2024-09-12T11:56:55.031 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T11:56:55.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T11:56:55.162 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901704' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: syntax: v2 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD0zUWu3MgPH4hFVOKp9xNNq3v4mt8KBEyECG7y0TOEOVn6syZl32PbbVAnVlwiKYcaE4FxIyE+DyNngcy104q4= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDE1C6vAy72EMF3goj0cL9zSgQxU7Jbg0z2fiSjMSUTz9fjScLsVcai65MfeSflxs/L3Cj/4aEwVm/ifqa8bD9c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T11:56:55.163 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T11:56:55.164 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T11:56:55.164 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T11:56:55.165 INFO:teuthology.task.internal:Checking packages... 2024-09-12T11:56:55.188 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T11:56:55.188 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T11:56:55.188 INFO:teuthology.packaging:ref: None 2024-09-12T11:56:55.188 INFO:teuthology.packaging:tag: None 2024-09-12T11:56:55.188 INFO:teuthology.packaging:branch: squid 2024-09-12T11:56:55.188 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T11:56:55.189 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-12T11:56:55.446 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314-g086c737f-1jammy 2024-09-12T11:56:55.448 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T11:56:55.454 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T11:56:55.454 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T11:56:55.466 INFO:teuthology.task.internal:Saving configuration 2024-09-12T11:56:55.483 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T11:56:55.490 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T11:56:55.522 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 11:51:08.693787', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE5G/OwC+yyr1dkKWreiFf1AZMOnjmtxhNtn+vPkKIqe'} 2024-09-12T11:56:55.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 11:51:08.691897', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFPBIsiVbxeV2S6Og1aWUL9Hv1nkKIf4Xv6JsgP6PZ63'} 2024-09-12T11:56:55.551 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T11:56:55.560 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-12T11:56:55.561 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-12T11:56:55.561 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T11:56:55.643 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff754594280>, signals=[15]) 2024-09-12T11:56:55.643 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T11:56:55.649 INFO:teuthology.task.internal:Opening connections... 2024-09-12T11:56:55.649 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T11:56:55.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:56:55.742 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T11:56:55.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:56:55.832 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T11:56:55.838 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-09-12T11:56:55.843 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-09-12T11:56:55.844 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-09-12T11:56:55.891 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T11:56:55.891 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Ubuntu" 2024-09-12T11:56:55.891 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="22.04" 2024-09-12T11:56:55.891 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T11:56:55.891 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_CODENAME=jammy 2024-09-12T11:56:55.892 INFO:teuthology.orchestra.run.smithi144.stdout:ID=ubuntu 2024-09-12T11:56:55.892 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE=debian 2024-09-12T11:56:55.892 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T11:56:55.892 INFO:teuthology.orchestra.run.smithi144.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T11:56:55.892 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T11:56:55.892 INFO:teuthology.orchestra.run.smithi144.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T11:56:55.892 INFO:teuthology.orchestra.run.smithi144.stdout:UBUNTU_CODENAME=jammy 2024-09-12T11:56:55.892 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-09-12T11:56:55.919 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-09-12T11:56:55.924 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-09-12T11:56:55.924 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-09-12T11:56:55.975 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="Ubuntu" 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="22.04" 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_CODENAME=jammy 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:ID=ubuntu 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE=debian 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T11:56:55.976 INFO:teuthology.orchestra.run.smithi165.stdout:UBUNTU_CODENAME=jammy 2024-09-12T11:56:55.977 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-09-12T11:56:56.011 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T11:56:56.021 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T11:56:56.026 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T11:56:56.027 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-09-12T11:56:56.029 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-09-12T11:56:56.033 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T11:56:56.039 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T11:56:56.040 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-09-12T11:56:56.077 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-09-12T11:56:56.169 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T11:56:56.243 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T11:56:56.258 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T11:56:56.258 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-12T11:56:56.258 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-12T11:56:56.259 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T11:56:56.259 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T11:56:56.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T11:56:56.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-12T11:56:56.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T11:56:56.276 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-12T11:56:56.444 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T11:56:56.444 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T11:56:56.445 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-12T11:56:56.450 INFO:teuthology.orchestra.run.smithi165.stdout:5.15.0-56-generic 2024-09-12T11:56:56.450 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T11:56:56.450 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T11:56:56.451 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-12T11:56:56.451 DEBUG:teuthology.orchestra.run.smithi165:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-12T11:56:56.452 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T11:56:56.452 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T11:56:56.452 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-12T11:56:56.458 INFO:teuthology.orchestra.run.smithi144.stdout:5.15.0-56-generic 2024-09-12T11:56:56.458 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T11:56:56.458 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T11:56:56.458 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-12T11:56:56.458 DEBUG:teuthology.orchestra.run.smithi144:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-12T11:56:56.506 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-12T11:56:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-12T11:56:56.627 INFO:teuthology.orchestra.run.smithi165.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-12T11:56:56.627 INFO:teuthology.orchestra.run.smithi165.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-12T11:56:56.628 INFO:teuthology.orchestra.run.smithi165.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-12T11:56:56.628 INFO:teuthology.orchestra.run.smithi165.stderr:hint: 2024-09-12T11:56:56.628 INFO:teuthology.orchestra.run.smithi165.stderr:hint: git config --global init.defaultBranch 2024-09-12T11:56:56.628 INFO:teuthology.orchestra.run.smithi165.stderr:hint: 2024-09-12T11:56:56.628 INFO:teuthology.orchestra.run.smithi165.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-12T11:56:56.628 INFO:teuthology.orchestra.run.smithi165.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-12T11:56:56.628 INFO:teuthology.orchestra.run.smithi165.stderr:hint: 2024-09-12T11:56:56.628 INFO:teuthology.orchestra.run.smithi165.stderr:hint: git branch -m 2024-09-12T11:56:56.629 INFO:teuthology.orchestra.run.smithi165.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-12T11:56:56.631 DEBUG:teuthology.orchestra.run.smithi165:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-12T11:56:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-12T11:56:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-12T11:56:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-12T11:56:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:hint: 2024-09-12T11:56:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:hint: git config --global init.defaultBranch 2024-09-12T11:56:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:hint: 2024-09-12T11:56:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-12T11:56:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-12T11:56:56.663 INFO:teuthology.orchestra.run.smithi144.stderr:hint: 2024-09-12T11:56:56.663 INFO:teuthology.orchestra.run.smithi144.stderr:hint: git branch -m 2024-09-12T11:56:56.663 INFO:teuthology.orchestra.run.smithi144.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-12T11:56:56.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-12T11:56:56.697 DEBUG:teuthology.orchestra.run.smithi165:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-12T11:56:56.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-12T11:56:56.755 DEBUG:teuthology.orchestra.run.smithi165:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-12T11:56:56.785 DEBUG:teuthology.orchestra.run.smithi144:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-12T11:57:21.018 INFO:teuthology.orchestra.run.smithi165.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-12T11:57:21.018 INFO:teuthology.orchestra.run.smithi165.stderr: * [new branch] main -> origin/main 2024-09-12T11:57:21.048 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20190312 -> 20190312 2024-09-12T11:57:21.048 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20190416 -> 20190416 2024-09-12T11:57:21.048 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20190514 -> 20190514 2024-09-12T11:57:21.048 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20190618 -> 20190618 2024-09-12T11:57:21.048 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20190717 -> 20190717 2024-09-12T11:57:21.049 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20190815 -> 20190815 2024-09-12T11:57:21.049 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20190923 -> 20190923 2024-09-12T11:57:21.049 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20191022 -> 20191022 2024-09-12T11:57:21.049 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20191215 -> 20191215 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20200122 -> 20200122 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20200316 -> 20200316 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20200421 -> 20200421 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20200519 -> 20200519 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20200619 -> 20200619 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20200721 -> 20200721 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20200817 -> 20200817 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20200918 -> 20200918 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20201022 -> 20201022 2024-09-12T11:57:21.052 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20201118 -> 20201118 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20201218 -> 20201218 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20210208 -> 20210208 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20210315 -> 20210315 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20210511 -> 20210511 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20210716 -> 20210716 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20210818 -> 20210818 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20210919 -> 20210919 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20211027 -> 20211027 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20211216 -> 20211216 2024-09-12T11:57:21.053 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20220209 -> 20220209 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20220310 -> 20220310 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20220411 -> 20220411 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20220509 -> 20220509 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20220610 -> 20220610 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20220708 -> 20220708 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20220815 -> 20220815 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20220913 -> 20220913 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20221012 -> 20221012 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20221109 -> 20221109 2024-09-12T11:57:21.054 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20221214 -> 20221214 2024-09-12T11:57:21.057 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20230117 -> 20230117 2024-09-12T11:57:21.057 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20230210 -> 20230210 2024-09-12T11:57:21.057 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20230310 -> 20230310 2024-09-12T11:57:21.057 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20230404 -> 20230404 2024-09-12T11:57:21.058 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20230515 -> 20230515 2024-09-12T11:57:21.058 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20230625 -> 20230625 2024-09-12T11:57:21.058 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20230804 -> 20230804 2024-09-12T11:57:21.058 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20230919 -> 20230919 2024-09-12T11:57:21.058 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20231030 -> 20231030 2024-09-12T11:57:21.058 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20231111 -> 20231111 2024-09-12T11:57:21.058 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20231211 -> 20231211 2024-09-12T11:57:21.058 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20240115 -> 20240115 2024-09-12T11:57:21.058 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20240220 -> 20240220 2024-09-12T11:57:21.059 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20240312 -> 20240312 2024-09-12T11:57:21.059 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20240410 -> 20240410 2024-09-12T11:57:21.059 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20240513 -> 20240513 2024-09-12T11:57:21.059 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20240610 -> 20240610 2024-09-12T11:57:21.059 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20240709 -> 20240709 2024-09-12T11:57:21.059 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20240811 -> 20240811 2024-09-12T11:57:21.059 INFO:teuthology.orchestra.run.smithi165.stderr: * [new tag] 20240909 -> 20240909 2024-09-12T11:57:23.883 INFO:teuthology.orchestra.run.smithi144.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-12T11:57:23.883 INFO:teuthology.orchestra.run.smithi144.stderr: * [new branch] main -> origin/main 2024-09-12T11:57:23.920 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20190312 -> 20190312 2024-09-12T11:57:23.920 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20190416 -> 20190416 2024-09-12T11:57:23.920 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20190514 -> 20190514 2024-09-12T11:57:23.920 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20190618 -> 20190618 2024-09-12T11:57:23.921 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20190717 -> 20190717 2024-09-12T11:57:23.921 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20190815 -> 20190815 2024-09-12T11:57:23.921 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20190923 -> 20190923 2024-09-12T11:57:23.922 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20191022 -> 20191022 2024-09-12T11:57:23.922 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20191215 -> 20191215 2024-09-12T11:57:23.922 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20200122 -> 20200122 2024-09-12T11:57:23.922 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20200316 -> 20200316 2024-09-12T11:57:23.923 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20200421 -> 20200421 2024-09-12T11:57:23.923 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20200519 -> 20200519 2024-09-12T11:57:23.923 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20200619 -> 20200619 2024-09-12T11:57:23.923 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20200721 -> 20200721 2024-09-12T11:57:23.923 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20200817 -> 20200817 2024-09-12T11:57:23.923 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20200918 -> 20200918 2024-09-12T11:57:23.923 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20201022 -> 20201022 2024-09-12T11:57:23.924 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20201118 -> 20201118 2024-09-12T11:57:23.924 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20201218 -> 20201218 2024-09-12T11:57:23.924 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20210208 -> 20210208 2024-09-12T11:57:23.924 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20210315 -> 20210315 2024-09-12T11:57:23.924 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20210511 -> 20210511 2024-09-12T11:57:23.924 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20210716 -> 20210716 2024-09-12T11:57:23.924 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20210818 -> 20210818 2024-09-12T11:57:23.925 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20210919 -> 20210919 2024-09-12T11:57:23.925 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20211027 -> 20211027 2024-09-12T11:57:23.926 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20211216 -> 20211216 2024-09-12T11:57:23.926 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20220209 -> 20220209 2024-09-12T11:57:23.926 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20220310 -> 20220310 2024-09-12T11:57:23.926 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20220411 -> 20220411 2024-09-12T11:57:23.926 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20220509 -> 20220509 2024-09-12T11:57:23.927 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20220610 -> 20220610 2024-09-12T11:57:23.927 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20220708 -> 20220708 2024-09-12T11:57:23.927 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20220815 -> 20220815 2024-09-12T11:57:23.927 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20220913 -> 20220913 2024-09-12T11:57:23.927 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20221012 -> 20221012 2024-09-12T11:57:23.927 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20221109 -> 20221109 2024-09-12T11:57:23.927 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20221214 -> 20221214 2024-09-12T11:57:23.928 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20230117 -> 20230117 2024-09-12T11:57:23.929 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20230210 -> 20230210 2024-09-12T11:57:23.929 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20230310 -> 20230310 2024-09-12T11:57:23.929 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20230404 -> 20230404 2024-09-12T11:57:23.929 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20230515 -> 20230515 2024-09-12T11:57:23.929 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20230625 -> 20230625 2024-09-12T11:57:23.929 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20230804 -> 20230804 2024-09-12T11:57:23.929 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20230919 -> 20230919 2024-09-12T11:57:23.929 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20231030 -> 20231030 2024-09-12T11:57:23.930 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20231111 -> 20231111 2024-09-12T11:57:23.930 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20231211 -> 20231211 2024-09-12T11:57:23.930 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20240115 -> 20240115 2024-09-12T11:57:23.930 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20240220 -> 20240220 2024-09-12T11:57:23.930 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20240312 -> 20240312 2024-09-12T11:57:23.931 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20240410 -> 20240410 2024-09-12T11:57:23.931 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20240513 -> 20240513 2024-09-12T11:57:23.931 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20240610 -> 20240610 2024-09-12T11:57:23.931 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20240709 -> 20240709 2024-09-12T11:57:23.931 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20240811 -> 20240811 2024-09-12T11:57:23.931 INFO:teuthology.orchestra.run.smithi144.stderr: * [new tag] 20240909 -> 20240909 2024-09-12T11:57:25.631 INFO:teuthology.orchestra.run.smithi165.stderr:Updating files: 44% (1563/3509) Updating files: 45% (1580/3509) Updating files: 46% (1615/3509) Updating files: 47% (1650/3509) Updating files: 48% (1685/3509) Updating files: 49% (1720/3509) Updating files: 50% (1755/3509) Updating files: 51% (1790/3509) Updating files: 52% (1825/3509) Updating files: 53% (1860/3509) Updating files: 54% (1895/3509) Updating files: 55% (1930/3509) Updating files: 56% (1966/3509) Updating files: 57% (2001/3509) Updating files: 58% (2036/3509) Updating files: 58% (2069/3509) Updating files: 59% (2071/3509) Updating files: 60% (2106/3509) Updating files: 61% (2141/3509) Updating files: 62% (2176/3509) Updating files: 63% (2211/3509) Updating files: 64% (2246/3509) Updating files: 65% (2281/3509) Updating files: 66% (2316/3509) Updating files: 67% (2352/3509) Updating files: 68% (2387/3509) Updating files: 69% (2422/3509) Updating files: 69% (2427/3509) Updating files: 70% (2457/3509) Updating files: 71% (2492/3509) Updating files: 72% (2527/3509) Updating files: 73% (2562/3509) Updating files: 74% (2597/3509) Updating files: 75% (2632/3509) Updating files: 76% (2667/3509) Updating files: 77% (2702/3509) Updating files: 78% (2738/3509) Updating files: 79% (2773/3509) Updating files: 80% (2808/3509) Updating files: 81% (2843/3509) Updating files: 82% (2878/3509) Updating files: 82% (2894/3509) Updating files: 83% (2913/3509) Updating files: 84% (2948/3509) Updating files: 85% (2983/3509) Updating files: 86% (3018/3509) Updating files: 87% (3053/3509) Updating files: 88% (3088/3509) Updating files: 89% (3124/3509) Updating files: 90% (3159/3509) Updating files: 91% (3194/3509) Updating files: 92% (3229/3509) Updating files: 93% (3264/3509) Updating files: 94% (3299/3509) Updating files: 95% (3334/3509) Updating files: 96% (3369/3509) Updating files: 97% (3404/3509) Updating files: 98% (3439/3509) Updating files: 99% (3474/3509) Updating files: 100% (3509/3509) Updating files: 100% (3509/3509), done. 2024-09-12T11:57:25.636 INFO:teuthology.orchestra.run.smithi165.stdout:HEAD is now at b7389eb8 Merge branch 'rb3gen2' into 'main' 2024-09-12T11:57:25.659 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-12T11:57:25.659 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T11:57:25.815 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-12T11:57:25.815 DEBUG:teuthology.orchestra.run.smithi165:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-12T11:57:25.818 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi165.front.sepia.ceph.com to complete... 2024-09-12T11:57:27.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12 11:57:27 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-12T11:57:27.389 INFO:teuthology.orchestra.run.smithi165.stderr:FINISHED --2024-09-12 11:57:27-- 2024-09-12T11:57:27.389 INFO:teuthology.orchestra.run.smithi165.stderr:Total wall clock time: 1.5s 2024-09-12T11:57:27.389 INFO:teuthology.orchestra.run.smithi165.stderr:Downloaded: 1 files, 43M in 1.3s (32.4 MB/s) 2024-09-12T11:57:27.393 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-12T11:57:27.393 DEBUG:teuthology.orchestra.run.smithi165:> sudo dpkg -i /tmp/linux-image.deb 2024-09-12T11:57:27.661 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-12T11:57:28.530 INFO:teuthology.orchestra.run.smithi144.stderr:Updating files: 38% (1358/3509) Updating files: 39% (1369/3509) Updating files: 40% (1404/3509) Updating files: 41% (1439/3509) Updating files: 42% (1474/3509) Updating files: 43% (1509/3509) Updating files: 44% (1544/3509) Updating files: 45% (1580/3509) Updating files: 46% (1615/3509) Updating files: 47% (1650/3509) Updating files: 48% (1685/3509) Updating files: 49% (1720/3509) Updating files: 50% (1755/3509) Updating files: 51% (1790/3509) Updating files: 52% (1825/3509) Updating files: 53% (1860/3509) Updating files: 54% (1895/3509) Updating files: 55% (1930/3509) Updating files: 56% (1966/3509) Updating files: 57% (2001/3509) Updating files: 58% (2036/3509) Updating files: 58% (2063/3509) Updating files: 59% (2071/3509) Updating files: 60% (2106/3509) Updating files: 61% (2141/3509) Updating files: 62% (2176/3509) Updating files: 63% (2211/3509) Updating files: 64% (2246/3509) Updating files: 65% (2281/3509) Updating files: 66% (2316/3509) Updating files: 67% (2352/3509) Updating files: 68% (2387/3509) Updating files: 69% (2422/3509) Updating files: 69% (2423/3509) Updating files: 70% (2457/3509) Updating files: 71% (2492/3509) Updating files: 72% (2527/3509) Updating files: 73% (2562/3509) Updating files: 74% (2597/3509) Updating files: 75% (2632/3509) Updating files: 76% (2667/3509) Updating files: 77% (2702/3509) Updating files: 78% (2738/3509) Updating files: 79% (2773/3509) Updating files: 80% (2808/3509) Updating files: 81% (2843/3509) Updating files: 82% (2878/3509) Updating files: 82% (2891/3509) Updating files: 83% (2913/3509) Updating files: 84% (2948/3509) Updating files: 85% (2983/3509) Updating files: 86% (3018/3509) Updating files: 87% (3053/3509) Updating files: 88% (3088/3509) Updating files: 89% (3124/3509) Updating files: 90% (3159/3509) Updating files: 91% (3194/3509) Updating files: 92% (3229/3509) Updating files: 93% (3264/3509) Updating files: 94% (3299/3509) Updating files: 95% (3334/3509) Updating files: 96% (3369/3509) Updating files: 97% (3404/3509) Updating files: 98% (3439/3509) Updating files: 99% (3474/3509) Updating files: 100% (3509/3509) Updating files: 100% (3509/3509), done. 2024-09-12T11:57:28.535 INFO:teuthology.orchestra.run.smithi144.stdout:HEAD is now at b7389eb8 Merge branch 'rb3gen2' into 'main' 2024-09-12T11:57:28.557 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T11:57:28.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T11:57:28.707 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-12T11:57:28.707 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-12T11:57:28.710 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi144.front.sepia.ceph.com to complete... 2024-09-12T11:57:29.624 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-12T11:57:29.628 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-12T11:57:29.777 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-12T11:57:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12 11:57:29 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-12T11:57:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:FINISHED --2024-09-12 11:57:29-- 2024-09-12T11:57:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:Total wall clock time: 1.0s 2024-09-12T11:57:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:Downloaded: 1 files, 43M in 0.9s (49.9 MB/s) 2024-09-12T11:57:29.843 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T11:57:29.843 DEBUG:teuthology.orchestra.run.smithi144:> sudo dpkg -i /tmp/linux-image.deb 2024-09-12T11:57:30.105 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-12T11:57:32.113 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-12T11:57:32.118 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-12T11:57:32.229 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-12T11:57:33.863 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-12T11:57:33.986 INFO:teuthology.orchestra.run.smithi165.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:36.224 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-12T11:57:36.333 INFO:teuthology.orchestra.run.smithi144.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:Sourcing file `/etc/default/grub' 2024-09-12T11:57:56.946 INFO:teuthology.orchestra.run.smithi165.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T11:57:56.975 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2024-09-12T11:57:57.382 INFO:teuthology.orchestra.run.smithi165.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:57.400 INFO:teuthology.orchestra.run.smithi165.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:57.765 INFO:teuthology.orchestra.run.smithi165.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T11:57:57.775 INFO:teuthology.orchestra.run.smithi165.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T11:57:57.848 INFO:teuthology.orchestra.run.smithi165.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T11:57:57.853 INFO:teuthology.orchestra.run.smithi165.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T11:57:57.999 INFO:teuthology.orchestra.run.smithi165.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T11:57:57.999 INFO:teuthology.orchestra.run.smithi165.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T11:57:57.999 INFO:teuthology.orchestra.run.smithi165.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T11:57:58.038 INFO:teuthology.orchestra.run.smithi165.stderr:done 2024-09-12T11:57:58.255 DEBUG:teuthology.orchestra.run.smithi165:> dpkg-deb -c /tmp/linux-image.deb 2024-09-12T11:57:58.262 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-12T11:57:58.263 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-12T11:57:58.263 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:58.280 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:58.280 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:58.303 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-12T11:57:58.303 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-12T11:57:58.303 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-12T11:57:58.303 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-12T11:57:58.303 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-12T11:57:58.303 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T11:57:58.304 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T11:57:58.305 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-12T11:57:58.306 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T11:57:58.307 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T11:57:58.307 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T11:57:58.320 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-12T11:57:58.320 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-12T11:57:58.320 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T11:57:58.321 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T11:57:58.322 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T11:57:58.323 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T11:57:58.324 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-12T11:57:58.325 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T11:57:58.326 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T11:57:58.327 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T11:57:58.328 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T11:57:58.329 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T11:57:58.329 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T11:57:58.329 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T11:57:58.329 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T11:57:58.329 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T11:57:58.329 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-12T11:57:58.329 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T11:57:58.329 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-12T11:57:58.329 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T11:57:58.330 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-12T11:57:58.331 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T11:57:58.332 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-12T11:57:58.332 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T11:57:58.380 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T11:57:58.380 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-12T11:57:58.380 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T11:57:58.380 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T11:57:58.380 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-12T11:57:58.380 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T11:57:58.380 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T11:57:58.381 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-12T11:57:58.382 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-12T11:57:58.383 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-12T11:57:58.384 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T11:57:58.385 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T11:57:58.386 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-12T11:57:58.387 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-12T11:57:58.388 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-12T11:57:58.389 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-12T11:57:58.390 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T11:57:58.391 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T11:57:58.392 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-12T11:57:58.393 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T11:57:58.394 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T11:57:58.395 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T11:57:58.396 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T11:57:58.397 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T11:57:58.398 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T11:57:58.399 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T11:57:58.400 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T11:57:58.401 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T11:57:58.402 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T11:57:58.403 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-12T11:57:58.404 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T11:57:58.405 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T11:57:58.406 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T11:57:58.407 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-12T11:57:58.408 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T11:57:58.409 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T11:57:58.410 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T11:57:58.411 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T11:57:58.412 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-12T11:57:58.413 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-12T11:57:58.414 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-12T11:57:58.415 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-12T11:57:58.416 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T11:57:58.417 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-12T11:57:58.418 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-12T11:57:58.419 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-12T11:57:58.420 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T11:57:58.421 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-12T11:57:58.422 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T11:57:58.423 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T11:57:58.424 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-12T11:57:58.425 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-12T11:57:58.426 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-12T11:57:58.427 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-12T11:57:58.428 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-12T11:57:58.429 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-12T11:57:58.430 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T11:57:58.431 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T11:57:58.432 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-12T11:57:58.432 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T11:57:58.473 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-12T11:57:58.474 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T11:57:58.475 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-12T11:57:58.476 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-12T11:57:58.477 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T11:57:58.478 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T11:57:58.479 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-12T11:57:58.480 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-12T11:57:58.481 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-12T11:57:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-12T11:57:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T11:57:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-12T11:57:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-12T11:57:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-12T11:57:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-12T11:57:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T11:57:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-12T11:57:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T11:57:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-12T11:57:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T11:57:58.485 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-12T11:57:58.486 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T11:57:58.487 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T11:57:58.488 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T11:57:58.489 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T11:57:58.490 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-12T11:57:58.491 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T11:57:58.492 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-12T11:57:58.493 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-12T11:57:58.494 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T11:57:58.495 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-12T11:57:58.496 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T11:57:58.497 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T11:57:58.498 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-12T11:57:58.499 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-12T11:57:58.500 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-12T11:57:58.501 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-12T11:57:58.502 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T11:57:58.503 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T11:57:58.504 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T11:57:58.505 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-12T11:57:58.506 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-12T11:57:58.507 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T11:57:58.508 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-12T11:57:58.509 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T11:57:58.510 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T11:57:58.511 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T11:57:58.512 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-12T11:57:58.513 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T11:57:58.514 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T11:57:58.514 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-12T11:57:58.514 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T11:57:58.514 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-12T11:57:58.514 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T11:57:58.514 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-12T11:57:58.554 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T11:57:58.555 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T11:57:58.556 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T11:57:58.557 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T11:57:58.557 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T11:57:58.557 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T11:57:58.557 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T11:57:58.557 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T11:57:58.557 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T11:57:58.557 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T11:57:58.557 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T11:57:58.557 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T11:57:58.560 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T11:57:58.560 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T11:57:58.561 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-12T11:57:58.562 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-12T11:57:58.563 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-12T11:57:58.564 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-12T11:57:58.565 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-12T11:57:58.566 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-12T11:57:58.567 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-12T11:57:58.568 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-12T11:57:58.569 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-12T11:57:58.570 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-12T11:57:58.571 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-12T11:57:58.572 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T11:57:58.573 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T11:57:58.574 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T11:57:58.575 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T11:57:58.576 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T11:57:58.577 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T11:57:58.578 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-12T11:57:58.579 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-12T11:57:58.580 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-12T11:57:58.581 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T11:57:58.582 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-12T11:57:58.583 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T11:57:58.584 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-12T11:57:58.585 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T11:57:58.586 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T11:57:58.587 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-12T11:57:58.588 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T11:57:58.589 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-12T11:57:58.590 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-12T11:57:58.591 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T11:57:58.592 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T11:57:58.593 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T11:57:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T11:57:58.595 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T11:57:58.596 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T11:57:58.597 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T11:57:58.598 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T11:57:58.638 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T11:57:58.638 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T11:57:58.638 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T11:57:58.638 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-12T11:57:58.638 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-12T11:57:58.638 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-12T11:57:58.638 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-12T11:57:58.639 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-12T11:57:58.640 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T11:57:58.641 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-12T11:57:58.642 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T11:57:58.643 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T11:57:58.644 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T11:57:58.645 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T11:57:58.646 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T11:57:58.647 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T11:57:58.648 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T11:57:58.649 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T11:57:58.650 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T11:57:58.651 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T11:57:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T11:57:58.653 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T11:57:58.654 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T11:57:58.655 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T11:57:58.656 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-12T11:57:58.657 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T11:57:58.658 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T11:57:58.659 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T11:57:58.660 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T11:57:58.661 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T11:57:58.662 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T11:57:58.663 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T11:57:58.664 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T11:57:58.665 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T11:57:58.666 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T11:57:58.667 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T11:57:58.668 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-12T11:57:58.669 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-12T11:57:58.670 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T11:57:58.671 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T11:57:58.672 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T11:57:58.673 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T11:57:58.674 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T11:57:58.675 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T11:57:58.676 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-12T11:57:58.677 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-12T11:57:58.678 INFO:teuthology.orchestra.run.smithi165.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-12T11:57:58.678 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-12T11:57:58.678 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-12T11:57:58.683 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:58.683 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:58.683 DEBUG:teuthology.orchestra.run.smithi165:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-12T11:57:58.690 INFO:teuthology.orchestra.run.smithi165.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-12T11:57:58.690 INFO:teuthology.orchestra.run.smithi165.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-12T11:57:58.690 INFO:teuthology.orchestra.run.smithi165.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-12T11:57:58.691 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-12T11:57:58.691 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:58.691 DEBUG:teuthology.orchestra.run.smithi165:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-12T11:57:58.739 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi165.front.sepia.ceph.com to complete... 2024-09-12T11:57:58.970 INFO:teuthology.orchestra.run.smithi144.stderr:Sourcing file `/etc/default/grub' 2024-09-12T11:57:58.988 INFO:teuthology.orchestra.run.smithi144.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T11:57:59.012 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-09-12T11:57:59.180 INFO:teuthology.orchestra.run.smithi165.stderr:Sourcing file `/etc/default/grub' 2024-09-12T11:57:59.181 INFO:teuthology.orchestra.run.smithi165.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T11:57:59.202 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2024-09-12T11:57:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:59.336 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:59.502 INFO:teuthology.orchestra.run.smithi165.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:59.509 INFO:teuthology.orchestra.run.smithi165.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:57:59.617 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T11:57:59.624 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T11:57:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T11:57:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T11:57:59.820 INFO:teuthology.orchestra.run.smithi165.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T11:57:59.826 INFO:teuthology.orchestra.run.smithi165.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T11:57:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T11:57:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T11:57:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T11:57:59.873 INFO:teuthology.orchestra.run.smithi165.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T11:57:59.878 INFO:teuthology.orchestra.run.smithi165.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T11:57:59.908 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-09-12T11:58:00.010 INFO:teuthology.orchestra.run.smithi165.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T11:58:00.011 INFO:teuthology.orchestra.run.smithi165.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T11:58:00.011 INFO:teuthology.orchestra.run.smithi165.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T11:58:00.027 INFO:teuthology.orchestra.run.smithi165.stderr:done 2024-09-12T11:58:00.066 DEBUG:teuthology.orchestra.run.smithi144:> dpkg-deb -c /tmp/linux-image.deb 2024-09-12T11:58:00.073 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-12T11:58:00.073 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-12T11:58:00.073 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:58:00.088 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:58:00.088 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:58:00.109 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-12T11:58:00.109 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-12T11:58:00.110 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-12T11:58:00.111 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-12T11:58:00.111 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-12T11:58:00.111 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T11:58:00.111 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T11:58:00.111 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T11:58:00.111 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T11:58:00.111 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T11:58:00.112 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T11:58:00.112 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T11:58:00.112 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T11:58:00.113 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T11:58:00.113 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T11:58:00.113 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T11:58:00.113 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T11:58:00.113 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T11:58:00.113 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T11:58:00.113 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T11:58:00.114 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T11:58:00.114 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T11:58:00.114 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T11:58:00.114 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T11:58:00.114 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-12T11:58:00.114 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-12T11:58:00.114 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-12T11:58:00.115 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T11:58:00.115 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-12T11:58:00.115 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-12T11:58:00.115 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-12T11:58:00.115 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T11:58:00.116 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T11:58:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T11:58:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-12T11:58:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-12T11:58:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-12T11:58:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-12T11:58:00.189 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T11:58:00.190 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T11:58:00.191 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T11:58:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T11:58:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T11:58:00.196 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T11:58:00.196 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T11:58:00.196 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T11:58:00.196 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-12T11:58:00.196 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T11:58:00.196 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-12T11:58:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T11:58:00.198 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T11:58:00.199 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T11:58:00.200 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T11:58:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T11:58:00.202 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-12T11:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T11:58:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T11:58:00.205 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-12T11:58:00.206 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-12T11:58:00.207 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-12T11:58:00.208 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T11:58:00.209 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-12T11:58:00.210 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-12T11:58:00.211 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-12T11:58:00.212 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-12T11:58:00.213 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T11:58:00.214 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-12T11:58:00.215 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T11:58:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T11:58:00.217 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T11:58:00.218 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T11:58:00.219 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T11:58:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T11:58:00.221 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T11:58:00.222 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T11:58:00.223 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T11:58:00.224 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T11:58:00.225 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T11:58:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T11:58:00.227 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T11:58:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T11:58:00.229 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-12T11:58:00.230 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T11:58:00.231 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T11:58:00.232 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T11:58:00.233 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T11:58:00.234 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-12T11:58:00.235 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-12T11:58:00.236 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-12T11:58:00.237 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-12T11:58:00.238 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T11:58:00.239 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T11:58:00.240 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-12T11:58:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-12T11:58:00.242 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T11:58:00.243 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T11:58:00.244 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T11:58:00.245 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T11:58:00.246 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-12T11:58:00.247 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-12T11:58:00.248 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-12T11:58:00.249 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-12T11:58:00.250 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T11:58:00.251 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T11:58:00.252 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T11:58:00.253 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T11:58:00.254 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-12T11:58:00.255 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T11:58:00.256 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T11:58:00.257 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-12T11:58:00.257 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T11:58:00.257 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T11:58:00.320 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-12T11:58:00.320 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-12T11:58:00.320 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T11:58:00.320 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-12T11:58:00.320 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-12T11:58:00.320 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T11:58:00.320 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-12T11:58:00.320 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-12T11:58:00.321 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-12T11:58:00.322 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-12T11:58:00.323 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T11:58:00.324 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T11:58:00.325 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-12T11:58:00.326 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T11:58:00.327 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T11:58:00.327 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-12T11:58:00.327 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T11:58:00.327 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-12T11:58:00.327 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T11:58:00.327 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-12T11:58:00.327 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T11:58:00.327 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T11:58:00.327 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T11:58:00.328 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T11:58:00.329 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T11:58:00.330 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-12T11:58:00.331 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T11:58:00.332 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-12T11:58:00.333 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T11:58:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T11:58:00.335 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T11:58:00.336 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T11:58:00.337 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T11:58:00.338 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-12T11:58:00.339 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T11:58:00.340 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T11:58:00.341 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-12T11:58:00.342 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-12T11:58:00.343 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-12T11:58:00.344 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T11:58:00.345 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T11:58:00.346 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T11:58:00.347 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-12T11:58:00.348 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-12T11:58:00.349 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-12T11:58:00.350 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T11:58:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T11:58:00.352 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-12T11:58:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T11:58:00.354 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-12T11:58:00.355 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-12T11:58:00.356 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-12T11:58:00.357 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T11:58:00.358 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T11:58:00.359 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T11:58:00.360 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T11:58:00.361 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-12T11:58:00.362 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-12T11:58:00.363 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-12T11:58:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-12T11:58:00.365 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-12T11:58:00.366 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-12T11:58:00.367 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-12T11:58:00.368 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-12T11:58:00.369 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T11:58:00.370 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T11:58:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T11:58:00.372 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T11:58:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T11:58:00.374 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T11:58:00.375 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T11:58:00.376 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T11:58:00.377 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-12T11:58:00.378 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T11:58:00.379 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-12T11:58:00.380 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-12T11:58:00.380 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-12T11:58:00.380 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-12T11:58:00.380 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-12T11:58:00.380 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-12T11:58:00.380 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T11:58:00.380 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T11:58:00.381 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-12T11:58:00.382 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T11:58:00.383 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-12T11:58:00.384 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-12T11:58:00.385 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-12T11:58:00.386 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-12T11:58:00.387 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-12T11:58:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T11:58:00.389 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-12T11:58:00.389 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T11:58:00.389 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-12T11:58:00.389 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-12T11:58:00.389 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-12T11:58:00.389 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T11:58:00.433 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-12T11:58:00.434 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-12T11:58:00.435 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-12T11:58:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T11:58:00.437 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T11:58:00.438 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T11:58:00.439 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T11:58:00.440 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T11:58:00.441 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-12T11:58:00.442 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T11:58:00.443 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-12T11:58:00.444 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T11:58:00.445 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T11:58:00.446 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-12T11:58:00.446 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T11:58:00.446 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T11:58:00.446 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-12T11:58:00.446 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T11:58:00.446 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-12T11:58:00.446 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T11:58:00.447 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T11:58:00.448 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T11:58:00.449 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T11:58:00.450 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T11:58:00.451 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T11:58:00.452 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-12T11:58:00.453 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T11:58:00.454 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-12T11:58:00.455 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T11:58:00.456 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T11:58:00.457 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T11:58:00.458 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T11:58:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T11:58:00.460 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T11:58:00.461 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-12T11:58:00.462 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T11:58:00.463 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T11:58:00.464 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T11:58:00.465 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T11:58:00.466 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T11:58:00.467 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T11:58:00.468 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T11:58:00.469 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T11:58:00.469 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T11:58:00.469 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-12T11:58:00.469 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-12T11:58:00.469 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-12T11:58:00.469 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T11:58:00.469 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T11:58:00.469 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T11:58:00.469 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T11:58:00.470 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T11:58:00.471 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T11:58:00.472 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T11:58:00.473 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T11:58:00.474 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-12T11:58:00.475 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T11:58:00.476 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T11:58:00.477 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T11:58:00.478 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T11:58:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T11:58:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T11:58:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T11:58:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T11:58:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-12T11:58:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T11:58:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T11:58:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-12T11:58:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-12T11:58:00.480 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T11:58:00.481 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T11:58:00.482 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-12T11:58:00.483 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-12T11:58:00.484 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-12T11:58:00.488 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:58:00.488 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:58:00.488 DEBUG:teuthology.orchestra.run.smithi144:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-12T11:58:00.494 INFO:teuthology.orchestra.run.smithi144.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-12T11:58:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-12T11:58:00.495 INFO:teuthology.orchestra.run.smithi144.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-12T11:58:00.495 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-12T11:58:00.495 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:58:00.495 DEBUG:teuthology.orchestra.run.smithi144:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-12T11:58:00.541 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi144.front.sepia.ceph.com to complete... 2024-09-12T11:58:00.958 INFO:teuthology.orchestra.run.smithi144.stderr:Sourcing file `/etc/default/grub' 2024-09-12T11:58:00.959 INFO:teuthology.orchestra.run.smithi144.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T11:58:00.993 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-09-12T11:58:01.177 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:58:01.183 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:58:01.405 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T11:58:01.410 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T11:58:01.448 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T11:58:01.453 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T11:58:01.566 INFO:teuthology.orchestra.run.smithi144.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T11:58:01.567 INFO:teuthology.orchestra.run.smithi144.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T11:58:01.567 INFO:teuthology.orchestra.run.smithi144.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T11:58:01.583 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-09-12T11:58:31.155 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-12T11:58:31.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-12T11:58:31.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:58:32.708 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T11:58:32.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-12T11:58:32.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:59:05.794 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-12T11:59:14.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-12T11:59:14.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:59:32.752 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T11:59:41.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-12T11:59:41.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:59:42.814 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-09-12T11:59:54.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-12T11:59:54.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:59:55.055 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-12T11:59:55.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-12T11:59:55.712 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T11:59:55.712 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-12T11:59:55.762 INFO:teuthology.orchestra.run.smithi144.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:59:55.762 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T11:59:55.762 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T11:59:55.762 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T11:59:56.764 DEBUG:teuthology.parallel:result is None 2024-09-12T12:00:14.815 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T12:00:26.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-12T12:00:26.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:00:27.163 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-12T12:00:27.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-12T12:00:27.806 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T12:00:27.806 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-12T12:00:27.858 INFO:teuthology.orchestra.run.smithi165.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:00:27.858 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T12:00:27.858 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T12:00:27.858 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T12:00:28.859 DEBUG:teuthology.parallel:result is None 2024-09-12T12:00:28.860 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T12:00:28.881 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T12:00:28.882 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:00:28.885 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:00:28.894 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T12:00:28.905 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T12:00:28.918 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T12:00:28.919 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:00:28.937 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:00:28.970 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T12:00:28.978 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T12:00:28.978 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:00:29.002 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:00:29.080 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:29.108 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:29.119 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:29.138 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:29.140 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T12:00:29.149 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T12:00:29.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:00:29.153 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:00:29.174 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T12:00:29.188 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T12:00:29.188 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:00:29.217 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:00:29.226 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:00:29.274 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:00:29.331 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:00:29.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:00:29.401 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:00:29.411 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:00:29.466 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:00:29.466 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:00:29.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-09-12T12:00:29.544 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-09-12T12:00:29.676 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T12:00:29.687 INFO:teuthology.task.internal:Starting timer... 2024-09-12T12:00:29.688 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T12:00:29.711 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T12:00:29.725 DEBUG:teuthology.task.selinux:Excluding smithi144: OS 'ubuntu' does not support SELinux 2024-09-12T12:00:29.725 DEBUG:teuthology.task.selinux:Excluding smithi165: OS 'ubuntu' does not support SELinux 2024-09-12T12:00:29.725 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T12:00:29.725 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T12:00:29.725 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T12:00:29.726 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T12:00:29.739 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T12:00:29.751 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T12:00:29.753 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi144.front.sepia.ceph.com,smithi165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T12:08:51.055 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi144.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com')] 2024-09-12T12:08:51.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-12T12:08:51.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:08:51.157 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-12T12:08:51.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-12T12:08:51.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-12T12:08:51.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:08:51.393 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-12T12:08:51.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-12T12:08:51.511 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T12:08:51.522 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T12:08:51.522 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:08:51.523 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:08:51.527 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:08:51.527 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:08:51.566 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T12:08:51.566 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: Command line: ntpd -gq 2024-09-12T12:08:51.566 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: ---------------------------------------------------- 2024-09-12T12:08:51.566 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T12:08:51.566 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T12:08:51.566 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: corporation. Support and training for ntp-4 are 2024-09-12T12:08:51.566 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: available at https://www.nwtime.org/support 2024-09-12T12:08:51.567 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: ---------------------------------------------------- 2024-09-12T12:08:51.567 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: proto: precision = 0.042 usec (-24) 2024-09-12T12:08:51.567 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: basedate set to 2022-02-04 2024-09-12T12:08:51.567 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: gps base set to 2022-02-06 (week 2196) 2024-09-12T12:08:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T12:08:51.567 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T12:08:51.568 INFO:teuthology.orchestra.run.smithi144.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T12:08:51.568 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T12:08:51.569 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T12:08:51.569 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T12:08:51.569 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T12:08:51.569 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: Listen normally on 3 enp3s0f1 172.21.15.144:123 2024-09-12T12:08:51.569 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: Listen normally on 4 lo [::1]:123 2024-09-12T12:08:51.569 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f5f%5]:123 2024-09-12T12:08:51.569 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:51 ntpd[18483]: Listening on routing socket on fd #22 for interface updates 2024-09-12T12:08:51.592 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T12:08:51.592 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: Command line: ntpd -gq 2024-09-12T12:08:51.592 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: ---------------------------------------------------- 2024-09-12T12:08:51.592 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T12:08:51.592 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T12:08:51.593 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: corporation. Support and training for ntp-4 are 2024-09-12T12:08:51.593 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: available at https://www.nwtime.org/support 2024-09-12T12:08:51.593 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: ---------------------------------------------------- 2024-09-12T12:08:51.593 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: proto: precision = 0.042 usec (-24) 2024-09-12T12:08:51.594 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: basedate set to 2022-02-04 2024-09-12T12:08:51.594 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: gps base set to 2022-02-06 (week 2196) 2024-09-12T12:08:51.594 INFO:teuthology.orchestra.run.smithi165.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T12:08:51.594 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T12:08:51.594 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T12:08:51.595 INFO:teuthology.orchestra.run.smithi165.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T12:08:51.596 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T12:08:51.596 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T12:08:51.596 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T12:08:51.596 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: Listen normally on 3 enp3s0f1 172.21.15.165:123 2024-09-12T12:08:51.596 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: Listen normally on 4 lo [::1]:123 2024-09-12T12:08:51.596 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f63%5]:123 2024-09-12T12:08:51.596 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:51 ntpd[18475]: Listening on routing socket on fd #22 for interface updates 2024-09-12T12:08:52.563 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:52 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:52.564 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:52 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:52.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:52 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:52.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:52 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:52.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:52 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:52.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:52 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:52.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:52 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:52.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:52 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:53 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:53.592 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:53 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:53.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:53 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:54.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:54.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:54.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:54.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:54.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:54.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:54.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:54.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:54.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:54.595 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:54.595 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:54.595 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:54 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:55.564 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:55.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:55.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:55.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:55.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:55.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:55 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:55.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:55 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:55.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:55 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:55.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:55 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:55.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:55 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:55.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:55 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:55.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:55 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:56.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:56.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:56.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:56.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:56.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:56.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:56.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:56.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:56.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:56.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:56.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:56.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:56 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:57.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:57 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:57.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:57 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:57.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:57 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:57.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:57 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:57.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:57 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:57.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:57 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:57.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:57 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:58.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:58.593 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:58.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:58.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:58.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:58.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:58.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:58.594 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:12 Sep 12:08:58 ntpd[18475]: ntpd: time slew -0.000587 s 2024-09-12T12:08:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:ntpd: time slew -0.000587s 2024-09-12T12:08:58.595 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T12:08:58.595 INFO:teuthology.orchestra.run.smithi165.stderr:12 Sep 12:08:58 ntpd[18475]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T12:08:58.736 INFO:teuthology.orchestra.run.smithi165.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T12:08:58.736 INFO:teuthology.orchestra.run.smithi165.stdout:============================================================================== 2024-09-12T12:08:58.736 INFO:teuthology.orchestra.run.smithi165.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T12:08:58.736 INFO:teuthology.orchestra.run.smithi165.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T12:08:58.736 INFO:teuthology.orchestra.run.smithi165.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T12:08:58.736 INFO:teuthology.orchestra.run.smithi165.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T12:08:59.564 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:59.564 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:59.564 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:59.564 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:59.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:59.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:59.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T12:08:59.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T12:08:59.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T12:08:59.565 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T12:08:59.565 INFO:teuthology.orchestra.run.smithi144.stdout:12 Sep 12:08:59 ntpd[18483]: ntpd: time slew -0.002271 s 2024-09-12T12:08:59.565 INFO:teuthology.orchestra.run.smithi144.stdout:ntpd: time slew -0.002271s 2024-09-12T12:08:59.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T12:08:59.566 INFO:teuthology.orchestra.run.smithi144.stderr:12 Sep 12:08:59 ntpd[18483]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T12:08:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T12:08:59.677 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================== 2024-09-12T12:08:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T12:08:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T12:08:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T12:08:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T12:08:59.678 INFO:teuthology.run_tasks:Running task install... 2024-09-12T12:08:59.687 DEBUG:teuthology.task.install:project ceph 2024-09-12T12:08:59.687 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T12:08:59.687 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T12:08:59.687 INFO:teuthology.task.install:Using flavor: default 2024-09-12T12:08:59.692 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T12:08:59.692 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T12:08:59.693 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-key list | grep Ceph 2024-09-12T12:08:59.693 DEBUG:teuthology.orchestra.run.smithi165:> sudo apt-key list | grep Ceph 2024-09-12T12:08:59.797 INFO:teuthology.orchestra.run.smithi165.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T12:08:59.825 INFO:teuthology.orchestra.run.smithi144.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T12:08:59.848 INFO:teuthology.orchestra.run.smithi165.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T12:08:59.849 INFO:teuthology.orchestra.run.smithi165.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T12:08:59.850 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-12T12:08:59.850 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-12T12:08:59.850 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T12:08:59.876 INFO:teuthology.orchestra.run.smithi144.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T12:08:59.877 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-12T12:08:59.877 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-12T12:08:59.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:09:00.013 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-12T12:09:00.014 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T12:09:00.039 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-12T12:09:00.039 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T12:09:00.147 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:09:00.147 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T12:09:00.158 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:09:00.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T12:09:00.166 DEBUG:teuthology.orchestra.run.smithi165:> sudo apt-get update 2024-09-12T12:09:00.177 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2024-09-12T12:09:00.348 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T12:09:00.355 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T12:09:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T12:09:00.364 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T12:09:00.371 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T12:09:00.372 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T12:09:00.388 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T12:09:00.402 INFO:teuthology.orchestra.run.smithi165.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T12:09:00.415 INFO:teuthology.orchestra.run.smithi144.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T12:09:00.424 INFO:teuthology.orchestra.run.smithi165.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-12T12:09:00.436 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-12T12:09:00.448 INFO:teuthology.orchestra.run.smithi165.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T12:09:00.459 INFO:teuthology.orchestra.run.smithi144.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T12:09:00.466 INFO:teuthology.orchestra.run.smithi165.stdout:Hit:7 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T12:09:00.471 INFO:teuthology.orchestra.run.smithi165.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-12T12:09:00.495 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-12T12:09:00.507 INFO:teuthology.orchestra.run.smithi165.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-12T12:09:00.527 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-12T12:09:00.953 INFO:teuthology.orchestra.run.smithi165.stdout:Fetched 29.0 kB in 1s (51.5 kB/s) 2024-09-12T12:09:00.961 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 29.0 kB in 1s (52.3 kB/s) 2024-09-12T12:09:02.005 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-09-12T12:09:02.011 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-09-12T12:09:02.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy cephfs-shell=19.1.1-298-gb53b6d3e-1jammy cephfs-top=19.1.1-298-gb53b6d3e-1jammy cephfs-mirror=19.1.1-298-gb53b6d3e-1jammy 2024-09-12T12:09:02.027 DEBUG:teuthology.orchestra.run.smithi165:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy cephfs-shell=19.1.1-298-gb53b6d3e-1jammy cephfs-top=19.1.1-298-gb53b6d3e-1jammy cephfs-mirror=19.1.1-298-gb53b6d3e-1jammy 2024-09-12T12:09:02.097 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-09-12T12:09:02.104 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-09-12T12:09:02.285 INFO:teuthology.orchestra.run.smithi165.stdout:Building dependency tree... 2024-09-12T12:09:02.285 INFO:teuthology.orchestra.run.smithi165.stdout:Reading state information... 2024-09-12T12:09:02.287 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2024-09-12T12:09:02.287 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2024-09-12T12:09:02.475 INFO:teuthology.orchestra.run.smithi165.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T12:09:02.475 INFO:teuthology.orchestra.run.smithi165.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T12:09:02.475 INFO:teuthology.orchestra.run.smithi165.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T12:09:02.475 INFO:teuthology.orchestra.run.smithi165.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T12:09:02.476 INFO:teuthology.orchestra.run.smithi165.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T12:09:02.476 INFO:teuthology.orchestra.run.smithi165.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T12:09:02.476 INFO:teuthology.orchestra.run.smithi165.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T12:09:02.476 INFO:teuthology.orchestra.run.smithi165.stdout:The following additional packages will be installed: 2024-09-12T12:09:02.476 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T12:09:02.478 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T12:09:02.478 INFO:teuthology.orchestra.run.smithi165.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T12:09:02.478 INFO:teuthology.orchestra.run.smithi165.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T12:09:02.478 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T12:09:02.478 INFO:teuthology.orchestra.run.smithi165.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-12T12:09:02.479 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-12T12:09:02.480 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-12T12:09:02.480 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-12T12:09:02.480 INFO:teuthology.orchestra.run.smithi165.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-12T12:09:02.480 INFO:teuthology.orchestra.run.smithi165.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-12T12:09:02.480 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-12T12:09:02.480 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-12T12:09:02.480 INFO:teuthology.orchestra.run.smithi165.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-12T12:09:02.481 INFO:teuthology.orchestra.run.smithi165.stdout:Suggested packages: 2024-09-12T12:09:02.481 INFO:teuthology.orchestra.run.smithi165.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T12:09:02.481 INFO:teuthology.orchestra.run.smithi165.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T12:09:02.481 INFO:teuthology.orchestra.run.smithi165.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T12:09:02.482 INFO:teuthology.orchestra.run.smithi165.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T12:09:02.482 INFO:teuthology.orchestra.run.smithi165.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T12:09:02.482 INFO:teuthology.orchestra.run.smithi165.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T12:09:02.482 INFO:teuthology.orchestra.run.smithi165.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T12:09:02.482 INFO:teuthology.orchestra.run.smithi165.stdout:Recommended packages: 2024-09-12T12:09:02.482 INFO:teuthology.orchestra.run.smithi165.stdout: btrfs-tools 2024-09-12T12:09:02.483 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T12:09:02.483 INFO:teuthology.orchestra.run.smithi144.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T12:09:02.483 INFO:teuthology.orchestra.run.smithi144.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T12:09:02.483 INFO:teuthology.orchestra.run.smithi144.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T12:09:02.483 INFO:teuthology.orchestra.run.smithi144.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T12:09:02.483 INFO:teuthology.orchestra.run.smithi144.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T12:09:02.483 INFO:teuthology.orchestra.run.smithi144.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T12:09:02.485 INFO:teuthology.orchestra.run.smithi144.stdout:The following additional packages will be installed: 2024-09-12T12:09:02.485 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-12T12:09:02.486 INFO:teuthology.orchestra.run.smithi144.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-12T12:09:02.487 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2024-09-12T12:09:02.488 INFO:teuthology.orchestra.run.smithi144.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T12:09:02.488 INFO:teuthology.orchestra.run.smithi144.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T12:09:02.488 INFO:teuthology.orchestra.run.smithi144.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T12:09:02.488 INFO:teuthology.orchestra.run.smithi144.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T12:09:02.488 INFO:teuthology.orchestra.run.smithi144.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T12:09:02.488 INFO:teuthology.orchestra.run.smithi144.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T12:09:02.488 INFO:teuthology.orchestra.run.smithi144.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T12:09:02.488 INFO:teuthology.orchestra.run.smithi144.stdout:Recommended packages: 2024-09-12T12:09:02.488 INFO:teuthology.orchestra.run.smithi144.stdout: btrfs-tools 2024-09-12T12:09:02.637 INFO:teuthology.orchestra.run.smithi165.stdout:The following NEW packages will be installed: 2024-09-12T12:09:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T12:09:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T12:09:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-12T12:09:02.638 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-12T12:09:02.639 INFO:teuthology.orchestra.run.smithi165.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-12T12:09:02.641 INFO:teuthology.orchestra.run.smithi165.stdout: socat unzip xmlstarlet zip 2024-09-12T12:09:02.643 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2024-09-12T12:09:02.643 INFO:teuthology.orchestra.run.smithi144.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T12:09:02.643 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T12:09:02.643 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-12T12:09:02.643 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T12:09:02.644 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-12T12:09:02.645 INFO:teuthology.orchestra.run.smithi144.stdout: socat unzip xmlstarlet zip 2024-09-12T12:09:02.713 INFO:teuthology.orchestra.run.smithi144.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-09-12T12:09:02.713 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 181 MB of archives. 2024-09-12T12:09:02.713 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-12T12:09:02.713 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-12T12:09:02.731 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T12:09:02.741 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-12T12:09:02.782 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T12:09:02.802 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T12:09:02.805 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T12:09:02.816 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T12:09:02.821 INFO:teuthology.orchestra.run.smithi165.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-09-12T12:09:02.821 INFO:teuthology.orchestra.run.smithi165.stdout:Need to get 181 MB of archives. 2024-09-12T12:09:02.822 INFO:teuthology.orchestra.run.smithi165.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-12T12:09:02.822 INFO:teuthology.orchestra.run.smithi165.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-12T12:09:02.836 INFO:teuthology.orchestra.run.smithi165.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-12T12:09:02.854 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T12:09:02.856 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T12:09:02.860 INFO:teuthology.orchestra.run.smithi144.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-12T12:09:02.864 INFO:teuthology.orchestra.run.smithi144.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T12:09:02.866 INFO:teuthology.orchestra.run.smithi144.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T12:09:02.867 INFO:teuthology.orchestra.run.smithi144.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T12:09:02.873 INFO:teuthology.orchestra.run.smithi144.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T12:09:02.875 INFO:teuthology.orchestra.run.smithi144.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T12:09:02.877 INFO:teuthology.orchestra.run.smithi144.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T12:09:02.878 INFO:teuthology.orchestra.run.smithi144.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T12:09:02.878 INFO:teuthology.orchestra.run.smithi144.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T12:09:02.890 INFO:teuthology.orchestra.run.smithi144.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T12:09:02.892 INFO:teuthology.orchestra.run.smithi144.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T12:09:02.894 INFO:teuthology.orchestra.run.smithi144.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T12:09:02.894 INFO:teuthology.orchestra.run.smithi144.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T12:09:02.907 INFO:teuthology.orchestra.run.smithi144.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T12:09:02.908 INFO:teuthology.orchestra.run.smithi144.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T12:09:02.908 INFO:teuthology.orchestra.run.smithi144.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T12:09:02.909 INFO:teuthology.orchestra.run.smithi144.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T12:09:02.909 INFO:teuthology.orchestra.run.smithi144.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T12:09:02.910 INFO:teuthology.orchestra.run.smithi144.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T12:09:02.919 INFO:teuthology.orchestra.run.smithi165.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T12:09:02.924 INFO:teuthology.orchestra.run.smithi144.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T12:09:02.925 INFO:teuthology.orchestra.run.smithi144.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T12:09:02.927 INFO:teuthology.orchestra.run.smithi144.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T12:09:02.928 INFO:teuthology.orchestra.run.smithi144.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T12:09:02.941 INFO:teuthology.orchestra.run.smithi144.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T12:09:02.942 INFO:teuthology.orchestra.run.smithi144.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T12:09:02.943 INFO:teuthology.orchestra.run.smithi144.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T12:09:02.943 INFO:teuthology.orchestra.run.smithi144.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T12:09:02.943 INFO:teuthology.orchestra.run.smithi144.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T12:09:02.945 INFO:teuthology.orchestra.run.smithi144.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T12:09:02.958 INFO:teuthology.orchestra.run.smithi144.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T12:09:02.959 INFO:teuthology.orchestra.run.smithi144.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T12:09:02.963 INFO:teuthology.orchestra.run.smithi144.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T12:09:02.964 INFO:teuthology.orchestra.run.smithi144.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T12:09:02.964 INFO:teuthology.orchestra.run.smithi165.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-12T12:09:02.975 INFO:teuthology.orchestra.run.smithi144.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T12:09:02.976 INFO:teuthology.orchestra.run.smithi144.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T12:09:02.977 INFO:teuthology.orchestra.run.smithi144.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T12:09:02.979 INFO:teuthology.orchestra.run.smithi144.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T12:09:02.979 INFO:teuthology.orchestra.run.smithi144.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T12:09:02.981 INFO:teuthology.orchestra.run.smithi144.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T12:09:02.994 INFO:teuthology.orchestra.run.smithi144.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T12:09:02.996 INFO:teuthology.orchestra.run.smithi144.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T12:09:02.996 INFO:teuthology.orchestra.run.smithi144.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T12:09:02.997 INFO:teuthology.orchestra.run.smithi144.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T12:09:03.011 INFO:teuthology.orchestra.run.smithi144.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T12:09:03.055 INFO:teuthology.orchestra.run.smithi144.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T12:09:03.055 INFO:teuthology.orchestra.run.smithi144.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T12:09:03.057 INFO:teuthology.orchestra.run.smithi144.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T12:09:03.057 INFO:teuthology.orchestra.run.smithi144.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T12:09:03.059 INFO:teuthology.orchestra.run.smithi144.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T12:09:03.077 INFO:teuthology.orchestra.run.smithi144.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T12:09:03.080 INFO:teuthology.orchestra.run.smithi144.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T12:09:03.080 INFO:teuthology.orchestra.run.smithi144.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T12:09:03.096 INFO:teuthology.orchestra.run.smithi144.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T12:09:03.097 INFO:teuthology.orchestra.run.smithi144.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T12:09:03.098 INFO:teuthology.orchestra.run.smithi144.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T12:09:03.098 INFO:teuthology.orchestra.run.smithi144.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T12:09:03.099 INFO:teuthology.orchestra.run.smithi144.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T12:09:03.099 INFO:teuthology.orchestra.run.smithi144.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T12:09:03.107 INFO:teuthology.orchestra.run.smithi144.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T12:09:03.108 INFO:teuthology.orchestra.run.smithi144.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T12:09:03.111 INFO:teuthology.orchestra.run.smithi144.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T12:09:03.125 INFO:teuthology.orchestra.run.smithi144.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T12:09:03.126 INFO:teuthology.orchestra.run.smithi144.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T12:09:03.127 INFO:teuthology.orchestra.run.smithi144.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T12:09:03.130 INFO:teuthology.orchestra.run.smithi144.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T12:09:03.133 INFO:teuthology.orchestra.run.smithi144.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-12T12:09:03.133 INFO:teuthology.orchestra.run.smithi144.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T12:09:03.134 INFO:teuthology.orchestra.run.smithi144.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T12:09:03.142 INFO:teuthology.orchestra.run.smithi144.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T12:09:03.146 INFO:teuthology.orchestra.run.smithi144.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T12:09:03.147 INFO:teuthology.orchestra.run.smithi144.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T12:09:03.159 INFO:teuthology.orchestra.run.smithi144.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T12:09:03.159 INFO:teuthology.orchestra.run.smithi144.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T12:09:03.160 INFO:teuthology.orchestra.run.smithi144.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T12:09:03.160 INFO:teuthology.orchestra.run.smithi144.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T12:09:03.162 INFO:teuthology.orchestra.run.smithi144.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T12:09:03.162 INFO:teuthology.orchestra.run.smithi165.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T12:09:03.163 INFO:teuthology.orchestra.run.smithi144.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T12:09:03.169 INFO:teuthology.orchestra.run.smithi144.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T12:09:03.176 INFO:teuthology.orchestra.run.smithi144.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T12:09:03.176 INFO:teuthology.orchestra.run.smithi144.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T12:09:03.178 INFO:teuthology.orchestra.run.smithi144.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T12:09:03.193 INFO:teuthology.orchestra.run.smithi144.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T12:09:03.255 INFO:teuthology.orchestra.run.smithi165.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T12:09:03.255 INFO:teuthology.orchestra.run.smithi165.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-12T12:09:03.267 INFO:teuthology.orchestra.run.smithi165.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T12:09:03.309 INFO:teuthology.orchestra.run.smithi144.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-12T12:09:03.317 INFO:teuthology.orchestra.run.smithi165.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T12:09:03.423 INFO:teuthology.orchestra.run.smithi165.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-12T12:09:03.457 INFO:teuthology.orchestra.run.smithi165.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-12T12:09:03.465 INFO:teuthology.orchestra.run.smithi165.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-12T12:09:03.465 INFO:teuthology.orchestra.run.smithi165.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-12T12:09:03.481 INFO:teuthology.orchestra.run.smithi165.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-12T12:09:03.491 INFO:teuthology.orchestra.run.smithi165.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T12:09:03.499 INFO:teuthology.orchestra.run.smithi165.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-12T12:09:03.499 INFO:teuthology.orchestra.run.smithi165.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T12:09:03.526 INFO:teuthology.orchestra.run.smithi165.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T12:09:03.535 INFO:teuthology.orchestra.run.smithi165.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T12:09:03.535 INFO:teuthology.orchestra.run.smithi165.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T12:09:03.549 INFO:teuthology.orchestra.run.smithi165.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-12T12:09:03.554 INFO:teuthology.orchestra.run.smithi165.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T12:09:03.558 INFO:teuthology.orchestra.run.smithi165.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T12:09:03.562 INFO:teuthology.orchestra.run.smithi165.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T12:09:03.564 INFO:teuthology.orchestra.run.smithi165.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T12:09:03.573 INFO:teuthology.orchestra.run.smithi165.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T12:09:03.611 INFO:teuthology.orchestra.run.smithi144.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-12T12:09:03.633 INFO:teuthology.orchestra.run.smithi144.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-12T12:09:03.647 INFO:teuthology.orchestra.run.smithi165.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T12:09:03.649 INFO:teuthology.orchestra.run.smithi165.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T12:09:03.650 INFO:teuthology.orchestra.run.smithi165.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T12:09:03.651 INFO:teuthology.orchestra.run.smithi165.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T12:09:03.652 INFO:teuthology.orchestra.run.smithi165.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T12:09:03.653 INFO:teuthology.orchestra.run.smithi144.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-12T12:09:03.653 INFO:teuthology.orchestra.run.smithi144.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-12T12:09:03.655 INFO:teuthology.orchestra.run.smithi165.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T12:09:03.655 INFO:teuthology.orchestra.run.smithi144.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-12T12:09:03.656 INFO:teuthology.orchestra.run.smithi165.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T12:09:03.656 INFO:teuthology.orchestra.run.smithi165.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T12:09:03.656 INFO:teuthology.orchestra.run.smithi144.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-12T12:09:03.656 INFO:teuthology.orchestra.run.smithi165.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T12:09:03.685 INFO:teuthology.orchestra.run.smithi144.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-12T12:09:03.735 INFO:teuthology.orchestra.run.smithi165.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T12:09:03.736 INFO:teuthology.orchestra.run.smithi165.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T12:09:03.736 INFO:teuthology.orchestra.run.smithi165.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T12:09:03.738 INFO:teuthology.orchestra.run.smithi165.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T12:09:03.739 INFO:teuthology.orchestra.run.smithi165.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T12:09:03.795 INFO:teuthology.orchestra.run.smithi165.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-12T12:09:03.817 INFO:teuthology.orchestra.run.smithi165.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T12:09:03.817 INFO:teuthology.orchestra.run.smithi165.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T12:09:03.818 INFO:teuthology.orchestra.run.smithi165.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T12:09:03.818 INFO:teuthology.orchestra.run.smithi165.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T12:09:03.819 INFO:teuthology.orchestra.run.smithi165.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T12:09:03.829 INFO:teuthology.orchestra.run.smithi165.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-12T12:09:03.857 INFO:teuthology.orchestra.run.smithi165.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-12T12:09:03.898 INFO:teuthology.orchestra.run.smithi165.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T12:09:03.898 INFO:teuthology.orchestra.run.smithi165.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T12:09:03.899 INFO:teuthology.orchestra.run.smithi165.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T12:09:03.904 INFO:teuthology.orchestra.run.smithi165.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T12:09:03.904 INFO:teuthology.orchestra.run.smithi165.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T12:09:03.979 INFO:teuthology.orchestra.run.smithi165.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T12:09:03.980 INFO:teuthology.orchestra.run.smithi165.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T12:09:03.981 INFO:teuthology.orchestra.run.smithi165.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T12:09:03.982 INFO:teuthology.orchestra.run.smithi165.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T12:09:03.983 INFO:teuthology.orchestra.run.smithi165.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T12:09:04.061 INFO:teuthology.orchestra.run.smithi165.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T12:09:04.061 INFO:teuthology.orchestra.run.smithi165.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T12:09:04.063 INFO:teuthology.orchestra.run.smithi165.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T12:09:04.064 INFO:teuthology.orchestra.run.smithi165.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T12:09:04.065 INFO:teuthology.orchestra.run.smithi165.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T12:09:04.142 INFO:teuthology.orchestra.run.smithi165.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T12:09:04.252 INFO:teuthology.orchestra.run.smithi165.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T12:09:04.253 INFO:teuthology.orchestra.run.smithi165.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T12:09:04.254 INFO:teuthology.orchestra.run.smithi165.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T12:09:04.254 INFO:teuthology.orchestra.run.smithi165.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T12:09:04.255 INFO:teuthology.orchestra.run.smithi165.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T12:09:04.328 INFO:teuthology.orchestra.run.smithi165.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T12:09:04.330 INFO:teuthology.orchestra.run.smithi165.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T12:09:04.330 INFO:teuthology.orchestra.run.smithi165.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T12:09:04.401 INFO:teuthology.orchestra.run.smithi165.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T12:09:04.401 INFO:teuthology.orchestra.run.smithi165.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T12:09:04.416 INFO:teuthology.orchestra.run.smithi165.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T12:09:04.416 INFO:teuthology.orchestra.run.smithi165.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T12:09:04.417 INFO:teuthology.orchestra.run.smithi165.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T12:09:04.418 INFO:teuthology.orchestra.run.smithi165.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T12:09:04.418 INFO:teuthology.orchestra.run.smithi165.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T12:09:04.419 INFO:teuthology.orchestra.run.smithi165.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T12:09:04.422 INFO:teuthology.orchestra.run.smithi165.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T12:09:04.497 INFO:teuthology.orchestra.run.smithi165.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T12:09:04.499 INFO:teuthology.orchestra.run.smithi165.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T12:09:04.500 INFO:teuthology.orchestra.run.smithi165.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T12:09:04.574 INFO:teuthology.orchestra.run.smithi165.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-12T12:09:04.579 INFO:teuthology.orchestra.run.smithi165.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T12:09:04.581 INFO:teuthology.orchestra.run.smithi165.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-12T12:09:04.582 INFO:teuthology.orchestra.run.smithi165.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T12:09:04.583 INFO:teuthology.orchestra.run.smithi165.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T12:09:04.583 INFO:teuthology.orchestra.run.smithi165.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T12:09:04.588 INFO:teuthology.orchestra.run.smithi165.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T12:09:04.589 INFO:teuthology.orchestra.run.smithi165.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T12:09:04.660 INFO:teuthology.orchestra.run.smithi165.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T12:09:04.660 INFO:teuthology.orchestra.run.smithi165.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T12:09:04.661 INFO:teuthology.orchestra.run.smithi165.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T12:09:04.741 INFO:teuthology.orchestra.run.smithi165.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T12:09:04.743 INFO:teuthology.orchestra.run.smithi165.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T12:09:04.743 INFO:teuthology.orchestra.run.smithi165.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T12:09:04.752 INFO:teuthology.orchestra.run.smithi165.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T12:09:04.752 INFO:teuthology.orchestra.run.smithi165.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T12:09:04.752 INFO:teuthology.orchestra.run.smithi165.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T12:09:04.754 INFO:teuthology.orchestra.run.smithi165.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T12:09:04.823 INFO:teuthology.orchestra.run.smithi165.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T12:09:04.932 INFO:teuthology.orchestra.run.smithi165.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-12T12:09:04.940 INFO:teuthology.orchestra.run.smithi165.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-12T12:09:04.974 INFO:teuthology.orchestra.run.smithi165.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-12T12:09:05.021 INFO:teuthology.orchestra.run.smithi165.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-12T12:09:05.166 INFO:teuthology.orchestra.run.smithi165.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-12T12:09:05.838 INFO:teuthology.orchestra.run.smithi165.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-12T12:09:05.859 INFO:teuthology.orchestra.run.smithi165.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-12T12:09:05.896 INFO:teuthology.orchestra.run.smithi165.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-12T12:09:05.962 INFO:teuthology.orchestra.run.smithi165.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-12T12:09:05.974 INFO:teuthology.orchestra.run.smithi165.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-12T12:09:05.988 INFO:teuthology.orchestra.run.smithi165.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-12T12:09:06.051 INFO:teuthology.orchestra.run.smithi165.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-12T12:09:06.318 INFO:teuthology.orchestra.run.smithi165.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-12T12:09:06.323 INFO:teuthology.orchestra.run.smithi165.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-12T12:09:07.599 INFO:teuthology.orchestra.run.smithi144.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-12T12:09:07.600 INFO:teuthology.orchestra.run.smithi144.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-12T12:09:07.917 INFO:teuthology.orchestra.run.smithi165.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-12T12:09:07.918 INFO:teuthology.orchestra.run.smithi165.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-298-gb53b6d3e-1jammy [237 kB] 2024-09-12T12:09:07.920 INFO:teuthology.orchestra.run.smithi165.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-298-gb53b6d3e-1jammy [34.0 kB] 2024-09-12T12:09:07.929 INFO:teuthology.orchestra.run.smithi165.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-298-gb53b6d3e-1jammy [23.5 kB] 2024-09-12T12:09:07.930 INFO:teuthology.orchestra.run.smithi165.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-12T12:09:07.959 INFO:teuthology.orchestra.run.smithi165.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-12T12:09:08.352 INFO:teuthology.orchestra.run.smithi165.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-12T12:09:08.415 INFO:teuthology.orchestra.run.smithi144.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-12T12:09:09.017 INFO:teuthology.orchestra.run.smithi144.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-12T12:09:09.026 INFO:teuthology.orchestra.run.smithi165.stdout:Fetched 181 MB in 6s (31.7 MB/s) 2024-09-12T12:09:09.094 INFO:teuthology.orchestra.run.smithi144.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-12T12:09:09.096 INFO:teuthology.orchestra.run.smithi144.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-12T12:09:09.098 INFO:teuthology.orchestra.run.smithi144.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-12T12:09:09.124 INFO:teuthology.orchestra.run.smithi144.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-12T12:09:09.150 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-12T12:09:09.214 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-12T12:09:09.218 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-12T12:09:09.227 INFO:teuthology.orchestra.run.smithi144.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-12T12:09:09.332 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-12T12:09:09.606 INFO:teuthology.orchestra.run.smithi144.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-12T12:09:09.606 INFO:teuthology.orchestra.run.smithi144.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-12T12:09:09.613 INFO:teuthology.orchestra.run.smithi144.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-12T12:09:09.634 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T12:09:09.647 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T12:09:09.654 INFO:teuthology.orchestra.run.smithi144.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-12T12:09:09.666 INFO:teuthology.orchestra.run.smithi144.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-12T12:09:09.669 INFO:teuthology.orchestra.run.smithi144.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-12T12:09:09.692 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T12:09:09.707 INFO:teuthology.orchestra.run.smithi144.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-12T12:09:09.850 INFO:teuthology.orchestra.run.smithi144.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-12T12:09:09.851 INFO:teuthology.orchestra.run.smithi144.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-12T12:09:10.012 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-cmd2. 2024-09-12T12:09:10.026 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-12T12:09:10.070 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-12T12:09:10.423 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T12:09:10.437 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T12:09:10.523 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T12:09:10.706 INFO:teuthology.orchestra.run.smithi144.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-12T12:09:10.707 INFO:teuthology.orchestra.run.smithi144.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-298-gb53b6d3e-1jammy [237 kB] 2024-09-12T12:09:10.709 INFO:teuthology.orchestra.run.smithi144.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-298-gb53b6d3e-1jammy [34.0 kB] 2024-09-12T12:09:10.710 INFO:teuthology.orchestra.run.smithi144.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-298-gb53b6d3e-1jammy [23.5 kB] 2024-09-12T12:09:10.710 INFO:teuthology.orchestra.run.smithi144.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-12T12:09:10.711 INFO:teuthology.orchestra.run.smithi144.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-12T12:09:10.868 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T12:09:10.883 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T12:09:10.926 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T12:09:10.926 INFO:teuthology.orchestra.run.smithi144.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-12T12:09:11.221 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T12:09:11.236 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T12:09:11.295 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T12:09:11.582 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 181 MB in 8s (21.9 MB/s) 2024-09-12T12:09:11.736 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-12T12:09:11.757 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T12:09:11.772 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T12:09:11.799 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-12T12:09:11.803 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-12T12:09:11.823 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:09:11.843 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-12T12:09:12.104 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T12:09:12.118 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T12:09:12.162 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T12:09:12.235 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T12:09:12.249 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T12:09:12.293 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:09:12.498 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cmd2. 2024-09-12T12:09:12.512 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-12T12:09:12.557 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-12T12:09:12.646 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T12:09:12.661 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T12:09:12.704 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:09:13.057 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T12:09:13.072 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T12:09:13.115 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T12:09:13.185 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T12:09:13.199 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T12:09:13.285 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T12:09:13.426 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package librados2. 2024-09-12T12:09:13.441 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../010-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:13.484 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:13.605 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T12:09:13.620 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T12:09:13.663 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T12:09:13.920 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package librbd1. 2024-09-12T12:09:13.934 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../011-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:13.971 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:14.033 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T12:09:14.049 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T12:09:14.083 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T12:09:14.356 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T12:09:14.370 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:14.423 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:14.487 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T12:09:14.502 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T12:09:14.553 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:09:14.733 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-rados. 2024-09-12T12:09:14.747 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../013-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:14.800 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:14.982 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T12:09:14.997 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T12:09:15.040 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:09:15.202 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T12:09:15.217 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:15.269 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:15.385 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T12:09:15.400 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T12:09:15.435 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:09:15.555 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T12:09:15.569 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:15.613 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:15.754 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T12:09:15.769 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T12:09:15.813 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T12:09:15.957 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T12:09:15.973 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:16.024 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:16.140 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librados2. 2024-09-12T12:09:16.155 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../010-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:16.199 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:16.443 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T12:09:16.459 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T12:09:16.518 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T12:09:16.627 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librbd1. 2024-09-12T12:09:16.642 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../011-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:16.676 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:16.829 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T12:09:16.844 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:16.896 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:17.055 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T12:09:17.069 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:17.112 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:17.323 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T12:09:17.338 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T12:09:17.382 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rados. 2024-09-12T12:09:17.390 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T12:09:17.397 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../013-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:17.440 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:17.717 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T12:09:17.732 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T12:09:17.775 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T12:09:17.784 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T12:09:17.800 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:17.877 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:18.120 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T12:09:18.121 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T12:09:18.135 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T12:09:18.136 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:18.170 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:18.187 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T12:09:18.465 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T12:09:18.480 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:18.523 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:18.573 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package lua5.1. 2024-09-12T12:09:18.588 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T12:09:18.631 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T12:09:18.852 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T12:09:18.867 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T12:09:18.910 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T12:09:18.968 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package lua-any. 2024-09-12T12:09:18.982 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-12T12:09:19.026 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T12:09:19.196 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T12:09:19.211 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:19.254 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:19.303 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package zip. 2024-09-12T12:09:19.318 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-12T12:09:19.353 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T12:09:19.573 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T12:09:19.588 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T12:09:19.615 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package unzip. 2024-09-12T12:09:19.623 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T12:09:19.630 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T12:09:19.664 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T12:09:19.884 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T12:09:19.900 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T12:09:19.943 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T12:09:20.110 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package luarocks. 2024-09-12T12:09:20.125 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T12:09:20.167 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T12:09:20.239 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T12:09:20.253 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T12:09:20.295 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T12:09:20.558 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package librgw2. 2024-09-12T12:09:20.572 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../027-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:20.616 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:20.641 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package lua5.1. 2024-09-12T12:09:20.656 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T12:09:20.699 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T12:09:20.969 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package lua-any. 2024-09-12T12:09:20.984 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-12T12:09:21.019 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T12:09:21.110 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T12:09:21.125 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:21.169 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:21.296 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package zip. 2024-09-12T12:09:21.311 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-12T12:09:21.354 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T12:09:21.513 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T12:09:21.527 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T12:09:21.571 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T12:09:21.683 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package unzip. 2024-09-12T12:09:21.698 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T12:09:21.741 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T12:09:21.893 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T12:09:21.902 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:21.941 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:22.103 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package luarocks. 2024-09-12T12:09:22.118 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T12:09:22.153 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T12:09:22.385 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-common. 2024-09-12T12:09:22.399 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../031-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:22.443 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:22.527 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librgw2. 2024-09-12T12:09:22.542 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../027-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:22.585 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:23.230 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T12:09:23.244 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:23.283 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:23.498 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-base. 2024-09-12T12:09:23.513 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../032-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:23.557 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:23.633 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T12:09:23.647 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T12:09:23.691 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T12:09:23.994 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T12:09:24.009 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:24.052 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:24.110 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T12:09:24.125 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T12:09:24.160 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T12:09:24.498 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-common. 2024-09-12T12:09:24.512 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../031-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:24.564 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:24.697 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T12:09:24.710 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T12:09:24.755 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T12:09:25.122 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T12:09:25.137 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T12:09:25.182 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T12:09:25.485 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T12:09:25.499 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T12:09:25.543 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T12:09:25.686 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-base. 2024-09-12T12:09:25.701 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../032-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:25.753 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:25.821 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T12:09:25.835 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T12:09:25.870 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T12:09:26.107 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T12:09:26.124 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T12:09:26.165 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T12:09:26.315 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T12:09:26.329 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T12:09:26.373 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T12:09:26.442 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-portend. 2024-09-12T12:09:26.457 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-12T12:09:26.492 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T12:09:26.676 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T12:09:26.690 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T12:09:26.734 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T12:09:26.737 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T12:09:26.752 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T12:09:26.795 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T12:09:27.088 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T12:09:27.098 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T12:09:27.103 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T12:09:27.113 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T12:09:27.145 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T12:09:27.156 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T12:09:27.423 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T12:09:27.439 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T12:09:27.473 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T12:09:27.492 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T12:09:27.507 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T12:09:27.551 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T12:09:27.743 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T12:09:27.758 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T12:09:27.793 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T12:09:27.895 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T12:09:27.911 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T12:09:27.953 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T12:09:28.079 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T12:09:28.094 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T12:09:28.137 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T12:09:28.256 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T12:09:28.272 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T12:09:28.306 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T12:09:28.473 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-portend. 2024-09-12T12:09:28.489 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-12T12:09:28.531 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T12:09:28.550 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-mako. 2024-09-12T12:09:28.566 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T12:09:28.600 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T12:09:28.784 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T12:09:28.800 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T12:09:28.834 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T12:09:28.937 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T12:09:28.952 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T12:09:28.995 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T12:09:29.096 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T12:09:29.111 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T12:09:29.154 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T12:09:29.297 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T12:09:29.313 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T12:09:29.356 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T12:09:29.491 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T12:09:29.505 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T12:09:29.540 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T12:09:29.617 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-webob. 2024-09-12T12:09:29.632 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T12:09:29.675 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T12:09:29.819 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T12:09:29.834 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T12:09:29.902 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T12:09:30.011 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T12:09:30.026 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T12:09:30.072 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T12:09:30.205 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T12:09:30.220 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T12:09:30.263 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T12:09:30.389 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T12:09:30.404 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T12:09:30.447 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T12:09:30.612 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-mako. 2024-09-12T12:09:30.627 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T12:09:30.674 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T12:09:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-paste. 2024-09-12T12:09:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T12:09:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T12:09:31.011 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T12:09:31.026 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T12:09:31.069 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T12:09:31.094 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T12:09:31.109 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T12:09:31.146 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T12:09:31.356 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T12:09:31.371 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T12:09:31.405 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T12:09:31.465 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T12:09:31.481 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T12:09:31.523 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T12:09:31.700 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-webob. 2024-09-12T12:09:31.715 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T12:09:31.758 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T12:09:31.801 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T12:09:31.816 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T12:09:31.851 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T12:09:32.104 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T12:09:32.118 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T12:09:32.128 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T12:09:32.143 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T12:09:32.153 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T12:09:32.189 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T12:09:32.497 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T12:09:32.513 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T12:09:32.525 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T12:09:32.539 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T12:09:32.555 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T12:09:32.574 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T12:09:32.875 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-paste. 2024-09-12T12:09:32.885 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-idna. 2024-09-12T12:09:32.890 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T12:09:32.903 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T12:09:32.933 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T12:09:32.943 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T12:09:33.245 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T12:09:33.260 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T12:09:33.271 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T12:09:33.287 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T12:09:33.295 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T12:09:33.330 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T12:09:33.573 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T12:09:33.588 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T12:09:33.631 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T12:09:33.649 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-requests. 2024-09-12T12:09:33.665 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T12:09:33.707 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T12:09:33.934 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T12:09:33.949 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T12:09:33.992 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T12:09:34.044 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T12:09:34.059 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T12:09:34.102 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T12:09:34.329 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T12:09:34.343 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T12:09:34.380 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T12:09:34.387 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T12:09:34.395 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:34.438 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:34.725 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T12:09:34.737 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T12:09:34.774 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T12:09:35.136 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-idna. 2024-09-12T12:09:35.151 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T12:09:35.194 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T12:09:35.801 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T12:09:35.804 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T12:09:35.816 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:35.817 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T12:09:35.851 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:36.154 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T12:09:36.169 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T12:09:36.211 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T12:09:36.330 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T12:09:36.523 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T12:09:36.538 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T12:09:36.581 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T12:09:36.667 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-requests. 2024-09-12T12:09:36.680 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T12:09:36.717 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T12:09:36.909 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T12:09:36.924 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:36.959 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:37.064 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T12:09:37.076 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T12:09:37.113 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T12:09:37.320 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T12:09:37.335 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:37.367 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T12:09:37.378 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:37.378 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:37.408 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:37.780 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T12:09:37.791 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:37.829 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:37.990 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T12:09:38.005 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:38.048 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T12:09:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T12:09:38.174 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T12:09:38.710 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T12:09:38.725 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T12:09:38.768 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T12:09:38.801 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph. 2024-09-12T12:09:38.816 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../068-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:38.859 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:39.128 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T12:09:39.130 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T12:09:39.144 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:39.145 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:39.195 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:39.213 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:39.556 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T12:09:39.567 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T12:09:39.571 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:39.580 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:39.614 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:39.624 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:40.000 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package cephadm. 2024-09-12T12:09:40.016 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../071-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:40.058 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:40.186 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T12:09:40.200 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:40.244 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:40.328 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T12:09:40.343 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T12:09:40.377 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T12:09:40.722 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T12:09:40.744 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T12:09:40.772 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T12:09:41.023 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph. 2024-09-12T12:09:41.036 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../068-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:41.073 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:41.426 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T12:09:41.439 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:41.484 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:41.787 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T12:09:41.800 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:41.836 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:41.935 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-babel. 2024-09-12T12:09:41.949 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T12:09:41.993 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T12:09:42.240 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package cephadm. 2024-09-12T12:09:42.253 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../071-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:42.298 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:42.320 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T12:09:42.334 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T12:09:42.379 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T12:09:42.585 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T12:09:42.598 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T12:09:42.634 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T12:09:42.715 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T12:09:42.729 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:42.773 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:42.945 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T12:09:42.958 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T12:09:42.987 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T12:09:43.168 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T12:09:43.183 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T12:09:43.226 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T12:09:43.587 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-routes. 2024-09-12T12:09:43.602 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T12:09:43.653 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T12:09:43.958 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-babel. 2024-09-12T12:09:43.973 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T12:09:43.974 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T12:09:43.989 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:44.017 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T12:09:44.031 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:44.361 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T12:09:44.375 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T12:09:44.419 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T12:09:44.764 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T12:09:44.775 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:44.814 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:45.159 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T12:09:45.174 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T12:09:45.217 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T12:09:45.344 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T12:09:45.359 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T12:09:45.403 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T12:09:45.503 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-routes. 2024-09-12T12:09:45.516 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T12:09:45.553 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T12:09:45.881 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T12:09:45.896 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T12:09:45.923 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T12:09:45.931 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T12:09:45.939 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:45.981 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:46.292 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T12:09:46.307 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T12:09:46.436 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T12:09:46.780 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T12:09:46.796 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T12:09:46.830 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T12:09:47.161 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T12:09:47.174 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T12:09:47.236 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T12:09:47.463 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T12:09:47.478 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:47.522 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:47.740 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T12:09:47.752 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T12:09:47.789 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T12:09:48.160 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T12:09:48.172 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T12:09:48.287 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T12:09:48.590 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T12:09:48.603 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T12:09:48.616 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T12:09:48.632 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T12:09:48.673 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T12:09:48.683 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T12:09:49.035 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T12:09:49.051 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T12:09:49.102 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T12:09:49.299 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T12:09:49.312 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:49.341 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:49.514 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T12:09:49.529 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T12:09:49.580 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T12:09:49.866 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T12:09:49.882 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-12T12:09:49.924 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T12:09:50.236 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T12:09:50.251 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T12:09:50.294 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T12:09:50.311 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T12:09:50.324 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T12:09:50.369 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T12:09:50.623 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T12:09:50.638 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T12:09:50.680 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T12:09:50.697 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T12:09:50.711 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T12:09:50.764 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T12:09:51.034 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T12:09:51.050 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T12:09:51.092 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T12:09:51.093 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T12:09:51.105 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T12:09:51.150 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T12:09:51.412 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T12:09:51.427 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T12:09:51.461 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T12:09:51.462 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T12:09:51.475 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-12T12:09:51.553 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T12:09:51.874 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T12:09:51.887 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T12:09:51.932 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T12:09:52.133 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T12:09:52.148 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:52.191 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:52.268 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T12:09:52.282 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T12:09:52.326 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T12:09:52.511 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T12:09:52.525 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T12:09:52.569 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T12:09:52.671 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T12:09:52.685 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T12:09:52.746 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T12:09:52.863 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T12:09:52.878 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T12:09:52.913 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T12:09:53.141 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T12:09:53.155 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T12:09:53.208 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T12:09:53.216 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package jq. 2024-09-12T12:09:53.231 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T12:09:53.274 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T12:09:53.527 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package socat. 2024-09-12T12:09:53.542 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T12:09:53.585 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T12:09:53.879 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T12:09:53.895 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T12:09:53.946 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T12:09:54.105 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T12:09:54.118 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:54.155 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:54.309 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-test. 2024-09-12T12:09:54.323 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../099-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:54.392 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:54.591 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T12:09:54.605 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T12:09:54.641 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T12:09:54.978 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T12:09:54.991 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T12:09:55.035 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T12:09:55.314 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package jq. 2024-09-12T12:09:55.327 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T12:09:55.372 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T12:09:55.641 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package socat. 2024-09-12T12:09:55.655 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T12:09:55.699 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T12:09:56.012 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T12:09:56.025 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T12:09:56.061 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T12:09:56.382 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-test. 2024-09-12T12:09:56.394 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../099-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:56.431 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:56.495 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T12:09:56.511 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:56.553 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:56.957 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-12T12:09:56.973 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:57.015 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:57.310 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-colorama. 2024-09-12T12:09:57.326 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-12T12:09:57.368 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-12T12:09:57.570 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package cephfs-shell. 2024-09-12T12:09:57.586 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:57.628 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:57.889 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package cephfs-top. 2024-09-12T12:09:57.906 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:57.948 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:58.225 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T12:09:58.240 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:58.283 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:58.386 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T12:09:58.400 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:58.444 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:58.594 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T12:09:58.610 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T12:09:58.652 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T12:09:58.823 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-12T12:09:58.837 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:09:58.881 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:58.990 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T12:09:59.006 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T12:09:59.047 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T12:09:59.218 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-colorama. 2024-09-12T12:09:59.232 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-12T12:09:59.276 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-12T12:09:59.418 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T12:09:59.434 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T12:09:59.468 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T12:09:59.537 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package cephfs-shell. 2024-09-12T12:09:59.551 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:59.586 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:09:59.864 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package pkg-config. 2024-09-12T12:09:59.872 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package cephfs-top. 2024-09-12T12:09:59.880 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T12:09:59.886 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T12:09:59.923 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T12:09:59.930 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:00.183 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T12:10:00.184 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T12:10:00.197 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:10:00.198 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T12:10:00.241 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:00.258 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T12:10:00.586 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T12:10:00.600 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T12:10:00.644 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T12:10:00.719 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T12:10:00.734 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T12:10:00.777 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T12:10:00.982 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T12:10:00.996 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T12:10:01.040 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T12:10:01.089 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T12:10:01.103 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T12:10:01.147 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T12:10:01.428 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T12:10:01.442 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T12:10:01.467 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T12:10:01.482 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T12:10:01.485 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T12:10:01.525 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T12:10:01.811 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T12:10:01.826 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T12:10:01.883 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package pkg-config. 2024-09-12T12:10:01.896 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T12:10:01.897 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T12:10:01.933 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T12:10:02.169 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T12:10:02.183 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T12:10:02.227 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T12:10:02.255 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-py. 2024-09-12T12:10:02.271 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-12T12:10:02.313 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T12:10:02.625 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T12:10:02.641 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T12:10:02.680 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T12:10:02.683 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T12:10:02.695 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T12:10:02.738 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T12:10:03.041 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T12:10:03.056 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T12:10:03.099 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T12:10:03.178 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T12:10:03.193 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T12:10:03.236 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T12:10:03.453 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T12:10:03.466 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T12:10:03.489 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-toml. 2024-09-12T12:10:03.506 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-12T12:10:03.511 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T12:10:03.539 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T12:10:03.808 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T12:10:03.823 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T12:10:03.830 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T12:10:03.845 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T12:10:03.866 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T12:10:03.889 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T12:10:04.178 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T12:10:04.193 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T12:10:04.228 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T12:10:04.242 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-py. 2024-09-12T12:10:04.256 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-12T12:10:04.300 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T12:10:04.506 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T12:10:04.522 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T12:10:04.555 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T12:10:04.628 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T12:10:04.642 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T12:10:04.686 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T12:10:05.157 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T12:10:05.170 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T12:10:05.215 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T12:10:05.300 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package radosgw. 2024-09-12T12:10:05.315 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../122-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:10:05.551 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-toml. 2024-09-12T12:10:05.565 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-12T12:10:05.600 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:05.609 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T12:10:05.879 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T12:10:05.893 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T12:10:05.929 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T12:10:06.229 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T12:10:06.244 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:10:06.295 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:06.417 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T12:10:06.418 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T12:10:06.418 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T12:10:06.631 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T12:10:06.644 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T12:10:06.658 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T12:10:06.702 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T12:10:06.917 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T12:10:07.042 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T12:10:07.304 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T12:10:07.422 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package radosgw. 2024-09-12T12:10:07.436 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../122-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:10:07.480 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:07.724 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T12:10:08.109 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T12:10:08.123 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T12:10:08.166 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:08.337 INFO:teuthology.orchestra.run.smithi165.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T12:10:08.414 INFO:teuthology.orchestra.run.smithi165.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-12T12:10:08.460 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T12:10:08.578 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:08.730 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T12:10:08.856 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T12:10:09.119 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T12:10:09.122 INFO:teuthology.orchestra.run.smithi165.stdout:Adding system user cephadm....done 2024-09-12T12:10:09.250 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T12:10:09.530 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T12:10:09.560 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T12:10:09.811 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T12:10:09.912 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T12:10:10.151 INFO:teuthology.orchestra.run.smithi144.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T12:10:10.163 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T12:10:10.187 INFO:teuthology.orchestra.run.smithi144.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-12T12:10:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:10.431 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T12:10:10.557 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T12:10:10.793 INFO:teuthology.orchestra.run.smithi144.stdout:Adding system user cephadm....done 2024-09-12T12:10:10.892 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T12:10:10.923 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T12:10:11.199 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T12:10:11.260 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T12:10:11.459 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T12:10:11.521 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-12T12:10:11.606 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T12:10:11.774 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T12:10:11.871 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T12:10:12.066 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T12:10:12.129 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T12:10:12.263 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T12:10:12.301 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T12:10:12.557 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T12:10:12.644 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T12:10:12.895 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T12:10:12.942 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T12:10:13.180 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:13.201 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-12T12:10:13.447 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T12:10:13.453 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T12:10:13.574 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T12:10:13.699 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-12T12:10:13.721 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T12:10:13.950 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T12:10:13.972 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T12:10:14.068 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T12:10:14.282 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T12:10:14.336 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T12:10:14.583 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T12:10:14.743 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T12:10:14.774 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T12:10:14.839 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T12:10:14.850 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:14.965 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T12:10:15.126 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T12:10:15.252 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T12:10:15.333 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T12:10:15.378 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-12T12:10:15.434 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T12:10:15.637 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T12:10:15.710 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T12:10:15.755 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T12:10:15.995 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T12:10:16.048 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T12:10:16.304 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T12:10:16.430 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T12:10:16.435 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T12:10:16.470 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T12:10:16.535 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T12:10:16.685 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T12:10:17.037 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T12:10:17.124 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T12:10:17.138 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T12:10:17.375 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T12:10:17.398 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T12:10:17.493 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T12:10:17.619 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T12:10:17.665 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T12:10:17.937 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T12:10:17.983 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T12:10:18.134 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T12:10:18.338 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T12:10:18.606 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T12:10:18.819 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T12:10:18.991 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T12:10:19.079 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T12:10:19.190 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T12:10:19.275 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-12T12:10:19.316 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T12:10:19.568 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T12:10:19.634 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T12:10:19.919 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T12:10:20.026 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T12:10:20.179 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T12:10:20.277 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T12:10:20.305 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:20.607 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T12:10:20.646 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T12:10:20.963 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-12T12:10:20.966 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T12:10:21.290 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T12:10:21.691 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T12:10:21.950 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T12:10:22.051 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:22.172 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T12:10:22.344 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T12:10:22.415 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:10:22.525 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T12:10:22.712 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T12:10:22.776 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T12:10:22.902 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T12:10:23.028 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T12:10:23.346 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T12:10:23.614 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T12:10:23.865 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:10:23.927 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T12:10:23.974 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T12:10:24.153 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:10:24.262 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T12:10:24.301 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T12:10:24.594 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T12:10:24.838 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T12:10:24.861 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T12:10:24.964 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T12:10:25.099 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T12:10:25.138 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T12:10:25.417 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T12:10:25.422 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T12:10:25.693 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T12:10:25.698 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T12:10:25.835 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T12:10:25.952 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:10:26.053 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T12:10:26.367 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T12:10:26.371 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T12:10:26.485 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T12:10:26.614 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T12:10:26.786 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T12:10:26.882 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T12:10:27.095 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T12:10:27.149 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T12:10:27.372 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T12:10:27.408 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T12:10:27.498 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T12:10:27.615 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T12:10:27.668 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T12:10:27.687 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T12:10:27.793 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T12:10:27.926 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T12:10:28.052 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T12:10:28.078 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T12:10:28.226 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T12:10:28.453 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T12:10:28.530 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T12:10:28.729 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T12:10:28.840 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T12:10:28.864 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T12:10:29.132 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:10:29.132 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T12:10:29.250 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T12:10:29.257 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T12:10:29.376 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T12:10:29.456 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T12:10:29.576 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T12:10:29.694 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T12:10:29.820 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T12:10:29.885 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T12:10:30.178 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T12:10:30.213 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T12:10:30.389 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T12:10:30.490 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T12:10:30.616 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T12:10:30.657 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T12:10:30.875 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T12:10:30.945 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T12:10:31.001 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T12:10:31.210 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T12:10:31.353 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T12:10:31.595 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T12:10:31.645 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T12:10:31.888 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T12:10:31.912 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T12:10:32.132 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T12:10:32.258 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T12:10:32.384 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:32.400 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T12:10:32.510 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:32.636 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T12:10:32.693 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T12:10:32.961 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T12:10:32.981 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:33.090 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:33.216 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T12:10:33.346 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T12:10:33.510 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:33.635 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:33.639 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T12:10:33.762 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:33.970 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T12:10:33.970 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T12:10:34.000 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T12:10:34.126 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:34.252 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:34.353 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T12:10:34.638 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:34.705 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:34.772 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:34.841 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:34.898 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:34.966 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T12:10:34.999 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:35.100 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T12:10:35.251 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:35.369 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:35.503 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:35.705 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T12:10:35.705 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T12:10:36.371 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:36.421 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:36.505 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:36.615 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:36.716 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:36.833 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:36.864 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:37.009 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:37.057 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:37.183 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:37.309 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T12:10:37.554 INFO:teuthology.orchestra.run.smithi165.stdout:Adding group ceph....done 2024-09-12T12:10:37.955 INFO:teuthology.orchestra.run.smithi165.stdout:Adding system user ceph....done 2024-09-12T12:10:38.108 INFO:teuthology.orchestra.run.smithi165.stdout:Setting system user ceph properties....done 2024-09-12T12:10:38.122 INFO:teuthology.orchestra.run.smithi165.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T12:10:38.262 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T12:10:38.579 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:38.669 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T12:10:38.705 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:38.831 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:38.949 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:39.066 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:39.192 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:39.319 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:39.560 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:10:39.560 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:10:39.737 INFO:teuthology.orchestra.run.smithi144.stdout:Adding group ceph....done 2024-09-12T12:10:40.129 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:40.163 INFO:teuthology.orchestra.run.smithi144.stdout:Adding system user ceph....done 2024-09-12T12:10:40.255 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:40.307 INFO:teuthology.orchestra.run.smithi144.stdout:Setting system user ceph properties....done 2024-09-12T12:10:40.330 INFO:teuthology.orchestra.run.smithi144.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T12:10:40.473 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T12:10:40.785 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:10:40.788 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:10:40.868 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T12:10:41.390 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:41.560 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:41.768 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:10:41.768 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:10:42.089 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T12:10:42.403 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:42.528 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:42.757 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:42.985 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T12:10:42.985 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T12:10:43.092 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:10:43.092 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:10:43.598 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:43.722 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:43.810 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T12:10:43.811 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T12:10:44.095 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T12:10:44.466 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:44.740 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:44.882 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T12:10:44.882 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T12:10:44.948 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T12:10:44.949 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T12:10:45.509 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:45.576 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:45.635 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:45.791 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T12:10:45.791 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T12:10:45.802 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:46.011 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T12:10:46.011 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T12:10:46.411 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:46.654 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:46.727 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T12:10:46.727 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T12:10:46.974 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:47.125 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:47.268 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:47.362 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:47.488 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:47.637 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T12:10:47.639 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:47.738 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T12:10:47.840 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T12:10:47.841 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T12:10:47.899 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T12:10:48.524 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:48.666 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:48.792 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:48.935 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T12:10:49.025 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T12:10:49.296 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T12:10:49.397 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T12:10:49.550 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T12:10:49.758 INFO:teuthology.orchestra.run.smithi165.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T12:10:49.763 DEBUG:teuthology.orchestra.run.smithi165:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-12T12:10:49.840 INFO:teuthology.orchestra.run.smithi165.stdout:Reading package lists... 2024-09-12T12:10:50.025 INFO:teuthology.orchestra.run.smithi165.stdout:Building dependency tree... 2024-09-12T12:10:50.026 INFO:teuthology.orchestra.run.smithi165.stdout:Reading state information... 2024-09-12T12:10:50.211 INFO:teuthology.orchestra.run.smithi165.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-12T12:10:50.212 INFO:teuthology.orchestra.run.smithi165.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T12:10:50.212 INFO:teuthology.orchestra.run.smithi165.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T12:10:50.212 INFO:teuthology.orchestra.run.smithi165.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T12:10:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T12:10:50.212 INFO:teuthology.orchestra.run.smithi165.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T12:10:50.213 INFO:teuthology.orchestra.run.smithi165.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T12:10:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T12:10:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T12:10:50.214 INFO:teuthology.orchestra.run.smithi165.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T12:10:50.214 INFO:teuthology.orchestra.run.smithi165.stdout:The following additional packages will be installed: 2024-09-12T12:10:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-12T12:10:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-12T12:10:50.214 INFO:teuthology.orchestra.run.smithi165.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-12T12:10:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-12T12:10:50.215 INFO:teuthology.orchestra.run.smithi165.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T12:10:50.215 INFO:teuthology.orchestra.run.smithi165.stdout:Suggested packages: 2024-09-12T12:10:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-12T12:10:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-12T12:10:50.216 INFO:teuthology.orchestra.run.smithi165.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-12T12:10:50.273 INFO:teuthology.orchestra.run.smithi165.stdout:The following NEW packages will be installed: 2024-09-12T12:10:50.274 INFO:teuthology.orchestra.run.smithi165.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-12T12:10:50.274 INFO:teuthology.orchestra.run.smithi165.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-12T12:10:50.274 INFO:teuthology.orchestra.run.smithi165.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-12T12:10:50.274 INFO:teuthology.orchestra.run.smithi165.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-12T12:10:50.274 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-12T12:10:50.275 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-12T12:10:50.275 INFO:teuthology.orchestra.run.smithi165.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T12:10:50.275 INFO:teuthology.orchestra.run.smithi165.stdout:The following packages will be upgraded: 2024-09-12T12:10:50.276 INFO:teuthology.orchestra.run.smithi165.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-12T12:10:50.332 INFO:teuthology.orchestra.run.smithi165.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-12T12:10:50.332 INFO:teuthology.orchestra.run.smithi165.stdout:Need to get 55.8 MB of archives. 2024-09-12T12:10:50.332 INFO:teuthology.orchestra.run.smithi165.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-12T12:10:50.333 INFO:teuthology.orchestra.run.smithi165.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-12T12:10:50.465 INFO:teuthology.orchestra.run.smithi165.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T12:10:50.467 INFO:teuthology.orchestra.run.smithi165.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T12:10:50.495 INFO:teuthology.orchestra.run.smithi165.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T12:10:50.495 INFO:teuthology.orchestra.run.smithi165.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T12:10:50.496 INFO:teuthology.orchestra.run.smithi165.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T12:10:50.503 INFO:teuthology.orchestra.run.smithi165.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-12T12:10:50.504 INFO:teuthology.orchestra.run.smithi165.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-12T12:10:50.505 INFO:teuthology.orchestra.run.smithi165.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-12T12:10:50.506 INFO:teuthology.orchestra.run.smithi165.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T12:10:50.507 INFO:teuthology.orchestra.run.smithi165.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-12T12:10:50.508 INFO:teuthology.orchestra.run.smithi165.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T12:10:50.516 INFO:teuthology.orchestra.run.smithi165.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T12:10:50.516 INFO:teuthology.orchestra.run.smithi165.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T12:10:50.517 INFO:teuthology.orchestra.run.smithi165.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-12T12:10:50.533 INFO:teuthology.orchestra.run.smithi165.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-12T12:10:50.752 INFO:teuthology.orchestra.run.smithi165.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-12T12:10:50.753 INFO:teuthology.orchestra.run.smithi165.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-12T12:10:50.754 INFO:teuthology.orchestra.run.smithi165.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-12T12:10:50.757 INFO:teuthology.orchestra.run.smithi165.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-12T12:10:50.757 INFO:teuthology.orchestra.run.smithi165.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-12T12:10:50.759 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T12:10:50.762 INFO:teuthology.orchestra.run.smithi165.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-12T12:10:50.763 INFO:teuthology.orchestra.run.smithi165.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-12T12:10:50.771 INFO:teuthology.orchestra.run.smithi165.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-12T12:10:50.771 INFO:teuthology.orchestra.run.smithi165.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T12:10:50.792 INFO:teuthology.orchestra.run.smithi165.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-12T12:10:50.792 INFO:teuthology.orchestra.run.smithi165.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-12T12:10:50.804 INFO:teuthology.orchestra.run.smithi165.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-12T12:10:50.824 INFO:teuthology.orchestra.run.smithi165.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-12T12:10:50.827 INFO:teuthology.orchestra.run.smithi165.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-12T12:10:50.828 INFO:teuthology.orchestra.run.smithi165.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-12T12:10:50.829 INFO:teuthology.orchestra.run.smithi165.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-12T12:10:50.830 INFO:teuthology.orchestra.run.smithi165.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-12T12:10:50.841 INFO:teuthology.orchestra.run.smithi165.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-12T12:10:50.843 INFO:teuthology.orchestra.run.smithi165.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-12T12:10:50.991 INFO:teuthology.orchestra.run.smithi165.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-12T12:10:50.991 INFO:teuthology.orchestra.run.smithi165.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-12T12:10:50.991 INFO:teuthology.orchestra.run.smithi165.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-12T12:10:50.991 INFO:teuthology.orchestra.run.smithi165.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-12T12:10:50.992 INFO:teuthology.orchestra.run.smithi165.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-12T12:10:50.992 INFO:teuthology.orchestra.run.smithi165.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-12T12:10:51.008 INFO:teuthology.orchestra.run.smithi165.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-12T12:10:51.008 INFO:teuthology.orchestra.run.smithi165.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-12T12:10:51.388 INFO:teuthology.orchestra.run.smithi165.stdout:Preconfiguring packages ... 2024-09-12T12:10:51.428 INFO:teuthology.orchestra.run.smithi144.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T12:10:51.433 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-12T12:10:51.510 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-09-12T12:10:51.559 INFO:teuthology.orchestra.run.smithi165.stdout:Fetched 55.8 MB in 1s (77.4 MB/s) 2024-09-12T12:10:51.695 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2024-09-12T12:10:51.696 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2024-09-12T12:10:51.845 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-12T12:10:51.849 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T12:10:51.878 INFO:teuthology.orchestra.run.smithi144.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-12T12:10:51.878 INFO:teuthology.orchestra.run.smithi144.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T12:10:51.878 INFO:teuthology.orchestra.run.smithi144.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T12:10:51.878 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T12:10:51.879 INFO:teuthology.orchestra.run.smithi144.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T12:10:51.879 INFO:teuthology.orchestra.run.smithi144.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T12:10:51.879 INFO:teuthology.orchestra.run.smithi144.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T12:10:51.879 INFO:teuthology.orchestra.run.smithi144.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T12:10:51.879 INFO:teuthology.orchestra.run.smithi144.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T12:10:51.879 INFO:teuthology.orchestra.run.smithi144.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T12:10:51.880 INFO:teuthology.orchestra.run.smithi144.stdout:The following additional packages will be installed: 2024-09-12T12:10:51.880 INFO:teuthology.orchestra.run.smithi144.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-12T12:10:51.880 INFO:teuthology.orchestra.run.smithi144.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-12T12:10:51.881 INFO:teuthology.orchestra.run.smithi144.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-12T12:10:51.881 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-12T12:10:51.881 INFO:teuthology.orchestra.run.smithi144.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T12:10:51.882 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2024-09-12T12:10:51.882 INFO:teuthology.orchestra.run.smithi144.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-12T12:10:51.882 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-12T12:10:51.882 INFO:teuthology.orchestra.run.smithi144.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-12T12:10:51.939 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2024-09-12T12:10:51.940 INFO:teuthology.orchestra.run.smithi144.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-12T12:10:51.940 INFO:teuthology.orchestra.run.smithi144.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-12T12:10:51.940 INFO:teuthology.orchestra.run.smithi144.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-12T12:10:51.940 INFO:teuthology.orchestra.run.smithi144.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-12T12:10:51.940 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-12T12:10:51.941 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-12T12:10:51.941 INFO:teuthology.orchestra.run.smithi144.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T12:10:51.942 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages will be upgraded: 2024-09-12T12:10:51.943 INFO:teuthology.orchestra.run.smithi144.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-12T12:10:52.015 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T12:10:52.129 INFO:teuthology.orchestra.run.smithi144.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-12T12:10:52.129 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 55.8 MB of archives. 2024-09-12T12:10:52.129 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-12T12:10:52.129 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-12T12:10:52.624 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-12T12:10:52.753 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T12:10:52.769 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T12:10:52.894 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T12:10:52.894 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T12:10:52.896 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T12:10:52.924 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-12T12:10:52.926 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-12T12:10:52.929 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-12T12:10:52.932 INFO:teuthology.orchestra.run.smithi144.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T12:10:52.932 INFO:teuthology.orchestra.run.smithi144.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-12T12:10:52.934 INFO:teuthology.orchestra.run.smithi144.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T12:10:52.999 INFO:teuthology.orchestra.run.smithi144.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T12:10:52.999 INFO:teuthology.orchestra.run.smithi144.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T12:10:52.999 INFO:teuthology.orchestra.run.smithi144.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-12T12:10:53.080 INFO:teuthology.orchestra.run.smithi144.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-12T12:10:53.764 INFO:teuthology.orchestra.run.smithi144.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-12T12:10:53.766 INFO:teuthology.orchestra.run.smithi144.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-12T12:10:53.766 INFO:teuthology.orchestra.run.smithi144.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-12T12:10:53.769 INFO:teuthology.orchestra.run.smithi144.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-12T12:10:53.769 INFO:teuthology.orchestra.run.smithi144.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-12T12:10:53.773 INFO:teuthology.orchestra.run.smithi144.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-12T12:10:53.775 INFO:teuthology.orchestra.run.smithi144.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-12T12:10:53.810 INFO:teuthology.orchestra.run.smithi165.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-12T12:10:53.825 INFO:teuthology.orchestra.run.smithi144.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-12T12:10:53.825 INFO:teuthology.orchestra.run.smithi144.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T12:10:53.902 INFO:teuthology.orchestra.run.smithi144.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-12T12:10:53.908 INFO:teuthology.orchestra.run.smithi144.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-12T12:10:53.919 INFO:teuthology.orchestra.run.smithi144.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-12T12:10:53.996 INFO:teuthology.orchestra.run.smithi144.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-12T12:10:54.000 INFO:teuthology.orchestra.run.smithi144.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-12T12:10:54.000 INFO:teuthology.orchestra.run.smithi144.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-12T12:10:54.001 INFO:teuthology.orchestra.run.smithi144.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-12T12:10:54.001 INFO:teuthology.orchestra.run.smithi144.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-12T12:10:54.016 INFO:teuthology.orchestra.run.smithi144.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-12T12:10:54.017 INFO:teuthology.orchestra.run.smithi144.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-12T12:10:54.113 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package flex. 2024-09-12T12:10:54.186 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-12T12:10:54.189 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T12:10:54.237 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T12:10:54.507 INFO:teuthology.orchestra.run.smithi144.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-12T12:10:54.507 INFO:teuthology.orchestra.run.smithi144.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-12T12:10:54.507 INFO:teuthology.orchestra.run.smithi144.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-12T12:10:54.507 INFO:teuthology.orchestra.run.smithi144.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-12T12:10:54.507 INFO:teuthology.orchestra.run.smithi144.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-12T12:10:54.508 INFO:teuthology.orchestra.run.smithi144.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-12T12:10:54.568 INFO:teuthology.orchestra.run.smithi144.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-12T12:10:54.569 INFO:teuthology.orchestra.run.smithi144.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-12T12:10:54.858 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T12:10:54.954 INFO:teuthology.orchestra.run.smithi144.stdout:Preconfiguring packages ... 2024-09-12T12:10:55.108 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 55.8 MB in 3s (21.3 MB/s) 2024-09-12T12:10:55.339 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T12:10:55.404 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-12T12:10:55.408 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T12:10:55.958 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T12:10:56.128 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T12:10:56.591 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-12T12:10:56.724 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-12T12:10:56.728 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T12:10:56.869 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T12:10:57.692 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T12:10:57.769 INFO:teuthology.orchestra.run.smithi144.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-12T12:10:57.852 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T12:10:58.020 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package flex. 2024-09-12T12:10:58.091 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-12T12:10:58.094 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T12:10:58.136 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T12:10:58.218 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T12:10:58.615 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T12:10:58.620 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package bison. 2024-09-12T12:10:58.695 INFO:teuthology.orchestra.run.smithi165.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-12T12:10:58.699 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T12:10:58.747 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T12:10:58.808 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T12:10:59.156 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-12T12:10:59.170 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-12T12:10:59.189 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T12:10:59.214 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T12:10:59.551 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package dump. 2024-09-12T12:10:59.566 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-12T12:10:59.600 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking dump (0.4b47-3) ... 2024-09-12T12:10:59.726 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-12T12:10:59.729 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T12:10:59.858 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T12:10:59.879 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package indent. 2024-09-12T12:10:59.894 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:10:59.938 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T12:11:00.216 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T12:11:00.230 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T12:11:00.274 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T12:11:00.286 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T12:11:00.422 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T12:11:00.553 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-12T12:11:00.568 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-12T12:11:00.603 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T12:11:00.730 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T12:11:00.883 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T12:11:00.898 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T12:11:00.941 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T12:11:01.223 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package bison. 2024-09-12T12:11:01.236 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T12:11:01.252 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T12:11:01.286 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T12:11:01.297 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-12T12:11:01.302 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T12:11:01.351 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T12:11:01.572 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T12:11:01.588 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T12:11:01.630 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T12:11:01.759 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-12T12:11:01.775 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-12T12:11:01.818 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T12:11:01.884 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libjson-perl. 2024-09-12T12:11:01.898 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-12T12:11:01.942 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-12T12:11:02.154 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package dump. 2024-09-12T12:11:02.170 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-12T12:11:02.213 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking dump (0.4b47-3) ... 2024-09-12T12:11:02.278 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-12T12:11:02.294 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-12T12:11:02.336 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T12:11:02.583 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package indent. 2024-09-12T12:11:02.599 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:02.641 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T12:11:02.877 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T12:11:02.893 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T12:11:02.927 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T12:11:03.273 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-12T12:11:03.289 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-12T12:11:03.323 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T12:11:03.567 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T12:11:03.583 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T12:11:03.626 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T12:11:03.732 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-12T12:11:03.747 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T12:11:03.789 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T12:11:03.979 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T12:11:03.995 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T12:11:04.037 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T12:11:04.109 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-12T12:11:04.125 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T12:11:04.193 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T12:11:04.273 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T12:11:04.289 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T12:11:04.331 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T12:11:04.612 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-12T12:11:04.626 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjson-perl. 2024-09-12T12:11:04.628 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T12:11:04.642 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-12T12:11:04.679 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T12:11:04.684 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-12T12:11:04.962 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-12T12:11:04.978 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-12T12:11:05.012 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T12:11:05.057 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-12T12:11:05.073 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-12T12:11:05.124 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T12:11:05.435 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-12T12:11:05.451 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T12:11:05.494 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T12:11:05.872 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-12T12:11:05.888 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:05.930 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:06.275 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-12T12:11:06.291 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:06.325 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T12:11:06.417 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-12T12:11:06.433 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T12:11:06.475 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T12:11:06.611 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-12T12:11:06.627 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:06.677 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T12:11:06.759 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-12T12:11:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T12:11:06.819 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T12:11:06.963 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T12:11:06.979 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T12:11:07.030 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T12:11:07.122 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-12T12:11:07.137 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T12:11:07.181 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T12:11:07.542 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-12T12:11:07.556 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-12T12:11:07.600 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T12:11:07.617 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-12T12:11:07.633 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-12T12:11:07.684 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T12:11:07.928 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-12T12:11:07.942 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T12:11:07.986 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T12:11:08.121 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package modemmanager. 2024-09-12T12:11:08.136 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T12:11:08.187 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T12:11:08.323 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-12T12:11:08.337 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:08.381 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:08.692 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-12T12:11:08.706 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:08.750 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T12:11:08.844 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package network-manager. 2024-09-12T12:11:08.860 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T12:11:08.903 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-12T12:11:09.078 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-12T12:11:09.523 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:09.523 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T12:11:09.523 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T12:11:09.523 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T12:11:09.523 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T12:11:09.669 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package ppp. 2024-09-12T12:11:09.684 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-12T12:11:09.984 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-12T12:11:09.997 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-12T12:11:10.035 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T12:11:10.048 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T12:11:10.362 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package modemmanager. 2024-09-12T12:11:10.375 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T12:11:10.424 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package pptp-linux. 2024-09-12T12:11:10.441 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-12T12:11:10.445 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T12:11:10.490 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-12T12:11:10.785 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-12T12:11:10.800 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-12T12:11:10.844 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-12T12:11:11.068 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package network-manager. 2024-09-12T12:11:11.083 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T12:11:11.152 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-12T12:11:11.238 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-12T12:11:11.257 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-12T12:11:11.305 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking postgresql-client-common (238) ... 2024-09-12T12:11:11.684 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-12T12:11:11.699 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:11.751 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:11.846 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ppp. 2024-09-12T12:11:11.860 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-12T12:11:12.194 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T12:11:12.364 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package postgresql-common. 2024-09-12T12:11:12.379 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-12T12:11:12.448 INFO:teuthology.orchestra.run.smithi165.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-12T12:11:12.487 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking postgresql-common (238) ... 2024-09-12T12:11:12.576 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package pptp-linux. 2024-09-12T12:11:12.588 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-12T12:11:12.625 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-12T12:11:12.878 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-12T12:11:12.892 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-12T12:11:12.928 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-12T12:11:13.046 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package postgresql-14. 2024-09-12T12:11:13.061 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:13.116 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:13.254 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-12T12:11:13.266 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-12T12:11:13.314 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking postgresql-client-common (238) ... 2024-09-12T12:11:13.593 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-12T12:11:13.606 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:13.643 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:14.223 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package postgresql-common. 2024-09-12T12:11:14.235 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-12T12:11:14.290 INFO:teuthology.orchestra.run.smithi144.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-12T12:11:14.321 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking postgresql-common (238) ... 2024-09-12T12:11:14.392 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package postgresql. 2024-09-12T12:11:14.407 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-12T12:11:14.450 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking postgresql (14+238) ... 2024-09-12T12:11:14.702 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package postgresql-client. 2024-09-12T12:11:14.717 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-12T12:11:14.753 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking postgresql-client (14+238) ... 2024-09-12T12:11:14.813 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package postgresql-14. 2024-09-12T12:11:14.826 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T12:11:14.866 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:14.946 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-12T12:11:14.961 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-12T12:11:15.004 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-12T12:11:15.323 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package tcl8.6. 2024-09-12T12:11:15.338 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-12T12:11:15.382 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T12:11:15.660 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package tcl. 2024-09-12T12:11:15.674 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-12T12:11:15.722 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-12T12:11:16.041 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package postgresql. 2024-09-12T12:11:16.054 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package wpasupplicant. 2024-09-12T12:11:16.055 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-12T12:11:16.069 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-12T12:11:16.091 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking postgresql (14+238) ... 2024-09-12T12:11:16.104 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T12:11:16.343 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package postgresql-client. 2024-09-12T12:11:16.359 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-12T12:11:16.402 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking postgresql-client (14+238) ... 2024-09-12T12:11:16.467 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-12T12:11:16.482 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-12T12:11:16.526 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-12T12:11:16.637 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-12T12:11:16.652 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-12T12:11:16.695 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-12T12:11:16.904 INFO:teuthology.orchestra.run.smithi165.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-12T12:11:16.918 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-12T12:11:16.969 INFO:teuthology.orchestra.run.smithi165.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T12:11:17.039 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package tcl8.6. 2024-09-12T12:11:17.057 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-12T12:11:17.098 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T12:11:17.262 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up postgresql-client-common (238) ... 2024-09-12T12:11:17.384 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package tcl. 2024-09-12T12:11:17.401 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-12T12:11:17.448 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-12T12:11:17.468 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T12:11:17.594 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T12:11:17.720 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:17.820 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package wpasupplicant. 2024-09-12T12:11:17.837 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-12T12:11:17.846 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T12:11:17.878 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T12:11:17.973 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T12:11:18.090 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:18.199 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-12T12:11:18.215 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-12T12:11:18.249 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-12T12:11:18.627 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-12T12:11:18.644 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-12T12:11:18.693 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T12:11:18.971 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up postgresql-client-common (238) ... 2024-09-12T12:11:19.031 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-12T12:11:19.146 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T12:11:19.208 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T12:11:19.334 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T12:11:19.461 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:19.580 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T12:11:19.583 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T12:11:19.584 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T12:11:19.687 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T12:11:19.814 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:20.300 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T12:11:20.409 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T12:11:20.535 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T12:11:20.661 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-12T12:11:20.787 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T12:11:20.795 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-12T12:11:20.886 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T12:11:20.946 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T12:11:21.097 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T12:11:21.238 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T12:11:21.239 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T12:11:21.248 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T12:11:21.989 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T12:11:22.079 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T12:11:22.140 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T12:11:22.239 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up dump (0.4b47-3) ... 2024-09-12T12:11:22.265 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T12:11:22.334 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-12T12:11:22.392 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-12T12:11:22.398 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T12:11:22.500 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T12:11:22.518 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T12:11:22.617 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-12T12:11:22.636 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T12:11:22.742 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T12:11:22.743 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-12T12:11:22.870 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T12:11:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T12:11:22.959 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T12:11:23.046 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T12:11:23.172 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T12:11:23.340 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T12:11:23.517 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T12:11:23.635 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T12:11:23.667 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-12T12:11:23.753 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up dump (0.4b47-3) ... 2024-09-12T12:11:23.831 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-12T12:11:23.869 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up postgresql-client (14+238) ... 2024-09-12T12:11:23.896 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T12:11:24.022 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T12:11:24.148 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-12T12:11:24.299 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-12T12:11:24.370 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-12T12:11:24.425 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T12:11:24.523 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T12:11:24.594 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T12:11:24.720 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T12:11:24.871 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T12:11:25.006 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:25.007 INFO:teuthology.orchestra.run.smithi165.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-12T12:11:25.008 INFO:teuthology.orchestra.run.smithi165.stdout:which means they are currently configured by ifupdown: 2024-09-12T12:11:25.008 INFO:teuthology.orchestra.run.smithi165.stdout:- enp3s0f1 2024-09-12T12:11:25.008 INFO:teuthology.orchestra.run.smithi165.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-12T12:11:25.008 INFO:teuthology.orchestra.run.smithi165.stdout:remove their configuration from /etc/network/interfaces. 2024-09-12T12:11:25.008 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:25.013 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T12:11:25.139 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-12T12:11:25.139 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-12T12:11:25.307 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up postgresql-client (14+238) ... 2024-09-12T12:11:25.442 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-12T12:11:25.541 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-12T12:11:25.953 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-12T12:11:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:26.044 INFO:teuthology.orchestra.run.smithi144.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-12T12:11:26.044 INFO:teuthology.orchestra.run.smithi144.stdout:which means they are currently configured by ifupdown: 2024-09-12T12:11:26.044 INFO:teuthology.orchestra.run.smithi144.stdout:- enp3s0f1 2024-09-12T12:11:26.044 INFO:teuthology.orchestra.run.smithi144.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-12T12:11:26.044 INFO:teuthology.orchestra.run.smithi144.stdout:remove their configuration from /etc/network/interfaces. 2024-09-12T12:11:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:26.177 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-12T12:11:26.607 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-12T12:11:26.689 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T12:11:26.816 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T12:11:26.934 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-12T12:11:27.059 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-12T12:11:27.060 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up postgresql-common (238) ... 2024-09-12T12:11:27.803 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T12:11:27.962 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T12:11:28.043 INFO:teuthology.orchestra.run.smithi165.stdout:Adding user postgres to group ssl-cert 2024-09-12T12:11:28.089 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-12T12:11:28.281 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:28.281 INFO:teuthology.orchestra.run.smithi165.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-12T12:11:28.298 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up postgresql-common (238) ... 2024-09-12T12:11:28.544 INFO:teuthology.orchestra.run.smithi165.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-12T12:11:28.545 INFO:teuthology.orchestra.run.smithi165.stdout:Removing obsolete dictionary files: 2024-09-12T12:11:29.251 INFO:teuthology.orchestra.run.smithi144.stdout:Adding user postgres to group ssl-cert 2024-09-12T12:11:29.290 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-12T12:11:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:29.539 INFO:teuthology.orchestra.run.smithi144.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-12T12:11:29.785 INFO:teuthology.orchestra.run.smithi144.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-12T12:11:29.785 INFO:teuthology.orchestra.run.smithi144.stdout:Removing obsolete dictionary files: 2024-09-12T12:11:29.836 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:30.302 INFO:teuthology.orchestra.run.smithi165.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-12T12:11:30.321 INFO:teuthology.orchestra.run.smithi165.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-12T12:11:30.384 INFO:teuthology.orchestra.run.smithi165.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-12T12:11:30.384 INFO:teuthology.orchestra.run.smithi165.stdout:This user must also own the server process. 2024-09-12T12:11:30.384 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:30.385 INFO:teuthology.orchestra.run.smithi165.stdout:The database cluster will be initialized with locale "en_US". 2024-09-12T12:11:30.385 INFO:teuthology.orchestra.run.smithi165.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-12T12:11:30.385 INFO:teuthology.orchestra.run.smithi165.stdout:The default text search configuration will be set to "english". 2024-09-12T12:11:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:30.385 INFO:teuthology.orchestra.run.smithi165.stdout:Data page checksums are disabled. 2024-09-12T12:11:30.385 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:30.385 INFO:teuthology.orchestra.run.smithi165.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-12T12:11:30.386 INFO:teuthology.orchestra.run.smithi165.stdout:creating subdirectories ... ok 2024-09-12T12:11:30.386 INFO:teuthology.orchestra.run.smithi165.stdout:selecting dynamic shared memory implementation ... posix 2024-09-12T12:11:30.410 INFO:teuthology.orchestra.run.smithi165.stdout:selecting default max_connections ... 100 2024-09-12T12:11:30.443 INFO:teuthology.orchestra.run.smithi165.stdout:selecting default shared_buffers ... 128MB 2024-09-12T12:11:30.457 INFO:teuthology.orchestra.run.smithi165.stdout:selecting default time zone ... Etc/UTC 2024-09-12T12:11:30.457 INFO:teuthology.orchestra.run.smithi165.stdout:creating configuration files ... ok 2024-09-12T12:11:30.482 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-12T12:11:30.619 INFO:teuthology.orchestra.run.smithi165.stdout:running bootstrap script ... ok 2024-09-12T12:11:30.965 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T12:11:31.233 INFO:teuthology.orchestra.run.smithi165.stdout:performing post-bootstrap initialization ... ok 2024-09-12T12:11:31.308 INFO:teuthology.orchestra.run.smithi144.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-12T12:11:31.324 INFO:teuthology.orchestra.run.smithi144.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-12T12:11:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-12T12:11:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:This user must also own the server process. 2024-09-12T12:11:31.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:31.372 INFO:teuthology.orchestra.run.smithi144.stdout:The database cluster will be initialized with locale "en_US". 2024-09-12T12:11:31.373 INFO:teuthology.orchestra.run.smithi144.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-12T12:11:31.373 INFO:teuthology.orchestra.run.smithi144.stdout:The default text search configuration will be set to "english". 2024-09-12T12:11:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:31.373 INFO:teuthology.orchestra.run.smithi144.stdout:Data page checksums are disabled. 2024-09-12T12:11:31.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:31.373 INFO:teuthology.orchestra.run.smithi144.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-12T12:11:31.374 INFO:teuthology.orchestra.run.smithi144.stdout:creating subdirectories ... ok 2024-09-12T12:11:31.374 INFO:teuthology.orchestra.run.smithi144.stdout:selecting dynamic shared memory implementation ... posix 2024-09-12T12:11:31.397 INFO:teuthology.orchestra.run.smithi144.stdout:selecting default max_connections ... 100 2024-09-12T12:11:31.431 INFO:teuthology.orchestra.run.smithi144.stdout:selecting default shared_buffers ... 128MB 2024-09-12T12:11:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:selecting default time zone ... Etc/UTC 2024-09-12T12:11:31.445 INFO:teuthology.orchestra.run.smithi144.stdout:creating configuration files ... ok 2024-09-12T12:11:31.606 INFO:teuthology.orchestra.run.smithi144.stdout:running bootstrap script ... ok 2024-09-12T12:11:31.777 INFO:teuthology.orchestra.run.smithi165.stdout:syncing data to disk ... ok 2024-09-12T12:11:32.216 INFO:teuthology.orchestra.run.smithi144.stdout:performing post-bootstrap initialization ... ok 2024-09-12T12:11:32.302 INFO:teuthology.orchestra.run.smithi165.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-12T12:11:32.738 INFO:teuthology.orchestra.run.smithi144.stdout:syncing data to disk ... ok 2024-09-12T12:11:33.262 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-12T12:11:35.294 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T12:11:35.420 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-12T12:11:35.546 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up postgresql (14+238) ... 2024-09-12T12:11:35.672 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T12:11:35.799 INFO:teuthology.orchestra.run.smithi165.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T12:11:36.072 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T12:11:36.073 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T12:11:36.289 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T12:11:36.415 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-12T12:11:36.575 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up postgresql (14+238) ... 2024-09-12T12:11:36.701 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T12:11:36.810 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T12:11:36.834 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T12:11:36.910 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T12:11:37.046 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T12:11:37.046 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T12:11:37.237 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T12:11:37.397 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T12:11:37.813 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T12:11:37.913 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T12:11:38.274 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T12:11:38.409 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T12:11:38.809 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-12T12:11:38.901 INFO:teuthology.orchestra.run.smithi165.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T12:11:39.468 INFO:teuthology.orchestra.run.smithi165.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T12:11:39.476 DEBUG:teuthology.parallel:result is None 2024-09-12T12:11:39.945 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-12T12:11:40.045 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T12:11:40.602 INFO:teuthology.orchestra.run.smithi144.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T12:11:40.608 DEBUG:teuthology.parallel:result is None 2024-09-12T12:11:40.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:11:40.768 DEBUG:teuthology.orchestra.run.smithi144:> dpkg-query -W -f '${Version}' ceph 2024-09-12T12:11:40.790 INFO:teuthology.orchestra.run.smithi144.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-12T12:11:40.791 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T12:11:40.791 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-12T12:11:40.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:11:40.947 DEBUG:teuthology.orchestra.run.smithi165:> dpkg-query -W -f '${Version}' ceph 2024-09-12T12:11:40.970 INFO:teuthology.orchestra.run.smithi165.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-12T12:11:40.970 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T12:11:40.970 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-12T12:11:40.972 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T12:11:40.972 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:40.973 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:11:40.993 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:11:40.993 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:11:41.032 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T12:11:41.032 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:41.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:11:41.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:11:41.118 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:11:41.118 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:11:41.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:11:41.202 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T12:11:41.203 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:41.203 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:11:41.222 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:11:41.282 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:11:41.282 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:11:41.302 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:11:41.363 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T12:11:41.363 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:41.363 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:11:41.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:11:41.446 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:11:41.446 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:11:41.467 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:11:41.531 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T12:11:41.643 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T12:11:41.643 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2024-09-12T12:11:41.646 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /var/log/ceph 2024-09-12T12:11:41.666 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T12:11:41.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T12:11:41.706 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T12:11:41.727 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T12:11:41.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T12:11:41.767 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T12:11:41.797 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-12T12:11:41.798 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-12T12:11:41.798 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-12T12:11:41.798 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:41.798 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T12:11:41.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T12:11:41.920 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:11:41.920 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T12:11:41.929 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T12:11:42.024 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T12:11:42.025 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T12:11:42.025 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901704', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD0zUWu3MgPH4hFVOKp9xNNq3v4mt8KBEyECG7y0TOEOVn6syZl32PbbVAnVlwiKYcaE4FxIyE+DyNngcy104q4=', 'smithi165.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDE1C6vAy72EMF3goj0cL9zSgQxU7Jbg0z2fiSjMSUTz9fjScLsVcai65MfeSflxs/L3Cj/4aEwVm/ifqa8bD9c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T12:11:42.025 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T12:11:42.029 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T12:11:42.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T12:11:42.079 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T12:11:42.099 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:42.099 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:11:42.148 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:11:42.148 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-09-12T12:11:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:11:42.204 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:11:42.204 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 886 Links: 1 2024-09-12T12:11:42.204 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:11:42.204 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-12 12:05:05.189326441 +0000 2024-09-12T12:11:42.205 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-12 12:05:04.909328943 +0000 2024-09-12T12:11:42.205 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-12 12:05:04.909328943 +0000 2024-09-12T12:11:42.205 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-12 12:05:04.909328943 +0000 2024-09-12T12:11:42.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:11:42.264 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:11:42.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:11:42.265 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000345652 s, 1.5 MB/s 2024-09-12T12:11:42.266 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:11:42.321 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-09-12T12:11:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:11:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:11:42.372 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-09-12T12:11:42.372 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:11:42.372 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-12 12:05:05.733321583 +0000 2024-09-12T12:11:42.372 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-12 12:05:05.489323762 +0000 2024-09-12T12:11:42.372 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-12 12:05:05.489323762 +0000 2024-09-12T12:11:42.372 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-12 12:05:05.489323762 +0000 2024-09-12T12:11:42.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:11:42.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:11:42.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:11:42.430 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.00035027 s, 1.5 MB/s 2024-09-12T12:11:42.431 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:11:42.485 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-09-12T12:11:42.539 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:11:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:11:42.540 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 918 Links: 1 2024-09-12T12:11:42.540 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:11:42.540 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-12 12:05:06.281316688 +0000 2024-09-12T12:11:42.540 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-12 12:05:06.025318974 +0000 2024-09-12T12:11:42.540 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-12 12:05:06.025318974 +0000 2024-09-12T12:11:42.540 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-12 12:05:06.025318974 +0000 2024-09-12T12:11:42.540 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:11:42.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:11:42.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:11:42.597 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.00037117 s, 1.4 MB/s 2024-09-12T12:11:42.598 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:11:42.654 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-09-12T12:11:42.704 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:11:42.704 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:11:42.705 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 936 Links: 1 2024-09-12T12:11:42.705 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:11:42.705 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-12 12:05:06.825311829 +0000 2024-09-12T12:11:42.705 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-12 12:05:06.561314187 +0000 2024-09-12T12:11:42.705 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-12 12:05:06.561314187 +0000 2024-09-12T12:11:42.705 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-12 12:05:06.561314187 +0000 2024-09-12T12:11:42.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:11:42.765 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:11:42.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:11:42.766 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000387746 s, 1.3 MB/s 2024-09-12T12:11:42.768 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:11:42.819 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T12:11:42.819 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:11:42.819 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:11:42.828 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:11:42.829 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-09-12T12:11:42.879 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:11:42.880 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:11:42.880 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 879 Links: 1 2024-09-12T12:11:42.880 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:11:42.880 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-12 12:05:05.191594052 +0000 2024-09-12T12:11:42.880 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-12 12:05:04.915596517 +0000 2024-09-12T12:11:42.880 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-12 12:05:04.915596517 +0000 2024-09-12T12:11:42.880 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-12 12:05:04.915596517 +0000 2024-09-12T12:11:42.880 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:11:42.941 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-12T12:11:42.941 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-12T12:11:42.941 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000659026 s, 777 kB/s 2024-09-12T12:11:42.943 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:11:42.997 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-09-12T12:11:43.047 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:11:43.047 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:11:43.047 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-09-12T12:11:43.047 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:11:43.047 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-12 12:05:05.771588871 +0000 2024-09-12T12:11:43.047 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-12 12:05:05.515591158 +0000 2024-09-12T12:11:43.047 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-12 12:05:05.515591158 +0000 2024-09-12T12:11:43.047 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-12 12:05:05.515591158 +0000 2024-09-12T12:11:43.048 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:11:43.109 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-12T12:11:43.110 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-12T12:11:43.110 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000382031 s, 1.3 MB/s 2024-09-12T12:11:43.111 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:11:43.165 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-09-12T12:11:43.215 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:11:43.215 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:11:43.215 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-09-12T12:11:43.215 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:11:43.215 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-12 12:05:06.379583440 +0000 2024-09-12T12:11:43.215 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-12 12:05:06.099585941 +0000 2024-09-12T12:11:43.215 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-12 12:05:06.099585941 +0000 2024-09-12T12:11:43.216 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-12 12:05:06.099585941 +0000 2024-09-12T12:11:43.216 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:11:43.277 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-12T12:11:43.277 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-12T12:11:43.277 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000384013 s, 1.3 MB/s 2024-09-12T12:11:43.279 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:11:43.333 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-09-12T12:11:43.383 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:11:43.383 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:11:43.383 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 933 Links: 1 2024-09-12T12:11:43.383 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:11:43.384 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-12 12:05:06.947578366 +0000 2024-09-12T12:11:43.384 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-12 12:05:06.667580868 +0000 2024-09-12T12:11:43.384 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-12 12:05:06.667580868 +0000 2024-09-12T12:11:43.384 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-12 12:05:06.667580868 +0000 2024-09-12T12:11:43.384 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:11:43.445 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-12T12:11:43.445 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-12T12:11:43.445 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000394118 s, 1.3 MB/s 2024-09-12T12:11:43.447 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:11:43.501 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T12:11:43.501 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T12:11:43.501 INFO:tasks.ceph:Generating config... 2024-09-12T12:11:43.503 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-12T12:11:43.503 INFO:tasks.ceph:[client] debug client = 20 2024-09-12T12:11:43.503 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T12:11:43.503 INFO:tasks.ceph:[client] pid file = 2024-09-12T12:11:43.503 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-12T12:11:43.503 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-12T12:11:43.504 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-12T12:11:43.504 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-12T12:11:43.504 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-12T12:11:43.504 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-12T12:11:43.504 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-09-12T12:11:43.505 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-12T12:11:43.505 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-12T12:11:43.505 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-09-12T12:11:43.505 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-12T12:11:43.505 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-12T12:11:43.506 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-12T12:11:43.506 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-12T12:11:43.506 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-12T12:11:43.506 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-12T12:11:43.506 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T12:11:43.506 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T12:11:43.506 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T12:11:43.507 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T12:11:43.507 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T12:11:43.507 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-12T12:11:43.507 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-12T12:11:43.507 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-12T12:11:43.507 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T12:11:43.507 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T12:11:43.508 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-12T12:11:43.508 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-12T12:11:43.508 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T12:11:43.508 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T12:11:43.508 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-12T12:11:43.508 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T12:11:43.508 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T12:11:43.508 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T12:11:43.509 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T12:11:43.509 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T12:11:43.509 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-12T12:11:43.509 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T12:11:43.510 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T12:11:43.555 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T12:11:43.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T12:11:43.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T12:11:43.683 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.144'), ('mon.b', '172.21.15.165'), ('mon.c', '[v2:172.21.15.165:3301,v1:172.21.15.165:6790]')] 2024-09-12T12:11:43.683 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-12T12:11:43.684 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:43.684 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T12:11:43.736 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.144 --add b 172.21.15.165 --addv c '[v2:172.21.15.165:3301,v1:172.21.15.165:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:11:43.826 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:11:43.826 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: generated fsid 91f78d05-407b-4adf-ae67-409c5ce36eb9 2024-09-12T12:11:43.826 INFO:teuthology.orchestra.run.smithi144.stdout:setting min_mon_release = quincy 2024-09-12T12:11:43.826 INFO:teuthology.orchestra.run.smithi144.stdout:epoch 0 2024-09-12T12:11:43.826 INFO:teuthology.orchestra.run.smithi144.stdout:fsid 91f78d05-407b-4adf-ae67-409c5ce36eb9 2024-09-12T12:11:43.827 INFO:teuthology.orchestra.run.smithi144.stdout:last_changed 2024-09-12T12:11:43.827649+0000 2024-09-12T12:11:43.827 INFO:teuthology.orchestra.run.smithi144.stdout:created 2024-09-12T12:11:43.827649+0000 2024-09-12T12:11:43.827 INFO:teuthology.orchestra.run.smithi144.stdout:min_mon_release 17 (quincy) 2024-09-12T12:11:43.827 INFO:teuthology.orchestra.run.smithi144.stdout:election_strategy: 1 2024-09-12T12:11:43.827 INFO:teuthology.orchestra.run.smithi144.stdout:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-12T12:11:43.827 INFO:teuthology.orchestra.run.smithi144.stdout:1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2024-09-12T12:11:43.827 INFO:teuthology.orchestra.run.smithi144.stdout:2: [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] mon.c 2024-09-12T12:11:43.827 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T12:11:43.829 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T12:11:43.837 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 91f78d05-407b-4adf-ae67-409c5ce36eb9... 2024-09-12T12:11:43.838 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T12:11:43.884 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T12:11:43.924 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-09-12T12:11:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-09-12T12:11:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T12:11:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-09-12T12:11:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.924 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-09-12T12:11:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-09-12T12:11:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-09-12T12:11:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-09-12T12:11:43.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-09-12T12:11:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-09-12T12:11:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T12:11:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-09-12T12:11:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T12:11:43.926 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T12:11:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-09-12T12:11:43.927 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-09-12T12:11:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-09-12T12:11:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-09-12T12:11:43.928 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-09-12T12:11:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-09-12T12:11:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-09-12T12:11:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-09-12T12:11:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T12:11:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T12:11:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-09-12T12:11:43.929 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T12:11:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-09-12T12:11:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-09-12T12:11:43.930 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-09-12T12:11:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-09-12T12:11:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-09-12T12:11:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-09-12T12:11:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2024-09-12T12:11:43.931 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 91f78d05-407b-4adf-ae67-409c5ce36eb9 2024-09-12T12:11:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.932 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-09-12T12:11:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-09-12T12:11:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-09-12T12:11:43.932 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-09-12T12:11:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-09-12T12:11:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-09-12T12:11:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-09-12T12:11:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-09-12T12:11:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-09-12T12:11:43.933 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug trim objects = true 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.934 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2024-09-12T12:11:43.935 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:11:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-09-12T12:11:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2024-09-12T12:11:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T12:11:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-09-12T12:11:43.936 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-09-12T12:11:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-09-12T12:11:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-09-12T12:11:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-09-12T12:11:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.937 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-09-12T12:11:43.937 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:11:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-09-12T12:11:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-12T12:11:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-12T12:11:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:11:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:11:43.938 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-09-12T12:11:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-09-12T12:11:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.939 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-09-12T12:11:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:11:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-12T12:11:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-09-12T12:11:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-12T12:11:43.939 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-09-12T12:11:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-09-12T12:11:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:11:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-09-12T12:11:43.940 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-09-12T12:11:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:11:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T12:11:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T12:11:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T12:11:43.941 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T12:11:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T12:11:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T12:11:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-09-12T12:11:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-09-12T12:11:43.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: mon down mkfs grace = 300 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on pool no app = False 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T12:11:43.943 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = "" 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2024-09-12T12:11:43.944 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds balancer = 20 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: mds cache max size = 1000 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2024-09-12T12:11:43.945 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2024-09-12T12:11:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: mds log max segments = 1 2024-09-12T12:11:43.946 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2024-09-12T12:11:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2024-09-12T12:11:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-09-12T12:11:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-09-12T12:11:43.947 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-09-12T12:11:43.948 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.949 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2024-09-12T12:11:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2024-09-12T12:11:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T12:11:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2024-09-12T12:11:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T12:11:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T12:11:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.950 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T12:11:43.951 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T12:11:43.952 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2024-09-12T12:11:43.952 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.952 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T12:11:43.952 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.952 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2024-09-12T12:11:43.952 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.952 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2024-09-12T12:11:43.952 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.952 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = "172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on skipped message = False 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = 91f78d05-407b-4adf-ae67-409c5ce36eb9 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 600 2024-09-12T12:11:43.953 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock profile = high_recovery_ops 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug trim objects = true 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.954 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2024-09-12T12:11:43.955 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 20 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 20 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 10 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-09-12T12:11:43.956 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2024-09-12T12:11:43.957 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T12:11:43.958 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: mon down mkfs grace = 300 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: mon op complaint time = 120 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on pool no app = False 2024-09-12T12:11:43.959 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: client mount timeout = 600 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = "" 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-09-12T12:11:43.960 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.b] 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.c] 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.a] 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.c] 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.b] 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.d] 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout:[mds] 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds = 20 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds balancer = 20 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout: mds cache max size = 1000 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug frag = True 2024-09-12T12:11:43.961 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug scatterstat = True 2024-09-12T12:11:43.962 INFO:teuthology.orchestra.run.smithi165.stdout: mds log max segments = 1 2024-09-12T12:11:43.962 INFO:teuthology.orchestra.run.smithi165.stdout: mds op complaint time = 180 2024-09-12T12:11:43.962 INFO:teuthology.orchestra.run.smithi165.stdout: mds verify scatter = True 2024-09-12T12:11:43.962 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-09-12T12:11:43.962 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-09-12T12:11:43.962 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-09-12T12:11:43.963 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T12:11:43.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T12:11:44.047 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T12:11:44.047 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:44.048 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T12:11:44.057 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:44.057 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T12:11:44.107 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:11:44.108 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:44.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T12:11:44.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T12:11:44.183 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:11:44.183 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:11:44.236 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:11:44.236 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:11:44.236 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T12:11:44.236 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T12:11:44.271 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:11:44.271 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:11:44.323 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T12:11:44.323 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T12:11:44.323 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T12:11:44.377 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T12:11:44.383 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T12:11:44.441 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T12:11:44.465 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T12:11:44.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T12:11:44.519 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T12:11:44.524 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T12:11:44.543 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T12:11:44.637 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T12:11:44.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-12T12:11:44.662 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T12:11:44.720 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T12:11:44.725 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-12T12:11:44.745 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T12:11:44.841 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T12:11:44.845 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-12T12:11:44.865 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T12:11:44.865 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T12:11:44.908 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T12:11:44.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-12T12:11:45.004 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-12T12:11:45.020 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T12:11:45.062 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T12:11:45.078 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-12T12:11:45.162 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-12T12:11:45.178 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T12:11:45.179 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T12:11:45.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T12:11:45.197 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T12:11:45.197 INFO:tasks.ceph:role: osd.0 2024-09-12T12:11:45.198 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:11:45.198 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T12:11:45.266 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T12:11:45.266 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T12:11:45.266 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T12:11:45.267 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T12:11:45.267 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T12:11:45.267 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-12T12:11:45.267 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T12:11:45.267 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T12:11:45.267 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T12:11:45.267 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T12:11:45.648 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-12T12:11:45.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-12T12:11:45.651 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T12:11:45.706 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T12:11:45.722 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T12:11:45.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:11:45.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T12:11:45.791 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T12:11:45.791 INFO:tasks.ceph:role: osd.1 2024-09-12T12:11:45.791 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:11:45.791 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T12:11:45.866 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T12:11:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T12:11:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T12:11:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T12:11:45.867 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T12:11:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-12T12:11:45.867 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T12:11:45.867 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T12:11:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T12:11:45.867 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T12:11:46.257 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-12T12:11:46.259 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-12T12:11:46.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T12:11:46.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T12:11:46.371 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T12:11:46.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:11:46.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T12:11:46.435 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T12:11:46.435 INFO:tasks.ceph:role: osd.2 2024-09-12T12:11:46.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:11:46.436 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T12:11:46.502 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T12:11:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T12:11:46.502 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T12:11:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T12:11:46.503 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T12:11:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-12T12:11:46.503 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T12:11:46.503 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T12:11:46.503 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T12:11:46.503 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T12:11:46.918 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-12T12:11:46.921 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-12T12:11:46.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T12:11:47.045 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T12:11:47.061 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T12:11:47.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:11:47.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T12:11:47.123 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T12:11:47.123 INFO:tasks.ceph:role: osd.3 2024-09-12T12:11:47.123 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:11:47.124 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T12:11:47.191 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T12:11:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T12:11:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T12:11:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T12:11:47.191 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T12:11:47.191 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-12T12:11:47.192 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T12:11:47.192 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T12:11:47.192 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T12:11:47.192 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T12:11:47.569 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-12T12:11:47.575 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-12T12:11:47.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T12:11:47.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T12:11:47.708 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T12:11:47.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:11:47.709 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:11:47.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:47.830+0000 7f705be4a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T12:11:47.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:47.830+0000 7f705be4a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T12:11:47.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:47.830+0000 7f705be4a7c0 -1 bdev(0x5601dbbc5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T12:11:47.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:47.834+0000 7f705be4a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T12:11:51.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T12:11:51.052 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:11:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:51.154+0000 7f8a499387c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T12:11:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:51.154+0000 7f8a499387c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T12:11:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:51.154+0000 7f8a499387c0 -1 bdev(0x5613bd799800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T12:11:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:51.154+0000 7f8a499387c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T12:11:54.366 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T12:11:54.387 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:11:54.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:54.474+0000 7fa8ab6a97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T12:11:54.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:54.478+0000 7fa8ab6a97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T12:11:54.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:54.478+0000 7fa8ab6a97c0 -1 bdev(0x55c72a8ff800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T12:11:54.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:54.478+0000 7fa8ab6a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T12:11:57.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T12:11:57.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:11:57.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:57.794+0000 7fe9101507c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T12:11:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:57.794+0000 7fe9101507c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T12:11:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:57.794+0000 7fe9101507c0 -1 bdev(0x560978c2b800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T12:11:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:11:57.794+0000 7fe9101507c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T12:12:01.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T12:12:01.050 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T12:12:01.074 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T12:12:01.074 INFO:tasks.ceph:role: osd.4 2024-09-12T12:12:01.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:12:01.074 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T12:12:01.147 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T12:12:01.147 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T12:12:01.147 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T12:12:01.147 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T12:12:01.148 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T12:12:01.148 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-12T12:12:01.148 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T12:12:01.148 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T12:12:01.148 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T12:12:01.148 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T12:12:01.559 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-12T12:12:01.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-12T12:12:01.562 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T12:12:01.691 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T12:12:01.708 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T12:12:01.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:12:01.710 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T12:12:01.770 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T12:12:01.770 INFO:tasks.ceph:role: osd.5 2024-09-12T12:12:01.770 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:12:01.771 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T12:12:01.838 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T12:12:01.838 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T12:12:01.838 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T12:12:01.838 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T12:12:01.838 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T12:12:01.838 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-12T12:12:01.838 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T12:12:01.838 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T12:12:01.839 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T12:12:01.839 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T12:12:02.213 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-12T12:12:02.216 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-12T12:12:02.216 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T12:12:02.290 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T12:12:02.354 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T12:12:02.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:12:02.355 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T12:12:02.422 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T12:12:02.422 INFO:tasks.ceph:role: osd.6 2024-09-12T12:12:02.422 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:12:02.422 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T12:12:02.495 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T12:12:02.495 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T12:12:02.495 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T12:12:02.495 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T12:12:02.495 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T12:12:02.495 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-12T12:12:02.495 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T12:12:02.496 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T12:12:02.496 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T12:12:02.496 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T12:12:02.897 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-12T12:12:02.900 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-12T12:12:02.901 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T12:12:02.999 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T12:12:03.016 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T12:12:03.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:12:03.017 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T12:12:03.084 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T12:12:03.084 INFO:tasks.ceph:role: osd.7 2024-09-12T12:12:03.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:12:03.085 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T12:12:03.154 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T12:12:03.154 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T12:12:03.154 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T12:12:03.154 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T12:12:03.155 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T12:12:03.155 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-12T12:12:03.155 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T12:12:03.155 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T12:12:03.155 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T12:12:03.155 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T12:12:03.557 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-12T12:12:03.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-12T12:12:03.560 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T12:12:03.692 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T12:12:03.708 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T12:12:03.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:12:03.710 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:12:03.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:03.831+0000 7f8d7ccf97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T12:12:03.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:03.835+0000 7f8d7ccf97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T12:12:03.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:03.835+0000 7f8d7ccf97c0 -1 bdev(0x562b8b5f3800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T12:12:03.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:03.835+0000 7f8d7ccf97c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T12:12:07.070 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T12:12:07.092 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:12:07.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:07.191+0000 7f58f6e2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T12:12:07.193 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:07.191+0000 7f58f6e2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T12:12:07.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:07.191+0000 7f58f6e2b7c0 -1 bdev(0x5649418f7800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T12:12:07.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:07.191+0000 7f58f6e2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T12:12:10.405 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T12:12:10.426 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:12:10.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:10.519+0000 7fc6dcab87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T12:12:10.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:10.519+0000 7fc6dcab87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T12:12:10.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:10.519+0000 7fc6dcab87c0 -1 bdev(0x556a45f5d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T12:12:10.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:10.519+0000 7fc6dcab87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T12:12:12.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:12:12.031 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:12:13.781 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T12:12:13.803 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:12:13.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:13.895+0000 7f3d7e4ff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T12:12:13.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:13.899+0000 7f3d7e4ff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T12:12:13.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:13.899+0000 7f3d7e4ff7c0 -1 bdev(0x5563dd16f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T12:12:13.899 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:13.899+0000 7f3d7e4ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T12:12:17.373 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T12:12:17.395 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T12:12:17.395 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:17.395 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T12:12:17.418 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:17.418 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T12:12:17.484 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:17.485 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-12T12:12:17.549 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:17.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T12:12:17.616 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:17.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T12:12:17.680 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:17.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T12:12:17.744 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:17.744 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T12:12:17.808 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:17.809 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T12:12:17.831 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:17.831 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-12T12:12:17.895 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:17.895 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-12T12:12:17.959 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:17.959 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T12:12:18.023 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:18.023 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T12:12:18.087 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:18.087 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T12:12:18.155 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:18.155 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T12:12:18.223 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:18.223 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T12:12:18.231 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:18.232 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-12T12:12:18.281 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:18.281 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T12:12:18.293 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:18.293 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-12T12:12:18.344 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T12:12:18.344 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T12:12:18.348 DEBUG:teuthology.orchestra.run.smithi165:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T12:12:18.390 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2024-09-12T12:12:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw== 2024-09-12T12:12:18.391 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-09-12T12:12:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw== 2024-09-12T12:12:18.391 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-09-12T12:12:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ== 2024-09-12T12:12:18.391 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2024-09-12T12:12:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ== 2024-09-12T12:12:18.391 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2024-09-12T12:12:18.391 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ== 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA== 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w== 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug== 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A== 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg== 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg== 2024-09-12T12:12:18.392 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg== 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg== 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ== 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout:[client.2] 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA== 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw== 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout:[client.3] 2024-09-12T12:12:18.393 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA== 2024-09-12T12:12:18.405 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr.y] 2024-09-12T12:12:18.405 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw== 2024-09-12T12:12:18.405 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.a] 2024-09-12T12:12:18.405 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw== 2024-09-12T12:12:18.406 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.c] 2024-09-12T12:12:18.406 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ== 2024-09-12T12:12:18.406 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.0] 2024-09-12T12:12:18.406 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ== 2024-09-12T12:12:18.406 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.1] 2024-09-12T12:12:18.407 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ== 2024-09-12T12:12:18.407 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.2] 2024-09-12T12:12:18.407 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA== 2024-09-12T12:12:18.407 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.3] 2024-09-12T12:12:18.407 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w== 2024-09-12T12:12:18.407 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr.x] 2024-09-12T12:12:18.407 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug== 2024-09-12T12:12:18.408 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.b] 2024-09-12T12:12:18.408 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A== 2024-09-12T12:12:18.408 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.d] 2024-09-12T12:12:18.408 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg== 2024-09-12T12:12:18.408 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.4] 2024-09-12T12:12:18.408 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg== 2024-09-12T12:12:18.409 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.5] 2024-09-12T12:12:18.409 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg== 2024-09-12T12:12:18.409 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.6] 2024-09-12T12:12:18.409 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg== 2024-09-12T12:12:18.411 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.7] 2024-09-12T12:12:18.411 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ== 2024-09-12T12:12:18.412 INFO:teuthology.orchestra.run.smithi165.stdout:[client.0] 2024-09-12T12:12:18.412 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:12:18.412 INFO:teuthology.orchestra.run.smithi165.stdout:[client.2] 2024-09-12T12:12:18.412 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA== 2024-09-12T12:12:18.412 INFO:teuthology.orchestra.run.smithi165.stdout:[client.1] 2024-09-12T12:12:18.412 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw== 2024-09-12T12:12:18.413 INFO:teuthology.orchestra.run.smithi165.stdout:[client.3] 2024-09-12T12:12:18.413 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA== 2024-09-12T12:12:18.414 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T12:12:18.443 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T12:12:18.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T12:12:18.524 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T12:12:18.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T12:12:18.585 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T12:12:18.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:18.645 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:18.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:18.701 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:18.754 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:18.757 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:18.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:18.813 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:18.868 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T12:12:18.871 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T12:12:18.924 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T12:12:18.929 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T12:12:18.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T12:12:18.988 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T12:12:19.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:19.048 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:19.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:19.104 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:19.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:19.159 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:19.213 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:19.216 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T12:12:19.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T12:12:19.273 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T12:12:19.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T12:12:19.334 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T12:12:19.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T12:12:19.394 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T12:12:19.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T12:12:19.453 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T12:12:19.510 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T12:12:19.511 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T12:12:19.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T12:12:19.637 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T12:12:19.656 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T12:12:19.676 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T12:12:19.784 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T12:12:19.804 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T12:12:19.864 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T12:12:19.977 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T12:12:19.996 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:12:19.999 DEBUG:teuthology.orchestra.run.smithi165:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T12:12:20.050 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T12:12:20.051 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T12:12:20.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T12:12:20.054 INFO:tasks.ceph.mon.a:Started 2024-09-12T12:12:20.054 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T12:12:20.054 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T12:12:20.097 INFO:tasks.ceph.mon.b:Started 2024-09-12T12:12:20.097 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T12:12:20.097 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T12:12:20.101 INFO:tasks.ceph.mon.c:Started 2024-09-12T12:12:20.101 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T12:12:20.101 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T12:12:20.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T12:12:20.104 INFO:tasks.ceph.mgr.y:Started 2024-09-12T12:12:20.104 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T12:12:20.105 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T12:12:20.108 INFO:tasks.ceph.mgr.x:Started 2024-09-12T12:12:20.108 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T12:12:20.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T12:12:20.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.242+0000 7f8799c00640 1 Processor -- start 2024-09-12T12:12:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.242+0000 7f8799c00640 1 -- start start 2024-09-12T12:12:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8799c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 0x7f87940b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8799c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f87940b4200 0x7f879415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:20.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8799c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87940d00a0 con 0x7f879415c2e0 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8799c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f87940d0380 con 0x7f87940b4200 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8799c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f87940d0660 con 0x7f87940cfb50 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8792a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f879415c2e0 0x7f87940b00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56172/0 (socket says 172.21.15.144:56172) 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8792a00640 1 -- 172.21.15.144:0/1108250447 learned_addr learned my addr 172.21.15.144:0/1108250447 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8793400640 1 --2- 172.21.15.144:0/1108250447 >> v2:172.21.15.144:3300/0 conn(0x7f87940b4200 0x7f879415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8792000640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 0x7f87940b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8793400640 1 -- 172.21.15.144:0/1108250447 >> v2:172.21.15.144:3300/0 conn(0x7f87940b4200 msgr2=0x7f879415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8793400640 1 -- 172.21.15.144:0/1108250447 >> v2:172.21.15.144:3300/0 conn(0x7f87940b4200 msgr2=0x7f879415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8793400640 1 --2- 172.21.15.144:0/1108250447 >> v2:172.21.15.144:3300/0 conn(0x7f87940b4200 0x7f879415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8792000640 1 -- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 msgr2=0x7f87940b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8792000640 1 -- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 msgr2=0x7f87940b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T12:12:20.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8792000640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 0x7f87940b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:12:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8792000640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 0x7f87940b3cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:12:20.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.246+0000 7f8793400640 1 --2- 172.21.15.144:0/1108250447 >> v2:172.21.15.144:3300/0 conn(0x7f87940b4200 0x7f879415cf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:12:20.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225161027 0 0) 0x7f87940d00a0 con 0x7f879415c2e0 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8778003530 con 0x7f879415c2e0 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 364116842 0 0) 0x7f8778003530 con 0x7f879415c2e0 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 msgr2=0x7f87940b3cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 0x7f87940b3cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 >> v2:172.21.15.144:3300/0 conn(0x7f87940b4200 msgr2=0x7f879415cf20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 --2- 172.21.15.144:0/1108250447 >> v2:172.21.15.144:3300/0 conn(0x7f87940b4200 0x7f879415cf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879415ca00 con 0x7f879415c2e0 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f8784001680 con 0x7f879415c2e0 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 >> v1:172.21.15.144:6789/0 conn(0x7f879415c2e0 legacy=0x7f87940b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87780039c0 0x7f8778003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8778004810 0x7f8778004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:20.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 0x7f87780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f87940d0380 con 0x7f87780039c0 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f87940d0660 con 0x7f8778004810 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f877800bb60 con 0x7f87940cfb50 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8792a00640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87780039c0 0x7f8778003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8792000640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8778004810 0x7f8778004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8793400640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 0x7f87780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8792a00640 1 -- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 msgr2=0x7f87780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8792a00640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f87940cfb50 0x7f87780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8792a00640 1 -- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8778004810 msgr2=0x7f8778004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8792a00640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8778004810 0x7f8778004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.398+0000 7f8792a00640 1 -- 172.21.15.144:0/1108250447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8778003530 con 0x7f87780039c0 2024-09-12T12:12:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8792a00640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87780039c0 0x7f8778003de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f878400c210 tx=0x7f878401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e50c691f8f9806 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784007d40 con 0x7f87780039c0 2024-09-12T12:12:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87840a9020 con 0x7f87780039c0 2024-09-12T12:12:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8791600640 1 -- 172.21.15.144:0/1108250447 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784005b00 con 0x7f87780039c0 2024-09-12T12:12:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8799c00640 1 -- 172.21.15.144:0/1108250447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87780039c0 msgr2=0x7f8778003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8799c00640 1 --2- 172.21.15.144:0/1108250447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87780039c0 0x7f8778003de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f878400c210 tx=0x7f878401cc60 comp rx=0 tx=0).stop 2024-09-12T12:12:20.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8793400640 1 -- 172.21.15.144:0/1108250447 reap_dead start 2024-09-12T12:12:20.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8799c00640 1 -- 172.21.15.144:0/1108250447 shutdown_connections 2024-09-12T12:12:20.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8799c00640 1 -- 172.21.15.144:0/1108250447 >> 172.21.15.144:0/1108250447 conn(0x7f879406cb10 msgr2=0x7f879406cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:20.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8799c00640 1 -- 172.21.15.144:0/1108250447 shutdown_connections 2024-09-12T12:12:20.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8799c00640 1 -- 172.21.15.144:0/1108250447 wait complete. 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.402+0000 7f8799c00640 1 Processor -- start 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 -- start start 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87780039c0 0x7f879414ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87941539c0 0x7f87940afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8794153e40 0x7f87940b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f87941671a0 con 0x7f87941539c0 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8794167020 con 0x7f87780039c0 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8794167320 con 0x7f8794153e40 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87941539c0 0x7f87940afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87941539c0 0x7f87940afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58162/0 (socket says 172.21.15.144:58162) 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792000640 1 -- 172.21.15.144:0/548371561 learned_addr learned my addr 172.21.15.144:0/548371561 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792a00640 1 --2- 172.21.15.144:0/548371561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87780039c0 0x7f879414ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:20.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8793400640 1 --2- 172.21.15.144:0/548371561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8794153e40 0x7f87940b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792000640 1 -- 172.21.15.144:0/548371561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8794153e40 msgr2=0x7f87940b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792000640 1 --2- 172.21.15.144:0/548371561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8794153e40 0x7f87940b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792000640 1 -- 172.21.15.144:0/548371561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87780039c0 msgr2=0x7f879414ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792000640 1 --2- 172.21.15.144:0/548371561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87780039c0 0x7f879414ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792000640 1 -- 172.21.15.144:0/548371561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879415ee60 con 0x7f87941539c0 2024-09-12T12:12:20.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8792000640 1 --2- 172.21.15.144:0/548371561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87941539c0 0x7f87940afd70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f87800114e0 tx=0x7f87800119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:20.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f878aa00640 1 -- 172.21.15.144:0/548371561 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8780019070 con 0x7f87941539c0 2024-09-12T12:12:20.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f878aa00640 1 -- 172.21.15.144:0/548371561 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8780015890 con 0x7f87941539c0 2024-09-12T12:12:20.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f878aa00640 1 -- 172.21.15.144:0/548371561 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878000f040 con 0x7f87941539c0 2024-09-12T12:12:20.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 -- 172.21.15.144:0/548371561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879415f140 con 0x7f87941539c0 2024-09-12T12:12:20.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 -- 172.21.15.144:0/548371561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879415da20 con 0x7f87941539c0 2024-09-12T12:12:20.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f878aa00640 1 -- 172.21.15.144:0/548371561 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f878001c070 con 0x7f87941539c0 2024-09-12T12:12:20.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f878aa00640 1 -- 172.21.15.144:0/548371561 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8780013740 con 0x7f87941539c0 2024-09-12T12:12:20.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.406+0000 7f8799c00640 1 -- 172.21.15.144:0/548371561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f879415cf20 con 0x7f87941539c0 2024-09-12T12:12:20.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.410+0000 7f878aa00640 1 -- 172.21.15.144:0/548371561 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8780015d80 con 0x7f87941539c0 2024-09-12T12:12:20.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.478+0000 7f8799c00640 1 -- 172.21.15.144:0/548371561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f879406d1b0 con 0x7f87941539c0 2024-09-12T12:12:20.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.478+0000 7f878aa00640 1 -- 172.21.15.144:0/548371561 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8780013940 con 0x7f87941539c0 2024-09-12T12:12:20.483 INFO:teuthology.orchestra.run.smithi144.stderr:adjusted tunables profile to default 2024-09-12T12:12:20.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.478+0000 7f8799c00640 1 -- 172.21.15.144:0/548371561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87941539c0 msgr2=0x7f87940afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:20.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.478+0000 7f8799c00640 1 --2- 172.21.15.144:0/548371561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87941539c0 0x7f87940afd70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f87800114e0 tx=0x7f87800119a0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.478+0000 7f8799c00640 1 -- 172.21.15.144:0/548371561 shutdown_connections 2024-09-12T12:12:20.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.478+0000 7f8799c00640 1 --2- 172.21.15.144:0/548371561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8794153e40 0x7f87940b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.478+0000 7f8799c00640 1 --2- 172.21.15.144:0/548371561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87941539c0 0x7f87940afd70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.478+0000 7f8799c00640 1 --2- 172.21.15.144:0/548371561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87780039c0 0x7f879414ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:20.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.478+0000 7f8799c00640 1 -- 172.21.15.144:0/548371561 >> 172.21.15.144:0/548371561 conn(0x7f879406cb10 msgr2=0x7f87940cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:20.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.482+0000 7f8799c00640 1 -- 172.21.15.144:0/548371561 shutdown_connections 2024-09-12T12:12:20.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:20.482+0000 7f8799c00640 1 -- 172.21.15.144:0/548371561 wait complete. 2024-09-12T12:12:20.503 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T12:12:20.503 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T12:12:20.504 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:20.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T12:12:20.523 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:20.524 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T12:12:20.587 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:20.587 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T12:12:20.618 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:20.615+0000 7f7c0a7a9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:12:20.622 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:20.618+0000 7fc2288db180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:12:20.640 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:20.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T12:12:20.703 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:20.703 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T12:12:20.723 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:20.723 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T12:12:20.786 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:20.786 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T12:12:20.845 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:12:20.846 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T12:12:20.906 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 4337f826-e2f8-424f-bbf2-95cac64c0b1f 0 2024-09-12T12:12:21.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe492a00640 1 Processor -- start 2024-09-12T12:12:21.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe492a00640 1 -- start start 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe492a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe48c15e570 0x7fe48c073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe492a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe48c06ea70 0x7fe48c0b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe492a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c0b7220 0x7fe48c06f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe492a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe48c073550 con 0x7fe48c15e570 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe492a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe48c15e950 con 0x7fe48c06ea70 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe492a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c06e5e0 con 0x7fe48c0b7220 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe490a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c0b7220 0x7fe48c06f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe483400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe48c06ea70 0x7fe48c0b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe490a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c0b7220 0x7fe48c06f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58250/0 (socket says 172.21.15.165:58250) 2024-09-12T12:12:21.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe490a00640 1 -- 172.21.15.165:0/4232548032 learned_addr learned my addr 172.21.15.165:0/4232548032 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:21.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe48be00640 1 --2- 172.21.15.165:0/4232548032 >> v2:172.21.15.144:3300/0 conn(0x7fe48c15e570 0x7fe48c073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe490a00640 1 -- 172.21.15.165:0/4232548032 >> v2:172.21.15.165:3300/0 conn(0x7fe48c06ea70 msgr2=0x7fe48c0b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:21.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe490a00640 1 --2- 172.21.15.165:0/4232548032 >> v2:172.21.15.165:3300/0 conn(0x7fe48c06ea70 0x7fe48c0b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe490a00640 1 -- 172.21.15.165:0/4232548032 >> v2:172.21.15.144:3300/0 conn(0x7fe48c15e570 msgr2=0x7fe48c073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:21.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe490a00640 1 --2- 172.21.15.165:0/4232548032 >> v2:172.21.15.144:3300/0 conn(0x7fe48c15e570 0x7fe48c073ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.079+0000 7fe490a00640 1 -- 172.21.15.165:0/4232548032 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c06d730 con 0x7fe48c0b7220 2024-09-12T12:12:21.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.083+0000 7fe48be00640 1 --2- 172.21.15.165:0/4232548032 >> v2:172.21.15.144:3300/0 conn(0x7fe48c15e570 0x7fe48c073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:21.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe490a00640 1 --2- 172.21.15.165:0/4232548032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c0b7220 0x7fe48c06f400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0b1610 tx=0x7fe48401c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aceef70c4597dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:21.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe48b400640 1 -- 172.21.15.165:0/4232548032 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4840a5580 con 0x7fe48c0b7220 2024-09-12T12:12:21.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe48b400640 1 -- 172.21.15.165:0/4232548032 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4840a5720 con 0x7fe48c0b7220 2024-09-12T12:12:21.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe48b400640 1 -- 172.21.15.165:0/4232548032 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4840a5af0 con 0x7fe48c0b7220 2024-09-12T12:12:21.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 -- 172.21.15.165:0/4232548032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c0b7220 msgr2=0x7fe48c06f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 --2- 172.21.15.165:0/4232548032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c0b7220 0x7fe48c06f400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0b1610 tx=0x7fe48401c700 comp rx=0 tx=0).stop 2024-09-12T12:12:21.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 -- 172.21.15.165:0/4232548032 shutdown_connections 2024-09-12T12:12:21.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 --2- 172.21.15.165:0/4232548032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c0b7220 0x7fe48c06f400 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 --2- 172.21.15.165:0/4232548032 >> v2:172.21.15.165:3300/0 conn(0x7fe48c06ea70 0x7fe48c0b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 --2- 172.21.15.165:0/4232548032 >> v2:172.21.15.144:3300/0 conn(0x7fe48c15e570 0x7fe48c073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 -- 172.21.15.165:0/4232548032 >> 172.21.15.165:0/4232548032 conn(0x7fe48c06c010 msgr2=0x7fe48c067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:21.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 -- 172.21.15.165:0/4232548032 shutdown_connections 2024-09-12T12:12:21.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 -- 172.21.15.165:0/4232548032 wait complete. 2024-09-12T12:12:21.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 Processor -- start 2024-09-12T12:12:21.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.087+0000 7fe492a00640 1 -- start start 2024-09-12T12:12:21.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe492a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48c06ea70 0x7fe48c168830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe492a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe48c0b7220 0x7fe48c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe492a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c15e570 0x7fe48c15f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe492a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c0b76b0 con 0x7fe48c06ea70 2024-09-12T12:12:21.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe492a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c06e270 con 0x7fe48c0b7220 2024-09-12T12:12:21.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe492a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c074010 con 0x7fe48c15e570 2024-09-12T12:12:21.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe490a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c15e570 0x7fe48c15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe483400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe48c0b7220 0x7fe48c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe490a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c15e570 0x7fe48c15f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58252/0 (socket says 172.21.15.165:58252) 2024-09-12T12:12:21.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe490a00640 1 -- 172.21.15.165:0/244072826 learned_addr learned my addr 172.21.15.165:0/244072826 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:21.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe483400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe48c0b7220 0x7fe48c150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:46514/0 (socket says 172.21.15.165:46514) 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe48be00640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48c06ea70 0x7fe48c168830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe490a00640 1 -- 172.21.15.165:0/244072826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe48c0b7220 msgr2=0x7fe48c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe490a00640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe48c0b7220 0x7fe48c150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe490a00640 1 -- 172.21.15.165:0/244072826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48c06ea70 msgr2=0x7fe48c168830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe490a00640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48c06ea70 0x7fe48c168830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe490a00640 1 -- 172.21.15.165:0/244072826 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c14eac0 con 0x7fe48c15e570 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe483400640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe48c0b7220 0x7fe48c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe48be00640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48c06ea70 0x7fe48c168830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe490a00640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c15e570 0x7fe48c15f520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4840af040 tx=0x7fe4840194a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe488c00640 1 -- 172.21.15.165:0/244072826 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4840a5580 con 0x7fe48c15e570 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe488c00640 1 -- 172.21.15.165:0/244072826 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4840be070 con 0x7fe48c15e570 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe492a00640 1 -- 172.21.15.165:0/244072826 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48c14ed70 con 0x7fe48c15e570 2024-09-12T12:12:21.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe488c00640 1 -- 172.21.15.165:0/244072826 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe484009510 con 0x7fe48c15e570 2024-09-12T12:12:21.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe492a00640 1 -- 172.21.15.165:0/244072826 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48c14f330 con 0x7fe48c15e570 2024-09-12T12:12:21.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe488c00640 1 -- 172.21.15.165:0/244072826 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4840b88b0 con 0x7fe48c15e570 2024-09-12T12:12:21.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe488c00640 1 -- 172.21.15.165:0/244072826 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe4840c3960 con 0x7fe48c15e570 2024-09-12T12:12:21.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.091+0000 7fe492a00640 1 -- 172.21.15.165:0/244072826 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48c0008e0 con 0x7fe48c15e570 2024-09-12T12:12:21.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.111+0000 7fe488c00640 1 -- 172.21.15.165:0/244072826 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe4840165e0 con 0x7fe48c15e570 2024-09-12T12:12:21.113 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:21.111+0000 7f7c0a7a9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:12:21.116 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:21.110+0000 7fc2288db180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:12:21.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.175+0000 7fe492a00640 1 -- 172.21.15.165:0/244072826 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4337f826-e2f8-424f-bbf2-95cac64c0b1f", "id": 0} v 0) -- 0x7fe48c168d70 con 0x7fe48c15e570 2024-09-12T12:12:21.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe488c00640 1 -- 172.21.15.165:0/244072826 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4337f826-e2f8-424f-bbf2-95cac64c0b1f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe4840b8d80 con 0x7fe48c15e570 2024-09-12T12:12:21.184 INFO:teuthology.orchestra.run.smithi165.stdout:0 2024-09-12T12:12:21.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe492a00640 1 -- 172.21.15.165:0/244072826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c15e570 msgr2=0x7fe48c15f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe492a00640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c15e570 0x7fe48c15f520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4840af040 tx=0x7fe4840194a0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe492a00640 1 -- 172.21.15.165:0/244072826 shutdown_connections 2024-09-12T12:12:21.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe492a00640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe48c15e570 0x7fe48c15f520 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe492a00640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe48c0b7220 0x7fe48c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe492a00640 1 --2- 172.21.15.165:0/244072826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe48c06ea70 0x7fe48c168830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe492a00640 1 -- 172.21.15.165:0/244072826 >> 172.21.15.165:0/244072826 conn(0x7fe48c06c010 msgr2=0x7fe48c15c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:21.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe492a00640 1 -- 172.21.15.165:0/244072826 shutdown_connections 2024-09-12T12:12:21.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.183+0000 7fe492a00640 1 -- 172.21.15.165:0/244072826 wait complete. 2024-09-12T12:12:21.205 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4 1 2024-09-12T12:12:21.330 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:21.326+0000 7fc2288db180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:12:21.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a66e00640 1 Processor -- start 2024-09-12T12:12:21.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a66e00640 1 -- start start 2024-09-12T12:12:21.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a66e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a6015c3b0 0x7f1a60073b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a66e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1a60160bf0 0x7f1a600d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a66e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1a6015c790 0x7f1a600d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.341 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a66e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6015d640 con 0x7f1a6015c790 2024-09-12T12:12:21.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a66e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6015cd10 con 0x7f1a60160bf0 2024-09-12T12:12:21.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a66e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6015cff0 con 0x7f1a6015c3b0 2024-09-12T12:12:21.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a6015c3b0 0x7f1a60073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5f400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1a60160bf0 0x7f1a600d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a6015c3b0 0x7f1a60073b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58254/0 (socket says 172.21.15.165:58254) 2024-09-12T12:12:21.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5f400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1a60160bf0 0x7f1a600d2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:46526/0 (socket says 172.21.15.165:46526) 2024-09-12T12:12:21.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5fe00640 1 -- 172.21.15.165:0/3241499347 learned_addr learned my addr 172.21.15.165:0/3241499347 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:21.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a64e00640 1 --2- 172.21.15.165:0/3241499347 >> v2:172.21.15.144:3300/0 conn(0x7f1a6015c790 0x7f1a600d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5fe00640 1 -- 172.21.15.165:0/3241499347 >> v2:172.21.15.165:3300/0 conn(0x7f1a60160bf0 msgr2=0x7f1a600d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:21.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5fe00640 1 --2- 172.21.15.165:0/3241499347 >> v2:172.21.15.165:3300/0 conn(0x7f1a60160bf0 0x7f1a600d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5fe00640 1 -- 172.21.15.165:0/3241499347 >> v2:172.21.15.144:3300/0 conn(0x7f1a6015c790 msgr2=0x7f1a600d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:21.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5fe00640 1 --2- 172.21.15.165:0/3241499347 >> v2:172.21.15.144:3300/0 conn(0x7f1a6015c790 0x7f1a600d2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5fe00640 1 -- 172.21.15.165:0/3241499347 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6015d2d0 con 0x7f1a6015c3b0 2024-09-12T12:12:21.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f1a5f400640 1 --2- 172.21.15.165:0/3241499347 >> v2:172.21.15.165:3300/0 conn(0x7f1a60160bf0 0x7f1a600d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:21.343 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:21.339+0000 7f7c0a7a9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:12:21.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a5fe00640 1 --2- 172.21.15.165:0/3241499347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a6015c3b0 0x7f1a60073b60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a6006c710 tx=0x7f1a5001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83d9fb5d28a592ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:21.344 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a5ea00640 1 -- 172.21.15.165:0/3241499347 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a500ab620 con 0x7f1a6015c3b0 2024-09-12T12:12:21.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a5ea00640 1 -- 172.21.15.165:0/3241499347 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a500b0070 con 0x7f1a6015c3b0 2024-09-12T12:12:21.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a5ea00640 1 -- 172.21.15.165:0/3241499347 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a500ab9e0 con 0x7f1a6015c3b0 2024-09-12T12:12:21.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a66e00640 1 -- 172.21.15.165:0/3241499347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a6015c3b0 msgr2=0x7f1a60073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a66e00640 1 --2- 172.21.15.165:0/3241499347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a6015c3b0 0x7f1a60073b60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a6006c710 tx=0x7f1a5001c520 comp rx=0 tx=0).stop 2024-09-12T12:12:21.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a66e00640 1 -- 172.21.15.165:0/3241499347 shutdown_connections 2024-09-12T12:12:21.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a66e00640 1 --2- 172.21.15.165:0/3241499347 >> v2:172.21.15.144:3300/0 conn(0x7f1a6015c790 0x7f1a600d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a66e00640 1 --2- 172.21.15.165:0/3241499347 >> v2:172.21.15.165:3300/0 conn(0x7f1a60160bf0 0x7f1a600d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a66e00640 1 --2- 172.21.15.165:0/3241499347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a6015c3b0 0x7f1a60073b60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a66e00640 1 -- 172.21.15.165:0/3241499347 >> 172.21.15.165:0/3241499347 conn(0x7f1a6006c010 msgr2=0x7f1a60067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:21.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a66e00640 1 -- 172.21.15.165:0/3241499347 shutdown_connections 2024-09-12T12:12:21.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.343+0000 7f1a66e00640 1 -- 172.21.15.165:0/3241499347 wait complete. 2024-09-12T12:12:21.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 Processor -- start 2024-09-12T12:12:21.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 -- start start 2024-09-12T12:12:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6015c3b0 0x7f1a60151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a6015c790 0x7f1a6014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a60160bf0 0x7f1a601417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6006ffa0 con 0x7f1a6015c3b0 2024-09-12T12:12:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6006fe20 con 0x7f1a6015c790 2024-09-12T12:12:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1a60070120 con 0x7f1a60160bf0 2024-09-12T12:12:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a5f400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a6015c790 0x7f1a6014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a64e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a60160bf0 0x7f1a601417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a64e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a60160bf0 0x7f1a601417d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58262/0 (socket says 172.21.15.165:58262) 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a64e00640 1 -- 172.21.15.165:0/1994736553 learned_addr learned my addr 172.21.15.165:0/1994736553 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a5fe00640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6015c3b0 0x7f1a60151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a64e00640 1 -- 172.21.15.165:0/1994736553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a6015c790 msgr2=0x7f1a6014f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a64e00640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a6015c790 0x7f1a6014f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a64e00640 1 -- 172.21.15.165:0/1994736553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6015c3b0 msgr2=0x7f1a60151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a64e00640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6015c3b0 0x7f1a60151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a64e00640 1 -- 172.21.15.165:0/1994736553 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a601521d0 con 0x7f1a60160bf0 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a5f400640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a6015c790 0x7f1a6014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a5fe00640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6015c3b0 0x7f1a60151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:21.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a64e00640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a60160bf0 0x7f1a601417d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800ef00 tx=0x7f1a5800b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:21.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a57e00640 1 -- 172.21.15.165:0/1994736553 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58018020 con 0x7f1a60160bf0 2024-09-12T12:12:21.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a57e00640 1 -- 172.21.15.165:0/1994736553 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5800bd30 con 0x7f1a60160bf0 2024-09-12T12:12:21.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 -- 172.21.15.165:0/1994736553 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a601524b0 con 0x7f1a60160bf0 2024-09-12T12:12:21.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a57e00640 1 -- 172.21.15.165:0/1994736553 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58014640 con 0x7f1a60160bf0 2024-09-12T12:12:21.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 -- 172.21.15.165:0/1994736553 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a60152a70 con 0x7f1a60160bf0 2024-09-12T12:12:21.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a57e00640 1 -- 172.21.15.165:0/1994736553 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1a5801b020 con 0x7f1a60160bf0 2024-09-12T12:12:21.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a57e00640 1 -- 172.21.15.165:0/1994736553 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f1a5801dce0 con 0x7f1a60160bf0 2024-09-12T12:12:21.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.347+0000 7f1a66e00640 1 -- 172.21.15.165:0/1994736553 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a60073b60 con 0x7f1a60160bf0 2024-09-12T12:12:21.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.351+0000 7f1a57e00640 1 -- 172.21.15.165:0/1994736553 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1a58022020 con 0x7f1a60160bf0 2024-09-12T12:12:21.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.419+0000 7f1a66e00640 1 -- 172.21.15.165:0/1994736553 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4", "id": 1} v 0) -- 0x7f1a60166ed0 con 0x7f1a60160bf0 2024-09-12T12:12:21.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.427+0000 7f1a57e00640 1 -- 172.21.15.165:0/1994736553 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f1a580147e0 con 0x7f1a60160bf0 2024-09-12T12:12:21.430 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-12T12:12:21.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.431+0000 7f1a66e00640 1 -- 172.21.15.165:0/1994736553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a60160bf0 msgr2=0x7f1a601417d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.431+0000 7f1a66e00640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a60160bf0 0x7f1a601417d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800ef00 tx=0x7f1a5800b480 comp rx=0 tx=0).stop 2024-09-12T12:12:21.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.431+0000 7f1a66e00640 1 -- 172.21.15.165:0/1994736553 shutdown_connections 2024-09-12T12:12:21.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.431+0000 7f1a66e00640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a60160bf0 0x7f1a601417d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.431 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.431+0000 7f1a66e00640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a6015c790 0x7f1a6014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.431+0000 7f1a66e00640 1 --2- 172.21.15.165:0/1994736553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a6015c3b0 0x7f1a60151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.431+0000 7f1a66e00640 1 -- 172.21.15.165:0/1994736553 >> 172.21.15.165:0/1994736553 conn(0x7f1a6006c010 msgr2=0x7f1a600d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:21.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.431+0000 7f1a66e00640 1 -- 172.21.15.165:0/1994736553 shutdown_connections 2024-09-12T12:12:21.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.431+0000 7f1a66e00640 1 -- 172.21.15.165:0/1994736553 wait complete. 2024-09-12T12:12:21.450 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 7479c663-64a8-4493-b198-547f3031af57 2 2024-09-12T12:12:21.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f5406000640 1 Processor -- start 2024-09-12T12:12:21.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f5406000640 1 -- start start 2024-09-12T12:12:21.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f5406000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5400073c50 0x7f54000d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f5406000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54000708b0 con 0x7f54000737c0 2024-09-12T12:12:21.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f5406000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5400070b90 con 0x7f540015a120 2024-09-12T12:12:21.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f5406000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5400070e70 con 0x7f5400073c50 2024-09-12T12:12:21.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f53f7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5400073c50 0x7f54000d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f53ff400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f540015a120 0x7f54000730b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.165:37918/0 (socket says 172.21.15.165:37918) 2024-09-12T12:12:21.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f53ff400640 1 -- 172.21.15.165:0/738334262 learned_addr learned my addr 172.21.15.165:0/738334262 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-12T12:12:21.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f53f7e00640 1 -- 172.21.15.165:0/738334262 >> v1:172.21.15.165:6789/0 conn(0x7f540015a120 legacy=0x7f54000730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f53f7e00640 1 -- 172.21.15.165:0/738334262 >> v1:172.21.15.144:6789/0 conn(0x7f54000737c0 legacy=0x7f54000d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.583+0000 7f53f7e00640 1 -- 172.21.15.165:0/738334262 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5400071150 con 0x7f5400073c50 2024-09-12T12:12:21.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f53f7e00640 1 --2- 172.21.15.165:0/738334262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5400073c50 0x7f54000d03a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f53e80097f0 tx=0x7f53e801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81c07be701478ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:21.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f53fea00640 1 -- 172.21.15.165:0/738334262 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e80aa600 con 0x7f5400073c50 2024-09-12T12:12:21.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f53fea00640 1 -- 172.21.15.165:0/738334262 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e80af070 con 0x7f5400073c50 2024-09-12T12:12:21.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f53fea00640 1 -- 172.21.15.165:0/738334262 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e80aa9c0 con 0x7f5400073c50 2024-09-12T12:12:21.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f5406000640 1 -- 172.21.15.165:0/738334262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5400073c50 msgr2=0x7f54000d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f5406000640 1 --2- 172.21.15.165:0/738334262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5400073c50 0x7f54000d03a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f53e80097f0 tx=0x7f53e801c4b0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f5406000640 1 -- 172.21.15.165:0/738334262 shutdown_connections 2024-09-12T12:12:21.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f5406000640 1 --2- 172.21.15.165:0/738334262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5400073c50 0x7f54000d03a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f5406000640 1 -- 172.21.15.165:0/738334262 >> 172.21.15.165:0/738334262 conn(0x7f54000d2400 msgr2=0x7f54000d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:21.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f5406000640 1 -- 172.21.15.165:0/738334262 shutdown_connections 2024-09-12T12:12:21.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.587+0000 7f5406000640 1 -- 172.21.15.165:0/738334262 wait complete. 2024-09-12T12:12:21.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 Processor -- start 2024-09-12T12:12:21.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 -- start start 2024-09-12T12:12:21.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54000737c0 0x7f54001456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5400073c50 0x7f5400144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f540015a120 0x7f54000cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f540016a540 con 0x7f540015a120 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f540016a3c0 con 0x7f5400073c50 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f540016a6c0 con 0x7f54000737c0 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5400073c50 0x7f5400144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53ff400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54000737c0 0x7f54001456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5400073c50 0x7f5400144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:46550/0 (socket says 172.21.15.165:46550) 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7e00640 1 -- 172.21.15.165:0/3467077003 learned_addr learned my addr 172.21.15.165:0/3467077003 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:21.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53ffe00640 1 --2- 172.21.15.165:0/3467077003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f540015a120 0x7f54000cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7e00640 1 -- 172.21.15.165:0/3467077003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54000737c0 msgr2=0x7f54001456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7e00640 1 --2- 172.21.15.165:0/3467077003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54000737c0 0x7f54001456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7e00640 1 -- 172.21.15.165:0/3467077003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f540015a120 msgr2=0x7f54000cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7e00640 1 --2- 172.21.15.165:0/3467077003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f540015a120 0x7f54000cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7e00640 1 -- 172.21.15.165:0/3467077003 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54000b7300 con 0x7f5400073c50 2024-09-12T12:12:21.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7e00640 1 --2- 172.21.15.165:0/3467077003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5400073c50 0x7f5400144da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53e80ac040 tx=0x7f53e801acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:21.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7400640 1 -- 172.21.15.165:0/3467077003 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e80be610 con 0x7f5400073c50 2024-09-12T12:12:21.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7400640 1 -- 172.21.15.165:0/3467077003 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e80be7f0 con 0x7f5400073c50 2024-09-12T12:12:21.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7400640 1 -- 172.21.15.165:0/3467077003 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e80bebe0 con 0x7f5400073c50 2024-09-12T12:12:21.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 -- 172.21.15.165:0/3467077003 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54000b6540 con 0x7f5400073c50 2024-09-12T12:12:21.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f5406000640 1 -- 172.21.15.165:0/3467077003 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54000b6b00 con 0x7f5400073c50 2024-09-12T12:12:21.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7400640 1 -- 172.21.15.165:0/3467077003 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53e80bc020 con 0x7f5400073c50 2024-09-12T12:12:21.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.591+0000 7f53f7400640 1 -- 172.21.15.165:0/3467077003 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f53e80bed80 con 0x7f5400073c50 2024-09-12T12:12:21.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.595+0000 7f5406000640 1 -- 172.21.15.165:0/3467077003 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54000730b0 con 0x7f5400073c50 2024-09-12T12:12:21.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.595+0000 7f53f7400640 1 -- 172.21.15.165:0/3467077003 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f53e80c5030 con 0x7f5400073c50 2024-09-12T12:12:21.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.663+0000 7f5406000640 1 -- 172.21.15.165:0/3467077003 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7479c663-64a8-4493-b198-547f3031af57", "id": 2} v 0) -- 0x7f5400160db0 con 0x7f5400073c50 2024-09-12T12:12:21.672 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f53f7400640 1 -- 172.21.15.165:0/3467077003 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7479c663-64a8-4493-b198-547f3031af57", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f53e80160d0 con 0x7f5400073c50 2024-09-12T12:12:21.672 INFO:teuthology.orchestra.run.smithi165.stdout:2 2024-09-12T12:12:21.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f5406000640 1 -- 172.21.15.165:0/3467077003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5400073c50 msgr2=0x7f5400144da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f5406000640 1 --2- 172.21.15.165:0/3467077003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5400073c50 0x7f5400144da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53e80ac040 tx=0x7f53e801acf0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f5406000640 1 -- 172.21.15.165:0/3467077003 shutdown_connections 2024-09-12T12:12:21.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f5406000640 1 --2- 172.21.15.165:0/3467077003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f540015a120 0x7f54000cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f5406000640 1 --2- 172.21.15.165:0/3467077003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5400073c50 0x7f5400144da0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f5406000640 1 --2- 172.21.15.165:0/3467077003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54000737c0 0x7f54001456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f5406000640 1 -- 172.21.15.165:0/3467077003 >> 172.21.15.165:0/3467077003 conn(0x7f54000d2400 msgr2=0x7f540006e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:21.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f5406000640 1 -- 172.21.15.165:0/3467077003 shutdown_connections 2024-09-12T12:12:21.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.671+0000 7f5406000640 1 -- 172.21.15.165:0/3467077003 wait complete. 2024-09-12T12:12:21.691 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new f48972e1-284a-4504-9006-8491c0001f0f 3 2024-09-12T12:12:21.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47de600640 1 Processor -- start 2024-09-12T12:12:21.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47de600640 1 -- start start 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47de600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d815e530 0x7f47d80d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47de600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f47d80cfa90 0x7f47d806c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47de600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d80b7740 con 0x7f47d806c620 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47de600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f47d806ca60 con 0x7f47d80cfa90 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47de600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47d80d3a00 con 0x7f47d815e530 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47d7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d815e530 0x7f47d80d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47d7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d815e530 0x7f47d80d30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58300/0 (socket says 172.21.15.165:58300) 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47d7400640 1 -- 172.21.15.165:0/2776211551 learned_addr learned my addr 172.21.15.165:0/2776211551 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47d7e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f47d806c620 0x7f47d806d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.165:37920/0 (socket says 172.21.15.165:37920) 2024-09-12T12:12:21.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47d6a00640 1 --2- 172.21.15.165:0/2776211551 >> v2:172.21.15.165:3300/0 conn(0x7f47d80cfa90 0x7f47d806c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47d7400640 1 -- 172.21.15.165:0/2776211551 >> v2:172.21.15.165:3300/0 conn(0x7f47d80cfa90 msgr2=0x7f47d806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:21.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47d7400640 1 --2- 172.21.15.165:0/2776211551 >> v2:172.21.15.165:3300/0 conn(0x7f47d80cfa90 0x7f47d806c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47d7400640 1 -- 172.21.15.165:0/2776211551 >> v1:172.21.15.165:6789/0 conn(0x7f47d806c620 legacy=0x7f47d806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.827+0000 7f47d7400640 1 -- 172.21.15.165:0/2776211551 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d80d3ce0 con 0x7f47d815e530 2024-09-12T12:12:21.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47d7400640 1 --2- 172.21.15.165:0/2776211551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d815e530 0x7f47d80d30b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8df535848346a2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:21.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47d6000640 1 -- 172.21.15.165:0/2776211551 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ab640 con 0x7f47d815e530 2024-09-12T12:12:21.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47d6000640 1 -- 172.21.15.165:0/2776211551 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c80b0070 con 0x7f47d815e530 2024-09-12T12:12:21.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47d6000640 1 -- 172.21.15.165:0/2776211551 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c80aba00 con 0x7f47d815e530 2024-09-12T12:12:21.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 -- 172.21.15.165:0/2776211551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d815e530 msgr2=0x7f47d80d30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 --2- 172.21.15.165:0/2776211551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d815e530 0x7f47d80d30b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009870 tx=0x7f47c801c530 comp rx=0 tx=0).stop 2024-09-12T12:12:21.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 -- 172.21.15.165:0/2776211551 shutdown_connections 2024-09-12T12:12:21.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 --2- 172.21.15.165:0/2776211551 >> v2:172.21.15.165:3300/0 conn(0x7f47d80cfa90 0x7f47d806c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 --2- 172.21.15.165:0/2776211551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d815e530 0x7f47d80d30b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 -- 172.21.15.165:0/2776211551 >> 172.21.15.165:0/2776211551 conn(0x7f47d80d4680 msgr2=0x7f47d80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:21.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 -- 172.21.15.165:0/2776211551 shutdown_connections 2024-09-12T12:12:21.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 -- 172.21.15.165:0/2776211551 wait complete. 2024-09-12T12:12:21.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 Processor -- start 2024-09-12T12:12:21.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.831+0000 7f47de600640 1 -- start start 2024-09-12T12:12:21.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47de600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d806c620 0x7f47d815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47de600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d80cfa90 0x7f47d8160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47de600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47d815e530 0x7f47d8161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47de600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47d815ea90 con 0x7f47d806c620 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47de600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f47d815e910 con 0x7f47d815e530 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47de600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47d816b230 con 0x7f47d80cfa90 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d80cfa90 0x7f47d8160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47d815e530 0x7f47d8161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d80cfa90 0x7f47d8160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58312/0 (socket says 172.21.15.165:58312) 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d6a00640 1 -- 172.21.15.165:0/2594400672 learned_addr learned my addr 172.21.15.165:0/2594400672 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d7400640 1 --2- 172.21.15.165:0/2594400672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d806c620 0x7f47d815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d6a00640 1 -- 172.21.15.165:0/2594400672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47d815e530 msgr2=0x7f47d8161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d6a00640 1 --2- 172.21.15.165:0/2594400672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47d815e530 0x7f47d8161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d6a00640 1 -- 172.21.15.165:0/2594400672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d806c620 msgr2=0x7f47d815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d6a00640 1 --2- 172.21.15.165:0/2594400672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d806c620 0x7f47d815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d6a00640 1 -- 172.21.15.165:0/2594400672 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d8162ba0 con 0x7f47d80cfa90 2024-09-12T12:12:21.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47d6a00640 1 --2- 172.21.15.165:0/2594400672 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d80cfa90 0x7f47d8160e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47c400e900 tx=0x7f47c400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:21.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47cf400640 1 -- 172.21.15.165:0/2594400672 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4017070 con 0x7f47d80cfa90 2024-09-12T12:12:21.838 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47cf400640 1 -- 172.21.15.165:0/2594400672 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c400ca00 con 0x7f47d80cfa90 2024-09-12T12:12:21.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47de600640 1 -- 172.21.15.165:0/2594400672 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d8162e80 con 0x7f47d80cfa90 2024-09-12T12:12:21.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47cf400640 1 -- 172.21.15.165:0/2594400672 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c400cdd0 con 0x7f47d80cfa90 2024-09-12T12:12:21.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47de600640 1 -- 172.21.15.165:0/2594400672 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d8163440 con 0x7f47d80cfa90 2024-09-12T12:12:21.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47cf400640 1 -- 172.21.15.165:0/2594400672 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f47c401a070 con 0x7f47d80cfa90 2024-09-12T12:12:21.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47cf400640 1 -- 172.21.15.165:0/2594400672 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f47c4013900 con 0x7f47d80cfa90 2024-09-12T12:12:21.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.835+0000 7f47de600640 1 -- 172.21.15.165:0/2594400672 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d80008e0 con 0x7f47d80cfa90 2024-09-12T12:12:21.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.839+0000 7f47cf400640 1 -- 172.21.15.165:0/2594400672 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f47c4013c20 con 0x7f47d80cfa90 2024-09-12T12:12:21.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.907+0000 7f47de600640 1 -- 172.21.15.165:0/2594400672 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f48972e1-284a-4504-9006-8491c0001f0f", "id": 3} v 0) -- 0x7f47d8068530 con 0x7f47d80cfa90 2024-09-12T12:12:21.913 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47cf400640 1 -- 172.21.15.165:0/2594400672 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f48972e1-284a-4504-9006-8491c0001f0f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f47c4013470 con 0x7f47d80cfa90 2024-09-12T12:12:21.913 INFO:teuthology.orchestra.run.smithi165.stdout:3 2024-09-12T12:12:21.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47de600640 1 -- 172.21.15.165:0/2594400672 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d80cfa90 msgr2=0x7f47d8160e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:21.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47de600640 1 --2- 172.21.15.165:0/2594400672 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d80cfa90 0x7f47d8160e40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47c400e900 tx=0x7f47c400edc0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47de600640 1 -- 172.21.15.165:0/2594400672 shutdown_connections 2024-09-12T12:12:21.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47de600640 1 --2- 172.21.15.165:0/2594400672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47d815e530 0x7f47d8161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47de600640 1 --2- 172.21.15.165:0/2594400672 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47d80cfa90 0x7f47d8160e40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47de600640 1 --2- 172.21.15.165:0/2594400672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47d806c620 0x7f47d815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:21.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47de600640 1 -- 172.21.15.165:0/2594400672 >> 172.21.15.165:0/2594400672 conn(0x7f47d80d4680 msgr2=0x7f47d815d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:21.914 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47de600640 1 -- 172.21.15.165:0/2594400672 shutdown_connections 2024-09-12T12:12:21.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:21.911+0000 7f47de600640 1 -- 172.21.15.165:0/2594400672 wait complete. 2024-09-12T12:12:21.933 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9 4 2024-09-12T12:12:21.951 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:21.946+0000 7fc2288db180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:12:21.997 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:21.995+0000 7f7c0a7a9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:12:22.014 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:22.010+0000 7fc2288db180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:12:22.060 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:22.059+0000 7f7c0a7a9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:12:22.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe82b000640 1 Processor -- start 2024-09-12T12:12:22.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe82b000640 1 -- start start 2024-09-12T12:12:22.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe82b000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe824160bf0 0x7fe8240d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe82b000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe82415c790 0x7fe8240d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe82b000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82415cd10 con 0x7fe82415c3b0 2024-09-12T12:12:22.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe82b000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe82415d640 con 0x7fe824160bf0 2024-09-12T12:12:22.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe82b000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe82415cff0 con 0x7fe82415c790 2024-09-12T12:12:22.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe829000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe82415c790 0x7fe8240d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe823e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fe82415c3b0 0x7fe824073b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.165:37926/0 (socket says 172.21.15.165:37926) 2024-09-12T12:12:22.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe823e00640 1 -- 172.21.15.165:0/279978823 learned_addr learned my addr 172.21.15.165:0/279978823 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-12T12:12:22.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe81b400640 1 --2- 172.21.15.165:0/279978823 >> v2:172.21.15.144:3300/0 conn(0x7fe824160bf0 0x7fe8240d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe829000640 1 -- 172.21.15.165:0/279978823 >> v2:172.21.15.144:3300/0 conn(0x7fe824160bf0 msgr2=0x7fe8240d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:22.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe829000640 1 --2- 172.21.15.165:0/279978823 >> v2:172.21.15.144:3300/0 conn(0x7fe824160bf0 0x7fe8240d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe829000640 1 -- 172.21.15.165:0/279978823 >> v1:172.21.15.165:6789/0 conn(0x7fe82415c3b0 legacy=0x7fe824073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.067+0000 7fe829000640 1 -- 172.21.15.165:0/279978823 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82415d2d0 con 0x7fe82415c790 2024-09-12T12:12:22.073 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:22.070+0000 7fc2288db180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:12:22.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe829000640 1 --2- 172.21.15.165:0/279978823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c790 0x7fe8240d2960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe8240d34b0 tx=0x7fe81c01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c107eec4db97d5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:22.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe823400640 1 -- 172.21.15.165:0/279978823 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0b2070 con 0x7fe82415c790 2024-09-12T12:12:22.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe823400640 1 -- 172.21.15.165:0/279978823 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c0a5870 con 0x7fe82415c790 2024-09-12T12:12:22.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe823400640 1 -- 172.21.15.165:0/279978823 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0a5c40 con 0x7fe82415c790 2024-09-12T12:12:22.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe82b000640 1 -- 172.21.15.165:0/279978823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c790 msgr2=0x7fe8240d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe82b000640 1 --2- 172.21.15.165:0/279978823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c790 0x7fe8240d2960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe8240d34b0 tx=0x7fe81c01c8a0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe82b000640 1 -- 172.21.15.165:0/279978823 shutdown_connections 2024-09-12T12:12:22.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe82b000640 1 --2- 172.21.15.165:0/279978823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c790 0x7fe8240d2960 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe82b000640 1 --2- 172.21.15.165:0/279978823 >> v2:172.21.15.144:3300/0 conn(0x7fe824160bf0 0x7fe8240d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe82b000640 1 -- 172.21.15.165:0/279978823 >> 172.21.15.165:0/279978823 conn(0x7fe82406c010 msgr2=0x7fe824067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:22.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe82b000640 1 -- 172.21.15.165:0/279978823 shutdown_connections 2024-09-12T12:12:22.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.071+0000 7fe82b000640 1 -- 172.21.15.165:0/279978823 wait complete. 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe82b000640 1 Processor -- start 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe82b000640 1 -- start start 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe82b000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c3b0 0x7fe82415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe82b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82415c790 0x7fe8240b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe82b000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe824160bf0 0x7fe8240b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe82b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8240d0e90 con 0x7fe82415c790 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe82b000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8240d0d10 con 0x7fe82415c3b0 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe82b000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8240d1010 con 0x7fe824160bf0 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe823e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c3b0 0x7fe82415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe829000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe824160bf0 0x7fe8240b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe823e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c3b0 0x7fe82415ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:46588/0 (socket says 172.21.15.165:46588) 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe823e00640 1 -- 172.21.15.165:0/2724545936 learned_addr learned my addr 172.21.15.165:0/2724545936 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe81b400640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82415c790 0x7fe8240b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe823e00640 1 -- 172.21.15.165:0/2724545936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe824160bf0 msgr2=0x7fe8240b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe823e00640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe824160bf0 0x7fe8240b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe823e00640 1 -- 172.21.15.165:0/2724545936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82415c790 msgr2=0x7fe8240b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe823e00640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82415c790 0x7fe8240b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe823e00640 1 -- 172.21.15.165:0/2724545936 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82415b390 con 0x7fe82415c3b0 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe829000640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe824160bf0 0x7fe8240b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe81b400640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82415c790 0x7fe8240b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe823e00640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c3b0 0x7fe82415ae50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe81400c420 tx=0x7fe81400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe820c00640 1 -- 172.21.15.165:0/2724545936 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814017070 con 0x7fe82415c3b0 2024-09-12T12:12:22.081 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe820c00640 1 -- 172.21.15.165:0/2724545936 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe814005cf0 con 0x7fe82415c3b0 2024-09-12T12:12:22.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe82b000640 1 -- 172.21.15.165:0/2724545936 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8240cd270 con 0x7fe82415c3b0 2024-09-12T12:12:22.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.075+0000 7fe820c00640 1 -- 172.21.15.165:0/2724545936 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8140072f0 con 0x7fe82415c3b0 2024-09-12T12:12:22.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.079+0000 7fe82b000640 1 -- 172.21.15.165:0/2724545936 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8240cd830 con 0x7fe82415c3b0 2024-09-12T12:12:22.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.079+0000 7fe820c00640 1 -- 172.21.15.165:0/2724545936 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe81401a070 con 0x7fe82415c3b0 2024-09-12T12:12:22.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.079+0000 7fe820c00640 1 -- 172.21.15.165:0/2724545936 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe814007490 con 0x7fe82415c3b0 2024-09-12T12:12:22.082 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.079+0000 7fe82b000640 1 -- 172.21.15.165:0/2724545936 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8240d13d0 con 0x7fe82415c3b0 2024-09-12T12:12:22.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.083+0000 7fe820c00640 1 -- 172.21.15.165:0/2724545936 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe814021070 con 0x7fe82415c3b0 2024-09-12T12:12:22.126 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:22.123+0000 7f7c0a7a9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:12:22.151 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.151+0000 7fe82b000640 1 -- 172.21.15.165:0/2724545936 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9", "id": 4} v 0) -- 0x7fe824166060 con 0x7fe82415c3b0 2024-09-12T12:12:22.156 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe820c00640 1 -- 172.21.15.165:0/2724545936 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe81401c440 con 0x7fe82415c3b0 2024-09-12T12:12:22.156 INFO:teuthology.orchestra.run.smithi165.stdout:4 2024-09-12T12:12:22.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe82b000640 1 -- 172.21.15.165:0/2724545936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c3b0 msgr2=0x7fe82415ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe82b000640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c3b0 0x7fe82415ae50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe81400c420 tx=0x7fe81400c8e0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe82b000640 1 -- 172.21.15.165:0/2724545936 shutdown_connections 2024-09-12T12:12:22.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe82b000640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe824160bf0 0x7fe8240b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe82b000640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe82415c790 0x7fe8240b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe82b000640 1 --2- 172.21.15.165:0/2724545936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe82415c3b0 0x7fe82415ae50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe82b000640 1 -- 172.21.15.165:0/2724545936 >> 172.21.15.165:0/2724545936 conn(0x7fe82406c010 msgr2=0x7fe824067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:22.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe82b000640 1 -- 172.21.15.165:0/2724545936 shutdown_connections 2024-09-12T12:12:22.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.155+0000 7fe82b000640 1 -- 172.21.15.165:0/2724545936 wait complete. 2024-09-12T12:12:22.162 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:22.158+0000 7fc2288db180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:12:22.176 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 47ea549e-8f7e-42d6-bd80-0c100b2efd6d 5 2024-09-12T12:12:22.221 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:22.219+0000 7f7c0a7a9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:12:22.222 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:22.218+0000 7fc2288db180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:12:22.285 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:22.283+0000 7f7c0a7a9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:12:22.309 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:22.306+0000 7fc2288db180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:12:22.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35c1800640 1 Processor -- start 2024-09-12T12:12:22.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35c1800640 1 -- start start 2024-09-12T12:12:22.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35c1800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35bc15af60 0x7f35bc0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35c1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc0cd9f0 0x7f35bc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35c1800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35bc0b4300 con 0x7f35bc15b340 2024-09-12T12:12:22.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35c1800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f35bc0b32f0 con 0x7f35bc15af60 2024-09-12T12:12:22.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35c1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35bc0b3540 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35baa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35bc15af60 0x7f35bc0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35ba000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc0cd9f0 0x7f35bc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35baa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35bc15af60 0x7f35bc0ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:46592/0 (socket says 172.21.15.165:46592) 2024-09-12T12:12:22.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35baa00640 1 -- 172.21.15.165:0/1704553098 learned_addr learned my addr 172.21.15.165:0/1704553098 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:22.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35ba000640 1 -- 172.21.15.165:0/1704553098 >> v2:172.21.15.165:3300/0 conn(0x7f35bc15af60 msgr2=0x7f35bc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:22.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35ba000640 1 --2- 172.21.15.165:0/1704553098 >> v2:172.21.15.165:3300/0 conn(0x7f35bc15af60 0x7f35bc0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35ba000640 1 -- 172.21.15.165:0/1704553098 >> v1:172.21.15.144:6789/0 conn(0x7f35bc15b340 legacy=0x7f35bc15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.311+0000 7f35ba000640 1 -- 172.21.15.165:0/1704553098 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc0b3820 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35ba000640 1 --2- 172.21.15.165:0/1704553098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc0cd9f0 0x7f35bc06bc10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35a80097c0 tx=0x7f35a801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed5e6ddbef86565 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:22.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35b9600640 1 -- 172.21.15.165:0/1704553098 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a80b5070 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35b9600640 1 -- 172.21.15.165:0/1704553098 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a80a8990 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35b9600640 1 -- 172.21.15.165:0/1704553098 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a80a8d60 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35c1800640 1 -- 172.21.15.165:0/1704553098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc0cd9f0 msgr2=0x7f35bc06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35c1800640 1 --2- 172.21.15.165:0/1704553098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc0cd9f0 0x7f35bc06bc10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35a80097c0 tx=0x7f35a801ec90 comp rx=0 tx=0).stop 2024-09-12T12:12:22.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35c1800640 1 -- 172.21.15.165:0/1704553098 shutdown_connections 2024-09-12T12:12:22.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35c1800640 1 --2- 172.21.15.165:0/1704553098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc0cd9f0 0x7f35bc06bc10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35c1800640 1 --2- 172.21.15.165:0/1704553098 >> v2:172.21.15.165:3300/0 conn(0x7f35bc15af60 0x7f35bc0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35c1800640 1 -- 172.21.15.165:0/1704553098 >> 172.21.15.165:0/1704553098 conn(0x7f35bc068030 msgr2=0x7f35bc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:22.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35c1800640 1 -- 172.21.15.165:0/1704553098 shutdown_connections 2024-09-12T12:12:22.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.315+0000 7f35c1800640 1 -- 172.21.15.165:0/1704553098 wait complete. 2024-09-12T12:12:22.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 Processor -- start 2024-09-12T12:12:22.319 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 -- start start 2024-09-12T12:12:22.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35bc0cd9f0 0x7f35bc149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35bc15af60 0x7f35bc15cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc15b340 0x7f35bc1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc0b5570 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc0b3de0 con 0x7f35bc15af60 2024-09-12T12:12:22.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35bc0cebc0 con 0x7f35bc15b340 2024-09-12T12:12:22.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35bb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc15b340 0x7f35bc1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35bb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc15b340 0x7f35bc1595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58342/0 (socket says 172.21.15.165:58342) 2024-09-12T12:12:22.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35bb400640 1 -- 172.21.15.165:0/551428343 learned_addr learned my addr 172.21.15.165:0/551428343 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:22.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35baa00640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35bc0cd9f0 0x7f35bc149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35ba000640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35bc15af60 0x7f35bc15cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35baa00640 1 -- 172.21.15.165:0/551428343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc15b340 msgr2=0x7f35bc1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35baa00640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc15b340 0x7f35bc1595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35baa00640 1 -- 172.21.15.165:0/551428343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35bc15af60 msgr2=0x7f35bc15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35baa00640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35bc15af60 0x7f35bc15cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35baa00640 1 -- 172.21.15.165:0/551428343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc14a3b0 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35bb400640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc15b340 0x7f35bc1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:22.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35baa00640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35bc0cd9f0 0x7f35bc149e70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00e870 tx=0x7f35ac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:22.327 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35b2a00640 1 -- 172.21.15.165:0/551428343 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac017070 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35b2a00640 1 -- 172.21.15.165:0/551428343 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ac00c940 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 -- 172.21.15.165:0/551428343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35bc15b8b0 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35b2a00640 1 -- 172.21.15.165:0/551428343 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac00cd10 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 -- 172.21.15.165:0/551428343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35bc15be70 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35b2a00640 1 -- 172.21.15.165:0/551428343 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f35ac01a070 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35b2a00640 1 -- 172.21.15.165:0/551428343 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f35ac006020 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.319+0000 7f35c1800640 1 -- 172.21.15.165:0/551428343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35bc0ce680 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.323+0000 7f35b2a00640 1 -- 172.21.15.165:0/551428343 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f35bc14a3b0 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.372 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:22.366+0000 7fc2288db180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:12:22.379 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:22.375+0000 7f7c0a7a9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:12:22.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.391+0000 7f35c1800640 1 -- 172.21.15.165:0/551428343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47ea549e-8f7e-42d6-bd80-0c100b2efd6d", "id": 5} v 0) -- 0x7f35bc06d5a0 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35b2a00640 1 -- 172.21.15.165:0/551428343 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47ea549e-8f7e-42d6-bd80-0c100b2efd6d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f35ac006570 con 0x7f35bc0cd9f0 2024-09-12T12:12:22.397 INFO:teuthology.orchestra.run.smithi165.stdout:5 2024-09-12T12:12:22.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35c1800640 1 -- 172.21.15.165:0/551428343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35bc0cd9f0 msgr2=0x7f35bc149e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35c1800640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35bc0cd9f0 0x7f35bc149e70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f35ac00e870 tx=0x7f35ac00ed30 comp rx=0 tx=0).stop 2024-09-12T12:12:22.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35c1800640 1 -- 172.21.15.165:0/551428343 shutdown_connections 2024-09-12T12:12:22.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35c1800640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35bc15b340 0x7f35bc1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35c1800640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35bc15af60 0x7f35bc15cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35c1800640 1 --2- 172.21.15.165:0/551428343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35bc0cd9f0 0x7f35bc149e70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35c1800640 1 -- 172.21.15.165:0/551428343 >> 172.21.15.165:0/551428343 conn(0x7f35bc068030 msgr2=0x7f35bc0ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:22.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35c1800640 1 -- 172.21.15.165:0/551428343 shutdown_connections 2024-09-12T12:12:22.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.395+0000 7f35c1800640 1 -- 172.21.15.165:0/551428343 wait complete. 2024-09-12T12:12:22.419 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 97981375-ee59-41ae-9d02-36da47193340 6 2024-09-12T12:12:22.444 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:22.443+0000 7f7c0a7a9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:12:22.544 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:22.542+0000 7fc2288db180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:12:22.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.575+0000 7f482ce00640 1 Processor -- start 2024-09-12T12:12:22.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f482ce00640 1 -- start start 2024-09-12T12:12:22.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f482ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f482815e570 0x7f4828073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f482ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f482806ea70 0x7f48280b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f482ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f48280b7220 0x7f482806f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.581 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f482ce00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4828073550 con 0x7f48280b7220 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f482ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f482815e950 con 0x7f482815e570 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f482ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f482806e5e0 con 0x7f482806ea70 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f4825e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f482815e570 0x7f4828073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f4825e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f482815e570 0x7f4828073ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:46608/0 (socket says 172.21.15.165:46608) 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f4825e00640 1 -- 172.21.15.165:0/1975298407 learned_addr learned my addr 172.21.15.165:0/1975298407 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f4825e00640 1 -- 172.21.15.165:0/1975298407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f482806ea70 msgr2=0x7f48280b6ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f4825e00640 1 --2- 172.21.15.165:0/1975298407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f482806ea70 0x7f48280b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f4825e00640 1 -- 172.21.15.165:0/1975298407 >> v2:172.21.15.144:3300/0 conn(0x7f48280b7220 msgr2=0x7f482806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f4825e00640 1 --2- 172.21.15.165:0/1975298407 >> v2:172.21.15.144:3300/0 conn(0x7f48280b7220 0x7f482806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.579+0000 7f4825e00640 1 -- 172.21.15.165:0/1975298407 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482806d730 con 0x7f482815e570 2024-09-12T12:12:22.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f4825e00640 1 --2- 172.21.15.165:0/1975298407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 0x7f4828073ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f482806c6b0 tx=0x7f481801c230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=606d01dba7788dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:22.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f4824a00640 1 -- 172.21.15.165:0/1975298407 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48180b0070 con 0x7f482815e570 2024-09-12T12:12:22.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f4824a00640 1 -- 172.21.15.165:0/1975298407 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48180ab600 con 0x7f482815e570 2024-09-12T12:12:22.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f4824a00640 1 -- 172.21.15.165:0/1975298407 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48180ab9d0 con 0x7f482815e570 2024-09-12T12:12:22.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 -- 172.21.15.165:0/1975298407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 msgr2=0x7f4828073ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 --2- 172.21.15.165:0/1975298407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 0x7f4828073ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f482806c6b0 tx=0x7f481801c230 comp rx=0 tx=0).stop 2024-09-12T12:12:22.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 -- 172.21.15.165:0/1975298407 shutdown_connections 2024-09-12T12:12:22.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 --2- 172.21.15.165:0/1975298407 >> v2:172.21.15.144:3300/0 conn(0x7f48280b7220 0x7f482806f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 --2- 172.21.15.165:0/1975298407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f482806ea70 0x7f48280b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 --2- 172.21.15.165:0/1975298407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 0x7f4828073ad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 -- 172.21.15.165:0/1975298407 >> 172.21.15.165:0/1975298407 conn(0x7f482806c010 msgr2=0x7f4828067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:22.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 -- 172.21.15.165:0/1975298407 shutdown_connections 2024-09-12T12:12:22.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 -- 172.21.15.165:0/1975298407 wait complete. 2024-09-12T12:12:22.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 Processor -- start 2024-09-12T12:12:22.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.583+0000 7f482ce00640 1 -- start start 2024-09-12T12:12:22.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f482ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f482806ea70 0x7f48280cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f482ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48280b7220 0x7f48281face0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f482ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 0x7f48281fb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f482ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f48280b76b0 con 0x7f482806ea70 2024-09-12T12:12:22.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f482ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f482806e270 con 0x7f482815e570 2024-09-12T12:12:22.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f482ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4828074010 con 0x7f48280b7220 2024-09-12T12:12:22.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4826800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 0x7f48281fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4825400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48280b7220 0x7f48281face0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4826800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 0x7f48281fb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:46610/0 (socket says 172.21.15.165:46610) 2024-09-12T12:12:22.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4826800640 1 -- 172.21.15.165:0/3739542638 learned_addr learned my addr 172.21.15.165:0/3739542638 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:22.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4825e00640 1 --2- 172.21.15.165:0/3739542638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f482806ea70 0x7f48280cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4826800640 1 -- 172.21.15.165:0/3739542638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48280b7220 msgr2=0x7f48281face0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4826800640 1 --2- 172.21.15.165:0/3739542638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48280b7220 0x7f48281face0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4826800640 1 -- 172.21.15.165:0/3739542638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f482806ea70 msgr2=0x7f48280cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4826800640 1 --2- 172.21.15.165:0/3739542638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f482806ea70 0x7f48280cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4826800640 1 -- 172.21.15.165:0/3739542638 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48281575e0 con 0x7f482815e570 2024-09-12T12:12:22.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f4826800640 1 --2- 172.21.15.165:0/3739542638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 0x7f48281fb220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f482000b970 tx=0x7f482000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:22.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f481e000640 1 -- 172.21.15.165:0/3739542638 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820019070 con 0x7f482815e570 2024-09-12T12:12:22.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f481e000640 1 -- 172.21.15.165:0/3739542638 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482000cb60 con 0x7f482815e570 2024-09-12T12:12:22.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f481e000640 1 -- 172.21.15.165:0/3739542638 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820014440 con 0x7f482815e570 2024-09-12T12:12:22.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f482ce00640 1 -- 172.21.15.165:0/3739542638 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48281578c0 con 0x7f482815e570 2024-09-12T12:12:22.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f482ce00640 1 -- 172.21.15.165:0/3739542638 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4828157e80 con 0x7f482815e570 2024-09-12T12:12:22.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f481e000640 1 -- 172.21.15.165:0/3739542638 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f482001c070 con 0x7f482815e570 2024-09-12T12:12:22.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f481e000640 1 -- 172.21.15.165:0/3739542638 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f4820014bd0 con 0x7f482815e570 2024-09-12T12:12:22.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.587+0000 7f482ce00640 1 -- 172.21.15.165:0/3739542638 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48281550f0 con 0x7f482815e570 2024-09-12T12:12:22.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.591+0000 7f481e000640 1 -- 172.21.15.165:0/3739542638 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4820023020 con 0x7f482815e570 2024-09-12T12:12:22.615 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:22.610+0000 7fc2288db180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:12:22.620 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:22.619+0000 7f7c0a7a9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:12:22.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.659+0000 7f482ce00640 1 -- 172.21.15.165:0/3739542638 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "97981375-ee59-41ae-9d02-36da47193340", "id": 6} v 0) -- 0x7f482815a970 con 0x7f482815e570 2024-09-12T12:12:22.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.663+0000 7f481e000640 1 -- 172.21.15.165:0/3739542638 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97981375-ee59-41ae-9d02-36da47193340", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f48200145e0 con 0x7f482815e570 2024-09-12T12:12:22.666 INFO:teuthology.orchestra.run.smithi165.stdout:6 2024-09-12T12:12:22.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.667+0000 7f482ce00640 1 -- 172.21.15.165:0/3739542638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 msgr2=0x7f48281fb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.667+0000 7f482ce00640 1 --2- 172.21.15.165:0/3739542638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 0x7f48281fb220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f482000b970 tx=0x7f482000be30 comp rx=0 tx=0).stop 2024-09-12T12:12:22.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.667+0000 7f482ce00640 1 -- 172.21.15.165:0/3739542638 shutdown_connections 2024-09-12T12:12:22.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.667+0000 7f482ce00640 1 --2- 172.21.15.165:0/3739542638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f482815e570 0x7f48281fb220 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.667+0000 7f482ce00640 1 --2- 172.21.15.165:0/3739542638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48280b7220 0x7f48281face0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.667+0000 7f482ce00640 1 --2- 172.21.15.165:0/3739542638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f482806ea70 0x7f48280cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.667+0000 7f482ce00640 1 -- 172.21.15.165:0/3739542638 >> 172.21.15.165:0/3739542638 conn(0x7f482806c010 msgr2=0x7f4828067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:22.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.667+0000 7f482ce00640 1 -- 172.21.15.165:0/3739542638 shutdown_connections 2024-09-12T12:12:22.668 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.667+0000 7f482ce00640 1 -- 172.21.15.165:0/3739542638 wait complete. 2024-09-12T12:12:22.685 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51 7 2024-09-12T12:12:22.696 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:22.695+0000 7f7c0a7a9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:12:22.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdf200640 1 Processor -- start 2024-09-12T12:12:22.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdf200640 1 -- start start 2024-09-12T12:12:22.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0158a70 0x7f1be00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdf200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1be00b4440 0x7f1be006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdf200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1be0073f00 0x7f1be006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdf200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1be015e9f0 con 0x7f1be00b4440 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdf200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1be015ecd0 con 0x7f1be0073f00 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1be015efb0 con 0x7f1be0158a70 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0158a70 0x7f1be00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bde800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1be0073f00 0x7f1be006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0158a70 0x7f1be00ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58358/0 (socket says 172.21.15.165:58358) 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdde00640 1 -- 172.21.15.165:0/2240758313 learned_addr learned my addr 172.21.15.165:0/2240758313 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdd400640 1 --2- 172.21.15.165:0/2240758313 >> v2:172.21.15.144:3300/0 conn(0x7f1be00b4440 0x7f1be006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdde00640 1 -- 172.21.15.165:0/2240758313 >> v2:172.21.15.165:3300/0 conn(0x7f1be0073f00 msgr2=0x7f1be006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdde00640 1 --2- 172.21.15.165:0/2240758313 >> v2:172.21.15.165:3300/0 conn(0x7f1be0073f00 0x7f1be006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdde00640 1 -- 172.21.15.165:0/2240758313 >> v2:172.21.15.144:3300/0 conn(0x7f1be00b4440 msgr2=0x7f1be006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:22.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdde00640 1 --2- 172.21.15.165:0/2240758313 >> v2:172.21.15.144:3300/0 conn(0x7f1be00b4440 0x7f1be006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdde00640 1 -- 172.21.15.165:0/2240758313 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be015f290 con 0x7f1be0158a70 2024-09-12T12:12:22.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.823+0000 7f1bdd400640 1 --2- 172.21.15.165:0/2240758313 >> v2:172.21.15.144:3300/0 conn(0x7f1be00b4440 0x7f1be006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:12:22.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdde00640 1 --2- 172.21.15.165:0/2240758313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0158a70 0x7f1be00ae890 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1be006ef70 tx=0x7f1bd001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c61ad5b47f207f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:22.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdca00640 1 -- 172.21.15.165:0/2240758313 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00ab5f0 con 0x7f1be0158a70 2024-09-12T12:12:22.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdca00640 1 -- 172.21.15.165:0/2240758313 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd00b0070 con 0x7f1be0158a70 2024-09-12T12:12:22.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdca00640 1 -- 172.21.15.165:0/2240758313 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00ab9b0 con 0x7f1be0158a70 2024-09-12T12:12:22.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdf200640 1 -- 172.21.15.165:0/2240758313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0158a70 msgr2=0x7f1be00ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdf200640 1 --2- 172.21.15.165:0/2240758313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0158a70 0x7f1be00ae890 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1be006ef70 tx=0x7f1bd001c520 comp rx=0 tx=0).stop 2024-09-12T12:12:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdf200640 1 -- 172.21.15.165:0/2240758313 shutdown_connections 2024-09-12T12:12:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdf200640 1 --2- 172.21.15.165:0/2240758313 >> v2:172.21.15.144:3300/0 conn(0x7f1be00b4440 0x7f1be006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdf200640 1 --2- 172.21.15.165:0/2240758313 >> v2:172.21.15.165:3300/0 conn(0x7f1be0073f00 0x7f1be006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdf200640 1 --2- 172.21.15.165:0/2240758313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0158a70 0x7f1be00ae890 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdf200640 1 -- 172.21.15.165:0/2240758313 >> 172.21.15.165:0/2240758313 conn(0x7f1be006d740 msgr2=0x7f1be006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdf200640 1 -- 172.21.15.165:0/2240758313 shutdown_connections 2024-09-12T12:12:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.827+0000 7f1bdf200640 1 -- 172.21.15.165:0/2240758313 wait complete. 2024-09-12T12:12:22.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 Processor -- start 2024-09-12T12:12:22.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 -- start start 2024-09-12T12:12:22.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0073f00 0x7f1be0154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1be00b4440 0x7f1be014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1be0158a70 0x7f1be0150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:22.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1be0162a70 con 0x7f1be00b4440 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1be01628f0 con 0x7f1be0158a70 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1be0162bf0 con 0x7f1be0073f00 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0073f00 0x7f1be0154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bde800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1be0158a70 0x7f1be0150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0073f00 0x7f1be0154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:58360/0 (socket says 172.21.15.165:58360) 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdde00640 1 -- 172.21.15.165:0/1072691468 learned_addr learned my addr 172.21.15.165:0/1072691468 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdd400640 1 --2- 172.21.15.165:0/1072691468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1be00b4440 0x7f1be014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdde00640 1 -- 172.21.15.165:0/1072691468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1be0158a70 msgr2=0x7f1be0150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdde00640 1 --2- 172.21.15.165:0/1072691468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1be0158a70 0x7f1be0150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdde00640 1 -- 172.21.15.165:0/1072691468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1be00b4440 msgr2=0x7f1be014cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdde00640 1 --2- 172.21.15.165:0/1072691468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1be00b4440 0x7f1be014cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdde00640 1 -- 172.21.15.165:0/1072691468 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be0155510 con 0x7f1be0073f00 2024-09-12T12:12:22.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdde00640 1 --2- 172.21.15.165:0/1072691468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0073f00 0x7f1be0154ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ad040 tx=0x7f1bd00192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:22.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bd6000640 1 -- 172.21.15.165:0/1072691468 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00bf610 con 0x7f1be0073f00 2024-09-12T12:12:22.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bd6000640 1 -- 172.21.15.165:0/1072691468 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd00bf7b0 con 0x7f1be0073f00 2024-09-12T12:12:22.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bd6000640 1 -- 172.21.15.165:0/1072691468 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00bfba0 con 0x7f1be0073f00 2024-09-12T12:12:22.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 -- 172.21.15.165:0/1072691468 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be01557f0 con 0x7f1be0073f00 2024-09-12T12:12:22.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 -- 172.21.15.165:0/1072691468 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be015fcd0 con 0x7f1be0073f00 2024-09-12T12:12:22.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bd6000640 1 -- 172.21.15.165:0/1072691468 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1bd00bd020 con 0x7f1be0073f00 2024-09-12T12:12:22.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bd6000640 1 -- 172.21.15.165:0/1072691468 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f1bd00b5df0 con 0x7f1be0073f00 2024-09-12T12:12:22.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.831+0000 7f1bdf200640 1 -- 172.21.15.165:0/1072691468 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be0070270 con 0x7f1be0073f00 2024-09-12T12:12:22.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.835+0000 7f1bd6000640 1 -- 172.21.15.165:0/1072691468 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1bd0016110 con 0x7f1be0073f00 2024-09-12T12:12:22.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.899+0000 7f1bdf200640 1 -- 172.21.15.165:0/1072691468 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51", "id": 7} v 0) -- 0x7f1be015fa80 con 0x7f1be0073f00 2024-09-12T12:12:22.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bd6000640 1 -- 172.21.15.165:0/1072691468 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f1bd00b5790 con 0x7f1be0073f00 2024-09-12T12:12:22.913 INFO:teuthology.orchestra.run.smithi165.stdout:7 2024-09-12T12:12:22.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bdf200640 1 -- 172.21.15.165:0/1072691468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0073f00 msgr2=0x7f1be0154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:22.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bdf200640 1 --2- 172.21.15.165:0/1072691468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0073f00 0x7f1be0154ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ad040 tx=0x7f1bd00192c0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bdf200640 1 -- 172.21.15.165:0/1072691468 shutdown_connections 2024-09-12T12:12:22.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bdf200640 1 --2- 172.21.15.165:0/1072691468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1be0158a70 0x7f1be0150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bdf200640 1 --2- 172.21.15.165:0/1072691468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1be00b4440 0x7f1be014cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.915 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bdf200640 1 --2- 172.21.15.165:0/1072691468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1be0073f00 0x7f1be0154ef0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:22.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bdf200640 1 -- 172.21.15.165:0/1072691468 >> 172.21.15.165:0/1072691468 conn(0x7f1be006d740 msgr2=0x7f1be0071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:22.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bdf200640 1 -- 172.21.15.165:0/1072691468 shutdown_connections 2024-09-12T12:12:22.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:12:22.911+0000 7f1bdf200640 1 -- 172.21.15.165:0/1072691468 wait complete. 2024-09-12T12:12:22.937 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T12:12:22.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T12:12:22.942 INFO:tasks.ceph.osd.0:Started 2024-09-12T12:12:22.943 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T12:12:22.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T12:12:22.957 INFO:tasks.ceph.osd.1:Started 2024-09-12T12:12:22.957 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T12:12:22.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T12:12:22.962 INFO:tasks.ceph.osd.2:Started 2024-09-12T12:12:22.962 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T12:12:22.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T12:12:22.970 INFO:tasks.ceph.osd.3:Started 2024-09-12T12:12:22.971 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T12:12:22.971 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T12:12:22.981 INFO:tasks.ceph.osd.4:Started 2024-09-12T12:12:22.982 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T12:12:22.982 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T12:12:22.986 INFO:tasks.ceph.osd.5:Started 2024-09-12T12:12:22.986 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T12:12:22.986 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T12:12:22.990 INFO:tasks.ceph.osd.6:Started 2024-09-12T12:12:22.990 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T12:12:22.990 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T12:12:22.994 INFO:tasks.ceph.osd.7:Started 2024-09-12T12:12:22.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:12:23.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd79c000640 1 Processor -- start 2024-09-12T12:12:23.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd79c000640 1 -- start start 2024-09-12T12:12:23.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd79c000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd79415e5f0 0x7fd79406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:23.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd79c000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd7940b44a0 0x7fd7940b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:23.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd79c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79406e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:23.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd79c000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd79406ecb0 con 0x7fd79415e5f0 2024-09-12T12:12:23.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd79c000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd79406d260 con 0x7fd7940b44a0 2024-09-12T12:12:23.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd79c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd7940b6f60 con 0x7fd79406e300 2024-09-12T12:12:23.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd799600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd79415e5f0 0x7fd79406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:23.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd799600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd79415e5f0 0x7fd79406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58212/0 (socket says 172.21.15.144:58212) 2024-09-12T12:12:23.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd799600640 1 -- 172.21.15.144:0/1797401898 learned_addr learned my addr 172.21.15.144:0/1797401898 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:23.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd798c00640 1 --2- 172.21.15.144:0/1797401898 >> v2:172.21.15.165:3300/0 conn(0x7fd7940b44a0 0x7fd7940b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:23.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd79a000640 1 --2- 172.21.15.144:0/1797401898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:23.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd799600640 1 -- 172.21.15.144:0/1797401898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 msgr2=0x7fd79406e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:23.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd799600640 1 --2- 172.21.15.144:0/1797401898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79406e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd799600640 1 -- 172.21.15.144:0/1797401898 >> v2:172.21.15.165:3300/0 conn(0x7fd7940b44a0 msgr2=0x7fd7940b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:23.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd799600640 1 --2- 172.21.15.144:0/1797401898 >> v2:172.21.15.165:3300/0 conn(0x7fd7940b44a0 0x7fd7940b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.150+0000 7fd799600640 1 -- 172.21.15.144:0/1797401898 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7940b7240 con 0x7fd79415e5f0 2024-09-12T12:12:23.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd799600640 1 --2- 172.21.15.144:0/1797401898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 0x7fd79406cd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd7940b5570 tx=0x7fd78801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670e34de0f2a9420 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:23.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd793e00640 1 -- 172.21.15.144:0/1797401898 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7880a5840 con 0x7fd79415e5f0 2024-09-12T12:12:23.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd793e00640 1 -- 172.21.15.144:0/1797401898 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7880a59e0 con 0x7fd79415e5f0 2024-09-12T12:12:23.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd793e00640 1 -- 172.21.15.144:0/1797401898 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7880a5db0 con 0x7fd79415e5f0 2024-09-12T12:12:23.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd79c000640 1 -- 172.21.15.144:0/1797401898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 msgr2=0x7fd79406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:23.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd79c000640 1 --2- 172.21.15.144:0/1797401898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 0x7fd79406cd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd7940b5570 tx=0x7fd78801c9c0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd79c000640 1 -- 172.21.15.144:0/1797401898 shutdown_connections 2024-09-12T12:12:23.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd79c000640 1 --2- 172.21.15.144:0/1797401898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79406e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd79c000640 1 --2- 172.21.15.144:0/1797401898 >> v2:172.21.15.165:3300/0 conn(0x7fd7940b44a0 0x7fd7940b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd79c000640 1 --2- 172.21.15.144:0/1797401898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 0x7fd79406cd20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd79c000640 1 -- 172.21.15.144:0/1797401898 >> 172.21.15.144:0/1797401898 conn(0x7fd79406f400 msgr2=0x7fd79406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:23.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd79c000640 1 -- 172.21.15.144:0/1797401898 shutdown_connections 2024-09-12T12:12:23.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.154+0000 7fd79c000640 1 -- 172.21.15.144:0/1797401898 wait complete. 2024-09-12T12:12:23.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 Processor -- start 2024-09-12T12:12:23.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 -- start start 2024-09-12T12:12:23.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79413e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:23.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7940b44a0 0x7fd79414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:23.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 0x7fd7941597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:23.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd7940b6d10 con 0x7fd79415e5f0 2024-09-12T12:12:23.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd7940b6b90 con 0x7fd7940b44a0 2024-09-12T12:12:23.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd79415f720 con 0x7fd79406e300 2024-09-12T12:12:23.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 0x7fd7941597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd799600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79413e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd798c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7940b44a0 0x7fd79414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd799600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79413e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:59794/0 (socket says 172.21.15.144:59794) 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd799600640 1 -- 172.21.15.144:0/1446930971 learned_addr learned my addr 172.21.15.144:0/1446930971 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd799600640 1 -- 172.21.15.144:0/1446930971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7940b44a0 msgr2=0x7fd79414d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd799600640 1 --2- 172.21.15.144:0/1446930971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7940b44a0 0x7fd79414d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd799600640 1 -- 172.21.15.144:0/1446930971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 msgr2=0x7fd7941597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd799600640 1 --2- 172.21.15.144:0/1446930971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 0x7fd7941597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd799600640 1 -- 172.21.15.144:0/1446930971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79413e610 con 0x7fd79406e300 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79a000640 1 --2- 172.21.15.144:0/1446930971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 0x7fd7941597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd799600640 1 --2- 172.21.15.144:0/1446930971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79413e0d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd7880af040 tx=0x7fd788019760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd791600640 1 -- 172.21.15.144:0/1446930971 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7880bc020 con 0x7fd79406e300 2024-09-12T12:12:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd791600640 1 -- 172.21.15.144:0/1446930971 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7880b8670 con 0x7fd79406e300 2024-09-12T12:12:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd791600640 1 -- 172.21.15.144:0/1446930971 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7880b8a60 con 0x7fd79406e300 2024-09-12T12:12:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 -- 172.21.15.144:0/1446930971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79414c250 con 0x7fd79406e300 2024-09-12T12:12:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd79c000640 1 -- 172.21.15.144:0/1446930971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79414c810 con 0x7fd79406e300 2024-09-12T12:12:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd791600640 1 -- 172.21.15.144:0/1446930971 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd7880bf020 con 0x7fd79406e300 2024-09-12T12:12:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.158+0000 7fd791600640 1 -- 172.21.15.144:0/1446930971 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd7880c1bd0 con 0x7fd79406e300 2024-09-12T12:12:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.162+0000 7fd79c000640 1 -- 172.21.15.144:0/1446930971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7940b48d0 con 0x7fd79406e300 2024-09-12T12:12:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.162+0000 7fd791600640 1 -- 172.21.15.144:0/1446930971 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd7880c6030 con 0x7fd79406e300 2024-09-12T12:12:23.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.234+0000 7fd79c000640 1 -- 172.21.15.144:0/1446930971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd79415fab0 con 0x7fd79406e300 2024-09-12T12:12:23.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd791600640 1 -- 172.21.15.144:0/1446930971 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd7880165e0 con 0x7fd79406e300 2024-09-12T12:12:23.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:23.242 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":10,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:22.905516+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:12:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd79c000640 1 -- 172.21.15.144:0/1446930971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 msgr2=0x7fd79413e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd79c000640 1 --2- 172.21.15.144:0/1446930971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79413e0d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd7880af040 tx=0x7fd788019760 comp rx=0 tx=0).stop 2024-09-12T12:12:23.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd79c000640 1 -- 172.21.15.144:0/1446930971 shutdown_connections 2024-09-12T12:12:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd79c000640 1 --2- 172.21.15.144:0/1446930971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79415e5f0 0x7fd7941597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd79c000640 1 --2- 172.21.15.144:0/1446930971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7940b44a0 0x7fd79414d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd79c000640 1 --2- 172.21.15.144:0/1446930971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79406e300 0x7fd79413e0d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd79c000640 1 -- 172.21.15.144:0/1446930971 >> 172.21.15.144:0/1446930971 conn(0x7fd79406f400 msgr2=0x7fd7940b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd79c000640 1 -- 172.21.15.144:0/1446930971 shutdown_connections 2024-09-12T12:12:23.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:23.238+0000 7fd79c000640 1 -- 172.21.15.144:0/1446930971 wait complete. 2024-09-12T12:12:23.257 INFO:tasks.ceph.mgr.y.smithi144.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T12:12:23.258 INFO:tasks.ceph.mgr.y.smithi144.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T12:12:23.258 INFO:tasks.ceph.mgr.y.smithi144.stderr: from numpy import show_config as show_numpy_config 2024-09-12T12:12:23.260 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T12:12:23.261 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T12:12:23.307 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:23.302+0000 7fc2288db180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:12:23.379 INFO:tasks.ceph.mgr.x.smithi165.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T12:12:23.380 INFO:tasks.ceph.mgr.x.smithi165.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T12:12:23.380 INFO:tasks.ceph.mgr.x.smithi165.stderr: from numpy import show_config as show_numpy_config 2024-09-12T12:12:23.444 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:23.439+0000 7f7c0a7a9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:12:23.458 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:23.454+0000 7fc2288db180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:12:23.591 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:23.591+0000 7f7c0a7a9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:12:23.641 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:23.638+0000 7fc2288db180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:12:23.714 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:23.710+0000 7fc2288db180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:12:23.768 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:23.767+0000 7f7c0a7a9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:12:23.841 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:23.839+0000 7f7c0a7a9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:12:23.865 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:23.862+0000 7fc2288db180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:12:23.991 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:23.987+0000 7f7c0a7a9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:12:24.068 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T12:12:24.197 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccb0600640 1 Processor -- start 2024-09-12T12:12:24.197 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccb0600640 1 -- start start 2024-09-12T12:12:24.198 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccb0600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcca8144fc0 0x7fcca80cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:24.198 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccb0600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca81453a0 0x7fcca80b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:24.198 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccb0600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca80b3940 con 0x7fcca8145860 2024-09-12T12:12:24.198 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccb0600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcca80b3c20 con 0x7fcca8144fc0 2024-09-12T12:12:24.198 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccb0600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcca80b3f00 con 0x7fcca81453a0 2024-09-12T12:12:24.199 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccad200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca81453a0 0x7fcca80b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:24.199 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccad200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca81453a0 0x7fcca80b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:59802/0 (socket says 172.21.15.144:59802) 2024-09-12T12:12:24.199 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccad200640 1 -- 172.21.15.144:0/1630758676 learned_addr learned my addr 172.21.15.144:0/1630758676 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:24.199 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccadc00640 1 --2- 172.21.15.144:0/1630758676 >> v2:172.21.15.165:3300/0 conn(0x7fcca8144fc0 0x7fcca80cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:24.199 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccadc00640 1 -- 172.21.15.144:0/1630758676 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca81453a0 msgr2=0x7fcca80b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:24.199 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccadc00640 1 --2- 172.21.15.144:0/1630758676 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca81453a0 0x7fcca80b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:24.199 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccadc00640 1 -- 172.21.15.144:0/1630758676 >> v1:172.21.15.165:6789/0 conn(0x7fcca8145860 legacy=0x7fcca80cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:24.199 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccadc00640 1 -- 172.21.15.144:0/1630758676 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca80b41e0 con 0x7fcca8144fc0 2024-09-12T12:12:24.199 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.194+0000 7fccad200640 1 --2- 172.21.15.144:0/1630758676 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca81453a0 0x7fcca80b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:24.201 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fccadc00640 1 --2- 172.21.15.144:0/1630758676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca8144fc0 0x7fcca80cfd10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0097c0 tx=0x7fcc9c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e45951193654f897 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:24.202 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fcca7e00640 1 -- 172.21.15.144:0/1630758676 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0ab610 con 0x7fcca8144fc0 2024-09-12T12:12:24.202 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fcca7e00640 1 -- 172.21.15.144:0/1630758676 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc9c0b0070 con 0x7fcca8144fc0 2024-09-12T12:12:24.202 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fcca7e00640 1 -- 172.21.15.144:0/1630758676 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0ab9d0 con 0x7fcca8144fc0 2024-09-12T12:12:24.203 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fccb0600640 1 -- 172.21.15.144:0/1630758676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca8144fc0 msgr2=0x7fcca80cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:24.203 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fccb0600640 1 --2- 172.21.15.144:0/1630758676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca8144fc0 0x7fcca80cfd10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0097c0 tx=0x7fcc9c01c470 comp rx=0 tx=0).stop 2024-09-12T12:12:24.203 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fccb0600640 1 -- 172.21.15.144:0/1630758676 shutdown_connections 2024-09-12T12:12:24.203 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fccb0600640 1 --2- 172.21.15.144:0/1630758676 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca81453a0 0x7fcca80b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:24.203 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fccb0600640 1 --2- 172.21.15.144:0/1630758676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca8144fc0 0x7fcca80cfd10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:24.203 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fccb0600640 1 -- 172.21.15.144:0/1630758676 >> 172.21.15.144:0/1630758676 conn(0x7fcca8067fe0 msgr2=0x7fcca806bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:24.203 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fccb0600640 1 -- 172.21.15.144:0/1630758676 shutdown_connections 2024-09-12T12:12:24.203 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.198+0000 7fccb0600640 1 -- 172.21.15.144:0/1630758676 wait complete. 2024-09-12T12:12:24.204 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 Processor -- start 2024-09-12T12:12:24.204 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 -- start start 2024-09-12T12:12:24.206 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcca8144fc0 0x7fcca8141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:24.206 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca81453a0 0x7fcca813aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:24.206 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca8145860 0x7fcca81610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:24.206 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcca80cd9b0 con 0x7fcca8144fc0 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcca80cd830 con 0x7fcca81453a0 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcca806d8a0 con 0x7fcca8145860 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccadc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcca8144fc0 0x7fcca8141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccadc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcca8144fc0 0x7fcca8141fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58222/0 (socket says 172.21.15.144:58222) 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccadc00640 1 -- 172.21.15.144:0/1077700337 learned_addr learned my addr 172.21.15.144:0/1077700337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccae600640 1 --2- 172.21.15.144:0/1077700337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca8145860 0x7fcca81610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccad200640 1 --2- 172.21.15.144:0/1077700337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca81453a0 0x7fcca813aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccadc00640 1 -- 172.21.15.144:0/1077700337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca8145860 msgr2=0x7fcca81610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccadc00640 1 --2- 172.21.15.144:0/1077700337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca8145860 0x7fcca81610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccadc00640 1 -- 172.21.15.144:0/1077700337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca81453a0 msgr2=0x7fcca813aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccadc00640 1 --2- 172.21.15.144:0/1077700337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca81453a0 0x7fcca813aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:24.207 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccadc00640 1 -- 172.21.15.144:0/1077700337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca8163ca0 con 0x7fcca8144fc0 2024-09-12T12:12:24.208 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccadc00640 1 --2- 172.21.15.144:0/1077700337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcca8144fc0 0x7fcca8141fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c01a0a0 tx=0x7fcc9c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:24.208 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fcca5600640 1 -- 172.21.15.144:0/1077700337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0bf610 con 0x7fcca8144fc0 2024-09-12T12:12:24.209 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fcca5600640 1 -- 172.21.15.144:0/1077700337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc9c0bf7d0 con 0x7fcca8144fc0 2024-09-12T12:12:24.209 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fcca5600640 1 -- 172.21.15.144:0/1077700337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0bfbc0 con 0x7fcca8144fc0 2024-09-12T12:12:24.209 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 -- 172.21.15.144:0/1077700337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca8163f80 con 0x7fcca8144fc0 2024-09-12T12:12:24.209 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 -- 172.21.15.144:0/1077700337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca8164540 con 0x7fcca8144fc0 2024-09-12T12:12:24.209 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fcca5600640 1 -- 172.21.15.144:0/1077700337 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcc9c0bd020 con 0x7fcca8144fc0 2024-09-12T12:12:24.209 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fcca5600640 1 -- 172.21.15.144:0/1077700337 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fcc9c0bfe00 con 0x7fcca8144fc0 2024-09-12T12:12:24.209 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.202+0000 7fccb0600640 1 -- 172.21.15.144:0/1077700337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca80b49e0 con 0x7fcca8144fc0 2024-09-12T12:12:24.210 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.206+0000 7fcca5600640 1 -- 172.21.15.144:0/1077700337 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcc9c0a8050 con 0x7fcca8144fc0 2024-09-12T12:12:24.267 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.262+0000 7fccb0600640 1 -- 172.21.15.144:0/1077700337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcca80b1290 con 0x7fcca8144fc0 2024-09-12T12:12:24.268 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.262+0000 7fcca5600640 1 -- 172.21.15.144:0/1077700337 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fcc9c016090 con 0x7fcca8144fc0 2024-09-12T12:12:24.269 INFO:teuthology.misc.health.smithi144.stdout: 2024-09-12T12:12:24.270 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":10,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:22.905516+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:12:24.271 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.266+0000 7fccb0600640 1 -- 172.21.15.144:0/1077700337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcca8144fc0 msgr2=0x7fcca8141fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:24.271 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.266+0000 7fccb0600640 1 --2- 172.21.15.144:0/1077700337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcca8144fc0 0x7fcca8141fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c01a0a0 tx=0x7fcc9c01acb0 comp rx=0 tx=0).stop 2024-09-12T12:12:24.271 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.266+0000 7fccb0600640 1 -- 172.21.15.144:0/1077700337 shutdown_connections 2024-09-12T12:12:24.271 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.266+0000 7fccb0600640 1 --2- 172.21.15.144:0/1077700337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcca8145860 0x7fcca81610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:24.271 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.266+0000 7fccb0600640 1 --2- 172.21.15.144:0/1077700337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcca81453a0 0x7fcca813aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:24.271 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.266+0000 7fccb0600640 1 --2- 172.21.15.144:0/1077700337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcca8144fc0 0x7fcca8141fb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:24.271 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.266+0000 7fccb0600640 1 -- 172.21.15.144:0/1077700337 >> 172.21.15.144:0/1077700337 conn(0x7fcca8067fe0 msgr2=0x7fcca80cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:24.271 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.266+0000 7fccb0600640 1 -- 172.21.15.144:0/1077700337 shutdown_connections 2024-09-12T12:12:24.271 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:24.266+0000 7fccb0600640 1 -- 172.21.15.144:0/1077700337 wait complete. 2024-09-12T12:12:24.286 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T12:12:24.575 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:24.570+0000 7fc2288db180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:12:24.662 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:24.658+0000 7fc2288db180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:12:24.678 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:24.675+0000 7f7c0a7a9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:12:24.701 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-12T12:12:24.699+0000 7fc4c17677c0 -1 Falling back to public interface 2024-09-12T12:12:24.701 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-09-12T12:12:24.699+0000 7f14c7c2f7c0 -1 Falling back to public interface 2024-09-12T12:12:24.716 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-09-12T12:12:24.715+0000 7f64cf9ab7c0 -1 Falling back to public interface 2024-09-12T12:12:24.724 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-12T12:12:24.723+0000 7f02958727c0 -1 Falling back to public interface 2024-09-12T12:12:24.734 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-12T12:12:24.730+0000 7f02246d67c0 -1 Falling back to public interface 2024-09-12T12:12:24.745 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-09-12T12:12:24.742+0000 7f43f54b87c0 -1 Falling back to public interface 2024-09-12T12:12:24.746 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-12T12:12:24.742+0000 7f508de707c0 -1 Falling back to public interface 2024-09-12T12:12:24.773 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:24.771+0000 7f7c0a7a9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:12:24.777 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-12T12:12:24.774+0000 7f2860c727c0 -1 Falling back to public interface 2024-09-12T12:12:24.872 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:24.866+0000 7fc2288db180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:12:24.956 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:24.950+0000 7fc2288db180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:12:24.974 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:24.971+0000 7f7c0a7a9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:12:25.060 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:25.059+0000 7f7c0a7a9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:12:25.288 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:25.282+0000 7fc2288db180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:12:25.360 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:25.354+0000 7fc2288db180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:12:25.396 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:25.395+0000 7f7c0a7a9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:12:25.470 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-12T12:12:25.467+0000 7f7c0a7a9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:12:26.380 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:26.378+0000 7fc1cde00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T12:12:26.381 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-12T12:12:26.378+0000 7fc1cde00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T12:12:28.808 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-09-12T12:12:28.806+0000 7f14c7c2f7c0 -1 osd.7 0 log_to_monitors true 2024-09-12T12:12:28.955 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-12T12:12:28.950+0000 7fc4c17677c0 -1 osd.5 0 log_to_monitors true 2024-09-12T12:12:28.983 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-09-12T12:12:28.982+0000 7f64cf9ab7c0 -1 osd.6 0 log_to_monitors true 2024-09-12T12:12:29.001 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-09-12T12:12:28.998+0000 7f43f54b87c0 -1 osd.0 0 log_to_monitors true 2024-09-12T12:12:29.009 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-12T12:12:29.006+0000 7f02958727c0 -1 osd.4 0 log_to_monitors true 2024-09-12T12:12:29.015 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-12T12:12:29.010+0000 7f02246d67c0 -1 osd.3 0 log_to_monitors true 2024-09-12T12:12:29.189 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-12T12:12:29.186+0000 7f508de707c0 -1 osd.2 0 log_to_monitors true 2024-09-12T12:12:29.319 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-12T12:12:29.314+0000 7f2860c727c0 -1 osd.1 0 log_to_monitors true 2024-09-12T12:12:31.093 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T12:12:31.254 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.246+0000 7f2437200640 1 Processor -- start 2024-09-12T12:12:31.254 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.246+0000 7f2437200640 1 -- start start 2024-09-12T12:12:31.254 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2437200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2430073730 0x7f243006da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:31.254 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2437200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f243006dfa0 0x7f2430162390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:31.254 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2437200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2430073450 con 0x7f243015e6e0 2024-09-12T12:12:31.254 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2437200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f24300d0cc0 con 0x7f243006dfa0 2024-09-12T12:12:31.254 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2437200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f24300d0fa0 con 0x7f2430073730 2024-09-12T12:12:31.254 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2435400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2430073730 0x7f243006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:31.255 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2435e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f243015e6e0 0x7f2430073d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:46810/0 (socket says 172.21.15.144:46810) 2024-09-12T12:12:31.255 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2435400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2430073730 0x7f243006da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:59840/0 (socket says 172.21.15.144:59840) 2024-09-12T12:12:31.255 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2435e00640 1 -- 172.21.15.144:0/153628484 learned_addr learned my addr 172.21.15.144:0/153628484 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:31.255 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2436800640 1 --2- 172.21.15.144:0/153628484 >> v2:172.21.15.165:3300/0 conn(0x7f243006dfa0 0x7f2430162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:31.256 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2434a00640 1 -- 172.21.15.144:0/153628484 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065987491 0 0) 0x7f2430073450 con 0x7f243015e6e0 2024-09-12T12:12:31.256 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2435400640 1 -- 172.21.15.144:0/153628484 >> v2:172.21.15.165:3300/0 conn(0x7f243006dfa0 msgr2=0x7f2430162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:31.256 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2435400640 1 --2- 172.21.15.144:0/153628484 >> v2:172.21.15.165:3300/0 conn(0x7f243006dfa0 0x7f2430162390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:31.256 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2435400640 1 -- 172.21.15.144:0/153628484 >> v1:172.21.15.165:6789/0 conn(0x7f243015e6e0 legacy=0x7f2430073d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:31.256 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.250+0000 7f2435400640 1 -- 172.21.15.144:0/153628484 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24300b19a0 con 0x7f2430073730 2024-09-12T12:12:31.258 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2435400640 1 --2- 172.21.15.144:0/153628484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2430073730 0x7f243006da60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24200097c0 tx=0x7f242001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f78d956702885a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:31.259 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2434a00640 1 -- 172.21.15.144:0/153628484 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24200b1070 con 0x7f2430073730 2024-09-12T12:12:31.259 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2434a00640 1 -- 172.21.15.144:0/153628484 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24200ac630 con 0x7f2430073730 2024-09-12T12:12:31.260 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2434a00640 1 -- 172.21.15.144:0/153628484 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24200a8050 con 0x7f2430073730 2024-09-12T12:12:31.260 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2437200640 1 -- 172.21.15.144:0/153628484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2430073730 msgr2=0x7f243006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:31.260 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2437200640 1 --2- 172.21.15.144:0/153628484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2430073730 0x7f243006da60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24200097c0 tx=0x7f242001c470 comp rx=0 tx=0).stop 2024-09-12T12:12:31.260 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2437200640 1 -- 172.21.15.144:0/153628484 shutdown_connections 2024-09-12T12:12:31.260 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2437200640 1 --2- 172.21.15.144:0/153628484 >> v2:172.21.15.165:3300/0 conn(0x7f243006dfa0 0x7f2430162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:31.260 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2437200640 1 --2- 172.21.15.144:0/153628484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2430073730 0x7f243006da60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:31.261 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2437200640 1 -- 172.21.15.144:0/153628484 >> 172.21.15.144:0/153628484 conn(0x7f24300d23a0 msgr2=0x7f24300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:31.261 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2437200640 1 -- 172.21.15.144:0/153628484 shutdown_connections 2024-09-12T12:12:31.261 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.254+0000 7f2437200640 1 -- 172.21.15.144:0/153628484 wait complete. 2024-09-12T12:12:31.261 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 Processor -- start 2024-09-12T12:12:31.261 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 -- start start 2024-09-12T12:12:31.263 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f243006dfa0 0x7f2430152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:31.263 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2430073730 0x7f24301574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:31.263 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f243015e6e0 0x7f2430159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:31.263 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f243015ec40 con 0x7f243015e6e0 2024-09-12T12:12:31.263 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f243015eac0 con 0x7f2430073730 2024-09-12T12:12:31.263 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f243016b6d0 con 0x7f243006dfa0 2024-09-12T12:12:31.263 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2436800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f243015e6e0 0x7f2430159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:31.263 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2435e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f243006dfa0 0x7f2430152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:31.264 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2436800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f243015e6e0 0x7f2430159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45236/0 (socket says 172.21.15.144:45236) 2024-09-12T12:12:31.264 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2436800640 1 -- 172.21.15.144:0/704987355 learned_addr learned my addr 172.21.15.144:0/704987355 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:31.264 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2435400640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2430073730 0x7f24301574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:31.264 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2436800640 1 -- 172.21.15.144:0/704987355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f243006dfa0 msgr2=0x7f2430152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2436800640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f243006dfa0 0x7f2430152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2436800640 1 -- 172.21.15.144:0/704987355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2430073730 msgr2=0x7f24301574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2436800640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2430073730 0x7f24301574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2436800640 1 -- 172.21.15.144:0/704987355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2430158e60 con 0x7f243015e6e0 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2436800640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f243015e6e0 0x7f2430159c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f242c009dd0 tx=0x7f242c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f242a000640 1 -- 172.21.15.144:0/704987355 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c018020 con 0x7f243015e6e0 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f242a000640 1 -- 172.21.15.144:0/704987355 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242c014480 con 0x7f243015e6e0 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f242a000640 1 -- 172.21.15.144:0/704987355 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c014870 con 0x7f243015e6e0 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2430159140 con 0x7f243015e6e0 2024-09-12T12:12:31.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.258+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2430159700 con 0x7f243015e6e0 2024-09-12T12:12:31.266 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.262+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2430159900 con 0x7f243015e6e0 2024-09-12T12:12:31.266 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.262+0000 7f242a000640 1 -- 172.21.15.144:0/704987355 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f242c01b020 con 0x7f243015e6e0 2024-09-12T12:12:31.267 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.262+0000 7f242a000640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2414067830 0x7f2414069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:31.267 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.262+0000 7f242a000640 1 -- 172.21.15.144:0/704987355 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f242c085b40 con 0x7f243015e6e0 2024-09-12T12:12:31.268 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.262+0000 7f2435e00640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2414067830 0x7f2414069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:31.268 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.266+0000 7f2435e00640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2414067830 0x7f2414069cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2424007bc0 tx=0x7f2424007b10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:31.273 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.270+0000 7f242a000640 1 -- 172.21.15.144:0/704987355 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f242c022030 con 0x7f243015e6e0 2024-09-12T12:12:31.492 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.486+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2430162390 con 0x7f243015e6e0 2024-09-12T12:12:31.495 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.490+0000 7f242a000640 1 -- 172.21.15.144:0/704987355 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f242c010040 con 0x7f243015e6e0 2024-09-12T12:12:31.495 INFO:teuthology.misc.health.smithi144.stdout: 2024-09-12T12:12:31.496 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":12,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:30.420680+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2414067830 msgr2=0x7f2414069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2414067830 0x7f2414069cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2424007bc0 tx=0x7f2424007b10 comp rx=0 tx=0).stop 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f243015e6e0 msgr2=0x7f2430159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f243015e6e0 0x7f2430159c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f242c009dd0 tx=0x7f242c00c490 comp rx=0 tx=0).stop 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 shutdown_connections 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2414067830 0x7f2414069cf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f243015e6e0 0x7f2430159c20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2430073730 0x7f24301574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 --2- 172.21.15.144:0/704987355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f243006dfa0 0x7f2430152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:31.499 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 >> 172.21.15.144:0/704987355 conn(0x7f24300d23a0 msgr2=0x7f24300b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:31.500 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 shutdown_connections 2024-09-12T12:12:31.500 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:31.494+0000 7f2437200640 1 -- 172.21.15.144:0/704987355 wait complete. 2024-09-12T12:12:31.521 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T12:12:32.674 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-12T12:12:32.670+0000 7fc4bc600640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T12:12:32.702 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-12T12:12:32.698+0000 7fc4b2600640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:32.736 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-12T12:12:32.730+0000 7f5088e00640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T12:12:32.741 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-09-12T12:12:32.738+0000 7f14c2a00640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T12:12:32.770 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-12T12:12:32.766+0000 7f507ee00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:32.772 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-09-12T12:12:32.770+0000 7f14b8a00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:32.805 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-12T12:12:32.802+0000 7f0290800640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T12:12:32.823 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-09-12T12:12:32.822+0000 7f64ca800640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T12:12:32.832 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-12T12:12:32.830+0000 7f0286800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:32.840 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-09-12T12:12:32.838+0000 7f43f0400640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T12:12:32.844 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-12T12:12:32.838+0000 7f0220000640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T12:12:32.844 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-12T12:12:32.842+0000 7f285c600640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T12:12:32.848 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-09-12T12:12:32.846+0000 7f64c0800640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:32.865 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-09-12T12:12:32.862+0000 7f43e6400640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:32.885 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-12T12:12:32.882+0000 7f2851c00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:32.894 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-12T12:12:32.894+0000 7f0215600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:38.328 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T12:12:38.461 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80ed400640 1 Processor -- start 2024-09-12T12:12:38.461 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80ed400640 1 -- start start 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80ed400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f80e815f890 0x7f80e80b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80ed400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e80b5290 0x7f80e8071920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80ed400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e806f210 con 0x7f80e80735a0 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80ed400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f80e80b56e0 con 0x7f80e815f890 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80ed400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f80e806f4f0 con 0x7f80e80b5290 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e6800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f80e80735a0 0x7f80e806e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58210/0 (socket says 172.21.15.144:58210) 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e6800640 1 -- 172.21.15.144:0/3946432715 learned_addr learned my addr 172.21.15.144:0/3946432715 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e7200640 1 --2- 172.21.15.144:0/3946432715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e80b5290 0x7f80e8071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e5e00640 1 --2- 172.21.15.144:0/3946432715 >> v2:172.21.15.165:3300/0 conn(0x7f80e815f890 0x7f80e80b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.463 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e5400640 1 -- 172.21.15.144:0/3946432715 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594957937 0 0) 0x7f80e806f210 con 0x7f80e80735a0 2024-09-12T12:12:38.464 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e5400640 1 -- 172.21.15.144:0/3946432715 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80cc003530 con 0x7f80e80735a0 2024-09-12T12:12:38.464 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e5400640 1 -- 172.21.15.144:0/3946432715 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 58679777 0 0) 0x7f80cc003530 con 0x7f80e80735a0 2024-09-12T12:12:38.464 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e7200640 1 -- 172.21.15.144:0/3946432715 >> v2:172.21.15.165:3300/0 conn(0x7f80e815f890 msgr2=0x7f80e80b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:38.464 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e7200640 1 --2- 172.21.15.144:0/3946432715 >> v2:172.21.15.165:3300/0 conn(0x7f80e815f890 0x7f80e80b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.464 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e7200640 1 -- 172.21.15.144:0/3946432715 >> v1:172.21.15.144:6789/0 conn(0x7f80e80735a0 legacy=0x7f80e806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.464 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.461+0000 7f80e7200640 1 -- 172.21.15.144:0/3946432715 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e806f7d0 con 0x7f80e80b5290 2024-09-12T12:12:38.466 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80e7200640 1 --2- 172.21.15.144:0/3946432715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e80b5290 0x7f80e8071920 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f80e00097c0 tx=0x7f80e001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dba59e5f3df0ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:38.466 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80e5400640 1 -- 172.21.15.144:0/3946432715 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e00b0070 con 0x7f80e80b5290 2024-09-12T12:12:38.466 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80e5400640 1 -- 172.21.15.144:0/3946432715 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e00ab400 con 0x7f80e80b5290 2024-09-12T12:12:38.466 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80e5400640 1 -- 172.21.15.144:0/3946432715 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8001a00 con 0x7f80e80b5290 2024-09-12T12:12:38.467 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80ed400640 1 -- 172.21.15.144:0/3946432715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e80b5290 msgr2=0x7f80e8071920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.467 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80ed400640 1 --2- 172.21.15.144:0/3946432715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e80b5290 0x7f80e8071920 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f80e00097c0 tx=0x7f80e001c3c0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.467 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80ed400640 1 -- 172.21.15.144:0/3946432715 shutdown_connections 2024-09-12T12:12:38.467 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80ed400640 1 --2- 172.21.15.144:0/3946432715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e80b5290 0x7f80e8071920 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.467 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80ed400640 1 --2- 172.21.15.144:0/3946432715 >> v2:172.21.15.165:3300/0 conn(0x7f80e815f890 0x7f80e80b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.467 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80ed400640 1 -- 172.21.15.144:0/3946432715 >> 172.21.15.144:0/3946432715 conn(0x7f80e806caf0 msgr2=0x7f80e806cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:38.468 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80ed400640 1 -- 172.21.15.144:0/3946432715 shutdown_connections 2024-09-12T12:12:38.468 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.465+0000 7f80ed400640 1 -- 172.21.15.144:0/3946432715 wait complete. 2024-09-12T12:12:38.469 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 Processor -- start 2024-09-12T12:12:38.469 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 -- start start 2024-09-12T12:12:38.471 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e80735a0 0x7f80e8153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.471 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e80b5290 0x7f80e8137b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.471 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e815f890 0x7f80e8138430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.471 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8072670 con 0x7f80e80b5290 2024-09-12T12:12:38.471 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f80e806ef20 con 0x7f80e80735a0 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f80e80727f0 con 0x7f80e815f890 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e80b5290 0x7f80e8137b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e80b5290 0x7f80e8137b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53736/0 (socket says 172.21.15.144:53736) 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e5e00640 1 -- 172.21.15.144:0/4019614314 learned_addr learned my addr 172.21.15.144:0/4019614314 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e6800640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e80735a0 0x7f80e8153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e7200640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e815f890 0x7f80e8138430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e5e00640 1 -- 172.21.15.144:0/4019614314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e815f890 msgr2=0x7f80e8138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e5e00640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e815f890 0x7f80e8138430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e5e00640 1 -- 172.21.15.144:0/4019614314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e80735a0 msgr2=0x7f80e8153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e5e00640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e80735a0 0x7f80e8153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e5e00640 1 -- 172.21.15.144:0/4019614314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e8155440 con 0x7f80e80b5290 2024-09-12T12:12:38.472 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80e5e00640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e80b5290 0x7f80e8137b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f80d400e900 tx=0x7f80d400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:38.473 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80dea00640 1 -- 172.21.15.144:0/4019614314 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d4017070 con 0x7f80e80b5290 2024-09-12T12:12:38.473 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80dea00640 1 -- 172.21.15.144:0/4019614314 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d400ca00 con 0x7f80e80b5290 2024-09-12T12:12:38.473 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e814c540 con 0x7f80e80b5290 2024-09-12T12:12:38.473 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80dea00640 1 -- 172.21.15.144:0/4019614314 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d400cdd0 con 0x7f80e80b5290 2024-09-12T12:12:38.473 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e815ad40 con 0x7f80e80b5290 2024-09-12T12:12:38.474 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.469+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e8071900 con 0x7f80e80b5290 2024-09-12T12:12:38.474 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.473+0000 7f80dea00640 1 -- 172.21.15.144:0/4019614314 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80d401a070 con 0x7f80e80b5290 2024-09-12T12:12:38.474 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.473+0000 7f80dea00640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80c80678f0 0x7f80c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.474 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.473+0000 7f80dea00640 1 -- 172.21.15.144:0/4019614314 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f80d40859c0 con 0x7f80e80b5290 2024-09-12T12:12:38.474 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.473+0000 7f80e6800640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80c80678f0 0x7f80c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.474 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.473+0000 7f80e6800640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80c80678f0 0x7f80c8069db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80d8002240 tx=0x7f80d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:38.479 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.477+0000 7f80dea00640 1 -- 172.21.15.144:0/4019614314 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f80e8155440 con 0x7f80e80b5290 2024-09-12T12:12:38.638 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.637+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80e814cc90 con 0x7f80e80b5290 2024-09-12T12:12:38.639 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.637+0000 7f80dea00640 1 -- 172.21.15.144:0/4019614314 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7f80d4056170 con 0x7f80e80b5290 2024-09-12T12:12:38.639 INFO:teuthology.misc.health.smithi144.stdout: 2024-09-12T12:12:38.639 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":17,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:37.706125+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:12:38.641 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80c80678f0 msgr2=0x7f80c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.641 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80c80678f0 0x7f80c8069db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80d8002240 tx=0x7f80d8009040 comp rx=0 tx=0).stop 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e80b5290 msgr2=0x7f80e8137b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e80b5290 0x7f80e8137b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f80d400e900 tx=0x7f80d400edc0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 shutdown_connections 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80c80678f0 0x7f80c8069db0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e815f890 0x7f80e8138430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e80b5290 0x7f80e8137b00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 --2- 172.21.15.144:0/4019614314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e80735a0 0x7f80e8153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 >> 172.21.15.144:0/4019614314 conn(0x7f80e806caf0 msgr2=0x7f80e8158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 shutdown_connections 2024-09-12T12:12:38.642 INFO:teuthology.misc.health.smithi144.stderr:2024-09-12T12:12:38.641+0000 7f80ed400640 1 -- 172.21.15.144:0/4019614314 wait complete. 2024-09-12T12:12:38.658 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T12:12:38.659 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T12:12:38.659 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:12:38.659 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:12:38.662 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:12:38.662 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:12:38.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:12:38.666 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:12:38.666 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:12:38.666 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:12:38.669 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:12:38.669 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:12:38.669 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:12:38.672 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:12:38.673 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T12:12:38.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:12:38.766 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:12:38.767 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:12:38.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.821+0000 7f9cc1000640 1 Processor -- start 2024-09-12T12:12:38.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.821+0000 7f9cc1000640 1 -- start start 2024-09-12T12:12:38.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cc1000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9cbc0b44a0 0x7f9cbc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cc1000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cbc0b6f60 con 0x7f9cbc15e5f0 2024-09-12T12:12:38.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cc1000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cbc0b7240 con 0x7f9cbc06e300 2024-09-12T12:12:38.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cc1000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9cbc0b7520 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cb9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9cbc0b44a0 0x7f9cbc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cb9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9cbc0b44a0 0x7f9cbc0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53790/0 (socket says 172.21.15.144:53790) 2024-09-12T12:12:38.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cb9400640 1 -- 172.21.15.144:0/4071516729 learned_addr learned my addr 172.21.15.144:0/4071516729 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:38.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cb9400640 1 -- 172.21.15.144:0/4071516729 >> v1:172.21.15.165:6789/0 conn(0x7f9cbc06e300 legacy=0x7f9cbc15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cb9400640 1 -- 172.21.15.144:0/4071516729 >> v1:172.21.15.144:6789/0 conn(0x7f9cbc15e5f0 legacy=0x7f9cbc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cb9400640 1 -- 172.21.15.144:0/4071516729 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc0b7800 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.826 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:12:38.827 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:12:38.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cb9400640 1 --2- 172.21.15.144:0/4071516729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc0b44a0 0x7f9cbc0b48d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009870 tx=0x7f9ca801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be96b997388cfcfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:38.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.825+0000 7f9cb8a00640 1 -- 172.21.15.144:0/4071516729 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80aa610 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cb8a00640 1 -- 172.21.15.144:0/4071516729 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca80af070 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cb8a00640 1 -- 172.21.15.144:0/4071516729 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80aa9d0 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 -- 172.21.15.144:0/4071516729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc0b44a0 msgr2=0x7f9cbc0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 --2- 172.21.15.144:0/4071516729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc0b44a0 0x7f9cbc0b48d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009870 tx=0x7f9ca801c4d0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 -- 172.21.15.144:0/4071516729 shutdown_connections 2024-09-12T12:12:38.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 --2- 172.21.15.144:0/4071516729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc0b44a0 0x7f9cbc0b48d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 -- 172.21.15.144:0/4071516729 >> 172.21.15.144:0/4071516729 conn(0x7f9cbc06f400 msgr2=0x7f9cbc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:38.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 -- 172.21.15.144:0/4071516729 shutdown_connections 2024-09-12T12:12:38.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 -- 172.21.15.144:0/4071516729 wait complete. 2024-09-12T12:12:38.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 Processor -- start 2024-09-12T12:12:38.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 -- start start 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9cbc06e300 0x7f9cbc152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9cbc0b44a0 0x7f9cbc14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc15e5f0 0x7f9cbc151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc0b6d10 con 0x7f9cbc15e5f0 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc0b6b90 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cc1000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9cbc16c940 con 0x7f9cbc06e300 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cba800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc15e5f0 0x7f9cbc151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cb9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9cbc0b44a0 0x7f9cbc14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cb9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9cbc06e300 0x7f9cbc152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cba800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc15e5f0 0x7f9cbc151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53802/0 (socket says 172.21.15.144:53802) 2024-09-12T12:12:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cba800640 1 -- 172.21.15.144:0/1131410873 learned_addr learned my addr 172.21.15.144:0/1131410873 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.829+0000 7f9cb9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9cbc0b44a0 0x7f9cbc14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:38812/0 (socket says 172.21.15.144:38812) 2024-09-12T12:12:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb9400640 1 -- 172.21.15.144:0/1131410873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9cbc06e300 msgr2=0x7f9cbc152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb9400640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9cbc06e300 0x7f9cbc152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb9400640 1 -- 172.21.15.144:0/1131410873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc15e5f0 msgr2=0x7f9cbc151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb9400640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc15e5f0 0x7f9cbc151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb9400640 1 -- 172.21.15.144:0/1131410873 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc153520 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb9400640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9cbc0b44a0 0x7f9cbc14e700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80ab000 tx=0x7f9ca801ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:38.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb2000640 1 -- 172.21.15.144:0/1131410873 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80b3800 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb2000640 1 -- 172.21.15.144:0/1131410873 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca80b39e0 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb2000640 1 -- 172.21.15.144:0/1131410873 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80b3dd0 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc1513f0 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc1487f0 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cbc0b48d0 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb2000640 1 -- 172.21.15.144:0/1131410873 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ca80059a0 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb2000640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9c9c0678f0 0x7f9c9c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:38.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb2000640 1 -- 172.21.15.144:0/1131410873 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9ca81202c0 con 0x7f9cbc0b44a0 2024-09-12T12:12:38.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.833+0000 7f9cb9e00640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9c9c0678f0 0x7f9c9c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:38.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.837+0000 7f9cb9e00640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9c9c0678f0 0x7f9c9c069db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cac007fd0 tx=0x7f9cac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:38.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:38.837+0000 7f9cb2000640 1 -- 172.21.15.144:0/1131410873 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ca80a7070 con 0x7f9cbc0b44a0 2024-09-12T12:12:39.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.029+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cbc0b30f0 con 0x7f9cbc0b44a0 2024-09-12T12:12:39.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.029+0000 7f9cb2000640 1 -- 172.21.15.144:0/1131410873 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f9ca8016150 con 0x7f9cbc0b44a0 2024-09-12T12:12:39.031 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:39.031 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"btime":"2024-09-12T12:12:38:784708+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T12:12:39.031 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 2 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9c9c0678f0 msgr2=0x7f9c9c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9c9c0678f0 0x7f9c9c069db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cac007fd0 tx=0x7f9cac009040 comp rx=0 tx=0).stop 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9cbc0b44a0 msgr2=0x7f9cbc14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9cbc0b44a0 0x7f9cbc14e700 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80ab000 tx=0x7f9ca801ad10 comp rx=0 tx=0).stop 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 shutdown_connections 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9c9c0678f0 0x7f9c9c069db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cbc15e5f0 0x7f9cbc151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9cbc0b44a0 0x7f9cbc14e700 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 --2- 172.21.15.144:0/1131410873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9cbc06e300 0x7f9cbc152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 >> 172.21.15.144:0/1131410873 conn(0x7f9cbc06f400 msgr2=0x7f9cbc0b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 shutdown_connections 2024-09-12T12:12:39.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:39.033+0000 7f9cc1000640 1 -- 172.21.15.144:0/1131410873 wait complete. 2024-09-12T12:12:41.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:12:41.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.197+0000 7f45d4200640 1 Processor -- start 2024-09-12T12:12:41.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.197+0000 7f45d4200640 1 -- start start 2024-09-12T12:12:41.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d4200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f45cc0b44a0 0x7f45cc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d4200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45cc06e300 0x7f45cc06e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d4200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45cc0b6f60 con 0x7f45cc15e5f0 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d4200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f45cc06ec90 con 0x7f45cc06e300 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d4200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f45cc0b7240 con 0x7f45cc0b44a0 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45cc06e300 0x7f45cc06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45cc06e300 0x7f45cc06e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53812/0 (socket says 172.21.15.144:53812) 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d2200640 1 -- 172.21.15.144:0/2368559050 learned_addr learned my addr 172.21.15.144:0/2368559050 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d0e00640 1 --2- 172.21.15.144:0/2368559050 >> v2:172.21.15.165:3300/0 conn(0x7f45cc0b44a0 0x7f45cc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d2200640 1 -- 172.21.15.144:0/2368559050 >> v2:172.21.15.165:3300/0 conn(0x7f45cc0b44a0 msgr2=0x7f45cc0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d2200640 1 --2- 172.21.15.144:0/2368559050 >> v2:172.21.15.165:3300/0 conn(0x7f45cc0b44a0 0x7f45cc0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d2200640 1 -- 172.21.15.144:0/2368559050 >> v1:172.21.15.165:6789/0 conn(0x7f45cc15e5f0 legacy=0x7f45cc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:41.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.201+0000 7f45d2200640 1 -- 172.21.15.144:0/2368559050 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45cc0b7520 con 0x7f45cc06e300 2024-09-12T12:12:41.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d2200640 1 --2- 172.21.15.144:0/2368559050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc06e300 0x7f45cc06e750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f45cc070f80 tx=0x7f45c401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f1ed44b258f655 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:41.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45cbe00640 1 -- 172.21.15.144:0/2368559050 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c40a57d0 con 0x7f45cc06e300 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45cbe00640 1 -- 172.21.15.144:0/2368559050 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c40a5970 con 0x7f45cc06e300 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45cbe00640 1 -- 172.21.15.144:0/2368559050 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c40a5d40 con 0x7f45cc06e300 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 -- 172.21.15.144:0/2368559050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc06e300 msgr2=0x7f45cc06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 --2- 172.21.15.144:0/2368559050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc06e300 0x7f45cc06e750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f45cc070f80 tx=0x7f45c401c8f0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 -- 172.21.15.144:0/2368559050 shutdown_connections 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 --2- 172.21.15.144:0/2368559050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc06e300 0x7f45cc06e750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 --2- 172.21.15.144:0/2368559050 >> v2:172.21.15.165:3300/0 conn(0x7f45cc0b44a0 0x7f45cc0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 -- 172.21.15.144:0/2368559050 >> 172.21.15.144:0/2368559050 conn(0x7f45cc06f400 msgr2=0x7f45cc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 -- 172.21.15.144:0/2368559050 shutdown_connections 2024-09-12T12:12:41.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 -- 172.21.15.144:0/2368559050 wait complete. 2024-09-12T12:12:41.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 Processor -- start 2024-09-12T12:12:41.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 -- start start 2024-09-12T12:12:41.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45cc06e300 0x7f45cc14c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc0b44a0 0x7f45cc160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45cc15e5f0 0x7f45cc152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc15f8a0 con 0x7f45cc0b44a0 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc15f720 con 0x7f45cc06e300 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45cc15fa20 con 0x7f45cc15e5f0 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.205+0000 7f45d0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc0b44a0 0x7f45cc160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc0b44a0 0x7f45cc160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53816/0 (socket says 172.21.15.144:53816) 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d0e00640 1 -- 172.21.15.144:0/3295823275 learned_addr learned my addr 172.21.15.144:0/3295823275 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d1800640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45cc06e300 0x7f45cc14c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d2200640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45cc15e5f0 0x7f45cc152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d0e00640 1 -- 172.21.15.144:0/3295823275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45cc15e5f0 msgr2=0x7f45cc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d0e00640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45cc15e5f0 0x7f45cc152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d0e00640 1 -- 172.21.15.144:0/3295823275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45cc06e300 msgr2=0x7f45cc14c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d0e00640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45cc06e300 0x7f45cc14c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d0e00640 1 -- 172.21.15.144:0/3295823275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45cc14cdf0 con 0x7f45cc0b44a0 2024-09-12T12:12:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d2200640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45cc15e5f0 0x7f45cc152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:12:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d0e00640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc0b44a0 0x7f45cc160ee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f45b800d830 tx=0x7f45b800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45c9600640 1 -- 172.21.15.144:0/3295823275 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b800b6c0 con 0x7f45cc0b44a0 2024-09-12T12:12:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45c9600640 1 -- 172.21.15.144:0/3295823275 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b8019070 con 0x7f45cc0b44a0 2024-09-12T12:12:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45cc14d0d0 con 0x7f45cc0b44a0 2024-09-12T12:12:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45c9600640 1 -- 172.21.15.144:0/3295823275 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b800bae0 con 0x7f45cc0b44a0 2024-09-12T12:12:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45cc150740 con 0x7f45cc0b44a0 2024-09-12T12:12:41.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45cc14cb50 con 0x7f45cc0b44a0 2024-09-12T12:12:41.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45c9600640 1 -- 172.21.15.144:0/3295823275 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45b801e460 con 0x7f45cc0b44a0 2024-09-12T12:12:41.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45c9600640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45ac0678c0 0x7f45ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.209+0000 7f45c9600640 1 -- 172.21.15.144:0/3295823275 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f45b8085f60 con 0x7f45cc0b44a0 2024-09-12T12:12:41.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.213+0000 7f45d1800640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45ac0678c0 0x7f45ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.213+0000 7f45d1800640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45ac0678c0 0x7f45ac069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f45c00098e0 tx=0x7f45c0009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.217+0000 7f45c9600640 1 -- 172.21.15.144:0/3295823275 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45b8056e80 con 0x7f45cc0b44a0 2024-09-12T12:12:41.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.405+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45cc06e750 con 0x7f45cc0b44a0 2024-09-12T12:12:41.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45c9600640 1 -- 172.21.15.144:0/3295823275 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3915 (secure 0 0 0) 0x7f45b8056780 con 0x7f45cc0b44a0 2024-09-12T12:12:41.409 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:41.409 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":3,"btime":"2024-09-12T12:12:39:786881+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T12:12:41.409 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 3 2024-09-12T12:12:41.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45ac0678c0 msgr2=0x7f45ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45ac0678c0 0x7f45ac069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f45c00098e0 tx=0x7f45c0009060 comp rx=0 tx=0).stop 2024-09-12T12:12:41.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc0b44a0 msgr2=0x7f45cc160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc0b44a0 0x7f45cc160ee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f45b800d830 tx=0x7f45b800dcf0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 shutdown_connections 2024-09-12T12:12:41.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45ac0678c0 0x7f45ac069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45cc15e5f0 0x7f45cc152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45cc0b44a0 0x7f45cc160ee0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 --2- 172.21.15.144:0/3295823275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45cc06e300 0x7f45cc14c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 >> 172.21.15.144:0/3295823275 conn(0x7f45cc06f400 msgr2=0x7f45cc0b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:41.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 shutdown_connections 2024-09-12T12:12:41.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.409+0000 7f45d4200640 1 -- 172.21.15.144:0/3295823275 wait complete. 2024-09-12T12:12:41.431 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:12:41.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.565+0000 7f6c62a00640 1 Processor -- start 2024-09-12T12:12:41.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.565+0000 7f6c62a00640 1 -- start start 2024-09-12T12:12:41.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c62a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6c5c15e580 0x7f6c5c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c62a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5c06d9a0 con 0x7f6c5c06d380 2024-09-12T12:12:41.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c62a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5c06df40 con 0x7f6c5c06ea20 2024-09-12T12:12:41.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c62a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6c5c06e220 con 0x7f6c5c15e580 2024-09-12T12:12:41.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c60a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6c5c06d380 0x7f6c5c0cb850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58238/0 (socket says 172.21.15.144:58238) 2024-09-12T12:12:41.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c60a00640 1 -- 172.21.15.144:0/1723941087 learned_addr learned my addr 172.21.15.144:0/1723941087 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5be00640 1 --2- 172.21.15.144:0/1723941087 >> v2:172.21.15.165:3300/0 conn(0x7f6c5c15e580 0x7f6c5c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215182571 0 0) 0x7f6c5c06d9a0 con 0x7f6c5c06d380 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c40003530 con 0x7f6c5c06d380 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3018220025 0 0) 0x7f6c40003530 con 0x7f6c5c06d380 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 >> v2:172.21.15.165:3300/0 conn(0x7f6c5c15e580 msgr2=0x7f6c5c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 --2- 172.21.15.144:0/1723941087 >> v2:172.21.15.165:3300/0 conn(0x7f6c5c15e580 0x7f6c5c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 >> v1:172.21.15.165:6789/0 conn(0x7f6c5c06ea20 legacy=0x7f6c5c06cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c06e500 con 0x7f6c5c06d380 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f6c54001a00 con 0x7f6c5c06d380 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 >> v1:172.21.15.144:6789/0 conn(0x7f6c5c06d380 legacy=0x7f6c5c0cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c400039c0 0x7f6c40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c40004810 0x7f6c40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400051d0 0x7f6c4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c06e220 con 0x7f6c400039c0 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4000c070 con 0x7f6c40004810 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4000c270 con 0x7f6c400051d0 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5be00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c400039c0 0x7f6c40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5b400640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c40004810 0x7f6c40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c60a00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400051d0 0x7f6c4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5be00640 1 -- 172.21.15.144:0/1723941087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400051d0 msgr2=0x7f6c4000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5be00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400051d0 0x7f6c4000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5be00640 1 -- 172.21.15.144:0/1723941087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c40004810 msgr2=0x7f6c40004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5be00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c40004810 0x7f6c40004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c5be00640 1 -- 172.21.15.144:0/1723941087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c40003530 con 0x7f6c400039c0 2024-09-12T12:12:41.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c60a00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400051d0 0x7f6c4000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:12:41.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.569+0000 7f6c60a00640 1 -- 172.21.15.144:0/1723941087 reap_dead start 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c5be00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c400039c0 0x7f6c40003de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009ae0 tx=0x7f6c4c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8492b55f67b615 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0b2070 con 0x7f6c400039c0 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4c0a55e0 con 0x7f6c400039c0 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c5aa00640 1 -- 172.21.15.144:0/1723941087 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0096b0 con 0x7f6c400039c0 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c62a00640 1 -- 172.21.15.144:0/1723941087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c400039c0 msgr2=0x7f6c40003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c62a00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c400039c0 0x7f6c40003de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009ae0 tx=0x7f6c4c01ca70 comp rx=0 tx=0).stop 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c62a00640 1 -- 172.21.15.144:0/1723941087 shutdown_connections 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c62a00640 1 --2- 172.21.15.144:0/1723941087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c400039c0 0x7f6c40003de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c62a00640 1 -- 172.21.15.144:0/1723941087 >> 172.21.15.144:0/1723941087 conn(0x7f6c5c067a00 msgr2=0x7f6c5c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c62a00640 1 -- 172.21.15.144:0/1723941087 shutdown_connections 2024-09-12T12:12:41.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c62a00640 1 -- 172.21.15.144:0/1723941087 wait complete. 2024-09-12T12:12:41.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c62a00640 1 Processor -- start 2024-09-12T12:12:41.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.573+0000 7f6c62a00640 1 -- start start 2024-09-12T12:12:41.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c62a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400039c0 0x7f6c5c15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c62a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c5c1f7e70 0x7f6c5c1f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c62a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c5c1f6480 0x7f6c5c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c62a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c0b7220 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c62a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c0b70a0 con 0x7f6c5c1f6480 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c62a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5c0b73a0 con 0x7f6c400039c0 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c5c1f7e70 0x7f6c5c1f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c5c1f7e70 0x7f6c5c1f7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53834/0 (socket says 172.21.15.144:53834) 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5b400640 1 -- 172.21.15.144:0/2574088917 learned_addr learned my addr 172.21.15.144:0/2574088917 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c60a00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c5c1f6480 0x7f6c5c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5be00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400039c0 0x7f6c5c15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5b400640 1 -- 172.21.15.144:0/2574088917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400039c0 msgr2=0x7f6c5c15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5b400640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400039c0 0x7f6c5c15eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5b400640 1 -- 172.21.15.144:0/2574088917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c5c1f6480 msgr2=0x7f6c5c151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5b400640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c5c1f6480 0x7f6c5c151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5b400640 1 -- 172.21.15.144:0/2574088917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c1f7c60 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c5b400640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c5c1f7e70 0x7f6c5c1f7720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800f7f0 tx=0x7f6c4800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:41.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c53e00640 1 -- 172.21.15.144:0/2574088917 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c480050d0 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c53e00640 1 -- 172.21.15.144:0/2574088917 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c48018070 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5c0b4370 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c53e00640 1 -- 172.21.15.144:0/2574088917 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800d730 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c5c1f88c0 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.577+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c5c0cc010 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.581+0000 7f6c53e00640 1 -- 172.21.15.144:0/2574088917 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c4800d8d0 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.581+0000 7f6c53e00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c3c0678c0 0x7f6c3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.581+0000 7f6c53e00640 1 -- 172.21.15.144:0/2574088917 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6c48085730 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.581+0000 7f6c5be00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c3c0678c0 0x7f6c3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.581+0000 7f6c5be00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c3c0678c0 0x7f6c3c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0af000 tx=0x7f6c4c0046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:41.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.585+0000 7f6c53e00640 1 -- 172.21.15.144:0/2574088917 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c48055ed0 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.741+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6c5c15bf30 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c53e00640 1 -- 172.21.15.144:0/2574088917 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f6c4805a1d0 con 0x7f6c5c1f7e70 2024-09-12T12:12:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:41.745 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:12:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:12:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:12:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:12:41.745 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:12:41.745 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:12:41.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c3c0678c0 msgr2=0x7f6c3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c3c0678c0 0x7f6c3c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0af000 tx=0x7f6c4c0046d0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c5c1f7e70 msgr2=0x7f6c5c1f7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c5c1f7e70 0x7f6c5c1f7720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800f7f0 tx=0x7f6c4800fcb0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 shutdown_connections 2024-09-12T12:12:41.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c3c0678c0 0x7f6c3c069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c5c1f6480 0x7f6c5c151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c5c1f7e70 0x7f6c5c1f7720 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 --2- 172.21.15.144:0/2574088917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c400039c0 0x7f6c5c15eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 >> 172.21.15.144:0/2574088917 conn(0x7f6c5c067a00 msgr2=0x7f6c5c15cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:41.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 shutdown_connections 2024-09-12T12:12:41.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.745+0000 7f6c62a00640 1 -- 172.21.15.144:0/2574088917 wait complete. 2024-09-12T12:12:41.766 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:12:41.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:12:41.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.905+0000 7fad70a00640 1 Processor -- start 2024-09-12T12:12:41.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.905+0000 7fad70a00640 1 -- start start 2024-09-12T12:12:41.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad70a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad6c0d0290 0x7fad6c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad70a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6c0cf4d0 con 0x7fad6c0b3700 2024-09-12T12:12:41.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad70a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6c0cf7b0 con 0x7fad6c15b1b0 2024-09-12T12:12:41.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad70a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fad6c15fd10 con 0x7fad6c0d0290 2024-09-12T12:12:41.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad6aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad6c0d0290 0x7fad6c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad6be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fad6c0b3700 0x7fad6c15f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58240/0 (socket says 172.21.15.144:58240) 2024-09-12T12:12:41.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad6be00640 1 -- 172.21.15.144:0/1064742574 learned_addr learned my addr 172.21.15.144:0/1064742574 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:41.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad6aa00640 1 -- 172.21.15.144:0/1064742574 >> v1:172.21.15.165:6789/0 conn(0x7fad6c15b1b0 legacy=0x7fad6c0b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad6aa00640 1 -- 172.21.15.144:0/1064742574 >> v1:172.21.15.144:6789/0 conn(0x7fad6c0b3700 legacy=0x7fad6c15f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad6aa00640 1 -- 172.21.15.144:0/1064742574 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c0cfa90 con 0x7fad6c0d0290 2024-09-12T12:12:41.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.909+0000 7fad6a000640 1 -- 172.21.15.144:0/1064742574 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3204673336 0 0) 0x7fad6c0cf4d0 con 0x7fad6c0b3700 2024-09-12T12:12:41.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad6aa00640 1 --2- 172.21.15.144:0/1064742574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0d0290 0x7fad6c15efa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad580097c0 tx=0x7fad5801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369477343feb0df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:41.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad6a000640 1 -- 172.21.15.144:0/1064742574 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad580b1070 con 0x7fad6c0d0290 2024-09-12T12:12:41.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad6a000640 1 -- 172.21.15.144:0/1064742574 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad580ac410 con 0x7fad6c0d0290 2024-09-12T12:12:41.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad6a000640 1 -- 172.21.15.144:0/1064742574 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad580ac7e0 con 0x7fad6c0d0290 2024-09-12T12:12:41.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad70a00640 1 -- 172.21.15.144:0/1064742574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0d0290 msgr2=0x7fad6c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad70a00640 1 --2- 172.21.15.144:0/1064742574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0d0290 0x7fad6c15efa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad580097c0 tx=0x7fad5801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad70a00640 1 -- 172.21.15.144:0/1064742574 shutdown_connections 2024-09-12T12:12:41.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad70a00640 1 --2- 172.21.15.144:0/1064742574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0d0290 0x7fad6c15efa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad70a00640 1 -- 172.21.15.144:0/1064742574 >> 172.21.15.144:0/1064742574 conn(0x7fad6c06cd20 msgr2=0x7fad6c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:41.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad70a00640 1 -- 172.21.15.144:0/1064742574 shutdown_connections 2024-09-12T12:12:41.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad70a00640 1 -- 172.21.15.144:0/1064742574 wait complete. 2024-09-12T12:12:41.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad70a00640 1 Processor -- start 2024-09-12T12:12:41.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.913+0000 7fad70a00640 1 -- start start 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad70a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0b3700 0x7fad6c1607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad70a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad6c0d0290 0x7fad6c156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad70a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad6c15b1b0 0x7fad6c163db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad70a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c168aa0 con 0x7fad6c0b3700 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad70a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c168920 con 0x7fad6c0d0290 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad70a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fad6c168c20 con 0x7fad6c15b1b0 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0b3700 0x7fad6c1607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0b3700 0x7fad6c1607f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53848/0 (socket says 172.21.15.144:53848) 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6b400640 1 -- 172.21.15.144:0/2466185429 learned_addr learned my addr 172.21.15.144:0/2466185429 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6aa00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad6c0d0290 0x7fad6c156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6be00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad6c15b1b0 0x7fad6c163db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6b400640 1 -- 172.21.15.144:0/2466185429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad6c15b1b0 msgr2=0x7fad6c163db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6b400640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad6c15b1b0 0x7fad6c163db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6b400640 1 -- 172.21.15.144:0/2466185429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad6c0d0290 msgr2=0x7fad6c156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6b400640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad6c0d0290 0x7fad6c156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6b400640 1 -- 172.21.15.144:0/2466185429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c06c990 con 0x7fad6c0b3700 2024-09-12T12:12:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad6b400640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0b3700 0x7fad6c1607f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c7a0 tx=0x7fad5c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad63400640 1 -- 172.21.15.144:0/2466185429 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c003b80 con 0x7fad6c0b3700 2024-09-12T12:12:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad63400640 1 -- 172.21.15.144:0/2466185429 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c003d20 con 0x7fad6c0b3700 2024-09-12T12:12:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad63400640 1 -- 172.21.15.144:0/2466185429 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00aa90 con 0x7fad6c0b3700 2024-09-12T12:12:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6c1632d0 con 0x7fad6c0b3700 2024-09-12T12:12:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6c160d30 con 0x7fad6c0b3700 2024-09-12T12:12:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6c1630c0 con 0x7fad6c0b3700 2024-09-12T12:12:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad63400640 1 -- 172.21.15.144:0/2466185429 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fad5c00ac30 con 0x7fad6c0b3700 2024-09-12T12:12:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.917+0000 7fad63400640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fad4c0678c0 0x7fad4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.921+0000 7fad63400640 1 -- 172.21.15.144:0/2466185429 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fad5c085780 con 0x7fad6c0b3700 2024-09-12T12:12:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.921+0000 7fad6aa00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fad4c0678c0 0x7fad4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.921+0000 7fad6aa00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fad4c0678c0 0x7fad4c069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad580ae000 tx=0x7fad580a6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:41.925+0000 7fad63400640 1 -- 172.21.15.144:0/2466185429 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fad5c056620 con 0x7fad6c0b3700 2024-09-12T12:12:42.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.081+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fad6c0b2ff0 con 0x7fad6c0b3700 2024-09-12T12:12:42.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:12:42.110 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:12:42.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.809+0000 7fad63400640 1 -- 172.21.15.144:0/2466185429 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fad5c055f20 con 0x7fad6c0b3700 2024-09-12T12:12:42.860 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:12:42.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.809+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fad4c0678c0 msgr2=0x7fad4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:42.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.809+0000 7fad70a00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fad4c0678c0 0x7fad4c069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad580ae000 tx=0x7fad580a6040 comp rx=0 tx=0).stop 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.809+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0b3700 msgr2=0x7fad6c1607f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.809+0000 7fad70a00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0b3700 0x7fad6c1607f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00c7a0 tx=0x7fad5c00cc60 comp rx=0 tx=0).stop 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.813+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 shutdown_connections 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.813+0000 7fad70a00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fad4c0678c0 0x7fad4c069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.813+0000 7fad70a00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad6c15b1b0 0x7fad6c163db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.813+0000 7fad70a00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad6c0d0290 0x7fad6c156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.813+0000 7fad70a00640 1 --2- 172.21.15.144:0/2466185429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad6c0b3700 0x7fad6c1607f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.813+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 >> 172.21.15.144:0/2466185429 conn(0x7fad6c06cd20 msgr2=0x7fad6c157a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.813+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 shutdown_connections 2024-09-12T12:12:42.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:42.813+0000 7fad70a00640 1 -- 172.21.15.144:0/2466185429 wait complete. 2024-09-12T12:12:42.863 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T12:12:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.005+0000 7fd63a000640 1 Processor -- start 2024-09-12T12:12:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.005+0000 7fd63a000640 1 -- start start 2024-09-12T12:12:43.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd63a000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd634159ec0 0x7fd6340b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:43.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd63a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6340b2350 0x7fd634071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:43.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd63a000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd634073680 con 0x7fd6340724f0 2024-09-12T12:12:43.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd63a000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd6340b27b0 con 0x7fd6340b2350 2024-09-12T12:12:43.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd63a000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd634072de0 con 0x7fd634159ec0 2024-09-12T12:12:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd633e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6340b2350 0x7fd634071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd633e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6340b2350 0x7fd634071fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53864/0 (socket says 172.21.15.144:53864) 2024-09-12T12:12:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd633e00640 1 -- 172.21.15.144:0/949209456 learned_addr learned my addr 172.21.15.144:0/949209456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd638c00640 1 --2- 172.21.15.144:0/949209456 >> v2:172.21.15.165:3300/0 conn(0x7fd634159ec0 0x7fd6340b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd633e00640 1 -- 172.21.15.144:0/949209456 >> v2:172.21.15.165:3300/0 conn(0x7fd634159ec0 msgr2=0x7fd6340b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd633e00640 1 --2- 172.21.15.144:0/949209456 >> v2:172.21.15.165:3300/0 conn(0x7fd634159ec0 0x7fd6340b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd633e00640 1 -- 172.21.15.144:0/949209456 >> v1:172.21.15.165:6789/0 conn(0x7fd6340724f0 legacy=0x7fd6340d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd633e00640 1 -- 172.21.15.144:0/949209456 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6340730c0 con 0x7fd6340b2350 2024-09-12T12:12:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.009+0000 7fd638c00640 1 --2- 172.21.15.144:0/949209456 >> v2:172.21.15.165:3300/0 conn(0x7fd634159ec0 0x7fd6340b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:43.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd633e00640 1 --2- 172.21.15.144:0/949209456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b2350 0x7fd634071fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6340d1190 tx=0x7fd62001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a126bcd767eb4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:43.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd633400640 1 -- 172.21.15.144:0/949209456 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200aa610 con 0x7fd6340b2350 2024-09-12T12:12:43.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd633400640 1 -- 172.21.15.144:0/949209456 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6200af070 con 0x7fd6340b2350 2024-09-12T12:12:43.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd633400640 1 -- 172.21.15.144:0/949209456 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200aa9d0 con 0x7fd6340b2350 2024-09-12T12:12:43.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 -- 172.21.15.144:0/949209456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b2350 msgr2=0x7fd634071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 --2- 172.21.15.144:0/949209456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b2350 0x7fd634071fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6340d1190 tx=0x7fd62001c4b0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 -- 172.21.15.144:0/949209456 shutdown_connections 2024-09-12T12:12:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 --2- 172.21.15.144:0/949209456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340b2350 0x7fd634071fb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 --2- 172.21.15.144:0/949209456 >> v2:172.21.15.165:3300/0 conn(0x7fd634159ec0 0x7fd6340b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 -- 172.21.15.144:0/949209456 >> 172.21.15.144:0/949209456 conn(0x7fd63406e7e0 msgr2=0x7fd63406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 -- 172.21.15.144:0/949209456 shutdown_connections 2024-09-12T12:12:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 -- 172.21.15.144:0/949209456 wait complete. 2024-09-12T12:12:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 Processor -- start 2024-09-12T12:12:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 -- start start 2024-09-12T12:12:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340724f0 0x7fd634150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6340b2350 0x7fd634157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd634159ec0 0x7fd63414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd634169150 con 0x7fd6340724f0 2024-09-12T12:12:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd634168fd0 con 0x7fd634159ec0 2024-09-12T12:12:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.013+0000 7fd63a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd6341692d0 con 0x7fd6340b2350 2024-09-12T12:12:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd638c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340724f0 0x7fd634150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:43.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd638c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340724f0 0x7fd634150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53874/0 (socket says 172.21.15.144:53874) 2024-09-12T12:12:43.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd638c00640 1 -- 172.21.15.144:0/202368109 learned_addr learned my addr 172.21.15.144:0/202368109 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:43.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd633e00640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6340b2350 0x7fd634157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:43.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd639600640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd634159ec0 0x7fd63414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:43.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd638c00640 1 -- 172.21.15.144:0/202368109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6340b2350 msgr2=0x7fd634157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:43.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd638c00640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6340b2350 0x7fd634157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd638c00640 1 -- 172.21.15.144:0/202368109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd634159ec0 msgr2=0x7fd63414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:43.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd638c00640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd634159ec0 0x7fd63414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd638c00640 1 -- 172.21.15.144:0/202368109 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd634150c60 con 0x7fd6340724f0 2024-09-12T12:12:43.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd638c00640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340724f0 0x7fd634150680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd62400ce00 tx=0x7fd62400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:43.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd630c00640 1 -- 172.21.15.144:0/202368109 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62400f890 con 0x7fd6340724f0 2024-09-12T12:12:43.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd630c00640 1 -- 172.21.15.144:0/202368109 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62400fa30 con 0x7fd6340724f0 2024-09-12T12:12:43.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd634150f40 con 0x7fd6340724f0 2024-09-12T12:12:43.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd630c00640 1 -- 172.21.15.144:0/202368109 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62400fe40 con 0x7fd6340724f0 2024-09-12T12:12:43.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd634158210 con 0x7fd6340724f0 2024-09-12T12:12:43.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd634071fb0 con 0x7fd6340724f0 2024-09-12T12:12:43.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.017+0000 7fd630c00640 1 -- 172.21.15.144:0/202368109 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd624018400 con 0x7fd6340724f0 2024-09-12T12:12:43.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.021+0000 7fd630c00640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6140678c0 0x7fd614069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:43.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.021+0000 7fd630c00640 1 -- 172.21.15.144:0/202368109 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fd624086d10 con 0x7fd6340724f0 2024-09-12T12:12:43.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.021+0000 7fd633e00640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6140678c0 0x7fd614069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:43.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.021+0000 7fd633e00640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6140678c0 0x7fd614069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ae000 tx=0x7fd6200a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:43.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.025+0000 7fd630c00640 1 -- 172.21.15.144:0/202368109 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd624026020 con 0x7fd6340724f0 2024-09-12T12:12:43.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.181+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fd6340691c0 con 0x7fd6340724f0 2024-09-12T12:12:43.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.813+0000 7fd630c00640 1 -- 172.21.15.144:0/202368109 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7fd624014030 con 0x7fd6340724f0 2024-09-12T12:12:43.817 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:12:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6140678c0 msgr2=0x7fd614069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6140678c0 0x7fd614069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ae000 tx=0x7fd6200a7000 comp rx=0 tx=0).stop 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340724f0 msgr2=0x7fd634150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340724f0 0x7fd634150680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd62400ce00 tx=0x7fd62400a650 comp rx=0 tx=0).stop 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 shutdown_connections 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6140678c0 0x7fd614069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd634159ec0 0x7fd63414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6340b2350 0x7fd634157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 --2- 172.21.15.144:0/202368109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6340724f0 0x7fd634150680 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 >> 172.21.15.144:0/202368109 conn(0x7fd63406e7e0 msgr2=0x7fd63415cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 shutdown_connections 2024-09-12T12:12:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.817+0000 7fd63a000640 1 -- 172.21.15.144:0/202368109 wait complete. 2024-09-12T12:12:43.861 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:12:43.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.997+0000 7f20a3400640 1 Processor -- start 2024-09-12T12:12:43.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.997+0000 7f20a3400640 1 -- start start 2024-09-12T12:12:44.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.997+0000 7f20a3400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f209c15af60 0x7f209c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.997+0000 7f20a3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f209c06c320 0x7f209c0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.997+0000 7f20a3400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c0b4300 con 0x7f209c0cd9f0 2024-09-12T12:12:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.997+0000 7f20a3400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f209c0b32f0 con 0x7f209c06c320 2024-09-12T12:12:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.997+0000 7f20a3400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f209c0b3540 con 0x7f209c15af60 2024-09-12T12:12:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:43.997+0000 7f20a1400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f209c06c320 0x7f209c0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f209be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f209c0cd9f0 0x7f209c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58242/0 (socket says 172.21.15.144:58242) 2024-09-12T12:12:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f209be00640 1 -- 172.21.15.144:0/1321140650 learned_addr learned my addr 172.21.15.144:0/1321140650 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f20a0a00640 1 --2- 172.21.15.144:0/1321140650 >> v2:172.21.15.165:3300/0 conn(0x7f209c15af60 0x7f209c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:44.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f20a1400640 1 -- 172.21.15.144:0/1321140650 >> v2:172.21.15.165:3300/0 conn(0x7f209c15af60 msgr2=0x7f209c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:44.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f20a1400640 1 --2- 172.21.15.144:0/1321140650 >> v2:172.21.15.165:3300/0 conn(0x7f209c15af60 0x7f209c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f20a1400640 1 -- 172.21.15.144:0/1321140650 >> v1:172.21.15.144:6789/0 conn(0x7f209c0cd9f0 legacy=0x7f209c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:44.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f209b400640 1 -- 172.21.15.144:0/1321140650 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471351760 0 0) 0x7f209c0b4300 con 0x7f209c0cd9f0 2024-09-12T12:12:44.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f20a1400640 1 -- 172.21.15.144:0/1321140650 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c0b3820 con 0x7f209c06c320 2024-09-12T12:12:44.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f20a0a00640 1 --2- 172.21.15.144:0/1321140650 >> v2:172.21.15.165:3300/0 conn(0x7f209c15af60 0x7f209c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:12:44.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f20a1400640 1 --2- 172.21.15.144:0/1321140650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c06c320 0x7f209c0b4560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f209c0d0240 tx=0x7f209401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c48c0116752e569 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:44.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f209b400640 1 -- 172.21.15.144:0/1321140650 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20940b0070 con 0x7f209c06c320 2024-09-12T12:12:44.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f209b400640 1 -- 172.21.15.144:0/1321140650 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20940ab600 con 0x7f209c06c320 2024-09-12T12:12:44.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.001+0000 7f209b400640 1 -- 172.21.15.144:0/1321140650 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20940ab9d0 con 0x7f209c06c320 2024-09-12T12:12:44.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 -- 172.21.15.144:0/1321140650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c06c320 msgr2=0x7f209c0b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:44.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 --2- 172.21.15.144:0/1321140650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c06c320 0x7f209c0b4560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f209c0d0240 tx=0x7f209401c480 comp rx=0 tx=0).stop 2024-09-12T12:12:44.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 -- 172.21.15.144:0/1321140650 shutdown_connections 2024-09-12T12:12:44.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 --2- 172.21.15.144:0/1321140650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c06c320 0x7f209c0b4560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 --2- 172.21.15.144:0/1321140650 >> v2:172.21.15.165:3300/0 conn(0x7f209c15af60 0x7f209c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 -- 172.21.15.144:0/1321140650 >> 172.21.15.144:0/1321140650 conn(0x7f209c068030 msgr2=0x7f209c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:44.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 -- 172.21.15.144:0/1321140650 shutdown_connections 2024-09-12T12:12:44.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 -- 172.21.15.144:0/1321140650 wait complete. 2024-09-12T12:12:44.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 Processor -- start 2024-09-12T12:12:44.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 -- start start 2024-09-12T12:12:44.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209c06c320 0x7f209c142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:44.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c0cd9f0 0x7f209c15e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:44.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f209c15af60 0x7f209c141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:44.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0b5430 con 0x7f209c0cd9f0 2024-09-12T12:12:44.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f209c0b52b0 con 0x7f209c15af60 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a3400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f209c0b55b0 con 0x7f209c06c320 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f209be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c0cd9f0 0x7f209c15e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f209be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c0cd9f0 0x7f209c15e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53888/0 (socket says 172.21.15.144:53888) 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f209be00640 1 -- 172.21.15.144:0/422081646 learned_addr learned my addr 172.21.15.144:0/422081646 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a1400640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f209c15af60 0x7f209c141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f20a0a00640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209c06c320 0x7f209c142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f209be00640 1 -- 172.21.15.144:0/422081646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209c06c320 msgr2=0x7f209c142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f209be00640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209c06c320 0x7f209c142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f209be00640 1 -- 172.21.15.144:0/422081646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f209c15af60 msgr2=0x7f209c141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f209be00640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f209c15af60 0x7f209c141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.005+0000 7f209be00640 1 -- 172.21.15.144:0/422081646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c15d8f0 con 0x7f209c0cd9f0 2024-09-12T12:12:44.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.009+0000 7f209be00640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c0cd9f0 0x7f209c15e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f208800c520 tx=0x7f208800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:44.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.009+0000 7f2098c00640 1 -- 172.21.15.144:0/422081646 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2088018070 con 0x7f209c0cd9f0 2024-09-12T12:12:44.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.009+0000 7f2098c00640 1 -- 172.21.15.144:0/422081646 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20880074e0 con 0x7f209c0cd9f0 2024-09-12T12:12:44.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.009+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c1428f0 con 0x7f209c0cd9f0 2024-09-12T12:12:44.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.009+0000 7f2098c00640 1 -- 172.21.15.144:0/422081646 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880049f0 con 0x7f209c0cd9f0 2024-09-12T12:12:44.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.009+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c15e5d0 con 0x7f209c0cd9f0 2024-09-12T12:12:44.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.009+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c0b4560 con 0x7f209c0cd9f0 2024-09-12T12:12:44.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.009+0000 7f2098c00640 1 -- 172.21.15.144:0/422081646 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f208801b070 con 0x7f209c0cd9f0 2024-09-12T12:12:44.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.013+0000 7f2098c00640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f207c0678c0 0x7f207c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:44.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.013+0000 7f2098c00640 1 -- 172.21.15.144:0/422081646 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f2088084f30 con 0x7f209c0cd9f0 2024-09-12T12:12:44.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.013+0000 7f20a0a00640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f207c0678c0 0x7f207c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:44.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.013+0000 7f20a0a00640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f207c0678c0 0x7f207c069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f208c009fd0 tx=0x7f208c009870 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.017+0000 7f2098c00640 1 -- 172.21.15.144:0/422081646 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f209c15d8f0 con 0x7f209c0cd9f0 2024-09-12T12:12:44.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.205+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f209c0735b0 con 0x7f209c0cd9f0 2024-09-12T12:12:44.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.817+0000 7f2098c00640 1 -- 172.21.15.144:0/422081646 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f2088055510 con 0x7f209c0cd9f0 2024-09-12T12:12:44.820 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T12:12:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f207c0678c0 msgr2=0x7f207c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f207c0678c0 0x7f207c069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f208c009fd0 tx=0x7f208c009870 comp rx=0 tx=0).stop 2024-09-12T12:12:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c0cd9f0 msgr2=0x7f209c15e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c0cd9f0 0x7f209c15e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f208800c520 tx=0x7f208800c9e0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 shutdown_connections 2024-09-12T12:12:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f207c0678c0 0x7f207c069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f209c15af60 0x7f209c141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f209c0cd9f0 0x7f209c15e090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 --2- 172.21.15.144:0/422081646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209c06c320 0x7f209c142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:44.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 >> 172.21.15.144:0/422081646 conn(0x7f209c068030 msgr2=0x7f209c0b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:44.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 shutdown_connections 2024-09-12T12:12:44.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:44.821+0000 7f20a3400640 1 -- 172.21.15.144:0/422081646 wait complete. 2024-09-12T12:12:44.879 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T12:12:44.879 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T12:12:45.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc69e400640 1 Processor -- start 2024-09-12T12:12:45.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc69e400640 1 -- start start 2024-09-12T12:12:45.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc69e400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc69815b150 0x7fc6980ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:45.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc69e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815b5c0 0x7fc6980cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:45.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc69e400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69806cd20 con 0x7fc69815ad70 2024-09-12T12:12:45.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc69e400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc69806d880 con 0x7fc69815b150 2024-09-12T12:12:45.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc69e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc69806db20 con 0x7fc69815b5c0 2024-09-12T12:12:45.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc696a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc69815b150 0x7fc6980ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:45.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc696a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc69815b150 0x7fc6980ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53898/0 (socket says 172.21.15.144:53898) 2024-09-12T12:12:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc696a00640 1 -- 172.21.15.144:0/2513496012 learned_addr learned my addr 172.21.15.144:0/2513496012 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc697e00640 1 --2- 172.21.15.144:0/2513496012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815b5c0 0x7fc6980cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc696a00640 1 -- 172.21.15.144:0/2513496012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815b5c0 msgr2=0x7fc6980cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc696a00640 1 --2- 172.21.15.144:0/2513496012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815b5c0 0x7fc6980cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.021+0000 7fc696a00640 1 -- 172.21.15.144:0/2513496012 >> v1:172.21.15.165:6789/0 conn(0x7fc69815ad70 legacy=0x7fc6980b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc696a00640 1 -- 172.21.15.144:0/2513496012 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6980710a0 con 0x7fc69815b150 2024-09-12T12:12:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc697e00640 1 --2- 172.21.15.144:0/2513496012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815b5c0 0x7fc6980cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:45.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc696a00640 1 --2- 172.21.15.144:0/2513496012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 0x7fc6980ccd90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc68401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49523afe462dbd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:45.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc696000640 1 -- 172.21.15.144:0/2513496012 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840b0070 con 0x7fc69815b150 2024-09-12T12:12:45.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc696000640 1 -- 172.21.15.144:0/2513496012 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6840ab600 con 0x7fc69815b150 2024-09-12T12:12:45.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc696000640 1 -- 172.21.15.144:0/2513496012 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840ab9d0 con 0x7fc69815b150 2024-09-12T12:12:45.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc69e400640 1 -- 172.21.15.144:0/2513496012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 msgr2=0x7fc6980ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:45.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc69e400640 1 --2- 172.21.15.144:0/2513496012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 0x7fc6980ccd90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc68401c520 comp rx=0 tx=0).stop 2024-09-12T12:12:45.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc69e400640 1 -- 172.21.15.144:0/2513496012 shutdown_connections 2024-09-12T12:12:45.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc69e400640 1 --2- 172.21.15.144:0/2513496012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815b5c0 0x7fc6980cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc69e400640 1 --2- 172.21.15.144:0/2513496012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 0x7fc6980ccd90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc69e400640 1 -- 172.21.15.144:0/2513496012 >> 172.21.15.144:0/2513496012 conn(0x7fc69806bc10 msgr2=0x7fc69806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:45.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc69e400640 1 -- 172.21.15.144:0/2513496012 shutdown_connections 2024-09-12T12:12:45.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.025+0000 7fc69e400640 1 -- 172.21.15.144:0/2513496012 wait complete. 2024-09-12T12:12:45.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 Processor -- start 2024-09-12T12:12:45.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 -- start start 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815ad70 0x7fc6980ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 0x7fc69815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69815b5c0 0x7fc69814a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc698072390 con 0x7fc69815b150 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc69806de00 con 0x7fc69815b5c0 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc698072510 con 0x7fc69815ad70 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc696a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 0x7fc69815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc696a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 0x7fc69815d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53910/0 (socket says 172.21.15.144:53910) 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc696a00640 1 -- 172.21.15.144:0/3016605912 learned_addr learned my addr 172.21.15.144:0/3016605912 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc697e00640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69815b5c0 0x7fc69814a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:45.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc697400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815ad70 0x7fc6980ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:45.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc696a00640 1 -- 172.21.15.144:0/3016605912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815ad70 msgr2=0x7fc6980ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:45.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc696a00640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815ad70 0x7fc6980ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc696a00640 1 -- 172.21.15.144:0/3016605912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69815b5c0 msgr2=0x7fc69814a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:45.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc696a00640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69815b5c0 0x7fc69814a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc696a00640 1 -- 172.21.15.144:0/3016605912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6980cad50 con 0x7fc69815b150 2024-09-12T12:12:45.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc696a00640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 0x7fc69815d8d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc68401cdc0 tx=0x7fc6840192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:45.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc68f400640 1 -- 172.21.15.144:0/3016605912 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840ba070 con 0x7fc69815b150 2024-09-12T12:12:45.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc68f400640 1 -- 172.21.15.144:0/3016605912 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6840b4640 con 0x7fc69815b150 2024-09-12T12:12:45.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6980cb030 con 0x7fc69815b150 2024-09-12T12:12:45.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc68f400640 1 -- 172.21.15.144:0/3016605912 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840b0040 con 0x7fc69815b150 2024-09-12T12:12:45.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.029+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69814ab70 con 0x7fc69815b150 2024-09-12T12:12:45.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.033+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6980b3ea0 con 0x7fc69815b150 2024-09-12T12:12:45.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.033+0000 7fc68f400640 1 -- 172.21.15.144:0/3016605912 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6840bd070 con 0x7fc69815b150 2024-09-12T12:12:45.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.033+0000 7fc68f400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6780678c0 0x7fc678069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:45.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.033+0000 7fc68f400640 1 -- 172.21.15.144:0/3016605912 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc68411ef40 con 0x7fc69815b150 2024-09-12T12:12:45.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.033+0000 7fc697400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6780678c0 0x7fc678069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:45.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.033+0000 7fc697400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6780678c0 0x7fc678069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc688005530 tx=0x7fc688009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:45.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.037+0000 7fc68f400640 1 -- 172.21.15.144:0/3016605912 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc684016110 con 0x7fc69815b150 2024-09-12T12:12:45.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.209+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fc69814f960 con 0x7fc69815b150 2024-09-12T12:12:45.800 INFO:tasks.ceph.mds.d.smithi165.stderr:2024-09-12T12:12:45.798+0000 7fd8b4c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:12:45.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.841+0000 7fc68f400640 1 -- 172.21.15.144:0/3016605912 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fc6840ef9e0 con 0x7fc69815b150 2024-09-12T12:12:45.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6780678c0 msgr2=0x7fc678069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:45.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6780678c0 0x7fc678069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc688005530 tx=0x7fc688009040 comp rx=0 tx=0).stop 2024-09-12T12:12:45.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 msgr2=0x7fc69815d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:45.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 0x7fc69815d8d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc68401cdc0 tx=0x7fc6840192c0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 shutdown_connections 2024-09-12T12:12:45.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6780678c0 0x7fc678069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69815b5c0 0x7fc69814a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc69815b150 0x7fc69815d8d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 --2- 172.21.15.144:0/3016605912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69815ad70 0x7fc6980ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:45.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 >> 172.21.15.144:0/3016605912 conn(0x7fc69806bc10 msgr2=0x7fc6980ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:45.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 shutdown_connections 2024-09-12T12:12:45.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:45.845+0000 7fc69e400640 1 -- 172.21.15.144:0/3016605912 wait complete. 2024-09-12T12:12:45.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:12:46.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.017+0000 7f1322a00640 1 Processor -- start 2024-09-12T12:12:46.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.017+0000 7f1322a00640 1 -- start start 2024-09-12T12:12:46.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1322a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f131c156750 0x7f131c06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:46.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1322a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f131c06fff0 0x7f131c0d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:46.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1322a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f131c15cbf0 con 0x7f131c0d26c0 2024-09-12T12:12:46.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1322a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f131c15ced0 con 0x7f131c156750 2024-09-12T12:12:46.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1322a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f131c15d1b0 con 0x7f131c06fff0 2024-09-12T12:12:46.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1321600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f131c156750 0x7f131c06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:46.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1321600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f131c156750 0x7f131c06fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53924/0 (socket says 172.21.15.144:53924) 2024-09-12T12:12:46.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1321600640 1 -- 172.21.15.144:0/1052499817 learned_addr learned my addr 172.21.15.144:0/1052499817 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:46.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1322000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f131c0d26c0 0x7f131c15fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58246/0 (socket says 172.21.15.144:58246) 2024-09-12T12:12:46.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1320c00640 1 --2- 172.21.15.144:0/1052499817 >> v2:172.21.15.165:3300/0 conn(0x7f131c06fff0 0x7f131c0d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:46.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1321600640 1 -- 172.21.15.144:0/1052499817 >> v2:172.21.15.165:3300/0 conn(0x7f131c06fff0 msgr2=0x7f131c0d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:46.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1321600640 1 --2- 172.21.15.144:0/1052499817 >> v2:172.21.15.165:3300/0 conn(0x7f131c06fff0 0x7f131c0d2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:46.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1321600640 1 -- 172.21.15.144:0/1052499817 >> v1:172.21.15.144:6789/0 conn(0x7f131c0d26c0 legacy=0x7f131c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:46.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1321600640 1 -- 172.21.15.144:0/1052499817 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c15d490 con 0x7f131c156750 2024-09-12T12:12:46.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1320c00640 1 --2- 172.21.15.144:0/1052499817 >> v2:172.21.15.165:3300/0 conn(0x7f131c06fff0 0x7f131c0d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:46.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.021+0000 7f1321600640 1 --2- 172.21.15.144:0/1052499817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c156750 0x7f131c06fab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f131c06f770 tx=0x7f131001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78164aa59ea607c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:46.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f131be00640 1 -- 172.21.15.144:0/1052499817 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13100ab660 con 0x7f131c156750 2024-09-12T12:12:46.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f131be00640 1 -- 172.21.15.144:0/1052499817 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13100b0070 con 0x7f131c156750 2024-09-12T12:12:46.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f131be00640 1 -- 172.21.15.144:0/1052499817 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13100aba20 con 0x7f131c156750 2024-09-12T12:12:46.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 -- 172.21.15.144:0/1052499817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c156750 msgr2=0x7f131c06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:46.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 --2- 172.21.15.144:0/1052499817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c156750 0x7f131c06fab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f131c06f770 tx=0x7f131001c520 comp rx=0 tx=0).stop 2024-09-12T12:12:46.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 -- 172.21.15.144:0/1052499817 shutdown_connections 2024-09-12T12:12:46.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 --2- 172.21.15.144:0/1052499817 >> v2:172.21.15.165:3300/0 conn(0x7f131c06fff0 0x7f131c0d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:46.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 --2- 172.21.15.144:0/1052499817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c156750 0x7f131c06fab0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:46.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 -- 172.21.15.144:0/1052499817 >> 172.21.15.144:0/1052499817 conn(0x7f131c067a00 msgr2=0x7f131c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:46.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 -- 172.21.15.144:0/1052499817 shutdown_connections 2024-09-12T12:12:46.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 -- 172.21.15.144:0/1052499817 wait complete. 2024-09-12T12:12:46.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 Processor -- start 2024-09-12T12:12:46.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 -- start start 2024-09-12T12:12:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f131c06fff0 0x7f131c14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c0d26c0 0x7f131c14cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:46.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f131c156750 0x7f131c148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f131c15c8a0 con 0x7f131c0d26c0 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f131c0d2ad0 con 0x7f131c06fff0 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1322a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f131c156b30 con 0x7f131c156750 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1320c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c0d26c0 0x7f131c14cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1320c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c0d26c0 0x7f131c14cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53940/0 (socket says 172.21.15.144:53940) 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.025+0000 7f1320c00640 1 -- 172.21.15.144:0/1719847879 learned_addr learned my addr 172.21.15.144:0/1719847879 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1321600640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f131c06fff0 0x7f131c14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1322000640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f131c156750 0x7f131c148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1320c00640 1 -- 172.21.15.144:0/1719847879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f131c156750 msgr2=0x7f131c148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1320c00640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f131c156750 0x7f131c148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1320c00640 1 -- 172.21.15.144:0/1719847879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f131c06fff0 msgr2=0x7f131c14b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:46.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1320c00640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f131c06fff0 0x7f131c14b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1320c00640 1 -- 172.21.15.144:0/1719847879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c06d470 con 0x7f131c0d26c0 2024-09-12T12:12:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1322000640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f131c156750 0x7f131c148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1320c00640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c0d26c0 0x7f131c14cd60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f130800c7f0 tx=0x7f130800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1319600640 1 -- 172.21.15.144:0/1719847879 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308015070 con 0x7f131c0d26c0 2024-09-12T12:12:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1319600640 1 -- 172.21.15.144:0/1719847879 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1308007820 con 0x7f131c0d26c0 2024-09-12T12:12:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1319600640 1 -- 172.21.15.144:0/1719847879 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308007c10 con 0x7f131c0d26c0 2024-09-12T12:12:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131c06d710 con 0x7f131c0d26c0 2024-09-12T12:12:46.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131c06dcd0 con 0x7f131c0d26c0 2024-09-12T12:12:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c06dea0 con 0x7f131c0d26c0 2024-09-12T12:12:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1319600640 1 -- 172.21.15.144:0/1719847879 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1308018070 con 0x7f131c0d26c0 2024-09-12T12:12:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1319600640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12fc0678c0 0x7f12fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1319600640 1 -- 172.21.15.144:0/1719847879 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f1308085f00 con 0x7f131c0d26c0 2024-09-12T12:12:46.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.029+0000 7f1321600640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12fc0678c0 0x7f12fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:46.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.033+0000 7f1321600640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12fc0678c0 0x7f12fc069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f13100af000 tx=0x7f13100a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:46.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.037+0000 7f1319600640 1 -- 172.21.15.144:0/1719847879 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1308056900 con 0x7f131c0d26c0 2024-09-12T12:12:46.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:46.193+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f131c0b3d80 con 0x7f131c0d26c0 2024-09-12T12:12:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.161+0000 7f1319600640 1 -- 172.21.15.144:0/1719847879 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f1308056200 con 0x7f131c0d26c0 2024-09-12T12:12:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data_ec' created 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12fc0678c0 msgr2=0x7f12fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12fc0678c0 0x7f12fc069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f13100af000 tx=0x7f13100a7000 comp rx=0 tx=0).stop 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c0d26c0 msgr2=0x7f131c14cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c0d26c0 0x7f131c14cd60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f130800c7f0 tx=0x7f130800ccb0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 shutdown_connections 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12fc0678c0 0x7f12fc069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f131c156750 0x7f131c148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f131c0d26c0 0x7f131c14cd60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 --2- 172.21.15.144:0/1719847879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f131c06fff0 0x7f131c14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 >> 172.21.15.144:0/1719847879 conn(0x7f131c067a00 msgr2=0x7f131c0cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:48.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 shutdown_connections 2024-09-12T12:12:48.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.165+0000 7f1322a00640 1 -- 172.21.15.144:0/1719847879 wait complete. 2024-09-12T12:12:48.199 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T12:12:48.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.341+0000 7f83edc00640 1 Processor -- start 2024-09-12T12:12:48.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.341+0000 7f83edc00640 1 -- start start 2024-09-12T12:12:48.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83edc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f83e8162a90 0x7f83e806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:48.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83edc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e806ee50 0x7f83e815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:48.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83edc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e8073a20 con 0x7f83e815f3c0 2024-09-12T12:12:48.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83edc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f83e806f2b0 con 0x7f83e8162a90 2024-09-12T12:12:48.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83edc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f83e8072a10 con 0x7f83e806ee50 2024-09-12T12:12:48.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f83e8162a90 0x7f83e806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:48.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f83e8162a90 0x7f83e806e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37636/0 (socket says 172.21.15.144:37636) 2024-09-12T12:12:48.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6a00640 1 -- 172.21.15.144:0/1844314188 learned_addr learned my addr 172.21.15.144:0/1844314188 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:48.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6000640 1 --2- 172.21.15.144:0/1844314188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e806ee50 0x7f83e815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:48.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6a00640 1 -- 172.21.15.144:0/1844314188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e806ee50 msgr2=0x7f83e815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:48.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6a00640 1 --2- 172.21.15.144:0/1844314188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e806ee50 0x7f83e815ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6a00640 1 -- 172.21.15.144:0/1844314188 >> v1:172.21.15.165:6789/0 conn(0x7f83e815f3c0 legacy=0x7f83e80717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:48.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6a00640 1 -- 172.21.15.144:0/1844314188 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e8072c60 con 0x7f83e8162a90 2024-09-12T12:12:48.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6000640 1 --2- 172.21.15.144:0/1844314188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e806ee50 0x7f83e815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:48.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.345+0000 7f83e6a00640 1 --2- 172.21.15.144:0/1844314188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 0x7f83e806e910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009870 tx=0x7f83d801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c6055efdfd8586 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:48.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83e5600640 1 -- 172.21.15.144:0/1844314188 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d80b0070 con 0x7f83e8162a90 2024-09-12T12:12:48.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83e5600640 1 -- 172.21.15.144:0/1844314188 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d80ab600 con 0x7f83e8162a90 2024-09-12T12:12:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83e5600640 1 -- 172.21.15.144:0/1844314188 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d80ab9d0 con 0x7f83e8162a90 2024-09-12T12:12:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 -- 172.21.15.144:0/1844314188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 msgr2=0x7f83e806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 --2- 172.21.15.144:0/1844314188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 0x7f83e806e910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009870 tx=0x7f83d801c490 comp rx=0 tx=0).stop 2024-09-12T12:12:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 -- 172.21.15.144:0/1844314188 shutdown_connections 2024-09-12T12:12:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 --2- 172.21.15.144:0/1844314188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e806ee50 0x7f83e815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 --2- 172.21.15.144:0/1844314188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 0x7f83e806e910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 -- 172.21.15.144:0/1844314188 >> 172.21.15.144:0/1844314188 conn(0x7f83e806ddf0 msgr2=0x7f83e806e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 -- 172.21.15.144:0/1844314188 shutdown_connections 2024-09-12T12:12:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 -- 172.21.15.144:0/1844314188 wait complete. 2024-09-12T12:12:48.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 Processor -- start 2024-09-12T12:12:48.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 -- start start 2024-09-12T12:12:48.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e806ee50 0x7f83e814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:48.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e815f3c0 0x7f83e8147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:48.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 0x7f83e8157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:48.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f83e80b6240 con 0x7f83e8162a90 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83e815f850 con 0x7f83e806ee50 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83edc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f83e80b63c0 con 0x7f83e815f3c0 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 0x7f83e8157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 0x7f83e8157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37644/0 (socket says 172.21.15.144:37644) 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83e7400640 1 -- 172.21.15.144:0/4168163843 learned_addr learned my addr 172.21.15.144:0/4168163843 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83e6a00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e806ee50 0x7f83e814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.349+0000 7f83e6000640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e815f3c0 0x7f83e8147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83e7400640 1 -- 172.21.15.144:0/4168163843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e815f3c0 msgr2=0x7f83e8147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83e7400640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e815f3c0 0x7f83e8147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83e7400640 1 -- 172.21.15.144:0/4168163843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e806ee50 msgr2=0x7f83e814e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83e7400640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e806ee50 0x7f83e814e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:48.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83e7400640 1 -- 172.21.15.144:0/4168163843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e8157770 con 0x7f83e8162a90 2024-09-12T12:12:48.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83e7400640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 0x7f83e8157230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83e000b970 tx=0x7f83e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:48.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83dea00640 1 -- 172.21.15.144:0/4168163843 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0019070 con 0x7f83e8162a90 2024-09-12T12:12:48.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83dea00640 1 -- 172.21.15.144:0/4168163843 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e000cb40 con 0x7f83e8162a90 2024-09-12T12:12:48.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83dea00640 1 -- 172.21.15.144:0/4168163843 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0014440 con 0x7f83e8162a90 2024-09-12T12:12:48.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e8154280 con 0x7f83e8162a90 2024-09-12T12:12:48.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e814baa0 con 0x7f83e8162a90 2024-09-12T12:12:48.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e815ee80 con 0x7f83e8162a90 2024-09-12T12:12:48.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83dea00640 1 -- 172.21.15.144:0/4168163843 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83e001c070 con 0x7f83e8162a90 2024-09-12T12:12:48.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.353+0000 7f83dea00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83c80678c0 0x7f83c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:48.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.357+0000 7f83dea00640 1 -- 172.21.15.144:0/4168163843 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f83e0085c50 con 0x7f83e8162a90 2024-09-12T12:12:48.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.357+0000 7f83e6a00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83c80678c0 0x7f83c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.357+0000 7f83e6a00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83c80678c0 0x7f83c8069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83d80ad000 tx=0x7f83d80a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:48.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.369+0000 7f83dea00640 1 -- 172.21.15.144:0/4168163843 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83e0055cf0 con 0x7f83e8162a90 2024-09-12T12:12:48.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:48.529+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f83e814bc70 con 0x7f83e8162a90 2024-09-12T12:12:49.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.169+0000 7f83dea00640 1 -- 172.21.15.144:0/4168163843 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f83e0059ff0 con 0x7f83e8162a90 2024-09-12T12:12:49.171 INFO:teuthology.orchestra.run.smithi144.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T12:12:49.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83c80678c0 msgr2=0x7f83c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:49.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83c80678c0 0x7f83c8069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83d80ad000 tx=0x7f83d80a6000 comp rx=0 tx=0).stop 2024-09-12T12:12:49.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 msgr2=0x7f83e8157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:49.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 0x7f83e8157230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83e000b970 tx=0x7f83e000be30 comp rx=0 tx=0).stop 2024-09-12T12:12:49.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 shutdown_connections 2024-09-12T12:12:49.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83c80678c0 0x7f83c8069d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:49.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83e8162a90 0x7f83e8157230 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:49.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83e815f3c0 0x7f83e8147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:49.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 --2- 172.21.15.144:0/4168163843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83e806ee50 0x7f83e814e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:49.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 >> 172.21.15.144:0/4168163843 conn(0x7f83e806ddf0 msgr2=0x7f83e8153140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:49.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 shutdown_connections 2024-09-12T12:12:49.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.173+0000 7f83edc00640 1 -- 172.21.15.144:0/4168163843 wait complete. 2024-09-12T12:12:49.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T12:12:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.361+0000 7fe3da200640 1 Processor -- start 2024-09-12T12:12:49.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.361+0000 7fe3da200640 1 -- start start 2024-09-12T12:12:49.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3da200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d415c2e0 0x7fe3d4072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:49.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3da200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe3d40af5f0 0x7fe3d406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:49.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3da200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d40733e0 con 0x7fe3d406c150 2024-09-12T12:12:49.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3da200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d40cd290 con 0x7fe3d40af5f0 2024-09-12T12:12:49.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3da200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d40cd570 con 0x7fe3d415c2e0 2024-09-12T12:12:49.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3d3e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe3d406c150 0x7fe3d406d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42504/0 (socket says 172.21.15.144:42504) 2024-09-12T12:12:49.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3d3e00640 1 -- 172.21.15.144:0/1386305235 learned_addr learned my addr 172.21.15.144:0/1386305235 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:49.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3d3400640 1 --2- 172.21.15.144:0/1386305235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d415c2e0 0x7fe3d4072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:49.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3caa00640 1 --2- 172.21.15.144:0/1386305235 >> v2:172.21.15.165:3300/0 conn(0x7fe3d40af5f0 0x7fe3d406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3d2a00640 1 -- 172.21.15.144:0/1386305235 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942861431 0 0) 0x7fe3d40733e0 con 0x7fe3d406c150 2024-09-12T12:12:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3d2a00640 1 -- 172.21.15.144:0/1386305235 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b8003530 con 0x7fe3d406c150 2024-09-12T12:12:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3d3400640 1 -- 172.21.15.144:0/1386305235 >> v2:172.21.15.165:3300/0 conn(0x7fe3d40af5f0 msgr2=0x7fe3d406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3d3400640 1 --2- 172.21.15.144:0/1386305235 >> v2:172.21.15.165:3300/0 conn(0x7fe3d40af5f0 0x7fe3d406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3d3400640 1 -- 172.21.15.144:0/1386305235 >> v1:172.21.15.144:6789/0 conn(0x7fe3d406c150 legacy=0x7fe3d406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3d3400640 1 -- 172.21.15.144:0/1386305235 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d40cd850 con 0x7fe3d415c2e0 2024-09-12T12:12:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.365+0000 7fe3caa00640 1 --2- 172.21.15.144:0/1386305235 >> v2:172.21.15.165:3300/0 conn(0x7fe3d40af5f0 0x7fe3d406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3d3400640 1 --2- 172.21.15.144:0/1386305235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d415c2e0 0x7fe3d4072b50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009d90 tx=0x7fe3c401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d80bdf2486b140c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:49.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3d2a00640 1 -- 172.21.15.144:0/1386305235 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40b2070 con 0x7fe3d415c2e0 2024-09-12T12:12:49.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3d2a00640 1 -- 172.21.15.144:0/1386305235 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c40a5710 con 0x7fe3d415c2e0 2024-09-12T12:12:49.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3d2a00640 1 -- 172.21.15.144:0/1386305235 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c40a5ae0 con 0x7fe3d415c2e0 2024-09-12T12:12:49.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 -- 172.21.15.144:0/1386305235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d415c2e0 msgr2=0x7fe3d4072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:49.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 --2- 172.21.15.144:0/1386305235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d415c2e0 0x7fe3d4072b50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009d90 tx=0x7fe3c401c850 comp rx=0 tx=0).stop 2024-09-12T12:12:49.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 -- 172.21.15.144:0/1386305235 shutdown_connections 2024-09-12T12:12:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 --2- 172.21.15.144:0/1386305235 >> v2:172.21.15.165:3300/0 conn(0x7fe3d40af5f0 0x7fe3d406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 --2- 172.21.15.144:0/1386305235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d415c2e0 0x7fe3d4072b50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 -- 172.21.15.144:0/1386305235 >> 172.21.15.144:0/1386305235 conn(0x7fe3d4068030 msgr2=0x7fe3d40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 -- 172.21.15.144:0/1386305235 shutdown_connections 2024-09-12T12:12:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 -- 172.21.15.144:0/1386305235 wait complete. 2024-09-12T12:12:49.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 Processor -- start 2024-09-12T12:12:49.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.369+0000 7fe3da200640 1 -- start start 2024-09-12T12:12:49.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3da200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d406c150 0x7fe3d415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:49.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3da200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d40af5f0 0x7fe3d4152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3da200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d415c2e0 0x7fe3d4153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3da200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d41692b0 con 0x7fe3d40af5f0 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3da200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d4169130 con 0x7fe3d415c2e0 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3da200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d4169430 con 0x7fe3d406c150 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d40af5f0 0x7fe3d4152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d40af5f0 0x7fe3d4152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37658/0 (socket says 172.21.15.144:37658) 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3caa00640 1 -- 172.21.15.144:0/2045238430 learned_addr learned my addr 172.21.15.144:0/2045238430 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3d3400640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d406c150 0x7fe3d415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3d3e00640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d415c2e0 0x7fe3d4153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3caa00640 1 -- 172.21.15.144:0/2045238430 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d406c150 msgr2=0x7fe3d415a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3caa00640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d406c150 0x7fe3d415a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3caa00640 1 -- 172.21.15.144:0/2045238430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d415c2e0 msgr2=0x7fe3d4153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3caa00640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d415c2e0 0x7fe3d4153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3caa00640 1 -- 172.21.15.144:0/2045238430 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d4155070 con 0x7fe3d40af5f0 2024-09-12T12:12:49.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3caa00640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d40af5f0 0x7fe3d4152bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00ebe0 tx=0x7fe3bc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:49.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3cbe00640 1 -- 172.21.15.144:0/2045238430 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc017070 con 0x7fe3d40af5f0 2024-09-12T12:12:49.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3cbe00640 1 -- 172.21.15.144:0/2045238430 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00cc30 con 0x7fe3d40af5f0 2024-09-12T12:12:49.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3cbe00640 1 -- 172.21.15.144:0/2045238430 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc013470 con 0x7fe3d40af5f0 2024-09-12T12:12:49.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d4155350 con 0x7fe3d40af5f0 2024-09-12T12:12:49.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d4155910 con 0x7fe3d40af5f0 2024-09-12T12:12:49.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d406bc10 con 0x7fe3d40af5f0 2024-09-12T12:12:49.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.373+0000 7fe3cbe00640 1 -- 172.21.15.144:0/2045238430 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3bc01a070 con 0x7fe3d40af5f0 2024-09-12T12:12:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.377+0000 7fe3cbe00640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.377+0000 7fe3cbe00640 1 -- 172.21.15.144:0/2045238430 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fe3bc086330 con 0x7fe3d40af5f0 2024-09-12T12:12:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.377+0000 7fe3d3400640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:49.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.377+0000 7fe3d3400640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40af000 tx=0x7fe3c40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.381+0000 7fe3cbe00640 1 -- 172.21.15.144:0/2045238430 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe3bc0563e0 con 0x7fe3d40af5f0 2024-09-12T12:12:49.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:49.573+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fe3d40685e0 con 0x7fe3d40af5f0 2024-09-12T12:12:50.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.177+0000 7fe3cbe00640 1 -- 172.21.15.144:0/2045238430 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fe3bc05a6e0 con 0x7fe3d40af5f0 2024-09-12T12:12:50.179 INFO:teuthology.orchestra.run.smithi144.stderr:added data pool 4 to fsmap 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 msgr2=0x7fe3b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40af000 tx=0x7fe3c40a7070 comp rx=0 tx=0).stop 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d40af5f0 msgr2=0x7fe3d4152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d40af5f0 0x7fe3d4152bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00ebe0 tx=0x7fe3bc00c520 comp rx=0 tx=0).stop 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 shutdown_connections 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d415c2e0 0x7fe3d4153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d40af5f0 0x7fe3d4152bd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 --2- 172.21.15.144:0/2045238430 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d406c150 0x7fe3d415a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 >> 172.21.15.144:0/2045238430 conn(0x7fe3d4068030 msgr2=0x7fe3d40b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 shutdown_connections 2024-09-12T12:12:50.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.181+0000 7fe3da200640 1 -- 172.21.15.144:0/2045238430 wait complete. 2024-09-12T12:12:50.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:12:50.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca7d800640 1 Processor -- start 2024-09-12T12:12:50.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca7d800640 1 -- start start 2024-09-12T12:12:50.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca7d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca780b4e50 0x7fca780b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca7d800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fca7815c0e0 0x7fca780b5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca7d800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca780b3df0 con 0x7fca7815bd00 2024-09-12T12:12:50.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca7d800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fca780b4090 con 0x7fca7815c0e0 2024-09-12T12:12:50.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca7d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fca780b4370 con 0x7fca780b4e50 2024-09-12T12:12:50.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca780b4e50 0x7fca780b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca7ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fca7815c0e0 0x7fca780b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca77e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fca7815bd00 0x7fca780b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:47318/0 (socket says 172.21.15.144:47318) 2024-09-12T12:12:50.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.341+0000 7fca77e00640 1 -- 172.21.15.144:0/3102663443 learned_addr learned my addr 172.21.15.144:0/3102663443 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:50.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca6fe00640 1 -- 172.21.15.144:0/3102663443 >> v2:172.21.15.165:3300/0 conn(0x7fca7815c0e0 msgr2=0x7fca780b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:50.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca6fe00640 1 --2- 172.21.15.144:0/3102663443 >> v2:172.21.15.165:3300/0 conn(0x7fca7815c0e0 0x7fca780b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca6fe00640 1 -- 172.21.15.144:0/3102663443 >> v1:172.21.15.165:6789/0 conn(0x7fca7815bd00 legacy=0x7fca780b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca6fe00640 1 -- 172.21.15.144:0/3102663443 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca780b4650 con 0x7fca780b4e50 2024-09-12T12:12:50.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca77400640 1 -- 172.21.15.144:0/3102663443 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596564330 0 0) 0x7fca780b3df0 con 0x7fca7815bd00 2024-09-12T12:12:50.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca7ce00640 1 --2- 172.21.15.144:0/3102663443 >> v2:172.21.15.165:3300/0 conn(0x7fca7815c0e0 0x7fca780b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:50.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca6fe00640 1 --2- 172.21.15.144:0/3102663443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca780b4e50 0x7fca780b52f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fca600097c0 tx=0x7fca6001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea476ce7c563b3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:50.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca77400640 1 -- 172.21.15.144:0/3102663443 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca600ab600 con 0x7fca780b4e50 2024-09-12T12:12:50.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca77400640 1 -- 172.21.15.144:0/3102663443 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca600b0070 con 0x7fca780b4e50 2024-09-12T12:12:50.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.345+0000 7fca77400640 1 -- 172.21.15.144:0/3102663443 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca600ab9c0 con 0x7fca780b4e50 2024-09-12T12:12:50.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 -- 172.21.15.144:0/3102663443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca780b4e50 msgr2=0x7fca780b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 --2- 172.21.15.144:0/3102663443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca780b4e50 0x7fca780b52f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fca600097c0 tx=0x7fca6001c3e0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 -- 172.21.15.144:0/3102663443 shutdown_connections 2024-09-12T12:12:50.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 --2- 172.21.15.144:0/3102663443 >> v2:172.21.15.165:3300/0 conn(0x7fca7815c0e0 0x7fca780b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 --2- 172.21.15.144:0/3102663443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca780b4e50 0x7fca780b52f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 -- 172.21.15.144:0/3102663443 >> 172.21.15.144:0/3102663443 conn(0x7fca780ce540 msgr2=0x7fca780ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:50.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 -- 172.21.15.144:0/3102663443 shutdown_connections 2024-09-12T12:12:50.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 -- 172.21.15.144:0/3102663443 wait complete. 2024-09-12T12:12:50.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 Processor -- start 2024-09-12T12:12:50.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 -- start start 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca780b4e50 0x7fca78155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca7815bd00 0x7fca78150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca7815c0e0 0x7fca780725e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fca781601c0 con 0x7fca7815bd00 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fca78160040 con 0x7fca780b4e50 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fca78160340 con 0x7fca7815c0e0 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca7815bd00 0x7fca78150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca6fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca7815bd00 0x7fca78150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37670/0 (socket says 172.21.15.144:37670) 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca6fe00640 1 -- 172.21.15.144:0/2526914553 learned_addr learned my addr 172.21.15.144:0/2526914553 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:50.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca77e00640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca780b4e50 0x7fca78155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca7ce00640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca7815c0e0 0x7fca780725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca6fe00640 1 -- 172.21.15.144:0/2526914553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca7815c0e0 msgr2=0x7fca780725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca6fe00640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca7815c0e0 0x7fca780725e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca6fe00640 1 -- 172.21.15.144:0/2526914553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca780b4e50 msgr2=0x7fca78155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca6fe00640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca780b4e50 0x7fca78155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.349+0000 7fca6fe00640 1 -- 172.21.15.144:0/2526914553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca78154790 con 0x7fca7815bd00 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca6fe00640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca7815bd00 0x7fca78150110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca6001a010 tx=0x7fca6001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca74c00640 1 -- 172.21.15.144:0/2526914553 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60006e20 con 0x7fca7815bd00 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca74c00640 1 -- 172.21.15.144:0/2526914553 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca600b5830 con 0x7fca7815bd00 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca74c00640 1 -- 172.21.15.144:0/2526914553 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca600b5c20 con 0x7fca7815bd00 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca7d800640 1 -- 172.21.15.144:0/2526914553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca78154a70 con 0x7fca7815bd00 2024-09-12T12:12:50.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca7d800640 1 -- 172.21.15.144:0/2526914553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca781562c0 con 0x7fca7815bd00 2024-09-12T12:12:50.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca6d600640 1 -- 172.21.15.144:0/2526914553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca480052a0 con 0x7fca7815bd00 2024-09-12T12:12:50.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca74c00640 1 -- 172.21.15.144:0/2526914553 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fca600bd020 con 0x7fca7815bd00 2024-09-12T12:12:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca74c00640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fca540678c0 0x7fca54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca74c00640 1 -- 172.21.15.144:0/2526914553 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fca601203b0 con 0x7fca7815bd00 2024-09-12T12:12:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.353+0000 7fca77e00640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fca540678c0 0x7fca54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.357+0000 7fca77e00640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fca540678c0 0x7fca54069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca68007fd0 tx=0x7fca68007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:50.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.357+0000 7fca74c00640 1 -- 172.21.15.144:0/2526914553 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fca600c6030 con 0x7fca7815bd00 2024-09-12T12:12:50.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.573+0000 7fca6d600640 1 -- 172.21.15.144:0/2526914553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca48005590 con 0x7fca7815bd00 2024-09-12T12:12:50.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.573+0000 7fca74c00640 1 -- 172.21.15.144:0/2526914553 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5228 (secure 0 0 0) 0x7fca60016090 con 0x7fca7815bd00 2024-09-12T12:12:50.576 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:50.576 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":6,"btime":"2024-09-12T12:12:50:173152+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:12:49.576430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:12:50.576 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 6 2024-09-12T12:12:50.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 -- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fca540678c0 msgr2=0x7fca54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fca540678c0 0x7fca54069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca68007fd0 tx=0x7fca68007d60 comp rx=0 tx=0).stop 2024-09-12T12:12:50.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 -- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca7815bd00 msgr2=0x7fca78150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca7815bd00 0x7fca78150110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca6001a010 tx=0x7fca6001ac20 comp rx=0 tx=0).stop 2024-09-12T12:12:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 -- 172.21.15.144:0/2526914553 shutdown_connections 2024-09-12T12:12:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fca540678c0 0x7fca54069d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fca7815c0e0 0x7fca780725e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca7815bd00 0x7fca78150110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 --2- 172.21.15.144:0/2526914553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca780b4e50 0x7fca78155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 -- 172.21.15.144:0/2526914553 >> 172.21.15.144:0/2526914553 conn(0x7fca780ce540 msgr2=0x7fca780cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 -- 172.21.15.144:0/2526914553 shutdown_connections 2024-09-12T12:12:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.577+0000 7fca6d600640 1 -- 172.21.15.144:0/2526914553 wait complete. 2024-09-12T12:12:50.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:12:50.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b5c000640 1 Processor -- start 2024-09-12T12:12:50.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b5c000640 1 -- start start 2024-09-12T12:12:50.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b5c000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b5415c220 0x7f2b540d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b5c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b540b4200 0x7f2b540b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b5c000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b540d1580 con 0x7f2b540732c0 2024-09-12T12:12:50.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b5c000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2b540b4bb0 con 0x7f2b5415c220 2024-09-12T12:12:50.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b5c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b540d1860 con 0x7f2b540b4200 2024-09-12T12:12:50.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b58c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b540b4200 0x7f2b540b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b59600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b5415c220 0x7f2b540d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b58c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b540b4200 0x7f2b540b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40656/0 (socket says 172.21.15.144:40656) 2024-09-12T12:12:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b58c00640 1 -- 172.21.15.144:0/492692965 learned_addr learned my addr 172.21.15.144:0/492692965 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b5a000640 1 --1- 172.21.15.144:0/492692965 >> v1:172.21.15.165:6789/0 conn(0x7f2b540732c0 0x7f2b54073710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:47334/0 (socket says 172.21.15.144:47334) 2024-09-12T12:12:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b58c00640 1 -- 172.21.15.144:0/492692965 >> v2:172.21.15.165:3300/0 conn(0x7f2b5415c220 msgr2=0x7f2b540d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b58c00640 1 --2- 172.21.15.144:0/492692965 >> v2:172.21.15.165:3300/0 conn(0x7f2b5415c220 0x7f2b540d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.733+0000 7f2b58c00640 1 -- 172.21.15.144:0/492692965 >> v1:172.21.15.165:6789/0 conn(0x7f2b540732c0 legacy=0x7f2b54073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b58c00640 1 -- 172.21.15.144:0/492692965 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b540d1b40 con 0x7f2b540b4200 2024-09-12T12:12:50.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b58c00640 1 --2- 172.21.15.144:0/492692965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b540b4200 0x7f2b540b4670 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009870 tx=0x7f2b4001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f71c4c8ae95ccf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:50.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b53e00640 1 -- 172.21.15.144:0/492692965 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b400a95f0 con 0x7f2b540b4200 2024-09-12T12:12:50.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b53e00640 1 -- 172.21.15.144:0/492692965 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b400a9790 con 0x7f2b540b4200 2024-09-12T12:12:50.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b53e00640 1 -- 172.21.15.144:0/492692965 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b400a9b60 con 0x7f2b540b4200 2024-09-12T12:12:50.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b5c000640 1 -- 172.21.15.144:0/492692965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b540b4200 msgr2=0x7f2b540b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b5c000640 1 --2- 172.21.15.144:0/492692965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b540b4200 0x7f2b540b4670 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009870 tx=0x7f2b4001c530 comp rx=0 tx=0).stop 2024-09-12T12:12:50.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b5c000640 1 -- 172.21.15.144:0/492692965 shutdown_connections 2024-09-12T12:12:50.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b5c000640 1 --2- 172.21.15.144:0/492692965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b540b4200 0x7f2b540b4670 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b5c000640 1 --2- 172.21.15.144:0/492692965 >> v2:172.21.15.165:3300/0 conn(0x7f2b5415c220 0x7f2b540d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.737+0000 7f2b5c000640 1 -- 172.21.15.144:0/492692965 >> 172.21.15.144:0/492692965 conn(0x7f2b5406f400 msgr2=0x7f2b5406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:50.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 -- 172.21.15.144:0/492692965 shutdown_connections 2024-09-12T12:12:50.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 -- 172.21.15.144:0/492692965 wait complete. 2024-09-12T12:12:50.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 Processor -- start 2024-09-12T12:12:50.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 -- start start 2024-09-12T12:12:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b540732c0 0x7f2b54143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b540b4200 0x7f2b54155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5415c220 0x7f2b5415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b540d12d0 con 0x7f2b540b4200 2024-09-12T12:12:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2b540d1150 con 0x7f2b540732c0 2024-09-12T12:12:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b54070bf0 con 0x7f2b5415c220 2024-09-12T12:12:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b58c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b540b4200 0x7f2b54155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b58c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b540b4200 0x7f2b54155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37674/0 (socket says 172.21.15.144:37674) 2024-09-12T12:12:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b58c00640 1 -- 172.21.15.144:0/3831163704 learned_addr learned my addr 172.21.15.144:0/3831163704 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b59600640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b540732c0 0x7f2b54143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b5a000640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5415c220 0x7f2b5415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b58c00640 1 -- 172.21.15.144:0/3831163704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5415c220 msgr2=0x7f2b5415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b58c00640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5415c220 0x7f2b5415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b58c00640 1 -- 172.21.15.144:0/3831163704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b540732c0 msgr2=0x7f2b54143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b58c00640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b540732c0 0x7f2b54143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b58c00640 1 -- 172.21.15.144:0/3831163704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b540ae9c0 con 0x7f2b540b4200 2024-09-12T12:12:50.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b58c00640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b540b4200 0x7f2b54155da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b4001ca10 tx=0x7f2b400192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:50.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.741+0000 7f2b51600640 1 -- 172.21.15.144:0/3831163704 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b400b9630 con 0x7f2b540b4200 2024-09-12T12:12:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b51600640 1 -- 172.21.15.144:0/3831163704 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b400b97d0 con 0x7f2b540b4200 2024-09-12T12:12:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b51600640 1 -- 172.21.15.144:0/3831163704 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b400b9bc0 con 0x7f2b540b4200 2024-09-12T12:12:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b540aeca0 con 0x7f2b540b4200 2024-09-12T12:12:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b540af260 con 0x7f2b540b4200 2024-09-12T12:12:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b540b4670 con 0x7f2b540b4200 2024-09-12T12:12:50.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b51600640 1 -- 172.21.15.144:0/3831163704 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b400c23f0 con 0x7f2b540b4200 2024-09-12T12:12:50.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b51600640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2b340678c0 0x7f2b34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:50.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b51600640 1 -- 172.21.15.144:0/3831163704 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2b40120630 con 0x7f2b540b4200 2024-09-12T12:12:50.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b59600640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2b340678c0 0x7f2b34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:50.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.745+0000 7f2b59600640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2b340678c0 0x7f2b34069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009af0 tx=0x7f2b48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:50.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.749+0000 7f2b51600640 1 -- 172.21.15.144:0/3831163704 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2b400ad020 con 0x7f2b540b4200 2024-09-12T12:12:50.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.909+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b5415b450 con 0x7f2b540b4200 2024-09-12T12:12:50.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b51600640 1 -- 172.21.15.144:0/3831163704 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f2b40016150 con 0x7f2b540b4200 2024-09-12T12:12:50.913 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:50.913 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:12:50.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2b340678c0 msgr2=0x7f2b34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2b340678c0 0x7f2b34069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009af0 tx=0x7f2b48008040 comp rx=0 tx=0).stop 2024-09-12T12:12:50.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b540b4200 msgr2=0x7f2b54155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b540b4200 0x7f2b54155da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b4001ca10 tx=0x7f2b400192d0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 shutdown_connections 2024-09-12T12:12:50.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2b340678c0 0x7f2b34069d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5415c220 0x7f2b5415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b540b4200 0x7f2b54155da0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 --2- 172.21.15.144:0/3831163704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b540732c0 0x7f2b54143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 >> 172.21.15.144:0/3831163704 conn(0x7f2b5406f400 msgr2=0x7f2b540736d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:50.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 shutdown_connections 2024-09-12T12:12:50.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:50.913+0000 7f2b5c000640 1 -- 172.21.15.144:0/3831163704 wait complete. 2024-09-12T12:12:50.934 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:12:51.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9ed200640 1 Processor -- start 2024-09-12T12:12:51.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9ed200640 1 -- start start 2024-09-12T12:12:51.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9ed200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe9e8145ef0 0x7fe9e806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9ed200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe9e8072080 0x7fe9e806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9ed200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e80b6620 0x7fe9e80d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9ed200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e80725f0 con 0x7fe9e8072080 2024-09-12T12:12:51.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9ed200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e80728d0 con 0x7fe9e8145ef0 2024-09-12T12:12:51.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9ed200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e8072bb0 con 0x7fe9e80b6620 2024-09-12T12:12:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe9e8072080 0x7fe9e806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe9e8145ef0 0x7fe9e806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe9e8072080 0x7fe9e806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37682/0 (socket says 172.21.15.144:37682) 2024-09-12T12:12:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5400640 1 -- 172.21.15.144:0/487044471 learned_addr learned my addr 172.21.15.144:0/487044471 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e6800640 1 --2- 172.21.15.144:0/487044471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e80b6620 0x7fe9e80d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5e00640 1 -- 172.21.15.144:0/487044471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e80b6620 msgr2=0x7fe9e80d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5e00640 1 --2- 172.21.15.144:0/487044471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e80b6620 0x7fe9e80d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5e00640 1 -- 172.21.15.144:0/487044471 >> v2:172.21.15.144:3300/0 conn(0x7fe9e8072080 msgr2=0x7fe9e806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:51.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5e00640 1 --2- 172.21.15.144:0/487044471 >> v2:172.21.15.144:3300/0 conn(0x7fe9e8072080 0x7fe9e806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5e00640 1 -- 172.21.15.144:0/487044471 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e8072e90 con 0x7fe9e8145ef0 2024-09-12T12:12:51.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.069+0000 7fe9e5400640 1 --2- 172.21.15.144:0/487044471 >> v2:172.21.15.144:3300/0 conn(0x7fe9e8072080 0x7fe9e806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:51.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9e5e00640 1 --2- 172.21.15.144:0/487044471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8145ef0 0x7fe9e806bc10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80d1430 tx=0x7fe9d801c130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb4af4defefbb2c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:51.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9e4a00640 1 -- 172.21.15.144:0/487044471 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80b0070 con 0x7fe9e8145ef0 2024-09-12T12:12:51.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9e4a00640 1 -- 172.21.15.144:0/487044471 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d80ab600 con 0x7fe9e8145ef0 2024-09-12T12:12:51.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9e4a00640 1 -- 172.21.15.144:0/487044471 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80ab9d0 con 0x7fe9e8145ef0 2024-09-12T12:12:51.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9ed200640 1 -- 172.21.15.144:0/487044471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8145ef0 msgr2=0x7fe9e806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9ed200640 1 --2- 172.21.15.144:0/487044471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8145ef0 0x7fe9e806bc10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80d1430 tx=0x7fe9d801c130 comp rx=0 tx=0).stop 2024-09-12T12:12:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9ed200640 1 -- 172.21.15.144:0/487044471 shutdown_connections 2024-09-12T12:12:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9ed200640 1 --2- 172.21.15.144:0/487044471 >> v2:172.21.15.144:3300/0 conn(0x7fe9e8072080 0x7fe9e806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9ed200640 1 --2- 172.21.15.144:0/487044471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e80b6620 0x7fe9e80d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9ed200640 1 --2- 172.21.15.144:0/487044471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8145ef0 0x7fe9e806bc10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9ed200640 1 -- 172.21.15.144:0/487044471 >> 172.21.15.144:0/487044471 conn(0x7fe9e806cd20 msgr2=0x7fe9e806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9ed200640 1 -- 172.21.15.144:0/487044471 shutdown_connections 2024-09-12T12:12:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.073+0000 7fe9ed200640 1 -- 172.21.15.144:0/487044471 wait complete. 2024-09-12T12:12:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 Processor -- start 2024-09-12T12:12:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 -- start start 2024-09-12T12:12:51.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8072080 0x7fe9e8155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e80b6620 0x7fe9e8157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e8145ef0 0x7fe9e8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e815cb10 con 0x7fe9e80b6620 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e815c990 con 0x7fe9e8072080 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e815cc90 con 0x7fe9e8145ef0 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e80b6620 0x7fe9e8157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e80b6620 0x7fe9e8157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37694/0 (socket says 172.21.15.144:37694) 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5400640 1 -- 172.21.15.144:0/1407112694 learned_addr learned my addr 172.21.15.144:0/1407112694 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5e00640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8072080 0x7fe9e8155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e6800640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e8145ef0 0x7fe9e8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5400640 1 -- 172.21.15.144:0/1407112694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e8145ef0 msgr2=0x7fe9e8152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5400640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e8145ef0 0x7fe9e8152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5400640 1 -- 172.21.15.144:0/1407112694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8072080 msgr2=0x7fe9e8155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5400640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8072080 0x7fe9e8155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5400640 1 -- 172.21.15.144:0/1407112694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e815a1c0 con 0x7fe9e80b6620 2024-09-12T12:12:51.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5e00640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8072080 0x7fe9e8155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:12:51.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9e5400640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e80b6620 0x7fe9e8157300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400e9d0 tx=0x7fe9d400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:51.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9de000640 1 -- 172.21.15.144:0/1407112694 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4017070 con 0x7fe9e80b6620 2024-09-12T12:12:51.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9de000640 1 -- 172.21.15.144:0/1407112694 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d400ca00 con 0x7fe9e80b6620 2024-09-12T12:12:51.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9de000640 1 -- 172.21.15.144:0/1407112694 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400cdb0 con 0x7fe9e80b6620 2024-09-12T12:12:51.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e8155a70 con 0x7fe9e80b6620 2024-09-12T12:12:51.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.077+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e8152230 con 0x7fe9e80b6620 2024-09-12T12:12:51.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.081+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e80d0170 con 0x7fe9e80b6620 2024-09-12T12:12:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.081+0000 7fe9de000640 1 -- 172.21.15.144:0/1407112694 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9d401a070 con 0x7fe9e80b6620 2024-09-12T12:12:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.081+0000 7fe9de000640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9c80678c0 0x7fe9c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.081+0000 7fe9de000640 1 -- 172.21.15.144:0/1407112694 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe9d4085ef0 con 0x7fe9e80b6620 2024-09-12T12:12:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.081+0000 7fe9e5e00640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9c80678c0 0x7fe9c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.081+0000 7fe9e5e00640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9c80678c0 0x7fe9c8069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80ad000 tx=0x7fe9d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:51.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.085+0000 7fe9de000640 1 -- 172.21.15.144:0/1407112694 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9d40566e0 con 0x7fe9e80b6620 2024-09-12T12:12:51.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.253+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9e81570e0 con 0x7fe9e80b6620 2024-09-12T12:12:51.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.253+0000 7fe9de000640 1 -- 172.21.15.144:0/1407112694 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7fe9d4055fe0 con 0x7fe9e80b6620 2024-09-12T12:12:51.255 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:51.256 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:12:51.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9c80678c0 msgr2=0x7fe9c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9c80678c0 0x7fe9c8069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80ad000 tx=0x7fe9d8008040 comp rx=0 tx=0).stop 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e80b6620 msgr2=0x7fe9e8157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e80b6620 0x7fe9e8157300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400e9d0 tx=0x7fe9d400ee90 comp rx=0 tx=0).stop 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 shutdown_connections 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9c80678c0 0x7fe9c8069d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9e8145ef0 0x7fe9e8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e80b6620 0x7fe9e8157300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 --2- 172.21.15.144:0/1407112694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9e8072080 0x7fe9e8155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 >> 172.21.15.144:0/1407112694 conn(0x7fe9e806cd20 msgr2=0x7fe9e8144730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 shutdown_connections 2024-09-12T12:12:51.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.257+0000 7fe9ed200640 1 -- 172.21.15.144:0/1407112694 wait complete. 2024-09-12T12:12:51.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:12:51.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2231a00640 1 Processor -- start 2024-09-12T12:12:51.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2231a00640 1 -- start start 2024-09-12T12:12:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2231a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f222c15c7b0 0x7f222c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2231a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2231a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f222c0cd870 con 0x7f222c0b5de0 2024-09-12T12:12:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2231a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f222c072a50 con 0x7f222c15c7b0 2024-09-12T12:12:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2231a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f222c0cde30 con 0x7f222c15cd30 2024-09-12T12:12:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f222aa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f222c15c7b0 0x7f222c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2223e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f222aa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f222c15c7b0 0x7f222c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:56572/0 (socket says 172.21.15.144:56572) 2024-09-12T12:12:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2223e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c0b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40686/0 (socket says 172.21.15.144:40686) 2024-09-12T12:12:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f222aa00640 1 -- 172.21.15.144:0/869645680 learned_addr learned my addr 172.21.15.144:0/869645680 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f222b400640 1 --1- 172.21.15.144:0/869645680 >> v1:172.21.15.165:6789/0 conn(0x7f222c0b5de0 0x7f222c1601d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:47350/0 (socket says 172.21.15.144:47350) 2024-09-12T12:12:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f222aa00640 1 -- 172.21.15.144:0/869645680 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 msgr2=0x7f222c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f222aa00640 1 --2- 172.21.15.144:0/869645680 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f222aa00640 1 -- 172.21.15.144:0/869645680 >> v1:172.21.15.165:6789/0 conn(0x7f222c0b5de0 legacy=0x7f222c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f222aa00640 1 -- 172.21.15.144:0/869645680 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222c0cdb50 con 0x7f222c15c7b0 2024-09-12T12:12:51.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.429+0000 7f2223e00640 1 --2- 172.21.15.144:0/869645680 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:51.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f222aa00640 1 --2- 172.21.15.144:0/869645680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f222c15c7b0 0x7f222c0ccf00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f221c009870 tx=0x7f221c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=150f34445e24808e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f222a000640 1 -- 172.21.15.144:0/869645680 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c0b2070 con 0x7f222c15c7b0 2024-09-12T12:12:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f222a000640 1 -- 172.21.15.144:0/869645680 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c0a9070 con 0x7f222c15c7b0 2024-09-12T12:12:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f222a000640 1 -- 172.21.15.144:0/869645680 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c0ad880 con 0x7f222c15c7b0 2024-09-12T12:12:51.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f2231a00640 1 -- 172.21.15.144:0/869645680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f222c15c7b0 msgr2=0x7f222c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f2231a00640 1 --2- 172.21.15.144:0/869645680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f222c15c7b0 0x7f222c0ccf00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f221c009870 tx=0x7f221c01c560 comp rx=0 tx=0).stop 2024-09-12T12:12:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f2231a00640 1 -- 172.21.15.144:0/869645680 shutdown_connections 2024-09-12T12:12:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f2231a00640 1 --2- 172.21.15.144:0/869645680 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f2231a00640 1 --2- 172.21.15.144:0/869645680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f222c15c7b0 0x7f222c0ccf00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f2231a00640 1 -- 172.21.15.144:0/869645680 >> 172.21.15.144:0/869645680 conn(0x7f222c06d0d0 msgr2=0x7f222c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f2231a00640 1 -- 172.21.15.144:0/869645680 shutdown_connections 2024-09-12T12:12:51.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.433+0000 7f2231a00640 1 -- 172.21.15.144:0/869645680 wait complete. 2024-09-12T12:12:51.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 Processor -- start 2024-09-12T12:12:51.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 -- start start 2024-09-12T12:12:51.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f222c0b5de0 0x7f222c163510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f222c15c7b0 0x7f222c1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c15b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f222c169530 con 0x7f222c0b5de0 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f222c0cd650 con 0x7f222c15c7b0 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f222c1696b0 con 0x7f222c15cd30 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f222c0b5de0 0x7f222c163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f222c0b5de0 0x7f222c163510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37710/0 (socket says 172.21.15.144:37710) 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222aa00640 1 -- 172.21.15.144:0/3550744500 learned_addr learned my addr 172.21.15.144:0/3550744500 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2223e00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f222c15c7b0 0x7f222c1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222b400640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c15b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222aa00640 1 -- 172.21.15.144:0/3550744500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 msgr2=0x7f222c15b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222aa00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c15b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222aa00640 1 -- 172.21.15.144:0/3550744500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f222c15c7b0 msgr2=0x7f222c1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222aa00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f222c15c7b0 0x7f222c1534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222aa00640 1 -- 172.21.15.144:0/3550744500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222c153a30 con 0x7f222c0b5de0 2024-09-12T12:12:51.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222b400640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:12:51.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f222aa00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f222c0b5de0 0x7f222c163510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f221c01ac10 tx=0x7f221c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:51.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2222a00640 1 -- 172.21.15.144:0/3550744500 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c0bb070 con 0x7f222c0b5de0 2024-09-12T12:12:51.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2222a00640 1 -- 172.21.15.144:0/3550744500 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c0adce0 con 0x7f222c0b5de0 2024-09-12T12:12:51.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2222a00640 1 -- 172.21.15.144:0/3550744500 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f221c0b2040 con 0x7f222c0b5de0 2024-09-12T12:12:51.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222c162750 con 0x7f222c0b5de0 2024-09-12T12:12:51.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f222c162d10 con 0x7f222c0b5de0 2024-09-12T12:12:51.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.437+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f222c0ccf00 con 0x7f222c0b5de0 2024-09-12T12:12:51.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.441+0000 7f2222a00640 1 -- 172.21.15.144:0/3550744500 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f221c0be070 con 0x7f222c0b5de0 2024-09-12T12:12:51.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.441+0000 7f2222a00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22080678c0 0x7f2208069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.441+0000 7f2222a00640 1 -- 172.21.15.144:0/3550744500 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f221c11eee0 con 0x7f222c0b5de0 2024-09-12T12:12:51.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.441+0000 7f2223e00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22080678c0 0x7f2208069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.441+0000 7f2223e00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22080678c0 0x7f2208069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2214009580 tx=0x7f2214009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:51.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.445+0000 7f2222a00640 1 -- 172.21.15.144:0/3550744500 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f221c016150 con 0x7f222c0b5de0 2024-09-12T12:12:51.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.633+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f222c1568b0 con 0x7f222c0b5de0 2024-09-12T12:12:51.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.633+0000 7f2222a00640 1 -- 172.21.15.144:0/3550744500 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5228 (secure 0 0 0) 0x7f221c0eeff0 con 0x7f222c0b5de0 2024-09-12T12:12:51.636 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:51.636 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":6,"btime":"2024-09-12T12:12:50:173152+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:12:49.576430+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:12:51.637 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 6 2024-09-12T12:12:51.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22080678c0 msgr2=0x7f2208069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22080678c0 0x7f2208069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2214009580 tx=0x7f2214009190 comp rx=0 tx=0).stop 2024-09-12T12:12:51.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f222c0b5de0 msgr2=0x7f222c163510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f222c0b5de0 0x7f222c163510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f221c01ac10 tx=0x7f221c019300 comp rx=0 tx=0).stop 2024-09-12T12:12:51.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 shutdown_connections 2024-09-12T12:12:51.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22080678c0 0x7f2208069d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f222c15cd30 0x7f222c15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f222c15c7b0 0x7f222c1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 --2- 172.21.15.144:0/3550744500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f222c0b5de0 0x7f222c163510 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 >> 172.21.15.144:0/3550744500 conn(0x7f222c06d0d0 msgr2=0x7f222c15d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:51.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 shutdown_connections 2024-09-12T12:12:51.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.637+0000 7f2231a00640 1 -- 172.21.15.144:0/3550744500 wait complete. 2024-09-12T12:12:51.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:12:51.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe814c00640 1 Processor -- start 2024-09-12T12:12:51.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe814c00640 1 -- start start 2024-09-12T12:12:51.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe814c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe81015c7b0 0x7fe8100ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe814c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe81015cd30 0x7fe8100b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe814c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8100b61e0 con 0x7fe8100b5de0 2024-09-12T12:12:51.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe814c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe810072a50 con 0x7fe81015cd30 2024-09-12T12:12:51.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe814c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe8100cde30 con 0x7fe81015c7b0 2024-09-12T12:12:51.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe80d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe81015cd30 0x7fe8100b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe80d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe81015cd30 0x7fe8100b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37726/0 (socket says 172.21.15.144:37726) 2024-09-12T12:12:51.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe80d400640 1 -- 172.21.15.144:0/421810873 learned_addr learned my addr 172.21.15.144:0/421810873 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:51.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe80de00640 1 --2- 172.21.15.144:0/421810873 >> v2:172.21.15.165:3300/0 conn(0x7fe81015c7b0 0x7fe8100ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe80d400640 1 -- 172.21.15.144:0/421810873 >> v2:172.21.15.165:3300/0 conn(0x7fe81015c7b0 msgr2=0x7fe8100ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:51.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe80d400640 1 --2- 172.21.15.144:0/421810873 >> v2:172.21.15.165:3300/0 conn(0x7fe81015c7b0 0x7fe8100ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe80d400640 1 -- 172.21.15.144:0/421810873 >> v1:172.21.15.144:6789/0 conn(0x7fe8100b5de0 legacy=0x7fe8101601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe80ca00640 1 -- 172.21.15.144:0/421810873 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250825946 0 0) 0x7fe8100b61e0 con 0x7fe8100b5de0 2024-09-12T12:12:51.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.793+0000 7fe80d400640 1 -- 172.21.15.144:0/421810873 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8100cd870 con 0x7fe81015cd30 2024-09-12T12:12:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe80d400640 1 --2- 172.21.15.144:0/421810873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 0x7fe8100b58a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8100d14f0 tx=0x7fe7fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bea0a9ed517d3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:51.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe80ca00640 1 -- 172.21.15.144:0/421810873 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0ab610 con 0x7fe81015cd30 2024-09-12T12:12:51.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe80ca00640 1 -- 172.21.15.144:0/421810873 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7fc0b0070 con 0x7fe81015cd30 2024-09-12T12:12:51.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe80ca00640 1 -- 172.21.15.144:0/421810873 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0ab9d0 con 0x7fe81015cd30 2024-09-12T12:12:51.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe814c00640 1 -- 172.21.15.144:0/421810873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 msgr2=0x7fe8100b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe814c00640 1 --2- 172.21.15.144:0/421810873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 0x7fe8100b58a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8100d14f0 tx=0x7fe7fc01c520 comp rx=0 tx=0).stop 2024-09-12T12:12:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe814c00640 1 -- 172.21.15.144:0/421810873 shutdown_connections 2024-09-12T12:12:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe814c00640 1 --2- 172.21.15.144:0/421810873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 0x7fe8100b58a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe814c00640 1 --2- 172.21.15.144:0/421810873 >> v2:172.21.15.165:3300/0 conn(0x7fe81015c7b0 0x7fe8100ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe814c00640 1 -- 172.21.15.144:0/421810873 >> 172.21.15.144:0/421810873 conn(0x7fe81006d0d0 msgr2=0x7fe81006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe814c00640 1 -- 172.21.15.144:0/421810873 shutdown_connections 2024-09-12T12:12:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.797+0000 7fe814c00640 1 -- 172.21.15.144:0/421810873 wait complete. 2024-09-12T12:12:51.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 Processor -- start 2024-09-12T12:12:51.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 -- start start 2024-09-12T12:12:51.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8100b5de0 0x7fe810149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81015c7b0 0x7fe81015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 0x7fe81015bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe810169320 con 0x7fe81015cd30 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8100cd650 con 0x7fe8100b5de0 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8101694a0 con 0x7fe81015c7b0 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 0x7fe81015bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 0x7fe81015bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37728/0 (socket says 172.21.15.144:37728) 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80e800640 1 -- 172.21.15.144:0/2286858156 learned_addr learned my addr 172.21.15.144:0/2286858156 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80d400640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81015c7b0 0x7fe81015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80de00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8100b5de0 0x7fe810149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80e800640 1 -- 172.21.15.144:0/2286858156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81015c7b0 msgr2=0x7fe81015b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80e800640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81015c7b0 0x7fe81015b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80e800640 1 -- 172.21.15.144:0/2286858156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8100b5de0 msgr2=0x7fe810149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80e800640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8100b5de0 0x7fe810149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80e800640 1 -- 172.21.15.144:0/2286858156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810158960 con 0x7fe81015cd30 2024-09-12T12:12:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80de00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8100b5de0 0x7fe810149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe80e800640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 0x7fe81015bb70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe80800c780 tx=0x7fe80800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:51.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe806000640 1 -- 172.21.15.144:0/2286858156 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808003db0 con 0x7fe81015cd30 2024-09-12T12:12:51.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe806000640 1 -- 172.21.15.144:0/2286858156 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808005070 con 0x7fe81015cd30 2024-09-12T12:12:51.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe806000640 1 -- 172.21.15.144:0/2286858156 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808005460 con 0x7fe81015cd30 2024-09-12T12:12:51.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe810158c40 con 0x7fe81015cd30 2024-09-12T12:12:51.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.801+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe810159200 con 0x7fe81015cd30 2024-09-12T12:12:51.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.805+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8100ccf00 con 0x7fe81015cd30 2024-09-12T12:12:51.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.805+0000 7fe806000640 1 -- 172.21.15.144:0/2286858156 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe808005600 con 0x7fe81015cd30 2024-09-12T12:12:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.805+0000 7fe806000640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7f00678c0 0x7fe7f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.805+0000 7fe806000640 1 -- 172.21.15.144:0/2286858156 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe808086060 con 0x7fe81015cd30 2024-09-12T12:12:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.805+0000 7fe80de00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7f00678c0 0x7fe7f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.805+0000 7fe80de00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7f00678c0 0x7fe7f0069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe800009ae0 tx=0x7fe800008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:51.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.809+0000 7fe806000640 1 -- 172.21.15.144:0/2286858156 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe8080567c0 con 0x7fe81015cd30 2024-09-12T12:12:51.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.969+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8100afef0 con 0x7fe81015cd30 2024-09-12T12:12:51.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.969+0000 7fe806000640 1 -- 172.21.15.144:0/2286858156 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7fe8080560c0 con 0x7fe81015cd30 2024-09-12T12:12:51.972 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:51.972 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:12:51.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7f00678c0 msgr2=0x7fe7f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7f00678c0 0x7fe7f0069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe800009ae0 tx=0x7fe800008040 comp rx=0 tx=0).stop 2024-09-12T12:12:51.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 msgr2=0x7fe81015bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:51.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 0x7fe81015bb70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe80800c780 tx=0x7fe80800cc40 comp rx=0 tx=0).stop 2024-09-12T12:12:51.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 shutdown_connections 2024-09-12T12:12:51.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7f00678c0 0x7fe7f0069d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe81015cd30 0x7fe81015bb70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81015c7b0 0x7fe81015b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 --2- 172.21.15.144:0/2286858156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8100b5de0 0x7fe810149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:51.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 >> 172.21.15.144:0/2286858156 conn(0x7fe81006d0d0 msgr2=0x7fe8100d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:51.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 shutdown_connections 2024-09-12T12:12:51.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:51.973+0000 7fe814c00640 1 -- 172.21.15.144:0/2286858156 wait complete. 2024-09-12T12:12:52.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:12:44.209030+0000', 'modified': '2024-09-12T12:12:49.576430+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.165:6835/2425635308', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6833', 'nonce': 2425635308}, {'type': 'v1', 'addr': '172.21.15.165:6835', 'nonce': 2425635308}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-09-12T12:12:52.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:12:52.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T12:12:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.533+0000 7f9ad7800640 1 Processor -- start 2024-09-12T12:12:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.533+0000 7f9ad7800640 1 -- start start 2024-09-12T12:12:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.533+0000 7f9ad7800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9ad015cd30 0x7f9ad00b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.533+0000 7f9ad7800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad00b61e0 con 0x7f9ad00b5de0 2024-09-12T12:12:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.533+0000 7f9ad7800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad00cd870 con 0x7f9ad015c7b0 2024-09-12T12:12:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.533+0000 7f9ad7800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad0072a50 con 0x7f9ad015cd30 2024-09-12T12:12:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.533+0000 7f9ad5800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9ad00b5de0 0x7f9ad0072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42512/0 (socket says 172.21.15.144:42512) 2024-09-12T12:12:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.533+0000 7f9ad5800640 1 -- 172.21.15.144:0/64157462 learned_addr learned my addr 172.21.15.144:0/64157462 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:52.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acfe00640 1 --2- 172.21.15.144:0/64157462 >> v2:172.21.15.165:3300/0 conn(0x7f9ad015cd30 0x7f9ad00b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497913461 0 0) 0x7f9ad00b61e0 con 0x7f9ad00b5de0 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab4003530 con 0x7f9ad00b5de0 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 28906649 0 0) 0x7f9ab4003530 con 0x7f9ad00b5de0 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 >> v2:172.21.15.165:3300/0 conn(0x7f9ad015cd30 msgr2=0x7f9ad00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 --2- 172.21.15.144:0/64157462 >> v2:172.21.15.165:3300/0 conn(0x7f9ad015cd30 0x7f9ad00b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 >> v1:172.21.15.165:6789/0 conn(0x7f9ad015c7b0 legacy=0x7f9ad00ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad00cdb50 con 0x7f9ad00b5de0 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f9ac8001a00 con 0x7f9ad00b5de0 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 >> v1:172.21.15.144:6789/0 conn(0x7f9ad00b5de0 legacy=0x7f9ad0072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab4003a10 0x7f9ab4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab4004810 0x7f9ab4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ab40051d0 0x7f9ab400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad0072a50 con 0x7f9ab4004810 2024-09-12T12:12:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab400c0d0 con 0x7f9ab40051d0 2024-09-12T12:12:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab400c2d0 con 0x7f9ab4003a10 2024-09-12T12:12:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acfe00640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab4004810 0x7f9ab4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab4003a10 0x7f9ab4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9ad5800640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ab40051d0 0x7f9ab400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acfe00640 1 -- 172.21.15.144:0/64157462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab4003a10 msgr2=0x7f9ab4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acfe00640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab4003a10 0x7f9ab4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acfe00640 1 -- 172.21.15.144:0/64157462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ab40051d0 msgr2=0x7f9ab400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acfe00640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ab40051d0 0x7f9ab400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9acfe00640 1 -- 172.21.15.144:0/64157462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab4003530 con 0x7f9ab4004810 2024-09-12T12:12:52.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.537+0000 7f9ad5800640 1 -- 172.21.15.144:0/64157462 reap_dead start 2024-09-12T12:12:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9acfe00640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab4004810 0x7f9ab4004c90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009ae0 tx=0x7f9abc01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aba305be0936870 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0b2070 con 0x7f9ab4004810 2024-09-12T12:12:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc0a5630 con 0x7f9ab4004810 2024-09-12T12:12:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9acf400640 1 -- 172.21.15.144:0/64157462 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0096b0 con 0x7f9ab4004810 2024-09-12T12:12:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 -- 172.21.15.144:0/64157462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab4004810 msgr2=0x7f9ab4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab4004810 0x7f9ab4004c90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009ae0 tx=0x7f9abc01ca40 comp rx=0 tx=0).stop 2024-09-12T12:12:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 -- 172.21.15.144:0/64157462 shutdown_connections 2024-09-12T12:12:52.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 --2- 172.21.15.144:0/64157462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ab4004810 0x7f9ab4004c90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 -- 172.21.15.144:0/64157462 >> 172.21.15.144:0/64157462 conn(0x7f9ad006d0d0 msgr2=0x7f9ad006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:52.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 -- 172.21.15.144:0/64157462 shutdown_connections 2024-09-12T12:12:52.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 -- 172.21.15.144:0/64157462 wait complete. 2024-09-12T12:12:52.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 Processor -- start 2024-09-12T12:12:52.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 -- start start 2024-09-12T12:12:52.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab4004810 0x7f9ad0158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ad0157d50 0x7f9ad00ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ad00af090 0x7f9ad015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad00ccf00 con 0x7f9ad0157d50 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad00cde30 con 0x7f9ad00af090 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.541+0000 7f9ad7800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad00cd080 con 0x7f9ab4004810 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9acfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ad0157d50 0x7f9ad00ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9acfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ad0157d50 0x7f9ad00ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37742/0 (socket says 172.21.15.144:37742) 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9acfe00640 1 -- 172.21.15.144:0/4129302716 learned_addr learned my addr 172.21.15.144:0/4129302716 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab4004810 0x7f9ad0158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9ad5800640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ad00af090 0x7f9ad015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9acfe00640 1 -- 172.21.15.144:0/4129302716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab4004810 msgr2=0x7f9ad0158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9acfe00640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab4004810 0x7f9ad0158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9acfe00640 1 -- 172.21.15.144:0/4129302716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ad00af090 msgr2=0x7f9ad015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9acfe00640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ad00af090 0x7f9ad015b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9acfe00640 1 -- 172.21.15.144:0/4129302716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad01f3c30 con 0x7f9ad0157d50 2024-09-12T12:12:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9acfe00640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ad0157d50 0x7f9ad00ae210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0b0040 tx=0x7f9abc0197e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9accc00640 1 -- 172.21.15.144:0/4129302716 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0ba020 con 0x7f9ad0157d50 2024-09-12T12:12:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9accc00640 1 -- 172.21.15.144:0/4129302716 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc004020 con 0x7f9ad0157d50 2024-09-12T12:12:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9accc00640 1 -- 172.21.15.144:0/4129302716 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0b2040 con 0x7f9ad0157d50 2024-09-12T12:12:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9ad7800640 1 -- 172.21.15.144:0/4129302716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad01f3f10 con 0x7f9ad0157d50 2024-09-12T12:12:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9ad7800640 1 -- 172.21.15.144:0/4129302716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad01f44d0 con 0x7f9ad0157d50 2024-09-12T12:12:52.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9accc00640 1 -- 172.21.15.144:0/4129302716 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9abc0bd070 con 0x7f9ad0157d50 2024-09-12T12:12:52.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.545+0000 7f9accc00640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ab00678c0 0x7f9ab0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9accc00640 1 -- 172.21.15.144:0/4129302716 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9abc11f720 con 0x7f9ad0157d50 2024-09-12T12:12:52.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ab00678c0 0x7f9ab0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 Processor -- start 2024-09-12T12:12:52.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- start start 2024-09-12T12:12:52.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ab00678c0 0x7f9ab0069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0000c10 tx=0x7f9ac0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 0x55984cdd1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cd87d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd88290 0x55984cd88670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55984cc6fb60 con 0x55984cdd2440 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55984cbd6c70 con 0x55984cd88290 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55984cb7ced0 con 0x55984cdd1b20 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9acfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cd87d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9acfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cd87d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37754/0 (socket says 172.21.15.144:37754) 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9acfe00640 1 -- 172.21.15.144:0/1567194610 learned_addr learned my addr 172.21.15.144:0/1567194610 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:52.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/1567194610 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 0x55984cdd1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9ad5800640 1 --2- 172.21.15.144:0/1567194610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd88290 0x55984cd88670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9acfe00640 1 -- 172.21.15.144:0/1567194610 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 msgr2=0x55984cdd1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9acfe00640 1 --2- 172.21.15.144:0/1567194610 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 0x55984cdd1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9acfe00640 1 -- 172.21.15.144:0/1567194610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd88290 msgr2=0x55984cd88670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9acfe00640 1 --2- 172.21.15.144:0/1567194610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd88290 0x55984cd88670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9acfe00640 1 -- 172.21.15.144:0/1567194610 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55984cb8ee50 con 0x55984cdd2440 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9acfe00640 1 --2- 172.21.15.144:0/1567194610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cd87d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0ef7a0 tx=0x7f9abc0eff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102e309a50396e69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9ac5600640 1 -- 172.21.15.144:0/1567194610 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0f83f0 con 0x55984cdd2440 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9ac5600640 1 -- 172.21.15.144:0/1567194610 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc0ed8b0 con 0x55984cdd2440 2024-09-12T12:12:52.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9ac5600640 1 -- 172.21.15.144:0/1567194610 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc004410 con 0x55984cdd2440 2024-09-12T12:12:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- 172.21.15.144:0/1567194610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 msgr2=0x55984cd87d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 --2- 172.21.15.144:0/1567194610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cd87d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0ef7a0 tx=0x7f9abc0eff10 comp rx=0 tx=0).stop 2024-09-12T12:12:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- 172.21.15.144:0/1567194610 shutdown_connections 2024-09-12T12:12:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 --2- 172.21.15.144:0/1567194610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd88290 0x55984cd88670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 --2- 172.21.15.144:0/1567194610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cd87d50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 --2- 172.21.15.144:0/1567194610 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 0x55984cdd1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- 172.21.15.144:0/1567194610 >> 172.21.15.144:0/1567194610 conn(0x55984cd8e600 msgr2=0x55984cd86630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- 172.21.15.144:0/1567194610 shutdown_connections 2024-09-12T12:12:52.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- 172.21.15.144:0/1567194610 wait complete. 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 -- start start 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.549+0000 7f9adace7000 1 Processor -- start 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984cd8cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd2440 0x55984cd8d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984cd930d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55984cc38b00 con 0x55984cdd1b20 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55984cbb1360 con 0x55984cd92cf0 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55984cbae2d0 con 0x55984cdd2440 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 10 client.0 _ll_register_callbacks cb 0x55984cd73820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984cd8cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984cd8cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37764/0 (socket says 172.21.15.144:37764) 2024-09-12T12:12:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad4e00640 1 -- 172.21.15.144:0/1546529257 learned_addr learned my addr 172.21.15.144:0/1546529257 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad5800640 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984cd930d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9acfe00640 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd2440 0x55984cd8d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad4e00640 1 -- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd2440 msgr2=0x55984cd8d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd2440 0x55984cd8d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad4e00640 1 -- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 msgr2=0x55984cd930d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984cd930d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad4e00640 1 -- 172.21.15.144:0/1546529257 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55984cb7d120 con 0x55984cdd1b20 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984cd8cc70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00154e0 tx=0x7f9ac0001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8482b0c92e690eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9aba000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:12:52.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9aba000640 1 -- 172.21.15.144:0/1546529257 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac00145e0 con 0x55984cdd1b20 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9aba000640 1 -- 172.21.15.144:0/1546529257 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9ac0014780 con 0x55984cdd1b20 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 -- 172.21.15.144:0/1546529257 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9abc0ed8b0 con 0x55984cdd1b20 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9aba000640 1 -- 172.21.15.144:0/1546529257 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f9ac0030050 con 0x55984cdd1b20 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 10 client.4389 fetch_fsmap learned FSMap version 6 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 -- 172.21.15.144:0/1546529257 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55984cb76450 con 0x55984cdd1b20 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9aba000640 1 -- 172.21.15.144:0/1546529257 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc0ed8b0 con 0x55984cdd1b20 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9aba000640 1 -- 172.21.15.144:0/1546529257 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f9ac0033020 con 0x55984cdd1b20 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 10 client.4389 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 10 client.4389 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 20 client.4389 populate_metadata read hostname 'smithi144' 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x55984cde0280 0x55984cde2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 4 client.4389 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:12:52.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9adace7000 1 -- 172.21.15.144:0/1546529257 --> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55984cb70c00 con 0x55984cde0280 2024-09-12T12:12:52.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9acfe00640 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x55984cde0280 0x55984cde2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9aba000640 10 client.4389 ms_handle_connect on v2:172.21.15.165:6833/2425635308 2024-09-12T12:12:52.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.553+0000 7f9acfe00640 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x55984cde0280 0x55984cde2670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ad633b8fe634db7 server_cookie=f868e31c7a8d0cae in_seq=0 out_seq=0 2024-09-12T12:12:52.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9aba000640 1 -- 172.21.15.144:0/1546529257 <== mds.0 v2:172.21.15.165:6833/2425635308 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55984cb70c00 con 0x55984cde0280 2024-09-12T12:12:52.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9aba000640 10 client.4389 handle_command_reply: tid=0 2024-09-12T12:12:52.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 client.4389 shutdown 2024-09-12T12:12:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 -- 172.21.15.144:0/1546529257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 msgr2=0x55984cd8cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984cd8cc70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00154e0 tx=0x7f9ac0001130 comp rx=0 tx=0).stop 2024-09-12T12:12:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 -- 172.21.15.144:0/1546529257 shutdown_connections 2024-09-12T12:12:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984cd930d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd2440 0x55984cd8d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x55984cde0280 0x55984cde2670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 --2- 172.21.15.144:0/1546529257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984cd8cc70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 -- 172.21.15.144:0/1546529257 >> 172.21.15.144:0/1546529257 conn(0x55984cd88290 msgr2=0x55984cd86d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9aba000640 0 client.4389 ms_handle_reset on v2:172.21.15.165:6833/2425635308 2024-09-12T12:12:52.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 -- 172.21.15.144:0/1546529257 shutdown_connections 2024-09-12T12:12:52.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 1 -- 172.21.15.144:0/1546529257 wait complete. 2024-09-12T12:12:52.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.557+0000 7f9adace7000 20 client.4389 trim_cache size 0 max 16384 2024-09-12T12:12:52.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.573+0000 7f9adace7000 1 Processor -- start 2024-09-12T12:12:52.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.573+0000 7f9adace7000 1 -- start start 2024-09-12T12:12:52.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984cde5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 0x55984cdd0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cdd10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01fd3d0 con 0x55984cdd2440 2024-09-12T12:12:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad01fc730 con 0x55984cd92cf0 2024-09-12T12:12:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad01fcd80 con 0x55984cdd1b20 2024-09-12T12:12:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad5800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cdd10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad5800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cdd10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37766/0 (socket says 172.21.15.144:37766) 2024-09-12T12:12:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9acfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 0x55984cdd0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad5800640 1 -- 172.21.15.144:0/398251957 learned_addr learned my addr 172.21.15.144:0/398251957 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:52.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/398251957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984cde5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad5800640 1 -- 172.21.15.144:0/398251957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 msgr2=0x55984cdd0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad5800640 1 --2- 172.21.15.144:0/398251957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 0x55984cdd0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad5800640 1 -- 172.21.15.144:0/398251957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 msgr2=0x55984cde5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad5800640 1 --2- 172.21.15.144:0/398251957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984cde5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad5800640 1 -- 172.21.15.144:0/398251957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55984cb5dfd0 con 0x55984cdd2440 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9acfe00640 1 --2- 172.21.15.144:0/398251957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 0x55984cdd0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ad5800640 1 --2- 172.21.15.144:0/398251957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cdd10a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0070f90 tx=0x7f9ac8019820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede10dc5ed1e1360 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ac4c00640 1 -- 172.21.15.144:0/398251957 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8010040 con 0x55984cdd2440 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ac4c00640 1 -- 172.21.15.144:0/398251957 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac8005ab0 con 0x55984cdd2440 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9ac4c00640 1 -- 172.21.15.144:0/398251957 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80225c0 con 0x55984cdd2440 2024-09-12T12:12:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 -- 172.21.15.144:0/398251957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 msgr2=0x55984cdd10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 --2- 172.21.15.144:0/398251957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cdd10a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0070f90 tx=0x7f9ac8019820 comp rx=0 tx=0).stop 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 -- 172.21.15.144:0/398251957 shutdown_connections 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 --2- 172.21.15.144:0/398251957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd2440 0x55984cdd10a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 --2- 172.21.15.144:0/398251957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd1b20 0x55984cdd0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 --2- 172.21.15.144:0/398251957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984cde5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 -- 172.21.15.144:0/398251957 >> 172.21.15.144:0/398251957 conn(0x55984cd88290 msgr2=0x55984cd89db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 -- 172.21.15.144:0/398251957 shutdown_connections 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 -- 172.21.15.144:0/398251957 wait complete. 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 -- start start 2024-09-12T12:12:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.577+0000 7f9adace7000 1 Processor -- start 2024-09-12T12:12:52.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984ce44ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984ce45220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd2440 0x55984ce45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55984cbd5f80 con 0x55984cdd1b20 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55984cb8eca0 con 0x55984cd92cf0 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55984cbdb2a0 con 0x55984cdd2440 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 10 client.0 _ll_register_callbacks cb 0x7f9ac0005340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9acfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984ce45220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9acfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984ce45220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37770/0 (socket says 172.21.15.144:37770) 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9acfe00640 1 -- 172.21.15.144:0/989814582 learned_addr learned my addr 172.21.15.144:0/989814582 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984ce44ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9acfe00640 1 -- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd2440 msgr2=0x55984ce45760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9acfe00640 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd2440 0x55984ce45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9acfe00640 1 -- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 msgr2=0x55984ce44ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9acfe00640 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984ce44ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9acfe00640 1 -- 172.21.15.144:0/989814582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55984cc59750 con 0x55984cdd1b20 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9acfe00640 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984ce45220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0f00c0 tx=0x7f9abc11f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef1e6635ad236b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 1 -- 172.21.15.144:0/989814582 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0edb10 con 0x55984cdd1b20 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 1 -- 172.21.15.144:0/989814582 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9abc0c0e30 con 0x55984cdd1b20 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- 172.21.15.144:0/989814582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ac8005ab0 con 0x55984cdd1b20 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 1 -- 172.21.15.144:0/989814582 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f9abc004410 con 0x55984cdd1b20 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 10 client.4395 fetch_fsmap learned FSMap version 6 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- 172.21.15.144:0/989814582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55984cb64a30 con 0x55984cdd1b20 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 1 -- 172.21.15.144:0/989814582 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac8005ab0 con 0x55984cdd1b20 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 1 -- 172.21.15.144:0/989814582 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f9abc0ebe80 con 0x55984cdd1b20 2024-09-12T12:12:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 10 client.4395 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 20 client.4395 populate_metadata read hostname 'smithi144' 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x55984ce00de0 0x55984ce011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 4 client.4395 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- 172.21.15.144:0/989814582 --> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] -- command(tid 0: {"prefix": "status"}) -- 0x55984cbe43a0 con 0x55984ce00de0 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x55984ce00de0 0x55984ce011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 10 client.4395 ms_handle_connect on v2:172.21.15.165:6833/2425635308 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9ad4e00640 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x55984ce00de0 0x55984ce011c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c500e49867dcab server_cookie=e57ada31332de2b0 in_seq=0 out_seq=0 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 1 -- 172.21.15.144:0/989814582 <== mds.0 v2:172.21.15.165:6833/2425635308 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55984cbe43a0 con 0x55984ce00de0 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 10 client.4395 handle_command_reply: tid=0 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 client.4395 shutdown 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- 172.21.15.144:0/989814582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 msgr2=0x55984ce45220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984ce45220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0f00c0 tx=0x7f9abc11f040 comp rx=0 tx=0).stop 2024-09-12T12:12:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- 172.21.15.144:0/989814582 shutdown_connections 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55984cdd2440 0x55984ce45760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x55984ce00de0 0x55984ce011c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55984cdd1b20 0x55984ce45220 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 --2- 172.21.15.144:0/989814582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55984cd92cf0 0x55984ce44ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9aba000640 0 client.4395 ms_handle_reset on v2:172.21.15.165:6833/2425635308 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- 172.21.15.144:0/989814582 >> 172.21.15.144:0/989814582 conn(0x55984cd88290 msgr2=0x55984cdcfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- 172.21.15.144:0/989814582 shutdown_connections 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.581+0000 7f9adace7000 1 -- 172.21.15.144:0/989814582 wait complete. 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9adace7000 20 client.4395 trim_cache size 0 max 16384 2024-09-12T12:12:52.588 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4287, 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 7.7639786199999996, 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 6, 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 25, 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 25, 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 13.753352383999999 2024-09-12T12:12:52.589 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:12:52.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 -- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ab00678c0 msgr2=0x7f9ab0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ab00678c0 0x7f9ab0069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0000c10 tx=0x7f9ac0009040 comp rx=0 tx=0).stop 2024-09-12T12:12:52.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 -- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ad0157d50 msgr2=0x7f9ad00ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ad0157d50 0x7f9ad00ae210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0b0040 tx=0x7f9abc0197e0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 -- 172.21.15.144:0/4129302716 shutdown_connections 2024-09-12T12:12:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ab00678c0 0x7f9ab0069d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ad00af090 0x7f9ad015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ad0157d50 0x7f9ad00ae210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 --2- 172.21.15.144:0/4129302716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ab4004810 0x7f9ad0158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 -- 172.21.15.144:0/4129302716 >> 172.21.15.144:0/4129302716 conn(0x7f9ad006d0d0 msgr2=0x7f9ad00ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 -- 172.21.15.144:0/4129302716 shutdown_connections 2024-09-12T12:12:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.585+0000 7f9ad7800640 1 -- 172.21.15.144:0/4129302716 wait complete. 2024-09-12T12:12:52.604 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:12:52.604 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:12:52.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:12:52.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.737+0000 7fdac8e00640 1 Processor -- start 2024-09-12T12:12:52.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.737+0000 7fdac8e00640 1 -- start start 2024-09-12T12:12:52.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac8e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdac406ea20 0x7fdac406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac8e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdac40b7070 0x7fdac406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac8e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac406d6f0 con 0x7fdac415e580 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac8e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdac406d9a0 con 0x7fdac40b7070 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac8e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdac406df40 con 0x7fdac406ea20 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdac415e580 0x7fdac40b6960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42518/0 (socket says 172.21.15.144:42518) 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac1e00640 1 -- 172.21.15.144:0/1303717849 learned_addr learned my addr 172.21.15.144:0/1303717849 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac2800640 1 --2- 172.21.15.144:0/1303717849 >> v2:172.21.15.144:3300/0 conn(0x7fdac40b7070 0x7fdac406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac1400640 1 --2- 172.21.15.144:0/1303717849 >> v2:172.21.15.165:3300/0 conn(0x7fdac406ea20 0x7fdac406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac2800640 1 -- 172.21.15.144:0/1303717849 >> v2:172.21.15.165:3300/0 conn(0x7fdac406ea20 msgr2=0x7fdac406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac2800640 1 --2- 172.21.15.144:0/1303717849 >> v2:172.21.15.165:3300/0 conn(0x7fdac406ea20 0x7fdac406cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac2800640 1 -- 172.21.15.144:0/1303717849 >> v1:172.21.15.144:6789/0 conn(0x7fdac415e580 legacy=0x7fdac40b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.741+0000 7fdac2800640 1 -- 172.21.15.144:0/1303717849 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac406e220 con 0x7fdac40b7070 2024-09-12T12:12:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac2800640 1 --2- 172.21.15.144:0/1303717849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 0x7fdac406d1b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdac40b16a0 tx=0x7fdabc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbbacb7d7a37ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac0a00640 1 -- 172.21.15.144:0/1303717849 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0b0070 con 0x7fdac40b7070 2024-09-12T12:12:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac0a00640 1 -- 172.21.15.144:0/1303717849 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdabc0ab600 con 0x7fdac40b7070 2024-09-12T12:12:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac0a00640 1 -- 172.21.15.144:0/1303717849 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0ab9d0 con 0x7fdac40b7070 2024-09-12T12:12:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 -- 172.21.15.144:0/1303717849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 msgr2=0x7fdac406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 --2- 172.21.15.144:0/1303717849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 0x7fdac406d1b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdac40b16a0 tx=0x7fdabc01c450 comp rx=0 tx=0).stop 2024-09-12T12:12:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 -- 172.21.15.144:0/1303717849 shutdown_connections 2024-09-12T12:12:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 --2- 172.21.15.144:0/1303717849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 0x7fdac406d1b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 --2- 172.21.15.144:0/1303717849 >> v2:172.21.15.165:3300/0 conn(0x7fdac406ea20 0x7fdac406cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 -- 172.21.15.144:0/1303717849 >> 172.21.15.144:0/1303717849 conn(0x7fdac4067a00 msgr2=0x7fdac4067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 -- 172.21.15.144:0/1303717849 shutdown_connections 2024-09-12T12:12:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 -- 172.21.15.144:0/1303717849 wait complete. 2024-09-12T12:12:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 Processor -- start 2024-09-12T12:12:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 -- start start 2024-09-12T12:12:52.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac406ea20 0x7fdac4152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 0x7fdac4154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdac415e580 0x7fdac4154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40cc3f0 con 0x7fdac40b7070 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40cc270 con 0x7fdac406ea20 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdac40cc570 con 0x7fdac415e580 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 0x7fdac4154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 0x7fdac4154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37788/0 (socket says 172.21.15.144:37788) 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.745+0000 7fdac1400640 1 -- 172.21.15.144:0/2219214193 learned_addr learned my addr 172.21.15.144:0/2219214193 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac1e00640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac406ea20 0x7fdac4152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac2800640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdac415e580 0x7fdac4154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac1400640 1 -- 172.21.15.144:0/2219214193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdac415e580 msgr2=0x7fdac4154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac1400640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdac415e580 0x7fdac4154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac1400640 1 -- 172.21.15.144:0/2219214193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac406ea20 msgr2=0x7fdac4152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac1400640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac406ea20 0x7fdac4152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac1400640 1 -- 172.21.15.144:0/2219214193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac41557e0 con 0x7fdac40b7070 2024-09-12T12:12:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac2800640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdac415e580 0x7fdac4154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:12:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac1400640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 0x7fdac4154630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdab000d800 tx=0x7fdab000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdaba000640 1 -- 172.21.15.144:0/2219214193 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab000b6c0 con 0x7fdac40b7070 2024-09-12T12:12:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdaba000640 1 -- 172.21.15.144:0/2219214193 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab0019070 con 0x7fdac40b7070 2024-09-12T12:12:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac4155ac0 con 0x7fdac40b7070 2024-09-12T12:12:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdaba000640 1 -- 172.21.15.144:0/2219214193 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab000ba60 con 0x7fdac40b7070 2024-09-12T12:12:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac41572b0 con 0x7fdac40b7070 2024-09-12T12:12:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac40b6960 con 0x7fdac40b7070 2024-09-12T12:12:52.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdaba000640 1 -- 172.21.15.144:0/2219214193 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdab000bc00 con 0x7fdac40b7070 2024-09-12T12:12:52.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdaba000640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdaa40678c0 0x7fdaa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:52.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.749+0000 7fdaba000640 1 -- 172.21.15.144:0/2219214193 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdab0086400 con 0x7fdac40b7070 2024-09-12T12:12:52.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.753+0000 7fdac1e00640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdaa40678c0 0x7fdaa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:52.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.753+0000 7fdac1e00640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdaa40678c0 0x7fdaa4069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdab40012f0 tx=0x7fdab40019a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:52.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.753+0000 7fdaba000640 1 -- 172.21.15.144:0/2219214193 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdab0056c00 con 0x7fdac40b7070 2024-09-12T12:12:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.953+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdac4069450 con 0x7fdac40b7070 2024-09-12T12:12:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.953+0000 7fdaba000640 1 -- 172.21.15.144:0/2219214193 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fdab0056500 con 0x7fdac40b7070 2024-09-12T12:12:52.956 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T12:12:52.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdaa40678c0 msgr2=0x7fdaa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdaa40678c0 0x7fdaa4069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdab40012f0 tx=0x7fdab40019a0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 msgr2=0x7fdac4154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 0x7fdac4154630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdab000d800 tx=0x7fdab000dcc0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 shutdown_connections 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdaa40678c0 0x7fdaa4069d80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdac415e580 0x7fdac4154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdac40b7070 0x7fdac4154630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 --2- 172.21.15.144:0/2219214193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac406ea20 0x7fdac4152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 >> 172.21.15.144:0/2219214193 conn(0x7fdac4067a00 msgr2=0x7fdac406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 shutdown_connections 2024-09-12T12:12:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:52.957+0000 7fdac8e00640 1 -- 172.21.15.144:0/2219214193 wait complete. 2024-09-12T12:12:52.976 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:12:52.976 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:12:52.977 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:12:52.977 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T12:12:52.977 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:12:52.977 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:12:52.977 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:12:52.977 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:12:52.977 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T12:12:52.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:52.977 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:12:52.986 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:12:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:12:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:12:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:12:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:12:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:12:52.986 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:12:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:12:52.986 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42410sec preferred_lft 42410sec 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:12:52.987 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:12:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:12:52.988 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:12:52.989 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T12:12:52.989 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:12:52.989 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:12:52.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2024-09-12T12:12:52.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2024-09-12T12:12:52.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2024-09-12T12:12:52.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T12:12:52.989 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:12:53.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:12:53.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:12:53.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:53.145 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:12:53.206 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:12:53.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:53.208 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:12:53.285 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:12:53.285 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:12:53.285 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:12:53.285 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:12:53.285 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:12:53.285 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:12:53.285 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:12:53.286 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:12:53.286 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:12:53.286 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:12:53.286 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:12:53.286 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:12:53.286 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:12:53.286 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:12:53.287 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:12:53.287 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:12:53.287 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:12:53.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:12:53.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:12:53.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:53.423 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:12:53.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:53.433 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2024-09-12T12:12:53.489 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:12:53.490 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:12:53.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:12:53.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T12:12:53.490 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:12:53.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:12:53.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:12:53.618 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T12:12:53.619 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:12:53.619 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:12:53.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T12:12:53.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T12:12:53.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T12:12:53.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T12:12:53.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T12:12:53.619 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:12:53.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:12:53.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:12:53.831 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:12:53.831 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:12:53.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:12:53.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T12:12:53.832 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:12:53.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:12:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:12:53.959 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T12:12:53.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:12:53.959 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:12:53.968 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T12:12:53.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:12:53.968 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:12:54.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse 2024-09-12T12:12:54.080 DEBUG:teuthology.orchestra.run.smithi144:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:12:54.133 INFO:teuthology.orchestra.run.smithi144.stdout:/sys 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/proc 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/dev 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/pts 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/run 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/ 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/security 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/shm 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/run/lock 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/cgroup 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/pstore 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/bpf 2024-09-12T12:12:54.134 INFO:teuthology.orchestra.run.smithi144.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/hugepages 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/mqueue 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/debug 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/tracing 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/proc/fs/nfsd 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/fuse/connections 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/config 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/run/rpc_pipefs 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/run/user/1000 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T12:12:54.135 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T12:12:54.136 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T12:12:54.136 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T12:12:54.136 INFO:teuthology.orchestra.run.smithi144.stdout:/run/netns 2024-09-12T12:12:54.136 INFO:teuthology.orchestra.run.smithi144.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:12:54.136 INFO:teuthology.orchestra.run.smithi144.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:12:54.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:54.137 DEBUG:teuthology.orchestra.run.smithi144:> ls /sys/fs/fuse/connections 2024-09-12T12:12:54.192 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T12:12:54.193 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T12:12:54.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse 2024-09-12T12:12:54.258 DEBUG:teuthology.orchestra.run.smithi144:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:12:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/sys 2024-09-12T12:12:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/proc 2024-09-12T12:12:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/dev 2024-09-12T12:12:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/pts 2024-09-12T12:12:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/run 2024-09-12T12:12:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/ 2024-09-12T12:12:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/security 2024-09-12T12:12:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/shm 2024-09-12T12:12:54.312 INFO:teuthology.orchestra.run.smithi144.stdout:/run/lock 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/cgroup 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/pstore 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/bpf 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/hugepages 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/mqueue 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/debug 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/tracing 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/proc/fs/nfsd 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/fuse/connections 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/config 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T12:12:54.313 INFO:teuthology.orchestra.run.smithi144.stdout:/run/rpc_pipefs 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/run/user/1000 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/run/netns 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run.smithi144.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:12:54.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:54.314 DEBUG:teuthology.orchestra.run.smithi144:> ls /sys/fs/fuse/connections 2024-09-12T12:12:54.336 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi144.stderr:2024-09-12T12:12:54.333+0000 7f8b97dd9580 -1 init, newargv = 0x55e0c7aec2b0 newargc=15 2024-09-12T12:12:54.336 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi144.stderr:ceph-fuse[35452]: starting ceph client 2024-09-12T12:12:54.345 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi144.stderr:ceph-fuse[35452]: starting fuse 2024-09-12T12:12:55.446 DEBUG:teuthology.orchestra.run.smithi144:> sudo modprobe fuse 2024-09-12T12:12:55.469 DEBUG:teuthology.orchestra.run.smithi144:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T12:12:55.522 INFO:teuthology.orchestra.run.smithi144.stdout:/sys 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/proc 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/dev 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/pts 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/run 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/ 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/security 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/shm 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/run/lock 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/cgroup 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/pstore 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/bpf 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T12:12:55.523 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/hugepages 2024-09-12T12:12:55.524 INFO:teuthology.orchestra.run.smithi144.stdout:/dev/mqueue 2024-09-12T12:12:55.524 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/debug 2024-09-12T12:12:55.524 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/tracing 2024-09-12T12:12:55.524 INFO:teuthology.orchestra.run.smithi144.stdout:/proc/fs/nfsd 2024-09-12T12:12:55.524 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/fs/fuse/connections 2024-09-12T12:12:55.524 INFO:teuthology.orchestra.run.smithi144.stdout:/sys/kernel/config 2024-09-12T12:12:55.525 INFO:teuthology.orchestra.run.smithi144.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T12:12:55.525 INFO:teuthology.orchestra.run.smithi144.stdout:/run/rpc_pipefs 2024-09-12T12:12:55.525 INFO:teuthology.orchestra.run.smithi144.stdout:/run/user/1000 2024-09-12T12:12:55.525 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph 2024-09-12T12:12:55.525 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T12:12:55.525 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T12:12:55.526 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T12:12:55.526 INFO:teuthology.orchestra.run.smithi144.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T12:12:55.526 INFO:teuthology.orchestra.run.smithi144.stdout:/run/netns 2024-09-12T12:12:55.526 INFO:teuthology.orchestra.run.smithi144.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:12:55.526 INFO:teuthology.orchestra.run.smithi144.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:12:55.526 INFO:teuthology.orchestra.run.smithi144.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-12T12:12:55.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:55.527 DEBUG:teuthology.orchestra.run.smithi144:> ls /sys/fs/fuse/connections 2024-09-12T12:12:55.577 INFO:teuthology.orchestra.run.smithi144.stdout:44 2024-09-12T12:12:55.577 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-12T12:12:55.577 DEBUG:teuthology.orchestra.run.smithi144:> sudo stdin-killer -- python3 -c ' 2024-09-12T12:12:55.577 DEBUG:teuthology.orchestra.run.smithi144:> import glob 2024-09-12T12:12:55.577 DEBUG:teuthology.orchestra.run.smithi144:> import re 2024-09-12T12:12:55.577 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> import subprocess 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> def _find_admin_socket(client_name): 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> files = glob.glob(asok_path) 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> # Given a non-glob path, it better be there 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> if "*" not in asok_path: 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> assert(len(files) == 1) 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> return files[0] 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> for f in files: 2024-09-12T12:12:55.578 DEBUG:teuthology.orchestra.run.smithi144:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T12:12:55.579 DEBUG:teuthology.orchestra.run.smithi144:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T12:12:55.579 DEBUG:teuthology.orchestra.run.smithi144:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T12:12:55.579 DEBUG:teuthology.orchestra.run.smithi144:> contents = proc_f.read() 2024-09-12T12:12:55.579 DEBUG:teuthology.orchestra.run.smithi144:> if mountpoint in contents: 2024-09-12T12:12:55.579 DEBUG:teuthology.orchestra.run.smithi144:> return f 2024-09-12T12:12:55.579 DEBUG:teuthology.orchestra.run.smithi144:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T12:12:55.579 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:12:55.579 DEBUG:teuthology.orchestra.run.smithi144:> print(_find_admin_socket("client.admin")) 2024-09-12T12:12:55.579 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:12:55.709 INFO:teuthology.orchestra.run.smithi144.stdout:/var/run/ceph/ceph-client.admin.35452.asok 2024-09-12T12:12:55.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:12:55.721 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.35452.asok 2024-09-12T12:12:55.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:55.721 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.35452.asok status 2024-09-12T12:12:55.898 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:12:55.898 INFO:teuthology.orchestra.run.smithi144.stdout: "metadata": { 2024-09-12T12:12:55.898 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T12:12:55.898 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "entity_id": "admin", 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "hostname": "smithi144", 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "pid": "35452", 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "root": "/" 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "dentry_count": 0, 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "dentry_pinned_count": 0, 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4410, 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "inst": { 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "name": { 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "client", 2024-09-12T12:12:55.899 INFO:teuthology.orchestra.run.smithi144.stdout: "num": 4410 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": { 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v1", 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "192.168.0.1:0", 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 2684236230 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": { 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v1", 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "192.168.0.1:0", 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 2684236230 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "inst_str": "client.4410 192.168.0.1:0/2684236230", 2024-09-12T12:12:55.900 INFO:teuthology.orchestra.run.smithi144.stdout: "addr_str": "192.168.0.1:0/2684236230", 2024-09-12T12:12:55.901 INFO:teuthology.orchestra.run.smithi144.stdout: "inode_count": 1, 2024-09-12T12:12:55.901 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_epoch": 6, 2024-09-12T12:12:55.901 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_epoch": 25, 2024-09-12T12:12:55.901 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_epoch_barrier": 0, 2024-09-12T12:12:55.901 INFO:teuthology.orchestra.run.smithi144.stdout: "blocklisted": false, 2024-09-12T12:12:55.901 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs" 2024-09-12T12:12:55.901 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:12:55.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:55.914 DEBUG:teuthology.orchestra.run.smithi144:> stat --file-system '--printf=%T 2024-09-12T12:12:55.914 DEBUG:teuthology.orchestra.run.smithi144:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:12:55.924 INFO:teuthology.orchestra.run.smithi144.stdout:fuseblk 2024-09-12T12:12:55.924 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:12:55.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:55.924 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:12:55.988 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T12:12:56.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:12:56.125 INFO:teuthology.orchestra.run.smithi144.stdout:# file: . 2024-09-12T12:12:56.125 INFO:teuthology.orchestra.run.smithi144.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T12:12:56.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:12:56.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:12:56.131 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:56.131 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:12:56.140 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:12:56.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.321+0000 7f0db4e00640 1 Processor -- start 2024-09-12T12:12:56.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.321+0000 7f0db4e00640 1 -- start start 2024-09-12T12:12:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.321+0000 7f0db4e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0db015b4e0 0x7f0db00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.321+0000 7f0db4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0db00b3ad0 0x7f0db0071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0db4e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db00b45a0 con 0x7f0db0071960 2024-09-12T12:12:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0db4e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0db00b3fe0 con 0x7f0db00b3ad0 2024-09-12T12:12:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0db4e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0db00b42c0 con 0x7f0db015b4e0 2024-09-12T12:12:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0da7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0db00b3ad0 0x7f0db0071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0da7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0db00b3ad0 0x7f0db0071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37804/0 (socket says 172.21.15.144:37804) 2024-09-12T12:12:56.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0da7e00640 1 -- 172.21.15.144:0/2771051712 learned_addr learned my addr 172.21.15.144:0/2771051712 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:56.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0da7e00640 1 -- 172.21.15.144:0/2771051712 >> v2:172.21.15.165:3300/0 conn(0x7f0db015b4e0 msgr2=0x7f0db00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:56.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0dade00640 1 --2- 172.21.15.144:0/2771051712 >> v2:172.21.15.165:3300/0 conn(0x7f0db015b4e0 0x7f0db00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0da7e00640 1 --2- 172.21.15.144:0/2771051712 >> v2:172.21.15.165:3300/0 conn(0x7f0db015b4e0 0x7f0db00b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0da7e00640 1 -- 172.21.15.144:0/2771051712 >> v1:172.21.15.165:6789/0 conn(0x7f0db0071960 legacy=0x7f0db00ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:12:56.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0da7e00640 1 -- 172.21.15.144:0/2771051712 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db00b1490 con 0x7f0db00b3ad0 2024-09-12T12:12:56.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0dade00640 1 --2- 172.21.15.144:0/2771051712 >> v2:172.21.15.165:3300/0 conn(0x7f0db015b4e0 0x7f0db00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0da7e00640 1 --2- 172.21.15.144:0/2771051712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 0x7f0db0071420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0db0069450 tx=0x7f0d9801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddcdafde5e910c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.325+0000 7f0dad400640 1 -- 172.21.15.144:0/2771051712 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d980b4070 con 0x7f0db00b3ad0 2024-09-12T12:12:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0dad400640 1 -- 172.21.15.144:0/2771051712 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d980a7c70 con 0x7f0db00b3ad0 2024-09-12T12:12:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0dad400640 1 -- 172.21.15.144:0/2771051712 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d980af660 con 0x7f0db00b3ad0 2024-09-12T12:12:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 -- 172.21.15.144:0/2771051712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 msgr2=0x7f0db0071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 --2- 172.21.15.144:0/2771051712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 0x7f0db0071420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0db0069450 tx=0x7f0d9801eb80 comp rx=0 tx=0).stop 2024-09-12T12:12:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 -- 172.21.15.144:0/2771051712 shutdown_connections 2024-09-12T12:12:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 --2- 172.21.15.144:0/2771051712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 0x7f0db0071420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 --2- 172.21.15.144:0/2771051712 >> v2:172.21.15.165:3300/0 conn(0x7f0db015b4e0 0x7f0db00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 -- 172.21.15.144:0/2771051712 >> 172.21.15.144:0/2771051712 conn(0x7f0db006d0d0 msgr2=0x7f0db006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 -- 172.21.15.144:0/2771051712 shutdown_connections 2024-09-12T12:12:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 -- 172.21.15.144:0/2771051712 wait complete. 2024-09-12T12:12:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 Processor -- start 2024-09-12T12:12:56.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 -- start start 2024-09-12T12:12:56.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db0071960 0x7f0db0152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 0x7f0db0072860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db015b4e0 0x7f0db0072da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00b2620 con 0x7f0db00b3ad0 2024-09-12T12:12:56.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00b24a0 con 0x7f0db0071960 2024-09-12T12:12:56.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0db4e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0db00cd640 con 0x7f0db015b4e0 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0da7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 0x7f0db0072860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0da7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 0x7f0db0072860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37808/0 (socket says 172.21.15.144:37808) 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0da7e00640 1 -- 172.21.15.144:0/3002273317 learned_addr learned my addr 172.21.15.144:0/3002273317 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0dade00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db0071960 0x7f0db0152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0dae800640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db015b4e0 0x7f0db0072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0da7e00640 1 -- 172.21.15.144:0/3002273317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db015b4e0 msgr2=0x7f0db0072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0da7e00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db015b4e0 0x7f0db0072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0da7e00640 1 -- 172.21.15.144:0/3002273317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db0071960 msgr2=0x7f0db0152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0da7e00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db0071960 0x7f0db0152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0da7e00640 1 -- 172.21.15.144:0/3002273317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db01598d0 con 0x7f0db00b3ad0 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.329+0000 7f0dae800640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db015b4e0 0x7f0db0072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:56.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0da7e00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 0x7f0db0072860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d9801c7b0 tx=0x7f0d9801b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:56.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0da6000640 1 -- 172.21.15.144:0/3002273317 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d980b4030 con 0x7f0db00b3ad0 2024-09-12T12:12:56.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0da6000640 1 -- 172.21.15.144:0/3002273317 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d980b6070 con 0x7f0db00b3ad0 2024-09-12T12:12:56.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db0159bb0 con 0x7f0db00b3ad0 2024-09-12T12:12:56.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0da6000640 1 -- 172.21.15.144:0/3002273317 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d980ad7b0 con 0x7f0db00b3ad0 2024-09-12T12:12:56.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db015a170 con 0x7f0db00b3ad0 2024-09-12T12:12:56.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db0071420 con 0x7f0db00b3ad0 2024-09-12T12:12:56.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0da6000640 1 -- 172.21.15.144:0/3002273317 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d980c1060 con 0x7f0db00b3ad0 2024-09-12T12:12:56.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0da6000640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d8c0678c0 0x7f0d8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0da6000640 1 -- 172.21.15.144:0/3002273317 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0d98120660 con 0x7f0db00b3ad0 2024-09-12T12:12:56.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.333+0000 7f0dade00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d8c0678c0 0x7f0d8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.337+0000 7f0dade00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d8c0678c0 0x7f0d8c069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0da0006fd0 tx=0x7f0da0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:56.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.337+0000 7f0da6000640 1 -- 172.21.15.144:0/3002273317 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0d980a7e20 con 0x7f0db00b3ad0 2024-09-12T12:12:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.509+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0db00b0ef0 con 0x7f0db00b3ad0 2024-09-12T12:12:56.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.509+0000 7f0da6000640 1 -- 172.21.15.144:0/3002273317 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f0d980187a0 con 0x7f0db00b3ad0 2024-09-12T12:12:56.512 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:12:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d8c0678c0 msgr2=0x7f0d8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d8c0678c0 0x7f0d8c069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0da0006fd0 tx=0x7f0da0008040 comp rx=0 tx=0).stop 2024-09-12T12:12:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 msgr2=0x7f0db0072860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 0x7f0db0072860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d9801c7b0 tx=0x7f0d9801b920 comp rx=0 tx=0).stop 2024-09-12T12:12:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 shutdown_connections 2024-09-12T12:12:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d8c0678c0 0x7f0d8c069d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db015b4e0 0x7f0db0072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db00b3ad0 0x7f0db0072860 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 --2- 172.21.15.144:0/3002273317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db0071960 0x7f0db0152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 >> 172.21.15.144:0/3002273317 conn(0x7f0db006d0d0 msgr2=0x7f0db015efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 shutdown_connections 2024-09-12T12:12:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.513+0000 7f0db4e00640 1 -- 172.21.15.144:0/3002273317 wait complete. 2024-09-12T12:12:56.532 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:12:56.533 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:12:56.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:12:56.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.717+0000 7f842e600640 1 Processor -- start 2024-09-12T12:12:56.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.717+0000 7f842e600640 1 -- start start 2024-09-12T12:12:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f842e600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f84280b49e0 0x7f842815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f842e600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84280b3aa0 con 0x7f84280b3590 2024-09-12T12:12:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f842e600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84280afc10 con 0x7f842815ad50 2024-09-12T12:12:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f842e600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f842815f860 con 0x7f84280b49e0 2024-09-12T12:12:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f8426a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f84280b49e0 0x7f842815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f8427e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f84280b3590 0x7f84280b06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42530/0 (socket says 172.21.15.144:42530) 2024-09-12T12:12:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f8427e00640 1 -- 172.21.15.144:0/2960491609 learned_addr learned my addr 172.21.15.144:0/2960491609 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:12:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f8426a00640 1 -- 172.21.15.144:0/2960491609 >> v1:172.21.15.165:6789/0 conn(0x7f842815ad50 legacy=0x7f84280b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f8426a00640 1 -- 172.21.15.144:0/2960491609 >> v1:172.21.15.144:6789/0 conn(0x7f84280b3590 legacy=0x7f84280b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.721+0000 7f8426a00640 1 -- 172.21.15.144:0/2960491609 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84280afef0 con 0x7f84280b49e0 2024-09-12T12:12:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f8426a00640 1 --2- 172.21.15.144:0/2960491609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84280b49e0 0x7f842815f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8418009d90 tx=0x7f841801da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad0fb2d70f4b710 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:56.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f8426000640 1 -- 172.21.15.144:0/2960491609 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180b3070 con 0x7f84280b49e0 2024-09-12T12:12:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f8426000640 1 -- 172.21.15.144:0/2960491609 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84180a68e0 con 0x7f84280b49e0 2024-09-12T12:12:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f8426000640 1 -- 172.21.15.144:0/2960491609 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180a6cb0 con 0x7f84280b49e0 2024-09-12T12:12:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 -- 172.21.15.144:0/2960491609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84280b49e0 msgr2=0x7f842815f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 --2- 172.21.15.144:0/2960491609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84280b49e0 0x7f842815f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8418009d90 tx=0x7f841801da80 comp rx=0 tx=0).stop 2024-09-12T12:12:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 -- 172.21.15.144:0/2960491609 shutdown_connections 2024-09-12T12:12:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 --2- 172.21.15.144:0/2960491609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84280b49e0 0x7f842815f320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 -- 172.21.15.144:0/2960491609 >> 172.21.15.144:0/2960491609 conn(0x7f842806d0d0 msgr2=0x7f842806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 -- 172.21.15.144:0/2960491609 shutdown_connections 2024-09-12T12:12:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 -- 172.21.15.144:0/2960491609 wait complete. 2024-09-12T12:12:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 Processor -- start 2024-09-12T12:12:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 -- start start 2024-09-12T12:12:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280b3590 0x7f842814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84280b49e0 0x7f842814e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f842815ad50 0x7f84280ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f84280b1210 con 0x7f842815ad50 2024-09-12T12:12:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f84280b1090 con 0x7f84280b49e0 2024-09-12T12:12:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.725+0000 7f842e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f84280b1390 con 0x7f84280b3590 2024-09-12T12:12:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f842815ad50 0x7f84280ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f842815ad50 0x7f84280ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37816/0 (socket says 172.21.15.144:37816) 2024-09-12T12:12:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427e00640 1 -- 172.21.15.144:0/1529511801 learned_addr learned my addr 172.21.15.144:0/1529511801 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:12:56.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427e00640 1 -- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280b3590 msgr2=0x7f842814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427400640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280b3590 0x7f842814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8426a00640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84280b49e0 0x7f842814e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427e00640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280b3590 0x7f842814edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427e00640 1 -- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84280b49e0 msgr2=0x7f842814e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427e00640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84280b49e0 0x7f842814e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427e00640 1 -- 172.21.15.144:0/1529511801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842814f3a0 con 0x7f842815ad50 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427400640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280b3590 0x7f842814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8426a00640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84280b49e0 0x7f842814e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f8427e00640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f842815ad50 0x7f84280ce3e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f842000c430 tx=0x7f842000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f841f400640 1 -- 172.21.15.144:0/1529511801 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420017070 con 0x7f842815ad50 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f841f400640 1 -- 172.21.15.144:0/1529511801 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8420005cf0 con 0x7f842815ad50 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f841f400640 1 -- 172.21.15.144:0/1529511801 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84200072d0 con 0x7f842815ad50 2024-09-12T12:12:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842814f680 con 0x7f842815ad50 2024-09-12T12:12:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842814fc40 con 0x7f842815ad50 2024-09-12T12:12:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84280b1750 con 0x7f842815ad50 2024-09-12T12:12:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f841f400640 1 -- 172.21.15.144:0/1529511801 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f842001a070 con 0x7f842815ad50 2024-09-12T12:12:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.729+0000 7f841f400640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84040678c0 0x7f8404069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.733+0000 7f841f400640 1 -- 172.21.15.144:0/1529511801 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8420085270 con 0x7f842815ad50 2024-09-12T12:12:56.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.733+0000 7f8427400640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84040678c0 0x7f8404069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:56.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.733+0000 7f8427400640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84040678c0 0x7f8404069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8410000f70 tx=0x7f8410009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.737+0000 7f841f400640 1 -- 172.21.15.144:0/1529511801 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8420055410 con 0x7f842815ad50 2024-09-12T12:12:56.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.905+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f842814e830 con 0x7f842815ad50 2024-09-12T12:12:56.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.905+0000 7f841f400640 1 -- 172.21.15.144:0/1529511801 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f8420059710 con 0x7f842815ad50 2024-09-12T12:12:56.907 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:12:56.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84040678c0 msgr2=0x7f8404069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84040678c0 0x7f8404069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8410000f70 tx=0x7f8410009040 comp rx=0 tx=0).stop 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f842815ad50 msgr2=0x7f84280ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f842815ad50 0x7f84280ce3e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f842000c430 tx=0x7f842000c8f0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 shutdown_connections 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84040678c0 0x7f8404069d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f842815ad50 0x7f84280ce3e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84280b49e0 0x7f842814e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 --2- 172.21.15.144:0/1529511801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84280b3590 0x7f842814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 >> 172.21.15.144:0/1529511801 conn(0x7f842806d0d0 msgr2=0x7f84280d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 shutdown_connections 2024-09-12T12:12:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:12:56.909+0000 7f842e600640 1 -- 172.21.15.144:0/1529511801 wait complete. 2024-09-12T12:12:56.928 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi144.front.sepia.ceph.com... 2024-09-12T12:12:56.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:12:56.928 DEBUG:teuthology.orchestra.run.smithi144:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T12:12:56.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi144.stderr:ceph-fuse[35452]: fuse finished with error 0 and tester_r 0 2024-09-12T12:12:56.960 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:13:03.062 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:13:03.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:03.063 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T12:13:03.085 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e7ae00640 1 Processor -- start 2024-09-12T12:13:03.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e7ae00640 1 -- start start 2024-09-12T12:13:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e7ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9e740b5fb0 0x7f9e74167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e7ae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e740cd870 con 0x7f9e7415cd30 2024-09-12T12:13:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e7ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e740cdb50 con 0x7f9e7415c7b0 2024-09-12T12:13:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e7ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9e74072a50 con 0x7f9e740b5fb0 2024-09-12T12:13:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e78e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9e740b5fb0 0x7f9e74167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e73400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9e7415cd30 0x7f9e740b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60478/0 (socket says 172.21.15.144:60478) 2024-09-12T12:13:03.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e73400640 1 -- 172.21.15.144:0/492728318 learned_addr learned my addr 172.21.15.144:0/492728318 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:03.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e78e00640 1 -- 172.21.15.144:0/492728318 >> v1:172.21.15.165:6789/0 conn(0x7f9e7415c7b0 legacy=0x7f9e740ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e78e00640 1 -- 172.21.15.144:0/492728318 >> v1:172.21.15.144:6789/0 conn(0x7f9e7415cd30 legacy=0x7f9e740b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.273+0000 7f9e78e00640 1 -- 172.21.15.144:0/492728318 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e740726e0 con 0x7f9e740b5fb0 2024-09-12T12:13:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e78e00640 1 --2- 172.21.15.144:0/492728318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e740b5fb0 0x7f9e74167310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097c0 tx=0x7f9e6c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd75ca800ab813e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e72a00640 1 -- 172.21.15.144:0/492728318 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0b0070 con 0x7f9e740b5fb0 2024-09-12T12:13:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e72a00640 1 -- 172.21.15.144:0/492728318 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0ab600 con 0x7f9e740b5fb0 2024-09-12T12:13:03.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e72a00640 1 -- 172.21.15.144:0/492728318 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0ab9d0 con 0x7f9e740b5fb0 2024-09-12T12:13:03.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e7ae00640 1 -- 172.21.15.144:0/492728318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e740b5fb0 msgr2=0x7f9e74167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e7ae00640 1 --2- 172.21.15.144:0/492728318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e740b5fb0 0x7f9e74167310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097c0 tx=0x7f9e6c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e7ae00640 1 -- 172.21.15.144:0/492728318 shutdown_connections 2024-09-12T12:13:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e7ae00640 1 --2- 172.21.15.144:0/492728318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e740b5fb0 0x7f9e74167310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e7ae00640 1 -- 172.21.15.144:0/492728318 >> 172.21.15.144:0/492728318 conn(0x7f9e7406d0d0 msgr2=0x7f9e7406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e7ae00640 1 -- 172.21.15.144:0/492728318 shutdown_connections 2024-09-12T12:13:03.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.277+0000 7f9e7ae00640 1 -- 172.21.15.144:0/492728318 wait complete. 2024-09-12T12:13:03.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 Processor -- start 2024-09-12T12:13:03.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 -- start start 2024-09-12T12:13:03.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e740b5fb0 0x7f9e741521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7415c7b0 0x7f9e740d0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e7415cd30 0x7f9e741591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7416a690 con 0x7f9e7415cd30 2024-09-12T12:13:03.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9e740cd610 con 0x7f9e7415c7b0 2024-09-12T12:13:03.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7416a810 con 0x7f9e740b5fb0 2024-09-12T12:13:03.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e78e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e7415cd30 0x7f9e741591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e78e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e7415cd30 0x7f9e741591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52316/0 (socket says 172.21.15.144:52316) 2024-09-12T12:13:03.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e78e00640 1 -- 172.21.15.144:0/451381362 learned_addr learned my addr 172.21.15.144:0/451381362 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:03.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e73e00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e740b5fb0 0x7f9e741521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e73400640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7415c7b0 0x7f9e740d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e78e00640 1 -- 172.21.15.144:0/451381362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e740b5fb0 msgr2=0x7f9e741521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e78e00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e740b5fb0 0x7f9e741521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e78e00640 1 -- 172.21.15.144:0/451381362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7415c7b0 msgr2=0x7f9e740d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e78e00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7415c7b0 0x7f9e740d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e78e00640 1 -- 172.21.15.144:0/451381362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e741526e0 con 0x7f9e7415cd30 2024-09-12T12:13:03.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e78e00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e7415cd30 0x7f9e741591c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0ae040 tx=0x7f9e6c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:03.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e6be00640 1 -- 172.21.15.144:0/451381362 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0b8020 con 0x7f9e7415cd30 2024-09-12T12:13:03.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e6be00640 1 -- 172.21.15.144:0/451381362 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0aa750 con 0x7f9e7415cd30 2024-09-12T12:13:03.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e6be00640 1 -- 172.21.15.144:0/451381362 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0b0040 con 0x7f9e7415cd30 2024-09-12T12:13:03.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e740cfe40 con 0x7f9e7415cd30 2024-09-12T12:13:03.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e74154b00 con 0x7f9e7415cd30 2024-09-12T12:13:03.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.281+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e740ccf00 con 0x7f9e7415cd30 2024-09-12T12:13:03.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.285+0000 7f9e6be00640 1 -- 172.21.15.144:0/451381362 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e6c0bb020 con 0x7f9e7415cd30 2024-09-12T12:13:03.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.285+0000 7f9e6be00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.285+0000 7f9e6be00640 1 -- 172.21.15.144:0/451381362 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9e6c11fec0 con 0x7f9e7415cd30 2024-09-12T12:13:03.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.285+0000 7f9e73e00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.285+0000 7f9e73e00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e64001ea0 tx=0x7f9e64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:03.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.289+0000 7f9e6be00640 1 -- 172.21.15.144:0/451381362 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e6c0c2030 con 0x7f9e7415cd30 2024-09-12T12:13:03.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.453+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e740af480 con 0x7f9e7415cd30 2024-09-12T12:13:03.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.453+0000 7f9e6be00640 1 -- 172.21.15.144:0/451381362 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f9e6c016090 con 0x7f9e7415cd30 2024-09-12T12:13:03.455 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:03.455 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:03.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 msgr2=0x7f9e54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9e64001ea0 tx=0x7f9e64009040 comp rx=0 tx=0).stop 2024-09-12T12:13:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e7415cd30 msgr2=0x7f9e741591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e7415cd30 0x7f9e741591c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0ae040 tx=0x7f9e6c019240 comp rx=0 tx=0).stop 2024-09-12T12:13:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 shutdown_connections 2024-09-12T12:13:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e7415cd30 0x7f9e741591c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7415c7b0 0x7f9e740d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 --2- 172.21.15.144:0/451381362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e740b5fb0 0x7f9e741521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 >> 172.21.15.144:0/451381362 conn(0x7f9e7406d0d0 msgr2=0x7f9e7415f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 shutdown_connections 2024-09-12T12:13:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.457+0000 7f9e7ae00640 1 -- 172.21.15.144:0/451381362 wait complete. 2024-09-12T12:13:03.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:03.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc21a800640 1 Processor -- start 2024-09-12T12:13:03.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc21a800640 1 -- start start 2024-09-12T12:13:03.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc21a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21415e5f0 0x7fc21406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc21a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc21406ea10 0x7fc2140b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc21a800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc21406d260 con 0x7fc2140b44a0 2024-09-12T12:13:03.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc21a800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc2140b6f60 con 0x7fc21406ea10 2024-09-12T12:13:03.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc21a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc2140b7240 con 0x7fc21415e5f0 2024-09-12T12:13:03.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc213e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc21406ea10 0x7fc2140b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc213e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc21406ea10 0x7fc2140b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52322/0 (socket says 172.21.15.144:52322) 2024-09-12T12:13:03.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc213e00640 1 -- 172.21.15.144:0/1544505408 learned_addr learned my addr 172.21.15.144:0/1544505408 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:03.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc213400640 1 --2- 172.21.15.144:0/1544505408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21415e5f0 0x7fc21406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc213e00640 1 -- 172.21.15.144:0/1544505408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21415e5f0 msgr2=0x7fc21406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:03.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc213e00640 1 --2- 172.21.15.144:0/1544505408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21415e5f0 0x7fc21406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc213e00640 1 -- 172.21.15.144:0/1544505408 >> v1:172.21.15.165:6789/0 conn(0x7fc2140b44a0 legacy=0x7fc21406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc213e00640 1 -- 172.21.15.144:0/1544505408 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2140b7520 con 0x7fc21406ea10 2024-09-12T12:13:03.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.613+0000 7fc213400640 1 --2- 172.21.15.144:0/1544505408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21415e5f0 0x7fc21406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:03.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc213e00640 1 --2- 172.21.15.144:0/1544505408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21406ea10 0x7fc2140b48a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009e50 tx=0x7fc20c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22316eb5adf18756 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:03.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc212a00640 1 -- 172.21.15.144:0/1544505408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0a58f0 con 0x7fc21406ea10 2024-09-12T12:13:03.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc212a00640 1 -- 172.21.15.144:0/1544505408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c0a5a90 con 0x7fc21406ea10 2024-09-12T12:13:03.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc212a00640 1 -- 172.21.15.144:0/1544505408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0a5e60 con 0x7fc21406ea10 2024-09-12T12:13:03.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc21a800640 1 -- 172.21.15.144:0/1544505408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21406ea10 msgr2=0x7fc2140b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc21a800640 1 --2- 172.21.15.144:0/1544505408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21406ea10 0x7fc2140b48a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009e50 tx=0x7fc20c01ca00 comp rx=0 tx=0).stop 2024-09-12T12:13:03.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc21a800640 1 -- 172.21.15.144:0/1544505408 shutdown_connections 2024-09-12T12:13:03.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc21a800640 1 --2- 172.21.15.144:0/1544505408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21406ea10 0x7fc2140b48a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc21a800640 1 --2- 172.21.15.144:0/1544505408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21415e5f0 0x7fc21406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc21a800640 1 -- 172.21.15.144:0/1544505408 >> 172.21.15.144:0/1544505408 conn(0x7fc21406f400 msgr2=0x7fc21406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:03.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc21a800640 1 -- 172.21.15.144:0/1544505408 shutdown_connections 2024-09-12T12:13:03.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.617+0000 7fc21a800640 1 -- 172.21.15.144:0/1544505408 wait complete. 2024-09-12T12:13:03.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 Processor -- start 2024-09-12T12:13:03.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 -- start start 2024-09-12T12:13:03.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21406ea10 0x7fc21414a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2140b44a0 0x7fc21414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21415e5f0 0x7fc21414ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc21415f880 con 0x7fc21415e5f0 2024-09-12T12:13:03.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc21415f700 con 0x7fc2140b44a0 2024-09-12T12:13:03.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc21415fa00 con 0x7fc21406ea10 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21415e5f0 0x7fc21414ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21415e5f0 0x7fc21414ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52324/0 (socket says 172.21.15.144:52324) 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213e00640 1 -- 172.21.15.144:0/4102078854 learned_addr learned my addr 172.21.15.144:0/4102078854 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213400640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21406ea10 0x7fc21414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc20be00640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2140b44a0 0x7fc21414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213e00640 1 -- 172.21.15.144:0/4102078854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21406ea10 msgr2=0x7fc21414a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213e00640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21406ea10 0x7fc21414a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213e00640 1 -- 172.21.15.144:0/4102078854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2140b44a0 msgr2=0x7fc21414e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213e00640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2140b44a0 0x7fc21414e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213e00640 1 -- 172.21.15.144:0/4102078854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc214152a80 con 0x7fc21415e5f0 2024-09-12T12:13:03.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc213e00640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21415e5f0 0x7fc21414ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc20c01a630 tx=0x7fc20c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:03.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc20b400640 1 -- 172.21.15.144:0/4102078854 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0bc020 con 0x7fc21415e5f0 2024-09-12T12:13:03.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc20b400640 1 -- 172.21.15.144:0/4102078854 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c0b8470 con 0x7fc21415e5f0 2024-09-12T12:13:03.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc214151f00 con 0x7fc21415e5f0 2024-09-12T12:13:03.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc20b400640 1 -- 172.21.15.144:0/4102078854 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0a58f0 con 0x7fc21415e5f0 2024-09-12T12:13:03.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2141524c0 con 0x7fc21415e5f0 2024-09-12T12:13:03.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.621+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21406cd20 con 0x7fc21415e5f0 2024-09-12T12:13:03.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.625+0000 7fc20b400640 1 -- 172.21.15.144:0/4102078854 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc20c0bf020 con 0x7fc21415e5f0 2024-09-12T12:13:03.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.625+0000 7fc20b400640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1f00678c0 0x7fc1f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.625+0000 7fc20b400640 1 -- 172.21.15.144:0/4102078854 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc20c1213f0 con 0x7fc21415e5f0 2024-09-12T12:13:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.625+0000 7fc213400640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1f00678c0 0x7fc1f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.625+0000 7fc213400640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1f00678c0 0x7fc1f0069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc2140b5870 tx=0x7fc204008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:03.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.629+0000 7fc20b400640 1 -- 172.21.15.144:0/4102078854 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc20c0c6030 con 0x7fc21415e5f0 2024-09-12T12:13:03.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.789+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc21414a540 con 0x7fc21415e5f0 2024-09-12T12:13:03.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.789+0000 7fc20b400640 1 -- 172.21.15.144:0/4102078854 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7fc20c016620 con 0x7fc21415e5f0 2024-09-12T12:13:03.792 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:03.793 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1f00678c0 msgr2=0x7fc1f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1f00678c0 0x7fc1f0069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc2140b5870 tx=0x7fc204008040 comp rx=0 tx=0).stop 2024-09-12T12:13:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21415e5f0 msgr2=0x7fc21414ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21415e5f0 0x7fc21414ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc20c01a630 tx=0x7fc20c0197a0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 shutdown_connections 2024-09-12T12:13:03.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1f00678c0 0x7fc1f0069d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc21415e5f0 0x7fc21414ee80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2140b44a0 0x7fc21414e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 --2- 172.21.15.144:0/4102078854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc21406ea10 0x7fc21414a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 >> 172.21.15.144:0/4102078854 conn(0x7fc21406f400 msgr2=0x7fc2140d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 shutdown_connections 2024-09-12T12:13:03.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.793+0000 7fc21a800640 1 -- 172.21.15.144:0/4102078854 wait complete. 2024-09-12T12:13:03.813 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:13:03.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.949+0000 7fb925a00640 1 Processor -- start 2024-09-12T12:13:03.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.949+0000 7fb925a00640 1 -- start start 2024-09-12T12:13:03.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb925a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb92006c320 0x7fb920166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb925a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9200733e0 con 0x7fb9200af5f0 2024-09-12T12:13:03.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb925a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9200cd290 con 0x7fb92015c2e0 2024-09-12T12:13:03.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb925a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb9200cd570 con 0x7fb92006c320 2024-09-12T12:13:03.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb91e000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb9200af5f0 0x7fb92006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60494/0 (socket says 172.21.15.144:60494) 2024-09-12T12:13:03.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb91e000640 1 -- 172.21.15.144:0/676661485 learned_addr learned my addr 172.21.15.144:0/676661485 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:03.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb91f400640 1 --2- 172.21.15.144:0/676661485 >> v2:172.21.15.144:3300/0 conn(0x7fb92006c320 0x7fb920166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb91d600640 1 -- 172.21.15.144:0/676661485 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159374374 0 0) 0x7fb9200733e0 con 0x7fb9200af5f0 2024-09-12T12:13:03.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb91d600640 1 -- 172.21.15.144:0/676661485 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb904003530 con 0x7fb9200af5f0 2024-09-12T12:13:03.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb91f400640 1 -- 172.21.15.144:0/676661485 >> v1:172.21.15.165:6789/0 conn(0x7fb92015c2e0 legacy=0x7fb920072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb91f400640 1 -- 172.21.15.144:0/676661485 >> v1:172.21.15.144:6789/0 conn(0x7fb9200af5f0 legacy=0x7fb92006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.953+0000 7fb91f400640 1 -- 172.21.15.144:0/676661485 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9200cd850 con 0x7fb92006c320 2024-09-12T12:13:03.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb91f400640 1 --2- 172.21.15.144:0/676661485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 0x7fb920166f10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097c0 tx=0x7fb91801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865d392c0b366016 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:03.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb91d600640 1 -- 172.21.15.144:0/676661485 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9180b0070 con 0x7fb92006c320 2024-09-12T12:13:03.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb91d600640 1 -- 172.21.15.144:0/676661485 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9180ab600 con 0x7fb92006c320 2024-09-12T12:13:03.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb91d600640 1 -- 172.21.15.144:0/676661485 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9180ab9d0 con 0x7fb92006c320 2024-09-12T12:13:03.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb925a00640 1 -- 172.21.15.144:0/676661485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 msgr2=0x7fb920166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb925a00640 1 --2- 172.21.15.144:0/676661485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 0x7fb920166f10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097c0 tx=0x7fb91801c380 comp rx=0 tx=0).stop 2024-09-12T12:13:03.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb925a00640 1 -- 172.21.15.144:0/676661485 shutdown_connections 2024-09-12T12:13:03.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb925a00640 1 --2- 172.21.15.144:0/676661485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 0x7fb920166f10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb925a00640 1 -- 172.21.15.144:0/676661485 >> 172.21.15.144:0/676661485 conn(0x7fb920068030 msgr2=0x7fb9200b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:03.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb925a00640 1 -- 172.21.15.144:0/676661485 shutdown_connections 2024-09-12T12:13:03.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb925a00640 1 -- 172.21.15.144:0/676661485 wait complete. 2024-09-12T12:13:03.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb925a00640 1 Processor -- start 2024-09-12T12:13:03.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.957+0000 7fb925a00640 1 -- start start 2024-09-12T12:13:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb925a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 0x7fb92014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb925a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9200af5f0 0x7fb9201f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb925a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92015c2e0 0x7fb9201f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb925a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb92016a000 con 0x7fb92006c320 2024-09-12T12:13:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb925a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb920169e80 con 0x7fb9200af5f0 2024-09-12T12:13:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb925a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb92016a180 con 0x7fb92015c2e0 2024-09-12T12:13:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 0x7fb92014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 0x7fb92014d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52342/0 (socket says 172.21.15.144:52342) 2024-09-12T12:13:03.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91ea00640 1 -- 172.21.15.144:0/3366235283 learned_addr learned my addr 172.21.15.144:0/3366235283 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:03.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91f400640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92015c2e0 0x7fb9201f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91e000640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9200af5f0 0x7fb9201f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91ea00640 1 -- 172.21.15.144:0/3366235283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92015c2e0 msgr2=0x7fb9201f8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91ea00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92015c2e0 0x7fb9201f8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91ea00640 1 -- 172.21.15.144:0/3366235283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9200af5f0 msgr2=0x7fb9201f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:03.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91ea00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9200af5f0 0x7fb9201f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:03.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91ea00640 1 -- 172.21.15.144:0/3366235283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb920158f80 con 0x7fb92006c320 2024-09-12T12:13:03.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb91ea00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 0x7fb92014d510 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb91000c7d0 tx=0x7fb91000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:03.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb916a00640 1 -- 172.21.15.144:0/3366235283 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910003b80 con 0x7fb92006c320 2024-09-12T12:13:03.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb916a00640 1 -- 172.21.15.144:0/3366235283 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb910003d20 con 0x7fb92006c320 2024-09-12T12:13:03.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb916a00640 1 -- 172.21.15.144:0/3366235283 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91000aa90 con 0x7fb92006c320 2024-09-12T12:13:03.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb920159260 con 0x7fb92006c320 2024-09-12T12:13:03.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb920159820 con 0x7fb92006c320 2024-09-12T12:13:03.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92006bc10 con 0x7fb92006c320 2024-09-12T12:13:03.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.961+0000 7fb916a00640 1 -- 172.21.15.144:0/3366235283 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb91000ac30 con 0x7fb92006c320 2024-09-12T12:13:03.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.965+0000 7fb916a00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9000678c0 0x7fb900069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:03.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.965+0000 7fb916a00640 1 -- 172.21.15.144:0/3366235283 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb910085f40 con 0x7fb92006c320 2024-09-12T12:13:03.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.965+0000 7fb91e000640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9000678c0 0x7fb900069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:03.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.965+0000 7fb91e000640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9000678c0 0x7fb900069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb92014e290 tx=0x7fb90c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:03.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:03.969+0000 7fb916a00640 1 -- 172.21.15.144:0/3366235283 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb9100566a0 con 0x7fb92006c320 2024-09-12T12:13:04.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.157+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb92015b150 con 0x7fb92006c320 2024-09-12T12:13:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.433+0000 7fb916a00640 1 -- 172.21.15.144:0/3366235283 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fb910055fa0 con 0x7fb92006c320 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9000678c0 msgr2=0x7fb900069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9000678c0 0x7fb900069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb92014e290 tx=0x7fb90c009040 comp rx=0 tx=0).stop 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 msgr2=0x7fb92014d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 0x7fb92014d510 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb91000c7d0 tx=0x7fb91000cc90 comp rx=0 tx=0).stop 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 shutdown_connections 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9000678c0 0x7fb900069d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92015c2e0 0x7fb9201f8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9200af5f0 0x7fb9201f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 --2- 172.21.15.144:0/3366235283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92006c320 0x7fb92014d510 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 >> 172.21.15.144:0/3366235283 conn(0x7fb920068030 msgr2=0x7fb9200cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 shutdown_connections 2024-09-12T12:13:04.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.437+0000 7fb925a00640 1 -- 172.21.15.144:0/3366235283 wait complete. 2024-09-12T12:13:04.460 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-12T12:13:04.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:13:04.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6708600640 1 Processor -- start 2024-09-12T12:13:04.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6708600640 1 -- start start 2024-09-12T12:13:04.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6708600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:04.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6708600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f670015c790 0x7f67000d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:04.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6708600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f670015cd10 con 0x7f670015c3b0 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6708600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f670015d640 con 0x7f670015c790 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6708600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f670015cff0 con 0x7f6700160bf0 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6705c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f670015c3b0 0x7f6700073b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60502/0 (socket says 172.21.15.144:60502) 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6705c00640 1 -- 172.21.15.144:0/2923567724 learned_addr learned my addr 172.21.15.144:0/2923567724 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6706600640 1 --2- 172.21.15.144:0/2923567724 >> v2:172.21.15.144:3300/0 conn(0x7f670015c790 0x7f67000d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6705200640 1 --2- 172.21.15.144:0/2923567724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f66ffe00640 1 -- 172.21.15.144:0/2923567724 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350155170 0 0) 0x7f670015cd10 con 0x7f670015c3b0 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f66ffe00640 1 -- 172.21.15.144:0/2923567724 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e8003530 con 0x7f670015c3b0 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6706600640 1 -- 172.21.15.144:0/2923567724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 msgr2=0x7f67000d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6706600640 1 --2- 172.21.15.144:0/2923567724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6706600640 1 -- 172.21.15.144:0/2923567724 >> v1:172.21.15.144:6789/0 conn(0x7f670015c3b0 legacy=0x7f6700073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:04.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6706600640 1 -- 172.21.15.144:0/2923567724 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670015d2d0 con 0x7f670015c790 2024-09-12T12:13:04.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.597+0000 7f6705200640 1 --2- 172.21.15.144:0/2923567724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:04.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f6706600640 1 --2- 172.21.15.144:0/2923567724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 0x7f67000d2960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009d90 tx=0x7f66f801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8495cfdefce395b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:04.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f66ffe00640 1 -- 172.21.15.144:0/2923567724 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f80b2070 con 0x7f670015c790 2024-09-12T12:13:04.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f66ffe00640 1 -- 172.21.15.144:0/2923567724 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f80a5940 con 0x7f670015c790 2024-09-12T12:13:04.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f66ffe00640 1 -- 172.21.15.144:0/2923567724 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f80a5cf0 con 0x7f670015c790 2024-09-12T12:13:04.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f6708600640 1 -- 172.21.15.144:0/2923567724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 msgr2=0x7f67000d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:04.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f6708600640 1 --2- 172.21.15.144:0/2923567724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 0x7f67000d2960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009d90 tx=0x7f66f801c970 comp rx=0 tx=0).stop 2024-09-12T12:13:04.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f6708600640 1 -- 172.21.15.144:0/2923567724 shutdown_connections 2024-09-12T12:13:04.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f6708600640 1 --2- 172.21.15.144:0/2923567724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 0x7f67000d2960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:04.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f6708600640 1 --2- 172.21.15.144:0/2923567724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:04.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f6708600640 1 -- 172.21.15.144:0/2923567724 >> 172.21.15.144:0/2923567724 conn(0x7f670006c010 msgr2=0x7f6700067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:04.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f6708600640 1 -- 172.21.15.144:0/2923567724 shutdown_connections 2024-09-12T12:13:04.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.601+0000 7f6708600640 1 -- 172.21.15.144:0/2923567724 wait complete. 2024-09-12T12:13:04.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 Processor -- start 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 -- start start 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f670015c3b0 0x7f670015ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 0x7f67000c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f67000d0e50 con 0x7f670015c790 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f67000d0cd0 con 0x7f670015c3b0 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f67000d0fd0 con 0x7f6700160bf0 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 0x7f67000c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 0x7f67000c9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52358/0 (socket says 172.21.15.144:52358) 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705200640 1 -- 172.21.15.144:0/2090559356 learned_addr learned my addr 172.21.15.144:0/2090559356 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6706600640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705c00640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f670015c3b0 0x7f670015ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:04.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705200640 1 -- 172.21.15.144:0/2090559356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 msgr2=0x7f67000b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705200640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705200640 1 -- 172.21.15.144:0/2090559356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f670015c3b0 msgr2=0x7f670015ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705200640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f670015c3b0 0x7f670015ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705200640 1 -- 172.21.15.144:0/2090559356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67000cd8f0 con 0x7f670015c790 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6706600640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6705200640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 0x7f67000c9ea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00e930 tx=0x7f66ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f66fd600640 1 -- 172.21.15.144:0/2090559356 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec017070 con 0x7f670015c790 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f66fd600640 1 -- 172.21.15.144:0/2090559356 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ec00ca00 con 0x7f670015c790 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f66fd600640 1 -- 172.21.15.144:0/2090559356 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00cdd0 con 0x7f670015c790 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67000cdbd0 con 0x7f670015c790 2024-09-12T12:13:04.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.605+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67000ce190 con 0x7f670015c790 2024-09-12T12:13:04.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.609+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670015cd10 con 0x7f670015c790 2024-09-12T12:13:04.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.609+0000 7f66fd600640 1 -- 172.21.15.144:0/2090559356 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66ec01a070 con 0x7f670015c790 2024-09-12T12:13:04.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.609+0000 7f66fd600640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f66e00678c0 0x7f66e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:04.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.609+0000 7f66fd600640 1 -- 172.21.15.144:0/2090559356 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f66ec085e40 con 0x7f670015c790 2024-09-12T12:13:04.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.609+0000 7f6705c00640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f66e00678c0 0x7f66e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:04.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.609+0000 7f6705c00640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f66e00678c0 0x7f66e0069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66f4007fd0 tx=0x7f66f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:04.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.613+0000 7f66fd600640 1 -- 172.21.15.144:0/2090559356 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f66ec055fe0 con 0x7f670015c790 2024-09-12T12:13:04.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:04.805+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f67000b67a0 con 0x7f670015c790 2024-09-12T12:13:05.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.445+0000 7f66fd600640 1 -- 172.21.15.144:0/2090559356 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f66ec05a2e0 con 0x7f670015c790 2024-09-12T12:13:05.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f66e00678c0 msgr2=0x7f66e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f66e00678c0 0x7f66e0069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66f4007fd0 tx=0x7f66f4009040 comp rx=0 tx=0).stop 2024-09-12T12:13:05.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 msgr2=0x7f67000c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 0x7f67000c9ea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00e930 tx=0x7f66ec00edf0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 shutdown_connections 2024-09-12T12:13:05.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f66e00678c0 0x7f66e0069d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6700160bf0 0x7f67000b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f670015c790 0x7f67000c9ea0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 --2- 172.21.15.144:0/2090559356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f670015c3b0 0x7f670015ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 >> 172.21.15.144:0/2090559356 conn(0x7f670006c010 msgr2=0x7f670015ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:05.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 shutdown_connections 2024-09-12T12:13:05.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.449+0000 7f6708600640 1 -- 172.21.15.144:0/2090559356 wait complete. 2024-09-12T12:13:05.470 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:13:05.470 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:05.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.601+0000 7faa7a800640 1 Processor -- start 2024-09-12T12:13:05.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa7a800640 1 -- start start 2024-09-12T12:13:05.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa7a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa7415e5f0 0x7faa7406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa7a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faa740b44a0 0x7faa740b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa7a800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa7406d260 con 0x7faa7406e300 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa7a800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faa740b6f60 con 0x7faa740b44a0 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa7a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faa740b7240 con 0x7faa7415e5f0 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa72a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faa740b44a0 0x7faa740b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa72a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faa740b44a0 0x7faa740b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52374/0 (socket says 172.21.15.144:52374) 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa72a00640 1 -- 172.21.15.144:0/457325487 learned_addr learned my addr 172.21.15.144:0/457325487 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa73400640 1 --2- 172.21.15.144:0/457325487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa7415e5f0 0x7faa7406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa72a00640 1 -- 172.21.15.144:0/457325487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa7415e5f0 msgr2=0x7faa7406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa72a00640 1 --2- 172.21.15.144:0/457325487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa7415e5f0 0x7faa7406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa72a00640 1 -- 172.21.15.144:0/457325487 >> v1:172.21.15.144:6789/0 conn(0x7faa7406e300 legacy=0x7faa7415ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa72a00640 1 -- 172.21.15.144:0/457325487 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740b7520 con 0x7faa740b44a0 2024-09-12T12:13:05.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.605+0000 7faa73400640 1 --2- 172.21.15.144:0/457325487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa7415e5f0 0x7faa7406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:05.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa72a00640 1 --2- 172.21.15.144:0/457325487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740b44a0 0x7faa740b48a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faa60009870 tx=0x7faa6001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd126194cf42e753 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:05.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa72000640 1 -- 172.21.15.144:0/457325487 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600aa670 con 0x7faa740b44a0 2024-09-12T12:13:05.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa72000640 1 -- 172.21.15.144:0/457325487 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa600af070 con 0x7faa740b44a0 2024-09-12T12:13:05.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa72000640 1 -- 172.21.15.144:0/457325487 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600aaa30 con 0x7faa740b44a0 2024-09-12T12:13:05.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 -- 172.21.15.144:0/457325487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740b44a0 msgr2=0x7faa740b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 --2- 172.21.15.144:0/457325487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740b44a0 0x7faa740b48a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faa60009870 tx=0x7faa6001c530 comp rx=0 tx=0).stop 2024-09-12T12:13:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 -- 172.21.15.144:0/457325487 shutdown_connections 2024-09-12T12:13:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 --2- 172.21.15.144:0/457325487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa740b44a0 0x7faa740b48a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 --2- 172.21.15.144:0/457325487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa7415e5f0 0x7faa7406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 -- 172.21.15.144:0/457325487 >> 172.21.15.144:0/457325487 conn(0x7faa7406f400 msgr2=0x7faa7406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 -- 172.21.15.144:0/457325487 shutdown_connections 2024-09-12T12:13:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 -- 172.21.15.144:0/457325487 wait complete. 2024-09-12T12:13:05.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 Processor -- start 2024-09-12T12:13:05.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.609+0000 7faa7a800640 1 -- start start 2024-09-12T12:13:05.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa7a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa7406e300 0x7faa74150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa7a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa740b44a0 0x7faa741f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa7a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7415e5f0 0x7faa741520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa7a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa7406eb20 con 0x7faa7415e5f0 2024-09-12T12:13:05.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa7a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faa740b6b90 con 0x7faa7406e300 2024-09-12T12:13:05.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa7a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faa7414e4c0 con 0x7faa740b44a0 2024-09-12T12:13:05.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7415e5f0 0x7faa741520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7415e5f0 0x7faa741520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52390/0 (socket says 172.21.15.144:52390) 2024-09-12T12:13:05.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73e00640 1 -- 172.21.15.144:0/374969692 learned_addr learned my addr 172.21.15.144:0/374969692 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:05.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73400640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa7406e300 0x7faa74150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa72a00640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa740b44a0 0x7faa741f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73e00640 1 -- 172.21.15.144:0/374969692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa740b44a0 msgr2=0x7faa741f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73e00640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa740b44a0 0x7faa741f7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73e00640 1 -- 172.21.15.144:0/374969692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa7406e300 msgr2=0x7faa74150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73e00640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa7406e300 0x7faa74150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73e00640 1 -- 172.21.15.144:0/374969692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7414d8b0 con 0x7faa7415e5f0 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa73e00640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7415e5f0 0x7faa741520f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00c430 tx=0x7faa6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa6b400640 1 -- 172.21.15.144:0/374969692 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c005220 con 0x7faa7415e5f0 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa6b400640 1 -- 172.21.15.144:0/374969692 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c0053c0 con 0x7faa7415e5f0 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa6b400640 1 -- 172.21.15.144:0/374969692 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c007270 con 0x7faa7415e5f0 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7414db90 con 0x7faa7415e5f0 2024-09-12T12:13:05.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7414e150 con 0x7faa7415e5f0 2024-09-12T12:13:05.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.613+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa7406cd20 con 0x7faa7415e5f0 2024-09-12T12:13:05.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.617+0000 7faa6b400640 1 -- 172.21.15.144:0/374969692 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa6c019020 con 0x7faa7415e5f0 2024-09-12T12:13:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.617+0000 7faa6b400640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa540678f0 0x7faa54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.617+0000 7faa6b400640 1 -- 172.21.15.144:0/374969692 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faa6c085100 con 0x7faa7415e5f0 2024-09-12T12:13:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.617+0000 7faa73400640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa540678f0 0x7faa54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.617+0000 7faa73400640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa540678f0 0x7faa54069db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa64009fd0 tx=0x7faa640097f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:05.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.621+0000 7faa6b400640 1 -- 172.21.15.144:0/374969692 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faa6c055210 con 0x7faa7415e5f0 2024-09-12T12:13:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.809+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa7415f1a0 con 0x7faa7415e5f0 2024-09-12T12:13:05.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.809+0000 7faa6b400640 1 -- 172.21.15.144:0/374969692 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5228 (secure 0 0 0) 0x7faa6c059510 con 0x7faa7415e5f0 2024-09-12T12:13:05.812 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:05.812 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-12T12:13:05:442423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:13:04.808385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:13:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-12T12:13:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa540678f0 msgr2=0x7faa54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa540678f0 0x7faa54069db0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa64009fd0 tx=0x7faa640097f0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7415e5f0 msgr2=0x7faa741520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7415e5f0 0x7faa741520f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00c430 tx=0x7faa6c00c8f0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 shutdown_connections 2024-09-12T12:13:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa540678f0 0x7faa54069db0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7415e5f0 0x7faa741520f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa740b44a0 0x7faa741f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 --2- 172.21.15.144:0/374969692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa7406e300 0x7faa74150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 >> 172.21.15.144:0/374969692 conn(0x7faa7406f400 msgr2=0x7faa74158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 shutdown_connections 2024-09-12T12:13:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.813+0000 7faa7a800640 1 -- 172.21.15.144:0/374969692 wait complete. 2024-09-12T12:13:05.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42ab200640 1 Processor -- start 2024-09-12T12:13:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42ab200640 1 -- start start 2024-09-12T12:13:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42ab200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42a415ffe0 0x7f42a4160420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42ab200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a40d2310 0x7f42a40d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42ab200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a40741c0 con 0x7f42a415c580 2024-09-12T12:13:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42ab200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f42a415c960 con 0x7f42a415ffe0 2024-09-12T12:13:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42ab200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42a40b5bc0 con 0x7f42a40d2310 2024-09-12T12:13:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42a3e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f42a415c580 0x7f42a40b6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:60912/0 (socket says 172.21.15.144:60912) 2024-09-12T12:13:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42a3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42a415ffe0 0x7f42a4160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42a3e00640 1 -- 172.21.15.144:0/538481055 learned_addr learned my addr 172.21.15.144:0/538481055 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42a9200640 1 --2- 172.21.15.144:0/538481055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a40d2310 0x7f42a40d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42a3400640 1 -- 172.21.15.144:0/538481055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a40d2310 msgr2=0x7f42a40d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42a3400640 1 --2- 172.21.15.144:0/538481055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a40d2310 0x7f42a40d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42a2a00640 1 -- 172.21.15.144:0/538481055 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587696472 0 0) 0x7f42a40741c0 con 0x7f42a415c580 2024-09-12T12:13:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42a3400640 1 -- 172.21.15.144:0/538481055 >> v1:172.21.15.165:6789/0 conn(0x7f42a415c580 legacy=0x7f42a40b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.969+0000 7f42a3400640 1 -- 172.21.15.144:0/538481055 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a40b6760 con 0x7f42a415ffe0 2024-09-12T12:13:05.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42a3400640 1 --2- 172.21.15.144:0/538481055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415ffe0 0x7f42a4160420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f42900097c0 tx=0x7f429001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e09727e0479f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42a2a00640 1 -- 172.21.15.144:0/538481055 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900b0070 con 0x7f42a415ffe0 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42a2a00640 1 -- 172.21.15.144:0/538481055 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42900ab600 con 0x7f42a415ffe0 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42a2a00640 1 -- 172.21.15.144:0/538481055 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42900ab9d0 con 0x7f42a415ffe0 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42ab200640 1 -- 172.21.15.144:0/538481055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415ffe0 msgr2=0x7f42a4160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42ab200640 1 --2- 172.21.15.144:0/538481055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415ffe0 0x7f42a4160420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f42900097c0 tx=0x7f429001c410 comp rx=0 tx=0).stop 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42ab200640 1 -- 172.21.15.144:0/538481055 shutdown_connections 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42ab200640 1 --2- 172.21.15.144:0/538481055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a40d2310 0x7f42a40d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42ab200640 1 --2- 172.21.15.144:0/538481055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a415ffe0 0x7f42a4160420 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42ab200640 1 -- 172.21.15.144:0/538481055 >> 172.21.15.144:0/538481055 conn(0x7f42a4067a00 msgr2=0x7f42a4067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42ab200640 1 -- 172.21.15.144:0/538481055 shutdown_connections 2024-09-12T12:13:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.973+0000 7f42ab200640 1 -- 172.21.15.144:0/538481055 wait complete. 2024-09-12T12:13:05.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 Processor -- start 2024-09-12T12:13:05.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 -- start start 2024-09-12T12:13:05.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a40d2310 0x7f42a40b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42a415c580 0x7f42a4153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a415ffe0 0x7f42a414ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42a40d0920 con 0x7f42a40d2310 2024-09-12T12:13:05.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4160e30 con 0x7f42a415c580 2024-09-12T12:13:05.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42a40d0aa0 con 0x7f42a415ffe0 2024-09-12T12:13:05.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a40d2310 0x7f42a40b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a40d2310 0x7f42a40b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52408/0 (socket says 172.21.15.144:52408) 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3e00640 1 -- 172.21.15.144:0/1878053765 learned_addr learned my addr 172.21.15.144:0/1878053765 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3400640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42a415c580 0x7f42a4153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a9200640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a415ffe0 0x7f42a414ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3e00640 1 -- 172.21.15.144:0/1878053765 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a415ffe0 msgr2=0x7f42a414ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3e00640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a415ffe0 0x7f42a414ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3e00640 1 -- 172.21.15.144:0/1878053765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42a415c580 msgr2=0x7f42a4153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3e00640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42a415c580 0x7f42a4153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3e00640 1 -- 172.21.15.144:0/1878053765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a415e5a0 con 0x7f42a40d2310 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a9200640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a415ffe0 0x7f42a414ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42a3e00640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a40d2310 0x7f42a40b3510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f42940011f0 tx=0x7f429400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f429be00640 1 -- 172.21.15.144:0/1878053765 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294018070 con 0x7f42a40d2310 2024-09-12T12:13:05.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f429be00640 1 -- 172.21.15.144:0/1878053765 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42940074e0 con 0x7f42a40d2310 2024-09-12T12:13:05.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a415eb60 con 0x7f42a40d2310 2024-09-12T12:13:05.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f429be00640 1 -- 172.21.15.144:0/1878053765 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294004a10 con 0x7f42a40d2310 2024-09-12T12:13:05.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a415f120 con 0x7f42a40d2310 2024-09-12T12:13:05.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.977+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a40d2740 con 0x7f42a40d2310 2024-09-12T12:13:05.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.981+0000 7f429be00640 1 -- 172.21.15.144:0/1878053765 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4294004bb0 con 0x7f42a40d2310 2024-09-12T12:13:05.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.981+0000 7f429be00640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42840678c0 0x7f4284069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:05.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.981+0000 7f429be00640 1 -- 172.21.15.144:0/1878053765 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4294085310 con 0x7f42a40d2310 2024-09-12T12:13:05.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.981+0000 7f42a3400640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42840678c0 0x7f4284069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.981+0000 7f42a3400640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42840678c0 0x7f4284069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42900ad000 tx=0x7f4290008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:05.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:05.985+0000 7f429be00640 1 -- 172.21.15.144:0/1878053765 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42940554c0 con 0x7f42a40d2310 2024-09-12T12:13:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.145+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42a4073900 con 0x7f42a40d2310 2024-09-12T12:13:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.145+0000 7f429be00640 1 -- 172.21.15.144:0/1878053765 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f42940597c0 con 0x7f42a40d2310 2024-09-12T12:13:06.147 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:06.147 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42840678c0 msgr2=0x7f4284069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42840678c0 0x7f4284069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42900ad000 tx=0x7f4290008040 comp rx=0 tx=0).stop 2024-09-12T12:13:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a40d2310 msgr2=0x7f42a40b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a40d2310 0x7f42a40b3510 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f42940011f0 tx=0x7f429400c9b0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 shutdown_connections 2024-09-12T12:13:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42840678c0 0x7f4284069d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42a415ffe0 0x7f42a414ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42a415c580 0x7f42a4153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 --2- 172.21.15.144:0/1878053765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42a40d2310 0x7f42a40b3510 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 >> 172.21.15.144:0/1878053765 conn(0x7f42a4067a00 msgr2=0x7f42a406d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 shutdown_connections 2024-09-12T12:13:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.149+0000 7f42ab200640 1 -- 172.21.15.144:0/1878053765 wait complete. 2024-09-12T12:13:06.170 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:13:06.170 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:13:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44b1a00640 1 Processor -- start 2024-09-12T12:13:06.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44b1a00640 1 -- start start 2024-09-12T12:13:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44b1a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f44ac0b44a0 0x7f44ac0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44b1a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac06e300 0x7f44ac06e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44b1a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44ac0b6f60 con 0x7f44ac15e5f0 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44b1a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f44ac06ec90 con 0x7f44ac0b44a0 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44b1a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44ac0b7240 con 0x7f44ac06e300 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44aa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f44ac0b44a0 0x7f44ac0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44aa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f44ac0b44a0 0x7f44ac0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52414/0 (socket says 172.21.15.144:52414) 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44aa000640 1 -- 172.21.15.144:0/4181290259 learned_addr learned my addr 172.21.15.144:0/4181290259 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44ab400640 1 --2- 172.21.15.144:0/4181290259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac06e300 0x7f44ac06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44aa000640 1 -- 172.21.15.144:0/4181290259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac06e300 msgr2=0x7f44ac06e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44aa000640 1 --2- 172.21.15.144:0/4181290259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac06e300 0x7f44ac06e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44aa000640 1 -- 172.21.15.144:0/4181290259 >> v1:172.21.15.144:6789/0 conn(0x7f44ac15e5f0 legacy=0x7f44ac06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44aa000640 1 -- 172.21.15.144:0/4181290259 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ac0b7520 con 0x7f44ac0b44a0 2024-09-12T12:13:06.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.305+0000 7f44ab400640 1 --2- 172.21.15.144:0/4181290259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac06e300 0x7f44ac06e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:06.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44aa000640 1 --2- 172.21.15.144:0/4181290259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac0b44a0 0x7f44ac0b48d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4498009870 tx=0x7f449801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a399a0fde7ccf6c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:06.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44a9600640 1 -- 172.21.15.144:0/4181290259 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44980a9610 con 0x7f44ac0b44a0 2024-09-12T12:13:06.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44a9600640 1 -- 172.21.15.144:0/4181290259 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44980a97b0 con 0x7f44ac0b44a0 2024-09-12T12:13:06.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44a9600640 1 -- 172.21.15.144:0/4181290259 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44980a9b80 con 0x7f44ac0b44a0 2024-09-12T12:13:06.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44b1a00640 1 -- 172.21.15.144:0/4181290259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac0b44a0 msgr2=0x7f44ac0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44b1a00640 1 --2- 172.21.15.144:0/4181290259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac0b44a0 0x7f44ac0b48d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4498009870 tx=0x7f449801c530 comp rx=0 tx=0).stop 2024-09-12T12:13:06.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44b1a00640 1 -- 172.21.15.144:0/4181290259 shutdown_connections 2024-09-12T12:13:06.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44b1a00640 1 --2- 172.21.15.144:0/4181290259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac06e300 0x7f44ac06e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44b1a00640 1 --2- 172.21.15.144:0/4181290259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac0b44a0 0x7f44ac0b48d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44b1a00640 1 -- 172.21.15.144:0/4181290259 >> 172.21.15.144:0/4181290259 conn(0x7f44ac06f400 msgr2=0x7f44ac06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:06.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44b1a00640 1 -- 172.21.15.144:0/4181290259 shutdown_connections 2024-09-12T12:13:06.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.309+0000 7f44b1a00640 1 -- 172.21.15.144:0/4181290259 wait complete. 2024-09-12T12:13:06.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 Processor -- start 2024-09-12T12:13:06.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 -- start start 2024-09-12T12:13:06.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac06e300 0x7f44ac1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44ac0b44a0 0x7f44ac14ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac15e5f0 0x7f44ac14b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac15f880 con 0x7f44ac06e300 2024-09-12T12:13:06.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f44ac15f700 con 0x7f44ac0b44a0 2024-09-12T12:13:06.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44ac15fa00 con 0x7f44ac15e5f0 2024-09-12T12:13:06.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac06e300 0x7f44ac1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac06e300 0x7f44ac1525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52418/0 (socket says 172.21.15.144:52418) 2024-09-12T12:13:06.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aaa00640 1 -- 172.21.15.144:0/2165885647 learned_addr learned my addr 172.21.15.144:0/2165885647 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44ab400640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac15e5f0 0x7f44ac14b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aa000640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44ac0b44a0 0x7f44ac14ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aaa00640 1 -- 172.21.15.144:0/2165885647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac15e5f0 msgr2=0x7f44ac14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aaa00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac15e5f0 0x7f44ac14b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aaa00640 1 -- 172.21.15.144:0/2165885647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44ac0b44a0 msgr2=0x7f44ac14ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aaa00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44ac0b44a0 0x7f44ac14ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aaa00640 1 -- 172.21.15.144:0/2165885647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ac15d810 con 0x7f44ac06e300 2024-09-12T12:13:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aa000640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44ac0b44a0 0x7f44ac14ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44aaa00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac06e300 0x7f44ac1525c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f449c00c760 tx=0x7f449c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:06.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44a2a00640 1 -- 172.21.15.144:0/2165885647 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c016020 con 0x7f44ac06e300 2024-09-12T12:13:06.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44a2a00640 1 -- 172.21.15.144:0/2165885647 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f449c006d60 con 0x7f44ac06e300 2024-09-12T12:13:06.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44a2a00640 1 -- 172.21.15.144:0/2165885647 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c003bc0 con 0x7f44ac06e300 2024-09-12T12:13:06.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44ac15a940 con 0x7f44ac06e300 2024-09-12T12:13:06.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44ac15abe0 con 0x7f44ac06e300 2024-09-12T12:13:06.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.313+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44ac06e750 con 0x7f44ac06e300 2024-09-12T12:13:06.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.317+0000 7f44a2a00640 1 -- 172.21.15.144:0/2165885647 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f449c00a850 con 0x7f44ac06e300 2024-09-12T12:13:06.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.317+0000 7f44a2a00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f448c0678c0 0x7f448c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.317+0000 7f44a2a00640 1 -- 172.21.15.144:0/2165885647 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f449c085cb0 con 0x7f44ac06e300 2024-09-12T12:13:06.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.317+0000 7f44aa000640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f448c0678c0 0x7f448c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.317+0000 7f44aa000640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f448c0678c0 0x7f448c069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44980ae000 tx=0x7f44980b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:06.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.321+0000 7f44a2a00640 1 -- 172.21.15.144:0/2165885647 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f449c020020 con 0x7f44ac06e300 2024-09-12T12:13:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.477+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44ac14eb90 con 0x7f448c0678c0 2024-09-12T12:13:06.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.489+0000 7f44a2a00640 1 -- 172.21.15.144:0/2165885647 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f44ac14eb90 con 0x7f448c0678c0 2024-09-12T12:13:06.491 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:06.495 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:13:06.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f448c0678c0 msgr2=0x7f448c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f448c0678c0 0x7f448c069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44980ae000 tx=0x7f44980b3040 comp rx=0 tx=0).stop 2024-09-12T12:13:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac06e300 msgr2=0x7f44ac1525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac06e300 0x7f44ac1525c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f449c00c760 tx=0x7f449c00cc20 comp rx=0 tx=0).stop 2024-09-12T12:13:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 shutdown_connections 2024-09-12T12:13:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f448c0678c0 0x7f448c069d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44ac15e5f0 0x7f44ac14b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44ac0b44a0 0x7f44ac14ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 --2- 172.21.15.144:0/2165885647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44ac06e300 0x7f44ac1525c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 >> 172.21.15.144:0/2165885647 conn(0x7f44ac06f400 msgr2=0x7f44ac06dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:06.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 shutdown_connections 2024-09-12T12:13:06.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.493+0000 7f44b1a00640 1 -- 172.21.15.144:0/2165885647 wait complete. 2024-09-12T12:13:06.514 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-12T12:13:05.380072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3383296,"data_stored":2029436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003361"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513364+0000","last_change":"2024-09-12T12:12:43.854827+0000","last_active":"2024-09-12T12:12:50.513364+0000","last_peered":"2024-09-12T12:12:50.513364+0000","last_clean":"2024-09-12T12:12:50.513364+0000","last_became_active":"2024-09-12T12:12:43.854234+0000","last_became_peered":"2024-09-12T12:12:43.854234+0000","last_unstale":"2024-09-12T12:12:50.513364+0000","last_undegraded":"2024-09-12T12:12:50.513364+0000","last_fullsized":"2024-09-12T12:12:50.513364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.059875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177273+0000","last_change":"2024-09-12T12:12:44.850415+0000","last_active":"2024-09-12T12:12:50.177273+0000","last_peered":"2024-09-12T12:12:50.177273+0000","last_clean":"2024-09-12T12:12:50.177273+0000","last_became_active":"2024-09-12T12:12:44.849823+0000","last_became_peered":"2024-09-12T12:12:44.849823+0000","last_unstale":"2024-09-12T12:12:50.177273+0000","last_undegraded":"2024-09-12T12:12:50.177273+0000","last_fullsized":"2024-09-12T12:12:50.177273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176576+0000","last_change":"2024-09-12T12:12:49.236999+0000","last_active":"2024-09-12T12:12:50.176576+0000","last_peered":"2024-09-12T12:12:50.176576+0000","last_clean":"2024-09-12T12:12:50.176576+0000","last_became_active":"2024-09-12T12:12:49.236615+0000","last_became_peered":"2024-09-12T12:12:49.236615+0000","last_unstale":"2024-09-12T12:12:50.176576+0000","last_undegraded":"2024-09-12T12:12:50.176576+0000","last_fullsized":"2024-09-12T12:12:50.176576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.973179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177466+0000","last_change":"2024-09-12T12:12:43.838111+0000","last_active":"2024-09-12T12:12:50.177466+0000","last_peered":"2024-09-12T12:12:50.177466+0000","last_clean":"2024-09-12T12:12:50.177466+0000","last_became_active":"2024-09-12T12:12:43.837789+0000","last_became_peered":"2024-09-12T12:12:43.837789+0000","last_unstale":"2024-09-12T12:12:50.177466+0000","last_undegraded":"2024-09-12T12:12:50.177466+0000","last_fullsized":"2024-09-12T12:12:50.177466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:35.915450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513110+0000","last_change":"2024-09-12T12:12:44.866423+0000","last_active":"2024-09-12T12:12:50.513110+0000","last_peered":"2024-09-12T12:12:50.513110+0000","last_clean":"2024-09-12T12:12:50.513110+0000","last_became_active":"2024-09-12T12:12:44.866168+0000","last_became_peered":"2024-09-12T12:12:44.866168+0000","last_unstale":"2024-09-12T12:12:50.513110+0000","last_undegraded":"2024-09-12T12:12:50.513110+0000","last_fullsized":"2024-09-12T12:12:50.513110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177230+0000","last_change":"2024-09-12T12:12:49.204118+0000","last_active":"2024-09-12T12:12:50.177230+0000","last_peered":"2024-09-12T12:12:50.177230+0000","last_clean":"2024-09-12T12:12:50.177230+0000","last_became_active":"2024-09-12T12:12:49.203691+0000","last_became_peered":"2024-09-12T12:12:49.203691+0000","last_unstale":"2024-09-12T12:12:50.177230+0000","last_undegraded":"2024-09-12T12:12:50.177230+0000","last_fullsized":"2024-09-12T12:12:50.177230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:35.607283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517260+0000","last_change":"2024-09-12T12:12:43.858755+0000","last_active":"2024-09-12T12:12:50.517260+0000","last_peered":"2024-09-12T12:12:50.517260+0000","last_clean":"2024-09-12T12:12:50.517260+0000","last_became_active":"2024-09-12T12:12:43.858306+0000","last_became_peered":"2024-09-12T12:12:43.858306+0000","last_unstale":"2024-09-12T12:12:50.517260+0000","last_undegraded":"2024-09-12T12:12:50.517260+0000","last_fullsized":"2024-09-12T12:12:50.517260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664377+0000","last_change":"2024-09-12T12:12:44.868441+0000","last_active":"2024-09-12T12:12:50.664377+0000","last_peered":"2024-09-12T12:12:50.664377+0000","last_clean":"2024-09-12T12:12:50.664377+0000","last_became_active":"2024-09-12T12:12:44.866463+0000","last_became_peered":"2024-09-12T12:12:44.866463+0000","last_unstale":"2024-09-12T12:12:50.664377+0000","last_undegraded":"2024-09-12T12:12:50.664377+0000","last_fullsized":"2024-09-12T12:12:50.664377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177347+0000","last_change":"2024-09-12T12:12:49.196167+0000","last_active":"2024-09-12T12:12:50.177347+0000","last_peered":"2024-09-12T12:12:50.177347+0000","last_clean":"2024-09-12T12:12:50.177347+0000","last_became_active":"2024-09-12T12:12:49.195584+0000","last_became_peered":"2024-09-12T12:12:49.195584+0000","last_unstale":"2024-09-12T12:12:50.177347+0000","last_undegraded":"2024-09-12T12:12:50.177347+0000","last_fullsized":"2024-09-12T12:12:50.177347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:21.660305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516953+0000","last_change":"2024-09-12T12:12:43.858662+0000","last_active":"2024-09-12T12:12:50.516953+0000","last_peered":"2024-09-12T12:12:50.516953+0000","last_clean":"2024-09-12T12:12:50.516953+0000","last_became_active":"2024-09-12T12:12:43.858322+0000","last_became_peered":"2024-09-12T12:12:43.858322+0000","last_unstale":"2024-09-12T12:12:50.516953+0000","last_undegraded":"2024-09-12T12:12:50.516953+0000","last_fullsized":"2024-09-12T12:12:50.516953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664591+0000","last_change":"2024-09-12T12:12:44.863427+0000","last_active":"2024-09-12T12:12:50.664591+0000","last_peered":"2024-09-12T12:12:50.664591+0000","last_clean":"2024-09-12T12:12:50.664591+0000","last_became_active":"2024-09-12T12:12:44.863173+0000","last_became_peered":"2024-09-12T12:12:44.863173+0000","last_unstale":"2024-09-12T12:12:50.664591+0000","last_undegraded":"2024-09-12T12:12:50.664591+0000","last_fullsized":"2024-09-12T12:12:50.664591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:15.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177891+0000","last_change":"2024-09-12T12:12:49.196228+0000","last_active":"2024-09-12T12:12:50.177891+0000","last_peered":"2024-09-12T12:12:50.177891+0000","last_clean":"2024-09-12T12:12:50.177891+0000","last_became_active":"2024-09-12T12:12:49.195611+0000","last_became_peered":"2024-09-12T12:12:49.195611+0000","last_unstale":"2024-09-12T12:12:50.177891+0000","last_undegraded":"2024-09-12T12:12:50.177891+0000","last_fullsized":"2024-09-12T12:12:50.177891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:48.359326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177371+0000","last_change":"2024-09-12T12:12:44.846595+0000","last_active":"2024-09-12T12:12:50.177371+0000","last_peered":"2024-09-12T12:12:50.177371+0000","last_clean":"2024-09-12T12:12:50.177371+0000","last_became_active":"2024-09-12T12:12:44.846334+0000","last_became_peered":"2024-09-12T12:12:44.846334+0000","last_unstale":"2024-09-12T12:12:50.177371+0000","last_undegraded":"2024-09-12T12:12:50.177371+0000","last_fullsized":"2024-09-12T12:12:50.177371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516972+0000","last_change":"2024-09-12T12:12:43.857695+0000","last_active":"2024-09-12T12:12:50.516972+0000","last_peered":"2024-09-12T12:12:50.516972+0000","last_clean":"2024-09-12T12:12:50.516972+0000","last_became_active":"2024-09-12T12:12:43.857427+0000","last_became_peered":"2024-09-12T12:12:43.857427+0000","last_unstale":"2024-09-12T12:12:50.516972+0000","last_undegraded":"2024-09-12T12:12:50.516972+0000","last_fullsized":"2024-09-12T12:12:50.516972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:35.915450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179125+0000","last_change":"2024-09-12T12:12:49.190846+0000","last_active":"2024-09-12T12:12:50.179125+0000","last_peered":"2024-09-12T12:12:50.179125+0000","last_clean":"2024-09-12T12:12:50.179125+0000","last_became_active":"2024-09-12T12:12:49.190417+0000","last_became_peered":"2024-09-12T12:12:49.190417+0000","last_unstale":"2024-09-12T12:12:50.179125+0000","last_undegraded":"2024-09-12T12:12:50.179125+0000","last_fullsized":"2024-09-12T12:12:50.179125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176911+0000","last_change":"2024-09-12T12:12:44.866244+0000","last_active":"2024-09-12T12:12:50.176911+0000","last_peered":"2024-09-12T12:12:50.176911+0000","last_clean":"2024-09-12T12:12:50.176911+0000","last_became_active":"2024-09-12T12:12:44.862336+0000","last_became_peered":"2024-09-12T12:12:44.862336+0000","last_unstale":"2024-09-12T12:12:50.176911+0000","last_undegraded":"2024-09-12T12:12:50.176911+0000","last_fullsized":"2024-09-12T12:12:50.176911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125510+0000","last_change":"2024-09-12T12:12:43.842526+0000","last_active":"2024-09-12T12:12:51.125510+0000","last_peered":"2024-09-12T12:12:51.125510+0000","last_clean":"2024-09-12T12:12:51.125510+0000","last_became_active":"2024-09-12T12:12:43.842238+0000","last_became_peered":"2024-09-12T12:12:43.842238+0000","last_unstale":"2024-09-12T12:12:51.125510+0000","last_undegraded":"2024-09-12T12:12:51.125510+0000","last_fullsized":"2024-09-12T12:12:51.125510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178671+0000","last_change":"2024-09-12T12:12:49.204542+0000","last_active":"2024-09-12T12:12:50.178671+0000","last_peered":"2024-09-12T12:12:50.178671+0000","last_clean":"2024-09-12T12:12:50.178671+0000","last_became_active":"2024-09-12T12:12:49.204013+0000","last_became_peered":"2024-09-12T12:12:49.204013+0000","last_unstale":"2024-09-12T12:12:50.178671+0000","last_undegraded":"2024-09-12T12:12:50.178671+0000","last_fullsized":"2024-09-12T12:12:50.178671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:36.758809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176780+0000","last_change":"2024-09-12T12:12:44.861505+0000","last_active":"2024-09-12T12:12:50.176780+0000","last_peered":"2024-09-12T12:12:50.176780+0000","last_clean":"2024-09-12T12:12:50.176780+0000","last_became_active":"2024-09-12T12:12:44.861217+0000","last_became_peered":"2024-09-12T12:12:44.861217+0000","last_unstale":"2024-09-12T12:12:50.176780+0000","last_undegraded":"2024-09-12T12:12:50.176780+0000","last_fullsized":"2024-09-12T12:12:50.176780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125097+0000","last_change":"2024-09-12T12:12:43.846034+0000","last_active":"2024-09-12T12:12:51.125097+0000","last_peered":"2024-09-12T12:12:51.125097+0000","last_clean":"2024-09-12T12:12:51.125097+0000","last_became_active":"2024-09-12T12:12:43.845492+0000","last_became_peered":"2024-09-12T12:12:43.845492+0000","last_unstale":"2024-09-12T12:12:51.125097+0000","last_undegraded":"2024-09-12T12:12:51.125097+0000","last_fullsized":"2024-09-12T12:12:51.125097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125970+0000","last_change":"2024-09-12T12:12:49.238233+0000","last_active":"2024-09-12T12:12:51.125970+0000","last_peered":"2024-09-12T12:12:51.125970+0000","last_clean":"2024-09-12T12:12:51.125970+0000","last_became_active":"2024-09-12T12:12:49.237705+0000","last_became_peered":"2024-09-12T12:12:49.237705+0000","last_unstale":"2024-09-12T12:12:51.125970+0000","last_undegraded":"2024-09-12T12:12:51.125970+0000","last_fullsized":"2024-09-12T12:12:51.125970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:21.360400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177834+0000","last_change":"2024-09-12T12:12:44.854329+0000","last_active":"2024-09-12T12:12:50.177834+0000","last_peered":"2024-09-12T12:12:50.177834+0000","last_clean":"2024-09-12T12:12:50.177834+0000","last_became_active":"2024-09-12T12:12:44.854125+0000","last_became_peered":"2024-09-12T12:12:44.854125+0000","last_unstale":"2024-09-12T12:12:50.177834+0000","last_undegraded":"2024-09-12T12:12:50.177834+0000","last_fullsized":"2024-09-12T12:12:50.177834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:09.458022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516448+0000","last_change":"2024-09-12T12:12:43.853652+0000","last_active":"2024-09-12T12:12:50.516448+0000","last_peered":"2024-09-12T12:12:50.516448+0000","last_clean":"2024-09-12T12:12:50.516448+0000","last_became_active":"2024-09-12T12:12:43.853375+0000","last_became_peered":"2024-09-12T12:12:43.853375+0000","last_unstale":"2024-09-12T12:12:50.516448+0000","last_undegraded":"2024-09-12T12:12:50.516448+0000","last_fullsized":"2024-09-12T12:12:50.516448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179414+0000","last_change":"2024-09-12T12:12:49.196067+0000","last_active":"2024-09-12T12:12:50.179414+0000","last_peered":"2024-09-12T12:12:50.179414+0000","last_clean":"2024-09-12T12:12:50.179414+0000","last_became_active":"2024-09-12T12:12:49.195668+0000","last_became_peered":"2024-09-12T12:12:49.195668+0000","last_unstale":"2024-09-12T12:12:50.179414+0000","last_undegraded":"2024-09-12T12:12:50.179414+0000","last_fullsized":"2024-09-12T12:12:50.179414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:40.014673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513018+0000","last_change":"2024-09-12T12:12:44.843136+0000","last_active":"2024-09-12T12:12:50.513018+0000","last_peered":"2024-09-12T12:12:50.513018+0000","last_clean":"2024-09-12T12:12:50.513018+0000","last_became_active":"2024-09-12T12:12:44.842828+0000","last_became_peered":"2024-09-12T12:12:44.842828+0000","last_unstale":"2024-09-12T12:12:50.513018+0000","last_undegraded":"2024-09-12T12:12:50.513018+0000","last_fullsized":"2024-09-12T12:12:50.513018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178520+0000","last_change":"2024-09-12T12:12:43.853992+0000","last_active":"2024-09-12T12:12:50.178520+0000","last_peered":"2024-09-12T12:12:50.178520+0000","last_clean":"2024-09-12T12:12:50.178520+0000","last_became_active":"2024-09-12T12:12:43.853565+0000","last_became_peered":"2024-09-12T12:12:43.853565+0000","last_unstale":"2024-09-12T12:12:50.178520+0000","last_undegraded":"2024-09-12T12:12:50.178520+0000","last_fullsized":"2024-09-12T12:12:50.178520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177496+0000","last_change":"2024-09-12T12:12:49.237840+0000","last_active":"2024-09-12T12:12:50.177496+0000","last_peered":"2024-09-12T12:12:50.177496+0000","last_clean":"2024-09-12T12:12:50.177496+0000","last_became_active":"2024-09-12T12:12:49.237366+0000","last_became_peered":"2024-09-12T12:12:49.237366+0000","last_unstale":"2024-09-12T12:12:50.177496+0000","last_undegraded":"2024-09-12T12:12:50.177496+0000","last_fullsized":"2024-09-12T12:12:50.177496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:32.420795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177705+0000","last_change":"2024-09-12T12:12:44.863064+0000","last_active":"2024-09-12T12:12:50.177705+0000","last_peered":"2024-09-12T12:12:50.177705+0000","last_clean":"2024-09-12T12:12:50.177705+0000","last_became_active":"2024-09-12T12:12:44.862295+0000","last_became_peered":"2024-09-12T12:12:44.862295+0000","last_unstale":"2024-09-12T12:12:50.177705+0000","last_undegraded":"2024-09-12T12:12:50.177705+0000","last_fullsized":"2024-09-12T12:12:50.177705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126177+0000","last_change":"2024-09-12T12:12:43.844539+0000","last_active":"2024-09-12T12:12:51.126177+0000","last_peered":"2024-09-12T12:12:51.126177+0000","last_clean":"2024-09-12T12:12:51.126177+0000","last_became_active":"2024-09-12T12:12:43.844303+0000","last_became_peered":"2024-09-12T12:12:43.844303+0000","last_unstale":"2024-09-12T12:12:51.126177+0000","last_undegraded":"2024-09-12T12:12:51.126177+0000","last_fullsized":"2024-09-12T12:12:51.126177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176517+0000","last_change":"2024-09-12T12:12:49.234495+0000","last_active":"2024-09-12T12:12:50.176517+0000","last_peered":"2024-09-12T12:12:50.176517+0000","last_clean":"2024-09-12T12:12:50.176517+0000","last_became_active":"2024-09-12T12:12:49.233400+0000","last_became_peered":"2024-09-12T12:12:49.233400+0000","last_unstale":"2024-09-12T12:12:50.176517+0000","last_undegraded":"2024-09-12T12:12:50.176517+0000","last_fullsized":"2024-09-12T12:12:50.176517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:09.355445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126175+0000","last_change":"2024-09-12T12:12:44.848284+0000","last_active":"2024-09-12T12:12:51.126175+0000","last_peered":"2024-09-12T12:12:51.126175+0000","last_clean":"2024-09-12T12:12:51.126175+0000","last_became_active":"2024-09-12T12:12:44.848024+0000","last_became_peered":"2024-09-12T12:12:44.848024+0000","last_unstale":"2024-09-12T12:12:51.126175+0000","last_undegraded":"2024-09-12T12:12:51.126175+0000","last_fullsized":"2024-09-12T12:12:51.126175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517386+0000","last_change":"2024-09-12T12:12:43.855069+0000","last_active":"2024-09-12T12:12:50.517386+0000","last_peered":"2024-09-12T12:12:50.517386+0000","last_clean":"2024-09-12T12:12:50.517386+0000","last_became_active":"2024-09-12T12:12:43.854801+0000","last_became_peered":"2024-09-12T12:12:43.854801+0000","last_unstale":"2024-09-12T12:12:50.517386+0000","last_undegraded":"2024-09-12T12:12:50.517386+0000","last_fullsized":"2024-09-12T12:12:50.517386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:10:14.539671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512594+0000","last_change":"2024-09-12T12:12:49.236330+0000","last_active":"2024-09-12T12:12:50.512594+0000","last_peered":"2024-09-12T12:12:50.512594+0000","last_clean":"2024-09-12T12:12:50.512594+0000","last_became_active":"2024-09-12T12:12:49.235941+0000","last_became_peered":"2024-09-12T12:12:49.235941+0000","last_unstale":"2024-09-12T12:12:50.512594+0000","last_undegraded":"2024-09-12T12:12:50.512594+0000","last_fullsized":"2024-09-12T12:12:50.512594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:21.360400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664641+0000","last_change":"2024-09-12T12:12:44.865593+0000","last_active":"2024-09-12T12:12:50.664641+0000","last_peered":"2024-09-12T12:12:50.664641+0000","last_clean":"2024-09-12T12:12:50.664641+0000","last_became_active":"2024-09-12T12:12:44.865207+0000","last_became_peered":"2024-09-12T12:12:44.865207+0000","last_unstale":"2024-09-12T12:12:50.664641+0000","last_undegraded":"2024-09-12T12:12:50.664641+0000","last_fullsized":"2024-09-12T12:12:50.664641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:35.665829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126175+0000","last_change":"2024-09-12T12:12:43.840268+0000","last_active":"2024-09-12T12:12:51.126175+0000","last_peered":"2024-09-12T12:12:51.126175+0000","last_clean":"2024-09-12T12:12:51.126175+0000","last_became_active":"2024-09-12T12:12:43.839978+0000","last_became_peered":"2024-09-12T12:12:43.839978+0000","last_unstale":"2024-09-12T12:12:51.126175+0000","last_undegraded":"2024-09-12T12:12:51.126175+0000","last_fullsized":"2024-09-12T12:12:51.126175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125228+0000","last_change":"2024-09-12T12:12:49.201974+0000","last_active":"2024-09-12T12:12:51.125228+0000","last_peered":"2024-09-12T12:12:51.125228+0000","last_clean":"2024-09-12T12:12:51.125228+0000","last_became_active":"2024-09-12T12:12:49.201363+0000","last_became_peered":"2024-09-12T12:12:49.201363+0000","last_unstale":"2024-09-12T12:12:51.125228+0000","last_undegraded":"2024-09-12T12:12:51.125228+0000","last_fullsized":"2024-09-12T12:12:51.125228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179210+0000","last_change":"2024-09-12T12:12:44.850770+0000","last_active":"2024-09-12T12:12:50.179210+0000","last_peered":"2024-09-12T12:12:50.179210+0000","last_clean":"2024-09-12T12:12:50.179210+0000","last_became_active":"2024-09-12T12:12:44.842455+0000","last_became_peered":"2024-09-12T12:12:44.842455+0000","last_unstale":"2024-09-12T12:12:50.179210+0000","last_undegraded":"2024-09-12T12:12:50.179210+0000","last_fullsized":"2024-09-12T12:12:50.179210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:15.274937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664457+0000","last_change":"2024-09-12T12:12:43.848461+0000","last_active":"2024-09-12T12:12:50.664457+0000","last_peered":"2024-09-12T12:12:50.664457+0000","last_clean":"2024-09-12T12:12:50.664457+0000","last_became_active":"2024-09-12T12:12:43.847953+0000","last_became_peered":"2024-09-12T12:12:43.847953+0000","last_unstale":"2024-09-12T12:12:50.664457+0000","last_undegraded":"2024-09-12T12:12:50.664457+0000","last_fullsized":"2024-09-12T12:12:50.664457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126063+0000","last_change":"2024-09-12T12:12:49.200796+0000","last_active":"2024-09-12T12:12:51.126063+0000","last_peered":"2024-09-12T12:12:51.126063+0000","last_clean":"2024-09-12T12:12:51.126063+0000","last_became_active":"2024-09-12T12:12:49.200352+0000","last_became_peered":"2024-09-12T12:12:49.200352+0000","last_unstale":"2024-09-12T12:12:51.126063+0000","last_undegraded":"2024-09-12T12:12:51.126063+0000","last_fullsized":"2024-09-12T12:12:51.126063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:54.688541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125166+0000","last_change":"2024-09-12T12:12:44.861229+0000","last_active":"2024-09-12T12:12:51.125166+0000","last_peered":"2024-09-12T12:12:51.125166+0000","last_clean":"2024-09-12T12:12:51.125166+0000","last_became_active":"2024-09-12T12:12:44.855880+0000","last_became_peered":"2024-09-12T12:12:44.855880+0000","last_unstale":"2024-09-12T12:12:51.125166+0000","last_undegraded":"2024-09-12T12:12:51.125166+0000","last_fullsized":"2024-09-12T12:12:51.125166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124771+0000","last_change":"2024-09-12T12:12:43.843781+0000","last_active":"2024-09-12T12:12:51.124771+0000","last_peered":"2024-09-12T12:12:51.124771+0000","last_clean":"2024-09-12T12:12:51.124771+0000","last_became_active":"2024-09-12T12:12:43.843510+0000","last_became_peered":"2024-09-12T12:12:43.843510+0000","last_unstale":"2024-09-12T12:12:51.124771+0000","last_undegraded":"2024-09-12T12:12:51.124771+0000","last_fullsized":"2024-09-12T12:12:51.124771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126036+0000","last_change":"2024-09-12T12:12:49.201170+0000","last_active":"2024-09-12T12:12:51.126036+0000","last_peered":"2024-09-12T12:12:51.126036+0000","last_clean":"2024-09-12T12:12:51.126036+0000","last_became_active":"2024-09-12T12:12:49.200754+0000","last_became_peered":"2024-09-12T12:12:49.200754+0000","last_unstale":"2024-09-12T12:12:51.126036+0000","last_undegraded":"2024-09-12T12:12:51.126036+0000","last_fullsized":"2024-09-12T12:12:51.126036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:33.368245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512181+0000","last_change":"2024-09-12T12:12:44.839123+0000","last_active":"2024-09-12T12:12:50.512181+0000","last_peered":"2024-09-12T12:12:50.512181+0000","last_clean":"2024-09-12T12:12:50.512181+0000","last_became_active":"2024-09-12T12:12:44.838887+0000","last_became_peered":"2024-09-12T12:12:44.838887+0000","last_unstale":"2024-09-12T12:12:50.512181+0000","last_undegraded":"2024-09-12T12:12:50.512181+0000","last_fullsized":"2024-09-12T12:12:50.512181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:31.037954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516448+0000","last_change":"2024-09-12T12:12:43.853714+0000","last_active":"2024-09-12T12:12:50.516448+0000","last_peered":"2024-09-12T12:12:50.516448+0000","last_clean":"2024-09-12T12:12:50.516448+0000","last_became_active":"2024-09-12T12:12:43.853354+0000","last_became_peered":"2024-09-12T12:12:43.853354+0000","last_unstale":"2024-09-12T12:12:50.516448+0000","last_undegraded":"2024-09-12T12:12:50.516448+0000","last_fullsized":"2024-09-12T12:12:50.516448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512950+0000","last_change":"2024-09-12T12:12:49.233432+0000","last_active":"2024-09-12T12:12:50.512950+0000","last_peered":"2024-09-12T12:12:50.512950+0000","last_clean":"2024-09-12T12:12:50.512950+0000","last_became_active":"2024-09-12T12:12:49.232960+0000","last_became_peered":"2024-09-12T12:12:49.232960+0000","last_unstale":"2024-09-12T12:12:50.512950+0000","last_undegraded":"2024-09-12T12:12:50.512950+0000","last_fullsized":"2024-09-12T12:12:50.512950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:29.872131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176900+0000","last_change":"2024-09-12T12:12:44.866650+0000","last_active":"2024-09-12T12:12:50.176900+0000","last_peered":"2024-09-12T12:12:50.176900+0000","last_clean":"2024-09-12T12:12:50.176900+0000","last_became_active":"2024-09-12T12:12:44.866307+0000","last_became_peered":"2024-09-12T12:12:44.866307+0000","last_unstale":"2024-09-12T12:12:50.176900+0000","last_undegraded":"2024-09-12T12:12:50.176900+0000","last_fullsized":"2024-09-12T12:12:50.176900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664136+0000","last_change":"2024-09-12T12:12:43.850483+0000","last_active":"2024-09-12T12:12:50.664136+0000","last_peered":"2024-09-12T12:12:50.664136+0000","last_clean":"2024-09-12T12:12:50.664136+0000","last_became_active":"2024-09-12T12:12:43.850143+0000","last_became_peered":"2024-09-12T12:12:43.850143+0000","last_unstale":"2024-09-12T12:12:50.664136+0000","last_undegraded":"2024-09-12T12:12:50.664136+0000","last_fullsized":"2024-09-12T12:12:50.664136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516596+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:12:50.516596+0000","last_peered":"2024-09-12T12:12:50.516596+0000","last_clean":"2024-09-12T12:12:50.516596+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:12:50.516596+0000","last_undegraded":"2024-09-12T12:12:50.516596+0000","last_fullsized":"2024-09-12T12:12:50.516596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178235+0000","last_change":"2024-09-12T12:12:49.235904+0000","last_active":"2024-09-12T12:12:50.178235+0000","last_peered":"2024-09-12T12:12:50.178235+0000","last_clean":"2024-09-12T12:12:50.178235+0000","last_became_active":"2024-09-12T12:12:49.235548+0000","last_became_peered":"2024-09-12T12:12:49.235548+0000","last_unstale":"2024-09-12T12:12:50.178235+0000","last_undegraded":"2024-09-12T12:12:50.178235+0000","last_fullsized":"2024-09-12T12:12:50.178235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517137+0000","last_change":"2024-09-12T12:12:44.866993+0000","last_active":"2024-09-12T12:12:50.517137+0000","last_peered":"2024-09-12T12:12:50.517137+0000","last_clean":"2024-09-12T12:12:50.517137+0000","last_became_active":"2024-09-12T12:12:44.866717+0000","last_became_peered":"2024-09-12T12:12:44.866717+0000","last_unstale":"2024-09-12T12:12:50.517137+0000","last_undegraded":"2024-09-12T12:12:50.517137+0000","last_fullsized":"2024-09-12T12:12:50.517137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:29.019401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125386+0000","last_change":"2024-09-12T12:12:43.857565+0000","last_active":"2024-09-12T12:12:51.125386+0000","last_peered":"2024-09-12T12:12:51.125386+0000","last_clean":"2024-09-12T12:12:51.125386+0000","last_became_active":"2024-09-12T12:12:43.857320+0000","last_became_peered":"2024-09-12T12:12:43.857320+0000","last_unstale":"2024-09-12T12:12:51.125386+0000","last_undegraded":"2024-09-12T12:12:51.125386+0000","last_fullsized":"2024-09-12T12:12:51.125386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177268+0000","last_change":"2024-09-12T12:12:49.233077+0000","last_active":"2024-09-12T12:12:50.177268+0000","last_peered":"2024-09-12T12:12:50.177268+0000","last_clean":"2024-09-12T12:12:50.177268+0000","last_became_active":"2024-09-12T12:12:49.232399+0000","last_became_peered":"2024-09-12T12:12:49.232399+0000","last_unstale":"2024-09-12T12:12:50.177268+0000","last_undegraded":"2024-09-12T12:12:50.177268+0000","last_fullsized":"2024-09-12T12:12:50.177268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:36.758809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664546+0000","last_change":"2024-09-12T12:12:44.863346+0000","last_active":"2024-09-12T12:12:50.664546+0000","last_peered":"2024-09-12T12:12:50.664546+0000","last_clean":"2024-09-12T12:12:50.664546+0000","last_became_active":"2024-09-12T12:12:44.863022+0000","last_became_peered":"2024-09-12T12:12:44.863022+0000","last_unstale":"2024-09-12T12:12:50.664546+0000","last_undegraded":"2024-09-12T12:12:50.664546+0000","last_fullsized":"2024-09-12T12:12:50.664546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125799+0000","last_change":"2024-09-12T12:12:43.843497+0000","last_active":"2024-09-12T12:12:51.125799+0000","last_peered":"2024-09-12T12:12:51.125799+0000","last_clean":"2024-09-12T12:12:51.125799+0000","last_became_active":"2024-09-12T12:12:43.843205+0000","last_became_peered":"2024-09-12T12:12:43.843205+0000","last_unstale":"2024-09-12T12:12:51.125799+0000","last_undegraded":"2024-09-12T12:12:51.125799+0000","last_fullsized":"2024-09-12T12:12:51.125799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512708+0000","last_change":"2024-09-12T12:12:49.194951+0000","last_active":"2024-09-12T12:12:50.512708+0000","last_peered":"2024-09-12T12:12:50.512708+0000","last_clean":"2024-09-12T12:12:50.512708+0000","last_became_active":"2024-09-12T12:12:49.193406+0000","last_became_peered":"2024-09-12T12:12:49.193406+0000","last_unstale":"2024-09-12T12:12:50.512708+0000","last_undegraded":"2024-09-12T12:12:50.512708+0000","last_fullsized":"2024-09-12T12:12:50.512708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:33.368245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517235+0000","last_change":"2024-09-12T12:12:44.873360+0000","last_active":"2024-09-12T12:12:50.517235+0000","last_peered":"2024-09-12T12:12:50.517235+0000","last_clean":"2024-09-12T12:12:50.517235+0000","last_became_active":"2024-09-12T12:12:44.871164+0000","last_became_peered":"2024-09-12T12:12:44.871164+0000","last_unstale":"2024-09-12T12:12:50.517235+0000","last_undegraded":"2024-09-12T12:12:50.517235+0000","last_fullsized":"2024-09-12T12:12:50.517235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:15.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125672+0000","last_change":"2024-09-12T12:12:43.844520+0000","last_active":"2024-09-12T12:12:51.125672+0000","last_peered":"2024-09-12T12:12:51.125672+0000","last_clean":"2024-09-12T12:12:51.125672+0000","last_became_active":"2024-09-12T12:12:43.844192+0000","last_became_peered":"2024-09-12T12:12:43.844192+0000","last_unstale":"2024-09-12T12:12:51.125672+0000","last_undegraded":"2024-09-12T12:12:51.125672+0000","last_fullsized":"2024-09-12T12:12:51.125672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663736+0000","last_change":"2024-09-12T12:12:49.235687+0000","last_active":"2024-09-12T12:12:50.663736+0000","last_peered":"2024-09-12T12:12:50.663736+0000","last_clean":"2024-09-12T12:12:50.663736+0000","last_became_active":"2024-09-12T12:12:49.235279+0000","last_became_peered":"2024-09-12T12:12:49.235279+0000","last_unstale":"2024-09-12T12:12:50.663736+0000","last_undegraded":"2024-09-12T12:12:50.663736+0000","last_fullsized":"2024-09-12T12:12:50.663736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:09.355445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517127+0000","last_change":"2024-09-12T12:12:44.869312+0000","last_active":"2024-09-12T12:12:50.517127+0000","last_peered":"2024-09-12T12:12:50.517127+0000","last_clean":"2024-09-12T12:12:50.517127+0000","last_became_active":"2024-09-12T12:12:44.869049+0000","last_became_peered":"2024-09-12T12:12:44.869049+0000","last_unstale":"2024-09-12T12:12:50.517127+0000","last_undegraded":"2024-09-12T12:12:50.517127+0000","last_fullsized":"2024-09-12T12:12:50.517127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178843+0000","last_change":"2024-09-12T12:12:43.850258+0000","last_active":"2024-09-12T12:12:50.178843+0000","last_peered":"2024-09-12T12:12:50.178843+0000","last_clean":"2024-09-12T12:12:50.178843+0000","last_became_active":"2024-09-12T12:12:43.849933+0000","last_became_peered":"2024-09-12T12:12:43.849933+0000","last_unstale":"2024-09-12T12:12:50.178843+0000","last_undegraded":"2024-09-12T12:12:50.178843+0000","last_fullsized":"2024-09-12T12:12:50.178843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.059875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177247+0000","last_change":"2024-09-12T12:12:49.204097+0000","last_active":"2024-09-12T12:12:50.177247+0000","last_peered":"2024-09-12T12:12:50.177247+0000","last_clean":"2024-09-12T12:12:50.177247+0000","last_became_active":"2024-09-12T12:12:49.203718+0000","last_became_peered":"2024-09-12T12:12:49.203718+0000","last_unstale":"2024-09-12T12:12:50.177247+0000","last_undegraded":"2024-09-12T12:12:50.177247+0000","last_fullsized":"2024-09-12T12:12:50.177247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:40.026171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516739+0000","last_change":"2024-09-12T12:12:44.869271+0000","last_active":"2024-09-12T12:12:50.516739+0000","last_peered":"2024-09-12T12:12:50.516739+0000","last_clean":"2024-09-12T12:12:50.516739+0000","last_became_active":"2024-09-12T12:12:44.868992+0000","last_became_peered":"2024-09-12T12:12:44.868992+0000","last_unstale":"2024-09-12T12:12:50.516739+0000","last_undegraded":"2024-09-12T12:12:50.516739+0000","last_fullsized":"2024-09-12T12:12:50.516739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:17.011556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124631+0000","last_change":"2024-09-12T12:12:43.838202+0000","last_active":"2024-09-12T12:12:51.124631+0000","last_peered":"2024-09-12T12:12:51.124631+0000","last_clean":"2024-09-12T12:12:51.124631+0000","last_became_active":"2024-09-12T12:12:43.837927+0000","last_became_peered":"2024-09-12T12:12:43.837927+0000","last_unstale":"2024-09-12T12:12:51.124631+0000","last_undegraded":"2024-09-12T12:12:51.124631+0000","last_fullsized":"2024-09-12T12:12:51.124631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:57.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512786+0000","last_change":"2024-09-12T12:12:49.204734+0000","last_active":"2024-09-12T12:12:50.512786+0000","last_peered":"2024-09-12T12:12:50.512786+0000","last_clean":"2024-09-12T12:12:50.512786+0000","last_became_active":"2024-09-12T12:12:49.204387+0000","last_became_peered":"2024-09-12T12:12:49.204387+0000","last_unstale":"2024-09-12T12:12:50.512786+0000","last_undegraded":"2024-09-12T12:12:50.512786+0000","last_fullsized":"2024-09-12T12:12:50.512786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.325777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177498+0000","last_change":"2024-09-12T12:12:44.836998+0000","last_active":"2024-09-12T12:12:50.177498+0000","last_peered":"2024-09-12T12:12:50.177498+0000","last_clean":"2024-09-12T12:12:50.177498+0000","last_became_active":"2024-09-12T12:12:44.836723+0000","last_became_peered":"2024-09-12T12:12:44.836723+0000","last_unstale":"2024-09-12T12:12:50.177498+0000","last_undegraded":"2024-09-12T12:12:50.177498+0000","last_fullsized":"2024-09-12T12:12:50.177498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177648+0000","last_change":"2024-09-12T12:12:43.847610+0000","last_active":"2024-09-12T12:12:50.177648+0000","last_peered":"2024-09-12T12:12:50.177648+0000","last_clean":"2024-09-12T12:12:50.177648+0000","last_became_active":"2024-09-12T12:12:43.846782+0000","last_became_peered":"2024-09-12T12:12:43.846782+0000","last_unstale":"2024-09-12T12:12:50.177648+0000","last_undegraded":"2024-09-12T12:12:50.177648+0000","last_fullsized":"2024-09-12T12:12:50.177648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177641+0000","last_change":"2024-09-12T12:12:49.237439+0000","last_active":"2024-09-12T12:12:50.177641+0000","last_peered":"2024-09-12T12:12:50.177641+0000","last_clean":"2024-09-12T12:12:50.177641+0000","last_became_active":"2024-09-12T12:12:49.236640+0000","last_became_peered":"2024-09-12T12:12:49.236640+0000","last_unstale":"2024-09-12T12:12:50.177641+0000","last_undegraded":"2024-09-12T12:12:50.177641+0000","last_fullsized":"2024-09-12T12:12:50.177641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:48.564758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516862+0000","last_change":"2024-09-12T12:12:44.870489+0000","last_active":"2024-09-12T12:12:50.516862+0000","last_peered":"2024-09-12T12:12:50.516862+0000","last_clean":"2024-09-12T12:12:50.516862+0000","last_became_active":"2024-09-12T12:12:44.869985+0000","last_became_peered":"2024-09-12T12:12:44.869985+0000","last_unstale":"2024-09-12T12:12:50.516862+0000","last_undegraded":"2024-09-12T12:12:50.516862+0000","last_fullsized":"2024-09-12T12:12:50.516862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:35.665829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664336+0000","last_change":"2024-09-12T12:12:43.855159+0000","last_active":"2024-09-12T12:12:50.664336+0000","last_peered":"2024-09-12T12:12:50.664336+0000","last_clean":"2024-09-12T12:12:50.664336+0000","last_became_active":"2024-09-12T12:12:43.854881+0000","last_became_peered":"2024-09-12T12:12:43.854881+0000","last_unstale":"2024-09-12T12:12:50.664336+0000","last_undegraded":"2024-09-12T12:12:50.664336+0000","last_fullsized":"2024-09-12T12:12:50.664336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177172+0000","last_change":"2024-09-12T12:12:49.238471+0000","last_active":"2024-09-12T12:12:50.177172+0000","last_peered":"2024-09-12T12:12:50.177172+0000","last_clean":"2024-09-12T12:12:50.177172+0000","last_became_active":"2024-09-12T12:12:49.235791+0000","last_became_peered":"2024-09-12T12:12:49.235791+0000","last_unstale":"2024-09-12T12:12:50.177172+0000","last_undegraded":"2024-09-12T12:12:50.177172+0000","last_fullsized":"2024-09-12T12:12:50.177172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:21:33.661174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512468+0000","last_change":"2024-09-12T12:12:44.856728+0000","last_active":"2024-09-12T12:12:50.512468+0000","last_peered":"2024-09-12T12:12:50.512468+0000","last_clean":"2024-09-12T12:12:50.512468+0000","last_became_active":"2024-09-12T12:12:44.856523+0000","last_became_peered":"2024-09-12T12:12:44.856523+0000","last_unstale":"2024-09-12T12:12:50.512468+0000","last_undegraded":"2024-09-12T12:12:50.512468+0000","last_fullsized":"2024-09-12T12:12:50.512468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.435034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512841+0000","last_change":"2024-09-12T12:12:43.845142+0000","last_active":"2024-09-12T12:12:50.512841+0000","last_peered":"2024-09-12T12:12:50.512841+0000","last_clean":"2024-09-12T12:12:50.512841+0000","last_became_active":"2024-09-12T12:12:43.844828+0000","last_became_peered":"2024-09-12T12:12:43.844828+0000","last_unstale":"2024-09-12T12:12:50.512841+0000","last_undegraded":"2024-09-12T12:12:50.512841+0000","last_fullsized":"2024-09-12T12:12:50.512841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:59.203160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664482+0000","last_change":"2024-09-12T12:12:49.233138+0000","last_active":"2024-09-12T12:12:50.664482+0000","last_peered":"2024-09-12T12:12:50.664482+0000","last_clean":"2024-09-12T12:12:50.664482+0000","last_became_active":"2024-09-12T12:12:49.232720+0000","last_became_peered":"2024-09-12T12:12:49.232720+0000","last_unstale":"2024-09-12T12:12:50.664482+0000","last_undegraded":"2024-09-12T12:12:50.664482+0000","last_fullsized":"2024-09-12T12:12:50.664482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.973179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517078+0000","last_change":"2024-09-12T12:12:44.864865+0000","last_active":"2024-09-12T12:12:50.517078+0000","last_peered":"2024-09-12T12:12:50.517078+0000","last_clean":"2024-09-12T12:12:50.517078+0000","last_became_active":"2024-09-12T12:12:44.864611+0000","last_became_peered":"2024-09-12T12:12:44.864611+0000","last_unstale":"2024-09-12T12:12:50.517078+0000","last_undegraded":"2024-09-12T12:12:50.517078+0000","last_fullsized":"2024-09-12T12:12:50.517078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:56.111249+0000","last_change":"2024-09-12T12:12:43.841311+0000","last_active":"2024-09-12T12:12:56.111249+0000","last_peered":"2024-09-12T12:12:56.111249+0000","last_clean":"2024-09-12T12:12:56.111249+0000","last_became_active":"2024-09-12T12:12:43.840143+0000","last_became_peered":"2024-09-12T12:12:43.840143+0000","last_unstale":"2024-09-12T12:12:56.111249+0000","last_undegraded":"2024-09-12T12:12:56.111249+0000","last_fullsized":"2024-09-12T12:12:56.111249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125393+0000","last_change":"2024-09-12T12:12:49.201741+0000","last_active":"2024-09-12T12:12:51.125393+0000","last_peered":"2024-09-12T12:12:51.125393+0000","last_clean":"2024-09-12T12:12:51.125393+0000","last_became_active":"2024-09-12T12:12:49.200783+0000","last_became_peered":"2024-09-12T12:12:49.200783+0000","last_unstale":"2024-09-12T12:12:51.125393+0000","last_undegraded":"2024-09-12T12:12:51.125393+0000","last_fullsized":"2024-09-12T12:12:51.125393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:40.014673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178889+0000","last_change":"2024-09-12T12:12:44.866195+0000","last_active":"2024-09-12T12:12:50.178889+0000","last_peered":"2024-09-12T12:12:50.178889+0000","last_clean":"2024-09-12T12:12:50.178889+0000","last_became_active":"2024-09-12T12:12:44.862903+0000","last_became_peered":"2024-09-12T12:12:44.862903+0000","last_unstale":"2024-09-12T12:12:50.178889+0000","last_undegraded":"2024-09-12T12:12:50.178889+0000","last_fullsized":"2024-09-12T12:12:50.178889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:07.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125724+0000","last_change":"2024-09-12T12:12:43.855996+0000","last_active":"2024-09-12T12:12:51.125724+0000","last_peered":"2024-09-12T12:12:51.125724+0000","last_clean":"2024-09-12T12:12:51.125724+0000","last_became_active":"2024-09-12T12:12:43.855599+0000","last_became_peered":"2024-09-12T12:12:43.855599+0000","last_unstale":"2024-09-12T12:12:51.125724+0000","last_undegraded":"2024-09-12T12:12:51.125724+0000","last_fullsized":"2024-09-12T12:12:51.125724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178966+0000","last_change":"2024-09-12T12:12:49.192756+0000","last_active":"2024-09-12T12:12:50.178966+0000","last_peered":"2024-09-12T12:12:50.178966+0000","last_clean":"2024-09-12T12:12:50.178966+0000","last_became_active":"2024-09-12T12:12:49.192349+0000","last_became_peered":"2024-09-12T12:12:49.192349+0000","last_unstale":"2024-09-12T12:12:50.178966+0000","last_undegraded":"2024-09-12T12:12:50.178966+0000","last_fullsized":"2024-09-12T12:12:50.178966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:04.961251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513276+0000","last_change":"2024-09-12T12:12:44.858876+0000","last_active":"2024-09-12T12:12:50.513276+0000","last_peered":"2024-09-12T12:12:50.513276+0000","last_clean":"2024-09-12T12:12:50.513276+0000","last_became_active":"2024-09-12T12:12:44.858622+0000","last_became_peered":"2024-09-12T12:12:44.858622+0000","last_unstale":"2024-09-12T12:12:50.513276+0000","last_undegraded":"2024-09-12T12:12:50.513276+0000","last_fullsized":"2024-09-12T12:12:50.513276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664332+0000","last_change":"2024-09-12T12:12:43.855782+0000","last_active":"2024-09-12T12:12:50.664332+0000","last_peered":"2024-09-12T12:12:50.664332+0000","last_clean":"2024-09-12T12:12:50.664332+0000","last_became_active":"2024-09-12T12:12:43.855330+0000","last_became_peered":"2024-09-12T12:12:43.855330+0000","last_unstale":"2024-09-12T12:12:50.664332+0000","last_undegraded":"2024-09-12T12:12:50.664332+0000","last_fullsized":"2024-09-12T12:12:50.664332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176677+0000","last_change":"2024-09-12T12:12:49.199551+0000","last_active":"2024-09-12T12:12:50.176677+0000","last_peered":"2024-09-12T12:12:50.176677+0000","last_clean":"2024-09-12T12:12:50.176677+0000","last_became_active":"2024-09-12T12:12:49.199160+0000","last_became_peered":"2024-09-12T12:12:49.199160+0000","last_unstale":"2024-09-12T12:12:50.176677+0000","last_undegraded":"2024-09-12T12:12:50.176677+0000","last_fullsized":"2024-09-12T12:12:50.176677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:55.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664327+0000","last_change":"2024-09-12T12:12:44.861353+0000","last_active":"2024-09-12T12:12:50.664327+0000","last_peered":"2024-09-12T12:12:50.664327+0000","last_clean":"2024-09-12T12:12:50.664327+0000","last_became_active":"2024-09-12T12:12:44.861070+0000","last_became_peered":"2024-09-12T12:12:44.861070+0000","last_unstale":"2024-09-12T12:12:50.664327+0000","last_undegraded":"2024-09-12T12:12:50.664327+0000","last_fullsized":"2024-09-12T12:12:50.664327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178299+0000","last_change":"2024-09-12T12:12:43.856649+0000","last_active":"2024-09-12T12:12:50.178299+0000","last_peered":"2024-09-12T12:12:50.178299+0000","last_clean":"2024-09-12T12:12:50.178299+0000","last_became_active":"2024-09-12T12:12:43.856407+0000","last_became_peered":"2024-09-12T12:12:43.856407+0000","last_unstale":"2024-09-12T12:12:50.178299+0000","last_undegraded":"2024-09-12T12:12:50.178299+0000","last_fullsized":"2024-09-12T12:12:50.178299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176631+0000","last_change":"2024-09-12T12:12:49.234007+0000","last_active":"2024-09-12T12:12:50.176631+0000","last_peered":"2024-09-12T12:12:50.176631+0000","last_clean":"2024-09-12T12:12:50.176631+0000","last_became_active":"2024-09-12T12:12:49.233586+0000","last_became_peered":"2024-09-12T12:12:49.233586+0000","last_unstale":"2024-09-12T12:12:50.176631+0000","last_undegraded":"2024-09-12T12:12:50.176631+0000","last_fullsized":"2024-09-12T12:12:50.176631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:01.336468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512727+0000","last_change":"2024-09-12T12:12:49.239278+0000","last_active":"2024-09-12T12:12:50.512727+0000","last_peered":"2024-09-12T12:12:50.512727+0000","last_clean":"2024-09-12T12:12:50.512727+0000","last_became_active":"2024-09-12T12:12:49.237056+0000","last_became_peered":"2024-09-12T12:12:49.237056+0000","last_unstale":"2024-09-12T12:12:50.512727+0000","last_undegraded":"2024-09-12T12:12:50.512727+0000","last_fullsized":"2024-09-12T12:12:50.512727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:54.688541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124996+0000","last_change":"2024-09-12T12:12:44.849271+0000","last_active":"2024-09-12T12:12:51.124996+0000","last_peered":"2024-09-12T12:12:51.124996+0000","last_clean":"2024-09-12T12:12:51.124996+0000","last_became_active":"2024-09-12T12:12:44.848981+0000","last_became_peered":"2024-09-12T12:12:44.848981+0000","last_unstale":"2024-09-12T12:12:51.124996+0000","last_undegraded":"2024-09-12T12:12:51.124996+0000","last_fullsized":"2024-09-12T12:12:51.124996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664166+0000","last_change":"2024-09-12T12:12:43.850772+0000","last_active":"2024-09-12T12:12:50.664166+0000","last_peered":"2024-09-12T12:12:50.664166+0000","last_clean":"2024-09-12T12:12:50.664166+0000","last_became_active":"2024-09-12T12:12:43.849876+0000","last_became_peered":"2024-09-12T12:12:43.849876+0000","last_unstale":"2024-09-12T12:12:50.664166+0000","last_undegraded":"2024-09-12T12:12:50.664166+0000","last_fullsized":"2024-09-12T12:12:50.664166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178125+0000","last_change":"2024-09-12T12:12:49.197617+0000","last_active":"2024-09-12T12:12:50.178125+0000","last_peered":"2024-09-12T12:12:50.178125+0000","last_clean":"2024-09-12T12:12:50.178125+0000","last_became_active":"2024-09-12T12:12:49.197030+0000","last_became_peered":"2024-09-12T12:12:49.197030+0000","last_unstale":"2024-09-12T12:12:50.178125+0000","last_undegraded":"2024-09-12T12:12:50.178125+0000","last_fullsized":"2024-09-12T12:12:50.178125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:04.961251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176677+0000","last_change":"2024-09-12T12:12:44.861618+0000","last_active":"2024-09-12T12:12:50.176677+0000","last_peered":"2024-09-12T12:12:50.176677+0000","last_clean":"2024-09-12T12:12:50.176677+0000","last_became_active":"2024-09-12T12:12:44.861291+0000","last_became_peered":"2024-09-12T12:12:44.861291+0000","last_unstale":"2024-09-12T12:12:50.176677+0000","last_undegraded":"2024-09-12T12:12:50.176677+0000","last_fullsized":"2024-09-12T12:12:50.176677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176907+0000","last_change":"2024-09-12T12:12:43.843772+0000","last_active":"2024-09-12T12:12:50.176907+0000","last_peered":"2024-09-12T12:12:50.176907+0000","last_clean":"2024-09-12T12:12:50.176907+0000","last_became_active":"2024-09-12T12:12:43.843482+0000","last_became_peered":"2024-09-12T12:12:43.843482+0000","last_unstale":"2024-09-12T12:12:50.176907+0000","last_undegraded":"2024-09-12T12:12:50.176907+0000","last_fullsized":"2024-09-12T12:12:50.176907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:57.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177687+0000","last_change":"2024-09-12T12:12:43.853195+0000","last_active":"2024-09-12T12:12:50.177687+0000","last_peered":"2024-09-12T12:12:50.177687+0000","last_clean":"2024-09-12T12:12:50.177687+0000","last_became_active":"2024-09-12T12:12:43.852885+0000","last_became_peered":"2024-09-12T12:12:43.852885+0000","last_unstale":"2024-09-12T12:12:50.177687+0000","last_undegraded":"2024-09-12T12:12:50.177687+0000","last_fullsized":"2024-09-12T12:12:50.177687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512832+0000","last_change":"2024-09-12T12:12:44.841616+0000","last_active":"2024-09-12T12:12:50.512832+0000","last_peered":"2024-09-12T12:12:50.512832+0000","last_clean":"2024-09-12T12:12:50.512832+0000","last_became_active":"2024-09-12T12:12:44.837035+0000","last_became_peered":"2024-09-12T12:12:44.837035+0000","last_unstale":"2024-09-12T12:12:50.512832+0000","last_undegraded":"2024-09-12T12:12:50.512832+0000","last_fullsized":"2024-09-12T12:12:50.512832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125285+0000","last_change":"2024-09-12T12:12:49.197010+0000","last_active":"2024-09-12T12:12:51.125285+0000","last_peered":"2024-09-12T12:12:51.125285+0000","last_clean":"2024-09-12T12:12:51.125285+0000","last_became_active":"2024-09-12T12:12:49.196614+0000","last_became_peered":"2024-09-12T12:12:49.196614+0000","last_unstale":"2024-09-12T12:12:51.125285+0000","last_undegraded":"2024-09-12T12:12:51.125285+0000","last_fullsized":"2024-09-12T12:12:51.125285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:15.930626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176978+0000","last_change":"2024-09-12T12:12:43.852370+0000","last_active":"2024-09-12T12:12:50.176978+0000","last_peered":"2024-09-12T12:12:50.176978+0000","last_clean":"2024-09-12T12:12:50.176978+0000","last_became_active":"2024-09-12T12:12:43.852074+0000","last_became_peered":"2024-09-12T12:12:43.852074+0000","last_unstale":"2024-09-12T12:12:50.176978+0000","last_undegraded":"2024-09-12T12:12:50.176978+0000","last_fullsized":"2024-09-12T12:12:50.176978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178100+0000","last_change":"2024-09-12T12:12:44.832700+0000","last_active":"2024-09-12T12:12:50.178100+0000","last_peered":"2024-09-12T12:12:50.178100+0000","last_clean":"2024-09-12T12:12:50.178100+0000","last_became_active":"2024-09-12T12:12:44.832406+0000","last_became_peered":"2024-09-12T12:12:44.832406+0000","last_unstale":"2024-09-12T12:12:50.178100+0000","last_undegraded":"2024-09-12T12:12:50.178100+0000","last_fullsized":"2024-09-12T12:12:50.178100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:58.477524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177442+0000","last_change":"2024-09-12T12:12:49.196949+0000","last_active":"2024-09-12T12:12:50.177442+0000","last_peered":"2024-09-12T12:12:50.177442+0000","last_clean":"2024-09-12T12:12:50.177442+0000","last_became_active":"2024-09-12T12:12:49.196332+0000","last_became_peered":"2024-09-12T12:12:49.196332+0000","last_unstale":"2024-09-12T12:12:50.177442+0000","last_undegraded":"2024-09-12T12:12:50.177442+0000","last_fullsized":"2024-09-12T12:12:50.177442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:33.072107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177294+0000","last_change":"2024-09-12T12:12:44.844712+0000","last_active":"2024-09-12T12:12:50.177294+0000","last_peered":"2024-09-12T12:12:50.177294+0000","last_clean":"2024-09-12T12:12:50.177294+0000","last_became_active":"2024-09-12T12:12:44.843911+0000","last_became_peered":"2024-09-12T12:12:44.843911+0000","last_unstale":"2024-09-12T12:12:50.177294+0000","last_undegraded":"2024-09-12T12:12:50.177294+0000","last_fullsized":"2024-09-12T12:12:50.177294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.435034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124714+0000","last_change":"2024-09-12T12:12:44.848326+0000","last_active":"2024-09-12T12:12:51.124714+0000","last_peered":"2024-09-12T12:12:51.124714+0000","last_clean":"2024-09-12T12:12:51.124714+0000","last_became_active":"2024-09-12T12:12:44.848042+0000","last_became_peered":"2024-09-12T12:12:44.848042+0000","last_unstale":"2024-09-12T12:12:51.124714+0000","last_undegraded":"2024-09-12T12:12:51.124714+0000","last_fullsized":"2024-09-12T12:12:51.124714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:29.908514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664167+0000","last_change":"2024-09-12T12:12:44.864217+0000","last_active":"2024-09-12T12:12:50.664167+0000","last_peered":"2024-09-12T12:12:50.664167+0000","last_clean":"2024-09-12T12:12:50.664167+0000","last_became_active":"2024-09-12T12:12:44.863950+0000","last_became_peered":"2024-09-12T12:12:44.863950+0000","last_unstale":"2024-09-12T12:12:50.664167+0000","last_undegraded":"2024-09-12T12:12:50.664167+0000","last_fullsized":"2024-09-12T12:12:50.664167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512709+0000","last_change":"2024-09-12T12:12:44.844044+0000","last_active":"2024-09-12T12:12:50.512709+0000","last_peered":"2024-09-12T12:12:50.512709+0000","last_clean":"2024-09-12T12:12:50.512709+0000","last_became_active":"2024-09-12T12:12:44.843737+0000","last_became_peered":"2024-09-12T12:12:44.843737+0000","last_unstale":"2024-09-12T12:12:50.512709+0000","last_undegraded":"2024-09-12T12:12:50.512709+0000","last_fullsized":"2024-09-12T12:12:50.512709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177290+0000","last_change":"2024-09-12T12:12:44.854798+0000","last_active":"2024-09-12T12:12:50.177290+0000","last_peered":"2024-09-12T12:12:50.177290+0000","last_clean":"2024-09-12T12:12:50.177290+0000","last_became_active":"2024-09-12T12:12:44.852834+0000","last_became_peered":"2024-09-12T12:12:44.852834+0000","last_unstale":"2024-09-12T12:12:50.177290+0000","last_undegraded":"2024-09-12T12:12:50.177290+0000","last_fullsized":"2024-09-12T12:12:50.177290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125449+0000","last_change":"2024-09-12T12:12:44.855309+0000","last_active":"2024-09-12T12:12:51.125449+0000","last_peered":"2024-09-12T12:12:51.125449+0000","last_clean":"2024-09-12T12:12:51.125449+0000","last_became_active":"2024-09-12T12:12:44.854718+0000","last_became_peered":"2024-09-12T12:12:44.854718+0000","last_unstale":"2024-09-12T12:12:51.125449+0000","last_undegraded":"2024-09-12T12:12:51.125449+0000","last_fullsized":"2024-09-12T12:12:51.125449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178907+0000","last_change":"2024-09-12T12:12:44.855541+0000","last_active":"2024-09-12T12:12:50.178907+0000","last_peered":"2024-09-12T12:12:50.178907+0000","last_clean":"2024-09-12T12:12:50.178907+0000","last_became_active":"2024-09-12T12:12:44.855141+0000","last_became_peered":"2024-09-12T12:12:44.855141+0000","last_unstale":"2024-09-12T12:12:50.178907+0000","last_undegraded":"2024-09-12T12:12:50.178907+0000","last_fullsized":"2024-09-12T12:12:50.178907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177604+0000","last_change":"2024-09-12T12:12:44.866746+0000","last_active":"2024-09-12T12:12:50.177604+0000","last_peered":"2024-09-12T12:12:50.177604+0000","last_clean":"2024-09-12T12:12:50.177604+0000","last_became_active":"2024-09-12T12:12:44.866244+0000","last_became_peered":"2024-09-12T12:12:44.866244+0000","last_unstale":"2024-09-12T12:12:50.177604+0000","last_undegraded":"2024-09-12T12:12:50.177604+0000","last_fullsized":"2024-09-12T12:12:50.177604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663883+0000","last_change":"2024-09-12T12:12:44.864035+0000","last_active":"2024-09-12T12:12:50.663883+0000","last_peered":"2024-09-12T12:12:50.663883+0000","last_clean":"2024-09-12T12:12:50.663883+0000","last_became_active":"2024-09-12T12:12:44.863759+0000","last_became_peered":"2024-09-12T12:12:44.863759+0000","last_unstale":"2024-09-12T12:12:50.663883+0000","last_undegraded":"2024-09-12T12:12:50.663883+0000","last_fullsized":"2024-09-12T12:12:50.663883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:31.258440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176816+0000","last_change":"2024-09-12T12:12:44.865302+0000","last_active":"2024-09-12T12:12:50.176816+0000","last_peered":"2024-09-12T12:12:50.176816+0000","last_clean":"2024-09-12T12:12:50.176816+0000","last_became_active":"2024-09-12T12:12:44.865069+0000","last_became_peered":"2024-09-12T12:12:44.865069+0000","last_unstale":"2024-09-12T12:12:50.176816+0000","last_undegraded":"2024-09-12T12:12:50.176816+0000","last_fullsized":"2024-09-12T12:12:50.176816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664052+0000","last_change":"2024-09-12T12:12:44.861590+0000","last_active":"2024-09-12T12:12:50.664052+0000","last_peered":"2024-09-12T12:12:50.664052+0000","last_clean":"2024-09-12T12:12:50.664052+0000","last_became_active":"2024-09-12T12:12:44.861202+0000","last_became_peered":"2024-09-12T12:12:44.861202+0000","last_unstale":"2024-09-12T12:12:50.664052+0000","last_undegraded":"2024-09-12T12:12:50.664052+0000","last_fullsized":"2024-09-12T12:12:50.664052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512497+0000","last_change":"2024-09-12T12:12:44.856860+0000","last_active":"2024-09-12T12:12:50.512497+0000","last_peered":"2024-09-12T12:12:50.512497+0000","last_clean":"2024-09-12T12:12:50.512497+0000","last_became_active":"2024-09-12T12:12:44.856519+0000","last_became_peered":"2024-09-12T12:12:44.856519+0000","last_unstale":"2024-09-12T12:12:50.512497+0000","last_undegraded":"2024-09-12T12:12:50.512497+0000","last_fullsized":"2024-09-12T12:12:50.512497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:11.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178221+0000","last_change":"2024-09-12T12:12:44.848555+0000","last_active":"2024-09-12T12:12:50.178221+0000","last_peered":"2024-09-12T12:12:50.178221+0000","last_clean":"2024-09-12T12:12:50.178221+0000","last_became_active":"2024-09-12T12:12:44.848264+0000","last_became_peered":"2024-09-12T12:12:44.848264+0000","last_unstale":"2024-09-12T12:12:50.178221+0000","last_undegraded":"2024-09-12T12:12:50.178221+0000","last_fullsized":"2024-09-12T12:12:50.178221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517342+0000","last_change":"2024-09-12T12:12:44.871273+0000","last_active":"2024-09-12T12:12:50.517342+0000","last_peered":"2024-09-12T12:12:50.517342+0000","last_clean":"2024-09-12T12:12:50.517342+0000","last_became_active":"2024-09-12T12:12:44.871000+0000","last_became_peered":"2024-09-12T12:12:44.871000+0000","last_unstale":"2024-09-12T12:12:50.517342+0000","last_undegraded":"2024-09-12T12:12:50.517342+0000","last_fullsized":"2024-09-12T12:12:50.517342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.339698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125660+0000","last_change":"2024-09-12T12:12:44.852240+0000","last_active":"2024-09-12T12:12:51.125660+0000","last_peered":"2024-09-12T12:12:51.125660+0000","last_clean":"2024-09-12T12:12:51.125660+0000","last_became_active":"2024-09-12T12:12:44.851932+0000","last_became_peered":"2024-09-12T12:12:44.851932+0000","last_unstale":"2024-09-12T12:12:51.125660+0000","last_undegraded":"2024-09-12T12:12:51.125660+0000","last_fullsized":"2024-09-12T12:12:51.125660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:07.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664682+0000","last_change":"2024-09-12T12:12:44.873027+0000","last_active":"2024-09-12T12:12:50.664682+0000","last_peered":"2024-09-12T12:12:50.664682+0000","last_clean":"2024-09-12T12:12:50.664682+0000","last_became_active":"2024-09-12T12:12:44.872766+0000","last_became_peered":"2024-09-12T12:12:44.872766+0000","last_unstale":"2024-09-12T12:12:50.664682+0000","last_undegraded":"2024-09-12T12:12:50.664682+0000","last_fullsized":"2024-09-12T12:12:50.664682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:17.011556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663750+0000","last_change":"2024-09-12T12:12:44.846340+0000","last_active":"2024-09-12T12:12:50.663750+0000","last_peered":"2024-09-12T12:12:50.663750+0000","last_clean":"2024-09-12T12:12:50.663750+0000","last_became_active":"2024-09-12T12:12:44.846029+0000","last_became_peered":"2024-09-12T12:12:44.846029+0000","last_unstale":"2024-09-12T12:12:50.663750+0000","last_undegraded":"2024-09-12T12:12:50.663750+0000","last_fullsized":"2024-09-12T12:12:50.663750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:00.612407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125028+0000","last_change":"2024-09-12T12:12:44.841774+0000","last_active":"2024-09-12T12:12:51.125028+0000","last_peered":"2024-09-12T12:12:51.125028+0000","last_clean":"2024-09-12T12:12:51.125028+0000","last_became_active":"2024-09-12T12:12:44.841455+0000","last_became_peered":"2024-09-12T12:12:44.841455+0000","last_unstale":"2024-09-12T12:12:51.125028+0000","last_undegraded":"2024-09-12T12:12:51.125028+0000","last_fullsized":"2024-09-12T12:12:51.125028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512467+0000","last_change":"2024-09-12T12:12:44.853169+0000","last_active":"2024-09-12T12:12:50.512467+0000","last_peered":"2024-09-12T12:12:50.512467+0000","last_clean":"2024-09-12T12:12:50.512467+0000","last_became_active":"2024-09-12T12:12:44.852892+0000","last_became_peered":"2024-09-12T12:12:44.852892+0000","last_unstale":"2024-09-12T12:12:50.512467+0000","last_undegraded":"2024-09-12T12:12:50.512467+0000","last_fullsized":"2024-09-12T12:12:50.512467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:35.948872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176814+0000","last_change":"2024-09-12T12:12:44.844754+0000","last_active":"2024-09-12T12:12:50.176814+0000","last_peered":"2024-09-12T12:12:50.176814+0000","last_clean":"2024-09-12T12:12:50.176814+0000","last_became_active":"2024-09-12T12:12:44.844442+0000","last_became_peered":"2024-09-12T12:12:44.844442+0000","last_unstale":"2024-09-12T12:12:50.176814+0000","last_undegraded":"2024-09-12T12:12:50.176814+0000","last_fullsized":"2024-09-12T12:12:50.176814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:31.258440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178826+0000","last_change":"2024-09-12T12:12:44.839270+0000","last_active":"2024-09-12T12:12:50.178826+0000","last_peered":"2024-09-12T12:12:50.178826+0000","last_clean":"2024-09-12T12:12:50.178826+0000","last_became_active":"2024-09-12T12:12:44.838825+0000","last_became_peered":"2024-09-12T12:12:44.838825+0000","last_unstale":"2024-09-12T12:12:50.178826+0000","last_undegraded":"2024-09-12T12:12:50.178826+0000","last_fullsized":"2024-09-12T12:12:50.178826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:29.908514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178340+0000","last_change":"2024-09-12T12:12:44.845641+0000","last_active":"2024-09-12T12:12:50.178340+0000","last_peered":"2024-09-12T12:12:50.178340+0000","last_clean":"2024-09-12T12:12:50.178340+0000","last_became_active":"2024-09-12T12:12:44.845161+0000","last_became_peered":"2024-09-12T12:12:44.845161+0000","last_unstale":"2024-09-12T12:12:50.178340+0000","last_undegraded":"2024-09-12T12:12:50.178340+0000","last_fullsized":"2024-09-12T12:12:50.178340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178812+0000","last_change":"2024-09-12T12:12:44.858433+0000","last_active":"2024-09-12T12:12:50.178812+0000","last_peered":"2024-09-12T12:12:50.178812+0000","last_clean":"2024-09-12T12:12:50.178812+0000","last_became_active":"2024-09-12T12:12:44.858113+0000","last_became_peered":"2024-09-12T12:12:44.858113+0000","last_unstale":"2024-09-12T12:12:50.178812+0000","last_undegraded":"2024-09-12T12:12:50.178812+0000","last_fullsized":"2024-09-12T12:12:50.178812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517222+0000","last_change":"2024-09-12T12:12:44.869733+0000","last_active":"2024-09-12T12:12:50.517222+0000","last_peered":"2024-09-12T12:12:50.517222+0000","last_clean":"2024-09-12T12:12:50.517222+0000","last_became_active":"2024-09-12T12:12:44.868192+0000","last_became_peered":"2024-09-12T12:12:44.868192+0000","last_unstale":"2024-09-12T12:12:50.517222+0000","last_undegraded":"2024-09-12T12:12:50.517222+0000","last_fullsized":"2024-09-12T12:12:50.517222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:00.612407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176586+0000","last_change":"2024-09-12T12:12:44.844476+0000","last_active":"2024-09-12T12:12:50.176586+0000","last_peered":"2024-09-12T12:12:50.176586+0000","last_clean":"2024-09-12T12:12:50.176586+0000","last_became_active":"2024-09-12T12:12:44.844240+0000","last_became_peered":"2024-09-12T12:12:44.844240+0000","last_unstale":"2024-09-12T12:12:50.176586+0000","last_undegraded":"2024-09-12T12:12:50.176586+0000","last_fullsized":"2024-09-12T12:12:50.176586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516610+0000","last_change":"2024-09-12T12:12:44.859103+0000","last_active":"2024-09-12T12:12:50.516610+0000","last_peered":"2024-09-12T12:12:50.516610+0000","last_clean":"2024-09-12T12:12:50.516610+0000","last_became_active":"2024-09-12T12:12:44.858792+0000","last_became_peered":"2024-09-12T12:12:44.858792+0000","last_unstale":"2024-09-12T12:12:50.516610+0000","last_undegraded":"2024-09-12T12:12:50.516610+0000","last_fullsized":"2024-09-12T12:12:50.516610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663939+0000","last_change":"2024-09-12T12:12:44.846757+0000","last_active":"2024-09-12T12:12:50.663939+0000","last_peered":"2024-09-12T12:12:50.663939+0000","last_clean":"2024-09-12T12:12:50.663939+0000","last_became_active":"2024-09-12T12:12:44.846487+0000","last_became_peered":"2024-09-12T12:12:44.846487+0000","last_unstale":"2024-09-12T12:12:50.663939+0000","last_undegraded":"2024-09-12T12:12:50.663939+0000","last_fullsized":"2024-09-12T12:12:50.663939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516676+0000","last_change":"2024-09-12T12:12:44.861675+0000","last_active":"2024-09-12T12:12:50.516676+0000","last_peered":"2024-09-12T12:12:50.516676+0000","last_clean":"2024-09-12T12:12:50.516676+0000","last_became_active":"2024-09-12T12:12:44.860557+0000","last_became_peered":"2024-09-12T12:12:44.860557+0000","last_unstale":"2024-09-12T12:12:50.516676+0000","last_undegraded":"2024-09-12T12:12:50.516676+0000","last_fullsized":"2024-09-12T12:12:50.516676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664240+0000","last_change":"2024-09-12T12:12:44.872237+0000","last_active":"2024-09-12T12:12:50.664240+0000","last_peered":"2024-09-12T12:12:50.664240+0000","last_clean":"2024-09-12T12:12:50.664240+0000","last_became_active":"2024-09-12T12:12:44.871938+0000","last_became_peered":"2024-09-12T12:12:44.871938+0000","last_unstale":"2024-09-12T12:12:50.664240+0000","last_undegraded":"2024-09-12T12:12:50.664240+0000","last_fullsized":"2024-09-12T12:12:50.664240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512684+0000","last_change":"2024-09-12T12:12:44.849177+0000","last_active":"2024-09-12T12:12:50.512684+0000","last_peered":"2024-09-12T12:12:50.512684+0000","last_clean":"2024-09-12T12:12:50.512684+0000","last_became_active":"2024-09-12T12:12:44.848855+0000","last_became_peered":"2024-09-12T12:12:44.848855+0000","last_unstale":"2024-09-12T12:12:50.512684+0000","last_undegraded":"2024-09-12T12:12:50.512684+0000","last_fullsized":"2024-09-12T12:12:50.512684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126168+0000","last_change":"2024-09-12T12:12:44.840454+0000","last_active":"2024-09-12T12:12:51.126168+0000","last_peered":"2024-09-12T12:12:51.126168+0000","last_clean":"2024-09-12T12:12:51.126168+0000","last_became_active":"2024-09-12T12:12:44.838175+0000","last_became_peered":"2024-09-12T12:12:44.838175+0000","last_unstale":"2024-09-12T12:12:51.126168+0000","last_undegraded":"2024-09-12T12:12:51.126168+0000","last_fullsized":"2024-09-12T12:12:51.126168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517102+0000","last_change":"2024-09-12T12:12:44.868520+0000","last_active":"2024-09-12T12:12:50.517102+0000","last_peered":"2024-09-12T12:12:50.517102+0000","last_clean":"2024-09-12T12:12:50.517102+0000","last_became_active":"2024-09-12T12:12:44.861576+0000","last_became_peered":"2024-09-12T12:12:44.861576+0000","last_unstale":"2024-09-12T12:12:50.517102+0000","last_undegraded":"2024-09-12T12:12:50.517102+0000","last_fullsized":"2024-09-12T12:12:50.517102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:13:06.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:13:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.689+0000 7f9d43200640 1 Processor -- start 2024-09-12T12:13:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.689+0000 7f9d43200640 1 -- start start 2024-09-12T12:13:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.689+0000 7f9d43200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d3c0cf210 0x7f9d3c0cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d43200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d3c06c6b0 con 0x7f9d3c147fa0 2024-09-12T12:13:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d43200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d3c072ce0 con 0x7f9d3c15ea70 2024-09-12T12:13:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d43200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9d3c072a90 con 0x7f9d3c0cf210 2024-09-12T12:13:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9d3c147fa0 0x7f9d3c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60520/0 (socket says 172.21.15.144:60520) 2024-09-12T12:13:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3be00640 1 -- 172.21.15.144:0/1231725054 learned_addr learned my addr 172.21.15.144:0/1231725054 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3b400640 1 --2- 172.21.15.144:0/1231725054 >> v2:172.21.15.144:3300/0 conn(0x7f9d3c0cf210 0x7f9d3c0cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3b400640 1 -- 172.21.15.144:0/1231725054 >> v1:172.21.15.165:6789/0 conn(0x7f9d3c15ea70 legacy=0x7f9d3c15ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3b400640 1 -- 172.21.15.144:0/1231725054 >> v1:172.21.15.144:6789/0 conn(0x7f9d3c147fa0 legacy=0x7f9d3c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3b400640 1 -- 172.21.15.144:0/1231725054 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3c072fc0 con 0x7f9d3c0cf210 2024-09-12T12:13:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3b400640 1 --2- 172.21.15.144:0/1231725054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c0cf210 0x7f9d3c0cf650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d280097c0 tx=0x7f9d2801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462884c203a6f4a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3aa00640 1 -- 172.21.15.144:0/1231725054 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d280b0070 con 0x7f9d3c0cf210 2024-09-12T12:13:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3aa00640 1 -- 172.21.15.144:0/1231725054 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d280ab600 con 0x7f9d3c0cf210 2024-09-12T12:13:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.693+0000 7f9d3aa00640 1 -- 172.21.15.144:0/1231725054 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d280ab9d0 con 0x7f9d3c0cf210 2024-09-12T12:13:06.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 -- 172.21.15.144:0/1231725054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c0cf210 msgr2=0x7f9d3c0cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 --2- 172.21.15.144:0/1231725054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c0cf210 0x7f9d3c0cf650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d280097c0 tx=0x7f9d2801c340 comp rx=0 tx=0).stop 2024-09-12T12:13:06.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 -- 172.21.15.144:0/1231725054 shutdown_connections 2024-09-12T12:13:06.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 --2- 172.21.15.144:0/1231725054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c0cf210 0x7f9d3c0cf650 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 -- 172.21.15.144:0/1231725054 >> 172.21.15.144:0/1231725054 conn(0x7f9d3c06cd20 msgr2=0x7f9d3c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:06.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 -- 172.21.15.144:0/1231725054 shutdown_connections 2024-09-12T12:13:06.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 -- 172.21.15.144:0/1231725054 wait complete. 2024-09-12T12:13:06.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 Processor -- start 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 -- start start 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d3c0cf210 0x7f9d3c13df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d3c147fa0 0x7f9d3c159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c15ea70 0x7f9d3c13d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c15fa20 con 0x7f9d3c15ea70 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3c06c320 con 0x7f9d3c0cf210 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d43200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3c15fba0 con 0x7f9d3c147fa0 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d41200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c15ea70 0x7f9d3c13d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d41200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c15ea70 0x7f9d3c13d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52446/0 (socket says 172.21.15.144:52446) 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d41200640 1 -- 172.21.15.144:0/3280838296 learned_addr learned my addr 172.21.15.144:0/3280838296 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:06.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d3be00640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d3c0cf210 0x7f9d3c13df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d3b400640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d3c147fa0 0x7f9d3c159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d41200640 1 -- 172.21.15.144:0/3280838296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d3c147fa0 msgr2=0x7f9d3c159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d41200640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d3c147fa0 0x7f9d3c159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d41200640 1 -- 172.21.15.144:0/3280838296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d3c0cf210 msgr2=0x7f9d3c13df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d41200640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d3c0cf210 0x7f9d3c13df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d41200640 1 -- 172.21.15.144:0/3280838296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3c151d20 con 0x7f9d3c15ea70 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d3b400640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d3c147fa0 0x7f9d3c159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.697+0000 7f9d41200640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c15ea70 0x7f9d3c13d370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b440 tx=0x7f9d3400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d33e00640 1 -- 172.21.15.144:0/3280838296 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34015020 con 0x7f9d3c15ea70 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d33e00640 1 -- 172.21.15.144:0/3280838296 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d34011850 con 0x7f9d3c15ea70 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3c151fc0 con 0x7f9d3c15ea70 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d33e00640 1 -- 172.21.15.144:0/3280838296 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34011c40 con 0x7f9d3c15ea70 2024-09-12T12:13:06.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d3c152580 con 0x7f9d3c15ea70 2024-09-12T12:13:06.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d3c0cf650 con 0x7f9d3c15ea70 2024-09-12T12:13:06.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d33e00640 1 -- 172.21.15.144:0/3280838296 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d34018020 con 0x7f9d3c15ea70 2024-09-12T12:13:06.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d33e00640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d1c0678f0 0x7f9d1c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:06.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d33e00640 1 -- 172.21.15.144:0/3280838296 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9d34085e50 con 0x7f9d3c15ea70 2024-09-12T12:13:06.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d3be00640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d1c0678f0 0x7f9d1c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:06.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.701+0000 7f9d3be00640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d1c0678f0 0x7f9d1c069db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0012f0 tx=0x7f9d2c0019a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:06.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.705+0000 7f9d33e00640 1 -- 172.21.15.144:0/3280838296 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9d3401f020 con 0x7f9d3c15ea70 2024-09-12T12:13:06.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.861+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d3c0b67d0 con 0x7f9d1c0678f0 2024-09-12T12:13:06.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.869+0000 7f9d33e00640 1 -- 172.21.15.144:0/3280838296 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f9d3c0b67d0 con 0x7f9d1c0678f0 2024-09-12T12:13:06.873 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:06.875 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d1c0678f0 msgr2=0x7f9d1c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d1c0678f0 0x7f9d1c069db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0012f0 tx=0x7f9d2c0019a0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c15ea70 msgr2=0x7f9d3c13d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c15ea70 0x7f9d3c13d370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b440 tx=0x7f9d3400b900 comp rx=0 tx=0).stop 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 shutdown_connections 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d1c0678f0 0x7f9d1c069db0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c15ea70 0x7f9d3c13d370 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d3c147fa0 0x7f9d3c159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 --2- 172.21.15.144:0/3280838296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d3c0cf210 0x7f9d3c13df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 >> 172.21.15.144:0/3280838296 conn(0x7f9d3c06cd20 msgr2=0x7f9d3c146c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:06.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 shutdown_connections 2024-09-12T12:13:06.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:06.873+0000 7f9d43200640 1 -- 172.21.15.144:0/3280838296 wait complete. 2024-09-12T12:13:06.892 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-12T12:13:05.380072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3383296,"data_stored":2029436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003361"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513364+0000","last_change":"2024-09-12T12:12:43.854827+0000","last_active":"2024-09-12T12:12:50.513364+0000","last_peered":"2024-09-12T12:12:50.513364+0000","last_clean":"2024-09-12T12:12:50.513364+0000","last_became_active":"2024-09-12T12:12:43.854234+0000","last_became_peered":"2024-09-12T12:12:43.854234+0000","last_unstale":"2024-09-12T12:12:50.513364+0000","last_undegraded":"2024-09-12T12:12:50.513364+0000","last_fullsized":"2024-09-12T12:12:50.513364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.059875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177273+0000","last_change":"2024-09-12T12:12:44.850415+0000","last_active":"2024-09-12T12:12:50.177273+0000","last_peered":"2024-09-12T12:12:50.177273+0000","last_clean":"2024-09-12T12:12:50.177273+0000","last_became_active":"2024-09-12T12:12:44.849823+0000","last_became_peered":"2024-09-12T12:12:44.849823+0000","last_unstale":"2024-09-12T12:12:50.177273+0000","last_undegraded":"2024-09-12T12:12:50.177273+0000","last_fullsized":"2024-09-12T12:12:50.177273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176576+0000","last_change":"2024-09-12T12:12:49.236999+0000","last_active":"2024-09-12T12:12:50.176576+0000","last_peered":"2024-09-12T12:12:50.176576+0000","last_clean":"2024-09-12T12:12:50.176576+0000","last_became_active":"2024-09-12T12:12:49.236615+0000","last_became_peered":"2024-09-12T12:12:49.236615+0000","last_unstale":"2024-09-12T12:12:50.176576+0000","last_undegraded":"2024-09-12T12:12:50.176576+0000","last_fullsized":"2024-09-12T12:12:50.176576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.973179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177466+0000","last_change":"2024-09-12T12:12:43.838111+0000","last_active":"2024-09-12T12:12:50.177466+0000","last_peered":"2024-09-12T12:12:50.177466+0000","last_clean":"2024-09-12T12:12:50.177466+0000","last_became_active":"2024-09-12T12:12:43.837789+0000","last_became_peered":"2024-09-12T12:12:43.837789+0000","last_unstale":"2024-09-12T12:12:50.177466+0000","last_undegraded":"2024-09-12T12:12:50.177466+0000","last_fullsized":"2024-09-12T12:12:50.177466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:35.915450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513110+0000","last_change":"2024-09-12T12:12:44.866423+0000","last_active":"2024-09-12T12:12:50.513110+0000","last_peered":"2024-09-12T12:12:50.513110+0000","last_clean":"2024-09-12T12:12:50.513110+0000","last_became_active":"2024-09-12T12:12:44.866168+0000","last_became_peered":"2024-09-12T12:12:44.866168+0000","last_unstale":"2024-09-12T12:12:50.513110+0000","last_undegraded":"2024-09-12T12:12:50.513110+0000","last_fullsized":"2024-09-12T12:12:50.513110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177230+0000","last_change":"2024-09-12T12:12:49.204118+0000","last_active":"2024-09-12T12:12:50.177230+0000","last_peered":"2024-09-12T12:12:50.177230+0000","last_clean":"2024-09-12T12:12:50.177230+0000","last_became_active":"2024-09-12T12:12:49.203691+0000","last_became_peered":"2024-09-12T12:12:49.203691+0000","last_unstale":"2024-09-12T12:12:50.177230+0000","last_undegraded":"2024-09-12T12:12:50.177230+0000","last_fullsized":"2024-09-12T12:12:50.177230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:35.607283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517260+0000","last_change":"2024-09-12T12:12:43.858755+0000","last_active":"2024-09-12T12:12:50.517260+0000","last_peered":"2024-09-12T12:12:50.517260+0000","last_clean":"2024-09-12T12:12:50.517260+0000","last_became_active":"2024-09-12T12:12:43.858306+0000","last_became_peered":"2024-09-12T12:12:43.858306+0000","last_unstale":"2024-09-12T12:12:50.517260+0000","last_undegraded":"2024-09-12T12:12:50.517260+0000","last_fullsized":"2024-09-12T12:12:50.517260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664377+0000","last_change":"2024-09-12T12:12:44.868441+0000","last_active":"2024-09-12T12:12:50.664377+0000","last_peered":"2024-09-12T12:12:50.664377+0000","last_clean":"2024-09-12T12:12:50.664377+0000","last_became_active":"2024-09-12T12:12:44.866463+0000","last_became_peered":"2024-09-12T12:12:44.866463+0000","last_unstale":"2024-09-12T12:12:50.664377+0000","last_undegraded":"2024-09-12T12:12:50.664377+0000","last_fullsized":"2024-09-12T12:12:50.664377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177347+0000","last_change":"2024-09-12T12:12:49.196167+0000","last_active":"2024-09-12T12:12:50.177347+0000","last_peered":"2024-09-12T12:12:50.177347+0000","last_clean":"2024-09-12T12:12:50.177347+0000","last_became_active":"2024-09-12T12:12:49.195584+0000","last_became_peered":"2024-09-12T12:12:49.195584+0000","last_unstale":"2024-09-12T12:12:50.177347+0000","last_undegraded":"2024-09-12T12:12:50.177347+0000","last_fullsized":"2024-09-12T12:12:50.177347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:21.660305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516953+0000","last_change":"2024-09-12T12:12:43.858662+0000","last_active":"2024-09-12T12:12:50.516953+0000","last_peered":"2024-09-12T12:12:50.516953+0000","last_clean":"2024-09-12T12:12:50.516953+0000","last_became_active":"2024-09-12T12:12:43.858322+0000","last_became_peered":"2024-09-12T12:12:43.858322+0000","last_unstale":"2024-09-12T12:12:50.516953+0000","last_undegraded":"2024-09-12T12:12:50.516953+0000","last_fullsized":"2024-09-12T12:12:50.516953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664591+0000","last_change":"2024-09-12T12:12:44.863427+0000","last_active":"2024-09-12T12:12:50.664591+0000","last_peered":"2024-09-12T12:12:50.664591+0000","last_clean":"2024-09-12T12:12:50.664591+0000","last_became_active":"2024-09-12T12:12:44.863173+0000","last_became_peered":"2024-09-12T12:12:44.863173+0000","last_unstale":"2024-09-12T12:12:50.664591+0000","last_undegraded":"2024-09-12T12:12:50.664591+0000","last_fullsized":"2024-09-12T12:12:50.664591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:15.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177891+0000","last_change":"2024-09-12T12:12:49.196228+0000","last_active":"2024-09-12T12:12:50.177891+0000","last_peered":"2024-09-12T12:12:50.177891+0000","last_clean":"2024-09-12T12:12:50.177891+0000","last_became_active":"2024-09-12T12:12:49.195611+0000","last_became_peered":"2024-09-12T12:12:49.195611+0000","last_unstale":"2024-09-12T12:12:50.177891+0000","last_undegraded":"2024-09-12T12:12:50.177891+0000","last_fullsized":"2024-09-12T12:12:50.177891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:48.359326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177371+0000","last_change":"2024-09-12T12:12:44.846595+0000","last_active":"2024-09-12T12:12:50.177371+0000","last_peered":"2024-09-12T12:12:50.177371+0000","last_clean":"2024-09-12T12:12:50.177371+0000","last_became_active":"2024-09-12T12:12:44.846334+0000","last_became_peered":"2024-09-12T12:12:44.846334+0000","last_unstale":"2024-09-12T12:12:50.177371+0000","last_undegraded":"2024-09-12T12:12:50.177371+0000","last_fullsized":"2024-09-12T12:12:50.177371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516972+0000","last_change":"2024-09-12T12:12:43.857695+0000","last_active":"2024-09-12T12:12:50.516972+0000","last_peered":"2024-09-12T12:12:50.516972+0000","last_clean":"2024-09-12T12:12:50.516972+0000","last_became_active":"2024-09-12T12:12:43.857427+0000","last_became_peered":"2024-09-12T12:12:43.857427+0000","last_unstale":"2024-09-12T12:12:50.516972+0000","last_undegraded":"2024-09-12T12:12:50.516972+0000","last_fullsized":"2024-09-12T12:12:50.516972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:35.915450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179125+0000","last_change":"2024-09-12T12:12:49.190846+0000","last_active":"2024-09-12T12:12:50.179125+0000","last_peered":"2024-09-12T12:12:50.179125+0000","last_clean":"2024-09-12T12:12:50.179125+0000","last_became_active":"2024-09-12T12:12:49.190417+0000","last_became_peered":"2024-09-12T12:12:49.190417+0000","last_unstale":"2024-09-12T12:12:50.179125+0000","last_undegraded":"2024-09-12T12:12:50.179125+0000","last_fullsized":"2024-09-12T12:12:50.179125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176911+0000","last_change":"2024-09-12T12:12:44.866244+0000","last_active":"2024-09-12T12:12:50.176911+0000","last_peered":"2024-09-12T12:12:50.176911+0000","last_clean":"2024-09-12T12:12:50.176911+0000","last_became_active":"2024-09-12T12:12:44.862336+0000","last_became_peered":"2024-09-12T12:12:44.862336+0000","last_unstale":"2024-09-12T12:12:50.176911+0000","last_undegraded":"2024-09-12T12:12:50.176911+0000","last_fullsized":"2024-09-12T12:12:50.176911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125510+0000","last_change":"2024-09-12T12:12:43.842526+0000","last_active":"2024-09-12T12:12:51.125510+0000","last_peered":"2024-09-12T12:12:51.125510+0000","last_clean":"2024-09-12T12:12:51.125510+0000","last_became_active":"2024-09-12T12:12:43.842238+0000","last_became_peered":"2024-09-12T12:12:43.842238+0000","last_unstale":"2024-09-12T12:12:51.125510+0000","last_undegraded":"2024-09-12T12:12:51.125510+0000","last_fullsized":"2024-09-12T12:12:51.125510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178671+0000","last_change":"2024-09-12T12:12:49.204542+0000","last_active":"2024-09-12T12:12:50.178671+0000","last_peered":"2024-09-12T12:12:50.178671+0000","last_clean":"2024-09-12T12:12:50.178671+0000","last_became_active":"2024-09-12T12:12:49.204013+0000","last_became_peered":"2024-09-12T12:12:49.204013+0000","last_unstale":"2024-09-12T12:12:50.178671+0000","last_undegraded":"2024-09-12T12:12:50.178671+0000","last_fullsized":"2024-09-12T12:12:50.178671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:36.758809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176780+0000","last_change":"2024-09-12T12:12:44.861505+0000","last_active":"2024-09-12T12:12:50.176780+0000","last_peered":"2024-09-12T12:12:50.176780+0000","last_clean":"2024-09-12T12:12:50.176780+0000","last_became_active":"2024-09-12T12:12:44.861217+0000","last_became_peered":"2024-09-12T12:12:44.861217+0000","last_unstale":"2024-09-12T12:12:50.176780+0000","last_undegraded":"2024-09-12T12:12:50.176780+0000","last_fullsized":"2024-09-12T12:12:50.176780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125097+0000","last_change":"2024-09-12T12:12:43.846034+0000","last_active":"2024-09-12T12:12:51.125097+0000","last_peered":"2024-09-12T12:12:51.125097+0000","last_clean":"2024-09-12T12:12:51.125097+0000","last_became_active":"2024-09-12T12:12:43.845492+0000","last_became_peered":"2024-09-12T12:12:43.845492+0000","last_unstale":"2024-09-12T12:12:51.125097+0000","last_undegraded":"2024-09-12T12:12:51.125097+0000","last_fullsized":"2024-09-12T12:12:51.125097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125970+0000","last_change":"2024-09-12T12:12:49.238233+0000","last_active":"2024-09-12T12:12:51.125970+0000","last_peered":"2024-09-12T12:12:51.125970+0000","last_clean":"2024-09-12T12:12:51.125970+0000","last_became_active":"2024-09-12T12:12:49.237705+0000","last_became_peered":"2024-09-12T12:12:49.237705+0000","last_unstale":"2024-09-12T12:12:51.125970+0000","last_undegraded":"2024-09-12T12:12:51.125970+0000","last_fullsized":"2024-09-12T12:12:51.125970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:21.360400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177834+0000","last_change":"2024-09-12T12:12:44.854329+0000","last_active":"2024-09-12T12:12:50.177834+0000","last_peered":"2024-09-12T12:12:50.177834+0000","last_clean":"2024-09-12T12:12:50.177834+0000","last_became_active":"2024-09-12T12:12:44.854125+0000","last_became_peered":"2024-09-12T12:12:44.854125+0000","last_unstale":"2024-09-12T12:12:50.177834+0000","last_undegraded":"2024-09-12T12:12:50.177834+0000","last_fullsized":"2024-09-12T12:12:50.177834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:09.458022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516448+0000","last_change":"2024-09-12T12:12:43.853652+0000","last_active":"2024-09-12T12:12:50.516448+0000","last_peered":"2024-09-12T12:12:50.516448+0000","last_clean":"2024-09-12T12:12:50.516448+0000","last_became_active":"2024-09-12T12:12:43.853375+0000","last_became_peered":"2024-09-12T12:12:43.853375+0000","last_unstale":"2024-09-12T12:12:50.516448+0000","last_undegraded":"2024-09-12T12:12:50.516448+0000","last_fullsized":"2024-09-12T12:12:50.516448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179414+0000","last_change":"2024-09-12T12:12:49.196067+0000","last_active":"2024-09-12T12:12:50.179414+0000","last_peered":"2024-09-12T12:12:50.179414+0000","last_clean":"2024-09-12T12:12:50.179414+0000","last_became_active":"2024-09-12T12:12:49.195668+0000","last_became_peered":"2024-09-12T12:12:49.195668+0000","last_unstale":"2024-09-12T12:12:50.179414+0000","last_undegraded":"2024-09-12T12:12:50.179414+0000","last_fullsized":"2024-09-12T12:12:50.179414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:40.014673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513018+0000","last_change":"2024-09-12T12:12:44.843136+0000","last_active":"2024-09-12T12:12:50.513018+0000","last_peered":"2024-09-12T12:12:50.513018+0000","last_clean":"2024-09-12T12:12:50.513018+0000","last_became_active":"2024-09-12T12:12:44.842828+0000","last_became_peered":"2024-09-12T12:12:44.842828+0000","last_unstale":"2024-09-12T12:12:50.513018+0000","last_undegraded":"2024-09-12T12:12:50.513018+0000","last_fullsized":"2024-09-12T12:12:50.513018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178520+0000","last_change":"2024-09-12T12:12:43.853992+0000","last_active":"2024-09-12T12:12:50.178520+0000","last_peered":"2024-09-12T12:12:50.178520+0000","last_clean":"2024-09-12T12:12:50.178520+0000","last_became_active":"2024-09-12T12:12:43.853565+0000","last_became_peered":"2024-09-12T12:12:43.853565+0000","last_unstale":"2024-09-12T12:12:50.178520+0000","last_undegraded":"2024-09-12T12:12:50.178520+0000","last_fullsized":"2024-09-12T12:12:50.178520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177496+0000","last_change":"2024-09-12T12:12:49.237840+0000","last_active":"2024-09-12T12:12:50.177496+0000","last_peered":"2024-09-12T12:12:50.177496+0000","last_clean":"2024-09-12T12:12:50.177496+0000","last_became_active":"2024-09-12T12:12:49.237366+0000","last_became_peered":"2024-09-12T12:12:49.237366+0000","last_unstale":"2024-09-12T12:12:50.177496+0000","last_undegraded":"2024-09-12T12:12:50.177496+0000","last_fullsized":"2024-09-12T12:12:50.177496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:32.420795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177705+0000","last_change":"2024-09-12T12:12:44.863064+0000","last_active":"2024-09-12T12:12:50.177705+0000","last_peered":"2024-09-12T12:12:50.177705+0000","last_clean":"2024-09-12T12:12:50.177705+0000","last_became_active":"2024-09-12T12:12:44.862295+0000","last_became_peered":"2024-09-12T12:12:44.862295+0000","last_unstale":"2024-09-12T12:12:50.177705+0000","last_undegraded":"2024-09-12T12:12:50.177705+0000","last_fullsized":"2024-09-12T12:12:50.177705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126177+0000","last_change":"2024-09-12T12:12:43.844539+0000","last_active":"2024-09-12T12:12:51.126177+0000","last_peered":"2024-09-12T12:12:51.126177+0000","last_clean":"2024-09-12T12:12:51.126177+0000","last_became_active":"2024-09-12T12:12:43.844303+0000","last_became_peered":"2024-09-12T12:12:43.844303+0000","last_unstale":"2024-09-12T12:12:51.126177+0000","last_undegraded":"2024-09-12T12:12:51.126177+0000","last_fullsized":"2024-09-12T12:12:51.126177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176517+0000","last_change":"2024-09-12T12:12:49.234495+0000","last_active":"2024-09-12T12:12:50.176517+0000","last_peered":"2024-09-12T12:12:50.176517+0000","last_clean":"2024-09-12T12:12:50.176517+0000","last_became_active":"2024-09-12T12:12:49.233400+0000","last_became_peered":"2024-09-12T12:12:49.233400+0000","last_unstale":"2024-09-12T12:12:50.176517+0000","last_undegraded":"2024-09-12T12:12:50.176517+0000","last_fullsized":"2024-09-12T12:12:50.176517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:09.355445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126175+0000","last_change":"2024-09-12T12:12:44.848284+0000","last_active":"2024-09-12T12:12:51.126175+0000","last_peered":"2024-09-12T12:12:51.126175+0000","last_clean":"2024-09-12T12:12:51.126175+0000","last_became_active":"2024-09-12T12:12:44.848024+0000","last_became_peered":"2024-09-12T12:12:44.848024+0000","last_unstale":"2024-09-12T12:12:51.126175+0000","last_undegraded":"2024-09-12T12:12:51.126175+0000","last_fullsized":"2024-09-12T12:12:51.126175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517386+0000","last_change":"2024-09-12T12:12:43.855069+0000","last_active":"2024-09-12T12:12:50.517386+0000","last_peered":"2024-09-12T12:12:50.517386+0000","last_clean":"2024-09-12T12:12:50.517386+0000","last_became_active":"2024-09-12T12:12:43.854801+0000","last_became_peered":"2024-09-12T12:12:43.854801+0000","last_unstale":"2024-09-12T12:12:50.517386+0000","last_undegraded":"2024-09-12T12:12:50.517386+0000","last_fullsized":"2024-09-12T12:12:50.517386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:10:14.539671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512594+0000","last_change":"2024-09-12T12:12:49.236330+0000","last_active":"2024-09-12T12:12:50.512594+0000","last_peered":"2024-09-12T12:12:50.512594+0000","last_clean":"2024-09-12T12:12:50.512594+0000","last_became_active":"2024-09-12T12:12:49.235941+0000","last_became_peered":"2024-09-12T12:12:49.235941+0000","last_unstale":"2024-09-12T12:12:50.512594+0000","last_undegraded":"2024-09-12T12:12:50.512594+0000","last_fullsized":"2024-09-12T12:12:50.512594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:21.360400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664641+0000","last_change":"2024-09-12T12:12:44.865593+0000","last_active":"2024-09-12T12:12:50.664641+0000","last_peered":"2024-09-12T12:12:50.664641+0000","last_clean":"2024-09-12T12:12:50.664641+0000","last_became_active":"2024-09-12T12:12:44.865207+0000","last_became_peered":"2024-09-12T12:12:44.865207+0000","last_unstale":"2024-09-12T12:12:50.664641+0000","last_undegraded":"2024-09-12T12:12:50.664641+0000","last_fullsized":"2024-09-12T12:12:50.664641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:35.665829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126175+0000","last_change":"2024-09-12T12:12:43.840268+0000","last_active":"2024-09-12T12:12:51.126175+0000","last_peered":"2024-09-12T12:12:51.126175+0000","last_clean":"2024-09-12T12:12:51.126175+0000","last_became_active":"2024-09-12T12:12:43.839978+0000","last_became_peered":"2024-09-12T12:12:43.839978+0000","last_unstale":"2024-09-12T12:12:51.126175+0000","last_undegraded":"2024-09-12T12:12:51.126175+0000","last_fullsized":"2024-09-12T12:12:51.126175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125228+0000","last_change":"2024-09-12T12:12:49.201974+0000","last_active":"2024-09-12T12:12:51.125228+0000","last_peered":"2024-09-12T12:12:51.125228+0000","last_clean":"2024-09-12T12:12:51.125228+0000","last_became_active":"2024-09-12T12:12:49.201363+0000","last_became_peered":"2024-09-12T12:12:49.201363+0000","last_unstale":"2024-09-12T12:12:51.125228+0000","last_undegraded":"2024-09-12T12:12:51.125228+0000","last_fullsized":"2024-09-12T12:12:51.125228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179210+0000","last_change":"2024-09-12T12:12:44.850770+0000","last_active":"2024-09-12T12:12:50.179210+0000","last_peered":"2024-09-12T12:12:50.179210+0000","last_clean":"2024-09-12T12:12:50.179210+0000","last_became_active":"2024-09-12T12:12:44.842455+0000","last_became_peered":"2024-09-12T12:12:44.842455+0000","last_unstale":"2024-09-12T12:12:50.179210+0000","last_undegraded":"2024-09-12T12:12:50.179210+0000","last_fullsized":"2024-09-12T12:12:50.179210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:15.274937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664457+0000","last_change":"2024-09-12T12:12:43.848461+0000","last_active":"2024-09-12T12:12:50.664457+0000","last_peered":"2024-09-12T12:12:50.664457+0000","last_clean":"2024-09-12T12:12:50.664457+0000","last_became_active":"2024-09-12T12:12:43.847953+0000","last_became_peered":"2024-09-12T12:12:43.847953+0000","last_unstale":"2024-09-12T12:12:50.664457+0000","last_undegraded":"2024-09-12T12:12:50.664457+0000","last_fullsized":"2024-09-12T12:12:50.664457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126063+0000","last_change":"2024-09-12T12:12:49.200796+0000","last_active":"2024-09-12T12:12:51.126063+0000","last_peered":"2024-09-12T12:12:51.126063+0000","last_clean":"2024-09-12T12:12:51.126063+0000","last_became_active":"2024-09-12T12:12:49.200352+0000","last_became_peered":"2024-09-12T12:12:49.200352+0000","last_unstale":"2024-09-12T12:12:51.126063+0000","last_undegraded":"2024-09-12T12:12:51.126063+0000","last_fullsized":"2024-09-12T12:12:51.126063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:54.688541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125166+0000","last_change":"2024-09-12T12:12:44.861229+0000","last_active":"2024-09-12T12:12:51.125166+0000","last_peered":"2024-09-12T12:12:51.125166+0000","last_clean":"2024-09-12T12:12:51.125166+0000","last_became_active":"2024-09-12T12:12:44.855880+0000","last_became_peered":"2024-09-12T12:12:44.855880+0000","last_unstale":"2024-09-12T12:12:51.125166+0000","last_undegraded":"2024-09-12T12:12:51.125166+0000","last_fullsized":"2024-09-12T12:12:51.125166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124771+0000","last_change":"2024-09-12T12:12:43.843781+0000","last_active":"2024-09-12T12:12:51.124771+0000","last_peered":"2024-09-12T12:12:51.124771+0000","last_clean":"2024-09-12T12:12:51.124771+0000","last_became_active":"2024-09-12T12:12:43.843510+0000","last_became_peered":"2024-09-12T12:12:43.843510+0000","last_unstale":"2024-09-12T12:12:51.124771+0000","last_undegraded":"2024-09-12T12:12:51.124771+0000","last_fullsized":"2024-09-12T12:12:51.124771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126036+0000","last_change":"2024-09-12T12:12:49.201170+0000","last_active":"2024-09-12T12:12:51.126036+0000","last_peered":"2024-09-12T12:12:51.126036+0000","last_clean":"2024-09-12T12:12:51.126036+0000","last_became_active":"2024-09-12T12:12:49.200754+0000","last_became_peered":"2024-09-12T12:12:49.200754+0000","last_unstale":"2024-09-12T12:12:51.126036+0000","last_undegraded":"2024-09-12T12:12:51.126036+0000","last_fullsized":"2024-09-12T12:12:51.126036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:33.368245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512181+0000","last_change":"2024-09-12T12:12:44.839123+0000","last_active":"2024-09-12T12:12:50.512181+0000","last_peered":"2024-09-12T12:12:50.512181+0000","last_clean":"2024-09-12T12:12:50.512181+0000","last_became_active":"2024-09-12T12:12:44.838887+0000","last_became_peered":"2024-09-12T12:12:44.838887+0000","last_unstale":"2024-09-12T12:12:50.512181+0000","last_undegraded":"2024-09-12T12:12:50.512181+0000","last_fullsized":"2024-09-12T12:12:50.512181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:31.037954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516448+0000","last_change":"2024-09-12T12:12:43.853714+0000","last_active":"2024-09-12T12:12:50.516448+0000","last_peered":"2024-09-12T12:12:50.516448+0000","last_clean":"2024-09-12T12:12:50.516448+0000","last_became_active":"2024-09-12T12:12:43.853354+0000","last_became_peered":"2024-09-12T12:12:43.853354+0000","last_unstale":"2024-09-12T12:12:50.516448+0000","last_undegraded":"2024-09-12T12:12:50.516448+0000","last_fullsized":"2024-09-12T12:12:50.516448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512950+0000","last_change":"2024-09-12T12:12:49.233432+0000","last_active":"2024-09-12T12:12:50.512950+0000","last_peered":"2024-09-12T12:12:50.512950+0000","last_clean":"2024-09-12T12:12:50.512950+0000","last_became_active":"2024-09-12T12:12:49.232960+0000","last_became_peered":"2024-09-12T12:12:49.232960+0000","last_unstale":"2024-09-12T12:12:50.512950+0000","last_undegraded":"2024-09-12T12:12:50.512950+0000","last_fullsized":"2024-09-12T12:12:50.512950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:29.872131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176900+0000","last_change":"2024-09-12T12:12:44.866650+0000","last_active":"2024-09-12T12:12:50.176900+0000","last_peered":"2024-09-12T12:12:50.176900+0000","last_clean":"2024-09-12T12:12:50.176900+0000","last_became_active":"2024-09-12T12:12:44.866307+0000","last_became_peered":"2024-09-12T12:12:44.866307+0000","last_unstale":"2024-09-12T12:12:50.176900+0000","last_undegraded":"2024-09-12T12:12:50.176900+0000","last_fullsized":"2024-09-12T12:12:50.176900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664136+0000","last_change":"2024-09-12T12:12:43.850483+0000","last_active":"2024-09-12T12:12:50.664136+0000","last_peered":"2024-09-12T12:12:50.664136+0000","last_clean":"2024-09-12T12:12:50.664136+0000","last_became_active":"2024-09-12T12:12:43.850143+0000","last_became_peered":"2024-09-12T12:12:43.850143+0000","last_unstale":"2024-09-12T12:12:50.664136+0000","last_undegraded":"2024-09-12T12:12:50.664136+0000","last_fullsized":"2024-09-12T12:12:50.664136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516596+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:12:50.516596+0000","last_peered":"2024-09-12T12:12:50.516596+0000","last_clean":"2024-09-12T12:12:50.516596+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:12:50.516596+0000","last_undegraded":"2024-09-12T12:12:50.516596+0000","last_fullsized":"2024-09-12T12:12:50.516596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178235+0000","last_change":"2024-09-12T12:12:49.235904+0000","last_active":"2024-09-12T12:12:50.178235+0000","last_peered":"2024-09-12T12:12:50.178235+0000","last_clean":"2024-09-12T12:12:50.178235+0000","last_became_active":"2024-09-12T12:12:49.235548+0000","last_became_peered":"2024-09-12T12:12:49.235548+0000","last_unstale":"2024-09-12T12:12:50.178235+0000","last_undegraded":"2024-09-12T12:12:50.178235+0000","last_fullsized":"2024-09-12T12:12:50.178235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517137+0000","last_change":"2024-09-12T12:12:44.866993+0000","last_active":"2024-09-12T12:12:50.517137+0000","last_peered":"2024-09-12T12:12:50.517137+0000","last_clean":"2024-09-12T12:12:50.517137+0000","last_became_active":"2024-09-12T12:12:44.866717+0000","last_became_peered":"2024-09-12T12:12:44.866717+0000","last_unstale":"2024-09-12T12:12:50.517137+0000","last_undegraded":"2024-09-12T12:12:50.517137+0000","last_fullsized":"2024-09-12T12:12:50.517137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:29.019401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125386+0000","last_change":"2024-09-12T12:12:43.857565+0000","last_active":"2024-09-12T12:12:51.125386+0000","last_peered":"2024-09-12T12:12:51.125386+0000","last_clean":"2024-09-12T12:12:51.125386+0000","last_became_active":"2024-09-12T12:12:43.857320+0000","last_became_peered":"2024-09-12T12:12:43.857320+0000","last_unstale":"2024-09-12T12:12:51.125386+0000","last_undegraded":"2024-09-12T12:12:51.125386+0000","last_fullsized":"2024-09-12T12:12:51.125386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177268+0000","last_change":"2024-09-12T12:12:49.233077+0000","last_active":"2024-09-12T12:12:50.177268+0000","last_peered":"2024-09-12T12:12:50.177268+0000","last_clean":"2024-09-12T12:12:50.177268+0000","last_became_active":"2024-09-12T12:12:49.232399+0000","last_became_peered":"2024-09-12T12:12:49.232399+0000","last_unstale":"2024-09-12T12:12:50.177268+0000","last_undegraded":"2024-09-12T12:12:50.177268+0000","last_fullsized":"2024-09-12T12:12:50.177268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:36.758809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664546+0000","last_change":"2024-09-12T12:12:44.863346+0000","last_active":"2024-09-12T12:12:50.664546+0000","last_peered":"2024-09-12T12:12:50.664546+0000","last_clean":"2024-09-12T12:12:50.664546+0000","last_became_active":"2024-09-12T12:12:44.863022+0000","last_became_peered":"2024-09-12T12:12:44.863022+0000","last_unstale":"2024-09-12T12:12:50.664546+0000","last_undegraded":"2024-09-12T12:12:50.664546+0000","last_fullsized":"2024-09-12T12:12:50.664546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125799+0000","last_change":"2024-09-12T12:12:43.843497+0000","last_active":"2024-09-12T12:12:51.125799+0000","last_peered":"2024-09-12T12:12:51.125799+0000","last_clean":"2024-09-12T12:12:51.125799+0000","last_became_active":"2024-09-12T12:12:43.843205+0000","last_became_peered":"2024-09-12T12:12:43.843205+0000","last_unstale":"2024-09-12T12:12:51.125799+0000","last_undegraded":"2024-09-12T12:12:51.125799+0000","last_fullsized":"2024-09-12T12:12:51.125799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512708+0000","last_change":"2024-09-12T12:12:49.194951+0000","last_active":"2024-09-12T12:12:50.512708+0000","last_peered":"2024-09-12T12:12:50.512708+0000","last_clean":"2024-09-12T12:12:50.512708+0000","last_became_active":"2024-09-12T12:12:49.193406+0000","last_became_peered":"2024-09-12T12:12:49.193406+0000","last_unstale":"2024-09-12T12:12:50.512708+0000","last_undegraded":"2024-09-12T12:12:50.512708+0000","last_fullsized":"2024-09-12T12:12:50.512708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:33.368245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517235+0000","last_change":"2024-09-12T12:12:44.873360+0000","last_active":"2024-09-12T12:12:50.517235+0000","last_peered":"2024-09-12T12:12:50.517235+0000","last_clean":"2024-09-12T12:12:50.517235+0000","last_became_active":"2024-09-12T12:12:44.871164+0000","last_became_peered":"2024-09-12T12:12:44.871164+0000","last_unstale":"2024-09-12T12:12:50.517235+0000","last_undegraded":"2024-09-12T12:12:50.517235+0000","last_fullsized":"2024-09-12T12:12:50.517235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:15.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125672+0000","last_change":"2024-09-12T12:12:43.844520+0000","last_active":"2024-09-12T12:12:51.125672+0000","last_peered":"2024-09-12T12:12:51.125672+0000","last_clean":"2024-09-12T12:12:51.125672+0000","last_became_active":"2024-09-12T12:12:43.844192+0000","last_became_peered":"2024-09-12T12:12:43.844192+0000","last_unstale":"2024-09-12T12:12:51.125672+0000","last_undegraded":"2024-09-12T12:12:51.125672+0000","last_fullsized":"2024-09-12T12:12:51.125672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663736+0000","last_change":"2024-09-12T12:12:49.235687+0000","last_active":"2024-09-12T12:12:50.663736+0000","last_peered":"2024-09-12T12:12:50.663736+0000","last_clean":"2024-09-12T12:12:50.663736+0000","last_became_active":"2024-09-12T12:12:49.235279+0000","last_became_peered":"2024-09-12T12:12:49.235279+0000","last_unstale":"2024-09-12T12:12:50.663736+0000","last_undegraded":"2024-09-12T12:12:50.663736+0000","last_fullsized":"2024-09-12T12:12:50.663736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:09.355445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517127+0000","last_change":"2024-09-12T12:12:44.869312+0000","last_active":"2024-09-12T12:12:50.517127+0000","last_peered":"2024-09-12T12:12:50.517127+0000","last_clean":"2024-09-12T12:12:50.517127+0000","last_became_active":"2024-09-12T12:12:44.869049+0000","last_became_peered":"2024-09-12T12:12:44.869049+0000","last_unstale":"2024-09-12T12:12:50.517127+0000","last_undegraded":"2024-09-12T12:12:50.517127+0000","last_fullsized":"2024-09-12T12:12:50.517127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178843+0000","last_change":"2024-09-12T12:12:43.850258+0000","last_active":"2024-09-12T12:12:50.178843+0000","last_peered":"2024-09-12T12:12:50.178843+0000","last_clean":"2024-09-12T12:12:50.178843+0000","last_became_active":"2024-09-12T12:12:43.849933+0000","last_became_peered":"2024-09-12T12:12:43.849933+0000","last_unstale":"2024-09-12T12:12:50.178843+0000","last_undegraded":"2024-09-12T12:12:50.178843+0000","last_fullsized":"2024-09-12T12:12:50.178843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.059875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177247+0000","last_change":"2024-09-12T12:12:49.204097+0000","last_active":"2024-09-12T12:12:50.177247+0000","last_peered":"2024-09-12T12:12:50.177247+0000","last_clean":"2024-09-12T12:12:50.177247+0000","last_became_active":"2024-09-12T12:12:49.203718+0000","last_became_peered":"2024-09-12T12:12:49.203718+0000","last_unstale":"2024-09-12T12:12:50.177247+0000","last_undegraded":"2024-09-12T12:12:50.177247+0000","last_fullsized":"2024-09-12T12:12:50.177247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:40.026171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516739+0000","last_change":"2024-09-12T12:12:44.869271+0000","last_active":"2024-09-12T12:12:50.516739+0000","last_peered":"2024-09-12T12:12:50.516739+0000","last_clean":"2024-09-12T12:12:50.516739+0000","last_became_active":"2024-09-12T12:12:44.868992+0000","last_became_peered":"2024-09-12T12:12:44.868992+0000","last_unstale":"2024-09-12T12:12:50.516739+0000","last_undegraded":"2024-09-12T12:12:50.516739+0000","last_fullsized":"2024-09-12T12:12:50.516739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:17.011556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124631+0000","last_change":"2024-09-12T12:12:43.838202+0000","last_active":"2024-09-12T12:12:51.124631+0000","last_peered":"2024-09-12T12:12:51.124631+0000","last_clean":"2024-09-12T12:12:51.124631+0000","last_became_active":"2024-09-12T12:12:43.837927+0000","last_became_peered":"2024-09-12T12:12:43.837927+0000","last_unstale":"2024-09-12T12:12:51.124631+0000","last_undegraded":"2024-09-12T12:12:51.124631+0000","last_fullsized":"2024-09-12T12:12:51.124631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:57.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512786+0000","last_change":"2024-09-12T12:12:49.204734+0000","last_active":"2024-09-12T12:12:50.512786+0000","last_peered":"2024-09-12T12:12:50.512786+0000","last_clean":"2024-09-12T12:12:50.512786+0000","last_became_active":"2024-09-12T12:12:49.204387+0000","last_became_peered":"2024-09-12T12:12:49.204387+0000","last_unstale":"2024-09-12T12:12:50.512786+0000","last_undegraded":"2024-09-12T12:12:50.512786+0000","last_fullsized":"2024-09-12T12:12:50.512786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.325777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177498+0000","last_change":"2024-09-12T12:12:44.836998+0000","last_active":"2024-09-12T12:12:50.177498+0000","last_peered":"2024-09-12T12:12:50.177498+0000","last_clean":"2024-09-12T12:12:50.177498+0000","last_became_active":"2024-09-12T12:12:44.836723+0000","last_became_peered":"2024-09-12T12:12:44.836723+0000","last_unstale":"2024-09-12T12:12:50.177498+0000","last_undegraded":"2024-09-12T12:12:50.177498+0000","last_fullsized":"2024-09-12T12:12:50.177498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177648+0000","last_change":"2024-09-12T12:12:43.847610+0000","last_active":"2024-09-12T12:12:50.177648+0000","last_peered":"2024-09-12T12:12:50.177648+0000","last_clean":"2024-09-12T12:12:50.177648+0000","last_became_active":"2024-09-12T12:12:43.846782+0000","last_became_peered":"2024-09-12T12:12:43.846782+0000","last_unstale":"2024-09-12T12:12:50.177648+0000","last_undegraded":"2024-09-12T12:12:50.177648+0000","last_fullsized":"2024-09-12T12:12:50.177648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177641+0000","last_change":"2024-09-12T12:12:49.237439+0000","last_active":"2024-09-12T12:12:50.177641+0000","last_peered":"2024-09-12T12:12:50.177641+0000","last_clean":"2024-09-12T12:12:50.177641+0000","last_became_active":"2024-09-12T12:12:49.236640+0000","last_became_peered":"2024-09-12T12:12:49.236640+0000","last_unstale":"2024-09-12T12:12:50.177641+0000","last_undegraded":"2024-09-12T12:12:50.177641+0000","last_fullsized":"2024-09-12T12:12:50.177641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:48.564758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516862+0000","last_change":"2024-09-12T12:12:44.870489+0000","last_active":"2024-09-12T12:12:50.516862+0000","last_peered":"2024-09-12T12:12:50.516862+0000","last_clean":"2024-09-12T12:12:50.516862+0000","last_became_active":"2024-09-12T12:12:44.869985+0000","last_became_peered":"2024-09-12T12:12:44.869985+0000","last_unstale":"2024-09-12T12:12:50.516862+0000","last_undegraded":"2024-09-12T12:12:50.516862+0000","last_fullsized":"2024-09-12T12:12:50.516862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:35.665829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664336+0000","last_change":"2024-09-12T12:12:43.855159+0000","last_active":"2024-09-12T12:12:50.664336+0000","last_peered":"2024-09-12T12:12:50.664336+0000","last_clean":"2024-09-12T12:12:50.664336+0000","last_became_active":"2024-09-12T12:12:43.854881+0000","last_became_peered":"2024-09-12T12:12:43.854881+0000","last_unstale":"2024-09-12T12:12:50.664336+0000","last_undegraded":"2024-09-12T12:12:50.664336+0000","last_fullsized":"2024-09-12T12:12:50.664336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177172+0000","last_change":"2024-09-12T12:12:49.238471+0000","last_active":"2024-09-12T12:12:50.177172+0000","last_peered":"2024-09-12T12:12:50.177172+0000","last_clean":"2024-09-12T12:12:50.177172+0000","last_became_active":"2024-09-12T12:12:49.235791+0000","last_became_peered":"2024-09-12T12:12:49.235791+0000","last_unstale":"2024-09-12T12:12:50.177172+0000","last_undegraded":"2024-09-12T12:12:50.177172+0000","last_fullsized":"2024-09-12T12:12:50.177172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:21:33.661174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512468+0000","last_change":"2024-09-12T12:12:44.856728+0000","last_active":"2024-09-12T12:12:50.512468+0000","last_peered":"2024-09-12T12:12:50.512468+0000","last_clean":"2024-09-12T12:12:50.512468+0000","last_became_active":"2024-09-12T12:12:44.856523+0000","last_became_peered":"2024-09-12T12:12:44.856523+0000","last_unstale":"2024-09-12T12:12:50.512468+0000","last_undegraded":"2024-09-12T12:12:50.512468+0000","last_fullsized":"2024-09-12T12:12:50.512468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.435034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512841+0000","last_change":"2024-09-12T12:12:43.845142+0000","last_active":"2024-09-12T12:12:50.512841+0000","last_peered":"2024-09-12T12:12:50.512841+0000","last_clean":"2024-09-12T12:12:50.512841+0000","last_became_active":"2024-09-12T12:12:43.844828+0000","last_became_peered":"2024-09-12T12:12:43.844828+0000","last_unstale":"2024-09-12T12:12:50.512841+0000","last_undegraded":"2024-09-12T12:12:50.512841+0000","last_fullsized":"2024-09-12T12:12:50.512841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:59.203160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664482+0000","last_change":"2024-09-12T12:12:49.233138+0000","last_active":"2024-09-12T12:12:50.664482+0000","last_peered":"2024-09-12T12:12:50.664482+0000","last_clean":"2024-09-12T12:12:50.664482+0000","last_became_active":"2024-09-12T12:12:49.232720+0000","last_became_peered":"2024-09-12T12:12:49.232720+0000","last_unstale":"2024-09-12T12:12:50.664482+0000","last_undegraded":"2024-09-12T12:12:50.664482+0000","last_fullsized":"2024-09-12T12:12:50.664482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.973179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517078+0000","last_change":"2024-09-12T12:12:44.864865+0000","last_active":"2024-09-12T12:12:50.517078+0000","last_peered":"2024-09-12T12:12:50.517078+0000","last_clean":"2024-09-12T12:12:50.517078+0000","last_became_active":"2024-09-12T12:12:44.864611+0000","last_became_peered":"2024-09-12T12:12:44.864611+0000","last_unstale":"2024-09-12T12:12:50.517078+0000","last_undegraded":"2024-09-12T12:12:50.517078+0000","last_fullsized":"2024-09-12T12:12:50.517078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:56.111249+0000","last_change":"2024-09-12T12:12:43.841311+0000","last_active":"2024-09-12T12:12:56.111249+0000","last_peered":"2024-09-12T12:12:56.111249+0000","last_clean":"2024-09-12T12:12:56.111249+0000","last_became_active":"2024-09-12T12:12:43.840143+0000","last_became_peered":"2024-09-12T12:12:43.840143+0000","last_unstale":"2024-09-12T12:12:56.111249+0000","last_undegraded":"2024-09-12T12:12:56.111249+0000","last_fullsized":"2024-09-12T12:12:56.111249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125393+0000","last_change":"2024-09-12T12:12:49.201741+0000","last_active":"2024-09-12T12:12:51.125393+0000","last_peered":"2024-09-12T12:12:51.125393+0000","last_clean":"2024-09-12T12:12:51.125393+0000","last_became_active":"2024-09-12T12:12:49.200783+0000","last_became_peered":"2024-09-12T12:12:49.200783+0000","last_unstale":"2024-09-12T12:12:51.125393+0000","last_undegraded":"2024-09-12T12:12:51.125393+0000","last_fullsized":"2024-09-12T12:12:51.125393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:40.014673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178889+0000","last_change":"2024-09-12T12:12:44.866195+0000","last_active":"2024-09-12T12:12:50.178889+0000","last_peered":"2024-09-12T12:12:50.178889+0000","last_clean":"2024-09-12T12:12:50.178889+0000","last_became_active":"2024-09-12T12:12:44.862903+0000","last_became_peered":"2024-09-12T12:12:44.862903+0000","last_unstale":"2024-09-12T12:12:50.178889+0000","last_undegraded":"2024-09-12T12:12:50.178889+0000","last_fullsized":"2024-09-12T12:12:50.178889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:07.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125724+0000","last_change":"2024-09-12T12:12:43.855996+0000","last_active":"2024-09-12T12:12:51.125724+0000","last_peered":"2024-09-12T12:12:51.125724+0000","last_clean":"2024-09-12T12:12:51.125724+0000","last_became_active":"2024-09-12T12:12:43.855599+0000","last_became_peered":"2024-09-12T12:12:43.855599+0000","last_unstale":"2024-09-12T12:12:51.125724+0000","last_undegraded":"2024-09-12T12:12:51.125724+0000","last_fullsized":"2024-09-12T12:12:51.125724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178966+0000","last_change":"2024-09-12T12:12:49.192756+0000","last_active":"2024-09-12T12:12:50.178966+0000","last_peered":"2024-09-12T12:12:50.178966+0000","last_clean":"2024-09-12T12:12:50.178966+0000","last_became_active":"2024-09-12T12:12:49.192349+0000","last_became_peered":"2024-09-12T12:12:49.192349+0000","last_unstale":"2024-09-12T12:12:50.178966+0000","last_undegraded":"2024-09-12T12:12:50.178966+0000","last_fullsized":"2024-09-12T12:12:50.178966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:04.961251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513276+0000","last_change":"2024-09-12T12:12:44.858876+0000","last_active":"2024-09-12T12:12:50.513276+0000","last_peered":"2024-09-12T12:12:50.513276+0000","last_clean":"2024-09-12T12:12:50.513276+0000","last_became_active":"2024-09-12T12:12:44.858622+0000","last_became_peered":"2024-09-12T12:12:44.858622+0000","last_unstale":"2024-09-12T12:12:50.513276+0000","last_undegraded":"2024-09-12T12:12:50.513276+0000","last_fullsized":"2024-09-12T12:12:50.513276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664332+0000","last_change":"2024-09-12T12:12:43.855782+0000","last_active":"2024-09-12T12:12:50.664332+0000","last_peered":"2024-09-12T12:12:50.664332+0000","last_clean":"2024-09-12T12:12:50.664332+0000","last_became_active":"2024-09-12T12:12:43.855330+0000","last_became_peered":"2024-09-12T12:12:43.855330+0000","last_unstale":"2024-09-12T12:12:50.664332+0000","last_undegraded":"2024-09-12T12:12:50.664332+0000","last_fullsized":"2024-09-12T12:12:50.664332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176677+0000","last_change":"2024-09-12T12:12:49.199551+0000","last_active":"2024-09-12T12:12:50.176677+0000","last_peered":"2024-09-12T12:12:50.176677+0000","last_clean":"2024-09-12T12:12:50.176677+0000","last_became_active":"2024-09-12T12:12:49.199160+0000","last_became_peered":"2024-09-12T12:12:49.199160+0000","last_unstale":"2024-09-12T12:12:50.176677+0000","last_undegraded":"2024-09-12T12:12:50.176677+0000","last_fullsized":"2024-09-12T12:12:50.176677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:55.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664327+0000","last_change":"2024-09-12T12:12:44.861353+0000","last_active":"2024-09-12T12:12:50.664327+0000","last_peered":"2024-09-12T12:12:50.664327+0000","last_clean":"2024-09-12T12:12:50.664327+0000","last_became_active":"2024-09-12T12:12:44.861070+0000","last_became_peered":"2024-09-12T12:12:44.861070+0000","last_unstale":"2024-09-12T12:12:50.664327+0000","last_undegraded":"2024-09-12T12:12:50.664327+0000","last_fullsized":"2024-09-12T12:12:50.664327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178299+0000","last_change":"2024-09-12T12:12:43.856649+0000","last_active":"2024-09-12T12:12:50.178299+0000","last_peered":"2024-09-12T12:12:50.178299+0000","last_clean":"2024-09-12T12:12:50.178299+0000","last_became_active":"2024-09-12T12:12:43.856407+0000","last_became_peered":"2024-09-12T12:12:43.856407+0000","last_unstale":"2024-09-12T12:12:50.178299+0000","last_undegraded":"2024-09-12T12:12:50.178299+0000","last_fullsized":"2024-09-12T12:12:50.178299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176631+0000","last_change":"2024-09-12T12:12:49.234007+0000","last_active":"2024-09-12T12:12:50.176631+0000","last_peered":"2024-09-12T12:12:50.176631+0000","last_clean":"2024-09-12T12:12:50.176631+0000","last_became_active":"2024-09-12T12:12:49.233586+0000","last_became_peered":"2024-09-12T12:12:49.233586+0000","last_unstale":"2024-09-12T12:12:50.176631+0000","last_undegraded":"2024-09-12T12:12:50.176631+0000","last_fullsized":"2024-09-12T12:12:50.176631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:01.336468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512727+0000","last_change":"2024-09-12T12:12:49.239278+0000","last_active":"2024-09-12T12:12:50.512727+0000","last_peered":"2024-09-12T12:12:50.512727+0000","last_clean":"2024-09-12T12:12:50.512727+0000","last_became_active":"2024-09-12T12:12:49.237056+0000","last_became_peered":"2024-09-12T12:12:49.237056+0000","last_unstale":"2024-09-12T12:12:50.512727+0000","last_undegraded":"2024-09-12T12:12:50.512727+0000","last_fullsized":"2024-09-12T12:12:50.512727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:54.688541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124996+0000","last_change":"2024-09-12T12:12:44.849271+0000","last_active":"2024-09-12T12:12:51.124996+0000","last_peered":"2024-09-12T12:12:51.124996+0000","last_clean":"2024-09-12T12:12:51.124996+0000","last_became_active":"2024-09-12T12:12:44.848981+0000","last_became_peered":"2024-09-12T12:12:44.848981+0000","last_unstale":"2024-09-12T12:12:51.124996+0000","last_undegraded":"2024-09-12T12:12:51.124996+0000","last_fullsized":"2024-09-12T12:12:51.124996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664166+0000","last_change":"2024-09-12T12:12:43.850772+0000","last_active":"2024-09-12T12:12:50.664166+0000","last_peered":"2024-09-12T12:12:50.664166+0000","last_clean":"2024-09-12T12:12:50.664166+0000","last_became_active":"2024-09-12T12:12:43.849876+0000","last_became_peered":"2024-09-12T12:12:43.849876+0000","last_unstale":"2024-09-12T12:12:50.664166+0000","last_undegraded":"2024-09-12T12:12:50.664166+0000","last_fullsized":"2024-09-12T12:12:50.664166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178125+0000","last_change":"2024-09-12T12:12:49.197617+0000","last_active":"2024-09-12T12:12:50.178125+0000","last_peered":"2024-09-12T12:12:50.178125+0000","last_clean":"2024-09-12T12:12:50.178125+0000","last_became_active":"2024-09-12T12:12:49.197030+0000","last_became_peered":"2024-09-12T12:12:49.197030+0000","last_unstale":"2024-09-12T12:12:50.178125+0000","last_undegraded":"2024-09-12T12:12:50.178125+0000","last_fullsized":"2024-09-12T12:12:50.178125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:04.961251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176677+0000","last_change":"2024-09-12T12:12:44.861618+0000","last_active":"2024-09-12T12:12:50.176677+0000","last_peered":"2024-09-12T12:12:50.176677+0000","last_clean":"2024-09-12T12:12:50.176677+0000","last_became_active":"2024-09-12T12:12:44.861291+0000","last_became_peered":"2024-09-12T12:12:44.861291+0000","last_unstale":"2024-09-12T12:12:50.176677+0000","last_undegraded":"2024-09-12T12:12:50.176677+0000","last_fullsized":"2024-09-12T12:12:50.176677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176907+0000","last_change":"2024-09-12T12:12:43.843772+0000","last_active":"2024-09-12T12:12:50.176907+0000","last_peered":"2024-09-12T12:12:50.176907+0000","last_clean":"2024-09-12T12:12:50.176907+0000","last_became_active":"2024-09-12T12:12:43.843482+0000","last_became_peered":"2024-09-12T12:12:43.843482+0000","last_unstale":"2024-09-12T12:12:50.176907+0000","last_undegraded":"2024-09-12T12:12:50.176907+0000","last_fullsized":"2024-09-12T12:12:50.176907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:57.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177687+0000","last_change":"2024-09-12T12:12:43.853195+0000","last_active":"2024-09-12T12:12:50.177687+0000","last_peered":"2024-09-12T12:12:50.177687+0000","last_clean":"2024-09-12T12:12:50.177687+0000","last_became_active":"2024-09-12T12:12:43.852885+0000","last_became_peered":"2024-09-12T12:12:43.852885+0000","last_unstale":"2024-09-12T12:12:50.177687+0000","last_undegraded":"2024-09-12T12:12:50.177687+0000","last_fullsized":"2024-09-12T12:12:50.177687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512832+0000","last_change":"2024-09-12T12:12:44.841616+0000","last_active":"2024-09-12T12:12:50.512832+0000","last_peered":"2024-09-12T12:12:50.512832+0000","last_clean":"2024-09-12T12:12:50.512832+0000","last_became_active":"2024-09-12T12:12:44.837035+0000","last_became_peered":"2024-09-12T12:12:44.837035+0000","last_unstale":"2024-09-12T12:12:50.512832+0000","last_undegraded":"2024-09-12T12:12:50.512832+0000","last_fullsized":"2024-09-12T12:12:50.512832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125285+0000","last_change":"2024-09-12T12:12:49.197010+0000","last_active":"2024-09-12T12:12:51.125285+0000","last_peered":"2024-09-12T12:12:51.125285+0000","last_clean":"2024-09-12T12:12:51.125285+0000","last_became_active":"2024-09-12T12:12:49.196614+0000","last_became_peered":"2024-09-12T12:12:49.196614+0000","last_unstale":"2024-09-12T12:12:51.125285+0000","last_undegraded":"2024-09-12T12:12:51.125285+0000","last_fullsized":"2024-09-12T12:12:51.125285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:15.930626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176978+0000","last_change":"2024-09-12T12:12:43.852370+0000","last_active":"2024-09-12T12:12:50.176978+0000","last_peered":"2024-09-12T12:12:50.176978+0000","last_clean":"2024-09-12T12:12:50.176978+0000","last_became_active":"2024-09-12T12:12:43.852074+0000","last_became_peered":"2024-09-12T12:12:43.852074+0000","last_unstale":"2024-09-12T12:12:50.176978+0000","last_undegraded":"2024-09-12T12:12:50.176978+0000","last_fullsized":"2024-09-12T12:12:50.176978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178100+0000","last_change":"2024-09-12T12:12:44.832700+0000","last_active":"2024-09-12T12:12:50.178100+0000","last_peered":"2024-09-12T12:12:50.178100+0000","last_clean":"2024-09-12T12:12:50.178100+0000","last_became_active":"2024-09-12T12:12:44.832406+0000","last_became_peered":"2024-09-12T12:12:44.832406+0000","last_unstale":"2024-09-12T12:12:50.178100+0000","last_undegraded":"2024-09-12T12:12:50.178100+0000","last_fullsized":"2024-09-12T12:12:50.178100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:58.477524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177442+0000","last_change":"2024-09-12T12:12:49.196949+0000","last_active":"2024-09-12T12:12:50.177442+0000","last_peered":"2024-09-12T12:12:50.177442+0000","last_clean":"2024-09-12T12:12:50.177442+0000","last_became_active":"2024-09-12T12:12:49.196332+0000","last_became_peered":"2024-09-12T12:12:49.196332+0000","last_unstale":"2024-09-12T12:12:50.177442+0000","last_undegraded":"2024-09-12T12:12:50.177442+0000","last_fullsized":"2024-09-12T12:12:50.177442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:33.072107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177294+0000","last_change":"2024-09-12T12:12:44.844712+0000","last_active":"2024-09-12T12:12:50.177294+0000","last_peered":"2024-09-12T12:12:50.177294+0000","last_clean":"2024-09-12T12:12:50.177294+0000","last_became_active":"2024-09-12T12:12:44.843911+0000","last_became_peered":"2024-09-12T12:12:44.843911+0000","last_unstale":"2024-09-12T12:12:50.177294+0000","last_undegraded":"2024-09-12T12:12:50.177294+0000","last_fullsized":"2024-09-12T12:12:50.177294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.435034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124714+0000","last_change":"2024-09-12T12:12:44.848326+0000","last_active":"2024-09-12T12:12:51.124714+0000","last_peered":"2024-09-12T12:12:51.124714+0000","last_clean":"2024-09-12T12:12:51.124714+0000","last_became_active":"2024-09-12T12:12:44.848042+0000","last_became_peered":"2024-09-12T12:12:44.848042+0000","last_unstale":"2024-09-12T12:12:51.124714+0000","last_undegraded":"2024-09-12T12:12:51.124714+0000","last_fullsized":"2024-09-12T12:12:51.124714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:29.908514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664167+0000","last_change":"2024-09-12T12:12:44.864217+0000","last_active":"2024-09-12T12:12:50.664167+0000","last_peered":"2024-09-12T12:12:50.664167+0000","last_clean":"2024-09-12T12:12:50.664167+0000","last_became_active":"2024-09-12T12:12:44.863950+0000","last_became_peered":"2024-09-12T12:12:44.863950+0000","last_unstale":"2024-09-12T12:12:50.664167+0000","last_undegraded":"2024-09-12T12:12:50.664167+0000","last_fullsized":"2024-09-12T12:12:50.664167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512709+0000","last_change":"2024-09-12T12:12:44.844044+0000","last_active":"2024-09-12T12:12:50.512709+0000","last_peered":"2024-09-12T12:12:50.512709+0000","last_clean":"2024-09-12T12:12:50.512709+0000","last_became_active":"2024-09-12T12:12:44.843737+0000","last_became_peered":"2024-09-12T12:12:44.843737+0000","last_unstale":"2024-09-12T12:12:50.512709+0000","last_undegraded":"2024-09-12T12:12:50.512709+0000","last_fullsized":"2024-09-12T12:12:50.512709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177290+0000","last_change":"2024-09-12T12:12:44.854798+0000","last_active":"2024-09-12T12:12:50.177290+0000","last_peered":"2024-09-12T12:12:50.177290+0000","last_clean":"2024-09-12T12:12:50.177290+0000","last_became_active":"2024-09-12T12:12:44.852834+0000","last_became_peered":"2024-09-12T12:12:44.852834+0000","last_unstale":"2024-09-12T12:12:50.177290+0000","last_undegraded":"2024-09-12T12:12:50.177290+0000","last_fullsized":"2024-09-12T12:12:50.177290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125449+0000","last_change":"2024-09-12T12:12:44.855309+0000","last_active":"2024-09-12T12:12:51.125449+0000","last_peered":"2024-09-12T12:12:51.125449+0000","last_clean":"2024-09-12T12:12:51.125449+0000","last_became_active":"2024-09-12T12:12:44.854718+0000","last_became_peered":"2024-09-12T12:12:44.854718+0000","last_unstale":"2024-09-12T12:12:51.125449+0000","last_undegraded":"2024-09-12T12:12:51.125449+0000","last_fullsized":"2024-09-12T12:12:51.125449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178907+0000","last_change":"2024-09-12T12:12:44.855541+0000","last_active":"2024-09-12T12:12:50.178907+0000","last_peered":"2024-09-12T12:12:50.178907+0000","last_clean":"2024-09-12T12:12:50.178907+0000","last_became_active":"2024-09-12T12:12:44.855141+0000","last_became_peered":"2024-09-12T12:12:44.855141+0000","last_unstale":"2024-09-12T12:12:50.178907+0000","last_undegraded":"2024-09-12T12:12:50.178907+0000","last_fullsized":"2024-09-12T12:12:50.178907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177604+0000","last_change":"2024-09-12T12:12:44.866746+0000","last_active":"2024-09-12T12:12:50.177604+0000","last_peered":"2024-09-12T12:12:50.177604+0000","last_clean":"2024-09-12T12:12:50.177604+0000","last_became_active":"2024-09-12T12:12:44.866244+0000","last_became_peered":"2024-09-12T12:12:44.866244+0000","last_unstale":"2024-09-12T12:12:50.177604+0000","last_undegraded":"2024-09-12T12:12:50.177604+0000","last_fullsized":"2024-09-12T12:12:50.177604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663883+0000","last_change":"2024-09-12T12:12:44.864035+0000","last_active":"2024-09-12T12:12:50.663883+0000","last_peered":"2024-09-12T12:12:50.663883+0000","last_clean":"2024-09-12T12:12:50.663883+0000","last_became_active":"2024-09-12T12:12:44.863759+0000","last_became_peered":"2024-09-12T12:12:44.863759+0000","last_unstale":"2024-09-12T12:12:50.663883+0000","last_undegraded":"2024-09-12T12:12:50.663883+0000","last_fullsized":"2024-09-12T12:12:50.663883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:31.258440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176816+0000","last_change":"2024-09-12T12:12:44.865302+0000","last_active":"2024-09-12T12:12:50.176816+0000","last_peered":"2024-09-12T12:12:50.176816+0000","last_clean":"2024-09-12T12:12:50.176816+0000","last_became_active":"2024-09-12T12:12:44.865069+0000","last_became_peered":"2024-09-12T12:12:44.865069+0000","last_unstale":"2024-09-12T12:12:50.176816+0000","last_undegraded":"2024-09-12T12:12:50.176816+0000","last_fullsized":"2024-09-12T12:12:50.176816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664052+0000","last_change":"2024-09-12T12:12:44.861590+0000","last_active":"2024-09-12T12:12:50.664052+0000","last_peered":"2024-09-12T12:12:50.664052+0000","last_clean":"2024-09-12T12:12:50.664052+0000","last_became_active":"2024-09-12T12:12:44.861202+0000","last_became_peered":"2024-09-12T12:12:44.861202+0000","last_unstale":"2024-09-12T12:12:50.664052+0000","last_undegraded":"2024-09-12T12:12:50.664052+0000","last_fullsized":"2024-09-12T12:12:50.664052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512497+0000","last_change":"2024-09-12T12:12:44.856860+0000","last_active":"2024-09-12T12:12:50.512497+0000","last_peered":"2024-09-12T12:12:50.512497+0000","last_clean":"2024-09-12T12:12:50.512497+0000","last_became_active":"2024-09-12T12:12:44.856519+0000","last_became_peered":"2024-09-12T12:12:44.856519+0000","last_unstale":"2024-09-12T12:12:50.512497+0000","last_undegraded":"2024-09-12T12:12:50.512497+0000","last_fullsized":"2024-09-12T12:12:50.512497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:11.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178221+0000","last_change":"2024-09-12T12:12:44.848555+0000","last_active":"2024-09-12T12:12:50.178221+0000","last_peered":"2024-09-12T12:12:50.178221+0000","last_clean":"2024-09-12T12:12:50.178221+0000","last_became_active":"2024-09-12T12:12:44.848264+0000","last_became_peered":"2024-09-12T12:12:44.848264+0000","last_unstale":"2024-09-12T12:12:50.178221+0000","last_undegraded":"2024-09-12T12:12:50.178221+0000","last_fullsized":"2024-09-12T12:12:50.178221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517342+0000","last_change":"2024-09-12T12:12:44.871273+0000","last_active":"2024-09-12T12:12:50.517342+0000","last_peered":"2024-09-12T12:12:50.517342+0000","last_clean":"2024-09-12T12:12:50.517342+0000","last_became_active":"2024-09-12T12:12:44.871000+0000","last_became_peered":"2024-09-12T12:12:44.871000+0000","last_unstale":"2024-09-12T12:12:50.517342+0000","last_undegraded":"2024-09-12T12:12:50.517342+0000","last_fullsized":"2024-09-12T12:12:50.517342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.339698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125660+0000","last_change":"2024-09-12T12:12:44.852240+0000","last_active":"2024-09-12T12:12:51.125660+0000","last_peered":"2024-09-12T12:12:51.125660+0000","last_clean":"2024-09-12T12:12:51.125660+0000","last_became_active":"2024-09-12T12:12:44.851932+0000","last_became_peered":"2024-09-12T12:12:44.851932+0000","last_unstale":"2024-09-12T12:12:51.125660+0000","last_undegraded":"2024-09-12T12:12:51.125660+0000","last_fullsized":"2024-09-12T12:12:51.125660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:07.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664682+0000","last_change":"2024-09-12T12:12:44.873027+0000","last_active":"2024-09-12T12:12:50.664682+0000","last_peered":"2024-09-12T12:12:50.664682+0000","last_clean":"2024-09-12T12:12:50.664682+0000","last_became_active":"2024-09-12T12:12:44.872766+0000","last_became_peered":"2024-09-12T12:12:44.872766+0000","last_unstale":"2024-09-12T12:12:50.664682+0000","last_undegraded":"2024-09-12T12:12:50.664682+0000","last_fullsized":"2024-09-12T12:12:50.664682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:17.011556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663750+0000","last_change":"2024-09-12T12:12:44.846340+0000","last_active":"2024-09-12T12:12:50.663750+0000","last_peered":"2024-09-12T12:12:50.663750+0000","last_clean":"2024-09-12T12:12:50.663750+0000","last_became_active":"2024-09-12T12:12:44.846029+0000","last_became_peered":"2024-09-12T12:12:44.846029+0000","last_unstale":"2024-09-12T12:12:50.663750+0000","last_undegraded":"2024-09-12T12:12:50.663750+0000","last_fullsized":"2024-09-12T12:12:50.663750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:00.612407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125028+0000","last_change":"2024-09-12T12:12:44.841774+0000","last_active":"2024-09-12T12:12:51.125028+0000","last_peered":"2024-09-12T12:12:51.125028+0000","last_clean":"2024-09-12T12:12:51.125028+0000","last_became_active":"2024-09-12T12:12:44.841455+0000","last_became_peered":"2024-09-12T12:12:44.841455+0000","last_unstale":"2024-09-12T12:12:51.125028+0000","last_undegraded":"2024-09-12T12:12:51.125028+0000","last_fullsized":"2024-09-12T12:12:51.125028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512467+0000","last_change":"2024-09-12T12:12:44.853169+0000","last_active":"2024-09-12T12:12:50.512467+0000","last_peered":"2024-09-12T12:12:50.512467+0000","last_clean":"2024-09-12T12:12:50.512467+0000","last_became_active":"2024-09-12T12:12:44.852892+0000","last_became_peered":"2024-09-12T12:12:44.852892+0000","last_unstale":"2024-09-12T12:12:50.512467+0000","last_undegraded":"2024-09-12T12:12:50.512467+0000","last_fullsized":"2024-09-12T12:12:50.512467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:35.948872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176814+0000","last_change":"2024-09-12T12:12:44.844754+0000","last_active":"2024-09-12T12:12:50.176814+0000","last_peered":"2024-09-12T12:12:50.176814+0000","last_clean":"2024-09-12T12:12:50.176814+0000","last_became_active":"2024-09-12T12:12:44.844442+0000","last_became_peered":"2024-09-12T12:12:44.844442+0000","last_unstale":"2024-09-12T12:12:50.176814+0000","last_undegraded":"2024-09-12T12:12:50.176814+0000","last_fullsized":"2024-09-12T12:12:50.176814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:31.258440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178826+0000","last_change":"2024-09-12T12:12:44.839270+0000","last_active":"2024-09-12T12:12:50.178826+0000","last_peered":"2024-09-12T12:12:50.178826+0000","last_clean":"2024-09-12T12:12:50.178826+0000","last_became_active":"2024-09-12T12:12:44.838825+0000","last_became_peered":"2024-09-12T12:12:44.838825+0000","last_unstale":"2024-09-12T12:12:50.178826+0000","last_undegraded":"2024-09-12T12:12:50.178826+0000","last_fullsized":"2024-09-12T12:12:50.178826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:29.908514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178340+0000","last_change":"2024-09-12T12:12:44.845641+0000","last_active":"2024-09-12T12:12:50.178340+0000","last_peered":"2024-09-12T12:12:50.178340+0000","last_clean":"2024-09-12T12:12:50.178340+0000","last_became_active":"2024-09-12T12:12:44.845161+0000","last_became_peered":"2024-09-12T12:12:44.845161+0000","last_unstale":"2024-09-12T12:12:50.178340+0000","last_undegraded":"2024-09-12T12:12:50.178340+0000","last_fullsized":"2024-09-12T12:12:50.178340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178812+0000","last_change":"2024-09-12T12:12:44.858433+0000","last_active":"2024-09-12T12:12:50.178812+0000","last_peered":"2024-09-12T12:12:50.178812+0000","last_clean":"2024-09-12T12:12:50.178812+0000","last_became_active":"2024-09-12T12:12:44.858113+0000","last_became_peered":"2024-09-12T12:12:44.858113+0000","last_unstale":"2024-09-12T12:12:50.178812+0000","last_undegraded":"2024-09-12T12:12:50.178812+0000","last_fullsized":"2024-09-12T12:12:50.178812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517222+0000","last_change":"2024-09-12T12:12:44.869733+0000","last_active":"2024-09-12T12:12:50.517222+0000","last_peered":"2024-09-12T12:12:50.517222+0000","last_clean":"2024-09-12T12:12:50.517222+0000","last_became_active":"2024-09-12T12:12:44.868192+0000","last_became_peered":"2024-09-12T12:12:44.868192+0000","last_unstale":"2024-09-12T12:12:50.517222+0000","last_undegraded":"2024-09-12T12:12:50.517222+0000","last_fullsized":"2024-09-12T12:12:50.517222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:00.612407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176586+0000","last_change":"2024-09-12T12:12:44.844476+0000","last_active":"2024-09-12T12:12:50.176586+0000","last_peered":"2024-09-12T12:12:50.176586+0000","last_clean":"2024-09-12T12:12:50.176586+0000","last_became_active":"2024-09-12T12:12:44.844240+0000","last_became_peered":"2024-09-12T12:12:44.844240+0000","last_unstale":"2024-09-12T12:12:50.176586+0000","last_undegraded":"2024-09-12T12:12:50.176586+0000","last_fullsized":"2024-09-12T12:12:50.176586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516610+0000","last_change":"2024-09-12T12:12:44.859103+0000","last_active":"2024-09-12T12:12:50.516610+0000","last_peered":"2024-09-12T12:12:50.516610+0000","last_clean":"2024-09-12T12:12:50.516610+0000","last_became_active":"2024-09-12T12:12:44.858792+0000","last_became_peered":"2024-09-12T12:12:44.858792+0000","last_unstale":"2024-09-12T12:12:50.516610+0000","last_undegraded":"2024-09-12T12:12:50.516610+0000","last_fullsized":"2024-09-12T12:12:50.516610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663939+0000","last_change":"2024-09-12T12:12:44.846757+0000","last_active":"2024-09-12T12:12:50.663939+0000","last_peered":"2024-09-12T12:12:50.663939+0000","last_clean":"2024-09-12T12:12:50.663939+0000","last_became_active":"2024-09-12T12:12:44.846487+0000","last_became_peered":"2024-09-12T12:12:44.846487+0000","last_unstale":"2024-09-12T12:12:50.663939+0000","last_undegraded":"2024-09-12T12:12:50.663939+0000","last_fullsized":"2024-09-12T12:12:50.663939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516676+0000","last_change":"2024-09-12T12:12:44.861675+0000","last_active":"2024-09-12T12:12:50.516676+0000","last_peered":"2024-09-12T12:12:50.516676+0000","last_clean":"2024-09-12T12:12:50.516676+0000","last_became_active":"2024-09-12T12:12:44.860557+0000","last_became_peered":"2024-09-12T12:12:44.860557+0000","last_unstale":"2024-09-12T12:12:50.516676+0000","last_undegraded":"2024-09-12T12:12:50.516676+0000","last_fullsized":"2024-09-12T12:12:50.516676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664240+0000","last_change":"2024-09-12T12:12:44.872237+0000","last_active":"2024-09-12T12:12:50.664240+0000","last_peered":"2024-09-12T12:12:50.664240+0000","last_clean":"2024-09-12T12:12:50.664240+0000","last_became_active":"2024-09-12T12:12:44.871938+0000","last_became_peered":"2024-09-12T12:12:44.871938+0000","last_unstale":"2024-09-12T12:12:50.664240+0000","last_undegraded":"2024-09-12T12:12:50.664240+0000","last_fullsized":"2024-09-12T12:12:50.664240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512684+0000","last_change":"2024-09-12T12:12:44.849177+0000","last_active":"2024-09-12T12:12:50.512684+0000","last_peered":"2024-09-12T12:12:50.512684+0000","last_clean":"2024-09-12T12:12:50.512684+0000","last_became_active":"2024-09-12T12:12:44.848855+0000","last_became_peered":"2024-09-12T12:12:44.848855+0000","last_unstale":"2024-09-12T12:12:50.512684+0000","last_undegraded":"2024-09-12T12:12:50.512684+0000","last_fullsized":"2024-09-12T12:12:50.512684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126168+0000","last_change":"2024-09-12T12:12:44.840454+0000","last_active":"2024-09-12T12:12:51.126168+0000","last_peered":"2024-09-12T12:12:51.126168+0000","last_clean":"2024-09-12T12:12:51.126168+0000","last_became_active":"2024-09-12T12:12:44.838175+0000","last_became_peered":"2024-09-12T12:12:44.838175+0000","last_unstale":"2024-09-12T12:12:51.126168+0000","last_undegraded":"2024-09-12T12:12:51.126168+0000","last_fullsized":"2024-09-12T12:12:51.126168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517102+0000","last_change":"2024-09-12T12:12:44.868520+0000","last_active":"2024-09-12T12:12:50.517102+0000","last_peered":"2024-09-12T12:12:50.517102+0000","last_clean":"2024-09-12T12:12:50.517102+0000","last_became_active":"2024-09-12T12:12:44.861576+0000","last_became_peered":"2024-09-12T12:12:44.861576+0000","last_unstale":"2024-09-12T12:12:50.517102+0000","last_undegraded":"2024-09-12T12:12:50.517102+0000","last_fullsized":"2024-09-12T12:12:50.517102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:13:06.898 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:13:06.898 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T12:13:06.898 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T12:13:06.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T12:13:06.899 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T12:13:07.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.073+0000 7f32ad400640 1 Processor -- start 2024-09-12T12:13:07.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.073+0000 7f32ad400640 1 -- start start 2024-09-12T12:13:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32ad400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 0x7f32a815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32ad400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f32a80b3590 0x7f32a80b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32ad400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a80b3aa0 con 0x7f32a815ad50 2024-09-12T12:13:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32ad400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f32a815f860 con 0x7f32a80b3590 2024-09-12T12:13:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32ad400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32a80cdeb0 con 0x7f32a80b49e0 2024-09-12T12:13:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a6800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f32a815ad50 0x7f32a80b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37212/0 (socket says 172.21.15.144:37212) 2024-09-12T12:13:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a6800640 1 -- 172.21.15.144:0/2096472486 learned_addr learned my addr 172.21.15.144:0/2096472486 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a7200640 1 --2- 172.21.15.144:0/2096472486 >> v2:172.21.15.165:3300/0 conn(0x7f32a80b3590 0x7f32a80b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a5e00640 1 --2- 172.21.15.144:0/2096472486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 0x7f32a815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a5400640 1 -- 172.21.15.144:0/2096472486 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100947562 0 0) 0x7f32a80b3aa0 con 0x7f32a815ad50 2024-09-12T12:13:07.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a5400640 1 -- 172.21.15.144:0/2096472486 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f328c003530 con 0x7f32a815ad50 2024-09-12T12:13:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a7200640 1 -- 172.21.15.144:0/2096472486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 msgr2=0x7f32a815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a7200640 1 --2- 172.21.15.144:0/2096472486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 0x7f32a815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a7200640 1 -- 172.21.15.144:0/2096472486 >> v1:172.21.15.144:6789/0 conn(0x7f32a815ad50 legacy=0x7f32a80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.077+0000 7f32a7200640 1 -- 172.21.15.144:0/2096472486 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a80afc10 con 0x7f32a80b3590 2024-09-12T12:13:07.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32a7200640 1 --2- 172.21.15.144:0/2096472486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a80b3590 0x7f32a80b06f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32a00097c0 tx=0x7f32a001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c36903b139588e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:07.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32a5400640 1 -- 172.21.15.144:0/2096472486 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a00b1070 con 0x7f32a80b3590 2024-09-12T12:13:07.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32a5400640 1 -- 172.21.15.144:0/2096472486 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a00ac640 con 0x7f32a80b3590 2024-09-12T12:13:07.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32a5400640 1 -- 172.21.15.144:0/2096472486 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a00aca10 con 0x7f32a80b3590 2024-09-12T12:13:07.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 -- 172.21.15.144:0/2096472486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a80b3590 msgr2=0x7f32a80b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 --2- 172.21.15.144:0/2096472486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a80b3590 0x7f32a80b06f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f32a00097c0 tx=0x7f32a001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 -- 172.21.15.144:0/2096472486 shutdown_connections 2024-09-12T12:13:07.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 --2- 172.21.15.144:0/2096472486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a80b3590 0x7f32a80b06f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 --2- 172.21.15.144:0/2096472486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 0x7f32a815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 -- 172.21.15.144:0/2096472486 >> 172.21.15.144:0/2096472486 conn(0x7f32a806d0d0 msgr2=0x7f32a806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:07.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 -- 172.21.15.144:0/2096472486 shutdown_connections 2024-09-12T12:13:07.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 -- 172.21.15.144:0/2096472486 wait complete. 2024-09-12T12:13:07.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 Processor -- start 2024-09-12T12:13:07.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 -- start start 2024-09-12T12:13:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32a80b3590 0x7f32a80cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 0x7f32a8158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a815ad50 0x7f32a81f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f32a80b0db0 con 0x7f32a80b3590 2024-09-12T12:13:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f32a80b0c30 con 0x7f32a815ad50 2024-09-12T12:13:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.081+0000 7f32ad400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32a80b0f30 con 0x7f32a80b49e0 2024-09-12T12:13:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32a80b3590 0x7f32a80cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32a80b3590 0x7f32a80cf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50644/0 (socket says 172.21.15.144:50644) 2024-09-12T12:13:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a6800640 1 -- 172.21.15.144:0/1601682743 learned_addr learned my addr 172.21.15.144:0/1601682743 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:07.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a5e00640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 0x7f32a8158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a7200640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a815ad50 0x7f32a81f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a6800640 1 -- 172.21.15.144:0/1601682743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 msgr2=0x7f32a8158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a6800640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 0x7f32a8158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a6800640 1 -- 172.21.15.144:0/1601682743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a815ad50 msgr2=0x7f32a81f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a6800640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a815ad50 0x7f32a81f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a6800640 1 -- 172.21.15.144:0/1601682743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a81592d0 con 0x7f32a80b3590 2024-09-12T12:13:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32a6800640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32a80b3590 0x7f32a80cf560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f329800caa0 tx=0x7f329800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f329ea00640 1 -- 172.21.15.144:0/1601682743 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298017070 con 0x7f32a80b3590 2024-09-12T12:13:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f329ea00640 1 -- 172.21.15.144:0/1601682743 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329800ac00 con 0x7f32a80b3590 2024-09-12T12:13:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f329ea00640 1 -- 172.21.15.144:0/1601682743 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298012400 con 0x7f32a80b3590 2024-09-12T12:13:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a80cfc60 con 0x7f32a80b3590 2024-09-12T12:13:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a80d0220 con 0x7f32a80b3590 2024-09-12T12:13:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a80d03f0 con 0x7f32a80b3590 2024-09-12T12:13:07.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.085+0000 7f329ea00640 1 -- 172.21.15.144:0/1601682743 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f329801a070 con 0x7f32a80b3590 2024-09-12T12:13:07.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.089+0000 7f329ea00640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32880678c0 0x7f3288069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.089+0000 7f329ea00640 1 -- 172.21.15.144:0/1601682743 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3298085ca0 con 0x7f32a80b3590 2024-09-12T12:13:07.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.089+0000 7f32a5e00640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32880678c0 0x7f3288069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.089+0000 7f32a5e00640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32880678c0 0x7f3288069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32a80cc8c0 tx=0x7f3294009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:07.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.093+0000 7f329ea00640 1 -- 172.21.15.144:0/1601682743 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3298055e50 con 0x7f32a80b3590 2024-09-12T12:13:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.285+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f32a80b06f0 con 0x7f32a80b3590 2024-09-12T12:13:07.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.289+0000 7f329ea00640 1 -- 172.21.15.144:0/1601682743 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166893 (secure 0 0 0) 0x7f329805a150 con 0x7f32a80b3590 2024-09-12T12:13:07.292 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:07.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32880678c0 msgr2=0x7f3288069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32880678c0 0x7f3288069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32a80cc8c0 tx=0x7f3294009190 comp rx=0 tx=0).stop 2024-09-12T12:13:07.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32a80b3590 msgr2=0x7f32a80cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32a80b3590 0x7f32a80cf560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f329800caa0 tx=0x7f329800cf60 comp rx=0 tx=0).stop 2024-09-12T12:13:07.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 shutdown_connections 2024-09-12T12:13:07.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32880678c0 0x7f3288069d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a815ad50 0x7f32a81f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32a80b49e0 0x7f32a8158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 --2- 172.21.15.144:0/1601682743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32a80b3590 0x7f32a80cf560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 >> 172.21.15.144:0/1601682743 conn(0x7f32a806d0d0 msgr2=0x7f32a8157770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 shutdown_connections 2024-09-12T12:13:07.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.293+0000 7f32ad400640 1 -- 172.21.15.144:0/1601682743 wait complete. 2024-09-12T12:13:07.313 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":4117380046},{"type":"v1","addr":"172.21.15.144:6833","nonce":4117380046}]},"active_addr":"172.21.15.144:6833/4117380046","active_change":"2024-09-12T12:12:25.362836+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":1443976077}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":2454489861}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":2753918595}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":435928313}]}]} 2024-09-12T12:13:07.316 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T12:13:07.316 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T12:13:07.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:07.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f1a800640 1 Processor -- start 2024-09-12T12:13:07.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f1a800640 1 -- start start 2024-09-12T12:13:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f1a800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8f1415e5f0 0x7f8f1406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f1a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 0x7f8f140b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f1a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f1406e300 0x7f8f1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f1a800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1406ecb0 con 0x7f8f1406e300 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f1a800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1406d260 con 0x7f8f1415e5f0 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f1a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8f140b6f60 con 0x7f8f140b44a0 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f13e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f1406e300 0x7f8f1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f13e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f1406e300 0x7f8f1406e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50660/0 (socket says 172.21.15.144:50660) 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f13e00640 1 -- 172.21.15.144:0/1053357515 learned_addr learned my addr 172.21.15.144:0/1053357515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f12a00640 1 --2- 172.21.15.144:0/1053357515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 0x7f8f140b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f13400640 1 --2- 172.21.15.144:0/1053357515 >> v2:172.21.15.165:3300/0 conn(0x7f8f1415e5f0 0x7f8f1406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f13e00640 1 -- 172.21.15.144:0/1053357515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 msgr2=0x7f8f140b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f13e00640 1 --2- 172.21.15.144:0/1053357515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 0x7f8f140b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f13e00640 1 -- 172.21.15.144:0/1053357515 >> v2:172.21.15.165:3300/0 conn(0x7f8f1415e5f0 msgr2=0x7f8f1406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f13e00640 1 --2- 172.21.15.144:0/1053357515 >> v2:172.21.15.165:3300/0 conn(0x7f8f1415e5f0 0x7f8f1406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.453+0000 7f8f13e00640 1 -- 172.21.15.144:0/1053357515 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f140b7240 con 0x7f8f1406e300 2024-09-12T12:13:07.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f13e00640 1 --2- 172.21.15.144:0/1053357515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 0x7f8f1406e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f14074b30 tx=0x7f8f0c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a5e01cdba4b4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:07.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f12000640 1 -- 172.21.15.144:0/1053357515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0a5840 con 0x7f8f1406e300 2024-09-12T12:13:07.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f12000640 1 -- 172.21.15.144:0/1053357515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c0a59e0 con 0x7f8f1406e300 2024-09-12T12:13:07.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f12000640 1 -- 172.21.15.144:0/1053357515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0a5db0 con 0x7f8f1406e300 2024-09-12T12:13:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f1a800640 1 -- 172.21.15.144:0/1053357515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 msgr2=0x7f8f1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f1a800640 1 --2- 172.21.15.144:0/1053357515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 0x7f8f1406e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f14074b30 tx=0x7f8f0c01c9c0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f1a800640 1 -- 172.21.15.144:0/1053357515 shutdown_connections 2024-09-12T12:13:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f1a800640 1 --2- 172.21.15.144:0/1053357515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 0x7f8f1406e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f1a800640 1 --2- 172.21.15.144:0/1053357515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 0x7f8f140b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f1a800640 1 --2- 172.21.15.144:0/1053357515 >> v2:172.21.15.165:3300/0 conn(0x7f8f1415e5f0 0x7f8f1406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f1a800640 1 -- 172.21.15.144:0/1053357515 >> 172.21.15.144:0/1053357515 conn(0x7f8f1406f400 msgr2=0x7f8f1406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f1a800640 1 -- 172.21.15.144:0/1053357515 shutdown_connections 2024-09-12T12:13:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.457+0000 7f8f1a800640 1 -- 172.21.15.144:0/1053357515 wait complete. 2024-09-12T12:13:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 Processor -- start 2024-09-12T12:13:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 -- start start 2024-09-12T12:13:07.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 0x7f8f14149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 0x7f8f1414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1415e5f0 0x7f8f14153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8f140b6d10 con 0x7f8f1406e300 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f140b6b90 con 0x7f8f1415e5f0 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1415f700 con 0x7f8f140b44a0 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 0x7f8f14149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 0x7f8f14149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50662/0 (socket says 172.21.15.144:50662) 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13400640 1 -- 172.21.15.144:0/3739048990 learned_addr learned my addr 172.21.15.144:0/3739048990 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f12a00640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 0x7f8f1414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13e00640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1415e5f0 0x7f8f14153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13400640 1 -- 172.21.15.144:0/3739048990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 msgr2=0x7f8f1414ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13400640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 0x7f8f1414ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13400640 1 -- 172.21.15.144:0/3739048990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1415e5f0 msgr2=0x7f8f14153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13400640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1415e5f0 0x7f8f14153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13400640 1 -- 172.21.15.144:0/3739048990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1414a3a0 con 0x7f8f1406e300 2024-09-12T12:13:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f13400640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 0x7f8f14149e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400e8a0 tx=0x7f8f0400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f0b400640 1 -- 172.21.15.144:0/3739048990 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f04017070 con 0x7f8f1406e300 2024-09-12T12:13:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f0b400640 1 -- 172.21.15.144:0/3739048990 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0400c940 con 0x7f8f1406e300 2024-09-12T12:13:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f0b400640 1 -- 172.21.15.144:0/3739048990 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400ccf0 con 0x7f8f1406e300 2024-09-12T12:13:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1414e100 con 0x7f8f1406e300 2024-09-12T12:13:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1414aff0 con 0x7f8f1406e300 2024-09-12T12:13:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.461+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1406e770 con 0x7f8f1406e300 2024-09-12T12:13:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.465+0000 7f8f0b400640 1 -- 172.21.15.144:0/3739048990 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f0401a070 con 0x7f8f1406e300 2024-09-12T12:13:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.465+0000 7f8f0b400640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ef40678f0 0x7f8ef4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.465+0000 7f8f0b400640 1 -- 172.21.15.144:0/3739048990 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8f04085f00 con 0x7f8f1406e300 2024-09-12T12:13:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.465+0000 7f8f12a00640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ef40678f0 0x7f8ef4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.465+0000 7f8f12a00640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ef40678f0 0x7f8ef4069db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f141fa760 tx=0x7f8f00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:07.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.469+0000 7f8f0b400640 1 -- 172.21.15.144:0/3739048990 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f04056660 con 0x7f8f1406e300 2024-09-12T12:13:07.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.629+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f140b2720 con 0x7f8f1406e300 2024-09-12T12:13:07.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f0b400640 1 -- 172.21.15.144:0/3739048990 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f8f04055f60 con 0x7f8f1406e300 2024-09-12T12:13:07.633 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:07.633 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:07.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ef40678f0 msgr2=0x7f8ef4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ef40678f0 0x7f8ef4069db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f141fa760 tx=0x7f8f00008040 comp rx=0 tx=0).stop 2024-09-12T12:13:07.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 msgr2=0x7f8f14149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 0x7f8f14149e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400e8a0 tx=0x7f8f0400eca0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 shutdown_connections 2024-09-12T12:13:07.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ef40678f0 0x7f8ef4069db0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1415e5f0 0x7f8f14153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f140b44a0 0x7f8f1414ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 --2- 172.21.15.144:0/3739048990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1406e300 0x7f8f14149e60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 >> 172.21.15.144:0/3739048990 conn(0x7f8f1406f400 msgr2=0x7f8f1415fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:07.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 shutdown_connections 2024-09-12T12:13:07.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.633+0000 7f8f1a800640 1 -- 172.21.15.144:0/3739048990 wait complete. 2024-09-12T12:13:07.654 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T12:13:07.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:07.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f1294e00640 1 Processor -- start 2024-09-12T12:13:07.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f1294e00640 1 -- start start 2024-09-12T12:13:07.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f1294e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b67c0 0x7f12900b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f1294e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1290162720 con 0x7f12900d2e10 2024-09-12T12:13:07.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f1294e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1290162a00 con 0x7f129015e4a0 2024-09-12T12:13:07.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f1294e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1290073310 con 0x7f12900b67c0 2024-09-12T12:13:07.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f12900d2e10 0x7f12900737a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37228/0 (socket says 172.21.15.144:37228) 2024-09-12T12:13:07.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128ea00640 1 -- 172.21.15.144:0/3812718231 learned_addr learned my addr 172.21.15.144:0/3812718231 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:07.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128fe00640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b67c0 0x7f12900b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1170658750 0 0) 0x7f1290162720 con 0x7f12900d2e10 2024-09-12T12:13:07.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1274003530 con 0x7f12900d2e10 2024-09-12T12:13:07.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270122438 0 0) 0x7f1290162a00 con 0x7f129015e4a0 2024-09-12T12:13:07.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1290162720 con 0x7f129015e4a0 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3511453530 0 0) 0x7f1274003530 con 0x7f12900d2e10 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b67c0 msgr2=0x7f12900b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b67c0 0x7f12900b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 >> v1:172.21.15.165:6789/0 conn(0x7f129015e4a0 legacy=0x7f1290161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1290162ce0 con 0x7f12900d2e10 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f127c001680 con 0x7f12900d2e10 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 >> v1:172.21.15.144:6789/0 conn(0x7f12900d2e10 legacy=0x7f12900737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1274003b80 0x7f1274003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f1274004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b67c0 0x7f12740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1290073310 con 0x7f1274004810 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f127400ba80 con 0x7f1274003b80 2024-09-12T12:13:07.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f127400bc80 con 0x7f12900b67c0 2024-09-12T12:13:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128ea00640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f1274004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128f400640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1274003b80 0x7f1274003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128fe00640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b67c0 0x7f12740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128ea00640 1 -- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b67c0 msgr2=0x7f12740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128ea00640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b67c0 0x7f12740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128ea00640 1 -- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1274003b80 msgr2=0x7f1274003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128ea00640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1274003b80 0x7f1274003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128ea00640 1 -- 172.21.15.144:0/3812718231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1274003530 con 0x7f1274004810 2024-09-12T12:13:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.789+0000 7f128f400640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1274003b80 0x7f1274003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:07.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f128ea00640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f1274004c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c160 tx=0x7f127c01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad2f1ec72c9c748 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:07.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c007cb0 con 0x7f1274004810 2024-09-12T12:13:07.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127c0a9020 con 0x7f1274004810 2024-09-12T12:13:07.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f128e000640 1 -- 172.21.15.144:0/3812718231 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c005b00 con 0x7f1274004810 2024-09-12T12:13:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f1294e00640 1 -- 172.21.15.144:0/3812718231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 msgr2=0x7f1274004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f1294e00640 1 --2- 172.21.15.144:0/3812718231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f1274004c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c160 tx=0x7f127c01cb80 comp rx=0 tx=0).stop 2024-09-12T12:13:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f128fe00640 1 -- 172.21.15.144:0/3812718231 reap_dead start 2024-09-12T12:13:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f1294e00640 1 -- 172.21.15.144:0/3812718231 shutdown_connections 2024-09-12T12:13:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f1294e00640 1 -- 172.21.15.144:0/3812718231 >> 172.21.15.144:0/3812718231 conn(0x7f12900d2280 msgr2=0x7f12900d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f1294e00640 1 -- 172.21.15.144:0/3812718231 shutdown_connections 2024-09-12T12:13:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.793+0000 7f1294e00640 1 -- 172.21.15.144:0/3812718231 wait complete. 2024-09-12T12:13:07.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 Processor -- start 2024-09-12T12:13:07.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 -- start start 2024-09-12T12:13:07.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f12900b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12900cfa20 0x7f12900cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b1ab0 0x7f12900b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f12900b6da0 con 0x7f1274004810 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12900b6c20 con 0x7f12900cfa20 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f12900b6f20 con 0x7f12900b1ab0 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f12900b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f12900b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50682/0 (socket says 172.21.15.144:50682) 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128f400640 1 -- 172.21.15.144:0/706070173 learned_addr learned my addr 172.21.15.144:0/706070173 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128ea00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12900cfa20 0x7f12900cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128fe00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b1ab0 0x7f12900b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128f400640 1 -- 172.21.15.144:0/706070173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b1ab0 msgr2=0x7f12900b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128f400640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b1ab0 0x7f12900b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128f400640 1 -- 172.21.15.144:0/706070173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12900cfa20 msgr2=0x7f12900cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128f400640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12900cfa20 0x7f12900cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128f400640 1 -- 172.21.15.144:0/706070173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12900b2470 con 0x7f1274004810 2024-09-12T12:13:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128ea00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12900cfa20 0x7f12900cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f128f400640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f12900b1090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12800128c0 tx=0x7f1280012d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1287400640 1 -- 172.21.15.144:0/706070173 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280010b70 con 0x7f1274004810 2024-09-12T12:13:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1287400640 1 -- 172.21.15.144:0/706070173 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f128001b070 con 0x7f1274004810 2024-09-12T12:13:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1287400640 1 -- 172.21.15.144:0/706070173 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280016480 con 0x7f1274004810 2024-09-12T12:13:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12900d0590 con 0x7f1274004810 2024-09-12T12:13:07.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12900d0b50 con 0x7f1274004810 2024-09-12T12:13:07.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.797+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f129006ef30 con 0x7f1274004810 2024-09-12T12:13:07.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.801+0000 7f1287400640 1 -- 172.21.15.144:0/706070173 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1280016620 con 0x7f1274004810 2024-09-12T12:13:07.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.801+0000 7f1287400640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12700678f0 0x7f1270069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:07.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.801+0000 7f1287400640 1 -- 172.21.15.144:0/706070173 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f12800897a0 con 0x7f1274004810 2024-09-12T12:13:07.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.801+0000 7f128ea00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12700678f0 0x7f1270069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:07.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.801+0000 7f128ea00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12700678f0 0x7f1270069db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c160 tx=0x7f127c0019d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:07.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.805+0000 7f1287400640 1 -- 172.21.15.144:0/706070173 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1280059f90 con 0x7f1274004810 2024-09-12T12:13:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.965+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1290075250 con 0x7f1274004810 2024-09-12T12:13:07.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1287400640 1 -- 172.21.15.144:0/706070173 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f1280059890 con 0x7f1274004810 2024-09-12T12:13:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:07.969 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:07.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12700678f0 msgr2=0x7f1270069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12700678f0 0x7f1270069db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c160 tx=0x7f127c0019d0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 msgr2=0x7f12900b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:07.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f12900b1090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12800128c0 tx=0x7f1280012d80 comp rx=0 tx=0).stop 2024-09-12T12:13:07.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 shutdown_connections 2024-09-12T12:13:07.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12700678f0 0x7f1270069db0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12900b1ab0 0x7f12900b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12900cfa20 0x7f12900cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 --2- 172.21.15.144:0/706070173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1274004810 0x7f12900b1090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:07.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 >> 172.21.15.144:0/706070173 conn(0x7f12900d2280 msgr2=0x7f1290160890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:07.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 shutdown_connections 2024-09-12T12:13:07.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:07.969+0000 7f1294e00640 1 -- 172.21.15.144:0/706070173 wait complete. 2024-09-12T12:13:07.991 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T12:13:07.991 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T12:13:07.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T12:13:07.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T12:13:07.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T12:13:07.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T12:13:07.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T12:13:07.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T12:13:08.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.233+0000 7f9da0c00640 1 Processor -- start 2024-09-12T12:13:08.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.233+0000 7fe88fe00640 1 Processor -- start 2024-09-12T12:13:08.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.233+0000 7f9da0c00640 1 -- start start 2024-09-12T12:13:08.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9da0c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 0x7f9d94109040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9da0c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d94054f40 0x7f9d94036030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9da0c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9d94036570 0x7f9d94104250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9da0c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9d94109580 con 0x7f9d94054f40 2024-09-12T12:13:08.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9da0c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9d94006d50 con 0x7f9d94036570 2024-09-12T12:13:08.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9da0c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9404eb70 con 0x7f9d94050610 2024-09-12T12:13:08.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 0x7f9d94109040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.233+0000 7fe88fe00640 1 -- start start 2024-09-12T12:13:08.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7fe88fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe888033870 0x7fe888006f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7fe88fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe888039260 0x7fe888036030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d94054f40 0x7f9d94036030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 0x7f9d94109040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34016/0 (socket says 172.21.15.144:34016) 2024-09-12T12:13:08.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99e00640 1 -- 172.21.15.144:0/1212099784 learned_addr learned my addr 172.21.15.144:0/1212099784 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d9a800640 1 --2- 172.21.15.144:0/1212099784 >> v2:172.21.15.165:3300/0 conn(0x7f9d94036570 0x7f9d94104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f59ff200640 1 Processor -- start 2024-09-12T12:13:08.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99e00640 1 -- 172.21.15.144:0/1212099784 >> v2:172.21.15.165:3300/0 conn(0x7f9d94036570 msgr2=0x7f9d94104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99e00640 1 --2- 172.21.15.144:0/1212099784 >> v2:172.21.15.165:3300/0 conn(0x7f9d94036570 0x7f9d94104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99e00640 1 -- 172.21.15.144:0/1212099784 >> v2:172.21.15.144:3300/0 conn(0x7f9d94054f40 msgr2=0x7f9d94036030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99e00640 1 --2- 172.21.15.144:0/1212099784 >> v2:172.21.15.144:3300/0 conn(0x7f9d94054f40 0x7f9d94036030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99e00640 1 -- 172.21.15.144:0/1212099784 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d940509f0 con 0x7f9d94050610 2024-09-12T12:13:08.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f9d99400640 1 --2- 172.21.15.144:0/1212099784 >> v2:172.21.15.144:3300/0 conn(0x7f9d94054f40 0x7f9d94036030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:08.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f59ff200640 1 -- start start 2024-09-12T12:13:08.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f59ff200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8054f50 0x7f59f8054300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.237+0000 7f59ff200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f59f8055330 0x7f59f80e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59ff200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f8054990 con 0x7f59f8051380 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59ff200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f59f8038240 con 0x7f59f8055330 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59ff200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59f8038520 con 0x7f59f8054f50 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59fde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8054f50 0x7f59f8054300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59fde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8054f50 0x7f59f8054300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34024/0 (socket says 172.21.15.144:34024) 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59fde00640 1 -- 172.21.15.144:0/1838032815 learned_addr learned my addr 172.21.15.144:0/1838032815 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59fde00640 1 -- 172.21.15.144:0/1838032815 >> v2:172.21.15.165:3300/0 conn(0x7f59f8055330 msgr2=0x7f59f80e4f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59fde00640 1 --2- 172.21.15.144:0/1838032815 >> v2:172.21.15.165:3300/0 conn(0x7f59f8055330 0x7f59f80e4f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe888036570 0x7fe8880de200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe8880554b0 con 0x7fe888033870 2024-09-12T12:13:08.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe888033c50 con 0x7fe888036570 2024-09-12T12:13:08.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe888039820 con 0x7fe888039260 2024-09-12T12:13:08.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59fde00640 1 -- 172.21.15.144:0/1838032815 >> v1:172.21.15.144:6789/0 conn(0x7f59f8051380 legacy=0x7f59f8051830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f59fde00640 1 -- 172.21.15.144:0/1838032815 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f8038800 con 0x7f59f8054f50 2024-09-12T12:13:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88f400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe888036570 0x7fe8880de200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88f400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe888036570 0x7fe8880de200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43884/0 (socket says 172.21.15.144:43884) 2024-09-12T12:13:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88f400640 1 -- 172.21.15.144:0/2977466035 learned_addr learned my addr 172.21.15.144:0/2977466035 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88e000640 1 --2- 172.21.15.144:0/2977466035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe888039260 0x7fe888036030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88f400640 1 -- 172.21.15.144:0/2977466035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe888039260 msgr2=0x7fe888036030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88f400640 1 --2- 172.21.15.144:0/2977466035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe888039260 0x7fe888036030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88f400640 1 -- 172.21.15.144:0/2977466035 >> v2:172.21.15.144:3300/0 conn(0x7fe888033870 msgr2=0x7fe888006f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88f400640 1 --2- 172.21.15.144:0/2977466035 >> v2:172.21.15.144:3300/0 conn(0x7fe888033870 0x7fe888006f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7fe88f400640 1 -- 172.21.15.144:0/2977466035 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe888039b00 con 0x7fe888036570 2024-09-12T12:13:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9d99e00640 1 --2- 172.21.15.144:0/1212099784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 0x7f9d94109040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d94050fe0 tx=0x7f9d8c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebc916128e6f9cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9d98a00640 1 -- 172.21.15.144:0/1212099784 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0b2070 con 0x7f9d94050610 2024-09-12T12:13:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9d98a00640 1 -- 172.21.15.144:0/1212099784 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0a9070 con 0x7f9d94050610 2024-09-12T12:13:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9d98a00640 1 -- 172.21.15.144:0/1212099784 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0ad880 con 0x7f9d94050610 2024-09-12T12:13:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9da0c00640 1 -- 172.21.15.144:0/1212099784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 msgr2=0x7f9d94109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9da0c00640 1 --2- 172.21.15.144:0/1212099784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 0x7f9d94109040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d94050fe0 tx=0x7f9d8c01c4b0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9da0c00640 1 -- 172.21.15.144:0/1212099784 shutdown_connections 2024-09-12T12:13:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9da0c00640 1 --2- 172.21.15.144:0/1212099784 >> v2:172.21.15.144:3300/0 conn(0x7f9d94054f40 0x7f9d94036030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9da0c00640 1 --2- 172.21.15.144:0/1212099784 >> v2:172.21.15.165:3300/0 conn(0x7f9d94036570 0x7f9d94104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9da0c00640 1 --2- 172.21.15.144:0/1212099784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 0x7f9d94109040 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f9da0c00640 1 -- 172.21.15.144:0/1212099784 >> 172.21.15.144:0/1212099784 conn(0x7f9d9401d940 msgr2=0x7f9d940545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.241+0000 7f73fb200640 1 Processor -- start 2024-09-12T12:13:08.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f9da0c00640 1 -- 172.21.15.144:0/1212099784 shutdown_connections 2024-09-12T12:13:08.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f73fb200640 1 -- start start 2024-09-12T12:13:08.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59fde00640 1 --2- 172.21.15.144:0/1838032815 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8054f50 0x7f59f8054300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f59ec006fd0 tx=0x7f59ec01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d57a8c416cc338 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7fe88f400640 1 --2- 172.21.15.144:0/2977466035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 0x7fe8880de200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe89006b270 tx=0x7fe890098700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=969daa2637a748ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f9da0c00640 1 -- 172.21.15.144:0/1212099784 wait complete. 2024-09-12T12:13:08.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f3d47200640 1 Processor -- start 2024-09-12T12:13:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59fca00640 1 -- 172.21.15.144:0/1838032815 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0b2070 con 0x7f59f8054f50 2024-09-12T12:13:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59fca00640 1 -- 172.21.15.144:0/1838032815 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec0a9070 con 0x7f59f8054f50 2024-09-12T12:13:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59fca00640 1 -- 172.21.15.144:0/1838032815 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0ad880 con 0x7f59f8054f50 2024-09-12T12:13:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7fe88d600640 1 -- 172.21.15.144:0/2977466035 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89012c070 con 0x7fe888036570 2024-09-12T12:13:08.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f73fb200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f73fc15b110 0x7f73fc072190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7fe88d600640 1 -- 172.21.15.144:0/2977466035 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe890127600 con 0x7fe888036570 2024-09-12T12:13:08.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7fe88d600640 1 -- 172.21.15.144:0/2977466035 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890127a70 con 0x7fe888036570 2024-09-12T12:13:08.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f2a7a600640 1 Processor -- start 2024-09-12T12:13:08.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f2a7a600640 1 -- start start 2024-09-12T12:13:08.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f9da0c00640 1 Processor -- start 2024-09-12T12:13:08.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f9da0c00640 1 -- start start 2024-09-12T12:13:08.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f7dbca00640 1 Processor -- start 2024-09-12T12:13:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7fe88fe00640 1 -- 172.21.15.144:0/2977466035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 msgr2=0x7fe8880de200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59ff200640 1 -- 172.21.15.144:0/1838032815 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8054f50 msgr2=0x7f59f8054300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59ff200640 1 --2- 172.21.15.144:0/1838032815 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8054f50 0x7f59f8054300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f59ec006fd0 tx=0x7f59ec01c560 comp rx=0 tx=0).stop 2024-09-12T12:13:08.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7fe88fe00640 1 --2- 172.21.15.144:0/2977466035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 0x7fe8880de200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe89006b270 tx=0x7fe890098700 comp rx=0 tx=0).stop 2024-09-12T12:13:08.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f73fb200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73fc0b2590 0x7f73fc15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59ff200640 1 -- 172.21.15.144:0/1838032815 shutdown_connections 2024-09-12T12:13:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59ff200640 1 --2- 172.21.15.144:0/1838032815 >> v2:172.21.15.165:3300/0 conn(0x7f59f8055330 0x7f59f80e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59ff200640 1 --2- 172.21.15.144:0/1838032815 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8054f50 0x7f59f8054300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f59ff200640 1 -- 172.21.15.144:0/1838032815 >> 172.21.15.144:0/1838032815 conn(0x7f59f80567c0 msgr2=0x7f59f8056bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f7dbca00640 1 -- start start 2024-09-12T12:13:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f3d47200640 1 -- start start 2024-09-12T12:13:08.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f3d47200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c0338c0 0x7f3d3c047580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f3d47200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3c01dea0 con 0x7f3d3c04eb70 2024-09-12T12:13:08.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f3d47200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3c00bac0 con 0x7f3d3c009b00 2024-09-12T12:13:08.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.245+0000 7f3d47200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3c01d0e0 con 0x7f3d3c0338c0 2024-09-12T12:13:08.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f59ff200640 1 -- 172.21.15.144:0/1838032815 shutdown_connections 2024-09-12T12:13:08.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73f9400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f73fc0726d0 0x7f73fc0b1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:54782/0 (socket says 172.21.15.144:54782) 2024-09-12T12:13:08.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f59ff200640 1 -- 172.21.15.144:0/1838032815 wait complete. 2024-09-12T12:13:08.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7fe88fe00640 1 -- 172.21.15.144:0/2977466035 shutdown_connections 2024-09-12T12:13:08.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7fe88fe00640 1 --2- 172.21.15.144:0/2977466035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 0x7fe8880de200 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7fe88fe00640 1 --2- 172.21.15.144:0/2977466035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe888039260 0x7fe888036030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7fe88fe00640 1 --2- 172.21.15.144:0/2977466035 >> v2:172.21.15.144:3300/0 conn(0x7fe888033870 0x7fe888006f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7fe88fe00640 1 -- 172.21.15.144:0/2977466035 >> 172.21.15.144:0/2977466035 conn(0x7fe88801d940 msgr2=0x7fe8880545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73f9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f73fc15b110 0x7f73fc072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73fb200640 1 -- 172.21.15.144:0/2278159291 --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73fc072ce0 con 0x7f73fc0726d0 2024-09-12T12:13:08.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73fb200640 1 -- 172.21.15.144:0/2278159291 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f73fc072fc0 con 0x7f73fc0b2590 2024-09-12T12:13:08.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73fb200640 1 -- 172.21.15.144:0/2278159291 --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f73fc0732a0 con 0x7f73fc15b110 2024-09-12T12:13:08.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73f9400640 1 -- 172.21.15.144:0/2278159291 learned_addr learned my addr 172.21.15.144:0/2278159291 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:08.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f3d46800640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f3d3c009b00 0x7f3d3c009f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:54790/0 (socket says 172.21.15.144:54790) 2024-09-12T12:13:08.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7fe88fe00640 1 -- 172.21.15.144:0/2977466035 shutdown_connections 2024-09-12T12:13:08.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7fe88fe00640 1 -- 172.21.15.144:0/2977466035 wait complete. 2024-09-12T12:13:08.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a7a600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a7415ad50 0x7f2a7415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f3d46800640 1 -- 172.21.15.144:0/2154584002 learned_addr learned my addr 172.21.15.144:0/2154584002 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:08.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f3d45400640 1 --2- 172.21.15.144:0/2154584002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c0338c0 0x7f3d3c047580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f7dbca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 0x7f7db0047580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f7dbca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7db00338c0 0x7f7db004ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f7dbca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db001dea0 con 0x7f7db0005a70 2024-09-12T12:13:08.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f7dbca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7db000bac0 con 0x7f7db00338c0 2024-09-12T12:13:08.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f7dbca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7db004f490 con 0x7f7db004eb70 2024-09-12T12:13:08.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9da0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d94036570 0x7f9d94106370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9da0c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 0x7f9d94103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9da0c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d94054f40 0x7f9d940f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9da0c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d94005b90 con 0x7f9d94036570 2024-09-12T12:13:08.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9da0c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9d94005a10 con 0x7f9d94054f40 2024-09-12T12:13:08.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9da0c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9d94005d10 con 0x7f9d94050610 2024-09-12T12:13:08.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a7a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a740b3aa0 con 0x7f2a740b49e0 2024-09-12T12:13:08.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a7a600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a740afc10 con 0x7f2a740b3590 2024-09-12T12:13:08.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a7a600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7415f860 con 0x7f2a7415ad50 2024-09-12T12:13:08.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f2a740b3590 0x7f2a740b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:54800/0 (socket says 172.21.15.144:54800) 2024-09-12T12:13:08.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72a00640 1 -- 172.21.15.144:0/4260625367 learned_addr learned my addr 172.21.15.144:0/4260625367 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:08.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73f8a00640 1 -- 172.21.15.144:0/2278159291 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3623433274 0 0) 0x7f73fc072ce0 con 0x7f73fc0726d0 2024-09-12T12:13:08.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73f9e00640 1 -- 172.21.15.144:0/2278159291 >> v2:172.21.15.144:3300/0 conn(0x7f73fc0b2590 msgr2=0x7f73fc15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f3d44a00640 1 -- 172.21.15.144:0/2154584002 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675847581 0 0) 0x7f3d3c00bac0 con 0x7f3d3c009b00 2024-09-12T12:13:08.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f3d44a00640 1 -- 172.21.15.144:0/2154584002 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d28003530 con 0x7f3d3c009b00 2024-09-12T12:13:08.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a73400640 1 --2- 172.21.15.144:0/4260625367 >> v2:172.21.15.144:3300/0 conn(0x7f2a7415ad50 0x7f2a7415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9d9a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d94054f40 0x7f9d940f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9d9a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d94054f40 0x7f9d940f8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43896/0 (socket says 172.21.15.144:43896) 2024-09-12T12:13:08.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9d9a800640 1 -- 172.21.15.144:0/1417760918 learned_addr learned my addr 172.21.15.144:0/1417760918 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9d99400640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 0x7f9d94103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f7db7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 0x7f7db0047580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f7db7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7db0005a70 0x7f7db0005f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37256/0 (socket says 172.21.15.144:37256) 2024-09-12T12:13:08.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f7db7e00640 1 -- 172.21.15.144:0/4149778620 learned_addr learned my addr 172.21.15.144:0/4149778620 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:08.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114028270 0 0) 0x7f2a740afc10 con 0x7f2a740b3590 2024-09-12T12:13:08.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a58003530 con 0x7f2a740b3590 2024-09-12T12:13:08.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9d9a800640 1 -- 172.21.15.144:0/1417760918 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 msgr2=0x7f9d94103040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9d9a800640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d94050610 0x7f9d94103040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9d9a800640 1 -- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d94036570 msgr2=0x7f9d94106370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9d9a800640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d94036570 0x7f9d94106370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f9d9a800640 1 -- 172.21.15.144:0/1417760918 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9404ca10 con 0x7f9d94054f40 2024-09-12T12:13:08.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f7db6a00640 1 --2- 172.21.15.144:0/4149778620 >> v2:172.21.15.144:3300/0 conn(0x7f7db00338c0 0x7f7db004ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 247299061 0 0) 0x7f2a58003530 con 0x7f2a740b3590 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 >> v2:172.21.15.144:3300/0 conn(0x7f2a7415ad50 msgr2=0x7f2a7415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 --2- 172.21.15.144:0/4260625367 >> v2:172.21.15.144:3300/0 conn(0x7f2a7415ad50 0x7f2a7415f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 >> v1:172.21.15.144:6789/0 conn(0x7f2a740b49e0 legacy=0x7f2a740b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 --> v1:172.21.15.165:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a740afef0 con 0x7f2a740b3590 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 <== mon.1 v1:172.21.15.165:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f2a60001680 con 0x7f2a740b3590 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 >> v1:172.21.15.165:6789/0 conn(0x7f2a740b3590 legacy=0x7f2a740b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 --2- 172.21.15.144:0/4260625367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a58003a10 0x7f2a58003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 --2- 172.21.15.144:0/4260625367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a58004810 0x7f2a58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 --2- 172.21.15.144:0/4260625367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a580051d0 0x7f2a5800ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7415f860 con 0x7f2a58004810 2024-09-12T12:13:08.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58010660 con 0x7f2a58003a10 2024-09-12T12:13:08.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2a58009c40 con 0x7f2a580051d0 2024-09-12T12:13:08.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f59ff200640 1 Processor -- start 2024-09-12T12:13:08.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f2a73e00640 1 --2- 172.21.15.144:0/4260625367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a580051d0 0x7f2a5800ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f59ff200640 1 -- start start 2024-09-12T12:13:08.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f7db7400640 1 -- 172.21.15.144:0/4149778620 >> v2:172.21.15.144:3300/0 conn(0x7f7db00338c0 msgr2=0x7f7db004ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f7db7400640 1 --2- 172.21.15.144:0/4149778620 >> v2:172.21.15.144:3300/0 conn(0x7f7db00338c0 0x7f7db004ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f7db7400640 1 -- 172.21.15.144:0/4149778620 >> v1:172.21.15.144:6789/0 conn(0x7f7db0005a70 legacy=0x7f7db0005f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f7db7400640 1 -- 172.21.15.144:0/4149778620 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db001d0e0 con 0x7f7db004eb70 2024-09-12T12:13:08.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f7db6a00640 1 --2- 172.21.15.144:0/4149778620 >> v2:172.21.15.144:3300/0 conn(0x7f7db00338c0 0x7f7db004ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:08.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f9d9a800640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d94054f40 0x7f9d940f8fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c000b70 tx=0x7f9d9c069f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f9d92000640 1 -- 172.21.15.144:0/1417760918 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0749b0 con 0x7f9d94054f40 2024-09-12T12:13:08.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88fe00640 1 Processor -- start 2024-09-12T12:13:08.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f2a73e00640 1 -- 172.21.15.144:0/4260625367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a58003a10 msgr2=0x7f2a58003e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:13:08.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f2a73e00640 1 --2- 172.21.15.144:0/4260625367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a58003a10 0x7f2a58003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f2a73e00640 1 -- 172.21.15.144:0/4260625367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a58004810 msgr2=0x7f2a58004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f2a73e00640 1 --2- 172.21.15.144:0/4260625367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a58004810 0x7f2a58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f2a73e00640 1 -- 172.21.15.144:0/4260625367 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a58003530 con 0x7f2a580051d0 2024-09-12T12:13:08.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f9d92000640 1 -- 172.21.15.144:0/1417760918 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9c074b90 con 0x7f9d94054f40 2024-09-12T12:13:08.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f9d92000640 1 -- 172.21.15.144:0/1417760918 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c063020 con 0x7f9d94054f40 2024-09-12T12:13:08.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d94103580 con 0x7f9d94054f40 2024-09-12T12:13:08.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d94103b00 con 0x7f9d94054f40 2024-09-12T12:13:08.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88fe00640 1 -- start start 2024-09-12T12:13:08.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888033870 0x7fe8880cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 0x7fe8880355c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe888039260 0x7fe888048050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe888005a10 con 0x7fe888033870 2024-09-12T12:13:08.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880ec740 con 0x7fe888036570 2024-09-12T12:13:08.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe888005b90 con 0x7fe888039260 2024-09-12T12:13:08.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d94109040 con 0x7f9d94054f40 2024-09-12T12:13:08.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f59ff200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8051380 0x7f59f80d8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f59ff200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f8054f50 0x7f59f80395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88e000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 0x7fe8880355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88e000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 0x7fe8880355c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43912/0 (socket says 172.21.15.144:43912) 2024-09-12T12:13:08.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7fe88e000640 1 -- 172.21.15.144:0/2554930956 learned_addr learned my addr 172.21.15.144:0/2554930956 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f59fde00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8051380 0x7f59f80d8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f59fde00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8051380 0x7f59f80d8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43918/0 (socket says 172.21.15.144:43918) 2024-09-12T12:13:08.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73fa800640 1 --2- 172.21.15.144:0/2278159291 >> v2:172.21.15.144:3300/0 conn(0x7f73fc0b2590 0x7f73fc15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73f9e00640 1 --2- 172.21.15.144:0/2278159291 >> v2:172.21.15.144:3300/0 conn(0x7f73fc0b2590 0x7f73fc15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73f9e00640 1 -- 172.21.15.144:0/2278159291 >> v1:172.21.15.165:6789/0 conn(0x7f73fc0726d0 legacy=0x7f73fc0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f73f9e00640 1 -- 172.21.15.144:0/2278159291 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc073580 con 0x7f73fc15b110 2024-09-12T12:13:08.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f59fde00640 1 -- 172.21.15.144:0/1299425801 learned_addr learned my addr 172.21.15.144:0/1299425801 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f3d45400640 1 -- 172.21.15.144:0/2154584002 >> v1:172.21.15.165:6789/0 conn(0x7f3d3c009b00 legacy=0x7f3d3c009f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f3d45400640 1 -- 172.21.15.144:0/2154584002 >> v1:172.21.15.144:6789/0 conn(0x7f3d3c04eb70 legacy=0x7f3d3c04ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.249+0000 7f3d45400640 1 -- 172.21.15.144:0/2154584002 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c01d3c0 con 0x7f3d3c0338c0 2024-09-12T12:13:08.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f73fa800640 1 --2- 172.21.15.144:0/2278159291 >> v2:172.21.15.144:3300/0 conn(0x7f73fc0b2590 0x7f73fc15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:08.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f73f9e00640 1 --2- 172.21.15.144:0/2278159291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc15b110 0x7f73fc072190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0b5d90 tx=0x7f73f401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b0dba50f8752cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f59ff200640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8055330 0x7f59f800bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f59ff200640 1 -- 172.21.15.144:0/1299425801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8039000 con 0x7f59f8054f50 2024-09-12T12:13:08.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f73f8a00640 1 -- 172.21.15.144:0/2278159291 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f40b2070 con 0x7f73fc15b110 2024-09-12T12:13:08.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f73f8a00640 1 -- 172.21.15.144:0/2278159291 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f40a5830 con 0x7f73fc15b110 2024-09-12T12:13:08.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f73f8a00640 1 -- 172.21.15.144:0/2278159291 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f40a5be0 con 0x7f73fc15b110 2024-09-12T12:13:08.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.253+0000 7f9d92000640 1 -- 172.21.15.144:0/1417760918 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d9c0a39e0 con 0x7f9d94054f40 2024-09-12T12:13:08.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88ea00640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888033870 0x7fe8880cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59fe800640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8055330 0x7f59f800bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88f400640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe888039260 0x7fe888048050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59ff200640 1 -- 172.21.15.144:0/1299425801 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59f8007740 con 0x7f59f8051380 2024-09-12T12:13:08.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59ff200640 1 -- 172.21.15.144:0/1299425801 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59f803bfa0 con 0x7f59f8055330 2024-09-12T12:13:08.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88e000640 1 -- 172.21.15.144:0/2554930956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe888039260 msgr2=0x7fe888048050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88e000640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe888039260 0x7fe888048050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88e000640 1 -- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888033870 msgr2=0x7fe8880cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88e000640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe888033870 0x7fe8880cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88e000640 1 -- 172.21.15.144:0/2554930956 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8880ea4a0 con 0x7fe888036570 2024-09-12T12:13:08.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88e000640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 0x7fe8880355c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00e870 tx=0x7fe87c00ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f73fb200640 1 -- 172.21.15.144:0/2278159291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc15b110 msgr2=0x7f73fc072190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f73fb200640 1 --2- 172.21.15.144:0/2278159291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc15b110 0x7f73fc072190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0b5d90 tx=0x7f73f401c970 comp rx=0 tx=0).stop 2024-09-12T12:13:08.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59fd400640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f8054f50 0x7f59f80395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f3c16800640 1 Processor -- start 2024-09-12T12:13:08.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f9d92000640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d7c067990 0x7f9d7c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f73fb200640 1 -- 172.21.15.144:0/2278159291 shutdown_connections 2024-09-12T12:13:08.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe886a00640 1 -- 172.21.15.144:0/2554930956 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c017070 con 0x7fe888036570 2024-09-12T12:13:08.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe886a00640 1 -- 172.21.15.144:0/2554930956 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87c00c730 con 0x7fe888036570 2024-09-12T12:13:08.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe886a00640 1 -- 172.21.15.144:0/2554930956 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c00cae0 con 0x7fe888036570 2024-09-12T12:13:08.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f9d92000640 1 -- 172.21.15.144:0/1417760918 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9d9c0f0c30 con 0x7f9d94054f40 2024-09-12T12:13:08.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a73e00640 1 -- 172.21.15.144:0/4260625367 reap_dead start 2024-09-12T12:13:08.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f3d45400640 1 --2- 172.21.15.144:0/2154584002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c0338c0 0x7f3d3c047580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d300097f0 tx=0x7f3d3001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf3008507826fdc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8880dd2f0 con 0x7fe888036570 2024-09-12T12:13:08.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f73fb200640 1 --2- 172.21.15.144:0/2278159291 >> v2:172.21.15.144:3300/0 conn(0x7f73fc0b2590 0x7f73fc15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f73fb200640 1 --2- 172.21.15.144:0/2278159291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc15b110 0x7f73fc072190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f73fb200640 1 -- 172.21.15.144:0/2278159291 >> 172.21.15.144:0/2278159291 conn(0x7f73fc06bc10 msgr2=0x7f73fc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a73e00640 1 --2- 172.21.15.144:0/4260625367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a580051d0 0x7f2a5800ffe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c001d50 tx=0x7f2a6c01c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d3e52c0585ed9fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59fde00640 1 -- 172.21.15.144:0/1299425801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8055330 msgr2=0x7f59f800bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59fde00640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59f8055330 0x7f59f800bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59fde00640 1 -- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f8054f50 msgr2=0x7f59f80395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59fde00640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f8054f50 0x7f59f80395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59fde00640 1 -- 172.21.15.144:0/1299425801 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f803b670 con 0x7f59f8051380 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59fd400640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59f8054f50 0x7f59f80395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f59fde00640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8051380 0x7f59f80d8670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59ec01ac10 tx=0x7f59ec019300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f59f6000640 1 -- 172.21.15.144:0/1299425801 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0b2040 con 0x7f59f8051380 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f59f6000640 1 -- 172.21.15.144:0/1299425801 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec0039a0 con 0x7f59f8051380 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f59f6000640 1 -- 172.21.15.144:0/1299425801 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec003d70 con 0x7f59f8051380 2024-09-12T12:13:08.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f59ff200640 1 -- 172.21.15.144:0/1299425801 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f803b950 con 0x7f59f8051380 2024-09-12T12:13:08.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f59ff200640 1 -- 172.21.15.144:0/1299425801 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f80d8bb0 con 0x7f59f8051380 2024-09-12T12:13:08.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe888034dc0 con 0x7fe888036570 2024-09-12T12:13:08.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8880de200 con 0x7fe888036570 2024-09-12T12:13:08.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7fe886a00640 1 -- 172.21.15.144:0/2554930956 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe87c01a070 con 0x7fe888036570 2024-09-12T12:13:08.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f9d92000640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7f9d7c071110 0x7f9d7c073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f9d92000640 1 -- 172.21.15.144:0/1417760918 --> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d7c073c20 con 0x7f9d7c071110 2024-09-12T12:13:08.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f9d92000640 1 -- 172.21.15.144:0/1417760918 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d9c0f1020 con 0x7f9d94054f40 2024-09-12T12:13:08.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f9d99400640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7f9d7c071110 0x7f9d7c073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f9d99e00640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d7c067990 0x7f9d7c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f9d99400640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7f9d7c071110 0x7f9d7c073550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f9d99e00640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d7c067990 0x7f9d7c069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0af000 tx=0x7f9d8c004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f73fb200640 1 -- 172.21.15.144:0/2278159291 shutdown_connections 2024-09-12T12:13:08.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f73fb200640 1 -- 172.21.15.144:0/2278159291 wait complete. 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f7db7400640 1 --2- 172.21.15.144:0/4149778620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 0x7f7db0047580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0097a0 tx=0x7f7dac01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e62e9a406272849 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f7db6000640 1 -- 172.21.15.144:0/4149778620 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0b0070 con 0x7f7db004eb70 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f7db6000640 1 -- 172.21.15.144:0/4149778620 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dac0ab600 con 0x7f7db004eb70 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f7db6000640 1 -- 172.21.15.144:0/4149778620 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0ab9d0 con 0x7f7db004eb70 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f7dbca00640 1 -- 172.21.15.144:0/4149778620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 msgr2=0x7f7db0047580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f7dbca00640 1 --2- 172.21.15.144:0/4149778620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 0x7f7db0047580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0097a0 tx=0x7f7dac01c440 comp rx=0 tx=0).stop 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f7dbca00640 1 -- 172.21.15.144:0/4149778620 shutdown_connections 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f7dbca00640 1 --2- 172.21.15.144:0/4149778620 >> v2:172.21.15.144:3300/0 conn(0x7f7db00338c0 0x7f7db004ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f7dbca00640 1 --2- 172.21.15.144:0/4149778620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 0x7f7db0047580 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f7dbca00640 1 -- 172.21.15.144:0/4149778620 >> 172.21.15.144:0/4149778620 conn(0x7f7db00360a0 msgr2=0x7f7db00364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c001950 con 0x7f2a580051d0 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6c003b80 con 0x7f2a580051d0 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a72000640 1 -- 172.21.15.144:0/4260625367 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0a6040 con 0x7f2a580051d0 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a7a600640 1 -- 172.21.15.144:0/4260625367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a580051d0 msgr2=0x7f2a5800ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a7a600640 1 --2- 172.21.15.144:0/4260625367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a580051d0 0x7f2a5800ffe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c001d50 tx=0x7f2a6c01c6a0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a7a600640 1 -- 172.21.15.144:0/4260625367 shutdown_connections 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a7a600640 1 --2- 172.21.15.144:0/4260625367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a580051d0 0x7f2a5800ffe0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a7a600640 1 -- 172.21.15.144:0/4260625367 >> 172.21.15.144:0/4260625367 conn(0x7f2a7406d0d0 msgr2=0x7f2a7406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f2a7a600640 1 -- 172.21.15.144:0/4260625367 shutdown_connections 2024-09-12T12:13:08.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f2a7a600640 1 -- 172.21.15.144:0/4260625367 wait complete. 2024-09-12T12:13:08.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3d44a00640 1 -- 172.21.15.144:0/2154584002 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d300b2070 con 0x7f3d3c0338c0 2024-09-12T12:13:08.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3d44a00640 1 -- 172.21.15.144:0/2154584002 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d300ad640 con 0x7f3d3c0338c0 2024-09-12T12:13:08.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3d44a00640 1 -- 172.21.15.144:0/2154584002 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d300ada10 con 0x7f3d3c0338c0 2024-09-12T12:13:08.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f3c16800640 1 -- start start 2024-09-12T12:13:08.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f3c16800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c101605e0 0x7f3c101643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f3c16800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c101609c0 0x7f3c10163230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f3c16800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c100b17c0 con 0x7f3c100cdd40 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f3c16800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3c100b1af0 con 0x7f3c101609c0 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.257+0000 7f3c16800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3c10163af0 con 0x7f3c101605e0 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3c0f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c101605e0 0x7f3c101643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3c0f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c101605e0 0x7f3c101643f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34098/0 (socket says 172.21.15.144:34098) 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3c0f400640 1 -- 172.21.15.144:0/3781487265 learned_addr learned my addr 172.21.15.144:0/3781487265 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3c0f400640 1 -- 172.21.15.144:0/3781487265 >> v2:172.21.15.144:3300/0 conn(0x7f3c101609c0 msgr2=0x7f3c10163230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3c0f400640 1 --2- 172.21.15.144:0/3781487265 >> v2:172.21.15.144:3300/0 conn(0x7f3c101609c0 0x7f3c10163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3c0f400640 1 -- 172.21.15.144:0/3781487265 >> v1:172.21.15.165:6789/0 conn(0x7f3c100cdd40 legacy=0x7f3c100b5b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3c0f400640 1 -- 172.21.15.144:0/3781487265 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c10163dd0 con 0x7f3c101605e0 2024-09-12T12:13:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3d47200640 1 -- 172.21.15.144:0/2154584002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c0338c0 msgr2=0x7f3d3c047580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f3d47200640 1 --2- 172.21.15.144:0/2154584002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c0338c0 0x7f3d3c047580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d300097f0 tx=0x7f3d3001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f7dbca00640 1 -- 172.21.15.144:0/4149778620 shutdown_connections 2024-09-12T12:13:08.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f2a7a600640 1 Processor -- start 2024-09-12T12:13:08.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7fe886a00640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe870067910 0x7fe870069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7fe886a00640 1 -- 172.21.15.144:0/2554930956 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe87c086110 con 0x7fe888036570 2024-09-12T12:13:08.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7fe886a00640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fe870071090 0x7fe8700734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7fe886a00640 1 -- 172.21.15.144:0/2554930956 --> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe87c016ec0 con 0x7fe870071090 2024-09-12T12:13:08.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7fe88ea00640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe870067910 0x7fe870069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7fe886a00640 1 -- 172.21.15.144:0/2554930956 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe87c0865f0 con 0x7fe888036570 2024-09-12T12:13:08.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f2a7a600640 1 -- start start 2024-09-12T12:13:08.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7fe88f400640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fe870071090 0x7fe8700734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f73fb200640 1 Processor -- start 2024-09-12T12:13:08.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f7dbca00640 1 -- 172.21.15.144:0/4149778620 wait complete. 2024-09-12T12:13:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.261+0000 7f9d92000640 1 -- 172.21.15.144:0/1417760918 <== osd.2 v2:172.21.15.144:6809/1322554046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d7c073c20 con 0x7f9d7c071110 2024-09-12T12:13:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7fe88ea00640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe870067910 0x7fe870069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe880009990 tx=0x7fe880009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7fe88f400640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fe870071090 0x7fe8700734d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fb200640 1 -- start start 2024-09-12T12:13:08.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a7a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a580051d0 0x7f2a74071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a7a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a74070f00 0x7f2a74151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a7a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a740732a0 0x7f2a74073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7fe886a00640 1 -- 172.21.15.144:0/2554930956 <== osd.1 v2:172.21.15.144:6824/68043553 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe87c016ec0 con 0x7fe870071090 2024-09-12T12:13:08.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f7dbca00640 1 Processor -- start 2024-09-12T12:13:08.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a7a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7415b130 con 0x7f2a740732a0 2024-09-12T12:13:08.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a7a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a740cdeb0 con 0x7f2a580051d0 2024-09-12T12:13:08.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a7a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7415b2b0 con 0x7f2a74070f00 2024-09-12T12:13:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a73400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a580051d0 0x7f2a74071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a73400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a580051d0 0x7f2a74071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43934/0 (socket says 172.21.15.144:43934) 2024-09-12T12:13:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a73400640 1 -- 172.21.15.144:0/4069759483 learned_addr learned my addr 172.21.15.144:0/4069759483 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f7dbca00640 1 -- start start 2024-09-12T12:13:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a72a00640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a74070f00 0x7f2a74151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f59eb400640 1 -- 172.21.15.144:0/1299425801 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59f80e4f00 con 0x7f59f8051380 2024-09-12T12:13:08.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc0726d0 0x7f73fc13de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0b2590 0x7f73fc14c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a72a00640 1 -- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a580051d0 msgr2=0x7f2a74071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a72a00640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a580051d0 0x7f2a74071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a72a00640 1 -- 172.21.15.144:0/4069759483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a740732a0 msgr2=0x7f2a74073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a73e00640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a740732a0 0x7f2a74073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a72a00640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a740732a0 0x7f2a74073720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a72a00640 1 -- 172.21.15.144:0/4069759483 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a741516d0 con 0x7f2a74070f00 2024-09-12T12:13:08.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a72a00640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a74070f00 0x7f2a74151190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000f650 tx=0x7f2a6000fb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc15b110 0x7f73fc14c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f7dbca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7db0005a70 0x7f7db00e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73f9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0b2590 0x7f73fc14c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc15cb90 con 0x7f73fc0726d0 2024-09-12T12:13:08.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a6b400640 1 -- 172.21.15.144:0/4069759483 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60017020 con 0x7f2a74070f00 2024-09-12T12:13:08.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a6b400640 1 -- 172.21.15.144:0/4069759483 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a60006270 con 0x7f2a74070f00 2024-09-12T12:13:08.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a6b400640 1 -- 172.21.15.144:0/4069759483 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60006660 con 0x7f2a74070f00 2024-09-12T12:13:08.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f3c0f400640 1 --2- 172.21.15.144:0/3781487265 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c101605e0 0x7f3c101643f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b1990 tx=0x7f3c0001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd01e4851a99565 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc15ca10 con 0x7f73fc0b2590 2024-09-12T12:13:08.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a740cef20 con 0x7f2a74070f00 2024-09-12T12:13:08.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a740cf4e0 con 0x7f2a74070f00 2024-09-12T12:13:08.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc15cd10 con 0x7f73fc15b110 2024-09-12T12:13:08.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fa800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc15b110 0x7f73fc14c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fa800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc15b110 0x7f73fc14c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34112/0 (socket says 172.21.15.144:34112) 2024-09-12T12:13:08.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f73fa800640 1 -- 172.21.15.144:0/1714607226 learned_addr learned my addr 172.21.15.144:0/1714607226 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f7dbca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7db00338c0 0x7f7db0048910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f7dbca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 0x7f7db0048e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f7dbca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0007410 con 0x7f7db0005a70 2024-09-12T12:13:08.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f7dbca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7db0007290 con 0x7f7db00338c0 2024-09-12T12:13:08.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f7dbca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7db000ab10 con 0x7f7db004eb70 2024-09-12T12:13:08.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db6a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7db00338c0 0x7f7db0048910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db6a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7db00338c0 0x7f7db0048910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43962/0 (socket says 172.21.15.144:43962) 2024-09-12T12:13:08.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db6a00640 1 -- 172.21.15.144:0/2010784271 learned_addr learned my addr 172.21.15.144:0/2010784271 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73fa800640 1 -- 172.21.15.144:0/1714607226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0b2590 msgr2=0x7f73fc14c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73fa800640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0b2590 0x7f73fc14c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73fa800640 1 -- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc0726d0 msgr2=0x7f73fc13de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73fa800640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc0726d0 0x7f73fc13de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73fa800640 1 -- 172.21.15.144:0/1714607226 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc0b2370 con 0x7f73fc15b110 2024-09-12T12:13:08.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3d47200640 1 -- 172.21.15.144:0/2154584002 shutdown_connections 2024-09-12T12:13:08.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3d47200640 1 --2- 172.21.15.144:0/2154584002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c0338c0 0x7f3d3c047580 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3d47200640 1 -- 172.21.15.144:0/2154584002 >> 172.21.15.144:0/2154584002 conn(0x7f3d3c0360a0 msgr2=0x7f3d3c0364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3c0e000640 1 -- 172.21.15.144:0/3781487265 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c000b1070 con 0x7f3c101605e0 2024-09-12T12:13:08.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3c0e000640 1 -- 172.21.15.144:0/3781487265 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c000ac640 con 0x7f3c101605e0 2024-09-12T12:13:08.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73fa800640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc15b110 0x7f73fc14c880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00c820 tx=0x7f73ec00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db7e00640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 0x7f7db0048e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a7415f320 con 0x7f2a74070f00 2024-09-12T12:13:08.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3d47200640 1 -- 172.21.15.144:0/2154584002 shutdown_connections 2024-09-12T12:13:08.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3c0e000640 1 -- 172.21.15.144:0/3781487265 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c000aca10 con 0x7f3c101605e0 2024-09-12T12:13:08.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.265+0000 7f59f6000640 1 -- 172.21.15.144:0/1299425801 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59ec0ab070 con 0x7f59f8051380 2024-09-12T12:13:08.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73f2000640 1 -- 172.21.15.144:0/1714607226 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec015070 con 0x7f73fc15b110 2024-09-12T12:13:08.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db7e00640 1 -- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7db00338c0 msgr2=0x7f7db0048910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db7e00640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7db00338c0 0x7f7db0048910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db7e00640 1 -- 172.21.15.144:0/2010784271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7db0005a70 msgr2=0x7f7db00e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db7400640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7db0005a70 0x7f7db00e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73f2000640 1 -- 172.21.15.144:0/1714607226 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ec004240 con 0x7f73fc15b110 2024-09-12T12:13:08.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73f2000640 1 -- 172.21.15.144:0/1714607226 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00ce10 con 0x7f73fc15b110 2024-09-12T12:13:08.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc1419a0 con 0x7f73fc15b110 2024-09-12T12:13:08.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3d47200640 1 -- 172.21.15.144:0/2154584002 wait complete. 2024-09-12T12:13:08.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3c16800640 1 -- 172.21.15.144:0/3781487265 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c101605e0 msgr2=0x7f3c101643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f3c16800640 1 --2- 172.21.15.144:0/3781487265 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c101605e0 0x7f3c101643f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b1990 tx=0x7f3c0001c440 comp rx=0 tx=0).stop 2024-09-12T12:13:08.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc0b2090 con 0x7f73fc15b110 2024-09-12T12:13:08.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f59f6000640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59e00678c0 0x7f59e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f59f6000640 1 -- 172.21.15.144:0/1299425801 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f59ec11f900 con 0x7f59f8051380 2024-09-12T12:13:08.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f2a6b400640 1 -- 172.21.15.144:0/4069759483 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2a6001a020 con 0x7f2a74070f00 2024-09-12T12:13:08.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f59f6000640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7f59e0071040 0x7f59e0073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f59f6000640 1 -- 172.21.15.144:0/1299425801 --> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59e0073b50 con 0x7f59e0071040 2024-09-12T12:13:08.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f59f6000640 1 -- 172.21.15.144:0/1299425801 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f59ec124260 con 0x7f59f8051380 2024-09-12T12:13:08.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db7e00640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7db0005a70 0x7f7db00e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db7e00640 1 -- 172.21.15.144:0/2010784271 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db00e9450 con 0x7f7db004eb70 2024-09-12T12:13:08.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f59fd400640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59e00678c0 0x7f59e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db7400640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7db0005a70 0x7f7db00e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:08.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f7db7e00640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 0x7f7db0048e50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7da400c440 tx=0x7f7da400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f7dab400640 1 -- 172.21.15.144:0/2010784271 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4017070 con 0x7f7db004eb70 2024-09-12T12:13:08.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f7dab400640 1 -- 172.21.15.144:0/2010784271 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da4005d10 con 0x7f7db004eb70 2024-09-12T12:13:08.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f7dab400640 1 -- 172.21.15.144:0/2010784271 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4007310 con 0x7f7db004eb70 2024-09-12T12:13:08.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.269+0000 7f2a6b400640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a54067ae0 0x7f2a54069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f2a6b400640 1 -- 172.21.15.144:0/4069759483 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2a60089100 con 0x7f2a74070f00 2024-09-12T12:13:08.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f2a6b400640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7f2a540711e0 0x7f2a54073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f2a6b400640 1 -- 172.21.15.144:0/4069759483 --> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a60009f70 con 0x7f2a540711e0 2024-09-12T12:13:08.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3c16800640 1 -- 172.21.15.144:0/3781487265 shutdown_connections 2024-09-12T12:13:08.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3c16800640 1 --2- 172.21.15.144:0/3781487265 >> v2:172.21.15.144:3300/0 conn(0x7f3c101609c0 0x7f3c10163230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3c16800640 1 --2- 172.21.15.144:0/3781487265 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c101605e0 0x7f3c101643f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3c16800640 1 -- 172.21.15.144:0/3781487265 >> 172.21.15.144:0/3781487265 conn(0x7f3c1006d0d0 msgr2=0x7f3c1006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3d47200640 1 Processor -- start 2024-09-12T12:13:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f59fe800640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7f59e0071040 0x7f59e0073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3d47200640 1 -- start start 2024-09-12T12:13:08.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f2a6b400640 1 -- 172.21.15.144:0/4069759483 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2a60090050 con 0x7f2a74070f00 2024-09-12T12:13:08.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f7dbca00640 1 -- 172.21.15.144:0/2010784271 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db00e96f0 con 0x7f7db004eb70 2024-09-12T12:13:08.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f7dbca00640 1 -- 172.21.15.144:0/2010784271 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db00e9cb0 con 0x7f7db004eb70 2024-09-12T12:13:08.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f59fe800640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7f59e0071040 0x7f59e0073480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73fc15ba30 con 0x7f73fc15b110 2024-09-12T12:13:08.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f73f2000640 1 -- 172.21.15.144:0/1714607226 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73ec007830 con 0x7f73fc15b110 2024-09-12T12:13:08.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f2a73e00640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7f2a540711e0 0x7f2a54073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f59fd400640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59e00678c0 0x7f59e0069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59f800cfc0 tx=0x7f59f0009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3c16800640 1 -- 172.21.15.144:0/3781487265 shutdown_connections 2024-09-12T12:13:08.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3c16800640 1 -- 172.21.15.144:0/3781487265 wait complete. 2024-09-12T12:13:08.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f2a73e00640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7f2a540711e0 0x7f2a54073620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3c16800640 1 Processor -- start 2024-09-12T12:13:08.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f7da8c00640 1 -- 172.21.15.144:0/2010784271 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7db004ef50 con 0x7f7db004eb70 2024-09-12T12:13:08.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3d47200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c009b00 0x7f3d3c0dc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3d47200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d3c0338c0 0x7f3d3c0e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3d47200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d3c04eb70 0x7f3d3c0e42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3d47200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c00ac30 con 0x7f3d3c0338c0 2024-09-12T12:13:08.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3d47200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c00aab0 con 0x7f3d3c04eb70 2024-09-12T12:13:08.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3d47200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3c0f55e0 con 0x7f3d3c009b00 2024-09-12T12:13:08.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.273+0000 7f3c16800640 1 -- start start 2024-09-12T12:13:08.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c009b00 0x7f3d3c0dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c009b00 0x7f3d3c0dc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34126/0 (socket says 172.21.15.144:34126) 2024-09-12T12:13:08.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45e00640 1 -- 172.21.15.144:0/2866520787 learned_addr learned my addr 172.21.15.144:0/2866520787 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f73f2000640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc067910 0x7f73dc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f73f2000640 1 -- 172.21.15.144:0/1714607226 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f73ec085cd0 con 0x7f73fc15b110 2024-09-12T12:13:08.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f59f6000640 1 -- 172.21.15.144:0/1299425801 <== osd.0 v2:172.21.15.144:6808/1854211635 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59e0073b50 con 0x7f59e0071040 2024-09-12T12:13:08.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f2a73400640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a54067ae0 0x7f2a54069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f2a6b400640 1 -- 172.21.15.144:0/4069759483 <== osd.5 v2:172.21.15.165:6800/2887749117 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a60009f70 con 0x7f2a540711e0 2024-09-12T12:13:08.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c16800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c100cdd40 0x7f3c100adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f73f2000640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f73dc071090 0x7f73dc0734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f73f2000640 1 -- 172.21.15.144:0/1714607226 --> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73dc073ba0 con 0x7f73dc071090 2024-09-12T12:13:08.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f73f2000640 1 -- 172.21.15.144:0/1714607226 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73ec088420 con 0x7f73fc15b110 2024-09-12T12:13:08.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f73f9e00640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc067910 0x7f73dc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f73f9400640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f73dc071090 0x7f73dc0734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f2a73400640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a54067ae0 0x7f2a54069fa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400aaa0 tx=0x7f2a64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c16800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c101605e0 0x7f3c1015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c16800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c101609c0 0x7f3c100ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c100cdd40 0x7f3c100adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c100cdd40 0x7f3c100adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34142/0 (socket says 172.21.15.144:34142) 2024-09-12T12:13:08.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3c100b2b60 con 0x7f3c101605e0 2024-09-12T12:13:08.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0f400640 1 -- 172.21.15.144:0/4155555787 learned_addr learned my addr 172.21.15.144:0/4155555787 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3c100b29e0 con 0x7f3c101609c0 2024-09-12T12:13:08.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3c100b2ce0 con 0x7f3c100cdd40 2024-09-12T12:13:08.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0ea00640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c101605e0 0x7f3c1015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0fe00640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c101609c0 0x7f3c100ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0f400640 1 -- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c101609c0 msgr2=0x7f3c100ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0f400640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c101609c0 0x7f3c100ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0f400640 1 -- 172.21.15.144:0/4155555787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c101605e0 msgr2=0x7f3c1015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0f400640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c101605e0 0x7f3c1015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0f400640 1 -- 172.21.15.144:0/4155555787 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c100acf90 con 0x7f3c100cdd40 2024-09-12T12:13:08.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d46800640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d3c04eb70 0x7f3d3c0e42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45400640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d3c0338c0 0x7f3d3c0e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f7dab400640 1 -- 172.21.15.144:0/2010784271 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7da401a070 con 0x7f7db004eb70 2024-09-12T12:13:08.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0fe00640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c101609c0 0x7f3c100ab4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:08.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45e00640 1 -- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d3c04eb70 msgr2=0x7f3d3c0e42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45e00640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d3c04eb70 0x7f3d3c0e42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45e00640 1 -- 172.21.15.144:0/2866520787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d3c0338c0 msgr2=0x7f3d3c0e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45e00640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d3c0338c0 0x7f3d3c0e3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45e00640 1 -- 172.21.15.144:0/2866520787 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c039900 con 0x7f3d3c009b00 2024-09-12T12:13:08.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d46800640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d3c04eb70 0x7f3d3c0e42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:08.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c0f400640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c100cdd40 0x7f3c100adff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c0001a070 tx=0x7f3c000191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45400640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d3c0338c0 0x7f3d3c0e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:08.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c07400640 1 -- 172.21.15.144:0/4155555787 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c000ba020 con 0x7f3c100cdd40 2024-09-12T12:13:08.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d45e00640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c009b00 0x7f3d3c0dc120 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3d40000b70 tx=0x7f3d40069f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3c07400640 1 -- 172.21.15.144:0/4155555787 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c000b2040 con 0x7f3c100cdd40 2024-09-12T12:13:08.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f7dab400640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7d98067990 0x7f7d98069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d3a000640 1 -- 172.21.15.144:0/2866520787 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400749b0 con 0x7f3d3c009b00 2024-09-12T12:13:08.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d3a000640 1 -- 172.21.15.144:0/2866520787 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d40074b50 con 0x7f3d3c009b00 2024-09-12T12:13:08.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.277+0000 7f3d3a000640 1 -- 172.21.15.144:0/2866520787 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40075380 con 0x7f3d3c009b00 2024-09-12T12:13:08.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c100ad230 con 0x7f3c100cdd40 2024-09-12T12:13:08.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c100ad7f0 con 0x7f3c100cdd40 2024-09-12T12:13:08.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f3c07400640 1 -- 172.21.15.144:0/4155555787 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c000b1050 con 0x7f3c100cdd40 2024-09-12T12:13:08.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f7dab400640 1 -- 172.21.15.144:0/2010784271 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7da40853a0 con 0x7f7db004eb70 2024-09-12T12:13:08.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f3d47200640 1 -- 172.21.15.144:0/2866520787 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3c039be0 con 0x7f3d3c009b00 2024-09-12T12:13:08.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f3d47200640 1 -- 172.21.15.144:0/2866520787 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3c03a1a0 con 0x7f3d3c009b00 2024-09-12T12:13:08.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f73f9e00640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc067910 0x7f73dc069dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f73f40af000 tx=0x7f73f4004ac0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f7dab400640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7f7d98071110 0x7f7d98073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3be8001040 con 0x7f3c100cdd40 2024-09-12T12:13:08.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f73f9400640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f73dc071090 0x7f73dc0734d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f7dab400640 1 -- 172.21.15.144:0/2010784271 --> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d98073c20 con 0x7f7d98071110 2024-09-12T12:13:08.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f7dab400640 1 -- 172.21.15.144:0/2010784271 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7da4085790 con 0x7f7db004eb70 2024-09-12T12:13:08.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f7db6a00640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7f7d98071110 0x7f7d98073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f7db7400640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7d98067990 0x7f7d98069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f73f2000640 1 -- 172.21.15.144:0/1714607226 <== osd.3 v2:172.21.15.144:6800/331901335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73dc073ba0 con 0x7f73dc071090 2024-09-12T12:13:08.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.281+0000 7f3d3a000640 1 -- 172.21.15.144:0/2866520787 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d40075520 con 0x7f3d3c009b00 2024-09-12T12:13:08.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f7db7400640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7d98067990 0x7f7d98069e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0ad000 tx=0x7f7dac0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3c07400640 1 -- 172.21.15.144:0/4155555787 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c000bd020 con 0x7f3c100cdd40 2024-09-12T12:13:08.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3d47200640 1 -- 172.21.15.144:0/2866520787 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d3c047580 con 0x7f3d3c009b00 2024-09-12T12:13:08.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3d3a000640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d240678c0 0x7f3d24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3c07400640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bf0067910 0x7f3bf0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3d3a000640 1 -- 172.21.15.144:0/2866520787 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3d40101a30 con 0x7f3d3c009b00 2024-09-12T12:13:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3d45400640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d240678c0 0x7f3d24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3c07400640 1 -- 172.21.15.144:0/4155555787 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3c00120600 con 0x7f3c100cdd40 2024-09-12T12:13:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3c0ea00640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bf0067910 0x7f3bf0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3c07400640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f3bf0071090 0x7f3bf00734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3c07400640 1 -- 172.21.15.144:0/4155555787 --> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c000c3e80 con 0x7f3bf0071090 2024-09-12T12:13:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3c07400640 1 -- 172.21.15.144:0/4155555787 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c00120a60 con 0x7f3c100cdd40 2024-09-12T12:13:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3c0fe00640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f3bf0071090 0x7f3bf00734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f7db6a00640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7f7d98071110 0x7f7d98073550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3d3a000640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f3d24070fc0 0x7f3d24073400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3d3a000640 1 -- 172.21.15.144:0/2866520787 --> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d4006fe50 con 0x7f3d24070fc0 2024-09-12T12:13:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.285+0000 7f3d3a000640 1 -- 172.21.15.144:0/2866520787 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d401062c0 con 0x7f3d3c009b00 2024-09-12T12:13:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.289+0000 7f3d46800640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f3d24070fc0 0x7f3d24073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.289+0000 7f3d45400640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d240678c0 0x7f3d24069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3d300af000 tx=0x7f3d30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.289+0000 7f7dab400640 1 -- 172.21.15.144:0/2010784271 <== osd.4 v2:172.21.15.165:6824/2062585005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7d98073c20 con 0x7f7d98071110 2024-09-12T12:13:08.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.289+0000 7f3c0fe00640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f3bf0071090 0x7f3bf00734d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.289+0000 7f3c0ea00640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bf0067910 0x7f3bf0069dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c10131a90 tx=0x7f3bfc006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.289+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 --> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe88804b3b0 con 0x7fe870071090 2024-09-12T12:13:08.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.289+0000 7f3d46800640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f3d24070fc0 0x7f3d24073400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.289+0000 7f3d3a000640 1 -- 172.21.15.144:0/2866520787 <== osd.6 v2:172.21.15.165:6816/608700228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d4006fe50 con 0x7f3d24070fc0 2024-09-12T12:13:08.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.289+0000 7f3c07400640 1 -- 172.21.15.144:0/4155555787 <== osd.7 v2:172.21.15.165:6801/1577381026 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c000c3e80 con 0x7f3bf0071090 2024-09-12T12:13:08.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe886a00640 1 -- 172.21.15.144:0/2554930956 <== osd.1 v2:172.21.15.144:6824/68043553 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe88804b3b0 con 0x7fe870071090 2024-09-12T12:13:08.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fe870071090 msgr2=0x7fe8700734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fe870071090 0x7fe8700734d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe870067910 msgr2=0x7fe870069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe870067910 0x7fe870069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe880009990 tx=0x7fe880009110 comp rx=0 tx=0).stop 2024-09-12T12:13:08.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 msgr2=0x7fe8880355c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 --2- 172.21.15.144:0/2554930956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe888036570 0x7fe8880355c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00e870 tx=0x7fe87c00ec70 comp rx=0 tx=0).stop 2024-09-12T12:13:08.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88f400640 1 -- 172.21.15.144:0/2554930956 reap_dead start 2024-09-12T12:13:08.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 shutdown_connections 2024-09-12T12:13:08.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 >> 172.21.15.144:0/2554930956 conn(0x7fe88801d940 msgr2=0x7fe888051030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 shutdown_connections 2024-09-12T12:13:08.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.293+0000 7fe88fe00640 1 -- 172.21.15.144:0/2554930956 wait complete. 2024-09-12T12:13:08.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 --> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2a740cd5e0 con 0x7f2a540711e0 2024-09-12T12:13:08.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 --> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d94032ff0 con 0x7f9d7c071110 2024-09-12T12:13:08.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a6b400640 1 -- 172.21.15.144:0/4069759483 <== osd.5 v2:172.21.15.165:6800/2887749117 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2a740cd5e0 con 0x7f2a540711e0 2024-09-12T12:13:08.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7f2a540711e0 msgr2=0x7f2a54073620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7f2a540711e0 0x7f2a54073620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f9d92000640 1 -- 172.21.15.144:0/1417760918 <== osd.2 v2:172.21.15.144:6809/1322554046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9d94032ff0 con 0x7f9d7c071110 2024-09-12T12:13:08.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a54067ae0 msgr2=0x7f2a54069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f59eb400640 1 -- 172.21.15.144:0/1299425801 --> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f59f8035f00 con 0x7f59e0071040 2024-09-12T12:13:08.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a54067ae0 0x7f2a54069fa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400aaa0 tx=0x7f2a64008040 comp rx=0 tx=0).stop 2024-09-12T12:13:08.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a74070f00 msgr2=0x7f2a74151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 --2- 172.21.15.144:0/4069759483 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a74070f00 0x7f2a74151190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000f650 tx=0x7f2a6000fb10 comp rx=0 tx=0).stop 2024-09-12T12:13:08.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a73e00640 1 -- 172.21.15.144:0/4069759483 reap_dead start 2024-09-12T12:13:08.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 shutdown_connections 2024-09-12T12:13:08.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 >> 172.21.15.144:0/4069759483 conn(0x7f2a7406d0d0 msgr2=0x7f2a74154ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f59f6000640 1 -- 172.21.15.144:0/1299425801 <== osd.0 v2:172.21.15.144:6808/1854211635 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f59f8035f00 con 0x7f59e0071040 2024-09-12T12:13:08.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.305+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 shutdown_connections 2024-09-12T12:13:08.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f2a7a600640 1 -- 172.21.15.144:0/4069759483 wait complete. 2024-09-12T12:13:08.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 -- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7f59e0071040 msgr2=0x7f59e0073480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7f59e0071040 0x7f59e0073480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7f9d7c071110 msgr2=0x7f9d7c073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7f9d7c071110 0x7f9d7c073550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 -- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59e00678c0 msgr2=0x7f59e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59e00678c0 0x7f59e0069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59f800cfc0 tx=0x7f59f0009060 comp rx=0 tx=0).stop 2024-09-12T12:13:08.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d7c067990 msgr2=0x7f9d7c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9d7c067990 0x7f9d7c069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0af000 tx=0x7f9d8c004740 comp rx=0 tx=0).stop 2024-09-12T12:13:08.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 -- 172.21.15.144:0/1299425801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8051380 msgr2=0x7f59f80d8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 --2- 172.21.15.144:0/1299425801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8051380 0x7f59f80d8670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59ec01ac10 tx=0x7f59ec019300 comp rx=0 tx=0).stop 2024-09-12T12:13:08.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59fe800640 1 -- 172.21.15.144:0/1299425801 reap_dead start 2024-09-12T12:13:08.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d94054f40 msgr2=0x7f9d940f8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 --2- 172.21.15.144:0/1417760918 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d94054f40 0x7f9d940f8fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c000b70 tx=0x7f9d9c069f40 comp rx=0 tx=0).stop 2024-09-12T12:13:08.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9d9a800640 1 -- 172.21.15.144:0/1417760918 reap_dead start 2024-09-12T12:13:08.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 shutdown_connections 2024-09-12T12:13:08.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 >> 172.21.15.144:0/1417760918 conn(0x7f9d9401d940 msgr2=0x7f9d940060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 -- 172.21.15.144:0/1299425801 shutdown_connections 2024-09-12T12:13:08.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 -- 172.21.15.144:0/1299425801 >> 172.21.15.144:0/1299425801 conn(0x7f59f80567c0 msgr2=0x7f59f8053030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 shutdown_connections 2024-09-12T12:13:08.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f9da0c00640 1 -- 172.21.15.144:0/1417760918 wait complete. 2024-09-12T12:13:08.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 -- 172.21.15.144:0/1299425801 shutdown_connections 2024-09-12T12:13:08.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f59eb400640 1 -- 172.21.15.144:0/1299425801 wait complete. 2024-09-12T12:13:08.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.309+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 --> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f73fc14e470 con 0x7f73dc071090 2024-09-12T12:13:08.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73f2000640 1 -- 172.21.15.144:0/1714607226 <== osd.3 v2:172.21.15.144:6800/331901335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f73fc14e470 con 0x7f73dc071090 2024-09-12T12:13:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f73dc071090 msgr2=0x7f73dc0734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f73dc071090 0x7f73dc0734d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc067910 msgr2=0x7f73dc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc067910 0x7f73dc069dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f73f40af000 tx=0x7f73f4004ac0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc15b110 msgr2=0x7f73fc14c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 --2- 172.21.15.144:0/1714607226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc15b110 0x7f73fc14c880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00c820 tx=0x7f73ec00cce0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fa800640 1 -- 172.21.15.144:0/1714607226 reap_dead start 2024-09-12T12:13:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 shutdown_connections 2024-09-12T12:13:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 >> 172.21.15.144:0/1714607226 conn(0x7f73fc06bc10 msgr2=0x7f73fc0b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 shutdown_connections 2024-09-12T12:13:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.313+0000 7f73fb200640 1 -- 172.21.15.144:0/1714607226 wait complete. 2024-09-12T12:13:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.317+0000 7f3d47200640 1 -- 172.21.15.144:0/2866520787 --> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d3c039650 con 0x7f3d24070fc0 2024-09-12T12:13:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.317+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 --> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3be8002de0 con 0x7f3bf0071090 2024-09-12T12:13:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.317+0000 7f7da8c00640 1 -- 172.21.15.144:0/2010784271 --> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7db00eea90 con 0x7f7d98071110 2024-09-12T12:13:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c07400640 1 -- 172.21.15.144:0/4155555787 <== osd.7 v2:172.21.15.165:6801/1577381026 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3be8002de0 con 0x7f3bf0071090 2024-09-12T12:13:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d3a000640 1 -- 172.21.15.144:0/2866520787 <== osd.6 v2:172.21.15.165:6816/608700228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d3c039650 con 0x7f3d24070fc0 2024-09-12T12:13:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f3bf0071090 msgr2=0x7f3bf00734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f3bf0071090 0x7f3bf00734d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f7dab400640 1 -- 172.21.15.144:0/2010784271 <== osd.4 v2:172.21.15.165:6824/2062585005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7db00eea90 con 0x7f7d98071110 2024-09-12T12:13:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bf0067910 msgr2=0x7f3bf0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bf0067910 0x7f3bf0069dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c10131a90 tx=0x7f3bfc006f90 comp rx=0 tx=0).stop 2024-09-12T12:13:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c100cdd40 msgr2=0x7f3c100adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 --2- 172.21.15.144:0/4155555787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c100cdd40 0x7f3c100adff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c0001a070 tx=0x7f3c000191e0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c0fe00640 1 -- 172.21.15.144:0/4155555787 reap_dead start 2024-09-12T12:13:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 shutdown_connections 2024-09-12T12:13:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 >> 172.21.15.144:0/4155555787 conn(0x7f3c1006d0d0 msgr2=0x7f3c10070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 -- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f3d24070fc0 msgr2=0x7f3d24073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f3d24070fc0 0x7f3d24073400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 shutdown_connections 2024-09-12T12:13:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 -- 172.21.15.144:0/2866520787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d240678c0 msgr2=0x7f3d24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d240678c0 0x7f3d24069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3d300af000 tx=0x7f3d30008040 comp rx=0 tx=0).stop 2024-09-12T12:13:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 -- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c009b00 msgr2=0x7f3d3c0dc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 --2- 172.21.15.144:0/2866520787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d3c009b00 0x7f3d3c0dc120 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3d40000b70 tx=0x7f3d40069f40 comp rx=0 tx=0).stop 2024-09-12T12:13:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d46800640 1 -- 172.21.15.144:0/2866520787 reap_dead start 2024-09-12T12:13:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3c16800640 1 -- 172.21.15.144:0/4155555787 wait complete. 2024-09-12T12:13:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 -- 172.21.15.144:0/2866520787 shutdown_connections 2024-09-12T12:13:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 -- 172.21.15.144:0/2866520787 >> 172.21.15.144:0/2866520787 conn(0x7f3d3c0360a0 msgr2=0x7f3d3c034f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 -- 172.21.15.144:0/2866520787 shutdown_connections 2024-09-12T12:13:08.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.321+0000 7f3d2f400640 1 -- 172.21.15.144:0/2866520787 wait complete. 2024-09-12T12:13:08.377 INFO:teuthology.orchestra.run.smithi144.stdout:55834574858 2024-09-12T12:13:08.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T12:13:08.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.325+0000 7f7da8c00640 1 -- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7f7d98071110 msgr2=0x7f7d98073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.325+0000 7f7da8c00640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7f7d98071110 0x7f7d98073550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.329+0000 7f7da8c00640 1 -- 172.21.15.144:0/2010784271 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7d98067990 msgr2=0x7f7d98069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.329+0000 7f7da8c00640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7d98067990 0x7f7d98069e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0ad000 tx=0x7f7dac0a6000 comp rx=0 tx=0).stop 2024-09-12T12:13:08.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.329+0000 7f7da8c00640 1 -- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 msgr2=0x7f7db0048e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.329+0000 7f7da8c00640 1 --2- 172.21.15.144:0/2010784271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7db004eb70 0x7f7db0048e50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7da400c440 tx=0x7f7da400c900 comp rx=0 tx=0).stop 2024-09-12T12:13:08.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.329+0000 7f7db7e00640 1 -- 172.21.15.144:0/2010784271 reap_dead start 2024-09-12T12:13:08.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.329+0000 7f7da8c00640 1 -- 172.21.15.144:0/2010784271 shutdown_connections 2024-09-12T12:13:08.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.329+0000 7f7da8c00640 1 -- 172.21.15.144:0/2010784271 >> 172.21.15.144:0/2010784271 conn(0x7f7db00360a0 msgr2=0x7f7db004f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.329+0000 7f7da8c00640 1 -- 172.21.15.144:0/2010784271 shutdown_connections 2024-09-12T12:13:08.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.329+0000 7f7da8c00640 1 -- 172.21.15.144:0/2010784271 wait complete. 2024-09-12T12:13:08.380 INFO:teuthology.orchestra.run.smithi144.stdout:55834574859 2024-09-12T12:13:08.381 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T12:13:08.381 INFO:teuthology.orchestra.run.smithi144.stdout:55834574857 2024-09-12T12:13:08.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T12:13:08.383 INFO:teuthology.orchestra.run.smithi144.stdout:55834574856 2024-09-12T12:13:08.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T12:13:08.384 INFO:teuthology.orchestra.run.smithi144.stdout:55834574859 2024-09-12T12:13:08.384 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T12:13:08.385 INFO:teuthology.orchestra.run.smithi144.stdout:55834574858 2024-09-12T12:13:08.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T12:13:08.386 INFO:teuthology.orchestra.run.smithi144.stdout:55834574857 2024-09-12T12:13:08.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T12:13:08.387 INFO:teuthology.orchestra.run.smithi144.stdout:55834574857 2024-09-12T12:13:08.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T12:13:08.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.617+0000 7f31d9600640 1 Processor -- start 2024-09-12T12:13:08.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.617+0000 7f31d9600640 1 -- start start 2024-09-12T12:13:08.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d9600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31d4073220 0x7f31d40cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d9600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d40cfa60 con 0x7f31d4073600 2024-09-12T12:13:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d9600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d40cfd40 con 0x7f31d40d0820 2024-09-12T12:13:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d9600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f31d40cf830 con 0x7f31d4073220 2024-09-12T12:13:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31d4073220 0x7f31d40cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d2000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f31d40d0820 0x7f31d415adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:54822/0 (socket says 172.21.15.144:54822) 2024-09-12T12:13:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d2000640 1 -- 172.21.15.144:0/746027869 learned_addr learned my addr 172.21.15.144:0/746027869 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:08.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d2a00640 1 -- 172.21.15.144:0/746027869 >> v1:172.21.15.165:6789/0 conn(0x7f31d40d0820 legacy=0x7f31d415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d2a00640 1 -- 172.21.15.144:0/746027869 >> v1:172.21.15.144:6789/0 conn(0x7f31d4073600 legacy=0x7f31d41543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.621+0000 7f31d2a00640 1 -- 172.21.15.144:0/746027869 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d40d0020 con 0x7f31d4073220 2024-09-12T12:13:08.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.629+0000 7f31d2a00640 1 --2- 172.21.15.144:0/746027869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31d4073220 0x7f31d40cd6c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009d90 tx=0x7f31cc01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778ab39f88044d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.629+0000 7f31d1600640 1 -- 172.21.15.144:0/746027869 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0b4070 con 0x7f31d4073220 2024-09-12T12:13:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.629+0000 7f31d1600640 1 -- 172.21.15.144:0/746027869 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc0a7b80 con 0x7f31d4073220 2024-09-12T12:13:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.629+0000 7f31d1600640 1 -- 172.21.15.144:0/746027869 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0af440 con 0x7f31d4073220 2024-09-12T12:13:08.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.633+0000 7f31d9600640 1 -- 172.21.15.144:0/746027869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31d4073220 msgr2=0x7f31d40cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.633+0000 7f31d9600640 1 --2- 172.21.15.144:0/746027869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31d4073220 0x7f31d40cd6c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009d90 tx=0x7f31cc01eba0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.633+0000 7f31d9600640 1 -- 172.21.15.144:0/746027869 shutdown_connections 2024-09-12T12:13:08.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.633+0000 7f31d9600640 1 --2- 172.21.15.144:0/746027869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31d4073220 0x7f31d40cd6c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.633+0000 7f31d9600640 1 -- 172.21.15.144:0/746027869 >> 172.21.15.144:0/746027869 conn(0x7f31d4068000 msgr2=0x7f31d406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.633+0000 7f31d9600640 1 -- 172.21.15.144:0/746027869 shutdown_connections 2024-09-12T12:13:08.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.633+0000 7f31d9600640 1 -- 172.21.15.144:0/746027869 wait complete. 2024-09-12T12:13:08.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f31d9600640 1 Processor -- start 2024-09-12T12:13:08.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.633+0000 7f058aa00640 1 Processor -- start 2024-09-12T12:13:08.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f5c43400640 1 Processor -- start 2024-09-12T12:13:08.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f31d9600640 1 -- start start 2024-09-12T12:13:08.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.633+0000 7f058aa00640 1 -- start start 2024-09-12T12:13:08.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f058aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f058415a950 0x7f058415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f058aa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058415b410 con 0x7f05840b3cf0 2024-09-12T12:13:08.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f058aa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058415b6f0 con 0x7f05840cd540 2024-09-12T12:13:08.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f058aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05840b34f0 con 0x7f058415a950 2024-09-12T12:13:08.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f0588c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f058415a950 0x7f058415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f0588c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f058415a950 0x7f058415adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34144/0 (socket says 172.21.15.144:34144) 2024-09-12T12:13:08.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f0588c00640 1 -- 172.21.15.144:0/495754277 learned_addr learned my addr 172.21.15.144:0/495754277 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f5c43400640 1 -- start start 2024-09-12T12:13:08.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f0588c00640 1 -- 172.21.15.144:0/495754277 >> v1:172.21.15.165:6789/0 conn(0x7f05840cd540 legacy=0x7f05840cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f0588c00640 1 -- 172.21.15.144:0/495754277 >> v1:172.21.15.144:6789/0 conn(0x7f05840b3cf0 legacy=0x7f05840b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f31d9600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31d4073220 0x7f31d41596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f31d9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31d4073600 0x7f31d4152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f5c43400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5c340e2990 0x7f5c34053e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f5c43400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5c34006dd0 0x7f5c340071e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f5c43400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c34058870 con 0x7f5c34057780 2024-09-12T12:13:08.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f5c43400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5c34007720 con 0x7f5c340e2990 2024-09-12T12:13:08.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f5c43400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5c34057fd0 con 0x7f5c34006dd0 2024-09-12T12:13:08.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f31d2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31d4073600 0x7f31d4152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f31d2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31d4073220 0x7f31d41596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f31d2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31d4073220 0x7f31d41596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34160/0 (socket says 172.21.15.144:34160) 2024-09-12T12:13:08.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d2a00640 1 -- 172.21.15.144:0/3219829304 learned_addr learned my addr 172.21.15.144:0/3219829304 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d9600640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31d40d0820 0x7f31d4152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f5c3be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5c34057780 0x7f5c3403c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37296/0 (socket says 172.21.15.144:37296) 2024-09-12T12:13:08.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f5c3be00640 1 -- 172.21.15.144:0/301833937 learned_addr learned my addr 172.21.15.144:0/301833937 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:08.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f31d4154e60 con 0x7f31d4073600 2024-09-12T12:13:08.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f31d4154ce0 con 0x7f31d40d0820 2024-09-12T12:13:08.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f31d4154fe0 con 0x7f31d4073220 2024-09-12T12:13:08.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d3400640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31d40d0820 0x7f31d4152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.637+0000 7f0588c00640 1 -- 172.21.15.144:0/495754277 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05840af8c0 con 0x7f058415a950 2024-09-12T12:13:08.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d2a00640 1 -- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31d40d0820 msgr2=0x7f31d4152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d2a00640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31d40d0820 0x7f31d4152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d2a00640 1 -- 172.21.15.144:0/3219829304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31d4073600 msgr2=0x7f31d4152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d2a00640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31d4073600 0x7f31d4152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d2a00640 1 -- 172.21.15.144:0/3219829304 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d4205340 con 0x7f31d4073220 2024-09-12T12:13:08.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f5c41400640 1 --2- 172.21.15.144:0/301833937 >> v2:172.21.15.165:3300/0 conn(0x7f5c34006dd0 0x7f5c340071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d3400640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31d40d0820 0x7f31d4152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:08.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d2a00640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31d4073220 0x7f31d41596b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31cc01c7d0 tx=0x7f31cc01b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31caa00640 1 -- 172.21.15.144:0/3219829304 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0bf070 con 0x7f31d4073220 2024-09-12T12:13:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d4205900 con 0x7f31d4073220 2024-09-12T12:13:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d4205ec0 con 0x7f31d4073220 2024-09-12T12:13:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31caa00640 1 -- 172.21.15.144:0/3219829304 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc0a7b80 con 0x7f31d4073220 2024-09-12T12:13:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f31caa00640 1 -- 172.21.15.144:0/3219829304 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0bf070 con 0x7f31d4073220 2024-09-12T12:13:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f5c40a00640 1 --2- 172.21.15.144:0/301833937 >> v2:172.21.15.144:3300/0 conn(0x7f5c340e2990 0x7f5c34053e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.645+0000 7f31caa00640 1 -- 172.21.15.144:0/3219829304 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31cc0af640 con 0x7f31d4073220 2024-09-12T12:13:08.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f5c41400640 1 -- 172.21.15.144:0/301833937 >> v2:172.21.15.144:3300/0 conn(0x7f5c340e2990 msgr2=0x7f5c34053e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f5c41400640 1 --2- 172.21.15.144:0/301833937 >> v2:172.21.15.144:3300/0 conn(0x7f5c340e2990 0x7f5c34053e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f5c41400640 1 -- 172.21.15.144:0/301833937 >> v1:172.21.15.144:6789/0 conn(0x7f5c34057780 legacy=0x7f5c3403c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f5c41400640 1 -- 172.21.15.144:0/301833937 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c340582b0 con 0x7f5c34006dd0 2024-09-12T12:13:08.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.641+0000 7f5c40a00640 1 --2- 172.21.15.144:0/301833937 >> v2:172.21.15.144:3300/0 conn(0x7f5c340e2990 0x7f5c34053e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:08.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.645+0000 7f1d66e00640 1 Processor -- start 2024-09-12T12:13:08.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.645+0000 7f1d66e00640 1 -- start start 2024-09-12T12:13:08.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.645+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d42056f0 con 0x7f31d4073220 2024-09-12T12:13:08.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.645+0000 7f0588c00640 1 --2- 172.21.15.144:0/495754277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f058415a950 0x7f058415adb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f057c009c00 tx=0x7f057c01df20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6dce02ca292ff3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.645+0000 7f31caa00640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b4067cc0 0x7f31b406a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.645+0000 7f31caa00640 1 -- 172.21.15.144:0/3219829304 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f31cc0af440 con 0x7f31d4073220 2024-09-12T12:13:08.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.645+0000 7f1d66e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1d580e2d20 0x7f1d58056610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d66e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d580e66a0 0x7f1d580e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f31d2000640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b4067cc0 0x7f31b406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1d580e2d20 0x7f1d58056610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1d580e2d20 0x7f1d58056610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44016/0 (socket says 172.21.15.144:44016) 2024-09-12T12:13:08.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d580e66a0 0x7f1d580e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d580e66a0 0x7f1d580e6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50876/0 (socket says 172.21.15.144:50876) 2024-09-12T12:13:08.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65a00640 1 -- 172.21.15.144:0/1590849726 learned_addr learned my addr 172.21.15.144:0/1590849726 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c41400640 1 --2- 172.21.15.144:0/301833937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 0x7f5c340071e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c06b8d0 tx=0x7f5c3c0986e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc9fc171c62f1638 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d66e00640 1 --2- 172.21.15.144:0/1590849726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 0x7f1d58053090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d66e00640 1 -- 172.21.15.144:0/1590849726 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1d58057830 con 0x7f1d580e66a0 2024-09-12T12:13:08.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d66e00640 1 -- 172.21.15.144:0/1590849726 --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1d580e74b0 con 0x7f1d580e2d20 2024-09-12T12:13:08.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d66e00640 1 -- 172.21.15.144:0/1590849726 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1d58057ab0 con 0x7f1d580e7020 2024-09-12T12:13:08.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d66400640 1 --2- 172.21.15.144:0/1590849726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 0x7f1d58053090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f31d2000640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b4067cc0 0x7f31b406a180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f31d4166190 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c3b400640 1 -- 172.21.15.144:0/301833937 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c129640 con 0x7f5c34006dd0 2024-09-12T12:13:08.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c3b400640 1 -- 172.21.15.144:0/301833937 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c129820 con 0x7f5c34006dd0 2024-09-12T12:13:08.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c3b400640 1 -- 172.21.15.144:0/301833937 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c129c90 con 0x7f5c34006dd0 2024-09-12T12:13:08.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65a00640 1 -- 172.21.15.144:0/1590849726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 msgr2=0x7f1d58053090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65a00640 1 --2- 172.21.15.144:0/1590849726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 0x7f1d58053090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65a00640 1 -- 172.21.15.144:0/1590849726 >> v2:172.21.15.144:3300/0 conn(0x7f1d580e66a0 msgr2=0x7f1d580e6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65a00640 1 --2- 172.21.15.144:0/1590849726 >> v2:172.21.15.144:3300/0 conn(0x7f1d580e66a0 0x7f1d580e6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65a00640 1 -- 172.21.15.144:0/1590849726 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d58057d90 con 0x7f1d580e2d20 2024-09-12T12:13:08.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f1d65000640 1 --2- 172.21.15.144:0/1590849726 >> v2:172.21.15.144:3300/0 conn(0x7f1d580e66a0 0x7f1d580e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:08.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c43400640 1 -- 172.21.15.144:0/301833937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 msgr2=0x7f5c340071e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c43400640 1 --2- 172.21.15.144:0/301833937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 0x7f5c340071e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c06b8d0 tx=0x7f5c3c0986e0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c43400640 1 -- 172.21.15.144:0/301833937 shutdown_connections 2024-09-12T12:13:08.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c43400640 1 --2- 172.21.15.144:0/301833937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 0x7f5c340071e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c43400640 1 --2- 172.21.15.144:0/301833937 >> v2:172.21.15.144:3300/0 conn(0x7f5c340e2990 0x7f5c34053e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c43400640 1 -- 172.21.15.144:0/301833937 >> 172.21.15.144:0/301833937 conn(0x7f5c3403a530 msgr2=0x7f5c3403a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c43400640 1 -- 172.21.15.144:0/301833937 shutdown_connections 2024-09-12T12:13:08.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.649+0000 7f5c43400640 1 -- 172.21.15.144:0/301833937 wait complete. 2024-09-12T12:13:08.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c43400640 1 Processor -- start 2024-09-12T12:13:08.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c43400640 1 -- start start 2024-09-12T12:13:08.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c43400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 0x7f5c3404e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c43400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c34057780 0x7f5c340e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f31caa00640 1 -- 172.21.15.144:0/3219829304 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f31cc018790 con 0x7f31d4073220 2024-09-12T12:13:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c43400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c340e2990 0x7f5c340e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c43400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5c34057d10 con 0x7f5c340e2990 2024-09-12T12:13:08.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c43400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5c34057b90 con 0x7f5c34006dd0 2024-09-12T12:13:08.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c43400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3403d1c0 con 0x7f5c34057780 2024-09-12T12:13:08.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c40a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 0x7f5c3404e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c40a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 0x7f5c3404e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44026/0 (socket says 172.21.15.144:44026) 2024-09-12T12:13:08.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c40a00640 1 -- 172.21.15.144:0/3040477067 learned_addr learned my addr 172.21.15.144:0/3040477067 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c3be00640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c34057780 0x7f5c340e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f0583e00640 1 -- 172.21.15.144:0/495754277 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0a6c30 con 0x7f058415a950 2024-09-12T12:13:08.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f0583e00640 1 -- 172.21.15.144:0/495754277 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c0a6dd0 con 0x7f058415a950 2024-09-12T12:13:08.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f0583e00640 1 -- 172.21.15.144:0/495754277 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0ae610 con 0x7f058415a950 2024-09-12T12:13:08.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c41400640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c340e2990 0x7f5c340e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c40a00640 1 -- 172.21.15.144:0/3040477067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c34057780 msgr2=0x7f5c340e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c40a00640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c34057780 0x7f5c340e5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c40a00640 1 -- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c340e2990 msgr2=0x7f5c340e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c40a00640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c340e2990 0x7f5c340e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c40a00640 1 -- 172.21.15.144:0/3040477067 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3417c670 con 0x7f5c34006dd0 2024-09-12T12:13:08.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f058aa00640 1 -- 172.21.15.144:0/495754277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f058415a950 msgr2=0x7f058415adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f058aa00640 1 --2- 172.21.15.144:0/495754277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f058415a950 0x7f058415adb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f057c009c00 tx=0x7f057c01df20 comp rx=0 tx=0).stop 2024-09-12T12:13:08.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f058aa00640 1 -- 172.21.15.144:0/495754277 shutdown_connections 2024-09-12T12:13:08.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f058aa00640 1 --2- 172.21.15.144:0/495754277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f058415a950 0x7f058415adb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f058aa00640 1 -- 172.21.15.144:0/495754277 >> 172.21.15.144:0/495754277 conn(0x7f058406bc10 msgr2=0x7f058406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f058aa00640 1 -- 172.21.15.144:0/495754277 shutdown_connections 2024-09-12T12:13:08.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f058aa00640 1 -- 172.21.15.144:0/495754277 wait complete. 2024-09-12T12:13:08.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c40a00640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 0x7f5c3404e520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5c30013de0 tx=0x7f5c30009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.653+0000 7f5c38c00640 1 -- 172.21.15.144:0/3040477067 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c30022070 con 0x7f5c34006dd0 2024-09-12T12:13:08.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f5c38c00640 1 -- 172.21.15.144:0/3040477067 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300128e0 con 0x7f5c34006dd0 2024-09-12T12:13:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f5c38c00640 1 -- 172.21.15.144:0/3040477067 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c30012cd0 con 0x7f5c34006dd0 2024-09-12T12:13:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3404da40 con 0x7f5c34006dd0 2024-09-12T12:13:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3417c950 con 0x7f5c34006dd0 2024-09-12T12:13:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f058aa00640 1 Processor -- start 2024-09-12T12:13:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d65a00640 1 --2- 172.21.15.144:0/1590849726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 0x7f1d58056610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d5804fac0 tx=0x7f1d5401c1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a1c8cdf88597051 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d5fe00640 1 -- 172.21.15.144:0/1590849726 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d540b0070 con 0x7f1d580e2d20 2024-09-12T12:13:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d5fe00640 1 -- 172.21.15.144:0/1590849726 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d540ab600 con 0x7f1d580e2d20 2024-09-12T12:13:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d5fe00640 1 -- 172.21.15.144:0/1590849726 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d540ab9d0 con 0x7f1d580e2d20 2024-09-12T12:13:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d66e00640 1 -- 172.21.15.144:0/1590849726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 msgr2=0x7f1d58056610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d66e00640 1 --2- 172.21.15.144:0/1590849726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 0x7f1d58056610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d5804fac0 tx=0x7f1d5401c1a0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d66e00640 1 -- 172.21.15.144:0/1590849726 shutdown_connections 2024-09-12T12:13:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d66e00640 1 --2- 172.21.15.144:0/1590849726 >> v2:172.21.15.144:3300/0 conn(0x7f1d580e66a0 0x7f1d580e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d66e00640 1 --2- 172.21.15.144:0/1590849726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 0x7f1d58053090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d66e00640 1 --2- 172.21.15.144:0/1590849726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 0x7f1d58056610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f1d66e00640 1 -- 172.21.15.144:0/1590849726 >> 172.21.15.144:0/1590849726 conn(0x7f1d5803a530 msgr2=0x7f1d5803a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f058aa00640 1 -- start start 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f058aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05840b3cf0 0x7f0584146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.657+0000 7f058aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05840cd540 0x7f0584155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f058aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f058415a950 0x7f0584155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f058aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0584168330 con 0x7f05840b3cf0 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f058aa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05841681b0 con 0x7f058415a950 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f058aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05841684b0 con 0x7f05840cd540 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0588c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05840cd540 0x7f0584155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0588c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05840cd540 0x7f0584155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34208/0 (socket says 172.21.15.144:34208) 2024-09-12T12:13:08.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0588c00640 1 -- 172.21.15.144:0/4156099807 learned_addr learned my addr 172.21.15.144:0/4156099807 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f1d66e00640 1 -- 172.21.15.144:0/1590849726 shutdown_connections 2024-09-12T12:13:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f1d66e00640 1 -- 172.21.15.144:0/1590849726 wait complete. 2024-09-12T12:13:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f058a000640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f058415a950 0x7f0584155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0588c00640 1 -- 172.21.15.144:0/4156099807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f058415a950 msgr2=0x7f0584155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0588c00640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f058415a950 0x7f0584155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0588c00640 1 -- 172.21.15.144:0/4156099807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05840b3cf0 msgr2=0x7f0584146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0588c00640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05840b3cf0 0x7f0584146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0588c00640 1 -- 172.21.15.144:0/4156099807 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058414b450 con 0x7f05840cd540 2024-09-12T12:13:08.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c34007aa0 con 0x7f5c34006dd0 2024-09-12T12:13:08.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0588c00640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05840cd540 0x7f0584155750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f057c0b0040 tx=0x7f057c01acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f5c38c00640 1 -- 172.21.15.144:0/3040477067 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c30025070 con 0x7f5c34006dd0 2024-09-12T12:13:08.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0581600640 1 -- 172.21.15.144:0/4156099807 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0a6c30 con 0x7f05840cd540 2024-09-12T12:13:08.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0581600640 1 -- 172.21.15.144:0/4156099807 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c0bd070 con 0x7f05840cd540 2024-09-12T12:13:08.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f0581600640 1 -- 172.21.15.144:0/4156099807 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0b78a0 con 0x7f05840cd540 2024-09-12T12:13:08.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f058aa00640 1 -- 172.21.15.144:0/4156099807 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058414b730 con 0x7f05840cd540 2024-09-12T12:13:08.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f5c38c00640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c1c067990 0x7f5c1c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f5c38c00640 1 -- 172.21.15.144:0/3040477067 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5c3008ddb0 con 0x7f5c34006dd0 2024-09-12T12:13:08.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f1d66e00640 1 Processor -- start 2024-09-12T12:13:08.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f5c3be00640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c1c067990 0x7f5c1c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f058aa00640 1 -- 172.21.15.144:0/4156099807 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f058414bcf0 con 0x7f05840cd540 2024-09-12T12:13:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.661+0000 7f1d66e00640 1 -- start start 2024-09-12T12:13:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f0576a00640 1 -- 172.21.15.144:0/4156099807 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058415adb0 con 0x7f05840cd540 2024-09-12T12:13:08.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f5c3be00640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c1c067990 0x7f5c1c069e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c340e3280 tx=0x7f5c28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 0x7f1d580dbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d580e66a0 0x7f1d5804fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d65a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 0x7f1d580dbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d65000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d580e66a0 0x7f1d5804fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d65000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d580e66a0 0x7f1d5804fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50922/0 (socket says 172.21.15.144:50922) 2024-09-12T12:13:08.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d65a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 0x7f1d580dbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44040/0 (socket says 172.21.15.144:44040) 2024-09-12T12:13:08.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f0581600640 1 -- 172.21.15.144:0/4156099807 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f057c0b7a40 con 0x7f05840cd540 2024-09-12T12:13:08.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 0x7f1d580d9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1d58006770 con 0x7f1d580e66a0 2024-09-12T12:13:08.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1d580065f0 con 0x7f1d580e2d20 2024-09-12T12:13:08.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1d580068f0 con 0x7f1d580e7020 2024-09-12T12:13:08.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d65000640 1 -- 172.21.15.144:0/3197330587 learned_addr learned my addr 172.21.15.144:0/3197330587 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f0581600640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0564067990 0x7f0564069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66400640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 0x7f1d580d9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66400640 1 -- 172.21.15.144:0/3197330587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 msgr2=0x7f1d580dbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66400640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 0x7f1d580dbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66400640 1 -- 172.21.15.144:0/3197330587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d580e66a0 msgr2=0x7f1d5804fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66400640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d580e66a0 0x7f1d5804fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66400640 1 -- 172.21.15.144:0/3197330587 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d58050210 con 0x7f1d580e7020 2024-09-12T12:13:08.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f0581600640 1 -- 172.21.15.144:0/4156099807 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f057c1221b0 con 0x7f05840cd540 2024-09-12T12:13:08.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f0589600640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0564067990 0x7f0564069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.665+0000 7f1d66400640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 0x7f1d580d9de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d6006ac00 tx=0x7f1d60069f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7f0589600640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0564067990 0x7f0564069e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0570000f70 tx=0x7f05700079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7f5c38c00640 1 -- 172.21.15.144:0/3040477067 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5c3005df40 con 0x7f5c34006dd0 2024-09-12T12:13:08.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7f1d5d600640 1 -- 172.21.15.144:0/3197330587 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6009a070 con 0x7f1d580e7020 2024-09-12T12:13:08.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7f1d5d600640 1 -- 172.21.15.144:0/3197330587 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d600749f0 con 0x7f1d580e7020 2024-09-12T12:13:08.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7f1d5d600640 1 -- 172.21.15.144:0/3197330587 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60074de0 con 0x7f1d580e7020 2024-09-12T12:13:08.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d580dc1b0 con 0x7f1d580e7020 2024-09-12T12:13:08.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d580dc770 con 0x7f1d580e7020 2024-09-12T12:13:08.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7fe10ee00640 1 Processor -- start 2024-09-12T12:13:08.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7fd533000640 1 Processor -- start 2024-09-12T12:13:08.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7f0581600640 1 -- 172.21.15.144:0/4156099807 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f057c017b10 con 0x7f05840cd540 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.669+0000 7fe10ee00640 1 -- start start 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe10ee00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe1080b2af0 0x7fe1080cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe10ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe10806e590 0x7fe10806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe10ee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe10806d260 0x7fe108140d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe10ee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe10806d6b0 con 0x7fe10806d260 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe10ee00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe10815bcc0 con 0x7fe1080b2af0 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe10ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe10815bfa0 con 0x7fe10806e590 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe107e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe1080b2af0 0x7fe1080cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe107e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe1080b2af0 0x7fe1080cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44048/0 (socket says 172.21.15.144:44048) 2024-09-12T12:13:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe107e00640 1 -- 172.21.15.144:0/4089877473 learned_addr learned my addr 172.21.15.144:0/4089877473 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fd533000640 1 -- start start 2024-09-12T12:13:08.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fd533000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd52c162b20 0x7fd52c0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fd533000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd52c0ccd20 con 0x7fd52c0d0050 2024-09-12T12:13:08.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fd533000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd52c0cd000 con 0x7fd52c162f00 2024-09-12T12:13:08.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fd533000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd52c0cd2e0 con 0x7fd52c162b20 2024-09-12T12:13:08.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fd531000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd52c0d0050 0x7fd52c06d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37304/0 (socket says 172.21.15.144:37304) 2024-09-12T12:13:08.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fd531000640 1 -- 172.21.15.144:0/1734786610 learned_addr learned my addr 172.21.15.144:0/1734786610 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:08.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d580e6ae0 con 0x7f1d580e7020 2024-09-12T12:13:08.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7f1d5d600640 1 -- 172.21.15.144:0/3197330587 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d6009d070 con 0x7f1d580e7020 2024-09-12T12:13:08.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7f1d5d600640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d40067910 0x7f1d40069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7f1d5d600640 1 -- 172.21.15.144:0/3197330587 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1d600cf760 con 0x7f1d580e7020 2024-09-12T12:13:08.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7f1d65a00640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d40067910 0x7f1d40069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f06f9c00640 1 Processor -- start 2024-09-12T12:13:08.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7fd52be00640 1 --2- 172.21.15.144:0/1734786610 >> v2:172.21.15.165:3300/0 conn(0x7fd52c162b20 0x7fd52c0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f1d65a00640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d40067910 0x7f1d40069dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d540ad000 tx=0x7f1d540a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7fd52aa00640 1 -- 172.21.15.144:0/1734786610 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772023608 0 0) 0x7fd52c0ccd20 con 0x7fd52c0d0050 2024-09-12T12:13:08.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7fd52aa00640 1 -- 172.21.15.144:0/1734786610 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd510003530 con 0x7fd52c0d0050 2024-09-12T12:13:08.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f06f9c00640 1 -- start start 2024-09-12T12:13:08.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7fd52aa00640 1 -- 172.21.15.144:0/1734786610 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825817142 0 0) 0x7fd52c0cd000 con 0x7fd52c162f00 2024-09-12T12:13:08.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7fd52aa00640 1 -- 172.21.15.144:0/1734786610 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd52c0ccd20 con 0x7fd52c162f00 2024-09-12T12:13:08.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7fd52be00640 1 -- 172.21.15.144:0/1734786610 >> v1:172.21.15.165:6789/0 conn(0x7fd52c162f00 legacy=0x7fd52c0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7fd52be00640 1 -- 172.21.15.144:0/1734786610 >> v1:172.21.15.144:6789/0 conn(0x7fd52c0d0050 legacy=0x7fd52c06d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7fd52be00640 1 -- 172.21.15.144:0/1734786610 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52c0cd5c0 con 0x7fd52c162b20 2024-09-12T12:13:08.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7fd52aa00640 1 -- 172.21.15.144:0/1734786610 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1458775468 0 0) 0x7fd510003530 con 0x7fd52c0d0050 2024-09-12T12:13:08.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe107e00640 1 -- 172.21.15.144:0/4089877473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe10806e590 msgr2=0x7fe10806cd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:13:08.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe107e00640 1 --2- 172.21.15.144:0/4089877473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe10806e590 0x7fe10806cd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe107e00640 1 -- 172.21.15.144:0/4089877473 >> v2:172.21.15.144:3300/0 conn(0x7fe10806d260 msgr2=0x7fe108140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe107e00640 1 --2- 172.21.15.144:0/4089877473 >> v2:172.21.15.144:3300/0 conn(0x7fe10806d260 0x7fe108140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.673+0000 7fe107e00640 1 -- 172.21.15.144:0/4089877473 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10815c280 con 0x7fe1080b2af0 2024-09-12T12:13:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7ff1e6e00640 1 Processor -- start 2024-09-12T12:13:08.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f06f9c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06f4071860 0x7f06f40b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f06f9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06f4071ca0 0x7f06f40721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f06f9c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f40b28c0 con 0x7f06f406e810 2024-09-12T12:13:08.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f06f9c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f06f415bd40 con 0x7f06f4071ca0 2024-09-12T12:13:08.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f06f9c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f06f415f250 con 0x7f06f4071860 2024-09-12T12:13:08.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f06f2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f06f406e810 0x7f06f406ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37318/0 (socket says 172.21.15.144:37318) 2024-09-12T12:13:08.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7f06f2a00640 1 -- 172.21.15.144:0/2420463093 learned_addr learned my addr 172.21.15.144:0/2420463093 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:08.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159976603 0 0) 0x7f06e4001120 con 0x7f06f406e810 2024-09-12T12:13:08.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06d8003530 con 0x7f06f406e810 2024-09-12T12:13:08.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f1d5d600640 1 -- 172.21.15.144:0/3197330587 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d58050210 con 0x7f1d580e7020 2024-09-12T12:13:08.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f3400640 1 --2- 172.21.15.144:0/2420463093 >> v2:172.21.15.144:3300/0 conn(0x7f06f4071ca0 0x7f06f40721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2307329205 0 0) 0x7f06d8003530 con 0x7f06f406e810 2024-09-12T12:13:08.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06f4071860 msgr2=0x7f06f40b0bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:13:08.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06f4071860 0x7f06f40b0bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 >> v2:172.21.15.144:3300/0 conn(0x7f06f4071ca0 msgr2=0x7f06f40721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 --2- 172.21.15.144:0/2420463093 >> v2:172.21.15.144:3300/0 conn(0x7f06f4071ca0 0x7f06f40721d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f40710a0 con 0x7f06f406e810 2024-09-12T12:13:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f06e4001850 con 0x7f06f406e810 2024-09-12T12:13:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 >> v1:172.21.15.144:6789/0 conn(0x7f06f406e810 legacy=0x7f06f406ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d80039c0 0x7f06d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d8004810 0x7f06d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d80052f0 0x7f06d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f06f415bd40 con 0x7f06d80039c0 2024-09-12T12:13:08.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f06f415f250 con 0x7f06d8004810 2024-09-12T12:13:08.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f06d800c1d0 con 0x7f06d80052f0 2024-09-12T12:13:08.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f3400640 1 --2- 172.21.15.144:0/2420463093 >> v2:172.21.15.144:3300/0 conn(0x7f06f4071ca0 0x7f06f40721d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:08.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.677+0000 7ff1e6e00640 1 -- start start 2024-09-12T12:13:08.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7ff1e6e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff1e00b4200 0x7ff1e00b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7ff1dfe00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7ff1e015c220 0x7ff1e00d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:54842/0 (socket says 172.21.15.144:54842) 2024-09-12T12:13:08.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f3400640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d80052f0 0x7f06d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f2a00640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d80039c0 0x7f06d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7fd52be00640 1 --2- 172.21.15.144:0/1734786610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 0x7fd52c0cc160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0097c0 tx=0x7fd51c01ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ae14f0cd096470c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7ff1dfe00640 1 -- 172.21.15.144:0/394249618 learned_addr learned my addr 172.21.15.144:0/394249618 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:08.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7fd52aa00640 1 -- 172.21.15.144:0/1734786610 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0b5070 con 0x7fd52c162b20 2024-09-12T12:13:08.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7fe107e00640 1 --2- 172.21.15.144:0/4089877473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1080b2af0 0x7fe1080cfa70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1080b42d0 tx=0x7fe0f801ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e0acd739643db21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f2a00640 1 -- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d80052f0 msgr2=0x7f06d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f2a00640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d80052f0 0x7f06d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f2a00640 1 -- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d8004810 msgr2=0x7f06d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7fd52aa00640 1 -- 172.21.15.144:0/1734786610 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51c0a8630 con 0x7fd52c162b20 2024-09-12T12:13:08.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7fd52aa00640 1 -- 172.21.15.144:0/1734786610 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524001a00 con 0x7fd52c162b20 2024-09-12T12:13:08.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/394249618 >> v2:172.21.15.165:3300/0 conn(0x7ff1e00b5720 0x7ff1e00b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7ff1df400640 1 --2- 172.21.15.144:0/394249618 >> v2:172.21.15.144:3300/0 conn(0x7ff1e00b4200 0x7ff1e00b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7ff1e4e00640 1 --2- 172.21.15.144:0/394249618 >> v2:172.21.15.165:3300/0 conn(0x7ff1e00b5720 0x7ff1e00b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f2000640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d8004810 0x7f06d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f2a00640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d8004810 0x7f06d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7f06f2a00640 1 -- 172.21.15.144:0/2420463093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d8003530 con 0x7f06d80039c0 2024-09-12T12:13:08.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7f06f2000640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d8004810 0x7f06d8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:08.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.681+0000 7fe106a00640 1 -- 172.21.15.144:0/4089877473 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80b4070 con 0x7fe1080b2af0 2024-09-12T12:13:08.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe106a00640 1 -- 172.21.15.144:0/4089877473 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80a7bb0 con 0x7fe1080b2af0 2024-09-12T12:13:08.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe106a00640 1 -- 172.21.15.144:0/4089877473 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80af440 con 0x7fe1080b2af0 2024-09-12T12:13:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fd533000640 1 -- 172.21.15.144:0/1734786610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 msgr2=0x7fd52c0cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fd533000640 1 --2- 172.21.15.144:0/1734786610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 0x7fd52c0cc160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0097c0 tx=0x7fd51c01ebb0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fd533000640 1 -- 172.21.15.144:0/1734786610 shutdown_connections 2024-09-12T12:13:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fd533000640 1 --2- 172.21.15.144:0/1734786610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 0x7fd52c0cc160 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fd533000640 1 -- 172.21.15.144:0/1734786610 >> 172.21.15.144:0/1734786610 conn(0x7fd52c0b23c0 msgr2=0x7fd52c0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fd533000640 1 -- 172.21.15.144:0/1734786610 shutdown_connections 2024-09-12T12:13:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fd533000640 1 -- 172.21.15.144:0/1734786610 wait complete. 2024-09-12T12:13:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe10ee00640 1 -- 172.21.15.144:0/4089877473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1080b2af0 msgr2=0x7fe1080cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe10ee00640 1 --2- 172.21.15.144:0/4089877473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1080b2af0 0x7fe1080cfa70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1080b42d0 tx=0x7fe0f801ec10 comp rx=0 tx=0).stop 2024-09-12T12:13:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe10ee00640 1 -- 172.21.15.144:0/4089877473 shutdown_connections 2024-09-12T12:13:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe10ee00640 1 --2- 172.21.15.144:0/4089877473 >> v2:172.21.15.144:3300/0 conn(0x7fe10806d260 0x7fe108140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe10ee00640 1 --2- 172.21.15.144:0/4089877473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe10806e590 0x7fe10806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe10ee00640 1 --2- 172.21.15.144:0/4089877473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1080b2af0 0x7fe1080cfa70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe10ee00640 1 -- 172.21.15.144:0/4089877473 >> 172.21.15.144:0/4089877473 conn(0x7fe108067a00 msgr2=0x7fe108067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7ff1e6e00640 1 -- 172.21.15.144:0/394249618 --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e00d1580 con 0x7ff1e015c220 2024-09-12T12:13:08.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7ff1e6e00640 1 -- 172.21.15.144:0/394249618 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e00b4bb0 con 0x7ff1e00b4200 2024-09-12T12:13:08.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7ff1e6e00640 1 -- 172.21.15.144:0/394249618 --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e00d1320 con 0x7ff1e00b5720 2024-09-12T12:13:08.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe10ee00640 1 -- 172.21.15.144:0/4089877473 shutdown_connections 2024-09-12T12:13:08.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7fe10ee00640 1 -- 172.21.15.144:0/4089877473 wait complete. 2024-09-12T12:13:08.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7fe10ee00640 1 Processor -- start 2024-09-12T12:13:08.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7f06f2a00640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d80039c0 0x7f06d8003de0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f06e4004f90 tx=0x7f06e401e4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e79fdb79c2459e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4007030 con 0x7f06d80039c0 2024-09-12T12:13:08.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e40b1070 con 0x7f06d80039c0 2024-09-12T12:13:08.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7f06f1600640 1 -- 172.21.15.144:0/2420463093 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4004bb0 con 0x7f06d80039c0 2024-09-12T12:13:08.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7fd533000640 1 Processor -- start 2024-09-12T12:13:08.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7fd533000640 1 -- start start 2024-09-12T12:13:08.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7ff1df400640 1 -- 172.21.15.144:0/394249618 >> v2:172.21.15.165:3300/0 conn(0x7ff1e00b5720 msgr2=0x7ff1e00b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:08.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7ff1df400640 1 --2- 172.21.15.144:0/394249618 >> v2:172.21.15.165:3300/0 conn(0x7ff1e00b5720 0x7ff1e00b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7ff1df400640 1 -- 172.21.15.144:0/394249618 >> v1:172.21.15.165:6789/0 conn(0x7ff1e015c220 legacy=0x7ff1e00d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.685+0000 7ff1df400640 1 -- 172.21.15.144:0/394249618 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e00d1860 con 0x7ff1e00b4200 2024-09-12T12:13:08.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7f06f9c00640 1 -- 172.21.15.144:0/2420463093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d80039c0 msgr2=0x7f06d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7f06f9c00640 1 --2- 172.21.15.144:0/2420463093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d80039c0 0x7f06d8003de0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f06e4004f90 tx=0x7f06e401e4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7f06f3400640 1 -- 172.21.15.144:0/2420463093 reap_dead start 2024-09-12T12:13:08.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7ff1e4e00640 1 --2- 172.21.15.144:0/394249618 >> v2:172.21.15.165:3300/0 conn(0x7ff1e00b5720 0x7ff1e00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:08.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7fd533000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd52c0d0050 0x7fd52c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7fd533000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 0x7fd52c0b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7fd533000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52c162f00 0x7fd52c0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7fd533000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c0cc6a0 con 0x7fd52c162f00 2024-09-12T12:13:08.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7fd533000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c166b60 con 0x7fd52c162b20 2024-09-12T12:13:08.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.689+0000 7fd533000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd52c0cc820 con 0x7fd52c0d0050 2024-09-12T12:13:08.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7f06f9c00640 1 -- 172.21.15.144:0/2420463093 shutdown_connections 2024-09-12T12:13:08.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd52be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd52c0d0050 0x7fd52c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe10ee00640 1 -- start start 2024-09-12T12:13:08.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1df400640 1 --2- 172.21.15.144:0/394249618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e00b4200 0x7ff1e00b4670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00cf990 tx=0x7ff1cc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0075b6f262839a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd52be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd52c0d0050 0x7fd52c154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34272/0 (socket says 172.21.15.144:34272) 2024-09-12T12:13:08.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd531000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52c162f00 0x7fd52c0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd531000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52c162f00 0x7fd52c0b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50980/0 (socket says 172.21.15.144:50980) 2024-09-12T12:13:08.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd531000640 1 -- 172.21.15.144:0/1836200573 learned_addr learned my addr 172.21.15.144:0/1836200573 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd52b400640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 0x7fd52c0b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7f06f9c00640 1 -- 172.21.15.144:0/2420463093 >> 172.21.15.144:0/2420463093 conn(0x7f06f40d04e0 msgr2=0x7f06f40d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1dea00640 1 -- 172.21.15.144:0/394249618 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0a7070 con 0x7ff1e00b4200 2024-09-12T12:13:08.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1dea00640 1 -- 172.21.15.144:0/394249618 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc0b0070 con 0x7ff1e00b4200 2024-09-12T12:13:08.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd52b400640 1 -- 172.21.15.144:0/1836200573 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd52c0d0050 msgr2=0x7fd52c154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd52b400640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd52c0d0050 0x7fd52c154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd52b400640 1 -- 172.21.15.144:0/1836200573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52c162f00 msgr2=0x7fd52c0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd52b400640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52c162f00 0x7fd52c0b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd52b400640 1 -- 172.21.15.144:0/1836200573 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52c0c5ac0 con 0x7fd52c162b20 2024-09-12T12:13:08.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1dea00640 1 -- 172.21.15.144:0/394249618 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0a7070 con 0x7ff1e00b4200 2024-09-12T12:13:08.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe10ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe10806d260 0x7fe108158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7f06f9c00640 1 -- 172.21.15.144:0/2420463093 shutdown_connections 2024-09-12T12:13:08.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7f06f9c00640 1 -- 172.21.15.144:0/2420463093 wait complete. 2024-09-12T12:13:08.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd52b400640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 0x7fd52c0b4710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c3c0 tx=0x7fd51800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1e6e00640 1 -- 172.21.15.144:0/394249618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e00b4200 msgr2=0x7ff1e00b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/394249618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e00b4200 0x7ff1e00b4670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00cf990 tx=0x7ff1cc01c470 comp rx=0 tx=0).stop 2024-09-12T12:13:08.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd523e00640 1 -- 172.21.15.144:0/1836200573 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518017070 con 0x7fd52c162b20 2024-09-12T12:13:08.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd523e00640 1 -- 172.21.15.144:0/1836200573 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5180052d0 con 0x7fd52c162b20 2024-09-12T12:13:08.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fd523e00640 1 -- 172.21.15.144:0/1836200573 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5180054c0 con 0x7fd52c162b20 2024-09-12T12:13:08.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe10ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe10806e590 0x7fe1081594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe10ee00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1080b2af0 0x7fe10813d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe10ee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe10815ba10 con 0x7fe10806e590 2024-09-12T12:13:08.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe10ee00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe10815b890 con 0x7fe1080b2af0 2024-09-12T12:13:08.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe10ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1080b2ed0 con 0x7fe10806d260 2024-09-12T12:13:08.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe107400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe10806e590 0x7fe1081594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe107400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe10806e590 0x7fe1081594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50984/0 (socket says 172.21.15.144:50984) 2024-09-12T12:13:08.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe107400640 1 -- 172.21.15.144:0/838148871 learned_addr learned my addr 172.21.15.144:0/838148871 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7fe10ce00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1080b2af0 0x7fe10813d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1e6e00640 1 -- 172.21.15.144:0/394249618 shutdown_connections 2024-09-12T12:13:08.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/394249618 >> v2:172.21.15.165:3300/0 conn(0x7ff1e00b5720 0x7ff1e00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/394249618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e00b4200 0x7ff1e00b4670 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1e6e00640 1 -- 172.21.15.144:0/394249618 >> 172.21.15.144:0/394249618 conn(0x7ff1e006f400 msgr2=0x7ff1e006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.693+0000 7ff1e6e00640 1 -- 172.21.15.144:0/394249618 shutdown_connections 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe107400640 1 -- 172.21.15.144:0/838148871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe10806d260 msgr2=0x7fe108158f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe107400640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe10806d260 0x7fe108158f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe107400640 1 -- 172.21.15.144:0/838148871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1080b2af0 msgr2=0x7fe10813d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe107400640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1080b2af0 0x7fe10813d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe107400640 1 -- 172.21.15.144:0/838148871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe108165ed0 con 0x7fe10806e590 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe107400640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe10806e590 0x7fe1081594a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400b3e0 tx=0x7fe0f400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe0ffe00640 1 -- 172.21.15.144:0/838148871 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4015020 con 0x7fe10806e590 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe0ffe00640 1 -- 172.21.15.144:0/838148871 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f4011830 con 0x7fe10806e590 2024-09-12T12:13:08.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe0ffe00640 1 -- 172.21.15.144:0/838148871 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4015020 con 0x7fe10806e590 2024-09-12T12:13:08.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7ff1e6e00640 1 -- 172.21.15.144:0/394249618 wait complete. 2024-09-12T12:13:08.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd52c152400 con 0x7fd52c162b20 2024-09-12T12:13:08.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7f06f9c00640 1 Processor -- start 2024-09-12T12:13:08.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd52c1529c0 con 0x7fd52c162b20 2024-09-12T12:13:08.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe108156680 con 0x7fe10806e590 2024-09-12T12:13:08.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7f06f9c00640 1 -- start start 2024-09-12T12:13:08.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.697+0000 7ff1e6e00640 1 Processor -- start 2024-09-12T12:13:08.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1e6e00640 1 -- start start 2024-09-12T12:13:08.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd52c0cc160 con 0x7fd52c162b20 2024-09-12T12:13:08.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7fd523e00640 1 -- 172.21.15.144:0/1836200573 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd51801a070 con 0x7fd52c162b20 2024-09-12T12:13:08.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe108156c40 con 0x7fe10806e590 2024-09-12T12:13:08.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f9c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80039c0 0x7f06f4151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f9c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06f40b4d50 0x7f06f41f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1e6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1e00b4200 0x7ff1e014d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1e6e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e00b5720 0x7ff1e014dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7fd523e00640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd50c067990 0x7fd50c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7fd523e00640 1 -- 172.21.15.144:0/1836200573 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd518085280 con 0x7fd52c162b20 2024-09-12T12:13:08.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1dfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1e00b4200 0x7ff1e014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1dfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1e00b4200 0x7ff1e014d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34290/0 (socket says 172.21.15.144:34290) 2024-09-12T12:13:08.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06f415ab00 0x7f06f415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80039c0 0x7f06f4151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80039c0 0x7f06f4151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44100/0 (socket says 172.21.15.144:44100) 2024-09-12T12:13:08.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f2a00640 1 -- 172.21.15.144:0/3632250533 learned_addr learned my addr 172.21.15.144:0/3632250533 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f3400640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06f415ab00 0x7f06f415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f06f40b3100 con 0x7f06f415ab00 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f06f40b13e0 con 0x7f06d80039c0 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f06f4072b20 con 0x7f06f40b4d50 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7f06f2000640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06f40b4d50 0x7f06f41f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1dfe00640 1 -- 172.21.15.144:0/215879751 learned_addr learned my addr 172.21.15.144:0/215879751 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e015c220 0x7ff1e014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1df400640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e00b5720 0x7ff1e014dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e015c780 con 0x7ff1e015c220 2024-09-12T12:13:08.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e015c600 con 0x7ff1e00b5720 2024-09-12T12:13:08.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e0070bf0 con 0x7ff1e00b4200 2024-09-12T12:13:08.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7ff1e4e00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e015c220 0x7ff1e014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f2a00640 1 -- 172.21.15.144:0/3632250533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06f40b4d50 msgr2=0x7f06f41f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1dfe00640 1 -- 172.21.15.144:0/215879751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e00b5720 msgr2=0x7ff1e014dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1dfe00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e00b5720 0x7ff1e014dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1dfe00640 1 -- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e015c220 msgr2=0x7ff1e014e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1dfe00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e015c220 0x7ff1e014e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f2a00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06f40b4d50 0x7f06f41f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f2a00640 1 -- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06f415ab00 msgr2=0x7f06f415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:08.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f2a00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06f415ab00 0x7f06f415afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:08.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f2a00640 1 -- 172.21.15.144:0/3632250533 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f41fa0f0 con 0x7f06d80039c0 2024-09-12T12:13:08.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f2000640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06f40b4d50 0x7f06f41f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:08.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.701+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10806e370 con 0x7fe10806e590 2024-09-12T12:13:08.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1dfe00640 1 -- 172.21.15.144:0/215879751 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e0153050 con 0x7ff1e00b4200 2024-09-12T12:13:08.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1dfe00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1e00b4200 0x7ff1e014d680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800cbc0 tx=0x7ff1d800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1d7e00640 1 -- 172.21.15.144:0/215879751 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8017070 con 0x7ff1e00b4200 2024-09-12T12:13:08.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1d7e00640 1 -- 172.21.15.144:0/215879751 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d800aca0 con 0x7ff1e00b4200 2024-09-12T12:13:08.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f2a00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80039c0 0x7f06f4151340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06e401e2d0 tx=0x7f06d8005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7fd52be00640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd50c067990 0x7fd50c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7fd52be00640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd50c067990 0x7fd50c069e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0b2000 tx=0x7fd51c0aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e0153330 con 0x7ff1e00b4200 2024-09-12T12:13:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7fe0ffe00640 1 -- 172.21.15.144:0/838148871 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe0f4018020 con 0x7fe10806e590 2024-09-12T12:13:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7fe0ffe00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0e8067ac0 0x7fe0e8069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e0150d70 con 0x7ff1e00b4200 2024-09-12T12:13:08.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06eaa00640 1 -- 172.21.15.144:0/3632250533 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4004bb0 con 0x7f06d80039c0 2024-09-12T12:13:08.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f40b51e0 con 0x7f06d80039c0 2024-09-12T12:13:08.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f40b57a0 con 0x7f06d80039c0 2024-09-12T12:13:08.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7ff1d7e00640 1 -- 172.21.15.144:0/215879751 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8012600 con 0x7ff1e00b4200 2024-09-12T12:13:08.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.705+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f40b00d0 con 0x7f06d80039c0 2024-09-12T12:13:08.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7fe107e00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0e8067ac0 0x7fe0e8069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7fe107e00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0e8067ac0 0x7fe0e8069f80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80b1000 tx=0x7fe0f80a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7fe0ffe00640 1 -- 172.21.15.144:0/838148871 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe0f4052fa0 con 0x7fe10806e590 2024-09-12T12:13:08.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e00b5e50 con 0x7ff1e00b4200 2024-09-12T12:13:08.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7ff1d7e00640 1 -- 172.21.15.144:0/215879751 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1d801a070 con 0x7ff1e00b4200 2024-09-12T12:13:08.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7fd523e00640 1 -- 172.21.15.144:0/1836200573 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd518055410 con 0x7fd52c162b20 2024-09-12T12:13:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7f06eaa00640 1 -- 172.21.15.144:0/3632250533 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e40ba030 con 0x7f06d80039c0 2024-09-12T12:13:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7f06eaa00640 1 -- 172.21.15.144:0/3632250533 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40ac650 con 0x7f06d80039c0 2024-09-12T12:13:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7f06eaa00640 1 -- 172.21.15.144:0/3632250533 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06e40ac7f0 con 0x7f06d80039c0 2024-09-12T12:13:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7ff1d7e00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1c0067990 0x7ff1c0069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.709+0000 7ff1d7e00640 1 -- 172.21.15.144:0/215879751 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff1d8085c40 con 0x7ff1e00b4200 2024-09-12T12:13:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.713+0000 7ff1df400640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1c0067990 0x7ff1c0069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.713+0000 7f06eaa00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06d40678f0 0x7f06d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.713+0000 7f06eaa00640 1 -- 172.21.15.144:0/3632250533 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f06e41213c0 con 0x7f06d80039c0 2024-09-12T12:13:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.713+0000 7f06f2000640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06d40678f0 0x7f06d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:08.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.713+0000 7ff1df400640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1c0067990 0x7ff1c0069e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0af000 tx=0x7ff1cc0b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.713+0000 7f06f2000640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06d40678f0 0x7f06d4069db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06f415b860 tx=0x7f06e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:08.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.717+0000 7f06eaa00640 1 -- 172.21.15.144:0/3632250533 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f06e40c4030 con 0x7f06d80039c0 2024-09-12T12:13:08.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.717+0000 7fe0ffe00640 1 -- 172.21.15.144:0/838148871 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe0f4055600 con 0x7fe10806e590 2024-09-12T12:13:08.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:08.721+0000 7ff1d7e00640 1 -- 172.21.15.144:0/215879751 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff1d8055e60 con 0x7ff1e00b4200 2024-09-12T12:13:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.005+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f31d40ccde0 con 0x7f31d4073220 2024-09-12T12:13:09.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.005+0000 7f31caa00640 1 -- 172.21.15.144:0/3219829304 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31cc0f00b0 con 0x7f31d4073220 2024-09-12T12:13:09.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.005+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5c3403d550 con 0x7f5c34006dd0 2024-09-12T12:13:09.007 INFO:teuthology.orchestra.run.smithi144.stdout:55834574857 2024-09-12T12:13:09.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.005+0000 7f5c38c00640 1 -- 172.21.15.144:0/3040477067 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5c30062240 con 0x7f5c34006dd0 2024-09-12T12:13:09.008 INFO:teuthology.orchestra.run.smithi144.stdout:55834574856 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b4067cc0 msgr2=0x7f31b406a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b4067cc0 0x7f31b406a180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f31d4166190 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31d4073220 msgr2=0x7f31d41596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31d4073220 0x7f31d41596b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31cc01c7d0 tx=0x7f31cc01b940 comp rx=0 tx=0).stop 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 shutdown_connections 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b4067cc0 0x7f31b406a180 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f31d4166190 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31d40d0820 0x7f31d4152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31d4073600 0x7f31d4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 --2- 172.21.15.144:0/3219829304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31d4073220 0x7f31d41596b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 >> 172.21.15.144:0/3219829304 conn(0x7f31d4068000 msgr2=0x7f31d4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:09.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 shutdown_connections 2024-09-12T12:13:09.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f31d9600640 1 -- 172.21.15.144:0/3219829304 wait complete. 2024-09-12T12:13:09.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c1c067990 msgr2=0x7f5c1c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f5c43400640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c1c067990 0x7f5c1c069e50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c340e3280 tx=0x7f5c28009040 comp rx=0 tx=0).stop 2024-09-12T12:13:09.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 msgr2=0x7f5c3404e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.009+0000 7f5c43400640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 0x7f5c3404e520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5c30013de0 tx=0x7f5c30009490 comp rx=0 tx=0).stop 2024-09-12T12:13:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 shutdown_connections 2024-09-12T12:13:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f5c43400640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c1c067990 0x7f5c1c069e50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f5c43400640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c340e2990 0x7f5c340e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f5c43400640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c34057780 0x7f5c340e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f5c43400640 1 --2- 172.21.15.144:0/3040477067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c34006dd0 0x7f5c3404e520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 >> 172.21.15.144:0/3040477067 conn(0x7f5c3403a530 msgr2=0x7f5c3403a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:09.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f0576a00640 1 -- 172.21.15.144:0/4156099807 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0584073fa0 con 0x7f05840cd540 2024-09-12T12:13:09.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 shutdown_connections 2024-09-12T12:13:09.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f5c43400640 1 -- 172.21.15.144:0/3040477067 wait complete. 2024-09-12T12:13:09.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.013+0000 7f0581600640 1 -- 172.21.15.144:0/4156099807 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f057c0f2ae0 con 0x7f05840cd540 2024-09-12T12:13:09.017 INFO:teuthology.orchestra.run.smithi144.stdout:55834574858 2024-09-12T12:13:09.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.021+0000 7f0576a00640 1 -- 172.21.15.144:0/4156099807 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0564067990 msgr2=0x7f0564069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.021+0000 7f0576a00640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0564067990 0x7f0564069e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0570000f70 tx=0x7f05700079c0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.021+0000 7f0576a00640 1 -- 172.21.15.144:0/4156099807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05840cd540 msgr2=0x7f0584155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.021+0000 7f0576a00640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05840cd540 0x7f0584155750 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f057c0b0040 tx=0x7f057c01acc0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.025+0000 7f0576a00640 1 -- 172.21.15.144:0/4156099807 shutdown_connections 2024-09-12T12:13:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.025+0000 7f0576a00640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0564067990 0x7f0564069e50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.025+0000 7f0576a00640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f058415a950 0x7f0584155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.025+0000 7f0576a00640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05840cd540 0x7f0584155750 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.025+0000 7f0576a00640 1 --2- 172.21.15.144:0/4156099807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05840b3cf0 0x7f0584146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.025+0000 7f0576a00640 1 -- 172.21.15.144:0/4156099807 >> 172.21.15.144:0/4156099807 conn(0x7f058406bc10 msgr2=0x7f05840b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:09.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.025+0000 7f0576a00640 1 -- 172.21.15.144:0/4156099807 shutdown_connections 2024-09-12T12:13:09.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.025+0000 7f0576a00640 1 -- 172.21.15.144:0/4156099807 wait complete. 2024-09-12T12:13:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.025+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1d5803e9c0 con 0x7f1d580e7020 2024-09-12T12:13:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.029+0000 7f1d5d600640 1 -- 172.21.15.144:0/3197330587 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d58050210 con 0x7f1d580e7020 2024-09-12T12:13:09.032 INFO:teuthology.orchestra.run.smithi144.stdout:55834574855 2024-09-12T12:13:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.033+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d40067910 msgr2=0x7f1d40069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.033+0000 7f1d66e00640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d40067910 0x7f1d40069dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d540ad000 tx=0x7f1d540a6000 comp rx=0 tx=0).stop 2024-09-12T12:13:09.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.033+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 msgr2=0x7f1d580d9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.033+0000 7f1d66e00640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 0x7f1d580d9de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d6006ac00 tx=0x7f1d60069f40 comp rx=0 tx=0).stop 2024-09-12T12:13:09.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.037+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 shutdown_connections 2024-09-12T12:13:09.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.037+0000 7f1d66e00640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d40067910 0x7f1d40069dd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.037+0000 7f1d66e00640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d580e7020 0x7f1d580d9de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.037+0000 7f1d66e00640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d580e66a0 0x7f1d5804fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.037+0000 7f1d66e00640 1 --2- 172.21.15.144:0/3197330587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d580e2d20 0x7f1d580dbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.037+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 >> 172.21.15.144:0/3197330587 conn(0x7f1d5803a530 msgr2=0x7f1d58039dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:09.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.037+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 shutdown_connections 2024-09-12T12:13:09.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.037+0000 7f1d66e00640 1 -- 172.21.15.144:0/3197330587 wait complete. 2024-09-12T12:13:09.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-09-12T12:13:09.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-09-12T12:13:09.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.057+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f06f406f580 con 0x7f06d80039c0 2024-09-12T12:13:09.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.057+0000 7f06eaa00640 1 -- 172.21.15.144:0/3632250533 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06f40b28c0 con 0x7f06d80039c0 2024-09-12T12:13:09.058 INFO:teuthology.orchestra.run.smithi144.stdout:55834574858 2024-09-12T12:13:09.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2024-09-12T12:13:09.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06d40678f0 msgr2=0x7f06d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06d40678f0 0x7f06d4069db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06f415b860 tx=0x7f06e0008040 comp rx=0 tx=0).stop 2024-09-12T12:13:09.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80039c0 msgr2=0x7f06f4151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80039c0 0x7f06f4151340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06e401e2d0 tx=0x7f06d8005840 comp rx=0 tx=0).stop 2024-09-12T12:13:09.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 shutdown_connections 2024-09-12T12:13:09.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06d40678f0 0x7f06d4069db0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06f415ab00 0x7f06f415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06f40b4d50 0x7f06f41f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 --2- 172.21.15.144:0/3632250533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80039c0 0x7f06f4151340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 >> 172.21.15.144:0/3632250533 conn(0x7f06f40d04e0 msgr2=0x7f06f415cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:09.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 shutdown_connections 2024-09-12T12:13:09.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7f06f9c00640 1 -- 172.21.15.144:0/3632250533 wait complete. 2024-09-12T12:13:09.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff1e00b3470 con 0x7ff1e00b4200 2024-09-12T12:13:09.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7ff1d7e00640 1 -- 172.21.15.144:0/215879751 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff1d805a160 con 0x7ff1e00b4200 2024-09-12T12:13:09.063 INFO:teuthology.orchestra.run.smithi144.stdout:55834574856 2024-09-12T12:13:09.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd52c075550 con 0x7fd52c162b20 2024-09-12T12:13:09.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.061+0000 7fd523e00640 1 -- 172.21.15.144:0/1836200573 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd518059710 con 0x7fd52c162b20 2024-09-12T12:13:09.065 INFO:teuthology.orchestra.run.smithi144.stdout:55834574856 2024-09-12T12:13:09.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1c0067990 msgr2=0x7ff1c0069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1c0067990 0x7ff1c0069e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc0af000 tx=0x7ff1cc0b6040 comp rx=0 tx=0).stop 2024-09-12T12:13:09.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1e00b4200 msgr2=0x7ff1e014d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1e00b4200 0x7ff1e014d680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800cbc0 tx=0x7ff1d800a060 comp rx=0 tx=0).stop 2024-09-12T12:13:09.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 shutdown_connections 2024-09-12T12:13:09.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1c0067990 0x7ff1c0069e50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e015c220 0x7ff1e014e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e00b5720 0x7ff1e014dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 --2- 172.21.15.144:0/215879751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1e00b4200 0x7ff1e014d680 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 >> 172.21.15.144:0/215879751 conn(0x7ff1e006f400 msgr2=0x7ff1e0073a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:09.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-09-12T12:13:09.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 shutdown_connections 2024-09-12T12:13:09.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7ff1e6e00640 1 -- 172.21.15.144:0/215879751 wait complete. 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd50c067990 msgr2=0x7fd50c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd50c067990 0x7fd50c069e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0b2000 tx=0x7fd51c0aa070 comp rx=0 tx=0).stop 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 msgr2=0x7fd52c0b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 0x7fd52c0b4710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c3c0 tx=0x7fd51800c880 comp rx=0 tx=0).stop 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 shutdown_connections 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd50c067990 0x7fd50c069e50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd52c162f00 0x7fd52c0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52c162b20 0x7fd52c0b4710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 --2- 172.21.15.144:0/1836200573 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd52c0d0050 0x7fd52c154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 >> 172.21.15.144:0/1836200573 conn(0x7fd52c0b23c0 msgr2=0x7fd52c160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:09.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 shutdown_connections 2024-09-12T12:13:09.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.065+0000 7fd533000640 1 -- 172.21.15.144:0/1836200573 wait complete. 2024-09-12T12:13:09.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.069+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe10813df10 con 0x7fe10806e590 2024-09-12T12:13:09.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.069+0000 7fe0ffe00640 1 -- 172.21.15.144:0/838148871 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0f4054f00 con 0x7fe10806e590 2024-09-12T12:13:09.071 INFO:teuthology.orchestra.run.smithi144.stdout:55834574857 2024-09-12T12:13:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.069+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0e8067ac0 msgr2=0x7fe0e8069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.069+0000 7fe10ee00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0e8067ac0 0x7fe0e8069f80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80b1000 tx=0x7fe0f80a9070 comp rx=0 tx=0).stop 2024-09-12T12:13:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.069+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe10806e590 msgr2=0x7fe1081594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.069+0000 7fe10ee00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe10806e590 0x7fe1081594a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400b3e0 tx=0x7fe0f400b8a0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.069+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 shutdown_connections 2024-09-12T12:13:09.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.069+0000 7fe10ee00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0e8067ac0 0x7fe0e8069f80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.073+0000 7fe10ee00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1080b2af0 0x7fe10813d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.073+0000 7fe10ee00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe10806e590 0x7fe1081594a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.073+0000 7fe10ee00640 1 --2- 172.21.15.144:0/838148871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe10806d260 0x7fe108158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:09.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.073+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 >> 172.21.15.144:0/838148871 conn(0x7fe108067a00 msgr2=0x7fe10815d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:09.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.073+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 shutdown_connections 2024-09-12T12:13:09.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:09.073+0000 7fe10ee00640 1 -- 172.21.15.144:0/838148871 wait complete. 2024-09-12T12:13:09.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-09-12T12:13:09.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-09-12T12:13:09.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-09-12T12:13:09.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-09-12T12:13:10.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T12:13:10.054 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T12:13:10.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T12:13:10.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T12:13:10.097 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T12:13:10.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T12:13:10.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T12:13:10.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T12:13:10.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.261+0000 7f8a61000640 1 Processor -- start 2024-09-12T12:13:10.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.261+0000 7f8a61000640 1 -- start start 2024-09-12T12:13:10.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.261+0000 7f8a61000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8a5c15e320 0x7f8a5c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.261+0000 7f8a61000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a5c0ae890 0x7f8a5c0aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.261+0000 7f8a61000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5c0cf480 con 0x7f8a5c0cebd0 2024-09-12T12:13:10.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.261+0000 7fd644a00640 1 Processor -- start 2024-09-12T12:13:10.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.261+0000 7fd644a00640 1 -- start start 2024-09-12T12:13:10.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd644a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6400cd540 0x7fd6400cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a61000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5c0cf040 con 0x7f8a5c0ae890 2024-09-12T12:13:10.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a61000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8a5c0af1b0 con 0x7f8a5c15e320 2024-09-12T12:13:10.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd644a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd64015a950 0x7fd64015adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a5be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a5c0ae890 0x7f8a5c0aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a5be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a5c0ae890 0x7f8a5c0aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51018/0 (socket says 172.21.15.144:51018) 2024-09-12T12:13:10.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a5b400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8a5c15e320 0x7f8a5c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a5be00640 1 -- 172.21.15.144:0/2569299579 learned_addr learned my addr 172.21.15.144:0/2569299579 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd644a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64006cd20 0x7fd64006d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd644a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd6400cde60 con 0x7fd6400cd540 2024-09-12T12:13:10.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd644a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd64015b410 con 0x7fd64015a950 2024-09-12T12:13:10.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd644a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd64015b6f0 con 0x7fd64006cd20 2024-09-12T12:13:10.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a5b400640 1 -- 172.21.15.144:0/2569299579 >> v2:172.21.15.144:3300/0 conn(0x7f8a5c0ae890 msgr2=0x7f8a5c0aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a5b400640 1 --2- 172.21.15.144:0/2569299579 >> v2:172.21.15.144:3300/0 conn(0x7f8a5c0ae890 0x7f8a5c0aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a5b400640 1 -- 172.21.15.144:0/2569299579 >> v1:172.21.15.144:6789/0 conn(0x7f8a5c0cebd0 legacy=0x7f8a5c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a5b400640 1 -- 172.21.15.144:0/2569299579 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c0cf6f0 con 0x7f8a5c15e320 2024-09-12T12:13:10.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7f8a5be00640 1 --2- 172.21.15.144:0/2569299579 >> v2:172.21.15.144:3300/0 conn(0x7f8a5c0ae890 0x7f8a5c0aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:10.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64006cd20 0x7fd64006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6400cd540 0x7fd6400cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd64015a950 0x7fd64015adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd64015a950 0x7fd64015adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44142/0 (socket says 172.21.15.144:44142) 2024-09-12T12:13:10.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63de00640 1 -- 172.21.15.144:0/2624145523 learned_addr learned my addr 172.21.15.144:0/2624145523 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63e800640 1 --2- 172.21.15.144:0/2624145523 >> v2:172.21.15.144:3300/0 conn(0x7fd6400cd540 0x7fd6400cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51026/0 (socket says 172.21.15.144:51026) 2024-09-12T12:13:10.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63f200640 1 -- 172.21.15.144:0/2624145523 >> v2:172.21.15.165:3300/0 conn(0x7fd64015a950 msgr2=0x7fd64015adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63f200640 1 --2- 172.21.15.144:0/2624145523 >> v2:172.21.15.165:3300/0 conn(0x7fd64015a950 0x7fd64015adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63f200640 1 -- 172.21.15.144:0/2624145523 >> v2:172.21.15.144:3300/0 conn(0x7fd6400cd540 msgr2=0x7fd6400cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63f200640 1 --2- 172.21.15.144:0/2624145523 >> v2:172.21.15.144:3300/0 conn(0x7fd6400cd540 0x7fd6400cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63f200640 1 -- 172.21.15.144:0/2624145523 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6400b34f0 con 0x7fd64006cd20 2024-09-12T12:13:10.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.265+0000 7fd63e800640 1 --2- 172.21.15.144:0/2624145523 >> v2:172.21.15.144:3300/0 conn(0x7fd6400cd540 0x7fd6400cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:10.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.269+0000 7f8a5b400640 1 --2- 172.21.15.144:0/2569299579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c15e320 0x7f8a5c0cdc00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0687c0 tx=0x7f8a5401c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bcd093a74feff2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.269+0000 7f8a5a000640 1 -- 172.21.15.144:0/2569299579 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a540b0070 con 0x7f8a5c15e320 2024-09-12T12:13:10.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.269+0000 7f8a5a000640 1 -- 172.21.15.144:0/2569299579 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a540ab600 con 0x7f8a5c15e320 2024-09-12T12:13:10.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.269+0000 7f8a5a000640 1 -- 172.21.15.144:0/2569299579 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a540ab9d0 con 0x7f8a5c15e320 2024-09-12T12:13:10.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.269+0000 7fd63f200640 1 --2- 172.21.15.144:0/2624145523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64006cd20 0x7fd64006d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6400cd010 tx=0x7fd63801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaecf458298a65f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7f8a61000640 1 -- 172.21.15.144:0/2569299579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c15e320 msgr2=0x7f8a5c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd63d400640 1 -- 172.21.15.144:0/2624145523 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6380b2070 con 0x7fd64006cd20 2024-09-12T12:13:10.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd63d400640 1 -- 172.21.15.144:0/2624145523 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6380a58c0 con 0x7fd64006cd20 2024-09-12T12:13:10.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7f8a61000640 1 --2- 172.21.15.144:0/2569299579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c15e320 0x7f8a5c0cdc00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0687c0 tx=0x7f8a5401c440 comp rx=0 tx=0).stop 2024-09-12T12:13:10.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd644a00640 1 -- 172.21.15.144:0/2624145523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64006cd20 msgr2=0x7fd64006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd63d400640 1 -- 172.21.15.144:0/2624145523 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6380b2070 con 0x7fd64006cd20 2024-09-12T12:13:10.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd644a00640 1 --2- 172.21.15.144:0/2624145523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64006cd20 0x7fd64006d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6400cd010 tx=0x7fd63801c950 comp rx=0 tx=0).stop 2024-09-12T12:13:10.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7f8a61000640 1 -- 172.21.15.144:0/2569299579 shutdown_connections 2024-09-12T12:13:10.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7f8a61000640 1 --2- 172.21.15.144:0/2569299579 >> v2:172.21.15.144:3300/0 conn(0x7f8a5c0ae890 0x7f8a5c0aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd644a00640 1 -- 172.21.15.144:0/2624145523 shutdown_connections 2024-09-12T12:13:10.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd644a00640 1 --2- 172.21.15.144:0/2624145523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64006cd20 0x7fd64006d190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd644a00640 1 --2- 172.21.15.144:0/2624145523 >> v2:172.21.15.165:3300/0 conn(0x7fd64015a950 0x7fd64015adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd644a00640 1 --2- 172.21.15.144:0/2624145523 >> v2:172.21.15.144:3300/0 conn(0x7fd6400cd540 0x7fd6400cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7fd644a00640 1 -- 172.21.15.144:0/2624145523 >> 172.21.15.144:0/2624145523 conn(0x7fd64006bc10 msgr2=0x7fd64006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7f8a61000640 1 --2- 172.21.15.144:0/2569299579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c15e320 0x7f8a5c0cdc00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7f8a61000640 1 -- 172.21.15.144:0/2569299579 >> 172.21.15.144:0/2569299579 conn(0x7f8a5c06bc10 msgr2=0x7f8a5c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7f8a61000640 1 -- 172.21.15.144:0/2569299579 shutdown_connections 2024-09-12T12:13:10.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.273+0000 7f8a61000640 1 -- 172.21.15.144:0/2569299579 wait complete. 2024-09-12T12:13:10.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.277+0000 7fd644a00640 1 -- 172.21.15.144:0/2624145523 shutdown_connections 2024-09-12T12:13:10.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.277+0000 7fd644a00640 1 -- 172.21.15.144:0/2624145523 wait complete. 2024-09-12T12:13:10.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.277+0000 7f8a61000640 1 Processor -- start 2024-09-12T12:13:10.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.277+0000 7f8a61000640 1 -- start start 2024-09-12T12:13:10.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7f8a61000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a5c0ae890 0x7f8a5c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7f8a61000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c0cebd0 0x7f8a5c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7f8a61000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a5c15e320 0x7f8a5c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7f8a5b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a5c0ae890 0x7f8a5c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7f8a5b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a5c0ae890 0x7f8a5c155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34314/0 (socket says 172.21.15.144:34314) 2024-09-12T12:13:10.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7f8a5b400640 1 -- 172.21.15.144:0/1992091339 learned_addr learned my addr 172.21.15.144:0/1992091339 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c15e700 con 0x7f8a5c15e320 2024-09-12T12:13:10.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7fd644a00640 1 Processor -- start 2024-09-12T12:13:10.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c0af5a0 con 0x7f8a5c0cebd0 2024-09-12T12:13:10.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5c15e880 con 0x7f8a5c0ae890 2024-09-12T12:13:10.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.281+0000 7fd644a00640 1 -- start start 2024-09-12T12:13:10.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd644a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64006cd20 0x7fd640070da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5b400640 1 -- 172.21.15.144:0/1992091339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c0cebd0 msgr2=0x7f8a5c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd644a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6400cd540 0x7fd640204120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd644a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64015a950 0x7fd640204660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd644a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd6400b4870 con 0x7fd64006cd20 2024-09-12T12:13:10.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd644a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd6400b46f0 con 0x7fd6400cd540 2024-09-12T12:13:10.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd644a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd6400b49f0 con 0x7fd64015a950 2024-09-12T12:13:10.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5be00640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a5c15e320 0x7f8a5c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5aa00640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c0cebd0 0x7f8a5c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64006cd20 0x7fd640070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64006cd20 0x7fd640070da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51040/0 (socket says 172.21.15.144:51040) 2024-09-12T12:13:10.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63e800640 1 -- 172.21.15.144:0/1749328307 learned_addr learned my addr 172.21.15.144:0/1749328307 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63f200640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64015a950 0x7fd640204660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63de00640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6400cd540 0x7fd640204120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5b400640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c0cebd0 0x7f8a5c1586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5b400640 1 -- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a5c15e320 msgr2=0x7f8a5c158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5b400640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a5c15e320 0x7f8a5c158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5b400640 1 -- 172.21.15.144:0/1992091339 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c0abd70 con 0x7f8a5c0ae890 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5be00640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a5c15e320 0x7f8a5c158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5aa00640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c0cebd0 0x7f8a5c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63f200640 1 -- 172.21.15.144:0/1749328307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6400cd540 msgr2=0x7fd640204120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63f200640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6400cd540 0x7fd640204120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63f200640 1 -- 172.21.15.144:0/1749328307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64006cd20 msgr2=0x7fd640070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63f200640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64006cd20 0x7fd640070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63f200640 1 -- 172.21.15.144:0/1749328307 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd640073f90 con 0x7fd64015a950 2024-09-12T12:13:10.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a5b400640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a5c0ae890 0x7f8a5c155f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a540ae040 tx=0x7f8a540191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd63f200640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64015a950 0x7fd640204660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd64015b870 tx=0x7fd6380196f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd636a00640 1 -- 172.21.15.144:0/1749328307 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6380b2050 con 0x7fd64015a950 2024-09-12T12:13:10.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd640073470 con 0x7fd64015a950 2024-09-12T12:13:10.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd640073cb0 con 0x7fd64015a950 2024-09-12T12:13:10.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a53400640 1 -- 172.21.15.144:0/1992091339 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a540b0040 con 0x7f8a5c0ae890 2024-09-12T12:13:10.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a53400640 1 -- 172.21.15.144:0/1992091339 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a540bb070 con 0x7f8a5c0ae890 2024-09-12T12:13:10.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.285+0000 7f8a53400640 1 -- 172.21.15.144:0/1992091339 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a540b4650 con 0x7f8a5c0ae890 2024-09-12T12:13:10.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.289+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c156440 con 0x7f8a5c0ae890 2024-09-12T12:13:10.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.289+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c0ac2f0 con 0x7f8a5c0ae890 2024-09-12T12:13:10.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.289+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c0b3980 con 0x7f8a5c0ae890 2024-09-12T12:13:10.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.289+0000 7fd636a00640 1 -- 172.21.15.144:0/1749328307 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6380be070 con 0x7fd64015a950 2024-09-12T12:13:10.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.289+0000 7fd636a00640 1 -- 172.21.15.144:0/1749328307 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6380b2050 con 0x7fd64015a950 2024-09-12T12:13:10.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.289+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6400cd320 con 0x7fd64015a950 2024-09-12T12:13:10.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.293+0000 7fd636a00640 1 -- 172.21.15.144:0/1749328307 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd638004250 con 0x7fd64015a950 2024-09-12T12:13:10.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.293+0000 7f8a53400640 1 -- 172.21.15.144:0/1992091339 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a540dc890 con 0x7f8a5c0ae890 2024-09-12T12:13:10.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.293+0000 7fd636a00640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd620067cc0 0x7fd62006a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.297+0000 7fd63e800640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd620067cc0 0x7fd62006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.297+0000 7fd636a00640 1 -- 172.21.15.144:0/1749328307 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd6380a56c0 con 0x7fd64015a950 2024-09-12T12:13:10.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.297+0000 7fd636a00640 1 -- 172.21.15.144:0/1749328307 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd6380c7020 con 0x7fd64015a950 2024-09-12T12:13:10.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.297+0000 7fd63e800640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd620067cc0 0x7fd62006a180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009fd0 tx=0x7fd62c009a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.293+0000 7f8a53400640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a3c067990 0x7f8a3c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.293+0000 7f8a53400640 1 -- 172.21.15.144:0/1992091339 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a5411ff20 con 0x7f8a5c0ae890 2024-09-12T12:13:10.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.297+0000 7f8a5aa00640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a3c067990 0x7f8a3c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.297+0000 7f8a5aa00640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a3c067990 0x7f8a3c069e50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c007fd0 tx=0x7f8a4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.301+0000 7f8a53400640 1 -- 172.21.15.144:0/1992091339 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8a54016030 con 0x7f8a5c0ae890 2024-09-12T12:13:10.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.337+0000 7f4df2c00640 1 Processor -- start 2024-09-12T12:13:10.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df2c00640 1 -- start start 2024-09-12T12:13:10.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df2c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4dec15e320 0x7f4dec0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec0d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df2c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dec0cf480 con 0x7f4dec0ae890 2024-09-12T12:13:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df2c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4dec0cf040 con 0x7f4dec15e320 2024-09-12T12:13:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec0cf6f0 con 0x7f4dec0cebd0 2024-09-12T12:13:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec0d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec0d04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34344/0 (socket says 172.21.15.144:34344) 2024-09-12T12:13:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df0e00640 1 -- 172.21.15.144:0/3798114781 learned_addr learned my addr 172.21.15.144:0/3798114781 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df1800640 1 --2- 172.21.15.144:0/3798114781 >> v2:172.21.15.165:3300/0 conn(0x7f4dec15e320 0x7f4dec0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df0e00640 1 -- 172.21.15.144:0/3798114781 >> v2:172.21.15.165:3300/0 conn(0x7f4dec15e320 msgr2=0x7f4dec0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df0e00640 1 --2- 172.21.15.144:0/3798114781 >> v2:172.21.15.165:3300/0 conn(0x7f4dec15e320 0x7f4dec0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df0e00640 1 -- 172.21.15.144:0/3798114781 >> v1:172.21.15.165:6789/0 conn(0x7f4dec0ae890 legacy=0x7f4dec0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.341+0000 7f4df0e00640 1 -- 172.21.15.144:0/3798114781 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec0cf9d0 con 0x7f4dec0cebd0 2024-09-12T12:13:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4df0e00640 1 --2- 172.21.15.144:0/3798114781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec0d04b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009870 tx=0x7f4dd801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219b57e2b4e0f4be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4debe00640 1 -- 172.21.15.144:0/3798114781 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80ab640 con 0x7f4dec0cebd0 2024-09-12T12:13:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4debe00640 1 -- 172.21.15.144:0/3798114781 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd80b0070 con 0x7f4dec0cebd0 2024-09-12T12:13:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4debe00640 1 -- 172.21.15.144:0/3798114781 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80aba00 con 0x7f4dec0cebd0 2024-09-12T12:13:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4df2c00640 1 -- 172.21.15.144:0/3798114781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 msgr2=0x7f4dec0d04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4df2c00640 1 --2- 172.21.15.144:0/3798114781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec0d04b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009870 tx=0x7f4dd801c530 comp rx=0 tx=0).stop 2024-09-12T12:13:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4df2c00640 1 -- 172.21.15.144:0/3798114781 shutdown_connections 2024-09-12T12:13:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4df2c00640 1 --2- 172.21.15.144:0/3798114781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec0d04b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4df2c00640 1 --2- 172.21.15.144:0/3798114781 >> v2:172.21.15.165:3300/0 conn(0x7f4dec15e320 0x7f4dec0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4df2c00640 1 -- 172.21.15.144:0/3798114781 >> 172.21.15.144:0/3798114781 conn(0x7f4dec06bc10 msgr2=0x7f4dec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4df2c00640 1 -- 172.21.15.144:0/3798114781 shutdown_connections 2024-09-12T12:13:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.349+0000 7f4df2c00640 1 -- 172.21.15.144:0/3798114781 wait complete. 2024-09-12T12:13:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2c00640 1 Processor -- start 2024-09-12T12:13:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2c00640 1 -- start start 2024-09-12T12:13:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dec0ae890 0x7f4dec14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec15e320 0x7f4dec0aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0af0b0 con 0x7f4dec15e320 2024-09-12T12:13:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0d09f0 con 0x7f4dec0ae890 2024-09-12T12:13:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec072870 con 0x7f4dec0cebd0 2024-09-12T12:13:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dec0ae890 0x7f4dec14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dec0ae890 0x7f4dec14db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44186/0 (socket says 172.21.15.144:44186) 2024-09-12T12:13:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df1800640 1 -- 172.21.15.144:0/3788073537 learned_addr learned my addr 172.21.15.144:0/3788073537 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df0e00640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2200640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec15e320 0x7f4dec0aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df1800640 1 -- 172.21.15.144:0/3788073537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 msgr2=0x7f4dec071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df1800640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec071ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df1800640 1 -- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec15e320 msgr2=0x7f4dec0aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df1800640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec15e320 0x7f4dec0aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df1800640 1 -- 172.21.15.144:0/3788073537 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec167540 con 0x7f4dec0ae890 2024-09-12T12:13:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.353+0000 7f4df2200640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec15e320 0x7f4dec0aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7fbcaa600640 1 Processor -- start 2024-09-12T12:13:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7f4df1800640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dec0ae890 0x7f4dec14db40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4de000e930 tx=0x7f4de000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7fbcaa600640 1 -- start start 2024-09-12T12:13:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7f4de9600640 1 -- 172.21.15.144:0/3788073537 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0017070 con 0x7f4dec0ae890 2024-09-12T12:13:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7f4df2c00640 1 -- 172.21.15.144:0/3788073537 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec167820 con 0x7f4dec0ae890 2024-09-12T12:13:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7f4df2c00640 1 -- 172.21.15.144:0/3788073537 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec14e080 con 0x7f4dec0ae890 2024-09-12T12:13:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7f4de9600640 1 -- 172.21.15.144:0/3788073537 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de000ca00 con 0x7f4dec0ae890 2024-09-12T12:13:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7f4de9600640 1 -- 172.21.15.144:0/3788073537 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0017070 con 0x7f4dec0ae890 2024-09-12T12:13:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7fbcaa600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbca40cd540 0x7fbca40cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7fbcaa600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbca40b3cf0 0x7fbca40b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7fbcaa600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca415b6f0 con 0x7fbca406c730 2024-09-12T12:13:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7fbcaa600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbca40cdee0 con 0x7fbca40b3cf0 2024-09-12T12:13:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7fbcaa600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbca40b34f0 con 0x7fbca40cd540 2024-09-12T12:13:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7f4ddea00640 1 -- 172.21.15.144:0/3788073537 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc80052a0 con 0x7f4dec0ae890 2024-09-12T12:13:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.357+0000 7f6c2fe00640 1 Processor -- start 2024-09-12T12:13:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca9200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbca406c730 0x7fbca415a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37332/0 (socket says 172.21.15.144:37332) 2024-09-12T12:13:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f6c2fe00640 1 -- start start 2024-09-12T12:13:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca9200640 1 -- 172.21.15.144:0/4202664611 learned_addr learned my addr 172.21.15.144:0/4202664611 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:10.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212242074 0 0) 0x7fbca415b6f0 con 0x7fbca406c730 2024-09-12T12:13:10.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc88003530 con 0x7fbca406c730 2024-09-12T12:13:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f4de9600640 1 -- 172.21.15.144:0/3788073537 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4de001a070 con 0x7f4dec0ae890 2024-09-12T12:13:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f6c2fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6c3006c730 0x7f6c3015a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f6c2fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c3015b6f0 con 0x7f6c300cdc50 2024-09-12T12:13:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f6c2fe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c300b34f0 con 0x7f6c3015ae90 2024-09-12T12:13:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f6c2fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6c30160f70 con 0x7f6c3006c730 2024-09-12T12:13:10.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3318716454 0 0) 0x7fbc88003530 con 0x7fbca406c730 2024-09-12T12:13:10.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbca40cd540 msgr2=0x7fbca40cd9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:13:10.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbca40cd540 0x7fbca40cd9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 >> v2:172.21.15.165:3300/0 conn(0x7fbca40b3cf0 msgr2=0x7fbca40b41a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:13:10.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 --2- 172.21.15.144:0/4202664611 >> v2:172.21.15.165:3300/0 conn(0x7fbca40b3cf0 0x7fbca40b41a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca40af8c0 con 0x7fbca406c730 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fbc94001680 con 0x7fbca406c730 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 >> v1:172.21.15.144:6789/0 conn(0x7fbca406c730 legacy=0x7fbca415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 0x7fbc88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc88004810 0x7fbc88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc880051d0 0x7fbc8800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbca40b34f0 con 0x7fbc880039c0 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8800c120 con 0x7fbc880051d0 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8800c320 con 0x7fbc88004810 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f6c2ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6c3006c730 0x7f6c3015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f6c2ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6c3006c730 0x7f6c3015a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44206/0 (socket says 172.21.15.144:44206) 2024-09-12T12:13:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f6c2ea00640 1 -- 172.21.15.144:0/1131588500 learned_addr learned my addr 172.21.15.144:0/1131588500 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7fbca9200640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 0x7fbc88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f4de9600640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dcc067cc0 0x7f4dcc06a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.361+0000 7f4de9600640 1 -- 172.21.15.144:0/3788073537 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4de000f040 con 0x7f4dec0ae890 2024-09-12T12:13:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f4423a00640 1 Processor -- start 2024-09-12T12:13:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7fbca9c00640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc880051d0 0x7fbc8800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7fbca9200640 1 -- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc88004810 msgr2=0x7fbc88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7fbca3e00640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc88004810 0x7fbc88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7fbca9200640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc88004810 0x7fbc88004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7fbca9200640 1 -- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc880051d0 msgr2=0x7fbc8800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7fbca9200640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc880051d0 0x7fbc8800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7fbca9200640 1 -- 172.21.15.144:0/4202664611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca40af8c0 con 0x7fbc880039c0 2024-09-12T12:13:10.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7fbca3e00640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc88004810 0x7fbc88004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:10.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f4df0e00640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dcc067cc0 0x7f4dcc06a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f4423a00640 1 -- start start 2024-09-12T12:13:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f9006400640 1 Processor -- start 2024-09-12T12:13:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026481551 0 0) 0x7f6c300b34f0 con 0x7f6c3015ae90 2024-09-12T12:13:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c14003530 con 0x7f6c3015ae90 2024-09-12T12:13:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2692718064 0 0) 0x7f6c14003530 con 0x7f6c3015ae90 2024-09-12T12:13:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 >> v2:172.21.15.165:3300/0 conn(0x7f6c3006c730 msgr2=0x7f6c3015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 --2- 172.21.15.144:0/1131588500 >> v2:172.21.15.165:3300/0 conn(0x7f6c3006c730 0x7f6c3015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 >> v1:172.21.15.144:6789/0 conn(0x7f6c300cdc50 legacy=0x7f6c300b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 --> v1:172.21.15.165:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c300af8c0 con 0x7f6c3015ae90 2024-09-12T12:13:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f9006400640 1 -- start start 2024-09-12T12:13:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 <== mon.1 v1:172.21.15.165:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f6c1c001680 con 0x7f6c3015ae90 2024-09-12T12:13:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 >> v1:172.21.15.165:6789/0 conn(0x7f6c3015ae90 legacy=0x7f6c300cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c140039c0 0x7f6c14003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c14004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c140051d0 0x7f6c1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30160f70 con 0x7f6c140039c0 2024-09-12T12:13:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1400c050 con 0x7f6c14004810 2024-09-12T12:13:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1400c250 con 0x7f6c140051d0 2024-09-12T12:13:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f9006400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9000162900 0x7f90000cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f9006400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9000072e90 0x7f900006e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f9006400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90000b54f0 con 0x7f900006de40 2024-09-12T12:13:10.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f9006400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f900006e7f0 con 0x7f9000162900 2024-09-12T12:13:10.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f9006400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9000071710 con 0x7f9000072e90 2024-09-12T12:13:10.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2e000640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c14004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f4de9600640 1 -- 172.21.15.144:0/3788073537 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4de0055fd0 con 0x7f4dec0ae890 2024-09-12T12:13:10.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4df0e00640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dcc067cc0 0x7f4dcc06a180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80af000 tx=0x7f4dd80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f4423a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c0d1000 0x7f441c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f6c2ea00640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c140039c0 0x7f6c14003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f6c2f400640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c140051d0 0x7f6c1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f6c2e000640 1 -- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c140051d0 msgr2=0x7f6c1400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f6c2e000640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c140051d0 0x7f6c1400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f6c2e000640 1 -- 172.21.15.144:0/1131588500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c140039c0 msgr2=0x7f6c14003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f6c2e000640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c140039c0 0x7f6c14003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f6c2e000640 1 -- 172.21.15.144:0/1131588500 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c300af8c0 con 0x7f6c14004810 2024-09-12T12:13:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f6c2ea00640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c140039c0 0x7f6c14003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4421000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c0d1000 0x7f441c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4421000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c0d1000 0x7f441c0afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34398/0 (socket says 172.21.15.144:34398) 2024-09-12T12:13:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4421000640 1 -- 172.21.15.144:0/1523341919 learned_addr learned my addr 172.21.15.144:0/1523341919 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f9005a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9000072e90 0x7f900006e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4423a00640 1 -- 172.21.15.144:0/1523341919 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441c0710a0 con 0x7f441c071860 2024-09-12T12:13:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4423a00640 1 -- 172.21.15.144:0/1523341919 --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441c0b2b40 con 0x7f441c071c80 2024-09-12T12:13:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4423a00640 1 -- 172.21.15.144:0/1523341919 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f441c0b2e20 con 0x7f441c0d1000 2024-09-12T12:13:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7fbca9200640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 0x7fbc88003de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400c510 tx=0x7fbc9401f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d7d94e829a541a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.365+0000 7f9005a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9000072e90 0x7f900006e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34380/0 (socket says 172.21.15.144:34380) 2024-09-12T12:13:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f9005a00640 1 -- 172.21.15.144:0/2400972203 learned_addr learned my addr 172.21.15.144:0/2400972203 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f9005000640 1 --2- 172.21.15.144:0/2400972203 >> v2:172.21.15.165:3300/0 conn(0x7f9000162900 0x7f90000cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f9005a00640 1 -- 172.21.15.144:0/2400972203 >> v2:172.21.15.165:3300/0 conn(0x7f9000162900 msgr2=0x7f90000cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f9005a00640 1 --2- 172.21.15.144:0/2400972203 >> v2:172.21.15.165:3300/0 conn(0x7f9000162900 0x7f90000cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f9005a00640 1 -- 172.21.15.144:0/2400972203 >> v1:172.21.15.165:6789/0 conn(0x7f900006de40 legacy=0x7f9000162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f9005a00640 1 -- 172.21.15.144:0/2400972203 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90000b57d0 con 0x7f9000072e90 2024-09-12T12:13:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f441b400640 1 -- 172.21.15.144:0/1523341919 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009914506 0 0) 0x7f441c0b2b40 con 0x7f441c071c80 2024-09-12T12:13:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f6c2f400640 1 -- 172.21.15.144:0/1131588500 reap_dead start 2024-09-12T12:13:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f441b400640 1 -- 172.21.15.144:0/1523341919 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4400003530 con 0x7f441c071c80 2024-09-12T12:13:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4421000640 1 -- 172.21.15.144:0/1523341919 >> v1:172.21.15.165:6789/0 conn(0x7f441c071c80 legacy=0x7f441c06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4421000640 1 -- 172.21.15.144:0/1523341919 >> v1:172.21.15.144:6789/0 conn(0x7f441c071860 legacy=0x7f441c0b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7f4421000640 1 -- 172.21.15.144:0/1523341919 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441c071340 con 0x7f441c0d1000 2024-09-12T12:13:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.369+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400c0e0 con 0x7fbc880039c0 2024-09-12T12:13:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc94005ae0 con 0x7fbc880039c0 2024-09-12T12:13:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7fbca3400640 1 -- 172.21.15.144:0/4202664611 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400c0e0 con 0x7fbc880039c0 2024-09-12T12:13:10.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7f6c2e000640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c14004c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00c1b0 tx=0x7f6c1c01f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2966de5b1b858512 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7fbcaa600640 1 -- 172.21.15.144:0/4202664611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 msgr2=0x7fbc88003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7fbcaa600640 1 --2- 172.21.15.144:0/4202664611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 0x7fbc88003de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400c510 tx=0x7fbc9401f530 comp rx=0 tx=0).stop 2024-09-12T12:13:10.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7fbca9c00640 1 -- 172.21.15.144:0/4202664611 reap_dead start 2024-09-12T12:13:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7f9005a00640 1 --2- 172.21.15.144:0/2400972203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9000072e90 0x7f900006e2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009e50 tx=0x7f8ff801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fb9cb1fbea886a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7fbcaa600640 1 -- 172.21.15.144:0/4202664611 shutdown_connections 2024-09-12T12:13:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7fbcaa600640 1 -- 172.21.15.144:0/4202664611 >> 172.21.15.144:0/4202664611 conn(0x7fbca406bc10 msgr2=0x7fbca406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7fbcaa600640 1 -- 172.21.15.144:0/4202664611 shutdown_connections 2024-09-12T12:13:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c007c90 con 0x7f6c14004810 2024-09-12T12:13:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c1c006a00 con 0x7f6c14004810 2024-09-12T12:13:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7f6c2d600640 1 -- 172.21.15.144:0/1131588500 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c006e30 con 0x7f6c14004810 2024-09-12T12:13:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7f8fff400640 1 -- 172.21.15.144:0/2400972203 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80a55e0 con 0x7f9000072e90 2024-09-12T12:13:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7f8fff400640 1 -- 172.21.15.144:0/2400972203 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff80a5780 con 0x7f9000072e90 2024-09-12T12:13:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7f8fff400640 1 -- 172.21.15.144:0/2400972203 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80a55e0 con 0x7f9000072e90 2024-09-12T12:13:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7fbcaa600640 1 -- 172.21.15.144:0/4202664611 wait complete. 2024-09-12T12:13:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.373+0000 7f6c2fe00640 1 -- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 msgr2=0x7f6c14004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f6c2fe00640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c14004c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00c1b0 tx=0x7f6c1c01f330 comp rx=0 tx=0).stop 2024-09-12T12:13:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f9006400640 1 -- 172.21.15.144:0/2400972203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9000072e90 msgr2=0x7f900006e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f9006400640 1 --2- 172.21.15.144:0/2400972203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9000072e90 0x7f900006e2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009e50 tx=0x7f8ff801c960 comp rx=0 tx=0).stop 2024-09-12T12:13:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f6c2fe00640 1 -- 172.21.15.144:0/1131588500 shutdown_connections 2024-09-12T12:13:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f6c2fe00640 1 --2- 172.21.15.144:0/1131588500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c14004c90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f6c2fe00640 1 -- 172.21.15.144:0/1131588500 >> 172.21.15.144:0/1131588500 conn(0x7f6c3006bc10 msgr2=0x7f6c3006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f9006400640 1 -- 172.21.15.144:0/2400972203 shutdown_connections 2024-09-12T12:13:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f9006400640 1 --2- 172.21.15.144:0/2400972203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9000072e90 0x7f900006e2b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f4421000640 1 --2- 172.21.15.144:0/1523341919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c0d1000 0x7f441c0afe70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44040098a0 tx=0x7f440401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6c96e5a69c776 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f6c2fe00640 1 -- 172.21.15.144:0/1131588500 shutdown_connections 2024-09-12T12:13:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f9006400640 1 --2- 172.21.15.144:0/2400972203 >> v2:172.21.15.165:3300/0 conn(0x7f9000162900 0x7f90000cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f9006400640 1 -- 172.21.15.144:0/2400972203 >> 172.21.15.144:0/2400972203 conn(0x7f90000b2860 msgr2=0x7f90000b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f6c2fe00640 1 -- 172.21.15.144:0/1131588500 wait complete. 2024-09-12T12:13:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f9006400640 1 -- 172.21.15.144:0/2400972203 shutdown_connections 2024-09-12T12:13:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f441b400640 1 -- 172.21.15.144:0/1523341919 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44040b5070 con 0x7f441c0d1000 2024-09-12T12:13:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f441b400640 1 -- 172.21.15.144:0/1523341919 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44040a8a30 con 0x7f441c0d1000 2024-09-12T12:13:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f441b400640 1 -- 172.21.15.144:0/1523341919 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44040a8e00 con 0x7f441c0d1000 2024-09-12T12:13:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f9006400640 1 -- 172.21.15.144:0/2400972203 wait complete. 2024-09-12T12:13:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f4423a00640 1 -- 172.21.15.144:0/1523341919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c0d1000 msgr2=0x7f441c0afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f4423a00640 1 --2- 172.21.15.144:0/1523341919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c0d1000 0x7f441c0afe70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44040098a0 tx=0x7f440401ed30 comp rx=0 tx=0).stop 2024-09-12T12:13:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f4423a00640 1 -- 172.21.15.144:0/1523341919 shutdown_connections 2024-09-12T12:13:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f4423a00640 1 --2- 172.21.15.144:0/1523341919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c0d1000 0x7f441c0afe70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f4423a00640 1 -- 172.21.15.144:0/1523341919 >> 172.21.15.144:0/1523341919 conn(0x7f441c0d04e0 msgr2=0x7f441c0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f6c2fe00640 1 Processor -- start 2024-09-12T12:13:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7fbcaa600640 1 Processor -- start 2024-09-12T12:13:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7fbcaa600640 1 -- start start 2024-09-12T12:13:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f4423a00640 1 -- 172.21.15.144:0/1523341919 shutdown_connections 2024-09-12T12:13:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9006400640 1 Processor -- start 2024-09-12T12:13:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.377+0000 7f4423a00640 1 -- 172.21.15.144:0/1523341919 wait complete. 2024-09-12T12:13:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2fe00640 1 -- start start 2024-09-12T12:13:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbcaa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 0x7fbca40afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9006400640 1 -- start start 2024-09-12T12:13:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9006400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f900006de40 0x7f900013f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9006400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9000072e90 0x7f9000154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9006400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9000162900 0x7f900013f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9006400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f900016f5c0 con 0x7f9000072e90 2024-09-12T12:13:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9006400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f900016f440 con 0x7f9000162900 2024-09-12T12:13:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9006400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f900016f740 con 0x7f900006de40 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c3013d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c30159680 0x7f6c30159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c30156ed0 0x7f6c30157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3015a950 con 0x7f6c30156ed0 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3015aad0 con 0x7f6c14004810 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3015ac50 con 0x7f6c30159680 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2ea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c3013d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2ea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c3013d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44236/0 (socket says 172.21.15.144:44236) 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2ea00640 1 -- 172.21.15.144:0/3438255389 learned_addr learned my addr 172.21.15.144:0/3438255389 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f4423a00640 1 Processor -- start 2024-09-12T12:13:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9005a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9000162900 0x7f900013f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f8fffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9000072e90 0x7f9000154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9005000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f900006de40 0x7f900013f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2f400640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c30156ed0 0x7f6c30157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f6c2e000640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c30159680 0x7f6c30159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbcaa600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbca413ad60 0x7fbca41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbcaa600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbca4139ae0 0x7fbca41452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbcaa600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4154df0 con 0x7fbc880039c0 2024-09-12T12:13:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbcaa600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4154c70 con 0x7fbca413ad60 2024-09-12T12:13:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbcaa600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbca40cd9a0 con 0x7fbca4139ae0 2024-09-12T12:13:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbca3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbca413ad60 0x7fbca41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f4423a00640 1 -- start start 2024-09-12T12:13:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbca3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbca413ad60 0x7fbca41395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44254/0 (socket says 172.21.15.144:44254) 2024-09-12T12:13:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbca3e00640 1 -- 172.21.15.144:0/2250741129 learned_addr learned my addr 172.21.15.144:0/2250741129 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbca9c00640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbca4139ae0 0x7fbca41452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7fbca9200640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 0x7fbca40afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbca3e00640 1 -- 172.21.15.144:0/2250741129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbca4139ae0 msgr2=0x7fbca41452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbca3e00640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbca4139ae0 0x7fbca41452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbca3e00640 1 -- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 msgr2=0x7fbca40afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbca3e00640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 0x7fbca40afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbca3e00640 1 -- 172.21.15.144:0/2250741129 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca413a150 con 0x7fbca413ad60 2024-09-12T12:13:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2ea00640 1 -- 172.21.15.144:0/3438255389 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c30159680 msgr2=0x7f6c30159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2ea00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c30159680 0x7f6c30159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2ea00640 1 -- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c30156ed0 msgr2=0x7f6c30157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2ea00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c30156ed0 0x7f6c30157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2ea00640 1 -- 172.21.15.144:0/3438255389 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3013e2e0 con 0x7f6c14004810 2024-09-12T12:13:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2e000640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c30159680 0x7f6c30159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbca3e00640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbca413ad60 0x7fbca41395a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000c5f0 tx=0x7fbc9000cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbca0c00640 1 -- 172.21.15.144:0/2250741129 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc90015070 con 0x7fbca413ad60 2024-09-12T12:13:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2ea00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c3013d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c20011cd0 tx=0x7f6c2000f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbca0c00640 1 -- 172.21.15.144:0/2250741129 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc90011800 con 0x7fbca413ad60 2024-09-12T12:13:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbca0c00640 1 -- 172.21.15.144:0/2250741129 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc90011bd0 con 0x7fbca413ad60 2024-09-12T12:13:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4423a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c071860 0x7f441c1f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4423a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441c071c80 0x7f441c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4423a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f441c0d1000 0x7f441c146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4423a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f441c0b12e0 con 0x7f441c071c80 2024-09-12T12:13:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4423a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f441c0b3100 con 0x7f441c0d1000 2024-09-12T12:13:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4423a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f441c0b1460 con 0x7f441c071860 2024-09-12T12:13:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2f400640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c30156ed0 0x7f6c30157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4421a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f441c0d1000 0x7f441c146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4421a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f441c0d1000 0x7f441c146a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44266/0 (socket says 172.21.15.144:44266) 2024-09-12T12:13:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4421a00640 1 -- 172.21.15.144:0/775329934 learned_addr learned my addr 172.21.15.144:0/775329934 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f441be00640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441c071c80 0x7f441c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c26a00640 1 -- 172.21.15.144:0/3438255389 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20011e80 con 0x7f6c14004810 2024-09-12T12:13:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3013e5c0 con 0x7f6c14004810 2024-09-12T12:13:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3013eb80 con 0x7f6c14004810 2024-09-12T12:13:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbcaa600640 1 -- 172.21.15.144:0/2250741129 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca413a430 con 0x7fbca413ad60 2024-09-12T12:13:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7fbcaa600640 1 -- 172.21.15.144:0/2250741129 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca4155000 con 0x7fbca413ad60 2024-09-12T12:13:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4421a00640 1 -- 172.21.15.144:0/775329934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c071860 msgr2=0x7f441c1f2e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:13:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4421a00640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c071860 0x7f441c1f2e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4421a00640 1 -- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441c071c80 msgr2=0x7f441c0b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4421a00640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441c071c80 0x7f441c0b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4421a00640 1 -- 172.21.15.144:0/775329934 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441c0b4530 con 0x7f441c0d1000 2024-09-12T12:13:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4421a00640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f441c0d1000 0x7f441c146a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f440c001700 tx=0x7f440c001bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f6c26a00640 1 -- 172.21.15.144:0/3438255389 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c20014440 con 0x7f6c14004810 2024-09-12T12:13:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4418c00640 1 -- 172.21.15.144:0/775329934 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c005480 con 0x7f441c0d1000 2024-09-12T12:13:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4418c00640 1 -- 172.21.15.144:0/775329934 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440c00a640 con 0x7f441c0d1000 2024-09-12T12:13:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4418c00640 1 -- 172.21.15.144:0/775329934 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c00aa90 con 0x7f441c0d1000 2024-09-12T12:13:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4423a00640 1 -- 172.21.15.144:0/775329934 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441c0b4810 con 0x7f441c0d1000 2024-09-12T12:13:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f4423a00640 1 -- 172.21.15.144:0/775329934 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f441c0b4dd0 con 0x7f441c0d1000 2024-09-12T12:13:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9005000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f900006de40 0x7f900013f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34406/0 (socket says 172.21.15.144:34406) 2024-09-12T12:13:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9005000640 1 -- 172.21.15.144:0/1492616873 learned_addr learned my addr 172.21.15.144:0/1492616873 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.385+0000 7f9005000640 1 -- 172.21.15.144:0/1492616873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9000162900 msgr2=0x7f900013f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.381+0000 7f9005a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9000162900 0x7f900013f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44250/0 (socket says 172.21.15.144:44250) 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f9005000640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9000162900 0x7f900013f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f9005000640 1 -- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9000072e90 msgr2=0x7f9000154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f9005000640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9000072e90 0x7f9000154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f9005000640 1 -- 172.21.15.144:0/1492616873 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90001563d0 con 0x7f900006de40 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f9005000640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f900006de40 0x7f900013f050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400d5f0 tx=0x7f8ff400dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f8ffcc00640 1 -- 172.21.15.144:0/1492616873 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40125f0 con 0x7f900006de40 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f8ffcc00640 1 -- 172.21.15.144:0/1492616873 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4019070 con 0x7f900006de40 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f8ffcc00640 1 -- 172.21.15.144:0/1492616873 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40129d0 con 0x7f900006de40 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f9005a00640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9000162900 0x7f900013f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f8fffe00640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9000072e90 0x7f9000154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f6c26a00640 1 -- 172.21.15.144:0/3438255389 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20011e80 con 0x7f6c14004810 2024-09-12T12:13:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f4418c00640 1 -- 172.21.15.144:0/775329934 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f440c00ac30 con 0x7f441c0d1000 2024-09-12T12:13:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.389+0000 7f4412000640 1 -- 172.21.15.144:0/775329934 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441c0afe70 con 0x7f441c0d1000 2024-09-12T12:13:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7fbc9a000640 1 -- 172.21.15.144:0/2250741129 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca4139ec0 con 0x7fbca413ad60 2024-09-12T12:13:10.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90001566b0 con 0x7f900006de40 2024-09-12T12:13:10.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9000156c70 con 0x7f900006de40 2024-09-12T12:13:10.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7f4418c00640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43f80679c0 0x7f43f8069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7fbca0c00640 1 -- 172.21.15.144:0/2250741129 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc90018070 con 0x7fbca413ad60 2024-09-12T12:13:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c080052a0 con 0x7f6c14004810 2024-09-12T12:13:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7f4418c00640 1 -- 172.21.15.144:0/775329934 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f440c085db0 con 0x7f441c0d1000 2024-09-12T12:13:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7f4421000640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43f80679c0 0x7f43f8069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f900006e2b0 con 0x7f900006de40 2024-09-12T12:13:10.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7fbca0c00640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc840678c0 0x7fbc84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7fbca0c00640 1 -- 172.21.15.144:0/2250741129 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbc90085ef0 con 0x7fbca413ad60 2024-09-12T12:13:10.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7f4421000640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43f80679c0 0x7f43f8069e80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f44040b2000 tx=0x7f44040aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.393+0000 7f6c26a00640 1 -- 172.21.15.144:0/3438255389 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c20012040 con 0x7f6c14004810 2024-09-12T12:13:10.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7fbca9200640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc840678c0 0x7fbc84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7f8ffcc00640 1 -- 172.21.15.144:0/1492616873 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ff4012b70 con 0x7f900006de40 2024-09-12T12:13:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7f6c26a00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c10067ac0 0x7f6c10069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7f6c2e000640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c10067ac0 0x7f6c10069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7f6c26a00640 1 -- 172.21.15.144:0/3438255389 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6c20086520 con 0x7f6c14004810 2024-09-12T12:13:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7f6c2e000640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c10067ac0 0x7f6c10069f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0b0000 tx=0x7f6c1c0aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7fbca9200640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc840678c0 0x7fbc84069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc940ae000 tx=0x7fbc94001ac0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7f8ffcc00640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8fe4067910 0x7f8fe4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7f8ffcc00640 1 -- 172.21.15.144:0/1492616873 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8ff4086d60 con 0x7f900006de40 2024-09-12T12:13:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7f8fffe00640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8fe4067910 0x7f8fe4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.397+0000 7f8fffe00640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8fe4067910 0x7f8fe4069dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90001ff150 tx=0x7f8ff0007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.401+0000 7f4418c00640 1 -- 172.21.15.144:0/775329934 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f440c01e030 con 0x7f441c0d1000 2024-09-12T12:13:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.405+0000 7f8ffcc00640 1 -- 172.21.15.144:0/1492616873 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8ff4057640 con 0x7f900006de40 2024-09-12T12:13:10.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.405+0000 7fbca0c00640 1 -- 172.21.15.144:0/2250741129 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbc90056000 con 0x7fbca413ad60 2024-09-12T12:13:10.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.413+0000 7f6c26a00640 1 -- 172.21.15.144:0/3438255389 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c20019030 con 0x7f6c14004810 2024-09-12T12:13:10.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9977200640 1 Processor -- start 2024-09-12T12:13:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9977200640 1 -- start start 2024-09-12T12:13:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9977200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9978148c70 0x7f99780cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9977200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cd820 0x7f99780ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9977200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f99780cec10 0x7f9978166350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9977200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9978071ba0 con 0x7f9978148c70 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9977200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f99780cdda0 con 0x7f99780cec10 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9977200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f99780ce080 con 0x7f99780cd820 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9975e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9978148c70 0x7f99780cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9976800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f99780cec10 0x7f9978166350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9976800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f99780cec10 0x7f9978166350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44276/0 (socket says 172.21.15.144:44276) 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.421+0000 7f9976800640 1 -- 172.21.15.144:0/679217442 learned_addr learned my addr 172.21.15.144:0/679217442 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.425+0000 7f9975400640 1 --2- 172.21.15.144:0/679217442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cd820 0x7f99780ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.425+0000 7f9976800640 1 -- 172.21.15.144:0/679217442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cd820 msgr2=0x7f99780ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.425+0000 7f9976800640 1 --2- 172.21.15.144:0/679217442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cd820 0x7f99780ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.425+0000 7f9976800640 1 -- 172.21.15.144:0/679217442 >> v2:172.21.15.144:3300/0 conn(0x7f9978148c70 msgr2=0x7f99780cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.425+0000 7f9976800640 1 --2- 172.21.15.144:0/679217442 >> v2:172.21.15.144:3300/0 conn(0x7f9978148c70 0x7f99780cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.425+0000 7f9976800640 1 -- 172.21.15.144:0/679217442 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9978071830 con 0x7f99780cec10 2024-09-12T12:13:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.425+0000 7f9975e00640 1 --2- 172.21.15.144:0/679217442 >> v2:172.21.15.144:3300/0 conn(0x7f9978148c70 0x7f99780cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:10.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.429+0000 7f9976800640 1 --2- 172.21.15.144:0/679217442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99780cec10 0x7f9978166350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f997814c540 tx=0x7f997001f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d77e045dc97635 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.433+0000 7f9974a00640 1 -- 172.21.15.144:0/679217442 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99700b4070 con 0x7f99780cec10 2024-09-12T12:13:10.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.433+0000 7f9974a00640 1 -- 172.21.15.144:0/679217442 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99700af400 con 0x7f99780cec10 2024-09-12T12:13:10.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.433+0000 7f9974a00640 1 -- 172.21.15.144:0/679217442 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99700af7d0 con 0x7f99780cec10 2024-09-12T12:13:10.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.437+0000 7f9977200640 1 -- 172.21.15.144:0/679217442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99780cec10 msgr2=0x7f9978166350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.437+0000 7f9977200640 1 --2- 172.21.15.144:0/679217442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99780cec10 0x7f9978166350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f997814c540 tx=0x7f997001f1e0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.437+0000 7f9977200640 1 -- 172.21.15.144:0/679217442 shutdown_connections 2024-09-12T12:13:10.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.437+0000 7f9977200640 1 --2- 172.21.15.144:0/679217442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99780cec10 0x7f9978166350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.437+0000 7f9977200640 1 --2- 172.21.15.144:0/679217442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cd820 0x7f99780ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.437+0000 7f9977200640 1 --2- 172.21.15.144:0/679217442 >> v2:172.21.15.144:3300/0 conn(0x7f9978148c70 0x7f99780cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.437+0000 7f9977200640 1 -- 172.21.15.144:0/679217442 >> 172.21.15.144:0/679217442 conn(0x7f99780b0660 msgr2=0x7f99780b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.437+0000 7f9977200640 1 -- 172.21.15.144:0/679217442 shutdown_connections 2024-09-12T12:13:10.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.441+0000 7f9977200640 1 -- 172.21.15.144:0/679217442 wait complete. 2024-09-12T12:13:10.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.441+0000 7f9977200640 1 Processor -- start 2024-09-12T12:13:10.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.441+0000 7f9977200640 1 -- start start 2024-09-12T12:13:10.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9977200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99780cd820 0x7f9978167e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9977200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cec10 0x7f9978137c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9977200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9978148c70 0x7f997813a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9977200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9978166890 con 0x7f99780cd820 2024-09-12T12:13:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9975e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99780cd820 0x7f9978167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9975e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99780cd820 0x7f9978167e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51114/0 (socket says 172.21.15.144:51114) 2024-09-12T12:13:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9975e00640 1 -- 172.21.15.144:0/2796986639 learned_addr learned my addr 172.21.15.144:0/2796986639 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9976800640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9978148c70 0x7f997813a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9975400640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cec10 0x7f9978137c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9978067c20 con 0x7f9978148c70 2024-09-12T12:13:10.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9978166a10 con 0x7f99780cec10 2024-09-12T12:13:10.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9976800640 1 -- 172.21.15.144:0/2796986639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cec10 msgr2=0x7f9978137c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9976800640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cec10 0x7f9978137c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9976800640 1 -- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99780cd820 msgr2=0x7f9978167e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9976800640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99780cd820 0x7f9978167e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9976800640 1 -- 172.21.15.144:0/2796986639 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997806bdb0 con 0x7f9978148c70 2024-09-12T12:13:10.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9975e00640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99780cd820 0x7f9978167e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:10.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.445+0000 7f9976800640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9978148c70 0x7f997813a2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99700ae000 tx=0x7f997001bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.449+0000 7f996e000640 1 -- 172.21.15.144:0/2796986639 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99700c0020 con 0x7f9978148c70 2024-09-12T12:13:10.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.449+0000 7f996e000640 1 -- 172.21.15.144:0/2796986639 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99700afb50 con 0x7f9978148c70 2024-09-12T12:13:10.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.449+0000 7f996e000640 1 -- 172.21.15.144:0/2796986639 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99700b4040 con 0x7f9978148c70 2024-09-12T12:13:10.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.449+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997806c090 con 0x7f9978148c70 2024-09-12T12:13:10.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.449+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f997806c650 con 0x7f9978148c70 2024-09-12T12:13:10.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.453+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9978166350 con 0x7f9978148c70 2024-09-12T12:13:10.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.457+0000 7f996e000640 1 -- 172.21.15.144:0/2796986639 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99700ba470 con 0x7f9978148c70 2024-09-12T12:13:10.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.461+0000 7f996e000640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f99540678c0 0x7f9954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.461+0000 7f996e000640 1 -- 172.21.15.144:0/2796986639 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9970002020 con 0x7f9978148c70 2024-09-12T12:13:10.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.461+0000 7f996e000640 1 -- 172.21.15.144:0/2796986639 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9970018d40 con 0x7f9978148c70 2024-09-12T12:13:10.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.465+0000 7f9975e00640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f99540678c0 0x7f9954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:10.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.465+0000 7f9975e00640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f99540678c0 0x7f9954069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9978165790 tx=0x7f9968008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:10.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.653+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd6400d0740 con 0x7fd64015a950 2024-09-12T12:13:10.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.653+0000 7fd636a00640 1 -- 172.21.15.144:0/1749328307 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd640073470 con 0x7fd64015a950 2024-09-12T12:13:10.655 INFO:teuthology.orchestra.run.smithi144.stdout:55834574857 2024-09-12T12:13:10.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8a5c0b1e50 con 0x7f8a5c0ae890 2024-09-12T12:13:10.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd620067cc0 msgr2=0x7fd62006a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd620067cc0 0x7fd62006a180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd62c009fd0 tx=0x7fd62c009a20 comp rx=0 tx=0).stop 2024-09-12T12:13:10.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64015a950 msgr2=0x7fd640204660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7f8a53400640 1 -- 172.21.15.144:0/1992091339 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a540f0700 con 0x7f8a5c0ae890 2024-09-12T12:13:10.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64015a950 0x7fd640204660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd64015b870 tx=0x7fd6380196f0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.660 INFO:teuthology.orchestra.run.smithi144.stdout:55834574858 2024-09-12T12:13:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 shutdown_connections 2024-09-12T12:13:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd620067cc0 0x7fd62006a180 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64015a950 0x7fd640204660 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6400cd540 0x7fd640204120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 --2- 172.21.15.144:0/1749328307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64006cd20 0x7fd640070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.657+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 >> 172.21.15.144:0/1749328307 conn(0x7fd64006bc10 msgr2=0x7fd640075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.661+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 shutdown_connections 2024-09-12T12:13:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.661+0000 7fd644a00640 1 -- 172.21.15.144:0/1749328307 wait complete. 2024-09-12T12:13:10.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a3c067990 msgr2=0x7f8a3c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a3c067990 0x7f8a3c069e50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c007fd0 tx=0x7f8a4c009040 comp rx=0 tx=0).stop 2024-09-12T12:13:10.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a5c0ae890 msgr2=0x7f8a5c155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a5c0ae890 0x7f8a5c155f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a540ae040 tx=0x7f8a540191e0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 shutdown_connections 2024-09-12T12:13:10.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a3c067990 0x7f8a3c069e50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a5c15e320 0x7f8a5c158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a5c0cebd0 0x7f8a5c1586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 --2- 172.21.15.144:0/1992091339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a5c0ae890 0x7f8a5c155f00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.665+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 >> 172.21.15.144:0/1992091339 conn(0x7f8a5c06bc10 msgr2=0x7f8a5c0b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.669+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 shutdown_connections 2024-09-12T12:13:10.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.669+0000 7f8a61000640 1 -- 172.21.15.144:0/1992091339 wait complete. 2024-09-12T12:13:10.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-09-12T12:13:10.699 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:10.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.701+0000 7f4412000640 1 -- 172.21.15.144:0/775329934 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f441c06f580 con 0x7f441c0d1000 2024-09-12T12:13:10.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.701+0000 7f4418c00640 1 -- 172.21.15.144:0/775329934 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f440c056590 con 0x7f441c0d1000 2024-09-12T12:13:10.703 INFO:teuthology.orchestra.run.smithi144.stdout:55834574856 2024-09-12T12:13:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 -- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43f80679c0 msgr2=0x7f43f8069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43f80679c0 0x7f43f8069e80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f44040b2000 tx=0x7f44040aa070 comp rx=0 tx=0).stop 2024-09-12T12:13:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 -- 172.21.15.144:0/775329934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f441c0d1000 msgr2=0x7f441c146a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f441c0d1000 0x7f441c146a90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f440c001700 tx=0x7f440c001bc0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 -- 172.21.15.144:0/775329934 shutdown_connections 2024-09-12T12:13:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43f80679c0 0x7f43f8069e80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f441c0d1000 0x7f441c146a90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f441c071c80 0x7f441c0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 --2- 172.21.15.144:0/775329934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f441c071860 0x7f441c1f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 -- 172.21.15.144:0/775329934 >> 172.21.15.144:0/775329934 conn(0x7f441c0d04e0 msgr2=0x7f441c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 -- 172.21.15.144:0/775329934 shutdown_connections 2024-09-12T12:13:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4412000640 1 -- 172.21.15.144:0/775329934 wait complete. 2024-09-12T12:13:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.705+0000 7f4ddea00640 1 -- 172.21.15.144:0/3788073537 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4dc8005860 con 0x7f4dec0ae890 2024-09-12T12:13:10.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.713+0000 7f4de9600640 1 -- 172.21.15.144:0/3788073537 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4de005a2d0 con 0x7f4dec0ae890 2024-09-12T12:13:10.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-09-12T12:13:10.715 INFO:teuthology.orchestra.run.smithi144.stdout:55834574859 2024-09-12T12:13:10.715 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:10.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 -- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dcc067cc0 msgr2=0x7f4dcc06a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dcc067cc0 0x7f4dcc06a180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80af000 tx=0x7f4dd80a7000 comp rx=0 tx=0).stop 2024-09-12T12:13:10.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 -- 172.21.15.144:0/3788073537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dec0ae890 msgr2=0x7f4dec14db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dec0ae890 0x7f4dec14db40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4de000e930 tx=0x7f4de000edf0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 -- 172.21.15.144:0/3788073537 shutdown_connections 2024-09-12T12:13:10.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dcc067cc0 0x7f4dcc06a180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dec15e320 0x7f4dec0aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dec0cebd0 0x7f4dec071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 --2- 172.21.15.144:0/3788073537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dec0ae890 0x7f4dec14db40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 -- 172.21.15.144:0/3788073537 >> 172.21.15.144:0/3788073537 conn(0x7f4dec06bc10 msgr2=0x7f4dec158410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 -- 172.21.15.144:0/3788073537 shutdown_connections 2024-09-12T12:13:10.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.717+0000 7f4ddea00640 1 -- 172.21.15.144:0/3788073537 wait complete. 2024-09-12T12:13:10.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.737+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6c08005860 con 0x7f6c14004810 2024-09-12T12:13:10.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.737+0000 7f6c26a00640 1 -- 172.21.15.144:0/3438255389 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c20056ca0 con 0x7f6c14004810 2024-09-12T12:13:10.740 INFO:teuthology.orchestra.run.smithi144.stdout:55834574857 2024-09-12T12:13:10.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-09-12T12:13:10.742 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c10067ac0 msgr2=0x7f6c10069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c10067ac0 0x7f6c10069f80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0b0000 tx=0x7f6c1c0aa000 comp rx=0 tx=0).stop 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 msgr2=0x7f6c3013d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c3013d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c20011cd0 tx=0x7f6c2000f610 comp rx=0 tx=0).stop 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 shutdown_connections 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c10067ac0 0x7f6c10069f80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c30156ed0 0x7f6c30157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c30159680 0x7f6c30159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 --2- 172.21.15.144:0/3438255389 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c14004810 0x7f6c3013d990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 >> 172.21.15.144:0/3438255389 conn(0x7f6c3006bc10 msgr2=0x7f6c300cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 shutdown_connections 2024-09-12T12:13:10.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.741+0000 7f6c2fe00640 1 -- 172.21.15.144:0/3438255389 wait complete. 2024-09-12T12:13:10.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-09-12T12:13:10.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f90000d00a0 con 0x7f900006de40 2024-09-12T12:13:10.750 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:10.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f8ffcc00640 1 -- 172.21.15.144:0/1492616873 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ff4056f40 con 0x7f900006de40 2024-09-12T12:13:10.751 INFO:teuthology.orchestra.run.smithi144.stdout:55834574859 2024-09-12T12:13:10.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8fe4067910 msgr2=0x7f8fe4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8fe4067910 0x7f8fe4069dd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f90001ff150 tx=0x7f8ff0007e40 comp rx=0 tx=0).stop 2024-09-12T12:13:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f900006de40 msgr2=0x7f900013f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f900006de40 0x7f900013f050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400d5f0 tx=0x7f8ff400dab0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 shutdown_connections 2024-09-12T12:13:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8fe4067910 0x7f8fe4069dd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9000162900 0x7f900013f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9000072e90 0x7f9000154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 --2- 172.21.15.144:0/1492616873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f900006de40 0x7f900013f050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 >> 172.21.15.144:0/1492616873 conn(0x7f90000b2860 msgr2=0x7f9000165500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.749+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 shutdown_connections 2024-09-12T12:13:10.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.753+0000 7f9006400640 1 -- 172.21.15.144:0/1492616873 wait complete. 2024-09-12T12:13:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.769+0000 7fbc9a000640 1 -- 172.21.15.144:0/2250741129 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbca40cdd30 con 0x7fbca413ad60 2024-09-12T12:13:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.769+0000 7fbca0c00640 1 -- 172.21.15.144:0/2250741129 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbc9005a300 con 0x7fbca413ad60 2024-09-12T12:13:10.772 INFO:teuthology.orchestra.run.smithi144.stdout:55834574858 2024-09-12T12:13:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 -- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc840678c0 msgr2=0x7fbc84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc840678c0 0x7fbc84069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc940ae000 tx=0x7fbc94001ac0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 -- 172.21.15.144:0/2250741129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbca413ad60 msgr2=0x7fbca41395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbca413ad60 0x7fbca41395a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000c5f0 tx=0x7fbc9000cab0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 -- 172.21.15.144:0/2250741129 shutdown_connections 2024-09-12T12:13:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc840678c0 0x7fbc84069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbca4139ae0 0x7fbca41452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbca413ad60 0x7fbca41395a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 --2- 172.21.15.144:0/2250741129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc880039c0 0x7fbca40afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 -- 172.21.15.144:0/2250741129 >> 172.21.15.144:0/2250741129 conn(0x7fbca406bc10 msgr2=0x7fbca415a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 -- 172.21.15.144:0/2250741129 shutdown_connections 2024-09-12T12:13:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.773+0000 7fbc9a000640 1 -- 172.21.15.144:0/2250741129 wait complete. 2024-09-12T12:13:10.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-09-12T12:13:10.777 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:10.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-09-12T12:13:10.778 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.785+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9978165800 con 0x7f9978148c70 2024-09-12T12:13:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.785+0000 7f996e000640 1 -- 172.21.15.144:0/2796986639 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99700f47b0 con 0x7f9978148c70 2024-09-12T12:13:10.786 INFO:teuthology.orchestra.run.smithi144.stdout:55834574857 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f99540678c0 msgr2=0x7f9954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f99540678c0 0x7f9954069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9978165790 tx=0x7f9968008040 comp rx=0 tx=0).stop 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9978148c70 msgr2=0x7f997813a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9978148c70 0x7f997813a2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99700ae000 tx=0x7f997001bf80 comp rx=0 tx=0).stop 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 shutdown_connections 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f99540678c0 0x7f9954069d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9978148c70 0x7f997813a2c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99780cec10 0x7f9978137c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 --2- 172.21.15.144:0/2796986639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99780cd820 0x7f9978167e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 >> 172.21.15.144:0/2796986639 conn(0x7f99780b0660 msgr2=0x7f99780b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 shutdown_connections 2024-09-12T12:13:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.789+0000 7f9977200640 1 -- 172.21.15.144:0/2796986639 wait complete. 2024-09-12T12:13:10.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-09-12T12:13:10.800 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:10.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-09-12T12:13:10.810 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:10.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:13:10.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:13:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d2d800640 1 Processor -- start 2024-09-12T12:13:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d2d800640 1 -- start start 2024-09-12T12:13:10.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d2d800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8d2815c220 0x7f8d280d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d2d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d280b4200 0x7f8d280b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:10.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d2d800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d280d1580 con 0x7f8d280732c0 2024-09-12T12:13:10.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d2d800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8d280b4bb0 con 0x7f8d2815c220 2024-09-12T12:13:10.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d2d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8d280d1860 con 0x7f8d280b4200 2024-09-12T12:13:10.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d27400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8d280732c0 0x7f8d28073710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37364/0 (socket says 172.21.15.144:37364) 2024-09-12T12:13:10.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d27400640 1 -- 172.21.15.144:0/2551612900 learned_addr learned my addr 172.21.15.144:0/2551612900 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:10.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d26a00640 1 --2- 172.21.15.144:0/2551612900 >> v2:172.21.15.165:3300/0 conn(0x7f8d2815c220 0x7f8d280d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.993+0000 7f8d1fe00640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d280b4200 0x7f8d280b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2240422195 0 0) 0x7f8d280d1580 con 0x7f8d280732c0 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d0c003530 con 0x7f8d280732c0 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1423886145 0 0) 0x7f8d0c003530 con 0x7f8d280732c0 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d280b4200 msgr2=0x7f8d280b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d280b4200 0x7f8d280b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 >> v2:172.21.15.165:3300/0 conn(0x7f8d2815c220 msgr2=0x7f8d280d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 --2- 172.21.15.144:0/2551612900 >> v2:172.21.15.165:3300/0 conn(0x7f8d2815c220 0x7f8d280d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d280d1b40 con 0x7f8d280732c0 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f8d20001a00 con 0x7f8d280732c0 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 >> v1:172.21.15.144:6789/0 conn(0x7f8d280732c0 legacy=0x7f8d28073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0039c0 0x7f8d0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d280b4200 0x7f8d0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0c004d50 0x7f8d0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280b4bb0 con 0x7f8d0c0039c0 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280d1860 con 0x7f8d0c004d50 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0c00b9d0 con 0x7f8d280b4200 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26a00640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0039c0 0x7f8d0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d1fe00640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d280b4200 0x7f8d0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d27400640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0c004d50 0x7f8d0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26a00640 1 -- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d280b4200 msgr2=0x7f8d0c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26a00640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d280b4200 0x7f8d0c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26a00640 1 -- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0c004d50 msgr2=0x7f8d0c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26a00640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0c004d50 0x7f8d0c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:10.997+0000 7f8d26a00640 1 -- 172.21.15.144:0/2551612900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0c003530 con 0x7f8d0c0039c0 2024-09-12T12:13:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d26a00640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0039c0 0x7f8d0c003de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009b10 tx=0x7f8d1801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb63c75f59e0e139 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d180b2070 con 0x7f8d0c0039c0 2024-09-12T12:13:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d180a5530 con 0x7f8d0c0039c0 2024-09-12T12:13:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d26000640 1 -- 172.21.15.144:0/2551612900 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d180096b0 con 0x7f8d0c0039c0 2024-09-12T12:13:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 -- 172.21.15.144:0/2551612900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0039c0 msgr2=0x7f8d0c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 --2- 172.21.15.144:0/2551612900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0039c0 0x7f8d0c003de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009b10 tx=0x7f8d1801ca80 comp rx=0 tx=0).stop 2024-09-12T12:13:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d27400640 1 -- 172.21.15.144:0/2551612900 reap_dead start 2024-09-12T12:13:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 -- 172.21.15.144:0/2551612900 shutdown_connections 2024-09-12T12:13:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 -- 172.21.15.144:0/2551612900 >> 172.21.15.144:0/2551612900 conn(0x7f8d2806f400 msgr2=0x7f8d2806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 -- 172.21.15.144:0/2551612900 shutdown_connections 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 -- 172.21.15.144:0/2551612900 wait complete. 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 Processor -- start 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 -- start start 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0c0039c0 0x7f8d28147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d2815dd70 0x7f8d2815e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d28158b00 0x7f8d28158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280d12d0 con 0x7f8d28158b00 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280d1150 con 0x7f8d2815dd70 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.001+0000 7f8d2d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8d28070bf0 con 0x7f8d0c0039c0 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d27400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d28158b00 0x7f8d28158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d27400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d28158b00 0x7f8d28158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51146/0 (socket says 172.21.15.144:51146) 2024-09-12T12:13:11.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d27400640 1 -- 172.21.15.144:0/284038749 learned_addr learned my addr 172.21.15.144:0/284038749 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d26a00640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0c0039c0 0x7f8d28147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d1fe00640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d2815dd70 0x7f8d2815e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d27400640 1 -- 172.21.15.144:0/284038749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0c0039c0 msgr2=0x7f8d28147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d27400640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0c0039c0 0x7f8d28147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d27400640 1 -- 172.21.15.144:0/284038749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d2815dd70 msgr2=0x7f8d2815e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d27400640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d2815dd70 0x7f8d2815e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d27400640 1 -- 172.21.15.144:0/284038749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d281544f0 con 0x7f8d28158b00 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d27400640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d28158b00 0x7f8d28158f80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8d20001340 tx=0x7f8d2000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d1ea00640 1 -- 172.21.15.144:0/284038749 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2000ebb0 con 0x7f8d28158b00 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d1ea00640 1 -- 172.21.15.144:0/284038749 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d20018070 con 0x7f8d28158b00 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d1ea00640 1 -- 172.21.15.144:0/284038749 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20013420 con 0x7f8d28158b00 2024-09-12T12:13:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d28160e00 con 0x7f8d28158b00 2024-09-12T12:13:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d281613c0 con 0x7f8d28158b00 2024-09-12T12:13:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d280d0c10 con 0x7f8d28158b00 2024-09-12T12:13:11.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d1ea00640 1 -- 172.21.15.144:0/284038749 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d200135c0 con 0x7f8d28158b00 2024-09-12T12:13:11.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d1ea00640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d040678f0 0x7f8d04069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.005+0000 7f8d1ea00640 1 -- 172.21.15.144:0/284038749 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8d200860c0 con 0x7f8d28158b00 2024-09-12T12:13:11.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.009+0000 7f8d26a00640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d040678f0 0x7f8d04069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.009+0000 7f8d26a00640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d040678f0 0x7f8d04069db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8d180af000 tx=0x7f8d180046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:11.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.013+0000 7f8d1ea00640 1 -- 172.21.15.144:0/284038749 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8d281544f0 con 0x7f8d28158b00 2024-09-12T12:13:11.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.165+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d281594c0 con 0x7f8d040678f0 2024-09-12T12:13:11.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.173+0000 7f8d1ea00640 1 -- 172.21.15.144:0/284038749 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f8d281594c0 con 0x7f8d040678f0 2024-09-12T12:13:11.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:11.182 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:13:11.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d040678f0 msgr2=0x7f8d04069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d040678f0 0x7f8d04069db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8d180af000 tx=0x7f8d180046d0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d28158b00 msgr2=0x7f8d28158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d28158b00 0x7f8d28158f80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8d20001340 tx=0x7f8d2000e530 comp rx=0 tx=0).stop 2024-09-12T12:13:11.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 shutdown_connections 2024-09-12T12:13:11.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d040678f0 0x7f8d04069db0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d28158b00 0x7f8d28158f80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d2815dd70 0x7f8d2815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 --2- 172.21.15.144:0/284038749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0c0039c0 0x7f8d28147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.177+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 >> 172.21.15.144:0/284038749 conn(0x7f8d2806f400 msgr2=0x7f8d281571e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:11.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.181+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 shutdown_connections 2024-09-12T12:13:11.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.181+0000 7f8d2d800640 1 -- 172.21.15.144:0/284038749 wait complete. 2024-09-12T12:13:11.200 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-12T12:13:09.381028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3383296,"data_stored":2029436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003102"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513364+0000","last_change":"2024-09-12T12:12:43.854827+0000","last_active":"2024-09-12T12:12:50.513364+0000","last_peered":"2024-09-12T12:12:50.513364+0000","last_clean":"2024-09-12T12:12:50.513364+0000","last_became_active":"2024-09-12T12:12:43.854234+0000","last_became_peered":"2024-09-12T12:12:43.854234+0000","last_unstale":"2024-09-12T12:12:50.513364+0000","last_undegraded":"2024-09-12T12:12:50.513364+0000","last_fullsized":"2024-09-12T12:12:50.513364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.059875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177273+0000","last_change":"2024-09-12T12:12:44.850415+0000","last_active":"2024-09-12T12:12:50.177273+0000","last_peered":"2024-09-12T12:12:50.177273+0000","last_clean":"2024-09-12T12:12:50.177273+0000","last_became_active":"2024-09-12T12:12:44.849823+0000","last_became_peered":"2024-09-12T12:12:44.849823+0000","last_unstale":"2024-09-12T12:12:50.177273+0000","last_undegraded":"2024-09-12T12:12:50.177273+0000","last_fullsized":"2024-09-12T12:12:50.177273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176576+0000","last_change":"2024-09-12T12:12:49.236999+0000","last_active":"2024-09-12T12:12:50.176576+0000","last_peered":"2024-09-12T12:12:50.176576+0000","last_clean":"2024-09-12T12:12:50.176576+0000","last_became_active":"2024-09-12T12:12:49.236615+0000","last_became_peered":"2024-09-12T12:12:49.236615+0000","last_unstale":"2024-09-12T12:12:50.176576+0000","last_undegraded":"2024-09-12T12:12:50.176576+0000","last_fullsized":"2024-09-12T12:12:50.176576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.973179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177466+0000","last_change":"2024-09-12T12:12:43.838111+0000","last_active":"2024-09-12T12:12:50.177466+0000","last_peered":"2024-09-12T12:12:50.177466+0000","last_clean":"2024-09-12T12:12:50.177466+0000","last_became_active":"2024-09-12T12:12:43.837789+0000","last_became_peered":"2024-09-12T12:12:43.837789+0000","last_unstale":"2024-09-12T12:12:50.177466+0000","last_undegraded":"2024-09-12T12:12:50.177466+0000","last_fullsized":"2024-09-12T12:12:50.177466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:35.915450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513110+0000","last_change":"2024-09-12T12:12:44.866423+0000","last_active":"2024-09-12T12:12:50.513110+0000","last_peered":"2024-09-12T12:12:50.513110+0000","last_clean":"2024-09-12T12:12:50.513110+0000","last_became_active":"2024-09-12T12:12:44.866168+0000","last_became_peered":"2024-09-12T12:12:44.866168+0000","last_unstale":"2024-09-12T12:12:50.513110+0000","last_undegraded":"2024-09-12T12:12:50.513110+0000","last_fullsized":"2024-09-12T12:12:50.513110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177230+0000","last_change":"2024-09-12T12:12:49.204118+0000","last_active":"2024-09-12T12:12:50.177230+0000","last_peered":"2024-09-12T12:12:50.177230+0000","last_clean":"2024-09-12T12:12:50.177230+0000","last_became_active":"2024-09-12T12:12:49.203691+0000","last_became_peered":"2024-09-12T12:12:49.203691+0000","last_unstale":"2024-09-12T12:12:50.177230+0000","last_undegraded":"2024-09-12T12:12:50.177230+0000","last_fullsized":"2024-09-12T12:12:50.177230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:35.607283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517260+0000","last_change":"2024-09-12T12:12:43.858755+0000","last_active":"2024-09-12T12:12:50.517260+0000","last_peered":"2024-09-12T12:12:50.517260+0000","last_clean":"2024-09-12T12:12:50.517260+0000","last_became_active":"2024-09-12T12:12:43.858306+0000","last_became_peered":"2024-09-12T12:12:43.858306+0000","last_unstale":"2024-09-12T12:12:50.517260+0000","last_undegraded":"2024-09-12T12:12:50.517260+0000","last_fullsized":"2024-09-12T12:12:50.517260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664377+0000","last_change":"2024-09-12T12:12:44.868441+0000","last_active":"2024-09-12T12:12:50.664377+0000","last_peered":"2024-09-12T12:12:50.664377+0000","last_clean":"2024-09-12T12:12:50.664377+0000","last_became_active":"2024-09-12T12:12:44.866463+0000","last_became_peered":"2024-09-12T12:12:44.866463+0000","last_unstale":"2024-09-12T12:12:50.664377+0000","last_undegraded":"2024-09-12T12:12:50.664377+0000","last_fullsized":"2024-09-12T12:12:50.664377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177347+0000","last_change":"2024-09-12T12:12:49.196167+0000","last_active":"2024-09-12T12:12:50.177347+0000","last_peered":"2024-09-12T12:12:50.177347+0000","last_clean":"2024-09-12T12:12:50.177347+0000","last_became_active":"2024-09-12T12:12:49.195584+0000","last_became_peered":"2024-09-12T12:12:49.195584+0000","last_unstale":"2024-09-12T12:12:50.177347+0000","last_undegraded":"2024-09-12T12:12:50.177347+0000","last_fullsized":"2024-09-12T12:12:50.177347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:21.660305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516953+0000","last_change":"2024-09-12T12:12:43.858662+0000","last_active":"2024-09-12T12:12:50.516953+0000","last_peered":"2024-09-12T12:12:50.516953+0000","last_clean":"2024-09-12T12:12:50.516953+0000","last_became_active":"2024-09-12T12:12:43.858322+0000","last_became_peered":"2024-09-12T12:12:43.858322+0000","last_unstale":"2024-09-12T12:12:50.516953+0000","last_undegraded":"2024-09-12T12:12:50.516953+0000","last_fullsized":"2024-09-12T12:12:50.516953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664591+0000","last_change":"2024-09-12T12:12:44.863427+0000","last_active":"2024-09-12T12:12:50.664591+0000","last_peered":"2024-09-12T12:12:50.664591+0000","last_clean":"2024-09-12T12:12:50.664591+0000","last_became_active":"2024-09-12T12:12:44.863173+0000","last_became_peered":"2024-09-12T12:12:44.863173+0000","last_unstale":"2024-09-12T12:12:50.664591+0000","last_undegraded":"2024-09-12T12:12:50.664591+0000","last_fullsized":"2024-09-12T12:12:50.664591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:15.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177891+0000","last_change":"2024-09-12T12:12:49.196228+0000","last_active":"2024-09-12T12:12:50.177891+0000","last_peered":"2024-09-12T12:12:50.177891+0000","last_clean":"2024-09-12T12:12:50.177891+0000","last_became_active":"2024-09-12T12:12:49.195611+0000","last_became_peered":"2024-09-12T12:12:49.195611+0000","last_unstale":"2024-09-12T12:12:50.177891+0000","last_undegraded":"2024-09-12T12:12:50.177891+0000","last_fullsized":"2024-09-12T12:12:50.177891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:48.359326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177371+0000","last_change":"2024-09-12T12:12:44.846595+0000","last_active":"2024-09-12T12:12:50.177371+0000","last_peered":"2024-09-12T12:12:50.177371+0000","last_clean":"2024-09-12T12:12:50.177371+0000","last_became_active":"2024-09-12T12:12:44.846334+0000","last_became_peered":"2024-09-12T12:12:44.846334+0000","last_unstale":"2024-09-12T12:12:50.177371+0000","last_undegraded":"2024-09-12T12:12:50.177371+0000","last_fullsized":"2024-09-12T12:12:50.177371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516972+0000","last_change":"2024-09-12T12:12:43.857695+0000","last_active":"2024-09-12T12:12:50.516972+0000","last_peered":"2024-09-12T12:12:50.516972+0000","last_clean":"2024-09-12T12:12:50.516972+0000","last_became_active":"2024-09-12T12:12:43.857427+0000","last_became_peered":"2024-09-12T12:12:43.857427+0000","last_unstale":"2024-09-12T12:12:50.516972+0000","last_undegraded":"2024-09-12T12:12:50.516972+0000","last_fullsized":"2024-09-12T12:12:50.516972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:35.915450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179125+0000","last_change":"2024-09-12T12:12:49.190846+0000","last_active":"2024-09-12T12:12:50.179125+0000","last_peered":"2024-09-12T12:12:50.179125+0000","last_clean":"2024-09-12T12:12:50.179125+0000","last_became_active":"2024-09-12T12:12:49.190417+0000","last_became_peered":"2024-09-12T12:12:49.190417+0000","last_unstale":"2024-09-12T12:12:50.179125+0000","last_undegraded":"2024-09-12T12:12:50.179125+0000","last_fullsized":"2024-09-12T12:12:50.179125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176911+0000","last_change":"2024-09-12T12:12:44.866244+0000","last_active":"2024-09-12T12:12:50.176911+0000","last_peered":"2024-09-12T12:12:50.176911+0000","last_clean":"2024-09-12T12:12:50.176911+0000","last_became_active":"2024-09-12T12:12:44.862336+0000","last_became_peered":"2024-09-12T12:12:44.862336+0000","last_unstale":"2024-09-12T12:12:50.176911+0000","last_undegraded":"2024-09-12T12:12:50.176911+0000","last_fullsized":"2024-09-12T12:12:50.176911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125510+0000","last_change":"2024-09-12T12:12:43.842526+0000","last_active":"2024-09-12T12:12:51.125510+0000","last_peered":"2024-09-12T12:12:51.125510+0000","last_clean":"2024-09-12T12:12:51.125510+0000","last_became_active":"2024-09-12T12:12:43.842238+0000","last_became_peered":"2024-09-12T12:12:43.842238+0000","last_unstale":"2024-09-12T12:12:51.125510+0000","last_undegraded":"2024-09-12T12:12:51.125510+0000","last_fullsized":"2024-09-12T12:12:51.125510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178671+0000","last_change":"2024-09-12T12:12:49.204542+0000","last_active":"2024-09-12T12:12:50.178671+0000","last_peered":"2024-09-12T12:12:50.178671+0000","last_clean":"2024-09-12T12:12:50.178671+0000","last_became_active":"2024-09-12T12:12:49.204013+0000","last_became_peered":"2024-09-12T12:12:49.204013+0000","last_unstale":"2024-09-12T12:12:50.178671+0000","last_undegraded":"2024-09-12T12:12:50.178671+0000","last_fullsized":"2024-09-12T12:12:50.178671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:36.758809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176780+0000","last_change":"2024-09-12T12:12:44.861505+0000","last_active":"2024-09-12T12:12:50.176780+0000","last_peered":"2024-09-12T12:12:50.176780+0000","last_clean":"2024-09-12T12:12:50.176780+0000","last_became_active":"2024-09-12T12:12:44.861217+0000","last_became_peered":"2024-09-12T12:12:44.861217+0000","last_unstale":"2024-09-12T12:12:50.176780+0000","last_undegraded":"2024-09-12T12:12:50.176780+0000","last_fullsized":"2024-09-12T12:12:50.176780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125097+0000","last_change":"2024-09-12T12:12:43.846034+0000","last_active":"2024-09-12T12:12:51.125097+0000","last_peered":"2024-09-12T12:12:51.125097+0000","last_clean":"2024-09-12T12:12:51.125097+0000","last_became_active":"2024-09-12T12:12:43.845492+0000","last_became_peered":"2024-09-12T12:12:43.845492+0000","last_unstale":"2024-09-12T12:12:51.125097+0000","last_undegraded":"2024-09-12T12:12:51.125097+0000","last_fullsized":"2024-09-12T12:12:51.125097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125970+0000","last_change":"2024-09-12T12:12:49.238233+0000","last_active":"2024-09-12T12:12:51.125970+0000","last_peered":"2024-09-12T12:12:51.125970+0000","last_clean":"2024-09-12T12:12:51.125970+0000","last_became_active":"2024-09-12T12:12:49.237705+0000","last_became_peered":"2024-09-12T12:12:49.237705+0000","last_unstale":"2024-09-12T12:12:51.125970+0000","last_undegraded":"2024-09-12T12:12:51.125970+0000","last_fullsized":"2024-09-12T12:12:51.125970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:21.360400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177834+0000","last_change":"2024-09-12T12:12:44.854329+0000","last_active":"2024-09-12T12:12:50.177834+0000","last_peered":"2024-09-12T12:12:50.177834+0000","last_clean":"2024-09-12T12:12:50.177834+0000","last_became_active":"2024-09-12T12:12:44.854125+0000","last_became_peered":"2024-09-12T12:12:44.854125+0000","last_unstale":"2024-09-12T12:12:50.177834+0000","last_undegraded":"2024-09-12T12:12:50.177834+0000","last_fullsized":"2024-09-12T12:12:50.177834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:09.458022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516448+0000","last_change":"2024-09-12T12:12:43.853652+0000","last_active":"2024-09-12T12:12:50.516448+0000","last_peered":"2024-09-12T12:12:50.516448+0000","last_clean":"2024-09-12T12:12:50.516448+0000","last_became_active":"2024-09-12T12:12:43.853375+0000","last_became_peered":"2024-09-12T12:12:43.853375+0000","last_unstale":"2024-09-12T12:12:50.516448+0000","last_undegraded":"2024-09-12T12:12:50.516448+0000","last_fullsized":"2024-09-12T12:12:50.516448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179414+0000","last_change":"2024-09-12T12:12:49.196067+0000","last_active":"2024-09-12T12:12:50.179414+0000","last_peered":"2024-09-12T12:12:50.179414+0000","last_clean":"2024-09-12T12:12:50.179414+0000","last_became_active":"2024-09-12T12:12:49.195668+0000","last_became_peered":"2024-09-12T12:12:49.195668+0000","last_unstale":"2024-09-12T12:12:50.179414+0000","last_undegraded":"2024-09-12T12:12:50.179414+0000","last_fullsized":"2024-09-12T12:12:50.179414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:40.014673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513018+0000","last_change":"2024-09-12T12:12:44.843136+0000","last_active":"2024-09-12T12:12:50.513018+0000","last_peered":"2024-09-12T12:12:50.513018+0000","last_clean":"2024-09-12T12:12:50.513018+0000","last_became_active":"2024-09-12T12:12:44.842828+0000","last_became_peered":"2024-09-12T12:12:44.842828+0000","last_unstale":"2024-09-12T12:12:50.513018+0000","last_undegraded":"2024-09-12T12:12:50.513018+0000","last_fullsized":"2024-09-12T12:12:50.513018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178520+0000","last_change":"2024-09-12T12:12:43.853992+0000","last_active":"2024-09-12T12:12:50.178520+0000","last_peered":"2024-09-12T12:12:50.178520+0000","last_clean":"2024-09-12T12:12:50.178520+0000","last_became_active":"2024-09-12T12:12:43.853565+0000","last_became_peered":"2024-09-12T12:12:43.853565+0000","last_unstale":"2024-09-12T12:12:50.178520+0000","last_undegraded":"2024-09-12T12:12:50.178520+0000","last_fullsized":"2024-09-12T12:12:50.178520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177496+0000","last_change":"2024-09-12T12:12:49.237840+0000","last_active":"2024-09-12T12:12:50.177496+0000","last_peered":"2024-09-12T12:12:50.177496+0000","last_clean":"2024-09-12T12:12:50.177496+0000","last_became_active":"2024-09-12T12:12:49.237366+0000","last_became_peered":"2024-09-12T12:12:49.237366+0000","last_unstale":"2024-09-12T12:12:50.177496+0000","last_undegraded":"2024-09-12T12:12:50.177496+0000","last_fullsized":"2024-09-12T12:12:50.177496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:32.420795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177705+0000","last_change":"2024-09-12T12:12:44.863064+0000","last_active":"2024-09-12T12:12:50.177705+0000","last_peered":"2024-09-12T12:12:50.177705+0000","last_clean":"2024-09-12T12:12:50.177705+0000","last_became_active":"2024-09-12T12:12:44.862295+0000","last_became_peered":"2024-09-12T12:12:44.862295+0000","last_unstale":"2024-09-12T12:12:50.177705+0000","last_undegraded":"2024-09-12T12:12:50.177705+0000","last_fullsized":"2024-09-12T12:12:50.177705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126177+0000","last_change":"2024-09-12T12:12:43.844539+0000","last_active":"2024-09-12T12:12:51.126177+0000","last_peered":"2024-09-12T12:12:51.126177+0000","last_clean":"2024-09-12T12:12:51.126177+0000","last_became_active":"2024-09-12T12:12:43.844303+0000","last_became_peered":"2024-09-12T12:12:43.844303+0000","last_unstale":"2024-09-12T12:12:51.126177+0000","last_undegraded":"2024-09-12T12:12:51.126177+0000","last_fullsized":"2024-09-12T12:12:51.126177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176517+0000","last_change":"2024-09-12T12:12:49.234495+0000","last_active":"2024-09-12T12:12:50.176517+0000","last_peered":"2024-09-12T12:12:50.176517+0000","last_clean":"2024-09-12T12:12:50.176517+0000","last_became_active":"2024-09-12T12:12:49.233400+0000","last_became_peered":"2024-09-12T12:12:49.233400+0000","last_unstale":"2024-09-12T12:12:50.176517+0000","last_undegraded":"2024-09-12T12:12:50.176517+0000","last_fullsized":"2024-09-12T12:12:50.176517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:09.355445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126175+0000","last_change":"2024-09-12T12:12:44.848284+0000","last_active":"2024-09-12T12:12:51.126175+0000","last_peered":"2024-09-12T12:12:51.126175+0000","last_clean":"2024-09-12T12:12:51.126175+0000","last_became_active":"2024-09-12T12:12:44.848024+0000","last_became_peered":"2024-09-12T12:12:44.848024+0000","last_unstale":"2024-09-12T12:12:51.126175+0000","last_undegraded":"2024-09-12T12:12:51.126175+0000","last_fullsized":"2024-09-12T12:12:51.126175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517386+0000","last_change":"2024-09-12T12:12:43.855069+0000","last_active":"2024-09-12T12:12:50.517386+0000","last_peered":"2024-09-12T12:12:50.517386+0000","last_clean":"2024-09-12T12:12:50.517386+0000","last_became_active":"2024-09-12T12:12:43.854801+0000","last_became_peered":"2024-09-12T12:12:43.854801+0000","last_unstale":"2024-09-12T12:12:50.517386+0000","last_undegraded":"2024-09-12T12:12:50.517386+0000","last_fullsized":"2024-09-12T12:12:50.517386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:10:14.539671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512594+0000","last_change":"2024-09-12T12:12:49.236330+0000","last_active":"2024-09-12T12:12:50.512594+0000","last_peered":"2024-09-12T12:12:50.512594+0000","last_clean":"2024-09-12T12:12:50.512594+0000","last_became_active":"2024-09-12T12:12:49.235941+0000","last_became_peered":"2024-09-12T12:12:49.235941+0000","last_unstale":"2024-09-12T12:12:50.512594+0000","last_undegraded":"2024-09-12T12:12:50.512594+0000","last_fullsized":"2024-09-12T12:12:50.512594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:21.360400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664641+0000","last_change":"2024-09-12T12:12:44.865593+0000","last_active":"2024-09-12T12:12:50.664641+0000","last_peered":"2024-09-12T12:12:50.664641+0000","last_clean":"2024-09-12T12:12:50.664641+0000","last_became_active":"2024-09-12T12:12:44.865207+0000","last_became_peered":"2024-09-12T12:12:44.865207+0000","last_unstale":"2024-09-12T12:12:50.664641+0000","last_undegraded":"2024-09-12T12:12:50.664641+0000","last_fullsized":"2024-09-12T12:12:50.664641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:35.665829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126175+0000","last_change":"2024-09-12T12:12:43.840268+0000","last_active":"2024-09-12T12:12:51.126175+0000","last_peered":"2024-09-12T12:12:51.126175+0000","last_clean":"2024-09-12T12:12:51.126175+0000","last_became_active":"2024-09-12T12:12:43.839978+0000","last_became_peered":"2024-09-12T12:12:43.839978+0000","last_unstale":"2024-09-12T12:12:51.126175+0000","last_undegraded":"2024-09-12T12:12:51.126175+0000","last_fullsized":"2024-09-12T12:12:51.126175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125228+0000","last_change":"2024-09-12T12:12:49.201974+0000","last_active":"2024-09-12T12:12:51.125228+0000","last_peered":"2024-09-12T12:12:51.125228+0000","last_clean":"2024-09-12T12:12:51.125228+0000","last_became_active":"2024-09-12T12:12:49.201363+0000","last_became_peered":"2024-09-12T12:12:49.201363+0000","last_unstale":"2024-09-12T12:12:51.125228+0000","last_undegraded":"2024-09-12T12:12:51.125228+0000","last_fullsized":"2024-09-12T12:12:51.125228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179210+0000","last_change":"2024-09-12T12:12:44.850770+0000","last_active":"2024-09-12T12:12:50.179210+0000","last_peered":"2024-09-12T12:12:50.179210+0000","last_clean":"2024-09-12T12:12:50.179210+0000","last_became_active":"2024-09-12T12:12:44.842455+0000","last_became_peered":"2024-09-12T12:12:44.842455+0000","last_unstale":"2024-09-12T12:12:50.179210+0000","last_undegraded":"2024-09-12T12:12:50.179210+0000","last_fullsized":"2024-09-12T12:12:50.179210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:15.274937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664457+0000","last_change":"2024-09-12T12:12:43.848461+0000","last_active":"2024-09-12T12:12:50.664457+0000","last_peered":"2024-09-12T12:12:50.664457+0000","last_clean":"2024-09-12T12:12:50.664457+0000","last_became_active":"2024-09-12T12:12:43.847953+0000","last_became_peered":"2024-09-12T12:12:43.847953+0000","last_unstale":"2024-09-12T12:12:50.664457+0000","last_undegraded":"2024-09-12T12:12:50.664457+0000","last_fullsized":"2024-09-12T12:12:50.664457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126063+0000","last_change":"2024-09-12T12:12:49.200796+0000","last_active":"2024-09-12T12:12:51.126063+0000","last_peered":"2024-09-12T12:12:51.126063+0000","last_clean":"2024-09-12T12:12:51.126063+0000","last_became_active":"2024-09-12T12:12:49.200352+0000","last_became_peered":"2024-09-12T12:12:49.200352+0000","last_unstale":"2024-09-12T12:12:51.126063+0000","last_undegraded":"2024-09-12T12:12:51.126063+0000","last_fullsized":"2024-09-12T12:12:51.126063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:54.688541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125166+0000","last_change":"2024-09-12T12:12:44.861229+0000","last_active":"2024-09-12T12:12:51.125166+0000","last_peered":"2024-09-12T12:12:51.125166+0000","last_clean":"2024-09-12T12:12:51.125166+0000","last_became_active":"2024-09-12T12:12:44.855880+0000","last_became_peered":"2024-09-12T12:12:44.855880+0000","last_unstale":"2024-09-12T12:12:51.125166+0000","last_undegraded":"2024-09-12T12:12:51.125166+0000","last_fullsized":"2024-09-12T12:12:51.125166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124771+0000","last_change":"2024-09-12T12:12:43.843781+0000","last_active":"2024-09-12T12:12:51.124771+0000","last_peered":"2024-09-12T12:12:51.124771+0000","last_clean":"2024-09-12T12:12:51.124771+0000","last_became_active":"2024-09-12T12:12:43.843510+0000","last_became_peered":"2024-09-12T12:12:43.843510+0000","last_unstale":"2024-09-12T12:12:51.124771+0000","last_undegraded":"2024-09-12T12:12:51.124771+0000","last_fullsized":"2024-09-12T12:12:51.124771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126036+0000","last_change":"2024-09-12T12:12:49.201170+0000","last_active":"2024-09-12T12:12:51.126036+0000","last_peered":"2024-09-12T12:12:51.126036+0000","last_clean":"2024-09-12T12:12:51.126036+0000","last_became_active":"2024-09-12T12:12:49.200754+0000","last_became_peered":"2024-09-12T12:12:49.200754+0000","last_unstale":"2024-09-12T12:12:51.126036+0000","last_undegraded":"2024-09-12T12:12:51.126036+0000","last_fullsized":"2024-09-12T12:12:51.126036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:33.368245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512181+0000","last_change":"2024-09-12T12:12:44.839123+0000","last_active":"2024-09-12T12:12:50.512181+0000","last_peered":"2024-09-12T12:12:50.512181+0000","last_clean":"2024-09-12T12:12:50.512181+0000","last_became_active":"2024-09-12T12:12:44.838887+0000","last_became_peered":"2024-09-12T12:12:44.838887+0000","last_unstale":"2024-09-12T12:12:50.512181+0000","last_undegraded":"2024-09-12T12:12:50.512181+0000","last_fullsized":"2024-09-12T12:12:50.512181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:31.037954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516448+0000","last_change":"2024-09-12T12:12:43.853714+0000","last_active":"2024-09-12T12:12:50.516448+0000","last_peered":"2024-09-12T12:12:50.516448+0000","last_clean":"2024-09-12T12:12:50.516448+0000","last_became_active":"2024-09-12T12:12:43.853354+0000","last_became_peered":"2024-09-12T12:12:43.853354+0000","last_unstale":"2024-09-12T12:12:50.516448+0000","last_undegraded":"2024-09-12T12:12:50.516448+0000","last_fullsized":"2024-09-12T12:12:50.516448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512950+0000","last_change":"2024-09-12T12:12:49.233432+0000","last_active":"2024-09-12T12:12:50.512950+0000","last_peered":"2024-09-12T12:12:50.512950+0000","last_clean":"2024-09-12T12:12:50.512950+0000","last_became_active":"2024-09-12T12:12:49.232960+0000","last_became_peered":"2024-09-12T12:12:49.232960+0000","last_unstale":"2024-09-12T12:12:50.512950+0000","last_undegraded":"2024-09-12T12:12:50.512950+0000","last_fullsized":"2024-09-12T12:12:50.512950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:29.872131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176900+0000","last_change":"2024-09-12T12:12:44.866650+0000","last_active":"2024-09-12T12:12:50.176900+0000","last_peered":"2024-09-12T12:12:50.176900+0000","last_clean":"2024-09-12T12:12:50.176900+0000","last_became_active":"2024-09-12T12:12:44.866307+0000","last_became_peered":"2024-09-12T12:12:44.866307+0000","last_unstale":"2024-09-12T12:12:50.176900+0000","last_undegraded":"2024-09-12T12:12:50.176900+0000","last_fullsized":"2024-09-12T12:12:50.176900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664136+0000","last_change":"2024-09-12T12:12:43.850483+0000","last_active":"2024-09-12T12:12:50.664136+0000","last_peered":"2024-09-12T12:12:50.664136+0000","last_clean":"2024-09-12T12:12:50.664136+0000","last_became_active":"2024-09-12T12:12:43.850143+0000","last_became_peered":"2024-09-12T12:12:43.850143+0000","last_unstale":"2024-09-12T12:12:50.664136+0000","last_undegraded":"2024-09-12T12:12:50.664136+0000","last_fullsized":"2024-09-12T12:12:50.664136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516596+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:12:50.516596+0000","last_peered":"2024-09-12T12:12:50.516596+0000","last_clean":"2024-09-12T12:12:50.516596+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:12:50.516596+0000","last_undegraded":"2024-09-12T12:12:50.516596+0000","last_fullsized":"2024-09-12T12:12:50.516596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178235+0000","last_change":"2024-09-12T12:12:49.235904+0000","last_active":"2024-09-12T12:12:50.178235+0000","last_peered":"2024-09-12T12:12:50.178235+0000","last_clean":"2024-09-12T12:12:50.178235+0000","last_became_active":"2024-09-12T12:12:49.235548+0000","last_became_peered":"2024-09-12T12:12:49.235548+0000","last_unstale":"2024-09-12T12:12:50.178235+0000","last_undegraded":"2024-09-12T12:12:50.178235+0000","last_fullsized":"2024-09-12T12:12:50.178235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517137+0000","last_change":"2024-09-12T12:12:44.866993+0000","last_active":"2024-09-12T12:12:50.517137+0000","last_peered":"2024-09-12T12:12:50.517137+0000","last_clean":"2024-09-12T12:12:50.517137+0000","last_became_active":"2024-09-12T12:12:44.866717+0000","last_became_peered":"2024-09-12T12:12:44.866717+0000","last_unstale":"2024-09-12T12:12:50.517137+0000","last_undegraded":"2024-09-12T12:12:50.517137+0000","last_fullsized":"2024-09-12T12:12:50.517137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:29.019401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125386+0000","last_change":"2024-09-12T12:12:43.857565+0000","last_active":"2024-09-12T12:12:51.125386+0000","last_peered":"2024-09-12T12:12:51.125386+0000","last_clean":"2024-09-12T12:12:51.125386+0000","last_became_active":"2024-09-12T12:12:43.857320+0000","last_became_peered":"2024-09-12T12:12:43.857320+0000","last_unstale":"2024-09-12T12:12:51.125386+0000","last_undegraded":"2024-09-12T12:12:51.125386+0000","last_fullsized":"2024-09-12T12:12:51.125386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177268+0000","last_change":"2024-09-12T12:12:49.233077+0000","last_active":"2024-09-12T12:12:50.177268+0000","last_peered":"2024-09-12T12:12:50.177268+0000","last_clean":"2024-09-12T12:12:50.177268+0000","last_became_active":"2024-09-12T12:12:49.232399+0000","last_became_peered":"2024-09-12T12:12:49.232399+0000","last_unstale":"2024-09-12T12:12:50.177268+0000","last_undegraded":"2024-09-12T12:12:50.177268+0000","last_fullsized":"2024-09-12T12:12:50.177268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:36.758809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664546+0000","last_change":"2024-09-12T12:12:44.863346+0000","last_active":"2024-09-12T12:12:50.664546+0000","last_peered":"2024-09-12T12:12:50.664546+0000","last_clean":"2024-09-12T12:12:50.664546+0000","last_became_active":"2024-09-12T12:12:44.863022+0000","last_became_peered":"2024-09-12T12:12:44.863022+0000","last_unstale":"2024-09-12T12:12:50.664546+0000","last_undegraded":"2024-09-12T12:12:50.664546+0000","last_fullsized":"2024-09-12T12:12:50.664546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125799+0000","last_change":"2024-09-12T12:12:43.843497+0000","last_active":"2024-09-12T12:12:51.125799+0000","last_peered":"2024-09-12T12:12:51.125799+0000","last_clean":"2024-09-12T12:12:51.125799+0000","last_became_active":"2024-09-12T12:12:43.843205+0000","last_became_peered":"2024-09-12T12:12:43.843205+0000","last_unstale":"2024-09-12T12:12:51.125799+0000","last_undegraded":"2024-09-12T12:12:51.125799+0000","last_fullsized":"2024-09-12T12:12:51.125799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512708+0000","last_change":"2024-09-12T12:12:49.194951+0000","last_active":"2024-09-12T12:12:50.512708+0000","last_peered":"2024-09-12T12:12:50.512708+0000","last_clean":"2024-09-12T12:12:50.512708+0000","last_became_active":"2024-09-12T12:12:49.193406+0000","last_became_peered":"2024-09-12T12:12:49.193406+0000","last_unstale":"2024-09-12T12:12:50.512708+0000","last_undegraded":"2024-09-12T12:12:50.512708+0000","last_fullsized":"2024-09-12T12:12:50.512708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:33.368245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517235+0000","last_change":"2024-09-12T12:12:44.873360+0000","last_active":"2024-09-12T12:12:50.517235+0000","last_peered":"2024-09-12T12:12:50.517235+0000","last_clean":"2024-09-12T12:12:50.517235+0000","last_became_active":"2024-09-12T12:12:44.871164+0000","last_became_peered":"2024-09-12T12:12:44.871164+0000","last_unstale":"2024-09-12T12:12:50.517235+0000","last_undegraded":"2024-09-12T12:12:50.517235+0000","last_fullsized":"2024-09-12T12:12:50.517235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:15.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125672+0000","last_change":"2024-09-12T12:12:43.844520+0000","last_active":"2024-09-12T12:12:51.125672+0000","last_peered":"2024-09-12T12:12:51.125672+0000","last_clean":"2024-09-12T12:12:51.125672+0000","last_became_active":"2024-09-12T12:12:43.844192+0000","last_became_peered":"2024-09-12T12:12:43.844192+0000","last_unstale":"2024-09-12T12:12:51.125672+0000","last_undegraded":"2024-09-12T12:12:51.125672+0000","last_fullsized":"2024-09-12T12:12:51.125672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663736+0000","last_change":"2024-09-12T12:12:49.235687+0000","last_active":"2024-09-12T12:12:50.663736+0000","last_peered":"2024-09-12T12:12:50.663736+0000","last_clean":"2024-09-12T12:12:50.663736+0000","last_became_active":"2024-09-12T12:12:49.235279+0000","last_became_peered":"2024-09-12T12:12:49.235279+0000","last_unstale":"2024-09-12T12:12:50.663736+0000","last_undegraded":"2024-09-12T12:12:50.663736+0000","last_fullsized":"2024-09-12T12:12:50.663736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:09.355445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517127+0000","last_change":"2024-09-12T12:12:44.869312+0000","last_active":"2024-09-12T12:12:50.517127+0000","last_peered":"2024-09-12T12:12:50.517127+0000","last_clean":"2024-09-12T12:12:50.517127+0000","last_became_active":"2024-09-12T12:12:44.869049+0000","last_became_peered":"2024-09-12T12:12:44.869049+0000","last_unstale":"2024-09-12T12:12:50.517127+0000","last_undegraded":"2024-09-12T12:12:50.517127+0000","last_fullsized":"2024-09-12T12:12:50.517127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178843+0000","last_change":"2024-09-12T12:12:43.850258+0000","last_active":"2024-09-12T12:12:50.178843+0000","last_peered":"2024-09-12T12:12:50.178843+0000","last_clean":"2024-09-12T12:12:50.178843+0000","last_became_active":"2024-09-12T12:12:43.849933+0000","last_became_peered":"2024-09-12T12:12:43.849933+0000","last_unstale":"2024-09-12T12:12:50.178843+0000","last_undegraded":"2024-09-12T12:12:50.178843+0000","last_fullsized":"2024-09-12T12:12:50.178843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.059875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177247+0000","last_change":"2024-09-12T12:12:49.204097+0000","last_active":"2024-09-12T12:12:50.177247+0000","last_peered":"2024-09-12T12:12:50.177247+0000","last_clean":"2024-09-12T12:12:50.177247+0000","last_became_active":"2024-09-12T12:12:49.203718+0000","last_became_peered":"2024-09-12T12:12:49.203718+0000","last_unstale":"2024-09-12T12:12:50.177247+0000","last_undegraded":"2024-09-12T12:12:50.177247+0000","last_fullsized":"2024-09-12T12:12:50.177247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:40.026171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516739+0000","last_change":"2024-09-12T12:12:44.869271+0000","last_active":"2024-09-12T12:12:50.516739+0000","last_peered":"2024-09-12T12:12:50.516739+0000","last_clean":"2024-09-12T12:12:50.516739+0000","last_became_active":"2024-09-12T12:12:44.868992+0000","last_became_peered":"2024-09-12T12:12:44.868992+0000","last_unstale":"2024-09-12T12:12:50.516739+0000","last_undegraded":"2024-09-12T12:12:50.516739+0000","last_fullsized":"2024-09-12T12:12:50.516739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:17.011556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124631+0000","last_change":"2024-09-12T12:12:43.838202+0000","last_active":"2024-09-12T12:12:51.124631+0000","last_peered":"2024-09-12T12:12:51.124631+0000","last_clean":"2024-09-12T12:12:51.124631+0000","last_became_active":"2024-09-12T12:12:43.837927+0000","last_became_peered":"2024-09-12T12:12:43.837927+0000","last_unstale":"2024-09-12T12:12:51.124631+0000","last_undegraded":"2024-09-12T12:12:51.124631+0000","last_fullsized":"2024-09-12T12:12:51.124631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:57.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512786+0000","last_change":"2024-09-12T12:12:49.204734+0000","last_active":"2024-09-12T12:12:50.512786+0000","last_peered":"2024-09-12T12:12:50.512786+0000","last_clean":"2024-09-12T12:12:50.512786+0000","last_became_active":"2024-09-12T12:12:49.204387+0000","last_became_peered":"2024-09-12T12:12:49.204387+0000","last_unstale":"2024-09-12T12:12:50.512786+0000","last_undegraded":"2024-09-12T12:12:50.512786+0000","last_fullsized":"2024-09-12T12:12:50.512786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.325777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177498+0000","last_change":"2024-09-12T12:12:44.836998+0000","last_active":"2024-09-12T12:12:50.177498+0000","last_peered":"2024-09-12T12:12:50.177498+0000","last_clean":"2024-09-12T12:12:50.177498+0000","last_became_active":"2024-09-12T12:12:44.836723+0000","last_became_peered":"2024-09-12T12:12:44.836723+0000","last_unstale":"2024-09-12T12:12:50.177498+0000","last_undegraded":"2024-09-12T12:12:50.177498+0000","last_fullsized":"2024-09-12T12:12:50.177498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177648+0000","last_change":"2024-09-12T12:12:43.847610+0000","last_active":"2024-09-12T12:12:50.177648+0000","last_peered":"2024-09-12T12:12:50.177648+0000","last_clean":"2024-09-12T12:12:50.177648+0000","last_became_active":"2024-09-12T12:12:43.846782+0000","last_became_peered":"2024-09-12T12:12:43.846782+0000","last_unstale":"2024-09-12T12:12:50.177648+0000","last_undegraded":"2024-09-12T12:12:50.177648+0000","last_fullsized":"2024-09-12T12:12:50.177648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177641+0000","last_change":"2024-09-12T12:12:49.237439+0000","last_active":"2024-09-12T12:12:50.177641+0000","last_peered":"2024-09-12T12:12:50.177641+0000","last_clean":"2024-09-12T12:12:50.177641+0000","last_became_active":"2024-09-12T12:12:49.236640+0000","last_became_peered":"2024-09-12T12:12:49.236640+0000","last_unstale":"2024-09-12T12:12:50.177641+0000","last_undegraded":"2024-09-12T12:12:50.177641+0000","last_fullsized":"2024-09-12T12:12:50.177641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:48.564758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516862+0000","last_change":"2024-09-12T12:12:44.870489+0000","last_active":"2024-09-12T12:12:50.516862+0000","last_peered":"2024-09-12T12:12:50.516862+0000","last_clean":"2024-09-12T12:12:50.516862+0000","last_became_active":"2024-09-12T12:12:44.869985+0000","last_became_peered":"2024-09-12T12:12:44.869985+0000","last_unstale":"2024-09-12T12:12:50.516862+0000","last_undegraded":"2024-09-12T12:12:50.516862+0000","last_fullsized":"2024-09-12T12:12:50.516862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:35.665829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664336+0000","last_change":"2024-09-12T12:12:43.855159+0000","last_active":"2024-09-12T12:12:50.664336+0000","last_peered":"2024-09-12T12:12:50.664336+0000","last_clean":"2024-09-12T12:12:50.664336+0000","last_became_active":"2024-09-12T12:12:43.854881+0000","last_became_peered":"2024-09-12T12:12:43.854881+0000","last_unstale":"2024-09-12T12:12:50.664336+0000","last_undegraded":"2024-09-12T12:12:50.664336+0000","last_fullsized":"2024-09-12T12:12:50.664336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177172+0000","last_change":"2024-09-12T12:12:49.238471+0000","last_active":"2024-09-12T12:12:50.177172+0000","last_peered":"2024-09-12T12:12:50.177172+0000","last_clean":"2024-09-12T12:12:50.177172+0000","last_became_active":"2024-09-12T12:12:49.235791+0000","last_became_peered":"2024-09-12T12:12:49.235791+0000","last_unstale":"2024-09-12T12:12:50.177172+0000","last_undegraded":"2024-09-12T12:12:50.177172+0000","last_fullsized":"2024-09-12T12:12:50.177172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:21:33.661174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512468+0000","last_change":"2024-09-12T12:12:44.856728+0000","last_active":"2024-09-12T12:12:50.512468+0000","last_peered":"2024-09-12T12:12:50.512468+0000","last_clean":"2024-09-12T12:12:50.512468+0000","last_became_active":"2024-09-12T12:12:44.856523+0000","last_became_peered":"2024-09-12T12:12:44.856523+0000","last_unstale":"2024-09-12T12:12:50.512468+0000","last_undegraded":"2024-09-12T12:12:50.512468+0000","last_fullsized":"2024-09-12T12:12:50.512468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.435034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512841+0000","last_change":"2024-09-12T12:12:43.845142+0000","last_active":"2024-09-12T12:12:50.512841+0000","last_peered":"2024-09-12T12:12:50.512841+0000","last_clean":"2024-09-12T12:12:50.512841+0000","last_became_active":"2024-09-12T12:12:43.844828+0000","last_became_peered":"2024-09-12T12:12:43.844828+0000","last_unstale":"2024-09-12T12:12:50.512841+0000","last_undegraded":"2024-09-12T12:12:50.512841+0000","last_fullsized":"2024-09-12T12:12:50.512841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:59.203160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664482+0000","last_change":"2024-09-12T12:12:49.233138+0000","last_active":"2024-09-12T12:12:50.664482+0000","last_peered":"2024-09-12T12:12:50.664482+0000","last_clean":"2024-09-12T12:12:50.664482+0000","last_became_active":"2024-09-12T12:12:49.232720+0000","last_became_peered":"2024-09-12T12:12:49.232720+0000","last_unstale":"2024-09-12T12:12:50.664482+0000","last_undegraded":"2024-09-12T12:12:50.664482+0000","last_fullsized":"2024-09-12T12:12:50.664482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.973179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517078+0000","last_change":"2024-09-12T12:12:44.864865+0000","last_active":"2024-09-12T12:12:50.517078+0000","last_peered":"2024-09-12T12:12:50.517078+0000","last_clean":"2024-09-12T12:12:50.517078+0000","last_became_active":"2024-09-12T12:12:44.864611+0000","last_became_peered":"2024-09-12T12:12:44.864611+0000","last_unstale":"2024-09-12T12:12:50.517078+0000","last_undegraded":"2024-09-12T12:12:50.517078+0000","last_fullsized":"2024-09-12T12:12:50.517078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:56.111249+0000","last_change":"2024-09-12T12:12:43.841311+0000","last_active":"2024-09-12T12:12:56.111249+0000","last_peered":"2024-09-12T12:12:56.111249+0000","last_clean":"2024-09-12T12:12:56.111249+0000","last_became_active":"2024-09-12T12:12:43.840143+0000","last_became_peered":"2024-09-12T12:12:43.840143+0000","last_unstale":"2024-09-12T12:12:56.111249+0000","last_undegraded":"2024-09-12T12:12:56.111249+0000","last_fullsized":"2024-09-12T12:12:56.111249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125393+0000","last_change":"2024-09-12T12:12:49.201741+0000","last_active":"2024-09-12T12:12:51.125393+0000","last_peered":"2024-09-12T12:12:51.125393+0000","last_clean":"2024-09-12T12:12:51.125393+0000","last_became_active":"2024-09-12T12:12:49.200783+0000","last_became_peered":"2024-09-12T12:12:49.200783+0000","last_unstale":"2024-09-12T12:12:51.125393+0000","last_undegraded":"2024-09-12T12:12:51.125393+0000","last_fullsized":"2024-09-12T12:12:51.125393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:40.014673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178889+0000","last_change":"2024-09-12T12:12:44.866195+0000","last_active":"2024-09-12T12:12:50.178889+0000","last_peered":"2024-09-12T12:12:50.178889+0000","last_clean":"2024-09-12T12:12:50.178889+0000","last_became_active":"2024-09-12T12:12:44.862903+0000","last_became_peered":"2024-09-12T12:12:44.862903+0000","last_unstale":"2024-09-12T12:12:50.178889+0000","last_undegraded":"2024-09-12T12:12:50.178889+0000","last_fullsized":"2024-09-12T12:12:50.178889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:07.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125724+0000","last_change":"2024-09-12T12:12:43.855996+0000","last_active":"2024-09-12T12:12:51.125724+0000","last_peered":"2024-09-12T12:12:51.125724+0000","last_clean":"2024-09-12T12:12:51.125724+0000","last_became_active":"2024-09-12T12:12:43.855599+0000","last_became_peered":"2024-09-12T12:12:43.855599+0000","last_unstale":"2024-09-12T12:12:51.125724+0000","last_undegraded":"2024-09-12T12:12:51.125724+0000","last_fullsized":"2024-09-12T12:12:51.125724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178966+0000","last_change":"2024-09-12T12:12:49.192756+0000","last_active":"2024-09-12T12:12:50.178966+0000","last_peered":"2024-09-12T12:12:50.178966+0000","last_clean":"2024-09-12T12:12:50.178966+0000","last_became_active":"2024-09-12T12:12:49.192349+0000","last_became_peered":"2024-09-12T12:12:49.192349+0000","last_unstale":"2024-09-12T12:12:50.178966+0000","last_undegraded":"2024-09-12T12:12:50.178966+0000","last_fullsized":"2024-09-12T12:12:50.178966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:04.961251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513276+0000","last_change":"2024-09-12T12:12:44.858876+0000","last_active":"2024-09-12T12:12:50.513276+0000","last_peered":"2024-09-12T12:12:50.513276+0000","last_clean":"2024-09-12T12:12:50.513276+0000","last_became_active":"2024-09-12T12:12:44.858622+0000","last_became_peered":"2024-09-12T12:12:44.858622+0000","last_unstale":"2024-09-12T12:12:50.513276+0000","last_undegraded":"2024-09-12T12:12:50.513276+0000","last_fullsized":"2024-09-12T12:12:50.513276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664332+0000","last_change":"2024-09-12T12:12:43.855782+0000","last_active":"2024-09-12T12:12:50.664332+0000","last_peered":"2024-09-12T12:12:50.664332+0000","last_clean":"2024-09-12T12:12:50.664332+0000","last_became_active":"2024-09-12T12:12:43.855330+0000","last_became_peered":"2024-09-12T12:12:43.855330+0000","last_unstale":"2024-09-12T12:12:50.664332+0000","last_undegraded":"2024-09-12T12:12:50.664332+0000","last_fullsized":"2024-09-12T12:12:50.664332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176677+0000","last_change":"2024-09-12T12:12:49.199551+0000","last_active":"2024-09-12T12:12:50.176677+0000","last_peered":"2024-09-12T12:12:50.176677+0000","last_clean":"2024-09-12T12:12:50.176677+0000","last_became_active":"2024-09-12T12:12:49.199160+0000","last_became_peered":"2024-09-12T12:12:49.199160+0000","last_unstale":"2024-09-12T12:12:50.176677+0000","last_undegraded":"2024-09-12T12:12:50.176677+0000","last_fullsized":"2024-09-12T12:12:50.176677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:55.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664327+0000","last_change":"2024-09-12T12:12:44.861353+0000","last_active":"2024-09-12T12:12:50.664327+0000","last_peered":"2024-09-12T12:12:50.664327+0000","last_clean":"2024-09-12T12:12:50.664327+0000","last_became_active":"2024-09-12T12:12:44.861070+0000","last_became_peered":"2024-09-12T12:12:44.861070+0000","last_unstale":"2024-09-12T12:12:50.664327+0000","last_undegraded":"2024-09-12T12:12:50.664327+0000","last_fullsized":"2024-09-12T12:12:50.664327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178299+0000","last_change":"2024-09-12T12:12:43.856649+0000","last_active":"2024-09-12T12:12:50.178299+0000","last_peered":"2024-09-12T12:12:50.178299+0000","last_clean":"2024-09-12T12:12:50.178299+0000","last_became_active":"2024-09-12T12:12:43.856407+0000","last_became_peered":"2024-09-12T12:12:43.856407+0000","last_unstale":"2024-09-12T12:12:50.178299+0000","last_undegraded":"2024-09-12T12:12:50.178299+0000","last_fullsized":"2024-09-12T12:12:50.178299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176631+0000","last_change":"2024-09-12T12:12:49.234007+0000","last_active":"2024-09-12T12:12:50.176631+0000","last_peered":"2024-09-12T12:12:50.176631+0000","last_clean":"2024-09-12T12:12:50.176631+0000","last_became_active":"2024-09-12T12:12:49.233586+0000","last_became_peered":"2024-09-12T12:12:49.233586+0000","last_unstale":"2024-09-12T12:12:50.176631+0000","last_undegraded":"2024-09-12T12:12:50.176631+0000","last_fullsized":"2024-09-12T12:12:50.176631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:01.336468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512727+0000","last_change":"2024-09-12T12:12:49.239278+0000","last_active":"2024-09-12T12:12:50.512727+0000","last_peered":"2024-09-12T12:12:50.512727+0000","last_clean":"2024-09-12T12:12:50.512727+0000","last_became_active":"2024-09-12T12:12:49.237056+0000","last_became_peered":"2024-09-12T12:12:49.237056+0000","last_unstale":"2024-09-12T12:12:50.512727+0000","last_undegraded":"2024-09-12T12:12:50.512727+0000","last_fullsized":"2024-09-12T12:12:50.512727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:54.688541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124996+0000","last_change":"2024-09-12T12:12:44.849271+0000","last_active":"2024-09-12T12:12:51.124996+0000","last_peered":"2024-09-12T12:12:51.124996+0000","last_clean":"2024-09-12T12:12:51.124996+0000","last_became_active":"2024-09-12T12:12:44.848981+0000","last_became_peered":"2024-09-12T12:12:44.848981+0000","last_unstale":"2024-09-12T12:12:51.124996+0000","last_undegraded":"2024-09-12T12:12:51.124996+0000","last_fullsized":"2024-09-12T12:12:51.124996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664166+0000","last_change":"2024-09-12T12:12:43.850772+0000","last_active":"2024-09-12T12:12:50.664166+0000","last_peered":"2024-09-12T12:12:50.664166+0000","last_clean":"2024-09-12T12:12:50.664166+0000","last_became_active":"2024-09-12T12:12:43.849876+0000","last_became_peered":"2024-09-12T12:12:43.849876+0000","last_unstale":"2024-09-12T12:12:50.664166+0000","last_undegraded":"2024-09-12T12:12:50.664166+0000","last_fullsized":"2024-09-12T12:12:50.664166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178125+0000","last_change":"2024-09-12T12:12:49.197617+0000","last_active":"2024-09-12T12:12:50.178125+0000","last_peered":"2024-09-12T12:12:50.178125+0000","last_clean":"2024-09-12T12:12:50.178125+0000","last_became_active":"2024-09-12T12:12:49.197030+0000","last_became_peered":"2024-09-12T12:12:49.197030+0000","last_unstale":"2024-09-12T12:12:50.178125+0000","last_undegraded":"2024-09-12T12:12:50.178125+0000","last_fullsized":"2024-09-12T12:12:50.178125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:04.961251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176677+0000","last_change":"2024-09-12T12:12:44.861618+0000","last_active":"2024-09-12T12:12:50.176677+0000","last_peered":"2024-09-12T12:12:50.176677+0000","last_clean":"2024-09-12T12:12:50.176677+0000","last_became_active":"2024-09-12T12:12:44.861291+0000","last_became_peered":"2024-09-12T12:12:44.861291+0000","last_unstale":"2024-09-12T12:12:50.176677+0000","last_undegraded":"2024-09-12T12:12:50.176677+0000","last_fullsized":"2024-09-12T12:12:50.176677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176907+0000","last_change":"2024-09-12T12:12:43.843772+0000","last_active":"2024-09-12T12:12:50.176907+0000","last_peered":"2024-09-12T12:12:50.176907+0000","last_clean":"2024-09-12T12:12:50.176907+0000","last_became_active":"2024-09-12T12:12:43.843482+0000","last_became_peered":"2024-09-12T12:12:43.843482+0000","last_unstale":"2024-09-12T12:12:50.176907+0000","last_undegraded":"2024-09-12T12:12:50.176907+0000","last_fullsized":"2024-09-12T12:12:50.176907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:57.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177687+0000","last_change":"2024-09-12T12:12:43.853195+0000","last_active":"2024-09-12T12:12:50.177687+0000","last_peered":"2024-09-12T12:12:50.177687+0000","last_clean":"2024-09-12T12:12:50.177687+0000","last_became_active":"2024-09-12T12:12:43.852885+0000","last_became_peered":"2024-09-12T12:12:43.852885+0000","last_unstale":"2024-09-12T12:12:50.177687+0000","last_undegraded":"2024-09-12T12:12:50.177687+0000","last_fullsized":"2024-09-12T12:12:50.177687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512832+0000","last_change":"2024-09-12T12:12:44.841616+0000","last_active":"2024-09-12T12:12:50.512832+0000","last_peered":"2024-09-12T12:12:50.512832+0000","last_clean":"2024-09-12T12:12:50.512832+0000","last_became_active":"2024-09-12T12:12:44.837035+0000","last_became_peered":"2024-09-12T12:12:44.837035+0000","last_unstale":"2024-09-12T12:12:50.512832+0000","last_undegraded":"2024-09-12T12:12:50.512832+0000","last_fullsized":"2024-09-12T12:12:50.512832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125285+0000","last_change":"2024-09-12T12:12:49.197010+0000","last_active":"2024-09-12T12:12:51.125285+0000","last_peered":"2024-09-12T12:12:51.125285+0000","last_clean":"2024-09-12T12:12:51.125285+0000","last_became_active":"2024-09-12T12:12:49.196614+0000","last_became_peered":"2024-09-12T12:12:49.196614+0000","last_unstale":"2024-09-12T12:12:51.125285+0000","last_undegraded":"2024-09-12T12:12:51.125285+0000","last_fullsized":"2024-09-12T12:12:51.125285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:15.930626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176978+0000","last_change":"2024-09-12T12:12:43.852370+0000","last_active":"2024-09-12T12:12:50.176978+0000","last_peered":"2024-09-12T12:12:50.176978+0000","last_clean":"2024-09-12T12:12:50.176978+0000","last_became_active":"2024-09-12T12:12:43.852074+0000","last_became_peered":"2024-09-12T12:12:43.852074+0000","last_unstale":"2024-09-12T12:12:50.176978+0000","last_undegraded":"2024-09-12T12:12:50.176978+0000","last_fullsized":"2024-09-12T12:12:50.176978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178100+0000","last_change":"2024-09-12T12:12:44.832700+0000","last_active":"2024-09-12T12:12:50.178100+0000","last_peered":"2024-09-12T12:12:50.178100+0000","last_clean":"2024-09-12T12:12:50.178100+0000","last_became_active":"2024-09-12T12:12:44.832406+0000","last_became_peered":"2024-09-12T12:12:44.832406+0000","last_unstale":"2024-09-12T12:12:50.178100+0000","last_undegraded":"2024-09-12T12:12:50.178100+0000","last_fullsized":"2024-09-12T12:12:50.178100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:58.477524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177442+0000","last_change":"2024-09-12T12:12:49.196949+0000","last_active":"2024-09-12T12:12:50.177442+0000","last_peered":"2024-09-12T12:12:50.177442+0000","last_clean":"2024-09-12T12:12:50.177442+0000","last_became_active":"2024-09-12T12:12:49.196332+0000","last_became_peered":"2024-09-12T12:12:49.196332+0000","last_unstale":"2024-09-12T12:12:50.177442+0000","last_undegraded":"2024-09-12T12:12:50.177442+0000","last_fullsized":"2024-09-12T12:12:50.177442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:33.072107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177294+0000","last_change":"2024-09-12T12:12:44.844712+0000","last_active":"2024-09-12T12:12:50.177294+0000","last_peered":"2024-09-12T12:12:50.177294+0000","last_clean":"2024-09-12T12:12:50.177294+0000","last_became_active":"2024-09-12T12:12:44.843911+0000","last_became_peered":"2024-09-12T12:12:44.843911+0000","last_unstale":"2024-09-12T12:12:50.177294+0000","last_undegraded":"2024-09-12T12:12:50.177294+0000","last_fullsized":"2024-09-12T12:12:50.177294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.435034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124714+0000","last_change":"2024-09-12T12:12:44.848326+0000","last_active":"2024-09-12T12:12:51.124714+0000","last_peered":"2024-09-12T12:12:51.124714+0000","last_clean":"2024-09-12T12:12:51.124714+0000","last_became_active":"2024-09-12T12:12:44.848042+0000","last_became_peered":"2024-09-12T12:12:44.848042+0000","last_unstale":"2024-09-12T12:12:51.124714+0000","last_undegraded":"2024-09-12T12:12:51.124714+0000","last_fullsized":"2024-09-12T12:12:51.124714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:29.908514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664167+0000","last_change":"2024-09-12T12:12:44.864217+0000","last_active":"2024-09-12T12:12:50.664167+0000","last_peered":"2024-09-12T12:12:50.664167+0000","last_clean":"2024-09-12T12:12:50.664167+0000","last_became_active":"2024-09-12T12:12:44.863950+0000","last_became_peered":"2024-09-12T12:12:44.863950+0000","last_unstale":"2024-09-12T12:12:50.664167+0000","last_undegraded":"2024-09-12T12:12:50.664167+0000","last_fullsized":"2024-09-12T12:12:50.664167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512709+0000","last_change":"2024-09-12T12:12:44.844044+0000","last_active":"2024-09-12T12:12:50.512709+0000","last_peered":"2024-09-12T12:12:50.512709+0000","last_clean":"2024-09-12T12:12:50.512709+0000","last_became_active":"2024-09-12T12:12:44.843737+0000","last_became_peered":"2024-09-12T12:12:44.843737+0000","last_unstale":"2024-09-12T12:12:50.512709+0000","last_undegraded":"2024-09-12T12:12:50.512709+0000","last_fullsized":"2024-09-12T12:12:50.512709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177290+0000","last_change":"2024-09-12T12:12:44.854798+0000","last_active":"2024-09-12T12:12:50.177290+0000","last_peered":"2024-09-12T12:12:50.177290+0000","last_clean":"2024-09-12T12:12:50.177290+0000","last_became_active":"2024-09-12T12:12:44.852834+0000","last_became_peered":"2024-09-12T12:12:44.852834+0000","last_unstale":"2024-09-12T12:12:50.177290+0000","last_undegraded":"2024-09-12T12:12:50.177290+0000","last_fullsized":"2024-09-12T12:12:50.177290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125449+0000","last_change":"2024-09-12T12:12:44.855309+0000","last_active":"2024-09-12T12:12:51.125449+0000","last_peered":"2024-09-12T12:12:51.125449+0000","last_clean":"2024-09-12T12:12:51.125449+0000","last_became_active":"2024-09-12T12:12:44.854718+0000","last_became_peered":"2024-09-12T12:12:44.854718+0000","last_unstale":"2024-09-12T12:12:51.125449+0000","last_undegraded":"2024-09-12T12:12:51.125449+0000","last_fullsized":"2024-09-12T12:12:51.125449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178907+0000","last_change":"2024-09-12T12:12:44.855541+0000","last_active":"2024-09-12T12:12:50.178907+0000","last_peered":"2024-09-12T12:12:50.178907+0000","last_clean":"2024-09-12T12:12:50.178907+0000","last_became_active":"2024-09-12T12:12:44.855141+0000","last_became_peered":"2024-09-12T12:12:44.855141+0000","last_unstale":"2024-09-12T12:12:50.178907+0000","last_undegraded":"2024-09-12T12:12:50.178907+0000","last_fullsized":"2024-09-12T12:12:50.178907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177604+0000","last_change":"2024-09-12T12:12:44.866746+0000","last_active":"2024-09-12T12:12:50.177604+0000","last_peered":"2024-09-12T12:12:50.177604+0000","last_clean":"2024-09-12T12:12:50.177604+0000","last_became_active":"2024-09-12T12:12:44.866244+0000","last_became_peered":"2024-09-12T12:12:44.866244+0000","last_unstale":"2024-09-12T12:12:50.177604+0000","last_undegraded":"2024-09-12T12:12:50.177604+0000","last_fullsized":"2024-09-12T12:12:50.177604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663883+0000","last_change":"2024-09-12T12:12:44.864035+0000","last_active":"2024-09-12T12:12:50.663883+0000","last_peered":"2024-09-12T12:12:50.663883+0000","last_clean":"2024-09-12T12:12:50.663883+0000","last_became_active":"2024-09-12T12:12:44.863759+0000","last_became_peered":"2024-09-12T12:12:44.863759+0000","last_unstale":"2024-09-12T12:12:50.663883+0000","last_undegraded":"2024-09-12T12:12:50.663883+0000","last_fullsized":"2024-09-12T12:12:50.663883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:31.258440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176816+0000","last_change":"2024-09-12T12:12:44.865302+0000","last_active":"2024-09-12T12:12:50.176816+0000","last_peered":"2024-09-12T12:12:50.176816+0000","last_clean":"2024-09-12T12:12:50.176816+0000","last_became_active":"2024-09-12T12:12:44.865069+0000","last_became_peered":"2024-09-12T12:12:44.865069+0000","last_unstale":"2024-09-12T12:12:50.176816+0000","last_undegraded":"2024-09-12T12:12:50.176816+0000","last_fullsized":"2024-09-12T12:12:50.176816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664052+0000","last_change":"2024-09-12T12:12:44.861590+0000","last_active":"2024-09-12T12:12:50.664052+0000","last_peered":"2024-09-12T12:12:50.664052+0000","last_clean":"2024-09-12T12:12:50.664052+0000","last_became_active":"2024-09-12T12:12:44.861202+0000","last_became_peered":"2024-09-12T12:12:44.861202+0000","last_unstale":"2024-09-12T12:12:50.664052+0000","last_undegraded":"2024-09-12T12:12:50.664052+0000","last_fullsized":"2024-09-12T12:12:50.664052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512497+0000","last_change":"2024-09-12T12:12:44.856860+0000","last_active":"2024-09-12T12:12:50.512497+0000","last_peered":"2024-09-12T12:12:50.512497+0000","last_clean":"2024-09-12T12:12:50.512497+0000","last_became_active":"2024-09-12T12:12:44.856519+0000","last_became_peered":"2024-09-12T12:12:44.856519+0000","last_unstale":"2024-09-12T12:12:50.512497+0000","last_undegraded":"2024-09-12T12:12:50.512497+0000","last_fullsized":"2024-09-12T12:12:50.512497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:11.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178221+0000","last_change":"2024-09-12T12:12:44.848555+0000","last_active":"2024-09-12T12:12:50.178221+0000","last_peered":"2024-09-12T12:12:50.178221+0000","last_clean":"2024-09-12T12:12:50.178221+0000","last_became_active":"2024-09-12T12:12:44.848264+0000","last_became_peered":"2024-09-12T12:12:44.848264+0000","last_unstale":"2024-09-12T12:12:50.178221+0000","last_undegraded":"2024-09-12T12:12:50.178221+0000","last_fullsized":"2024-09-12T12:12:50.178221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517342+0000","last_change":"2024-09-12T12:12:44.871273+0000","last_active":"2024-09-12T12:12:50.517342+0000","last_peered":"2024-09-12T12:12:50.517342+0000","last_clean":"2024-09-12T12:12:50.517342+0000","last_became_active":"2024-09-12T12:12:44.871000+0000","last_became_peered":"2024-09-12T12:12:44.871000+0000","last_unstale":"2024-09-12T12:12:50.517342+0000","last_undegraded":"2024-09-12T12:12:50.517342+0000","last_fullsized":"2024-09-12T12:12:50.517342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.339698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125660+0000","last_change":"2024-09-12T12:12:44.852240+0000","last_active":"2024-09-12T12:12:51.125660+0000","last_peered":"2024-09-12T12:12:51.125660+0000","last_clean":"2024-09-12T12:12:51.125660+0000","last_became_active":"2024-09-12T12:12:44.851932+0000","last_became_peered":"2024-09-12T12:12:44.851932+0000","last_unstale":"2024-09-12T12:12:51.125660+0000","last_undegraded":"2024-09-12T12:12:51.125660+0000","last_fullsized":"2024-09-12T12:12:51.125660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:07.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664682+0000","last_change":"2024-09-12T12:12:44.873027+0000","last_active":"2024-09-12T12:12:50.664682+0000","last_peered":"2024-09-12T12:12:50.664682+0000","last_clean":"2024-09-12T12:12:50.664682+0000","last_became_active":"2024-09-12T12:12:44.872766+0000","last_became_peered":"2024-09-12T12:12:44.872766+0000","last_unstale":"2024-09-12T12:12:50.664682+0000","last_undegraded":"2024-09-12T12:12:50.664682+0000","last_fullsized":"2024-09-12T12:12:50.664682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:17.011556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663750+0000","last_change":"2024-09-12T12:12:44.846340+0000","last_active":"2024-09-12T12:12:50.663750+0000","last_peered":"2024-09-12T12:12:50.663750+0000","last_clean":"2024-09-12T12:12:50.663750+0000","last_became_active":"2024-09-12T12:12:44.846029+0000","last_became_peered":"2024-09-12T12:12:44.846029+0000","last_unstale":"2024-09-12T12:12:50.663750+0000","last_undegraded":"2024-09-12T12:12:50.663750+0000","last_fullsized":"2024-09-12T12:12:50.663750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:00.612407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125028+0000","last_change":"2024-09-12T12:12:44.841774+0000","last_active":"2024-09-12T12:12:51.125028+0000","last_peered":"2024-09-12T12:12:51.125028+0000","last_clean":"2024-09-12T12:12:51.125028+0000","last_became_active":"2024-09-12T12:12:44.841455+0000","last_became_peered":"2024-09-12T12:12:44.841455+0000","last_unstale":"2024-09-12T12:12:51.125028+0000","last_undegraded":"2024-09-12T12:12:51.125028+0000","last_fullsized":"2024-09-12T12:12:51.125028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512467+0000","last_change":"2024-09-12T12:12:44.853169+0000","last_active":"2024-09-12T12:12:50.512467+0000","last_peered":"2024-09-12T12:12:50.512467+0000","last_clean":"2024-09-12T12:12:50.512467+0000","last_became_active":"2024-09-12T12:12:44.852892+0000","last_became_peered":"2024-09-12T12:12:44.852892+0000","last_unstale":"2024-09-12T12:12:50.512467+0000","last_undegraded":"2024-09-12T12:12:50.512467+0000","last_fullsized":"2024-09-12T12:12:50.512467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:35.948872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176814+0000","last_change":"2024-09-12T12:12:44.844754+0000","last_active":"2024-09-12T12:12:50.176814+0000","last_peered":"2024-09-12T12:12:50.176814+0000","last_clean":"2024-09-12T12:12:50.176814+0000","last_became_active":"2024-09-12T12:12:44.844442+0000","last_became_peered":"2024-09-12T12:12:44.844442+0000","last_unstale":"2024-09-12T12:12:50.176814+0000","last_undegraded":"2024-09-12T12:12:50.176814+0000","last_fullsized":"2024-09-12T12:12:50.176814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:31.258440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178826+0000","last_change":"2024-09-12T12:12:44.839270+0000","last_active":"2024-09-12T12:12:50.178826+0000","last_peered":"2024-09-12T12:12:50.178826+0000","last_clean":"2024-09-12T12:12:50.178826+0000","last_became_active":"2024-09-12T12:12:44.838825+0000","last_became_peered":"2024-09-12T12:12:44.838825+0000","last_unstale":"2024-09-12T12:12:50.178826+0000","last_undegraded":"2024-09-12T12:12:50.178826+0000","last_fullsized":"2024-09-12T12:12:50.178826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:29.908514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178340+0000","last_change":"2024-09-12T12:12:44.845641+0000","last_active":"2024-09-12T12:12:50.178340+0000","last_peered":"2024-09-12T12:12:50.178340+0000","last_clean":"2024-09-12T12:12:50.178340+0000","last_became_active":"2024-09-12T12:12:44.845161+0000","last_became_peered":"2024-09-12T12:12:44.845161+0000","last_unstale":"2024-09-12T12:12:50.178340+0000","last_undegraded":"2024-09-12T12:12:50.178340+0000","last_fullsized":"2024-09-12T12:12:50.178340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178812+0000","last_change":"2024-09-12T12:12:44.858433+0000","last_active":"2024-09-12T12:12:50.178812+0000","last_peered":"2024-09-12T12:12:50.178812+0000","last_clean":"2024-09-12T12:12:50.178812+0000","last_became_active":"2024-09-12T12:12:44.858113+0000","last_became_peered":"2024-09-12T12:12:44.858113+0000","last_unstale":"2024-09-12T12:12:50.178812+0000","last_undegraded":"2024-09-12T12:12:50.178812+0000","last_fullsized":"2024-09-12T12:12:50.178812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517222+0000","last_change":"2024-09-12T12:12:44.869733+0000","last_active":"2024-09-12T12:12:50.517222+0000","last_peered":"2024-09-12T12:12:50.517222+0000","last_clean":"2024-09-12T12:12:50.517222+0000","last_became_active":"2024-09-12T12:12:44.868192+0000","last_became_peered":"2024-09-12T12:12:44.868192+0000","last_unstale":"2024-09-12T12:12:50.517222+0000","last_undegraded":"2024-09-12T12:12:50.517222+0000","last_fullsized":"2024-09-12T12:12:50.517222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:00.612407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176586+0000","last_change":"2024-09-12T12:12:44.844476+0000","last_active":"2024-09-12T12:12:50.176586+0000","last_peered":"2024-09-12T12:12:50.176586+0000","last_clean":"2024-09-12T12:12:50.176586+0000","last_became_active":"2024-09-12T12:12:44.844240+0000","last_became_peered":"2024-09-12T12:12:44.844240+0000","last_unstale":"2024-09-12T12:12:50.176586+0000","last_undegraded":"2024-09-12T12:12:50.176586+0000","last_fullsized":"2024-09-12T12:12:50.176586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516610+0000","last_change":"2024-09-12T12:12:44.859103+0000","last_active":"2024-09-12T12:12:50.516610+0000","last_peered":"2024-09-12T12:12:50.516610+0000","last_clean":"2024-09-12T12:12:50.516610+0000","last_became_active":"2024-09-12T12:12:44.858792+0000","last_became_peered":"2024-09-12T12:12:44.858792+0000","last_unstale":"2024-09-12T12:12:50.516610+0000","last_undegraded":"2024-09-12T12:12:50.516610+0000","last_fullsized":"2024-09-12T12:12:50.516610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663939+0000","last_change":"2024-09-12T12:12:44.846757+0000","last_active":"2024-09-12T12:12:50.663939+0000","last_peered":"2024-09-12T12:12:50.663939+0000","last_clean":"2024-09-12T12:12:50.663939+0000","last_became_active":"2024-09-12T12:12:44.846487+0000","last_became_peered":"2024-09-12T12:12:44.846487+0000","last_unstale":"2024-09-12T12:12:50.663939+0000","last_undegraded":"2024-09-12T12:12:50.663939+0000","last_fullsized":"2024-09-12T12:12:50.663939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516676+0000","last_change":"2024-09-12T12:12:44.861675+0000","last_active":"2024-09-12T12:12:50.516676+0000","last_peered":"2024-09-12T12:12:50.516676+0000","last_clean":"2024-09-12T12:12:50.516676+0000","last_became_active":"2024-09-12T12:12:44.860557+0000","last_became_peered":"2024-09-12T12:12:44.860557+0000","last_unstale":"2024-09-12T12:12:50.516676+0000","last_undegraded":"2024-09-12T12:12:50.516676+0000","last_fullsized":"2024-09-12T12:12:50.516676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664240+0000","last_change":"2024-09-12T12:12:44.872237+0000","last_active":"2024-09-12T12:12:50.664240+0000","last_peered":"2024-09-12T12:12:50.664240+0000","last_clean":"2024-09-12T12:12:50.664240+0000","last_became_active":"2024-09-12T12:12:44.871938+0000","last_became_peered":"2024-09-12T12:12:44.871938+0000","last_unstale":"2024-09-12T12:12:50.664240+0000","last_undegraded":"2024-09-12T12:12:50.664240+0000","last_fullsized":"2024-09-12T12:12:50.664240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512684+0000","last_change":"2024-09-12T12:12:44.849177+0000","last_active":"2024-09-12T12:12:50.512684+0000","last_peered":"2024-09-12T12:12:50.512684+0000","last_clean":"2024-09-12T12:12:50.512684+0000","last_became_active":"2024-09-12T12:12:44.848855+0000","last_became_peered":"2024-09-12T12:12:44.848855+0000","last_unstale":"2024-09-12T12:12:50.512684+0000","last_undegraded":"2024-09-12T12:12:50.512684+0000","last_fullsized":"2024-09-12T12:12:50.512684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126168+0000","last_change":"2024-09-12T12:12:44.840454+0000","last_active":"2024-09-12T12:12:51.126168+0000","last_peered":"2024-09-12T12:12:51.126168+0000","last_clean":"2024-09-12T12:12:51.126168+0000","last_became_active":"2024-09-12T12:12:44.838175+0000","last_became_peered":"2024-09-12T12:12:44.838175+0000","last_unstale":"2024-09-12T12:12:51.126168+0000","last_undegraded":"2024-09-12T12:12:51.126168+0000","last_fullsized":"2024-09-12T12:12:51.126168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517102+0000","last_change":"2024-09-12T12:12:44.868520+0000","last_active":"2024-09-12T12:12:50.517102+0000","last_peered":"2024-09-12T12:12:50.517102+0000","last_clean":"2024-09-12T12:12:50.517102+0000","last_became_active":"2024-09-12T12:12:44.861576+0000","last_became_peered":"2024-09-12T12:12:44.861576+0000","last_unstale":"2024-09-12T12:12:50.517102+0000","last_undegraded":"2024-09-12T12:12:50.517102+0000","last_fullsized":"2024-09-12T12:12:50.517102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:13:11.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:13:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.377+0000 7f5cc8c00640 1 Processor -- start 2024-09-12T12:13:11.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.377+0000 7f5cc8c00640 1 -- start start 2024-09-12T12:13:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc8c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5cc40b4670 0x7f5cc40b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc8c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc40d1580 con 0x7f5cc40b4200 2024-09-12T12:13:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc8c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc40d1860 con 0x7f5cc415c220 2024-09-12T12:13:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc8c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc40d1320 con 0x7f5cc40b4670 2024-09-12T12:13:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cbbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5cc40b4200 0x7f5cc40b5720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37374/0 (socket says 172.21.15.144:37374) 2024-09-12T12:13:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cbbe00640 1 -- 172.21.15.144:0/2281874502 learned_addr learned my addr 172.21.15.144:0/2281874502 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc2800640 1 --2- 172.21.15.144:0/2281874502 >> v2:172.21.15.165:3300/0 conn(0x7f5cc40b4670 0x7f5cc40b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc1400640 1 -- 172.21.15.144:0/2281874502 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517526325 0 0) 0x7f5cc40d1580 con 0x7f5cc40b4200 2024-09-12T12:13:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc1400640 1 -- 172.21.15.144:0/2281874502 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ca8003530 con 0x7f5cc40b4200 2024-09-12T12:13:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc2800640 1 -- 172.21.15.144:0/2281874502 >> v1:172.21.15.165:6789/0 conn(0x7f5cc415c220 legacy=0x7f5cc40d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc2800640 1 -- 172.21.15.144:0/2281874502 >> v1:172.21.15.144:6789/0 conn(0x7f5cc40b4200 legacy=0x7f5cc40b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.381+0000 7f5cc2800640 1 -- 172.21.15.144:0/2281874502 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc40d1b40 con 0x7f5cc40b4670 2024-09-12T12:13:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc2800640 1 --2- 172.21.15.144:0/2281874502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc40b4670 0x7f5cc40b5e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009d90 tx=0x7f5cbc01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6506d897b506228 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc1400640 1 -- 172.21.15.144:0/2281874502 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0b2070 con 0x7f5cc40b4670 2024-09-12T12:13:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc1400640 1 -- 172.21.15.144:0/2281874502 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cbc0a5a00 con 0x7f5cc40b4670 2024-09-12T12:13:11.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc1400640 1 -- 172.21.15.144:0/2281874502 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0a5db0 con 0x7f5cc40b4670 2024-09-12T12:13:11.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc8c00640 1 -- 172.21.15.144:0/2281874502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc40b4670 msgr2=0x7f5cc40b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc8c00640 1 --2- 172.21.15.144:0/2281874502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc40b4670 0x7f5cc40b5e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc009d90 tx=0x7f5cbc01c940 comp rx=0 tx=0).stop 2024-09-12T12:13:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc8c00640 1 -- 172.21.15.144:0/2281874502 shutdown_connections 2024-09-12T12:13:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc8c00640 1 --2- 172.21.15.144:0/2281874502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc40b4670 0x7f5cc40b5e30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc8c00640 1 -- 172.21.15.144:0/2281874502 >> 172.21.15.144:0/2281874502 conn(0x7f5cc406f400 msgr2=0x7f5cc406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc8c00640 1 -- 172.21.15.144:0/2281874502 shutdown_connections 2024-09-12T12:13:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc8c00640 1 -- 172.21.15.144:0/2281874502 wait complete. 2024-09-12T12:13:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc8c00640 1 Processor -- start 2024-09-12T12:13:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.385+0000 7f5cc8c00640 1 -- start start 2024-09-12T12:13:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cc40b4200 0x7f5cc415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cc40b4670 0x7f5cc41544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc415c220 0x7f5cc406dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc8c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc415c780 con 0x7f5cc40b4200 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc8c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc415c600 con 0x7f5cc415c220 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc4070bf0 con 0x7f5cc40b4670 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cc40b4200 0x7f5cc415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cc40b4200 0x7f5cc415ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51148/0 (socket says 172.21.15.144:51148) 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc1e00640 1 -- 172.21.15.144:0/3824948299 learned_addr learned my addr 172.21.15.144:0/3824948299 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cbbe00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cc40b4670 0x7f5cc41544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc2800640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc415c220 0x7f5cc406dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc1e00640 1 -- 172.21.15.144:0/3824948299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cc40b4670 msgr2=0x7f5cc41544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc1e00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cc40b4670 0x7f5cc41544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc1e00640 1 -- 172.21.15.144:0/3824948299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc415c220 msgr2=0x7f5cc406dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc1e00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc415c220 0x7f5cc406dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc1e00640 1 -- 172.21.15.144:0/3824948299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc4155300 con 0x7f5cc40b4200 2024-09-12T12:13:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc2800640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc415c220 0x7f5cc406dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc1e00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cc40b4200 0x7f5cc415ea10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400c3a0 tx=0x7f5cb400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cba000640 1 -- 172.21.15.144:0/3824948299 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb40052d0 con 0x7f5cc40b4200 2024-09-12T12:13:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cba000640 1 -- 172.21.15.144:0/3824948299 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb4005470 con 0x7f5cc40b4200 2024-09-12T12:13:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc415f080 con 0x7f5cc40b4200 2024-09-12T12:13:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cba000640 1 -- 172.21.15.144:0/3824948299 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4007260 con 0x7f5cc40b4200 2024-09-12T12:13:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc415f640 con 0x7f5cc40b4200 2024-09-12T12:13:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc40d0c10 con 0x7f5cc40b4200 2024-09-12T12:13:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.389+0000 7f5cba000640 1 -- 172.21.15.144:0/3824948299 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5cb4007400 con 0x7f5cc40b4200 2024-09-12T12:13:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.393+0000 7f5cba000640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ca00678f0 0x7f5ca0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.393+0000 7f5cba000640 1 -- 172.21.15.144:0/3824948299 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5cb40854f0 con 0x7f5cc40b4200 2024-09-12T12:13:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.393+0000 7f5cbbe00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ca00678f0 0x7f5ca0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.393+0000 7f5cbbe00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ca00678f0 0x7f5ca0069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4151940 tx=0x7f5cac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.397+0000 7f5cba000640 1 -- 172.21.15.144:0/3824948299 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5cb4055c50 con 0x7f5cc40b4200 2024-09-12T12:13:11.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.553+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5cc406cd20 con 0x7f5ca00678f0 2024-09-12T12:13:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.561+0000 7f5cba000640 1 -- 172.21.15.144:0/3824948299 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f5cc406cd20 con 0x7f5ca00678f0 2024-09-12T12:13:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:13:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ca00678f0 msgr2=0x7f5ca0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ca00678f0 0x7f5ca0069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4151940 tx=0x7f5cac009040 comp rx=0 tx=0).stop 2024-09-12T12:13:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cc40b4200 msgr2=0x7f5cc415ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cc40b4200 0x7f5cc415ea10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400c3a0 tx=0x7f5cb400c860 comp rx=0 tx=0).stop 2024-09-12T12:13:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 shutdown_connections 2024-09-12T12:13:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ca00678f0 0x7f5ca0069db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cc415c220 0x7f5cc406dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cc40b4670 0x7f5cc41544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 --2- 172.21.15.144:0/3824948299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cc40b4200 0x7f5cc415ea10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 >> 172.21.15.144:0/3824948299 conn(0x7f5cc406f400 msgr2=0x7f5cc40b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 shutdown_connections 2024-09-12T12:13:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.565+0000 7f5cc8c00640 1 -- 172.21.15.144:0/3824948299 wait complete. 2024-09-12T12:13:11.589 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-12T12:13:11.381715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3383296,"data_stored":2029436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003282"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513364+0000","last_change":"2024-09-12T12:12:43.854827+0000","last_active":"2024-09-12T12:12:50.513364+0000","last_peered":"2024-09-12T12:12:50.513364+0000","last_clean":"2024-09-12T12:12:50.513364+0000","last_became_active":"2024-09-12T12:12:43.854234+0000","last_became_peered":"2024-09-12T12:12:43.854234+0000","last_unstale":"2024-09-12T12:12:50.513364+0000","last_undegraded":"2024-09-12T12:12:50.513364+0000","last_fullsized":"2024-09-12T12:12:50.513364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.059875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177273+0000","last_change":"2024-09-12T12:12:44.850415+0000","last_active":"2024-09-12T12:12:50.177273+0000","last_peered":"2024-09-12T12:12:50.177273+0000","last_clean":"2024-09-12T12:12:50.177273+0000","last_became_active":"2024-09-12T12:12:44.849823+0000","last_became_peered":"2024-09-12T12:12:44.849823+0000","last_unstale":"2024-09-12T12:12:50.177273+0000","last_undegraded":"2024-09-12T12:12:50.177273+0000","last_fullsized":"2024-09-12T12:12:50.177273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176576+0000","last_change":"2024-09-12T12:12:49.236999+0000","last_active":"2024-09-12T12:12:50.176576+0000","last_peered":"2024-09-12T12:12:50.176576+0000","last_clean":"2024-09-12T12:12:50.176576+0000","last_became_active":"2024-09-12T12:12:49.236615+0000","last_became_peered":"2024-09-12T12:12:49.236615+0000","last_unstale":"2024-09-12T12:12:50.176576+0000","last_undegraded":"2024-09-12T12:12:50.176576+0000","last_fullsized":"2024-09-12T12:12:50.176576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.973179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177466+0000","last_change":"2024-09-12T12:12:43.838111+0000","last_active":"2024-09-12T12:12:50.177466+0000","last_peered":"2024-09-12T12:12:50.177466+0000","last_clean":"2024-09-12T12:12:50.177466+0000","last_became_active":"2024-09-12T12:12:43.837789+0000","last_became_peered":"2024-09-12T12:12:43.837789+0000","last_unstale":"2024-09-12T12:12:50.177466+0000","last_undegraded":"2024-09-12T12:12:50.177466+0000","last_fullsized":"2024-09-12T12:12:50.177466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:35.915450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513110+0000","last_change":"2024-09-12T12:12:44.866423+0000","last_active":"2024-09-12T12:12:50.513110+0000","last_peered":"2024-09-12T12:12:50.513110+0000","last_clean":"2024-09-12T12:12:50.513110+0000","last_became_active":"2024-09-12T12:12:44.866168+0000","last_became_peered":"2024-09-12T12:12:44.866168+0000","last_unstale":"2024-09-12T12:12:50.513110+0000","last_undegraded":"2024-09-12T12:12:50.513110+0000","last_fullsized":"2024-09-12T12:12:50.513110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177230+0000","last_change":"2024-09-12T12:12:49.204118+0000","last_active":"2024-09-12T12:12:50.177230+0000","last_peered":"2024-09-12T12:12:50.177230+0000","last_clean":"2024-09-12T12:12:50.177230+0000","last_became_active":"2024-09-12T12:12:49.203691+0000","last_became_peered":"2024-09-12T12:12:49.203691+0000","last_unstale":"2024-09-12T12:12:50.177230+0000","last_undegraded":"2024-09-12T12:12:50.177230+0000","last_fullsized":"2024-09-12T12:12:50.177230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:35.607283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517260+0000","last_change":"2024-09-12T12:12:43.858755+0000","last_active":"2024-09-12T12:12:50.517260+0000","last_peered":"2024-09-12T12:12:50.517260+0000","last_clean":"2024-09-12T12:12:50.517260+0000","last_became_active":"2024-09-12T12:12:43.858306+0000","last_became_peered":"2024-09-12T12:12:43.858306+0000","last_unstale":"2024-09-12T12:12:50.517260+0000","last_undegraded":"2024-09-12T12:12:50.517260+0000","last_fullsized":"2024-09-12T12:12:50.517260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664377+0000","last_change":"2024-09-12T12:12:44.868441+0000","last_active":"2024-09-12T12:12:50.664377+0000","last_peered":"2024-09-12T12:12:50.664377+0000","last_clean":"2024-09-12T12:12:50.664377+0000","last_became_active":"2024-09-12T12:12:44.866463+0000","last_became_peered":"2024-09-12T12:12:44.866463+0000","last_unstale":"2024-09-12T12:12:50.664377+0000","last_undegraded":"2024-09-12T12:12:50.664377+0000","last_fullsized":"2024-09-12T12:12:50.664377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177347+0000","last_change":"2024-09-12T12:12:49.196167+0000","last_active":"2024-09-12T12:12:50.177347+0000","last_peered":"2024-09-12T12:12:50.177347+0000","last_clean":"2024-09-12T12:12:50.177347+0000","last_became_active":"2024-09-12T12:12:49.195584+0000","last_became_peered":"2024-09-12T12:12:49.195584+0000","last_unstale":"2024-09-12T12:12:50.177347+0000","last_undegraded":"2024-09-12T12:12:50.177347+0000","last_fullsized":"2024-09-12T12:12:50.177347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:21.660305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516953+0000","last_change":"2024-09-12T12:12:43.858662+0000","last_active":"2024-09-12T12:12:50.516953+0000","last_peered":"2024-09-12T12:12:50.516953+0000","last_clean":"2024-09-12T12:12:50.516953+0000","last_became_active":"2024-09-12T12:12:43.858322+0000","last_became_peered":"2024-09-12T12:12:43.858322+0000","last_unstale":"2024-09-12T12:12:50.516953+0000","last_undegraded":"2024-09-12T12:12:50.516953+0000","last_fullsized":"2024-09-12T12:12:50.516953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664591+0000","last_change":"2024-09-12T12:12:44.863427+0000","last_active":"2024-09-12T12:12:50.664591+0000","last_peered":"2024-09-12T12:12:50.664591+0000","last_clean":"2024-09-12T12:12:50.664591+0000","last_became_active":"2024-09-12T12:12:44.863173+0000","last_became_peered":"2024-09-12T12:12:44.863173+0000","last_unstale":"2024-09-12T12:12:50.664591+0000","last_undegraded":"2024-09-12T12:12:50.664591+0000","last_fullsized":"2024-09-12T12:12:50.664591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:15.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177891+0000","last_change":"2024-09-12T12:12:49.196228+0000","last_active":"2024-09-12T12:12:50.177891+0000","last_peered":"2024-09-12T12:12:50.177891+0000","last_clean":"2024-09-12T12:12:50.177891+0000","last_became_active":"2024-09-12T12:12:49.195611+0000","last_became_peered":"2024-09-12T12:12:49.195611+0000","last_unstale":"2024-09-12T12:12:50.177891+0000","last_undegraded":"2024-09-12T12:12:50.177891+0000","last_fullsized":"2024-09-12T12:12:50.177891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:48.359326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177371+0000","last_change":"2024-09-12T12:12:44.846595+0000","last_active":"2024-09-12T12:12:50.177371+0000","last_peered":"2024-09-12T12:12:50.177371+0000","last_clean":"2024-09-12T12:12:50.177371+0000","last_became_active":"2024-09-12T12:12:44.846334+0000","last_became_peered":"2024-09-12T12:12:44.846334+0000","last_unstale":"2024-09-12T12:12:50.177371+0000","last_undegraded":"2024-09-12T12:12:50.177371+0000","last_fullsized":"2024-09-12T12:12:50.177371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516972+0000","last_change":"2024-09-12T12:12:43.857695+0000","last_active":"2024-09-12T12:12:50.516972+0000","last_peered":"2024-09-12T12:12:50.516972+0000","last_clean":"2024-09-12T12:12:50.516972+0000","last_became_active":"2024-09-12T12:12:43.857427+0000","last_became_peered":"2024-09-12T12:12:43.857427+0000","last_unstale":"2024-09-12T12:12:50.516972+0000","last_undegraded":"2024-09-12T12:12:50.516972+0000","last_fullsized":"2024-09-12T12:12:50.516972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:35.915450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179125+0000","last_change":"2024-09-12T12:12:49.190846+0000","last_active":"2024-09-12T12:12:50.179125+0000","last_peered":"2024-09-12T12:12:50.179125+0000","last_clean":"2024-09-12T12:12:50.179125+0000","last_became_active":"2024-09-12T12:12:49.190417+0000","last_became_peered":"2024-09-12T12:12:49.190417+0000","last_unstale":"2024-09-12T12:12:50.179125+0000","last_undegraded":"2024-09-12T12:12:50.179125+0000","last_fullsized":"2024-09-12T12:12:50.179125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176911+0000","last_change":"2024-09-12T12:12:44.866244+0000","last_active":"2024-09-12T12:12:50.176911+0000","last_peered":"2024-09-12T12:12:50.176911+0000","last_clean":"2024-09-12T12:12:50.176911+0000","last_became_active":"2024-09-12T12:12:44.862336+0000","last_became_peered":"2024-09-12T12:12:44.862336+0000","last_unstale":"2024-09-12T12:12:50.176911+0000","last_undegraded":"2024-09-12T12:12:50.176911+0000","last_fullsized":"2024-09-12T12:12:50.176911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125510+0000","last_change":"2024-09-12T12:12:43.842526+0000","last_active":"2024-09-12T12:12:51.125510+0000","last_peered":"2024-09-12T12:12:51.125510+0000","last_clean":"2024-09-12T12:12:51.125510+0000","last_became_active":"2024-09-12T12:12:43.842238+0000","last_became_peered":"2024-09-12T12:12:43.842238+0000","last_unstale":"2024-09-12T12:12:51.125510+0000","last_undegraded":"2024-09-12T12:12:51.125510+0000","last_fullsized":"2024-09-12T12:12:51.125510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178671+0000","last_change":"2024-09-12T12:12:49.204542+0000","last_active":"2024-09-12T12:12:50.178671+0000","last_peered":"2024-09-12T12:12:50.178671+0000","last_clean":"2024-09-12T12:12:50.178671+0000","last_became_active":"2024-09-12T12:12:49.204013+0000","last_became_peered":"2024-09-12T12:12:49.204013+0000","last_unstale":"2024-09-12T12:12:50.178671+0000","last_undegraded":"2024-09-12T12:12:50.178671+0000","last_fullsized":"2024-09-12T12:12:50.178671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:36.758809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176780+0000","last_change":"2024-09-12T12:12:44.861505+0000","last_active":"2024-09-12T12:12:50.176780+0000","last_peered":"2024-09-12T12:12:50.176780+0000","last_clean":"2024-09-12T12:12:50.176780+0000","last_became_active":"2024-09-12T12:12:44.861217+0000","last_became_peered":"2024-09-12T12:12:44.861217+0000","last_unstale":"2024-09-12T12:12:50.176780+0000","last_undegraded":"2024-09-12T12:12:50.176780+0000","last_fullsized":"2024-09-12T12:12:50.176780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125097+0000","last_change":"2024-09-12T12:12:43.846034+0000","last_active":"2024-09-12T12:12:51.125097+0000","last_peered":"2024-09-12T12:12:51.125097+0000","last_clean":"2024-09-12T12:12:51.125097+0000","last_became_active":"2024-09-12T12:12:43.845492+0000","last_became_peered":"2024-09-12T12:12:43.845492+0000","last_unstale":"2024-09-12T12:12:51.125097+0000","last_undegraded":"2024-09-12T12:12:51.125097+0000","last_fullsized":"2024-09-12T12:12:51.125097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125970+0000","last_change":"2024-09-12T12:12:49.238233+0000","last_active":"2024-09-12T12:12:51.125970+0000","last_peered":"2024-09-12T12:12:51.125970+0000","last_clean":"2024-09-12T12:12:51.125970+0000","last_became_active":"2024-09-12T12:12:49.237705+0000","last_became_peered":"2024-09-12T12:12:49.237705+0000","last_unstale":"2024-09-12T12:12:51.125970+0000","last_undegraded":"2024-09-12T12:12:51.125970+0000","last_fullsized":"2024-09-12T12:12:51.125970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:21.360400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177834+0000","last_change":"2024-09-12T12:12:44.854329+0000","last_active":"2024-09-12T12:12:50.177834+0000","last_peered":"2024-09-12T12:12:50.177834+0000","last_clean":"2024-09-12T12:12:50.177834+0000","last_became_active":"2024-09-12T12:12:44.854125+0000","last_became_peered":"2024-09-12T12:12:44.854125+0000","last_unstale":"2024-09-12T12:12:50.177834+0000","last_undegraded":"2024-09-12T12:12:50.177834+0000","last_fullsized":"2024-09-12T12:12:50.177834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:09.458022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516448+0000","last_change":"2024-09-12T12:12:43.853652+0000","last_active":"2024-09-12T12:12:50.516448+0000","last_peered":"2024-09-12T12:12:50.516448+0000","last_clean":"2024-09-12T12:12:50.516448+0000","last_became_active":"2024-09-12T12:12:43.853375+0000","last_became_peered":"2024-09-12T12:12:43.853375+0000","last_unstale":"2024-09-12T12:12:50.516448+0000","last_undegraded":"2024-09-12T12:12:50.516448+0000","last_fullsized":"2024-09-12T12:12:50.516448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179414+0000","last_change":"2024-09-12T12:12:49.196067+0000","last_active":"2024-09-12T12:12:50.179414+0000","last_peered":"2024-09-12T12:12:50.179414+0000","last_clean":"2024-09-12T12:12:50.179414+0000","last_became_active":"2024-09-12T12:12:49.195668+0000","last_became_peered":"2024-09-12T12:12:49.195668+0000","last_unstale":"2024-09-12T12:12:50.179414+0000","last_undegraded":"2024-09-12T12:12:50.179414+0000","last_fullsized":"2024-09-12T12:12:50.179414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:40.014673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513018+0000","last_change":"2024-09-12T12:12:44.843136+0000","last_active":"2024-09-12T12:12:50.513018+0000","last_peered":"2024-09-12T12:12:50.513018+0000","last_clean":"2024-09-12T12:12:50.513018+0000","last_became_active":"2024-09-12T12:12:44.842828+0000","last_became_peered":"2024-09-12T12:12:44.842828+0000","last_unstale":"2024-09-12T12:12:50.513018+0000","last_undegraded":"2024-09-12T12:12:50.513018+0000","last_fullsized":"2024-09-12T12:12:50.513018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178520+0000","last_change":"2024-09-12T12:12:43.853992+0000","last_active":"2024-09-12T12:12:50.178520+0000","last_peered":"2024-09-12T12:12:50.178520+0000","last_clean":"2024-09-12T12:12:50.178520+0000","last_became_active":"2024-09-12T12:12:43.853565+0000","last_became_peered":"2024-09-12T12:12:43.853565+0000","last_unstale":"2024-09-12T12:12:50.178520+0000","last_undegraded":"2024-09-12T12:12:50.178520+0000","last_fullsized":"2024-09-12T12:12:50.178520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177496+0000","last_change":"2024-09-12T12:12:49.237840+0000","last_active":"2024-09-12T12:12:50.177496+0000","last_peered":"2024-09-12T12:12:50.177496+0000","last_clean":"2024-09-12T12:12:50.177496+0000","last_became_active":"2024-09-12T12:12:49.237366+0000","last_became_peered":"2024-09-12T12:12:49.237366+0000","last_unstale":"2024-09-12T12:12:50.177496+0000","last_undegraded":"2024-09-12T12:12:50.177496+0000","last_fullsized":"2024-09-12T12:12:50.177496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:32.420795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177705+0000","last_change":"2024-09-12T12:12:44.863064+0000","last_active":"2024-09-12T12:12:50.177705+0000","last_peered":"2024-09-12T12:12:50.177705+0000","last_clean":"2024-09-12T12:12:50.177705+0000","last_became_active":"2024-09-12T12:12:44.862295+0000","last_became_peered":"2024-09-12T12:12:44.862295+0000","last_unstale":"2024-09-12T12:12:50.177705+0000","last_undegraded":"2024-09-12T12:12:50.177705+0000","last_fullsized":"2024-09-12T12:12:50.177705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126177+0000","last_change":"2024-09-12T12:12:43.844539+0000","last_active":"2024-09-12T12:12:51.126177+0000","last_peered":"2024-09-12T12:12:51.126177+0000","last_clean":"2024-09-12T12:12:51.126177+0000","last_became_active":"2024-09-12T12:12:43.844303+0000","last_became_peered":"2024-09-12T12:12:43.844303+0000","last_unstale":"2024-09-12T12:12:51.126177+0000","last_undegraded":"2024-09-12T12:12:51.126177+0000","last_fullsized":"2024-09-12T12:12:51.126177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176517+0000","last_change":"2024-09-12T12:12:49.234495+0000","last_active":"2024-09-12T12:12:50.176517+0000","last_peered":"2024-09-12T12:12:50.176517+0000","last_clean":"2024-09-12T12:12:50.176517+0000","last_became_active":"2024-09-12T12:12:49.233400+0000","last_became_peered":"2024-09-12T12:12:49.233400+0000","last_unstale":"2024-09-12T12:12:50.176517+0000","last_undegraded":"2024-09-12T12:12:50.176517+0000","last_fullsized":"2024-09-12T12:12:50.176517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:09.355445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126175+0000","last_change":"2024-09-12T12:12:44.848284+0000","last_active":"2024-09-12T12:12:51.126175+0000","last_peered":"2024-09-12T12:12:51.126175+0000","last_clean":"2024-09-12T12:12:51.126175+0000","last_became_active":"2024-09-12T12:12:44.848024+0000","last_became_peered":"2024-09-12T12:12:44.848024+0000","last_unstale":"2024-09-12T12:12:51.126175+0000","last_undegraded":"2024-09-12T12:12:51.126175+0000","last_fullsized":"2024-09-12T12:12:51.126175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517386+0000","last_change":"2024-09-12T12:12:43.855069+0000","last_active":"2024-09-12T12:12:50.517386+0000","last_peered":"2024-09-12T12:12:50.517386+0000","last_clean":"2024-09-12T12:12:50.517386+0000","last_became_active":"2024-09-12T12:12:43.854801+0000","last_became_peered":"2024-09-12T12:12:43.854801+0000","last_unstale":"2024-09-12T12:12:50.517386+0000","last_undegraded":"2024-09-12T12:12:50.517386+0000","last_fullsized":"2024-09-12T12:12:50.517386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:10:14.539671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512594+0000","last_change":"2024-09-12T12:12:49.236330+0000","last_active":"2024-09-12T12:12:50.512594+0000","last_peered":"2024-09-12T12:12:50.512594+0000","last_clean":"2024-09-12T12:12:50.512594+0000","last_became_active":"2024-09-12T12:12:49.235941+0000","last_became_peered":"2024-09-12T12:12:49.235941+0000","last_unstale":"2024-09-12T12:12:50.512594+0000","last_undegraded":"2024-09-12T12:12:50.512594+0000","last_fullsized":"2024-09-12T12:12:50.512594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:21.360400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664641+0000","last_change":"2024-09-12T12:12:44.865593+0000","last_active":"2024-09-12T12:12:50.664641+0000","last_peered":"2024-09-12T12:12:50.664641+0000","last_clean":"2024-09-12T12:12:50.664641+0000","last_became_active":"2024-09-12T12:12:44.865207+0000","last_became_peered":"2024-09-12T12:12:44.865207+0000","last_unstale":"2024-09-12T12:12:50.664641+0000","last_undegraded":"2024-09-12T12:12:50.664641+0000","last_fullsized":"2024-09-12T12:12:50.664641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:35.665829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126175+0000","last_change":"2024-09-12T12:12:43.840268+0000","last_active":"2024-09-12T12:12:51.126175+0000","last_peered":"2024-09-12T12:12:51.126175+0000","last_clean":"2024-09-12T12:12:51.126175+0000","last_became_active":"2024-09-12T12:12:43.839978+0000","last_became_peered":"2024-09-12T12:12:43.839978+0000","last_unstale":"2024-09-12T12:12:51.126175+0000","last_undegraded":"2024-09-12T12:12:51.126175+0000","last_fullsized":"2024-09-12T12:12:51.126175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125228+0000","last_change":"2024-09-12T12:12:49.201974+0000","last_active":"2024-09-12T12:12:51.125228+0000","last_peered":"2024-09-12T12:12:51.125228+0000","last_clean":"2024-09-12T12:12:51.125228+0000","last_became_active":"2024-09-12T12:12:49.201363+0000","last_became_peered":"2024-09-12T12:12:49.201363+0000","last_unstale":"2024-09-12T12:12:51.125228+0000","last_undegraded":"2024-09-12T12:12:51.125228+0000","last_fullsized":"2024-09-12T12:12:51.125228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.179210+0000","last_change":"2024-09-12T12:12:44.850770+0000","last_active":"2024-09-12T12:12:50.179210+0000","last_peered":"2024-09-12T12:12:50.179210+0000","last_clean":"2024-09-12T12:12:50.179210+0000","last_became_active":"2024-09-12T12:12:44.842455+0000","last_became_peered":"2024-09-12T12:12:44.842455+0000","last_unstale":"2024-09-12T12:12:50.179210+0000","last_undegraded":"2024-09-12T12:12:50.179210+0000","last_fullsized":"2024-09-12T12:12:50.179210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:15.274937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664457+0000","last_change":"2024-09-12T12:12:43.848461+0000","last_active":"2024-09-12T12:12:50.664457+0000","last_peered":"2024-09-12T12:12:50.664457+0000","last_clean":"2024-09-12T12:12:50.664457+0000","last_became_active":"2024-09-12T12:12:43.847953+0000","last_became_peered":"2024-09-12T12:12:43.847953+0000","last_unstale":"2024-09-12T12:12:50.664457+0000","last_undegraded":"2024-09-12T12:12:50.664457+0000","last_fullsized":"2024-09-12T12:12:50.664457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:28.901904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126063+0000","last_change":"2024-09-12T12:12:49.200796+0000","last_active":"2024-09-12T12:12:51.126063+0000","last_peered":"2024-09-12T12:12:51.126063+0000","last_clean":"2024-09-12T12:12:51.126063+0000","last_became_active":"2024-09-12T12:12:49.200352+0000","last_became_peered":"2024-09-12T12:12:49.200352+0000","last_unstale":"2024-09-12T12:12:51.126063+0000","last_undegraded":"2024-09-12T12:12:51.126063+0000","last_fullsized":"2024-09-12T12:12:51.126063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:54.688541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125166+0000","last_change":"2024-09-12T12:12:44.861229+0000","last_active":"2024-09-12T12:12:51.125166+0000","last_peered":"2024-09-12T12:12:51.125166+0000","last_clean":"2024-09-12T12:12:51.125166+0000","last_became_active":"2024-09-12T12:12:44.855880+0000","last_became_peered":"2024-09-12T12:12:44.855880+0000","last_unstale":"2024-09-12T12:12:51.125166+0000","last_undegraded":"2024-09-12T12:12:51.125166+0000","last_fullsized":"2024-09-12T12:12:51.125166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124771+0000","last_change":"2024-09-12T12:12:43.843781+0000","last_active":"2024-09-12T12:12:51.124771+0000","last_peered":"2024-09-12T12:12:51.124771+0000","last_clean":"2024-09-12T12:12:51.124771+0000","last_became_active":"2024-09-12T12:12:43.843510+0000","last_became_peered":"2024-09-12T12:12:43.843510+0000","last_unstale":"2024-09-12T12:12:51.124771+0000","last_undegraded":"2024-09-12T12:12:51.124771+0000","last_fullsized":"2024-09-12T12:12:51.124771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126036+0000","last_change":"2024-09-12T12:12:49.201170+0000","last_active":"2024-09-12T12:12:51.126036+0000","last_peered":"2024-09-12T12:12:51.126036+0000","last_clean":"2024-09-12T12:12:51.126036+0000","last_became_active":"2024-09-12T12:12:49.200754+0000","last_became_peered":"2024-09-12T12:12:49.200754+0000","last_unstale":"2024-09-12T12:12:51.126036+0000","last_undegraded":"2024-09-12T12:12:51.126036+0000","last_fullsized":"2024-09-12T12:12:51.126036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:33.368245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512181+0000","last_change":"2024-09-12T12:12:44.839123+0000","last_active":"2024-09-12T12:12:50.512181+0000","last_peered":"2024-09-12T12:12:50.512181+0000","last_clean":"2024-09-12T12:12:50.512181+0000","last_became_active":"2024-09-12T12:12:44.838887+0000","last_became_peered":"2024-09-12T12:12:44.838887+0000","last_unstale":"2024-09-12T12:12:50.512181+0000","last_undegraded":"2024-09-12T12:12:50.512181+0000","last_fullsized":"2024-09-12T12:12:50.512181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:31.037954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516448+0000","last_change":"2024-09-12T12:12:43.853714+0000","last_active":"2024-09-12T12:12:50.516448+0000","last_peered":"2024-09-12T12:12:50.516448+0000","last_clean":"2024-09-12T12:12:50.516448+0000","last_became_active":"2024-09-12T12:12:43.853354+0000","last_became_peered":"2024-09-12T12:12:43.853354+0000","last_unstale":"2024-09-12T12:12:50.516448+0000","last_undegraded":"2024-09-12T12:12:50.516448+0000","last_fullsized":"2024-09-12T12:12:50.516448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512950+0000","last_change":"2024-09-12T12:12:49.233432+0000","last_active":"2024-09-12T12:12:50.512950+0000","last_peered":"2024-09-12T12:12:50.512950+0000","last_clean":"2024-09-12T12:12:50.512950+0000","last_became_active":"2024-09-12T12:12:49.232960+0000","last_became_peered":"2024-09-12T12:12:49.232960+0000","last_unstale":"2024-09-12T12:12:50.512950+0000","last_undegraded":"2024-09-12T12:12:50.512950+0000","last_fullsized":"2024-09-12T12:12:50.512950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:29.872131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176900+0000","last_change":"2024-09-12T12:12:44.866650+0000","last_active":"2024-09-12T12:12:50.176900+0000","last_peered":"2024-09-12T12:12:50.176900+0000","last_clean":"2024-09-12T12:12:50.176900+0000","last_became_active":"2024-09-12T12:12:44.866307+0000","last_became_peered":"2024-09-12T12:12:44.866307+0000","last_unstale":"2024-09-12T12:12:50.176900+0000","last_undegraded":"2024-09-12T12:12:50.176900+0000","last_fullsized":"2024-09-12T12:12:50.176900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664136+0000","last_change":"2024-09-12T12:12:43.850483+0000","last_active":"2024-09-12T12:12:50.664136+0000","last_peered":"2024-09-12T12:12:50.664136+0000","last_clean":"2024-09-12T12:12:50.664136+0000","last_became_active":"2024-09-12T12:12:43.850143+0000","last_became_peered":"2024-09-12T12:12:43.850143+0000","last_unstale":"2024-09-12T12:12:50.664136+0000","last_undegraded":"2024-09-12T12:12:50.664136+0000","last_fullsized":"2024-09-12T12:12:50.664136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516596+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:12:50.516596+0000","last_peered":"2024-09-12T12:12:50.516596+0000","last_clean":"2024-09-12T12:12:50.516596+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:12:50.516596+0000","last_undegraded":"2024-09-12T12:12:50.516596+0000","last_fullsized":"2024-09-12T12:12:50.516596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178235+0000","last_change":"2024-09-12T12:12:49.235904+0000","last_active":"2024-09-12T12:12:50.178235+0000","last_peered":"2024-09-12T12:12:50.178235+0000","last_clean":"2024-09-12T12:12:50.178235+0000","last_became_active":"2024-09-12T12:12:49.235548+0000","last_became_peered":"2024-09-12T12:12:49.235548+0000","last_unstale":"2024-09-12T12:12:50.178235+0000","last_undegraded":"2024-09-12T12:12:50.178235+0000","last_fullsized":"2024-09-12T12:12:50.178235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:19.933379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517137+0000","last_change":"2024-09-12T12:12:44.866993+0000","last_active":"2024-09-12T12:12:50.517137+0000","last_peered":"2024-09-12T12:12:50.517137+0000","last_clean":"2024-09-12T12:12:50.517137+0000","last_became_active":"2024-09-12T12:12:44.866717+0000","last_became_peered":"2024-09-12T12:12:44.866717+0000","last_unstale":"2024-09-12T12:12:50.517137+0000","last_undegraded":"2024-09-12T12:12:50.517137+0000","last_fullsized":"2024-09-12T12:12:50.517137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:29.019401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125386+0000","last_change":"2024-09-12T12:12:43.857565+0000","last_active":"2024-09-12T12:12:51.125386+0000","last_peered":"2024-09-12T12:12:51.125386+0000","last_clean":"2024-09-12T12:12:51.125386+0000","last_became_active":"2024-09-12T12:12:43.857320+0000","last_became_peered":"2024-09-12T12:12:43.857320+0000","last_unstale":"2024-09-12T12:12:51.125386+0000","last_undegraded":"2024-09-12T12:12:51.125386+0000","last_fullsized":"2024-09-12T12:12:51.125386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177268+0000","last_change":"2024-09-12T12:12:49.233077+0000","last_active":"2024-09-12T12:12:50.177268+0000","last_peered":"2024-09-12T12:12:50.177268+0000","last_clean":"2024-09-12T12:12:50.177268+0000","last_became_active":"2024-09-12T12:12:49.232399+0000","last_became_peered":"2024-09-12T12:12:49.232399+0000","last_unstale":"2024-09-12T12:12:50.177268+0000","last_undegraded":"2024-09-12T12:12:50.177268+0000","last_fullsized":"2024-09-12T12:12:50.177268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:36.758809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664546+0000","last_change":"2024-09-12T12:12:44.863346+0000","last_active":"2024-09-12T12:12:50.664546+0000","last_peered":"2024-09-12T12:12:50.664546+0000","last_clean":"2024-09-12T12:12:50.664546+0000","last_became_active":"2024-09-12T12:12:44.863022+0000","last_became_peered":"2024-09-12T12:12:44.863022+0000","last_unstale":"2024-09-12T12:12:50.664546+0000","last_undegraded":"2024-09-12T12:12:50.664546+0000","last_fullsized":"2024-09-12T12:12:50.664546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125799+0000","last_change":"2024-09-12T12:12:43.843497+0000","last_active":"2024-09-12T12:12:51.125799+0000","last_peered":"2024-09-12T12:12:51.125799+0000","last_clean":"2024-09-12T12:12:51.125799+0000","last_became_active":"2024-09-12T12:12:43.843205+0000","last_became_peered":"2024-09-12T12:12:43.843205+0000","last_unstale":"2024-09-12T12:12:51.125799+0000","last_undegraded":"2024-09-12T12:12:51.125799+0000","last_fullsized":"2024-09-12T12:12:51.125799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512708+0000","last_change":"2024-09-12T12:12:49.194951+0000","last_active":"2024-09-12T12:12:50.512708+0000","last_peered":"2024-09-12T12:12:50.512708+0000","last_clean":"2024-09-12T12:12:50.512708+0000","last_became_active":"2024-09-12T12:12:49.193406+0000","last_became_peered":"2024-09-12T12:12:49.193406+0000","last_unstale":"2024-09-12T12:12:50.512708+0000","last_undegraded":"2024-09-12T12:12:50.512708+0000","last_fullsized":"2024-09-12T12:12:50.512708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:33.368245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517235+0000","last_change":"2024-09-12T12:12:44.873360+0000","last_active":"2024-09-12T12:12:50.517235+0000","last_peered":"2024-09-12T12:12:50.517235+0000","last_clean":"2024-09-12T12:12:50.517235+0000","last_became_active":"2024-09-12T12:12:44.871164+0000","last_became_peered":"2024-09-12T12:12:44.871164+0000","last_unstale":"2024-09-12T12:12:50.517235+0000","last_undegraded":"2024-09-12T12:12:50.517235+0000","last_fullsized":"2024-09-12T12:12:50.517235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:15.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125672+0000","last_change":"2024-09-12T12:12:43.844520+0000","last_active":"2024-09-12T12:12:51.125672+0000","last_peered":"2024-09-12T12:12:51.125672+0000","last_clean":"2024-09-12T12:12:51.125672+0000","last_became_active":"2024-09-12T12:12:43.844192+0000","last_became_peered":"2024-09-12T12:12:43.844192+0000","last_unstale":"2024-09-12T12:12:51.125672+0000","last_undegraded":"2024-09-12T12:12:51.125672+0000","last_fullsized":"2024-09-12T12:12:51.125672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663736+0000","last_change":"2024-09-12T12:12:49.235687+0000","last_active":"2024-09-12T12:12:50.663736+0000","last_peered":"2024-09-12T12:12:50.663736+0000","last_clean":"2024-09-12T12:12:50.663736+0000","last_became_active":"2024-09-12T12:12:49.235279+0000","last_became_peered":"2024-09-12T12:12:49.235279+0000","last_unstale":"2024-09-12T12:12:50.663736+0000","last_undegraded":"2024-09-12T12:12:50.663736+0000","last_fullsized":"2024-09-12T12:12:50.663736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:09.355445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517127+0000","last_change":"2024-09-12T12:12:44.869312+0000","last_active":"2024-09-12T12:12:50.517127+0000","last_peered":"2024-09-12T12:12:50.517127+0000","last_clean":"2024-09-12T12:12:50.517127+0000","last_became_active":"2024-09-12T12:12:44.869049+0000","last_became_peered":"2024-09-12T12:12:44.869049+0000","last_unstale":"2024-09-12T12:12:50.517127+0000","last_undegraded":"2024-09-12T12:12:50.517127+0000","last_fullsized":"2024-09-12T12:12:50.517127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178843+0000","last_change":"2024-09-12T12:12:43.850258+0000","last_active":"2024-09-12T12:12:50.178843+0000","last_peered":"2024-09-12T12:12:50.178843+0000","last_clean":"2024-09-12T12:12:50.178843+0000","last_became_active":"2024-09-12T12:12:43.849933+0000","last_became_peered":"2024-09-12T12:12:43.849933+0000","last_unstale":"2024-09-12T12:12:50.178843+0000","last_undegraded":"2024-09-12T12:12:50.178843+0000","last_fullsized":"2024-09-12T12:12:50.178843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:46.059875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177247+0000","last_change":"2024-09-12T12:12:49.204097+0000","last_active":"2024-09-12T12:12:50.177247+0000","last_peered":"2024-09-12T12:12:50.177247+0000","last_clean":"2024-09-12T12:12:50.177247+0000","last_became_active":"2024-09-12T12:12:49.203718+0000","last_became_peered":"2024-09-12T12:12:49.203718+0000","last_unstale":"2024-09-12T12:12:50.177247+0000","last_undegraded":"2024-09-12T12:12:50.177247+0000","last_fullsized":"2024-09-12T12:12:50.177247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:40.026171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516739+0000","last_change":"2024-09-12T12:12:44.869271+0000","last_active":"2024-09-12T12:12:50.516739+0000","last_peered":"2024-09-12T12:12:50.516739+0000","last_clean":"2024-09-12T12:12:50.516739+0000","last_became_active":"2024-09-12T12:12:44.868992+0000","last_became_peered":"2024-09-12T12:12:44.868992+0000","last_unstale":"2024-09-12T12:12:50.516739+0000","last_undegraded":"2024-09-12T12:12:50.516739+0000","last_fullsized":"2024-09-12T12:12:50.516739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:17.011556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124631+0000","last_change":"2024-09-12T12:12:43.838202+0000","last_active":"2024-09-12T12:12:51.124631+0000","last_peered":"2024-09-12T12:12:51.124631+0000","last_clean":"2024-09-12T12:12:51.124631+0000","last_became_active":"2024-09-12T12:12:43.837927+0000","last_became_peered":"2024-09-12T12:12:43.837927+0000","last_unstale":"2024-09-12T12:12:51.124631+0000","last_undegraded":"2024-09-12T12:12:51.124631+0000","last_fullsized":"2024-09-12T12:12:51.124631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:57.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512786+0000","last_change":"2024-09-12T12:12:49.204734+0000","last_active":"2024-09-12T12:12:50.512786+0000","last_peered":"2024-09-12T12:12:50.512786+0000","last_clean":"2024-09-12T12:12:50.512786+0000","last_became_active":"2024-09-12T12:12:49.204387+0000","last_became_peered":"2024-09-12T12:12:49.204387+0000","last_unstale":"2024-09-12T12:12:50.512786+0000","last_undegraded":"2024-09-12T12:12:50.512786+0000","last_fullsized":"2024-09-12T12:12:50.512786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.325777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177498+0000","last_change":"2024-09-12T12:12:44.836998+0000","last_active":"2024-09-12T12:12:50.177498+0000","last_peered":"2024-09-12T12:12:50.177498+0000","last_clean":"2024-09-12T12:12:50.177498+0000","last_became_active":"2024-09-12T12:12:44.836723+0000","last_became_peered":"2024-09-12T12:12:44.836723+0000","last_unstale":"2024-09-12T12:12:50.177498+0000","last_undegraded":"2024-09-12T12:12:50.177498+0000","last_fullsized":"2024-09-12T12:12:50.177498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177648+0000","last_change":"2024-09-12T12:12:43.847610+0000","last_active":"2024-09-12T12:12:50.177648+0000","last_peered":"2024-09-12T12:12:50.177648+0000","last_clean":"2024-09-12T12:12:50.177648+0000","last_became_active":"2024-09-12T12:12:43.846782+0000","last_became_peered":"2024-09-12T12:12:43.846782+0000","last_unstale":"2024-09-12T12:12:50.177648+0000","last_undegraded":"2024-09-12T12:12:50.177648+0000","last_fullsized":"2024-09-12T12:12:50.177648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:39.307917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177641+0000","last_change":"2024-09-12T12:12:49.237439+0000","last_active":"2024-09-12T12:12:50.177641+0000","last_peered":"2024-09-12T12:12:50.177641+0000","last_clean":"2024-09-12T12:12:50.177641+0000","last_became_active":"2024-09-12T12:12:49.236640+0000","last_became_peered":"2024-09-12T12:12:49.236640+0000","last_unstale":"2024-09-12T12:12:50.177641+0000","last_undegraded":"2024-09-12T12:12:50.177641+0000","last_fullsized":"2024-09-12T12:12:50.177641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:48.564758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516862+0000","last_change":"2024-09-12T12:12:44.870489+0000","last_active":"2024-09-12T12:12:50.516862+0000","last_peered":"2024-09-12T12:12:50.516862+0000","last_clean":"2024-09-12T12:12:50.516862+0000","last_became_active":"2024-09-12T12:12:44.869985+0000","last_became_peered":"2024-09-12T12:12:44.869985+0000","last_unstale":"2024-09-12T12:12:50.516862+0000","last_undegraded":"2024-09-12T12:12:50.516862+0000","last_fullsized":"2024-09-12T12:12:50.516862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:35.665829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664336+0000","last_change":"2024-09-12T12:12:43.855159+0000","last_active":"2024-09-12T12:12:50.664336+0000","last_peered":"2024-09-12T12:12:50.664336+0000","last_clean":"2024-09-12T12:12:50.664336+0000","last_became_active":"2024-09-12T12:12:43.854881+0000","last_became_peered":"2024-09-12T12:12:43.854881+0000","last_unstale":"2024-09-12T12:12:50.664336+0000","last_undegraded":"2024-09-12T12:12:50.664336+0000","last_fullsized":"2024-09-12T12:12:50.664336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.492006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177172+0000","last_change":"2024-09-12T12:12:49.238471+0000","last_active":"2024-09-12T12:12:50.177172+0000","last_peered":"2024-09-12T12:12:50.177172+0000","last_clean":"2024-09-12T12:12:50.177172+0000","last_became_active":"2024-09-12T12:12:49.235791+0000","last_became_peered":"2024-09-12T12:12:49.235791+0000","last_unstale":"2024-09-12T12:12:50.177172+0000","last_undegraded":"2024-09-12T12:12:50.177172+0000","last_fullsized":"2024-09-12T12:12:50.177172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:21:33.661174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512468+0000","last_change":"2024-09-12T12:12:44.856728+0000","last_active":"2024-09-12T12:12:50.512468+0000","last_peered":"2024-09-12T12:12:50.512468+0000","last_clean":"2024-09-12T12:12:50.512468+0000","last_became_active":"2024-09-12T12:12:44.856523+0000","last_became_peered":"2024-09-12T12:12:44.856523+0000","last_unstale":"2024-09-12T12:12:50.512468+0000","last_undegraded":"2024-09-12T12:12:50.512468+0000","last_fullsized":"2024-09-12T12:12:50.512468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.435034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512841+0000","last_change":"2024-09-12T12:12:43.845142+0000","last_active":"2024-09-12T12:12:50.512841+0000","last_peered":"2024-09-12T12:12:50.512841+0000","last_clean":"2024-09-12T12:12:50.512841+0000","last_became_active":"2024-09-12T12:12:43.844828+0000","last_became_peered":"2024-09-12T12:12:43.844828+0000","last_unstale":"2024-09-12T12:12:50.512841+0000","last_undegraded":"2024-09-12T12:12:50.512841+0000","last_fullsized":"2024-09-12T12:12:50.512841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:59.203160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664482+0000","last_change":"2024-09-12T12:12:49.233138+0000","last_active":"2024-09-12T12:12:50.664482+0000","last_peered":"2024-09-12T12:12:50.664482+0000","last_clean":"2024-09-12T12:12:50.664482+0000","last_became_active":"2024-09-12T12:12:49.232720+0000","last_became_peered":"2024-09-12T12:12:49.232720+0000","last_unstale":"2024-09-12T12:12:50.664482+0000","last_undegraded":"2024-09-12T12:12:50.664482+0000","last_fullsized":"2024-09-12T12:12:50.664482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:09.973179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517078+0000","last_change":"2024-09-12T12:12:44.864865+0000","last_active":"2024-09-12T12:12:50.517078+0000","last_peered":"2024-09-12T12:12:50.517078+0000","last_clean":"2024-09-12T12:12:50.517078+0000","last_became_active":"2024-09-12T12:12:44.864611+0000","last_became_peered":"2024-09-12T12:12:44.864611+0000","last_unstale":"2024-09-12T12:12:50.517078+0000","last_undegraded":"2024-09-12T12:12:50.517078+0000","last_fullsized":"2024-09-12T12:12:50.517078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:32.409965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:56.111249+0000","last_change":"2024-09-12T12:12:43.841311+0000","last_active":"2024-09-12T12:12:56.111249+0000","last_peered":"2024-09-12T12:12:56.111249+0000","last_clean":"2024-09-12T12:12:56.111249+0000","last_became_active":"2024-09-12T12:12:43.840143+0000","last_became_peered":"2024-09-12T12:12:43.840143+0000","last_unstale":"2024-09-12T12:12:56.111249+0000","last_undegraded":"2024-09-12T12:12:56.111249+0000","last_fullsized":"2024-09-12T12:12:56.111249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125393+0000","last_change":"2024-09-12T12:12:49.201741+0000","last_active":"2024-09-12T12:12:51.125393+0000","last_peered":"2024-09-12T12:12:51.125393+0000","last_clean":"2024-09-12T12:12:51.125393+0000","last_became_active":"2024-09-12T12:12:49.200783+0000","last_became_peered":"2024-09-12T12:12:49.200783+0000","last_unstale":"2024-09-12T12:12:51.125393+0000","last_undegraded":"2024-09-12T12:12:51.125393+0000","last_fullsized":"2024-09-12T12:12:51.125393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:54:40.014673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178889+0000","last_change":"2024-09-12T12:12:44.866195+0000","last_active":"2024-09-12T12:12:50.178889+0000","last_peered":"2024-09-12T12:12:50.178889+0000","last_clean":"2024-09-12T12:12:50.178889+0000","last_became_active":"2024-09-12T12:12:44.862903+0000","last_became_peered":"2024-09-12T12:12:44.862903+0000","last_unstale":"2024-09-12T12:12:50.178889+0000","last_undegraded":"2024-09-12T12:12:50.178889+0000","last_fullsized":"2024-09-12T12:12:50.178889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:07.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125724+0000","last_change":"2024-09-12T12:12:43.855996+0000","last_active":"2024-09-12T12:12:51.125724+0000","last_peered":"2024-09-12T12:12:51.125724+0000","last_clean":"2024-09-12T12:12:51.125724+0000","last_became_active":"2024-09-12T12:12:43.855599+0000","last_became_peered":"2024-09-12T12:12:43.855599+0000","last_unstale":"2024-09-12T12:12:51.125724+0000","last_undegraded":"2024-09-12T12:12:51.125724+0000","last_fullsized":"2024-09-12T12:12:51.125724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:08.451412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178966+0000","last_change":"2024-09-12T12:12:49.192756+0000","last_active":"2024-09-12T12:12:50.178966+0000","last_peered":"2024-09-12T12:12:50.178966+0000","last_clean":"2024-09-12T12:12:50.178966+0000","last_became_active":"2024-09-12T12:12:49.192349+0000","last_became_peered":"2024-09-12T12:12:49.192349+0000","last_unstale":"2024-09-12T12:12:50.178966+0000","last_undegraded":"2024-09-12T12:12:50.178966+0000","last_fullsized":"2024-09-12T12:12:50.178966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:04.961251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.513276+0000","last_change":"2024-09-12T12:12:44.858876+0000","last_active":"2024-09-12T12:12:50.513276+0000","last_peered":"2024-09-12T12:12:50.513276+0000","last_clean":"2024-09-12T12:12:50.513276+0000","last_became_active":"2024-09-12T12:12:44.858622+0000","last_became_peered":"2024-09-12T12:12:44.858622+0000","last_unstale":"2024-09-12T12:12:50.513276+0000","last_undegraded":"2024-09-12T12:12:50.513276+0000","last_fullsized":"2024-09-12T12:12:50.513276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664332+0000","last_change":"2024-09-12T12:12:43.855782+0000","last_active":"2024-09-12T12:12:50.664332+0000","last_peered":"2024-09-12T12:12:50.664332+0000","last_clean":"2024-09-12T12:12:50.664332+0000","last_became_active":"2024-09-12T12:12:43.855330+0000","last_became_peered":"2024-09-12T12:12:43.855330+0000","last_unstale":"2024-09-12T12:12:50.664332+0000","last_undegraded":"2024-09-12T12:12:50.664332+0000","last_fullsized":"2024-09-12T12:12:50.664332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:14.268328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176677+0000","last_change":"2024-09-12T12:12:49.199551+0000","last_active":"2024-09-12T12:12:50.176677+0000","last_peered":"2024-09-12T12:12:50.176677+0000","last_clean":"2024-09-12T12:12:50.176677+0000","last_became_active":"2024-09-12T12:12:49.199160+0000","last_became_peered":"2024-09-12T12:12:49.199160+0000","last_unstale":"2024-09-12T12:12:50.176677+0000","last_undegraded":"2024-09-12T12:12:50.176677+0000","last_fullsized":"2024-09-12T12:12:50.176677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:55.453339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664327+0000","last_change":"2024-09-12T12:12:44.861353+0000","last_active":"2024-09-12T12:12:50.664327+0000","last_peered":"2024-09-12T12:12:50.664327+0000","last_clean":"2024-09-12T12:12:50.664327+0000","last_became_active":"2024-09-12T12:12:44.861070+0000","last_became_peered":"2024-09-12T12:12:44.861070+0000","last_unstale":"2024-09-12T12:12:50.664327+0000","last_undegraded":"2024-09-12T12:12:50.664327+0000","last_fullsized":"2024-09-12T12:12:50.664327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178299+0000","last_change":"2024-09-12T12:12:43.856649+0000","last_active":"2024-09-12T12:12:50.178299+0000","last_peered":"2024-09-12T12:12:50.178299+0000","last_clean":"2024-09-12T12:12:50.178299+0000","last_became_active":"2024-09-12T12:12:43.856407+0000","last_became_peered":"2024-09-12T12:12:43.856407+0000","last_unstale":"2024-09-12T12:12:50.178299+0000","last_undegraded":"2024-09-12T12:12:50.178299+0000","last_fullsized":"2024-09-12T12:12:50.178299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:57.470915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176631+0000","last_change":"2024-09-12T12:12:49.234007+0000","last_active":"2024-09-12T12:12:50.176631+0000","last_peered":"2024-09-12T12:12:50.176631+0000","last_clean":"2024-09-12T12:12:50.176631+0000","last_became_active":"2024-09-12T12:12:49.233586+0000","last_became_peered":"2024-09-12T12:12:49.233586+0000","last_unstale":"2024-09-12T12:12:50.176631+0000","last_undegraded":"2024-09-12T12:12:50.176631+0000","last_fullsized":"2024-09-12T12:12:50.176631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:01.336468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512727+0000","last_change":"2024-09-12T12:12:49.239278+0000","last_active":"2024-09-12T12:12:50.512727+0000","last_peered":"2024-09-12T12:12:50.512727+0000","last_clean":"2024-09-12T12:12:50.512727+0000","last_became_active":"2024-09-12T12:12:49.237056+0000","last_became_peered":"2024-09-12T12:12:49.237056+0000","last_unstale":"2024-09-12T12:12:50.512727+0000","last_undegraded":"2024-09-12T12:12:50.512727+0000","last_fullsized":"2024-09-12T12:12:50.512727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:54.688541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124996+0000","last_change":"2024-09-12T12:12:44.849271+0000","last_active":"2024-09-12T12:12:51.124996+0000","last_peered":"2024-09-12T12:12:51.124996+0000","last_clean":"2024-09-12T12:12:51.124996+0000","last_became_active":"2024-09-12T12:12:44.848981+0000","last_became_peered":"2024-09-12T12:12:44.848981+0000","last_unstale":"2024-09-12T12:12:51.124996+0000","last_undegraded":"2024-09-12T12:12:51.124996+0000","last_fullsized":"2024-09-12T12:12:51.124996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664166+0000","last_change":"2024-09-12T12:12:43.850772+0000","last_active":"2024-09-12T12:12:50.664166+0000","last_peered":"2024-09-12T12:12:50.664166+0000","last_clean":"2024-09-12T12:12:50.664166+0000","last_became_active":"2024-09-12T12:12:43.849876+0000","last_became_peered":"2024-09-12T12:12:43.849876+0000","last_unstale":"2024-09-12T12:12:50.664166+0000","last_undegraded":"2024-09-12T12:12:50.664166+0000","last_fullsized":"2024-09-12T12:12:50.664166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178125+0000","last_change":"2024-09-12T12:12:49.197617+0000","last_active":"2024-09-12T12:12:50.178125+0000","last_peered":"2024-09-12T12:12:50.178125+0000","last_clean":"2024-09-12T12:12:50.178125+0000","last_became_active":"2024-09-12T12:12:49.197030+0000","last_became_peered":"2024-09-12T12:12:49.197030+0000","last_unstale":"2024-09-12T12:12:50.178125+0000","last_undegraded":"2024-09-12T12:12:50.178125+0000","last_fullsized":"2024-09-12T12:12:50.178125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:04.961251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176677+0000","last_change":"2024-09-12T12:12:44.861618+0000","last_active":"2024-09-12T12:12:50.176677+0000","last_peered":"2024-09-12T12:12:50.176677+0000","last_clean":"2024-09-12T12:12:50.176677+0000","last_became_active":"2024-09-12T12:12:44.861291+0000","last_became_peered":"2024-09-12T12:12:44.861291+0000","last_unstale":"2024-09-12T12:12:50.176677+0000","last_undegraded":"2024-09-12T12:12:50.176677+0000","last_fullsized":"2024-09-12T12:12:50.176677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176907+0000","last_change":"2024-09-12T12:12:43.843772+0000","last_active":"2024-09-12T12:12:50.176907+0000","last_peered":"2024-09-12T12:12:50.176907+0000","last_clean":"2024-09-12T12:12:50.176907+0000","last_became_active":"2024-09-12T12:12:43.843482+0000","last_became_peered":"2024-09-12T12:12:43.843482+0000","last_unstale":"2024-09-12T12:12:50.176907+0000","last_undegraded":"2024-09-12T12:12:50.176907+0000","last_fullsized":"2024-09-12T12:12:50.176907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:57.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177687+0000","last_change":"2024-09-12T12:12:43.853195+0000","last_active":"2024-09-12T12:12:50.177687+0000","last_peered":"2024-09-12T12:12:50.177687+0000","last_clean":"2024-09-12T12:12:50.177687+0000","last_became_active":"2024-09-12T12:12:43.852885+0000","last_became_peered":"2024-09-12T12:12:43.852885+0000","last_unstale":"2024-09-12T12:12:50.177687+0000","last_undegraded":"2024-09-12T12:12:50.177687+0000","last_fullsized":"2024-09-12T12:12:50.177687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512832+0000","last_change":"2024-09-12T12:12:44.841616+0000","last_active":"2024-09-12T12:12:50.512832+0000","last_peered":"2024-09-12T12:12:50.512832+0000","last_clean":"2024-09-12T12:12:50.512832+0000","last_became_active":"2024-09-12T12:12:44.837035+0000","last_became_peered":"2024-09-12T12:12:44.837035+0000","last_unstale":"2024-09-12T12:12:50.512832+0000","last_undegraded":"2024-09-12T12:12:50.512832+0000","last_fullsized":"2024-09-12T12:12:50.512832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125285+0000","last_change":"2024-09-12T12:12:49.197010+0000","last_active":"2024-09-12T12:12:51.125285+0000","last_peered":"2024-09-12T12:12:51.125285+0000","last_clean":"2024-09-12T12:12:51.125285+0000","last_became_active":"2024-09-12T12:12:49.196614+0000","last_became_peered":"2024-09-12T12:12:49.196614+0000","last_unstale":"2024-09-12T12:12:51.125285+0000","last_undegraded":"2024-09-12T12:12:51.125285+0000","last_fullsized":"2024-09-12T12:12:51.125285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:15.930626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176978+0000","last_change":"2024-09-12T12:12:43.852370+0000","last_active":"2024-09-12T12:12:50.176978+0000","last_peered":"2024-09-12T12:12:50.176978+0000","last_clean":"2024-09-12T12:12:50.176978+0000","last_became_active":"2024-09-12T12:12:43.852074+0000","last_became_peered":"2024-09-12T12:12:43.852074+0000","last_unstale":"2024-09-12T12:12:50.176978+0000","last_undegraded":"2024-09-12T12:12:50.176978+0000","last_fullsized":"2024-09-12T12:12:50.176978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:42.804011+0000","last_clean_scrub_stamp":"2024-09-12T12:12:42.804011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:56:05.769388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178100+0000","last_change":"2024-09-12T12:12:44.832700+0000","last_active":"2024-09-12T12:12:50.178100+0000","last_peered":"2024-09-12T12:12:50.178100+0000","last_clean":"2024-09-12T12:12:50.178100+0000","last_became_active":"2024-09-12T12:12:44.832406+0000","last_became_peered":"2024-09-12T12:12:44.832406+0000","last_unstale":"2024-09-12T12:12:50.178100+0000","last_undegraded":"2024-09-12T12:12:50.178100+0000","last_fullsized":"2024-09-12T12:12:50.178100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:58.477524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177442+0000","last_change":"2024-09-12T12:12:49.196949+0000","last_active":"2024-09-12T12:12:50.177442+0000","last_peered":"2024-09-12T12:12:50.177442+0000","last_clean":"2024-09-12T12:12:50.177442+0000","last_became_active":"2024-09-12T12:12:49.196332+0000","last_became_peered":"2024-09-12T12:12:49.196332+0000","last_unstale":"2024-09-12T12:12:50.177442+0000","last_undegraded":"2024-09-12T12:12:50.177442+0000","last_fullsized":"2024-09-12T12:12:50.177442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:48.159464+0000","last_clean_scrub_stamp":"2024-09-12T12:12:48.159464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:33.072107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177294+0000","last_change":"2024-09-12T12:12:44.844712+0000","last_active":"2024-09-12T12:12:50.177294+0000","last_peered":"2024-09-12T12:12:50.177294+0000","last_clean":"2024-09-12T12:12:50.177294+0000","last_became_active":"2024-09-12T12:12:44.843911+0000","last_became_peered":"2024-09-12T12:12:44.843911+0000","last_unstale":"2024-09-12T12:12:50.177294+0000","last_undegraded":"2024-09-12T12:12:50.177294+0000","last_fullsized":"2024-09-12T12:12:50.177294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.435034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.124714+0000","last_change":"2024-09-12T12:12:44.848326+0000","last_active":"2024-09-12T12:12:51.124714+0000","last_peered":"2024-09-12T12:12:51.124714+0000","last_clean":"2024-09-12T12:12:51.124714+0000","last_became_active":"2024-09-12T12:12:44.848042+0000","last_became_peered":"2024-09-12T12:12:44.848042+0000","last_unstale":"2024-09-12T12:12:51.124714+0000","last_undegraded":"2024-09-12T12:12:51.124714+0000","last_fullsized":"2024-09-12T12:12:51.124714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:29.908514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664167+0000","last_change":"2024-09-12T12:12:44.864217+0000","last_active":"2024-09-12T12:12:50.664167+0000","last_peered":"2024-09-12T12:12:50.664167+0000","last_clean":"2024-09-12T12:12:50.664167+0000","last_became_active":"2024-09-12T12:12:44.863950+0000","last_became_peered":"2024-09-12T12:12:44.863950+0000","last_unstale":"2024-09-12T12:12:50.664167+0000","last_undegraded":"2024-09-12T12:12:50.664167+0000","last_fullsized":"2024-09-12T12:12:50.664167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512709+0000","last_change":"2024-09-12T12:12:44.844044+0000","last_active":"2024-09-12T12:12:50.512709+0000","last_peered":"2024-09-12T12:12:50.512709+0000","last_clean":"2024-09-12T12:12:50.512709+0000","last_became_active":"2024-09-12T12:12:44.843737+0000","last_became_peered":"2024-09-12T12:12:44.843737+0000","last_unstale":"2024-09-12T12:12:50.512709+0000","last_undegraded":"2024-09-12T12:12:50.512709+0000","last_fullsized":"2024-09-12T12:12:50.512709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:02.801865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177290+0000","last_change":"2024-09-12T12:12:44.854798+0000","last_active":"2024-09-12T12:12:50.177290+0000","last_peered":"2024-09-12T12:12:50.177290+0000","last_clean":"2024-09-12T12:12:50.177290+0000","last_became_active":"2024-09-12T12:12:44.852834+0000","last_became_peered":"2024-09-12T12:12:44.852834+0000","last_unstale":"2024-09-12T12:12:50.177290+0000","last_undegraded":"2024-09-12T12:12:50.177290+0000","last_fullsized":"2024-09-12T12:12:50.177290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125449+0000","last_change":"2024-09-12T12:12:44.855309+0000","last_active":"2024-09-12T12:12:51.125449+0000","last_peered":"2024-09-12T12:12:51.125449+0000","last_clean":"2024-09-12T12:12:51.125449+0000","last_became_active":"2024-09-12T12:12:44.854718+0000","last_became_peered":"2024-09-12T12:12:44.854718+0000","last_unstale":"2024-09-12T12:12:51.125449+0000","last_undegraded":"2024-09-12T12:12:51.125449+0000","last_fullsized":"2024-09-12T12:12:51.125449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178907+0000","last_change":"2024-09-12T12:12:44.855541+0000","last_active":"2024-09-12T12:12:50.178907+0000","last_peered":"2024-09-12T12:12:50.178907+0000","last_clean":"2024-09-12T12:12:50.178907+0000","last_became_active":"2024-09-12T12:12:44.855141+0000","last_became_peered":"2024-09-12T12:12:44.855141+0000","last_unstale":"2024-09-12T12:12:50.178907+0000","last_undegraded":"2024-09-12T12:12:50.178907+0000","last_fullsized":"2024-09-12T12:12:50.178907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.177604+0000","last_change":"2024-09-12T12:12:44.866746+0000","last_active":"2024-09-12T12:12:50.177604+0000","last_peered":"2024-09-12T12:12:50.177604+0000","last_clean":"2024-09-12T12:12:50.177604+0000","last_became_active":"2024-09-12T12:12:44.866244+0000","last_became_peered":"2024-09-12T12:12:44.866244+0000","last_unstale":"2024-09-12T12:12:50.177604+0000","last_undegraded":"2024-09-12T12:12:50.177604+0000","last_fullsized":"2024-09-12T12:12:50.177604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:28.071951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663883+0000","last_change":"2024-09-12T12:12:44.864035+0000","last_active":"2024-09-12T12:12:50.663883+0000","last_peered":"2024-09-12T12:12:50.663883+0000","last_clean":"2024-09-12T12:12:50.663883+0000","last_became_active":"2024-09-12T12:12:44.863759+0000","last_became_peered":"2024-09-12T12:12:44.863759+0000","last_unstale":"2024-09-12T12:12:50.663883+0000","last_undegraded":"2024-09-12T12:12:50.663883+0000","last_fullsized":"2024-09-12T12:12:50.663883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:31.258440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176816+0000","last_change":"2024-09-12T12:12:44.865302+0000","last_active":"2024-09-12T12:12:50.176816+0000","last_peered":"2024-09-12T12:12:50.176816+0000","last_clean":"2024-09-12T12:12:50.176816+0000","last_became_active":"2024-09-12T12:12:44.865069+0000","last_became_peered":"2024-09-12T12:12:44.865069+0000","last_unstale":"2024-09-12T12:12:50.176816+0000","last_undegraded":"2024-09-12T12:12:50.176816+0000","last_fullsized":"2024-09-12T12:12:50.176816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664052+0000","last_change":"2024-09-12T12:12:44.861590+0000","last_active":"2024-09-12T12:12:50.664052+0000","last_peered":"2024-09-12T12:12:50.664052+0000","last_clean":"2024-09-12T12:12:50.664052+0000","last_became_active":"2024-09-12T12:12:44.861202+0000","last_became_peered":"2024-09-12T12:12:44.861202+0000","last_unstale":"2024-09-12T12:12:50.664052+0000","last_undegraded":"2024-09-12T12:12:50.664052+0000","last_fullsized":"2024-09-12T12:12:50.664052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512497+0000","last_change":"2024-09-12T12:12:44.856860+0000","last_active":"2024-09-12T12:12:50.512497+0000","last_peered":"2024-09-12T12:12:50.512497+0000","last_clean":"2024-09-12T12:12:50.512497+0000","last_became_active":"2024-09-12T12:12:44.856519+0000","last_became_peered":"2024-09-12T12:12:44.856519+0000","last_unstale":"2024-09-12T12:12:50.512497+0000","last_undegraded":"2024-09-12T12:12:50.512497+0000","last_fullsized":"2024-09-12T12:12:50.512497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:11.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178221+0000","last_change":"2024-09-12T12:12:44.848555+0000","last_active":"2024-09-12T12:12:50.178221+0000","last_peered":"2024-09-12T12:12:50.178221+0000","last_clean":"2024-09-12T12:12:50.178221+0000","last_became_active":"2024-09-12T12:12:44.848264+0000","last_became_peered":"2024-09-12T12:12:44.848264+0000","last_unstale":"2024-09-12T12:12:50.178221+0000","last_undegraded":"2024-09-12T12:12:50.178221+0000","last_fullsized":"2024-09-12T12:12:50.178221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517342+0000","last_change":"2024-09-12T12:12:44.871273+0000","last_active":"2024-09-12T12:12:50.517342+0000","last_peered":"2024-09-12T12:12:50.517342+0000","last_clean":"2024-09-12T12:12:50.517342+0000","last_became_active":"2024-09-12T12:12:44.871000+0000","last_became_peered":"2024-09-12T12:12:44.871000+0000","last_unstale":"2024-09-12T12:12:50.517342+0000","last_undegraded":"2024-09-12T12:12:50.517342+0000","last_fullsized":"2024-09-12T12:12:50.517342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:50.339698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125660+0000","last_change":"2024-09-12T12:12:44.852240+0000","last_active":"2024-09-12T12:12:51.125660+0000","last_peered":"2024-09-12T12:12:51.125660+0000","last_clean":"2024-09-12T12:12:51.125660+0000","last_became_active":"2024-09-12T12:12:44.851932+0000","last_became_peered":"2024-09-12T12:12:44.851932+0000","last_unstale":"2024-09-12T12:12:51.125660+0000","last_undegraded":"2024-09-12T12:12:51.125660+0000","last_fullsized":"2024-09-12T12:12:51.125660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:07.498615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664682+0000","last_change":"2024-09-12T12:12:44.873027+0000","last_active":"2024-09-12T12:12:50.664682+0000","last_peered":"2024-09-12T12:12:50.664682+0000","last_clean":"2024-09-12T12:12:50.664682+0000","last_became_active":"2024-09-12T12:12:44.872766+0000","last_became_peered":"2024-09-12T12:12:44.872766+0000","last_unstale":"2024-09-12T12:12:50.664682+0000","last_undegraded":"2024-09-12T12:12:50.664682+0000","last_fullsized":"2024-09-12T12:12:50.664682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:31:17.011556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663750+0000","last_change":"2024-09-12T12:12:44.846340+0000","last_active":"2024-09-12T12:12:50.663750+0000","last_peered":"2024-09-12T12:12:50.663750+0000","last_clean":"2024-09-12T12:12:50.663750+0000","last_became_active":"2024-09-12T12:12:44.846029+0000","last_became_peered":"2024-09-12T12:12:44.846029+0000","last_unstale":"2024-09-12T12:12:50.663750+0000","last_undegraded":"2024-09-12T12:12:50.663750+0000","last_fullsized":"2024-09-12T12:12:50.663750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:00.612407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.125028+0000","last_change":"2024-09-12T12:12:44.841774+0000","last_active":"2024-09-12T12:12:51.125028+0000","last_peered":"2024-09-12T12:12:51.125028+0000","last_clean":"2024-09-12T12:12:51.125028+0000","last_became_active":"2024-09-12T12:12:44.841455+0000","last_became_peered":"2024-09-12T12:12:44.841455+0000","last_unstale":"2024-09-12T12:12:51.125028+0000","last_undegraded":"2024-09-12T12:12:51.125028+0000","last_fullsized":"2024-09-12T12:12:51.125028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512467+0000","last_change":"2024-09-12T12:12:44.853169+0000","last_active":"2024-09-12T12:12:50.512467+0000","last_peered":"2024-09-12T12:12:50.512467+0000","last_clean":"2024-09-12T12:12:50.512467+0000","last_became_active":"2024-09-12T12:12:44.852892+0000","last_became_peered":"2024-09-12T12:12:44.852892+0000","last_unstale":"2024-09-12T12:12:50.512467+0000","last_undegraded":"2024-09-12T12:12:50.512467+0000","last_fullsized":"2024-09-12T12:12:50.512467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:35.948872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176814+0000","last_change":"2024-09-12T12:12:44.844754+0000","last_active":"2024-09-12T12:12:50.176814+0000","last_peered":"2024-09-12T12:12:50.176814+0000","last_clean":"2024-09-12T12:12:50.176814+0000","last_became_active":"2024-09-12T12:12:44.844442+0000","last_became_peered":"2024-09-12T12:12:44.844442+0000","last_unstale":"2024-09-12T12:12:50.176814+0000","last_undegraded":"2024-09-12T12:12:50.176814+0000","last_fullsized":"2024-09-12T12:12:50.176814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:31.258440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178826+0000","last_change":"2024-09-12T12:12:44.839270+0000","last_active":"2024-09-12T12:12:50.178826+0000","last_peered":"2024-09-12T12:12:50.178826+0000","last_clean":"2024-09-12T12:12:50.178826+0000","last_became_active":"2024-09-12T12:12:44.838825+0000","last_became_peered":"2024-09-12T12:12:44.838825+0000","last_unstale":"2024-09-12T12:12:50.178826+0000","last_undegraded":"2024-09-12T12:12:50.178826+0000","last_fullsized":"2024-09-12T12:12:50.178826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:29.908514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178340+0000","last_change":"2024-09-12T12:12:44.845641+0000","last_active":"2024-09-12T12:12:50.178340+0000","last_peered":"2024-09-12T12:12:50.178340+0000","last_clean":"2024-09-12T12:12:50.178340+0000","last_became_active":"2024-09-12T12:12:44.845161+0000","last_became_peered":"2024-09-12T12:12:44.845161+0000","last_unstale":"2024-09-12T12:12:50.178340+0000","last_undegraded":"2024-09-12T12:12:50.178340+0000","last_fullsized":"2024-09-12T12:12:50.178340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:08.386369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.178812+0000","last_change":"2024-09-12T12:12:44.858433+0000","last_active":"2024-09-12T12:12:50.178812+0000","last_peered":"2024-09-12T12:12:50.178812+0000","last_clean":"2024-09-12T12:12:50.178812+0000","last_became_active":"2024-09-12T12:12:44.858113+0000","last_became_peered":"2024-09-12T12:12:44.858113+0000","last_unstale":"2024-09-12T12:12:50.178812+0000","last_undegraded":"2024-09-12T12:12:50.178812+0000","last_fullsized":"2024-09-12T12:12:50.178812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517222+0000","last_change":"2024-09-12T12:12:44.869733+0000","last_active":"2024-09-12T12:12:50.517222+0000","last_peered":"2024-09-12T12:12:50.517222+0000","last_clean":"2024-09-12T12:12:50.517222+0000","last_became_active":"2024-09-12T12:12:44.868192+0000","last_became_peered":"2024-09-12T12:12:44.868192+0000","last_unstale":"2024-09-12T12:12:50.517222+0000","last_undegraded":"2024-09-12T12:12:50.517222+0000","last_fullsized":"2024-09-12T12:12:50.517222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:00.612407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.176586+0000","last_change":"2024-09-12T12:12:44.844476+0000","last_active":"2024-09-12T12:12:50.176586+0000","last_peered":"2024-09-12T12:12:50.176586+0000","last_clean":"2024-09-12T12:12:50.176586+0000","last_became_active":"2024-09-12T12:12:44.844240+0000","last_became_peered":"2024-09-12T12:12:44.844240+0000","last_unstale":"2024-09-12T12:12:50.176586+0000","last_undegraded":"2024-09-12T12:12:50.176586+0000","last_fullsized":"2024-09-12T12:12:50.176586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:32.949417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516610+0000","last_change":"2024-09-12T12:12:44.859103+0000","last_active":"2024-09-12T12:12:50.516610+0000","last_peered":"2024-09-12T12:12:50.516610+0000","last_clean":"2024-09-12T12:12:50.516610+0000","last_became_active":"2024-09-12T12:12:44.858792+0000","last_became_peered":"2024-09-12T12:12:44.858792+0000","last_unstale":"2024-09-12T12:12:50.516610+0000","last_undegraded":"2024-09-12T12:12:50.516610+0000","last_fullsized":"2024-09-12T12:12:50.516610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.663939+0000","last_change":"2024-09-12T12:12:44.846757+0000","last_active":"2024-09-12T12:12:50.663939+0000","last_peered":"2024-09-12T12:12:50.663939+0000","last_clean":"2024-09-12T12:12:50.663939+0000","last_became_active":"2024-09-12T12:12:44.846487+0000","last_became_peered":"2024-09-12T12:12:44.846487+0000","last_unstale":"2024-09-12T12:12:50.663939+0000","last_undegraded":"2024-09-12T12:12:50.663939+0000","last_fullsized":"2024-09-12T12:12:50.663939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:03.996805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.516676+0000","last_change":"2024-09-12T12:12:44.861675+0000","last_active":"2024-09-12T12:12:50.516676+0000","last_peered":"2024-09-12T12:12:50.516676+0000","last_clean":"2024-09-12T12:12:50.516676+0000","last_became_active":"2024-09-12T12:12:44.860557+0000","last_became_peered":"2024-09-12T12:12:44.860557+0000","last_unstale":"2024-09-12T12:12:50.516676+0000","last_undegraded":"2024-09-12T12:12:50.516676+0000","last_fullsized":"2024-09-12T12:12:50.516676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:17.311461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.664240+0000","last_change":"2024-09-12T12:12:44.872237+0000","last_active":"2024-09-12T12:12:50.664240+0000","last_peered":"2024-09-12T12:12:50.664240+0000","last_clean":"2024-09-12T12:12:50.664240+0000","last_became_active":"2024-09-12T12:12:44.871938+0000","last_became_peered":"2024-09-12T12:12:44.871938+0000","last_unstale":"2024-09-12T12:12:50.664240+0000","last_undegraded":"2024-09-12T12:12:50.664240+0000","last_fullsized":"2024-09-12T12:12:50.664240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:35.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.512684+0000","last_change":"2024-09-12T12:12:44.849177+0000","last_active":"2024-09-12T12:12:50.512684+0000","last_peered":"2024-09-12T12:12:50.512684+0000","last_clean":"2024-09-12T12:12:50.512684+0000","last_became_active":"2024-09-12T12:12:44.848855+0000","last_became_peered":"2024-09-12T12:12:44.848855+0000","last_unstale":"2024-09-12T12:12:50.512684+0000","last_undegraded":"2024-09-12T12:12:50.512684+0000","last_fullsized":"2024-09-12T12:12:50.512684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:55.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:51.126168+0000","last_change":"2024-09-12T12:12:44.840454+0000","last_active":"2024-09-12T12:12:51.126168+0000","last_peered":"2024-09-12T12:12:51.126168+0000","last_clean":"2024-09-12T12:12:51.126168+0000","last_became_active":"2024-09-12T12:12:44.838175+0000","last_became_peered":"2024-09-12T12:12:44.838175+0000","last_unstale":"2024-09-12T12:12:51.126168+0000","last_undegraded":"2024-09-12T12:12:51.126168+0000","last_fullsized":"2024-09-12T12:12:51.126168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:31.108417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T12:12:50.517102+0000","last_change":"2024-09-12T12:12:44.868520+0000","last_active":"2024-09-12T12:12:50.517102+0000","last_peered":"2024-09-12T12:12:50.517102+0000","last_clean":"2024-09-12T12:12:50.517102+0000","last_became_active":"2024-09-12T12:12:44.861576+0000","last_became_peered":"2024-09-12T12:12:44.861576+0000","last_unstale":"2024-09-12T12:12:50.517102+0000","last_undegraded":"2024-09-12T12:12:50.517102+0000","last_fullsized":"2024-09-12T12:12:50.517102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:43.810620+0000","last_clean_scrub_stamp":"2024-09-12T12:12:43.810620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":108771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:13:11.594 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:13:11.594 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T12:13:11.594 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T12:13:11.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T12:13:11.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f6446600640 1 Processor -- start 2024-09-12T12:13:11.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f6446600640 1 -- start start 2024-09-12T12:13:11.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f6446600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f644015c2b0 0x7f644006da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f6446600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f64400d0ee0 0x7f64400cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f6446600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644006e360 con 0x7f644015c690 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f6446600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f64400cd830 con 0x7f64400d0ee0 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f6446600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f644006e640 con 0x7f644015c2b0 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f64400d0ee0 0x7f64400cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f64400d0ee0 0x7f64400cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51154/0 (socket says 172.21.15.144:51154) 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643ea00640 1 -- 172.21.15.144:0/108195710 learned_addr learned my addr 172.21.15.144:0/108195710 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f644015c690 0x7f644015fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37382/0 (socket says 172.21.15.144:37382) 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643f400640 1 --2- 172.21.15.144:0/108195710 >> v2:172.21.15.165:3300/0 conn(0x7f644015c2b0 0x7f644006da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643ea00640 1 -- 172.21.15.144:0/108195710 >> v2:172.21.15.165:3300/0 conn(0x7f644015c2b0 msgr2=0x7f644006da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643ea00640 1 --2- 172.21.15.144:0/108195710 >> v2:172.21.15.165:3300/0 conn(0x7f644015c2b0 0x7f644006da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643ea00640 1 -- 172.21.15.144:0/108195710 >> v1:172.21.15.144:6789/0 conn(0x7f644015c690 legacy=0x7f644015fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643ea00640 1 -- 172.21.15.144:0/108195710 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64400cd4c0 con 0x7f64400d0ee0 2024-09-12T12:13:11.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.769+0000 7f643e000640 1 -- 172.21.15.144:0/108195710 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514751377 0 0) 0x7f644006e360 con 0x7f644015c690 2024-09-12T12:13:11.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f643ea00640 1 --2- 172.21.15.144:0/108195710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64400d0ee0 0x7f64400cf1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f64400b59c0 tx=0x7f642c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6a39d98852d965 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:11.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f643e000640 1 -- 172.21.15.144:0/108195710 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c0b1070 con 0x7f64400d0ee0 2024-09-12T12:13:11.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f643e000640 1 -- 172.21.15.144:0/108195710 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642c0ac410 con 0x7f64400d0ee0 2024-09-12T12:13:11.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f643e000640 1 -- 172.21.15.144:0/108195710 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c0ac7e0 con 0x7f64400d0ee0 2024-09-12T12:13:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 -- 172.21.15.144:0/108195710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64400d0ee0 msgr2=0x7f64400cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 --2- 172.21.15.144:0/108195710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64400d0ee0 0x7f64400cf1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f64400b59c0 tx=0x7f642c01c520 comp rx=0 tx=0).stop 2024-09-12T12:13:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 -- 172.21.15.144:0/108195710 shutdown_connections 2024-09-12T12:13:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 --2- 172.21.15.144:0/108195710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64400d0ee0 0x7f64400cf1a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 --2- 172.21.15.144:0/108195710 >> v2:172.21.15.165:3300/0 conn(0x7f644015c2b0 0x7f644006da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 -- 172.21.15.144:0/108195710 >> 172.21.15.144:0/108195710 conn(0x7f6440067e00 msgr2=0x7f64400d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 -- 172.21.15.144:0/108195710 shutdown_connections 2024-09-12T12:13:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 -- 172.21.15.144:0/108195710 wait complete. 2024-09-12T12:13:11.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 Processor -- start 2024-09-12T12:13:11.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.773+0000 7f6446600640 1 -- start start 2024-09-12T12:13:11.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6446600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64400d0ee0 0x7f6440150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6446600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644015c2b0 0x7f6440161bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6446600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644015c690 0x7f64401620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6446600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f64401693f0 con 0x7f644015c690 2024-09-12T12:13:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6446600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6440169270 con 0x7f64400d0ee0 2024-09-12T12:13:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6446600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6440169570 con 0x7f644015c2b0 2024-09-12T12:13:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644015c690 0x7f64401620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644015c690 0x7f64401620f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51158/0 (socket says 172.21.15.144:51158) 2024-09-12T12:13:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643fe00640 1 -- 172.21.15.144:0/1104284370 learned_addr learned my addr 172.21.15.144:0/1104284370 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:11.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643ea00640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644015c2b0 0x7f6440161bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643f400640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64400d0ee0 0x7f6440150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643fe00640 1 -- 172.21.15.144:0/1104284370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644015c2b0 msgr2=0x7f6440161bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643fe00640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644015c2b0 0x7f6440161bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643fe00640 1 -- 172.21.15.144:0/1104284370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64400d0ee0 msgr2=0x7f6440150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643fe00640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64400d0ee0 0x7f6440150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643fe00640 1 -- 172.21.15.144:0/1104284370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6440165720 con 0x7f644015c690 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643ea00640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644015c2b0 0x7f6440161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f643fe00640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644015c690 0x7f64401620f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f643800c730 tx=0x7f643800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6437400640 1 -- 172.21.15.144:0/1104284370 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438018070 con 0x7f644015c690 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6437400640 1 -- 172.21.15.144:0/1104284370 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643800ce40 con 0x7f644015c690 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6437400640 1 -- 172.21.15.144:0/1104284370 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643800a880 con 0x7f644015c690 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6440165a00 con 0x7f644015c690 2024-09-12T12:13:11.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6440165fc0 con 0x7f644015c690 2024-09-12T12:13:11.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.777+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64400cf1a0 con 0x7f644015c690 2024-09-12T12:13:11.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.781+0000 7f6437400640 1 -- 172.21.15.144:0/1104284370 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f643801b070 con 0x7f644015c690 2024-09-12T12:13:11.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.781+0000 7f6437400640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f64200678c0 0x7f6420069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:11.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.781+0000 7f6437400640 1 -- 172.21.15.144:0/1104284370 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6438085630 con 0x7f644015c690 2024-09-12T12:13:11.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.781+0000 7f643f400640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f64200678c0 0x7f6420069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:11.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.781+0000 7f643f400640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f64200678c0 0x7f6420069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f64401560a0 tx=0x7f6430008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:11.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.785+0000 7f6437400640 1 -- 172.21.15.144:0/1104284370 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6438055d90 con 0x7f644015c690 2024-09-12T12:13:11.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.973+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f644006ca70 con 0x7f644015c690 2024-09-12T12:13:11.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.973+0000 7f6437400640 1 -- 172.21.15.144:0/1104284370 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6438055690 con 0x7f644015c690 2024-09-12T12:13:11.977 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:11.977 INFO:teuthology.orchestra.run.smithi144.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T12:13:11.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f64200678c0 msgr2=0x7f6420069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f64200678c0 0x7f6420069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f64401560a0 tx=0x7f6430008040 comp rx=0 tx=0).stop 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644015c690 msgr2=0x7f64401620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644015c690 0x7f64401620f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f643800c730 tx=0x7f643800cbf0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 shutdown_connections 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f64200678c0 0x7f6420069d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644015c690 0x7f64401620f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644015c2b0 0x7f6440161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 --2- 172.21.15.144:0/1104284370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64400d0ee0 0x7f6440150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 >> 172.21.15.144:0/1104284370 conn(0x7f6440067e00 msgr2=0x7f644006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 shutdown_connections 2024-09-12T12:13:11.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:11.977+0000 7f6446600640 1 -- 172.21.15.144:0/1104284370 wait complete. 2024-09-12T12:13:11.997 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T12:13:11.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:12.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e4000640 1 Processor -- start 2024-09-12T12:13:12.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e4000640 1 -- start start 2024-09-12T12:13:12.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e4000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f30dc15c7b0 0x7f30dc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e4000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30dc0b5fb0 0x7f30dc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e4000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30dc0cd870 con 0x7f30dc15cd30 2024-09-12T12:13:12.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e4000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f30dc072a50 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e4000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f30dc0cde30 con 0x7f30dc15c7b0 2024-09-12T12:13:12.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30dc0b5fb0 0x7f30dc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30dc0b5fb0 0x7f30dc072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51164/0 (socket says 172.21.15.144:51164) 2024-09-12T12:13:12.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e2000640 1 -- 172.21.15.144:0/1817190113 learned_addr learned my addr 172.21.15.144:0/1817190113 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:12.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e1600640 1 --2- 172.21.15.144:0/1817190113 >> v2:172.21.15.165:3300/0 conn(0x7f30dc15c7b0 0x7f30dc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e2000640 1 -- 172.21.15.144:0/1817190113 >> v2:172.21.15.165:3300/0 conn(0x7f30dc15c7b0 msgr2=0x7f30dc0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:12.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e2000640 1 --2- 172.21.15.144:0/1817190113 >> v2:172.21.15.165:3300/0 conn(0x7f30dc15c7b0 0x7f30dc0ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e2000640 1 -- 172.21.15.144:0/1817190113 >> v1:172.21.15.165:6789/0 conn(0x7f30dc15cd30 legacy=0x7f30dc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.133+0000 7f30e2000640 1 -- 172.21.15.144:0/1817190113 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc0cdb50 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30e2000640 1 --2- 172.21.15.144:0/1817190113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 0x7f30dc072ee0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0d14f0 tx=0x7f30d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a843691b23887a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:12.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30dbe00640 1 -- 172.21.15.144:0/1817190113 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d40ab430 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30dbe00640 1 -- 172.21.15.144:0/1817190113 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d40b0070 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30dbe00640 1 -- 172.21.15.144:0/1817190113 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d40ab7f0 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30e4000640 1 -- 172.21.15.144:0/1817190113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 msgr2=0x7f30dc072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30e4000640 1 --2- 172.21.15.144:0/1817190113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 0x7f30dc072ee0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0d14f0 tx=0x7f30d401c520 comp rx=0 tx=0).stop 2024-09-12T12:13:12.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30e4000640 1 -- 172.21.15.144:0/1817190113 shutdown_connections 2024-09-12T12:13:12.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30e4000640 1 --2- 172.21.15.144:0/1817190113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 0x7f30dc072ee0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30e4000640 1 --2- 172.21.15.144:0/1817190113 >> v2:172.21.15.165:3300/0 conn(0x7f30dc15c7b0 0x7f30dc0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30e4000640 1 -- 172.21.15.144:0/1817190113 >> 172.21.15.144:0/1817190113 conn(0x7f30dc06d0d0 msgr2=0x7f30dc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:12.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30e4000640 1 -- 172.21.15.144:0/1817190113 shutdown_connections 2024-09-12T12:13:12.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.137+0000 7f30e4000640 1 -- 172.21.15.144:0/1817190113 wait complete. 2024-09-12T12:13:12.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 Processor -- start 2024-09-12T12:13:12.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 -- start start 2024-09-12T12:13:12.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 0x7f30dc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30dc15c7b0 0x7f30dc1561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc15cd30 0x7f30dc15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc073fc0 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc073e40 con 0x7f30dc15cd30 2024-09-12T12:13:12.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f30dc074140 con 0x7f30dc15c7b0 2024-09-12T12:13:12.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 0x7f30dc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 0x7f30dc15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51176/0 (socket says 172.21.15.144:51176) 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e1600640 1 -- 172.21.15.144:0/3197418489 learned_addr learned my addr 172.21.15.144:0/3197418489 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e0c00640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30dc15c7b0 0x7f30dc1561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e2000640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc15cd30 0x7f30dc15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e1600640 1 -- 172.21.15.144:0/3197418489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30dc15c7b0 msgr2=0x7f30dc1561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e1600640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30dc15c7b0 0x7f30dc1561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e1600640 1 -- 172.21.15.144:0/3197418489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc15cd30 msgr2=0x7f30dc15b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e1600640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc15cd30 0x7f30dc15b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e1600640 1 -- 172.21.15.144:0/3197418489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc159540 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e0c00640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30dc15c7b0 0x7f30dc1561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e1600640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 0x7f30dc15a5e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30d000efc0 tx=0x7f30d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:12.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30d9600640 1 -- 172.21.15.144:0/3197418489 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0018020 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30d9600640 1 -- 172.21.15.144:0/3197418489 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d0014480 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30d9600640 1 -- 172.21.15.144:0/3197418489 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0014850 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc159820 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc15a0c0 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.141+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc159c10 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.145+0000 7f30d9600640 1 -- 172.21.15.144:0/3197418489 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30d001b020 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.145+0000 7f30d9600640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30bc0678c0 0x7f30bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.145+0000 7f30d9600640 1 -- 172.21.15.144:0/3197418489 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f30d0086b40 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.145+0000 7f30e0c00640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30bc0678c0 0x7f30bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.145+0000 7f30e0c00640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30bc0678c0 0x7f30bc069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0ccd50 tx=0x7f30c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:12.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.149+0000 7f30d9600640 1 -- 172.21.15.144:0/3197418489 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f30d0022070 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.203 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:13:12.207 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:13:12.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30dc072ee0 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30d9600640 1 -- 172.21.15.144:0/3197418489 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5228 (secure 0 0 0) 0x7f30d0010040 con 0x7f30dc0b5fb0 2024-09-12T12:13:12.346 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:12.346 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-12T12:13:05:442423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:13:04.808385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:13:12.347 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-12T12:13:12.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30bc0678c0 msgr2=0x7f30bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30bc0678c0 0x7f30bc069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0ccd50 tx=0x7f30c8009040 comp rx=0 tx=0).stop 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 msgr2=0x7f30dc15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 0x7f30dc15a5e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30d000efc0 tx=0x7f30d000c490 comp rx=0 tx=0).stop 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 shutdown_connections 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30bc0678c0 0x7f30bc069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc15cd30 0x7f30dc15b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30dc15c7b0 0x7f30dc1561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 --2- 172.21.15.144:0/3197418489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30dc0b5fb0 0x7f30dc15a5e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.345+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 >> 172.21.15.144:0/3197418489 conn(0x7f30dc06d0d0 msgr2=0x7f30dc0b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.349+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 shutdown_connections 2024-09-12T12:13:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.349+0000 7f30e4000640 1 -- 172.21.15.144:0/3197418489 wait complete. 2024-09-12T12:13:12.370 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:12.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3368000640 1 Processor -- start 2024-09-12T12:13:12.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3368000640 1 -- start start 2024-09-12T12:13:12.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3368000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3360159e60 0x7f33600d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3368000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336015c9b0 con 0x7f33600b7550 2024-09-12T12:13:12.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3368000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336015cc30 con 0x7f33600d29a0 2024-09-12T12:13:12.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3368000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f336015d560 con 0x7f3360159e60 2024-09-12T12:13:12.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3365600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3360159e60 0x7f33600d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3366000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f33600b7550 0x7f3360073370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37398/0 (socket says 172.21.15.144:37398) 2024-09-12T12:13:12.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3365600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3360159e60 0x7f33600d2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51178/0 (socket says 172.21.15.144:51178) 2024-09-12T12:13:12.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3366000640 1 -- 172.21.15.144:0/1673857945 learned_addr learned my addr 172.21.15.144:0/1673857945 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:12.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3365600640 1 -- 172.21.15.144:0/1673857945 >> v1:172.21.15.165:6789/0 conn(0x7f33600d29a0 legacy=0x7f33600b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:12.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3365600640 1 -- 172.21.15.144:0/1673857945 >> v1:172.21.15.144:6789/0 conn(0x7f33600b7550 legacy=0x7f3360073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f3365600640 1 -- 172.21.15.144:0/1673857945 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336015cf10 con 0x7f3360159e60 2024-09-12T12:13:12.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.505+0000 7f335fe00640 1 -- 172.21.15.144:0/1673857945 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245592290 0 0) 0x7f3358001120 con 0x7f33600b7550 2024-09-12T12:13:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f3365600640 1 --2- 172.21.15.144:0/1673857945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3360159e60 0x7f33600d2460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3354009d90 tx=0x7f335401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe38bd6a85581730 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f335fe00640 1 -- 172.21.15.144:0/1673857945 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540b2070 con 0x7f3360159e60 2024-09-12T12:13:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f335fe00640 1 -- 172.21.15.144:0/1673857945 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33540a57f0 con 0x7f3360159e60 2024-09-12T12:13:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f335fe00640 1 -- 172.21.15.144:0/1673857945 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540a5bc0 con 0x7f3360159e60 2024-09-12T12:13:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f3368000640 1 -- 172.21.15.144:0/1673857945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3360159e60 msgr2=0x7f33600d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f3368000640 1 --2- 172.21.15.144:0/1673857945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3360159e60 0x7f33600d2460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3354009d90 tx=0x7f335401c930 comp rx=0 tx=0).stop 2024-09-12T12:13:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f3368000640 1 -- 172.21.15.144:0/1673857945 shutdown_connections 2024-09-12T12:13:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f3368000640 1 --2- 172.21.15.144:0/1673857945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3360159e60 0x7f33600d2460 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f3368000640 1 -- 172.21.15.144:0/1673857945 >> 172.21.15.144:0/1673857945 conn(0x7f3360067a00 msgr2=0x7f3360067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f3368000640 1 -- 172.21.15.144:0/1673857945 shutdown_connections 2024-09-12T12:13:12.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.509+0000 7f3368000640 1 -- 172.21.15.144:0/1673857945 wait complete. 2024-09-12T12:13:12.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 Processor -- start 2024-09-12T12:13:12.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 -- start start 2024-09-12T12:13:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33600b7550 0x7f33600c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33600d29a0 0x7f3360158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3360159e60 0x7f33600c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f33600d2dd0 con 0x7f33600b7550 2024-09-12T12:13:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f336015a450 con 0x7f33600d29a0 2024-09-12T12:13:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f336016a120 con 0x7f3360159e60 2024-09-12T12:13:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3365600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33600b7550 0x7f33600c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3365600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33600b7550 0x7f33600c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51184/0 (socket says 172.21.15.144:51184) 2024-09-12T12:13:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3365600640 1 -- 172.21.15.144:0/3234886419 learned_addr learned my addr 172.21.15.144:0/3234886419 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:12.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3364c00640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33600d29a0 0x7f3360158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3366000640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3360159e60 0x7f33600c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3365600640 1 -- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3360159e60 msgr2=0x7f33600c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3365600640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3360159e60 0x7f33600c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3365600640 1 -- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33600d29a0 msgr2=0x7f3360158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3365600640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33600d29a0 0x7f3360158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3365600640 1 -- 172.21.15.144:0/3234886419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3360068e20 con 0x7f33600b7550 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3364c00640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33600d29a0 0x7f3360158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3366000640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3360159e60 0x7f33600c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3365600640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33600b7550 0x7f33600c7470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33540b0040 tx=0x7f33540196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f335d600640 1 -- 172.21.15.144:0/3234886419 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540b2040 con 0x7f33600b7550 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f335d600640 1 -- 172.21.15.144:0/3234886419 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33540b8470 con 0x7f33600b7550 2024-09-12T12:13:12.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f335d600640 1 -- 172.21.15.144:0/3234886419 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540b8820 con 0x7f33600b7550 2024-09-12T12:13:12.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33601585b0 con 0x7f33600b7550 2024-09-12T12:13:12.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f336006d040 con 0x7f33600b7550 2024-09-12T12:13:12.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.513+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33600d2460 con 0x7f33600b7550 2024-09-12T12:13:12.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.517+0000 7f335d600640 1 -- 172.21.15.144:0/3234886419 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33540c1020 con 0x7f33600b7550 2024-09-12T12:13:12.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.517+0000 7f335d600640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33400678c0 0x7f3340069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.517+0000 7f335d600640 1 -- 172.21.15.144:0/3234886419 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3354120af0 con 0x7f33600b7550 2024-09-12T12:13:12.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.517+0000 7f3364c00640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33400678c0 0x7f3340069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.517+0000 7f3364c00640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33400678c0 0x7f3340069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f334c007fd0 tx=0x7f334c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:12.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.521+0000 7f335d600640 1 -- 172.21.15.144:0/3234886419 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3354016520 con 0x7f33600b7550 2024-09-12T12:13:12.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.713+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33600b1d10 con 0x7f33600b7550 2024-09-12T12:13:12.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.713+0000 7f335d600640 1 -- 172.21.15.144:0/3234886419 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5228 (secure 0 0 0) 0x7f33540f7030 con 0x7f33600b7550 2024-09-12T12:13:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:12.715 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-12T12:13:05:442423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:13:04.808385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:13:12.715 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-12T12:13:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33400678c0 msgr2=0x7f3340069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33400678c0 0x7f3340069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f334c007fd0 tx=0x7f334c009040 comp rx=0 tx=0).stop 2024-09-12T12:13:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33600b7550 msgr2=0x7f33600c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33600b7550 0x7f33600c7470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33540b0040 tx=0x7f33540196d0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 shutdown_connections 2024-09-12T12:13:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33400678c0 0x7f3340069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3360159e60 0x7f33600c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33600d29a0 0x7f3360158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 --2- 172.21.15.144:0/3234886419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33600b7550 0x7f33600c7470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 >> 172.21.15.144:0/3234886419 conn(0x7f3360067a00 msgr2=0x7f33600b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 shutdown_connections 2024-09-12T12:13:12.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.717+0000 7f3368000640 1 -- 172.21.15.144:0/3234886419 wait complete. 2024-09-12T12:13:12.736 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.869+0000 7f2f62800640 1 Processor -- start 2024-09-12T12:13:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.869+0000 7f2f62800640 1 -- start start 2024-09-12T12:13:12.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f62800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f5c0cd640 0x7f2f5c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f62800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c0b45a0 con 0x7f2f5c071420 2024-09-12T12:13:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f62800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c0b3fe0 con 0x7f2f5c15b4e0 2024-09-12T12:13:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f62800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5c0b42c0 con 0x7f2f5c0cd640 2024-09-12T12:13:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f5aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2f5c071420 0x7f2f5c0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37412/0 (socket says 172.21.15.144:37412) 2024-09-12T12:13:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f5aa00640 1 -- 172.21.15.144:0/3715630461 learned_addr learned my addr 172.21.15.144:0/3715630461 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f5be00640 1 --2- 172.21.15.144:0/3715630461 >> v2:172.21.15.144:3300/0 conn(0x7f2f5c0cd640 0x7f2f5c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f5be00640 1 -- 172.21.15.144:0/3715630461 >> v1:172.21.15.165:6789/0 conn(0x7f2f5c15b4e0 legacy=0x7f2f5c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f5a000640 1 -- 172.21.15.144:0/3715630461 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155258869 0 0) 0x7f2f5c0b45a0 con 0x7f2f5c071420 2024-09-12T12:13:12.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f5be00640 1 -- 172.21.15.144:0/3715630461 >> v1:172.21.15.144:6789/0 conn(0x7f2f5c071420 legacy=0x7f2f5c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.873+0000 7f2f5be00640 1 -- 172.21.15.144:0/3715630461 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c0b1490 con 0x7f2f5c0cd640 2024-09-12T12:13:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f5be00640 1 --2- 172.21.15.144:0/3715630461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c0cd640 0x7f2f5c071840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097c0 tx=0x7f2f5401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4eeb75f14dc063 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f5a000640 1 -- 172.21.15.144:0/3715630461 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540ab600 con 0x7f2f5c0cd640 2024-09-12T12:13:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f5a000640 1 -- 172.21.15.144:0/3715630461 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f540b0070 con 0x7f2f5c0cd640 2024-09-12T12:13:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f5a000640 1 -- 172.21.15.144:0/3715630461 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540ab9c0 con 0x7f2f5c0cd640 2024-09-12T12:13:12.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f62800640 1 -- 172.21.15.144:0/3715630461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c0cd640 msgr2=0x7f2f5c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f62800640 1 --2- 172.21.15.144:0/3715630461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c0cd640 0x7f2f5c071840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f540097c0 tx=0x7f2f5401c470 comp rx=0 tx=0).stop 2024-09-12T12:13:12.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f62800640 1 -- 172.21.15.144:0/3715630461 shutdown_connections 2024-09-12T12:13:12.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f62800640 1 --2- 172.21.15.144:0/3715630461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c0cd640 0x7f2f5c071840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f62800640 1 -- 172.21.15.144:0/3715630461 >> 172.21.15.144:0/3715630461 conn(0x7f2f5c06d0d0 msgr2=0x7f2f5c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:12.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f62800640 1 -- 172.21.15.144:0/3715630461 shutdown_connections 2024-09-12T12:13:12.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f62800640 1 -- 172.21.15.144:0/3715630461 wait complete. 2024-09-12T12:13:12.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f62800640 1 Processor -- start 2024-09-12T12:13:12.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.877+0000 7f2f62800640 1 -- start start 2024-09-12T12:13:12.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f62800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c071420 0x7f2f5c14bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f62800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f5c0cd640 0x7f2f5c15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f62800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f5c15b4e0 0x7f2f5c15f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f62800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c15b8c0 con 0x7f2f5c071420 2024-09-12T12:13:12.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f62800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c169270 con 0x7f2f5c0cd640 2024-09-12T12:13:12.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f62800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c154c00 con 0x7f2f5c15b4e0 2024-09-12T12:13:12.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c071420 0x7f2f5c14bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c071420 0x7f2f5c14bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51196/0 (socket says 172.21.15.144:51196) 2024-09-12T12:13:12.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5b400640 1 -- 172.21.15.144:0/756660694 learned_addr learned my addr 172.21.15.144:0/756660694 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:12.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5aa00640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f5c0cd640 0x7f2f5c15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5be00640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f5c15b4e0 0x7f2f5c15f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5b400640 1 -- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f5c15b4e0 msgr2=0x7f2f5c15f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5b400640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f5c15b4e0 0x7f2f5c15f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5b400640 1 -- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f5c0cd640 msgr2=0x7f2f5c15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:12.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5b400640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f5c0cd640 0x7f2f5c15ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:12.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5b400640 1 -- 172.21.15.144:0/756660694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c15e870 con 0x7f2f5c071420 2024-09-12T12:13:12.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5be00640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f5c15b4e0 0x7f2f5c15f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:12.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5aa00640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f5c0cd640 0x7f2f5c15ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:12.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f5b400640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c071420 0x7f2f5c14bab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c7a0 tx=0x7f2f4c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:12.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f53400640 1 -- 172.21.15.144:0/756660694 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c003b80 con 0x7f2f5c071420 2024-09-12T12:13:12.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f53400640 1 -- 172.21.15.144:0/756660694 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4c003d20 con 0x7f2f5c071420 2024-09-12T12:13:12.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f53400640 1 -- 172.21.15.144:0/756660694 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00aa90 con 0x7f2f5c071420 2024-09-12T12:13:12.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1545b0 con 0x7f2f5c071420 2024-09-12T12:13:12.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c14c610 con 0x7f2f5c071420 2024-09-12T12:13:12.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c071840 con 0x7f2f5c071420 2024-09-12T12:13:12.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.881+0000 7f2f53400640 1 -- 172.21.15.144:0/756660694 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f4c00ac30 con 0x7f2f5c071420 2024-09-12T12:13:12.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.885+0000 7f2f53400640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f3c0678f0 0x7f2f3c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:12.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.885+0000 7f2f53400640 1 -- 172.21.15.144:0/756660694 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2f4c085f10 con 0x7f2f5c071420 2024-09-12T12:13:12.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.885+0000 7f2f5aa00640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f3c0678f0 0x7f2f3c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:12.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.885+0000 7f2f5aa00640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f3c0678f0 0x7f2f3c069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c156cd0 tx=0x7f2f48007c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:12.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:12.889+0000 7f2f53400640 1 -- 172.21.15.144:0/756660694 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f4c0566f0 con 0x7f2f5c071420 2024-09-12T12:13:13.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f5c0b11d0 con 0x7f2f5c071420 2024-09-12T12:13:13.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f53400640 1 -- 172.21.15.144:0/756660694 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f2f4c055ff0 con 0x7f2f5c071420 2024-09-12T12:13:13.050 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:13.051 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:13.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f3c0678f0 msgr2=0x7f2f3c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f3c0678f0 0x7f2f3c069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c156cd0 tx=0x7f2f48007c60 comp rx=0 tx=0).stop 2024-09-12T12:13:13.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c071420 msgr2=0x7f2f5c14bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c071420 0x7f2f5c14bab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c7a0 tx=0x7f2f4c00cc60 comp rx=0 tx=0).stop 2024-09-12T12:13:13.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 shutdown_connections 2024-09-12T12:13:13.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f3c0678f0 0x7f2f3c069db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f5c15b4e0 0x7f2f5c15f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f5c0cd640 0x7f2f5c15ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 --2- 172.21.15.144:0/756660694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f5c071420 0x7f2f5c14bab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 >> 172.21.15.144:0/756660694 conn(0x7f2f5c06d0d0 msgr2=0x7f2f5c071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:13.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 shutdown_connections 2024-09-12T12:13:13.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.049+0000 7f2f62800640 1 -- 172.21.15.144:0/756660694 wait complete. 2024-09-12T12:13:13.072 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:13.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce8e00640 1 Processor -- start 2024-09-12T12:13:13.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce8e00640 1 -- start start 2024-09-12T12:13:13.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce8e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1ce415e4a0 0x7f1ce4161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce8e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ce40d2e10 0x7f1ce40737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce8e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce4162720 con 0x7f1ce40b67c0 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce8e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce4073310 con 0x7f1ce40d2e10 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce8e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce4162a00 con 0x7f1ce415e4a0 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ce40d2e10 0x7f1ce40737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ce40d2e10 0x7f1ce40737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51200/0 (socket says 172.21.15.144:51200) 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce2a00640 1 -- 172.21.15.144:0/3761145955 learned_addr learned my addr 172.21.15.144:0/3761145955 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce3400640 1 --2- 172.21.15.144:0/3761145955 >> v2:172.21.15.165:3300/0 conn(0x7f1ce415e4a0 0x7f1ce4161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce2a00640 1 -- 172.21.15.144:0/3761145955 >> v2:172.21.15.165:3300/0 conn(0x7f1ce415e4a0 msgr2=0x7f1ce4161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce2a00640 1 --2- 172.21.15.144:0/3761145955 >> v2:172.21.15.165:3300/0 conn(0x7f1ce415e4a0 0x7f1ce4161e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce2a00640 1 -- 172.21.15.144:0/3761145955 >> v1:172.21.15.165:6789/0 conn(0x7f1ce40b67c0 legacy=0x7f1ce40b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce2a00640 1 -- 172.21.15.144:0/3761145955 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce4162ce0 con 0x7f1ce40d2e10 2024-09-12T12:13:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.209+0000 7f1ce3400640 1 --2- 172.21.15.144:0/3761145955 >> v2:172.21.15.165:3300/0 conn(0x7f1ce415e4a0 0x7f1ce4161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:13.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce2a00640 1 --2- 172.21.15.144:0/3761145955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40d2e10 0x7f1ce40737a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4072910 tx=0x7f1cd001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b79e8835339e4f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:13.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce2000640 1 -- 172.21.15.144:0/3761145955 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00ab430 con 0x7f1ce40d2e10 2024-09-12T12:13:13.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce2000640 1 -- 172.21.15.144:0/3761145955 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00b0070 con 0x7f1ce40d2e10 2024-09-12T12:13:13.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce2000640 1 -- 172.21.15.144:0/3761145955 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00ab7f0 con 0x7f1ce40d2e10 2024-09-12T12:13:13.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce8e00640 1 -- 172.21.15.144:0/3761145955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40d2e10 msgr2=0x7f1ce40737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce8e00640 1 --2- 172.21.15.144:0/3761145955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40d2e10 0x7f1ce40737a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4072910 tx=0x7f1cd001c520 comp rx=0 tx=0).stop 2024-09-12T12:13:13.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce8e00640 1 -- 172.21.15.144:0/3761145955 shutdown_connections 2024-09-12T12:13:13.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce8e00640 1 --2- 172.21.15.144:0/3761145955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40d2e10 0x7f1ce40737a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce8e00640 1 --2- 172.21.15.144:0/3761145955 >> v2:172.21.15.165:3300/0 conn(0x7f1ce415e4a0 0x7f1ce4161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce8e00640 1 -- 172.21.15.144:0/3761145955 >> 172.21.15.144:0/3761145955 conn(0x7f1ce40d2280 msgr2=0x7f1ce40d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:13.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce8e00640 1 -- 172.21.15.144:0/3761145955 shutdown_connections 2024-09-12T12:13:13.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.213+0000 7f1ce8e00640 1 -- 172.21.15.144:0/3761145955 wait complete. 2024-09-12T12:13:13.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 Processor -- start 2024-09-12T12:13:13.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 -- start start 2024-09-12T12:13:13.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40b67c0 0x7f1ce4160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40d2e10 0x7f1ce4158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce415e4a0 0x7f1ce40d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce406d6b0 con 0x7f1ce40b67c0 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce406d530 con 0x7f1ce415e4a0 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce416b000 con 0x7f1ce40d2e10 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40b67c0 0x7f1ce4160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40b67c0 0x7f1ce4160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51208/0 (socket says 172.21.15.144:51208) 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3400640 1 -- 172.21.15.144:0/753773688 learned_addr learned my addr 172.21.15.144:0/753773688 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce2a00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40d2e10 0x7f1ce4158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3e00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce415e4a0 0x7f1ce40d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3400640 1 -- 172.21.15.144:0/753773688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40d2e10 msgr2=0x7f1ce4158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3400640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40d2e10 0x7f1ce4158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3400640 1 -- 172.21.15.144:0/753773688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce415e4a0 msgr2=0x7f1ce40d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3400640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce415e4a0 0x7f1ce40d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3400640 1 -- 172.21.15.144:0/753773688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce4160630 con 0x7f1ce40b67c0 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3e00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce415e4a0 0x7f1ce40d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce3400640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40b67c0 0x7f1ce4160050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d800 tx=0x7f1cd400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1cdb400640 1 -- 172.21.15.144:0/753773688 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd400b6c0 con 0x7f1ce40b67c0 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1cdb400640 1 -- 172.21.15.144:0/753773688 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd4019070 con 0x7f1ce40b67c0 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce4160910 con 0x7f1ce40b67c0 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1cdb400640 1 -- 172.21.15.144:0/753773688 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd400baa0 con 0x7f1ce40b67c0 2024-09-12T12:13:13.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.217+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce415e990 con 0x7f1ce40b67c0 2024-09-12T12:13:13.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.221+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce4161e90 con 0x7f1ce40b67c0 2024-09-12T12:13:13.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.221+0000 7f1cdb400640 1 -- 172.21.15.144:0/753773688 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1cd400bc40 con 0x7f1ce40b67c0 2024-09-12T12:13:13.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.221+0000 7f1cdb400640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678f0 0x7f1cc4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.221+0000 7f1cdb400640 1 -- 172.21.15.144:0/753773688 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1cd4086320 con 0x7f1ce40b67c0 2024-09-12T12:13:13.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.221+0000 7f1ce2a00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678f0 0x7f1cc4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.221+0000 7f1ce2a00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678f0 0x7f1cc4069db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00af000 tx=0x7f1cd00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:13.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.225+0000 7f1cdb400640 1 -- 172.21.15.144:0/753773688 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1cd4056b20 con 0x7f1ce40b67c0 2024-09-12T12:13:13.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.421+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ce415d260 con 0x7f1ce40b67c0 2024-09-12T12:13:13.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.421+0000 7f1cdb400640 1 -- 172.21.15.144:0/753773688 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5228 (secure 0 0 0) 0x7f1cd4056420 con 0x7f1ce40b67c0 2024-09-12T12:13:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:13.422 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-12T12:13:05:442423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:13:04.808385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:13:13.423 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.421+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678f0 msgr2=0x7f1cc4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.421+0000 7f1ce8e00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678f0 0x7f1cc4069db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00af000 tx=0x7f1cd00a7000 comp rx=0 tx=0).stop 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.421+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40b67c0 msgr2=0x7f1ce4160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.421+0000 7f1ce8e00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40b67c0 0x7f1ce4160050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d800 tx=0x7f1cd400dcc0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.425+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 shutdown_connections 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.425+0000 7f1ce8e00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678f0 0x7f1cc4069db0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.425+0000 7f1ce8e00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce415e4a0 0x7f1ce40d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.425+0000 7f1ce8e00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40d2e10 0x7f1ce4158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.425+0000 7f1ce8e00640 1 --2- 172.21.15.144:0/753773688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40b67c0 0x7f1ce4160050 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.425+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 >> 172.21.15.144:0/753773688 conn(0x7f1ce40d2280 msgr2=0x7f1ce4070350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:13.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.425+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 shutdown_connections 2024-09-12T12:13:13.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.425+0000 7f1ce8e00640 1 -- 172.21.15.144:0/753773688 wait complete. 2024-09-12T12:13:13.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:12:44.209030+0000', 'modified': '2024-09-12T12:13:04.808385+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.165:6835/2425635308', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6833', 'nonce': 2425635308}, {'type': 'v1', 'addr': '172.21.15.165:6835', 'nonce': 2425635308}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-09-12T12:13:13.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:13:13.848 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T12:13:13.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.981+0000 7efc8de00640 1 Processor -- start 2024-09-12T12:13:13.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.981+0000 7efc8de00640 1 -- start start 2024-09-12T12:13:13.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc8de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc88148190 0x7efc880ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc8de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efc880b0480 0x7efc880b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc8de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc88148570 con 0x7efc880cd470 2024-09-12T12:13:13.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc8de00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efc880ce090 con 0x7efc88148190 2024-09-12T12:13:13.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc8de00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efc880cd8b0 con 0x7efc880b0480 2024-09-12T12:13:13.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc86a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc88148190 0x7efc880ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc86000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efc880cd470 0x7efc880afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37422/0 (socket says 172.21.15.144:37422) 2024-09-12T12:13:13.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc86000640 1 -- 172.21.15.144:0/2055446108 learned_addr learned my addr 172.21.15.144:0/2055446108 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:13.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc86a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc88148190 0x7efc880ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51222/0 (socket says 172.21.15.144:51222) 2024-09-12T12:13:13.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc87400640 1 --2- 172.21.15.144:0/2055446108 >> v2:172.21.15.165:3300/0 conn(0x7efc880b0480 0x7efc880b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc86a00640 1 -- 172.21.15.144:0/2055446108 >> v2:172.21.15.165:3300/0 conn(0x7efc880b0480 msgr2=0x7efc880b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:13.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc86a00640 1 --2- 172.21.15.144:0/2055446108 >> v2:172.21.15.165:3300/0 conn(0x7efc880b0480 0x7efc880b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc86a00640 1 -- 172.21.15.144:0/2055446108 >> v1:172.21.15.144:6789/0 conn(0x7efc880cd470 legacy=0x7efc880afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc86a00640 1 -- 172.21.15.144:0/2055446108 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc880b41f0 con 0x7efc88148190 2024-09-12T12:13:13.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.985+0000 7efc85600640 1 -- 172.21.15.144:0/2055446108 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1158373872 0 0) 0x7efc88148570 con 0x7efc880cd470 2024-09-12T12:13:13.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc86a00640 1 --2- 172.21.15.144:0/2055446108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc88148190 0x7efc880ccf30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc880d0480 tx=0x7efc7801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189aa5333f3d7647 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc85600640 1 -- 172.21.15.144:0/2055446108 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780b0070 con 0x7efc88148190 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc85600640 1 -- 172.21.15.144:0/2055446108 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc780ab600 con 0x7efc88148190 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc85600640 1 -- 172.21.15.144:0/2055446108 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780ab9d0 con 0x7efc88148190 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 -- 172.21.15.144:0/2055446108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc88148190 msgr2=0x7efc880ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 --2- 172.21.15.144:0/2055446108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc88148190 0x7efc880ccf30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc880d0480 tx=0x7efc7801c480 comp rx=0 tx=0).stop 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 -- 172.21.15.144:0/2055446108 shutdown_connections 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 --2- 172.21.15.144:0/2055446108 >> v2:172.21.15.165:3300/0 conn(0x7efc880b0480 0x7efc880b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 --2- 172.21.15.144:0/2055446108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc88148190 0x7efc880ccf30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 -- 172.21.15.144:0/2055446108 >> 172.21.15.144:0/2055446108 conn(0x7efc8806d0d0 msgr2=0x7efc8806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 -- 172.21.15.144:0/2055446108 shutdown_connections 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 -- 172.21.15.144:0/2055446108 wait complete. 2024-09-12T12:13:13.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 Processor -- start 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 -- start start 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc880b0480 0x7efc88073170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc880cd470 0x7efc8815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.989+0000 7efc8de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88148190 0x7efc8815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc8de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc880b5420 con 0x7efc880b0480 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc8de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc880b11f0 con 0x7efc88148190 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc8de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc880b55a0 con 0x7efc880cd470 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc86a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc880b0480 0x7efc88073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc86a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc880b0480 0x7efc88073170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51228/0 (socket says 172.21.15.144:51228) 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc86a00640 1 -- 172.21.15.144:0/2911530913 learned_addr learned my addr 172.21.15.144:0/2911530913 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc86a00640 1 -- 172.21.15.144:0/2911530913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc880cd470 msgr2=0x7efc8815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc86a00640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc880cd470 0x7efc8815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc86a00640 1 -- 172.21.15.144:0/2911530913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88148190 msgr2=0x7efc8815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:13.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc86a00640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88148190 0x7efc8815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:13.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc86a00640 1 -- 172.21.15.144:0/2911530913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc881686a0 con 0x7efc880b0480 2024-09-12T12:13:13.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc86a00640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc880b0480 0x7efc88073170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efc7801a0b0 tx=0x7efc7801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:13.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc7f400640 1 -- 172.21.15.144:0/2911530913 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780b0040 con 0x7efc880b0480 2024-09-12T12:13:13.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc7f400640 1 -- 172.21.15.144:0/2911530913 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc78004030 con 0x7efc880b0480 2024-09-12T12:13:13.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc8de00640 1 -- 172.21.15.144:0/2911530913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc88168980 con 0x7efc880b0480 2024-09-12T12:13:13.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc7f400640 1 -- 172.21.15.144:0/2911530913 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780043e0 con 0x7efc880b0480 2024-09-12T12:13:13.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc8de00640 1 -- 172.21.15.144:0/2911530913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc8812fc40 con 0x7efc880b0480 2024-09-12T12:13:13.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc7f400640 1 -- 172.21.15.144:0/2911530913 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc78003620 con 0x7efc880b0480 2024-09-12T12:13:13.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.993+0000 7efc7f400640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc680678c0 0x7efc68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc7f400640 1 -- 172.21.15.144:0/2911530913 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc781206d0 con 0x7efc880b0480 2024-09-12T12:13:13.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86000640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc680678c0 0x7efc68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:13.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 Processor -- start 2024-09-12T12:13:13.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 -- start start 2024-09-12T12:13:13.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86000640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc680678c0 0x7efc68069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc740011f0 tx=0x7efc74007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:13.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a923b20 0x563d6a923f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a924440 0x563d6a8d9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a8da290 0x563d6a8da670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:13.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563d6a7c1b60 con 0x563d6a923b20 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563d6a728c70 con 0x563d6a924440 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x563d6a6ceed0 con 0x563d6a8da290 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a923b20 0x563d6a923f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a923b20 0x563d6a923f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51230/0 (socket says 172.21.15.144:51230) 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86a00640 1 -- 172.21.15.144:0/2051756979 learned_addr learned my addr 172.21.15.144:0/2051756979 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86a00640 1 -- 172.21.15.144:0/2051756979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a8da290 msgr2=0x563d6a8da670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86a00640 1 --2- 172.21.15.144:0/2051756979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a8da290 0x563d6a8da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86a00640 1 -- 172.21.15.144:0/2051756979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a924440 msgr2=0x563d6a8d9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86a00640 1 --2- 172.21.15.144:0/2051756979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a924440 0x563d6a8d9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86a00640 1 -- 172.21.15.144:0/2051756979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6a6e0e50 con 0x563d6a923b20 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc86a00640 1 --2- 172.21.15.144:0/2051756979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a923b20 0x563d6a923f00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc780ecc20 tx=0x7efc78009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede06e3f1b4de159 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc73e00640 1 -- 172.21.15.144:0/2051756979 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780f07c0 con 0x563d6a923b20 2024-09-12T12:13:14.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc73e00640 1 -- 172.21.15.144:0/2051756979 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc780f4b70 con 0x563d6a923b20 2024-09-12T12:13:14.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc73e00640 1 -- 172.21.15.144:0/2051756979 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780f93a0 con 0x563d6a923b20 2024-09-12T12:13:14.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 -- 172.21.15.144:0/2051756979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a923b20 msgr2=0x563d6a923f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:14.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 --2- 172.21.15.144:0/2051756979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a923b20 0x563d6a923f00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc780ecc20 tx=0x7efc78009190 comp rx=0 tx=0).stop 2024-09-12T12:13:14.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 -- 172.21.15.144:0/2051756979 shutdown_connections 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 --2- 172.21.15.144:0/2051756979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a8da290 0x563d6a8da670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 --2- 172.21.15.144:0/2051756979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a924440 0x563d6a8d9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 --2- 172.21.15.144:0/2051756979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a923b20 0x563d6a923f00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 -- 172.21.15.144:0/2051756979 >> 172.21.15.144:0/2051756979 conn(0x563d6a8e0600 msgr2=0x563d6a8d8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 -- 172.21.15.144:0/2051756979 shutdown_connections 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:13.997+0000 7efc9115e000 1 -- 172.21.15.144:0/2051756979 wait complete. 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 -- start start 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 Processor -- start 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 0x563d6a8dee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a8e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 0x563d6a8e5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563d6a78ab00 con 0x563d6a924440 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563d6a703360 con 0x563d6a8df390 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x563d6a7002d0 con 0x563d6a923b20 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 10 client.0 _ll_register_callbacks cb 0x563d6a8c5820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a8e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a8e4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51242/0 (socket says 172.21.15.144:51242) 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86000640 1 -- 172.21.15.144:0/1394943300 learned_addr learned my addr 172.21.15.144:0/1394943300 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc87400640 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 0x563d6a8e5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86a00640 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 0x563d6a8dee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86000640 1 -- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 msgr2=0x563d6a8dee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86000640 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 0x563d6a8dee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86000640 1 -- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 msgr2=0x563d6a8e5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:14.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86000640 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 0x563d6a8e5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86000640 1 -- 172.21.15.144:0/1394943300 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6a6cf120 con 0x563d6a924440 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86000640 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a8e4cf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc74005d80 tx=0x7efc74016820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301a3b37d3e37ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc70c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc70c00640 1 -- 172.21.15.144:0/1394943300 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74005db0 con 0x563d6a924440 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc70c00640 1 -- 172.21.15.144:0/1394943300 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc74016110 con 0x563d6a924440 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 -- 172.21.15.144:0/1394943300 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc780f4b70 con 0x563d6a924440 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc70c00640 1 -- 172.21.15.144:0/1394943300 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7efc74012440 con 0x563d6a924440 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 10 client.4668 fetch_fsmap learned FSMap version 8 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 -- 172.21.15.144:0/1394943300 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x563d6a6c8450 con 0x563d6a924440 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc70c00640 1 -- 172.21.15.144:0/1394943300 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc780f4b70 con 0x563d6a924440 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc70c00640 1 -- 172.21.15.144:0/1394943300 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7efc740125e0 con 0x563d6a924440 2024-09-12T12:13:14.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T12:13:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 10 client.4668 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:13:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 20 client.4668 populate_metadata read hostname 'smithi144' 2024-09-12T12:13:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x563d6a929f50 0x563d6a92a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 4 client.4668 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:13:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc9115e000 1 -- 172.21.15.144:0/1394943300 --> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d6a6c2c00 con 0x563d6a929f50 2024-09-12T12:13:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.001+0000 7efc86a00640 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x563d6a929f50 0x563d6a92a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc86a00640 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x563d6a929f50 0x563d6a92a330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ced4fbc8c67856e server_cookie=6b530d4b05d0ef03 in_seq=0 out_seq=0 2024-09-12T12:13:14.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc70c00640 10 client.4668 ms_handle_connect on v2:172.21.15.165:6833/2425635308 2024-09-12T12:13:14.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc70c00640 1 -- 172.21.15.144:0/1394943300 <== mds.0 v2:172.21.15.165:6833/2425635308 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d6a6c2c00 con 0x563d6a929f50 2024-09-12T12:13:14.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc70c00640 10 client.4668 handle_command_reply: tid=0 2024-09-12T12:13:14.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 client.4668 shutdown 2024-09-12T12:13:14.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 -- 172.21.15.144:0/1394943300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 msgr2=0x563d6a8e4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:14.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a8e4cf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efc74005d80 tx=0x7efc74016820 comp rx=0 tx=0).stop 2024-09-12T12:13:14.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 -- 172.21.15.144:0/1394943300 shutdown_connections 2024-09-12T12:13:14.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 0x563d6a8e5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x563d6a929f50 0x563d6a92a330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a8e4cf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 --2- 172.21.15.144:0/1394943300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 0x563d6a8dee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc70c00640 0 client.4668 ms_handle_reset on v2:172.21.15.165:6833/2425635308 2024-09-12T12:13:14.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 -- 172.21.15.144:0/1394943300 >> 172.21.15.144:0/1394943300 conn(0x563d6a8da290 msgr2=0x563d6a8d8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:14.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 -- 172.21.15.144:0/1394943300 shutdown_connections 2024-09-12T12:13:14.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 1 -- 172.21.15.144:0/1394943300 wait complete. 2024-09-12T12:13:14.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.005+0000 7efc9115e000 20 client.4668 trim_cache size 0 max 16384 2024-09-12T12:13:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.021+0000 7efc9115e000 1 Processor -- start 2024-09-12T12:13:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.021+0000 7efc9115e000 1 -- start start 2024-09-12T12:13:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 0x563d6a923260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 0x563d6a93a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a93a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc88203d20 con 0x563d6a924440 2024-09-12T12:13:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc88131370 con 0x563d6a8df390 2024-09-12T12:13:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc882036d0 con 0x563d6a923b20 2024-09-12T12:13:14.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc87400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a93a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc87400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a93a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51244/0 (socket says 172.21.15.144:51244) 2024-09-12T12:13:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc87400640 1 -- 172.21.15.144:0/2901391379 learned_addr learned my addr 172.21.15.144:0/2901391379 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc86a00640 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 0x563d6a923260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc86000640 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 0x563d6a93a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc87400640 1 -- 172.21.15.144:0/2901391379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 msgr2=0x563d6a93a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc87400640 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 0x563d6a93a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc87400640 1 -- 172.21.15.144:0/2901391379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 msgr2=0x563d6a923260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:14.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc87400640 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 0x563d6a923260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc87400640 1 -- 172.21.15.144:0/2901391379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6a6affd0 con 0x563d6a924440 2024-09-12T12:13:14.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc86a00640 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 0x563d6a923260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:14.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc87400640 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a93a550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efc80003e90 tx=0x7efc80009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdaf93edad91080 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:14.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc73400640 1 -- 172.21.15.144:0/2901391379 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc800046b0 con 0x563d6a924440 2024-09-12T12:13:14.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc73400640 1 -- 172.21.15.144:0/2901391379 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8001a070 con 0x563d6a924440 2024-09-12T12:13:14.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc73400640 1 -- 172.21.15.144:0/2901391379 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80015660 con 0x563d6a924440 2024-09-12T12:13:14.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 -- 172.21.15.144:0/2901391379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 msgr2=0x563d6a93a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:14.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a93a550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efc80003e90 tx=0x7efc80009d30 comp rx=0 tx=0).stop 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 -- 172.21.15.144:0/2901391379 shutdown_connections 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a924440 0x563d6a93a550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a923b20 0x563d6a93a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 --2- 172.21.15.144:0/2901391379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a8df390 0x563d6a923260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 -- 172.21.15.144:0/2901391379 >> 172.21.15.144:0/2901391379 conn(0x563d6a8da290 msgr2=0x563d6a8de650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 -- 172.21.15.144:0/2901391379 shutdown_connections 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 -- 172.21.15.144:0/2901391379 wait complete. 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 -- start start 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.025+0000 7efc9115e000 1 Processor -- start 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a8df390 0x563d6a9302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a923b20 0x563d6a92d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a924440 0x563d6a92d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563d6a727f80 con 0x563d6a8df390 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563d6a6e0ca0 con 0x563d6a923b20 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x563d6a72d2a0 con 0x563d6a924440 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 10 client.0 _ll_register_callbacks cb 0x7efc74001320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a8df390 0x563d6a9302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a8df390 0x563d6a9302d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51258/0 (socket says 172.21.15.144:51258) 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86a00640 1 -- 172.21.15.144:0/878550455 learned_addr learned my addr 172.21.15.144:0/878550455 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc87400640 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a924440 0x563d6a92d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86000640 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a923b20 0x563d6a92d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86a00640 1 -- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a924440 msgr2=0x563d6a92d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86a00640 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a924440 0x563d6a92d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86a00640 1 -- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a923b20 msgr2=0x563d6a92d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:14.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86a00640 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a923b20 0x563d6a92d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86a00640 1 -- 172.21.15.144:0/878550455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6a7ab750 con 0x563d6a8df390 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86000640 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a923b20 0x563d6a92d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86a00640 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a8df390 0x563d6a9302d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efc7801c960 tx=0x7efc780abf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e319451d93afce1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 1 -- 172.21.15.144:0/878550455 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc780ece30 con 0x563d6a8df390 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 1 -- 172.21.15.144:0/878550455 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc780bf3a0 con 0x563d6a8df390 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- 172.21.15.144:0/878550455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc8001a070 con 0x563d6a8df390 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 1 -- 172.21.15.144:0/878550455 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7efc78111050 con 0x563d6a8df390 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 10 client.4674 fetch_fsmap learned FSMap version 8 2024-09-12T12:13:14.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- 172.21.15.144:0/878550455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x563d6a6b6a30 con 0x563d6a8df390 2024-09-12T12:13:14.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 1 -- 172.21.15.144:0/878550455 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc8001a070 con 0x563d6a8df390 2024-09-12T12:13:14.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 1 -- 172.21.15.144:0/878550455 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7efc78114020 con 0x563d6a8df390 2024-09-12T12:13:14.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T12:13:14.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 10 client.4674 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:13:14.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 20 client.4674 populate_metadata read hostname 'smithi144' 2024-09-12T12:13:14.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x563d6a92de10 0x563d6a99f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 4 client.4674 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- 172.21.15.144:0/878550455 --> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] -- command(tid 0: {"prefix": "status"}) -- 0x563d6a7363a0 con 0x563d6a92de10 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86000640 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x563d6a92de10 0x563d6a99f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc86000640 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x563d6a92de10 0x563d6a99f200 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=401e322f7c69d6f3 server_cookie=a9d52451a934ef74 in_seq=0 out_seq=0 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 10 client.4674 ms_handle_connect on v2:172.21.15.165:6833/2425635308 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 1 -- 172.21.15.144:0/878550455 <== mds.0 v2:172.21.15.165:6833/2425635308 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x563d6a7363a0 con 0x563d6a92de10 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 10 client.4674 handle_command_reply: tid=0 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 client.4674 shutdown 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- 172.21.15.144:0/878550455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a8df390 msgr2=0x563d6a9302d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a8df390 0x563d6a9302d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efc7801c960 tx=0x7efc780abf90 comp rx=0 tx=0).stop 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- 172.21.15.144:0/878550455 shutdown_connections 2024-09-12T12:13:14.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563d6a924440 0x563d6a92d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563d6a923b20 0x563d6a92d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.165:6833/2425635308,v1:172.21.15.165:6835/2425635308] conn(0x563d6a92de10 0x563d6a99f200 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 --2- 172.21.15.144:0/878550455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d6a8df390 0x563d6a9302d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc70c00640 0 client.4674 ms_handle_reset on v2:172.21.15.165:6833/2425635308 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- 172.21.15.144:0/878550455 >> 172.21.15.144:0/878550455 conn(0x563d6a8da290 msgr2=0x563d6a939000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- 172.21.15.144:0/878550455 shutdown_connections 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 1 -- 172.21.15.144:0/878550455 wait complete. 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.029+0000 7efc9115e000 20 client.4674 trim_cache size 0 max 16384 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:13:14.038 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4287, 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 29.211451755999999, 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 8, 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 25, 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 25, 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 35.200824992999998 2024-09-12T12:13:14.039 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:13:14.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 -- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc680678c0 msgr2=0x7efc68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:14.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc680678c0 0x7efc68069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc740011f0 tx=0x7efc74007930 comp rx=0 tx=0).stop 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 -- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc880b0480 msgr2=0x7efc88073170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc880b0480 0x7efc88073170 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efc7801a0b0 tx=0x7efc7801acc0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 -- 172.21.15.144:0/2911530913 shutdown_connections 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc680678c0 0x7efc68069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88148190 0x7efc8815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc880cd470 0x7efc8815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 --2- 172.21.15.144:0/2911530913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc880b0480 0x7efc88073170 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 -- 172.21.15.144:0/2911530913 >> 172.21.15.144:0/2911530913 conn(0x7efc8806d0d0 msgr2=0x7efc880cf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 -- 172.21.15.144:0/2911530913 shutdown_connections 2024-09-12T12:13:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:14.033+0000 7efc8de00640 1 -- 172.21.15.144:0/2911530913 wait complete. 2024-09-12T12:13:14.052 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T12:13:14.062 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T12:13:14.063 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T12:13:14.063 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T12:13:14.063 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T12:13:14.075 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T12:13:14.076 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-12T12:13:14.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:14.076 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:13:14.085 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T12:13:14.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:14.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T12:13:14.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:14.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-12T12:13:14.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:14.719 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:13:14.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:14.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-12T12:13:14.794 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-09-12T12:13:14.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:13:14.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:14.796 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-12T12:13:14.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:14.806 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-12T12:13:14.872 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-09-12T12:13:14.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:13:14.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:14.874 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-12T12:13:14.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:14.925 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-12T12:13:14.991 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-09-12T12:13:14.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:13:14.994 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-12T12:13:14.994 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:13:14.994 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:13:14.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:13:15.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9328e00640 1 Processor -- start 2024-09-12T12:13:15.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9328e00640 1 -- start start 2024-09-12T12:13:15.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9328e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93240afb40 0x7f93240b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:15.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9328e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f93240af5f0 0x7f93240b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:15.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9328e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93240b22d0 con 0x7f932415e6a0 2024-09-12T12:13:15.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9328e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f93240b2080 con 0x7f93240af5f0 2024-09-12T12:13:15.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9328e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9324067d70 con 0x7f93240afb40 2024-09-12T12:13:15.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9323400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f932415e6a0 0x7f93240caf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37432/0 (socket says 172.21.15.144:37432) 2024-09-12T12:13:15.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9323400640 1 -- 172.21.15.144:0/3396356182 learned_addr learned my addr 172.21.15.144:0/3396356182 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219591877 0 0) 0x7f93240b22d0 con 0x7f932415e6a0 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9323e00640 1 --2- 172.21.15.144:0/3396356182 >> v2:172.21.15.165:3300/0 conn(0x7f93240af5f0 0x7f93240b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9308003530 con 0x7f932415e6a0 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322a00640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93240afb40 0x7f93240b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1221097658 0 0) 0x7f9308003530 con 0x7f932415e6a0 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93240afb40 msgr2=0x7f93240b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93240afb40 0x7f93240b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 >> v2:172.21.15.165:3300/0 conn(0x7f93240af5f0 msgr2=0x7f93240b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 --2- 172.21.15.144:0/3396356182 >> v2:172.21.15.165:3300/0 conn(0x7f93240af5f0 0x7f93240b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93240b65f0 con 0x7f932415e6a0 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f930c001680 con 0x7f932415e6a0 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 >> v1:172.21.15.144:6789/0 conn(0x7f932415e6a0 legacy=0x7f93240caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93080039c0 0x7f9308003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9308004810 0x7f9308004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93080051d0 0x7f930800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f93240b2080 con 0x7f93080051d0 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9324067d70 con 0x7f9308004810 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f930800c010 con 0x7f93080039c0 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9323e00640 1 --2- 172.21.15.144:0/3396356182 >> v2:172.21.15.165:3300/0 conn(0x7f93240af5f0 0x7f93240b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.129+0000 7f9322a00640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93240afb40 0x7f93240b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9323e00640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93080051d0 0x7f930800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9323400640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93080039c0 0x7f9308003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9322a00640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9308004810 0x7f9308004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9323e00640 1 -- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93080039c0 msgr2=0x7f9308003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9323e00640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93080039c0 0x7f9308003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9323e00640 1 -- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9308004810 msgr2=0x7f9308004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9323e00640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9308004810 0x7f9308004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9323e00640 1 -- 172.21.15.144:0/3396356182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9308003530 con 0x7f93080051d0 2024-09-12T12:13:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9323e00640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93080051d0 0x7f930800b9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f931c0073e0 tx=0x7f931c01cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f5ceaa77d1b32f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c009c80 con 0x7f93080051d0 2024-09-12T12:13:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c0a5e00 con 0x7f93080051d0 2024-09-12T12:13:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.133+0000 7f9322000640 1 -- 172.21.15.144:0/3396356182 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c003bc0 con 0x7f93080051d0 2024-09-12T12:13:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 -- 172.21.15.144:0/3396356182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93080051d0 msgr2=0x7f930800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 --2- 172.21.15.144:0/3396356182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93080051d0 0x7f930800b9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f931c0073e0 tx=0x7f931c01cf00 comp rx=0 tx=0).stop 2024-09-12T12:13:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 -- 172.21.15.144:0/3396356182 reap_dead start 2024-09-12T12:13:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 -- 172.21.15.144:0/3396356182 shutdown_connections 2024-09-12T12:13:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 -- 172.21.15.144:0/3396356182 >> 172.21.15.144:0/3396356182 conn(0x7f93240b0580 msgr2=0x7f93240b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 -- 172.21.15.144:0/3396356182 shutdown_connections 2024-09-12T12:13:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 -- 172.21.15.144:0/3396356182 wait complete. 2024-09-12T12:13:15.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 Processor -- start 2024-09-12T12:13:15.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 -- start start 2024-09-12T12:13:15.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93080051d0 0x7f9324161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:15.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93241411a0 0x7f932415f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:15.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93241443c0 0x7f932415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:15.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f93240cb6a0 con 0x7f93241443c0 2024-09-12T12:13:15.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9324067a00 con 0x7f93080051d0 2024-09-12T12:13:15.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9328e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9324161a80 con 0x7f93241411a0 2024-09-12T12:13:15.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93241443c0 0x7f932415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:15.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93241443c0 0x7f932415cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51286/0 (socket says 172.21.15.144:51286) 2024-09-12T12:13:15.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 -- 172.21.15.144:0/4080145186 learned_addr learned my addr 172.21.15.144:0/4080145186 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9322a00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93241411a0 0x7f932415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323400640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93080051d0 0x7f9324161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 -- 172.21.15.144:0/4080145186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93241411a0 msgr2=0x7f932415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93241411a0 0x7f932415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 -- 172.21.15.144:0/4080145186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93080051d0 msgr2=0x7f9324161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93080051d0 0x7f9324161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 -- 172.21.15.144:0/4080145186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932415fd50 con 0x7f93241443c0 2024-09-12T12:13:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.137+0000 7f9323e00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93241443c0 0x7f932415cfa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f931c0073e0 tx=0x7f9308005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f931b400640 1 -- 172.21.15.144:0/4080145186 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c009c80 con 0x7f93241443c0 2024-09-12T12:13:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f931b400640 1 -- 172.21.15.144:0/4080145186 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931c0a5c00 con 0x7f93241443c0 2024-09-12T12:13:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f931b400640 1 -- 172.21.15.144:0/4080145186 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c0046b0 con 0x7f93241443c0 2024-09-12T12:13:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9324160780 con 0x7f93241443c0 2024-09-12T12:13:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9324160d40 con 0x7f93241443c0 2024-09-12T12:13:15.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93240caf90 con 0x7f93241443c0 2024-09-12T12:13:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f931b400640 1 -- 172.21.15.144:0/4080145186 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f931c0c1020 con 0x7f93241443c0 2024-09-12T12:13:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f931b400640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f93000678c0 0x7f9300069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f931b400640 1 -- 172.21.15.144:0/4080145186 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f931c120790 con 0x7f93241443c0 2024-09-12T12:13:15.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f9323400640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f93000678c0 0x7f9300069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:15.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.141+0000 7f9323400640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f93000678c0 0x7f9300069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f930c000c10 tx=0x7f930c007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:15.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.145+0000 7f931b400640 1 -- 172.21.15.144:0/4080145186 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f931c0c8020 con 0x7f93241443c0 2024-09-12T12:13:15.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9324161c00 con 0x7f93241443c0 2024-09-12T12:13:15.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f931b400640 1 -- 172.21.15.144:0/4080145186 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f931c016c10 con 0x7f93241443c0 2024-09-12T12:13:15.338 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T12:13:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f93000678c0 msgr2=0x7f9300069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f93000678c0 0x7f9300069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f930c000c10 tx=0x7f930c007040 comp rx=0 tx=0).stop 2024-09-12T12:13:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93241443c0 msgr2=0x7f932415cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93241443c0 0x7f932415cfa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f931c0073e0 tx=0x7f9308005840 comp rx=0 tx=0).stop 2024-09-12T12:13:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 shutdown_connections 2024-09-12T12:13:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f93000678c0 0x7f9300069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93241443c0 0x7f932415cfa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93241411a0 0x7f932415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 --2- 172.21.15.144:0/4080145186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93080051d0 0x7f9324161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 >> 172.21.15.144:0/4080145186 conn(0x7f93240b0580 msgr2=0x7f93240cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:15.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 shutdown_connections 2024-09-12T12:13:15.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15.337+0000 7f9328e00640 1 -- 172.21.15.144:0/4080145186 wait complete. 2024-09-12T12:13:15.359 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T12:13:15.359 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:13:15.359 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:13:15.359 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:13:15.359 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:13:15.359 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T12:13:15.359 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:13:15.359 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:13:15.359 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:13:15.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:15.360 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:13:15.368 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:13:15.368 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:13:15.368 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:13:15.368 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:15.369 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:13:15.370 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42388sec preferred_lft 42388sec 2024-09-12T12:13:15.370 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:13:15.370 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:15.370 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:13:15.370 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:15.370 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:13:15.370 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:15.371 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T12:13:15.371 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:15.371 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:15.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2024-09-12T12:13:15.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2024-09-12T12:13:15.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2024-09-12T12:13:15.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T12:13:15.372 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:15.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:15.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:15.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:15.525 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:13:15.544 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:13:15.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:15.546 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:13:15.605 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:13:15.605 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:13:15.605 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:13:15.605 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:13:15.605 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:13:15.605 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:13:15.605 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:13:15.606 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:15.606 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:15.606 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:15.606 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:13:15.606 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:15.606 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:15.607 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:13:15.607 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:13:15.607 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:13:15.607 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:15.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:15.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:15.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:15.742 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:13:15.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:15.798 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2024-09-12T12:13:15.849 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:15.850 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:15.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:13:15.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T12:13:15.850 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:15.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:15.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:15.977 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T12:13:15.977 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:15.977 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:15.977 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T12:13:15.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T12:13:15.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T12:13:15.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T12:13:15.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T12:13:15.978 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:16.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:16.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:16.116 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:16.116 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:16.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:13:16.116 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T12:13:16.116 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:16.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:16.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:16.242 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:13:16.250 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:13:16.251 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:16.251 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:13:16.300 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:13:16.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:16.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:16.393 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:16.393 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:17.069 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:17.070 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:17.070 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:13:17.070 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:13:17.070 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:13:17.073 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:13:17.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:17.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:13:17.093 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:17.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:17.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:17.194 INFO:teuthology.orchestra.run.smithi144.stdout:client4511 2024-09-12T12:13:17.194 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:17.194 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:17.203 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:17.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:17.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:17.300 INFO:teuthology.orchestra.run.smithi144.stdout:client4511 2024-09-12T12:13:17.300 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:17.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:17.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:17.357 INFO:teuthology.orchestra.run.smithi144.stdout:client4511 2024-09-12T12:13:17.357 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/91f78d05-407b-4adf-ae67-409c5ce36eb9.client4511/status') 2024-09-12T12:13:17.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:17.459 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4511 (3)172.21.15.144:0/1421141531 2024-09-12T12:13:17.459 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2024-09-12T12:13:17.460 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2024-09-12T12:13:17.460 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2024-09-12T12:13:17.460 INFO:teuthology.orchestra.run.smithi144.stderr:71 bytes copied, 5.9197e-05 s, 1.2 MB/s 2024-09-12T12:13:17.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:17.468 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-12T12:13:17.468 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:13:17.468 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T12:13:17.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:13:17.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.601+0000 7f088e000640 1 Processor -- start 2024-09-12T12:13:17.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088e000640 1 -- start start 2024-09-12T12:13:17.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f088815c0a0 0x7f08880b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:17.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088e000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088815c480 con 0x7f08880b7230 2024-09-12T12:13:17.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088e000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088815fdd0 con 0x7f08880ce950 2024-09-12T12:13:17.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088e000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f08881609e0 con 0x7f088815c0a0 2024-09-12T12:13:17.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f088815c0a0 0x7f08880b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:17.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f088815c0a0 0x7f08880b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32974/0 (socket says 172.21.15.144:32974) 2024-09-12T12:13:17.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088cc00640 1 -- 172.21.15.144:0/458934960 learned_addr learned my addr 172.21.15.144:0/458934960 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:17.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088d600640 1 --1- 172.21.15.144:0/458934960 >> v1:172.21.15.144:6789/0 conn(0x7f08880b7230 0x7f08880730b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41906/0 (socket says 172.21.15.144:41906) 2024-09-12T12:13:17.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088cc00640 1 -- 172.21.15.144:0/458934960 >> v1:172.21.15.165:6789/0 conn(0x7f08880ce950 legacy=0x7f08880b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:17.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088cc00640 1 -- 172.21.15.144:0/458934960 >> v1:172.21.15.144:6789/0 conn(0x7f08880b7230 legacy=0x7f08880730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:17.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.605+0000 7f088cc00640 1 -- 172.21.15.144:0/458934960 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08881600b0 con 0x7f088815c0a0 2024-09-12T12:13:17.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088cc00640 1 --2- 172.21.15.144:0/458934960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f088815c0a0 0x7f08880b5310 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0878009870 tx=0x7f087801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dec7e512b1b858 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:17.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f0887400640 1 -- 172.21.15.144:0/458934960 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08780ab640 con 0x7f088815c0a0 2024-09-12T12:13:17.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f0887400640 1 -- 172.21.15.144:0/458934960 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08780b0070 con 0x7f088815c0a0 2024-09-12T12:13:17.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f0887400640 1 -- 172.21.15.144:0/458934960 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08780aba00 con 0x7f088815c0a0 2024-09-12T12:13:17.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088e000640 1 -- 172.21.15.144:0/458934960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f088815c0a0 msgr2=0x7f08880b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088e000640 1 --2- 172.21.15.144:0/458934960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f088815c0a0 0x7f08880b5310 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0878009870 tx=0x7f087801c460 comp rx=0 tx=0).stop 2024-09-12T12:13:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088e000640 1 -- 172.21.15.144:0/458934960 shutdown_connections 2024-09-12T12:13:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088e000640 1 --2- 172.21.15.144:0/458934960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f088815c0a0 0x7f08880b5310 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088e000640 1 -- 172.21.15.144:0/458934960 >> 172.21.15.144:0/458934960 conn(0x7f08880d2280 msgr2=0x7f08880d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088e000640 1 -- 172.21.15.144:0/458934960 shutdown_connections 2024-09-12T12:13:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088e000640 1 -- 172.21.15.144:0/458934960 wait complete. 2024-09-12T12:13:17.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088e000640 1 Processor -- start 2024-09-12T12:13:17.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.609+0000 7f088e000640 1 -- start start 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08880b7230 0x7f0888150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088e000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08880ce950 0x7f08881530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088e000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f088815c0a0 0x7f088806da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f088816a160 con 0x7f08880b7230 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088e000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0888169fe0 con 0x7f088815c0a0 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088e000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f088816a2e0 con 0x7f08880ce950 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08880b7230 0x7f0888150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08880b7230 0x7f0888150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32990/0 (socket says 172.21.15.144:32990) 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088cc00640 1 -- 172.21.15.144:0/1110070356 learned_addr learned my addr 172.21.15.144:0/1110070356 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088cc00640 1 -- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08880ce950 msgr2=0x7f08881530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f0887e00640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08880ce950 0x7f08881530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:17.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088d600640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f088815c0a0 0x7f088806da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088cc00640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08880ce950 0x7f08881530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088cc00640 1 -- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f088815c0a0 msgr2=0x7f088806da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088cc00640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f088815c0a0 0x7f088806da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088cc00640 1 -- 172.21.15.144:0/1110070356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088815acc0 con 0x7f08880b7230 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f0887e00640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08880ce950 0x7f08881530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088d600640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f088815c0a0 0x7f088806da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088cc00640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08880b7230 0x7f0888150000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f08780ad040 tx=0x7f087801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f0884c00640 1 -- 172.21.15.144:0/1110070356 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08780be5f0 con 0x7f08880b7230 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f0884c00640 1 -- 172.21.15.144:0/1110070356 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08780abe50 con 0x7f08880b7230 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088815a140 con 0x7f08880b7230 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f0884c00640 1 -- 172.21.15.144:0/1110070356 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08780be9f0 con 0x7f08880b7230 2024-09-12T12:13:17.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088815a700 con 0x7f08880b7230 2024-09-12T12:13:17.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08880b5310 con 0x7f08880b7230 2024-09-12T12:13:17.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.613+0000 7f0884c00640 1 -- 172.21.15.144:0/1110070356 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f08780b43f0 con 0x7f08880b7230 2024-09-12T12:13:17.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.617+0000 7f0884c00640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08680678c0 0x7f0868069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:17.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.617+0000 7f0884c00640 1 -- 172.21.15.144:0/1110070356 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0878120ee0 con 0x7f08880b7230 2024-09-12T12:13:17.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.617+0000 7f0887e00640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08680678c0 0x7f0868069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:17.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.617+0000 7f0887e00640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08680678c0 0x7f0868069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f08881fa730 tx=0x7f0874009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:17.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.621+0000 7f0884c00640 1 -- 172.21.15.144:0/1110070356 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0878016110 con 0x7f08880b7230 2024-09-12T12:13:17.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.813+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f08880b1c60 con 0x7f08880b7230 2024-09-12T12:13:17.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.813+0000 7f0884c00640 1 -- 172.21.15.144:0/1110070356 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f08780f16d0 con 0x7f08880b7230 2024-09-12T12:13:17.815 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T12:13:17.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08680678c0 msgr2=0x7f0868069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:17.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08680678c0 0x7f0868069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f08881fa730 tx=0x7f0874009040 comp rx=0 tx=0).stop 2024-09-12T12:13:17.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08880b7230 msgr2=0x7f0888150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:17.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08880b7230 0x7f0888150000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f08780ad040 tx=0x7f087801aca0 comp rx=0 tx=0).stop 2024-09-12T12:13:17.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 shutdown_connections 2024-09-12T12:13:17.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08680678c0 0x7f0868069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:17.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f088815c0a0 0x7f088806da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:17.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08880ce950 0x7f08881530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:17.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 --2- 172.21.15.144:0/1110070356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08880b7230 0x7f0888150000 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:17.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 >> 172.21.15.144:0/1110070356 conn(0x7f08880d2280 msgr2=0x7f088806f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:17.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 shutdown_connections 2024-09-12T12:13:17.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:17.817+0000 7f088e000640 1 -- 172.21.15.144:0/1110070356 wait complete. 2024-09-12T12:13:17.836 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T12:13:17.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:13:17.836 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:13:17.837 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-12T12:13:17.837 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T12:13:17.837 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T12:13:17.837 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:13:17.837 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:13:17.837 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-12T12:13:17.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:17.837 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:13:17.846 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:13:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:13:17.846 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:13:17.847 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42385sec preferred_lft 42385sec 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:13:17.848 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:17.849 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:13:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:13:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-09-12T12:13:17.849 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:17.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:17.849 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:13:17.909 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:13:17.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:17.911 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:13:17.965 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:13:17.966 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:13:17.966 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:13:17.966 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:13:17.966 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:13:17.966 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:13:17.966 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:13:17.966 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:17.967 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:17.967 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:17.967 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:13:17.967 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:17.967 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:17.968 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:13:17.968 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:13:17.968 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:13:17.968 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:18.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:18.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:18.106 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:13:18.114 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:13:18.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:18.117 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2024-09-12T12:13:18.168 INFO:teuthology.orchestra.run.smithi144.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-12T12:13:18.169 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:18.169 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:18.169 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:13:18.169 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-12T12:13:18.169 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:18.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:18.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:18.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:18.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T12:13:18.316 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:13:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:13:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:13:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:13:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:18.316 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:13:18.316 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 66:62:89:51:26:c5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T12:13:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T12:13:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::6462:89ff:fe51:26c5/64 scope link 2024-09-12T12:13:18.317 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:18.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:18.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 66:62:89:51:26:c5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T12:13:18.381 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::6462:89ff:fe51:26c5/64 scope link 2024-09-12T12:13:18.382 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:18.383 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-12T12:13:18.383 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:18.383 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:18.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-12T12:13:18.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T12:13:18.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-12T12:13:18.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-12T12:13:18.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-12T12:13:18.384 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:18.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:18.569 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:18.569 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:18.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.1 up 2024-09-12T12:13:18.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T12:13:18.570 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:18.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:18.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:18.698 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:18.698 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-12T12:13:18.707 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-12T12:13:18.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:18.707 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-12T12:13:18.759 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-12T12:13:18.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:18.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:18.849 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:13:18.865 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 2@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:13:18.866 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:13:18.870 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:13:18.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:18.870 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-12T12:13:18.889 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:18.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:18.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:18.988 INFO:teuthology.orchestra.run.smithi144.stdout:client4514 2024-09-12T12:13:18.989 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:18.989 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:19.045 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:19.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:19.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:19.149 INFO:teuthology.orchestra.run.smithi144.stdout:client4514 2024-09-12T12:13:19.150 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:19.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:19.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:19.251 INFO:teuthology.orchestra.run.smithi144.stdout:client4514 2024-09-12T12:13:19.252 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/91f78d05-407b-4adf-ae67-409c5ce36eb9.client4514/status') 2024-09-12T12:13:19.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:19.354 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4514 (3)172.21.15.144:0/990601779 2024-09-12T12:13:19.354 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2024-09-12T12:13:19.354 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2024-09-12T12:13:19.354 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2024-09-12T12:13:19.354 INFO:teuthology.orchestra.run.smithi144.stderr:70 bytes copied, 6.8449e-05 s, 1.0 MB/s 2024-09-12T12:13:19.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:19.362 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-12T12:13:19.362 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:13:19.362 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T12:13:19.362 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:13:19.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194fe00640 1 Processor -- start 2024-09-12T12:13:19.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194fe00640 1 -- start start 2024-09-12T12:13:19.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1950073bd0 0x7f1950070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:19.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19500cff90 0x7f19500d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:19.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19500cd1d0 con 0x7f195015b160 2024-09-12T12:13:19.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f195015b540 con 0x7f1950073bd0 2024-09-12T12:13:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f19500cd4a0 con 0x7f19500cff90 2024-09-12T12:13:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f195015b160 0x7f19500ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41908/0 (socket says 172.21.15.144:41908) 2024-09-12T12:13:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194ea00640 1 -- 172.21.15.144:0/3952054489 learned_addr learned my addr 172.21.15.144:0/3952054489 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f1947e00640 1 --2- 172.21.15.144:0/3952054489 >> v2:172.21.15.144:3300/0 conn(0x7f1950073bd0 0x7f1950070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194f400640 1 --2- 172.21.15.144:0/3952054489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19500cff90 0x7f19500d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f194e000640 1 -- 172.21.15.144:0/3952054489 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912232746 0 0) 0x7f19500cd1d0 con 0x7f195015b160 2024-09-12T12:13:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f1947e00640 1 -- 172.21.15.144:0/3952054489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19500cff90 msgr2=0x7f19500d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f1947e00640 1 --2- 172.21.15.144:0/3952054489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19500cff90 0x7f19500d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:19.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f1947e00640 1 -- 172.21.15.144:0/3952054489 >> v1:172.21.15.144:6789/0 conn(0x7f195015b160 legacy=0x7f19500ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:19.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.501+0000 7f1947e00640 1 -- 172.21.15.144:0/3952054489 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19500cd780 con 0x7f1950073bd0 2024-09-12T12:13:19.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f1947e00640 1 --2- 172.21.15.144:0/3952054489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 0x7f1950070ee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f19380097c0 tx=0x7f193801e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3541b0928258bbc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:19.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194e000640 1 -- 172.21.15.144:0/3952054489 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380ad430 con 0x7f1950073bd0 2024-09-12T12:13:19.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194e000640 1 -- 172.21.15.144:0/3952054489 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19380b2070 con 0x7f1950073bd0 2024-09-12T12:13:19.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194e000640 1 -- 172.21.15.144:0/3952054489 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19380ad7f0 con 0x7f1950073bd0 2024-09-12T12:13:19.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 -- 172.21.15.144:0/3952054489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 msgr2=0x7f1950070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:19.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 --2- 172.21.15.144:0/3952054489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 0x7f1950070ee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f19380097c0 tx=0x7f193801e620 comp rx=0 tx=0).stop 2024-09-12T12:13:19.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 -- 172.21.15.144:0/3952054489 shutdown_connections 2024-09-12T12:13:19.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 --2- 172.21.15.144:0/3952054489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19500cff90 0x7f19500d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:19.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 --2- 172.21.15.144:0/3952054489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 0x7f1950070ee0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:19.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 -- 172.21.15.144:0/3952054489 >> 172.21.15.144:0/3952054489 conn(0x7f195006bc10 msgr2=0x7f195006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:19.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 -- 172.21.15.144:0/3952054489 shutdown_connections 2024-09-12T12:13:19.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 -- 172.21.15.144:0/3952054489 wait complete. 2024-09-12T12:13:19.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 Processor -- start 2024-09-12T12:13:19.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.505+0000 7f194fe00640 1 -- start start 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 0x7f19501521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19500cff90 0x7f195015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f195015b160 0x7f1950072640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f19500b45a0 con 0x7f1950073bd0 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19500b4420 con 0x7f19500cff90 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f19500b4720 con 0x7f195015b160 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 0x7f19501521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 0x7f19501521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33014/0 (socket says 172.21.15.144:33014) 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194ea00640 1 -- 172.21.15.144:0/3062115272 learned_addr learned my addr 172.21.15.144:0/3062115272 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:19.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194ea00640 1 -- 172.21.15.144:0/3062115272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f195015b160 msgr2=0x7f1950072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:19.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194ea00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f195015b160 0x7f1950072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:19.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194ea00640 1 -- 172.21.15.144:0/3062115272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19500cff90 msgr2=0x7f195015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:19.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194ea00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19500cff90 0x7f195015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:19.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194ea00640 1 -- 172.21.15.144:0/3062115272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195015d610 con 0x7f1950073bd0 2024-09-12T12:13:19.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194ea00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 0x7f19501521d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f194000c480 tx=0x7f194000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:19.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f1946a00640 1 -- 172.21.15.144:0/3062115272 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940018070 con 0x7f1950073bd0 2024-09-12T12:13:19.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f1946a00640 1 -- 172.21.15.144:0/3062115272 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1940007500 con 0x7f1950073bd0 2024-09-12T12:13:19.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f1946a00640 1 -- 172.21.15.144:0/3062115272 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940004a30 con 0x7f1950073bd0 2024-09-12T12:13:19.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195015d8f0 con 0x7f1950073bd0 2024-09-12T12:13:19.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195015deb0 con 0x7f1950073bd0 2024-09-12T12:13:19.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.509+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1950070ee0 con 0x7f1950073bd0 2024-09-12T12:13:19.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.513+0000 7f1946a00640 1 -- 172.21.15.144:0/3062115272 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f194001b070 con 0x7f1950073bd0 2024-09-12T12:13:19.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.513+0000 7f1946a00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f192c0678c0 0x7f192c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:19.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.513+0000 7f1946a00640 1 -- 172.21.15.144:0/3062115272 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1940085350 con 0x7f1950073bd0 2024-09-12T12:13:19.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.513+0000 7f1947e00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f192c0678c0 0x7f192c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:19.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.513+0000 7f1947e00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f192c0678c0 0x7f192c069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f19380b1000 tx=0x7f1938004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:19.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.517+0000 7f1946a00640 1 -- 172.21.15.144:0/3062115272 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1940055b40 con 0x7f1950073bd0 2024-09-12T12:13:19.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f195004ffc0 con 0x7f1950073bd0 2024-09-12T12:13:19.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f1946a00640 1 -- 172.21.15.144:0/3062115272 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f1940055440 con 0x7f1950073bd0 2024-09-12T12:13:19.710 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T12:13:19.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f192c0678c0 msgr2=0x7f192c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:19.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f192c0678c0 0x7f192c069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f19380b1000 tx=0x7f1938004740 comp rx=0 tx=0).stop 2024-09-12T12:13:19.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 msgr2=0x7f19501521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:19.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 0x7f19501521d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f194000c480 tx=0x7f194000c940 comp rx=0 tx=0).stop 2024-09-12T12:13:19.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 shutdown_connections 2024-09-12T12:13:19.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f192c0678c0 0x7f192c069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:19.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f195015b160 0x7f1950072640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:19.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19500cff90 0x7f195015cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:19.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 --2- 172.21.15.144:0/3062115272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1950073bd0 0x7f19501521d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:19.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 >> 172.21.15.144:0/3062115272 conn(0x7f195006bc10 msgr2=0x7f1950156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:19.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 shutdown_connections 2024-09-12T12:13:19.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:19.709+0000 7f194fe00640 1 -- 172.21.15.144:0/3062115272 wait complete. 2024-09-12T12:13:19.730 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T12:13:19.730 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:13:19.730 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-12T12:13:19.731 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T12:13:19.731 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T12:13:19.731 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T12:13:19.731 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:13:19.731 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:13:19.731 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T12:13:19.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:19.731 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-12T12:13:19.741 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:13:19.741 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:13:19.741 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:13:19.741 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:13:19.742 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42392sec preferred_lft 42392sec 2024-09-12T12:13:19.743 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link 2024-09-12T12:13:19.743 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:19.743 INFO:teuthology.orchestra.run.smithi165.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:13:19.743 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 02:42:aa:65:72:b3 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:19.743 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:13:19.743 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:19.744 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T12:13:19.744 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:19.744 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-12T12:13:19.744 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add name ceph-brx type bridge 2024-09-12T12:13:19.744 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr flush dev ceph-brx 2024-09-12T12:13:19.744 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set ceph-brx up 2024-09-12T12:13:19.745 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T12:13:19.745 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-12T12:13:19.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:19.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:19.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:19.911 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:13:19.929 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-12T12:13:19.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:19.931 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-12T12:13:20.247 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:20.248 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:13:20.249 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:20.249 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-12T12:13:20.249 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:13:20.249 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:13:20.249 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:13:20.249 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-12T12:13:20.296 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:20.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:20.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:20.344 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-12T12:13:20.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:20.400 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list-id 2024-09-12T12:13:20.453 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:20.453 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-12T12:13:20.453 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T12:13:20.453 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-12T12:13:20.453 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-12T12:13:20.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:20.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:20.584 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-12T12:13:20.585 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:20.585 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-12T12:13:20.585 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-12T12:13:20.585 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T12:13:20.585 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-12T12:13:20.585 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-12T12:13:20.585 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-12T12:13:20.585 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-12T12:13:20.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:20.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:20.804 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:20.804 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-12T12:13:20.804 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-12T12:13:20.804 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T12:13:20.804 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-12T12:13:20.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:20.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:20.889 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:20.889 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T12:13:20.939 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T12:13:20.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:20.940 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T12:13:20.990 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T12:13:20.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:20.991 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:21.083 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:21.083 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:21.752 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:21.752 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:21.752 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:13:21.752 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:13:21.753 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:13:21.756 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:13:21.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:21.756 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T12:13:21.775 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:21.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:21.895 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:21.901 INFO:teuthology.orchestra.run.smithi165.stdout:client4701 2024-09-12T12:13:21.902 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:13:21.902 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:21.952 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:22.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:22.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:22.050 INFO:teuthology.orchestra.run.smithi165.stdout:client4701 2024-09-12T12:13:22.051 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:22.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:22.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:22.150 INFO:teuthology.orchestra.run.smithi165.stdout:client4701 2024-09-12T12:13:22.151 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/91f78d05-407b-4adf-ae67-409c5ce36eb9.client4701/status') 2024-09-12T12:13:22.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:22.210 INFO:teuthology.orchestra.run.smithi165.stdout:instance: client.4701 (3)172.21.15.165:0/109055716 2024-09-12T12:13:22.210 INFO:teuthology.orchestra.run.smithi165.stdout:blocklisted: false 2024-09-12T12:13:22.210 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records in 2024-09-12T12:13:22.210 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records out 2024-09-12T12:13:22.210 INFO:teuthology.orchestra.run.smithi165.stderr:70 bytes copied, 6.0543e-05 s, 1.2 MB/s 2024-09-12T12:13:22.211 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:22.218 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-12T12:13:22.218 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:13:22.218 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T12:13:22.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:13:22.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.357+0000 7fc726a00640 1 Processor -- start 2024-09-12T12:13:22.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.357+0000 7fc726a00640 1 -- start start 2024-09-12T12:13:22.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc726a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 0x7fc7200b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:22.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc726a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc7200b3ad0 0x7fc720071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:22.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc726a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7200b45a0 con 0x7fc720071960 2024-09-12T12:13:22.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc726a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc7200b3fe0 con 0x7fc7200b3ad0 2024-09-12T12:13:22.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc726a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7200b42c0 con 0x7fc72015b4e0 2024-09-12T12:13:22.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc724a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc720071960 0x7fc7200ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41924/0 (socket says 172.21.15.144:41924) 2024-09-12T12:13:22.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc724a00640 1 -- 172.21.15.144:0/3554238471 learned_addr learned my addr 172.21.15.144:0/3554238471 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:22.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc71f400640 1 --2- 172.21.15.144:0/3554238471 >> v2:172.21.15.165:3300/0 conn(0x7fc7200b3ad0 0x7fc720071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:22.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc71fe00640 1 --2- 172.21.15.144:0/3554238471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 0x7fc7200b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:22.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc71ea00640 1 -- 172.21.15.144:0/3554238471 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707278007 0 0) 0x7fc7200b45a0 con 0x7fc720071960 2024-09-12T12:13:22.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc71ea00640 1 -- 172.21.15.144:0/3554238471 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc704003530 con 0x7fc720071960 2024-09-12T12:13:22.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc71f400640 1 -- 172.21.15.144:0/3554238471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 msgr2=0x7fc7200b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:22.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc71f400640 1 --2- 172.21.15.144:0/3554238471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 0x7fc7200b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc71f400640 1 -- 172.21.15.144:0/3554238471 >> v1:172.21.15.144:6789/0 conn(0x7fc720071960 legacy=0x7fc7200ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:22.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.361+0000 7fc71f400640 1 -- 172.21.15.144:0/3554238471 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7200b1490 con 0x7fc7200b3ad0 2024-09-12T12:13:22.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc71f400640 1 --2- 172.21.15.144:0/3554238471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7200b3ad0 0x7fc720071420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0097c0 tx=0x7fc70c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d85c453242184685 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:22.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc71ea00640 1 -- 172.21.15.144:0/3554238471 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c0aa5f0 con 0x7fc7200b3ad0 2024-09-12T12:13:22.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc71ea00640 1 -- 172.21.15.144:0/3554238471 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c0af070 con 0x7fc7200b3ad0 2024-09-12T12:13:22.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc71ea00640 1 -- 172.21.15.144:0/3554238471 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c0aa9b0 con 0x7fc7200b3ad0 2024-09-12T12:13:22.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 -- 172.21.15.144:0/3554238471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7200b3ad0 msgr2=0x7fc720071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:22.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 --2- 172.21.15.144:0/3554238471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7200b3ad0 0x7fc720071420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0097c0 tx=0x7fc70c01c470 comp rx=0 tx=0).stop 2024-09-12T12:13:22.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 -- 172.21.15.144:0/3554238471 shutdown_connections 2024-09-12T12:13:22.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 --2- 172.21.15.144:0/3554238471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7200b3ad0 0x7fc720071420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 --2- 172.21.15.144:0/3554238471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 0x7fc7200b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 -- 172.21.15.144:0/3554238471 >> 172.21.15.144:0/3554238471 conn(0x7fc72006d0d0 msgr2=0x7fc72006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:22.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 -- 172.21.15.144:0/3554238471 shutdown_connections 2024-09-12T12:13:22.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 -- 172.21.15.144:0/3554238471 wait complete. 2024-09-12T12:13:22.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 Processor -- start 2024-09-12T12:13:22.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.365+0000 7fc726a00640 1 -- start start 2024-09-12T12:13:22.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc726a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc720071960 0x7fc7201505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:22.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc726a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7200b3ad0 0x7fc7201f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:22.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc726a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 0x7fc7201f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:22.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc726a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200b2620 con 0x7fc7200b3ad0 2024-09-12T12:13:22.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc726a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200b24a0 con 0x7fc720071960 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc726a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7200cd640 con 0x7fc72015b4e0 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7200b3ad0 0x7fc7201f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7200b3ad0 0x7fc7201f85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33030/0 (socket says 172.21.15.144:33030) 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71f400640 1 -- 172.21.15.144:0/2226048110 learned_addr learned my addr 172.21.15.144:0/2226048110 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71fe00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc720071960 0x7fc7201505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc724a00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 0x7fc7201f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71f400640 1 -- 172.21.15.144:0/2226048110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 msgr2=0x7fc7201f8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71f400640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 0x7fc7201f8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71f400640 1 -- 172.21.15.144:0/2226048110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc720071960 msgr2=0x7fc7201505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71f400640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc720071960 0x7fc7201505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71f400640 1 -- 172.21.15.144:0/2226048110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72014fc10 con 0x7fc7200b3ad0 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71fe00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc720071960 0x7fc7201505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:22.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc71f400640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7200b3ad0 0x7fc7201f85d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0ac040 tx=0x7fc70c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:22.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc717e00640 1 -- 172.21.15.144:0/2226048110 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c0be410 con 0x7fc7200b3ad0 2024-09-12T12:13:22.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc717e00640 1 -- 172.21.15.144:0/2226048110 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c0be5d0 con 0x7fc7200b3ad0 2024-09-12T12:13:22.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72014fef0 con 0x7fc7200b3ad0 2024-09-12T12:13:22.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc717e00640 1 -- 172.21.15.144:0/2226048110 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c0be9c0 con 0x7fc7200b3ad0 2024-09-12T12:13:22.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc720152c10 con 0x7fc7200b3ad0 2024-09-12T12:13:22.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc720071420 con 0x7fc7200b3ad0 2024-09-12T12:13:22.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.369+0000 7fc717e00640 1 -- 172.21.15.144:0/2226048110 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc70c0bc020 con 0x7fc7200b3ad0 2024-09-12T12:13:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.373+0000 7fc717e00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7000678c0 0x7fc700069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.373+0000 7fc717e00640 1 -- 172.21.15.144:0/2226048110 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc70c120730 con 0x7fc7200b3ad0 2024-09-12T12:13:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.373+0000 7fc71fe00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7000678c0 0x7fc700069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.373+0000 7fc71fe00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7000678c0 0x7fc700069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc720165e50 tx=0x7fc71000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:22.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.377+0000 7fc717e00640 1 -- 172.21.15.144:0/2226048110 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc70c016090 con 0x7fc7200b3ad0 2024-09-12T12:13:22.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.569+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc720072560 con 0x7fc7200b3ad0 2024-09-12T12:13:22.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.569+0000 7fc717e00640 1 -- 172.21.15.144:0/2226048110 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fc70c0f0e90 con 0x7fc7200b3ad0 2024-09-12T12:13:22.572 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7000678c0 msgr2=0x7fc700069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7000678c0 0x7fc700069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc720165e50 tx=0x7fc71000b040 comp rx=0 tx=0).stop 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7200b3ad0 msgr2=0x7fc7201f85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7200b3ad0 0x7fc7201f85d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0ac040 tx=0x7fc70c01acb0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 shutdown_connections 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7000678c0 0x7fc700069d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc72015b4e0 0x7fc7201f8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7200b3ad0 0x7fc7201f85d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 --2- 172.21.15.144:0/2226048110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc720071960 0x7fc7201505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 >> 172.21.15.144:0/2226048110 conn(0x7fc72006d0d0 msgr2=0x7fc7200cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:22.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 shutdown_connections 2024-09-12T12:13:22.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:22.573+0000 7fc726a00640 1 -- 172.21.15.144:0/2226048110 wait complete. 2024-09-12T12:13:22.593 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T12:13:22.593 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:13:22.593 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-12T12:13:22.593 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-12T12:13:22.593 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T12:13:22.593 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T12:13:22.593 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:13:22.593 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:13:22.593 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-12T12:13:22.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:22.593 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-12T12:13:22.604 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:22.604 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:13:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:13:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42389sec preferred_lft 42389sec 2024-09-12T12:13:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 02:42:aa:65:72:b3 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:13:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:22.606 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:13:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T12:13:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:13:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:22.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:22.607 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:13:22.674 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-12T12:13:22.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:22.675 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-12T12:13:22.728 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-12T12:13:22.728 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:13:22.729 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:13:22.729 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:13:22.729 INFO:teuthology.orchestra.run.smithi165.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:13:22.729 INFO:teuthology.orchestra.run.smithi165.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:13:22.729 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:13:22.729 INFO:teuthology.orchestra.run.smithi165.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:22.729 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:22.729 INFO:teuthology.orchestra.run.smithi165.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:22.729 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:13:22.729 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:22.730 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-12T12:13:22.730 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:13:22.730 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:13:22.730 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:13:22.730 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-12T12:13:22.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:22.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:22.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:22.869 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-12T12:13:22.878 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T12:13:22.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:22.879 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list-id 2024-09-12T12:13:22.931 INFO:teuthology.orchestra.run.smithi165.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-12T12:13:22.932 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:22.932 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-12T12:13:22.932 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T12:13:22.932 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-12T12:13:22.932 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-12T12:13:23.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:23.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:23.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:23.057 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T12:13:23.077 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:13:23.077 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:13:23.077 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:13:23.078 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:23.078 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-12T12:13:23.078 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:23.078 INFO:teuthology.orchestra.run.smithi165.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:13:23.078 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 12:df:1f:c7:fe:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T12:13:23.078 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T12:13:23.078 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:23.078 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::10df:1fff:fec7:fead/64 scope link 2024-09-12T12:13:23.078 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:23.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:23.079 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T12:13:23.143 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:13:23.143 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:13:23.143 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:13:23.143 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:23.143 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-12T12:13:23.143 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:23.143 INFO:teuthology.orchestra.run.smithi165.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:13:23.143 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 12:df:1f:c7:fe:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T12:13:23.144 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T12:13:23.144 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:23.144 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::10df:1fff:fec7:fead/64 scope link 2024-09-12T12:13:23.144 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:23.145 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-12T12:13:23.145 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:23.145 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-12T12:13:23.145 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-12T12:13:23.145 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T12:13:23.146 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-12T12:13:23.146 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-12T12:13:23.146 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-12T12:13:23.146 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-12T12:13:23.233 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:23.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:23.323 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:23.323 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-12T12:13:23.323 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.1 up 2024-09-12T12:13:23.324 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T12:13:23.324 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-12T12:13:23.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:23.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:23.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:23.406 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-12T12:13:23.415 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-12T12:13:23.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:23.415 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-12T12:13:23.467 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-12T12:13:23.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:23.468 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:23.560 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:23.560 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:23.573 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:23.573 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:23.573 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:13:23.573 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 3@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:13:23.573 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:13:23.577 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:13:23.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:23.578 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-12T12:13:23.597 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:23.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:23.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:23.695 INFO:teuthology.orchestra.run.smithi165.stdout:client4710 2024-09-12T12:13:23.696 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:13:23.696 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:23.705 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:23.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:23.800 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:23.806 INFO:teuthology.orchestra.run.smithi165.stdout:client4710 2024-09-12T12:13:23.806 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:23.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:23.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:23.903 INFO:teuthology.orchestra.run.smithi165.stdout:client4710 2024-09-12T12:13:23.904 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/91f78d05-407b-4adf-ae67-409c5ce36eb9.client4710/status') 2024-09-12T12:13:23.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:23.962 INFO:teuthology.orchestra.run.smithi165.stdout:instance: client.4710 (3)172.21.15.165:0/2475729349 2024-09-12T12:13:23.963 INFO:teuthology.orchestra.run.smithi165.stdout:blocklisted: false 2024-09-12T12:13:23.963 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records in 2024-09-12T12:13:23.964 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records out 2024-09-12T12:13:23.964 INFO:teuthology.orchestra.run.smithi165.stderr:71 bytes copied, 6.0756e-05 s, 1.2 MB/s 2024-09-12T12:13:23.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-12T12:13:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:23.973 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-12T12:13:24.073 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-09-12T12:13:24.073 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-12T12:13:24.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:24.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.217+0000 7f8b7fc00640 1 Processor -- start 2024-09-12T12:13:24.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.217+0000 7f8b7fc00640 1 -- start start 2024-09-12T12:13:24.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7fc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8b78147fa0 0x7f8b7806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b7806c150 0x7f8b780cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7fc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b7806c6b0 con 0x7f8b780cf750 2024-09-12T12:13:24.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7fc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8b78072a90 con 0x7f8b78147fa0 2024-09-12T12:13:24.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b78072ce0 con 0x7f8b7806c150 2024-09-12T12:13:24.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8b78147fa0 0x7f8b7806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8b78147fa0 0x7f8b7806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33044/0 (socket says 172.21.15.144:33044) 2024-09-12T12:13:24.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7d200640 1 -- 172.21.15.144:0/1529583623 learned_addr learned my addr 172.21.15.144:0/1529583623 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:24.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b77e00640 1 --2- 172.21.15.144:0/1529583623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b7806c150 0x7f8b780cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7d200640 1 -- 172.21.15.144:0/1529583623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b7806c150 msgr2=0x7f8b780cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:24.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7d200640 1 --2- 172.21.15.144:0/1529583623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b7806c150 0x7f8b780cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7d200640 1 -- 172.21.15.144:0/1529583623 >> v1:172.21.15.165:6789/0 conn(0x7f8b780cf750 legacy=0x7f8b781620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.221+0000 7f8b7d200640 1 -- 172.21.15.144:0/1529583623 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b78072fc0 con 0x7f8b78147fa0 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7d200640 1 --2- 172.21.15.144:0/1529583623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b78147fa0 0x7f8b7806bc10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009870 tx=0x7f8b6801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668e17bddb3a86b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b77400640 1 -- 172.21.15.144:0/1529583623 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680b0070 con 0x7f8b78147fa0 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b77400640 1 -- 172.21.15.144:0/1529583623 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b680ab600 con 0x7f8b78147fa0 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b77400640 1 -- 172.21.15.144:0/1529583623 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680ab9d0 con 0x7f8b78147fa0 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 -- 172.21.15.144:0/1529583623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b78147fa0 msgr2=0x7f8b7806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 --2- 172.21.15.144:0/1529583623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b78147fa0 0x7f8b7806bc10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009870 tx=0x7f8b6801c440 comp rx=0 tx=0).stop 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 -- 172.21.15.144:0/1529583623 shutdown_connections 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 --2- 172.21.15.144:0/1529583623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b7806c150 0x7f8b780cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 --2- 172.21.15.144:0/1529583623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b78147fa0 0x7f8b7806bc10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 -- 172.21.15.144:0/1529583623 >> 172.21.15.144:0/1529583623 conn(0x7f8b7806cd20 msgr2=0x7f8b7806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:24.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 -- 172.21.15.144:0/1529583623 shutdown_connections 2024-09-12T12:13:24.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 -- 172.21.15.144:0/1529583623 wait complete. 2024-09-12T12:13:24.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 Processor -- start 2024-09-12T12:13:24.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.225+0000 7f8b7fc00640 1 -- start start 2024-09-12T12:13:24.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b7806c150 0x7f8b7815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b780cf750 0x7f8b7815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b78147fa0 0x7f8b7815e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7815fa80 con 0x7f8b7806c150 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7816b450 con 0x7f8b780cf750 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7815c650 con 0x7f8b78147fa0 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b7806c150 0x7f8b7815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b7806c150 0x7f8b7815b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33048/0 (socket says 172.21.15.144:33048) 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7d200640 1 -- 172.21.15.144:0/3800939968 learned_addr learned my addr 172.21.15.144:0/3800939968 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b77e00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b780cf750 0x7f8b7815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7dc00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b78147fa0 0x7f8b7815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7d200640 1 -- 172.21.15.144:0/3800939968 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b78147fa0 msgr2=0x7f8b7815e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7d200640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b78147fa0 0x7f8b7815e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7d200640 1 -- 172.21.15.144:0/3800939968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b780cf750 msgr2=0x7f8b7815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7d200640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b780cf750 0x7f8b7815bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7d200640 1 -- 172.21.15.144:0/3800939968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7815c930 con 0x7f8b7806c150 2024-09-12T12:13:24.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7d200640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b7806c150 0x7f8b7815b600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8b680ae040 tx=0x7f8b6801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:24.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b74c00640 1 -- 172.21.15.144:0/3800939968 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680ba020 con 0x7f8b7806c150 2024-09-12T12:13:24.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b74c00640 1 -- 172.21.15.144:0/3800939968 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b680b6420 con 0x7f8b7806c150 2024-09-12T12:13:24.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b74c00640 1 -- 172.21.15.144:0/3800939968 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680b0040 con 0x7f8b7806c150 2024-09-12T12:13:24.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7815cc10 con 0x7f8b7806c150 2024-09-12T12:13:24.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b780cc3e0 con 0x7f8b7806c150 2024-09-12T12:13:24.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b780cf210 con 0x7f8b7806c150 2024-09-12T12:13:24.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.229+0000 7f8b74c00640 1 -- 172.21.15.144:0/3800939968 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b680bd020 con 0x7f8b7806c150 2024-09-12T12:13:24.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.233+0000 7f8b74c00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b580678c0 0x7f8b58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.233+0000 7f8b74c00640 1 -- 172.21.15.144:0/3800939968 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8b68120120 con 0x7f8b7806c150 2024-09-12T12:13:24.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.233+0000 7f8b77e00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b580678c0 0x7f8b58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.233+0000 7f8b77e00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b580678c0 0x7f8b58069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b780d0a60 tx=0x7f8b64009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:24.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.237+0000 7f8b74c00640 1 -- 172.21.15.144:0/3800939968 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8b680c4030 con 0x7f8b7806c150 2024-09-12T12:13:24.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.393+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b780b67d0 con 0x7f8b7806c150 2024-09-12T12:13:24.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b74c00640 1 -- 172.21.15.144:0/3800939968 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18622 (secure 0 0 0) 0x7f8b68016150 con 0x7f8b7806c150 2024-09-12T12:13:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:24.398 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:12:49.576257+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b580678c0 msgr2=0x7f8b58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b580678c0 0x7f8b58069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b780d0a60 tx=0x7f8b64009190 comp rx=0 tx=0).stop 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b7806c150 msgr2=0x7f8b7815b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b7806c150 0x7f8b7815b600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8b680ae040 tx=0x7f8b6801ac80 comp rx=0 tx=0).stop 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 shutdown_connections 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b580678c0 0x7f8b58069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b78147fa0 0x7f8b7815e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b780cf750 0x7f8b7815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 --2- 172.21.15.144:0/3800939968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b7806c150 0x7f8b7815b600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 >> 172.21.15.144:0/3800939968 conn(0x7f8b7806cd20 msgr2=0x7f8b780b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:24.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 shutdown_connections 2024-09-12T12:13:24.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.397+0000 7f8b7fc00640 1 -- 172.21.15.144:0/3800939968 wait complete. 2024-09-12T12:13:24.420 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T12:12:42.126753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T12:12:43.227823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T12:12:47.209031+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T12:13:24.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:13:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33e00640 1 Processor -- start 2024-09-12T12:13:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33e00640 1 -- start start 2024-09-12T12:13:24.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f34156750 0x7f0f3406fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f340d2890 0x7f0f34073280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3415cbf0 con 0x7f0f3406fff0 2024-09-12T12:13:24.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3415ced0 con 0x7f0f340d2890 2024-09-12T12:13:24.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3415d1b0 con 0x7f0f34156750 2024-09-12T12:13:24.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f340d2890 0x7f0f34073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f340d2890 0x7f0f34073280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33052/0 (socket says 172.21.15.144:33052) 2024-09-12T12:13:24.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33400640 1 -- 172.21.15.144:0/1985851537 learned_addr learned my addr 172.21.15.144:0/1985851537 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:24.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f32a00640 1 --2- 172.21.15.144:0/1985851537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f34156750 0x7f0f3406fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33400640 1 -- 172.21.15.144:0/1985851537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f34156750 msgr2=0x7f0f3406fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:24.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33400640 1 --2- 172.21.15.144:0/1985851537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f34156750 0x7f0f3406fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33400640 1 -- 172.21.15.144:0/1985851537 >> v1:172.21.15.165:6789/0 conn(0x7f0f3406fff0 legacy=0x7f0f340d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.561+0000 7f0f33400640 1 -- 172.21.15.144:0/1985851537 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3415d490 con 0x7f0f340d2890 2024-09-12T12:13:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f33400640 1 --2- 172.21.15.144:0/1985851537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f340d2890 0x7f0f34073280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009870 tx=0x7f0f2c01cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebeed023678e18e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f31600640 1 -- 172.21.15.144:0/1985851537 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0aa650 con 0x7f0f340d2890 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f31600640 1 -- 172.21.15.144:0/1985851537 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c0af070 con 0x7f0f340d2890 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f31600640 1 -- 172.21.15.144:0/1985851537 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0aaa10 con 0x7f0f340d2890 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f33e00640 1 -- 172.21.15.144:0/1985851537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f340d2890 msgr2=0x7f0f34073280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f33e00640 1 --2- 172.21.15.144:0/1985851537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f340d2890 0x7f0f34073280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009870 tx=0x7f0f2c01cf30 comp rx=0 tx=0).stop 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f33e00640 1 -- 172.21.15.144:0/1985851537 shutdown_connections 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f33e00640 1 --2- 172.21.15.144:0/1985851537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f340d2890 0x7f0f34073280 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f33e00640 1 --2- 172.21.15.144:0/1985851537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f34156750 0x7f0f3406fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f33e00640 1 -- 172.21.15.144:0/1985851537 >> 172.21.15.144:0/1985851537 conn(0x7f0f34067a00 msgr2=0x7f0f34067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f33e00640 1 -- 172.21.15.144:0/1985851537 shutdown_connections 2024-09-12T12:13:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.565+0000 7f0f33e00640 1 -- 172.21.15.144:0/1985851537 wait complete. 2024-09-12T12:13:24.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 Processor -- start 2024-09-12T12:13:24.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 -- start start 2024-09-12T12:13:24.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f3406fff0 0x7f0f34149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f340d2890 0x7f0f341482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f34156750 0x7f0f3415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f34156cb0 con 0x7f0f3406fff0 2024-09-12T12:13:24.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f34156b30 con 0x7f0f34156750 2024-09-12T12:13:24.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f34073fd0 con 0x7f0f340d2890 2024-09-12T12:13:24.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f3406fff0 0x7f0f34149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f3406fff0 0x7f0f34149f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33066/0 (socket says 172.21.15.144:33066) 2024-09-12T12:13:24.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32a00640 1 -- 172.21.15.144:0/385625748 learned_addr learned my addr 172.21.15.144:0/385625748 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:24.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32000640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f340d2890 0x7f0f341482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33400640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f34156750 0x7f0f3415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32a00640 1 -- 172.21.15.144:0/385625748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f340d2890 msgr2=0x7f0f341482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32a00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f340d2890 0x7f0f341482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32a00640 1 -- 172.21.15.144:0/385625748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f34156750 msgr2=0x7f0f3415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32a00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f34156750 0x7f0f3415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32a00640 1 -- 172.21.15.144:0/385625748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3414c3e0 con 0x7f0f3406fff0 2024-09-12T12:13:24.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f32a00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f3406fff0 0x7f0f34149f10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009d10 tx=0x7f0f2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:24.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f2aa00640 1 -- 172.21.15.144:0/385625748 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24018020 con 0x7f0f3406fff0 2024-09-12T12:13:24.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f2aa00640 1 -- 172.21.15.144:0/385625748 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f24014480 con 0x7f0f3406fff0 2024-09-12T12:13:24.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f2aa00640 1 -- 172.21.15.144:0/385625748 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24014830 con 0x7f0f3406fff0 2024-09-12T12:13:24.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3414c6c0 con 0x7f0f3406fff0 2024-09-12T12:13:24.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3414cc80 con 0x7f0f3406fff0 2024-09-12T12:13:24.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.569+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f34073280 con 0x7f0f3406fff0 2024-09-12T12:13:24.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.573+0000 7f0f2aa00640 1 -- 172.21.15.144:0/385625748 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f2401b020 con 0x7f0f3406fff0 2024-09-12T12:13:24.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.573+0000 7f0f2aa00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f140678c0 0x7f0f14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.573+0000 7f0f2aa00640 1 -- 172.21.15.144:0/385625748 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0f24086960 con 0x7f0f3406fff0 2024-09-12T12:13:24.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.573+0000 7f0f32000640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f140678c0 0x7f0f14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.573+0000 7f0f32000640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f140678c0 0x7f0f14069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f340b1bf0 tx=0x7f0f20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:24.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.577+0000 7f0f2aa00640 1 -- 172.21.15.144:0/385625748 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f24022070 con 0x7f0f3406fff0 2024-09-12T12:13:24.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.733+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0f340b1c60 con 0x7f0f3406fff0 2024-09-12T12:13:24.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.733+0000 7f0f2aa00640 1 -- 172.21.15.144:0/385625748 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f0f24010040 con 0x7f0f3406fff0 2024-09-12T12:13:24.737 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:13:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f140678c0 msgr2=0x7f0f14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f140678c0 0x7f0f14069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f340b1bf0 tx=0x7f0f20009040 comp rx=0 tx=0).stop 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f3406fff0 msgr2=0x7f0f34149f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f3406fff0 0x7f0f34149f10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009d10 tx=0x7f0f2400c490 comp rx=0 tx=0).stop 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 shutdown_connections 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f140678c0 0x7f0f14069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f34156750 0x7f0f3415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f340d2890 0x7f0f341482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 --2- 172.21.15.144:0/385625748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f3406fff0 0x7f0f34149f10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 >> 172.21.15.144:0/385625748 conn(0x7f0f34067a00 msgr2=0x7f0f3415db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 shutdown_connections 2024-09-12T12:13:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.737+0000 7f0f33e00640 1 -- 172.21.15.144:0/385625748 wait complete. 2024-09-12T12:13:24.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T12:13:24.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.897+0000 7f4fa9e00640 1 Processor -- start 2024-09-12T12:13:24.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.897+0000 7f4fa9e00640 1 -- start start 2024-09-12T12:13:24.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4fa415af60 0x7f4fa40ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa9e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa40b4300 con 0x7f4fa40cd9f0 2024-09-12T12:13:24.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa9e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa40b3540 con 0x7f4fa406c320 2024-09-12T12:13:24.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa9e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4fa40b32f0 con 0x7f4fa415af60 2024-09-12T12:13:24.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4f9be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4fa40cd9f0 0x7f4fa406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41932/0 (socket says 172.21.15.144:41932) 2024-09-12T12:13:24.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4f9be00640 1 -- 172.21.15.144:0/2117395285 learned_addr learned my addr 172.21.15.144:0/2117395285 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:24.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa2a00640 1 --2- 172.21.15.144:0/2117395285 >> v2:172.21.15.165:3300/0 conn(0x7f4fa415af60 0x7f4fa40ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa2000640 1 -- 172.21.15.144:0/2117395285 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477005852 0 0) 0x7f4fa40b4300 con 0x7f4fa40cd9f0 2024-09-12T12:13:24.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa2000640 1 -- 172.21.15.144:0/2117395285 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f88003530 con 0x7f4fa40cd9f0 2024-09-12T12:13:24.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa2000640 1 -- 172.21.15.144:0/2117395285 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 146673781 0 0) 0x7f4fa40b3540 con 0x7f4fa406c320 2024-09-12T12:13:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa2000640 1 -- 172.21.15.144:0/2117395285 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa40b4300 con 0x7f4fa406c320 2024-09-12T12:13:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa2a00640 1 -- 172.21.15.144:0/2117395285 >> v1:172.21.15.165:6789/0 conn(0x7f4fa406c320 legacy=0x7f4fa40b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa2a00640 1 -- 172.21.15.144:0/2117395285 >> v1:172.21.15.144:6789/0 conn(0x7f4fa40cd9f0 legacy=0x7f4fa406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.901+0000 7f4fa2a00640 1 -- 172.21.15.144:0/2117395285 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa40b3820 con 0x7f4fa415af60 2024-09-12T12:13:24.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa2a00640 1 --2- 172.21.15.144:0/2117395285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fa415af60 0x7f4fa40ce680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f940097c0 tx=0x7f4f9401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51816425c5a7bf30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:24.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa2000640 1 -- 172.21.15.144:0/2117395285 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f940b1070 con 0x7f4fa415af60 2024-09-12T12:13:24.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa2000640 1 -- 172.21.15.144:0/2117395285 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f940ac5f0 con 0x7f4fa415af60 2024-09-12T12:13:24.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa2000640 1 -- 172.21.15.144:0/2117395285 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f940ac9a0 con 0x7f4fa415af60 2024-09-12T12:13:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa9e00640 1 -- 172.21.15.144:0/2117395285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fa415af60 msgr2=0x7f4fa40ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa9e00640 1 --2- 172.21.15.144:0/2117395285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fa415af60 0x7f4fa40ce680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4f940097c0 tx=0x7f4f9401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa9e00640 1 -- 172.21.15.144:0/2117395285 shutdown_connections 2024-09-12T12:13:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa9e00640 1 --2- 172.21.15.144:0/2117395285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fa415af60 0x7f4fa40ce680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa9e00640 1 -- 172.21.15.144:0/2117395285 >> 172.21.15.144:0/2117395285 conn(0x7f4fa4068030 msgr2=0x7f4fa40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa9e00640 1 -- 172.21.15.144:0/2117395285 shutdown_connections 2024-09-12T12:13:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa9e00640 1 -- 172.21.15.144:0/2117395285 wait complete. 2024-09-12T12:13:24.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa9e00640 1 Processor -- start 2024-09-12T12:13:24.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.905+0000 7f4fa9e00640 1 -- start start 2024-09-12T12:13:24.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fa406c320 0x7f4fa4071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa9e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fa40cd9f0 0x7f4fa4159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa415af60 0x7f4fa4147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa9e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa4169090 con 0x7f4fa415af60 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa9e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa4168f10 con 0x7f4fa40cd9f0 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa9e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa4169210 con 0x7f4fa406c320 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa415af60 0x7f4fa4147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa415af60 0x7f4fa4147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33070/0 (socket says 172.21.15.144:33070) 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa3400640 1 -- 172.21.15.144:0/4205191101 learned_addr learned my addr 172.21.15.144:0/4205191101 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4f9be00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fa40cd9f0 0x7f4fa4159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa2a00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fa406c320 0x7f4fa4071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa3400640 1 -- 172.21.15.144:0/4205191101 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fa406c320 msgr2=0x7f4fa4071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa3400640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fa406c320 0x7f4fa4071a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa3400640 1 -- 172.21.15.144:0/4205191101 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fa40cd9f0 msgr2=0x7f4fa4159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa3400640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fa40cd9f0 0x7f4fa4159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa3400640 1 -- 172.21.15.144:0/4205191101 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa4072bb0 con 0x7f4fa415af60 2024-09-12T12:13:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa3400640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa415af60 0x7f4fa4147280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c790 tx=0x7f4f9c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4f9b400640 1 -- 172.21.15.144:0/4205191101 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c003b80 con 0x7f4fa415af60 2024-09-12T12:13:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4f9b400640 1 -- 172.21.15.144:0/4205191101 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f9c003d20 con 0x7f4fa415af60 2024-09-12T12:13:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4f9b400640 1 -- 172.21.15.144:0/4205191101 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00aa50 con 0x7f4fa415af60 2024-09-12T12:13:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa4147fb0 con 0x7f4fa415af60 2024-09-12T12:13:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa41f7810 con 0x7f4fa415af60 2024-09-12T12:13:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.909+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa40ce680 con 0x7f4fa415af60 2024-09-12T12:13:24.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.913+0000 7f4f9b400640 1 -- 172.21.15.144:0/4205191101 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f9c00abf0 con 0x7f4fa415af60 2024-09-12T12:13:24.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.913+0000 7f4f9b400640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f800678c0 0x7f4f80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:24.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.913+0000 7f4f9b400640 1 -- 172.21.15.144:0/4205191101 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4f9c085e70 con 0x7f4fa415af60 2024-09-12T12:13:24.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.913+0000 7f4fa2a00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f800678c0 0x7f4f80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:24.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.913+0000 7f4fa2a00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f800678c0 0x7f4f80069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f940ae000 tx=0x7f4f940a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:24.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:24.917+0000 7f4f9b400640 1 -- 172.21.15.144:0/4205191101 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f9c056010 con 0x7f4fa415af60 2024-09-12T12:13:25.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.073+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4fa40b0100 con 0x7f4fa415af60 2024-09-12T12:13:25.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.073+0000 7f4f9b400640 1 -- 172.21.15.144:0/4205191101 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f4f9c05a310 con 0x7f4fa415af60 2024-09-12T12:13:25.076 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2024-09-12T12:13:25.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f800678c0 msgr2=0x7f4f80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f800678c0 0x7f4f80069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f940ae000 tx=0x7f4f940a7000 comp rx=0 tx=0).stop 2024-09-12T12:13:25.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa415af60 msgr2=0x7f4fa4147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa415af60 0x7f4fa4147280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c790 tx=0x7f4f9c00cc50 comp rx=0 tx=0).stop 2024-09-12T12:13:25.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 shutdown_connections 2024-09-12T12:13:25.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f800678c0 0x7f4f80069d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fa415af60 0x7f4fa4147280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fa40cd9f0 0x7f4fa4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 --2- 172.21.15.144:0/4205191101 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fa406c320 0x7f4fa4071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 >> 172.21.15.144:0/4205191101 conn(0x7f4fa4068030 msgr2=0x7f4fa406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:25.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 shutdown_connections 2024-09-12T12:13:25.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.077+0000 7f4fa9e00640 1 -- 172.21.15.144:0/4205191101 wait complete. 2024-09-12T12:13:25.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T12:13:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe1c400640 1 Processor -- start 2024-09-12T12:13:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe1c400640 1 -- start start 2024-09-12T12:13:25.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe1c400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbe1415af60 0x7fbe140ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe1c400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe140b4300 con 0x7fbe1406c320 2024-09-12T12:13:25.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe1c400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe140b3540 con 0x7fbe140cd9f0 2024-09-12T12:13:25.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe1c400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbe140b32f0 con 0x7fbe1415af60 2024-09-12T12:13:25.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe1a400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbe1406c320 0x7fbe140b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41944/0 (socket says 172.21.15.144:41944) 2024-09-12T12:13:25.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe1a400640 1 -- 172.21.15.144:0/836931016 learned_addr learned my addr 172.21.15.144:0/836931016 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:25.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe19a00640 1 --2- 172.21.15.144:0/836931016 >> v2:172.21.15.165:3300/0 conn(0x7fbe1415af60 0x7fbe140ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe13e00640 1 -- 172.21.15.144:0/836931016 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033217105 0 0) 0x7fbe140b3540 con 0x7fbe140cd9f0 2024-09-12T12:13:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe13e00640 1 -- 172.21.15.144:0/836931016 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdfc005740 con 0x7fbe140cd9f0 2024-09-12T12:13:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe13e00640 1 -- 172.21.15.144:0/836931016 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4139128196 0 0) 0x7fbe140b4300 con 0x7fbe1406c320 2024-09-12T12:13:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe13e00640 1 -- 172.21.15.144:0/836931016 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe140b3540 con 0x7fbe1406c320 2024-09-12T12:13:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe19a00640 1 -- 172.21.15.144:0/836931016 >> v1:172.21.15.165:6789/0 conn(0x7fbe140cd9f0 legacy=0x7fbe1406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe19a00640 1 -- 172.21.15.144:0/836931016 >> v1:172.21.15.144:6789/0 conn(0x7fbe1406c320 legacy=0x7fbe140b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.237+0000 7fbe19a00640 1 -- 172.21.15.144:0/836931016 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe140b3820 con 0x7fbe1415af60 2024-09-12T12:13:25.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe19a00640 1 --2- 172.21.15.144:0/836931016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1415af60 0x7fbe140ce680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe080097c0 tx=0x7fbe0801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a142aef0bcce559f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe13e00640 1 -- 172.21.15.144:0/836931016 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe080b1070 con 0x7fbe1415af60 2024-09-12T12:13:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe13e00640 1 -- 172.21.15.144:0/836931016 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe080ac5f0 con 0x7fbe1415af60 2024-09-12T12:13:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe13e00640 1 -- 172.21.15.144:0/836931016 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe080ac9c0 con 0x7fbe1415af60 2024-09-12T12:13:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe1c400640 1 -- 172.21.15.144:0/836931016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1415af60 msgr2=0x7fbe140ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe1c400640 1 --2- 172.21.15.144:0/836931016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1415af60 0x7fbe140ce680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe080097c0 tx=0x7fbe0801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe1c400640 1 -- 172.21.15.144:0/836931016 shutdown_connections 2024-09-12T12:13:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe1c400640 1 --2- 172.21.15.144:0/836931016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1415af60 0x7fbe140ce680 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe1c400640 1 -- 172.21.15.144:0/836931016 >> 172.21.15.144:0/836931016 conn(0x7fbe14068030 msgr2=0x7fbe140b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe1c400640 1 -- 172.21.15.144:0/836931016 shutdown_connections 2024-09-12T12:13:25.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe1c400640 1 -- 172.21.15.144:0/836931016 wait complete. 2024-09-12T12:13:25.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.241+0000 7fbe1c400640 1 Processor -- start 2024-09-12T12:13:25.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 -- start start 2024-09-12T12:13:25.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1406c320 0x7fbe14147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe140cd9f0 0x7fbe141f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1415af60 0x7fbe1415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1406d270 con 0x7fbe1415af60 2024-09-12T12:13:25.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1406d0f0 con 0x7fbe1406c320 2024-09-12T12:13:25.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe1406d3f0 con 0x7fbe140cd9f0 2024-09-12T12:13:25.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1415af60 0x7fbe1415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe19a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1406c320 0x7fbe14147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1415af60 0x7fbe1415ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33082/0 (socket says 172.21.15.144:33082) 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe19a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1406c320 0x7fbe14147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44068/0 (socket says 172.21.15.144:44068) 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe19000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe140cd9f0 0x7fbe141f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1a400640 1 -- 172.21.15.144:0/3196499061 learned_addr learned my addr 172.21.15.144:0/3196499061 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1a400640 1 -- 172.21.15.144:0/3196499061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe140cd9f0 msgr2=0x7fbe141f8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1a400640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe140cd9f0 0x7fbe141f8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1a400640 1 -- 172.21.15.144:0/3196499061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1406c320 msgr2=0x7fbe14147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1a400640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1406c320 0x7fbe14147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1a400640 1 -- 172.21.15.144:0/3196499061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe14070fb0 con 0x7fbe1415af60 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1a400640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1415af60 0x7fbe1415ddd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00cbc0 tx=0x7fbe0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe11600640 1 -- 172.21.15.144:0/3196499061 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c017070 con 0x7fbe1415af60 2024-09-12T12:13:25.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe11600640 1 -- 172.21.15.144:0/3196499061 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe0c00ad40 con 0x7fbe1415af60 2024-09-12T12:13:25.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe14071270 con 0x7fbe1415af60 2024-09-12T12:13:25.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe11600640 1 -- 172.21.15.144:0/3196499061 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c012640 con 0x7fbe1415af60 2024-09-12T12:13:25.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe14071830 con 0x7fbe1415af60 2024-09-12T12:13:25.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.245+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe140ce680 con 0x7fbe1415af60 2024-09-12T12:13:25.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.249+0000 7fbe11600640 1 -- 172.21.15.144:0/3196499061 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbe0c01a070 con 0x7fbe1415af60 2024-09-12T12:13:25.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.249+0000 7fbe11600640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdf40678c0 0x7fbdf4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.249+0000 7fbe11600640 1 -- 172.21.15.144:0/3196499061 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbe0c085dd0 con 0x7fbe1415af60 2024-09-12T12:13:25.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.249+0000 7fbe19a00640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdf40678c0 0x7fbdf4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.249+0000 7fbe19a00640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdf40678c0 0x7fbdf4069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe080ae000 tx=0x7fbe08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:25.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.253+0000 7fbe11600640 1 -- 172.21.15.144:0/3196499061 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbe0c055ef0 con 0x7fbe1415af60 2024-09-12T12:13:25.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbe1415ee50 con 0x7fbe1415af60 2024-09-12T12:13:25.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe11600640 1 -- 172.21.15.144:0/3196499061 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fbe0c05a1f0 con 0x7fbe1415af60 2024-09-12T12:13:25.414 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdf40678c0 msgr2=0x7fbdf4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdf40678c0 0x7fbdf4069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe080ae000 tx=0x7fbe08008040 comp rx=0 tx=0).stop 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1415af60 msgr2=0x7fbe1415ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1415af60 0x7fbe1415ddd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00cbc0 tx=0x7fbe0c00a430 comp rx=0 tx=0).stop 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 shutdown_connections 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdf40678c0 0x7fbdf4069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1415af60 0x7fbe1415ddd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe140cd9f0 0x7fbe141f8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 --2- 172.21.15.144:0/3196499061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe1406c320 0x7fbe14147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 >> 172.21.15.144:0/3196499061 conn(0x7fbe14068030 msgr2=0x7fbe140b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:25.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 shutdown_connections 2024-09-12T12:13:25.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.413+0000 7fbe1c400640 1 -- 172.21.15.144:0/3196499061 wait complete. 2024-09-12T12:13:25.436 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T12:13:25.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.581+0000 7f7a53000640 1 Processor -- start 2024-09-12T12:13:25.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.581+0000 7f7a53000640 1 -- start start 2024-09-12T12:13:25.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.581+0000 7f7a53000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 0x7f7a4c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.581+0000 7f7a53000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4c0b4300 con 0x7f7a4c0cd9f0 2024-09-12T12:13:25.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.581+0000 7f7a53000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4c0b3540 con 0x7f7a4c06c320 2024-09-12T12:13:25.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.581+0000 7f7a53000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4c0b32f0 con 0x7f7a4c15af60 2024-09-12T12:13:25.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.581+0000 7f7a4b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7a4c0cd9f0 0x7f7a4c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41956/0 (socket says 172.21.15.144:41956) 2024-09-12T12:13:25.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4b400640 1 -- 172.21.15.144:0/2313428263 learned_addr learned my addr 172.21.15.144:0/2313428263 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:25.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4be00640 1 --2- 172.21.15.144:0/2313428263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 0x7f7a4c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4aa00640 1 -- 172.21.15.144:0/2313428263 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005716742 0 0) 0x7f7a4c0b3540 con 0x7f7a4c06c320 2024-09-12T12:13:25.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4aa00640 1 -- 172.21.15.144:0/2313428263 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a30003530 con 0x7f7a4c06c320 2024-09-12T12:13:25.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4aa00640 1 -- 172.21.15.144:0/2313428263 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745829444 0 0) 0x7f7a4c0b4300 con 0x7f7a4c0cd9f0 2024-09-12T12:13:25.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4be00640 1 -- 172.21.15.144:0/2313428263 >> v1:172.21.15.165:6789/0 conn(0x7f7a4c06c320 legacy=0x7f7a4c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4be00640 1 -- 172.21.15.144:0/2313428263 >> v1:172.21.15.144:6789/0 conn(0x7f7a4c0cd9f0 legacy=0x7f7a4c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4be00640 1 -- 172.21.15.144:0/2313428263 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c0b3820 con 0x7f7a4c15af60 2024-09-12T12:13:25.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4be00640 1 --2- 172.21.15.144:0/2313428263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 0x7f7a4c0ce680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009dc0 tx=0x7f7a3c01f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=558ff5be665ee2ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:25.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.585+0000 7f7a4aa00640 1 -- 172.21.15.144:0/2313428263 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0b4070 con 0x7f7a4c15af60 2024-09-12T12:13:25.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a4aa00640 1 -- 172.21.15.144:0/2313428263 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0af600 con 0x7f7a4c15af60 2024-09-12T12:13:25.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a4aa00640 1 -- 172.21.15.144:0/2313428263 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0af9b0 con 0x7f7a4c15af60 2024-09-12T12:13:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 -- 172.21.15.144:0/2313428263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 msgr2=0x7f7a4c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 --2- 172.21.15.144:0/2313428263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 0x7f7a4c0ce680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009dc0 tx=0x7f7a3c01f170 comp rx=0 tx=0).stop 2024-09-12T12:13:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 -- 172.21.15.144:0/2313428263 shutdown_connections 2024-09-12T12:13:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 --2- 172.21.15.144:0/2313428263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 0x7f7a4c0ce680 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 -- 172.21.15.144:0/2313428263 >> 172.21.15.144:0/2313428263 conn(0x7f7a4c068030 msgr2=0x7f7a4c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 -- 172.21.15.144:0/2313428263 shutdown_connections 2024-09-12T12:13:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 -- 172.21.15.144:0/2313428263 wait complete. 2024-09-12T12:13:25.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 Processor -- start 2024-09-12T12:13:25.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 -- start start 2024-09-12T12:13:25.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4c06c320 0x7f7a4c06d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a4c0cd9f0 0x7f7a4c15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 0x7f7a4c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c0cebc0 con 0x7f7a4c06c320 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c0b3de0 con 0x7f7a4c0cd9f0 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a53000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4c0ced40 con 0x7f7a4c15af60 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a4be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4c06c320 0x7f7a4c06d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a4be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4c06c320 0x7f7a4c06d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33084/0 (socket says 172.21.15.144:33084) 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a4be00640 1 -- 172.21.15.144:0/3359112779 learned_addr learned my addr 172.21.15.144:0/3359112779 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a4b400640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a4c0cd9f0 0x7f7a4c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.589+0000 7f7a51000640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 0x7f7a4c154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a4be00640 1 -- 172.21.15.144:0/3359112779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 msgr2=0x7f7a4c154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a4be00640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 0x7f7a4c154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a4be00640 1 -- 172.21.15.144:0/3359112779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a4c0cd9f0 msgr2=0x7f7a4c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a4be00640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a4c0cd9f0 0x7f7a4c15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a4be00640 1 -- 172.21.15.144:0/3359112779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c15c970 con 0x7f7a4c06c320 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a4b400640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a4c0cd9f0 0x7f7a4c15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a4be00640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4c06c320 0x7f7a4c06d5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c01bd80 tx=0x7f7a3c01bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a43e00640 1 -- 172.21.15.144:0/3359112779 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0b4070 con 0x7f7a4c06c320 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a43e00640 1 -- 172.21.15.144:0/3359112779 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3c0c1070 con 0x7f7a4c06c320 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a43e00640 1 -- 172.21.15.144:0/3359112779 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0afbc0 con 0x7f7a4c06c320 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c15cf00 con 0x7f7a4c06c320 2024-09-12T12:13:25.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4c1f3e70 con 0x7f7a4c06c320 2024-09-12T12:13:25.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4c1f4100 con 0x7f7a4c06c320 2024-09-12T12:13:25.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a43e00640 1 -- 172.21.15.144:0/3359112779 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a3c004040 con 0x7f7a4c06c320 2024-09-12T12:13:25.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a43e00640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a2c0678c0 0x7f7a2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a43e00640 1 -- 172.21.15.144:0/3359112779 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7a3c124ae0 con 0x7f7a4c06c320 2024-09-12T12:13:25.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.593+0000 7f7a4b400640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a2c0678c0 0x7f7a2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.597+0000 7f7a4b400640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a2c0678c0 0x7f7a2c069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a38007b20 tx=0x7f7a38007cf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:25.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.597+0000 7f7a43e00640 1 -- 172.21.15.144:0/3359112779 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a4c1f4100 con 0x7f7a4c06c320 2024-09-12T12:13:25.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.757+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7a4c15b340 con 0x7f7a4c06c320 2024-09-12T12:13:25.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.757+0000 7f7a43e00640 1 -- 172.21.15.144:0/3359112779 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f7a3c018cd0 con 0x7f7a4c06c320 2024-09-12T12:13:25.760 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a2c0678c0 msgr2=0x7f7a2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a2c0678c0 0x7f7a2c069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a38007b20 tx=0x7f7a38007cf0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4c06c320 msgr2=0x7f7a4c06d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4c06c320 0x7f7a4c06d5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c01bd80 tx=0x7f7a3c01bf10 comp rx=0 tx=0).stop 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 shutdown_connections 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a2c0678c0 0x7f7a2c069d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a4c15af60 0x7f7a4c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a4c0cd9f0 0x7f7a4c15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 --2- 172.21.15.144:0/3359112779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a4c06c320 0x7f7a4c06d5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 >> 172.21.15.144:0/3359112779 conn(0x7f7a4c068030 msgr2=0x7f7a4c15e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:25.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 shutdown_connections 2024-09-12T12:13:25.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.761+0000 7f7a53000640 1 -- 172.21.15.144:0/3359112779 wait complete. 2024-09-12T12:13:25.781 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-12T12:13:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.913+0000 7f467ae00640 1 Processor -- start 2024-09-12T12:13:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.913+0000 7f467ae00640 1 -- start start 2024-09-12T12:13:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f467ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467415ad50 0x7f467415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f467ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46740b3590 0x7f46740b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f467ae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46740b3aa0 con 0x7f46740b4810 2024-09-12T12:13:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f467ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f467415f860 con 0x7f46740b3590 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f467ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46740cdeb0 con 0x7f467415ad50 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f466be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46740b3590 0x7f46740b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f466be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46740b3590 0x7f46740b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33092/0 (socket says 172.21.15.144:33092) 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f4678e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f46740b4810 0x7f46740b2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41970/0 (socket says 172.21.15.144:41970) 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f466be00640 1 -- 172.21.15.144:0/3342816904 learned_addr learned my addr 172.21.15.144:0/3342816904 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f4673e00640 1 --2- 172.21.15.144:0/3342816904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467415ad50 0x7f467415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f466be00640 1 -- 172.21.15.144:0/3342816904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467415ad50 msgr2=0x7f467415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f466be00640 1 --2- 172.21.15.144:0/3342816904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467415ad50 0x7f467415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f466be00640 1 -- 172.21.15.144:0/3342816904 >> v1:172.21.15.144:6789/0 conn(0x7f46740b4810 legacy=0x7f46740b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.917+0000 7f466be00640 1 -- 172.21.15.144:0/3342816904 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46740afc10 con 0x7f46740b3590 2024-09-12T12:13:25.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f466be00640 1 --2- 172.21.15.144:0/3342816904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46740b3590 0x7f46740b42d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f465c00bb10 tx=0x7f465c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94107b163bc27b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:25.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f4673400640 1 -- 172.21.15.144:0/3342816904 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c0b4070 con 0x7f46740b3590 2024-09-12T12:13:25.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f4673400640 1 -- 172.21.15.144:0/3342816904 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465c0a7a80 con 0x7f46740b3590 2024-09-12T12:13:25.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f4673400640 1 -- 172.21.15.144:0/3342816904 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c0a7e50 con 0x7f46740b3590 2024-09-12T12:13:25.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 -- 172.21.15.144:0/3342816904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46740b3590 msgr2=0x7f46740b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 --2- 172.21.15.144:0/3342816904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46740b3590 0x7f46740b42d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f465c00bb10 tx=0x7f465c01ec30 comp rx=0 tx=0).stop 2024-09-12T12:13:25.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 -- 172.21.15.144:0/3342816904 shutdown_connections 2024-09-12T12:13:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 --2- 172.21.15.144:0/3342816904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46740b3590 0x7f46740b42d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 --2- 172.21.15.144:0/3342816904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467415ad50 0x7f467415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 -- 172.21.15.144:0/3342816904 >> 172.21.15.144:0/3342816904 conn(0x7f467406d0d0 msgr2=0x7f467406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 -- 172.21.15.144:0/3342816904 shutdown_connections 2024-09-12T12:13:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 -- 172.21.15.144:0/3342816904 wait complete. 2024-09-12T12:13:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 Processor -- start 2024-09-12T12:13:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.921+0000 7f467ae00640 1 -- start start 2024-09-12T12:13:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f467ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46740b3590 0x7f4674073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f467ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46740b4810 0x7f46741f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f467ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467415ad50 0x7f467415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f467ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f46740b2bc0 con 0x7f467415ad50 2024-09-12T12:13:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f467ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f46740b2a40 con 0x7f46740b4810 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f467ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46740b2d40 con 0x7f46740b3590 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4678e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467415ad50 0x7f467415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f466be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46740b4810 0x7f46741f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4673e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46740b3590 0x7f4674073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4678e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467415ad50 0x7f467415b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33096/0 (socket says 172.21.15.144:33096) 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f466be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46740b4810 0x7f46741f6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44086/0 (socket says 172.21.15.144:44086) 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4678e00640 1 -- 172.21.15.144:0/1018476154 learned_addr learned my addr 172.21.15.144:0/1018476154 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4673e00640 1 -- 172.21.15.144:0/1018476154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46740b4810 msgr2=0x7f46741f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4673e00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46740b4810 0x7f46741f6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4673e00640 1 -- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467415ad50 msgr2=0x7f467415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:25.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4673e00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467415ad50 0x7f467415b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:25.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4673e00640 1 -- 172.21.15.144:0/1018476154 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46741f84e0 con 0x7f46740b3590 2024-09-12T12:13:25.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4678e00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467415ad50 0x7f467415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:25.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4673e00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46740b3590 0x7f4674073ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f466400e870 tx=0x7f466400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:25.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4670c00640 1 -- 172.21.15.144:0/1018476154 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664017070 con 0x7f46740b3590 2024-09-12T12:13:25.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4670c00640 1 -- 172.21.15.144:0/1018476154 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466400ee60 con 0x7f46740b3590 2024-09-12T12:13:25.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467415d110 con 0x7f46740b3590 2024-09-12T12:13:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f4670c00640 1 -- 172.21.15.144:0/1018476154 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466400cb60 con 0x7f46740b3590 2024-09-12T12:13:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f467415d6d0 con 0x7f46740b3590 2024-09-12T12:13:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.925+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46740b42d0 con 0x7f46740b3590 2024-09-12T12:13:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.929+0000 7f4670c00640 1 -- 172.21.15.144:0/1018476154 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f466401a070 con 0x7f46740b3590 2024-09-12T12:13:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.929+0000 7f4670c00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46500678c0 0x7f4650069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.929+0000 7f4670c00640 1 -- 172.21.15.144:0/1018476154 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f46640864c0 con 0x7f46740b3590 2024-09-12T12:13:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.929+0000 7f466be00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46500678c0 0x7f4650069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.929+0000 7f466be00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46500678c0 0x7f4650069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f465c0b1000 tx=0x7f465c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:25.933+0000 7f4670c00640 1 -- 172.21.15.144:0/1018476154 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4664056720 con 0x7f46740b3590 2024-09-12T12:13:26.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.141+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f467415b5f0 con 0x7f46740b3590 2024-09-12T12:13:26.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f4670c00640 1 -- 172.21.15.144:0/1018476154 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v58) ==== 151+0+0 (secure 0 0 0) 0x7f466405aa20 con 0x7f46740b3590 2024-09-12T12:13:26.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46500678c0 msgr2=0x7f4650069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46500678c0 0x7f4650069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f465c0b1000 tx=0x7f465c008040 comp rx=0 tx=0).stop 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46740b3590 msgr2=0x7f4674073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46740b3590 0x7f4674073ac0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f466400e870 tx=0x7f466400ed30 comp rx=0 tx=0).stop 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 shutdown_connections 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46500678c0 0x7f4650069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467415ad50 0x7f467415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46740b4810 0x7f46741f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 --2- 172.21.15.144:0/1018476154 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46740b3590 0x7f4674073ac0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 >> 172.21.15.144:0/1018476154 conn(0x7f467406d0d0 msgr2=0x7f46740ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 shutdown_connections 2024-09-12T12:13:26.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.473+0000 7f467ae00640 1 -- 172.21.15.144:0/1018476154 wait complete. 2024-09-12T12:13:26.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:13:26.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe83ac00640 1 Processor -- start 2024-09-12T12:13:26.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe83ac00640 1 -- start start 2024-09-12T12:13:26.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe83ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:26.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe83ac00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe83415b340 0x7fe83406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:26.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe83ac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8340b4300 con 0x7fe83415af60 2024-09-12T12:13:26.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe83ac00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe8340b32f0 con 0x7fe83415b340 2024-09-12T12:13:26.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe83ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8340b3540 con 0x7fe8340cd9f0 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe838c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe83415b340 0x7fe83406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe82be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe833e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fe83415af60 0x7fe8340ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:39910/0 (socket says 172.21.15.144:39910) 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe82be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:56432/0 (socket says 172.21.15.144:56432) 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe838c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe83415b340 0x7fe83406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44088/0 (socket says 172.21.15.144:44088) 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe833e00640 1 -- 172.21.15.144:0/1159181005 learned_addr learned my addr 172.21.15.144:0/1159181005 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe82be00640 1 -- 172.21.15.144:0/1159181005 >> v2:172.21.15.165:3300/0 conn(0x7fe83415b340 msgr2=0x7fe83406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe82be00640 1 --2- 172.21.15.144:0/1159181005 >> v2:172.21.15.165:3300/0 conn(0x7fe83415b340 0x7fe83406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe82be00640 1 -- 172.21.15.144:0/1159181005 >> v1:172.21.15.165:6789/0 conn(0x7fe83415af60 legacy=0x7fe8340ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.637+0000 7fe82be00640 1 -- 172.21.15.144:0/1159181005 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8340b3820 con 0x7fe8340cd9f0 2024-09-12T12:13:26.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe82be00640 1 --2- 172.21.15.144:0/1159181005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83406bc10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0097c0 tx=0x7fe81c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51ae08a12aba3beb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:26.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe833400640 1 -- 172.21.15.144:0/1159181005 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0b5070 con 0x7fe8340cd9f0 2024-09-12T12:13:26.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe833400640 1 -- 172.21.15.144:0/1159181005 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c0a8990 con 0x7fe8340cd9f0 2024-09-12T12:13:26.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe833400640 1 -- 172.21.15.144:0/1159181005 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0a8d60 con 0x7fe8340cd9f0 2024-09-12T12:13:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe83ac00640 1 -- 172.21.15.144:0/1159181005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 msgr2=0x7fe83406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe83ac00640 1 --2- 172.21.15.144:0/1159181005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83406bc10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0097c0 tx=0x7fe81c01ec90 comp rx=0 tx=0).stop 2024-09-12T12:13:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe83ac00640 1 -- 172.21.15.144:0/1159181005 shutdown_connections 2024-09-12T12:13:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe83ac00640 1 --2- 172.21.15.144:0/1159181005 >> v2:172.21.15.165:3300/0 conn(0x7fe83415b340 0x7fe83406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe83ac00640 1 --2- 172.21.15.144:0/1159181005 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83406bc10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe83ac00640 1 -- 172.21.15.144:0/1159181005 >> 172.21.15.144:0/1159181005 conn(0x7fe834068030 msgr2=0x7fe8340b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe83ac00640 1 -- 172.21.15.144:0/1159181005 shutdown_connections 2024-09-12T12:13:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.641+0000 7fe83ac00640 1 -- 172.21.15.144:0/1159181005 wait complete. 2024-09-12T12:13:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 Processor -- start 2024-09-12T12:13:26.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 -- start start 2024-09-12T12:13:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83414b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe83415af60 0x7fe83415c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe83415b340 0x7fe83415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8340b4560 con 0x7fe83415af60 2024-09-12T12:13:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8340b3de0 con 0x7fe83415b340 2024-09-12T12:13:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8340b46e0 con 0x7fe8340cd9f0 2024-09-12T12:13:26.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe82be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe83415af60 0x7fe83415c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe82be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe83415af60 0x7fe83415c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33110/0 (socket says 172.21.15.144:33110) 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe82be00640 1 -- 172.21.15.144:0/3170008348 learned_addr learned my addr 172.21.15.144:0/3170008348 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe833e00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83414b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe838c00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe83415b340 0x7fe83415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe82be00640 1 -- 172.21.15.144:0/3170008348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 msgr2=0x7fe83414b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe82be00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83414b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe82be00640 1 -- 172.21.15.144:0/3170008348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe83415b340 msgr2=0x7fe83415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe82be00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe83415b340 0x7fe83415c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe82be00640 1 -- 172.21.15.144:0/3170008348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83414b780 con 0x7fe83415af60 2024-09-12T12:13:26.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe838c00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe83415b340 0x7fe83415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe82be00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe83415af60 0x7fe83415c2b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0b3040 tx=0x7fe81c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe830c00640 1 -- 172.21.15.144:0/3170008348 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0bf070 con 0x7fe83415af60 2024-09-12T12:13:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe830c00640 1 -- 172.21.15.144:0/3170008348 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c0b07a0 con 0x7fe83415af60 2024-09-12T12:13:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe830c00640 1 -- 172.21.15.144:0/3170008348 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0b5040 con 0x7fe83415af60 2024-09-12T12:13:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe83415d140 con 0x7fe83415af60 2024-09-12T12:13:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.645+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe83415d700 con 0x7fe83415af60 2024-09-12T12:13:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.649+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8340ce680 con 0x7fe83415af60 2024-09-12T12:13:26.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.649+0000 7fe830c00640 1 -- 172.21.15.144:0/3170008348 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe81c0b0b90 con 0x7fe83415af60 2024-09-12T12:13:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.649+0000 7fe830c00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe8100678c0 0x7fe810069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.649+0000 7fe830c00640 1 -- 172.21.15.144:0/3170008348 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe81c122a10 con 0x7fe83415af60 2024-09-12T12:13:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.649+0000 7fe833e00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe8100678c0 0x7fe810069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.649+0000 7fe833e00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe8100678c0 0x7fe810069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe824000f70 tx=0x7fe824009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:26.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.653+0000 7fe830c00640 1 -- 172.21.15.144:0/3170008348 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe81c0187f0 con 0x7fe83415af60 2024-09-12T12:13:26.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.813+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe834157120 con 0x7fe83415af60 2024-09-12T12:13:26.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe830c00640 1 -- 172.21.15.144:0/3170008348 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fe81c0f3140 con 0x7fe83415af60 2024-09-12T12:13:26.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe8100678c0 msgr2=0x7fe810069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:26.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe8100678c0 0x7fe810069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe824000f70 tx=0x7fe824009040 comp rx=0 tx=0).stop 2024-09-12T12:13:26.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe83415af60 msgr2=0x7fe83415c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:26.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe83415af60 0x7fe83415c2b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0b3040 tx=0x7fe81c01ba30 comp rx=0 tx=0).stop 2024-09-12T12:13:26.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 shutdown_connections 2024-09-12T12:13:26.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe8100678c0 0x7fe810069d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe83415b340 0x7fe83415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe83415af60 0x7fe83415c2b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 --2- 172.21.15.144:0/3170008348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8340cd9f0 0x7fe83414b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:26.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 >> 172.21.15.144:0/3170008348 conn(0x7fe834068030 msgr2=0x7fe8340aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:26.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 shutdown_connections 2024-09-12T12:13:26.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:26.817+0000 7fe83ac00640 1 -- 172.21.15.144:0/3170008348 wait complete. 2024-09-12T12:13:26.839 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:13:26.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:13:26.939 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:13:27.026 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:13:27.027 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:27.027 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:27.035 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:27.036 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:27.085 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:27.085 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:27.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:13:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e45c00640 1 Processor -- start 2024-09-12T12:13:27.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e45c00640 1 -- start start 2024-09-12T12:13:27.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e45c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7e4015c7b0 0x7f7e400ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e45c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e400cd870 con 0x7f7e400b5fb0 2024-09-12T12:13:27.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e45c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e400cdb50 con 0x7f7e4015cd30 2024-09-12T12:13:27.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e45c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7e40072a50 con 0x7f7e4015c7b0 2024-09-12T12:13:27.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e3ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7e4015c7b0 0x7f7e400ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e3f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7e400b5fb0 0x7f7e40072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39470/0 (socket says 172.21.15.144:39470) 2024-09-12T12:13:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e3f400640 1 -- 172.21.15.144:0/1949405663 learned_addr learned my addr 172.21.15.144:0/1949405663 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e3ea00640 1 -- 172.21.15.144:0/1949405663 >> v1:172.21.15.165:6789/0 conn(0x7f7e4015cd30 legacy=0x7f7e400b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e3ea00640 1 -- 172.21.15.144:0/1949405663 >> v1:172.21.15.144:6789/0 conn(0x7f7e400b5fb0 legacy=0x7f7e40072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e3ea00640 1 -- 172.21.15.144:0/1949405663 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e400726e0 con 0x7f7e4015c7b0 2024-09-12T12:13:27.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.321+0000 7f7e3e000640 1 -- 172.21.15.144:0/1949405663 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132904544 0 0) 0x7f7e400cd870 con 0x7f7e400b5fb0 2024-09-12T12:13:27.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e3ea00640 1 --2- 172.21.15.144:0/1949405663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015c7b0 0x7f7e400ccf00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7e300097c0 tx=0x7f7e3001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e989bf5a7ec06159 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:27.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e3e000640 1 -- 172.21.15.144:0/1949405663 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e300b0070 con 0x7f7e4015c7b0 2024-09-12T12:13:27.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e3e000640 1 -- 172.21.15.144:0/1949405663 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e300ab600 con 0x7f7e4015c7b0 2024-09-12T12:13:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e3e000640 1 -- 172.21.15.144:0/1949405663 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e300ab9d0 con 0x7f7e4015c7b0 2024-09-12T12:13:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e45c00640 1 -- 172.21.15.144:0/1949405663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015c7b0 msgr2=0x7f7e400ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e45c00640 1 --2- 172.21.15.144:0/1949405663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015c7b0 0x7f7e400ccf00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7e300097c0 tx=0x7f7e3001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e45c00640 1 -- 172.21.15.144:0/1949405663 shutdown_connections 2024-09-12T12:13:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e45c00640 1 --2- 172.21.15.144:0/1949405663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015c7b0 0x7f7e400ccf00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e45c00640 1 -- 172.21.15.144:0/1949405663 >> 172.21.15.144:0/1949405663 conn(0x7f7e4006d0d0 msgr2=0x7f7e4006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e45c00640 1 -- 172.21.15.144:0/1949405663 shutdown_connections 2024-09-12T12:13:27.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.325+0000 7f7e45c00640 1 -- 172.21.15.144:0/1949405663 wait complete. 2024-09-12T12:13:27.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 Processor -- start 2024-09-12T12:13:27.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 -- start start 2024-09-12T12:13:27.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e400b5fb0 0x7f7e401566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4015c7b0 0x7f7e400aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015cd30 0x7f7e401575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e400741d0 con 0x7f7e4015cd30 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40074050 con 0x7f7e400b5fb0 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7e400cde30 con 0x7f7e4015c7b0 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015cd30 0x7f7e401575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015cd30 0x7f7e401575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57104/0 (socket says 172.21.15.144:57104) 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3f400640 1 -- 172.21.15.144:0/1125032632 learned_addr learned my addr 172.21.15.144:0/1125032632 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3ea00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e400b5fb0 0x7f7e401566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e37e00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4015c7b0 0x7f7e400aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3f400640 1 -- 172.21.15.144:0/1125032632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4015c7b0 msgr2=0x7f7e400aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3f400640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4015c7b0 0x7f7e400aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3f400640 1 -- 172.21.15.144:0/1125032632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e400b5fb0 msgr2=0x7f7e401566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3f400640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e400b5fb0 0x7f7e401566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3f400640 1 -- 172.21.15.144:0/1125032632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e401558e0 con 0x7f7e4015cd30 2024-09-12T12:13:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e3f400640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015cd30 0x7f7e401575c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c7a0 tx=0x7f7e3800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e36a00640 1 -- 172.21.15.144:0/1125032632 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38018070 con 0x7f7e4015cd30 2024-09-12T12:13:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e36a00640 1 -- 172.21.15.144:0/1125032632 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3800a640 con 0x7f7e4015cd30 2024-09-12T12:13:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e36a00640 1 -- 172.21.15.144:0/1125032632 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800aa70 con 0x7f7e4015cd30 2024-09-12T12:13:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e40155bc0 con 0x7f7e4015cd30 2024-09-12T12:13:27.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.329+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e401524e0 con 0x7f7e4015cd30 2024-09-12T12:13:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.333+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e400ccf00 con 0x7f7e4015cd30 2024-09-12T12:13:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.333+0000 7f7e36a00640 1 -- 172.21.15.144:0/1125032632 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e3800ac10 con 0x7f7e4015cd30 2024-09-12T12:13:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.333+0000 7f7e36a00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e1c0678c0 0x7f7e1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.333+0000 7f7e36a00640 1 -- 172.21.15.144:0/1125032632 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7e38085730 con 0x7f7e4015cd30 2024-09-12T12:13:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.333+0000 7f7e3ea00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e1c0678c0 0x7f7e1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.333+0000 7f7e3ea00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e1c0678c0 0x7f7e1c069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e300ad000 tx=0x7f7e300a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:27.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.337+0000 7f7e36a00640 1 -- 172.21.15.144:0/1125032632 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7e38055e60 con 0x7f7e4015cd30 2024-09-12T12:13:27.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7e4015e9c0 con 0x7f7e4015cd30 2024-09-12T12:13:27.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e36a00640 1 -- 172.21.15.144:0/1125032632 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f7e38055760 con 0x7f7e4015cd30 2024-09-12T12:13:27.511 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:13:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e1c0678c0 msgr2=0x7f7e1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e1c0678c0 0x7f7e1c069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e300ad000 tx=0x7f7e300a6000 comp rx=0 tx=0).stop 2024-09-12T12:13:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015cd30 msgr2=0x7f7e401575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015cd30 0x7f7e401575c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c7a0 tx=0x7f7e3800cc60 comp rx=0 tx=0).stop 2024-09-12T12:13:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 shutdown_connections 2024-09-12T12:13:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e1c0678c0 0x7f7e1c069d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4015cd30 0x7f7e401575c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4015c7b0 0x7f7e400aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 --2- 172.21.15.144:0/1125032632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e400b5fb0 0x7f7e401566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.509+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 >> 172.21.15.144:0/1125032632 conn(0x7f7e4006d0d0 msgr2=0x7f7e400b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.513+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 shutdown_connections 2024-09-12T12:13:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.513+0000 7f7e45c00640 1 -- 172.21.15.144:0/1125032632 wait complete. 2024-09-12T12:13:27.531 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:13:27.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:27.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T12:13:27.567 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:13:27.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:27.568 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:13:27.621 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:13:27.621 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:27.633 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:13:27.633 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:27.689 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:13:27.689 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:27.740 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:13:27.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1ef000640 1 Processor -- start 2024-09-12T12:13:27.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1ef000640 1 -- start start 2024-09-12T12:13:27.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1ef000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1e815b0f0 0x7fb1e815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1ef000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e80b6660 con 0x7fb1e815f9d0 2024-09-12T12:13:27.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1ef000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e80b6940 con 0x7fb1e80b6130 2024-09-12T12:13:27.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1ef000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e80b6c20 con 0x7fb1e815b0f0 2024-09-12T12:13:27.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1e7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1e815b0f0 0x7fb1e815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1e7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1e815b0f0 0x7fb1e815ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57118/0 (socket says 172.21.15.144:57118) 2024-09-12T12:13:27.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1e7e00640 1 -- 172.21.15.144:0/3183745808 learned_addr learned my addr 172.21.15.144:0/3183745808 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:27.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1ed000640 1 --1- 172.21.15.144:0/3183745808 >> v1:172.21.15.144:6789/0 conn(0x7fb1e815f9d0 0x7fb1e80cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39484/0 (socket says 172.21.15.144:39484) 2024-09-12T12:13:27.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1e7e00640 1 -- 172.21.15.144:0/3183745808 >> v1:172.21.15.165:6789/0 conn(0x7fb1e80b6130 legacy=0x7fb1e815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:27.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1e7e00640 1 -- 172.21.15.144:0/3183745808 >> v1:172.21.15.144:6789/0 conn(0x7fb1e815f9d0 legacy=0x7fb1e80cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1e7e00640 1 -- 172.21.15.144:0/3183745808 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e80b6f00 con 0x7fb1e815b0f0 2024-09-12T12:13:27.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.877+0000 7fb1e6a00640 1 -- 172.21.15.144:0/3183745808 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213157143 0 0) 0x7fb1e80b6660 con 0x7fb1e815f9d0 2024-09-12T12:13:27.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1e7e00640 1 --2- 172.21.15.144:0/3183745808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815b0f0 0x7fb1e815ed80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009e50 tx=0x7fb1d801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c940c7fb53129e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:27.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1e6a00640 1 -- 172.21.15.144:0/3183745808 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a58c0 con 0x7fb1e815b0f0 2024-09-12T12:13:27.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1e6a00640 1 -- 172.21.15.144:0/3183745808 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d80a5a60 con 0x7fb1e815b0f0 2024-09-12T12:13:27.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1e6a00640 1 -- 172.21.15.144:0/3183745808 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a5e30 con 0x7fb1e815b0f0 2024-09-12T12:13:27.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1ef000640 1 -- 172.21.15.144:0/3183745808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815b0f0 msgr2=0x7fb1e815ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1ef000640 1 --2- 172.21.15.144:0/3183745808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815b0f0 0x7fb1e815ed80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009e50 tx=0x7fb1d801ca30 comp rx=0 tx=0).stop 2024-09-12T12:13:27.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1ef000640 1 -- 172.21.15.144:0/3183745808 shutdown_connections 2024-09-12T12:13:27.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1ef000640 1 --2- 172.21.15.144:0/3183745808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815b0f0 0x7fb1e815ed80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1ef000640 1 -- 172.21.15.144:0/3183745808 >> 172.21.15.144:0/3183745808 conn(0x7fb1e806f8b0 msgr2=0x7fb1e806fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:27.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1ef000640 1 -- 172.21.15.144:0/3183745808 shutdown_connections 2024-09-12T12:13:27.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.881+0000 7fb1ef000640 1 -- 172.21.15.144:0/3183745808 wait complete. 2024-09-12T12:13:27.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 Processor -- start 2024-09-12T12:13:27.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 -- start start 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e80b6130 0x7fb1e814df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e815b0f0 0x7fb1e814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815f9d0 0x7fb1e815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80d0950 con 0x7fb1e815f9d0 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80d07d0 con 0x7fb1e80b6130 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e80d0ad0 con 0x7fb1e815b0f0 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ed000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815f9d0 0x7fb1e815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ed000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815f9d0 0x7fb1e815e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57128/0 (socket says 172.21.15.144:57128) 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ed000640 1 -- 172.21.15.144:0/3713574435 learned_addr learned my addr 172.21.15.144:0/3713574435 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1e7e00640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e80b6130 0x7fb1e814df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1e7400640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e815b0f0 0x7fb1e814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ed000640 1 -- 172.21.15.144:0/3713574435 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e815b0f0 msgr2=0x7fb1e814ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ed000640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e815b0f0 0x7fb1e814ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ed000640 1 -- 172.21.15.144:0/3713574435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e80b6130 msgr2=0x7fb1e814df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:27.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ed000640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e80b6130 0x7fb1e814df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:27.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ed000640 1 -- 172.21.15.144:0/3713574435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e814d0f0 con 0x7fb1e815f9d0 2024-09-12T12:13:27.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ed000640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815f9d0 0x7fb1e815e1e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c410 tx=0x7fb1e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:27.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1dfe00640 1 -- 172.21.15.144:0/3713574435 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00074e0 con 0x7fb1e815f9d0 2024-09-12T12:13:27.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1dfe00640 1 -- 172.21.15.144:0/3713574435 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e00047f0 con 0x7fb1e815f9d0 2024-09-12T12:13:27.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1dfe00640 1 -- 172.21.15.144:0/3713574435 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0007680 con 0x7fb1e815f9d0 2024-09-12T12:13:27.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e814d3d0 con 0x7fb1e815f9d0 2024-09-12T12:13:27.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e814d990 con 0x7fb1e815f9d0 2024-09-12T12:13:27.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.885+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e80cf890 con 0x7fb1e815f9d0 2024-09-12T12:13:27.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.889+0000 7fb1dfe00640 1 -- 172.21.15.144:0/3713574435 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1e0011070 con 0x7fb1e815f9d0 2024-09-12T12:13:27.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.889+0000 7fb1dfe00640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c80678f0 0x7fb1c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:27.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.889+0000 7fb1dfe00640 1 -- 172.21.15.144:0/3713574435 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb1e0085cc0 con 0x7fb1e815f9d0 2024-09-12T12:13:27.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.889+0000 7fb1e7e00640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c80678f0 0x7fb1c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:27.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.889+0000 7fb1e7e00640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c80678f0 0x7fb1c8069db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80ae000 tx=0x7fb1d80a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:27.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:27.893+0000 7fb1dfe00640 1 -- 172.21.15.144:0/3713574435 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb1e008c080 con 0x7fb1e815f9d0 2024-09-12T12:13:28.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.061+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1e8072a10 con 0x7fb1e815f9d0 2024-09-12T12:13:28.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.061+0000 7fb1dfe00640 1 -- 172.21.15.144:0/3713574435 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fb1e0056360 con 0x7fb1e815f9d0 2024-09-12T12:13:28.063 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:13:28.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c80678f0 msgr2=0x7fb1c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:28.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c80678f0 0x7fb1c8069db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80ae000 tx=0x7fb1d80a7070 comp rx=0 tx=0).stop 2024-09-12T12:13:28.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815f9d0 msgr2=0x7fb1e815e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:28.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815f9d0 0x7fb1e815e1e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c410 tx=0x7fb1e000c8d0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 shutdown_connections 2024-09-12T12:13:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c80678f0 0x7fb1c8069db0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e815f9d0 0x7fb1e815e1e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e815b0f0 0x7fb1e814ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 --2- 172.21.15.144:0/3713574435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e80b6130 0x7fb1e814df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 >> 172.21.15.144:0/3713574435 conn(0x7fb1e806f8b0 msgr2=0x7fb1e806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 shutdown_connections 2024-09-12T12:13:28.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.065+0000 7fb1ef000640 1 -- 172.21.15.144:0/3713574435 wait complete. 2024-09-12T12:13:28.086 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T12:13:28.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:28.087 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-12T12:13:28.126 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:13:28.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:28.127 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T12:13:28.179 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:28.179 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:28.187 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:28.188 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:28.236 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:28.236 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:28.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:13:28.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.461+0000 7f21d8a00640 1 Processor -- start 2024-09-12T12:13:28.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.461+0000 7f21d8a00640 1 -- start start 2024-09-12T12:13:28.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d415b0f0 0x7f21d415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:28.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d8a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f21d40b6130 0x7f21d415f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:28.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d8a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d40b6660 con 0x7f21d415f800 2024-09-12T12:13:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d8a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f21d415fcb0 con 0x7f21d40b6130 2024-09-12T12:13:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d8a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21d40b6940 con 0x7f21d415b0f0 2024-09-12T12:13:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d1400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f21d40b6130 0x7f21d415f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f21d415f800 0x7f21d415b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39486/0 (socket says 172.21.15.144:39486) 2024-09-12T12:13:28.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d2800640 1 -- 172.21.15.144:0/433303343 learned_addr learned my addr 172.21.15.144:0/433303343 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:28.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d1e00640 1 --2- 172.21.15.144:0/433303343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d415b0f0 0x7f21d415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:28.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d1400640 1 -- 172.21.15.144:0/433303343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d415b0f0 msgr2=0x7f21d415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:28.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d1400640 1 --2- 172.21.15.144:0/433303343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d415b0f0 0x7f21d415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d1400640 1 -- 172.21.15.144:0/433303343 >> v1:172.21.15.144:6789/0 conn(0x7f21d415f800 legacy=0x7f21d415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:28.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d1400640 1 -- 172.21.15.144:0/433303343 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d40b6c20 con 0x7f21d40b6130 2024-09-12T12:13:28.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.465+0000 7f21d0a00640 1 -- 172.21.15.144:0/433303343 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284460685 0 0) 0x7f21d40b6660 con 0x7f21d415f800 2024-09-12T12:13:28.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d1400640 1 --2- 172.21.15.144:0/433303343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d40b6130 0x7f21d415f2c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21c00097c0 tx=0x7f21c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e771964e07949f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:28.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d0a00640 1 -- 172.21.15.144:0/433303343 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00aa5f0 con 0x7f21d40b6130 2024-09-12T12:13:28.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d0a00640 1 -- 172.21.15.144:0/433303343 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c00af070 con 0x7f21d40b6130 2024-09-12T12:13:28.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d0a00640 1 -- 172.21.15.144:0/433303343 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00aa9b0 con 0x7f21d40b6130 2024-09-12T12:13:28.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 -- 172.21.15.144:0/433303343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d40b6130 msgr2=0x7f21d415f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:28.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 --2- 172.21.15.144:0/433303343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d40b6130 0x7f21d415f2c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f21c00097c0 tx=0x7f21c001c470 comp rx=0 tx=0).stop 2024-09-12T12:13:28.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 -- 172.21.15.144:0/433303343 shutdown_connections 2024-09-12T12:13:28.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 --2- 172.21.15.144:0/433303343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d40b6130 0x7f21d415f2c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 --2- 172.21.15.144:0/433303343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d415b0f0 0x7f21d415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 -- 172.21.15.144:0/433303343 >> 172.21.15.144:0/433303343 conn(0x7f21d406f8b0 msgr2=0x7f21d406fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:28.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 -- 172.21.15.144:0/433303343 shutdown_connections 2024-09-12T12:13:28.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 -- 172.21.15.144:0/433303343 wait complete. 2024-09-12T12:13:28.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 Processor -- start 2024-09-12T12:13:28.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.469+0000 7f21d8a00640 1 -- start start 2024-09-12T12:13:28.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d40b6130 0x7f21d41656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:28.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d415b0f0 0x7f21d40b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d8a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21d415f800 0x7f21d4159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d8a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21d415c570 con 0x7f21d415b0f0 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d8a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21d415c3f0 con 0x7f21d415f800 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d8a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21d4167ed0 con 0x7f21d40b6130 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d415b0f0 0x7f21d40b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d415b0f0 0x7f21d40b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57142/0 (socket says 172.21.15.144:57142) 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1400640 1 -- 172.21.15.144:0/682198403 learned_addr learned my addr 172.21.15.144:0/682198403 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1e00640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d40b6130 0x7f21d41656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d2800640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21d415f800 0x7f21d4159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1400640 1 -- 172.21.15.144:0/682198403 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d40b6130 msgr2=0x7f21d41656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1400640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d40b6130 0x7f21d41656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1400640 1 -- 172.21.15.144:0/682198403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21d415f800 msgr2=0x7f21d4159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:28.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1400640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21d415f800 0x7f21d4159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1400640 1 -- 172.21.15.144:0/682198403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d41524e0 con 0x7f21d415b0f0 2024-09-12T12:13:28.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d1400640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d415b0f0 0x7f21d40b2160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21c00ac040 tx=0x7f21c001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:28.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21ca000640 1 -- 172.21.15.144:0/682198403 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00be610 con 0x7f21d415b0f0 2024-09-12T12:13:28.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21ca000640 1 -- 172.21.15.144:0/682198403 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c00be7d0 con 0x7f21d415b0f0 2024-09-12T12:13:28.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21ca000640 1 -- 172.21.15.144:0/682198403 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00bebc0 con 0x7f21d415b0f0 2024-09-12T12:13:28.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d40b2a40 con 0x7f21d415b0f0 2024-09-12T12:13:28.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d40b3280 con 0x7f21d415b0f0 2024-09-12T12:13:28.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d415b4d0 con 0x7f21d415b0f0 2024-09-12T12:13:28.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.473+0000 7f21ca000640 1 -- 172.21.15.144:0/682198403 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21c00bc020 con 0x7f21d415b0f0 2024-09-12T12:13:28.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.477+0000 7f21ca000640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21b40678c0 0x7f21b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:28.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.477+0000 7f21ca000640 1 -- 172.21.15.144:0/682198403 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f21c0120980 con 0x7f21d415b0f0 2024-09-12T12:13:28.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.477+0000 7f21d1e00640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21b40678c0 0x7f21b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:28.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.477+0000 7f21d1e00640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21b40678c0 0x7f21b4069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21d41fa440 tx=0x7f21c40098d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:28.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.481+0000 7f21ca000640 1 -- 172.21.15.144:0/682198403 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f21d40b2a40 con 0x7f21d415b0f0 2024-09-12T12:13:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f21d40b4950 con 0x7f21d415b0f0 2024-09-12T12:13:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21ca000640 1 -- 172.21.15.144:0/682198403 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f21c0016090 con 0x7f21d415b0f0 2024-09-12T12:13:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:13:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21b40678c0 msgr2=0x7f21b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21b40678c0 0x7f21b4069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f21d41fa440 tx=0x7f21c40098d0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d415b0f0 msgr2=0x7f21d40b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d415b0f0 0x7f21d40b2160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21c00ac040 tx=0x7f21c001acb0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 shutdown_connections 2024-09-12T12:13:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21b40678c0 0x7f21b4069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21d415f800 0x7f21d4159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21d415b0f0 0x7f21d40b2160 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 --2- 172.21.15.144:0/682198403 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21d40b6130 0x7f21d41656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 >> 172.21.15.144:0/682198403 conn(0x7f21d406f8b0 msgr2=0x7f21d4075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 shutdown_connections 2024-09-12T12:13:28.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.649+0000 7f21d8a00640 1 -- 172.21.15.144:0/682198403 wait complete. 2024-09-12T12:13:28.671 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-12T12:13:28.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:28.671 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-12T12:13:28.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:13:28.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:28.695 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T12:13:28.745 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:13:28.745 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:28.755 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:13:28.755 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:28.804 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:13:28.804 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:28.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:13:28.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.993+0000 7f0009000640 1 Processor -- start 2024-09-12T12:13:28.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.993+0000 7f0009000640 1 -- start start 2024-09-12T12:13:28.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0009000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f000415c7b0 0x7f00040ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:28.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0009000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00040b5fb0 0x7f0004072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:28.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0009000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00040cd870 con 0x7f000415cd30 2024-09-12T12:13:28.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0009000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0004072a50 con 0x7f000415c7b0 2024-09-12T12:13:28.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0009000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f00040cde30 con 0x7f00040b5fb0 2024-09-12T12:13:28.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0001400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f000415cd30 0x7f00040b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39500/0 (socket says 172.21.15.144:39500) 2024-09-12T12:13:28.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0001400640 1 -- 172.21.15.144:0/186926014 learned_addr learned my addr 172.21.15.144:0/186926014 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:28.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0002800640 1 --2- 172.21.15.144:0/186926014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00040b5fb0 0x7f0004072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:28.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0001e00640 1 --2- 172.21.15.144:0/186926014 >> v2:172.21.15.165:3300/0 conn(0x7f000415c7b0 0x7f00040ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:28.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0000a00640 1 -- 172.21.15.144:0/186926014 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1944570019 0 0) 0x7f00040cd870 con 0x7f000415cd30 2024-09-12T12:13:28.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0000a00640 1 -- 172.21.15.144:0/186926014 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effe8003530 con 0x7f000415cd30 2024-09-12T12:13:28.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0002800640 1 -- 172.21.15.144:0/186926014 >> v2:172.21.15.165:3300/0 conn(0x7f000415c7b0 msgr2=0x7f00040ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:28.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0002800640 1 --2- 172.21.15.144:0/186926014 >> v2:172.21.15.165:3300/0 conn(0x7f000415c7b0 0x7f00040ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:28.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0002800640 1 -- 172.21.15.144:0/186926014 >> v1:172.21.15.144:6789/0 conn(0x7f000415cd30 legacy=0x7f00040b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:28.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0002800640 1 -- 172.21.15.144:0/186926014 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00040cdb50 con 0x7f00040b5fb0 2024-09-12T12:13:28.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:28.997+0000 7f0001e00640 1 --2- 172.21.15.144:0/186926014 >> v2:172.21.15.165:3300/0 conn(0x7f000415c7b0 0x7f00040ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:29.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0002800640 1 --2- 172.21.15.144:0/186926014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00040b5fb0 0x7f0004072ee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efffc009d90 tx=0x7efffc01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b32968ccfa9bf739 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0000a00640 1 -- 172.21.15.144:0/186926014 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc0b2070 con 0x7f00040b5fb0 2024-09-12T12:13:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0000a00640 1 -- 172.21.15.144:0/186926014 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efffc0a5940 con 0x7f00040b5fb0 2024-09-12T12:13:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0000a00640 1 -- 172.21.15.144:0/186926014 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc0a5d10 con 0x7f00040b5fb0 2024-09-12T12:13:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 -- 172.21.15.144:0/186926014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00040b5fb0 msgr2=0x7f0004072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 --2- 172.21.15.144:0/186926014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00040b5fb0 0x7f0004072ee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efffc009d90 tx=0x7efffc01c970 comp rx=0 tx=0).stop 2024-09-12T12:13:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 -- 172.21.15.144:0/186926014 shutdown_connections 2024-09-12T12:13:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 --2- 172.21.15.144:0/186926014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00040b5fb0 0x7f0004072ee0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 --2- 172.21.15.144:0/186926014 >> v2:172.21.15.165:3300/0 conn(0x7f000415c7b0 0x7f00040ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 -- 172.21.15.144:0/186926014 >> 172.21.15.144:0/186926014 conn(0x7f000406d0d0 msgr2=0x7f000406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:29.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 -- 172.21.15.144:0/186926014 shutdown_connections 2024-09-12T12:13:29.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 -- 172.21.15.144:0/186926014 wait complete. 2024-09-12T12:13:29.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 Processor -- start 2024-09-12T12:13:29.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.001+0000 7f0009000640 1 -- start start 2024-09-12T12:13:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0009000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00040b5fb0 0x7f0004162870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0009000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f000415c7b0 0x7f000414b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0009000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f000415cd30 0x7f000414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0009000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0004073fc0 con 0x7f000415c7b0 2024-09-12T12:13:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0009000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0004073e40 con 0x7f00040b5fb0 2024-09-12T12:13:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0009000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0004074140 con 0x7f000415cd30 2024-09-12T12:13:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f000415c7b0 0x7f000414b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f000415c7b0 0x7f000414b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57154/0 (socket says 172.21.15.144:57154) 2024-09-12T12:13:29.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001400640 1 -- 172.21.15.144:0/3761481021 learned_addr learned my addr 172.21.15.144:0/3761481021 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001e00640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00040b5fb0 0x7f0004162870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0002800640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f000415cd30 0x7f000414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001400640 1 -- 172.21.15.144:0/3761481021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f000415cd30 msgr2=0x7f000414b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001400640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f000415cd30 0x7f000414b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001400640 1 -- 172.21.15.144:0/3761481021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00040b5fb0 msgr2=0x7f0004162870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001400640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00040b5fb0 0x7f0004162870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001400640 1 -- 172.21.15.144:0/3761481021 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0004162db0 con 0x7f000415c7b0 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001e00640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00040b5fb0 0x7f0004162870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0001400640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f000415c7b0 0x7f000414b130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efff00010f0 tx=0x7efff000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7efffa000640 1 -- 172.21.15.144:0/3761481021 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0017070 con 0x7f000415c7b0 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7efffa000640 1 -- 172.21.15.144:0/3761481021 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff0005d10 con 0x7f000415c7b0 2024-09-12T12:13:29.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000414b670 con 0x7f000415c7b0 2024-09-12T12:13:29.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7efffa000640 1 -- 172.21.15.144:0/3761481021 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0007310 con 0x7f000415c7b0 2024-09-12T12:13:29.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0004163730 con 0x7f000415c7b0 2024-09-12T12:13:29.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0004072ee0 con 0x7f000415c7b0 2024-09-12T12:13:29.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.005+0000 7efffa000640 1 -- 172.21.15.144:0/3761481021 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efff001a070 con 0x7f000415c7b0 2024-09-12T12:13:29.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.009+0000 7efffa000640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7effe40678c0 0x7effe4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.009+0000 7efffa000640 1 -- 172.21.15.144:0/3761481021 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efff00854e0 con 0x7f000415c7b0 2024-09-12T12:13:29.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.009+0000 7f0001e00640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7effe40678c0 0x7effe4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.009+0000 7f0001e00640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7effe40678c0 0x7effe4069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efff4009bc0 tx=0x7efff4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:29.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.013+0000 7efffa000640 1 -- 172.21.15.144:0/3761481021 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0004162db0 con 0x7f000415c7b0 2024-09-12T12:13:29.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f000415e370 con 0x7f000415c7b0 2024-09-12T12:13:29.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7efffa000640 1 -- 172.21.15.144:0/3761481021 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7efff0055b80 con 0x7f000415c7b0 2024-09-12T12:13:29.190 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:13:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7effe40678c0 msgr2=0x7effe4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7effe40678c0 0x7effe4069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efff4009bc0 tx=0x7efff4008040 comp rx=0 tx=0).stop 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f000415c7b0 msgr2=0x7f000414b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f000415c7b0 0x7f000414b130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efff00010f0 tx=0x7efff000c890 comp rx=0 tx=0).stop 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 shutdown_connections 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7effe40678c0 0x7effe4069d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f000415cd30 0x7f000414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f000415c7b0 0x7f000414b130 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 --2- 172.21.15.144:0/3761481021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00040b5fb0 0x7f0004162870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 >> 172.21.15.144:0/3761481021 conn(0x7f000406d0d0 msgr2=0x7f00040ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 shutdown_connections 2024-09-12T12:13:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.189+0000 7f0009000640 1 -- 172.21.15.144:0/3761481021 wait complete. 2024-09-12T12:13:29.213 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-12T12:13:29.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:29.214 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-12T12:13:29.243 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:13:29.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:29.243 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T12:13:29.292 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:13:29.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:29.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ea00640 1 Processor -- start 2024-09-12T12:13:29.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ea00640 1 -- start start 2024-09-12T12:13:29.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f041815c300 0x7f04180b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04180b46c0 0x7f0418073960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ea00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04180d0c80 con 0x7f04180b4270 2024-09-12T12:13:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ea00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f04180d2000 con 0x7f04180b46c0 2024-09-12T12:13:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ea00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f04180d0f60 con 0x7f041815c300 2024-09-12T12:13:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04180b46c0 0x7f0418073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04180b46c0 0x7f0418073960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57162/0 (socket says 172.21.15.144:57162) 2024-09-12T12:13:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ca00640 1 -- 172.21.15.144:0/2800032969 learned_addr learned my addr 172.21.15.144:0/2800032969 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f0417e00640 1 --2- 172.21.15.144:0/2800032969 >> v2:172.21.15.165:3300/0 conn(0x7f041815c300 0x7f04180b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ca00640 1 -- 172.21.15.144:0/2800032969 >> v2:172.21.15.165:3300/0 conn(0x7f041815c300 msgr2=0x7f04180b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ca00640 1 --2- 172.21.15.144:0/2800032969 >> v2:172.21.15.165:3300/0 conn(0x7f041815c300 0x7f04180b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ca00640 1 -- 172.21.15.144:0/2800032969 >> v1:172.21.15.165:6789/0 conn(0x7f04180b4270 legacy=0x7f0418073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.429+0000 7f041ca00640 1 -- 172.21.15.144:0/2800032969 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04180d1240 con 0x7f04180b46c0 2024-09-12T12:13:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f041ca00640 1 --2- 172.21.15.144:0/2800032969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04180b46c0 0x7f0418073960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0418070720 tx=0x7f041001f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75dd1c4c379df59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f0417400640 1 -- 172.21.15.144:0/2800032969 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04100b4070 con 0x7f04180b46c0 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f0417400640 1 -- 172.21.15.144:0/2800032969 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04100af400 con 0x7f04180b46c0 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f0417400640 1 -- 172.21.15.144:0/2800032969 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04100af7d0 con 0x7f04180b46c0 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f041ea00640 1 -- 172.21.15.144:0/2800032969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04180b46c0 msgr2=0x7f0418073960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f041ea00640 1 --2- 172.21.15.144:0/2800032969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04180b46c0 0x7f0418073960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0418070720 tx=0x7f041001f1a0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f041ea00640 1 -- 172.21.15.144:0/2800032969 shutdown_connections 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f041ea00640 1 --2- 172.21.15.144:0/2800032969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04180b46c0 0x7f0418073960 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f041ea00640 1 --2- 172.21.15.144:0/2800032969 >> v2:172.21.15.165:3300/0 conn(0x7f041815c300 0x7f04180b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f041ea00640 1 -- 172.21.15.144:0/2800032969 >> 172.21.15.144:0/2800032969 conn(0x7f041806f3e0 msgr2=0x7f041806f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f041ea00640 1 -- 172.21.15.144:0/2800032969 shutdown_connections 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.433+0000 7f041ea00640 1 -- 172.21.15.144:0/2800032969 wait complete. 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 Processor -- start 2024-09-12T12:13:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 -- start start 2024-09-12T12:13:29.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04180b4270 0x7f041815d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04180b46c0 0x7f04181fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041815c300 0x7f0418152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04180d1ae0 con 0x7f041815c300 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04180d1800 con 0x7f04180b46c0 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0418070e30 con 0x7f04180b4270 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041815c300 0x7f0418152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041815c300 0x7f0418152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57168/0 (socket says 172.21.15.144:57168) 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ca00640 1 -- 172.21.15.144:0/3073359455 learned_addr learned my addr 172.21.15.144:0/3073359455 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f040f400640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04180b46c0 0x7f04181fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f0417e00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04180b4270 0x7f041815d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ca00640 1 -- 172.21.15.144:0/3073359455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04180b4270 msgr2=0x7f041815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ca00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04180b4270 0x7f041815d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ca00640 1 -- 172.21.15.144:0/3073359455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04180b46c0 msgr2=0x7f04181fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ca00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04180b46c0 0x7f04181fc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ca00640 1 -- 172.21.15.144:0/3073359455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041815d630 con 0x7f041815c300 2024-09-12T12:13:29.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ca00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041815c300 0x7f0418152b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f041001cdd0 tx=0x7f041001bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:29.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f0414c00640 1 -- 172.21.15.144:0/3073359455 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04100b4040 con 0x7f041815c300 2024-09-12T12:13:29.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f0414c00640 1 -- 172.21.15.144:0/3073359455 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04100c0070 con 0x7f041815c300 2024-09-12T12:13:29.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f0414c00640 1 -- 172.21.15.144:0/3073359455 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410009510 con 0x7f041815c300 2024-09-12T12:13:29.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041815d8b0 con 0x7f041815c300 2024-09-12T12:13:29.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.437+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04181544f0 con 0x7f041815c300 2024-09-12T12:13:29.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.441+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04180b4b10 con 0x7f041815c300 2024-09-12T12:13:29.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.441+0000 7f0414c00640 1 -- 172.21.15.144:0/3073359455 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04100c5460 con 0x7f041815c300 2024-09-12T12:13:29.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.441+0000 7f0414c00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03f40678c0 0x7f03f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.441+0000 7f0414c00640 1 -- 172.21.15.144:0/3073359455 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0410124250 con 0x7f041815c300 2024-09-12T12:13:29.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.441+0000 7f0417e00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03f40678c0 0x7f03f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.441+0000 7f0417e00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03f40678c0 0x7f03f4069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0408006aa0 tx=0x7f0408008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:29.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.445+0000 7f0414c00640 1 -- 172.21.15.144:0/3073359455 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f041815d630 con 0x7f041815c300 2024-09-12T12:13:29.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0418073d80 con 0x7f041815c300 2024-09-12T12:13:29.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f0414c00640 1 -- 172.21.15.144:0/3073359455 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5228 (secure 0 0 0) 0x7f0410018d00 con 0x7f041815c300 2024-09-12T12:13:29.639 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:29.639 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-12T12:13:05:442423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:13:04.808385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:13:29.639 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-12T12:13:29.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03f40678c0 msgr2=0x7f03f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03f40678c0 0x7f03f4069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0408006aa0 tx=0x7f0408008040 comp rx=0 tx=0).stop 2024-09-12T12:13:29.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041815c300 msgr2=0x7f0418152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041815c300 0x7f0418152b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f041001cdd0 tx=0x7f041001bf40 comp rx=0 tx=0).stop 2024-09-12T12:13:29.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 shutdown_connections 2024-09-12T12:13:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03f40678c0 0x7f03f4069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041815c300 0x7f0418152b50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04180b46c0 0x7f04181fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 --2- 172.21.15.144:0/3073359455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04180b4270 0x7f041815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 >> 172.21.15.144:0/3073359455 conn(0x7f041806f3e0 msgr2=0x7f04180b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 shutdown_connections 2024-09-12T12:13:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.637+0000 7f041ea00640 1 -- 172.21.15.144:0/3073359455 wait complete. 2024-09-12T12:13:29.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:29.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.793+0000 7f08b8600640 1 Processor -- start 2024-09-12T12:13:29.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.793+0000 7f08b8600640 1 -- start start 2024-09-12T12:13:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b8600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08b0147fa0 0x7f08b006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b8600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b006c6b0 con 0x7f08b006c150 2024-09-12T12:13:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b8600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b0072ce0 con 0x7f08b00cf920 2024-09-12T12:13:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b8600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f08b0072a90 con 0x7f08b0147fa0 2024-09-12T12:13:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b5c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08b0147fa0 0x7f08b006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b5200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f08b006c150 0x7f08b00cf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39516/0 (socket says 172.21.15.144:39516) 2024-09-12T12:13:29.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b5200640 1 -- 172.21.15.144:0/716467746 learned_addr learned my addr 172.21.15.144:0/716467746 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:29.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b5c00640 1 -- 172.21.15.144:0/716467746 >> v1:172.21.15.165:6789/0 conn(0x7f08b00cf920 legacy=0x7f08b015ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:29.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b5c00640 1 -- 172.21.15.144:0/716467746 >> v1:172.21.15.144:6789/0 conn(0x7f08b006c150 legacy=0x7f08b00cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.797+0000 7f08b5c00640 1 -- 172.21.15.144:0/716467746 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b0072fc0 con 0x7f08b0147fa0 2024-09-12T12:13:29.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b5c00640 1 --2- 172.21.15.144:0/716467746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b0147fa0 0x7f08b006bc10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08b0072c10 tx=0x7f08a401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1d8a123c31d2d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:29.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08afe00640 1 -- 172.21.15.144:0/716467746 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a40b2070 con 0x7f08b0147fa0 2024-09-12T12:13:29.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08afe00640 1 -- 172.21.15.144:0/716467746 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a40a5760 con 0x7f08b0147fa0 2024-09-12T12:13:29.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08afe00640 1 -- 172.21.15.144:0/716467746 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a40a5b30 con 0x7f08b0147fa0 2024-09-12T12:13:29.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b8600640 1 -- 172.21.15.144:0/716467746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b0147fa0 msgr2=0x7f08b006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b8600640 1 --2- 172.21.15.144:0/716467746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b0147fa0 0x7f08b006bc10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08b0072c10 tx=0x7f08a401c7f0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b8600640 1 -- 172.21.15.144:0/716467746 shutdown_connections 2024-09-12T12:13:29.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b8600640 1 --2- 172.21.15.144:0/716467746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b0147fa0 0x7f08b006bc10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b8600640 1 -- 172.21.15.144:0/716467746 >> 172.21.15.144:0/716467746 conn(0x7f08b006cd20 msgr2=0x7f08b006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:29.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b8600640 1 -- 172.21.15.144:0/716467746 shutdown_connections 2024-09-12T12:13:29.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b8600640 1 -- 172.21.15.144:0/716467746 wait complete. 2024-09-12T12:13:29.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b8600640 1 Processor -- start 2024-09-12T12:13:29.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.801+0000 7f08b8600640 1 -- start start 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b8600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b006c150 0x7f08b0139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b8600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b00cf920 0x7f08b015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b8600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08b0147fa0 0x7f08b0139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b8600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f08b016c5e0 con 0x7f08b00cf920 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b8600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f08b016c460 con 0x7f08b006c150 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b8600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f08b016c760 con 0x7f08b0147fa0 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b00cf920 0x7f08b015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b00cf920 0x7f08b015ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57182/0 (socket says 172.21.15.144:57182) 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5200640 1 -- 172.21.15.144:0/1652364066 learned_addr learned my addr 172.21.15.144:0/1652364066 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5c00640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b006c150 0x7f08b0139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b6600640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08b0147fa0 0x7f08b0139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5200640 1 -- 172.21.15.144:0/1652364066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08b0147fa0 msgr2=0x7f08b0139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5200640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08b0147fa0 0x7f08b0139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5200640 1 -- 172.21.15.144:0/1652364066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b006c150 msgr2=0x7f08b0139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5200640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b006c150 0x7f08b0139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5200640 1 -- 172.21.15.144:0/1652364066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b0139860 con 0x7f08b00cf920 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b6600640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08b0147fa0 0x7f08b0139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b5200640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b00cf920 0x7f08b015ea20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f089c00c450 tx=0x7f089c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08ad600640 1 -- 172.21.15.144:0/1652364066 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c017070 con 0x7f08b00cf920 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08ad600640 1 -- 172.21.15.144:0/1652364066 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f089c005cf0 con 0x7f08b00cf920 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08ad600640 1 -- 172.21.15.144:0/1652364066 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c007290 con 0x7f08b00cf920 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b015ef60 con 0x7f08b00cf920 2024-09-12T12:13:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b015e490 con 0x7f08b00cf920 2024-09-12T12:13:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b006bc10 con 0x7f08b00cf920 2024-09-12T12:13:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.805+0000 7f08ad600640 1 -- 172.21.15.144:0/1652364066 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f089c01a070 con 0x7f08b00cf920 2024-09-12T12:13:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.809+0000 7f08ad600640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08900678f0 0x7f0890069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.809+0000 7f08ad600640 1 -- 172.21.15.144:0/1652364066 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f089c085500 con 0x7f08b00cf920 2024-09-12T12:13:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.809+0000 7f08b5c00640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08900678f0 0x7f0890069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.809+0000 7f08b5c00640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08900678f0 0x7f0890069db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f08a40af000 tx=0x7f08a40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:29.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:29.813+0000 7f08ad600640 1 -- 172.21.15.144:0/1652364066 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f089c055b10 con 0x7f08b00cf920 2024-09-12T12:13:30.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08b00b67d0 con 0x7f08b00cf920 2024-09-12T12:13:30.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08ad600640 1 -- 172.21.15.144:0/1652364066 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5228 (secure 0 0 0) 0x7f089c055410 con 0x7f08b00cf920 2024-09-12T12:13:30.003 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:30.003 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-12T12:13:05:442423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:13:04.808385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:13:30.003 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-12T12:13:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08900678f0 msgr2=0x7f0890069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08900678f0 0x7f0890069db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f08a40af000 tx=0x7f08a40a7070 comp rx=0 tx=0).stop 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b00cf920 msgr2=0x7f08b015ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b00cf920 0x7f08b015ea20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f089c00c450 tx=0x7f089c00c910 comp rx=0 tx=0).stop 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 shutdown_connections 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f08900678f0 0x7f0890069db0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08b0147fa0 0x7f08b0139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08b00cf920 0x7f08b015ea20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 --2- 172.21.15.144:0/1652364066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b006c150 0x7f08b0139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.001+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 >> 172.21.15.144:0/1652364066 conn(0x7f08b006cd20 msgr2=0x7f08b00b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.005+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 shutdown_connections 2024-09-12T12:13:30.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.005+0000 7f08b8600640 1 -- 172.21.15.144:0/1652364066 wait complete. 2024-09-12T12:13:30.025 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:30.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a5c000640 1 Processor -- start 2024-09-12T12:13:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a5c000640 1 -- start start 2024-09-12T12:13:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a5c000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7a540cd640 0x7f7a54071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a5c000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a540b45a0 con 0x7f7a5415b4e0 2024-09-12T12:13:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a5c000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a540b3fe0 con 0x7f7a54071420 2024-09-12T12:13:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a5c000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7a540b42c0 con 0x7f7a540cd640 2024-09-12T12:13:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a59600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7a5415b4e0 0x7f7a540b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39520/0 (socket says 172.21.15.144:39520) 2024-09-12T12:13:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a59600640 1 -- 172.21.15.144:0/1576074486 learned_addr learned my addr 172.21.15.144:0/1576074486 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a5a000640 1 --2- 172.21.15.144:0/1576074486 >> v2:172.21.15.165:3300/0 conn(0x7f7a540cd640 0x7f7a54071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a53e00640 1 -- 172.21.15.144:0/1576074486 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121190366 0 0) 0x7f7a540b45a0 con 0x7f7a5415b4e0 2024-09-12T12:13:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.161+0000 7f7a53e00640 1 -- 172.21.15.144:0/1576074486 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a3c003530 con 0x7f7a5415b4e0 2024-09-12T12:13:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a5a000640 1 -- 172.21.15.144:0/1576074486 >> v1:172.21.15.165:6789/0 conn(0x7f7a54071420 legacy=0x7f7a540ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a5a000640 1 -- 172.21.15.144:0/1576074486 >> v1:172.21.15.144:6789/0 conn(0x7f7a5415b4e0 legacy=0x7f7a540b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a5a000640 1 -- 172.21.15.144:0/1576074486 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a540b1490 con 0x7f7a540cd640 2024-09-12T12:13:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a5a000640 1 --2- 172.21.15.144:0/1576074486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a540cd640 0x7f7a54071840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097c0 tx=0x7f7a4c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91dd5b306fa88eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a53e00640 1 -- 172.21.15.144:0/1576074486 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0ab600 con 0x7f7a540cd640 2024-09-12T12:13:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a53e00640 1 -- 172.21.15.144:0/1576074486 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0b0070 con 0x7f7a540cd640 2024-09-12T12:13:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a53e00640 1 -- 172.21.15.144:0/1576074486 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0ab9a0 con 0x7f7a540cd640 2024-09-12T12:13:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a5c000640 1 -- 172.21.15.144:0/1576074486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a540cd640 msgr2=0x7f7a54071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a5c000640 1 --2- 172.21.15.144:0/1576074486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a540cd640 0x7f7a54071840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097c0 tx=0x7f7a4c01c470 comp rx=0 tx=0).stop 2024-09-12T12:13:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a5c000640 1 -- 172.21.15.144:0/1576074486 shutdown_connections 2024-09-12T12:13:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a5c000640 1 --2- 172.21.15.144:0/1576074486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a540cd640 0x7f7a54071840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.165+0000 7f7a5c000640 1 -- 172.21.15.144:0/1576074486 >> 172.21.15.144:0/1576074486 conn(0x7f7a5406d0d0 msgr2=0x7f7a5406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 -- 172.21.15.144:0/1576074486 shutdown_connections 2024-09-12T12:13:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 -- 172.21.15.144:0/1576074486 wait complete. 2024-09-12T12:13:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 Processor -- start 2024-09-12T12:13:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 -- start start 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a54071420 0x7f7a5414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a540cd640 0x7f7a54166470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a5415b4e0 0x7f7a5414fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5415b8c0 con 0x7f7a5415b4e0 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54169270 con 0x7f7a54071420 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5414f030 con 0x7f7a540cd640 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a5415b4e0 0x7f7a5414fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a5415b4e0 0x7f7a5414fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57190/0 (socket says 172.21.15.144:57190) 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5a000640 1 -- 172.21.15.144:0/3190608458 learned_addr learned my addr 172.21.15.144:0/3190608458 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a59600640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a54071420 0x7f7a5414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a58c00640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a540cd640 0x7f7a54166470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5a000640 1 -- 172.21.15.144:0/3190608458 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a540cd640 msgr2=0x7f7a54166470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5a000640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a540cd640 0x7f7a54166470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5a000640 1 -- 172.21.15.144:0/3190608458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a54071420 msgr2=0x7f7a5414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5a000640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a54071420 0x7f7a5414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5a000640 1 -- 172.21.15.144:0/3190608458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a54166d70 con 0x7f7a5415b4e0 2024-09-12T12:13:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a59600640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a54071420 0x7f7a5414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a5a000640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a5415b4e0 0x7f7a5414fc80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097c0 tx=0x7f7a4c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.169+0000 7f7a51600640 1 -- 172.21.15.144:0/3190608458 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0c1070 con 0x7f7a5415b4e0 2024-09-12T12:13:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a51600640 1 -- 172.21.15.144:0/3190608458 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c003820 con 0x7f7a5415b4e0 2024-09-12T12:13:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a540ce580 con 0x7f7a5415b4e0 2024-09-12T12:13:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a51600640 1 -- 172.21.15.144:0/3190608458 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c003bd0 con 0x7f7a5415b4e0 2024-09-12T12:13:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a540ceb40 con 0x7f7a5415b4e0 2024-09-12T12:13:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a54167050 con 0x7f7a5415b4e0 2024-09-12T12:13:30.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a51600640 1 -- 172.21.15.144:0/3190608458 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a4c0c4070 con 0x7f7a5415b4e0 2024-09-12T12:13:30.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a51600640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a340678c0 0x7f7a34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a51600640 1 -- 172.21.15.144:0/3190608458 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7a4c120180 con 0x7f7a5415b4e0 2024-09-12T12:13:30.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a59600640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a340678c0 0x7f7a34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.173+0000 7f7a59600640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a340678c0 0x7f7a34069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7a48001570 tx=0x7f7a48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:30.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.177+0000 7f7a51600640 1 -- 172.21.15.144:0/3190608458 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a4c016090 con 0x7f7a5415b4e0 2024-09-12T12:13:30.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.337+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a54071840 con 0x7f7a5415b4e0 2024-09-12T12:13:30.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a51600640 1 -- 172.21.15.144:0/3190608458 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19007 (secure 0 0 0) 0x7f7a4c0f08b0 con 0x7f7a5415b4e0 2024-09-12T12:13:30.341 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:30.341 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:13:26.456094+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:30.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a340678c0 msgr2=0x7f7a34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a340678c0 0x7f7a34069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7a48001570 tx=0x7f7a48009040 comp rx=0 tx=0).stop 2024-09-12T12:13:30.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a5415b4e0 msgr2=0x7f7a5414fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a5415b4e0 0x7f7a5414fc80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097c0 tx=0x7f7a4c019210 comp rx=0 tx=0).stop 2024-09-12T12:13:30.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 shutdown_connections 2024-09-12T12:13:30.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a340678c0 0x7f7a34069d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a5415b4e0 0x7f7a5414fc80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a540cd640 0x7f7a54166470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 --2- 172.21.15.144:0/3190608458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a54071420 0x7f7a5414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 >> 172.21.15.144:0/3190608458 conn(0x7f7a5406d0d0 msgr2=0x7f7a54152380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:30.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 shutdown_connections 2024-09-12T12:13:30.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.341+0000 7f7a5c000640 1 -- 172.21.15.144:0/3190608458 wait complete. 2024-09-12T12:13:30.364 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:13:30.364 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:30.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e0a000640 1 Processor -- start 2024-09-12T12:13:30.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e0a000640 1 -- start start 2024-09-12T12:13:30.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e0a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e0415b4e0 0x7f2e040b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e0a000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2e040b3ad0 0x7f2e04071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e0a000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e040b45a0 con 0x7f2e04071960 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e0a000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2e040b3fe0 con 0x7f2e0415b4e0 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e0a000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2e040b42c0 con 0x7f2e040b3ad0 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e03400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e0415b4e0 0x7f2e040b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e03400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e0415b4e0 0x7f2e040b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57202/0 (socket says 172.21.15.144:57202) 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e03400640 1 -- 172.21.15.144:0/728789268 learned_addr learned my addr 172.21.15.144:0/728789268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.501+0000 7f2e02a00640 1 --2- 172.21.15.144:0/728789268 >> v2:172.21.15.165:3300/0 conn(0x7f2e040b3ad0 0x7f2e04071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e03400640 1 -- 172.21.15.144:0/728789268 >> v2:172.21.15.165:3300/0 conn(0x7f2e040b3ad0 msgr2=0x7f2e04071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e03400640 1 --2- 172.21.15.144:0/728789268 >> v2:172.21.15.165:3300/0 conn(0x7f2e040b3ad0 0x7f2e04071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e03400640 1 -- 172.21.15.144:0/728789268 >> v1:172.21.15.165:6789/0 conn(0x7f2e04071960 legacy=0x7f2e040ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:30.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e03400640 1 -- 172.21.15.144:0/728789268 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e040b1490 con 0x7f2e0415b4e0 2024-09-12T12:13:30.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e03400640 1 --2- 172.21.15.144:0/728789268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0415b4e0 0x7f2e040b3590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b02b0 tx=0x7f2df401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39082cc5ab470109 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:30.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e02000640 1 -- 172.21.15.144:0/728789268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df40a5860 con 0x7f2e0415b4e0 2024-09-12T12:13:30.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e02000640 1 -- 172.21.15.144:0/728789268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df40a5a00 con 0x7f2e0415b4e0 2024-09-12T12:13:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e02000640 1 -- 172.21.15.144:0/728789268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df40a5dd0 con 0x7f2e0415b4e0 2024-09-12T12:13:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e0a000640 1 -- 172.21.15.144:0/728789268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0415b4e0 msgr2=0x7f2e040b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e0a000640 1 --2- 172.21.15.144:0/728789268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0415b4e0 0x7f2e040b3590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b02b0 tx=0x7f2df401c980 comp rx=0 tx=0).stop 2024-09-12T12:13:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e0a000640 1 -- 172.21.15.144:0/728789268 shutdown_connections 2024-09-12T12:13:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e0a000640 1 --2- 172.21.15.144:0/728789268 >> v2:172.21.15.165:3300/0 conn(0x7f2e040b3ad0 0x7f2e04071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e0a000640 1 --2- 172.21.15.144:0/728789268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0415b4e0 0x7f2e040b3590 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e0a000640 1 -- 172.21.15.144:0/728789268 >> 172.21.15.144:0/728789268 conn(0x7f2e0406d0d0 msgr2=0x7f2e0406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e0a000640 1 -- 172.21.15.144:0/728789268 shutdown_connections 2024-09-12T12:13:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.505+0000 7f2e0a000640 1 -- 172.21.15.144:0/728789268 wait complete. 2024-09-12T12:13:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e0a000640 1 Processor -- start 2024-09-12T12:13:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e0a000640 1 -- start start 2024-09-12T12:13:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e0a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e04071960 0x7f2e0414a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e0a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e040b3ad0 0x7f2e04150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e0a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e0415b4e0 0x7f2e04151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e0a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e040b2620 con 0x7f2e040b3ad0 2024-09-12T12:13:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e0a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e040b24a0 con 0x7f2e0415b4e0 2024-09-12T12:13:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e0a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e040cd640 con 0x7f2e04071960 2024-09-12T12:13:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e02a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e040b3ad0 0x7f2e04150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e02a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e040b3ad0 0x7f2e04150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57212/0 (socket says 172.21.15.144:57212) 2024-09-12T12:13:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e02a00640 1 -- 172.21.15.144:0/1892783095 learned_addr learned my addr 172.21.15.144:0/1892783095 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e03400640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e04071960 0x7f2e0414a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e03e00640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e0415b4e0 0x7f2e04151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e02a00640 1 -- 172.21.15.144:0/1892783095 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e04071960 msgr2=0x7f2e0414a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e02a00640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e04071960 0x7f2e0414a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e02a00640 1 -- 172.21.15.144:0/1892783095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e0415b4e0 msgr2=0x7f2e04151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e02a00640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e0415b4e0 0x7f2e04151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e02a00640 1 -- 172.21.15.144:0/1892783095 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e040af440 con 0x7f2e040b3ad0 2024-09-12T12:13:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e03e00640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e0415b4e0 0x7f2e04151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e02a00640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e040b3ad0 0x7f2e04150e50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2df000d800 tx=0x7f2df000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2dfb400640 1 -- 172.21.15.144:0/1892783095 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df000b6c0 con 0x7f2e040b3ad0 2024-09-12T12:13:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2dfb400640 1 -- 172.21.15.144:0/1892783095 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df0019070 con 0x7f2e040b3ad0 2024-09-12T12:13:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2dfb400640 1 -- 172.21.15.144:0/1892783095 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df000ba60 con 0x7f2e040b3ad0 2024-09-12T12:13:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.509+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e040af6e0 con 0x7f2e040b3ad0 2024-09-12T12:13:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.513+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e040afca0 con 0x7f2e040b3ad0 2024-09-12T12:13:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.513+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e04071420 con 0x7f2e040b3ad0 2024-09-12T12:13:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.513+0000 7f2dfb400640 1 -- 172.21.15.144:0/1892783095 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2df000bc00 con 0x7f2e040b3ad0 2024-09-12T12:13:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.513+0000 7f2dfb400640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2de40678c0 0x7f2de4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.513+0000 7f2dfb400640 1 -- 172.21.15.144:0/1892783095 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2df00864d0 con 0x7f2e040b3ad0 2024-09-12T12:13:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.513+0000 7f2e03400640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2de40678c0 0x7f2de4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.513+0000 7f2e03400640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2de40678c0 0x7f2de4069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2df40ae000 tx=0x7f2df40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:30.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.517+0000 7f2dfb400640 1 -- 172.21.15.144:0/1892783095 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2df0056c00 con 0x7f2e040b3ad0 2024-09-12T12:13:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.705+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e040b2b60 con 0x7f2e040b3ad0 2024-09-12T12:13:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.705+0000 7f2dfb400640 1 -- 172.21.15.144:0/1892783095 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5228 (secure 0 0 0) 0x7f2df0056500 con 0x7f2e040b3ad0 2024-09-12T12:13:30.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:30.709 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-12T12:13:05:442423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:13:04.808385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:13:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-12T12:13:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2de40678c0 msgr2=0x7f2de4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2de40678c0 0x7f2de4069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2df40ae000 tx=0x7f2df40a7070 comp rx=0 tx=0).stop 2024-09-12T12:13:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e040b3ad0 msgr2=0x7f2e04150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e040b3ad0 0x7f2e04150e50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2df000d800 tx=0x7f2df000dcc0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 shutdown_connections 2024-09-12T12:13:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2de40678c0 0x7f2de4069d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e0415b4e0 0x7f2e04151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e040b3ad0 0x7f2e04150e50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 --2- 172.21.15.144:0/1892783095 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e04071960 0x7f2e0414a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 >> 172.21.15.144:0/1892783095 conn(0x7f2e0406d0d0 msgr2=0x7f2e040b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:30.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 shutdown_connections 2024-09-12T12:13:30.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.709+0000 7f2e0a000640 1 -- 172.21.15.144:0/1892783095 wait complete. 2024-09-12T12:13:30.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f3564a00640 1 Processor -- start 2024-09-12T12:13:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f3564a00640 1 -- start start 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f3564a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3560072080 0x7f3560072460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f3564a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 0x7f3560073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f3564a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35600cde20 con 0x7f35600735c0 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f3564a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f35600ce9c0 con 0x7f3560072080 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f3564a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35600729a0 con 0x7f35600d0db0 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f355de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3560072080 0x7f3560072460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f355e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f35600735c0 0x7f35600cee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39522/0 (socket says 172.21.15.144:39522) 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f355e800640 1 -- 172.21.15.144:0/2206064586 learned_addr learned my addr 172.21.15.144:0/2206064586 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f355d400640 1 --2- 172.21.15.144:0/2206064586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 0x7f3560073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f355de00640 1 -- 172.21.15.144:0/2206064586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 msgr2=0x7f3560073080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f355de00640 1 --2- 172.21.15.144:0/2206064586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 0x7f3560073080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f355de00640 1 -- 172.21.15.144:0/2206064586 >> v1:172.21.15.144:6789/0 conn(0x7f35600735c0 legacy=0x7f35600cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f355de00640 1 -- 172.21.15.144:0/2206064586 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35600ce090 con 0x7f3560072080 2024-09-12T12:13:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.865+0000 7f355ca00640 1 -- 172.21.15.144:0/2206064586 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899104350 0 0) 0x7f35600cde20 con 0x7f35600735c0 2024-09-12T12:13:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f355de00640 1 --2- 172.21.15.144:0/2206064586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3560072080 0x7f3560072460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3550009d90 tx=0x7f355001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97df063206a5c7c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f355ca00640 1 -- 172.21.15.144:0/2206064586 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35500b2070 con 0x7f3560072080 2024-09-12T12:13:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f355ca00640 1 -- 172.21.15.144:0/2206064586 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35500a5970 con 0x7f3560072080 2024-09-12T12:13:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f355ca00640 1 -- 172.21.15.144:0/2206064586 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35500a5d40 con 0x7f3560072080 2024-09-12T12:13:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f3564a00640 1 -- 172.21.15.144:0/2206064586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3560072080 msgr2=0x7f3560072460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f3564a00640 1 --2- 172.21.15.144:0/2206064586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3560072080 0x7f3560072460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3550009d90 tx=0x7f355001c8b0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f3564a00640 1 -- 172.21.15.144:0/2206064586 shutdown_connections 2024-09-12T12:13:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f3564a00640 1 --2- 172.21.15.144:0/2206064586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 0x7f3560073080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f3564a00640 1 --2- 172.21.15.144:0/2206064586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3560072080 0x7f3560072460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f3564a00640 1 -- 172.21.15.144:0/2206064586 >> 172.21.15.144:0/2206064586 conn(0x7f356006cd20 msgr2=0x7f356006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f3564a00640 1 -- 172.21.15.144:0/2206064586 shutdown_connections 2024-09-12T12:13:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.869+0000 7f3564a00640 1 -- 172.21.15.144:0/2206064586 wait complete. 2024-09-12T12:13:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 Processor -- start 2024-09-12T12:13:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 -- start start 2024-09-12T12:13:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3560072080 0x7f3560148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600735c0 0x7f35600cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 0x7f356014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35600cfef0 con 0x7f35600735c0 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35600cfd70 con 0x7f3560072080 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35600d0070 con 0x7f35600d0db0 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600735c0 0x7f35600cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600735c0 0x7f35600cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57240/0 (socket says 172.21.15.144:57240) 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355d400640 1 -- 172.21.15.144:0/1619096708 learned_addr learned my addr 172.21.15.144:0/1619096708 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355de00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3560072080 0x7f3560148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355e800640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 0x7f356014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355d400640 1 -- 172.21.15.144:0/1619096708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 msgr2=0x7f356014a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355d400640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 0x7f356014a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355d400640 1 -- 172.21.15.144:0/1619096708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3560072080 msgr2=0x7f3560148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355d400640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3560072080 0x7f3560148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355d400640 1 -- 172.21.15.144:0/1619096708 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35600cd310 con 0x7f35600735c0 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355de00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3560072080 0x7f3560148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f355d400640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600735c0 0x7f35600cc390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f354c00d7d0 tx=0x7f354c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3556000640 1 -- 172.21.15.144:0/1619096708 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c004030 con 0x7f35600735c0 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3556000640 1 -- 172.21.15.144:0/1619096708 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354c0041d0 con 0x7f35600735c0 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35600ccd50 con 0x7f35600735c0 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3556000640 1 -- 172.21.15.144:0/1619096708 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c00b6c0 con 0x7f35600735c0 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3560149f40 con 0x7f35600735c0 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.873+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3560072460 con 0x7f35600735c0 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.877+0000 7f3556000640 1 -- 172.21.15.144:0/1619096708 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f354c00b860 con 0x7f35600735c0 2024-09-12T12:13:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.877+0000 7f3556000640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35400678c0 0x7f3540069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.877+0000 7f3556000640 1 -- 172.21.15.144:0/1619096708 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f354c086410 con 0x7f35600735c0 2024-09-12T12:13:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.877+0000 7f355de00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35400678c0 0x7f3540069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.877+0000 7f355de00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35400678c0 0x7f3540069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f35500af000 tx=0x7f35500a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:30.881+0000 7f3556000640 1 -- 172.21.15.144:0/1619096708 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f354c056ab0 con 0x7f35600735c0 2024-09-12T12:13:31.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.073+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3560072e60 con 0x7f35600735c0 2024-09-12T12:13:31.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.073+0000 7f3556000640 1 -- 172.21.15.144:0/1619096708 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5228 (secure 0 0 0) 0x7f354c0563b0 con 0x7f35600735c0 2024-09-12T12:13:31.075 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:31.076 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-12T12:13:05:442423+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/595982667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":595982667},{"type":"v1","addr":"172.21.15.144:6837","nonce":595982667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1900650772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1900650772},{"type":"v1","addr":"172.21.15.165:6834","nonce":1900650772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2042416987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2042416987},{"type":"v1","addr":"172.21.15.144:6836","nonce":2042416987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:12:44.209030+0000","modified":"2024-09-12T12:13:04.808385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2425635308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2425635308},{"type":"v1","addr":"172.21.15.165:6835","nonce":2425635308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-09-12T12:13:31.076 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-12T12:13:31.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35400678c0 msgr2=0x7f3540069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35400678c0 0x7f3540069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f35500af000 tx=0x7f35500a7070 comp rx=0 tx=0).stop 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600735c0 msgr2=0x7f35600cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600735c0 0x7f35600cc390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f354c00d7d0 tx=0x7f354c00dc90 comp rx=0 tx=0).stop 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 shutdown_connections 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35400678c0 0x7f3540069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35600d0db0 0x7f356014a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35600735c0 0x7f35600cc390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 --2- 172.21.15.144:0/1619096708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3560072080 0x7f3560148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 >> 172.21.15.144:0/1619096708 conn(0x7f356006cd20 msgr2=0x7f356015bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 shutdown_connections 2024-09-12T12:13:31.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.077+0000 7f3564a00640 1 -- 172.21.15.144:0/1619096708 wait complete. 2024-09-12T12:13:31.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.229+0000 7f5918800640 1 Processor -- start 2024-09-12T12:13:31.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.229+0000 7f5918800640 1 -- start start 2024-09-12T12:13:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5918800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015c7b0 0x7f59100ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5918800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f59100b5fb0 0x7f5910072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5918800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59100cd870 con 0x7f591015cd30 2024-09-12T12:13:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5918800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5910072a50 con 0x7f59100b5fb0 2024-09-12T12:13:31.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5918800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59100cde30 con 0x7f591015c7b0 2024-09-12T12:13:31.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5915e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015c7b0 0x7f59100ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5916800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f59100b5fb0 0x7f5910072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5916800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f59100b5fb0 0x7f5910072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:38072/0 (socket says 172.21.15.144:38072) 2024-09-12T12:13:31.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5916800640 1 -- 172.21.15.144:0/4082560018 learned_addr learned my addr 172.21.15.144:0/4082560018 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:31.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5915e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015c7b0 0x7f59100ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60062/0 (socket says 172.21.15.144:60062) 2024-09-12T12:13:31.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5916800640 1 -- 172.21.15.144:0/4082560018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015c7b0 msgr2=0x7f59100ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:31.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5916800640 1 --2- 172.21.15.144:0/4082560018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015c7b0 0x7f59100ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5916800640 1 -- 172.21.15.144:0/4082560018 >> v1:172.21.15.165:6789/0 conn(0x7f591015cd30 legacy=0x7f59100b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.233+0000 7f5916800640 1 -- 172.21.15.144:0/4082560018 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59100cdb50 con 0x7f59100b5fb0 2024-09-12T12:13:31.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5916800640 1 --2- 172.21.15.144:0/4082560018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59100b5fb0 0x7f5910072ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f590c009e50 tx=0x7f590c01ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cafca0d1f376a9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:31.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5914a00640 1 -- 172.21.15.144:0/4082560018 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0a5810 con 0x7f59100b5fb0 2024-09-12T12:13:31.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5914a00640 1 -- 172.21.15.144:0/4082560018 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590c0a59b0 con 0x7f59100b5fb0 2024-09-12T12:13:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5914a00640 1 -- 172.21.15.144:0/4082560018 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c0a5d80 con 0x7f59100b5fb0 2024-09-12T12:13:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 -- 172.21.15.144:0/4082560018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59100b5fb0 msgr2=0x7f5910072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 --2- 172.21.15.144:0/4082560018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59100b5fb0 0x7f5910072ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f590c009e50 tx=0x7f590c01ca30 comp rx=0 tx=0).stop 2024-09-12T12:13:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 -- 172.21.15.144:0/4082560018 shutdown_connections 2024-09-12T12:13:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 --2- 172.21.15.144:0/4082560018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59100b5fb0 0x7f5910072ee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 --2- 172.21.15.144:0/4082560018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015c7b0 0x7f59100ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 -- 172.21.15.144:0/4082560018 >> 172.21.15.144:0/4082560018 conn(0x7f591006d0d0 msgr2=0x7f591006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 -- 172.21.15.144:0/4082560018 shutdown_connections 2024-09-12T12:13:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 -- 172.21.15.144:0/4082560018 wait complete. 2024-09-12T12:13:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 Processor -- start 2024-09-12T12:13:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.237+0000 7f5918800640 1 -- start start 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5918800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59100b5fb0 0x7f5910152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5918800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f591015c7b0 0x7f59100b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5918800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015cd30 0x7f59100ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5918800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5910073fc0 con 0x7f591015c7b0 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5918800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5910073e40 con 0x7f59100b5fb0 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5918800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5910074140 con 0x7f591015cd30 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f591015c7b0 0x7f59100b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f591015c7b0 0x7f59100b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57252/0 (socket says 172.21.15.144:57252) 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915400640 1 -- 172.21.15.144:0/3252653220 learned_addr learned my addr 172.21.15.144:0/3252653220 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915e00640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59100b5fb0 0x7f5910152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5916800640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015cd30 0x7f59100ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915400640 1 -- 172.21.15.144:0/3252653220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015cd30 msgr2=0x7f59100ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915400640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015cd30 0x7f59100ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915400640 1 -- 172.21.15.144:0/3252653220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59100b5fb0 msgr2=0x7f5910152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915400640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59100b5fb0 0x7f5910152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915400640 1 -- 172.21.15.144:0/3252653220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59100b4bd0 con 0x7f591015c7b0 2024-09-12T12:13:31.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5915400640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f591015c7b0 0x7f59100b4380 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f590000c370 tx=0x7f590000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f590a000640 1 -- 172.21.15.144:0/3252653220 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59000052d0 con 0x7f591015c7b0 2024-09-12T12:13:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f590a000640 1 -- 172.21.15.144:0/3252653220 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5900005470 con 0x7f591015c7b0 2024-09-12T12:13:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f590a000640 1 -- 172.21.15.144:0/3252653220 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900007260 con 0x7f591015c7b0 2024-09-12T12:13:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59100b4eb0 con 0x7f591015c7b0 2024-09-12T12:13:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59100b5470 con 0x7f591015c7b0 2024-09-12T12:13:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59100b5670 con 0x7f591015c7b0 2024-09-12T12:13:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.241+0000 7f590a000640 1 -- 172.21.15.144:0/3252653220 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5900007400 con 0x7f591015c7b0 2024-09-12T12:13:31.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.245+0000 7f590a000640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58f40678c0 0x7f58f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.245+0000 7f590a000640 1 -- 172.21.15.144:0/3252653220 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f59000853a0 con 0x7f591015c7b0 2024-09-12T12:13:31.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.245+0000 7f5915e00640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58f40678c0 0x7f58f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.245+0000 7f5915e00640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58f40678c0 0x7f58f4069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5904009b60 tx=0x7f5904009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.249+0000 7f590a000640 1 -- 172.21.15.144:0/3252653220 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5900055520 con 0x7f591015c7b0 2024-09-12T12:13:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.409+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5910072ee0 con 0x7f591015c7b0 2024-09-12T12:13:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.409+0000 7f590a000640 1 -- 172.21.15.144:0/3252653220 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19007 (secure 0 0 0) 0x7f5900059820 con 0x7f591015c7b0 2024-09-12T12:13:31.412 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:31.413 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":27,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:13:26.456094+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:12:42.126753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:12:43.227823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T12:12:47.209031+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58f40678c0 msgr2=0x7f58f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58f40678c0 0x7f58f4069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5904009b60 tx=0x7f5904009190 comp rx=0 tx=0).stop 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f591015c7b0 msgr2=0x7f59100b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f591015c7b0 0x7f59100b4380 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f590000c370 tx=0x7f590000c830 comp rx=0 tx=0).stop 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 shutdown_connections 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58f40678c0 0x7f58f4069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f591015cd30 0x7f59100ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f591015c7b0 0x7f59100b4380 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 --2- 172.21.15.144:0/3252653220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59100b5fb0 0x7f5910152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 >> 172.21.15.144:0/3252653220 conn(0x7f591006d0d0 msgr2=0x7f59100cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 shutdown_connections 2024-09-12T12:13:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.413+0000 7f5918800640 1 -- 172.21.15.144:0/3252653220 wait complete. 2024-09-12T12:13:31.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:13:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c8400640 1 Processor -- start 2024-09-12T12:13:31.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c8400640 1 -- start start 2024-09-12T12:13:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c8400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd1c015cd30 0x7fd1c00b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c8400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c00b61e0 con 0x7fd1c00b5de0 2024-09-12T12:13:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c8400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c00cd870 con 0x7fd1c015c7b0 2024-09-12T12:13:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c8400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c0072a50 con 0x7fd1c015cd30 2024-09-12T12:13:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd1c015cd30 0x7fd1c00b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c6400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd1c00b5de0 0x7fd1c0072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39536/0 (socket says 172.21.15.144:39536) 2024-09-12T12:13:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c6400640 1 -- 172.21.15.144:0/1325899308 learned_addr learned my addr 172.21.15.144:0/1325899308 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c5000640 1 -- 172.21.15.144:0/1325899308 >> v1:172.21.15.165:6789/0 conn(0x7fd1c015c7b0 legacy=0x7fd1c00ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.573+0000 7fd1c5000640 1 -- 172.21.15.144:0/1325899308 >> v1:172.21.15.144:6789/0 conn(0x7fd1c00b5de0 legacy=0x7fd1c0072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1c5000640 1 -- 172.21.15.144:0/1325899308 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c00cdb50 con 0x7fd1c015cd30 2024-09-12T12:13:31.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1bfe00640 1 -- 172.21.15.144:0/1325899308 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540800779 0 0) 0x7fd1c00b61e0 con 0x7fd1c00b5de0 2024-09-12T12:13:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1c5000640 1 --2- 172.21.15.144:0/1325899308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c015cd30 0x7fd1c00b58a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0097c0 tx=0x7fd1ac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555ee523bcb10693 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1bfe00640 1 -- 172.21.15.144:0/1325899308 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0b0070 con 0x7fd1c015cd30 2024-09-12T12:13:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1bfe00640 1 -- 172.21.15.144:0/1325899308 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0ab600 con 0x7fd1c015cd30 2024-09-12T12:13:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1bfe00640 1 -- 172.21.15.144:0/1325899308 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0ab9d0 con 0x7fd1c015cd30 2024-09-12T12:13:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1c8400640 1 -- 172.21.15.144:0/1325899308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c015cd30 msgr2=0x7fd1c00b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1c8400640 1 --2- 172.21.15.144:0/1325899308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c015cd30 0x7fd1c00b58a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0097c0 tx=0x7fd1ac01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1c8400640 1 -- 172.21.15.144:0/1325899308 shutdown_connections 2024-09-12T12:13:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1c8400640 1 --2- 172.21.15.144:0/1325899308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c015cd30 0x7fd1c00b58a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1c8400640 1 -- 172.21.15.144:0/1325899308 >> 172.21.15.144:0/1325899308 conn(0x7fd1c006d0d0 msgr2=0x7fd1c006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1c8400640 1 -- 172.21.15.144:0/1325899308 shutdown_connections 2024-09-12T12:13:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.577+0000 7fd1c8400640 1 -- 172.21.15.144:0/1325899308 wait complete. 2024-09-12T12:13:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 Processor -- start 2024-09-12T12:13:31.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 -- start start 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c00b5de0 0x7fd1c015ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1c015c7b0 0x7fd1c00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1c015cd30 0x7fd1c00aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c0074210 con 0x7fd1c00b5de0 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c0074090 con 0x7fd1c015c7b0 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c00cd610 con 0x7fd1c015cd30 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c00b5de0 0x7fd1c015ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c00b5de0 0x7fd1c015ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57268/0 (socket says 172.21.15.144:57268) 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5a00640 1 -- 172.21.15.144:0/565772553 learned_addr learned my addr 172.21.15.144:0/565772553 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:31.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5000640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1c015c7b0 0x7fd1c00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c6400640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1c015cd30 0x7fd1c00aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5a00640 1 -- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1c015cd30 msgr2=0x7fd1c00aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5a00640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1c015cd30 0x7fd1c00aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5a00640 1 -- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1c015c7b0 msgr2=0x7fd1c00ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5a00640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1c015c7b0 0x7fd1c00ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5a00640 1 -- 172.21.15.144:0/565772553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c01411f0 con 0x7fd1c00b5de0 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5000640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1c015c7b0 0x7fd1c00ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c6400640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1c015cd30 0x7fd1c00aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c5a00640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c00b5de0 0x7fd1c015ab10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400c530 tx=0x7fd1b400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1bd600640 1 -- 172.21.15.144:0/565772553 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4016020 con 0x7fd1c00b5de0 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1bd600640 1 -- 172.21.15.144:0/565772553 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b4005220 con 0x7fd1c00b5de0 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1bd600640 1 -- 172.21.15.144:0/565772553 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4007030 con 0x7fd1c00b5de0 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c01414d0 con 0x7fd1c00b5de0 2024-09-12T12:13:31.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.581+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c0141a90 con 0x7fd1c00b5de0 2024-09-12T12:13:31.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.585+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c00b58a0 con 0x7fd1c00b5de0 2024-09-12T12:13:31.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.585+0000 7fd1bd600640 1 -- 172.21.15.144:0/565772553 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1b40071d0 con 0x7fd1c00b5de0 2024-09-12T12:13:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.585+0000 7fd1bd600640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1a0067910 0x7fd1a0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.585+0000 7fd1bd600640 1 -- 172.21.15.144:0/565772553 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd1b4085a30 con 0x7fd1c00b5de0 2024-09-12T12:13:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.585+0000 7fd1c5000640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1a0067910 0x7fd1a0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.585+0000 7fd1c5000640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1a0067910 0x7fd1a0069dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0ad000 tx=0x7fd1ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:31.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.589+0000 7fd1bd600640 1 -- 172.21.15.144:0/565772553 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd1b4020020 con 0x7fd1c00b5de0 2024-09-12T12:13:31.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.781+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd1c0168100 con 0x7fd1c00b5de0 2024-09-12T12:13:31.783 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:13:31.781+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:13:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1bd600640 1 -- 172.21.15.144:0/565772553 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fd1b40074c0 con 0x7fd1c00b5de0 2024-09-12T12:13:31.785 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:13:31.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1a0067910 msgr2=0x7fd1a0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1a0067910 0x7fd1a0069dd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0ad000 tx=0x7fd1ac008040 comp rx=0 tx=0).stop 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c00b5de0 msgr2=0x7fd1c015ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c00b5de0 0x7fd1c015ab10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400c530 tx=0x7fd1b400c9f0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 shutdown_connections 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1a0067910 0x7fd1a0069dd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1c015cd30 0x7fd1c00aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1c015c7b0 0x7fd1c00ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 --2- 172.21.15.144:0/565772553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1c00b5de0 0x7fd1c015ab10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.785+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 >> 172.21.15.144:0/565772553 conn(0x7fd1c006d0d0 msgr2=0x7fd1c00b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.789+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 shutdown_connections 2024-09-12T12:13:31.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.789+0000 7fd1c8400640 1 -- 172.21.15.144:0/565772553 wait complete. 2024-09-12T12:13:31.798 INFO:tasks.ceph.mds.d.smithi165.stderr: -4561> 2024-09-12T12:12:45.798+0000 7fd8b4c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:13:31.808 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:13:31.850 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:13:31.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.945+0000 7fe95a200640 1 Processor -- start 2024-09-12T12:13:31.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe95a200640 1 -- start start 2024-09-12T12:13:31.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe95a200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe954162b80 0x7fe95415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe95a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9540af0c0 0x7fe95406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe95a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9540ae930 con 0x7fe954072a80 2024-09-12T12:13:31.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe95a200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe9540b6d70 con 0x7fe954162b80 2024-09-12T12:13:31.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe95a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe95415f300 con 0x7fe9540af0c0 2024-09-12T12:13:31.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe953400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe954072a80 0x7fe954072e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39550/0 (socket says 172.21.15.144:39550) 2024-09-12T12:13:31.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe953400640 1 -- 172.21.15.144:0/2146101008 learned_addr learned my addr 172.21.15.144:0/2146101008 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:31.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe953e00640 1 --2- 172.21.15.144:0/2146101008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9540af0c0 0x7fe95406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe952a00640 1 --2- 172.21.15.144:0/2146101008 >> v2:172.21.15.165:3300/0 conn(0x7fe954162b80 0x7fe95415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe952000640 1 -- 172.21.15.144:0/2146101008 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766982673 0 0) 0x7fe9540ae930 con 0x7fe954072a80 2024-09-12T12:13:31.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe953e00640 1 -- 172.21.15.144:0/2146101008 >> v2:172.21.15.165:3300/0 conn(0x7fe954162b80 msgr2=0x7fe95415ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:31.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe953e00640 1 --2- 172.21.15.144:0/2146101008 >> v2:172.21.15.165:3300/0 conn(0x7fe954162b80 0x7fe95415ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe953e00640 1 -- 172.21.15.144:0/2146101008 >> v1:172.21.15.144:6789/0 conn(0x7fe954072a80 legacy=0x7fe954072e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.949+0000 7fe953e00640 1 -- 172.21.15.144:0/2146101008 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95415f5e0 con 0x7fe9540af0c0 2024-09-12T12:13:31.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe953e00640 1 --2- 172.21.15.144:0/2146101008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9540af0c0 0x7fe95406ef50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0097c0 tx=0x7fe94c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1df6f1e0075e070 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:31.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe952000640 1 -- 172.21.15.144:0/2146101008 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0b0070 con 0x7fe9540af0c0 2024-09-12T12:13:31.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe952000640 1 -- 172.21.15.144:0/2146101008 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94c0ab600 con 0x7fe9540af0c0 2024-09-12T12:13:31.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe952000640 1 -- 172.21.15.144:0/2146101008 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0ab9d0 con 0x7fe9540af0c0 2024-09-12T12:13:31.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 -- 172.21.15.144:0/2146101008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9540af0c0 msgr2=0x7fe95406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 --2- 172.21.15.144:0/2146101008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9540af0c0 0x7fe95406ef50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0097c0 tx=0x7fe94c01c410 comp rx=0 tx=0).stop 2024-09-12T12:13:31.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 -- 172.21.15.144:0/2146101008 shutdown_connections 2024-09-12T12:13:31.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 --2- 172.21.15.144:0/2146101008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9540af0c0 0x7fe95406ef50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 --2- 172.21.15.144:0/2146101008 >> v2:172.21.15.165:3300/0 conn(0x7fe954162b80 0x7fe95415ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 -- 172.21.15.144:0/2146101008 >> 172.21.15.144:0/2146101008 conn(0x7fe95406cb10 msgr2=0x7fe95406cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:31.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 -- 172.21.15.144:0/2146101008 shutdown_connections 2024-09-12T12:13:31.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 -- 172.21.15.144:0/2146101008 wait complete. 2024-09-12T12:13:31.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 Processor -- start 2024-09-12T12:13:31.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.953+0000 7fe95a200640 1 -- start start 2024-09-12T12:13:31.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe95a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe954072a80 0x7fe9541558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe95a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9540af0c0 0x7fe954157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe95a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe954162b80 0x7fe95406da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe95a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe95415ef50 con 0x7fe9540af0c0 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe95a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe95416b960 con 0x7fe954162b80 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe95a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe954158890 con 0x7fe954072a80 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe952a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9540af0c0 0x7fe954157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe952a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9540af0c0 0x7fe954157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57284/0 (socket says 172.21.15.144:57284) 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe952a00640 1 -- 172.21.15.144:0/2890748400 learned_addr learned my addr 172.21.15.144:0/2890748400 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe953400640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe954072a80 0x7fe9541558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe953e00640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe954162b80 0x7fe95406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe952a00640 1 -- 172.21.15.144:0/2890748400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe954072a80 msgr2=0x7fe9541558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe952a00640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe954072a80 0x7fe9541558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe952a00640 1 -- 172.21.15.144:0/2890748400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe954162b80 msgr2=0x7fe95406da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:31.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe952a00640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe954162b80 0x7fe95406da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:31.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe952a00640 1 -- 172.21.15.144:0/2890748400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9540cee60 con 0x7fe9540af0c0 2024-09-12T12:13:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe952a00640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9540af0c0 0x7fe954157e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe94000e930 tx=0x7fe94000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe94b400640 1 -- 172.21.15.144:0/2890748400 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940017070 con 0x7fe9540af0c0 2024-09-12T12:13:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe94b400640 1 -- 172.21.15.144:0/2890748400 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe94000ca00 con 0x7fe9540af0c0 2024-09-12T12:13:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9540cf140 con 0x7fe9540af0c0 2024-09-12T12:13:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe94b400640 1 -- 172.21.15.144:0/2890748400 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94000cdb0 con 0x7fe9540af0c0 2024-09-12T12:13:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9541578c0 con 0x7fe9540af0c0 2024-09-12T12:13:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.957+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95406ef50 con 0x7fe9540af0c0 2024-09-12T12:13:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.961+0000 7fe94b400640 1 -- 172.21.15.144:0/2890748400 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe94001a070 con 0x7fe9540af0c0 2024-09-12T12:13:31.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.961+0000 7fe94b400640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9340678c0 0x7fe934069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:31.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.961+0000 7fe94b400640 1 -- 172.21.15.144:0/2890748400 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fe9400864f0 con 0x7fe9540af0c0 2024-09-12T12:13:31.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.961+0000 7fe953400640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9340678c0 0x7fe934069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:31.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.961+0000 7fe953400640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9340678c0 0x7fe934069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9440012f0 tx=0x7fe944001690 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:31.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:31.965+0000 7fe94b400640 1 -- 172.21.15.144:0/2890748400 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9400565a0 con 0x7fe9540af0c0 2024-09-12T12:13:32.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.157+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe9540b6170 con 0x7fe9540af0c0 2024-09-12T12:13:32.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.784+0000 7fe94b400640 1 -- 172.21.15.144:0/2890748400 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fe94005a8a0 con 0x7fe9540af0c0 2024-09-12T12:13:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9340678c0 msgr2=0x7fe934069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9340678c0 0x7fe934069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9440012f0 tx=0x7fe944001690 comp rx=0 tx=0).stop 2024-09-12T12:13:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9540af0c0 msgr2=0x7fe954157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9540af0c0 0x7fe954157e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe94000e930 tx=0x7fe94000edf0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 shutdown_connections 2024-09-12T12:13:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9340678c0 0x7fe934069d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe954162b80 0x7fe95406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9540af0c0 0x7fe954157e10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 --2- 172.21.15.144:0/2890748400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe954072a80 0x7fe9541558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 >> 172.21.15.144:0/2890748400 conn(0x7fe95406cb10 msgr2=0x7fe95406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:32.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 shutdown_connections 2024-09-12T12:13:32.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.788+0000 7fe95a200640 1 -- 172.21.15.144:0/2890748400 wait complete. 2024-09-12T12:13:32.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:13:32.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed1d200640 1 Processor -- start 2024-09-12T12:13:32.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed1d200640 1 -- start start 2024-09-12T12:13:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed1d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fed18156d30 0x7fed18072220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed1d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1806cff0 0x7fed1806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed1d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed180733d0 0x7fed18073880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed1d200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fed1806d990 con 0x7fed180733d0 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed1d200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fed18071210 con 0x7fed18156d30 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed1d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed18072760 con 0x7fed1806cff0 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed16800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed180733d0 0x7fed18073880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed16800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed180733d0 0x7fed18073880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57296/0 (socket says 172.21.15.144:57296) 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed16800640 1 -- 172.21.15.144:0/3006058640 learned_addr learned my addr 172.21.15.144:0/3006058640 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed15400640 1 --2- 172.21.15.144:0/3006058640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1806cff0 0x7fed1806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.952+0000 7fed15e00640 1 --2- 172.21.15.144:0/3006058640 >> v2:172.21.15.165:3300/0 conn(0x7fed18156d30 0x7fed18072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed16800640 1 -- 172.21.15.144:0/3006058640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1806cff0 msgr2=0x7fed1806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed16800640 1 --2- 172.21.15.144:0/3006058640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1806cff0 0x7fed1806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed16800640 1 -- 172.21.15.144:0/3006058640 >> v2:172.21.15.165:3300/0 conn(0x7fed18156d30 msgr2=0x7fed18072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed16800640 1 --2- 172.21.15.144:0/3006058640 >> v2:172.21.15.165:3300/0 conn(0x7fed18156d30 0x7fed18072220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed16800640 1 -- 172.21.15.144:0/3006058640 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1806cd20 con 0x7fed180733d0 2024-09-12T12:13:32.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed15e00640 1 --2- 172.21.15.144:0/3006058640 >> v2:172.21.15.165:3300/0 conn(0x7fed18156d30 0x7fed18072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:32.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed16800640 1 --2- 172.21.15.144:0/3006058640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed180733d0 0x7fed18073880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed180b5b20 tx=0x7fed1001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfa57bc1143e4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:32.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed14a00640 1 -- 172.21.15.144:0/3006058640 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed100b1070 con 0x7fed180733d0 2024-09-12T12:13:32.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed14a00640 1 -- 172.21.15.144:0/3006058640 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed100ac630 con 0x7fed180733d0 2024-09-12T12:13:32.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed14a00640 1 -- 172.21.15.144:0/3006058640 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed100a8050 con 0x7fed180733d0 2024-09-12T12:13:32.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed1d200640 1 -- 172.21.15.144:0/3006058640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed180733d0 msgr2=0x7fed18073880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:32.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed1d200640 1 --2- 172.21.15.144:0/3006058640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed180733d0 0x7fed18073880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fed180b5b20 tx=0x7fed1001c520 comp rx=0 tx=0).stop 2024-09-12T12:13:32.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed1d200640 1 -- 172.21.15.144:0/3006058640 shutdown_connections 2024-09-12T12:13:32.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed1d200640 1 --2- 172.21.15.144:0/3006058640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed180733d0 0x7fed18073880 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed1d200640 1 --2- 172.21.15.144:0/3006058640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1806cff0 0x7fed1806d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed1d200640 1 --2- 172.21.15.144:0/3006058640 >> v2:172.21.15.165:3300/0 conn(0x7fed18156d30 0x7fed18072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed1d200640 1 -- 172.21.15.144:0/3006058640 >> 172.21.15.144:0/3006058640 conn(0x7fed1806bc10 msgr2=0x7fed1806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:32.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed1d200640 1 -- 172.21.15.144:0/3006058640 shutdown_connections 2024-09-12T12:13:32.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.956+0000 7fed1d200640 1 -- 172.21.15.144:0/3006058640 wait complete. 2024-09-12T12:13:32.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 Processor -- start 2024-09-12T12:13:32.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 -- start start 2024-09-12T12:13:32.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1806cff0 0x7fed18157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:32.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed180733d0 0x7fed1813e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:32.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed18156d30 0x7fed1815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fed18157110 con 0x7fed1806cff0 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed18071d00 con 0x7fed180733d0 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed18073dc0 con 0x7fed18156d30 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1806cff0 0x7fed18157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1806cff0 0x7fed18157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57310/0 (socket says 172.21.15.144:57310) 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15e00640 1 -- 172.21.15.144:0/364043202 learned_addr learned my addr 172.21.15.144:0/364043202 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed16800640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed18156d30 0x7fed1815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15400640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed180733d0 0x7fed1813e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15e00640 1 -- 172.21.15.144:0/364043202 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed18156d30 msgr2=0x7fed1815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15e00640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed18156d30 0x7fed1815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15e00640 1 -- 172.21.15.144:0/364043202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed180733d0 msgr2=0x7fed1813e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15e00640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed180733d0 0x7fed1813e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:32.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15e00640 1 -- 172.21.15.144:0/364043202 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed18158ae0 con 0x7fed1806cff0 2024-09-12T12:13:32.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed15e00640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1806cff0 0x7fed18157ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed08007ef0 tx=0x7fed0800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:32.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed0e000640 1 -- 172.21.15.144:0/364043202 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0801a070 con 0x7fed1806cff0 2024-09-12T12:13:32.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed0e000640 1 -- 172.21.15.144:0/364043202 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed08003ba0 con 0x7fed1806cff0 2024-09-12T12:13:32.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed0e000640 1 -- 172.21.15.144:0/364043202 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08004030 con 0x7fed1806cff0 2024-09-12T12:13:32.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed18158dc0 con 0x7fed1806cff0 2024-09-12T12:13:32.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.960+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed18159380 con 0x7fed1806cff0 2024-09-12T12:13:32.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.964+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed18073880 con 0x7fed1806cff0 2024-09-12T12:13:32.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.964+0000 7fed0e000640 1 -- 172.21.15.144:0/364043202 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed0801d070 con 0x7fed1806cff0 2024-09-12T12:13:32.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.964+0000 7fed0e000640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecf80678c0 0x7fecf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:32.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.964+0000 7fed0e000640 1 -- 172.21.15.144:0/364043202 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fed08086390 con 0x7fed1806cff0 2024-09-12T12:13:32.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.964+0000 7fed15400640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecf80678c0 0x7fecf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:32.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.964+0000 7fed15400640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecf80678c0 0x7fecf8069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed1815d660 tx=0x7fed04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:32.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:32.968+0000 7fed0e000640 1 -- 172.21.15.144:0/364043202 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed08010070 con 0x7fed1806cff0 2024-09-12T12:13:33.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.128+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fed1806dd80 con 0x7fed1806cff0 2024-09-12T12:13:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.788+0000 7fed0e000640 1 -- 172.21.15.144:0/364043202 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fed08056380 con 0x7fed1806cff0 2024-09-12T12:13:33.792 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:13:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecf80678c0 msgr2=0x7fecf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecf80678c0 0x7fecf8069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed1815d660 tx=0x7fed04008040 comp rx=0 tx=0).stop 2024-09-12T12:13:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1806cff0 msgr2=0x7fed18157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1806cff0 0x7fed18157ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed08007ef0 tx=0x7fed0800d4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 shutdown_connections 2024-09-12T12:13:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecf80678c0 0x7fecf8069d80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed18156d30 0x7fed1815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed180733d0 0x7fed1813e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 --2- 172.21.15.144:0/364043202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1806cff0 0x7fed18157ca0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 >> 172.21.15.144:0/364043202 conn(0x7fed1806bc10 msgr2=0x7fed18160250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 shutdown_connections 2024-09-12T12:13:33.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.792+0000 7fed1d200640 1 -- 172.21.15.144:0/364043202 wait complete. 2024-09-12T12:13:33.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:13:33.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.960+0000 7f3b85600640 1 Processor -- start 2024-09-12T12:13:33.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.960+0000 7f3b85600640 1 -- start start 2024-09-12T12:13:33.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b85600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3b800b3490 0x7f3b800b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:33.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b85600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8006cd20 con 0x7f3b8006d250 2024-09-12T12:13:33.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b85600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b800b4f30 con 0x7f3b8006d630 2024-09-12T12:13:33.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b85600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3b80072620 con 0x7f3b800b3490 2024-09-12T12:13:33.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3b8006d250 0x7f3b8015c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39566/0 (socket says 172.21.15.144:39566) 2024-09-12T12:13:33.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7ea00640 1 -- 172.21.15.144:0/2114108563 learned_addr learned my addr 172.21.15.144:0/2114108563 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7e000640 1 --2- 172.21.15.144:0/2114108563 >> v2:172.21.15.165:3300/0 conn(0x7f3b800b3490 0x7f3b800b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879529680 0 0) 0x7f3b8006cd20 con 0x7f3b8006d250 2024-09-12T12:13:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b64005740 con 0x7f3b8006d250 2024-09-12T12:13:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1909585105 0 0) 0x7f3b64005740 con 0x7f3b8006d250 2024-09-12T12:13:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 >> v2:172.21.15.165:3300/0 conn(0x7f3b800b3490 msgr2=0x7f3b800b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 --2- 172.21.15.144:0/2114108563 >> v2:172.21.15.165:3300/0 conn(0x7f3b800b3490 0x7f3b800b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 >> v1:172.21.15.165:6789/0 conn(0x7f3b8006d630 legacy=0x7f3b80155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b800b3950 con 0x7f3b8006d250 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f3b70001a00 con 0x7f3b8006d250 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 >> v1:172.21.15.144:6789/0 conn(0x7f3b8006d250 legacy=0x7f3b8015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b64005bd0 0x7f3b64005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b64006a20 0x7f3b64006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b640073e0 0x7f3b6400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b80072620 con 0x7f3b64005bd0 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6400e280 con 0x7f3b64006a20 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3b6400e480 con 0x7f3b640073e0 2024-09-12T12:13:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7ea00640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b64005bd0 0x7f3b64005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7e000640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b64006a20 0x7f3b64006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7f400640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b640073e0 0x7f3b6400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7ea00640 1 -- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b640073e0 msgr2=0x7f3b6400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7ea00640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b640073e0 0x7f3b6400dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7ea00640 1 -- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b64006a20 msgr2=0x7f3b64006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7ea00640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b64006a20 0x7f3b64006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7ea00640 1 -- 172.21.15.144:0/2114108563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b64005740 con 0x7f3b64005bd0 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7f400640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b640073e0 0x7f3b6400dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7e000640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b64006a20 0x7f3b64006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.964+0000 7f3b7f400640 1 -- 172.21.15.144:0/2114108563 reap_dead start 2024-09-12T12:13:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b7ea00640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b64005bd0 0x7f3b64005ff0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000a830 tx=0x7f3b7001d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1664b9ca04306b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000a480 con 0x7f3b64005bd0 2024-09-12T12:13:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b700ad650 con 0x7f3b64005bd0 2024-09-12T12:13:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b7d600640 1 -- 172.21.15.144:0/2114108563 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b700ada40 con 0x7f3b64005bd0 2024-09-12T12:13:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b85600640 1 -- 172.21.15.144:0/2114108563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b64005bd0 msgr2=0x7f3b64005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b85600640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b64005bd0 0x7f3b64005ff0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000a830 tx=0x7f3b7001d330 comp rx=0 tx=0).stop 2024-09-12T12:13:33.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b85600640 1 -- 172.21.15.144:0/2114108563 shutdown_connections 2024-09-12T12:13:33.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b85600640 1 --2- 172.21.15.144:0/2114108563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b64005bd0 0x7f3b64005ff0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b85600640 1 -- 172.21.15.144:0/2114108563 >> 172.21.15.144:0/2114108563 conn(0x7f3b8006bc10 msgr2=0x7f3b8006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:33.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b85600640 1 -- 172.21.15.144:0/2114108563 shutdown_connections 2024-09-12T12:13:33.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b85600640 1 -- 172.21.15.144:0/2114108563 wait complete. 2024-09-12T12:13:33.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b85600640 1 Processor -- start 2024-09-12T12:13:33.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.968+0000 7f3b85600640 1 -- start start 2024-09-12T12:13:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b85600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b64005bd0 0x7f3b8015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b85600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8014e220 0x7f3b800ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b85600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b8014d680 0x7f3b8014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b85600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8015cb50 con 0x7f3b8014e220 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b85600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b800b44d0 con 0x7f3b8014d680 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b85600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8014e040 con 0x7f3b64005bd0 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8014e220 0x7f3b800ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8014e220 0x7f3b800ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57320/0 (socket says 172.21.15.144:57320) 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7e000640 1 -- 172.21.15.144:0/3509155229 learned_addr learned my addr 172.21.15.144:0/3509155229 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7ea00640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b64005bd0 0x7f3b8015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7f400640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b8014d680 0x7f3b8014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7e000640 1 -- 172.21.15.144:0/3509155229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b64005bd0 msgr2=0x7f3b8015ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7e000640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b64005bd0 0x7f3b8015ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7e000640 1 -- 172.21.15.144:0/3509155229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b8014d680 msgr2=0x7f3b8014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:33.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7e000640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b8014d680 0x7f3b8014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:33.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7e000640 1 -- 172.21.15.144:0/3509155229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b80157d90 con 0x7f3b8014e220 2024-09-12T12:13:33.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7ea00640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b64005bd0 0x7f3b8015ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:33.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b7e000640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8014e220 0x7f3b800ca840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c011cd0 tx=0x7f3b6c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:33.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b76a00640 1 -- 172.21.15.144:0/3509155229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c011e80 con 0x7f3b8014e220 2024-09-12T12:13:33.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b76a00640 1 -- 172.21.15.144:0/3509155229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b6c004020 con 0x7f3b8014e220 2024-09-12T12:13:33.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b76a00640 1 -- 172.21.15.144:0/3509155229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0043f0 con 0x7f3b8014e220 2024-09-12T12:13:33.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8015de50 con 0x7f3b8014e220 2024-09-12T12:13:33.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8015d890 con 0x7f3b8014e220 2024-09-12T12:13:33.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.972+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b80156030 con 0x7f3b8014e220 2024-09-12T12:13:33.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.976+0000 7f3b76a00640 1 -- 172.21.15.144:0/3509155229 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3b6c012040 con 0x7f3b8014e220 2024-09-12T12:13:33.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.976+0000 7f3b76a00640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b600678f0 0x7f3b60069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:33.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.976+0000 7f3b76a00640 1 -- 172.21.15.144:0/3509155229 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7f3b6c0863b0 con 0x7f3b8014e220 2024-09-12T12:13:33.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.976+0000 7f3b7ea00640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b600678f0 0x7f3b60069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:33.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.976+0000 7f3b7ea00640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b600678f0 0x7f3b60069db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3b700ad000 tx=0x7f3b70007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:33.980+0000 7f3b76a00640 1 -- 172.21.15.144:0/3509155229 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3b6c019030 con 0x7f3b8014e220 2024-09-12T12:13:34.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.136+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3b80072f10 con 0x7f3b8014e220 2024-09-12T12:13:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.792+0000 7f3b76a00640 1 -- 172.21.15.144:0/3509155229 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f3b6c056c50 con 0x7f3b8014e220 2024-09-12T12:13:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:13:34.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b600678f0 msgr2=0x7f3b60069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b600678f0 0x7f3b60069db0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3b700ad000 tx=0x7f3b70007040 comp rx=0 tx=0).stop 2024-09-12T12:13:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8014e220 msgr2=0x7f3b800ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8014e220 0x7f3b800ca840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c011cd0 tx=0x7f3b6c00f610 comp rx=0 tx=0).stop 2024-09-12T12:13:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 shutdown_connections 2024-09-12T12:13:34.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b600678f0 0x7f3b60069db0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b8014d680 0x7f3b8014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8014e220 0x7f3b800ca840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 --2- 172.21.15.144:0/3509155229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b64005bd0 0x7f3b8015ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 >> 172.21.15.144:0/3509155229 conn(0x7f3b8006bc10 msgr2=0x7f3b80075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 shutdown_connections 2024-09-12T12:13:34.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.800+0000 7f3b85600640 1 -- 172.21.15.144:0/3509155229 wait complete. 2024-09-12T12:13:34.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T12:13:34.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.960+0000 7f688e600640 1 Processor -- start 2024-09-12T12:13:34.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.960+0000 7f688e600640 1 -- start start 2024-09-12T12:13:34.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f688e600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6888156c10 0x7f6888072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:34.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f688e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888073a70 0x7f688806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:34.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f688e600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688806cd20 con 0x7f688806cff0 2024-09-12T12:13:34.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f688e600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f688806d990 con 0x7f6888156c10 2024-09-12T12:13:34.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f688e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6888071be0 con 0x7f6888073a70 2024-09-12T12:13:34.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6887e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888073a70 0x7f688806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:34.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6887400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6888156c10 0x7f6888072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:34.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6886a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f688806cff0 0x7f6888073360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:38124/0 (socket says 172.21.15.144:38124) 2024-09-12T12:13:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6886a00640 1 -- 172.21.15.144:0/895114986 learned_addr learned my addr 172.21.15.144:0/895114986 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6887e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888073a70 0x7f688806d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60150/0 (socket says 172.21.15.144:60150) 2024-09-12T12:13:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6887e00640 1 -- 172.21.15.144:0/895114986 >> v2:172.21.15.165:3300/0 conn(0x7f6888156c10 msgr2=0x7f6888072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6887e00640 1 --2- 172.21.15.144:0/895114986 >> v2:172.21.15.165:3300/0 conn(0x7f6888156c10 0x7f6888072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6887e00640 1 -- 172.21.15.144:0/895114986 >> v1:172.21.15.165:6789/0 conn(0x7f688806cff0 legacy=0x7f6888073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6886000640 1 -- 172.21.15.144:0/895114986 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579488363 0 0) 0x7f688806cd20 con 0x7f688806cff0 2024-09-12T12:13:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.964+0000 7f6887e00640 1 -- 172.21.15.144:0/895114986 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68880712b0 con 0x7f6888073a70 2024-09-12T12:13:34.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f6887e00640 1 --2- 172.21.15.144:0/895114986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888073a70 0x7f688806d450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6880009d90 tx=0x7f688001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=421ab9c548cacc59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:34.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f6886000640 1 -- 172.21.15.144:0/895114986 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68800b2070 con 0x7f6888073a70 2024-09-12T12:13:34.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f6886000640 1 -- 172.21.15.144:0/895114986 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68800a5a30 con 0x7f6888073a70 2024-09-12T12:13:34.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f6886000640 1 -- 172.21.15.144:0/895114986 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68800a5e00 con 0x7f6888073a70 2024-09-12T12:13:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 -- 172.21.15.144:0/895114986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888073a70 msgr2=0x7f688806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 --2- 172.21.15.144:0/895114986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888073a70 0x7f688806d450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6880009d90 tx=0x7f688001c970 comp rx=0 tx=0).stop 2024-09-12T12:13:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 -- 172.21.15.144:0/895114986 shutdown_connections 2024-09-12T12:13:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 --2- 172.21.15.144:0/895114986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888073a70 0x7f688806d450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 --2- 172.21.15.144:0/895114986 >> v2:172.21.15.165:3300/0 conn(0x7f6888156c10 0x7f6888072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 -- 172.21.15.144:0/895114986 >> 172.21.15.144:0/895114986 conn(0x7f688806bc10 msgr2=0x7f688806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:34.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 -- 172.21.15.144:0/895114986 shutdown_connections 2024-09-12T12:13:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 -- 172.21.15.144:0/895114986 wait complete. 2024-09-12T12:13:34.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 Processor -- start 2024-09-12T12:13:34.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.968+0000 7f688e600640 1 -- start start 2024-09-12T12:13:34.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f688e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f688806cff0 0x7f6888142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:34.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f688e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6888073a70 0x7f688814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f688e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888156c10 0x7f688815ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f688e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6888157170 con 0x7f688806cff0 2024-09-12T12:13:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f688e600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6888156ff0 con 0x7f6888073a70 2024-09-12T12:13:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f688e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f68880725b0 con 0x7f6888156c10 2024-09-12T12:13:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f688806cff0 0x7f6888142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f688806cff0 0x7f6888142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57324/0 (socket says 172.21.15.144:57324) 2024-09-12T12:13:34.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887400640 1 -- 172.21.15.144:0/1856501181 learned_addr learned my addr 172.21.15.144:0/1856501181 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6886a00640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6888073a70 0x7f688814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887e00640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888156c10 0x7f688815ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887400640 1 -- 172.21.15.144:0/1856501181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888156c10 msgr2=0x7f688815ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887400640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888156c10 0x7f688815ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887400640 1 -- 172.21.15.144:0/1856501181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6888073a70 msgr2=0x7f688814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887400640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6888073a70 0x7f688814a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887400640 1 -- 172.21.15.144:0/1856501181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688814b180 con 0x7f688806cff0 2024-09-12T12:13:34.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887e00640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888156c10 0x7f688815ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f6887400640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f688806cff0 0x7f6888142f40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f687800e930 tx=0x7f687800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f687f400640 1 -- 172.21.15.144:0/1856501181 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878017070 con 0x7f688806cff0 2024-09-12T12:13:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f687f400640 1 -- 172.21.15.144:0/1856501181 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687800ca00 con 0x7f688806cff0 2024-09-12T12:13:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f687f400640 1 -- 172.21.15.144:0/1856501181 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687800cdb0 con 0x7f688806cff0 2024-09-12T12:13:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688814b460 con 0x7f688806cff0 2024-09-12T12:13:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688814ba20 con 0x7f688806cff0 2024-09-12T12:13:34.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688814be50 con 0x7f688806cff0 2024-09-12T12:13:34.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.972+0000 7f687f400640 1 -- 172.21.15.144:0/1856501181 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f687801a070 con 0x7f688806cff0 2024-09-12T12:13:34.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.976+0000 7f687f400640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68680678c0 0x7f6868069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:34.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.976+0000 7f687f400640 1 -- 172.21.15.144:0/1856501181 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f6878086080 con 0x7f688806cff0 2024-09-12T12:13:34.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.976+0000 7f6886a00640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68680678c0 0x7f6868069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:34.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.976+0000 7f6886a00640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68680678c0 0x7f6868069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f68880d0cd0 tx=0x7f6874009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:34.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:34.980+0000 7f687f400640 1 -- 172.21.15.144:0/1856501181 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f68780565a0 con 0x7f688806cff0 2024-09-12T12:13:35.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.148+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f688806dd80 con 0x7f688806cff0 2024-09-12T12:13:35.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.812+0000 7f687f400640 1 -- 172.21.15.144:0/1856501181 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f687805a8a0 con 0x7f688806cff0 2024-09-12T12:13:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data_ec' removed 2024-09-12T12:13:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68680678c0 msgr2=0x7f6868069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68680678c0 0x7f6868069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f68880d0cd0 tx=0x7f6874009040 comp rx=0 tx=0).stop 2024-09-12T12:13:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f688806cff0 msgr2=0x7f6888142f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f688806cff0 0x7f6888142f40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f687800e930 tx=0x7f687800edf0 comp rx=0 tx=0).stop 2024-09-12T12:13:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 shutdown_connections 2024-09-12T12:13:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68680678c0 0x7f6868069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6888156c10 0x7f688815ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6888073a70 0x7f688814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 --2- 172.21.15.144:0/1856501181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f688806cff0 0x7f6888142f40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 >> 172.21.15.144:0/1856501181 conn(0x7f688806bc10 msgr2=0x7f688806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 shutdown_connections 2024-09-12T12:13:35.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:35.816+0000 7f688e600640 1 -- 172.21.15.144:0/1856501181 wait complete. 2024-09-12T12:13:35.841 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:13:35.841 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:13:35.841 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:13:35.841 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:13:35.842 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:13:35.842 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:13:35.842 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:13:35.842 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:13:35.842 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:13:35.842 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:13:35.842 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:13:35.843 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:13:35.843 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:13:35.843 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:13:35.843 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:13:35.843 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:13:35.857 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:13:35.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:13:35.858 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:13:35.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:13:35.859 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:13:35.860 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:13:35.860 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:13:35.861 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:13:35.903 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:13:35.904 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:35.908 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:13:35.909 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:35.910 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:13:35.910 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:35.911 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:13:35.911 DEBUG:teuthology.parallel:result is None 2024-09-12T12:13:35.911 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:13:35.997 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:13:35.999 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:13:35.999 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:13:35.999 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:13:36.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf2e000640 1 Processor -- start 2024-09-12T12:13:36.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf2e000640 1 -- start start 2024-09-12T12:13:36.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf2e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf2815c7b0 0x7faf280ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf2e000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7faf2815cd30 0x7faf280b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf2e000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf280b5de0 0x7faf281601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf2e000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faf280b6230 con 0x7faf2815c7b0 2024-09-12T12:13:36.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf2e000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7faf28072a50 con 0x7faf2815cd30 2024-09-12T12:13:36.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf2e000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf280cde30 con 0x7faf280b5de0 2024-09-12T12:13:36.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf27400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf2815c7b0 0x7faf280ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf27400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf2815c7b0 0x7faf280ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57354/0 (socket says 172.21.15.144:57354) 2024-09-12T12:13:36.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf27400640 1 -- 172.21.15.144:0/4139323761 learned_addr learned my addr 172.21.15.144:0/4139323761 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:36.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf27400640 1 -- 172.21.15.144:0/4139323761 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf280b5de0 msgr2=0x7faf281601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:36.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf27400640 1 --2- 172.21.15.144:0/4139323761 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf280b5de0 0x7faf281601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf27400640 1 -- 172.21.15.144:0/4139323761 >> v2:172.21.15.165:3300/0 conn(0x7faf2815cd30 msgr2=0x7faf280b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:36.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf27400640 1 --2- 172.21.15.144:0/4139323761 >> v2:172.21.15.165:3300/0 conn(0x7faf2815cd30 0x7faf280b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.060+0000 7faf27400640 1 -- 172.21.15.144:0/4139323761 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf280cd870 con 0x7faf2815c7b0 2024-09-12T12:13:36.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf27400640 1 --2- 172.21.15.144:0/4139323761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf2815c7b0 0x7faf280ccf00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faf280afd90 tx=0x7faf1801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f00cdb71f822810 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:36.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf26a00640 1 -- 172.21.15.144:0/4139323761 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf180b0070 con 0x7faf2815c7b0 2024-09-12T12:13:36.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf26a00640 1 -- 172.21.15.144:0/4139323761 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf180ab600 con 0x7faf2815c7b0 2024-09-12T12:13:36.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf26a00640 1 -- 172.21.15.144:0/4139323761 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf180ab9d0 con 0x7faf2815c7b0 2024-09-12T12:13:36.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 -- 172.21.15.144:0/4139323761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf2815c7b0 msgr2=0x7faf280ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:36.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 --2- 172.21.15.144:0/4139323761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf2815c7b0 0x7faf280ccf00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faf280afd90 tx=0x7faf1801c260 comp rx=0 tx=0).stop 2024-09-12T12:13:36.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 -- 172.21.15.144:0/4139323761 shutdown_connections 2024-09-12T12:13:36.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 --2- 172.21.15.144:0/4139323761 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf280b5de0 0x7faf281601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 --2- 172.21.15.144:0/4139323761 >> v2:172.21.15.165:3300/0 conn(0x7faf2815cd30 0x7faf280b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 --2- 172.21.15.144:0/4139323761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf2815c7b0 0x7faf280ccf00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 -- 172.21.15.144:0/4139323761 >> 172.21.15.144:0/4139323761 conn(0x7faf2806d0d0 msgr2=0x7faf2806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:36.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 -- 172.21.15.144:0/4139323761 shutdown_connections 2024-09-12T12:13:36.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 -- 172.21.15.144:0/4139323761 wait complete. 2024-09-12T12:13:36.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 Processor -- start 2024-09-12T12:13:36.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.064+0000 7faf2e000640 1 -- start start 2024-09-12T12:13:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf2e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf280b5de0 0x7faf280cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf2e000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf2815c7b0 0x7faf280d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf2e000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf2815cd30 0x7faf28140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf2e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faf28072ee0 con 0x7faf280b5de0 2024-09-12T12:13:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf2e000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faf280cd650 con 0x7faf2815c7b0 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf2e000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf28073060 con 0x7faf2815cd30 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf280b5de0 0x7faf280cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf280b5de0 0x7faf280cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57362/0 (socket says 172.21.15.144:57362) 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27400640 1 -- 172.21.15.144:0/2217701742 learned_addr learned my addr 172.21.15.144:0/2217701742 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf1fe00640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf2815c7b0 0x7faf280d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27e00640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf2815cd30 0x7faf28140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27400640 1 -- 172.21.15.144:0/2217701742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf2815cd30 msgr2=0x7faf28140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27400640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf2815cd30 0x7faf28140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27400640 1 -- 172.21.15.144:0/2217701742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf2815c7b0 msgr2=0x7faf280d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27400640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf2815c7b0 0x7faf280d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27400640 1 -- 172.21.15.144:0/2217701742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf280cf360 con 0x7faf280b5de0 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27e00640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf2815cd30 0x7faf28140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf27400640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf280b5de0 0x7faf280cea60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf180ae040 tx=0x7faf1801aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf1f400640 1 -- 172.21.15.144:0/2217701742 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf180ba020 con 0x7faf280b5de0 2024-09-12T12:13:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf1f400640 1 -- 172.21.15.144:0/2217701742 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf180b6640 con 0x7faf280b5de0 2024-09-12T12:13:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf280cf640 con 0x7faf280b5de0 2024-09-12T12:13:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf1f400640 1 -- 172.21.15.144:0/2217701742 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf180b0040 con 0x7faf280b5de0 2024-09-12T12:13:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf280cfc00 con 0x7faf280b5de0 2024-09-12T12:13:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf280ccf00 con 0x7faf280b5de0 2024-09-12T12:13:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.068+0000 7faf1f400640 1 -- 172.21.15.144:0/2217701742 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf180bd020 con 0x7faf280b5de0 2024-09-12T12:13:36.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.072+0000 7faf1f400640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf040678f0 0x7faf04069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.072+0000 7faf1f400640 1 -- 172.21.15.144:0/2217701742 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7faf1811ff90 con 0x7faf280b5de0 2024-09-12T12:13:36.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.072+0000 7faf1fe00640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf040678f0 0x7faf04069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.072+0000 7faf1fe00640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf040678f0 0x7faf04069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faf10006fd0 tx=0x7faf10008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:36.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.076+0000 7faf1f400640 1 -- 172.21.15.144:0/2217701742 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf180c4030 con 0x7faf280b5de0 2024-09-12T12:13:36.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.244+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7faf2815de90 con 0x7faf280b5de0 2024-09-12T12:13:36.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.824+0000 7faf1f400640 1 -- 172.21.15.144:0/2217701742 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7faf18016110 con 0x7faf280b5de0 2024-09-12T12:13:36.826 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:13:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf040678f0 msgr2=0x7faf04069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf040678f0 0x7faf04069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faf10006fd0 tx=0x7faf10008040 comp rx=0 tx=0).stop 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf280b5de0 msgr2=0x7faf280cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf280b5de0 0x7faf280cea60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf180ae040 tx=0x7faf1801aaa0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 shutdown_connections 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf040678f0 0x7faf04069db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf2815cd30 0x7faf28140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf2815c7b0 0x7faf280d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 --2- 172.21.15.144:0/2217701742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf280b5de0 0x7faf280cea60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 >> 172.21.15.144:0/2217701742 conn(0x7faf2806d0d0 msgr2=0x7faf28153160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 shutdown_connections 2024-09-12T12:13:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.828+0000 7faf2e000640 1 -- 172.21.15.144:0/2217701742 wait complete. 2024-09-12T12:13:36.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:13:36.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.984+0000 7f890de00640 1 Processor -- start 2024-09-12T12:13:36.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.984+0000 7f890de00640 1 -- start start 2024-09-12T12:13:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.984+0000 7f890de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815c7b0 0x7f89080ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f890de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f890815cd30 0x7f89080b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f890de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f89080b5de0 0x7f89081601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f890de00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8908072a50 con 0x7f890815cd30 2024-09-12T12:13:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f890de00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f89080cde30 con 0x7f89080b5de0 2024-09-12T12:13:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f890de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89080b6210 con 0x7f890815c7b0 2024-09-12T12:13:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f88fe000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f890815cd30 0x7f89080b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f88fe000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f890815cd30 0x7f89080b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57364/0 (socket says 172.21.15.144:57364) 2024-09-12T12:13:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f88fe000640 1 -- 172.21.15.144:0/2047807018 learned_addr learned my addr 172.21.15.144:0/2047807018 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f8906a00640 1 --2- 172.21.15.144:0/2047807018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815c7b0 0x7f89080ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f8907400640 1 --2- 172.21.15.144:0/2047807018 >> v2:172.21.15.165:3300/0 conn(0x7f89080b5de0 0x7f89081601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f88fe000640 1 -- 172.21.15.144:0/2047807018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815c7b0 msgr2=0x7f89080ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f88fe000640 1 --2- 172.21.15.144:0/2047807018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815c7b0 0x7f89080ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f88fe000640 1 -- 172.21.15.144:0/2047807018 >> v2:172.21.15.165:3300/0 conn(0x7f89080b5de0 msgr2=0x7f89081601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f88fe000640 1 --2- 172.21.15.144:0/2047807018 >> v2:172.21.15.165:3300/0 conn(0x7f89080b5de0 0x7f89081601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f88fe000640 1 -- 172.21.15.144:0/2047807018 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89080cd870 con 0x7f890815cd30 2024-09-12T12:13:36.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f88fe000640 1 --2- 172.21.15.144:0/2047807018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815cd30 0x7f89080b58a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f89080ce230 tx=0x7f88f001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb404aede724c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:36.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.988+0000 7f8906000640 1 -- 172.21.15.144:0/2047807018 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f00b0070 con 0x7f890815cd30 2024-09-12T12:13:36.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f8906000640 1 -- 172.21.15.144:0/2047807018 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f00ab600 con 0x7f890815cd30 2024-09-12T12:13:36.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f8906000640 1 -- 172.21.15.144:0/2047807018 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f00ab9d0 con 0x7f890815cd30 2024-09-12T12:13:36.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 -- 172.21.15.144:0/2047807018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815cd30 msgr2=0x7f89080b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:36.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 --2- 172.21.15.144:0/2047807018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815cd30 0x7f89080b58a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f89080ce230 tx=0x7f88f001c260 comp rx=0 tx=0).stop 2024-09-12T12:13:36.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 -- 172.21.15.144:0/2047807018 shutdown_connections 2024-09-12T12:13:36.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 --2- 172.21.15.144:0/2047807018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815cd30 0x7f89080b58a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 --2- 172.21.15.144:0/2047807018 >> v2:172.21.15.165:3300/0 conn(0x7f89080b5de0 0x7f89081601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 --2- 172.21.15.144:0/2047807018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815c7b0 0x7f89080ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 -- 172.21.15.144:0/2047807018 >> 172.21.15.144:0/2047807018 conn(0x7f890806d0d0 msgr2=0x7f890806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 -- 172.21.15.144:0/2047807018 shutdown_connections 2024-09-12T12:13:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 -- 172.21.15.144:0/2047807018 wait complete. 2024-09-12T12:13:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 Processor -- start 2024-09-12T12:13:36.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 -- start start 2024-09-12T12:13:36.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89080b5de0 0x7f8908154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815c7b0 0x7f89081fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815cd30 0x7f890815b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8908072ec0 con 0x7f890815c7b0 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f89080cd650 con 0x7f89080b5de0 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f890de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8908073040 con 0x7f890815cd30 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f88fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815c7b0 0x7f89081fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f88fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815c7b0 0x7f89081fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57380/0 (socket says 172.21.15.144:57380) 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f88fe000640 1 -- 172.21.15.144:0/253251822 learned_addr learned my addr 172.21.15.144:0/253251822 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f8906a00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89080b5de0 0x7f8908154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f8907400640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815cd30 0x7f890815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f88fe000640 1 -- 172.21.15.144:0/253251822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815cd30 msgr2=0x7f890815b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f88fe000640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815cd30 0x7f890815b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f88fe000640 1 -- 172.21.15.144:0/253251822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89080b5de0 msgr2=0x7f8908154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f88fe000640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89080b5de0 0x7f8908154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:36.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.992+0000 7f88fe000640 1 -- 172.21.15.144:0/253251822 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8908166320 con 0x7f890815c7b0 2024-09-12T12:13:36.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f88fe000640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815c7b0 0x7f89081fad80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f88f001a910 tx=0x7f88f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:36.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f88ffe00640 1 -- 172.21.15.144:0/253251822 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f00ba070 con 0x7f890815c7b0 2024-09-12T12:13:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f88ffe00640 1 -- 172.21.15.144:0/253251822 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f00b4620 con 0x7f890815c7b0 2024-09-12T12:13:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f88ffe00640 1 -- 172.21.15.144:0/253251822 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f00b0040 con 0x7f890815c7b0 2024-09-12T12:13:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8908164240 con 0x7f890815c7b0 2024-09-12T12:13:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8908164800 con 0x7f890815c7b0 2024-09-12T12:13:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89080ccf00 con 0x7f890815c7b0 2024-09-12T12:13:36.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f88ffe00640 1 -- 172.21.15.144:0/253251822 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88f00ab4c0 con 0x7f890815c7b0 2024-09-12T12:13:37.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f88ffe00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88e40678c0 0x7f88e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f88ffe00640 1 -- 172.21.15.144:0/253251822 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f88f011ed70 con 0x7f890815c7b0 2024-09-12T12:13:37.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:36.996+0000 7f8906a00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88e40678c0 0x7f88e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.000+0000 7f8906a00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88e40678c0 0x7f88e4069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f88f8006aa0 tx=0x7f88f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:37.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.000+0000 7f88ffe00640 1 -- 172.21.15.144:0/253251822 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f88f0016110 con 0x7f890815c7b0 2024-09-12T12:13:37.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.212+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f890815e090 con 0x7f890815c7b0 2024-09-12T12:13:37.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f88ffe00640 1 -- 172.21.15.144:0/253251822 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f88f00ef380 con 0x7f890815c7b0 2024-09-12T12:13:37.217 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:37.217 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:13:37.217 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:13:37.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:13:37.218 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.219 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:13:37.219 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:13:37.219 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:13:37.219 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.219 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.219 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:13:37.219 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:13:37.220 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.220 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:13:37.220 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:13:37.220 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:13:37.220 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.220 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:13:37.221 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:13:37.221 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.221 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:13:37.221 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:13:37.221 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:13:37.221 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:13:37.222 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.224 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:13:37.224 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:13:37.224 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:13:37.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:13:37.225 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.225 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:13:37.225 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:13:37.225 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.227 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:13:37.228 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:13:37.228 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.229 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:13:37.229 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:13:37.229 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.229 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:13:37.229 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:13:37.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:13:37.231 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:13:37.232 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-mds", 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCk2uJmP+DnFhAALHgg2fXGiGph+ojikLcryQ==", 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-mds" 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.234 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-mgr", 2024-09-12T12:13:37.234 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCk2uJmKurnFhAAh9dWXTPzO8XOKByCam/W6Q==", 2024-09-12T12:13:37.234 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.234 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-12T12:13:37.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.234 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-osd", 2024-09-12T12:13:37.234 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCk2uJmnfLnFhAAJuNK7cWCwrISa/oaBzE5Ug==", 2024-09-12T12:13:37.235 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.235 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-osd" 2024-09-12T12:13:37.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.236 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rbd", 2024-09-12T12:13:37.236 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCk2uJm1vrnFhAAo+yN5gXbnX/Xldxlk5JYbQ==", 2024-09-12T12:13:37.236 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.236 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-12T12:13:37.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCk2uJmWQPoFhAAjK7p6KyOgWpYWRkRXVSXOA==", 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.237 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rgw", 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCk2uJm/wvoFhAA3eJK6rGmYVJRp3LuHThKlw==", 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.238 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:13:37.239 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:13:37.240 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:37.241 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:13:37.242 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:13:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88e40678c0 msgr2=0x7f88e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88e40678c0 0x7f88e4069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f88f8006aa0 tx=0x7f88f8008040 comp rx=0 tx=0).stop 2024-09-12T12:13:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815c7b0 msgr2=0x7f89081fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815c7b0 0x7f89081fad80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f88f001a910 tx=0x7f88f0019000 comp rx=0 tx=0).stop 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 shutdown_connections 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88e40678c0 0x7f88e4069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890815cd30 0x7f890815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890815c7b0 0x7f89081fad80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 --2- 172.21.15.144:0/253251822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89080b5de0 0x7f8908154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 >> 172.21.15.144:0/253251822 conn(0x7f890806d0d0 msgr2=0x7f890815e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 shutdown_connections 2024-09-12T12:13:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.216+0000 7f890de00640 1 -- 172.21.15.144:0/253251822 wait complete. 2024-09-12T12:13:37.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-12T12:13:37.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.380+0000 7f32d2800640 1 Processor -- start 2024-09-12T12:13:37.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.380+0000 7f32d2800640 1 -- start start 2024-09-12T12:13:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32d2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc15e5f0 0x7f32cc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32d2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32cc0b44a0 0x7f32cc0b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32d2800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f32cc06e300 0x7f32cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32d2800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f32cc06ecb0 con 0x7f32cc0b44a0 2024-09-12T12:13:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32d2800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f32cc06d260 con 0x7f32cc06e300 2024-09-12T12:13:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32d2800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32cc0b6f60 con 0x7f32cc15e5f0 2024-09-12T12:13:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32caa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32cc0b44a0 0x7f32cc0b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32caa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32cc0b44a0 0x7f32cc0b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34624/0 (socket says 172.21.15.144:34624) 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32caa00640 1 -- 172.21.15.144:0/2033106335 learned_addr learned my addr 172.21.15.144:0/2033106335 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32cb400640 1 --2- 172.21.15.144:0/2033106335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc15e5f0 0x7f32cc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32cbe00640 1 --2- 172.21.15.144:0/2033106335 >> v2:172.21.15.165:3300/0 conn(0x7f32cc06e300 0x7f32cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32caa00640 1 -- 172.21.15.144:0/2033106335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc15e5f0 msgr2=0x7f32cc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32caa00640 1 --2- 172.21.15.144:0/2033106335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc15e5f0 0x7f32cc06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32caa00640 1 -- 172.21.15.144:0/2033106335 >> v2:172.21.15.165:3300/0 conn(0x7f32cc06e300 msgr2=0x7f32cc06e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32caa00640 1 --2- 172.21.15.144:0/2033106335 >> v2:172.21.15.165:3300/0 conn(0x7f32cc06e300 0x7f32cc06e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32caa00640 1 -- 172.21.15.144:0/2033106335 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc0b7240 con 0x7f32cc0b44a0 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32cb400640 1 --2- 172.21.15.144:0/2033106335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc15e5f0 0x7f32cc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:37.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.384+0000 7f32cbe00640 1 --2- 172.21.15.144:0/2033106335 >> v2:172.21.15.165:3300/0 conn(0x7f32cc06e300 0x7f32cc06e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32caa00640 1 --2- 172.21.15.144:0/2033106335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc0b44a0 0x7f32cc0b48a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32cc070f80 tx=0x7f32b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c942837536823dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32ca000640 1 -- 172.21.15.144:0/2033106335 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b80aa610 con 0x7f32cc0b44a0 2024-09-12T12:13:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32ca000640 1 -- 172.21.15.144:0/2033106335 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b80af070 con 0x7f32cc0b44a0 2024-09-12T12:13:37.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32ca000640 1 -- 172.21.15.144:0/2033106335 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b80aa9d0 con 0x7f32cc0b44a0 2024-09-12T12:13:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 -- 172.21.15.144:0/2033106335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc0b44a0 msgr2=0x7f32cc0b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 --2- 172.21.15.144:0/2033106335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc0b44a0 0x7f32cc0b48a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32cc070f80 tx=0x7f32b801c4f0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 -- 172.21.15.144:0/2033106335 shutdown_connections 2024-09-12T12:13:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 --2- 172.21.15.144:0/2033106335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc0b44a0 0x7f32cc0b48a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 --2- 172.21.15.144:0/2033106335 >> v2:172.21.15.165:3300/0 conn(0x7f32cc06e300 0x7f32cc06e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 --2- 172.21.15.144:0/2033106335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc15e5f0 0x7f32cc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 -- 172.21.15.144:0/2033106335 >> 172.21.15.144:0/2033106335 conn(0x7f32cc06f400 msgr2=0x7f32cc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 -- 172.21.15.144:0/2033106335 shutdown_connections 2024-09-12T12:13:37.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 -- 172.21.15.144:0/2033106335 wait complete. 2024-09-12T12:13:37.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 Processor -- start 2024-09-12T12:13:37.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 -- start start 2024-09-12T12:13:37.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc06e300 0x7f32cc14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32cc0b44a0 0x7f32cc14e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc15e5f0 0x7f32cc14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc0b6d10 con 0x7f32cc15e5f0 2024-09-12T12:13:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f32cc0b6b90 con 0x7f32cc0b44a0 2024-09-12T12:13:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.388+0000 7f32d2800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32cc15f700 con 0x7f32cc06e300 2024-09-12T12:13:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc15e5f0 0x7f32cc14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc15e5f0 0x7f32cc14b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34634/0 (socket says 172.21.15.144:34634) 2024-09-12T12:13:37.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cbe00640 1 -- 172.21.15.144:0/3824252254 learned_addr learned my addr 172.21.15.144:0/3824252254 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:37.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32caa00640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32cc0b44a0 0x7f32cc14e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cb400640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc06e300 0x7f32cc14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cbe00640 1 -- 172.21.15.144:0/3824252254 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc06e300 msgr2=0x7f32cc14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cbe00640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc06e300 0x7f32cc14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cbe00640 1 -- 172.21.15.144:0/3824252254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32cc0b44a0 msgr2=0x7f32cc14e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cbe00640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32cc0b44a0 0x7f32cc14e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cbe00640 1 -- 172.21.15.144:0/3824252254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32cc14ee20 con 0x7f32cc15e5f0 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32cbe00640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc15e5f0 0x7f32cc14b3b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f32c4007e40 tx=0x7f32c400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32c3400640 1 -- 172.21.15.144:0/3824252254 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c401a070 con 0x7f32cc15e5f0 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32c3400640 1 -- 172.21.15.144:0/3824252254 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c4003ba0 con 0x7f32cc15e5f0 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32cc14f0c0 con 0x7f32cc15e5f0 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32c3400640 1 -- 172.21.15.144:0/3824252254 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c400de80 con 0x7f32cc15e5f0 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32cc1501f0 con 0x7f32cc15e5f0 2024-09-12T12:13:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32cc1549a0 con 0x7f32cc15e5f0 2024-09-12T12:13:37.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32c3400640 1 -- 172.21.15.144:0/3824252254 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32c401d070 con 0x7f32cc15e5f0 2024-09-12T12:13:37.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.392+0000 7f32c3400640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32ac0678c0 0x7f32ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.396+0000 7f32c3400640 1 -- 172.21.15.144:0/3824252254 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f32c4085ec0 con 0x7f32cc15e5f0 2024-09-12T12:13:37.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.396+0000 7f32cb400640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32ac0678c0 0x7f32ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.396+0000 7f32cb400640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32ac0678c0 0x7f32ac069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00ba10 tx=0x7f32bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:37.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.400+0000 7f32c3400640 1 -- 172.21.15.144:0/3824252254 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f32c4010070 con 0x7f32cc15e5f0 2024-09-12T12:13:37.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.612+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f32cc0b3530 con 0x7f32cc15e5f0 2024-09-12T12:13:37.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.612+0000 7f32c3400640 1 -- 172.21.15.144:0/3824252254 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f32c4056aa0 con 0x7f32cc15e5f0 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32ac0678c0 msgr2=0x7f32ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32ac0678c0 0x7f32ac069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00ba10 tx=0x7f32bc008040 comp rx=0 tx=0).stop 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc15e5f0 msgr2=0x7f32cc14b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc15e5f0 0x7f32cc14b3b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f32c4007e40 tx=0x7f32c400d4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 shutdown_connections 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32ac0678c0 0x7f32ac069d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32cc15e5f0 0x7f32cc14b3b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32cc0b44a0 0x7f32cc14e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 --2- 172.21.15.144:0/3824252254 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32cc06e300 0x7f32cc14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 >> 172.21.15.144:0/3824252254 conn(0x7f32cc06f400 msgr2=0x7f32cc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:37.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 shutdown_connections 2024-09-12T12:13:37.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.616+0000 7f32d2800640 1 -- 172.21.15.144:0/3824252254 wait complete. 2024-09-12T12:13:37.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-12T12:13:37.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ffd400640 1 Processor -- start 2024-09-12T12:13:37.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ffd400640 1 -- start start 2024-09-12T12:13:37.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ffd400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3ff815c7b0 0x7f3ff80ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ffd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff815cd30 0x7f3ff80b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ffd400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff80cd870 con 0x7f3ff80b5de0 2024-09-12T12:13:37.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ffd400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff8072a50 con 0x7f3ff815c7b0 2024-09-12T12:13:37.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ffd400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff80cde30 con 0x7f3ff815cd30 2024-09-12T12:13:37.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ff7200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3ff80b5de0 0x7f3ff81601d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45200/0 (socket says 172.21.15.144:45200) 2024-09-12T12:13:37.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ff7200640 1 -- 172.21.15.144:0/2058294885 learned_addr learned my addr 172.21.15.144:0/2058294885 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:37.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ff6800640 1 --2- 172.21.15.144:0/2058294885 >> v2:172.21.15.165:3300/0 conn(0x7f3ff815c7b0 0x7f3ff80ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ff5e00640 1 --2- 172.21.15.144:0/2058294885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff815cd30 0x7f3ff80b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ff5400640 1 -- 172.21.15.144:0/2058294885 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129760018 0 0) 0x7f3ff80cd870 con 0x7f3ff80b5de0 2024-09-12T12:13:37.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.772+0000 7f3ff5400640 1 -- 172.21.15.144:0/2058294885 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fdc003530 con 0x7f3ff80b5de0 2024-09-12T12:13:37.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff5e00640 1 -- 172.21.15.144:0/2058294885 >> v2:172.21.15.165:3300/0 conn(0x7f3ff815c7b0 msgr2=0x7f3ff80ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:37.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff5e00640 1 --2- 172.21.15.144:0/2058294885 >> v2:172.21.15.165:3300/0 conn(0x7f3ff815c7b0 0x7f3ff80ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff5e00640 1 -- 172.21.15.144:0/2058294885 >> v1:172.21.15.144:6789/0 conn(0x7f3ff80b5de0 legacy=0x7f3ff81601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff5400640 1 -- 172.21.15.144:0/2058294885 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2185813219 0 0) 0x7f3fdc003530 con 0x7f3ff80b5de0 2024-09-12T12:13:37.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff5e00640 1 -- 172.21.15.144:0/2058294885 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff80cdb50 con 0x7f3ff815cd30 2024-09-12T12:13:37.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff6800640 1 --2- 172.21.15.144:0/2058294885 >> v2:172.21.15.165:3300/0 conn(0x7f3ff815c7b0 0x7f3ff80ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:37.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff5e00640 1 --2- 172.21.15.144:0/2058294885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff815cd30 0x7f3ff80b58a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40097c0 tx=0x7f3fe401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20ec17e2d478740a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:37.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff5400640 1 -- 172.21.15.144:0/2058294885 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40b0070 con 0x7f3ff815cd30 2024-09-12T12:13:37.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff5400640 1 -- 172.21.15.144:0/2058294885 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe40ab400 con 0x7f3ff815cd30 2024-09-12T12:13:37.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ff5400640 1 -- 172.21.15.144:0/2058294885 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0001680 con 0x7f3ff815cd30 2024-09-12T12:13:37.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ffd400640 1 -- 172.21.15.144:0/2058294885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff815cd30 msgr2=0x7f3ff80b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.776+0000 7f3ffd400640 1 --2- 172.21.15.144:0/2058294885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff815cd30 0x7f3ff80b58a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40097c0 tx=0x7f3fe401c3c0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 -- 172.21.15.144:0/2058294885 shutdown_connections 2024-09-12T12:13:37.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 --2- 172.21.15.144:0/2058294885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff815cd30 0x7f3ff80b58a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 --2- 172.21.15.144:0/2058294885 >> v2:172.21.15.165:3300/0 conn(0x7f3ff815c7b0 0x7f3ff80ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 -- 172.21.15.144:0/2058294885 >> 172.21.15.144:0/2058294885 conn(0x7f3ff806d0d0 msgr2=0x7f3ff806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:37.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 -- 172.21.15.144:0/2058294885 shutdown_connections 2024-09-12T12:13:37.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 -- 172.21.15.144:0/2058294885 wait complete. 2024-09-12T12:13:37.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 Processor -- start 2024-09-12T12:13:37.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 -- start start 2024-09-12T12:13:37.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff80b5de0 0x7f3ff814a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff815c7b0 0x7f3ff8159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff815cd30 0x7f3ff80cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff8169530 con 0x7f3ff815c7b0 2024-09-12T12:13:37.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff80cd650 con 0x7f3ff815cd30 2024-09-12T12:13:37.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ffd400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff81696b0 con 0x7f3ff80b5de0 2024-09-12T12:13:37.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff815c7b0 0x7f3ff8159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff815c7b0 0x7f3ff8159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34644/0 (socket says 172.21.15.144:34644) 2024-09-12T12:13:37.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff5e00640 1 -- 172.21.15.144:0/2618173263 learned_addr learned my addr 172.21.15.144:0/2618173263 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:37.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff7200640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff815cd30 0x7f3ff80cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff6800640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff80b5de0 0x7f3ff814a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff5e00640 1 -- 172.21.15.144:0/2618173263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff80b5de0 msgr2=0x7f3ff814a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff5e00640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff80b5de0 0x7f3ff814a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff5e00640 1 -- 172.21.15.144:0/2618173263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff815cd30 msgr2=0x7f3ff80cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff5e00640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff815cd30 0x7f3ff80cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff5e00640 1 -- 172.21.15.144:0/2618173263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff814a540 con 0x7f3ff815c7b0 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff6800640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff80b5de0 0x7f3ff814a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3ff5e00640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff815c7b0 0x7f3ff8159ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40097c0 tx=0x7f3fe4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.780+0000 7f3feea00640 1 -- 172.21.15.144:0/2618173263 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40bb070 con 0x7f3ff815c7b0 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3feea00640 1 -- 172.21.15.144:0/2618173263 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe40b7460 con 0x7f3ff815c7b0 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3feea00640 1 -- 172.21.15.144:0/2618173263 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40b0040 con 0x7f3ff815c7b0 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff81620d0 con 0x7f3ff815c7b0 2024-09-12T12:13:37.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff815b260 con 0x7f3ff815c7b0 2024-09-12T12:13:37.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff815b780 con 0x7f3ff815c7b0 2024-09-12T12:13:37.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3feea00640 1 -- 172.21.15.144:0/2618173263 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3fe40be070 con 0x7f3ff815c7b0 2024-09-12T12:13:37.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3feea00640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd80678c0 0x7f3fd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:37.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3feea00640 1 -- 172.21.15.144:0/2618173263 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f3fe411ff40 con 0x7f3ff815c7b0 2024-09-12T12:13:37.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3ff6800640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd80678c0 0x7f3fd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:37.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.784+0000 7f3ff6800640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd80678c0 0x7f3fd8069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8007520 tx=0x7f3fe800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:37.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:37.788+0000 7f3feea00640 1 -- 172.21.15.144:0/2618173263 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3ff814a540 con 0x7f3ff815c7b0 2024-09-12T12:13:38.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.004+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f3ff80ccf00 con 0x7f3ff815c7b0 2024-09-12T12:13:38.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.004+0000 7f3feea00640 1 -- 172.21.15.144:0/2618173263 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f3fe4015fb0 con 0x7f3ff815c7b0 2024-09-12T12:13:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd80678c0 msgr2=0x7f3fd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd80678c0 0x7f3fd8069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8007520 tx=0x7f3fe800b040 comp rx=0 tx=0).stop 2024-09-12T12:13:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff815c7b0 msgr2=0x7f3ff8159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff815c7b0 0x7f3ff8159ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3fe40097c0 tx=0x7f3fe4019160 comp rx=0 tx=0).stop 2024-09-12T12:13:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 shutdown_connections 2024-09-12T12:13:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd80678c0 0x7f3fd8069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff815cd30 0x7f3ff80cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff815c7b0 0x7f3ff8159ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 --2- 172.21.15.144:0/2618173263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff80b5de0 0x7f3ff814a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 >> 172.21.15.144:0/2618173263 conn(0x7f3ff806d0d0 msgr2=0x7f3ff80b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 shutdown_connections 2024-09-12T12:13:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.008+0000 7f3ffd400640 1 -- 172.21.15.144:0/2618173263 wait complete. 2024-09-12T12:13:38.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-12T12:13:38.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.164+0000 7fb0db600640 1 Processor -- start 2024-09-12T12:13:38.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.164+0000 7fb0db600640 1 -- start start 2024-09-12T12:13:38.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.164+0000 7fb0db600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.164+0000 7fb0db600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb0d406c150 0x7fb0d40cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.164+0000 7fb0db600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d406c6b0 con 0x7fb0d40cf750 2024-09-12T12:13:38.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.164+0000 7fb0db600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d4072a90 con 0x7fb0d406c150 2024-09-12T12:13:38.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.164+0000 7fb0db600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d4072ce0 con 0x7fb0d4147fa0 2024-09-12T12:13:38.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:37508/0 (socket says 172.21.15.144:37508) 2024-09-12T12:13:38.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d8c00640 1 -- 172.21.15.144:0/3362380694 learned_addr learned my addr 172.21.15.144:0/3362380694 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:38.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb0d406c150 0x7fb0d40cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d8c00640 1 -- 172.21.15.144:0/3362380694 >> v2:172.21.15.165:3300/0 conn(0x7fb0d406c150 msgr2=0x7fb0d40cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:38.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d8c00640 1 --2- 172.21.15.144:0/3362380694 >> v2:172.21.15.165:3300/0 conn(0x7fb0d406c150 0x7fb0d40cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d8c00640 1 -- 172.21.15.144:0/3362380694 >> v1:172.21.15.165:6789/0 conn(0x7fb0d40cf750 legacy=0x7fb0d41620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d8c00640 1 -- 172.21.15.144:0/3362380694 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d4072fc0 con 0x7fb0d4147fa0 2024-09-12T12:13:38.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d8c00640 1 --2- 172.21.15.144:0/3362380694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d406bc10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009870 tx=0x7fb0c401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=277d612512f4af80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:38.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.168+0000 7fb0d3400640 1 -- 172.21.15.144:0/3362380694 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40b0070 con 0x7fb0d4147fa0 2024-09-12T12:13:38.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0d3400640 1 -- 172.21.15.144:0/3362380694 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c40ab600 con 0x7fb0d4147fa0 2024-09-12T12:13:38.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0d3400640 1 -- 172.21.15.144:0/3362380694 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40ab9d0 con 0x7fb0d4147fa0 2024-09-12T12:13:38.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 -- 172.21.15.144:0/3362380694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 msgr2=0x7fb0d406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 --2- 172.21.15.144:0/3362380694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d406bc10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009870 tx=0x7fb0c401c440 comp rx=0 tx=0).stop 2024-09-12T12:13:38.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 -- 172.21.15.144:0/3362380694 shutdown_connections 2024-09-12T12:13:38.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 --2- 172.21.15.144:0/3362380694 >> v2:172.21.15.165:3300/0 conn(0x7fb0d406c150 0x7fb0d40cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 --2- 172.21.15.144:0/3362380694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d406bc10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 -- 172.21.15.144:0/3362380694 >> 172.21.15.144:0/3362380694 conn(0x7fb0d406cd20 msgr2=0x7fb0d406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:38.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 -- 172.21.15.144:0/3362380694 shutdown_connections 2024-09-12T12:13:38.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 -- 172.21.15.144:0/3362380694 wait complete. 2024-09-12T12:13:38.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 Processor -- start 2024-09-12T12:13:38.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 -- start start 2024-09-12T12:13:38.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0d406c150 0x7fb0d415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0d40cf750 0x7fb0d415bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d415fa80 con 0x7fb0d40cf750 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d416b450 con 0x7fb0d406c150 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0db600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d4147560 con 0x7fb0d4147fa0 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0d3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0d40cf750 0x7fb0d415bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0d3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0d40cf750 0x7fb0d415bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34658/0 (socket says 172.21.15.144:34658) 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0d3e00640 1 -- 172.21.15.144:0/1614246547 learned_addr learned my addr 172.21.15.144:0/1614246547 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0d8c00640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0d406c150 0x7fb0d415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.172+0000 7fb0d9600640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d3e00640 1 -- 172.21.15.144:0/1614246547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 msgr2=0x7fb0d415bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d3e00640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d415bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d3e00640 1 -- 172.21.15.144:0/1614246547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0d406c150 msgr2=0x7fb0d415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d3e00640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0d406c150 0x7fb0d415b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d3e00640 1 -- 172.21.15.144:0/1614246547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d4146cc0 con 0x7fb0d40cf750 2024-09-12T12:13:38.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d3e00640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0d40cf750 0x7fb0d415bab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000e840 tx=0x7fb0c000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:38.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d0c00640 1 -- 172.21.15.144:0/1614246547 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0017070 con 0x7fb0d40cf750 2024-09-12T12:13:38.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d0c00640 1 -- 172.21.15.144:0/1614246547 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c000ee90 con 0x7fb0d40cf750 2024-09-12T12:13:38.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d0c00640 1 -- 172.21.15.144:0/1614246547 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000cb60 con 0x7fb0d40cf750 2024-09-12T12:13:38.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d4146fa0 con 0x7fb0d40cf750 2024-09-12T12:13:38.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d40cb970 con 0x7fb0d40cf750 2024-09-12T12:13:38.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d40cf210 con 0x7fb0d40cf750 2024-09-12T12:13:38.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d0c00640 1 -- 172.21.15.144:0/1614246547 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0c001a070 con 0x7fb0d40cf750 2024-09-12T12:13:38.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d0c00640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0b40678f0 0x7fb0b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d0c00640 1 -- 172.21.15.144:0/1614246547 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fb0c0085c70 con 0x7fb0d40cf750 2024-09-12T12:13:38.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.176+0000 7fb0d8c00640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0b40678f0 0x7fb0b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.180+0000 7fb0d8c00640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0b40678f0 0x7fb0b4069db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40ad000 tx=0x7fb0c40a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.180+0000 7fb0d0c00640 1 -- 172.21.15.144:0/1614246547 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb0c0056310 con 0x7fb0d40cf750 2024-09-12T12:13:38.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.396+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fb0d40b67d0 con 0x7fb0d40cf750 2024-09-12T12:13:38.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.396+0000 7fb0d0c00640 1 -- 172.21.15.144:0/1614246547 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fb0c005a610 con 0x7fb0d40cf750 2024-09-12T12:13:38.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0b40678f0 msgr2=0x7fb0b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0b40678f0 0x7fb0b4069db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40ad000 tx=0x7fb0c40a6000 comp rx=0 tx=0).stop 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0d40cf750 msgr2=0x7fb0d415bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0d40cf750 0x7fb0d415bab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000e840 tx=0x7fb0c000ec40 comp rx=0 tx=0).stop 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 shutdown_connections 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0b40678f0 0x7fb0b4069db0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0d4147fa0 0x7fb0d415bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0d40cf750 0x7fb0d415bab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 --2- 172.21.15.144:0/1614246547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0d406c150 0x7fb0d415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 >> 172.21.15.144:0/1614246547 conn(0x7fb0d406cd20 msgr2=0x7fb0d415ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 shutdown_connections 2024-09-12T12:13:38.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.400+0000 7fb0db600640 1 -- 172.21.15.144:0/1614246547 wait complete. 2024-09-12T12:13:38.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-12T12:13:38.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb53d400640 1 Processor -- start 2024-09-12T12:13:38.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb53d400640 1 -- start start 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb53d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb53815b4e0 0x7fb5380b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb53d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb5380b3ad0 0x7fb538071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb53d400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5380b45a0 con 0x7fb538071960 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb53d400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb5380b3fe0 con 0x7fb5380b3ad0 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb53d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb5380b42c0 con 0x7fb53815b4e0 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb52de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb5380b3ad0 0x7fb538071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb52de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb5380b3ad0 0x7fb538071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34668/0 (socket says 172.21.15.144:34668) 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb52de00640 1 -- 172.21.15.144:0/3172152639 learned_addr learned my addr 172.21.15.144:0/3172152639 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb536800640 1 --2- 172.21.15.144:0/3172152639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb53815b4e0 0x7fb5380b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb52de00640 1 -- 172.21.15.144:0/3172152639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb53815b4e0 msgr2=0x7fb5380b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:38.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb52de00640 1 --2- 172.21.15.144:0/3172152639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb53815b4e0 0x7fb5380b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb52de00640 1 -- 172.21.15.144:0/3172152639 >> v1:172.21.15.144:6789/0 conn(0x7fb538071960 legacy=0x7fb5380ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb52de00640 1 -- 172.21.15.144:0/3172152639 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5380b1490 con 0x7fb5380b3ad0 2024-09-12T12:13:38.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.556+0000 7fb535e00640 1 -- 172.21.15.144:0/3172152639 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419562551 0 0) 0x7fb5380b45a0 con 0x7fb538071960 2024-09-12T12:13:38.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb52de00640 1 --2- 172.21.15.144:0/3172152639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5380b3ad0 0x7fb538071420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb520009870 tx=0x7fb52001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4527b6724fd8607c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:38.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb535e00640 1 -- 172.21.15.144:0/3172152639 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5200a9610 con 0x7fb5380b3ad0 2024-09-12T12:13:38.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb535e00640 1 -- 172.21.15.144:0/3172152639 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5200a97b0 con 0x7fb5380b3ad0 2024-09-12T12:13:38.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb535e00640 1 -- 172.21.15.144:0/3172152639 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5200a9b80 con 0x7fb5380b3ad0 2024-09-12T12:13:38.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb53d400640 1 -- 172.21.15.144:0/3172152639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5380b3ad0 msgr2=0x7fb538071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb53d400640 1 --2- 172.21.15.144:0/3172152639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5380b3ad0 0x7fb538071420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb520009870 tx=0x7fb52001c530 comp rx=0 tx=0).stop 2024-09-12T12:13:38.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb53d400640 1 -- 172.21.15.144:0/3172152639 shutdown_connections 2024-09-12T12:13:38.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb53d400640 1 --2- 172.21.15.144:0/3172152639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5380b3ad0 0x7fb538071420 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb53d400640 1 --2- 172.21.15.144:0/3172152639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb53815b4e0 0x7fb5380b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb53d400640 1 -- 172.21.15.144:0/3172152639 >> 172.21.15.144:0/3172152639 conn(0x7fb53806d0d0 msgr2=0x7fb53806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:38.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb53d400640 1 -- 172.21.15.144:0/3172152639 shutdown_connections 2024-09-12T12:13:38.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.560+0000 7fb53d400640 1 -- 172.21.15.144:0/3172152639 wait complete. 2024-09-12T12:13:38.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 Processor -- start 2024-09-12T12:13:38.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 -- start start 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb538071960 0x7fb538150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5380b3ad0 0x7fb53815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb53815b4e0 0x7fb538154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb5380b2620 con 0x7fb53815b4e0 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb5380b24a0 con 0x7fb5380b3ad0 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb5380cd640 con 0x7fb538071960 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb537200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb53815b4e0 0x7fb538154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb537200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb53815b4e0 0x7fb538154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34670/0 (socket says 172.21.15.144:34670) 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb537200640 1 -- 172.21.15.144:0/3910564799 learned_addr learned my addr 172.21.15.144:0/3910564799 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb536800640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb538071960 0x7fb538150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb52de00640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5380b3ad0 0x7fb53815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb537200640 1 -- 172.21.15.144:0/3910564799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb538071960 msgr2=0x7fb538150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb537200640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb538071960 0x7fb538150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb537200640 1 -- 172.21.15.144:0/3910564799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5380b3ad0 msgr2=0x7fb53815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb537200640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5380b3ad0 0x7fb53815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb537200640 1 -- 172.21.15.144:0/3910564799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53815dba0 con 0x7fb53815b4e0 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb537200640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb53815b4e0 0x7fb538154100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb53000c740 tx=0x7fb53000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb52f400640 1 -- 172.21.15.144:0/3910564799 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530003db0 con 0x7fb53815b4e0 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb52f400640 1 -- 172.21.15.144:0/3910564799 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53000ce50 con 0x7fb53815b4e0 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb52f400640 1 -- 172.21.15.144:0/3910564799 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5300052b0 con 0x7fb53815b4e0 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53815de80 con 0x7fb53815b4e0 2024-09-12T12:13:38.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.564+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb53815e720 con 0x7fb53815b4e0 2024-09-12T12:13:38.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.568+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb538071420 con 0x7fb53815b4e0 2024-09-12T12:13:38.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.568+0000 7fb52f400640 1 -- 172.21.15.144:0/3910564799 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb530005450 con 0x7fb53815b4e0 2024-09-12T12:13:38.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.568+0000 7fb52f400640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb5140678c0 0x7fb514069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.568+0000 7fb52f400640 1 -- 172.21.15.144:0/3910564799 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fb5300858e0 con 0x7fb53815b4e0 2024-09-12T12:13:38.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.568+0000 7fb536800640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb5140678c0 0x7fb514069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.568+0000 7fb536800640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb5140678c0 0x7fb514069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb5380cd610 tx=0x7fb528008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:38.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.572+0000 7fb52f400640 1 -- 172.21.15.144:0/3910564799 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb530055f80 con 0x7fb53815b4e0 2024-09-12T12:13:38.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.784+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fb53815e050 con 0x7fb53815b4e0 2024-09-12T12:13:38.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb52f400640 1 -- 172.21.15.144:0/3910564799 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fb53005a280 con 0x7fb53815b4e0 2024-09-12T12:13:38.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb5140678c0 msgr2=0x7fb514069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb5140678c0 0x7fb514069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb5380cd610 tx=0x7fb528008040 comp rx=0 tx=0).stop 2024-09-12T12:13:38.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb53815b4e0 msgr2=0x7fb538154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb53815b4e0 0x7fb538154100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb53000c740 tx=0x7fb53000cc00 comp rx=0 tx=0).stop 2024-09-12T12:13:38.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 shutdown_connections 2024-09-12T12:13:38.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb5140678c0 0x7fb514069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb53815b4e0 0x7fb538154100 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5380b3ad0 0x7fb53815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 --2- 172.21.15.144:0/3910564799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb538071960 0x7fb538150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 >> 172.21.15.144:0/3910564799 conn(0x7fb53806d0d0 msgr2=0x7fb538155dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:38.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 shutdown_connections 2024-09-12T12:13:38.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.788+0000 7fb53d400640 1 -- 172.21.15.144:0/3910564799 wait complete. 2024-09-12T12:13:38.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-12T12:13:38.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.944+0000 7f75a9800640 1 Processor -- start 2024-09-12T12:13:38.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.944+0000 7f75a9800640 1 -- start start 2024-09-12T12:13:38.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a9800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f75a415c360 0x7f75a40b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a9800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a40b4b80 con 0x7f75a4071550 2024-09-12T12:13:38.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a9800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a415c740 con 0x7f75a40b4780 2024-09-12T12:13:38.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a9800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f75a4160d50 con 0x7f75a415c360 2024-09-12T12:13:38.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a3400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f75a4071550 0x7f75a40b55b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45222/0 (socket says 172.21.15.144:45222) 2024-09-12T12:13:38.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a3400640 1 -- 172.21.15.144:0/2209729513 learned_addr learned my addr 172.21.15.144:0/2209729513 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:38.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a2a00640 1 --2- 172.21.15.144:0/2209729513 >> v2:172.21.15.165:3300/0 conn(0x7f75a415c360 0x7f75a40b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a1600640 1 -- 172.21.15.144:0/2209729513 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104295685 0 0) 0x7f75a40b4b80 con 0x7f75a4071550 2024-09-12T12:13:38.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a1600640 1 -- 172.21.15.144:0/2209729513 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7588003530 con 0x7f75a4071550 2024-09-12T12:13:38.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a2a00640 1 -- 172.21.15.144:0/2209729513 >> v1:172.21.15.165:6789/0 conn(0x7f75a40b4780 legacy=0x7f75a4070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a2a00640 1 -- 172.21.15.144:0/2209729513 >> v1:172.21.15.144:6789/0 conn(0x7f75a4071550 legacy=0x7f75a40b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.948+0000 7f75a2a00640 1 -- 172.21.15.144:0/2209729513 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a415ff90 con 0x7f75a415c360 2024-09-12T12:13:38.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a2a00640 1 --2- 172.21.15.144:0/2209729513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a415c360 0x7f75a40b4240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7594009d90 tx=0x7f759401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1589fc9fd6647ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:38.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a1600640 1 -- 172.21.15.144:0/2209729513 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75940b2070 con 0x7f75a415c360 2024-09-12T12:13:38.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a1600640 1 -- 172.21.15.144:0/2209729513 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75940a57a0 con 0x7f75a415c360 2024-09-12T12:13:38.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a1600640 1 -- 172.21.15.144:0/2209729513 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75940a5b70 con 0x7f75a415c360 2024-09-12T12:13:38.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a9800640 1 -- 172.21.15.144:0/2209729513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a415c360 msgr2=0x7f75a40b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a9800640 1 --2- 172.21.15.144:0/2209729513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a415c360 0x7f75a40b4240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7594009d90 tx=0x7f759401c8e0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a9800640 1 -- 172.21.15.144:0/2209729513 shutdown_connections 2024-09-12T12:13:38.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a9800640 1 --2- 172.21.15.144:0/2209729513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a415c360 0x7f75a40b4240 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a9800640 1 -- 172.21.15.144:0/2209729513 >> 172.21.15.144:0/2209729513 conn(0x7f75a406f3c0 msgr2=0x7f75a406f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:38.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a9800640 1 -- 172.21.15.144:0/2209729513 shutdown_connections 2024-09-12T12:13:38.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.952+0000 7f75a9800640 1 -- 172.21.15.144:0/2209729513 wait complete. 2024-09-12T12:13:38.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 Processor -- start 2024-09-12T12:13:38.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 -- start start 2024-09-12T12:13:38.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f75a4071550 0x7f75a4148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a40b4780 0x7f75a4165710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a415c360 0x7f75a4165c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40b6650 con 0x7f75a40b4780 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40b64d0 con 0x7f75a415c360 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f75a4169fc0 con 0x7f75a4071550 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a40b4780 0x7f75a4165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f75a4071550 0x7f75a4148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f75a4071550 0x7f75a4148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:37546/0 (socket says 172.21.15.144:37546) 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a40b4780 0x7f75a4165710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34674/0 (socket says 172.21.15.144:34674) 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2a00640 1 -- 172.21.15.144:0/119753047 learned_addr learned my addr 172.21.15.144:0/119753047 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:38.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a3400640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a415c360 0x7f75a4165c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2a00640 1 -- 172.21.15.144:0/119753047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a415c360 msgr2=0x7f75a4165c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2a00640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a415c360 0x7f75a4165c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2a00640 1 -- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a40b4780 msgr2=0x7f75a4165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:38.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2a00640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a40b4780 0x7f75a4165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:38.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2a00640 1 -- 172.21.15.144:0/119753047 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a4163870 con 0x7f75a4071550 2024-09-12T12:13:38.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2000640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a40b4780 0x7f75a4165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:38.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a2a00640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f75a4071550 0x7f75a4148190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75940b0040 tx=0x7f7594019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:38.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f759aa00640 1 -- 172.21.15.144:0/119753047 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75940b2050 con 0x7f75a4071550 2024-09-12T12:13:38.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f759aa00640 1 -- 172.21.15.144:0/119753047 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75940be070 con 0x7f75a4071550 2024-09-12T12:13:38.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f759aa00640 1 -- 172.21.15.144:0/119753047 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75940ad870 con 0x7f75a4071550 2024-09-12T12:13:38.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a4163b50 con 0x7f75a4071550 2024-09-12T12:13:38.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.956+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a4164110 con 0x7f75a4071550 2024-09-12T12:13:38.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.960+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a40b4240 con 0x7f75a4071550 2024-09-12T12:13:38.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.960+0000 7f759aa00640 1 -- 172.21.15.144:0/119753047 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75940ada10 con 0x7f75a4071550 2024-09-12T12:13:38.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.960+0000 7f759aa00640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75840678c0 0x7f7584069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:38.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.960+0000 7f759aa00640 1 -- 172.21.15.144:0/119753047 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f75941209c0 con 0x7f75a4071550 2024-09-12T12:13:38.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.960+0000 7f75a2000640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75840678c0 0x7f7584069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:38.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.960+0000 7f75a2000640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75840678c0 0x7f7584069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f75a40b6c80 tx=0x7f7590009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:38.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:38.964+0000 7f759aa00640 1 -- 172.21.15.144:0/119753047 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7594016560 con 0x7f75a4071550 2024-09-12T12:13:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.180+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f75a4076160 con 0x7f75a4071550 2024-09-12T12:13:39.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f759aa00640 1 -- 172.21.15.144:0/119753047 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f75940f0fd0 con 0x7f75a4071550 2024-09-12T12:13:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75840678c0 msgr2=0x7f7584069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75840678c0 0x7f7584069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f75a40b6c80 tx=0x7f7590009040 comp rx=0 tx=0).stop 2024-09-12T12:13:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f75a4071550 msgr2=0x7f75a4148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f75a4071550 0x7f75a4148190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f75940b0040 tx=0x7f7594019680 comp rx=0 tx=0).stop 2024-09-12T12:13:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 shutdown_connections 2024-09-12T12:13:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75840678c0 0x7f7584069d80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75a415c360 0x7f75a4165c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75a40b4780 0x7f75a4165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 --2- 172.21.15.144:0/119753047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f75a4071550 0x7f75a4148190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 >> 172.21.15.144:0/119753047 conn(0x7f75a406f3c0 msgr2=0x7f75a40b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:39.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 shutdown_connections 2024-09-12T12:13:39.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.188+0000 7f75a9800640 1 -- 172.21.15.144:0/119753047 wait complete. 2024-09-12T12:13:39.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-12T12:13:39.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.344+0000 7f185bc00640 1 Processor -- start 2024-09-12T12:13:39.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.344+0000 7f185bc00640 1 -- start start 2024-09-12T12:13:39.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.344+0000 7f185bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 0x7f18540b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.344+0000 7f185bc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18540b3ad0 0x7f1854071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.344+0000 7f185bc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1854071960 0x7f18540ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.344+0000 7f185bc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f18540b45a0 con 0x7f18540b3ad0 2024-09-12T12:13:39.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.344+0000 7f185bc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f18540b3fe0 con 0x7f1854071960 2024-09-12T12:13:39.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.344+0000 7f185bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f18540b42c0 con 0x7f185415b4e0 2024-09-12T12:13:39.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18540b3ad0 0x7f1854071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f18540b3ad0 0x7f1854071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34690/0 (socket says 172.21.15.144:34690) 2024-09-12T12:13:39.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853e00640 1 -- 172.21.15.144:0/1707450703 learned_addr learned my addr 172.21.15.144:0/1707450703 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:39.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1859200640 1 --2- 172.21.15.144:0/1707450703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 0x7f18540b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853e00640 1 -- 172.21.15.144:0/1707450703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 msgr2=0x7f18540b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:39.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1859c00640 1 --2- 172.21.15.144:0/1707450703 >> v2:172.21.15.165:3300/0 conn(0x7f1854071960 0x7f18540ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853e00640 1 --2- 172.21.15.144:0/1707450703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 0x7f18540b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853e00640 1 -- 172.21.15.144:0/1707450703 >> v2:172.21.15.165:3300/0 conn(0x7f1854071960 msgr2=0x7f18540ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:39.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853e00640 1 --2- 172.21.15.144:0/1707450703 >> v2:172.21.15.165:3300/0 conn(0x7f1854071960 0x7f18540ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853e00640 1 -- 172.21.15.144:0/1707450703 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18540b1490 con 0x7f18540b3ad0 2024-09-12T12:13:39.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1859c00640 1 --2- 172.21.15.144:0/1707450703 >> v2:172.21.15.165:3300/0 conn(0x7f1854071960 0x7f18540ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:39.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1859200640 1 --2- 172.21.15.144:0/1707450703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 0x7f18540b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:39.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853e00640 1 --2- 172.21.15.144:0/1707450703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 0x7f1854071420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f18540d04b0 tx=0x7f184001ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc967e4306209d98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:39.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853400640 1 -- 172.21.15.144:0/1707450703 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18400b4070 con 0x7f18540b3ad0 2024-09-12T12:13:39.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853400640 1 -- 172.21.15.144:0/1707450703 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18400a7b60 con 0x7f18540b3ad0 2024-09-12T12:13:39.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.348+0000 7f1853400640 1 -- 172.21.15.144:0/1707450703 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18400af440 con 0x7f18540b3ad0 2024-09-12T12:13:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 -- 172.21.15.144:0/1707450703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 msgr2=0x7f1854071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 --2- 172.21.15.144:0/1707450703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 0x7f1854071420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f18540d04b0 tx=0x7f184001ebc0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 -- 172.21.15.144:0/1707450703 shutdown_connections 2024-09-12T12:13:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 --2- 172.21.15.144:0/1707450703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 0x7f1854071420 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 --2- 172.21.15.144:0/1707450703 >> v2:172.21.15.165:3300/0 conn(0x7f1854071960 0x7f18540ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 --2- 172.21.15.144:0/1707450703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 0x7f18540b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 -- 172.21.15.144:0/1707450703 >> 172.21.15.144:0/1707450703 conn(0x7f185406d0d0 msgr2=0x7f185406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:39.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 -- 172.21.15.144:0/1707450703 shutdown_connections 2024-09-12T12:13:39.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 -- 172.21.15.144:0/1707450703 wait complete. 2024-09-12T12:13:39.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 Processor -- start 2024-09-12T12:13:39.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 -- start start 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1854071960 0x7f18541fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 0x7f185415a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 0x7f1854154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f185415f270 con 0x7f18540b3ad0 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f185415f0f0 con 0x7f1854071960 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f185bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f185415f3f0 con 0x7f185415b4e0 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1853e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 0x7f185415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1853e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 0x7f185415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34702/0 (socket says 172.21.15.144:34702) 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1853e00640 1 -- 172.21.15.144:0/2659381812 learned_addr learned my addr 172.21.15.144:0/2659381812 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1859c00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 0x7f1854154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1859200640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1854071960 0x7f18541fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1853e00640 1 -- 172.21.15.144:0/2659381812 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 msgr2=0x7f1854154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1853e00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 0x7f1854154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1853e00640 1 -- 172.21.15.144:0/2659381812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1854071960 msgr2=0x7f18541fba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1853e00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1854071960 0x7f18541fba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.352+0000 7f1853e00640 1 -- 172.21.15.144:0/2659381812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1854159d50 con 0x7f18540b3ad0 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f1853e00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 0x7f185415a440 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f184001d270 tx=0x7f184001b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f1850c00640 1 -- 172.21.15.144:0/2659381812 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18400b4030 con 0x7f18540b3ad0 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f1850c00640 1 -- 172.21.15.144:0/2659381812 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18400b6070 con 0x7f18540b3ad0 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1854159a70 con 0x7f18540b3ad0 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f1850c00640 1 -- 172.21.15.144:0/2659381812 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18400ad7b0 con 0x7f18540b3ad0 2024-09-12T12:13:39.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18541fb230 con 0x7f18540b3ad0 2024-09-12T12:13:39.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1854071420 con 0x7f18540b3ad0 2024-09-12T12:13:39.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f1850c00640 1 -- 172.21.15.144:0/2659381812 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18400c1060 con 0x7f18540b3ad0 2024-09-12T12:13:39.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f1850c00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18340678c0 0x7f1834069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f1850c00640 1 -- 172.21.15.144:0/2659381812 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f184011ffa0 con 0x7f18540b3ad0 2024-09-12T12:13:39.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f1859200640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18340678c0 0x7f1834069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.356+0000 7f1859200640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18340678c0 0x7f1834069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f184400f3f0 tx=0x7f1844007770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:39.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.360+0000 7f1850c00640 1 -- 172.21.15.144:0/2659381812 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f18400187e0 con 0x7f18540b3ad0 2024-09-12T12:13:39.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.576+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f18540b0630 con 0x7f18540b3ad0 2024-09-12T12:13:39.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.576+0000 7f1850c00640 1 -- 172.21.15.144:0/2659381812 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f18400f05b0 con 0x7f18540b3ad0 2024-09-12T12:13:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18340678c0 msgr2=0x7f1834069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18340678c0 0x7f1834069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f184400f3f0 tx=0x7f1844007770 comp rx=0 tx=0).stop 2024-09-12T12:13:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 msgr2=0x7f185415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 0x7f185415a440 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f184001d270 tx=0x7f184001b960 comp rx=0 tx=0).stop 2024-09-12T12:13:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 shutdown_connections 2024-09-12T12:13:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18340678c0 0x7f1834069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f185415b4e0 0x7f1854154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18540b3ad0 0x7f185415a440 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 --2- 172.21.15.144:0/2659381812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1854071960 0x7f18541fba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 >> 172.21.15.144:0/2659381812 conn(0x7f185406d0d0 msgr2=0x7f1854165630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:39.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 shutdown_connections 2024-09-12T12:13:39.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.580+0000 7f185bc00640 1 -- 172.21.15.144:0/2659381812 wait complete. 2024-09-12T12:13:39.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:13:39.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f9621a00640 1 Processor -- start 2024-09-12T12:13:39.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f9621a00640 1 -- start start 2024-09-12T12:13:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f9621a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f961c15b4e0 0x7f961c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f9621a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f961c0b3ad0 0x7f961c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f9621a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c0b45a0 con 0x7f961c071960 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f9621a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f961c0b3fe0 con 0x7f961c15b4e0 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f9621a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f961c0b42c0 con 0x7f961c0b3ad0 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f961aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f961c15b4e0 0x7f961c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f961aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f961c15b4e0 0x7f961c0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34706/0 (socket says 172.21.15.144:34706) 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f961aa00640 1 -- 172.21.15.144:0/363688551 learned_addr learned my addr 172.21.15.144:0/363688551 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f961a000640 1 --2- 172.21.15.144:0/363688551 >> v2:172.21.15.165:3300/0 conn(0x7f961c0b3ad0 0x7f961c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f961aa00640 1 -- 172.21.15.144:0/363688551 >> v2:172.21.15.165:3300/0 conn(0x7f961c0b3ad0 msgr2=0x7f961c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.736+0000 7f961aa00640 1 --2- 172.21.15.144:0/363688551 >> v2:172.21.15.165:3300/0 conn(0x7f961c0b3ad0 0x7f961c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f961aa00640 1 -- 172.21.15.144:0/363688551 >> v1:172.21.15.165:6789/0 conn(0x7f961c071960 legacy=0x7f961c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f961aa00640 1 -- 172.21.15.144:0/363688551 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c0b1490 con 0x7f961c15b4e0 2024-09-12T12:13:39.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f961aa00640 1 --2- 172.21.15.144:0/363688551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 0x7f961c0b3590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f961c0b02b0 tx=0x7f960c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8154cf19c8ba2ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9619600640 1 -- 172.21.15.144:0/363688551 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0a58a0 con 0x7f961c15b4e0 2024-09-12T12:13:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9619600640 1 -- 172.21.15.144:0/363688551 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960c0a5a40 con 0x7f961c15b4e0 2024-09-12T12:13:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9619600640 1 -- 172.21.15.144:0/363688551 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0a5e10 con 0x7f961c15b4e0 2024-09-12T12:13:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9621a00640 1 -- 172.21.15.144:0/363688551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 msgr2=0x7f961c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9621a00640 1 --2- 172.21.15.144:0/363688551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 0x7f961c0b3590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f961c0b02b0 tx=0x7f960c01c9c0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9621a00640 1 -- 172.21.15.144:0/363688551 shutdown_connections 2024-09-12T12:13:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9621a00640 1 --2- 172.21.15.144:0/363688551 >> v2:172.21.15.165:3300/0 conn(0x7f961c0b3ad0 0x7f961c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9621a00640 1 --2- 172.21.15.144:0/363688551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 0x7f961c0b3590 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9621a00640 1 -- 172.21.15.144:0/363688551 >> 172.21.15.144:0/363688551 conn(0x7f961c06d0d0 msgr2=0x7f961c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9621a00640 1 -- 172.21.15.144:0/363688551 shutdown_connections 2024-09-12T12:13:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.740+0000 7f9621a00640 1 -- 172.21.15.144:0/363688551 wait complete. 2024-09-12T12:13:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 Processor -- start 2024-09-12T12:13:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 -- start start 2024-09-12T12:13:39.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f961c071960 0x7f961c147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961c0b3ad0 0x7f961c15c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 0x7f961c149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f961c0b2620 con 0x7f961c15b4e0 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f961c0b24a0 con 0x7f961c0b3ad0 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f961c0cd640 con 0x7f961c071960 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 0x7f961c149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 0x7f961c149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34720/0 (socket says 172.21.15.144:34720) 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961b400640 1 -- 172.21.15.144:0/2675311798 learned_addr learned my addr 172.21.15.144:0/2675311798 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961aa00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f961c071960 0x7f961c147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961a000640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961c0b3ad0 0x7f961c15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961b400640 1 -- 172.21.15.144:0/2675311798 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f961c071960 msgr2=0x7f961c147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961b400640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f961c071960 0x7f961c147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961b400640 1 -- 172.21.15.144:0/2675311798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961c0b3ad0 msgr2=0x7f961c15c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961b400640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961c0b3ad0 0x7f961c15c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961b400640 1 -- 172.21.15.144:0/2675311798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c149c60 con 0x7f961c15b4e0 2024-09-12T12:13:39.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f961b400640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 0x7f961c149720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f961400c430 tx=0x7f961400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:39.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9612a00640 1 -- 172.21.15.144:0/2675311798 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614005220 con 0x7f961c15b4e0 2024-09-12T12:13:39.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9612a00640 1 -- 172.21.15.144:0/2675311798 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96140053c0 con 0x7f961c15b4e0 2024-09-12T12:13:39.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9612a00640 1 -- 172.21.15.144:0/2675311798 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614007270 con 0x7f961c15b4e0 2024-09-12T12:13:39.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961c15cc20 con 0x7f961c15b4e0 2024-09-12T12:13:39.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.744+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961c072330 con 0x7f961c15b4e0 2024-09-12T12:13:39.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.748+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961c071420 con 0x7f961c15b4e0 2024-09-12T12:13:39.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.748+0000 7f9612a00640 1 -- 172.21.15.144:0/2675311798 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9614019020 con 0x7f961c15b4e0 2024-09-12T12:13:39.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.748+0000 7f9612a00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95fc0678c0 0x7f95fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:39.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.748+0000 7f9612a00640 1 -- 172.21.15.144:0/2675311798 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9614084d40 con 0x7f961c15b4e0 2024-09-12T12:13:39.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.748+0000 7f961aa00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95fc0678c0 0x7f95fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:39.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.752+0000 7f961aa00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95fc0678c0 0x7f95fc069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f960c0ae000 tx=0x7f960c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:39.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.752+0000 7f9612a00640 1 -- 172.21.15.144:0/2675311798 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f96140553d0 con 0x7f961c15b4e0 2024-09-12T12:13:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.916+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f961c152fa0 con 0x7f961c15b4e0 2024-09-12T12:13:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.916+0000 7f9612a00640 1 -- 172.21.15.144:0/2675311798 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f96140596d0 con 0x7f961c15b4e0 2024-09-12T12:13:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:39.919 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:13:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:13:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:13:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:13:39.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:13:39.919 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:13:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95fc0678c0 msgr2=0x7f95fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95fc0678c0 0x7f95fc069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f960c0ae000 tx=0x7f960c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:13:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 msgr2=0x7f961c149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 0x7f961c149720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f961400c430 tx=0x7f961400c8f0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 shutdown_connections 2024-09-12T12:13:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95fc0678c0 0x7f95fc069d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f961c15b4e0 0x7f961c149720 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961c0b3ad0 0x7f961c15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 --2- 172.21.15.144:0/2675311798 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f961c071960 0x7f961c147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 >> 172.21.15.144:0/2675311798 conn(0x7f961c06d0d0 msgr2=0x7f961c1489e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 shutdown_connections 2024-09-12T12:13:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:39.920+0000 7f9621a00640 1 -- 172.21.15.144:0/2675311798 wait complete. 2024-09-12T12:13:39.940 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:13:39.940 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:13:40.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90c1400640 1 Processor -- start 2024-09-12T12:13:40.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90c1400640 1 -- start start 2024-09-12T12:13:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90c1400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f90bc0b3490 0x7f90bc0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90c1400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90bc06cd20 con 0x7f90bc06d630 2024-09-12T12:13:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90c1400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90bc0b4f30 con 0x7f90bc06d250 2024-09-12T12:13:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90c1400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f90bc072620 con 0x7f90bc0b3490 2024-09-12T12:13:40.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90bb200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f90bc06d630 0x7f90bc155820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45238/0 (socket says 172.21.15.144:45238) 2024-09-12T12:13:40.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90bb200640 1 -- 172.21.15.144:0/3188915804 learned_addr learned my addr 172.21.15.144:0/3188915804 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:40.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90b9e00640 1 --2- 172.21.15.144:0/3188915804 >> v2:172.21.15.165:3300/0 conn(0x7f90bc0b3490 0x7f90bc0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:40.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90b9400640 1 -- 172.21.15.144:0/3188915804 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548037898 0 0) 0x7f90bc06cd20 con 0x7f90bc06d630 2024-09-12T12:13:40.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90b9400640 1 -- 172.21.15.144:0/3188915804 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90a0003530 con 0x7f90bc06d630 2024-09-12T12:13:40.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90b9400640 1 -- 172.21.15.144:0/3188915804 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577426356 0 0) 0x7f90bc0b4f30 con 0x7f90bc06d250 2024-09-12T12:13:40.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90b9400640 1 -- 172.21.15.144:0/3188915804 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90bc06cd20 con 0x7f90bc06d250 2024-09-12T12:13:40.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90b9e00640 1 -- 172.21.15.144:0/3188915804 >> v1:172.21.15.165:6789/0 conn(0x7f90bc06d250 legacy=0x7f90bc15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:40.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90b9e00640 1 -- 172.21.15.144:0/3188915804 >> v1:172.21.15.144:6789/0 conn(0x7f90bc06d630 legacy=0x7f90bc155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:40.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.080+0000 7f90b9e00640 1 -- 172.21.15.144:0/3188915804 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc0b3950 con 0x7f90bc0b3490 2024-09-12T12:13:40.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90b9e00640 1 --2- 172.21.15.144:0/3188915804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc0b3490 0x7f90bc0b49f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90a80097c0 tx=0x7f90a801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fadba906eb13799 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90b9400640 1 -- 172.21.15.144:0/3188915804 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a80a7070 con 0x7f90bc0b3490 2024-09-12T12:13:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90b9400640 1 -- 172.21.15.144:0/3188915804 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a80b0070 con 0x7f90bc0b3490 2024-09-12T12:13:40.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90b9400640 1 -- 172.21.15.144:0/3188915804 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a80ab870 con 0x7f90bc0b3490 2024-09-12T12:13:40.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90c1400640 1 -- 172.21.15.144:0/3188915804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc0b3490 msgr2=0x7f90bc0b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:40.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90c1400640 1 --2- 172.21.15.144:0/3188915804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc0b3490 0x7f90bc0b49f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90a80097c0 tx=0x7f90a801c470 comp rx=0 tx=0).stop 2024-09-12T12:13:40.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90c1400640 1 -- 172.21.15.144:0/3188915804 shutdown_connections 2024-09-12T12:13:40.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90c1400640 1 --2- 172.21.15.144:0/3188915804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc0b3490 0x7f90bc0b49f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:40.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90c1400640 1 -- 172.21.15.144:0/3188915804 >> 172.21.15.144:0/3188915804 conn(0x7f90bc06bc10 msgr2=0x7f90bc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:40.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90c1400640 1 -- 172.21.15.144:0/3188915804 shutdown_connections 2024-09-12T12:13:40.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.084+0000 7f90c1400640 1 -- 172.21.15.144:0/3188915804 wait complete. 2024-09-12T12:13:40.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 Processor -- start 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 -- start start 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90bc06d250 0x7f90bc146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc06d630 0x7f90bc158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90bc0b3490 0x7f90bc147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc15d690 con 0x7f90bc0b3490 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc0b44d0 con 0x7f90bc06d630 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90bc15d810 con 0x7f90bc06d250 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90bb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90bc0b3490 0x7f90bc147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90bb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90bc0b3490 0x7f90bc147960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34732/0 (socket says 172.21.15.144:34732) 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90bb200640 1 -- 172.21.15.144:0/3519263517 learned_addr learned my addr 172.21.15.144:0/3519263517 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90ba800640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90bc06d250 0x7f90bc146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90b9e00640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc06d630 0x7f90bc158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90bb200640 1 -- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90bc06d250 msgr2=0x7f90bc146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90bb200640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90bc06d250 0x7f90bc146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90bb200640 1 -- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc06d630 msgr2=0x7f90bc158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90bb200640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc06d630 0x7f90bc158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90bb200640 1 -- 172.21.15.144:0/3519263517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc1591a0 con 0x7f90bc0b3490 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90ba800640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90bc06d250 0x7f90bc146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90b9e00640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc06d630 0x7f90bc158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90bb200640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90bc0b3490 0x7f90bc147960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90b400c530 tx=0x7f90b400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90b2a00640 1 -- 172.21.15.144:0/3519263517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4017070 con 0x7f90bc0b3490 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90b2a00640 1 -- 172.21.15.144:0/3519263517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b4005cf0 con 0x7f90bc0b3490 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90bc156340 con 0x7f90bc0b3490 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90b2a00640 1 -- 172.21.15.144:0/3519263517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b40072f0 con 0x7f90bc0b3490 2024-09-12T12:13:40.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90bc156900 con 0x7f90bc0b3490 2024-09-12T12:13:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.088+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90bc0b49f0 con 0x7f90bc0b3490 2024-09-12T12:13:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.092+0000 7f90b2a00640 1 -- 172.21.15.144:0/3519263517 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f90b401a070 con 0x7f90bc0b3490 2024-09-12T12:13:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.092+0000 7f90b2a00640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f909c0678c0 0x7f909c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.092+0000 7f90b2a00640 1 -- 172.21.15.144:0/3519263517 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f90b4084e00 con 0x7f90bc0b3490 2024-09-12T12:13:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.092+0000 7f90ba800640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f909c0678c0 0x7f909c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.092+0000 7f90ba800640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f909c0678c0 0x7f909c069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f90ac001dd0 tx=0x7f90ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:40.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.096+0000 7f90b2a00640 1 -- 172.21.15.144:0/3519263517 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f90b40554a0 con 0x7f90bc0b3490 2024-09-12T12:13:40.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:40.260+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f90bc0ccbb0 con 0x7f90bc0b3490 2024-09-12T12:13:41.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.188+0000 7f90b2a00640 1 -- 172.21.15.144:0/3519263517 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f90b40597a0 con 0x7f90bc0b3490 2024-09-12T12:13:41.192 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:13:41.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f909c0678c0 msgr2=0x7f909c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f909c0678c0 0x7f909c069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f90ac001dd0 tx=0x7f90ac009040 comp rx=0 tx=0).stop 2024-09-12T12:13:41.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90bc0b3490 msgr2=0x7f90bc147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90bc0b3490 0x7f90bc147960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90b400c530 tx=0x7f90b400c9f0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 shutdown_connections 2024-09-12T12:13:41.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f909c0678c0 0x7f909c069d80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90bc0b3490 0x7f90bc147960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90bc06d630 0x7f90bc158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 --2- 172.21.15.144:0/3519263517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90bc06d250 0x7f90bc146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 >> 172.21.15.144:0/3519263517 conn(0x7f90bc06bc10 msgr2=0x7f90bc0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:41.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 shutdown_connections 2024-09-12T12:13:41.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.192+0000 7f90c1400640 1 -- 172.21.15.144:0/3519263517 wait complete. 2024-09-12T12:13:41.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:13:41.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b96800640 1 Processor -- start 2024-09-12T12:13:41.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b96800640 1 -- start start 2024-09-12T12:13:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b96800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3b900af5d0 0x7f3b900cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b96800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b90166510 0x7f3b90166960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b96800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b900cf900 con 0x7f3b90162a40 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b96800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3b900cf6d0 con 0x7f3b900af5d0 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b96800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3b900cfbe0 con 0x7f3b90166510 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b8ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3b900af5d0 0x7f3b900cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b8ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3b900af5d0 0x7f3b900cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34744/0 (socket says 172.21.15.144:34744) 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b8ea00640 1 -- 172.21.15.144:0/3941011984 learned_addr learned my addr 172.21.15.144:0/3941011984 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b8fe00640 1 --2- 172.21.15.144:0/3941011984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b90166510 0x7f3b90166960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b8ea00640 1 -- 172.21.15.144:0/3941011984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b90166510 msgr2=0x7f3b90166960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b8ea00640 1 --2- 172.21.15.144:0/3941011984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b90166510 0x7f3b90166960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b8ea00640 1 -- 172.21.15.144:0/3941011984 >> v1:172.21.15.165:6789/0 conn(0x7f3b90162a40 legacy=0x7f3b90163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.364+0000 7f3b8ea00640 1 -- 172.21.15.144:0/3941011984 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b900cfec0 con 0x7f3b900af5d0 2024-09-12T12:13:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b8ea00640 1 --2- 172.21.15.144:0/3941011984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b900af5d0 0x7f3b900cf190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009870 tx=0x7f3b7c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87fafdd6bea9d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:41.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b8e000640 1 -- 172.21.15.144:0/3941011984 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0b0070 con 0x7f3b900af5d0 2024-09-12T12:13:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b8e000640 1 -- 172.21.15.144:0/3941011984 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c0ab600 con 0x7f3b900af5d0 2024-09-12T12:13:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b8e000640 1 -- 172.21.15.144:0/3941011984 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0ab9d0 con 0x7f3b900af5d0 2024-09-12T12:13:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b96800640 1 -- 172.21.15.144:0/3941011984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b900af5d0 msgr2=0x7f3b900cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b96800640 1 --2- 172.21.15.144:0/3941011984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b900af5d0 0x7f3b900cf190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009870 tx=0x7f3b7c01c4d0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b96800640 1 -- 172.21.15.144:0/3941011984 shutdown_connections 2024-09-12T12:13:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b96800640 1 --2- 172.21.15.144:0/3941011984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b90166510 0x7f3b90166960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b96800640 1 --2- 172.21.15.144:0/3941011984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b900af5d0 0x7f3b900cf190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b96800640 1 -- 172.21.15.144:0/3941011984 >> 172.21.15.144:0/3941011984 conn(0x7f3b90068030 msgr2=0x7f3b900b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b96800640 1 -- 172.21.15.144:0/3941011984 shutdown_connections 2024-09-12T12:13:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.368+0000 7f3b96800640 1 -- 172.21.15.144:0/3941011984 wait complete. 2024-09-12T12:13:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 Processor -- start 2024-09-12T12:13:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 -- start start 2024-09-12T12:13:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b900af5d0 0x7f3b900aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b90162a40 0x7f3b9015b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b90166510 0x7f3b9015f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9016fa30 con 0x7f3b90166510 2024-09-12T12:13:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9016f8b0 con 0x7f3b90162a40 2024-09-12T12:13:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3b9016fbb0 con 0x7f3b900af5d0 2024-09-12T12:13:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b90166510 0x7f3b9015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b90166510 0x7f3b9015f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34756/0 (socket says 172.21.15.144:34756) 2024-09-12T12:13:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8fe00640 1 -- 172.21.15.144:0/3459010549 learned_addr learned my addr 172.21.15.144:0/3459010549 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8f400640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b900af5d0 0x7f3b900aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8ea00640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b90162a40 0x7f3b9015b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8fe00640 1 -- 172.21.15.144:0/3459010549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b900af5d0 msgr2=0x7f3b900aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8fe00640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b900af5d0 0x7f3b900aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8fe00640 1 -- 172.21.15.144:0/3459010549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b90162a40 msgr2=0x7f3b9015b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8fe00640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b90162a40 0x7f3b9015b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8fe00640 1 -- 172.21.15.144:0/3459010549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b90072770 con 0x7f3b90166510 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b8fe00640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b90166510 0x7f3b9015f610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800e930 tx=0x7f3b8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b87400640 1 -- 172.21.15.144:0/3459010549 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88017070 con 0x7f3b90166510 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b87400640 1 -- 172.21.15.144:0/3459010549 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8800c9a0 con 0x7f3b90166510 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b87400640 1 -- 172.21.15.144:0/3459010549 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800cd70 con 0x7f3b90166510 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b90072a50 con 0x7f3b90166510 2024-09-12T12:13:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.372+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b9015c310 con 0x7f3b90166510 2024-09-12T12:13:41.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.376+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b90072f70 con 0x7f3b90166510 2024-09-12T12:13:41.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.376+0000 7f3b87400640 1 -- 172.21.15.144:0/3459010549 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3b8801a070 con 0x7f3b90166510 2024-09-12T12:13:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.376+0000 7f3b87400640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b700678c0 0x7f3b70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.376+0000 7f3b87400640 1 -- 172.21.15.144:0/3459010549 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7f3b88086410 con 0x7f3b90166510 2024-09-12T12:13:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.376+0000 7f3b8f400640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b700678c0 0x7f3b70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.376+0000 7f3b8f400640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b700678c0 0x7f3b70069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b800012f0 tx=0x7f3b80009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:41.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.380+0000 7f3b87400640 1 -- 172.21.15.144:0/3459010549 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3b880569f0 con 0x7f3b90166510 2024-09-12T12:13:41.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:41.540+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3b900cf190 con 0x7f3b90166510 2024-09-12T12:13:42.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.196+0000 7f3b87400640 1 -- 172.21.15.144:0/3459010549 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7f3b8805acf0 con 0x7f3b90166510 2024-09-12T12:13:42.200 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b700678c0 msgr2=0x7f3b70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b700678c0 0x7f3b70069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3b800012f0 tx=0x7f3b80009040 comp rx=0 tx=0).stop 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b90166510 msgr2=0x7f3b9015f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b90166510 0x7f3b9015f610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800e930 tx=0x7f3b8800edf0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 shutdown_connections 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3b700678c0 0x7f3b70069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b90166510 0x7f3b9015f610 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b90162a40 0x7f3b9015b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 --2- 172.21.15.144:0/3459010549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b900af5d0 0x7f3b900aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 >> 172.21.15.144:0/3459010549 conn(0x7f3b90068030 msgr2=0x7f3b9006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:42.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 shutdown_connections 2024-09-12T12:13:42.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.200+0000 7f3b96800640 1 -- 172.21.15.144:0/3459010549 wait complete. 2024-09-12T12:13:42.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:13:42.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:13:42.295 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:13:42.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.384+0000 7f166b200640 1 Processor -- start 2024-09-12T12:13:42.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.384+0000 7f166b200640 1 -- start start 2024-09-12T12:13:42.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.384+0000 7f166b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f166c0d2180 0x7f166c0d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:42.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.384+0000 7f166b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c073280 0x7f166c0736b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:42.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.384+0000 7f166b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c0d2b50 con 0x7f166c156750 2024-09-12T12:13:42.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.384+0000 7f166b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f166c15cbf0 con 0x7f166c0d2180 2024-09-12T12:13:42.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.384+0000 7f166b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f166c15ced0 con 0x7f166c073280 2024-09-12T12:13:42.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f166a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c073280 0x7f166c0736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:42.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f1663e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f166c0d2180 0x7f166c0d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:42.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f166a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c073280 0x7f166c0736b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:37610/0 (socket says 172.21.15.144:37610) 2024-09-12T12:13:42.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f166a800640 1 -- 172.21.15.144:0/964847536 learned_addr learned my addr 172.21.15.144:0/964847536 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:42.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f166a800640 1 -- 172.21.15.144:0/964847536 >> v2:172.21.15.165:3300/0 conn(0x7f166c0d2180 msgr2=0x7f166c0d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:42.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f166a800640 1 --2- 172.21.15.144:0/964847536 >> v2:172.21.15.165:3300/0 conn(0x7f166c0d2180 0x7f166c0d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f166a800640 1 -- 172.21.15.144:0/964847536 >> v1:172.21.15.165:6789/0 conn(0x7f166c156750 legacy=0x7f166c06fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:42.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f166a800640 1 -- 172.21.15.144:0/964847536 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c15d1b0 con 0x7f166c073280 2024-09-12T12:13:42.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f166a800640 1 --2- 172.21.15.144:0/964847536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c073280 0x7f166c0736b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1664009e50 tx=0x7f166401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fb2855ac3daef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:42.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f1669400640 1 -- 172.21.15.144:0/964847536 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16640a5920 con 0x7f166c073280 2024-09-12T12:13:42.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f1669400640 1 -- 172.21.15.144:0/964847536 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16640a5ac0 con 0x7f166c073280 2024-09-12T12:13:42.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.388+0000 7f1669400640 1 -- 172.21.15.144:0/964847536 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16640ad3f0 con 0x7f166c073280 2024-09-12T12:13:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 -- 172.21.15.144:0/964847536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c073280 msgr2=0x7f166c0736b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 --2- 172.21.15.144:0/964847536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c073280 0x7f166c0736b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1664009e50 tx=0x7f166401ca30 comp rx=0 tx=0).stop 2024-09-12T12:13:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 -- 172.21.15.144:0/964847536 shutdown_connections 2024-09-12T12:13:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 --2- 172.21.15.144:0/964847536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c073280 0x7f166c0736b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 --2- 172.21.15.144:0/964847536 >> v2:172.21.15.165:3300/0 conn(0x7f166c0d2180 0x7f166c0d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 -- 172.21.15.144:0/964847536 >> 172.21.15.144:0/964847536 conn(0x7f166c067a00 msgr2=0x7f166c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 -- 172.21.15.144:0/964847536 shutdown_connections 2024-09-12T12:13:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 -- 172.21.15.144:0/964847536 wait complete. 2024-09-12T12:13:42.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 Processor -- start 2024-09-12T12:13:42.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 -- start start 2024-09-12T12:13:42.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f166c073280 0x7f166c153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:42.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c0d2180 0x7f166c15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:42.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c156750 0x7f166c06d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:42.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f166c0701c0 con 0x7f166c073280 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f166c15c8a0 con 0x7f166c0d2180 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f166c070340 con 0x7f166c156750 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f1669e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f166c073280 0x7f166c153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f1669e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f166c073280 0x7f166c153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34766/0 (socket says 172.21.15.144:34766) 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f1669e00640 1 -- 172.21.15.144:0/176211910 learned_addr learned my addr 172.21.15.144:0/176211910 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166a800640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c156750 0x7f166c06d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f1663e00640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c0d2180 0x7f166c15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f1669e00640 1 -- 172.21.15.144:0/176211910 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c156750 msgr2=0x7f166c06d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f1669e00640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c156750 0x7f166c06d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f1669e00640 1 -- 172.21.15.144:0/176211910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c0d2180 msgr2=0x7f166c15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f1669e00640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c0d2180 0x7f166c15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f1669e00640 1 -- 172.21.15.144:0/176211910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c06e4c0 con 0x7f166c073280 2024-09-12T12:13:42.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.392+0000 7f166a800640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c156750 0x7f166c06d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:42.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f1669e00640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f166c073280 0x7f166c153d50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f165c007fd0 tx=0x7f165c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:42.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f1662000640 1 -- 172.21.15.144:0/176211910 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c017070 con 0x7f166c073280 2024-09-12T12:13:42.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f1662000640 1 -- 172.21.15.144:0/176211910 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c0052d0 con 0x7f166c073280 2024-09-12T12:13:42.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c0b59d0 con 0x7f166c073280 2024-09-12T12:13:42.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f1662000640 1 -- 172.21.15.144:0/176211910 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c003840 con 0x7f166c073280 2024-09-12T12:13:42.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c154290 con 0x7f166c073280 2024-09-12T12:13:42.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c156bc0 con 0x7f166c073280 2024-09-12T12:13:42.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f1662000640 1 -- 172.21.15.144:0/176211910 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f165c01a070 con 0x7f166c073280 2024-09-12T12:13:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f1662000640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16480678c0 0x7f1648069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f1662000640 1 -- 172.21.15.144:0/176211910 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f165c085170 con 0x7f166c073280 2024-09-12T12:13:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.396+0000 7f1663e00640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16480678c0 0x7f1648069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.400+0000 7f1663e00640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16480678c0 0x7f1648069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f166c14fbc0 tx=0x7f1654009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:42.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.404+0000 7f1662000640 1 -- 172.21.15.144:0/176211910 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f165c005480 con 0x7f166c073280 2024-09-12T12:13:42.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:42.592+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f166c0b60d0 con 0x7f166c073280 2024-09-12T12:13:43.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.200+0000 7f1662000640 1 -- 172.21.15.144:0/176211910 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7f165c055490 con 0x7f166c073280 2024-09-12T12:13:43.202 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 5 and data pool 6 2024-09-12T12:13:43.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16480678c0 msgr2=0x7f1648069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16480678c0 0x7f1648069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f166c14fbc0 tx=0x7f1654009190 comp rx=0 tx=0).stop 2024-09-12T12:13:43.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f166c073280 msgr2=0x7f166c153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f166c073280 0x7f166c153d50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f165c007fd0 tx=0x7f165c00c890 comp rx=0 tx=0).stop 2024-09-12T12:13:43.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 shutdown_connections 2024-09-12T12:13:43.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16480678c0 0x7f1648069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f166c156750 0x7f166c06d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c0d2180 0x7f166c15dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 --2- 172.21.15.144:0/176211910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f166c073280 0x7f166c153d50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.204+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 >> 172.21.15.144:0/176211910 conn(0x7f166c067a00 msgr2=0x7f166c06fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.208+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 shutdown_connections 2024-09-12T12:13:43.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.208+0000 7f166b200640 1 -- 172.21.15.144:0/176211910 wait complete. 2024-09-12T12:13:43.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:43.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef9200640 1 Processor -- start 2024-09-12T12:13:43.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef9200640 1 -- start start 2024-09-12T12:13:43.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 0x7fdef415c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef9200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef40b55b0 con 0x7fdef40b2f20 2024-09-12T12:13:43.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef9200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef40b52d0 con 0x7fdef415e850 2024-09-12T12:13:43.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef9200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdef4072990 con 0x7fdef40b4da0 2024-09-12T12:13:43.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef3e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdef40b2f20 0x7fdef4073470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45246/0 (socket says 172.21.15.144:45246) 2024-09-12T12:13:43.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef3e00640 1 -- 172.21.15.144:0/77156225 learned_addr learned my addr 172.21.15.144:0/77156225 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:43.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef2a00640 1 --2- 172.21.15.144:0/77156225 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 0x7fdef415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef2000640 1 -- 172.21.15.144:0/77156225 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435109371 0 0) 0x7fdeec001120 con 0x7fdef40b2f20 2024-09-12T12:13:43.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef2000640 1 -- 172.21.15.144:0/77156225 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fded8005740 con 0x7fdef40b2f20 2024-09-12T12:13:43.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef2000640 1 -- 172.21.15.144:0/77156225 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2819826151 0 0) 0x7fdef40b52d0 con 0x7fdef415e850 2024-09-12T12:13:43.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef2000640 1 -- 172.21.15.144:0/77156225 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeec001120 con 0x7fdef415e850 2024-09-12T12:13:43.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef2a00640 1 -- 172.21.15.144:0/77156225 >> v1:172.21.15.165:6789/0 conn(0x7fdef415e850 legacy=0x7fdef406ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef2a00640 1 -- 172.21.15.144:0/77156225 >> v1:172.21.15.144:6789/0 conn(0x7fdef40b2f20 legacy=0x7fdef4073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.388+0000 7fdef2a00640 1 -- 172.21.15.144:0/77156225 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef4072c70 con 0x7fdef40b4da0 2024-09-12T12:13:43.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef2a00640 1 --2- 172.21.15.144:0/77156225 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 0x7fdef415c870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdee00097f0 tx=0x7fdee001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9cc48765e24f53d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:43.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef2000640 1 -- 172.21.15.144:0/77156225 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00b5070 con 0x7fdef40b4da0 2024-09-12T12:13:43.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef2000640 1 -- 172.21.15.144:0/77156225 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee00a89d0 con 0x7fdef40b4da0 2024-09-12T12:13:43.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef2000640 1 -- 172.21.15.144:0/77156225 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00a8d80 con 0x7fdef40b4da0 2024-09-12T12:13:43.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef9200640 1 -- 172.21.15.144:0/77156225 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 msgr2=0x7fdef415c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef9200640 1 --2- 172.21.15.144:0/77156225 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 0x7fdef415c870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdee00097f0 tx=0x7fdee001ecd0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef9200640 1 -- 172.21.15.144:0/77156225 shutdown_connections 2024-09-12T12:13:43.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef9200640 1 --2- 172.21.15.144:0/77156225 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 0x7fdef415c870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef9200640 1 -- 172.21.15.144:0/77156225 >> 172.21.15.144:0/77156225 conn(0x7fdef406e200 msgr2=0x7fdef406e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:43.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef9200640 1 -- 172.21.15.144:0/77156225 shutdown_connections 2024-09-12T12:13:43.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.392+0000 7fdef9200640 1 -- 172.21.15.144:0/77156225 wait complete. 2024-09-12T12:13:43.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 Processor -- start 2024-09-12T12:13:43.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 -- start start 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40b2f20 0x7fdef4150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 0x7fdef415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdef415e850 0x7fdef415a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdef40b34d0 con 0x7fdef40b2f20 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdef40b3350 con 0x7fdef415e850 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdef40b3650 con 0x7fdef40b4da0 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40b2f20 0x7fdef4150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40b2f20 0x7fdef4150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34778/0 (socket says 172.21.15.144:34778) 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3400640 1 -- 172.21.15.144:0/1491264744 learned_addr learned my addr 172.21.15.144:0/1491264744 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:43.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef2a00640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 0x7fdef415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3e00640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdef415e850 0x7fdef415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3400640 1 -- 172.21.15.144:0/1491264744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 msgr2=0x7fdef415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3400640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 0x7fdef415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3400640 1 -- 172.21.15.144:0/1491264744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdef415e850 msgr2=0x7fdef415a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3400640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdef415e850 0x7fdef415a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3400640 1 -- 172.21.15.144:0/1491264744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef4158710 con 0x7fdef40b2f20 2024-09-12T12:13:43.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef3400640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40b2f20 0x7fdef4150860 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c870 tx=0x7fdee400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:43.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdeeb400640 1 -- 172.21.15.144:0/1491264744 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4003b80 con 0x7fdef40b2f20 2024-09-12T12:13:43.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdeeb400640 1 -- 172.21.15.144:0/1491264744 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee4003d20 con 0x7fdef40b2f20 2024-09-12T12:13:43.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef41589f0 con 0x7fdef40b2f20 2024-09-12T12:13:43.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdeeb400640 1 -- 172.21.15.144:0/1491264744 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee400aa30 con 0x7fdef40b2f20 2024-09-12T12:13:43.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.396+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef4158fb0 con 0x7fdef40b2f20 2024-09-12T12:13:43.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.400+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef41efd00 con 0x7fdef40b2f20 2024-09-12T12:13:43.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.400+0000 7fdeeb400640 1 -- 172.21.15.144:0/1491264744 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdee400abd0 con 0x7fdef40b2f20 2024-09-12T12:13:43.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.400+0000 7fdeeb400640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fded40678c0 0x7fded4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.400+0000 7fdeeb400640 1 -- 172.21.15.144:0/1491264744 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fdee4085dc0 con 0x7fdef40b2f20 2024-09-12T12:13:43.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.400+0000 7fdef2a00640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fded40678c0 0x7fded4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.400+0000 7fdef2a00640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fded40678c0 0x7fded4069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdee00b2000 tx=0x7fdee00aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:43.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.404+0000 7fdeeb400640 1 -- 172.21.15.144:0/1491264744 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdee4056760 con 0x7fdef40b2f20 2024-09-12T12:13:43.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.564+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdef415cd60 con 0x7fdef40b2f20 2024-09-12T12:13:43.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.564+0000 7fdeeb400640 1 -- 172.21.15.144:0/1491264744 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17039 (secure 0 0 0) 0x7fdee4056060 con 0x7fdef40b2f20 2024-09-12T12:13:43.567 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:43.567 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":38,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:13:42.597205+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:13:40.307199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T12:13:41.588661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fded40678c0 msgr2=0x7fded4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fded40678c0 0x7fded4069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdee00b2000 tx=0x7fdee00aa070 comp rx=0 tx=0).stop 2024-09-12T12:13:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40b2f20 msgr2=0x7fdef4150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40b2f20 0x7fdef4150860 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c870 tx=0x7fdee400cd30 comp rx=0 tx=0).stop 2024-09-12T12:13:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 shutdown_connections 2024-09-12T12:13:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fded40678c0 0x7fded4069d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdef415e850 0x7fdef415a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdef40b4da0 0x7fdef415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 --2- 172.21.15.144:0/1491264744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdef40b2f20 0x7fdef4150860 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 >> 172.21.15.144:0/1491264744 conn(0x7fdef406e200 msgr2=0x7fdef415d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 shutdown_connections 2024-09-12T12:13:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.568+0000 7fdef9200640 1 -- 172.21.15.144:0/1491264744 wait complete. 2024-09-12T12:13:43.588 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:43.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.720+0000 7f78e7600640 1 Processor -- start 2024-09-12T12:13:43.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.720+0000 7f78e7600640 1 -- start start 2024-09-12T12:13:43.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78e7600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e00cd640 0x7f78e0071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78e7600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e00b45a0 con 0x7f78e0071420 2024-09-12T12:13:43.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78e7600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e00b3fe0 con 0x7f78e015b4e0 2024-09-12T12:13:43.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78e7600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f78e00b42c0 con 0x7f78e00cd640 2024-09-12T12:13:43.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78dfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f78e0071420 0x7f78e00ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45254/0 (socket says 172.21.15.144:45254) 2024-09-12T12:13:43.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78dfe00640 1 -- 172.21.15.144:0/1576804743 learned_addr learned my addr 172.21.15.144:0/1576804743 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:43.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78e5600640 1 --2- 172.21.15.144:0/1576804743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e00cd640 0x7f78e0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78df400640 1 -- 172.21.15.144:0/1576804743 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157661963 0 0) 0x7f78e00b45a0 con 0x7f78e0071420 2024-09-12T12:13:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78df400640 1 -- 172.21.15.144:0/1576804743 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78c4003530 con 0x7f78e0071420 2024-09-12T12:13:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78df400640 1 -- 172.21.15.144:0/1576804743 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707144929 0 0) 0x7f78e00b3fe0 con 0x7f78e015b4e0 2024-09-12T12:13:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78df400640 1 -- 172.21.15.144:0/1576804743 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78e00b45a0 con 0x7f78e015b4e0 2024-09-12T12:13:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78e5600640 1 -- 172.21.15.144:0/1576804743 >> v1:172.21.15.165:6789/0 conn(0x7f78e015b4e0 legacy=0x7f78e00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78e5600640 1 -- 172.21.15.144:0/1576804743 >> v1:172.21.15.144:6789/0 conn(0x7f78e0071420 legacy=0x7f78e00ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.724+0000 7f78e5600640 1 -- 172.21.15.144:0/1576804743 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e00b1490 con 0x7f78e00cd640 2024-09-12T12:13:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e5600640 1 --2- 172.21.15.144:0/1576804743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e00cd640 0x7f78e0071840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f78d80097f0 tx=0x7f78d801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25cc75b08d7f573 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78df400640 1 -- 172.21.15.144:0/1576804743 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80ab640 con 0x7f78e00cd640 2024-09-12T12:13:43.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78df400640 1 -- 172.21.15.144:0/1576804743 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d80b0070 con 0x7f78e00cd640 2024-09-12T12:13:43.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78df400640 1 -- 172.21.15.144:0/1576804743 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80ab9e0 con 0x7f78e00cd640 2024-09-12T12:13:43.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e7600640 1 -- 172.21.15.144:0/1576804743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e00cd640 msgr2=0x7f78e0071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e7600640 1 --2- 172.21.15.144:0/1576804743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e00cd640 0x7f78e0071840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f78d80097f0 tx=0x7f78d801c4b0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e7600640 1 -- 172.21.15.144:0/1576804743 shutdown_connections 2024-09-12T12:13:43.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e7600640 1 --2- 172.21.15.144:0/1576804743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e00cd640 0x7f78e0071840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e7600640 1 -- 172.21.15.144:0/1576804743 >> 172.21.15.144:0/1576804743 conn(0x7f78e006d0d0 msgr2=0x7f78e006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e7600640 1 -- 172.21.15.144:0/1576804743 shutdown_connections 2024-09-12T12:13:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e7600640 1 -- 172.21.15.144:0/1576804743 wait complete. 2024-09-12T12:13:43.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e7600640 1 Processor -- start 2024-09-12T12:13:43.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.728+0000 7f78e7600640 1 -- start start 2024-09-12T12:13:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e7600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e0071420 0x7f78e0152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e7600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e00cd640 0x7f78e014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e7600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e015b4e0 0x7f78e014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e7600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f78e015b8c0 con 0x7f78e00cd640 2024-09-12T12:13:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e7600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78e00b02e0 con 0x7f78e0071420 2024-09-12T12:13:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e7600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f78e014dd60 con 0x7f78e015b4e0 2024-09-12T12:13:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e00cd640 0x7f78e014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e00cd640 0x7f78e014e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34782/0 (socket says 172.21.15.144:34782) 2024-09-12T12:13:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dfe00640 1 -- 172.21.15.144:0/681006462 learned_addr learned my addr 172.21.15.144:0/681006462 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e5600640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e015b4e0 0x7f78e014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dfe00640 1 -- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e015b4e0 msgr2=0x7f78e014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e4c00640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e0071420 0x7f78e0152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dfe00640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e015b4e0 0x7f78e014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dfe00640 1 -- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e0071420 msgr2=0x7f78e0152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dfe00640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e0071420 0x7f78e0152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dfe00640 1 -- 172.21.15.144:0/681006462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e0158000 con 0x7f78e00cd640 2024-09-12T12:13:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e5600640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e015b4e0 0x7f78e014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e4c00640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e0071420 0x7f78e0152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dfe00640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e00cd640 0x7f78e014e4d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c520 tx=0x7f78cc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dcc00640 1 -- 172.21.15.144:0/681006462 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc017070 con 0x7f78e00cd640 2024-09-12T12:13:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dcc00640 1 -- 172.21.15.144:0/681006462 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc005cf0 con 0x7f78e00cd640 2024-09-12T12:13:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e01582e0 con 0x7f78e00cd640 2024-09-12T12:13:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dcc00640 1 -- 172.21.15.144:0/681006462 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc007270 con 0x7f78e00cd640 2024-09-12T12:13:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e014dfb0 con 0x7f78e00cd640 2024-09-12T12:13:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e0071800 con 0x7f78e00cd640 2024-09-12T12:13:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.732+0000 7f78dcc00640 1 -- 172.21.15.144:0/681006462 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78cc01a070 con 0x7f78e00cd640 2024-09-12T12:13:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.736+0000 7f78dcc00640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c00678c0 0x7f78c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.736+0000 7f78dcc00640 1 -- 172.21.15.144:0/681006462 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f78cc085200 con 0x7f78e00cd640 2024-09-12T12:13:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.736+0000 7f78e4c00640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c00678c0 0x7f78c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:43.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.736+0000 7f78e4c00640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c00678c0 0x7f78c0069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f78d0001570 tx=0x7f78d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:43.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.740+0000 7f78dcc00640 1 -- 172.21.15.144:0/681006462 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f78cc0554c0 con 0x7f78e00cd640 2024-09-12T12:13:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.896+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78e0157ce0 con 0x7f78e00cd640 2024-09-12T12:13:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78dcc00640 1 -- 172.21.15.144:0/681006462 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17039 (secure 0 0 0) 0x7f78cc0597c0 con 0x7f78e00cd640 2024-09-12T12:13:43.901 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:43.901 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":38,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:13:42.597205+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:13:40.307199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T12:13:41.588661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c00678c0 msgr2=0x7f78c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c00678c0 0x7f78c0069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f78d0001570 tx=0x7f78d0009040 comp rx=0 tx=0).stop 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e00cd640 msgr2=0x7f78e014e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e00cd640 0x7f78e014e4d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c520 tx=0x7f78cc00c9e0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 shutdown_connections 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c00678c0 0x7f78c0069d80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e015b4e0 0x7f78e014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e00cd640 0x7f78e014e4d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 --2- 172.21.15.144:0/681006462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e0071420 0x7f78e0152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:43.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 >> 172.21.15.144:0/681006462 conn(0x7f78e006d0d0 msgr2=0x7f78e0156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:43.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 shutdown_connections 2024-09-12T12:13:43.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:43.900+0000 7f78e7600640 1 -- 172.21.15.144:0/681006462 wait complete. 2024-09-12T12:13:43.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:13:44.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f3d800640 1 Processor -- start 2024-09-12T12:13:44.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f3d800640 1 -- start start 2024-09-12T12:13:44.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f3d800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f3806d0f0 0x7f8f3806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f3d800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8f380ccdc0 0x7f8f380cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f3d800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3806da10 con 0x7f8f380b32f0 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f3d800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8f380b38b0 con 0x7f8f3806d0f0 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f3d800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8f380b3b90 con 0x7f8f380ccdc0 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f36a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f3806d0f0 0x7f8f3806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f36a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f3806d0f0 0x7f8f3806d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34792/0 (socket says 172.21.15.144:34792) 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f36000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8f380b32f0 0x7f8f3815b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45260/0 (socket says 172.21.15.144:45260) 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f36a00640 1 -- 172.21.15.144:0/2602164344 learned_addr learned my addr 172.21.15.144:0/2602164344 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f37400640 1 --2- 172.21.15.144:0/2602164344 >> v2:172.21.15.165:3300/0 conn(0x7f8f380ccdc0 0x7f8f380cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f36a00640 1 -- 172.21.15.144:0/2602164344 >> v2:172.21.15.165:3300/0 conn(0x7f8f380ccdc0 msgr2=0x7f8f380cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f36a00640 1 --2- 172.21.15.144:0/2602164344 >> v2:172.21.15.165:3300/0 conn(0x7f8f380ccdc0 0x7f8f380cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f36a00640 1 -- 172.21.15.144:0/2602164344 >> v1:172.21.15.144:6789/0 conn(0x7f8f380b32f0 legacy=0x7f8f3815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:44.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.060+0000 7f8f36a00640 1 -- 172.21.15.144:0/2602164344 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f380b3e70 con 0x7f8f3806d0f0 2024-09-12T12:13:44.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f36a00640 1 --2- 172.21.15.144:0/2602164344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f3806d0f0 0x7f8f3806d4d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f38070d00 tx=0x7f8f2801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6515dad4e74daedb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:44.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f35600640 1 -- 172.21.15.144:0/2602164344 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f280b4070 con 0x7f8f3806d0f0 2024-09-12T12:13:44.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f35600640 1 -- 172.21.15.144:0/2602164344 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f280a7ac0 con 0x7f8f3806d0f0 2024-09-12T12:13:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f35600640 1 -- 172.21.15.144:0/2602164344 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f280af440 con 0x7f8f3806d0f0 2024-09-12T12:13:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 -- 172.21.15.144:0/2602164344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f3806d0f0 msgr2=0x7f8f3806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 --2- 172.21.15.144:0/2602164344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f3806d0f0 0x7f8f3806d4d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8f38070d00 tx=0x7f8f2801eb60 comp rx=0 tx=0).stop 2024-09-12T12:13:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 -- 172.21.15.144:0/2602164344 shutdown_connections 2024-09-12T12:13:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 --2- 172.21.15.144:0/2602164344 >> v2:172.21.15.165:3300/0 conn(0x7f8f380ccdc0 0x7f8f380cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 --2- 172.21.15.144:0/2602164344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f3806d0f0 0x7f8f3806d4d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 -- 172.21.15.144:0/2602164344 >> 172.21.15.144:0/2602164344 conn(0x7f8f38068030 msgr2=0x7f8f380b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 -- 172.21.15.144:0/2602164344 shutdown_connections 2024-09-12T12:13:44.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 -- 172.21.15.144:0/2602164344 wait complete. 2024-09-12T12:13:44.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 Processor -- start 2024-09-12T12:13:44.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.064+0000 7f8f3d800640 1 -- start start 2024-09-12T12:13:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f3d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f3806d0f0 0x7f8f381441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f3d800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f380b32f0 0x7f8f3815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f3d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f380ccdc0 0x7f8f38156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f3d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8f380cdb40 con 0x7f8f380ccdc0 2024-09-12T12:13:44.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f3d800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f380cd9c0 con 0x7f8f380b32f0 2024-09-12T12:13:44.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f3d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8f380cdcc0 con 0x7f8f3806d0f0 2024-09-12T12:13:44.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f380ccdc0 0x7f8f38156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f380ccdc0 0x7f8f38156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34802/0 (socket says 172.21.15.144:34802) 2024-09-12T12:13:44.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f37400640 1 -- 172.21.15.144:0/2139954696 learned_addr learned my addr 172.21.15.144:0/2139954696 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:44.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f36a00640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f3806d0f0 0x7f8f381441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f36000640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f380b32f0 0x7f8f3815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f37400640 1 -- 172.21.15.144:0/2139954696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f3806d0f0 msgr2=0x7f8f381441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:44.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f37400640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f3806d0f0 0x7f8f381441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f37400640 1 -- 172.21.15.144:0/2139954696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f380b32f0 msgr2=0x7f8f3815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f37400640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f380b32f0 0x7f8f3815b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f37400640 1 -- 172.21.15.144:0/2139954696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f38144730 con 0x7f8f380ccdc0 2024-09-12T12:13:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f37400640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f380ccdc0 0x7f8f38156800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000efc0 tx=0x7f8f3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f2ea00640 1 -- 172.21.15.144:0/2139954696 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30018020 con 0x7f8f380ccdc0 2024-09-12T12:13:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f2ea00640 1 -- 172.21.15.144:0/2139954696 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f30014480 con 0x7f8f380ccdc0 2024-09-12T12:13:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f38159ca0 con 0x7f8f380ccdc0 2024-09-12T12:13:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f2ea00640 1 -- 172.21.15.144:0/2139954696 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30014870 con 0x7f8f380ccdc0 2024-09-12T12:13:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3815a540 con 0x7f8f380ccdc0 2024-09-12T12:13:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.068+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f380ce050 con 0x7f8f380ccdc0 2024-09-12T12:13:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.072+0000 7f8f2ea00640 1 -- 172.21.15.144:0/2139954696 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f3001b020 con 0x7f8f380ccdc0 2024-09-12T12:13:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.072+0000 7f8f2ea00640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f180678c0 0x7f8f18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.072+0000 7f8f2ea00640 1 -- 172.21.15.144:0/2139954696 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f8f30086910 con 0x7f8f380ccdc0 2024-09-12T12:13:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.072+0000 7f8f36a00640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f180678c0 0x7f8f18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.072+0000 7f8f36a00640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f180678c0 0x7f8f18069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f280b1000 tx=0x7f8f28008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:44.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.076+0000 7f8f2ea00640 1 -- 172.21.15.144:0/2139954696 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f30022070 con 0x7f8f380ccdc0 2024-09-12T12:13:44.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:44.268+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8f38156270 con 0x7f8f380ccdc0 2024-09-12T12:13:45.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.232+0000 7f8f2ea00640 1 -- 172.21.15.144:0/2139954696 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f8f30010040 con 0x7f8f380ccdc0 2024-09-12T12:13:45.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f180678c0 msgr2=0x7f8f18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:45.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f180678c0 0x7f8f18069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f280b1000 tx=0x7f8f28008040 comp rx=0 tx=0).stop 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f380ccdc0 msgr2=0x7f8f38156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f380ccdc0 0x7f8f38156800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000efc0 tx=0x7f8f3000c490 comp rx=0 tx=0).stop 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 shutdown_connections 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f180678c0 0x7f8f18069d80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f380ccdc0 0x7f8f38156800 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f380b32f0 0x7f8f3815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 --2- 172.21.15.144:0/2139954696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f3806d0f0 0x7f8f381441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 >> 172.21.15.144:0/2139954696 conn(0x7f8f38068030 msgr2=0x7f8f380b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 shutdown_connections 2024-09-12T12:13:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.236+0000 7f8f3d800640 1 -- 172.21.15.144:0/2139954696 wait complete. 2024-09-12T12:13:45.565 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:13:45.566 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:13:45.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6d1e00640 1 Processor -- start 2024-09-12T12:13:45.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6d1e00640 1 -- start start 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6d1e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 0x7fa6cc073b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6d1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6cc0d2b30 0x7fa6cc0d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6d1e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6cc15cd10 con 0x7fa6cc160bf0 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6d1e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa6cc15d640 con 0x7fa6cc0d2b30 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6d1e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6cc15cff0 con 0x7fa6cc15c3b0 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6cc0d2b30 0x7fa6cc0d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6cc0d2b30 0x7fa6cc0d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34804/0 (socket says 172.21.15.144:34804) 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6cb400640 1 -- 172.21.15.144:0/1338455539 learned_addr learned my addr 172.21.15.144:0/1338455539 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6caa00640 1 --2- 172.21.15.144:0/1338455539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 0x7fa6cc073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6cb400640 1 -- 172.21.15.144:0/1338455539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 msgr2=0x7fa6cc073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6cb400640 1 --2- 172.21.15.144:0/1338455539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 0x7fa6cc073b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6cb400640 1 -- 172.21.15.144:0/1338455539 >> v1:172.21.15.165:6789/0 conn(0x7fa6cc160bf0 legacy=0x7fa6cc0d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.704+0000 7fa6cb400640 1 -- 172.21.15.144:0/1338455539 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc15d2d0 con 0x7fa6cc0d2b30 2024-09-12T12:13:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6cb400640 1 --2- 172.21.15.144:0/1338455539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc0d2b30 0x7fa6cc0d02b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009870 tx=0x7fa6c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d68b05c52c0dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:45.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6c9600640 1 -- 172.21.15.144:0/1338455539 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40ab620 con 0x7fa6cc0d2b30 2024-09-12T12:13:45.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6c9600640 1 -- 172.21.15.144:0/1338455539 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c40b0070 con 0x7fa6cc0d2b30 2024-09-12T12:13:45.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6c9600640 1 -- 172.21.15.144:0/1338455539 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40ab9e0 con 0x7fa6cc0d2b30 2024-09-12T12:13:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6d1e00640 1 -- 172.21.15.144:0/1338455539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc0d2b30 msgr2=0x7fa6cc0d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6d1e00640 1 --2- 172.21.15.144:0/1338455539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc0d2b30 0x7fa6cc0d02b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009870 tx=0x7fa6c401c520 comp rx=0 tx=0).stop 2024-09-12T12:13:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6d1e00640 1 -- 172.21.15.144:0/1338455539 shutdown_connections 2024-09-12T12:13:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6d1e00640 1 --2- 172.21.15.144:0/1338455539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc0d2b30 0x7fa6cc0d02b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6d1e00640 1 --2- 172.21.15.144:0/1338455539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 0x7fa6cc073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6d1e00640 1 -- 172.21.15.144:0/1338455539 >> 172.21.15.144:0/1338455539 conn(0x7fa6cc06c010 msgr2=0x7fa6cc067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6d1e00640 1 -- 172.21.15.144:0/1338455539 shutdown_connections 2024-09-12T12:13:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.708+0000 7fa6d1e00640 1 -- 172.21.15.144:0/1338455539 wait complete. 2024-09-12T12:13:45.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 Processor -- start 2024-09-12T12:13:45.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 -- start start 2024-09-12T12:13:45.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6cc0d2b30 0x7fa6cc157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:45.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 0x7fa6cc155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:45.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc160bf0 0x7fa6cc155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:45.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc0d1390 con 0x7fa6cc160bf0 2024-09-12T12:13:45.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc0d1210 con 0x7fa6cc0d2b30 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6cc0d1510 con 0x7fa6cc15c3b0 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc160bf0 0x7fa6cc155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc160bf0 0x7fa6cc155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34808/0 (socket says 172.21.15.144:34808) 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6cb400640 1 -- 172.21.15.144:0/3270630260 learned_addr learned my addr 172.21.15.144:0/3270630260 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6ca000640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 0x7fa6cc155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6caa00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6cc0d2b30 0x7fa6cc157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6cb400640 1 -- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 msgr2=0x7fa6cc155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6cb400640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 0x7fa6cc155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6cb400640 1 -- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6cc0d2b30 msgr2=0x7fa6cc157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6cb400640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6cc0d2b30 0x7fa6cc157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:45.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6cb400640 1 -- 172.21.15.144:0/3270630260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc159c40 con 0x7fa6cc160bf0 2024-09-12T12:13:45.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6caa00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6cc0d2b30 0x7fa6cc157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:45.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6ca000640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 0x7fa6cc155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:45.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6cb400640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc160bf0 0x7fa6cc155640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40ad040 tx=0x7fa6c401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:45.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6c3400640 1 -- 172.21.15.144:0/3270630260 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40be3f0 con 0x7fa6cc160bf0 2024-09-12T12:13:45.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6c3400640 1 -- 172.21.15.144:0/3270630260 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c40be590 con 0x7fa6cc160bf0 2024-09-12T12:13:45.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6c3400640 1 -- 172.21.15.144:0/3270630260 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40be980 con 0x7fa6cc160bf0 2024-09-12T12:13:45.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6cc159f20 con 0x7fa6cc160bf0 2024-09-12T12:13:45.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.712+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6cc15a4e0 con 0x7fa6cc160bf0 2024-09-12T12:13:45.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.716+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6cc0d02b0 con 0x7fa6cc160bf0 2024-09-12T12:13:45.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.716+0000 7fa6c3400640 1 -- 172.21.15.144:0/3270630260 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6c40b43f0 con 0x7fa6cc160bf0 2024-09-12T12:13:45.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.716+0000 7fa6c3400640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6ac0678c0 0x7fa6ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:45.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.716+0000 7fa6c3400640 1 -- 172.21.15.144:0/3270630260 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa6c4120300 con 0x7fa6cc160bf0 2024-09-12T12:13:45.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.716+0000 7fa6caa00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6ac0678c0 0x7fa6ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:45.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.716+0000 7fa6caa00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6ac0678c0 0x7fa6ac069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc156090 tx=0x7fa6bc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:45.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.720+0000 7fa6c3400640 1 -- 172.21.15.144:0/3270630260 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa6c40c4060 con 0x7fa6cc160bf0 2024-09-12T12:13:45.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:45.912+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa6cc166c20 con 0x7fa6cc160bf0 2024-09-12T12:13:46.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.240+0000 7fa6c3400640 1 -- 172.21.15.144:0/3270630260 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fa6c4016110 con 0x7fa6cc160bf0 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6ac0678c0 msgr2=0x7fa6ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6ac0678c0 0x7fa6ac069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc156090 tx=0x7fa6bc00b040 comp rx=0 tx=0).stop 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc160bf0 msgr2=0x7fa6cc155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc160bf0 0x7fa6cc155640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40ad040 tx=0x7fa6c401ad60 comp rx=0 tx=0).stop 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 shutdown_connections 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6ac0678c0 0x7fa6ac069d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6cc160bf0 0x7fa6cc155640 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6cc15c3b0 0x7fa6cc155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 --2- 172.21.15.144:0/3270630260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6cc0d2b30 0x7fa6cc157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 >> 172.21.15.144:0/3270630260 conn(0x7fa6cc06c010 msgr2=0x7fa6cc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 shutdown_connections 2024-09-12T12:13:46.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.244+0000 7fa6d1e00640 1 -- 172.21.15.144:0/3270630260 wait complete. 2024-09-12T12:13:46.267 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:13:46.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:46.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.400+0000 7f74f6a00640 1 Processor -- start 2024-09-12T12:13:46.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.400+0000 7f74f6a00640 1 -- start start 2024-09-12T12:13:46.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.400+0000 7f74f6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f015c7b0 0x7f74f00ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.400+0000 7f74f6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74f00b5fb0 0x7f74f0072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.400+0000 7f74f6a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f00cd870 con 0x7f74f015cd30 2024-09-12T12:13:46.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.400+0000 7f74f6a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f74f0072a50 con 0x7f74f00b5fb0 2024-09-12T12:13:46.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.400+0000 7f74f6a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f74f00cde30 con 0x7f74f015c7b0 2024-09-12T12:13:46.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74f4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74f00b5fb0 0x7f74f0072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74f4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74f00b5fb0 0x7f74f0072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34812/0 (socket says 172.21.15.144:34812) 2024-09-12T12:13:46.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74f4a00640 1 -- 172.21.15.144:0/1899332595 learned_addr learned my addr 172.21.15.144:0/1899332595 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:46.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74efe00640 1 --2- 172.21.15.144:0/1899332595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f015c7b0 0x7f74f00ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74f4a00640 1 -- 172.21.15.144:0/1899332595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f015c7b0 msgr2=0x7f74f00ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74f4a00640 1 --2- 172.21.15.144:0/1899332595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f015c7b0 0x7f74f00ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74f4a00640 1 -- 172.21.15.144:0/1899332595 >> v1:172.21.15.165:6789/0 conn(0x7f74f015cd30 legacy=0x7f74f00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74f4a00640 1 -- 172.21.15.144:0/1899332595 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f00cdb50 con 0x7f74f00b5fb0 2024-09-12T12:13:46.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74f4a00640 1 --2- 172.21.15.144:0/1899332595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f00b5fb0 0x7f74f0072ee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009870 tx=0x7f74e801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ad5c96467fd7f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:46.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.404+0000 7f74eea00640 1 -- 172.21.15.144:0/1899332595 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80a7070 con 0x7f74f00b5fb0 2024-09-12T12:13:46.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74eea00640 1 -- 172.21.15.144:0/1899332595 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e80b0070 con 0x7f74f00b5fb0 2024-09-12T12:13:46.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74eea00640 1 -- 172.21.15.144:0/1899332595 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80ab890 con 0x7f74f00b5fb0 2024-09-12T12:13:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 -- 172.21.15.144:0/1899332595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f00b5fb0 msgr2=0x7f74f0072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 --2- 172.21.15.144:0/1899332595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f00b5fb0 0x7f74f0072ee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009870 tx=0x7f74e801c560 comp rx=0 tx=0).stop 2024-09-12T12:13:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 -- 172.21.15.144:0/1899332595 shutdown_connections 2024-09-12T12:13:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 --2- 172.21.15.144:0/1899332595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f00b5fb0 0x7f74f0072ee0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 --2- 172.21.15.144:0/1899332595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f015c7b0 0x7f74f00ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 -- 172.21.15.144:0/1899332595 >> 172.21.15.144:0/1899332595 conn(0x7f74f006d0d0 msgr2=0x7f74f006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:46.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 -- 172.21.15.144:0/1899332595 shutdown_connections 2024-09-12T12:13:46.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 -- 172.21.15.144:0/1899332595 wait complete. 2024-09-12T12:13:46.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 Processor -- start 2024-09-12T12:13:46.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 -- start start 2024-09-12T12:13:46.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f00b5fb0 0x7f74f0151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74f015c7b0 0x7f74f00b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f015cd30 0x7f74f00aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f74f0073fc0 con 0x7f74f015cd30 2024-09-12T12:13:46.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f74f0073e40 con 0x7f74f015c7b0 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f6a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f74f0074140 con 0x7f74f00b5fb0 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74f4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f015cd30 0x7f74f00aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74efe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f00b5fb0 0x7f74f0151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74efe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f00b5fb0 0x7f74f0151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:37686/0 (socket says 172.21.15.144:37686) 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74efe00640 1 -- 172.21.15.144:0/3532392072 learned_addr learned my addr 172.21.15.144:0/3532392072 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.408+0000 7f74ef400640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74f015c7b0 0x7f74f00b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74f4a00640 1 -- 172.21.15.144:0/3532392072 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f00b5fb0 msgr2=0x7f74f0151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74f4a00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f00b5fb0 0x7f74f0151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74f4a00640 1 -- 172.21.15.144:0/3532392072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74f015c7b0 msgr2=0x7f74f00b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74f4a00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74f015c7b0 0x7f74f00b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74f4a00640 1 -- 172.21.15.144:0/3532392072 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f00b1080 con 0x7f74f015cd30 2024-09-12T12:13:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74f4a00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f015cd30 0x7f74f00aea60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f74e80ac000 tx=0x7f74e801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74e7e00640 1 -- 172.21.15.144:0/3532392072 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80be5f0 con 0x7f74f015cd30 2024-09-12T12:13:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74e7e00640 1 -- 172.21.15.144:0/3532392072 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e80be790 con 0x7f74f015cd30 2024-09-12T12:13:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f00b1360 con 0x7f74f015cd30 2024-09-12T12:13:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74e7e00640 1 -- 172.21.15.144:0/3532392072 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80beb80 con 0x7f74f015cd30 2024-09-12T12:13:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f00b1920 con 0x7f74f015cd30 2024-09-12T12:13:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f0072ee0 con 0x7f74f015cd30 2024-09-12T12:13:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74e7e00640 1 -- 172.21.15.144:0/3532392072 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f74e80b43f0 con 0x7f74f015cd30 2024-09-12T12:13:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74e7e00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74d00678c0 0x7f74d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74e7e00640 1 -- 172.21.15.144:0/3532392072 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f74e8120bb0 con 0x7f74f015cd30 2024-09-12T12:13:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.412+0000 7f74efe00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74d00678c0 0x7f74d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.416+0000 7f74efe00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74d00678c0 0x7f74d0069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f74e0007520 tx=0x7f74e0009950 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:46.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.416+0000 7f74e7e00640 1 -- 172.21.15.144:0/3532392072 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f74e80c4060 con 0x7f74f015cd30 2024-09-12T12:13:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74f015e190 con 0x7f74f015cd30 2024-09-12T12:13:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74e7e00640 1 -- 172.21.15.144:0/3532392072 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5235 (secure 0 0 0) 0x7f74e8016150 con 0x7f74f015cd30 2024-09-12T12:13:46.610 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:46.610 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"btime":"2024-09-12T12:13:46:236418+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1734346147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1734346147},{"type":"v1","addr":"172.21.15.144:6835","nonce":1734346147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3346311863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3346311863},{"type":"v1","addr":"172.21.15.165:6834","nonce":3346311863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2564271519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2564271519},{"type":"v1","addr":"172.21.15.165:6835","nonce":2564271519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:13:42.597555+0000","modified":"2024-09-12T12:13:45.914890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/3288752771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3288752771},{"type":"v1","addr":"172.21.15.144:6837","nonce":3288752771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-12T12:13:46.610 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 17 2024-09-12T12:13:46.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74d00678c0 msgr2=0x7f74d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74d00678c0 0x7f74d0069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f74e0007520 tx=0x7f74e0009950 comp rx=0 tx=0).stop 2024-09-12T12:13:46.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f015cd30 msgr2=0x7f74f00aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f015cd30 0x7f74f00aea60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f74e80ac000 tx=0x7f74e801ada0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 shutdown_connections 2024-09-12T12:13:46.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74d00678c0 0x7f74d0069d80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74f015cd30 0x7f74f00aea60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74f015c7b0 0x7f74f00b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 --2- 172.21.15.144:0/3532392072 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74f00b5fb0 0x7f74f0151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 >> 172.21.15.144:0/3532392072 conn(0x7f74f006d0d0 msgr2=0x7f74f015e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:46.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 shutdown_connections 2024-09-12T12:13:46.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.608+0000 7f74f6a00640 1 -- 172.21.15.144:0/3532392072 wait complete. 2024-09-12T12:13:46.630 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:13:46.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24be600640 1 Processor -- start 2024-09-12T12:13:46.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24be600640 1 -- start start 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24be600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f24b8071420 0x7f24b8071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24be600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24b80ccf30 0x7f24b80cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24be600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24b80cd890 con 0x7f24b815b4e0 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24be600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f24b80b45a0 con 0x7f24b80ccf30 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24be600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f24b80b3fe0 con 0x7f24b8071420 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24b7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24b80ccf30 0x7f24b80cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24b7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24b80ccf30 0x7f24b80cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34838/0 (socket says 172.21.15.144:34838) 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24b7e00640 1 -- 172.21.15.144:0/3936923201 learned_addr learned my addr 172.21.15.144:0/3936923201 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24b6a00640 1 --2- 172.21.15.144:0/3936923201 >> v2:172.21.15.165:3300/0 conn(0x7f24b8071420 0x7f24b8071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24b7e00640 1 -- 172.21.15.144:0/3936923201 >> v2:172.21.15.165:3300/0 conn(0x7f24b8071420 msgr2=0x7f24b8071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24b7e00640 1 --2- 172.21.15.144:0/3936923201 >> v2:172.21.15.165:3300/0 conn(0x7f24b8071420 0x7f24b8071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24b7e00640 1 -- 172.21.15.144:0/3936923201 >> v1:172.21.15.144:6789/0 conn(0x7f24b815b4e0 legacy=0x7f24b80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.764+0000 7f24b7e00640 1 -- 172.21.15.144:0/3936923201 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b80b42c0 con 0x7f24b80ccf30 2024-09-12T12:13:46.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24b7e00640 1 --2- 172.21.15.144:0/3936923201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b80ccf30 0x7f24b80cd350 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f24b80b02b0 tx=0x7f24b001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbc4d2409e90db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:46.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24b6000640 1 -- 172.21.15.144:0/3936923201 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b00a5880 con 0x7f24b80ccf30 2024-09-12T12:13:46.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24b6000640 1 -- 172.21.15.144:0/3936923201 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b00a5a20 con 0x7f24b80ccf30 2024-09-12T12:13:46.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24b6000640 1 -- 172.21.15.144:0/3936923201 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b00a5df0 con 0x7f24b80ccf30 2024-09-12T12:13:46.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24be600640 1 -- 172.21.15.144:0/3936923201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b80ccf30 msgr2=0x7f24b80cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24be600640 1 --2- 172.21.15.144:0/3936923201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b80ccf30 0x7f24b80cd350 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f24b80b02b0 tx=0x7f24b001c9c0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24be600640 1 -- 172.21.15.144:0/3936923201 shutdown_connections 2024-09-12T12:13:46.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24be600640 1 --2- 172.21.15.144:0/3936923201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b80ccf30 0x7f24b80cd350 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24be600640 1 --2- 172.21.15.144:0/3936923201 >> v2:172.21.15.165:3300/0 conn(0x7f24b8071420 0x7f24b8071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24be600640 1 -- 172.21.15.144:0/3936923201 >> 172.21.15.144:0/3936923201 conn(0x7f24b806d0d0 msgr2=0x7f24b806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:46.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24be600640 1 -- 172.21.15.144:0/3936923201 shutdown_connections 2024-09-12T12:13:46.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.768+0000 7f24be600640 1 -- 172.21.15.144:0/3936923201 wait complete. 2024-09-12T12:13:46.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 Processor -- start 2024-09-12T12:13:46.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 -- start start 2024-09-12T12:13:46.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8071420 0x7f24b81f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24b80ccf30 0x7f24b8154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24b815b4e0 0x7f24b8157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24b815b8c0 con 0x7f24b8071420 2024-09-12T12:13:46.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f24b80cdef0 con 0x7f24b815b4e0 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f24b80aa480 con 0x7f24b80ccf30 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8071420 0x7f24b81f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8071420 0x7f24b81f7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34842/0 (socket says 172.21.15.144:34842) 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7400640 1 -- 172.21.15.144:0/2526231916 learned_addr learned my addr 172.21.15.144:0/2526231916 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7e00640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24b815b4e0 0x7f24b8157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b6a00640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24b80ccf30 0x7f24b8154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7400640 1 -- 172.21.15.144:0/2526231916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24b80ccf30 msgr2=0x7f24b8154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7400640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24b80ccf30 0x7f24b8154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7400640 1 -- 172.21.15.144:0/2526231916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24b815b4e0 msgr2=0x7f24b8157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7400640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24b815b4e0 0x7f24b8157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7400640 1 -- 172.21.15.144:0/2526231916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b80aa6d0 con 0x7f24b8071420 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24b7400640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8071420 0x7f24b81f7340 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24a800c370 tx=0x7f24a800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:46.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24af400640 1 -- 172.21.15.144:0/2526231916 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a80052d0 con 0x7f24b8071420 2024-09-12T12:13:46.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24af400640 1 -- 172.21.15.144:0/2526231916 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a8005470 con 0x7f24b8071420 2024-09-12T12:13:46.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24af400640 1 -- 172.21.15.144:0/2526231916 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8007260 con 0x7f24b8071420 2024-09-12T12:13:46.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b80aa9b0 con 0x7f24b8071420 2024-09-12T12:13:46.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.772+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b80cf590 con 0x7f24b8071420 2024-09-12T12:13:46.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.776+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b8071800 con 0x7f24b8071420 2024-09-12T12:13:46.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.776+0000 7f24af400640 1 -- 172.21.15.144:0/2526231916 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24a8007400 con 0x7f24b8071420 2024-09-12T12:13:46.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.776+0000 7f24af400640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24980678c0 0x7f2498069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.776+0000 7f24af400640 1 -- 172.21.15.144:0/2526231916 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f24a80852c0 con 0x7f24b8071420 2024-09-12T12:13:46.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.776+0000 7f24b6a00640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24980678c0 0x7f2498069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.776+0000 7f24b6a00640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24980678c0 0x7f2498069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f24b8159c40 tx=0x7f24a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:46.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.780+0000 7f24af400640 1 -- 172.21.15.144:0/2526231916 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f24a8055c60 con 0x7f24b8071420 2024-09-12T12:13:46.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.940+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24b8155dc0 con 0x7f24b8071420 2024-09-12T12:13:46.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.940+0000 7f24af400640 1 -- 172.21.15.144:0/2526231916 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17026 (secure 0 0 0) 0x7f24a8055560 con 0x7f24b8071420 2024-09-12T12:13:46.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:46.943 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":39,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:13:44.203649+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:13:40.307199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T12:13:41.588661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:46.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24980678c0 msgr2=0x7f2498069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24980678c0 0x7f2498069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f24b8159c40 tx=0x7f24a4008040 comp rx=0 tx=0).stop 2024-09-12T12:13:46.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8071420 msgr2=0x7f24b81f7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8071420 0x7f24b81f7340 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24a800c370 tx=0x7f24a800c830 comp rx=0 tx=0).stop 2024-09-12T12:13:46.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 shutdown_connections 2024-09-12T12:13:46.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24980678c0 0x7f2498069d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24b815b4e0 0x7f24b8157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24b80ccf30 0x7f24b8154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 --2- 172.21.15.144:0/2526231916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24b8071420 0x7f24b81f7340 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 >> 172.21.15.144:0/2526231916 conn(0x7f24b806d0d0 msgr2=0x7f24b8073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:46.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 shutdown_connections 2024-09-12T12:13:46.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:46.944+0000 7f24be600640 1 -- 172.21.15.144:0/2526231916 wait complete. 2024-09-12T12:13:46.964 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:13:46.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:13:47.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d66000640 1 Processor -- start 2024-09-12T12:13:47.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d66000640 1 -- start start 2024-09-12T12:13:47.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d66000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1d6015e5f0 0x7f1d6006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d66000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d600b44a0 0x7f1d600b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d66000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d6006e300 0x7f1d6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d66000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1d6006ecb0 con 0x7f1d6006e300 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d66000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1d6006d260 con 0x7f1d6015e5f0 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d66000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1d600b6f60 con 0x7f1d600b44a0 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d6006e300 0x7f1d6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d6006e300 0x7f1d6006e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40466/0 (socket says 172.21.15.144:40466) 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5fe00640 1 -- 172.21.15.144:0/268667723 learned_addr learned my addr 172.21.15.144:0/268667723 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5f400640 1 --2- 172.21.15.144:0/268667723 >> v2:172.21.15.165:3300/0 conn(0x7f1d6015e5f0 0x7f1d6006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5ea00640 1 --2- 172.21.15.144:0/268667723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d600b44a0 0x7f1d600b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5fe00640 1 -- 172.21.15.144:0/268667723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d600b44a0 msgr2=0x7f1d600b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5fe00640 1 --2- 172.21.15.144:0/268667723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d600b44a0 0x7f1d600b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5fe00640 1 -- 172.21.15.144:0/268667723 >> v2:172.21.15.165:3300/0 conn(0x7f1d6015e5f0 msgr2=0x7f1d6006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5fe00640 1 --2- 172.21.15.144:0/268667723 >> v2:172.21.15.165:3300/0 conn(0x7f1d6015e5f0 0x7f1d6006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.100+0000 7f1d5fe00640 1 -- 172.21.15.144:0/268667723 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d600b7240 con 0x7f1d6006e300 2024-09-12T12:13:47.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d5fe00640 1 --2- 172.21.15.144:0/268667723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d6006e300 0x7f1d6006e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d60074b30 tx=0x7f1d5801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7314a35dd3921176 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:47.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d5e000640 1 -- 172.21.15.144:0/268667723 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d580a5840 con 0x7f1d6006e300 2024-09-12T12:13:47.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d5e000640 1 -- 172.21.15.144:0/268667723 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d580a59e0 con 0x7f1d6006e300 2024-09-12T12:13:47.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d5e000640 1 -- 172.21.15.144:0/268667723 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d580a5db0 con 0x7f1d6006e300 2024-09-12T12:13:47.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d66000640 1 -- 172.21.15.144:0/268667723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d6006e300 msgr2=0x7f1d6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d66000640 1 --2- 172.21.15.144:0/268667723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d6006e300 0x7f1d6006e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1d60074b30 tx=0x7f1d5801c9c0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d66000640 1 -- 172.21.15.144:0/268667723 shutdown_connections 2024-09-12T12:13:47.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d66000640 1 --2- 172.21.15.144:0/268667723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d6006e300 0x7f1d6006e770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d66000640 1 --2- 172.21.15.144:0/268667723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d600b44a0 0x7f1d600b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d66000640 1 --2- 172.21.15.144:0/268667723 >> v2:172.21.15.165:3300/0 conn(0x7f1d6015e5f0 0x7f1d6006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d66000640 1 -- 172.21.15.144:0/268667723 >> 172.21.15.144:0/268667723 conn(0x7f1d6006f400 msgr2=0x7f1d6006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:47.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d66000640 1 -- 172.21.15.144:0/268667723 shutdown_connections 2024-09-12T12:13:47.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.104+0000 7f1d66000640 1 -- 172.21.15.144:0/268667723 wait complete. 2024-09-12T12:13:47.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 Processor -- start 2024-09-12T12:13:47.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 -- start start 2024-09-12T12:13:47.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d6006e300 0x7f1d60149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d600b44a0 0x7f1d6014ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d6015e5f0 0x7f1d60153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1d600b6d10 con 0x7f1d600b44a0 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1d600b6b90 con 0x7f1d6006e300 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1d6015f700 con 0x7f1d6015e5f0 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d600b44a0 0x7f1d6014ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d600b44a0 0x7f1d6014ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40470/0 (socket says 172.21.15.144:40470) 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5ea00640 1 -- 172.21.15.144:0/4009757867 learned_addr learned my addr 172.21.15.144:0/4009757867 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5f400640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d6006e300 0x7f1d60149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5fe00640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d6015e5f0 0x7f1d60153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5ea00640 1 -- 172.21.15.144:0/4009757867 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d6015e5f0 msgr2=0x7f1d60153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5ea00640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d6015e5f0 0x7f1d60153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5ea00640 1 -- 172.21.15.144:0/4009757867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d6006e300 msgr2=0x7f1d60149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5ea00640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d6006e300 0x7f1d60149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5ea00640 1 -- 172.21.15.144:0/4009757867 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6014a3a0 con 0x7f1d600b44a0 2024-09-12T12:13:47.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d5ea00640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d600b44a0 0x7f1d6014ec20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00d830 tx=0x7f1d4c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:47.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d57400640 1 -- 172.21.15.144:0/4009757867 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c018020 con 0x7f1d600b44a0 2024-09-12T12:13:47.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d57400640 1 -- 172.21.15.144:0/4009757867 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c0096c0 con 0x7f1d600b44a0 2024-09-12T12:13:47.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d57400640 1 -- 172.21.15.144:0/4009757867 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c009ab0 con 0x7f1d600b44a0 2024-09-12T12:13:47.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6014e100 con 0x7f1d600b44a0 2024-09-12T12:13:47.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d6014aff0 con 0x7f1d600b44a0 2024-09-12T12:13:47.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.108+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6006e770 con 0x7f1d600b44a0 2024-09-12T12:13:47.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.112+0000 7f1d57400640 1 -- 172.21.15.144:0/4009757867 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d4c01b020 con 0x7f1d600b44a0 2024-09-12T12:13:47.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.112+0000 7f1d57400640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d400678f0 0x7f1d40069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.112+0000 7f1d57400640 1 -- 172.21.15.144:0/4009757867 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f1d4c0863d0 con 0x7f1d600b44a0 2024-09-12T12:13:47.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.112+0000 7f1d5f400640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d400678f0 0x7f1d40069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.112+0000 7f1d5f400640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d400678f0 0x7f1d40069db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d6014e6c0 tx=0x7f1d50008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:47.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.116+0000 7f1d57400640 1 -- 172.21.15.144:0/4009757867 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d4c022020 con 0x7f1d600b44a0 2024-09-12T12:13:47.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.272+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1d600b2720 con 0x7f1d400678f0 2024-09-12T12:13:47.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.280+0000 7f1d57400640 1 -- 172.21.15.144:0/4009757867 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251917 (secure 0 0 0) 0x7f1d600b2720 con 0x7f1d400678f0 2024-09-12T12:13:47.284 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:47.285 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:13:47.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.280+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d400678f0 msgr2=0x7f1d40069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.280+0000 7f1d66000640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d400678f0 0x7f1d40069db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d6014e6c0 tx=0x7f1d50008040 comp rx=0 tx=0).stop 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.280+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d600b44a0 msgr2=0x7f1d6014ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.284+0000 7f1d66000640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d600b44a0 0x7f1d6014ec20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00d830 tx=0x7f1d4c00dcf0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.284+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 shutdown_connections 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.284+0000 7f1d66000640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d400678f0 0x7f1d40069db0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.284+0000 7f1d66000640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d6015e5f0 0x7f1d60153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.284+0000 7f1d66000640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d600b44a0 0x7f1d6014ec20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.284+0000 7f1d66000640 1 --2- 172.21.15.144:0/4009757867 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d6006e300 0x7f1d60149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.284+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 >> 172.21.15.144:0/4009757867 conn(0x7f1d6006f400 msgr2=0x7f1d6015fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.284+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 shutdown_connections 2024-09-12T12:13:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.284+0000 7f1d66000640 1 -- 172.21.15.144:0/4009757867 wait complete. 2024-09-12T12:13:47.303 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-09-12T12:13:45.388404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225064,"kb_used_data":4660,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749656,"statfs":{"total":773094113280,"available":772863647744,"internally_reserved":0,"allocated":4771840,"data_stored":2696368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.193509"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210853+0000","last_change":"2024-09-12T12:13:43.244735+0000","last_active":"2024-09-12T12:13:44.210853+0000","last_peered":"2024-09-12T12:13:44.210853+0000","last_clean":"2024-09-12T12:13:44.210853+0000","last_became_active":"2024-09-12T12:13:43.244436+0000","last_became_peered":"2024-09-12T12:13:43.244436+0000","last_unstale":"2024-09-12T12:13:44.210853+0000","last_undegraded":"2024-09-12T12:13:44.210853+0000","last_fullsized":"2024-09-12T12:13:44.210853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:53.404803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210600+0000","last_change":"2024-09-12T12:13:43.228980+0000","last_active":"2024-09-12T12:13:44.210600+0000","last_peered":"2024-09-12T12:13:44.210600+0000","last_clean":"2024-09-12T12:13:44.210600+0000","last_became_active":"2024-09-12T12:13:43.228657+0000","last_became_peered":"2024-09-12T12:13:43.228657+0000","last_unstale":"2024-09-12T12:13:44.210600+0000","last_undegraded":"2024-09-12T12:13:44.210600+0000","last_fullsized":"2024-09-12T12:13:44.210600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:52.062922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246829+0000","last_change":"2024-09-12T12:13:43.234545+0000","last_active":"2024-09-12T12:13:43.246829+0000","last_peered":"2024-09-12T12:13:43.246829+0000","last_clean":"2024-09-12T12:13:43.246829+0000","last_became_active":"2024-09-12T12:13:43.234249+0000","last_became_peered":"2024-09-12T12:13:43.234249+0000","last_unstale":"2024-09-12T12:13:43.246829+0000","last_undegraded":"2024-09-12T12:13:43.246829+0000","last_fullsized":"2024-09-12T12:13:43.246829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:10.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.231156+0000","last_change":"2024-09-12T12:13:43.225630+0000","last_active":"2024-09-12T12:13:43.231156+0000","last_peered":"2024-09-12T12:13:43.231156+0000","last_clean":"2024-09-12T12:13:43.231156+0000","last_became_active":"2024-09-12T12:13:43.224701+0000","last_became_peered":"2024-09-12T12:13:43.224701+0000","last_unstale":"2024-09-12T12:13:43.231156+0000","last_undegraded":"2024-09-12T12:13:43.231156+0000","last_fullsized":"2024-09-12T12:13:43.231156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:59.509473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.215804+0000","last_change":"2024-09-12T12:13:43.212514+0000","last_active":"2024-09-12T12:13:43.215804+0000","last_peered":"2024-09-12T12:13:43.215804+0000","last_clean":"2024-09-12T12:13:43.215804+0000","last_became_active":"2024-09-12T12:13:43.212217+0000","last_became_peered":"2024-09-12T12:13:43.212217+0000","last_unstale":"2024-09-12T12:13:43.215804+0000","last_undegraded":"2024-09-12T12:13:43.215804+0000","last_fullsized":"2024-09-12T12:13:43.215804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:41.458594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336245+0000","last_change":"2024-09-12T12:13:43.233076+0000","last_active":"2024-09-12T12:13:44.336245+0000","last_peered":"2024-09-12T12:13:44.336245+0000","last_clean":"2024-09-12T12:13:44.336245+0000","last_became_active":"2024-09-12T12:13:43.232779+0000","last_became_peered":"2024-09-12T12:13:43.232779+0000","last_unstale":"2024-09-12T12:13:44.336245+0000","last_undegraded":"2024-09-12T12:13:44.336245+0000","last_fullsized":"2024-09-12T12:13:44.336245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:22.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.234568+0000","last_change":"2024-09-12T12:13:43.230413+0000","last_active":"2024-09-12T12:13:43.234568+0000","last_peered":"2024-09-12T12:13:43.234568+0000","last_clean":"2024-09-12T12:13:43.234568+0000","last_became_active":"2024-09-12T12:13:43.230138+0000","last_became_peered":"2024-09-12T12:13:43.230138+0000","last_unstale":"2024-09-12T12:13:43.234568+0000","last_undegraded":"2024-09-12T12:13:43.234568+0000","last_fullsized":"2024-09-12T12:13:43.234568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:30.133702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209950+0000","last_change":"2024-09-12T12:13:43.237407+0000","last_active":"2024-09-12T12:13:44.209950+0000","last_peered":"2024-09-12T12:13:44.209950+0000","last_clean":"2024-09-12T12:13:44.209950+0000","last_became_active":"2024-09-12T12:13:43.236999+0000","last_became_peered":"2024-09-12T12:13:43.236999+0000","last_unstale":"2024-09-12T12:13:44.209950+0000","last_undegraded":"2024-09-12T12:13:44.209950+0000","last_fullsized":"2024-09-12T12:13:44.209950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:31:53.126811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247482+0000","last_change":"2024-09-12T12:13:43.239302+0000","last_active":"2024-09-12T12:13:43.247482+0000","last_peered":"2024-09-12T12:13:43.247482+0000","last_clean":"2024-09-12T12:13:43.247482+0000","last_became_active":"2024-09-12T12:13:43.238850+0000","last_became_peered":"2024-09-12T12:13:43.238850+0000","last_unstale":"2024-09-12T12:13:43.247482+0000","last_undegraded":"2024-09-12T12:13:43.247482+0000","last_fullsized":"2024-09-12T12:13:43.247482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:22.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.232474+0000","last_change":"2024-09-12T12:13:43.226294+0000","last_active":"2024-09-12T12:13:43.232474+0000","last_peered":"2024-09-12T12:13:43.232474+0000","last_clean":"2024-09-12T12:13:43.232474+0000","last_became_active":"2024-09-12T12:13:43.223598+0000","last_became_peered":"2024-09-12T12:13:43.223598+0000","last_unstale":"2024-09-12T12:13:43.232474+0000","last_undegraded":"2024-09-12T12:13:43.232474+0000","last_fullsized":"2024-09-12T12:13:43.232474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.232583+0000","last_change":"2024-09-12T12:13:43.226639+0000","last_active":"2024-09-12T12:13:43.232583+0000","last_peered":"2024-09-12T12:13:43.232583+0000","last_clean":"2024-09-12T12:13:43.232583+0000","last_became_active":"2024-09-12T12:13:43.226343+0000","last_became_peered":"2024-09-12T12:13:43.226343+0000","last_unstale":"2024-09-12T12:13:43.232583+0000","last_undegraded":"2024-09-12T12:13:43.232583+0000","last_fullsized":"2024-09-12T12:13:43.232583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246039+0000","last_change":"2024-09-12T12:13:43.232962+0000","last_active":"2024-09-12T12:13:43.246039+0000","last_peered":"2024-09-12T12:13:43.246039+0000","last_clean":"2024-09-12T12:13:43.246039+0000","last_became_active":"2024-09-12T12:13:43.232713+0000","last_became_peered":"2024-09-12T12:13:43.232713+0000","last_unstale":"2024-09-12T12:13:43.246039+0000","last_undegraded":"2024-09-12T12:13:43.246039+0000","last_fullsized":"2024-09-12T12:13:43.246039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.238571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.231719+0000","last_change":"2024-09-12T12:13:43.222647+0000","last_active":"2024-09-12T12:13:43.231719+0000","last_peered":"2024-09-12T12:13:43.231719+0000","last_clean":"2024-09-12T12:13:43.231719+0000","last_became_active":"2024-09-12T12:13:43.222380+0000","last_became_peered":"2024-09-12T12:13:43.222380+0000","last_unstale":"2024-09-12T12:13:43.231719+0000","last_undegraded":"2024-09-12T12:13:43.231719+0000","last_fullsized":"2024-09-12T12:13:43.231719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208388+0000","last_change":"2024-09-12T12:13:43.217301+0000","last_active":"2024-09-12T12:13:44.208388+0000","last_peered":"2024-09-12T12:13:44.208388+0000","last_clean":"2024-09-12T12:13:44.208388+0000","last_became_active":"2024-09-12T12:13:43.216932+0000","last_became_peered":"2024-09-12T12:13:43.216932+0000","last_unstale":"2024-09-12T12:13:44.208388+0000","last_undegraded":"2024-09-12T12:13:44.208388+0000","last_fullsized":"2024-09-12T12:13:44.208388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:15.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.234546+0000","last_change":"2024-09-12T12:13:43.229389+0000","last_active":"2024-09-12T12:13:43.234546+0000","last_peered":"2024-09-12T12:13:43.234546+0000","last_clean":"2024-09-12T12:13:43.234546+0000","last_became_active":"2024-09-12T12:13:43.229111+0000","last_became_peered":"2024-09-12T12:13:43.229111+0000","last_unstale":"2024-09-12T12:13:43.234546+0000","last_undegraded":"2024-09-12T12:13:43.234546+0000","last_fullsized":"2024-09-12T12:13:43.234546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:08.547195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245793+0000","last_change":"2024-09-12T12:13:43.238288+0000","last_active":"2024-09-12T12:13:43.245793+0000","last_peered":"2024-09-12T12:13:43.245793+0000","last_clean":"2024-09-12T12:13:43.245793+0000","last_became_active":"2024-09-12T12:13:43.237988+0000","last_became_peered":"2024-09-12T12:13:43.237988+0000","last_unstale":"2024-09-12T12:13:43.245793+0000","last_undegraded":"2024-09-12T12:13:43.245793+0000","last_fullsized":"2024-09-12T12:13:43.245793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:30.133702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245265+0000","last_change":"2024-09-12T12:13:43.234372+0000","last_active":"2024-09-12T12:13:43.245265+0000","last_peered":"2024-09-12T12:13:43.245265+0000","last_clean":"2024-09-12T12:13:43.245265+0000","last_became_active":"2024-09-12T12:13:43.234062+0000","last_became_peered":"2024-09-12T12:13:43.234062+0000","last_unstale":"2024-09-12T12:13:43.245265+0000","last_undegraded":"2024-09-12T12:13:43.245265+0000","last_fullsized":"2024-09-12T12:13:43.245265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208796+0000","last_change":"2024-09-12T12:13:43.230161+0000","last_active":"2024-09-12T12:13:44.208796+0000","last_peered":"2024-09-12T12:13:44.208796+0000","last_clean":"2024-09-12T12:13:44.208796+0000","last_became_active":"2024-09-12T12:13:43.224716+0000","last_became_peered":"2024-09-12T12:13:43.224716+0000","last_unstale":"2024-09-12T12:13:44.208796+0000","last_undegraded":"2024-09-12T12:13:44.208796+0000","last_fullsized":"2024-09-12T12:13:44.208796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:19.613063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.243670+0000","last_change":"2024-09-12T12:13:43.241173+0000","last_active":"2024-09-12T12:13:43.243670+0000","last_peered":"2024-09-12T12:13:43.243670+0000","last_clean":"2024-09-12T12:13:43.243670+0000","last_became_active":"2024-09-12T12:13:43.240857+0000","last_became_peered":"2024-09-12T12:13:43.240857+0000","last_unstale":"2024-09-12T12:13:43.243670+0000","last_undegraded":"2024-09-12T12:13:43.243670+0000","last_fullsized":"2024-09-12T12:13:43.243670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:19.695637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208996+0000","last_change":"2024-09-12T12:13:43.230230+0000","last_active":"2024-09-12T12:13:44.208996+0000","last_peered":"2024-09-12T12:13:44.208996+0000","last_clean":"2024-09-12T12:13:44.208996+0000","last_became_active":"2024-09-12T12:13:43.229944+0000","last_became_peered":"2024-09-12T12:13:43.229944+0000","last_unstale":"2024-09-12T12:13:44.208996+0000","last_undegraded":"2024-09-12T12:13:44.208996+0000","last_fullsized":"2024-09-12T12:13:44.208996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.238571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244014+0000","last_change":"2024-09-12T12:13:43.239236+0000","last_active":"2024-09-12T12:13:43.244014+0000","last_peered":"2024-09-12T12:13:43.244014+0000","last_clean":"2024-09-12T12:13:43.244014+0000","last_became_active":"2024-09-12T12:13:43.239000+0000","last_became_peered":"2024-09-12T12:13:43.239000+0000","last_unstale":"2024-09-12T12:13:43.244014+0000","last_undegraded":"2024-09-12T12:13:43.244014+0000","last_fullsized":"2024-09-12T12:13:43.244014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:58.310139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209050+0000","last_change":"2024-09-12T12:13:43.214958+0000","last_active":"2024-09-12T12:13:44.209050+0000","last_peered":"2024-09-12T12:13:44.209050+0000","last_clean":"2024-09-12T12:13:44.209050+0000","last_became_active":"2024-09-12T12:13:43.214696+0000","last_became_peered":"2024-09-12T12:13:43.214696+0000","last_unstale":"2024-09-12T12:13:44.209050+0000","last_undegraded":"2024-09-12T12:13:44.209050+0000","last_fullsized":"2024-09-12T12:13:44.209050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:22.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244923+0000","last_change":"2024-09-12T12:13:43.226827+0000","last_active":"2024-09-12T12:13:43.244923+0000","last_peered":"2024-09-12T12:13:43.244923+0000","last_clean":"2024-09-12T12:13:43.244923+0000","last_became_active":"2024-09-12T12:13:43.226549+0000","last_became_peered":"2024-09-12T12:13:43.226549+0000","last_unstale":"2024-09-12T12:13:43.244923+0000","last_undegraded":"2024-09-12T12:13:43.244923+0000","last_fullsized":"2024-09-12T12:13:43.244923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:22.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.223959+0000","last_change":"2024-09-12T12:13:43.222437+0000","last_active":"2024-09-12T12:13:43.223959+0000","last_peered":"2024-09-12T12:13:43.223959+0000","last_clean":"2024-09-12T12:13:43.223959+0000","last_became_active":"2024-09-12T12:13:43.221619+0000","last_became_peered":"2024-09-12T12:13:43.221619+0000","last_unstale":"2024-09-12T12:13:43.223959+0000","last_undegraded":"2024-09-12T12:13:43.223959+0000","last_fullsized":"2024-09-12T12:13:43.223959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:33.325460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209328+0000","last_change":"2024-09-12T12:13:43.242362+0000","last_active":"2024-09-12T12:13:44.209328+0000","last_peered":"2024-09-12T12:13:44.209328+0000","last_clean":"2024-09-12T12:13:44.209328+0000","last_became_active":"2024-09-12T12:13:43.242076+0000","last_became_peered":"2024-09-12T12:13:43.242076+0000","last_unstale":"2024-09-12T12:13:44.209328+0000","last_undegraded":"2024-09-12T12:13:44.209328+0000","last_fullsized":"2024-09-12T12:13:44.209328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:15.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336559+0000","last_change":"2024-09-12T12:13:43.247905+0000","last_active":"2024-09-12T12:13:44.336559+0000","last_peered":"2024-09-12T12:13:44.336559+0000","last_clean":"2024-09-12T12:13:44.336559+0000","last_became_active":"2024-09-12T12:13:43.247277+0000","last_became_peered":"2024-09-12T12:13:43.247277+0000","last_unstale":"2024-09-12T12:13:44.336559+0000","last_undegraded":"2024-09-12T12:13:44.336559+0000","last_fullsized":"2024-09-12T12:13:44.336559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:08.547195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208938+0000","last_change":"2024-09-12T12:13:43.229983+0000","last_active":"2024-09-12T12:13:44.208938+0000","last_peered":"2024-09-12T12:13:44.208938+0000","last_clean":"2024-09-12T12:13:44.208938+0000","last_became_active":"2024-09-12T12:13:43.225211+0000","last_became_peered":"2024-09-12T12:13:43.225211+0000","last_unstale":"2024-09-12T12:13:44.208938+0000","last_undegraded":"2024-09-12T12:13:44.208938+0000","last_fullsized":"2024-09-12T12:13:44.208938+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:28.744882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.233213+0000","last_change":"2024-09-12T12:13:43.230509+0000","last_active":"2024-09-12T12:13:43.233213+0000","last_peered":"2024-09-12T12:13:43.233213+0000","last_clean":"2024-09-12T12:13:43.233213+0000","last_became_active":"2024-09-12T12:13:43.230148+0000","last_became_peered":"2024-09-12T12:13:43.230148+0000","last_unstale":"2024-09-12T12:13:43.233213+0000","last_undegraded":"2024-09-12T12:13:43.233213+0000","last_fullsized":"2024-09-12T12:13:43.233213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:00.734722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208587+0000","last_change":"2024-09-12T12:13:43.247006+0000","last_active":"2024-09-12T12:13:44.208587+0000","last_peered":"2024-09-12T12:13:44.208587+0000","last_clean":"2024-09-12T12:13:44.208587+0000","last_became_active":"2024-09-12T12:13:43.246712+0000","last_became_peered":"2024-09-12T12:13:43.246712+0000","last_unstale":"2024-09-12T12:13:44.208587+0000","last_undegraded":"2024-09-12T12:13:44.208587+0000","last_fullsized":"2024-09-12T12:13:44.208587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:54.709474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208378+0000","last_change":"2024-09-12T12:13:43.229857+0000","last_active":"2024-09-12T12:13:44.208378+0000","last_peered":"2024-09-12T12:13:44.208378+0000","last_clean":"2024-09-12T12:13:44.208378+0000","last_became_active":"2024-09-12T12:13:43.224427+0000","last_became_peered":"2024-09-12T12:13:43.224427+0000","last_unstale":"2024-09-12T12:13:44.208378+0000","last_undegraded":"2024-09-12T12:13:44.208378+0000","last_fullsized":"2024-09-12T12:13:44.208378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:43.536121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245210+0000","last_change":"2024-09-12T12:13:43.227341+0000","last_active":"2024-09-12T12:13:43.245210+0000","last_peered":"2024-09-12T12:13:43.245210+0000","last_clean":"2024-09-12T12:13:43.245210+0000","last_became_active":"2024-09-12T12:13:43.226849+0000","last_became_peered":"2024-09-12T12:13:43.226849+0000","last_unstale":"2024-09-12T12:13:43.245210+0000","last_undegraded":"2024-09-12T12:13:43.245210+0000","last_fullsized":"2024-09-12T12:13:43.245210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336329+0000","last_change":"2024-09-12T12:13:43.227837+0000","last_active":"2024-09-12T12:13:44.336329+0000","last_peered":"2024-09-12T12:13:44.336329+0000","last_clean":"2024-09-12T12:13:44.336329+0000","last_became_active":"2024-09-12T12:13:43.227560+0000","last_became_peered":"2024-09-12T12:13:43.227560+0000","last_unstale":"2024-09-12T12:13:44.336329+0000","last_undegraded":"2024-09-12T12:13:44.336329+0000","last_fullsized":"2024-09-12T12:13:44.336329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245350+0000","last_change":"2024-09-12T12:13:43.235173+0000","last_active":"2024-09-12T12:13:43.245350+0000","last_peered":"2024-09-12T12:13:43.245350+0000","last_clean":"2024-09-12T12:13:43.245350+0000","last_became_active":"2024-09-12T12:13:43.234875+0000","last_became_peered":"2024-09-12T12:13:43.234875+0000","last_unstale":"2024-09-12T12:13:43.245350+0000","last_undegraded":"2024-09-12T12:13:43.245350+0000","last_fullsized":"2024-09-12T12:13:43.245350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209154+0000","last_change":"2024-09-12T12:13:42.225850+0000","last_active":"2024-09-12T12:13:44.209154+0000","last_peered":"2024-09-12T12:13:44.209154+0000","last_clean":"2024-09-12T12:13:44.209154+0000","last_became_active":"2024-09-12T12:13:42.225541+0000","last_became_peered":"2024-09-12T12:13:42.225541+0000","last_unstale":"2024-09-12T12:13:44.209154+0000","last_undegraded":"2024-09-12T12:13:44.209154+0000","last_fullsized":"2024-09-12T12:13:44.209154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:45:39.749491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336539+0000","last_change":"2024-09-12T12:13:43.245629+0000","last_active":"2024-09-12T12:13:44.336539+0000","last_peered":"2024-09-12T12:13:44.336539+0000","last_clean":"2024-09-12T12:13:44.336539+0000","last_became_active":"2024-09-12T12:13:43.245374+0000","last_became_peered":"2024-09-12T12:13:43.245374+0000","last_unstale":"2024-09-12T12:13:44.336539+0000","last_undegraded":"2024-09-12T12:13:44.336539+0000","last_fullsized":"2024-09-12T12:13:44.336539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.239104+0000","last_change":"2024-09-12T12:13:42.224589+0000","last_active":"2024-09-12T12:13:43.239104+0000","last_peered":"2024-09-12T12:13:43.239104+0000","last_clean":"2024-09-12T12:13:43.239104+0000","last_became_active":"2024-09-12T12:13:42.224322+0000","last_became_peered":"2024-09-12T12:13:42.224322+0000","last_unstale":"2024-09-12T12:13:43.239104+0000","last_undegraded":"2024-09-12T12:13:43.239104+0000","last_fullsized":"2024-09-12T12:13:43.239104+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:18.608456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209566+0000","last_change":"2024-09-12T12:13:43.217960+0000","last_active":"2024-09-12T12:13:44.209566+0000","last_peered":"2024-09-12T12:13:44.209566+0000","last_clean":"2024-09-12T12:13:44.209566+0000","last_became_active":"2024-09-12T12:13:43.217681+0000","last_became_peered":"2024-09-12T12:13:43.217681+0000","last_unstale":"2024-09-12T12:13:44.209566+0000","last_undegraded":"2024-09-12T12:13:44.209566+0000","last_fullsized":"2024-09-12T12:13:44.209566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336588+0000","last_change":"2024-09-12T12:13:42.226799+0000","last_active":"2024-09-12T12:13:44.336588+0000","last_peered":"2024-09-12T12:13:44.336588+0000","last_clean":"2024-09-12T12:13:44.336588+0000","last_became_active":"2024-09-12T12:13:42.226552+0000","last_became_peered":"2024-09-12T12:13:42.226552+0000","last_unstale":"2024-09-12T12:13:44.336588+0000","last_undegraded":"2024-09-12T12:13:44.336588+0000","last_fullsized":"2024-09-12T12:13:44.336588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:42.531514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210795+0000","last_change":"2024-09-12T12:13:43.239066+0000","last_active":"2024-09-12T12:13:44.210795+0000","last_peered":"2024-09-12T12:13:44.210795+0000","last_clean":"2024-09-12T12:13:44.210795+0000","last_became_active":"2024-09-12T12:13:43.238511+0000","last_became_peered":"2024-09-12T12:13:43.238511+0000","last_unstale":"2024-09-12T12:13:44.210795+0000","last_undegraded":"2024-09-12T12:13:44.210795+0000","last_fullsized":"2024-09-12T12:13:44.210795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:55:42.314180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209301+0000","last_change":"2024-09-12T12:13:42.227992+0000","last_active":"2024-09-12T12:13:44.209301+0000","last_peered":"2024-09-12T12:13:44.209301+0000","last_clean":"2024-09-12T12:13:44.209301+0000","last_became_active":"2024-09-12T12:13:42.227700+0000","last_became_peered":"2024-09-12T12:13:42.227700+0000","last_unstale":"2024-09-12T12:13:44.209301+0000","last_undegraded":"2024-09-12T12:13:44.209301+0000","last_fullsized":"2024-09-12T12:13:44.209301+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:13.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.249347+0000","last_change":"2024-09-12T12:13:43.247785+0000","last_active":"2024-09-12T12:13:43.249347+0000","last_peered":"2024-09-12T12:13:43.249347+0000","last_clean":"2024-09-12T12:13:43.249347+0000","last_became_active":"2024-09-12T12:13:43.247582+0000","last_became_peered":"2024-09-12T12:13:43.247582+0000","last_unstale":"2024-09-12T12:13:43.249347+0000","last_undegraded":"2024-09-12T12:13:43.249347+0000","last_fullsized":"2024-09-12T12:13:43.249347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247586+0000","last_change":"2024-09-12T12:13:42.228952+0000","last_active":"2024-09-12T12:13:43.247586+0000","last_peered":"2024-09-12T12:13:43.247586+0000","last_clean":"2024-09-12T12:13:43.247586+0000","last_became_active":"2024-09-12T12:13:42.228670+0000","last_became_peered":"2024-09-12T12:13:42.228670+0000","last_unstale":"2024-09-12T12:13:43.247586+0000","last_undegraded":"2024-09-12T12:13:43.247586+0000","last_fullsized":"2024-09-12T12:13:43.247586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.452962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244002+0000","last_change":"2024-09-12T12:13:43.239240+0000","last_active":"2024-09-12T12:13:43.244002+0000","last_peered":"2024-09-12T12:13:43.244002+0000","last_clean":"2024-09-12T12:13:43.244002+0000","last_became_active":"2024-09-12T12:13:43.238958+0000","last_became_peered":"2024-09-12T12:13:43.238958+0000","last_unstale":"2024-09-12T12:13:43.244002+0000","last_undegraded":"2024-09-12T12:13:43.244002+0000","last_fullsized":"2024-09-12T12:13:43.244002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:59.999097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244956+0000","last_change":"2024-09-12T12:13:42.231479+0000","last_active":"2024-09-12T12:13:43.244956+0000","last_peered":"2024-09-12T12:13:43.244956+0000","last_clean":"2024-09-12T12:13:43.244956+0000","last_became_active":"2024-09-12T12:13:42.229387+0000","last_became_peered":"2024-09-12T12:13:42.229387+0000","last_unstale":"2024-09-12T12:13:43.244956+0000","last_undegraded":"2024-09-12T12:13:43.244956+0000","last_fullsized":"2024-09-12T12:13:43.244956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:27.740275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208621+0000","last_change":"2024-09-12T12:13:43.229008+0000","last_active":"2024-09-12T12:13:44.208621+0000","last_peered":"2024-09-12T12:13:44.208621+0000","last_clean":"2024-09-12T12:13:44.208621+0000","last_became_active":"2024-09-12T12:13:43.228397+0000","last_became_peered":"2024-09-12T12:13:43.228397+0000","last_unstale":"2024-09-12T12:13:44.208621+0000","last_undegraded":"2024-09-12T12:13:44.208621+0000","last_fullsized":"2024-09-12T12:13:44.208621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336261+0000","last_change":"2024-09-12T12:13:42.223306+0000","last_active":"2024-09-12T12:13:44.336261+0000","last_peered":"2024-09-12T12:13:44.336261+0000","last_clean":"2024-09-12T12:13:44.336261+0000","last_became_active":"2024-09-12T12:13:42.223034+0000","last_became_peered":"2024-09-12T12:13:42.223034+0000","last_unstale":"2024-09-12T12:13:44.336261+0000","last_undegraded":"2024-09-12T12:13:44.336261+0000","last_fullsized":"2024-09-12T12:13:44.336261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:10.757599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210021+0000","last_change":"2024-09-12T12:13:43.227661+0000","last_active":"2024-09-12T12:13:44.210021+0000","last_peered":"2024-09-12T12:13:44.210021+0000","last_clean":"2024-09-12T12:13:44.210021+0000","last_became_active":"2024-09-12T12:13:43.227357+0000","last_became_peered":"2024-09-12T12:13:43.227357+0000","last_unstale":"2024-09-12T12:13:44.210021+0000","last_undegraded":"2024-09-12T12:13:44.210021+0000","last_fullsized":"2024-09-12T12:13:44.210021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:09.821058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208219+0000","last_change":"2024-09-12T12:13:42.225511+0000","last_active":"2024-09-12T12:13:44.208219+0000","last_peered":"2024-09-12T12:13:44.208219+0000","last_clean":"2024-09-12T12:13:44.208219+0000","last_became_active":"2024-09-12T12:13:42.225209+0000","last_became_peered":"2024-09-12T12:13:42.225209+0000","last_unstale":"2024-09-12T12:13:44.208219+0000","last_undegraded":"2024-09-12T12:13:44.208219+0000","last_fullsized":"2024-09-12T12:13:44.208219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:10.557737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.231178+0000","last_change":"2024-09-12T12:13:43.225962+0000","last_active":"2024-09-12T12:13:43.231178+0000","last_peered":"2024-09-12T12:13:43.231178+0000","last_clean":"2024-09-12T12:13:43.231178+0000","last_became_active":"2024-09-12T12:13:43.225033+0000","last_became_peered":"2024-09-12T12:13:43.225033+0000","last_unstale":"2024-09-12T12:13:43.231178+0000","last_undegraded":"2024-09-12T12:13:43.231178+0000","last_fullsized":"2024-09-12T12:13:43.231178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:53.456301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210853+0000","last_change":"2024-09-12T12:13:42.222441+0000","last_active":"2024-09-12T12:13:44.210853+0000","last_peered":"2024-09-12T12:13:44.210853+0000","last_clean":"2024-09-12T12:13:44.210853+0000","last_became_active":"2024-09-12T12:13:42.222182+0000","last_became_peered":"2024-09-12T12:13:42.222182+0000","last_unstale":"2024-09-12T12:13:44.210853+0000","last_undegraded":"2024-09-12T12:13:44.210853+0000","last_fullsized":"2024-09-12T12:13:44.210853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:28.723801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245722+0000","last_change":"2024-09-12T12:13:43.244493+0000","last_active":"2024-09-12T12:13:43.245722+0000","last_peered":"2024-09-12T12:13:43.245722+0000","last_clean":"2024-09-12T12:13:43.245722+0000","last_became_active":"2024-09-12T12:13:43.244205+0000","last_became_peered":"2024-09-12T12:13:43.244205+0000","last_unstale":"2024-09-12T12:13:43.245722+0000","last_undegraded":"2024-09-12T12:13:43.245722+0000","last_fullsized":"2024-09-12T12:13:43.245722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:00.734722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.212488+0000","last_change":"2024-09-12T12:13:42.224092+0000","last_active":"2024-09-12T12:13:43.212488+0000","last_peered":"2024-09-12T12:13:43.212488+0000","last_clean":"2024-09-12T12:13:43.212488+0000","last_became_active":"2024-09-12T12:13:42.223801+0000","last_became_peered":"2024-09-12T12:13:42.223801+0000","last_unstale":"2024-09-12T12:13:43.212488+0000","last_undegraded":"2024-09-12T12:13:43.212488+0000","last_fullsized":"2024-09-12T12:13:43.212488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:14.774749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247500+0000","last_change":"2024-09-12T12:13:43.239635+0000","last_active":"2024-09-12T12:13:43.247500+0000","last_peered":"2024-09-12T12:13:43.247500+0000","last_clean":"2024-09-12T12:13:43.247500+0000","last_became_active":"2024-09-12T12:13:43.239355+0000","last_became_peered":"2024-09-12T12:13:43.239355+0000","last_unstale":"2024-09-12T12:13:43.247500+0000","last_undegraded":"2024-09-12T12:13:43.247500+0000","last_fullsized":"2024-09-12T12:13:43.247500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247452+0000","last_change":"2024-09-12T12:13:42.222429+0000","last_active":"2024-09-12T12:13:43.247452+0000","last_peered":"2024-09-12T12:13:43.247452+0000","last_clean":"2024-09-12T12:13:43.247452+0000","last_became_active":"2024-09-12T12:13:42.220509+0000","last_became_peered":"2024-09-12T12:13:42.220509+0000","last_unstale":"2024-09-12T12:13:43.247452+0000","last_undegraded":"2024-09-12T12:13:43.247452+0000","last_fullsized":"2024-09-12T12:13:43.247452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:21.429926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209479+0000","last_change":"2024-09-12T12:13:43.217203+0000","last_active":"2024-09-12T12:13:44.209479+0000","last_peered":"2024-09-12T12:13:44.209479+0000","last_clean":"2024-09-12T12:13:44.209479+0000","last_became_active":"2024-09-12T12:13:43.216889+0000","last_became_peered":"2024-09-12T12:13:43.216889+0000","last_unstale":"2024-09-12T12:13:44.209479+0000","last_undegraded":"2024-09-12T12:13:44.209479+0000","last_fullsized":"2024-09-12T12:13:44.209479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210536+0000","last_change":"2024-09-12T12:13:42.231073+0000","last_active":"2024-09-12T12:13:44.210536+0000","last_peered":"2024-09-12T12:13:44.210536+0000","last_clean":"2024-09-12T12:13:44.210536+0000","last_became_active":"2024-09-12T12:13:42.230401+0000","last_became_peered":"2024-09-12T12:13:42.230401+0000","last_unstale":"2024-09-12T12:13:44.210536+0000","last_undegraded":"2024-09-12T12:13:44.210536+0000","last_fullsized":"2024-09-12T12:13:44.210536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:36.588444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247714+0000","last_change":"2024-09-12T12:13:43.242612+0000","last_active":"2024-09-12T12:13:43.247714+0000","last_peered":"2024-09-12T12:13:43.247714+0000","last_clean":"2024-09-12T12:13:43.247714+0000","last_became_active":"2024-09-12T12:13:43.238803+0000","last_became_peered":"2024-09-12T12:13:43.238803+0000","last_unstale":"2024-09-12T12:13:43.247714+0000","last_undegraded":"2024-09-12T12:13:43.247714+0000","last_fullsized":"2024-09-12T12:13:43.247714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210376+0000","last_change":"2024-09-12T12:13:42.223553+0000","last_active":"2024-09-12T12:13:44.210376+0000","last_peered":"2024-09-12T12:13:44.210376+0000","last_clean":"2024-09-12T12:13:44.210376+0000","last_became_active":"2024-09-12T12:13:42.223299+0000","last_became_peered":"2024-09-12T12:13:42.223299+0000","last_unstale":"2024-09-12T12:13:44.210376+0000","last_undegraded":"2024-09-12T12:13:44.210376+0000","last_fullsized":"2024-09-12T12:13:44.210376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:22.090154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210055+0000","last_change":"2024-09-12T12:13:43.249123+0000","last_active":"2024-09-12T12:13:44.210055+0000","last_peered":"2024-09-12T12:13:44.210055+0000","last_clean":"2024-09-12T12:13:44.210055+0000","last_became_active":"2024-09-12T12:13:43.248879+0000","last_became_peered":"2024-09-12T12:13:43.248879+0000","last_unstale":"2024-09-12T12:13:44.210055+0000","last_undegraded":"2024-09-12T12:13:44.210055+0000","last_fullsized":"2024-09-12T12:13:44.210055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:50.680172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336196+0000","last_change":"2024-09-12T12:13:42.224628+0000","last_active":"2024-09-12T12:13:44.336196+0000","last_peered":"2024-09-12T12:13:44.336196+0000","last_clean":"2024-09-12T12:13:44.336196+0000","last_became_active":"2024-09-12T12:13:42.224334+0000","last_became_peered":"2024-09-12T12:13:42.224334+0000","last_unstale":"2024-09-12T12:13:44.336196+0000","last_undegraded":"2024-09-12T12:13:44.336196+0000","last_fullsized":"2024-09-12T12:13:44.336196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:28.605713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244927+0000","last_change":"2024-09-12T12:13:43.224027+0000","last_active":"2024-09-12T12:13:43.244927+0000","last_peered":"2024-09-12T12:13:43.244927+0000","last_clean":"2024-09-12T12:13:43.244927+0000","last_became_active":"2024-09-12T12:13:43.223671+0000","last_became_peered":"2024-09-12T12:13:43.223671+0000","last_unstale":"2024-09-12T12:13:43.244927+0000","last_undegraded":"2024-09-12T12:13:43.244927+0000","last_fullsized":"2024-09-12T12:13:43.244927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:15.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208144+0000","last_change":"2024-09-12T12:13:42.227207+0000","last_active":"2024-09-12T12:13:44.208144+0000","last_peered":"2024-09-12T12:13:44.208144+0000","last_clean":"2024-09-12T12:13:44.208144+0000","last_became_active":"2024-09-12T12:13:42.226899+0000","last_became_peered":"2024-09-12T12:13:42.226899+0000","last_unstale":"2024-09-12T12:13:44.208144+0000","last_undegraded":"2024-09-12T12:13:44.208144+0000","last_fullsized":"2024-09-12T12:13:44.208144+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:44.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210071+0000","last_change":"2024-09-12T12:13:43.244671+0000","last_active":"2024-09-12T12:13:44.210071+0000","last_peered":"2024-09-12T12:13:44.210071+0000","last_clean":"2024-09-12T12:13:44.210071+0000","last_became_active":"2024-09-12T12:13:43.244426+0000","last_became_peered":"2024-09-12T12:13:43.244426+0000","last_unstale":"2024-09-12T12:13:44.210071+0000","last_undegraded":"2024-09-12T12:13:44.210071+0000","last_fullsized":"2024-09-12T12:13:44.210071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:22.494915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245748+0000","last_change":"2024-09-12T12:13:42.231631+0000","last_active":"2024-09-12T12:13:43.245748+0000","last_peered":"2024-09-12T12:13:43.245748+0000","last_clean":"2024-09-12T12:13:43.245748+0000","last_became_active":"2024-09-12T12:13:42.231285+0000","last_became_peered":"2024-09-12T12:13:42.231285+0000","last_unstale":"2024-09-12T12:13:43.245748+0000","last_undegraded":"2024-09-12T12:13:43.245748+0000","last_fullsized":"2024-09-12T12:13:43.245748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:18.608456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210604+0000","last_change":"2024-09-12T12:13:43.243604+0000","last_active":"2024-09-12T12:13:44.210604+0000","last_peered":"2024-09-12T12:13:44.210604+0000","last_clean":"2024-09-12T12:13:44.210604+0000","last_became_active":"2024-09-12T12:13:43.243328+0000","last_became_peered":"2024-09-12T12:13:43.243328+0000","last_unstale":"2024-09-12T12:13:44.210604+0000","last_undegraded":"2024-09-12T12:13:44.210604+0000","last_fullsized":"2024-09-12T12:13:44.210604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:38.096292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.240257+0000","last_change":"2024-09-12T12:13:42.229343+0000","last_active":"2024-09-12T12:13:43.240257+0000","last_peered":"2024-09-12T12:13:43.240257+0000","last_clean":"2024-09-12T12:13:43.240257+0000","last_became_active":"2024-09-12T12:13:42.229030+0000","last_became_peered":"2024-09-12T12:13:42.229030+0000","last_unstale":"2024-09-12T12:13:43.240257+0000","last_undegraded":"2024-09-12T12:13:43.240257+0000","last_fullsized":"2024-09-12T12:13:43.240257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:27.740275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.248089+0000","last_change":"2024-09-12T12:13:43.246701+0000","last_active":"2024-09-12T12:13:43.248089+0000","last_peered":"2024-09-12T12:13:43.248089+0000","last_clean":"2024-09-12T12:13:43.248089+0000","last_became_active":"2024-09-12T12:13:43.246417+0000","last_became_peered":"2024-09-12T12:13:43.246417+0000","last_unstale":"2024-09-12T12:13:43.248089+0000","last_undegraded":"2024-09-12T12:13:43.248089+0000","last_fullsized":"2024-09-12T12:13:43.248089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:31.818393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209634+0000","last_change":"2024-09-12T12:13:42.226611+0000","last_active":"2024-09-12T12:13:44.209634+0000","last_peered":"2024-09-12T12:13:44.209634+0000","last_clean":"2024-09-12T12:13:44.209634+0000","last_became_active":"2024-09-12T12:13:42.226182+0000","last_became_peered":"2024-09-12T12:13:42.226182+0000","last_unstale":"2024-09-12T12:13:44.209634+0000","last_undegraded":"2024-09-12T12:13:44.209634+0000","last_fullsized":"2024-09-12T12:13:44.209634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:10.757599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209529+0000","last_change":"2024-09-12T12:13:43.229401+0000","last_active":"2024-09-12T12:13:44.209529+0000","last_peered":"2024-09-12T12:13:44.209529+0000","last_clean":"2024-09-12T12:13:44.209529+0000","last_became_active":"2024-09-12T12:13:43.229080+0000","last_became_peered":"2024-09-12T12:13:43.229080+0000","last_unstale":"2024-09-12T12:13:44.209529+0000","last_undegraded":"2024-09-12T12:13:44.209529+0000","last_fullsized":"2024-09-12T12:13:44.209529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.222713+0000","last_change":"2024-09-12T12:13:42.224453+0000","last_active":"2024-09-12T12:13:43.222713+0000","last_peered":"2024-09-12T12:13:43.222713+0000","last_clean":"2024-09-12T12:13:43.222713+0000","last_became_active":"2024-09-12T12:13:42.224192+0000","last_became_peered":"2024-09-12T12:13:42.224192+0000","last_unstale":"2024-09-12T12:13:43.222713+0000","last_undegraded":"2024-09-12T12:13:43.222713+0000","last_fullsized":"2024-09-12T12:13:43.222713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:09.366069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.232548+0000","last_change":"2024-09-12T12:13:43.229862+0000","last_active":"2024-09-12T12:13:43.232548+0000","last_peered":"2024-09-12T12:13:43.232548+0000","last_clean":"2024-09-12T12:13:43.232548+0000","last_became_active":"2024-09-12T12:13:43.229561+0000","last_became_peered":"2024-09-12T12:13:43.229561+0000","last_unstale":"2024-09-12T12:13:43.232548+0000","last_undegraded":"2024-09-12T12:13:43.232548+0000","last_fullsized":"2024-09-12T12:13:43.232548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:57.901189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336368+0000","last_change":"2024-09-12T12:13:42.227948+0000","last_active":"2024-09-12T12:13:44.336368+0000","last_peered":"2024-09-12T12:13:44.336368+0000","last_clean":"2024-09-12T12:13:44.336368+0000","last_became_active":"2024-09-12T12:13:42.227695+0000","last_became_peered":"2024-09-12T12:13:42.227695+0000","last_unstale":"2024-09-12T12:13:44.336368+0000","last_undegraded":"2024-09-12T12:13:44.336368+0000","last_fullsized":"2024-09-12T12:13:44.336368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:01.849678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245008+0000","last_change":"2024-09-12T12:13:43.224055+0000","last_active":"2024-09-12T12:13:43.245008+0000","last_peered":"2024-09-12T12:13:43.245008+0000","last_clean":"2024-09-12T12:13:43.245008+0000","last_became_active":"2024-09-12T12:13:43.223885+0000","last_became_peered":"2024-09-12T12:13:43.223885+0000","last_unstale":"2024-09-12T12:13:43.245008+0000","last_undegraded":"2024-09-12T12:13:43.245008+0000","last_fullsized":"2024-09-12T12:13:43.245008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:10.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246542+0000","last_change":"2024-09-12T12:13:42.220591+0000","last_active":"2024-09-12T12:13:43.246542+0000","last_peered":"2024-09-12T12:13:43.246542+0000","last_clean":"2024-09-12T12:13:43.246542+0000","last_became_active":"2024-09-12T12:13:42.220274+0000","last_became_peered":"2024-09-12T12:13:42.220274+0000","last_unstale":"2024-09-12T12:13:43.246542+0000","last_undegraded":"2024-09-12T12:13:43.246542+0000","last_fullsized":"2024-09-12T12:13:43.246542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:18.829574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246785+0000","last_change":"2024-09-12T12:13:43.234145+0000","last_active":"2024-09-12T12:13:43.246785+0000","last_peered":"2024-09-12T12:13:43.246785+0000","last_clean":"2024-09-12T12:13:43.246785+0000","last_became_active":"2024-09-12T12:13:43.233779+0000","last_became_peered":"2024-09-12T12:13:43.233779+0000","last_unstale":"2024-09-12T12:13:43.246785+0000","last_undegraded":"2024-09-12T12:13:43.246785+0000","last_fullsized":"2024-09-12T12:13:43.246785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:15.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.207187+0000","last_change":"2024-09-12T12:13:42.212451+0000","last_active":"2024-09-12T12:13:43.207187+0000","last_peered":"2024-09-12T12:13:43.207187+0000","last_clean":"2024-09-12T12:13:43.207187+0000","last_became_active":"2024-09-12T12:13:42.212175+0000","last_became_peered":"2024-09-12T12:13:42.212175+0000","last_unstale":"2024-09-12T12:13:43.207187+0000","last_undegraded":"2024-09-12T12:13:43.207187+0000","last_fullsized":"2024-09-12T12:13:43.207187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:41.594907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.234967+0000","last_change":"2024-09-12T12:13:43.225584+0000","last_active":"2024-09-12T12:13:43.234967+0000","last_peered":"2024-09-12T12:13:43.234967+0000","last_clean":"2024-09-12T12:13:43.234967+0000","last_became_active":"2024-09-12T12:13:43.225326+0000","last_became_peered":"2024-09-12T12:13:43.225326+0000","last_unstale":"2024-09-12T12:13:43.234967+0000","last_undegraded":"2024-09-12T12:13:43.234967+0000","last_fullsized":"2024-09-12T12:13:43.234967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.214479+0000","last_change":"2024-09-12T12:13:42.233350+0000","last_active":"2024-09-12T12:13:43.214479+0000","last_peered":"2024-09-12T12:13:43.214479+0000","last_clean":"2024-09-12T12:13:43.214479+0000","last_became_active":"2024-09-12T12:13:42.232970+0000","last_became_peered":"2024-09-12T12:13:42.232970+0000","last_unstale":"2024-09-12T12:13:43.214479+0000","last_undegraded":"2024-09-12T12:13:43.214479+0000","last_fullsized":"2024-09-12T12:13:43.214479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:53.704867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210252+0000","last_change":"2024-09-12T12:13:43.224937+0000","last_active":"2024-09-12T12:13:44.210252+0000","last_peered":"2024-09-12T12:13:44.210252+0000","last_clean":"2024-09-12T12:13:44.210252+0000","last_became_active":"2024-09-12T12:13:43.223740+0000","last_became_peered":"2024-09-12T12:13:43.223740+0000","last_unstale":"2024-09-12T12:13:44.210252+0000","last_undegraded":"2024-09-12T12:13:44.210252+0000","last_fullsized":"2024-09-12T12:13:44.210252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:41.881778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.206942+0000","last_change":"2024-09-12T12:13:42.218353+0000","last_active":"2024-09-12T12:13:43.206942+0000","last_peered":"2024-09-12T12:13:43.206942+0000","last_clean":"2024-09-12T12:13:43.206942+0000","last_became_active":"2024-09-12T12:13:42.218095+0000","last_became_peered":"2024-09-12T12:13:42.218095+0000","last_unstale":"2024-09-12T12:13:43.206942+0000","last_undegraded":"2024-09-12T12:13:43.206942+0000","last_fullsized":"2024-09-12T12:13:43.206942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:26.102256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336441+0000","last_change":"2024-09-12T12:13:43.246965+0000","last_active":"2024-09-12T12:13:44.336441+0000","last_peered":"2024-09-12T12:13:44.336441+0000","last_clean":"2024-09-12T12:13:44.336441+0000","last_became_active":"2024-09-12T12:13:43.245467+0000","last_became_peered":"2024-09-12T12:13:43.245467+0000","last_unstale":"2024-09-12T12:13:44.336441+0000","last_undegraded":"2024-09-12T12:13:44.336441+0000","last_fullsized":"2024-09-12T12:13:44.336441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246580+0000","last_change":"2024-09-12T12:13:42.226582+0000","last_active":"2024-09-12T12:13:43.246580+0000","last_peered":"2024-09-12T12:13:43.246580+0000","last_clean":"2024-09-12T12:13:43.246580+0000","last_became_active":"2024-09-12T12:13:42.226283+0000","last_became_peered":"2024-09-12T12:13:42.226283+0000","last_unstale":"2024-09-12T12:13:43.246580+0000","last_undegraded":"2024-09-12T12:13:43.246580+0000","last_fullsized":"2024-09-12T12:13:43.246580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:00.233965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245573+0000","last_change":"2024-09-12T12:13:43.237068+0000","last_active":"2024-09-12T12:13:43.245573+0000","last_peered":"2024-09-12T12:13:43.245573+0000","last_clean":"2024-09-12T12:13:43.245573+0000","last_became_active":"2024-09-12T12:13:43.236703+0000","last_became_peered":"2024-09-12T12:13:43.236703+0000","last_unstale":"2024-09-12T12:13:43.245573+0000","last_undegraded":"2024-09-12T12:13:43.245573+0000","last_fullsized":"2024-09-12T12:13:43.245573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:08.547195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.209174+0000","last_change":"2024-09-12T12:13:42.222493+0000","last_active":"2024-09-12T12:13:43.209174+0000","last_peered":"2024-09-12T12:13:43.209174+0000","last_clean":"2024-09-12T12:13:43.209174+0000","last_became_active":"2024-09-12T12:13:42.222230+0000","last_became_peered":"2024-09-12T12:13:42.222230+0000","last_unstale":"2024-09-12T12:13:43.209174+0000","last_undegraded":"2024-09-12T12:13:43.209174+0000","last_fullsized":"2024-09-12T12:13:43.209174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:50:13.329589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210782+0000","last_change":"2024-09-12T12:13:43.226626+0000","last_active":"2024-09-12T12:13:44.210782+0000","last_peered":"2024-09-12T12:13:44.210782+0000","last_clean":"2024-09-12T12:13:44.210782+0000","last_became_active":"2024-09-12T12:13:43.226315+0000","last_became_peered":"2024-09-12T12:13:43.226315+0000","last_unstale":"2024-09-12T12:13:44.210782+0000","last_undegraded":"2024-09-12T12:13:44.210782+0000","last_fullsized":"2024-09-12T12:13:44.210782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:02.541823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.213533+0000","last_change":"2024-09-12T12:13:42.220988+0000","last_active":"2024-09-12T12:13:43.213533+0000","last_peered":"2024-09-12T12:13:43.213533+0000","last_clean":"2024-09-12T12:13:43.213533+0000","last_became_active":"2024-09-12T12:13:42.220718+0000","last_became_peered":"2024-09-12T12:13:42.220718+0000","last_unstale":"2024-09-12T12:13:43.213533+0000","last_undegraded":"2024-09-12T12:13:43.213533+0000","last_fullsized":"2024-09-12T12:13:43.213533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:53.704867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247725+0000","last_change":"2024-09-12T12:13:43.243796+0000","last_active":"2024-09-12T12:13:43.247725+0000","last_peered":"2024-09-12T12:13:43.247725+0000","last_clean":"2024-09-12T12:13:43.247725+0000","last_became_active":"2024-09-12T12:13:43.235674+0000","last_became_peered":"2024-09-12T12:13:43.235674+0000","last_unstale":"2024-09-12T12:13:43.247725+0000","last_undegraded":"2024-09-12T12:13:43.247725+0000","last_fullsized":"2024-09-12T12:13:43.247725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.219040+0000","last_change":"2024-09-12T12:13:42.226680+0000","last_active":"2024-09-12T12:13:43.219040+0000","last_peered":"2024-09-12T12:13:43.219040+0000","last_clean":"2024-09-12T12:13:43.219040+0000","last_became_active":"2024-09-12T12:13:42.226419+0000","last_became_peered":"2024-09-12T12:13:42.226419+0000","last_unstale":"2024-09-12T12:13:43.219040+0000","last_undegraded":"2024-09-12T12:13:43.219040+0000","last_fullsized":"2024-09-12T12:13:43.219040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:27.740275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336265+0000","last_change":"2024-09-12T12:13:43.247334+0000","last_active":"2024-09-12T12:13:44.336265+0000","last_peered":"2024-09-12T12:13:44.336265+0000","last_clean":"2024-09-12T12:13:44.336265+0000","last_became_active":"2024-09-12T12:13:43.247043+0000","last_became_peered":"2024-09-12T12:13:43.247043+0000","last_unstale":"2024-09-12T12:13:44.336265+0000","last_undegraded":"2024-09-12T12:13:44.336265+0000","last_fullsized":"2024-09-12T12:13:44.336265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208475+0000","last_change":"2024-09-12T12:13:42.227848+0000","last_active":"2024-09-12T12:13:44.208475+0000","last_peered":"2024-09-12T12:13:44.208475+0000","last_clean":"2024-09-12T12:13:44.208475+0000","last_became_active":"2024-09-12T12:13:42.227520+0000","last_became_peered":"2024-09-12T12:13:42.227520+0000","last_unstale":"2024-09-12T12:13:44.208475+0000","last_undegraded":"2024-09-12T12:13:44.208475+0000","last_fullsized":"2024-09-12T12:13:44.208475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:18.691031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208439+0000","last_change":"2024-09-12T12:13:43.231905+0000","last_active":"2024-09-12T12:13:44.208439+0000","last_peered":"2024-09-12T12:13:44.208439+0000","last_clean":"2024-09-12T12:13:44.208439+0000","last_became_active":"2024-09-12T12:13:43.231649+0000","last_became_peered":"2024-09-12T12:13:43.231649+0000","last_unstale":"2024-09-12T12:13:44.208439+0000","last_undegraded":"2024-09-12T12:13:44.208439+0000","last_fullsized":"2024-09-12T12:13:44.208439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:10.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208889+0000","last_change":"2024-09-12T12:13:42.223588+0000","last_active":"2024-09-12T12:13:44.208889+0000","last_peered":"2024-09-12T12:13:44.208889+0000","last_clean":"2024-09-12T12:13:44.208889+0000","last_became_active":"2024-09-12T12:13:42.223291+0000","last_became_peered":"2024-09-12T12:13:42.223291+0000","last_unstale":"2024-09-12T12:13:44.208889+0000","last_undegraded":"2024-09-12T12:13:44.208889+0000","last_fullsized":"2024-09-12T12:13:44.208889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:28.605713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245527+0000","last_change":"2024-09-12T12:13:43.236016+0000","last_active":"2024-09-12T12:13:43.245527+0000","last_peered":"2024-09-12T12:13:43.245527+0000","last_clean":"2024-09-12T12:13:43.245527+0000","last_became_active":"2024-09-12T12:13:43.235700+0000","last_became_peered":"2024-09-12T12:13:43.235700+0000","last_unstale":"2024-09-12T12:13:43.245527+0000","last_undegraded":"2024-09-12T12:13:43.245527+0000","last_fullsized":"2024-09-12T12:13:43.245527+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210081+0000","last_change":"2024-09-12T12:13:42.222115+0000","last_active":"2024-09-12T12:13:44.210081+0000","last_peered":"2024-09-12T12:13:44.210081+0000","last_clean":"2024-09-12T12:13:44.210081+0000","last_became_active":"2024-09-12T12:13:42.221849+0000","last_became_peered":"2024-09-12T12:13:42.221849+0000","last_unstale":"2024-09-12T12:13:44.210081+0000","last_undegraded":"2024-09-12T12:13:44.210081+0000","last_fullsized":"2024-09-12T12:13:44.210081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:22.629945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.234290+0000","last_change":"2024-09-12T12:13:43.231424+0000","last_active":"2024-09-12T12:13:43.234290+0000","last_peered":"2024-09-12T12:13:43.234290+0000","last_clean":"2024-09-12T12:13:43.234290+0000","last_became_active":"2024-09-12T12:13:43.230822+0000","last_became_peered":"2024-09-12T12:13:43.230822+0000","last_unstale":"2024-09-12T12:13:43.234290+0000","last_undegraded":"2024-09-12T12:13:43.234290+0000","last_fullsized":"2024-09-12T12:13:43.234290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:40.687151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.215779+0000","last_change":"2024-09-12T12:13:42.229981+0000","last_active":"2024-09-12T12:13:43.215779+0000","last_peered":"2024-09-12T12:13:43.215779+0000","last_clean":"2024-09-12T12:13:43.215779+0000","last_became_active":"2024-09-12T12:13:42.229710+0000","last_became_peered":"2024-09-12T12:13:42.229710+0000","last_unstale":"2024-09-12T12:13:43.215779+0000","last_undegraded":"2024-09-12T12:13:43.215779+0000","last_fullsized":"2024-09-12T12:13:43.215779+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:00.233965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.215084+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:13:43.215084+0000","last_peered":"2024-09-12T12:13:43.215084+0000","last_clean":"2024-09-12T12:13:43.215084+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:13:43.215084+0000","last_undegraded":"2024-09-12T12:13:43.215084+0000","last_fullsized":"2024-09-12T12:13:43.215084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1048576,"data_stored":780065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":454656,"data_stored":195289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":188127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":188619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":189661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":442368,"data_stored":188085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":442368,"data_stored":188105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1036288,"data_stored":778417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:13:47.308 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:13:47.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.476+0000 7efe8f600640 1 Processor -- start 2024-09-12T12:13:47.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.476+0000 7efe8f600640 1 -- start start 2024-09-12T12:13:47.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe8f600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe88071420 0x7efe88071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe8f600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe880b45a0 con 0x7efe880ccf30 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe8f600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe880b3fe0 con 0x7efe8815b4e0 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe8f600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efe880b42c0 con 0x7efe88071420 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe87e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe88071420 0x7efe88071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe8d600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efe880ccf30 0x7efe880cd350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56924/0 (socket says 172.21.15.144:56924) 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe87e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe88071420 0x7efe88071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40474/0 (socket says 172.21.15.144:40474) 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe8d600640 1 -- 172.21.15.144:0/860580352 learned_addr learned my addr 172.21.15.144:0/860580352 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe87e00640 1 -- 172.21.15.144:0/860580352 >> v1:172.21.15.165:6789/0 conn(0x7efe8815b4e0 legacy=0x7efe880b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe87e00640 1 -- 172.21.15.144:0/860580352 >> v1:172.21.15.144:6789/0 conn(0x7efe880ccf30 legacy=0x7efe880cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe87e00640 1 -- 172.21.15.144:0/860580352 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe880b1490 con 0x7efe88071420 2024-09-12T12:13:47.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.480+0000 7efe87400640 1 -- 172.21.15.144:0/860580352 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3861960460 0 0) 0x7efe880b45a0 con 0x7efe880ccf30 2024-09-12T12:13:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe87e00640 1 --2- 172.21.15.144:0/860580352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe88071420 0x7efe88071840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efe7400ba60 tx=0x7efe7401eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba70585361cb02c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe87400640 1 -- 172.21.15.144:0/860580352 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe740b4070 con 0x7efe88071420 2024-09-12T12:13:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe87400640 1 -- 172.21.15.144:0/860580352 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe740a7b60 con 0x7efe88071420 2024-09-12T12:13:47.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe87400640 1 -- 172.21.15.144:0/860580352 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe740af440 con 0x7efe88071420 2024-09-12T12:13:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 -- 172.21.15.144:0/860580352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe88071420 msgr2=0x7efe88071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 --2- 172.21.15.144:0/860580352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe88071420 0x7efe88071840 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efe7400ba60 tx=0x7efe7401eb00 comp rx=0 tx=0).stop 2024-09-12T12:13:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 -- 172.21.15.144:0/860580352 shutdown_connections 2024-09-12T12:13:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 --2- 172.21.15.144:0/860580352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe88071420 0x7efe88071840 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 -- 172.21.15.144:0/860580352 >> 172.21.15.144:0/860580352 conn(0x7efe8806d0d0 msgr2=0x7efe8806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 -- 172.21.15.144:0/860580352 shutdown_connections 2024-09-12T12:13:47.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 -- 172.21.15.144:0/860580352 wait complete. 2024-09-12T12:13:47.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 Processor -- start 2024-09-12T12:13:47.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 -- start start 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe88071420 0x7efe881528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe880ccf30 0x7efe880cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe8815b4e0 0x7efe880cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe8815b8c0 con 0x7efe8815b4e0 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efe880b02e0 con 0x7efe88071420 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.484+0000 7efe8f600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efe88073a70 con 0x7efe880ccf30 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe8815b4e0 0x7efe880cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe8815b4e0 0x7efe880cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40486/0 (socket says 172.21.15.144:40486) 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8d600640 1 -- 172.21.15.144:0/1891630611 learned_addr learned my addr 172.21.15.144:0/1891630611 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe87e00640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe880ccf30 0x7efe880cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8cc00640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe88071420 0x7efe881528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8d600640 1 -- 172.21.15.144:0/1891630611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe880ccf30 msgr2=0x7efe880cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8d600640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe880ccf30 0x7efe880cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8d600640 1 -- 172.21.15.144:0/1891630611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe88071420 msgr2=0x7efe881528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8d600640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe88071420 0x7efe881528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8d600640 1 -- 172.21.15.144:0/1891630611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe881faeb0 con 0x7efe8815b4e0 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8d600640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe8815b4e0 0x7efe880cfaa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efe8000c7d0 tx=0x7efe8000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe84c00640 1 -- 172.21.15.144:0/1891630611 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80018070 con 0x7efe8815b4e0 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe84c00640 1 -- 172.21.15.144:0/1891630611 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe8000a640 con 0x7efe8815b4e0 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe84c00640 1 -- 172.21.15.144:0/1891630611 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8000aa70 con 0x7efe8815b4e0 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe881fb190 con 0x7efe8815b4e0 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe88152e30 con 0x7efe8815b4e0 2024-09-12T12:13:47.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe881faca0 con 0x7efe8815b4e0 2024-09-12T12:13:47.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.488+0000 7efe84c00640 1 -- 172.21.15.144:0/1891630611 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe8001b070 con 0x7efe8815b4e0 2024-09-12T12:13:47.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.492+0000 7efe84c00640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe680678c0 0x7efe68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.492+0000 7efe84c00640 1 -- 172.21.15.144:0/1891630611 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7efe800853e0 con 0x7efe8815b4e0 2024-09-12T12:13:47.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.492+0000 7efe8cc00640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe680678c0 0x7efe68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.492+0000 7efe8cc00640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe680678c0 0x7efe68069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe780098e0 tx=0x7efe78009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:47.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.496+0000 7efe84c00640 1 -- 172.21.15.144:0/1891630611 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe80055720 con 0x7efe8815b4e0 2024-09-12T12:13:47.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.648+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe88071840 con 0x7efe680678c0 2024-09-12T12:13:47.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.652+0000 7efe84c00640 1 -- 172.21.15.144:0/1891630611 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251917 (secure 0 0 0) 0x7efe88071840 con 0x7efe680678c0 2024-09-12T12:13:47.659 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:47.660 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:13:47.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe680678c0 msgr2=0x7efe68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe680678c0 0x7efe68069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe780098e0 tx=0x7efe78009060 comp rx=0 tx=0).stop 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe8815b4e0 msgr2=0x7efe880cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe8815b4e0 0x7efe880cfaa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efe8000c7d0 tx=0x7efe8000cc90 comp rx=0 tx=0).stop 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 shutdown_connections 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe680678c0 0x7efe68069d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe8815b4e0 0x7efe880cfaa0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe880ccf30 0x7efe880cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 --2- 172.21.15.144:0/1891630611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe88071420 0x7efe881528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 >> 172.21.15.144:0/1891630611 conn(0x7efe8806d0d0 msgr2=0x7efe8815efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 shutdown_connections 2024-09-12T12:13:47.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.656+0000 7efe8f600640 1 -- 172.21.15.144:0/1891630611 wait complete. 2024-09-12T12:13:47.679 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-12T12:13:47.388784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225064,"kb_used_data":4660,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749656,"statfs":{"total":773094113280,"available":772863647744,"internally_reserved":0,"allocated":4771840,"data_stored":2696368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000881"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210853+0000","last_change":"2024-09-12T12:13:43.244735+0000","last_active":"2024-09-12T12:13:44.210853+0000","last_peered":"2024-09-12T12:13:44.210853+0000","last_clean":"2024-09-12T12:13:44.210853+0000","last_became_active":"2024-09-12T12:13:43.244436+0000","last_became_peered":"2024-09-12T12:13:43.244436+0000","last_unstale":"2024-09-12T12:13:44.210853+0000","last_undegraded":"2024-09-12T12:13:44.210853+0000","last_fullsized":"2024-09-12T12:13:44.210853+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:53.404803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210600+0000","last_change":"2024-09-12T12:13:43.228980+0000","last_active":"2024-09-12T12:13:44.210600+0000","last_peered":"2024-09-12T12:13:44.210600+0000","last_clean":"2024-09-12T12:13:44.210600+0000","last_became_active":"2024-09-12T12:13:43.228657+0000","last_became_peered":"2024-09-12T12:13:43.228657+0000","last_unstale":"2024-09-12T12:13:44.210600+0000","last_undegraded":"2024-09-12T12:13:44.210600+0000","last_fullsized":"2024-09-12T12:13:44.210600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:52.062922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246829+0000","last_change":"2024-09-12T12:13:43.234545+0000","last_active":"2024-09-12T12:13:43.246829+0000","last_peered":"2024-09-12T12:13:43.246829+0000","last_clean":"2024-09-12T12:13:43.246829+0000","last_became_active":"2024-09-12T12:13:43.234249+0000","last_became_peered":"2024-09-12T12:13:43.234249+0000","last_unstale":"2024-09-12T12:13:43.246829+0000","last_undegraded":"2024-09-12T12:13:43.246829+0000","last_fullsized":"2024-09-12T12:13:43.246829+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:10.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.231156+0000","last_change":"2024-09-12T12:13:43.225630+0000","last_active":"2024-09-12T12:13:43.231156+0000","last_peered":"2024-09-12T12:13:43.231156+0000","last_clean":"2024-09-12T12:13:43.231156+0000","last_became_active":"2024-09-12T12:13:43.224701+0000","last_became_peered":"2024-09-12T12:13:43.224701+0000","last_unstale":"2024-09-12T12:13:43.231156+0000","last_undegraded":"2024-09-12T12:13:43.231156+0000","last_fullsized":"2024-09-12T12:13:43.231156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:59.509473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.215804+0000","last_change":"2024-09-12T12:13:43.212514+0000","last_active":"2024-09-12T12:13:43.215804+0000","last_peered":"2024-09-12T12:13:43.215804+0000","last_clean":"2024-09-12T12:13:43.215804+0000","last_became_active":"2024-09-12T12:13:43.212217+0000","last_became_peered":"2024-09-12T12:13:43.212217+0000","last_unstale":"2024-09-12T12:13:43.215804+0000","last_undegraded":"2024-09-12T12:13:43.215804+0000","last_fullsized":"2024-09-12T12:13:43.215804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:41.458594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336245+0000","last_change":"2024-09-12T12:13:43.233076+0000","last_active":"2024-09-12T12:13:44.336245+0000","last_peered":"2024-09-12T12:13:44.336245+0000","last_clean":"2024-09-12T12:13:44.336245+0000","last_became_active":"2024-09-12T12:13:43.232779+0000","last_became_peered":"2024-09-12T12:13:43.232779+0000","last_unstale":"2024-09-12T12:13:44.336245+0000","last_undegraded":"2024-09-12T12:13:44.336245+0000","last_fullsized":"2024-09-12T12:13:44.336245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:22.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.234568+0000","last_change":"2024-09-12T12:13:43.230413+0000","last_active":"2024-09-12T12:13:43.234568+0000","last_peered":"2024-09-12T12:13:43.234568+0000","last_clean":"2024-09-12T12:13:43.234568+0000","last_became_active":"2024-09-12T12:13:43.230138+0000","last_became_peered":"2024-09-12T12:13:43.230138+0000","last_unstale":"2024-09-12T12:13:43.234568+0000","last_undegraded":"2024-09-12T12:13:43.234568+0000","last_fullsized":"2024-09-12T12:13:43.234568+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:30.133702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209950+0000","last_change":"2024-09-12T12:13:43.237407+0000","last_active":"2024-09-12T12:13:44.209950+0000","last_peered":"2024-09-12T12:13:44.209950+0000","last_clean":"2024-09-12T12:13:44.209950+0000","last_became_active":"2024-09-12T12:13:43.236999+0000","last_became_peered":"2024-09-12T12:13:43.236999+0000","last_unstale":"2024-09-12T12:13:44.209950+0000","last_undegraded":"2024-09-12T12:13:44.209950+0000","last_fullsized":"2024-09-12T12:13:44.209950+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:31:53.126811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247482+0000","last_change":"2024-09-12T12:13:43.239302+0000","last_active":"2024-09-12T12:13:43.247482+0000","last_peered":"2024-09-12T12:13:43.247482+0000","last_clean":"2024-09-12T12:13:43.247482+0000","last_became_active":"2024-09-12T12:13:43.238850+0000","last_became_peered":"2024-09-12T12:13:43.238850+0000","last_unstale":"2024-09-12T12:13:43.247482+0000","last_undegraded":"2024-09-12T12:13:43.247482+0000","last_fullsized":"2024-09-12T12:13:43.247482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:22.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.232474+0000","last_change":"2024-09-12T12:13:43.226294+0000","last_active":"2024-09-12T12:13:43.232474+0000","last_peered":"2024-09-12T12:13:43.232474+0000","last_clean":"2024-09-12T12:13:43.232474+0000","last_became_active":"2024-09-12T12:13:43.223598+0000","last_became_peered":"2024-09-12T12:13:43.223598+0000","last_unstale":"2024-09-12T12:13:43.232474+0000","last_undegraded":"2024-09-12T12:13:43.232474+0000","last_fullsized":"2024-09-12T12:13:43.232474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.232583+0000","last_change":"2024-09-12T12:13:43.226639+0000","last_active":"2024-09-12T12:13:43.232583+0000","last_peered":"2024-09-12T12:13:43.232583+0000","last_clean":"2024-09-12T12:13:43.232583+0000","last_became_active":"2024-09-12T12:13:43.226343+0000","last_became_peered":"2024-09-12T12:13:43.226343+0000","last_unstale":"2024-09-12T12:13:43.232583+0000","last_undegraded":"2024-09-12T12:13:43.232583+0000","last_fullsized":"2024-09-12T12:13:43.232583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246039+0000","last_change":"2024-09-12T12:13:43.232962+0000","last_active":"2024-09-12T12:13:43.246039+0000","last_peered":"2024-09-12T12:13:43.246039+0000","last_clean":"2024-09-12T12:13:43.246039+0000","last_became_active":"2024-09-12T12:13:43.232713+0000","last_became_peered":"2024-09-12T12:13:43.232713+0000","last_unstale":"2024-09-12T12:13:43.246039+0000","last_undegraded":"2024-09-12T12:13:43.246039+0000","last_fullsized":"2024-09-12T12:13:43.246039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.238571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.231719+0000","last_change":"2024-09-12T12:13:43.222647+0000","last_active":"2024-09-12T12:13:43.231719+0000","last_peered":"2024-09-12T12:13:43.231719+0000","last_clean":"2024-09-12T12:13:43.231719+0000","last_became_active":"2024-09-12T12:13:43.222380+0000","last_became_peered":"2024-09-12T12:13:43.222380+0000","last_unstale":"2024-09-12T12:13:43.231719+0000","last_undegraded":"2024-09-12T12:13:43.231719+0000","last_fullsized":"2024-09-12T12:13:43.231719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208388+0000","last_change":"2024-09-12T12:13:43.217301+0000","last_active":"2024-09-12T12:13:44.208388+0000","last_peered":"2024-09-12T12:13:44.208388+0000","last_clean":"2024-09-12T12:13:44.208388+0000","last_became_active":"2024-09-12T12:13:43.216932+0000","last_became_peered":"2024-09-12T12:13:43.216932+0000","last_unstale":"2024-09-12T12:13:44.208388+0000","last_undegraded":"2024-09-12T12:13:44.208388+0000","last_fullsized":"2024-09-12T12:13:44.208388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:15.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.234546+0000","last_change":"2024-09-12T12:13:43.229389+0000","last_active":"2024-09-12T12:13:43.234546+0000","last_peered":"2024-09-12T12:13:43.234546+0000","last_clean":"2024-09-12T12:13:43.234546+0000","last_became_active":"2024-09-12T12:13:43.229111+0000","last_became_peered":"2024-09-12T12:13:43.229111+0000","last_unstale":"2024-09-12T12:13:43.234546+0000","last_undegraded":"2024-09-12T12:13:43.234546+0000","last_fullsized":"2024-09-12T12:13:43.234546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:08.547195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245793+0000","last_change":"2024-09-12T12:13:43.238288+0000","last_active":"2024-09-12T12:13:43.245793+0000","last_peered":"2024-09-12T12:13:43.245793+0000","last_clean":"2024-09-12T12:13:43.245793+0000","last_became_active":"2024-09-12T12:13:43.237988+0000","last_became_peered":"2024-09-12T12:13:43.237988+0000","last_unstale":"2024-09-12T12:13:43.245793+0000","last_undegraded":"2024-09-12T12:13:43.245793+0000","last_fullsized":"2024-09-12T12:13:43.245793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:30.133702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245265+0000","last_change":"2024-09-12T12:13:43.234372+0000","last_active":"2024-09-12T12:13:43.245265+0000","last_peered":"2024-09-12T12:13:43.245265+0000","last_clean":"2024-09-12T12:13:43.245265+0000","last_became_active":"2024-09-12T12:13:43.234062+0000","last_became_peered":"2024-09-12T12:13:43.234062+0000","last_unstale":"2024-09-12T12:13:43.245265+0000","last_undegraded":"2024-09-12T12:13:43.245265+0000","last_fullsized":"2024-09-12T12:13:43.245265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208796+0000","last_change":"2024-09-12T12:13:43.230161+0000","last_active":"2024-09-12T12:13:44.208796+0000","last_peered":"2024-09-12T12:13:44.208796+0000","last_clean":"2024-09-12T12:13:44.208796+0000","last_became_active":"2024-09-12T12:13:43.224716+0000","last_became_peered":"2024-09-12T12:13:43.224716+0000","last_unstale":"2024-09-12T12:13:44.208796+0000","last_undegraded":"2024-09-12T12:13:44.208796+0000","last_fullsized":"2024-09-12T12:13:44.208796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:19.613063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.243670+0000","last_change":"2024-09-12T12:13:43.241173+0000","last_active":"2024-09-12T12:13:43.243670+0000","last_peered":"2024-09-12T12:13:43.243670+0000","last_clean":"2024-09-12T12:13:43.243670+0000","last_became_active":"2024-09-12T12:13:43.240857+0000","last_became_peered":"2024-09-12T12:13:43.240857+0000","last_unstale":"2024-09-12T12:13:43.243670+0000","last_undegraded":"2024-09-12T12:13:43.243670+0000","last_fullsized":"2024-09-12T12:13:43.243670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:19.695637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208996+0000","last_change":"2024-09-12T12:13:43.230230+0000","last_active":"2024-09-12T12:13:44.208996+0000","last_peered":"2024-09-12T12:13:44.208996+0000","last_clean":"2024-09-12T12:13:44.208996+0000","last_became_active":"2024-09-12T12:13:43.229944+0000","last_became_peered":"2024-09-12T12:13:43.229944+0000","last_unstale":"2024-09-12T12:13:44.208996+0000","last_undegraded":"2024-09-12T12:13:44.208996+0000","last_fullsized":"2024-09-12T12:13:44.208996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:01.238571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244014+0000","last_change":"2024-09-12T12:13:43.239236+0000","last_active":"2024-09-12T12:13:43.244014+0000","last_peered":"2024-09-12T12:13:43.244014+0000","last_clean":"2024-09-12T12:13:43.244014+0000","last_became_active":"2024-09-12T12:13:43.239000+0000","last_became_peered":"2024-09-12T12:13:43.239000+0000","last_unstale":"2024-09-12T12:13:43.244014+0000","last_undegraded":"2024-09-12T12:13:43.244014+0000","last_fullsized":"2024-09-12T12:13:43.244014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:58.310139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209050+0000","last_change":"2024-09-12T12:13:43.214958+0000","last_active":"2024-09-12T12:13:44.209050+0000","last_peered":"2024-09-12T12:13:44.209050+0000","last_clean":"2024-09-12T12:13:44.209050+0000","last_became_active":"2024-09-12T12:13:43.214696+0000","last_became_peered":"2024-09-12T12:13:43.214696+0000","last_unstale":"2024-09-12T12:13:44.209050+0000","last_undegraded":"2024-09-12T12:13:44.209050+0000","last_fullsized":"2024-09-12T12:13:44.209050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:22.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244923+0000","last_change":"2024-09-12T12:13:43.226827+0000","last_active":"2024-09-12T12:13:43.244923+0000","last_peered":"2024-09-12T12:13:43.244923+0000","last_clean":"2024-09-12T12:13:43.244923+0000","last_became_active":"2024-09-12T12:13:43.226549+0000","last_became_peered":"2024-09-12T12:13:43.226549+0000","last_unstale":"2024-09-12T12:13:43.244923+0000","last_undegraded":"2024-09-12T12:13:43.244923+0000","last_fullsized":"2024-09-12T12:13:43.244923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:22.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.223959+0000","last_change":"2024-09-12T12:13:43.222437+0000","last_active":"2024-09-12T12:13:43.223959+0000","last_peered":"2024-09-12T12:13:43.223959+0000","last_clean":"2024-09-12T12:13:43.223959+0000","last_became_active":"2024-09-12T12:13:43.221619+0000","last_became_peered":"2024-09-12T12:13:43.221619+0000","last_unstale":"2024-09-12T12:13:43.223959+0000","last_undegraded":"2024-09-12T12:13:43.223959+0000","last_fullsized":"2024-09-12T12:13:43.223959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:33.325460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209328+0000","last_change":"2024-09-12T12:13:43.242362+0000","last_active":"2024-09-12T12:13:44.209328+0000","last_peered":"2024-09-12T12:13:44.209328+0000","last_clean":"2024-09-12T12:13:44.209328+0000","last_became_active":"2024-09-12T12:13:43.242076+0000","last_became_peered":"2024-09-12T12:13:43.242076+0000","last_unstale":"2024-09-12T12:13:44.209328+0000","last_undegraded":"2024-09-12T12:13:44.209328+0000","last_fullsized":"2024-09-12T12:13:44.209328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:15.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336559+0000","last_change":"2024-09-12T12:13:43.247905+0000","last_active":"2024-09-12T12:13:44.336559+0000","last_peered":"2024-09-12T12:13:44.336559+0000","last_clean":"2024-09-12T12:13:44.336559+0000","last_became_active":"2024-09-12T12:13:43.247277+0000","last_became_peered":"2024-09-12T12:13:43.247277+0000","last_unstale":"2024-09-12T12:13:44.336559+0000","last_undegraded":"2024-09-12T12:13:44.336559+0000","last_fullsized":"2024-09-12T12:13:44.336559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:08.547195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208938+0000","last_change":"2024-09-12T12:13:43.229983+0000","last_active":"2024-09-12T12:13:44.208938+0000","last_peered":"2024-09-12T12:13:44.208938+0000","last_clean":"2024-09-12T12:13:44.208938+0000","last_became_active":"2024-09-12T12:13:43.225211+0000","last_became_peered":"2024-09-12T12:13:43.225211+0000","last_unstale":"2024-09-12T12:13:44.208938+0000","last_undegraded":"2024-09-12T12:13:44.208938+0000","last_fullsized":"2024-09-12T12:13:44.208938+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:28.744882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.233213+0000","last_change":"2024-09-12T12:13:43.230509+0000","last_active":"2024-09-12T12:13:43.233213+0000","last_peered":"2024-09-12T12:13:43.233213+0000","last_clean":"2024-09-12T12:13:43.233213+0000","last_became_active":"2024-09-12T12:13:43.230148+0000","last_became_peered":"2024-09-12T12:13:43.230148+0000","last_unstale":"2024-09-12T12:13:43.233213+0000","last_undegraded":"2024-09-12T12:13:43.233213+0000","last_fullsized":"2024-09-12T12:13:43.233213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:00.734722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208587+0000","last_change":"2024-09-12T12:13:43.247006+0000","last_active":"2024-09-12T12:13:44.208587+0000","last_peered":"2024-09-12T12:13:44.208587+0000","last_clean":"2024-09-12T12:13:44.208587+0000","last_became_active":"2024-09-12T12:13:43.246712+0000","last_became_peered":"2024-09-12T12:13:43.246712+0000","last_unstale":"2024-09-12T12:13:44.208587+0000","last_undegraded":"2024-09-12T12:13:44.208587+0000","last_fullsized":"2024-09-12T12:13:44.208587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:54.709474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208378+0000","last_change":"2024-09-12T12:13:43.229857+0000","last_active":"2024-09-12T12:13:44.208378+0000","last_peered":"2024-09-12T12:13:44.208378+0000","last_clean":"2024-09-12T12:13:44.208378+0000","last_became_active":"2024-09-12T12:13:43.224427+0000","last_became_peered":"2024-09-12T12:13:43.224427+0000","last_unstale":"2024-09-12T12:13:44.208378+0000","last_undegraded":"2024-09-12T12:13:44.208378+0000","last_fullsized":"2024-09-12T12:13:44.208378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:43.536121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245210+0000","last_change":"2024-09-12T12:13:43.227341+0000","last_active":"2024-09-12T12:13:43.245210+0000","last_peered":"2024-09-12T12:13:43.245210+0000","last_clean":"2024-09-12T12:13:43.245210+0000","last_became_active":"2024-09-12T12:13:43.226849+0000","last_became_peered":"2024-09-12T12:13:43.226849+0000","last_unstale":"2024-09-12T12:13:43.245210+0000","last_undegraded":"2024-09-12T12:13:43.245210+0000","last_fullsized":"2024-09-12T12:13:43.245210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336329+0000","last_change":"2024-09-12T12:13:43.227837+0000","last_active":"2024-09-12T12:13:44.336329+0000","last_peered":"2024-09-12T12:13:44.336329+0000","last_clean":"2024-09-12T12:13:44.336329+0000","last_became_active":"2024-09-12T12:13:43.227560+0000","last_became_peered":"2024-09-12T12:13:43.227560+0000","last_unstale":"2024-09-12T12:13:44.336329+0000","last_undegraded":"2024-09-12T12:13:44.336329+0000","last_fullsized":"2024-09-12T12:13:44.336329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245350+0000","last_change":"2024-09-12T12:13:43.235173+0000","last_active":"2024-09-12T12:13:43.245350+0000","last_peered":"2024-09-12T12:13:43.245350+0000","last_clean":"2024-09-12T12:13:43.245350+0000","last_became_active":"2024-09-12T12:13:43.234875+0000","last_became_peered":"2024-09-12T12:13:43.234875+0000","last_unstale":"2024-09-12T12:13:43.245350+0000","last_undegraded":"2024-09-12T12:13:43.245350+0000","last_fullsized":"2024-09-12T12:13:43.245350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209154+0000","last_change":"2024-09-12T12:13:42.225850+0000","last_active":"2024-09-12T12:13:44.209154+0000","last_peered":"2024-09-12T12:13:44.209154+0000","last_clean":"2024-09-12T12:13:44.209154+0000","last_became_active":"2024-09-12T12:13:42.225541+0000","last_became_peered":"2024-09-12T12:13:42.225541+0000","last_unstale":"2024-09-12T12:13:44.209154+0000","last_undegraded":"2024-09-12T12:13:44.209154+0000","last_fullsized":"2024-09-12T12:13:44.209154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:45:39.749491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336539+0000","last_change":"2024-09-12T12:13:43.245629+0000","last_active":"2024-09-12T12:13:44.336539+0000","last_peered":"2024-09-12T12:13:44.336539+0000","last_clean":"2024-09-12T12:13:44.336539+0000","last_became_active":"2024-09-12T12:13:43.245374+0000","last_became_peered":"2024-09-12T12:13:43.245374+0000","last_unstale":"2024-09-12T12:13:44.336539+0000","last_undegraded":"2024-09-12T12:13:44.336539+0000","last_fullsized":"2024-09-12T12:13:44.336539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.239104+0000","last_change":"2024-09-12T12:13:42.224589+0000","last_active":"2024-09-12T12:13:43.239104+0000","last_peered":"2024-09-12T12:13:43.239104+0000","last_clean":"2024-09-12T12:13:43.239104+0000","last_became_active":"2024-09-12T12:13:42.224322+0000","last_became_peered":"2024-09-12T12:13:42.224322+0000","last_unstale":"2024-09-12T12:13:43.239104+0000","last_undegraded":"2024-09-12T12:13:43.239104+0000","last_fullsized":"2024-09-12T12:13:43.239104+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:18.608456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209566+0000","last_change":"2024-09-12T12:13:43.217960+0000","last_active":"2024-09-12T12:13:44.209566+0000","last_peered":"2024-09-12T12:13:44.209566+0000","last_clean":"2024-09-12T12:13:44.209566+0000","last_became_active":"2024-09-12T12:13:43.217681+0000","last_became_peered":"2024-09-12T12:13:43.217681+0000","last_unstale":"2024-09-12T12:13:44.209566+0000","last_undegraded":"2024-09-12T12:13:44.209566+0000","last_fullsized":"2024-09-12T12:13:44.209566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336588+0000","last_change":"2024-09-12T12:13:42.226799+0000","last_active":"2024-09-12T12:13:44.336588+0000","last_peered":"2024-09-12T12:13:44.336588+0000","last_clean":"2024-09-12T12:13:44.336588+0000","last_became_active":"2024-09-12T12:13:42.226552+0000","last_became_peered":"2024-09-12T12:13:42.226552+0000","last_unstale":"2024-09-12T12:13:44.336588+0000","last_undegraded":"2024-09-12T12:13:44.336588+0000","last_fullsized":"2024-09-12T12:13:44.336588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:42.531514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210795+0000","last_change":"2024-09-12T12:13:43.239066+0000","last_active":"2024-09-12T12:13:44.210795+0000","last_peered":"2024-09-12T12:13:44.210795+0000","last_clean":"2024-09-12T12:13:44.210795+0000","last_became_active":"2024-09-12T12:13:43.238511+0000","last_became_peered":"2024-09-12T12:13:43.238511+0000","last_unstale":"2024-09-12T12:13:44.210795+0000","last_undegraded":"2024-09-12T12:13:44.210795+0000","last_fullsized":"2024-09-12T12:13:44.210795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:55:42.314180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209301+0000","last_change":"2024-09-12T12:13:42.227992+0000","last_active":"2024-09-12T12:13:44.209301+0000","last_peered":"2024-09-12T12:13:44.209301+0000","last_clean":"2024-09-12T12:13:44.209301+0000","last_became_active":"2024-09-12T12:13:42.227700+0000","last_became_peered":"2024-09-12T12:13:42.227700+0000","last_unstale":"2024-09-12T12:13:44.209301+0000","last_undegraded":"2024-09-12T12:13:44.209301+0000","last_fullsized":"2024-09-12T12:13:44.209301+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:13.250333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.249347+0000","last_change":"2024-09-12T12:13:43.247785+0000","last_active":"2024-09-12T12:13:43.249347+0000","last_peered":"2024-09-12T12:13:43.249347+0000","last_clean":"2024-09-12T12:13:43.249347+0000","last_became_active":"2024-09-12T12:13:43.247582+0000","last_became_peered":"2024-09-12T12:13:43.247582+0000","last_unstale":"2024-09-12T12:13:43.249347+0000","last_undegraded":"2024-09-12T12:13:43.249347+0000","last_fullsized":"2024-09-12T12:13:43.249347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247586+0000","last_change":"2024-09-12T12:13:42.228952+0000","last_active":"2024-09-12T12:13:43.247586+0000","last_peered":"2024-09-12T12:13:43.247586+0000","last_clean":"2024-09-12T12:13:43.247586+0000","last_became_active":"2024-09-12T12:13:42.228670+0000","last_became_peered":"2024-09-12T12:13:42.228670+0000","last_unstale":"2024-09-12T12:13:43.247586+0000","last_undegraded":"2024-09-12T12:13:43.247586+0000","last_fullsized":"2024-09-12T12:13:43.247586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.452962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244002+0000","last_change":"2024-09-12T12:13:43.239240+0000","last_active":"2024-09-12T12:13:43.244002+0000","last_peered":"2024-09-12T12:13:43.244002+0000","last_clean":"2024-09-12T12:13:43.244002+0000","last_became_active":"2024-09-12T12:13:43.238958+0000","last_became_peered":"2024-09-12T12:13:43.238958+0000","last_unstale":"2024-09-12T12:13:43.244002+0000","last_undegraded":"2024-09-12T12:13:43.244002+0000","last_fullsized":"2024-09-12T12:13:43.244002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:59.999097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244956+0000","last_change":"2024-09-12T12:13:42.231479+0000","last_active":"2024-09-12T12:13:43.244956+0000","last_peered":"2024-09-12T12:13:43.244956+0000","last_clean":"2024-09-12T12:13:43.244956+0000","last_became_active":"2024-09-12T12:13:42.229387+0000","last_became_peered":"2024-09-12T12:13:42.229387+0000","last_unstale":"2024-09-12T12:13:43.244956+0000","last_undegraded":"2024-09-12T12:13:43.244956+0000","last_fullsized":"2024-09-12T12:13:43.244956+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:27.740275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208621+0000","last_change":"2024-09-12T12:13:43.229008+0000","last_active":"2024-09-12T12:13:44.208621+0000","last_peered":"2024-09-12T12:13:44.208621+0000","last_clean":"2024-09-12T12:13:44.208621+0000","last_became_active":"2024-09-12T12:13:43.228397+0000","last_became_peered":"2024-09-12T12:13:43.228397+0000","last_unstale":"2024-09-12T12:13:44.208621+0000","last_undegraded":"2024-09-12T12:13:44.208621+0000","last_fullsized":"2024-09-12T12:13:44.208621+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336261+0000","last_change":"2024-09-12T12:13:42.223306+0000","last_active":"2024-09-12T12:13:44.336261+0000","last_peered":"2024-09-12T12:13:44.336261+0000","last_clean":"2024-09-12T12:13:44.336261+0000","last_became_active":"2024-09-12T12:13:42.223034+0000","last_became_peered":"2024-09-12T12:13:42.223034+0000","last_unstale":"2024-09-12T12:13:44.336261+0000","last_undegraded":"2024-09-12T12:13:44.336261+0000","last_fullsized":"2024-09-12T12:13:44.336261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:10.757599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210021+0000","last_change":"2024-09-12T12:13:43.227661+0000","last_active":"2024-09-12T12:13:44.210021+0000","last_peered":"2024-09-12T12:13:44.210021+0000","last_clean":"2024-09-12T12:13:44.210021+0000","last_became_active":"2024-09-12T12:13:43.227357+0000","last_became_peered":"2024-09-12T12:13:43.227357+0000","last_unstale":"2024-09-12T12:13:44.210021+0000","last_undegraded":"2024-09-12T12:13:44.210021+0000","last_fullsized":"2024-09-12T12:13:44.210021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:09.821058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208219+0000","last_change":"2024-09-12T12:13:42.225511+0000","last_active":"2024-09-12T12:13:44.208219+0000","last_peered":"2024-09-12T12:13:44.208219+0000","last_clean":"2024-09-12T12:13:44.208219+0000","last_became_active":"2024-09-12T12:13:42.225209+0000","last_became_peered":"2024-09-12T12:13:42.225209+0000","last_unstale":"2024-09-12T12:13:44.208219+0000","last_undegraded":"2024-09-12T12:13:44.208219+0000","last_fullsized":"2024-09-12T12:13:44.208219+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:10.557737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.231178+0000","last_change":"2024-09-12T12:13:43.225962+0000","last_active":"2024-09-12T12:13:43.231178+0000","last_peered":"2024-09-12T12:13:43.231178+0000","last_clean":"2024-09-12T12:13:43.231178+0000","last_became_active":"2024-09-12T12:13:43.225033+0000","last_became_peered":"2024-09-12T12:13:43.225033+0000","last_unstale":"2024-09-12T12:13:43.231178+0000","last_undegraded":"2024-09-12T12:13:43.231178+0000","last_fullsized":"2024-09-12T12:13:43.231178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:53.456301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210853+0000","last_change":"2024-09-12T12:13:42.222441+0000","last_active":"2024-09-12T12:13:44.210853+0000","last_peered":"2024-09-12T12:13:44.210853+0000","last_clean":"2024-09-12T12:13:44.210853+0000","last_became_active":"2024-09-12T12:13:42.222182+0000","last_became_peered":"2024-09-12T12:13:42.222182+0000","last_unstale":"2024-09-12T12:13:44.210853+0000","last_undegraded":"2024-09-12T12:13:44.210853+0000","last_fullsized":"2024-09-12T12:13:44.210853+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:28.723801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245722+0000","last_change":"2024-09-12T12:13:43.244493+0000","last_active":"2024-09-12T12:13:43.245722+0000","last_peered":"2024-09-12T12:13:43.245722+0000","last_clean":"2024-09-12T12:13:43.245722+0000","last_became_active":"2024-09-12T12:13:43.244205+0000","last_became_peered":"2024-09-12T12:13:43.244205+0000","last_unstale":"2024-09-12T12:13:43.245722+0000","last_undegraded":"2024-09-12T12:13:43.245722+0000","last_fullsized":"2024-09-12T12:13:43.245722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:27:00.734722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.212488+0000","last_change":"2024-09-12T12:13:42.224092+0000","last_active":"2024-09-12T12:13:43.212488+0000","last_peered":"2024-09-12T12:13:43.212488+0000","last_clean":"2024-09-12T12:13:43.212488+0000","last_became_active":"2024-09-12T12:13:42.223801+0000","last_became_peered":"2024-09-12T12:13:42.223801+0000","last_unstale":"2024-09-12T12:13:43.212488+0000","last_undegraded":"2024-09-12T12:13:43.212488+0000","last_fullsized":"2024-09-12T12:13:43.212488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:14.774749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247500+0000","last_change":"2024-09-12T12:13:43.239635+0000","last_active":"2024-09-12T12:13:43.247500+0000","last_peered":"2024-09-12T12:13:43.247500+0000","last_clean":"2024-09-12T12:13:43.247500+0000","last_became_active":"2024-09-12T12:13:43.239355+0000","last_became_peered":"2024-09-12T12:13:43.239355+0000","last_unstale":"2024-09-12T12:13:43.247500+0000","last_undegraded":"2024-09-12T12:13:43.247500+0000","last_fullsized":"2024-09-12T12:13:43.247500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247452+0000","last_change":"2024-09-12T12:13:42.222429+0000","last_active":"2024-09-12T12:13:43.247452+0000","last_peered":"2024-09-12T12:13:43.247452+0000","last_clean":"2024-09-12T12:13:43.247452+0000","last_became_active":"2024-09-12T12:13:42.220509+0000","last_became_peered":"2024-09-12T12:13:42.220509+0000","last_unstale":"2024-09-12T12:13:43.247452+0000","last_undegraded":"2024-09-12T12:13:43.247452+0000","last_fullsized":"2024-09-12T12:13:43.247452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:21.429926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209479+0000","last_change":"2024-09-12T12:13:43.217203+0000","last_active":"2024-09-12T12:13:44.209479+0000","last_peered":"2024-09-12T12:13:44.209479+0000","last_clean":"2024-09-12T12:13:44.209479+0000","last_became_active":"2024-09-12T12:13:43.216889+0000","last_became_peered":"2024-09-12T12:13:43.216889+0000","last_unstale":"2024-09-12T12:13:44.209479+0000","last_undegraded":"2024-09-12T12:13:44.209479+0000","last_fullsized":"2024-09-12T12:13:44.209479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210536+0000","last_change":"2024-09-12T12:13:42.231073+0000","last_active":"2024-09-12T12:13:44.210536+0000","last_peered":"2024-09-12T12:13:44.210536+0000","last_clean":"2024-09-12T12:13:44.210536+0000","last_became_active":"2024-09-12T12:13:42.230401+0000","last_became_peered":"2024-09-12T12:13:42.230401+0000","last_unstale":"2024-09-12T12:13:44.210536+0000","last_undegraded":"2024-09-12T12:13:44.210536+0000","last_fullsized":"2024-09-12T12:13:44.210536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:36.588444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247714+0000","last_change":"2024-09-12T12:13:43.242612+0000","last_active":"2024-09-12T12:13:43.247714+0000","last_peered":"2024-09-12T12:13:43.247714+0000","last_clean":"2024-09-12T12:13:43.247714+0000","last_became_active":"2024-09-12T12:13:43.238803+0000","last_became_peered":"2024-09-12T12:13:43.238803+0000","last_unstale":"2024-09-12T12:13:43.247714+0000","last_undegraded":"2024-09-12T12:13:43.247714+0000","last_fullsized":"2024-09-12T12:13:43.247714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210376+0000","last_change":"2024-09-12T12:13:42.223553+0000","last_active":"2024-09-12T12:13:44.210376+0000","last_peered":"2024-09-12T12:13:44.210376+0000","last_clean":"2024-09-12T12:13:44.210376+0000","last_became_active":"2024-09-12T12:13:42.223299+0000","last_became_peered":"2024-09-12T12:13:42.223299+0000","last_unstale":"2024-09-12T12:13:44.210376+0000","last_undegraded":"2024-09-12T12:13:44.210376+0000","last_fullsized":"2024-09-12T12:13:44.210376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:22.090154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210055+0000","last_change":"2024-09-12T12:13:43.249123+0000","last_active":"2024-09-12T12:13:44.210055+0000","last_peered":"2024-09-12T12:13:44.210055+0000","last_clean":"2024-09-12T12:13:44.210055+0000","last_became_active":"2024-09-12T12:13:43.248879+0000","last_became_peered":"2024-09-12T12:13:43.248879+0000","last_unstale":"2024-09-12T12:13:44.210055+0000","last_undegraded":"2024-09-12T12:13:44.210055+0000","last_fullsized":"2024-09-12T12:13:44.210055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:50.680172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336196+0000","last_change":"2024-09-12T12:13:42.224628+0000","last_active":"2024-09-12T12:13:44.336196+0000","last_peered":"2024-09-12T12:13:44.336196+0000","last_clean":"2024-09-12T12:13:44.336196+0000","last_became_active":"2024-09-12T12:13:42.224334+0000","last_became_peered":"2024-09-12T12:13:42.224334+0000","last_unstale":"2024-09-12T12:13:44.336196+0000","last_undegraded":"2024-09-12T12:13:44.336196+0000","last_fullsized":"2024-09-12T12:13:44.336196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:28.605713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.244927+0000","last_change":"2024-09-12T12:13:43.224027+0000","last_active":"2024-09-12T12:13:43.244927+0000","last_peered":"2024-09-12T12:13:43.244927+0000","last_clean":"2024-09-12T12:13:43.244927+0000","last_became_active":"2024-09-12T12:13:43.223671+0000","last_became_peered":"2024-09-12T12:13:43.223671+0000","last_unstale":"2024-09-12T12:13:43.244927+0000","last_undegraded":"2024-09-12T12:13:43.244927+0000","last_fullsized":"2024-09-12T12:13:43.244927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:15.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208144+0000","last_change":"2024-09-12T12:13:42.227207+0000","last_active":"2024-09-12T12:13:44.208144+0000","last_peered":"2024-09-12T12:13:44.208144+0000","last_clean":"2024-09-12T12:13:44.208144+0000","last_became_active":"2024-09-12T12:13:42.226899+0000","last_became_peered":"2024-09-12T12:13:42.226899+0000","last_unstale":"2024-09-12T12:13:44.208144+0000","last_undegraded":"2024-09-12T12:13:44.208144+0000","last_fullsized":"2024-09-12T12:13:44.208144+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:44.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210071+0000","last_change":"2024-09-12T12:13:43.244671+0000","last_active":"2024-09-12T12:13:44.210071+0000","last_peered":"2024-09-12T12:13:44.210071+0000","last_clean":"2024-09-12T12:13:44.210071+0000","last_became_active":"2024-09-12T12:13:43.244426+0000","last_became_peered":"2024-09-12T12:13:43.244426+0000","last_unstale":"2024-09-12T12:13:44.210071+0000","last_undegraded":"2024-09-12T12:13:44.210071+0000","last_fullsized":"2024-09-12T12:13:44.210071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:22.494915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245748+0000","last_change":"2024-09-12T12:13:42.231631+0000","last_active":"2024-09-12T12:13:43.245748+0000","last_peered":"2024-09-12T12:13:43.245748+0000","last_clean":"2024-09-12T12:13:43.245748+0000","last_became_active":"2024-09-12T12:13:42.231285+0000","last_became_peered":"2024-09-12T12:13:42.231285+0000","last_unstale":"2024-09-12T12:13:43.245748+0000","last_undegraded":"2024-09-12T12:13:43.245748+0000","last_fullsized":"2024-09-12T12:13:43.245748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:18.608456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210604+0000","last_change":"2024-09-12T12:13:43.243604+0000","last_active":"2024-09-12T12:13:44.210604+0000","last_peered":"2024-09-12T12:13:44.210604+0000","last_clean":"2024-09-12T12:13:44.210604+0000","last_became_active":"2024-09-12T12:13:43.243328+0000","last_became_peered":"2024-09-12T12:13:43.243328+0000","last_unstale":"2024-09-12T12:13:44.210604+0000","last_undegraded":"2024-09-12T12:13:44.210604+0000","last_fullsized":"2024-09-12T12:13:44.210604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:38.096292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.240257+0000","last_change":"2024-09-12T12:13:42.229343+0000","last_active":"2024-09-12T12:13:43.240257+0000","last_peered":"2024-09-12T12:13:43.240257+0000","last_clean":"2024-09-12T12:13:43.240257+0000","last_became_active":"2024-09-12T12:13:42.229030+0000","last_became_peered":"2024-09-12T12:13:42.229030+0000","last_unstale":"2024-09-12T12:13:43.240257+0000","last_undegraded":"2024-09-12T12:13:43.240257+0000","last_fullsized":"2024-09-12T12:13:43.240257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:27.740275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.248089+0000","last_change":"2024-09-12T12:13:43.246701+0000","last_active":"2024-09-12T12:13:43.248089+0000","last_peered":"2024-09-12T12:13:43.248089+0000","last_clean":"2024-09-12T12:13:43.248089+0000","last_became_active":"2024-09-12T12:13:43.246417+0000","last_became_peered":"2024-09-12T12:13:43.246417+0000","last_unstale":"2024-09-12T12:13:43.248089+0000","last_undegraded":"2024-09-12T12:13:43.248089+0000","last_fullsized":"2024-09-12T12:13:43.248089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:31.818393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209634+0000","last_change":"2024-09-12T12:13:42.226611+0000","last_active":"2024-09-12T12:13:44.209634+0000","last_peered":"2024-09-12T12:13:44.209634+0000","last_clean":"2024-09-12T12:13:44.209634+0000","last_became_active":"2024-09-12T12:13:42.226182+0000","last_became_peered":"2024-09-12T12:13:42.226182+0000","last_unstale":"2024-09-12T12:13:44.209634+0000","last_undegraded":"2024-09-12T12:13:44.209634+0000","last_fullsized":"2024-09-12T12:13:44.209634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:10.757599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.209529+0000","last_change":"2024-09-12T12:13:43.229401+0000","last_active":"2024-09-12T12:13:44.209529+0000","last_peered":"2024-09-12T12:13:44.209529+0000","last_clean":"2024-09-12T12:13:44.209529+0000","last_became_active":"2024-09-12T12:13:43.229080+0000","last_became_peered":"2024-09-12T12:13:43.229080+0000","last_unstale":"2024-09-12T12:13:44.209529+0000","last_undegraded":"2024-09-12T12:13:44.209529+0000","last_fullsized":"2024-09-12T12:13:44.209529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.222713+0000","last_change":"2024-09-12T12:13:42.224453+0000","last_active":"2024-09-12T12:13:43.222713+0000","last_peered":"2024-09-12T12:13:43.222713+0000","last_clean":"2024-09-12T12:13:43.222713+0000","last_became_active":"2024-09-12T12:13:42.224192+0000","last_became_peered":"2024-09-12T12:13:42.224192+0000","last_unstale":"2024-09-12T12:13:43.222713+0000","last_undegraded":"2024-09-12T12:13:43.222713+0000","last_fullsized":"2024-09-12T12:13:43.222713+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:09.366069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.232548+0000","last_change":"2024-09-12T12:13:43.229862+0000","last_active":"2024-09-12T12:13:43.232548+0000","last_peered":"2024-09-12T12:13:43.232548+0000","last_clean":"2024-09-12T12:13:43.232548+0000","last_became_active":"2024-09-12T12:13:43.229561+0000","last_became_peered":"2024-09-12T12:13:43.229561+0000","last_unstale":"2024-09-12T12:13:43.232548+0000","last_undegraded":"2024-09-12T12:13:43.232548+0000","last_fullsized":"2024-09-12T12:13:43.232548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:57.901189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336368+0000","last_change":"2024-09-12T12:13:42.227948+0000","last_active":"2024-09-12T12:13:44.336368+0000","last_peered":"2024-09-12T12:13:44.336368+0000","last_clean":"2024-09-12T12:13:44.336368+0000","last_became_active":"2024-09-12T12:13:42.227695+0000","last_became_peered":"2024-09-12T12:13:42.227695+0000","last_unstale":"2024-09-12T12:13:44.336368+0000","last_undegraded":"2024-09-12T12:13:44.336368+0000","last_fullsized":"2024-09-12T12:13:44.336368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:01.849678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245008+0000","last_change":"2024-09-12T12:13:43.224055+0000","last_active":"2024-09-12T12:13:43.245008+0000","last_peered":"2024-09-12T12:13:43.245008+0000","last_clean":"2024-09-12T12:13:43.245008+0000","last_became_active":"2024-09-12T12:13:43.223885+0000","last_became_peered":"2024-09-12T12:13:43.223885+0000","last_unstale":"2024-09-12T12:13:43.245008+0000","last_undegraded":"2024-09-12T12:13:43.245008+0000","last_fullsized":"2024-09-12T12:13:43.245008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:10.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246542+0000","last_change":"2024-09-12T12:13:42.220591+0000","last_active":"2024-09-12T12:13:43.246542+0000","last_peered":"2024-09-12T12:13:43.246542+0000","last_clean":"2024-09-12T12:13:43.246542+0000","last_became_active":"2024-09-12T12:13:42.220274+0000","last_became_peered":"2024-09-12T12:13:42.220274+0000","last_unstale":"2024-09-12T12:13:43.246542+0000","last_undegraded":"2024-09-12T12:13:43.246542+0000","last_fullsized":"2024-09-12T12:13:43.246542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:18.829574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246785+0000","last_change":"2024-09-12T12:13:43.234145+0000","last_active":"2024-09-12T12:13:43.246785+0000","last_peered":"2024-09-12T12:13:43.246785+0000","last_clean":"2024-09-12T12:13:43.246785+0000","last_became_active":"2024-09-12T12:13:43.233779+0000","last_became_peered":"2024-09-12T12:13:43.233779+0000","last_unstale":"2024-09-12T12:13:43.246785+0000","last_undegraded":"2024-09-12T12:13:43.246785+0000","last_fullsized":"2024-09-12T12:13:43.246785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:15.779356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.207187+0000","last_change":"2024-09-12T12:13:42.212451+0000","last_active":"2024-09-12T12:13:43.207187+0000","last_peered":"2024-09-12T12:13:43.207187+0000","last_clean":"2024-09-12T12:13:43.207187+0000","last_became_active":"2024-09-12T12:13:42.212175+0000","last_became_peered":"2024-09-12T12:13:42.212175+0000","last_unstale":"2024-09-12T12:13:43.207187+0000","last_undegraded":"2024-09-12T12:13:43.207187+0000","last_fullsized":"2024-09-12T12:13:43.207187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:41.594907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.234967+0000","last_change":"2024-09-12T12:13:43.225584+0000","last_active":"2024-09-12T12:13:43.234967+0000","last_peered":"2024-09-12T12:13:43.234967+0000","last_clean":"2024-09-12T12:13:43.234967+0000","last_became_active":"2024-09-12T12:13:43.225326+0000","last_became_peered":"2024-09-12T12:13:43.225326+0000","last_unstale":"2024-09-12T12:13:43.234967+0000","last_undegraded":"2024-09-12T12:13:43.234967+0000","last_fullsized":"2024-09-12T12:13:43.234967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.634552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.214479+0000","last_change":"2024-09-12T12:13:42.233350+0000","last_active":"2024-09-12T12:13:43.214479+0000","last_peered":"2024-09-12T12:13:43.214479+0000","last_clean":"2024-09-12T12:13:43.214479+0000","last_became_active":"2024-09-12T12:13:42.232970+0000","last_became_peered":"2024-09-12T12:13:42.232970+0000","last_unstale":"2024-09-12T12:13:43.214479+0000","last_undegraded":"2024-09-12T12:13:43.214479+0000","last_fullsized":"2024-09-12T12:13:43.214479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:53.704867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210252+0000","last_change":"2024-09-12T12:13:43.224937+0000","last_active":"2024-09-12T12:13:44.210252+0000","last_peered":"2024-09-12T12:13:44.210252+0000","last_clean":"2024-09-12T12:13:44.210252+0000","last_became_active":"2024-09-12T12:13:43.223740+0000","last_became_peered":"2024-09-12T12:13:43.223740+0000","last_unstale":"2024-09-12T12:13:44.210252+0000","last_undegraded":"2024-09-12T12:13:44.210252+0000","last_fullsized":"2024-09-12T12:13:44.210252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:41.881778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.206942+0000","last_change":"2024-09-12T12:13:42.218353+0000","last_active":"2024-09-12T12:13:43.206942+0000","last_peered":"2024-09-12T12:13:43.206942+0000","last_clean":"2024-09-12T12:13:43.206942+0000","last_became_active":"2024-09-12T12:13:42.218095+0000","last_became_peered":"2024-09-12T12:13:42.218095+0000","last_unstale":"2024-09-12T12:13:43.206942+0000","last_undegraded":"2024-09-12T12:13:43.206942+0000","last_fullsized":"2024-09-12T12:13:43.206942+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:26.102256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336441+0000","last_change":"2024-09-12T12:13:43.246965+0000","last_active":"2024-09-12T12:13:44.336441+0000","last_peered":"2024-09-12T12:13:44.336441+0000","last_clean":"2024-09-12T12:13:44.336441+0000","last_became_active":"2024-09-12T12:13:43.245467+0000","last_became_peered":"2024-09-12T12:13:43.245467+0000","last_unstale":"2024-09-12T12:13:44.336441+0000","last_undegraded":"2024-09-12T12:13:44.336441+0000","last_fullsized":"2024-09-12T12:13:44.336441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.246580+0000","last_change":"2024-09-12T12:13:42.226582+0000","last_active":"2024-09-12T12:13:43.246580+0000","last_peered":"2024-09-12T12:13:43.246580+0000","last_clean":"2024-09-12T12:13:43.246580+0000","last_became_active":"2024-09-12T12:13:42.226283+0000","last_became_peered":"2024-09-12T12:13:42.226283+0000","last_unstale":"2024-09-12T12:13:43.246580+0000","last_undegraded":"2024-09-12T12:13:43.246580+0000","last_fullsized":"2024-09-12T12:13:43.246580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:00.233965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245573+0000","last_change":"2024-09-12T12:13:43.237068+0000","last_active":"2024-09-12T12:13:43.245573+0000","last_peered":"2024-09-12T12:13:43.245573+0000","last_clean":"2024-09-12T12:13:43.245573+0000","last_became_active":"2024-09-12T12:13:43.236703+0000","last_became_peered":"2024-09-12T12:13:43.236703+0000","last_unstale":"2024-09-12T12:13:43.245573+0000","last_undegraded":"2024-09-12T12:13:43.245573+0000","last_fullsized":"2024-09-12T12:13:43.245573+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:08.547195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.209174+0000","last_change":"2024-09-12T12:13:42.222493+0000","last_active":"2024-09-12T12:13:43.209174+0000","last_peered":"2024-09-12T12:13:43.209174+0000","last_clean":"2024-09-12T12:13:43.209174+0000","last_became_active":"2024-09-12T12:13:42.222230+0000","last_became_peered":"2024-09-12T12:13:42.222230+0000","last_unstale":"2024-09-12T12:13:43.209174+0000","last_undegraded":"2024-09-12T12:13:43.209174+0000","last_fullsized":"2024-09-12T12:13:43.209174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:50:13.329589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210782+0000","last_change":"2024-09-12T12:13:43.226626+0000","last_active":"2024-09-12T12:13:44.210782+0000","last_peered":"2024-09-12T12:13:44.210782+0000","last_clean":"2024-09-12T12:13:44.210782+0000","last_became_active":"2024-09-12T12:13:43.226315+0000","last_became_peered":"2024-09-12T12:13:43.226315+0000","last_unstale":"2024-09-12T12:13:44.210782+0000","last_undegraded":"2024-09-12T12:13:44.210782+0000","last_fullsized":"2024-09-12T12:13:44.210782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:02.541823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.213533+0000","last_change":"2024-09-12T12:13:42.220988+0000","last_active":"2024-09-12T12:13:43.213533+0000","last_peered":"2024-09-12T12:13:43.213533+0000","last_clean":"2024-09-12T12:13:43.213533+0000","last_became_active":"2024-09-12T12:13:42.220718+0000","last_became_peered":"2024-09-12T12:13:42.220718+0000","last_unstale":"2024-09-12T12:13:43.213533+0000","last_undegraded":"2024-09-12T12:13:43.213533+0000","last_fullsized":"2024-09-12T12:13:43.213533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:53.704867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.247725+0000","last_change":"2024-09-12T12:13:43.243796+0000","last_active":"2024-09-12T12:13:43.247725+0000","last_peered":"2024-09-12T12:13:43.247725+0000","last_clean":"2024-09-12T12:13:43.247725+0000","last_became_active":"2024-09-12T12:13:43.235674+0000","last_became_peered":"2024-09-12T12:13:43.235674+0000","last_unstale":"2024-09-12T12:13:43.247725+0000","last_undegraded":"2024-09-12T12:13:43.247725+0000","last_fullsized":"2024-09-12T12:13:43.247725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:29.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.219040+0000","last_change":"2024-09-12T12:13:42.226680+0000","last_active":"2024-09-12T12:13:43.219040+0000","last_peered":"2024-09-12T12:13:43.219040+0000","last_clean":"2024-09-12T12:13:43.219040+0000","last_became_active":"2024-09-12T12:13:42.226419+0000","last_became_peered":"2024-09-12T12:13:42.226419+0000","last_unstale":"2024-09-12T12:13:43.219040+0000","last_undegraded":"2024-09-12T12:13:43.219040+0000","last_fullsized":"2024-09-12T12:13:43.219040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:27.740275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.336265+0000","last_change":"2024-09-12T12:13:43.247334+0000","last_active":"2024-09-12T12:13:44.336265+0000","last_peered":"2024-09-12T12:13:44.336265+0000","last_clean":"2024-09-12T12:13:44.336265+0000","last_became_active":"2024-09-12T12:13:43.247043+0000","last_became_peered":"2024-09-12T12:13:43.247043+0000","last_unstale":"2024-09-12T12:13:44.336265+0000","last_undegraded":"2024-09-12T12:13:44.336265+0000","last_fullsized":"2024-09-12T12:13:44.336265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:37.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208475+0000","last_change":"2024-09-12T12:13:42.227848+0000","last_active":"2024-09-12T12:13:44.208475+0000","last_peered":"2024-09-12T12:13:44.208475+0000","last_clean":"2024-09-12T12:13:44.208475+0000","last_became_active":"2024-09-12T12:13:42.227520+0000","last_became_peered":"2024-09-12T12:13:42.227520+0000","last_unstale":"2024-09-12T12:13:44.208475+0000","last_undegraded":"2024-09-12T12:13:44.208475+0000","last_fullsized":"2024-09-12T12:13:44.208475+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:18.691031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208439+0000","last_change":"2024-09-12T12:13:43.231905+0000","last_active":"2024-09-12T12:13:44.208439+0000","last_peered":"2024-09-12T12:13:44.208439+0000","last_clean":"2024-09-12T12:13:44.208439+0000","last_became_active":"2024-09-12T12:13:43.231649+0000","last_became_peered":"2024-09-12T12:13:43.231649+0000","last_unstale":"2024-09-12T12:13:44.208439+0000","last_undegraded":"2024-09-12T12:13:44.208439+0000","last_fullsized":"2024-09-12T12:13:44.208439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:10.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.208889+0000","last_change":"2024-09-12T12:13:42.223588+0000","last_active":"2024-09-12T12:13:44.208889+0000","last_peered":"2024-09-12T12:13:44.208889+0000","last_clean":"2024-09-12T12:13:44.208889+0000","last_became_active":"2024-09-12T12:13:42.223291+0000","last_became_peered":"2024-09-12T12:13:42.223291+0000","last_unstale":"2024-09-12T12:13:44.208889+0000","last_undegraded":"2024-09-12T12:13:44.208889+0000","last_fullsized":"2024-09-12T12:13:44.208889+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:28.605713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.245527+0000","last_change":"2024-09-12T12:13:43.236016+0000","last_active":"2024-09-12T12:13:43.245527+0000","last_peered":"2024-09-12T12:13:43.245527+0000","last_clean":"2024-09-12T12:13:43.245527+0000","last_became_active":"2024-09-12T12:13:43.235700+0000","last_became_peered":"2024-09-12T12:13:43.235700+0000","last_unstale":"2024-09-12T12:13:43.245527+0000","last_undegraded":"2024-09-12T12:13:43.245527+0000","last_fullsized":"2024-09-12T12:13:43.245527+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:23.094760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T12:13:44.210081+0000","last_change":"2024-09-12T12:13:42.222115+0000","last_active":"2024-09-12T12:13:44.210081+0000","last_peered":"2024-09-12T12:13:44.210081+0000","last_clean":"2024-09-12T12:13:44.210081+0000","last_became_active":"2024-09-12T12:13:42.221849+0000","last_became_peered":"2024-09-12T12:13:42.221849+0000","last_unstale":"2024-09-12T12:13:44.210081+0000","last_undegraded":"2024-09-12T12:13:44.210081+0000","last_fullsized":"2024-09-12T12:13:44.210081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:22.629945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.234290+0000","last_change":"2024-09-12T12:13:43.231424+0000","last_active":"2024-09-12T12:13:43.234290+0000","last_peered":"2024-09-12T12:13:43.234290+0000","last_clean":"2024-09-12T12:13:43.234290+0000","last_became_active":"2024-09-12T12:13:43.230822+0000","last_became_peered":"2024-09-12T12:13:43.230822+0000","last_unstale":"2024-09-12T12:13:43.234290+0000","last_undegraded":"2024-09-12T12:13:43.234290+0000","last_fullsized":"2024-09-12T12:13:43.234290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:42.194219+0000","last_clean_scrub_stamp":"2024-09-12T12:13:42.194219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:13:40.687151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.215779+0000","last_change":"2024-09-12T12:13:42.229981+0000","last_active":"2024-09-12T12:13:43.215779+0000","last_peered":"2024-09-12T12:13:43.215779+0000","last_clean":"2024-09-12T12:13:43.215779+0000","last_became_active":"2024-09-12T12:13:42.229710+0000","last_became_peered":"2024-09-12T12:13:42.229710+0000","last_unstale":"2024-09-12T12:13:43.215779+0000","last_undegraded":"2024-09-12T12:13:43.215779+0000","last_fullsized":"2024-09-12T12:13:43.215779+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:13:41.189613+0000","last_clean_scrub_stamp":"2024-09-12T12:13:41.189613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:00.233965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T12:13:43.215084+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:13:43.215084+0000","last_peered":"2024-09-12T12:13:43.215084+0000","last_clean":"2024-09-12T12:13:43.215084+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:13:43.215084+0000","last_undegraded":"2024-09-12T12:13:43.215084+0000","last_fullsized":"2024-09-12T12:13:43.215084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1048576,"data_stored":780065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":454656,"data_stored":195289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":188127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":188619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":189661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":442368,"data_stored":188085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":442368,"data_stored":188105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1036288,"data_stored":778417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:13:47.683 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:13:47.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:13:47.830 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-12T12:13:47.828+0000 7f6b96000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:13:47.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f907ba00640 1 Processor -- start 2024-09-12T12:13:47.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f907ba00640 1 -- start start 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f907ba00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f907415af60 0x7f90740ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f907ba00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f90740cd9f0 0x7f907406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f907ba00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90740b4300 con 0x7f907415b340 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f907ba00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f90740b32f0 con 0x7f907415af60 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f907ba00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f90740b3540 con 0x7f90740cd9f0 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f9079000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f907415af60 0x7f90740ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f9079000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f907415af60 0x7f90740ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40494/0 (socket says 172.21.15.144:40494) 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f9079000640 1 -- 172.21.15.144:0/532582706 learned_addr learned my addr 172.21.15.144:0/532582706 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f9073e00640 1 --2- 172.21.15.144:0/532582706 >> v2:172.21.15.165:3300/0 conn(0x7f90740cd9f0 0x7f907406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f9079000640 1 -- 172.21.15.144:0/532582706 >> v2:172.21.15.165:3300/0 conn(0x7f90740cd9f0 msgr2=0x7f907406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f9079000640 1 --2- 172.21.15.144:0/532582706 >> v2:172.21.15.165:3300/0 conn(0x7f90740cd9f0 0x7f907406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f9079000640 1 -- 172.21.15.144:0/532582706 >> v1:172.21.15.165:6789/0 conn(0x7f907415b340 legacy=0x7f907415ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.864+0000 7f9079000640 1 -- 172.21.15.144:0/532582706 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90740b3820 con 0x7f907415af60 2024-09-12T12:13:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f9079000640 1 --2- 172.21.15.144:0/532582706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 0x7f90740ce680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9074070d20 tx=0x7f906401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6220f489baaab925 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f9073400640 1 -- 172.21.15.144:0/532582706 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90640b0070 con 0x7f907415af60 2024-09-12T12:13:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f9073400640 1 -- 172.21.15.144:0/532582706 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90640ab600 con 0x7f907415af60 2024-09-12T12:13:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f9073400640 1 -- 172.21.15.144:0/532582706 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90640ab9d0 con 0x7f907415af60 2024-09-12T12:13:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f907ba00640 1 -- 172.21.15.144:0/532582706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 msgr2=0x7f90740ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f907ba00640 1 --2- 172.21.15.144:0/532582706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 0x7f90740ce680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9074070d20 tx=0x7f906401c520 comp rx=0 tx=0).stop 2024-09-12T12:13:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f907ba00640 1 -- 172.21.15.144:0/532582706 shutdown_connections 2024-09-12T12:13:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f907ba00640 1 --2- 172.21.15.144:0/532582706 >> v2:172.21.15.165:3300/0 conn(0x7f90740cd9f0 0x7f907406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f907ba00640 1 --2- 172.21.15.144:0/532582706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 0x7f90740ce680 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f907ba00640 1 -- 172.21.15.144:0/532582706 >> 172.21.15.144:0/532582706 conn(0x7f9074068030 msgr2=0x7f90740b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f907ba00640 1 -- 172.21.15.144:0/532582706 shutdown_connections 2024-09-12T12:13:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.868+0000 7f907ba00640 1 -- 172.21.15.144:0/532582706 wait complete. 2024-09-12T12:13:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 Processor -- start 2024-09-12T12:13:47.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 -- start start 2024-09-12T12:13:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90740cd9f0 0x7f90740acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 0x7f9074073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f907415b340 0x7f9074073d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f90740ced40 con 0x7f907415af60 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f90740cebc0 con 0x7f90740cd9f0 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9074167f00 con 0x7f907415b340 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9073e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 0x7f9074073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9073e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 0x7f9074073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40500/0 (socket says 172.21.15.144:40500) 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9073e00640 1 -- 172.21.15.144:0/3401953714 learned_addr learned my addr 172.21.15.144:0/3401953714 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9079000640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90740cd9f0 0x7f90740acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9079a00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f907415b340 0x7f9074073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9073e00640 1 -- 172.21.15.144:0/3401953714 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f907415b340 msgr2=0x7f9074073d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9073e00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f907415b340 0x7f9074073d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9073e00640 1 -- 172.21.15.144:0/3401953714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90740cd9f0 msgr2=0x7f90740acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9073e00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90740cd9f0 0x7f90740acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9073e00640 1 -- 172.21.15.144:0/3401953714 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90740ae9e0 con 0x7f907415af60 2024-09-12T12:13:47.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9073e00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 0x7f9074073800 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f906000e930 tx=0x7f906000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9070c00640 1 -- 172.21.15.144:0/3401953714 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060017070 con 0x7f907415af60 2024-09-12T12:13:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9070c00640 1 -- 172.21.15.144:0/3401953714 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f906000ca00 con 0x7f907415af60 2024-09-12T12:13:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f9070c00640 1 -- 172.21.15.144:0/3401953714 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906000cdb0 con 0x7f907415af60 2024-09-12T12:13:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90740aecc0 con 0x7f907415af60 2024-09-12T12:13:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90740af280 con 0x7f907415af60 2024-09-12T12:13:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.872+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f907406bc10 con 0x7f907415af60 2024-09-12T12:13:47.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.876+0000 7f9070c00640 1 -- 172.21.15.144:0/3401953714 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f906001a070 con 0x7f907415af60 2024-09-12T12:13:47.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.876+0000 7f9070c00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90540678c0 0x7f9054069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:47.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.876+0000 7f9070c00640 1 -- 172.21.15.144:0/3401953714 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9060086220 con 0x7f907415af60 2024-09-12T12:13:47.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.876+0000 7f9079000640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90540678c0 0x7f9054069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:47.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.876+0000 7f9079000640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90540678c0 0x7f9054069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f90640ad000 tx=0x7f9064008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:47.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:47.880+0000 7f9070c00640 1 -- 172.21.15.144:0/3401953714 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f90600565a0 con 0x7f907415af60 2024-09-12T12:13:48.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.092+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f907414fdc0 con 0x7f907415af60 2024-09-12T12:13:48.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f9070c00640 1 -- 172.21.15.144:0/3401953714 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f906005a8a0 con 0x7f907415af60 2024-09-12T12:13:48.097 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:13:48.097 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:13:48.097 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:13:48.098 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:13:48.098 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:13:48.098 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:13:48.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90540678c0 msgr2=0x7f9054069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90540678c0 0x7f9054069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f90640ad000 tx=0x7f9064008040 comp rx=0 tx=0).stop 2024-09-12T12:13:48.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 msgr2=0x7f9074073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 0x7f9074073800 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f906000e930 tx=0x7f906000edf0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 shutdown_connections 2024-09-12T12:13:48.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90540678c0 0x7f9054069d80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f907415b340 0x7f9074073d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f907415af60 0x7f9074073800 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 --2- 172.21.15.144:0/3401953714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90740cd9f0 0x7f90740acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 >> 172.21.15.144:0/3401953714 conn(0x7f9074068030 msgr2=0x7f90741502e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:48.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.096+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 shutdown_connections 2024-09-12T12:13:48.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.100+0000 7f907ba00640 1 -- 172.21.15.144:0/3401953714 wait complete. 2024-09-12T12:13:48.120 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:13:48.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.252+0000 7f73fee00640 1 Processor -- start 2024-09-12T12:13:48.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.252+0000 7f73fee00640 1 -- start start 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73fee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73f8071420 0x7f73f8071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73fee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 0x7f73f80cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73fee00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73f80b45a0 con 0x7f73f815b4e0 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73fee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f73f80cd8e0 con 0x7f73f8071420 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73fee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73f80b3fe0 con 0x7f73f80ccf30 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73ef400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73f8071420 0x7f73f8071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73ef400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73f8071420 0x7f73f8071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40504/0 (socket says 172.21.15.144:40504) 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73ef400640 1 -- 172.21.15.144:0/2719650882 learned_addr learned my addr 172.21.15.144:0/2719650882 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73fce00640 1 --2- 172.21.15.144:0/2719650882 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 0x7f73f80cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73ef400640 1 -- 172.21.15.144:0/2719650882 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 msgr2=0x7f73f80cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73ef400640 1 --2- 172.21.15.144:0/2719650882 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 0x7f73f80cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73ef400640 1 -- 172.21.15.144:0/2719650882 >> v1:172.21.15.165:6789/0 conn(0x7f73f815b4e0 legacy=0x7f73f80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.256+0000 7f73ef400640 1 -- 172.21.15.144:0/2719650882 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f80b42c0 con 0x7f73f8071420 2024-09-12T12:13:48.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73ef400640 1 --2- 172.21.15.144:0/2719650882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8071420 0x7f73f8071840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f73e000bb10 tx=0x7f73e001ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfea9a8706e6d3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:48.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73f7400640 1 -- 172.21.15.144:0/2719650882 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e00b4070 con 0x7f73f8071420 2024-09-12T12:13:48.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73f7400640 1 -- 172.21.15.144:0/2719650882 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e00a7cd0 con 0x7f73f8071420 2024-09-12T12:13:48.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73f7400640 1 -- 172.21.15.144:0/2719650882 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e00af660 con 0x7f73f8071420 2024-09-12T12:13:48.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 -- 172.21.15.144:0/2719650882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8071420 msgr2=0x7f73f8071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 --2- 172.21.15.144:0/2719650882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8071420 0x7f73f8071840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f73e000bb10 tx=0x7f73e001ec00 comp rx=0 tx=0).stop 2024-09-12T12:13:48.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 -- 172.21.15.144:0/2719650882 shutdown_connections 2024-09-12T12:13:48.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 --2- 172.21.15.144:0/2719650882 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 0x7f73f80cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 --2- 172.21.15.144:0/2719650882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8071420 0x7f73f8071840 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 -- 172.21.15.144:0/2719650882 >> 172.21.15.144:0/2719650882 conn(0x7f73f806d0d0 msgr2=0x7f73f806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:48.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 -- 172.21.15.144:0/2719650882 shutdown_connections 2024-09-12T12:13:48.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 -- 172.21.15.144:0/2719650882 wait complete. 2024-09-12T12:13:48.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 Processor -- start 2024-09-12T12:13:48.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.260+0000 7f73fee00640 1 -- start start 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fee00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73f8071420 0x7f73f8155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 0x7f73f815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f815b4e0 0x7f73f815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f73f815b8c0 con 0x7f73f815b4e0 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fee00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73f80cdef0 con 0x7f73f8071420 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73f8159590 con 0x7f73f80ccf30 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f815b4e0 0x7f73f815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f815b4e0 0x7f73f815de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40510/0 (socket says 172.21.15.144:40510) 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fce00640 1 -- 172.21.15.144:0/2948799537 learned_addr learned my addr 172.21.15.144:0/2948799537 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:48.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73f7e00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73f8071420 0x7f73f8155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73ef400640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 0x7f73f815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fce00640 1 -- 172.21.15.144:0/2948799537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 msgr2=0x7f73f815d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fce00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 0x7f73f815d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fce00640 1 -- 172.21.15.144:0/2948799537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73f8071420 msgr2=0x7f73f8155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fce00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73f8071420 0x7f73f8155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fce00640 1 -- 172.21.15.144:0/2948799537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f8159870 con 0x7f73f815b4e0 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fce00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f815b4e0 0x7f73f815de20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f73f000efc0 tx=0x7f73f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73f4c00640 1 -- 172.21.15.144:0/2948799537 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0018020 con 0x7f73f815b4e0 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73f4c00640 1 -- 172.21.15.144:0/2948799537 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f0014480 con 0x7f73f815b4e0 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73f4c00640 1 -- 172.21.15.144:0/2948799537 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0014870 con 0x7f73f815b4e0 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f8159b50 con 0x7f73f815b4e0 2024-09-12T12:13:48.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f8157d10 con 0x7f73f815b4e0 2024-09-12T12:13:48.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73f8073df0 con 0x7f73f815b4e0 2024-09-12T12:13:48.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.264+0000 7f73f4c00640 1 -- 172.21.15.144:0/2948799537 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73f001b020 con 0x7f73f815b4e0 2024-09-12T12:13:48.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.268+0000 7f73f4c00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73d40678c0 0x7f73d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.268+0000 7f73f4c00640 1 -- 172.21.15.144:0/2948799537 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f73f0086940 con 0x7f73f815b4e0 2024-09-12T12:13:48.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.268+0000 7f73f7e00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73d40678c0 0x7f73d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.268+0000 7f73f7e00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73d40678c0 0x7f73d4069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f73e8007fd0 tx=0x7f73e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:48.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.272+0000 7f73f4c00640 1 -- 172.21.15.144:0/2948799537 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f73f0022070 con 0x7f73f815b4e0 2024-09-12T12:13:48.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.460+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73f8071840 con 0x7f73f815b4e0 2024-09-12T12:13:48.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.460+0000 7f73f4c00640 1 -- 172.21.15.144:0/2948799537 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5235 (secure 0 0 0) 0x7f73f0010040 con 0x7f73f815b4e0 2024-09-12T12:13:48.464 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:13:48.464 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"btime":"2024-09-12T12:13:46:236418+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1734346147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1734346147},{"type":"v1","addr":"172.21.15.144:6835","nonce":1734346147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3346311863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3346311863},{"type":"v1","addr":"172.21.15.165:6834","nonce":3346311863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2564271519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2564271519},{"type":"v1","addr":"172.21.15.165:6835","nonce":2564271519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:13:42.597555+0000","modified":"2024-09-12T12:13:45.914890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/3288752771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3288752771},{"type":"v1","addr":"172.21.15.144:6837","nonce":3288752771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-12T12:13:48.465 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 17 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73d40678c0 msgr2=0x7f73d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73d40678c0 0x7f73d4069d80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f73e8007fd0 tx=0x7f73e8009040 comp rx=0 tx=0).stop 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f815b4e0 msgr2=0x7f73f815de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f815b4e0 0x7f73f815de20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f73f000efc0 tx=0x7f73f000c490 comp rx=0 tx=0).stop 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 shutdown_connections 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73d40678c0 0x7f73d4069d80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f815b4e0 0x7f73f815de20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f80ccf30 0x7f73f815d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 --2- 172.21.15.144:0/2948799537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73f8071420 0x7f73f8155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 >> 172.21.15.144:0/2948799537 conn(0x7f73f806d0d0 msgr2=0x7f73f815efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 shutdown_connections 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:48.464+0000 7f73fee00640 1 -- 172.21.15.144:0/2948799537 wait complete. 2024-09-12T12:13:48.889 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:13:42.597555+0000', 'modified': '2024-09-12T12:13:45.914890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4884}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4884': {'gid': 4884, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/3288752771', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 3288752771}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 3288752771}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4884, 'qdb_cluster': [4884]} 2024-09-12T12:13:48.889 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:13:48.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T12:13:49.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2993200640 1 Processor -- start 2024-09-12T12:13:49.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2993200640 1 -- start start 2024-09-12T12:13:49.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2993200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 0x7f298c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2993200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f298c0b3ad0 0x7f298c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2993200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f298c071960 0x7f298c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2993200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f298c0b45a0 con 0x7f298c071960 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2993200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f298c0b3fe0 con 0x7f298c0b3ad0 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2993200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f298c0b42c0 con 0x7f298c15b4e0 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2991200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f298c071960 0x7f298c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2991200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f298c071960 0x7f298c0ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40520/0 (socket says 172.21.15.144:40520) 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f2991200640 1 -- 172.21.15.144:0/588525204 learned_addr learned my addr 172.21.15.144:0/588525204 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f298b400640 1 --2- 172.21.15.144:0/588525204 >> v2:172.21.15.165:3300/0 conn(0x7f298c0b3ad0 0x7f298c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.024+0000 7f298be00640 1 --2- 172.21.15.144:0/588525204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 0x7f298c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.028+0000 7f2991200640 1 -- 172.21.15.144:0/588525204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 msgr2=0x7f298c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.028+0000 7f2991200640 1 --2- 172.21.15.144:0/588525204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 0x7f298c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.028+0000 7f2991200640 1 -- 172.21.15.144:0/588525204 >> v2:172.21.15.165:3300/0 conn(0x7f298c0b3ad0 msgr2=0x7f298c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.028+0000 7f2991200640 1 --2- 172.21.15.144:0/588525204 >> v2:172.21.15.165:3300/0 conn(0x7f298c0b3ad0 0x7f298c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.028+0000 7f2991200640 1 -- 172.21.15.144:0/588525204 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c0b1490 con 0x7f298c071960 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.028+0000 7f2991200640 1 --2- 172.21.15.144:0/588525204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 0x7f298c0ccf30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f298c06a020 tx=0x7f298401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf448081f7af460 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.028+0000 7f298aa00640 1 -- 172.21.15.144:0/588525204 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840b1070 con 0x7f298c071960 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.028+0000 7f298aa00640 1 -- 172.21.15.144:0/588525204 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29840ac620 con 0x7f298c071960 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.028+0000 7f298aa00640 1 -- 172.21.15.144:0/588525204 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840ac9f0 con 0x7f298c071960 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 -- 172.21.15.144:0/588525204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 msgr2=0x7f298c0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 --2- 172.21.15.144:0/588525204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 0x7f298c0ccf30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f298c06a020 tx=0x7f298401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 -- 172.21.15.144:0/588525204 shutdown_connections 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 --2- 172.21.15.144:0/588525204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 0x7f298c0ccf30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 --2- 172.21.15.144:0/588525204 >> v2:172.21.15.165:3300/0 conn(0x7f298c0b3ad0 0x7f298c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 --2- 172.21.15.144:0/588525204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 0x7f298c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 -- 172.21.15.144:0/588525204 >> 172.21.15.144:0/588525204 conn(0x7f298c06d0d0 msgr2=0x7f298c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:49.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 -- 172.21.15.144:0/588525204 shutdown_connections 2024-09-12T12:13:49.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 -- 172.21.15.144:0/588525204 wait complete. 2024-09-12T12:13:49.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 Processor -- start 2024-09-12T12:13:49.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 -- start start 2024-09-12T12:13:49.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 0x7f298c146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f298c0b3ad0 0x7f298c147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 0x7f298c160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f298c15f270 con 0x7f298c071960 2024-09-12T12:13:49.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f298c15f0f0 con 0x7f298c0b3ad0 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2993200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f298c15f3f0 con 0x7f298c15b4e0 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 0x7f298c146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 0x7f298c146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40528/0 (socket says 172.21.15.144:40528) 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298be00640 1 -- 172.21.15.144:0/1358739409 learned_addr learned my addr 172.21.15.144:0/1358739409 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2991200640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 0x7f298c160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298b400640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f298c0b3ad0 0x7f298c147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298be00640 1 -- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 msgr2=0x7f298c160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298be00640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 0x7f298c160270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298be00640 1 -- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f298c0b3ad0 msgr2=0x7f298c147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298be00640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f298c0b3ad0 0x7f298c147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298be00640 1 -- 172.21.15.144:0/1358739409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298c1633d0 con 0x7f298c071960 2024-09-12T12:13:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f298b400640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f298c0b3ad0 0x7f298c147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.032+0000 7f2991200640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 0x7f298c160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f298be00640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 0x7f298c146fe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f297c007e90 tx=0x7f297c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2983e00640 1 -- 172.21.15.144:0/1358739409 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c014620 con 0x7f298c071960 2024-09-12T12:13:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2983e00640 1 -- 172.21.15.144:0/1358739409 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c019070 con 0x7f298c071960 2024-09-12T12:13:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2993200640 1 -- 172.21.15.144:0/1358739409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298c1636b0 con 0x7f298c071960 2024-09-12T12:13:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2983e00640 1 -- 172.21.15.144:0/1358739409 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c014a20 con 0x7f298c071960 2024-09-12T12:13:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2993200640 1 -- 172.21.15.144:0/1358739409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298c163f50 con 0x7f298c071960 2024-09-12T12:13:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2983e00640 1 -- 172.21.15.144:0/1358739409 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f297c014bc0 con 0x7f298c071960 2024-09-12T12:13:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2983e00640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29680678f0 0x7f2968069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2983e00640 1 -- 172.21.15.144:0/1358739409 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f297c0866f0 con 0x7f298c071960 2024-09-12T12:13:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f298b400640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29680678f0 0x7f2968069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2996581000 1 Processor -- start 2024-09-12T12:13:49.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.036+0000 7f2996581000 1 -- start start 2024-09-12T12:13:49.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298b400640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29680678f0 0x7f2968069db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f298c0b1010 tx=0x7f2974008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0da1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 0x5622d0d57d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d58290 0x5622d0d58670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5622d0c3fb60 con 0x5622d0da1b20 2024-09-12T12:13:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5622d0ba6c70 con 0x5622d0da2440 2024-09-12T12:13:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5622d0b4ced0 con 0x5622d0d58290 2024-09-12T12:13:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0da1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0da1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40538/0 (socket says 172.21.15.144:40538) 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298be00640 1 -- 172.21.15.144:0/1647265136 learned_addr learned my addr 172.21.15.144:0/1647265136 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298b400640 1 --2- 172.21.15.144:0/1647265136 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 0x5622d0d57d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2991200640 1 --2- 172.21.15.144:0/1647265136 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d58290 0x5622d0d58670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298be00640 1 -- 172.21.15.144:0/1647265136 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d58290 msgr2=0x5622d0d58670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298be00640 1 --2- 172.21.15.144:0/1647265136 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d58290 0x5622d0d58670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298be00640 1 -- 172.21.15.144:0/1647265136 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 msgr2=0x5622d0d57d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298be00640 1 --2- 172.21.15.144:0/1647265136 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 0x5622d0d57d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298be00640 1 -- 172.21.15.144:0/1647265136 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d0b5ee50 con 0x5622d0da1b20 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f298be00640 1 --2- 172.21.15.144:0/1647265136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0da1f00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f297c056600 tx=0x7f297c057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d6cf45882bd3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2980c00640 1 -- 172.21.15.144:0/1647265136 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c05f4e0 con 0x5622d0da1b20 2024-09-12T12:13:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2980c00640 1 -- 172.21.15.144:0/1647265136 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c084e50 con 0x5622d0da1b20 2024-09-12T12:13:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2980c00640 1 -- 172.21.15.144:0/1647265136 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c052f70 con 0x5622d0da1b20 2024-09-12T12:13:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 -- 172.21.15.144:0/1647265136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 msgr2=0x5622d0da1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 --2- 172.21.15.144:0/1647265136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0da1f00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f297c056600 tx=0x7f297c057000 comp rx=0 tx=0).stop 2024-09-12T12:13:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 -- 172.21.15.144:0/1647265136 shutdown_connections 2024-09-12T12:13:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 --2- 172.21.15.144:0/1647265136 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d58290 0x5622d0d58670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 --2- 172.21.15.144:0/1647265136 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 0x5622d0d57d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 --2- 172.21.15.144:0/1647265136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0da1f00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 -- 172.21.15.144:0/1647265136 >> 172.21.15.144:0/1647265136 conn(0x5622d0d5e600 msgr2=0x5622d0d56630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 -- 172.21.15.144:0/1647265136 shutdown_connections 2024-09-12T12:13:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 -- 172.21.15.144:0/1647265136 wait complete. 2024-09-12T12:13:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 -- start start 2024-09-12T12:13:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.040+0000 7f2996581000 1 Processor -- start 2024-09-12T12:13:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0d5ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 0x5622d0d62cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d5d390 0x5622d0d63230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5622d0c08b00 con 0x5622d0da1b20 2024-09-12T12:13:49.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5622d0b81360 con 0x5622d0da2440 2024-09-12T12:13:49.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5622d0b7e2d0 con 0x5622d0d5d390 2024-09-12T12:13:49.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 10 client.0 _ll_register_callbacks cb 0x5622d0d43820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:13:49.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0d5ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0d5ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40544/0 (socket says 172.21.15.144:40544) 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298be00640 1 -- 172.21.15.144:0/3304307262 learned_addr learned my addr 172.21.15.144:0/3304307262 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298b400640 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 0x5622d0d62cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2991200640 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d5d390 0x5622d0d63230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298be00640 1 -- 172.21.15.144:0/3304307262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d5d390 msgr2=0x5622d0d63230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298be00640 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d5d390 0x5622d0d63230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298be00640 1 -- 172.21.15.144:0/3304307262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 msgr2=0x5622d0d62cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298be00640 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 0x5622d0d62cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298be00640 1 -- 172.21.15.144:0/3304307262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d0b4d120 con 0x5622d0da1b20 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298be00640 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0d5ce50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f297c0571b0 tx=0x7f297c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f7dd558deb23aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2979600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:13:49.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2979600640 1 -- 172.21.15.144:0/3304307262 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c05f4e0 con 0x5622d0da1b20 2024-09-12T12:13:49.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2979600640 1 -- 172.21.15.144:0/3304307262 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f297c052f70 con 0x5622d0da1b20 2024-09-12T12:13:49.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 -- 172.21.15.144:0/3304307262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f297c084e50 con 0x5622d0da1b20 2024-09-12T12:13:49.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2979600640 1 -- 172.21.15.144:0/3304307262 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f297c07d050 con 0x5622d0da1b20 2024-09-12T12:13:49.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 10 client.5034 fetch_fsmap learned FSMap version 17 2024-09-12T12:13:49.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 -- 172.21.15.144:0/3304307262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5622d0b46450 con 0x5622d0da1b20 2024-09-12T12:13:49.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2979600640 1 -- 172.21.15.144:0/3304307262 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c084e50 con 0x5622d0da1b20 2024-09-12T12:13:49.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2979600640 1 -- 172.21.15.144:0/3304307262 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f297c078030 con 0x5622d0da1b20 2024-09-12T12:13:49.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 10 client.5034 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T12:13:49.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 10 client.5034 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:13:49.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 20 client.5034 populate_metadata read hostname 'smithi144' 2024-09-12T12:13:49.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5622d0da7f50 0x5622d0da8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 4 client.5034 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:13:49.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2996581000 1 -- 172.21.15.144:0/3304307262 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622d0b40c00 con 0x5622d0da7f50 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298b400640 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5622d0da7f50 0x5622d0da8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f298b400640 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5622d0da7f50 0x5622d0da8330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fc7cb7cece43892 server_cookie=283da5902d8b3833 in_seq=0 out_seq=0 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2979600640 10 client.5034 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2979600640 1 -- 172.21.15.144:0/3304307262 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622d0b40c00 con 0x5622d0da7f50 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.044+0000 7f2979600640 10 client.5034 handle_command_reply: tid=0 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 client.5034 shutdown 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 -- 172.21.15.144:0/3304307262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 msgr2=0x5622d0d5ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0d5ce50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f297c0571b0 tx=0x7f297c086040 comp rx=0 tx=0).stop 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 -- 172.21.15.144:0/3304307262 shutdown_connections 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0d5d390 0x5622d0d63230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0da2440 0x5622d0d62cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5622d0da7f50 0x5622d0da8330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 --2- 172.21.15.144:0/3304307262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0d5ce50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 -- 172.21.15.144:0/3304307262 >> 172.21.15.144:0/3304307262 conn(0x5622d0d58290 msgr2=0x5622d0d56d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:49.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2979600640 0 client.5034 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:13:49.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 -- 172.21.15.144:0/3304307262 shutdown_connections 2024-09-12T12:13:49.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 1 -- 172.21.15.144:0/3304307262 wait complete. 2024-09-12T12:13:49.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.048+0000 7f2996581000 20 client.5034 trim_cache size 0 max 16384 2024-09-12T12:13:49.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2996581000 1 Processor -- start 2024-09-12T12:13:49.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2996581000 1 -- start start 2024-09-12T12:13:49.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2996581000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 0x5622d0db8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2996581000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da1b20 0x5622d0da0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2996581000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da2440 0x5622d0da1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2996581000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f298c203690 con 0x5622d0da2440 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2996581000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f298c162dc0 con 0x5622d0d5d390 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2996581000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f298c2030a0 con 0x5622d0da1b20 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2991200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da2440 0x5622d0da1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2991200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da2440 0x5622d0da1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40552/0 (socket says 172.21.15.144:40552) 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.064+0000 7f2991200640 1 -- 172.21.15.144:0/2818522446 learned_addr learned my addr 172.21.15.144:0/2818522446 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298be00640 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 0x5622d0db8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2991200640 1 -- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da1b20 msgr2=0x5622d0da0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da1b20 0x5622d0da0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2991200640 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da1b20 0x5622d0da0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2991200640 1 -- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 msgr2=0x5622d0db8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2991200640 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 0x5622d0db8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2991200640 1 -- 172.21.15.144:0/2818522446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d0b2dfd0 con 0x5622d0da2440 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298be00640 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 0x5622d0db8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da1b20 0x5622d0da0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2991200640 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da2440 0x5622d0da1230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f298401c530 tx=0x7f2984004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3ee9b4efc99b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f297be00640 1 -- 172.21.15.144:0/2818522446 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840b1040 con 0x5622d0da2440 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f297be00640 1 -- 172.21.15.144:0/2818522446 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29840ac720 con 0x5622d0da2440 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f297be00640 1 -- 172.21.15.144:0/2818522446 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29840acad0 con 0x5622d0da2440 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 -- 172.21.15.144:0/2818522446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da2440 msgr2=0x5622d0da1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da2440 0x5622d0da1230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f298401c530 tx=0x7f2984004740 comp rx=0 tx=0).stop 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 -- 172.21.15.144:0/2818522446 shutdown_connections 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da2440 0x5622d0da1230 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da1b20 0x5622d0da0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 --2- 172.21.15.144:0/2818522446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 0x5622d0db8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 -- 172.21.15.144:0/2818522446 >> 172.21.15.144:0/2818522446 conn(0x5622d0d58290 msgr2=0x5622d0d5c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 -- 172.21.15.144:0/2818522446 shutdown_connections 2024-09-12T12:13:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 -- 172.21.15.144:0/2818522446 wait complete. 2024-09-12T12:13:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 -- start start 2024-09-12T12:13:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 Processor -- start 2024-09-12T12:13:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 0x5622d0e145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0e14b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da2440 0x5622d0e15050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5622d0ba5f80 con 0x5622d0da1b20 2024-09-12T12:13:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5622d0b5eca0 con 0x5622d0d5d390 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5622d0bab2a0 con 0x5622d0da2440 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2996581000 10 client.0 _ll_register_callbacks cb 0x7f29740095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0e14b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0e14b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40562/0 (socket says 172.21.15.144:40562) 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 -- 172.21.15.144:0/318045208 learned_addr learned my addr 172.21.15.144:0/318045208 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298be00640 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 0x5622d0e145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f2991200640 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da2440 0x5622d0e15050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 -- 172.21.15.144:0/318045208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da2440 msgr2=0x5622d0e15050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da2440 0x5622d0e15050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 -- 172.21.15.144:0/318045208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 msgr2=0x5622d0e145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 0x5622d0e145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.068+0000 7f298b400640 1 -- 172.21.15.144:0/318045208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d0c29750 con 0x5622d0da1b20 2024-09-12T12:13:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f298b400640 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0e14b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5622d0be7bf0 tx=0x7f2974011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad61ac5a9970e0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 1 -- 172.21.15.144:0/318045208 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297400f040 con 0x5622d0da1b20 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 1 -- 172.21.15.144:0/318045208 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f2974015650 con 0x5622d0da1b20 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 -- 172.21.15.144:0/318045208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29840ac720 con 0x5622d0da1b20 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 1 -- 172.21.15.144:0/318045208 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2974038050 con 0x5622d0da1b20 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 10 client.5040 fetch_fsmap learned FSMap version 17 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 -- 172.21.15.144:0/318045208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5622d0b34a30 con 0x5622d0da1b20 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 1 -- 172.21.15.144:0/318045208 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29840ac720 con 0x5622d0da1b20 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 1 -- 172.21.15.144:0/318045208 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f297403b020 con 0x5622d0da1b20 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 10 client.5040 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 10 client.5040 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 20 client.5040 populate_metadata read hostname 'smithi144' 2024-09-12T12:13:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5622d0daca90 0x5622d0dabbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 4 client.5040 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 -- 172.21.15.144:0/318045208 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "status"}) -- 0x5622d0bb43a0 con 0x5622d0daca90 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f298be00640 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5622d0daca90 0x5622d0dabbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f298be00640 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5622d0daca90 0x5622d0dabbb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1b7210074d643a9 server_cookie=608dbe8cf17ca565 in_seq=0 out_seq=0 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 10 client.5040 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 1 -- 172.21.15.144:0/318045208 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5622d0bb43a0 con 0x5622d0daca90 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 10 client.5040 handle_command_reply: tid=0 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 client.5040 shutdown 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 -- 172.21.15.144:0/318045208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 msgr2=0x5622d0e14b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0e14b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5622d0be7bf0 tx=0x7f2974011000 comp rx=0 tx=0).stop 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 -- 172.21.15.144:0/318045208 shutdown_connections 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5622d0da2440 0x5622d0e15050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5622d0daca90 0x5622d0dabbb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5622d0da1b20 0x5622d0e14b10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 --2- 172.21.15.144:0/318045208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5622d0d5d390 0x5622d0e145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2979600640 0 client.5040 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:13:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 -- 172.21.15.144:0/318045208 >> 172.21.15.144:0/318045208 conn(0x5622d0d58290 msgr2=0x5622d0d9fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 -- 172.21.15.144:0/318045208 shutdown_connections 2024-09-12T12:13:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 1 -- 172.21.15.144:0/318045208 wait complete. 2024-09-12T12:13:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2996581000 20 client.5040 trim_cache size 0 max 16384 2024-09-12T12:13:49.080 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:13:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4884, 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 5.8713136820000003, 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 17, 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 39, 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 39, 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 13.070413089000001 2024-09-12T12:13:49.081 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:13:49.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 -- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29680678f0 msgr2=0x7f2968069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29680678f0 0x7f2968069db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f298c0b1010 tx=0x7f2974008040 comp rx=0 tx=0).stop 2024-09-12T12:13:49.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 -- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 msgr2=0x7f298c146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 0x7f298c146fe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f297c007e90 tx=0x7f297c00e4b0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 -- 172.21.15.144:0/1358739409 shutdown_connections 2024-09-12T12:13:49.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29680678f0 0x7f2968069db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f298c15b4e0 0x7f298c160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f298c0b3ad0 0x7f298c147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 --2- 172.21.15.144:0/1358739409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f298c071960 0x7f298c146fe0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 -- 172.21.15.144:0/1358739409 >> 172.21.15.144:0/1358739409 conn(0x7f298c06d0d0 msgr2=0x7f298c165830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:49.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 -- 172.21.15.144:0/1358739409 shutdown_connections 2024-09-12T12:13:49.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.072+0000 7f2993200640 1 -- 172.21.15.144:0/1358739409 wait complete. 2024-09-12T12:13:49.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:13:49.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d4400640 1 Processor -- start 2024-09-12T12:13:49.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d4400640 1 -- start start 2024-09-12T12:13:49.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d4400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc15cd30 0x7ff5cc0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d4400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff5cc0b5de0 0x7ff5cc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d4400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc0cd870 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d4400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff5cc072a50 con 0x7ff5cc0b5de0 2024-09-12T12:13:49.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d4400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc0cde30 con 0x7ff5cc15cd30 2024-09-12T12:13:49.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d2400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff5cc0b5de0 0x7ff5cc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d1a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7ff5cc15c7b0 0x7ff5cc0ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:46948/0 (socket says 172.21.15.144:46948) 2024-09-12T12:13:49.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d1a00640 1 -- 172.21.15.144:0/1990273947 learned_addr learned my addr 172.21.15.144:0/1990273947 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:13:49.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d1000640 1 --2- 172.21.15.144:0/1990273947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc15cd30 0x7ff5cc0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d2400640 1 -- 172.21.15.144:0/1990273947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc15cd30 msgr2=0x7ff5cc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:49.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d2400640 1 --2- 172.21.15.144:0/1990273947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc15cd30 0x7ff5cc0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d2400640 1 -- 172.21.15.144:0/1990273947 >> v1:172.21.15.165:6789/0 conn(0x7ff5cc15c7b0 legacy=0x7ff5cc0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5d2400640 1 -- 172.21.15.144:0/1990273947 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc0cdb50 con 0x7ff5cc0b5de0 2024-09-12T12:13:49.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.228+0000 7ff5cbe00640 1 -- 172.21.15.144:0/1990273947 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262581940 0 0) 0x7ff5cc0cd870 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5d2400640 1 --2- 172.21.15.144:0/1990273947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5cc0b5de0 0x7ff5cc072ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40097c0 tx=0x7ff5c401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da76a658dd6f114e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5cbe00640 1 -- 172.21.15.144:0/1990273947 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40b0070 con 0x7ff5cc0b5de0 2024-09-12T12:13:49.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5cbe00640 1 -- 172.21.15.144:0/1990273947 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c40ab600 con 0x7ff5cc0b5de0 2024-09-12T12:13:49.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5cbe00640 1 -- 172.21.15.144:0/1990273947 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40ab9d0 con 0x7ff5cc0b5de0 2024-09-12T12:13:49.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5d4400640 1 -- 172.21.15.144:0/1990273947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5cc0b5de0 msgr2=0x7ff5cc072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5d4400640 1 --2- 172.21.15.144:0/1990273947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5cc0b5de0 0x7ff5cc072ee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40097c0 tx=0x7ff5c401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5d4400640 1 -- 172.21.15.144:0/1990273947 shutdown_connections 2024-09-12T12:13:49.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5d4400640 1 --2- 172.21.15.144:0/1990273947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5cc0b5de0 0x7ff5cc072ee0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5d4400640 1 --2- 172.21.15.144:0/1990273947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc15cd30 0x7ff5cc0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5d4400640 1 -- 172.21.15.144:0/1990273947 >> 172.21.15.144:0/1990273947 conn(0x7ff5cc06d0d0 msgr2=0x7ff5cc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:49.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5d4400640 1 -- 172.21.15.144:0/1990273947 shutdown_connections 2024-09-12T12:13:49.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.232+0000 7ff5d4400640 1 -- 172.21.15.144:0/1990273947 wait complete. 2024-09-12T12:13:49.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 Processor -- start 2024-09-12T12:13:49.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 -- start start 2024-09-12T12:13:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc0b5de0 0x7ff5cc15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc15c7b0 0x7ff5cc157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5cc15cd30 0x7ff5cc15b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc073fc0 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc073e40 con 0x7ff5cc15cd30 2024-09-12T12:13:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc074140 con 0x7ff5cc0b5de0 2024-09-12T12:13:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc15c7b0 0x7ff5cc157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc0b5de0 0x7ff5cc15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc15c7b0 0x7ff5cc157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40572/0 (socket says 172.21.15.144:40572) 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1000640 1 -- 172.21.15.144:0/3056432439 learned_addr learned my addr 172.21.15.144:0/3056432439 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d2400640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5cc15cd30 0x7ff5cc15b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1000640 1 -- 172.21.15.144:0/3056432439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc0b5de0 msgr2=0x7ff5cc15ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1000640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc0b5de0 0x7ff5cc15ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1000640 1 -- 172.21.15.144:0/3056432439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5cc15cd30 msgr2=0x7ff5cc15b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1000640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5cc15cd30 0x7ff5cc15b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1000640 1 -- 172.21.15.144:0/3056432439 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc15b1a0 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d1000640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc15c7b0 0x7ff5cc157ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800e8a0 tx=0x7ff5b800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5c9600640 1 -- 172.21.15.144:0/3056432439 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8017070 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5c9600640 1 -- 172.21.15.144:0/3056432439 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b800c940 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5c9600640 1 -- 172.21.15.144:0/3056432439 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800ccf0 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5cc159bc0 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.236+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5cc15a180 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.240+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5cc072ec0 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.240+0000 7ff5c9600640 1 -- 172.21.15.144:0/3056432439 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5b801a070 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.240+0000 7ff5c9600640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5ac0678c0 0x7ff5ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.240+0000 7ff5c9600640 1 -- 172.21.15.144:0/3056432439 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff5b8085d20 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.240+0000 7ff5d1a00640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5ac0678c0 0x7ff5ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.240+0000 7ff5d1a00640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5ac0678c0 0x7ff5ac069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00012f0 tx=0x7ff5c0001770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.244+0000 7ff5c9600640 1 -- 172.21.15.144:0/3056432439 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff5b8055fe0 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.436+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff5cc0cf750 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.436+0000 7ff5c9600640 1 -- 172.21.15.144:0/3056432439 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7ff5b805a2e0 con 0x7ff5cc15c7b0 2024-09-12T12:13:49.439 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:13:49.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5ac0678c0 msgr2=0x7ff5ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5ac0678c0 0x7ff5ac069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00012f0 tx=0x7ff5c0001770 comp rx=0 tx=0).stop 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc15c7b0 msgr2=0x7ff5cc157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc15c7b0 0x7ff5cc157ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800e8a0 tx=0x7ff5b800eca0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 shutdown_connections 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5ac0678c0 0x7ff5ac069d80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5cc15cd30 0x7ff5cc15b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5cc15c7b0 0x7ff5cc157ec0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 --2- 172.21.15.144:0/3056432439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5cc0b5de0 0x7ff5cc15ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 >> 172.21.15.144:0/3056432439 conn(0x7ff5cc06d0d0 msgr2=0x7ff5cc0cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:49.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 shutdown_connections 2024-09-12T12:13:49.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49.440+0000 7ff5d4400640 1 -- 172.21.15.144:0/3056432439 wait complete. 2024-09-12T12:13:49.461 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:13:49.462 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:13:49.462 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:13:49.462 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:13:49.462 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:13:49.462 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:13:49.462 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:13:49.462 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:13:49.462 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:13:49.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:49.463 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:13:49.473 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:13:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:13:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:13:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:13:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:49.473 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:49.473 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42353sec preferred_lft 42353sec 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:13:49.474 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:13:49.475 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:49.476 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:13:49.476 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:13:49.476 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:13:49.476 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:13:49.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:49.476 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:13:49.538 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:13:49.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:49.540 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:13:49.599 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:13:49.600 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:13:49.601 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:13:49.601 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:13:49.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:13:49.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:13:49.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:13:49.601 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:13:49.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:13:49.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:49.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:49.733 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:13:49.742 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:13:49.743 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:13:49.743 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:13:49.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:49.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:13:49.808 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:49.808 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:13:49.860 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:13:49.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:13:49.860 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:13:49.915 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:13:49.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:49.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:50.004 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:50.004 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:50.019 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:13:50.020 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:13:50.020 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:13:50.020 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:13:50.020 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:13:50.024 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:13:50.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:50.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:13:50.045 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:13:50.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:13:50.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:13:50.157 INFO:teuthology.orchestra.run.smithi144.stdout:client4763 2024-09-12T12:13:50.157 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:50.158 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:50.170 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-12T12:13:50.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee3800640 1 Processor -- start 2024-09-12T12:13:50.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee3800640 1 -- start start 2024-09-12T12:13:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b6490 0x7f9edc0b6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee3800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9edc0b33e0 0x7f9edc06dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee3800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc0b38c0 con 0x7f9edc15e810 2024-09-12T12:13:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee3800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc0b6db0 con 0x7f9edc0b33e0 2024-09-12T12:13:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc0d2340 con 0x7f9edc0b6490 2024-09-12T12:13:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9edc0b33e0 0x7f9edc06dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:50.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9edc0b33e0 0x7f9edc06dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40574/0 (socket says 172.21.15.144:40574) 2024-09-12T12:13:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.352+0000 7f9ee1800640 1 -- 172.21.15.144:0/2793985898 learned_addr learned my addr 172.21.15.144:0/2793985898 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.356+0000 7f9ee0e00640 1 --2- 172.21.15.144:0/2793985898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b6490 0x7f9edc0b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.356+0000 7f9ee1800640 1 -- 172.21.15.144:0/2793985898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b6490 msgr2=0x7f9edc0b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:13:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.356+0000 7f9ee1800640 1 --2- 172.21.15.144:0/2793985898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b6490 0x7f9edc0b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.356+0000 7f9ee1800640 1 -- 172.21.15.144:0/2793985898 >> v1:172.21.15.165:6789/0 conn(0x7f9edc15e810 legacy=0x7f9edc06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:50.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.356+0000 7f9ee1800640 1 -- 172.21.15.144:0/2793985898 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0d2620 con 0x7f9edc0b33e0 2024-09-12T12:13:50.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee1800640 1 --2- 172.21.15.144:0/2793985898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 0x7f9edc06dfd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009e50 tx=0x7f9ed401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc4121c43f4a3a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:50.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9edb400640 1 -- 172.21.15.144:0/2793985898 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40a5860 con 0x7f9edc0b33e0 2024-09-12T12:13:50.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9edb400640 1 -- 172.21.15.144:0/2793985898 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed40a5a00 con 0x7f9edc0b33e0 2024-09-12T12:13:50.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9edb400640 1 -- 172.21.15.144:0/2793985898 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40a5dd0 con 0x7f9edc0b33e0 2024-09-12T12:13:50.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee3800640 1 -- 172.21.15.144:0/2793985898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 msgr2=0x7f9edc06dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:50.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee3800640 1 --2- 172.21.15.144:0/2793985898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 0x7f9edc06dfd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009e50 tx=0x7f9ed401c9a0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee3800640 1 -- 172.21.15.144:0/2793985898 shutdown_connections 2024-09-12T12:13:50.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee3800640 1 --2- 172.21.15.144:0/2793985898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 0x7f9edc06dfd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee3800640 1 --2- 172.21.15.144:0/2793985898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b6490 0x7f9edc0b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee3800640 1 -- 172.21.15.144:0/2793985898 >> 172.21.15.144:0/2793985898 conn(0x7f9edc0d14c0 msgr2=0x7f9edc0d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:50.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee3800640 1 -- 172.21.15.144:0/2793985898 shutdown_connections 2024-09-12T12:13:50.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee3800640 1 -- 172.21.15.144:0/2793985898 wait complete. 2024-09-12T12:13:50.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.360+0000 7f9ee3800640 1 Processor -- start 2024-09-12T12:13:50.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 -- start start 2024-09-12T12:13:50.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 0x7f9edc0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:50.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b6490 0x7f9edc0b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:50.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc15e810 0x7f9edc154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:50.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc06e510 con 0x7f9edc0b33e0 2024-09-12T12:13:50.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc06e690 con 0x7f9edc0b6490 2024-09-12T12:13:50.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc16b9b0 con 0x7f9edc15e810 2024-09-12T12:13:50.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 0x7f9edc0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:50.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 0x7f9edc0ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40586/0 (socket says 172.21.15.144:40586) 2024-09-12T12:13:50.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee0e00640 1 -- 172.21.15.144:0/3386547546 learned_addr learned my addr 172.21.15.144:0/3386547546 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee1800640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc15e810 0x7f9edc154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9edbe00640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b6490 0x7f9edc0b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee0e00640 1 -- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc15e810 msgr2=0x7f9edc154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee0e00640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc15e810 0x7f9edc154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee0e00640 1 -- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b6490 msgr2=0x7f9edc0b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee0e00640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b6490 0x7f9edc0b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee0e00640 1 -- 172.21.15.144:0/3386547546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0d5450 con 0x7f9edc0b33e0 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee1800640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc15e810 0x7f9edc154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9edbe00640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b6490 0x7f9edc0b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:50.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee0e00640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 0x7f9edc0ca770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000e870 tx=0x7f9ed000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:50.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ed8c00640 1 -- 172.21.15.144:0/3386547546 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0017070 con 0x7f9edc0b33e0 2024-09-12T12:13:50.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ed8c00640 1 -- 172.21.15.144:0/3386547546 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed000c940 con 0x7f9edc0b33e0 2024-09-12T12:13:50.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc0b89a0 con 0x7f9edc0b33e0 2024-09-12T12:13:50.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ed8c00640 1 -- 172.21.15.144:0/3386547546 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000ccf0 con 0x7f9edc0b33e0 2024-09-12T12:13:50.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc0b8f60 con 0x7f9edc0b33e0 2024-09-12T12:13:50.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.364+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc0b6870 con 0x7f9edc0b33e0 2024-09-12T12:13:50.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.368+0000 7f9ed8c00640 1 -- 172.21.15.144:0/3386547546 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ed001a070 con 0x7f9edc0b33e0 2024-09-12T12:13:50.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.368+0000 7f9ed8c00640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ebc0678f0 0x7f9ebc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:50.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.368+0000 7f9ed8c00640 1 -- 172.21.15.144:0/3386547546 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9ed0086130 con 0x7f9edc0b33e0 2024-09-12T12:13:50.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.368+0000 7f9edbe00640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ebc0678f0 0x7f9ebc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:50.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.368+0000 7f9edbe00640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ebc0678f0 0x7f9ebc069db0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9edc154440 tx=0x7f9ec8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:50.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.376+0000 7f9ed8c00640 1 -- 172.21.15.144:0/3386547546 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ed0056a40 con 0x7f9edc0b33e0 2024-09-12T12:13:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:50.576+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f9edc153750 con 0x7f9edc0b33e0 2024-09-12T12:13:51.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.260+0000 7f9ed8c00640 1 -- 172.21.15.144:0/3386547546 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v18) ==== 167+0+0 (secure 0 0 0) 0x7f9ed0056340 con 0x7f9edc0b33e0 2024-09-12T12:13:51.262 INFO:teuthology.orchestra.run.smithi144.stderr:enabled new snapshots 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ebc0678f0 msgr2=0x7f9ebc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ebc0678f0 0x7f9ebc069db0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9edc154440 tx=0x7f9ec8009040 comp rx=0 tx=0).stop 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 msgr2=0x7f9edc0ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 0x7f9edc0ca770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000e870 tx=0x7f9ed000ec70 comp rx=0 tx=0).stop 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 shutdown_connections 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ebc0678f0 0x7f9ebc069db0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc15e810 0x7f9edc154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b6490 0x7f9edc0b94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 --2- 172.21.15.144:0/3386547546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b33e0 0x7f9edc0ca770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 >> 172.21.15.144:0/3386547546 conn(0x7f9edc0d14c0 msgr2=0x7f9edc0d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:51.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 shutdown_connections 2024-09-12T12:13:51.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:13:51.264+0000 7f9ee3800640 1 -- 172.21.15.144:0/3386547546 wait complete. 2024-09-12T12:13:51.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:13:51.285 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-12T12:13:51.300 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:13:51.300 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:13:51.349 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:13:51.349 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:13:51.349 DEBUG:teuthology.orchestra.run.smithi144:> import uuid 2024-09-12T12:13:51.349 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:13:51.349 DEBUG:teuthology.orchestra.run.smithi144:> n = 2000 2024-09-12T12:13:51.349 DEBUG:teuthology.orchestra.run.smithi144:> create_hard_links = False 2024-09-12T12:13:51.349 DEBUG:teuthology.orchestra.run.smithi144:> if 3 > 0: 2024-09-12T12:13:51.349 DEBUG:teuthology.orchestra.run.smithi144:> create_hard_links = True 2024-09-12T12:13:51.349 DEBUG:teuthology.orchestra.run.smithi144:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> dpath = os.path.dirname(path) 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> fnameprefix = os.path.basename(path) 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> os.makedirs(dpath, exist_ok=True) 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> try: 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> for i in range(n): 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> f.write(f"{i}") 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> f.flush() 2024-09-12T12:13:51.350 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(f.fileno()) 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> os.unlink(fpath) 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(dirfd) 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> if create_hard_links: 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> for j in range(3): 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(dirfd) 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> finally: 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> os.close(dirfd) 2024-09-12T12:13:51.351 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:14:12.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:14:12.351 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:14:14.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:14:14.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:14:14.688 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-12T12:14:15.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:14:15.072 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-12T12:14:42.402 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:14:42.406 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:14:43.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:14:43.296 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-12T12:14:43.332 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-12T12:14:43.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f6a000640 1 Processor -- start 2024-09-12T12:14:43.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f6a000640 1 -- start start 2024-09-12T12:14:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f6a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f6415e5c0 0x7f8f640b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f6a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f6406c320 0x7f8f640ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f6a000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f6415e9a0 con 0x7f8f640b3830 2024-09-12T12:14:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f6a000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8f640cdc20 con 0x7f8f6406c320 2024-09-12T12:14:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f6a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8f640b4310 con 0x7f8f6415e5c0 2024-09-12T12:14:43.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f63400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f6415e5c0 0x7f8f640b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f63e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f6406c320 0x7f8f640ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f63e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f6406c320 0x7f8f640ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37048/0 (socket says 172.21.15.144:37048) 2024-09-12T12:14:43.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.532+0000 7f8f63e00640 1 -- 172.21.15.144:0/575446786 learned_addr learned my addr 172.21.15.144:0/575446786 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.536+0000 7f8f63400640 1 -- 172.21.15.144:0/575446786 >> v2:172.21.15.144:3300/0 conn(0x7f8f6406c320 msgr2=0x7f8f640ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.536+0000 7f8f63400640 1 --2- 172.21.15.144:0/575446786 >> v2:172.21.15.144:3300/0 conn(0x7f8f6406c320 0x7f8f640ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.536+0000 7f8f63400640 1 -- 172.21.15.144:0/575446786 >> v1:172.21.15.165:6789/0 conn(0x7f8f640b3830 legacy=0x7f8f6406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.536+0000 7f8f63400640 1 -- 172.21.15.144:0/575446786 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f640b3d50 con 0x7f8f6415e5c0 2024-09-12T12:14:43.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.540+0000 7f8f63400640 1 --2- 172.21.15.144:0/575446786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f6415e5c0 0x7f8f640b32f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f500097c0 tx=0x7f8f5001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=331e88366687fafd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.540+0000 7f8f62000640 1 -- 172.21.15.144:0/575446786 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f500b1070 con 0x7f8f6415e5c0 2024-09-12T12:14:43.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.540+0000 7f8f62000640 1 -- 172.21.15.144:0/575446786 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f500a8050 con 0x7f8f6415e5c0 2024-09-12T12:14:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.544+0000 7f8f6a000640 1 -- 172.21.15.144:0/575446786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f6415e5c0 msgr2=0x7f8f640b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.544+0000 7f8f6a000640 1 --2- 172.21.15.144:0/575446786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f6415e5c0 0x7f8f640b32f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f500097c0 tx=0x7f8f5001c3e0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.544+0000 7f8f62000640 1 -- 172.21.15.144:0/575446786 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f500ac860 con 0x7f8f6415e5c0 2024-09-12T12:14:43.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.544+0000 7f8f6a000640 1 -- 172.21.15.144:0/575446786 shutdown_connections 2024-09-12T12:14:43.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.544+0000 7f8f6a000640 1 --2- 172.21.15.144:0/575446786 >> v2:172.21.15.144:3300/0 conn(0x7f8f6406c320 0x7f8f640ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.544+0000 7f8f6a000640 1 --2- 172.21.15.144:0/575446786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f6415e5c0 0x7f8f640b32f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.544+0000 7f8f6a000640 1 -- 172.21.15.144:0/575446786 >> 172.21.15.144:0/575446786 conn(0x7f8f64067e00 msgr2=0x7f8f640b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.544+0000 7f8f6a000640 1 -- 172.21.15.144:0/575446786 shutdown_connections 2024-09-12T12:14:43.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.544+0000 7f8f6a000640 1 -- 172.21.15.144:0/575446786 wait complete. 2024-09-12T12:14:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.548+0000 7f8f6a000640 1 Processor -- start 2024-09-12T12:14:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.548+0000 7f8f6a000640 1 -- start start 2024-09-12T12:14:43.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f6a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f6406c320 0x7f8f6415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f6a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f640b3830 0x7f8f6414ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f6a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f6415e5c0 0x7f8f6414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f6a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8f640cf3a0 con 0x7f8f6406c320 2024-09-12T12:14:43.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f6a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f640aeb20 con 0x7f8f6415e5c0 2024-09-12T12:14:43.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f640b3830 0x7f8f6414ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f640b3830 0x7f8f6414ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:38604/0 (socket says 172.21.15.144:38604) 2024-09-12T12:14:43.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f62a00640 1 -- 172.21.15.144:0/3453141695 learned_addr learned my addr 172.21.15.144:0/3453141695 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f6a000640 1 -- 172.21.15.144:0/3453141695 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8f640cf520 con 0x7f8f640b3830 2024-09-12T12:14:43.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f63e00640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f6415e5c0 0x7f8f6414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f63e00640 1 -- 172.21.15.144:0/3453141695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f640b3830 msgr2=0x7f8f6414ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f63e00640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f640b3830 0x7f8f6414ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f63e00640 1 -- 172.21.15.144:0/3453141695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f6406c320 msgr2=0x7f8f6415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f63e00640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f6406c320 0x7f8f6415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.552+0000 7f8f63e00640 1 -- 172.21.15.144:0/3453141695 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6414f0f0 con 0x7f8f6415e5c0 2024-09-12T12:14:43.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.556+0000 7f8f63e00640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f6415e5c0 0x7f8f6414e390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c007a70 tx=0x7f8f5c007f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.556+0000 7f8f5b400640 1 -- 172.21.15.144:0/3453141695 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c01a070 con 0x7f8f6415e5c0 2024-09-12T12:14:43.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.556+0000 7f8f5b400640 1 -- 172.21.15.144:0/3453141695 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5c00dc40 con 0x7f8f6415e5c0 2024-09-12T12:14:43.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.556+0000 7f8f5b400640 1 -- 172.21.15.144:0/3453141695 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c015400 con 0x7f8f6415e5c0 2024-09-12T12:14:43.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.556+0000 7f8f6a000640 1 -- 172.21.15.144:0/3453141695 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f6414f3c0 con 0x7f8f6415e5c0 2024-09-12T12:14:43.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.556+0000 7f8f6a000640 1 -- 172.21.15.144:0/3453141695 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6414f980 con 0x7f8f6415e5c0 2024-09-12T12:14:43.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f6d461000 1 Processor -- start 2024-09-12T12:14:43.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f5b400640 1 -- 172.21.15.144:0/3453141695 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f5c01d070 con 0x7f8f6415e5c0 2024-09-12T12:14:43.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f6d461000 1 -- start start 2024-09-12T12:14:43.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29670 0x55a103e29a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29f90 0x55a103de15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103de1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f6d461000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a103c25cc0 con 0x55a103e29670 2024-09-12T12:14:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f6d461000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a103be0a20 con 0x55a103e29f90 2024-09-12T12:14:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f6d461000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55a103c21c80 con 0x55a103de1ae0 2024-09-12T12:14:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f5b400640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f44067990 0x7f8f44069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f5b400640 1 -- 172.21.15.144:0/3453141695 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f8f5c085b50 con 0x7f8f6415e5c0 2024-09-12T12:14:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103de1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103de1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:38612/0 (socket says 172.21.15.144:38612) 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f62a00640 1 -- 172.21.15.144:0/1397629751 learned_addr learned my addr 172.21.15.144:0/1397629751 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f63400640 1 --2- 172.21.15.144:0/1397629751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29f90 0x55a103de15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1397629751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29670 0x55a103e29a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f63e00640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f44067990 0x7f8f44069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f62a00640 1 -- 172.21.15.144:0/1397629751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29f90 msgr2=0x55a103de15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1397629751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29f90 0x55a103de15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f62a00640 1 -- 172.21.15.144:0/1397629751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29670 msgr2=0x55a103e29a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1397629751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29670 0x55a103e29a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.564+0000 7f8f62a00640 1 -- 172.21.15.144:0/1397629751 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a103bc8d40 con 0x55a103de1ae0 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1397629751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103de1ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f54001d60 tx=0x7f8f540013c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b8bdb034780d9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f63e00640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f44067990 0x7f8f44069e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c004b20 tx=0x7f8f5c004a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f4fe00640 1 -- 172.21.15.144:0/1397629751 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54010040 con 0x55a103de1ae0 2024-09-12T12:14:43.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f4fe00640 1 -- 172.21.15.144:0/1397629751 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f54005310 con 0x55a103de1ae0 2024-09-12T12:14:43.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f4fe00640 1 -- 172.21.15.144:0/1397629751 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54003800 con 0x55a103de1ae0 2024-09-12T12:14:43.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 -- 172.21.15.144:0/1397629751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 msgr2=0x55a103de1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1397629751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103de1ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f54001d60 tx=0x7f8f540013c0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 -- 172.21.15.144:0/1397629751 shutdown_connections 2024-09-12T12:14:43.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1397629751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103de1ec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1397629751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29f90 0x55a103de15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1397629751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29670 0x55a103e29a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 -- 172.21.15.144:0/1397629751 >> 172.21.15.144:0/1397629751 conn(0x55a103e019b0 msgr2=0x55a103e03da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 -- 172.21.15.144:0/1397629751 shutdown_connections 2024-09-12T12:14:43.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 -- 172.21.15.144:0/1397629751 wait complete. 2024-09-12T12:14:43.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 -- start start 2024-09-12T12:14:43.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.568+0000 7f8f6d461000 1 Processor -- start 2024-09-12T12:14:43.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103e307c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29670 0x55a103e30d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103de5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f6d461000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a103c33f50 con 0x55a103e29f90 2024-09-12T12:14:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f6d461000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a103ca6e90 con 0x55a103e29670 2024-09-12T12:14:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f6d461000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55a103bcd120 con 0x55a103de1ae0 2024-09-12T12:14:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f6d461000 10 client.0 _ll_register_callbacks cb 0x55a103c86db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:14:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103e307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103e307c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:38626/0 (socket says 172.21.15.144:38626) 2024-09-12T12:14:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 -- 172.21.15.144:0/3774558652 learned_addr learned my addr 172.21.15.144:0/3774558652 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103de5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f63400640 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29670 0x55a103e30d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 -- 172.21.15.144:0/3774558652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29670 msgr2=0x55a103e30d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29670 0x55a103e30d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 -- 172.21.15.144:0/3774558652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 msgr2=0x55a103de5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103de5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 -- 172.21.15.144:0/3774558652 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55a103bc5770 con 0x55a103de1ae0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f62a00640 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103e307c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55a103be9c10 tx=0x7f8f54009050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ffb50dcb9398f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f4cc00640 1 -- 172.21.15.144:0/3774558652 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5401e040 con 0x55a103de1ae0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f4cc00640 1 -- 172.21.15.144:0/3774558652 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f8f540067e0 con 0x55a103de1ae0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f6d461000 1 -- 172.21.15.144:0/3774558652 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f54005310 con 0x55a103de1ae0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f4cc00640 1 -- 172.21.15.144:0/3774558652 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8f54031050 con 0x55a103de1ae0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.572+0000 7f8f6d461000 10 client.4781 fetch_fsmap learned FSMap version 18 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 -- 172.21.15.144:0/3774558652 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a103be33f0 con 0x55a103de1ae0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f4cc00640 1 -- 172.21.15.144:0/3774558652 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f54005310 con 0x55a103de1ae0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f4cc00640 1 -- 172.21.15.144:0/3774558652 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f8f54034020 con 0x55a103de1ae0 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 10 client.4781 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:14:43.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 10 client.4781 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:14:43.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 20 client.4781 populate_metadata read hostname 'smithi144' 2024-09-12T12:14:43.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x55a103de69b0 0x55a103de6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 4 client.4781 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:14:43.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 -- 172.21.15.144:0/3774558652 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a103bbfd90 con 0x55a103de69b0 2024-09-12T12:14:43.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f63400640 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x55a103de69b0 0x55a103de6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f4cc00640 10 client.4781 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:43.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f63400640 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x55a103de69b0 0x55a103de6dc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c6e96b26f1597f9 server_cookie=79fb14623e041157 in_seq=0 out_seq=0 2024-09-12T12:14:43.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f4cc00640 1 -- 172.21.15.144:0/3774558652 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a103bbfd90 con 0x55a103de69b0 2024-09-12T12:14:43.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f4cc00640 10 client.4781 handle_command_reply: tid=0 2024-09-12T12:14:43.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 client.4781 shutdown 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 -- 172.21.15.144:0/3774558652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 msgr2=0x55a103e307c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103e307c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55a103be9c10 tx=0x7f8f54009050 comp rx=0 tx=0).stop 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 -- 172.21.15.144:0/3774558652 shutdown_connections 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x55a103de69b0 0x55a103de6dc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103de5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103e29670 0x55a103e30d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 --2- 172.21.15.144:0/3774558652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103de1ae0 0x55a103e307c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 -- 172.21.15.144:0/3774558652 >> 172.21.15.144:0/3774558652 conn(0x55a103e019b0 msgr2=0x55a103e03da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f4cc00640 0 client.4781 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 -- 172.21.15.144:0/3774558652 shutdown_connections 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 1 -- 172.21.15.144:0/3774558652 wait complete. 2024-09-12T12:14:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.576+0000 7f8f6d461000 20 client.4781 trim_cache size 0 max 16384 2024-09-12T12:14:43.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.592+0000 7f8f6d461000 1 Processor -- start 2024-09-12T12:14:43.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.592+0000 7f8f6d461000 1 -- start start 2024-09-12T12:14:43.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.592+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 0x55a103e40f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e365e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e36b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c00bf10 con 0x55a103e29f90 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c00b1d0 con 0x55a103de1ae0 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c00b840 con 0x55a103e29670 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e36b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e36b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37090/0 (socket says 172.21.15.144:37090) 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 -- 172.21.15.144:0/1883986677 learned_addr learned my addr 172.21.15.144:0/1883986677 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f63400640 1 --2- 172.21.15.144:0/1883986677 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1883986677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 0x55a103e40f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 -- 172.21.15.144:0/1883986677 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 msgr2=0x55a103e365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1883986677 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 -- 172.21.15.144:0/1883986677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 msgr2=0x55a103e40f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1883986677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 0x55a103e40f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 -- 172.21.15.144:0/1883986677 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a103ca7320 con 0x55a103e29f90 2024-09-12T12:14:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1883986677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e36b20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000fe0 tx=0x7f8f5401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8c5d28a8425d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f4f400640 1 -- 172.21.15.144:0/1883986677 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f540015d0 con 0x55a103e29f90 2024-09-12T12:14:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f4f400640 1 -- 172.21.15.144:0/1883986677 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f54005110 con 0x55a103e29f90 2024-09-12T12:14:43.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f4f400640 1 -- 172.21.15.144:0/1883986677 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54004820 con 0x55a103e29f90 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- 172.21.15.144:0/1883986677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 msgr2=0x55a103e36b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1883986677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e36b20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000fe0 tx=0x7f8f5401f000 comp rx=0 tx=0).stop 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- 172.21.15.144:0/1883986677 shutdown_connections 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1883986677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e36b20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1883986677 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1883986677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 0x55a103e40f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- 172.21.15.144:0/1883986677 >> 172.21.15.144:0/1883986677 conn(0x55a103e019b0 msgr2=0x55a103dd3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- 172.21.15.144:0/1883986677 shutdown_connections 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- 172.21.15.144:0/1883986677 wait complete. 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- start start 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 Processor -- start 2024-09-12T12:14:43.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 0x55a103e98e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e993d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e99910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a103be4740 con 0x55a103e29f90 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a103bcfb90 con 0x55a103de1ae0 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55a103bcbea0 con 0x55a103e29670 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.596+0000 7f8f6d461000 10 client.0 _ll_register_callbacks cb 0x7f8f500af070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f63400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e99910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f62a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e99910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37106/0 (socket says 172.21.15.144:37106) 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f63400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:38638/0 (socket says 172.21.15.144:38638) 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f62a00640 1 -- 172.21.15.144:0/1614167172 learned_addr learned my addr 172.21.15.144:0/1614167172 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 0x55a103e98e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f63400640 1 -- 172.21.15.144:0/1614167172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 msgr2=0x55a103e98e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f63400640 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 0x55a103e98e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f63400640 1 -- 172.21.15.144:0/1614167172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 msgr2=0x55a103e99910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f63400640 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e99910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f63400640 1 -- 172.21.15.144:0/1614167172 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55a103bb95c0 con 0x55a103e29670 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e99910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f63400640 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e993d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f500ac000 tx=0x7f8f5001ac20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a346cc046cdfb9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 1 -- 172.21.15.144:0/1614167172 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f500b1040 con 0x55a103e29670 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 1 -- 172.21.15.144:0/1614167172 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f8f500aca20 con 0x55a103e29670 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 -- 172.21.15.144:0/1614167172 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f54005110 con 0x55a103e29670 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 1 -- 172.21.15.144:0/1614167172 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8f500acc20 con 0x55a103e29670 2024-09-12T12:14:43.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 10 client.4787 fetch_fsmap learned FSMap version 18 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 -- 172.21.15.144:0/1614167172 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55a103bbd330 con 0x55a103e29670 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 1 -- 172.21.15.144:0/1614167172 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f54005110 con 0x55a103e29670 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 1 -- 172.21.15.144:0/1614167172 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f8f500bf300 con 0x55a103e29670 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 10 client.4787 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 10 client.4787 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 20 client.4787 populate_metadata read hostname 'smithi144' 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x55a103e99e50 0x55a103e9a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 4 client.4787 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 -- 172.21.15.144:0/1614167172 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55a103c333f0 con 0x55a103e99e50 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x55a103e99e50 0x55a103e9a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f62a00640 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x55a103e99e50 0x55a103e9a230 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81aef44683950072 server_cookie=a7e67e937b68ca8d in_seq=0 out_seq=0 2024-09-12T12:14:43.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 10 client.4787 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 1 -- 172.21.15.144:0/1614167172 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17990 (crc 0 0 0) 0x55a103c333f0 con 0x55a103e99e50 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 10 client.4787 handle_command_reply: tid=0 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 client.4787 shutdown 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 -- 172.21.15.144:0/1614167172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 msgr2=0x55a103e993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e993d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f500ac000 tx=0x7f8f5001ac20 comp rx=0 tx=0).stop 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 -- 172.21.15.144:0/1614167172 shutdown_connections 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x55a103e99e50 0x55a103e9a230 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a103e29f90 0x55a103e99910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a103e29670 0x55a103e993d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 --2- 172.21.15.144:0/1614167172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a103de1ae0 0x55a103e98e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f4cc00640 0 client.4787 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 -- 172.21.15.144:0/1614167172 >> 172.21.15.144:0/1614167172 conn(0x55a103e019b0 msgr2=0x55a103dd3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.600+0000 7f8f6d461000 1 -- 172.21.15.144:0/1614167172 shutdown_connections 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6d461000 1 -- 172.21.15.144:0/1614167172 wait complete. 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6d461000 20 client.4787 trim_cache size 0 max 16384 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1126, 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1117, 2024-09-12T12:14:43.609 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 383563, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 14496958, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.153581430, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.075698590, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.037282261, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.034394501, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1117, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.256671635, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000229786 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.610 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000178, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000089 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 118032, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 20224 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1071, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1085, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 269656, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 14614231, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-12T12:14:43.611 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.144383265, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.076086603, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.026450547, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.035995320, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1084, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.247288122, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000228125 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 110112 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 29772, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 52074, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 10857939, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 76771962, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 4.793370910, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 2.834939458, 2024-09-12T12:14:43.613 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 2.883908295, 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.092704787, 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 52073, 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.612886031, 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000030973 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 72856, 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.015917261, 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000218 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:14:43.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1394, 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 16.442490385, 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.011795186 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.615 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2093, 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.830847812, 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000396965 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 25912, 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 25912, 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 25912, 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 295.389475075, 2024-09-12T12:14:43.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.011399717 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 12, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 19873, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 19873, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 19872, 2024-09-12T12:14:43.617 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 148, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 148, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 47211, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 46643, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 107, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-12T12:14:43.618 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:14:43.619 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 1068, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 4034, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 3305, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 2609, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 58, 2024-09-12T12:14:43.620 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 14162 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 1686, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 4181, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 1854, 2024-09-12T12:14:43.621 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 2235, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-12T12:14:43.622 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 24601, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 24601, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 35, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-12T12:14:43.623 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 35, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 4, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 89447651, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2679, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 86.850379577, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.032418954 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.624 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 2014, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 2014, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 0, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 13, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 13, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 0, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 19873, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 19874, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 1, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 148, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 7798, 2024-09-12T12:14:43.625 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 7650, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 112760, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 231732 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 28889, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 25912, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 4, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2000, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.932551509, 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000966275 2024-09-12T12:14:43.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 24, 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.003444656, 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000143527 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 6000, 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 6.670746681, 2024-09-12T12:14:43.627 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001111791 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 7639, 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 5.136470739, 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000672400 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.628 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.629 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000084993, 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000084993 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.002888885, 2024-09-12T12:14:43.630 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002888885 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.361998173, 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.361998173 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:14:43.631 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000116305, 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000116305 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8, 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.565030099, 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.070628762 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2235, 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 262.130575039, 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.117284373 2024-09-12T12:14:43.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.633 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.023406194, 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.023406194 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-12T12:14:43.634 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000284687, 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000284687 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-12T12:14:43.636 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8000, 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 18.561877115, 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002320234 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.637 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 1, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 0, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 18499, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 18499, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 51, 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-12T12:14:43.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:14:43.639 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:14:43.640 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 18421912, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 4699, 2024-09-12T12:14:43.641 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 5520, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 78, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-12T12:14:43.642 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 20677457, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 807870, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 4786, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 85540911, 2024-09-12T12:14:43.643 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 37, 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 4786, 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4786, 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 25.711730680, 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.005372279 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4786, 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 4886 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 4786, 2024-09-12T12:14:43.644 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 55, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 4731, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 11, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 55, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 2734, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 34, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-12T12:14:43.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 1540, 2024-09-12T12:14:43.647 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 346, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 22, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:14:43.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-12T12:14:43.649 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 41, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 3, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 8, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 8, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 112, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 0, 2024-09-12T12:14:43.650 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 32 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 32, 2024-09-12T12:14:43.651 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 32, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 1854, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 1854, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 31961, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 8628662, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 31961, 2024-09-12T12:14:43.652 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 31961, 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 8628662, 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-12T12:14:43.653 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 4786, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 85740485, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 4786, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 85740485, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 4786, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 4786, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 4786, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 4786, 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:14:43.655 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 1854, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 199574, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 1854, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:14:43.656 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 55, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 199574, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x555ee4c8e780": { 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 190388, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 24601, 2024-09-12T12:14:43.657 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 85253347, 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 24601, 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2679, 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 85062959, 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:43.658 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 -- 172.21.15.144:0/3453141695 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f44067990 msgr2=0x7f8f44069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f44067990 0x7f8f44069e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c004b20 tx=0x7f8f5c004a50 comp rx=0 tx=0).stop 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 -- 172.21.15.144:0/3453141695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f6415e5c0 msgr2=0x7f8f6414e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f6415e5c0 0x7f8f6414e390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c007a70 tx=0x7f8f5c007f30 comp rx=0 tx=0).stop 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 -- 172.21.15.144:0/3453141695 shutdown_connections 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f44067990 0x7f8f44069e50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f6415e5c0 0x7f8f6414e390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f640b3830 0x7f8f6414ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 --2- 172.21.15.144:0/3453141695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f6406c320 0x7f8f6415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 -- 172.21.15.144:0/3453141695 >> 172.21.15.144:0/3453141695 conn(0x7f8f64067e00 msgr2=0x7f8f640b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 -- 172.21.15.144:0/3453141695 shutdown_connections 2024-09-12T12:14:43.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.604+0000 7f8f6a000640 1 -- 172.21.15.144:0/3453141695 wait complete. 2024-09-12T12:14:43.662 INFO:tasks.cephfs.test_scrub_checks:num of strays: 1686 2024-09-12T12:14:43.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:14:43.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-09-12T12:14:43.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.800+0000 7f1ced800640 1 Processor -- start 2024-09-12T12:14:43.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.800+0000 7f1ced800640 1 -- start start 2024-09-12T12:14:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ced800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1ce8073a70 0x7f1ce806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ced800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce806cd20 con 0x7f1ce806cff0 2024-09-12T12:14:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ced800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce8072780 con 0x7f1ce8156c10 2024-09-12T12:14:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ced800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce806d990 con 0x7f1ce8073a70 2024-09-12T12:14:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1cdfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1ce806cff0 0x7f1ce8073360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43582/0 (socket says 172.21.15.144:43582) 2024-09-12T12:14:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1cdfe00640 1 -- 172.21.15.144:0/1848964528 learned_addr learned my addr 172.21.15.144:0/1848964528 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:14:43.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ce7400640 1 --2- 172.21.15.144:0/1848964528 >> v2:172.21.15.165:3300/0 conn(0x7f1ce8073a70 0x7f1ce806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ce6000640 1 -- 172.21.15.144:0/1848964528 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2230827306 0 0) 0x7f1ce806cd20 con 0x7f1ce806cff0 2024-09-12T12:14:43.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ce6000640 1 -- 172.21.15.144:0/1848964528 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ccc003530 con 0x7f1ce806cff0 2024-09-12T12:14:43.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ce7400640 1 -- 172.21.15.144:0/1848964528 >> v1:172.21.15.165:6789/0 conn(0x7f1ce8156c10 legacy=0x7f1ce8072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ce7400640 1 -- 172.21.15.144:0/1848964528 >> v1:172.21.15.144:6789/0 conn(0x7f1ce806cff0 legacy=0x7f1ce8073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.804+0000 7f1ce7400640 1 -- 172.21.15.144:0/1848964528 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce80712b0 con 0x7f1ce8073a70 2024-09-12T12:14:43.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ce7400640 1 --2- 172.21.15.144:0/1848964528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce8073a70 0x7f1ce806d450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009d90 tx=0x7f1ce001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57b046e78d3e55f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ce6000640 1 -- 172.21.15.144:0/1848964528 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00b2070 con 0x7f1ce8073a70 2024-09-12T12:14:43.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ce6000640 1 -- 172.21.15.144:0/1848964528 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce00a5940 con 0x7f1ce8073a70 2024-09-12T12:14:43.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ce6000640 1 -- 172.21.15.144:0/1848964528 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00a5d10 con 0x7f1ce8073a70 2024-09-12T12:14:43.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ced800640 1 -- 172.21.15.144:0/1848964528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce8073a70 msgr2=0x7f1ce806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ced800640 1 --2- 172.21.15.144:0/1848964528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce8073a70 0x7f1ce806d450 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009d90 tx=0x7f1ce001c970 comp rx=0 tx=0).stop 2024-09-12T12:14:43.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ced800640 1 -- 172.21.15.144:0/1848964528 shutdown_connections 2024-09-12T12:14:43.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ced800640 1 --2- 172.21.15.144:0/1848964528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce8073a70 0x7f1ce806d450 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ced800640 1 -- 172.21.15.144:0/1848964528 >> 172.21.15.144:0/1848964528 conn(0x7f1ce806bc10 msgr2=0x7f1ce806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ced800640 1 -- 172.21.15.144:0/1848964528 shutdown_connections 2024-09-12T12:14:43.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ced800640 1 -- 172.21.15.144:0/1848964528 wait complete. 2024-09-12T12:14:43.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ced800640 1 Processor -- start 2024-09-12T12:14:43.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.808+0000 7f1ced800640 1 -- start start 2024-09-12T12:14:43.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ced800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce806cff0 0x7f1ce814af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ced800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8073a70 0x7f1ce8144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ced800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce8156c10 0x7f1ce8142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ced800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8157170 con 0x7f1ce8073a70 2024-09-12T12:14:43.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ced800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8156ff0 con 0x7f1ce806cff0 2024-09-12T12:14:43.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ced800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce816a670 con 0x7f1ce8156c10 2024-09-12T12:14:43.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8073a70 0x7f1ce8144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8073a70 0x7f1ce8144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37122/0 (socket says 172.21.15.144:37122) 2024-09-12T12:14:43.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdfe00640 1 -- 172.21.15.144:0/2996634955 learned_addr learned my addr 172.21.15.144:0/2996634955 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ce7400640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce8156c10 0x7f1ce8142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce806cff0 0x7f1ce814af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdfe00640 1 -- 172.21.15.144:0/2996634955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce8156c10 msgr2=0x7f1ce8142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdfe00640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce8156c10 0x7f1ce8142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdfe00640 1 -- 172.21.15.144:0/2996634955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce806cff0 msgr2=0x7f1ce814af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdfe00640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce806cff0 0x7f1ce814af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdfe00640 1 -- 172.21.15.144:0/2996634955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce814b470 con 0x7f1ce8073a70 2024-09-12T12:14:43.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ce7400640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce8156c10 0x7f1ce8142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:14:43.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdfe00640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8073a70 0x7f1ce8144b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c420 tx=0x7f1cd000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdea00640 1 -- 172.21.15.144:0/2996634955 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0017070 con 0x7f1ce8073a70 2024-09-12T12:14:43.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdea00640 1 -- 172.21.15.144:0/2996634955 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd0005cf0 con 0x7f1ce8073a70 2024-09-12T12:14:43.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ced800640 1 -- 172.21.15.144:0/2996634955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce8157990 con 0x7f1ce8073a70 2024-09-12T12:14:43.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdea00640 1 -- 172.21.15.144:0/2996634955 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00072d0 con 0x7f1ce8073a70 2024-09-12T12:14:43.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1ced800640 1 -- 172.21.15.144:0/2996634955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce81581d0 con 0x7f1ce8073a70 2024-09-12T12:14:43.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.812+0000 7f1cdea00640 1 -- 172.21.15.144:0/2996634955 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1cd001a070 con 0x7f1ce8073a70 2024-09-12T12:14:43.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cdea00640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678c0 0x7f1cc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cdea00640 1 -- 172.21.15.144:0/2996634955 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f1cd00851c0 con 0x7f1ce8073a70 2024-09-12T12:14:43.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678c0 0x7f1cc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 Processor -- start 2024-09-12T12:14:43.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 -- start start 2024-09-12T12:14:43.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678c0 0x7f1cc4069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ce814acf0 tx=0x7f1cd8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d22a70 0x565469d22e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469cd6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469cd6a60 0x565469cd6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565469b22b50 con 0x565469d22a70 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565469ac8300 con 0x565469cd6a60 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x565469b1eb10 con 0x565469d23390 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d22a70 0x565469d22e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d22a70 0x565469d22e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37134/0 (socket says 172.21.15.144:37134) 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 -- 172.21.15.144:0/1574638344 learned_addr learned my addr 172.21.15.144:0/1574638344 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cdfe00640 1 --2- 172.21.15.144:0/1574638344 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469cd6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce7400640 1 --2- 172.21.15.144:0/1574638344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469cd6a60 0x565469cd6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 -- 172.21.15.144:0/1574638344 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 msgr2=0x565469cd6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/1574638344 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469cd6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 -- 172.21.15.144:0/1574638344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469cd6a60 msgr2=0x565469cd6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/1574638344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469cd6a60 0x565469cd6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 -- 172.21.15.144:0/1574638344 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565469acbb80 con 0x565469d22a70 2024-09-12T12:14:43.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/1574638344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d22a70 0x565469d22e50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800fb70 tx=0x7f1cd8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7d935b88b73a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cd7400640 1 -- 172.21.15.144:0/1574638344 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8025070 con 0x565469d22a70 2024-09-12T12:14:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cd7400640 1 -- 172.21.15.144:0/1574638344 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd801b050 con 0x565469d22a70 2024-09-12T12:14:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cd7400640 1 -- 172.21.15.144:0/1574638344 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8014de0 con 0x565469d22a70 2024-09-12T12:14:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 -- 172.21.15.144:0/1574638344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d22a70 msgr2=0x565469d22e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.816+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/1574638344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d22a70 0x565469d22e50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800fb70 tx=0x7f1cd8012000 comp rx=0 tx=0).stop 2024-09-12T12:14:43.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- 172.21.15.144:0/1574638344 shutdown_connections 2024-09-12T12:14:43.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/1574638344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469cd6a60 0x565469cd6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/1574638344 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469cd6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/1574638344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d22a70 0x565469d22e50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- 172.21.15.144:0/1574638344 >> 172.21.15.144:0/1574638344 conn(0x565469cff420 msgr2=0x565469d01810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- 172.21.15.144:0/1574638344 shutdown_connections 2024-09-12T12:14:43.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- 172.21.15.144:0/1574638344 wait complete. 2024-09-12T12:14:43.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- start start 2024-09-12T12:14:43.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 Processor -- start 2024-09-12T12:14:43.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469cd6a60 0x565469ce0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469ce05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d23390 0x565469ce0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565469abc250 con 0x565469d23390 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565469aedfb0 con 0x565469d22a70 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x565469ac9de0 con 0x565469cd6a60 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 10 client.0 _ll_register_callbacks cb 0x565469cbfb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d23390 0x565469ce0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469cd6a60 0x565469ce0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d23390 0x565469ce0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37140/0 (socket says 172.21.15.144:37140) 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce7400640 1 -- 172.21.15.144:0/3608414750 learned_addr learned my addr 172.21.15.144:0/3608414750 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cdfe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469ce05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce6a00640 1 -- 172.21.15.144:0/3608414750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 msgr2=0x565469ce05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469ce05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce6a00640 1 -- 172.21.15.144:0/3608414750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d23390 msgr2=0x565469ce0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d23390 0x565469ce0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce6a00640 1 -- 172.21.15.144:0/3608414750 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x565469b2b7c0 con 0x565469cd6a60 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce7400640 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d23390 0x565469ce0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469cd6a60 0x565469ce0060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800fb40 tx=0x7f1cd8001130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6d784b3e337e4e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ccbe00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ccbe00640 1 -- 172.21.15.144:0/3608414750 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd802f020 con 0x565469cd6a60 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ccbe00640 1 -- 172.21.15.144:0/3608414750 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f1cd8020a40 con 0x565469cd6a60 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3608414750 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd801b050 con 0x565469cd6a60 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ccbe00640 1 -- 172.21.15.144:0/3608414750 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1cd8025040 con 0x565469cd6a60 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 10 client.4796 fetch_fsmap learned FSMap version 18 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3608414750 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x565469acc9a0 con 0x565469cd6a60 2024-09-12T12:14:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.820+0000 7f1ccbe00640 1 -- 172.21.15.144:0/3608414750 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd801b050 con 0x565469cd6a60 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1ccbe00640 1 -- 172.21.15.144:0/3608414750 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f1cd803c020 con 0x565469cd6a60 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 10 client.4796 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 10 client.4796 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 20 client.4796 populate_metadata read hostname 'smithi144' 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x565469d31d10 0x565469d34100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 4 client.4796 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3608414750 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565469abcb80 con 0x565469d31d10 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cdfe00640 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x565469d31d10 0x565469d34100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cdfe00640 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x565469d31d10 0x565469d34100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56db7dd0ecd5b11b server_cookie=fc99659a035901c1 in_seq=0 out_seq=0 2024-09-12T12:14:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1ccbe00640 10 client.4796 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1ccbe00640 1 -- 172.21.15.144:0/3608414750 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565469abcb80 con 0x565469d31d10 2024-09-12T12:14:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1ccbe00640 10 client.4796 handle_command_reply: tid=0 2024-09-12T12:14:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 client.4796 shutdown 2024-09-12T12:14:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3608414750 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469cd6a60 msgr2=0x565469ce0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469cd6a60 0x565469ce0060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800fb40 tx=0x7f1cd8001130 comp rx=0 tx=0).stop 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3608414750 shutdown_connections 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x565469d31d10 0x565469d34100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469d23390 0x565469ce0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469ce05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1ccbe00640 0 client.4796 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3608414750 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469cd6a60 0x565469ce0060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3608414750 >> 172.21.15.144:0/3608414750 conn(0x565469cff420 msgr2=0x565469cd1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3608414750 shutdown_connections 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3608414750 wait complete. 2024-09-12T12:14:43.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.824+0000 7f1cf0b00000 20 client.4796 trim_cache size 0 max 16384 2024-09-12T12:14:43.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cf0b00000 1 Processor -- start 2024-09-12T12:14:43.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cf0b00000 1 -- start start 2024-09-12T12:14:43.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d36e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469d373a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469d35110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce80b4a80 con 0x565469cd6a60 2024-09-12T12:14:43.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8149ff0 con 0x565469d22a70 2024-09-12T12:14:43.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce81592e0 con 0x565469d23390 2024-09-12T12:14:43.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1ce6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d36e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1ce6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d36e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37154/0 (socket says 172.21.15.144:37154) 2024-09-12T12:14:43.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1ce6a00640 1 -- 172.21.15.144:0/3216550448 learned_addr learned my addr 172.21.15.144:0/3216550448 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1ce6a00640 1 -- 172.21.15.144:0/3216550448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 msgr2=0x565469d35110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/3216550448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469d35110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1ce6a00640 1 -- 172.21.15.144:0/3216550448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 msgr2=0x565469d373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/3216550448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469d373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1ce6a00640 1 -- 172.21.15.144:0/3216550448 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565469ac8550 con 0x565469cd6a60 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/3216550448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d36e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8007d60 tx=0x7f1cd8029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3de13e342624204 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cd6a00640 1 -- 172.21.15.144:0/3216550448 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd802f030 con 0x565469cd6a60 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cd6a00640 1 -- 172.21.15.144:0/3216550448 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd801b030 con 0x565469cd6a60 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.844+0000 7f1cd6a00640 1 -- 172.21.15.144:0/3216550448 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80343f0 con 0x565469cd6a60 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3216550448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 msgr2=0x565469d36e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3216550448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d36e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8007d60 tx=0x7f1cd8029000 comp rx=0 tx=0).stop 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3216550448 shutdown_connections 2024-09-12T12:14:43.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3216550448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469d35110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3216550448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469d373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/3216550448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d36e60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3216550448 >> 172.21.15.144:0/3216550448 conn(0x565469cff420 msgr2=0x565469cfec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3216550448 shutdown_connections 2024-09-12T12:14:43.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- 172.21.15.144:0/3216550448 wait complete. 2024-09-12T12:14:43.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- start start 2024-09-12T12:14:43.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 Processor -- start 2024-09-12T12:14:43.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d96870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469d96db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469d972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565469aa78a0 con 0x565469cd6a60 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565469acebc0 con 0x565469d22a70 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x565469ab9880 con 0x565469d23390 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 10 client.0 _ll_register_callbacks cb 0x7f1cd8023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d96870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d96870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37156/0 (socket says 172.21.15.144:37156) 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce6a00640 1 -- 172.21.15.144:0/132210370 learned_addr learned my addr 172.21.15.144:0/132210370 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce7400640 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469d972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cdfe00640 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469d96db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce6a00640 1 -- 172.21.15.144:0/132210370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 msgr2=0x565469d972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469d972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce6a00640 1 -- 172.21.15.144:0/132210370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 msgr2=0x565469d96db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469d96db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce6a00640 1 -- 172.21.15.144:0/132210370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565469ac2560 con 0x565469cd6a60 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ce6a00640 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d96870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800f610 tx=0x7f1cd800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c62ec90b3c10b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ccbe00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ccbe00640 1 -- 172.21.15.144:0/132210370 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8034800 con 0x565469cd6a60 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ccbe00640 1 -- 172.21.15.144:0/132210370 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f1cd80349a0 con 0x565469cd6a60 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- 172.21.15.144:0/132210370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd801b030 con 0x565469cd6a60 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ccbe00640 1 -- 172.21.15.144:0/132210370 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1cd802b470 con 0x565469cd6a60 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 10 client.5082 fetch_fsmap learned FSMap version 18 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1cf0b00000 1 -- 172.21.15.144:0/132210370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x565469aba2e0 con 0x565469cd6a60 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.848+0000 7f1ccbe00640 1 -- 172.21.15.144:0/132210370 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd801b030 con 0x565469cd6a60 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1ccbe00640 1 -- 172.21.15.144:0/132210370 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f1cd803c070 con 0x565469cd6a60 2024-09-12T12:14:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1cf0b00000 10 client.5082 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:14:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1cf0b00000 10 client.5082 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:14:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1cf0b00000 20 client.5082 populate_metadata read hostname 'smithi144' 2024-09-12T12:14:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x565469d51ce0 0x565469d520f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1cf0b00000 4 client.5082 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-09-12T12:14:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1cf0b00000 1 -- 172.21.15.144:0/132210370 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x565469b30280 con 0x565469d51ce0 2024-09-12T12:14:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1cdfe00640 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x565469d51ce0 0x565469d520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1ccbe00640 10 client.5082 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.852+0000 7f1cdfe00640 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x565469d51ce0 0x565469d520f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e96a51aee09f26d server_cookie=a23052d11c5b96f8 in_seq=0 out_seq=0 2024-09-12T12:14:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ccbe00640 1 -- 172.21.15.144:0/132210370 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x565469b30280 con 0x565469d51ce0 2024-09-12T12:14:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ccbe00640 10 client.5082 handle_command_reply: tid=0 2024-09-12T12:14:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 client.5082 shutdown 2024-09-12T12:14:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 -- 172.21.15.144:0/132210370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 msgr2=0x565469d96870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d96870 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800f610 tx=0x7f1cd800a000 comp rx=0 tx=0).stop 2024-09-12T12:14:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 -- 172.21.15.144:0/132210370 shutdown_connections 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565469d23390 0x565469d972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565469d22a70 0x565469d96db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x565469d51ce0 0x565469d520f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 --2- 172.21.15.144:0/132210370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565469cd6a60 0x565469d96870 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ccbe00640 0 client.5082 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 -- 172.21.15.144:0/132210370 >> 172.21.15.144:0/132210370 conn(0x565469cff420 msgr2=0x565469d34100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 -- 172.21.15.144:0/132210370 shutdown_connections 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 1 -- 172.21.15.144:0/132210370 wait complete. 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1cf0b00000 20 client.5082 trim_cache size 0 max 16384 2024-09-12T12:14:43.859 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:14:43.860 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:14:43.860 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "1f82e23f-92fc-4fea-877c-392b9cceee0f", 2024-09-12T12:14:43.860 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:14:43.860 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:14:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 -- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678c0 msgr2=0x7f1cc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678c0 0x7f1cc4069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1ce814acf0 tx=0x7f1cd8009040 comp rx=0 tx=0).stop 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 -- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8073a70 msgr2=0x7f1ce8144b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8073a70 0x7f1ce8144b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c420 tx=0x7f1cd000c8e0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 -- 172.21.15.144:0/2996634955 shutdown_connections 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cc40678c0 0x7f1cc4069d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce8156c10 0x7f1ce8142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce8073a70 0x7f1ce8144b10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 --2- 172.21.15.144:0/2996634955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce806cff0 0x7f1ce814af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 -- 172.21.15.144:0/2996634955 >> 172.21.15.144:0/2996634955 conn(0x7f1ce806bc10 msgr2=0x7f1ce806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 -- 172.21.15.144:0/2996634955 shutdown_connections 2024-09-12T12:14:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:43.856+0000 7f1ced800640 1 -- 172.21.15.144:0/2996634955 wait complete. 2024-09-12T12:14:43.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:14:43.881 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-12T12:14:44.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.064+0000 7fc7a7c00640 1 Processor -- start 2024-09-12T12:14:44.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.064+0000 7fc7a7c00640 1 -- start start 2024-09-12T12:14:44.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.064+0000 7fc7a7c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc7a006ea70 0x7fc7a00b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.064+0000 7fc7a7c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a006d730 con 0x7fc7a00b7220 2024-09-12T12:14:44.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.064+0000 7fc7a7c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a006d9d0 con 0x7fc7a015e570 2024-09-12T12:14:44.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.064+0000 7fc7a7c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a0073550 con 0x7fc7a006ea70 2024-09-12T12:14:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.068+0000 7fc7a5200640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fc7a015e570 0x7fc7a0073ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:41918/0 (socket says 172.21.15.144:41918) 2024-09-12T12:14:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.068+0000 7fc7a5200640 1 -- 172.21.15.144:0/903732127 learned_addr learned my addr 172.21.15.144:0/903732127 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:14:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.068+0000 7fc7a5c00640 1 --1- 172.21.15.144:0/903732127 >> v1:172.21.15.144:6789/0 conn(0x7fc7a00b7220 0x7fc7a00cb8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43596/0 (socket says 172.21.15.144:43596) 2024-09-12T12:14:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.068+0000 7fc79fe00640 1 --2- 172.21.15.144:0/903732127 >> v2:172.21.15.165:3300/0 conn(0x7fc7a006ea70 0x7fc7a00b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.068+0000 7fc79fe00640 1 -- 172.21.15.144:0/903732127 >> v1:172.21.15.165:6789/0 conn(0x7fc7a015e570 legacy=0x7fc7a0073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.068+0000 7fc79fe00640 1 -- 172.21.15.144:0/903732127 >> v1:172.21.15.144:6789/0 conn(0x7fc7a00b7220 legacy=0x7fc7a00cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.068+0000 7fc79f400640 1 -- 172.21.15.144:0/903732127 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 36383333 0 0) 0x7fc7a006d730 con 0x7fc7a00b7220 2024-09-12T12:14:44.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.068+0000 7fc79fe00640 1 -- 172.21.15.144:0/903732127 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a006dcb0 con 0x7fc7a006ea70 2024-09-12T12:14:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc79fe00640 1 --2- 172.21.15.144:0/903732127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 0x7fc7a00b6ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0097c0 tx=0x7fc78c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed3dbcc62b75a8b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc79f400640 1 -- 172.21.15.144:0/903732127 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0b0070 con 0x7fc7a006ea70 2024-09-12T12:14:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc79f400640 1 -- 172.21.15.144:0/903732127 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78c0ab600 con 0x7fc7a006ea70 2024-09-12T12:14:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc79f400640 1 -- 172.21.15.144:0/903732127 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0ab9d0 con 0x7fc7a006ea70 2024-09-12T12:14:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc7a7c00640 1 -- 172.21.15.144:0/903732127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 msgr2=0x7fc7a00b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc7a7c00640 1 --2- 172.21.15.144:0/903732127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 0x7fc7a00b6ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0097c0 tx=0x7fc78c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc7a7c00640 1 -- 172.21.15.144:0/903732127 shutdown_connections 2024-09-12T12:14:44.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc7a7c00640 1 --2- 172.21.15.144:0/903732127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 0x7fc7a00b6ce0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc7a7c00640 1 -- 172.21.15.144:0/903732127 >> 172.21.15.144:0/903732127 conn(0x7fc7a006c010 msgr2=0x7fc7a0067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:44.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc7a7c00640 1 -- 172.21.15.144:0/903732127 shutdown_connections 2024-09-12T12:14:44.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.072+0000 7fc7a7c00640 1 -- 172.21.15.144:0/903732127 wait complete. 2024-09-12T12:14:44.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a7c00640 1 Processor -- start 2024-09-12T12:14:44.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a7c00640 1 -- start start 2024-09-12T12:14:44.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a7c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 0x7fc7a00d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a7c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a00b7220 0x7fc7a00cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a7c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7a015e570 0x7fc7a01478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a7c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a016c0d0 con 0x7fc7a00b7220 2024-09-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a7c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a00741e0 con 0x7fc7a006ea70 2024-09-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a7c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a016c250 con 0x7fc7a015e570 2024-09-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 0x7fc7a00d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 0x7fc7a00d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43604/0 (socket says 172.21.15.144:43604) 2024-09-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5200640 1 -- 172.21.15.144:0/1001169243 learned_addr learned my addr 172.21.15.144:0/1001169243 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5c00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7a015e570 0x7fc7a01478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc79fe00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a00b7220 0x7fc7a00cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5200640 1 -- 172.21.15.144:0/1001169243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7a015e570 msgr2=0x7fc7a01478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5200640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7a015e570 0x7fc7a01478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5200640 1 -- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a00b7220 msgr2=0x7fc7a00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5200640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a00b7220 0x7fc7a00cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5200640 1 -- 172.21.15.144:0/1001169243 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a00cff90 con 0x7fc7a006ea70 2024-09-12T12:14:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc7a5200640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 0x7fc7a00d1cd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc79400c400 tx=0x7fc79400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc79cc00640 1 -- 172.21.15.144:0/1001169243 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc794017070 con 0x7fc7a006ea70 2024-09-12T12:14:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc79cc00640 1 -- 172.21.15.144:0/1001169243 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc794005cf0 con 0x7fc7a006ea70 2024-09-12T12:14:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.076+0000 7fc79cc00640 1 -- 172.21.15.144:0/1001169243 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7940072d0 con 0x7fc7a006ea70 2024-09-12T12:14:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.080+0000 7fc7a7c00640 1 -- 172.21.15.144:0/1001169243 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a00d0270 con 0x7fc7a006ea70 2024-09-12T12:14:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.080+0000 7fc7a7c00640 1 -- 172.21.15.144:0/1001169243 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a00d0830 con 0x7fc7a006ea70 2024-09-12T12:14:44.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.080+0000 7fc79cc00640 1 -- 172.21.15.144:0/1001169243 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc79401a070 con 0x7fc7a006ea70 2024-09-12T12:14:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.080+0000 7fc79cc00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc780067910 0x7fc780069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.080+0000 7fc79cc00640 1 -- 172.21.15.144:0/1001169243 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fc7940850c0 con 0x7fc7a006ea70 2024-09-12T12:14:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc79fe00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc780067910 0x7fc780069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc79fe00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc780067910 0x7fc780069dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0ad000 tx=0x7fc78c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:44.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7ab0c7000 1 Processor -- start 2024-09-12T12:14:44.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7ab0c7000 1 -- start start 2024-09-12T12:14:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c92d70 0x5646d8c93150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c46870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c47190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c92d70 0x5646d8c93150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c92d70 0x5646d8c93150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:38694/0 (socket says 172.21.15.144:38694) 2024-09-12T12:14:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc79fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c46870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc79fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c46870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43614/0 (socket says 172.21.15.144:43614) 2024-09-12T12:14:44.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5200640 1 -- 172.21.15.144:0/3031874205 learned_addr learned my addr 172.21.15.144:0/3031874205 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:44.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3031874205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5646d8b30960 con 0x5646d8c46db0 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3031874205 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5646d8a74900 con 0x5646d8c93690 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3031874205 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5646d8a97d40 con 0x5646d8c92d70 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5c00640 1 --2- 172.21.15.144:0/3031874205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c47190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5200640 1 -- 172.21.15.144:0/3031874205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 msgr2=0x5646d8c46870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5200640 1 --2- 172.21.15.144:0/3031874205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c46870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5200640 1 -- 172.21.15.144:0/3031874205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 msgr2=0x5646d8c47190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5200640 1 --2- 172.21.15.144:0/3031874205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c47190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5200640 1 -- 172.21.15.144:0/3031874205 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d8a3e580 con 0x5646d8c92d70 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.084+0000 7fc7a5c00640 1 --2- 172.21.15.144:0/3031874205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c47190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7a5200640 1 --2- 172.21.15.144:0/3031874205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c92d70 0x5646d8c93150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7940070a0 tx=0x7fc794055470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0e22fd55fded6d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc791600640 1 -- 172.21.15.144:0/3031874205 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79406d070 con 0x5646d8c92d70 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc791600640 1 -- 172.21.15.144:0/3031874205 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc794053770 con 0x5646d8c92d70 2024-09-12T12:14:44.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc791600640 1 -- 172.21.15.144:0/3031874205 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79406d210 con 0x5646d8c92d70 2024-09-12T12:14:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3031874205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c92d70 msgr2=0x5646d8c93150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/3031874205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c92d70 0x5646d8c93150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7940070a0 tx=0x7fc794055470 comp rx=0 tx=0).stop 2024-09-12T12:14:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3031874205 shutdown_connections 2024-09-12T12:14:44.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/3031874205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c47190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/3031874205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c46870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/3031874205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c92d70 0x5646d8c93150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3031874205 >> 172.21.15.144:0/3031874205 conn(0x5646d8c74040 msgr2=0x5646d8c76430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3031874205 shutdown_connections 2024-09-12T12:14:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3031874205 wait complete. 2024-09-12T12:14:44.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 -- start start 2024-09-12T12:14:44.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.088+0000 7fc7ab0c7000 1 Processor -- start 2024-09-12T12:14:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 0x5646d8c99ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c92d70 0x5646d8c9a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c93690 0x5646d8c9a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5646d8a93d00 con 0x5646d8c93690 2024-09-12T12:14:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5646d8a52aa0 con 0x5646d8c92d70 2024-09-12T12:14:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5646d8a31340 con 0x5646d8c46db0 2024-09-12T12:14:44.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 10 client.0 _ll_register_callbacks cb 0x5646d8c34760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc79fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c92d70 0x5646d8c9a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc79fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c92d70 0x5646d8c9a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43618/0 (socket says 172.21.15.144:43618) 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc79fe00640 1 -- 172.21.15.144:0/2554980250 learned_addr learned my addr 172.21.15.144:0/2554980250 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7a5200640 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 0x5646d8c99ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7a5c00640 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c93690 0x5646d8c9a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc79fe00640 1 -- 172.21.15.144:0/2554980250 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 msgr2=0x5646d8c99ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc79fe00640 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 0x5646d8c99ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc79fe00640 1 -- 172.21.15.144:0/2554980250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c93690 msgr2=0x5646d8c9a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc79fe00640 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c93690 0x5646d8c9a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc79fe00640 1 -- 172.21.15.144:0/2554980250 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d8a3adc0 con 0x5646d8c92d70 2024-09-12T12:14:44.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc79fe00640 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c92d70 0x5646d8c9a220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009580 tx=0x7fc78c01ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b31aafd9edb627ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:44.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc786000640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:14:44.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc786000640 1 -- 172.21.15.144:0/2554980250 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0b0040 con 0x5646d8c92d70 2024-09-12T12:14:44.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc786000640 1 -- 172.21.15.144:0/2554980250 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fc78c0b6b40 con 0x5646d8c92d70 2024-09-12T12:14:44.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2554980250 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc794053770 con 0x5646d8c92d70 2024-09-12T12:14:44.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc786000640 1 -- 172.21.15.144:0/2554980250 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc78c0abe20 con 0x5646d8c92d70 2024-09-12T12:14:44.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 10 client.5032 fetch_fsmap learned FSMap version 18 2024-09-12T12:14:44.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2554980250 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5646d8a377f0 con 0x5646d8c92d70 2024-09-12T12:14:44.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc786000640 1 -- 172.21.15.144:0/2554980250 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc794053770 con 0x5646d8c92d70 2024-09-12T12:14:44.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc786000640 1 -- 172.21.15.144:0/2554980250 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fc78c0c3460 con 0x5646d8c92d70 2024-09-12T12:14:44.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 10 client.5032 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:14:44.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 10 client.5032 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:14:44.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 20 client.5032 populate_metadata read hostname 'smithi144' 2024-09-12T12:14:44.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5646d8ca20b0 0x5646d8ca44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 4 client.5032 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:14:44.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.092+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2554980250 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646d8a31e10 con 0x5646d8ca20b0 2024-09-12T12:14:44.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7a5200640 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5646d8ca20b0 0x5646d8ca44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc786000640 10 client.5032 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:44.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7a5200640 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5646d8ca20b0 0x5646d8ca44a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d488c5096c768b3 server_cookie=36d4cc7ebe28d55 in_seq=0 out_seq=0 2024-09-12T12:14:44.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc786000640 1 -- 172.21.15.144:0/2554980250 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646d8a31e10 con 0x5646d8ca20b0 2024-09-12T12:14:44.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc786000640 10 client.5032 handle_command_reply: tid=0 2024-09-12T12:14:44.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 client.5032 shutdown 2024-09-12T12:14:44.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2554980250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c92d70 msgr2=0x5646d8c9a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c92d70 0x5646d8c9a220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009580 tx=0x7fc78c01ace0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2554980250 shutdown_connections 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5646d8ca20b0 0x5646d8ca44a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c93690 0x5646d8c9a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c92d70 0x5646d8c9a220 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2554980250 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 0x5646d8c99ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2554980250 >> 172.21.15.144:0/2554980250 conn(0x5646d8c74040 msgr2=0x5646d8c45f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc786000640 0 client.5032 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2554980250 shutdown_connections 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2554980250 wait complete. 2024-09-12T12:14:44.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.096+0000 7fc7ab0c7000 20 client.5032 trim_cache size 0 max 16384 2024-09-12T12:14:44.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.128+0000 7fc7ab0c7000 1 Processor -- start 2024-09-12T12:14:44.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.128+0000 7fc7ab0c7000 1 -- start start 2024-09-12T12:14:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c4ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c4f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c9fd30 0x5646d8ca0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a00c8a60 con 0x5646d8c46db0 2024-09-12T12:14:44.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a00c7b00 con 0x5646d8c93690 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a015ac10 con 0x5646d8c9fd30 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c4ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c4ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37196/0 (socket says 172.21.15.144:37196) 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5200640 1 -- 172.21.15.144:0/3632550203 learned_addr learned my addr 172.21.15.144:0/3632550203 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc79fe00640 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c4f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5c00640 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c9fd30 0x5646d8ca0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5200640 1 -- 172.21.15.144:0/3632550203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c9fd30 msgr2=0x5646d8ca0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5200640 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c9fd30 0x5646d8ca0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5200640 1 -- 172.21.15.144:0/3632550203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 msgr2=0x5646d8c4f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5200640 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c4f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5200640 1 -- 172.21.15.144:0/3632550203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d8a55470 con 0x5646d8c46db0 2024-09-12T12:14:44.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc79fe00640 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c4f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7a5200640 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c4ec30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc79405e160 tx=0x7fc79401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8b2c5f63f11594 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc790c00640 1 -- 172.21.15.144:0/3632550203 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79406d040 con 0x5646d8c46db0 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc790c00640 1 -- 172.21.15.144:0/3632550203 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc794053770 con 0x5646d8c46db0 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc790c00640 1 -- 172.21.15.144:0/3632550203 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc794051710 con 0x5646d8c46db0 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3632550203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 msgr2=0x5646d8c4ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c4ec30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc79405e160 tx=0x7fc79401e000 comp rx=0 tx=0).stop 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3632550203 shutdown_connections 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c9fd30 0x5646d8ca0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c4f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/3632550203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c46db0 0x5646d8c4ec30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3632550203 >> 172.21.15.144:0/3632550203 conn(0x5646d8c74040 msgr2=0x5646d8c99aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3632550203 shutdown_connections 2024-09-12T12:14:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/3632550203 wait complete. 2024-09-12T12:14:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 -- start start 2024-09-12T12:14:44.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.132+0000 7fc7ab0c7000 1 Processor -- start 2024-09-12T12:14:44.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 0x5646d8c9f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c9f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c9fd30 0x5646d8cc2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5646d8a567c0 con 0x5646d8c9fd30 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a00c74b0 con 0x5646d8c93690 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5646d8a3df20 con 0x5646d8c46db0 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 10 client.0 _ll_register_callbacks cb 0x7fc78c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c9fd30 0x5646d8cc2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c9fd30 0x5646d8cc2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37198/0 (socket says 172.21.15.144:37198) 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5c00640 1 -- 172.21.15.144:0/2610888743 learned_addr learned my addr 172.21.15.144:0/2610888743 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5200640 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 0x5646d8c9f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc79fe00640 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c9f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5c00640 1 -- 172.21.15.144:0/2610888743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 msgr2=0x5646d8c9f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5c00640 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 0x5646d8c9f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5c00640 1 -- 172.21.15.144:0/2610888743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 msgr2=0x5646d8c9f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5c00640 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c9f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5c00640 1 -- 172.21.15.144:0/2610888743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d8a2b640 con 0x5646d8c9fd30 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5200640 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 0x5646d8c9f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5c00640 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c9fd30 0x5646d8cc2790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc798001f20 tx=0x7fc798007490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7439db1d3582d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc786000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc786000640 1 -- 172.21.15.144:0/2610888743 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798027060 con 0x5646d8c9fd30 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc786000640 1 -- 172.21.15.144:0/2610888743 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fc798022c40 con 0x5646d8c9fd30 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2610888743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc794053770 con 0x5646d8c9fd30 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc786000640 1 -- 172.21.15.144:0/2610888743 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc7980020d0 con 0x5646d8c9fd30 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 10 client.5097 fetch_fsmap learned FSMap version 18 2024-09-12T12:14:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2610888743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5646d8a2f3b0 con 0x5646d8c9fd30 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc786000640 1 -- 172.21.15.144:0/2610888743 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc794053770 con 0x5646d8c9fd30 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc786000640 1 -- 172.21.15.144:0/2610888743 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fc798020540 con 0x5646d8c9fd30 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 10 client.5097 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 10 client.5097 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 20 client.5097 populate_metadata read hostname 'smithi144' 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5646d8d06b10 0x5646d8d06f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 4 client.5097 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2610888743 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5646d8aa5470 con 0x5646d8d06b10 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5200640 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5646d8d06b10 0x5646d8d06f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7a5200640 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5646d8d06b10 0x5646d8d06f20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a1fe2963e2ff01 server_cookie=fccb59faa1d748ff in_seq=0 out_seq=0 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc786000640 10 client.5097 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc786000640 1 -- 172.21.15.144:0/2610888743 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x5646d8aa5470 con 0x5646d8d06b10 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc786000640 10 client.5097 handle_command_reply: tid=0 2024-09-12T12:14:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 client.5097 shutdown 2024-09-12T12:14:44.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2610888743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c9fd30 msgr2=0x5646d8cc2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c9fd30 0x5646d8cc2790 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc798001f20 tx=0x7fc798007490 comp rx=0 tx=0).stop 2024-09-12T12:14:44.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.136+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2610888743 shutdown_connections 2024-09-12T12:14:44.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x5646d8d06b10 0x5646d8d06f20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5646d8c9fd30 0x5646d8cc2790 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5646d8c93690 0x5646d8c9f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7ab0c7000 1 --2- 172.21.15.144:0/2610888743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5646d8c46db0 0x5646d8c9f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc786000640 0 client.5097 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:14:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2610888743 >> 172.21.15.144:0/2610888743 conn(0x5646d8c74040 msgr2=0x5646d8c99aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2610888743 shutdown_connections 2024-09-12T12:14:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7ab0c7000 1 -- 172.21.15.144:0/2610888743 wait complete. 2024-09-12T12:14:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7ab0c7000 20 client.5097 trim_cache size 0 max 16384 2024-09-12T12:14:44.144 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:14:44.145 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:14:44.145 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:14:44.145 INFO:teuthology.orchestra.run.smithi144.stdout: "1f82e23f-92fc-4fea-877c-392b9cceee0f": { 2024-09-12T12:14:44.145 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-09-12T12:14:44.145 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "1f82e23f-92fc-4fea-877c-392b9cceee0f", 2024-09-12T12:14:44.145 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "recursive,scrub_mdsdir" 2024-09-12T12:14:44.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:44.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:14:44.145 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:14:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 -- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc780067910 msgr2=0x7fc780069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc780067910 0x7fc780069dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0ad000 tx=0x7fc78c008040 comp rx=0 tx=0).stop 2024-09-12T12:14:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 -- 172.21.15.144:0/1001169243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 msgr2=0x7fc7a00d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 0x7fc7a00d1cd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc79400c400 tx=0x7fc79400c8c0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 -- 172.21.15.144:0/1001169243 shutdown_connections 2024-09-12T12:14:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc780067910 0x7fc780069dd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7a015e570 0x7fc7a01478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7a00b7220 0x7fc7a00cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 --2- 172.21.15.144:0/1001169243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7a006ea70 0x7fc7a00d1cd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 -- 172.21.15.144:0/1001169243 >> 172.21.15.144:0/1001169243 conn(0x7fc7a006c010 msgr2=0x7fc7a0160b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:44.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 -- 172.21.15.144:0/1001169243 shutdown_connections 2024-09-12T12:14:44.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:14:44.140+0000 7fc7a7c00640 1 -- 172.21.15.144:0/1001169243 wait complete. 2024-09-12T12:14:44.159 INFO:tasks.cephfs.filesystem:scrub status for tag:1f82e23f-92fc-4fea-877c-392b9cceee0f - {'path': '/', 'tag': '1f82e23f-92fc-4fea-877c-392b9cceee0f', 'options': 'recursive,scrub_mdsdir'} 2024-09-12T12:15:12.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:15:12.483 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:15:14.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:14.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-12T12:15:14.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1df5200640 1 Processor -- start 2024-09-12T12:15:14.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1df5200640 1 -- start start 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1df5200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1df00cd9f0 0x7f1df006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1df5200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1df015b340 0x7f1df006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1df5200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1df00b4300 con 0x7f1df015af60 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1df5200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1df00b32f0 con 0x7f1df015b340 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1df5200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1df00b3540 con 0x7f1df00cd9f0 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1dee800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1df015b340 0x7f1df006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1dede00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1df015af60 0x7f1df00ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41560/0 (socket says 172.21.15.144:41560) 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1dede00640 1 -- 172.21.15.144:0/1167431473 learned_addr learned my addr 172.21.15.144:0/1167431473 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1ded400640 1 --2- 172.21.15.144:0/1167431473 >> v2:172.21.15.165:3300/0 conn(0x7f1df00cd9f0 0x7f1df006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1dee800640 1 -- 172.21.15.144:0/1167431473 >> v2:172.21.15.165:3300/0 conn(0x7f1df00cd9f0 msgr2=0x7f1df006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1dee800640 1 --2- 172.21.15.144:0/1167431473 >> v2:172.21.15.165:3300/0 conn(0x7f1df00cd9f0 0x7f1df006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1dee800640 1 -- 172.21.15.144:0/1167431473 >> v1:172.21.15.144:6789/0 conn(0x7f1df015af60 legacy=0x7f1df00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1dee800640 1 -- 172.21.15.144:0/1167431473 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df00b3820 con 0x7f1df015b340 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.307+0000 7f1deca00640 1 -- 172.21.15.144:0/1167431473 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479404444 0 0) 0x7f1df00b4300 con 0x7f1df015af60 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1dee800640 1 --2- 172.21.15.144:0/1167431473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015b340 0x7f1df006c150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1df0070d20 tx=0x7f1de801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a09771dbed2aca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1deca00640 1 -- 172.21.15.144:0/1167431473 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de80b0070 con 0x7f1df015b340 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1deca00640 1 -- 172.21.15.144:0/1167431473 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de80ab600 con 0x7f1df015b340 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1deca00640 1 -- 172.21.15.144:0/1167431473 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de80ab9d0 con 0x7f1df015b340 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1df5200640 1 -- 172.21.15.144:0/1167431473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015b340 msgr2=0x7f1df006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1df5200640 1 --2- 172.21.15.144:0/1167431473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015b340 0x7f1df006c150 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1df0070d20 tx=0x7f1de801c480 comp rx=0 tx=0).stop 2024-09-12T12:15:14.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1df5200640 1 -- 172.21.15.144:0/1167431473 shutdown_connections 2024-09-12T12:15:14.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1df5200640 1 --2- 172.21.15.144:0/1167431473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015b340 0x7f1df006c150 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1df5200640 1 --2- 172.21.15.144:0/1167431473 >> v2:172.21.15.165:3300/0 conn(0x7f1df00cd9f0 0x7f1df006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1df5200640 1 -- 172.21.15.144:0/1167431473 >> 172.21.15.144:0/1167431473 conn(0x7f1df0068030 msgr2=0x7f1df00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1df5200640 1 -- 172.21.15.144:0/1167431473 shutdown_connections 2024-09-12T12:15:14.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.311+0000 7f1df5200640 1 -- 172.21.15.144:0/1167431473 wait complete. 2024-09-12T12:15:14.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 Processor -- start 2024-09-12T12:15:14.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 -- start start 2024-09-12T12:15:14.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df00cd9f0 0x7f1df0072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015af60 0x7f1df0142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df015b340 0x7f1df0158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1df00b5180 con 0x7f1df015af60 2024-09-12T12:15:14.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1df00b5000 con 0x7f1df015b340 2024-09-12T12:15:14.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1df00b5300 con 0x7f1df00cd9f0 2024-09-12T12:15:14.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015af60 0x7f1df0142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015af60 0x7f1df0142d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36098/0 (socket says 172.21.15.144:36098) 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1ded400640 1 -- 172.21.15.144:0/2447976117 learned_addr learned my addr 172.21.15.144:0/2447976117 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1dee800640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df015b340 0x7f1df0158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1dede00640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df00cd9f0 0x7f1df0072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1ded400640 1 -- 172.21.15.144:0/2447976117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df00cd9f0 msgr2=0x7f1df0072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1ded400640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df00cd9f0 0x7f1df0072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1ded400640 1 -- 172.21.15.144:0/2447976117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df015b340 msgr2=0x7f1df0158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1ded400640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df015b340 0x7f1df0158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1ded400640 1 -- 172.21.15.144:0/2447976117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df0159500 con 0x7f1df015af60 2024-09-12T12:15:14.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1ded400640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015af60 0x7f1df0142d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00e930 tx=0x7f1ddc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1de6000640 1 -- 172.21.15.144:0/2447976117 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc017070 con 0x7f1df015af60 2024-09-12T12:15:14.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1de6000640 1 -- 172.21.15.144:0/2447976117 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc00ca00 con 0x7f1df015af60 2024-09-12T12:15:14.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1de6000640 1 -- 172.21.15.144:0/2447976117 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00cdb0 con 0x7f1df015af60 2024-09-12T12:15:14.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 -- 172.21.15.144:0/2447976117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df01597a0 con 0x7f1df015af60 2024-09-12T12:15:14.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.315+0000 7f1df5200640 1 -- 172.21.15.144:0/2447976117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df0159d60 con 0x7f1df015af60 2024-09-12T12:15:14.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.319+0000 7f1de6000640 1 -- 172.21.15.144:0/2447976117 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ddc01a070 con 0x7f1df015af60 2024-09-12T12:15:14.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.319+0000 7f1de6000640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dd00678f0 0x7f1dd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.319+0000 7f1de6000640 1 -- 172.21.15.144:0/2447976117 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f1ddc085d50 con 0x7f1df015af60 2024-09-12T12:15:14.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.319+0000 7f1dede00640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dd00678f0 0x7f1dd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.319+0000 7f1df85b1000 1 Processor -- start 2024-09-12T12:15:14.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- start start 2024-09-12T12:15:14.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1dede00640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dd00678f0 0x7f1dd0069db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1de0004fd0 tx=0x7f1de0001770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d203d70 0x56104d204150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d204690 0x56104d1b7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d1b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56104d0a1960 con 0x56104d204690 2024-09-12T12:15:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56104cfe5900 con 0x56104d1b7db0 2024-09-12T12:15:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56104d008d40 con 0x56104d203d70 2024-09-12T12:15:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d204690 0x56104d1b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d204690 0x56104d1b7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36102/0 (socket says 172.21.15.144:36102) 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ded400640 1 -- 172.21.15.144:0/2622750534 learned_addr learned my addr 172.21.15.144:0/2622750534 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1dede00640 1 --2- 172.21.15.144:0/2622750534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d203d70 0x56104d204150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1dee800640 1 --2- 172.21.15.144:0/2622750534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d1b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ded400640 1 -- 172.21.15.144:0/2622750534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d203d70 msgr2=0x56104d204150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ded400640 1 --2- 172.21.15.144:0/2622750534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d203d70 0x56104d204150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ded400640 1 -- 172.21.15.144:0/2622750534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 msgr2=0x56104d1b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ded400640 1 --2- 172.21.15.144:0/2622750534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d1b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ded400640 1 -- 172.21.15.144:0/2622750534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104cfaf580 con 0x56104d204690 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ded400640 1 --2- 172.21.15.144:0/2622750534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d204690 0x56104d1b7870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0840f0 tx=0x7f1ddc056310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f9343f41c65071 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ddaa00640 1 -- 172.21.15.144:0/2622750534 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc081020 con 0x56104d204690 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ddaa00640 1 -- 172.21.15.144:0/2622750534 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc0544d0 con 0x56104d204690 2024-09-12T12:15:14.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1ddaa00640 1 -- 172.21.15.144:0/2622750534 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc021040 con 0x56104d204690 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- 172.21.15.144:0/2622750534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d204690 msgr2=0x56104d1b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2622750534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d204690 0x56104d1b7870 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0840f0 tx=0x7f1ddc056310 comp rx=0 tx=0).stop 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- 172.21.15.144:0/2622750534 shutdown_connections 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2622750534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d1b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2622750534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d204690 0x56104d1b7870 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2622750534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d203d70 0x56104d204150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- 172.21.15.144:0/2622750534 >> 172.21.15.144:0/2622750534 conn(0x56104d1e5040 msgr2=0x56104d1e7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- 172.21.15.144:0/2622750534 shutdown_connections 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- 172.21.15.144:0/2622750534 wait complete. 2024-09-12T12:15:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 -- start start 2024-09-12T12:15:14.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.323+0000 7f1df85b1000 1 Processor -- start 2024-09-12T12:15:14.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d20ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d20b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 0x56104d20b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56104d004d00 con 0x56104d203d70 2024-09-12T12:15:14.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56104cfc3aa0 con 0x56104d1b7db0 2024-09-12T12:15:14.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56104cfa2340 con 0x56104d204690 2024-09-12T12:15:14.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 10 client.0 _ll_register_callbacks cb 0x56104d1a5760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:14.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d20b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d20b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36110/0 (socket says 172.21.15.144:36110) 2024-09-12T12:15:14.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1ded400640 1 -- 172.21.15.144:0/2128216841 learned_addr learned my addr 172.21.15.144:0/2128216841 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dede00640 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d20ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dee800640 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 0x56104d20b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1ded400640 1 -- 172.21.15.144:0/2128216841 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 msgr2=0x56104d20b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1ded400640 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 0x56104d20b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1ded400640 1 -- 172.21.15.144:0/2128216841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 msgr2=0x56104d20ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1ded400640 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d20ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1ded400640 1 -- 172.21.15.144:0/2128216841 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56104cfabdc0 con 0x56104d203d70 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1ded400640 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d20b220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc05a690 tx=0x7f1ddc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdbfd9fa0608e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dcf400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dcf400640 1 -- 172.21.15.144:0/2128216841 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc081030 con 0x56104d203d70 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dcf400640 1 -- 172.21.15.144:0/2128216841 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f1ddc055830 con 0x56104d203d70 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 -- 172.21.15.144:0/2128216841 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ddc0544d0 con 0x56104d203d70 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dcf400640 1 -- 172.21.15.144:0/2128216841 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1ddc021050 con 0x56104d203d70 2024-09-12T12:15:14.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 10 client.5112 fetch_fsmap learned FSMap version 18 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 -- 172.21.15.144:0/2128216841 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56104cfa87f0 con 0x56104d203d70 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dcf400640 1 -- 172.21.15.144:0/2128216841 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc0544d0 con 0x56104d203d70 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dcf400640 1 -- 172.21.15.144:0/2128216841 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f1ddc024060 con 0x56104d203d70 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 10 client.5112 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 10 client.5112 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 20 client.5112 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x56104d2130b0 0x56104d2154a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 4 client.5112 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 -- 172.21.15.144:0/2128216841 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56104cfa2e10 con 0x56104d2130b0 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dede00640 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x56104d2130b0 0x56104d2154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dcf400640 10 client.5112 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dede00640 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x56104d2130b0 0x56104d2154a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d116a2a485c89803 server_cookie=286739b0805cab43 in_seq=0 out_seq=0 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dcf400640 1 -- 172.21.15.144:0/2128216841 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56104cfa2e10 con 0x56104d2130b0 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1dcf400640 10 client.5112 handle_command_reply: tid=0 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.327+0000 7f1df85b1000 1 client.5112 shutdown 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 -- 172.21.15.144:0/2128216841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 msgr2=0x56104d20b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d20b220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc05a690 tx=0x7f1ddc000bd0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 -- 172.21.15.144:0/2128216841 shutdown_connections 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 0x56104d20b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x56104d2130b0 0x56104d2154a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d20b220 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2128216841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d20ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1dcf400640 0 client.5112 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:15:14.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 -- 172.21.15.144:0/2128216841 >> 172.21.15.144:0/2128216841 conn(0x56104d1e5040 msgr2=0x56104d1b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 -- 172.21.15.144:0/2128216841 shutdown_connections 2024-09-12T12:15:14.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 1 -- 172.21.15.144:0/2128216841 wait complete. 2024-09-12T12:15:14.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.331+0000 7f1df85b1000 20 client.5112 trim_cache size 0 max 16384 2024-09-12T12:15:14.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1df85b1000 1 Processor -- start 2024-09-12T12:15:14.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1df85b1000 1 -- start start 2024-09-12T12:15:14.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d218d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d1bfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 0x56104d1c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1df85b1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0204170 con 0x56104d203d70 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1df85b1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0203150 con 0x56104d1b7db0 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1df85b1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1df014e6c0 con 0x56104d204690 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d1bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1dede00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d218d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d1bfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36114/0 (socket says 172.21.15.144:36114) 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1ded400640 1 -- 172.21.15.144:0/2863648315 learned_addr learned my addr 172.21.15.144:0/2863648315 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.347+0000 7f1dee800640 1 --2- 172.21.15.144:0/2863648315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 0x56104d1c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 -- 172.21.15.144:0/2863648315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 msgr2=0x56104d1c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 --2- 172.21.15.144:0/2863648315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 0x56104d1c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 -- 172.21.15.144:0/2863648315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 msgr2=0x56104d218d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 --2- 172.21.15.144:0/2863648315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d218d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 -- 172.21.15.144:0/2863648315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104d1bd960 con 0x56104d203d70 2024-09-12T12:15:14.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1dede00640 1 --2- 172.21.15.144:0/2863648315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d218d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:14.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 --2- 172.21.15.144:0/2863648315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d1bfc00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc056160 tx=0x7f1ddc083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb56fc802a858d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1dda000640 1 -- 172.21.15.144:0/2863648315 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc081070 con 0x56104d203d70 2024-09-12T12:15:14.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1dda000640 1 -- 172.21.15.144:0/2863648315 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc055830 con 0x56104d203d70 2024-09-12T12:15:14.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1dda000640 1 -- 172.21.15.144:0/2863648315 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc07dab0 con 0x56104d203d70 2024-09-12T12:15:14.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 -- 172.21.15.144:0/2863648315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 msgr2=0x56104d1bfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2863648315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d1bfc00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc056160 tx=0x7f1ddc083000 comp rx=0 tx=0).stop 2024-09-12T12:15:14.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 -- 172.21.15.144:0/2863648315 shutdown_connections 2024-09-12T12:15:14.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2863648315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d204690 0x56104d1c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2863648315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d1bfc00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 --2- 172.21.15.144:0/2863648315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d1b7db0 0x56104d218d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 -- 172.21.15.144:0/2863648315 >> 172.21.15.144:0/2863648315 conn(0x56104d1e5040 msgr2=0x56104d210ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 -- 172.21.15.144:0/2863648315 shutdown_connections 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 -- 172.21.15.144:0/2863648315 wait complete. 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 -- start start 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 Processor -- start 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d1b7db0 0x56104d217e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d233790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d204690 0x56104d233cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56104d1bea30 con 0x56104d203d70 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56104cfd0400 con 0x56104d204690 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56104cfc73f0 con 0x56104d1b7db0 2024-09-12T12:15:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1df85b1000 10 client.0 _ll_register_callbacks cb 0x7f1ddc055b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d233790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d233790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36118/0 (socket says 172.21.15.144:36118) 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 -- 172.21.15.144:0/3955930613 learned_addr learned my addr 172.21.15.144:0/3955930613 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1dede00640 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d1b7db0 0x56104d217e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1dee800640 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d204690 0x56104d233cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 -- 172.21.15.144:0/3955930613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d1b7db0 msgr2=0x56104d217e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d1b7db0 0x56104d217e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 -- 172.21.15.144:0/3955930613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d204690 msgr2=0x56104d233cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d204690 0x56104d233cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.351+0000 7f1ded400640 1 -- 172.21.15.144:0/3955930613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56104cfc6470 con 0x56104d203d70 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1ded400640 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d233790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc056160 tx=0x7f1ddc0524f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdac6932adcfb84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 1 -- 172.21.15.144:0/3955930613 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc081070 con 0x56104d203d70 2024-09-12T12:15:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 1 -- 172.21.15.144:0/3955930613 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f1ddc07dcc0 con 0x56104d203d70 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 -- 172.21.15.144:0/3955930613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ddc055830 con 0x56104d203d70 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 1 -- 172.21.15.144:0/3955930613 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1ddc0059a0 con 0x56104d203d70 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 10 client.5118 fetch_fsmap learned FSMap version 18 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 -- 172.21.15.144:0/3955930613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56104cf9c640 con 0x56104d203d70 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 1 -- 172.21.15.144:0/3955930613 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc055830 con 0x56104d203d70 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 1 -- 172.21.15.144:0/3955930613 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f1ddc005b40 con 0x56104d203d70 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 10 client.5118 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 10 client.5118 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 20 client.5118 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:14.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x56104d234210 0x56104d277700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 4 client.5118 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:15:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 -- 172.21.15.144:0/3955930613 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56104d016470 con 0x56104d234210 2024-09-12T12:15:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dede00640 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x56104d234210 0x56104d277700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 10 client.5118 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:15:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dede00640 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x56104d234210 0x56104d277700 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1245cc0fff998105 server_cookie=6ad0eddfca22eac in_seq=0 out_seq=0 2024-09-12T12:15:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 1 -- 172.21.15.144:0/3955930613 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56104d016470 con 0x56104d234210 2024-09-12T12:15:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 10 client.5118 handle_command_reply: tid=0 2024-09-12T12:15:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 client.5118 shutdown 2024-09-12T12:15:14.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 -- 172.21.15.144:0/3955930613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 msgr2=0x56104d233790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d233790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc056160 tx=0x7f1ddc0524f0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 -- 172.21.15.144:0/3955930613 shutdown_connections 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56104d204690 0x56104d233cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x56104d234210 0x56104d277700 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56104d203d70 0x56104d233790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 --2- 172.21.15.144:0/3955930613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56104d1b7db0 0x56104d217e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1dcf400640 0 client.5118 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 -- 172.21.15.144:0/3955930613 >> 172.21.15.144:0/3955930613 conn(0x56104d1e5040 msgr2=0x56104d2112f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 -- 172.21.15.144:0/3955930613 shutdown_connections 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 1 -- 172.21.15.144:0/3955930613 wait complete. 2024-09-12T12:15:14.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df85b1000 20 client.5118 trim_cache size 0 max 16384 2024-09-12T12:15:14.364 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:14.364 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "no active scrubs running", 2024-09-12T12:15:14.364 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:15:14.364 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 -- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dd00678f0 msgr2=0x7f1dd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dd00678f0 0x7f1dd0069db0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1de0004fd0 tx=0x7f1de0001770 comp rx=0 tx=0).stop 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 -- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015af60 msgr2=0x7f1df0142d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015af60 0x7f1df0142d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00e930 tx=0x7f1ddc00edf0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 -- 172.21.15.144:0/2447976117 shutdown_connections 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dd00678f0 0x7f1dd0069db0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df015b340 0x7f1df0158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df015af60 0x7f1df0142d90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 --2- 172.21.15.144:0/2447976117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df00cd9f0 0x7f1df0072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 -- 172.21.15.144:0/2447976117 >> 172.21.15.144:0/2447976117 conn(0x7f1df0068030 msgr2=0x7f1df0150c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 -- 172.21.15.144:0/2447976117 shutdown_connections 2024-09-12T12:15:14.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.355+0000 7f1df5200640 1 -- 172.21.15.144:0/2447976117 wait complete. 2024-09-12T12:15:14.377 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:15:14.377 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-12T12:15:14.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd3000640 1 Processor -- start 2024-09-12T12:15:14.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd3000640 1 -- start start 2024-09-12T12:15:14.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c1d0 0x7f5dcc0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd3000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dcc0b6fe0 0x7f5dcc0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd3000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dcc0d0b20 con 0x7f5dcc15c5b0 2024-09-12T12:15:14.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd3000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5dcc073250 con 0x7f5dcc0b6fe0 2024-09-12T12:15:14.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc0d0e00 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd2600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dcc0b6fe0 0x7f5dcc0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd2600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dcc0b6fe0 0x7f5dcc0b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36126/0 (socket says 172.21.15.144:36126) 2024-09-12T12:15:14.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd2600640 1 -- 172.21.15.144:0/2786911204 learned_addr learned my addr 172.21.15.144:0/2786911204 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/2786911204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c1d0 0x7f5dcc0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd2600640 1 -- 172.21.15.144:0/2786911204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c1d0 msgr2=0x7f5dcc0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd2600640 1 --2- 172.21.15.144:0/2786911204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c1d0 0x7f5dcc0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd2600640 1 -- 172.21.15.144:0/2786911204 >> v1:172.21.15.165:6789/0 conn(0x7f5dcc15c5b0 legacy=0x7f5dcc0b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.515+0000 7f5dd2600640 1 -- 172.21.15.144:0/2786911204 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc0d10e0 con 0x7f5dcc0b6fe0 2024-09-12T12:15:14.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd2600640 1 --2- 172.21.15.144:0/2786911204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc0b6fe0 0x7f5dcc0b44e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009e50 tx=0x7f5dc401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ce21fe08fc8e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dcbe00640 1 -- 172.21.15.144:0/2786911204 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40a58f0 con 0x7f5dcc0b6fe0 2024-09-12T12:15:14.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dcbe00640 1 -- 172.21.15.144:0/2786911204 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc40a5a90 con 0x7f5dcc0b6fe0 2024-09-12T12:15:14.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dcbe00640 1 -- 172.21.15.144:0/2786911204 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40a5e60 con 0x7f5dcc0b6fe0 2024-09-12T12:15:14.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 -- 172.21.15.144:0/2786911204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc0b6fe0 msgr2=0x7f5dcc0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 --2- 172.21.15.144:0/2786911204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc0b6fe0 0x7f5dcc0b44e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009e50 tx=0x7f5dc401ca00 comp rx=0 tx=0).stop 2024-09-12T12:15:14.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 -- 172.21.15.144:0/2786911204 shutdown_connections 2024-09-12T12:15:14.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 --2- 172.21.15.144:0/2786911204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc0b6fe0 0x7f5dcc0b44e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 --2- 172.21.15.144:0/2786911204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c1d0 0x7f5dcc0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 -- 172.21.15.144:0/2786911204 >> 172.21.15.144:0/2786911204 conn(0x7f5dcc0b7c30 msgr2=0x7f5dcc067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 -- 172.21.15.144:0/2786911204 shutdown_connections 2024-09-12T12:15:14.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 -- 172.21.15.144:0/2786911204 wait complete. 2024-09-12T12:15:14.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 Processor -- start 2024-09-12T12:15:14.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.519+0000 7f5dd3000640 1 -- start start 2024-09-12T12:15:14.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd3000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dcc0b6fe0 0x7f5dcc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd3000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc15c1d0 0x7f5dcc158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c5b0 0x7f5dcc145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd3000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0d2480 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd3000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0d2300 con 0x7f5dcc0b6fe0 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc0d2600 con 0x7f5dcc15c5b0 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc15c1d0 0x7f5dcc158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc15c1d0 0x7f5dcc158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36142/0 (socket says 172.21.15.144:36142) 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1200640 1 -- 172.21.15.144:0/3685419817 learned_addr learned my addr 172.21.15.144:0/3685419817 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dcc0b6fe0 0x7f5dcc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd2600640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c5b0 0x7f5dcc145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1200640 1 -- 172.21.15.144:0/3685419817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c5b0 msgr2=0x7f5dcc145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1200640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c5b0 0x7f5dcc145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1200640 1 -- 172.21.15.144:0/3685419817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dcc0b6fe0 msgr2=0x7f5dcc154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1200640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dcc0b6fe0 0x7f5dcc154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1200640 1 -- 172.21.15.144:0/3685419817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc157e70 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd1200640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc15c1d0 0x7f5dcc158c10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c3f0 tx=0x7f5db800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dc9600640 1 -- 172.21.15.144:0/3685419817 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db80052d0 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dc9600640 1 -- 172.21.15.144:0/3685419817 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db8005490 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dc9600640 1 -- 172.21.15.144:0/3685419817 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8007240 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd3000640 1 -- 172.21.15.144:0/3685419817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc158130 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.523+0000 7f5dd3000640 1 -- 172.21.15.144:0/3685419817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc1586f0 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dc9600640 1 -- 172.21.15.144:0/3685419817 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5db80073e0 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dc9600640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5dac0678c0 0x7f5dac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dc9600640 1 -- 172.21.15.144:0/3685419817 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f5db8085210 con 0x7f5dcc15c1d0 2024-09-12T12:15:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5dac0678c0 0x7f5dac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd797e000 1 Processor -- start 2024-09-12T12:15:14.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd797e000 1 -- start start 2024-09-12T12:15:14.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5dac0678c0 0x7f5dac069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009b60 tx=0x7f5dc0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 0x556751c7cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c30240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c30780 0x556751c30b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd797e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556751a81cc0 con 0x556751c7d530 2024-09-12T12:15:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd797e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556751a3ca20 con 0x556751c7cc10 2024-09-12T12:15:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd797e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x556751a7dc80 con 0x556751c30780 2024-09-12T12:15:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c30240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c30240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36158/0 (socket says 172.21.15.144:36158) 2024-09-12T12:15:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1200640 1 -- 172.21.15.144:0/3088756040 learned_addr learned my addr 172.21.15.144:0/3088756040 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/3088756040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 0x556751c7cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd2600640 1 --2- 172.21.15.144:0/3088756040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c30780 0x556751c30b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1200640 1 -- 172.21.15.144:0/3088756040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c30780 msgr2=0x556751c30b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1200640 1 --2- 172.21.15.144:0/3088756040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c30780 0x556751c30b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1200640 1 -- 172.21.15.144:0/3088756040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 msgr2=0x556751c7cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1200640 1 --2- 172.21.15.144:0/3088756040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 0x556751c7cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1200640 1 -- 172.21.15.144:0/3088756040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556751a24d40 con 0x556751c7d530 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dd1200640 1 --2- 172.21.15.144:0/3088756040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c30240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5db805daa0 tx=0x7f5db80554a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a695aac43da860b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dbe000640 1 -- 172.21.15.144:0/3088756040 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db805dfd0 con 0x556751c7d530 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dbe000640 1 -- 172.21.15.144:0/3088756040 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db80537a0 con 0x556751c7d530 2024-09-12T12:15:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.527+0000 7f5dbe000640 1 -- 172.21.15.144:0/3088756040 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db80548f0 con 0x556751c7d530 2024-09-12T12:15:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- 172.21.15.144:0/3088756040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 msgr2=0x556751c30240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3088756040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c30240 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5db805daa0 tx=0x7f5db80554a0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- 172.21.15.144:0/3088756040 shutdown_connections 2024-09-12T12:15:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3088756040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c30780 0x556751c30b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3088756040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c30240 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3088756040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 0x556751c7cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- 172.21.15.144:0/3088756040 >> 172.21.15.144:0/3088756040 conn(0x556751c5d9b0 msgr2=0x556751c5fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- 172.21.15.144:0/3088756040 shutdown_connections 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- 172.21.15.144:0/3088756040 wait complete. 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- start start 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 Processor -- start 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c30780 0x556751c84130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 0x556751c84670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c36480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556751a1b2c0 con 0x556751c7d530 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556751a40370 con 0x556751c30780 2024-09-12T12:15:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x556751a8ff50 con 0x556751c7cc10 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 10 client.0 _ll_register_callbacks cb 0x556751ae2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c36480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c36480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36162/0 (socket says 172.21.15.144:36162) 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd2600640 1 -- 172.21.15.144:0/3166242149 learned_addr learned my addr 172.21.15.144:0/3166242149 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd1200640 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 0x556751c84670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c30780 0x556751c84130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd2600640 1 -- 172.21.15.144:0/3166242149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 msgr2=0x556751c84670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd2600640 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 0x556751c84670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd2600640 1 -- 172.21.15.144:0/3166242149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c30780 msgr2=0x556751c84130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd2600640 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c30780 0x556751c84130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd2600640 1 -- 172.21.15.144:0/3166242149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556751a21770 con 0x556751c7d530 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd2600640 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c36480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5dc401b0b0 tx=0x7f5dc401b240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb0cd4cf82a7273 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5db2a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5db2a00640 1 -- 172.21.15.144:0/3166242149 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40c1450 con 0x556751c7d530 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- 172.21.15.144:0/3166242149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5db80537a0 con 0x556751c7d530 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5db2a00640 1 -- 172.21.15.144:0/3166242149 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f5dc40c15f0 con 0x556751c7d530 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5db2a00640 1 -- 172.21.15.144:0/3166242149 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f5dc40c9050 con 0x556751c7d530 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 10 client.5130 fetch_fsmap learned FSMap version 18 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.531+0000 7f5dd797e000 1 -- 172.21.15.144:0/3166242149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556751a3f3f0 con 0x556751c7d530 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5db2a00640 1 -- 172.21.15.144:0/3166242149 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db80537a0 con 0x556751c7d530 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5db2a00640 1 -- 172.21.15.144:0/3166242149 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f5dc40cc020 con 0x556751c7d530 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 10 client.5130 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 10 client.5130 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 20 client.5130 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x556751c36e90 0x556751c37270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 4 client.5130 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 -- 172.21.15.144:0/3166242149 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556751a1bd90 con 0x556751c36e90 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x556751c36e90 0x556751c37270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x556751c36e90 0x556751c37270 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37faabdd7469884 server_cookie=44c7f82e35ce9472 in_seq=0 out_seq=0 2024-09-12T12:15:14.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5db2a00640 10 client.5130 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5db2a00640 1 -- 172.21.15.144:0/3166242149 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556751a1bd90 con 0x556751c36e90 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5db2a00640 10 client.5130 handle_command_reply: tid=0 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 client.5130 shutdown 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 -- 172.21.15.144:0/3166242149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 msgr2=0x556751c36480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c36480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5dc401b0b0 tx=0x7f5dc401b240 comp rx=0 tx=0).stop 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 -- 172.21.15.144:0/3166242149 shutdown_connections 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x556751c36e90 0x556751c37270 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c7d530 0x556751c36480 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 0x556751c84670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 --2- 172.21.15.144:0/3166242149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c30780 0x556751c84130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5db2a00640 0 client.5130 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 -- 172.21.15.144:0/3166242149 >> 172.21.15.144:0/3166242149 conn(0x556751c5d9b0 msgr2=0x556751c2f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 -- 172.21.15.144:0/3166242149 shutdown_connections 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 1 -- 172.21.15.144:0/3166242149 wait complete. 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.535+0000 7f5dd797e000 20 client.5130 trim_cache size 0 max 16384 2024-09-12T12:15:14.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd797e000 1 Processor -- start 2024-09-12T12:15:14.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd797e000 1 -- start start 2024-09-12T12:15:14.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cebce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 0x556751cec220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7d530 0x556751cec760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd797e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc202e20 con 0x556751c30780 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd797e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc15dc20 con 0x556751c7cc10 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd797e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc202800 con 0x556751c7d530 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cebce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36164/0 (socket says 172.21.15.144:36164) 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd1c00640 1 -- 172.21.15.144:0/219898379 learned_addr learned my addr 172.21.15.144:0/219898379 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd2600640 1 --2- 172.21.15.144:0/219898379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7d530 0x556751cec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd1200640 1 --2- 172.21.15.144:0/219898379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 0x556751cec220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd1c00640 1 -- 172.21.15.144:0/219898379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7d530 msgr2=0x556751cec760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/219898379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7d530 0x556751cec760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd1c00640 1 -- 172.21.15.144:0/219898379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 msgr2=0x556751cec220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/219898379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 0x556751cec220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.551+0000 7f5dd1c00640 1 -- 172.21.15.144:0/219898379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556751b03320 con 0x556751c30780 2024-09-12T12:15:14.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/219898379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cebce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556751a41c90 tx=0x7f5dc0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5b4db8ab2df778 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dbd600640 1 -- 172.21.15.144:0/219898379 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0003820 con 0x556751c30780 2024-09-12T12:15:14.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dbd600640 1 -- 172.21.15.144:0/219898379 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc00039c0 con 0x556751c30780 2024-09-12T12:15:14.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dbd600640 1 -- 172.21.15.144:0/219898379 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0003d70 con 0x556751c30780 2024-09-12T12:15:14.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 -- 172.21.15.144:0/219898379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 msgr2=0x556751cebce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 --2- 172.21.15.144:0/219898379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cebce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556751a41c90 tx=0x7f5dc0018000 comp rx=0 tx=0).stop 2024-09-12T12:15:14.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 -- 172.21.15.144:0/219898379 shutdown_connections 2024-09-12T12:15:14.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 --2- 172.21.15.144:0/219898379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7d530 0x556751cec760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 --2- 172.21.15.144:0/219898379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7cc10 0x556751cec220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 --2- 172.21.15.144:0/219898379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cebce0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 -- 172.21.15.144:0/219898379 >> 172.21.15.144:0/219898379 conn(0x556751c5d9b0 msgr2=0x556751c2ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 -- 172.21.15.144:0/219898379 shutdown_connections 2024-09-12T12:15:14.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 -- 172.21.15.144:0/219898379 wait complete. 2024-09-12T12:15:14.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 -- start start 2024-09-12T12:15:14.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 Processor -- start 2024-09-12T12:15:14.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cf0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 0x556751cf14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7d530 0x556751c89290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556751a29120 con 0x556751c30780 2024-09-12T12:15:14.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556751b02e90 con 0x556751c7d530 2024-09-12T12:15:14.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x556751a2bb90 con 0x556751c7cc10 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd797e000 10 client.0 _ll_register_callbacks cb 0x7f5dc0009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cf0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cf0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36170/0 (socket says 172.21.15.144:36170) 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 -- 172.21.15.144:0/1491729644 learned_addr learned my addr 172.21.15.144:0/1491729644 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd2600640 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7d530 0x556751c89290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1200640 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 0x556751cf14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 -- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 msgr2=0x556751cf14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 0x556751cf14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 -- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7d530 msgr2=0x556751c89290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7d530 0x556751c89290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 -- 172.21.15.144:0/1491729644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556751a155c0 con 0x556751c30780 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd2600640 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7d530 0x556751c89290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1200640 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 0x556751cf14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5dd1c00640 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cf0f80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00096c0 tx=0x7f5dc0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c741726d167c3762 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5db2a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.555+0000 7f5db2a00640 1 -- 172.21.15.144:0/1491729644 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc003b020 con 0x556751c30780 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5db2a00640 1 -- 172.21.15.144:0/1491729644 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f5dc0005bb0 con 0x556751c30780 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 -- 172.21.15.144:0/1491729644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc00039c0 con 0x556751c30780 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5db2a00640 1 -- 172.21.15.144:0/1491729644 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f5dc0005db0 con 0x556751c30780 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 10 client.5136 fetch_fsmap learned FSMap version 18 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 -- 172.21.15.144:0/1491729644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x556751a19330 con 0x556751c30780 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5db2a00640 1 -- 172.21.15.144:0/1491729644 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc00039c0 con 0x556751c30780 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5db2a00640 1 -- 172.21.15.144:0/1491729644 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f5dc002b020 con 0x556751c30780 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 10 client.5136 fetch_fsmap finished waiting for FSMap version 18 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 10 client.5136 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 20 client.5136 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x556751c897d0 0x556751c89bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 4 client.5136 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 -- 172.21.15.144:0/1491729644 --> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] -- command(tid 0: {"prefix": "perf dump"}) -- 0x556751a8f3f0 con 0x556751c897d0 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd1200640 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x556751c897d0 0x556751c89bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd1200640 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x556751c897d0 0x556751c89bb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b17f1dee5b1275b3 server_cookie=468a4d9829b084e4 in_seq=0 out_seq=0 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5db2a00640 10 client.5136 ms_handle_connect on v2:172.21.15.144:6836/3288752771 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5db2a00640 1 -- 172.21.15.144:0/1491729644 <== mds.0 v2:172.21.15.144:6836/3288752771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17995 (crc 0 0 0) 0x556751a8f3f0 con 0x556751c897d0 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5db2a00640 10 client.5136 handle_command_reply: tid=0 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 client.5136 shutdown 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 -- 172.21.15.144:0/1491729644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 msgr2=0x556751cf0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cf0f80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00096c0 tx=0x7f5dc0004740 comp rx=0 tx=0).stop 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 -- 172.21.15.144:0/1491729644 shutdown_connections 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556751c7d530 0x556751c89290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556751c7cc10 0x556751cf14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.144:6836/3288752771,v1:172.21.15.144:6837/3288752771] conn(0x556751c897d0 0x556751c89bb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 --2- 172.21.15.144:0/1491729644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556751c30780 0x556751cf0f80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5db2a00640 0 client.5136 ms_handle_reset on v2:172.21.15.144:6836/3288752771 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 -- 172.21.15.144:0/1491729644 >> 172.21.15.144:0/1491729644 conn(0x556751c5d9b0 msgr2=0x556751c93d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 -- 172.21.15.144:0/1491729644 shutdown_connections 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 1 -- 172.21.15.144:0/1491729644 wait complete. 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd797e000 20 client.5136 trim_cache size 0 max 16384 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:15:14.567 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1992, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1983, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 603437, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 14897171, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 16, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 6, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.228279716, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.102960037, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.057632257, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.053528204, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1983, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.347892831, 2024-09-12T12:15:14.568 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000175437 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 10, 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000001227, 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000122 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 122064, 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 26720 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 2437, 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 2457, 2024-09-12T12:15:14.569 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 616726, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 16291415, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.261549563, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.127154833, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.052114937, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.065721974, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2456, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.407687766, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000165996 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:15:14.570 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 120960 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 31008, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 53278, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 11351867, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 77337836, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2024-09-12T12:15:14.571 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 4.899576723, 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 2.876725437, 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 2.909046911, 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.123547008, 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 53277, 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.751336071, 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000032872 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.572 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 72892, 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.015923126, 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000218 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-12T12:15:14.573 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2655, 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 16.782988070, 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.006321276 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-12T12:15:14.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3943, 2024-09-12T12:15:14.575 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.004765105, 2024-09-12T12:15:14.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000254822 2024-09-12T12:15:14.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:14.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.575 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-12T12:15:14.575 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 25912, 2024-09-12T12:15:14.575 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 25912, 2024-09-12T12:15:14.575 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 25912, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 295.389475075, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.011399717 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 12, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 17873, 2024-09-12T12:15:14.576 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 17873, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 17872, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 2, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 2, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 47212, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 46644, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:15:14.577 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 107, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 1699, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2024-09-12T12:15:14.578 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 1699, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 13, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 2, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 11, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 1686, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 1068, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 4034, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:15:14.579 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 3305, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 2609, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 59, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 14162 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-12T12:15:14.580 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 4181, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 3540, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 2235, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:15:14.581 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 1, 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 26293, 2024-09-12T12:15:14.582 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 26293, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 36, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 36, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 4, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 90474007, 2024-09-12T12:15:14.583 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2683, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 86.883903399, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.032383117 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 14, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 2016, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 2002, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 13, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 13, 2024-09-12T12:15:14.584 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 0, 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 17873, 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 19874, 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 2001, 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 2, 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 7798, 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 7796, 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 100732, 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 231732 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.585 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 28889, 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 25912, 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 6, 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2000, 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.932551509, 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000966275 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-12T12:15:14.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 24, 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.003444656, 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000143527 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 6000, 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 6.670746681, 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001111791 2024-09-12T12:15:14.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 7639, 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 5.136470739, 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000672400 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.588 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000084993, 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000084993 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.002888885, 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002888885 2024-09-12T12:15:14.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.361998173, 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.361998173 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:15:14.591 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000116305, 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000116305 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8, 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.565030099, 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.070628762 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2235, 2024-09-12T12:15:14.592 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 262.130575039, 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.117284373 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-12T12:15:14.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.023406194, 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.023406194 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.594 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000284687, 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000284687 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.597 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-12T12:15:14.597 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8000, 2024-09-12T12:15:14.597 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 18.561877115, 2024-09-12T12:15:14.597 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002320234 2024-09-12T12:15:14.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.597 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:15:14.597 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:15:14.597 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 1, 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 0, 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 18499, 2024-09-12T12:15:14.598 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 18499, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 81, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:15:14.599 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:15:14.600 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-12T12:15:14.601 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 250468, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 86, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:15:14.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 5624, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 80, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 13461732, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 661542, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-12T12:15:14.603 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 8198, 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 86938649, 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 37, 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 8198, 2024-09-12T12:15:14.604 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8198, 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 38.387598715, 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.004682556 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8198, 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 8299 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 8198, 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 1764, 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 6434, 2024-09-12T12:15:14.605 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 11, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 63, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 2744, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 38, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 1540, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 2032, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-12T12:15:14.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 1701, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 22, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-12T12:15:14.607 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-12T12:15:14.608 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 43, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 5, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 8, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 8, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 115, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 0, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 33 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.609 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 32, 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-12T12:15:14.610 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 32, 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 3540, 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 3540, 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 35429, 2024-09-12T12:15:14.611 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 9376751, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 35429, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 35429, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 9376751, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.612 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 8198, 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 87308509, 2024-09-12T12:15:14.613 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 8198, 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 87308509, 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-12T12:15:14.614 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 8198, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 8198, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 8198, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 8198, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:15:14.615 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 3540, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 369860, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 3540, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 61, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 369860, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.616 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x555ee4c8e780": { 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 26293, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 86279703, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 26293, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:15:14.617 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2683, 2024-09-12T12:15:14.618 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 86279703, 2024-09-12T12:15:14.618 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:15:14.618 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:15:14.618 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:15:14.618 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:15:14.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:14.618 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:14.618 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:14.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 -- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5dac0678c0 msgr2=0x7f5dac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5dac0678c0 0x7f5dac069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009b60 tx=0x7f5dc0009190 comp rx=0 tx=0).stop 2024-09-12T12:15:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 -- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc15c1d0 msgr2=0x7f5dcc158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc15c1d0 0x7f5dcc158c10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c3f0 tx=0x7f5db800c8b0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 -- 172.21.15.144:0/3685419817 shutdown_connections 2024-09-12T12:15:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5dac0678c0 0x7f5dac069d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dcc15c5b0 0x7f5dcc145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dcc15c1d0 0x7f5dcc158c10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 --2- 172.21.15.144:0/3685419817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dcc0b6fe0 0x7f5dcc154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 -- 172.21.15.144:0/3685419817 >> 172.21.15.144:0/3685419817 conn(0x7f5dcc0b7c30 msgr2=0x7f5dcc06cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 -- 172.21.15.144:0/3685419817 shutdown_connections 2024-09-12T12:15:14.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:14.559+0000 7f5dd3000640 1 -- 172.21.15.144:0/3685419817 wait complete. 2024-09-12T12:15:14.622 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:15:14.622 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:15:14.706 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:15:14.790 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:15:14.790 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:15:14.790 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:15:14.790 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:14.799 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:15:14.799 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:14.848 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:15:15.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.023+0000 7fb1ea400640 1 Processor -- start 2024-09-12T12:15:15.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1ea400640 1 -- start start 2024-09-12T12:15:15.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1ea400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb1e40cd640 0x7fb1e4071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1ea400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e40b45a0 con 0x7fb1e415b4e0 2024-09-12T12:15:15.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1ea400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e40b3fe0 con 0x7fb1e4071420 2024-09-12T12:15:15.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1ea400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e40b42c0 con 0x7fb1e40cd640 2024-09-12T12:15:15.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1e3400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb1e415b4e0 0x7fb1e40b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41574/0 (socket says 172.21.15.144:41574) 2024-09-12T12:15:15.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1e3400640 1 -- 172.21.15.144:0/2578044543 learned_addr learned my addr 172.21.15.144:0/2578044543 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/2578044543 >> v2:172.21.15.165:3300/0 conn(0x7fb1e40cd640 0x7fb1e4071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1e2000640 1 -- 172.21.15.144:0/2578044543 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883538161 0 0) 0x7fb1e40b45a0 con 0x7fb1e415b4e0 2024-09-12T12:15:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1e2000640 1 -- 172.21.15.144:0/2578044543 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1c8005740 con 0x7fb1e415b4e0 2024-09-12T12:15:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1e3e00640 1 -- 172.21.15.144:0/2578044543 >> v1:172.21.15.165:6789/0 conn(0x7fb1e4071420 legacy=0x7fb1e40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1e3e00640 1 -- 172.21.15.144:0/2578044543 >> v1:172.21.15.144:6789/0 conn(0x7fb1e415b4e0 legacy=0x7fb1e40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.027+0000 7fb1e3e00640 1 -- 172.21.15.144:0/2578044543 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e40b1490 con 0x7fb1e40cd640 2024-09-12T12:15:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/2578044543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e40cd640 0x7fb1e4071840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0097c0 tx=0x7fb1dc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c097cd3759e7ccf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1e2000640 1 -- 172.21.15.144:0/2578044543 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0ab600 con 0x7fb1e40cd640 2024-09-12T12:15:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1e2000640 1 -- 172.21.15.144:0/2578044543 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc0b0070 con 0x7fb1e40cd640 2024-09-12T12:15:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1e2000640 1 -- 172.21.15.144:0/2578044543 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0ab9c0 con 0x7fb1e40cd640 2024-09-12T12:15:15.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1ea400640 1 -- 172.21.15.144:0/2578044543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e40cd640 msgr2=0x7fb1e4071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1ea400640 1 --2- 172.21.15.144:0/2578044543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e40cd640 0x7fb1e4071840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0097c0 tx=0x7fb1dc01c470 comp rx=0 tx=0).stop 2024-09-12T12:15:15.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1ea400640 1 -- 172.21.15.144:0/2578044543 shutdown_connections 2024-09-12T12:15:15.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1ea400640 1 --2- 172.21.15.144:0/2578044543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e40cd640 0x7fb1e4071840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1ea400640 1 -- 172.21.15.144:0/2578044543 >> 172.21.15.144:0/2578044543 conn(0x7fb1e406d0d0 msgr2=0x7fb1e406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:15.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1ea400640 1 -- 172.21.15.144:0/2578044543 shutdown_connections 2024-09-12T12:15:15.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1ea400640 1 -- 172.21.15.144:0/2578044543 wait complete. 2024-09-12T12:15:15.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1ea400640 1 Processor -- start 2024-09-12T12:15:15.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.031+0000 7fb1ea400640 1 -- start start 2024-09-12T12:15:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1ea400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e4071420 0x7fb1e4142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1ea400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e40cd640 0x7fb1e4156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1ea400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e415b4e0 0x7fb1e4156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1ea400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e415b8c0 con 0x7fb1e40cd640 2024-09-12T12:15:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1ea400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e40b02e0 con 0x7fb1e4071420 2024-09-12T12:15:15.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1ea400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e4145bc0 con 0x7fb1e415b4e0 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e40cd640 0x7fb1e4156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e40cd640 0x7fb1e4156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36174/0 (socket says 172.21.15.144:36174) 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e2a00640 1 -- 172.21.15.144:0/2127316577 learned_addr learned my addr 172.21.15.144:0/2127316577 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e3400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e4071420 0x7fb1e4142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e3e00640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e415b4e0 0x7fb1e4156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e2a00640 1 -- 172.21.15.144:0/2127316577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e415b4e0 msgr2=0x7fb1e4156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e2a00640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e415b4e0 0x7fb1e4156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e2a00640 1 -- 172.21.15.144:0/2127316577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e4071420 msgr2=0x7fb1e4142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e2a00640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e4071420 0x7fb1e4142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e2a00640 1 -- 172.21.15.144:0/2127316577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e41428b0 con 0x7fb1e40cd640 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e3400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e4071420 0x7fb1e4142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1e2a00640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e40cd640 0x7fb1e4156a50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c420 tx=0x7fb1d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1db400640 1 -- 172.21.15.144:0/2127316577 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d00052d0 con 0x7fb1e40cd640 2024-09-12T12:15:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1db400640 1 -- 172.21.15.144:0/2127316577 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d0005470 con 0x7fb1e40cd640 2024-09-12T12:15:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e4142ce0 con 0x7fb1e40cd640 2024-09-12T12:15:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1db400640 1 -- 172.21.15.144:0/2127316577 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0007260 con 0x7fb1e40cd640 2024-09-12T12:15:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e41432a0 con 0x7fb1e40cd640 2024-09-12T12:15:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.035+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e4071840 con 0x7fb1e40cd640 2024-09-12T12:15:15.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.039+0000 7fb1db400640 1 -- 172.21.15.144:0/2127316577 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1d0007400 con 0x7fb1e40cd640 2024-09-12T12:15:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.039+0000 7fb1db400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c40678f0 0x7fb1c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.039+0000 7fb1db400640 1 -- 172.21.15.144:0/2127316577 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7fb1d0085290 con 0x7fb1e40cd640 2024-09-12T12:15:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.039+0000 7fb1e3400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c40678f0 0x7fb1c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.039+0000 7fb1e3400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c40678f0 0x7fb1c4069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4001570 tx=0x7fb1d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.043+0000 7fb1db400640 1 -- 172.21.15.144:0/2127316577 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb1d0055ca0 con 0x7fb1e40cd640 2024-09-12T12:15:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.211+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1e40686c0 con 0x7fb1e40cd640 2024-09-12T12:15:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.211+0000 7fb1db400640 1 -- 172.21.15.144:0/2127316577 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) ==== 80+0+0 (secure 0 0 0) 0x7fb1d00555a0 con 0x7fb1e40cd640 2024-09-12T12:15:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:15:15.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c40678f0 msgr2=0x7fb1c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c40678f0 0x7fb1c4069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4001570 tx=0x7fb1d4009040 comp rx=0 tx=0).stop 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e40cd640 msgr2=0x7fb1e4156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e40cd640 0x7fb1e4156a50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c420 tx=0x7fb1d000c8e0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 shutdown_connections 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1c40678f0 0x7fb1c4069db0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1e415b4e0 0x7fb1e4156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e40cd640 0x7fb1e4156a50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 --2- 172.21.15.144:0/2127316577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1e4071420 0x7fb1e4142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 >> 172.21.15.144:0/2127316577 conn(0x7fb1e406d0d0 msgr2=0x7fb1e40b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 shutdown_connections 2024-09-12T12:15:15.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.215+0000 7fb1ea400640 1 -- 172.21.15.144:0/2127316577 wait complete. 2024-09-12T12:15:15.237 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:15:15.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:15.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:15:15.284 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:15:15.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:15.284 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:15:15.340 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:15:15.341 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:15:15.341 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:15.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:15:15.350 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:15:15.350 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:15:15.351 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:15.392 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:15:15.392 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:15:15.392 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:15:15.392 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:15.403 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:15:15.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:15:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb472200640 1 Processor -- start 2024-09-12T12:15:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb472200640 1 -- start start 2024-09-12T12:15:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb472200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb46c159e60 0x7fb46c0d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb472200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0b7550 0x7fb46c073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb472200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46c15c9b0 con 0x7fb46c0d29a0 2024-09-12T12:15:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb472200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb46c15d560 con 0x7fb46c159e60 2024-09-12T12:15:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb472200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb46c0d2dd0 con 0x7fb46c0b7550 2024-09-12T12:15:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb46b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb46c159e60 0x7fb46c0d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb46b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb46c159e60 0x7fb46c0d2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36190/0 (socket says 172.21.15.144:36190) 2024-09-12T12:15:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb46aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb46c0d29a0 0x7fb46c0b6e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41582/0 (socket says 172.21.15.144:41582) 2024-09-12T12:15:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb46b400640 1 -- 172.21.15.144:0/4150260570 learned_addr learned my addr 172.21.15.144:0/4150260570 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb46b400640 1 -- 172.21.15.144:0/4150260570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0b7550 msgr2=0x7fb46c073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb46b400640 1 --2- 172.21.15.144:0/4150260570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0b7550 0x7fb46c073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb46b400640 1 -- 172.21.15.144:0/4150260570 >> v1:172.21.15.144:6789/0 conn(0x7fb46c0d29a0 legacy=0x7fb46c0b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.571+0000 7fb46b400640 1 -- 172.21.15.144:0/4150260570 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c15cc30 con 0x7fb46c159e60 2024-09-12T12:15:15.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb46b400640 1 --2- 172.21.15.144:0/4150260570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c159e60 0x7fb46c0d2460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009870 tx=0x7fb45c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d16e51a1fdc2f3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb46a000640 1 -- 172.21.15.144:0/4150260570 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0b2070 con 0x7fb46c159e60 2024-09-12T12:15:15.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb46a000640 1 -- 172.21.15.144:0/4150260570 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45c0a9070 con 0x7fb46c159e60 2024-09-12T12:15:15.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb46a000640 1 -- 172.21.15.144:0/4150260570 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0ad880 con 0x7fb46c159e60 2024-09-12T12:15:15.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb472200640 1 -- 172.21.15.144:0/4150260570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c159e60 msgr2=0x7fb46c0d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb472200640 1 --2- 172.21.15.144:0/4150260570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c159e60 0x7fb46c0d2460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009870 tx=0x7fb45c01c560 comp rx=0 tx=0).stop 2024-09-12T12:15:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb472200640 1 -- 172.21.15.144:0/4150260570 shutdown_connections 2024-09-12T12:15:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb472200640 1 --2- 172.21.15.144:0/4150260570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0b7550 0x7fb46c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb472200640 1 --2- 172.21.15.144:0/4150260570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c159e60 0x7fb46c0d2460 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb472200640 1 -- 172.21.15.144:0/4150260570 >> 172.21.15.144:0/4150260570 conn(0x7fb46c067a00 msgr2=0x7fb46c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb472200640 1 -- 172.21.15.144:0/4150260570 shutdown_connections 2024-09-12T12:15:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.575+0000 7fb472200640 1 -- 172.21.15.144:0/4150260570 wait complete. 2024-09-12T12:15:15.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 Processor -- start 2024-09-12T12:15:15.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 -- start start 2024-09-12T12:15:15.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c0b7550 0x7fb46c149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0d29a0 0x7fb46c06e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c159e60 0x7fb46c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c15a3c0 con 0x7fb46c0b7550 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c15a240 con 0x7fb46c159e60 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb46c169110 con 0x7fb46c0d29a0 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c0b7550 0x7fb46c149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c0b7550 0x7fb46c149da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36206/0 (socket says 172.21.15.144:36206) 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46b400640 1 -- 172.21.15.144:0/259691738 learned_addr learned my addr 172.21.15.144:0/259691738 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46aa00640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0d29a0 0x7fb46c06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46be00640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c159e60 0x7fb46c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46b400640 1 -- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0d29a0 msgr2=0x7fb46c06e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46b400640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0d29a0 0x7fb46c06e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46b400640 1 -- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c159e60 msgr2=0x7fb46c06e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46b400640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c159e60 0x7fb46c06e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46b400640 1 -- 172.21.15.144:0/259691738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c14a2e0 con 0x7fb46c0b7550 2024-09-12T12:15:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46be00640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c159e60 0x7fb46c06e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46aa00640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0d29a0 0x7fb46c06e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb46b400640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c0b7550 0x7fb46c149da0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb45c01a190 tx=0x7fb45c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb463400640 1 -- 172.21.15.144:0/259691738 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0b2040 con 0x7fb46c0b7550 2024-09-12T12:15:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb463400640 1 -- 172.21.15.144:0/259691738 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45c0be070 con 0x7fb46c0b7550 2024-09-12T12:15:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb463400640 1 -- 172.21.15.144:0/259691738 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0b8660 con 0x7fb46c0b7550 2024-09-12T12:15:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46c06cf70 con 0x7fb46c0b7550 2024-09-12T12:15:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46c06d530 con 0x7fb46c0b7550 2024-09-12T12:15:15.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.579+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46c073370 con 0x7fb46c0b7550 2024-09-12T12:15:15.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.583+0000 7fb463400640 1 -- 172.21.15.144:0/259691738 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb45c0ab070 con 0x7fb46c0b7550 2024-09-12T12:15:15.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.583+0000 7fb463400640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb44c0678c0 0x7fb44c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.583+0000 7fb463400640 1 -- 172.21.15.144:0/259691738 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7fb45c11ffe0 con 0x7fb46c0b7550 2024-09-12T12:15:15.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.583+0000 7fb46aa00640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb44c0678c0 0x7fb44c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.583+0000 7fb46aa00640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb44c0678c0 0x7fb44c069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb46c15c030 tx=0x7fb458009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.587+0000 7fb463400640 1 -- 172.21.15.144:0/259691738 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb45c016150 con 0x7fb46c0b7550 2024-09-12T12:15:15.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb46c068160 con 0x7fb46c0b7550 2024-09-12T12:15:15.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb463400640 1 -- 172.21.15.144:0/259691738 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7fb45c0f0900 con 0x7fb46c0b7550 2024-09-12T12:15:15.777 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:15.777 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"btime":"2024-09-12T12:13:51:258203+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1734346147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1734346147},{"type":"v1","addr":"172.21.15.144:6835","nonce":1734346147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3346311863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3346311863},{"type":"v1","addr":"172.21.15.165:6834","nonce":3346311863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2564271519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2564271519},{"type":"v1","addr":"172.21.15.165:6835","nonce":2564271519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-12T12:13:42.597555+0000","modified":"2024-09-12T12:13:50.581922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/3288752771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3288752771},{"type":"v1","addr":"172.21.15.144:6837","nonce":3288752771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-12T12:15:15.778 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-09-12T12:15:15.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb44c0678c0 msgr2=0x7fb44c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb44c0678c0 0x7fb44c069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb46c15c030 tx=0x7fb458009040 comp rx=0 tx=0).stop 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c0b7550 msgr2=0x7fb46c149da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c0b7550 0x7fb46c149da0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb45c01a190 tx=0x7fb45c01ada0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 shutdown_connections 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb44c0678c0 0x7fb44c069d80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c159e60 0x7fb46c06e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb46c0d29a0 0x7fb46c06e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 --2- 172.21.15.144:0/259691738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb46c0b7550 0x7fb46c149da0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 >> 172.21.15.144:0/259691738 conn(0x7fb46c067a00 msgr2=0x7fb46c0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 shutdown_connections 2024-09-12T12:15:15.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.775+0000 7fb472200640 1 -- 172.21.15.144:0/259691738 wait complete. 2024-09-12T12:15:15.798 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:15:15.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f661a400640 1 Processor -- start 2024-09-12T12:15:15.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f661a400640 1 -- start start 2024-09-12T12:15:15.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f661a400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6614071420 0x7f6614071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f661a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 0x7f66140cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f661a400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66140b45a0 con 0x7f661415b4e0 2024-09-12T12:15:15.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f661a400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f66140cd8e0 con 0x7f6614071420 2024-09-12T12:15:15.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f661a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f66140b3fe0 con 0x7f66140ccf30 2024-09-12T12:15:15.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f6612a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6614071420 0x7f6614071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f6612a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6614071420 0x7f6614071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36222/0 (socket says 172.21.15.144:36222) 2024-09-12T12:15:15.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f6612a00640 1 -- 172.21.15.144:0/441052738 learned_addr learned my addr 172.21.15.144:0/441052738 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:15.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f6613e00640 1 --2- 172.21.15.144:0/441052738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 0x7f66140cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f6612a00640 1 -- 172.21.15.144:0/441052738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 msgr2=0x7f66140cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:15.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f6612a00640 1 --2- 172.21.15.144:0/441052738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 0x7f66140cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f6612a00640 1 -- 172.21.15.144:0/441052738 >> v1:172.21.15.165:6789/0 conn(0x7f661415b4e0 legacy=0x7f66140b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.931+0000 7f6612a00640 1 -- 172.21.15.144:0/441052738 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66140b42c0 con 0x7f6614071420 2024-09-12T12:15:15.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f6612a00640 1 --2- 172.21.15.144:0/441052738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614071420 0x7f6614071840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6600009870 tx=0x7f660001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcaed19cbfcf613d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f6612000640 1 -- 172.21.15.144:0/441052738 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66000a95f0 con 0x7f6614071420 2024-09-12T12:15:15.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f6612000640 1 -- 172.21.15.144:0/441052738 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66000a9790 con 0x7f6614071420 2024-09-12T12:15:15.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f6612000640 1 -- 172.21.15.144:0/441052738 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66000a9b60 con 0x7f6614071420 2024-09-12T12:15:15.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f661a400640 1 -- 172.21.15.144:0/441052738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614071420 msgr2=0x7f6614071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f661a400640 1 --2- 172.21.15.144:0/441052738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614071420 0x7f6614071840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6600009870 tx=0x7f660001c530 comp rx=0 tx=0).stop 2024-09-12T12:15:15.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f661a400640 1 -- 172.21.15.144:0/441052738 shutdown_connections 2024-09-12T12:15:15.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f661a400640 1 --2- 172.21.15.144:0/441052738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 0x7f66140cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f661a400640 1 --2- 172.21.15.144:0/441052738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614071420 0x7f6614071840 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f661a400640 1 -- 172.21.15.144:0/441052738 >> 172.21.15.144:0/441052738 conn(0x7f661406d0d0 msgr2=0x7f661406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:15.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f661a400640 1 -- 172.21.15.144:0/441052738 shutdown_connections 2024-09-12T12:15:15.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.935+0000 7f661a400640 1 -- 172.21.15.144:0/441052738 wait complete. 2024-09-12T12:15:15.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f661a400640 1 Processor -- start 2024-09-12T12:15:15.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f661a400640 1 -- start start 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f661a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6614071420 0x7f6614161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f661a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140ccf30 0x7f6614156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f661a400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415b4e0 0x7f66140cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f661a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f661415b8c0 con 0x7f66140ccf30 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f661a400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f66140cdef0 con 0x7f661415b4e0 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f661a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6614161790 con 0x7f6614071420 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6612a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140ccf30 0x7f6614156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6612a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140ccf30 0x7f6614156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36228/0 (socket says 172.21.15.144:36228) 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6612a00640 1 -- 172.21.15.144:0/1392480914 learned_addr learned my addr 172.21.15.144:0/1392480914 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:15.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6613e00640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415b4e0 0x7f66140cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6613400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6614071420 0x7f6614161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6612a00640 1 -- 172.21.15.144:0/1392480914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6614071420 msgr2=0x7f6614161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6612a00640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6614071420 0x7f6614161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6612a00640 1 -- 172.21.15.144:0/1392480914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415b4e0 msgr2=0x7f66140cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6612a00640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415b4e0 0x7f66140cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6612a00640 1 -- 172.21.15.144:0/1392480914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661415a780 con 0x7f66140ccf30 2024-09-12T12:15:15.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f6612a00640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140ccf30 0x7f6614156ae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66000ab040 tx=0x7f660001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f660b400640 1 -- 172.21.15.144:0/1392480914 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66000b1600 con 0x7f66140ccf30 2024-09-12T12:15:15.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f660b400640 1 -- 172.21.15.144:0/1392480914 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66000b17a0 con 0x7f66140ccf30 2024-09-12T12:15:15.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f660b400640 1 -- 172.21.15.144:0/1392480914 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66000b1b90 con 0x7f66140ccf30 2024-09-12T12:15:15.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.939+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f661415aa60 con 0x7f66140ccf30 2024-09-12T12:15:15.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.943+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66140aec10 con 0x7f66140ccf30 2024-09-12T12:15:15.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.943+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6614071840 con 0x7f66140ccf30 2024-09-12T12:15:15.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.943+0000 7f660b400640 1 -- 172.21.15.144:0/1392480914 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66000bc450 con 0x7f66140ccf30 2024-09-12T12:15:15.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.943+0000 7f660b400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.943+0000 7f660b400640 1 -- 172.21.15.144:0/1392480914 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f66001204f0 con 0x7f66140ccf30 2024-09-12T12:15:15.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.943+0000 7f6613400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.943+0000 7f6613400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f66040012f0 tx=0x7f6604009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:15.947+0000 7f660b400640 1 -- 172.21.15.144:0/1392480914 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f66000c3030 con 0x7f66140ccf30 2024-09-12T12:15:16.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.139+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66140008e0 con 0x7f66140ccf30 2024-09-12T12:15:16.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.139+0000 7f660b400640 1 -- 172.21.15.144:0/1392480914 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7f66000ad020 con 0x7f66140ccf30 2024-09-12T12:15:16.144 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:16.144 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"btime":"2024-09-12T12:13:51:258203+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1734346147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1734346147},{"type":"v1","addr":"172.21.15.144:6835","nonce":1734346147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3346311863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3346311863},{"type":"v1","addr":"172.21.15.165:6834","nonce":3346311863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2564271519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2564271519},{"type":"v1","addr":"172.21.15.165:6835","nonce":2564271519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-12T12:13:42.597555+0000","modified":"2024-09-12T12:13:50.581922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/3288752771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3288752771},{"type":"v1","addr":"172.21.15.144:6837","nonce":3288752771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-12T12:15:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-09-12T12:15:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 msgr2=0x7f65f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f66040012f0 tx=0x7f6604009040 comp rx=0 tx=0).stop 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140ccf30 msgr2=0x7f6614156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140ccf30 0x7f6614156ae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66000ab040 tx=0x7f660001ad70 comp rx=0 tx=0).stop 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 shutdown_connections 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415b4e0 0x7f66140cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140ccf30 0x7f6614156ae0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 --2- 172.21.15.144:0/1392480914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6614071420 0x7f6614161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 >> 172.21.15.144:0/1392480914 conn(0x7f661406d0d0 msgr2=0x7f66140ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 shutdown_connections 2024-09-12T12:15:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.143+0000 7f661a400640 1 -- 172.21.15.144:0/1392480914 wait complete. 2024-09-12T12:15:16.164 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:15:16.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b8a00640 1 Processor -- start 2024-09-12T12:15:16.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b8a00640 1 -- start start 2024-09-12T12:15:16.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b8a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10b4161cb0 0x7f10b415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b8a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b415f0d0 con 0x7f10b40b4970 2024-09-12T12:15:16.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b8a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b415f350 con 0x7f10b40aef50 2024-09-12T12:15:16.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b8a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f10b415fbf0 con 0x7f10b4161cb0 2024-09-12T12:15:16.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10b4161cb0 0x7f10b415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b1400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f10b40b4970 0x7f10b415fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41598/0 (socket says 172.21.15.144:41598) 2024-09-12T12:15:16.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10b4161cb0 0x7f10b415eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36238/0 (socket says 172.21.15.144:36238) 2024-09-12T12:15:16.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b1400640 1 -- 172.21.15.144:0/651860384 learned_addr learned my addr 172.21.15.144:0/651860384 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:16.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b1e00640 1 -- 172.21.15.144:0/651860384 >> v1:172.21.15.165:6789/0 conn(0x7f10b40aef50 legacy=0x7f10b406cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b1e00640 1 -- 172.21.15.144:0/651860384 >> v1:172.21.15.144:6789/0 conn(0x7f10b40b4970 legacy=0x7f10b415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.299+0000 7f10b1e00640 1 -- 172.21.15.144:0/651860384 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b415f630 con 0x7f10b4161cb0 2024-09-12T12:15:16.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b1e00640 1 --2- 172.21.15.144:0/651860384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b4161cb0 0x7f10b415eb90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f10a40097c0 tx=0x7f10a401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73f2285c6ee5c7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:16.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b0a00640 1 -- 172.21.15.144:0/651860384 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a40b0070 con 0x7f10b4161cb0 2024-09-12T12:15:16.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b0a00640 1 -- 172.21.15.144:0/651860384 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a40ab600 con 0x7f10b4161cb0 2024-09-12T12:15:16.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b0a00640 1 -- 172.21.15.144:0/651860384 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a40ab9d0 con 0x7f10b4161cb0 2024-09-12T12:15:16.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b8a00640 1 -- 172.21.15.144:0/651860384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b4161cb0 msgr2=0x7f10b415eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b8a00640 1 --2- 172.21.15.144:0/651860384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b4161cb0 0x7f10b415eb90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f10a40097c0 tx=0x7f10a401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b8a00640 1 -- 172.21.15.144:0/651860384 shutdown_connections 2024-09-12T12:15:16.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b8a00640 1 --2- 172.21.15.144:0/651860384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b4161cb0 0x7f10b415eb90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b8a00640 1 -- 172.21.15.144:0/651860384 >> 172.21.15.144:0/651860384 conn(0x7f10b40cd870 msgr2=0x7f10b40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:16.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b8a00640 1 -- 172.21.15.144:0/651860384 shutdown_connections 2024-09-12T12:15:16.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.303+0000 7f10b8a00640 1 -- 172.21.15.144:0/651860384 wait complete. 2024-09-12T12:15:16.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 Processor -- start 2024-09-12T12:15:16.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 -- start start 2024-09-12T12:15:16.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40aef50 0x7f10b4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b40b4970 0x7f10b415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b4161cb0 0x7f10b406f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10b406d4b0 con 0x7f10b40aef50 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10b406d330 con 0x7f10b4161cb0 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f10b40af360 con 0x7f10b40b4970 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40aef50 0x7f10b4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40aef50 0x7f10b4154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36246/0 (socket says 172.21.15.144:36246) 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1e00640 1 -- 172.21.15.144:0/3699884043 learned_addr learned my addr 172.21.15.144:0/3699884043 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b2800640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b4161cb0 0x7f10b406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1400640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b40b4970 0x7f10b415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1e00640 1 -- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b40b4970 msgr2=0x7f10b415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1e00640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b40b4970 0x7f10b415d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1e00640 1 -- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b4161cb0 msgr2=0x7f10b406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1e00640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b4161cb0 0x7f10b406f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1e00640 1 -- 172.21.15.144:0/3699884043 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b415df00 con 0x7f10b40aef50 2024-09-12T12:15:16.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b2800640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b4161cb0 0x7f10b406f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:16.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1400640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b40b4970 0x7f10b415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:16.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b1e00640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40aef50 0x7f10b4154f60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f10a40097c0 tx=0x7f10a4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:16.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10aa000640 1 -- 172.21.15.144:0/3699884043 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a40b0040 con 0x7f10b40aef50 2024-09-12T12:15:16.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10aa000640 1 -- 172.21.15.144:0/3699884043 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a40b4410 con 0x7f10b40aef50 2024-09-12T12:15:16.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10aa000640 1 -- 172.21.15.144:0/3699884043 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a40b47e0 con 0x7f10b40aef50 2024-09-12T12:15:16.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b4158b80 con 0x7f10b40aef50 2024-09-12T12:15:16.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b4150360 con 0x7f10b40aef50 2024-09-12T12:15:16.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.307+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b40af7a0 con 0x7f10b40aef50 2024-09-12T12:15:16.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.311+0000 7f10aa000640 1 -- 172.21.15.144:0/3699884043 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10a40bc020 con 0x7f10b40aef50 2024-09-12T12:15:16.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.311+0000 7f10aa000640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10940678c0 0x7f1094069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.311+0000 7f10aa000640 1 -- 172.21.15.144:0/3699884043 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f10a411f5e0 con 0x7f10b40aef50 2024-09-12T12:15:16.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.311+0000 7f10b1400640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10940678c0 0x7f1094069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.311+0000 7f10b1400640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10940678c0 0x7f1094069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f10b4150050 tx=0x7f10a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:16.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.315+0000 7f10aa000640 1 -- 172.21.15.144:0/3699884043 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f10a4016090 con 0x7f10b40aef50 2024-09-12T12:15:16.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.475+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10b40691d0 con 0x7f10b40aef50 2024-09-12T12:15:16.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.475+0000 7f10aa000640 1 -- 172.21.15.144:0/3699884043 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17140 (secure 0 0 0) 0x7f10a40efec0 con 0x7f10b40aef50 2024-09-12T12:15:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:16.478 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":43,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:14:55.171678+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:13:40.307199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T12:13:41.588661+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:15:16.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.475+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10940678c0 msgr2=0x7f1094069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.475+0000 7f10b8a00640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10940678c0 0x7f1094069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f10b4150050 tx=0x7f10a0009040 comp rx=0 tx=0).stop 2024-09-12T12:15:16.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40aef50 msgr2=0x7f10b4154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40aef50 0x7f10b4154f60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f10a40097c0 tx=0x7f10a4019240 comp rx=0 tx=0).stop 2024-09-12T12:15:16.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 shutdown_connections 2024-09-12T12:15:16.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10940678c0 0x7f1094069d80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b4161cb0 0x7f10b406f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b40b4970 0x7f10b415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 --2- 172.21.15.144:0/3699884043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40aef50 0x7f10b4154f60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 >> 172.21.15.144:0/3699884043 conn(0x7f10b40cd870 msgr2=0x7f10b40cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:16.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 shutdown_connections 2024-09-12T12:15:16.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.479+0000 7f10b8a00640 1 -- 172.21.15.144:0/3699884043 wait complete. 2024-09-12T12:15:16.500 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:15:16.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:15:16.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa70a00640 1 Processor -- start 2024-09-12T12:15:16.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa70a00640 1 -- start start 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa70a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c148190 0x7ffa6c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa70a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6c148570 con 0x7ffa6c0cd470 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa70a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6c0b41f0 con 0x7ffa6c0b0480 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa70a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c0ce090 con 0x7ffa6c148190 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa69400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ffa6c0cd470 0x7ffa6c0afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41600/0 (socket says 172.21.15.144:41600) 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa69400640 1 -- 172.21.15.144:0/685165275 learned_addr learned my addr 172.21.15.144:0/685165275 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa69e00640 1 --2- 172.21.15.144:0/685165275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c148190 0x7ffa6c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa68a00640 1 -- 172.21.15.144:0/685165275 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142482831 0 0) 0x7ffa6c148570 con 0x7ffa6c0cd470 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa68a00640 1 -- 172.21.15.144:0/685165275 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa50003530 con 0x7ffa6c0cd470 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa68a00640 1 -- 172.21.15.144:0/685165275 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077618854 0 0) 0x7ffa6c0b41f0 con 0x7ffa6c0b0480 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa68a00640 1 -- 172.21.15.144:0/685165275 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa6c148570 con 0x7ffa6c0b0480 2024-09-12T12:15:16.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa68a00640 1 -- 172.21.15.144:0/685165275 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3264865030 0 0) 0x7ffa50003530 con 0x7ffa6c0cd470 2024-09-12T12:15:16.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa69e00640 1 -- 172.21.15.144:0/685165275 >> v1:172.21.15.165:6789/0 conn(0x7ffa6c0b0480 legacy=0x7ffa6c0b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa69e00640 1 -- 172.21.15.144:0/685165275 >> v1:172.21.15.144:6789/0 conn(0x7ffa6c0cd470 legacy=0x7ffa6c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.635+0000 7ffa69e00640 1 -- 172.21.15.144:0/685165275 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c0b0950 con 0x7ffa6c148190 2024-09-12T12:15:16.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa69e00640 1 --2- 172.21.15.144:0/685165275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c148190 0x7ffa6c0ccf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b43c0 tx=0x7ffa5c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d6f7f5690703e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:16.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa68a00640 1 -- 172.21.15.144:0/685165275 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58001680 con 0x7ffa6c148190 2024-09-12T12:15:16.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa68a00640 1 -- 172.21.15.144:0/685165275 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c0a6500 con 0x7ffa6c148190 2024-09-12T12:15:16.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa68a00640 1 -- 172.21.15.144:0/685165275 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0a68d0 con 0x7ffa6c148190 2024-09-12T12:15:16.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa70a00640 1 -- 172.21.15.144:0/685165275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c148190 msgr2=0x7ffa6c0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa70a00640 1 --2- 172.21.15.144:0/685165275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c148190 0x7ffa6c0ccf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b43c0 tx=0x7ffa5c01c8b0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa70a00640 1 -- 172.21.15.144:0/685165275 shutdown_connections 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa70a00640 1 --2- 172.21.15.144:0/685165275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c148190 0x7ffa6c0ccf30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa70a00640 1 -- 172.21.15.144:0/685165275 >> 172.21.15.144:0/685165275 conn(0x7ffa6c06d0d0 msgr2=0x7ffa6c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa70a00640 1 -- 172.21.15.144:0/685165275 shutdown_connections 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.639+0000 7ffa70a00640 1 -- 172.21.15.144:0/685165275 wait complete. 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 Processor -- start 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 -- start start 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa6c0b0480 0x7ffa6c14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c0cd470 0x7ffa6c142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6c148190 0x7ffa6c142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0b5770 con 0x7ffa6c148190 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0b55f0 con 0x7ffa6c0b0480 2024-09-12T12:15:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c0b58f0 con 0x7ffa6c0cd470 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa6a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6c148190 0x7ffa6c142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa69e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa6c0b0480 0x7ffa6c14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa69400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c0cd470 0x7ffa6c142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa69e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa6c0b0480 0x7ffa6c14e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:52912/0 (socket says 172.21.15.144:52912) 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa6a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6c148190 0x7ffa6c142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36260/0 (socket says 172.21.15.144:36260) 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa69e00640 1 -- 172.21.15.144:0/3854194216 learned_addr learned my addr 172.21.15.144:0/3854194216 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa6a800640 1 -- 172.21.15.144:0/3854194216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c0cd470 msgr2=0x7ffa6c142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa6a800640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c0cd470 0x7ffa6c142740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa6a800640 1 -- 172.21.15.144:0/3854194216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa6c0b0480 msgr2=0x7ffa6c14e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa6a800640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa6c0b0480 0x7ffa6c14e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa6a800640 1 -- 172.21.15.144:0/3854194216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c14e5d0 con 0x7ffa6c148190 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa6a800640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6c148190 0x7ffa6c142c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c390 tx=0x7ffa6400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa62000640 1 -- 172.21.15.144:0/3854194216 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64017070 con 0x7ffa6c148190 2024-09-12T12:15:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa62000640 1 -- 172.21.15.144:0/3854194216 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa640052d0 con 0x7ffa6c148190 2024-09-12T12:15:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c1453d0 con 0x7ffa6c148190 2024-09-12T12:15:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa62000640 1 -- 172.21.15.144:0/3854194216 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64003840 con 0x7ffa6c148190 2024-09-12T12:15:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.643+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c145990 con 0x7ffa6c148190 2024-09-12T12:15:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.647+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c0ccf30 con 0x7ffa6c148190 2024-09-12T12:15:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.647+0000 7ffa62000640 1 -- 172.21.15.144:0/3854194216 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa6401a070 con 0x7ffa6c148190 2024-09-12T12:15:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.647+0000 7ffa62000640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffa4c0678c0 0x7ffa4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.647+0000 7ffa62000640 1 -- 172.21.15.144:0/3854194216 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7ffa640851a0 con 0x7ffa6c148190 2024-09-12T12:15:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.647+0000 7ffa69e00640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffa4c0678c0 0x7ffa4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.647+0000 7ffa69e00640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffa4c0678c0 0x7ffa4c069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c000f90 tx=0x7ffa5c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:16.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.651+0000 7ffa62000640 1 -- 172.21.15.144:0/3854194216 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffa64005480 con 0x7ffa6c148190 2024-09-12T12:15:16.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.839+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa6c143cf0 con 0x7ffa6c148190 2024-09-12T12:15:16.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.839+0000 7ffa62000640 1 -- 172.21.15.144:0/3854194216 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7ffa64055430 con 0x7ffa6c148190 2024-09-12T12:15:16.843 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:16.843 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"btime":"2024-09-12T12:13:51:258203+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1734346147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1734346147},{"type":"v1","addr":"172.21.15.144:6835","nonce":1734346147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3346311863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3346311863},{"type":"v1","addr":"172.21.15.165:6834","nonce":3346311863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2564271519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2564271519},{"type":"v1","addr":"172.21.15.165:6835","nonce":2564271519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-12T12:13:42.597555+0000","modified":"2024-09-12T12:13:50.581922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/3288752771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3288752771},{"type":"v1","addr":"172.21.15.144:6837","nonce":3288752771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-12T12:15:16.843 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-09-12T12:15:16.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffa4c0678c0 msgr2=0x7ffa4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffa4c0678c0 0x7ffa4c069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c000f90 tx=0x7ffa5c0a7000 comp rx=0 tx=0).stop 2024-09-12T12:15:16.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6c148190 msgr2=0x7ffa6c142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:16.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6c148190 0x7ffa6c142c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c390 tx=0x7ffa6400c850 comp rx=0 tx=0).stop 2024-09-12T12:15:16.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 shutdown_connections 2024-09-12T12:15:16.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffa4c0678c0 0x7ffa4c069d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa6c148190 0x7ffa6c142c80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa6c0cd470 0x7ffa6c142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 --2- 172.21.15.144:0/3854194216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa6c0b0480 0x7ffa6c14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:16.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 >> 172.21.15.144:0/3854194216 conn(0x7ffa6c06d0d0 msgr2=0x7ffa6c0b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:16.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 shutdown_connections 2024-09-12T12:15:16.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.843+0000 7ffa70a00640 1 -- 172.21.15.144:0/3854194216 wait complete. 2024-09-12T12:15:16.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:15:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.995+0000 7f5624400640 1 Processor -- start 2024-09-12T12:15:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.995+0000 7f5624400640 1 -- start start 2024-09-12T12:15:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5624400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f561c15c7b0 0x7f561c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5624400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f561c15cd30 0x7f561c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5624400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561c0b61e0 con 0x7f561c0b5de0 2024-09-12T12:15:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5624400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f561c072a50 con 0x7f561c15c7b0 2024-09-12T12:15:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5624400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f561c0cde30 con 0x7f561c15cd30 2024-09-12T12:15:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5621a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f561c15c7b0 0x7f561c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5621a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f561c15c7b0 0x7f561c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36262/0 (socket says 172.21.15.144:36262) 2024-09-12T12:15:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5621a00640 1 -- 172.21.15.144:0/652567599 learned_addr learned my addr 172.21.15.144:0/652567599 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5622400640 1 --1- 172.21.15.144:0/652567599 >> v1:172.21.15.144:6789/0 conn(0x7f561c0b5de0 0x7f561c1601d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41614/0 (socket says 172.21.15.144:41614) 2024-09-12T12:15:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5621000640 1 --2- 172.21.15.144:0/652567599 >> v2:172.21.15.165:3300/0 conn(0x7f561c15cd30 0x7f561c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5621a00640 1 -- 172.21.15.144:0/652567599 >> v2:172.21.15.165:3300/0 conn(0x7f561c15cd30 msgr2=0x7f561c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5621a00640 1 --2- 172.21.15.144:0/652567599 >> v2:172.21.15.165:3300/0 conn(0x7f561c15cd30 0x7f561c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5621a00640 1 -- 172.21.15.144:0/652567599 >> v1:172.21.15.144:6789/0 conn(0x7f561c0b5de0 legacy=0x7f561c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:16.999+0000 7f5621a00640 1 -- 172.21.15.144:0/652567599 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c0cd870 con 0x7f561c15c7b0 2024-09-12T12:15:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5621a00640 1 --2- 172.21.15.144:0/652567599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c15c7b0 0x7f561c0ccf00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f561c0afd90 tx=0x7f561001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f34130b2b0050e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f561be00640 1 -- 172.21.15.144:0/652567599 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56100a57a0 con 0x7f561c15c7b0 2024-09-12T12:15:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f561be00640 1 -- 172.21.15.144:0/652567599 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56100a5940 con 0x7f561c15c7b0 2024-09-12T12:15:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f561be00640 1 -- 172.21.15.144:0/652567599 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56100a5d10 con 0x7f561c15c7b0 2024-09-12T12:15:17.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 -- 172.21.15.144:0/652567599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c15c7b0 msgr2=0x7f561c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 --2- 172.21.15.144:0/652567599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c15c7b0 0x7f561c0ccf00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f561c0afd90 tx=0x7f561001c9f0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 -- 172.21.15.144:0/652567599 shutdown_connections 2024-09-12T12:15:17.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 --2- 172.21.15.144:0/652567599 >> v2:172.21.15.165:3300/0 conn(0x7f561c15cd30 0x7f561c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 --2- 172.21.15.144:0/652567599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c15c7b0 0x7f561c0ccf00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 -- 172.21.15.144:0/652567599 >> 172.21.15.144:0/652567599 conn(0x7f561c06d0d0 msgr2=0x7f561c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 -- 172.21.15.144:0/652567599 shutdown_connections 2024-09-12T12:15:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 -- 172.21.15.144:0/652567599 wait complete. 2024-09-12T12:15:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 Processor -- start 2024-09-12T12:15:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 -- start start 2024-09-12T12:15:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c0b5de0 0x7f561c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f561c15c7b0 0x7f561c0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f561c15cd30 0x7f561c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f561c169320 con 0x7f561c0b5de0 2024-09-12T12:15:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f561c0cd650 con 0x7f561c15cd30 2024-09-12T12:15:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5624400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f561c1694a0 con 0x7f561c15c7b0 2024-09-12T12:15:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5621a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c0b5de0 0x7f561c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.003+0000 7f5621a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c0b5de0 0x7f561c150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36272/0 (socket says 172.21.15.144:36272) 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5621a00640 1 -- 172.21.15.144:0/2926595688 learned_addr learned my addr 172.21.15.144:0/2926595688 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5621000640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f561c15c7b0 0x7f561c0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5622400640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f561c15cd30 0x7f561c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5621a00640 1 -- 172.21.15.144:0/2926595688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f561c15c7b0 msgr2=0x7f561c0b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5621a00640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f561c15c7b0 0x7f561c0b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5621a00640 1 -- 172.21.15.144:0/2926595688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f561c15cd30 msgr2=0x7f561c14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5621a00640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f561c15cd30 0x7f561c14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5621a00640 1 -- 172.21.15.144:0/2926595688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561c0b0750 con 0x7f561c0b5de0 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5621a00640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c0b5de0 0x7f561c150d60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5610019600 tx=0x7f5610019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5619600640 1 -- 172.21.15.144:0/2926595688 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56100bc020 con 0x7f561c0b5de0 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5619600640 1 -- 172.21.15.144:0/2926595688 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56100b8670 con 0x7f561c0b5de0 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f561c0b0a30 con 0x7f561c0b5de0 2024-09-12T12:15:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5619600640 1 -- 172.21.15.144:0/2926595688 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56100b8a60 con 0x7f561c0b5de0 2024-09-12T12:15:17.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f561c0b0ff0 con 0x7f561c0b5de0 2024-09-12T12:15:17.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f561c0b3140 con 0x7f561c0b5de0 2024-09-12T12:15:17.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5619600640 1 -- 172.21.15.144:0/2926595688 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56100bf020 con 0x7f561c0b5de0 2024-09-12T12:15:17.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5619600640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55fc0678c0 0x7f55fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.007+0000 7f5619600640 1 -- 172.21.15.144:0/2926595688 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f5610120f90 con 0x7f561c0b5de0 2024-09-12T12:15:17.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.011+0000 7f5621000640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55fc0678c0 0x7f55fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.011+0000 7f5621000640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55fc0678c0 0x7f55fc069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f561c0af580 tx=0x7f5608008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.011+0000 7f5619600640 1 -- 172.21.15.144:0/2926595688 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f56100c6030 con 0x7f561c0b5de0 2024-09-12T12:15:17.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.203+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f561c15dd10 con 0x7f561c0b5de0 2024-09-12T12:15:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5619600640 1 -- 172.21.15.144:0/2926595688 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5235 (secure 0 0 0) 0x7f56100165e0 con 0x7f561c0b5de0 2024-09-12T12:15:17.208 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:17.208 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"btime":"2024-09-12T12:13:51:258203+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1734346147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1734346147},{"type":"v1","addr":"172.21.15.144:6835","nonce":1734346147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3346311863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3346311863},{"type":"v1","addr":"172.21.15.165:6834","nonce":3346311863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2564271519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2564271519},{"type":"v1","addr":"172.21.15.165:6835","nonce":2564271519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-12T12:13:42.597555+0000","modified":"2024-09-12T12:13:50.581922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/3288752771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3288752771},{"type":"v1","addr":"172.21.15.144:6837","nonce":3288752771}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-12T12:15:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-09-12T12:15:17.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55fc0678c0 msgr2=0x7f55fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55fc0678c0 0x7f55fc069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f561c0af580 tx=0x7f5608008040 comp rx=0 tx=0).stop 2024-09-12T12:15:17.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c0b5de0 msgr2=0x7f561c150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c0b5de0 0x7f561c150d60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5610019600 tx=0x7f5610019790 comp rx=0 tx=0).stop 2024-09-12T12:15:17.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 shutdown_connections 2024-09-12T12:15:17.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55fc0678c0 0x7f55fc069d80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f561c15cd30 0x7f561c14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f561c15c7b0 0x7f561c0b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 --2- 172.21.15.144:0/2926595688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f561c0b5de0 0x7f561c150d60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 >> 172.21.15.144:0/2926595688 conn(0x7f561c06d0d0 msgr2=0x7f561c15d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:17.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 shutdown_connections 2024-09-12T12:15:17.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.207+0000 7f5624400640 1 -- 172.21.15.144:0/2926595688 wait complete. 2024-09-12T12:15:17.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:15:17.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.363+0000 7f033fe00640 1 Processor -- start 2024-09-12T12:15:17.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.363+0000 7f033fe00640 1 -- start start 2024-09-12T12:15:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.363+0000 7f033fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f033815c7b0 0x7f03380ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.363+0000 7f033fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f033815cd30 0x7f03380b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.363+0000 7f033fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03380b61e0 con 0x7f03380b5de0 2024-09-12T12:15:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.363+0000 7f033fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0338072a50 con 0x7f033815c7b0 2024-09-12T12:15:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.363+0000 7f033fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f03380cde30 con 0x7f033815cd30 2024-09-12T12:15:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f033d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f033815c7b0 0x7f03380ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f033d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f033815c7b0 0x7f03380ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49406/0 (socket says 172.21.15.144:49406) 2024-09-12T12:15:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f033d400640 1 -- 172.21.15.144:0/3397115697 learned_addr learned my addr 172.21.15.144:0/3397115697 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f033ca00640 1 --2- 172.21.15.144:0/3397115697 >> v2:172.21.15.165:3300/0 conn(0x7f033815cd30 0x7f03380b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f033d400640 1 -- 172.21.15.144:0/3397115697 >> v2:172.21.15.165:3300/0 conn(0x7f033815cd30 msgr2=0x7f03380b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f033d400640 1 --2- 172.21.15.144:0/3397115697 >> v2:172.21.15.165:3300/0 conn(0x7f033815cd30 0x7f03380b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f033d400640 1 -- 172.21.15.144:0/3397115697 >> v1:172.21.15.144:6789/0 conn(0x7f03380b5de0 legacy=0x7f03381601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f033d400640 1 -- 172.21.15.144:0/3397115697 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03380cd870 con 0x7f033815c7b0 2024-09-12T12:15:17.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f033d400640 1 --2- 172.21.15.144:0/3397115697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 0x7f03380ccf00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f03380afd90 tx=0x7f032c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f893952d600338c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f0337e00640 1 -- 172.21.15.144:0/3397115697 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0a57a0 con 0x7f033815c7b0 2024-09-12T12:15:17.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f0337e00640 1 -- 172.21.15.144:0/3397115697 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c0a5940 con 0x7f033815c7b0 2024-09-12T12:15:17.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.367+0000 7f0337e00640 1 -- 172.21.15.144:0/3397115697 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c0a5d10 con 0x7f033815c7b0 2024-09-12T12:15:17.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 -- 172.21.15.144:0/3397115697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 msgr2=0x7f03380ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 --2- 172.21.15.144:0/3397115697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 0x7f03380ccf00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f03380afd90 tx=0x7f032c01c9f0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 -- 172.21.15.144:0/3397115697 shutdown_connections 2024-09-12T12:15:17.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 --2- 172.21.15.144:0/3397115697 >> v2:172.21.15.165:3300/0 conn(0x7f033815cd30 0x7f03380b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 --2- 172.21.15.144:0/3397115697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 0x7f03380ccf00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 -- 172.21.15.144:0/3397115697 >> 172.21.15.144:0/3397115697 conn(0x7f033806d0d0 msgr2=0x7f033806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:17.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 -- 172.21.15.144:0/3397115697 shutdown_connections 2024-09-12T12:15:17.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 -- 172.21.15.144:0/3397115697 wait complete. 2024-09-12T12:15:17.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 Processor -- start 2024-09-12T12:15:17.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 -- start start 2024-09-12T12:15:17.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03380b5de0 0x7f033814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 0x7f033814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f033815cd30 0x7f033814fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0338169320 con 0x7f033815c7b0 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f03380cd650 con 0x7f03380b5de0 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f03381694a0 con 0x7f033815cd30 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 0x7f033814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 0x7f033814f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49422/0 (socket says 172.21.15.144:49422) 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033ca00640 1 -- 172.21.15.144:0/449761782 learned_addr learned my addr 172.21.15.144:0/449761782 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033d400640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03380b5de0 0x7f033814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033de00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f033815cd30 0x7f033814fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033ca00640 1 -- 172.21.15.144:0/449761782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f033815cd30 msgr2=0x7f033814fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033ca00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f033815cd30 0x7f033814fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033ca00640 1 -- 172.21.15.144:0/449761782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03380b5de0 msgr2=0x7f033814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033ca00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03380b5de0 0x7f033814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.371+0000 7f033ca00640 1 -- 172.21.15.144:0/449761782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03380b2920 con 0x7f033815c7b0 2024-09-12T12:15:17.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f033ca00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 0x7f033814f810 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f032400e8a0 tx=0x7f032400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f0335600640 1 -- 172.21.15.144:0/449761782 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0324017070 con 0x7f033815c7b0 2024-09-12T12:15:17.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f0335600640 1 -- 172.21.15.144:0/449761782 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032400c940 con 0x7f033815c7b0 2024-09-12T12:15:17.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f0335600640 1 -- 172.21.15.144:0/449761782 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032400ccf0 con 0x7f033815c7b0 2024-09-12T12:15:17.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03380b2c00 con 0x7f033815c7b0 2024-09-12T12:15:17.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03380b2120 con 0x7f033815c7b0 2024-09-12T12:15:17.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03380b3140 con 0x7f033815c7b0 2024-09-12T12:15:17.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f0335600640 1 -- 172.21.15.144:0/449761782 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f032401a070 con 0x7f033815c7b0 2024-09-12T12:15:17.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f0335600640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03180678c0 0x7f0318069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f0335600640 1 -- 172.21.15.144:0/449761782 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7f0324085fe0 con 0x7f033815c7b0 2024-09-12T12:15:17.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.375+0000 7f033d400640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03180678c0 0x7f0318069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.379+0000 7f033d400640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03180678c0 0x7f0318069d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f032c0ae000 tx=0x7f032c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.379+0000 7f0335600640 1 -- 172.21.15.144:0/449761782 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0324056360 con 0x7f033815c7b0 2024-09-12T12:15:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.543+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03380b2dd0 con 0x7f033815c7b0 2024-09-12T12:15:17.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.543+0000 7f0335600640 1 -- 172.21.15.144:0/449761782 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+17140 (secure 0 0 0) 0x7f032405a660 con 0x7f033815c7b0 2024-09-12T12:15:17.546 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:17.546 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":43,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:14:55.171678+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:13:40.307199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T12:13:41.588661+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":42,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:15:17.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03180678c0 msgr2=0x7f0318069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03180678c0 0x7f0318069d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f032c0ae000 tx=0x7f032c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:15:17.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 msgr2=0x7f033814f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 0x7f033814f810 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f032400e8a0 tx=0x7f032400eca0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 shutdown_connections 2024-09-12T12:15:17.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03180678c0 0x7f0318069d80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f033815cd30 0x7f033814fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033815c7b0 0x7f033814f810 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 --2- 172.21.15.144:0/449761782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03380b5de0 0x7f033814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 >> 172.21.15.144:0/449761782 conn(0x7f033806d0d0 msgr2=0x7f033815d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:17.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 shutdown_connections 2024-09-12T12:15:17.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.547+0000 7f033fe00640 1 -- 172.21.15.144:0/449761782 wait complete. 2024-09-12T12:15:17.568 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:15:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81a00640 1 Processor -- start 2024-09-12T12:15:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81a00640 1 -- start start 2024-09-12T12:15:17.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15b100 0x7fec7c0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec7c06ebc0 0x7fec7c15f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec7c15fa90 con 0x7fec7c15ec40 2024-09-12T12:15:17.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fec7c15f7b0 con 0x7fec7c06ebc0 2024-09-12T12:15:17.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec7c0b47d0 con 0x7fec7c15b100 2024-09-12T12:15:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec7c06ebc0 0x7fec7c15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec7b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fec7c15ec40 0x7fec7c06e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47870/0 (socket says 172.21.15.144:47870) 2024-09-12T12:15:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec7b400640 1 -- 172.21.15.144:0/3293146323 learned_addr learned my addr 172.21.15.144:0/3293146323 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec7be00640 1 --2- 172.21.15.144:0/3293146323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15b100 0x7fec7c0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81000640 1 -- 172.21.15.144:0/3293146323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15b100 msgr2=0x7fec7c0b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81000640 1 --2- 172.21.15.144:0/3293146323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15b100 0x7fec7c0b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81000640 1 -- 172.21.15.144:0/3293146323 >> v1:172.21.15.144:6789/0 conn(0x7fec7c15ec40 legacy=0x7fec7c06e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec81000640 1 -- 172.21.15.144:0/3293146323 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c0b4ab0 con 0x7fec7c06ebc0 2024-09-12T12:15:17.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.703+0000 7fec7aa00640 1 -- 172.21.15.144:0/3293146323 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719441534 0 0) 0x7fec7c15fa90 con 0x7fec7c15ec40 2024-09-12T12:15:17.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec81000640 1 --2- 172.21.15.144:0/3293146323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c06ebc0 0x7fec7c15f080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fec740097c0 tx=0x7fec7401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c92e854cf615f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec7aa00640 1 -- 172.21.15.144:0/3293146323 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec740b0070 con 0x7fec7c06ebc0 2024-09-12T12:15:17.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec7aa00640 1 -- 172.21.15.144:0/3293146323 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec740ab600 con 0x7fec7c06ebc0 2024-09-12T12:15:17.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec7aa00640 1 -- 172.21.15.144:0/3293146323 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec740ab9d0 con 0x7fec7c06ebc0 2024-09-12T12:15:17.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec81a00640 1 -- 172.21.15.144:0/3293146323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c06ebc0 msgr2=0x7fec7c15f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec81a00640 1 --2- 172.21.15.144:0/3293146323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c06ebc0 0x7fec7c15f080 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fec740097c0 tx=0x7fec7401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec81a00640 1 -- 172.21.15.144:0/3293146323 shutdown_connections 2024-09-12T12:15:17.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec81a00640 1 --2- 172.21.15.144:0/3293146323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c06ebc0 0x7fec7c15f080 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec81a00640 1 --2- 172.21.15.144:0/3293146323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15b100 0x7fec7c0b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec81a00640 1 -- 172.21.15.144:0/3293146323 >> 172.21.15.144:0/3293146323 conn(0x7fec7c0b6720 msgr2=0x7fec7c0b6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:17.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec81a00640 1 -- 172.21.15.144:0/3293146323 shutdown_connections 2024-09-12T12:15:17.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.707+0000 7fec81a00640 1 -- 172.21.15.144:0/3293146323 wait complete. 2024-09-12T12:15:17.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 Processor -- start 2024-09-12T12:15:17.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 -- start start 2024-09-12T12:15:17.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7c06ebc0 0x7fec7c15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c15b100 0x7fec7c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15ec40 0x7fec7c14cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c0ce4a0 con 0x7fec7c15b100 2024-09-12T12:15:17.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c0b57f0 con 0x7fec7c06ebc0 2024-09-12T12:15:17.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec7c0ce620 con 0x7fec7c15ec40 2024-09-12T12:15:17.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c15b100 0x7fec7c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c15b100 0x7fec7c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49436/0 (socket says 172.21.15.144:49436) 2024-09-12T12:15:17.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7b400640 1 -- 172.21.15.144:0/4095776474 learned_addr learned my addr 172.21.15.144:0/4095776474 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7be00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7c06ebc0 0x7fec7c15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81000640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15ec40 0x7fec7c14cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7b400640 1 -- 172.21.15.144:0/4095776474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15ec40 msgr2=0x7fec7c14cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7b400640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15ec40 0x7fec7c14cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7b400640 1 -- 172.21.15.144:0/4095776474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7c06ebc0 msgr2=0x7fec7c15b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7b400640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7c06ebc0 0x7fec7c15b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7b400640 1 -- 172.21.15.144:0/4095776474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c151540 con 0x7fec7c15b100 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7be00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7c06ebc0 0x7fec7c15b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec7b400640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c15b100 0x7fec7c157fd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c480 tx=0x7fec6800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec73e00640 1 -- 172.21.15.144:0/4095776474 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68018070 con 0x7fec7c15b100 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec73e00640 1 -- 172.21.15.144:0/4095776474 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec680074e0 con 0x7fec7c15b100 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c152e50 con 0x7fec7c15b100 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec73e00640 1 -- 172.21.15.144:0/4095776474 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec680049f0 con 0x7fec7c15b100 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c14dfa0 con 0x7fec7c15b100 2024-09-12T12:15:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.711+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c15f080 con 0x7fec7c15b100 2024-09-12T12:15:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.715+0000 7fec73e00640 1 -- 172.21.15.144:0/4095776474 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec6801b070 con 0x7fec7c15b100 2024-09-12T12:15:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.715+0000 7fec73e00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec5c0678c0 0x7fec5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.715+0000 7fec73e00640 1 -- 172.21.15.144:0/4095776474 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6158+0+0 (secure 0 0 0) 0x7fec68085210 con 0x7fec7c15b100 2024-09-12T12:15:17.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.715+0000 7fec7be00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec5c0678c0 0x7fec5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.715+0000 7fec7be00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec5c0678c0 0x7fec5c069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fec6c007520 tx=0x7fec6c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.719+0000 7fec73e00640 1 -- 172.21.15.144:0/4095776474 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec68055c20 con 0x7fec7c15b100 2024-09-12T12:15:17.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.911+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fec7c155cb0 con 0x7fec7c15b100 2024-09-12T12:15:17.914 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:15:17.911+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:15:17.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.911+0000 7fec73e00640 1 -- 172.21.15.144:0/4095776474 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fec68055520 con 0x7fec7c15b100 2024-09-12T12:15:17.916 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:15:17.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec5c0678c0 msgr2=0x7fec5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec5c0678c0 0x7fec5c069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fec6c007520 tx=0x7fec6c00b040 comp rx=0 tx=0).stop 2024-09-12T12:15:17.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c15b100 msgr2=0x7fec7c157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c15b100 0x7fec7c157fd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fec6800c480 tx=0x7fec6800c940 comp rx=0 tx=0).stop 2024-09-12T12:15:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 shutdown_connections 2024-09-12T12:15:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec5c0678c0 0x7fec5c069d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7c15ec40 0x7fec7c14cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec7c15b100 0x7fec7c157fd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 --2- 172.21.15.144:0/4095776474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7c06ebc0 0x7fec7c15b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 >> 172.21.15.144:0/4095776474 conn(0x7fec7c0b6720 msgr2=0x7fec7c075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 shutdown_connections 2024-09-12T12:15:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:17.915+0000 7fec81a00640 1 -- 172.21.15.144:0/4095776474 wait complete. 2024-09-12T12:15:17.941 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:15:17.990 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:15:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.079+0000 7f8ad2c00640 1 Processor -- start 2024-09-12T12:15:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.079+0000 7f8ad2c00640 1 -- start start 2024-09-12T12:15:18.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8ad2c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8acc15af60 0x7f8acc0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:18.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8ad2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0cd9f0 0x7f8acc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:18.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8ad2c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8acc0b4300 con 0x7f8acc15b340 2024-09-12T12:15:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8ad2c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8acc0b32f0 con 0x7f8acc15af60 2024-09-12T12:15:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8ad2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8acc0b3540 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8acbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8acc15af60 0x7f8acc0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8acbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8acc15af60 0x7f8acc0ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49454/0 (socket says 172.21.15.144:49454) 2024-09-12T12:15:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8acbe00640 1 -- 172.21.15.144:0/3725851973 learned_addr learned my addr 172.21.15.144:0/3725851973 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:18.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8acb400640 1 --2- 172.21.15.144:0/3725851973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0cd9f0 0x7f8acc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:18.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8acbe00640 1 -- 172.21.15.144:0/3725851973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0cd9f0 msgr2=0x7f8acc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:18.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8acbe00640 1 --2- 172.21.15.144:0/3725851973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0cd9f0 0x7f8acc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8acbe00640 1 -- 172.21.15.144:0/3725851973 >> v1:172.21.15.165:6789/0 conn(0x7f8acc15b340 legacy=0x7f8acc15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:18.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.083+0000 7f8acbe00640 1 -- 172.21.15.144:0/3725851973 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8acc0b3820 con 0x7f8acc15af60 2024-09-12T12:15:18.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8acbe00640 1 --2- 172.21.15.144:0/3725851973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc15af60 0x7f8acc0ce680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009870 tx=0x7f8abc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9201ee79319b06e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:18.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8acaa00640 1 -- 172.21.15.144:0/3725851973 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0b5070 con 0x7f8acc15af60 2024-09-12T12:15:18.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8acaa00640 1 -- 172.21.15.144:0/3725851973 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc0a8a50 con 0x7f8acc15af60 2024-09-12T12:15:18.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8acaa00640 1 -- 172.21.15.144:0/3725851973 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0a8e20 con 0x7f8acc15af60 2024-09-12T12:15:18.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 -- 172.21.15.144:0/3725851973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc15af60 msgr2=0x7f8acc0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:18.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 --2- 172.21.15.144:0/3725851973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc15af60 0x7f8acc0ce680 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009870 tx=0x7f8abc01ed50 comp rx=0 tx=0).stop 2024-09-12T12:15:18.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 -- 172.21.15.144:0/3725851973 shutdown_connections 2024-09-12T12:15:18.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 --2- 172.21.15.144:0/3725851973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc0cd9f0 0x7f8acc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 --2- 172.21.15.144:0/3725851973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc15af60 0x7f8acc0ce680 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 -- 172.21.15.144:0/3725851973 >> 172.21.15.144:0/3725851973 conn(0x7f8acc068030 msgr2=0x7f8acc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 -- 172.21.15.144:0/3725851973 shutdown_connections 2024-09-12T12:15:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 -- 172.21.15.144:0/3725851973 wait complete. 2024-09-12T12:15:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 Processor -- start 2024-09-12T12:15:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 -- start start 2024-09-12T12:15:18.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc0cd9f0 0x7f8acc148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:18.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc15af60 0x7f8acc159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:18.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc15b340 0x7f8acc0aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:18.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc0b5570 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc0b3de0 con 0x7f8acc15af60 2024-09-12T12:15:18.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.087+0000 7f8ad2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8acc0cebc0 con 0x7f8acc15b340 2024-09-12T12:15:18.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc0cd9f0 0x7f8acc148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:18.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc0cd9f0 0x7f8acc148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49456/0 (socket says 172.21.15.144:49456) 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acbe00640 1 -- 172.21.15.144:0/425216155 learned_addr learned my addr 172.21.15.144:0/425216155 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acb400640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc15af60 0x7f8acc159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ad0c00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc15b340 0x7f8acc0aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acbe00640 1 -- 172.21.15.144:0/425216155 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc15b340 msgr2=0x7f8acc0aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acbe00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc15b340 0x7f8acc0aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acbe00640 1 -- 172.21.15.144:0/425216155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc15af60 msgr2=0x7f8acc159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acbe00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc15af60 0x7f8acc159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acbe00640 1 -- 172.21.15.144:0/425216155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8acc1497a0 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ad0c00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc15b340 0x7f8acc0aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8acbe00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc0cd9f0 0x7f8acc148d60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0b3040 tx=0x7f8abc01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ac3e00640 1 -- 172.21.15.144:0/425216155 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0c0070 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ac3e00640 1 -- 172.21.15.144:0/425216155 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc0ae550 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8acc15d780 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ac3e00640 1 -- 172.21.15.144:0/425216155 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0b5070 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8acc15dd40 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8acc0ce680 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ac3e00640 1 -- 172.21.15.144:0/425216155 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8abc0c3070 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ac3e00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8aac0678c0 0x7f8aac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:18.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.091+0000 7f8ac3e00640 1 -- 172.21.15.144:0/425216155 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f8abc123670 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.095+0000 7f8acb400640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8aac0678c0 0x7f8aac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:18.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.095+0000 7f8acb400640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8aac0678c0 0x7f8aac069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0b1f50 tx=0x7f8ab8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:18.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.095+0000 7f8ac3e00640 1 -- 172.21.15.144:0/425216155 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8acc1497a0 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.295+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8acc15fa60 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.915+0000 7f8ac3e00640 1 -- 172.21.15.144:0/425216155 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f8abc0188b0 con 0x7f8acc0cd9f0 2024-09-12T12:15:18.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8aac0678c0 msgr2=0x7f8aac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:18.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8aac0678c0 0x7f8aac069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0b1f50 tx=0x7f8ab8008040 comp rx=0 tx=0).stop 2024-09-12T12:15:18.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc0cd9f0 msgr2=0x7f8acc148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:18.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc0cd9f0 0x7f8acc148d60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8abc0b3040 tx=0x7f8abc01baf0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 shutdown_connections 2024-09-12T12:15:18.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8aac0678c0 0x7f8aac069d80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8acc15b340 0x7f8acc0aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8acc15af60 0x7f8acc159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 --2- 172.21.15.144:0/425216155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8acc0cd9f0 0x7f8acc148d60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:18.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 >> 172.21.15.144:0/425216155 conn(0x7f8acc068030 msgr2=0x7f8acc14b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 shutdown_connections 2024-09-12T12:15:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:18.919+0000 7f8ad2c00640 1 -- 172.21.15.144:0/425216155 wait complete. 2024-09-12T12:15:18.944 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:15:19.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b54400640 1 Processor -- start 2024-09-12T12:15:19.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b54400640 1 -- start start 2024-09-12T12:15:19.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b54400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 0x7f6b4c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b54400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b4c073360 0x7f6b4c073810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b54400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4c06cd20 con 0x7f6b4c156c10 2024-09-12T12:15:19.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b54400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4c073d50 con 0x7f6b4c073360 2024-09-12T12:15:19.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b54400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4c06d990 con 0x7f6b4c06cff0 2024-09-12T12:15:19.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b52400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b4c073360 0x7f6b4c073810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b52400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b4c073360 0x7f6b4c073810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49460/0 (socket says 172.21.15.144:49460) 2024-09-12T12:15:19.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b52400640 1 -- 172.21.15.144:0/1064126392 learned_addr learned my addr 172.21.15.144:0/1064126392 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:19.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b51000640 1 --2- 172.21.15.144:0/1064126392 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 0x7f6b4c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b52400640 1 -- 172.21.15.144:0/1064126392 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 msgr2=0x7f6b4c06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:19.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b52400640 1 --2- 172.21.15.144:0/1064126392 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 0x7f6b4c06d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b52400640 1 -- 172.21.15.144:0/1064126392 >> v1:172.21.15.165:6789/0 conn(0x7f6b4c156c10 legacy=0x7f6b4c072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.087+0000 7f6b52400640 1 -- 172.21.15.144:0/1064126392 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c072780 con 0x7f6b4c073360 2024-09-12T12:15:19.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b52400640 1 --2- 172.21.15.144:0/1064126392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 0x7f6b4c073810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009e80 tx=0x7f6b4401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c73de5de449b631 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:19.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b4be00640 1 -- 172.21.15.144:0/1064126392 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b440a57f0 con 0x7f6b4c073360 2024-09-12T12:15:19.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b4be00640 1 -- 172.21.15.144:0/1064126392 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b440a5990 con 0x7f6b4c073360 2024-09-12T12:15:19.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b4be00640 1 -- 172.21.15.144:0/1064126392 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b440a5d60 con 0x7f6b4c073360 2024-09-12T12:15:19.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 -- 172.21.15.144:0/1064126392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 msgr2=0x7f6b4c073810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 --2- 172.21.15.144:0/1064126392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 0x7f6b4c073810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009e80 tx=0x7f6b4401ca10 comp rx=0 tx=0).stop 2024-09-12T12:15:19.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 -- 172.21.15.144:0/1064126392 shutdown_connections 2024-09-12T12:15:19.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 --2- 172.21.15.144:0/1064126392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 0x7f6b4c073810 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 --2- 172.21.15.144:0/1064126392 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 0x7f6b4c06d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 -- 172.21.15.144:0/1064126392 >> 172.21.15.144:0/1064126392 conn(0x7f6b4c06bc10 msgr2=0x7f6b4c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:19.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 -- 172.21.15.144:0/1064126392 shutdown_connections 2024-09-12T12:15:19.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 -- 172.21.15.144:0/1064126392 wait complete. 2024-09-12T12:15:19.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 Processor -- start 2024-09-12T12:15:19.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.091+0000 7f6b54400640 1 -- start start 2024-09-12T12:15:19.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b54400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 0x7f6b4c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b54400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 0x7f6b4c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b54400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b4c156c10 0x7f6b4c14b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b54400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c156ff0 con 0x7f6b4c073360 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b54400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c073f70 con 0x7f6b4c156c10 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b54400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4c157170 con 0x7f6b4c06cff0 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 0x7f6b4c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 0x7f6b4c1592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49472/0 (socket says 172.21.15.144:49472) 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51000640 1 -- 172.21.15.144:0/2711798207 learned_addr learned my addr 172.21.15.144:0/2711798207 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b52400640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b4c156c10 0x7f6b4c14b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51a00640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 0x7f6b4c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51000640 1 -- 172.21.15.144:0/2711798207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 msgr2=0x7f6b4c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51000640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 0x7f6b4c159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51000640 1 -- 172.21.15.144:0/2711798207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b4c156c10 msgr2=0x7f6b4c14b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51000640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b4c156c10 0x7f6b4c14b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51000640 1 -- 172.21.15.144:0/2711798207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c159970 con 0x7f6b4c073360 2024-09-12T12:15:19.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b51000640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 0x7f6b4c1592b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800d7d0 tx=0x7f6b3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:19.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b49600640 1 -- 172.21.15.144:0/2711798207 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38004030 con 0x7f6b4c073360 2024-09-12T12:15:19.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b49600640 1 -- 172.21.15.144:0/2711798207 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b380041d0 con 0x7f6b4c073360 2024-09-12T12:15:19.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b49600640 1 -- 172.21.15.144:0/2711798207 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800b6c0 con 0x7f6b4c073360 2024-09-12T12:15:19.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c155520 con 0x7f6b4c073360 2024-09-12T12:15:19.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c155ae0 con 0x7f6b4c073360 2024-09-12T12:15:19.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4c06d450 con 0x7f6b4c073360 2024-09-12T12:15:19.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.095+0000 7f6b49600640 1 -- 172.21.15.144:0/2711798207 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b3800b860 con 0x7f6b4c073360 2024-09-12T12:15:19.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.099+0000 7f6b49600640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b2c0678c0 0x7f6b2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.099+0000 7f6b49600640 1 -- 172.21.15.144:0/2711798207 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6216+0+0 (secure 0 0 0) 0x7f6b38086100 con 0x7f6b4c073360 2024-09-12T12:15:19.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.099+0000 7f6b51a00640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b2c0678c0 0x7f6b2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.099+0000 7f6b51a00640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b2c0678c0 0x7f6b2c069d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c06c4a0 tx=0x7f6b40009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:19.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.103+0000 7f6b49600640 1 -- 172.21.15.144:0/2711798207 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b380563e0 con 0x7f6b4c073360 2024-09-12T12:15:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.267+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6b4c15ffa0 con 0x7f6b4c073360 2024-09-12T12:15:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.919+0000 7f6b49600640 1 -- 172.21.15.144:0/2711798207 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) ==== 181+0+0 (secure 0 0 0) 0x7f6b3805a6e0 con 0x7f6b4c073360 2024-09-12T12:15:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:15:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.919+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b2c0678c0 msgr2=0x7f6b2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.919+0000 7f6b54400640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b2c0678c0 0x7f6b2c069d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c06c4a0 tx=0x7f6b40009040 comp rx=0 tx=0).stop 2024-09-12T12:15:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.919+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 msgr2=0x7f6b4c1592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.919+0000 7f6b54400640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 0x7f6b4c1592b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800d7d0 tx=0x7f6b3800dc90 comp rx=0 tx=0).stop 2024-09-12T12:15:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.923+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 shutdown_connections 2024-09-12T12:15:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.923+0000 7f6b54400640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b2c0678c0 0x7f6b2c069d80 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c06c4a0 tx=0x7f6b40009040 comp rx=0 tx=0).stop 2024-09-12T12:15:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.923+0000 7f6b54400640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b4c156c10 0x7f6b4c14b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.923+0000 7f6b54400640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b4c073360 0x7f6b4c1592b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.923+0000 7f6b54400640 1 --2- 172.21.15.144:0/2711798207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b4c06cff0 0x7f6b4c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.923+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 >> 172.21.15.144:0/2711798207 conn(0x7f6b4c06bc10 msgr2=0x7f6b4c14c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.923+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 shutdown_connections 2024-09-12T12:15:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:19.923+0000 7f6b54400640 1 -- 172.21.15.144:0/2711798207 wait complete. 2024-09-12T12:15:19.950 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:15:20.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.091+0000 7f661ae00640 1 Processor -- start 2024-09-12T12:15:20.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.091+0000 7f661ae00640 1 -- start start 2024-09-12T12:15:20.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.091+0000 7f661ae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f661415dd20 0x7f661406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:20.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.091+0000 7f661ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66140c6480 0x7f66140c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:20.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.091+0000 7f661ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f661406c1f0 con 0x7f6614145e80 2024-09-12T12:15:20.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.091+0000 7f661ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f66140c6e30 con 0x7f66140c6480 2024-09-12T12:15:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.091+0000 7f661ae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f661406c4d0 con 0x7f661415dd20 2024-09-12T12:15:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6618e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66140c6480 0x7f66140c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6618e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66140c6480 0x7f66140c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49484/0 (socket says 172.21.15.144:49484) 2024-09-12T12:15:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6618e00640 1 -- 172.21.15.144:0/3134894997 learned_addr learned my addr 172.21.15.144:0/3134894997 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6613400640 1 --2- 172.21.15.144:0/3134894997 >> v2:172.21.15.165:3300/0 conn(0x7f661415dd20 0x7f661406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6618e00640 1 -- 172.21.15.144:0/3134894997 >> v2:172.21.15.165:3300/0 conn(0x7f661415dd20 msgr2=0x7f661406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6618e00640 1 --2- 172.21.15.144:0/3134894997 >> v2:172.21.15.165:3300/0 conn(0x7f661415dd20 0x7f661406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6618e00640 1 -- 172.21.15.144:0/3134894997 >> v1:172.21.15.165:6789/0 conn(0x7f6614145e80 legacy=0x7f66140d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:20.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6618e00640 1 -- 172.21.15.144:0/3134894997 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6614072120 con 0x7f66140c6480 2024-09-12T12:15:20.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6618e00640 1 --2- 172.21.15.144:0/3134894997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140c6480 0x7f66140c68f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f660c009e50 tx=0x7f660c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5051a5d5ff77cad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:20.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6612a00640 1 -- 172.21.15.144:0/3134894997 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c0a5710 con 0x7f66140c6480 2024-09-12T12:15:20.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6612a00640 1 -- 172.21.15.144:0/3134894997 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c0a58b0 con 0x7f66140c6480 2024-09-12T12:15:20.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.095+0000 7f6612a00640 1 -- 172.21.15.144:0/3134894997 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c0a5c80 con 0x7f66140c6480 2024-09-12T12:15:20.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 -- 172.21.15.144:0/3134894997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140c6480 msgr2=0x7f66140c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:20.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 --2- 172.21.15.144:0/3134894997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140c6480 0x7f66140c68f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f660c009e50 tx=0x7f660c01c870 comp rx=0 tx=0).stop 2024-09-12T12:15:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 -- 172.21.15.144:0/3134894997 shutdown_connections 2024-09-12T12:15:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 --2- 172.21.15.144:0/3134894997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66140c6480 0x7f66140c68f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 --2- 172.21.15.144:0/3134894997 >> v2:172.21.15.165:3300/0 conn(0x7f661415dd20 0x7f661406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 -- 172.21.15.144:0/3134894997 >> 172.21.15.144:0/3134894997 conn(0x7f661406cd20 msgr2=0x7f661406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 -- 172.21.15.144:0/3134894997 shutdown_connections 2024-09-12T12:15:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 -- 172.21.15.144:0/3134894997 wait complete. 2024-09-12T12:15:20.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 Processor -- start 2024-09-12T12:15:20.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 -- start start 2024-09-12T12:15:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140c6480 0x7f66140cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614145e80 0x7f661413ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415dd20 0x7f661414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f661415d4e0 con 0x7f6614145e80 2024-09-12T12:15:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f661415d360 con 0x7f661415dd20 2024-09-12T12:15:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f661ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f661415d660 con 0x7f66140c6480 2024-09-12T12:15:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6613400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614145e80 0x7f661413ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6613400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614145e80 0x7f661413ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49488/0 (socket says 172.21.15.144:49488) 2024-09-12T12:15:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6613400640 1 -- 172.21.15.144:0/1598956375 learned_addr learned my addr 172.21.15.144:0/1598956375 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6618e00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415dd20 0x7f661414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6613e00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140c6480 0x7f66140cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6613400640 1 -- 172.21.15.144:0/1598956375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140c6480 msgr2=0x7f66140cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6613400640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140c6480 0x7f66140cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6613400640 1 -- 172.21.15.144:0/1598956375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415dd20 msgr2=0x7f661414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6613400640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415dd20 0x7f661414ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.099+0000 7f6613400640 1 -- 172.21.15.144:0/1598956375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661413d1f0 con 0x7f6614145e80 2024-09-12T12:15:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f6613400640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614145e80 0x7f661413ca80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f660000e870 tx=0x7f660000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:20.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f660be00640 1 -- 172.21.15.144:0/1598956375 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600017070 con 0x7f6614145e80 2024-09-12T12:15:20.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f660be00640 1 -- 172.21.15.144:0/1598956375 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660000c940 con 0x7f6614145e80 2024-09-12T12:15:20.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f661413d4d0 con 0x7f6614145e80 2024-09-12T12:15:20.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f660be00640 1 -- 172.21.15.144:0/1598956375 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660000cd10 con 0x7f6614145e80 2024-09-12T12:15:20.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661413da90 con 0x7f6614145e80 2024-09-12T12:15:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66140c68f0 con 0x7f6614145e80 2024-09-12T12:15:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f660be00640 1 -- 172.21.15.144:0/1598956375 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f660001a070 con 0x7f6614145e80 2024-09-12T12:15:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f660be00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f660be00640 1 -- 172.21.15.144:0/1598956375 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5778+0+0 (secure 0 0 0) 0x7f6600085fe0 con 0x7f6614145e80 2024-09-12T12:15:20.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.103+0000 7f6613e00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:20.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.107+0000 7f6613e00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6604001650 tx=0x7f6604009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:20.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.107+0000 7f660be00640 1 -- 172.21.15.144:0/1598956375 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6600056390 con 0x7f6614145e80 2024-09-12T12:15:20.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.271+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f66140b5940 con 0x7f6614145e80 2024-09-12T12:15:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.919+0000 7f660be00640 1 -- 172.21.15.144:0/1598956375 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) ==== 169+0+0 (secure 0 0 0) 0x7f660005a690 con 0x7f6614145e80 2024-09-12T12:15:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:15:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 msgr2=0x7f65f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6604001650 tx=0x7f6604009040 comp rx=0 tx=0).stop 2024-09-12T12:15:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614145e80 msgr2=0x7f661413ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614145e80 0x7f661413ca80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f660000e870 tx=0x7f660000ed30 comp rx=0 tx=0).stop 2024-09-12T12:15:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 shutdown_connections 2024-09-12T12:15:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f661415dd20 0x7f661414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614145e80 0x7f661413ca80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 --2- 172.21.15.144:0/1598956375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140c6480 0x7f66140cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 >> 172.21.15.144:0/1598956375 conn(0x7f661406cd20 msgr2=0x7f6614075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 shutdown_connections 2024-09-12T12:15:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:20.923+0000 7f661ae00640 1 -- 172.21.15.144:0/1598956375 wait complete. 2024-09-12T12:15:20.950 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:15:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb2a000640 1 Processor -- start 2024-09-12T12:15:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb2a000640 1 -- start start 2024-09-12T12:15:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb2a000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feb240cd9f0 0x7feb2406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb2a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb2406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb2a000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb240b4300 con 0x7feb2415af60 2024-09-12T12:15:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb2a000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7feb240b32f0 con 0x7feb240cd9f0 2024-09-12T12:15:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb2a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb240b3540 con 0x7feb2415b340 2024-09-12T12:15:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb22a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feb240cd9f0 0x7feb2406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb23e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb2406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb22a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feb240cd9f0 0x7feb2406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:38142/0 (socket says 172.21.15.144:38142) 2024-09-12T12:15:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb23400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7feb2415af60 0x7feb240ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:39296/0 (socket says 172.21.15.144:39296) 2024-09-12T12:15:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb23e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb2406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:38798/0 (socket says 172.21.15.144:38798) 2024-09-12T12:15:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.087+0000 7feb22a00640 1 -- 172.21.15.144:0/599440330 learned_addr learned my addr 172.21.15.144:0/599440330 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb22a00640 1 -- 172.21.15.144:0/599440330 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 msgr2=0x7feb2406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb22a00640 1 --2- 172.21.15.144:0/599440330 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb2406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb22a00640 1 -- 172.21.15.144:0/599440330 >> v1:172.21.15.165:6789/0 conn(0x7feb2415af60 legacy=0x7feb240ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb22a00640 1 -- 172.21.15.144:0/599440330 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb240b3820 con 0x7feb240cd9f0 2024-09-12T12:15:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb22000640 1 -- 172.21.15.144:0/599440330 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341206776 0 0) 0x7feb240b4300 con 0x7feb2415af60 2024-09-12T12:15:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb23e00640 1 --2- 172.21.15.144:0/599440330 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb2406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb22a00640 1 --2- 172.21.15.144:0/599440330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb240cd9f0 0x7feb2406bc10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feb10009870 tx=0x7feb1001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=925e1725750d4305 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb22000640 1 -- 172.21.15.144:0/599440330 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb100b2070 con 0x7feb240cd9f0 2024-09-12T12:15:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb22000640 1 -- 172.21.15.144:0/599440330 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb100a9070 con 0x7feb240cd9f0 2024-09-12T12:15:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb22000640 1 -- 172.21.15.144:0/599440330 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb100ad880 con 0x7feb240cd9f0 2024-09-12T12:15:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb2a000640 1 -- 172.21.15.144:0/599440330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb240cd9f0 msgr2=0x7feb2406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.091+0000 7feb2a000640 1 --2- 172.21.15.144:0/599440330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb240cd9f0 0x7feb2406bc10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feb10009870 tx=0x7feb1001c560 comp rx=0 tx=0).stop 2024-09-12T12:15:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 -- 172.21.15.144:0/599440330 shutdown_connections 2024-09-12T12:15:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 --2- 172.21.15.144:0/599440330 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb2406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 --2- 172.21.15.144:0/599440330 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb240cd9f0 0x7feb2406bc10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 -- 172.21.15.144:0/599440330 >> 172.21.15.144:0/599440330 conn(0x7feb24068030 msgr2=0x7feb240b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 -- 172.21.15.144:0/599440330 shutdown_connections 2024-09-12T12:15:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 -- 172.21.15.144:0/599440330 wait complete. 2024-09-12T12:15:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 Processor -- start 2024-09-12T12:15:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 -- start start 2024-09-12T12:15:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb240cd9f0 0x7feb24155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2415af60 0x7feb24157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb24149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feb240b5180 con 0x7feb240cd9f0 2024-09-12T12:15:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb240b5000 con 0x7feb2415af60 2024-09-12T12:15:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb2a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb240b5300 con 0x7feb2415b340 2024-09-12T12:15:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb240cd9f0 0x7feb24155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb240cd9f0 0x7feb24155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49504/0 (socket says 172.21.15.144:49504) 2024-09-12T12:15:21.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23400640 1 -- 172.21.15.144:0/4001788221 learned_addr learned my addr 172.21.15.144:0/4001788221 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb22a00640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2415af60 0x7feb24157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23e00640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb24149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23400640 1 -- 172.21.15.144:0/4001788221 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 msgr2=0x7feb24149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23400640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb24149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23400640 1 -- 172.21.15.144:0/4001788221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2415af60 msgr2=0x7feb24157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23400640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2415af60 0x7feb24157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23400640 1 -- 172.21.15.144:0/4001788221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb24157920 con 0x7feb240cd9f0 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.095+0000 7feb23400640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb240cd9f0 0x7feb24155980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7feb140011f0 tx=0x7feb1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb1b400640 1 -- 172.21.15.144:0/4001788221 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb140074e0 con 0x7feb240cd9f0 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb1b400640 1 -- 172.21.15.144:0/4001788221 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb140047f0 con 0x7feb240cd9f0 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb24157c00 con 0x7feb240cd9f0 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb1b400640 1 -- 172.21.15.144:0/4001788221 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14007680 con 0x7feb240cd9f0 2024-09-12T12:15:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2415e2e0 con 0x7feb240cd9f0 2024-09-12T12:15:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb240ce680 con 0x7feb240cd9f0 2024-09-12T12:15:21.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb1b400640 1 -- 172.21.15.144:0/4001788221 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb14011070 con 0x7feb240cd9f0 2024-09-12T12:15:21.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb1b400640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb040678c0 0x7feb04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb1b400640 1 -- 172.21.15.144:0/4001788221 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7feb14085700 con 0x7feb240cd9f0 2024-09-12T12:15:21.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb22a00640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb040678c0 0x7feb04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.099+0000 7feb22a00640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb040678c0 0x7feb04069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb100af000 tx=0x7feb100a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:21.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.103+0000 7feb1b400640 1 -- 172.21.15.144:0/4001788221 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feb14056390 con 0x7feb240cd9f0 2024-09-12T12:15:21.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.279+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7feb240afc20 con 0x7feb240cd9f0 2024-09-12T12:15:21.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.283+0000 7feb1b400640 1 -- 172.21.15.144:0/4001788221 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7feb14055c90 con 0x7feb240cd9f0 2024-09-12T12:15:21.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb040678c0 msgr2=0x7feb04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb040678c0 0x7feb04069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb100af000 tx=0x7feb100a7000 comp rx=0 tx=0).stop 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb240cd9f0 msgr2=0x7feb24155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb240cd9f0 0x7feb24155980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7feb140011f0 tx=0x7feb1400c8f0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 shutdown_connections 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb040678c0 0x7feb04069d80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2415b340 0x7feb24149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2415af60 0x7feb24157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 --2- 172.21.15.144:0/4001788221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb240cd9f0 0x7feb24155980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 >> 172.21.15.144:0/4001788221 conn(0x7feb24068030 msgr2=0x7feb240b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 shutdown_connections 2024-09-12T12:15:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.287+0000 7feb2a000640 1 -- 172.21.15.144:0/4001788221 wait complete. 2024-09-12T12:15:21.308 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-12T12:15:21.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.443+0000 7f7392e00640 1 Processor -- start 2024-09-12T12:15:21.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.443+0000 7f7392e00640 1 -- start start 2024-09-12T12:15:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f7392e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f738c15c7b0 0x7f738c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f7392e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f738c0b5fb0 0x7f738c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f7392e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f738c0cd870 con 0x7f738c15cd30 2024-09-12T12:15:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f7392e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f738c072a50 con 0x7f738c15c7b0 2024-09-12T12:15:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f7392e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f738c0cde30 con 0x7f738c0b5fb0 2024-09-12T12:15:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f738c15c7b0 0x7f738c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f738c15c7b0 0x7f738c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49516/0 (socket says 172.21.15.144:49516) 2024-09-12T12:15:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738be00640 1 -- 172.21.15.144:0/3920072050 learned_addr learned my addr 172.21.15.144:0/3920072050 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f7390e00640 1 --2- 172.21.15.144:0/3920072050 >> v2:172.21.15.165:3300/0 conn(0x7f738c0b5fb0 0x7f738c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738be00640 1 -- 172.21.15.144:0/3920072050 >> v2:172.21.15.165:3300/0 conn(0x7f738c0b5fb0 msgr2=0x7f738c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738be00640 1 --2- 172.21.15.144:0/3920072050 >> v2:172.21.15.165:3300/0 conn(0x7f738c0b5fb0 0x7f738c072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738be00640 1 -- 172.21.15.144:0/3920072050 >> v1:172.21.15.165:6789/0 conn(0x7f738c15cd30 legacy=0x7f738c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738be00640 1 -- 172.21.15.144:0/3920072050 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c0cdb50 con 0x7f738c15c7b0 2024-09-12T12:15:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738be00640 1 --2- 172.21.15.144:0/3920072050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c15c7b0 0x7f738c0ccf00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f738c0d0480 tx=0x7f737c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6db4439af7b621 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738b400640 1 -- 172.21.15.144:0/3920072050 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c0a5780 con 0x7f738c15c7b0 2024-09-12T12:15:21.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738b400640 1 -- 172.21.15.144:0/3920072050 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c0a5920 con 0x7f738c15c7b0 2024-09-12T12:15:21.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.447+0000 7f738b400640 1 -- 172.21.15.144:0/3920072050 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c0a5cf0 con 0x7f738c15c7b0 2024-09-12T12:15:21.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 -- 172.21.15.144:0/3920072050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c15c7b0 msgr2=0x7f738c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 --2- 172.21.15.144:0/3920072050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c15c7b0 0x7f738c0ccf00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f738c0d0480 tx=0x7f737c01c9b0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 -- 172.21.15.144:0/3920072050 shutdown_connections 2024-09-12T12:15:21.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 --2- 172.21.15.144:0/3920072050 >> v2:172.21.15.165:3300/0 conn(0x7f738c0b5fb0 0x7f738c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 --2- 172.21.15.144:0/3920072050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c15c7b0 0x7f738c0ccf00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 -- 172.21.15.144:0/3920072050 >> 172.21.15.144:0/3920072050 conn(0x7f738c06d0d0 msgr2=0x7f738c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:21.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 -- 172.21.15.144:0/3920072050 shutdown_connections 2024-09-12T12:15:21.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 -- 172.21.15.144:0/3920072050 wait complete. 2024-09-12T12:15:21.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 Processor -- start 2024-09-12T12:15:21.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 -- start start 2024-09-12T12:15:21.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c0b5fb0 0x7f738c0d0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f738c15c7b0 0x7f738c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f738c15cd30 0x7f738c14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f738c073fc0 con 0x7f738c0b5fb0 2024-09-12T12:15:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f738c073e40 con 0x7f738c15cd30 2024-09-12T12:15:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7392e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f738c074140 con 0x7f738c15c7b0 2024-09-12T12:15:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f738be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c0b5fb0 0x7f738c0d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f738be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c0b5fb0 0x7f738c0d0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49518/0 (socket says 172.21.15.144:49518) 2024-09-12T12:15:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f738be00640 1 -- 172.21.15.144:0/2364762687 learned_addr learned my addr 172.21.15.144:0/2364762687 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7390e00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f738c15cd30 0x7f738c14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7383400640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f738c15c7b0 0x7f738c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f738be00640 1 -- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f738c15c7b0 msgr2=0x7f738c0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f738be00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f738c15c7b0 0x7f738c0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f738be00640 1 -- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f738c15cd30 msgr2=0x7f738c14ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f738be00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f738c15cd30 0x7f738c14ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f738be00640 1 -- 172.21.15.144:0/2364762687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c0b46e0 con 0x7f738c0b5fb0 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7383400640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f738c15c7b0 0x7f738c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.451+0000 7f7390e00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f738c15cd30 0x7f738c14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f738be00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c0b5fb0 0x7f738c0d0550 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f737c0af040 tx=0x7f737c019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7388c00640 1 -- 172.21.15.144:0/2364762687 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c0b8670 con 0x7f738c0b5fb0 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7388c00640 1 -- 172.21.15.144:0/2364762687 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c0be070 con 0x7f738c0b5fb0 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7388c00640 1 -- 172.21.15.144:0/2364762687 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c0b8a70 con 0x7f738c0b5fb0 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c0b49c0 con 0x7f738c0b5fb0 2024-09-12T12:15:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c0b4f80 con 0x7f738c0b5fb0 2024-09-12T12:15:21.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738c072ee0 con 0x7f738c0b5fb0 2024-09-12T12:15:21.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7388c00640 1 -- 172.21.15.144:0/2364762687 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f737c0b8c10 con 0x7f738c0b5fb0 2024-09-12T12:15:21.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7388c00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73680678c0 0x7f7368069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7388c00640 1 -- 172.21.15.144:0/2364762687 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f737c120d40 con 0x7f738c0b5fb0 2024-09-12T12:15:21.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.455+0000 7f7383400640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73680678c0 0x7f7368069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.459+0000 7f7383400640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73680678c0 0x7f7368069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f738c15ed70 tx=0x7f7374008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:21.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.459+0000 7f7388c00640 1 -- 172.21.15.144:0/2364762687 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f737c0165a0 con 0x7f738c0b5fb0 2024-09-12T12:15:21.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.675+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f738c15e930 con 0x7f738c0b5fb0 2024-09-12T12:15:21.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7388c00640 1 -- 172.21.15.144:0/2364762687 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v133) ==== 148+0+0 (secure 0 0 0) 0x7f737c0f1950 con 0x7f738c0b5fb0 2024-09-12T12:15:21.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73680678c0 msgr2=0x7f7368069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73680678c0 0x7f7368069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f738c15ed70 tx=0x7f7374008040 comp rx=0 tx=0).stop 2024-09-12T12:15:21.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c0b5fb0 msgr2=0x7f738c0d0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c0b5fb0 0x7f738c0d0550 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f737c0af040 tx=0x7f737c019750 comp rx=0 tx=0).stop 2024-09-12T12:15:21.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 shutdown_connections 2024-09-12T12:15:21.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73680678c0 0x7f7368069d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f738c15cd30 0x7f738c14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f738c15c7b0 0x7f738c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 --2- 172.21.15.144:0/2364762687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f738c0b5fb0 0x7f738c0d0550 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 >> 172.21.15.144:0/2364762687 conn(0x7f738c06d0d0 msgr2=0x7f738c0b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:21.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 shutdown_connections 2024-09-12T12:15:21.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:21.923+0000 7f7392e00640 1 -- 172.21.15.144:0/2364762687 wait complete. 2024-09-12T12:15:21.947 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-09-12T12:15:21.947 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-12T12:15:21.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:15:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.079+0000 7f7bb9c00640 1 Processor -- start 2024-09-12T12:15:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.079+0000 7f7bb9c00640 1 -- start start 2024-09-12T12:15:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7bb9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bb415cd30 0x7f7bb40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7bb9c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bb40b61e0 con 0x7f7bb40b5de0 2024-09-12T12:15:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7bb9c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bb40cd870 con 0x7f7bb415c7b0 2024-09-12T12:15:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7bb9c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7bb4072a50 con 0x7f7bb415cd30 2024-09-12T12:15:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7baa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bb415cd30 0x7f7bb40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7baa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bb415cd30 0x7f7bb40b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49526/0 (socket says 172.21.15.144:49526) 2024-09-12T12:15:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7baa000640 1 -- 172.21.15.144:0/3897102385 learned_addr learned my addr 172.21.15.144:0/3897102385 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7baa000640 1 -- 172.21.15.144:0/3897102385 >> v1:172.21.15.165:6789/0 conn(0x7f7bb415c7b0 legacy=0x7f7bb40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7baa000640 1 -- 172.21.15.144:0/3897102385 >> v1:172.21.15.144:6789/0 conn(0x7f7bb40b5de0 legacy=0x7f7bb4072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7baa000640 1 -- 172.21.15.144:0/3897102385 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb40cdb50 con 0x7f7bb415cd30 2024-09-12T12:15:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.083+0000 7f7baa000640 1 --2- 172.21.15.144:0/3897102385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415cd30 0x7f7bb40b58a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009870 tx=0x7f7b9c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576444bc12297295 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb2000640 1 -- 172.21.15.144:0/3897102385 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0b0070 con 0x7f7bb415cd30 2024-09-12T12:15:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb2000640 1 -- 172.21.15.144:0/3897102385 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0ab600 con 0x7f7bb415cd30 2024-09-12T12:15:22.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb2000640 1 -- 172.21.15.144:0/3897102385 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0ab9d0 con 0x7f7bb415cd30 2024-09-12T12:15:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 -- 172.21.15.144:0/3897102385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415cd30 msgr2=0x7f7bb40b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 --2- 172.21.15.144:0/3897102385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415cd30 0x7f7bb40b58a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009870 tx=0x7f7b9c01c520 comp rx=0 tx=0).stop 2024-09-12T12:15:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 -- 172.21.15.144:0/3897102385 shutdown_connections 2024-09-12T12:15:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 --2- 172.21.15.144:0/3897102385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415cd30 0x7f7bb40b58a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 -- 172.21.15.144:0/3897102385 >> 172.21.15.144:0/3897102385 conn(0x7f7bb406d0d0 msgr2=0x7f7bb406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 -- 172.21.15.144:0/3897102385 shutdown_connections 2024-09-12T12:15:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 -- 172.21.15.144:0/3897102385 wait complete. 2024-09-12T12:15:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 Processor -- start 2024-09-12T12:15:22.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 -- start start 2024-09-12T12:15:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bb40b5de0 0x7f7bb414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415c7b0 0x7f7bb40b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bb415cd30 0x7f7bb40ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb4074210 con 0x7f7bb415c7b0 2024-09-12T12:15:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb4074090 con 0x7f7bb40b5de0 2024-09-12T12:15:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb9c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb40cd610 con 0x7f7bb415cd30 2024-09-12T12:15:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7baa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415c7b0 0x7f7bb40b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7baa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415c7b0 0x7f7bb40b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49538/0 (socket says 172.21.15.144:49538) 2024-09-12T12:15:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7baa000640 1 -- 172.21.15.144:0/2480928318 learned_addr learned my addr 172.21.15.144:0/2480928318 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb2a00640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bb40b5de0 0x7f7bb414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.087+0000 7f7bb3400640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bb415cd30 0x7f7bb40ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7baa000640 1 -- 172.21.15.144:0/2480928318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bb415cd30 msgr2=0x7f7bb40ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7baa000640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bb415cd30 0x7f7bb40ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7baa000640 1 -- 172.21.15.144:0/2480928318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bb40b5de0 msgr2=0x7f7bb414ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7baa000640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bb40b5de0 0x7f7bb414ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7baa000640 1 -- 172.21.15.144:0/2480928318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb40b1930 con 0x7f7bb415c7b0 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7baa000640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415c7b0 0x7f7bb40b3fd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c01abd0 tx=0x7f7b9c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bab400640 1 -- 172.21.15.144:0/2480928318 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0bb070 con 0x7f7bb415c7b0 2024-09-12T12:15:22.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bab400640 1 -- 172.21.15.144:0/2480928318 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0aa680 con 0x7f7bb415c7b0 2024-09-12T12:15:22.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bab400640 1 -- 172.21.15.144:0/2480928318 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0b0040 con 0x7f7bb415c7b0 2024-09-12T12:15:22.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb40b1c10 con 0x7f7bb415c7b0 2024-09-12T12:15:22.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb40b21d0 con 0x7f7bb415c7b0 2024-09-12T12:15:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb40b58a0 con 0x7f7bb415c7b0 2024-09-12T12:15:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bab400640 1 -- 172.21.15.144:0/2480928318 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b9c0aaa70 con 0x7f7bb415c7b0 2024-09-12T12:15:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bab400640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b900678c0 0x7f7b90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bab400640 1 -- 172.21.15.144:0/2480928318 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f7b9c11f500 con 0x7f7bb415c7b0 2024-09-12T12:15:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.091+0000 7f7bb2a00640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b900678c0 0x7f7b90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.095+0000 7f7bb2a00640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b900678c0 0x7f7b90069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bb414f080 tx=0x7f7ba4003dd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.095+0000 7f7bab400640 1 -- 172.21.15.144:0/2480928318 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7b9c016110 con 0x7f7bb415c7b0 2024-09-12T12:15:22.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bb4168100 con 0x7f7bb415c7b0 2024-09-12T12:15:22.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bab400640 1 -- 172.21.15.144:0/2480928318 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+13331 (secure 0 0 0) 0x7f7b9c0efac0 con 0x7f7bb415c7b0 2024-09-12T12:15:22.258 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:22.258 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:15:20.921916+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/3288752771":"2024-09-13T12:15:17.915543+0000","172.21.15.144:6836/3288752771":"2024-09-13T12:15:17.915543+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b900678c0 msgr2=0x7f7b90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b900678c0 0x7f7b90069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bb414f080 tx=0x7f7ba4003dd0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415c7b0 msgr2=0x7f7bb40b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415c7b0 0x7f7bb40b3fd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c01abd0 tx=0x7f7b9c0192c0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 shutdown_connections 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b900678c0 0x7f7b90069d80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bb415cd30 0x7f7bb40ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bb415c7b0 0x7f7bb40b3fd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 --2- 172.21.15.144:0/2480928318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bb40b5de0 0x7f7bb414ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.255+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 >> 172.21.15.144:0/2480928318 conn(0x7f7bb406d0d0 msgr2=0x7f7bb415f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.259+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 shutdown_connections 2024-09-12T12:15:22.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.259+0000 7f7bb9c00640 1 -- 172.21.15.144:0/2480928318 wait complete. 2024-09-12T12:15:22.279 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:15:22.279 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:15:22.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.415+0000 7fd0b8e00640 1 Processor -- start 2024-09-12T12:15:22.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.415+0000 7fd0b8e00640 1 -- start start 2024-09-12T12:15:22.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0b8e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0b415c750 0x7fd0b415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0b8e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b406cb60 con 0x7fd0b4141470 2024-09-12T12:15:22.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0b8e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b406e2a0 con 0x7fd0b406f340 2024-09-12T12:15:22.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0b8e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd0b406e580 con 0x7fd0b415c750 2024-09-12T12:15:22.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0b415c750 0x7fd0b415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0b415c750 0x7fd0b415cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49542/0 (socket says 172.21.15.144:49542) 2024-09-12T12:15:22.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0abe00640 1 -- 172.21.15.144:0/2937640097 learned_addr learned my addr 172.21.15.144:0/2937640097 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:22.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0b3400640 1 --1- 172.21.15.144:0/2937640097 >> v1:172.21.15.144:6789/0 conn(0x7fd0b4141470 0x7fd0b406c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47890/0 (socket says 172.21.15.144:47890) 2024-09-12T12:15:22.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0abe00640 1 -- 172.21.15.144:0/2937640097 >> v1:172.21.15.165:6789/0 conn(0x7fd0b406f340 legacy=0x7fd0b40b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:22.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0abe00640 1 -- 172.21.15.144:0/2937640097 >> v1:172.21.15.144:6789/0 conn(0x7fd0b4141470 legacy=0x7fd0b406c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.419+0000 7fd0abe00640 1 -- 172.21.15.144:0/2937640097 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b406e860 con 0x7fd0b415c750 2024-09-12T12:15:22.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0abe00640 1 --2- 172.21.15.144:0/2937640097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b415c750 0x7fd0b415cbc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00bb10 tx=0x7fd09c01eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304c23ddec5dad03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b2a00640 1 -- 172.21.15.144:0/2937640097 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0b4070 con 0x7fd0b415c750 2024-09-12T12:15:22.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b2a00640 1 -- 172.21.15.144:0/2937640097 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd09c0a7b40 con 0x7fd0b415c750 2024-09-12T12:15:22.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b2a00640 1 -- 172.21.15.144:0/2937640097 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0af440 con 0x7fd0b415c750 2024-09-12T12:15:22.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 -- 172.21.15.144:0/2937640097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b415c750 msgr2=0x7fd0b415cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 --2- 172.21.15.144:0/2937640097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b415c750 0x7fd0b415cbc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00bb10 tx=0x7fd09c01eb70 comp rx=0 tx=0).stop 2024-09-12T12:15:22.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 -- 172.21.15.144:0/2937640097 shutdown_connections 2024-09-12T12:15:22.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 --2- 172.21.15.144:0/2937640097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b415c750 0x7fd0b415cbc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 -- 172.21.15.144:0/2937640097 >> 172.21.15.144:0/2937640097 conn(0x7fd0b40b1720 msgr2=0x7fd0b40b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 -- 172.21.15.144:0/2937640097 shutdown_connections 2024-09-12T12:15:22.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 -- 172.21.15.144:0/2937640097 wait complete. 2024-09-12T12:15:22.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 Processor -- start 2024-09-12T12:15:22.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 -- start start 2024-09-12T12:15:22.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b406f340 0x7fd0b41424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0b4141470 0x7fd0b413b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0b415c750 0x7fd0b413f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b406bfe0 con 0x7fd0b406f340 2024-09-12T12:15:22.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b4141850 con 0x7fd0b4141470 2024-09-12T12:15:22.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.423+0000 7fd0b8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b406c160 con 0x7fd0b415c750 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b406f340 0x7fd0b41424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b406f340 0x7fd0b41424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49548/0 (socket says 172.21.15.144:49548) 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b3400640 1 -- 172.21.15.144:0/3569621302 learned_addr learned my addr 172.21.15.144:0/3569621302 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0abe00640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0b4141470 0x7fd0b413b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b3400640 1 -- 172.21.15.144:0/3569621302 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0b415c750 msgr2=0x7fd0b413f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b3400640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0b415c750 0x7fd0b413f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b3400640 1 -- 172.21.15.144:0/3569621302 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0b4141470 msgr2=0x7fd0b413b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b3400640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0b4141470 0x7fd0b413b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b3400640 1 -- 172.21.15.144:0/3569621302 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b40cdc10 con 0x7fd0b406f340 2024-09-12T12:15:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b3400640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b406f340 0x7fd0b41424d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400c490 tx=0x7fd0a400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0ab400640 1 -- 172.21.15.144:0/3569621302 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4018070 con 0x7fd0b406f340 2024-09-12T12:15:22.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0ab400640 1 -- 172.21.15.144:0/3569621302 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a4007480 con 0x7fd0b406f340 2024-09-12T12:15:22.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b40cdef0 con 0x7fd0b406f340 2024-09-12T12:15:22.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0ab400640 1 -- 172.21.15.144:0/3569621302 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4004a10 con 0x7fd0b406f340 2024-09-12T12:15:22.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b40ce4b0 con 0x7fd0b406f340 2024-09-12T12:15:22.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b40b6570 con 0x7fd0b406f340 2024-09-12T12:15:22.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0ab400640 1 -- 172.21.15.144:0/3569621302 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0a401b070 con 0x7fd0b406f340 2024-09-12T12:15:22.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.427+0000 7fd0ab400640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0900678f0 0x7fd090069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.431+0000 7fd0ab400640 1 -- 172.21.15.144:0/3569621302 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7fd0a4084ce0 con 0x7fd0b406f340 2024-09-12T12:15:22.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.431+0000 7fd0abe00640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0900678f0 0x7fd090069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.431+0000 7fd0abe00640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0900678f0 0x7fd090069db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0b1000 tx=0x7fd09c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.435+0000 7fd0ab400640 1 -- 172.21.15.144:0/3569621302 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd0a4055a20 con 0x7fd0b406f340 2024-09-12T12:15:22.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd0b40d0870 con 0x7fd0b406f340 2024-09-12T12:15:22.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0ab400640 1 -- 172.21.15.144:0/3569621302 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7fd0a4055320 con 0x7fd0b406f340 2024-09-12T12:15:22.594 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0900678f0 msgr2=0x7fd090069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0900678f0 0x7fd090069db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0b1000 tx=0x7fd09c008040 comp rx=0 tx=0).stop 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b406f340 msgr2=0x7fd0b41424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b406f340 0x7fd0b41424d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400c490 tx=0x7fd0a400c950 comp rx=0 tx=0).stop 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 shutdown_connections 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0900678f0 0x7fd090069db0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0b415c750 0x7fd0b413f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0b4141470 0x7fd0b413b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 --2- 172.21.15.144:0/3569621302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0b406f340 0x7fd0b41424d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 >> 172.21.15.144:0/3569621302 conn(0x7fd0b40b1720 msgr2=0x7fd0b40b5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 shutdown_connections 2024-09-12T12:15:22.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.591+0000 7fd0b8e00640 1 -- 172.21.15.144:0/3569621302 wait complete. 2024-09-12T12:15:22.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-12T12:15:22.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee7b200640 1 Processor -- start 2024-09-12T12:15:22.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee7b200640 1 -- start start 2024-09-12T12:15:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee7b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fee7c159d30 0x7fee7c0cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee7b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c072810 0x7fee7c15de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee7b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c15a110 con 0x7fee7c0d03f0 2024-09-12T12:15:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee7b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fee7c072c40 con 0x7fee7c159d30 2024-09-12T12:15:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee7b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c073710 con 0x7fee7c072810 2024-09-12T12:15:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee79e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fee7c159d30 0x7fee7c0cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee7a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c072810 0x7fee7c15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee79400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fee7c0d03f0 0x7fee7c072100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:39330/0 (socket says 172.21.15.144:39330) 2024-09-12T12:15:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.751+0000 7fee79400640 1 -- 172.21.15.144:0/1839335822 learned_addr learned my addr 172.21.15.144:0/1839335822 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.755+0000 7fee7a800640 1 -- 172.21.15.144:0/1839335822 >> v2:172.21.15.165:3300/0 conn(0x7fee7c159d30 msgr2=0x7fee7c0cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:22.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.755+0000 7fee7a800640 1 --2- 172.21.15.144:0/1839335822 >> v2:172.21.15.165:3300/0 conn(0x7fee7c159d30 0x7fee7c0cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.755+0000 7fee7a800640 1 -- 172.21.15.144:0/1839335822 >> v1:172.21.15.165:6789/0 conn(0x7fee7c0d03f0 legacy=0x7fee7c072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.755+0000 7fee78a00640 1 -- 172.21.15.144:0/1839335822 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849369998 0 0) 0x7fee7c15a110 con 0x7fee7c0d03f0 2024-09-12T12:15:22.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.755+0000 7fee7a800640 1 -- 172.21.15.144:0/1839335822 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c0d0860 con 0x7fee7c072810 2024-09-12T12:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.755+0000 7fee7a800640 1 --2- 172.21.15.144:0/1839335822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c072810 0x7fee7c15de60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee74009d90 tx=0x7fee7401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78f4f9e5d2b2b2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.755+0000 7fee78a00640 1 -- 172.21.15.144:0/1839335822 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740b2070 con 0x7fee7c072810 2024-09-12T12:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.755+0000 7fee78a00640 1 -- 172.21.15.144:0/1839335822 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee740a5a00 con 0x7fee7c072810 2024-09-12T12:15:22.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.755+0000 7fee78a00640 1 -- 172.21.15.144:0/1839335822 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740a5dd0 con 0x7fee7c072810 2024-09-12T12:15:22.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 -- 172.21.15.144:0/1839335822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c072810 msgr2=0x7fee7c15de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 --2- 172.21.15.144:0/1839335822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c072810 0x7fee7c15de60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee74009d90 tx=0x7fee7401c940 comp rx=0 tx=0).stop 2024-09-12T12:15:22.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 -- 172.21.15.144:0/1839335822 shutdown_connections 2024-09-12T12:15:22.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 --2- 172.21.15.144:0/1839335822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c072810 0x7fee7c15de60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 --2- 172.21.15.144:0/1839335822 >> v2:172.21.15.165:3300/0 conn(0x7fee7c159d30 0x7fee7c0cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 -- 172.21.15.144:0/1839335822 >> 172.21.15.144:0/1839335822 conn(0x7fee7c06bc10 msgr2=0x7fee7c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 -- 172.21.15.144:0/1839335822 shutdown_connections 2024-09-12T12:15:22.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 -- 172.21.15.144:0/1839335822 wait complete. 2024-09-12T12:15:22.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 Processor -- start 2024-09-12T12:15:22.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 -- start start 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee7c072810 0x7fee7c14ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c0d03f0 0x7fee7c1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7c159d30 0x7fee7c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c15ebb0 con 0x7fee7c159d30 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c15d960 con 0x7fee7c072810 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c15ed30 con 0x7fee7c0d03f0 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7c159d30 0x7fee7c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7c159d30 0x7fee7c158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49562/0 (socket says 172.21.15.144:49562) 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee7a800640 1 -- 172.21.15.144:0/1827772862 learned_addr learned my addr 172.21.15.144:0/1827772862 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:22.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee79e00640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee7c072810 0x7fee7c14ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.759+0000 7fee79400640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c0d03f0 0x7fee7c1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee7a800640 1 -- 172.21.15.144:0/1827772862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c0d03f0 msgr2=0x7fee7c1587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee7a800640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c0d03f0 0x7fee7c1587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee7a800640 1 -- 172.21.15.144:0/1827772862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee7c072810 msgr2=0x7fee7c14ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee7a800640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee7c072810 0x7fee7c14ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee7a800640 1 -- 172.21.15.144:0/1827772862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c0af800 con 0x7fee7c159d30 2024-09-12T12:15:22.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee7a800640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7c159d30 0x7fee7c158d30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee74009d90 tx=0x7fee740196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee72000640 1 -- 172.21.15.144:0/1827772862 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740b2050 con 0x7fee7c159d30 2024-09-12T12:15:22.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee72000640 1 -- 172.21.15.144:0/1827772862 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee740be070 con 0x7fee7c159d30 2024-09-12T12:15:22.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee72000640 1 -- 172.21.15.144:0/1827772862 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee740adb10 con 0x7fee7c159d30 2024-09-12T12:15:22.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c0b24c0 con 0x7fee7c159d30 2024-09-12T12:15:22.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c0b2a80 con 0x7fee7c159d30 2024-09-12T12:15:22.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7c15de60 con 0x7fee7c159d30 2024-09-12T12:15:22.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee72000640 1 -- 172.21.15.144:0/1827772862 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee740adcb0 con 0x7fee7c159d30 2024-09-12T12:15:22.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee72000640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee5c0678c0 0x7fee5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee72000640 1 -- 172.21.15.144:0/1827772862 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7fee74120e70 con 0x7fee7c159d30 2024-09-12T12:15:22.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.763+0000 7fee79e00640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee5c0678c0 0x7fee5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.767+0000 7fee79e00640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee5c0678c0 0x7fee5c069d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009ac0 tx=0x7fee6c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.767+0000 7fee72000640 1 -- 172.21.15.144:0/1827772862 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fee74016560 con 0x7fee7c159d30 2024-09-12T12:15:22.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:22.983+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7fee7c0cff00 con 0x7fee7c159d30 2024-09-12T12:15:23.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.931+0000 7fee72000640 1 -- 172.21.15.144:0/1827772862 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v135) ==== 146+0+0 (secure 0 0 0) 0x7fee740f1440 con 0x7fee7c159d30 2024-09-12T12:15:23.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee5c0678c0 msgr2=0x7fee5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:23.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee5c0678c0 0x7fee5c069d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009ac0 tx=0x7fee6c009190 comp rx=0 tx=0).stop 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7c159d30 msgr2=0x7fee7c158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7c159d30 0x7fee7c158d30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee74009d90 tx=0x7fee740196e0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 shutdown_connections 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee5c0678c0 0x7fee5c069d80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee7c159d30 0x7fee7c158d30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee7c0d03f0 0x7fee7c1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 --2- 172.21.15.144:0/1827772862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee7c072810 0x7fee7c14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 >> 172.21.15.144:0/1827772862 conn(0x7fee7c06bc10 msgr2=0x7fee7c0b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 shutdown_connections 2024-09-12T12:15:23.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:23.935+0000 7fee7b200640 1 -- 172.21.15.144:0/1827772862 wait complete. 2024-09-12T12:15:23.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:15:24.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.099+0000 7f6ff7200640 1 Processor -- start 2024-09-12T12:15:24.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.099+0000 7f6ff7200640 1 -- start start 2024-09-12T12:15:24.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.099+0000 7f6ff7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6ff015c2e0 0x7f6ff0072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.099+0000 7f6ff7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ff00af5f0 0x7f6ff006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.099+0000 7f6ff7200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff00733e0 con 0x7f6ff006c150 2024-09-12T12:15:24.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.099+0000 7f6ff7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff006c5c0 con 0x7f6ff00af5f0 2024-09-12T12:15:24.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.099+0000 7f6ff7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff00cd290 con 0x7f6ff015c2e0 2024-09-12T12:15:24.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6fef400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ff00af5f0 0x7f6ff006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6fef400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ff00af5f0 0x7f6ff006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49568/0 (socket says 172.21.15.144:49568) 2024-09-12T12:15:24.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6fef400640 1 -- 172.21.15.144:0/2334274645 learned_addr learned my addr 172.21.15.144:0/2334274645 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:24.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6fefe00640 1 --2- 172.21.15.144:0/2334274645 >> v2:172.21.15.165:3300/0 conn(0x7f6ff015c2e0 0x7f6ff0072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6fef400640 1 -- 172.21.15.144:0/2334274645 >> v2:172.21.15.165:3300/0 conn(0x7f6ff015c2e0 msgr2=0x7f6ff0072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:24.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6fef400640 1 --2- 172.21.15.144:0/2334274645 >> v2:172.21.15.165:3300/0 conn(0x7f6ff015c2e0 0x7f6ff0072b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6fef400640 1 -- 172.21.15.144:0/2334274645 >> v1:172.21.15.165:6789/0 conn(0x7f6ff006c150 legacy=0x7f6ff006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6fef400640 1 -- 172.21.15.144:0/2334274645 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff00cd570 con 0x7f6ff00af5f0 2024-09-12T12:15:24.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6fef400640 1 --2- 172.21.15.144:0/2334274645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff00af5f0 0x7f6ff006bc10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6ff006e190 tx=0x7f6fdc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174116b4876f472e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:24.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6feea00640 1 -- 172.21.15.144:0/2334274645 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0b1070 con 0x7f6ff00af5f0 2024-09-12T12:15:24.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6feea00640 1 -- 172.21.15.144:0/2334274645 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc0ac640 con 0x7f6ff00af5f0 2024-09-12T12:15:24.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.103+0000 7f6feea00640 1 -- 172.21.15.144:0/2334274645 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0aca10 con 0x7f6ff00af5f0 2024-09-12T12:15:24.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 -- 172.21.15.144:0/2334274645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff00af5f0 msgr2=0x7f6ff006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 --2- 172.21.15.144:0/2334274645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff00af5f0 0x7f6ff006bc10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6ff006e190 tx=0x7f6fdc01c400 comp rx=0 tx=0).stop 2024-09-12T12:15:24.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 -- 172.21.15.144:0/2334274645 shutdown_connections 2024-09-12T12:15:24.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 --2- 172.21.15.144:0/2334274645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff00af5f0 0x7f6ff006bc10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 --2- 172.21.15.144:0/2334274645 >> v2:172.21.15.165:3300/0 conn(0x7f6ff015c2e0 0x7f6ff0072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 -- 172.21.15.144:0/2334274645 >> 172.21.15.144:0/2334274645 conn(0x7f6ff0068030 msgr2=0x7f6ff00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:24.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 -- 172.21.15.144:0/2334274645 shutdown_connections 2024-09-12T12:15:24.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 -- 172.21.15.144:0/2334274645 wait complete. 2024-09-12T12:15:24.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 Processor -- start 2024-09-12T12:15:24.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 -- start start 2024-09-12T12:15:24.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ff006c150 0x7f6ff014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff00af5f0 0x7f6ff00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff015c2e0 0x7f6ff00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff01690a0 con 0x7f6ff015c2e0 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff0168f20 con 0x7f6ff00af5f0 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff0169220 con 0x7f6ff006c150 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff015c2e0 0x7f6ff00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff015c2e0 0x7f6ff00ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49570/0 (socket says 172.21.15.144:49570) 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff5200640 1 -- 172.21.15.144:0/1536978023 learned_addr learned my addr 172.21.15.144:0/1536978023 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6fef400640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff00af5f0 0x7f6ff00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6fefe00640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ff006c150 0x7f6ff014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff5200640 1 -- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ff006c150 msgr2=0x7f6ff014a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff5200640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ff006c150 0x7f6ff014a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff5200640 1 -- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff00af5f0 msgr2=0x7f6ff00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff5200640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff00af5f0 0x7f6ff00b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6ff5200640 1 -- 172.21.15.144:0/1536978023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff00b3cd0 con 0x7f6ff015c2e0 2024-09-12T12:15:24.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6fefe00640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ff006c150 0x7f6ff014a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:24.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.107+0000 7f6fef400640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff00af5f0 0x7f6ff00b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:24.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6ff5200640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff015c2e0 0x7f6ff00ae890 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c770 tx=0x7f6fe800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:24.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6fe7e00640 1 -- 172.21.15.144:0/1536978023 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8003b80 con 0x7f6ff015c2e0 2024-09-12T12:15:24.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6fe7e00640 1 -- 172.21.15.144:0/1536978023 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe8003d20 con 0x7f6ff015c2e0 2024-09-12T12:15:24.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff00b3fb0 con 0x7f6ff015c2e0 2024-09-12T12:15:24.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6fe7e00640 1 -- 172.21.15.144:0/1536978023 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe800aa90 con 0x7f6ff015c2e0 2024-09-12T12:15:24.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff00b4570 con 0x7f6ff015c2e0 2024-09-12T12:15:24.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff006bc10 con 0x7f6ff015c2e0 2024-09-12T12:15:24.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6fe7e00640 1 -- 172.21.15.144:0/1536978023 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6fe800ac30 con 0x7f6ff015c2e0 2024-09-12T12:15:24.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6fe7e00640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fd00678c0 0x7f6fd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6fe7e00640 1 -- 172.21.15.144:0/1536978023 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f6fe8085b40 con 0x7f6ff015c2e0 2024-09-12T12:15:24.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.111+0000 7f6fefe00640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fd00678c0 0x7f6fd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.115+0000 7f6fefe00640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fd00678c0 0x7f6fd0069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00097a0 tx=0x7f6fe0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:24.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.119+0000 7f6fe7e00640 1 -- 172.21.15.144:0/1536978023 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6fe8056750 con 0x7f6ff015c2e0 2024-09-12T12:15:24.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.271+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6ff0158660 con 0x7f6ff015c2e0 2024-09-12T12:15:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6fe7e00640 1 -- 172.21.15.144:0/1536978023 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f6fe8056050 con 0x7f6ff015c2e0 2024-09-12T12:15:24.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fd00678c0 msgr2=0x7f6fd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fd00678c0 0x7f6fd0069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00097a0 tx=0x7f6fe0008040 comp rx=0 tx=0).stop 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff015c2e0 msgr2=0x7f6ff00ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff015c2e0 0x7f6ff00ae890 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800c770 tx=0x7f6fe800cc30 comp rx=0 tx=0).stop 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 shutdown_connections 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fd00678c0 0x7f6fd0069d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff015c2e0 0x7f6ff00ae890 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff00af5f0 0x7f6ff00b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 --2- 172.21.15.144:0/1536978023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ff006c150 0x7f6ff014a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 >> 172.21.15.144:0/1536978023 conn(0x7f6ff0068030 msgr2=0x7f6ff00b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 shutdown_connections 2024-09-12T12:15:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.279+0000 7f6ff7200640 1 -- 172.21.15.144:0/1536978023 wait complete. 2024-09-12T12:15:24.302 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:15:24.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:15:24.406 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:15:24.486 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:15:24.486 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:15:24.486 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:24.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:15:24.495 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:15:24.495 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:24.504 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:15:24.504 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:15:24.505 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:24.545 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:15:24.545 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:15:24.545 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:24.559 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:15:24.559 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:15:24.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:15:24.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3aea800640 1 Processor -- start 2024-09-12T12:15:24.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3aea800640 1 -- start start 2024-09-12T12:15:24.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3aea800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ae415c0a0 0x7f3ae40b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3aea800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae40ce950 0x7f3ae415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3aea800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae415c480 con 0x7f3ae40b6b20 2024-09-12T12:15:24.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3aea800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae41609e0 con 0x7f3ae415c0a0 2024-09-12T12:15:24.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3aea800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae415fdd0 con 0x7f3ae40ce950 2024-09-12T12:15:24.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3ae9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ae415c0a0 0x7f3ae40b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3ae9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ae415c0a0 0x7f3ae40b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49580/0 (socket says 172.21.15.144:49580) 2024-09-12T12:15:24.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3ae9400640 1 -- 172.21.15.144:0/2637232679 learned_addr learned my addr 172.21.15.144:0/2637232679 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:24.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3ae8a00640 1 --2- 172.21.15.144:0/2637232679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae40ce950 0x7f3ae415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3ae9400640 1 -- 172.21.15.144:0/2637232679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae40ce950 msgr2=0x7f3ae415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:24.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3ae9400640 1 --2- 172.21.15.144:0/2637232679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae40ce950 0x7f3ae415d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3ae9400640 1 -- 172.21.15.144:0/2637232679 >> v1:172.21.15.144:6789/0 conn(0x7f3ae40b6b20 legacy=0x7f3ae40b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3ae9400640 1 -- 172.21.15.144:0/2637232679 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae41600b0 con 0x7f3ae415c0a0 2024-09-12T12:15:24.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.727+0000 7f3ae8a00640 1 --2- 172.21.15.144:0/2637232679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae40ce950 0x7f3ae415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:24.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3ae9400640 1 --2- 172.21.15.144:0/2637232679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae415c0a0 0x7f3ae40b5310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009870 tx=0x7f3ad801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499a9bc36467631c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:24.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3ae3e00640 1 -- 172.21.15.144:0/2637232679 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80b1070 con 0x7f3ae415c0a0 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3ae3e00640 1 -- 172.21.15.144:0/2637232679 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad80ac620 con 0x7f3ae415c0a0 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3ae3e00640 1 -- 172.21.15.144:0/2637232679 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80ac9f0 con 0x7f3ae415c0a0 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 -- 172.21.15.144:0/2637232679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae415c0a0 msgr2=0x7f3ae40b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 --2- 172.21.15.144:0/2637232679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae415c0a0 0x7f3ae40b5310 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009870 tx=0x7f3ad801c4d0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 -- 172.21.15.144:0/2637232679 shutdown_connections 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 --2- 172.21.15.144:0/2637232679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae40ce950 0x7f3ae415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 --2- 172.21.15.144:0/2637232679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae415c0a0 0x7f3ae40b5310 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 -- 172.21.15.144:0/2637232679 >> 172.21.15.144:0/2637232679 conn(0x7f3ae40d2280 msgr2=0x7f3ae40d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 -- 172.21.15.144:0/2637232679 shutdown_connections 2024-09-12T12:15:24.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 -- 172.21.15.144:0/2637232679 wait complete. 2024-09-12T12:15:24.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 Processor -- start 2024-09-12T12:15:24.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.731+0000 7f3aea800640 1 -- start start 2024-09-12T12:15:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3aea800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae40b6b20 0x7f3ae41469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3aea800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ae40ce950 0x7f3ae4149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3aea800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae415c0a0 0x7f3ae4147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3aea800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae4073c50 con 0x7f3ae40b6b20 2024-09-12T12:15:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3aea800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae4073ad0 con 0x7f3ae40ce950 2024-09-12T12:15:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3aea800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae4073dd0 con 0x7f3ae415c0a0 2024-09-12T12:15:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae40b6b20 0x7f3ae41469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae40b6b20 0x7f3ae41469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49592/0 (socket says 172.21.15.144:49592) 2024-09-12T12:15:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9400640 1 -- 172.21.15.144:0/3929526536 learned_addr learned my addr 172.21.15.144:0/3929526536 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9e00640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae415c0a0 0x7f3ae4147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae8a00640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ae40ce950 0x7f3ae4149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9400640 1 -- 172.21.15.144:0/3929526536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae415c0a0 msgr2=0x7f3ae4147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9400640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae415c0a0 0x7f3ae4147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9400640 1 -- 172.21.15.144:0/3929526536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ae40ce950 msgr2=0x7f3ae4149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9400640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ae40ce950 0x7f3ae4149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9400640 1 -- 172.21.15.144:0/3929526536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae4148440 con 0x7f3ae40b6b20 2024-09-12T12:15:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae9400640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae40b6b20 0x7f3ae41469b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3ad801a100 tx=0x7f3ad801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae1600640 1 -- 172.21.15.144:0/3929526536 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80bb020 con 0x7f3ae40b6b20 2024-09-12T12:15:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae1600640 1 -- 172.21.15.144:0/3929526536 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad80b7420 con 0x7f3ae40b6b20 2024-09-12T12:15:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae1600640 1 -- 172.21.15.144:0/3929526536 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80b1040 con 0x7f3ae40b6b20 2024-09-12T12:15:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae4149180 con 0x7f3ae40b6b20 2024-09-12T12:15:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae4149740 con 0x7f3ae40b6b20 2024-09-12T12:15:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae415d0c0 con 0x7f3ae40b6b20 2024-09-12T12:15:24.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.735+0000 7f3ae1600640 1 -- 172.21.15.144:0/3929526536 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ad80be020 con 0x7f3ae40b6b20 2024-09-12T12:15:24.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.739+0000 7f3ae1600640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ac40678c0 0x7f3ac4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:24.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.739+0000 7f3ae1600640 1 -- 172.21.15.144:0/3929526536 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f3ad811ffb0 con 0x7f3ae40b6b20 2024-09-12T12:15:24.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.739+0000 7f3ae8a00640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ac40678c0 0x7f3ac4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:24.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.739+0000 7f3ae8a00640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ac40678c0 0x7f3ac4069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ce780 tx=0x7f3ad0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.743+0000 7f3ae1600640 1 -- 172.21.15.144:0/3929526536 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3ad80c5030 con 0x7f3ae40b6b20 2024-09-12T12:15:24.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.935+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ae40b1c60 con 0x7f3ae40b6b20 2024-09-12T12:15:24.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3ae1600640 1 -- 172.21.15.144:0/3929526536 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3920 (secure 0 0 0) 0x7f3ad8016150 con 0x7f3ae40b6b20 2024-09-12T12:15:24.941 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:24.941 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"btime":"2024-09-12T12:15:18:917680+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1734346147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1734346147},{"type":"v1","addr":"172.21.15.144:6835","nonce":1734346147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3346311863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3346311863},{"type":"v1","addr":"172.21.15.165:6834","nonce":3346311863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2564271519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2564271519},{"type":"v1","addr":"172.21.15.165:6835","nonce":2564271519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/837069308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":837069308},{"type":"v1","addr":"172.21.15.144:6837","nonce":837069308}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-12T12:15:24.941 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 20 2024-09-12T12:15:24.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ac40678c0 msgr2=0x7f3ac4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ac40678c0 0x7f3ac4069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40ce780 tx=0x7f3ad0008040 comp rx=0 tx=0).stop 2024-09-12T12:15:24.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae40b6b20 msgr2=0x7f3ae41469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:24.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae40b6b20 0x7f3ae41469b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3ad801a100 tx=0x7f3ad801ad10 comp rx=0 tx=0).stop 2024-09-12T12:15:24.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 shutdown_connections 2024-09-12T12:15:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ac40678c0 0x7f3ac4069d80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ae415c0a0 0x7f3ae4147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ae40ce950 0x7f3ae4149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 --2- 172.21.15.144:0/3929526536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae40b6b20 0x7f3ae41469b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 >> 172.21.15.144:0/3929526536 conn(0x7f3ae40d2280 msgr2=0x7f3ae415c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 shutdown_connections 2024-09-12T12:15:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:24.939+0000 7f3aea800640 1 -- 172.21.15.144:0/3929526536 wait complete. 2024-09-12T12:15:24.962 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:15:24.962 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:15:24.962 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:15:24.962 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:15:24.962 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:15:24.963 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:15:24.963 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:15:24.963 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:15:24.963 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:15:24.963 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:15:24.963 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:15:24.963 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:15:24.964 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:15:24.964 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:15:24.964 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:15:24.964 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:15:24.975 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:15:24.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:15:24.976 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:15:24.976 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:15:24.977 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:15:24.977 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:15:24.978 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:15:24.978 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:15:25.018 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:15:25.018 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:25.019 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:15:25.020 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:25.021 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:15:25.021 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:25.023 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:15:25.023 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:25.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:15:25.106 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:15:25.107 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:15:25.110 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:15:25.110 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:15:25.112 INFO:tasks.ceph.mds.d.smithi165.stderr:2024-09-12T12:15:25.112+0000 7f43b6800640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-12T12:15:25.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2319600640 1 Processor -- start 2024-09-12T12:15:25.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2319600640 1 -- start start 2024-09-12T12:15:25.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2319600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f231406f020 0x7f23140717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:25.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2319600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f23140afab0 0x7f23140b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:25.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2319600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23140b54a0 con 0x7f231415e600 2024-09-12T12:15:25.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2319600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f23140b5270 con 0x7f231406f020 2024-09-12T12:15:25.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2319600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2314163020 con 0x7f23140afab0 2024-09-12T12:15:25.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2312000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f231406f020 0x7f23140717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:25.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2312000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f231406f020 0x7f23140717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49618/0 (socket says 172.21.15.144:49618) 2024-09-12T12:15:25.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2313400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f23140afab0 0x7f23140b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:25.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2312000640 1 -- 172.21.15.144:0/72012910 learned_addr learned my addr 172.21.15.144:0/72012910 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:25.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.167+0000 7f2312a00640 1 --1- 172.21.15.144:0/72012910 >> v1:172.21.15.165:6789/0 conn(0x7f231415e600 0x7f231406e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:39356/0 (socket says 172.21.15.144:39356) 2024-09-12T12:15:25.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2313400640 1 -- 172.21.15.144:0/72012910 >> v2:172.21.15.144:3300/0 conn(0x7f231406f020 msgr2=0x7f23140717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:25.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2313400640 1 --2- 172.21.15.144:0/72012910 >> v2:172.21.15.144:3300/0 conn(0x7f231406f020 0x7f23140717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2313400640 1 -- 172.21.15.144:0/72012910 >> v1:172.21.15.165:6789/0 conn(0x7f231415e600 legacy=0x7f231406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:25.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2313400640 1 -- 172.21.15.144:0/72012910 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23140b5780 con 0x7f23140afab0 2024-09-12T12:15:25.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2311600640 1 -- 172.21.15.144:0/72012910 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59172566 0 0) 0x7f23140b54a0 con 0x7f231415e600 2024-09-12T12:15:25.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2313400640 1 --2- 172.21.15.144:0/72012910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23140afab0 0x7f23140b6260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f230c0097c0 tx=0x7f230c01c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8adc9701050b8345 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:25.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2311600640 1 -- 172.21.15.144:0/72012910 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c0b0070 con 0x7f23140afab0 2024-09-12T12:15:25.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2311600640 1 -- 172.21.15.144:0/72012910 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230c0a4e50 con 0x7f23140afab0 2024-09-12T12:15:25.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2311600640 1 -- 172.21.15.144:0/72012910 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c0ab820 con 0x7f23140afab0 2024-09-12T12:15:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2319600640 1 -- 172.21.15.144:0/72012910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23140afab0 msgr2=0x7f23140b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2319600640 1 --2- 172.21.15.144:0/72012910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23140afab0 0x7f23140b6260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f230c0097c0 tx=0x7f230c01c3d0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2319600640 1 -- 172.21.15.144:0/72012910 shutdown_connections 2024-09-12T12:15:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2319600640 1 --2- 172.21.15.144:0/72012910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23140afab0 0x7f23140b6260 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2319600640 1 --2- 172.21.15.144:0/72012910 >> v2:172.21.15.144:3300/0 conn(0x7f231406f020 0x7f23140717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2319600640 1 -- 172.21.15.144:0/72012910 >> 172.21.15.144:0/72012910 conn(0x7f231406ddf0 msgr2=0x7f231406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2319600640 1 -- 172.21.15.144:0/72012910 shutdown_connections 2024-09-12T12:15:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.171+0000 7f2319600640 1 -- 172.21.15.144:0/72012910 wait complete. 2024-09-12T12:15:25.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 Processor -- start 2024-09-12T12:15:25.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 -- start start 2024-09-12T12:15:25.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f231406f020 0x7f2314145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:25.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23140afab0 0x7f231414f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:25.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f231415e600 0x7f23141596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:25.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f231416b3b0 con 0x7f23140afab0 2024-09-12T12:15:25.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f231416b230 con 0x7f231415e600 2024-09-12T12:15:25.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f231416b530 con 0x7f231406f020 2024-09-12T12:15:25.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23140afab0 0x7f231414f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:25.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f231406f020 0x7f2314145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:25.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2313400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f231415e600 0x7f23141596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:25.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f231406f020 0x7f2314145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:38902/0 (socket says 172.21.15.144:38902) 2024-09-12T12:15:25.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312a00640 1 -- 172.21.15.144:0/2807075971 learned_addr learned my addr 172.21.15.144:0/2807075971 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:25.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312a00640 1 -- 172.21.15.144:0/2807075971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f231415e600 msgr2=0x7f23141596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:25.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312a00640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f231415e600 0x7f23141596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312a00640 1 -- 172.21.15.144:0/2807075971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23140afab0 msgr2=0x7f231414f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:25.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312a00640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23140afab0 0x7f231414f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312a00640 1 -- 172.21.15.144:0/2807075971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231414ff90 con 0x7f231406f020 2024-09-12T12:15:25.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2313400640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f231415e600 0x7f23141596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:25.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2312a00640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f231406f020 0x7f2314145a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f230400c890 tx=0x7f230400cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:25.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f230aa00640 1 -- 172.21.15.144:0/2807075971 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304018070 con 0x7f231406f020 2024-09-12T12:15:25.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f230aa00640 1 -- 172.21.15.144:0/2807075971 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230400a640 con 0x7f231406f020 2024-09-12T12:15:25.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2314150270 con 0x7f231406f020 2024-09-12T12:15:25.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f230aa00640 1 -- 172.21.15.144:0/2807075971 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230400aa30 con 0x7f231406f020 2024-09-12T12:15:25.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.175+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2314145f40 con 0x7f231406f020 2024-09-12T12:15:25.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.179+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23140b6260 con 0x7f231406f020 2024-09-12T12:15:25.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.179+0000 7f230aa00640 1 -- 172.21.15.144:0/2807075971 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f230401b070 con 0x7f231406f020 2024-09-12T12:15:25.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.179+0000 7f230aa00640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22f40678c0 0x7f22f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:25.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.179+0000 7f230aa00640 1 -- 172.21.15.144:0/2807075971 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(46..46 src has 1..46) ==== 5335+0+0 (secure 0 0 0) 0x7f23040851c0 con 0x7f231406f020 2024-09-12T12:15:25.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.179+0000 7f2312000640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22f40678c0 0x7f22f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:25.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.179+0000 7f2312000640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22f40678c0 0x7f22f4069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f231414f5b0 tx=0x7f2300009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:25.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.183+0000 7f230aa00640 1 -- 172.21.15.144:0/2807075971 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2304055800 con 0x7f231406f020 2024-09-12T12:15:25.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.355+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f23140af680 con 0x7f231406f020 2024-09-12T12:15:25.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f230aa00640 1 -- 172.21.15.144:0/2807075971 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) ==== 97+0+0 (secure 0 0 0) 0x7f2304059b00 con 0x7f231406f020 2024-09-12T12:15:25.952 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:15:25.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22f40678c0 msgr2=0x7f22f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:25.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22f40678c0 0x7f22f4069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f231414f5b0 tx=0x7f2300009240 comp rx=0 tx=0).stop 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f231406f020 msgr2=0x7f2314145a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f231406f020 0x7f2314145a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f230400c890 tx=0x7f230400cd50 comp rx=0 tx=0).stop 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 shutdown_connections 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f22f40678c0 0x7f22f4069d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f231415e600 0x7f23141596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23140afab0 0x7f231414f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 --2- 172.21.15.144:0/2807075971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f231406f020 0x7f2314145a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 >> 172.21.15.144:0/2807075971 conn(0x7f231406ddf0 msgr2=0x7f23140b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 shutdown_connections 2024-09-12T12:15:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:25.951+0000 7f2319600640 1 -- 172.21.15.144:0/2807075971 wait complete. 2024-09-12T12:15:25.983 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:15:26.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2d7200640 1 Processor -- start 2024-09-12T12:15:26.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2d7200640 1 -- start start 2024-09-12T12:15:26.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2d7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d015e5f0 0x7fe2d006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2d7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d006d260 con 0x7fe2d00b44a0 2024-09-12T12:15:26.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2d7200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d00b6f60 con 0x7fe2d006ea10 2024-09-12T12:15:26.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2d7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d00b7240 con 0x7fe2d015e5f0 2024-09-12T12:15:26.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cf400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe2d00b44a0 0x7fe2d006e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47920/0 (socket says 172.21.15.144:47920) 2024-09-12T12:15:26.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cf400640 1 -- 172.21.15.144:0/1180802539 learned_addr learned my addr 172.21.15.144:0/1180802539 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:26.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cfe00640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d015e5f0 0x7fe2d006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151071978 0 0) 0x7fe2d006d260 con 0x7fe2d00b44a0 2024-09-12T12:15:26.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b4003530 con 0x7fe2d00b44a0 2024-09-12T12:15:26.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3330345350 0 0) 0x7fe2b4003530 con 0x7fe2d00b44a0 2024-09-12T12:15:26.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d015e5f0 msgr2=0x7fe2d006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:26.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d015e5f0 0x7fe2d006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 >> v1:172.21.15.165:6789/0 conn(0x7fe2d006ea10 legacy=0x7fe2d015ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d00b7520 con 0x7fe2d00b44a0 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fe2bc001680 con 0x7fe2d00b44a0 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 >> v1:172.21.15.144:6789/0 conn(0x7fe2d00b44a0 legacy=0x7fe2d006e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d015e5f0 0x7fe2b40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b4004d50 0x7fe2b40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00b7240 con 0x7fe2b4003f70 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b400bab0 con 0x7fe2b4004d50 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b400bcb0 con 0x7fe2d015e5f0 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cf400640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cfe00640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d015e5f0 0x7fe2b40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2d5200640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b4004d50 0x7fe2b40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cf400640 1 -- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d015e5f0 msgr2=0x7fe2b40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cf400640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d015e5f0 0x7fe2b40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cf400640 1 -- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b4004d50 msgr2=0x7fe2b40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cf400640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b4004d50 0x7fe2b40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.123+0000 7fe2cf400640 1 -- 172.21.15.144:0/1180802539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b4003530 con 0x7fe2b4003f70 2024-09-12T12:15:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2cf400640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2b4004810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c240 tx=0x7fe2bc01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0791e063d7c47a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc007d20 con 0x7fe2b4003f70 2024-09-12T12:15:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc005ae0 con 0x7fe2b4003f70 2024-09-12T12:15:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2cea00640 1 -- 172.21.15.144:0/1180802539 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc007070 con 0x7fe2b4003f70 2024-09-12T12:15:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2d7200640 1 -- 172.21.15.144:0/1180802539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 msgr2=0x7fe2b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2d7200640 1 --2- 172.21.15.144:0/1180802539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2b4004810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c240 tx=0x7fe2bc01f3f0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2d5200640 1 -- 172.21.15.144:0/1180802539 reap_dead start 2024-09-12T12:15:26.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2d7200640 1 -- 172.21.15.144:0/1180802539 shutdown_connections 2024-09-12T12:15:26.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2d7200640 1 -- 172.21.15.144:0/1180802539 >> 172.21.15.144:0/1180802539 conn(0x7fe2d006f400 msgr2=0x7fe2d006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:26.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2d7200640 1 -- 172.21.15.144:0/1180802539 shutdown_connections 2024-09-12T12:15:26.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.127+0000 7fe2d7200640 1 -- 172.21.15.144:0/1180802539 wait complete. 2024-09-12T12:15:26.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 Processor -- start 2024-09-12T12:15:26.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 -- start start 2024-09-12T12:15:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2d0160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d0157470 0x7fe2d014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2d0150ee0 0x7fe2d0151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00b6b90 con 0x7fe2b4003f70 2024-09-12T12:15:26.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d015e9d0 con 0x7fe2d0150ee0 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d00b6d10 con 0x7fe2d0157470 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2d0160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2d0160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49646/0 (socket says 172.21.15.144:49646) 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cfe00640 1 -- 172.21.15.144:0/1327466467 learned_addr learned my addr 172.21.15.144:0/1327466467 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cf400640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d0157470 0x7fe2d014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d5200640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2d0150ee0 0x7fe2d0151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cfe00640 1 -- 172.21.15.144:0/1327466467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d0157470 msgr2=0x7fe2d014f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cfe00640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d0157470 0x7fe2d014f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cfe00640 1 -- 172.21.15.144:0/1327466467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2d0150ee0 msgr2=0x7fe2d0151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cfe00640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2d0150ee0 0x7fe2d0151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cfe00640 1 -- 172.21.15.144:0/1327466467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d0157be0 con 0x7fe2b4003f70 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d5200640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2d0150ee0 0x7fe2d0151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2cfe00640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2d0160520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0011a00 tx=0x7fe2c0011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2c7e00640 1 -- 172.21.15.144:0/1327466467 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000fb50 con 0x7fe2b4003f70 2024-09-12T12:15:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2c7e00640 1 -- 172.21.15.144:0/1327466467 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c000fcf0 con 0x7fe2b4003f70 2024-09-12T12:15:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d0157ec0 con 0x7fe2b4003f70 2024-09-12T12:15:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2c7e00640 1 -- 172.21.15.144:0/1327466467 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000fea0 con 0x7fe2b4003f70 2024-09-12T12:15:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.131+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d0158480 con 0x7fe2b4003f70 2024-09-12T12:15:26.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.135+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d00b48a0 con 0x7fe2b4003f70 2024-09-12T12:15:26.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.135+0000 7fe2c7e00640 1 -- 172.21.15.144:0/1327466467 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe2c0012040 con 0x7fe2b4003f70 2024-09-12T12:15:26.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.135+0000 7fe2c7e00640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2b00678f0 0x7fe2b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.135+0000 7fe2c7e00640 1 -- 172.21.15.144:0/1327466467 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7fe2c0086110 con 0x7fe2b4003f70 2024-09-12T12:15:26.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.135+0000 7fe2cf400640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2b00678f0 0x7fe2b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.135+0000 7fe2cf400640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2b00678f0 0x7fe2b0069db0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0af000 tx=0x7fe2bc0aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.139+0000 7fe2c7e00640 1 -- 172.21.15.144:0/1327466467 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe2c0019030 con 0x7fe2b4003f70 2024-09-12T12:15:26.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.355+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe2d00b2310 con 0x7fe2b4003f70 2024-09-12T12:15:26.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.355+0000 7fe2c7e00640 1 -- 172.21.15.144:0/1327466467 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7fe2c0056ec0 con 0x7fe2b4003f70 2024-09-12T12:15:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:26.359 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:15:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.359 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:15:26.360 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:15:26.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:15:26.363 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:15:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:15:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:15:26.364 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.365 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:15:26.366 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.367 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:15:26.368 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.369 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:15:26.372 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:15:26.373 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:15:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:15:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:15:26.374 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:15:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:15:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:15:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:15:26.375 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:26.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2b00678f0 msgr2=0x7fe2b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2b00678f0 0x7fe2b0069db0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0af000 tx=0x7fe2bc0aa000 comp rx=0 tx=0).stop 2024-09-12T12:15:26.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 msgr2=0x7fe2d0160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2d0160520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0011a00 tx=0x7fe2c0011ec0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 shutdown_connections 2024-09-12T12:15:26.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2b00678f0 0x7fe2b0069db0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2d0150ee0 0x7fe2d0151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d0157470 0x7fe2d014f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 --2- 172.21.15.144:0/1327466467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4003f70 0x7fe2d0160520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 >> 172.21.15.144:0/1327466467 conn(0x7fe2d006f400 msgr2=0x7fe2d006d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:26.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 shutdown_connections 2024-09-12T12:15:26.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.359+0000 7fe2d7200640 1 -- 172.21.15.144:0/1327466467 wait complete. 2024-09-12T12:15:26.381 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:15:26.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa062e00640 1 Processor -- start 2024-09-12T12:15:26.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa062e00640 1 -- start start 2024-09-12T12:15:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa062e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa05c15c0a0 0x7fa05c0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa062e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa05c0ce950 0x7fa05c15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa062e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa05c15c480 con 0x7fa05c0b6b20 2024-09-12T12:15:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa062e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa05c1609e0 con 0x7fa05c0ce950 2024-09-12T12:15:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa062e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa05c15fdd0 con 0x7fa05c15c0a0 2024-09-12T12:15:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa061000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa05c0ce950 0x7fa05c15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa061000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa05c0ce950 0x7fa05c15d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49650/0 (socket says 172.21.15.144:49650) 2024-09-12T12:15:26.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa062400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa05c0b6b20 0x7fa05c0b6fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47934/0 (socket says 172.21.15.144:47934) 2024-09-12T12:15:26.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa061000640 1 -- 172.21.15.144:0/2616481345 learned_addr learned my addr 172.21.15.144:0/2616481345 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:26.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa061a00640 1 --2- 172.21.15.144:0/2616481345 >> v2:172.21.15.165:3300/0 conn(0x7fa05c15c0a0 0x7fa05c0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa061000640 1 -- 172.21.15.144:0/2616481345 >> v2:172.21.15.165:3300/0 conn(0x7fa05c15c0a0 msgr2=0x7fa05c0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:26.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa061000640 1 --2- 172.21.15.144:0/2616481345 >> v2:172.21.15.165:3300/0 conn(0x7fa05c15c0a0 0x7fa05c0b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa061000640 1 -- 172.21.15.144:0/2616481345 >> v1:172.21.15.144:6789/0 conn(0x7fa05c0b6b20 legacy=0x7fa05c0b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa061000640 1 -- 172.21.15.144:0/2616481345 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c1600b0 con 0x7fa05c0ce950 2024-09-12T12:15:26.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.519+0000 7fa05be00640 1 -- 172.21.15.144:0/2616481345 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231146671 0 0) 0x7fa05c15c480 con 0x7fa05c0b6b20 2024-09-12T12:15:26.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa061000640 1 --2- 172.21.15.144:0/2616481345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0ce950 0x7fa05c15d0c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa05c072910 tx=0x7fa04801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fead60d858d568 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa05be00640 1 -- 172.21.15.144:0/2616481345 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0480b2070 con 0x7fa05c0ce950 2024-09-12T12:15:26.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa05be00640 1 -- 172.21.15.144:0/2616481345 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0480ad680 con 0x7fa05c0ce950 2024-09-12T12:15:26.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa05be00640 1 -- 172.21.15.144:0/2616481345 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0480ada50 con 0x7fa05c0ce950 2024-09-12T12:15:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa062e00640 1 -- 172.21.15.144:0/2616481345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0ce950 msgr2=0x7fa05c15d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa062e00640 1 --2- 172.21.15.144:0/2616481345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0ce950 0x7fa05c15d0c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa05c072910 tx=0x7fa04801c490 comp rx=0 tx=0).stop 2024-09-12T12:15:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa062e00640 1 -- 172.21.15.144:0/2616481345 shutdown_connections 2024-09-12T12:15:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa062e00640 1 --2- 172.21.15.144:0/2616481345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0ce950 0x7fa05c15d0c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa062e00640 1 --2- 172.21.15.144:0/2616481345 >> v2:172.21.15.165:3300/0 conn(0x7fa05c15c0a0 0x7fa05c0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa062e00640 1 -- 172.21.15.144:0/2616481345 >> 172.21.15.144:0/2616481345 conn(0x7fa05c0d2280 msgr2=0x7fa05c0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa062e00640 1 -- 172.21.15.144:0/2616481345 shutdown_connections 2024-09-12T12:15:26.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.523+0000 7fa062e00640 1 -- 172.21.15.144:0/2616481345 wait complete. 2024-09-12T12:15:26.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 Processor -- start 2024-09-12T12:15:26.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 -- start start 2024-09-12T12:15:26.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0b6b20 0x7fa05c150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa05c0ce950 0x7fa05c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa05c15c0a0 0x7fa05c0b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c073c30 con 0x7fa05c0b6b20 2024-09-12T12:15:26.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c073ab0 con 0x7fa05c15c0a0 2024-09-12T12:15:26.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa05c073db0 con 0x7fa05c0ce950 2024-09-12T12:15:26.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0b6b20 0x7fa05c150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0b6b20 0x7fa05c150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49662/0 (socket says 172.21.15.144:49662) 2024-09-12T12:15:26.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061a00640 1 -- 172.21.15.144:0/3129711570 learned_addr learned my addr 172.21.15.144:0/3129711570 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061000640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa05c0ce950 0x7fa05c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062400640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa05c15c0a0 0x7fa05c0b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061a00640 1 -- 172.21.15.144:0/3129711570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa05c0ce950 msgr2=0x7fa05c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061a00640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa05c0ce950 0x7fa05c0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061a00640 1 -- 172.21.15.144:0/3129711570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa05c15c0a0 msgr2=0x7fa05c0b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061a00640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa05c15c0a0 0x7fa05c0b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061a00640 1 -- 172.21.15.144:0/3129711570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c1500d0 con 0x7fa05c0b6b20 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062400640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa05c15c0a0 0x7fa05c0b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa061a00640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0b6b20 0x7fa05c150e90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa05000d800 tx=0x7fa05000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa059600640 1 -- 172.21.15.144:0/3129711570 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05000b660 con 0x7fa05c0b6b20 2024-09-12T12:15:26.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa059600640 1 -- 172.21.15.144:0/3129711570 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa050019070 con 0x7fa05c0b6b20 2024-09-12T12:15:26.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa059600640 1 -- 172.21.15.144:0/3129711570 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05000ba00 con 0x7fa05c0b6b20 2024-09-12T12:15:26.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05c1503b0 con 0x7fa05c0b6b20 2024-09-12T12:15:26.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05c150970 con 0x7fa05c0b6b20 2024-09-12T12:15:26.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.527+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05c069de0 con 0x7fa05c0b6b20 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.531+0000 7fa059600640 1 -- 172.21.15.144:0/3129711570 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa05000bba0 con 0x7fa05c0b6b20 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.531+0000 7fa059600640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa03c0678c0 0x7fa03c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.531+0000 7fa059600640 1 -- 172.21.15.144:0/3129711570 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7fa050085fc0 con 0x7fa05c0b6b20 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.531+0000 7fa061000640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa03c0678c0 0x7fa03c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.531+0000 7fa061000640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa03c0678c0 0x7fa03c069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa0480af000 tx=0x7fa0480a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.535+0000 7fa059600640 1 -- 172.21.15.144:0/3129711570 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa050056c20 con 0x7fa05c0b6b20 2024-09-12T12:15:26.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.695+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa05c15d0c0 con 0x7fa05c0b6b20 2024-09-12T12:15:26.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.695+0000 7fa059600640 1 -- 172.21.15.144:0/3129711570 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) ==== 84+0+65 (secure 0 0 0) 0x7fa050056520 con 0x7fa05c0b6b20 2024-09-12T12:15:26.699 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:26.700 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:15:26.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:26.700 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:15:26.700 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:15:26.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:26.700 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:15:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa03c0678c0 msgr2=0x7fa03c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa03c0678c0 0x7fa03c069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa0480af000 tx=0x7fa0480a7000 comp rx=0 tx=0).stop 2024-09-12T12:15:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0b6b20 msgr2=0x7fa05c150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0b6b20 0x7fa05c150e90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa05000d800 tx=0x7fa05000dcc0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 shutdown_connections 2024-09-12T12:15:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa03c0678c0 0x7fa03c069d80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa05c15c0a0 0x7fa05c0b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa05c0ce950 0x7fa05c0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 --2- 172.21.15.144:0/3129711570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa05c0b6b20 0x7fa05c150e90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 >> 172.21.15.144:0/3129711570 conn(0x7fa05c0d2280 msgr2=0x7fa05c151fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 shutdown_connections 2024-09-12T12:15:26.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.699+0000 7fa062e00640 1 -- 172.21.15.144:0/3129711570 wait complete. 2024-09-12T12:15:26.721 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:15:26.722 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:15:26.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb272e00640 1 Processor -- start 2024-09-12T12:15:26.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb272e00640 1 -- start start 2024-09-12T12:15:26.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb272e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb26c0cc150 0x7fb26c0cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb272e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb26c0b40e0 0x7fb26c0b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb272e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26c06cd20 con 0x7fb26c06cff0 2024-09-12T12:15:26.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb272e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb26c0733d0 con 0x7fb26c0cc150 2024-09-12T12:15:26.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb272e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb26c0ccaf0 con 0x7fb26c0b40e0 2024-09-12T12:15:26.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb26b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb26c0cc150 0x7fb26c0cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb26b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb26c0cc150 0x7fb26c0cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49676/0 (socket says 172.21.15.144:49676) 2024-09-12T12:15:26.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb26b400640 1 -- 172.21.15.144:0/206341103 learned_addr learned my addr 172.21.15.144:0/206341103 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:26.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb26b400640 1 -- 172.21.15.144:0/206341103 >> v2:172.21.15.165:3300/0 conn(0x7fb26c0b40e0 msgr2=0x7fb26c0b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:26.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb270e00640 1 --2- 172.21.15.144:0/206341103 >> v2:172.21.15.165:3300/0 conn(0x7fb26c0b40e0 0x7fb26c0b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb26b400640 1 --2- 172.21.15.144:0/206341103 >> v2:172.21.15.165:3300/0 conn(0x7fb26c0b40e0 0x7fb26c0b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb26b400640 1 -- 172.21.15.144:0/206341103 >> v1:172.21.15.165:6789/0 conn(0x7fb26c06cff0 legacy=0x7fb26c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:26.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb26b400640 1 -- 172.21.15.144:0/206341103 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c073670 con 0x7fb26c0cc150 2024-09-12T12:15:26.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.863+0000 7fb270e00640 1 --2- 172.21.15.144:0/206341103 >> v2:172.21.15.165:3300/0 conn(0x7fb26c0b40e0 0x7fb26c0b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:26.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb26b400640 1 --2- 172.21.15.144:0/206341103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 0x7fb26c0cc5b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb26c070dc0 tx=0x7fb25801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff43a9836976933 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb26aa00640 1 -- 172.21.15.144:0/206341103 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2580aa610 con 0x7fb26c0cc150 2024-09-12T12:15:26.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb26aa00640 1 -- 172.21.15.144:0/206341103 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2580af070 con 0x7fb26c0cc150 2024-09-12T12:15:26.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb26aa00640 1 -- 172.21.15.144:0/206341103 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2580aa9d0 con 0x7fb26c0cc150 2024-09-12T12:15:26.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb272e00640 1 -- 172.21.15.144:0/206341103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 msgr2=0x7fb26c0cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb272e00640 1 --2- 172.21.15.144:0/206341103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 0x7fb26c0cc5b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb26c070dc0 tx=0x7fb25801c4b0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb272e00640 1 -- 172.21.15.144:0/206341103 shutdown_connections 2024-09-12T12:15:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb272e00640 1 --2- 172.21.15.144:0/206341103 >> v2:172.21.15.165:3300/0 conn(0x7fb26c0b40e0 0x7fb26c0b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb272e00640 1 --2- 172.21.15.144:0/206341103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 0x7fb26c0cc5b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb272e00640 1 -- 172.21.15.144:0/206341103 >> 172.21.15.144:0/206341103 conn(0x7fb26c06bc10 msgr2=0x7fb26c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb272e00640 1 -- 172.21.15.144:0/206341103 shutdown_connections 2024-09-12T12:15:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.867+0000 7fb272e00640 1 -- 172.21.15.144:0/206341103 wait complete. 2024-09-12T12:15:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 Processor -- start 2024-09-12T12:15:26.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 -- start start 2024-09-12T12:15:26.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb26c06cff0 0x7fb26c0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb26c0b40e0 0x7fb26c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 0x7fb26c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c15eb90 con 0x7fb26c0cc150 2024-09-12T12:15:26.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c0741f0 con 0x7fb26c06cff0 2024-09-12T12:15:26.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb26c15ed10 con 0x7fb26c0b40e0 2024-09-12T12:15:26.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb270e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 0x7fb26c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb270e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 0x7fb26c0c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49684/0 (socket says 172.21.15.144:49684) 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb270e00640 1 -- 172.21.15.144:0/3468153304 learned_addr learned my addr 172.21.15.144:0/3468153304 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb26be00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb26c06cff0 0x7fb26c0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb26b400640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb26c0b40e0 0x7fb26c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb270e00640 1 -- 172.21.15.144:0/3468153304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb26c0b40e0 msgr2=0x7fb26c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb270e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb26c0b40e0 0x7fb26c156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb270e00640 1 -- 172.21.15.144:0/3468153304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb26c06cff0 msgr2=0x7fb26c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb270e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb26c06cff0 0x7fb26c0cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb270e00640 1 -- 172.21.15.144:0/3468153304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c15efc0 con 0x7fb26c0cc150 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb26b400640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb26c0b40e0 0x7fb26c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb270e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 0x7fb26c0c9810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb26400c7f0 tx=0x7fb26400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb263e00640 1 -- 172.21.15.144:0/3468153304 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264015020 con 0x7fb26c0cc150 2024-09-12T12:15:26.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb263e00640 1 -- 172.21.15.144:0/3468153304 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb264004250 con 0x7fb26c0cc150 2024-09-12T12:15:26.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb263e00640 1 -- 172.21.15.144:0/3468153304 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264003620 con 0x7fb26c0cc150 2024-09-12T12:15:26.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26c15f2a0 con 0x7fb26c0cc150 2024-09-12T12:15:26.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb26c0cb3c0 con 0x7fb26c0cc150 2024-09-12T12:15:26.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.871+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26c0b4550 con 0x7fb26c0cc150 2024-09-12T12:15:26.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.875+0000 7fb263e00640 1 -- 172.21.15.144:0/3468153304 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb264018020 con 0x7fb26c0cc150 2024-09-12T12:15:26.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.875+0000 7fb263e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb24c0678c0 0x7fb24c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.875+0000 7fb263e00640 1 -- 172.21.15.144:0/3468153304 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5249+0+0 (secure 0 0 0) 0x7fb264085da0 con 0x7fb26c0cc150 2024-09-12T12:15:26.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.875+0000 7fb26be00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb24c0678c0 0x7fb24c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.875+0000 7fb26be00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb24c0678c0 0x7fb24c069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb26c15c3c0 tx=0x7fb25c00d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:26.879+0000 7fb263e00640 1 -- 172.21.15.144:0/3468153304 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb26401f020 con 0x7fb26c0cc150 2024-09-12T12:15:27.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.047+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb26c15c660 con 0x7fb26c0cc150 2024-09-12T12:15:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.955+0000 7fb263e00640 1 -- 172.21.15.144:0/3468153304 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) ==== 138+0+0 (secure 0 0 0) 0x7fb264056a90 con 0x7fb26c0cc150 2024-09-12T12:15:27.957 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:15:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb24c0678c0 msgr2=0x7fb24c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb24c0678c0 0x7fb24c069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb26c15c3c0 tx=0x7fb25c00d040 comp rx=0 tx=0).stop 2024-09-12T12:15:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 msgr2=0x7fb26c0c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 0x7fb26c0c9810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb26400c7f0 tx=0x7fb26400ccb0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 shutdown_connections 2024-09-12T12:15:27.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb24c0678c0 0x7fb24c069d80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb26c0cc150 0x7fb26c0c9810 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb26c0b40e0 0x7fb26c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 --2- 172.21.15.144:0/3468153304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb26c06cff0 0x7fb26c0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 >> 172.21.15.144:0/3468153304 conn(0x7fb26c06bc10 msgr2=0x7fb26c15d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:27.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 shutdown_connections 2024-09-12T12:15:27.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:27.959+0000 7fb272e00640 1 -- 172.21.15.144:0/3468153304 wait complete. 2024-09-12T12:15:27.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:15:28.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.143+0000 7f169fc00640 1 Processor -- start 2024-09-12T12:15:28.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.143+0000 7f169fc00640 1 -- start start 2024-09-12T12:15:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.143+0000 7f169fc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f16980b73f0 0x7f16981690b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.143+0000 7f169fc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169806d730 con 0x7f169806ea70 2024-09-12T12:15:28.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.143+0000 7f169fc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169806d9d0 con 0x7f169815e570 2024-09-12T12:15:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.143+0000 7f169fc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1698073550 con 0x7f16980b73f0 2024-09-12T12:15:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.143+0000 7f1697e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f169806ea70 0x7f16980b6ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39544/0 (socket says 172.21.15.144:39544) 2024-09-12T12:15:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.143+0000 7f1697e00640 1 -- 172.21.15.144:0/3025837036 learned_addr learned my addr 172.21.15.144:0/3025837036 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.143+0000 7f169dc00640 1 --2- 172.21.15.144:0/3025837036 >> v2:172.21.15.165:3300/0 conn(0x7f16980b73f0 0x7f16981690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f1697400640 1 -- 172.21.15.144:0/3025837036 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 171453753 0 0) 0x7f169806d730 con 0x7f169806ea70 2024-09-12T12:15:28.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f1697400640 1 -- 172.21.15.144:0/3025837036 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1680003530 con 0x7f169806ea70 2024-09-12T12:15:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f1697400640 1 -- 172.21.15.144:0/3025837036 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735340456 0 0) 0x7f169806d9d0 con 0x7f169815e570 2024-09-12T12:15:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f169dc00640 1 -- 172.21.15.144:0/3025837036 >> v1:172.21.15.165:6789/0 conn(0x7f169815e570 legacy=0x7f1698073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f169dc00640 1 -- 172.21.15.144:0/3025837036 >> v1:172.21.15.144:6789/0 conn(0x7f169806ea70 legacy=0x7f16980b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f169dc00640 1 -- 172.21.15.144:0/3025837036 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169806dcb0 con 0x7f16980b73f0 2024-09-12T12:15:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f169dc00640 1 --2- 172.21.15.144:0/3025837036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16980b73f0 0x7f16981690b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1690009d90 tx=0x7f169001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f622b73be9d079f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:28.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f1697400640 1 -- 172.21.15.144:0/3025837036 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900b2070 con 0x7f16980b73f0 2024-09-12T12:15:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f1697400640 1 -- 172.21.15.144:0/3025837036 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16900a5830 con 0x7f16980b73f0 2024-09-12T12:15:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.147+0000 7f1697400640 1 -- 172.21.15.144:0/3025837036 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900a5c00 con 0x7f16980b73f0 2024-09-12T12:15:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 -- 172.21.15.144:0/3025837036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16980b73f0 msgr2=0x7f16981690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 --2- 172.21.15.144:0/3025837036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16980b73f0 0x7f16981690b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1690009d90 tx=0x7f169001c970 comp rx=0 tx=0).stop 2024-09-12T12:15:28.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 -- 172.21.15.144:0/3025837036 shutdown_connections 2024-09-12T12:15:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 --2- 172.21.15.144:0/3025837036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16980b73f0 0x7f16981690b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 -- 172.21.15.144:0/3025837036 >> 172.21.15.144:0/3025837036 conn(0x7f169806c010 msgr2=0x7f1698067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 -- 172.21.15.144:0/3025837036 shutdown_connections 2024-09-12T12:15:28.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 -- 172.21.15.144:0/3025837036 wait complete. 2024-09-12T12:15:28.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 Processor -- start 2024-09-12T12:15:28.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 -- start start 2024-09-12T12:15:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f169806ea70 0x7f169815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16980b73f0 0x7f169814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169815e570 0x7f169814ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f169816c020 con 0x7f169815e570 2024-09-12T12:15:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f16980741e0 con 0x7f169806ea70 2024-09-12T12:15:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f169816c1a0 con 0x7f16980b73f0 2024-09-12T12:15:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169815e570 0x7f169814ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:28.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169815e570 0x7f169814ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52514/0 (socket says 172.21.15.144:52514) 2024-09-12T12:15:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169dc00640 1 -- 172.21.15.144:0/2592457510 learned_addr learned my addr 172.21.15.144:0/2592457510 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169d200640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f169806ea70 0x7f169815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:28.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f1697e00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16980b73f0 0x7f169814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169dc00640 1 -- 172.21.15.144:0/2592457510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16980b73f0 msgr2=0x7f169814a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169dc00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16980b73f0 0x7f169814a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169dc00640 1 -- 172.21.15.144:0/2592457510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f169806ea70 msgr2=0x7f169815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169dc00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f169806ea70 0x7f169815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.151+0000 7f169dc00640 1 -- 172.21.15.144:0/2592457510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169814f600 con 0x7f169815e570 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f169dc00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169815e570 0x7f169814ed60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1690009d90 tx=0x7f1690019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f1694c00640 1 -- 172.21.15.144:0/2592457510 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900c0070 con 0x7f169815e570 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f1694c00640 1 -- 172.21.15.144:0/2592457510 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16900039a0 con 0x7f169815e570 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169814f8e0 con 0x7f169815e570 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f1694c00640 1 -- 172.21.15.144:0/2592457510 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900b2040 con 0x7f169815e570 2024-09-12T12:15:28.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169814cd00 con 0x7f169815e570 2024-09-12T12:15:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16980b6ce0 con 0x7f169815e570 2024-09-12T12:15:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f1694c00640 1 -- 172.21.15.144:0/2592457510 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16900c3070 con 0x7f169815e570 2024-09-12T12:15:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f1694c00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16780678c0 0x7f1678069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f1694c00640 1 -- 172.21.15.144:0/2592457510 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5619+0+0 (secure 0 0 0) 0x7f169011ffa0 con 0x7f169815e570 2024-09-12T12:15:28.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.155+0000 7f169d200640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16780678c0 0x7f1678069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:28.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.159+0000 7f169d200640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16780678c0 0x7f1678069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f168c000f70 tx=0x7f168c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:28.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.163+0000 7f1694c00640 1 -- 172.21.15.144:0/2592457510 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1690016560 con 0x7f169815e570 2024-09-12T12:15:28.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.323+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1698154710 con 0x7f169815e570 2024-09-12T12:15:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.959+0000 7f1694c00640 1 -- 172.21.15.144:0/2592457510 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) ==== 170+0+0 (secure 0 0 0) 0x7f16900f0a90 con 0x7f169815e570 2024-09-12T12:15:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.959+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16780678c0 msgr2=0x7f1678069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.959+0000 7f169fc00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16780678c0 0x7f1678069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f168c000f70 tx=0x7f168c009040 comp rx=0 tx=0).stop 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.959+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169815e570 msgr2=0x7f169814ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.959+0000 7f169fc00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169815e570 0x7f169814ed60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1690009d90 tx=0x7f1690019710 comp rx=0 tx=0).stop 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.963+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 shutdown_connections 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.963+0000 7f169fc00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16780678c0 0x7f1678069d80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.963+0000 7f169fc00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f169815e570 0x7f169814ed60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.963+0000 7f169fc00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16980b73f0 0x7f169814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.963+0000 7f169fc00640 1 --2- 172.21.15.144:0/2592457510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f169806ea70 0x7f169815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.963+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 >> 172.21.15.144:0/2592457510 conn(0x7f169806c010 msgr2=0x7f169806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:28.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.963+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 shutdown_connections 2024-09-12T12:15:28.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:28.963+0000 7f169fc00640 1 -- 172.21.15.144:0/2592457510 wait complete. 2024-09-12T12:15:29.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:15:29.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.143+0000 7fb6b5600640 1 Processor -- start 2024-09-12T12:15:29.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.143+0000 7fb6b5600640 1 -- start start 2024-09-12T12:15:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b5600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb6b00b3b40 0x7fb6b015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b5600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b00cf7a0 0x7fb6b00cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b5600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b00b3fb0 con 0x7fb6b006f650 2024-09-12T12:15:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b5600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b00d0110 con 0x7fb6b00b3b40 2024-09-12T12:15:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b5600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b006bcb0 con 0x7fb6b00cf7a0 2024-09-12T12:15:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6afe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb6b006f650 0x7fb6b006fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39556/0 (socket says 172.21.15.144:39556) 2024-09-12T12:15:29.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6afe00640 1 -- 172.21.15.144:0/2315384244 learned_addr learned my addr 172.21.15.144:0/2315384244 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:29.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b4c00640 1 --2- 172.21.15.144:0/2315384244 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b00cf7a0 0x7fb6b00cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6af400640 1 --2- 172.21.15.144:0/2315384244 >> v2:172.21.15.165:3300/0 conn(0x7fb6b00b3b40 0x7fb6b015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6aea00640 1 -- 172.21.15.144:0/2315384244 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2913869836 0 0) 0x7fb6b00b3fb0 con 0x7fb6b006f650 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6aea00640 1 -- 172.21.15.144:0/2315384244 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb694003530 con 0x7fb6b006f650 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b4c00640 1 -- 172.21.15.144:0/2315384244 >> v2:172.21.15.165:3300/0 conn(0x7fb6b00b3b40 msgr2=0x7fb6b015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b4c00640 1 --2- 172.21.15.144:0/2315384244 >> v2:172.21.15.165:3300/0 conn(0x7fb6b00b3b40 0x7fb6b015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b4c00640 1 -- 172.21.15.144:0/2315384244 >> v1:172.21.15.144:6789/0 conn(0x7fb6b006f650 legacy=0x7fb6b006fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6b4c00640 1 -- 172.21.15.144:0/2315384244 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b006bf90 con 0x7fb6b00cf7a0 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.147+0000 7fb6af400640 1 --2- 172.21.15.144:0/2315384244 >> v2:172.21.15.165:3300/0 conn(0x7fb6b00b3b40 0x7fb6b015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b4c00640 1 --2- 172.21.15.144:0/2315384244 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b00cf7a0 0x7fb6b00cfbd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80097c0 tx=0x7fb6a801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca5d0d349cab0ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6aea00640 1 -- 172.21.15.144:0/2315384244 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80b1070 con 0x7fb6b00cf7a0 2024-09-12T12:15:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6aea00640 1 -- 172.21.15.144:0/2315384244 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a80a8050 con 0x7fb6b00cf7a0 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6aea00640 1 -- 172.21.15.144:0/2315384244 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80ac840 con 0x7fb6b00cf7a0 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 -- 172.21.15.144:0/2315384244 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b00cf7a0 msgr2=0x7fb6b00cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 --2- 172.21.15.144:0/2315384244 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b00cf7a0 0x7fb6b00cfbd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80097c0 tx=0x7fb6a801c3e0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 -- 172.21.15.144:0/2315384244 shutdown_connections 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 --2- 172.21.15.144:0/2315384244 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b00cf7a0 0x7fb6b00cfbd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 --2- 172.21.15.144:0/2315384244 >> v2:172.21.15.165:3300/0 conn(0x7fb6b00b3b40 0x7fb6b015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 -- 172.21.15.144:0/2315384244 >> 172.21.15.144:0/2315384244 conn(0x7fb6b00b0980 msgr2=0x7fb6b00b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 -- 172.21.15.144:0/2315384244 shutdown_connections 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 -- 172.21.15.144:0/2315384244 wait complete. 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 Processor -- start 2024-09-12T12:15:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 -- start start 2024-09-12T12:15:29.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b006f650 0x7fb6b0157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6b00b3b40 0x7fb6b0145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6b00cf7a0 0x7fb6b015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b015d5e0 con 0x7fb6b00b3b40 2024-09-12T12:15:29.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b015d460 con 0x7fb6b00cf7a0 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.151+0000 7fb6b5600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b00afce0 con 0x7fb6b006f650 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6b00b3b40 0x7fb6b0145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6afe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b006f650 0x7fb6b0157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6b00b3b40 0x7fb6b0145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52518/0 (socket says 172.21.15.144:52518) 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6af400640 1 -- 172.21.15.144:0/1642401142 learned_addr learned my addr 172.21.15.144:0/1642401142 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6b4c00640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6b00cf7a0 0x7fb6b015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6af400640 1 -- 172.21.15.144:0/1642401142 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b006f650 msgr2=0x7fb6b0157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6af400640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b006f650 0x7fb6b0157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6af400640 1 -- 172.21.15.144:0/1642401142 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6b00cf7a0 msgr2=0x7fb6b015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6af400640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6b00cf7a0 0x7fb6b015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6af400640 1 -- 172.21.15.144:0/1642401142 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b0156eb0 con 0x7fb6b00b3b40 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6af400640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6b00b3b40 0x7fb6b0145640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00ebe0 tx=0x7fb69c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6a7e00640 1 -- 172.21.15.144:0/1642401142 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c017070 con 0x7fb6b00b3b40 2024-09-12T12:15:29.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6a7e00640 1 -- 172.21.15.144:0/1642401142 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c00cc30 con 0x7fb6b00b3b40 2024-09-12T12:15:29.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6a7e00640 1 -- 172.21.15.144:0/1642401142 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c013470 con 0x7fb6b00b3b40 2024-09-12T12:15:29.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b0157190 con 0x7fb6b00b3b40 2024-09-12T12:15:29.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b0157750 con 0x7fb6b00b3b40 2024-09-12T12:15:29.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.155+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b00cfdc0 con 0x7fb6b00b3b40 2024-09-12T12:15:29.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.159+0000 7fb6a7e00640 1 -- 172.21.15.144:0/1642401142 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb69c01a070 con 0x7fb6b00b3b40 2024-09-12T12:15:29.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.159+0000 7fb6a7e00640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb6900678c0 0x7fb690069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.159+0000 7fb6a7e00640 1 -- 172.21.15.144:0/1642401142 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6001+0+0 (secure 0 0 0) 0x7fb69c0864d0 con 0x7fb6b00b3b40 2024-09-12T12:15:29.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.159+0000 7fb6afe00640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb6900678c0 0x7fb690069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.159+0000 7fb6afe00640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb6900678c0 0x7fb690069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0005c10 tx=0x7fb6a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:29.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.163+0000 7fb6a7e00640 1 -- 172.21.15.144:0/1642401142 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb69c056890 con 0x7fb6b00b3b40 2024-09-12T12:15:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.359+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb6b00747b0 con 0x7fb6b00b3b40 2024-09-12T12:15:29.997 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 7 and data pool 8 2024-09-12T12:15:29.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:29.987+0000 7fb6a7e00640 1 -- 172.21.15.144:0/1642401142 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v23) ==== 172+0+0 (secure 0 0 0) 0x7fb69c05ab90 con 0x7fb6b00b3b40 2024-09-12T12:15:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.003+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb6900678c0 msgr2=0x7fb690069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.003+0000 7fb6b5600640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb6900678c0 0x7fb690069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0005c10 tx=0x7fb6a0009040 comp rx=0 tx=0).stop 2024-09-12T12:15:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.003+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6b00b3b40 msgr2=0x7fb6b0145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.003+0000 7fb6b5600640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6b00b3b40 0x7fb6b0145640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00ebe0 tx=0x7fb69c00c520 comp rx=0 tx=0).stop 2024-09-12T12:15:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.007+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 shutdown_connections 2024-09-12T12:15:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.007+0000 7fb6b5600640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb6900678c0 0x7fb690069d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.007+0000 7fb6b5600640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6b00cf7a0 0x7fb6b015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.007+0000 7fb6b5600640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6b00b3b40 0x7fb6b0145640 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.007+0000 7fb6b5600640 1 --2- 172.21.15.144:0/1642401142 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6b006f650 0x7fb6b0157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.007+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 >> 172.21.15.144:0/1642401142 conn(0x7fb6b00b0980 msgr2=0x7fb6b015fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:30.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.007+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 shutdown_connections 2024-09-12T12:15:30.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.007+0000 7fb6b5600640 1 -- 172.21.15.144:0/1642401142 wait complete. 2024-09-12T12:15:30.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:15:30.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.179+0000 7fd2f8e00640 1 Processor -- start 2024-09-12T12:15:30.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.179+0000 7fd2f8e00640 1 -- start start 2024-09-12T12:15:30.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f8e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2f415c220 0x7fd2f40d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40b4200 0x7fd2f40b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f8e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd2f40732c0 0x7fd2f4073710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f8e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f40b4bb0 con 0x7fd2f415c220 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f8e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f40d1580 con 0x7fd2f40732c0 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f40d1860 con 0x7fd2f40b4200 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2f415c220 0x7fd2f40d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2f415c220 0x7fd2f40d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52524/0 (socket says 172.21.15.144:52524) 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1e00640 1 -- 172.21.15.144:0/3160649549 learned_addr learned my addr 172.21.15.144:0/3160649549 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1400640 1 --2- 172.21.15.144:0/3160649549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40b4200 0x7fd2f40b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f2800640 1 --2- 172.21.15.144:0/3160649549 >> v2:172.21.15.165:3300/0 conn(0x7fd2f40732c0 0x7fd2f4073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1e00640 1 -- 172.21.15.144:0/3160649549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40b4200 msgr2=0x7fd2f40b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1e00640 1 --2- 172.21.15.144:0/3160649549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40b4200 0x7fd2f40b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1e00640 1 -- 172.21.15.144:0/3160649549 >> v2:172.21.15.165:3300/0 conn(0x7fd2f40732c0 msgr2=0x7fd2f4073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:30.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1e00640 1 --2- 172.21.15.144:0/3160649549 >> v2:172.21.15.165:3300/0 conn(0x7fd2f40732c0 0x7fd2f4073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1e00640 1 -- 172.21.15.144:0/3160649549 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f40d1b40 con 0x7fd2f415c220 2024-09-12T12:15:30.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.183+0000 7fd2f1e00640 1 --2- 172.21.15.144:0/3160649549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f415c220 0x7fd2f40d0c10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40b1680 tx=0x7fd2e401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed90b95bbace5b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f0a00640 1 -- 172.21.15.144:0/3160649549 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40aa610 con 0x7fd2f415c220 2024-09-12T12:15:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f0a00640 1 -- 172.21.15.144:0/3160649549 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e40af070 con 0x7fd2f415c220 2024-09-12T12:15:30.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f0a00640 1 -- 172.21.15.144:0/3160649549 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40aa9d0 con 0x7fd2f415c220 2024-09-12T12:15:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 -- 172.21.15.144:0/3160649549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f415c220 msgr2=0x7fd2f40d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/3160649549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f415c220 0x7fd2f40d0c10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40b1680 tx=0x7fd2e401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 -- 172.21.15.144:0/3160649549 shutdown_connections 2024-09-12T12:15:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/3160649549 >> v2:172.21.15.165:3300/0 conn(0x7fd2f40732c0 0x7fd2f4073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/3160649549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40b4200 0x7fd2f40b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/3160649549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f415c220 0x7fd2f40d0c10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 -- 172.21.15.144:0/3160649549 >> 172.21.15.144:0/3160649549 conn(0x7fd2f406f400 msgr2=0x7fd2f406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 -- 172.21.15.144:0/3160649549 shutdown_connections 2024-09-12T12:15:30.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 -- 172.21.15.144:0/3160649549 wait complete. 2024-09-12T12:15:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 Processor -- start 2024-09-12T12:15:30.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 -- start start 2024-09-12T12:15:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40732c0 0x7fd2f414b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f40b4200 0x7fd2f4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f415c220 0x7fd2f41514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f415c780 con 0x7fd2f40b4200 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f415c600 con 0x7fd2f415c220 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f40d1150 con 0x7fd2f40732c0 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f40b4200 0x7fd2f4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f40b4200 0x7fd2f4155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52532/0 (socket says 172.21.15.144:52532) 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.187+0000 7fd2f1400640 1 -- 172.21.15.144:0/2414786903 learned_addr learned my addr 172.21.15.144:0/2414786903 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f1e00640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40732c0 0x7fd2f414b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f2800640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f415c220 0x7fd2f41514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f1400640 1 -- 172.21.15.144:0/2414786903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40732c0 msgr2=0x7fd2f414b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f1400640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40732c0 0x7fd2f414b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f1400640 1 -- 172.21.15.144:0/2414786903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f415c220 msgr2=0x7fd2f41514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f1400640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f415c220 0x7fd2f41514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f1400640 1 -- 172.21.15.144:0/2414786903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f41542d0 con 0x7fd2f40b4200 2024-09-12T12:15:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f1400640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f40b4200 0x7fd2f4155370 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00d800 tx=0x7fd2dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2ea000640 1 -- 172.21.15.144:0/2414786903 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc00b6c0 con 0x7fd2f40b4200 2024-09-12T12:15:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2ea000640 1 -- 172.21.15.144:0/2414786903 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc019070 con 0x7fd2f40b4200 2024-09-12T12:15:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f41545b0 con 0x7fd2f40b4200 2024-09-12T12:15:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2ea000640 1 -- 172.21.15.144:0/2414786903 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc00bae0 con 0x7fd2f40b4200 2024-09-12T12:15:30.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f4154b70 con 0x7fd2f40b4200 2024-09-12T12:15:30.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f4070bf0 con 0x7fd2f40b4200 2024-09-12T12:15:30.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2ea000640 1 -- 172.21.15.144:0/2414786903 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2dc00bc80 con 0x7fd2f40b4200 2024-09-12T12:15:30.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2ea000640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2d00678c0 0x7fd2d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.191+0000 7fd2ea000640 1 -- 172.21.15.144:0/2414786903 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fd2dc086200 con 0x7fd2f40b4200 2024-09-12T12:15:30.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.195+0000 7fd2f1e00640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2d00678c0 0x7fd2d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.195+0000 7fd2f1e00640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2d00678c0 0x7fd2d0069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40ae000 tx=0x7fd2e40a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:30.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.199+0000 7fd2ea000640 1 -- 172.21.15.144:0/2414786903 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2dc056550 con 0x7fd2f40b4200 2024-09-12T12:15:30.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.359+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2f406e220 con 0x7fd2f40b4200 2024-09-12T12:15:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.359+0000 7fd2ea000640 1 -- 172.21.15.144:0/2414786903 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+17039 (secure 0 0 0) 0x7fd2dc05a850 con 0x7fd2f40b4200 2024-09-12T12:15:30.362 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:30.362 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":53,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:15:29.364028+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:15:27.094655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T12:15:28.370982+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2d00678c0 msgr2=0x7fd2d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2d00678c0 0x7fd2d0069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40ae000 tx=0x7fd2e40a7000 comp rx=0 tx=0).stop 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f40b4200 msgr2=0x7fd2f4155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f40b4200 0x7fd2f4155370 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00d800 tx=0x7fd2dc00dcc0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 shutdown_connections 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2d00678c0 0x7fd2d0069d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f415c220 0x7fd2f41514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f40b4200 0x7fd2f4155370 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 --2- 172.21.15.144:0/2414786903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2f40732c0 0x7fd2f414b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 >> 172.21.15.144:0/2414786903 conn(0x7fd2f406f400 msgr2=0x7fd2f40b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 shutdown_connections 2024-09-12T12:15:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.363+0000 7fd2f8e00640 1 -- 172.21.15.144:0/2414786903 wait complete. 2024-09-12T12:15:30.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:15:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.519+0000 7f4cef800640 1 Processor -- start 2024-09-12T12:15:30.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.519+0000 7f4cef800640 1 -- start start 2024-09-12T12:15:30.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.519+0000 7f4cef800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4ce815c7b0 0x7f4ce80ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.519+0000 7f4cef800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce80cd870 con 0x7f4ce815cd30 2024-09-12T12:15:30.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.519+0000 7f4cef800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce80cdb50 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.519+0000 7f4cef800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce8072a50 con 0x7f4ce815c7b0 2024-09-12T12:15:30.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.519+0000 7f4ce7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4ce815cd30 0x7f4ce80b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39572/0 (socket says 172.21.15.144:39572) 2024-09-12T12:15:30.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.519+0000 7f4ce7e00640 1 -- 172.21.15.144:0/1137814674 learned_addr learned my addr 172.21.15.144:0/1137814674 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:30.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4cece00640 1 --2- 172.21.15.144:0/1137814674 >> v2:172.21.15.165:3300/0 conn(0x7f4ce815c7b0 0x7f4ce80ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4ce7400640 1 -- 172.21.15.144:0/1137814674 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138822968 0 0) 0x7f4ce80cd870 con 0x7f4ce815cd30 2024-09-12T12:15:30.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4ce7400640 1 -- 172.21.15.144:0/1137814674 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ccc003530 con 0x7f4ce815cd30 2024-09-12T12:15:30.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4ce7400640 1 -- 172.21.15.144:0/1137814674 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3267481488 0 0) 0x7f4ce80cdb50 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4ce7400640 1 -- 172.21.15.144:0/1137814674 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ce80cd870 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4cece00640 1 -- 172.21.15.144:0/1137814674 >> v1:172.21.15.165:6789/0 conn(0x7f4ce80b5fb0 legacy=0x7f4ce8072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4cece00640 1 -- 172.21.15.144:0/1137814674 >> v1:172.21.15.144:6789/0 conn(0x7f4ce815cd30 legacy=0x7f4ce80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4cece00640 1 -- 172.21.15.144:0/1137814674 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce80726e0 con 0x7f4ce815c7b0 2024-09-12T12:15:30.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4cece00640 1 --2- 172.21.15.144:0/1137814674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 0x7f4ce80ccf00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80097c0 tx=0x7f4cd801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e34bd7bd83561090 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:30.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4ce7400640 1 -- 172.21.15.144:0/1137814674 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80b0070 con 0x7f4ce815c7b0 2024-09-12T12:15:30.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4ce7400640 1 -- 172.21.15.144:0/1137814674 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd80ab600 con 0x7f4ce815c7b0 2024-09-12T12:15:30.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.523+0000 7f4ce7400640 1 -- 172.21.15.144:0/1137814674 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80ab9b0 con 0x7f4ce815c7b0 2024-09-12T12:15:30.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 -- 172.21.15.144:0/1137814674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 msgr2=0x7f4ce80ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 --2- 172.21.15.144:0/1137814674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 0x7f4ce80ccf00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80097c0 tx=0x7f4cd801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 -- 172.21.15.144:0/1137814674 shutdown_connections 2024-09-12T12:15:30.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 --2- 172.21.15.144:0/1137814674 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 0x7f4ce80ccf00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 -- 172.21.15.144:0/1137814674 >> 172.21.15.144:0/1137814674 conn(0x7f4ce806d0d0 msgr2=0x7f4ce806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:30.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 -- 172.21.15.144:0/1137814674 shutdown_connections 2024-09-12T12:15:30.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 -- 172.21.15.144:0/1137814674 wait complete. 2024-09-12T12:15:30.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 Processor -- start 2024-09-12T12:15:30.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 -- start start 2024-09-12T12:15:30.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ce80b5fb0 0x7f4ce81645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 0x7f4ce8140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ce815cd30 0x7f4ce80ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce80741d0 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8074050 con 0x7f4ce815c7b0 2024-09-12T12:15:30.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cef800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce80cde30 con 0x7f4ce815cd30 2024-09-12T12:15:30.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cece00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ce80b5fb0 0x7f4ce81645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cece00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ce80b5fb0 0x7f4ce81645c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52534/0 (socket says 172.21.15.144:52534) 2024-09-12T12:15:30.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cece00640 1 -- 172.21.15.144:0/2317544445 learned_addr learned my addr 172.21.15.144:0/2317544445 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:30.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4ce7e00640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 0x7f4ce8140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4ced800640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ce815cd30 0x7f4ce80ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cece00640 1 -- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ce815cd30 msgr2=0x7f4ce80ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cece00640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ce815cd30 0x7f4ce80ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cece00640 1 -- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 msgr2=0x7f4ce8140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cece00640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 0x7f4ce8140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4cece00640 1 -- 172.21.15.144:0/2317544445 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce81613f0 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4ce7e00640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 0x7f4ce8140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:30.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.527+0000 7f4ced800640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ce815cd30 0x7f4ce80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:30.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4cece00640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ce80b5fb0 0x7f4ce81645c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80190b0 tx=0x7f4cd8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:30.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4ce4c00640 1 -- 172.21.15.144:0/2317544445 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80b0040 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4ce4c00640 1 -- 172.21.15.144:0/2317544445 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd80b4410 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4ce4c00640 1 -- 172.21.15.144:0/2317544445 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80b47c0 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce81616d0 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce8161c90 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce80ccf00 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4ce4c00640 1 -- 172.21.15.144:0/2317544445 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4cd80bc030 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4ce4c00640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4cc80678f0 0x7f4cc8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4ce4c00640 1 -- 172.21.15.144:0/2317544445 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f4cd811f240 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.531+0000 7f4ce7e00640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4cc80678f0 0x7f4cc8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.535+0000 7f4ce7e00640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4cc80678f0 0x7f4cc8069db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ce81f8570 tx=0x7f4cd4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:30.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.535+0000 7f4ce4c00640 1 -- 172.21.15.144:0/2317544445 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4cd80c3060 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ce80b1a30 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4ce4c00640 1 -- 172.21.15.144:0/2317544445 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+17039 (secure 0 0 0) 0x7f4cd8016090 con 0x7f4ce80b5fb0 2024-09-12T12:15:30.702 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:30.702 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":53,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:15:29.364028+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:15:27.094655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T12:15:28.370982+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4cc80678f0 msgr2=0x7f4cc8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4cc80678f0 0x7f4cc8069db0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ce81f8570 tx=0x7f4cd4009040 comp rx=0 tx=0).stop 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ce80b5fb0 msgr2=0x7f4ce81645c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ce80b5fb0 0x7f4ce81645c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80190b0 tx=0x7f4cd8019240 comp rx=0 tx=0).stop 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 shutdown_connections 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4cc80678f0 0x7f4cc8069db0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ce815cd30 0x7f4ce80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ce815c7b0 0x7f4ce8140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 --2- 172.21.15.144:0/2317544445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ce80b5fb0 0x7f4ce81645c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.699+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 >> 172.21.15.144:0/2317544445 conn(0x7f4ce806d0d0 msgr2=0x7f4ce80b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.703+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 shutdown_connections 2024-09-12T12:15:30.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.703+0000 7f4cef800640 1 -- 172.21.15.144:0/2317544445 wait complete. 2024-09-12T12:15:30.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:15:30.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.859+0000 7f5a04400640 1 Processor -- start 2024-09-12T12:15:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a04400640 1 -- start start 2024-09-12T12:15:30.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a04400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59fc162a40 0x7f59fc0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a04400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc163650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a04400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59fc0cf900 con 0x7f59fc163b90 2024-09-12T12:15:30.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a04400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f59fc0cf6d0 con 0x7f59fc162a40 2024-09-12T12:15:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a04400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59fc0cfbe0 con 0x7f59fc0af5d0 2024-09-12T12:15:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a01a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59fc162a40 0x7f59fc0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a01a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59fc162a40 0x7f59fc0cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52540/0 (socket says 172.21.15.144:52540) 2024-09-12T12:15:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a01a00640 1 -- 172.21.15.144:0/1238290780 learned_addr learned my addr 172.21.15.144:0/1238290780 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a01000640 1 --2- 172.21.15.144:0/1238290780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc163650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a01a00640 1 -- 172.21.15.144:0/1238290780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 msgr2=0x7f59fc163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:30.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a01a00640 1 --2- 172.21.15.144:0/1238290780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc163650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a01a00640 1 -- 172.21.15.144:0/1238290780 >> v1:172.21.15.165:6789/0 conn(0x7f59fc163b90 legacy=0x7f59fc166510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a01a00640 1 -- 172.21.15.144:0/1238290780 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc0cfec0 con 0x7f59fc162a40 2024-09-12T12:15:30.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.863+0000 7f5a01000640 1 --2- 172.21.15.144:0/1238290780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc163650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a01a00640 1 --2- 172.21.15.144:0/1238290780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 0x7f59fc0cf190 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009e50 tx=0x7f59f001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e4ed97efc54346 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f59fbe00640 1 -- 172.21.15.144:0/1238290780 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f00a5810 con 0x7f59fc162a40 2024-09-12T12:15:30.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f59fbe00640 1 -- 172.21.15.144:0/1238290780 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f00a59b0 con 0x7f59fc162a40 2024-09-12T12:15:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f59fbe00640 1 -- 172.21.15.144:0/1238290780 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f00a5d80 con 0x7f59fc162a40 2024-09-12T12:15:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 -- 172.21.15.144:0/1238290780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 msgr2=0x7f59fc0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 --2- 172.21.15.144:0/1238290780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 0x7f59fc0cf190 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f59f0009e50 tx=0x7f59f001ca30 comp rx=0 tx=0).stop 2024-09-12T12:15:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 -- 172.21.15.144:0/1238290780 shutdown_connections 2024-09-12T12:15:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 --2- 172.21.15.144:0/1238290780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc163650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 --2- 172.21.15.144:0/1238290780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 0x7f59fc0cf190 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 -- 172.21.15.144:0/1238290780 >> 172.21.15.144:0/1238290780 conn(0x7f59fc068030 msgr2=0x7f59fc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 -- 172.21.15.144:0/1238290780 shutdown_connections 2024-09-12T12:15:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 -- 172.21.15.144:0/1238290780 wait complete. 2024-09-12T12:15:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 Processor -- start 2024-09-12T12:15:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.867+0000 7f5a04400640 1 -- start start 2024-09-12T12:15:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a04400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a04400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 0x7f59fc158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a04400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59fc163b90 0x7f59fc1616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a04400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc16fa30 con 0x7f59fc162a40 2024-09-12T12:15:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a04400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc16f8b0 con 0x7f59fc163b90 2024-09-12T12:15:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a04400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59fc16fbb0 con 0x7f59fc0af5d0 2024-09-12T12:15:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 0x7f59fc158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 0x7f59fc158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52550/0 (socket says 172.21.15.144:52550) 2024-09-12T12:15:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01000640 1 -- 172.21.15.144:0/605221809 learned_addr learned my addr 172.21.15.144:0/605221809 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a02400640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59fc163b90 0x7f59fc1616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01a00640 1 -- 172.21.15.144:0/605221809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59fc163b90 msgr2=0x7f59fc1616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01a00640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59fc163b90 0x7f59fc1616f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01a00640 1 -- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 msgr2=0x7f59fc158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01a00640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 0x7f59fc158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01a00640 1 -- 172.21.15.144:0/605221809 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc1552d0 con 0x7f59fc0af5d0 2024-09-12T12:15:30.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01000640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 0x7f59fc158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a01a00640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc154d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59f00ab000 tx=0x7f59f00197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f59f9600640 1 -- 172.21.15.144:0/605221809 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f00bc020 con 0x7f59fc0af5d0 2024-09-12T12:15:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f59f9600640 1 -- 172.21.15.144:0/605221809 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f00b8880 con 0x7f59fc0af5d0 2024-09-12T12:15:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f59f9600640 1 -- 172.21.15.144:0/605221809 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f00b8c50 con 0x7f59fc0af5d0 2024-09-12T12:15:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59fc158990 con 0x7f59fc0af5d0 2024-09-12T12:15:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59fc158f50 con 0x7f59fc0af5d0 2024-09-12T12:15:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.871+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59fc163650 con 0x7f59fc0af5d0 2024-09-12T12:15:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.875+0000 7f59f9600640 1 -- 172.21.15.144:0/605221809 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59f00bf020 con 0x7f59fc0af5d0 2024-09-12T12:15:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.875+0000 7f59f9600640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59dc0678f0 0x7f59dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.875+0000 7f59f9600640 1 -- 172.21.15.144:0/605221809 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f59f01212c0 con 0x7f59fc0af5d0 2024-09-12T12:15:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.875+0000 7f5a01000640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59dc0678f0 0x7f59dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.875+0000 7f5a01000640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59dc0678f0 0x7f59dc069db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f59fc155f50 tx=0x7f59e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:30.879+0000 7f59f9600640 1 -- 172.21.15.144:0/605221809 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59fc1552d0 con 0x7f59fc0af5d0 2024-09-12T12:15:30.953 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-12T12:15:30.951+0000 7f88ef600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:15:31.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:31.083+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f59fc15fd10 con 0x7f59fc0af5d0 2024-09-12T12:15:32.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.003+0000 7f59f9600640 1 -- 172.21.15.144:0/605221809 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f59f0016620 con 0x7f59fc0af5d0 2024-09-12T12:15:32.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59dc0678f0 msgr2=0x7f59dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59dc0678f0 0x7f59dc069db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f59fc155f50 tx=0x7f59e8008040 comp rx=0 tx=0).stop 2024-09-12T12:15:32.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 msgr2=0x7f59fc154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc154d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59f00ab000 tx=0x7f59f00197d0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 shutdown_connections 2024-09-12T12:15:32.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59dc0678f0 0x7f59dc069db0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59fc163b90 0x7f59fc1616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59fc162a40 0x7f59fc158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 --2- 172.21.15.144:0/605221809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59fc0af5d0 0x7f59fc154d90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 >> 172.21.15.144:0/605221809 conn(0x7f59fc068030 msgr2=0x7f59fc0b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:32.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 shutdown_connections 2024-09-12T12:15:32.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.007+0000 7f5a04400640 1 -- 172.21.15.144:0/605221809 wait complete. 2024-09-12T12:15:32.030 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:15:32.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:15:32.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.171+0000 7f705e400640 1 Processor -- start 2024-09-12T12:15:32.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.171+0000 7f705e400640 1 -- start start 2024-09-12T12:15:32.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f705e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f705e400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f705815b340 0x7f705806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f705e400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70580b4300 con 0x7f705815af60 2024-09-12T12:15:32.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f705e400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f70580b32f0 con 0x7f705815b340 2024-09-12T12:15:32.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f705e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f70580b3540 con 0x7f70580cd9f0 2024-09-12T12:15:32.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7056a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7056a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50018/0 (socket says 172.21.15.144:50018) 2024-09-12T12:15:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7057400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f705815af60 0x7f70580ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:56218/0 (socket says 172.21.15.144:56218) 2024-09-12T12:15:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7057e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f705815b340 0x7f705806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7056a00640 1 -- 172.21.15.144:0/3265663364 learned_addr learned my addr 172.21.15.144:0/3265663364 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7056000640 1 -- 172.21.15.144:0/3265663364 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331546826 0 0) 0x7f70580b4300 con 0x7f705815af60 2024-09-12T12:15:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7057e00640 1 -- 172.21.15.144:0/3265663364 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 msgr2=0x7f705806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7057e00640 1 --2- 172.21.15.144:0/3265663364 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7057e00640 1 -- 172.21.15.144:0/3265663364 >> v1:172.21.15.165:6789/0 conn(0x7f705815af60 legacy=0x7f70580ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7057e00640 1 -- 172.21.15.144:0/3265663364 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70580b3820 con 0x7f705815b340 2024-09-12T12:15:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.175+0000 7f7056a00640 1 --2- 172.21.15.144:0/3265663364 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:32.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f7057e00640 1 --2- 172.21.15.144:0/3265663364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f705815b340 0x7f705806c150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7050009d90 tx=0x7f705001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e7f7e4cce7cacaa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:32.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f7056000640 1 -- 172.21.15.144:0/3265663364 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70500b4070 con 0x7f705815b340 2024-09-12T12:15:32.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f7056000640 1 -- 172.21.15.144:0/3265663364 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70500af600 con 0x7f705815b340 2024-09-12T12:15:32.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f7056000640 1 -- 172.21.15.144:0/3265663364 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70500af9d0 con 0x7f705815b340 2024-09-12T12:15:32.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 -- 172.21.15.144:0/3265663364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f705815b340 msgr2=0x7f705806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 --2- 172.21.15.144:0/3265663364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f705815b340 0x7f705806c150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7050009d90 tx=0x7f705001f150 comp rx=0 tx=0).stop 2024-09-12T12:15:32.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 -- 172.21.15.144:0/3265663364 shutdown_connections 2024-09-12T12:15:32.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 --2- 172.21.15.144:0/3265663364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f705815b340 0x7f705806c150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 --2- 172.21.15.144:0/3265663364 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 -- 172.21.15.144:0/3265663364 >> 172.21.15.144:0/3265663364 conn(0x7f7058068030 msgr2=0x7f70580b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:32.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 -- 172.21.15.144:0/3265663364 shutdown_connections 2024-09-12T12:15:32.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 -- 172.21.15.144:0/3265663364 wait complete. 2024-09-12T12:15:32.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 Processor -- start 2024-09-12T12:15:32.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 -- start start 2024-09-12T12:15:32.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.179+0000 7f705e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705814e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f705e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f705815af60 0x7f705815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f705e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705815b340 0x7f70580ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f705e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f705806d0f0 con 0x7f705815b340 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f705e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f70580b3de0 con 0x7f705815af60 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f705e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f705806d270 con 0x7f70580cd9f0 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705815b340 0x7f70580ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705815b340 0x7f70580ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52558/0 (socket says 172.21.15.144:52558) 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057e00640 1 -- 172.21.15.144:0/2199189752 learned_addr learned my addr 172.21.15.144:0/2199189752 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705814e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7056a00640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f705815af60 0x7f705815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057e00640 1 -- 172.21.15.144:0/2199189752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 msgr2=0x7f705814e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057e00640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705814e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057e00640 1 -- 172.21.15.144:0/2199189752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f705815af60 msgr2=0x7f705815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057e00640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f705815af60 0x7f705815df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057e00640 1 -- 172.21.15.144:0/2199189752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70581f79a0 con 0x7f705815b340 2024-09-12T12:15:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705814e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f7057e00640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705815b340 0x7f70580ae890 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f705001d800 tx=0x7f705001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:32.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f704f400640 1 -- 172.21.15.144:0/2199189752 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70500b4070 con 0x7f705815b340 2024-09-12T12:15:32.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f704f400640 1 -- 172.21.15.144:0/2199189752 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70500c1070 con 0x7f705815b340 2024-09-12T12:15:32.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f704f400640 1 -- 172.21.15.144:0/2199189752 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70500bb8d0 con 0x7f705815b340 2024-09-12T12:15:32.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70581f7c80 con 0x7f705815b340 2024-09-12T12:15:32.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70581f8240 con 0x7f705815b340 2024-09-12T12:15:32.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70580ce680 con 0x7f705815b340 2024-09-12T12:15:32.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.183+0000 7f704f400640 1 -- 172.21.15.144:0/2199189752 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70500bba70 con 0x7f705815b340 2024-09-12T12:15:32.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.187+0000 7f704f400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70380678c0 0x7f7038069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.187+0000 7f704f400640 1 -- 172.21.15.144:0/2199189752 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f7050002020 con 0x7f705815b340 2024-09-12T12:15:32.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.187+0000 7f7057400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70380678c0 0x7f7038069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.187+0000 7f7057400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70380678c0 0x7f7038069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7048007fd0 tx=0x7f7048007c80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:32.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.191+0000 7f704f400640 1 -- 172.21.15.144:0/2199189752 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7050018cb0 con 0x7f705815b340 2024-09-12T12:15:32.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.383+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f70580afc20 con 0x7f705815b340 2024-09-12T12:15:33.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:32.999+0000 7f704f400640 1 -- 172.21.15.144:0/2199189752 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f70500f4e80 con 0x7f705815b340 2024-09-12T12:15:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70380678c0 msgr2=0x7f7038069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70380678c0 0x7f7038069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7048007fd0 tx=0x7f7048007c80 comp rx=0 tx=0).stop 2024-09-12T12:15:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705815b340 msgr2=0x7f70580ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705815b340 0x7f70580ae890 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f705001d800 tx=0x7f705001bef0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 shutdown_connections 2024-09-12T12:15:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70380678c0 0x7f7038069d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705815b340 0x7f70580ae890 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f705815af60 0x7f705815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 --2- 172.21.15.144:0/2199189752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70580cd9f0 0x7f705814e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 >> 172.21.15.144:0/2199189752 conn(0x7f7058068030 msgr2=0x7f705815ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:33.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 shutdown_connections 2024-09-12T12:15:33.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.003+0000 7f705e400640 1 -- 172.21.15.144:0/2199189752 wait complete. 2024-09-12T12:15:33.358 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:15:33.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:15:33.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.495+0000 7ff2d2800640 1 Processor -- start 2024-09-12T12:15:33.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.495+0000 7ff2d2800640 1 -- start start 2024-09-12T12:15:33.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.495+0000 7ff2d2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff2cc15c7b0 0x7ff2cc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.495+0000 7ff2d2800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff2cc0b5fb0 0x7ff2cc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.495+0000 7ff2d2800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2cc0cd870 con 0x7ff2cc15cd30 2024-09-12T12:15:33.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2d2800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff2cc072a50 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2d2800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff2cc0cde30 con 0x7ff2cc0b5fb0 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff2cc15c7b0 0x7ff2cc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2caa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff2cc15cd30 0x7ff2cc0b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39584/0 (socket says 172.21.15.144:39584) 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2caa00640 1 -- 172.21.15.144:0/3661846941 learned_addr learned my addr 172.21.15.144:0/3661846941 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff2cc15c7b0 0x7ff2cc0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52574/0 (socket says 172.21.15.144:52574) 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2cbe00640 1 --2- 172.21.15.144:0/3661846941 >> v2:172.21.15.165:3300/0 conn(0x7ff2cc0b5fb0 0x7ff2cc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2cb400640 1 -- 172.21.15.144:0/3661846941 >> v2:172.21.15.165:3300/0 conn(0x7ff2cc0b5fb0 msgr2=0x7ff2cc072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2cb400640 1 --2- 172.21.15.144:0/3661846941 >> v2:172.21.15.165:3300/0 conn(0x7ff2cc0b5fb0 0x7ff2cc072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2cb400640 1 -- 172.21.15.144:0/3661846941 >> v1:172.21.15.144:6789/0 conn(0x7ff2cc15cd30 legacy=0x7ff2cc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2cb400640 1 -- 172.21.15.144:0/3661846941 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2cc0cdb50 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2ca000640 1 -- 172.21.15.144:0/3661846941 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822470436 0 0) 0x7ff2cc0cd870 con 0x7ff2cc15cd30 2024-09-12T12:15:33.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.499+0000 7ff2cb400640 1 --2- 172.21.15.144:0/3661846941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 0x7ff2cc0ccf00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0d0480 tx=0x7ff2bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742afe60149a6727 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:33.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2ca000640 1 -- 172.21.15.144:0/3661846941 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0b1070 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2ca000640 1 -- 172.21.15.144:0/3661846941 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0ac5f0 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2ca000640 1 -- 172.21.15.144:0/3661846941 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0ac9c0 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 -- 172.21.15.144:0/3661846941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 msgr2=0x7ff2cc0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 --2- 172.21.15.144:0/3661846941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 0x7ff2cc0ccf00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0d0480 tx=0x7ff2bc01c480 comp rx=0 tx=0).stop 2024-09-12T12:15:33.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 -- 172.21.15.144:0/3661846941 shutdown_connections 2024-09-12T12:15:33.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 --2- 172.21.15.144:0/3661846941 >> v2:172.21.15.165:3300/0 conn(0x7ff2cc0b5fb0 0x7ff2cc072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 --2- 172.21.15.144:0/3661846941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 0x7ff2cc0ccf00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 -- 172.21.15.144:0/3661846941 >> 172.21.15.144:0/3661846941 conn(0x7ff2cc06d0d0 msgr2=0x7ff2cc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:33.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 -- 172.21.15.144:0/3661846941 shutdown_connections 2024-09-12T12:15:33.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 -- 172.21.15.144:0/3661846941 wait complete. 2024-09-12T12:15:33.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 Processor -- start 2024-09-12T12:15:33.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 -- start start 2024-09-12T12:15:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2cc0b5fb0 0x7ff2cc14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 0x7ff2cc1f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2cc15cd30 0x7ff2cc14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc073fc0 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2cc073e40 con 0x7ff2cc15cd30 2024-09-12T12:15:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2d2800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff2cc074140 con 0x7ff2cc0b5fb0 2024-09-12T12:15:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 0x7ff2cc1f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 0x7ff2cc1f5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52584/0 (socket says 172.21.15.144:52584) 2024-09-12T12:15:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2caa00640 1 -- 172.21.15.144:0/3566499066 learned_addr learned my addr 172.21.15.144:0/3566499066 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2cb400640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2cc0b5fb0 0x7ff2cc14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2cbe00640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2cc15cd30 0x7ff2cc14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2caa00640 1 -- 172.21.15.144:0/3566499066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2cc0b5fb0 msgr2=0x7ff2cc14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2caa00640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2cc0b5fb0 0x7ff2cc14c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2caa00640 1 -- 172.21.15.144:0/3566499066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2cc15cd30 msgr2=0x7ff2cc14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2caa00640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2cc15cd30 0x7ff2cc14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2caa00640 1 -- 172.21.15.144:0/3566499066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2cc14d930 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.503+0000 7ff2cbe00640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2cc15cd30 0x7ff2cc14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:33.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2caa00640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 0x7ff2cc1f5350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c480 tx=0x7ff2b800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:33.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2c3400640 1 -- 172.21.15.144:0/3566499066 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8018070 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2c3400640 1 -- 172.21.15.144:0/3566499066 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b8007500 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2c3400640 1 -- 172.21.15.144:0/3566499066 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8004a30 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2cc154590 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2cc154b50 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2cc072ec0 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2c3400640 1 -- 172.21.15.144:0/3566499066 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2b8004bd0 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2c3400640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ac0678c0 0x7ff2ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2c3400640 1 -- 172.21.15.144:0/3566499066 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ff2b8084ff0 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.507+0000 7ff2cb400640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ac0678c0 0x7ff2ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.511+0000 7ff2cb400640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ac0678c0 0x7ff2ac069d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0ae000 tx=0x7ff2bc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:33.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.511+0000 7ff2c3400640 1 -- 172.21.15.144:0/3566499066 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff2b80553a0 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.707+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2cc152620 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2c3400640 1 -- 172.21.15.144:0/3566499066 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7ff2b80596a0 con 0x7ff2cc15c7b0 2024-09-12T12:15:33.712 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:33.713 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-12T12:15:33:003315+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/149604375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":149604375},{"type":"v1","addr":"172.21.15.165:6834","nonce":149604375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3844758833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3844758833},{"type":"v1","addr":"172.21.15.144:6837","nonce":3844758833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/639962972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":639962972},{"type":"v1","addr":"172.21.15.165:6835","nonce":639962972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:15:29.364348+0000","modified":"2024-09-12T12:15:32.389508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6836/3957430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3957430285},{"type":"v1","addr":"172.21.15.144:6836","nonce":3957430285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-12T12:15:33.713 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-12T12:15:33.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ac0678c0 msgr2=0x7ff2ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ac0678c0 0x7ff2ac069d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0ae000 tx=0x7ff2bc0a7000 comp rx=0 tx=0).stop 2024-09-12T12:15:33.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 msgr2=0x7ff2cc1f5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 0x7ff2cc1f5350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c480 tx=0x7ff2b800c940 comp rx=0 tx=0).stop 2024-09-12T12:15:33.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 shutdown_connections 2024-09-12T12:15:33.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ac0678c0 0x7ff2ac069d80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2cc15cd30 0x7ff2cc14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc15c7b0 0x7ff2cc1f5350 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 --2- 172.21.15.144:0/3566499066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2cc0b5fb0 0x7ff2cc14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 >> 172.21.15.144:0/3566499066 conn(0x7ff2cc06d0d0 msgr2=0x7ff2cc152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:33.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 shutdown_connections 2024-09-12T12:15:33.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.711+0000 7ff2d2800640 1 -- 172.21.15.144:0/3566499066 wait complete. 2024-09-12T12:15:33.734 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:15:33.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.867+0000 7eff23e00640 1 Processor -- start 2024-09-12T12:15:33.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.867+0000 7eff23e00640 1 -- start start 2024-09-12T12:15:33.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff23e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15cd30 0x7eff1c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff23e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c0cd870 con 0x7eff1c15c7b0 2024-09-12T12:15:33.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff23e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c0cdb50 con 0x7eff1c0b5de0 2024-09-12T12:15:33.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff23e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c072a50 con 0x7eff1c15cd30 2024-09-12T12:15:33.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff21400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7eff1c15c7b0 0x7eff1c0ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39588/0 (socket says 172.21.15.144:39588) 2024-09-12T12:15:33.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff21400640 1 -- 172.21.15.144:0/2764960616 learned_addr learned my addr 172.21.15.144:0/2764960616 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff20a00640 1 --2- 172.21.15.144:0/2764960616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15cd30 0x7eff1c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff1be00640 1 -- 172.21.15.144:0/2764960616 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568868312 0 0) 0x7eff1c0cd870 con 0x7eff1c15c7b0 2024-09-12T12:15:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff1be00640 1 -- 172.21.15.144:0/2764960616 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff04003530 con 0x7eff1c15c7b0 2024-09-12T12:15:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff1be00640 1 -- 172.21.15.144:0/2764960616 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749926541 0 0) 0x7eff1c0cdb50 con 0x7eff1c0b5de0 2024-09-12T12:15:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff1be00640 1 -- 172.21.15.144:0/2764960616 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff1c0cd870 con 0x7eff1c0b5de0 2024-09-12T12:15:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff20a00640 1 -- 172.21.15.144:0/2764960616 >> v1:172.21.15.165:6789/0 conn(0x7eff1c0b5de0 legacy=0x7eff1c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff1be00640 1 -- 172.21.15.144:0/2764960616 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2223942987 0 0) 0x7eff04003530 con 0x7eff1c15c7b0 2024-09-12T12:15:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff20a00640 1 -- 172.21.15.144:0/2764960616 >> v1:172.21.15.144:6789/0 conn(0x7eff1c15c7b0 legacy=0x7eff1c0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.871+0000 7eff20a00640 1 -- 172.21.15.144:0/2764960616 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c0726e0 con 0x7eff1c15cd30 2024-09-12T12:15:33.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff20a00640 1 --2- 172.21.15.144:0/2764960616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15cd30 0x7eff1c0b58a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff080097f0 tx=0x7eff0801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d3e1655b961dd1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:33.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff1be00640 1 -- 172.21.15.144:0/2764960616 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff080b0070 con 0x7eff1c15cd30 2024-09-12T12:15:33.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff1be00640 1 -- 172.21.15.144:0/2764960616 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff080ab400 con 0x7eff1c15cd30 2024-09-12T12:15:33.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff1be00640 1 -- 172.21.15.144:0/2764960616 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10001a00 con 0x7eff1c15cd30 2024-09-12T12:15:33.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff23e00640 1 -- 172.21.15.144:0/2764960616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15cd30 msgr2=0x7eff1c0b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff23e00640 1 --2- 172.21.15.144:0/2764960616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15cd30 0x7eff1c0b58a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff080097f0 tx=0x7eff0801c400 comp rx=0 tx=0).stop 2024-09-12T12:15:33.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff23e00640 1 -- 172.21.15.144:0/2764960616 shutdown_connections 2024-09-12T12:15:33.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff23e00640 1 --2- 172.21.15.144:0/2764960616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15cd30 0x7eff1c0b58a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff23e00640 1 -- 172.21.15.144:0/2764960616 >> 172.21.15.144:0/2764960616 conn(0x7eff1c06d0d0 msgr2=0x7eff1c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:33.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff23e00640 1 -- 172.21.15.144:0/2764960616 shutdown_connections 2024-09-12T12:15:33.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff23e00640 1 -- 172.21.15.144:0/2764960616 wait complete. 2024-09-12T12:15:33.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff23e00640 1 Processor -- start 2024-09-12T12:15:33.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.875+0000 7eff23e00640 1 -- start start 2024-09-12T12:15:33.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff23e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c0b5de0 0x7eff1c0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff23e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15c7b0 0x7eff1c14a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff23e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff1c15cd30 0x7eff1c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff23e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c074210 con 0x7eff1c0b5de0 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff23e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c074090 con 0x7eff1c15cd30 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff23e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c0cd610 con 0x7eff1c15c7b0 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c0b5de0 0x7eff1c0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c0b5de0 0x7eff1c0afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52600/0 (socket says 172.21.15.144:52600) 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21400640 1 -- 172.21.15.144:0/1712830816 learned_addr learned my addr 172.21.15.144:0/1712830816 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21400640 1 -- 172.21.15.144:0/1712830816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15c7b0 msgr2=0x7eff1c14a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff20a00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15c7b0 0x7eff1c14a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21400640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15c7b0 0x7eff1c14a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21400640 1 -- 172.21.15.144:0/1712830816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff1c15cd30 msgr2=0x7eff1c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21e00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff1c15cd30 0x7eff1c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21400640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff1c15cd30 0x7eff1c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21400640 1 -- 172.21.15.144:0/1712830816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c14a910 con 0x7eff1c0b5de0 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21e00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff1c15cd30 0x7eff1c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff21400640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c0b5de0 0x7eff1c0afd70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7eff10001ff0 tx=0x7eff1000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff19600640 1 -- 172.21.15.144:0/1712830816 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10017070 con 0x7eff1c0b5de0 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff19600640 1 -- 172.21.15.144:0/1712830816 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff10012400 con 0x7eff1c0b5de0 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff19600640 1 -- 172.21.15.144:0/1712830816 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10012830 con 0x7eff1c0b5de0 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c0aec70 con 0x7eff1c0b5de0 2024-09-12T12:15:33.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c0af230 con 0x7eff1c0b5de0 2024-09-12T12:15:33.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c0b58a0 con 0x7eff1c0b5de0 2024-09-12T12:15:33.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.879+0000 7eff19600640 1 -- 172.21.15.144:0/1712830816 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff1001a070 con 0x7eff1c0b5de0 2024-09-12T12:15:33.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.883+0000 7eff19600640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.883+0000 7eff19600640 1 -- 172.21.15.144:0/1712830816 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7eff10085e40 con 0x7eff1c0b5de0 2024-09-12T12:15:33.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.883+0000 7eff20a00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.883+0000 7eff20a00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efefc0678c0 0x7efefc069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff080ad000 tx=0x7eff080a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:33.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:33.887+0000 7eff19600640 1 -- 172.21.15.144:0/1712830816 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff100567e0 con 0x7eff1c0b5de0 2024-09-12T12:15:34.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.051+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff1c168100 con 0x7eff1c0b5de0 2024-09-12T12:15:34.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.051+0000 7eff19600640 1 -- 172.21.15.144:0/1712830816 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+17026 (secure 0 0 0) 0x7eff100560e0 con 0x7eff1c0b5de0 2024-09-12T12:15:34.054 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:34.054 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":54,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:15:30.990121+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:15:27.094655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T12:15:28.370982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:15:34.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efefc0678c0 msgr2=0x7efefc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efefc0678c0 0x7efefc069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff080ad000 tx=0x7eff080a6000 comp rx=0 tx=0).stop 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c0b5de0 msgr2=0x7eff1c0afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c0b5de0 0x7eff1c0afd70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7eff10001ff0 tx=0x7eff1000a430 comp rx=0 tx=0).stop 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 shutdown_connections 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efefc0678c0 0x7efefc069d80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff1c15cd30 0x7eff1c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff1c15c7b0 0x7eff1c14a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 --2- 172.21.15.144:0/1712830816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff1c0b5de0 0x7eff1c0afd70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 >> 172.21.15.144:0/1712830816 conn(0x7eff1c06d0d0 msgr2=0x7eff1c151700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 shutdown_connections 2024-09-12T12:15:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.055+0000 7eff23e00640 1 -- 172.21.15.144:0/1712830816 wait complete. 2024-09-12T12:15:34.076 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:15:34.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c7a00640 1 Processor -- start 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c7a00640 1 -- start start 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c7a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff9c00b4200 0x7ff9c00b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c00b5720 0x7ff9c00b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c7a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c00d1580 con 0x7ff9c015c220 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c7a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c00b4bb0 con 0x7ff9c00b4200 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c00d1320 con 0x7ff9c00b5720 2024-09-12T12:15:34.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c5000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff9c015c220 0x7ff9c00d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39596/0 (socket says 172.21.15.144:39596) 2024-09-12T12:15:34.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c5000640 1 -- 172.21.15.144:0/3719264288 learned_addr learned my addr 172.21.15.144:0/3719264288 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:34.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c5a00640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c00b5720 0x7ff9c00b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bfe00640 1 --2- 172.21.15.144:0/3719264288 >> v2:172.21.15.165:3300/0 conn(0x7ff9c00b4200 0x7ff9c00b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292413455 0 0) 0x7ff9c00d1580 con 0x7ff9c015c220 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9a4003530 con 0x7ff9c015c220 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1441624530 0 0) 0x7ff9a4003530 con 0x7ff9c015c220 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c00b5720 msgr2=0x7ff9c00b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c00b5720 0x7ff9c00b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 >> v2:172.21.15.165:3300/0 conn(0x7ff9c00b4200 msgr2=0x7ff9c00b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 --2- 172.21.15.144:0/3719264288 >> v2:172.21.15.165:3300/0 conn(0x7ff9c00b4200 0x7ff9c00b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c00d1860 con 0x7ff9c015c220 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7ff9b0001a00 con 0x7ff9c015c220 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 >> v1:172.21.15.144:6789/0 conn(0x7ff9c015c220 legacy=0x7ff9c00d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9a40039f0 0x7ff9a4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c00b5720 0x7ff9a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a4004d50 0x7ff9a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00b4bb0 con 0x7ff9a4004d50 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00d1320 con 0x7ff9a40039f0 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a400b9d0 con 0x7ff9c00b5720 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c5a00640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a4004d50 0x7ff9a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9c5000640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9a40039f0 0x7ff9a4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.211+0000 7ff9bfe00640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c00b5720 0x7ff9a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9c5a00640 1 -- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c00b5720 msgr2=0x7ff9a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9c5a00640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c00b5720 0x7ff9a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9c5a00640 1 -- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9a40039f0 msgr2=0x7ff9a4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9c5a00640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9a40039f0 0x7ff9a4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9c5a00640 1 -- 172.21.15.144:0/3719264288 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a4003530 con 0x7ff9a4004d50 2024-09-12T12:15:34.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9c5a00640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a4004d50 0x7ff9a40051d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009b10 tx=0x7ff9b801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f002313dffd8be3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80b2070 con 0x7ff9a4004d50 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b80a5660 con 0x7ff9a4004d50 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9bf400640 1 -- 172.21.15.144:0/3719264288 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80096b0 con 0x7ff9a4004d50 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3719264288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a4004d50 msgr2=0x7ff9a40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9c7a00640 1 --2- 172.21.15.144:0/3719264288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a4004d50 0x7ff9a40051d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009b10 tx=0x7ff9b801ca70 comp rx=0 tx=0).stop 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.215+0000 7ff9c5a00640 1 -- 172.21.15.144:0/3719264288 reap_dead start 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3719264288 shutdown_connections 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3719264288 >> 172.21.15.144:0/3719264288 conn(0x7ff9c006f400 msgr2=0x7ff9c006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3719264288 shutdown_connections 2024-09-12T12:15:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3719264288 wait complete. 2024-09-12T12:15:34.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 Processor -- start 2024-09-12T12:15:34.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 -- start start 2024-09-12T12:15:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9c0146ea0 0x7ff9c0149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c0149b90 0x7ff9c0155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9c0155da0 0x7ff9c01f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00d2100 con 0x7ff9c0146ea0 2024-09-12T12:15:34.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00d1e20 con 0x7ff9c0155da0 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c015c600 con 0x7ff9c0149b90 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9c0146ea0 0x7ff9c0149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9c0146ea0 0x7ff9c0149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52618/0 (socket says 172.21.15.144:52618) 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5000640 1 -- 172.21.15.144:0/3347406974 learned_addr learned my addr 172.21.15.144:0/3347406974 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9bfe00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c0149b90 0x7ff9c0155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5a00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9c0155da0 0x7ff9c01f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5000640 1 -- 172.21.15.144:0/3347406974 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c0149b90 msgr2=0x7ff9c0155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5000640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c0149b90 0x7ff9c0155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5000640 1 -- 172.21.15.144:0/3347406974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9c0155da0 msgr2=0x7ff9c01f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5000640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9c0155da0 0x7ff9c01f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5000640 1 -- 172.21.15.144:0/3347406974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c0147280 con 0x7ff9c0146ea0 2024-09-12T12:15:34.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.219+0000 7ff9c5000640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9c0146ea0 0x7ff9c0149650 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000a500 tx=0x7ff9b000a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9bcc00640 1 -- 172.21.15.144:0/3347406974 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000adf0 con 0x7ff9c0146ea0 2024-09-12T12:15:34.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9bcc00640 1 -- 172.21.15.144:0/3347406974 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b0018070 con 0x7ff9c0146ea0 2024-09-12T12:15:34.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c0156610 con 0x7ff9c0146ea0 2024-09-12T12:15:34.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9bcc00640 1 -- 172.21.15.144:0/3347406974 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0013630 con 0x7ff9c0146ea0 2024-09-12T12:15:34.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c01478a0 con 0x7ff9c0146ea0 2024-09-12T12:15:34.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c0070bf0 con 0x7ff9c0146ea0 2024-09-12T12:15:34.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9bcc00640 1 -- 172.21.15.144:0/3347406974 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9b00137d0 con 0x7ff9c0146ea0 2024-09-12T12:15:34.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9bcc00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9a00678c0 0x7ff9a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9bcc00640 1 -- 172.21.15.144:0/3347406974 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ff9b0086640 con 0x7ff9c0146ea0 2024-09-12T12:15:34.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9bfe00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9a00678c0 0x7ff9a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.223+0000 7ff9bfe00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9a00678c0 0x7ff9a0069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff9c01f7a30 tx=0x7ff9ac009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.227+0000 7ff9bcc00640 1 -- 172.21.15.144:0/3347406974 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff9b0056f50 con 0x7ff9c0146ea0 2024-09-12T12:15:34.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.391+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9c0149f70 con 0x7ff9a00678c0 2024-09-12T12:15:34.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.399+0000 7ff9bcc00640 1 -- 172.21.15.144:0/3347406974 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7ff9c0149f70 con 0x7ff9a00678c0 2024-09-12T12:15:34.405 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:34.407 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9a00678c0 msgr2=0x7ff9a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9a00678c0 0x7ff9a0069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff9c01f7a30 tx=0x7ff9ac009190 comp rx=0 tx=0).stop 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9c0146ea0 msgr2=0x7ff9c0149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9c0146ea0 0x7ff9c0149650 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000a500 tx=0x7ff9b000a530 comp rx=0 tx=0).stop 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 shutdown_connections 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9a00678c0 0x7ff9a0069d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9c0155da0 0x7ff9c01f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9c0149b90 0x7ff9c0155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 --2- 172.21.15.144:0/3347406974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9c0146ea0 0x7ff9c0149650 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 >> 172.21.15.144:0/3347406974 conn(0x7ff9c006f400 msgr2=0x7ff9c00b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:34.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 shutdown_connections 2024-09-12T12:15:34.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.403+0000 7ff9c7a00640 1 -- 172.21.15.144:0/3347406974 wait complete. 2024-09-12T12:15:34.425 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-12T12:15:33.410812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284588,"kb_used_data":5932,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754690132,"statfs":{"total":773094113280,"available":772802695168,"internally_reserved":0,"allocated":6074368,"data_stored":3341985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.446495"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.982087+0000","last_change":"2024-09-12T12:15:28.982087+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.982087+0000","last_undegraded":"2024-09-12T12:15:28.982087+0000","last_fullsized":"2024-09-12T12:15:28.982087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975202+0000","last_change":"2024-09-12T12:15:28.975202+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975202+0000","last_undegraded":"2024-09-12T12:15:28.975202+0000","last_fullsized":"2024-09-12T12:15:28.975202+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979129+0000","last_change":"2024-09-12T12:15:28.979129+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979129+0000","last_undegraded":"2024-09-12T12:15:28.979129+0000","last_fullsized":"2024-09-12T12:15:28.979129+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974814+0000","last_change":"2024-09-12T12:15:28.974814+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974814+0000","last_undegraded":"2024-09-12T12:15:28.974814+0000","last_fullsized":"2024-09-12T12:15:28.974814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968941+0000","last_change":"2024-09-12T12:15:28.968941+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968941+0000","last_undegraded":"2024-09-12T12:15:28.968941+0000","last_fullsized":"2024-09-12T12:15:28.968941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.985779+0000","last_change":"2024-09-12T12:15:28.985779+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.985779+0000","last_undegraded":"2024-09-12T12:15:28.985779+0000","last_fullsized":"2024-09-12T12:15:28.985779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975376+0000","last_change":"2024-09-12T12:15:28.975376+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975376+0000","last_undegraded":"2024-09-12T12:15:28.975376+0000","last_fullsized":"2024-09-12T12:15:28.975376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974468+0000","last_change":"2024-09-12T12:15:28.974468+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974468+0000","last_undegraded":"2024-09-12T12:15:28.974468+0000","last_fullsized":"2024-09-12T12:15:28.974468+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979809+0000","last_change":"2024-09-12T12:15:28.979809+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979809+0000","last_undegraded":"2024-09-12T12:15:28.979809+0000","last_fullsized":"2024-09-12T12:15:28.979809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.980816+0000","last_change":"2024-09-12T12:15:28.980816+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.980816+0000","last_undegraded":"2024-09-12T12:15:28.980816+0000","last_fullsized":"2024-09-12T12:15:28.980816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972226+0000","last_change":"2024-09-12T12:15:28.972226+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972226+0000","last_undegraded":"2024-09-12T12:15:28.972226+0000","last_fullsized":"2024-09-12T12:15:28.972226+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.984796+0000","last_change":"2024-09-12T12:15:28.984796+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.984796+0000","last_undegraded":"2024-09-12T12:15:28.984796+0000","last_fullsized":"2024-09-12T12:15:28.984796+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.980928+0000","last_change":"2024-09-12T12:15:28.980928+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.980928+0000","last_undegraded":"2024-09-12T12:15:28.980928+0000","last_fullsized":"2024-09-12T12:15:28.980928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974762+0000","last_change":"2024-09-12T12:15:28.974762+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974762+0000","last_undegraded":"2024-09-12T12:15:28.974762+0000","last_fullsized":"2024-09-12T12:15:28.974762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975198+0000","last_change":"2024-09-12T12:15:28.975198+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975198+0000","last_undegraded":"2024-09-12T12:15:28.975198+0000","last_fullsized":"2024-09-12T12:15:28.975198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.985280+0000","last_change":"2024-09-12T12:15:28.985280+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.985280+0000","last_undegraded":"2024-09-12T12:15:28.985280+0000","last_fullsized":"2024-09-12T12:15:28.985280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.977272+0000","last_change":"2024-09-12T12:15:28.977272+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.977272+0000","last_undegraded":"2024-09-12T12:15:28.977272+0000","last_fullsized":"2024-09-12T12:15:28.977272+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974681+0000","last_change":"2024-09-12T12:15:28.974681+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974681+0000","last_undegraded":"2024-09-12T12:15:28.974681+0000","last_fullsized":"2024-09-12T12:15:28.974681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978637+0000","last_change":"2024-09-12T12:15:28.978637+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978637+0000","last_undegraded":"2024-09-12T12:15:28.978637+0000","last_fullsized":"2024-09-12T12:15:28.978637+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.969488+0000","last_change":"2024-09-12T12:15:28.969488+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.969488+0000","last_undegraded":"2024-09-12T12:15:28.969488+0000","last_fullsized":"2024-09-12T12:15:28.969488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968688+0000","last_change":"2024-09-12T12:15:28.968688+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968688+0000","last_undegraded":"2024-09-12T12:15:28.968688+0000","last_fullsized":"2024-09-12T12:15:28.968688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976107+0000","last_change":"2024-09-12T12:15:28.976107+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976107+0000","last_undegraded":"2024-09-12T12:15:28.976107+0000","last_fullsized":"2024-09-12T12:15:28.976107+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973240+0000","last_change":"2024-09-12T12:15:28.973240+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973240+0000","last_undegraded":"2024-09-12T12:15:28.973240+0000","last_fullsized":"2024-09-12T12:15:28.973240+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974545+0000","last_change":"2024-09-12T12:15:28.974545+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974545+0000","last_undegraded":"2024-09-12T12:15:28.974545+0000","last_fullsized":"2024-09-12T12:15:28.974545+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976913+0000","last_change":"2024-09-12T12:15:28.976913+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976913+0000","last_undegraded":"2024-09-12T12:15:28.976913+0000","last_fullsized":"2024-09-12T12:15:28.976913+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979335+0000","last_change":"2024-09-12T12:15:28.979335+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979335+0000","last_undegraded":"2024-09-12T12:15:28.979335+0000","last_fullsized":"2024-09-12T12:15:28.979335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979959+0000","last_change":"2024-09-12T12:15:28.979959+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979959+0000","last_undegraded":"2024-09-12T12:15:28.979959+0000","last_fullsized":"2024-09-12T12:15:28.979959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.969106+0000","last_change":"2024-09-12T12:15:28.969106+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.969106+0000","last_undegraded":"2024-09-12T12:15:28.969106+0000","last_fullsized":"2024-09-12T12:15:28.969106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976144+0000","last_change":"2024-09-12T12:15:28.976144+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976144+0000","last_undegraded":"2024-09-12T12:15:28.976144+0000","last_fullsized":"2024-09-12T12:15:28.976144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972855+0000","last_change":"2024-09-12T12:15:28.972855+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972855+0000","last_undegraded":"2024-09-12T12:15:28.972855+0000","last_fullsized":"2024-09-12T12:15:28.972855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974999+0000","last_change":"2024-09-12T12:15:28.974999+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974999+0000","last_undegraded":"2024-09-12T12:15:28.974999+0000","last_fullsized":"2024-09-12T12:15:28.974999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973589+0000","last_change":"2024-09-12T12:15:28.973589+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973589+0000","last_undegraded":"2024-09-12T12:15:28.973589+0000","last_fullsized":"2024-09-12T12:15:28.973589+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975179+0000","last_change":"2024-09-12T12:15:28.975179+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975179+0000","last_undegraded":"2024-09-12T12:15:28.975179+0000","last_fullsized":"2024-09-12T12:15:28.975179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.978950+0000","last_change":"2024-09-12T12:15:28.973024+0000","last_active":"2024-09-12T12:15:28.978950+0000","last_peered":"2024-09-12T12:15:28.978950+0000","last_clean":"2024-09-12T12:15:28.978950+0000","last_became_active":"2024-09-12T12:15:28.972768+0000","last_became_peered":"2024-09-12T12:15:28.972768+0000","last_unstale":"2024-09-12T12:15:28.978950+0000","last_undegraded":"2024-09-12T12:15:28.978950+0000","last_fullsized":"2024-09-12T12:15:28.978950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:20.788321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972453+0000","last_change":"2024-09-12T12:15:28.972453+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972453+0000","last_undegraded":"2024-09-12T12:15:28.972453+0000","last_fullsized":"2024-09-12T12:15:28.972453+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:29.000857+0000","last_change":"2024-09-12T12:15:28.997846+0000","last_active":"2024-09-12T12:15:29.000857+0000","last_peered":"2024-09-12T12:15:29.000857+0000","last_clean":"2024-09-12T12:15:29.000857+0000","last_became_active":"2024-09-12T12:15:28.997572+0000","last_became_peered":"2024-09-12T12:15:28.997572+0000","last_unstale":"2024-09-12T12:15:29.000857+0000","last_undegraded":"2024-09-12T12:15:29.000857+0000","last_fullsized":"2024-09-12T12:15:29.000857+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:48.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968180+0000","last_change":"2024-09-12T12:15:28.968180+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968180+0000","last_undegraded":"2024-09-12T12:15:28.968180+0000","last_fullsized":"2024-09-12T12:15:28.968180+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991779+0000","last_change":"2024-09-12T12:15:28.980175+0000","last_active":"2024-09-12T12:15:28.991779+0000","last_peered":"2024-09-12T12:15:28.991779+0000","last_clean":"2024-09-12T12:15:28.991779+0000","last_became_active":"2024-09-12T12:15:28.979558+0000","last_became_peered":"2024-09-12T12:15:28.979558+0000","last_unstale":"2024-09-12T12:15:28.991779+0000","last_undegraded":"2024-09-12T12:15:28.991779+0000","last_fullsized":"2024-09-12T12:15:28.991779+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:03.704773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.986270+0000","last_change":"2024-09-12T12:15:28.986270+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.986270+0000","last_undegraded":"2024-09-12T12:15:28.986270+0000","last_fullsized":"2024-09-12T12:15:28.986270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999428+0000","last_change":"2024-09-12T12:15:28.998874+0000","last_active":"2024-09-12T12:15:28.999428+0000","last_peered":"2024-09-12T12:15:28.999428+0000","last_clean":"2024-09-12T12:15:28.999428+0000","last_became_active":"2024-09-12T12:15:28.998570+0000","last_became_peered":"2024-09-12T12:15:28.998570+0000","last_unstale":"2024-09-12T12:15:28.999428+0000","last_undegraded":"2024-09-12T12:15:28.999428+0000","last_fullsized":"2024-09-12T12:15:28.999428+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:14.812799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968243+0000","last_change":"2024-09-12T12:15:28.968243+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968243+0000","last_undegraded":"2024-09-12T12:15:28.968243+0000","last_fullsized":"2024-09-12T12:15:28.968243+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991715+0000","last_change":"2024-09-12T12:15:28.990368+0000","last_active":"2024-09-12T12:15:28.991715+0000","last_peered":"2024-09-12T12:15:28.991715+0000","last_clean":"2024-09-12T12:15:28.991715+0000","last_became_active":"2024-09-12T12:15:28.990126+0000","last_became_peered":"2024-09-12T12:15:28.990126+0000","last_unstale":"2024-09-12T12:15:28.991715+0000","last_undegraded":"2024-09-12T12:15:28.991715+0000","last_fullsized":"2024-09-12T12:15:28.991715+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:21:35.194737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975521+0000","last_change":"2024-09-12T12:15:28.975521+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975521+0000","last_undegraded":"2024-09-12T12:15:28.975521+0000","last_fullsized":"2024-09-12T12:15:28.975521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.982480+0000","last_change":"2024-09-12T12:15:28.977317+0000","last_active":"2024-09-12T12:15:28.982480+0000","last_peered":"2024-09-12T12:15:28.982480+0000","last_clean":"2024-09-12T12:15:28.982480+0000","last_became_active":"2024-09-12T12:15:28.976850+0000","last_became_peered":"2024-09-12T12:15:28.976850+0000","last_unstale":"2024-09-12T12:15:28.982480+0000","last_undegraded":"2024-09-12T12:15:28.982480+0000","last_fullsized":"2024-09-12T12:15:28.982480+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:03.704773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978375+0000","last_change":"2024-09-12T12:15:28.978375+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978375+0000","last_undegraded":"2024-09-12T12:15:28.978375+0000","last_fullsized":"2024-09-12T12:15:28.978375+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.989843+0000","last_change":"2024-09-12T12:15:28.984535+0000","last_active":"2024-09-12T12:15:28.989843+0000","last_peered":"2024-09-12T12:15:28.989843+0000","last_clean":"2024-09-12T12:15:28.989843+0000","last_became_active":"2024-09-12T12:15:28.984229+0000","last_became_peered":"2024-09-12T12:15:28.984229+0000","last_unstale":"2024-09-12T12:15:28.989843+0000","last_undegraded":"2024-09-12T12:15:28.989843+0000","last_fullsized":"2024-09-12T12:15:28.989843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:48.415139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974758+0000","last_change":"2024-09-12T12:15:28.974758+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974758+0000","last_undegraded":"2024-09-12T12:15:28.974758+0000","last_fullsized":"2024-09-12T12:15:28.974758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.983192+0000","last_change":"2024-09-12T12:15:28.979840+0000","last_active":"2024-09-12T12:15:28.983192+0000","last_peered":"2024-09-12T12:15:28.983192+0000","last_clean":"2024-09-12T12:15:28.983192+0000","last_became_active":"2024-09-12T12:15:28.979629+0000","last_became_peered":"2024-09-12T12:15:28.979629+0000","last_unstale":"2024-09-12T12:15:28.983192+0000","last_undegraded":"2024-09-12T12:15:28.983192+0000","last_fullsized":"2024-09-12T12:15:28.983192+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:59.726786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.967481+0000","last_change":"2024-09-12T12:15:28.967481+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.967481+0000","last_undegraded":"2024-09-12T12:15:28.967481+0000","last_fullsized":"2024-09-12T12:15:28.967481+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.990057+0000","last_change":"2024-09-12T12:15:28.985794+0000","last_active":"2024-09-12T12:15:28.990057+0000","last_peered":"2024-09-12T12:15:28.990057+0000","last_clean":"2024-09-12T12:15:28.990057+0000","last_became_active":"2024-09-12T12:15:28.985514+0000","last_became_peered":"2024-09-12T12:15:28.985514+0000","last_unstale":"2024-09-12T12:15:28.990057+0000","last_undegraded":"2024-09-12T12:15:28.990057+0000","last_fullsized":"2024-09-12T12:15:28.990057+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:54.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974174+0000","last_change":"2024-09-12T12:15:28.974174+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974174+0000","last_undegraded":"2024-09-12T12:15:28.974174+0000","last_fullsized":"2024-09-12T12:15:28.974174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.984464+0000","last_change":"2024-09-12T12:15:28.981586+0000","last_active":"2024-09-12T12:15:28.984464+0000","last_peered":"2024-09-12T12:15:28.984464+0000","last_clean":"2024-09-12T12:15:28.984464+0000","last_became_active":"2024-09-12T12:15:28.981224+0000","last_became_peered":"2024-09-12T12:15:28.981224+0000","last_unstale":"2024-09-12T12:15:28.984464+0000","last_undegraded":"2024-09-12T12:15:28.984464+0000","last_fullsized":"2024-09-12T12:15:28.984464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:16.354264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974291+0000","last_change":"2024-09-12T12:15:28.974291+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974291+0000","last_undegraded":"2024-09-12T12:15:28.974291+0000","last_fullsized":"2024-09-12T12:15:28.974291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995764+0000","last_change":"2024-09-12T12:15:28.995320+0000","last_active":"2024-09-12T12:15:28.995764+0000","last_peered":"2024-09-12T12:15:28.995764+0000","last_clean":"2024-09-12T12:15:28.995764+0000","last_became_active":"2024-09-12T12:15:28.995054+0000","last_became_peered":"2024-09-12T12:15:28.995054+0000","last_unstale":"2024-09-12T12:15:28.995764+0000","last_undegraded":"2024-09-12T12:15:28.995764+0000","last_fullsized":"2024-09-12T12:15:28.995764+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:42.335476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968437+0000","last_change":"2024-09-12T12:15:28.968437+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968437+0000","last_undegraded":"2024-09-12T12:15:28.968437+0000","last_fullsized":"2024-09-12T12:15:28.968437+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999562+0000","last_change":"2024-09-12T12:15:28.996444+0000","last_active":"2024-09-12T12:15:28.999562+0000","last_peered":"2024-09-12T12:15:28.999562+0000","last_clean":"2024-09-12T12:15:28.999562+0000","last_became_active":"2024-09-12T12:15:28.996157+0000","last_became_peered":"2024-09-12T12:15:28.996157+0000","last_unstale":"2024-09-12T12:15:28.999562+0000","last_undegraded":"2024-09-12T12:15:28.999562+0000","last_fullsized":"2024-09-12T12:15:28.999562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:12.067885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.977148+0000","last_change":"2024-09-12T12:15:28.977148+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.977148+0000","last_undegraded":"2024-09-12T12:15:28.977148+0000","last_fullsized":"2024-09-12T12:15:28.977148+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991363+0000","last_change":"2024-09-12T12:15:28.986459+0000","last_active":"2024-09-12T12:15:28.991363+0000","last_peered":"2024-09-12T12:15:28.991363+0000","last_clean":"2024-09-12T12:15:28.991363+0000","last_became_active":"2024-09-12T12:15:28.986199+0000","last_became_peered":"2024-09-12T12:15:28.986199+0000","last_unstale":"2024-09-12T12:15:28.991363+0000","last_undegraded":"2024-09-12T12:15:28.991363+0000","last_fullsized":"2024-09-12T12:15:28.991363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:37.265570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978210+0000","last_change":"2024-09-12T12:15:28.978210+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978210+0000","last_undegraded":"2024-09-12T12:15:28.978210+0000","last_fullsized":"2024-09-12T12:15:28.978210+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.985055+0000","last_change":"2024-09-12T12:15:28.981615+0000","last_active":"2024-09-12T12:15:28.985055+0000","last_peered":"2024-09-12T12:15:28.985055+0000","last_clean":"2024-09-12T12:15:28.985055+0000","last_became_active":"2024-09-12T12:15:28.981365+0000","last_became_peered":"2024-09-12T12:15:28.981365+0000","last_unstale":"2024-09-12T12:15:28.985055+0000","last_undegraded":"2024-09-12T12:15:28.985055+0000","last_fullsized":"2024-09-12T12:15:28.985055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:55.218821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978872+0000","last_change":"2024-09-12T12:15:28.978872+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978872+0000","last_undegraded":"2024-09-12T12:15:28.978872+0000","last_fullsized":"2024-09-12T12:15:28.978872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.990129+0000","last_change":"2024-09-12T12:15:28.986783+0000","last_active":"2024-09-12T12:15:28.990129+0000","last_peered":"2024-09-12T12:15:28.990129+0000","last_clean":"2024-09-12T12:15:28.990129+0000","last_became_active":"2024-09-12T12:15:28.985415+0000","last_became_peered":"2024-09-12T12:15:28.985415+0000","last_unstale":"2024-09-12T12:15:28.990129+0000","last_undegraded":"2024-09-12T12:15:28.990129+0000","last_fullsized":"2024-09-12T12:15:28.990129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:08.684180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976524+0000","last_change":"2024-09-12T12:15:28.976524+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976524+0000","last_undegraded":"2024-09-12T12:15:28.976524+0000","last_fullsized":"2024-09-12T12:15:28.976524+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999316+0000","last_change":"2024-09-12T12:15:28.993668+0000","last_active":"2024-09-12T12:15:28.999316+0000","last_peered":"2024-09-12T12:15:28.999316+0000","last_clean":"2024-09-12T12:15:28.999316+0000","last_became_active":"2024-09-12T12:15:28.993395+0000","last_became_peered":"2024-09-12T12:15:28.993395+0000","last_unstale":"2024-09-12T12:15:28.999316+0000","last_undegraded":"2024-09-12T12:15:28.999316+0000","last_fullsized":"2024-09-12T12:15:28.999316+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.299252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973934+0000","last_change":"2024-09-12T12:15:28.973934+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973934+0000","last_undegraded":"2024-09-12T12:15:28.973934+0000","last_fullsized":"2024-09-12T12:15:28.973934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:29.000351+0000","last_change":"2024-09-12T12:15:28.999035+0000","last_active":"2024-09-12T12:15:29.000351+0000","last_peered":"2024-09-12T12:15:29.000351+0000","last_clean":"2024-09-12T12:15:29.000351+0000","last_became_active":"2024-09-12T12:15:28.998733+0000","last_became_peered":"2024-09-12T12:15:28.998733+0000","last_unstale":"2024-09-12T12:15:29.000351+0000","last_undegraded":"2024-09-12T12:15:29.000351+0000","last_fullsized":"2024-09-12T12:15:29.000351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:48.389471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976117+0000","last_change":"2024-09-12T12:15:28.976117+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976117+0000","last_undegraded":"2024-09-12T12:15:28.976117+0000","last_fullsized":"2024-09-12T12:15:28.976117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.989053+0000","last_change":"2024-09-12T12:15:28.988145+0000","last_active":"2024-09-12T12:15:28.989053+0000","last_peered":"2024-09-12T12:15:28.989053+0000","last_clean":"2024-09-12T12:15:28.989053+0000","last_became_active":"2024-09-12T12:15:28.987869+0000","last_became_peered":"2024-09-12T12:15:28.987869+0000","last_unstale":"2024-09-12T12:15:28.989053+0000","last_undegraded":"2024-09-12T12:15:28.989053+0000","last_fullsized":"2024-09-12T12:15:28.989053+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:34.475461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.967879+0000","last_change":"2024-09-12T12:15:28.967879+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.967879+0000","last_undegraded":"2024-09-12T12:15:28.967879+0000","last_fullsized":"2024-09-12T12:15:28.967879+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995394+0000","last_change":"2024-09-12T12:15:28.991659+0000","last_active":"2024-09-12T12:15:28.995394+0000","last_peered":"2024-09-12T12:15:28.995394+0000","last_clean":"2024-09-12T12:15:28.995394+0000","last_became_active":"2024-09-12T12:15:28.991363+0000","last_became_peered":"2024-09-12T12:15:28.991363+0000","last_unstale":"2024-09-12T12:15:28.995394+0000","last_undegraded":"2024-09-12T12:15:28.995394+0000","last_fullsized":"2024-09-12T12:15:28.995394+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:03.704773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975991+0000","last_change":"2024-09-12T12:15:28.975991+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975991+0000","last_undegraded":"2024-09-12T12:15:28.975991+0000","last_fullsized":"2024-09-12T12:15:28.975991+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.998050+0000","last_change":"2024-09-12T12:15:28.997415+0000","last_active":"2024-09-12T12:15:28.998050+0000","last_peered":"2024-09-12T12:15:28.998050+0000","last_clean":"2024-09-12T12:15:28.998050+0000","last_became_active":"2024-09-12T12:15:28.997122+0000","last_became_peered":"2024-09-12T12:15:28.997122+0000","last_unstale":"2024-09-12T12:15:28.998050+0000","last_undegraded":"2024-09-12T12:15:28.998050+0000","last_fullsized":"2024-09-12T12:15:28.998050+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:16.354264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973990+0000","last_change":"2024-09-12T12:15:28.973990+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973990+0000","last_undegraded":"2024-09-12T12:15:28.973990+0000","last_fullsized":"2024-09-12T12:15:28.973990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995387+0000","last_change":"2024-09-12T12:15:28.991547+0000","last_active":"2024-09-12T12:15:28.995387+0000","last_peered":"2024-09-12T12:15:28.995387+0000","last_clean":"2024-09-12T12:15:28.995387+0000","last_became_active":"2024-09-12T12:15:28.988510+0000","last_became_peered":"2024-09-12T12:15:28.988510+0000","last_unstale":"2024-09-12T12:15:28.995387+0000","last_undegraded":"2024-09-12T12:15:28.995387+0000","last_fullsized":"2024-09-12T12:15:28.995387+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:16.354264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.971314+0000","last_change":"2024-09-12T12:15:28.971314+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.971314+0000","last_undegraded":"2024-09-12T12:15:28.971314+0000","last_fullsized":"2024-09-12T12:15:28.971314+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999559+0000","last_change":"2024-09-12T12:15:28.995461+0000","last_active":"2024-09-12T12:15:28.999559+0000","last_peered":"2024-09-12T12:15:28.999559+0000","last_clean":"2024-09-12T12:15:28.999559+0000","last_became_active":"2024-09-12T12:15:28.995166+0000","last_became_peered":"2024-09-12T12:15:28.995166+0000","last_unstale":"2024-09-12T12:15:28.999559+0000","last_undegraded":"2024-09-12T12:15:28.999559+0000","last_fullsized":"2024-09-12T12:15:28.999559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:14.812799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973696+0000","last_change":"2024-09-12T12:15:28.973696+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973696+0000","last_undegraded":"2024-09-12T12:15:28.973696+0000","last_fullsized":"2024-09-12T12:15:28.973696+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995084+0000","last_change":"2024-09-12T12:15:28.993720+0000","last_active":"2024-09-12T12:15:28.995084+0000","last_peered":"2024-09-12T12:15:28.995084+0000","last_clean":"2024-09-12T12:15:28.995084+0000","last_became_active":"2024-09-12T12:15:28.993434+0000","last_became_peered":"2024-09-12T12:15:28.993434+0000","last_unstale":"2024-09-12T12:15:28.995084+0000","last_undegraded":"2024-09-12T12:15:28.995084+0000","last_fullsized":"2024-09-12T12:15:28.995084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:33.220369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978838+0000","last_change":"2024-09-12T12:15:28.978838+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978838+0000","last_undegraded":"2024-09-12T12:15:28.978838+0000","last_fullsized":"2024-09-12T12:15:28.978838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991881+0000","last_change":"2024-09-12T12:15:28.989717+0000","last_active":"2024-09-12T12:15:28.991881+0000","last_peered":"2024-09-12T12:15:28.991881+0000","last_clean":"2024-09-12T12:15:28.991881+0000","last_became_active":"2024-09-12T12:15:28.989405+0000","last_became_peered":"2024-09-12T12:15:28.989405+0000","last_unstale":"2024-09-12T12:15:28.991881+0000","last_undegraded":"2024-09-12T12:15:28.991881+0000","last_fullsized":"2024-09-12T12:15:28.991881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:35.417617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972482+0000","last_change":"2024-09-12T12:15:28.972482+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972482+0000","last_undegraded":"2024-09-12T12:15:28.972482+0000","last_fullsized":"2024-09-12T12:15:28.972482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.987402+0000","last_change":"2024-09-12T12:15:28.983057+0000","last_active":"2024-09-12T12:15:28.987402+0000","last_peered":"2024-09-12T12:15:28.987402+0000","last_clean":"2024-09-12T12:15:28.987402+0000","last_became_active":"2024-09-12T12:15:28.982770+0000","last_became_peered":"2024-09-12T12:15:28.982770+0000","last_unstale":"2024-09-12T12:15:28.987402+0000","last_undegraded":"2024-09-12T12:15:28.987402+0000","last_fullsized":"2024-09-12T12:15:28.987402+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:36.053548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978638+0000","last_change":"2024-09-12T12:15:28.978638+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978638+0000","last_undegraded":"2024-09-12T12:15:28.978638+0000","last_fullsized":"2024-09-12T12:15:28.978638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.990539+0000","last_change":"2024-09-12T12:15:28.989675+0000","last_active":"2024-09-12T12:15:28.990539+0000","last_peered":"2024-09-12T12:15:28.990539+0000","last_clean":"2024-09-12T12:15:28.990539+0000","last_became_active":"2024-09-12T12:15:28.989383+0000","last_became_peered":"2024-09-12T12:15:28.989383+0000","last_unstale":"2024-09-12T12:15:28.990539+0000","last_undegraded":"2024-09-12T12:15:28.990539+0000","last_fullsized":"2024-09-12T12:15:28.990539+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:25.049563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978897+0000","last_change":"2024-09-12T12:15:28.978897+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978897+0000","last_undegraded":"2024-09-12T12:15:28.978897+0000","last_fullsized":"2024-09-12T12:15:28.978897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.989851+0000","last_change":"2024-09-12T12:15:28.982400+0000","last_active":"2024-09-12T12:15:28.989851+0000","last_peered":"2024-09-12T12:15:28.989851+0000","last_clean":"2024-09-12T12:15:28.989851+0000","last_became_active":"2024-09-12T12:15:28.982103+0000","last_became_peered":"2024-09-12T12:15:28.982103+0000","last_unstale":"2024-09-12T12:15:28.989851+0000","last_undegraded":"2024-09-12T12:15:28.989851+0000","last_fullsized":"2024-09-12T12:15:28.989851+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:37.433511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973816+0000","last_change":"2024-09-12T12:15:28.973816+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973816+0000","last_undegraded":"2024-09-12T12:15:28.973816+0000","last_fullsized":"2024-09-12T12:15:28.973816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999485+0000","last_change":"2024-09-12T12:15:28.995466+0000","last_active":"2024-09-12T12:15:28.999485+0000","last_peered":"2024-09-12T12:15:28.999485+0000","last_clean":"2024-09-12T12:15:28.999485+0000","last_became_active":"2024-09-12T12:15:28.995180+0000","last_became_peered":"2024-09-12T12:15:28.995180+0000","last_unstale":"2024-09-12T12:15:28.999485+0000","last_undegraded":"2024-09-12T12:15:28.999485+0000","last_fullsized":"2024-09-12T12:15:28.999485+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:56.407792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973975+0000","last_change":"2024-09-12T12:15:28.973975+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973975+0000","last_undegraded":"2024-09-12T12:15:28.973975+0000","last_fullsized":"2024-09-12T12:15:28.973975+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:29.000477+0000","last_change":"2024-09-12T12:15:28.997623+0000","last_active":"2024-09-12T12:15:29.000477+0000","last_peered":"2024-09-12T12:15:29.000477+0000","last_clean":"2024-09-12T12:15:29.000477+0000","last_became_active":"2024-09-12T12:15:28.997361+0000","last_became_peered":"2024-09-12T12:15:28.997361+0000","last_unstale":"2024-09-12T12:15:29.000477+0000","last_undegraded":"2024-09-12T12:15:29.000477+0000","last_fullsized":"2024-09-12T12:15:29.000477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:36.747728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974230+0000","last_change":"2024-09-12T12:15:28.974230+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974230+0000","last_undegraded":"2024-09-12T12:15:28.974230+0000","last_fullsized":"2024-09-12T12:15:28.974230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.998055+0000","last_change":"2024-09-12T12:15:28.997529+0000","last_active":"2024-09-12T12:15:28.998055+0000","last_peered":"2024-09-12T12:15:28.998055+0000","last_clean":"2024-09-12T12:15:28.998055+0000","last_became_active":"2024-09-12T12:15:28.997217+0000","last_became_peered":"2024-09-12T12:15:28.997217+0000","last_unstale":"2024-09-12T12:15:28.998055+0000","last_undegraded":"2024-09-12T12:15:28.998055+0000","last_fullsized":"2024-09-12T12:15:28.998055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:48.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979412+0000","last_change":"2024-09-12T12:15:28.979412+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979412+0000","last_undegraded":"2024-09-12T12:15:28.979412+0000","last_fullsized":"2024-09-12T12:15:28.979412+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995298+0000","last_change":"2024-09-12T12:15:28.991866+0000","last_active":"2024-09-12T12:15:28.995298+0000","last_peered":"2024-09-12T12:15:28.995298+0000","last_clean":"2024-09-12T12:15:28.995298+0000","last_became_active":"2024-09-12T12:15:28.991562+0000","last_became_peered":"2024-09-12T12:15:28.991562+0000","last_unstale":"2024-09-12T12:15:28.995298+0000","last_undegraded":"2024-09-12T12:15:28.995298+0000","last_fullsized":"2024-09-12T12:15:28.995298+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.299252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968076+0000","last_change":"2024-09-12T12:15:28.968076+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968076+0000","last_undegraded":"2024-09-12T12:15:28.968076+0000","last_fullsized":"2024-09-12T12:15:28.968076+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991328+0000","last_change":"2024-09-12T12:15:28.985626+0000","last_active":"2024-09-12T12:15:28.991328+0000","last_peered":"2024-09-12T12:15:28.991328+0000","last_clean":"2024-09-12T12:15:28.991328+0000","last_became_active":"2024-09-12T12:15:28.985369+0000","last_became_peered":"2024-09-12T12:15:28.985369+0000","last_unstale":"2024-09-12T12:15:28.991328+0000","last_undegraded":"2024-09-12T12:15:28.991328+0000","last_fullsized":"2024-09-12T12:15:28.991328+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:41.313179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.978279+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:15:28.978279+0000","last_peered":"2024-09-12T12:15:28.978279+0000","last_clean":"2024-09-12T12:15:28.978279+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:15:28.978279+0000","last_undegraded":"2024-09-12T12:15:28.978279+0000","last_fullsized":"2024-09-12T12:15:28.978279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36540,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335300,"statfs":{"total":96636764160,"available":96599347200,"internally_reserved":0,"allocated":1212416,"data_stored":864691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35956,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335884,"statfs":{"total":96636764160,"available":96599945216,"internally_reserved":0,"allocated":618496,"data_stored":274323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36532,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335308,"statfs":{"total":96636764160,"available":96599355392,"internally_reserved":0,"allocated":1212416,"data_stored":864691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:15:34.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:15:34.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.607+0000 7f88a1600640 1 Processor -- start 2024-09-12T12:15:34.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.607+0000 7f88a1600640 1 -- start start 2024-09-12T12:15:34.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.607+0000 7f88a1600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f889c15b4e0 0x7f889c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.607+0000 7f88a1600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889c0b45a0 con 0x7f889c0ccf30 2024-09-12T12:15:34.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.607+0000 7f88a1600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889c0b3fe0 con 0x7f889c0b3ad0 2024-09-12T12:15:34.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.607+0000 7f88a1600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f889c0b42c0 con 0x7f889c15b4e0 2024-09-12T12:15:34.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f889c0ccf30 0x7f889c0b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39606/0 (socket says 172.21.15.144:39606) 2024-09-12T12:15:34.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889b400640 1 -- 172.21.15.144:0/960120123 learned_addr learned my addr 172.21.15.144:0/960120123 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:34.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889aa00640 1 --2- 172.21.15.144:0/960120123 >> v2:172.21.15.165:3300/0 conn(0x7f889c15b4e0 0x7f889c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117370458 0 0) 0x7f889c0b45a0 con 0x7f889c0ccf30 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8880003530 con 0x7f889c0ccf30 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2912733562 0 0) 0x7f8880003530 con 0x7f889c0ccf30 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 >> v2:172.21.15.165:3300/0 conn(0x7f889c15b4e0 msgr2=0x7f889c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 --2- 172.21.15.144:0/960120123 >> v2:172.21.15.165:3300/0 conn(0x7f889c15b4e0 0x7f889c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 >> v1:172.21.15.165:6789/0 conn(0x7f889c0b3ad0 legacy=0x7f889c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c0b1490 con 0x7f889c0ccf30 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f8894001a00 con 0x7f889c0ccf30 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 >> v1:172.21.15.144:6789/0 conn(0x7f889c0ccf30 legacy=0x7f889c0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88800039c0 0x7f8880003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8880004810 0x7f8880004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800051d0 0x7f888000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f889c0b42c0 con 0x7f88800051d0 2024-09-12T12:15:34.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f888000c020 con 0x7f8880004810 2024-09-12T12:15:34.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f888000c220 con 0x7f88800039c0 2024-09-12T12:15:34.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889b400640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800051d0 0x7f888000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889aa00640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88800039c0 0x7f8880003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889a000640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8880004810 0x7f8880004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889b400640 1 -- 172.21.15.144:0/960120123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88800039c0 msgr2=0x7f8880003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:34.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889b400640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88800039c0 0x7f8880003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889b400640 1 -- 172.21.15.144:0/960120123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8880004810 msgr2=0x7f8880004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889b400640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8880004810 0x7f8880004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.611+0000 7f889b400640 1 -- 172.21.15.144:0/960120123 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8880003530 con 0x7f88800051d0 2024-09-12T12:15:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f889b400640 1 -- 172.21.15.144:0/960120123 reap_dead start 2024-09-12T12:15:34.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f889b400640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800051d0 0x7f888000b9d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f889400a790 tx=0x7f889401fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcfc33422f3c3f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889400a3b0 con 0x7f88800051d0 2024-09-12T12:15:34.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88940aa650 con 0x7f88800051d0 2024-09-12T12:15:34.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f8899600640 1 -- 172.21.15.144:0/960120123 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940aaa40 con 0x7f88800051d0 2024-09-12T12:15:34.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f88a1600640 1 -- 172.21.15.144:0/960120123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800051d0 msgr2=0x7f888000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f88a1600640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800051d0 0x7f888000b9d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f889400a790 tx=0x7f889401fa00 comp rx=0 tx=0).stop 2024-09-12T12:15:34.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f88a1600640 1 -- 172.21.15.144:0/960120123 shutdown_connections 2024-09-12T12:15:34.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f88a1600640 1 --2- 172.21.15.144:0/960120123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800051d0 0x7f888000b9d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f88a1600640 1 -- 172.21.15.144:0/960120123 >> 172.21.15.144:0/960120123 conn(0x7f889c06d0d0 msgr2=0x7f889c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:34.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f88a1600640 1 -- 172.21.15.144:0/960120123 shutdown_connections 2024-09-12T12:15:34.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f88a1600640 1 -- 172.21.15.144:0/960120123 wait complete. 2024-09-12T12:15:34.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f88a1600640 1 Processor -- start 2024-09-12T12:15:34.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.615+0000 7f88a1600640 1 -- start start 2024-09-12T12:15:34.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f88a1600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88800051d0 0x7f889c1f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f88a1600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f889c154ee0 0x7f889c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f88a1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889c1541e0 0x7f889c155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f88a1600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f889c15b8c0 con 0x7f889c1541e0 2024-09-12T12:15:34.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f88a1600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f889c0cdef0 con 0x7f88800051d0 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f88a1600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f889c159ba0 con 0x7f889c154ee0 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889c1541e0 0x7f889c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889c1541e0 0x7f889c155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52642/0 (socket says 172.21.15.144:52642) 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889b400640 1 -- 172.21.15.144:0/3475775233 learned_addr learned my addr 172.21.15.144:0/3475775233 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889a000640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f889c154ee0 0x7f889c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889aa00640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88800051d0 0x7f889c1f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889b400640 1 -- 172.21.15.144:0/3475775233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f889c154ee0 msgr2=0x7f889c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889b400640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f889c154ee0 0x7f889c159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889b400640 1 -- 172.21.15.144:0/3475775233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88800051d0 msgr2=0x7f889c1f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889b400640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88800051d0 0x7f889c1f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889b400640 1 -- 172.21.15.144:0/3475775233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c1598c0 con 0x7f889c1541e0 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889aa00640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88800051d0 0x7f889c1f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f889b400640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889c1541e0 0x7f889c155460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f889401f830 tx=0x7f8880005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f8892a00640 1 -- 172.21.15.144:0/3475775233 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894001f10 con 0x7f889c1541e0 2024-09-12T12:15:34.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f8892a00640 1 -- 172.21.15.144:0/3475775233 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88940bb070 con 0x7f889c1541e0 2024-09-12T12:15:34.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f8892a00640 1 -- 172.21.15.144:0/3475775233 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940aaa00 con 0x7f889c1541e0 2024-09-12T12:15:34.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c1f4120 con 0x7f889c1541e0 2024-09-12T12:15:34.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c1f46e0 con 0x7f889c1541e0 2024-09-12T12:15:34.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c0b3fa0 con 0x7f889c1541e0 2024-09-12T12:15:34.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.619+0000 7f8892a00640 1 -- 172.21.15.144:0/3475775233 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88940aaba0 con 0x7f889c1541e0 2024-09-12T12:15:34.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.623+0000 7f8892a00640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f887c0678c0 0x7f887c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.623+0000 7f8892a00640 1 -- 172.21.15.144:0/3475775233 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f88941238c0 con 0x7f889c1541e0 2024-09-12T12:15:34.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.623+0000 7f889aa00640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f887c0678c0 0x7f887c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.623+0000 7f889aa00640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f887c0678c0 0x7f887c069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f889c1f1c00 tx=0x7f888c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.627+0000 7f8892a00640 1 -- 172.21.15.144:0/3475775233 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8894019710 con 0x7f889c1541e0 2024-09-12T12:15:34.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.779+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f889c0cef90 con 0x7f887c0678c0 2024-09-12T12:15:34.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.787+0000 7f8892a00640 1 -- 172.21.15.144:0/3475775233 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7f889c0cef90 con 0x7f887c0678c0 2024-09-12T12:15:34.791 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:34.793 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f887c0678c0 msgr2=0x7f887c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f887c0678c0 0x7f887c069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f889c1f1c00 tx=0x7f888c008040 comp rx=0 tx=0).stop 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889c1541e0 msgr2=0x7f889c155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889c1541e0 0x7f889c155460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f889401f830 tx=0x7f8880005840 comp rx=0 tx=0).stop 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 shutdown_connections 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f887c0678c0 0x7f887c069d80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f889c1541e0 0x7f889c155460 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f889c154ee0 0x7f889c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 --2- 172.21.15.144:0/3475775233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88800051d0 0x7f889c1f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 >> 172.21.15.144:0/3475775233 conn(0x7f889c06d0d0 msgr2=0x7f889c0cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:34.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 shutdown_connections 2024-09-12T12:15:34.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.791+0000 7f88a1600640 1 -- 172.21.15.144:0/3475775233 wait complete. 2024-09-12T12:15:34.813 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-12T12:15:33.410812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284588,"kb_used_data":5932,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754690132,"statfs":{"total":773094113280,"available":772802695168,"internally_reserved":0,"allocated":6074368,"data_stored":3341985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.446495"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.982087+0000","last_change":"2024-09-12T12:15:28.982087+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.982087+0000","last_undegraded":"2024-09-12T12:15:28.982087+0000","last_fullsized":"2024-09-12T12:15:28.982087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975202+0000","last_change":"2024-09-12T12:15:28.975202+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975202+0000","last_undegraded":"2024-09-12T12:15:28.975202+0000","last_fullsized":"2024-09-12T12:15:28.975202+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979129+0000","last_change":"2024-09-12T12:15:28.979129+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979129+0000","last_undegraded":"2024-09-12T12:15:28.979129+0000","last_fullsized":"2024-09-12T12:15:28.979129+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974814+0000","last_change":"2024-09-12T12:15:28.974814+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974814+0000","last_undegraded":"2024-09-12T12:15:28.974814+0000","last_fullsized":"2024-09-12T12:15:28.974814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968941+0000","last_change":"2024-09-12T12:15:28.968941+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968941+0000","last_undegraded":"2024-09-12T12:15:28.968941+0000","last_fullsized":"2024-09-12T12:15:28.968941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.985779+0000","last_change":"2024-09-12T12:15:28.985779+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.985779+0000","last_undegraded":"2024-09-12T12:15:28.985779+0000","last_fullsized":"2024-09-12T12:15:28.985779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975376+0000","last_change":"2024-09-12T12:15:28.975376+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975376+0000","last_undegraded":"2024-09-12T12:15:28.975376+0000","last_fullsized":"2024-09-12T12:15:28.975376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974468+0000","last_change":"2024-09-12T12:15:28.974468+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974468+0000","last_undegraded":"2024-09-12T12:15:28.974468+0000","last_fullsized":"2024-09-12T12:15:28.974468+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979809+0000","last_change":"2024-09-12T12:15:28.979809+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979809+0000","last_undegraded":"2024-09-12T12:15:28.979809+0000","last_fullsized":"2024-09-12T12:15:28.979809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.980816+0000","last_change":"2024-09-12T12:15:28.980816+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.980816+0000","last_undegraded":"2024-09-12T12:15:28.980816+0000","last_fullsized":"2024-09-12T12:15:28.980816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972226+0000","last_change":"2024-09-12T12:15:28.972226+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972226+0000","last_undegraded":"2024-09-12T12:15:28.972226+0000","last_fullsized":"2024-09-12T12:15:28.972226+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.984796+0000","last_change":"2024-09-12T12:15:28.984796+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.984796+0000","last_undegraded":"2024-09-12T12:15:28.984796+0000","last_fullsized":"2024-09-12T12:15:28.984796+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.980928+0000","last_change":"2024-09-12T12:15:28.980928+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.980928+0000","last_undegraded":"2024-09-12T12:15:28.980928+0000","last_fullsized":"2024-09-12T12:15:28.980928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974762+0000","last_change":"2024-09-12T12:15:28.974762+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974762+0000","last_undegraded":"2024-09-12T12:15:28.974762+0000","last_fullsized":"2024-09-12T12:15:28.974762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975198+0000","last_change":"2024-09-12T12:15:28.975198+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975198+0000","last_undegraded":"2024-09-12T12:15:28.975198+0000","last_fullsized":"2024-09-12T12:15:28.975198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.985280+0000","last_change":"2024-09-12T12:15:28.985280+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.985280+0000","last_undegraded":"2024-09-12T12:15:28.985280+0000","last_fullsized":"2024-09-12T12:15:28.985280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.977272+0000","last_change":"2024-09-12T12:15:28.977272+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.977272+0000","last_undegraded":"2024-09-12T12:15:28.977272+0000","last_fullsized":"2024-09-12T12:15:28.977272+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974681+0000","last_change":"2024-09-12T12:15:28.974681+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974681+0000","last_undegraded":"2024-09-12T12:15:28.974681+0000","last_fullsized":"2024-09-12T12:15:28.974681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978637+0000","last_change":"2024-09-12T12:15:28.978637+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978637+0000","last_undegraded":"2024-09-12T12:15:28.978637+0000","last_fullsized":"2024-09-12T12:15:28.978637+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.969488+0000","last_change":"2024-09-12T12:15:28.969488+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.969488+0000","last_undegraded":"2024-09-12T12:15:28.969488+0000","last_fullsized":"2024-09-12T12:15:28.969488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968688+0000","last_change":"2024-09-12T12:15:28.968688+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968688+0000","last_undegraded":"2024-09-12T12:15:28.968688+0000","last_fullsized":"2024-09-12T12:15:28.968688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976107+0000","last_change":"2024-09-12T12:15:28.976107+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976107+0000","last_undegraded":"2024-09-12T12:15:28.976107+0000","last_fullsized":"2024-09-12T12:15:28.976107+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973240+0000","last_change":"2024-09-12T12:15:28.973240+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973240+0000","last_undegraded":"2024-09-12T12:15:28.973240+0000","last_fullsized":"2024-09-12T12:15:28.973240+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974545+0000","last_change":"2024-09-12T12:15:28.974545+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974545+0000","last_undegraded":"2024-09-12T12:15:28.974545+0000","last_fullsized":"2024-09-12T12:15:28.974545+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976913+0000","last_change":"2024-09-12T12:15:28.976913+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976913+0000","last_undegraded":"2024-09-12T12:15:28.976913+0000","last_fullsized":"2024-09-12T12:15:28.976913+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979335+0000","last_change":"2024-09-12T12:15:28.979335+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979335+0000","last_undegraded":"2024-09-12T12:15:28.979335+0000","last_fullsized":"2024-09-12T12:15:28.979335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979959+0000","last_change":"2024-09-12T12:15:28.979959+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979959+0000","last_undegraded":"2024-09-12T12:15:28.979959+0000","last_fullsized":"2024-09-12T12:15:28.979959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.969106+0000","last_change":"2024-09-12T12:15:28.969106+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.969106+0000","last_undegraded":"2024-09-12T12:15:28.969106+0000","last_fullsized":"2024-09-12T12:15:28.969106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976144+0000","last_change":"2024-09-12T12:15:28.976144+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976144+0000","last_undegraded":"2024-09-12T12:15:28.976144+0000","last_fullsized":"2024-09-12T12:15:28.976144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972855+0000","last_change":"2024-09-12T12:15:28.972855+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972855+0000","last_undegraded":"2024-09-12T12:15:28.972855+0000","last_fullsized":"2024-09-12T12:15:28.972855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974999+0000","last_change":"2024-09-12T12:15:28.974999+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974999+0000","last_undegraded":"2024-09-12T12:15:28.974999+0000","last_fullsized":"2024-09-12T12:15:28.974999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973589+0000","last_change":"2024-09-12T12:15:28.973589+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973589+0000","last_undegraded":"2024-09-12T12:15:28.973589+0000","last_fullsized":"2024-09-12T12:15:28.973589+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975179+0000","last_change":"2024-09-12T12:15:28.975179+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975179+0000","last_undegraded":"2024-09-12T12:15:28.975179+0000","last_fullsized":"2024-09-12T12:15:28.975179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.978950+0000","last_change":"2024-09-12T12:15:28.973024+0000","last_active":"2024-09-12T12:15:28.978950+0000","last_peered":"2024-09-12T12:15:28.978950+0000","last_clean":"2024-09-12T12:15:28.978950+0000","last_became_active":"2024-09-12T12:15:28.972768+0000","last_became_peered":"2024-09-12T12:15:28.972768+0000","last_unstale":"2024-09-12T12:15:28.978950+0000","last_undegraded":"2024-09-12T12:15:28.978950+0000","last_fullsized":"2024-09-12T12:15:28.978950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:20.788321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972453+0000","last_change":"2024-09-12T12:15:28.972453+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972453+0000","last_undegraded":"2024-09-12T12:15:28.972453+0000","last_fullsized":"2024-09-12T12:15:28.972453+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:29.000857+0000","last_change":"2024-09-12T12:15:28.997846+0000","last_active":"2024-09-12T12:15:29.000857+0000","last_peered":"2024-09-12T12:15:29.000857+0000","last_clean":"2024-09-12T12:15:29.000857+0000","last_became_active":"2024-09-12T12:15:28.997572+0000","last_became_peered":"2024-09-12T12:15:28.997572+0000","last_unstale":"2024-09-12T12:15:29.000857+0000","last_undegraded":"2024-09-12T12:15:29.000857+0000","last_fullsized":"2024-09-12T12:15:29.000857+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:48.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968180+0000","last_change":"2024-09-12T12:15:28.968180+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968180+0000","last_undegraded":"2024-09-12T12:15:28.968180+0000","last_fullsized":"2024-09-12T12:15:28.968180+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991779+0000","last_change":"2024-09-12T12:15:28.980175+0000","last_active":"2024-09-12T12:15:28.991779+0000","last_peered":"2024-09-12T12:15:28.991779+0000","last_clean":"2024-09-12T12:15:28.991779+0000","last_became_active":"2024-09-12T12:15:28.979558+0000","last_became_peered":"2024-09-12T12:15:28.979558+0000","last_unstale":"2024-09-12T12:15:28.991779+0000","last_undegraded":"2024-09-12T12:15:28.991779+0000","last_fullsized":"2024-09-12T12:15:28.991779+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:03.704773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.986270+0000","last_change":"2024-09-12T12:15:28.986270+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.986270+0000","last_undegraded":"2024-09-12T12:15:28.986270+0000","last_fullsized":"2024-09-12T12:15:28.986270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999428+0000","last_change":"2024-09-12T12:15:28.998874+0000","last_active":"2024-09-12T12:15:28.999428+0000","last_peered":"2024-09-12T12:15:28.999428+0000","last_clean":"2024-09-12T12:15:28.999428+0000","last_became_active":"2024-09-12T12:15:28.998570+0000","last_became_peered":"2024-09-12T12:15:28.998570+0000","last_unstale":"2024-09-12T12:15:28.999428+0000","last_undegraded":"2024-09-12T12:15:28.999428+0000","last_fullsized":"2024-09-12T12:15:28.999428+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:14.812799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968243+0000","last_change":"2024-09-12T12:15:28.968243+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968243+0000","last_undegraded":"2024-09-12T12:15:28.968243+0000","last_fullsized":"2024-09-12T12:15:28.968243+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991715+0000","last_change":"2024-09-12T12:15:28.990368+0000","last_active":"2024-09-12T12:15:28.991715+0000","last_peered":"2024-09-12T12:15:28.991715+0000","last_clean":"2024-09-12T12:15:28.991715+0000","last_became_active":"2024-09-12T12:15:28.990126+0000","last_became_peered":"2024-09-12T12:15:28.990126+0000","last_unstale":"2024-09-12T12:15:28.991715+0000","last_undegraded":"2024-09-12T12:15:28.991715+0000","last_fullsized":"2024-09-12T12:15:28.991715+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:21:35.194737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975521+0000","last_change":"2024-09-12T12:15:28.975521+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975521+0000","last_undegraded":"2024-09-12T12:15:28.975521+0000","last_fullsized":"2024-09-12T12:15:28.975521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.982480+0000","last_change":"2024-09-12T12:15:28.977317+0000","last_active":"2024-09-12T12:15:28.982480+0000","last_peered":"2024-09-12T12:15:28.982480+0000","last_clean":"2024-09-12T12:15:28.982480+0000","last_became_active":"2024-09-12T12:15:28.976850+0000","last_became_peered":"2024-09-12T12:15:28.976850+0000","last_unstale":"2024-09-12T12:15:28.982480+0000","last_undegraded":"2024-09-12T12:15:28.982480+0000","last_fullsized":"2024-09-12T12:15:28.982480+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:03.704773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978375+0000","last_change":"2024-09-12T12:15:28.978375+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978375+0000","last_undegraded":"2024-09-12T12:15:28.978375+0000","last_fullsized":"2024-09-12T12:15:28.978375+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.989843+0000","last_change":"2024-09-12T12:15:28.984535+0000","last_active":"2024-09-12T12:15:28.989843+0000","last_peered":"2024-09-12T12:15:28.989843+0000","last_clean":"2024-09-12T12:15:28.989843+0000","last_became_active":"2024-09-12T12:15:28.984229+0000","last_became_peered":"2024-09-12T12:15:28.984229+0000","last_unstale":"2024-09-12T12:15:28.989843+0000","last_undegraded":"2024-09-12T12:15:28.989843+0000","last_fullsized":"2024-09-12T12:15:28.989843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:48.415139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974758+0000","last_change":"2024-09-12T12:15:28.974758+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974758+0000","last_undegraded":"2024-09-12T12:15:28.974758+0000","last_fullsized":"2024-09-12T12:15:28.974758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.983192+0000","last_change":"2024-09-12T12:15:28.979840+0000","last_active":"2024-09-12T12:15:28.983192+0000","last_peered":"2024-09-12T12:15:28.983192+0000","last_clean":"2024-09-12T12:15:28.983192+0000","last_became_active":"2024-09-12T12:15:28.979629+0000","last_became_peered":"2024-09-12T12:15:28.979629+0000","last_unstale":"2024-09-12T12:15:28.983192+0000","last_undegraded":"2024-09-12T12:15:28.983192+0000","last_fullsized":"2024-09-12T12:15:28.983192+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:59.726786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.967481+0000","last_change":"2024-09-12T12:15:28.967481+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.967481+0000","last_undegraded":"2024-09-12T12:15:28.967481+0000","last_fullsized":"2024-09-12T12:15:28.967481+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.990057+0000","last_change":"2024-09-12T12:15:28.985794+0000","last_active":"2024-09-12T12:15:28.990057+0000","last_peered":"2024-09-12T12:15:28.990057+0000","last_clean":"2024-09-12T12:15:28.990057+0000","last_became_active":"2024-09-12T12:15:28.985514+0000","last_became_peered":"2024-09-12T12:15:28.985514+0000","last_unstale":"2024-09-12T12:15:28.990057+0000","last_undegraded":"2024-09-12T12:15:28.990057+0000","last_fullsized":"2024-09-12T12:15:28.990057+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:54.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974174+0000","last_change":"2024-09-12T12:15:28.974174+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974174+0000","last_undegraded":"2024-09-12T12:15:28.974174+0000","last_fullsized":"2024-09-12T12:15:28.974174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.984464+0000","last_change":"2024-09-12T12:15:28.981586+0000","last_active":"2024-09-12T12:15:28.984464+0000","last_peered":"2024-09-12T12:15:28.984464+0000","last_clean":"2024-09-12T12:15:28.984464+0000","last_became_active":"2024-09-12T12:15:28.981224+0000","last_became_peered":"2024-09-12T12:15:28.981224+0000","last_unstale":"2024-09-12T12:15:28.984464+0000","last_undegraded":"2024-09-12T12:15:28.984464+0000","last_fullsized":"2024-09-12T12:15:28.984464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:16.354264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974291+0000","last_change":"2024-09-12T12:15:28.974291+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974291+0000","last_undegraded":"2024-09-12T12:15:28.974291+0000","last_fullsized":"2024-09-12T12:15:28.974291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995764+0000","last_change":"2024-09-12T12:15:28.995320+0000","last_active":"2024-09-12T12:15:28.995764+0000","last_peered":"2024-09-12T12:15:28.995764+0000","last_clean":"2024-09-12T12:15:28.995764+0000","last_became_active":"2024-09-12T12:15:28.995054+0000","last_became_peered":"2024-09-12T12:15:28.995054+0000","last_unstale":"2024-09-12T12:15:28.995764+0000","last_undegraded":"2024-09-12T12:15:28.995764+0000","last_fullsized":"2024-09-12T12:15:28.995764+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:42.335476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968437+0000","last_change":"2024-09-12T12:15:28.968437+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968437+0000","last_undegraded":"2024-09-12T12:15:28.968437+0000","last_fullsized":"2024-09-12T12:15:28.968437+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999562+0000","last_change":"2024-09-12T12:15:28.996444+0000","last_active":"2024-09-12T12:15:28.999562+0000","last_peered":"2024-09-12T12:15:28.999562+0000","last_clean":"2024-09-12T12:15:28.999562+0000","last_became_active":"2024-09-12T12:15:28.996157+0000","last_became_peered":"2024-09-12T12:15:28.996157+0000","last_unstale":"2024-09-12T12:15:28.999562+0000","last_undegraded":"2024-09-12T12:15:28.999562+0000","last_fullsized":"2024-09-12T12:15:28.999562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:12.067885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.977148+0000","last_change":"2024-09-12T12:15:28.977148+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.977148+0000","last_undegraded":"2024-09-12T12:15:28.977148+0000","last_fullsized":"2024-09-12T12:15:28.977148+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991363+0000","last_change":"2024-09-12T12:15:28.986459+0000","last_active":"2024-09-12T12:15:28.991363+0000","last_peered":"2024-09-12T12:15:28.991363+0000","last_clean":"2024-09-12T12:15:28.991363+0000","last_became_active":"2024-09-12T12:15:28.986199+0000","last_became_peered":"2024-09-12T12:15:28.986199+0000","last_unstale":"2024-09-12T12:15:28.991363+0000","last_undegraded":"2024-09-12T12:15:28.991363+0000","last_fullsized":"2024-09-12T12:15:28.991363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:37.265570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978210+0000","last_change":"2024-09-12T12:15:28.978210+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978210+0000","last_undegraded":"2024-09-12T12:15:28.978210+0000","last_fullsized":"2024-09-12T12:15:28.978210+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.985055+0000","last_change":"2024-09-12T12:15:28.981615+0000","last_active":"2024-09-12T12:15:28.985055+0000","last_peered":"2024-09-12T12:15:28.985055+0000","last_clean":"2024-09-12T12:15:28.985055+0000","last_became_active":"2024-09-12T12:15:28.981365+0000","last_became_peered":"2024-09-12T12:15:28.981365+0000","last_unstale":"2024-09-12T12:15:28.985055+0000","last_undegraded":"2024-09-12T12:15:28.985055+0000","last_fullsized":"2024-09-12T12:15:28.985055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:55.218821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978872+0000","last_change":"2024-09-12T12:15:28.978872+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978872+0000","last_undegraded":"2024-09-12T12:15:28.978872+0000","last_fullsized":"2024-09-12T12:15:28.978872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.990129+0000","last_change":"2024-09-12T12:15:28.986783+0000","last_active":"2024-09-12T12:15:28.990129+0000","last_peered":"2024-09-12T12:15:28.990129+0000","last_clean":"2024-09-12T12:15:28.990129+0000","last_became_active":"2024-09-12T12:15:28.985415+0000","last_became_peered":"2024-09-12T12:15:28.985415+0000","last_unstale":"2024-09-12T12:15:28.990129+0000","last_undegraded":"2024-09-12T12:15:28.990129+0000","last_fullsized":"2024-09-12T12:15:28.990129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:08.684180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976524+0000","last_change":"2024-09-12T12:15:28.976524+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976524+0000","last_undegraded":"2024-09-12T12:15:28.976524+0000","last_fullsized":"2024-09-12T12:15:28.976524+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999316+0000","last_change":"2024-09-12T12:15:28.993668+0000","last_active":"2024-09-12T12:15:28.999316+0000","last_peered":"2024-09-12T12:15:28.999316+0000","last_clean":"2024-09-12T12:15:28.999316+0000","last_became_active":"2024-09-12T12:15:28.993395+0000","last_became_peered":"2024-09-12T12:15:28.993395+0000","last_unstale":"2024-09-12T12:15:28.999316+0000","last_undegraded":"2024-09-12T12:15:28.999316+0000","last_fullsized":"2024-09-12T12:15:28.999316+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.299252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973934+0000","last_change":"2024-09-12T12:15:28.973934+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973934+0000","last_undegraded":"2024-09-12T12:15:28.973934+0000","last_fullsized":"2024-09-12T12:15:28.973934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:29.000351+0000","last_change":"2024-09-12T12:15:28.999035+0000","last_active":"2024-09-12T12:15:29.000351+0000","last_peered":"2024-09-12T12:15:29.000351+0000","last_clean":"2024-09-12T12:15:29.000351+0000","last_became_active":"2024-09-12T12:15:28.998733+0000","last_became_peered":"2024-09-12T12:15:28.998733+0000","last_unstale":"2024-09-12T12:15:29.000351+0000","last_undegraded":"2024-09-12T12:15:29.000351+0000","last_fullsized":"2024-09-12T12:15:29.000351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:48.389471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976117+0000","last_change":"2024-09-12T12:15:28.976117+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976117+0000","last_undegraded":"2024-09-12T12:15:28.976117+0000","last_fullsized":"2024-09-12T12:15:28.976117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.989053+0000","last_change":"2024-09-12T12:15:28.988145+0000","last_active":"2024-09-12T12:15:28.989053+0000","last_peered":"2024-09-12T12:15:28.989053+0000","last_clean":"2024-09-12T12:15:28.989053+0000","last_became_active":"2024-09-12T12:15:28.987869+0000","last_became_peered":"2024-09-12T12:15:28.987869+0000","last_unstale":"2024-09-12T12:15:28.989053+0000","last_undegraded":"2024-09-12T12:15:28.989053+0000","last_fullsized":"2024-09-12T12:15:28.989053+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:34.475461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.967879+0000","last_change":"2024-09-12T12:15:28.967879+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.967879+0000","last_undegraded":"2024-09-12T12:15:28.967879+0000","last_fullsized":"2024-09-12T12:15:28.967879+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995394+0000","last_change":"2024-09-12T12:15:28.991659+0000","last_active":"2024-09-12T12:15:28.995394+0000","last_peered":"2024-09-12T12:15:28.995394+0000","last_clean":"2024-09-12T12:15:28.995394+0000","last_became_active":"2024-09-12T12:15:28.991363+0000","last_became_peered":"2024-09-12T12:15:28.991363+0000","last_unstale":"2024-09-12T12:15:28.995394+0000","last_undegraded":"2024-09-12T12:15:28.995394+0000","last_fullsized":"2024-09-12T12:15:28.995394+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:03.704773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975991+0000","last_change":"2024-09-12T12:15:28.975991+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975991+0000","last_undegraded":"2024-09-12T12:15:28.975991+0000","last_fullsized":"2024-09-12T12:15:28.975991+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.998050+0000","last_change":"2024-09-12T12:15:28.997415+0000","last_active":"2024-09-12T12:15:28.998050+0000","last_peered":"2024-09-12T12:15:28.998050+0000","last_clean":"2024-09-12T12:15:28.998050+0000","last_became_active":"2024-09-12T12:15:28.997122+0000","last_became_peered":"2024-09-12T12:15:28.997122+0000","last_unstale":"2024-09-12T12:15:28.998050+0000","last_undegraded":"2024-09-12T12:15:28.998050+0000","last_fullsized":"2024-09-12T12:15:28.998050+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:16.354264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973990+0000","last_change":"2024-09-12T12:15:28.973990+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973990+0000","last_undegraded":"2024-09-12T12:15:28.973990+0000","last_fullsized":"2024-09-12T12:15:28.973990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995387+0000","last_change":"2024-09-12T12:15:28.991547+0000","last_active":"2024-09-12T12:15:28.995387+0000","last_peered":"2024-09-12T12:15:28.995387+0000","last_clean":"2024-09-12T12:15:28.995387+0000","last_became_active":"2024-09-12T12:15:28.988510+0000","last_became_peered":"2024-09-12T12:15:28.988510+0000","last_unstale":"2024-09-12T12:15:28.995387+0000","last_undegraded":"2024-09-12T12:15:28.995387+0000","last_fullsized":"2024-09-12T12:15:28.995387+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:16.354264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.971314+0000","last_change":"2024-09-12T12:15:28.971314+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.971314+0000","last_undegraded":"2024-09-12T12:15:28.971314+0000","last_fullsized":"2024-09-12T12:15:28.971314+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999559+0000","last_change":"2024-09-12T12:15:28.995461+0000","last_active":"2024-09-12T12:15:28.999559+0000","last_peered":"2024-09-12T12:15:28.999559+0000","last_clean":"2024-09-12T12:15:28.999559+0000","last_became_active":"2024-09-12T12:15:28.995166+0000","last_became_peered":"2024-09-12T12:15:28.995166+0000","last_unstale":"2024-09-12T12:15:28.999559+0000","last_undegraded":"2024-09-12T12:15:28.999559+0000","last_fullsized":"2024-09-12T12:15:28.999559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:14.812799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973696+0000","last_change":"2024-09-12T12:15:28.973696+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973696+0000","last_undegraded":"2024-09-12T12:15:28.973696+0000","last_fullsized":"2024-09-12T12:15:28.973696+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995084+0000","last_change":"2024-09-12T12:15:28.993720+0000","last_active":"2024-09-12T12:15:28.995084+0000","last_peered":"2024-09-12T12:15:28.995084+0000","last_clean":"2024-09-12T12:15:28.995084+0000","last_became_active":"2024-09-12T12:15:28.993434+0000","last_became_peered":"2024-09-12T12:15:28.993434+0000","last_unstale":"2024-09-12T12:15:28.995084+0000","last_undegraded":"2024-09-12T12:15:28.995084+0000","last_fullsized":"2024-09-12T12:15:28.995084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:33.220369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978838+0000","last_change":"2024-09-12T12:15:28.978838+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978838+0000","last_undegraded":"2024-09-12T12:15:28.978838+0000","last_fullsized":"2024-09-12T12:15:28.978838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991881+0000","last_change":"2024-09-12T12:15:28.989717+0000","last_active":"2024-09-12T12:15:28.991881+0000","last_peered":"2024-09-12T12:15:28.991881+0000","last_clean":"2024-09-12T12:15:28.991881+0000","last_became_active":"2024-09-12T12:15:28.989405+0000","last_became_peered":"2024-09-12T12:15:28.989405+0000","last_unstale":"2024-09-12T12:15:28.991881+0000","last_undegraded":"2024-09-12T12:15:28.991881+0000","last_fullsized":"2024-09-12T12:15:28.991881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:35.417617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972482+0000","last_change":"2024-09-12T12:15:28.972482+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972482+0000","last_undegraded":"2024-09-12T12:15:28.972482+0000","last_fullsized":"2024-09-12T12:15:28.972482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.987402+0000","last_change":"2024-09-12T12:15:28.983057+0000","last_active":"2024-09-12T12:15:28.987402+0000","last_peered":"2024-09-12T12:15:28.987402+0000","last_clean":"2024-09-12T12:15:28.987402+0000","last_became_active":"2024-09-12T12:15:28.982770+0000","last_became_peered":"2024-09-12T12:15:28.982770+0000","last_unstale":"2024-09-12T12:15:28.987402+0000","last_undegraded":"2024-09-12T12:15:28.987402+0000","last_fullsized":"2024-09-12T12:15:28.987402+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:36.053548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978638+0000","last_change":"2024-09-12T12:15:28.978638+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978638+0000","last_undegraded":"2024-09-12T12:15:28.978638+0000","last_fullsized":"2024-09-12T12:15:28.978638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.990539+0000","last_change":"2024-09-12T12:15:28.989675+0000","last_active":"2024-09-12T12:15:28.990539+0000","last_peered":"2024-09-12T12:15:28.990539+0000","last_clean":"2024-09-12T12:15:28.990539+0000","last_became_active":"2024-09-12T12:15:28.989383+0000","last_became_peered":"2024-09-12T12:15:28.989383+0000","last_unstale":"2024-09-12T12:15:28.990539+0000","last_undegraded":"2024-09-12T12:15:28.990539+0000","last_fullsized":"2024-09-12T12:15:28.990539+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:25.049563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978897+0000","last_change":"2024-09-12T12:15:28.978897+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978897+0000","last_undegraded":"2024-09-12T12:15:28.978897+0000","last_fullsized":"2024-09-12T12:15:28.978897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.989851+0000","last_change":"2024-09-12T12:15:28.982400+0000","last_active":"2024-09-12T12:15:28.989851+0000","last_peered":"2024-09-12T12:15:28.989851+0000","last_clean":"2024-09-12T12:15:28.989851+0000","last_became_active":"2024-09-12T12:15:28.982103+0000","last_became_peered":"2024-09-12T12:15:28.982103+0000","last_unstale":"2024-09-12T12:15:28.989851+0000","last_undegraded":"2024-09-12T12:15:28.989851+0000","last_fullsized":"2024-09-12T12:15:28.989851+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:37.433511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973816+0000","last_change":"2024-09-12T12:15:28.973816+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973816+0000","last_undegraded":"2024-09-12T12:15:28.973816+0000","last_fullsized":"2024-09-12T12:15:28.973816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999485+0000","last_change":"2024-09-12T12:15:28.995466+0000","last_active":"2024-09-12T12:15:28.999485+0000","last_peered":"2024-09-12T12:15:28.999485+0000","last_clean":"2024-09-12T12:15:28.999485+0000","last_became_active":"2024-09-12T12:15:28.995180+0000","last_became_peered":"2024-09-12T12:15:28.995180+0000","last_unstale":"2024-09-12T12:15:28.999485+0000","last_undegraded":"2024-09-12T12:15:28.999485+0000","last_fullsized":"2024-09-12T12:15:28.999485+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:56.407792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973975+0000","last_change":"2024-09-12T12:15:28.973975+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973975+0000","last_undegraded":"2024-09-12T12:15:28.973975+0000","last_fullsized":"2024-09-12T12:15:28.973975+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:29.000477+0000","last_change":"2024-09-12T12:15:28.997623+0000","last_active":"2024-09-12T12:15:29.000477+0000","last_peered":"2024-09-12T12:15:29.000477+0000","last_clean":"2024-09-12T12:15:29.000477+0000","last_became_active":"2024-09-12T12:15:28.997361+0000","last_became_peered":"2024-09-12T12:15:28.997361+0000","last_unstale":"2024-09-12T12:15:29.000477+0000","last_undegraded":"2024-09-12T12:15:29.000477+0000","last_fullsized":"2024-09-12T12:15:29.000477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:36.747728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974230+0000","last_change":"2024-09-12T12:15:28.974230+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974230+0000","last_undegraded":"2024-09-12T12:15:28.974230+0000","last_fullsized":"2024-09-12T12:15:28.974230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.998055+0000","last_change":"2024-09-12T12:15:28.997529+0000","last_active":"2024-09-12T12:15:28.998055+0000","last_peered":"2024-09-12T12:15:28.998055+0000","last_clean":"2024-09-12T12:15:28.998055+0000","last_became_active":"2024-09-12T12:15:28.997217+0000","last_became_peered":"2024-09-12T12:15:28.997217+0000","last_unstale":"2024-09-12T12:15:28.998055+0000","last_undegraded":"2024-09-12T12:15:28.998055+0000","last_fullsized":"2024-09-12T12:15:28.998055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:48.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979412+0000","last_change":"2024-09-12T12:15:28.979412+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979412+0000","last_undegraded":"2024-09-12T12:15:28.979412+0000","last_fullsized":"2024-09-12T12:15:28.979412+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995298+0000","last_change":"2024-09-12T12:15:28.991866+0000","last_active":"2024-09-12T12:15:28.995298+0000","last_peered":"2024-09-12T12:15:28.995298+0000","last_clean":"2024-09-12T12:15:28.995298+0000","last_became_active":"2024-09-12T12:15:28.991562+0000","last_became_peered":"2024-09-12T12:15:28.991562+0000","last_unstale":"2024-09-12T12:15:28.995298+0000","last_undegraded":"2024-09-12T12:15:28.995298+0000","last_fullsized":"2024-09-12T12:15:28.995298+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.299252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968076+0000","last_change":"2024-09-12T12:15:28.968076+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968076+0000","last_undegraded":"2024-09-12T12:15:28.968076+0000","last_fullsized":"2024-09-12T12:15:28.968076+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991328+0000","last_change":"2024-09-12T12:15:28.985626+0000","last_active":"2024-09-12T12:15:28.991328+0000","last_peered":"2024-09-12T12:15:28.991328+0000","last_clean":"2024-09-12T12:15:28.991328+0000","last_became_active":"2024-09-12T12:15:28.985369+0000","last_became_peered":"2024-09-12T12:15:28.985369+0000","last_unstale":"2024-09-12T12:15:28.991328+0000","last_undegraded":"2024-09-12T12:15:28.991328+0000","last_fullsized":"2024-09-12T12:15:28.991328+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:41.313179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.978279+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:15:28.978279+0000","last_peered":"2024-09-12T12:15:28.978279+0000","last_clean":"2024-09-12T12:15:28.978279+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:15:28.978279+0000","last_undegraded":"2024-09-12T12:15:28.978279+0000","last_fullsized":"2024-09-12T12:15:28.978279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36540,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335300,"statfs":{"total":96636764160,"available":96599347200,"internally_reserved":0,"allocated":1212416,"data_stored":864691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35956,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335884,"statfs":{"total":96636764160,"available":96599945216,"internally_reserved":0,"allocated":618496,"data_stored":274323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36532,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335308,"statfs":{"total":96636764160,"available":96599355392,"internally_reserved":0,"allocated":1212416,"data_stored":864691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:15:34.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:15:34.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.991+0000 7fc4a3400640 1 Processor -- start 2024-09-12T12:15:34.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.991+0000 7fc4a3400640 1 -- start start 2024-09-12T12:15:34.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc49c15b4e0 0x7fc49c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a3400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc49c0b3ad0 0x7fc49c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a3400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c071960 0x7fc49c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a3400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc49c0b45a0 con 0x7fc49c15b4e0 2024-09-12T12:15:34.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a3400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc49c0b3fe0 con 0x7fc49c0b3ad0 2024-09-12T12:15:34.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a3400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc49c0b42c0 con 0x7fc49c071960 2024-09-12T12:15:34.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc49c15b4e0 0x7fc49c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc49c15b4e0 0x7fc49c0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52658/0 (socket says 172.21.15.144:52658) 2024-09-12T12:15:34.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a0a00640 1 -- 172.21.15.144:0/3547154445 learned_addr learned my addr 172.21.15.144:0/3547154445 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:34.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a1400640 1 --2- 172.21.15.144:0/3547154445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c071960 0x7fc49c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc49be00640 1 --2- 172.21.15.144:0/3547154445 >> v2:172.21.15.165:3300/0 conn(0x7fc49c0b3ad0 0x7fc49c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a0a00640 1 -- 172.21.15.144:0/3547154445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c071960 msgr2=0x7fc49c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:34.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a0a00640 1 --2- 172.21.15.144:0/3547154445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c071960 0x7fc49c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a0a00640 1 -- 172.21.15.144:0/3547154445 >> v2:172.21.15.165:3300/0 conn(0x7fc49c0b3ad0 msgr2=0x7fc49c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:34.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a0a00640 1 --2- 172.21.15.144:0/3547154445 >> v2:172.21.15.165:3300/0 conn(0x7fc49c0b3ad0 0x7fc49c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.995+0000 7fc4a0a00640 1 -- 172.21.15.144:0/3547154445 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49c0b1490 con 0x7fc49c15b4e0 2024-09-12T12:15:34.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a0a00640 1 --2- 172.21.15.144:0/3547154445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c15b4e0 0x7fc49c0b3590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0b02b0 tx=0x7fc48c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c53694d5f06e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc49b400640 1 -- 172.21.15.144:0/3547154445 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0a5750 con 0x7fc49c15b4e0 2024-09-12T12:15:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc49b400640 1 -- 172.21.15.144:0/3547154445 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c0a58f0 con 0x7fc49c15b4e0 2024-09-12T12:15:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc49b400640 1 -- 172.21.15.144:0/3547154445 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0a5cc0 con 0x7fc49c15b4e0 2024-09-12T12:15:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 -- 172.21.15.144:0/3547154445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c15b4e0 msgr2=0x7fc49c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 --2- 172.21.15.144:0/3547154445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c15b4e0 0x7fc49c0b3590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0b02b0 tx=0x7fc48c01c9c0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 -- 172.21.15.144:0/3547154445 shutdown_connections 2024-09-12T12:15:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 --2- 172.21.15.144:0/3547154445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c071960 0x7fc49c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 --2- 172.21.15.144:0/3547154445 >> v2:172.21.15.165:3300/0 conn(0x7fc49c0b3ad0 0x7fc49c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 --2- 172.21.15.144:0/3547154445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c15b4e0 0x7fc49c0b3590 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 -- 172.21.15.144:0/3547154445 >> 172.21.15.144:0/3547154445 conn(0x7fc49c06d0d0 msgr2=0x7fc49c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:35.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 -- 172.21.15.144:0/3547154445 shutdown_connections 2024-09-12T12:15:35.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 -- 172.21.15.144:0/3547154445 wait complete. 2024-09-12T12:15:35.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 Processor -- start 2024-09-12T12:15:35.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 -- start start 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c071960 0x7fc49c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc49c0b3ad0 0x7fc49c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c15b4e0 0x7fc49c072320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c15f270 con 0x7fc49c071960 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c15f0f0 con 0x7fc49c0b3ad0 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a3400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc49c15f3f0 con 0x7fc49c15b4e0 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c071960 0x7fc49c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:34.999+0000 7fc4a0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c071960 0x7fc49c14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52664/0 (socket says 172.21.15.144:52664) 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a0a00640 1 -- 172.21.15.144:0/429677363 learned_addr learned my addr 172.21.15.144:0/429677363 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:35.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc49be00640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc49c0b3ad0 0x7fc49c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a1400640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c15b4e0 0x7fc49c072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a0a00640 1 -- 172.21.15.144:0/429677363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c15b4e0 msgr2=0x7fc49c072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a0a00640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c15b4e0 0x7fc49c072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a0a00640 1 -- 172.21.15.144:0/429677363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc49c0b3ad0 msgr2=0x7fc49c1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a0a00640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc49c0b3ad0 0x7fc49c1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a0a00640 1 -- 172.21.15.144:0/429677363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49c154b60 con 0x7fc49c071960 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a0a00640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c071960 0x7fc49c14fa90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0af040 tx=0x7fc48c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc498c00640 1 -- 172.21.15.144:0/429677363 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0bc020 con 0x7fc49c071960 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc498c00640 1 -- 172.21.15.144:0/429677363 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48c0b86b0 con 0x7fc49c071960 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49c15cda0 con 0x7fc49c071960 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc498c00640 1 -- 172.21.15.144:0/429677363 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0b8aa0 con 0x7fc49c071960 2024-09-12T12:15:35.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc49c15d360 con 0x7fc49c071960 2024-09-12T12:15:35.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc49c071420 con 0x7fc49c071960 2024-09-12T12:15:35.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.003+0000 7fc498c00640 1 -- 172.21.15.144:0/429677363 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc48c0bf020 con 0x7fc49c071960 2024-09-12T12:15:35.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.007+0000 7fc498c00640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc47c0678c0 0x7fc47c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.007+0000 7fc498c00640 1 -- 172.21.15.144:0/429677363 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc48c120a30 con 0x7fc49c071960 2024-09-12T12:15:35.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.007+0000 7fc49be00640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc47c0678c0 0x7fc47c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.007+0000 7fc49be00640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc47c0678c0 0x7fc47c069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0736f0 tx=0x7fc488008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:35.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.011+0000 7fc498c00640 1 -- 172.21.15.144:0/429677363 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc48c0c6070 con 0x7fc49c071960 2024-09-12T12:15:35.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.167+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc49c071e00 con 0x7fc47c0678c0 2024-09-12T12:15:35.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.171+0000 7fc498c00640 1 -- 172.21.15.144:0/429677363 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7fc49c071e00 con 0x7fc47c0678c0 2024-09-12T12:15:35.177 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:35.179 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc47c0678c0 msgr2=0x7fc47c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc47c0678c0 0x7fc47c069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0736f0 tx=0x7fc488008040 comp rx=0 tx=0).stop 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c071960 msgr2=0x7fc49c14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c071960 0x7fc49c14fa90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0af040 tx=0x7fc48c019760 comp rx=0 tx=0).stop 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 shutdown_connections 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc47c0678c0 0x7fc47c069d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc49c15b4e0 0x7fc49c072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc49c0b3ad0 0x7fc49c1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 --2- 172.21.15.144:0/429677363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc49c071960 0x7fc49c14fa90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 >> 172.21.15.144:0/429677363 conn(0x7fc49c06d0d0 msgr2=0x7fc49c15a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:35.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 shutdown_connections 2024-09-12T12:15:35.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.175+0000 7fc4a3400640 1 -- 172.21.15.144:0/429677363 wait complete. 2024-09-12T12:15:35.198 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-12T12:15:33.410812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284588,"kb_used_data":5932,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754690132,"statfs":{"total":773094113280,"available":772802695168,"internally_reserved":0,"allocated":6074368,"data_stored":3341985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.446495"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.982087+0000","last_change":"2024-09-12T12:15:28.982087+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.982087+0000","last_undegraded":"2024-09-12T12:15:28.982087+0000","last_fullsized":"2024-09-12T12:15:28.982087+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975202+0000","last_change":"2024-09-12T12:15:28.975202+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975202+0000","last_undegraded":"2024-09-12T12:15:28.975202+0000","last_fullsized":"2024-09-12T12:15:28.975202+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979129+0000","last_change":"2024-09-12T12:15:28.979129+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979129+0000","last_undegraded":"2024-09-12T12:15:28.979129+0000","last_fullsized":"2024-09-12T12:15:28.979129+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974814+0000","last_change":"2024-09-12T12:15:28.974814+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974814+0000","last_undegraded":"2024-09-12T12:15:28.974814+0000","last_fullsized":"2024-09-12T12:15:28.974814+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968941+0000","last_change":"2024-09-12T12:15:28.968941+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968941+0000","last_undegraded":"2024-09-12T12:15:28.968941+0000","last_fullsized":"2024-09-12T12:15:28.968941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.985779+0000","last_change":"2024-09-12T12:15:28.985779+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.985779+0000","last_undegraded":"2024-09-12T12:15:28.985779+0000","last_fullsized":"2024-09-12T12:15:28.985779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975376+0000","last_change":"2024-09-12T12:15:28.975376+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975376+0000","last_undegraded":"2024-09-12T12:15:28.975376+0000","last_fullsized":"2024-09-12T12:15:28.975376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974468+0000","last_change":"2024-09-12T12:15:28.974468+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974468+0000","last_undegraded":"2024-09-12T12:15:28.974468+0000","last_fullsized":"2024-09-12T12:15:28.974468+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979809+0000","last_change":"2024-09-12T12:15:28.979809+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979809+0000","last_undegraded":"2024-09-12T12:15:28.979809+0000","last_fullsized":"2024-09-12T12:15:28.979809+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.980816+0000","last_change":"2024-09-12T12:15:28.980816+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.980816+0000","last_undegraded":"2024-09-12T12:15:28.980816+0000","last_fullsized":"2024-09-12T12:15:28.980816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972226+0000","last_change":"2024-09-12T12:15:28.972226+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972226+0000","last_undegraded":"2024-09-12T12:15:28.972226+0000","last_fullsized":"2024-09-12T12:15:28.972226+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.984796+0000","last_change":"2024-09-12T12:15:28.984796+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.984796+0000","last_undegraded":"2024-09-12T12:15:28.984796+0000","last_fullsized":"2024-09-12T12:15:28.984796+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.980928+0000","last_change":"2024-09-12T12:15:28.980928+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.980928+0000","last_undegraded":"2024-09-12T12:15:28.980928+0000","last_fullsized":"2024-09-12T12:15:28.980928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974762+0000","last_change":"2024-09-12T12:15:28.974762+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974762+0000","last_undegraded":"2024-09-12T12:15:28.974762+0000","last_fullsized":"2024-09-12T12:15:28.974762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975198+0000","last_change":"2024-09-12T12:15:28.975198+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975198+0000","last_undegraded":"2024-09-12T12:15:28.975198+0000","last_fullsized":"2024-09-12T12:15:28.975198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.985280+0000","last_change":"2024-09-12T12:15:28.985280+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.985280+0000","last_undegraded":"2024-09-12T12:15:28.985280+0000","last_fullsized":"2024-09-12T12:15:28.985280+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.977272+0000","last_change":"2024-09-12T12:15:28.977272+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.977272+0000","last_undegraded":"2024-09-12T12:15:28.977272+0000","last_fullsized":"2024-09-12T12:15:28.977272+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974681+0000","last_change":"2024-09-12T12:15:28.974681+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974681+0000","last_undegraded":"2024-09-12T12:15:28.974681+0000","last_fullsized":"2024-09-12T12:15:28.974681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978637+0000","last_change":"2024-09-12T12:15:28.978637+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978637+0000","last_undegraded":"2024-09-12T12:15:28.978637+0000","last_fullsized":"2024-09-12T12:15:28.978637+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.969488+0000","last_change":"2024-09-12T12:15:28.969488+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.969488+0000","last_undegraded":"2024-09-12T12:15:28.969488+0000","last_fullsized":"2024-09-12T12:15:28.969488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968688+0000","last_change":"2024-09-12T12:15:28.968688+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968688+0000","last_undegraded":"2024-09-12T12:15:28.968688+0000","last_fullsized":"2024-09-12T12:15:28.968688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976107+0000","last_change":"2024-09-12T12:15:28.976107+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976107+0000","last_undegraded":"2024-09-12T12:15:28.976107+0000","last_fullsized":"2024-09-12T12:15:28.976107+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973240+0000","last_change":"2024-09-12T12:15:28.973240+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973240+0000","last_undegraded":"2024-09-12T12:15:28.973240+0000","last_fullsized":"2024-09-12T12:15:28.973240+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974545+0000","last_change":"2024-09-12T12:15:28.974545+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974545+0000","last_undegraded":"2024-09-12T12:15:28.974545+0000","last_fullsized":"2024-09-12T12:15:28.974545+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976913+0000","last_change":"2024-09-12T12:15:28.976913+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976913+0000","last_undegraded":"2024-09-12T12:15:28.976913+0000","last_fullsized":"2024-09-12T12:15:28.976913+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979335+0000","last_change":"2024-09-12T12:15:28.979335+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979335+0000","last_undegraded":"2024-09-12T12:15:28.979335+0000","last_fullsized":"2024-09-12T12:15:28.979335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979959+0000","last_change":"2024-09-12T12:15:28.979959+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979959+0000","last_undegraded":"2024-09-12T12:15:28.979959+0000","last_fullsized":"2024-09-12T12:15:28.979959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.969106+0000","last_change":"2024-09-12T12:15:28.969106+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.969106+0000","last_undegraded":"2024-09-12T12:15:28.969106+0000","last_fullsized":"2024-09-12T12:15:28.969106+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976144+0000","last_change":"2024-09-12T12:15:28.976144+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976144+0000","last_undegraded":"2024-09-12T12:15:28.976144+0000","last_fullsized":"2024-09-12T12:15:28.976144+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972855+0000","last_change":"2024-09-12T12:15:28.972855+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972855+0000","last_undegraded":"2024-09-12T12:15:28.972855+0000","last_fullsized":"2024-09-12T12:15:28.972855+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974999+0000","last_change":"2024-09-12T12:15:28.974999+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974999+0000","last_undegraded":"2024-09-12T12:15:28.974999+0000","last_fullsized":"2024-09-12T12:15:28.974999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973589+0000","last_change":"2024-09-12T12:15:28.973589+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973589+0000","last_undegraded":"2024-09-12T12:15:28.973589+0000","last_fullsized":"2024-09-12T12:15:28.973589+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975179+0000","last_change":"2024-09-12T12:15:28.975179+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975179+0000","last_undegraded":"2024-09-12T12:15:28.975179+0000","last_fullsized":"2024-09-12T12:15:28.975179+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.978950+0000","last_change":"2024-09-12T12:15:28.973024+0000","last_active":"2024-09-12T12:15:28.978950+0000","last_peered":"2024-09-12T12:15:28.978950+0000","last_clean":"2024-09-12T12:15:28.978950+0000","last_became_active":"2024-09-12T12:15:28.972768+0000","last_became_peered":"2024-09-12T12:15:28.972768+0000","last_unstale":"2024-09-12T12:15:28.978950+0000","last_undegraded":"2024-09-12T12:15:28.978950+0000","last_fullsized":"2024-09-12T12:15:28.978950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:20.788321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972453+0000","last_change":"2024-09-12T12:15:28.972453+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972453+0000","last_undegraded":"2024-09-12T12:15:28.972453+0000","last_fullsized":"2024-09-12T12:15:28.972453+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:29.000857+0000","last_change":"2024-09-12T12:15:28.997846+0000","last_active":"2024-09-12T12:15:29.000857+0000","last_peered":"2024-09-12T12:15:29.000857+0000","last_clean":"2024-09-12T12:15:29.000857+0000","last_became_active":"2024-09-12T12:15:28.997572+0000","last_became_peered":"2024-09-12T12:15:28.997572+0000","last_unstale":"2024-09-12T12:15:29.000857+0000","last_undegraded":"2024-09-12T12:15:29.000857+0000","last_fullsized":"2024-09-12T12:15:29.000857+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:48.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968180+0000","last_change":"2024-09-12T12:15:28.968180+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968180+0000","last_undegraded":"2024-09-12T12:15:28.968180+0000","last_fullsized":"2024-09-12T12:15:28.968180+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991779+0000","last_change":"2024-09-12T12:15:28.980175+0000","last_active":"2024-09-12T12:15:28.991779+0000","last_peered":"2024-09-12T12:15:28.991779+0000","last_clean":"2024-09-12T12:15:28.991779+0000","last_became_active":"2024-09-12T12:15:28.979558+0000","last_became_peered":"2024-09-12T12:15:28.979558+0000","last_unstale":"2024-09-12T12:15:28.991779+0000","last_undegraded":"2024-09-12T12:15:28.991779+0000","last_fullsized":"2024-09-12T12:15:28.991779+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:03.704773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.986270+0000","last_change":"2024-09-12T12:15:28.986270+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.986270+0000","last_undegraded":"2024-09-12T12:15:28.986270+0000","last_fullsized":"2024-09-12T12:15:28.986270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999428+0000","last_change":"2024-09-12T12:15:28.998874+0000","last_active":"2024-09-12T12:15:28.999428+0000","last_peered":"2024-09-12T12:15:28.999428+0000","last_clean":"2024-09-12T12:15:28.999428+0000","last_became_active":"2024-09-12T12:15:28.998570+0000","last_became_peered":"2024-09-12T12:15:28.998570+0000","last_unstale":"2024-09-12T12:15:28.999428+0000","last_undegraded":"2024-09-12T12:15:28.999428+0000","last_fullsized":"2024-09-12T12:15:28.999428+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:14.812799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968243+0000","last_change":"2024-09-12T12:15:28.968243+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968243+0000","last_undegraded":"2024-09-12T12:15:28.968243+0000","last_fullsized":"2024-09-12T12:15:28.968243+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991715+0000","last_change":"2024-09-12T12:15:28.990368+0000","last_active":"2024-09-12T12:15:28.991715+0000","last_peered":"2024-09-12T12:15:28.991715+0000","last_clean":"2024-09-12T12:15:28.991715+0000","last_became_active":"2024-09-12T12:15:28.990126+0000","last_became_peered":"2024-09-12T12:15:28.990126+0000","last_unstale":"2024-09-12T12:15:28.991715+0000","last_undegraded":"2024-09-12T12:15:28.991715+0000","last_fullsized":"2024-09-12T12:15:28.991715+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:21:35.194737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975521+0000","last_change":"2024-09-12T12:15:28.975521+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975521+0000","last_undegraded":"2024-09-12T12:15:28.975521+0000","last_fullsized":"2024-09-12T12:15:28.975521+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.982480+0000","last_change":"2024-09-12T12:15:28.977317+0000","last_active":"2024-09-12T12:15:28.982480+0000","last_peered":"2024-09-12T12:15:28.982480+0000","last_clean":"2024-09-12T12:15:28.982480+0000","last_became_active":"2024-09-12T12:15:28.976850+0000","last_became_peered":"2024-09-12T12:15:28.976850+0000","last_unstale":"2024-09-12T12:15:28.982480+0000","last_undegraded":"2024-09-12T12:15:28.982480+0000","last_fullsized":"2024-09-12T12:15:28.982480+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:03.704773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978375+0000","last_change":"2024-09-12T12:15:28.978375+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978375+0000","last_undegraded":"2024-09-12T12:15:28.978375+0000","last_fullsized":"2024-09-12T12:15:28.978375+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.989843+0000","last_change":"2024-09-12T12:15:28.984535+0000","last_active":"2024-09-12T12:15:28.989843+0000","last_peered":"2024-09-12T12:15:28.989843+0000","last_clean":"2024-09-12T12:15:28.989843+0000","last_became_active":"2024-09-12T12:15:28.984229+0000","last_became_peered":"2024-09-12T12:15:28.984229+0000","last_unstale":"2024-09-12T12:15:28.989843+0000","last_undegraded":"2024-09-12T12:15:28.989843+0000","last_fullsized":"2024-09-12T12:15:28.989843+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:48.415139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974758+0000","last_change":"2024-09-12T12:15:28.974758+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974758+0000","last_undegraded":"2024-09-12T12:15:28.974758+0000","last_fullsized":"2024-09-12T12:15:28.974758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.983192+0000","last_change":"2024-09-12T12:15:28.979840+0000","last_active":"2024-09-12T12:15:28.983192+0000","last_peered":"2024-09-12T12:15:28.983192+0000","last_clean":"2024-09-12T12:15:28.983192+0000","last_became_active":"2024-09-12T12:15:28.979629+0000","last_became_peered":"2024-09-12T12:15:28.979629+0000","last_unstale":"2024-09-12T12:15:28.983192+0000","last_undegraded":"2024-09-12T12:15:28.983192+0000","last_fullsized":"2024-09-12T12:15:28.983192+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:59.726786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.967481+0000","last_change":"2024-09-12T12:15:28.967481+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.967481+0000","last_undegraded":"2024-09-12T12:15:28.967481+0000","last_fullsized":"2024-09-12T12:15:28.967481+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.990057+0000","last_change":"2024-09-12T12:15:28.985794+0000","last_active":"2024-09-12T12:15:28.990057+0000","last_peered":"2024-09-12T12:15:28.990057+0000","last_clean":"2024-09-12T12:15:28.990057+0000","last_became_active":"2024-09-12T12:15:28.985514+0000","last_became_peered":"2024-09-12T12:15:28.985514+0000","last_unstale":"2024-09-12T12:15:28.990057+0000","last_undegraded":"2024-09-12T12:15:28.990057+0000","last_fullsized":"2024-09-12T12:15:28.990057+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:54.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974174+0000","last_change":"2024-09-12T12:15:28.974174+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974174+0000","last_undegraded":"2024-09-12T12:15:28.974174+0000","last_fullsized":"2024-09-12T12:15:28.974174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.984464+0000","last_change":"2024-09-12T12:15:28.981586+0000","last_active":"2024-09-12T12:15:28.984464+0000","last_peered":"2024-09-12T12:15:28.984464+0000","last_clean":"2024-09-12T12:15:28.984464+0000","last_became_active":"2024-09-12T12:15:28.981224+0000","last_became_peered":"2024-09-12T12:15:28.981224+0000","last_unstale":"2024-09-12T12:15:28.984464+0000","last_undegraded":"2024-09-12T12:15:28.984464+0000","last_fullsized":"2024-09-12T12:15:28.984464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:16.354264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974291+0000","last_change":"2024-09-12T12:15:28.974291+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974291+0000","last_undegraded":"2024-09-12T12:15:28.974291+0000","last_fullsized":"2024-09-12T12:15:28.974291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995764+0000","last_change":"2024-09-12T12:15:28.995320+0000","last_active":"2024-09-12T12:15:28.995764+0000","last_peered":"2024-09-12T12:15:28.995764+0000","last_clean":"2024-09-12T12:15:28.995764+0000","last_became_active":"2024-09-12T12:15:28.995054+0000","last_became_peered":"2024-09-12T12:15:28.995054+0000","last_unstale":"2024-09-12T12:15:28.995764+0000","last_undegraded":"2024-09-12T12:15:28.995764+0000","last_fullsized":"2024-09-12T12:15:28.995764+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:42.335476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968437+0000","last_change":"2024-09-12T12:15:28.968437+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968437+0000","last_undegraded":"2024-09-12T12:15:28.968437+0000","last_fullsized":"2024-09-12T12:15:28.968437+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999562+0000","last_change":"2024-09-12T12:15:28.996444+0000","last_active":"2024-09-12T12:15:28.999562+0000","last_peered":"2024-09-12T12:15:28.999562+0000","last_clean":"2024-09-12T12:15:28.999562+0000","last_became_active":"2024-09-12T12:15:28.996157+0000","last_became_peered":"2024-09-12T12:15:28.996157+0000","last_unstale":"2024-09-12T12:15:28.999562+0000","last_undegraded":"2024-09-12T12:15:28.999562+0000","last_fullsized":"2024-09-12T12:15:28.999562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:12.067885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.977148+0000","last_change":"2024-09-12T12:15:28.977148+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.977148+0000","last_undegraded":"2024-09-12T12:15:28.977148+0000","last_fullsized":"2024-09-12T12:15:28.977148+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991363+0000","last_change":"2024-09-12T12:15:28.986459+0000","last_active":"2024-09-12T12:15:28.991363+0000","last_peered":"2024-09-12T12:15:28.991363+0000","last_clean":"2024-09-12T12:15:28.991363+0000","last_became_active":"2024-09-12T12:15:28.986199+0000","last_became_peered":"2024-09-12T12:15:28.986199+0000","last_unstale":"2024-09-12T12:15:28.991363+0000","last_undegraded":"2024-09-12T12:15:28.991363+0000","last_fullsized":"2024-09-12T12:15:28.991363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:37.265570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978210+0000","last_change":"2024-09-12T12:15:28.978210+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978210+0000","last_undegraded":"2024-09-12T12:15:28.978210+0000","last_fullsized":"2024-09-12T12:15:28.978210+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.985055+0000","last_change":"2024-09-12T12:15:28.981615+0000","last_active":"2024-09-12T12:15:28.985055+0000","last_peered":"2024-09-12T12:15:28.985055+0000","last_clean":"2024-09-12T12:15:28.985055+0000","last_became_active":"2024-09-12T12:15:28.981365+0000","last_became_peered":"2024-09-12T12:15:28.981365+0000","last_unstale":"2024-09-12T12:15:28.985055+0000","last_undegraded":"2024-09-12T12:15:28.985055+0000","last_fullsized":"2024-09-12T12:15:28.985055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:55.218821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978872+0000","last_change":"2024-09-12T12:15:28.978872+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978872+0000","last_undegraded":"2024-09-12T12:15:28.978872+0000","last_fullsized":"2024-09-12T12:15:28.978872+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.990129+0000","last_change":"2024-09-12T12:15:28.986783+0000","last_active":"2024-09-12T12:15:28.990129+0000","last_peered":"2024-09-12T12:15:28.990129+0000","last_clean":"2024-09-12T12:15:28.990129+0000","last_became_active":"2024-09-12T12:15:28.985415+0000","last_became_peered":"2024-09-12T12:15:28.985415+0000","last_unstale":"2024-09-12T12:15:28.990129+0000","last_undegraded":"2024-09-12T12:15:28.990129+0000","last_fullsized":"2024-09-12T12:15:28.990129+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:08.684180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976524+0000","last_change":"2024-09-12T12:15:28.976524+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976524+0000","last_undegraded":"2024-09-12T12:15:28.976524+0000","last_fullsized":"2024-09-12T12:15:28.976524+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999316+0000","last_change":"2024-09-12T12:15:28.993668+0000","last_active":"2024-09-12T12:15:28.999316+0000","last_peered":"2024-09-12T12:15:28.999316+0000","last_clean":"2024-09-12T12:15:28.999316+0000","last_became_active":"2024-09-12T12:15:28.993395+0000","last_became_peered":"2024-09-12T12:15:28.993395+0000","last_unstale":"2024-09-12T12:15:28.999316+0000","last_undegraded":"2024-09-12T12:15:28.999316+0000","last_fullsized":"2024-09-12T12:15:28.999316+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.299252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973934+0000","last_change":"2024-09-12T12:15:28.973934+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973934+0000","last_undegraded":"2024-09-12T12:15:28.973934+0000","last_fullsized":"2024-09-12T12:15:28.973934+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:29.000351+0000","last_change":"2024-09-12T12:15:28.999035+0000","last_active":"2024-09-12T12:15:29.000351+0000","last_peered":"2024-09-12T12:15:29.000351+0000","last_clean":"2024-09-12T12:15:29.000351+0000","last_became_active":"2024-09-12T12:15:28.998733+0000","last_became_peered":"2024-09-12T12:15:28.998733+0000","last_unstale":"2024-09-12T12:15:29.000351+0000","last_undegraded":"2024-09-12T12:15:29.000351+0000","last_fullsized":"2024-09-12T12:15:29.000351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:48.389471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.976117+0000","last_change":"2024-09-12T12:15:28.976117+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.976117+0000","last_undegraded":"2024-09-12T12:15:28.976117+0000","last_fullsized":"2024-09-12T12:15:28.976117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.989053+0000","last_change":"2024-09-12T12:15:28.988145+0000","last_active":"2024-09-12T12:15:28.989053+0000","last_peered":"2024-09-12T12:15:28.989053+0000","last_clean":"2024-09-12T12:15:28.989053+0000","last_became_active":"2024-09-12T12:15:28.987869+0000","last_became_peered":"2024-09-12T12:15:28.987869+0000","last_unstale":"2024-09-12T12:15:28.989053+0000","last_undegraded":"2024-09-12T12:15:28.989053+0000","last_fullsized":"2024-09-12T12:15:28.989053+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:34.475461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.967879+0000","last_change":"2024-09-12T12:15:28.967879+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.967879+0000","last_undegraded":"2024-09-12T12:15:28.967879+0000","last_fullsized":"2024-09-12T12:15:28.967879+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995394+0000","last_change":"2024-09-12T12:15:28.991659+0000","last_active":"2024-09-12T12:15:28.995394+0000","last_peered":"2024-09-12T12:15:28.995394+0000","last_clean":"2024-09-12T12:15:28.995394+0000","last_became_active":"2024-09-12T12:15:28.991363+0000","last_became_peered":"2024-09-12T12:15:28.991363+0000","last_unstale":"2024-09-12T12:15:28.995394+0000","last_undegraded":"2024-09-12T12:15:28.995394+0000","last_fullsized":"2024-09-12T12:15:28.995394+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:03.704773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.975991+0000","last_change":"2024-09-12T12:15:28.975991+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.975991+0000","last_undegraded":"2024-09-12T12:15:28.975991+0000","last_fullsized":"2024-09-12T12:15:28.975991+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.998050+0000","last_change":"2024-09-12T12:15:28.997415+0000","last_active":"2024-09-12T12:15:28.998050+0000","last_peered":"2024-09-12T12:15:28.998050+0000","last_clean":"2024-09-12T12:15:28.998050+0000","last_became_active":"2024-09-12T12:15:28.997122+0000","last_became_peered":"2024-09-12T12:15:28.997122+0000","last_unstale":"2024-09-12T12:15:28.998050+0000","last_undegraded":"2024-09-12T12:15:28.998050+0000","last_fullsized":"2024-09-12T12:15:28.998050+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:16.354264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973990+0000","last_change":"2024-09-12T12:15:28.973990+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973990+0000","last_undegraded":"2024-09-12T12:15:28.973990+0000","last_fullsized":"2024-09-12T12:15:28.973990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995387+0000","last_change":"2024-09-12T12:15:28.991547+0000","last_active":"2024-09-12T12:15:28.995387+0000","last_peered":"2024-09-12T12:15:28.995387+0000","last_clean":"2024-09-12T12:15:28.995387+0000","last_became_active":"2024-09-12T12:15:28.988510+0000","last_became_peered":"2024-09-12T12:15:28.988510+0000","last_unstale":"2024-09-12T12:15:28.995387+0000","last_undegraded":"2024-09-12T12:15:28.995387+0000","last_fullsized":"2024-09-12T12:15:28.995387+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:16.354264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.971314+0000","last_change":"2024-09-12T12:15:28.971314+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.971314+0000","last_undegraded":"2024-09-12T12:15:28.971314+0000","last_fullsized":"2024-09-12T12:15:28.971314+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999559+0000","last_change":"2024-09-12T12:15:28.995461+0000","last_active":"2024-09-12T12:15:28.999559+0000","last_peered":"2024-09-12T12:15:28.999559+0000","last_clean":"2024-09-12T12:15:28.999559+0000","last_became_active":"2024-09-12T12:15:28.995166+0000","last_became_peered":"2024-09-12T12:15:28.995166+0000","last_unstale":"2024-09-12T12:15:28.999559+0000","last_undegraded":"2024-09-12T12:15:28.999559+0000","last_fullsized":"2024-09-12T12:15:28.999559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:14.812799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973696+0000","last_change":"2024-09-12T12:15:28.973696+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973696+0000","last_undegraded":"2024-09-12T12:15:28.973696+0000","last_fullsized":"2024-09-12T12:15:28.973696+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995084+0000","last_change":"2024-09-12T12:15:28.993720+0000","last_active":"2024-09-12T12:15:28.995084+0000","last_peered":"2024-09-12T12:15:28.995084+0000","last_clean":"2024-09-12T12:15:28.995084+0000","last_became_active":"2024-09-12T12:15:28.993434+0000","last_became_peered":"2024-09-12T12:15:28.993434+0000","last_unstale":"2024-09-12T12:15:28.995084+0000","last_undegraded":"2024-09-12T12:15:28.995084+0000","last_fullsized":"2024-09-12T12:15:28.995084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:33.220369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978838+0000","last_change":"2024-09-12T12:15:28.978838+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978838+0000","last_undegraded":"2024-09-12T12:15:28.978838+0000","last_fullsized":"2024-09-12T12:15:28.978838+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991881+0000","last_change":"2024-09-12T12:15:28.989717+0000","last_active":"2024-09-12T12:15:28.991881+0000","last_peered":"2024-09-12T12:15:28.991881+0000","last_clean":"2024-09-12T12:15:28.991881+0000","last_became_active":"2024-09-12T12:15:28.989405+0000","last_became_peered":"2024-09-12T12:15:28.989405+0000","last_unstale":"2024-09-12T12:15:28.991881+0000","last_undegraded":"2024-09-12T12:15:28.991881+0000","last_fullsized":"2024-09-12T12:15:28.991881+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:35.417617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.972482+0000","last_change":"2024-09-12T12:15:28.972482+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.972482+0000","last_undegraded":"2024-09-12T12:15:28.972482+0000","last_fullsized":"2024-09-12T12:15:28.972482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.987402+0000","last_change":"2024-09-12T12:15:28.983057+0000","last_active":"2024-09-12T12:15:28.987402+0000","last_peered":"2024-09-12T12:15:28.987402+0000","last_clean":"2024-09-12T12:15:28.987402+0000","last_became_active":"2024-09-12T12:15:28.982770+0000","last_became_peered":"2024-09-12T12:15:28.982770+0000","last_unstale":"2024-09-12T12:15:28.987402+0000","last_undegraded":"2024-09-12T12:15:28.987402+0000","last_fullsized":"2024-09-12T12:15:28.987402+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:36.053548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978638+0000","last_change":"2024-09-12T12:15:28.978638+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978638+0000","last_undegraded":"2024-09-12T12:15:28.978638+0000","last_fullsized":"2024-09-12T12:15:28.978638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.990539+0000","last_change":"2024-09-12T12:15:28.989675+0000","last_active":"2024-09-12T12:15:28.990539+0000","last_peered":"2024-09-12T12:15:28.990539+0000","last_clean":"2024-09-12T12:15:28.990539+0000","last_became_active":"2024-09-12T12:15:28.989383+0000","last_became_peered":"2024-09-12T12:15:28.989383+0000","last_unstale":"2024-09-12T12:15:28.990539+0000","last_undegraded":"2024-09-12T12:15:28.990539+0000","last_fullsized":"2024-09-12T12:15:28.990539+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:25.049563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.978897+0000","last_change":"2024-09-12T12:15:28.978897+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.978897+0000","last_undegraded":"2024-09-12T12:15:28.978897+0000","last_fullsized":"2024-09-12T12:15:28.978897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.989851+0000","last_change":"2024-09-12T12:15:28.982400+0000","last_active":"2024-09-12T12:15:28.989851+0000","last_peered":"2024-09-12T12:15:28.989851+0000","last_clean":"2024-09-12T12:15:28.989851+0000","last_became_active":"2024-09-12T12:15:28.982103+0000","last_became_peered":"2024-09-12T12:15:28.982103+0000","last_unstale":"2024-09-12T12:15:28.989851+0000","last_undegraded":"2024-09-12T12:15:28.989851+0000","last_fullsized":"2024-09-12T12:15:28.989851+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:37.433511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973816+0000","last_change":"2024-09-12T12:15:28.973816+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973816+0000","last_undegraded":"2024-09-12T12:15:28.973816+0000","last_fullsized":"2024-09-12T12:15:28.973816+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.999485+0000","last_change":"2024-09-12T12:15:28.995466+0000","last_active":"2024-09-12T12:15:28.999485+0000","last_peered":"2024-09-12T12:15:28.999485+0000","last_clean":"2024-09-12T12:15:28.999485+0000","last_became_active":"2024-09-12T12:15:28.995180+0000","last_became_peered":"2024-09-12T12:15:28.995180+0000","last_unstale":"2024-09-12T12:15:28.999485+0000","last_undegraded":"2024-09-12T12:15:28.999485+0000","last_fullsized":"2024-09-12T12:15:28.999485+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:56.407792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.973975+0000","last_change":"2024-09-12T12:15:28.973975+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.973975+0000","last_undegraded":"2024-09-12T12:15:28.973975+0000","last_fullsized":"2024-09-12T12:15:28.973975+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:29.000477+0000","last_change":"2024-09-12T12:15:28.997623+0000","last_active":"2024-09-12T12:15:29.000477+0000","last_peered":"2024-09-12T12:15:29.000477+0000","last_clean":"2024-09-12T12:15:29.000477+0000","last_became_active":"2024-09-12T12:15:28.997361+0000","last_became_peered":"2024-09-12T12:15:28.997361+0000","last_unstale":"2024-09-12T12:15:29.000477+0000","last_undegraded":"2024-09-12T12:15:29.000477+0000","last_fullsized":"2024-09-12T12:15:29.000477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:36.747728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.974230+0000","last_change":"2024-09-12T12:15:28.974230+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.974230+0000","last_undegraded":"2024-09-12T12:15:28.974230+0000","last_fullsized":"2024-09-12T12:15:28.974230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.998055+0000","last_change":"2024-09-12T12:15:28.997529+0000","last_active":"2024-09-12T12:15:28.998055+0000","last_peered":"2024-09-12T12:15:28.998055+0000","last_clean":"2024-09-12T12:15:28.998055+0000","last_became_active":"2024-09-12T12:15:28.997217+0000","last_became_peered":"2024-09-12T12:15:28.997217+0000","last_unstale":"2024-09-12T12:15:28.998055+0000","last_undegraded":"2024-09-12T12:15:28.998055+0000","last_fullsized":"2024-09-12T12:15:28.998055+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:48.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.979412+0000","last_change":"2024-09-12T12:15:28.979412+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.979412+0000","last_undegraded":"2024-09-12T12:15:28.979412+0000","last_fullsized":"2024-09-12T12:15:28.979412+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.995298+0000","last_change":"2024-09-12T12:15:28.991866+0000","last_active":"2024-09-12T12:15:28.995298+0000","last_peered":"2024-09-12T12:15:28.995298+0000","last_clean":"2024-09-12T12:15:28.995298+0000","last_became_active":"2024-09-12T12:15:28.991562+0000","last_became_peered":"2024-09-12T12:15:28.991562+0000","last_unstale":"2024-09-12T12:15:28.995298+0000","last_undegraded":"2024-09-12T12:15:28.995298+0000","last_fullsized":"2024-09-12T12:15:28.995298+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.299252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":52,"state":"creating+peering","last_fresh":"2024-09-12T12:15:28.968076+0000","last_change":"2024-09-12T12:15:28.968076+0000","last_active":"2024-09-12T12:15:28.958825+0000","last_peered":"2024-09-12T12:15:28.958825+0000","last_clean":"2024-09-12T12:15:28.958825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:15:28.968076+0000","last_undegraded":"2024-09-12T12:15:28.968076+0000","last_fullsized":"2024-09-12T12:15:28.968076+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.991328+0000","last_change":"2024-09-12T12:15:28.985626+0000","last_active":"2024-09-12T12:15:28.991328+0000","last_peered":"2024-09-12T12:15:28.991328+0000","last_clean":"2024-09-12T12:15:28.991328+0000","last_became_active":"2024-09-12T12:15:28.985369+0000","last_became_peered":"2024-09-12T12:15:28.985369+0000","last_unstale":"2024-09-12T12:15:28.991328+0000","last_undegraded":"2024-09-12T12:15:28.991328+0000","last_fullsized":"2024-09-12T12:15:28.991328+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:41.313179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":229,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-12T12:15:28.978279+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:15:28.978279+0000","last_peered":"2024-09-12T12:15:28.978279+0000","last_clean":"2024-09-12T12:15:28.978279+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:15:28.978279+0000","last_undegraded":"2024-09-12T12:15:28.978279+0000","last_fullsized":"2024-09-12T12:15:28.978279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36540,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335300,"statfs":{"total":96636764160,"available":96599347200,"internally_reserved":0,"allocated":1212416,"data_stored":864691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35956,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335884,"statfs":{"total":96636764160,"available":96599945216,"internally_reserved":0,"allocated":618496,"data_stored":274323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35940,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335900,"statfs":{"total":96636764160,"available":96599961600,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":606208,"data_stored":267656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36532,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335308,"statfs":{"total":96636764160,"available":96599355392,"internally_reserved":0,"allocated":1212416,"data_stored":864691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.982087+0000', 'last_change': '2024-09-12T12:15:28.982087+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.982087+0000', 'last_undegraded': '2024-09-12T12:15:28.982087+0000', 'last_fullsized': '2024-09-12T12:15:28.982087+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.975202+0000', 'last_change': '2024-09-12T12:15:28.975202+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.975202+0000', 'last_undegraded': '2024-09-12T12:15:28.975202+0000', 'last_fullsized': '2024-09-12T12:15:28.975202+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.979129+0000', 'last_change': '2024-09-12T12:15:28.979129+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.979129+0000', 'last_undegraded': '2024-09-12T12:15:28.979129+0000', 'last_fullsized': '2024-09-12T12:15:28.979129+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974814+0000', 'last_change': '2024-09-12T12:15:28.974814+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974814+0000', 'last_undegraded': '2024-09-12T12:15:28.974814+0000', 'last_fullsized': '2024-09-12T12:15:28.974814+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-09-12T12:15:35.203 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.968941+0000', 'last_change': '2024-09-12T12:15:28.968941+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.968941+0000', 'last_undegraded': '2024-09-12T12:15:28.968941+0000', 'last_fullsized': '2024-09-12T12:15:28.968941+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.985779+0000', 'last_change': '2024-09-12T12:15:28.985779+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.985779+0000', 'last_undegraded': '2024-09-12T12:15:28.985779+0000', 'last_fullsized': '2024-09-12T12:15:28.985779+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:PG 8.39 is not active+clean 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.975376+0000', 'last_change': '2024-09-12T12:15:28.975376+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.975376+0000', 'last_undegraded': '2024-09-12T12:15:28.975376+0000', 'last_fullsized': '2024-09-12T12:15:28.975376+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974468+0000', 'last_change': '2024-09-12T12:15:28.974468+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974468+0000', 'last_undegraded': '2024-09-12T12:15:28.974468+0000', 'last_fullsized': '2024-09-12T12:15:28.974468+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.979809+0000', 'last_change': '2024-09-12T12:15:28.979809+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.979809+0000', 'last_undegraded': '2024-09-12T12:15:28.979809+0000', 'last_fullsized': '2024-09-12T12:15:28.979809+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:PG 8.36 is not active+clean 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.980816+0000', 'last_change': '2024-09-12T12:15:28.980816+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.980816+0000', 'last_undegraded': '2024-09-12T12:15:28.980816+0000', 'last_fullsized': '2024-09-12T12:15:28.980816+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-09-12T12:15:35.204 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.972226+0000', 'last_change': '2024-09-12T12:15:28.972226+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.972226+0000', 'last_undegraded': '2024-09-12T12:15:28.972226+0000', 'last_fullsized': '2024-09-12T12:15:28.972226+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.984796+0000', 'last_change': '2024-09-12T12:15:28.984796+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.984796+0000', 'last_undegraded': '2024-09-12T12:15:28.984796+0000', 'last_fullsized': '2024-09-12T12:15:28.984796+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.980928+0000', 'last_change': '2024-09-12T12:15:28.980928+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.980928+0000', 'last_undegraded': '2024-09-12T12:15:28.980928+0000', 'last_fullsized': '2024-09-12T12:15:28.980928+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:PG 8.32 is not active+clean 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974762+0000', 'last_change': '2024-09-12T12:15:28.974762+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974762+0000', 'last_undegraded': '2024-09-12T12:15:28.974762+0000', 'last_fullsized': '2024-09-12T12:15:28.974762+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.975198+0000', 'last_change': '2024-09-12T12:15:28.975198+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.975198+0000', 'last_undegraded': '2024-09-12T12:15:28.975198+0000', 'last_fullsized': '2024-09-12T12:15:28.975198+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-09-12T12:15:35.205 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.985280+0000', 'last_change': '2024-09-12T12:15:28.985280+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.985280+0000', 'last_undegraded': '2024-09-12T12:15:28.985280+0000', 'last_fullsized': '2024-09-12T12:15:28.985280+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2f is not active+clean 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.977272+0000', 'last_change': '2024-09-12T12:15:28.977272+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.977272+0000', 'last_undegraded': '2024-09-12T12:15:28.977272+0000', 'last_fullsized': '2024-09-12T12:15:28.977272+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974681+0000', 'last_change': '2024-09-12T12:15:28.974681+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974681+0000', 'last_undegraded': '2024-09-12T12:15:28.974681+0000', 'last_fullsized': '2024-09-12T12:15:28.974681+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.978637+0000', 'last_change': '2024-09-12T12:15:28.978637+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.978637+0000', 'last_undegraded': '2024-09-12T12:15:28.978637+0000', 'last_fullsized': '2024-09-12T12:15:28.978637+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.969488+0000', 'last_change': '2024-09-12T12:15:28.969488+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.969488+0000', 'last_undegraded': '2024-09-12T12:15:28.969488+0000', 'last_fullsized': '2024-09-12T12:15:28.969488+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.968688+0000', 'last_change': '2024-09-12T12:15:28.968688+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.968688+0000', 'last_undegraded': '2024-09-12T12:15:28.968688+0000', 'last_fullsized': '2024-09-12T12:15:28.968688+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:15:35.206 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.976107+0000', 'last_change': '2024-09-12T12:15:28.976107+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.976107+0000', 'last_undegraded': '2024-09-12T12:15:28.976107+0000', 'last_fullsized': '2024-09-12T12:15:28.976107+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.973240+0000', 'last_change': '2024-09-12T12:15:28.973240+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.973240+0000', 'last_undegraded': '2024-09-12T12:15:28.973240+0000', 'last_fullsized': '2024-09-12T12:15:28.973240+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974545+0000', 'last_change': '2024-09-12T12:15:28.974545+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974545+0000', 'last_undegraded': '2024-09-12T12:15:28.974545+0000', 'last_fullsized': '2024-09-12T12:15:28.974545+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:PG 8.27 is not active+clean 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.976913+0000', 'last_change': '2024-09-12T12:15:28.976913+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.976913+0000', 'last_undegraded': '2024-09-12T12:15:28.976913+0000', 'last_fullsized': '2024-09-12T12:15:28.976913+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.979335+0000', 'last_change': '2024-09-12T12:15:28.979335+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.979335+0000', 'last_undegraded': '2024-09-12T12:15:28.979335+0000', 'last_fullsized': '2024-09-12T12:15:28.979335+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-09-12T12:15:35.207 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.979959+0000', 'last_change': '2024-09-12T12:15:28.979959+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.979959+0000', 'last_undegraded': '2024-09-12T12:15:28.979959+0000', 'last_fullsized': '2024-09-12T12:15:28.979959+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.969106+0000', 'last_change': '2024-09-12T12:15:28.969106+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.969106+0000', 'last_undegraded': '2024-09-12T12:15:28.969106+0000', 'last_fullsized': '2024-09-12T12:15:28.969106+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:PG 8.23 is not active+clean 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.976144+0000', 'last_change': '2024-09-12T12:15:28.976144+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.976144+0000', 'last_undegraded': '2024-09-12T12:15:28.976144+0000', 'last_fullsized': '2024-09-12T12:15:28.976144+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.972855+0000', 'last_change': '2024-09-12T12:15:28.972855+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.972855+0000', 'last_undegraded': '2024-09-12T12:15:28.972855+0000', 'last_fullsized': '2024-09-12T12:15:28.972855+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974999+0000', 'last_change': '2024-09-12T12:15:28.974999+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974999+0000', 'last_undegraded': '2024-09-12T12:15:28.974999+0000', 'last_fullsized': '2024-09-12T12:15:28.974999+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.973589+0000', 'last_change': '2024-09-12T12:15:28.973589+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.973589+0000', 'last_undegraded': '2024-09-12T12:15:28.973589+0000', 'last_fullsized': '2024-09-12T12:15:28.973589+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:15:35.208 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.975179+0000', 'last_change': '2024-09-12T12:15:28.975179+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.975179+0000', 'last_undegraded': '2024-09-12T12:15:28.975179+0000', 'last_fullsized': '2024-09-12T12:15:28.975179+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.972453+0000', 'last_change': '2024-09-12T12:15:28.972453+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.972453+0000', 'last_undegraded': '2024-09-12T12:15:28.972453+0000', 'last_fullsized': '2024-09-12T12:15:28.972453+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.968180+0000', 'last_change': '2024-09-12T12:15:28.968180+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.968180+0000', 'last_undegraded': '2024-09-12T12:15:28.968180+0000', 'last_fullsized': '2024-09-12T12:15:28.968180+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.986270+0000', 'last_change': '2024-09-12T12:15:28.986270+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.986270+0000', 'last_undegraded': '2024-09-12T12:15:28.986270+0000', 'last_fullsized': '2024-09-12T12:15:28.986270+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.968243+0000', 'last_change': '2024-09-12T12:15:28.968243+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.968243+0000', 'last_undegraded': '2024-09-12T12:15:28.968243+0000', 'last_fullsized': '2024-09-12T12:15:28.968243+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-12T12:15:35.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.975521+0000', 'last_change': '2024-09-12T12:15:28.975521+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.975521+0000', 'last_undegraded': '2024-09-12T12:15:28.975521+0000', 'last_fullsized': '2024-09-12T12:15:28.975521+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.978375+0000', 'last_change': '2024-09-12T12:15:28.978375+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.978375+0000', 'last_undegraded': '2024-09-12T12:15:28.978375+0000', 'last_fullsized': '2024-09-12T12:15:28.978375+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974758+0000', 'last_change': '2024-09-12T12:15:28.974758+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974758+0000', 'last_undegraded': '2024-09-12T12:15:28.974758+0000', 'last_fullsized': '2024-09-12T12:15:28.974758+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.967481+0000', 'last_change': '2024-09-12T12:15:28.967481+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.967481+0000', 'last_undegraded': '2024-09-12T12:15:28.967481+0000', 'last_fullsized': '2024-09-12T12:15:28.967481+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974174+0000', 'last_change': '2024-09-12T12:15:28.974174+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974174+0000', 'last_undegraded': '2024-09-12T12:15:28.974174+0000', 'last_fullsized': '2024-09-12T12:15:28.974174+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974291+0000', 'last_change': '2024-09-12T12:15:28.974291+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974291+0000', 'last_undegraded': '2024-09-12T12:15:28.974291+0000', 'last_fullsized': '2024-09-12T12:15:28.974291+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.210 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.968437+0000', 'last_change': '2024-09-12T12:15:28.968437+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.968437+0000', 'last_undegraded': '2024-09-12T12:15:28.968437+0000', 'last_fullsized': '2024-09-12T12:15:28.968437+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.977148+0000', 'last_change': '2024-09-12T12:15:28.977148+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.977148+0000', 'last_undegraded': '2024-09-12T12:15:28.977148+0000', 'last_fullsized': '2024-09-12T12:15:28.977148+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.978210+0000', 'last_change': '2024-09-12T12:15:28.978210+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.978210+0000', 'last_undegraded': '2024-09-12T12:15:28.978210+0000', 'last_fullsized': '2024-09-12T12:15:28.978210+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.978872+0000', 'last_change': '2024-09-12T12:15:28.978872+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.978872+0000', 'last_undegraded': '2024-09-12T12:15:28.978872+0000', 'last_fullsized': '2024-09-12T12:15:28.978872+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.976524+0000', 'last_change': '2024-09-12T12:15:28.976524+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.976524+0000', 'last_undegraded': '2024-09-12T12:15:28.976524+0000', 'last_fullsized': '2024-09-12T12:15:28.976524+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-12T12:15:35.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.973934+0000', 'last_change': '2024-09-12T12:15:28.973934+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.973934+0000', 'last_undegraded': '2024-09-12T12:15:28.973934+0000', 'last_fullsized': '2024-09-12T12:15:28.973934+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.212 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-12T12:15:35.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.976117+0000', 'last_change': '2024-09-12T12:15:28.976117+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.976117+0000', 'last_undegraded': '2024-09-12T12:15:28.976117+0000', 'last_fullsized': '2024-09-12T12:15:28.976117+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.212 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-12T12:15:35.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.967879+0000', 'last_change': '2024-09-12T12:15:28.967879+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.967879+0000', 'last_undegraded': '2024-09-12T12:15:28.967879+0000', 'last_fullsized': '2024-09-12T12:15:28.967879+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:15:35.212 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-12T12:15:35.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.975991+0000', 'last_change': '2024-09-12T12:15:28.975991+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.975991+0000', 'last_undegraded': '2024-09-12T12:15:28.975991+0000', 'last_fullsized': '2024-09-12T12:15:28.975991+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.973990+0000', 'last_change': '2024-09-12T12:15:28.973990+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.973990+0000', 'last_undegraded': '2024-09-12T12:15:28.973990+0000', 'last_fullsized': '2024-09-12T12:15:28.973990+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.971314+0000', 'last_change': '2024-09-12T12:15:28.971314+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.971314+0000', 'last_undegraded': '2024-09-12T12:15:28.971314+0000', 'last_fullsized': '2024-09-12T12:15:28.971314+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.973696+0000', 'last_change': '2024-09-12T12:15:28.973696+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.973696+0000', 'last_undegraded': '2024-09-12T12:15:28.973696+0000', 'last_fullsized': '2024-09-12T12:15:28.973696+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.978838+0000', 'last_change': '2024-09-12T12:15:28.978838+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.978838+0000', 'last_undegraded': '2024-09-12T12:15:28.978838+0000', 'last_fullsized': '2024-09-12T12:15:28.978838+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.972482+0000', 'last_change': '2024-09-12T12:15:28.972482+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.972482+0000', 'last_undegraded': '2024-09-12T12:15:28.972482+0000', 'last_fullsized': '2024-09-12T12:15:28.972482+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-09-12T12:15:35.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.978638+0000', 'last_change': '2024-09-12T12:15:28.978638+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.978638+0000', 'last_undegraded': '2024-09-12T12:15:28.978638+0000', 'last_fullsized': '2024-09-12T12:15:28.978638+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.978897+0000', 'last_change': '2024-09-12T12:15:28.978897+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.978897+0000', 'last_undegraded': '2024-09-12T12:15:28.978897+0000', 'last_fullsized': '2024-09-12T12:15:28.978897+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.973816+0000', 'last_change': '2024-09-12T12:15:28.973816+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.973816+0000', 'last_undegraded': '2024-09-12T12:15:28.973816+0000', 'last_fullsized': '2024-09-12T12:15:28.973816+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.973975+0000', 'last_change': '2024-09-12T12:15:28.973975+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.973975+0000', 'last_undegraded': '2024-09-12T12:15:28.973975+0000', 'last_fullsized': '2024-09-12T12:15:28.973975+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.974230+0000', 'last_change': '2024-09-12T12:15:28.974230+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.974230+0000', 'last_undegraded': '2024-09-12T12:15:28.974230+0000', 'last_fullsized': '2024-09-12T12:15:28.974230+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.979412+0000', 'last_change': '2024-09-12T12:15:28.979412+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.979412+0000', 'last_undegraded': '2024-09-12T12:15:28.979412+0000', 'last_fullsized': '2024-09-12T12:15:28.979412+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:15:35.214 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-12T12:15:35.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 52, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:15:28.968076+0000', 'last_change': '2024-09-12T12:15:28.968076+0000', 'last_active': '2024-09-12T12:15:28.958825+0000', 'last_peered': '2024-09-12T12:15:28.958825+0000', 'last_clean': '2024-09-12T12:15:28.958825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:15:28.968076+0000', 'last_undegraded': '2024-09-12T12:15:28.968076+0000', 'last_fullsized': '2024-09-12T12:15:28.968076+0000', 'mapping_epoch': 52, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 52, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'last_clean_scrub_stamp': '2024-09-12T12:15:28.958825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:15:35.215 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:15:35.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.375+0000 7faa45200640 1 Processor -- start 2024-09-12T12:15:35.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.375+0000 7faa45200640 1 -- start start 2024-09-12T12:15:35.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa45200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7faa40145c90 0x7faa4006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa45200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa4006ed90 con 0x7faa40145740 2024-09-12T12:15:35.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa45200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa4006f070 con 0x7faa40145240 2024-09-12T12:15:35.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa45200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7faa401602f0 con 0x7faa40145c90 2024-09-12T12:15:35.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faa40145740 0x7faa400b4300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39614/0 (socket says 172.21.15.144:39614) 2024-09-12T12:15:35.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3fe00640 1 -- 172.21.15.144:0/4263781940 learned_addr learned my addr 172.21.15.144:0/4263781940 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:35.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa36a00640 1 --2- 172.21.15.144:0/4263781940 >> v2:172.21.15.165:3300/0 conn(0x7faa40145c90 0x7faa4006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935224678 0 0) 0x7faa4006ed90 con 0x7faa40145740 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa24003530 con 0x7faa40145740 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940378822 0 0) 0x7faa4006f070 con 0x7faa40145240 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa4006ed90 con 0x7faa40145240 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2053168400 0 0) 0x7faa24003530 con 0x7faa40145740 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 >> v2:172.21.15.165:3300/0 conn(0x7faa40145c90 msgr2=0x7faa4006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 --2- 172.21.15.144:0/4263781940 >> v2:172.21.15.165:3300/0 conn(0x7faa40145c90 0x7faa4006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 >> v1:172.21.15.165:6789/0 conn(0x7faa40145240 legacy=0x7faa40160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4015ff80 con 0x7faa40145740 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7faa38001a00 con 0x7faa40145740 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 >> v1:172.21.15.144:6789/0 conn(0x7faa40145740 legacy=0x7faa400b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa24003b50 0x7faa24003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa24004810 0x7faa24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa240051d0 0x7faa2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa401602f0 con 0x7faa24003b50 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faa2400c050 con 0x7faa240051d0 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faa2400c250 con 0x7faa24004810 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3f400640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa24003b50 0x7faa24003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa36a00640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa24004810 0x7faa24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3fe00640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa240051d0 0x7faa2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3f400640 1 -- 172.21.15.144:0/4263781940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa24004810 msgr2=0x7faa24004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3f400640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa24004810 0x7faa24004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3f400640 1 -- 172.21.15.144:0/4263781940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa240051d0 msgr2=0x7faa2400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3f400640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa240051d0 0x7faa2400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3f400640 1 -- 172.21.15.144:0/4263781940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa24003530 con 0x7faa24003b50 2024-09-12T12:15:35.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.379+0000 7faa3fe00640 1 -- 172.21.15.144:0/4263781940 reap_dead start 2024-09-12T12:15:35.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa3f400640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa24003b50 0x7faa24003f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faa300018d0 tx=0x7faa3001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6e0f97f5cba6b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:35.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa300b0070 con 0x7faa24003b50 2024-09-12T12:15:35.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa300052f0 con 0x7faa24003b50 2024-09-12T12:15:35.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa3ea00640 1 -- 172.21.15.144:0/4263781940 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30001520 con 0x7faa24003b50 2024-09-12T12:15:35.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa45200640 1 -- 172.21.15.144:0/4263781940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa24003b50 msgr2=0x7faa24003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa45200640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa24003b50 0x7faa24003f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faa300018d0 tx=0x7faa3001c560 comp rx=0 tx=0).stop 2024-09-12T12:15:35.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa45200640 1 -- 172.21.15.144:0/4263781940 shutdown_connections 2024-09-12T12:15:35.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa45200640 1 --2- 172.21.15.144:0/4263781940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa24003b50 0x7faa24003f50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa45200640 1 -- 172.21.15.144:0/4263781940 >> 172.21.15.144:0/4263781940 conn(0x7faa4006e0f0 msgr2=0x7faa4006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:35.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa45200640 1 -- 172.21.15.144:0/4263781940 shutdown_connections 2024-09-12T12:15:35.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa45200640 1 -- 172.21.15.144:0/4263781940 wait complete. 2024-09-12T12:15:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa45200640 1 Processor -- start 2024-09-12T12:15:35.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.383+0000 7faa45200640 1 -- start start 2024-09-12T12:15:35.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa45200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa24003b50 0x7faa401f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa45200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa401400c0 0x7faa4013e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa45200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa4013ac50 0x7faa4015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa45200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa400d0970 con 0x7faa401400c0 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa45200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faa400d07f0 con 0x7faa24003b50 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa45200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faa400d0af0 con 0x7faa4013ac50 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa36a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa401400c0 0x7faa4013e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa36a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa401400c0 0x7faa4013e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52676/0 (socket says 172.21.15.144:52676) 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa36a00640 1 -- 172.21.15.144:0/3217405654 learned_addr learned my addr 172.21.15.144:0/3217405654 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa3f400640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa24003b50 0x7faa401f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa3fe00640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa4013ac50 0x7faa4015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa36a00640 1 -- 172.21.15.144:0/3217405654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa4013ac50 msgr2=0x7faa4015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa36a00640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa4013ac50 0x7faa4015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa36a00640 1 -- 172.21.15.144:0/3217405654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa24003b50 msgr2=0x7faa401f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa36a00640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa24003b50 0x7faa401f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa36a00640 1 -- 172.21.15.144:0/3217405654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4013f020 con 0x7faa401400c0 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa36a00640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa401400c0 0x7faa4013e920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faa28011500 tx=0x7faa28011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa37e00640 1 -- 172.21.15.144:0/3217405654 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28015870 con 0x7faa401400c0 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa37e00640 1 -- 172.21.15.144:0/3217405654 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa28015a10 con 0x7faa401400c0 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4013f300 con 0x7faa401400c0 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa37e00640 1 -- 172.21.15.144:0/3217405654 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28015dc0 con 0x7faa401400c0 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4013f8c0 con 0x7faa401400c0 2024-09-12T12:15:35.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.387+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4006f070 con 0x7faa401400c0 2024-09-12T12:15:35.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.391+0000 7faa37e00640 1 -- 172.21.15.144:0/3217405654 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa28013400 con 0x7faa401400c0 2024-09-12T12:15:35.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.391+0000 7faa37e00640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa1c0678c0 0x7faa1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.391+0000 7faa37e00640 1 -- 172.21.15.144:0/3217405654 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7faa28086690 con 0x7faa401400c0 2024-09-12T12:15:35.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.391+0000 7faa3f400640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa1c0678c0 0x7faa1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.391+0000 7faa3f400640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa1c0678c0 0x7faa1c069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa300ad000 tx=0x7faa300a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:35.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.395+0000 7faa37e00640 1 -- 172.21.15.144:0/3217405654 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faa28019030 con 0x7faa401400c0 2024-09-12T12:15:35.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7faa400cdac0 con 0x7faa401400c0 2024-09-12T12:15:35.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa37e00640 1 -- 172.21.15.144:0/3217405654 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1237 (secure 0 0 0) 0x7faa28056fa0 con 0x7faa401400c0 2024-09-12T12:15:35.617 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:35.617 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":195,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":291418112,"bytes_avail":772802695168,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":26,"btime":"2024-09-12T12:15:33:003315+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5283}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-12T12:14:39.398521+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:15:35.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa1c0678c0 msgr2=0x7faa1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa1c0678c0 0x7faa1c069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa300ad000 tx=0x7faa300a7000 comp rx=0 tx=0).stop 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa401400c0 msgr2=0x7faa4013e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa401400c0 0x7faa4013e920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faa28011500 tx=0x7faa28011900 comp rx=0 tx=0).stop 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 shutdown_connections 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faa1c0678c0 0x7faa1c069d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa4013ac50 0x7faa4015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa401400c0 0x7faa4013e920 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 --2- 172.21.15.144:0/3217405654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa24003b50 0x7faa401f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 >> 172.21.15.144:0/3217405654 conn(0x7faa4006e0f0 msgr2=0x7faa400b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 shutdown_connections 2024-09-12T12:15:35.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.615+0000 7faa45200640 1 -- 172.21.15.144:0/3217405654 wait complete. 2024-09-12T12:15:35.639 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T12:15:35.639 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:15:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe06da00640 1 Processor -- start 2024-09-12T12:15:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe06da00640 1 -- start start 2024-09-12T12:15:35.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe06da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe06815e590 0x7fe06806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe06da00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe068160750 con 0x7fe0680d1950 2024-09-12T12:15:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe06da00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe06815f5c0 con 0x7fe0681602a0 2024-09-12T12:15:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe06da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe06806d270 con 0x7fe06815e590 2024-09-12T12:15:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe05fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe0680d1950 0x7fe06815fb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39618/0 (socket says 172.21.15.144:39618) 2024-09-12T12:15:35.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe05fe00640 1 -- 172.21.15.144:0/441751981 learned_addr learned my addr 172.21.15.144:0/441751981 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe067e00640 1 --2- 172.21.15.144:0/441751981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe06815e590 0x7fe06806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe067400640 1 -- 172.21.15.144:0/441751981 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543257764 0 0) 0x7fe068160750 con 0x7fe0680d1950 2024-09-12T12:15:35.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe067400640 1 -- 172.21.15.144:0/441751981 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe04c003530 con 0x7fe0680d1950 2024-09-12T12:15:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe067400640 1 -- 172.21.15.144:0/441751981 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2182651015 0 0) 0x7fe06815f5c0 con 0x7fe0681602a0 2024-09-12T12:15:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe067400640 1 -- 172.21.15.144:0/441751981 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe068160750 con 0x7fe0681602a0 2024-09-12T12:15:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe067e00640 1 -- 172.21.15.144:0/441751981 >> v1:172.21.15.165:6789/0 conn(0x7fe0681602a0 legacy=0x7fe068161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe067e00640 1 -- 172.21.15.144:0/441751981 >> v1:172.21.15.144:6789/0 conn(0x7fe0680d1950 legacy=0x7fe06815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.775+0000 7fe067e00640 1 -- 172.21.15.144:0/441751981 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06815f8a0 con 0x7fe06815e590 2024-09-12T12:15:35.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe067e00640 1 --2- 172.21.15.144:0/441751981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe06815e590 0x7fe06806d700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0580097f0 tx=0x7fe05801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf5a4a37a4173fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:35.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe067400640 1 -- 172.21.15.144:0/441751981 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0580b0070 con 0x7fe06815e590 2024-09-12T12:15:35.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe067400640 1 -- 172.21.15.144:0/441751981 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0580ab600 con 0x7fe06815e590 2024-09-12T12:15:35.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe067400640 1 -- 172.21.15.144:0/441751981 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0580ab9b0 con 0x7fe06815e590 2024-09-12T12:15:35.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe06da00640 1 -- 172.21.15.144:0/441751981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe06815e590 msgr2=0x7fe06806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe06da00640 1 --2- 172.21.15.144:0/441751981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe06815e590 0x7fe06806d700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0580097f0 tx=0x7fe05801c380 comp rx=0 tx=0).stop 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe06da00640 1 -- 172.21.15.144:0/441751981 shutdown_connections 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe06da00640 1 --2- 172.21.15.144:0/441751981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe06815e590 0x7fe06806d700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe06da00640 1 -- 172.21.15.144:0/441751981 >> 172.21.15.144:0/441751981 conn(0x7fe0680b41d0 msgr2=0x7fe0680b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe06da00640 1 -- 172.21.15.144:0/441751981 shutdown_connections 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.779+0000 7fe06da00640 1 -- 172.21.15.144:0/441751981 wait complete. 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 Processor -- start 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 -- start start 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0680d1950 0x7fe06814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe06815e590 0x7fe0681531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0681602a0 0x7fe068156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe06816c390 con 0x7fe0681602a0 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe06806dc40 con 0x7fe06815e590 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe06816c510 con 0x7fe0680d1950 2024-09-12T12:15:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0681602a0 0x7fe068156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0681602a0 0x7fe068156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52692/0 (socket says 172.21.15.144:52692) 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06d000640 1 -- 172.21.15.144:0/382668440 learned_addr learned my addr 172.21.15.144:0/382668440 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe067e00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0680d1950 0x7fe06814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe05fe00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe06815e590 0x7fe0681531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06d000640 1 -- 172.21.15.144:0/382668440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0680d1950 msgr2=0x7fe06814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06d000640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0680d1950 0x7fe06814fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06d000640 1 -- 172.21.15.144:0/382668440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe06815e590 msgr2=0x7fe0681531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06d000640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe06815e590 0x7fe0681531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06d000640 1 -- 172.21.15.144:0/382668440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe068152120 con 0x7fe0681602a0 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06d000640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0681602a0 0x7fe068156c60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe06000c780 tx=0x7fe06000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe064c00640 1 -- 172.21.15.144:0/382668440 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060017070 con 0x7fe0681602a0 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe064c00640 1 -- 172.21.15.144:0/382668440 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe060003db0 con 0x7fe0681602a0 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe064c00640 1 -- 172.21.15.144:0/382668440 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060005290 con 0x7fe0681602a0 2024-09-12T12:15:35.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe068152400 con 0x7fe0681602a0 2024-09-12T12:15:35.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0681529c0 con 0x7fe0681602a0 2024-09-12T12:15:35.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.783+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe06806d700 con 0x7fe0681602a0 2024-09-12T12:15:35.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.787+0000 7fe064c00640 1 -- 172.21.15.144:0/382668440 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe06001a070 con 0x7fe0681602a0 2024-09-12T12:15:35.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.787+0000 7fe064c00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0440678f0 0x7fe044069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:35.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.787+0000 7fe064c00640 1 -- 172.21.15.144:0/382668440 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe060085510 con 0x7fe0681602a0 2024-09-12T12:15:35.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.787+0000 7fe067e00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0440678f0 0x7fe044069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:35.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.787+0000 7fe067e00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0440678f0 0x7fe044069db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe0580ad000 tx=0x7fe0580a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:35.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.791+0000 7fe064c00640 1 -- 172.21.15.144:0/382668440 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe060055eb0 con 0x7fe0681602a0 2024-09-12T12:15:35.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.959+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0680b77b0 con 0x7fe0440678f0 2024-09-12T12:15:35.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.967+0000 7fe064c00640 1 -- 172.21.15.144:0/382668440 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251961 (secure 0 0 0) 0x7fe0680b77b0 con 0x7fe0440678f0 2024-09-12T12:15:35.971 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:35.973 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0440678f0 msgr2=0x7fe044069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0440678f0 0x7fe044069db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe0580ad000 tx=0x7fe0580a6000 comp rx=0 tx=0).stop 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0681602a0 msgr2=0x7fe068156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0681602a0 0x7fe068156c60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe06000c780 tx=0x7fe06000cc40 comp rx=0 tx=0).stop 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 shutdown_connections 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0440678f0 0x7fe044069db0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0681602a0 0x7fe068156c60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe06815e590 0x7fe0681531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 --2- 172.21.15.144:0/382668440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0680d1950 0x7fe06814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 >> 172.21.15.144:0/382668440 conn(0x7fe0680b41d0 msgr2=0x7fe068075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 shutdown_connections 2024-09-12T12:15:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:35.971+0000 7fe06da00640 1 -- 172.21.15.144:0/382668440 wait complete. 2024-09-12T12:15:35.991 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-12T12:15:35.411109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284904,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754689816,"statfs":{"total":773094113280,"available":772802371584,"internally_reserved":0,"allocated":6397952,"data_stored":3491012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.444849"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000851+0000","last_change":"2024-09-12T12:15:30.003581+0000","last_active":"2024-09-12T12:15:31.000851+0000","last_peered":"2024-09-12T12:15:31.000851+0000","last_clean":"2024-09-12T12:15:31.000851+0000","last_became_active":"2024-09-12T12:15:29.998278+0000","last_became_peered":"2024-09-12T12:15:29.998278+0000","last_unstale":"2024-09-12T12:15:31.000851+0000","last_undegraded":"2024-09-12T12:15:31.000851+0000","last_fullsized":"2024-09-12T12:15:31.000851+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:13.073981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013514+0000","last_change":"2024-09-12T12:15:30.000196+0000","last_active":"2024-09-12T12:15:31.013514+0000","last_peered":"2024-09-12T12:15:31.013514+0000","last_clean":"2024-09-12T12:15:31.013514+0000","last_became_active":"2024-09-12T12:15:29.999711+0000","last_became_peered":"2024-09-12T12:15:29.999711+0000","last_unstale":"2024-09-12T12:15:31.013514+0000","last_undegraded":"2024-09-12T12:15:31.013514+0000","last_fullsized":"2024-09-12T12:15:31.013514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:27.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011811+0000","last_change":"2024-09-12T12:15:30.003228+0000","last_active":"2024-09-12T12:15:31.011811+0000","last_peered":"2024-09-12T12:15:31.011811+0000","last_clean":"2024-09-12T12:15:31.011811+0000","last_became_active":"2024-09-12T12:15:30.001737+0000","last_became_peered":"2024-09-12T12:15:30.001737+0000","last_unstale":"2024-09-12T12:15:31.011811+0000","last_undegraded":"2024-09-12T12:15:31.011811+0000","last_fullsized":"2024-09-12T12:15:31.011811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:13.949659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013389+0000","last_change":"2024-09-12T12:15:30.007179+0000","last_active":"2024-09-12T12:15:31.013389+0000","last_peered":"2024-09-12T12:15:31.013389+0000","last_clean":"2024-09-12T12:15:31.013389+0000","last_became_active":"2024-09-12T12:15:30.006891+0000","last_became_peered":"2024-09-12T12:15:30.006891+0000","last_unstale":"2024-09-12T12:15:31.013389+0000","last_undegraded":"2024-09-12T12:15:31.013389+0000","last_fullsized":"2024-09-12T12:15:31.013389+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:12.426078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999717+0000","last_change":"2024-09-12T12:15:29.996231+0000","last_active":"2024-09-12T12:15:30.999717+0000","last_peered":"2024-09-12T12:15:30.999717+0000","last_clean":"2024-09-12T12:15:30.999717+0000","last_became_active":"2024-09-12T12:15:29.995886+0000","last_became_peered":"2024-09-12T12:15:29.995886+0000","last_unstale":"2024-09-12T12:15:30.999717+0000","last_undegraded":"2024-09-12T12:15:30.999717+0000","last_fullsized":"2024-09-12T12:15:30.999717+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:49.395567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000418+0000","last_change":"2024-09-12T12:15:29.995344+0000","last_active":"2024-09-12T12:15:31.000418+0000","last_peered":"2024-09-12T12:15:31.000418+0000","last_clean":"2024-09-12T12:15:31.000418+0000","last_became_active":"2024-09-12T12:15:29.994095+0000","last_became_peered":"2024-09-12T12:15:29.994095+0000","last_unstale":"2024-09-12T12:15:31.000418+0000","last_undegraded":"2024-09-12T12:15:31.000418+0000","last_fullsized":"2024-09-12T12:15:31.000418+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:26.055659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011367+0000","last_change":"2024-09-12T12:15:30.006241+0000","last_active":"2024-09-12T12:15:31.011367+0000","last_peered":"2024-09-12T12:15:31.011367+0000","last_clean":"2024-09-12T12:15:31.011367+0000","last_became_active":"2024-09-12T12:15:30.005937+0000","last_became_peered":"2024-09-12T12:15:30.005937+0000","last_unstale":"2024-09-12T12:15:31.011367+0000","last_undegraded":"2024-09-12T12:15:31.011367+0000","last_fullsized":"2024-09-12T12:15:31.011367+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:44.200116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340289+0000","last_change":"2024-09-12T12:15:30.002658+0000","last_active":"2024-09-12T12:15:32.340289+0000","last_peered":"2024-09-12T12:15:32.340289+0000","last_clean":"2024-09-12T12:15:32.340289+0000","last_became_active":"2024-09-12T12:15:30.002419+0000","last_became_peered":"2024-09-12T12:15:30.002419+0000","last_unstale":"2024-09-12T12:15:32.340289+0000","last_undegraded":"2024-09-12T12:15:32.340289+0000","last_fullsized":"2024-09-12T12:15:32.340289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:23:20.075494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340853+0000","last_change":"2024-09-12T12:15:30.007470+0000","last_active":"2024-09-12T12:15:32.340853+0000","last_peered":"2024-09-12T12:15:32.340853+0000","last_clean":"2024-09-12T12:15:32.340853+0000","last_became_active":"2024-09-12T12:15:30.007128+0000","last_became_peered":"2024-09-12T12:15:30.007128+0000","last_unstale":"2024-09-12T12:15:32.340853+0000","last_undegraded":"2024-09-12T12:15:32.340853+0000","last_fullsized":"2024-09-12T12:15:32.340853+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:21.484859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000841+0000","last_change":"2024-09-12T12:15:29.987059+0000","last_active":"2024-09-12T12:15:31.000841+0000","last_peered":"2024-09-12T12:15:31.000841+0000","last_clean":"2024-09-12T12:15:31.000841+0000","last_became_active":"2024-09-12T12:15:29.986738+0000","last_became_peered":"2024-09-12T12:15:29.986738+0000","last_unstale":"2024-09-12T12:15:31.000841+0000","last_undegraded":"2024-09-12T12:15:31.000841+0000","last_fullsized":"2024-09-12T12:15:31.000841+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:15.818895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340198+0000","last_change":"2024-09-12T12:15:29.995341+0000","last_active":"2024-09-12T12:15:32.340198+0000","last_peered":"2024-09-12T12:15:32.340198+0000","last_clean":"2024-09-12T12:15:32.340198+0000","last_became_active":"2024-09-12T12:15:29.995042+0000","last_became_peered":"2024-09-12T12:15:29.995042+0000","last_unstale":"2024-09-12T12:15:32.340198+0000","last_undegraded":"2024-09-12T12:15:32.340198+0000","last_fullsized":"2024-09-12T12:15:32.340198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:01.269600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340660+0000","last_change":"2024-09-12T12:15:30.001904+0000","last_active":"2024-09-12T12:15:32.340660+0000","last_peered":"2024-09-12T12:15:32.340660+0000","last_clean":"2024-09-12T12:15:32.340660+0000","last_became_active":"2024-09-12T12:15:30.000811+0000","last_became_peered":"2024-09-12T12:15:30.000811+0000","last_unstale":"2024-09-12T12:15:32.340660+0000","last_undegraded":"2024-09-12T12:15:32.340660+0000","last_fullsized":"2024-09-12T12:15:32.340660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:15.638405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000593+0000","last_change":"2024-09-12T12:15:29.986556+0000","last_active":"2024-09-12T12:15:31.000593+0000","last_peered":"2024-09-12T12:15:31.000593+0000","last_clean":"2024-09-12T12:15:31.000593+0000","last_became_active":"2024-09-12T12:15:29.986239+0000","last_became_peered":"2024-09-12T12:15:29.986239+0000","last_unstale":"2024-09-12T12:15:31.000593+0000","last_undegraded":"2024-09-12T12:15:31.000593+0000","last_fullsized":"2024-09-12T12:15:31.000593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:49.305348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011693+0000","last_change":"2024-09-12T12:15:30.020729+0000","last_active":"2024-09-12T12:15:31.011693+0000","last_peered":"2024-09-12T12:15:31.011693+0000","last_clean":"2024-09-12T12:15:31.011693+0000","last_became_active":"2024-09-12T12:15:30.020439+0000","last_became_peered":"2024-09-12T12:15:30.020439+0000","last_unstale":"2024-09-12T12:15:31.011693+0000","last_undegraded":"2024-09-12T12:15:31.011693+0000","last_fullsized":"2024-09-12T12:15:31.011693+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:45.647595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013217+0000","last_change":"2024-09-12T12:15:29.993265+0000","last_active":"2024-09-12T12:15:31.013217+0000","last_peered":"2024-09-12T12:15:31.013217+0000","last_clean":"2024-09-12T12:15:31.013217+0000","last_became_active":"2024-09-12T12:15:29.991866+0000","last_became_peered":"2024-09-12T12:15:29.991866+0000","last_unstale":"2024-09-12T12:15:31.013217+0000","last_undegraded":"2024-09-12T12:15:31.013217+0000","last_fullsized":"2024-09-12T12:15:31.013217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.084470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000313+0000","last_change":"2024-09-12T12:15:29.991618+0000","last_active":"2024-09-12T12:15:31.000313+0000","last_peered":"2024-09-12T12:15:31.000313+0000","last_clean":"2024-09-12T12:15:31.000313+0000","last_became_active":"2024-09-12T12:15:29.991241+0000","last_became_peered":"2024-09-12T12:15:29.991241+0000","last_unstale":"2024-09-12T12:15:31.000313+0000","last_undegraded":"2024-09-12T12:15:31.000313+0000","last_fullsized":"2024-09-12T12:15:31.000313+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:09.690276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012170+0000","last_change":"2024-09-12T12:15:30.003798+0000","last_active":"2024-09-12T12:15:31.012170+0000","last_peered":"2024-09-12T12:15:31.012170+0000","last_clean":"2024-09-12T12:15:31.012170+0000","last_became_active":"2024-09-12T12:15:30.001821+0000","last_became_peered":"2024-09-12T12:15:30.001821+0000","last_unstale":"2024-09-12T12:15:31.012170+0000","last_undegraded":"2024-09-12T12:15:31.012170+0000","last_fullsized":"2024-09-12T12:15:31.012170+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:55.291882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013608+0000","last_change":"2024-09-12T12:15:30.003065+0000","last_active":"2024-09-12T12:15:31.013608+0000","last_peered":"2024-09-12T12:15:31.013608+0000","last_clean":"2024-09-12T12:15:31.013608+0000","last_became_active":"2024-09-12T12:15:30.002746+0000","last_became_peered":"2024-09-12T12:15:30.002746+0000","last_unstale":"2024-09-12T12:15:31.013608+0000","last_undegraded":"2024-09-12T12:15:31.013608+0000","last_fullsized":"2024-09-12T12:15:31.013608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:44.200116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011827+0000","last_change":"2024-09-12T12:15:30.003735+0000","last_active":"2024-09-12T12:15:31.011827+0000","last_peered":"2024-09-12T12:15:31.011827+0000","last_clean":"2024-09-12T12:15:31.011827+0000","last_became_active":"2024-09-12T12:15:30.001363+0000","last_became_peered":"2024-09-12T12:15:30.001363+0000","last_unstale":"2024-09-12T12:15:31.011827+0000","last_undegraded":"2024-09-12T12:15:31.011827+0000","last_fullsized":"2024-09-12T12:15:31.011827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:39.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000688+0000","last_change":"2024-09-12T12:15:29.989427+0000","last_active":"2024-09-12T12:15:31.000688+0000","last_peered":"2024-09-12T12:15:31.000688+0000","last_clean":"2024-09-12T12:15:31.000688+0000","last_became_active":"2024-09-12T12:15:29.989148+0000","last_became_peered":"2024-09-12T12:15:29.989148+0000","last_unstale":"2024-09-12T12:15:31.000688+0000","last_undegraded":"2024-09-12T12:15:31.000688+0000","last_fullsized":"2024-09-12T12:15:31.000688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:43.341572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000605+0000","last_change":"2024-09-12T12:15:29.994292+0000","last_active":"2024-09-12T12:15:31.000605+0000","last_peered":"2024-09-12T12:15:31.000605+0000","last_clean":"2024-09-12T12:15:31.000605+0000","last_became_active":"2024-09-12T12:15:29.993287+0000","last_became_peered":"2024-09-12T12:15:29.993287+0000","last_unstale":"2024-09-12T12:15:31.000605+0000","last_undegraded":"2024-09-12T12:15:31.000605+0000","last_fullsized":"2024-09-12T12:15:31.000605+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:26.055659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339890+0000","last_change":"2024-09-12T12:15:30.021397+0000","last_active":"2024-09-12T12:15:32.339890+0000","last_peered":"2024-09-12T12:15:32.339890+0000","last_clean":"2024-09-12T12:15:32.339890+0000","last_became_active":"2024-09-12T12:15:30.021133+0000","last_became_peered":"2024-09-12T12:15:30.021133+0000","last_unstale":"2024-09-12T12:15:32.339890+0000","last_undegraded":"2024-09-12T12:15:32.339890+0000","last_fullsized":"2024-09-12T12:15:32.339890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:23.062738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339811+0000","last_change":"2024-09-12T12:15:29.994672+0000","last_active":"2024-09-12T12:15:32.339811+0000","last_peered":"2024-09-12T12:15:32.339811+0000","last_clean":"2024-09-12T12:15:32.339811+0000","last_became_active":"2024-09-12T12:15:29.994352+0000","last_became_peered":"2024-09-12T12:15:29.994352+0000","last_unstale":"2024-09-12T12:15:32.339811+0000","last_undegraded":"2024-09-12T12:15:32.339811+0000","last_fullsized":"2024-09-12T12:15:32.339811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:34.922600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011324+0000","last_change":"2024-09-12T12:15:30.002516+0000","last_active":"2024-09-12T12:15:31.011324+0000","last_peered":"2024-09-12T12:15:31.011324+0000","last_clean":"2024-09-12T12:15:31.011324+0000","last_became_active":"2024-09-12T12:15:30.001788+0000","last_became_peered":"2024-09-12T12:15:30.001788+0000","last_unstale":"2024-09-12T12:15:31.011324+0000","last_undegraded":"2024-09-12T12:15:31.011324+0000","last_fullsized":"2024-09-12T12:15:31.011324+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:27.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012296+0000","last_change":"2024-09-12T12:15:30.004403+0000","last_active":"2024-09-12T12:15:31.012296+0000","last_peered":"2024-09-12T12:15:31.012296+0000","last_clean":"2024-09-12T12:15:31.012296+0000","last_became_active":"2024-09-12T12:15:30.002948+0000","last_became_peered":"2024-09-12T12:15:30.002948+0000","last_unstale":"2024-09-12T12:15:31.012296+0000","last_undegraded":"2024-09-12T12:15:31.012296+0000","last_fullsized":"2024-09-12T12:15:31.012296+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:34.624789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340518+0000","last_change":"2024-09-12T12:15:30.005320+0000","last_active":"2024-09-12T12:15:32.340518+0000","last_peered":"2024-09-12T12:15:32.340518+0000","last_clean":"2024-09-12T12:15:32.340518+0000","last_became_active":"2024-09-12T12:15:30.005051+0000","last_became_peered":"2024-09-12T12:15:30.005051+0000","last_unstale":"2024-09-12T12:15:32.340518+0000","last_undegraded":"2024-09-12T12:15:32.340518+0000","last_fullsized":"2024-09-12T12:15:32.340518+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:55.291882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000843+0000","last_change":"2024-09-12T12:15:30.006013+0000","last_active":"2024-09-12T12:15:31.000843+0000","last_peered":"2024-09-12T12:15:31.000843+0000","last_clean":"2024-09-12T12:15:31.000843+0000","last_became_active":"2024-09-12T12:15:30.005697+0000","last_became_peered":"2024-09-12T12:15:30.005697+0000","last_unstale":"2024-09-12T12:15:31.000843+0000","last_undegraded":"2024-09-12T12:15:31.000843+0000","last_fullsized":"2024-09-12T12:15:31.000843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:57.413888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000726+0000","last_change":"2024-09-12T12:15:29.994672+0000","last_active":"2024-09-12T12:15:31.000726+0000","last_peered":"2024-09-12T12:15:31.000726+0000","last_clean":"2024-09-12T12:15:31.000726+0000","last_became_active":"2024-09-12T12:15:29.994374+0000","last_became_peered":"2024-09-12T12:15:29.994374+0000","last_unstale":"2024-09-12T12:15:31.000726+0000","last_undegraded":"2024-09-12T12:15:31.000726+0000","last_fullsized":"2024-09-12T12:15:31.000726+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:43.508119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011479+0000","last_change":"2024-09-12T12:15:30.006704+0000","last_active":"2024-09-12T12:15:31.011479+0000","last_peered":"2024-09-12T12:15:31.011479+0000","last_clean":"2024-09-12T12:15:31.011479+0000","last_became_active":"2024-09-12T12:15:30.006412+0000","last_became_peered":"2024-09-12T12:15:30.006412+0000","last_unstale":"2024-09-12T12:15:31.011479+0000","last_undegraded":"2024-09-12T12:15:31.011479+0000","last_fullsized":"2024-09-12T12:15:31.011479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:58.835451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013474+0000","last_change":"2024-09-12T12:15:30.006145+0000","last_active":"2024-09-12T12:15:31.013474+0000","last_peered":"2024-09-12T12:15:31.013474+0000","last_clean":"2024-09-12T12:15:31.013474+0000","last_became_active":"2024-09-12T12:15:30.004690+0000","last_became_peered":"2024-09-12T12:15:30.004690+0000","last_unstale":"2024-09-12T12:15:31.013474+0000","last_undegraded":"2024-09-12T12:15:31.013474+0000","last_fullsized":"2024-09-12T12:15:31.013474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:49.354669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011487+0000","last_change":"2024-09-12T12:15:29.996477+0000","last_active":"2024-09-12T12:15:31.011487+0000","last_peered":"2024-09-12T12:15:31.011487+0000","last_clean":"2024-09-12T12:15:31.011487+0000","last_became_active":"2024-09-12T12:15:29.996190+0000","last_became_peered":"2024-09-12T12:15:29.996190+0000","last_unstale":"2024-09-12T12:15:31.011487+0000","last_undegraded":"2024-09-12T12:15:31.011487+0000","last_fullsized":"2024-09-12T12:15:31.011487+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:40.379955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292117+0000","last_change":"2024-09-12T12:15:30.003094+0000","last_active":"2024-09-12T12:15:31.292117+0000","last_peered":"2024-09-12T12:15:31.292117+0000","last_clean":"2024-09-12T12:15:31.292117+0000","last_became_active":"2024-09-12T12:15:30.002671+0000","last_became_peered":"2024-09-12T12:15:30.002671+0000","last_unstale":"2024-09-12T12:15:31.292117+0000","last_undegraded":"2024-09-12T12:15:31.292117+0000","last_fullsized":"2024-09-12T12:15:31.292117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:27.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013053+0000","last_change":"2024-09-12T12:15:30.005417+0000","last_active":"2024-09-12T12:15:31.013053+0000","last_peered":"2024-09-12T12:15:31.013053+0000","last_clean":"2024-09-12T12:15:31.013053+0000","last_became_active":"2024-09-12T12:15:30.002173+0000","last_became_peered":"2024-09-12T12:15:30.002173+0000","last_unstale":"2024-09-12T12:15:31.013053+0000","last_undegraded":"2024-09-12T12:15:31.013053+0000","last_fullsized":"2024-09-12T12:15:31.013053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:40.771980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000885+0000","last_change":"2024-09-12T12:15:28.973024+0000","last_active":"2024-09-12T12:15:31.000885+0000","last_peered":"2024-09-12T12:15:31.000885+0000","last_clean":"2024-09-12T12:15:31.000885+0000","last_became_active":"2024-09-12T12:15:28.972768+0000","last_became_peered":"2024-09-12T12:15:28.972768+0000","last_unstale":"2024-09-12T12:15:31.000885+0000","last_undegraded":"2024-09-12T12:15:31.000885+0000","last_fullsized":"2024-09-12T12:15:31.000885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:59.726786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292263+0000","last_change":"2024-09-12T12:15:30.001290+0000","last_active":"2024-09-12T12:15:31.292263+0000","last_peered":"2024-09-12T12:15:31.292263+0000","last_clean":"2024-09-12T12:15:31.292263+0000","last_became_active":"2024-09-12T12:15:30.001038+0000","last_became_peered":"2024-09-12T12:15:30.001038+0000","last_unstale":"2024-09-12T12:15:31.292263+0000","last_undegraded":"2024-09-12T12:15:31.292263+0000","last_fullsized":"2024-09-12T12:15:31.292263+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:40.379955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000929+0000","last_change":"2024-09-12T12:15:28.997846+0000","last_active":"2024-09-12T12:15:31.000929+0000","last_peered":"2024-09-12T12:15:31.000929+0000","last_clean":"2024-09-12T12:15:31.000929+0000","last_became_active":"2024-09-12T12:15:28.997572+0000","last_became_peered":"2024-09-12T12:15:28.997572+0000","last_unstale":"2024-09-12T12:15:31.000929+0000","last_undegraded":"2024-09-12T12:15:31.000929+0000","last_fullsized":"2024-09-12T12:15:31.000929+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:08.450301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000436+0000","last_change":"2024-09-12T12:15:29.996330+0000","last_active":"2024-09-12T12:15:31.000436+0000","last_peered":"2024-09-12T12:15:31.000436+0000","last_clean":"2024-09-12T12:15:31.000436+0000","last_became_active":"2024-09-12T12:15:29.992481+0000","last_became_peered":"2024-09-12T12:15:29.992481+0000","last_unstale":"2024-09-12T12:15:31.000436+0000","last_undegraded":"2024-09-12T12:15:31.000436+0000","last_fullsized":"2024-09-12T12:15:31.000436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:09.690276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000846+0000","last_change":"2024-09-12T12:15:28.980175+0000","last_active":"2024-09-12T12:15:31.000846+0000","last_peered":"2024-09-12T12:15:31.000846+0000","last_clean":"2024-09-12T12:15:31.000846+0000","last_became_active":"2024-09-12T12:15:28.979558+0000","last_became_peered":"2024-09-12T12:15:28.979558+0000","last_unstale":"2024-09-12T12:15:31.000846+0000","last_undegraded":"2024-09-12T12:15:31.000846+0000","last_fullsized":"2024-09-12T12:15:31.000846+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:59.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340271+0000","last_change":"2024-09-12T12:15:29.996929+0000","last_active":"2024-09-12T12:15:32.340271+0000","last_peered":"2024-09-12T12:15:32.340271+0000","last_clean":"2024-09-12T12:15:32.340271+0000","last_became_active":"2024-09-12T12:15:29.996627+0000","last_became_peered":"2024-09-12T12:15:29.996627+0000","last_unstale":"2024-09-12T12:15:32.340271+0000","last_undegraded":"2024-09-12T12:15:32.340271+0000","last_fullsized":"2024-09-12T12:15:32.340271+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:40.909134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292143+0000","last_change":"2024-09-12T12:15:28.998874+0000","last_active":"2024-09-12T12:15:31.292143+0000","last_peered":"2024-09-12T12:15:31.292143+0000","last_clean":"2024-09-12T12:15:31.292143+0000","last_became_active":"2024-09-12T12:15:28.998570+0000","last_became_peered":"2024-09-12T12:15:28.998570+0000","last_unstale":"2024-09-12T12:15:31.292143+0000","last_undegraded":"2024-09-12T12:15:31.292143+0000","last_fullsized":"2024-09-12T12:15:31.292143+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:12.067885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999800+0000","last_change":"2024-09-12T12:15:30.000686+0000","last_active":"2024-09-12T12:15:30.999800+0000","last_peered":"2024-09-12T12:15:30.999800+0000","last_clean":"2024-09-12T12:15:30.999800+0000","last_became_active":"2024-09-12T12:15:30.000318+0000","last_became_peered":"2024-09-12T12:15:30.000318+0000","last_unstale":"2024-09-12T12:15:30.999800+0000","last_undegraded":"2024-09-12T12:15:30.999800+0000","last_fullsized":"2024-09-12T12:15:30.999800+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:32:06.373968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011503+0000","last_change":"2024-09-12T12:15:28.990368+0000","last_active":"2024-09-12T12:15:31.011503+0000","last_peered":"2024-09-12T12:15:31.011503+0000","last_clean":"2024-09-12T12:15:31.011503+0000","last_became_active":"2024-09-12T12:15:28.990126+0000","last_became_peered":"2024-09-12T12:15:28.990126+0000","last_unstale":"2024-09-12T12:15:31.011503+0000","last_undegraded":"2024-09-12T12:15:31.011503+0000","last_fullsized":"2024-09-12T12:15:31.011503+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:01.219312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013282+0000","last_change":"2024-09-12T12:15:30.005692+0000","last_active":"2024-09-12T12:15:31.013282+0000","last_peered":"2024-09-12T12:15:31.013282+0000","last_clean":"2024-09-12T12:15:31.013282+0000","last_became_active":"2024-09-12T12:15:30.005433+0000","last_became_peered":"2024-09-12T12:15:30.005433+0000","last_unstale":"2024-09-12T12:15:31.013282+0000","last_undegraded":"2024-09-12T12:15:31.013282+0000","last_fullsized":"2024-09-12T12:15:31.013282+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:46.521953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999511+0000","last_change":"2024-09-12T12:15:28.977317+0000","last_active":"2024-09-12T12:15:30.999511+0000","last_peered":"2024-09-12T12:15:30.999511+0000","last_clean":"2024-09-12T12:15:30.999511+0000","last_became_active":"2024-09-12T12:15:28.976850+0000","last_became_peered":"2024-09-12T12:15:28.976850+0000","last_unstale":"2024-09-12T12:15:30.999511+0000","last_undegraded":"2024-09-12T12:15:30.999511+0000","last_fullsized":"2024-09-12T12:15:30.999511+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:26.222947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340621+0000","last_change":"2024-09-12T12:15:30.005337+0000","last_active":"2024-09-12T12:15:32.340621+0000","last_peered":"2024-09-12T12:15:32.340621+0000","last_clean":"2024-09-12T12:15:32.340621+0000","last_became_active":"2024-09-12T12:15:30.005039+0000","last_became_peered":"2024-09-12T12:15:30.005039+0000","last_unstale":"2024-09-12T12:15:32.340621+0000","last_undegraded":"2024-09-12T12:15:32.340621+0000","last_fullsized":"2024-09-12T12:15:32.340621+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:34.624789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000300+0000","last_change":"2024-09-12T12:15:28.984535+0000","last_active":"2024-09-12T12:15:31.000300+0000","last_peered":"2024-09-12T12:15:31.000300+0000","last_clean":"2024-09-12T12:15:31.000300+0000","last_became_active":"2024-09-12T12:15:28.984229+0000","last_became_peered":"2024-09-12T12:15:28.984229+0000","last_unstale":"2024-09-12T12:15:31.000300+0000","last_undegraded":"2024-09-12T12:15:31.000300+0000","last_fullsized":"2024-09-12T12:15:31.000300+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:08.450301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013688+0000","last_change":"2024-09-12T12:15:30.006302+0000","last_active":"2024-09-12T12:15:31.013688+0000","last_peered":"2024-09-12T12:15:31.013688+0000","last_clean":"2024-09-12T12:15:31.013688+0000","last_became_active":"2024-09-12T12:15:30.006009+0000","last_became_peered":"2024-09-12T12:15:30.006009+0000","last_unstale":"2024-09-12T12:15:31.013688+0000","last_undegraded":"2024-09-12T12:15:31.013688+0000","last_fullsized":"2024-09-12T12:15:31.013688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:58.835451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011347+0000","last_change":"2024-09-12T12:15:28.979840+0000","last_active":"2024-09-12T12:15:31.011347+0000","last_peered":"2024-09-12T12:15:31.011347+0000","last_clean":"2024-09-12T12:15:31.011347+0000","last_became_active":"2024-09-12T12:15:28.979629+0000","last_became_peered":"2024-09-12T12:15:28.979629+0000","last_unstale":"2024-09-12T12:15:31.011347+0000","last_undegraded":"2024-09-12T12:15:31.011347+0000","last_fullsized":"2024-09-12T12:15:31.011347+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:54.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999493+0000","last_change":"2024-09-12T12:15:29.995528+0000","last_active":"2024-09-12T12:15:30.999493+0000","last_peered":"2024-09-12T12:15:30.999493+0000","last_clean":"2024-09-12T12:15:30.999493+0000","last_became_active":"2024-09-12T12:15:29.995269+0000","last_became_peered":"2024-09-12T12:15:29.995269+0000","last_unstale":"2024-09-12T12:15:30.999493+0000","last_undegraded":"2024-09-12T12:15:30.999493+0000","last_fullsized":"2024-09-12T12:15:30.999493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.918299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013642+0000","last_change":"2024-09-12T12:15:28.985794+0000","last_active":"2024-09-12T12:15:31.013642+0000","last_peered":"2024-09-12T12:15:31.013642+0000","last_clean":"2024-09-12T12:15:31.013642+0000","last_became_active":"2024-09-12T12:15:28.985514+0000","last_became_peered":"2024-09-12T12:15:28.985514+0000","last_unstale":"2024-09-12T12:15:31.013642+0000","last_undegraded":"2024-09-12T12:15:31.013642+0000","last_fullsized":"2024-09-12T12:15:31.013642+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.299252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.291896+0000","last_change":"2024-09-12T12:15:30.004964+0000","last_active":"2024-09-12T12:15:31.291896+0000","last_peered":"2024-09-12T12:15:31.291896+0000","last_clean":"2024-09-12T12:15:31.291896+0000","last_became_active":"2024-09-12T12:15:30.004638+0000","last_became_peered":"2024-09-12T12:15:30.004638+0000","last_unstale":"2024-09-12T12:15:31.291896+0000","last_undegraded":"2024-09-12T12:15:31.291896+0000","last_fullsized":"2024-09-12T12:15:31.291896+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:46.521953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000733+0000","last_change":"2024-09-12T12:15:28.981586+0000","last_active":"2024-09-12T12:15:31.000733+0000","last_peered":"2024-09-12T12:15:31.000733+0000","last_clean":"2024-09-12T12:15:31.000733+0000","last_became_active":"2024-09-12T12:15:28.981224+0000","last_became_peered":"2024-09-12T12:15:28.981224+0000","last_unstale":"2024-09-12T12:15:31.000733+0000","last_undegraded":"2024-09-12T12:15:31.000733+0000","last_fullsized":"2024-09-12T12:15:31.000733+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:08.450301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011544+0000","last_change":"2024-09-12T12:15:30.008799+0000","last_active":"2024-09-12T12:15:31.011544+0000","last_peered":"2024-09-12T12:15:31.011544+0000","last_clean":"2024-09-12T12:15:31.011544+0000","last_became_active":"2024-09-12T12:15:30.002897+0000","last_became_peered":"2024-09-12T12:15:30.002897+0000","last_unstale":"2024-09-12T12:15:31.011544+0000","last_undegraded":"2024-09-12T12:15:31.011544+0000","last_fullsized":"2024-09-12T12:15:31.011544+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:06.077459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013567+0000","last_change":"2024-09-12T12:15:28.995320+0000","last_active":"2024-09-12T12:15:31.013567+0000","last_peered":"2024-09-12T12:15:31.013567+0000","last_clean":"2024-09-12T12:15:31.013567+0000","last_became_active":"2024-09-12T12:15:28.995054+0000","last_became_peered":"2024-09-12T12:15:28.995054+0000","last_unstale":"2024-09-12T12:15:31.013567+0000","last_undegraded":"2024-09-12T12:15:31.013567+0000","last_fullsized":"2024-09-12T12:15:31.013567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:32.670718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999780+0000","last_change":"2024-09-12T12:15:29.993010+0000","last_active":"2024-09-12T12:15:30.999780+0000","last_peered":"2024-09-12T12:15:30.999780+0000","last_clean":"2024-09-12T12:15:30.999780+0000","last_became_active":"2024-09-12T12:15:29.992745+0000","last_became_peered":"2024-09-12T12:15:29.992745+0000","last_unstale":"2024-09-12T12:15:30.999780+0000","last_undegraded":"2024-09-12T12:15:30.999780+0000","last_fullsized":"2024-09-12T12:15:30.999780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:02.225408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"53'6","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340661+0000","last_change":"2024-09-12T12:15:28.996444+0000","last_active":"2024-09-12T12:15:32.340661+0000","last_peered":"2024-09-12T12:15:32.340661+0000","last_clean":"2024-09-12T12:15:32.340661+0000","last_became_active":"2024-09-12T12:15:28.996157+0000","last_became_peered":"2024-09-12T12:15:28.996157+0000","last_unstale":"2024-09-12T12:15:32.340661+0000","last_undegraded":"2024-09-12T12:15:32.340661+0000","last_fullsized":"2024-09-12T12:15:32.340661+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:01.676839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.291989+0000","last_change":"2024-09-12T12:15:29.999812+0000","last_active":"2024-09-12T12:15:31.291989+0000","last_peered":"2024-09-12T12:15:31.291989+0000","last_clean":"2024-09-12T12:15:31.291989+0000","last_became_active":"2024-09-12T12:15:29.999375+0000","last_became_peered":"2024-09-12T12:15:29.999375+0000","last_unstale":"2024-09-12T12:15:31.291989+0000","last_undegraded":"2024-09-12T12:15:31.291989+0000","last_fullsized":"2024-09-12T12:15:31.291989+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:12.426078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011585+0000","last_change":"2024-09-12T12:15:28.986459+0000","last_active":"2024-09-12T12:15:31.011585+0000","last_peered":"2024-09-12T12:15:31.011585+0000","last_clean":"2024-09-12T12:15:31.011585+0000","last_became_active":"2024-09-12T12:15:28.986199+0000","last_became_peered":"2024-09-12T12:15:28.986199+0000","last_unstale":"2024-09-12T12:15:31.011585+0000","last_undegraded":"2024-09-12T12:15:31.011585+0000","last_fullsized":"2024-09-12T12:15:31.011585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:32:05.367872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011970+0000","last_change":"2024-09-12T12:15:30.005618+0000","last_active":"2024-09-12T12:15:31.011970+0000","last_peered":"2024-09-12T12:15:31.011970+0000","last_clean":"2024-09-12T12:15:31.011970+0000","last_became_active":"2024-09-12T12:15:30.005376+0000","last_became_peered":"2024-09-12T12:15:30.005376+0000","last_unstale":"2024-09-12T12:15:31.011970+0000","last_undegraded":"2024-09-12T12:15:31.011970+0000","last_fullsized":"2024-09-12T12:15:31.011970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:23.062738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000330+0000","last_change":"2024-09-12T12:15:28.981615+0000","last_active":"2024-09-12T12:15:31.000330+0000","last_peered":"2024-09-12T12:15:31.000330+0000","last_clean":"2024-09-12T12:15:31.000330+0000","last_became_active":"2024-09-12T12:15:28.981365+0000","last_became_peered":"2024-09-12T12:15:28.981365+0000","last_unstale":"2024-09-12T12:15:31.000330+0000","last_undegraded":"2024-09-12T12:15:31.000330+0000","last_fullsized":"2024-09-12T12:15:31.000330+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:59.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340649+0000","last_change":"2024-09-12T12:15:30.001274+0000","last_active":"2024-09-12T12:15:32.340649+0000","last_peered":"2024-09-12T12:15:32.340649+0000","last_clean":"2024-09-12T12:15:32.340649+0000","last_became_active":"2024-09-12T12:15:30.000987+0000","last_became_peered":"2024-09-12T12:15:30.000987+0000","last_unstale":"2024-09-12T12:15:32.340649+0000","last_undegraded":"2024-09-12T12:15:32.340649+0000","last_fullsized":"2024-09-12T12:15:32.340649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:24.877522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013300+0000","last_change":"2024-09-12T12:15:28.986783+0000","last_active":"2024-09-12T12:15:31.013300+0000","last_peered":"2024-09-12T12:15:31.013300+0000","last_clean":"2024-09-12T12:15:31.013300+0000","last_became_active":"2024-09-12T12:15:28.985415+0000","last_became_peered":"2024-09-12T12:15:28.985415+0000","last_unstale":"2024-09-12T12:15:31.013300+0000","last_undegraded":"2024-09-12T12:15:31.013300+0000","last_fullsized":"2024-09-12T12:15:31.013300+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:42.502023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012145+0000","last_change":"2024-09-12T12:15:30.004054+0000","last_active":"2024-09-12T12:15:31.012145+0000","last_peered":"2024-09-12T12:15:31.012145+0000","last_clean":"2024-09-12T12:15:31.012145+0000","last_became_active":"2024-09-12T12:15:30.002384+0000","last_became_peered":"2024-09-12T12:15:30.002384+0000","last_unstale":"2024-09-12T12:15:31.012145+0000","last_undegraded":"2024-09-12T12:15:31.012145+0000","last_fullsized":"2024-09-12T12:15:31.012145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:20.159552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339985+0000","last_change":"2024-09-12T12:15:28.993668+0000","last_active":"2024-09-12T12:15:32.339985+0000","last_peered":"2024-09-12T12:15:32.339985+0000","last_clean":"2024-09-12T12:15:32.339985+0000","last_became_active":"2024-09-12T12:15:28.993395+0000","last_became_peered":"2024-09-12T12:15:28.993395+0000","last_unstale":"2024-09-12T12:15:32.339985+0000","last_undegraded":"2024-09-12T12:15:32.339985+0000","last_fullsized":"2024-09-12T12:15:32.339985+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:04.903477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339849+0000","last_change":"2024-09-12T12:15:30.004025+0000","last_active":"2024-09-12T12:15:32.339849+0000","last_peered":"2024-09-12T12:15:32.339849+0000","last_clean":"2024-09-12T12:15:32.339849+0000","last_became_active":"2024-09-12T12:15:30.003667+0000","last_became_peered":"2024-09-12T12:15:30.003667+0000","last_unstale":"2024-09-12T12:15:32.339849+0000","last_undegraded":"2024-09-12T12:15:32.339849+0000","last_fullsized":"2024-09-12T12:15:32.339849+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:39.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012291+0000","last_change":"2024-09-12T12:15:28.999035+0000","last_active":"2024-09-12T12:15:31.012291+0000","last_peered":"2024-09-12T12:15:31.012291+0000","last_clean":"2024-09-12T12:15:31.012291+0000","last_became_active":"2024-09-12T12:15:28.998733+0000","last_became_peered":"2024-09-12T12:15:28.998733+0000","last_unstale":"2024-09-12T12:15:31.012291+0000","last_undegraded":"2024-09-12T12:15:31.012291+0000","last_fullsized":"2024-09-12T12:15:31.012291+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:25.049563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000368+0000","last_change":"2024-09-12T12:15:30.020286+0000","last_active":"2024-09-12T12:15:31.000368+0000","last_peered":"2024-09-12T12:15:31.000368+0000","last_clean":"2024-09-12T12:15:31.000368+0000","last_became_active":"2024-09-12T12:15:30.020060+0000","last_became_peered":"2024-09-12T12:15:30.020060+0000","last_unstale":"2024-09-12T12:15:31.000368+0000","last_undegraded":"2024-09-12T12:15:31.000368+0000","last_fullsized":"2024-09-12T12:15:31.000368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:43.341572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340134+0000","last_change":"2024-09-12T12:15:28.988145+0000","last_active":"2024-09-12T12:15:32.340134+0000","last_peered":"2024-09-12T12:15:32.340134+0000","last_clean":"2024-09-12T12:15:32.340134+0000","last_became_active":"2024-09-12T12:15:28.987869+0000","last_became_peered":"2024-09-12T12:15:28.987869+0000","last_unstale":"2024-09-12T12:15:32.340134+0000","last_undegraded":"2024-09-12T12:15:32.340134+0000","last_fullsized":"2024-09-12T12:15:32.340134+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:47.634420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999679+0000","last_change":"2024-09-12T12:15:30.004717+0000","last_active":"2024-09-12T12:15:30.999679+0000","last_peered":"2024-09-12T12:15:30.999679+0000","last_clean":"2024-09-12T12:15:30.999679+0000","last_became_active":"2024-09-12T12:15:30.004445+0000","last_became_peered":"2024-09-12T12:15:30.004445+0000","last_unstale":"2024-09-12T12:15:30.999679+0000","last_undegraded":"2024-09-12T12:15:30.999679+0000","last_fullsized":"2024-09-12T12:15:30.999679+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:34.226464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000852+0000","last_change":"2024-09-12T12:15:28.991659+0000","last_active":"2024-09-12T12:15:31.000852+0000","last_peered":"2024-09-12T12:15:31.000852+0000","last_clean":"2024-09-12T12:15:31.000852+0000","last_became_active":"2024-09-12T12:15:28.991363+0000","last_became_peered":"2024-09-12T12:15:28.991363+0000","last_unstale":"2024-09-12T12:15:31.000852+0000","last_undegraded":"2024-09-12T12:15:31.000852+0000","last_fullsized":"2024-09-12T12:15:31.000852+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:26.222947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000568+0000","last_change":"2024-09-12T12:15:30.006376+0000","last_active":"2024-09-12T12:15:31.000568+0000","last_peered":"2024-09-12T12:15:31.000568+0000","last_clean":"2024-09-12T12:15:31.000568+0000","last_became_active":"2024-09-12T12:15:29.998610+0000","last_became_peered":"2024-09-12T12:15:29.998610+0000","last_unstale":"2024-09-12T12:15:31.000568+0000","last_undegraded":"2024-09-12T12:15:31.000568+0000","last_fullsized":"2024-09-12T12:15:31.000568+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:33.676814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000800+0000","last_change":"2024-09-12T12:15:28.997415+0000","last_active":"2024-09-12T12:15:31.000800+0000","last_peered":"2024-09-12T12:15:31.000800+0000","last_clean":"2024-09-12T12:15:31.000800+0000","last_became_active":"2024-09-12T12:15:28.997122+0000","last_became_peered":"2024-09-12T12:15:28.997122+0000","last_unstale":"2024-09-12T12:15:31.000800+0000","last_undegraded":"2024-09-12T12:15:31.000800+0000","last_fullsized":"2024-09-12T12:15:31.000800+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:37.433511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.291993+0000","last_change":"2024-09-12T12:15:29.994311+0000","last_active":"2024-09-12T12:15:31.291993+0000","last_peered":"2024-09-12T12:15:31.291993+0000","last_clean":"2024-09-12T12:15:31.291993+0000","last_became_active":"2024-09-12T12:15:29.994019+0000","last_became_peered":"2024-09-12T12:15:29.994019+0000","last_unstale":"2024-09-12T12:15:31.291993+0000","last_undegraded":"2024-09-12T12:15:31.291993+0000","last_fullsized":"2024-09-12T12:15:31.291993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:49.354669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000667+0000","last_change":"2024-09-12T12:15:28.991547+0000","last_active":"2024-09-12T12:15:31.000667+0000","last_peered":"2024-09-12T12:15:31.000667+0000","last_clean":"2024-09-12T12:15:31.000667+0000","last_became_active":"2024-09-12T12:15:28.988510+0000","last_became_peered":"2024-09-12T12:15:28.988510+0000","last_unstale":"2024-09-12T12:15:31.000667+0000","last_undegraded":"2024-09-12T12:15:31.000667+0000","last_fullsized":"2024-09-12T12:15:31.000667+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:26.222947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000749+0000","last_change":"2024-09-12T12:15:29.987528+0000","last_active":"2024-09-12T12:15:31.000749+0000","last_peered":"2024-09-12T12:15:31.000749+0000","last_clean":"2024-09-12T12:15:31.000749+0000","last_became_active":"2024-09-12T12:15:29.987189+0000","last_became_peered":"2024-09-12T12:15:29.987189+0000","last_unstale":"2024-09-12T12:15:31.000749+0000","last_undegraded":"2024-09-12T12:15:31.000749+0000","last_fullsized":"2024-09-12T12:15:31.000749+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:33.676814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340044+0000","last_change":"2024-09-12T12:15:28.995461+0000","last_active":"2024-09-12T12:15:32.340044+0000","last_peered":"2024-09-12T12:15:32.340044+0000","last_clean":"2024-09-12T12:15:32.340044+0000","last_became_active":"2024-09-12T12:15:28.995166+0000","last_became_peered":"2024-09-12T12:15:28.995166+0000","last_unstale":"2024-09-12T12:15:32.340044+0000","last_undegraded":"2024-09-12T12:15:32.340044+0000","last_fullsized":"2024-09-12T12:15:32.340044+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:39.765885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012112+0000","last_change":"2024-09-12T12:15:30.011903+0000","last_active":"2024-09-12T12:15:31.012112+0000","last_peered":"2024-09-12T12:15:31.012112+0000","last_clean":"2024-09-12T12:15:31.012112+0000","last_became_active":"2024-09-12T12:15:30.011180+0000","last_became_peered":"2024-09-12T12:15:30.011180+0000","last_unstale":"2024-09-12T12:15:31.012112+0000","last_undegraded":"2024-09-12T12:15:31.012112+0000","last_fullsized":"2024-09-12T12:15:31.012112+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:23:20.075494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011519+0000","last_change":"2024-09-12T12:15:28.993720+0000","last_active":"2024-09-12T12:15:31.011519+0000","last_peered":"2024-09-12T12:15:31.011519+0000","last_clean":"2024-09-12T12:15:31.011519+0000","last_became_active":"2024-09-12T12:15:28.993434+0000","last_became_peered":"2024-09-12T12:15:28.993434+0000","last_unstale":"2024-09-12T12:15:31.011519+0000","last_undegraded":"2024-09-12T12:15:31.011519+0000","last_fullsized":"2024-09-12T12:15:31.011519+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:42.335476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000964+0000","last_change":"2024-09-12T12:15:29.997929+0000","last_active":"2024-09-12T12:15:31.000964+0000","last_peered":"2024-09-12T12:15:31.000964+0000","last_clean":"2024-09-12T12:15:31.000964+0000","last_became_active":"2024-09-12T12:15:29.997522+0000","last_became_peered":"2024-09-12T12:15:29.997522+0000","last_unstale":"2024-09-12T12:15:31.000964+0000","last_undegraded":"2024-09-12T12:15:31.000964+0000","last_fullsized":"2024-09-12T12:15:31.000964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:37.753824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339623+0000","last_change":"2024-09-12T12:15:28.989717+0000","last_active":"2024-09-12T12:15:32.339623+0000","last_peered":"2024-09-12T12:15:32.339623+0000","last_clean":"2024-09-12T12:15:32.339623+0000","last_became_active":"2024-09-12T12:15:28.989405+0000","last_became_peered":"2024-09-12T12:15:28.989405+0000","last_unstale":"2024-09-12T12:15:32.339623+0000","last_undegraded":"2024-09-12T12:15:32.339623+0000","last_fullsized":"2024-09-12T12:15:32.339623+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:15.376022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292250+0000","last_change":"2024-09-12T12:15:30.003846+0000","last_active":"2024-09-12T12:15:31.292250+0000","last_peered":"2024-09-12T12:15:31.292250+0000","last_clean":"2024-09-12T12:15:31.292250+0000","last_became_active":"2024-09-12T12:15:30.003092+0000","last_became_peered":"2024-09-12T12:15:30.003092+0000","last_unstale":"2024-09-12T12:15:31.292250+0000","last_undegraded":"2024-09-12T12:15:31.292250+0000","last_fullsized":"2024-09-12T12:15:31.292250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:58.835451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000910+0000","last_change":"2024-09-12T12:15:28.983057+0000","last_active":"2024-09-12T12:15:31.000910+0000","last_peered":"2024-09-12T12:15:31.000910+0000","last_clean":"2024-09-12T12:15:31.000910+0000","last_became_active":"2024-09-12T12:15:28.982770+0000","last_became_peered":"2024-09-12T12:15:28.982770+0000","last_unstale":"2024-09-12T12:15:31.000910+0000","last_undegraded":"2024-09-12T12:15:31.000910+0000","last_fullsized":"2024-09-12T12:15:31.000910+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:41.313179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000523+0000","last_change":"2024-09-12T12:15:29.999640+0000","last_active":"2024-09-12T12:15:31.000523+0000","last_peered":"2024-09-12T12:15:31.000523+0000","last_clean":"2024-09-12T12:15:31.000523+0000","last_became_active":"2024-09-12T12:15:29.994495+0000","last_became_peered":"2024-09-12T12:15:29.994495+0000","last_unstale":"2024-09-12T12:15:31.000523+0000","last_undegraded":"2024-09-12T12:15:31.000523+0000","last_fullsized":"2024-09-12T12:15:31.000523+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:43.508119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013593+0000","last_change":"2024-09-12T12:15:28.989675+0000","last_active":"2024-09-12T12:15:31.013593+0000","last_peered":"2024-09-12T12:15:31.013593+0000","last_clean":"2024-09-12T12:15:31.013593+0000","last_became_active":"2024-09-12T12:15:28.989383+0000","last_became_peered":"2024-09-12T12:15:28.989383+0000","last_unstale":"2024-09-12T12:15:31.013593+0000","last_undegraded":"2024-09-12T12:15:31.013593+0000","last_fullsized":"2024-09-12T12:15:31.013593+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:14.812799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340476+0000","last_change":"2024-09-12T12:15:30.001588+0000","last_active":"2024-09-12T12:15:32.340476+0000","last_peered":"2024-09-12T12:15:32.340476+0000","last_clean":"2024-09-12T12:15:32.340476+0000","last_became_active":"2024-09-12T12:15:30.000471+0000","last_became_peered":"2024-09-12T12:15:30.000471+0000","last_unstale":"2024-09-12T12:15:32.340476+0000","last_undegraded":"2024-09-12T12:15:32.340476+0000","last_fullsized":"2024-09-12T12:15:32.340476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:20.159552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011687+0000","last_change":"2024-09-12T12:15:28.982400+0000","last_active":"2024-09-12T12:15:31.011687+0000","last_peered":"2024-09-12T12:15:31.011687+0000","last_clean":"2024-09-12T12:15:31.011687+0000","last_became_active":"2024-09-12T12:15:28.982103+0000","last_became_peered":"2024-09-12T12:15:28.982103+0000","last_unstale":"2024-09-12T12:15:31.011687+0000","last_undegraded":"2024-09-12T12:15:31.011687+0000","last_fullsized":"2024-09-12T12:15:31.011687+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:08.684180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011530+0000","last_change":"2024-09-12T12:15:30.007084+0000","last_active":"2024-09-12T12:15:31.011530+0000","last_peered":"2024-09-12T12:15:31.011530+0000","last_clean":"2024-09-12T12:15:31.011530+0000","last_became_active":"2024-09-12T12:15:30.006749+0000","last_became_peered":"2024-09-12T12:15:30.006749+0000","last_unstale":"2024-09-12T12:15:31.011530+0000","last_undegraded":"2024-09-12T12:15:31.011530+0000","last_fullsized":"2024-09-12T12:15:31.011530+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:53.512937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340422+0000","last_change":"2024-09-12T12:15:28.995466+0000","last_active":"2024-09-12T12:15:32.340422+0000","last_peered":"2024-09-12T12:15:32.340422+0000","last_clean":"2024-09-12T12:15:32.340422+0000","last_became_active":"2024-09-12T12:15:28.995180+0000","last_became_peered":"2024-09-12T12:15:28.995180+0000","last_unstale":"2024-09-12T12:15:32.340422+0000","last_undegraded":"2024-09-12T12:15:32.340422+0000","last_fullsized":"2024-09-12T12:15:32.340422+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:04.013840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.291993+0000","last_change":"2024-09-12T12:15:29.995581+0000","last_active":"2024-09-12T12:15:31.291993+0000","last_peered":"2024-09-12T12:15:31.291993+0000","last_clean":"2024-09-12T12:15:31.291993+0000","last_became_active":"2024-09-12T12:15:29.995201+0000","last_became_peered":"2024-09-12T12:15:29.995201+0000","last_unstale":"2024-09-12T12:15:31.291993+0000","last_undegraded":"2024-09-12T12:15:31.291993+0000","last_fullsized":"2024-09-12T12:15:31.291993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:44.200116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340183+0000","last_change":"2024-09-12T12:15:28.997623+0000","last_active":"2024-09-12T12:15:32.340183+0000","last_peered":"2024-09-12T12:15:32.340183+0000","last_clean":"2024-09-12T12:15:32.340183+0000","last_became_active":"2024-09-12T12:15:28.997361+0000","last_became_peered":"2024-09-12T12:15:28.997361+0000","last_unstale":"2024-09-12T12:15:32.340183+0000","last_undegraded":"2024-09-12T12:15:32.340183+0000","last_fullsized":"2024-09-12T12:15:32.340183+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:25.365908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012021+0000","last_change":"2024-09-12T12:15:30.019997+0000","last_active":"2024-09-12T12:15:31.012021+0000","last_peered":"2024-09-12T12:15:31.012021+0000","last_clean":"2024-09-12T12:15:31.012021+0000","last_became_active":"2024-09-12T12:15:30.019722+0000","last_became_peered":"2024-09-12T12:15:30.019722+0000","last_unstale":"2024-09-12T12:15:31.012021+0000","last_undegraded":"2024-09-12T12:15:31.012021+0000","last_fullsized":"2024-09-12T12:15:31.012021+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:40.909134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999415+0000","last_change":"2024-09-12T12:15:28.997529+0000","last_active":"2024-09-12T12:15:30.999415+0000","last_peered":"2024-09-12T12:15:30.999415+0000","last_clean":"2024-09-12T12:15:30.999415+0000","last_became_active":"2024-09-12T12:15:28.997217+0000","last_became_peered":"2024-09-12T12:15:28.997217+0000","last_unstale":"2024-09-12T12:15:30.999415+0000","last_undegraded":"2024-09-12T12:15:30.999415+0000","last_fullsized":"2024-09-12T12:15:30.999415+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:59.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340873+0000","last_change":"2024-09-12T12:15:29.997113+0000","last_active":"2024-09-12T12:15:32.340873+0000","last_peered":"2024-09-12T12:15:32.340873+0000","last_clean":"2024-09-12T12:15:32.340873+0000","last_became_active":"2024-09-12T12:15:29.996840+0000","last_became_peered":"2024-09-12T12:15:29.996840+0000","last_unstale":"2024-09-12T12:15:32.340873+0000","last_undegraded":"2024-09-12T12:15:32.340873+0000","last_fullsized":"2024-09-12T12:15:32.340873+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:53.332565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292244+0000","last_change":"2024-09-12T12:15:28.991866+0000","last_active":"2024-09-12T12:15:31.292244+0000","last_peered":"2024-09-12T12:15:31.292244+0000","last_clean":"2024-09-12T12:15:31.292244+0000","last_became_active":"2024-09-12T12:15:28.991562+0000","last_became_peered":"2024-09-12T12:15:28.991562+0000","last_unstale":"2024-09-12T12:15:31.292244+0000","last_undegraded":"2024-09-12T12:15:31.292244+0000","last_fullsized":"2024-09-12T12:15:31.292244+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:56.407792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000400+0000","last_change":"2024-09-12T12:15:30.000772+0000","last_active":"2024-09-12T12:15:31.000400+0000","last_peered":"2024-09-12T12:15:31.000400+0000","last_clean":"2024-09-12T12:15:31.000400+0000","last_became_active":"2024-09-12T12:15:30.000098+0000","last_became_peered":"2024-09-12T12:15:30.000098+0000","last_unstale":"2024-09-12T12:15:31.000400+0000","last_undegraded":"2024-09-12T12:15:31.000400+0000","last_fullsized":"2024-09-12T12:15:31.000400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.918299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012122+0000","last_change":"2024-09-12T12:15:28.985626+0000","last_active":"2024-09-12T12:15:31.012122+0000","last_peered":"2024-09-12T12:15:31.012122+0000","last_clean":"2024-09-12T12:15:31.012122+0000","last_became_active":"2024-09-12T12:15:28.985369+0000","last_became_peered":"2024-09-12T12:15:28.985369+0000","last_unstale":"2024-09-12T12:15:31.012122+0000","last_undegraded":"2024-09-12T12:15:31.012122+0000","last_fullsized":"2024-09-12T12:15:31.012122+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:42.502023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013029+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:15:31.013029+0000","last_peered":"2024-09-12T12:15:31.013029+0000","last_clean":"2024-09-12T12:15:31.013029+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:15:31.013029+0000","last_undegraded":"2024-09-12T12:15:31.013029+0000","last_fullsized":"2024-09-12T12:15:31.013029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1245184,"data_stored":878674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":288834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":643072,"data_stored":288182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":647168,"data_stored":288764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":659456,"data_stored":289816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":655360,"data_stored":289794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":651264,"data_stored":288342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36572,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335268,"statfs":{"total":96636764160,"available":96599314432,"internally_reserved":0,"allocated":1245184,"data_stored":878606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:15:38.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:15:39.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.139+0000 7fced2000640 1 Processor -- start 2024-09-12T12:15:39.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fced2000640 1 -- start start 2024-09-12T12:15:39.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fced2000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcecc15c220 0x7fcecc0d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fced2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcecc0b4200 0x7fcecc0b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fced2000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcecc0d1580 con 0x7fcecc0732c0 2024-09-12T12:15:39.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fced2000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcecc0b4bb0 con 0x7fcecc0b4200 2024-09-12T12:15:39.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fced2000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcecc0d1860 con 0x7fcecc15c220 2024-09-12T12:15:39.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fcecaa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcecc0b4200 0x7fcecc0b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fcecbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcecc0732c0 0x7fcecc0736d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37710/0 (socket says 172.21.15.144:37710) 2024-09-12T12:15:39.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fcecaa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcecc0b4200 0x7fcecc0b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52816/0 (socket says 172.21.15.144:52816) 2024-09-12T12:15:39.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fcecbe00640 1 -- 172.21.15.144:0/4037876135 learned_addr learned my addr 172.21.15.144:0/4037876135 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:39.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fcecb400640 1 --2- 172.21.15.144:0/4037876135 >> v2:172.21.15.165:3300/0 conn(0x7fcecc15c220 0x7fcecc0d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fcecaa00640 1 -- 172.21.15.144:0/4037876135 >> v2:172.21.15.165:3300/0 conn(0x7fcecc15c220 msgr2=0x7fcecc0d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:39.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fcecaa00640 1 --2- 172.21.15.144:0/4037876135 >> v2:172.21.15.165:3300/0 conn(0x7fcecc15c220 0x7fcecc0d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fcecaa00640 1 -- 172.21.15.144:0/4037876135 >> v1:172.21.15.144:6789/0 conn(0x7fcecc0732c0 legacy=0x7fcecc0736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fcecaa00640 1 -- 172.21.15.144:0/4037876135 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc0d1b40 con 0x7fcecc0b4200 2024-09-12T12:15:39.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.143+0000 7fceca000640 1 -- 172.21.15.144:0/4037876135 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543344720 0 0) 0x7fcecc0d1580 con 0x7fcecc0732c0 2024-09-12T12:15:39.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fcecaa00640 1 --2- 172.21.15.144:0/4037876135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0b4200 0x7fcecc0b4670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcecc074b30 tx=0x7fceb801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f992b986b95d8829 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:39.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fceca000640 1 -- 172.21.15.144:0/4037876135 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80ab650 con 0x7fcecc0b4200 2024-09-12T12:15:39.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fceca000640 1 -- 172.21.15.144:0/4037876135 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb80b0070 con 0x7fcecc0b4200 2024-09-12T12:15:39.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fceca000640 1 -- 172.21.15.144:0/4037876135 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80aba10 con 0x7fcecc0b4200 2024-09-12T12:15:39.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 -- 172.21.15.144:0/4037876135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0b4200 msgr2=0x7fcecc0b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 --2- 172.21.15.144:0/4037876135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0b4200 0x7fcecc0b4670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcecc074b30 tx=0x7fceb801c450 comp rx=0 tx=0).stop 2024-09-12T12:15:39.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 -- 172.21.15.144:0/4037876135 shutdown_connections 2024-09-12T12:15:39.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 --2- 172.21.15.144:0/4037876135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0b4200 0x7fcecc0b4670 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 --2- 172.21.15.144:0/4037876135 >> v2:172.21.15.165:3300/0 conn(0x7fcecc15c220 0x7fcecc0d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 -- 172.21.15.144:0/4037876135 >> 172.21.15.144:0/4037876135 conn(0x7fcecc06f400 msgr2=0x7fcecc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:39.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 -- 172.21.15.144:0/4037876135 shutdown_connections 2024-09-12T12:15:39.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 -- 172.21.15.144:0/4037876135 wait complete. 2024-09-12T12:15:39.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 Processor -- start 2024-09-12T12:15:39.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.147+0000 7fced2000640 1 -- start start 2024-09-12T12:15:39.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fced2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0732c0 0x7fcecc1f9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fced2000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcecc0b4200 0x7fcecc15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fced2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcecc15c220 0x7fcecc15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fced2000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc0d12d0 con 0x7fcecc0732c0 2024-09-12T12:15:39.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fced2000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc0d1150 con 0x7fcecc0b4200 2024-09-12T12:15:39.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fced2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc070bf0 con 0x7fcecc15c220 2024-09-12T12:15:39.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0732c0 0x7fcecc1f9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0732c0 0x7fcecc1f9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52824/0 (socket says 172.21.15.144:52824) 2024-09-12T12:15:39.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecb400640 1 -- 172.21.15.144:0/1462593631 learned_addr learned my addr 172.21.15.144:0/1462593631 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:39.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecaa00640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcecc0b4200 0x7fcecc15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecb400640 1 -- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcecc15c220 msgr2=0x7fcecc15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecbe00640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcecc15c220 0x7fcecc15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecb400640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcecc15c220 0x7fcecc15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecb400640 1 -- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcecc0b4200 msgr2=0x7fcecc15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecb400640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcecc0b4200 0x7fcecc15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecb400640 1 -- 172.21.15.144:0/1462593631 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc157530 con 0x7fcecc0732c0 2024-09-12T12:15:39.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecaa00640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcecc0b4200 0x7fcecc15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:39.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecbe00640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcecc15c220 0x7fcecc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:39.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcecb400640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0732c0 0x7fcecc1f9f50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00efc0 tx=0x7fcebc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:39.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcec3400640 1 -- 172.21.15.144:0/1462593631 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc018020 con 0x7fcecc0732c0 2024-09-12T12:15:39.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcec3400640 1 -- 172.21.15.144:0/1462593631 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc014480 con 0x7fcecc0732c0 2024-09-12T12:15:39.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcecc157810 con 0x7fcecc0732c0 2024-09-12T12:15:39.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fcec3400640 1 -- 172.21.15.144:0/1462593631 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc014850 con 0x7fcecc0732c0 2024-09-12T12:15:39.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcecc157dd0 con 0x7fcecc0732c0 2024-09-12T12:15:39.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.151+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcecc0b4670 con 0x7fcecc0732c0 2024-09-12T12:15:39.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.155+0000 7fcec3400640 1 -- 172.21.15.144:0/1462593631 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcebc01b020 con 0x7fcecc0732c0 2024-09-12T12:15:39.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.155+0000 7fcec3400640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fceac0678c0 0x7fceac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.155+0000 7fcec3400640 1 -- 172.21.15.144:0/1462593631 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fcebc0869a0 con 0x7fcecc0732c0 2024-09-12T12:15:39.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.155+0000 7fcecaa00640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fceac0678c0 0x7fceac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.155+0000 7fcecaa00640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fceac0678c0 0x7fceac069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fceb80af000 tx=0x7fceb80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:39.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.159+0000 7fcec3400640 1 -- 172.21.15.144:0/1462593631 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcebc022070 con 0x7fcecc0732c0 2024-09-12T12:15:39.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.315+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcecc0713a0 con 0x7fceac0678c0 2024-09-12T12:15:39.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.319+0000 7fcec3400640 1 -- 172.21.15.144:0/1462593631 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251961 (secure 0 0 0) 0x7fcecc0713a0 con 0x7fceac0678c0 2024-09-12T12:15:39.327 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:39.329 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:15:39.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fceac0678c0 msgr2=0x7fceac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fceac0678c0 0x7fceac069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fceb80af000 tx=0x7fceb80a7000 comp rx=0 tx=0).stop 2024-09-12T12:15:39.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0732c0 msgr2=0x7fcecc1f9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0732c0 0x7fcecc1f9f50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00efc0 tx=0x7fcebc00c490 comp rx=0 tx=0).stop 2024-09-12T12:15:39.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 shutdown_connections 2024-09-12T12:15:39.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fceac0678c0 0x7fceac069d80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcecc15c220 0x7fcecc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcecc0b4200 0x7fcecc15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 --2- 172.21.15.144:0/1462593631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcecc0732c0 0x7fcecc1f9f50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 >> 172.21.15.144:0/1462593631 conn(0x7fcecc06f400 msgr2=0x7fcecc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:39.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 shutdown_connections 2024-09-12T12:15:39.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.323+0000 7fced2000640 1 -- 172.21.15.144:0/1462593631 wait complete. 2024-09-12T12:15:39.346 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-12T12:15:37.411717+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284904,"kb_used_data":6248,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754689816,"statfs":{"total":773094113280,"available":772802371584,"internally_reserved":0,"allocated":6397952,"data_stored":3491012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":285134385},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001617"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000851+0000","last_change":"2024-09-12T12:15:30.003581+0000","last_active":"2024-09-12T12:15:31.000851+0000","last_peered":"2024-09-12T12:15:31.000851+0000","last_clean":"2024-09-12T12:15:31.000851+0000","last_became_active":"2024-09-12T12:15:29.998278+0000","last_became_peered":"2024-09-12T12:15:29.998278+0000","last_unstale":"2024-09-12T12:15:31.000851+0000","last_undegraded":"2024-09-12T12:15:31.000851+0000","last_fullsized":"2024-09-12T12:15:31.000851+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:13.073981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013514+0000","last_change":"2024-09-12T12:15:30.000196+0000","last_active":"2024-09-12T12:15:31.013514+0000","last_peered":"2024-09-12T12:15:31.013514+0000","last_clean":"2024-09-12T12:15:31.013514+0000","last_became_active":"2024-09-12T12:15:29.999711+0000","last_became_peered":"2024-09-12T12:15:29.999711+0000","last_unstale":"2024-09-12T12:15:31.013514+0000","last_undegraded":"2024-09-12T12:15:31.013514+0000","last_fullsized":"2024-09-12T12:15:31.013514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:27.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011811+0000","last_change":"2024-09-12T12:15:30.003228+0000","last_active":"2024-09-12T12:15:31.011811+0000","last_peered":"2024-09-12T12:15:31.011811+0000","last_clean":"2024-09-12T12:15:31.011811+0000","last_became_active":"2024-09-12T12:15:30.001737+0000","last_became_peered":"2024-09-12T12:15:30.001737+0000","last_unstale":"2024-09-12T12:15:31.011811+0000","last_undegraded":"2024-09-12T12:15:31.011811+0000","last_fullsized":"2024-09-12T12:15:31.011811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:13.949659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013389+0000","last_change":"2024-09-12T12:15:30.007179+0000","last_active":"2024-09-12T12:15:31.013389+0000","last_peered":"2024-09-12T12:15:31.013389+0000","last_clean":"2024-09-12T12:15:31.013389+0000","last_became_active":"2024-09-12T12:15:30.006891+0000","last_became_peered":"2024-09-12T12:15:30.006891+0000","last_unstale":"2024-09-12T12:15:31.013389+0000","last_undegraded":"2024-09-12T12:15:31.013389+0000","last_fullsized":"2024-09-12T12:15:31.013389+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:12.426078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999717+0000","last_change":"2024-09-12T12:15:29.996231+0000","last_active":"2024-09-12T12:15:30.999717+0000","last_peered":"2024-09-12T12:15:30.999717+0000","last_clean":"2024-09-12T12:15:30.999717+0000","last_became_active":"2024-09-12T12:15:29.995886+0000","last_became_peered":"2024-09-12T12:15:29.995886+0000","last_unstale":"2024-09-12T12:15:30.999717+0000","last_undegraded":"2024-09-12T12:15:30.999717+0000","last_fullsized":"2024-09-12T12:15:30.999717+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:49.395567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000418+0000","last_change":"2024-09-12T12:15:29.995344+0000","last_active":"2024-09-12T12:15:31.000418+0000","last_peered":"2024-09-12T12:15:31.000418+0000","last_clean":"2024-09-12T12:15:31.000418+0000","last_became_active":"2024-09-12T12:15:29.994095+0000","last_became_peered":"2024-09-12T12:15:29.994095+0000","last_unstale":"2024-09-12T12:15:31.000418+0000","last_undegraded":"2024-09-12T12:15:31.000418+0000","last_fullsized":"2024-09-12T12:15:31.000418+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:26.055659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011367+0000","last_change":"2024-09-12T12:15:30.006241+0000","last_active":"2024-09-12T12:15:31.011367+0000","last_peered":"2024-09-12T12:15:31.011367+0000","last_clean":"2024-09-12T12:15:31.011367+0000","last_became_active":"2024-09-12T12:15:30.005937+0000","last_became_peered":"2024-09-12T12:15:30.005937+0000","last_unstale":"2024-09-12T12:15:31.011367+0000","last_undegraded":"2024-09-12T12:15:31.011367+0000","last_fullsized":"2024-09-12T12:15:31.011367+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:44.200116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340289+0000","last_change":"2024-09-12T12:15:30.002658+0000","last_active":"2024-09-12T12:15:32.340289+0000","last_peered":"2024-09-12T12:15:32.340289+0000","last_clean":"2024-09-12T12:15:32.340289+0000","last_became_active":"2024-09-12T12:15:30.002419+0000","last_became_peered":"2024-09-12T12:15:30.002419+0000","last_unstale":"2024-09-12T12:15:32.340289+0000","last_undegraded":"2024-09-12T12:15:32.340289+0000","last_fullsized":"2024-09-12T12:15:32.340289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:23:20.075494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340853+0000","last_change":"2024-09-12T12:15:30.007470+0000","last_active":"2024-09-12T12:15:32.340853+0000","last_peered":"2024-09-12T12:15:32.340853+0000","last_clean":"2024-09-12T12:15:32.340853+0000","last_became_active":"2024-09-12T12:15:30.007128+0000","last_became_peered":"2024-09-12T12:15:30.007128+0000","last_unstale":"2024-09-12T12:15:32.340853+0000","last_undegraded":"2024-09-12T12:15:32.340853+0000","last_fullsized":"2024-09-12T12:15:32.340853+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:21.484859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000841+0000","last_change":"2024-09-12T12:15:29.987059+0000","last_active":"2024-09-12T12:15:31.000841+0000","last_peered":"2024-09-12T12:15:31.000841+0000","last_clean":"2024-09-12T12:15:31.000841+0000","last_became_active":"2024-09-12T12:15:29.986738+0000","last_became_peered":"2024-09-12T12:15:29.986738+0000","last_unstale":"2024-09-12T12:15:31.000841+0000","last_undegraded":"2024-09-12T12:15:31.000841+0000","last_fullsized":"2024-09-12T12:15:31.000841+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:15.818895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340198+0000","last_change":"2024-09-12T12:15:29.995341+0000","last_active":"2024-09-12T12:15:32.340198+0000","last_peered":"2024-09-12T12:15:32.340198+0000","last_clean":"2024-09-12T12:15:32.340198+0000","last_became_active":"2024-09-12T12:15:29.995042+0000","last_became_peered":"2024-09-12T12:15:29.995042+0000","last_unstale":"2024-09-12T12:15:32.340198+0000","last_undegraded":"2024-09-12T12:15:32.340198+0000","last_fullsized":"2024-09-12T12:15:32.340198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:01.269600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340660+0000","last_change":"2024-09-12T12:15:30.001904+0000","last_active":"2024-09-12T12:15:32.340660+0000","last_peered":"2024-09-12T12:15:32.340660+0000","last_clean":"2024-09-12T12:15:32.340660+0000","last_became_active":"2024-09-12T12:15:30.000811+0000","last_became_peered":"2024-09-12T12:15:30.000811+0000","last_unstale":"2024-09-12T12:15:32.340660+0000","last_undegraded":"2024-09-12T12:15:32.340660+0000","last_fullsized":"2024-09-12T12:15:32.340660+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:15.638405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000593+0000","last_change":"2024-09-12T12:15:29.986556+0000","last_active":"2024-09-12T12:15:31.000593+0000","last_peered":"2024-09-12T12:15:31.000593+0000","last_clean":"2024-09-12T12:15:31.000593+0000","last_became_active":"2024-09-12T12:15:29.986239+0000","last_became_peered":"2024-09-12T12:15:29.986239+0000","last_unstale":"2024-09-12T12:15:31.000593+0000","last_undegraded":"2024-09-12T12:15:31.000593+0000","last_fullsized":"2024-09-12T12:15:31.000593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:49.305348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011693+0000","last_change":"2024-09-12T12:15:30.020729+0000","last_active":"2024-09-12T12:15:31.011693+0000","last_peered":"2024-09-12T12:15:31.011693+0000","last_clean":"2024-09-12T12:15:31.011693+0000","last_became_active":"2024-09-12T12:15:30.020439+0000","last_became_peered":"2024-09-12T12:15:30.020439+0000","last_unstale":"2024-09-12T12:15:31.011693+0000","last_undegraded":"2024-09-12T12:15:31.011693+0000","last_fullsized":"2024-09-12T12:15:31.011693+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:45.647595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013217+0000","last_change":"2024-09-12T12:15:29.993265+0000","last_active":"2024-09-12T12:15:31.013217+0000","last_peered":"2024-09-12T12:15:31.013217+0000","last_clean":"2024-09-12T12:15:31.013217+0000","last_became_active":"2024-09-12T12:15:29.991866+0000","last_became_peered":"2024-09-12T12:15:29.991866+0000","last_unstale":"2024-09-12T12:15:31.013217+0000","last_undegraded":"2024-09-12T12:15:31.013217+0000","last_fullsized":"2024-09-12T12:15:31.013217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:51.084470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000313+0000","last_change":"2024-09-12T12:15:29.991618+0000","last_active":"2024-09-12T12:15:31.000313+0000","last_peered":"2024-09-12T12:15:31.000313+0000","last_clean":"2024-09-12T12:15:31.000313+0000","last_became_active":"2024-09-12T12:15:29.991241+0000","last_became_peered":"2024-09-12T12:15:29.991241+0000","last_unstale":"2024-09-12T12:15:31.000313+0000","last_undegraded":"2024-09-12T12:15:31.000313+0000","last_fullsized":"2024-09-12T12:15:31.000313+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:09.690276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012170+0000","last_change":"2024-09-12T12:15:30.003798+0000","last_active":"2024-09-12T12:15:31.012170+0000","last_peered":"2024-09-12T12:15:31.012170+0000","last_clean":"2024-09-12T12:15:31.012170+0000","last_became_active":"2024-09-12T12:15:30.001821+0000","last_became_peered":"2024-09-12T12:15:30.001821+0000","last_unstale":"2024-09-12T12:15:31.012170+0000","last_undegraded":"2024-09-12T12:15:31.012170+0000","last_fullsized":"2024-09-12T12:15:31.012170+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:55.291882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013608+0000","last_change":"2024-09-12T12:15:30.003065+0000","last_active":"2024-09-12T12:15:31.013608+0000","last_peered":"2024-09-12T12:15:31.013608+0000","last_clean":"2024-09-12T12:15:31.013608+0000","last_became_active":"2024-09-12T12:15:30.002746+0000","last_became_peered":"2024-09-12T12:15:30.002746+0000","last_unstale":"2024-09-12T12:15:31.013608+0000","last_undegraded":"2024-09-12T12:15:31.013608+0000","last_fullsized":"2024-09-12T12:15:31.013608+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:44.200116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011827+0000","last_change":"2024-09-12T12:15:30.003735+0000","last_active":"2024-09-12T12:15:31.011827+0000","last_peered":"2024-09-12T12:15:31.011827+0000","last_clean":"2024-09-12T12:15:31.011827+0000","last_became_active":"2024-09-12T12:15:30.001363+0000","last_became_peered":"2024-09-12T12:15:30.001363+0000","last_unstale":"2024-09-12T12:15:31.011827+0000","last_undegraded":"2024-09-12T12:15:31.011827+0000","last_fullsized":"2024-09-12T12:15:31.011827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:39.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000688+0000","last_change":"2024-09-12T12:15:29.989427+0000","last_active":"2024-09-12T12:15:31.000688+0000","last_peered":"2024-09-12T12:15:31.000688+0000","last_clean":"2024-09-12T12:15:31.000688+0000","last_became_active":"2024-09-12T12:15:29.989148+0000","last_became_peered":"2024-09-12T12:15:29.989148+0000","last_unstale":"2024-09-12T12:15:31.000688+0000","last_undegraded":"2024-09-12T12:15:31.000688+0000","last_fullsized":"2024-09-12T12:15:31.000688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:43.341572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000605+0000","last_change":"2024-09-12T12:15:29.994292+0000","last_active":"2024-09-12T12:15:31.000605+0000","last_peered":"2024-09-12T12:15:31.000605+0000","last_clean":"2024-09-12T12:15:31.000605+0000","last_became_active":"2024-09-12T12:15:29.993287+0000","last_became_peered":"2024-09-12T12:15:29.993287+0000","last_unstale":"2024-09-12T12:15:31.000605+0000","last_undegraded":"2024-09-12T12:15:31.000605+0000","last_fullsized":"2024-09-12T12:15:31.000605+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:26.055659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339890+0000","last_change":"2024-09-12T12:15:30.021397+0000","last_active":"2024-09-12T12:15:32.339890+0000","last_peered":"2024-09-12T12:15:32.339890+0000","last_clean":"2024-09-12T12:15:32.339890+0000","last_became_active":"2024-09-12T12:15:30.021133+0000","last_became_peered":"2024-09-12T12:15:30.021133+0000","last_unstale":"2024-09-12T12:15:32.339890+0000","last_undegraded":"2024-09-12T12:15:32.339890+0000","last_fullsized":"2024-09-12T12:15:32.339890+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:23.062738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339811+0000","last_change":"2024-09-12T12:15:29.994672+0000","last_active":"2024-09-12T12:15:32.339811+0000","last_peered":"2024-09-12T12:15:32.339811+0000","last_clean":"2024-09-12T12:15:32.339811+0000","last_became_active":"2024-09-12T12:15:29.994352+0000","last_became_peered":"2024-09-12T12:15:29.994352+0000","last_unstale":"2024-09-12T12:15:32.339811+0000","last_undegraded":"2024-09-12T12:15:32.339811+0000","last_fullsized":"2024-09-12T12:15:32.339811+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:34.922600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011324+0000","last_change":"2024-09-12T12:15:30.002516+0000","last_active":"2024-09-12T12:15:31.011324+0000","last_peered":"2024-09-12T12:15:31.011324+0000","last_clean":"2024-09-12T12:15:31.011324+0000","last_became_active":"2024-09-12T12:15:30.001788+0000","last_became_peered":"2024-09-12T12:15:30.001788+0000","last_unstale":"2024-09-12T12:15:31.011324+0000","last_undegraded":"2024-09-12T12:15:31.011324+0000","last_fullsized":"2024-09-12T12:15:31.011324+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:27.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012296+0000","last_change":"2024-09-12T12:15:30.004403+0000","last_active":"2024-09-12T12:15:31.012296+0000","last_peered":"2024-09-12T12:15:31.012296+0000","last_clean":"2024-09-12T12:15:31.012296+0000","last_became_active":"2024-09-12T12:15:30.002948+0000","last_became_peered":"2024-09-12T12:15:30.002948+0000","last_unstale":"2024-09-12T12:15:31.012296+0000","last_undegraded":"2024-09-12T12:15:31.012296+0000","last_fullsized":"2024-09-12T12:15:31.012296+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:34.624789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340518+0000","last_change":"2024-09-12T12:15:30.005320+0000","last_active":"2024-09-12T12:15:32.340518+0000","last_peered":"2024-09-12T12:15:32.340518+0000","last_clean":"2024-09-12T12:15:32.340518+0000","last_became_active":"2024-09-12T12:15:30.005051+0000","last_became_peered":"2024-09-12T12:15:30.005051+0000","last_unstale":"2024-09-12T12:15:32.340518+0000","last_undegraded":"2024-09-12T12:15:32.340518+0000","last_fullsized":"2024-09-12T12:15:32.340518+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:55.291882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000843+0000","last_change":"2024-09-12T12:15:30.006013+0000","last_active":"2024-09-12T12:15:31.000843+0000","last_peered":"2024-09-12T12:15:31.000843+0000","last_clean":"2024-09-12T12:15:31.000843+0000","last_became_active":"2024-09-12T12:15:30.005697+0000","last_became_peered":"2024-09-12T12:15:30.005697+0000","last_unstale":"2024-09-12T12:15:31.000843+0000","last_undegraded":"2024-09-12T12:15:31.000843+0000","last_fullsized":"2024-09-12T12:15:31.000843+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:57.413888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000726+0000","last_change":"2024-09-12T12:15:29.994672+0000","last_active":"2024-09-12T12:15:31.000726+0000","last_peered":"2024-09-12T12:15:31.000726+0000","last_clean":"2024-09-12T12:15:31.000726+0000","last_became_active":"2024-09-12T12:15:29.994374+0000","last_became_peered":"2024-09-12T12:15:29.994374+0000","last_unstale":"2024-09-12T12:15:31.000726+0000","last_undegraded":"2024-09-12T12:15:31.000726+0000","last_fullsized":"2024-09-12T12:15:31.000726+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:43.508119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011479+0000","last_change":"2024-09-12T12:15:30.006704+0000","last_active":"2024-09-12T12:15:31.011479+0000","last_peered":"2024-09-12T12:15:31.011479+0000","last_clean":"2024-09-12T12:15:31.011479+0000","last_became_active":"2024-09-12T12:15:30.006412+0000","last_became_peered":"2024-09-12T12:15:30.006412+0000","last_unstale":"2024-09-12T12:15:31.011479+0000","last_undegraded":"2024-09-12T12:15:31.011479+0000","last_fullsized":"2024-09-12T12:15:31.011479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:58.835451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013474+0000","last_change":"2024-09-12T12:15:30.006145+0000","last_active":"2024-09-12T12:15:31.013474+0000","last_peered":"2024-09-12T12:15:31.013474+0000","last_clean":"2024-09-12T12:15:31.013474+0000","last_became_active":"2024-09-12T12:15:30.004690+0000","last_became_peered":"2024-09-12T12:15:30.004690+0000","last_unstale":"2024-09-12T12:15:31.013474+0000","last_undegraded":"2024-09-12T12:15:31.013474+0000","last_fullsized":"2024-09-12T12:15:31.013474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:49.354669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011487+0000","last_change":"2024-09-12T12:15:29.996477+0000","last_active":"2024-09-12T12:15:31.011487+0000","last_peered":"2024-09-12T12:15:31.011487+0000","last_clean":"2024-09-12T12:15:31.011487+0000","last_became_active":"2024-09-12T12:15:29.996190+0000","last_became_peered":"2024-09-12T12:15:29.996190+0000","last_unstale":"2024-09-12T12:15:31.011487+0000","last_undegraded":"2024-09-12T12:15:31.011487+0000","last_fullsized":"2024-09-12T12:15:31.011487+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:40.379955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292117+0000","last_change":"2024-09-12T12:15:30.003094+0000","last_active":"2024-09-12T12:15:31.292117+0000","last_peered":"2024-09-12T12:15:31.292117+0000","last_clean":"2024-09-12T12:15:31.292117+0000","last_became_active":"2024-09-12T12:15:30.002671+0000","last_became_peered":"2024-09-12T12:15:30.002671+0000","last_unstale":"2024-09-12T12:15:31.292117+0000","last_undegraded":"2024-09-12T12:15:31.292117+0000","last_fullsized":"2024-09-12T12:15:31.292117+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:27.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013053+0000","last_change":"2024-09-12T12:15:30.005417+0000","last_active":"2024-09-12T12:15:31.013053+0000","last_peered":"2024-09-12T12:15:31.013053+0000","last_clean":"2024-09-12T12:15:31.013053+0000","last_became_active":"2024-09-12T12:15:30.002173+0000","last_became_peered":"2024-09-12T12:15:30.002173+0000","last_unstale":"2024-09-12T12:15:31.013053+0000","last_undegraded":"2024-09-12T12:15:31.013053+0000","last_fullsized":"2024-09-12T12:15:31.013053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:40.771980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"53'4","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000885+0000","last_change":"2024-09-12T12:15:28.973024+0000","last_active":"2024-09-12T12:15:31.000885+0000","last_peered":"2024-09-12T12:15:31.000885+0000","last_clean":"2024-09-12T12:15:31.000885+0000","last_became_active":"2024-09-12T12:15:28.972768+0000","last_became_peered":"2024-09-12T12:15:28.972768+0000","last_unstale":"2024-09-12T12:15:31.000885+0000","last_undegraded":"2024-09-12T12:15:31.000885+0000","last_fullsized":"2024-09-12T12:15:31.000885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:59.726786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292263+0000","last_change":"2024-09-12T12:15:30.001290+0000","last_active":"2024-09-12T12:15:31.292263+0000","last_peered":"2024-09-12T12:15:31.292263+0000","last_clean":"2024-09-12T12:15:31.292263+0000","last_became_active":"2024-09-12T12:15:30.001038+0000","last_became_peered":"2024-09-12T12:15:30.001038+0000","last_unstale":"2024-09-12T12:15:31.292263+0000","last_undegraded":"2024-09-12T12:15:31.292263+0000","last_fullsized":"2024-09-12T12:15:31.292263+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:40.379955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000929+0000","last_change":"2024-09-12T12:15:28.997846+0000","last_active":"2024-09-12T12:15:31.000929+0000","last_peered":"2024-09-12T12:15:31.000929+0000","last_clean":"2024-09-12T12:15:31.000929+0000","last_became_active":"2024-09-12T12:15:28.997572+0000","last_became_peered":"2024-09-12T12:15:28.997572+0000","last_unstale":"2024-09-12T12:15:31.000929+0000","last_undegraded":"2024-09-12T12:15:31.000929+0000","last_fullsized":"2024-09-12T12:15:31.000929+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:08.450301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000436+0000","last_change":"2024-09-12T12:15:29.996330+0000","last_active":"2024-09-12T12:15:31.000436+0000","last_peered":"2024-09-12T12:15:31.000436+0000","last_clean":"2024-09-12T12:15:31.000436+0000","last_became_active":"2024-09-12T12:15:29.992481+0000","last_became_peered":"2024-09-12T12:15:29.992481+0000","last_unstale":"2024-09-12T12:15:31.000436+0000","last_undegraded":"2024-09-12T12:15:31.000436+0000","last_fullsized":"2024-09-12T12:15:31.000436+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:09.690276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000846+0000","last_change":"2024-09-12T12:15:28.980175+0000","last_active":"2024-09-12T12:15:31.000846+0000","last_peered":"2024-09-12T12:15:31.000846+0000","last_clean":"2024-09-12T12:15:31.000846+0000","last_became_active":"2024-09-12T12:15:28.979558+0000","last_became_peered":"2024-09-12T12:15:28.979558+0000","last_unstale":"2024-09-12T12:15:31.000846+0000","last_undegraded":"2024-09-12T12:15:31.000846+0000","last_fullsized":"2024-09-12T12:15:31.000846+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:59.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340271+0000","last_change":"2024-09-12T12:15:29.996929+0000","last_active":"2024-09-12T12:15:32.340271+0000","last_peered":"2024-09-12T12:15:32.340271+0000","last_clean":"2024-09-12T12:15:32.340271+0000","last_became_active":"2024-09-12T12:15:29.996627+0000","last_became_peered":"2024-09-12T12:15:29.996627+0000","last_unstale":"2024-09-12T12:15:32.340271+0000","last_undegraded":"2024-09-12T12:15:32.340271+0000","last_fullsized":"2024-09-12T12:15:32.340271+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:40.909134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292143+0000","last_change":"2024-09-12T12:15:28.998874+0000","last_active":"2024-09-12T12:15:31.292143+0000","last_peered":"2024-09-12T12:15:31.292143+0000","last_clean":"2024-09-12T12:15:31.292143+0000","last_became_active":"2024-09-12T12:15:28.998570+0000","last_became_peered":"2024-09-12T12:15:28.998570+0000","last_unstale":"2024-09-12T12:15:31.292143+0000","last_undegraded":"2024-09-12T12:15:31.292143+0000","last_fullsized":"2024-09-12T12:15:31.292143+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:12.067885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999800+0000","last_change":"2024-09-12T12:15:30.000686+0000","last_active":"2024-09-12T12:15:30.999800+0000","last_peered":"2024-09-12T12:15:30.999800+0000","last_clean":"2024-09-12T12:15:30.999800+0000","last_became_active":"2024-09-12T12:15:30.000318+0000","last_became_peered":"2024-09-12T12:15:30.000318+0000","last_unstale":"2024-09-12T12:15:30.999800+0000","last_undegraded":"2024-09-12T12:15:30.999800+0000","last_fullsized":"2024-09-12T12:15:30.999800+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:32:06.373968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011503+0000","last_change":"2024-09-12T12:15:28.990368+0000","last_active":"2024-09-12T12:15:31.011503+0000","last_peered":"2024-09-12T12:15:31.011503+0000","last_clean":"2024-09-12T12:15:31.011503+0000","last_became_active":"2024-09-12T12:15:28.990126+0000","last_became_peered":"2024-09-12T12:15:28.990126+0000","last_unstale":"2024-09-12T12:15:31.011503+0000","last_undegraded":"2024-09-12T12:15:31.011503+0000","last_fullsized":"2024-09-12T12:15:31.011503+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:01.219312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013282+0000","last_change":"2024-09-12T12:15:30.005692+0000","last_active":"2024-09-12T12:15:31.013282+0000","last_peered":"2024-09-12T12:15:31.013282+0000","last_clean":"2024-09-12T12:15:31.013282+0000","last_became_active":"2024-09-12T12:15:30.005433+0000","last_became_peered":"2024-09-12T12:15:30.005433+0000","last_unstale":"2024-09-12T12:15:31.013282+0000","last_undegraded":"2024-09-12T12:15:31.013282+0000","last_fullsized":"2024-09-12T12:15:31.013282+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:46.521953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999511+0000","last_change":"2024-09-12T12:15:28.977317+0000","last_active":"2024-09-12T12:15:30.999511+0000","last_peered":"2024-09-12T12:15:30.999511+0000","last_clean":"2024-09-12T12:15:30.999511+0000","last_became_active":"2024-09-12T12:15:28.976850+0000","last_became_peered":"2024-09-12T12:15:28.976850+0000","last_unstale":"2024-09-12T12:15:30.999511+0000","last_undegraded":"2024-09-12T12:15:30.999511+0000","last_fullsized":"2024-09-12T12:15:30.999511+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:26.222947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340621+0000","last_change":"2024-09-12T12:15:30.005337+0000","last_active":"2024-09-12T12:15:32.340621+0000","last_peered":"2024-09-12T12:15:32.340621+0000","last_clean":"2024-09-12T12:15:32.340621+0000","last_became_active":"2024-09-12T12:15:30.005039+0000","last_became_peered":"2024-09-12T12:15:30.005039+0000","last_unstale":"2024-09-12T12:15:32.340621+0000","last_undegraded":"2024-09-12T12:15:32.340621+0000","last_fullsized":"2024-09-12T12:15:32.340621+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:34.624789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000300+0000","last_change":"2024-09-12T12:15:28.984535+0000","last_active":"2024-09-12T12:15:31.000300+0000","last_peered":"2024-09-12T12:15:31.000300+0000","last_clean":"2024-09-12T12:15:31.000300+0000","last_became_active":"2024-09-12T12:15:28.984229+0000","last_became_peered":"2024-09-12T12:15:28.984229+0000","last_unstale":"2024-09-12T12:15:31.000300+0000","last_undegraded":"2024-09-12T12:15:31.000300+0000","last_fullsized":"2024-09-12T12:15:31.000300+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:08.450301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013688+0000","last_change":"2024-09-12T12:15:30.006302+0000","last_active":"2024-09-12T12:15:31.013688+0000","last_peered":"2024-09-12T12:15:31.013688+0000","last_clean":"2024-09-12T12:15:31.013688+0000","last_became_active":"2024-09-12T12:15:30.006009+0000","last_became_peered":"2024-09-12T12:15:30.006009+0000","last_unstale":"2024-09-12T12:15:31.013688+0000","last_undegraded":"2024-09-12T12:15:31.013688+0000","last_fullsized":"2024-09-12T12:15:31.013688+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:58.835451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011347+0000","last_change":"2024-09-12T12:15:28.979840+0000","last_active":"2024-09-12T12:15:31.011347+0000","last_peered":"2024-09-12T12:15:31.011347+0000","last_clean":"2024-09-12T12:15:31.011347+0000","last_became_active":"2024-09-12T12:15:28.979629+0000","last_became_peered":"2024-09-12T12:15:28.979629+0000","last_unstale":"2024-09-12T12:15:31.011347+0000","last_undegraded":"2024-09-12T12:15:31.011347+0000","last_fullsized":"2024-09-12T12:15:31.011347+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:54.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999493+0000","last_change":"2024-09-12T12:15:29.995528+0000","last_active":"2024-09-12T12:15:30.999493+0000","last_peered":"2024-09-12T12:15:30.999493+0000","last_clean":"2024-09-12T12:15:30.999493+0000","last_became_active":"2024-09-12T12:15:29.995269+0000","last_became_peered":"2024-09-12T12:15:29.995269+0000","last_unstale":"2024-09-12T12:15:30.999493+0000","last_undegraded":"2024-09-12T12:15:30.999493+0000","last_fullsized":"2024-09-12T12:15:30.999493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.918299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013642+0000","last_change":"2024-09-12T12:15:28.985794+0000","last_active":"2024-09-12T12:15:31.013642+0000","last_peered":"2024-09-12T12:15:31.013642+0000","last_clean":"2024-09-12T12:15:31.013642+0000","last_became_active":"2024-09-12T12:15:28.985514+0000","last_became_peered":"2024-09-12T12:15:28.985514+0000","last_unstale":"2024-09-12T12:15:31.013642+0000","last_undegraded":"2024-09-12T12:15:31.013642+0000","last_fullsized":"2024-09-12T12:15:31.013642+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:48.299252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.291896+0000","last_change":"2024-09-12T12:15:30.004964+0000","last_active":"2024-09-12T12:15:31.291896+0000","last_peered":"2024-09-12T12:15:31.291896+0000","last_clean":"2024-09-12T12:15:31.291896+0000","last_became_active":"2024-09-12T12:15:30.004638+0000","last_became_peered":"2024-09-12T12:15:30.004638+0000","last_unstale":"2024-09-12T12:15:31.291896+0000","last_undegraded":"2024-09-12T12:15:31.291896+0000","last_fullsized":"2024-09-12T12:15:31.291896+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:46.521953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000733+0000","last_change":"2024-09-12T12:15:28.981586+0000","last_active":"2024-09-12T12:15:31.000733+0000","last_peered":"2024-09-12T12:15:31.000733+0000","last_clean":"2024-09-12T12:15:31.000733+0000","last_became_active":"2024-09-12T12:15:28.981224+0000","last_became_peered":"2024-09-12T12:15:28.981224+0000","last_unstale":"2024-09-12T12:15:31.000733+0000","last_undegraded":"2024-09-12T12:15:31.000733+0000","last_fullsized":"2024-09-12T12:15:31.000733+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:08.450301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011544+0000","last_change":"2024-09-12T12:15:30.008799+0000","last_active":"2024-09-12T12:15:31.011544+0000","last_peered":"2024-09-12T12:15:31.011544+0000","last_clean":"2024-09-12T12:15:31.011544+0000","last_became_active":"2024-09-12T12:15:30.002897+0000","last_became_peered":"2024-09-12T12:15:30.002897+0000","last_unstale":"2024-09-12T12:15:31.011544+0000","last_undegraded":"2024-09-12T12:15:31.011544+0000","last_fullsized":"2024-09-12T12:15:31.011544+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:06.077459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"53'3","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013567+0000","last_change":"2024-09-12T12:15:28.995320+0000","last_active":"2024-09-12T12:15:31.013567+0000","last_peered":"2024-09-12T12:15:31.013567+0000","last_clean":"2024-09-12T12:15:31.013567+0000","last_became_active":"2024-09-12T12:15:28.995054+0000","last_became_peered":"2024-09-12T12:15:28.995054+0000","last_unstale":"2024-09-12T12:15:31.013567+0000","last_undegraded":"2024-09-12T12:15:31.013567+0000","last_fullsized":"2024-09-12T12:15:31.013567+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:32.670718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999780+0000","last_change":"2024-09-12T12:15:29.993010+0000","last_active":"2024-09-12T12:15:30.999780+0000","last_peered":"2024-09-12T12:15:30.999780+0000","last_clean":"2024-09-12T12:15:30.999780+0000","last_became_active":"2024-09-12T12:15:29.992745+0000","last_became_peered":"2024-09-12T12:15:29.992745+0000","last_unstale":"2024-09-12T12:15:30.999780+0000","last_undegraded":"2024-09-12T12:15:30.999780+0000","last_fullsized":"2024-09-12T12:15:30.999780+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:02.225408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"53'6","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340661+0000","last_change":"2024-09-12T12:15:28.996444+0000","last_active":"2024-09-12T12:15:32.340661+0000","last_peered":"2024-09-12T12:15:32.340661+0000","last_clean":"2024-09-12T12:15:32.340661+0000","last_became_active":"2024-09-12T12:15:28.996157+0000","last_became_peered":"2024-09-12T12:15:28.996157+0000","last_unstale":"2024-09-12T12:15:32.340661+0000","last_undegraded":"2024-09-12T12:15:32.340661+0000","last_fullsized":"2024-09-12T12:15:32.340661+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:01.676839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.291989+0000","last_change":"2024-09-12T12:15:29.999812+0000","last_active":"2024-09-12T12:15:31.291989+0000","last_peered":"2024-09-12T12:15:31.291989+0000","last_clean":"2024-09-12T12:15:31.291989+0000","last_became_active":"2024-09-12T12:15:29.999375+0000","last_became_peered":"2024-09-12T12:15:29.999375+0000","last_unstale":"2024-09-12T12:15:31.291989+0000","last_undegraded":"2024-09-12T12:15:31.291989+0000","last_fullsized":"2024-09-12T12:15:31.291989+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:12.426078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011585+0000","last_change":"2024-09-12T12:15:28.986459+0000","last_active":"2024-09-12T12:15:31.011585+0000","last_peered":"2024-09-12T12:15:31.011585+0000","last_clean":"2024-09-12T12:15:31.011585+0000","last_became_active":"2024-09-12T12:15:28.986199+0000","last_became_peered":"2024-09-12T12:15:28.986199+0000","last_unstale":"2024-09-12T12:15:31.011585+0000","last_undegraded":"2024-09-12T12:15:31.011585+0000","last_fullsized":"2024-09-12T12:15:31.011585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:32:05.367872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011970+0000","last_change":"2024-09-12T12:15:30.005618+0000","last_active":"2024-09-12T12:15:31.011970+0000","last_peered":"2024-09-12T12:15:31.011970+0000","last_clean":"2024-09-12T12:15:31.011970+0000","last_became_active":"2024-09-12T12:15:30.005376+0000","last_became_peered":"2024-09-12T12:15:30.005376+0000","last_unstale":"2024-09-12T12:15:31.011970+0000","last_undegraded":"2024-09-12T12:15:31.011970+0000","last_fullsized":"2024-09-12T12:15:31.011970+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:23.062738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000330+0000","last_change":"2024-09-12T12:15:28.981615+0000","last_active":"2024-09-12T12:15:31.000330+0000","last_peered":"2024-09-12T12:15:31.000330+0000","last_clean":"2024-09-12T12:15:31.000330+0000","last_became_active":"2024-09-12T12:15:28.981365+0000","last_became_peered":"2024-09-12T12:15:28.981365+0000","last_unstale":"2024-09-12T12:15:31.000330+0000","last_undegraded":"2024-09-12T12:15:31.000330+0000","last_fullsized":"2024-09-12T12:15:31.000330+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:59.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340649+0000","last_change":"2024-09-12T12:15:30.001274+0000","last_active":"2024-09-12T12:15:32.340649+0000","last_peered":"2024-09-12T12:15:32.340649+0000","last_clean":"2024-09-12T12:15:32.340649+0000","last_became_active":"2024-09-12T12:15:30.000987+0000","last_became_peered":"2024-09-12T12:15:30.000987+0000","last_unstale":"2024-09-12T12:15:32.340649+0000","last_undegraded":"2024-09-12T12:15:32.340649+0000","last_fullsized":"2024-09-12T12:15:32.340649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:07:24.877522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013300+0000","last_change":"2024-09-12T12:15:28.986783+0000","last_active":"2024-09-12T12:15:31.013300+0000","last_peered":"2024-09-12T12:15:31.013300+0000","last_clean":"2024-09-12T12:15:31.013300+0000","last_became_active":"2024-09-12T12:15:28.985415+0000","last_became_peered":"2024-09-12T12:15:28.985415+0000","last_unstale":"2024-09-12T12:15:31.013300+0000","last_undegraded":"2024-09-12T12:15:31.013300+0000","last_fullsized":"2024-09-12T12:15:31.013300+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:42.502023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012145+0000","last_change":"2024-09-12T12:15:30.004054+0000","last_active":"2024-09-12T12:15:31.012145+0000","last_peered":"2024-09-12T12:15:31.012145+0000","last_clean":"2024-09-12T12:15:31.012145+0000","last_became_active":"2024-09-12T12:15:30.002384+0000","last_became_peered":"2024-09-12T12:15:30.002384+0000","last_unstale":"2024-09-12T12:15:31.012145+0000","last_undegraded":"2024-09-12T12:15:31.012145+0000","last_fullsized":"2024-09-12T12:15:31.012145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:20.159552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"53'8","reported_seq":22,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339985+0000","last_change":"2024-09-12T12:15:28.993668+0000","last_active":"2024-09-12T12:15:32.339985+0000","last_peered":"2024-09-12T12:15:32.339985+0000","last_clean":"2024-09-12T12:15:32.339985+0000","last_became_active":"2024-09-12T12:15:28.993395+0000","last_became_peered":"2024-09-12T12:15:28.993395+0000","last_unstale":"2024-09-12T12:15:32.339985+0000","last_undegraded":"2024-09-12T12:15:32.339985+0000","last_fullsized":"2024-09-12T12:15:32.339985+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:04.903477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339849+0000","last_change":"2024-09-12T12:15:30.004025+0000","last_active":"2024-09-12T12:15:32.339849+0000","last_peered":"2024-09-12T12:15:32.339849+0000","last_clean":"2024-09-12T12:15:32.339849+0000","last_became_active":"2024-09-12T12:15:30.003667+0000","last_became_peered":"2024-09-12T12:15:30.003667+0000","last_unstale":"2024-09-12T12:15:32.339849+0000","last_undegraded":"2024-09-12T12:15:32.339849+0000","last_fullsized":"2024-09-12T12:15:32.339849+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:39.344023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012291+0000","last_change":"2024-09-12T12:15:28.999035+0000","last_active":"2024-09-12T12:15:31.012291+0000","last_peered":"2024-09-12T12:15:31.012291+0000","last_clean":"2024-09-12T12:15:31.012291+0000","last_became_active":"2024-09-12T12:15:28.998733+0000","last_became_peered":"2024-09-12T12:15:28.998733+0000","last_unstale":"2024-09-12T12:15:31.012291+0000","last_undegraded":"2024-09-12T12:15:31.012291+0000","last_fullsized":"2024-09-12T12:15:31.012291+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:25.049563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000368+0000","last_change":"2024-09-12T12:15:30.020286+0000","last_active":"2024-09-12T12:15:31.000368+0000","last_peered":"2024-09-12T12:15:31.000368+0000","last_clean":"2024-09-12T12:15:31.000368+0000","last_became_active":"2024-09-12T12:15:30.020060+0000","last_became_peered":"2024-09-12T12:15:30.020060+0000","last_unstale":"2024-09-12T12:15:31.000368+0000","last_undegraded":"2024-09-12T12:15:31.000368+0000","last_fullsized":"2024-09-12T12:15:31.000368+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:43.341572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340134+0000","last_change":"2024-09-12T12:15:28.988145+0000","last_active":"2024-09-12T12:15:32.340134+0000","last_peered":"2024-09-12T12:15:32.340134+0000","last_clean":"2024-09-12T12:15:32.340134+0000","last_became_active":"2024-09-12T12:15:28.987869+0000","last_became_peered":"2024-09-12T12:15:28.987869+0000","last_unstale":"2024-09-12T12:15:32.340134+0000","last_undegraded":"2024-09-12T12:15:32.340134+0000","last_fullsized":"2024-09-12T12:15:32.340134+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:47.634420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999679+0000","last_change":"2024-09-12T12:15:30.004717+0000","last_active":"2024-09-12T12:15:30.999679+0000","last_peered":"2024-09-12T12:15:30.999679+0000","last_clean":"2024-09-12T12:15:30.999679+0000","last_became_active":"2024-09-12T12:15:30.004445+0000","last_became_peered":"2024-09-12T12:15:30.004445+0000","last_unstale":"2024-09-12T12:15:30.999679+0000","last_undegraded":"2024-09-12T12:15:30.999679+0000","last_fullsized":"2024-09-12T12:15:30.999679+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:34.226464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"53'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000852+0000","last_change":"2024-09-12T12:15:28.991659+0000","last_active":"2024-09-12T12:15:31.000852+0000","last_peered":"2024-09-12T12:15:31.000852+0000","last_clean":"2024-09-12T12:15:31.000852+0000","last_became_active":"2024-09-12T12:15:28.991363+0000","last_became_peered":"2024-09-12T12:15:28.991363+0000","last_unstale":"2024-09-12T12:15:31.000852+0000","last_undegraded":"2024-09-12T12:15:31.000852+0000","last_fullsized":"2024-09-12T12:15:31.000852+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:26.222947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000568+0000","last_change":"2024-09-12T12:15:30.006376+0000","last_active":"2024-09-12T12:15:31.000568+0000","last_peered":"2024-09-12T12:15:31.000568+0000","last_clean":"2024-09-12T12:15:31.000568+0000","last_became_active":"2024-09-12T12:15:29.998610+0000","last_became_peered":"2024-09-12T12:15:29.998610+0000","last_unstale":"2024-09-12T12:15:31.000568+0000","last_undegraded":"2024-09-12T12:15:31.000568+0000","last_fullsized":"2024-09-12T12:15:31.000568+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:33.676814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000800+0000","last_change":"2024-09-12T12:15:28.997415+0000","last_active":"2024-09-12T12:15:31.000800+0000","last_peered":"2024-09-12T12:15:31.000800+0000","last_clean":"2024-09-12T12:15:31.000800+0000","last_became_active":"2024-09-12T12:15:28.997122+0000","last_became_peered":"2024-09-12T12:15:28.997122+0000","last_unstale":"2024-09-12T12:15:31.000800+0000","last_undegraded":"2024-09-12T12:15:31.000800+0000","last_fullsized":"2024-09-12T12:15:31.000800+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:37.433511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.291993+0000","last_change":"2024-09-12T12:15:29.994311+0000","last_active":"2024-09-12T12:15:31.291993+0000","last_peered":"2024-09-12T12:15:31.291993+0000","last_clean":"2024-09-12T12:15:31.291993+0000","last_became_active":"2024-09-12T12:15:29.994019+0000","last_became_peered":"2024-09-12T12:15:29.994019+0000","last_unstale":"2024-09-12T12:15:31.291993+0000","last_undegraded":"2024-09-12T12:15:31.291993+0000","last_fullsized":"2024-09-12T12:15:31.291993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:49.354669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000667+0000","last_change":"2024-09-12T12:15:28.991547+0000","last_active":"2024-09-12T12:15:31.000667+0000","last_peered":"2024-09-12T12:15:31.000667+0000","last_clean":"2024-09-12T12:15:31.000667+0000","last_became_active":"2024-09-12T12:15:28.988510+0000","last_became_peered":"2024-09-12T12:15:28.988510+0000","last_unstale":"2024-09-12T12:15:31.000667+0000","last_undegraded":"2024-09-12T12:15:31.000667+0000","last_fullsized":"2024-09-12T12:15:31.000667+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:26.222947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000749+0000","last_change":"2024-09-12T12:15:29.987528+0000","last_active":"2024-09-12T12:15:31.000749+0000","last_peered":"2024-09-12T12:15:31.000749+0000","last_clean":"2024-09-12T12:15:31.000749+0000","last_became_active":"2024-09-12T12:15:29.987189+0000","last_became_peered":"2024-09-12T12:15:29.987189+0000","last_unstale":"2024-09-12T12:15:31.000749+0000","last_undegraded":"2024-09-12T12:15:31.000749+0000","last_fullsized":"2024-09-12T12:15:31.000749+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:33.676814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340044+0000","last_change":"2024-09-12T12:15:28.995461+0000","last_active":"2024-09-12T12:15:32.340044+0000","last_peered":"2024-09-12T12:15:32.340044+0000","last_clean":"2024-09-12T12:15:32.340044+0000","last_became_active":"2024-09-12T12:15:28.995166+0000","last_became_peered":"2024-09-12T12:15:28.995166+0000","last_unstale":"2024-09-12T12:15:32.340044+0000","last_undegraded":"2024-09-12T12:15:32.340044+0000","last_fullsized":"2024-09-12T12:15:32.340044+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:39.765885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012112+0000","last_change":"2024-09-12T12:15:30.011903+0000","last_active":"2024-09-12T12:15:31.012112+0000","last_peered":"2024-09-12T12:15:31.012112+0000","last_clean":"2024-09-12T12:15:31.012112+0000","last_became_active":"2024-09-12T12:15:30.011180+0000","last_became_peered":"2024-09-12T12:15:30.011180+0000","last_unstale":"2024-09-12T12:15:31.012112+0000","last_undegraded":"2024-09-12T12:15:31.012112+0000","last_fullsized":"2024-09-12T12:15:31.012112+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:23:20.075494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011519+0000","last_change":"2024-09-12T12:15:28.993720+0000","last_active":"2024-09-12T12:15:31.011519+0000","last_peered":"2024-09-12T12:15:31.011519+0000","last_clean":"2024-09-12T12:15:31.011519+0000","last_became_active":"2024-09-12T12:15:28.993434+0000","last_became_peered":"2024-09-12T12:15:28.993434+0000","last_unstale":"2024-09-12T12:15:31.011519+0000","last_undegraded":"2024-09-12T12:15:31.011519+0000","last_fullsized":"2024-09-12T12:15:31.011519+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:42.335476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000964+0000","last_change":"2024-09-12T12:15:29.997929+0000","last_active":"2024-09-12T12:15:31.000964+0000","last_peered":"2024-09-12T12:15:31.000964+0000","last_clean":"2024-09-12T12:15:31.000964+0000","last_became_active":"2024-09-12T12:15:29.997522+0000","last_became_peered":"2024-09-12T12:15:29.997522+0000","last_unstale":"2024-09-12T12:15:31.000964+0000","last_undegraded":"2024-09-12T12:15:31.000964+0000","last_fullsized":"2024-09-12T12:15:31.000964+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:37.753824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.339623+0000","last_change":"2024-09-12T12:15:28.989717+0000","last_active":"2024-09-12T12:15:32.339623+0000","last_peered":"2024-09-12T12:15:32.339623+0000","last_clean":"2024-09-12T12:15:32.339623+0000","last_became_active":"2024-09-12T12:15:28.989405+0000","last_became_peered":"2024-09-12T12:15:28.989405+0000","last_unstale":"2024-09-12T12:15:32.339623+0000","last_undegraded":"2024-09-12T12:15:32.339623+0000","last_fullsized":"2024-09-12T12:15:32.339623+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:15.376022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292250+0000","last_change":"2024-09-12T12:15:30.003846+0000","last_active":"2024-09-12T12:15:31.292250+0000","last_peered":"2024-09-12T12:15:31.292250+0000","last_clean":"2024-09-12T12:15:31.292250+0000","last_became_active":"2024-09-12T12:15:30.003092+0000","last_became_peered":"2024-09-12T12:15:30.003092+0000","last_unstale":"2024-09-12T12:15:31.292250+0000","last_undegraded":"2024-09-12T12:15:31.292250+0000","last_fullsized":"2024-09-12T12:15:31.292250+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:58.835451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"53'2","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000910+0000","last_change":"2024-09-12T12:15:28.983057+0000","last_active":"2024-09-12T12:15:31.000910+0000","last_peered":"2024-09-12T12:15:31.000910+0000","last_clean":"2024-09-12T12:15:31.000910+0000","last_became_active":"2024-09-12T12:15:28.982770+0000","last_became_peered":"2024-09-12T12:15:28.982770+0000","last_unstale":"2024-09-12T12:15:31.000910+0000","last_undegraded":"2024-09-12T12:15:31.000910+0000","last_fullsized":"2024-09-12T12:15:31.000910+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:41.313179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000523+0000","last_change":"2024-09-12T12:15:29.999640+0000","last_active":"2024-09-12T12:15:31.000523+0000","last_peered":"2024-09-12T12:15:31.000523+0000","last_clean":"2024-09-12T12:15:31.000523+0000","last_became_active":"2024-09-12T12:15:29.994495+0000","last_became_peered":"2024-09-12T12:15:29.994495+0000","last_unstale":"2024-09-12T12:15:31.000523+0000","last_undegraded":"2024-09-12T12:15:31.000523+0000","last_fullsized":"2024-09-12T12:15:31.000523+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:43.508119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013593+0000","last_change":"2024-09-12T12:15:28.989675+0000","last_active":"2024-09-12T12:15:31.013593+0000","last_peered":"2024-09-12T12:15:31.013593+0000","last_clean":"2024-09-12T12:15:31.013593+0000","last_became_active":"2024-09-12T12:15:28.989383+0000","last_became_peered":"2024-09-12T12:15:28.989383+0000","last_unstale":"2024-09-12T12:15:31.013593+0000","last_undegraded":"2024-09-12T12:15:31.013593+0000","last_fullsized":"2024-09-12T12:15:31.013593+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:14.812799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340476+0000","last_change":"2024-09-12T12:15:30.001588+0000","last_active":"2024-09-12T12:15:32.340476+0000","last_peered":"2024-09-12T12:15:32.340476+0000","last_clean":"2024-09-12T12:15:32.340476+0000","last_became_active":"2024-09-12T12:15:30.000471+0000","last_became_peered":"2024-09-12T12:15:30.000471+0000","last_unstale":"2024-09-12T12:15:32.340476+0000","last_undegraded":"2024-09-12T12:15:32.340476+0000","last_fullsized":"2024-09-12T12:15:32.340476+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:20.159552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011687+0000","last_change":"2024-09-12T12:15:28.982400+0000","last_active":"2024-09-12T12:15:31.011687+0000","last_peered":"2024-09-12T12:15:31.011687+0000","last_clean":"2024-09-12T12:15:31.011687+0000","last_became_active":"2024-09-12T12:15:28.982103+0000","last_became_peered":"2024-09-12T12:15:28.982103+0000","last_unstale":"2024-09-12T12:15:31.011687+0000","last_undegraded":"2024-09-12T12:15:31.011687+0000","last_fullsized":"2024-09-12T12:15:31.011687+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:08.684180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.011530+0000","last_change":"2024-09-12T12:15:30.007084+0000","last_active":"2024-09-12T12:15:31.011530+0000","last_peered":"2024-09-12T12:15:31.011530+0000","last_clean":"2024-09-12T12:15:31.011530+0000","last_became_active":"2024-09-12T12:15:30.006749+0000","last_became_peered":"2024-09-12T12:15:30.006749+0000","last_unstale":"2024-09-12T12:15:31.011530+0000","last_undegraded":"2024-09-12T12:15:31.011530+0000","last_fullsized":"2024-09-12T12:15:31.011530+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:53.512937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340422+0000","last_change":"2024-09-12T12:15:28.995466+0000","last_active":"2024-09-12T12:15:32.340422+0000","last_peered":"2024-09-12T12:15:32.340422+0000","last_clean":"2024-09-12T12:15:32.340422+0000","last_became_active":"2024-09-12T12:15:28.995180+0000","last_became_peered":"2024-09-12T12:15:28.995180+0000","last_unstale":"2024-09-12T12:15:32.340422+0000","last_undegraded":"2024-09-12T12:15:32.340422+0000","last_fullsized":"2024-09-12T12:15:32.340422+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:04.013840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.291993+0000","last_change":"2024-09-12T12:15:29.995581+0000","last_active":"2024-09-12T12:15:31.291993+0000","last_peered":"2024-09-12T12:15:31.291993+0000","last_clean":"2024-09-12T12:15:31.291993+0000","last_became_active":"2024-09-12T12:15:29.995201+0000","last_became_peered":"2024-09-12T12:15:29.995201+0000","last_unstale":"2024-09-12T12:15:31.291993+0000","last_undegraded":"2024-09-12T12:15:31.291993+0000","last_fullsized":"2024-09-12T12:15:31.291993+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:44.200116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340183+0000","last_change":"2024-09-12T12:15:28.997623+0000","last_active":"2024-09-12T12:15:32.340183+0000","last_peered":"2024-09-12T12:15:32.340183+0000","last_clean":"2024-09-12T12:15:32.340183+0000","last_became_active":"2024-09-12T12:15:28.997361+0000","last_became_peered":"2024-09-12T12:15:28.997361+0000","last_unstale":"2024-09-12T12:15:32.340183+0000","last_undegraded":"2024-09-12T12:15:32.340183+0000","last_fullsized":"2024-09-12T12:15:32.340183+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:25.365908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012021+0000","last_change":"2024-09-12T12:15:30.019997+0000","last_active":"2024-09-12T12:15:31.012021+0000","last_peered":"2024-09-12T12:15:31.012021+0000","last_clean":"2024-09-12T12:15:31.012021+0000","last_became_active":"2024-09-12T12:15:30.019722+0000","last_became_peered":"2024-09-12T12:15:30.019722+0000","last_unstale":"2024-09-12T12:15:31.012021+0000","last_undegraded":"2024-09-12T12:15:31.012021+0000","last_fullsized":"2024-09-12T12:15:31.012021+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:40.909134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:30.999415+0000","last_change":"2024-09-12T12:15:28.997529+0000","last_active":"2024-09-12T12:15:30.999415+0000","last_peered":"2024-09-12T12:15:30.999415+0000","last_clean":"2024-09-12T12:15:30.999415+0000","last_became_active":"2024-09-12T12:15:28.997217+0000","last_became_peered":"2024-09-12T12:15:28.997217+0000","last_unstale":"2024-09-12T12:15:30.999415+0000","last_undegraded":"2024-09-12T12:15:30.999415+0000","last_fullsized":"2024-09-12T12:15:30.999415+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:59.606826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.340873+0000","last_change":"2024-09-12T12:15:29.997113+0000","last_active":"2024-09-12T12:15:32.340873+0000","last_peered":"2024-09-12T12:15:32.340873+0000","last_clean":"2024-09-12T12:15:32.340873+0000","last_became_active":"2024-09-12T12:15:29.996840+0000","last_became_peered":"2024-09-12T12:15:29.996840+0000","last_unstale":"2024-09-12T12:15:32.340873+0000","last_undegraded":"2024-09-12T12:15:32.340873+0000","last_fullsized":"2024-09-12T12:15:32.340873+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:02:53.332565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.292244+0000","last_change":"2024-09-12T12:15:28.991866+0000","last_active":"2024-09-12T12:15:31.292244+0000","last_peered":"2024-09-12T12:15:31.292244+0000","last_clean":"2024-09-12T12:15:31.292244+0000","last_became_active":"2024-09-12T12:15:28.991562+0000","last_became_peered":"2024-09-12T12:15:28.991562+0000","last_unstale":"2024-09-12T12:15:31.292244+0000","last_undegraded":"2024-09-12T12:15:31.292244+0000","last_fullsized":"2024-09-12T12:15:31.292244+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:56.407792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.000400+0000","last_change":"2024-09-12T12:15:30.000772+0000","last_active":"2024-09-12T12:15:31.000400+0000","last_peered":"2024-09-12T12:15:31.000400+0000","last_clean":"2024-09-12T12:15:31.000400+0000","last_became_active":"2024-09-12T12:15:30.000098+0000","last_became_peered":"2024-09-12T12:15:30.000098+0000","last_unstale":"2024-09-12T12:15:31.000400+0000","last_undegraded":"2024-09-12T12:15:31.000400+0000","last_fullsized":"2024-09-12T12:15:31.000400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:28.958825+0000","last_clean_scrub_stamp":"2024-09-12T12:15:28.958825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:55.918299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"54'1","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.012122+0000","last_change":"2024-09-12T12:15:28.985626+0000","last_active":"2024-09-12T12:15:31.012122+0000","last_peered":"2024-09-12T12:15:31.012122+0000","last_clean":"2024-09-12T12:15:31.012122+0000","last_became_active":"2024-09-12T12:15:28.985369+0000","last_became_peered":"2024-09-12T12:15:28.985369+0000","last_unstale":"2024-09-12T12:15:31.012122+0000","last_undegraded":"2024-09-12T12:15:31.012122+0000","last_fullsized":"2024-09-12T12:15:31.012122+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:15:27.952729+0000","last_clean_scrub_stamp":"2024-09-12T12:15:27.952729+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:42.502023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":233,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-12T12:15:31.013029+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:15:31.013029+0000","last_peered":"2024-09-12T12:15:31.013029+0000","last_clean":"2024-09-12T12:15:31.013029+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:15:31.013029+0000","last_undegraded":"2024-09-12T12:15:31.013029+0000","last_fullsized":"2024-09-12T12:15:31.013029+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1245184,"data_stored":878674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35984,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335856,"statfs":{"total":96636764160,"available":96599916544,"internally_reserved":0,"allocated":651264,"data_stored":288834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":643072,"data_stored":288182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35980,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335860,"statfs":{"total":96636764160,"available":96599920640,"internally_reserved":0,"allocated":647168,"data_stored":288764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":659456,"data_stored":289816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":655360,"data_stored":289794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":651264,"data_stored":288342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36572,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335268,"statfs":{"total":96636764160,"available":96599314432,"internally_reserved":0,"allocated":1245184,"data_stored":878606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:15:39.350 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:15:39.350 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:15:39.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7fafa2a00640 1 Processor -- start 2024-09-12T12:15:39.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7fafa2a00640 1 -- start start 2024-09-12T12:15:39.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7fafa2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf9c15c2e0 0x7faf9c072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7fafa2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c0af5f0 0x7faf9c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7fafa2a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9c0733e0 con 0x7faf9c06c150 2024-09-12T12:15:39.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7fafa2a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faf9c06c5c0 con 0x7faf9c15c2e0 2024-09-12T12:15:39.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7fafa2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c0cd290 con 0x7faf9c0af5f0 2024-09-12T12:15:39.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7faf9be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf9c15c2e0 0x7faf9c072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7faf9be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf9c15c2e0 0x7faf9c072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52832/0 (socket says 172.21.15.144:52832) 2024-09-12T12:15:39.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7faf9be00640 1 -- 172.21.15.144:0/1593459145 learned_addr learned my addr 172.21.15.144:0/1593459145 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:39.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7faf9b400640 1 --2- 172.21.15.144:0/1593459145 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c0af5f0 0x7faf9c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7faf9be00640 1 -- 172.21.15.144:0/1593459145 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c0af5f0 msgr2=0x7faf9c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:39.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7faf9be00640 1 --2- 172.21.15.144:0/1593459145 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c0af5f0 0x7faf9c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7faf9be00640 1 -- 172.21.15.144:0/1593459145 >> v1:172.21.15.165:6789/0 conn(0x7faf9c06c150 legacy=0x7faf9c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.531+0000 7faf9be00640 1 -- 172.21.15.144:0/1593459145 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c0cd570 con 0x7faf9c15c2e0 2024-09-12T12:15:39.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7faf9be00640 1 --2- 172.21.15.144:0/1593459145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c15c2e0 0x7faf9c072b50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009870 tx=0x7faf8c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216daf9bca91fb09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:39.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7faf9aa00640 1 -- 172.21.15.144:0/1593459145 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0b0070 con 0x7faf9c15c2e0 2024-09-12T12:15:39.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7faf9aa00640 1 -- 172.21.15.144:0/1593459145 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c004230 con 0x7faf9c15c2e0 2024-09-12T12:15:39.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7faf9aa00640 1 -- 172.21.15.144:0/1593459145 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c003620 con 0x7faf9c15c2e0 2024-09-12T12:15:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7fafa2a00640 1 -- 172.21.15.144:0/1593459145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c15c2e0 msgr2=0x7faf9c072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7fafa2a00640 1 --2- 172.21.15.144:0/1593459145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c15c2e0 0x7faf9c072b50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009870 tx=0x7faf8c01c440 comp rx=0 tx=0).stop 2024-09-12T12:15:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7fafa2a00640 1 -- 172.21.15.144:0/1593459145 shutdown_connections 2024-09-12T12:15:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7fafa2a00640 1 --2- 172.21.15.144:0/1593459145 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c0af5f0 0x7faf9c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7fafa2a00640 1 --2- 172.21.15.144:0/1593459145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c15c2e0 0x7faf9c072b50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7fafa2a00640 1 -- 172.21.15.144:0/1593459145 >> 172.21.15.144:0/1593459145 conn(0x7faf9c068030 msgr2=0x7faf9c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7fafa2a00640 1 -- 172.21.15.144:0/1593459145 shutdown_connections 2024-09-12T12:15:39.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7fafa2a00640 1 -- 172.21.15.144:0/1593459145 wait complete. 2024-09-12T12:15:39.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.535+0000 7fafa2a00640 1 Processor -- start 2024-09-12T12:15:39.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 -- start start 2024-09-12T12:15:39.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c06c150 0x7faf9c13a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c0af5f0 0x7faf9c1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf9c15c2e0 0x7faf9c0ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1690a0 con 0x7faf9c0af5f0 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c168f20 con 0x7faf9c15c2e0 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c169220 con 0x7faf9c06c150 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c0af5f0 0x7faf9c1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c0af5f0 0x7faf9c1511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52836/0 (socket says 172.21.15.144:52836) 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9b400640 1 -- 172.21.15.144:0/2948731097 learned_addr learned my addr 172.21.15.144:0/2948731097 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9be00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c06c150 0x7faf9c13a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa0a00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf9c15c2e0 0x7faf9c0ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9b400640 1 -- 172.21.15.144:0/2948731097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c06c150 msgr2=0x7faf9c13a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9b400640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c06c150 0x7faf9c13a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9b400640 1 -- 172.21.15.144:0/2948731097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf9c15c2e0 msgr2=0x7faf9c0ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9b400640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf9c15c2e0 0x7faf9c0ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9b400640 1 -- 172.21.15.144:0/2948731097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c151c00 con 0x7faf9c0af5f0 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa0a00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf9c15c2e0 0x7faf9c0ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf9b400640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c0af5f0 0x7faf9c1511b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faf8800d830 tx=0x7faf8800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf93e00640 1 -- 172.21.15.144:0/2948731097 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8800b6c0 con 0x7faf9c0af5f0 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf93e00640 1 -- 172.21.15.144:0/2948731097 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf88019070 con 0x7faf9c0af5f0 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7faf93e00640 1 -- 172.21.15.144:0/2948731097 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8800bae0 con 0x7faf9c0af5f0 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c14d4e0 con 0x7faf9c0af5f0 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c14daa0 con 0x7faf9c0af5f0 2024-09-12T12:15:39.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.539+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9c06bc10 con 0x7faf9c0af5f0 2024-09-12T12:15:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.543+0000 7faf93e00640 1 -- 172.21.15.144:0/2948731097 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf8801e460 con 0x7faf9c0af5f0 2024-09-12T12:15:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.543+0000 7faf93e00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf7c0678c0 0x7faf7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.543+0000 7faf93e00640 1 -- 172.21.15.144:0/2948731097 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7faf880864e0 con 0x7faf9c0af5f0 2024-09-12T12:15:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.543+0000 7faf9be00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf7c0678c0 0x7faf7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.543+0000 7faf9be00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf7c0678c0 0x7faf7c069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0ad000 tx=0x7faf8c0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:39.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.547+0000 7faf93e00640 1 -- 172.21.15.144:0/2948731097 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf88056e80 con 0x7faf9c0af5f0 2024-09-12T12:15:39.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.759+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7faf9c0d0ed0 con 0x7faf9c0af5f0 2024-09-12T12:15:39.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7faf93e00640 1 -- 172.21.15.144:0/2948731097 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7faf88056780 con 0x7faf9c0af5f0 2024-09-12T12:15:39.764 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:15:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:15:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:15:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:15:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:15:39.765 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:15:39.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf7c0678c0 msgr2=0x7faf7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf7c0678c0 0x7faf7c069d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf8c0ad000 tx=0x7faf8c0a6000 comp rx=0 tx=0).stop 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c0af5f0 msgr2=0x7faf9c1511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c0af5f0 0x7faf9c1511b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7faf8800d830 tx=0x7faf8800dcf0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 shutdown_connections 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf7c0678c0 0x7faf7c069d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf9c15c2e0 0x7faf9c0ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf9c0af5f0 0x7faf9c1511b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 --2- 172.21.15.144:0/2948731097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf9c06c150 0x7faf9c13a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 >> 172.21.15.144:0/2948731097 conn(0x7faf9c068030 msgr2=0x7faf9c0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 shutdown_connections 2024-09-12T12:15:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.763+0000 7fafa2a00640 1 -- 172.21.15.144:0/2948731097 wait complete. 2024-09-12T12:15:39.786 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:15:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.919+0000 7f0c7b600640 1 Processor -- start 2024-09-12T12:15:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.919+0000 7f0c7b600640 1 -- start start 2024-09-12T12:15:39.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.919+0000 7f0c7b600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0c7415c7b0 0x7f0c740ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.919+0000 7f0c7b600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c740cd870 con 0x7f0c740b5fb0 2024-09-12T12:15:39.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.919+0000 7f0c7b600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c740cdb50 con 0x7f0c7415cd30 2024-09-12T12:15:39.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.919+0000 7f0c7b600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0c74072a50 con 0x7f0c7415c7b0 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.919+0000 7f0c79600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0c740b5fb0 0x7f0c74072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37720/0 (socket says 172.21.15.144:37720) 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.919+0000 7f0c79600640 1 -- 172.21.15.144:0/4201300188 learned_addr learned my addr 172.21.15.144:0/4201300188 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150791909 0 0) 0x7f0c740cd870 con 0x7f0c740b5fb0 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c58003530 con 0x7f0c740b5fb0 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c78c00640 1 --2- 172.21.15.144:0/4201300188 >> v2:172.21.15.165:3300/0 conn(0x7f0c7415c7b0 0x7f0c740ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 803203379 0 0) 0x7f0c58003530 con 0x7f0c740b5fb0 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 >> v2:172.21.15.165:3300/0 conn(0x7f0c7415c7b0 msgr2=0x7f0c740ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 --2- 172.21.15.144:0/4201300188 >> v2:172.21.15.165:3300/0 conn(0x7f0c7415c7b0 0x7f0c740ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 >> v1:172.21.15.165:6789/0 conn(0x7f0c7415cd30 legacy=0x7f0c740b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c740726e0 con 0x7f0c740b5fb0 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f0c6c001680 con 0x7f0c740b5fb0 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 >> v1:172.21.15.144:6789/0 conn(0x7f0c740b5fb0 legacy=0x7f0c74072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c580039c0 0x7f0c58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c58004810 0x7f0c58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c580051d0 0x7f0c5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74072a50 con 0x7f0c580039c0 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5800c120 con 0x7f0c58004810 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c5800c320 con 0x7f0c580051d0 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c78c00640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c580039c0 0x7f0c58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c73e00640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c58004810 0x7f0c58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c79600640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c580051d0 0x7f0c5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c78c00640 1 -- 172.21.15.144:0/4201300188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c580051d0 msgr2=0x7f0c5800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c78c00640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c580051d0 0x7f0c5800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c78c00640 1 -- 172.21.15.144:0/4201300188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c58004810 msgr2=0x7f0c58004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c78c00640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c58004810 0x7f0c58004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c78c00640 1 -- 172.21.15.144:0/4201300188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c58003530 con 0x7f0c580039c0 2024-09-12T12:15:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c79600640 1 -- 172.21.15.144:0/4201300188 reap_dead start 2024-09-12T12:15:39.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.923+0000 7f0c78c00640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c580039c0 0x7f0c58003de0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0c64007360 tx=0x7f0c6401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b6184737131435 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:39.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c640b2070 con 0x7f0c580039c0 2024-09-12T12:15:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c640a5b20 con 0x7f0c580039c0 2024-09-12T12:15:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c73400640 1 -- 172.21.15.144:0/4201300188 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64009be0 con 0x7f0c580039c0 2024-09-12T12:15:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 -- 172.21.15.144:0/4201300188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c580039c0 msgr2=0x7f0c58003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c580039c0 0x7f0c58003de0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0c64007360 tx=0x7f0c6401ce40 comp rx=0 tx=0).stop 2024-09-12T12:15:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 -- 172.21.15.144:0/4201300188 shutdown_connections 2024-09-12T12:15:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 --2- 172.21.15.144:0/4201300188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c580039c0 0x7f0c58003de0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 -- 172.21.15.144:0/4201300188 >> 172.21.15.144:0/4201300188 conn(0x7f0c7406d0d0 msgr2=0x7f0c7406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:39.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 -- 172.21.15.144:0/4201300188 shutdown_connections 2024-09-12T12:15:39.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 -- 172.21.15.144:0/4201300188 wait complete. 2024-09-12T12:15:39.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 Processor -- start 2024-09-12T12:15:39.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 -- start start 2024-09-12T12:15:39.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c580039c0 0x7f0c740aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740c6e50 0x7f0c740c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c741fb510 0x7f0c741fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74160560 con 0x7f0c740c6e50 2024-09-12T12:15:39.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741603e0 con 0x7f0c580039c0 2024-09-12T12:15:39.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c7b600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c741606e0 con 0x7f0c741fb510 2024-09-12T12:15:39.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740c6e50 0x7f0c740c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740c6e50 0x7f0c740c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52846/0 (socket says 172.21.15.144:52846) 2024-09-12T12:15:39.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c73e00640 1 -- 172.21.15.144:0/219276375 learned_addr learned my addr 172.21.15.144:0/219276375 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:39.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c78c00640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c580039c0 0x7f0c740aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.927+0000 7f0c79600640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c741fb510 0x7f0c741fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c73e00640 1 -- 172.21.15.144:0/219276375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c741fb510 msgr2=0x7f0c741fb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c73e00640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c741fb510 0x7f0c741fb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c73e00640 1 -- 172.21.15.144:0/219276375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c580039c0 msgr2=0x7f0c740aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:39.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c73e00640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c580039c0 0x7f0c740aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:39.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c73e00640 1 -- 172.21.15.144:0/219276375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c740c77f0 con 0x7f0c740c6e50 2024-09-12T12:15:39.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c73e00640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740c6e50 0x7f0c740c72b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000f820 tx=0x7f0c6000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:39.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c70c00640 1 -- 172.21.15.144:0/219276375 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60001cf0 con 0x7f0c740c6e50 2024-09-12T12:15:39.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c70c00640 1 -- 172.21.15.144:0/219276375 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c60018070 con 0x7f0c740c6e50 2024-09-12T12:15:39.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c70c00640 1 -- 172.21.15.144:0/219276375 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000d730 con 0x7f0c740c6e50 2024-09-12T12:15:39.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c740c5f10 con 0x7f0c740c6e50 2024-09-12T12:15:39.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c740c6490 con 0x7f0c740c6e50 2024-09-12T12:15:39.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c74160a70 con 0x7f0c740c6e50 2024-09-12T12:15:39.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c70c00640 1 -- 172.21.15.144:0/219276375 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c6000d8d0 con 0x7f0c740c6e50 2024-09-12T12:15:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c70c00640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678c0 0x7f0c54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c70c00640 1 -- 172.21.15.144:0/219276375 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f0c60085b40 con 0x7f0c740c6e50 2024-09-12T12:15:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.931+0000 7f0c78c00640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678c0 0x7f0c54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.935+0000 7f0c78c00640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678c0 0x7f0c54069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0c640af000 tx=0x7f0c64004a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:39.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:39.935+0000 7f0c70c00640 1 -- 172.21.15.144:0/219276375 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0c60055e90 con 0x7f0c740c6e50 2024-09-12T12:15:40.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.127+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c740b3160 con 0x7f0c740c6e50 2024-09-12T12:15:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.127+0000 7f0c70c00640 1 -- 172.21.15.144:0/219276375 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7f0c6005a190 con 0x7f0c740c6e50 2024-09-12T12:15:40.131 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:40.131 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-12T12:15:33:003315+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/149604375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":149604375},{"type":"v1","addr":"172.21.15.165:6834","nonce":149604375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3844758833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3844758833},{"type":"v1","addr":"172.21.15.144:6837","nonce":3844758833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/639962972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":639962972},{"type":"v1","addr":"172.21.15.165:6835","nonce":639962972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:15:29.364348+0000","modified":"2024-09-12T12:15:32.389508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6836/3957430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3957430285},{"type":"v1","addr":"172.21.15.144:6836","nonce":3957430285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-12T12:15:40.132 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-12T12:15:40.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678c0 msgr2=0x7f0c54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678c0 0x7f0c54069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0c640af000 tx=0x7f0c64004a50 comp rx=0 tx=0).stop 2024-09-12T12:15:40.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740c6e50 msgr2=0x7f0c740c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740c6e50 0x7f0c740c72b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000f820 tx=0x7f0c6000fce0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 shutdown_connections 2024-09-12T12:15:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678c0 0x7f0c54069d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c741fb510 0x7f0c741fb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740c6e50 0x7f0c740c72b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 --2- 172.21.15.144:0/219276375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c580039c0 0x7f0c740aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 >> 172.21.15.144:0/219276375 conn(0x7f0c7406d0d0 msgr2=0x7f0c7415b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 shutdown_connections 2024-09-12T12:15:40.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.131+0000 7f0c7b600640 1 -- 172.21.15.144:0/219276375 wait complete. 2024-09-12T12:15:40.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:15:29.364348+0000', 'modified': '2024-09-12T12:15:32.389508+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5283}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5283': {'gid': 5283, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6836/3957430285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3957430285}, {'type': 'v1', 'addr': '172.21.15.144:6836', 'nonce': 3957430285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5283, 'qdb_cluster': [5283]} 2024-09-12T12:15:40.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:15:40.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T12:15:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.691+0000 7f9dedc00640 1 Processor -- start 2024-09-12T12:15:40.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.691+0000 7f9dedc00640 1 -- start start 2024-09-12T12:15:40.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9dedc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9de815b4e0 0x7f9de80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9dedc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80b3ad0 0x7f9de8071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9dedc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de80b45a0 con 0x7f9de8071960 2024-09-12T12:15:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9dedc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9de80b3fe0 con 0x7f9de815b4e0 2024-09-12T12:15:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9dedc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9de80b42c0 con 0x7f9de80b3ad0 2024-09-12T12:15:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9de8071960 0x7f9de80ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37734/0 (socket says 172.21.15.144:37734) 2024-09-12T12:15:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de7400640 1 -- 172.21.15.144:0/611940262 learned_addr learned my addr 172.21.15.144:0/611940262 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de6000640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80b3ad0 0x7f9de8071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de6a00640 1 --2- 172.21.15.144:0/611940262 >> v2:172.21.15.165:3300/0 conn(0x7f9de815b4e0 0x7f9de80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294277632 0 0) 0x7f9de80b45a0 con 0x7f9de8071960 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dcc003530 con 0x7f9de8071960 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1441751389 0 0) 0x7f9dcc003530 con 0x7f9de8071960 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80b3ad0 msgr2=0x7f9de8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80b3ad0 0x7f9de8071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 >> v2:172.21.15.165:3300/0 conn(0x7f9de815b4e0 msgr2=0x7f9de80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 --2- 172.21.15.144:0/611940262 >> v2:172.21.15.165:3300/0 conn(0x7f9de815b4e0 0x7f9de80b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de80b1490 con 0x7f9de8071960 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f9de0001680 con 0x7f9de8071960 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 >> v1:172.21.15.144:6789/0 conn(0x7f9de8071960 legacy=0x7f9de80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc0039c0 0x7f9dcc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80b3ad0 0x7f9dcc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9dcc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80b3fe0 con 0x7f9dcc004d50 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80b42c0 con 0x7f9dcc0039c0 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc00b9d0 con 0x7f9de80b3ad0 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de7400640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9dcc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de6a00640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc0039c0 0x7f9dcc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de6000640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80b3ad0 0x7f9dcc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de7400640 1 -- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80b3ad0 msgr2=0x7f9dcc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de7400640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80b3ad0 0x7f9dcc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de7400640 1 -- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc0039c0 msgr2=0x7f9dcc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de7400640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc0039c0 0x7f9dcc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.695+0000 7f9de7400640 1 -- 172.21.15.144:0/611940262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc003530 con 0x7f9dcc004d50 2024-09-12T12:15:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9de7400640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9dcc0051d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9de8070fb0 tx=0x7f9de001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99314b9d81f3dcb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0007d40 con 0x7f9dcc004d50 2024-09-12T12:15:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de00a9020 con 0x7f9dcc004d50 2024-09-12T12:15:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9de5600640 1 -- 172.21.15.144:0/611940262 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de00a5b40 con 0x7f9dcc004d50 2024-09-12T12:15:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9dedc00640 1 -- 172.21.15.144:0/611940262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 msgr2=0x7f9dcc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9dedc00640 1 --2- 172.21.15.144:0/611940262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9dcc0051d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9de8070fb0 tx=0x7f9de001cc40 comp rx=0 tx=0).stop 2024-09-12T12:15:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9de7400640 1 -- 172.21.15.144:0/611940262 reap_dead start 2024-09-12T12:15:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9dedc00640 1 -- 172.21.15.144:0/611940262 shutdown_connections 2024-09-12T12:15:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9dedc00640 1 -- 172.21.15.144:0/611940262 >> 172.21.15.144:0/611940262 conn(0x7f9de806d0d0 msgr2=0x7f9de806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9dedc00640 1 -- 172.21.15.144:0/611940262 shutdown_connections 2024-09-12T12:15:40.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.699+0000 7f9dedc00640 1 -- 172.21.15.144:0/611940262 wait complete. 2024-09-12T12:15:40.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 Processor -- start 2024-09-12T12:15:40.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 -- start start 2024-09-12T12:15:40.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9de8158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80d0450 0x7f9de8151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9de80d08d0 0x7f9de81522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9de815b8c0 con 0x7f9dcc004d50 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9de80cdef0 con 0x7f9de80d08d0 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9de8157690 con 0x7f9de80d0450 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9de8158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9de8158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52856/0 (socket says 172.21.15.144:52856) 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6a00640 1 -- 172.21.15.144:0/69095611 learned_addr learned my addr 172.21.15.144:0/69095611 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6000640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80d0450 0x7f9de8151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de7400640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9de80d08d0 0x7f9de81522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6a00640 1 -- 172.21.15.144:0/69095611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80d0450 msgr2=0x7f9de8151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6a00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80d0450 0x7f9de8151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6a00640 1 -- 172.21.15.144:0/69095611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9de80d08d0 msgr2=0x7f9de81522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6a00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9de80d08d0 0x7f9de81522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6a00640 1 -- 172.21.15.144:0/69095611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de8157970 con 0x7f9dcc004d50 2024-09-12T12:15:40.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9de6a00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9de8158730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009f90 tx=0x7f9dd800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9ddea00640 1 -- 172.21.15.144:0/69095611 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800fea0 con 0x7f9dcc004d50 2024-09-12T12:15:40.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9ddea00640 1 -- 172.21.15.144:0/69095611 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd8015630 con 0x7f9dcc004d50 2024-09-12T12:15:40.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9ddea00640 1 -- 172.21.15.144:0/69095611 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8015a20 con 0x7f9dcc004d50 2024-09-12T12:15:40.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 -- 172.21.15.144:0/69095611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de8157c50 con 0x7f9dcc004d50 2024-09-12T12:15:40.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.703+0000 7f9dedc00640 1 -- 172.21.15.144:0/69095611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de8158210 con 0x7f9dcc004d50 2024-09-12T12:15:40.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9ddea00640 1 -- 172.21.15.144:0/69095611 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9dd8015bc0 con 0x7f9dcc004d50 2024-09-12T12:15:40.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9ddea00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dc8067800 0x7f9dc8069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9ddea00640 1 -- 172.21.15.144:0/69095611 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f9dd8086fd0 con 0x7f9dcc004d50 2024-09-12T12:15:40.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de6000640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dc8067800 0x7f9dc8069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9df1038000 1 Processor -- start 2024-09-12T12:15:40.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9df1038000 1 -- start start 2024-09-12T12:15:40.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de6000640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dc8067800 0x7f9dc8069cc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9de8160040 tx=0x7f9dd4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9df1038000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1af80 0x561fbfc1b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9df1038000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 0x561fbfbd1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9df1038000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfbd1a80 0x561fbfbd1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9df1038000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561fbfab4b60 con 0x561fbfbd1a80 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9df1038000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561fbfa1bc70 con 0x561fbfc1af80 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9df1038000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x561fbf9c1ed0 con 0x561fbfc1b8a0 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfbd1a80 0x561fbfbd1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfbd1a80 0x561fbfbd1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52872/0 (socket says 172.21.15.144:52872) 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de7400640 1 -- 172.21.15.144:0/2331057673 learned_addr learned my addr 172.21.15.144:0/2331057673 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de6000640 1 --2- 172.21.15.144:0/2331057673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 0x561fbfbd1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de6a00640 1 --2- 172.21.15.144:0/2331057673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1af80 0x561fbfc1b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de7400640 1 -- 172.21.15.144:0/2331057673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 msgr2=0x561fbfbd1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de7400640 1 --2- 172.21.15.144:0/2331057673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 0x561fbfbd1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de7400640 1 -- 172.21.15.144:0/2331057673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1af80 msgr2=0x561fbfc1b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de7400640 1 --2- 172.21.15.144:0/2331057673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1af80 0x561fbfc1b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de7400640 1 -- 172.21.15.144:0/2331057673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fbf9d3e50 con 0x561fbfbd1a80 2024-09-12T12:15:40.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.707+0000 7f9de7400640 1 --2- 172.21.15.144:0/2331057673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfbd1a80 0x561fbfbd1e60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9de0001980 tx=0x7f9de80b1660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c2699f2642404d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9dd3400640 1 -- 172.21.15.144:0/2331057673 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0007d40 con 0x561fbfbd1a80 2024-09-12T12:15:40.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9dd3400640 1 -- 172.21.15.144:0/2331057673 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de00a9040 con 0x561fbfbd1a80 2024-09-12T12:15:40.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9dd3400640 1 -- 172.21.15.144:0/2331057673 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0001660 con 0x561fbfbd1a80 2024-09-12T12:15:40.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- 172.21.15.144:0/2331057673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfbd1a80 msgr2=0x561fbfbd1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 --2- 172.21.15.144:0/2331057673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfbd1a80 0x561fbfbd1e60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9de0001980 tx=0x7f9de80b1660 comp rx=0 tx=0).stop 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- 172.21.15.144:0/2331057673 shutdown_connections 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 --2- 172.21.15.144:0/2331057673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfbd1a80 0x561fbfbd1e60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 --2- 172.21.15.144:0/2331057673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 0x561fbfbd1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 --2- 172.21.15.144:0/2331057673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1af80 0x561fbfc1b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- 172.21.15.144:0/2331057673 >> 172.21.15.144:0/2331057673 conn(0x561fbfbcda30 msgr2=0x561fbfbcfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- 172.21.15.144:0/2331057673 shutdown_connections 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- 172.21.15.144:0/2331057673 wait complete. 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- start start 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 Processor -- start 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfbd1a80 0x561fbfc210c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc21600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1b8a0 0x561fbfc077d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561fbfa7db00 con 0x561fbfc1af80 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561fbf9f6360 con 0x561fbfc1b8a0 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x561fbf9f32d0 con 0x561fbfbd1a80 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 10 client.0 _ll_register_callbacks cb 0x561fbfbb8820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc21600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc21600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52884/0 (socket says 172.21.15.144:52884) 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6000640 1 -- 172.21.15.144:0/1135455083 learned_addr learned my addr 172.21.15.144:0/1135455083 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6a00640 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfbd1a80 0x561fbfc210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de7400640 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1b8a0 0x561fbfc077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6000640 1 -- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfbd1a80 msgr2=0x561fbfc210c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6000640 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfbd1a80 0x561fbfc210c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6000640 1 -- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1b8a0 msgr2=0x561fbfc077d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6000640 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1b8a0 0x561fbfc077d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6000640 1 -- 172.21.15.144:0/1135455083 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fbf9c2120 con 0x561fbfc1af80 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de7400640 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1b8a0 0x561fbfc077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6a00640 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfbd1a80 0x561fbfc210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9de6000640 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc21600 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40038d0 tx=0x7f9dd40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb1339feca730c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9dc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9dc7e00640 1 -- 172.21.15.144:0/1135455083 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd401b070 con 0x561fbfc1af80 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9dc7e00640 1 -- 172.21.15.144:0/1135455083 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f9dd40159a0 con 0x561fbfc1af80 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.711+0000 7f9df1038000 1 -- 172.21.15.144:0/1135455083 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9de00a9040 con 0x561fbfc1af80 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9dc7e00640 1 -- 172.21.15.144:0/1135455083 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9dd4015ba0 con 0x561fbfc1af80 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 10 client.5427 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 -- 172.21.15.144:0/1135455083 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x561fbf9bb450 con 0x561fbfc1af80 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9dc7e00640 1 -- 172.21.15.144:0/1135455083 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de00a9040 con 0x561fbfc1af80 2024-09-12T12:15:40.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9dc7e00640 1 -- 172.21.15.144:0/1135455083 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f9dd4037080 con 0x561fbfc1af80 2024-09-12T12:15:40.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 10 client.5427 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:40.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 10 client.5427 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:15:40.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 20 client.5427 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:40.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561fbfc081e0 0x561fbfc085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 4 client.5427 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:40.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 -- 172.21.15.144:0/1135455083 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fbf9b5c00 con 0x561fbfc081e0 2024-09-12T12:15:40.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9de6a00640 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561fbfc081e0 0x561fbfc085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9dc7e00640 10 client.5427 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:40.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9de6a00640 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561fbfc081e0 0x561fbfc085c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a762617eba56a2f3 server_cookie=d155281696248137 in_seq=0 out_seq=0 2024-09-12T12:15:40.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9dc7e00640 1 -- 172.21.15.144:0/1135455083 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fbf9b5c00 con 0x561fbfc081e0 2024-09-12T12:15:40.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9dc7e00640 10 client.5427 handle_command_reply: tid=0 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 client.5427 shutdown 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 -- 172.21.15.144:0/1135455083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 msgr2=0x561fbfc21600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc21600 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40038d0 tx=0x7f9dd40046d0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 -- 172.21.15.144:0/1135455083 shutdown_connections 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561fbfc081e0 0x561fbfc085c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfc1b8a0 0x561fbfc077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc21600 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 --2- 172.21.15.144:0/1135455083 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfbd1a80 0x561fbfc210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9dc7e00640 0 client.5427 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 -- 172.21.15.144:0/1135455083 >> 172.21.15.144:0/1135455083 conn(0x561fbfbcda30 msgr2=0x561fbfbd2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 -- 172.21.15.144:0/1135455083 shutdown_connections 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 1 -- 172.21.15.144:0/1135455083 wait complete. 2024-09-12T12:15:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.715+0000 7f9df1038000 20 client.5427 trim_cache size 0 max 16384 2024-09-12T12:15:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 Processor -- start 2024-09-12T12:15:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 -- start start 2024-09-12T12:15:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc31470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc319b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 0x561fbfbd0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9de81fc220 con 0x561fbfc1af80 2024-09-12T12:15:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9de81f0cb0 con 0x561fbfbd1a80 2024-09-12T12:15:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9de81fbbd0 con 0x561fbfc1b8a0 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc319b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc319b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52894/0 (socket says 172.21.15.144:52894) 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6000640 1 -- 172.21.15.144:0/107753408 learned_addr learned my addr 172.21.15.144:0/107753408 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6a00640 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc31470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de7400640 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 0x561fbfbd0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6000640 1 -- 172.21.15.144:0/107753408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 msgr2=0x561fbfbd0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6000640 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 0x561fbfbd0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6000640 1 -- 172.21.15.144:0/107753408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 msgr2=0x561fbfc31470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6000640 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc31470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6000640 1 -- 172.21.15.144:0/107753408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fbf9a2fd0 con 0x561fbfc1af80 2024-09-12T12:15:40.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6a00640 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc31470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9de6000640 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc319b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4000c10 tx=0x7f9dd4025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8aafcaf60c0346 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9dd2a00640 1 -- 172.21.15.144:0/107753408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd402c550 con 0x561fbfc1af80 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9dd2a00640 1 -- 172.21.15.144:0/107753408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd4019070 con 0x561fbfc1af80 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9dd2a00640 1 -- 172.21.15.144:0/107753408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd402c8f0 con 0x561fbfc1af80 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 -- 172.21.15.144:0/107753408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 msgr2=0x561fbfc319b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.735+0000 7f9df1038000 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc319b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4000c10 tx=0x7f9dd4025040 comp rx=0 tx=0).stop 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- 172.21.15.144:0/107753408 shutdown_connections 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1b8a0 0x561fbfbd0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1af80 0x561fbfc319b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 --2- 172.21.15.144:0/107753408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc31470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- 172.21.15.144:0/107753408 >> 172.21.15.144:0/107753408 conn(0x561fbfbcda30 msgr2=0x561fbfbcfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- 172.21.15.144:0/107753408 shutdown_connections 2024-09-12T12:15:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- 172.21.15.144:0/107753408 wait complete. 2024-09-12T12:15:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- start start 2024-09-12T12:15:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 Processor -- start 2024-09-12T12:15:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc21380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1af80 0x561fbfc24f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1b8a0 0x561fbfc25470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561fbfa1af80 con 0x561fbfc1b8a0 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561fbf9d3ca0 con 0x561fbfbd1a80 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x561fbfa202a0 con 0x561fbfc1af80 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 10 client.0 _ll_register_callbacks cb 0x7f9dd4014bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1b8a0 0x561fbfc25470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1b8a0 0x561fbfc25470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52904/0 (socket says 172.21.15.144:52904) 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de7400640 1 -- 172.21.15.144:0/2128109833 learned_addr learned my addr 172.21.15.144:0/2128109833 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de6a00640 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc21380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de6000640 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1af80 0x561fbfc24f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de7400640 1 -- 172.21.15.144:0/2128109833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1af80 msgr2=0x561fbfc24f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de7400640 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1af80 0x561fbfc24f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de7400640 1 -- 172.21.15.144:0/2128109833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 msgr2=0x561fbfc21380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de7400640 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc21380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de7400640 1 -- 172.21.15.144:0/2128109833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fbfa9e750 con 0x561fbfc1b8a0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de6a00640 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc21380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9de7400640 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1b8a0 0x561fbfc25470 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9de001c6b0 tx=0x7f9de00199e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fd4e5a3c5261cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9dc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9dc7e00640 1 -- 172.21.15.144:0/2128109833 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de00a5940 con 0x561fbfc1b8a0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- 172.21.15.144:0/2128109833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dd4019070 con 0x561fbfc1b8a0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9dc7e00640 1 -- 172.21.15.144:0/2128109833 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f9de00a5ae0 con 0x561fbfc1b8a0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9dc7e00640 1 -- 172.21.15.144:0/2128109833 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9de00c9050 con 0x561fbfc1b8a0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 10 client.5433 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- 172.21.15.144:0/2128109833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x561fbf9a9a30 con 0x561fbfc1b8a0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9dc7e00640 1 -- 172.21.15.144:0/2128109833 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd4019070 con 0x561fbfc1b8a0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9dc7e00640 1 -- 172.21.15.144:0/2128109833 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f9de00cc020 con 0x561fbfc1b8a0 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 10 client.5433 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 10 client.5433 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 20 client.5433 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561fbfc259b0 0x561fbfc8d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 4 client.5433 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.739+0000 7f9df1038000 1 -- 172.21.15.144:0/2128109833 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "status"}) -- 0x561fbfbd8e30 con 0x561fbfc259b0 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9de6a00640 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561fbfc259b0 0x561fbfc8d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9de6a00640 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561fbfc259b0 0x561fbfc8d2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eabcf6bc8d0a785 server_cookie=17b4127b7f82e42a in_seq=0 out_seq=0 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dc7e00640 10 client.5433 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dc7e00640 1 -- 172.21.15.144:0/2128109833 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x561fbfbd8e30 con 0x561fbfc259b0 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dc7e00640 10 client.5433 handle_command_reply: tid=0 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 client.5433 shutdown 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 -- 172.21.15.144:0/2128109833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1b8a0 msgr2=0x561fbfc25470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1b8a0 0x561fbfc25470 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9de001c6b0 tx=0x7f9de00199e0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 -- 172.21.15.144:0/2128109833 shutdown_connections 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561fbfc259b0 0x561fbfc8d2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561fbfc1b8a0 0x561fbfc25470 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561fbfc1af80 0x561fbfc24f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 --2- 172.21.15.144:0/2128109833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fbfbd1a80 0x561fbfc21380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dc7e00640 0 client.5433 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 -- 172.21.15.144:0/2128109833 >> 172.21.15.144:0/2128109833 conn(0x561fbfbcda30 msgr2=0x561fbfbd0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 -- 172.21.15.144:0/2128109833 shutdown_connections 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 1 -- 172.21.15.144:0/2128109833 wait complete. 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9df1038000 20 client.5433 trim_cache size 0 max 16384 2024-09-12T12:15:40.749 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5283, 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 10.753710658999999, 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 26, 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 54, 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 54, 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 15.635068663 2024-09-12T12:15:40.750 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 -- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dc8067800 msgr2=0x7f9dc8069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dc8067800 0x7f9dc8069cc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9de8160040 tx=0x7f9dd4009190 comp rx=0 tx=0).stop 2024-09-12T12:15:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 -- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 msgr2=0x7f9de8158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9de8158730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009f90 tx=0x7f9dd800f580 comp rx=0 tx=0).stop 2024-09-12T12:15:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 -- 172.21.15.144:0/69095611 shutdown_connections 2024-09-12T12:15:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dc8067800 0x7f9dc8069cc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9de80d08d0 0x7f9de81522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9de80d0450 0x7f9de8151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 --2- 172.21.15.144:0/69095611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc004d50 0x7f9de8158730 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 -- 172.21.15.144:0/69095611 >> 172.21.15.144:0/69095611 conn(0x7f9de806d0d0 msgr2=0x7f9de8156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 -- 172.21.15.144:0/69095611 shutdown_connections 2024-09-12T12:15:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.743+0000 7f9dedc00640 1 -- 172.21.15.144:0/69095611 wait complete. 2024-09-12T12:15:40.765 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:15:40.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb934200640 1 Processor -- start 2024-09-12T12:15:40.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb934200640 1 -- start start 2024-09-12T12:15:40.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb934200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb92c0b0480 0x7fb92c169560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb934200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb92c148570 con 0x7fb92c148190 2024-09-12T12:15:40.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb934200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb92c0b41f0 con 0x7fb92c0cd640 2024-09-12T12:15:40.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb934200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb92c0ce090 con 0x7fb92c0b0480 2024-09-12T12:15:40.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb931800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb92c148190 0x7fb92c0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37748/0 (socket says 172.21.15.144:37748) 2024-09-12T12:15:40.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb931800640 1 -- 172.21.15.144:0/2597539580 learned_addr learned my addr 172.21.15.144:0/2597539580 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:40.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb932200640 1 --2- 172.21.15.144:0/2597539580 >> v2:172.21.15.165:3300/0 conn(0x7fb92c0b0480 0x7fb92c169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb92be00640 1 -- 172.21.15.144:0/2597539580 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268456589 0 0) 0x7fb92c148570 con 0x7fb92c148190 2024-09-12T12:15:40.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb92be00640 1 -- 172.21.15.144:0/2597539580 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb914003530 con 0x7fb92c148190 2024-09-12T12:15:40.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb92be00640 1 -- 172.21.15.144:0/2597539580 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403049941 0 0) 0x7fb92c0b41f0 con 0x7fb92c0cd640 2024-09-12T12:15:40.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb932200640 1 -- 172.21.15.144:0/2597539580 >> v1:172.21.15.165:6789/0 conn(0x7fb92c0cd640 legacy=0x7fb92c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb932200640 1 -- 172.21.15.144:0/2597539580 >> v1:172.21.15.144:6789/0 conn(0x7fb92c148190 legacy=0x7fb92c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.899+0000 7fb932200640 1 -- 172.21.15.144:0/2597539580 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c0b0950 con 0x7fb92c0b0480 2024-09-12T12:15:40.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb932200640 1 --2- 172.21.15.144:0/2597539580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92c0b0480 0x7fb92c169560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0b43c0 tx=0x7fb92401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=119fd54ce25a62fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb92be00640 1 -- 172.21.15.144:0/2597539580 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9240b1070 con 0x7fb92c0b0480 2024-09-12T12:15:40.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb92be00640 1 -- 172.21.15.144:0/2597539580 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9240ac5f0 con 0x7fb92c0b0480 2024-09-12T12:15:40.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb92be00640 1 -- 172.21.15.144:0/2597539580 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9240ac9a0 con 0x7fb92c0b0480 2024-09-12T12:15:40.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb934200640 1 -- 172.21.15.144:0/2597539580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92c0b0480 msgr2=0x7fb92c169560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb934200640 1 --2- 172.21.15.144:0/2597539580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92c0b0480 0x7fb92c169560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0b43c0 tx=0x7fb92401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb934200640 1 -- 172.21.15.144:0/2597539580 shutdown_connections 2024-09-12T12:15:40.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb934200640 1 --2- 172.21.15.144:0/2597539580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92c0b0480 0x7fb92c169560 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb934200640 1 -- 172.21.15.144:0/2597539580 >> 172.21.15.144:0/2597539580 conn(0x7fb92c06d0d0 msgr2=0x7fb92c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb934200640 1 -- 172.21.15.144:0/2597539580 shutdown_connections 2024-09-12T12:15:40.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.903+0000 7fb934200640 1 -- 172.21.15.144:0/2597539580 wait complete. 2024-09-12T12:15:40.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 Processor -- start 2024-09-12T12:15:40.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 -- start start 2024-09-12T12:15:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92c0b0480 0x7fb92c072000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92c0cd640 0x7fb92c073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92c148190 0x7fb92c1444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c16c850 con 0x7fb92c0cd640 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c16c6d0 con 0x7fb92c0b0480 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb92c16c9d0 con 0x7fb92c148190 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb930e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92c0cd640 0x7fb92c073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb930e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92c0cd640 0x7fb92c073890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52918/0 (socket says 172.21.15.144:52918) 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb930e00640 1 -- 172.21.15.144:0/4184571061 learned_addr learned my addr 172.21.15.144:0/4184571061 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb931800640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92c0b0480 0x7fb92c072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb932200640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92c148190 0x7fb92c1444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb930e00640 1 -- 172.21.15.144:0/4184571061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92c148190 msgr2=0x7fb92c1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb930e00640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92c148190 0x7fb92c1444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb930e00640 1 -- 172.21.15.144:0/4184571061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92c0b0480 msgr2=0x7fb92c072000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb930e00640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92c0b0480 0x7fb92c072000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb930e00640 1 -- 172.21.15.144:0/4184571061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c15f740 con 0x7fb92c0cd640 2024-09-12T12:15:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb930e00640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92c0cd640 0x7fb92c073890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c500 tx=0x7fb91800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb929600640 1 -- 172.21.15.144:0/4184571061 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918017070 con 0x7fb92c0cd640 2024-09-12T12:15:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92c15f9e0 con 0x7fb92c0cd640 2024-09-12T12:15:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb929600640 1 -- 172.21.15.144:0/4184571061 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb918003600 con 0x7fb92c0cd640 2024-09-12T12:15:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb929600640 1 -- 172.21.15.144:0/4184571061 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9180039f0 con 0x7fb92c0cd640 2024-09-12T12:15:40.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.907+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92c160280 con 0x7fb92c0cd640 2024-09-12T12:15:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.911+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92c15fbb0 con 0x7fb92c0cd640 2024-09-12T12:15:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.911+0000 7fb929600640 1 -- 172.21.15.144:0/4184571061 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb91801a070 con 0x7fb92c0cd640 2024-09-12T12:15:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.911+0000 7fb929600640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb90c0678c0 0x7fb90c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.911+0000 7fb929600640 1 -- 172.21.15.144:0/4184571061 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fb918085380 con 0x7fb92c0cd640 2024-09-12T12:15:40.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.911+0000 7fb931800640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb90c0678c0 0x7fb90c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.911+0000 7fb931800640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb90c0678c0 0x7fb90c069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb920005c10 tx=0x7fb920009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:40.915+0000 7fb929600640 1 -- 172.21.15.144:0/4184571061 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb918055680 con 0x7fb92c0cd640 2024-09-12T12:15:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.111+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb92c073dd0 con 0x7fb92c0cd640 2024-09-12T12:15:41.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.111+0000 7fb929600640 1 -- 172.21.15.144:0/4184571061 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7fb918059980 con 0x7fb92c0cd640 2024-09-12T12:15:41.115 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:15:41.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb90c0678c0 msgr2=0x7fb90c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:41.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb90c0678c0 0x7fb90c069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb920005c10 tx=0x7fb920009040 comp rx=0 tx=0).stop 2024-09-12T12:15:41.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92c0cd640 msgr2=0x7fb92c073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:41.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92c0cd640 0x7fb92c073890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb91800c500 tx=0x7fb91800c9c0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 shutdown_connections 2024-09-12T12:15:41.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb90c0678c0 0x7fb90c069d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb92c148190 0x7fb92c1444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92c0cd640 0x7fb92c073890 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 --2- 172.21.15.144:0/4184571061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92c0b0480 0x7fb92c072000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 >> 172.21.15.144:0/4184571061 conn(0x7fb92c06d0d0 msgr2=0x7fb92c0b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:41.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 shutdown_connections 2024-09-12T12:15:41.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41.115+0000 7fb934200640 1 -- 172.21.15.144:0/4184571061 wait complete. 2024-09-12T12:15:41.137 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:15:41.137 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:15:41.137 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:15:41.137 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:15:41.137 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:15:41.137 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:15:41.137 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:15:41.137 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:15:41.137 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:15:41.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:41.138 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:15:41.147 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:15:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:15:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:15:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:15:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:15:41.147 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:15:41.148 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:15:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:15:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:15:41.148 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:15:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:15:41.148 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:15:41.148 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42242sec preferred_lft 42242sec 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:15:41.149 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:15:41.150 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:15:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:15:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:15:41.151 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:15:41.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:41.151 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:15:41.209 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:15:41.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:41.211 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:15:41.263 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:15:41.263 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:15:41.263 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:15:41.263 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:15:41.263 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:15:41.264 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:15:41.264 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:15:41.264 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:15:41.264 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:15:41.264 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:15:41.264 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:15:41.264 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:15:41.264 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:15:41.264 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:15:41.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:15:41.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:15:41.265 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:15:41.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:15:41.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:15:41.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:41.400 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:15:41.409 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:15:41.409 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:15:41.409 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:15:41.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:41.410 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:15:41.476 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:15:41.476 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:15:41.527 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:15:41.528 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:15:41.528 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:15:41.579 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:15:41.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:41.579 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:15:41.667 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:15:41.667 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:15:41.680 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:15:41.680 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:15:41.681 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:15:41.681 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:15:41.681 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:15:41.685 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:15:41.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:41.685 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:15:41.705 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:15:41.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:15:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:15:41.808 INFO:teuthology.orchestra.run.smithi144.stdout:client5356 2024-09-12T12:15:41.808 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:15:41.809 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:41.859 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-12T12:15:41.860 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-12T12:15:41.860 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-12T12:15:41.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:41.860 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-12T12:15:41.919 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:15:41.919 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:15:41.919 DEBUG:teuthology.orchestra.run.smithi144:> import stat 2024-09-12T12:15:41.919 DEBUG:teuthology.orchestra.run.smithi144:> import json 2024-09-12T12:15:41.920 DEBUG:teuthology.orchestra.run.smithi144:> import sys 2024-09-12T12:15:41.920 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:15:41.920 DEBUG:teuthology.orchestra.run.smithi144:> try: 2024-09-12T12:15:41.920 DEBUG:teuthology.orchestra.run.smithi144:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-12T12:15:41.920 DEBUG:teuthology.orchestra.run.smithi144:> except OSError as e: 2024-09-12T12:15:41.920 DEBUG:teuthology.orchestra.run.smithi144:> sys.exit(e.errno) 2024-09-12T12:15:41.921 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:15:41.921 DEBUG:teuthology.orchestra.run.smithi144:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-12T12:15:41.921 DEBUG:teuthology.orchestra.run.smithi144:> print(json.dumps( 2024-09-12T12:15:41.921 DEBUG:teuthology.orchestra.run.smithi144:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-12T12:15:41.921 DEBUG:teuthology.orchestra.run.smithi144:> indent=2)) 2024-09-12T12:15:41.921 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:15:42.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:42 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-12T12:15:42.037 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T12:15:42.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:42.038 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-09-12T12:15:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-09-12T12:15:42.280 INFO:teuthology.orchestra.run.smithi144.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-12T12:15:42.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:15:42.565 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:15:45.530 INFO:teuthology.orchestra.run.smithi144.stderr:Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 81% (1144/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-12T12:15:45.537 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-09-12T12:15:45.537 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-12T12:15:45.537 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-12T12:15:45.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5203600640 1 Processor -- start 2024-09-12T12:15:45.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5203600640 1 -- start start 2024-09-12T12:15:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5203600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc15eb20 0x7f51fc0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5203600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51fc0b3970 0x7f51fc0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5203600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51fc0b3470 con 0x7f51fc0b4b20 2024-09-12T12:15:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5203600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f51fc0b5440 con 0x7f51fc0b3970 2024-09-12T12:15:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5203600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc15f270 con 0x7f51fc15eb20 2024-09-12T12:15:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5200c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f51fc0b4b20 0x7f51fc162950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37752/0 (socket says 172.21.15.144:37752) 2024-09-12T12:15:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5200c00640 1 -- 172.21.15.144:0/1327377570 learned_addr learned my addr 172.21.15.144:0/1327377570 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5201600640 1 --2- 172.21.15.144:0/1327377570 >> v2:172.21.15.144:3300/0 conn(0x7f51fc0b3970 0x7f51fc0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f51fbe00640 1 --2- 172.21.15.144:0/1327377570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc15eb20 0x7f51fc0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f51fb400640 1 -- 172.21.15.144:0/1327377570 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011803035 0 0) 0x7f51fc0b3470 con 0x7f51fc0b4b20 2024-09-12T12:15:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f51fb400640 1 -- 172.21.15.144:0/1327377570 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e0003530 con 0x7f51fc0b4b20 2024-09-12T12:15:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5201600640 1 -- 172.21.15.144:0/1327377570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc15eb20 msgr2=0x7f51fc0b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5201600640 1 --2- 172.21.15.144:0/1327377570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc15eb20 0x7f51fc0b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5201600640 1 -- 172.21.15.144:0/1327377570 >> v1:172.21.15.144:6789/0 conn(0x7f51fc0b4b20 legacy=0x7f51fc162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f5201600640 1 -- 172.21.15.144:0/1327377570 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc15f550 con 0x7f51fc0b3970 2024-09-12T12:15:45.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.675+0000 7f51fbe00640 1 --2- 172.21.15.144:0/1327377570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc15eb20 0x7f51fc0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f5201600640 1 --2- 172.21.15.144:0/1327377570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51fc0b3970 0x7f51fc0b3e00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f51f40097f0 tx=0x7f51f401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8d2e22ab6bfe7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f51fb400640 1 -- 172.21.15.144:0/1327377570 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f40b0070 con 0x7f51fc0b3970 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f51fb400640 1 -- 172.21.15.144:0/1327377570 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f40ab600 con 0x7f51fc0b3970 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f51fb400640 1 -- 172.21.15.144:0/1327377570 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f40ab9b0 con 0x7f51fc0b3970 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f5203600640 1 -- 172.21.15.144:0/1327377570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51fc0b3970 msgr2=0x7f51fc0b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f5203600640 1 --2- 172.21.15.144:0/1327377570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51fc0b3970 0x7f51fc0b3e00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f51f40097f0 tx=0x7f51f401c410 comp rx=0 tx=0).stop 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f5203600640 1 -- 172.21.15.144:0/1327377570 shutdown_connections 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f5203600640 1 --2- 172.21.15.144:0/1327377570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51fc0b3970 0x7f51fc0b3e00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f5203600640 1 --2- 172.21.15.144:0/1327377570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc15eb20 0x7f51fc0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f5203600640 1 -- 172.21.15.144:0/1327377570 >> 172.21.15.144:0/1327377570 conn(0x7f51fc068030 msgr2=0x7f51fc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f5203600640 1 -- 172.21.15.144:0/1327377570 shutdown_connections 2024-09-12T12:15:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.679+0000 7f5203600640 1 -- 172.21.15.144:0/1327377570 wait complete. 2024-09-12T12:15:45.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 Processor -- start 2024-09-12T12:15:45.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 -- start start 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc0b3970 0x7f51fc1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51fc0b4b20 0x7f51fc157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51fc15eb20 0x7f51fc0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc06bfa0 con 0x7f51fc0b4b20 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc06be20 con 0x7f51fc15eb20 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc06c120 con 0x7f51fc0b3970 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51fc0b4b20 0x7f51fc157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51fc0b4b20 0x7f51fc157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52930/0 (socket says 172.21.15.144:52930) 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51fbe00640 1 -- 172.21.15.144:0/1977141689 learned_addr learned my addr 172.21.15.144:0/1977141689 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5201600640 1 --2- 172.21.15.144:0/1977141689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51fc15eb20 0x7f51fc0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5200c00640 1 --2- 172.21.15.144:0/1977141689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc0b3970 0x7f51fc1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51fbe00640 1 -- 172.21.15.144:0/1977141689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc0b3970 msgr2=0x7f51fc1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51fbe00640 1 --2- 172.21.15.144:0/1977141689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc0b3970 0x7f51fc1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51fbe00640 1 -- 172.21.15.144:0/1977141689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51fc15eb20 msgr2=0x7f51fc0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51fbe00640 1 --2- 172.21.15.144:0/1977141689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51fc15eb20 0x7f51fc0cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51fbe00640 1 -- 172.21.15.144:0/1977141689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc158460 con 0x7f51fc0b4b20 2024-09-12T12:15:45.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5200c00640 1 --2- 172.21.15.144:0/1977141689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51fc0b3970 0x7f51fc1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:45.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51fbe00640 1 --2- 172.21.15.144:0/1977141689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51fc0b4b20 0x7f51fc157f20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c820 tx=0x7f51e800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51f8c00640 1 -- 172.21.15.144:0/1977141689 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8015070 con 0x7f51fc0b4b20 2024-09-12T12:15:45.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51f8c00640 1 -- 172.21.15.144:0/1977141689 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e8007a30 con 0x7f51fc0b4b20 2024-09-12T12:15:45.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f51f8c00640 1 -- 172.21.15.144:0/1977141689 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8007e40 con 0x7f51fc0b4b20 2024-09-12T12:15:45.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 -- 172.21.15.144:0/1977141689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51fc0b1a30 con 0x7f51fc0b4b20 2024-09-12T12:15:45.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.683+0000 7f5203600640 1 -- 172.21.15.144:0/1977141689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51fc138140 con 0x7f51fc0b4b20 2024-09-12T12:15:45.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51f8c00640 1 -- 172.21.15.144:0/1977141689 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51e8018070 con 0x7f51fc0b4b20 2024-09-12T12:15:45.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51f8c00640 1 --2- 172.21.15.144:0/1977141689 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51dc0678c0 0x7f51dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51f8c00640 1 -- 172.21.15.144:0/1977141689 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f51e8085c50 con 0x7f51fc0b4b20 2024-09-12T12:15:45.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5206aaf000 1 Processor -- start 2024-09-12T12:15:45.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5200c00640 1 --2- 172.21.15.144:0/1977141689 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51dc0678c0 0x7f51dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5206aaf000 1 -- start start 2024-09-12T12:15:45.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5200c00640 1 --2- 172.21.15.144:0/1977141689 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51dc0678c0 0x7f51dc069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51ec005c10 tx=0x7f51ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a8558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a855e10 0x557c4a80bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a80c430 0x557c4a80c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5206aaf000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557c4a6f36a0 con 0x557c4a855e10 2024-09-12T12:15:45.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5206aaf000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557c4a659b80 con 0x557c4a80c430 2024-09-12T12:15:45.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5206aaf000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557c4a6006d0 con 0x557c4a8554f0 2024-09-12T12:15:45.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a855e10 0x557c4a80bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a855e10 0x557c4a80bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52946/0 (socket says 172.21.15.144:52946) 2024-09-12T12:15:45.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51fbe00640 1 -- 172.21.15.144:0/559770671 learned_addr learned my addr 172.21.15.144:0/559770671 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5201600640 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a80c430 0x557c4a80c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5200c00640 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a8558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51fbe00640 1 -- 172.21.15.144:0/559770671 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 msgr2=0x557c4a8558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51fbe00640 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a8558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51fbe00640 1 -- 172.21.15.144:0/559770671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a80c430 msgr2=0x557c4a80c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51fbe00640 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a80c430 0x557c4a80c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f51fbe00640 1 -- 172.21.15.144:0/559770671 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4a612030 con 0x557c4a855e10 2024-09-12T12:15:45.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.687+0000 7f5201600640 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a80c430 0x557c4a80c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:45.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f51fbe00640 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a855e10 0x557c4a80bef0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f51e805e5a0 tx=0x7f51e805a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ae45a5b206db89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f51f1600640 1 -- 172.21.15.144:0/559770671 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e801f040 con 0x557c4a855e10 2024-09-12T12:15:45.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f51f1600640 1 -- 172.21.15.144:0/559770671 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e80542a0 con 0x557c4a855e10 2024-09-12T12:15:45.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f51f1600640 1 -- 172.21.15.144:0/559770671 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e80553f0 con 0x557c4a855e10 2024-09-12T12:15:45.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- 172.21.15.144:0/559770671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a855e10 msgr2=0x557c4a80bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a855e10 0x557c4a80bef0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f51e805e5a0 tx=0x7f51e805a3e0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- 172.21.15.144:0/559770671 shutdown_connections 2024-09-12T12:15:45.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a80c430 0x557c4a80c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a855e10 0x557c4a80bef0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 --2- 172.21.15.144:0/559770671 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a8558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- 172.21.15.144:0/559770671 >> 172.21.15.144:0/559770671 conn(0x557c4a803820 msgr2=0x557c4a80a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- 172.21.15.144:0/559770671 shutdown_connections 2024-09-12T12:15:45.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- 172.21.15.144:0/559770671 wait complete. 2024-09-12T12:15:45.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- start start 2024-09-12T12:15:45.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 Processor -- start 2024-09-12T12:15:45.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a854f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a810c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a855e10 0x557c4a811140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557c4a6178f0 con 0x557c4a80c430 2024-09-12T12:15:45.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557c4a655b40 con 0x557c4a855e10 2024-09-12T12:15:45.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557c4a815090 con 0x557c4a8554f0 2024-09-12T12:15:45.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 10 client.0 _ll_register_callbacks cb 0x557c4a70e270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:45.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5200c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a854f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5200c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a854f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52954/0 (socket says 172.21.15.144:52954) 2024-09-12T12:15:45.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5200c00640 1 -- 172.21.15.144:0/1417836826 learned_addr learned my addr 172.21.15.144:0/1417836826 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f51fbe00640 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a810c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5201600640 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a855e10 0x557c4a811140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5200c00640 1 -- 172.21.15.144:0/1417836826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 msgr2=0x557c4a810c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5200c00640 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a810c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5200c00640 1 -- 172.21.15.144:0/1417836826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a855e10 msgr2=0x557c4a811140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5200c00640 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a855e10 0x557c4a811140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5200c00640 1 -- 172.21.15.144:0/1417836826 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c4a600920 con 0x557c4a80c430 2024-09-12T12:15:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f51fbe00640 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a810c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:45.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5200c00640 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a854f30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f51ec007680 tx=0x7f51ec001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa8202b2f10f7cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f51e6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f51e6000640 1 -- 172.21.15.144:0/1417836826 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec027060 con 0x557c4a80c430 2024-09-12T12:15:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f51e6000640 1 -- 172.21.15.144:0/1417836826 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f51ec010040 con 0x557c4a80c430 2024-09-12T12:15:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.691+0000 7f5206aaf000 1 -- 172.21.15.144:0/1417836826 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e80542a0 con 0x557c4a80c430 2024-09-12T12:15:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f51e6000640 1 -- 172.21.15.144:0/1417836826 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f51ec0159c0 con 0x557c4a80c430 2024-09-12T12:15:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 10 client.5454 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 -- 172.21.15.144:0/1417836826 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x557c4a5f9b30 con 0x557c4a80c430 2024-09-12T12:15:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f51e6000640 1 -- 172.21.15.144:0/1417836826 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e80542a0 con 0x557c4a80c430 2024-09-12T12:15:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f51e6000640 1 -- 172.21.15.144:0/1417836826 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f51ec015b60 con 0x557c4a80c430 2024-09-12T12:15:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 10 client.5454 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 10 client.5454 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:45.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 20 client.5454 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:45.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557c4a817100 0x557c4a8667a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 4 client.5454 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:45.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 -- 172.21.15.144:0/1417836826 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c4a5f4150 con 0x557c4a817100 2024-09-12T12:15:45.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f51fbe00640 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557c4a817100 0x557c4a8667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f51fbe00640 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557c4a817100 0x557c4a8667a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74a10c821ff5e374 server_cookie=29e7c842387a575c in_seq=0 out_seq=0 2024-09-12T12:15:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f51e6000640 10 client.5454 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f51e6000640 1 -- 172.21.15.144:0/1417836826 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c4a5f4150 con 0x557c4a817100 2024-09-12T12:15:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f51e6000640 10 client.5454 handle_command_reply: tid=0 2024-09-12T12:15:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 client.5454 shutdown 2024-09-12T12:15:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 -- 172.21.15.144:0/1417836826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 msgr2=0x557c4a854f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a854f30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f51ec007680 tx=0x7f51ec001260 comp rx=0 tx=0).stop 2024-09-12T12:15:45.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 -- 172.21.15.144:0/1417836826 shutdown_connections 2024-09-12T12:15:45.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557c4a817100 0x557c4a8667a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a855e10 0x557c4a811140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a810c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 --2- 172.21.15.144:0/1417836826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a854f30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f51e6000640 0 client.5454 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:45.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 -- 172.21.15.144:0/1417836826 >> 172.21.15.144:0/1417836826 conn(0x557c4a803820 msgr2=0x557c4a80a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 -- 172.21.15.144:0/1417836826 shutdown_connections 2024-09-12T12:15:45.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 1 -- 172.21.15.144:0/1417836826 wait complete. 2024-09-12T12:15:45.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.695+0000 7f5206aaf000 20 client.5454 trim_cache size 0 max 16384 2024-09-12T12:15:45.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5206aaf000 1 Processor -- start 2024-09-12T12:15:45.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5206aaf000 1 -- start start 2024-09-12T12:15:45.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a803820 0x557c4a810780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a810cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a8667a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5206aaf000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc203fc0 con 0x557c4a80c430 2024-09-12T12:15:45.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5206aaf000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc202fd0 con 0x557c4a803820 2024-09-12T12:15:45.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5206aaf000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc0b13e0 con 0x557c4a8554f0 2024-09-12T12:15:45.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a810cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a810cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52970/0 (socket says 172.21.15.144:52970) 2024-09-12T12:15:45.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51fbe00640 1 -- 172.21.15.144:0/3141548030 learned_addr learned my addr 172.21.15.144:0/3141548030 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5201600640 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a8667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5200c00640 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a803820 0x557c4a810780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51fbe00640 1 -- 172.21.15.144:0/3141548030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 msgr2=0x557c4a8667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51fbe00640 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a8667a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51fbe00640 1 -- 172.21.15.144:0/3141548030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a803820 msgr2=0x557c4a810780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51fbe00640 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a803820 0x557c4a810780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51fbe00640 1 -- 172.21.15.144:0/3141548030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4a6dc6c0 con 0x557c4a80c430 2024-09-12T12:15:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f5200c00640 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a803820 0x557c4a810780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51fbe00640 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a810cc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cfd0 tx=0x7f51e801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51f161f2351ff1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51f0c00640 1 -- 172.21.15.144:0/3141548030 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8081040 con 0x557c4a80c430 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51f0c00640 1 -- 172.21.15.144:0/3141548030 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e80743a0 con 0x557c4a80c430 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.711+0000 7f51f0c00640 1 -- 172.21.15.144:0/3141548030 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e801f040 con 0x557c4a80c430 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- 172.21.15.144:0/3141548030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 msgr2=0x557c4a810cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a810cc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cfd0 tx=0x7f51e801c000 comp rx=0 tx=0).stop 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- 172.21.15.144:0/3141548030 shutdown_connections 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a8554f0 0x557c4a8667a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a810cc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 --2- 172.21.15.144:0/3141548030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a803820 0x557c4a810780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- 172.21.15.144:0/3141548030 >> 172.21.15.144:0/3141548030 conn(0x557c4a854df0 msgr2=0x557c4a80d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- 172.21.15.144:0/3141548030 shutdown_connections 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- 172.21.15.144:0/3141548030 wait complete. 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- start start 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 Processor -- start 2024-09-12T12:15:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a803820 0x557c4a869630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a884a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a8554f0 0x557c4a884fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557c4a655b40 con 0x557c4a80c430 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557c4a61d940 con 0x557c4a8554f0 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557c4a658e90 con 0x557c4a803820 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 10 client.0 _ll_register_callbacks cb 0x7f51ec002020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a884a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a884a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52980/0 (socket says 172.21.15.144:52980) 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51fbe00640 1 -- 172.21.15.144:0/236405007 learned_addr learned my addr 172.21.15.144:0/236405007 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5200c00640 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a803820 0x557c4a869630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5201600640 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a8554f0 0x557c4a884fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51fbe00640 1 -- 172.21.15.144:0/236405007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a803820 msgr2=0x557c4a869630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51fbe00640 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a803820 0x557c4a869630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51fbe00640 1 -- 172.21.15.144:0/236405007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a8554f0 msgr2=0x557c4a884fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51fbe00640 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a8554f0 0x557c4a884fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51fbe00640 1 -- 172.21.15.144:0/236405007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c4a6b2920 con 0x557c4a80c430 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51fbe00640 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a884a90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f51e8055f30 tx=0x7f51e8006e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d09f1437b7e2bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51e6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51e6000640 1 -- 172.21.15.144:0/236405007 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8081070 con 0x557c4a80c430 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51e6000640 1 -- 172.21.15.144:0/236405007 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f51e80553f0 con 0x557c4a80c430 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- 172.21.15.144:0/236405007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e80743a0 con 0x557c4a80c430 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51e6000640 1 -- 172.21.15.144:0/236405007 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f51e801f070 con 0x557c4a80c430 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 10 client.5460 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:45.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- 172.21.15.144:0/236405007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x557c4a5f2970 con 0x557c4a80c430 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51e6000640 1 -- 172.21.15.144:0/236405007 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e80743a0 con 0x557c4a80c430 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f51e6000640 1 -- 172.21.15.144:0/236405007 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f51e807b070 con 0x557c4a80c430 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 10 client.5460 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 10 client.5460 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 20 client.5460 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557c4a855e10 0x557c4a885510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 4 client.5460 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.715+0000 7f5206aaf000 1 -- 172.21.15.144:0/236405007 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x557c4a6672b0 con 0x557c4a855e10 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5200c00640 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557c4a855e10 0x557c4a885510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5200c00640 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557c4a855e10 0x557c4a885510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e495267e65d35706 server_cookie=6794bcf10dafa328 in_seq=0 out_seq=0 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f51e6000640 10 client.5460 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f51e6000640 1 -- 172.21.15.144:0/236405007 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x557c4a6672b0 con 0x557c4a855e10 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f51e6000640 10 client.5460 handle_command_reply: tid=0 2024-09-12T12:15:45.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 client.5460 shutdown 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 -- 172.21.15.144:0/236405007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 msgr2=0x557c4a884a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a884a90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f51e8055f30 tx=0x7f51e8006e70 comp rx=0 tx=0).stop 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 -- 172.21.15.144:0/236405007 shutdown_connections 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557c4a855e10 0x557c4a885510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4a8554f0 0x557c4a884fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c4a80c430 0x557c4a884a90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 --2- 172.21.15.144:0/236405007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557c4a803820 0x557c4a869630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f51e6000640 0 client.5460 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 -- 172.21.15.144:0/236405007 >> 172.21.15.144:0/236405007 conn(0x557c4a854df0 msgr2=0x557c4a80f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 -- 172.21.15.144:0/236405007 shutdown_connections 2024-09-12T12:15:45.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 1 -- 172.21.15.144:0/236405007 wait complete. 2024-09-12T12:15:45.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.719+0000 7f5206aaf000 20 client.5460 trim_cache size 0 max 16384 2024-09-12T12:15:45.732 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:45.732 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:45.732 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": -2 2024-09-12T12:15:45.732 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:45.733 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T12:15:45.733 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: 2024-09-12T12:15:45.734 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-12T12:15:45.734 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-12T12:15:45.734 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-12T12:15:45.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.867+0000 7fc4bce00640 1 Processor -- start 2024-09-12T12:15:45.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.867+0000 7fc4bce00640 1 -- start start 2024-09-12T12:15:45.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4bce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 0x7fc4b806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4bce00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b80b4300 con 0x7fc4b815af60 2024-09-12T12:15:45.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4bce00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b80b3540 con 0x7fc4b815b340 2024-09-12T12:15:45.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4bce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b80b32f0 con 0x7fc4b80cd9f0 2024-09-12T12:15:45.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4b5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc4b815af60 0x7fc4b80ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37754/0 (socket says 172.21.15.144:37754) 2024-09-12T12:15:45.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4b5e00640 1 -- 172.21.15.144:0/2606285370 learned_addr learned my addr 172.21.15.144:0/2606285370 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:45.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2606285370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 0x7fc4b806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4b4a00640 1 -- 172.21.15.144:0/2606285370 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215294510 0 0) 0x7fc4b80b4300 con 0x7fc4b815af60 2024-09-12T12:15:45.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4b4a00640 1 -- 172.21.15.144:0/2606285370 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc49c005740 con 0x7fc4b815af60 2024-09-12T12:15:45.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4b5400640 1 -- 172.21.15.144:0/2606285370 >> v1:172.21.15.165:6789/0 conn(0x7fc4b815b340 legacy=0x7fc4b80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4b4a00640 1 -- 172.21.15.144:0/2606285370 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659961073 0 0) 0x7fc4b80b3540 con 0x7fc4b815b340 2024-09-12T12:15:45.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4b5400640 1 -- 172.21.15.144:0/2606285370 >> v1:172.21.15.144:6789/0 conn(0x7fc4b815af60 legacy=0x7fc4b80ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.871+0000 7fc4b5400640 1 -- 172.21.15.144:0/2606285370 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b80b3820 con 0x7fc4b80cd9f0 2024-09-12T12:15:45.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2606285370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 0x7fc4b806bc10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40097f0 tx=0x7fc4a401ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b2de5f517f2e010 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4b4a00640 1 -- 172.21.15.144:0/2606285370 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40b5070 con 0x7fc4b80cd9f0 2024-09-12T12:15:45.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4b4a00640 1 -- 172.21.15.144:0/2606285370 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a40a89d0 con 0x7fc4b80cd9f0 2024-09-12T12:15:45.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4b4a00640 1 -- 172.21.15.144:0/2606285370 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40a8d80 con 0x7fc4b80cd9f0 2024-09-12T12:15:45.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4bce00640 1 -- 172.21.15.144:0/2606285370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 msgr2=0x7fc4b806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4bce00640 1 --2- 172.21.15.144:0/2606285370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 0x7fc4b806bc10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40097f0 tx=0x7fc4a401ecd0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4bce00640 1 -- 172.21.15.144:0/2606285370 shutdown_connections 2024-09-12T12:15:45.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4bce00640 1 --2- 172.21.15.144:0/2606285370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 0x7fc4b806bc10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4bce00640 1 -- 172.21.15.144:0/2606285370 >> 172.21.15.144:0/2606285370 conn(0x7fc4b8068030 msgr2=0x7fc4b80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4bce00640 1 -- 172.21.15.144:0/2606285370 shutdown_connections 2024-09-12T12:15:45.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4bce00640 1 -- 172.21.15.144:0/2606285370 wait complete. 2024-09-12T12:15:45.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4bce00640 1 Processor -- start 2024-09-12T12:15:45.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.875+0000 7fc4bce00640 1 -- start start 2024-09-12T12:15:45.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4bce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 0x7fc4b815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4bce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b815af60 0x7fc4b8071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4bce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b815b340 0x7fc4b8071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4bce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b806c150 con 0x7fc4b815af60 2024-09-12T12:15:45.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4bce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80b3de0 con 0x7fc4b815b340 2024-09-12T12:15:45.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4bce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b806c2d0 con 0x7fc4b80cd9f0 2024-09-12T12:15:45.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b815af60 0x7fc4b8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b815af60 0x7fc4b8071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52986/0 (socket says 172.21.15.144:52986) 2024-09-12T12:15:45.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5400640 1 -- 172.21.15.144:0/2619588057 learned_addr learned my addr 172.21.15.144:0/2619588057 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b6800640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b815b340 0x7fc4b8071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 0x7fc4b815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5400640 1 -- 172.21.15.144:0/2619588057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 msgr2=0x7fc4b815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 0x7fc4b815bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5400640 1 -- 172.21.15.144:0/2619588057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b815b340 msgr2=0x7fc4b8071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b815b340 0x7fc4b8071ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5400640 1 -- 172.21.15.144:0/2619588057 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b8072590 con 0x7fc4b815af60 2024-09-12T12:15:45.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b815af60 0x7fc4b8071980 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40b3040 tx=0x7fc4a401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4ae000640 1 -- 172.21.15.144:0/2619588057 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40b5040 con 0x7fc4b815af60 2024-09-12T12:15:45.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4ae000640 1 -- 172.21.15.144:0/2619588057 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a4004140 con 0x7fc4b815af60 2024-09-12T12:15:45.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4ae000640 1 -- 172.21.15.144:0/2619588057 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40044f0 con 0x7fc4b815af60 2024-09-12T12:15:45.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4bce00640 1 -- 172.21.15.144:0/2619588057 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b814cb70 con 0x7fc4b815af60 2024-09-12T12:15:45.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.879+0000 7fc4bce00640 1 -- 172.21.15.144:0/2619588057 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b814d130 con 0x7fc4b815af60 2024-09-12T12:15:45.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4ae000640 1 -- 172.21.15.144:0/2619588057 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4a40c1020 con 0x7fc4b815af60 2024-09-12T12:15:45.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4ae000640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4980678c0 0x7fc498069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4ae000640 1 -- 172.21.15.144:0/2619588057 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc4a4122c50 con 0x7fc4b815af60 2024-09-12T12:15:45.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4980678c0 0x7fc498069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4980678c0 0x7fc498069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8005890 tx=0x7fc4a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4c00f1000 1 Processor -- start 2024-09-12T12:15:45.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4c00f1000 1 -- start start 2024-09-12T12:15:45.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59c4be0 0x5568f5977e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59783a0 0x5568f5978780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5568f57c3b70 con 0x5568f59c42c0 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5568f5769f10 con 0x5568f59c4be0 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5568f57bfb30 con 0x5568f59783a0 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52988/0 (socket says 172.21.15.144:52988) 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 -- 172.21.15.144:0/2345301521 learned_addr learned my addr 172.21.15.144:0/2345301521 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59c4be0 0x5568f5977e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b6800640 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59783a0 0x5568f5978780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 -- 172.21.15.144:0/2345301521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59783a0 msgr2=0x5568f5978780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59783a0 0x5568f5978780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 -- 172.21.15.144:0/2345301521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59c4be0 msgr2=0x5568f5977e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59c4be0 0x5568f5977e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 -- 172.21.15.144:0/2345301521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f5777d60 con 0x5568f59c42c0 2024-09-12T12:15:45.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59c4be0 0x5568f5977e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:45.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59c46a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80058c0 tx=0x7fc4a8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b223ef47e1d7c6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.883+0000 7fc4a2a00640 1 -- 172.21.15.144:0/2345301521 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8005e40 con 0x5568f59c42c0 2024-09-12T12:15:45.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4a2a00640 1 -- 172.21.15.144:0/2345301521 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a800e7b0 con 0x5568f59c42c0 2024-09-12T12:15:45.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4a2a00640 1 -- 172.21.15.144:0/2345301521 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a800eb60 con 0x5568f59c42c0 2024-09-12T12:15:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2345301521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 msgr2=0x5568f59c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59c46a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80058c0 tx=0x7fc4a8011000 comp rx=0 tx=0).stop 2024-09-12T12:15:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2345301521 shutdown_connections 2024-09-12T12:15:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59783a0 0x5568f5978780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59c4be0 0x5568f5977e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2345301521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59c46a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2345301521 >> 172.21.15.144:0/2345301521 conn(0x5568f59a5060 msgr2=0x5568f59a7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2345301521 shutdown_connections 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2345301521 wait complete. 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- start start 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 Processor -- start 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f59cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c4be0 0x5568f59cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5568f57c81a0 con 0x5568f59c42c0 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5568f57814d0 con 0x5568f59783a0 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5568f5748b60 con 0x5568f59c4be0 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 10 client.0 _ll_register_callbacks cb 0x5568f5799ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52990/0 (socket says 172.21.15.144:52990) 2024-09-12T12:15:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f59cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5400640 1 -- 172.21.15.144:0/2427664193 learned_addr learned my addr 172.21.15.144:0/2427664193 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b6800640 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c4be0 0x5568f59cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5400640 1 -- 172.21.15.144:0/2427664193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c4be0 msgr2=0x5568f59cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c4be0 0x5568f59cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5400640 1 -- 172.21.15.144:0/2427664193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 msgr2=0x5568f59cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f59cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5400640 1 -- 172.21.15.144:0/2427664193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f5786ce0 con 0x5568f59c42c0 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59cb980 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4121080 tx=0x7fc4a40f36d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8509502438ec899 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc497400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc497400640 1 -- 172.21.15.144:0/2427664193 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a410c070 con 0x5568f59c42c0 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc497400640 1 -- 172.21.15.144:0/2427664193 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc4a40fb860 con 0x5568f59c42c0 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.887+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2427664193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4a800e7b0 con 0x5568f59c42c0 2024-09-12T12:15:45.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc497400640 1 -- 172.21.15.144:0/2427664193 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc4a40fbaf0 con 0x5568f59c42c0 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 10 client.5472 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2427664193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5568f576a160 con 0x5568f59c42c0 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc497400640 1 -- 172.21.15.144:0/2427664193 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a800e7b0 con 0x5568f59c42c0 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc497400640 1 -- 172.21.15.144:0/2427664193 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc4a40b8050 con 0x5568f59c42c0 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 10 client.5472 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 10 client.5472 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 20 client.5472 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5568f59d3810 0x5568f59d5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 4 client.5472 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2427664193 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568f575dcc0 con 0x5568f59d3810 2024-09-12T12:15:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5568f59d3810 0x5568f59d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc497400640 10 client.5472 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:45.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5568f59d3810 0x5568f59d5c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abbdd657c9917925 server_cookie=ec5c749d2269d0f7 in_seq=0 out_seq=0 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc497400640 1 -- 172.21.15.144:0/2427664193 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568f575dcc0 con 0x5568f59d3810 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc497400640 10 client.5472 handle_command_reply: tid=0 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 client.5472 shutdown 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2427664193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 msgr2=0x5568f59cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59cb980 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4121080 tx=0x7fc4a40f36d0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2427664193 shutdown_connections 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5568f59d3810 0x5568f59d5c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c4be0 0x5568f59cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c42c0 0x5568f59cb980 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc497400640 0 client.5472 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2427664193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f59cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2427664193 >> 172.21.15.144:0/2427664193 conn(0x5568f59a5060 msgr2=0x5568f59a7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2427664193 shutdown_connections 2024-09-12T12:15:45.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2427664193 wait complete. 2024-09-12T12:15:45.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.891+0000 7fc4c00f1000 20 client.5472 trim_cache size 0 max 16384 2024-09-12T12:15:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.907+0000 7fc4c00f1000 1 Processor -- start 2024-09-12T12:15:45.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- start start 2024-09-12T12:15:45.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f5a342f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 0x5568f5a34830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a34d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b81fca60 con 0x5568f59c4be0 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b81fbaf0 con 0x5568f59783a0 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b814e230 con 0x5568f59c42c0 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a34d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a34d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53006/0 (socket says 172.21.15.144:53006) 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b6800640 1 -- 172.21.15.144:0/2575860249 learned_addr learned my addr 172.21.15.144:0/2575860249 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/2575860249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f5a342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b5400640 1 --2- 172.21.15.144:0/2575860249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 0x5568f5a34830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b6800640 1 -- 172.21.15.144:0/2575860249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 msgr2=0x5568f5a34830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b6800640 1 --2- 172.21.15.144:0/2575860249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 0x5568f5a34830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b6800640 1 -- 172.21.15.144:0/2575860249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 msgr2=0x5568f5a342f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b6800640 1 --2- 172.21.15.144:0/2575860249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f5a342f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b6800640 1 -- 172.21.15.144:0/2575860249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f5763510 con 0x5568f59c4be0 2024-09-12T12:15:45.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4b6800640 1 --2- 172.21.15.144:0/2575860249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a34d70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0005180 tx=0x7fc4b0005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579f43205364695f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4a2000640 1 -- 172.21.15.144:0/2575860249 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b001a030 con 0x5568f59c4be0 2024-09-12T12:15:45.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4a2000640 1 -- 172.21.15.144:0/2575860249 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b0012740 con 0x5568f59c4be0 2024-09-12T12:15:45.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4a2000640 1 -- 172.21.15.144:0/2575860249 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0012910 con 0x5568f59c4be0 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2575860249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 msgr2=0x5568f5a34d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2575860249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a34d70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0005180 tx=0x7fc4b0005640 comp rx=0 tx=0).stop 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2575860249 shutdown_connections 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2575860249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a34d70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2575860249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 0x5568f5a34830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/2575860249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f5a342f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2575860249 >> 172.21.15.144:0/2575860249 conn(0x5568f59a5060 msgr2=0x5568f59d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2575860249 shutdown_connections 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- 172.21.15.144:0/2575860249 wait complete. 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 -- start start 2024-09-12T12:15:45.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.911+0000 7fc4c00f1000 1 Processor -- start 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f5a37e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 0x5568f5a38390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a388d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5568f57c2e80 con 0x5568f59c4be0 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b81fb4a0 con 0x5568f59783a0 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5568f57c81a0 con 0x5568f59c42c0 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 10 client.0 _ll_register_callbacks cb 0x7fc4a40f2ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a388d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53016/0 (socket says 172.21.15.144:53016) 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b6800640 1 -- 172.21.15.144:0/4207162525 learned_addr learned my addr 172.21.15.144:0/4207162525 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b5400640 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 0x5568f5a38390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f5a37e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b6800640 1 -- 172.21.15.144:0/4207162525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 msgr2=0x5568f5a38390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b6800640 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 0x5568f5a38390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b6800640 1 -- 172.21.15.144:0/4207162525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 msgr2=0x5568f5a37e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b6800640 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f5a37e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b6800640 1 -- 172.21.15.144:0/4207162525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f581dad0 con 0x5568f59c4be0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b6800640 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a388d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0019040 tx=0x7fc4b0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f965bdd5279ab0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 1 -- 172.21.15.144:0/4207162525 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0016680 con 0x5568f59c4be0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 1 -- 172.21.15.144:0/4207162525 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc4b002bc50 con 0x5568f59c4be0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- 172.21.15.144:0/4207162525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4b0012740 con 0x5568f59c4be0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 1 -- 172.21.15.144:0/4207162525 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc4b002be50 con 0x5568f59c4be0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 10 client.5478 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- 172.21.15.144:0/4207162525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5568f5751af0 con 0x5568f59c4be0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 1 -- 172.21.15.144:0/4207162525 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b0012740 con 0x5568f59c4be0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 1 -- 172.21.15.144:0/4207162525 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc4b0016820 con 0x5568f59c4be0 2024-09-12T12:15:45.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 10 client.5478 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:45.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 10 client.5478 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:45.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 20 client.5478 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:45.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5568f59f46a0 0x5568f59f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 4 client.5478 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-12T12:15:45.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- 172.21.15.144:0/4207162525 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x5568f57d12a0 con 0x5568f59f46a0 2024-09-12T12:15:45.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5568f59f46a0 0x5568f59f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 10 client.5478 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:45.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4b5e00640 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5568f59f46a0 0x5568f59f4ab0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=378e3c45d7f5fa85 server_cookie=595ad03a4ccf82aa in_seq=0 out_seq=0 2024-09-12T12:15:45.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 1 -- 172.21.15.144:0/4207162525 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x5568f57d12a0 con 0x5568f59f46a0 2024-09-12T12:15:45.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 10 client.5478 handle_command_reply: tid=0 2024-09-12T12:15:45.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 client.5478 shutdown 2024-09-12T12:15:45.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- 172.21.15.144:0/4207162525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 msgr2=0x5568f5a388d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a388d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0019040 tx=0x7fc4b0001260 comp rx=0 tx=0).stop 2024-09-12T12:15:45.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- 172.21.15.144:0/4207162525 shutdown_connections 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5568f59f46a0 0x5568f59f4ab0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568f59c4be0 0x5568f5a388d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5568f59c42c0 0x5568f5a38390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 --2- 172.21.15.144:0/4207162525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5568f59783a0 0x5568f5a37e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- 172.21.15.144:0/4207162525 >> 172.21.15.144:0/4207162525 conn(0x5568f59a5060 msgr2=0x5568f59c2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc497400640 0 client.5478 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- 172.21.15.144:0/4207162525 shutdown_connections 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 1 -- 172.21.15.144:0/4207162525 wait complete. 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.915+0000 7fc4c00f1000 20 client.5478 trim_cache size 0 max 16384 2024-09-12T12:15:45.923 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:45.924 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": -2 2024-09-12T12:15:45.924 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:45.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 -- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4980678c0 msgr2=0x7fc498069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4980678c0 0x7fc498069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8005890 tx=0x7fc4a8009040 comp rx=0 tx=0).stop 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 -- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b815af60 msgr2=0x7fc4b8071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b815af60 0x7fc4b8071980 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40b3040 tx=0x7fc4a401ba70 comp rx=0 tx=0).stop 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 -- 172.21.15.144:0/2619588057 shutdown_connections 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4980678c0 0x7fc498069d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b815b340 0x7fc4b8071ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b815af60 0x7fc4b8071980 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 --2- 172.21.15.144:0/2619588057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b80cd9f0 0x7fc4b815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 -- 172.21.15.144:0/2619588057 >> 172.21.15.144:0/2619588057 conn(0x7fc4b8068030 msgr2=0x7fc4b80b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 -- 172.21.15.144:0/2619588057 shutdown_connections 2024-09-12T12:15:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:45.919+0000 7fc4bce00640 1 -- 172.21.15.144:0/2619588057 wait complete. 2024-09-12T12:15:45.939 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-12T12:15:45.939 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-09-12T12:15:45.939 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-09-12T12:15:45.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-09-12T12:15:46.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f217a600640 1 Processor -- start 2024-09-12T12:15:46.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f217a600640 1 -- start start 2024-09-12T12:15:46.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f217a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21740af5f0 0x7f217406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f217a600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f217406c150 0x7f21740cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f217a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21740733e0 con 0x7f217415c2e0 2024-09-12T12:15:46.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f217a600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f217406c5c0 con 0x7f217406c150 2024-09-12T12:15:46.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f217a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21740cd290 con 0x7f21740af5f0 2024-09-12T12:15:46.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2173400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f217415c2e0 0x7f2174072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37764/0 (socket says 172.21.15.144:37764) 2024-09-12T12:15:46.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2173400640 1 -- 172.21.15.144:0/2398249686 learned_addr learned my addr 172.21.15.144:0/2398249686 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:46.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2173e00640 1 --2- 172.21.15.144:0/2398249686 >> v2:172.21.15.165:3300/0 conn(0x7f217406c150 0x7f21740cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2172a00640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21740af5f0 0x7f217406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869615077 0 0) 0x7f21740733e0 con 0x7f217415c2e0 2024-09-12T12:15:46.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2158003530 con 0x7f217415c2e0 2024-09-12T12:15:46.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 945266406 0 0) 0x7f2158003530 con 0x7f217415c2e0 2024-09-12T12:15:46.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21740af5f0 msgr2=0x7f217406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2172000640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21740af5f0 0x7f217406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 >> v2:172.21.15.165:3300/0 conn(0x7f217406c150 msgr2=0x7f21740cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2172000640 1 --2- 172.21.15.144:0/2398249686 >> v2:172.21.15.165:3300/0 conn(0x7f217406c150 0x7f21740cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.079+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21740cd570 con 0x7f217415c2e0 2024-09-12T12:15:46.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f2164001a00 con 0x7f217415c2e0 2024-09-12T12:15:46.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 >> v1:172.21.15.144:6789/0 conn(0x7f217415c2e0 legacy=0x7f2174072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21580039c0 0x7f2158003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21740af5f0 0x7f2158004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2158004d50 0x7f21580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f217406c5c0 con 0x7f2158004d50 2024-09-12T12:15:46.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21740cd290 con 0x7f21580039c0 2024-09-12T12:15:46.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f215800ba80 con 0x7f21740af5f0 2024-09-12T12:15:46.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2173e00640 1 --2- 172.21.15.144:0/2398249686 >> v2:172.21.15.165:3300/0 conn(0x7f217406c150 0x7f21740cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:46.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2173e00640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2158004d50 0x7f21580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172a00640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21740af5f0 0x7f2158004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2173400640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21580039c0 0x7f2158003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2173e00640 1 -- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21740af5f0 msgr2=0x7f2158004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2173e00640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21740af5f0 0x7f2158004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2173e00640 1 -- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21580039c0 msgr2=0x7f2158003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2173e00640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21580039c0 0x7f2158003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2173e00640 1 -- 172.21.15.144:0/2398249686 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2158003530 con 0x7f2158004d50 2024-09-12T12:15:46.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2173e00640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2158004d50 0x7f21580051d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f216c009c90 tx=0x7f216c01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c9a37c02f51551 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c009860 con 0x7f2158004d50 2024-09-12T12:15:46.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f216c004020 con 0x7f2158004d50 2024-09-12T12:15:46.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.083+0000 7f2172000640 1 -- 172.21.15.144:0/2398249686 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c004410 con 0x7f2158004d50 2024-09-12T12:15:46.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 -- 172.21.15.144:0/2398249686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2158004d50 msgr2=0x7f21580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 --2- 172.21.15.144:0/2398249686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2158004d50 0x7f21580051d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f216c009c90 tx=0x7f216c01cc70 comp rx=0 tx=0).stop 2024-09-12T12:15:46.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173e00640 1 -- 172.21.15.144:0/2398249686 reap_dead start 2024-09-12T12:15:46.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 -- 172.21.15.144:0/2398249686 shutdown_connections 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 -- 172.21.15.144:0/2398249686 >> 172.21.15.144:0/2398249686 conn(0x7f2174068030 msgr2=0x7f21740b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 -- 172.21.15.144:0/2398249686 shutdown_connections 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 -- 172.21.15.144:0/2398249686 wait complete. 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 Processor -- start 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 -- start start 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f217414e970 0x7f2174154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f217414ed50 0x7f2174158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f217414f1d0 0x7f21741591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21740cee90 con 0x7f217414e970 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21740ced10 con 0x7f217414f1d0 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f217a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21740cf010 con 0x7f217414ed50 2024-09-12T12:15:46.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f217414e970 0x7f2174154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f217414e970 0x7f2174154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53036/0 (socket says 172.21.15.144:53036) 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173400640 1 -- 172.21.15.144:0/2968914880 learned_addr learned my addr 172.21.15.144:0/2968914880 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173e00640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f217414f1d0 0x7f21741591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2172a00640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f217414ed50 0x7f2174158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173400640 1 -- 172.21.15.144:0/2968914880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f217414ed50 msgr2=0x7f2174158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173400640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f217414ed50 0x7f2174158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173400640 1 -- 172.21.15.144:0/2968914880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f217414f1d0 msgr2=0x7f21741591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173400640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f217414f1d0 0x7f21741591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.087+0000 7f2173400640 1 -- 172.21.15.144:0/2968914880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21741552c0 con 0x7f217414e970 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f2173400640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f217414e970 0x7f2174154d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2164004bd0 tx=0x7f2164007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f216b400640 1 -- 172.21.15.144:0/2968914880 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216400acd0 con 0x7f217414e970 2024-09-12T12:15:46.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f216b400640 1 -- 172.21.15.144:0/2968914880 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2164018070 con 0x7f217414e970 2024-09-12T12:15:46.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f216b400640 1 -- 172.21.15.144:0/2968914880 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164013630 con 0x7f217414e970 2024-09-12T12:15:46.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f217a600640 1 -- 172.21.15.144:0/2968914880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2174155560 con 0x7f217414e970 2024-09-12T12:15:46.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f217a600640 1 -- 172.21.15.144:0/2968914880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2174160140 con 0x7f217414e970 2024-09-12T12:15:46.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f216b400640 1 -- 172.21.15.144:0/2968914880 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21640137d0 con 0x7f217414e970 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f216b400640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21540678c0 0x7f2154069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f216b400640 1 -- 172.21.15.144:0/2968914880 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2164086530 con 0x7f217414e970 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f2172a00640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21540678c0 0x7f2154069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.091+0000 7f217dae7000 1 Processor -- start 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- start start 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2172a00640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21540678c0 0x7f2154069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2160009be0 tx=0x7f2160009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f102816470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f1027ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1027cd150 0x55f1027cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f1026b2f20 con 0x55f102816090 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f10261ab70 con 0x55f1027cd150 2024-09-12T12:15:46.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f1025c0a80 con 0x55f1028169b0 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2173400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f102816470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2173400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f102816470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53044/0 (socket says 172.21.15.144:53044) 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2173400640 1 -- 172.21.15.144:0/3934318602 learned_addr learned my addr 172.21.15.144:0/3934318602 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2173400640 1 -- 172.21.15.144:0/3934318602 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 msgr2=0x55f1027ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2173400640 1 --2- 172.21.15.144:0/3934318602 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f1027ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2173400640 1 -- 172.21.15.144:0/3934318602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1027cd150 msgr2=0x55f1027cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2173400640 1 --2- 172.21.15.144:0/3934318602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1027cd150 0x55f1027cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2173400640 1 -- 172.21.15.144:0/3934318602 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1026237e0 con 0x55f102816090 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f2173400640 1 --2- 172.21.15.144:0/3934318602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f102816470 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2164056440 tx=0x7f216405d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7980a0807151eb85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f215fe00640 1 -- 172.21.15.144:0/3934318602 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216405aaf0 con 0x55f102816090 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f215fe00640 1 -- 172.21.15.144:0/3934318602 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f216405f320 con 0x55f102816090 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f215fe00640 1 -- 172.21.15.144:0/3934318602 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164052db0 con 0x55f102816090 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- 172.21.15.144:0/3934318602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 msgr2=0x55f102816470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 --2- 172.21.15.144:0/3934318602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f102816470 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2164056440 tx=0x7f216405d050 comp rx=0 tx=0).stop 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- 172.21.15.144:0/3934318602 shutdown_connections 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 --2- 172.21.15.144:0/3934318602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1027cd150 0x55f1027cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 --2- 172.21.15.144:0/3934318602 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f1027ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 --2- 172.21.15.144:0/3934318602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f102816470 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- 172.21.15.144:0/3934318602 >> 172.21.15.144:0/3934318602 conn(0x55f1027c90d0 msgr2=0x55f1027cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- 172.21.15.144:0/3934318602 shutdown_connections 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- 172.21.15.144:0/3934318602 wait complete. 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 -- start start 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.095+0000 7f217dae7000 1 Processor -- start 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f10281cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f102816090 0x55f10281d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1028169b0 0x55f10281d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f1025b4be0 con 0x55f1027cd150 2024-09-12T12:15:46.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f102616b30 con 0x55f1028169b0 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f10265a740 con 0x55f102816090 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 10 client.0 _ll_register_callbacks cb 0x55f1026cda50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f10281cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f10281cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53050/0 (socket says 172.21.15.144:53050) 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173400640 1 -- 172.21.15.144:0/3372546103 learned_addr learned my addr 172.21.15.144:0/3372546103 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173e00640 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1028169b0 0x55f10281d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2172a00640 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f102816090 0x55f10281d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173400640 1 -- 172.21.15.144:0/3372546103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f102816090 msgr2=0x55f10281d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173400640 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f102816090 0x55f10281d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173400640 1 -- 172.21.15.144:0/3372546103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1028169b0 msgr2=0x55f10281d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173400640 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1028169b0 0x55f10281d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173400640 1 -- 172.21.15.144:0/3372546103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1025c0cd0 con 0x55f1027cd150 2024-09-12T12:15:46.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2172a00640 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f102816090 0x55f10281d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:46.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2173400640 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f10281cdf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2164052ba0 tx=0x7f2164007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ceeb26a424ddaae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 1 -- 172.21.15.144:0/3372546103 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21640843d0 con 0x55f1027cd150 2024-09-12T12:15:46.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 1 -- 172.21.15.144:0/3372546103 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f216406abd0 con 0x55f1027cd150 2024-09-12T12:15:46.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 -- 172.21.15.144:0/3372546103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f216405f320 con 0x55f1027cd150 2024-09-12T12:15:46.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 1 -- 172.21.15.144:0/3372546103 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f216406add0 con 0x55f1027cd150 2024-09-12T12:15:46.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 10 client.5490 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 -- 172.21.15.144:0/3372546103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f1025bab90 con 0x55f1027cd150 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 1 -- 172.21.15.144:0/3372546103 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f216405f320 con 0x55f1027cd150 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 1 -- 172.21.15.144:0/3372546103 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f2164086070 con 0x55f1027cd150 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 10 client.5490 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 10 client.5490 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 20 client.5490 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f1028251c0 0x55f1028275b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 4 client.5490 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 -- 172.21.15.144:0/3372546103 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1025b51b0 con 0x55f1028251c0 2024-09-12T12:15:46.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2172a00640 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f1028251c0 0x55f1028275b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f2172a00640 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f1028251c0 0x55f1028275b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84a3930c8b8a3ab6 server_cookie=50a6fdf2c43a1a92 in_seq=0 out_seq=0 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 10 client.5490 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 1 -- 172.21.15.144:0/3372546103 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1025b51b0 con 0x55f1028251c0 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 10 client.5490 handle_command_reply: tid=0 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 client.5490 shutdown 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 -- 172.21.15.144:0/3372546103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 msgr2=0x55f10281cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f10281cdf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2164052ba0 tx=0x7f2164007c10 comp rx=0 tx=0).stop 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 -- 172.21.15.144:0/3372546103 shutdown_connections 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f1028251c0 0x55f1028275b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1028169b0 0x55f10281d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f102816090 0x55f10281d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 --2- 172.21.15.144:0/3372546103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f10281cdf0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f217dae7000 1 -- 172.21.15.144:0/3372546103 >> 172.21.15.144:0/3372546103 conn(0x55f1027c90d0 msgr2=0x55f1027cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.099+0000 7f215cc00640 0 client.5490 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.103+0000 7f217dae7000 1 -- 172.21.15.144:0/3372546103 shutdown_connections 2024-09-12T12:15:46.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.103+0000 7f217dae7000 1 -- 172.21.15.144:0/3372546103 wait complete. 2024-09-12T12:15:46.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.103+0000 7f217dae7000 20 client.5490 trim_cache size 0 max 16384 2024-09-12T12:15:46.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.115+0000 7f217dae7000 1 Processor -- start 2024-09-12T12:15:46.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.115+0000 7f217dae7000 1 -- start start 2024-09-12T12:15:46.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.115+0000 7f217dae7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1027cd150 0x55f102823260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.115+0000 7f217dae7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f1028154d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.115+0000 7f217dae7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102815a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.115+0000 7f217dae7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2174204de0 con 0x55f102816090 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.115+0000 7f217dae7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2174203e40 con 0x55f1027cd150 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.115+0000 7f217dae7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21742031a0 con 0x55f1028169b0 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2172a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f1028154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2172a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f1028154d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53062/0 (socket says 172.21.15.144:53062) 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2172a00640 1 -- 172.21.15.144:0/3094177954 learned_addr learned my addr 172.21.15.144:0/3094177954 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2173400640 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1027cd150 0x55f102823260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2173e00640 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102815a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2172a00640 1 -- 172.21.15.144:0/3094177954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 msgr2=0x55f102815a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2172a00640 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102815a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2172a00640 1 -- 172.21.15.144:0/3094177954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1027cd150 msgr2=0x55f102823260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2172a00640 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1027cd150 0x55f102823260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2172a00640 1 -- 172.21.15.144:0/3094177954 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1025d8be0 con 0x55f102816090 2024-09-12T12:15:46.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2173e00640 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102815a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:46.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2172a00640 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f1028154d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2160004300 tx=0x7f2160017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d2b7a81ae7c856 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f215f400640 1 -- 172.21.15.144:0/3094177954 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160032070 con 0x55f102816090 2024-09-12T12:15:46.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f215f400640 1 -- 172.21.15.144:0/3094177954 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2160004330 con 0x55f102816090 2024-09-12T12:15:46.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f215f400640 1 -- 172.21.15.144:0/3094177954 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216001b070 con 0x55f102816090 2024-09-12T12:15:46.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 -- 172.21.15.144:0/3094177954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 msgr2=0x55f1028154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f1028154d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2160004300 tx=0x7f2160017000 comp rx=0 tx=0).stop 2024-09-12T12:15:46.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 -- 172.21.15.144:0/3094177954 shutdown_connections 2024-09-12T12:15:46.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102815a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f102816090 0x55f1028154d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 --2- 172.21.15.144:0/3094177954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f1027cd150 0x55f102823260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 -- 172.21.15.144:0/3094177954 >> 172.21.15.144:0/3094177954 conn(0x55f1027c90d0 msgr2=0x55f102814dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 -- 172.21.15.144:0/3094177954 shutdown_connections 2024-09-12T12:15:46.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 -- 172.21.15.144:0/3094177954 wait complete. 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 -- start start 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 Processor -- start 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f1028227f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f102816090 0x55f1028458a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102845de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f1026ea940 con 0x55f1027cd150 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21742037f0 con 0x55f102816090 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f10265a740 con 0x55f1028169b0 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f217dae7000 10 client.0 _ll_register_callbacks cb 0x7f2164056330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2173400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f1028227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2173400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f1028227f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53076/0 (socket says 172.21.15.144:53076) 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.119+0000 7f2173400640 1 -- 172.21.15.144:0/606587229 learned_addr learned my addr 172.21.15.144:0/606587229 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2173e00640 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102845de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2172a00640 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f102816090 0x55f1028458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2173400640 1 -- 172.21.15.144:0/606587229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 msgr2=0x55f102845de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2173400640 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102845de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2173400640 1 -- 172.21.15.144:0/606587229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f102816090 msgr2=0x55f1028458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2173400640 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f102816090 0x55f1028458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2173400640 1 -- 172.21.15.144:0/606587229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1026970f0 con 0x55f1027cd150 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2173e00640 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102845de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2173400640 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f1028227f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2164001d00 tx=0x7f2164052a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76bc9ce8d6fba1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f215cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f215cc00640 1 -- 172.21.15.144:0/606587229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21640843d0 con 0x55f1027cd150 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f215cc00640 1 -- 172.21.15.144:0/606587229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2164060db0 con 0x55f1027cd150 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f217dae7000 1 -- 172.21.15.144:0/606587229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2160004330 con 0x55f1027cd150 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f215cc00640 1 -- 172.21.15.144:0/606587229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f216405f320 con 0x55f1027cd150 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f217dae7000 10 client.5496 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f217dae7000 1 -- 172.21.15.144:0/606587229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55f1025b2ca0 con 0x55f1027cd150 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f215cc00640 1 -- 172.21.15.144:0/606587229 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2160004330 con 0x55f1027cd150 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f215cc00640 1 -- 172.21.15.144:0/606587229 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f2164013ac0 con 0x55f1027cd150 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f217dae7000 10 client.5496 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f217dae7000 10 client.5496 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f217dae7000 20 client.5496 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f217dae7000 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f102846320 0x55f102888ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f217dae7000 4 client.5496 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-12T12:15:46.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f217dae7000 1 -- 172.21.15.144:0/606587229 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55f1026282a0 con 0x55f102846320 2024-09-12T12:15:46.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2172a00640 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f102846320 0x55f102888ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f2172a00640 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f102846320 0x55f102888ee0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=168c6e95e12f1224 server_cookie=f741dac5ac005eff in_seq=0 out_seq=0 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.123+0000 7f215cc00640 10 client.5496 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f215cc00640 1 -- 172.21.15.144:0/606587229 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1026282a0 con 0x55f102846320 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f215cc00640 10 client.5496 handle_command_reply: tid=0 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 client.5496 shutdown 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 -- 172.21.15.144:0/606587229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 msgr2=0x55f1028227f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f1028227f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2164001d00 tx=0x7f2164052a60 comp rx=0 tx=0).stop 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 -- 172.21.15.144:0/606587229 shutdown_connections 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f102846320 0x55f102888ee0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f1028169b0 0x55f102845de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f102816090 0x55f1028458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 --2- 172.21.15.144:0/606587229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1027cd150 0x55f1028227f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f215cc00640 0 client.5496 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 -- 172.21.15.144:0/606587229 >> 172.21.15.144:0/606587229 conn(0x55f1027c90d0 msgr2=0x55f1028155e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 -- 172.21.15.144:0/606587229 shutdown_connections 2024-09-12T12:15:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 1 -- 172.21.15.144:0/606587229 wait complete. 2024-09-12T12:15:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217dae7000 20 client.5496 trim_cache size 0 max 16384 2024-09-12T12:15:46.131 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:46.131 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:46.131 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:15:46.131 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 -- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21540678c0 msgr2=0x7f2154069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21540678c0 0x7f2154069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2160009be0 tx=0x7f2160009190 comp rx=0 tx=0).stop 2024-09-12T12:15:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 -- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f217414e970 msgr2=0x7f2174154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f217414e970 0x7f2174154d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2164004bd0 tx=0x7f2164007ba0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 -- 172.21.15.144:0/2968914880 shutdown_connections 2024-09-12T12:15:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21540678c0 0x7f2154069d80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f217414f1d0 0x7f21741591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f217414ed50 0x7f2174158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 --2- 172.21.15.144:0/2968914880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f217414e970 0x7f2174154d80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 -- 172.21.15.144:0/2968914880 >> 172.21.15.144:0/2968914880 conn(0x7f2174068030 msgr2=0x7f2174073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 -- 172.21.15.144:0/2968914880 shutdown_connections 2024-09-12T12:15:46.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.127+0000 7f217a600640 1 -- 172.21.15.144:0/2968914880 wait complete. 2024-09-12T12:15:46.149 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-09-12T12:15:46.149 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-12T12:15:46.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-12T12:15:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9cb400640 1 Processor -- start 2024-09-12T12:15:46.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9cb400640 1 -- start start 2024-09-12T12:15:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9cb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c40af5f0 0x7fa9c406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9cb400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa9c406c150 0x7fa9c40cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9cb400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c40733e0 con 0x7fa9c415c2e0 2024-09-12T12:15:46.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9cb400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c406c5c0 con 0x7fa9c406c150 2024-09-12T12:15:46.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9cb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c40cd290 con 0x7fa9c40af5f0 2024-09-12T12:15:46.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c8a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa9c415c2e0 0x7fa9c4072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37766/0 (socket says 172.21.15.144:37766) 2024-09-12T12:15:46.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c8a00640 1 -- 172.21.15.144:0/2566978003 learned_addr learned my addr 172.21.15.144:0/2566978003 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:46.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10985902 0 0) 0x7fa9c40733e0 con 0x7fa9c415c2e0 2024-09-12T12:15:46.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c40af5f0 0x7fa9c406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c9400640 1 --2- 172.21.15.144:0/2566978003 >> v2:172.21.15.165:3300/0 conn(0x7fa9c406c150 0x7fa9c40cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9a8003530 con 0x7fa9c415c2e0 2024-09-12T12:15:46.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3103098445 0 0) 0x7fa9a8003530 con 0x7fa9c415c2e0 2024-09-12T12:15:46.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c40af5f0 msgr2=0x7fa9c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c40af5f0 0x7fa9c406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 >> v2:172.21.15.165:3300/0 conn(0x7fa9c406c150 msgr2=0x7fa9c40cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 --2- 172.21.15.144:0/2566978003 >> v2:172.21.15.165:3300/0 conn(0x7fa9c406c150 0x7fa9c40cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c40cd570 con 0x7fa9c415c2e0 2024-09-12T12:15:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fa9b4001a00 con 0x7fa9c415c2e0 2024-09-12T12:15:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 >> v1:172.21.15.144:6789/0 conn(0x7fa9c415c2e0 legacy=0x7fa9c4072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9a80039c0 0x7fa9a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c40af5f0 0x7fa9a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a8004d50 0x7fa9a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c406c5c0 con 0x7fa9a8004d50 2024-09-12T12:15:46.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c40cd290 con 0x7fa9a80039c0 2024-09-12T12:15:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a800bad0 con 0x7fa9c40af5f0 2024-09-12T12:15:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c9400640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a8004d50 0x7fa9a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9a80039c0 0x7fa9a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c40af5f0 0x7fa9a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c9400640 1 -- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c40af5f0 msgr2=0x7fa9a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c9400640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c40af5f0 0x7fa9a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c9400640 1 -- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9a80039c0 msgr2=0x7fa9a8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c9400640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9a80039c0 0x7fa9a8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.287+0000 7fa9c9400640 1 -- 172.21.15.144:0/2566978003 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a8003530 con 0x7fa9a8004d50 2024-09-12T12:15:46.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9c9400640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a8004d50 0x7fa9a80051d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009ae0 tx=0x7fa9bc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81810d4879464f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0096b0 con 0x7fa9a8004d50 2024-09-12T12:15:46.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9bc0a6490 con 0x7fa9a8004d50 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9c3400640 1 -- 172.21.15.144:0/2566978003 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0a6880 con 0x7fa9a8004d50 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9cb400640 1 -- 172.21.15.144:0/2566978003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a8004d50 msgr2=0x7fa9a80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9cb400640 1 --2- 172.21.15.144:0/2566978003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a8004d50 0x7fa9a80051d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc009ae0 tx=0x7fa9bc01cab0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9c9400640 1 -- 172.21.15.144:0/2566978003 reap_dead start 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9cb400640 1 -- 172.21.15.144:0/2566978003 shutdown_connections 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9cb400640 1 -- 172.21.15.144:0/2566978003 >> 172.21.15.144:0/2566978003 conn(0x7fa9c4068030 msgr2=0x7fa9c40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9cb400640 1 -- 172.21.15.144:0/2566978003 shutdown_connections 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.291+0000 7fa9cb400640 1 -- 172.21.15.144:0/2566978003 wait complete. 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 Processor -- start 2024-09-12T12:15:46.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 -- start start 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c4158a80 0x7fa9c415e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9c4158e60 0x7fa9c415ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9c4157040 0x7fa9c41574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c40cee90 con 0x7fa9c4158e60 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c40ced10 con 0x7fa9c4157040 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c40cf010 con 0x7fa9c4158a80 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9c4158e60 0x7fa9c415ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9c4158e60 0x7fa9c415ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53094/0 (socket says 172.21.15.144:53094) 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c3e00640 1 -- 172.21.15.144:0/4251019891 learned_addr learned my addr 172.21.15.144:0/4251019891 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c4158a80 0x7fa9c415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c9400640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9c4157040 0x7fa9c41574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c3e00640 1 -- 172.21.15.144:0/4251019891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c4158a80 msgr2=0x7fa9c415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c4158a80 0x7fa9c415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c3e00640 1 -- 172.21.15.144:0/4251019891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9c4157040 msgr2=0x7fa9c41574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9c4157040 0x7fa9c41574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c3e00640 1 -- 172.21.15.144:0/4251019891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c415f3a0 con 0x7fa9c4158e60 2024-09-12T12:15:46.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9c4158e60 0x7fa9c415ee60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00119d0 tx=0x7fa9b0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c0c00640 1 -- 172.21.15.144:0/4251019891 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000fb50 con 0x7fa9c4158e60 2024-09-12T12:15:46.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c0c00640 1 -- 172.21.15.144:0/4251019891 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b000fcf0 con 0x7fa9c4158e60 2024-09-12T12:15:46.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 -- 172.21.15.144:0/4251019891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c415d4f0 con 0x7fa9c4158e60 2024-09-12T12:15:46.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9c0c00640 1 -- 172.21.15.144:0/4251019891 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000fea0 con 0x7fa9c4158e60 2024-09-12T12:15:46.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.295+0000 7fa9cb400640 1 -- 172.21.15.144:0/4251019891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c415dab0 con 0x7fa9c4158e60 2024-09-12T12:15:46.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c0c00640 1 -- 172.21.15.144:0/4251019891 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa9b0012040 con 0x7fa9c4158e60 2024-09-12T12:15:46.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c0c00640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9a40678f0 0x7fa9a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c0c00640 1 -- 172.21.15.144:0/4251019891 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fa9b0086360 con 0x7fa9c4158e60 2024-09-12T12:15:46.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9a40678f0 0x7fa9a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9ce787000 1 Processor -- start 2024-09-12T12:15:46.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9ce787000 1 -- start start 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9a40678f0 0x7fa9a4069db0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4004bd0 tx=0x7fa9b4006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1560 0x55e5afbc1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 0x55e5afb779e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afb78300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9ce787000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e5afa5b200 con 0x55e5afbc1560 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9ce787000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e5af95e620 con 0x55e5afbc1e80 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9ce787000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55e5af9c0b80 con 0x55e5afb77f20 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1560 0x55e5afbc1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1560 0x55e5afbc1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53100/0 (socket says 172.21.15.144:53100) 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c8a00640 1 -- 172.21.15.144:0/379562322 learned_addr learned my addr 172.21.15.144:0/379562322 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c9400640 1 --2- 172.21.15.144:0/379562322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afb78300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.299+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/379562322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 0x55e5afb779e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c8a00640 1 -- 172.21.15.144:0/379562322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 msgr2=0x55e5afb78300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/379562322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afb78300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c8a00640 1 -- 172.21.15.144:0/379562322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 msgr2=0x55e5afb779e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/379562322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 0x55e5afb779e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c8a00640 1 -- 172.21.15.144:0/379562322 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5af99d470 con 0x55e5afbc1560 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/379562322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1560 0x55e5afbc1940 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40155d0 tx=0x7fa9b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0bb803a68eb088 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9b9600640 1 -- 172.21.15.144:0/379562322 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4019070 con 0x55e5afbc1560 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9b9600640 1 -- 172.21.15.144:0/379562322 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4026070 con 0x55e5afbc1560 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9b9600640 1 -- 172.21.15.144:0/379562322 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4021610 con 0x55e5afbc1560 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 -- 172.21.15.144:0/379562322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1560 msgr2=0x55e5afbc1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 --2- 172.21.15.144:0/379562322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1560 0x55e5afbc1940 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40155d0 tx=0x7fa9b4015000 comp rx=0 tx=0).stop 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 -- 172.21.15.144:0/379562322 shutdown_connections 2024-09-12T12:15:46.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 --2- 172.21.15.144:0/379562322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afb78300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 --2- 172.21.15.144:0/379562322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 0x55e5afb779e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 --2- 172.21.15.144:0/379562322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1560 0x55e5afbc1940 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 -- 172.21.15.144:0/379562322 >> 172.21.15.144:0/379562322 conn(0x55e5afb79c70 msgr2=0x55e5afb71eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 -- 172.21.15.144:0/379562322 shutdown_connections 2024-09-12T12:15:46.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 -- 172.21.15.144:0/379562322 wait complete. 2024-09-12T12:15:46.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 -- start start 2024-09-12T12:15:46.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 Processor -- start 2024-09-12T12:15:46.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afbaaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 0x55e5afbaaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e5af9bcb40 con 0x55e5afbc1e80 2024-09-12T12:15:46.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e5af966350 con 0x55e5afbc1560 2024-09-12T12:15:46.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55e5af95a5b0 con 0x55e5afb77f20 2024-09-12T12:15:46.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9ce787000 10 client.0 _ll_register_callbacks cb 0x55e5afa23490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53114/0 (socket says 172.21.15.144:53114) 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c9400640 1 -- 172.21.15.144:0/1782150170 learned_addr learned my addr 172.21.15.144:0/1782150170 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afbaaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.303+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 0x55e5afbaaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9c9400640 1 -- 172.21.15.144:0/1782150170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 msgr2=0x55e5afbaaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9c9400640 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afbaaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9c9400640 1 -- 172.21.15.144:0/1782150170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 msgr2=0x55e5afbaaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9c9400640 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 0x55e5afbaaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9c9400640 1 -- 172.21.15.144:0/1782150170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5afa07250 con 0x55e5afbc1e80 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9c9400640 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbab480 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc01c8e0 tx=0x7fa9bc019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ad6e6285a1a827 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 1 -- 172.21.15.144:0/1782150170 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc00f000 con 0x55e5afbc1e80 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 1 -- 172.21.15.144:0/1782150170 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fa9bc0096b0 con 0x55e5afbc1e80 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 -- 172.21.15.144:0/1782150170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b4026070 con 0x55e5afbc1e80 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 1 -- 172.21.15.144:0/1782150170 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa9bc0c4050 con 0x55e5afbc1e80 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 10 client.5508 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 -- 172.21.15.144:0/1782150170 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e5af966ca0 con 0x55e5afbc1e80 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 1 -- 172.21.15.144:0/1782150170 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4026070 con 0x55e5afbc1e80 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 1 -- 172.21.15.144:0/1782150170 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fa9bc0c7020 con 0x55e5afbc1e80 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 10 client.5508 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 10 client.5508 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 20 client.5508 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e5afbabe90 0x55e5afbd1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 4 client.5508 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 -- 172.21.15.144:0/1782150170 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5af95ad60 con 0x55e5afbabe90 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e5afbabe90 0x55e5afbd1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e5afbabe90 0x55e5afbd1800 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a55d3973015b2b0e server_cookie=c81fe29daa3177cb in_seq=0 out_seq=0 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 10 client.5508 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 1 -- 172.21.15.144:0/1782150170 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5af95ad60 con 0x55e5afbabe90 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 10 client.5508 handle_command_reply: tid=0 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 client.5508 shutdown 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 -- 172.21.15.144:0/1782150170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 msgr2=0x55e5afbab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbab480 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc01c8e0 tx=0x7fa9bc019850 comp rx=0 tx=0).stop 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 -- 172.21.15.144:0/1782150170 shutdown_connections 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e5afbabe90 0x55e5afbd1800 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbab480 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 0x55e5afbaaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 --2- 172.21.15.144:0/1782150170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afbaaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 -- 172.21.15.144:0/1782150170 >> 172.21.15.144:0/1782150170 conn(0x55e5afb79c70 msgr2=0x55e5afb79230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ae000640 0 client.5508 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 -- 172.21.15.144:0/1782150170 shutdown_connections 2024-09-12T12:15:46.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 1 -- 172.21.15.144:0/1782150170 wait complete. 2024-09-12T12:15:46.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.307+0000 7fa9ce787000 20 client.5508 trim_cache size 0 max 16384 2024-09-12T12:15:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 Processor -- start 2024-09-12T12:15:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 -- start start 2024-09-12T12:15:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afb77f20 0x55e5afba9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afbc1560 0x55e5afb726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 0x55e5afb72be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4200c90 con 0x55e5afb77f20 2024-09-12T12:15:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c40b5460 con 0x55e5afbc1e80 2024-09-12T12:15:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c40b47c0 con 0x55e5afbc1560 2024-09-12T12:15:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afb77f20 0x55e5afba9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afb77f20 0x55e5afba9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53126/0 (socket says 172.21.15.144:53126) 2024-09-12T12:15:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c8a00640 1 -- 172.21.15.144:0/195688793 learned_addr learned my addr 172.21.15.144:0/195688793 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/195688793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afbc1560 0x55e5afb726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c9400640 1 --2- 172.21.15.144:0/195688793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 0x55e5afb72be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c8a00640 1 -- 172.21.15.144:0/195688793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afbc1560 msgr2=0x55e5afb726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/195688793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afbc1560 0x55e5afb726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c8a00640 1 -- 172.21.15.144:0/195688793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 msgr2=0x55e5afb72be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/195688793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 0x55e5afb72be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c8a00640 1 -- 172.21.15.144:0/195688793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5af9605b0 con 0x55e5afb77f20 2024-09-12T12:15:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/195688793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afb77f20 0x55e5afba9e80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4022000 tx=0x7fa9b4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c37a8b88382c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9b8c00640 1 -- 172.21.15.144:0/195688793 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4019040 con 0x55e5afb77f20 2024-09-12T12:15:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9b8c00640 1 -- 172.21.15.144:0/195688793 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4026070 con 0x55e5afb77f20 2024-09-12T12:15:46.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9b8c00640 1 -- 172.21.15.144:0/195688793 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b402d7c0 con 0x55e5afb77f20 2024-09-12T12:15:46.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 -- 172.21.15.144:0/195688793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afb77f20 msgr2=0x55e5afba9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 --2- 172.21.15.144:0/195688793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afb77f20 0x55e5afba9e80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4022000 tx=0x7fa9b4018000 comp rx=0 tx=0).stop 2024-09-12T12:15:46.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 -- 172.21.15.144:0/195688793 shutdown_connections 2024-09-12T12:15:46.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 --2- 172.21.15.144:0/195688793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1e80 0x55e5afb72be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 --2- 172.21.15.144:0/195688793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afbc1560 0x55e5afb726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 --2- 172.21.15.144:0/195688793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afb77f20 0x55e5afba9e80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 -- 172.21.15.144:0/195688793 >> 172.21.15.144:0/195688793 conn(0x55e5afb79c70 msgr2=0x55e5afb78300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 -- 172.21.15.144:0/195688793 shutdown_connections 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.327+0000 7fa9ce787000 1 -- 172.21.15.144:0/195688793 wait complete. 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 -- start start 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 Processor -- start 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afb76520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 0x55e5afb76a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbcf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e5af9bfe90 con 0x55e5afbc1e80 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c40b4e10 con 0x55e5afbc1560 2024-09-12T12:15:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55e5af9bcb40 con 0x55e5afb77f20 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 10 client.0 _ll_register_callbacks cb 0x7fa9b0009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbcf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbcf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53130/0 (socket says 172.21.15.144:53130) 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c9400640 1 -- 172.21.15.144:0/146261654 learned_addr learned my addr 172.21.15.144:0/146261654 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 0x55e5afb76a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afb76520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c9400640 1 -- 172.21.15.144:0/146261654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 msgr2=0x55e5afb76520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c9400640 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afb76520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c9400640 1 -- 172.21.15.144:0/146261654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 msgr2=0x55e5afb76a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c9400640 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 0x55e5afb76a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c9400640 1 -- 172.21.15.144:0/146261654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5af9544e0 con 0x55e5afbc1e80 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c3e00640 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 0x55e5afb76a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:46.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c9400640 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbcf7f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc0982a0 tx=0x7fa9bc0b2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8fc0debd42478c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ae000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ae000640 1 -- 172.21.15.144:0/146261654 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0043e0 con 0x55e5afbc1e80 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ae000640 1 -- 172.21.15.144:0/146261654 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fa9bc0baca0 con 0x55e5afbc1e80 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 -- 172.21.15.144:0/146261654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b4026070 con 0x55e5afbc1e80 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ae000640 1 -- 172.21.15.144:0/146261654 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa9bc0baea0 con 0x55e5afbc1e80 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 10 client.5514 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 -- 172.21.15.144:0/146261654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e5af958690 con 0x55e5afbc1e80 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ae000640 1 -- 172.21.15.144:0/146261654 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4026070 con 0x55e5afbc1e80 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ae000640 1 -- 172.21.15.144:0/146261654 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fa9bc0d0020 con 0x55e5afbc1e80 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 10 client.5514 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 10 client.5514 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 20 client.5514 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e5afbcfd30 0x55e5afbd0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 4 client.5514 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ce787000 1 -- 172.21.15.144:0/146261654 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55e5af9ce2b0 con 0x55e5afbcfd30 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e5afbcfd30 0x55e5afbd0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9ae000640 10 client.5514 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.331+0000 7fa9c8a00640 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e5afbcfd30 0x55e5afbd0140 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db3cb1c4ee86a351 server_cookie=58acdf8b185e20bc in_seq=0 out_seq=0 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ae000640 1 -- 172.21.15.144:0/146261654 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e5af9ce2b0 con 0x55e5afbcfd30 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ae000640 10 client.5514 handle_command_reply: tid=0 2024-09-12T12:15:46.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 client.5514 shutdown 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 -- 172.21.15.144:0/146261654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 msgr2=0x55e5afbcf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbcf7f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc0982a0 tx=0x7fa9bc0b2040 comp rx=0 tx=0).stop 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 -- 172.21.15.144:0/146261654 shutdown_connections 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e5afbcfd30 0x55e5afbd0140 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5afbc1e80 0x55e5afbcf7f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ae000640 0 client.5514 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e5afbc1560 0x55e5afb76a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 --2- 172.21.15.144:0/146261654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e5afb77f20 0x55e5afb76520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 -- 172.21.15.144:0/146261654 >> 172.21.15.144:0/146261654 conn(0x55e5afb79c70 msgr2=0x55e5afb78b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 -- 172.21.15.144:0/146261654 shutdown_connections 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 1 -- 172.21.15.144:0/146261654 wait complete. 2024-09-12T12:15:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9ce787000 20 client.5514 trim_cache size 0 max 16384 2024-09-12T12:15:46.348 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:46.348 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:15:46.348 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "12ebb5f1-1a76-475f-b6ae-498da7e8e1c6", 2024-09-12T12:15:46.348 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:15:46.348 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:46.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 -- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9a40678f0 msgr2=0x7fa9a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9a40678f0 0x7fa9a4069db0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4004bd0 tx=0x7fa9b4006040 comp rx=0 tx=0).stop 2024-09-12T12:15:46.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 -- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9c4158e60 msgr2=0x7fa9c415ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9c4158e60 0x7fa9c415ee60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00119d0 tx=0x7fa9b0011e90 comp rx=0 tx=0).stop 2024-09-12T12:15:46.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 -- 172.21.15.144:0/4251019891 shutdown_connections 2024-09-12T12:15:46.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9a40678f0 0x7fa9a4069db0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9c4157040 0x7fa9c41574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9c4158e60 0x7fa9c415ee60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 --2- 172.21.15.144:0/4251019891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9c4158a80 0x7fa9c415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 -- 172.21.15.144:0/4251019891 >> 172.21.15.144:0/4251019891 conn(0x7fa9c4068030 msgr2=0x7fa9c41622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 -- 172.21.15.144:0/4251019891 shutdown_connections 2024-09-12T12:15:46.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.335+0000 7fa9cb400640 1 -- 172.21.15.144:0/4251019891 wait complete. 2024-09-12T12:15:46.357 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '12ebb5f1-1a76-475f-b6ae-498da7e8e1c6', 'mode': 'asynchronous'}' 2024-09-12T12:15:46.357 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-12T12:15:46.357 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-12T12:15:46.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-12T12:15:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d11e00640 1 Processor -- start 2024-09-12T12:15:46.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d11e00640 1 -- start start 2024-09-12T12:15:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d11e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 0x7f0d0c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d11e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d0c073170 0x7f0d0c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d11e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0c070150 con 0x7f0d0c06fd10 2024-09-12T12:15:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d11e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0d0c0b63d0 con 0x7f0d0c073170 2024-09-12T12:15:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d11e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0b66b0 con 0x7f0d0c15e470 2024-09-12T12:15:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d0b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d0c073170 0x7f0d0c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d0b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0d0c073170 0x7f0d0c0aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53138/0 (socket says 172.21.15.144:53138) 2024-09-12T12:15:46.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d0b400640 1 -- 172.21.15.144:0/1688331098 learned_addr learned my addr 172.21.15.144:0/1688331098 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/1688331098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 0x7f0d0c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d0b400640 1 -- 172.21.15.144:0/1688331098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 msgr2=0x7f0d0c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d0b400640 1 --2- 172.21.15.144:0/1688331098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 0x7f0d0c0b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d0b400640 1 -- 172.21.15.144:0/1688331098 >> v1:172.21.15.165:6789/0 conn(0x7f0d0c06fd10 legacy=0x7f0d0c072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.495+0000 7f0d0b400640 1 -- 172.21.15.144:0/1688331098 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c0b6990 con 0x7f0d0c073170 2024-09-12T12:15:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d0b400640 1 --2- 172.21.15.144:0/1688331098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 0x7f0d0c0aedb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0d04009e80 tx=0x7f0d0401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3805311edbec7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d09600640 1 -- 172.21.15.144:0/1688331098 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d040a58a0 con 0x7f0d0c073170 2024-09-12T12:15:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d09600640 1 -- 172.21.15.144:0/1688331098 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d040a5a40 con 0x7f0d0c073170 2024-09-12T12:15:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d09600640 1 -- 172.21.15.144:0/1688331098 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d040a5e10 con 0x7f0d0c073170 2024-09-12T12:15:46.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d11e00640 1 -- 172.21.15.144:0/1688331098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 msgr2=0x7f0d0c0aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d11e00640 1 --2- 172.21.15.144:0/1688331098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 0x7f0d0c0aedb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0d04009e80 tx=0x7f0d0401c9e0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d11e00640 1 -- 172.21.15.144:0/1688331098 shutdown_connections 2024-09-12T12:15:46.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d11e00640 1 --2- 172.21.15.144:0/1688331098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 0x7f0d0c0aedb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d11e00640 1 --2- 172.21.15.144:0/1688331098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 0x7f0d0c0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d11e00640 1 -- 172.21.15.144:0/1688331098 >> 172.21.15.144:0/1688331098 conn(0x7f0d0c06cb10 msgr2=0x7f0d0c06cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d11e00640 1 -- 172.21.15.144:0/1688331098 shutdown_connections 2024-09-12T12:15:46.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.499+0000 7f0d11e00640 1 -- 172.21.15.144:0/1688331098 wait complete. 2024-09-12T12:15:46.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 Processor -- start 2024-09-12T12:15:46.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 -- start start 2024-09-12T12:15:46.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d0c06fd10 0x7f0d0c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 0x7f0d0c14ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 0x7f0d0c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0afc80 con 0x7f0d0c073170 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0afb00 con 0x7f0d0c06fd10 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0afe00 con 0x7f0d0c15e470 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 0x7f0d0c14ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 0x7f0d0c14ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53142/0 (socket says 172.21.15.144:53142) 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0a000640 1 -- 172.21.15.144:0/2071303122 learned_addr learned my addr 172.21.15.144:0/2071303122 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d0c06fd10 0x7f0d0c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0b400640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 0x7f0d0c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0a000640 1 -- 172.21.15.144:0/2071303122 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 msgr2=0x7f0d0c160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0a000640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 0x7f0d0c160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0a000640 1 -- 172.21.15.144:0/2071303122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d0c06fd10 msgr2=0x7f0d0c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0a000640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d0c06fd10 0x7f0d0c0cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0a000640 1 -- 172.21.15.144:0/2071303122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c14f590 con 0x7f0d0c073170 2024-09-12T12:15:46.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d0a000640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 0x7f0d0c14ea70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c460 tx=0x7f0cf800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d03400640 1 -- 172.21.15.144:0/2071303122 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8016020 con 0x7f0d0c073170 2024-09-12T12:15:46.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d03400640 1 -- 172.21.15.144:0/2071303122 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf80052d0 con 0x7f0d0c073170 2024-09-12T12:15:46.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d03400640 1 -- 172.21.15.144:0/2071303122 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8007260 con 0x7f0d0c073170 2024-09-12T12:15:46.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 -- 172.21.15.144:0/2071303122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c15fd20 con 0x7f0d0c073170 2024-09-12T12:15:46.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.503+0000 7f0d11e00640 1 -- 172.21.15.144:0/2071303122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c1602e0 con 0x7f0d0c073170 2024-09-12T12:15:46.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.507+0000 7f0d03400640 1 -- 172.21.15.144:0/2071303122 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0cf8007400 con 0x7f0d0c073170 2024-09-12T12:15:46.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.507+0000 7f0d03400640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0cec0678c0 0x7f0cec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.507+0000 7f0d03400640 1 -- 172.21.15.144:0/2071303122 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f0cf8085640 con 0x7f0d0c073170 2024-09-12T12:15:46.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.507+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0cec0678c0 0x7f0cec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.507+0000 7f0d1520e000 1 Processor -- start 2024-09-12T12:15:46.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.507+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0cec0678c0 0x7f0cec069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009ac0 tx=0x7f0cfc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.507+0000 7f0d1520e000 1 -- start start 2024-09-12T12:15:46.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e7920 0x55890a8e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a8e8240 0x55890a89db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a89e0b0 0x55890a89e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55890a6ebf60 con 0x55890a89e0b0 2024-09-12T12:15:46.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55890a6915a0 con 0x55890a8e7920 2024-09-12T12:15:46.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55890a6e7f20 con 0x55890a8e8240 2024-09-12T12:15:46.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a89e0b0 0x55890a89e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a89e0b0 0x55890a89e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53156/0 (socket says 172.21.15.144:53156) 2024-09-12T12:15:46.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a8e8240 0x55890a89db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e7920 0x55890a8e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0b400640 1 -- 172.21.15.144:0/3677653396 learned_addr learned my addr 172.21.15.144:0/3677653396 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0aa00640 1 -- 172.21.15.144:0/3677653396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a8e8240 msgr2=0x55890a89db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/3677653396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a8e8240 0x55890a89db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0aa00640 1 -- 172.21.15.144:0/3677653396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a89e0b0 msgr2=0x55890a89e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/3677653396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a89e0b0 0x55890a89e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0aa00640 1 -- 172.21.15.144:0/3677653396 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890a7325a0 con 0x55890a8e7920 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/3677653396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e7920 0x55890a8e7d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc011690 tx=0x7f0cfc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c9a72c5ed613049 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0cf7e00640 1 -- 172.21.15.144:0/3677653396 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc01b070 con 0x55890a8e7920 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0cf7e00640 1 -- 172.21.15.144:0/3677653396 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cfc027070 con 0x55890a8e7920 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0cf7e00640 1 -- 172.21.15.144:0/3677653396 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc003a30 con 0x55890a8e7920 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 -- 172.21.15.144:0/3677653396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e7920 msgr2=0x55890a8e7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3677653396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e7920 0x55890a8e7d00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc011690 tx=0x7f0cfc014000 comp rx=0 tx=0).stop 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 -- 172.21.15.144:0/3677653396 shutdown_connections 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3677653396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a89e0b0 0x55890a89e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3677653396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a8e8240 0x55890a89db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3677653396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e7920 0x55890a8e7d00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 -- 172.21.15.144:0/3677653396 >> 172.21.15.144:0/3677653396 conn(0x55890a89a060 msgr2=0x55890a89c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 -- 172.21.15.144:0/3677653396 shutdown_connections 2024-09-12T12:15:46.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 -- 172.21.15.144:0/3677653396 wait complete. 2024-09-12T12:15:46.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 -- start start 2024-09-12T12:15:46.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.511+0000 7f0d1520e000 1 Processor -- start 2024-09-12T12:15:46.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a8d5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e8240 0x55890a8a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55890a682f10 con 0x55890a8e7920 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55890a6a9a20 con 0x55890a8e8240 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55890a6b3660 con 0x55890a89e0b0 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 10 client.0 _ll_register_callbacks cb 0x55890a6c2d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8a32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53170/0 (socket says 172.21.15.144:53170) 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0a000640 1 -- 172.21.15.144:0/4164877372 learned_addr learned my addr 172.21.15.144:0/4164877372 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0b400640 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e8240 0x55890a8a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a8d5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0a000640 1 -- 172.21.15.144:0/4164877372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 msgr2=0x55890a8d5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0a000640 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a8d5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0a000640 1 -- 172.21.15.144:0/4164877372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e8240 msgr2=0x55890a8a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0a000640 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e8240 0x55890a8a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0a000640 1 -- 172.21.15.144:0/4164877372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55890a6917f0 con 0x55890a8e7920 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0a000640 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8a32c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8055690 tx=0x7f0cf8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16bfccecb9a756 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 1 -- 172.21.15.144:0/4164877372 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8052000 con 0x55890a8e7920 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 1 -- 172.21.15.144:0/4164877372 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f0cf8054de0 con 0x55890a8e7920 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- 172.21.15.144:0/4164877372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cfc027070 con 0x55890a8e7920 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 1 -- 172.21.15.144:0/4164877372 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0cf80521a0 con 0x55890a8e7920 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 10 client.5526 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- 172.21.15.144:0/4164877372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55890a68ba60 con 0x55890a8e7920 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 1 -- 172.21.15.144:0/4164877372 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cfc027070 con 0x55890a8e7920 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 1 -- 172.21.15.144:0/4164877372 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f0cf806db40 con 0x55890a8e7920 2024-09-12T12:15:46.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 10 client.5526 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 10 client.5526 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 20 client.5526 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55890a8d60c0 0x55890a8d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 4 client.5526 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- 172.21.15.144:0/4164877372 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55890a686210 con 0x55890a8d60c0 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55890a8d60c0 0x55890a8d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55890a8d60c0 0x55890a8d64a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c66c5fecd06d1be2 server_cookie=818821111a479253 in_seq=0 out_seq=0 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 10 client.5526 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 1 -- 172.21.15.144:0/4164877372 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55890a686210 con 0x55890a8d60c0 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 10 client.5526 handle_command_reply: tid=0 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 client.5526 shutdown 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- 172.21.15.144:0/4164877372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 msgr2=0x55890a8a32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8a32c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8055690 tx=0x7f0cf8011000 comp rx=0 tx=0).stop 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- 172.21.15.144:0/4164877372 shutdown_connections 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55890a8d60c0 0x55890a8d64a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a8e8240 0x55890a8a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8a32c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 --2- 172.21.15.144:0/4164877372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a8d5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0cf4c00640 0 client.5526 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- 172.21.15.144:0/4164877372 >> 172.21.15.144:0/4164877372 conn(0x55890a89a060 msgr2=0x55890a89cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- 172.21.15.144:0/4164877372 shutdown_connections 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.515+0000 7f0d1520e000 1 -- 172.21.15.144:0/4164877372 wait complete. 2024-09-12T12:15:46.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.519+0000 7f0d1520e000 20 client.5526 trim_cache size 0 max 16384 2024-09-12T12:15:46.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.531+0000 7f0d1520e000 1 Processor -- start 2024-09-12T12:15:46.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.531+0000 7f0d1520e000 1 -- start start 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.531+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 0x55890a956d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.531+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a9572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.531+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a9577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.531+0000 7f0d1520e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c208310 con 0x55890a8e7920 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.531+0000 7f0d1520e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c207310 con 0x55890a89a060 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.531+0000 7f0d1520e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c15f820 con 0x55890a89e0b0 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a9577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a9577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53186/0 (socket says 172.21.15.144:53186) 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 -- 172.21.15.144:0/1133915783 learned_addr learned my addr 172.21.15.144:0/1133915783 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 0x55890a956d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0a000640 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a9572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 -- 172.21.15.144:0/1133915783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 msgr2=0x55890a9572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a9572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 -- 172.21.15.144:0/1133915783 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 msgr2=0x55890a956d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 0x55890a956d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 -- 172.21.15.144:0/1133915783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890a76e650 con 0x55890a8e7920 2024-09-12T12:15:46.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0a000640 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a9572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:46.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a9577f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0d040985c0 tx=0x7f0d040a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67091ed8f36da7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0cf7400640 1 -- 172.21.15.144:0/1133915783 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d040c6070 con 0x55890a8e7920 2024-09-12T12:15:46.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0cf7400640 1 -- 172.21.15.144:0/1133915783 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d040c1430 con 0x55890a8e7920 2024-09-12T12:15:46.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0cf7400640 1 -- 172.21.15.144:0/1133915783 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d040c17e0 con 0x55890a8e7920 2024-09-12T12:15:46.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 -- 172.21.15.144:0/1133915783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 msgr2=0x55890a9577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a9577f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0d040985c0 tx=0x7f0d040a7070 comp rx=0 tx=0).stop 2024-09-12T12:15:46.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 -- 172.21.15.144:0/1133915783 shutdown_connections 2024-09-12T12:15:46.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a9577f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a9572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 --2- 172.21.15.144:0/1133915783 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 0x55890a956d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 -- 172.21.15.144:0/1133915783 >> 172.21.15.144:0/1133915783 conn(0x55890a8d5370 msgr2=0x55890a8f4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 -- 172.21.15.144:0/1133915783 shutdown_connections 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 -- 172.21.15.144:0/1133915783 wait complete. 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 -- start start 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 Processor -- start 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 0x55890a8fbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a8fc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8fc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55890a8a4250 con 0x55890a8e7920 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0ceb80 con 0x55890a89a060 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55890a697e60 con 0x55890a89e0b0 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d1520e000 10 client.0 _ll_register_callbacks cb 0x7f0cf80552f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.535+0000 7f0d0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8fc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8fc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53198/0 (socket says 172.21.15.144:53198) 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0b400640 1 -- 172.21.15.144:0/3817628432 learned_addr learned my addr 172.21.15.144:0/3817628432 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0a000640 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a8fc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 0x55890a8fbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0b400640 1 -- 172.21.15.144:0/3817628432 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 msgr2=0x55890a8fc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0b400640 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a8fc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0b400640 1 -- 172.21.15.144:0/3817628432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 msgr2=0x55890a8fbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0b400640 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 0x55890a8fbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0b400640 1 -- 172.21.15.144:0/3817628432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55890a6b1120 con 0x55890a8e7920 2024-09-12T12:15:46.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0b400640 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8fc790 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0d0401a610 tx=0x7f0d0401b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151b89c531763ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0cf4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0cf4c00640 1 -- 172.21.15.144:0/3817628432 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d040c6040 con 0x55890a8e7920 2024-09-12T12:15:46.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0cf4c00640 1 -- 172.21.15.144:0/3817628432 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f0d04003ce0 con 0x55890a8e7920 2024-09-12T12:15:46.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d1520e000 1 -- 172.21.15.144:0/3817628432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d040c1430 con 0x55890a8e7920 2024-09-12T12:15:46.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0cf4c00640 1 -- 172.21.15.144:0/3817628432 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0d04004040 con 0x55890a8e7920 2024-09-12T12:15:46.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d1520e000 10 client.5532 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d1520e000 1 -- 172.21.15.144:0/3817628432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55890a683a20 con 0x55890a8e7920 2024-09-12T12:15:46.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0cf4c00640 1 -- 172.21.15.144:0/3817628432 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d040c1430 con 0x55890a8e7920 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0cf4c00640 1 -- 172.21.15.144:0/3817628432 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f0d04008050 con 0x55890a8e7920 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d1520e000 10 client.5532 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d1520e000 10 client.5532 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d1520e000 20 client.5532 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55890a8e8240 0x55890a8fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d1520e000 4 client.5532 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d1520e000 1 -- 172.21.15.144:0/3817628432 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55890a6f9690 con 0x55890a8e8240 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55890a8e8240 0x55890a8fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0cf4c00640 10 client.5532 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.539+0000 7f0d0aa00640 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55890a8e8240 0x55890a8fccd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6da9df48a05e5d30 server_cookie=3a2548b8e2fe6f6b in_seq=0 out_seq=0 2024-09-12T12:15:46.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0cf4c00640 1 -- 172.21.15.144:0/3817628432 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55890a6f9690 con 0x55890a8e8240 2024-09-12T12:15:46.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0cf4c00640 10 client.5532 handle_command_reply: tid=0 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 client.5532 shutdown 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 -- 172.21.15.144:0/3817628432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 msgr2=0x55890a8fc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8fc790 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0d0401a610 tx=0x7f0d0401b220 comp rx=0 tx=0).stop 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 -- 172.21.15.144:0/3817628432 shutdown_connections 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55890a8e8240 0x55890a8fccd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55890a8e7920 0x55890a8fc790 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55890a89e0b0 0x55890a8fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0cf4c00640 0 client.5532 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 --2- 172.21.15.144:0/3817628432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55890a89a060 0x55890a8fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 -- 172.21.15.144:0/3817628432 >> 172.21.15.144:0/3817628432 conn(0x55890a8d5370 msgr2=0x55890a8e6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 -- 172.21.15.144:0/3817628432 shutdown_connections 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 1 -- 172.21.15.144:0/3817628432 wait complete. 2024-09-12T12:15:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d1520e000 20 client.5532 trim_cache size 0 max 16384 2024-09-12T12:15:46.548 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:46.548 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:46.548 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:15:46.548 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 -- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0cec0678c0 msgr2=0x7f0cec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0cec0678c0 0x7f0cec069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009ac0 tx=0x7f0cfc009190 comp rx=0 tx=0).stop 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 -- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 msgr2=0x7f0d0c14ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 0x7f0d0c14ea70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c460 tx=0x7f0cf800c920 comp rx=0 tx=0).stop 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 -- 172.21.15.144:0/2071303122 shutdown_connections 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0cec0678c0 0x7f0cec069d80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0d0c15e470 0x7f0d0c160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0d0c073170 0x7f0d0c14ea70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 --2- 172.21.15.144:0/2071303122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d0c06fd10 0x7f0d0c0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 -- 172.21.15.144:0/2071303122 >> 172.21.15.144:0/2071303122 conn(0x7f0d0c06cb10 msgr2=0x7f0d0c15b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 -- 172.21.15.144:0/2071303122 shutdown_connections 2024-09-12T12:15:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.543+0000 7f0d11e00640 1 -- 172.21.15.144:0/2071303122 wait complete. 2024-09-12T12:15:46.565 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-09-12T12:15:46.565 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-12T12:15:46.565 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-12T12:15:46.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff5a2600640 1 Processor -- start 2024-09-12T12:15:46.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff5a2600640 1 -- start start 2024-09-12T12:15:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff5a2600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff59c15c2e0 0x7ff59c072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff5a2600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff59c0af5f0 0x7ff59c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff5a2600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c06c150 0x7ff59c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff5a2600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff59c06c5c0 con 0x7ff59c15c2e0 2024-09-12T12:15:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff5a2600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff59c0733e0 con 0x7ff59c0af5f0 2024-09-12T12:15:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff5a2600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff59c0cd290 con 0x7ff59c06c150 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff59c15c2e0 0x7ff59c072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff59c15c2e0 0x7ff59c072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53212/0 (socket says 172.21.15.144:53212) 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59b400640 1 -- 172.21.15.144:0/1877893322 learned_addr learned my addr 172.21.15.144:0/1877893322 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59aa00640 1 --2- 172.21.15.144:0/1877893322 >> v2:172.21.15.165:3300/0 conn(0x7ff59c0af5f0 0x7ff59c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59be00640 1 --2- 172.21.15.144:0/1877893322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c06c150 0x7ff59c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59b400640 1 -- 172.21.15.144:0/1877893322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c06c150 msgr2=0x7ff59c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59b400640 1 --2- 172.21.15.144:0/1877893322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c06c150 0x7ff59c06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59b400640 1 -- 172.21.15.144:0/1877893322 >> v2:172.21.15.165:3300/0 conn(0x7ff59c0af5f0 msgr2=0x7ff59c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59b400640 1 --2- 172.21.15.144:0/1877893322 >> v2:172.21.15.165:3300/0 conn(0x7ff59c0af5f0 0x7ff59c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59b400640 1 -- 172.21.15.144:0/1877893322 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c0cd570 con 0x7ff59c15c2e0 2024-09-12T12:15:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.703+0000 7ff59be00640 1 --2- 172.21.15.144:0/1877893322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c06c150 0x7ff59c06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff59b400640 1 --2- 172.21.15.144:0/1877893322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c15c2e0 0x7ff59c072b50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0afa60 tx=0x7ff58c01c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8290933c392494d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff59a000640 1 -- 172.21.15.144:0/1877893322 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0b0070 con 0x7ff59c15c2e0 2024-09-12T12:15:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff59a000640 1 -- 172.21.15.144:0/1877893322 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c0ab600 con 0x7ff59c15c2e0 2024-09-12T12:15:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff59a000640 1 -- 172.21.15.144:0/1877893322 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0ab9d0 con 0x7ff59c15c2e0 2024-09-12T12:15:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff5a2600640 1 -- 172.21.15.144:0/1877893322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c15c2e0 msgr2=0x7ff59c072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff5a2600640 1 --2- 172.21.15.144:0/1877893322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c15c2e0 0x7ff59c072b50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0afa60 tx=0x7ff58c01c140 comp rx=0 tx=0).stop 2024-09-12T12:15:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff5a2600640 1 -- 172.21.15.144:0/1877893322 shutdown_connections 2024-09-12T12:15:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff5a2600640 1 --2- 172.21.15.144:0/1877893322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c06c150 0x7ff59c06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff5a2600640 1 --2- 172.21.15.144:0/1877893322 >> v2:172.21.15.165:3300/0 conn(0x7ff59c0af5f0 0x7ff59c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff5a2600640 1 --2- 172.21.15.144:0/1877893322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c15c2e0 0x7ff59c072b50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff5a2600640 1 -- 172.21.15.144:0/1877893322 >> 172.21.15.144:0/1877893322 conn(0x7ff59c068030 msgr2=0x7ff59c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff5a2600640 1 -- 172.21.15.144:0/1877893322 shutdown_connections 2024-09-12T12:15:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.707+0000 7ff5a2600640 1 -- 172.21.15.144:0/1877893322 wait complete. 2024-09-12T12:15:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 Processor -- start 2024-09-12T12:15:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 -- start start 2024-09-12T12:15:46.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c06c150 0x7ff59c0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c0af5f0 0x7ff59c14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff59c15c2e0 0x7ff59c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c0cdef0 con 0x7ff59c06c150 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c0cdd70 con 0x7ff59c15c2e0 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff59c0ce070 con 0x7ff59c0af5f0 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c06c150 0x7ff59c0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c06c150 0x7ff59c0b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53228/0 (socket says 172.21.15.144:53228) 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59b400640 1 -- 172.21.15.144:0/753541947 learned_addr learned my addr 172.21.15.144:0/753541947 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59be00640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff59c15c2e0 0x7ff59c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59aa00640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c0af5f0 0x7ff59c14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59b400640 1 -- 172.21.15.144:0/753541947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c0af5f0 msgr2=0x7ff59c14ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59b400640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c0af5f0 0x7ff59c14ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59b400640 1 -- 172.21.15.144:0/753541947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff59c15c2e0 msgr2=0x7ff59c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59b400640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff59c15c2e0 0x7ff59c0ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59b400640 1 -- 172.21.15.144:0/753541947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c1574c0 con 0x7ff59c06c150 2024-09-12T12:15:46.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff59b400640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c06c150 0x7ff59c0b33f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0ae040 tx=0x7ff58c01a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff593400640 1 -- 172.21.15.144:0/753541947 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0ba020 con 0x7ff59c06c150 2024-09-12T12:15:46.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff593400640 1 -- 172.21.15.144:0/753541947 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c0b6620 con 0x7ff59c06c150 2024-09-12T12:15:46.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff593400640 1 -- 172.21.15.144:0/753541947 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0b0040 con 0x7ff59c06c150 2024-09-12T12:15:46.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 -- 172.21.15.144:0/753541947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59c1577a0 con 0x7ff59c06c150 2024-09-12T12:15:46.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.711+0000 7ff5a2600640 1 -- 172.21.15.144:0/753541947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff59c15df20 con 0x7ff59c06c150 2024-09-12T12:15:46.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff593400640 1 -- 172.21.15.144:0/753541947 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff58c0bd020 con 0x7ff59c06c150 2024-09-12T12:15:46.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff593400640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff57c0678c0 0x7ff57c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff593400640 1 -- 172.21.15.144:0/753541947 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ff58c11fff0 con 0x7ff59c06c150 2024-09-12T12:15:46.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff59aa00640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff57c0678c0 0x7ff57c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff5a5927000 1 Processor -- start 2024-09-12T12:15:46.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff5a5927000 1 -- start start 2024-09-12T12:15:46.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff59aa00640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff57c0678c0 0x7ff57c069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff59c15d950 tx=0x7ff588008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe5791830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791d70 0x557fe57453a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe57458e0 0x557fe5745cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff5a5927000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557fe5595fd0 con 0x557fe5791450 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff5a5927000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557fe553b6b0 con 0x557fe5791d70 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff5a5927000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557fe5591f90 con 0x557fe57458e0 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff59b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe5791830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff59b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe5791830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53242/0 (socket says 172.21.15.144:53242) 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff59b400640 1 -- 172.21.15.144:0/1008103271 learned_addr learned my addr 172.21.15.144:0/1008103271 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff59be00640 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe57458e0 0x557fe5745cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.715+0000 7ff59aa00640 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791d70 0x557fe57453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59b400640 1 -- 172.21.15.144:0/1008103271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe57458e0 msgr2=0x557fe5745cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59b400640 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe57458e0 0x557fe5745cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59b400640 1 -- 172.21.15.144:0/1008103271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791d70 msgr2=0x557fe57453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59b400640 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791d70 0x557fe57453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59b400640 1 -- 172.21.15.144:0/1008103271 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fe553b900 con 0x557fe5791450 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59aa00640 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791d70 0x557fe57453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59b400640 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe5791830 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff58c000c10 tx=0x7ff58c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fb279b09e12066 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff587e00640 1 -- 172.21.15.144:0/1008103271 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0ab480 con 0x557fe5791450 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff587e00640 1 -- 172.21.15.144:0/1008103271 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c0ec940 con 0x557fe5791450 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff587e00640 1 -- 172.21.15.144:0/1008103271 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0f8970 con 0x557fe5791450 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 -- 172.21.15.144:0/1008103271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 msgr2=0x557fe5791830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe5791830 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff58c000c10 tx=0x7ff58c009240 comp rx=0 tx=0).stop 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 -- 172.21.15.144:0/1008103271 shutdown_connections 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe57458e0 0x557fe5745cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791d70 0x557fe57453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1008103271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe5791830 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 -- 172.21.15.144:0/1008103271 >> 172.21.15.144:0/1008103271 conn(0x557fe5258fc0 msgr2=0x557fe5774900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 -- 172.21.15.144:0/1008103271 shutdown_connections 2024-09-12T12:15:46.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 -- 172.21.15.144:0/1008103271 wait complete. 2024-09-12T12:15:46.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 -- start start 2024-09-12T12:15:46.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 Processor -- start 2024-09-12T12:15:46.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe57728f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791450 0x557fe5772e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791d70 0x557fe5773370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557fe559a600 con 0x557fe5791d70 2024-09-12T12:15:46.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557fe5553aa0 con 0x557fe57458e0 2024-09-12T12:15:46.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557fe552ced0 con 0x557fe5791450 2024-09-12T12:15:46.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff5a5927000 10 client.0 _ll_register_callbacks cb 0x557fe5732e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791d70 0x557fe5773370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791d70 0x557fe5773370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53250/0 (socket says 172.21.15.144:53250) 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59be00640 1 -- 172.21.15.144:0/2912395782 learned_addr learned my addr 172.21.15.144:0/2912395782 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59b400640 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe57728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59aa00640 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791450 0x557fe5772e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59be00640 1 -- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791450 msgr2=0x557fe5772e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59be00640 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791450 0x557fe5772e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59be00640 1 -- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 msgr2=0x557fe57728f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59be00640 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe57728f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59be00640 1 -- 172.21.15.144:0/2912395782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fe5535a20 con 0x557fe5791d70 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59b400640 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe57728f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.719+0000 7ff59aa00640 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791450 0x557fe5772e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff59be00640 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791d70 0x557fe5773370 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff59400db90 tx=0x7ff59400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5261b26bceb4338 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 1 -- 172.21.15.144:0/2912395782 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59401c060 con 0x557fe5791d70 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 1 -- 172.21.15.144:0/2912395782 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ff59400a610 con 0x557fe5791d70 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 -- 172.21.15.144:0/2912395782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff58c0ec940 con 0x557fe5791d70 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 1 -- 172.21.15.144:0/2912395782 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff594022050 con 0x557fe5791d70 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 10 client.5544 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 -- 172.21.15.144:0/2912395782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x557fe551d4a0 con 0x557fe5791d70 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 1 -- 172.21.15.144:0/2912395782 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c0ec940 con 0x557fe5791d70 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 1 -- 172.21.15.144:0/2912395782 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7ff594025020 con 0x557fe5791d70 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 10 client.5544 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 10 client.5544 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 20 client.5544 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557fe57a04e0 0x557fe57a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 4 client.5544 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:46.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 -- 172.21.15.144:0/2912395782 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fe55301d0 con 0x557fe57a04e0 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff59b400640 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557fe57a04e0 0x557fe57a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff59b400640 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557fe57a04e0 0x557fe57a28d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=148035b7888cc439 server_cookie=bf5d0402e9f38359 in_seq=0 out_seq=0 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 10 client.5544 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 1 -- 172.21.15.144:0/2912395782 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557fe55301d0 con 0x557fe57a04e0 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 10 client.5544 handle_command_reply: tid=0 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 client.5544 shutdown 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 -- 172.21.15.144:0/2912395782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791d70 msgr2=0x557fe5773370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791d70 0x557fe5773370 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff59400db90 tx=0x7ff59400c7f0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 -- 172.21.15.144:0/2912395782 shutdown_connections 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557fe57a04e0 0x557fe57a28d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791d70 0x557fe5773370 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791450 0x557fe5772e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 --2- 172.21.15.144:0/2912395782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe57728f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff584c00640 0 client.5544 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 -- 172.21.15.144:0/2912395782 >> 172.21.15.144:0/2912395782 conn(0x557fe5258fc0 msgr2=0x557fe5744aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 -- 172.21.15.144:0/2912395782 shutdown_connections 2024-09-12T12:15:46.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 1 -- 172.21.15.144:0/2912395782 wait complete. 2024-09-12T12:15:46.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.723+0000 7ff5a5927000 20 client.5544 trim_cache size 0 max 16384 2024-09-12T12:15:46.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 Processor -- start 2024-09-12T12:15:46.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 -- start start 2024-09-12T12:15:46.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe574d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe574d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 0x557fe5772cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c2040f0 con 0x557fe5791450 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c2030f0 con 0x557fe57458e0 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff59c202480 con 0x557fe5791d70 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe574d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe574d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53258/0 (socket says 172.21.15.144:53258) 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59aa00640 1 -- 172.21.15.144:0/3519921653 learned_addr learned my addr 172.21.15.144:0/3519921653 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59be00640 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 0x557fe5772cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59b400640 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe574d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59aa00640 1 -- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 msgr2=0x557fe5772cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59aa00640 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 0x557fe5772cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59aa00640 1 -- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 msgr2=0x557fe574d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59aa00640 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe574d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59aa00640 1 -- 172.21.15.144:0/3519921653 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fe553a590 con 0x557fe5791450 2024-09-12T12:15:46.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59b400640 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe574d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:46.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59be00640 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 0x557fe5772cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:46.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff59aa00640 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe574d790 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff588010b20 tx=0x7ff588016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e5d07ce61e9f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff587400640 1 -- 172.21.15.144:0/3519921653 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588016cd0 con 0x557fe5791450 2024-09-12T12:15:46.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff587400640 1 -- 172.21.15.144:0/3519921653 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff588028070 con 0x557fe5791450 2024-09-12T12:15:46.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff587400640 1 -- 172.21.15.144:0/3519921653 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588023680 con 0x557fe5791450 2024-09-12T12:15:46.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 -- 172.21.15.144:0/3519921653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 msgr2=0x557fe574d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe574d790 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff588010b20 tx=0x7ff588016000 comp rx=0 tx=0).stop 2024-09-12T12:15:46.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 -- 172.21.15.144:0/3519921653 shutdown_connections 2024-09-12T12:15:46.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 0x557fe5772cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe5791450 0x557fe574d790 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 --2- 172.21.15.144:0/3519921653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe57458e0 0x557fe574d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 -- 172.21.15.144:0/3519921653 >> 172.21.15.144:0/3519921653 conn(0x557fe5258fc0 msgr2=0x557fe57723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 -- 172.21.15.144:0/3519921653 shutdown_connections 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.743+0000 7ff5a5927000 1 -- 172.21.15.144:0/3519921653 wait complete. 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 -- start start 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 Processor -- start 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe57458e0 0x557fe5804540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791450 0x557fe5804a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 0x557fe57a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557fe55952e0 con 0x557fe57458e0 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c202aa0 con 0x557fe5791450 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557fe5595fd0 con 0x557fe5791d70 2024-09-12T12:15:46.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 10 client.0 _ll_register_callbacks cb 0x7ff594007a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe57458e0 0x557fe5804540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe57458e0 0x557fe5804540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53272/0 (socket says 172.21.15.144:53272) 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59b400640 1 -- 172.21.15.144:0/1345728777 learned_addr learned my addr 172.21.15.144:0/1345728777 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59aa00640 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791450 0x557fe5804a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59be00640 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 0x557fe57a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59b400640 1 -- 172.21.15.144:0/1345728777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 msgr2=0x557fe57a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59b400640 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 0x557fe57a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59b400640 1 -- 172.21.15.144:0/1345728777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791450 msgr2=0x557fe5804a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59b400640 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791450 0x557fe5804a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59b400640 1 -- 172.21.15.144:0/1345728777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fe561a720 con 0x557fe57458e0 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59b400640 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe57458e0 0x557fe5804540 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff58c120290 tx=0x7ff58c11e1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b5cc8c2c39611d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff584c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff584c00640 1 -- 172.21.15.144:0/1345728777 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0ec570 con 0x557fe57458e0 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff584c00640 1 -- 172.21.15.144:0/1345728777 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ff58c108050 con 0x557fe57458e0 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 -- 172.21.15.144:0/1345728777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff588028070 con 0x557fe57458e0 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff584c00640 1 -- 172.21.15.144:0/1345728777 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff58c0ec940 con 0x557fe57458e0 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 10 client.5550 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 -- 172.21.15.144:0/1345728777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x557fe552de90 con 0x557fe57458e0 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff584c00640 1 -- 172.21.15.144:0/1345728777 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff588028070 con 0x557fe57458e0 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff584c00640 1 -- 172.21.15.144:0/1345728777 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7ff58c0b3030 con 0x557fe57458e0 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 10 client.5550 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 10 client.5550 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 20 client.5550 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557fe57a5150 0x557fe57a5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 4 client.5550 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-12T12:15:46.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff5a5927000 1 -- 172.21.15.144:0/1345728777 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x557fe55a3700 con 0x557fe57a5150 2024-09-12T12:15:46.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59aa00640 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557fe57a5150 0x557fe57a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff59aa00640 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557fe57a5150 0x557fe57a5560 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5372d75ae3672d80 server_cookie=86267a55f7bbb402 in_seq=0 out_seq=0 2024-09-12T12:15:46.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.747+0000 7ff584c00640 10 client.5550 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff584c00640 1 -- 172.21.15.144:0/1345728777 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557fe55a3700 con 0x557fe57a5150 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff584c00640 10 client.5550 handle_command_reply: tid=0 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 client.5550 shutdown 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 -- 172.21.15.144:0/1345728777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe57458e0 msgr2=0x557fe5804540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe57458e0 0x557fe5804540 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff58c120290 tx=0x7ff58c11e1e0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 -- 172.21.15.144:0/1345728777 shutdown_connections 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557fe57a5150 0x557fe57a5560 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fe5791d70 0x557fe57a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fe5791450 0x557fe5804a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 --2- 172.21.15.144:0/1345728777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fe57458e0 0x557fe5804540 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 -- 172.21.15.144:0/1345728777 >> 172.21.15.144:0/1345728777 conn(0x557fe5258fc0 msgr2=0x557fe5772bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff584c00640 0 client.5550 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 -- 172.21.15.144:0/1345728777 shutdown_connections 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 1 -- 172.21.15.144:0/1345728777 wait complete. 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a5927000 20 client.5550 trim_cache size 0 max 16384 2024-09-12T12:15:46.757 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:46.758 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:15:46.758 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "3450ecce-8892-4e70-bd69-4665db656b01", 2024-09-12T12:15:46.758 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:15:46.758 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:46.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 -- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff57c0678c0 msgr2=0x7ff57c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff57c0678c0 0x7ff57c069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff59c15d950 tx=0x7ff588008040 comp rx=0 tx=0).stop 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 -- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c06c150 msgr2=0x7ff59c0b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c06c150 0x7ff59c0b33f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0ae040 tx=0x7ff58c01a980 comp rx=0 tx=0).stop 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 -- 172.21.15.144:0/753541947 shutdown_connections 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff57c0678c0 0x7ff57c069d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff59c15c2e0 0x7ff59c0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff59c0af5f0 0x7ff59c14ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 --2- 172.21.15.144:0/753541947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff59c06c150 0x7ff59c0b33f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 -- 172.21.15.144:0/753541947 >> 172.21.15.144:0/753541947 conn(0x7ff59c068030 msgr2=0x7ff59c0ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 -- 172.21.15.144:0/753541947 shutdown_connections 2024-09-12T12:15:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.751+0000 7ff5a2600640 1 -- 172.21.15.144:0/753541947 wait complete. 2024-09-12T12:15:46.771 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '3450ecce-8892-4e70-bd69-4665db656b01', 'mode': 'asynchronous'}' 2024-09-12T12:15:46.771 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-09-12T12:15:46.771 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-12T12:15:46.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-12T12:15:46.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd513400640 1 Processor -- start 2024-09-12T12:15:46.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd513400640 1 -- start start 2024-09-12T12:15:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd513400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd50c0cd9f0 0x7fd50c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd513400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50c0b4300 con 0x7fd50c15b340 2024-09-12T12:15:46.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd513400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50c0b3540 con 0x7fd50c15af60 2024-09-12T12:15:46.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd513400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd50c0b32f0 con 0x7fd50c0cd9f0 2024-09-12T12:15:46.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd50be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd50c0cd9f0 0x7fd50c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd50be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd50c0cd9f0 0x7fd50c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53276/0 (socket says 172.21.15.144:53276) 2024-09-12T12:15:46.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd50be00640 1 -- 172.21.15.144:0/2465858039 learned_addr learned my addr 172.21.15.144:0/2465858039 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd50be00640 1 -- 172.21.15.144:0/2465858039 >> v1:172.21.15.165:6789/0 conn(0x7fd50c15af60 legacy=0x7fd50c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd50be00640 1 -- 172.21.15.144:0/2465858039 >> v1:172.21.15.144:6789/0 conn(0x7fd50c15b340 legacy=0x7fd50c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.907+0000 7fd50be00640 1 -- 172.21.15.144:0/2465858039 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c0b3820 con 0x7fd50c0cd9f0 2024-09-12T12:15:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd50be00640 1 --2- 172.21.15.144:0/2465858039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c0cd9f0 0x7fd50c06bc10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009870 tx=0x7fd4f801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c49a97b9f44839 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd50b400640 1 -- 172.21.15.144:0/2465858039 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80b2070 con 0x7fd50c0cd9f0 2024-09-12T12:15:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd50b400640 1 -- 172.21.15.144:0/2465858039 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f80a9070 con 0x7fd50c0cd9f0 2024-09-12T12:15:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd50b400640 1 -- 172.21.15.144:0/2465858039 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80ad880 con 0x7fd50c0cd9f0 2024-09-12T12:15:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd513400640 1 -- 172.21.15.144:0/2465858039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c0cd9f0 msgr2=0x7fd50c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd513400640 1 --2- 172.21.15.144:0/2465858039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c0cd9f0 0x7fd50c06bc10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009870 tx=0x7fd4f801c560 comp rx=0 tx=0).stop 2024-09-12T12:15:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd513400640 1 -- 172.21.15.144:0/2465858039 shutdown_connections 2024-09-12T12:15:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd513400640 1 --2- 172.21.15.144:0/2465858039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c0cd9f0 0x7fd50c06bc10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd513400640 1 -- 172.21.15.144:0/2465858039 >> 172.21.15.144:0/2465858039 conn(0x7fd50c068030 msgr2=0x7fd50c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd513400640 1 -- 172.21.15.144:0/2465858039 shutdown_connections 2024-09-12T12:15:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.911+0000 7fd513400640 1 -- 172.21.15.144:0/2465858039 wait complete. 2024-09-12T12:15:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 Processor -- start 2024-09-12T12:15:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 -- start start 2024-09-12T12:15:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd50c0cd9f0 0x7fd50c141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c15af60 0x7fd50c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd50c15b340 0x7fd50c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c169120 con 0x7fd50c15af60 2024-09-12T12:15:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c06c560 con 0x7fd50c15b340 2024-09-12T12:15:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c1692a0 con 0x7fd50c0cd9f0 2024-09-12T12:15:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd50be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c15af60 0x7fd50c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd50be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c15af60 0x7fd50c159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53286/0 (socket says 172.21.15.144:53286) 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd50be00640 1 -- 172.21.15.144:0/1782148816 learned_addr learned my addr 172.21.15.144:0/1782148816 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd510a00640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd50c0cd9f0 0x7fd50c141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd511400640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd50c15b340 0x7fd50c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd50be00640 1 -- 172.21.15.144:0/1782148816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd50c0cd9f0 msgr2=0x7fd50c141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd50be00640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd50c0cd9f0 0x7fd50c141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd50be00640 1 -- 172.21.15.144:0/1782148816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd50c15b340 msgr2=0x7fd50c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd50be00640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd50c15b340 0x7fd50c0ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd50be00640 1 -- 172.21.15.144:0/1782148816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c158700 con 0x7fd50c15af60 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd50be00640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c15af60 0x7fd50c159f70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80b0040 tx=0x7fd4f8019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd508c00640 1 -- 172.21.15.144:0/1782148816 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80bc070 con 0x7fd50c15af60 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd508c00640 1 -- 172.21.15.144:0/1782148816 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f80b6640 con 0x7fd50c15af60 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 -- 172.21.15.144:0/1782148816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50c1589e0 con 0x7fd50c15af60 2024-09-12T12:15:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd508c00640 1 -- 172.21.15.144:0/1782148816 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80b2040 con 0x7fd50c15af60 2024-09-12T12:15:46.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.915+0000 7fd513400640 1 -- 172.21.15.144:0/1782148816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50c158fa0 con 0x7fd50c15af60 2024-09-12T12:15:46.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd508c00640 1 -- 172.21.15.144:0/1782148816 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd4f80bf070 con 0x7fd50c15af60 2024-09-12T12:15:46.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd508c00640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4ec0678c0 0x7fd4ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd508c00640 1 -- 172.21.15.144:0/1782148816 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd4f811f340 con 0x7fd50c15af60 2024-09-12T12:15:46.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd510a00640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4ec0678c0 0x7fd4ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd5168e6000 1 Processor -- start 2024-09-12T12:15:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd5168e6000 1 -- start start 2024-09-12T12:15:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd510a00640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4ec0678c0 0x7fd4ec069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd50c1fb2d0 tx=0x7fd4fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff4bb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff472800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 0x556fff473120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd5168e6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556fff359bd0 con 0x556fff4bb2d0 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd5168e6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556fff2c09e0 con 0x556fff4bbbf0 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.919+0000 7fd5168e6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x556fff2668f0 con 0x556fff472d40 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff4bb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff4bb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53298/0 (socket says 172.21.15.144:53298) 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 -- 172.21.15.144:0/2978952930 learned_addr learned my addr 172.21.15.144:0/2978952930 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd50be00640 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff472800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd511400640 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 0x556fff473120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 -- 172.21.15.144:0/2978952930 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 msgr2=0x556fff473120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 0x556fff473120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 -- 172.21.15.144:0/2978952930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 msgr2=0x556fff472800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff472800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 -- 172.21.15.144:0/2978952930 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fff25e970 con 0x556fff4bb2d0 2024-09-12T12:15:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd50be00640 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff472800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff4bb6b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00fb70 tx=0x7fd4fc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde34bf55395f925 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd501600640 1 -- 172.21.15.144:0/2978952930 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc025070 con 0x556fff4bb2d0 2024-09-12T12:15:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd501600640 1 -- 172.21.15.144:0/2978952930 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc01b050 con 0x556fff4bb2d0 2024-09-12T12:15:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd501600640 1 -- 172.21.15.144:0/2978952930 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc014de0 con 0x556fff4bb2d0 2024-09-12T12:15:46.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978952930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 msgr2=0x556fff4bb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff4bb6b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00fb70 tx=0x7fd4fc012000 comp rx=0 tx=0).stop 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978952930 shutdown_connections 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 0x556fff473120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff472800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978952930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff4bb6b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978952930 >> 172.21.15.144:0/2978952930 conn(0x556fff469ba0 msgr2=0x556fff4710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978952930 shutdown_connections 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978952930 wait complete. 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 -- start start 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 Processor -- start 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff472d40 0x556fff477930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 0x556fff477e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff4783b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556fff25aa50 con 0x556fff472d40 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556fff2bc9a0 con 0x556fff4bbbf0 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x556fff28b180 con 0x556fff4bb2d0 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd5168e6000 10 client.0 _ll_register_callbacks cb 0x556fff322430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff472d40 0x556fff477930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff472d40 0x556fff477930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53304/0 (socket says 172.21.15.144:53304) 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.923+0000 7fd510a00640 1 -- 172.21.15.144:0/2978137013 learned_addr learned my addr 172.21.15.144:0/2978137013 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd511400640 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff4783b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd50be00640 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 0x556fff477e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd510a00640 1 -- 172.21.15.144:0/2978137013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 msgr2=0x556fff477e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd510a00640 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 0x556fff477e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd510a00640 1 -- 172.21.15.144:0/2978137013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 msgr2=0x556fff4783b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd510a00640 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff4783b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd510a00640 1 -- 172.21.15.144:0/2978137013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fff2c9650 con 0x556fff472d40 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd510a00640 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff472d40 0x556fff477930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc023040 tx=0x7fd4fc001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a6be354189d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 1 -- 172.21.15.144:0/2978137013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc030020 con 0x556fff472d40 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978137013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4fc01b050 con 0x556fff472d40 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 1 -- 172.21.15.144:0/2978137013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd4fc020cf0 con 0x556fff472d40 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 1 -- 172.21.15.144:0/2978137013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd4fc03a050 con 0x556fff472d40 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 10 client.5565 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978137013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x556fff266b40 con 0x556fff472d40 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 1 -- 172.21.15.144:0/2978137013 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc01b050 con 0x556fff472d40 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 1 -- 172.21.15.144:0/2978137013 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fd4fc03d020 con 0x556fff472d40 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 10 client.5565 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 10 client.5565 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 20 client.5565 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x556fff479150 0x556fff4cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 4 client.5565 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:46.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978137013 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fff25b020 con 0x556fff479150 2024-09-12T12:15:46.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd50be00640 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x556fff479150 0x556fff4cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd50be00640 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x556fff479150 0x556fff4cc370 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85a6b4507077a568 server_cookie=fc29b3c3bb0f1773 in_seq=0 out_seq=0 2024-09-12T12:15:46.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 10 client.5565 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 1 -- 172.21.15.144:0/2978137013 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556fff25b020 con 0x556fff479150 2024-09-12T12:15:46.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 10 client.5565 handle_command_reply: tid=0 2024-09-12T12:15:46.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 client.5565 shutdown 2024-09-12T12:15:46.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978137013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff472d40 msgr2=0x556fff477930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff472d40 0x556fff477930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc023040 tx=0x7fd4fc001130 comp rx=0 tx=0).stop 2024-09-12T12:15:46.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978137013 shutdown_connections 2024-09-12T12:15:46.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x556fff479150 0x556fff4cc370 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff4783b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 0x556fff477e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd4f6000640 0 client.5565 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 --2- 172.21.15.144:0/2978137013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff472d40 0x556fff477930 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978137013 >> 172.21.15.144:0/2978137013 conn(0x556fff469ba0 msgr2=0x556fff4717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978137013 shutdown_connections 2024-09-12T12:15:46.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 1 -- 172.21.15.144:0/2978137013 wait complete. 2024-09-12T12:15:46.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.927+0000 7fd5168e6000 20 client.5565 trim_cache size 0 max 16384 2024-09-12T12:15:46.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd5168e6000 1 Processor -- start 2024-09-12T12:15:46.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd5168e6000 1 -- start start 2024-09-12T12:15:46.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 0x556fff529e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff52a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff52a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd5168e6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c2048d0 con 0x556fff4bb2d0 2024-09-12T12:15:46.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd5168e6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c203970 con 0x556fff4bbbf0 2024-09-12T12:15:46.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd5168e6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c0719e0 con 0x556fff472d40 2024-09-12T12:15:46.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd50be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff52a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd50be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff52a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53320/0 (socket says 172.21.15.144:53320) 2024-09-12T12:15:46.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.943+0000 7fd50be00640 1 -- 172.21.15.144:0/341737028 learned_addr learned my addr 172.21.15.144:0/341737028 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd510a00640 1 --2- 172.21.15.144:0/341737028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 0x556fff529e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd511400640 1 --2- 172.21.15.144:0/341737028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff52a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd50be00640 1 -- 172.21.15.144:0/341737028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 msgr2=0x556fff529e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd50be00640 1 --2- 172.21.15.144:0/341737028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 0x556fff529e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd50be00640 1 -- 172.21.15.144:0/341737028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 msgr2=0x556fff52a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd50be00640 1 --2- 172.21.15.144:0/341737028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff52a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd50be00640 1 -- 172.21.15.144:0/341737028 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fff4bb100 con 0x556fff4bb2d0 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd50be00640 1 --2- 172.21.15.144:0/341737028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff52a3c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80eba60 tx=0x7fd4f811d510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a708094e651894b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd500c00640 1 -- 172.21.15.144:0/341737028 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f810de60 con 0x556fff4bb2d0 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd500c00640 1 -- 172.21.15.144:0/341737028 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f80a9040 con 0x556fff4bb2d0 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd500c00640 1 -- 172.21.15.144:0/341737028 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80ed900 con 0x556fff4bb2d0 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 -- 172.21.15.144:0/341737028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 msgr2=0x556fff52a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 --2- 172.21.15.144:0/341737028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff52a3c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80eba60 tx=0x7fd4f811d510 comp rx=0 tx=0).stop 2024-09-12T12:15:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 -- 172.21.15.144:0/341737028 shutdown_connections 2024-09-12T12:15:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 --2- 172.21.15.144:0/341737028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff4bbbf0 0x556fff52a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 --2- 172.21.15.144:0/341737028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bb2d0 0x556fff52a3c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 --2- 172.21.15.144:0/341737028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff472d40 0x556fff529e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 -- 172.21.15.144:0/341737028 >> 172.21.15.144:0/341737028 conn(0x556fff469ba0 msgr2=0x556fff474a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 -- 172.21.15.144:0/341737028 shutdown_connections 2024-09-12T12:15:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 -- 172.21.15.144:0/341737028 wait complete. 2024-09-12T12:15:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 -- start start 2024-09-12T12:15:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 Processor -- start 2024-09-12T12:15:46.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff472d40 0x556fff52eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 0x556fff52eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bbbf0 0x556fff4e96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556fff37d330 con 0x556fff4bbbf0 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c072030 con 0x556fff472d40 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x556fff47be80 con 0x556fff4bb2d0 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd5168e6000 10 client.0 _ll_register_callbacks cb 0x7fd4fc023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd511400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bbbf0 0x556fff4e96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd511400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bbbf0 0x556fff4e96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53324/0 (socket says 172.21.15.144:53324) 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd511400640 1 -- 172.21.15.144:0/3514791751 learned_addr learned my addr 172.21.15.144:0/3514791751 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd510a00640 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff472d40 0x556fff52eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd50be00640 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 0x556fff52eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd511400640 1 -- 172.21.15.144:0/3514791751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 msgr2=0x556fff52eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd511400640 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 0x556fff52eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd511400640 1 -- 172.21.15.144:0/3514791751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff472d40 msgr2=0x556fff52eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd511400640 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff472d40 0x556fff52eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.947+0000 7fd511400640 1 -- 172.21.15.144:0/3514791751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fff4bba20 con 0x556fff4bbbf0 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd511400640 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bbbf0 0x556fff4e96a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd5040166b0 tx=0x7fd504016b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52531d44542db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd4f6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd4f6000640 1 -- 172.21.15.144:0/3514791751 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504006b60 con 0x556fff4bbbf0 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd4f6000640 1 -- 172.21.15.144:0/3514791751 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd504006d00 con 0x556fff4bbbf0 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 -- 172.21.15.144:0/3514791751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4f80a9040 con 0x556fff4bbbf0 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd4f6000640 1 -- 172.21.15.144:0/3514791751 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd504026050 con 0x556fff4bbbf0 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 10 client.5571 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 -- 172.21.15.144:0/3514791751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x556fff260a00 con 0x556fff4bbbf0 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd4f6000640 1 -- 172.21.15.144:0/3514791751 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f80a9040 con 0x556fff4bbbf0 2024-09-12T12:15:46.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd4f6000640 1 -- 172.21.15.144:0/3514791751 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fd504029020 con 0x556fff4bbbf0 2024-09-12T12:15:46.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 10 client.5571 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:46.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 10 client.5571 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:46.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 20 client.5571 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:46.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x556fff4e9be0 0x556fff4e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 4 client.5571 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-12T12:15:46.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 -- 172.21.15.144:0/3514791751 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x556fff29dcd0 con 0x556fff4e9be0 2024-09-12T12:15:46.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd510a00640 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x556fff4e9be0 0x556fff4e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd510a00640 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x556fff4e9be0 0x556fff4e9ff0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7374927806a77d5c server_cookie=97b866c3b7e667d4 in_seq=0 out_seq=0 2024-09-12T12:15:46.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd4f6000640 10 client.5571 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd4f6000640 1 -- 172.21.15.144:0/3514791751 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556fff29dcd0 con 0x556fff4e9be0 2024-09-12T12:15:46.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd4f6000640 10 client.5571 handle_command_reply: tid=0 2024-09-12T12:15:46.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 client.5571 shutdown 2024-09-12T12:15:46.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 -- 172.21.15.144:0/3514791751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bbbf0 msgr2=0x556fff4e96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bbbf0 0x556fff4e96a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd5040166b0 tx=0x7fd504016b70 comp rx=0 tx=0).stop 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 -- 172.21.15.144:0/3514791751 shutdown_connections 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x556fff4e9be0 0x556fff4e9ff0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.951+0000 7fd5168e6000 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556fff4bbbf0 0x556fff4e96a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd5168e6000 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556fff4bb2d0 0x556fff52eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd5168e6000 1 --2- 172.21.15.144:0/3514791751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556fff472d40 0x556fff52eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd5168e6000 1 -- 172.21.15.144:0/3514791751 >> 172.21.15.144:0/3514791751 conn(0x556fff469ba0 msgr2=0x556fff4cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd4f6000640 0 client.5571 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd5168e6000 1 -- 172.21.15.144:0/3514791751 shutdown_connections 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd5168e6000 1 -- 172.21.15.144:0/3514791751 wait complete. 2024-09-12T12:15:46.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd5168e6000 20 client.5571 trim_cache size 0 max 16384 2024-09-12T12:15:46.959 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:46.959 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:15:46.959 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:46.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 -- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4ec0678c0 msgr2=0x7fd4ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4ec0678c0 0x7fd4ec069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd50c1fb2d0 tx=0x7fd4fc009040 comp rx=0 tx=0).stop 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 -- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c15af60 msgr2=0x7fd50c159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c15af60 0x7fd50c159f70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80b0040 tx=0x7fd4f8019300 comp rx=0 tx=0).stop 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 -- 172.21.15.144:0/1782148816 shutdown_connections 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4ec0678c0 0x7fd4ec069d80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd50c15b340 0x7fd50c0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd50c15af60 0x7fd50c159f70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 --2- 172.21.15.144:0/1782148816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd50c0cd9f0 0x7fd50c141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 -- 172.21.15.144:0/1782148816 >> 172.21.15.144:0/1782148816 conn(0x7fd50c068030 msgr2=0x7fd50c075180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 -- 172.21.15.144:0/1782148816 shutdown_connections 2024-09-12T12:15:46.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:46.955+0000 7fd513400640 1 -- 172.21.15.144:0/1782148816 wait complete. 2024-09-12T12:15:46.974 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-12T12:15:46.975 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-12T12:15:46.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-12T12:15:47.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.111+0000 7fc6dea00640 1 Processor -- start 2024-09-12T12:15:47.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.111+0000 7fc6dea00640 1 -- start start 2024-09-12T12:15:47.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6dea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc6d815af60 0x7fc6d80ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6dea00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d80b4300 con 0x7fc6d806c320 2024-09-12T12:15:47.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6dea00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d80b3540 con 0x7fc6d80cd9f0 2024-09-12T12:15:47.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6dea00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc6d80b32f0 con 0x7fc6d815af60 2024-09-12T12:15:47.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6dca00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc6d806c320 0x7fc6d80b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53800/0 (socket says 172.21.15.144:53800) 2024-09-12T12:15:47.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6dca00640 1 -- 172.21.15.144:0/3134568074 learned_addr learned my addr 172.21.15.144:0/3134568074 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:47.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/3134568074 >> v2:172.21.15.165:3300/0 conn(0x7fc6d815af60 0x7fc6d80ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250751703 0 0) 0x7fc6d80b4300 con 0x7fc6d806c320 2024-09-12T12:15:47.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6bc003530 con 0x7fc6d806c320 2024-09-12T12:15:47.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2895569357 0 0) 0x7fc6bc003530 con 0x7fc6d806c320 2024-09-12T12:15:47.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 >> v2:172.21.15.165:3300/0 conn(0x7fc6d815af60 msgr2=0x7fc6d80ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 --2- 172.21.15.144:0/3134568074 >> v2:172.21.15.165:3300/0 conn(0x7fc6d815af60 0x7fc6d80ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 >> v1:172.21.15.165:6789/0 conn(0x7fc6d80cd9f0 legacy=0x7fc6d806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d80b3820 con 0x7fc6d806c320 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fc6d0001a00 con 0x7fc6d806c320 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 >> v1:172.21.15.144:6789/0 conn(0x7fc6d806c320 legacy=0x7fc6d80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6bc003a10 0x7fc6bc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6bc004810 0x7fc6bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6bc0051d0 0x7fc6bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80b32f0 con 0x7fc6bc004810 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc00c0d0 con 0x7fc6bc003a10 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc00c2d0 con 0x7fc6bc0051d0 2024-09-12T12:15:47.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d7400640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6bc004810 0x7fc6bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6bc003a10 0x7fc6bc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6dca00640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6bc0051d0 0x7fc6bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d7400640 1 -- 172.21.15.144:0/3134568074 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6bc0051d0 msgr2=0x7fc6bc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d7400640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6bc0051d0 0x7fc6bc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d7400640 1 -- 172.21.15.144:0/3134568074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6bc003a10 msgr2=0x7fc6bc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d7400640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6bc003a10 0x7fc6bc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6dca00640 1 -- 172.21.15.144:0/3134568074 reap_dead start 2024-09-12T12:15:47.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.115+0000 7fc6d7400640 1 -- 172.21.15.144:0/3134568074 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc003530 con 0x7fc6bc004810 2024-09-12T12:15:47.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6d7400640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6bc004810 0x7fc6bc004c90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4001360 tx=0x7fc6c401e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfd39106b69c4e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40013a0 con 0x7fc6bc004810 2024-09-12T12:15:47.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c40052a0 con 0x7fc6bc004810 2024-09-12T12:15:47.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6d6a00640 1 -- 172.21.15.144:0/3134568074 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4003600 con 0x7fc6bc004810 2024-09-12T12:15:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6dea00640 1 -- 172.21.15.144:0/3134568074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6bc004810 msgr2=0x7fc6bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6dea00640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6bc004810 0x7fc6bc004c90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4001360 tx=0x7fc6c401e5e0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6dea00640 1 -- 172.21.15.144:0/3134568074 shutdown_connections 2024-09-12T12:15:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6dea00640 1 --2- 172.21.15.144:0/3134568074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6bc004810 0x7fc6bc004c90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6dea00640 1 -- 172.21.15.144:0/3134568074 >> 172.21.15.144:0/3134568074 conn(0x7fc6d8068030 msgr2=0x7fc6d80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6dea00640 1 -- 172.21.15.144:0/3134568074 shutdown_connections 2024-09-12T12:15:47.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6dea00640 1 -- 172.21.15.144:0/3134568074 wait complete. 2024-09-12T12:15:47.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6dea00640 1 Processor -- start 2024-09-12T12:15:47.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.119+0000 7fc6dea00640 1 -- start start 2024-09-12T12:15:47.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6bc004810 0x7fc6d815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6d8151d20 0x7fc6d81536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6d814ff90 0x7fc6d8071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d815b340 con 0x7fc6d814ff90 2024-09-12T12:15:47.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dea00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80b3de0 con 0x7fc6d8151d20 2024-09-12T12:15:47.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dea00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d815b4c0 con 0x7fc6bc004810 2024-09-12T12:15:47.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6d814ff90 0x7fc6d8071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6d814ff90 0x7fc6d8071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40806/0 (socket says 172.21.15.144:40806) 2024-09-12T12:15:47.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dca00640 1 -- 172.21.15.144:0/1151036970 learned_addr learned my addr 172.21.15.144:0/1151036970 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6bc004810 0x7fc6d815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6d7400640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6d8151d20 0x7fc6d81536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dca00640 1 -- 172.21.15.144:0/1151036970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6bc004810 msgr2=0x7fc6d815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dca00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6bc004810 0x7fc6d815b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dca00640 1 -- 172.21.15.144:0/1151036970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6d8151d20 msgr2=0x7fc6d81536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dca00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6d8151d20 0x7fc6d81536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dca00640 1 -- 172.21.15.144:0/1151036970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d8153bf0 con 0x7fc6d814ff90 2024-09-12T12:15:47.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dca00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6d814ff90 0x7fc6d8071fc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80737d0 tx=0x7fc6d0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6cfe00640 1 -- 172.21.15.144:0/1151036970 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0010040 con 0x7fc6d814ff90 2024-09-12T12:15:47.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6cfe00640 1 -- 172.21.15.144:0/1151036970 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d001a070 con 0x7fc6d814ff90 2024-09-12T12:15:47.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6cfe00640 1 -- 172.21.15.144:0/1151036970 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d000fae0 con 0x7fc6d814ff90 2024-09-12T12:15:47.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dea00640 1 -- 172.21.15.144:0/1151036970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d8153e70 con 0x7fc6d814ff90 2024-09-12T12:15:47.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6dea00640 1 -- 172.21.15.144:0/1151036970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d8158650 con 0x7fc6d814ff90 2024-09-12T12:15:47.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.123+0000 7fc6cfe00640 1 -- 172.21.15.144:0/1151036970 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6d000fc80 con 0x7fc6d814ff90 2024-09-12T12:15:47.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6cfe00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6b80678f0 0x7fc6b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6cfe00640 1 -- 172.21.15.144:0/1151036970 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc6d0088cf0 con 0x7fc6d814ff90 2024-09-12T12:15:47.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6b80678f0 0x7fc6b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6e1e98000 1 Processor -- start 2024-09-12T12:15:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6e1e98000 1 -- start start 2024-09-12T12:15:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6b80678f0 0x7fc6b8069db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc6d806a780 tx=0x7fc6c8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0cd50 0x561c03e0d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03e0d670 0x561c03dc2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 0x561c03dc38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561c03caa540 con 0x561c03e0d670 2024-09-12T12:15:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561c03c10d70 con 0x561c03e0cd50 2024-09-12T12:15:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x561c03bcbb20 con 0x561c03dc3500 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03e0d670 0x561c03dc2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03e0d670 0x561c03dc2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40816/0 (socket says 172.21.15.144:40816) 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7400640 1 -- 172.21.15.144:0/3713954456 learned_addr learned my addr 172.21.15.144:0/3713954456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/3713954456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0cd50 0x561c03e0d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6dca00640 1 --2- 172.21.15.144:0/3713954456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 0x561c03dc38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7400640 1 -- 172.21.15.144:0/3713954456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 msgr2=0x561c03dc38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7400640 1 --2- 172.21.15.144:0/3713954456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 0x561c03dc38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7400640 1 -- 172.21.15.144:0/3713954456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0cd50 msgr2=0x561c03e0d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7400640 1 --2- 172.21.15.144:0/3713954456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0cd50 0x561c03e0d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7400640 1 -- 172.21.15.144:0/3713954456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c03c573b0 con 0x561c03e0d670 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6d7400640 1 --2- 172.21.15.144:0/3713954456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03e0d670 0x561c03dc2fc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4024b10 tx=0x7fc6c4001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcfdce2301e33ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6ccc00640 1 -- 172.21.15.144:0/3713954456 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4005090 con 0x561c03e0d670 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6ccc00640 1 -- 172.21.15.144:0/3713954456 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c40b8020 con 0x561c03e0d670 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.127+0000 7fc6ccc00640 1 -- 172.21.15.144:0/3713954456 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4005430 con 0x561c03e0d670 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- 172.21.15.144:0/3713954456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03e0d670 msgr2=0x561c03dc2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/3713954456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03e0d670 0x561c03dc2fc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4024b10 tx=0x7fc6c4001130 comp rx=0 tx=0).stop 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- 172.21.15.144:0/3713954456 shutdown_connections 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/3713954456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 0x561c03dc38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/3713954456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03e0d670 0x561c03dc2fc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/3713954456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0cd50 0x561c03e0d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- 172.21.15.144:0/3713954456 >> 172.21.15.144:0/3713954456 conn(0x561c03dbf4b0 msgr2=0x561c03dc18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- 172.21.15.144:0/3713954456 shutdown_connections 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- 172.21.15.144:0/3713954456 wait complete. 2024-09-12T12:15:47.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- start start 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 Processor -- start 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dc3500 0x561c03dc8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03e0cd50 0x561c03dc86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0d670 0x561c03df9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561c03bb81d0 con 0x561c03dc3500 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561c03bca680 con 0x561c03e0d670 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x561c03bb6d60 con 0x561c03e0cd50 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 10 client.0 _ll_register_callbacks cb 0x561c03c72f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dc3500 0x561c03dc8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dc3500 0x561c03dc8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40830/0 (socket says 172.21.15.144:40830) 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7e00640 1 -- 172.21.15.144:0/2312288833 learned_addr learned my addr 172.21.15.144:0/2312288833 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6dca00640 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0d670 0x561c03df9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7400640 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03e0cd50 0x561c03dc86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7e00640 1 -- 172.21.15.144:0/2312288833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03e0cd50 msgr2=0x561c03dc86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03e0cd50 0x561c03dc86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7e00640 1 -- 172.21.15.144:0/2312288833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0d670 msgr2=0x561c03df9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0d670 0x561c03df9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7e00640 1 -- 172.21.15.144:0/2312288833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c03be3b90 con 0x561c03dc3500 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dc3500 0x561c03dc8160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8003690 tx=0x7fc6c80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a41f200d5e7da78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6c1600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6c1600640 1 -- 172.21.15.144:0/2312288833 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c801b070 con 0x561c03dc3500 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2312288833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c40b8020 con 0x561c03dc3500 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6c1600640 1 -- 172.21.15.144:0/2312288833 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc6c802dc80 con 0x561c03dc3500 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6c1600640 1 -- 172.21.15.144:0/2312288833 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc6c802de80 con 0x561c03dc3500 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 10 client.5583 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.131+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2312288833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x561c03bca8a0 con 0x561c03dc3500 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6c1600640 1 -- 172.21.15.144:0/2312288833 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c40b8020 con 0x561c03dc3500 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6c1600640 1 -- 172.21.15.144:0/2312288833 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc6c8034050 con 0x561c03dc3500 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 10 client.5583 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 10 client.5583 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 20 client.5583 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561c03e12ec0 0x561c03e132d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 4 client.5583 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2312288833 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c03baae40 con 0x561c03e12ec0 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6d7400640 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561c03e12ec0 0x561c03e132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6c1600640 10 client.5583 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6d7400640 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561c03e12ec0 0x561c03e132d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38855a3e13ba8d32 server_cookie=7b9dacb26af50a24 in_seq=0 out_seq=0 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6c1600640 1 -- 172.21.15.144:0/2312288833 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c03baae40 con 0x561c03e12ec0 2024-09-12T12:15:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6c1600640 10 client.5583 handle_command_reply: tid=0 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 client.5583 shutdown 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2312288833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dc3500 msgr2=0x561c03dc8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dc3500 0x561c03dc8160 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8003690 tx=0x7fc6c80046d0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2312288833 shutdown_connections 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561c03e12ec0 0x561c03e132d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03e0d670 0x561c03df9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03e0cd50 0x561c03dc86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6c1600640 0 client.5583 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2312288833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dc3500 0x561c03dc8160 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2312288833 >> 172.21.15.144:0/2312288833 conn(0x561c03dbf4b0 msgr2=0x561c03dc20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2312288833 shutdown_connections 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2312288833 wait complete. 2024-09-12T12:15:47.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.135+0000 7fc6e1e98000 20 client.5583 trim_cache size 0 max 16384 2024-09-12T12:15:47.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.151+0000 7fc6e1e98000 1 Processor -- start 2024-09-12T12:15:47.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.151+0000 7fc6e1e98000 1 -- start start 2024-09-12T12:15:47.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03df9fd0 0x561c03e23450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dbf4b0 0x561c03e23990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dc3500 0x561c03e0bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d82007d0 con 0x561c03dbf4b0 2024-09-12T12:15:47.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81581f0 con 0x561c03dc3500 2024-09-12T12:15:47.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d8200180 con 0x561c03df9fd0 2024-09-12T12:15:47.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dbf4b0 0x561c03e23990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dbf4b0 0x561c03e23990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40838/0 (socket says 172.21.15.144:40838) 2024-09-12T12:15:47.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7400640 1 -- 172.21.15.144:0/2337466954 learned_addr learned my addr 172.21.15.144:0/2337466954 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6dca00640 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dc3500 0x561c03e0bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03df9fd0 0x561c03e23450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7400640 1 -- 172.21.15.144:0/2337466954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03df9fd0 msgr2=0x561c03e23450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7400640 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03df9fd0 0x561c03e23450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7400640 1 -- 172.21.15.144:0/2337466954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dc3500 msgr2=0x561c03e0bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7400640 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dc3500 0x561c03e0bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7400640 1 -- 172.21.15.144:0/2337466954 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c03bb0820 con 0x561c03dbf4b0 2024-09-12T12:15:47.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03df9fd0 0x561c03e23450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:47.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6d7400640 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dbf4b0 0x561c03e23990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4024b10 tx=0x7fc6c40a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e259cb3d64301f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6c3e00640 1 -- 172.21.15.144:0/2337466954 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40067e0 con 0x561c03dbf4b0 2024-09-12T12:15:47.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6c3e00640 1 -- 172.21.15.144:0/2337466954 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c40b8040 con 0x561c03dbf4b0 2024-09-12T12:15:47.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6c3e00640 1 -- 172.21.15.144:0/2337466954 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4006b80 con 0x561c03dbf4b0 2024-09-12T12:15:47.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2337466954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dbf4b0 msgr2=0x561c03e23990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dbf4b0 0x561c03e23990 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4024b10 tx=0x7fc6c40a9000 comp rx=0 tx=0).stop 2024-09-12T12:15:47.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2337466954 shutdown_connections 2024-09-12T12:15:47.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dc3500 0x561c03e0bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03dbf4b0 0x561c03e23990 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2337466954 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03df9fd0 0x561c03e23450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2337466954 >> 172.21.15.144:0/2337466954 conn(0x561c03e126c0 msgr2=0x561c03dc2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2337466954 shutdown_connections 2024-09-12T12:15:47.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2337466954 wait complete. 2024-09-12T12:15:47.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 -- start start 2024-09-12T12:15:47.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.155+0000 7fc6e1e98000 1 Processor -- start 2024-09-12T12:15:47.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dbf4b0 0x561c03e88c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 0x561c03e89170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03df9fd0 0x561c03e142f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561c03c153a0 con 0x561c03df9fd0 2024-09-12T12:15:47.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561c03c10080 con 0x561c03dbf4b0 2024-09-12T12:15:47.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x561c03bc7f10 con 0x561c03dc3500 2024-09-12T12:15:47.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 10 client.0 _ll_register_callbacks cb 0x7fc6c8014b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:47.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6d7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dbf4b0 0x561c03e88c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03df9fd0 0x561c03e142f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03df9fd0 0x561c03e142f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40854/0 (socket says 172.21.15.144:40854) 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6dca00640 1 -- 172.21.15.144:0/2928697351 learned_addr learned my addr 172.21.15.144:0/2928697351 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6d7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dbf4b0 0x561c03e88c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:59098/0 (socket says 172.21.15.144:59098) 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6d7400640 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 0x561c03e89170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6dca00640 1 -- 172.21.15.144:0/2928697351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 msgr2=0x561c03e89170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6dca00640 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 0x561c03e89170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6dca00640 1 -- 172.21.15.144:0/2928697351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dbf4b0 msgr2=0x561c03e88c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6dca00640 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dbf4b0 0x561c03e88c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6dca00640 1 -- 172.21.15.144:0/2928697351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c03c93530 con 0x561c03df9fd0 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6dca00640 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03df9fd0 0x561c03e142f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00553f0 tx=0x7fc6d00597e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87caab87765e4280 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 1 -- 172.21.15.144:0/2928697351 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00585e0 con 0x561c03df9fd0 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 1 -- 172.21.15.144:0/2928697351 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc6d0054ce0 con 0x561c03df9fd0 2024-09-12T12:15:47.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2928697351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c40b8040 con 0x561c03df9fd0 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 1 -- 172.21.15.144:0/2928697351 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc6d0054ee0 con 0x561c03df9fd0 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 10 client.5589 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2928697351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x561c03ba8420 con 0x561c03df9fd0 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 1 -- 172.21.15.144:0/2928697351 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c40b8040 con 0x561c03df9fd0 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 1 -- 172.21.15.144:0/2928697351 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fc6d0057e50 con 0x561c03df9fd0 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 10 client.5589 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 10 client.5589 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 20 client.5589 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561c03e0cd50 0x561c03e14830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 4 client.5589 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2928697351 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x561c03c1e4a0 con 0x561c03e0cd50 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561c03e0cd50 0x561c03e14830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6d7e00640 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561c03e0cd50 0x561c03e14830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ae5099a7a1f3366 server_cookie=6b7ba54c5755a41c in_seq=0 out_seq=0 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 10 client.5589 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 1 -- 172.21.15.144:0/2928697351 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561c03c1e4a0 con 0x561c03e0cd50 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 10 client.5589 handle_command_reply: tid=0 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 client.5589 shutdown 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2928697351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03df9fd0 msgr2=0x561c03e142f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03df9fd0 0x561c03e142f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00553f0 tx=0x7fc6d00597e0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2928697351 shutdown_connections 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x561c03e0cd50 0x561c03e14830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c03df9fd0 0x561c03e142f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x561c03dc3500 0x561c03e89170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 --2- 172.21.15.144:0/2928697351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561c03dbf4b0 0x561c03e88c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2928697351 >> 172.21.15.144:0/2928697351 conn(0x561c03e126c0 msgr2=0x561c03e22440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6c1600640 0 client.5589 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2928697351 shutdown_connections 2024-09-12T12:15:47.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 1 -- 172.21.15.144:0/2928697351 wait complete. 2024-09-12T12:15:47.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.159+0000 7fc6e1e98000 20 client.5589 trim_cache size 0 max 16384 2024-09-12T12:15:47.175 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:15:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "f57a67fd-ce27-4c75-be87-b9df97e6788d", 2024-09-12T12:15:47.175 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:15:47.176 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:47.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 -- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6b80678f0 msgr2=0x7fc6b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6b80678f0 0x7fc6b8069db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc6d806a780 tx=0x7fc6c8009190 comp rx=0 tx=0).stop 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 -- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6d814ff90 msgr2=0x7fc6d8071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6d814ff90 0x7fc6d8071fc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80737d0 tx=0x7fc6d0011b60 comp rx=0 tx=0).stop 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 -- 172.21.15.144:0/1151036970 shutdown_connections 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6b80678f0 0x7fc6b8069db0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6d814ff90 0x7fc6d8071fc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6d8151d20 0x7fc6d81536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 --2- 172.21.15.144:0/1151036970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6bc004810 0x7fc6d815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 -- 172.21.15.144:0/1151036970 >> 172.21.15.144:0/1151036970 conn(0x7fc6d8068030 msgr2=0x7fc6d80b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 -- 172.21.15.144:0/1151036970 shutdown_connections 2024-09-12T12:15:47.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.163+0000 7fc6dea00640 1 -- 172.21.15.144:0/1151036970 wait complete. 2024-09-12T12:15:47.184 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'f57a67fd-ce27-4c75-be87-b9df97e6788d', 'mode': 'asynchronous'}' 2024-09-12T12:15:47.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:47.184 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-09-12T12:15:47.195 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-09-12T12:15:47.196 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-09-12T12:15:47.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.379+0000 7ffb3ba00640 1 Processor -- start 2024-09-12T12:15:47.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.379+0000 7ffb3ba00640 1 -- start start 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb3ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb340cd9f0 0x7ffb3406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb3ba00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffb3415b340 0x7ffb3406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb3ba00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb340b4300 con 0x7ffb3415af60 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb3ba00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffb340b32f0 con 0x7ffb3415b340 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb3ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb340b3540 con 0x7ffb340cd9f0 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb39000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ffb3415af60 0x7ffb340ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53806/0 (socket says 172.21.15.144:53806) 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb39000640 1 -- 172.21.15.144:0/1218507622 learned_addr learned my addr 172.21.15.144:0/1218507622 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb39a00640 1 --2- 172.21.15.144:0/1218507622 >> v2:172.21.15.144:3300/0 conn(0x7ffb3415b340 0x7ffb3406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb33e00640 1 --2- 172.21.15.144:0/1218507622 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb340cd9f0 0x7ffb3406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb39a00640 1 -- 172.21.15.144:0/1218507622 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb340cd9f0 msgr2=0x7ffb3406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb39a00640 1 --2- 172.21.15.144:0/1218507622 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb340cd9f0 0x7ffb3406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb39a00640 1 -- 172.21.15.144:0/1218507622 >> v1:172.21.15.144:6789/0 conn(0x7ffb3415af60 legacy=0x7ffb340ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb39a00640 1 -- 172.21.15.144:0/1218507622 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb340b3820 con 0x7ffb3415b340 2024-09-12T12:15:47.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb39a00640 1 --2- 172.21.15.144:0/1218507622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb3415b340 0x7ffb3406c150 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0097c0 tx=0x7ffb2c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da463eed0a9e8cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.383+0000 7ffb33400640 1 -- 172.21.15.144:0/1218507622 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0b0070 con 0x7ffb3415b340 2024-09-12T12:15:47.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb33400640 1 -- 172.21.15.144:0/1218507622 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0ab600 con 0x7ffb3415b340 2024-09-12T12:15:47.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb33400640 1 -- 172.21.15.144:0/1218507622 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0ab9d0 con 0x7ffb3415b340 2024-09-12T12:15:47.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1218507622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb3415b340 msgr2=0x7ffb3406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 --2- 172.21.15.144:0/1218507622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb3415b340 0x7ffb3406c150 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0097c0 tx=0x7ffb2c01c3c0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1218507622 shutdown_connections 2024-09-12T12:15:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 --2- 172.21.15.144:0/1218507622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb3415b340 0x7ffb3406c150 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 --2- 172.21.15.144:0/1218507622 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb340cd9f0 0x7ffb3406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1218507622 >> 172.21.15.144:0/1218507622 conn(0x7ffb34068030 msgr2=0x7ffb340b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1218507622 shutdown_connections 2024-09-12T12:15:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1218507622 wait complete. 2024-09-12T12:15:47.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 Processor -- start 2024-09-12T12:15:47.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 -- start start 2024-09-12T12:15:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb340cd9f0 0x7ffb3414b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb3415af60 0x7ffb340ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb3415b340 0x7ffb340aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb340b4560 con 0x7ffb340cd9f0 2024-09-12T12:15:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffb340b3de0 con 0x7ffb3415af60 2024-09-12T12:15:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb3ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb340b46e0 con 0x7ffb3415b340 2024-09-12T12:15:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb39000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb340cd9f0 0x7ffb3414b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb39000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb340cd9f0 0x7ffb3414b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40874/0 (socket says 172.21.15.144:40874) 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb39000640 1 -- 172.21.15.144:0/1112323217 learned_addr learned my addr 172.21.15.144:0/1112323217 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb33e00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb3415af60 0x7ffb340ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb39a00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb3415b340 0x7ffb340aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb39000640 1 -- 172.21.15.144:0/1112323217 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb3415b340 msgr2=0x7ffb340aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb39000640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb3415b340 0x7ffb340aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.387+0000 7ffb39000640 1 -- 172.21.15.144:0/1112323217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb3415af60 msgr2=0x7ffb340ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb39000640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb3415af60 0x7ffb340ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb39000640 1 -- 172.21.15.144:0/1112323217 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb34158920 con 0x7ffb340cd9f0 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb33e00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb3415af60 0x7ffb340ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb39000640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb340cd9f0 0x7ffb3414b2b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400e7b0 tx=0x7ffb2400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb30c00640 1 -- 172.21.15.144:0/1112323217 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400f930 con 0x7ffb340cd9f0 2024-09-12T12:15:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb30c00640 1 -- 172.21.15.144:0/1112323217 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb24013070 con 0x7ffb340cd9f0 2024-09-12T12:15:47.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1112323217 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb34158c00 con 0x7ffb340cd9f0 2024-09-12T12:15:47.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb30c00640 1 -- 172.21.15.144:0/1112323217 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400fcd0 con 0x7ffb340cd9f0 2024-09-12T12:15:47.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1112323217 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb341591c0 con 0x7ffb340cd9f0 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb30c00640 1 -- 172.21.15.144:0/1112323217 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb240213f0 con 0x7ffb340cd9f0 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb30c00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb140678c0 0x7ffb14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb30c00640 1 -- 172.21.15.144:0/1112323217 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ffb24088a30 con 0x7ffb340cd9f0 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb33e00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb140678c0 0x7ffb14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.391+0000 7ffb3ee1e000 1 Processor -- start 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- start start 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb33e00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb140678c0 0x7ffb14069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffb34158160 tx=0x7ffb20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa507a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 0x55ffa5030ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 0x55ffa50317e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ffa4f18a20 con 0x55ffa5079d40 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ffa4e7dba0 con 0x55ffa5031400 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ffa4e23bb0 con 0x55ffa507a660 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa507a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa507a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40878/0 (socket says 172.21.15.144:40878) 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39000640 1 -- 172.21.15.144:0/1934005441 learned_addr learned my addr 172.21.15.144:0/1934005441 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39a00640 1 --2- 172.21.15.144:0/1934005441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 0x55ffa50317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb33e00640 1 --2- 172.21.15.144:0/1934005441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 0x55ffa5030ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39000640 1 -- 172.21.15.144:0/1934005441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 msgr2=0x55ffa5030ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39000640 1 --2- 172.21.15.144:0/1934005441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 0x55ffa5030ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39000640 1 -- 172.21.15.144:0/1934005441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 msgr2=0x55ffa50317e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39000640 1 --2- 172.21.15.144:0/1934005441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 0x55ffa50317e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39000640 1 -- 172.21.15.144:0/1934005441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffa4ec4ee0 con 0x55ffa5079d40 2024-09-12T12:15:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb39000640 1 --2- 172.21.15.144:0/1934005441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa507a120 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffb240612f0 tx=0x7ffb24058b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2504b13d9a0e5d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb29600640 1 -- 172.21.15.144:0/1934005441 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24061820 con 0x55ffa5079d40 2024-09-12T12:15:47.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb29600640 1 -- 172.21.15.144:0/1934005441 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2405f050 con 0x55ffa5079d40 2024-09-12T12:15:47.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb29600640 1 -- 172.21.15.144:0/1934005441 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24056f40 con 0x55ffa5079d40 2024-09-12T12:15:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1934005441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 msgr2=0x55ffa507a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/1934005441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa507a120 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffb240612f0 tx=0x7ffb24058b40 comp rx=0 tx=0).stop 2024-09-12T12:15:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1934005441 shutdown_connections 2024-09-12T12:15:47.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/1934005441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 0x55ffa50317e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/1934005441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 0x55ffa5030ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/1934005441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa507a120 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1934005441 >> 172.21.15.144:0/1934005441 conn(0x55ffa502d3b0 msgr2=0x55ffa502f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1934005441 shutdown_connections 2024-09-12T12:15:47.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1934005441 wait complete. 2024-09-12T12:15:47.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 -- start start 2024-09-12T12:15:47.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.395+0000 7ffb3ee1e000 1 Processor -- start 2024-09-12T12:15:47.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 0x55ffa503b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5079d40 0x55ffa503ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa507a660 0x55ffa503bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ffa4e17d20 con 0x55ffa507a660 2024-09-12T12:15:47.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ffa4e79b60 con 0x55ffa5031400 2024-09-12T12:15:47.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ffa4e821d0 con 0x55ffa5079d40 2024-09-12T12:15:47.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 10 client.0 _ll_register_callbacks cb 0x55ffa4ee1120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:47.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa507a660 0x55ffa503bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 0x55ffa503b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa507a660 0x55ffa503bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40884/0 (socket says 172.21.15.144:40884) 2024-09-12T12:15:47.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39a00640 1 -- 172.21.15.144:0/3903479104 learned_addr learned my addr 172.21.15.144:0/3903479104 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb33e00640 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5079d40 0x55ffa503ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39000640 1 -- 172.21.15.144:0/3903479104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5079d40 msgr2=0x55ffa503ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39000640 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5079d40 0x55ffa503ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39000640 1 -- 172.21.15.144:0/3903479104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa507a660 msgr2=0x55ffa503bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39000640 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa507a660 0x55ffa503bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39000640 1 -- 172.21.15.144:0/3903479104 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffa4e58e20 con 0x55ffa5031400 2024-09-12T12:15:47.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39a00640 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa507a660 0x55ffa503bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:47.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb33e00640 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5079d40 0x55ffa503ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:47.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb39000640 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 0x55ffa503b540 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb24058bd0 tx=0x7ffb24000f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=302bb41649ca46b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb1e000640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:15:47.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb1e000640 1 -- 172.21.15.144:0/3903479104 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24061820 con 0x55ffa5031400 2024-09-12T12:15:47.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb1e000640 1 -- 172.21.15.144:0/3903479104 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ffb24078d90 con 0x55ffa5031400 2024-09-12T12:15:47.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/3903479104 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb2405f050 con 0x55ffa5031400 2024-09-12T12:15:47.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb1e000640 1 -- 172.21.15.144:0/3903479104 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffb240803d0 con 0x55ffa5031400 2024-09-12T12:15:47.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 10 client.5494 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:47.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/3903479104 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ffa4e509c0 con 0x55ffa5031400 2024-09-12T12:15:47.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb1e000640 1 -- 172.21.15.144:0/3903479104 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2405f050 con 0x55ffa5031400 2024-09-12T12:15:47.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb1e000640 1 -- 172.21.15.144:0/3903479104 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7ffb24020030 con 0x55ffa5031400 2024-09-12T12:15:47.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 10 client.5494 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:47.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 10 client.5494 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:47.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 20 client.5494 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:47.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ffa5088dd0 0x55ffa508b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 4 client.5494 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:47.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/3903479104 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffa4e181e0 con 0x55ffa5088dd0 2024-09-12T12:15:47.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb33e00640 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ffa5088dd0 0x55ffa508b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb33e00640 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ffa5088dd0 0x55ffa508b1c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f9f9e54b22a5a32 server_cookie=8b902bd91e1f126d in_seq=0 out_seq=0 2024-09-12T12:15:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.399+0000 7ffb1e000640 10 client.5494 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb1e000640 1 -- 172.21.15.144:0/3903479104 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffa4e181e0 con 0x55ffa5088dd0 2024-09-12T12:15:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb1e000640 10 client.5494 handle_command_reply: tid=0 2024-09-12T12:15:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 client.5494 shutdown 2024-09-12T12:15:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/3903479104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 msgr2=0x55ffa503b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 0x55ffa503b540 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb24058bd0 tx=0x7ffb24000f50 comp rx=0 tx=0).stop 2024-09-12T12:15:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/3903479104 shutdown_connections 2024-09-12T12:15:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ffa5088dd0 0x55ffa508b1c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa507a660 0x55ffa503bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb1e000640 0 client.5494 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5079d40 0x55ffa503ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/3903479104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5031400 0x55ffa503b540 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/3903479104 >> 172.21.15.144:0/3903479104 conn(0x55ffa502d3b0 msgr2=0x55ffa502ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/3903479104 shutdown_connections 2024-09-12T12:15:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/3903479104 wait complete. 2024-09-12T12:15:47.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.403+0000 7ffb3ee1e000 20 client.5494 trim_cache size 0 max 16384 2024-09-12T12:15:47.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 Processor -- start 2024-09-12T12:15:47.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 -- start start 2024-09-12T12:15:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5031400 0x55ffa508e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5079d40 0x55ffa5036400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 0x55ffa5036940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb342012f0 con 0x55ffa5031400 2024-09-12T12:15:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffb342003c0 con 0x55ffa5079d40 2024-09-12T12:15:47.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb3415de10 con 0x55ffa507a660 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5031400 0x55ffa508e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5031400 0x55ffa508e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40888/0 (socket says 172.21.15.144:40888) 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39000640 1 -- 172.21.15.144:0/1129292249 learned_addr learned my addr 172.21.15.144:0/1129292249 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb33e00640 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5079d40 0x55ffa5036400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39a00640 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 0x55ffa5036940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39000640 1 -- 172.21.15.144:0/1129292249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 msgr2=0x55ffa5036940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39000640 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 0x55ffa5036940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39000640 1 -- 172.21.15.144:0/1129292249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5079d40 msgr2=0x55ffa5036400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39000640 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5079d40 0x55ffa5036400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39000640 1 -- 172.21.15.144:0/1129292249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffa507a490 con 0x55ffa5031400 2024-09-12T12:15:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb33e00640 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5079d40 0x55ffa5036400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb39000640 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5031400 0x55ffa508e820 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400ce30 tx=0x7ffb24072070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e99d9223295dced server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb28c00640 1 -- 172.21.15.144:0/1129292249 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004b70 con 0x55ffa5031400 2024-09-12T12:15:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb28c00640 1 -- 172.21.15.144:0/1129292249 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2405f050 con 0x55ffa5031400 2024-09-12T12:15:47.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb28c00640 1 -- 172.21.15.144:0/1129292249 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004d50 con 0x55ffa5031400 2024-09-12T12:15:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1129292249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5031400 msgr2=0x55ffa508e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5031400 0x55ffa508e820 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400ce30 tx=0x7ffb24072070 comp rx=0 tx=0).stop 2024-09-12T12:15:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1129292249 shutdown_connections 2024-09-12T12:15:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa507a660 0x55ffa5036940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa5079d40 0x55ffa5036400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/1129292249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5031400 0x55ffa508e820 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1129292249 >> 172.21.15.144:0/1129292249 conn(0x55ffa502d3b0 msgr2=0x55ffa5030630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1129292249 shutdown_connections 2024-09-12T12:15:47.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.419+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/1129292249 wait complete. 2024-09-12T12:15:47.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 -- start start 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 Processor -- start 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5031400 0x55ffa508e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa50a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa507a660 0x55ffa50a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3415e460 con 0x55ffa5079d40 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ffa4e5a150 con 0x55ffa507a660 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ffa4e25440 con 0x55ffa5031400 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 10 client.0 _ll_register_callbacks cb 0x7ffb2c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb33e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa50a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb33e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa50a94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40900/0 (socket says 172.21.15.144:40900) 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb33e00640 1 -- 172.21.15.144:0/2462708577 learned_addr learned my addr 172.21.15.144:0/2462708577 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb39000640 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5031400 0x55ffa508e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb39a00640 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa507a660 0x55ffa50a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb33e00640 1 -- 172.21.15.144:0/2462708577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5031400 msgr2=0x55ffa508e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb33e00640 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5031400 0x55ffa508e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb33e00640 1 -- 172.21.15.144:0/2462708577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa507a660 msgr2=0x55ffa50a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb33e00640 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa507a660 0x55ffa50a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb33e00640 1 -- 172.21.15.144:0/2462708577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffa4e23e00 con 0x55ffa5079d40 2024-09-12T12:15:47.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb33e00640 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa50a94b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ffb34072250 tx=0x7ffb20004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855e5c79d69b3bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb1e000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:47.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb1e000640 1 -- 172.21.15.144:0/2462708577 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2002f070 con 0x55ffa5079d40 2024-09-12T12:15:47.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb1e000640 1 -- 172.21.15.144:0/2462708577 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7ffb20023850 con 0x55ffa5079d40 2024-09-12T12:15:47.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/2462708577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb2405f050 con 0x55ffa5079d40 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb1e000640 1 -- 172.21.15.144:0/2462708577 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffb20036050 con 0x55ffa5079d40 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 10 client.5610 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/2462708577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55ffa4e11ce0 con 0x55ffa5079d40 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb1e000640 1 -- 172.21.15.144:0/2462708577 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2405f050 con 0x55ffa5079d40 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb1e000640 1 -- 172.21.15.144:0/2462708577 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7ffb20039020 con 0x55ffa5079d40 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 10 client.5610 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 10 client.5610 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 20 client.5610 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ffa50a9f30 0x55ffa50ecd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 4 client.5610 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/2462708577 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x55ffa4e8b2d0 con 0x55ffa50a9f30 2024-09-12T12:15:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb39000640 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ffa50a9f30 0x55ffa50ecd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb39000640 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ffa50a9f30 0x55ffa50ecd00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a59a0d89b73f89 server_cookie=5ec13960c438a0d5 in_seq=0 out_seq=0 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.423+0000 7ffb1e000640 10 client.5610 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb1e000640 1 -- 172.21.15.144:0/2462708577 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffa4e8b2d0 con 0x55ffa50a9f30 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb1e000640 10 client.5610 handle_command_reply: tid=0 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 client.5610 shutdown 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/2462708577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 msgr2=0x55ffa50a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa50a94b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ffb34072250 tx=0x7ffb20004740 comp rx=0 tx=0).stop 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/2462708577 shutdown_connections 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ffa50a9f30 0x55ffa50ecd00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ffa507a660 0x55ffa50a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ffa5079d40 0x55ffa50a94b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb1e000640 0 client.5610 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 --2- 172.21.15.144:0/2462708577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ffa5031400 0x55ffa508e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/2462708577 >> 172.21.15.144:0/2462708577 conn(0x55ffa502d3b0 msgr2=0x55ffa50353f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/2462708577 shutdown_connections 2024-09-12T12:15:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 1 -- 172.21.15.144:0/2462708577 wait complete. 2024-09-12T12:15:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ee1e000 20 client.5610 trim_cache size 0 max 16384 2024-09-12T12:15:47.437 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:47.437 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:47.437 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:15:47.437 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:47.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb140678c0 msgr2=0x7ffb14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb140678c0 0x7ffb14069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffb34158160 tx=0x7ffb20008040 comp rx=0 tx=0).stop 2024-09-12T12:15:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb340cd9f0 msgr2=0x7ffb3414b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb340cd9f0 0x7ffb3414b2b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400e7b0 tx=0x7ffb2400ec70 comp rx=0 tx=0).stop 2024-09-12T12:15:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1112323217 shutdown_connections 2024-09-12T12:15:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb140678c0 0x7ffb14069d80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb3415b340 0x7ffb340aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb3415af60 0x7ffb340ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 --2- 172.21.15.144:0/1112323217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb340cd9f0 0x7ffb3414b2b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.427+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1112323217 >> 172.21.15.144:0/1112323217 conn(0x7ffb34068030 msgr2=0x7ffb34073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.431+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1112323217 shutdown_connections 2024-09-12T12:15:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.431+0000 7ffb3ba00640 1 -- 172.21.15.144:0/1112323217 wait complete. 2024-09-12T12:15:47.449 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-09-12T12:15:47.450 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:15:47.450 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:47.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:47.459 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-12T12:15:47.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:15:47.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:15:47.531 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169759 s, 61.8 MB/s 2024-09-12T12:15:47.532 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-12T12:15:47.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-12T12:15:47.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1109200640 1 Processor -- start 2024-09-12T12:15:47.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1109200640 1 -- start start 2024-09-12T12:15:47.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1109200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f11040b4b20 0x7f110415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1109200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f11040b4f00 0x7f1104162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1109200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b3970 0x7f11040b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1109200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f11040b3470 con 0x7f11040b4f00 2024-09-12T12:15:47.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1109200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f110415f270 con 0x7f11040b4b20 2024-09-12T12:15:47.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1109200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f110415f550 con 0x7f11040b3970 2024-09-12T12:15:47.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f10f9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f11040b4f00 0x7f1104162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f10f9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f11040b4f00 0x7f1104162950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40906/0 (socket says 172.21.15.144:40906) 2024-09-12T12:15:47.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f10f9400640 1 -- 172.21.15.144:0/2158723537 learned_addr learned my addr 172.21.15.144:0/2158723537 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1102800640 1 --2- 172.21.15.144:0/2158723537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b3970 0x7f11040b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f1101e00640 1 --2- 172.21.15.144:0/2158723537 >> v2:172.21.15.165:3300/0 conn(0x7f11040b4b20 0x7f110415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f10f9400640 1 -- 172.21.15.144:0/2158723537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b3970 msgr2=0x7f11040b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f10f9400640 1 --2- 172.21.15.144:0/2158723537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b3970 0x7f11040b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f10f9400640 1 -- 172.21.15.144:0/2158723537 >> v2:172.21.15.165:3300/0 conn(0x7f11040b4b20 msgr2=0x7f110415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f10f9400640 1 --2- 172.21.15.144:0/2158723537 >> v2:172.21.15.165:3300/0 conn(0x7f11040b4b20 0x7f110415eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.715+0000 7f10f9400640 1 -- 172.21.15.144:0/2158723537 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110415f830 con 0x7f11040b4f00 2024-09-12T12:15:47.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f10f9400640 1 --2- 172.21.15.144:0/2158723537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 0x7f1104162950 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f110406e190 tx=0x7f10ec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f34667d9599e526 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1101400640 1 -- 172.21.15.144:0/2158723537 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0b0070 con 0x7f11040b4f00 2024-09-12T12:15:47.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1101400640 1 -- 172.21.15.144:0/2158723537 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ec0ab600 con 0x7f11040b4f00 2024-09-12T12:15:47.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1101400640 1 -- 172.21.15.144:0/2158723537 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0ab9d0 con 0x7f11040b4f00 2024-09-12T12:15:47.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1109200640 1 -- 172.21.15.144:0/2158723537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 msgr2=0x7f1104162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1109200640 1 --2- 172.21.15.144:0/2158723537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 0x7f1104162950 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f110406e190 tx=0x7f10ec01c490 comp rx=0 tx=0).stop 2024-09-12T12:15:47.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1109200640 1 -- 172.21.15.144:0/2158723537 shutdown_connections 2024-09-12T12:15:47.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1109200640 1 --2- 172.21.15.144:0/2158723537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 0x7f1104162950 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1109200640 1 --2- 172.21.15.144:0/2158723537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b3970 0x7f11040b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1109200640 1 --2- 172.21.15.144:0/2158723537 >> v2:172.21.15.165:3300/0 conn(0x7f11040b4b20 0x7f110415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1109200640 1 -- 172.21.15.144:0/2158723537 >> 172.21.15.144:0/2158723537 conn(0x7f1104068030 msgr2=0x7f11040b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1109200640 1 -- 172.21.15.144:0/2158723537 shutdown_connections 2024-09-12T12:15:47.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.719+0000 7f1109200640 1 -- 172.21.15.144:0/2158723537 wait complete. 2024-09-12T12:15:47.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 Processor -- start 2024-09-12T12:15:47.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 -- start start 2024-09-12T12:15:47.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11040b3970 0x7f1104073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b4b20 0x7f11041fadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 0x7f1104140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f110406bfe0 con 0x7f11040b4f00 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f110406be60 con 0x7f11040b3970 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f110406c160 con 0x7f11040b4b20 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1102800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 0x7f1104140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10f9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b4b20 0x7f11041fadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1102800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 0x7f1104140630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40910/0 (socket says 172.21.15.144:40910) 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1102800640 1 -- 172.21.15.144:0/890660273 learned_addr learned my addr 172.21.15.144:0/890660273 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1101e00640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11040b3970 0x7f1104073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10f9400640 1 -- 172.21.15.144:0/890660273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11040b3970 msgr2=0x7f1104073580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10f9400640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11040b3970 0x7f1104073580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10f9400640 1 -- 172.21.15.144:0/890660273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 msgr2=0x7f1104140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10f9400640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 0x7f1104140630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10f9400640 1 -- 172.21.15.144:0/890660273 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11040b5810 con 0x7f11040b4b20 2024-09-12T12:15:47.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10f9400640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b4b20 0x7f11041fadf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0ab000 tx=0x7f10ec019230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10faa00640 1 -- 172.21.15.144:0/890660273 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0ba020 con 0x7f11040b4b20 2024-09-12T12:15:47.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10faa00640 1 -- 172.21.15.144:0/890660273 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ec0b6420 con 0x7f11040b4b20 2024-09-12T12:15:47.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f10faa00640 1 -- 172.21.15.144:0/890660273 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0b0040 con 0x7f11040b4b20 2024-09-12T12:15:47.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 -- 172.21.15.144:0/890660273 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1104072ae0 con 0x7f11040b4b20 2024-09-12T12:15:47.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.723+0000 7f1109200640 1 -- 172.21.15.144:0/890660273 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1104072000 con 0x7f11040b4b20 2024-09-12T12:15:47.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.727+0000 7f10faa00640 1 -- 172.21.15.144:0/890660273 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10ec0bd020 con 0x7f11040b4b20 2024-09-12T12:15:47.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.727+0000 7f10faa00640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10e00678c0 0x7f10e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.727+0000 7f10faa00640 1 -- 172.21.15.144:0/890660273 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f10ec11f950 con 0x7f11040b4b20 2024-09-12T12:15:47.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.727+0000 7f1101e00640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10e00678c0 0x7f10e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.727+0000 7f110c54b000 1 Processor -- start 2024-09-12T12:15:47.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.727+0000 7f110c54b000 1 -- start start 2024-09-12T12:15:47.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f1101e00640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10e00678c0 0x7f10e0069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1104073510 tx=0x7f10f400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ec3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871e71ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871e72400 0x55e871e727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e871d59a20 con 0x55e871ec3e70 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e871cbeba0 con 0x55e871ec3550 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55e871c64bb0 con 0x55e871e72400 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871e71ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f1101e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ec3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871e71ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40912/0 (socket says 172.21.15.144:40912) 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f1101e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ec3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:59194/0 (socket says 172.21.15.144:59194) 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f9400640 1 -- 172.21.15.144:0/2859521112 learned_addr learned my addr 172.21.15.144:0/2859521112 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f1102800640 1 --2- 172.21.15.144:0/2859521112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871e72400 0x55e871e727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f9400640 1 -- 172.21.15.144:0/2859521112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871e72400 msgr2=0x55e871e727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f9400640 1 --2- 172.21.15.144:0/2859521112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871e72400 0x55e871e727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f9400640 1 -- 172.21.15.144:0/2859521112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 msgr2=0x55e871ec3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f9400640 1 --2- 172.21.15.144:0/2859521112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ec3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f9400640 1 -- 172.21.15.144:0/2859521112 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e871d05ee0 con 0x55e871ec3e70 2024-09-12T12:15:47.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f1101e00640 1 --2- 172.21.15.144:0/2859521112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ec3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:47.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f9400640 1 --2- 172.21.15.144:0/2859521112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871e71ec0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0f83c0 tx=0x7f10ec0ec190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4cac28aa4693c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f2a00640 1 -- 172.21.15.144:0/2859521112 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec11c070 con 0x55e871ec3e70 2024-09-12T12:15:47.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f2a00640 1 -- 172.21.15.144:0/2859521112 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ec0ee0c0 con 0x55e871ec3e70 2024-09-12T12:15:47.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f10f2a00640 1 -- 172.21.15.144:0/2859521112 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0f8460 con 0x55e871ec3e70 2024-09-12T12:15:47.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 -- 172.21.15.144:0/2859521112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 msgr2=0x55e871e71ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 --2- 172.21.15.144:0/2859521112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871e71ec0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0f83c0 tx=0x7f10ec0ec190 comp rx=0 tx=0).stop 2024-09-12T12:15:47.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 -- 172.21.15.144:0/2859521112 shutdown_connections 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 --2- 172.21.15.144:0/2859521112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871e72400 0x55e871e727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 --2- 172.21.15.144:0/2859521112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871e71ec0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 --2- 172.21.15.144:0/2859521112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ec3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 -- 172.21.15.144:0/2859521112 >> 172.21.15.144:0/2859521112 conn(0x55e871e6e3b0 msgr2=0x55e871e707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 -- 172.21.15.144:0/2859521112 shutdown_connections 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 -- 172.21.15.144:0/2859521112 wait complete. 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 -- start start 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.731+0000 7f110c54b000 1 Processor -- start 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e84d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3550 0x55e871e85290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 0x55e871e857d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e871c58d20 con 0x55e871ec3550 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e871cbab60 con 0x55e871e72400 2024-09-12T12:15:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55e871cc31d0 con 0x55e871ec3e70 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 10 client.0 _ll_register_callbacks cb 0x55e871d22120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10f9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3550 0x55e871e85290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f1101e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e84d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10f9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3550 0x55e871e85290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40926/0 (socket says 172.21.15.144:40926) 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10f9400640 1 -- 172.21.15.144:0/1813767165 learned_addr learned my addr 172.21.15.144:0/1813767165 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f1102800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 0x55e871e857d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f1101e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e84d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:59206/0 (socket says 172.21.15.144:59206) 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f1101e00640 1 -- 172.21.15.144:0/1813767165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 msgr2=0x55e871e857d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f1101e00640 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 0x55e871e857d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f1101e00640 1 -- 172.21.15.144:0/1813767165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3550 msgr2=0x55e871e85290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f1101e00640 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3550 0x55e871e85290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f1101e00640 1 -- 172.21.15.144:0/1813767165 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e871c99e20 con 0x55e871e72400 2024-09-12T12:15:47.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f1101e00640 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e84d50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f10f4004720 tx=0x7f10f4004a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b91aae95a910046c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10e7400640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:15:47.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10e7400640 1 -- 172.21.15.144:0/1813767165 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f401d040 con 0x55e871e72400 2024-09-12T12:15:47.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10e7400640 1 -- 172.21.15.144:0/1813767165 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f10f4017640 con 0x55e871e72400 2024-09-12T12:15:47.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 -- 172.21.15.144:0/1813767165 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10ec0ee0c0 con 0x55e871e72400 2024-09-12T12:15:47.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10e7400640 1 -- 172.21.15.144:0/1813767165 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f10f4030050 con 0x55e871e72400 2024-09-12T12:15:47.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 10 client.5512 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:47.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 -- 172.21.15.144:0/1813767165 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e871c919c0 con 0x55e871e72400 2024-09-12T12:15:47.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10e7400640 1 -- 172.21.15.144:0/1813767165 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ec0ee0c0 con 0x55e871e72400 2024-09-12T12:15:47.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10e7400640 1 -- 172.21.15.144:0/1813767165 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f10f4033020 con 0x55e871e72400 2024-09-12T12:15:47.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 10 client.5512 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:47.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 10 client.5512 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:47.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 20 client.5512 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:47.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e871ed25e0 0x55e871ed49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 4 client.5512 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:47.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 -- 172.21.15.144:0/1813767165 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e871c591e0 con 0x55e871ed25e0 2024-09-12T12:15:47.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10f9400640 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e871ed25e0 0x55e871ed49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10f9400640 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e871ed25e0 0x55e871ed49d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cdb65d1dc86a66d server_cookie=d1b60c2346d9145d in_seq=0 out_seq=0 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10e7400640 10 client.5512 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10e7400640 1 -- 172.21.15.144:0/1813767165 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e871c591e0 con 0x55e871ed25e0 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f10e7400640 10 client.5512 handle_command_reply: tid=0 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.735+0000 7f110c54b000 1 client.5512 shutdown 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 -- 172.21.15.144:0/1813767165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 msgr2=0x55e871e84d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e84d50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f10f4004720 tx=0x7f10f4004a50 comp rx=0 tx=0).stop 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 -- 172.21.15.144:0/1813767165 shutdown_connections 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e871ed25e0 0x55e871ed49d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 0x55e871e857d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3550 0x55e871e85290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 --2- 172.21.15.144:0/1813767165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e84d50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f10e7400640 0 client.5512 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 -- 172.21.15.144:0/1813767165 >> 172.21.15.144:0/1813767165 conn(0x55e871e6e3b0 msgr2=0x55e871e70fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 -- 172.21.15.144:0/1813767165 shutdown_connections 2024-09-12T12:15:47.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 1 -- 172.21.15.144:0/1813767165 wait complete. 2024-09-12T12:15:47.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.739+0000 7f110c54b000 20 client.5512 trim_cache size 0 max 16384 2024-09-12T12:15:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.751+0000 7f110c54b000 1 Processor -- start 2024-09-12T12:15:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.751+0000 7f110c54b000 1 -- start start 2024-09-12T12:15:47.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e77b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3550 0x55e871ed49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871ed4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f11040ad770 con 0x55e871ec3e70 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f11040ac7b0 con 0x55e871e72400 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f11040abb10 con 0x55e871ec3550 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1102800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871ed4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1102800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871ed4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40934/0 (socket says 172.21.15.144:40934) 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1102800640 1 -- 172.21.15.144:0/1208958271 learned_addr learned my addr 172.21.15.144:0/1208958271 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1101e00640 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e77b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f10f9400640 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3550 0x55e871ed49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1102800640 1 -- 172.21.15.144:0/1208958271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3550 msgr2=0x55e871ed49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1102800640 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3550 0x55e871ed49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1102800640 1 -- 172.21.15.144:0/1208958271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 msgr2=0x55e871e77b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1102800640 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e77b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1102800640 1 -- 172.21.15.144:0/1208958271 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e871c64e00 con 0x55e871ec3e70 2024-09-12T12:15:47.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f10f9400640 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3550 0x55e871ed49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:47.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f1102800640 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871ed4f10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009e80 tx=0x7f10fc009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f85c685d142b931 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f10f2000640 1 -- 172.21.15.144:0/1208958271 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc023070 con 0x55e871ec3e70 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f10f2000640 1 -- 172.21.15.144:0/1208958271 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10fc015cf0 con 0x55e871ec3e70 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f10f2000640 1 -- 172.21.15.144:0/1208958271 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc01e410 con 0x55e871ec3e70 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- 172.21.15.144:0/1208958271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 msgr2=0x55e871ed4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871ed4f10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009e80 tx=0x7f10fc009f70 comp rx=0 tx=0).stop 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- 172.21.15.144:0/1208958271 shutdown_connections 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871ec3e70 0x55e871ed4f10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3550 0x55e871ed49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- 172.21.15.144:0/1208958271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871e72400 0x55e871e77b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- 172.21.15.144:0/1208958271 >> 172.21.15.144:0/1208958271 conn(0x55e871e6e3b0 msgr2=0x55e871e76430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- 172.21.15.144:0/1208958271 shutdown_connections 2024-09-12T12:15:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- 172.21.15.144:0/1208958271 wait complete. 2024-09-12T12:15:47.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- start start 2024-09-12T12:15:47.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 Processor -- start 2024-09-12T12:15:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871e72400 0x55e871ed7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ef2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 0x55e871ef3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e871c66440 con 0x55e871e72400 2024-09-12T12:15:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f11040ac160 con 0x55e871ec3550 2024-09-12T12:15:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55e871c849a0 con 0x55e871ec3e70 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.755+0000 7f110c54b000 10 client.0 _ll_register_callbacks cb 0x7f10f4003b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f1101e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871e72400 0x55e871ed7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f1101e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871e72400 0x55e871ed7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40944/0 (socket says 172.21.15.144:40944) 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f1101e00640 1 -- 172.21.15.144:0/1081861262 learned_addr learned my addr 172.21.15.144:0/1081861262 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f1102800640 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 0x55e871ef3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10f9400640 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ef2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10f9400640 1 -- 172.21.15.144:0/1081861262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 msgr2=0x55e871ef3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10f9400640 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 0x55e871ef3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10f9400640 1 -- 172.21.15.144:0/1081861262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871e72400 msgr2=0x55e871ed7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10f9400640 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871e72400 0x55e871ed7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10f9400640 1 -- 172.21.15.144:0/1081861262 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e871c52ce0 con 0x55e871ec3550 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f1101e00640 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871e72400 0x55e871ed7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10f9400640 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ef2cc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0eff80 tx=0x7f10ec01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4627b64e99fd4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10e7400640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10e7400640 1 -- 172.21.15.144:0/1081861262 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec100060 con 0x55e871ec3550 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10e7400640 1 -- 172.21.15.144:0/1081861262 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f10ec0f8460 con 0x55e871ec3550 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f110c54b000 1 -- 172.21.15.144:0/1081861262 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10fc015cf0 con 0x55e871ec3550 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10e7400640 1 -- 172.21.15.144:0/1081861262 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f10ec10e050 con 0x55e871ec3550 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f110c54b000 10 client.5518 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f110c54b000 1 -- 172.21.15.144:0/1081861262 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55e871c56c40 con 0x55e871ec3550 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10e7400640 1 -- 172.21.15.144:0/1081861262 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10fc015cf0 con 0x55e871ec3550 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10e7400640 1 -- 172.21.15.144:0/1081861262 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f10ec0b3030 con 0x55e871ec3550 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f110c54b000 10 client.5518 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f110c54b000 10 client.5518 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f110c54b000 20 client.5518 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f110c54b000 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e871ef3740 0x55e871f36300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f110c54b000 4 client.5518 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-12T12:15:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f110c54b000 1 -- 172.21.15.144:0/1081861262 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x55e871ccc2d0 con 0x55e871ef3740 2024-09-12T12:15:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f1101e00640 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e871ef3740 0x55e871f36300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f10e7400640 10 client.5518 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.759+0000 7f1101e00640 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e871ef3740 0x55e871f36300 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a101008e1043c1 server_cookie=669dcadbe86ce919 in_seq=0 out_seq=0 2024-09-12T12:15:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f10e7400640 1 -- 172.21.15.144:0/1081861262 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e871ccc2d0 con 0x55e871ef3740 2024-09-12T12:15:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f10e7400640 10 client.5518 handle_command_reply: tid=0 2024-09-12T12:15:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 client.5518 shutdown 2024-09-12T12:15:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 -- 172.21.15.144:0/1081861262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 msgr2=0x55e871ef2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ef2cc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0eff80 tx=0x7f10ec01c490 comp rx=0 tx=0).stop 2024-09-12T12:15:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 -- 172.21.15.144:0/1081861262 shutdown_connections 2024-09-12T12:15:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55e871ef3740 0x55e871f36300 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55e871ec3e70 0x55e871ef3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e871ec3550 0x55e871ef2cc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 --2- 172.21.15.144:0/1081861262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e871e72400 0x55e871ed7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f10e7400640 0 client.5518 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 -- 172.21.15.144:0/1081861262 >> 172.21.15.144:0/1081861262 conn(0x55e871e6e3b0 msgr2=0x55e871e71cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 -- 172.21.15.144:0/1081861262 shutdown_connections 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 1 -- 172.21.15.144:0/1081861262 wait complete. 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.763+0000 7f110c54b000 20 client.5518 trim_cache size 0 max 16384 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:15:47.768 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:47.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 -- 172.21.15.144:0/890660273 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10e00678c0 msgr2=0x7f10e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10e00678c0 0x7f10e0069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1104073510 tx=0x7f10f400b040 comp rx=0 tx=0).stop 2024-09-12T12:15:47.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 -- 172.21.15.144:0/890660273 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b4b20 msgr2=0x7f11041fadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b4b20 0x7f11041fadf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0ab000 tx=0x7f10ec019230 comp rx=0 tx=0).stop 2024-09-12T12:15:47.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 -- 172.21.15.144:0/890660273 shutdown_connections 2024-09-12T12:15:47.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10e00678c0 0x7f10e0069d80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11040b4f00 0x7f1104140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11040b4b20 0x7f11041fadf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 --2- 172.21.15.144:0/890660273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11040b3970 0x7f1104073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 -- 172.21.15.144:0/890660273 >> 172.21.15.144:0/890660273 conn(0x7f1104068030 msgr2=0x7f11040d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 -- 172.21.15.144:0/890660273 shutdown_connections 2024-09-12T12:15:47.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47.767+0000 7f1109200640 1 -- 172.21.15.144:0/890660273 wait complete. 2024-09-12T12:15:47.786 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-09-12T12:15:47.787 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:15:47.787 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:15:47.787 DEBUG:teuthology.orchestra.run.smithi144:> import stat 2024-09-12T12:15:47.787 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:15:47.787 DEBUG:teuthology.orchestra.run.smithi144:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-09-12T12:15:47.787 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:15:47.851 INFO:teuthology.orchestra.run.smithi144.stdout:1099511630409 2024-09-12T12:15:47.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:15:47.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-12T12:15:48.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c17e00640 1 Processor -- start 2024-09-12T12:15:48.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c17e00640 1 -- start start 2024-09-12T12:15:48.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c17e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7c1015b550 0x7f7c10071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c17e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c100b4370 0x7f7c100ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c17e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c10072520 con 0x7f7c100b4e50 2024-09-12T12:15:48.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c17e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7c100ce6f0 con 0x7f7c100b4370 2024-09-12T12:15:48.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c17e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7c10073130 con 0x7f7c1015b550 2024-09-12T12:15:48.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c14a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c100b4370 0x7f7c100ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c14a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c100b4370 0x7f7c100ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40954/0 (socket says 172.21.15.144:40954) 2024-09-12T12:15:48.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c15e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7c100b4e50 0x7f7c100735c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53820/0 (socket says 172.21.15.144:53820) 2024-09-12T12:15:48.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c14a00640 1 -- 172.21.15.144:0/234776624 learned_addr learned my addr 172.21.15.144:0/234776624 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c15400640 1 --2- 172.21.15.144:0/234776624 >> v2:172.21.15.165:3300/0 conn(0x7f7c1015b550 0x7f7c10071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c14a00640 1 -- 172.21.15.144:0/234776624 >> v2:172.21.15.165:3300/0 conn(0x7f7c1015b550 msgr2=0x7f7c10071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c14a00640 1 --2- 172.21.15.144:0/234776624 >> v2:172.21.15.165:3300/0 conn(0x7f7c1015b550 0x7f7c10071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c14a00640 1 -- 172.21.15.144:0/234776624 >> v1:172.21.15.144:6789/0 conn(0x7f7c100b4e50 legacy=0x7f7c100735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c14a00640 1 -- 172.21.15.144:0/234776624 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c10072800 con 0x7f7c100b4370 2024-09-12T12:15:48.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c15400640 1 --2- 172.21.15.144:0/234776624 >> v2:172.21.15.165:3300/0 conn(0x7f7c1015b550 0x7f7c10071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:48.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.043+0000 7f7c0fe00640 1 -- 172.21.15.144:0/234776624 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3178880963 0 0) 0x7f7c10072520 con 0x7f7c100b4e50 2024-09-12T12:15:48.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c14a00640 1 --2- 172.21.15.144:0/234776624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4370 0x7f7c100ce1b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7c10074aa0 tx=0x7f7bfc01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df83bcc905c4530 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c0fe00640 1 -- 172.21.15.144:0/234776624 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0b4070 con 0x7f7c100b4370 2024-09-12T12:15:48.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c0fe00640 1 -- 172.21.15.144:0/234776624 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0a7ab0 con 0x7f7c100b4370 2024-09-12T12:15:48.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c0fe00640 1 -- 172.21.15.144:0/234776624 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0af440 con 0x7f7c100b4370 2024-09-12T12:15:48.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c17e00640 1 -- 172.21.15.144:0/234776624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4370 msgr2=0x7f7c100ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c17e00640 1 --2- 172.21.15.144:0/234776624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4370 0x7f7c100ce1b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7c10074aa0 tx=0x7f7bfc01ebf0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c17e00640 1 -- 172.21.15.144:0/234776624 shutdown_connections 2024-09-12T12:15:48.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c17e00640 1 --2- 172.21.15.144:0/234776624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4370 0x7f7c100ce1b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c17e00640 1 --2- 172.21.15.144:0/234776624 >> v2:172.21.15.165:3300/0 conn(0x7f7c1015b550 0x7f7c10071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c17e00640 1 -- 172.21.15.144:0/234776624 >> 172.21.15.144:0/234776624 conn(0x7f7c1006cd20 msgr2=0x7f7c1006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c17e00640 1 -- 172.21.15.144:0/234776624 shutdown_connections 2024-09-12T12:15:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c17e00640 1 -- 172.21.15.144:0/234776624 wait complete. 2024-09-12T12:15:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.047+0000 7f7c17e00640 1 Processor -- start 2024-09-12T12:15:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c17e00640 1 -- start start 2024-09-12T12:15:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c17e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c100b4370 0x7f7c1015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4e50 0x7f7c10159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c17e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1015b550 0x7f7c1014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c17e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10070350 con 0x7f7c100b4e50 2024-09-12T12:15:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c17e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100701d0 con 0x7f7c100b4370 2024-09-12T12:15:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c17e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7c100740e0 con 0x7f7c1015b550 2024-09-12T12:15:48.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c14a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4e50 0x7f7c10159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c14a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4e50 0x7f7c10159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40962/0 (socket says 172.21.15.144:40962) 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c14a00640 1 -- 172.21.15.144:0/1859241638 learned_addr learned my addr 172.21.15.144:0/1859241638 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c15400640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c100b4370 0x7f7c1015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c15e00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1015b550 0x7f7c1014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c14a00640 1 -- 172.21.15.144:0/1859241638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1015b550 msgr2=0x7f7c1014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1015b550 0x7f7c1014ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c14a00640 1 -- 172.21.15.144:0/1859241638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c100b4370 msgr2=0x7f7c1015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c100b4370 0x7f7c1015d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c14a00640 1 -- 172.21.15.144:0/1859241638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c100b2630 con 0x7f7c100b4e50 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4e50 0x7f7c10159da0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00b2c0 tx=0x7f7bfc01d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c0d600640 1 -- 172.21.15.144:0/1859241638 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0bf070 con 0x7f7c100b4e50 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c0d600640 1 -- 172.21.15.144:0/1859241638 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc004030 con 0x7f7c100b4e50 2024-09-12T12:15:48.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c17e00640 1 -- 172.21.15.144:0/1859241638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c100b2910 con 0x7f7c100b4e50 2024-09-12T12:15:48.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c0d600640 1 -- 172.21.15.144:0/1859241638 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0b4070 con 0x7f7c100b4e50 2024-09-12T12:15:48.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.051+0000 7f7c17e00640 1 -- 172.21.15.144:0/1859241638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c101595a0 con 0x7f7c100b4e50 2024-09-12T12:15:48.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c0d600640 1 -- 172.21.15.144:0/1859241638 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7bfc0c2070 con 0x7f7c100b4e50 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c0d600640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bf00678c0 0x7f7bf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c0d600640 1 -- 172.21.15.144:0/1859241638 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f7bfc1204c0 con 0x7f7c100b4e50 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c15400640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bf00678c0 0x7f7bf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c1b1d0000 1 Processor -- start 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c1b1d0000 1 -- start start 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c15400640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bf00678c0 0x7f7bf0069d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c040045f0 tx=0x7f7c04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 0x55de66adc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66a92290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66a927d0 0x55de66a92bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55de66979c40 con 0x55de66adcca0 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55de668e0d50 con 0x55de66adc380 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55de6689bab0 con 0x55de66a927d0 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c14a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66a92290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c14a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66a92290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40966/0 (socket says 172.21.15.144:40966) 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c14a00640 1 -- 172.21.15.144:0/3798603372 learned_addr learned my addr 172.21.15.144:0/3798603372 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c15400640 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 0x55de66adc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c15e00640 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66a927d0 0x55de66a92bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c14a00640 1 -- 172.21.15.144:0/3798603372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66a927d0 msgr2=0x55de66a92bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c14a00640 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66a927d0 0x55de66a92bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c14a00640 1 -- 172.21.15.144:0/3798603372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 msgr2=0x55de66adc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c14a00640 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 0x55de66adc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c14a00640 1 -- 172.21.15.144:0/3798603372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de66887590 con 0x55de66adcca0 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.055+0000 7f7c15e00640 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66a927d0 0x55de66a92bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c14a00640 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66a92290 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00bbd0 tx=0x7f7bfc00b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ecfabf86d3e3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c02000640 1 -- 172.21.15.144:0/3798603372 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00b730 con 0x55de66adcca0 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c02000640 1 -- 172.21.15.144:0/3798603372 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0f0930 con 0x55de66adcca0 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c02000640 1 -- 172.21.15.144:0/3798603372 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0f4c30 con 0x55de66adcca0 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/3798603372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 msgr2=0x55de66a92290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66a92290 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00bbd0 tx=0x7f7bfc00b450 comp rx=0 tx=0).stop 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/3798603372 shutdown_connections 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66a927d0 0x55de66a92bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66a92290 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/3798603372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 0x55de66adc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/3798603372 >> 172.21.15.144:0/3798603372 conn(0x55de66a89bc0 msgr2=0x55de66a90b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/3798603372 shutdown_connections 2024-09-12T12:15:48.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/3798603372 wait complete. 2024-09-12T12:15:48.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 -- start start 2024-09-12T12:15:48.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 Processor -- start 2024-09-12T12:15:48.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66a97820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adc380 0x55de66ac65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66ac6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55de6689f400 con 0x55de66adcca0 2024-09-12T12:15:48.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55de6699d3a0 con 0x55de66a927d0 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55de66920260 con 0x55de66adc380 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c1b1d0000 10 client.0 _ll_register_callbacks cb 0x55de66942020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66a97820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66ac6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66a97820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:59258/0 (socket says 172.21.15.144:59258) 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15400640 1 -- 172.21.15.144:0/1602789641 learned_addr learned my addr 172.21.15.144:0/1602789641 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adc380 0x55de66ac65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15400640 1 -- 172.21.15.144:0/1602789641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adc380 msgr2=0x55de66ac65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15400640 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adc380 0x55de66ac65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15400640 1 -- 172.21.15.144:0/1602789641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 msgr2=0x55de66ac6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15400640 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66ac6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15400640 1 -- 172.21.15.144:0/1602789641 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de66883dd0 con 0x55de66a927d0 2024-09-12T12:15:48.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15e00640 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66ac6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adc380 0x55de66ac65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7c15400640 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66a97820 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c04016700 tx=0x7f7c04004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba795039fb53ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.059+0000 7f7bf6a00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1602789641 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c04026070 con 0x55de66a927d0 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1602789641 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bfc0f0930 con 0x55de66a927d0 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1602789641 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f7c04014880 con 0x55de66a927d0 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1602789641 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7c04031050 con 0x55de66a927d0 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 10 client.5530 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1602789641 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55de66880800 con 0x55de66a927d0 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1602789641 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0f0930 con 0x55de66a927d0 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1602789641 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f7c04034020 con 0x55de66a927d0 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 10 client.5530 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 10 client.5530 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 20 client.5530 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55de66a97d60 0x55de66ae3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 4 client.5530 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1602789641 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de6687ae20 con 0x55de66a97d60 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55de66a97d60 0x55de66ae3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55de66a97d60 0x55de66ae3150 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e96a6742ebb8545 server_cookie=82a58ce77af782f9 in_seq=0 out_seq=0 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7bf6a00640 10 client.5530 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1602789641 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de6687ae20 con 0x55de66a97d60 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7bf6a00640 10 client.5530 handle_command_reply: tid=0 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 client.5530 shutdown 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1602789641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 msgr2=0x55de66a97820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66a97820 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c04016700 tx=0x7f7c04004740 comp rx=0 tx=0).stop 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1602789641 shutdown_connections 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55de66a97d60 0x55de66ae3150 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adcca0 0x55de66ac6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adc380 0x55de66ac65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1602789641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66a97820 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7bf6a00640 0 client.5530 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1602789641 >> 172.21.15.144:0/1602789641 conn(0x55de66a89bc0 msgr2=0x55de66a91280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1602789641 shutdown_connections 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1602789641 wait complete. 2024-09-12T12:15:48.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.063+0000 7f7c1b1d0000 20 client.5530 trim_cache size 0 max 16384 2024-09-12T12:15:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 Processor -- start 2024-09-12T12:15:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- start start 2024-09-12T12:15:48.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66b4b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adc380 0x55de66b4ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 0x55de66b4bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7c10203700 con 0x55de66adc380 2024-09-12T12:15:48.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1015c420 con 0x55de66a927d0 2024-09-12T12:15:48.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7c102030e0 con 0x55de66adcca0 2024-09-12T12:15:48.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c14a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adc380 0x55de66b4ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c14a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adc380 0x55de66b4ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40994/0 (socket says 172.21.15.144:40994) 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c14a00640 1 -- 172.21.15.144:0/545477704 learned_addr learned my addr 172.21.15.144:0/545477704 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c15400640 1 --2- 172.21.15.144:0/545477704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66b4b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c15e00640 1 --2- 172.21.15.144:0/545477704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 0x55de66b4bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c14a00640 1 -- 172.21.15.144:0/545477704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 msgr2=0x55de66b4bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c14a00640 1 --2- 172.21.15.144:0/545477704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 0x55de66b4bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c14a00640 1 -- 172.21.15.144:0/545477704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 msgr2=0x55de66b4b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c14a00640 1 --2- 172.21.15.144:0/545477704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66b4b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c14a00640 1 -- 172.21.15.144:0/545477704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de66adc040 con 0x55de66adc380 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c14a00640 1 --2- 172.21.15.144:0/545477704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adc380 0x55de66b4ba50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0ed2b0 tx=0x7f7bfc0c5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86db4efd34f95af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c01600640 1 -- 172.21.15.144:0/545477704 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0f0930 con 0x55de66adc380 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c01600640 1 -- 172.21.15.144:0/545477704 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0f9460 con 0x55de66adc380 2024-09-12T12:15:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c01600640 1 -- 172.21.15.144:0/545477704 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0f4c30 con 0x55de66adc380 2024-09-12T12:15:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/545477704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adc380 msgr2=0x55de66b4ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/545477704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adc380 0x55de66b4ba50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0ed2b0 tx=0x7f7bfc0c5000 comp rx=0 tx=0).stop 2024-09-12T12:15:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/545477704 shutdown_connections 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/545477704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 0x55de66b4bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/545477704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66adc380 0x55de66b4ba50 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/545477704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66a927d0 0x55de66b4b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/545477704 >> 172.21.15.144:0/545477704 conn(0x55de66a89bc0 msgr2=0x55de66ac5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/545477704 shutdown_connections 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/545477704 wait complete. 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 -- start start 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.079+0000 7f7c1b1d0000 1 Processor -- start 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66a927d0 0x55de66b4f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 0x55de66af1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 0x55de66af2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55de66886f30 con 0x55de66a927d0 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55de6689f7d0 con 0x55de66adc380 2024-09-12T12:15:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55de668e0060 con 0x55de66adcca0 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 10 client.0 _ll_register_callbacks cb 0x7f7c040042f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66a927d0 0x55de66b4f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66a927d0 0x55de66b4f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40996/0 (socket says 172.21.15.144:40996) 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15400640 1 -- 172.21.15.144:0/1557084016 learned_addr learned my addr 172.21.15.144:0/1557084016 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 0x55de66af1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15e00640 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 0x55de66af2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15400640 1 -- 172.21.15.144:0/1557084016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 msgr2=0x55de66af2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15400640 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 0x55de66af2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15400640 1 -- 172.21.15.144:0/1557084016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 msgr2=0x55de66af1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15400640 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 0x55de66af1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15400640 1 -- 172.21.15.144:0/1557084016 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6689e480 con 0x55de66a927d0 2024-09-12T12:15:48.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c15400640 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66a927d0 0x55de66b4f300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7c04000c10 tx=0x7f7c04015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a03c29bd1e613f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1557084016 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c04026070 con 0x55de66a927d0 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1557084016 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f7c04014880 con 0x55de66a927d0 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1557084016 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bfc0f9460 con 0x55de66a927d0 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1557084016 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7c0401c040 con 0x55de66a927d0 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 10 client.5649 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1557084016 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55de66874650 con 0x55de66a927d0 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1557084016 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0f9460 con 0x55de66a927d0 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1557084016 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f7c0403d050 con 0x55de66a927d0 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 10 client.5649 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 10 client.5649 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 20 client.5649 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:48.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55de66af2950 0x55de66af2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 4 client.5649 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1557084016 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55de668ee480 con 0x55de66af2950 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55de66af2950 0x55de66af2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c14a00640 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55de66af2950 0x55de66af2d30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=674431cf3f350501 server_cookie=77b6f9fbbcd1f9e3 in_seq=0 out_seq=0 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 10 client.5649 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 1 -- 172.21.15.144:0/1557084016 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55de668ee480 con 0x55de66af2950 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 10 client.5649 handle_command_reply: tid=0 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 client.5649 shutdown 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1557084016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66a927d0 msgr2=0x55de66b4f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66a927d0 0x55de66b4f300 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7c04000c10 tx=0x7f7c04015000 comp rx=0 tx=0).stop 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1557084016 shutdown_connections 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55de66af2950 0x55de66af2d30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de66adcca0 0x55de66af2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de66adc380 0x55de66af1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7bf6a00640 0 client.5649 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 --2- 172.21.15.144:0/1557084016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de66a927d0 0x55de66b4f300 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1557084016 >> 172.21.15.144:0/1557084016 conn(0x55de66a89bc0 msgr2=0x55de66ac5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1557084016 shutdown_connections 2024-09-12T12:15:48.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.083+0000 7f7c1b1d0000 1 -- 172.21.15.144:0/1557084016 wait complete. 2024-09-12T12:15:48.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c1b1d0000 20 client.5649 trim_cache size 0 max 16384 2024-09-12T12:15:48.093 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-12T12:15:48.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 -- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bf00678c0 msgr2=0x7f7bf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bf00678c0 0x7f7bf0069d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c040045f0 tx=0x7f7c04008040 comp rx=0 tx=0).stop 2024-09-12T12:15:48.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 -- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4e50 msgr2=0x7f7c10159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4e50 0x7f7c10159da0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00b2c0 tx=0x7f7bfc01d430 comp rx=0 tx=0).stop 2024-09-12T12:15:48.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 -- 172.21.15.144:0/1859241638 shutdown_connections 2024-09-12T12:15:48.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bf00678c0 0x7f7bf0069d80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1015b550 0x7f7c1014ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100b4e50 0x7f7c10159da0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 --2- 172.21.15.144:0/1859241638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c100b4370 0x7f7c1015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 -- 172.21.15.144:0/1859241638 >> 172.21.15.144:0/1859241638 conn(0x7f7c1006cd20 msgr2=0x7f7c1006f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 -- 172.21.15.144:0/1859241638 shutdown_connections 2024-09-12T12:15:48.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.087+0000 7f7c17e00640 1 -- 172.21.15.144:0/1859241638 wait complete. 2024-09-12T12:15:48.106 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a49.00000000 parent 2024-09-12T12:15:48.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 Processor -- start 2024-09-12T12:15:48.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 -- start start 2024-09-12T12:15:48.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b5d137a80 0x558b5d106510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 0x558b5d1dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558b5d0581b0 con 0x558b5d1de6b0 2024-09-12T12:15:48.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558b5d0b17b0 con 0x558b5d151b10 2024-09-12T12:15:48.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x558b5d1df570 con 0x558b5d137a80 2024-09-12T12:15:48.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbc200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbc200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41014/0 (socket says 172.21.15.144:41014) 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbc200640 1 -- 172.21.15.144:0/3446939656 learned_addr learned my addr 172.21.15.144:0/3446939656 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbb800640 1 --2- 172.21.15.144:0/3446939656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b5d137a80 0x558b5d106510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbae00640 1 --2- 172.21.15.144:0/3446939656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 0x558b5d1dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbc200640 1 -- 172.21.15.144:0/3446939656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b5d137a80 msgr2=0x558b5d106510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbc200640 1 --2- 172.21.15.144:0/3446939656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b5d137a80 0x558b5d106510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbc200640 1 -- 172.21.15.144:0/3446939656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 msgr2=0x558b5d1dbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbc200640 1 --2- 172.21.15.144:0/3446939656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 0x558b5d1dbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbc200640 1 -- 172.21.15.144:0/3446939656 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b5d1d53e0 con 0x558b5d1de6b0 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbc200640 1 --2- 172.21.15.144:0/3446939656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14b700 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fecb40016b0 tx=0x7fecb4001b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5460bca6e4815a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecb9a00640 1 -- 172.21.15.144:0/3446939656 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4003660 con 0x558b5d1de6b0 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecb9a00640 1 -- 172.21.15.144:0/3446939656 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb4003800 con 0x558b5d1de6b0 2024-09-12T12:15:48.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecb9a00640 1 -- 172.21.15.144:0/3446939656 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4003bd0 con 0x558b5d1de6b0 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3446939656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 msgr2=0x558b5d14b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 --2- 172.21.15.144:0/3446939656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14b700 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fecb40016b0 tx=0x7fecb4001b70 comp rx=0 tx=0).stop 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3446939656 shutdown_connections 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 --2- 172.21.15.144:0/3446939656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14b700 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 --2- 172.21.15.144:0/3446939656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 0x558b5d1dbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 --2- 172.21.15.144:0/3446939656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b5d137a80 0x558b5d106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3446939656 >> 172.21.15.144:0/3446939656 conn(0x558b5d131ff0 msgr2=0x558b5d1dd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3446939656 shutdown_connections 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3446939656 wait complete. 2024-09-12T12:15:48.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.151+0000 7fecbe6a8080 1 Processor -- start 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbe6a8080 1 -- start start 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbe6a8080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b5d137a80 0x558b5d1d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbe6a8080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 0x558b5d14d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbe6a8080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbe6a8080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558b5d1d5920 con 0x558b5d1de6b0 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbe6a8080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558b5d1d5680 con 0x558b5d151b10 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbe6a8080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x558b5d1d5bc0 con 0x558b5d137a80 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbc200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbc200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41020/0 (socket says 172.21.15.144:41020) 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbc200640 1 -- 172.21.15.144:0/3125171089 learned_addr learned my addr 172.21.15.144:0/3125171089 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbae00640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 0x558b5d14d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbb800640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b5d137a80 0x558b5d1d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbc200640 1 -- 172.21.15.144:0/3125171089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b5d137a80 msgr2=0x558b5d1d4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbc200640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b5d137a80 0x558b5d1d4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbc200640 1 -- 172.21.15.144:0/3125171089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 msgr2=0x558b5d14d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbc200640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 0x558b5d14d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbc200640 1 -- 172.21.15.144:0/3125171089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b5d1e0d40 con 0x558b5d1de6b0 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbae00640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b5d151b10 0x558b5d14d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbc200640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14dd80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x558b5d1d6d40 tx=0x7fecb4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecb3e00640 1 -- 172.21.15.144:0/3125171089 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4022020 con 0x558b5d1de6b0 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecb3e00640 1 -- 172.21.15.144:0/3125171089 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb401e880 con 0x558b5d1de6b0 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b5d1e0fe0 con 0x558b5d1de6b0 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecb3e00640 1 -- 172.21.15.144:0/3125171089 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4006c30 con 0x558b5d1de6b0 2024-09-12T12:15:48.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.155+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b5d1e1520 con 0x558b5d1de6b0 2024-09-12T12:15:48.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecb3e00640 1 -- 172.21.15.144:0/3125171089 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fecb4025020 con 0x558b5d1de6b0 2024-09-12T12:15:48.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecb3e00640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec9c0662d0 0x7fec9c068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecb3e00640 1 -- 172.21.15.144:0/3125171089 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fecb4085df0 con 0x558b5d1de6b0 2024-09-12T12:15:48.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbb800640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec9c0662d0 0x7fec9c068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x558b5d1d81d0 0x558b5d1d9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 --> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] -- osd_op(unknown.0.0:1 8.1f 8:f95eeb57:::10000000a49.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54) -- 0x558b5d1da500 con 0x558b5d1d81d0 2024-09-12T12:15:48.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbae00640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x558b5d1d81d0 0x558b5d1d9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbb800640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec9c0662d0 0x7fec9c068790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fecac0ae000 tx=0x7fecac0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbae00640 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x558b5d1d81d0 0x558b5d1d9fc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbae00640 1 -- 172.21.15.144:0/3125171089 <== osd.0 v2:172.21.15.144:6808/1854211635 1 ==== osd_op_reply(1 10000000a49.00000000 [rmxattr] v54'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7feca800d040 con 0x558b5d1d81d0 2024-09-12T12:15:48.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x558b5d1d81d0 msgr2=0x558b5d1d9fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x558b5d1d81d0 0x558b5d1d9fc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec9c0662d0 msgr2=0x7fec9c068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec9c0662d0 0x7fec9c068790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fecac0ae000 tx=0x7fecac0a6000 comp rx=0 tx=0).stop 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 msgr2=0x558b5d14dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 --2- 172.21.15.144:0/3125171089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b5d1de6b0 0x558b5d14dd80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x558b5d1d6d40 tx=0x7fecb4001260 comp rx=0 tx=0).stop 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbc200640 1 -- 172.21.15.144:0/3125171089 reap_dead start 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 shutdown_connections 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 >> 172.21.15.144:0/3125171089 conn(0x558b5d131ff0 msgr2=0x558b5d14ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 shutdown_connections 2024-09-12T12:15:48.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.159+0000 7fecbe6a8080 1 -- 172.21.15.144:0/3125171089 wait complete. 2024-09-12T12:15:48.168 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-12T12:15:48.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-12T12:15:48.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1fc00640 1 Processor -- start 2024-09-12T12:15:48.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1fc00640 1 -- start start 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1fc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd1815af60 0x7fcd180ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1806c320 0x7fcd180b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1fc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180b4300 con 0x7fcd180cd9f0 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1fc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcd180b32f0 con 0x7fcd1815af60 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcd180b3540 con 0x7fcd1806c320 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd1815af60 0x7fcd180ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd1815af60 0x7fcd180ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41024/0 (socket says 172.21.15.144:41024) 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1d200640 1 -- 172.21.15.144:0/2361930639 learned_addr learned my addr 172.21.15.144:0/2361930639 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1dc00640 1 --2- 172.21.15.144:0/2361930639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1806c320 0x7fcd180b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1d200640 1 -- 172.21.15.144:0/2361930639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1806c320 msgr2=0x7fcd180b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1d200640 1 --2- 172.21.15.144:0/2361930639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1806c320 0x7fcd180b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1d200640 1 -- 172.21.15.144:0/2361930639 >> v1:172.21.15.165:6789/0 conn(0x7fcd180cd9f0 legacy=0x7fcd1806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1d200640 1 -- 172.21.15.144:0/2361930639 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd180b3820 con 0x7fcd1815af60 2024-09-12T12:15:48.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.307+0000 7fcd1dc00640 1 --2- 172.21.15.144:0/2361930639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1806c320 0x7fcd180b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:48.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1d200640 1 --2- 172.21.15.144:0/2361930639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1815af60 0x7fcd180ce680 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009870 tx=0x7fcd0c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8aa781c9cc11ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd17400640 1 -- 172.21.15.144:0/2361930639 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0b1070 con 0x7fcd1815af60 2024-09-12T12:15:48.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd17400640 1 -- 172.21.15.144:0/2361930639 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0c0ac630 con 0x7fcd1815af60 2024-09-12T12:15:48.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd17400640 1 -- 172.21.15.144:0/2361930639 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0a8050 con 0x7fcd1815af60 2024-09-12T12:15:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 -- 172.21.15.144:0/2361930639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1815af60 msgr2=0x7fcd180ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 --2- 172.21.15.144:0/2361930639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1815af60 0x7fcd180ce680 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009870 tx=0x7fcd0c01c520 comp rx=0 tx=0).stop 2024-09-12T12:15:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 -- 172.21.15.144:0/2361930639 shutdown_connections 2024-09-12T12:15:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 --2- 172.21.15.144:0/2361930639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1806c320 0x7fcd180b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 --2- 172.21.15.144:0/2361930639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1815af60 0x7fcd180ce680 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 -- 172.21.15.144:0/2361930639 >> 172.21.15.144:0/2361930639 conn(0x7fcd18068030 msgr2=0x7fcd180b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 -- 172.21.15.144:0/2361930639 shutdown_connections 2024-09-12T12:15:48.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 -- 172.21.15.144:0/2361930639 wait complete. 2024-09-12T12:15:48.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 Processor -- start 2024-09-12T12:15:48.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.311+0000 7fcd1fc00640 1 -- start start 2024-09-12T12:15:48.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1806c320 0x7fcd18145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd180cd9f0 0x7fcd1806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1815af60 0x7fcd1806d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd180b5430 con 0x7fcd1806c320 2024-09-12T12:15:48.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd180b52b0 con 0x7fcd180cd9f0 2024-09-12T12:15:48.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcd180b55b0 con 0x7fcd1815af60 2024-09-12T12:15:48.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1806c320 0x7fcd18145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1806c320 0x7fcd18145050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41032/0 (socket says 172.21.15.144:41032) 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd17e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd180cd9f0 0x7fcd1806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1d200640 1 -- 172.21.15.144:0/321770111 learned_addr learned my addr 172.21.15.144:0/321770111 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1dc00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1815af60 0x7fcd1806d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1d200640 1 -- 172.21.15.144:0/321770111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1815af60 msgr2=0x7fcd1806d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1d200640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1815af60 0x7fcd1806d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1d200640 1 -- 172.21.15.144:0/321770111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd180cd9f0 msgr2=0x7fcd1806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1d200640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd180cd9f0 0x7fcd1806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1d200640 1 -- 172.21.15.144:0/321770111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd181470a0 con 0x7fcd1806c320 2024-09-12T12:15:48.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1d200640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1806c320 0x7fcd18145050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0af040 tx=0x7fcd0c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd14c00640 1 -- 172.21.15.144:0/321770111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0bc070 con 0x7fcd1806c320 2024-09-12T12:15:48.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd14c00640 1 -- 172.21.15.144:0/321770111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0c0ab800 con 0x7fcd1806c320 2024-09-12T12:15:48.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1fc00640 1 -- 172.21.15.144:0/321770111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1815c9d0 con 0x7fcd1806c320 2024-09-12T12:15:48.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd14c00640 1 -- 172.21.15.144:0/321770111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0b1070 con 0x7fcd1806c320 2024-09-12T12:15:48.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.315+0000 7fcd1fc00640 1 -- 172.21.15.144:0/321770111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1815cf90 con 0x7fcd1806c320 2024-09-12T12:15:48.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd14c00640 1 -- 172.21.15.144:0/321770111 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd0c0bf070 con 0x7fcd1806c320 2024-09-12T12:15:48.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd14c00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccf80678c0 0x7fccf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd14c00640 1 -- 172.21.15.144:0/321770111 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fcd0c11f9a0 con 0x7fcd1806c320 2024-09-12T12:15:48.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd17e00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccf80678c0 0x7fccf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd22fcc000 1 Processor -- start 2024-09-12T12:15:48.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd22fcc000 1 -- start start 2024-09-12T12:15:48.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd17e00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccf80678c0 0x7fccf8069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd1814bb60 tx=0x7fcd04007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a10220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b3a10760 0x55b0b39c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b39c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b0b3813b50 con 0x55b0b39c3c00 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b0b37b9370 con 0x55b0b3a10760 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b0b380fb10 con 0x55b0b3a0fe40 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b39c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a10220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b39c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41036/0 (socket says 172.21.15.144:41036) 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd17e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b3a10760 0x55b0b39c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1dc00640 1 -- 172.21.15.144:0/3245424386 learned_addr learned my addr 172.21.15.144:0/3245424386 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1d200640 1 -- 172.21.15.144:0/3245424386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b3a10760 msgr2=0x55b0b39c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1d200640 1 --2- 172.21.15.144:0/3245424386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b3a10760 0x55b0b39c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1d200640 1 -- 172.21.15.144:0/3245424386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 msgr2=0x55b0b39c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1d200640 1 --2- 172.21.15.144:0/3245424386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b39c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1d200640 1 -- 172.21.15.144:0/3245424386 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0b381c7c0 con 0x55b0b3a0fe40 2024-09-12T12:15:48.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd1d200640 1 --2- 172.21.15.144:0/3245424386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a10220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c000c10 tx=0x7fcd0c0efc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ddca70d4b44f528 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd09600640 1 -- 172.21.15.144:0/3245424386 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0f8790 con 0x55b0b3a0fe40 2024-09-12T12:15:48.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd09600640 1 -- 172.21.15.144:0/3245424386 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0c0edf60 con 0x55b0b3a0fe40 2024-09-12T12:15:48.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.319+0000 7fcd09600640 1 -- 172.21.15.144:0/3245424386 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0ec2d0 con 0x55b0b3a0fe40 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3245424386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 msgr2=0x55b0b3a10220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3245424386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a10220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c000c10 tx=0x7fcd0c0efc60 comp rx=0 tx=0).stop 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3245424386 shutdown_connections 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3245424386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b39c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3245424386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b3a10760 0x55b0b39c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3245424386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a10220 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3245424386 >> 172.21.15.144:0/3245424386 conn(0x55b0b39f0be0 msgr2=0x55b0b39f2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3245424386 shutdown_connections 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3245424386 wait complete. 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- start start 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 Processor -- start 2024-09-12T12:15:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 0x55b0b39cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b39daa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b3a10760 0x55b0b39dafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b0b3812e60 con 0x55b0b3a10760 2024-09-12T12:15:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b0b37ad650 con 0x55b0b39c3c00 2024-09-12T12:15:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b0b3890f10 con 0x55b0b3a0fe40 2024-09-12T12:15:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 10 client.0 _ll_register_callbacks cb 0x55b0b39b10f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b3a10760 0x55b0b39dafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b3a10760 0x55b0b39dafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41048/0 (socket says 172.21.15.144:41048) 2024-09-12T12:15:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1dc00640 1 -- 172.21.15.144:0/3781726899 learned_addr learned my addr 172.21.15.144:0/3781726899 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1d200640 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 0x55b0b39cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd17e00640 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b39daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1dc00640 1 -- 172.21.15.144:0/3781726899 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 msgr2=0x55b0b39daa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1dc00640 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b39daa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1dc00640 1 -- 172.21.15.144:0/3781726899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 msgr2=0x55b0b39cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1dc00640 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 0x55b0b39cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1dc00640 1 -- 172.21.15.144:0/3781726899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0b37d6eb0 con 0x55b0b3a10760 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd1dc00640 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b3a10760 0x55b0b39dafc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000df00 tx=0x7fcd1000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904107ec79dcaf60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fccfe000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fccfe000640 1 -- 172.21.15.144:0/3781726899 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1001c060 con 0x55b0b3a10760 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fccfe000640 1 -- 172.21.15.144:0/3781726899 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fcd1000a620 con 0x55b0b3a10760 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3781726899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd0c0edf60 con 0x55b0b3a10760 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fccfe000640 1 -- 172.21.15.144:0/3781726899 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcd10022050 con 0x55b0b3a10760 2024-09-12T12:15:48.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 10 client.5673 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.323+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3781726899 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55b0b37b9590 con 0x55b0b3a10760 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fccfe000640 1 -- 172.21.15.144:0/3781726899 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0c0edf60 con 0x55b0b3a10760 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fccfe000640 1 -- 172.21.15.144:0/3781726899 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fcd10025020 con 0x55b0b3a10760 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 10 client.5673 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 10 client.5673 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 20 client.5673 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55b0b39db9d0 0x55b0b39dbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 4 client.5673 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3781726899 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0b37add30 con 0x55b0b39db9d0 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd1d200640 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55b0b39db9d0 0x55b0b39dbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd1d200640 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55b0b39db9d0 0x55b0b39dbde0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a631b9217c3b5a2 server_cookie=a9736b770b5db067 in_seq=0 out_seq=0 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fccfe000640 10 client.5673 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fccfe000640 1 -- 172.21.15.144:0/3781726899 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0b37add30 con 0x55b0b39db9d0 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fccfe000640 10 client.5673 handle_command_reply: tid=0 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 client.5673 shutdown 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3781726899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b3a10760 msgr2=0x55b0b39dafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b3a10760 0x55b0b39dafc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000df00 tx=0x7fcd1000c7f0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3781726899 shutdown_connections 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55b0b39db9d0 0x55b0b39dbde0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b3a10760 0x55b0b39dafc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b39daa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fccfe000640 0 client.5673 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/3781726899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 0x55b0b39cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3781726899 >> 172.21.15.144:0/3781726899 conn(0x55b0b39f0be0 msgr2=0x55b0b39c2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3781726899 shutdown_connections 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 1 -- 172.21.15.144:0/3781726899 wait complete. 2024-09-12T12:15:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.327+0000 7fcd22fcc000 20 client.5673 trim_cache size 0 max 16384 2024-09-12T12:15:48.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.343+0000 7fcd22fcc000 1 Processor -- start 2024-09-12T12:15:48.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.343+0000 7fcd22fcc000 1 -- start start 2024-09-12T12:15:48.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39f0be0 0x55b0b3a7fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b3a80230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a80770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd182042c0 con 0x55b0b39c3c00 2024-09-12T12:15:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd182033b0 con 0x55b0b39f0be0 2024-09-12T12:15:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1815c530 con 0x55b0b3a0fe40 2024-09-12T12:15:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b3a80230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b3a80230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41056/0 (socket says 172.21.15.144:41056) 2024-09-12T12:15:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd17e00640 1 -- 172.21.15.144:0/4043354644 learned_addr learned my addr 172.21.15.144:0/4043354644 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd1dc00640 1 --2- 172.21.15.144:0/4043354644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a80770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd1d200640 1 --2- 172.21.15.144:0/4043354644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39f0be0 0x55b0b3a7fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd17e00640 1 -- 172.21.15.144:0/4043354644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 msgr2=0x55b0b3a80770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd17e00640 1 --2- 172.21.15.144:0/4043354644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a80770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd17e00640 1 -- 172.21.15.144:0/4043354644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39f0be0 msgr2=0x55b0b3a7fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd17e00640 1 --2- 172.21.15.144:0/4043354644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39f0be0 0x55b0b3a7fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd17e00640 1 -- 172.21.15.144:0/4043354644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0b38913a0 con 0x55b0b39c3c00 2024-09-12T12:15:48.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd17e00640 1 --2- 172.21.15.144:0/4043354644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b3a80230 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400fd40 tx=0x7fcd04015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5cbf3386a742db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd08c00640 1 -- 172.21.15.144:0/4043354644 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0401b040 con 0x55b0b39c3c00 2024-09-12T12:15:48.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd08c00640 1 -- 172.21.15.144:0/4043354644 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0401c040 con 0x55b0b39c3c00 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd08c00640 1 -- 172.21.15.144:0/4043354644 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04023670 con 0x55b0b39c3c00 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 -- 172.21.15.144:0/4043354644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 msgr2=0x55b0b3a80230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/4043354644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b3a80230 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400fd40 tx=0x7fcd04015000 comp rx=0 tx=0).stop 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 -- 172.21.15.144:0/4043354644 shutdown_connections 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/4043354644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a80770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/4043354644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39c3c00 0x55b0b3a80230 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/4043354644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39f0be0 0x55b0b3a7fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 -- 172.21.15.144:0/4043354644 >> 172.21.15.144:0/4043354644 conn(0x55b0b39dabd0 msgr2=0x55b0b3a210f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 -- 172.21.15.144:0/4043354644 shutdown_connections 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 -- 172.21.15.144:0/4043354644 wait complete. 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 -- start start 2024-09-12T12:15:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.347+0000 7fcd22fcc000 1 Processor -- start 2024-09-12T12:15:48.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 0x55b0b3a83a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39f0be0 0x55b0b3a83fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b0b37bfbe0 con 0x55b0b39f0be0 2024-09-12T12:15:48.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1815e430 con 0x55b0b39c3c00 2024-09-12T12:15:48.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b0b3798dc0 con 0x55b0b3a0fe40 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 10 client.0 _ll_register_callbacks cb 0x7fcd10007c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39f0be0 0x55b0b3a83fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39f0be0 0x55b0b3a83fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41068/0 (socket says 172.21.15.144:41068) 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd17e00640 1 -- 172.21.15.144:0/2612940711 learned_addr learned my addr 172.21.15.144:0/2612940711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd1dc00640 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd1d200640 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 0x55b0b3a83a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd17e00640 1 -- 172.21.15.144:0/2612940711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 msgr2=0x55b0b3a844e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd17e00640 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a844e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd17e00640 1 -- 172.21.15.144:0/2612940711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 msgr2=0x55b0b3a83a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd17e00640 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 0x55b0b3a83a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd17e00640 1 -- 172.21.15.144:0/2612940711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0b386ce20 con 0x55b0b39f0be0 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd17e00640 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39f0be0 0x55b0b3a83fa0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcd04004ab0 tx=0x7fcd04003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b610dc7d41d1a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:48.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 1 -- 172.21.15.144:0/2612940711 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0401b050 con 0x55b0b39f0be0 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 1 -- 172.21.15.144:0/2612940711 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fcd04035c80 con 0x55b0b39f0be0 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- 172.21.15.144:0/2612940711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd0401c040 con 0x55b0b39f0be0 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 1 -- 172.21.15.144:0/2612940711 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcd0403c050 con 0x55b0b39f0be0 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 10 client.5679 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- 172.21.15.144:0/2612940711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55b0b37ab910 con 0x55b0b39f0be0 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 1 -- 172.21.15.144:0/2612940711 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0401c040 con 0x55b0b39f0be0 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 1 -- 172.21.15.144:0/2612940711 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fcd0403f020 con 0x55b0b39f0be0 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 10 client.5679 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 10 client.5679 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 20 client.5679 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55b0b3a10760 0x55b0b3a3f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 4 client.5679 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- 172.21.15.144:0/2612940711 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x55b0b3821280 con 0x55b0b3a10760 2024-09-12T12:15:48.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd1d200640 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55b0b3a10760 0x55b0b3a3f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd1d200640 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55b0b3a10760 0x55b0b3a3f380 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82f7a00d927d7e49 server_cookie=240377b52f42e18f in_seq=0 out_seq=0 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 10 client.5679 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 1 -- 172.21.15.144:0/2612940711 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b0b3821280 con 0x55b0b3a10760 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 10 client.5679 handle_command_reply: tid=0 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 client.5679 shutdown 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- 172.21.15.144:0/2612940711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39f0be0 msgr2=0x55b0b3a83fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39f0be0 0x55b0b3a83fa0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcd04004ab0 tx=0x7fcd04003700 comp rx=0 tx=0).stop 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- 172.21.15.144:0/2612940711 shutdown_connections 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55b0b3a10760 0x55b0b3a3f380 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b0b3a0fe40 0x55b0b3a844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0b39f0be0 0x55b0b3a83fa0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 --2- 172.21.15.144:0/2612940711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b0b39c3c00 0x55b0b3a83a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- 172.21.15.144:0/2612940711 >> 172.21.15.144:0/2612940711 conn(0x55b0b39dabd0 msgr2=0x55b0b3a21910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fccfe000640 0 client.5679 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- 172.21.15.144:0/2612940711 shutdown_connections 2024-09-12T12:15:48.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.351+0000 7fcd22fcc000 1 -- 172.21.15.144:0/2612940711 wait complete. 2024-09-12T12:15:48.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd22fcc000 20 client.5679 trim_cache size 0 max 16384 2024-09-12T12:15:48.360 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-12T12:15:48.351+0000 7f88ea600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a49 [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v426 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5356=0-4194304@1} caps={5356=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5356 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55de9f05c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a49:[<0x10000000001/new_file_0 v426>,<0x10000000000/ceph-qa-suite v40>,<0x1/scrub_test_path v14>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-12T12:15:48.360 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:48.360 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:15:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "bd572e67-d59c-4289-8d06-10d377ebd202", 2024-09-12T12:15:48.361 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:15:48.361 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:48.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 -- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccf80678c0 msgr2=0x7fccf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccf80678c0 0x7fccf8069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd1814bb60 tx=0x7fcd04007e40 comp rx=0 tx=0).stop 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 -- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1806c320 msgr2=0x7fcd18145050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1806c320 0x7fcd18145050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c0af040 tx=0x7fcd0c0192c0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 -- 172.21.15.144:0/321770111 shutdown_connections 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccf80678c0 0x7fccf8069d80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1815af60 0x7fcd1806d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd180cd9f0 0x7fcd1806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 --2- 172.21.15.144:0/321770111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1806c320 0x7fcd18145050 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 -- 172.21.15.144:0/321770111 >> 172.21.15.144:0/321770111 conn(0x7fcd18068030 msgr2=0x7fcd1814fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 -- 172.21.15.144:0/321770111 shutdown_connections 2024-09-12T12:15:48.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.355+0000 7fcd1fc00640 1 -- 172.21.15.144:0/321770111 wait complete. 2024-09-12T12:15:48.376 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': 'bd572e67-d59c-4289-8d06-10d377ebd202', 'mode': 'asynchronous'}' 2024-09-12T12:15:48.377 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-12T12:15:48.377 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-12T12:15:48.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f247de00640 1 Processor -- start 2024-09-12T12:15:48.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f247de00640 1 -- start start 2024-09-12T12:15:48.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f247de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f24780cd9f0 0x7f247806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f247de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24780b4300 con 0x7f247815b340 2024-09-12T12:15:48.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f247de00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24780b3540 con 0x7f247815af60 2024-09-12T12:15:48.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f247de00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f24780b32f0 con 0x7f24780cd9f0 2024-09-12T12:15:48.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f2477400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f247815b340 0x7f24780b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53830/0 (socket says 172.21.15.144:53830) 2024-09-12T12:15:48.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f2477400640 1 -- 172.21.15.144:0/3339629718 learned_addr learned my addr 172.21.15.144:0/3339629718 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:48.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f246e000640 1 --2- 172.21.15.144:0/3339629718 >> v2:172.21.15.165:3300/0 conn(0x7f24780cd9f0 0x7f247806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f2476000640 1 -- 172.21.15.144:0/3339629718 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983868220 0 0) 0x7f24780b4300 con 0x7f247815b340 2024-09-12T12:15:48.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f2476000640 1 -- 172.21.15.144:0/3339629718 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f245c003530 con 0x7f247815b340 2024-09-12T12:15:48.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f2476000640 1 -- 172.21.15.144:0/3339629718 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226600378 0 0) 0x7f24780b3540 con 0x7f247815af60 2024-09-12T12:15:48.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f2476000640 1 -- 172.21.15.144:0/3339629718 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24780b4300 con 0x7f247815af60 2024-09-12T12:15:48.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f246e000640 1 -- 172.21.15.144:0/3339629718 >> v1:172.21.15.165:6789/0 conn(0x7f247815af60 legacy=0x7f24780ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f246e000640 1 -- 172.21.15.144:0/3339629718 >> v1:172.21.15.144:6789/0 conn(0x7f247815b340 legacy=0x7f24780b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.515+0000 7f246e000640 1 -- 172.21.15.144:0/3339629718 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24780b3820 con 0x7f24780cd9f0 2024-09-12T12:15:48.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f246e000640 1 --2- 172.21.15.144:0/3339629718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24780cd9f0 0x7f247806bc10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f24600097c0 tx=0x7f246001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3026fa57dd8bb26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f2476000640 1 -- 172.21.15.144:0/3339629718 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24600b0070 con 0x7f24780cd9f0 2024-09-12T12:15:48.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f2476000640 1 -- 172.21.15.144:0/3339629718 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24600ab600 con 0x7f24780cd9f0 2024-09-12T12:15:48.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f2476000640 1 -- 172.21.15.144:0/3339629718 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24600ab9d0 con 0x7f24780cd9f0 2024-09-12T12:15:48.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f247de00640 1 -- 172.21.15.144:0/3339629718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24780cd9f0 msgr2=0x7f247806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f247de00640 1 --2- 172.21.15.144:0/3339629718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24780cd9f0 0x7f247806bc10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f24600097c0 tx=0x7f246001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f247de00640 1 -- 172.21.15.144:0/3339629718 shutdown_connections 2024-09-12T12:15:48.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f247de00640 1 --2- 172.21.15.144:0/3339629718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24780cd9f0 0x7f247806bc10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f247de00640 1 -- 172.21.15.144:0/3339629718 >> 172.21.15.144:0/3339629718 conn(0x7f2478068030 msgr2=0x7f24780b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f247de00640 1 -- 172.21.15.144:0/3339629718 shutdown_connections 2024-09-12T12:15:48.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.519+0000 7f247de00640 1 -- 172.21.15.144:0/3339629718 wait complete. 2024-09-12T12:15:48.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 Processor -- start 2024-09-12T12:15:48.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 -- start start 2024-09-12T12:15:48.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24780cd9f0 0x7f247814cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f247815af60 0x7f24780b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f247815b340 0x7f24780b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2478169120 con 0x7f24780cd9f0 2024-09-12T12:15:48.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f247806c560 con 0x7f247815b340 2024-09-12T12:15:48.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f24781692a0 con 0x7f247815af60 2024-09-12T12:15:48.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24780cd9f0 0x7f247814cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24780cd9f0 0x7f247814cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41070/0 (socket says 172.21.15.144:41070) 2024-09-12T12:15:48.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2476a00640 1 -- 172.21.15.144:0/3896999903 learned_addr learned my addr 172.21.15.144:0/3896999903 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f246e000640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f247815af60 0x7f24780b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2477400640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f247815b340 0x7f24780b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2476a00640 1 -- 172.21.15.144:0/3896999903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f247815af60 msgr2=0x7f24780b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2476a00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f247815af60 0x7f24780b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2476a00640 1 -- 172.21.15.144:0/3896999903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f247815b340 msgr2=0x7f24780b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2476a00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f247815b340 0x7f24780b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2476a00640 1 -- 172.21.15.144:0/3896999903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2478154fe0 con 0x7f24780cd9f0 2024-09-12T12:15:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f2476a00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24780cd9f0 0x7f247814cd60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f246800c870 tx=0x7f246800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f246fe00640 1 -- 172.21.15.144:0/3896999903 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468003b80 con 0x7f24780cd9f0 2024-09-12T12:15:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f246fe00640 1 -- 172.21.15.144:0/3896999903 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2468003d20 con 0x7f24780cd9f0 2024-09-12T12:15:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f246fe00640 1 -- 172.21.15.144:0/3896999903 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246800aa30 con 0x7f24780cd9f0 2024-09-12T12:15:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 -- 172.21.15.144:0/3896999903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2478156760 con 0x7f24780cd9f0 2024-09-12T12:15:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.523+0000 7f247de00640 1 -- 172.21.15.144:0/3896999903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247814c390 con 0x7f24780cd9f0 2024-09-12T12:15:48.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.527+0000 7f246fe00640 1 -- 172.21.15.144:0/3896999903 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f246800abd0 con 0x7f24780cd9f0 2024-09-12T12:15:48.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.527+0000 7f246fe00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24540678c0 0x7f2454069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.527+0000 7f246fe00640 1 -- 172.21.15.144:0/3896999903 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2468085f00 con 0x7f24780cd9f0 2024-09-12T12:15:48.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.527+0000 7f246e000640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24540678c0 0x7f2454069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.527+0000 7f2481292000 1 Processor -- start 2024-09-12T12:15:48.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.527+0000 7f2481292000 1 -- start start 2024-09-12T12:15:48.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.527+0000 7f246e000640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24540678c0 0x7f2454069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f24600ad000 tx=0x7f2460008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.527+0000 7f2481292000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a733acd70 0x564a733ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.527+0000 7f2481292000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 0x564a73360870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a73360db0 0x564a73361190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564a7324a960 con 0x564a733acd70 2024-09-12T12:15:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564a7318e900 con 0x564a733ad690 2024-09-12T12:15:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x564a731b1d40 con 0x564a73360db0 2024-09-12T12:15:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a733acd70 0x564a733ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a733acd70 0x564a733ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41072/0 (socket says 172.21.15.144:41072) 2024-09-12T12:15:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 -- 172.21.15.144:0/4096898685 learned_addr learned my addr 172.21.15.144:0/4096898685 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f246e000640 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 0x564a73360870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2477400640 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a73360db0 0x564a73361190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 -- 172.21.15.144:0/4096898685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a73360db0 msgr2=0x564a73361190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a73360db0 0x564a73361190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 -- 172.21.15.144:0/4096898685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 msgr2=0x564a73360870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 0x564a73360870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 -- 172.21.15.144:0/4096898685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a73158580 con 0x564a733acd70 2024-09-12T12:15:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2477400640 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a73360db0 0x564a73361190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:48.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a733acd70 0x564a733ad150 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f246805e7c0 tx=0x7f2468012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7000dffcd53e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2467e00640 1 -- 172.21.15.144:0/4096898685 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246805ecf0 con 0x564a733acd70 2024-09-12T12:15:48.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2467e00640 1 -- 172.21.15.144:0/4096898685 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2468054410 con 0x564a733acd70 2024-09-12T12:15:48.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2467e00640 1 -- 172.21.15.144:0/4096898685 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468052780 con 0x564a733acd70 2024-09-12T12:15:48.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- 172.21.15.144:0/4096898685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a733acd70 msgr2=0x564a733ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a733acd70 0x564a733ad150 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f246805e7c0 tx=0x7f2468012000 comp rx=0 tx=0).stop 2024-09-12T12:15:48.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- 172.21.15.144:0/4096898685 shutdown_connections 2024-09-12T12:15:48.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a73360db0 0x564a73361190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 0x564a73360870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 --2- 172.21.15.144:0/4096898685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a733acd70 0x564a733ad150 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- 172.21.15.144:0/4096898685 >> 172.21.15.144:0/4096898685 conn(0x564a7338e040 msgr2=0x564a73390430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- 172.21.15.144:0/4096898685 shutdown_connections 2024-09-12T12:15:48.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- 172.21.15.144:0/4096898685 wait complete. 2024-09-12T12:15:48.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- start start 2024-09-12T12:15:48.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 Processor -- start 2024-09-12T12:15:48.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733acd70 0x564a733b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 0x564a733b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564a731add00 con 0x564a73360db0 2024-09-12T12:15:48.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564a7316caa0 con 0x564a733ad690 2024-09-12T12:15:48.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x564a7314b340 con 0x564a733acd70 2024-09-12T12:15:48.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2481292000 10 client.0 _ll_register_callbacks cb 0x564a7334e760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:48.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.531+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41088/0 (socket says 172.21.15.144:41088) 2024-09-12T12:15:48.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2476a00640 1 -- 172.21.15.144:0/2399339291 learned_addr learned my addr 172.21.15.144:0/2399339291 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f246e000640 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733acd70 0x564a733b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2477400640 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 0x564a733b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2476a00640 1 -- 172.21.15.144:0/2399339291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733acd70 msgr2=0x564a733b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2476a00640 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733acd70 0x564a733b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2476a00640 1 -- 172.21.15.144:0/2399339291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 msgr2=0x564a733b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2476a00640 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 0x564a733b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2476a00640 1 -- 172.21.15.144:0/2399339291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a73154dc0 con 0x564a73360db0 2024-09-12T12:15:48.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2476a00640 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b3ce0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f24680560a0 tx=0x7f2468001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec78da223298a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:48.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 1 -- 172.21.15.144:0/2399339291 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246805ecf0 con 0x564a73360db0 2024-09-12T12:15:48.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 1 -- 172.21.15.144:0/2399339291 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f246807db60 con 0x564a73360db0 2024-09-12T12:15:48.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 -- 172.21.15.144:0/2399339291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2468054410 con 0x564a73360db0 2024-09-12T12:15:48.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 1 -- 172.21.15.144:0/2399339291 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f246807c050 con 0x564a73360db0 2024-09-12T12:15:48.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 10 client.5691 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:48.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 -- 172.21.15.144:0/2399339291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x564a731517f0 con 0x564a73360db0 2024-09-12T12:15:48.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 1 -- 172.21.15.144:0/2399339291 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2468054410 con 0x564a73360db0 2024-09-12T12:15:48.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 1 -- 172.21.15.144:0/2399339291 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f2468055560 con 0x564a73360db0 2024-09-12T12:15:48.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 10 client.5691 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:48.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 10 client.5691 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:48.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 20 client.5691 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:48.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564a733bc0b0 0x564a733be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 4 client.5691 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:48.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 -- 172.21.15.144:0/2399339291 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a7314be10 con 0x564a733bc0b0 2024-09-12T12:15:48.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f246e000640 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564a733bc0b0 0x564a733be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 10 client.5691 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f246e000640 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564a733bc0b0 0x564a733be4a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a767931a645b661 server_cookie=c9af089ede053a54 in_seq=0 out_seq=0 2024-09-12T12:15:48.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 1 -- 172.21.15.144:0/2399339291 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a7314be10 con 0x564a733bc0b0 2024-09-12T12:15:48.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 10 client.5691 handle_command_reply: tid=0 2024-09-12T12:15:48.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 client.5691 shutdown 2024-09-12T12:15:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 -- 172.21.15.144:0/2399339291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 msgr2=0x564a733b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b3ce0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f24680560a0 tx=0x7f2468001260 comp rx=0 tx=0).stop 2024-09-12T12:15:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 -- 172.21.15.144:0/2399339291 shutdown_connections 2024-09-12T12:15:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564a733bc0b0 0x564a733be4a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733ad690 0x564a733b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733acd70 0x564a733b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 --2- 172.21.15.144:0/2399339291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b3ce0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 -- 172.21.15.144:0/2399339291 >> 172.21.15.144:0/2399339291 conn(0x564a7338e040 msgr2=0x564a7335ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2464c00640 0 client.5691 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 -- 172.21.15.144:0/2399339291 shutdown_connections 2024-09-12T12:15:48.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 1 -- 172.21.15.144:0/2399339291 wait complete. 2024-09-12T12:15:48.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.535+0000 7f2481292000 20 client.5691 trim_cache size 0 max 16384 2024-09-12T12:15:48.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 Processor -- start 2024-09-12T12:15:48.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 -- start start 2024-09-12T12:15:48.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733ba360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 0x564a73368ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 0x564a733690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24782046b0 con 0x564a73360db0 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2478203710 con 0x564a733acd70 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f24781f8460 con 0x564a733ad690 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733ba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733ba360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41094/0 (socket says 172.21.15.144:41094) 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2476a00640 1 -- 172.21.15.144:0/3264275963 learned_addr learned my addr 172.21.15.144:0/3264275963 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f246e000640 1 --2- 172.21.15.144:0/3264275963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 0x564a73368ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2477400640 1 --2- 172.21.15.144:0/3264275963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 0x564a733690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2476a00640 1 -- 172.21.15.144:0/3264275963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 msgr2=0x564a733690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2476a00640 1 --2- 172.21.15.144:0/3264275963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 0x564a733690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2476a00640 1 -- 172.21.15.144:0/3264275963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 msgr2=0x564a73368ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2476a00640 1 --2- 172.21.15.144:0/3264275963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 0x564a73368ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2476a00640 1 -- 172.21.15.144:0/3264275963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7316f470 con 0x564a73360db0 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2476a00640 1 --2- 172.21.15.144:0/3264275963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733ba360 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f246805e7c0 tx=0x7f246807f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea939d9bd85625d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2467400640 1 -- 172.21.15.144:0/3264275963 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468055ee0 con 0x564a73360db0 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2467400640 1 -- 172.21.15.144:0/3264275963 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2468074070 con 0x564a73360db0 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2467400640 1 -- 172.21.15.144:0/3264275963 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468054410 con 0x564a73360db0 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 -- 172.21.15.144:0/3264275963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 msgr2=0x564a733ba360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 --2- 172.21.15.144:0/3264275963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733ba360 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f246805e7c0 tx=0x7f246807f040 comp rx=0 tx=0).stop 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 -- 172.21.15.144:0/3264275963 shutdown_connections 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 --2- 172.21.15.144:0/3264275963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 0x564a733690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 --2- 172.21.15.144:0/3264275963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 0x564a73368ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 --2- 172.21.15.144:0/3264275963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733ba360 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 -- 172.21.15.144:0/3264275963 >> 172.21.15.144:0/3264275963 conn(0x564a7338e040 msgr2=0x564a733b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 -- 172.21.15.144:0/3264275963 shutdown_connections 2024-09-12T12:15:48.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.555+0000 7f2481292000 1 -- 172.21.15.144:0/3264275963 wait complete. 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 -- start start 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 Processor -- start 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 0x564a73424b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 0x564a73425090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564a731b1d40 con 0x564a73360db0 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564a7318e900 con 0x564a733acd70 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x564a731add00 con 0x564a733ad690 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 10 client.0 _ll_register_callbacks cb 0x7f24600ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:48.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2476a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41104/0 (socket says 172.21.15.144:41104) 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2476a00640 1 -- 172.21.15.144:0/3101951700 learned_addr learned my addr 172.21.15.144:0/3101951700 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f246e000640 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 0x564a73424b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2477400640 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 0x564a73425090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2476a00640 1 -- 172.21.15.144:0/3101951700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 msgr2=0x564a73425090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2476a00640 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 0x564a73425090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2476a00640 1 -- 172.21.15.144:0/3101951700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 msgr2=0x564a73424b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2476a00640 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 0x564a73424b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2476a00640 1 -- 172.21.15.144:0/3101951700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a73145640 con 0x564a73360db0 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2476a00640 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b9700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f246805e7c0 tx=0x7f24680014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c686d80c63a2016 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2464c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:48.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2464c00640 1 -- 172.21.15.144:0/3101951700 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468055ee0 con 0x564a73360db0 2024-09-12T12:15:48.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2464c00640 1 -- 172.21.15.144:0/3101951700 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2468055560 con 0x564a73360db0 2024-09-12T12:15:48.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 -- 172.21.15.144:0/3101951700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2468074070 con 0x564a73360db0 2024-09-12T12:15:48.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2464c00640 1 -- 172.21.15.144:0/3101951700 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2468054410 con 0x564a73360db0 2024-09-12T12:15:48.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 10 client.5697 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:48.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 -- 172.21.15.144:0/3101951700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x564a731493b0 con 0x564a73360db0 2024-09-12T12:15:48.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2464c00640 1 -- 172.21.15.144:0/3101951700 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2468074070 con 0x564a73360db0 2024-09-12T12:15:48.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2464c00640 1 -- 172.21.15.144:0/3101951700 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f2468054fd0 con 0x564a73360db0 2024-09-12T12:15:48.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 10 client.5697 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:48.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 10 client.5697 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:48.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 20 client.5697 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:48.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564a734255d0 0x564a734259e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 4 client.5697 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:15:48.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2481292000 1 -- 172.21.15.144:0/3101951700 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a731bf470 con 0x564a734255d0 2024-09-12T12:15:48.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f246e000640 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564a734255d0 0x564a734259e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f246e000640 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564a734255d0 0x564a734259e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6a01d53b94d3ecd server_cookie=54cd321503f296a7 in_seq=0 out_seq=0 2024-09-12T12:15:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.559+0000 7f2464c00640 10 client.5697 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2464c00640 1 -- 172.21.15.144:0/3101951700 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x564a731bf470 con 0x564a734255d0 2024-09-12T12:15:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2464c00640 10 client.5697 handle_command_reply: tid=0 2024-09-12T12:15:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 client.5697 shutdown 2024-09-12T12:15:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 -- 172.21.15.144:0/3101951700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 msgr2=0x564a733b9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b9700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f246805e7c0 tx=0x7f24680014e0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 -- 172.21.15.144:0/3101951700 shutdown_connections 2024-09-12T12:15:48.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564a734255d0 0x564a734259e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564a733ad690 0x564a73425090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564a733acd70 0x564a73424b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2464c00640 0 client.5697 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:48.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 --2- 172.21.15.144:0/3101951700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a73360db0 0x564a733b9700 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 -- 172.21.15.144:0/3101951700 >> 172.21.15.144:0/3101951700 conn(0x564a7338e040 msgr2=0x564a73367b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 -- 172.21.15.144:0/3101951700 shutdown_connections 2024-09-12T12:15:48.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 1 -- 172.21.15.144:0/3101951700 wait complete. 2024-09-12T12:15:48.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f2481292000 20 client.5697 trim_cache size 0 max 16384 2024-09-12T12:15:48.573 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:15:48.573 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "12ebb5f1-1a76-475f-b6ae-498da7e8e1c6": { 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "12ebb5f1-1a76-475f-b6ae-498da7e8e1c6", 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "" 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "3450ecce-8892-4e70-bd69-4665db656b01": { 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "3450ecce-8892-4e70-bd69-4665db656b01", 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "" 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "bd572e67-d59c-4289-8d06-10d377ebd202": { 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "bd572e67-d59c-4289-8d06-10d377ebd202", 2024-09-12T12:15:48.574 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "" 2024-09-12T12:15:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "f57a67fd-ce27-4c75-be87-b9df97e6788d": { 2024-09-12T12:15:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-09-12T12:15:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "f57a67fd-ce27-4c75-be87-b9df97e6788d", 2024-09-12T12:15:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "" 2024-09-12T12:15:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:48.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:48.575 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:48.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 -- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24540678c0 msgr2=0x7f2454069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24540678c0 0x7f2454069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f24600ad000 tx=0x7f2460008040 comp rx=0 tx=0).stop 2024-09-12T12:15:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 -- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24780cd9f0 msgr2=0x7f247814cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24780cd9f0 0x7f247814cd60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f246800c870 tx=0x7f246800cd30 comp rx=0 tx=0).stop 2024-09-12T12:15:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 -- 172.21.15.144:0/3896999903 shutdown_connections 2024-09-12T12:15:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24540678c0 0x7f2454069d80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f247815b340 0x7f24780b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f247815af60 0x7f24780b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 --2- 172.21.15.144:0/3896999903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24780cd9f0 0x7f247814cd60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 -- 172.21.15.144:0/3896999903 >> 172.21.15.144:0/3896999903 conn(0x7f2478068030 msgr2=0x7f247814de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 -- 172.21.15.144:0/3896999903 shutdown_connections 2024-09-12T12:15:48.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:48.563+0000 7f247de00640 1 -- 172.21.15.144:0/3896999903 wait complete. 2024-09-12T12:15:53.584 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-12T12:15:53.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-12T12:15:53.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.731+0000 7fd8c7a00640 1 Processor -- start 2024-09-12T12:15:53.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.731+0000 7fd8c7a00640 1 -- start start 2024-09-12T12:15:53.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.731+0000 7fd8c7a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd8c015e570 0x7fd8c0073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.731+0000 7fd8c7a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c006ea70 0x7fd8c00b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.731+0000 7fd8c7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b7220 0x7fd8c006f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.731+0000 7fd8c7a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c0073550 con 0x7fd8c006ea70 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.731+0000 7fd8c7a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c015e950 con 0x7fd8c015e570 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.731+0000 7fd8c7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c006e5e0 con 0x7fd8c00b7220 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c006ea70 0x7fd8c00b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c006ea70 0x7fd8c00b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41120/0 (socket says 172.21.15.144:41120) 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bfe00640 1 -- 172.21.15.144:0/650310591 learned_addr learned my addr 172.21.15.144:0/650310591 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/650310591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b7220 0x7fd8c006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8c5000640 1 --2- 172.21.15.144:0/650310591 >> v2:172.21.15.165:3300/0 conn(0x7fd8c015e570 0x7fd8c0073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bfe00640 1 -- 172.21.15.144:0/650310591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b7220 msgr2=0x7fd8c006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/650310591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b7220 0x7fd8c006f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bfe00640 1 -- 172.21.15.144:0/650310591 >> v2:172.21.15.165:3300/0 conn(0x7fd8c015e570 msgr2=0x7fd8c0073ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/650310591 >> v2:172.21.15.165:3300/0 conn(0x7fd8c015e570 0x7fd8c0073ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bfe00640 1 -- 172.21.15.144:0/650310591 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c006d730 con 0x7fd8c006ea70 2024-09-12T12:15:53.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/650310591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b7220 0x7fd8c006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:53.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/650310591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006ea70 0x7fd8c00b6ce0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd8c006c6b0 tx=0x7fd8ac01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3499c08fe2a6dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.735+0000 7fd8bf400640 1 -- 172.21.15.144:0/650310591 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0b0070 con 0x7fd8c006ea70 2024-09-12T12:15:53.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bf400640 1 -- 172.21.15.144:0/650310591 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac0ab600 con 0x7fd8c006ea70 2024-09-12T12:15:53.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bf400640 1 -- 172.21.15.144:0/650310591 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0ab9d0 con 0x7fd8c006ea70 2024-09-12T12:15:53.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 -- 172.21.15.144:0/650310591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006ea70 msgr2=0x7fd8c00b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/650310591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006ea70 0x7fd8c00b6ce0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd8c006c6b0 tx=0x7fd8ac01c230 comp rx=0 tx=0).stop 2024-09-12T12:15:53.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 -- 172.21.15.144:0/650310591 shutdown_connections 2024-09-12T12:15:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/650310591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006ea70 0x7fd8c00b6ce0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/650310591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b7220 0x7fd8c006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/650310591 >> v2:172.21.15.165:3300/0 conn(0x7fd8c015e570 0x7fd8c0073ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 -- 172.21.15.144:0/650310591 >> 172.21.15.144:0/650310591 conn(0x7fd8c006c010 msgr2=0x7fd8c0067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 -- 172.21.15.144:0/650310591 shutdown_connections 2024-09-12T12:15:53.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 -- 172.21.15.144:0/650310591 wait complete. 2024-09-12T12:15:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 Processor -- start 2024-09-12T12:15:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 -- start start 2024-09-12T12:15:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c006ea70 0x7fd8c0159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c00b7220 0x7fd8c015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015e570 0x7fd8c00b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c00b7630 con 0x7fd8c00b7220 2024-09-12T12:15:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c006e270 con 0x7fd8c006ea70 2024-09-12T12:15:53.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c0074010 con 0x7fd8c015e570 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c00b7220 0x7fd8c015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c00b7220 0x7fd8c015cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41132/0 (socket says 172.21.15.144:41132) 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bfe00640 1 -- 172.21.15.144:0/4045412850 learned_addr learned my addr 172.21.15.144:0/4045412850 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bfe00640 1 -- 172.21.15.144:0/4045412850 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015e570 msgr2=0x7fd8c00b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c5000640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c006ea70 0x7fd8c0159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015e570 0x7fd8c00b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bfe00640 1 -- 172.21.15.144:0/4045412850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c006ea70 msgr2=0x7fd8c0159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c006ea70 0x7fd8c0159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8bfe00640 1 -- 172.21.15.144:0/4045412850 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c014e220 con 0x7fd8c00b7220 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.739+0000 7fd8c5000640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c006ea70 0x7fd8c0159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c00b7220 0x7fd8c015cb40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac01a8e0 tx=0x7fd8ac018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8bcc00640 1 -- 172.21.15.144:0/4045412850 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0b0040 con 0x7fd8c00b7220 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8bcc00640 1 -- 172.21.15.144:0/4045412850 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac0b4420 con 0x7fd8c00b7220 2024-09-12T12:15:53.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8bcc00640 1 -- 172.21.15.144:0/4045412850 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0b47f0 con 0x7fd8c00b7220 2024-09-12T12:15:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8c7a00640 1 -- 172.21.15.144:0/4045412850 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c014e500 con 0x7fd8c00b7220 2024-09-12T12:15:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8c7a00640 1 -- 172.21.15.144:0/4045412850 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c014eac0 con 0x7fd8c00b7220 2024-09-12T12:15:53.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8bcc00640 1 -- 172.21.15.144:0/4045412850 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8ac0b4990 con 0x7fd8c00b7220 2024-09-12T12:15:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8bcc00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678f0 0x7fd8a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8bcc00640 1 -- 172.21.15.144:0/4045412850 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd8ac11f970 con 0x7fd8c00b7220 2024-09-12T12:15:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.743+0000 7fd8c5000640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678f0 0x7fd8a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 Processor -- start 2024-09-12T12:15:53.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 -- start start 2024-09-12T12:15:53.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5000640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678f0 0x7fd8a0069db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009a40 tx=0x7fd8b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec5d70 0x557f31ec6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec6690 0x557f31e79870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31e7a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557f31d63960 con 0x557f31e79db0 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557f31ca7900 con 0x557f31ec5d70 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557f31ccad40 con 0x557f31ec6690 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31e7a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec5d70 0x557f31ec6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31e7a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41136/0 (socket says 172.21.15.144:41136) 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5a00640 1 -- 172.21.15.144:0/1768558007 learned_addr learned my addr 172.21.15.144:0/1768558007 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/1768558007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec6690 0x557f31e79870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5a00640 1 -- 172.21.15.144:0/1768558007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec6690 msgr2=0x557f31e79870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/1768558007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec6690 0x557f31e79870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5a00640 1 -- 172.21.15.144:0/1768558007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec5d70 msgr2=0x557f31ec6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/1768558007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec5d70 0x557f31ec6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5a00640 1 -- 172.21.15.144:0/1768558007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f31c71580 con 0x557f31e79db0 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5000640 1 --2- 172.21.15.144:0/1768558007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec5d70 0x557f31ec6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/1768558007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31e7a190 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009eb0 tx=0x7fd8b8007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb64c4053b734e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8b1600640 1 -- 172.21.15.144:0/1768558007 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8018070 con 0x557f31e79db0 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8b1600640 1 -- 172.21.15.144:0/1768558007 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b8003bc0 con 0x557f31e79db0 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8b1600640 1 -- 172.21.15.144:0/1768558007 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8007e10 con 0x557f31e79db0 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1768558007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 msgr2=0x557f31e7a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/1768558007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31e7a190 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009eb0 tx=0x7fd8b8007700 comp rx=0 tx=0).stop 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1768558007 shutdown_connections 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/1768558007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31e7a190 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/1768558007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec6690 0x557f31e79870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/1768558007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec5d70 0x557f31ec6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1768558007 >> 172.21.15.144:0/1768558007 conn(0x557f31ea7040 msgr2=0x557f31ea9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1768558007 shutdown_connections 2024-09-12T12:15:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.747+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1768558007 wait complete. 2024-09-12T12:15:53.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 -- start start 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 Processor -- start 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 0x557f31eccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31ecd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31ecd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557f31cc6d00 con 0x557f31ec5d70 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557f31c85aa0 con 0x557f31ec6690 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557f31c64340 con 0x557f31e79db0 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 10 client.0 _ll_register_callbacks cb 0x557f31e67760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31ecd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31ecd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41142/0 (socket says 172.21.15.144:41142) 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8bfe00640 1 -- 172.21.15.144:0/3029248114 learned_addr learned my addr 172.21.15.144:0/3029248114 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8c5000640 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 0x557f31eccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31ecd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8bfe00640 1 -- 172.21.15.144:0/3029248114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 msgr2=0x557f31eccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 0x557f31eccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8bfe00640 1 -- 172.21.15.144:0/3029248114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 msgr2=0x557f31ecd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31ecd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8bfe00640 1 -- 172.21.15.144:0/3029248114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f31c6ddc0 con 0x557f31ec5d70 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31ecd220 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0b4000 tx=0x7fd8ac0ab600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913c0f95b758623b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8a6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8a6000640 1 -- 172.21.15.144:0/3029248114 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0f40e0 con 0x557f31ec5d70 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 -- 172.21.15.144:0/3029248114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8b8003bc0 con 0x557f31ec5d70 2024-09-12T12:15:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8a6000640 1 -- 172.21.15.144:0/3029248114 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd8ac0f8480 con 0x557f31ec5d70 2024-09-12T12:15:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8a6000640 1 -- 172.21.15.144:0/3029248114 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd8ac100050 con 0x557f31ec5d70 2024-09-12T12:15:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 10 client.5709 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 -- 172.21.15.144:0/3029248114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x557f31c6a7f0 con 0x557f31ec5d70 2024-09-12T12:15:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8a6000640 1 -- 172.21.15.144:0/3029248114 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b8003bc0 con 0x557f31ec5d70 2024-09-12T12:15:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8a6000640 1 -- 172.21.15.144:0/3029248114 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fd8ac103020 con 0x557f31ec5d70 2024-09-12T12:15:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 10 client.5709 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 10 client.5709 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 20 client.5709 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557f31ed50b0 0x557f31ed74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 4 client.5709 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8cad2d000 1 -- 172.21.15.144:0/3029248114 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f31c64e10 con 0x557f31ed50b0 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8c5000640 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557f31ed50b0 0x557f31ed74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8c5000640 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557f31ed50b0 0x557f31ed74a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e70ef1b17009154 server_cookie=ee1b7eea65e875a9 in_seq=0 out_seq=0 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.751+0000 7fd8a6000640 10 client.5709 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8a6000640 1 -- 172.21.15.144:0/3029248114 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f31c64e10 con 0x557f31ed50b0 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8a6000640 10 client.5709 handle_command_reply: tid=0 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 client.5709 shutdown 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 -- 172.21.15.144:0/3029248114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 msgr2=0x557f31ecd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31ecd220 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0b4000 tx=0x7fd8ac0ab600 comp rx=0 tx=0).stop 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 -- 172.21.15.144:0/3029248114 shutdown_connections 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557f31ed50b0 0x557f31ed74a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31ecd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31ecd220 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/3029248114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 0x557f31eccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8a6000640 0 client.5709 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 -- 172.21.15.144:0/3029248114 >> 172.21.15.144:0/3029248114 conn(0x557f31ea7040 msgr2=0x557f31e78f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 -- 172.21.15.144:0/3029248114 shutdown_connections 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 1 -- 172.21.15.144:0/3029248114 wait complete. 2024-09-12T12:15:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.755+0000 7fd8cad2d000 20 client.5709 trim_cache size 0 max 16384 2024-09-12T12:15:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.771+0000 7fd8cad2d000 1 Processor -- start 2024-09-12T12:15:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.771+0000 7fd8cad2d000 1 -- start start 2024-09-12T12:15:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.771+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 0x557f31edad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.771+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31e81bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.771+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31e82100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.771+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0204200 con 0x557f31ec5d70 2024-09-12T12:15:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.771+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0203200 con 0x557f31ec6690 2024-09-12T12:15:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.771+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c0151d60 con 0x557f31e79db0 2024-09-12T12:15:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.771+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31e81bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31e81bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41148/0 (socket says 172.21.15.144:41148) 2024-09-12T12:15:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8bfe00640 1 -- 172.21.15.144:0/1404529063 learned_addr learned my addr 172.21.15.144:0/1404529063 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31e82100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5000640 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 0x557f31edad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8bfe00640 1 -- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 msgr2=0x557f31edad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 0x557f31edad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8bfe00640 1 -- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 msgr2=0x557f31e82100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31e82100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8bfe00640 1 -- 172.21.15.144:0/1404529063 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f31c88470 con 0x557f31ec5d70 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31e82100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5000640 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 0x557f31edad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31e81bc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0efa30 tx=0x7fd8ac107000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959763fab5eebc8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8b0c00640 1 -- 172.21.15.144:0/1404529063 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0ef690 con 0x557f31ec5d70 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8b0c00640 1 -- 172.21.15.144:0/1404529063 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac11d070 con 0x557f31ec5d70 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8b0c00640 1 -- 172.21.15.144:0/1404529063 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0f86e0 con 0x557f31ec5d70 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1404529063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 msgr2=0x557f31e81bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31e81bc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0efa30 tx=0x7fd8ac107000 comp rx=0 tx=0).stop 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1404529063 shutdown_connections 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31e82100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31ec5d70 0x557f31e81bc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/1404529063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31e79db0 0x557f31edad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1404529063 >> 172.21.15.144:0/1404529063 conn(0x557f31ea7040 msgr2=0x557f31ed2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1404529063 shutdown_connections 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 -- 172.21.15.144:0/1404529063 wait complete. 2024-09-12T12:15:53.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 -- start start 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 Processor -- start 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31f1d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec5d70 0x557f31ed97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31ed9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557f31c92400 con 0x557f31e79db0 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557f31d870c0 con 0x557f31ec6690 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557f31e853f0 con 0x557f31ec5d70 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8cad2d000 10 client.0 _ll_register_callbacks cb 0x7fd8ac0efb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31f1d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31f1d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41160/0 (socket says 172.21.15.144:41160) 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5000640 1 -- 172.21.15.144:0/4109397135 learned_addr learned my addr 172.21.15.144:0/4109397135 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec5d70 0x557f31ed97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31ed9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5000640 1 -- 172.21.15.144:0/4109397135 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec5d70 msgr2=0x557f31ed97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.775+0000 7fd8c5000640 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec5d70 0x557f31ed97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c5000640 1 -- 172.21.15.144:0/4109397135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 msgr2=0x557f31ed9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c5000640 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31ed9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c5000640 1 -- 172.21.15.144:0/4109397135 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f31c5e640 con 0x557f31e79db0 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c5a00640 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31ed9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c5000640 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31f1d030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40156a0 tx=0x7fd8b40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2b92d49abe91de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 1 -- 172.21.15.144:0/4109397135 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4031060 con 0x557f31e79db0 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 1 -- 172.21.15.144:0/4109397135 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd8b402b680 con 0x557f31e79db0 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 -- 172.21.15.144:0/4109397135 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8ac11d070 con 0x557f31e79db0 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 1 -- 172.21.15.144:0/4109397135 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd8b4037050 con 0x557f31e79db0 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 10 client.5715 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:53.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 -- 172.21.15.144:0/4109397135 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x557f31c623b0 con 0x557f31e79db0 2024-09-12T12:15:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 1 -- 172.21.15.144:0/4109397135 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac11d070 con 0x557f31e79db0 2024-09-12T12:15:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 1 -- 172.21.15.144:0/4109397135 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fd8b403a020 con 0x557f31e79db0 2024-09-12T12:15:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 10 client.5715 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 10 client.5715 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 20 client.5715 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557f31eda260 0x557f31eda670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 4 client.5715 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:15:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 -- 172.21.15.144:0/4109397135 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f31cd8470 con 0x557f31eda260 2024-09-12T12:15:53.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557f31eda260 0x557f31eda670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557f31eda260 0x557f31eda670 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e078742506443a15 server_cookie=801225794e6e0ee3 in_seq=0 out_seq=0 2024-09-12T12:15:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 10 client.5715 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 1 -- 172.21.15.144:0/4109397135 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557f31cd8470 con 0x557f31eda260 2024-09-12T12:15:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 10 client.5715 handle_command_reply: tid=0 2024-09-12T12:15:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 client.5715 shutdown 2024-09-12T12:15:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 -- 172.21.15.144:0/4109397135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 msgr2=0x557f31f1d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31f1d030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40156a0 tx=0x7fd8b40046d0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 -- 172.21.15.144:0/4109397135 shutdown_connections 2024-09-12T12:15:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x557f31eda260 0x557f31eda670 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557f31ec6690 0x557f31ed9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557f31ec5d70 0x557f31ed97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8a6000640 0 client.5715 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 --2- 172.21.15.144:0/4109397135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557f31e79db0 0x557f31f1d030 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 -- 172.21.15.144:0/4109397135 >> 172.21.15.144:0/4109397135 conn(0x557f31ea7040 msgr2=0x557f31ed32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 -- 172.21.15.144:0/4109397135 shutdown_connections 2024-09-12T12:15:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 1 -- 172.21.15.144:0/4109397135 wait complete. 2024-09-12T12:15:53.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8cad2d000 20 client.5715 trim_cache size 0 max 16384 2024-09-12T12:15:53.789 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:53.789 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "no active scrubs running", 2024-09-12T12:15:53.790 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:15:53.790 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:53.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 -- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678f0 msgr2=0x7fd8a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678f0 0x7fd8a0069db0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009a40 tx=0x7fd8b4008040 comp rx=0 tx=0).stop 2024-09-12T12:15:53.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 -- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c00b7220 msgr2=0x7fd8c015cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c00b7220 0x7fd8c015cb40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac01a8e0 tx=0x7fd8ac018fd0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 -- 172.21.15.144:0/4045412850 shutdown_connections 2024-09-12T12:15:53.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678f0 0x7fd8a0069db0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015e570 0x7fd8c00b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c00b7220 0x7fd8c015cb40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 --2- 172.21.15.144:0/4045412850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c006ea70 0x7fd8c0159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 -- 172.21.15.144:0/4045412850 >> 172.21.15.144:0/4045412850 conn(0x7fd8c006c010 msgr2=0x7fd8c0067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 -- 172.21.15.144:0/4045412850 shutdown_connections 2024-09-12T12:15:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.779+0000 7fd8c7a00640 1 -- 172.21.15.144:0/4045412850 wait complete. 2024-09-12T12:15:53.802 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:15:53.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-12T12:15:53.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbde1400640 1 Processor -- start 2024-09-12T12:15:53.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbde1400640 1 -- start start 2024-09-12T12:15:53.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbde1400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbddc1517d0 0x7fbddc0d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbde1400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc0cd630 con 0x7fbddc0ccde0 2024-09-12T12:15:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbde1400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc0cd910 con 0x7fbddc15eb50 2024-09-12T12:15:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbde1400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbddc0cdbf0 con 0x7fbddc1517d0 2024-09-12T12:15:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbddbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbddc1517d0 0x7fbddc0d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbddbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbddc1517d0 0x7fbddc0d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41174/0 (socket says 172.21.15.144:41174) 2024-09-12T12:15:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbddb400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbddc0ccde0 0x7fbddc15e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53846/0 (socket says 172.21.15.144:53846) 2024-09-12T12:15:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.939+0000 7fbddbe00640 1 -- 172.21.15.144:0/789652371 learned_addr learned my addr 172.21.15.144:0/789652371 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbddbe00640 1 -- 172.21.15.144:0/789652371 >> v1:172.21.15.165:6789/0 conn(0x7fbddc15eb50 legacy=0x7fbddc1645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbddbe00640 1 -- 172.21.15.144:0/789652371 >> v1:172.21.15.144:6789/0 conn(0x7fbddc0ccde0 legacy=0x7fbddc15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbddbe00640 1 -- 172.21.15.144:0/789652371 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc0cded0 con 0x7fbddc1517d0 2024-09-12T12:15:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbddaa00640 1 -- 172.21.15.144:0/789652371 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1883273295 0 0) 0x7fbddc0cd630 con 0x7fbddc0ccde0 2024-09-12T12:15:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbddbe00640 1 --2- 172.21.15.144:0/789652371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc1517d0 0x7fbddc0d0600 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00af60 tx=0x7fbdcc01db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbc1f9ad08ecc31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbddaa00640 1 -- 172.21.15.144:0/789652371 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc00a2d0 con 0x7fbddc1517d0 2024-09-12T12:15:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbddaa00640 1 -- 172.21.15.144:0/789652371 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0a6880 con 0x7fbddc1517d0 2024-09-12T12:15:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbddaa00640 1 -- 172.21.15.144:0/789652371 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0a6c50 con 0x7fbddc1517d0 2024-09-12T12:15:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbde1400640 1 -- 172.21.15.144:0/789652371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc1517d0 msgr2=0x7fbddc0d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbde1400640 1 --2- 172.21.15.144:0/789652371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc1517d0 0x7fbddc0d0600 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00af60 tx=0x7fbdcc01db30 comp rx=0 tx=0).stop 2024-09-12T12:15:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbde1400640 1 -- 172.21.15.144:0/789652371 shutdown_connections 2024-09-12T12:15:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbde1400640 1 --2- 172.21.15.144:0/789652371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc1517d0 0x7fbddc0d0600 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbde1400640 1 -- 172.21.15.144:0/789652371 >> 172.21.15.144:0/789652371 conn(0x7fbddc06e7e0 msgr2=0x7fbddc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbde1400640 1 -- 172.21.15.144:0/789652371 shutdown_connections 2024-09-12T12:15:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.943+0000 7fbde1400640 1 -- 172.21.15.144:0/789652371 wait complete. 2024-09-12T12:15:53.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 Processor -- start 2024-09-12T12:15:53.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 -- start start 2024-09-12T12:15:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc0ccde0 0x7fbddc0724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc1517d0 0x7fbddc153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15eb50 0x7fbddc1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc0cd360 con 0x7fbddc0ccde0 2024-09-12T12:15:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc0cd1e0 con 0x7fbddc1517d0 2024-09-12T12:15:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbddc167cd0 con 0x7fbddc15eb50 2024-09-12T12:15:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc0ccde0 0x7fbddc0724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc0ccde0 0x7fbddc0724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41182/0 (socket says 172.21.15.144:41182) 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddbe00640 1 -- 172.21.15.144:0/3651401383 learned_addr learned my addr 172.21.15.144:0/3651401383 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddb400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc1517d0 0x7fbddc153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde0a00640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15eb50 0x7fbddc1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddbe00640 1 -- 172.21.15.144:0/3651401383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15eb50 msgr2=0x7fbddc1498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddbe00640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15eb50 0x7fbddc1498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddbe00640 1 -- 172.21.15.144:0/3651401383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc1517d0 msgr2=0x7fbddc153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddbe00640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc1517d0 0x7fbddc153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddbe00640 1 -- 172.21.15.144:0/3651401383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc14ce20 con 0x7fbddc0ccde0 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddb400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc1517d0 0x7fbddc153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbddbe00640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc0ccde0 0x7fbddc0724e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00af60 tx=0x7fbdcc01a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbdd3e00640 1 -- 172.21.15.144:0/3651401383 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0bd020 con 0x7fbddc0ccde0 2024-09-12T12:15:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbdd3e00640 1 -- 172.21.15.144:0/3651401383 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc008700 con 0x7fbddc0ccde0 2024-09-12T12:15:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbdd3e00640 1 -- 172.21.15.144:0/3651401383 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc008ad0 con 0x7fbddc0ccde0 2024-09-12T12:15:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 -- 172.21.15.144:0/3651401383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc14d160 con 0x7fbddc0ccde0 2024-09-12T12:15:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.947+0000 7fbde1400640 1 -- 172.21.15.144:0/3651401383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbddc14d9a0 con 0x7fbddc0ccde0 2024-09-12T12:15:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.951+0000 7fbdd3e00640 1 -- 172.21.15.144:0/3651401383 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbdcc0c0070 con 0x7fbddc0ccde0 2024-09-12T12:15:53.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.951+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdbc0678c0 0x7fbdbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.951+0000 7fbdd3e00640 1 -- 172.21.15.144:0/3651401383 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fbdcc120270 con 0x7fbddc0ccde0 2024-09-12T12:15:53.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.951+0000 7fbddb400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdbc0678c0 0x7fbdbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.951+0000 7fbde5d23000 1 Processor -- start 2024-09-12T12:15:53.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.951+0000 7fbde5d23000 1 -- start start 2024-09-12T12:15:53.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.951+0000 7fbddb400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdbc0678c0 0x7fbdbc069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbddc154bb0 tx=0x7fbdc8007c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c130b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c12c1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 0x55c5c12c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c5c11a8c40 con 0x55c5c130bca0 2024-09-12T12:15:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c5c110fd50 con 0x55c5c130b380 2024-09-12T12:15:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c5c10caab0 con 0x55c5c12c17d0 2024-09-12T12:15:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c12c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c12c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41194/0 (socket says 172.21.15.144:41194) 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddb400640 1 -- 172.21.15.144:0/349809237 learned_addr learned my addr 172.21.15.144:0/349809237 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddbe00640 1 --2- 172.21.15.144:0/349809237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c130b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde0a00640 1 --2- 172.21.15.144:0/349809237 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 0x55c5c12c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddb400640 1 -- 172.21.15.144:0/349809237 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 msgr2=0x55c5c12c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddb400640 1 --2- 172.21.15.144:0/349809237 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 0x55c5c12c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddb400640 1 -- 172.21.15.144:0/349809237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 msgr2=0x55c5c130b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddb400640 1 --2- 172.21.15.144:0/349809237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c130b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddb400640 1 -- 172.21.15.144:0/349809237 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5c10b6590 con 0x55c5c130bca0 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbddb400640 1 --2- 172.21.15.144:0/349809237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c12c1290 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8000c10 tx=0x7fbdc8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a0e877ab7c085c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbdd0c00640 1 -- 172.21.15.144:0/349809237 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8015110 con 0x55c5c130bca0 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbdd0c00640 1 -- 172.21.15.144:0/349809237 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc80159c0 con 0x55c5c130bca0 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbdd0c00640 1 -- 172.21.15.144:0/349809237 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8015d70 con 0x55c5c130bca0 2024-09-12T12:15:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 -- 172.21.15.144:0/349809237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 msgr2=0x55c5c12c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 --2- 172.21.15.144:0/349809237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c12c1290 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8000c10 tx=0x7fbdc8012000 comp rx=0 tx=0).stop 2024-09-12T12:15:53.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 -- 172.21.15.144:0/349809237 shutdown_connections 2024-09-12T12:15:53.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 --2- 172.21.15.144:0/349809237 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 0x55c5c12c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 --2- 172.21.15.144:0/349809237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c12c1290 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 --2- 172.21.15.144:0/349809237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c130b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 -- 172.21.15.144:0/349809237 >> 172.21.15.144:0/349809237 conn(0x55c5c12b8bc0 msgr2=0x55c5c12bfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 -- 172.21.15.144:0/349809237 shutdown_connections 2024-09-12T12:15:53.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 -- 172.21.15.144:0/349809237 wait complete. 2024-09-12T12:15:53.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 -- start start 2024-09-12T12:15:53.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.955+0000 7fbde5d23000 1 Processor -- start 2024-09-12T12:15:53.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c12c17d0 0x55c5c12c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c12f4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 0x55c5c12f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c5c10ce400 con 0x55c5c12c17d0 2024-09-12T12:15:53.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c5c11cc3a0 con 0x55c5c130b380 2024-09-12T12:15:53.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c5c114f260 con 0x55c5c130bca0 2024-09-12T12:15:53.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 10 client.0 _ll_register_callbacks cb 0x55c5c1171020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c12c17d0 0x55c5c12c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c12c17d0 0x55c5c12c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41196/0 (socket says 172.21.15.144:41196) 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddbe00640 1 -- 172.21.15.144:0/3595167914 learned_addr learned my addr 172.21.15.144:0/3595167914 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddb400640 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c12f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde0a00640 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 0x55c5c12f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddbe00640 1 -- 172.21.15.144:0/3595167914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 msgr2=0x55c5c12f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddbe00640 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 0x55c5c12f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddbe00640 1 -- 172.21.15.144:0/3595167914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 msgr2=0x55c5c12f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddbe00640 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c12f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddbe00640 1 -- 172.21.15.144:0/3595167914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5c10b2dd0 con 0x55c5c12c17d0 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde0a00640 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 0x55c5c12f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddbe00640 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c12c17d0 0x55c5c12c6820 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc01db70 tx=0x7fbdcc0efea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52888d83bc17129 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 1 -- 172.21.15.144:0/3595167914 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0f08e0 con 0x55c5c12c17d0 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 1 -- 172.21.15.144:0/3595167914 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fbdcc0f8bd0 con 0x55c5c12c17d0 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 -- 172.21.15.144:0/3595167914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdc80159c0 con 0x55c5c12c17d0 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 1 -- 172.21.15.144:0/3595167914 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbdcc0f4830 con 0x55c5c12c17d0 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 10 client.5730 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 -- 172.21.15.144:0/3595167914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55c5c10af800 con 0x55c5c12c17d0 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 1 -- 172.21.15.144:0/3595167914 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc80159c0 con 0x55c5c12c17d0 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 1 -- 172.21.15.144:0/3595167914 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fbdcc11e0d0 con 0x55c5c12c17d0 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 10 client.5730 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 10 client.5730 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 20 client.5730 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c5c12c6d60 0x55c5c12f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 4 client.5730 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 -- 172.21.15.144:0/3595167914 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5c10a9e20 con 0x55c5c12c6d60 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddb400640 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c5c12c6d60 0x55c5c12f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 10 client.5730 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbddb400640 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c5c12c6d60 0x55c5c12f5cb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1576bee57802f682 server_cookie=9d564f84a5a67861 in_seq=0 out_seq=0 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 1 -- 172.21.15.144:0/3595167914 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5c10a9e20 con 0x55c5c12c6d60 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 10 client.5730 handle_command_reply: tid=0 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 client.5730 shutdown 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 -- 172.21.15.144:0/3595167914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c12c17d0 msgr2=0x55c5c12c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c12c17d0 0x55c5c12c6820 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc01db70 tx=0x7fbdcc0efea0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 -- 172.21.15.144:0/3595167914 shutdown_connections 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c5c12c6d60 0x55c5c12f5cb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 0x55c5c12f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c12f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 --2- 172.21.15.144:0/3595167914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c12c17d0 0x55c5c12c6820 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbdc5600640 0 client.5730 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.959+0000 7fbde5d23000 1 -- 172.21.15.144:0/3595167914 >> 172.21.15.144:0/3595167914 conn(0x55c5c12b8bc0 msgr2=0x55c5c12c0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.963+0000 7fbde5d23000 1 -- 172.21.15.144:0/3595167914 shutdown_connections 2024-09-12T12:15:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.963+0000 7fbde5d23000 1 -- 172.21.15.144:0/3595167914 wait complete. 2024-09-12T12:15:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.963+0000 7fbde5d23000 20 client.5730 trim_cache size 0 max 16384 2024-09-12T12:15:53.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde5d23000 1 Processor -- start 2024-09-12T12:15:53.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde5d23000 1 -- start start 2024-09-12T12:15:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 0x55c5c1379f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c137a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c137a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde5d23000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc200b90 con 0x55c5c130bca0 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde5d23000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc14eab0 con 0x55c5c130b380 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde5d23000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbddc14f100 con 0x55c5c12c17d0 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c137a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c137a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41208/0 (socket says 172.21.15.144:41208) 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde0a00640 1 -- 172.21.15.144:0/1533256633 learned_addr learned my addr 172.21.15.144:0/1533256633 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbddb400640 1 --2- 172.21.15.144:0/1533256633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c137a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbddbe00640 1 --2- 172.21.15.144:0/1533256633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 0x55c5c1379f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde0a00640 1 -- 172.21.15.144:0/1533256633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 msgr2=0x55c5c1379f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde0a00640 1 --2- 172.21.15.144:0/1533256633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 0x55c5c1379f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde0a00640 1 -- 172.21.15.144:0/1533256633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 msgr2=0x55c5c137a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde0a00640 1 --2- 172.21.15.144:0/1533256633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c137a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde0a00640 1 -- 172.21.15.144:0/1533256633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5c10cd480 con 0x55c5c130bca0 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbde0a00640 1 --2- 172.21.15.144:0/1533256633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c137a9f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4005310 tx=0x7fbdd40039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b78ba88b87f938 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbdc7e00640 1 -- 172.21.15.144:0/1533256633 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd401a020 con 0x55c5c130bca0 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbdc7e00640 1 -- 172.21.15.144:0/1533256633 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd4016660 con 0x55c5c130bca0 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.975+0000 7fbdc7e00640 1 -- 172.21.15.144:0/1533256633 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4016a30 con 0x55c5c130bca0 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- 172.21.15.144:0/1533256633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 msgr2=0x55c5c137a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1533256633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c137a9f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4005310 tx=0x7fbdd40039d0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- 172.21.15.144:0/1533256633 shutdown_connections 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1533256633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130bca0 0x55c5c137a9f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1533256633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c130b380 0x55c5c137a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1533256633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c12c17d0 0x55c5c1379f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- 172.21.15.144:0/1533256633 >> 172.21.15.144:0/1533256633 conn(0x55c5c12b8bc0 msgr2=0x55c5c12c5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- 172.21.15.144:0/1533256633 shutdown_connections 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- 172.21.15.144:0/1533256633 wait complete. 2024-09-12T12:15:53.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- start start 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 Processor -- start 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c12c17d0 0x55c5c1320e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130b380 0x55c5c1321340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 0x55c5c1321880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c5c10b5f30 con 0x55c5c130b380 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c5c10ce7d0 con 0x55c5c12c17d0 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c5c110f060 con 0x55c5c130bca0 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 10 client.0 _ll_register_callbacks cb 0x7fbdcc1200b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130b380 0x55c5c1321340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130b380 0x55c5c1321340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41210/0 (socket says 172.21.15.144:41210) 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddb400640 1 -- 172.21.15.144:0/1352020474 learned_addr learned my addr 172.21.15.144:0/1352020474 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddbe00640 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c12c17d0 0x55c5c1320e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde0a00640 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 0x55c5c1321880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddb400640 1 -- 172.21.15.144:0/1352020474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 msgr2=0x55c5c1321880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddb400640 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 0x55c5c1321880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddb400640 1 -- 172.21.15.144:0/1352020474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c12c17d0 msgr2=0x55c5c1320e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddb400640 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c12c17d0 0x55c5c1320e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddb400640 1 -- 172.21.15.144:0/1352020474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5c10a3650 con 0x55c5c130b380 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbddb400640 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130b380 0x55c5c1321340 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8000f70 tx=0x7fbdc8007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed7ae92a8aec551 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbdc5600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbdc5600640 1 -- 172.21.15.144:0/1352020474 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80152a0 con 0x55c5c130b380 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbdc5600640 1 -- 172.21.15.144:0/1352020474 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fbdc802ecc0 con 0x55c5c130b380 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- 172.21.15.144:0/1352020474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdd4016660 con 0x55c5c130b380 2024-09-12T12:15:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbdc5600640 1 -- 172.21.15.144:0/1352020474 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbdc803d050 con 0x55c5c130b380 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 10 client.5736 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 1 -- 172.21.15.144:0/1352020474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55c5c10a73c0 con 0x55c5c130b380 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbdc5600640 1 -- 172.21.15.144:0/1352020474 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd4016660 con 0x55c5c130b380 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbdc5600640 1 -- 172.21.15.144:0/1352020474 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fbdc8015bd0 con 0x55c5c130b380 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 10 client.5736 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.979+0000 7fbde5d23000 10 client.5736 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 20 client.5736 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c5c13661a0 0x55c5c1321dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 4 client.5736 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 -- 172.21.15.144:0/1352020474 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c5c111d480 con 0x55c5c13661a0 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbddbe00640 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c5c13661a0 0x55c5c1321dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbddbe00640 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c5c13661a0 0x55c5c1321dc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8908b759128df18 server_cookie=1d0f223724e2aa01 in_seq=0 out_seq=0 2024-09-12T12:15:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbdc5600640 10 client.5736 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbdc5600640 1 -- 172.21.15.144:0/1352020474 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x55c5c111d480 con 0x55c5c13661a0 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbdc5600640 10 client.5736 handle_command_reply: tid=0 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 client.5736 shutdown 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 -- 172.21.15.144:0/1352020474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130b380 msgr2=0x55c5c1321340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130b380 0x55c5c1321340 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8000f70 tx=0x7fbdc8007a20 comp rx=0 tx=0).stop 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 -- 172.21.15.144:0/1352020474 shutdown_connections 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c5c13661a0 0x55c5c1321dc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c5c130bca0 0x55c5c1321880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5c130b380 0x55c5c1321340 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 --2- 172.21.15.144:0/1352020474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5c12c17d0 0x55c5c1320e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbdc5600640 0 client.5736 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 -- 172.21.15.144:0/1352020474 >> 172.21.15.144:0/1352020474 conn(0x55c5c12b8bc0 msgr2=0x55c5c12f4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 -- 172.21.15.144:0/1352020474 shutdown_connections 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 1 -- 172.21.15.144:0/1352020474 wait complete. 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde5d23000 20 client.5736 trim_cache size 0 max 16384 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "damage_type": "backtrace", 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 3480052279, 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 1099511630409, 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:53.992 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:15:53.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 -- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdbc0678c0 msgr2=0x7fbdbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdbc0678c0 0x7fbdbc069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbddc154bb0 tx=0x7fbdc8007c60 comp rx=0 tx=0).stop 2024-09-12T12:15:53.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 -- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc0ccde0 msgr2=0x7fbddc0724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:53.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc0ccde0 0x7fbddc0724e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00af60 tx=0x7fbdcc01a8d0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 -- 172.21.15.144:0/3651401383 shutdown_connections 2024-09-12T12:15:53.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdbc0678c0 0x7fbdbc069d80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15eb50 0x7fbddc1498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc1517d0 0x7fbddc153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 --2- 172.21.15.144:0/3651401383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc0ccde0 0x7fbddc0724e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:53.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 -- 172.21.15.144:0/3651401383 >> 172.21.15.144:0/3651401383 conn(0x7fbddc06e7e0 msgr2=0x7fbddc15c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:53.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 -- 172.21.15.144:0/3651401383 shutdown_connections 2024-09-12T12:15:53.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:53.983+0000 7fbde1400640 1 -- 172.21.15.144:0/3651401383 wait complete. 2024-09-12T12:15:54.007 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:15:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb78b800640 1 Processor -- start 2024-09-12T12:15:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb78b800640 1 -- start start 2024-09-12T12:15:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb78b800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb78415e580 0x7fb7840b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb78b800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb78406ea20 0x7fb7840b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb78b800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78406d9a0 con 0x7fb78406cc70 2024-09-12T12:15:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb78b800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb7840b73e0 con 0x7fb78406ea20 2024-09-12T12:15:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb78b800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb78406df40 con 0x7fb78415e580 2024-09-12T12:15:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb783e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb78406ea20 0x7fb7840b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb783e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb78406ea20 0x7fb7840b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41224/0 (socket says 172.21.15.144:41224) 2024-09-12T12:15:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb783e00640 1 -- 172.21.15.144:0/1177710233 learned_addr learned my addr 172.21.15.144:0/1177710233 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb788e00640 1 --2- 172.21.15.144:0/1177710233 >> v2:172.21.15.165:3300/0 conn(0x7fb78415e580 0x7fb7840b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb783e00640 1 -- 172.21.15.144:0/1177710233 >> v2:172.21.15.165:3300/0 conn(0x7fb78415e580 msgr2=0x7fb7840b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb783e00640 1 --2- 172.21.15.144:0/1177710233 >> v2:172.21.15.165:3300/0 conn(0x7fb78415e580 0x7fb7840b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb783e00640 1 -- 172.21.15.144:0/1177710233 >> v1:172.21.15.165:6789/0 conn(0x7fb78406cc70 legacy=0x7fb78406d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.143+0000 7fb783e00640 1 -- 172.21.15.144:0/1177710233 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78406e220 con 0x7fb78406ea20 2024-09-12T12:15:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb783e00640 1 --2- 172.21.15.144:0/1177710233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 0x7fb7840b6ea0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb7840b5200 tx=0x7fb77001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a55e2260fb4284 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb783400640 1 -- 172.21.15.144:0/1177710233 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7700b0070 con 0x7fb78406ea20 2024-09-12T12:15:54.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb783400640 1 -- 172.21.15.144:0/1177710233 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7700ab600 con 0x7fb78406ea20 2024-09-12T12:15:54.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb783400640 1 -- 172.21.15.144:0/1177710233 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7700ab9d0 con 0x7fb78406ea20 2024-09-12T12:15:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb78b800640 1 -- 172.21.15.144:0/1177710233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 msgr2=0x7fb7840b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb78b800640 1 --2- 172.21.15.144:0/1177710233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 0x7fb7840b6ea0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb7840b5200 tx=0x7fb77001c520 comp rx=0 tx=0).stop 2024-09-12T12:15:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb78b800640 1 -- 172.21.15.144:0/1177710233 shutdown_connections 2024-09-12T12:15:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb78b800640 1 --2- 172.21.15.144:0/1177710233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 0x7fb7840b6ea0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb78b800640 1 --2- 172.21.15.144:0/1177710233 >> v2:172.21.15.165:3300/0 conn(0x7fb78415e580 0x7fb7840b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb78b800640 1 -- 172.21.15.144:0/1177710233 >> 172.21.15.144:0/1177710233 conn(0x7fb784067a00 msgr2=0x7fb784067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb78b800640 1 -- 172.21.15.144:0/1177710233 shutdown_connections 2024-09-12T12:15:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.147+0000 7fb78b800640 1 -- 172.21.15.144:0/1177710233 wait complete. 2024-09-12T12:15:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 Processor -- start 2024-09-12T12:15:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 -- start start 2024-09-12T12:15:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb78406cc70 0x7fb7841609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 0x7fb78414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78415e580 0x7fb7840cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840cc3f0 con 0x7fb78406ea20 2024-09-12T12:15:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840cc270 con 0x7fb78415e580 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7840cc570 con 0x7fb78406cc70 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb783e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 0x7fb78414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb783e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 0x7fb78414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41228/0 (socket says 172.21.15.144:41228) 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb783e00640 1 -- 172.21.15.144:0/650144944 learned_addr learned my addr 172.21.15.144:0/650144944 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb788e00640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb78406cc70 0x7fb7841609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb789800640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78415e580 0x7fb7840cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb783e00640 1 -- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb78406cc70 msgr2=0x7fb7841609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb783e00640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb78406cc70 0x7fb7841609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb783e00640 1 -- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78415e580 msgr2=0x7fb7840cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb783e00640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78415e580 0x7fb7840cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb783e00640 1 -- 172.21.15.144:0/650144944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78414de90 con 0x7fb78406ea20 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb788e00640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb78406cc70 0x7fb7841609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb789800640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78415e580 0x7fb7840cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb783e00640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 0x7fb78414d950 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ae040 tx=0x7fb7700192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb780c00640 1 -- 172.21.15.144:0/650144944 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7700b0040 con 0x7fb78406ea20 2024-09-12T12:15:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb780c00640 1 -- 172.21.15.144:0/650144944 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7700b4420 con 0x7fb78406ea20 2024-09-12T12:15:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb780c00640 1 -- 172.21.15.144:0/650144944 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7700b47f0 con 0x7fb78406ea20 2024-09-12T12:15:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78414e130 con 0x7fb78406ea20 2024-09-12T12:15:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.151+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78414e6f0 con 0x7fb78406ea20 2024-09-12T12:15:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.155+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78406d0c0 con 0x7fb78406ea20 2024-09-12T12:15:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.155+0000 7fb780c00640 1 -- 172.21.15.144:0/650144944 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7700b4990 con 0x7fb78406ea20 2024-09-12T12:15:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.155+0000 7fb780c00640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7640678c0 0x7fb764069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.155+0000 7fb780c00640 1 -- 172.21.15.144:0/650144944 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fb77011f980 con 0x7fb78406ea20 2024-09-12T12:15:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.155+0000 7fb788e00640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7640678c0 0x7fb764069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.155+0000 7fb788e00640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7640678c0 0x7fb764069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb778009b10 tx=0x7fb778008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.159+0000 7fb780c00640 1 -- 172.21.15.144:0/650144944 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb770016110 con 0x7fb78406ea20 2024-09-12T12:15:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.347+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7841528d0 con 0x7fb78406ea20 2024-09-12T12:15:54.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.347+0000 7fb780c00640 1 -- 172.21.15.144:0/650144944 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5229 (secure 0 0 0) 0x7fb7700f0440 con 0x7fb78406ea20 2024-09-12T12:15:54.351 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:15:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-12T12:15:33:003315+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/149604375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":149604375},{"type":"v1","addr":"172.21.15.165:6834","nonce":149604375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3844758833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3844758833},{"type":"v1","addr":"172.21.15.144:6837","nonce":3844758833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/639962972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":639962972},{"type":"v1","addr":"172.21.15.165:6835","nonce":639962972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:15:29.364348+0000","modified":"2024-09-12T12:15:32.389508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6836/3957430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3957430285},{"type":"v1","addr":"172.21.15.144:6836","nonce":3957430285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-12T12:15:54.351 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-12T12:15:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7640678c0 msgr2=0x7fb764069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7640678c0 0x7fb764069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb778009b10 tx=0x7fb778008040 comp rx=0 tx=0).stop 2024-09-12T12:15:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 msgr2=0x7fb78414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 0x7fb78414d950 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ae040 tx=0x7fb7700192c0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 shutdown_connections 2024-09-12T12:15:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7640678c0 0x7fb764069d80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78415e580 0x7fb7840cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb78406ea20 0x7fb78414d950 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 --2- 172.21.15.144:0/650144944 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb78406cc70 0x7fb7841609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 >> 172.21.15.144:0/650144944 conn(0x7fb784067a00 msgr2=0x7fb7840cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 shutdown_connections 2024-09-12T12:15:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.351+0000 7fb78b800640 1 -- 172.21.15.144:0/650144944 wait complete. 2024-09-12T12:15:54.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 3480052279 2024-09-12T12:15:54.466 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:15:54.463+0000 7fac71e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T12:15:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dd0600640 1 Processor -- start 2024-09-12T12:15:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dd0600640 1 -- start start 2024-09-12T12:15:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dd0600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0dc815c2e0 0x7f0dc8072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dd0600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc80af5f0 0x7f0dc806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dd0600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0dc806c150 0x7f0dc806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dd0600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc806c5c0 con 0x7f0dc815c2e0 2024-09-12T12:15:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dd0600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc80733e0 con 0x7f0dc806c150 2024-09-12T12:15:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dd0600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc80cd290 con 0x7f0dc80af5f0 2024-09-12T12:15:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dcdc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0dc815c2e0 0x7f0dc8072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dcdc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0dc815c2e0 0x7f0dc8072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41234/0 (socket says 172.21.15.144:41234) 2024-09-12T12:15:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dcdc00640 1 -- 172.21.15.144:0/397305699 learned_addr learned my addr 172.21.15.144:0/397305699 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dce600640 1 --2- 172.21.15.144:0/397305699 >> v2:172.21.15.165:3300/0 conn(0x7f0dc806c150 0x7f0dc806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dcd200640 1 --2- 172.21.15.144:0/397305699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc80af5f0 0x7f0dc806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.511+0000 7f0dcdc00640 1 -- 172.21.15.144:0/397305699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc80af5f0 msgr2=0x7f0dc806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/397305699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc80af5f0 0x7f0dc806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dcdc00640 1 -- 172.21.15.144:0/397305699 >> v2:172.21.15.165:3300/0 conn(0x7f0dc806c150 msgr2=0x7f0dc806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/397305699 >> v2:172.21.15.165:3300/0 conn(0x7f0dc806c150 0x7f0dc806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dcdc00640 1 -- 172.21.15.144:0/397305699 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc80cd570 con 0x7f0dc815c2e0 2024-09-12T12:15:54.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dce600640 1 --2- 172.21.15.144:0/397305699 >> v2:172.21.15.165:3300/0 conn(0x7f0dc806c150 0x7f0dc806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:54.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dcd200640 1 --2- 172.21.15.144:0/397305699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc80af5f0 0x7f0dc806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/397305699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc815c2e0 0x7f0dc8072b50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80aff30 tx=0x7f0dbc01c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414bbe062223494f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dc7e00640 1 -- 172.21.15.144:0/397305699 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b0070 con 0x7f0dc815c2e0 2024-09-12T12:15:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dc7e00640 1 -- 172.21.15.144:0/397305699 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0ab600 con 0x7f0dc815c2e0 2024-09-12T12:15:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dc7e00640 1 -- 172.21.15.144:0/397305699 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0ab9d0 con 0x7f0dc815c2e0 2024-09-12T12:15:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dd0600640 1 -- 172.21.15.144:0/397305699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc815c2e0 msgr2=0x7f0dc8072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dd0600640 1 --2- 172.21.15.144:0/397305699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc815c2e0 0x7f0dc8072b50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80aff30 tx=0x7f0dbc01c140 comp rx=0 tx=0).stop 2024-09-12T12:15:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dd0600640 1 -- 172.21.15.144:0/397305699 shutdown_connections 2024-09-12T12:15:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dd0600640 1 --2- 172.21.15.144:0/397305699 >> v2:172.21.15.165:3300/0 conn(0x7f0dc806c150 0x7f0dc806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dd0600640 1 --2- 172.21.15.144:0/397305699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc80af5f0 0x7f0dc806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dd0600640 1 --2- 172.21.15.144:0/397305699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc815c2e0 0x7f0dc8072b50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dd0600640 1 -- 172.21.15.144:0/397305699 >> 172.21.15.144:0/397305699 conn(0x7f0dc8068030 msgr2=0x7f0dc80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dd0600640 1 -- 172.21.15.144:0/397305699 shutdown_connections 2024-09-12T12:15:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.515+0000 7f0dd0600640 1 -- 172.21.15.144:0/397305699 wait complete. 2024-09-12T12:15:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dd0600640 1 Processor -- start 2024-09-12T12:15:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dd0600640 1 -- start start 2024-09-12T12:15:54.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dd0600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dc806c150 0x7f0dc80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dd0600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc80af5f0 0x7f0dc815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dd0600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc815c2e0 0x7f0dc80b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dd0600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc80cdef0 con 0x7f0dc80af5f0 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dd0600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc80cdd70 con 0x7f0dc806c150 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dd0600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc80ce070 con 0x7f0dc815c2e0 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc80af5f0 0x7f0dc815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcdc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dc806c150 0x7f0dc80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc80af5f0 0x7f0dc815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41250/0 (socket says 172.21.15.144:41250) 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcd200640 1 -- 172.21.15.144:0/936307017 learned_addr learned my addr 172.21.15.144:0/936307017 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dce600640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc815c2e0 0x7f0dc80b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcd200640 1 -- 172.21.15.144:0/936307017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc815c2e0 msgr2=0x7f0dc80b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcd200640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc815c2e0 0x7f0dc80b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcd200640 1 -- 172.21.15.144:0/936307017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dc806c150 msgr2=0x7f0dc80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcd200640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dc806c150 0x7f0dc80aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcd200640 1 -- 172.21.15.144:0/936307017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc80b3eb0 con 0x7f0dc80af5f0 2024-09-12T12:15:54.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dce600640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc815c2e0 0x7f0dc80b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:54.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dcd200640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc80af5f0 0x7f0dc815d670 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c7c0 tx=0x7f0db400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dc5600640 1 -- 172.21.15.144:0/936307017 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4007a30 con 0x7f0dc80af5f0 2024-09-12T12:15:54.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dc5600640 1 -- 172.21.15.144:0/936307017 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db4007bd0 con 0x7f0dc80af5f0 2024-09-12T12:15:54.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dc5600640 1 -- 172.21.15.144:0/936307017 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40113f0 con 0x7f0dc80af5f0 2024-09-12T12:15:54.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.519+0000 7f0dd0600640 1 -- 172.21.15.144:0/936307017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc815cb90 con 0x7f0dc80af5f0 2024-09-12T12:15:54.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.523+0000 7f0dd0600640 1 -- 172.21.15.144:0/936307017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc815d150 con 0x7f0dc80af5f0 2024-09-12T12:15:54.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.523+0000 7f0dc5600640 1 -- 172.21.15.144:0/936307017 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0db4011590 con 0x7f0dc80af5f0 2024-09-12T12:15:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.523+0000 7f0dc5600640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0da80678f0 0x7f0da8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.523+0000 7f0dc5600640 1 -- 172.21.15.144:0/936307017 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f0db4085f80 con 0x7f0dc80af5f0 2024-09-12T12:15:54.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.523+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0da80678f0 0x7f0da8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.523+0000 7f0dd3927000 1 Processor -- start 2024-09-12T12:15:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.523+0000 7f0dd3927000 1 -- start start 2024-09-12T12:15:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.523+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0da80678f0 0x7f0da8069db0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0ad000 tx=0x7f0dbc0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7759d030 0x55cf776ff310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf776ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf776b57a0 0x55cf776b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cf77503d30 con 0x55cf7759d030 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cf774a9410 con 0x55cf776ff850 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55cf774ffcf0 con 0x55cf776b57a0 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7759d030 0x55cf776ff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7759d030 0x55cf776ff310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41264/0 (socket says 172.21.15.144:41264) 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcdc00640 1 -- 172.21.15.144:0/3074947898 learned_addr learned my addr 172.21.15.144:0/3074947898 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcdc00640 1 -- 172.21.15.144:0/3074947898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf776b57a0 msgr2=0x55cf776b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/3074947898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf776b57a0 0x55cf776b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcdc00640 1 -- 172.21.15.144:0/3074947898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 msgr2=0x55cf776ffc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcd200640 1 --2- 172.21.15.144:0/3074947898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf776ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/3074947898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf776ffc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcdc00640 1 -- 172.21.15.144:0/3074947898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf774ca620 con 0x55cf7759d030 2024-09-12T12:15:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcd200640 1 --2- 172.21.15.144:0/3074947898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf776ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:54.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/3074947898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7759d030 0x55cf776ff310 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc01a7f0 tx=0x7f0dbc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca925aa972c25f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dba000640 1 -- 172.21.15.144:0/3074947898 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b0040 con 0x55cf7759d030 2024-09-12T12:15:54.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dba000640 1 -- 172.21.15.144:0/3074947898 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0c7070 con 0x55cf7759d030 2024-09-12T12:15:54.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dba000640 1 -- 172.21.15.144:0/3074947898 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b5640 con 0x55cf7759d030 2024-09-12T12:15:54.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 -- 172.21.15.144:0/3074947898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7759d030 msgr2=0x55cf776ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 --2- 172.21.15.144:0/3074947898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7759d030 0x55cf776ff310 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc01a7f0 tx=0x7f0dbc004740 comp rx=0 tx=0).stop 2024-09-12T12:15:54.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 -- 172.21.15.144:0/3074947898 shutdown_connections 2024-09-12T12:15:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 --2- 172.21.15.144:0/3074947898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf776b57a0 0x55cf776b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 --2- 172.21.15.144:0/3074947898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf776ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 --2- 172.21.15.144:0/3074947898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7759d030 0x55cf776ff310 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 -- 172.21.15.144:0/3074947898 >> 172.21.15.144:0/3074947898 conn(0x55cf771c6a20 msgr2=0x55cf776b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 -- 172.21.15.144:0/3074947898 shutdown_connections 2024-09-12T12:15:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 -- 172.21.15.144:0/3074947898 wait complete. 2024-09-12T12:15:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 -- start start 2024-09-12T12:15:54.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.527+0000 7f0dd3927000 1 Processor -- start 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 0x55cf776c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776b57a0 0x55cf776c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf776c1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cf774c7850 con 0x55cf776ff850 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cf7749d6b0 con 0x55cf776b57a0 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55cf776beeb0 con 0x55cf7759d030 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 10 client.0 _ll_register_callbacks cb 0x55cf776a1440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dce600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf776c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dce600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf776c1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41270/0 (socket says 172.21.15.144:41270) 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dcdc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 0x55cf776c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dce600640 1 -- 172.21.15.144:0/4154122879 learned_addr learned my addr 172.21.15.144:0/4154122879 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dcd200640 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776b57a0 0x55cf776c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dce600640 1 -- 172.21.15.144:0/4154122879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 msgr2=0x55cf776c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dce600640 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 0x55cf776c06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dce600640 1 -- 172.21.15.144:0/4154122879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776b57a0 msgr2=0x55cf776c0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dce600640 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776b57a0 0x55cf776c0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dce600640 1 -- 172.21.15.144:0/4154122879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf774a3520 con 0x55cf776ff850 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dce600640 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf776c1170 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000eb80 tx=0x7f0dc000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5890f32fc6593d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0daea00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0daea00640 1 -- 172.21.15.144:0/4154122879 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc001b060 con 0x55cf776ff850 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0daea00640 1 -- 172.21.15.144:0/4154122879 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f0dc000a840 con 0x55cf776ff850 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 -- 172.21.15.144:0/4154122879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dbc0c7070 con 0x55cf776ff850 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0daea00640 1 -- 172.21.15.144:0/4154122879 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0dc0021050 con 0x55cf776ff850 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 10 client.5754 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 -- 172.21.15.144:0/4154122879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55cf774a9660 con 0x55cf776ff850 2024-09-12T12:15:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0daea00640 1 -- 172.21.15.144:0/4154122879 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0c7070 con 0x55cf776ff850 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0daea00640 1 -- 172.21.15.144:0/4154122879 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f0dc0024020 con 0x55cf776ff850 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 10 client.5754 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 10 client.5754 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 20 client.5754 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55cf776c1b80 0x55cf7770ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 4 client.5754 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 -- 172.21.15.144:0/4154122879 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf7749dcd0 con 0x55cf776c1b80 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55cf776c1b80 0x55cf7770ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0daea00640 10 client.5754 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55cf776c1b80 0x55cf7770ffd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6309d512a8e346a server_cookie=d8ceadfbeec9adb9 in_seq=0 out_seq=0 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0daea00640 1 -- 172.21.15.144:0/4154122879 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf7749dcd0 con 0x55cf776c1b80 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0daea00640 10 client.5754 handle_command_reply: tid=0 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.531+0000 7f0dd3927000 1 client.5754 shutdown 2024-09-12T12:15:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 -- 172.21.15.144:0/4154122879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 msgr2=0x55cf776c1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf776c1170 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000eb80 tx=0x7f0dc000c790 comp rx=0 tx=0).stop 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 -- 172.21.15.144:0/4154122879 shutdown_connections 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55cf776c1b80 0x55cf7770ffd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf776c1170 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776b57a0 0x55cf776c0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 --2- 172.21.15.144:0/4154122879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 0x55cf776c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0daea00640 0 client.5754 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 -- 172.21.15.144:0/4154122879 >> 172.21.15.144:0/4154122879 conn(0x55cf771c6a20 msgr2=0x55cf776b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 -- 172.21.15.144:0/4154122879 shutdown_connections 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 1 -- 172.21.15.144:0/4154122879 wait complete. 2024-09-12T12:15:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.535+0000 7f0dd3927000 20 client.5754 trim_cache size 0 max 16384 2024-09-12T12:15:54.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dd3927000 1 Processor -- start 2024-09-12T12:15:54.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dd3927000 1 -- start start 2024-09-12T12:15:54.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 0x55cf7776e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776b57a0 0x55cf7776ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf7776efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dd3927000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8204050 con 0x55cf776b57a0 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dd3927000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8203090 con 0x55cf776ff850 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dd3927000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc8159660 con 0x55cf7759d030 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dcd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776b57a0 0x55cf7776ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dcd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776b57a0 0x55cf7776ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41276/0 (socket says 172.21.15.144:41276) 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dcd200640 1 -- 172.21.15.144:0/2413789556 learned_addr learned my addr 172.21.15.144:0/2413789556 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dce600640 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf7776efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 0x55cf7776e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dcd200640 1 -- 172.21.15.144:0/2413789556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 msgr2=0x55cf7776e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dcd200640 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 0x55cf7776e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dcd200640 1 -- 172.21.15.144:0/2413789556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 msgr2=0x55cf7776efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dcd200640 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf7776efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dcd200640 1 -- 172.21.15.144:0/2413789556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf774c0f30 con 0x55cf776b57a0 2024-09-12T12:15:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.547+0000 7f0dce600640 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf7776efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776b57a0 0x55cf7776ea60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0db4007410 tx=0x7f0db4052620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7a0323f6e3b496 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0db9600640 1 -- 172.21.15.144:0/2413789556 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db406e070 con 0x55cf776b57a0 2024-09-12T12:15:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0db9600640 1 -- 172.21.15.144:0/2413789556 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db40545d0 con 0x55cf776b57a0 2024-09-12T12:15:54.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0db9600640 1 -- 172.21.15.144:0/2413789556 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db401e040 con 0x55cf776b57a0 2024-09-12T12:15:54.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- 172.21.15.144:0/2413789556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776b57a0 msgr2=0x55cf7776ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776b57a0 0x55cf7776ea60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0db4007410 tx=0x7f0db4052620 comp rx=0 tx=0).stop 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- 172.21.15.144:0/2413789556 shutdown_connections 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf776ff850 0x55cf7776efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776b57a0 0x55cf7776ea60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 --2- 172.21.15.144:0/2413789556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf7759d030 0x55cf7776e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- 172.21.15.144:0/2413789556 >> 172.21.15.144:0/2413789556 conn(0x55cf771c6a20 msgr2=0x55cf7770ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- 172.21.15.144:0/2413789556 shutdown_connections 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- 172.21.15.144:0/2413789556 wait complete. 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- start start 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 Processor -- start 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf7759d030 0x55cf777153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf7776e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf77715920 0x55cf7776ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cf77503040 con 0x55cf776ff850 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8202c60 con 0x55cf7759d030 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55cf775012e0 con 0x55cf77715920 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 10 client.0 _ll_register_callbacks cb 0x7f0dc00077b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf7776e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf7776e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41278/0 (socket says 172.21.15.144:41278) 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 -- 172.21.15.144:0/1944697271 learned_addr learned my addr 172.21.15.144:0/1944697271 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf7759d030 0x55cf777153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dce600640 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf77715920 0x55cf7776ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 -- 172.21.15.144:0/1944697271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf77715920 msgr2=0x55cf7776ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf77715920 0x55cf7776ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 -- 172.21.15.144:0/1944697271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf7759d030 msgr2=0x55cf777153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf7759d030 0x55cf777153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 -- 172.21.15.144:0/1944697271 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf7755bb00 con 0x55cf776ff850 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dcd200640 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf7776e910 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0db405a790 tx=0x7f0db4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524cdbe41ebe96ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0daea00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0daea00640 1 -- 172.21.15.144:0/1944697271 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4081070 con 0x55cf776ff850 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0daea00640 1 -- 172.21.15.144:0/1944697271 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f0db405a2b0 con 0x55cf776ff850 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.551+0000 7f0dd3927000 1 -- 172.21.15.144:0/1944697271 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0db40545d0 con 0x55cf776ff850 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0daea00640 1 -- 172.21.15.144:0/1944697271 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0db401e070 con 0x55cf776ff850 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 10 client.5760 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 -- 172.21.15.144:0/1944697271 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55cf771be360 con 0x55cf776ff850 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0daea00640 1 -- 172.21.15.144:0/1944697271 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db40545d0 con 0x55cf776ff850 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0daea00640 1 -- 172.21.15.144:0/1944697271 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f0db4074b30 con 0x55cf776ff850 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 10 client.5760 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 10 client.5760 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:15:54.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 20 client.5760 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55cf7776f7b0 0x55cf7776fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 4 client.5760 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3480052279}] 2024-09-12T12:15:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 -- 172.21.15.144:0/1944697271 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3480052279}) -- 0x55cf77511460 con 0x55cf7776f7b0 2024-09-12T12:15:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55cf7776f7b0 0x55cf7776fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dcdc00640 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55cf7776f7b0 0x55cf7776fb90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73645eafb7ae42c server_cookie=4aa3499aa1dea951 in_seq=0 out_seq=0 2024-09-12T12:15:54.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0daea00640 10 client.5760 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:54.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0daea00640 1 -- 172.21.15.144:0/1944697271 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55cf77511460 con 0x55cf7776f7b0 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0daea00640 10 client.5760 handle_command_reply: tid=0 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 client.5760 shutdown 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 -- 172.21.15.144:0/1944697271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 msgr2=0x55cf7776e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf7776e910 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0db405a790 tx=0x7f0db4000bd0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 -- 172.21.15.144:0/1944697271 shutdown_connections 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55cf7776f7b0 0x55cf7776fb90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cf77715920 0x55cf7776ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0daea00640 0 client.5760 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf776ff850 0x55cf7776e910 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 --2- 172.21.15.144:0/1944697271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cf7759d030 0x55cf777153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 -- 172.21.15.144:0/1944697271 >> 172.21.15.144:0/1944697271 conn(0x55cf771c6a20 msgr2=0x55cf777107f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 -- 172.21.15.144:0/1944697271 shutdown_connections 2024-09-12T12:15:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 1 -- 172.21.15.144:0/1944697271 wait complete. 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd3927000 20 client.5760 trim_cache size 0 max 16384 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 -- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0da80678f0 msgr2=0x7f0da8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0da80678f0 0x7f0da8069db0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0ad000 tx=0x7f0dbc0a6000 comp rx=0 tx=0).stop 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 -- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc80af5f0 msgr2=0x7f0dc815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc80af5f0 0x7f0dc815d670 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c7c0 tx=0x7f0db400cc80 comp rx=0 tx=0).stop 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 -- 172.21.15.144:0/936307017 shutdown_connections 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0da80678f0 0x7f0da8069db0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0dc815c2e0 0x7f0dc80b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dc80af5f0 0x7f0dc815d670 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 --2- 172.21.15.144:0/936307017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0dc806c150 0x7f0dc80aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 -- 172.21.15.144:0/936307017 >> 172.21.15.144:0/936307017 conn(0x7f0dc8068030 msgr2=0x7f0dc815f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 -- 172.21.15.144:0/936307017 shutdown_connections 2024-09-12T12:15:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.555+0000 7f0dd0600640 1 -- 172.21.15.144:0/936307017 wait complete. 2024-09-12T12:15:54.576 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-12T12:15:54.577 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-12T12:15:54.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e40a00640 1 Processor -- start 2024-09-12T12:15:54.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e40a00640 1 -- start start 2024-09-12T12:15:54.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e40a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e3c156750 0x7f6e3c06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e40a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6e3c06fff0 0x7f6e3c0d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e40a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c0d26c0 0x7f6e3c15fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e40a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c15cbf0 con 0x7f6e3c156750 2024-09-12T12:15:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e40a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c15ced0 con 0x7f6e3c06fff0 2024-09-12T12:15:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e40a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c15d1b0 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e3b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e3c156750 0x7f6e3c06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e3b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e3c156750 0x7f6e3c06fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41284/0 (socket says 172.21.15.144:41284) 2024-09-12T12:15:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.711+0000 7f6e3b400640 1 -- 172.21.15.144:0/2823545556 learned_addr learned my addr 172.21.15.144:0/2823545556 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/2823545556 >> v2:172.21.15.165:3300/0 conn(0x7f6e3c06fff0 0x7f6e3c0d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3be00640 1 --2- 172.21.15.144:0/2823545556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c0d26c0 0x7f6e3c15fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3b400640 1 -- 172.21.15.144:0/2823545556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c0d26c0 msgr2=0x7f6e3c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3b400640 1 --2- 172.21.15.144:0/2823545556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c0d26c0 0x7f6e3c15fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3b400640 1 -- 172.21.15.144:0/2823545556 >> v2:172.21.15.165:3300/0 conn(0x7f6e3c06fff0 msgr2=0x7f6e3c0d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3b400640 1 --2- 172.21.15.144:0/2823545556 >> v2:172.21.15.165:3300/0 conn(0x7f6e3c06fff0 0x7f6e3c0d2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3b400640 1 -- 172.21.15.144:0/2823545556 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c15d490 con 0x7f6e3c156750 2024-09-12T12:15:54.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3be00640 1 --2- 172.21.15.144:0/2823545556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c0d26c0 0x7f6e3c15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3b400640 1 --2- 172.21.15.144:0/2823545556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c156750 0x7f6e3c06fab0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c15d3c0 tx=0x7f6e2c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464d8ed98285e615 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3a000640 1 -- 172.21.15.144:0/2823545556 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0b0070 con 0x7f6e3c156750 2024-09-12T12:15:54.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3a000640 1 -- 172.21.15.144:0/2823545556 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c0ab600 con 0x7f6e3c156750 2024-09-12T12:15:54.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.715+0000 7f6e3a000640 1 -- 172.21.15.144:0/2823545556 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0ab9d0 con 0x7f6e3c156750 2024-09-12T12:15:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- 172.21.15.144:0/2823545556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c156750 msgr2=0x7f6e3c06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 --2- 172.21.15.144:0/2823545556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c156750 0x7f6e3c06fab0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c15d3c0 tx=0x7f6e2c01ccc0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- 172.21.15.144:0/2823545556 shutdown_connections 2024-09-12T12:15:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 --2- 172.21.15.144:0/2823545556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c0d26c0 0x7f6e3c15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 --2- 172.21.15.144:0/2823545556 >> v2:172.21.15.165:3300/0 conn(0x7f6e3c06fff0 0x7f6e3c0d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 --2- 172.21.15.144:0/2823545556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c156750 0x7f6e3c06fab0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- 172.21.15.144:0/2823545556 >> 172.21.15.144:0/2823545556 conn(0x7f6e3c067a00 msgr2=0x7f6e3c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- 172.21.15.144:0/2823545556 shutdown_connections 2024-09-12T12:15:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- 172.21.15.144:0/2823545556 wait complete. 2024-09-12T12:15:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 Processor -- start 2024-09-12T12:15:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- start start 2024-09-12T12:15:54.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e3c06fff0 0x7f6e3c142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c0d26c0 0x7f6e3c14b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c156750 0x7f6e3c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c156b30 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c15c8a0 con 0x7f6e3c06fff0 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c156cb0 con 0x7f6e3c156750 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c0d26c0 0x7f6e3c14b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c0d26c0 0x7f6e3c14b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41286/0 (socket says 172.21.15.144:41286) 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3aa00640 1 -- 172.21.15.144:0/255091044 learned_addr learned my addr 172.21.15.144:0/255091044 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3be00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c156750 0x7f6e3c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3b400640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e3c06fff0 0x7f6e3c142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3aa00640 1 -- 172.21.15.144:0/255091044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c156750 msgr2=0x7f6e3c15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c156750 0x7f6e3c15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3aa00640 1 -- 172.21.15.144:0/255091044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e3c06fff0 msgr2=0x7f6e3c142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e3c06fff0 0x7f6e3c142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3aa00640 1 -- 172.21.15.144:0/255091044 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c141a40 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c0d26c0 0x7f6e3c14b730 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e8e0 tx=0x7f6e2800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e33400640 1 -- 172.21.15.144:0/255091044 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28017070 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e33400640 1 -- 172.21.15.144:0/255091044 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2800ca00 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e33400640 1 -- 172.21.15.144:0/255091044 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800cdd0 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.719+0000 7f6e40a00640 1 -- 172.21.15.144:0/255091044 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c141d20 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.723+0000 7f6e40a00640 1 -- 172.21.15.144:0/255091044 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c1422e0 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.723+0000 7f6e33400640 1 -- 172.21.15.144:0/255091044 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e2801a070 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.723+0000 7f6e33400640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e1c0678c0 0x7f6e1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.723+0000 7f6e33400640 1 -- 172.21.15.144:0/255091044 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f6e28086190 con 0x7f6e3c0d26c0 2024-09-12T12:15:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.723+0000 7f6e3b400640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e1c0678c0 0x7f6e1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.723+0000 7f6e45337000 1 Processor -- start 2024-09-12T12:15:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.723+0000 7f6e45337000 1 -- start start 2024-09-12T12:15:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.723+0000 7f6e3b400640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e1c0678c0 0x7f6e1c069d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0ad000 tx=0x7f6e2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x558338510ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x558338511910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x55833855fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5583383f3bd0 con 0x558338511e50 2024-09-12T12:15:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55833835a9e0 con 0x558338510c10 2024-09-12T12:15:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5583383008f0 con 0x558338511530 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x55833855fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x55833855fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41296/0 (socket says 172.21.15.144:41296) 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3be00640 1 -- 172.21.15.144:0/2430987283 learned_addr learned my addr 172.21.15.144:0/2430987283 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3b400640 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x558338510ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x558338511910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3be00640 1 -- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 msgr2=0x558338511910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3be00640 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x558338511910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3be00640 1 -- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 msgr2=0x558338510ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3be00640 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x558338510ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3be00640 1 -- 172.21.15.144:0/2430987283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583382f8970 con 0x558338511e50 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3b400640 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x558338510ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x558338511910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e3be00640 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x55833855fb10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6e340074e0 tx=0x7f6e340079a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385641fe6cb50c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e27e00640 1 -- 172.21.15.144:0/2430987283 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3401a020 con 0x558338511e50 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e27e00640 1 -- 172.21.15.144:0/2430987283 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e34015850 con 0x558338511e50 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e27e00640 1 -- 172.21.15.144:0/2430987283 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34015c40 con 0x558338511e50 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 -- 172.21.15.144:0/2430987283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 msgr2=0x55833855fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x55833855fb10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6e340074e0 tx=0x7f6e340079a0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 -- 172.21.15.144:0/2430987283 shutdown_connections 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x55833855fb10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x558338511910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 --2- 172.21.15.144:0/2430987283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x558338510ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 -- 172.21.15.144:0/2430987283 >> 172.21.15.144:0/2430987283 conn(0x558338503ba0 msgr2=0x55833850f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 -- 172.21.15.144:0/2430987283 shutdown_connections 2024-09-12T12:15:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 -- 172.21.15.144:0/2430987283 wait complete. 2024-09-12T12:15:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 -- start start 2024-09-12T12:15:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.727+0000 7f6e45337000 1 Processor -- start 2024-09-12T12:15:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x558338560280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 0x5583385607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 0x55833851aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5583382f4a50 con 0x558338510c10 2024-09-12T12:15:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5583383569a0 con 0x558338511530 2024-09-12T12:15:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x558338325180 con 0x558338511e50 2024-09-12T12:15:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 10 client.0 _ll_register_callbacks cb 0x5583383bc430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x558338560280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x558338560280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41300/0 (socket says 172.21.15.144:41300) 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3b400640 1 -- 172.21.15.144:0/4042618061 learned_addr learned my addr 172.21.15.144:0/4042618061 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 0x5583385607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3be00640 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 0x55833851aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3b400640 1 -- 172.21.15.144:0/4042618061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 msgr2=0x55833851aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3b400640 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 0x55833851aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3b400640 1 -- 172.21.15.144:0/4042618061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 msgr2=0x5583385607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3b400640 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 0x5583385607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3b400640 1 -- 172.21.15.144:0/4042618061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558338363650 con 0x558338510c10 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3b400640 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x558338560280 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0ae040 tx=0x7f6e2c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa2dd19aa3bb8af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e24c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:54.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e24c00640 1 -- 172.21.15.144:0/4042618061 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0b54c0 con 0x558338510c10 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e24c00640 1 -- 172.21.15.144:0/4042618061 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f6e2c0b5660 con 0x558338510c10 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 -- 172.21.15.144:0/4042618061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e34015850 con 0x558338510c10 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e24c00640 1 -- 172.21.15.144:0/4042618061 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6e2c0cd050 con 0x558338510c10 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 10 client.5772 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 -- 172.21.15.144:0/4042618061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x558338300b40 con 0x558338510c10 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e24c00640 1 -- 172.21.15.144:0/4042618061 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e34015850 con 0x558338510c10 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e24c00640 1 -- 172.21.15.144:0/4042618061 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f6e2c0d0020 con 0x558338510c10 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 10 client.5772 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 10 client.5772 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 20 client.5772 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55833851b460 0x55833851b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 4 client.5772 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 -- 172.21.15.144:0/4042618061 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583382f5020 con 0x55833851b460 2024-09-12T12:15:54.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55833851b460 0x55833851b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e24c00640 10 client.5772 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55833851b460 0x55833851b840 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=192259bd57da44b6 server_cookie=81239d170db07da8 in_seq=0 out_seq=0 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e24c00640 1 -- 172.21.15.144:0/4042618061 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583382f5020 con 0x55833851b460 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e24c00640 10 client.5772 handle_command_reply: tid=0 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.731+0000 7f6e45337000 1 client.5772 shutdown 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 -- 172.21.15.144:0/4042618061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 msgr2=0x558338560280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x558338560280 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0ae040 tx=0x7f6e2c01c260 comp rx=0 tx=0).stop 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 -- 172.21.15.144:0/4042618061 shutdown_connections 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55833851b460 0x55833851b840 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 0x55833851aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 0x5583385607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 --2- 172.21.15.144:0/4042618061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x558338560280 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e24c00640 0 client.5772 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:54.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 -- 172.21.15.144:0/4042618061 >> 172.21.15.144:0/4042618061 conn(0x558338503ba0 msgr2=0x558338512c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 -- 172.21.15.144:0/4042618061 shutdown_connections 2024-09-12T12:15:54.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 1 -- 172.21.15.144:0/4042618061 wait complete. 2024-09-12T12:15:54.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.735+0000 7f6e45337000 20 client.5772 trim_cache size 0 max 16384 2024-09-12T12:15:54.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.747+0000 7f6e45337000 1 Processor -- start 2024-09-12T12:15:54.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.747+0000 7f6e45337000 1 -- start start 2024-09-12T12:15:54.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x55833851a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x5583385660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x558338566610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1ffdf0 con 0x558338511e50 2024-09-12T12:15:54.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c06e580 con 0x558338510c10 2024-09-12T12:15:54.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c0b72b0 con 0x558338511530 2024-09-12T12:15:54.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x558338566610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x558338566610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41304/0 (socket says 172.21.15.144:41304) 2024-09-12T12:15:54.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3be00640 1 -- 172.21.15.144:0/486511407 learned_addr learned my addr 172.21.15.144:0/486511407 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3b400640 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x55833851a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x5583385660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3be00640 1 -- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 msgr2=0x5583385660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3be00640 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x5583385660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3be00640 1 -- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 msgr2=0x55833851a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3be00640 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x55833851a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3be00640 1 -- 172.21.15.144:0/486511407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583382faa00 con 0x558338511e50 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3b400640 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x55833851a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x5583385660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e3be00640 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x558338566610 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6e34018000 tx=0x7f6e34013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1376daf3f2667c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e27400640 1 -- 172.21.15.144:0/486511407 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3401a040 con 0x558338511e50 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e27400640 1 -- 172.21.15.144:0/486511407 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e34003ce0 con 0x558338511e50 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e27400640 1 -- 172.21.15.144:0/486511407 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e340158b0 con 0x558338511e50 2024-09-12T12:15:54.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 -- 172.21.15.144:0/486511407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 msgr2=0x558338566610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x558338566610 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6e34018000 tx=0x7f6e34013000 comp rx=0 tx=0).stop 2024-09-12T12:15:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 -- 172.21.15.144:0/486511407 shutdown_connections 2024-09-12T12:15:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338511e50 0x558338566610 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511530 0x5583385660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 --2- 172.21.15.144:0/486511407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338510c10 0x55833851a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 -- 172.21.15.144:0/486511407 >> 172.21.15.144:0/486511407 conn(0x558338503ba0 msgr2=0x558338510380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 -- 172.21.15.144:0/486511407 shutdown_connections 2024-09-12T12:15:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 -- 172.21.15.144:0/486511407 wait complete. 2024-09-12T12:15:54.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 -- start start 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.751+0000 7f6e45337000 1 Processor -- start 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x5583385cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 0x558338564600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 0x558338564b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558338515e80 con 0x558338510c10 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c06df30 con 0x558338511530 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55833835f010 con 0x558338511e50 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 10 client.0 _ll_register_callbacks cb 0x7f6e28009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x5583385cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x5583385cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41314/0 (socket says 172.21.15.144:41314) 2024-09-12T12:15:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3b400640 1 -- 172.21.15.144:0/1320540861 learned_addr learned my addr 172.21.15.144:0/1320540861 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 0x558338564600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3be00640 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 0x558338564b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3b400640 1 -- 172.21.15.144:0/1320540861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 msgr2=0x558338564b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3b400640 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 0x558338564b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3b400640 1 -- 172.21.15.144:0/1320540861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 msgr2=0x558338564600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3b400640 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 0x558338564600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3b400640 1 -- 172.21.15.144:0/1320540861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558338318a50 con 0x558338510c10 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 0x558338564600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3b400640 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x5583385cd090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c008010 tx=0x7f6e2c01aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a3574136dfd069 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e24c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e24c00640 1 -- 172.21.15.144:0/1320540861 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c009490 con 0x558338510c10 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e24c00640 1 -- 172.21.15.144:0/1320540861 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f6e2c0c2610 con 0x558338510c10 2024-09-12T12:15:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 -- 172.21.15.144:0/1320540861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e34003ce0 con 0x558338510c10 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e24c00640 1 -- 172.21.15.144:0/1320540861 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6e2c0e4050 con 0x558338510c10 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 10 client.5778 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 -- 172.21.15.144:0/1320540861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5583382f2b10 con 0x558338510c10 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e24c00640 1 -- 172.21.15.144:0/1320540861 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e34003ce0 con 0x558338510c10 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e24c00640 1 -- 172.21.15.144:0/1320540861 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f6e2c0e7020 con 0x558338510c10 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 10 client.5778 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 10 client.5778 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 20 client.5778 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x558338565080 0x558338565490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 4 client.5778 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e45337000 1 -- 172.21.15.144:0/1320540861 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x558338337cd0 con 0x558338565080 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x558338565080 0x558338565490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e24c00640 10 client.5778 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.755+0000 7f6e3aa00640 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x558338565080 0x558338565490 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c398e649c8343fd server_cookie=c4437e92454aa602 in_seq=0 out_seq=0 2024-09-12T12:15:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e24c00640 1 -- 172.21.15.144:0/1320540861 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558338337cd0 con 0x558338565080 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e24c00640 10 client.5778 handle_command_reply: tid=0 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 client.5778 shutdown 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 -- 172.21.15.144:0/1320540861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 msgr2=0x5583385cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x5583385cd090 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c008010 tx=0x7f6e2c01aaa0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 -- 172.21.15.144:0/1320540861 shutdown_connections 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x558338565080 0x558338565490 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558338511e50 0x558338564b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558338511530 0x558338564600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 --2- 172.21.15.144:0/1320540861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558338510c10 0x5583385cd090 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e24c00640 0 client.5778 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 -- 172.21.15.144:0/1320540861 >> 172.21.15.144:0/1320540861 conn(0x558338503ba0 msgr2=0x5583385195a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 -- 172.21.15.144:0/1320540861 shutdown_connections 2024-09-12T12:15:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 1 -- 172.21.15.144:0/1320540861 wait complete. 2024-09-12T12:15:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e45337000 20 client.5778 trim_cache size 0 max 16384 2024-09-12T12:15:54.764 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:15:54.764 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 -- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e1c0678c0 msgr2=0x7f6e1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e1c0678c0 0x7f6e1c069d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0ad000 tx=0x7f6e2c008040 comp rx=0 tx=0).stop 2024-09-12T12:15:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 -- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c0d26c0 msgr2=0x7f6e3c14b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c0d26c0 0x7f6e3c14b730 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e8e0 tx=0x7f6e2800eda0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 -- 172.21.15.144:0/255091044 shutdown_connections 2024-09-12T12:15:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e1c0678c0 0x7f6e1c069d80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e3c156750 0x7f6e3c15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e3c0d26c0 0x7f6e3c14b730 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 --2- 172.21.15.144:0/255091044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e3c06fff0 0x7f6e3c142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 -- 172.21.15.144:0/255091044 >> 172.21.15.144:0/255091044 conn(0x7f6e3c067a00 msgr2=0x7f6e3c073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 -- 172.21.15.144:0/255091044 shutdown_connections 2024-09-12T12:15:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54.759+0000 7f6e40a00640 1 -- 172.21.15.144:0/255091044 wait complete. 2024-09-12T12:15:54.781 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-12T12:15:54.781 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-12T12:15:54.781 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-12T12:15:54.781 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-12T12:15:54.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:54.781 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-12T12:15:54.790 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> import stat 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> import json 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> import sys 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> try: 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> except OSError as e: 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> sys.exit(e.errno) 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-12T12:15:54.791 DEBUG:teuthology.orchestra.run.smithi144:> print(json.dumps( 2024-09-12T12:15:54.792 DEBUG:teuthology.orchestra.run.smithi144:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-12T12:15:54.792 DEBUG:teuthology.orchestra.run.smithi144:> indent=2)) 2024-09-12T12:15:54.792 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:15:54.898 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_mode": 16893, 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_ino": 1099511627777, 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_dev": 44, 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_nlink": 16, 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_uid": 1000, 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_gid": 1271, 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_size": 18, 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_atime": 1726143342.0876267, 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_mtime": 1726143347.5075607, 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout: "st_ctime": 1726143347.5075607 2024-09-12T12:15:54.899 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:54.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:15:54.908 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-09-12T12:15:54.908 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-12T12:15:54.908 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-12T12:15:55.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f806b800640 1 Processor -- start 2024-09-12T12:15:55.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f806b800640 1 -- start start 2024-09-12T12:15:55.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f806b800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f806415af60 0x7f80640ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f806b800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80640cd9f0 0x7f806406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f806b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f806415b340 0x7f806406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f806b800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f80640b32f0 con 0x7f80640cd9f0 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f806b800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f80640b4300 con 0x7f806415af60 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f806b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f80640b3540 con 0x7f806415b340 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f8063e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80640cd9f0 0x7f806406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f8063e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80640cd9f0 0x7f806406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41316/0 (socket says 172.21.15.144:41316) 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f8063e00640 1 -- 172.21.15.144:0/1630723472 learned_addr learned my addr 172.21.15.144:0/1630723472 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f8068e00640 1 --2- 172.21.15.144:0/1630723472 >> v2:172.21.15.165:3300/0 conn(0x7f806415af60 0x7f80640ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f8069800640 1 --2- 172.21.15.144:0/1630723472 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f806415b340 0x7f806406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.087+0000 7f8063e00640 1 -- 172.21.15.144:0/1630723472 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f806415b340 msgr2=0x7f806406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8063e00640 1 --2- 172.21.15.144:0/1630723472 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f806415b340 0x7f806406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8063e00640 1 -- 172.21.15.144:0/1630723472 >> v2:172.21.15.165:3300/0 conn(0x7f806415af60 msgr2=0x7f80640ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8063e00640 1 --2- 172.21.15.144:0/1630723472 >> v2:172.21.15.165:3300/0 conn(0x7f806415af60 0x7f80640ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8063e00640 1 -- 172.21.15.144:0/1630723472 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80640b3820 con 0x7f80640cd9f0 2024-09-12T12:15:55.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8069800640 1 --2- 172.21.15.144:0/1630723472 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f806415b340 0x7f806406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8068e00640 1 --2- 172.21.15.144:0/1630723472 >> v2:172.21.15.165:3300/0 conn(0x7f806415af60 0x7f80640ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8063e00640 1 --2- 172.21.15.144:0/1630723472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80640cd9f0 0x7f806406bc10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f80640d0240 tx=0x7f805001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75315742201ec7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8063400640 1 -- 172.21.15.144:0/1630723472 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500b1070 con 0x7f80640cd9f0 2024-09-12T12:15:55.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8063400640 1 -- 172.21.15.144:0/1630723472 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80500ac630 con 0x7f80640cd9f0 2024-09-12T12:15:55.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f8063400640 1 -- 172.21.15.144:0/1630723472 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500a8050 con 0x7f80640cd9f0 2024-09-12T12:15:55.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f806b800640 1 -- 172.21.15.144:0/1630723472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80640cd9f0 msgr2=0x7f806406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f806b800640 1 --2- 172.21.15.144:0/1630723472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80640cd9f0 0x7f806406bc10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f80640d0240 tx=0x7f805001c520 comp rx=0 tx=0).stop 2024-09-12T12:15:55.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f806b800640 1 -- 172.21.15.144:0/1630723472 shutdown_connections 2024-09-12T12:15:55.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f806b800640 1 --2- 172.21.15.144:0/1630723472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80640cd9f0 0x7f806406bc10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f806b800640 1 --2- 172.21.15.144:0/1630723472 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f806415b340 0x7f806406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f806b800640 1 --2- 172.21.15.144:0/1630723472 >> v2:172.21.15.165:3300/0 conn(0x7f806415af60 0x7f80640ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f806b800640 1 -- 172.21.15.144:0/1630723472 >> 172.21.15.144:0/1630723472 conn(0x7f8064068030 msgr2=0x7f80640b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f806b800640 1 -- 172.21.15.144:0/1630723472 shutdown_connections 2024-09-12T12:15:55.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.091+0000 7f806b800640 1 -- 172.21.15.144:0/1630723472 wait complete. 2024-09-12T12:15:55.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f806b800640 1 Processor -- start 2024-09-12T12:15:55.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f806b800640 1 -- start start 2024-09-12T12:15:55.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f806b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80640cd9f0 0x7f8064149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f806b800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f806415af60 0x7f8064157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f806b800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f806415b340 0x7f8064151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f806b800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f806415f720 con 0x7f806415b340 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f806b800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f806415f5a0 con 0x7f806415af60 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f806b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f806415f8a0 con 0x7f80640cd9f0 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8069800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f806415b340 0x7f8064151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8069800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f806415b340 0x7f8064151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41326/0 (socket says 172.21.15.144:41326) 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8069800640 1 -- 172.21.15.144:0/2539025743 learned_addr learned my addr 172.21.15.144:0/2539025743 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8068e00640 1 --2- 172.21.15.144:0/2539025743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80640cd9f0 0x7f8064149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8063e00640 1 --2- 172.21.15.144:0/2539025743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f806415af60 0x7f8064157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8069800640 1 -- 172.21.15.144:0/2539025743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80640cd9f0 msgr2=0x7f8064149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8069800640 1 --2- 172.21.15.144:0/2539025743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80640cd9f0 0x7f8064149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8069800640 1 -- 172.21.15.144:0/2539025743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f806415af60 msgr2=0x7f8064157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8069800640 1 --2- 172.21.15.144:0/2539025743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f806415af60 0x7f8064157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8069800640 1 -- 172.21.15.144:0/2539025743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806414a100 con 0x7f806415b340 2024-09-12T12:15:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8069800640 1 --2- 172.21.15.144:0/2539025743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f806415b340 0x7f8064151a60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f805c00c7f0 tx=0x7f805c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8060c00640 1 -- 172.21.15.144:0/2539025743 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c015020 con 0x7f806415b340 2024-09-12T12:15:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8060c00640 1 -- 172.21.15.144:0/2539025743 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805c004250 con 0x7f806415b340 2024-09-12T12:15:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f806b800640 1 -- 172.21.15.144:0/2539025743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806414ab40 con 0x7f806415b340 2024-09-12T12:15:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.095+0000 7f8060c00640 1 -- 172.21.15.144:0/2539025743 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c003620 con 0x7f806415b340 2024-09-12T12:15:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.099+0000 7f806b800640 1 -- 172.21.15.144:0/2539025743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806415e270 con 0x7f806415b340 2024-09-12T12:15:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.099+0000 7f8060c00640 1 -- 172.21.15.144:0/2539025743 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f805c018020 con 0x7f806415b340 2024-09-12T12:15:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.099+0000 7f8060c00640 1 --2- 172.21.15.144:0/2539025743 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80440678c0 0x7f8044069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.099+0000 7f8060c00640 1 -- 172.21.15.144:0/2539025743 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f805c085c40 con 0x7f806415b340 2024-09-12T12:15:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.099+0000 7f8068e00640 1 --2- 172.21.15.144:0/2539025743 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80440678c0 0x7f8044069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.099+0000 7f806ebde000 1 Processor -- start 2024-09-12T12:15:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.099+0000 7f806ebde000 1 -- start start 2024-09-12T12:15:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8068e00640 1 --2- 172.21.15.144:0/2539025743 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80440678c0 0x7f8044069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8054003b90 tx=0x7f8054009910 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 0x55ec6aff7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff8270 0x55ec6afae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afaf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec6ae916a0 con 0x55ec6aff8270 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ec6adf7b80 con 0x55ec6afaec20 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ec6ad9e6d0 con 0x55ec6aff7950 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8063e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff8270 0x55ec6afae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8063e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff8270 0x55ec6afae6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41328/0 (socket says 172.21.15.144:41328) 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8063e00640 1 -- 172.21.15.144:0/3398312440 learned_addr learned my addr 172.21.15.144:0/3398312440 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8068e00640 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 0x55ec6aff7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8069800640 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afaf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8063e00640 1 -- 172.21.15.144:0/3398312440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 msgr2=0x55ec6aff7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8063e00640 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 0x55ec6aff7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8063e00640 1 -- 172.21.15.144:0/3398312440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 msgr2=0x55ec6afaf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8063e00640 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afaf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8063e00640 1 -- 172.21.15.144:0/3398312440 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6adb0030 con 0x55ec6aff8270 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8069800640 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afaf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8063e00640 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff8270 0x55ec6afae6e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f80500af040 tx=0x7f80500a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af159698a869b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8059600640 1 -- 172.21.15.144:0/3398312440 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500b1040 con 0x55ec6aff8270 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8059600640 1 -- 172.21.15.144:0/3398312440 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80500ac9a0 con 0x55ec6aff8270 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f8059600640 1 -- 172.21.15.144:0/3398312440 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500a8040 con 0x55ec6aff8270 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 -- 172.21.15.144:0/3398312440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff8270 msgr2=0x55ec6afae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff8270 0x55ec6afae6e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f80500af040 tx=0x7f80500a7000 comp rx=0 tx=0).stop 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 -- 172.21.15.144:0/3398312440 shutdown_connections 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afaf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff8270 0x55ec6afae6e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 --2- 172.21.15.144:0/3398312440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 0x55ec6aff7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 -- 172.21.15.144:0/3398312440 >> 172.21.15.144:0/3398312440 conn(0x55ec6afaabd0 msgr2=0x55ec6afacfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 -- 172.21.15.144:0/3398312440 shutdown_connections 2024-09-12T12:15:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 -- 172.21.15.144:0/3398312440 wait complete. 2024-09-12T12:15:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 -- start start 2024-09-12T12:15:55.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.103+0000 7f806ebde000 1 Processor -- start 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afe1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6afe1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 0x55ec6afe1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec6adb58f0 con 0x55ec6aff7950 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ec6adf3b40 con 0x55ec6afaec20 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ec6adfc1b0 con 0x55ec6aff8270 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 10 client.0 _ll_register_callbacks cb 0x55ec6aeac270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8063e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6afe1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8063e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6afe1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41340/0 (socket says 172.21.15.144:41340) 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8063e00640 1 -- 172.21.15.144:0/3938336788 learned_addr learned my addr 172.21.15.144:0/3938336788 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8069800640 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 0x55ec6afe1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8068e00640 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afe1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8063e00640 1 -- 172.21.15.144:0/3938336788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 msgr2=0x55ec6afe1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8063e00640 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 0x55ec6afe1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8063e00640 1 -- 172.21.15.144:0/3938336788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 msgr2=0x55ec6afe1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8063e00640 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afe1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8063e00640 1 -- 172.21.15.144:0/3938336788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6ad9e920 con 0x55ec6aff7950 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8068e00640 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afe1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8063e00640 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6afe1760 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8050009010 tx=0x7f805001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0adaa99b0834369 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f804e000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f804e000640 1 -- 172.21.15.144:0/3938336788 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500a8030 con 0x55ec6aff7950 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f804e000640 1 -- 172.21.15.144:0/3938336788 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f80500c0c30 con 0x55ec6aff7950 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 -- 172.21.15.144:0/3938336788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80500ac9a0 con 0x55ec6aff7950 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f804e000640 1 -- 172.21.15.144:0/3938336788 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f80500b1040 con 0x55ec6aff7950 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 10 client.5790 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 -- 172.21.15.144:0/3938336788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ec6ad97b30 con 0x55ec6aff7950 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f804e000640 1 -- 172.21.15.144:0/3938336788 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80500ac9a0 con 0x55ec6aff7950 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f804e000640 1 -- 172.21.15.144:0/3938336788 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f80500b4030 con 0x55ec6aff7950 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 10 client.5790 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 10 client.5790 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 20 client.5790 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ec6b005be0 0x55ec6b007fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 4 client.5790 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 -- 172.21.15.144:0/3938336788 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec6ad92150 con 0x55ec6b005be0 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8068e00640 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ec6b005be0 0x55ec6b007fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f8068e00640 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ec6b005be0 0x55ec6b007fd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeeac0f3309adfda server_cookie=e8810270b98e06a5 in_seq=0 out_seq=0 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f804e000640 10 client.5790 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f804e000640 1 -- 172.21.15.144:0/3938336788 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec6ad92150 con 0x55ec6b005be0 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f804e000640 10 client.5790 handle_command_reply: tid=0 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 client.5790 shutdown 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 -- 172.21.15.144:0/3938336788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 msgr2=0x55ec6afe1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.107+0000 7f806ebde000 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6afe1760 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8050009010 tx=0x7f805001ad60 comp rx=0 tx=0).stop 2024-09-12T12:15:55.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f806ebde000 1 -- 172.21.15.144:0/3938336788 shutdown_connections 2024-09-12T12:15:55.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f806ebde000 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ec6b005be0 0x55ec6b007fd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f806ebde000 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 0x55ec6afe1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f806ebde000 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6afe1760 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f806ebde000 1 --2- 172.21.15.144:0/3938336788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6afe1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f804e000640 0 client.5790 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f806ebde000 1 -- 172.21.15.144:0/3938336788 >> 172.21.15.144:0/3938336788 conn(0x55ec6afaabd0 msgr2=0x55ec6afaf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f806ebde000 1 -- 172.21.15.144:0/3938336788 shutdown_connections 2024-09-12T12:15:55.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f806ebde000 1 -- 172.21.15.144:0/3938336788 wait complete. 2024-09-12T12:15:55.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.111+0000 7f806ebde000 20 client.5790 trim_cache size 0 max 16384 2024-09-12T12:15:55.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f806ebde000 1 Processor -- start 2024-09-12T12:15:55.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f806ebde000 1 -- start start 2024-09-12T12:15:55.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f806ebde000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6b067320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f806ebde000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6b067860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f806ebde000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 0x55ec6b067da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f806ebde000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f80641ffa80 con 0x55ec6aff7950 2024-09-12T12:15:55.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f806ebde000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8064159de0 con 0x55ec6afaec20 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f806ebde000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f806415c860 con 0x55ec6aff8270 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f8063e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6b067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.135+0000 7f8063e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6b067860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41342/0 (socket says 172.21.15.144:41342) 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8063e00640 1 -- 172.21.15.144:0/2025451276 learned_addr learned my addr 172.21.15.144:0/2025451276 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8069800640 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 0x55ec6b067da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8063e00640 1 -- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 msgr2=0x55ec6b067da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8068e00640 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6b067320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8063e00640 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 0x55ec6b067da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8063e00640 1 -- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 msgr2=0x55ec6b067320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8063e00640 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6b067320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8063e00640 1 -- 172.21.15.144:0/2025451276 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec6aff80a0 con 0x55ec6aff7950 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8068e00640 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6b067320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8069800640 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 0x55ec6b067da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8063e00640 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6b067860 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f805001a150 tx=0x7f80500bc000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e606ef5c0a96ced server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8058c00640 1 -- 172.21.15.144:0/2025451276 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500ace60 con 0x55ec6aff7950 2024-09-12T12:15:55.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8058c00640 1 -- 172.21.15.144:0/2025451276 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80500c9430 con 0x55ec6aff7950 2024-09-12T12:15:55.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8058c00640 1 -- 172.21.15.144:0/2025451276 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80500a8040 con 0x55ec6aff7950 2024-09-12T12:15:55.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 -- 172.21.15.144:0/2025451276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 msgr2=0x55ec6b067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6b067860 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f805001a150 tx=0x7f80500bc000 comp rx=0 tx=0).stop 2024-09-12T12:15:55.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 -- 172.21.15.144:0/2025451276 shutdown_connections 2024-09-12T12:15:55.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff8270 0x55ec6b067da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6aff7950 0x55ec6b067860 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 --2- 172.21.15.144:0/2025451276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6afaec20 0x55ec6b067320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 -- 172.21.15.144:0/2025451276 >> 172.21.15.144:0/2025451276 conn(0x55ec6afaabd0 msgr2=0x55ec6afade50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 -- 172.21.15.144:0/2025451276 shutdown_connections 2024-09-12T12:15:55.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 -- 172.21.15.144:0/2025451276 wait complete. 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 -- start start 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 Processor -- start 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6afaec20 0x55ec6b06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 0x55ec6b06b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6aff8270 0x55ec6b06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec6adbd3b0 con 0x55ec6afaec20 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f80641597c0 con 0x55ec6aff8270 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ec6afb3090 con 0x55ec6aff7950 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f806ebde000 10 client.0 _ll_register_callbacks cb 0x7f80500ac430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8068e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6afaec20 0x55ec6b06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8068e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6afaec20 0x55ec6b06b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41350/0 (socket says 172.21.15.144:41350) 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8068e00640 1 -- 172.21.15.144:0/1033176990 learned_addr learned my addr 172.21.15.144:0/1033176990 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8063e00640 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 0x55ec6b06b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.139+0000 7f8069800640 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6aff8270 0x55ec6b06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f8068e00640 1 -- 172.21.15.144:0/1033176990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 msgr2=0x55ec6b06b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f8068e00640 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 0x55ec6b06b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f8068e00640 1 -- 172.21.15.144:0/1033176990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6aff8270 msgr2=0x55ec6b06bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f8068e00640 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6aff8270 0x55ec6b06bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f8068e00640 1 -- 172.21.15.144:0/1033176990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec6ae7a6c0 con 0x55ec6afaec20 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f8068e00640 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6afaec20 0x55ec6b06b090 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f80540049e0 tx=0x7f8054004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcfcf26c9139b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 1 -- 172.21.15.144:0/1033176990 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054015cf0 con 0x55ec6afaec20 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 1 -- 172.21.15.144:0/1033176990 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f805402e410 con 0x55ec6afaec20 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 -- 172.21.15.144:0/1033176990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80500c9430 con 0x55ec6afaec20 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 1 -- 172.21.15.144:0/1033176990 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8054038050 con 0x55ec6afaec20 2024-09-12T12:15:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 10 client.5796 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 -- 172.21.15.144:0/1033176990 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ec6ae50920 con 0x55ec6afaec20 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 1 -- 172.21.15.144:0/1033176990 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80500c9430 con 0x55ec6afaec20 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 1 -- 172.21.15.144:0/1033176990 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f805403b020 con 0x55ec6afaec20 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 10 client.5796 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 10 client.5796 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 20 client.5796 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ec6b026cb0 0x55ec6b0270c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 4 client.5796 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 -- 172.21.15.144:0/1033176990 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55ec6ae052b0 con 0x55ec6b026cb0 2024-09-12T12:15:55.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f8063e00640 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ec6b026cb0 0x55ec6b0270c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 10 client.5796 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f8063e00640 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ec6b026cb0 0x55ec6b0270c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bd0e3310ea57600 server_cookie=f50ac241568778ec in_seq=0 out_seq=0 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 1 -- 172.21.15.144:0/1033176990 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x55ec6ae052b0 con 0x55ec6b026cb0 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 10 client.5796 handle_command_reply: tid=0 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 client.5796 shutdown 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 -- 172.21.15.144:0/1033176990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6afaec20 msgr2=0x55ec6b06b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6afaec20 0x55ec6b06b090 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f80540049e0 tx=0x7f8054004ac0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 -- 172.21.15.144:0/1033176990 shutdown_connections 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ec6b026cb0 0x55ec6b0270c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec6aff8270 0x55ec6b06bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec6aff7950 0x55ec6b06b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f804e000640 0 client.5796 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 --2- 172.21.15.144:0/1033176990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec6afaec20 0x55ec6b06b090 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 -- 172.21.15.144:0/1033176990 >> 172.21.15.144:0/1033176990 conn(0x55ec6afaabd0 msgr2=0x55ec6afaf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 -- 172.21.15.144:0/1033176990 shutdown_connections 2024-09-12T12:15:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 1 -- 172.21.15.144:0/1033176990 wait complete. 2024-09-12T12:15:55.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.143+0000 7f806ebde000 20 client.5796 trim_cache size 0 max 16384 2024-09-12T12:15:55.151 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": -2 2024-09-12T12:15:55.151 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:55.151 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: 2024-09-12T12:15:55.154 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T12:15:55.154 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-12T12:15:55.154 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-12T12:15:55.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-12T12:15:55.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f491ca00640 1 Processor -- start 2024-09-12T12:15:55.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f491ca00640 1 -- start start 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f491ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815af60 0x7f49180ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f491ca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f49180cd9f0 0x7f491806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f491ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f491815b340 0x7f491806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f491ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f49180b32f0 con 0x7f491815b340 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f491ca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f49180b4300 con 0x7f49180cd9f0 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f491ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f49180b3540 con 0x7f491815af60 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f4916800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f491815b340 0x7f491806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f4916800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f491815b340 0x7f491806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41364/0 (socket says 172.21.15.144:41364) 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f4916800640 1 -- 172.21.15.144:0/1863036484 learned_addr learned my addr 172.21.15.144:0/1863036484 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f4915e00640 1 --2- 172.21.15.144:0/1863036484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815af60 0x7f49180ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f490fe00640 1 --2- 172.21.15.144:0/1863036484 >> v2:172.21.15.165:3300/0 conn(0x7f49180cd9f0 0x7f491806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f4916800640 1 -- 172.21.15.144:0/1863036484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815af60 msgr2=0x7f49180ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f4916800640 1 --2- 172.21.15.144:0/1863036484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815af60 0x7f49180ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f4916800640 1 -- 172.21.15.144:0/1863036484 >> v2:172.21.15.165:3300/0 conn(0x7f49180cd9f0 msgr2=0x7f491806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f4916800640 1 --2- 172.21.15.144:0/1863036484 >> v2:172.21.15.165:3300/0 conn(0x7f49180cd9f0 0x7f491806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.291+0000 7f4916800640 1 -- 172.21.15.144:0/1863036484 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49180b3820 con 0x7f491815b340 2024-09-12T12:15:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f4916800640 1 --2- 172.21.15.144:0/1863036484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815b340 0x7f491806c150 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f491806f330 tx=0x7f491001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8188fc5b0abdd3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f4915400640 1 -- 172.21.15.144:0/1863036484 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49100b4070 con 0x7f491815b340 2024-09-12T12:15:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f4915400640 1 -- 172.21.15.144:0/1863036484 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49100af400 con 0x7f491815b340 2024-09-12T12:15:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f4915400640 1 -- 172.21.15.144:0/1863036484 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49100af7d0 con 0x7f491815b340 2024-09-12T12:15:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f491ca00640 1 -- 172.21.15.144:0/1863036484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815b340 msgr2=0x7f491806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f491ca00640 1 --2- 172.21.15.144:0/1863036484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815b340 0x7f491806c150 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f491806f330 tx=0x7f491001f1e0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f491ca00640 1 -- 172.21.15.144:0/1863036484 shutdown_connections 2024-09-12T12:15:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f491ca00640 1 --2- 172.21.15.144:0/1863036484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815b340 0x7f491806c150 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f491ca00640 1 --2- 172.21.15.144:0/1863036484 >> v2:172.21.15.165:3300/0 conn(0x7f49180cd9f0 0x7f491806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f491ca00640 1 --2- 172.21.15.144:0/1863036484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815af60 0x7f49180ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f491ca00640 1 -- 172.21.15.144:0/1863036484 >> 172.21.15.144:0/1863036484 conn(0x7f4918068030 msgr2=0x7f49180b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f491ca00640 1 -- 172.21.15.144:0/1863036484 shutdown_connections 2024-09-12T12:15:55.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.295+0000 7f491ca00640 1 -- 172.21.15.144:0/1863036484 wait complete. 2024-09-12T12:15:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 Processor -- start 2024-09-12T12:15:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 -- start start 2024-09-12T12:15:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49180cd9f0 0x7f4918073d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815af60 0x7f4918144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815b340 0x7f49181f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49180cebc0 con 0x7f491815af60 2024-09-12T12:15:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f49180b3de0 con 0x7f49180cd9f0 2024-09-12T12:15:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f49180ced40 con 0x7f491815b340 2024-09-12T12:15:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815af60 0x7f4918144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815af60 0x7f4918144220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41380/0 (socket says 172.21.15.144:41380) 2024-09-12T12:15:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490fe00640 1 -- 172.21.15.144:0/424919678 learned_addr learned my addr 172.21.15.144:0/424919678 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f4916800640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815b340 0x7f49181f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f4915e00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49180cd9f0 0x7f4918073d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490fe00640 1 -- 172.21.15.144:0/424919678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815b340 msgr2=0x7f49181f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490fe00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815b340 0x7f49181f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490fe00640 1 -- 172.21.15.144:0/424919678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49180cd9f0 msgr2=0x7f4918073d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490fe00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49180cd9f0 0x7f4918073d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490fe00640 1 -- 172.21.15.144:0/424919678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4918144970 con 0x7f491815af60 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f4915e00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49180cd9f0 0x7f4918073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490fe00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815af60 0x7f4918144220 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f490000e900 tx=0x7f490000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490e000640 1 -- 172.21.15.144:0/424919678 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900017070 con 0x7f491815af60 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490e000640 1 -- 172.21.15.144:0/424919678 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490000ca00 con 0x7f491815af60 2024-09-12T12:15:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 -- 172.21.15.144:0/424919678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4918144c50 con 0x7f491815af60 2024-09-12T12:15:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f490e000640 1 -- 172.21.15.144:0/424919678 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490000cdd0 con 0x7f491815af60 2024-09-12T12:15:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.299+0000 7f491ca00640 1 -- 172.21.15.144:0/424919678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49181f7b20 con 0x7f491815af60 2024-09-12T12:15:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f490e000640 1 -- 172.21.15.144:0/424919678 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f490001a070 con 0x7f491815af60 2024-09-12T12:15:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f490e000640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48f40678c0 0x7f48f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f490e000640 1 -- 172.21.15.144:0/424919678 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f49000861c0 con 0x7f491815af60 2024-09-12T12:15:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48f40678c0 0x7f48f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f491fd69000 1 Processor -- start 2024-09-12T12:15:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48f40678c0 0x7f48f4069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4908009b30 tx=0x7f4908008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f491fd69000 1 -- start start 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f491fd69000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007df6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f491fd69000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007dac550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f491fd69000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007dace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f491fd69000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565007bf9b70 con 0x565007df5e60 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f491fd69000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565007b9ff10 con 0x565007df6780 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f491fd69000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x565007bf5b30 con 0x565007daca90 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007df6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007df6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41392/0 (socket says 172.21.15.144:41392) 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 -- 172.21.15.144:0/2035444981 learned_addr learned my addr 172.21.15.144:0/2035444981 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f490fe00640 1 --2- 172.21.15.144:0/2035444981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007dac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4916800640 1 --2- 172.21.15.144:0/2035444981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007dace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 -- 172.21.15.144:0/2035444981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 msgr2=0x565007dace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 --2- 172.21.15.144:0/2035444981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007dace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 -- 172.21.15.144:0/2035444981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 msgr2=0x565007dac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 --2- 172.21.15.144:0/2035444981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007dac550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 -- 172.21.15.144:0/2035444981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565007badd60 con 0x565007df5e60 2024-09-12T12:15:55.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4915e00640 1 --2- 172.21.15.144:0/2035444981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007df6240 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4908011e10 tx=0x7f4908014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6899a5a2dc6bcaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4906a00640 1 -- 172.21.15.144:0/2035444981 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4908011e40 con 0x565007df5e60 2024-09-12T12:15:55.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4906a00640 1 -- 172.21.15.144:0/2035444981 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4908026070 con 0x565007df5e60 2024-09-12T12:15:55.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.303+0000 7f4906a00640 1 -- 172.21.15.144:0/2035444981 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4908021660 con 0x565007df5e60 2024-09-12T12:15:55.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- 172.21.15.144:0/2035444981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 msgr2=0x565007df6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 --2- 172.21.15.144:0/2035444981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007df6240 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4908011e10 tx=0x7f4908014000 comp rx=0 tx=0).stop 2024-09-12T12:15:55.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- 172.21.15.144:0/2035444981 shutdown_connections 2024-09-12T12:15:55.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 --2- 172.21.15.144:0/2035444981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007dace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 --2- 172.21.15.144:0/2035444981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007dac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 --2- 172.21.15.144:0/2035444981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007df6240 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- 172.21.15.144:0/2035444981 >> 172.21.15.144:0/2035444981 conn(0x565007da8a40 msgr2=0x565007daae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- 172.21.15.144:0/2035444981 shutdown_connections 2024-09-12T12:15:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- 172.21.15.144:0/2035444981 wait complete. 2024-09-12T12:15:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- start start 2024-09-12T12:15:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 Processor -- start 2024-09-12T12:15:55.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007dfcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007dfd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007dfd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565007bfe1a0 con 0x565007df5e60 2024-09-12T12:15:55.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565007bb74d0 con 0x565007df6780 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x565007b7eb60 con 0x565007daca90 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 10 client.0 _ll_register_callbacks cb 0x565007bcfef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f490fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007dfd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f490fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007dfd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41396/0 (socket says 172.21.15.144:41396) 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f490fe00640 1 -- 172.21.15.144:0/2362862894 learned_addr learned my addr 172.21.15.144:0/2362862894 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f4916800640 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007dfd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f4915e00640 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007dfcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f490fe00640 1 -- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 msgr2=0x565007dfcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f490fe00640 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007dfcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f490fe00640 1 -- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 msgr2=0x565007dfd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f490fe00640 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007dfd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f490fe00640 1 -- 172.21.15.144:0/2362862894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565007bbcce0 con 0x565007df5e60 2024-09-12T12:15:55.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f4916800640 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007dfd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f4915e00640 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007dfcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f490fe00640 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007dfd310 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f490000c520 tx=0x7f4900056540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984426e6e3a0adb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f48fb400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f48fb400640 1 -- 172.21.15.144:0/2362862894 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900021030 con 0x565007df5e60 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f48fb400640 1 -- 172.21.15.144:0/2362862894 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f490006e380 con 0x565007df5e60 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- 172.21.15.144:0/2362862894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4908026070 con 0x565007df5e60 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f48fb400640 1 -- 172.21.15.144:0/2362862894 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4900084120 con 0x565007df5e60 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 10 client.5808 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.307+0000 7f491fd69000 1 -- 172.21.15.144:0/2362862894 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x565007ba0160 con 0x565007df5e60 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f48fb400640 1 -- 172.21.15.144:0/2362862894 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4908026070 con 0x565007df5e60 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f48fb400640 1 -- 172.21.15.144:0/2362862894 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f49000558d0 con 0x565007df5e60 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 10 client.5808 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 10 client.5808 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 20 client.5808 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x565007e051a0 0x565007e07590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 4 client.5808 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 -- 172.21.15.144:0/2362862894 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565007b93cc0 con 0x565007e051a0 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f4915e00640 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x565007e051a0 0x565007e07590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f4915e00640 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x565007e051a0 0x565007e07590 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c34554c8ec70743e server_cookie=6a8f142a04af07b0 in_seq=0 out_seq=0 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f48fb400640 10 client.5808 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f48fb400640 1 -- 172.21.15.144:0/2362862894 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565007b93cc0 con 0x565007e051a0 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f48fb400640 10 client.5808 handle_command_reply: tid=0 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 client.5808 shutdown 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 -- 172.21.15.144:0/2362862894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 msgr2=0x565007dfd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007dfd310 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f490000c520 tx=0x7f4900056540 comp rx=0 tx=0).stop 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 -- 172.21.15.144:0/2362862894 shutdown_connections 2024-09-12T12:15:55.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x565007e051a0 0x565007e07590 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007dfd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007dfd310 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f48fb400640 0 client.5808 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 --2- 172.21.15.144:0/2362862894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007dfcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 -- 172.21.15.144:0/2362862894 >> 172.21.15.144:0/2362862894 conn(0x565007da8a40 msgr2=0x565007dab650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 -- 172.21.15.144:0/2362862894 shutdown_connections 2024-09-12T12:15:55.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 1 -- 172.21.15.144:0/2362862894 wait complete. 2024-09-12T12:15:55.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.311+0000 7f491fd69000 20 client.5808 trim_cache size 0 max 16384 2024-09-12T12:15:55.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 Processor -- start 2024-09-12T12:15:55.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- start start 2024-09-12T12:15:55.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007daca90 0x565007e6eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007df5e60 0x565007e6eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df6780 0x565007e6f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49182010e0 con 0x565007df6780 2024-09-12T12:15:55.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f49182000e0 con 0x565007daca90 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f49180af210 con 0x565007df5e60 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4916800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df6780 0x565007e6f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4916800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df6780 0x565007e6f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41406/0 (socket says 172.21.15.144:41406) 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4916800640 1 -- 172.21.15.144:0/1696354696 learned_addr learned my addr 172.21.15.144:0/1696354696 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4915e00640 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007daca90 0x565007e6eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f490fe00640 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007df5e60 0x565007e6eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4916800640 1 -- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007df5e60 msgr2=0x565007e6eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4916800640 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007df5e60 0x565007e6eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4916800640 1 -- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007daca90 msgr2=0x565007e6eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4916800640 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007daca90 0x565007e6eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4916800640 1 -- 172.21.15.144:0/1696354696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565007b99510 con 0x565007df6780 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4915e00640 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007daca90 0x565007e6eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f490fe00640 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007df5e60 0x565007e6eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4916800640 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df6780 0x565007e6f530 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f491001f220 tx=0x7f4910004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5032084d48b767c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4906000640 1 -- 172.21.15.144:0/1696354696 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49100c7070 con 0x565007df6780 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4906000640 1 -- 172.21.15.144:0/1696354696 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4910009210 con 0x565007df6780 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f4906000640 1 -- 172.21.15.144:0/1696354696 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49100b4040 con 0x565007df6780 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- 172.21.15.144:0/1696354696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df6780 msgr2=0x565007e6f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df6780 0x565007e6f530 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f491001f220 tx=0x7f4910004ac0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- 172.21.15.144:0/1696354696 shutdown_connections 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df6780 0x565007e6f530 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007df5e60 0x565007e6eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 --2- 172.21.15.144:0/1696354696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007daca90 0x565007e6eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- 172.21.15.144:0/1696354696 >> 172.21.15.144:0/1696354696 conn(0x565007da8a40 msgr2=0x565007daae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- 172.21.15.144:0/1696354696 shutdown_connections 2024-09-12T12:15:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- 172.21.15.144:0/1696354696 wait complete. 2024-09-12T12:15:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 -- start start 2024-09-12T12:15:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.331+0000 7f491fd69000 1 Processor -- start 2024-09-12T12:15:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007e726d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007e72c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007e73150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565007bf8e80 con 0x565007df5e60 2024-09-12T12:15:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4918072ed0 con 0x565007df6780 2024-09-12T12:15:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x565007bfe1a0 con 0x565007daca90 2024-09-12T12:15:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 10 client.0 _ll_register_callbacks cb 0x7f49000860b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f490fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007e72c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f490fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007e72c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41416/0 (socket says 172.21.15.144:41416) 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f490fe00640 1 -- 172.21.15.144:0/989514152 learned_addr learned my addr 172.21.15.144:0/989514152 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f4915e00640 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007e726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f4916800640 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007e73150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f490fe00640 1 -- 172.21.15.144:0/989514152 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 msgr2=0x565007e726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f490fe00640 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007e726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f490fe00640 1 -- 172.21.15.144:0/989514152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 msgr2=0x565007e73150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f490fe00640 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007e73150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f490fe00640 1 -- 172.21.15.144:0/989514152 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565007c53ad0 con 0x565007df5e60 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f490fe00640 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007e72c10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f49000549b0 tx=0x7f4900000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4495ddb503c70245 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 1 -- 172.21.15.144:0/989514152 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900021050 con 0x565007df5e60 2024-09-12T12:15:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 1 -- 172.21.15.144:0/989514152 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f4900055340 con 0x565007df5e60 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- 172.21.15.144:0/989514152 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4910009210 con 0x565007df5e60 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 1 -- 172.21.15.144:0/989514152 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f490007b050 con 0x565007df5e60 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 10 client.5814 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- 172.21.15.144:0/989514152 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x565007b87af0 con 0x565007df5e60 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 1 -- 172.21.15.144:0/989514152 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4910009210 con 0x565007df5e60 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 1 -- 172.21.15.144:0/989514152 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f4900074ce0 con 0x565007df5e60 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 10 client.5814 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 10 client.5814 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 20 client.5814 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x565007e093f0 0x565007e09800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 4 client.5814 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-12T12:15:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- 172.21.15.144:0/989514152 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x565007df5cb0 con 0x565007e093f0 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f4915e00640 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x565007e093f0 0x565007e09800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f4915e00640 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x565007e093f0 0x565007e09800 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9f3df150baa0d98 server_cookie=e129b7476edc089e in_seq=0 out_seq=0 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 10 client.5814 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 1 -- 172.21.15.144:0/989514152 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x565007df5cb0 con 0x565007e093f0 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 10 client.5814 handle_command_reply: tid=0 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 client.5814 shutdown 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- 172.21.15.144:0/989514152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 msgr2=0x565007e72c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007e72c10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f49000549b0 tx=0x7f4900000bd0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- 172.21.15.144:0/989514152 shutdown_connections 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x565007e093f0 0x565007e09800 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565007df6780 0x565007e73150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565007df5e60 0x565007e72c10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f48fb400640 0 client.5814 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 --2- 172.21.15.144:0/989514152 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565007daca90 0x565007e726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- 172.21.15.144:0/989514152 >> 172.21.15.144:0/989514152 conn(0x565007da8a40 msgr2=0x565007dab650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- 172.21.15.144:0/989514152 shutdown_connections 2024-09-12T12:15:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 1 -- 172.21.15.144:0/989514152 wait complete. 2024-09-12T12:15:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.335+0000 7f491fd69000 20 client.5814 trim_cache size 0 max 16384 2024-09-12T12:15:55.344 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:55.344 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": -2 2024-09-12T12:15:55.344 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 -- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48f40678c0 msgr2=0x7f48f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48f40678c0 0x7f48f4069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4908009b30 tx=0x7f4908008040 comp rx=0 tx=0).stop 2024-09-12T12:15:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 -- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815af60 msgr2=0x7f4918144220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815af60 0x7f4918144220 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f490000e900 tx=0x7f490000edc0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 -- 172.21.15.144:0/424919678 shutdown_connections 2024-09-12T12:15:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48f40678c0 0x7f48f4069d80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f491815b340 0x7f49181f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f491815af60 0x7f4918144220 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 --2- 172.21.15.144:0/424919678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49180cd9f0 0x7f4918073d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 -- 172.21.15.144:0/424919678 >> 172.21.15.144:0/424919678 conn(0x7f4918068030 msgr2=0x7f491815f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 -- 172.21.15.144:0/424919678 shutdown_connections 2024-09-12T12:15:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.339+0000 7f491ca00640 1 -- 172.21.15.144:0/424919678 wait complete. 2024-09-12T12:15:55.359 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-12T12:15:55.359 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-12T12:15:55.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-12T12:15:55.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04fb200640 1 Processor -- start 2024-09-12T12:15:55.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04fb200640 1 -- start start 2024-09-12T12:15:55.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04fb200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f04f4160bf0 0x7f04f40d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04fb200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f415cd10 con 0x7f04f415c790 2024-09-12T12:15:55.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04fb200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f415cff0 con 0x7f04f415c3b0 2024-09-12T12:15:55.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04fb200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f04f415d640 con 0x7f04f4160bf0 2024-09-12T12:15:55.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f9200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f04f415c790 0x7f04f40d02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53854/0 (socket says 172.21.15.144:53854) 2024-09-12T12:15:55.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f9200640 1 -- 172.21.15.144:0/2223234853 learned_addr learned my addr 172.21.15.144:0/2223234853 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:55.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f3400640 1 --2- 172.21.15.144:0/2223234853 >> v2:172.21.15.165:3300/0 conn(0x7f04f4160bf0 0x7f04f40d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518632209 0 0) 0x7f04f415cd10 con 0x7f04f415c790 2024-09-12T12:15:55.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04d8003530 con 0x7f04f415c790 2024-09-12T12:15:55.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3445199177 0 0) 0x7f04d8003530 con 0x7f04f415c790 2024-09-12T12:15:55.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 >> v2:172.21.15.165:3300/0 conn(0x7f04f4160bf0 msgr2=0x7f04f40d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 --2- 172.21.15.144:0/2223234853 >> v2:172.21.15.165:3300/0 conn(0x7f04f4160bf0 0x7f04f40d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 >> v1:172.21.15.165:6789/0 conn(0x7f04f415c3b0 legacy=0x7f04f4073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f415d2d0 con 0x7f04f415c790 2024-09-12T12:15:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f04ec001a00 con 0x7f04f415c790 2024-09-12T12:15:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 >> v1:172.21.15.144:6789/0 conn(0x7f04f415c790 legacy=0x7f04f40d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d80039c0 0x7f04d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d8004810 0x7f04d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04d80051d0 0x7f04d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04f415d640 con 0x7f04d80039c0 2024-09-12T12:15:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04d800c170 con 0x7f04d80051d0 2024-09-12T12:15:55.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f04d800c370 con 0x7f04d8004810 2024-09-12T12:15:55.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d80039c0 0x7f04d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f9200640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04d80051d0 0x7f04d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f3400640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d8004810 0x7f04d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f3e00640 1 -- 172.21.15.144:0/2223234853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d8004810 msgr2=0x7f04d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d8004810 0x7f04d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f3e00640 1 -- 172.21.15.144:0/2223234853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04d80051d0 msgr2=0x7f04d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04d80051d0 0x7f04d800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f3e00640 1 -- 172.21.15.144:0/2223234853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d8003530 con 0x7f04d80039c0 2024-09-12T12:15:55.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.499+0000 7f04f9200640 1 -- 172.21.15.144:0/2223234853 reap_dead start 2024-09-12T12:15:55.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d80039c0 0x7f04d8003de0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f04e4001780 tx=0x7f04e401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f72d16c988e99b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40013a0 con 0x7f04d80039c0 2024-09-12T12:15:55.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e40052f0 con 0x7f04d80039c0 2024-09-12T12:15:55.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04f2a00640 1 -- 172.21.15.144:0/2223234853 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4003840 con 0x7f04d80039c0 2024-09-12T12:15:55.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04fb200640 1 -- 172.21.15.144:0/2223234853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d80039c0 msgr2=0x7f04d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04fb200640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d80039c0 0x7f04d8003de0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f04e4001780 tx=0x7f04e401c3d0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04fb200640 1 -- 172.21.15.144:0/2223234853 shutdown_connections 2024-09-12T12:15:55.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04fb200640 1 --2- 172.21.15.144:0/2223234853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d80039c0 0x7f04d8003de0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04fb200640 1 -- 172.21.15.144:0/2223234853 >> 172.21.15.144:0/2223234853 conn(0x7f04f406c010 msgr2=0x7f04f4067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04fb200640 1 -- 172.21.15.144:0/2223234853 shutdown_connections 2024-09-12T12:15:55.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.503+0000 7f04fb200640 1 -- 172.21.15.144:0/2223234853 wait complete. 2024-09-12T12:15:55.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 Processor -- start 2024-09-12T12:15:55.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 -- start start 2024-09-12T12:15:55.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04d80039c0 0x7f04f414e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4150c00 0x7f04f4150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04f4151f60 0x7f04f41505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04f406f580 con 0x7f04f4150c00 2024-09-12T12:15:55.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04f406f400 con 0x7f04d80039c0 2024-09-12T12:15:55.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f04f406f700 con 0x7f04f4151f60 2024-09-12T12:15:55.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4150c00 0x7f04f4150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4150c00 0x7f04f4150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41428/0 (socket says 172.21.15.144:41428) 2024-09-12T12:15:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3400640 1 -- 172.21.15.144:0/2475959371 learned_addr learned my addr 172.21.15.144:0/2475959371 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04d80039c0 0x7f04f414e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f9200640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04f4151f60 0x7f04f41505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3400640 1 -- 172.21.15.144:0/2475959371 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04f4151f60 msgr2=0x7f04f41505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3400640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04f4151f60 0x7f04f41505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3400640 1 -- 172.21.15.144:0/2475959371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04d80039c0 msgr2=0x7f04f414e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3400640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04d80039c0 0x7f04f414e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3400640 1 -- 172.21.15.144:0/2475959371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f406d7d0 con 0x7f04f4150c00 2024-09-12T12:15:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04f3400640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4150c00 0x7f04f4150060 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f04e0011870 tx=0x7f04e0011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04ebe00640 1 -- 172.21.15.144:0/2475959371 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0019070 con 0x7f04f4150c00 2024-09-12T12:15:55.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04ebe00640 1 -- 172.21.15.144:0/2475959371 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0004240 con 0x7f04f4150c00 2024-09-12T12:15:55.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 -- 172.21.15.144:0/2475959371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f4151720 con 0x7f04f4150c00 2024-09-12T12:15:55.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04ebe00640 1 -- 172.21.15.144:0/2475959371 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e000f820 con 0x7f04f4150c00 2024-09-12T12:15:55.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.507+0000 7f04fb200640 1 -- 172.21.15.144:0/2475959371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f4151ce0 con 0x7f04f4150c00 2024-09-12T12:15:55.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.511+0000 7f04ebe00640 1 -- 172.21.15.144:0/2475959371 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04e001c070 con 0x7f04f4150c00 2024-09-12T12:15:55.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.511+0000 7f04ebe00640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f04d40678f0 0x7f04d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.511+0000 7f04ebe00640 1 -- 172.21.15.144:0/2475959371 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f04e0086110 con 0x7f04f4150c00 2024-09-12T12:15:55.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.511+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f04d40678f0 0x7f04d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.511+0000 7f04fe54c000 1 Processor -- start 2024-09-12T12:15:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.511+0000 7f04fe54c000 1 -- start start 2024-09-12T12:15:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.511+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f04d40678f0 0x7f04d4069db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f04e4001750 tx=0x7f04e40011a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 0x55ca7fca56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5c30 0x55ca7fc5b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc5bb10 0x55ca7fc5bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ca7fb43200 con 0x55ca7fca5c30 2024-09-12T12:15:55.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ca7fa46620 con 0x55ca7fca5310 2024-09-12T12:15:55.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ca7faa8b80 con 0x55ca7fc5bb10 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5c30 0x55ca7fc5b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5c30 0x55ca7fc5b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41436/0 (socket says 172.21.15.144:41436) 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3400640 1 -- 172.21.15.144:0/558825220 learned_addr learned my addr 172.21.15.144:0/558825220 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3e00640 1 --2- 172.21.15.144:0/558825220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 0x55ca7fca56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f9200640 1 --2- 172.21.15.144:0/558825220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc5bb10 0x55ca7fc5bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3400640 1 -- 172.21.15.144:0/558825220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc5bb10 msgr2=0x55ca7fc5bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3400640 1 --2- 172.21.15.144:0/558825220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc5bb10 0x55ca7fc5bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3400640 1 -- 172.21.15.144:0/558825220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 msgr2=0x55ca7fca56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3400640 1 --2- 172.21.15.144:0/558825220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 0x55ca7fca56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3400640 1 -- 172.21.15.144:0/558825220 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca7fa85470 con 0x55ca7fca5c30 2024-09-12T12:15:55.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04f3400640 1 --2- 172.21.15.144:0/558825220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5c30 0x55ca7fc5b5d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f04e005e9d0 tx=0x7f04e00563d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5ef450207a4c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04e8c00640 1 -- 172.21.15.144:0/558825220 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0023040 con 0x55ca7fca5c30 2024-09-12T12:15:55.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04e8c00640 1 -- 172.21.15.144:0/558825220 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e00546d0 con 0x55ca7fca5c30 2024-09-12T12:15:55.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04e8c00640 1 -- 172.21.15.144:0/558825220 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e006e170 con 0x55ca7fca5c30 2024-09-12T12:15:55.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 -- 172.21.15.144:0/558825220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5c30 msgr2=0x55ca7fc5b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 --2- 172.21.15.144:0/558825220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5c30 0x55ca7fc5b5d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f04e005e9d0 tx=0x7f04e00563d0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 -- 172.21.15.144:0/558825220 shutdown_connections 2024-09-12T12:15:55.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 --2- 172.21.15.144:0/558825220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc5bb10 0x55ca7fc5bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 --2- 172.21.15.144:0/558825220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5c30 0x55ca7fc5b5d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 --2- 172.21.15.144:0/558825220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 0x55ca7fca56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 -- 172.21.15.144:0/558825220 >> 172.21.15.144:0/558825220 conn(0x55ca7fc61c70 msgr2=0x55ca7fc59eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 -- 172.21.15.144:0/558825220 shutdown_connections 2024-09-12T12:15:55.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 -- 172.21.15.144:0/558825220 wait complete. 2024-09-12T12:15:55.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 -- start start 2024-09-12T12:15:55.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 Processor -- start 2024-09-12T12:15:55.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.515+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc5bb10 0x55ca7fca4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5310 0x55ca7fc5f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5c30 0x55ca7fc5ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ca7faa4b40 con 0x55ca7fca5310 2024-09-12T12:15:55.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ca7fa4e350 con 0x55ca7fc5bb10 2024-09-12T12:15:55.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ca7fa425b0 con 0x55ca7fca5c30 2024-09-12T12:15:55.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 10 client.0 _ll_register_callbacks cb 0x55ca7fb0b490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5310 0x55ca7fc5f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5310 0x55ca7fc5f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41452/0 (socket says 172.21.15.144:41452) 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3400640 1 -- 172.21.15.144:0/704321644 learned_addr learned my addr 172.21.15.144:0/704321644 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3e00640 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc5bb10 0x55ca7fca4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f9200640 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5c30 0x55ca7fc5ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3400640 1 -- 172.21.15.144:0/704321644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5c30 msgr2=0x55ca7fc5ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3400640 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5c30 0x55ca7fc5ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3400640 1 -- 172.21.15.144:0/704321644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc5bb10 msgr2=0x55ca7fca4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3400640 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc5bb10 0x55ca7fca4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3400640 1 -- 172.21.15.144:0/704321644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca7faef250 con 0x55ca7fca5310 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3e00640 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc5bb10 0x55ca7fca4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3400640 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5310 0x55ca7fc5f9e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f04e005a040 tx=0x7f04e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbc5c6cdbbfd4d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 1 -- 172.21.15.144:0/704321644 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0083070 con 0x55ca7fca5310 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 1 -- 172.21.15.144:0/704321644 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f04e005ec70 con 0x55ca7fca5310 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- 172.21.15.144:0/704321644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e00546d0 con 0x55ca7fca5310 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 1 -- 172.21.15.144:0/704321644 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04e0023040 con 0x55ca7fca5310 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 10 client.5826 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- 172.21.15.144:0/704321644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ca7fa4eca0 con 0x55ca7fca5310 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 1 -- 172.21.15.144:0/704321644 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e00546d0 con 0x55ca7fca5310 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 1 -- 172.21.15.144:0/704321644 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f04e0055820 con 0x55ca7fca5310 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 10 client.5826 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 10 client.5826 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 20 client.5826 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ca7fc60c90 0x55ca7fcb55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 4 client.5826 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- 172.21.15.144:0/704321644 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca7fa42d60 con 0x55ca7fc60c90 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3e00640 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ca7fc60c90 0x55ca7fcb55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04f3e00640 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ca7fc60c90 0x55ca7fcb55b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f850223848b09ead server_cookie=555a904e0406fec in_seq=0 out_seq=0 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 10 client.5826 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 1 -- 172.21.15.144:0/704321644 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca7fa42d60 con 0x55ca7fc60c90 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 10 client.5826 handle_command_reply: tid=0 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 client.5826 shutdown 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- 172.21.15.144:0/704321644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5310 msgr2=0x55ca7fc5f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5310 0x55ca7fc5f9e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f04e005a040 tx=0x7f04e0008040 comp rx=0 tx=0).stop 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- 172.21.15.144:0/704321644 shutdown_connections 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ca7fc60c90 0x55ca7fcb55b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5c30 0x55ca7fc5ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fca5310 0x55ca7fc5f9e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 --2- 172.21.15.144:0/704321644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc5bb10 0x55ca7fca4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04dd600640 0 client.5826 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- 172.21.15.144:0/704321644 >> 172.21.15.144:0/704321644 conn(0x55ca7fc61c70 msgr2=0x55ca7fc5a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- 172.21.15.144:0/704321644 shutdown_connections 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.519+0000 7f04fe54c000 1 -- 172.21.15.144:0/704321644 wait complete. 2024-09-12T12:15:55.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.523+0000 7f04fe54c000 20 client.5826 trim_cache size 0 max 16384 2024-09-12T12:15:55.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04fe54c000 1 Processor -- start 2024-09-12T12:15:55.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04fe54c000 1 -- start start 2024-09-12T12:15:55.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc61c70 0x55ca7fd136f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd13c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5310 0x55ca7fd14170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04fe54c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04f4204ab0 con 0x55ca7fc5bb10 2024-09-12T12:15:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04fe54c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04f4203ab0 con 0x55ca7fc61c70 2024-09-12T12:15:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04fe54c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f04f4202e40 con 0x55ca7fca5310 2024-09-12T12:15:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd13c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd13c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41462/0 (socket says 172.21.15.144:41462) 2024-09-12T12:15:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3400640 1 -- 172.21.15.144:0/2073457484 learned_addr learned my addr 172.21.15.144:0/2073457484 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f9200640 1 --2- 172.21.15.144:0/2073457484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5310 0x55ca7fd14170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2073457484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc61c70 0x55ca7fd136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3400640 1 -- 172.21.15.144:0/2073457484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5310 msgr2=0x55ca7fd14170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3400640 1 --2- 172.21.15.144:0/2073457484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5310 0x55ca7fd14170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3400640 1 -- 172.21.15.144:0/2073457484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc61c70 msgr2=0x55ca7fd136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3400640 1 --2- 172.21.15.144:0/2073457484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc61c70 0x55ca7fd136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3400640 1 -- 172.21.15.144:0/2073457484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca7fa485b0 con 0x55ca7fc5bb10 2024-09-12T12:15:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04f3400640 1 --2- 172.21.15.144:0/2073457484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd13c30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f04e0084290 tx=0x7f04e007f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebde433e6aac2fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04dfe00640 1 -- 172.21.15.144:0/2073457484 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0083040 con 0x55ca7fc5bb10 2024-09-12T12:15:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04dfe00640 1 -- 172.21.15.144:0/2073457484 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0073070 con 0x55ca7fc5bb10 2024-09-12T12:15:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.539+0000 7f04dfe00640 1 -- 172.21.15.144:0/2073457484 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e005ea70 con 0x55ca7fc5bb10 2024-09-12T12:15:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- 172.21.15.144:0/2073457484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 msgr2=0x55ca7fd13c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2073457484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd13c30 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f04e0084290 tx=0x7f04e007f070 comp rx=0 tx=0).stop 2024-09-12T12:15:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- 172.21.15.144:0/2073457484 shutdown_connections 2024-09-12T12:15:55.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2073457484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fca5310 0x55ca7fd14170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2073457484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd13c30 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2073457484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fc61c70 0x55ca7fd136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- 172.21.15.144:0/2073457484 >> 172.21.15.144:0/2073457484 conn(0x55ca7fcb0a60 msgr2=0x55ca7fc5f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- 172.21.15.144:0/2073457484 shutdown_connections 2024-09-12T12:15:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- 172.21.15.144:0/2073457484 wait complete. 2024-09-12T12:15:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- start start 2024-09-12T12:15:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 Processor -- start 2024-09-12T12:15:55.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd17900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc61c70 0x55ca7fd17e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 0x55ca7fcd28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ca7fa46620 con 0x55ca7fc5bb10 2024-09-12T12:15:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ca7faa4b40 con 0x55ca7fca5310 2024-09-12T12:15:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ca7fa6ca60 con 0x55ca7fc61c70 2024-09-12T12:15:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 10 client.0 _ll_register_callbacks cb 0x7f04e006d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd17900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd17900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41478/0 (socket says 172.21.15.144:41478) 2024-09-12T12:15:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3e00640 1 -- 172.21.15.144:0/2123232086 learned_addr learned my addr 172.21.15.144:0/2123232086 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3400640 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc61c70 0x55ca7fd17e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f9200640 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 0x55ca7fcd28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3e00640 1 -- 172.21.15.144:0/2123232086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc61c70 msgr2=0x55ca7fd17e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc61c70 0x55ca7fd17e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3e00640 1 -- 172.21.15.144:0/2123232086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 msgr2=0x55ca7fcd28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 0x55ca7fcd28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3e00640 1 -- 172.21.15.144:0/2123232086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca7fa3c4e0 con 0x55ca7fc5bb10 2024-09-12T12:15:55.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04f3e00640 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd17900 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f04e4007110 tx=0x7f04e401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7966015a4a623ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04dd600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04dd600640 1 -- 172.21.15.144:0/2123232086 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40d2060 con 0x55ca7fc5bb10 2024-09-12T12:15:55.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04dd600640 1 -- 172.21.15.144:0/2123232086 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f04e4006cb0 con 0x55ca7fc5bb10 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- 172.21.15.144:0/2123232086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e0073070 con 0x55ca7fc5bb10 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04dd600640 1 -- 172.21.15.144:0/2123232086 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04e40d8050 con 0x55ca7fc5bb10 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 10 client.5832 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- 172.21.15.144:0/2123232086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ca7fa40690 con 0x55ca7fc5bb10 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04dd600640 1 -- 172.21.15.144:0/2123232086 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0073070 con 0x55ca7fc5bb10 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04dd600640 1 -- 172.21.15.144:0/2123232086 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f04e40db020 con 0x55ca7fc5bb10 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 10 client.5832 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 10 client.5832 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 20 client.5832 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ca7fca5c30 0x55ca7fcd2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 4 client.5832 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-12T12:15:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.543+0000 7f04fe54c000 1 -- 172.21.15.144:0/2123232086 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55ca7fab62b0 con 0x55ca7fca5c30 2024-09-12T12:15:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04f3400640 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ca7fca5c30 0x55ca7fcd2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04f3400640 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ca7fca5c30 0x55ca7fcd2e20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6ddd5e5009a738 server_cookie=9c687abead08766 in_seq=0 out_seq=0 2024-09-12T12:15:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04dd600640 10 client.5832 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04dd600640 1 -- 172.21.15.144:0/2123232086 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ca7fab62b0 con 0x55ca7fca5c30 2024-09-12T12:15:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04dd600640 10 client.5832 handle_command_reply: tid=0 2024-09-12T12:15:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 client.5832 shutdown 2024-09-12T12:15:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 -- 172.21.15.144:0/2123232086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 msgr2=0x55ca7fd17900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd17900 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f04e4007110 tx=0x7f04e401ac10 comp rx=0 tx=0).stop 2024-09-12T12:15:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 -- 172.21.15.144:0/2123232086 shutdown_connections 2024-09-12T12:15:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55ca7fca5c30 0x55ca7fcd2e20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ca7fca5310 0x55ca7fcd28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ca7fc61c70 0x55ca7fd17e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 --2- 172.21.15.144:0/2123232086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ca7fc5bb10 0x55ca7fd17900 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 -- 172.21.15.144:0/2123232086 >> 172.21.15.144:0/2123232086 conn(0x55ca7fcb0a60 msgr2=0x55ca7fc5f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04dd600640 0 client.5832 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 -- 172.21.15.144:0/2123232086 shutdown_connections 2024-09-12T12:15:55.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 1 -- 172.21.15.144:0/2123232086 wait complete. 2024-09-12T12:15:55.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fe54c000 20 client.5832 trim_cache size 0 max 16384 2024-09-12T12:15:55.564 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:55.565 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:15:55.565 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "f4f42f27-1e58-4cb2-9b98-85e8aba84009", 2024-09-12T12:15:55.565 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:15:55.565 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:55.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 -- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f04d40678f0 msgr2=0x7f04d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f04d40678f0 0x7f04d4069db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f04e4001750 tx=0x7f04e40011a0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 -- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4150c00 msgr2=0x7f04f4150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4150c00 0x7f04f4150060 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f04e0011870 tx=0x7f04e0011d30 comp rx=0 tx=0).stop 2024-09-12T12:15:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 -- 172.21.15.144:0/2475959371 shutdown_connections 2024-09-12T12:15:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f04d40678f0 0x7f04d4069db0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04f4151f60 0x7f04f41505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04f4150c00 0x7f04f4150060 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 --2- 172.21.15.144:0/2475959371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04d80039c0 0x7f04f414e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 -- 172.21.15.144:0/2475959371 >> 172.21.15.144:0/2475959371 conn(0x7f04f406c010 msgr2=0x7f04f415ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 -- 172.21.15.144:0/2475959371 shutdown_connections 2024-09-12T12:15:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.547+0000 7f04fb200640 1 -- 172.21.15.144:0/2475959371 wait complete. 2024-09-12T12:15:55.570 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'f4f42f27-1e58-4cb2-9b98-85e8aba84009', 'mode': 'asynchronous'}' 2024-09-12T12:15:55.570 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-12T12:15:55.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-12T12:15:55.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.707+0000 7fd90e600640 1 Processor -- start 2024-09-12T12:15:55.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.707+0000 7fd90e600640 1 -- start start 2024-09-12T12:15:55.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.707+0000 7fd90e600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd9080cd9f0 0x7fd90806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.707+0000 7fd90e600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd90815b340 0x7fd90806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.707+0000 7fd90e600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9080b4300 con 0x7fd90815af60 2024-09-12T12:15:55.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.707+0000 7fd90e600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd9080b32f0 con 0x7fd90815b340 2024-09-12T12:15:55.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.707+0000 7fd90e600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd9080b3540 con 0x7fd9080cd9f0 2024-09-12T12:15:55.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.707+0000 7fd907400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd90815af60 0x7fd9080ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53862/0 (socket says 172.21.15.144:53862) 2024-09-12T12:15:55.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.707+0000 7fd907400640 1 -- 172.21.15.144:0/2873010102 learned_addr learned my addr 172.21.15.144:0/2873010102 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:55.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd907e00640 1 --2- 172.21.15.144:0/2873010102 >> v2:172.21.15.144:3300/0 conn(0x7fd90815b340 0x7fd90806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd907e00640 1 -- 172.21.15.144:0/2873010102 >> v2:172.21.15.165:3300/0 conn(0x7fd9080cd9f0 msgr2=0x7fd90806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd906a00640 1 --2- 172.21.15.144:0/2873010102 >> v2:172.21.15.165:3300/0 conn(0x7fd9080cd9f0 0x7fd90806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd907e00640 1 --2- 172.21.15.144:0/2873010102 >> v2:172.21.15.165:3300/0 conn(0x7fd9080cd9f0 0x7fd90806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd906000640 1 -- 172.21.15.144:0/2873010102 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190836611 0 0) 0x7fd9080b4300 con 0x7fd90815af60 2024-09-12T12:15:55.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd907e00640 1 -- 172.21.15.144:0/2873010102 >> v1:172.21.15.144:6789/0 conn(0x7fd90815af60 legacy=0x7fd9080ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd907e00640 1 -- 172.21.15.144:0/2873010102 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9080b3820 con 0x7fd90815b340 2024-09-12T12:15:55.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd906a00640 1 --2- 172.21.15.144:0/2873010102 >> v2:172.21.15.165:3300/0 conn(0x7fd9080cd9f0 0x7fd90806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd907e00640 1 --2- 172.21.15.144:0/2873010102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90815b340 0x7fd90806c150 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd908070d20 tx=0x7fd90001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6e53732a98ac31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd906000640 1 -- 172.21.15.144:0/2873010102 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000b2070 con 0x7fd90815b340 2024-09-12T12:15:55.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd906000640 1 -- 172.21.15.144:0/2873010102 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9000a57f0 con 0x7fd90815b340 2024-09-12T12:15:55.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.711+0000 7fd906000640 1 -- 172.21.15.144:0/2873010102 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000a5bc0 con 0x7fd90815b340 2024-09-12T12:15:55.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 -- 172.21.15.144:0/2873010102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90815b340 msgr2=0x7fd90806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 --2- 172.21.15.144:0/2873010102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90815b340 0x7fd90806c150 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd908070d20 tx=0x7fd90001c930 comp rx=0 tx=0).stop 2024-09-12T12:15:55.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 -- 172.21.15.144:0/2873010102 shutdown_connections 2024-09-12T12:15:55.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 --2- 172.21.15.144:0/2873010102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd90815b340 0x7fd90806c150 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 --2- 172.21.15.144:0/2873010102 >> v2:172.21.15.165:3300/0 conn(0x7fd9080cd9f0 0x7fd90806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 -- 172.21.15.144:0/2873010102 >> 172.21.15.144:0/2873010102 conn(0x7fd908068030 msgr2=0x7fd9080b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 -- 172.21.15.144:0/2873010102 shutdown_connections 2024-09-12T12:15:55.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 -- 172.21.15.144:0/2873010102 wait complete. 2024-09-12T12:15:55.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 Processor -- start 2024-09-12T12:15:55.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 -- start start 2024-09-12T12:15:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9080cd9f0 0x7fd908144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd90815af60 0x7fd90814c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd90815b340 0x7fd90814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9080b5180 con 0x7fd9080cd9f0 2024-09-12T12:15:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd9080b5000 con 0x7fd90815b340 2024-09-12T12:15:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd90e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd9080b5300 con 0x7fd90815af60 2024-09-12T12:15:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9080cd9f0 0x7fd908144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9080cd9f0 0x7fd908144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41484/0 (socket says 172.21.15.144:41484) 2024-09-12T12:15:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907400640 1 -- 172.21.15.144:0/1602994977 learned_addr learned my addr 172.21.15.144:0/1602994977 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907e00640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd90815b340 0x7fd90814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd906a00640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd90815af60 0x7fd90814c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907400640 1 -- 172.21.15.144:0/1602994977 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd90815af60 msgr2=0x7fd90814c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907400640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd90815af60 0x7fd90814c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907400640 1 -- 172.21.15.144:0/1602994977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd90815b340 msgr2=0x7fd90814c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907400640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd90815b340 0x7fd90814c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907400640 1 -- 172.21.15.144:0/1602994977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd908072920 con 0x7fd9080cd9f0 2024-09-12T12:15:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.715+0000 7fd907400640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9080cd9f0 0x7fd908144db0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80011f0 tx=0x7fd8f800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.719+0000 7fd8ff400640 1 -- 172.21.15.144:0/1602994977 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8018070 con 0x7fd9080cd9f0 2024-09-12T12:15:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.719+0000 7fd8ff400640 1 -- 172.21.15.144:0/1602994977 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f80074e0 con 0x7fd9080cd9f0 2024-09-12T12:15:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.719+0000 7fd8ff400640 1 -- 172.21.15.144:0/1602994977 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8004a10 con 0x7fd9080cd9f0 2024-09-12T12:15:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.719+0000 7fd90e600640 1 -- 172.21.15.144:0/1602994977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90814daa0 con 0x7fd9080cd9f0 2024-09-12T12:15:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.719+0000 7fd90e600640 1 -- 172.21.15.144:0/1602994977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd908071e40 con 0x7fd9080cd9f0 2024-09-12T12:15:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.719+0000 7fd8ff400640 1 -- 172.21.15.144:0/1602994977 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8f8004bb0 con 0x7fd9080cd9f0 2024-09-12T12:15:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.719+0000 7fd8ff400640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8e80678c0 0x7fd8e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.719+0000 7fd8ff400640 1 -- 172.21.15.144:0/1602994977 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd8f80851f0 con 0x7fd9080cd9f0 2024-09-12T12:15:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd906a00640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8e80678c0 0x7fd8e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 Processor -- start 2024-09-12T12:15:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 -- start start 2024-09-12T12:15:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd906a00640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8e80678c0 0x7fd8e8069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd9080732d0 tx=0x7fd8f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 0x555599675830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 0x5555996293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555996298e0 0x555599629cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555599479fd0 con 0x5555996298e0 2024-09-12T12:15:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55559941f6b0 con 0x555599675d70 2024-09-12T12:15:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555599475f90 con 0x555599675450 2024-09-12T12:15:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555996298e0 0x555599629cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555996298e0 0x555599629cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41500/0 (socket says 172.21.15.144:41500) 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907e00640 1 -- 172.21.15.144:0/2922201606 learned_addr learned my addr 172.21.15.144:0/2922201606 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907400640 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 0x555599675830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd906a00640 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 0x5555996293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907e00640 1 -- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 msgr2=0x555599675830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907e00640 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 0x555599675830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907e00640 1 -- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 msgr2=0x5555996293a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907e00640 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 0x5555996293a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907e00640 1 -- 172.21.15.144:0/2922201606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559941f900 con 0x5555996298e0 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907400640 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 0x555599675830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd906a00640 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 0x5555996293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd907e00640 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555996298e0 0x555599629cc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd9000b0040 tx=0x7fd900004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa86605c2e2b035a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd8f3e00640 1 -- 172.21.15.144:0/2922201606 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000bc030 con 0x5555996298e0 2024-09-12T12:15:55.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd8f3e00640 1 -- 172.21.15.144:0/2922201606 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9000b3040 con 0x5555996298e0 2024-09-12T12:15:55.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd8f3e00640 1 -- 172.21.15.144:0/2922201606 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000b2070 con 0x5555996298e0 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 -- 172.21.15.144:0/2922201606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555996298e0 msgr2=0x555599629cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555996298e0 0x555599629cc0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd9000b0040 tx=0x7fd900004ac0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 -- 172.21.15.144:0/2922201606 shutdown_connections 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555996298e0 0x555599629cc0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 0x5555996293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 --2- 172.21.15.144:0/2922201606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 0x555599675830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 -- 172.21.15.144:0/2922201606 >> 172.21.15.144:0/2922201606 conn(0x55559913cfc0 msgr2=0x555599658900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 -- 172.21.15.144:0/2922201606 shutdown_connections 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.723+0000 7fd9118fc000 1 -- 172.21.15.144:0/2922201606 wait complete. 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 -- start start 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 Processor -- start 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x55559962af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 0x55559962b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675d70 0x55559962b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55559947e600 con 0x555599675d70 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555599437aa0 con 0x5555996298e0 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555599410ed0 con 0x555599675450 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 10 client.0 _ll_register_callbacks cb 0x555599616e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675d70 0x55559962b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675d70 0x55559962b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41508/0 (socket says 172.21.15.144:41508) 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907e00640 1 -- 172.21.15.144:0/3621502919 learned_addr learned my addr 172.21.15.144:0/3621502919 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd906a00640 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 0x55559962b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907400640 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x55559962af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907e00640 1 -- 172.21.15.144:0/3621502919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 msgr2=0x55559962b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907e00640 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 0x55559962b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907e00640 1 -- 172.21.15.144:0/3621502919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 msgr2=0x55559962af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907e00640 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x55559962af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907e00640 1 -- 172.21.15.144:0/3621502919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555599419a20 con 0x555599675d70 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907400640 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x55559962af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907e00640 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675d70 0x55559962b9a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd90001afe0 tx=0x7fd90001b170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18359025e83f7778 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd8f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd8f0c00640 1 -- 172.21.15.144:0/3621502919 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000b2070 con 0x555599675d70 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd8f0c00640 1 -- 172.21.15.144:0/3621502919 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd900004240 con 0x555599675d70 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 -- 172.21.15.144:0/3621502919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9000b3040 con 0x555599675d70 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd8f0c00640 1 -- 172.21.15.144:0/3621502919 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd900004440 con 0x555599675d70 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 10 client.5847 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 -- 172.21.15.144:0/3621502919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5555994014a0 con 0x555599675d70 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd8f0c00640 1 -- 172.21.15.144:0/3621502919 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9000b3040 con 0x555599675d70 2024-09-12T12:15:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd8f0c00640 1 -- 172.21.15.144:0/3621502919 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd9000045e0 con 0x555599675d70 2024-09-12T12:15:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 10 client.5847 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 10 client.5847 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 20 client.5847 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5555996844e0 0x5555996868d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 4 client.5847 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd9118fc000 1 -- 172.21.15.144:0/3621502919 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555994141d0 con 0x5555996844e0 2024-09-12T12:15:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907400640 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5555996844e0 0x5555996868d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd8f0c00640 10 client.5847 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.727+0000 7fd907400640 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5555996844e0 0x5555996868d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e7dd3a233abb567 server_cookie=a02353fe5e33f2df in_seq=0 out_seq=0 2024-09-12T12:15:55.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd8f0c00640 1 -- 172.21.15.144:0/3621502919 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555994141d0 con 0x5555996844e0 2024-09-12T12:15:55.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd8f0c00640 10 client.5847 handle_command_reply: tid=0 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 client.5847 shutdown 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 -- 172.21.15.144:0/3621502919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675d70 msgr2=0x55559962b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675d70 0x55559962b9a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd90001afe0 tx=0x7fd90001b170 comp rx=0 tx=0).stop 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 -- 172.21.15.144:0/3621502919 shutdown_connections 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5555996844e0 0x5555996868d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675d70 0x55559962b9a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675450 0x55559962b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 --2- 172.21.15.144:0/3621502919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x55559962af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd8f0c00640 0 client.5847 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 -- 172.21.15.144:0/3621502919 >> 172.21.15.144:0/3621502919 conn(0x55559913cfc0 msgr2=0x555599628aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 -- 172.21.15.144:0/3621502919 shutdown_connections 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 1 -- 172.21.15.144:0/3621502919 wait complete. 2024-09-12T12:15:55.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.731+0000 7fd9118fc000 20 client.5847 trim_cache size 0 max 16384 2024-09-12T12:15:55.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd9118fc000 1 Processor -- start 2024-09-12T12:15:55.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd9118fc000 1 -- start start 2024-09-12T12:15:55.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555996298e0 0x5555996ece00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x5555996ed340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 0x5555996ed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd9118fc000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd908203f40 con 0x555599675450 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd9118fc000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd908202f90 con 0x555599675d70 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd9118fc000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd90815cd40 con 0x5555996298e0 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd906a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x5555996ed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd906a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x5555996ed340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41512/0 (socket says 172.21.15.144:41512) 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.747+0000 7fd906a00640 1 -- 172.21.15.144:0/1400183109 learned_addr learned my addr 172.21.15.144:0/1400183109 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd907400640 1 --2- 172.21.15.144:0/1400183109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555996298e0 0x5555996ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd907e00640 1 --2- 172.21.15.144:0/1400183109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 0x5555996ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd906a00640 1 -- 172.21.15.144:0/1400183109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555996298e0 msgr2=0x5555996ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd906a00640 1 --2- 172.21.15.144:0/1400183109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555996298e0 0x5555996ece00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd906a00640 1 -- 172.21.15.144:0/1400183109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 msgr2=0x5555996ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd906a00640 1 --2- 172.21.15.144:0/1400183109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 0x5555996ed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd906a00640 1 -- 172.21.15.144:0/1400183109 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559941e590 con 0x555599675450 2024-09-12T12:15:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd906a00640 1 --2- 172.21.15.144:0/1400183109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x5555996ed340 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400fa70 tx=0x7fd8f4018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8df23d91fdc7aca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd8f3400640 1 -- 172.21.15.144:0/1400183109 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f401b070 con 0x555599675450 2024-09-12T12:15:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd8f3400640 1 -- 172.21.15.144:0/1400183109 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f401c040 con 0x555599675450 2024-09-12T12:15:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd8f3400640 1 -- 172.21.15.144:0/1400183109 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4014de0 con 0x555599675450 2024-09-12T12:15:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 -- 172.21.15.144:0/1400183109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 msgr2=0x5555996ed340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 --2- 172.21.15.144:0/1400183109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x5555996ed340 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400fa70 tx=0x7fd8f4018040 comp rx=0 tx=0).stop 2024-09-12T12:15:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 -- 172.21.15.144:0/1400183109 shutdown_connections 2024-09-12T12:15:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 --2- 172.21.15.144:0/1400183109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555599675d70 0x5555996ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 --2- 172.21.15.144:0/1400183109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x5555996ed340 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 --2- 172.21.15.144:0/1400183109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555996298e0 0x5555996ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 -- 172.21.15.144:0/1400183109 >> 172.21.15.144:0/1400183109 conn(0x55559913cfc0 msgr2=0x555599630f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 -- 172.21.15.144:0/1400183109 shutdown_connections 2024-09-12T12:15:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 -- 172.21.15.144:0/1400183109 wait complete. 2024-09-12T12:15:55.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 -- start start 2024-09-12T12:15:55.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 Processor -- start 2024-09-12T12:15:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x5555996d7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x555599689c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675d70 0x55559968a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5555994792e0 con 0x555599675450 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd908202ab0 con 0x5555996298e0 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55559947e600 con 0x555599675d70 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd9118fc000 10 client.0 _ll_register_callbacks cb 0x7fd9000094e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd906a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x555599689c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd907400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x5555996d7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd907e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675d70 0x55559968a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd907400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x5555996d7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:59832/0 (socket says 172.21.15.144:59832) 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd907400640 1 -- 172.21.15.144:0/4072337213 learned_addr learned my addr 172.21.15.144:0/4072337213 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.751+0000 7fd906a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x555599689c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41528/0 (socket says 172.21.15.144:41528) 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd906a00640 1 -- 172.21.15.144:0/4072337213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675d70 msgr2=0x55559968a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd906a00640 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675d70 0x55559968a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd906a00640 1 -- 172.21.15.144:0/4072337213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 msgr2=0x5555996d7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd906a00640 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x5555996d7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd906a00640 1 -- 172.21.15.144:0/4072337213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555994fe720 con 0x555599675450 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd907400640 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x5555996d7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd906a00640 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x555599689c30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4026000 tx=0x7fd8f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24980fe6e41834f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 1 -- 172.21.15.144:0/4072337213 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f401b040 con 0x555599675450 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 1 -- 172.21.15.144:0/4072337213 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd8f4032c50 con 0x555599675450 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 -- 172.21.15.144:0/4072337213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8f401c040 con 0x555599675450 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 1 -- 172.21.15.144:0/4072337213 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd8f4032e50 con 0x555599675450 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 10 client.5853 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 -- 172.21.15.144:0/4072337213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x555599411e90 con 0x555599675450 2024-09-12T12:15:55.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 1 -- 172.21.15.144:0/4072337213 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f401c040 con 0x555599675450 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 1 -- 172.21.15.144:0/4072337213 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fd8f40059a0 con 0x555599675450 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 10 client.5853 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 10 client.5853 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 20 client.5853 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5555996edf50 0x5555996ee360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 4 client.5853 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 -- 172.21.15.144:0/4072337213 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x555599487700 con 0x5555996edf50 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd907400640 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5555996edf50 0x5555996ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd907400640 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5555996edf50 0x5555996ee360 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9054da75245322d server_cookie=c0d1d76f1de9695c in_seq=0 out_seq=0 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 10 client.5853 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 1 -- 172.21.15.144:0/4072337213 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555599487700 con 0x5555996edf50 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 10 client.5853 handle_command_reply: tid=0 2024-09-12T12:15:55.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 client.5853 shutdown 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 -- 172.21.15.144:0/4072337213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 msgr2=0x555599689c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x555599689c30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4026000 tx=0x7fd8f4004740 comp rx=0 tx=0).stop 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 -- 172.21.15.144:0/4072337213 shutdown_connections 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5555996edf50 0x5555996ee360 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555599675d70 0x55559968a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555599675450 0x555599689c30 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 --2- 172.21.15.144:0/4072337213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555996298e0 0x5555996d7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 -- 172.21.15.144:0/4072337213 >> 172.21.15.144:0/4072337213 conn(0x55559913cfc0 msgr2=0x555599631630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd8f0c00640 0 client.5853 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 -- 172.21.15.144:0/4072337213 shutdown_connections 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 1 -- 172.21.15.144:0/4072337213 wait complete. 2024-09-12T12:15:55.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.755+0000 7fd9118fc000 20 client.5853 trim_cache size 0 max 16384 2024-09-12T12:15:55.764 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:15:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "d7c1ef35-77b0-4a57-b0ff-e947c76d1730", 2024-09-12T12:15:55.764 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:15:55.764 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 -- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8e80678c0 msgr2=0x7fd8e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8e80678c0 0x7fd8e8069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd9080732d0 tx=0x7fd8f4008040 comp rx=0 tx=0).stop 2024-09-12T12:15:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 -- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9080cd9f0 msgr2=0x7fd908144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9080cd9f0 0x7fd908144db0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80011f0 tx=0x7fd8f800c9b0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 -- 172.21.15.144:0/1602994977 shutdown_connections 2024-09-12T12:15:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8e80678c0 0x7fd8e8069d80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd90815b340 0x7fd90814c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd90815af60 0x7fd90814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 --2- 172.21.15.144:0/1602994977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9080cd9f0 0x7fd908144db0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 -- 172.21.15.144:0/1602994977 >> 172.21.15.144:0/1602994977 conn(0x7fd908068030 msgr2=0x7fd908073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 -- 172.21.15.144:0/1602994977 shutdown_connections 2024-09-12T12:15:55.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.759+0000 7fd90e600640 1 -- 172.21.15.144:0/1602994977 wait complete. 2024-09-12T12:15:55.779 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': 'd7c1ef35-77b0-4a57-b0ff-e947c76d1730', 'mode': 'asynchronous'}' 2024-09-12T12:15:55.779 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-12T12:15:55.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-12T12:15:55.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5de0200640 1 Processor -- start 2024-09-12T12:15:55.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5de0200640 1 -- start start 2024-09-12T12:15:55.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5de0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd8160bf0 0x7f5dd80d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5de0200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5dd815c790 0x7f5dd80d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5de0200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd815cd10 con 0x7f5dd815c3b0 2024-09-12T12:15:55.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5de0200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5dd815d640 con 0x7f5dd815c790 2024-09-12T12:15:55.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5de0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd815cff0 con 0x7f5dd8160bf0 2024-09-12T12:15:55.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5ddd800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5dd815c3b0 0x7f5dd8073b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53874/0 (socket says 172.21.15.144:53874) 2024-09-12T12:15:55.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5ddd800640 1 -- 172.21.15.144:0/2011404073 learned_addr learned my addr 172.21.15.144:0/2011404073 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:55.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5ddce00640 1 --2- 172.21.15.144:0/2011404073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd8160bf0 0x7f5dd80d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5dde200640 1 --2- 172.21.15.144:0/2011404073 >> v2:172.21.15.165:3300/0 conn(0x7f5dd815c790 0x7f5dd80d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5dd7e00640 1 -- 172.21.15.144:0/2011404073 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633409874 0 0) 0x7f5dd815cd10 con 0x7f5dd815c3b0 2024-09-12T12:15:55.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5dd7e00640 1 -- 172.21.15.144:0/2011404073 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc0003530 con 0x7f5dd815c3b0 2024-09-12T12:15:55.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5dd7e00640 1 -- 172.21.15.144:0/2011404073 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1948134509 0 0) 0x7f5dc0003530 con 0x7f5dd815c3b0 2024-09-12T12:15:55.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5ddce00640 1 -- 172.21.15.144:0/2011404073 >> v2:172.21.15.165:3300/0 conn(0x7f5dd815c790 msgr2=0x7f5dd80d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5ddce00640 1 --2- 172.21.15.144:0/2011404073 >> v2:172.21.15.165:3300/0 conn(0x7f5dd815c790 0x7f5dd80d2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5ddce00640 1 -- 172.21.15.144:0/2011404073 >> v1:172.21.15.144:6789/0 conn(0x7f5dd815c3b0 legacy=0x7f5dd8073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5ddce00640 1 -- 172.21.15.144:0/2011404073 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd815d2d0 con 0x7f5dd8160bf0 2024-09-12T12:15:55.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.915+0000 7f5dde200640 1 --2- 172.21.15.144:0/2011404073 >> v2:172.21.15.165:3300/0 conn(0x7f5dd815c790 0x7f5dd80d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:55.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5ddce00640 1 --2- 172.21.15.144:0/2011404073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd8160bf0 0x7f5dd80d2420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40097c0 tx=0x7f5dc401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9590c59f50fc2391 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5dd7e00640 1 -- 172.21.15.144:0/2011404073 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40b0070 con 0x7f5dd8160bf0 2024-09-12T12:15:55.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5dd7e00640 1 -- 172.21.15.144:0/2011404073 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc40ab400 con 0x7f5dd8160bf0 2024-09-12T12:15:55.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5dd7e00640 1 -- 172.21.15.144:0/2011404073 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc001a00 con 0x7f5dd8160bf0 2024-09-12T12:15:55.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5de0200640 1 -- 172.21.15.144:0/2011404073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd8160bf0 msgr2=0x7f5dd80d2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5de0200640 1 --2- 172.21.15.144:0/2011404073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd8160bf0 0x7f5dd80d2420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40097c0 tx=0x7f5dc401c3c0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5de0200640 1 -- 172.21.15.144:0/2011404073 shutdown_connections 2024-09-12T12:15:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5de0200640 1 --2- 172.21.15.144:0/2011404073 >> v2:172.21.15.165:3300/0 conn(0x7f5dd815c790 0x7f5dd80d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5de0200640 1 --2- 172.21.15.144:0/2011404073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd8160bf0 0x7f5dd80d2420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5de0200640 1 -- 172.21.15.144:0/2011404073 >> 172.21.15.144:0/2011404073 conn(0x7f5dd806c010 msgr2=0x7f5dd8067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5de0200640 1 -- 172.21.15.144:0/2011404073 shutdown_connections 2024-09-12T12:15:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.919+0000 7f5de0200640 1 -- 172.21.15.144:0/2011404073 wait complete. 2024-09-12T12:15:55.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 Processor -- start 2024-09-12T12:15:55.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 -- start start 2024-09-12T12:15:55.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd815c3b0 0x7f5dd8165730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dd815c790 0x7f5dd806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd8160bf0 0x7f5dd806d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd80d0e50 con 0x7f5dd815c790 2024-09-12T12:15:55.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd80d0cd0 con 0x7f5dd8160bf0 2024-09-12T12:15:55.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd80d0fd0 con 0x7f5dd815c3b0 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dd815c790 0x7f5dd806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dd815c790 0x7f5dd806d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41532/0 (socket says 172.21.15.144:41532) 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddce00640 1 -- 172.21.15.144:0/712768275 learned_addr learned my addr 172.21.15.144:0/712768275 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddd800640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd815c3b0 0x7f5dd8165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5dde200640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd8160bf0 0x7f5dd806d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddce00640 1 -- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd815c3b0 msgr2=0x7f5dd8165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddce00640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd815c3b0 0x7f5dd8165730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddce00640 1 -- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd8160bf0 msgr2=0x7f5dd806d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddce00640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd8160bf0 0x7f5dd806d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddce00640 1 -- 172.21.15.144:0/712768275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd80b5e80 con 0x7f5dd815c790 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddd800640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd815c3b0 0x7f5dd8165730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5dde200640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd8160bf0 0x7f5dd806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5ddce00640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dd815c790 0x7f5dd806d300 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4000c10 tx=0x7f5dc4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5dd5600640 1 -- 172.21.15.144:0/712768275 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40b0040 con 0x7f5dd815c790 2024-09-12T12:15:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5dd5600640 1 -- 172.21.15.144:0/712768275 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc40b7670 con 0x7f5dd815c790 2024-09-12T12:15:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 -- 172.21.15.144:0/712768275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd806e150 con 0x7f5dd815c790 2024-09-12T12:15:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5dd5600640 1 -- 172.21.15.144:0/712768275 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4006e20 con 0x7f5dd815c790 2024-09-12T12:15:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.923+0000 7f5de0200640 1 -- 172.21.15.144:0/712768275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd806e710 con 0x7f5dd815c790 2024-09-12T12:15:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5dd5600640 1 -- 172.21.15.144:0/712768275 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5dc40c0020 con 0x7f5dd815c790 2024-09-12T12:15:55.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5dd5600640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5db80678c0 0x7f5db8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5dd5600640 1 -- 172.21.15.144:0/712768275 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f5dc411fff0 con 0x7f5dd815c790 2024-09-12T12:15:55.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5ddd800640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5db80678c0 0x7f5db8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5de3637000 1 Processor -- start 2024-09-12T12:15:55.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5de3637000 1 -- start start 2024-09-12T12:15:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5ddd800640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5db80678c0 0x7f5db8069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00d210 tx=0x7f5dcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5de3637000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 0x5629876b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5de3637000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b5670 0x56298766afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5de3637000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x56298766b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5de3637000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562987552540 con 0x5629876b5670 2024-09-12T12:15:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5de3637000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5629874b8d70 con 0x56298766b500 2024-09-12T12:15:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.927+0000 7f5de3637000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x562987473b20 con 0x5629876b4d50 2024-09-12T12:15:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b5670 0x56298766afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b5670 0x56298766afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41544/0 (socket says 172.21.15.144:41544) 2024-09-12T12:15:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 -- 172.21.15.144:0/158107444 learned_addr learned my addr 172.21.15.144:0/158107444 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddd800640 1 --2- 172.21.15.144:0/158107444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 0x5629876b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5dde200640 1 --2- 172.21.15.144:0/158107444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x56298766b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 -- 172.21.15.144:0/158107444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 msgr2=0x5629876b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 --2- 172.21.15.144:0/158107444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 0x5629876b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 -- 172.21.15.144:0/158107444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 msgr2=0x56298766b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 --2- 172.21.15.144:0/158107444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x56298766b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 -- 172.21.15.144:0/158107444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629874ff3b0 con 0x5629876b5670 2024-09-12T12:15:55.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 --2- 172.21.15.144:0/158107444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b5670 0x56298766afc0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40f89f0 tx=0x7f5dc40efca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7f137c6fb82a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5dca000640 1 -- 172.21.15.144:0/158107444 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40f0340 con 0x5629876b5670 2024-09-12T12:15:55.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5dca000640 1 -- 172.21.15.144:0/158107444 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc40f46f0 con 0x5629876b5670 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5dca000640 1 -- 172.21.15.144:0/158107444 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40f8f20 con 0x5629876b5670 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 -- 172.21.15.144:0/158107444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b5670 msgr2=0x56298766afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 --2- 172.21.15.144:0/158107444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b5670 0x56298766afc0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40f89f0 tx=0x7f5dc40efca0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 -- 172.21.15.144:0/158107444 shutdown_connections 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 --2- 172.21.15.144:0/158107444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x56298766b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 --2- 172.21.15.144:0/158107444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b5670 0x56298766afc0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 --2- 172.21.15.144:0/158107444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 0x5629876b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 -- 172.21.15.144:0/158107444 >> 172.21.15.144:0/158107444 conn(0x5629876674b0 msgr2=0x5629876698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 -- 172.21.15.144:0/158107444 shutdown_connections 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 -- 172.21.15.144:0/158107444 wait complete. 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 -- start start 2024-09-12T12:15:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 Processor -- start 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x562987675b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x562987676040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b5670 0x562987676580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5629874601d0 con 0x5629876b4d50 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562987472680 con 0x56298766b500 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56298745ed60 con 0x5629876b5670 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5de3637000 10 client.0 _ll_register_callbacks cb 0x56298751af40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x562987676040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x562987676040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41556/0 (socket says 172.21.15.144:41556) 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.931+0000 7f5ddce00640 1 -- 172.21.15.144:0/831133223 learned_addr learned my addr 172.21.15.144:0/831133223 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dde200640 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b5670 0x562987676580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5ddd800640 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x562987675b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5ddce00640 1 -- 172.21.15.144:0/831133223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b5670 msgr2=0x562987676580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5ddce00640 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b5670 0x562987676580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5ddce00640 1 -- 172.21.15.144:0/831133223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 msgr2=0x562987675b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5ddce00640 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x562987675b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5ddce00640 1 -- 172.21.15.144:0/831133223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298748bb90 con 0x5629876b4d50 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5ddce00640 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x562987676040 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40097c0 tx=0x7f5dc4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc927eeeb962e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 1 -- 172.21.15.144:0/831133223 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40f8f20 con 0x5629876b4d50 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 1 -- 172.21.15.144:0/831133223 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f5dc40f8a90 con 0x5629876b4d50 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 -- 172.21.15.144:0/831133223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc40f46f0 con 0x5629876b4d50 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 1 -- 172.21.15.144:0/831133223 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5dc40fa050 con 0x5629876b4d50 2024-09-12T12:15:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 10 client.5865 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 -- 172.21.15.144:0/831133223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5629874728a0 con 0x5629876b4d50 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 1 -- 172.21.15.144:0/831133223 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc40f46f0 con 0x5629876b4d50 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 1 -- 172.21.15.144:0/831133223 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f5dc40ef790 con 0x5629876b4d50 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 10 client.5865 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 10 client.5865 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 20 client.5865 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x562987676f90 0x5629876c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 4 client.5865 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 -- 172.21.15.144:0/831133223 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562987452e40 con 0x562987676f90 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5ddd800640 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x562987676f90 0x5629876c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5ddd800640 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x562987676f90 0x5629876c5df0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e41a3da1dd23314b server_cookie=43fa34ecaf6a633 in_seq=0 out_seq=0 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 10 client.5865 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 1 -- 172.21.15.144:0/831133223 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562987452e40 con 0x562987676f90 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 10 client.5865 handle_command_reply: tid=0 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 client.5865 shutdown 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 -- 172.21.15.144:0/831133223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 msgr2=0x562987676040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x562987676040 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40097c0 tx=0x7f5dc4009190 comp rx=0 tx=0).stop 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 -- 172.21.15.144:0/831133223 shutdown_connections 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x562987676f90 0x5629876c5df0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b5670 0x562987676580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x562987676040 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 --2- 172.21.15.144:0/831133223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x562987675b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5dbea00640 0 client.5865 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 -- 172.21.15.144:0/831133223 >> 172.21.15.144:0/831133223 conn(0x5629876674b0 msgr2=0x56298766a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 -- 172.21.15.144:0/831133223 shutdown_connections 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 1 -- 172.21.15.144:0/831133223 wait complete. 2024-09-12T12:15:55.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.935+0000 7f5de3637000 20 client.5865 trim_cache size 0 max 16384 2024-09-12T12:15:55.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 Processor -- start 2024-09-12T12:15:55.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 -- start start 2024-09-12T12:15:55.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876674b0 0x5629876c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x5629876c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x5629876c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd82027f0 con 0x5629876b4d50 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd80b2e60 con 0x56298766b500 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd80b34b0 con 0x5629876674b0 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dde200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x5629876c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dde200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x5629876c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41558/0 (socket says 172.21.15.144:41558) 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dde200640 1 -- 172.21.15.144:0/2568085889 learned_addr learned my addr 172.21.15.144:0/2568085889 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5ddd800640 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876674b0 0x5629876c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dde200640 1 -- 172.21.15.144:0/2568085889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876674b0 msgr2=0x5629876c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dde200640 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876674b0 0x5629876c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5ddce00640 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x5629876c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dde200640 1 -- 172.21.15.144:0/2568085889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 msgr2=0x5629876c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dde200640 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x5629876c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dde200640 1 -- 172.21.15.144:0/2568085889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562987458820 con 0x5629876b4d50 2024-09-12T12:15:55.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5ddce00640 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x5629876c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dde200640 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x5629876c5df0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009c40 tx=0x7f5dd0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e293d1fd25817a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dc9600640 1 -- 172.21.15.144:0/2568085889 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd001b070 con 0x5629876b4d50 2024-09-12T12:15:55.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dc9600640 1 -- 172.21.15.144:0/2568085889 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd0015e70 con 0x5629876b4d50 2024-09-12T12:15:55.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5dc9600640 1 -- 172.21.15.144:0/2568085889 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000f040 con 0x5629876b4d50 2024-09-12T12:15:55.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 -- 172.21.15.144:0/2568085889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 msgr2=0x5629876c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x5629876c5df0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009c40 tx=0x7f5dd0009190 comp rx=0 tx=0).stop 2024-09-12T12:15:55.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 -- 172.21.15.144:0/2568085889 shutdown_connections 2024-09-12T12:15:55.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876b4d50 0x5629876c5df0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x5629876c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 --2- 172.21.15.144:0/2568085889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876674b0 0x5629876c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 -- 172.21.15.144:0/2568085889 >> 172.21.15.144:0/2568085889 conn(0x562987676450 msgr2=0x5629876b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 -- 172.21.15.144:0/2568085889 shutdown_connections 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.955+0000 7f5de3637000 1 -- 172.21.15.144:0/2568085889 wait complete. 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 -- start start 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 Processor -- start 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876674b0 0x562987728a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x562987728fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 0x562987729510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5629874bd3a0 con 0x5629876674b0 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5629874b8080 con 0x56298766b500 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56298746ff10 con 0x5629876b4d50 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 10 client.0 _ll_register_callbacks cb 0x7f5dc40efe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876674b0 0x562987728a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876674b0 0x562987728a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41574/0 (socket says 172.21.15.144:41574) 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddd800640 1 -- 172.21.15.144:0/2252133542 learned_addr learned my addr 172.21.15.144:0/2252133542 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddce00640 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x562987728fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5dde200640 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 0x562987729510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddd800640 1 -- 172.21.15.144:0/2252133542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 msgr2=0x562987729510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddd800640 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 0x562987729510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddd800640 1 -- 172.21.15.144:0/2252133542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 msgr2=0x562987728fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddd800640 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x562987728fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddd800640 1 -- 172.21.15.144:0/2252133542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298753b530 con 0x5629876674b0 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddce00640 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x562987728fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddd800640 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876674b0 0x562987728a90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc007290 tx=0x7f5dcc001460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d970d4d9978c42e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5dbea00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5dbea00640 1 -- 172.21.15.144:0/2252133542 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc030060 con 0x5629876674b0 2024-09-12T12:15:55.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5dbea00640 1 -- 172.21.15.144:0/2252133542 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f5dcc026950 con 0x5629876674b0 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 -- 172.21.15.144:0/2252133542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dd0015e70 con 0x5629876674b0 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5dbea00640 1 -- 172.21.15.144:0/2252133542 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5dcc036050 con 0x5629876674b0 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 10 client.5871 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 -- 172.21.15.144:0/2252133542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x562987450420 con 0x5629876674b0 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5dbea00640 1 -- 172.21.15.144:0/2252133542 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd0015e70 con 0x5629876674b0 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5dbea00640 1 -- 172.21.15.144:0/2252133542 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f5dcc039020 con 0x5629876674b0 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 10 client.5871 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 10 client.5871 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 20 client.5871 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5629876b5670 0x5629876e4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 4 client.5871 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5de3637000 1 -- 172.21.15.144:0/2252133542 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x5629874c64a0 con 0x5629876b5670 2024-09-12T12:15:55.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.959+0000 7f5ddce00640 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5629876b5670 0x5629876e4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5ddce00640 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5629876b5670 0x5629876e4840 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e6643ddde4afb7a server_cookie=bc595524a8675a16 in_seq=0 out_seq=0 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5dbea00640 10 client.5871 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5dbea00640 1 -- 172.21.15.144:0/2252133542 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5629874c64a0 con 0x5629876b5670 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5dbea00640 10 client.5871 handle_command_reply: tid=0 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 client.5871 shutdown 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 -- 172.21.15.144:0/2252133542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876674b0 msgr2=0x562987728a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876674b0 0x562987728a90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc007290 tx=0x7f5dcc001460 comp rx=0 tx=0).stop 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 -- 172.21.15.144:0/2252133542 shutdown_connections 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x5629876b5670 0x5629876e4840 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5629876b4d50 0x562987729510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56298766b500 0x562987728fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 --2- 172.21.15.144:0/2252133542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629876674b0 0x562987728a90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5dbea00640 0 client.5871 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:55.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 -- 172.21.15.144:0/2252133542 >> 172.21.15.144:0/2252133542 conn(0x562987676450 msgr2=0x5629876698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 -- 172.21.15.144:0/2252133542 shutdown_connections 2024-09-12T12:15:55.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 1 -- 172.21.15.144:0/2252133542 wait complete. 2024-09-12T12:15:55.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de3637000 20 client.5871 trim_cache size 0 max 16384 2024-09-12T12:15:55.969 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:55.969 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:15:55.969 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "8215f758-915f-48a6-af62-d9ca6da9598e", 2024-09-12T12:15:55.969 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:15:55.969 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:55.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 -- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5db80678c0 msgr2=0x7f5db8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5db80678c0 0x7f5db8069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00d210 tx=0x7f5dcc009040 comp rx=0 tx=0).stop 2024-09-12T12:15:55.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 -- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dd815c790 msgr2=0x7f5dd806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dd815c790 0x7f5dd806d300 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4000c10 tx=0x7f5dc4019160 comp rx=0 tx=0).stop 2024-09-12T12:15:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 -- 172.21.15.144:0/712768275 shutdown_connections 2024-09-12T12:15:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5db80678c0 0x7f5db8069d80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd8160bf0 0x7f5dd806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dd815c790 0x7f5dd806d300 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 --2- 172.21.15.144:0/712768275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dd815c3b0 0x7f5dd8165730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 -- 172.21.15.144:0/712768275 >> 172.21.15.144:0/712768275 conn(0x7f5dd806c010 msgr2=0x7f5dd815f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 -- 172.21.15.144:0/712768275 shutdown_connections 2024-09-12T12:15:55.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:55.963+0000 7f5de0200640 1 -- 172.21.15.144:0/712768275 wait complete. 2024-09-12T12:15:55.984 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '8215f758-915f-48a6-af62-d9ca6da9598e', 'mode': 'asynchronous'}' 2024-09-12T12:15:55.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:55.984 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-09-12T12:15:55.995 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-09-12T12:15:55.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-09-12T12:15:56.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.171+0000 7f1f50200640 1 Processor -- start 2024-09-12T12:15:56.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.171+0000 7f1f50200640 1 -- start start 2024-09-12T12:15:56.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f50200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f480af5f0 0x7f1f4806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f50200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f4806c150 0x7f1f480cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f50200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f480733e0 con 0x7f1f4815c2e0 2024-09-12T12:15:56.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f50200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1f4806c5c0 con 0x7f1f4806c150 2024-09-12T12:15:56.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f50200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1f480cd290 con 0x7f1f480af5f0 2024-09-12T12:15:56.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f4e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f4806c150 0x7f1f480cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f4e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f4806c150 0x7f1f480cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41580/0 (socket says 172.21.15.144:41580) 2024-09-12T12:15:56.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f4e200640 1 -- 172.21.15.144:0/497522074 learned_addr learned my addr 172.21.15.144:0/497522074 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/497522074 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f480af5f0 0x7f1f4806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f4e200640 1 -- 172.21.15.144:0/497522074 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f480af5f0 msgr2=0x7f1f4806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f4e200640 1 --2- 172.21.15.144:0/497522074 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f480af5f0 0x7f1f4806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f4e200640 1 -- 172.21.15.144:0/497522074 >> v1:172.21.15.165:6789/0 conn(0x7f1f4815c2e0 legacy=0x7f1f48072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.175+0000 7f1f4e200640 1 -- 172.21.15.144:0/497522074 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f480cd570 con 0x7f1f4806c150 2024-09-12T12:15:56.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f4e200640 1 --2- 172.21.15.144:0/497522074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f4806c150 0x7f1f480cdd70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009e50 tx=0x7f1f4001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35c02784ddfda09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f47e00640 1 -- 172.21.15.144:0/497522074 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400a55e0 con 0x7f1f4806c150 2024-09-12T12:15:56.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f47e00640 1 -- 172.21.15.144:0/497522074 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f400a5780 con 0x7f1f4806c150 2024-09-12T12:15:56.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f47e00640 1 -- 172.21.15.144:0/497522074 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400a5b50 con 0x7f1f4806c150 2024-09-12T12:15:56.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 -- 172.21.15.144:0/497522074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f4806c150 msgr2=0x7f1f480cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 --2- 172.21.15.144:0/497522074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f4806c150 0x7f1f480cdd70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009e50 tx=0x7f1f4001c910 comp rx=0 tx=0).stop 2024-09-12T12:15:56.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 -- 172.21.15.144:0/497522074 shutdown_connections 2024-09-12T12:15:56.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 --2- 172.21.15.144:0/497522074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f4806c150 0x7f1f480cdd70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 --2- 172.21.15.144:0/497522074 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f480af5f0 0x7f1f4806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 -- 172.21.15.144:0/497522074 >> 172.21.15.144:0/497522074 conn(0x7f1f48068030 msgr2=0x7f1f480b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 -- 172.21.15.144:0/497522074 shutdown_connections 2024-09-12T12:15:56.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 -- 172.21.15.144:0/497522074 wait complete. 2024-09-12T12:15:56.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 Processor -- start 2024-09-12T12:15:56.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.179+0000 7f1f50200640 1 -- start start 2024-09-12T12:15:56.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f50200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f4806c150 0x7f1f4814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f50200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f480af5f0 0x7f1f48153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f50200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f4815c2e0 0x7f1f480ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f50200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f480cee90 con 0x7f1f480af5f0 2024-09-12T12:15:56.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f50200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f480ced10 con 0x7f1f4806c150 2024-09-12T12:15:56.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f50200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1f480cf010 con 0x7f1f4815c2e0 2024-09-12T12:15:56.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f480af5f0 0x7f1f48153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f480af5f0 0x7f1f48153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41590/0 (socket says 172.21.15.144:41590) 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4ce00640 1 -- 172.21.15.144:0/528033066 learned_addr learned my addr 172.21.15.144:0/528033066 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4e200640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f4815c2e0 0x7f1f480ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4d800640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f4806c150 0x7f1f4814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4ce00640 1 -- 172.21.15.144:0/528033066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f4815c2e0 msgr2=0x7f1f480ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f4815c2e0 0x7f1f480ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4ce00640 1 -- 172.21.15.144:0/528033066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f4806c150 msgr2=0x7f1f4814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f4806c150 0x7f1f4814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4ce00640 1 -- 172.21.15.144:0/528033066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f48072cc0 con 0x7f1f480af5f0 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4d800640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f4806c150 0x7f1f4814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f480af5f0 0x7f1f48153260 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400d800 tx=0x7f1f3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f45600640 1 -- 172.21.15.144:0/528033066 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400b6c0 con 0x7f1f480af5f0 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f45600640 1 -- 172.21.15.144:0/528033066 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f34019070 con 0x7f1f480af5f0 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f50200640 1 -- 172.21.15.144:0/528033066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f48152a60 con 0x7f1f480af5f0 2024-09-12T12:15:56.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f45600640 1 -- 172.21.15.144:0/528033066 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400bae0 con 0x7f1f480af5f0 2024-09-12T12:15:56.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f50200640 1 -- 172.21.15.144:0/528033066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f480b5070 con 0x7f1f480af5f0 2024-09-12T12:15:56.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.183+0000 7f1f45600640 1 -- 172.21.15.144:0/528033066 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f3400bc80 con 0x7f1f480af5f0 2024-09-12T12:15:56.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f45600640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f280678f0 0x7f1f28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f45600640 1 -- 172.21.15.144:0/528033066 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f1f34086230 con 0x7f1f480af5f0 2024-09-12T12:15:56.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4d800640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f280678f0 0x7f1f28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 Processor -- start 2024-09-12T12:15:56.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4d800640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f280678f0 0x7f1f28069db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c001710 tx=0x7f1f3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 -- start start 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 0x564b13165120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b1311bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b1311c400 0x564b1311c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564b13003a20 con 0x564b13165660 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564b12f68ba0 con 0x564b13164d40 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x564b12f0ebb0 con 0x564b1311c400 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b1311bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b1311bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41592/0 (socket says 172.21.15.144:41592) 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4ce00640 1 -- 172.21.15.144:0/365187376 learned_addr learned my addr 172.21.15.144:0/365187376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4e200640 1 --2- 172.21.15.144:0/365187376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b1311c400 0x564b1311c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4d800640 1 --2- 172.21.15.144:0/365187376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 0x564b13165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4ce00640 1 -- 172.21.15.144:0/365187376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b1311c400 msgr2=0x564b1311c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/365187376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b1311c400 0x564b1311c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4ce00640 1 -- 172.21.15.144:0/365187376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 msgr2=0x564b13165120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/365187376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 0x564b13165120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4ce00640 1 -- 172.21.15.144:0/365187376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b12fafee0 con 0x564b13165660 2024-09-12T12:15:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/365187376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b1311bec0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1f34052930 tx=0x7f1f34055eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51784fe71daba7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f3a000640 1 -- 172.21.15.144:0/365187376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3406e020 con 0x564b13165660 2024-09-12T12:15:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f3a000640 1 -- 172.21.15.144:0/365187376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3405a880 con 0x564b13165660 2024-09-12T12:15:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f3a000640 1 -- 172.21.15.144:0/365187376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3405f0b0 con 0x564b13165660 2024-09-12T12:15:56.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 -- 172.21.15.144:0/365187376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 msgr2=0x564b1311bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.187+0000 7f1f5353a000 1 --2- 172.21.15.144:0/365187376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b1311bec0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1f34052930 tx=0x7f1f34055eb0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- 172.21.15.144:0/365187376 shutdown_connections 2024-09-12T12:15:56.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 --2- 172.21.15.144:0/365187376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b1311c400 0x564b1311c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 --2- 172.21.15.144:0/365187376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b1311bec0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 --2- 172.21.15.144:0/365187376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 0x564b13165120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- 172.21.15.144:0/365187376 >> 172.21.15.144:0/365187376 conn(0x564b131183b0 msgr2=0x564b1311a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- 172.21.15.144:0/365187376 shutdown_connections 2024-09-12T12:15:56.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- 172.21.15.144:0/365187376 wait complete. 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- start start 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 Processor -- start 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 0x564b13126540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13164d40 0x564b13126a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 0x564b13126fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564b12f02d20 con 0x564b13164d40 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564b12f64b60 con 0x564b1311c400 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x564b12f6d1d0 con 0x564b13165660 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 10 client.0 _ll_register_callbacks cb 0x564b12fcc120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13164d40 0x564b13126a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13164d40 0x564b13126a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41608/0 (socket says 172.21.15.144:41608) 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4ce00640 1 -- 172.21.15.144:0/699143871 learned_addr learned my addr 172.21.15.144:0/699143871 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4d800640 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 0x564b13126540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4e200640 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 0x564b13126fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4ce00640 1 -- 172.21.15.144:0/699143871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 msgr2=0x564b13126fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 0x564b13126fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4ce00640 1 -- 172.21.15.144:0/699143871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 msgr2=0x564b13126540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 0x564b13126540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4ce00640 1 -- 172.21.15.144:0/699143871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b12f43e20 con 0x564b13164d40 2024-09-12T12:15:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13164d40 0x564b13126a80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1f34052930 tx=0x7f1f34020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea17795dae406b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f2ea00640 1 -- 172.21.15.144:0/699143871 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f34081030 con 0x564b13164d40 2024-09-12T12:15:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f2ea00640 1 -- 172.21.15.144:0/699143871 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f1f34052b40 con 0x564b13164d40 2024-09-12T12:15:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- 172.21.15.144:0/699143871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f3405a880 con 0x564b13164d40 2024-09-12T12:15:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f2ea00640 1 -- 172.21.15.144:0/699143871 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f3406e040 con 0x564b13164d40 2024-09-12T12:15:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 10 client.5883 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- 172.21.15.144:0/699143871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x564b12f3b9c0 con 0x564b13164d40 2024-09-12T12:15:56.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f2ea00640 1 -- 172.21.15.144:0/699143871 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3405a880 con 0x564b13164d40 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f2ea00640 1 -- 172.21.15.144:0/699143871 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f1f34013070 con 0x564b13164d40 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 10 client.5883 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 10 client.5883 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 20 client.5883 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564b13173dd0 0x564b131761c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 4 client.5883 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f5353a000 1 -- 172.21.15.144:0/699143871 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b12f031e0 con 0x564b13173dd0 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.191+0000 7f1f4d800640 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564b13173dd0 0x564b131761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f2ea00640 10 client.5883 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f4d800640 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564b13173dd0 0x564b131761c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b7d30dac230f0a0 server_cookie=fb9101a86bc78863 in_seq=0 out_seq=0 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f2ea00640 1 -- 172.21.15.144:0/699143871 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b12f031e0 con 0x564b13173dd0 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f2ea00640 10 client.5883 handle_command_reply: tid=0 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 client.5883 shutdown 2024-09-12T12:15:56.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 -- 172.21.15.144:0/699143871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13164d40 msgr2=0x564b13126a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13164d40 0x564b13126a80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1f34052930 tx=0x7f1f34020070 comp rx=0 tx=0).stop 2024-09-12T12:15:56.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 -- 172.21.15.144:0/699143871 shutdown_connections 2024-09-12T12:15:56.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564b13173dd0 0x564b131761c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 0x564b13126fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13164d40 0x564b13126a80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 --2- 172.21.15.144:0/699143871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 0x564b13126540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f2ea00640 0 client.5883 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 -- 172.21.15.144:0/699143871 >> 172.21.15.144:0/699143871 conn(0x564b131183b0 msgr2=0x564b1311afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 -- 172.21.15.144:0/699143871 shutdown_connections 2024-09-12T12:15:56.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 1 -- 172.21.15.144:0/699143871 wait complete. 2024-09-12T12:15:56.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.195+0000 7f1f5353a000 20 client.5883 trim_cache size 0 max 16384 2024-09-12T12:15:56.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 Processor -- start 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 -- start start 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 0x564b13179a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13164d40 0x564b13121490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b131219d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f48204030 con 0x564b13165660 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f482030d0 con 0x564b1311c400 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1f480b44e0 con 0x564b13164d40 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b131219d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b131219d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41610/0 (socket says 172.21.15.144:41610) 2024-09-12T12:15:56.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4e200640 1 -- 172.21.15.144:0/1376154297 learned_addr learned my addr 172.21.15.144:0/1376154297 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13164d40 0x564b13121490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4d800640 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 0x564b13179a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4e200640 1 -- 172.21.15.144:0/1376154297 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13164d40 msgr2=0x564b13121490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4e200640 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13164d40 0x564b13121490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4e200640 1 -- 172.21.15.144:0/1376154297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 msgr2=0x564b13179a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4e200640 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 0x564b13179a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4e200640 1 -- 172.21.15.144:0/1376154297 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b13165490 con 0x564b13165660 2024-09-12T12:15:56.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13164d40 0x564b13121490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:56.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f4e200640 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b131219d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009c90 tx=0x7f1f40004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa5c09617792eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f39600640 1 -- 172.21.15.144:0/1376154297 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400a57e0 con 0x564b13165660 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f39600640 1 -- 172.21.15.144:0/1376154297 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f400c6070 con 0x564b13165660 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f39600640 1 -- 172.21.15.144:0/1376154297 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400a5ba0 con 0x564b13165660 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 -- 172.21.15.144:0/1376154297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 msgr2=0x564b131219d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b131219d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009c90 tx=0x7f1f40004ac0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 -- 172.21.15.144:0/1376154297 shutdown_connections 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b13165660 0x564b131219d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13164d40 0x564b13121490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 --2- 172.21.15.144:0/1376154297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b1311c400 0x564b13179a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 -- 172.21.15.144:0/1376154297 >> 172.21.15.144:0/1376154297 conn(0x564b131183b0 msgr2=0x564b1311b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 -- 172.21.15.144:0/1376154297 shutdown_connections 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.211+0000 7f1f5353a000 1 -- 172.21.15.144:0/1376154297 wait complete. 2024-09-12T12:15:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 -- start start 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 Processor -- start 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b1311c400 0x564b13179190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 0x564b1319ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 0x564b1319d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f48202ab0 con 0x564b1311c400 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564b12f67eb0 con 0x564b13164d40 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x564b12f68ba0 con 0x564b13165660 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 10 client.0 _ll_register_callbacks cb 0x7f1f3c001d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b1311c400 0x564b13179190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b1311c400 0x564b13179190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41620/0 (socket says 172.21.15.144:41620) 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4d800640 1 -- 172.21.15.144:0/995474226 learned_addr learned my addr 172.21.15.144:0/995474226 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4e200640 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 0x564b1319d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 0x564b1319ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4d800640 1 -- 172.21.15.144:0/995474226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 msgr2=0x564b1319d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4d800640 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 0x564b1319d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4d800640 1 -- 172.21.15.144:0/995474226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 msgr2=0x564b1319ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4d800640 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 0x564b1319ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4d800640 1 -- 172.21.15.144:0/995474226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b12f0ee00 con 0x564b1311c400 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4d800640 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b1311c400 0x564b13179190 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00ea10 tx=0x7f1f3c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d100fbf7eb5e818 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f2ea00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f2ea00640 1 -- 172.21.15.144:0/995474226 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c003810 con 0x564b1311c400 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f2ea00640 1 -- 172.21.15.144:0/995474226 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f1f3c010040 con 0x564b1311c400 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 -- 172.21.15.144:0/995474226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f400c6070 con 0x564b1311c400 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f2ea00640 1 -- 172.21.15.144:0/995474226 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f3c0039b0 con 0x564b1311c400 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 10 client.5889 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 -- 172.21.15.144:0/995474226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x564b12efcce0 con 0x564b1311c400 2024-09-12T12:15:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f2ea00640 1 -- 172.21.15.144:0/995474226 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f400c6070 con 0x564b1311c400 2024-09-12T12:15:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f2ea00640 1 -- 172.21.15.144:0/995474226 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f1f3c035050 con 0x564b1311c400 2024-09-12T12:15:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 10 client.5889 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 10 client.5889 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 20 client.5889 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564b1319d740 0x564b131e0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 4 client.5889 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-09-12T12:15:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f5353a000 1 -- 172.21.15.144:0/995474226 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x564b12f762d0 con 0x564b1319d740 2024-09-12T12:15:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564b1319d740 0x564b131e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f4ce00640 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564b1319d740 0x564b131e0720 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35afeaa709ee03a4 server_cookie=5c8312c4d07fa170 in_seq=0 out_seq=0 2024-09-12T12:15:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.215+0000 7f1f2ea00640 10 client.5889 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f2ea00640 1 -- 172.21.15.144:0/995474226 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564b12f762d0 con 0x564b1319d740 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f2ea00640 10 client.5889 handle_command_reply: tid=0 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 client.5889 shutdown 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 -- 172.21.15.144:0/995474226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b1311c400 msgr2=0x564b13179190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b1311c400 0x564b13179190 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00ea10 tx=0x7f1f3c000bd0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 -- 172.21.15.144:0/995474226 shutdown_connections 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x564b1319d740 0x564b131e0720 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x564b13165660 0x564b1319d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564b13164d40 0x564b1319ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 --2- 172.21.15.144:0/995474226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b1311c400 0x564b13179190 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f2ea00640 0 client.5889 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 -- 172.21.15.144:0/995474226 >> 172.21.15.144:0/995474226 conn(0x564b131183b0 msgr2=0x564b13120480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 -- 172.21.15.144:0/995474226 shutdown_connections 2024-09-12T12:15:56.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 1 -- 172.21.15.144:0/995474226 wait complete. 2024-09-12T12:15:56.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f5353a000 20 client.5889 trim_cache size 0 max 16384 2024-09-12T12:15:56.226 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:56.226 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:15:56.226 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 -- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f280678f0 msgr2=0x7f1f28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f280678f0 0x7f1f28069db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c001710 tx=0x7f1f3c009040 comp rx=0 tx=0).stop 2024-09-12T12:15:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 -- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f480af5f0 msgr2=0x7f1f48153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f480af5f0 0x7f1f48153260 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400d800 tx=0x7f1f3400dcc0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 -- 172.21.15.144:0/528033066 shutdown_connections 2024-09-12T12:15:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f280678f0 0x7f1f28069db0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f4815c2e0 0x7f1f480ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f480af5f0 0x7f1f48153260 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 --2- 172.21.15.144:0/528033066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f4806c150 0x7f1f4814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 -- 172.21.15.144:0/528033066 >> 172.21.15.144:0/528033066 conn(0x7f1f48068030 msgr2=0x7f1f480d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 -- 172.21.15.144:0/528033066 shutdown_connections 2024-09-12T12:15:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.223+0000 7f1f50200640 1 -- 172.21.15.144:0/528033066 wait complete. 2024-09-12T12:15:56.244 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-09-12T12:15:56.245 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:15:56.245 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:15:56.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:15:56.254 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-12T12:15:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:15:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:15:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180475 s, 58.1 MB/s 2024-09-12T12:15:56.323 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-12T12:15:56.323 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-12T12:15:56.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4ae6e00640 1 Processor -- start 2024-09-12T12:15:56.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4ae6e00640 1 -- start start 2024-09-12T12:15:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4ae6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae015af60 0x7f4ae00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4ae6e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4ae006c320 0x7f4ae00b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4ae6e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae00b4300 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4ae6e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae00b32f0 con 0x7f4ae006c320 2024-09-12T12:15:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4ae6e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae00b3540 con 0x7f4ae015af60 2024-09-12T12:15:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4adfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae015af60 0x7f4ae00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4adf400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f4ae00cd9f0 0x7f4ae006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:51226/0 (socket says 172.21.15.144:51226) 2024-09-12T12:15:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4adf400640 1 -- 172.21.15.144:0/1479885033 learned_addr learned my addr 172.21.15.144:0/1479885033 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.511+0000 7f4ae4e00640 1 --2- 172.21.15.144:0/1479885033 >> v2:172.21.15.165:3300/0 conn(0x7f4ae006c320 0x7f4ae00b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4adea00640 1 -- 172.21.15.144:0/1479885033 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216708683 0 0) 0x7f4ae00b4300 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4adea00640 1 -- 172.21.15.144:0/1479885033 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ac4003530 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4ae4e00640 1 -- 172.21.15.144:0/1479885033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae015af60 msgr2=0x7f4ae00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4ae4e00640 1 --2- 172.21.15.144:0/1479885033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae015af60 0x7f4ae00ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4ae4e00640 1 -- 172.21.15.144:0/1479885033 >> v1:172.21.15.165:6789/0 conn(0x7f4ae00cd9f0 legacy=0x7f4ae006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4ae4e00640 1 -- 172.21.15.144:0/1479885033 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae00b3820 con 0x7f4ae006c320 2024-09-12T12:15:56.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4ae4e00640 1 --2- 172.21.15.144:0/1479885033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ae006c320 0x7f4ae00b4560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009d90 tx=0x7f4ad801f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=962e39e090fd01fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4adea00640 1 -- 172.21.15.144:0/1479885033 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80b4070 con 0x7f4ae006c320 2024-09-12T12:15:56.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4adea00640 1 -- 172.21.15.144:0/1479885033 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad80af600 con 0x7f4ae006c320 2024-09-12T12:15:56.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4adea00640 1 -- 172.21.15.144:0/1479885033 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80af9b0 con 0x7f4ae006c320 2024-09-12T12:15:56.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4ae6e00640 1 -- 172.21.15.144:0/1479885033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ae006c320 msgr2=0x7f4ae00b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4ae6e00640 1 --2- 172.21.15.144:0/1479885033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ae006c320 0x7f4ae00b4560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009d90 tx=0x7f4ad801f150 comp rx=0 tx=0).stop 2024-09-12T12:15:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4ae6e00640 1 -- 172.21.15.144:0/1479885033 shutdown_connections 2024-09-12T12:15:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.515+0000 7f4ae6e00640 1 --2- 172.21.15.144:0/1479885033 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ae006c320 0x7f4ae00b4560 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 --2- 172.21.15.144:0/1479885033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae015af60 0x7f4ae00ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 -- 172.21.15.144:0/1479885033 >> 172.21.15.144:0/1479885033 conn(0x7f4ae0068030 msgr2=0x7f4ae00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 -- 172.21.15.144:0/1479885033 shutdown_connections 2024-09-12T12:15:56.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 -- 172.21.15.144:0/1479885033 wait complete. 2024-09-12T12:15:56.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 Processor -- start 2024-09-12T12:15:56.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 -- start start 2024-09-12T12:15:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae006c320 0x7f4ae00aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae00cd9f0 0x7f4ae015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ae015af60 0x7f4ae0140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae00cebc0 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae00b3de0 con 0x7f4ae015af60 2024-09-12T12:15:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae6e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae00ced40 con 0x7f4ae006c320 2024-09-12T12:15:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae00cd9f0 0x7f4ae015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae00cd9f0 0x7f4ae015b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41634/0 (socket says 172.21.15.144:41634) 2024-09-12T12:15:56.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adf400640 1 -- 172.21.15.144:0/3469300989 learned_addr learned my addr 172.21.15.144:0/3469300989 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adfe00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae006c320 0x7f4ae00aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4ae4e00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ae015af60 0x7f4ae0140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adf400640 1 -- 172.21.15.144:0/3469300989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae006c320 msgr2=0x7f4ae00aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adf400640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae006c320 0x7f4ae00aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adf400640 1 -- 172.21.15.144:0/3469300989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ae015af60 msgr2=0x7f4ae0140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adf400640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ae015af60 0x7f4ae0140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adf400640 1 -- 172.21.15.144:0/3469300989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae0140f60 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adfe00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae006c320 0x7f4ae00aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.519+0000 7f4adf400640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae00cd9f0 0x7f4ae015b550 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00c420 tx=0x7f4acc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4ad7e00640 1 -- 172.21.15.144:0/3469300989 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc017070 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4ad7e00640 1 -- 172.21.15.144:0/3469300989 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4acc005d10 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4ad7e00640 1 -- 172.21.15.144:0/3469300989 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc007310 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4ae6e00640 1 -- 172.21.15.144:0/3469300989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae0141240 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4ae6e00640 1 -- 172.21.15.144:0/3469300989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae0141800 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4ad7e00640 1 -- 172.21.15.144:0/3469300989 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4acc01a070 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4ad7e00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ac00678c0 0x7f4ac0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4ad7e00640 1 -- 172.21.15.144:0/3469300989 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f4acc0851b0 con 0x7f4ae00cd9f0 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4aea259000 1 Processor -- start 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4adfe00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ac00678c0 0x7f4ac0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.523+0000 7f4aea259000 1 -- start start 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adfe00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ac00678c0 0x7f4ac0069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009b10 tx=0x7f4ad0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247110d40 0x55a247111120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247111660 0x55a2470c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 0x55a2470c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a246fafa20 con 0x55a247111660 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a246f14ba0 con 0x55a2470c8400 2024-09-12T12:15:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55a246ebabb0 con 0x55a247110d40 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247111660 0x55a2470c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247111660 0x55a2470c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41640/0 (socket says 172.21.15.144:41640) 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adf400640 1 -- 172.21.15.144:0/3280850696 learned_addr learned my addr 172.21.15.144:0/3280850696 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4ae4e00640 1 --2- 172.21.15.144:0/3280850696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 0x55a2470c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adfe00640 1 --2- 172.21.15.144:0/3280850696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247110d40 0x55a247111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adf400640 1 -- 172.21.15.144:0/3280850696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247110d40 msgr2=0x55a247111120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adf400640 1 --2- 172.21.15.144:0/3280850696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247110d40 0x55a247111120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adf400640 1 -- 172.21.15.144:0/3280850696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 msgr2=0x55a2470c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adf400640 1 --2- 172.21.15.144:0/3280850696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 0x55a2470c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adf400640 1 -- 172.21.15.144:0/3280850696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a246f5bee0 con 0x55a247111660 2024-09-12T12:15:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4adf400640 1 --2- 172.21.15.144:0/3280850696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247111660 0x55a2470c7ec0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4acc051a20 tx=0x7f4acc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f3eb51c1efbf6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4ad4c00640 1 -- 172.21.15.144:0/3280850696 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc051c30 con 0x55a247111660 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4ad4c00640 1 -- 172.21.15.144:0/3280850696 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4acc0074b0 con 0x55a247111660 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4ad4c00640 1 -- 172.21.15.144:0/3280850696 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc051dd0 con 0x55a247111660 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 -- 172.21.15.144:0/3280850696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247111660 msgr2=0x55a2470c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 --2- 172.21.15.144:0/3280850696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247111660 0x55a2470c7ec0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4acc051a20 tx=0x7f4acc00cf90 comp rx=0 tx=0).stop 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 -- 172.21.15.144:0/3280850696 shutdown_connections 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 --2- 172.21.15.144:0/3280850696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 0x55a2470c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 --2- 172.21.15.144:0/3280850696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247111660 0x55a2470c7ec0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 --2- 172.21.15.144:0/3280850696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247110d40 0x55a247111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 -- 172.21.15.144:0/3280850696 >> 172.21.15.144:0/3280850696 conn(0x55a2470c43b0 msgr2=0x55a2470c67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 -- 172.21.15.144:0/3280850696 shutdown_connections 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 -- 172.21.15.144:0/3280850696 wait complete. 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 -- start start 2024-09-12T12:15:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.527+0000 7f4aea259000 1 Processor -- start 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 0x55a2470d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247110d40 0x55a2470d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 0x55a2470d2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a246eaed20 con 0x55a247110d40 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a246f10b60 con 0x55a2470c8400 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55a246f191d0 con 0x55a247111660 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 10 client.0 _ll_register_callbacks cb 0x55a246f78120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247110d40 0x55a2470d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247110d40 0x55a2470d2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41652/0 (socket says 172.21.15.144:41652) 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adf400640 1 -- 172.21.15.144:0/2437810245 learned_addr learned my addr 172.21.15.144:0/2437810245 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ae4e00640 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 0x55a2470d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adf400640 1 -- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 msgr2=0x55a2470d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adfe00640 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 0x55a2470d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adf400640 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 0x55a2470d2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adf400640 1 -- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 msgr2=0x55a2470d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adf400640 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 0x55a2470d2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adf400640 1 -- 172.21.15.144:0/2437810245 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a246eefe20 con 0x55a247110d40 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ae4e00640 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 0x55a2470d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adfe00640 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 0x55a2470d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adf400640 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247110d40 0x55a2470d2a80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0837a0 tx=0x7f4acc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4405d3b7a50765ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 1 -- 172.21.15.144:0/2437810245 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc071030 con 0x55a247110d40 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 1 -- 172.21.15.144:0/2437810245 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f4acc081040 con 0x55a247110d40 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- 172.21.15.144:0/2437810245 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4acc0074b0 con 0x55a247110d40 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 1 -- 172.21.15.144:0/2437810245 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4acc055390 con 0x55a247110d40 2024-09-12T12:15:56.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 10 client.5898 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- 172.21.15.144:0/2437810245 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55a246ee79c0 con 0x55a247110d40 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 1 -- 172.21.15.144:0/2437810245 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4acc0074b0 con 0x55a247110d40 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 1 -- 172.21.15.144:0/2437810245 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f4acc051310 con 0x55a247110d40 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 10 client.5898 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 10 client.5898 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 20 client.5898 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55a24711fdd0 0x55a2471221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 4 client.5898 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- 172.21.15.144:0/2437810245 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a246eaf1e0 con 0x55a24711fdd0 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adfe00640 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55a24711fdd0 0x55a2471221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 10 client.5898 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4adfe00640 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55a24711fdd0 0x55a2471221c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3209b2e7ed5b25b0 server_cookie=525c5ad4112e185c in_seq=0 out_seq=0 2024-09-12T12:15:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 1 -- 172.21.15.144:0/2437810245 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a246eaf1e0 con 0x55a24711fdd0 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 10 client.5898 handle_command_reply: tid=0 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 client.5898 shutdown 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- 172.21.15.144:0/2437810245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247110d40 msgr2=0x55a2470d2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247110d40 0x55a2470d2a80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0837a0 tx=0x7f4acc000bd0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- 172.21.15.144:0/2437810245 shutdown_connections 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55a24711fdd0 0x55a2471221c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 0x55a2470d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a247110d40 0x55a2470d2a80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4ac9600640 0 client.5898 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 --2- 172.21.15.144:0/2437810245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a2470c8400 0x55a2470d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- 172.21.15.144:0/2437810245 >> 172.21.15.144:0/2437810245 conn(0x55a2470c43b0 msgr2=0x55a2470c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- 172.21.15.144:0/2437810245 shutdown_connections 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.531+0000 7f4aea259000 1 -- 172.21.15.144:0/2437810245 wait complete. 2024-09-12T12:15:56.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.535+0000 7f4aea259000 20 client.5898 trim_cache size 0 max 16384 2024-09-12T12:15:56.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.547+0000 7f4aea259000 1 Processor -- start 2024-09-12T12:15:56.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.547+0000 7f4aea259000 1 -- start start 2024-09-12T12:15:56.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.547+0000 7f4aea259000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247125820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.547+0000 7f4aea259000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247110d40 0x55a2470cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.547+0000 7f4aea259000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a247111660 0x55a2470cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.547+0000 7f4aea259000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0200f40 con 0x55a2470c8400 2024-09-12T12:15:56.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.547+0000 7f4aea259000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01fff90 con 0x55a247111660 2024-09-12T12:15:56.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.547+0000 7f4aea259000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae015e290 con 0x55a247110d40 2024-09-12T12:15:56.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247125820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247125820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41660/0 (socket says 172.21.15.144:41660) 2024-09-12T12:15:56.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 -- 172.21.15.144:0/2913624049 learned_addr learned my addr 172.21.15.144:0/2913624049 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 -- 172.21.15.144:0/2913624049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247110d40 msgr2=0x55a2470cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 --2- 172.21.15.144:0/2913624049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247110d40 0x55a2470cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 -- 172.21.15.144:0/2913624049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a247111660 msgr2=0x55a2470cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 --2- 172.21.15.144:0/2913624049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a247111660 0x55a2470cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 -- 172.21.15.144:0/2913624049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a247111490 con 0x55a2470c8400 2024-09-12T12:15:56.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 --2- 172.21.15.144:0/2913624049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247125820 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009600 tx=0x7f4ad0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5258fd235743b1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4acbe00640 1 -- 172.21.15.144:0/2913624049 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0004420 con 0x55a2470c8400 2024-09-12T12:15:56.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4acbe00640 1 -- 172.21.15.144:0/2913624049 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad001d040 con 0x55a2470c8400 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4acbe00640 1 -- 172.21.15.144:0/2913624049 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0003ca0 con 0x55a2470c8400 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 -- 172.21.15.144:0/2913624049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 msgr2=0x55a247125820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 --2- 172.21.15.144:0/2913624049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247125820 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009600 tx=0x7f4ad0014000 comp rx=0 tx=0).stop 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 -- 172.21.15.144:0/2913624049 shutdown_connections 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 --2- 172.21.15.144:0/2913624049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a247111660 0x55a2470cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 --2- 172.21.15.144:0/2913624049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247110d40 0x55a2470cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 --2- 172.21.15.144:0/2913624049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247125820 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 -- 172.21.15.144:0/2913624049 >> 172.21.15.144:0/2913624049 conn(0x55a2470c43b0 msgr2=0x55a2470c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 -- 172.21.15.144:0/2913624049 shutdown_connections 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 -- 172.21.15.144:0/2913624049 wait complete. 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 -- start start 2024-09-12T12:15:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 Processor -- start 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247124e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a247110d40 0x55a2471253b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 0x55a2471404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a246eda9a0 con 0x55a2470c8400 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01ff940 con 0x55a247110d40 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55a246f14ba0 con 0x55a247111660 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4aea259000 10 client.0 _ll_register_callbacks cb 0x7f4ac4003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247124e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247124e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41662/0 (socket says 172.21.15.144:41662) 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adfe00640 1 -- 172.21.15.144:0/22774121 learned_addr learned my addr 172.21.15.144:0/22774121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4adf400640 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a247110d40 0x55a2471253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.551+0000 7f4ae4e00640 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 0x55a2471404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4adfe00640 1 -- 172.21.15.144:0/22774121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 msgr2=0x55a2471404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4adfe00640 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 0x55a2471404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4adfe00640 1 -- 172.21.15.144:0/22774121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a247110d40 msgr2=0x55a2471253b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4adfe00640 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a247110d40 0x55a2471253b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4adfe00640 1 -- 172.21.15.144:0/22774121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a246ebae00 con 0x55a2470c8400 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4adfe00640 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247124e70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000a010 tx=0x7f4ad00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38009496fc34f564 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4ac9600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4ac9600640 1 -- 172.21.15.144:0/22774121 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad003c060 con 0x55a2470c8400 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4ac9600640 1 -- 172.21.15.144:0/22774121 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f4ad000f040 con 0x55a2470c8400 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4aea259000 1 -- 172.21.15.144:0/22774121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad001d040 con 0x55a2470c8400 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4ac9600640 1 -- 172.21.15.144:0/22774121 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ad0003aa0 con 0x55a2470c8400 2024-09-12T12:15:56.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4aea259000 10 client.5904 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4aea259000 1 -- 172.21.15.144:0/22774121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55a246ea8ce0 con 0x55a2470c8400 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4ac9600640 1 -- 172.21.15.144:0/22774121 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad001d040 con 0x55a2470c8400 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4ac9600640 1 -- 172.21.15.144:0/22774121 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f4ad0045080 con 0x55a2470c8400 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4aea259000 10 client.5904 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4aea259000 10 client.5904 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4aea259000 20 client.5904 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4aea259000 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55a247140e40 0x55a247183f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4aea259000 4 client.5904 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4aea259000 1 -- 172.21.15.144:0/22774121 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x55a246f222d0 con 0x55a247140e40 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4adf400640 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55a247140e40 0x55a247183f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4adf400640 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55a247140e40 0x55a247183f10 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9656b985560356d8 server_cookie=4a863ac63ae1a246 in_seq=0 out_seq=0 2024-09-12T12:15:56.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.555+0000 7f4ac9600640 10 client.5904 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4ac9600640 1 -- 172.21.15.144:0/22774121 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a246f222d0 con 0x55a247140e40 2024-09-12T12:15:56.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4ac9600640 10 client.5904 handle_command_reply: tid=0 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 client.5904 shutdown 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 -- 172.21.15.144:0/22774121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 msgr2=0x55a247124e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247124e70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000a010 tx=0x7f4ad00046d0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 -- 172.21.15.144:0/22774121 shutdown_connections 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55a247140e40 0x55a247183f10 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a247111660 0x55a2471404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a247110d40 0x55a2471253b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4ac9600640 0 client.5904 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 --2- 172.21.15.144:0/22774121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a2470c8400 0x55a247124e70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 -- 172.21.15.144:0/22774121 >> 172.21.15.144:0/22774121 conn(0x55a2470c43b0 msgr2=0x55a2470cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 -- 172.21.15.144:0/22774121 shutdown_connections 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 1 -- 172.21.15.144:0/22774121 wait complete. 2024-09-12T12:15:56.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4aea259000 20 client.5904 trim_cache size 0 max 16384 2024-09-12T12:15:56.564 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:56.564 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:15:56.564 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:15:56.564 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4ae6e00640 1 -- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ac00678c0 msgr2=0x7f4ac0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4ae6e00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ac00678c0 0x7f4ac0069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009b10 tx=0x7f4ad0008040 comp rx=0 tx=0).stop 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4ae6e00640 1 -- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae00cd9f0 msgr2=0x7f4ae015b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.559+0000 7f4ae6e00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae00cd9f0 0x7f4ae015b550 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00c420 tx=0x7f4acc00c8e0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.563+0000 7f4ae6e00640 1 -- 172.21.15.144:0/3469300989 shutdown_connections 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.563+0000 7f4ae6e00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ac00678c0 0x7f4ac0069d80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.563+0000 7f4ae6e00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ae015af60 0x7f4ae0140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.563+0000 7f4ae6e00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ae00cd9f0 0x7f4ae015b550 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.563+0000 7f4ae6e00640 1 --2- 172.21.15.144:0/3469300989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ae006c320 0x7f4ae00aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.563+0000 7f4ae6e00640 1 -- 172.21.15.144:0/3469300989 >> 172.21.15.144:0/3469300989 conn(0x7f4ae0068030 msgr2=0x7f4ae00afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.563+0000 7f4ae6e00640 1 -- 172.21.15.144:0/3469300989 shutdown_connections 2024-09-12T12:15:56.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.563+0000 7f4ae6e00640 1 -- 172.21.15.144:0/3469300989 wait complete. 2024-09-12T12:15:56.582 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-09-12T12:15:56.583 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:15:56.583 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:15:56.583 DEBUG:teuthology.orchestra.run.smithi144:> import stat 2024-09-12T12:15:56.583 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:15:56.584 DEBUG:teuthology.orchestra.run.smithi144:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-09-12T12:15:56.584 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:15:56.648 INFO:teuthology.orchestra.run.smithi144.stdout:1099511630411 2024-09-12T12:15:56.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:15:56.658 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-12T12:15:56.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdedc400640 1 Processor -- start 2024-09-12T12:15:56.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdedc400640 1 -- start start 2024-09-12T12:15:56.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdedc400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fded406c320 0x7fded4165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdedc400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded40b4300 con 0x7fded40cd9f0 2024-09-12T12:15:56.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdedc400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded40b3540 con 0x7fded415af60 2024-09-12T12:15:56.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdedc400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fded40b32f0 con 0x7fded406c320 2024-09-12T12:15:56.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdeda400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fded406c320 0x7fded4165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fded9000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fded40cd9f0 0x7fded406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53888/0 (socket says 172.21.15.144:53888) 2024-09-12T12:15:56.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fded9000640 1 -- 172.21.15.144:0/3961511705 learned_addr learned my addr 172.21.15.144:0/3961511705 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:15:56.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdeda400640 1 -- 172.21.15.144:0/3961511705 >> v1:172.21.15.165:6789/0 conn(0x7fded415af60 legacy=0x7fded40ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdeda400640 1 -- 172.21.15.144:0/3961511705 >> v1:172.21.15.144:6789/0 conn(0x7fded40cd9f0 legacy=0x7fded406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fded3e00640 1 -- 172.21.15.144:0/3961511705 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263774777 0 0) 0x7fded40b4300 con 0x7fded40cd9f0 2024-09-12T12:15:56.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.835+0000 7fdeda400640 1 -- 172.21.15.144:0/3961511705 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded40b3820 con 0x7fded406c320 2024-09-12T12:15:56.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fdeda400640 1 --2- 172.21.15.144:0/3961511705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded406c320 0x7fded4165ef0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009d90 tx=0x7fdecc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7043af63965258a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fded3e00640 1 -- 172.21.15.144:0/3961511705 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0b2070 con 0x7fded406c320 2024-09-12T12:15:56.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fded3e00640 1 -- 172.21.15.144:0/3961511705 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdecc0a5830 con 0x7fded406c320 2024-09-12T12:15:56.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fded3e00640 1 -- 172.21.15.144:0/3961511705 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0a5c00 con 0x7fded406c320 2024-09-12T12:15:56.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fdedc400640 1 -- 172.21.15.144:0/3961511705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded406c320 msgr2=0x7fded4165ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fdedc400640 1 --2- 172.21.15.144:0/3961511705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded406c320 0x7fded4165ef0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009d90 tx=0x7fdecc01c970 comp rx=0 tx=0).stop 2024-09-12T12:15:56.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fdedc400640 1 -- 172.21.15.144:0/3961511705 shutdown_connections 2024-09-12T12:15:56.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fdedc400640 1 --2- 172.21.15.144:0/3961511705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded406c320 0x7fded4165ef0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fdedc400640 1 -- 172.21.15.144:0/3961511705 >> 172.21.15.144:0/3961511705 conn(0x7fded4068030 msgr2=0x7fded40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fdedc400640 1 -- 172.21.15.144:0/3961511705 shutdown_connections 2024-09-12T12:15:56.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.839+0000 7fdedc400640 1 -- 172.21.15.144:0/3961511705 wait complete. 2024-09-12T12:15:56.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 Processor -- start 2024-09-12T12:15:56.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 -- start start 2024-09-12T12:15:56.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fded406c320 0x7fded414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fded40cd9f0 0x7fded4140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded415af60 0x7fded4141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fded4168dd0 con 0x7fded415af60 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fded4168c50 con 0x7fded406c320 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fded4168f50 con 0x7fded40cd9f0 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdeda400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded415af60 0x7fded4141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdeda400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded415af60 0x7fded4141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41672/0 (socket says 172.21.15.144:41672) 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdeda400640 1 -- 172.21.15.144:0/3977609712 learned_addr learned my addr 172.21.15.144:0/3977609712 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fded9000640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fded40cd9f0 0x7fded4140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fded9a00640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fded406c320 0x7fded414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdeda400640 1 -- 172.21.15.144:0/3977609712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fded40cd9f0 msgr2=0x7fded4140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdeda400640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fded40cd9f0 0x7fded4140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdeda400640 1 -- 172.21.15.144:0/3977609712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fded406c320 msgr2=0x7fded414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdeda400640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fded406c320 0x7fded414ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdeda400640 1 -- 172.21.15.144:0/3977609712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded414e8e0 con 0x7fded415af60 2024-09-12T12:15:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdeda400640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded415af60 0x7fded4141160 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0b0040 tx=0x7fdecc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fded1600640 1 -- 172.21.15.144:0/3977609712 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0bd020 con 0x7fded415af60 2024-09-12T12:15:56.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fded1600640 1 -- 172.21.15.144:0/3977609712 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdecc0b3040 con 0x7fded415af60 2024-09-12T12:15:56.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 -- 172.21.15.144:0/3977609712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded414e600 con 0x7fded415af60 2024-09-12T12:15:56.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fded1600640 1 -- 172.21.15.144:0/3977609712 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0b2050 con 0x7fded415af60 2024-09-12T12:15:56.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.843+0000 7fdedc400640 1 -- 172.21.15.144:0/3977609712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded415bb60 con 0x7fded415af60 2024-09-12T12:15:56.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded1600640 1 -- 172.21.15.144:0/3977609712 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdecc0ad710 con 0x7fded415af60 2024-09-12T12:15:56.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded1600640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdeb40678c0 0x7fdeb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded1600640 1 -- 172.21.15.144:0/3977609712 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fdecc120b10 con 0x7fded415af60 2024-09-12T12:15:56.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdeb40678c0 0x7fdeb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdedf8a3000 1 Processor -- start 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdedf8a3000 1 -- start start 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdeb40678c0 0x7fdeb4069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fded414e510 tx=0x7fdec8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03380 0x55f6afc03760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afc03ca0 0x55f6afbb9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afbb9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f6afaa0c40 con 0x55f6afc03380 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f6afa07d50 con 0x55f6afbb97d0 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f6af9c2ab0 con 0x55f6afc03ca0 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03380 0x55f6afc03760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03380 0x55f6afc03760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41676/0 (socket says 172.21.15.144:41676) 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 -- 172.21.15.144:0/1358396937 learned_addr learned my addr 172.21.15.144:0/1358396937 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9000640 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afc03ca0 0x55f6afbb9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdeda400640 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afbb9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 -- 172.21.15.144:0/1358396937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afc03ca0 msgr2=0x55f6afbb9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afc03ca0 0x55f6afbb9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 -- 172.21.15.144:0/1358396937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 msgr2=0x55f6afbb9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afbb9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fded9a00640 1 -- 172.21.15.144:0/1358396937 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6af9ae590 con 0x55f6afc03380 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.847+0000 7fdeda400640 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afbb9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fded9a00640 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03380 0x55f6afc03760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdec80052f0 tx=0x7fdec8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a63a1fb3cb0f255 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdec6000640 1 -- 172.21.15.144:0/1358396937 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8005460 con 0x55f6afc03380 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdec6000640 1 -- 172.21.15.144:0/1358396937 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec800e6b0 con 0x55f6afc03380 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdec6000640 1 -- 172.21.15.144:0/1358396937 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec800ea60 con 0x55f6afc03380 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1358396937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03380 msgr2=0x55f6afc03760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03380 0x55f6afc03760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdec80052f0 tx=0x7fdec8011000 comp rx=0 tx=0).stop 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1358396937 shutdown_connections 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afbb9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afc03ca0 0x55f6afbb9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1358396937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03380 0x55f6afc03760 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1358396937 >> 172.21.15.144:0/1358396937 conn(0x55f6afbb0bc0 msgr2=0x55f6afbb7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1358396937 shutdown_connections 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1358396937 wait complete. 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 -- start start 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 Processor -- start 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb97d0 0x55f6afbbe8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afc03380 0x55f6afbed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03ca0 0x55f6afbedb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f6af9c6400 con 0x55f6afc03ca0 2024-09-12T12:15:56.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f6afac43a0 con 0x55f6afc03380 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f6afa47260 con 0x55f6afbb97d0 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdedf8a3000 10 client.0 _ll_register_callbacks cb 0x55f6afa69020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdeda400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03ca0 0x55f6afbedb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fded9a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb97d0 0x55f6afbbe8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdeda400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03ca0 0x55f6afbedb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41680/0 (socket says 172.21.15.144:41680) 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdeda400640 1 -- 172.21.15.144:0/1514559701 learned_addr learned my addr 172.21.15.144:0/1514559701 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fded9000640 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afc03380 0x55f6afbed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdeda400640 1 -- 172.21.15.144:0/1514559701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb97d0 msgr2=0x55f6afbbe8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdeda400640 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb97d0 0x55f6afbbe8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdeda400640 1 -- 172.21.15.144:0/1514559701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afc03380 msgr2=0x55f6afbed5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdeda400640 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afc03380 0x55f6afbed5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.851+0000 7fdeda400640 1 -- 172.21.15.144:0/1514559701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6af9aadd0 con 0x55f6afc03ca0 2024-09-12T12:15:56.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdeda400640 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03ca0 0x55f6afbedb10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdecc01cee0 tx=0x7fdecc0f14b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c266f2c4e0046e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 1 -- 172.21.15.144:0/1514559701 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0f5160 con 0x55f6afc03ca0 2024-09-12T12:15:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 1 -- 172.21.15.144:0/1514559701 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fdecc0f9500 con 0x55f6afc03ca0 2024-09-12T12:15:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1514559701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdec800e6b0 con 0x55f6afc03ca0 2024-09-12T12:15:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 1 -- 172.21.15.144:0/1514559701 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdecc0f9990 con 0x55f6afc03ca0 2024-09-12T12:15:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 10 client.5919 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1514559701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f6af9a7800 con 0x55f6afc03ca0 2024-09-12T12:15:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 1 -- 172.21.15.144:0/1514559701 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec800e6b0 con 0x55f6afc03ca0 2024-09-12T12:15:56.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 1 -- 172.21.15.144:0/1514559701 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdecc0f7040 con 0x55f6afc03ca0 2024-09-12T12:15:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 10 client.5919 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 10 client.5919 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 20 client.5919 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f6afc0a150 0x55f6afc0a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 4 client.5919 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1514559701 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6af9a1e20 con 0x55f6afc0a150 2024-09-12T12:15:56.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fded9a00640 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f6afc0a150 0x55f6afc0a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fded9a00640 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f6afc0a150 0x55f6afc0a530 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af7356dcbcd191c server_cookie=142b1303df2ee17f in_seq=0 out_seq=0 2024-09-12T12:15:56.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 10 client.5919 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 1 -- 172.21.15.144:0/1514559701 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6af9a1e20 con 0x55f6afc0a150 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 10 client.5919 handle_command_reply: tid=0 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 client.5919 shutdown 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1514559701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03ca0 msgr2=0x55f6afbedb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03ca0 0x55f6afbedb10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdecc01cee0 tx=0x7fdecc0f14b0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1514559701 shutdown_connections 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f6afc0a150 0x55f6afc0a530 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc03ca0 0x55f6afbedb10 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afc03380 0x55f6afbed5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1514559701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb97d0 0x55f6afbbe8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdebaa00640 0 client.5919 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1514559701 >> 172.21.15.144:0/1514559701 conn(0x55f6afbb0bc0 msgr2=0x55f6afbb8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1514559701 shutdown_connections 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1514559701 wait complete. 2024-09-12T12:15:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.855+0000 7fdedf8a3000 20 client.5919 trim_cache size 0 max 16384 2024-09-12T12:15:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 Processor -- start 2024-09-12T12:15:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- start start 2024-09-12T12:15:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc1a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb0bc0 0x55f6afc1ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afc06090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fded4149cc0 con 0x55f6afc10e70 2024-09-12T12:15:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fded4149020 con 0x55f6afbb97d0 2024-09-12T12:15:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fded4149670 con 0x55f6afbb0bc0 2024-09-12T12:15:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fded9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc1a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fded9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc1a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41684/0 (socket says 172.21.15.144:41684) 2024-09-12T12:15:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fded9a00640 1 -- 172.21.15.144:0/2747154893 learned_addr learned my addr 172.21.15.144:0/2747154893 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fded9a00640 1 -- 172.21.15.144:0/2747154893 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb0bc0 msgr2=0x55f6afc1ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fded9a00640 1 --2- 172.21.15.144:0/2747154893 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb0bc0 0x55f6afc1ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fded9a00640 1 -- 172.21.15.144:0/2747154893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 msgr2=0x55f6afc06090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fded9a00640 1 --2- 172.21.15.144:0/2747154893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afc06090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fded9a00640 1 -- 172.21.15.144:0/2747154893 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6af9c5480 con 0x55f6afc10e70 2024-09-12T12:15:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fded9a00640 1 --2- 172.21.15.144:0/2747154893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc1a750 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000f70 tx=0x7fdec8005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4ebe6878333788 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdec5600640 1 -- 172.21.15.144:0/2747154893 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec800e960 con 0x55f6afc10e70 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdec5600640 1 -- 172.21.15.144:0/2747154893 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec800eb00 con 0x55f6afc10e70 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdec5600640 1 -- 172.21.15.144:0/2747154893 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec802f3c0 con 0x55f6afc10e70 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- 172.21.15.144:0/2747154893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 msgr2=0x55f6afc1a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/2747154893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc1a750 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdec8000f70 tx=0x7fdec8005000 comp rx=0 tx=0).stop 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- 172.21.15.144:0/2747154893 shutdown_connections 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/2747154893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afc06090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/2747154893 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb0bc0 0x55f6afc1ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/2747154893 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc1a750 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- 172.21.15.144:0/2747154893 >> 172.21.15.144:0/2747154893 conn(0x55f6afbbe700 msgr2=0x55f6afbed100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- 172.21.15.144:0/2747154893 shutdown_connections 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- 172.21.15.144:0/2747154893 wait complete. 2024-09-12T12:15:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 -- start start 2024-09-12T12:15:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.871+0000 7fdedf8a3000 1 Processor -- start 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb0bc0 0x55f6afc08fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afc73e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc74350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f6af9adf30 con 0x55f6afc10e70 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f6af9c67d0 con 0x55f6afbb97d0 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f6afa07060 con 0x55f6afbb0bc0 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 10 client.0 _ll_register_callbacks cb 0x7fdecc009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdeda400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc74350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdeda400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc74350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41692/0 (socket says 172.21.15.144:41692) 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdeda400640 1 -- 172.21.15.144:0/1526532747 learned_addr learned my addr 172.21.15.144:0/1526532747 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fded9a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb0bc0 0x55f6afc08fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fded9000640 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afc73e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdeda400640 1 -- 172.21.15.144:0/1526532747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb0bc0 msgr2=0x55f6afc08fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdeda400640 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb0bc0 0x55f6afc08fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdeda400640 1 -- 172.21.15.144:0/1526532747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 msgr2=0x55f6afc73e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdeda400640 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afc73e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdeda400640 1 -- 172.21.15.144:0/1526532747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6af99b650 con 0x55f6afc10e70 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdeda400640 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc74350 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00c050 tx=0x7fdecc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c68154a98fcfe7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdebaa00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdebaa00640 1 -- 172.21.15.144:0/1526532747 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0ed050 con 0x55f6afc10e70 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdebaa00640 1 -- 172.21.15.144:0/1526532747 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fdecc10f120 con 0x55f6afc10e70 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1526532747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdec800eb00 con 0x55f6afc10e70 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdebaa00640 1 -- 172.21.15.144:0/1526532747 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdecc0f5160 con 0x55f6afc10e70 2024-09-12T12:15:56.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 10 client.5925 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1526532747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55f6af99f3c0 con 0x55f6afc10e70 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdebaa00640 1 -- 172.21.15.144:0/1526532747 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec800eb00 con 0x55f6afc10e70 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdebaa00640 1 -- 172.21.15.144:0/1526532747 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdecc0f7040 con 0x55f6afc10e70 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 10 client.5925 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 10 client.5925 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 20 client.5925 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f6afc03380 0x55f6afc74890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 4 client.5925 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1526532747 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f6afa15480 con 0x55f6afc03380 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fded9a00640 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f6afc03380 0x55f6afc74890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fded9a00640 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f6afc03380 0x55f6afc74890 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e7f5b9b5cb36b29 server_cookie=e0bee3de25cc30d7 in_seq=0 out_seq=0 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdebaa00640 10 client.5925 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdebaa00640 1 -- 172.21.15.144:0/1526532747 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f6afa15480 con 0x55f6afc03380 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdebaa00640 10 client.5925 handle_command_reply: tid=0 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 client.5925 shutdown 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1526532747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 msgr2=0x55f6afc74350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc74350 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00c050 tx=0x7fdecc01c970 comp rx=0 tx=0).stop 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1526532747 shutdown_connections 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f6afc03380 0x55f6afc74890 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f6afc10e70 0x55f6afc74350 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6afbb97d0 0x55f6afc73e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 --2- 172.21.15.144:0/1526532747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f6afbb0bc0 0x55f6afc08fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.875+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1526532747 >> 172.21.15.144:0/1526532747 conn(0x55f6afbbe700 msgr2=0x55f6afbed810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdebaa00640 0 client.5925 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1526532747 shutdown_connections 2024-09-12T12:15:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedf8a3000 1 -- 172.21.15.144:0/1526532747 wait complete. 2024-09-12T12:15:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedf8a3000 20 client.5925 trim_cache size 0 max 16384 2024-09-12T12:15:56.884 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 -- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdeb40678c0 msgr2=0x7fdeb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdeb40678c0 0x7fdeb4069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fded414e510 tx=0x7fdec8009040 comp rx=0 tx=0).stop 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 -- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded415af60 msgr2=0x7fded4141160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded415af60 0x7fded4141160 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdecc0b0040 tx=0x7fdecc019710 comp rx=0 tx=0).stop 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 -- 172.21.15.144:0/3977609712 shutdown_connections 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdeb40678c0 0x7fdeb4069d80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fded415af60 0x7fded4141160 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fded40cd9f0 0x7fded4140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 --2- 172.21.15.144:0/3977609712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fded406c320 0x7fded414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 -- 172.21.15.144:0/3977609712 >> 172.21.15.144:0/3977609712 conn(0x7fded4068030 msgr2=0x7fded40b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 -- 172.21.15.144:0/3977609712 shutdown_connections 2024-09-12T12:15:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.879+0000 7fdedc400640 1 -- 172.21.15.144:0/3977609712 wait complete. 2024-09-12T12:15:56.899 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4b.00000000 parent 2024-09-12T12:15:56.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6295603080 1 Processor -- start 2024-09-12T12:15:56.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6295603080 1 -- start start 2024-09-12T12:15:56.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6295603080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 0x558fba0fa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6295603080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6295603080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 0x558fba05bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6295603080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558fba02d1e0 con 0x558fba076c30 2024-09-12T12:15:56.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6295603080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558fb9f7e1b0 con 0x558fba074aa0 2024-09-12T12:15:56.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6295603080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x558fba02d360 con 0x558fba102540 2024-09-12T12:15:56.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f628be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f628be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41706/0 (socket says 172.21.15.144:41706) 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f628be00640 1 -- 172.21.15.144:0/3062032022 learned_addr learned my addr 172.21.15.144:0/3062032022 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6293200640 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 0x558fba05bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6292800640 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 0x558fba0fa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f628be00640 1 -- 172.21.15.144:0/3062032022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 msgr2=0x558fba05bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f628be00640 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 0x558fba05bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f628be00640 1 -- 172.21.15.144:0/3062032022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 msgr2=0x558fba0fa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f628be00640 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 0x558fba0fa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f628be00640 1 -- 172.21.15.144:0/3062032022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fba030910 con 0x558fba076c30 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6293200640 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 0x558fba05bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f628be00640 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b6d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f627c019010 tx=0x7f627c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37507d4a2d9bc60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6291400640 1 -- 172.21.15.144:0/3062032022 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c0af040 con 0x558fba076c30 2024-09-12T12:15:56.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6291400640 1 -- 172.21.15.144:0/3062032022 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c0b9070 con 0x558fba076c30 2024-09-12T12:15:56.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.943+0000 7f6291400640 1 -- 172.21.15.144:0/3062032022 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c0aacd0 con 0x558fba076c30 2024-09-12T12:15:56.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- 172.21.15.144:0/3062032022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 msgr2=0x558fba05b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b6d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f627c019010 tx=0x7f627c003030 comp rx=0 tx=0).stop 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- 172.21.15.144:0/3062032022 shutdown_connections 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 0x558fba05bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b6d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 --2- 172.21.15.144:0/3062032022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 0x558fba0fa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- 172.21.15.144:0/3062032022 >> 172.21.15.144:0/3062032022 conn(0x558fba057ff0 msgr2=0x558fba0583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- 172.21.15.144:0/3062032022 shutdown_connections 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- 172.21.15.144:0/3062032022 wait complete. 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 Processor -- start 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- start start 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 0x558fba19ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 0x558fba05b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558fba05c150 con 0x558fba076c30 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558fba0fe4b0 con 0x558fba074aa0 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x558fba06e080 con 0x558fba102540 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41718/0 (socket says 172.21.15.144:41718) 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628be00640 1 -- 172.21.15.144:0/4256623174 learned_addr learned my addr 172.21.15.144:0/4256623174 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6293200640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 0x558fba05b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6292800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 0x558fba19ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628be00640 1 -- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 msgr2=0x558fba05b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628be00640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558fba102540 0x558fba05b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628be00640 1 -- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 msgr2=0x558fba19ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628be00640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 0x558fba19ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628be00640 1 -- 172.21.15.144:0/4256623174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fba0508a0 con 0x558fba076c30 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6292800640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558fba074aa0 0x558fba19ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628be00640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b480 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f627c0b6040 tx=0x7f627c018180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628b400640 1 -- 172.21.15.144:0/4256623174 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c0af040 con 0x558fba076c30 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628b400640 1 -- 172.21.15.144:0/4256623174 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c0c5070 con 0x558fba076c30 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558fba050b40 con 0x558fba076c30 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f628b400640 1 -- 172.21.15.144:0/4256623174 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c0b4870 con 0x558fba076c30 2024-09-12T12:15:56.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.947+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fba051080 con 0x558fba076c30 2024-09-12T12:15:56.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.951+0000 7f628b400640 1 -- 172.21.15.144:0/4256623174 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f627c0b4a10 con 0x558fba076c30 2024-09-12T12:15:56.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.951+0000 7f628b400640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62700662d0 0x7f6270068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.951+0000 7f628b400640 1 -- 172.21.15.144:0/4256623174 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f627c1205d0 con 0x558fba076c30 2024-09-12T12:15:56.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.951+0000 7f6292800640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62700662d0 0x7f6270068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.951+0000 7f6295603080 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x558fba05e2f0 0x558fba19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:56.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.951+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 --> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] -- osd_op(unknown.0.0:1 8.24 8:256cebcc:::10000000a4b.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54) -- 0x558fba1a0490 con 0x558fba05e2f0 2024-09-12T12:15:56.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.951+0000 7f6293200640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x558fba05e2f0 0x558fba19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:56.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.951+0000 7f6292800640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62700662d0 0x7f6270068790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6284005fd0 tx=0x7f628400c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.951+0000 7f6293200640 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x558fba05e2f0 0x558fba19d940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:56.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6293200640 1 -- 172.21.15.144:0/4256623174 <== osd.6 v2:172.21.15.165:6816/608700228 1 ==== osd_op_reply(1 10000000a4b.00000000 [rmxattr] v54'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f628c003960 con 0x558fba05e2f0 2024-09-12T12:15:56.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x558fba05e2f0 msgr2=0x558fba19d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x558fba05e2f0 0x558fba19d940 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62700662d0 msgr2=0x7f6270068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62700662d0 0x7f6270068790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6284005fd0 tx=0x7f628400c040 comp rx=0 tx=0).stop 2024-09-12T12:15:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 msgr2=0x558fba05b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 --2- 172.21.15.144:0/4256623174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fba076c30 0x558fba05b480 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f627c0b6040 tx=0x7f627c018180 comp rx=0 tx=0).stop 2024-09-12T12:15:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6293200640 1 -- 172.21.15.144:0/4256623174 reap_dead start 2024-09-12T12:15:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 shutdown_connections 2024-09-12T12:15:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 >> 172.21.15.144:0/4256623174 conn(0x558fba057ff0 msgr2=0x558fba0583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 shutdown_connections 2024-09-12T12:15:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:56.955+0000 7f6295603080 1 -- 172.21.15.144:0/4256623174 wait complete. 2024-09-12T12:15:56.962 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-12T12:15:56.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-12T12:15:57.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.143+0000 7f6401c00640 1 Processor -- start 2024-09-12T12:15:57.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.143+0000 7f6401c00640 1 -- start start 2024-09-12T12:15:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f6401c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 0x7f63fc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f6401c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63fc15b340 0x7f63fc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f6401c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc0b4300 con 0x7f63fc15af60 2024-09-12T12:15:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f6401c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f63fc0b32f0 con 0x7f63fc15b340 2024-09-12T12:15:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f6401c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f63fc0b3540 con 0x7f63fc0cd9f0 2024-09-12T12:15:57.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63fc15b340 0x7f63fc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63fc15b340 0x7f63fc06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35886/0 (socket says 172.21.15.144:35886) 2024-09-12T12:15:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fb400640 1 -- 172.21.15.144:0/2346966142 learned_addr learned my addr 172.21.15.144:0/2346966142 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63f3e00640 1 --2- 172.21.15.144:0/2346966142 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 0x7f63fc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fb400640 1 -- 172.21.15.144:0/2346966142 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 msgr2=0x7f63fc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fb400640 1 --2- 172.21.15.144:0/2346966142 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 0x7f63fc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fb400640 1 -- 172.21.15.144:0/2346966142 >> v1:172.21.15.165:6789/0 conn(0x7f63fc15af60 legacy=0x7f63fc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fb400640 1 -- 172.21.15.144:0/2346966142 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc0b3820 con 0x7f63fc15b340 2024-09-12T12:15:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fb400640 1 --2- 172.21.15.144:0/2346966142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 0x7f63fc06c150 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009e50 tx=0x7f63f401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de99af017cfdcfc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fa000640 1 -- 172.21.15.144:0/2346966142 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f40b4070 con 0x7f63fc15b340 2024-09-12T12:15:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fa000640 1 -- 172.21.15.144:0/2346966142 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f40af400 con 0x7f63fc15b340 2024-09-12T12:15:57.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.147+0000 7f63fa000640 1 -- 172.21.15.144:0/2346966142 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f40af7d0 con 0x7f63fc15b340 2024-09-12T12:15:57.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 -- 172.21.15.144:0/2346966142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 msgr2=0x7f63fc06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 --2- 172.21.15.144:0/2346966142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 0x7f63fc06c150 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009e50 tx=0x7f63f401f210 comp rx=0 tx=0).stop 2024-09-12T12:15:57.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 -- 172.21.15.144:0/2346966142 shutdown_connections 2024-09-12T12:15:57.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 --2- 172.21.15.144:0/2346966142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 0x7f63fc06c150 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 --2- 172.21.15.144:0/2346966142 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 0x7f63fc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 -- 172.21.15.144:0/2346966142 >> 172.21.15.144:0/2346966142 conn(0x7f63fc068030 msgr2=0x7f63fc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 -- 172.21.15.144:0/2346966142 shutdown_connections 2024-09-12T12:15:57.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 -- 172.21.15.144:0/2346966142 wait complete. 2024-09-12T12:15:57.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 Processor -- start 2024-09-12T12:15:57.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 -- start start 2024-09-12T12:15:57.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 0x7f63fc1e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc15af60 0x7f63fc15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 0x7f63fc1f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc0b4560 con 0x7f63fc15b340 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc0b3de0 con 0x7f63fc15af60 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f6401c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f63fc0b46e0 con 0x7f63fc0cd9f0 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f63fb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 0x7f63fc1f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f63faa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 0x7f63fc1e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f63faa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 0x7f63fc1e7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:58750/0 (socket says 172.21.15.144:58750) 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f63faa00640 1 -- 172.21.15.144:0/2852437238 learned_addr learned my addr 172.21.15.144:0/2852437238 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.151+0000 7f63f3e00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc15af60 0x7f63fc15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63fb400640 1 -- 172.21.15.144:0/2852437238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 msgr2=0x7f63fc1e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63fb400640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 0x7f63fc1e7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63fb400640 1 -- 172.21.15.144:0/2852437238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc15af60 msgr2=0x7f63fc15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63fb400640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc15af60 0x7f63fc15db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63fb400640 1 -- 172.21.15.144:0/2852437238 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc15e180 con 0x7f63fc15b340 2024-09-12T12:15:57.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63fb400640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 0x7f63fc1f2200 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f63f40ae000 tx=0x7f63f401bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63f2a00640 1 -- 172.21.15.144:0/2852437238 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f40b4040 con 0x7f63fc15b340 2024-09-12T12:15:57.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63f2a00640 1 -- 172.21.15.144:0/2852437238 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f40c0070 con 0x7f63fc15b340 2024-09-12T12:15:57.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63f2a00640 1 -- 172.21.15.144:0/2852437238 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4009510 con 0x7f63fc15b340 2024-09-12T12:15:57.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f6401c00640 1 -- 172.21.15.144:0/2852437238 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc15e460 con 0x7f63fc15b340 2024-09-12T12:15:57.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f6401c00640 1 -- 172.21.15.144:0/2852437238 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc1e76d0 con 0x7f63fc15b340 2024-09-12T12:15:57.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63f2a00640 1 -- 172.21.15.144:0/2852437238 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63f40a8d10 con 0x7f63fc15b340 2024-09-12T12:15:57.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63f2a00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63d80678c0 0x7f63d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63f2a00640 1 -- 172.21.15.144:0/2852437238 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f63f4123bc0 con 0x7f63fc15b340 2024-09-12T12:15:57.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.155+0000 7f63faa00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63d80678c0 0x7f63d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 Processor -- start 2024-09-12T12:15:57.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 -- start start 2024-09-12T12:15:57.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63faa00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63d80678c0 0x7f63d8069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f63fc1e6fe0 tx=0x7f63ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 0x55c876183610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c876136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c8761373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c875f82b50 con 0x55c876137010 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c875f28370 con 0x55c876183b50 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c875f7eb10 con 0x55c876183230 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63fb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c8761373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63fb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c8761373f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35908/0 (socket says 172.21.15.144:35908) 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63fb400640 1 -- 172.21.15.144:0/2071567635 learned_addr learned my addr 172.21.15.144:0/2071567635 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63faa00640 1 --2- 172.21.15.144:0/2071567635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 0x55c876183610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63f3e00640 1 --2- 172.21.15.144:0/2071567635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c876136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63fb400640 1 -- 172.21.15.144:0/2071567635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 msgr2=0x55c876183610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63fb400640 1 --2- 172.21.15.144:0/2071567635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 0x55c876183610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63fb400640 1 -- 172.21.15.144:0/2071567635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 msgr2=0x55c876136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63fb400640 1 --2- 172.21.15.144:0/2071567635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c876136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63fb400640 1 -- 172.21.15.144:0/2071567635 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c875f8b7c0 con 0x55c876137010 2024-09-12T12:15:57.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63fb400640 1 --2- 172.21.15.144:0/2071567635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c8761373f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f63f40f0370 tx=0x7f63f4009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4998e8a385403bda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63eb400640 1 -- 172.21.15.144:0/2071567635 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f40f3f10 con 0x55c876137010 2024-09-12T12:15:57.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63eb400640 1 -- 172.21.15.144:0/2071567635 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f40f8210 con 0x55c876137010 2024-09-12T12:15:57.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f63eb400640 1 -- 172.21.15.144:0/2071567635 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f40fca40 con 0x55c876137010 2024-09-12T12:15:57.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 -- 172.21.15.144:0/2071567635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 msgr2=0x55c8761373f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 --2- 172.21.15.144:0/2071567635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c8761373f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f63f40f0370 tx=0x7f63f4009810 comp rx=0 tx=0).stop 2024-09-12T12:15:57.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 -- 172.21.15.144:0/2071567635 shutdown_connections 2024-09-12T12:15:57.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 --2- 172.21.15.144:0/2071567635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c8761373f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 --2- 172.21.15.144:0/2071567635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c876136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 --2- 172.21.15.144:0/2071567635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 0x55c876183610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 -- 172.21.15.144:0/2071567635 >> 172.21.15.144:0/2071567635 conn(0x55c87615fbe0 msgr2=0x55c876161fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 -- 172.21.15.144:0/2071567635 shutdown_connections 2024-09-12T12:15:57.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.159+0000 7f6404f60000 1 -- 172.21.15.144:0/2071567635 wait complete. 2024-09-12T12:15:57.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 -- start start 2024-09-12T12:15:57.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 Processor -- start 2024-09-12T12:15:57.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c876140610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 0x55c876140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c876141090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c875f81e60 con 0x55c876137010 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c875f1c650 con 0x55c876183b50 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c875ffff10 con 0x55c876183230 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 10 client.0 _ll_register_callbacks cb 0x55c8761200f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63faa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c876140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63faa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c876140610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35922/0 (socket says 172.21.15.144:35922) 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63faa00640 1 -- 172.21.15.144:0/2059218125 learned_addr learned my addr 172.21.15.144:0/2059218125 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63f3e00640 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 0x55c876140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63fb400640 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c876141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63faa00640 1 -- 172.21.15.144:0/2059218125 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 msgr2=0x55c876140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63faa00640 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 0x55c876140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63faa00640 1 -- 172.21.15.144:0/2059218125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 msgr2=0x55c876141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63faa00640 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c876141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63faa00640 1 -- 172.21.15.144:0/2059218125 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c875f45eb0 con 0x55c876137010 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63f3e00640 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 0x55c876140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63faa00640 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c876140610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0146d0 tx=0x7f63ec000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275b07eff560c70b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63dfe00640 1 -- 172.21.15.144:0/2059218125 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec025020 con 0x55c876137010 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63dfe00640 1 -- 172.21.15.144:0/2059218125 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f63ec013780 con 0x55c876137010 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 -- 172.21.15.144:0/2059218125 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63f40f8210 con 0x55c876137010 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63dfe00640 1 -- 172.21.15.144:0/2059218125 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f63ec02f050 con 0x55c876137010 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 10 client.5943 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 -- 172.21.15.144:0/2059218125 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55c875f28590 con 0x55c876137010 2024-09-12T12:15:57.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63dfe00640 1 -- 172.21.15.144:0/2059218125 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f40f8210 con 0x55c876137010 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63dfe00640 1 -- 172.21.15.144:0/2059218125 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f63ec032020 con 0x55c876137010 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 10 client.5943 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 10 client.5943 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 20 client.5943 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c8761924d0 0x55c8761948c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 4 client.5943 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f6404f60000 1 -- 172.21.15.144:0/2059218125 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c875f1cd30 con 0x55c8761924d0 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.163+0000 7f63f3e00640 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c8761924d0 0x55c8761948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f63f3e00640 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c8761924d0 0x55c8761948c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4897dd68b233cac4 server_cookie=e45e3123b6631b25 in_seq=0 out_seq=0 2024-09-12T12:15:57.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f63dfe00640 10 client.5943 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:57.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f63dfe00640 1 -- 172.21.15.144:0/2059218125 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c875f1cd30 con 0x55c8761924d0 2024-09-12T12:15:57.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f63dfe00640 10 client.5943 handle_command_reply: tid=0 2024-09-12T12:15:57.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 client.5943 shutdown 2024-09-12T12:15:57.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 -- 172.21.15.144:0/2059218125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 msgr2=0x55c876140610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c876140610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0146d0 tx=0x7f63ec000ee0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 -- 172.21.15.144:0/2059218125 shutdown_connections 2024-09-12T12:15:57.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c8761924d0 0x55c8761948c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c876141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183230 0x55c876140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 --2- 172.21.15.144:0/2059218125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876137010 0x55c876140610 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f63dfe00640 0 client.5943 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:57.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 -- 172.21.15.144:0/2059218125 >> 172.21.15.144:0/2059218125 conn(0x55c87615fbe0 msgr2=0x55c876131dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 -- 172.21.15.144:0/2059218125 shutdown_connections 2024-09-12T12:15:57.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 1 -- 172.21.15.144:0/2059218125 wait complete. 2024-09-12T12:15:57.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.167+0000 7f6404f60000 20 client.5943 trim_cache size 0 max 16384 2024-09-12T12:15:57.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.183+0000 7f6404f60000 1 Processor -- start 2024-09-12T12:15:57.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.183+0000 7f6404f60000 1 -- start start 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.183+0000 7f6404f60000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876137010 0x55c8761f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.183+0000 7f6404f60000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.183+0000 7f6404f60000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c8761f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.183+0000 7f6404f60000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc1fce30 con 0x55c876183230 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.183+0000 7f6404f60000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc159770 con 0x55c876183b50 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.183+0000 7f6404f60000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f63fc150ef0 con 0x55c876137010 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35930/0 (socket says 172.21.15.144:35930) 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 -- 172.21.15.144:0/3218688582 learned_addr learned my addr 172.21.15.144:0/3218688582 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63faa00640 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876137010 0x55c8761f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63fb400640 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c8761f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 -- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876137010 msgr2=0x55c8761f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876137010 0x55c8761f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 -- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 msgr2=0x55c8761f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c8761f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 -- 172.21.15.144:0/3218688582 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8760003a0 con 0x55c876183230 2024-09-12T12:15:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63faa00640 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876137010 0x55c8761f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63fb400640 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c8761f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:57.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f3500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f63e4007a10 tx=0x7f63e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6602dc48738e7757 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63eaa00640 1 -- 172.21.15.144:0/3218688582 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4016e00 con 0x55c876183230 2024-09-12T12:15:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63eaa00640 1 -- 172.21.15.144:0/3218688582 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e4024070 con 0x55c876183230 2024-09-12T12:15:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63eaa00640 1 -- 172.21.15.144:0/3218688582 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e401f5e0 con 0x55c876183230 2024-09-12T12:15:57.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 -- 172.21.15.144:0/3218688582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 msgr2=0x55c8761f3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f3500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f63e4007a10 tx=0x7f63e4008040 comp rx=0 tx=0).stop 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 -- 172.21.15.144:0/3218688582 shutdown_connections 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876183b50 0x55c8761f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f3500 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 --2- 172.21.15.144:0/3218688582 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876137010 0x55c8761f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 -- 172.21.15.144:0/3218688582 >> 172.21.15.144:0/3218688582 conn(0x55c87615fbe0 msgr2=0x55c87615ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 -- 172.21.15.144:0/3218688582 shutdown_connections 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 -- 172.21.15.144:0/3218688582 wait complete. 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 -- start start 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 Processor -- start 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876137010 0x55c8761f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183b50 0x55c8761f7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c875f2ebe0 con 0x55c876183230 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc1e6080 con 0x55c876137010 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c875f07dc0 con 0x55c876183b50 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f6404f60000 10 client.0 _ll_register_callbacks cb 0x7f63ec001550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35932/0 (socket says 172.21.15.144:35932) 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 -- 172.21.15.144:0/3679723533 learned_addr learned my addr 172.21.15.144:0/3679723533 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63faa00640 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876137010 0x55c8761f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63fb400640 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183b50 0x55c8761f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 -- 172.21.15.144:0/3679723533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183b50 msgr2=0x55c8761f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183b50 0x55c8761f7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 -- 172.21.15.144:0/3679723533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876137010 msgr2=0x55c8761f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876137010 0x55c8761f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63f3e00640 1 -- 172.21.15.144:0/3679723533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c875fdbe20 con 0x55c876183230 2024-09-12T12:15:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.187+0000 7f63faa00640 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876137010 0x55c8761f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63f3e00640 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f7150 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f63e4021040 tx=0x7f63e4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ec0f42a20dd60c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 1 -- 172.21.15.144:0/3679723533 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e401fa20 con 0x55c876183230 2024-09-12T12:15:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 1 -- 172.21.15.144:0/3679723533 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f63e4016e00 con 0x55c876183230 2024-09-12T12:15:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 -- 172.21.15.144:0/3679723533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63e4024070 con 0x55c876183230 2024-09-12T12:15:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 1 -- 172.21.15.144:0/3679723533 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f63e4038050 con 0x55c876183230 2024-09-12T12:15:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 10 client.5949 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:57.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 -- 172.21.15.144:0/3679723533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55c875f1a910 con 0x55c876183230 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 1 -- 172.21.15.144:0/3679723533 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e4024070 con 0x55c876183230 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 1 -- 172.21.15.144:0/3679723533 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7f63e403b020 con 0x55c876183230 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 10 client.5949 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 10 client.5949 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 20 client.5949 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c8761b29c0 0x55c8761b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 4 client.5949 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 -- 172.21.15.144:0/3679723533 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x55c875f90280 con 0x55c8761b29c0 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63faa00640 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c8761b29c0 0x55c8761b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63faa00640 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c8761b29c0 0x55c8761b2dd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0836682c3736d1e server_cookie=8dbc8fa876071d23 in_seq=0 out_seq=0 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 10 client.5949 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 1 -- 172.21.15.144:0/3679723533 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c875f90280 con 0x55c8761b29c0 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 10 client.5949 handle_command_reply: tid=0 2024-09-12T12:15:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 client.5949 shutdown 2024-09-12T12:15:57.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 -- 172.21.15.144:0/3679723533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 msgr2=0x55c8761f7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f7150 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f63e4021040 tx=0x7f63e4004740 comp rx=0 tx=0).stop 2024-09-12T12:15:57.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 -- 172.21.15.144:0/3679723533 shutdown_connections 2024-09-12T12:15:57.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c8761b29c0 0x55c8761b2dd0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c876183b50 0x55c8761f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c876183230 0x55c8761f7150 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 --2- 172.21.15.144:0/3679723533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c876137010 0x55c8761f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 -- 172.21.15.144:0/3679723533 >> 172.21.15.144:0/3679723533 conn(0x55c87615fbe0 msgr2=0x55c8761948c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.198 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f88ea600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4b [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v451 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5356=0-4194304@1} caps={5356=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5356 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55de9f05c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a4b:[<0x10000000001/new_file_1 v451>,<0x10000000000/ceph-qa-suite v57>,<0x1/scrub_test_path v23>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-12T12:15:57.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f63dfe00640 0 client.5949 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:57.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 -- 172.21.15.144:0/3679723533 shutdown_connections 2024-09-12T12:15:57.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 1 -- 172.21.15.144:0/3679723533 wait complete. 2024-09-12T12:15:57.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6404f60000 20 client.5949 trim_cache size 0 max 16384 2024-09-12T12:15:57.199 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:57.200 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:15:57.200 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "a5d6a807-a544-450f-96a9-f0fde5fafebd", 2024-09-12T12:15:57.200 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:15:57.200 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 -- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63d80678c0 msgr2=0x7f63d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63d80678c0 0x7f63d8069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f63fc1e6fe0 tx=0x7f63ec009040 comp rx=0 tx=0).stop 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 -- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 msgr2=0x7f63fc1f2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 0x7f63fc1f2200 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f63f40ae000 tx=0x7f63f401bfb0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 -- 172.21.15.144:0/2852437238 shutdown_connections 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63d80678c0 0x7f63d8069d80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63fc15b340 0x7f63fc1f2200 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc15af60 0x7f63fc15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 --2- 172.21.15.144:0/2852437238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63fc0cd9f0 0x7f63fc1e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 -- 172.21.15.144:0/2852437238 >> 172.21.15.144:0/2852437238 conn(0x7f63fc068030 msgr2=0x7f63fc06d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 -- 172.21.15.144:0/2852437238 shutdown_connections 2024-09-12T12:15:57.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.191+0000 7f6401c00640 1 -- 172.21.15.144:0/2852437238 wait complete. 2024-09-12T12:15:57.214 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': 'a5d6a807-a544-450f-96a9-f0fde5fafebd', 'mode': 'asynchronous'}' 2024-09-12T12:15:57.214 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-12T12:15:57.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-12T12:15:57.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53e00640 1 Processor -- start 2024-09-12T12:15:57.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53e00640 1 -- start start 2024-09-12T12:15:57.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdd54156750 0x7fdd5406fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd5406fff0 0x7fdd540d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdd540d26c0 0x7fdd5415fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdd5415cbf0 con 0x7fdd540d26c0 2024-09-12T12:15:57.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdd5415ced0 con 0x7fdd54156750 2024-09-12T12:15:57.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5415d1b0 con 0x7fdd5406fff0 2024-09-12T12:15:57.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdd540d26c0 0x7fdd5415fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd52a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdd54156750 0x7fdd5406fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdd540d26c0 0x7fdd5415fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35938/0 (socket says 172.21.15.144:35938) 2024-09-12T12:15:57.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53400640 1 -- 172.21.15.144:0/2050545386 learned_addr learned my addr 172.21.15.144:0/2050545386 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd52000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd5406fff0 0x7fdd540d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53400640 1 -- 172.21.15.144:0/2050545386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd5406fff0 msgr2=0x7fdd540d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53400640 1 --2- 172.21.15.144:0/2050545386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd5406fff0 0x7fdd540d2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53400640 1 -- 172.21.15.144:0/2050545386 >> v2:172.21.15.165:3300/0 conn(0x7fdd54156750 msgr2=0x7fdd5406fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53400640 1 --2- 172.21.15.144:0/2050545386 >> v2:172.21.15.165:3300/0 conn(0x7fdd54156750 0x7fdd5406fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd53400640 1 -- 172.21.15.144:0/2050545386 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5415d490 con 0x7fdd540d26c0 2024-09-12T12:15:57.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.351+0000 7fdd52a00640 1 --2- 172.21.15.144:0/2050545386 >> v2:172.21.15.165:3300/0 conn(0x7fdd54156750 0x7fdd5406fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:57.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53400640 1 --2- 172.21.15.144:0/2050545386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd540d26c0 0x7fdd5415fe90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdd5415d0e0 tx=0x7fdd4c01c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcd072b5bf22701 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd51600640 1 -- 172.21.15.144:0/2050545386 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0b0070 con 0x7fdd540d26c0 2024-09-12T12:15:57.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd51600640 1 -- 172.21.15.144:0/2050545386 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4c0ab600 con 0x7fdd540d26c0 2024-09-12T12:15:57.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd51600640 1 -- 172.21.15.144:0/2050545386 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0ab9d0 con 0x7fdd540d26c0 2024-09-12T12:15:57.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53e00640 1 -- 172.21.15.144:0/2050545386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd540d26c0 msgr2=0x7fdd5415fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53e00640 1 --2- 172.21.15.144:0/2050545386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd540d26c0 0x7fdd5415fe90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdd5415d0e0 tx=0x7fdd4c01c1d0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53e00640 1 -- 172.21.15.144:0/2050545386 shutdown_connections 2024-09-12T12:15:57.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53e00640 1 --2- 172.21.15.144:0/2050545386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd540d26c0 0x7fdd5415fe90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53e00640 1 --2- 172.21.15.144:0/2050545386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd5406fff0 0x7fdd540d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53e00640 1 --2- 172.21.15.144:0/2050545386 >> v2:172.21.15.165:3300/0 conn(0x7fdd54156750 0x7fdd5406fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53e00640 1 -- 172.21.15.144:0/2050545386 >> 172.21.15.144:0/2050545386 conn(0x7fdd54067a00 msgr2=0x7fdd54067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53e00640 1 -- 172.21.15.144:0/2050545386 shutdown_connections 2024-09-12T12:15:57.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.355+0000 7fdd53e00640 1 -- 172.21.15.144:0/2050545386 wait complete. 2024-09-12T12:15:57.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 Processor -- start 2024-09-12T12:15:57.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 -- start start 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd5406fff0 0x7fdd54143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd540d26c0 0x7fdd541507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54156750 0x7fdd5415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd54156b30 con 0x7fdd54156750 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5415c8a0 con 0x7fdd5406fff0 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd54156cb0 con 0x7fdd540d26c0 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54156750 0x7fdd5415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54156750 0x7fdd5415b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35952/0 (socket says 172.21.15.144:35952) 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53400640 1 -- 172.21.15.144:0/1712087378 learned_addr learned my addr 172.21.15.144:0/1712087378 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd52000640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd540d26c0 0x7fdd541507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53400640 1 -- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd540d26c0 msgr2=0x7fdd541507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd52a00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd5406fff0 0x7fdd54143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53400640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd540d26c0 0x7fdd541507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53400640 1 -- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd5406fff0 msgr2=0x7fdd54143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53400640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd5406fff0 0x7fdd54143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53400640 1 -- 172.21.15.144:0/1712087378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd540b58d0 con 0x7fdd54156750 2024-09-12T12:15:57.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd52000640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd540d26c0 0x7fdd541507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:57.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd52a00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd5406fff0 0x7fdd54143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:57.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53400640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54156750 0x7fdd5415b2a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0ae040 tx=0x7fdd4c018f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd4b400640 1 -- 172.21.15.144:0/1712087378 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0b0040 con 0x7fdd54156750 2024-09-12T12:15:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd4b400640 1 -- 172.21.15.144:0/1712087378 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4c0b4420 con 0x7fdd54156750 2024-09-12T12:15:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 -- 172.21.15.144:0/1712087378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd540b5bb0 con 0x7fdd54156750 2024-09-12T12:15:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd4b400640 1 -- 172.21.15.144:0/1712087378 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0b47f0 con 0x7fdd54156750 2024-09-12T12:15:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.359+0000 7fdd53e00640 1 -- 172.21.15.144:0/1712087378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd540b6170 con 0x7fdd54156750 2024-09-12T12:15:57.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd4b400640 1 -- 172.21.15.144:0/1712087378 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd4c0b4990 con 0x7fdd54156750 2024-09-12T12:15:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd4b400640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd340678c0 0x7fdd34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd4b400640 1 -- 172.21.15.144:0/1712087378 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fdd4c11f990 con 0x7fdd54156750 2024-09-12T12:15:57.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52a00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd340678c0 0x7fdd34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd5d27d000 1 Processor -- start 2024-09-12T12:15:57.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd5d27d000 1 -- start start 2024-09-12T12:15:57.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52a00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd340678c0 0x7fdd34069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdd440074d0 tx=0x7fdd4400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d1db150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d18e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 0x55bc6d18f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc6d078960 con 0x55bc6d1db690 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55bc6cfbc900 con 0x55bc6d1dad70 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55bc6cfdfd40 con 0x55bc6d18edb0 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d18e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d18e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35956/0 (socket says 172.21.15.144:35956) 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52000640 1 -- 172.21.15.144:0/3529229700 learned_addr learned my addr 172.21.15.144:0/3529229700 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52a00640 1 --2- 172.21.15.144:0/3529229700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d1db150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd53400640 1 --2- 172.21.15.144:0/3529229700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 0x55bc6d18f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52000640 1 -- 172.21.15.144:0/3529229700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 msgr2=0x55bc6d18f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52000640 1 --2- 172.21.15.144:0/3529229700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 0x55bc6d18f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52000640 1 -- 172.21.15.144:0/3529229700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 msgr2=0x55bc6d1db150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52000640 1 --2- 172.21.15.144:0/3529229700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d1db150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.363+0000 7fdd52000640 1 -- 172.21.15.144:0/3529229700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc6cf86580 con 0x55bc6d1db690 2024-09-12T12:15:57.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52000640 1 --2- 172.21.15.144:0/3529229700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d18e870 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009a00 tx=0x7fdd40009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804d148487ca0af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd3fe00640 1 -- 172.21.15.144:0/3529229700 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40018070 con 0x55bc6d1db690 2024-09-12T12:15:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd3fe00640 1 -- 172.21.15.144:0/3529229700 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd40010c80 con 0x55bc6d1db690 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd3fe00640 1 -- 172.21.15.144:0/3529229700 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000f040 con 0x55bc6d1db690 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3529229700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 msgr2=0x55bc6d18e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/3529229700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d18e870 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009a00 tx=0x7fdd40009190 comp rx=0 tx=0).stop 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3529229700 shutdown_connections 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/3529229700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 0x55bc6d18f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/3529229700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d18e870 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/3529229700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d1db150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3529229700 >> 172.21.15.144:0/3529229700 conn(0x55bc6d1bc040 msgr2=0x55bc6d1be430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3529229700 shutdown_connections 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3529229700 wait complete. 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 -- start start 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 Processor -- start 2024-09-12T12:15:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1e1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1dad70 0x55bc6d1e2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1db690 0x55bc6d1e2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc6cfdbd00 con 0x55bc6d18edb0 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55bc6cf9aaa0 con 0x55bc6d1db690 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55bc6cf79340 con 0x55bc6d1dad70 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd5d27d000 10 client.0 _ll_register_callbacks cb 0x55bc6d17c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1e1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1e1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35968/0 (socket says 172.21.15.144:35968) 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52a00640 1 -- 172.21.15.144:0/2795947464 learned_addr learned my addr 172.21.15.144:0/2795947464 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52000640 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1dad70 0x55bc6d1e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd53400640 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1db690 0x55bc6d1e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52a00640 1 -- 172.21.15.144:0/2795947464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1dad70 msgr2=0x55bc6d1e2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52a00640 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1dad70 0x55bc6d1e2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52a00640 1 -- 172.21.15.144:0/2795947464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1db690 msgr2=0x55bc6d1e2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52a00640 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1db690 0x55bc6d1e2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52a00640 1 -- 172.21.15.144:0/2795947464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc6cf82dc0 con 0x55bc6d18edb0 2024-09-12T12:15:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd52a00640 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1e1ce0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdd44016cc0 tx=0x7fdd44004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92627812b420ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.367+0000 7fdd3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd3cc00640 1 -- 172.21.15.144:0/2795947464 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440223f0 con 0x55bc6d18edb0 2024-09-12T12:15:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd3cc00640 1 -- 172.21.15.144:0/2795947464 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fdd44022590 con 0x55bc6d18edb0 2024-09-12T12:15:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 -- 172.21.15.144:0/2795947464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd40010c80 con 0x55bc6d18edb0 2024-09-12T12:15:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd3cc00640 1 -- 172.21.15.144:0/2795947464 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdd4402f050 con 0x55bc6d18edb0 2024-09-12T12:15:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 10 client.5961 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 -- 172.21.15.144:0/2795947464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55bc6cf7f7f0 con 0x55bc6d18edb0 2024-09-12T12:15:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd3cc00640 1 -- 172.21.15.144:0/2795947464 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd40010c80 con 0x55bc6d18edb0 2024-09-12T12:15:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd3cc00640 1 -- 172.21.15.144:0/2795947464 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdd44032020 con 0x55bc6d18edb0 2024-09-12T12:15:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 10 client.5961 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 10 client.5961 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 20 client.5961 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55bc6d1ea0b0 0x55bc6d1ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 4 client.5961 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 -- 172.21.15.144:0/2795947464 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc6cf79e10 con 0x55bc6d1ea0b0 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd52000640 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55bc6d1ea0b0 0x55bc6d1ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd52000640 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55bc6d1ea0b0 0x55bc6d1ec4a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeebf6dc4f8bf873 server_cookie=746a278578ea7cbf in_seq=0 out_seq=0 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd3cc00640 10 client.5961 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd3cc00640 1 -- 172.21.15.144:0/2795947464 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc6cf79e10 con 0x55bc6d1ea0b0 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd3cc00640 10 client.5961 handle_command_reply: tid=0 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 client.5961 shutdown 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 -- 172.21.15.144:0/2795947464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 msgr2=0x55bc6d1e1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1e1ce0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdd44016cc0 tx=0x7fdd44004a50 comp rx=0 tx=0).stop 2024-09-12T12:15:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 -- 172.21.15.144:0/2795947464 shutdown_connections 2024-09-12T12:15:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55bc6d1ea0b0 0x55bc6d1ec4a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1db690 0x55bc6d1e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1dad70 0x55bc6d1e2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/2795947464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1e1ce0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd3cc00640 0 client.5961 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 -- 172.21.15.144:0/2795947464 >> 172.21.15.144:0/2795947464 conn(0x55bc6d1bc040 msgr2=0x55bc6d18df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 -- 172.21.15.144:0/2795947464 shutdown_connections 2024-09-12T12:15:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 1 -- 172.21.15.144:0/2795947464 wait complete. 2024-09-12T12:15:57.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.371+0000 7fdd5d27d000 20 client.5961 trim_cache size 0 max 16384 2024-09-12T12:15:57.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 Processor -- start 2024-09-12T12:15:57.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- start start 2024-09-12T12:15:57.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1efd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d196c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1db690 0x55bc6d197140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd54203f90 con 0x55bc6d18edb0 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd54203000 con 0x55bc6d1dad70 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5406db20 con 0x55bc6d1db690 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1efd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35982/0 (socket says 172.21.15.144:35982) 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52a00640 1 -- 172.21.15.144:0/3908533732 learned_addr learned my addr 172.21.15.144:0/3908533732 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52000640 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d196c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd53400640 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1db690 0x55bc6d197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52a00640 1 -- 172.21.15.144:0/3908533732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1db690 msgr2=0x55bc6d197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52a00640 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1db690 0x55bc6d197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52a00640 1 -- 172.21.15.144:0/3908533732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 msgr2=0x55bc6d196c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52a00640 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d196c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52a00640 1 -- 172.21.15.144:0/3908533732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc6cf9d470 con 0x55bc6d18edb0 2024-09-12T12:15:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd53400640 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1db690 0x55bc6d197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd52a00640 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1efd10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdd44007e60 tx=0x7fdd44021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172a98847e5c3d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd3f400640 1 -- 172.21.15.144:0/3908533732 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44022d30 con 0x55bc6d18edb0 2024-09-12T12:15:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd3f400640 1 -- 172.21.15.144:0/3908533732 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd44027070 con 0x55bc6d18edb0 2024-09-12T12:15:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd3f400640 1 -- 172.21.15.144:0/3908533732 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440225f0 con 0x55bc6d18edb0 2024-09-12T12:15:57.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3908533732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 msgr2=0x55bc6d1efd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1efd10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fdd44007e60 tx=0x7fdd44021000 comp rx=0 tx=0).stop 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3908533732 shutdown_connections 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d1db690 0x55bc6d197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d196c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/3908533732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d18edb0 0x55bc6d1efd10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3908533732 >> 172.21.15.144:0/3908533732 conn(0x55bc6d1bc040 msgr2=0x55bc6d1e7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3908533732 shutdown_connections 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- 172.21.15.144:0/3908533732 wait complete. 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 -- start start 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.391+0000 7fdd5d27d000 1 Processor -- start 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 0x55bc6d1ef330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d24a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d24ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc6d17c690 con 0x55bc6d1db690 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd540b76e0 con 0x55bc6d1dad70 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55bc6cfedfd0 con 0x55bc6d18edb0 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 10 client.0 _ll_register_callbacks cb 0x7fdd44016420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d24ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d24ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35994/0 (socket says 172.21.15.144:35994) 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd53400640 1 -- 172.21.15.144:0/1168093289 learned_addr learned my addr 172.21.15.144:0/1168093289 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd52000640 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d24a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd52a00640 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 0x55bc6d1ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd53400640 1 -- 172.21.15.144:0/1168093289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 msgr2=0x55bc6d1ef330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd53400640 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 0x55bc6d1ef330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd53400640 1 -- 172.21.15.144:0/1168093289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 msgr2=0x55bc6d24a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd53400640 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d24a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd53400640 1 -- 172.21.15.144:0/1168093289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc6cf73640 con 0x55bc6d1db690 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd52a00640 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 0x55bc6d1ef330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd53400640 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d24ace0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0ec120 tx=0x7fdd4c0f4070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1674e1a5cd4184ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 1 -- 172.21.15.144:0/1168093289 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0fd060 con 0x55bc6d1db690 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 1 -- 172.21.15.144:0/1168093289 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fdd4c0f8610 con 0x55bc6d1db690 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- 172.21.15.144:0/1168093289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd44027070 con 0x55bc6d1db690 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 1 -- 172.21.15.144:0/1168093289 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdd4c103050 con 0x55bc6d1db690 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 10 client.5967 fetch_fsmap learned FSMap version 27 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- 172.21.15.144:0/1168093289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55bc6cf773b0 con 0x55bc6d1db690 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 1 -- 172.21.15.144:0/1168093289 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd44027070 con 0x55bc6d1db690 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 1 -- 172.21.15.144:0/1168093289 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fdd4c0ef110 con 0x55bc6d1db690 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 10 client.5967 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:15:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 10 client.5967 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 20 client.5967 populate_metadata read hostname 'smithi144' 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55bc6d24b220 0x55bc6d24b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 4 client.5967 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- 172.21.15.144:0/1168093289 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bc6cfed470 con 0x55bc6d24b220 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd52a00640 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55bc6d24b220 0x55bc6d24b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd52a00640 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55bc6d24b220 0x55bc6d24b600 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a28d54db4f55181 server_cookie=2f37e798c1acaf50 in_seq=0 out_seq=0 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 10 client.5967 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 1 -- 172.21.15.144:0/1168093289 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x55bc6cfed470 con 0x55bc6d24b220 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 10 client.5967 handle_command_reply: tid=0 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 client.5967 shutdown 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- 172.21.15.144:0/1168093289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 msgr2=0x55bc6d24ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d24ace0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0ec120 tx=0x7fdd4c0f4070 comp rx=0 tx=0).stop 2024-09-12T12:15:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- 172.21.15.144:0/1168093289 shutdown_connections 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55bc6d24b220 0x55bc6d24b600 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc6d1db690 0x55bc6d24ace0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc6d1dad70 0x55bc6d24a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 --2- 172.21.15.144:0/1168093289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc6d18edb0 0x55bc6d1ef330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd3cc00640 0 client.5967 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- 172.21.15.144:0/1168093289 >> 172.21.15.144:0/1168093289 conn(0x55bc6d1bc040 msgr2=0x55bc6d1e82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- 172.21.15.144:0/1168093289 shutdown_connections 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 1 -- 172.21.15.144:0/1168093289 wait complete. 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.395+0000 7fdd5d27d000 20 client.5967 trim_cache size 0 max 16384 2024-09-12T12:15:57.404 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "8215f758-915f-48a6-af62-d9ca6da9598e": { 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "8215f758-915f-48a6-af62-d9ca6da9598e", 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "" 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "a5d6a807-a544-450f-96a9-f0fde5fafebd": { 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "a5d6a807-a544-450f-96a9-f0fde5fafebd", 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "" 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:57.405 INFO:teuthology.orchestra.run.smithi144.stdout: "d7c1ef35-77b0-4a57-b0ff-e947c76d1730": { 2024-09-12T12:15:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-12T12:15:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "d7c1ef35-77b0-4a57-b0ff-e947c76d1730", 2024-09-12T12:15:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "" 2024-09-12T12:15:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:15:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "f4f42f27-1e58-4cb2-9b98-85e8aba84009": { 2024-09-12T12:15:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-12T12:15:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "f4f42f27-1e58-4cb2-9b98-85e8aba84009", 2024-09-12T12:15:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "" 2024-09-12T12:15:57.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:57.407 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:15:57.407 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:15:57.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 -- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd340678c0 msgr2=0x7fdd34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd340678c0 0x7fdd34069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdd440074d0 tx=0x7fdd4400b040 comp rx=0 tx=0).stop 2024-09-12T12:15:57.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 -- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54156750 msgr2=0x7fdd5415b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54156750 0x7fdd5415b2a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c0ae040 tx=0x7fdd4c018f70 comp rx=0 tx=0).stop 2024-09-12T12:15:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 -- 172.21.15.144:0/1712087378 shutdown_connections 2024-09-12T12:15:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd340678c0 0x7fdd34069d80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd54156750 0x7fdd5415b2a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd540d26c0 0x7fdd541507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 --2- 172.21.15.144:0/1712087378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd5406fff0 0x7fdd54143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 -- 172.21.15.144:0/1712087378 >> 172.21.15.144:0/1712087378 conn(0x7fdd54067a00 msgr2=0x7fdd54073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 -- 172.21.15.144:0/1712087378 shutdown_connections 2024-09-12T12:15:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:15:57.399+0000 7fdd53e00640 1 -- 172.21.15.144:0/1712087378 wait complete. 2024-09-12T12:16:02.168 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:16:02.167+0000 7fac71e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-12T12:16:02.419 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-12T12:16:02.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-12T12:16:02.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b89400640 1 Processor -- start 2024-09-12T12:16:02.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b89400640 1 -- start start 2024-09-12T12:16:02.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b89400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840b1c70 0x7f8b8406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b89400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8b8406e9e0 0x7f8b84070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b89400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b840730b0 con 0x7f8b840d1710 2024-09-12T12:16:02.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b89400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8b84073390 con 0x7f8b8406e9e0 2024-09-12T12:16:02.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b89400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b84073670 con 0x7f8b840b1c70 2024-09-12T12:16:02.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b83200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8b8406e9e0 0x7f8b84070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b81e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840b1c70 0x7f8b8406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b83200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8b8406e9e0 0x7f8b84070810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:55680/0 (socket says 172.21.15.144:55680) 2024-09-12T12:16:02.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b83200640 1 -- 172.21.15.144:0/499591283 learned_addr learned my addr 172.21.15.144:0/499591283 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b81e00640 1 -- 172.21.15.144:0/499591283 >> v2:172.21.15.165:3300/0 conn(0x7f8b8406e9e0 msgr2=0x7f8b84070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b81e00640 1 --2- 172.21.15.144:0/499591283 >> v2:172.21.15.165:3300/0 conn(0x7f8b8406e9e0 0x7f8b84070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b81e00640 1 -- 172.21.15.144:0/499591283 >> v1:172.21.15.165:6789/0 conn(0x7f8b840d1710 legacy=0x7f8b840d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b81e00640 1 -- 172.21.15.144:0/499591283 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b84073950 con 0x7f8b840b1c70 2024-09-12T12:16:02.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.567+0000 7f8b83200640 1 --2- 172.21.15.144:0/499591283 >> v2:172.21.15.165:3300/0 conn(0x7f8b8406e9e0 0x7f8b84070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:02.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b81e00640 1 --2- 172.21.15.144:0/499591283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840b1c70 0x7f8b8406e4a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b700097c0 tx=0x7f8b7001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0277f9aa1b9b40a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b81400640 1 -- 172.21.15.144:0/499591283 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700ab600 con 0x7f8b840b1c70 2024-09-12T12:16:02.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b81400640 1 -- 172.21.15.144:0/499591283 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700b0070 con 0x7f8b840b1c70 2024-09-12T12:16:02.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b81400640 1 -- 172.21.15.144:0/499591283 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700ab9c0 con 0x7f8b840b1c70 2024-09-12T12:16:02.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b89400640 1 -- 172.21.15.144:0/499591283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840b1c70 msgr2=0x7f8b8406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b89400640 1 --2- 172.21.15.144:0/499591283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840b1c70 0x7f8b8406e4a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b700097c0 tx=0x7f8b7001c3e0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b89400640 1 -- 172.21.15.144:0/499591283 shutdown_connections 2024-09-12T12:16:02.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b89400640 1 --2- 172.21.15.144:0/499591283 >> v2:172.21.15.165:3300/0 conn(0x7f8b8406e9e0 0x7f8b84070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b89400640 1 --2- 172.21.15.144:0/499591283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840b1c70 0x7f8b8406e4a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b89400640 1 -- 172.21.15.144:0/499591283 >> 172.21.15.144:0/499591283 conn(0x7f8b840d2400 msgr2=0x7f8b840d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b89400640 1 -- 172.21.15.144:0/499591283 shutdown_connections 2024-09-12T12:16:02.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.571+0000 7f8b89400640 1 -- 172.21.15.144:0/499591283 wait complete. 2024-09-12T12:16:02.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 Processor -- start 2024-09-12T12:16:02.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 -- start start 2024-09-12T12:16:02.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b8406e9e0 0x7f8b84142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840d1710 0x7f8b8406f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b8415a070 0x7f8b8406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8416b650 con 0x7f8b8415a070 2024-09-12T12:16:02.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8416b4d0 con 0x7f8b8406e9e0 2024-09-12T12:16:02.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8416b7d0 con 0x7f8b840d1710 2024-09-12T12:16:02.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b82800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b8406e9e0 0x7f8b84142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b81e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840d1710 0x7f8b8406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b83200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b8415a070 0x7f8b8406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b81e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840d1710 0x7f8b8406f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:58852/0 (socket says 172.21.15.144:58852) 2024-09-12T12:16:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b81e00640 1 -- 172.21.15.144:0/145616086 learned_addr learned my addr 172.21.15.144:0/145616086 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b82800640 1 -- 172.21.15.144:0/145616086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840d1710 msgr2=0x7f8b8406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b82800640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840d1710 0x7f8b8406f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b82800640 1 -- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b8415a070 msgr2=0x7f8b8406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b82800640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b8415a070 0x7f8b8406fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b82800640 1 -- 172.21.15.144:0/145616086 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b84159910 con 0x7f8b8406e9e0 2024-09-12T12:16:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b83200640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b8415a070 0x7f8b8406fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:02.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b82800640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b8406e9e0 0x7f8b84142e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c3c0 tx=0x7f8b7400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b7aa00640 1 -- 172.21.15.144:0/145616086 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74017070 con 0x7f8b8406e9e0 2024-09-12T12:16:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b7aa00640 1 -- 172.21.15.144:0/145616086 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b740052d0 con 0x7f8b8406e9e0 2024-09-12T12:16:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 -- 172.21.15.144:0/145616086 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b84159bf0 con 0x7f8b8406e9e0 2024-09-12T12:16:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b7aa00640 1 -- 172.21.15.144:0/145616086 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74003840 con 0x7f8b8406e9e0 2024-09-12T12:16:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.575+0000 7f8b89400640 1 -- 172.21.15.144:0/145616086 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b84154650 con 0x7f8b8406e9e0 2024-09-12T12:16:02.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.579+0000 7f8b7aa00640 1 -- 172.21.15.144:0/145616086 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b7401a070 con 0x7f8b8406e9e0 2024-09-12T12:16:02.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.579+0000 7f8b7aa00640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b640678f0 0x7f8b64069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.579+0000 7f8b7aa00640 1 -- 172.21.15.144:0/145616086 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f8b74084fe0 con 0x7f8b8406e9e0 2024-09-12T12:16:02.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.579+0000 7f8b81e00640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b640678f0 0x7f8b64069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.579+0000 7f8b8c841000 1 Processor -- start 2024-09-12T12:16:02.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.579+0000 7f8b8c841000 1 -- start start 2024-09-12T12:16:02.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.579+0000 7f8b81e00640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b640678f0 0x7f8b64069db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8b7001c420 tx=0x7f8b700a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 0x55aba638b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba633e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba633f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55aba6228960 con 0x55aba638b690 2024-09-12T12:16:02.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aba616c900 con 0x55aba638ad70 2024-09-12T12:16:02.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55aba618fd40 con 0x55aba633edb0 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b81e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba633e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b81e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba633e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36010/0 (socket says 172.21.15.144:36010) 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b81e00640 1 -- 172.21.15.144:0/3611941868 learned_addr learned my addr 172.21.15.144:0/3611941868 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b82800640 1 --2- 172.21.15.144:0/3611941868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 0x55aba638b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b83200640 1 --2- 172.21.15.144:0/3611941868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba633f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b81e00640 1 -- 172.21.15.144:0/3611941868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 msgr2=0x55aba633f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b81e00640 1 --2- 172.21.15.144:0/3611941868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba633f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b81e00640 1 -- 172.21.15.144:0/3611941868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 msgr2=0x55aba638b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b81e00640 1 --2- 172.21.15.144:0/3611941868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 0x55aba638b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b81e00640 1 -- 172.21.15.144:0/3611941868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba6136580 con 0x55aba638b690 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b81e00640 1 --2- 172.21.15.144:0/3611941868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba633e870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009580 tx=0x7f8b70004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd5deda84de99be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b6f400640 1 -- 172.21.15.144:0/3611941868 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700bc070 con 0x55aba638b690 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b6f400640 1 -- 172.21.15.144:0/3611941868 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700b0040 con 0x55aba638b690 2024-09-12T12:16:02.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b6f400640 1 -- 172.21.15.144:0/3611941868 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700abe10 con 0x55aba638b690 2024-09-12T12:16:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 -- 172.21.15.144:0/3611941868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 msgr2=0x55aba633e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3611941868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba633e870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009580 tx=0x7f8b70004740 comp rx=0 tx=0).stop 2024-09-12T12:16:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 -- 172.21.15.144:0/3611941868 shutdown_connections 2024-09-12T12:16:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3611941868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba633f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3611941868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba633e870 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3611941868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 0x55aba638b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 -- 172.21.15.144:0/3611941868 >> 172.21.15.144:0/3611941868 conn(0x55aba636c040 msgr2=0x55aba636e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 -- 172.21.15.144:0/3611941868 shutdown_connections 2024-09-12T12:16:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 -- 172.21.15.144:0/3611941868 wait complete. 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 -- start start 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.583+0000 7f8b8c841000 1 Processor -- start 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba6346510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 0x55aba6346a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba636c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55aba618bd00 con 0x55aba638b690 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aba614aaa0 con 0x55aba638ad70 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55aba6129340 con 0x55aba633edb0 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 10 client.0 _ll_register_callbacks cb 0x55aba632c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b83200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba636c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b83200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba636c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36016/0 (socket says 172.21.15.144:36016) 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b83200640 1 -- 172.21.15.144:0/3405458830 learned_addr learned my addr 172.21.15.144:0/3405458830 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b82800640 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba6346510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b81e00640 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 0x55aba6346a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b83200640 1 -- 172.21.15.144:0/3405458830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 msgr2=0x55aba6346510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b83200640 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba6346510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b83200640 1 -- 172.21.15.144:0/3405458830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 msgr2=0x55aba6346a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b83200640 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 0x55aba6346a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b83200640 1 -- 172.21.15.144:0/3405458830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba6132dc0 con 0x55aba638b690 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b83200640 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba636c420 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c004690 tx=0x7f8b7c00e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed538d165b5f1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 1 -- 172.21.15.144:0/3405458830 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c01e400 con 0x55aba638b690 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 -- 172.21.15.144:0/3405458830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b700b0040 con 0x55aba638b690 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 1 -- 172.21.15.144:0/3405458830 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f8b7c01e5a0 con 0x55aba638b690 2024-09-12T12:16:02.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 1 -- 172.21.15.144:0/3405458830 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b7c01e7a0 con 0x55aba638b690 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 10 client.5976 fetch_fsmap learned FSMap version 29 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 -- 172.21.15.144:0/3405458830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55aba612f7f0 con 0x55aba638b690 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 1 -- 172.21.15.144:0/3405458830 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700b0040 con 0x55aba638b690 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 1 -- 172.21.15.144:0/3405458830 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f8b7c029080 con 0x55aba638b690 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 10 client.5976 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 10 client.5976 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 20 client.5976 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55aba636ce30 0x55aba639c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 4 client.5976 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 -- 172.21.15.144:0/3405458830 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aba6129e10 con 0x55aba636ce30 2024-09-12T12:16:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b82800640 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55aba636ce30 0x55aba639c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b82800640 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55aba636ce30 0x55aba639c020 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c81267194033ae9 server_cookie=5866a27e92d31557 in_seq=0 out_seq=0 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 10 client.5976 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 1 -- 172.21.15.144:0/3405458830 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aba6129e10 con 0x55aba636ce30 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 10 client.5976 handle_command_reply: tid=0 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 client.5976 shutdown 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 -- 172.21.15.144:0/3405458830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 msgr2=0x55aba636c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba636c420 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c004690 tx=0x7f8b7c00e8c0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 -- 172.21.15.144:0/3405458830 shutdown_connections 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55aba636ce30 0x55aba639c020 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638b690 0x55aba636c420 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638ad70 0x55aba6346a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b63e00640 0 client.5976 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 --2- 172.21.15.144:0/3405458830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba6346510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.587+0000 7f8b8c841000 1 -- 172.21.15.144:0/3405458830 >> 172.21.15.144:0/3405458830 conn(0x55aba636c040 msgr2=0x55aba633df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.591+0000 7f8b8c841000 1 -- 172.21.15.144:0/3405458830 shutdown_connections 2024-09-12T12:16:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.591+0000 7f8b8c841000 1 -- 172.21.15.144:0/3405458830 wait complete. 2024-09-12T12:16:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.591+0000 7f8b8c841000 20 client.5976 trim_cache size 0 max 16384 2024-09-12T12:16:02.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b8c841000 1 Processor -- start 2024-09-12T12:16:02.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b8c841000 1 -- start start 2024-09-12T12:16:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba636b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638ad70 0x55aba638a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 0x55aba638a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b8c841000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84204670 con 0x55aba638ad70 2024-09-12T12:16:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b8c841000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8b842036d0 con 0x55aba638b690 2024-09-12T12:16:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b8c841000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b841519c0 con 0x55aba633edb0 2024-09-12T12:16:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b81e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638ad70 0x55aba638a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b81e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638ad70 0x55aba638a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36028/0 (socket says 172.21.15.144:36028) 2024-09-12T12:16:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b81e00640 1 -- 172.21.15.144:0/423601715 learned_addr learned my addr 172.21.15.144:0/423601715 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b82800640 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba636b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b81e00640 1 -- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 msgr2=0x55aba636b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b81e00640 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba636b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b81e00640 1 -- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 msgr2=0x55aba638a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b83200640 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 0x55aba638a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b81e00640 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 0x55aba638a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b81e00640 1 -- 172.21.15.144:0/423601715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba614d470 con 0x55aba638ad70 2024-09-12T12:16:02.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b82800640 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba636b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:02.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b83200640 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 0x55aba638a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:02.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b81e00640 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638ad70 0x55aba638a220 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8b70006cf0 tx=0x7f8b700b8070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f91a60b2814510c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b6ea00640 1 -- 172.21.15.144:0/423601715 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700d4070 con 0x55aba638ad70 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b6ea00640 1 -- 172.21.15.144:0/423601715 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700b0040 con 0x55aba638ad70 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.607+0000 7f8b6ea00640 1 -- 172.21.15.144:0/423601715 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700bc040 con 0x55aba638ad70 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- 172.21.15.144:0/423601715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638ad70 msgr2=0x55aba638a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638ad70 0x55aba638a220 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8b70006cf0 tx=0x7f8b700b8070 comp rx=0 tx=0).stop 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- 172.21.15.144:0/423601715 shutdown_connections 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 0x55aba638a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba638ad70 0x55aba638a220 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 --2- 172.21.15.144:0/423601715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba633edb0 0x55aba636b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- 172.21.15.144:0/423601715 >> 172.21.15.144:0/423601715 conn(0x55aba636c040 msgr2=0x55aba6389b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- 172.21.15.144:0/423601715 shutdown_connections 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- 172.21.15.144:0/423601715 wait complete. 2024-09-12T12:16:02.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- start start 2024-09-12T12:16:02.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 Processor -- start 2024-09-12T12:16:02.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba633edb0 0x55aba639e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba638ad70 0x55aba63fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 0x55aba63fad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55aba6145ac0 con 0x55aba633edb0 2024-09-12T12:16:02.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aba618bd00 con 0x55aba638b690 2024-09-12T12:16:02.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55aba619dfd0 con 0x55aba638ad70 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 10 client.0 _ll_register_callbacks cb 0x7f8b7c004270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b82800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba633edb0 0x55aba639e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b82800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba633edb0 0x55aba639e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36044/0 (socket says 172.21.15.144:36044) 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b82800640 1 -- 172.21.15.144:0/854854342 learned_addr learned my addr 172.21.15.144:0/854854342 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b81e00640 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba638ad70 0x55aba63fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b83200640 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 0x55aba63fad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b82800640 1 -- 172.21.15.144:0/854854342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba638ad70 msgr2=0x55aba63fa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b82800640 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba638ad70 0x55aba63fa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b82800640 1 -- 172.21.15.144:0/854854342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 msgr2=0x55aba63fad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b82800640 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 0x55aba63fad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b82800640 1 -- 172.21.15.144:0/854854342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba6123640 con 0x55aba633edb0 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b82800640 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba633edb0 0x55aba639e5a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400cd80 tx=0x7f8b74005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03a4ead47214f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b63e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:02.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b63e00640 1 -- 172.21.15.144:0/854854342 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7405dec0 con 0x55aba633edb0 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b63e00640 1 -- 172.21.15.144:0/854854342 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f8b7406d1d0 con 0x55aba633edb0 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- 172.21.15.144:0/854854342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b700b0040 con 0x55aba633edb0 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b63e00640 1 -- 172.21.15.144:0/854854342 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b74083050 con 0x55aba633edb0 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 10 client.5982 fetch_fsmap learned FSMap version 29 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- 172.21.15.144:0/854854342 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55aba61273b0 con 0x55aba633edb0 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b63e00640 1 -- 172.21.15.144:0/854854342 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b700b0040 con 0x55aba633edb0 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b63e00640 1 -- 172.21.15.144:0/854854342 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f8b74051a00 con 0x55aba633edb0 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 10 client.5982 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 10 client.5982 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 20 client.5982 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55aba639eae0 0x55aba63fb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 4 client.5982 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:16:02.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.611+0000 7f8b8c841000 1 -- 172.21.15.144:0/854854342 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aba619d470 con 0x55aba639eae0 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b81e00640 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55aba639eae0 0x55aba63fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b81e00640 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55aba639eae0 0x55aba63fb270 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7317ac79621bc5ec server_cookie=80d568e5725fd0e3 in_seq=0 out_seq=0 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b63e00640 10 client.5982 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b63e00640 1 -- 172.21.15.144:0/854854342 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55aba619d470 con 0x55aba639eae0 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b63e00640 10 client.5982 handle_command_reply: tid=0 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 client.5982 shutdown 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 -- 172.21.15.144:0/854854342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba633edb0 msgr2=0x55aba639e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba633edb0 0x55aba639e5a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400cd80 tx=0x7f8b74005550 comp rx=0 tx=0).stop 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 -- 172.21.15.144:0/854854342 shutdown_connections 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55aba639eae0 0x55aba63fb270 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aba638b690 0x55aba63fad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aba638ad70 0x55aba63fa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b63e00640 0 client.5982 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:02.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 --2- 172.21.15.144:0/854854342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aba633edb0 0x55aba639e5a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 -- 172.21.15.144:0/854854342 >> 172.21.15.144:0/854854342 conn(0x55aba636c040 msgr2=0x55aba638a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 -- 172.21.15.144:0/854854342 shutdown_connections 2024-09-12T12:16:02.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 1 -- 172.21.15.144:0/854854342 wait complete. 2024-09-12T12:16:02.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b8c841000 20 client.5982 trim_cache size 0 max 16384 2024-09-12T12:16:02.622 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:16:02.622 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "no active scrubs running", 2024-09-12T12:16:02.622 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:16:02.622 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:16:02.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 -- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b640678f0 msgr2=0x7f8b64069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b640678f0 0x7f8b64069db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8b7001c420 tx=0x7f8b700a7000 comp rx=0 tx=0).stop 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 -- 172.21.15.144:0/145616086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b8406e9e0 msgr2=0x7f8b84142e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b8406e9e0 0x7f8b84142e00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c3c0 tx=0x7f8b7400c880 comp rx=0 tx=0).stop 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 -- 172.21.15.144:0/145616086 shutdown_connections 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b640678f0 0x7f8b64069db0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b8415a070 0x7f8b8406fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b840d1710 0x7f8b8406f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 --2- 172.21.15.144:0/145616086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b8406e9e0 0x7f8b84142e00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 -- 172.21.15.144:0/145616086 >> 172.21.15.144:0/145616086 conn(0x7f8b840d2400 msgr2=0x7f8b841526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 -- 172.21.15.144:0/145616086 shutdown_connections 2024-09-12T12:16:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.615+0000 7f8b89400640 1 -- 172.21.15.144:0/145616086 wait complete. 2024-09-12T12:16:02.636 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:16:02.637 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-12T12:16:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.771+0000 7f2146000640 1 Processor -- start 2024-09-12T12:16:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.771+0000 7f2146000640 1 -- start start 2024-09-12T12:16:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f2146000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f214015c2e0 0x7f2140072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f2146000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21400733e0 con 0x7f214006c320 2024-09-12T12:16:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f2146000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21400cd290 con 0x7f21400af5f0 2024-09-12T12:16:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f2146000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f21400cd570 con 0x7f214015c2e0 2024-09-12T12:16:02.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f213f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f214015c2e0 0x7f2140072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f213fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f214006c320 0x7f21400cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50390/0 (socket says 172.21.15.144:50390) 2024-09-12T12:16:02.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f213fe00640 1 -- 172.21.15.144:0/1602085068 learned_addr learned my addr 172.21.15.144:0/1602085068 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:02.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f213f400640 1 -- 172.21.15.144:0/1602085068 >> v1:172.21.15.165:6789/0 conn(0x7f21400af5f0 legacy=0x7f214006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f213f400640 1 -- 172.21.15.144:0/1602085068 >> v1:172.21.15.144:6789/0 conn(0x7f214006c320 legacy=0x7f21400cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.775+0000 7f213f400640 1 -- 172.21.15.144:0/1602085068 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21400cd850 con 0x7f214015c2e0 2024-09-12T12:16:02.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f213f400640 1 --2- 172.21.15.144:0/1602085068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 0x7f2140072b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f21280097c0 tx=0x7f212801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a709582410d5bff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f213e000640 1 -- 172.21.15.144:0/1602085068 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280b0070 con 0x7f214015c2e0 2024-09-12T12:16:02.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f213e000640 1 -- 172.21.15.144:0/1602085068 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21280ab600 con 0x7f214015c2e0 2024-09-12T12:16:02.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f213e000640 1 -- 172.21.15.144:0/1602085068 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280ab9d0 con 0x7f214015c2e0 2024-09-12T12:16:02.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 -- 172.21.15.144:0/1602085068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 msgr2=0x7f2140072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 --2- 172.21.15.144:0/1602085068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 0x7f2140072b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f21280097c0 tx=0x7f212801c340 comp rx=0 tx=0).stop 2024-09-12T12:16:02.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 -- 172.21.15.144:0/1602085068 shutdown_connections 2024-09-12T12:16:02.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 --2- 172.21.15.144:0/1602085068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 0x7f2140072b50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 -- 172.21.15.144:0/1602085068 >> 172.21.15.144:0/1602085068 conn(0x7f2140068030 msgr2=0x7f21400b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 -- 172.21.15.144:0/1602085068 shutdown_connections 2024-09-12T12:16:02.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 -- 172.21.15.144:0/1602085068 wait complete. 2024-09-12T12:16:02.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 Processor -- start 2024-09-12T12:16:02.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 -- start start 2024-09-12T12:16:02.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f214006c320 0x7f214015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21400af5f0 0x7f2140149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 0x7f2140152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21400cf020 con 0x7f214015c2e0 2024-09-12T12:16:02.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21400ceea0 con 0x7f21400af5f0 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f2146000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2140169f30 con 0x7f214006c320 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f213fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 0x7f2140152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f213fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 0x7f2140152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36062/0 (socket says 172.21.15.144:36062) 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f213fe00640 1 -- 172.21.15.144:0/883726476 learned_addr learned my addr 172.21.15.144:0/883726476 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f213ea00640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21400af5f0 0x7f2140149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.779+0000 7f213f400640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f214006c320 0x7f214015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f213fe00640 1 -- 172.21.15.144:0/883726476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f214006c320 msgr2=0x7f214015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f213fe00640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f214006c320 0x7f214015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f213fe00640 1 -- 172.21.15.144:0/883726476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21400af5f0 msgr2=0x7f2140149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f213fe00640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21400af5f0 0x7f2140149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f213fe00640 1 -- 172.21.15.144:0/883726476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214015cd40 con 0x7f214015c2e0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f213fe00640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 0x7f2140152900 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f213800caf0 tx=0x7f213800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f2137400640 1 -- 172.21.15.144:0/883726476 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138017070 con 0x7f214015c2e0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f2137400640 1 -- 172.21.15.144:0/883726476 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213800aca0 con 0x7f214015c2e0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f2146000640 1 -- 172.21.15.144:0/883726476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214015d020 con 0x7f214015c2e0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f2137400640 1 -- 172.21.15.144:0/883726476 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138012600 con 0x7f214015c2e0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f2146000640 1 -- 172.21.15.144:0/883726476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214015d5e0 con 0x7f214015c2e0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f2137400640 1 -- 172.21.15.144:0/883726476 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f213801a070 con 0x7f214015c2e0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.783+0000 7f2137400640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f211c0678f0 0x7f211c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f2137400640 1 -- 172.21.15.144:0/883726476 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2138085aa0 con 0x7f214015c2e0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213f400640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f211c0678f0 0x7f211c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 Processor -- start 2024-09-12T12:16:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 -- start start 2024-09-12T12:16:02.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213f400640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f211c0678f0 0x7f211c069db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f21280ad000 tx=0x7f21280a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 0x55c4af3b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6ca0 0x55c4af36c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af36cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c4af253c40 con 0x55c4af36c7d0 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c4af1bad50 con 0x55c4af3b6ca0 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c4af175ab0 con 0x55c4af3b6380 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af36cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af36cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36078/0 (socket says 172.21.15.144:36078) 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213fe00640 1 -- 172.21.15.144:0/3534888498 learned_addr learned my addr 172.21.15.144:0/3534888498 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213f400640 1 --2- 172.21.15.144:0/3534888498 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 0x55c4af3b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213ea00640 1 --2- 172.21.15.144:0/3534888498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6ca0 0x55c4af36c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213fe00640 1 -- 172.21.15.144:0/3534888498 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 msgr2=0x55c4af3b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213fe00640 1 --2- 172.21.15.144:0/3534888498 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 0x55c4af3b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213fe00640 1 -- 172.21.15.144:0/3534888498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6ca0 msgr2=0x55c4af36c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213fe00640 1 --2- 172.21.15.144:0/3534888498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6ca0 0x55c4af36c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213fe00640 1 -- 172.21.15.144:0/3534888498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4af161590 con 0x55c4af36c7d0 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f213fe00640 1 --2- 172.21.15.144:0/3534888498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af36cbb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f213805e3f0 tx=0x7f2138055df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d298f20f2420493 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f212fe00640 1 -- 172.21.15.144:0/3534888498 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138053e90 con 0x55c4af36c7d0 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f212fe00640 1 -- 172.21.15.144:0/3534888498 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21380540f0 con 0x55c4af36c7d0 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f212fe00640 1 -- 172.21.15.144:0/3534888498 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213805e490 con 0x55c4af36c7d0 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 -- 172.21.15.144:0/3534888498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 msgr2=0x55c4af36cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 --2- 172.21.15.144:0/3534888498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af36cbb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f213805e3f0 tx=0x7f2138055df0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 -- 172.21.15.144:0/3534888498 shutdown_connections 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 --2- 172.21.15.144:0/3534888498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af36cbb0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 --2- 172.21.15.144:0/3534888498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6ca0 0x55c4af36c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 --2- 172.21.15.144:0/3534888498 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 0x55c4af3b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 -- 172.21.15.144:0/3534888498 >> 172.21.15.144:0/3534888498 conn(0x55c4af363bc0 msgr2=0x55c4af36ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 -- 172.21.15.144:0/3534888498 shutdown_connections 2024-09-12T12:16:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.787+0000 7f21494c9000 1 -- 172.21.15.144:0/3534888498 wait complete. 2024-09-12T12:16:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 -- start start 2024-09-12T12:16:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 Processor -- start 2024-09-12T12:16:02.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af3718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6380 0x55c4af3a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 0x55c4af3a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c4af179400 con 0x55c4af36c7d0 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c4af2773a0 con 0x55c4af3b6380 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c4af1fa260 con 0x55c4af3b6ca0 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 10 client.0 _ll_register_callbacks cb 0x55c4af21c020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af3718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af3718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36092/0 (socket says 172.21.15.144:36092) 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213f400640 1 -- 172.21.15.144:0/2503042126 learned_addr learned my addr 172.21.15.144:0/2503042126 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213ea00640 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6380 0x55c4af3a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213fe00640 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 0x55c4af3a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213f400640 1 -- 172.21.15.144:0/2503042126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 msgr2=0x55c4af3a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213f400640 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 0x55c4af3a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213f400640 1 -- 172.21.15.144:0/2503042126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6380 msgr2=0x55c4af3a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213f400640 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6380 0x55c4af3a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213f400640 1 -- 172.21.15.144:0/2503042126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4af15ddd0 con 0x55c4af36c7d0 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213f400640 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af3718a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2128000c10 tx=0x7f212801ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299c0f1c62d8a1b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f212cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f212cc00640 1 -- 172.21.15.144:0/2503042126 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280c9020 con 0x55c4af36c7d0 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 -- 172.21.15.144:0/2503042126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21380540f0 con 0x55c4af36c7d0 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f212cc00640 1 -- 172.21.15.144:0/2503042126 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f21280b6770 con 0x55c4af36c7d0 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f212cc00640 1 -- 172.21.15.144:0/2503042126 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f21280b0040 con 0x55c4af36c7d0 2024-09-12T12:16:02.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 10 client.5997 fetch_fsmap learned FSMap version 29 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 -- 172.21.15.144:0/2503042126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55c4af15a800 con 0x55c4af36c7d0 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f212cc00640 1 -- 172.21.15.144:0/2503042126 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21380540f0 con 0x55c4af36c7d0 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f212cc00640 1 -- 172.21.15.144:0/2503042126 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f21280b6970 con 0x55c4af36c7d0 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 10 client.5997 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 10 client.5997 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 20 client.5997 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c4af3bd150 0x55c4af3bd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 4 client.5997 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f21494c9000 1 -- 172.21.15.144:0/2503042126 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4af154e20 con 0x55c4af3bd150 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.791+0000 7f213ea00640 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c4af3bd150 0x55c4af3bd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f212cc00640 10 client.5997 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f213ea00640 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c4af3bd150 0x55c4af3bd530 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20bd9650fab949a6 server_cookie=e6ee90d1d514d012 in_seq=0 out_seq=0 2024-09-12T12:16:02.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f212cc00640 1 -- 172.21.15.144:0/2503042126 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4af154e20 con 0x55c4af3bd150 2024-09-12T12:16:02.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f212cc00640 10 client.5997 handle_command_reply: tid=0 2024-09-12T12:16:02.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 client.5997 shutdown 2024-09-12T12:16:02.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 -- 172.21.15.144:0/2503042126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 msgr2=0x55c4af3718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af3718a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2128000c10 tx=0x7f212801ab80 comp rx=0 tx=0).stop 2024-09-12T12:16:02.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 -- 172.21.15.144:0/2503042126 shutdown_connections 2024-09-12T12:16:02.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c4af3bd150 0x55c4af3bd530 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 0x55c4af3a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af3b6380 0x55c4af3a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f212cc00640 0 client.5997 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 --2- 172.21.15.144:0/2503042126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af36c7d0 0x55c4af3718a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 -- 172.21.15.144:0/2503042126 >> 172.21.15.144:0/2503042126 conn(0x55c4af363bc0 msgr2=0x55c4af36b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 -- 172.21.15.144:0/2503042126 shutdown_connections 2024-09-12T12:16:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 1 -- 172.21.15.144:0/2503042126 wait complete. 2024-09-12T12:16:02.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.795+0000 7f21494c9000 20 client.5997 trim_cache size 0 max 16384 2024-09-12T12:16:02.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.807+0000 7f21494c9000 1 Processor -- start 2024-09-12T12:16:02.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.807+0000 7f21494c9000 1 -- start start 2024-09-12T12:16:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.807+0000 7f21494c9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af36c7d0 0x55c4af425510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.807+0000 7f21494c9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 0x55c4af425a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.807+0000 7f21494c9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6ca0 0x55c4af425f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.807+0000 7f21494c9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2140207650 con 0x55c4af3b6ca0 2024-09-12T12:16:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.807+0000 7f21494c9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21400b51a0 con 0x55c4af36c7d0 2024-09-12T12:16:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.807+0000 7f21494c9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2140207000 con 0x55c4af3b6380 2024-09-12T12:16:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6ca0 0x55c4af425f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6ca0 0x55c4af425f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36100/0 (socket says 172.21.15.144:36100) 2024-09-12T12:16:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213fe00640 1 -- 172.21.15.144:0/1610378925 learned_addr learned my addr 172.21.15.144:0/1610378925 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213ea00640 1 --2- 172.21.15.144:0/1610378925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 0x55c4af425a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213f400640 1 --2- 172.21.15.144:0/1610378925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af36c7d0 0x55c4af425510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213fe00640 1 -- 172.21.15.144:0/1610378925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 msgr2=0x55c4af425a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213fe00640 1 --2- 172.21.15.144:0/1610378925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 0x55c4af425a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213fe00640 1 -- 172.21.15.144:0/1610378925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af36c7d0 msgr2=0x55c4af425510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213fe00640 1 --2- 172.21.15.144:0/1610378925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af36c7d0 0x55c4af425510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213fe00640 1 -- 172.21.15.144:0/1610378925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4af178480 con 0x55c4af3b6ca0 2024-09-12T12:16:02.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213fe00640 1 --2- 172.21.15.144:0/1610378925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6ca0 0x55c4af425f90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2138055af0 tx=0x7f213801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f9d38b3177e105 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f212f400640 1 -- 172.21.15.144:0/1610378925 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138053e90 con 0x55c4af3b6ca0 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f212f400640 1 -- 172.21.15.144:0/1610378925 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21380540f0 con 0x55c4af3b6ca0 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f212f400640 1 -- 172.21.15.144:0/1610378925 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138052460 con 0x55c4af3b6ca0 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 -- 172.21.15.144:0/1610378925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6ca0 msgr2=0x55c4af425f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 --2- 172.21.15.144:0/1610378925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6ca0 0x55c4af425f90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2138055af0 tx=0x7f213801e000 comp rx=0 tx=0).stop 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 -- 172.21.15.144:0/1610378925 shutdown_connections 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 --2- 172.21.15.144:0/1610378925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6ca0 0x55c4af425f90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 --2- 172.21.15.144:0/1610378925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6380 0x55c4af425a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 --2- 172.21.15.144:0/1610378925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af36c7d0 0x55c4af425510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 -- 172.21.15.144:0/1610378925 >> 172.21.15.144:0/1610378925 conn(0x55c4af363bc0 msgr2=0x55c4af370210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 -- 172.21.15.144:0/1610378925 shutdown_connections 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 -- 172.21.15.144:0/1610378925 wait complete. 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 -- start start 2024-09-12T12:16:02.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 Processor -- start 2024-09-12T12:16:02.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af36c7d0 0x55c4af4264f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6380 0x55c4af3bb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 0x55c4af3bb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c4af160f30 con 0x55c4af3b6380 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c4af1797d0 con 0x55c4af36c7d0 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c4af1ba060 con 0x55c4af3b6ca0 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f21494c9000 10 client.0 _ll_register_callbacks cb 0x7f21280ab8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6380 0x55c4af3bb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6380 0x55c4af3bb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36104/0 (socket says 172.21.15.144:36104) 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.811+0000 7f213ea00640 1 -- 172.21.15.144:0/4280996589 learned_addr learned my addr 172.21.15.144:0/4280996589 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213fe00640 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 0x55c4af3bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213ea00640 1 -- 172.21.15.144:0/4280996589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 msgr2=0x55c4af3bb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213ea00640 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 0x55c4af3bb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213ea00640 1 -- 172.21.15.144:0/4280996589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af36c7d0 msgr2=0x55c4af4264f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213ea00640 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af36c7d0 0x55c4af4264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213ea00640 1 -- 172.21.15.144:0/4280996589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4af14e650 con 0x55c4af3b6380 2024-09-12T12:16:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213fe00640 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 0x55c4af3bb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213ea00640 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6380 0x55c4af3bb3d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f214015b440 tx=0x7f2130007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd33106152276ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 1 -- 172.21.15.144:0/4280996589 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21300074d0 con 0x55c4af3b6380 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 1 -- 172.21.15.144:0/4280996589 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f2130017c60 con 0x55c4af3b6380 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 -- 172.21.15.144:0/4280996589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21380540f0 con 0x55c4af3b6380 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 1 -- 172.21.15.144:0/4280996589 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2130017e60 con 0x55c4af3b6380 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 10 client.6003 fetch_fsmap learned FSMap version 29 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 -- 172.21.15.144:0/4280996589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55c4af1523c0 con 0x55c4af3b6380 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 1 -- 172.21.15.144:0/4280996589 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2130022030 con 0x55c4af3b6380 2024-09-12T12:16:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 1 -- 172.21.15.144:0/4280996589 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f2130005110 con 0x55c4af3b6380 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 10 client.6003 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 10 client.6003 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 20 client.6003 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c4af3bc820 0x55c4af432b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 4 client.6003 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 -- 172.21.15.144:0/4280996589 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c4af1c8480 con 0x55c4af3bc820 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213f400640 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c4af3bc820 0x55c4af432b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f213f400640 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c4af3bc820 0x55c4af432b20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cf7e2a4b8a25210 server_cookie=61b887c9acd5093a in_seq=0 out_seq=0 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 10 client.6003 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 1 -- 172.21.15.144:0/4280996589 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x55c4af1c8480 con 0x55c4af3bc820 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 10 client.6003 handle_command_reply: tid=0 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 client.6003 shutdown 2024-09-12T12:16:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 -- 172.21.15.144:0/4280996589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6380 msgr2=0x55c4af3bb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6380 0x55c4af3bb3d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f214015b440 tx=0x7f2130007e20 comp rx=0 tx=0).stop 2024-09-12T12:16:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 -- 172.21.15.144:0/4280996589 shutdown_connections 2024-09-12T12:16:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c4af3bc820 0x55c4af432b20 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c4af3b6ca0 0x55c4af3bb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4af3b6380 0x55c4af3bb3d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 --2- 172.21.15.144:0/4280996589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c4af36c7d0 0x55c4af4264f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f212cc00640 0 client.6003 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 -- 172.21.15.144:0/4280996589 >> 172.21.15.144:0/4280996589 conn(0x55c4af363bc0 msgr2=0x55c4af3ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 -- 172.21.15.144:0/4280996589 shutdown_connections 2024-09-12T12:16:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 1 -- 172.21.15.144:0/4280996589 wait complete. 2024-09-12T12:16:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f21494c9000 20 client.6003 trim_cache size 0 max 16384 2024-09-12T12:16:02.825 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:16:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "damage_type": "backtrace", 2024-09-12T12:16:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 1428764755, 2024-09-12T12:16:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 1099511630411, 2024-09-12T12:16:02.825 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-09-12T12:16:02.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:02.826 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:16:02.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 -- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f211c0678f0 msgr2=0x7f211c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f211c0678f0 0x7f211c069db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f21280ad000 tx=0x7f21280a6000 comp rx=0 tx=0).stop 2024-09-12T12:16:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 -- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 msgr2=0x7f2140152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 0x7f2140152900 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f213800caf0 tx=0x7f213800a060 comp rx=0 tx=0).stop 2024-09-12T12:16:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 -- 172.21.15.144:0/883726476 shutdown_connections 2024-09-12T12:16:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f211c0678f0 0x7f211c069db0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f214015c2e0 0x7f2140152900 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21400af5f0 0x7f2140149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 --2- 172.21.15.144:0/883726476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f214006c320 0x7f214015dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 -- 172.21.15.144:0/883726476 >> 172.21.15.144:0/883726476 conn(0x7f2140068030 msgr2=0x7f2140156780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 -- 172.21.15.144:0/883726476 shutdown_connections 2024-09-12T12:16:02.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.815+0000 7f2146000640 1 -- 172.21.15.144:0/883726476 wait complete. 2024-09-12T12:16:02.838 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:02.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429c600640 1 Processor -- start 2024-09-12T12:16:02.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429c600640 1 -- start start 2024-09-12T12:16:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429c600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f429415e5f0 0x7f429406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429406ea10 0x7f42940b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429c600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f429406d260 con 0x7f42940b44a0 2024-09-12T12:16:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429c600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f42940b6f60 con 0x7f429415e5f0 2024-09-12T12:16:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42940b7240 con 0x7f429406ea10 2024-09-12T12:16:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f4299200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f42940b44a0 0x7f429406e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50404/0 (socket says 172.21.15.144:50404) 2024-09-12T12:16:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f4299200640 1 -- 172.21.15.144:0/2966121931 learned_addr learned my addr 172.21.15.144:0/2966121931 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429a600640 1 --2- 172.21.15.144:0/2966121931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429406ea10 0x7f42940b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f4299c00640 1 --2- 172.21.15.144:0/2966121931 >> v2:172.21.15.165:3300/0 conn(0x7f429415e5f0 0x7f429406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f4293e00640 1 -- 172.21.15.144:0/2966121931 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409761550 0 0) 0x7f429406d260 con 0x7f42940b44a0 2024-09-12T12:16:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f4293e00640 1 -- 172.21.15.144:0/2966121931 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f427c003530 con 0x7f42940b44a0 2024-09-12T12:16:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429a600640 1 -- 172.21.15.144:0/2966121931 >> v2:172.21.15.165:3300/0 conn(0x7f429415e5f0 msgr2=0x7f429406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429a600640 1 --2- 172.21.15.144:0/2966121931 >> v2:172.21.15.165:3300/0 conn(0x7f429415e5f0 0x7f429406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429a600640 1 -- 172.21.15.144:0/2966121931 >> v1:172.21.15.144:6789/0 conn(0x7f42940b44a0 legacy=0x7f429406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f4293e00640 1 -- 172.21.15.144:0/2966121931 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2254300956 0 0) 0x7f427c003530 con 0x7f42940b44a0 2024-09-12T12:16:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.971+0000 7f429a600640 1 -- 172.21.15.144:0/2966121931 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42940b7520 con 0x7f429406ea10 2024-09-12T12:16:02.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f429a600640 1 --2- 172.21.15.144:0/2966121931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429406ea10 0x7f42940b48d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f428c009d90 tx=0x7f428c01c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc763d0f9b8853d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f4293e00640 1 -- 172.21.15.144:0/2966121931 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c0b2070 con 0x7f429406ea10 2024-09-12T12:16:02.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f4293e00640 1 -- 172.21.15.144:0/2966121931 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428c0a5680 con 0x7f429406ea10 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f4293e00640 1 -- 172.21.15.144:0/2966121931 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280001680 con 0x7f429406ea10 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f429c600640 1 -- 172.21.15.144:0/2966121931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429406ea10 msgr2=0x7f42940b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f429c600640 1 --2- 172.21.15.144:0/2966121931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429406ea10 0x7f42940b48d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f428c009d90 tx=0x7f428c01c860 comp rx=0 tx=0).stop 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f429c600640 1 -- 172.21.15.144:0/2966121931 shutdown_connections 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f429c600640 1 --2- 172.21.15.144:0/2966121931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429406ea10 0x7f42940b48d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f429c600640 1 --2- 172.21.15.144:0/2966121931 >> v2:172.21.15.165:3300/0 conn(0x7f429415e5f0 0x7f429406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f429c600640 1 -- 172.21.15.144:0/2966121931 >> 172.21.15.144:0/2966121931 conn(0x7f429406f400 msgr2=0x7f429406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f429c600640 1 -- 172.21.15.144:0/2966121931 shutdown_connections 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.975+0000 7f429c600640 1 -- 172.21.15.144:0/2966121931 wait complete. 2024-09-12T12:16:02.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429c600640 1 Processor -- start 2024-09-12T12:16:02.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429c600640 1 -- start start 2024-09-12T12:16:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429c600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f429406ea10 0x7f429414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42940b44a0 0x7f4294149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429415e5f0 0x7f429414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f429415f880 con 0x7f42940b44a0 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429c600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f429415f700 con 0x7f429406ea10 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f429415fa00 con 0x7f429415e5f0 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42940b44a0 0x7f4294149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42940b44a0 0x7f4294149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36106/0 (socket says 172.21.15.144:36106) 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299200640 1 -- 172.21.15.144:0/1786273626 learned_addr learned my addr 172.21.15.144:0/1786273626 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299c00640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f429406ea10 0x7f429414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429a600640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429415e5f0 0x7f429414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299200640 1 -- 172.21.15.144:0/1786273626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429415e5f0 msgr2=0x7f429414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299200640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429415e5f0 0x7f429414e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299200640 1 -- 172.21.15.144:0/1786273626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f429406ea10 msgr2=0x7f429414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299200640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f429406ea10 0x7f429414dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299200640 1 -- 172.21.15.144:0/1786273626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429414ed80 con 0x7f42940b44a0 2024-09-12T12:16:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4299200640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42940b44a0 0x7f4294149640 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f428000c730 tx=0x7f428000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4291600640 1 -- 172.21.15.144:0/1786273626 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280017070 con 0x7f42940b44a0 2024-09-12T12:16:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4291600640 1 -- 172.21.15.144:0/1786273626 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4280005ae0 con 0x7f42940b44a0 2024-09-12T12:16:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f4291600640 1 -- 172.21.15.144:0/1786273626 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280007070 con 0x7f42940b44a0 2024-09-12T12:16:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.979+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429414cff0 con 0x7f42940b44a0 2024-09-12T12:16:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.983+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f429414b600 con 0x7f42940b44a0 2024-09-12T12:16:02.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.983+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42940b48d0 con 0x7f42940b44a0 2024-09-12T12:16:02.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.983+0000 7f4291600640 1 -- 172.21.15.144:0/1786273626 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f428001a070 con 0x7f42940b44a0 2024-09-12T12:16:02.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.983+0000 7f4291600640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42740678c0 0x7f4274069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.983+0000 7f4291600640 1 -- 172.21.15.144:0/1786273626 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f4280085380 con 0x7f42940b44a0 2024-09-12T12:16:02.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.983+0000 7f4299c00640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42740678c0 0x7f4274069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.983+0000 7f4299c00640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42740678c0 0x7f4274069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4288009ac0 tx=0x7f4288009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:02.987+0000 7f4291600640 1 -- 172.21.15.144:0/1786273626 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4280055640 con 0x7f42940b44a0 2024-09-12T12:16:03.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42940b3310 con 0x7f42940b44a0 2024-09-12T12:16:03.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f4291600640 1 -- 172.21.15.144:0/1786273626 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5230 (secure 0 0 0) 0x7f4280059940 con 0x7f42940b44a0 2024-09-12T12:16:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:03.186 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"btime":"2024-09-12T12:16:02:169923+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/149604375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":149604375},{"type":"v1","addr":"172.21.15.165:6834","nonce":149604375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3844758833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3844758833},{"type":"v1","addr":"172.21.15.144:6837","nonce":3844758833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/639962972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":639962972},{"type":"v1","addr":"172.21.15.165:6835","nonce":639962972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:15:29.364348+0000","modified":"2024-09-12T12:16:02.034824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6836/3957430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3957430285},{"type":"v1","addr":"172.21.15.144:6836","nonce":3957430285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-12T12:16:03.186 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 29 2024-09-12T12:16:03.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42740678c0 msgr2=0x7f4274069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42740678c0 0x7f4274069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4288009ac0 tx=0x7f4288009190 comp rx=0 tx=0).stop 2024-09-12T12:16:03.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42940b44a0 msgr2=0x7f4294149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42940b44a0 0x7f4294149640 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f428000c730 tx=0x7f428000cbf0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 shutdown_connections 2024-09-12T12:16:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42740678c0 0x7f4274069d80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f429415e5f0 0x7f429414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42940b44a0 0x7f4294149640 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 --2- 172.21.15.144:0/1786273626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f429406ea10 0x7f429414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 >> 172.21.15.144:0/1786273626 conn(0x7f429406f400 msgr2=0x7f42940d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 shutdown_connections 2024-09-12T12:16:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.183+0000 7f429c600640 1 -- 172.21.15.144:0/1786273626 wait complete. 2024-09-12T12:16:03.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage rm 1428764755 2024-09-12T12:16:03.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe512e00640 1 Processor -- start 2024-09-12T12:16:03.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe512e00640 1 -- start start 2024-09-12T12:16:03.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe512e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c15c2e0 0x7fe50c072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe512e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe50c0733e0 con 0x7fe50c0af5f0 2024-09-12T12:16:03.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe512e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe50c0cd290 con 0x7fe50c06c320 2024-09-12T12:16:03.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe512e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe50c0cd570 con 0x7fe50c15c2e0 2024-09-12T12:16:03.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe50c0af5f0 0x7fe50c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50406/0 (socket says 172.21.15.144:50406) 2024-09-12T12:16:03.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50b400640 1 -- 172.21.15.144:0/742700802 learned_addr learned my addr 172.21.15.144:0/742700802 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50be00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c15c2e0 0x7fe50c072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421975540 0 0) 0x7fe50c0733e0 con 0x7fe50c0af5f0 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4f0003530 con 0x7fe50c0af5f0 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758553407 0 0) 0x7fe50c0cd290 con 0x7fe50c06c320 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe50c0733e0 con 0x7fe50c06c320 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1916005922 0 0) 0x7fe4f0003530 con 0x7fe50c0af5f0 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c15c2e0 msgr2=0x7fe50c072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c15c2e0 0x7fe50c072b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 >> v1:172.21.15.165:6789/0 conn(0x7fe50c06c320 legacy=0x7fe50c0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c0cd850 con 0x7fe50c0af5f0 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fe4f8001680 con 0x7fe50c0af5f0 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.343+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 >> v1:172.21.15.144:6789/0 conn(0x7fe50c0af5f0 legacy=0x7fe50c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50aa00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4f0003b80 0x7fe4f0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50aa00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c15c2e0 0x7fe4f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50aa00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0004d50 0x7fe4f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c0cd570 con 0x7fe4f0003b80 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f000bbe0 con 0x7fe4f0004d50 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f000bde0 con 0x7fe50c15c2e0 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50be00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4f0003b80 0x7fe4f0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50b400640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c15c2e0 0x7fe4f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe510e00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0004d50 0x7fe4f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50be00640 1 -- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c15c2e0 msgr2=0x7fe4f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50be00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c15c2e0 0x7fe4f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50be00640 1 -- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0004d50 msgr2=0x7fe4f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50be00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0004d50 0x7fe4f00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50be00640 1 -- 172.21.15.144:0/742700802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f0003530 con 0x7fe4f0003b80 2024-09-12T12:16:03.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe510e00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0004d50 0x7fe4f00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50be00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4f0003b80 0x7fe4f0003f80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009ae0 tx=0x7fe4fc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe43f382454a29c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0b2070 con 0x7fe4f0003b80 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4fc0a5550 con 0x7fe4f0003b80 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.347+0000 7fe50aa00640 1 -- 172.21.15.144:0/742700802 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0096b0 con 0x7fe4f0003b80 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 -- 172.21.15.144:0/742700802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4f0003b80 msgr2=0x7fe4f0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 --2- 172.21.15.144:0/742700802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4f0003b80 0x7fe4f0003f80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009ae0 tx=0x7fe4fc01ca70 comp rx=0 tx=0).stop 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe510e00640 1 -- 172.21.15.144:0/742700802 reap_dead start 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 -- 172.21.15.144:0/742700802 shutdown_connections 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 -- 172.21.15.144:0/742700802 >> 172.21.15.144:0/742700802 conn(0x7fe50c068030 msgr2=0x7fe50c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 -- 172.21.15.144:0/742700802 shutdown_connections 2024-09-12T12:16:03.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 -- 172.21.15.144:0/742700802 wait complete. 2024-09-12T12:16:03.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 Processor -- start 2024-09-12T12:16:03.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 -- start start 2024-09-12T12:16:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0003b80 0x7fe50c15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe50c15c8d0 0x7fe50c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c1545e0 0x7fe50c153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c167f20 con 0x7fe50c15c8d0 2024-09-12T12:16:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c0cef60 con 0x7fe4f0003b80 2024-09-12T12:16:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe512e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe50c1680a0 con 0x7fe50c1545e0 2024-09-12T12:16:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe50c15c8d0 0x7fe50c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe50c15c8d0 0x7fe50c1595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36128/0 (socket says 172.21.15.144:36128) 2024-09-12T12:16:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50b400640 1 -- 172.21.15.144:0/3813870463 learned_addr learned my addr 172.21.15.144:0/3813870463 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50be00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0003b80 0x7fe50c15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe510e00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c1545e0 0x7fe50c153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50b400640 1 -- 172.21.15.144:0/3813870463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c1545e0 msgr2=0x7fe50c153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50b400640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c1545e0 0x7fe50c153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50b400640 1 -- 172.21.15.144:0/3813870463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0003b80 msgr2=0x7fe50c15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50b400640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0003b80 0x7fe50c15f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50b400640 1 -- 172.21.15.144:0/3813870463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c162ef0 con 0x7fe50c15c8d0 2024-09-12T12:16:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.351+0000 7fe50b400640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe50c15c8d0 0x7fe50c1595a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8004e40 tx=0x7fe4f8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe503e00640 1 -- 172.21.15.144:0/3813870463 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f800f7b0 con 0x7fe50c15c8d0 2024-09-12T12:16:03.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe503e00640 1 -- 172.21.15.144:0/3813870463 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f8018070 con 0x7fe50c15c8d0 2024-09-12T12:16:03.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe503e00640 1 -- 172.21.15.144:0/3813870463 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f800fbb0 con 0x7fe50c15c8d0 2024-09-12T12:16:03.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe512e00640 1 -- 172.21.15.144:0/3813870463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50c1631d0 con 0x7fe50c15c8d0 2024-09-12T12:16:03.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe512e00640 1 -- 172.21.15.144:0/3813870463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe50c1f74b0 con 0x7fe50c15c8d0 2024-09-12T12:16:03.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe503e00640 1 -- 172.21.15.144:0/3813870463 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4f800fd50 con 0x7fe50c15c8d0 2024-09-12T12:16:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe503e00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4ec0678f0 0x7fe4ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe503e00640 1 -- 172.21.15.144:0/3813870463 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe4f8085cc0 con 0x7fe50c15c8d0 2024-09-12T12:16:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe50be00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4ec0678f0 0x7fe4ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe51628e000 1 Processor -- start 2024-09-12T12:16:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.355+0000 7fe51628e000 1 -- start start 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4ec0678f0 0x7fe4ec069db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0af000 tx=0x7fe4fc0046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b30b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 0x55f44b30bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b2c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f44b10fd30 con 0x55f44b1a9030 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f44b0b5410 con 0x55f44b30b850 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f44b10bcf0 con 0x55f44b2c17a0 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b30b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b30b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36134/0 (socket says 172.21.15.144:36134) 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 -- 172.21.15.144:0/2859791379 learned_addr learned my addr 172.21.15.144:0/2859791379 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50b400640 1 --2- 172.21.15.144:0/2859791379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 0x55f44b30bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe510e00640 1 --2- 172.21.15.144:0/2859791379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b2c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 -- 172.21.15.144:0/2859791379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 msgr2=0x55f44b2c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 --2- 172.21.15.144:0/2859791379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b2c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 -- 172.21.15.144:0/2859791379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 msgr2=0x55f44b30bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 --2- 172.21.15.144:0/2859791379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 0x55f44b30bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 -- 172.21.15.144:0/2859791379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f44b0d6620 con 0x55f44b1a9030 2024-09-12T12:16:03.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe50be00640 1 --2- 172.21.15.144:0/2859791379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b30b310 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0b0040 tx=0x7fe4fc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f533659a2e032fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe500c00640 1 -- 172.21.15.144:0/2859791379 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0c8070 con 0x55f44b1a9030 2024-09-12T12:16:03.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe500c00640 1 -- 172.21.15.144:0/2859791379 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4fc0a5890 con 0x55f44b1a9030 2024-09-12T12:16:03.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe500c00640 1 -- 172.21.15.144:0/2859791379 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0b2040 con 0x55f44b1a9030 2024-09-12T12:16:03.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 -- 172.21.15.144:0/2859791379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 msgr2=0x55f44b30b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 --2- 172.21.15.144:0/2859791379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b30b310 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0b0040 tx=0x7fe4fc004740 comp rx=0 tx=0).stop 2024-09-12T12:16:03.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 -- 172.21.15.144:0/2859791379 shutdown_connections 2024-09-12T12:16:03.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 --2- 172.21.15.144:0/2859791379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b2c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 --2- 172.21.15.144:0/2859791379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 0x55f44b30bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 --2- 172.21.15.144:0/2859791379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b30b310 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 -- 172.21.15.144:0/2859791379 >> 172.21.15.144:0/2859791379 conn(0x55f44add2a20 msgr2=0x55f44b2c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 -- 172.21.15.144:0/2859791379 shutdown_connections 2024-09-12T12:16:03.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 -- 172.21.15.144:0/2859791379 wait complete. 2024-09-12T12:16:03.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 -- start start 2024-09-12T12:16:03.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.359+0000 7fe51628e000 1 Processor -- start 2024-09-12T12:16:03.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b1a9030 0x55f44b2cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b2c17a0 0x55f44b2ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b2cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f44b0d3850 con 0x55f44b30b850 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f44b0a96b0 con 0x55f44b2c17a0 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f44b2caeb0 con 0x55f44b1a9030 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 10 client.0 _ll_register_callbacks cb 0x55f44b2ad440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe510e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b2cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe510e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b2cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36144/0 (socket says 172.21.15.144:36144) 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe510e00640 1 -- 172.21.15.144:0/108740263 learned_addr learned my addr 172.21.15.144:0/108740263 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe50be00640 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b1a9030 0x55f44b2cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe50b400640 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b2c17a0 0x55f44b2ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe510e00640 1 -- 172.21.15.144:0/108740263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b1a9030 msgr2=0x55f44b2cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe510e00640 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b1a9030 0x55f44b2cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe510e00640 1 -- 172.21.15.144:0/108740263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b2c17a0 msgr2=0x55f44b2ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe510e00640 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b2c17a0 0x55f44b2ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe510e00640 1 -- 172.21.15.144:0/108740263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f44b0af520 con 0x55f44b30b850 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe510e00640 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b2cd170 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe50c06e190 tx=0x7fe504001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b06afc75c09a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe4f5600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe4f5600640 1 -- 172.21.15.144:0/108740263 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504006d70 con 0x55f44b30b850 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe4f5600640 1 -- 172.21.15.144:0/108740263 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe504010070 con 0x55f44b30b850 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 -- 172.21.15.144:0/108740263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4fc0a5890 con 0x55f44b30b850 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe4f5600640 1 -- 172.21.15.144:0/108740263 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe504016450 con 0x55f44b30b850 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 10 client.6021 fetch_fsmap learned FSMap version 29 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 -- 172.21.15.144:0/108740263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55f44b0b5660 con 0x55f44b30b850 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe4f5600640 1 -- 172.21.15.144:0/108740263 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4fc0a5890 con 0x55f44b30b850 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe4f5600640 1 -- 172.21.15.144:0/108740263 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fe5040165f0 con 0x55f44b30b850 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 10 client.6021 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:16:03.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 10 client.6021 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 20 client.6021 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f44b2cdb80 0x55f44b31bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 4 client.6021 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 -- 172.21.15.144:0/108740263 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f44b0a9cd0 con 0x55f44b2cdb80 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe50be00640 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f44b2cdb80 0x55f44b31bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe50be00640 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f44b2cdb80 0x55f44b31bfd0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b845ba1672641836 server_cookie=ad52cb87f8182c4a in_seq=0 out_seq=0 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe4f5600640 10 client.6021 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe4f5600640 1 -- 172.21.15.144:0/108740263 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f44b0a9cd0 con 0x55f44b2cdb80 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe4f5600640 10 client.6021 handle_command_reply: tid=0 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 client.6021 shutdown 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 -- 172.21.15.144:0/108740263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 msgr2=0x55f44b2cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b2cd170 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe50c06e190 tx=0x7fe504001c10 comp rx=0 tx=0).stop 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 -- 172.21.15.144:0/108740263 shutdown_connections 2024-09-12T12:16:03.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f44b2cdb80 0x55f44b31bfd0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b2cd170 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.363+0000 7fe51628e000 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b2c17a0 0x55f44b2ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.367+0000 7fe4f5600640 0 client.6021 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:03.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.367+0000 7fe51628e000 1 --2- 172.21.15.144:0/108740263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b1a9030 0x55f44b2cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.367+0000 7fe51628e000 1 -- 172.21.15.144:0/108740263 >> 172.21.15.144:0/108740263 conn(0x55f44add2a20 msgr2=0x55f44b2c0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.367+0000 7fe51628e000 1 -- 172.21.15.144:0/108740263 shutdown_connections 2024-09-12T12:16:03.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.367+0000 7fe51628e000 1 -- 172.21.15.144:0/108740263 wait complete. 2024-09-12T12:16:03.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.367+0000 7fe51628e000 20 client.6021 trim_cache size 0 max 16384 2024-09-12T12:16:03.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe51628e000 1 Processor -- start 2024-09-12T12:16:03.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe51628e000 1 -- start start 2024-09-12T12:16:03.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe51628e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b1a9030 0x55f44b37e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe51628e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b37eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe51628e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b37f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe51628e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c202a80 con 0x55f44b30b850 2024-09-12T12:16:03.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe51628e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c201a80 con 0x55f44b1a9030 2024-09-12T12:16:03.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe51628e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe50c200e10 con 0x55f44b2c17a0 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe510e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b37f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe510e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b37f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36146/0 (socket says 172.21.15.144:36146) 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe510e00640 1 -- 172.21.15.144:0/1892390821 learned_addr learned my addr 172.21.15.144:0/1892390821 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe50b400640 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b37eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe50be00640 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b1a9030 0x55f44b37e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe510e00640 1 -- 172.21.15.144:0/1892390821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 msgr2=0x55f44b37eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe510e00640 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b37eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe510e00640 1 -- 172.21.15.144:0/1892390821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b1a9030 msgr2=0x55f44b37e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe510e00640 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b1a9030 0x55f44b37e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe510e00640 1 -- 172.21.15.144:0/1892390821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f44b0ccf30 con 0x55f44b30b850 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe50be00640 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b1a9030 0x55f44b37e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:03.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.379+0000 7fe510e00640 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b37f0c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe504003bb0 tx=0x7fe504013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1b711640d0532f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe4f7e00640 1 -- 172.21.15.144:0/1892390821 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5040165f0 con 0x55f44b30b850 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe4f7e00640 1 -- 172.21.15.144:0/1892390821 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe504016af0 con 0x55f44b30b850 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe4f7e00640 1 -- 172.21.15.144:0/1892390821 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504022480 con 0x55f44b30b850 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 -- 172.21.15.144:0/1892390821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 msgr2=0x55f44b37f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b37f0c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe504003bb0 tx=0x7fe504013000 comp rx=0 tx=0).stop 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 -- 172.21.15.144:0/1892390821 shutdown_connections 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b30b850 0x55f44b37f0c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b37eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 --2- 172.21.15.144:0/1892390821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b1a9030 0x55f44b37e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 -- 172.21.15.144:0/1892390821 >> 172.21.15.144:0/1892390821 conn(0x55f44add2a20 msgr2=0x55f44b31bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 -- 172.21.15.144:0/1892390821 shutdown_connections 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 -- 172.21.15.144:0/1892390821 wait complete. 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 -- start start 2024-09-12T12:16:03.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 Processor -- start 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b369460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b37f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 0x55f44b37f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f44b10f040 con 0x55f44b1a9030 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c201430 con 0x55f44b30b850 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f44b0afa60 con 0x55f44b2c17a0 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe51628e000 10 client.0 _ll_register_callbacks cb 0x7fe504003c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b369460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b369460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36160/0 (socket says 172.21.15.144:36160) 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50be00640 1 -- 172.21.15.144:0/750707683 learned_addr learned my addr 172.21.15.144:0/750707683 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50b400640 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b37f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe510e00640 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 0x55f44b37f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50be00640 1 -- 172.21.15.144:0/750707683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 msgr2=0x55f44b37f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50be00640 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b37f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50be00640 1 -- 172.21.15.144:0/750707683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 msgr2=0x55f44b37f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50be00640 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 0x55f44b37f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50be00640 1 -- 172.21.15.144:0/750707683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f44b167b00 con 0x55f44b1a9030 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe50be00640 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b369460 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc01cf50 tx=0x7fe4fc019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e686a8f00b6363f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe4f5600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe4f5600640 1 -- 172.21.15.144:0/750707683 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0c8040 con 0x55f44b1a9030 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.383+0000 7fe4f5600640 1 -- 172.21.15.144:0/750707683 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fe4fc0a57d0 con 0x55f44b1a9030 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 -- 172.21.15.144:0/750707683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe504016af0 con 0x55f44b1a9030 2024-09-12T12:16:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe4f5600640 1 -- 172.21.15.144:0/750707683 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe4fc0ad440 con 0x55f44b1a9030 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 10 client.6027 fetch_fsmap learned FSMap version 29 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 -- 172.21.15.144:0/750707683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55f44adca360 con 0x55f44b1a9030 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe4f5600640 1 -- 172.21.15.144:0/750707683 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe504016af0 con 0x55f44b1a9030 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe4f5600640 1 -- 172.21.15.144:0/750707683 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fe4fc0ad5e0 con 0x55f44b1a9030 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 10 client.6027 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 10 client.6027 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 20 client.6027 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f44b37fd40 0x55f44b380120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 4 client.6027 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 1428764755}] 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 -- 172.21.15.144:0/750707683 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "damage rm", "damage_id": 1428764755}) -- 0x55f44b11d460 con 0x55f44b37fd40 2024-09-12T12:16:03.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe50b400640 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f44b37fd40 0x55f44b380120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe50b400640 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f44b37fd40 0x55f44b380120 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2adc42c499d68990 server_cookie=cffb68bb45479e87 in_seq=0 out_seq=0 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe4f5600640 10 client.6027 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe4f5600640 1 -- 172.21.15.144:0/750707683 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55f44b11d460 con 0x55f44b37fd40 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe4f5600640 10 client.6027 handle_command_reply: tid=0 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 client.6027 shutdown 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 -- 172.21.15.144:0/750707683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 msgr2=0x55f44b369460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b369460 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc01cf50 tx=0x7fe4fc019810 comp rx=0 tx=0).stop 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 -- 172.21.15.144:0/750707683 shutdown_connections 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55f44b37fd40 0x55f44b380120 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f44b30b850 0x55f44b37f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f44b2c17a0 0x55f44b37f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 --2- 172.21.15.144:0/750707683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f44b1a9030 0x55f44b369460 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 -- 172.21.15.144:0/750707683 >> 172.21.15.144:0/750707683 conn(0x55f44add2a20 msgr2=0x55f44b31bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe4f5600640 0 client.6027 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 -- 172.21.15.144:0/750707683 shutdown_connections 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 1 -- 172.21.15.144:0/750707683 wait complete. 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe51628e000 20 client.6027 trim_cache size 0 max 16384 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 -- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4ec0678f0 msgr2=0x7fe4ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4ec0678f0 0x7fe4ec069db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0af000 tx=0x7fe4fc0046d0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 -- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe50c15c8d0 msgr2=0x7fe50c1595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe50c15c8d0 0x7fe50c1595a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8004e40 tx=0x7fe4f8007430 comp rx=0 tx=0).stop 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 -- 172.21.15.144:0/3813870463 shutdown_connections 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4ec0678f0 0x7fe4ec069db0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe50c1545e0 0x7fe50c153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe50c15c8d0 0x7fe50c1595a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 --2- 172.21.15.144:0/3813870463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4f0003b80 0x7fe50c15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 -- 172.21.15.144:0/3813870463 >> 172.21.15.144:0/3813870463 conn(0x7fe50c068030 msgr2=0x7fe50c15b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 -- 172.21.15.144:0/3813870463 shutdown_connections 2024-09-12T12:16:03.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.387+0000 7fe512e00640 1 -- 172.21.15.144:0/3813870463 wait complete. 2024-09-12T12:16:03.409 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-12T12:16:03.410 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f1b000640 1 Processor -- start 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f1b000640 1 -- start start 2024-09-12T12:16:03.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f1b000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f1415af60 0x7f9f140ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f1b000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9f1406c320 0x7f9f140b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f1b000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f140b4300 con 0x7f9f140cd9f0 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f1b000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9f140b32f0 con 0x7f9f1406c320 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f1b000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9f140b3540 con 0x7f9f1415af60 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9f140cd9f0 0x7f9f1406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50422/0 (socket says 172.21.15.144:50422) 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13400640 1 -- 172.21.15.144:0/2617177650 learned_addr learned my addr 172.21.15.144:0/2617177650 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:03.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f19000640 1 --2- 172.21.15.144:0/2617177650 >> v2:172.21.15.165:3300/0 conn(0x7f9f1406c320 0x7f9f140b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13e00640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f1415af60 0x7f9f140ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165345930 0 0) 0x7f9f140b4300 con 0x7f9f140cd9f0 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ef8003530 con 0x7f9f140cd9f0 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3949190559 0 0) 0x7f9ef8003530 con 0x7f9f140cd9f0 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f1415af60 msgr2=0x7f9f140ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f1415af60 0x7f9f140ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 >> v2:172.21.15.165:3300/0 conn(0x7f9f1406c320 msgr2=0x7f9f140b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 --2- 172.21.15.144:0/2617177650 >> v2:172.21.15.165:3300/0 conn(0x7f9f1406c320 0x7f9f140b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f140b3820 con 0x7f9f140cd9f0 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f9f00001680 con 0x7f9f140cd9f0 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f19000640 1 --2- 172.21.15.144:0/2617177650 >> v2:172.21.15.165:3300/0 conn(0x7f9f1406c320 0x7f9f140b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 >> v1:172.21.15.144:6789/0 conn(0x7f9f140cd9f0 legacy=0x7f9f1406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ef80039c0 0x7f9ef8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ef8004810 0x7f9ef8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f1415af60 0x7f9ef80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f140b32f0 con 0x7f9ef8004810 2024-09-12T12:16:03.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f140b3540 con 0x7f9ef80039c0 2024-09-12T12:16:03.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef800dbe0 con 0x7f9f1415af60 2024-09-12T12:16:03.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13400640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ef8004810 0x7f9ef8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f19000640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f1415af60 0x7f9ef80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13e00640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ef80039c0 0x7f9ef8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13400640 1 -- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f1415af60 msgr2=0x7f9ef80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13400640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9f1415af60 0x7f9ef80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13400640 1 -- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ef80039c0 msgr2=0x7f9ef8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13400640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ef80039c0 0x7f9ef8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.547+0000 7f9f13400640 1 -- 172.21.15.144:0/2617177650 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef8003530 con 0x7f9ef8004810 2024-09-12T12:16:03.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f13400640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ef8004810 0x7f9ef8004c90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c290 tx=0x7f9f0001cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a45b8ae25a9bf14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00007d60 con 0x7f9ef8004810 2024-09-12T12:16:03.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f000a9020 con 0x7f9ef8004810 2024-09-12T12:16:03.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f12a00640 1 -- 172.21.15.144:0/2617177650 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00005ae0 con 0x7f9ef8004810 2024-09-12T12:16:03.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f1b000640 1 -- 172.21.15.144:0/2617177650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ef8004810 msgr2=0x7f9ef8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f1b000640 1 --2- 172.21.15.144:0/2617177650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ef8004810 0x7f9ef8004c90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c290 tx=0x7f9f0001cd20 comp rx=0 tx=0).stop 2024-09-12T12:16:03.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f19000640 1 -- 172.21.15.144:0/2617177650 reap_dead start 2024-09-12T12:16:03.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f1b000640 1 -- 172.21.15.144:0/2617177650 shutdown_connections 2024-09-12T12:16:03.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f1b000640 1 -- 172.21.15.144:0/2617177650 >> 172.21.15.144:0/2617177650 conn(0x7f9f14068030 msgr2=0x7f9f140b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f1b000640 1 -- 172.21.15.144:0/2617177650 shutdown_connections 2024-09-12T12:16:03.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.551+0000 7f9f1b000640 1 -- 172.21.15.144:0/2617177650 wait complete. 2024-09-12T12:16:03.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 Processor -- start 2024-09-12T12:16:03.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 -- start start 2024-09-12T12:16:03.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ef8004810 0x7f9f14158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f141f4b70 0x7f9f1415e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f140ae890 0x7f9f140aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1415b340 con 0x7f9f141f4b70 2024-09-12T12:16:03.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f140b3de0 con 0x7f9f140ae890 2024-09-12T12:16:03.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9f1415b4c0 con 0x7f9ef8004810 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f141f4b70 0x7f9f1415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f141f4b70 0x7f9f1415e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36180/0 (socket says 172.21.15.144:36180) 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13400640 1 -- 172.21.15.144:0/2439133560 learned_addr learned my addr 172.21.15.144:0/2439133560 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13e00640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ef8004810 0x7f9f14158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f19000640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f140ae890 0x7f9f140aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13400640 1 -- 172.21.15.144:0/2439133560 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ef8004810 msgr2=0x7f9f14158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13400640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ef8004810 0x7f9f14158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13400640 1 -- 172.21.15.144:0/2439133560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f140ae890 msgr2=0x7f9f140aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13400640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f140ae890 0x7f9f140aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13400640 1 -- 172.21.15.144:0/2439133560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1415e590 con 0x7f9f141f4b70 2024-09-12T12:16:03.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f13400640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f141f4b70 0x7f9f1415e050 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9f00007040 tx=0x7f9ef8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f0be00640 1 -- 172.21.15.144:0/2439133560 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00007d60 con 0x7f9f141f4b70 2024-09-12T12:16:03.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f0be00640 1 -- 172.21.15.144:0/2439133560 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f000049f0 con 0x7f9f141f4b70 2024-09-12T12:16:03.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 -- 172.21.15.144:0/2439133560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f14158850 con 0x7f9f141f4b70 2024-09-12T12:16:03.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f0be00640 1 -- 172.21.15.144:0/2439133560 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00001c90 con 0x7f9f141f4b70 2024-09-12T12:16:03.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.555+0000 7f9f1b000640 1 -- 172.21.15.144:0/2439133560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f14158e10 con 0x7f9f141f4b70 2024-09-12T12:16:03.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.559+0000 7f9f0be00640 1 -- 172.21.15.144:0/2439133560 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9f000070d0 con 0x7f9f141f4b70 2024-09-12T12:16:03.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.559+0000 7f9f0be00640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ef40678c0 0x7f9ef4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.559+0000 7f9f0be00640 1 -- 172.21.15.144:0/2439133560 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f9f0011ffd0 con 0x7f9f141f4b70 2024-09-12T12:16:03.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.559+0000 7f9f13e00640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ef40678c0 0x7f9ef4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.559+0000 7f9f1e37e000 1 Processor -- start 2024-09-12T12:16:03.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.559+0000 7f9f13e00640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ef40678c0 0x7f9ef4069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009a80 tx=0x7f9f04009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.559+0000 7f9f1e37e000 1 -- start start 2024-09-12T12:16:03.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5a2d0 0x55c360b5a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b11800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b11d40 0x55c360b12120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c3609f8bd0 con 0x55c360b5abf0 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c36095f9e0 con 0x55c360b5a2d0 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c3609058f0 con 0x55c360b11d40 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b11800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b11800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36192/0 (socket says 172.21.15.144:36192) 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13400640 1 -- 172.21.15.144:0/740879751 learned_addr learned my addr 172.21.15.144:0/740879751 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13e00640 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5a2d0 0x55c360b5a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f19000640 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b11d40 0x55c360b12120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13400640 1 -- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b11d40 msgr2=0x55c360b12120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13400640 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b11d40 0x55c360b12120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13400640 1 -- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5a2d0 msgr2=0x55c360b5a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13400640 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5a2d0 0x55c360b5a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13400640 1 -- 172.21.15.144:0/740879751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3608fd970 con 0x55c360b5abf0 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13e00640 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5a2d0 0x55c360b5a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f19000640 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b11d40 0x55c360b12120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f13400640 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b11800 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9f000ec640 tx=0x7f9f000ec500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deab99e8ad602d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f08c00640 1 -- 172.21.15.144:0/740879751 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00004dc0 con 0x55c360b5abf0 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f08c00640 1 -- 172.21.15.144:0/740879751 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f000ee4e0 con 0x55c360b5abf0 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f08c00640 1 -- 172.21.15.144:0/740879751 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f000ec850 con 0x55c360b5abf0 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- 172.21.15.144:0/740879751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 msgr2=0x55c360b11800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b11800 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9f000ec640 tx=0x7f9f000ec500 comp rx=0 tx=0).stop 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- 172.21.15.144:0/740879751 shutdown_connections 2024-09-12T12:16:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b11d40 0x55c360b12120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b11800 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/740879751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5a2d0 0x55c360b5a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- 172.21.15.144:0/740879751 >> 172.21.15.144:0/740879751 conn(0x55c360b08ba0 msgr2=0x55c360b100e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- 172.21.15.144:0/740879751 shutdown_connections 2024-09-12T12:16:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- 172.21.15.144:0/740879751 wait complete. 2024-09-12T12:16:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- start start 2024-09-12T12:16:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 Processor -- start 2024-09-12T12:16:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 0x55c360b59960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360b16330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b16870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c3608f9a50 con 0x55c360b5abf0 2024-09-12T12:16:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c36095b9a0 con 0x55c360b11d40 2024-09-12T12:16:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c3609f8bd0 con 0x55c360b5a2d0 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f1e37e000 10 client.0 _ll_register_callbacks cb 0x55c3609c1430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f19000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b16870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f19000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b16870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36208/0 (socket says 172.21.15.144:36208) 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.563+0000 7f9f19000640 1 -- 172.21.15.144:0/920194732 learned_addr learned my addr 172.21.15.144:0/920194732 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f13400640 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360b16330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f13e00640 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 0x55c360b59960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f19000640 1 -- 172.21.15.144:0/920194732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 msgr2=0x55c360b16330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f19000640 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360b16330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f19000640 1 -- 172.21.15.144:0/920194732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 msgr2=0x55c360b59960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f19000640 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 0x55c360b59960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f19000640 1 -- 172.21.15.144:0/920194732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c360968650 con 0x55c360b5abf0 2024-09-12T12:16:03.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f19000640 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b16870 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f140d0240 tx=0x7f9f0c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef6d27e411202ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 1 -- 172.21.15.144:0/920194732 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c003ba0 con 0x55c360b5abf0 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 1 -- 172.21.15.144:0/920194732 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f9f0c003d40 con 0x55c360b5abf0 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 -- 172.21.15.144:0/920194732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f000ee4e0 con 0x55c360b5abf0 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 1 -- 172.21.15.144:0/920194732 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9f0c028050 con 0x55c360b5abf0 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 10 client.6039 fetch_fsmap learned FSMap version 29 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 -- 172.21.15.144:0/920194732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55c360905b40 con 0x55c360b5abf0 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 1 -- 172.21.15.144:0/920194732 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f000ee4e0 con 0x55c360b5abf0 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 1 -- 172.21.15.144:0/920194732 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f9f0c02b020 con 0x55c360b5abf0 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 10 client.6039 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 10 client.6039 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 20 client.6039 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c360b17280 0x55c360b17690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 4 client.6039 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 -- 172.21.15.144:0/920194732 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3608fa020 con 0x55c360b17280 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f13e00640 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c360b17280 0x55c360b17690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f13e00640 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c360b17280 0x55c360b17690 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d44bcdf82852dbf0 server_cookie=8c67a4099eea2cc in_seq=0 out_seq=0 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 10 client.6039 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 1 -- 172.21.15.144:0/920194732 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3608fa020 con 0x55c360b17280 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 10 client.6039 handle_command_reply: tid=0 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 client.6039 shutdown 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 -- 172.21.15.144:0/920194732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 msgr2=0x55c360b16870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b16870 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9f140d0240 tx=0x7f9f0c007700 comp rx=0 tx=0).stop 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 -- 172.21.15.144:0/920194732 shutdown_connections 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c360b17280 0x55c360b17690 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b16870 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360b16330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/920194732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 0x55c360b59960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9efd600640 0 client.6039 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 -- 172.21.15.144:0/920194732 >> 172.21.15.144:0/920194732 conn(0x55c360b08ba0 msgr2=0x55c360b107f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 -- 172.21.15.144:0/920194732 shutdown_connections 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 1 -- 172.21.15.144:0/920194732 wait complete. 2024-09-12T12:16:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.567+0000 7f9f1e37e000 20 client.6039 trim_cache size 0 max 16384 2024-09-12T12:16:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f1e37e000 1 Processor -- start 2024-09-12T12:16:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f1e37e000 1 -- start start 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 0x55c360b164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360b709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b70f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14201720 con 0x55c360b5abf0 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14200740 con 0x55c360b11d40 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9f141ffaa0 con 0x55c360b5a2d0 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f19000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b70f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f19000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b70f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36216/0 (socket says 172.21.15.144:36216) 2024-09-12T12:16:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f19000640 1 -- 172.21.15.144:0/2431301679 learned_addr learned my addr 172.21.15.144:0/2431301679 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f13e00640 1 --2- 172.21.15.144:0/2431301679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 0x55c360b164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f13400640 1 --2- 172.21.15.144:0/2431301679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360b709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f19000640 1 -- 172.21.15.144:0/2431301679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 msgr2=0x55c360b709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f19000640 1 --2- 172.21.15.144:0/2431301679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360b709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f19000640 1 -- 172.21.15.144:0/2431301679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 msgr2=0x55c360b164c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f19000640 1 --2- 172.21.15.144:0/2431301679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 0x55c360b164c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.583+0000 7f9f19000640 1 -- 172.21.15.144:0/2431301679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3608ffa00 con 0x55c360b5abf0 2024-09-12T12:16:03.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f19000640 1 --2- 172.21.15.144:0/2431301679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b70f20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0094c0 tx=0x7f9f0c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49648262a5c769da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9effe00640 1 -- 172.21.15.144:0/2431301679 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0039a0 con 0x55c360b5abf0 2024-09-12T12:16:03.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9effe00640 1 -- 172.21.15.144:0/2431301679 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c031070 con 0x55c360b5abf0 2024-09-12T12:16:03.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9effe00640 1 -- 172.21.15.144:0/2431301679 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c003d40 con 0x55c360b5abf0 2024-09-12T12:16:03.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2431301679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 msgr2=0x55c360b70f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2431301679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b70f20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0094c0 tx=0x7f9f0c01b000 comp rx=0 tx=0).stop 2024-09-12T12:16:03.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2431301679 shutdown_connections 2024-09-12T12:16:03.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2431301679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b5abf0 0x55c360b70f20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2431301679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360b709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2431301679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b11d40 0x55c360b164c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2431301679 >> 172.21.15.144:0/2431301679 conn(0x55c360b08ba0 msgr2=0x55c360b59730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2431301679 shutdown_connections 2024-09-12T12:16:03.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2431301679 wait complete. 2024-09-12T12:16:03.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 -- start start 2024-09-12T12:16:03.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 Processor -- start 2024-09-12T12:16:03.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b11d40 0x55c360bcdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360bce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5abf0 0x55c360b63a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f142000f0 con 0x55c360b11d40 2024-09-12T12:16:03.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c360a1c330 con 0x55c360b5abf0 2024-09-12T12:16:03.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c360b118d0 con 0x55c360b5a2d0 2024-09-12T12:16:03.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f1e37e000 10 client.0 _ll_register_callbacks cb 0x7f9f0c009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:03.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b11d40 0x55c360bcdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b11d40 0x55c360bcdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36220/0 (socket says 172.21.15.144:36220) 2024-09-12T12:16:03.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13e00640 1 -- 172.21.15.144:0/2009283941 learned_addr learned my addr 172.21.15.144:0/2009283941 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13400640 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360bce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f19000640 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5abf0 0x55c360b63a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13e00640 1 -- 172.21.15.144:0/2009283941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 msgr2=0x55c360bce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13e00640 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360bce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13e00640 1 -- 172.21.15.144:0/2009283941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5abf0 msgr2=0x55c360b63a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13e00640 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5abf0 0x55c360b63a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13e00640 1 -- 172.21.15.144:0/2009283941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36091da50 con 0x55c360b11d40 2024-09-12T12:16:03.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13400640 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360bce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:03.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9f13e00640 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b11d40 0x55c360bcdfc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9f04004340 tx=0x7f9f040046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570c531f781a857e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.587+0000 7f9efd600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:03.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9efd600640 1 -- 172.21.15.144:0/2009283941 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0401b070 con 0x55c360b11d40 2024-09-12T12:16:03.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9efd600640 1 -- 172.21.15.144:0/2009283941 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f9f04003d30 con 0x55c360b11d40 2024-09-12T12:16:03.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2009283941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f0c031070 con 0x55c360b11d40 2024-09-12T12:16:03.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9efd600640 1 -- 172.21.15.144:0/2009283941 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9f0403c050 con 0x55c360b11d40 2024-09-12T12:16:03.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 10 client.6045 fetch_fsmap learned FSMap version 29 2024-09-12T12:16:03.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2009283941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55c3608f7b10 con 0x55c360b11d40 2024-09-12T12:16:03.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9efd600640 1 -- 172.21.15.144:0/2009283941 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c031070 con 0x55c360b11d40 2024-09-12T12:16:03.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9efd600640 1 -- 172.21.15.144:0/2009283941 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f9f0403f020 con 0x55c360b11d40 2024-09-12T12:16:03.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 10 client.6045 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T12:16:03.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 10 client.6045 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-12T12:16:03.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 20 client.6045 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:03.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c360b63fb0 0x55c360b643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 4 client.6045 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-12T12:16:03.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2009283941 --> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x55c36093ccd0 con 0x55c360b63fb0 2024-09-12T12:16:03.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f13400640 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c360b63fb0 0x55c360b643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9efd600640 10 client.6045 ms_handle_connect on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:03.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f13400640 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c360b63fb0 0x55c360b643c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab7a643ab2ada57e server_cookie=c54c657da007e9a5 in_seq=0 out_seq=0 2024-09-12T12:16:03.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9efd600640 1 -- 172.21.15.144:0/2009283941 <== mds.0 v2:172.21.15.144:6834/3957430285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c36093ccd0 con 0x55c360b63fb0 2024-09-12T12:16:03.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9efd600640 10 client.6045 handle_command_reply: tid=0 2024-09-12T12:16:03.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 client.6045 shutdown 2024-09-12T12:16:03.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2009283941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b11d40 msgr2=0x55c360bcdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b11d40 0x55c360bcdfc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9f04004340 tx=0x7f9f040046d0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2009283941 shutdown_connections 2024-09-12T12:16:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.144:6834/3957430285,v1:172.21.15.144:6836/3957430285] conn(0x55c360b63fb0 0x55c360b643c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c360b5abf0 0x55c360b63a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c360b5a2d0 0x55c360bce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9efd600640 0 client.6045 ms_handle_reset on v2:172.21.15.144:6834/3957430285 2024-09-12T12:16:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 --2- 172.21.15.144:0/2009283941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c360b11d40 0x55c360bcdfc0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2009283941 >> 172.21.15.144:0/2009283941 conn(0x55c360b08ba0 msgr2=0x55c360b6f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.591+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2009283941 shutdown_connections 2024-09-12T12:16:03.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1e37e000 1 -- 172.21.15.144:0/2009283941 wait complete. 2024-09-12T12:16:03.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1e37e000 20 client.6045 trim_cache size 0 max 16384 2024-09-12T12:16:03.606 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:16:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:16:03.606 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:16:03.606 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:16:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 -- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ef40678c0 msgr2=0x7f9ef4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ef40678c0 0x7f9ef4069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009a80 tx=0x7f9f04009190 comp rx=0 tx=0).stop 2024-09-12T12:16:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 -- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f141f4b70 msgr2=0x7f9f1415e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f141f4b70 0x7f9f1415e050 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9f00007040 tx=0x7f9ef8005840 comp rx=0 tx=0).stop 2024-09-12T12:16:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 -- 172.21.15.144:0/2439133560 shutdown_connections 2024-09-12T12:16:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ef40678c0 0x7f9ef4069d80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f140ae890 0x7f9f140aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f141f4b70 0x7f9f1415e050 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 --2- 172.21.15.144:0/2439133560 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ef8004810 0x7f9f14158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 -- 172.21.15.144:0/2439133560 >> 172.21.15.144:0/2439133560 conn(0x7f9f14068030 msgr2=0x7f9f1415f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 -- 172.21.15.144:0/2439133560 shutdown_connections 2024-09-12T12:16:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:03.595+0000 7f9f1b000640 1 -- 172.21.15.144:0/2439133560 wait complete. 2024-09-12T12:16:03.615 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-12T12:16:03.615 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:16:03.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:16:03.698 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:16:03.794 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:16:03.794 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:16:03.794 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:03.795 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:03.804 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:03.804 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:03.855 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:16:04.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.035+0000 7fc202c00640 1 Processor -- start 2024-09-12T12:16:04.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.035+0000 7fc202c00640 1 -- start start 2024-09-12T12:16:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc202c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc202c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc1fc0b5fb0 0x7fc1fc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc202c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1fc0cd870 con 0x7fc1fc15cd30 2024-09-12T12:16:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc202c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc1fc072a50 con 0x7fc1fc0b5fb0 2024-09-12T12:16:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc202c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc1fc0cde30 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc200c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc1fc0b5fb0 0x7fc1fc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc1fbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc200c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc1fc0b5fb0 0x7fc1fc072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:55910/0 (socket says 172.21.15.144:55910) 2024-09-12T12:16:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc200c00640 1 -- 172.21.15.144:0/3747590775 learned_addr learned my addr 172.21.15.144:0/3747590775 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc1fbe00640 1 -- 172.21.15.144:0/3747590775 >> v2:172.21.15.165:3300/0 conn(0x7fc1fc0b5fb0 msgr2=0x7fc1fc072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc1fbe00640 1 --2- 172.21.15.144:0/3747590775 >> v2:172.21.15.165:3300/0 conn(0x7fc1fc0b5fb0 0x7fc1fc072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc1fbe00640 1 -- 172.21.15.144:0/3747590775 >> v1:172.21.15.165:6789/0 conn(0x7fc1fc15cd30 legacy=0x7fc1fc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc1fbe00640 1 -- 172.21.15.144:0/3747590775 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1fc0cdb50 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.039+0000 7fc200c00640 1 --2- 172.21.15.144:0/3747590775 >> v2:172.21.15.165:3300/0 conn(0x7fc1fc0b5fb0 0x7fc1fc072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc1fbe00640 1 --2- 172.21.15.144:0/3747590775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ccf00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0097c0 tx=0x7fc1ec01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75d13c0ea03888c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:04.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc1faa00640 1 -- 172.21.15.144:0/3747590775 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0b1070 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc1faa00640 1 -- 172.21.15.144:0/3747590775 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ec0ac410 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc1faa00640 1 -- 172.21.15.144:0/3747590775 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0ac7e0 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 -- 172.21.15.144:0/3747590775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15c7b0 msgr2=0x7fc1fc0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 --2- 172.21.15.144:0/3747590775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ccf00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0097c0 tx=0x7fc1ec01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 -- 172.21.15.144:0/3747590775 shutdown_connections 2024-09-12T12:16:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 --2- 172.21.15.144:0/3747590775 >> v2:172.21.15.165:3300/0 conn(0x7fc1fc0b5fb0 0x7fc1fc072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 --2- 172.21.15.144:0/3747590775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ccf00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 -- 172.21.15.144:0/3747590775 >> 172.21.15.144:0/3747590775 conn(0x7fc1fc06d0d0 msgr2=0x7fc1fc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:04.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 -- 172.21.15.144:0/3747590775 shutdown_connections 2024-09-12T12:16:04.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 -- 172.21.15.144:0/3747590775 wait complete. 2024-09-12T12:16:04.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 Processor -- start 2024-09-12T12:16:04.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.043+0000 7fc202c00640 1 -- start start 2024-09-12T12:16:04.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc202c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc0b5fb0 0x7fc1fc0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:04.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc202c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:04.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc202c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15cd30 0x7fc1fc0aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:04.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc202c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc073fc0 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc202c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc1fc073e40 con 0x7fc1fc0b5fb0 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc202c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc1fc074140 con 0x7fc1fc15cd30 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36224/0 (socket says 172.21.15.144:36224) 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fb400640 1 -- 172.21.15.144:0/3328124068 learned_addr learned my addr 172.21.15.144:0/3328124068 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fbe00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc0b5fb0 0x7fc1fc0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc200c00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15cd30 0x7fc1fc0aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fb400640 1 -- 172.21.15.144:0/3328124068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15cd30 msgr2=0x7fc1fc0aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fb400640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15cd30 0x7fc1fc0aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fb400640 1 -- 172.21.15.144:0/3328124068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc0b5fb0 msgr2=0x7fc1fc0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fb400640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc0b5fb0 0x7fc1fc0b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fb400640 1 -- 172.21.15.144:0/3328124068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1fc0b4270 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fbe00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc0b5fb0 0x7fc1fc0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1fb400640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ae890 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c370 tx=0x7fc1e800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1f3e00640 1 -- 172.21.15.144:0/3328124068 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80052d0 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1f3e00640 1 -- 172.21.15.144:0/3328124068 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e8005470 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1f3e00640 1 -- 172.21.15.144:0/3328124068 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8007260 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1fc0b4550 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1fc0b4b10 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1fc072ec0 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.047+0000 7fc1f3e00640 1 -- 172.21.15.144:0/3328124068 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1e8007400 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.051+0000 7fc1f3e00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1dc0678f0 0x7fc1dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.051+0000 7fc1f3e00640 1 -- 172.21.15.144:0/3328124068 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fc1e80851d0 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.051+0000 7fc1fbe00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1dc0678f0 0x7fc1dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:04.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.051+0000 7fc1fbe00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1dc0678f0 0x7fc1dc069db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0ae000 tx=0x7fc1ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:04.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.055+0000 7fc1f3e00640 1 -- 172.21.15.144:0/3328124068 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc1e8055520 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.227+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc1fc160bc0 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.227+0000 7fc1f3e00640 1 -- 172.21.15.144:0/3328124068 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7fc1e8059820 con 0x7fc1fc15c7b0 2024-09-12T12:16:04.229 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:16:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.227+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1dc0678f0 msgr2=0x7fc1dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.227+0000 7fc202c00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1dc0678f0 0x7fc1dc069db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0ae000 tx=0x7fc1ec008040 comp rx=0 tx=0).stop 2024-09-12T12:16:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.227+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc15c7b0 msgr2=0x7fc1fc0ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.227+0000 7fc202c00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ae890 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c370 tx=0x7fc1e800c830 comp rx=0 tx=0).stop 2024-09-12T12:16:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.231+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 shutdown_connections 2024-09-12T12:16:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.231+0000 7fc202c00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1dc0678f0 0x7fc1dc069db0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.231+0000 7fc202c00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1fc15cd30 0x7fc1fc0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.231+0000 7fc202c00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1fc15c7b0 0x7fc1fc0ae890 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.231+0000 7fc202c00640 1 --2- 172.21.15.144:0/3328124068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1fc0b5fb0 0x7fc1fc0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:04.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.231+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 >> 172.21.15.144:0/3328124068 conn(0x7fc1fc06d0d0 msgr2=0x7fc1fc15d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:04.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.231+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 shutdown_connections 2024-09-12T12:16:04.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:04.231+0000 7fc202c00640 1 -- 172.21.15.144:0/3328124068 wait complete. 2024-09-12T12:16:04.251 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:16:04.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:04.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:05.527 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:16:05.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:05.528 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:16:05.538 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:16:05.538 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:16:05.538 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:05.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:16:05.547 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:16:05.547 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:05.547 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:05.591 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:16:05.591 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:16:05.592 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:16:05.592 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:05.601 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:16:05.601 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.767+0000 7f6259400640 1 Processor -- start 2024-09-12T12:16:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.767+0000 7f6259400640 1 -- start start 2024-09-12T12:16:05.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6259400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f625415c7b0 0x7f62540ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:05.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6259400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62540cd870 con 0x7f62540b5fb0 2024-09-12T12:16:05.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6259400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62540cdb50 con 0x7f625415cd30 2024-09-12T12:16:05.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6259400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6254072a50 con 0x7f625415c7b0 2024-09-12T12:16:05.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6253200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f62540b5fb0 0x7f6254072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50432/0 (socket says 172.21.15.144:50432) 2024-09-12T12:16:05.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6253200640 1 -- 172.21.15.144:0/306186890 learned_addr learned my addr 172.21.15.144:0/306186890 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6252800640 1 --2- 172.21.15.144:0/306186890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f625415c7b0 0x7f62540ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6251e00640 1 -- 172.21.15.144:0/306186890 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752594514 0 0) 0x7f62540cd870 con 0x7f62540b5fb0 2024-09-12T12:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6251e00640 1 -- 172.21.15.144:0/306186890 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6238003530 con 0x7f62540b5fb0 2024-09-12T12:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6251e00640 1 -- 172.21.15.144:0/306186890 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612571974 0 0) 0x7f62540cdb50 con 0x7f625415cd30 2024-09-12T12:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6251e00640 1 -- 172.21.15.144:0/306186890 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62540cd870 con 0x7f625415cd30 2024-09-12T12:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6252800640 1 -- 172.21.15.144:0/306186890 >> v1:172.21.15.165:6789/0 conn(0x7f625415cd30 legacy=0x7f62540b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6252800640 1 -- 172.21.15.144:0/306186890 >> v1:172.21.15.144:6789/0 conn(0x7f62540b5fb0 legacy=0x7f6254072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.771+0000 7f6252800640 1 -- 172.21.15.144:0/306186890 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62540726e0 con 0x7f625415c7b0 2024-09-12T12:16:05.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6252800640 1 --2- 172.21.15.144:0/306186890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f625415c7b0 0x7f62540ccf00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6244009dc0 tx=0x7f624401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fe1d724c86188a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:05.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6251e00640 1 -- 172.21.15.144:0/306186890 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62440b2070 con 0x7f625415c7b0 2024-09-12T12:16:05.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6251e00640 1 -- 172.21.15.144:0/306186890 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62440a5850 con 0x7f625415c7b0 2024-09-12T12:16:05.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6251e00640 1 -- 172.21.15.144:0/306186890 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62440a5c20 con 0x7f625415c7b0 2024-09-12T12:16:05.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6259400640 1 -- 172.21.15.144:0/306186890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f625415c7b0 msgr2=0x7f62540ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6259400640 1 --2- 172.21.15.144:0/306186890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f625415c7b0 0x7f62540ccf00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6244009dc0 tx=0x7f624401c990 comp rx=0 tx=0).stop 2024-09-12T12:16:05.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6259400640 1 -- 172.21.15.144:0/306186890 shutdown_connections 2024-09-12T12:16:05.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6259400640 1 --2- 172.21.15.144:0/306186890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f625415c7b0 0x7f62540ccf00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6259400640 1 -- 172.21.15.144:0/306186890 >> 172.21.15.144:0/306186890 conn(0x7f625406d0d0 msgr2=0x7f625406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:05.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6259400640 1 -- 172.21.15.144:0/306186890 shutdown_connections 2024-09-12T12:16:05.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6259400640 1 -- 172.21.15.144:0/306186890 wait complete. 2024-09-12T12:16:05.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6259400640 1 Processor -- start 2024-09-12T12:16:05.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.775+0000 7f6259400640 1 -- start start 2024-09-12T12:16:05.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6259400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62540b5fb0 0x7f625413dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:05.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6259400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f625415c7b0 0x7f62540ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:05.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6259400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f625415cd30 0x7f62540b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:05.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6259400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6254074210 con 0x7f625415cd30 2024-09-12T12:16:05.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6259400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6254074090 con 0x7f625415c7b0 2024-09-12T12:16:05.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6259400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f62540cde30 con 0x7f62540b5fb0 2024-09-12T12:16:05.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6253200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f625415cd30 0x7f62540b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:05.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6253200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f625415cd30 0x7f62540b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36226/0 (socket says 172.21.15.144:36226) 2024-09-12T12:16:05.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6253200640 1 -- 172.21.15.144:0/1868090227 learned_addr learned my addr 172.21.15.144:0/1868090227 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:05.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6249e00640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f625415c7b0 0x7f62540ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:05.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6252800640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62540b5fb0 0x7f625413dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:05.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6253200640 1 -- 172.21.15.144:0/1868090227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62540b5fb0 msgr2=0x7f625413dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6253200640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62540b5fb0 0x7f625413dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6253200640 1 -- 172.21.15.144:0/1868090227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f625415c7b0 msgr2=0x7f62540ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6253200640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f625415c7b0 0x7f62540ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6253200640 1 -- 172.21.15.144:0/1868090227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625413e530 con 0x7f625415cd30 2024-09-12T12:16:05.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6253200640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f625415cd30 0x7f62540b1cb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c420 tx=0x7f624c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:05.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f624b400640 1 -- 172.21.15.144:0/1868090227 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c017070 con 0x7f625415cd30 2024-09-12T12:16:05.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f624b400640 1 -- 172.21.15.144:0/1868090227 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c005db0 con 0x7f625415cd30 2024-09-12T12:16:05.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62540ae230 con 0x7f625415cd30 2024-09-12T12:16:05.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f624b400640 1 -- 172.21.15.144:0/1868090227 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0072f0 con 0x7f625415cd30 2024-09-12T12:16:05.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62540ae7f0 con 0x7f625415cd30 2024-09-12T12:16:05.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62540ccf00 con 0x7f625415cd30 2024-09-12T12:16:05.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.779+0000 7f624b400640 1 -- 172.21.15.144:0/1868090227 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f624c01a070 con 0x7f625415cd30 2024-09-12T12:16:05.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.783+0000 7f624b400640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62300678c0 0x7f6230069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:05.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.783+0000 7f624b400640 1 -- 172.21.15.144:0/1868090227 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f624c0851b0 con 0x7f625415cd30 2024-09-12T12:16:05.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.783+0000 7f6252800640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62300678c0 0x7f6230069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.783+0000 7f6252800640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62300678c0 0x7f6230069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f62440af000 tx=0x7f62440a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:05.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.787+0000 7f624b400640 1 -- 172.21.15.144:0/1868090227 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f624c055500 con 0x7f625415cd30 2024-09-12T12:16:05.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.979+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62540ce820 con 0x7f625415cd30 2024-09-12T12:16:05.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.979+0000 7f624b400640 1 -- 172.21.15.144:0/1868090227 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5230 (secure 0 0 0) 0x7f624c059800 con 0x7f625415cd30 2024-09-12T12:16:05.982 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:05.982 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":29,"btime":"2024-09-12T12:16:02:169923+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/149604375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":149604375},{"type":"v1","addr":"172.21.15.165:6834","nonce":149604375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3844758833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3844758833},{"type":"v1","addr":"172.21.15.144:6837","nonce":3844758833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/639962972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":639962972},{"type":"v1","addr":"172.21.15.165:6835","nonce":639962972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:15:29.364348+0000","modified":"2024-09-12T12:16:02.034824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.144:6836/3957430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3957430285},{"type":"v1","addr":"172.21.15.144:6836","nonce":3957430285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-12T12:16:05.982 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 29 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62300678c0 msgr2=0x7f6230069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62300678c0 0x7f6230069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f62440af000 tx=0x7f62440a7070 comp rx=0 tx=0).stop 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f625415cd30 msgr2=0x7f62540b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f625415cd30 0x7f62540b1cb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c420 tx=0x7f624c00c8e0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 shutdown_connections 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62300678c0 0x7f6230069d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f625415cd30 0x7f62540b1cb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f625415c7b0 0x7f62540ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 --2- 172.21.15.144:0/1868090227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62540b5fb0 0x7f625413dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 >> 172.21.15.144:0/1868090227 conn(0x7f625406d0d0 msgr2=0x7f62540ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 shutdown_connections 2024-09-12T12:16:05.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:05.983+0000 7f6259400640 1 -- 172.21.15.144:0/1868090227 wait complete. 2024-09-12T12:16:06.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:06.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.139+0000 7fb479000640 1 Processor -- start 2024-09-12T12:16:06.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.139+0000 7fb479000640 1 -- start start 2024-09-12T12:16:06.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb479000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb474071420 0x7fb474071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb479000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb4740ccf30 0x7fb4740cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb479000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4740b45a0 con 0x7fb47415b4e0 2024-09-12T12:16:06.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb479000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb4740b3fe0 con 0x7fb4740ccf30 2024-09-12T12:16:06.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb479000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb4740b42c0 con 0x7fb474071420 2024-09-12T12:16:06.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb472800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb4740ccf30 0x7fb4740cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb472800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb4740ccf30 0x7fb4740cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36230/0 (socket says 172.21.15.144:36230) 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb472800640 1 -- 172.21.15.144:0/396746171 learned_addr learned my addr 172.21.15.144:0/396746171 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb471e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb47415b4e0 0x7fb4740b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50438/0 (socket says 172.21.15.144:50438) 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb471400640 1 --2- 172.21.15.144:0/396746171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb474071420 0x7fb474071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb472800640 1 -- 172.21.15.144:0/396746171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb474071420 msgr2=0x7fb474071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb472800640 1 --2- 172.21.15.144:0/396746171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb474071420 0x7fb474071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb472800640 1 -- 172.21.15.144:0/396746171 >> v1:172.21.15.144:6789/0 conn(0x7fb47415b4e0 legacy=0x7fb4740b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb472800640 1 -- 172.21.15.144:0/396746171 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4740b1490 con 0x7fb4740ccf30 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb471400640 1 --2- 172.21.15.144:0/396746171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb474071420 0x7fb474071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:06.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb470a00640 1 -- 172.21.15.144:0/396746171 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2301592613 0 0) 0x7fb4740b45a0 con 0x7fb47415b4e0 2024-09-12T12:16:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb472800640 1 --2- 172.21.15.144:0/396746171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4740ccf30 0x7fb4740cd3e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009870 tx=0x7fb46c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651be17a7e7416d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb470a00640 1 -- 172.21.15.144:0/396746171 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0b1070 con 0x7fb4740ccf30 2024-09-12T12:16:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb470a00640 1 -- 172.21.15.144:0/396746171 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb46c0a8050 con 0x7fb4740ccf30 2024-09-12T12:16:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.143+0000 7fb470a00640 1 -- 172.21.15.144:0/396746171 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0ac860 con 0x7fb4740ccf30 2024-09-12T12:16:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 -- 172.21.15.144:0/396746171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4740ccf30 msgr2=0x7fb4740cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 --2- 172.21.15.144:0/396746171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4740ccf30 0x7fb4740cd3e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009870 tx=0x7fb46c01c560 comp rx=0 tx=0).stop 2024-09-12T12:16:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 -- 172.21.15.144:0/396746171 shutdown_connections 2024-09-12T12:16:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 --2- 172.21.15.144:0/396746171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4740ccf30 0x7fb4740cd3e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 --2- 172.21.15.144:0/396746171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb474071420 0x7fb474071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 -- 172.21.15.144:0/396746171 >> 172.21.15.144:0/396746171 conn(0x7fb47406d0d0 msgr2=0x7fb47406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 -- 172.21.15.144:0/396746171 shutdown_connections 2024-09-12T12:16:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 -- 172.21.15.144:0/396746171 wait complete. 2024-09-12T12:16:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 Processor -- start 2024-09-12T12:16:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 -- start start 2024-09-12T12:16:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb474071420 0x7fb474153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4740ccf30 0x7fb474073610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb47415b4e0 0x7fb47415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb47415b8c0 con 0x7fb474071420 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4740b02e0 con 0x7fb4740ccf30 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb479000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb474154480 con 0x7fb47415b4e0 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb471e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb474071420 0x7fb474153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb471e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb474071420 0x7fb474153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36234/0 (socket says 172.21.15.144:36234) 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb471e00640 1 -- 172.21.15.144:0/3318359520 learned_addr learned my addr 172.21.15.144:0/3318359520 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb472800640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb47415b4e0 0x7fb47415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb471400640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4740ccf30 0x7fb474073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb471e00640 1 -- 172.21.15.144:0/3318359520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb47415b4e0 msgr2=0x7fb47415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb471e00640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb47415b4e0 0x7fb47415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb471e00640 1 -- 172.21.15.144:0/3318359520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4740ccf30 msgr2=0x7fb474073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb471e00640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4740ccf30 0x7fb474073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.147+0000 7fb471e00640 1 -- 172.21.15.144:0/3318359520 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb47415be80 con 0x7fb474071420 2024-09-12T12:16:06.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb471e00640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb474071420 0x7fb474153f40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb46400c7c0 tx=0x7fb46400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb46a000640 1 -- 172.21.15.144:0/3318359520 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464018070 con 0x7fb474071420 2024-09-12T12:16:06.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb46a000640 1 -- 172.21.15.144:0/3318359520 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb46400a640 con 0x7fb474071420 2024-09-12T12:16:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb47415c160 con 0x7fb474071420 2024-09-12T12:16:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb46a000640 1 -- 172.21.15.144:0/3318359520 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46400aa30 con 0x7fb474071420 2024-09-12T12:16:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb47415c720 con 0x7fb474071420 2024-09-12T12:16:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4740cd3e0 con 0x7fb474071420 2024-09-12T12:16:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb46a000640 1 -- 172.21.15.144:0/3318359520 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb46401b070 con 0x7fb474071420 2024-09-12T12:16:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb46a000640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4540678c0 0x7fb454069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb46a000640 1 -- 172.21.15.144:0/3318359520 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fb464085400 con 0x7fb474071420 2024-09-12T12:16:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.151+0000 7fb471400640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4540678c0 0x7fb454069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.155+0000 7fb471400640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4540678c0 0x7fb454069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb474164be0 tx=0x7fb460008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.155+0000 7fb46a000640 1 -- 172.21.15.144:0/3318359520 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb464055750 con 0x7fb474071420 2024-09-12T12:16:06.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4740b60d0 con 0x7fb474071420 2024-09-12T12:16:06.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb46a000640 1 -- 172.21.15.144:0/3318359520 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5230 (secure 0 0 0) 0x7fb464059a50 con 0x7fb474071420 2024-09-12T12:16:06.353 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:06.353 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":30,"btime":"2024-09-12T12:16:06:185340+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/149604375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":149604375},{"type":"v1","addr":"172.21.15.165:6834","nonce":149604375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3844758833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3844758833},{"type":"v1","addr":"172.21.15.144:6837","nonce":3844758833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/639962972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":639962972},{"type":"v1","addr":"172.21.15.165:6835","nonce":639962972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:15:29.364348+0000","modified":"2024-09-12T12:16:06.035202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.144:6836/3957430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3957430285},{"type":"v1","addr":"172.21.15.144:6836","nonce":3957430285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-12T12:16:06.354 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 30 2024-09-12T12:16:06.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4540678c0 msgr2=0x7fb454069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4540678c0 0x7fb454069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb474164be0 tx=0x7fb460008040 comp rx=0 tx=0).stop 2024-09-12T12:16:06.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb474071420 msgr2=0x7fb474153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb474071420 0x7fb474153f40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb46400c7c0 tx=0x7fb46400cc80 comp rx=0 tx=0).stop 2024-09-12T12:16:06.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 shutdown_connections 2024-09-12T12:16:06.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4540678c0 0x7fb454069d80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb47415b4e0 0x7fb47415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4740ccf30 0x7fb474073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 --2- 172.21.15.144:0/3318359520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb474071420 0x7fb474153f40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 >> 172.21.15.144:0/3318359520 conn(0x7fb47406d0d0 msgr2=0x7fb4740b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:06.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 shutdown_connections 2024-09-12T12:16:06.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.351+0000 7fb479000640 1 -- 172.21.15.144:0/3318359520 wait complete. 2024-09-12T12:16:06.374 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:16:06.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.507+0000 7f0f6a400640 1 Processor -- start 2024-09-12T12:16:06.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.507+0000 7f0f6a400640 1 -- start start 2024-09-12T12:16:06.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f6a400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0f640cd640 0x7f0f64071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f6a400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f640b45a0 con 0x7f0f6415b4e0 2024-09-12T12:16:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f6a400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f640b3fe0 con 0x7f0f64071420 2024-09-12T12:16:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f6a400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0f640b42c0 con 0x7f0f640cd640 2024-09-12T12:16:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0f6415b4e0 0x7f0f640b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50440/0 (socket says 172.21.15.144:50440) 2024-09-12T12:16:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63400640 1 -- 172.21.15.144:0/236881119 learned_addr learned my addr 172.21.15.144:0/236881119 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63e00640 1 --2- 172.21.15.144:0/236881119 >> v2:172.21.15.165:3300/0 conn(0x7f0f640cd640 0x7f0f64071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652327766 0 0) 0x7f0f640b45a0 con 0x7f0f6415b4e0 2024-09-12T12:16:06.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f48003530 con 0x7f0f6415b4e0 2024-09-12T12:16:06.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2721581028 0 0) 0x7f0f48003530 con 0x7f0f6415b4e0 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 >> v2:172.21.15.165:3300/0 conn(0x7f0f640cd640 msgr2=0x7f0f64071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 --2- 172.21.15.144:0/236881119 >> v2:172.21.15.165:3300/0 conn(0x7f0f640cd640 0x7f0f64071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 >> v1:172.21.15.165:6789/0 conn(0x7f0f64071420 legacy=0x7f0f640ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f640b1490 con 0x7f0f6415b4e0 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f0f54001a00 con 0x7f0f6415b4e0 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 >> v1:172.21.15.144:6789/0 conn(0x7f0f6415b4e0 legacy=0x7f0f640b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f48004810 0x7f0f48004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f480051d0 0x7f0f4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640b42c0 con 0x7f0f480039c0 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4800c070 con 0x7f0f48004810 2024-09-12T12:16:06.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4800c270 con 0x7f0f480051d0 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63400640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63e00640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f480051d0 0x7f0f4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62a00640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f48004810 0x7f0f48004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63400640 1 -- 172.21.15.144:0/236881119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f480051d0 msgr2=0x7f0f4800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63400640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f480051d0 0x7f0f4800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63400640 1 -- 172.21.15.144:0/236881119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f48004810 msgr2=0x7f0f48004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63400640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f48004810 0x7f0f48004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63400640 1 -- 172.21.15.144:0/236881119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f48003530 con 0x7f0f480039c0 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f62a00640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f48004810 0x7f0f48004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:06.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.511+0000 7f0f63e00640 1 -- 172.21.15.144:0/236881119 reap_dead start 2024-09-12T12:16:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f63400640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f48003de0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400a840 tx=0x7f0f5401d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9061452b8286241 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400a460 con 0x7f0f480039c0 2024-09-12T12:16:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f540ad650 con 0x7f0f480039c0 2024-09-12T12:16:06.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f62000640 1 -- 172.21.15.144:0/236881119 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540ada80 con 0x7f0f480039c0 2024-09-12T12:16:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f6a400640 1 -- 172.21.15.144:0/236881119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 msgr2=0x7f0f48003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f6a400640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f48003de0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400a840 tx=0x7f0f5401d2b0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f6a400640 1 -- 172.21.15.144:0/236881119 shutdown_connections 2024-09-12T12:16:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f6a400640 1 --2- 172.21.15.144:0/236881119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f48003de0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f6a400640 1 -- 172.21.15.144:0/236881119 >> 172.21.15.144:0/236881119 conn(0x7f0f6406d0d0 msgr2=0x7f0f6406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f6a400640 1 -- 172.21.15.144:0/236881119 shutdown_connections 2024-09-12T12:16:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f6a400640 1 -- 172.21.15.144:0/236881119 wait complete. 2024-09-12T12:16:06.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f6a400640 1 Processor -- start 2024-09-12T12:16:06.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.515+0000 7f0f6a400640 1 -- start start 2024-09-12T12:16:06.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f6a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f6415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f6a400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6415d160 0x7f0f64152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f6a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f64153120 0x7f0f641535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f6a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6415b8c0 con 0x7f0f480039c0 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f6a400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640b3da0 con 0x7f0f6415d160 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f6a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6415d910 con 0x7f0f64153120 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f6415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f6415cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36258/0 (socket says 172.21.15.144:36258) 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63400640 1 -- 172.21.15.144:0/611535486 learned_addr learned my addr 172.21.15.144:0/611535486 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f62a00640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6415d160 0x7f0f64152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63e00640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f64153120 0x7f0f641535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63400640 1 -- 172.21.15.144:0/611535486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f64153120 msgr2=0x7f0f641535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f64153120 0x7f0f641535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63400640 1 -- 172.21.15.144:0/611535486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6415d160 msgr2=0x7f0f64152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6415d160 0x7f0f64152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63400640 1 -- 172.21.15.144:0/611535486 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6415dbf0 con 0x7f0f480039c0 2024-09-12T12:16:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f63400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f6415cc20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0f5401cd20 tx=0x7f0f48005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f5b400640 1 -- 172.21.15.144:0/611535486 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540ad430 con 0x7f0f480039c0 2024-09-12T12:16:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f5b400640 1 -- 172.21.15.144:0/611535486 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54001800 con 0x7f0f480039c0 2024-09-12T12:16:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6415ded0 con 0x7f0f480039c0 2024-09-12T12:16:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f5b400640 1 -- 172.21.15.144:0/611535486 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54004d90 con 0x7f0f480039c0 2024-09-12T12:16:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6415e490 con 0x7f0f480039c0 2024-09-12T12:16:06.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.519+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f640d15d0 con 0x7f0f480039c0 2024-09-12T12:16:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.523+0000 7f0f5b400640 1 -- 172.21.15.144:0/611535486 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f540be060 con 0x7f0f480039c0 2024-09-12T12:16:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.523+0000 7f0f5b400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f440678f0 0x7f0f44069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.523+0000 7f0f5b400640 1 -- 172.21.15.144:0/611535486 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f0f5411fa70 con 0x7f0f480039c0 2024-09-12T12:16:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.523+0000 7f0f62a00640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f440678f0 0x7f0f44069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.523+0000 7f0f62a00640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f440678f0 0x7f0f44069db0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0f50007fd0 tx=0x7f0f50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.527+0000 7f0f5b400640 1 -- 172.21.15.144:0/611535486 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f54016ff0 con 0x7f0f480039c0 2024-09-12T12:16:06.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.687+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f640b45a0 con 0x7f0f480039c0 2024-09-12T12:16:06.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.687+0000 7f0f5b400640 1 -- 172.21.15.144:0/611535486 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+17026 (secure 0 0 0) 0x7f0f540efdd0 con 0x7f0f480039c0 2024-09-12T12:16:06.690 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:06.690 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":54,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:15:30.990121+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:15:27.094655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T12:15:28.370982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f440678f0 msgr2=0x7f0f44069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f440678f0 0x7f0f44069db0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0f50007fd0 tx=0x7f0f50009040 comp rx=0 tx=0).stop 2024-09-12T12:16:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 msgr2=0x7f0f6415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f6415cc20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0f5401cd20 tx=0x7f0f48005840 comp rx=0 tx=0).stop 2024-09-12T12:16:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 shutdown_connections 2024-09-12T12:16:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0f440678f0 0x7f0f44069db0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f64153120 0x7f0f641535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6415d160 0x7f0f64152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 --2- 172.21.15.144:0/611535486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f480039c0 0x7f0f6415cc20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 >> 172.21.15.144:0/611535486 conn(0x7f0f6406d0d0 msgr2=0x7f0f640b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 shutdown_connections 2024-09-12T12:16:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.691+0000 7f0f6a400640 1 -- 172.21.15.144:0/611535486 wait complete. 2024-09-12T12:16:06.712 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:16:06.712 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:06.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.843+0000 7f42c2a00640 1 Processor -- start 2024-09-12T12:16:06.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.843+0000 7f42c2a00640 1 -- start start 2024-09-12T12:16:06.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42bc15b4e0 0x7f42bc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42c2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f42bc0b3ad0 0x7f42bc071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42c2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc071960 0x7f42bc0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42c2a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f42bc0b45a0 con 0x7f42bc15b4e0 2024-09-12T12:16:06.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42c2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f42bc0b3fe0 con 0x7f42bc0b3ad0 2024-09-12T12:16:06.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42c2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42bc0b42c0 con 0x7f42bc071960 2024-09-12T12:16:06.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42bbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42bc15b4e0 0x7f42bc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42bbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42bc15b4e0 0x7f42bc0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36264/0 (socket says 172.21.15.144:36264) 2024-09-12T12:16:06.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42bbe00640 1 -- 172.21.15.144:0/2446272713 learned_addr learned my addr 172.21.15.144:0/2446272713 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42bb400640 1 --2- 172.21.15.144:0/2446272713 >> v2:172.21.15.165:3300/0 conn(0x7f42bc0b3ad0 0x7f42bc071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42c0a00640 1 --2- 172.21.15.144:0/2446272713 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc071960 0x7f42bc0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42bbe00640 1 -- 172.21.15.144:0/2446272713 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc071960 msgr2=0x7f42bc0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42bbe00640 1 --2- 172.21.15.144:0/2446272713 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc071960 0x7f42bc0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42bbe00640 1 -- 172.21.15.144:0/2446272713 >> v2:172.21.15.165:3300/0 conn(0x7f42bc0b3ad0 msgr2=0x7f42bc071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42bbe00640 1 --2- 172.21.15.144:0/2446272713 >> v2:172.21.15.165:3300/0 conn(0x7f42bc0b3ad0 0x7f42bc071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.847+0000 7f42bbe00640 1 -- 172.21.15.144:0/2446272713 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc0b1490 con 0x7f42bc15b4e0 2024-09-12T12:16:06.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42bbe00640 1 --2- 172.21.15.144:0/2446272713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 0x7f42bc0b3590 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0b02b0 tx=0x7f42ac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d243c3137517d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42baa00640 1 -- 172.21.15.144:0/2446272713 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0b1070 con 0x7f42bc15b4e0 2024-09-12T12:16:06.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42baa00640 1 -- 172.21.15.144:0/2446272713 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac0ac620 con 0x7f42bc15b4e0 2024-09-12T12:16:06.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42baa00640 1 -- 172.21.15.144:0/2446272713 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0ac9f0 con 0x7f42bc15b4e0 2024-09-12T12:16:06.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 -- 172.21.15.144:0/2446272713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 msgr2=0x7f42bc0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2446272713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 0x7f42bc0b3590 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0b02b0 tx=0x7f42ac01c4f0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 -- 172.21.15.144:0/2446272713 shutdown_connections 2024-09-12T12:16:06.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2446272713 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc071960 0x7f42bc0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2446272713 >> v2:172.21.15.165:3300/0 conn(0x7f42bc0b3ad0 0x7f42bc071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2446272713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 0x7f42bc0b3590 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 -- 172.21.15.144:0/2446272713 >> 172.21.15.144:0/2446272713 conn(0x7f42bc06d0d0 msgr2=0x7f42bc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:06.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 -- 172.21.15.144:0/2446272713 shutdown_connections 2024-09-12T12:16:06.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 -- 172.21.15.144:0/2446272713 wait complete. 2024-09-12T12:16:06.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 Processor -- start 2024-09-12T12:16:06.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.851+0000 7f42c2a00640 1 -- start start 2024-09-12T12:16:06.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42bc071960 0x7f42bc154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc0b3ad0 0x7f42bc1fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 0x7f42bc0aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc15f270 con 0x7f42bc15b4e0 2024-09-12T12:16:06.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc15f0f0 con 0x7f42bc071960 2024-09-12T12:16:06.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42bc15f3f0 con 0x7f42bc0b3ad0 2024-09-12T12:16:06.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 0x7f42bc0aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 0x7f42bc0aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36266/0 (socket says 172.21.15.144:36266) 2024-09-12T12:16:06.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c0a00640 1 -- 172.21.15.144:0/2612343167 learned_addr learned my addr 172.21.15.144:0/2612343167 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:06.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42bb400640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc0b3ad0 0x7f42bc1fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42bbe00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42bc071960 0x7f42bc154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c0a00640 1 -- 172.21.15.144:0/2612343167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc0b3ad0 msgr2=0x7f42bc1fba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c0a00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc0b3ad0 0x7f42bc1fba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c0a00640 1 -- 172.21.15.144:0/2612343167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42bc071960 msgr2=0x7f42bc154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c0a00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42bc071960 0x7f42bc154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c0a00640 1 -- 172.21.15.144:0/2612343167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc1fbf80 con 0x7f42bc15b4e0 2024-09-12T12:16:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c0a00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 0x7f42bc0aa480 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f42b4007e30 tx=0x7f42b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42b3e00640 1 -- 172.21.15.144:0/2612343167 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4014620 con 0x7f42bc15b4e0 2024-09-12T12:16:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42b3e00640 1 -- 172.21.15.144:0/2612343167 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b4019070 con 0x7f42bc15b4e0 2024-09-12T12:16:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42b3e00640 1 -- 172.21.15.144:0/2612343167 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4014a00 con 0x7f42bc15b4e0 2024-09-12T12:16:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42bc15d890 con 0x7f42bc15b4e0 2024-09-12T12:16:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42bc155570 con 0x7f42bc15b4e0 2024-09-12T12:16:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42bc071420 con 0x7f42bc15b4e0 2024-09-12T12:16:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.855+0000 7f42b3e00640 1 -- 172.21.15.144:0/2612343167 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42b4014ba0 con 0x7f42bc15b4e0 2024-09-12T12:16:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.859+0000 7f42b3e00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f429c0678c0 0x7f429c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.859+0000 7f42b3e00640 1 -- 172.21.15.144:0/2612343167 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f42b40865c0 con 0x7f42bc15b4e0 2024-09-12T12:16:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.859+0000 7f42bbe00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f429c0678c0 0x7f429c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.859+0000 7f42bbe00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f429c0678c0 0x7f429c069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0ae000 tx=0x7f42ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:06.863+0000 7f42b3e00640 1 -- 172.21.15.144:0/2612343167 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42bc1fbf80 con 0x7f42bc15b4e0 2024-09-12T12:16:07.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.051+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42bc1653a0 con 0x7f42bc15b4e0 2024-09-12T12:16:07.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.051+0000 7f42b3e00640 1 -- 172.21.15.144:0/2612343167 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5230 (secure 0 0 0) 0x7f42b4056880 con 0x7f42bc15b4e0 2024-09-12T12:16:07.055 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:07.055 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":30,"btime":"2024-09-12T12:16:06:185340+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/149604375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":149604375},{"type":"v1","addr":"172.21.15.165:6834","nonce":149604375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3844758833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3844758833},{"type":"v1","addr":"172.21.15.144:6837","nonce":3844758833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/639962972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":639962972},{"type":"v1","addr":"172.21.15.165:6835","nonce":639962972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:15:29.364348+0000","modified":"2024-09-12T12:16:06.035202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.144:6836/3957430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3957430285},{"type":"v1","addr":"172.21.15.144:6836","nonce":3957430285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-12T12:16:07.056 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 30 2024-09-12T12:16:07.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f429c0678c0 msgr2=0x7f429c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f429c0678c0 0x7f429c069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0ae000 tx=0x7f42ac008040 comp rx=0 tx=0).stop 2024-09-12T12:16:07.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 msgr2=0x7f42bc0aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 0x7f42bc0aa480 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f42b4007e30 tx=0x7f42b400e4b0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 shutdown_connections 2024-09-12T12:16:07.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f429c0678c0 0x7f429c069d80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42bc15b4e0 0x7f42bc0aa480 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42bc0b3ad0 0x7f42bc1fba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 --2- 172.21.15.144:0/2612343167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42bc071960 0x7f42bc154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 >> 172.21.15.144:0/2612343167 conn(0x7f42bc06d0d0 msgr2=0x7f42bc15a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:07.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 shutdown_connections 2024-09-12T12:16:07.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.055+0000 7f42c2a00640 1 -- 172.21.15.144:0/2612343167 wait complete. 2024-09-12T12:16:07.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:07.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce47800640 1 Processor -- start 2024-09-12T12:16:07.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce47800640 1 -- start start 2024-09-12T12:16:07.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce47800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce400d2b70 0x7fce400b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce47800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fce400b7380 0x7fce40073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce47800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4015c9b0 con 0x7fce40159e60 2024-09-12T12:16:07.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce47800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fce4015d560 con 0x7fce400d2b70 2024-09-12T12:16:07.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce47800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fce4015cc30 con 0x7fce400b7380 2024-09-12T12:16:07.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce3fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce400d2b70 0x7fce400b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce3fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce400d2b70 0x7fce400b6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57378/0 (socket says 172.21.15.144:57378) 2024-09-12T12:16:07.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce3fe00640 1 -- 172.21.15.144:0/3024290634 learned_addr learned my addr 172.21.15.144:0/3024290634 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:07.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce45800640 1 --2- 172.21.15.144:0/3024290634 >> v2:172.21.15.165:3300/0 conn(0x7fce400b7380 0x7fce40073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce3fe00640 1 -- 172.21.15.144:0/3024290634 >> v2:172.21.15.165:3300/0 conn(0x7fce400b7380 msgr2=0x7fce40073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:07.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce3fe00640 1 --2- 172.21.15.144:0/3024290634 >> v2:172.21.15.165:3300/0 conn(0x7fce400b7380 0x7fce40073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce3fe00640 1 -- 172.21.15.144:0/3024290634 >> v1:172.21.15.165:6789/0 conn(0x7fce40159e60 legacy=0x7fce400d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.211+0000 7fce3fe00640 1 -- 172.21.15.144:0/3024290634 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4015cf10 con 0x7fce400d2b70 2024-09-12T12:16:07.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce3fe00640 1 --2- 172.21.15.144:0/3024290634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce400d2b70 0x7fce400b6e40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fce400cf5b0 tx=0x7fce2c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4c2358d01981d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:07.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce3f400640 1 -- 172.21.15.144:0/3024290634 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0ab430 con 0x7fce400d2b70 2024-09-12T12:16:07.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce3f400640 1 -- 172.21.15.144:0/3024290634 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2c0b0070 con 0x7fce400d2b70 2024-09-12T12:16:07.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce3f400640 1 -- 172.21.15.144:0/3024290634 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0ab7f0 con 0x7fce400d2b70 2024-09-12T12:16:07.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce47800640 1 -- 172.21.15.144:0/3024290634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce400d2b70 msgr2=0x7fce400b6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce47800640 1 --2- 172.21.15.144:0/3024290634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce400d2b70 0x7fce400b6e40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fce400cf5b0 tx=0x7fce2c01c520 comp rx=0 tx=0).stop 2024-09-12T12:16:07.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce47800640 1 -- 172.21.15.144:0/3024290634 shutdown_connections 2024-09-12T12:16:07.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce47800640 1 --2- 172.21.15.144:0/3024290634 >> v2:172.21.15.165:3300/0 conn(0x7fce400b7380 0x7fce40073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce47800640 1 --2- 172.21.15.144:0/3024290634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce400d2b70 0x7fce400b6e40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce47800640 1 -- 172.21.15.144:0/3024290634 >> 172.21.15.144:0/3024290634 conn(0x7fce40067a00 msgr2=0x7fce40067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:07.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce47800640 1 -- 172.21.15.144:0/3024290634 shutdown_connections 2024-09-12T12:16:07.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.215+0000 7fce47800640 1 -- 172.21.15.144:0/3024290634 wait complete. 2024-09-12T12:16:07.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 Processor -- start 2024-09-12T12:16:07.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 -- start start 2024-09-12T12:16:07.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce400b7380 0x7fce4014da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce400d2b70 0x7fce401564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce40159e60 0x7fce4006cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce4015a3c0 con 0x7fce40159e60 2024-09-12T12:16:07.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce4015a240 con 0x7fce400d2b70 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce40169110 con 0x7fce400b7380 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce45800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce40159e60 0x7fce4006cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce45800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce40159e60 0x7fce4006cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57394/0 (socket says 172.21.15.144:57394) 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce45800640 1 -- 172.21.15.144:0/1820480833 learned_addr learned my addr 172.21.15.144:0/1820480833 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce44e00640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce400b7380 0x7fce4014da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce3fe00640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce400d2b70 0x7fce401564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce45800640 1 -- 172.21.15.144:0/1820480833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce400b7380 msgr2=0x7fce4014da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce45800640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce400b7380 0x7fce4014da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce45800640 1 -- 172.21.15.144:0/1820480833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce400d2b70 msgr2=0x7fce401564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce45800640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce400d2b70 0x7fce401564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce45800640 1 -- 172.21.15.144:0/1820480833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4013af50 con 0x7fce40159e60 2024-09-12T12:16:07.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce45800640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce40159e60 0x7fce4006cd90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fce38007e40 tx=0x7fce3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:07.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce3cc00640 1 -- 172.21.15.144:0/1820480833 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38014620 con 0x7fce40159e60 2024-09-12T12:16:07.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce3cc00640 1 -- 172.21.15.144:0/1820480833 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce38019070 con 0x7fce40159e60 2024-09-12T12:16:07.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4013b230 con 0x7fce40159e60 2024-09-12T12:16:07.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce3cc00640 1 -- 172.21.15.144:0/1820480833 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38014a20 con 0x7fce40159e60 2024-09-12T12:16:07.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.219+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4013b7f0 con 0x7fce40159e60 2024-09-12T12:16:07.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.223+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce40073370 con 0x7fce40159e60 2024-09-12T12:16:07.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.223+0000 7fce3cc00640 1 -- 172.21.15.144:0/1820480833 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce38014bc0 con 0x7fce40159e60 2024-09-12T12:16:07.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.223+0000 7fce3cc00640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce200678f0 0x7fce20069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.223+0000 7fce3cc00640 1 -- 172.21.15.144:0/1820480833 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fce380864c0 con 0x7fce40159e60 2024-09-12T12:16:07.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.223+0000 7fce44e00640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce200678f0 0x7fce20069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.223+0000 7fce44e00640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce200678f0 0x7fce20069db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce30001770 tx=0x7fce30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:07.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.227+0000 7fce3cc00640 1 -- 172.21.15.144:0/1820480833 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fce380568b0 con 0x7fce40159e60 2024-09-12T12:16:07.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.415+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce40067f10 con 0x7fce40159e60 2024-09-12T12:16:07.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.415+0000 7fce3cc00640 1 -- 172.21.15.144:0/1820480833 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5230 (secure 0 0 0) 0x7fce3805abb0 con 0x7fce40159e60 2024-09-12T12:16:07.418 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:07.418 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":30,"btime":"2024-09-12T12:16:06:185340+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/149604375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":149604375},{"type":"v1","addr":"172.21.15.165:6834","nonce":149604375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3844758833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3844758833},{"type":"v1","addr":"172.21.15.144:6837","nonce":3844758833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/639962972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":639962972},{"type":"v1","addr":"172.21.15.165:6835","nonce":639962972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:15:29.364348+0000","modified":"2024-09-12T12:16:06.035202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.144:6836/3957430285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3957430285},{"type":"v1","addr":"172.21.15.144:6836","nonce":3957430285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-12T12:16:07.419 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 30 2024-09-12T12:16:07.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce200678f0 msgr2=0x7fce20069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce200678f0 0x7fce20069db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fce30001770 tx=0x7fce30009040 comp rx=0 tx=0).stop 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce40159e60 msgr2=0x7fce4006cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce40159e60 0x7fce4006cd90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fce38007e40 tx=0x7fce3800e4b0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 shutdown_connections 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce200678f0 0x7fce20069db0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce40159e60 0x7fce4006cd90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce400d2b70 0x7fce401564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 --2- 172.21.15.144:0/1820480833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce400b7380 0x7fce4014da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 >> 172.21.15.144:0/1820480833 conn(0x7fce40067a00 msgr2=0x7fce400b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 shutdown_connections 2024-09-12T12:16:07.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.419+0000 7fce47800640 1 -- 172.21.15.144:0/1820480833 wait complete. 2024-09-12T12:16:07.440 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:16:07.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.575+0000 7fd35e200640 1 Processor -- start 2024-09-12T12:16:07.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.575+0000 7fd35e200640 1 -- start start 2024-09-12T12:16:07.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd35e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd358071420 0x7fd358071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd35e200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd3580ccf30 0x7fd3580cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd35e200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3580cd890 con 0x7fd35815b4e0 2024-09-12T12:16:07.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd35e200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd3580b45a0 con 0x7fd358071420 2024-09-12T12:16:07.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd35e200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd3580b3fe0 con 0x7fd3580ccf30 2024-09-12T12:16:07.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd357400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd35815b4e0 0x7fd3580b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43714/0 (socket says 172.21.15.144:43714) 2024-09-12T12:16:07.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd357400640 1 -- 172.21.15.144:0/402850868 learned_addr learned my addr 172.21.15.144:0/402850868 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:07.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd356a00640 1 --2- 172.21.15.144:0/402850868 >> v2:172.21.15.144:3300/0 conn(0x7fd358071420 0x7fd358071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd357e00640 1 --2- 172.21.15.144:0/402850868 >> v2:172.21.15.165:3300/0 conn(0x7fd3580ccf30 0x7fd3580cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd356000640 1 -- 172.21.15.144:0/402850868 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839903795 0 0) 0x7fd3580cd890 con 0x7fd35815b4e0 2024-09-12T12:16:07.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd356000640 1 -- 172.21.15.144:0/402850868 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd33c003530 con 0x7fd35815b4e0 2024-09-12T12:16:07.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd356a00640 1 -- 172.21.15.144:0/402850868 >> v2:172.21.15.165:3300/0 conn(0x7fd3580ccf30 msgr2=0x7fd3580cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:07.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd356a00640 1 --2- 172.21.15.144:0/402850868 >> v2:172.21.15.165:3300/0 conn(0x7fd3580ccf30 0x7fd3580cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd356a00640 1 -- 172.21.15.144:0/402850868 >> v1:172.21.15.144:6789/0 conn(0x7fd35815b4e0 legacy=0x7fd3580b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd356a00640 1 -- 172.21.15.144:0/402850868 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3580b42c0 con 0x7fd358071420 2024-09-12T12:16:07.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.579+0000 7fd356a00640 1 --2- 172.21.15.144:0/402850868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd358071420 0x7fd358071840 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd3580d0480 tx=0x7fd34401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb9697be293a512 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:07.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd356000640 1 -- 172.21.15.144:0/402850868 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3440ab650 con 0x7fd358071420 2024-09-12T12:16:07.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd356000640 1 -- 172.21.15.144:0/402850868 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3440b0070 con 0x7fd358071420 2024-09-12T12:16:07.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd356000640 1 -- 172.21.15.144:0/402850868 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3440ab9f0 con 0x7fd358071420 2024-09-12T12:16:07.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 -- 172.21.15.144:0/402850868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd358071420 msgr2=0x7fd358071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 --2- 172.21.15.144:0/402850868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd358071420 0x7fd358071840 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd3580d0480 tx=0x7fd34401c450 comp rx=0 tx=0).stop 2024-09-12T12:16:07.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 -- 172.21.15.144:0/402850868 shutdown_connections 2024-09-12T12:16:07.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 --2- 172.21.15.144:0/402850868 >> v2:172.21.15.165:3300/0 conn(0x7fd3580ccf30 0x7fd3580cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 --2- 172.21.15.144:0/402850868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd358071420 0x7fd358071840 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 -- 172.21.15.144:0/402850868 >> 172.21.15.144:0/402850868 conn(0x7fd35806d0d0 msgr2=0x7fd35806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:07.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 -- 172.21.15.144:0/402850868 shutdown_connections 2024-09-12T12:16:07.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 -- 172.21.15.144:0/402850868 wait complete. 2024-09-12T12:16:07.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 Processor -- start 2024-09-12T12:16:07.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 -- start start 2024-09-12T12:16:07.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd358071420 0x7fd358157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3580ccf30 0x7fd3581f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd35815b4e0 0x7fd3581565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd35815b8c0 con 0x7fd35815b4e0 2024-09-12T12:16:07.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3580cdef0 con 0x7fd3580ccf30 2024-09-12T12:16:07.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd35e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3581f79e0 con 0x7fd358071420 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd357e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd35815b4e0 0x7fd3581565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd357e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd35815b4e0 0x7fd3581565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57414/0 (socket says 172.21.15.144:57414) 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd357e00640 1 -- 172.21.15.144:0/2482670372 learned_addr learned my addr 172.21.15.144:0/2482670372 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd356a00640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3580ccf30 0x7fd3581f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.583+0000 7fd357400640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd358071420 0x7fd358157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd357e00640 1 -- 172.21.15.144:0/2482670372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd358071420 msgr2=0x7fd358157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd357e00640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd358071420 0x7fd358157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd357e00640 1 -- 172.21.15.144:0/2482670372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3580ccf30 msgr2=0x7fd3581f7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd357e00640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3580ccf30 0x7fd3581f7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd357e00640 1 -- 172.21.15.144:0/2482670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3581f70c0 con 0x7fd35815b4e0 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd357e00640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd35815b4e0 0x7fd3581565b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd350009dd0 tx=0x7fd35000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd34f400640 1 -- 172.21.15.144:0/2482670372 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350018020 con 0x7fd35815b4e0 2024-09-12T12:16:07.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd34f400640 1 -- 172.21.15.144:0/2482670372 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd350014480 con 0x7fd35815b4e0 2024-09-12T12:16:07.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd34f400640 1 -- 172.21.15.144:0/2482670372 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350014870 con 0x7fd35815b4e0 2024-09-12T12:16:07.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd358156db0 con 0x7fd35815b4e0 2024-09-12T12:16:07.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3581f7670 con 0x7fd35815b4e0 2024-09-12T12:16:07.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd358071840 con 0x7fd35815b4e0 2024-09-12T12:16:07.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd34f400640 1 -- 172.21.15.144:0/2482670372 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd35001b020 con 0x7fd35815b4e0 2024-09-12T12:16:07.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.587+0000 7fd34f400640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3380678c0 0x7fd338069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.591+0000 7fd34f400640 1 -- 172.21.15.144:0/2482670372 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7fd3500867d0 con 0x7fd35815b4e0 2024-09-12T12:16:07.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.591+0000 7fd357400640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3380678c0 0x7fd338069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.591+0000 7fd357400640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3380678c0 0x7fd338069d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd348007fd0 tx=0x7fd348009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:07.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.595+0000 7fd34f400640 1 -- 172.21.15.144:0/2482670372 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd350022070 con 0x7fd35815b4e0 2024-09-12T12:16:07.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.751+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd35815acf0 con 0x7fd35815b4e0 2024-09-12T12:16:07.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd34f400640 1 -- 172.21.15.144:0/2482670372 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+17026 (secure 0 0 0) 0x7fd350010040 con 0x7fd35815b4e0 2024-09-12T12:16:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:07.757 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":54,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:15:30.990121+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:15:27.094655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T12:15:28.370982+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:07.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3380678c0 msgr2=0x7fd338069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3380678c0 0x7fd338069d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd348007fd0 tx=0x7fd348009040 comp rx=0 tx=0).stop 2024-09-12T12:16:07.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd35815b4e0 msgr2=0x7fd3581565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd35815b4e0 0x7fd3581565b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd350009dd0 tx=0x7fd35000c490 comp rx=0 tx=0).stop 2024-09-12T12:16:07.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 shutdown_connections 2024-09-12T12:16:07.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3380678c0 0x7fd338069d80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd35815b4e0 0x7fd3581565b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3580ccf30 0x7fd3581f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 --2- 172.21.15.144:0/2482670372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd358071420 0x7fd358157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 >> 172.21.15.144:0/2482670372 conn(0x7fd35806d0d0 msgr2=0x7fd35815dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:07.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 shutdown_connections 2024-09-12T12:16:07.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.755+0000 7fd35e200640 1 -- 172.21.15.144:0/2482670372 wait complete. 2024-09-12T12:16:07.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:16:07.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f9a00640 1 Processor -- start 2024-09-12T12:16:07.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f9a00640 1 -- start start 2024-09-12T12:16:07.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f9a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 0x7f17f4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f9a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f17f4073bd0 0x7f17f40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f9a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f17f40cd000 0x7f17f40cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f9a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f17f415b540 con 0x7f17f4073bd0 2024-09-12T12:16:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f9a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f17f40cd4a0 con 0x7f17f40cd000 2024-09-12T12:16:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f9a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40cd780 con 0x7f17f415b160 2024-09-12T12:16:07.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17eb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f17f4073bd0 0x7f17f40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17eb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f17f4073bd0 0x7f17f40ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57428/0 (socket says 172.21.15.144:57428) 2024-09-12T12:16:07.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17eb400640 1 -- 172.21.15.144:0/2196995176 learned_addr learned my addr 172.21.15.144:0/2196995176 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:07.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f9000640 1 --2- 172.21.15.144:0/2196995176 >> v2:172.21.15.165:3300/0 conn(0x7f17f40cd000 0x7f17f40cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17f3e00640 1 --2- 172.21.15.144:0/2196995176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 0x7f17f4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17eb400640 1 -- 172.21.15.144:0/2196995176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 msgr2=0x7f17f4070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:07.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17eb400640 1 --2- 172.21.15.144:0/2196995176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 0x7f17f4070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17eb400640 1 -- 172.21.15.144:0/2196995176 >> v2:172.21.15.165:3300/0 conn(0x7f17f40cd000 msgr2=0x7f17f40cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:07.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17eb400640 1 --2- 172.21.15.144:0/2196995176 >> v2:172.21.15.165:3300/0 conn(0x7f17f40cd000 0x7f17f40cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.915+0000 7f17eb400640 1 -- 172.21.15.144:0/2196995176 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f40b3180 con 0x7f17f4073bd0 2024-09-12T12:16:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17eb400640 1 --2- 172.21.15.144:0/2196995176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f4073bd0 0x7f17f40ccac0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f17f40cf680 tx=0x7f17dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36f39bf08b8e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f3400640 1 -- 172.21.15.144:0/2196995176 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0b0070 con 0x7f17f4073bd0 2024-09-12T12:16:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f3400640 1 -- 172.21.15.144:0/2196995176 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17dc0ab600 con 0x7f17f4073bd0 2024-09-12T12:16:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f3400640 1 -- 172.21.15.144:0/2196995176 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0ab9d0 con 0x7f17f4073bd0 2024-09-12T12:16:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f9a00640 1 -- 172.21.15.144:0/2196995176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f4073bd0 msgr2=0x7f17f40ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2196995176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f4073bd0 0x7f17f40ccac0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f17f40cf680 tx=0x7f17dc01c490 comp rx=0 tx=0).stop 2024-09-12T12:16:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f9a00640 1 -- 172.21.15.144:0/2196995176 shutdown_connections 2024-09-12T12:16:07.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2196995176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f4073bd0 0x7f17f40ccac0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2196995176 >> v2:172.21.15.165:3300/0 conn(0x7f17f40cd000 0x7f17f40cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2196995176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 0x7f17f4070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f9a00640 1 -- 172.21.15.144:0/2196995176 >> 172.21.15.144:0/2196995176 conn(0x7f17f406bc10 msgr2=0x7f17f406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:07.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f9a00640 1 -- 172.21.15.144:0/2196995176 shutdown_connections 2024-09-12T12:16:07.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.919+0000 7f17f9a00640 1 -- 172.21.15.144:0/2196995176 wait complete. 2024-09-12T12:16:07.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 Processor -- start 2024-09-12T12:16:07.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 -- start start 2024-09-12T12:16:07.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17f4073bd0 0x7f17f40b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f40cd000 0x7f17f4148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 0x7f17f40c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40b4520 con 0x7f17f40cd000 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40b43a0 con 0x7f17f4073bd0 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40b46a0 con 0x7f17f415b160 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f40cd000 0x7f17f4148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f40cd000 0x7f17f4148d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57430/0 (socket says 172.21.15.144:57430) 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17eb400640 1 -- 172.21.15.144:0/2815787193 learned_addr learned my addr 172.21.15.144:0/2815787193 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f3e00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17f4073bd0 0x7f17f40b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9000640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 0x7f17f40c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17eb400640 1 -- 172.21.15.144:0/2815787193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 msgr2=0x7f17f40c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17eb400640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 0x7f17f40c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17eb400640 1 -- 172.21.15.144:0/2815787193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17f4073bd0 msgr2=0x7f17f40b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17eb400640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17f4073bd0 0x7f17f40b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17eb400640 1 -- 172.21.15.144:0/2815787193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f40b17b0 con 0x7f17f40cd000 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f3e00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17f4073bd0 0x7f17f40b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17eb400640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f40cd000 0x7f17f4148d10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0ae040 tx=0x7f17dc019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f0c00640 1 -- 172.21.15.144:0/2815787193 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0b0040 con 0x7f17f40cd000 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f0c00640 1 -- 172.21.15.144:0/2815787193 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17dc0b9070 con 0x7f17f40cd000 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f0c00640 1 -- 172.21.15.144:0/2815787193 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0b38a0 con 0x7f17f40cd000 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f40b1a90 con 0x7f17f40cd000 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f40b2050 con 0x7f17f40cd000 2024-09-12T12:16:07.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.923+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f40cff90 con 0x7f17f40cd000 2024-09-12T12:16:07.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.927+0000 7f17f0c00640 1 -- 172.21.15.144:0/2815787193 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17dc0b3a40 con 0x7f17f40cd000 2024-09-12T12:16:07.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.927+0000 7f17f0c00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17d00678c0 0x7f17d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:07.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.927+0000 7f17f0c00640 1 -- 172.21.15.144:0/2815787193 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6101+0+0 (secure 0 0 0) 0x7f17dc11fb80 con 0x7f17f40cd000 2024-09-12T12:16:07.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.927+0000 7f17f3e00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17d00678c0 0x7f17d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:07.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.927+0000 7f17f3e00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17d00678c0 0x7f17d0069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f17e40073f0 tx=0x7f17e400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:07.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:07.931+0000 7f17f0c00640 1 -- 172.21.15.144:0/2815787193 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f17dc016110 con 0x7f17f40cd000 2024-09-12T12:16:08.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.119+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f17f415e3c0 con 0x7f17f40cd000 2024-09-12T12:16:08.122 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:16:08.119+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:16:08.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f0c00640 1 -- 172.21.15.144:0/2815787193 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f17dc0f0640 con 0x7f17f40cd000 2024-09-12T12:16:08.124 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:16:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17d00678c0 msgr2=0x7f17d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17d00678c0 0x7f17d0069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f17e40073f0 tx=0x7f17e400b040 comp rx=0 tx=0).stop 2024-09-12T12:16:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f40cd000 msgr2=0x7f17f4148d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f40cd000 0x7f17f4148d10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0ae040 tx=0x7f17dc019230 comp rx=0 tx=0).stop 2024-09-12T12:16:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 shutdown_connections 2024-09-12T12:16:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17d00678c0 0x7f17d0069d80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17f415b160 0x7f17f40c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17f40cd000 0x7f17f4148d10 secure :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0ae040 tx=0x7f17dc019230 comp rx=0 tx=0).stop 2024-09-12T12:16:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 --2- 172.21.15.144:0/2815787193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17f4073bd0 0x7f17f40b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.123+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 >> 172.21.15.144:0/2815787193 conn(0x7f17f406bc10 msgr2=0x7f17f4159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:08.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.127+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 shutdown_connections 2024-09-12T12:16:08.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.127+0000 7f17f9a00640 1 -- 172.21.15.144:0/2815787193 wait complete. 2024-09-12T12:16:08.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:16:08.197 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:16:08.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f221d600640 1 Processor -- start 2024-09-12T12:16:08.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f221d600640 1 -- start start 2024-09-12T12:16:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f221d600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f221815c2e0 0x7f2218072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f221d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 0x7f22180cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f221d600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22180733e0 con 0x7f22180af5f0 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f221d600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f22180cd290 con 0x7f221815c2e0 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f221d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f22180cd570 con 0x7f221806c320 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2217400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 0x7f22180cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2216a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f221815c2e0 0x7f2218072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2216000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f22180af5f0 0x7f221806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:46674/0 (socket says 172.21.15.144:46674) 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2216000640 1 -- 172.21.15.144:0/1071470293 learned_addr learned my addr 172.21.15.144:0/1071470293 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2217400640 1 --2- 172.21.15.144:0/1071470293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 0x7f22180cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40346/0 (socket says 172.21.15.144:40346) 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2216a00640 1 --2- 172.21.15.144:0/1071470293 >> v2:172.21.15.165:3300/0 conn(0x7f221815c2e0 0x7f2218072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:59078/0 (socket says 172.21.15.144:59078) 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2216a00640 1 -- 172.21.15.144:0/1071470293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 msgr2=0x7f22180cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2216a00640 1 --2- 172.21.15.144:0/1071470293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 0x7f22180cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2216a00640 1 -- 172.21.15.144:0/1071470293 >> v1:172.21.15.165:6789/0 conn(0x7f22180af5f0 legacy=0x7f221806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.291+0000 7f2216a00640 1 -- 172.21.15.144:0/1071470293 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22180cd850 con 0x7f221815c2e0 2024-09-12T12:16:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f2216a00640 1 --2- 172.21.15.144:0/1071470293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f221815c2e0 0x7f2218072b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f22080097c0 tx=0x7f220801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd9464b85e200 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f2215600640 1 -- 172.21.15.144:0/1071470293 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22080b0070 con 0x7f221815c2e0 2024-09-12T12:16:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f2215600640 1 -- 172.21.15.144:0/1071470293 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22080ab600 con 0x7f221815c2e0 2024-09-12T12:16:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f2215600640 1 -- 172.21.15.144:0/1071470293 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22080ab9d0 con 0x7f221815c2e0 2024-09-12T12:16:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f221d600640 1 -- 172.21.15.144:0/1071470293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f221815c2e0 msgr2=0x7f2218072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f221d600640 1 --2- 172.21.15.144:0/1071470293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f221815c2e0 0x7f2218072b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f22080097c0 tx=0x7f220801c380 comp rx=0 tx=0).stop 2024-09-12T12:16:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f221d600640 1 -- 172.21.15.144:0/1071470293 shutdown_connections 2024-09-12T12:16:08.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f221d600640 1 --2- 172.21.15.144:0/1071470293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 0x7f22180cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f221d600640 1 --2- 172.21.15.144:0/1071470293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f221815c2e0 0x7f2218072b50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f221d600640 1 -- 172.21.15.144:0/1071470293 >> 172.21.15.144:0/1071470293 conn(0x7f2218068030 msgr2=0x7f22180b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f221d600640 1 -- 172.21.15.144:0/1071470293 shutdown_connections 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.295+0000 7f221d600640 1 -- 172.21.15.144:0/1071470293 wait complete. 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 Processor -- start 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 -- start start 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 0x7f221814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22180af5f0 0x7f22181fb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f221815c2e0 0x7f22180aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f22180cee50 con 0x7f221815c2e0 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f22180cecd0 con 0x7f22180af5f0 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f22180cefd0 con 0x7f221806c320 2024-09-12T12:16:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2217400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f221815c2e0 0x7f22180aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2217400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f221815c2e0 0x7f22180aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57466/0 (socket says 172.21.15.144:57466) 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2217400640 1 -- 172.21.15.144:0/1354185641 learned_addr learned my addr 172.21.15.144:0/1354185641 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2216000640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22180af5f0 0x7f22181fb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2216a00640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 0x7f221814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2217400640 1 -- 172.21.15.144:0/1354185641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 msgr2=0x7f221814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2217400640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 0x7f221814c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2217400640 1 -- 172.21.15.144:0/1354185641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22180af5f0 msgr2=0x7f22181fb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2217400640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22180af5f0 0x7f22181fb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2217400640 1 -- 172.21.15.144:0/1354185641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22181fb780 con 0x7f221815c2e0 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2216000640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22180af5f0 0x7f22181fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f2217400640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f221815c2e0 0x7f22180aff60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2210009d30 tx=0x7f221000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f220ea00640 1 -- 172.21.15.144:0/1354185641 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210018020 con 0x7f221815c2e0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f220ea00640 1 -- 172.21.15.144:0/1354185641 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2210014480 con 0x7f221815c2e0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22181f7450 con 0x7f221815c2e0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f220ea00640 1 -- 172.21.15.144:0/1354185641 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210014870 con 0x7f221815c2e0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22181f7a10 con 0x7f221815c2e0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.299+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22180cdd70 con 0x7f221815c2e0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.303+0000 7f220ea00640 1 -- 172.21.15.144:0/1354185641 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f221001b020 con 0x7f221815c2e0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.303+0000 7f220ea00640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21f80678f0 0x7f21f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.303+0000 7f220ea00640 1 -- 172.21.15.144:0/1354185641 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f22100868e0 con 0x7f221815c2e0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.303+0000 7f2216a00640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21f80678f0 0x7f21f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.303+0000 7f2216a00640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21f80678f0 0x7f21f8069db0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22080ad000 tx=0x7f22080a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.307+0000 7f220ea00640 1 -- 172.21.15.144:0/1354185641 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2210022070 con 0x7f221815c2e0 2024-09-12T12:16:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:08.499+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f221815a200 con 0x7f221815c2e0 2024-09-12T12:16:09.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.195+0000 7f220ea00640 1 -- 172.21.15.144:0/1354185641 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f22181fb780 con 0x7f221815c2e0 2024-09-12T12:16:09.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21f80678f0 msgr2=0x7f21f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21f80678f0 0x7f21f8069db0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f22080ad000 tx=0x7f22080a6000 comp rx=0 tx=0).stop 2024-09-12T12:16:09.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f221815c2e0 msgr2=0x7f22180aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f221815c2e0 0x7f22180aff60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2210009d30 tx=0x7f221000c490 comp rx=0 tx=0).stop 2024-09-12T12:16:09.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 shutdown_connections 2024-09-12T12:16:09.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21f80678f0 0x7f21f8069db0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f221815c2e0 0x7f22180aff60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f22180af5f0 0x7f22181fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 --2- 172.21.15.144:0/1354185641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f221806c320 0x7f221814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 >> 172.21.15.144:0/1354185641 conn(0x7f2218068030 msgr2=0x7f22180ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:09.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 shutdown_connections 2024-09-12T12:16:09.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.199+0000 7f221d600640 1 -- 172.21.15.144:0/1354185641 wait complete. 2024-09-12T12:16:09.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:16:09.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f104da00640 1 Processor -- start 2024-09-12T12:16:09.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f104da00640 1 -- start start 2024-09-12T12:16:09.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f104da00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1048145e80 0x7f104806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f104da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104815dd20 0x7f10480d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f104da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10480c6480 0x7f10480c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f104da00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f104806c1f0 con 0x7f10480c6480 2024-09-12T12:16:09.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f104da00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f104806c4d0 con 0x7f1048145e80 2024-09-12T12:16:09.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f104da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1048072120 con 0x7f104815dd20 2024-09-12T12:16:09.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1047400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10480c6480 0x7f10480c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1047400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10480c6480 0x7f10480c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57482/0 (socket says 172.21.15.144:57482) 2024-09-12T12:16:09.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1047400640 1 -- 172.21.15.144:0/425031191 learned_addr learned my addr 172.21.15.144:0/425031191 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:09.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1046a00640 1 --2- 172.21.15.144:0/425031191 >> v2:172.21.15.165:3300/0 conn(0x7f1048145e80 0x7f104806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1046000640 1 --2- 172.21.15.144:0/425031191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104815dd20 0x7f10480d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1047400640 1 -- 172.21.15.144:0/425031191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104815dd20 msgr2=0x7f10480d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:09.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1047400640 1 --2- 172.21.15.144:0/425031191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104815dd20 0x7f10480d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1047400640 1 -- 172.21.15.144:0/425031191 >> v2:172.21.15.165:3300/0 conn(0x7f1048145e80 msgr2=0x7f104806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:09.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1047400640 1 --2- 172.21.15.144:0/425031191 >> v2:172.21.15.165:3300/0 conn(0x7f1048145e80 0x7f104806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1047400640 1 -- 172.21.15.144:0/425031191 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1048072400 con 0x7f10480c6480 2024-09-12T12:16:09.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.411+0000 7f1046a00640 1 --2- 172.21.15.144:0/425031191 >> v2:172.21.15.165:3300/0 conn(0x7f1048145e80 0x7f104806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:09.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f1047400640 1 --2- 172.21.15.144:0/425031191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10480c6480 0x7f10480c6910 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f10480717b0 tx=0x7f104001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e9ce59b22fc32c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:09.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f1045600640 1 -- 172.21.15.144:0/425031191 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400a5780 con 0x7f10480c6480 2024-09-12T12:16:09.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f1045600640 1 -- 172.21.15.144:0/425031191 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10400a5920 con 0x7f10480c6480 2024-09-12T12:16:09.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f1045600640 1 -- 172.21.15.144:0/425031191 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10400a5cf0 con 0x7f10480c6480 2024-09-12T12:16:09.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f104da00640 1 -- 172.21.15.144:0/425031191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10480c6480 msgr2=0x7f10480c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f104da00640 1 --2- 172.21.15.144:0/425031191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10480c6480 0x7f10480c6910 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f10480717b0 tx=0x7f104001c9f0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f104da00640 1 -- 172.21.15.144:0/425031191 shutdown_connections 2024-09-12T12:16:09.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f104da00640 1 --2- 172.21.15.144:0/425031191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10480c6480 0x7f10480c6910 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f104da00640 1 --2- 172.21.15.144:0/425031191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f104815dd20 0x7f10480d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f104da00640 1 --2- 172.21.15.144:0/425031191 >> v2:172.21.15.165:3300/0 conn(0x7f1048145e80 0x7f104806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f104da00640 1 -- 172.21.15.144:0/425031191 >> 172.21.15.144:0/425031191 conn(0x7f104806cd20 msgr2=0x7f104806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:09.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f104da00640 1 -- 172.21.15.144:0/425031191 shutdown_connections 2024-09-12T12:16:09.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.415+0000 7f104da00640 1 -- 172.21.15.144:0/425031191 wait complete. 2024-09-12T12:16:09.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 Processor -- start 2024-09-12T12:16:09.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 -- start start 2024-09-12T12:16:09.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10480c6480 0x7f104815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1048145e80 0x7f104813a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104815dd20 0x7f1048144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10480732b0 con 0x7f1048145e80 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1048073130 con 0x7f104815dd20 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1048073430 con 0x7f10480c6480 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1048145e80 0x7f104813a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1048145e80 0x7f104813a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57486/0 (socket says 172.21.15.144:57486) 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046000640 1 -- 172.21.15.144:0/3092417687 learned_addr learned my addr 172.21.15.144:0/3092417687 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046a00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10480c6480 0x7f104815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1047400640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104815dd20 0x7f1048144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046000640 1 -- 172.21.15.144:0/3092417687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10480c6480 msgr2=0x7f104815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046000640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10480c6480 0x7f104815bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046000640 1 -- 172.21.15.144:0/3092417687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104815dd20 msgr2=0x7f1048144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046000640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104815dd20 0x7f1048144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046000640 1 -- 172.21.15.144:0/3092417687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104813ad10 con 0x7f1048145e80 2024-09-12T12:16:09.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f1046000640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1048145e80 0x7f104813a250 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1034006e90 tx=0x7f103400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:09.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f103ea00640 1 -- 172.21.15.144:0/3092417687 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103400b6c0 con 0x7f1048145e80 2024-09-12T12:16:09.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f103ea00640 1 -- 172.21.15.144:0/3092417687 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1034019070 con 0x7f1048145e80 2024-09-12T12:16:09.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1048135cb0 con 0x7f1048145e80 2024-09-12T12:16:09.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f103ea00640 1 -- 172.21.15.144:0/3092417687 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103400bac0 con 0x7f1048145e80 2024-09-12T12:16:09.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.419+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1048136550 con 0x7f1048145e80 2024-09-12T12:16:09.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.423+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104806bc10 con 0x7f1048145e80 2024-09-12T12:16:09.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.423+0000 7f103ea00640 1 -- 172.21.15.144:0/3092417687 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f103400bc60 con 0x7f1048145e80 2024-09-12T12:16:09.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.423+0000 7f103ea00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10280678c0 0x7f1028069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.423+0000 7f103ea00640 1 -- 172.21.15.144:0/3092417687 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6187+0+0 (secure 0 0 0) 0x7f1034086230 con 0x7f1048145e80 2024-09-12T12:16:09.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.423+0000 7f1046a00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10280678c0 0x7f1028069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.423+0000 7f1046a00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10280678c0 0x7f1028069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f10380098d0 tx=0x7f1038008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:09.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.427+0000 7f103ea00640 1 -- 172.21.15.144:0/3092417687 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f10340564a0 con 0x7f1048145e80 2024-09-12T12:16:09.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:09.587+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1048136720 con 0x7f1048145e80 2024-09-12T12:16:10.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.207+0000 7f103ea00640 1 -- 172.21.15.144:0/3092417687 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) ==== 181+0+0 (secure 0 0 0) 0x7f103405a7a0 con 0x7f1048145e80 2024-09-12T12:16:10.210 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10280678c0 msgr2=0x7f1028069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10280678c0 0x7f1028069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f10380098d0 tx=0x7f1038008040 comp rx=0 tx=0).stop 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1048145e80 msgr2=0x7f104813a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1048145e80 0x7f104813a250 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1034006e90 tx=0x7f103400dc60 comp rx=0 tx=0).stop 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 shutdown_connections 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10280678c0 0x7f1028069d80 secure :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f10380098d0 tx=0x7f1038008040 comp rx=0 tx=0).stop 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104815dd20 0x7f1048144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1048145e80 0x7f104813a250 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 --2- 172.21.15.144:0/3092417687 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10480c6480 0x7f104815bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 >> 172.21.15.144:0/3092417687 conn(0x7f104806cd20 msgr2=0x7f1048166940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:10.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 shutdown_connections 2024-09-12T12:16:10.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.211+0000 7f104da00640 1 -- 172.21.15.144:0/3092417687 wait complete. 2024-09-12T12:16:10.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:16:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dcce00640 1 Processor -- start 2024-09-12T12:16:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dcce00640 1 -- start start 2024-09-12T12:16:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dcce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dc8073fc0 0x7f5dc806e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dcce00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc806ed10 con 0x7f5dc815e610 2024-09-12T12:16:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dcce00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc815eda0 con 0x7f5dc806e880 2024-09-12T12:16:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dcce00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc815f9b0 con 0x7f5dc8073fc0 2024-09-12T12:16:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dc5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dc8073fc0 0x7f5dc806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dc5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5dc815e610 0x7f5dc80738b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43720/0 (socket says 172.21.15.144:43720) 2024-09-12T12:16:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dc5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dc8073fc0 0x7f5dc806e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57492/0 (socket says 172.21.15.144:57492) 2024-09-12T12:16:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dc5e00640 1 -- 172.21.15.144:0/1743288682 learned_addr learned my addr 172.21.15.144:0/1743288682 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dc5400640 1 -- 172.21.15.144:0/1743288682 >> v1:172.21.15.165:6789/0 conn(0x7f5dc806e880 legacy=0x7f5dc806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dc5400640 1 -- 172.21.15.144:0/1743288682 >> v1:172.21.15.144:6789/0 conn(0x7f5dc815e610 legacy=0x7f5dc80738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dc5400640 1 -- 172.21.15.144:0/1743288682 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc815f080 con 0x7f5dc8073fc0 2024-09-12T12:16:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.375+0000 7f5dc4a00640 1 -- 172.21.15.144:0/1743288682 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652508536 0 0) 0x7f5dc806ed10 con 0x7f5dc815e610 2024-09-12T12:16:10.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dc5400640 1 --2- 172.21.15.144:0/1743288682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc8073fc0 0x7f5dc806e340 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5dc815fb30 tx=0x7f5db401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9d34656d448799 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:10.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dc4a00640 1 -- 172.21.15.144:0/1743288682 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db40b0070 con 0x7f5dc8073fc0 2024-09-12T12:16:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dc4a00640 1 -- 172.21.15.144:0/1743288682 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db4004230 con 0x7f5dc8073fc0 2024-09-12T12:16:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dc4a00640 1 -- 172.21.15.144:0/1743288682 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4003620 con 0x7f5dc8073fc0 2024-09-12T12:16:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dcce00640 1 -- 172.21.15.144:0/1743288682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc8073fc0 msgr2=0x7f5dc806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dcce00640 1 --2- 172.21.15.144:0/1743288682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc8073fc0 0x7f5dc806e340 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5dc815fb30 tx=0x7f5db401c460 comp rx=0 tx=0).stop 2024-09-12T12:16:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dcce00640 1 -- 172.21.15.144:0/1743288682 shutdown_connections 2024-09-12T12:16:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dcce00640 1 --2- 172.21.15.144:0/1743288682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc8073fc0 0x7f5dc806e340 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dcce00640 1 -- 172.21.15.144:0/1743288682 >> 172.21.15.144:0/1743288682 conn(0x7f5dc8067a00 msgr2=0x7f5dc8067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dcce00640 1 -- 172.21.15.144:0/1743288682 shutdown_connections 2024-09-12T12:16:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.379+0000 7f5dcce00640 1 -- 172.21.15.144:0/1743288682 wait complete. 2024-09-12T12:16:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 Processor -- start 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 -- start start 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dc806e880 0x7f5dc80cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dc8073fc0 0x7f5dc814a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc815e610 0x7f5dc814a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc806de50 con 0x7f5dc815e610 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc806dcd0 con 0x7f5dc8073fc0 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc816c1a0 con 0x7f5dc806e880 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc815e610 0x7f5dc814a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc815e610 0x7f5dc814a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57496/0 (socket says 172.21.15.144:57496) 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc6800640 1 -- 172.21.15.144:0/947291386 learned_addr learned my addr 172.21.15.144:0/947291386 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc5e00640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dc806e880 0x7f5dc80cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc5400640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dc8073fc0 0x7f5dc814a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc6800640 1 -- 172.21.15.144:0/947291386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dc806e880 msgr2=0x7f5dc80cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc6800640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dc806e880 0x7f5dc80cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc6800640 1 -- 172.21.15.144:0/947291386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dc8073fc0 msgr2=0x7f5dc814a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc6800640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dc8073fc0 0x7f5dc814a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc6800640 1 -- 172.21.15.144:0/947291386 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc80cc380 con 0x7f5dc815e610 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dc6800640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc815e610 0x7f5dc814a640 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000c3c0 tx=0x7f5dc000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dbe000640 1 -- 172.21.15.144:0/947291386 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0011790 con 0x7f5dc815e610 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dbe000640 1 -- 172.21.15.144:0/947291386 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc0017070 con 0x7f5dc815e610 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc814b030 con 0x7f5dc815e610 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dbe000640 1 -- 172.21.15.144:0/947291386 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0011b70 con 0x7f5dc815e610 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc80ccbe0 con 0x7f5dc815e610 2024-09-12T12:16:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.383+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc806e340 con 0x7f5dc815e610 2024-09-12T12:16:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.387+0000 7f5dbe000640 1 -- 172.21.15.144:0/947291386 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5dc0011d10 con 0x7f5dc815e610 2024-09-12T12:16:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.387+0000 7f5dbe000640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5da80678c0 0x7f5da8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.387+0000 7f5dbe000640 1 -- 172.21.15.144:0/947291386 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5749+0+0 (secure 0 0 0) 0x7f5dc0085a00 con 0x7f5dc815e610 2024-09-12T12:16:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.387+0000 7f5dc5e00640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5da80678c0 0x7f5da8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.387+0000 7f5dc5e00640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5da80678c0 0x7f5da8069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5db80012f0 tx=0x7f5db8001690 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.391+0000 7f5dbe000640 1 -- 172.21.15.144:0/947291386 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5dc0055e20 con 0x7f5dc815e610 2024-09-12T12:16:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:10.551+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5dc8157ca0 con 0x7f5dc815e610 2024-09-12T12:16:11.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.207+0000 7f5dbe000640 1 -- 172.21.15.144:0/947291386 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) ==== 169+0+0 (secure 0 0 0) 0x7f5dc005a120 con 0x7f5dc815e610 2024-09-12T12:16:11.212 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:16:11.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.211+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5da80678c0 msgr2=0x7f5da8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.211+0000 7f5dcce00640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5da80678c0 0x7f5da8069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5db80012f0 tx=0x7f5db8001690 comp rx=0 tx=0).stop 2024-09-12T12:16:11.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.211+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc815e610 msgr2=0x7f5dc814a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.211+0000 7f5dcce00640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc815e610 0x7f5dc814a640 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000c3c0 tx=0x7f5dc000c880 comp rx=0 tx=0).stop 2024-09-12T12:16:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.215+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 shutdown_connections 2024-09-12T12:16:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.215+0000 7f5dcce00640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5da80678c0 0x7f5da8069d80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.215+0000 7f5dcce00640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc815e610 0x7f5dc814a640 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.215+0000 7f5dcce00640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dc8073fc0 0x7f5dc814a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.215+0000 7f5dcce00640 1 --2- 172.21.15.144:0/947291386 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dc806e880 0x7f5dc80cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.215+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 >> 172.21.15.144:0/947291386 conn(0x7f5dc8067a00 msgr2=0x7f5dc8161430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:11.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.215+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 shutdown_connections 2024-09-12T12:16:11.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.215+0000 7f5dcce00640 1 -- 172.21.15.144:0/947291386 wait complete. 2024-09-12T12:16:11.242 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:16:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb43200640 1 Processor -- start 2024-09-12T12:16:11.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb43200640 1 -- start start 2024-09-12T12:16:11.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb43200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb4415e5f0 0x7fbb440d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb43200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440b6580 0x7fbb440b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb43200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb4415e9d0 con 0x7fbb440cf810 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb43200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbb440d25d0 con 0x7fbb4415e5f0 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb43200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbb440d28b0 con 0x7fbb440b6580 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb41e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb4415e5f0 0x7fbb440d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb41e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb4415e5f0 0x7fbb440d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57504/0 (socket says 172.21.15.144:57504) 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.379+0000 7fbb41e00640 1 -- 172.21.15.144:0/1702888940 learned_addr learned my addr 172.21.15.144:0/1702888940 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb41e00640 1 -- 172.21.15.144:0/1702888940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440b6580 msgr2=0x7fbb440b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb41e00640 1 --2- 172.21.15.144:0/1702888940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440b6580 0x7fbb440b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb41e00640 1 -- 172.21.15.144:0/1702888940 >> v1:172.21.15.165:6789/0 conn(0x7fbb440cf810 legacy=0x7fbb440b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb41e00640 1 -- 172.21.15.144:0/1702888940 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb440d2b90 con 0x7fbb4415e5f0 2024-09-12T12:16:11.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb41e00640 1 --2- 172.21.15.144:0/1702888940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4415e5f0 0x7fbb440d38c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009e50 tx=0x7fbb3401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85809a25660fd22d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb40a00640 1 -- 172.21.15.144:0/1702888940 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340b4070 con 0x7fbb4415e5f0 2024-09-12T12:16:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb40a00640 1 -- 172.21.15.144:0/1702888940 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb340af400 con 0x7fbb4415e5f0 2024-09-12T12:16:11.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb40a00640 1 -- 172.21.15.144:0/1702888940 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340af7d0 con 0x7fbb4415e5f0 2024-09-12T12:16:11.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb43200640 1 -- 172.21.15.144:0/1702888940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4415e5f0 msgr2=0x7fbb440d38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.383+0000 7fbb43200640 1 --2- 172.21.15.144:0/1702888940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4415e5f0 0x7fbb440d38c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009e50 tx=0x7fbb3401f1e0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 -- 172.21.15.144:0/1702888940 shutdown_connections 2024-09-12T12:16:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 --2- 172.21.15.144:0/1702888940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440b6580 0x7fbb440b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 --2- 172.21.15.144:0/1702888940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4415e5f0 0x7fbb440d38c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 -- 172.21.15.144:0/1702888940 >> 172.21.15.144:0/1702888940 conn(0x7fbb440d1040 msgr2=0x7fbb440d1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 -- 172.21.15.144:0/1702888940 shutdown_connections 2024-09-12T12:16:11.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 -- 172.21.15.144:0/1702888940 wait complete. 2024-09-12T12:16:11.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 Processor -- start 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 -- start start 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb440b6580 0x7fbb441574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4415e5f0 0x7fbb440cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440cba00 0x7fbb440cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbb440d3e00 con 0x7fbb440b6580 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbb440d3150 con 0x7fbb4415e5f0 2024-09-12T12:16:11.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbb440d3f80 con 0x7fbb440cba00 2024-09-12T12:16:11.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb440b6580 0x7fbb441574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb440b6580 0x7fbb441574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57512/0 (socket says 172.21.15.144:57512) 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41e00640 1 -- 172.21.15.144:0/1941846290 learned_addr learned my addr 172.21.15.144:0/1941846290 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb42800640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440cba00 0x7fbb440cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41400640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4415e5f0 0x7fbb440cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41e00640 1 -- 172.21.15.144:0/1941846290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440cba00 msgr2=0x7fbb440cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41e00640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440cba00 0x7fbb440cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41e00640 1 -- 172.21.15.144:0/1941846290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4415e5f0 msgr2=0x7fbb440cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41e00640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4415e5f0 0x7fbb440cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41e00640 1 -- 172.21.15.144:0/1941846290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb440cbf60 con 0x7fbb440b6580 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb42800640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440cba00 0x7fbb440cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb41e00640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb440b6580 0x7fbb441574f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbb3401d890 tx=0x7fbb3401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb3a000640 1 -- 172.21.15.144:0/1941846290 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340b4040 con 0x7fbb440b6580 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb3a000640 1 -- 172.21.15.144:0/1941846290 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb340c1070 con 0x7fbb440b6580 2024-09-12T12:16:11.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb440cc240 con 0x7fbb440b6580 2024-09-12T12:16:11.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.387+0000 7fbb3a000640 1 -- 172.21.15.144:0/1941846290 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340b96a0 con 0x7fbb440b6580 2024-09-12T12:16:11.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.391+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb441e3d50 con 0x7fbb440b6580 2024-09-12T12:16:11.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.391+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb440d38c0 con 0x7fbb440b6580 2024-09-12T12:16:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.391+0000 7fbb3a000640 1 -- 172.21.15.144:0/1941846290 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbb340b7070 con 0x7fbb440b6580 2024-09-12T12:16:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.391+0000 7fbb3a000640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb240678c0 0x7fbb24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.391+0000 7fbb3a000640 1 -- 172.21.15.144:0/1941846290 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fbb34123df0 con 0x7fbb440b6580 2024-09-12T12:16:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.391+0000 7fbb41400640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb240678c0 0x7fbb24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.391+0000 7fbb41400640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb240678c0 0x7fbb24069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb440b5890 tx=0x7fbb30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.395+0000 7fbb3a000640 1 -- 172.21.15.144:0/1941846290 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbb34018d40 con 0x7fbb440b6580 2024-09-12T12:16:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.567+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbb4415cef0 con 0x7fbb440b6580 2024-09-12T12:16:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.575+0000 7fbb3a000640 1 -- 172.21.15.144:0/1941846290 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fbb340f4ac0 con 0x7fbb440b6580 2024-09-12T12:16:11.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb240678c0 msgr2=0x7fbb24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb240678c0 0x7fbb24069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb440b5890 tx=0x7fbb30009040 comp rx=0 tx=0).stop 2024-09-12T12:16:11.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb440b6580 msgr2=0x7fbb441574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb440b6580 0x7fbb441574f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbb3401d890 tx=0x7fbb3401bf80 comp rx=0 tx=0).stop 2024-09-12T12:16:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 shutdown_connections 2024-09-12T12:16:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb240678c0 0x7fbb24069d80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb440cba00 0x7fbb440cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4415e5f0 0x7fbb440cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 --2- 172.21.15.144:0/1941846290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb440b6580 0x7fbb441574f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 >> 172.21.15.144:0/1941846290 conn(0x7fbb440d1040 msgr2=0x7fbb4415d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:11.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 shutdown_connections 2024-09-12T12:16:11.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.583+0000 7fbb43200640 1 -- 172.21.15.144:0/1941846290 wait complete. 2024-09-12T12:16:11.610 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-12T12:16:11.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.743+0000 7f2463c00640 1 Processor -- start 2024-09-12T12:16:11.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.743+0000 7f2463c00640 1 -- start start 2024-09-12T12:16:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f2463c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f245c071420 0x7f245c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f2463c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f245c0b45a0 con 0x7f245c15b4e0 2024-09-12T12:16:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f2463c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f245c0b3fe0 con 0x7f245c0ccf30 2024-09-12T12:16:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f2463c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f245c0b42c0 con 0x7f245c071420 2024-09-12T12:16:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f2461200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f245c15b4e0 0x7f245c0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43734/0 (socket says 172.21.15.144:43734) 2024-09-12T12:16:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f2461200640 1 -- 172.21.15.144:0/3659062115 learned_addr learned my addr 172.21.15.144:0/3659062115 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f245be00640 1 --2- 172.21.15.144:0/3659062115 >> v2:172.21.15.165:3300/0 conn(0x7f245c071420 0x7f245c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f245b400640 1 -- 172.21.15.144:0/3659062115 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380059480 0 0) 0x7f245c0b45a0 con 0x7f245c15b4e0 2024-09-12T12:16:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f245b400640 1 -- 172.21.15.144:0/3659062115 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2440005740 con 0x7f245c15b4e0 2024-09-12T12:16:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f245b400640 1 -- 172.21.15.144:0/3659062115 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2805886697 0 0) 0x7f245c0b3fe0 con 0x7f245c0ccf30 2024-09-12T12:16:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f245b400640 1 -- 172.21.15.144:0/3659062115 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f245c0b45a0 con 0x7f245c0ccf30 2024-09-12T12:16:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f245b400640 1 -- 172.21.15.144:0/3659062115 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3822332417 0 0) 0x7f2440005740 con 0x7f245c15b4e0 2024-09-12T12:16:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f245be00640 1 -- 172.21.15.144:0/3659062115 >> v1:172.21.15.165:6789/0 conn(0x7f245c0ccf30 legacy=0x7f245c0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f245be00640 1 -- 172.21.15.144:0/3659062115 >> v1:172.21.15.144:6789/0 conn(0x7f245c15b4e0 legacy=0x7f245c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.747+0000 7f245be00640 1 -- 172.21.15.144:0/3659062115 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c0b1490 con 0x7f245c071420 2024-09-12T12:16:11.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f245be00640 1 --2- 172.21.15.144:0/3659062115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f245c071420 0x7f245c071840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24480097c0 tx=0x7f244801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=925b63fe929884bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f245b400640 1 -- 172.21.15.144:0/3659062115 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24480b0070 con 0x7f245c071420 2024-09-12T12:16:11.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f245b400640 1 -- 172.21.15.144:0/3659062115 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24480ab400 con 0x7f245c071420 2024-09-12T12:16:11.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f245b400640 1 -- 172.21.15.144:0/3659062115 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c001680 con 0x7f245c071420 2024-09-12T12:16:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 -- 172.21.15.144:0/3659062115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f245c071420 msgr2=0x7f245c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 --2- 172.21.15.144:0/3659062115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f245c071420 0x7f245c071840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24480097c0 tx=0x7f244801c390 comp rx=0 tx=0).stop 2024-09-12T12:16:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 -- 172.21.15.144:0/3659062115 shutdown_connections 2024-09-12T12:16:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 --2- 172.21.15.144:0/3659062115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f245c071420 0x7f245c071840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 -- 172.21.15.144:0/3659062115 >> 172.21.15.144:0/3659062115 conn(0x7f245c06d0d0 msgr2=0x7f245c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 -- 172.21.15.144:0/3659062115 shutdown_connections 2024-09-12T12:16:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 -- 172.21.15.144:0/3659062115 wait complete. 2024-09-12T12:16:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 Processor -- start 2024-09-12T12:16:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 -- start start 2024-09-12T12:16:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f245c071420 0x7f245c15d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245c0ccf30 0x7f245c15e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f245c15b4e0 0x7f245c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f245c15b8c0 con 0x7f245c0ccf30 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f245c0b02e0 con 0x7f245c15b4e0 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f2463c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f245c0cedf0 con 0x7f245c071420 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.751+0000 7f245be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245c0ccf30 0x7f245c15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f245be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245c0ccf30 0x7f245c15e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57516/0 (socket says 172.21.15.144:57516) 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f245be00640 1 -- 172.21.15.144:0/2676901870 learned_addr learned my addr 172.21.15.144:0/2676901870 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2461200640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f245c071420 0x7f245c15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2461c00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f245c15b4e0 0x7f245c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f245be00640 1 -- 172.21.15.144:0/2676901870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f245c071420 msgr2=0x7f245c15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f245be00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f245c071420 0x7f245c15d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f245be00640 1 -- 172.21.15.144:0/2676901870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f245c15b4e0 msgr2=0x7f245c1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f245be00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f245c15b4e0 0x7f245c1503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f245be00640 1 -- 172.21.15.144:0/2676901870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c15da40 con 0x7f245c0ccf30 2024-09-12T12:16:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f245be00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245c0ccf30 0x7f245c15e700 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2448000c10 tx=0x7f2448019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2458c00640 1 -- 172.21.15.144:0/2676901870 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24480b9020 con 0x7f245c0ccf30 2024-09-12T12:16:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2458c00640 1 -- 172.21.15.144:0/2676901870 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24480038a0 con 0x7f245c0ccf30 2024-09-12T12:16:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2458c00640 1 -- 172.21.15.144:0/2676901870 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24480b0040 con 0x7f245c0ccf30 2024-09-12T12:16:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c0cf040 con 0x7f245c0ccf30 2024-09-12T12:16:11.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c0cf600 con 0x7f245c0ccf30 2024-09-12T12:16:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f245c071840 con 0x7f245c0ccf30 2024-09-12T12:16:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2458c00640 1 -- 172.21.15.144:0/2676901870 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24480bc020 con 0x7f245c0ccf30 2024-09-12T12:16:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2458c00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f243c0678c0 0x7f243c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.755+0000 7f2458c00640 1 -- 172.21.15.144:0/2676901870 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f244811f930 con 0x7f245c0ccf30 2024-09-12T12:16:11.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.759+0000 7f2461200640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f243c0678c0 0x7f243c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.759+0000 7f2461200640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f243c0678c0 0x7f243c069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f244c000fe0 tx=0x7f244c001160 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.763+0000 7f2458c00640 1 -- 172.21.15.144:0/2676901870 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f24480c3030 con 0x7f245c0ccf30 2024-09-12T12:16:11.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:11.975+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f245c0b37c0 con 0x7f245c0ccf30 2024-09-12T12:16:12.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.223+0000 7f2458c00640 1 -- 172.21.15.144:0/2676901870 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v177) ==== 143+0+0 (secure 0 0 0) 0x7f2448015fb0 con 0x7f245c0ccf30 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f243c0678c0 msgr2=0x7f243c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f243c0678c0 0x7f243c069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f244c000fe0 tx=0x7f244c001160 comp rx=0 tx=0).stop 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245c0ccf30 msgr2=0x7f245c15e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245c0ccf30 0x7f245c15e700 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2448000c10 tx=0x7f2448019130 comp rx=0 tx=0).stop 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 shutdown_connections 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f243c0678c0 0x7f243c069d80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f245c15b4e0 0x7f245c1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245c0ccf30 0x7f245c15e700 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 --2- 172.21.15.144:0/2676901870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f245c071420 0x7f245c15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 >> 172.21.15.144:0/2676901870 conn(0x7f245c06d0d0 msgr2=0x7f245c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 shutdown_connections 2024-09-12T12:16:12.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.227+0000 7f2463c00640 1 -- 172.21.15.144:0/2676901870 wait complete. 2024-09-12T12:16:12.249 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-12T12:16:12.250 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-09-12T12:16:12.250 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-12T12:16:12.250 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:16:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac80200640 1 Processor -- start 2024-09-12T12:16:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac80200640 1 -- start start 2024-09-12T12:16:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac80200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac7815cd30 0x7fac780b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac80200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac780b61e0 con 0x7fac7815c7b0 2024-09-12T12:16:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac80200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac780cd870 con 0x7fac780b5de0 2024-09-12T12:16:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac80200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fac78072a50 con 0x7fac7815cd30 2024-09-12T12:16:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac7ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac7815cd30 0x7fac780b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac7d800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fac7815c7b0 0x7fac780ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43750/0 (socket says 172.21.15.144:43750) 2024-09-12T12:16:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac7ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac7815cd30 0x7fac780b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57520/0 (socket says 172.21.15.144:57520) 2024-09-12T12:16:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.383+0000 7fac7d800640 1 -- 172.21.15.144:0/2064120961 learned_addr learned my addr 172.21.15.144:0/2064120961 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:12.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac7ce00640 1 -- 172.21.15.144:0/2064120961 >> v1:172.21.15.165:6789/0 conn(0x7fac780b5de0 legacy=0x7fac78072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac7ce00640 1 -- 172.21.15.144:0/2064120961 >> v1:172.21.15.144:6789/0 conn(0x7fac7815c7b0 legacy=0x7fac780ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac7ce00640 1 -- 172.21.15.144:0/2064120961 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac780cdb50 con 0x7fac7815cd30 2024-09-12T12:16:12.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac7ce00640 1 --2- 172.21.15.144:0/2064120961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 0x7fac780b58a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fac640097c0 tx=0x7fac6401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82ad4684715fbdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac77e00640 1 -- 172.21.15.144:0/2064120961 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac640b0070 con 0x7fac7815cd30 2024-09-12T12:16:12.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac77e00640 1 -- 172.21.15.144:0/2064120961 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac640ab600 con 0x7fac7815cd30 2024-09-12T12:16:12.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac77e00640 1 -- 172.21.15.144:0/2064120961 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac640ab9d0 con 0x7fac7815cd30 2024-09-12T12:16:12.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac80200640 1 -- 172.21.15.144:0/2064120961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 msgr2=0x7fac780b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac80200640 1 --2- 172.21.15.144:0/2064120961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 0x7fac780b58a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fac640097c0 tx=0x7fac6401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac80200640 1 -- 172.21.15.144:0/2064120961 shutdown_connections 2024-09-12T12:16:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac80200640 1 --2- 172.21.15.144:0/2064120961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 0x7fac780b58a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac80200640 1 -- 172.21.15.144:0/2064120961 >> 172.21.15.144:0/2064120961 conn(0x7fac7806d0d0 msgr2=0x7fac7806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.387+0000 7fac80200640 1 -- 172.21.15.144:0/2064120961 shutdown_connections 2024-09-12T12:16:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 -- 172.21.15.144:0/2064120961 wait complete. 2024-09-12T12:16:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 Processor -- start 2024-09-12T12:16:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 -- start start 2024-09-12T12:16:12.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac780b5de0 0x7fac78148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac7815c7b0 0x7fac7814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 0x7fac7814bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac78074210 con 0x7fac7815cd30 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac78074090 con 0x7fac7815c7b0 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac780cd610 con 0x7fac780b5de0 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 0x7fac7814bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 0x7fac7814bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57522/0 (socket says 172.21.15.144:57522) 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7e200640 1 -- 172.21.15.144:0/2592983654 learned_addr learned my addr 172.21.15.144:0/2592983654 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7ce00640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac7815c7b0 0x7fac7814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7d800640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac780b5de0 0x7fac78148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7e200640 1 -- 172.21.15.144:0/2592983654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac780b5de0 msgr2=0x7fac78148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7e200640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac780b5de0 0x7fac78148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7e200640 1 -- 172.21.15.144:0/2592983654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac7815c7b0 msgr2=0x7fac7814d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7e200640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac7815c7b0 0x7fac7814d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7e200640 1 -- 172.21.15.144:0/2592983654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7814c510 con 0x7fac7815cd30 2024-09-12T12:16:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7ce00640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac7815c7b0 0x7fac7814d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac7e200640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 0x7fac7814bb30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fac7000c770 tx=0x7fac7000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac75600640 1 -- 172.21.15.144:0/2592983654 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70003b80 con 0x7fac7815cd30 2024-09-12T12:16:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac75600640 1 -- 172.21.15.144:0/2592983654 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac70003d20 con 0x7fac7815cd30 2024-09-12T12:16:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac75600640 1 -- 172.21.15.144:0/2592983654 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7000aa90 con 0x7fac7815cd30 2024-09-12T12:16:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7814c7f0 con 0x7fac7815cd30 2024-09-12T12:16:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.391+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7814cdb0 con 0x7fac7815cd30 2024-09-12T12:16:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.395+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7814d250 con 0x7fac7815cd30 2024-09-12T12:16:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.395+0000 7fac75600640 1 -- 172.21.15.144:0/2592983654 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac7000ac30 con 0x7fac7815cd30 2024-09-12T12:16:12.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.395+0000 7fac75600640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac580678f0 0x7fac58069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.395+0000 7fac75600640 1 -- 172.21.15.144:0/2592983654 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fac70085b80 con 0x7fac7815cd30 2024-09-12T12:16:12.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.395+0000 7fac7d800640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac580678f0 0x7fac58069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.395+0000 7fac7d800640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac580678f0 0x7fac58069db0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac6c005890 tx=0x7fac6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.399+0000 7fac75600640 1 -- 172.21.15.144:0/2592983654 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fac70056700 con 0x7fac7815cd30 2024-09-12T12:16:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac780ce860 con 0x7fac7815cd30 2024-09-12T12:16:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac75600640 1 -- 172.21.15.144:0/2592983654 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+13331 (secure 0 0 0) 0x7fac70056000 con 0x7fac7815cd30 2024-09-12T12:16:12.562 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:12.562 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":57,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:16:11.211829+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6836/3957430285":"2024-09-13T12:16:08.123841+0000","172.21.15.144:6834/3957430285":"2024-09-13T12:16:08.123841+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac580678f0 msgr2=0x7fac58069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac580678f0 0x7fac58069db0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac6c005890 tx=0x7fac6c009040 comp rx=0 tx=0).stop 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 msgr2=0x7fac7814bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 0x7fac7814bb30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fac7000c770 tx=0x7fac7000cc30 comp rx=0 tx=0).stop 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 shutdown_connections 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac580678f0 0x7fac58069db0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac7815cd30 0x7fac7814bb30 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac7815c7b0 0x7fac7814d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 --2- 172.21.15.144:0/2592983654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac780b5de0 0x7fac78148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.559+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 >> 172.21.15.144:0/2592983654 conn(0x7fac7806d0d0 msgr2=0x7fac7815d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.563+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 shutdown_connections 2024-09-12T12:16:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.563+0000 7fac80200640 1 -- 172.21.15.144:0/2592983654 wait complete. 2024-09-12T12:16:12.583 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:16:12.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:16:12.625 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:16:12.634 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:16:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.719+0000 7ff559a00640 1 Processor -- start 2024-09-12T12:16:12.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.719+0000 7ff559a00640 1 -- start start 2024-09-12T12:16:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff559a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff55406d0f0 0x7ff55406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff559a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55406da10 con 0x7ff5540ccdc0 2024-09-12T12:16:12.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff559a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5540b38b0 con 0x7ff5540b32f0 2024-09-12T12:16:12.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff559a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff5540b3b90 con 0x7ff55406d0f0 2024-09-12T12:16:12.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff553400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff5540ccdc0 0x7ff5540cd230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43764/0 (socket says 172.21.15.144:43764) 2024-09-12T12:16:12.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff553400640 1 -- 172.21.15.144:0/2425969187 learned_addr learned my addr 172.21.15.144:0/2425969187 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:12.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737370821 0 0) 0x7ff55406da10 con 0x7ff5540ccdc0 2024-09-12T12:16:12.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff552a00640 1 --2- 172.21.15.144:0/2425969187 >> v2:172.21.15.165:3300/0 conn(0x7ff55406d0f0 0x7ff55406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff538003530 con 0x7ff5540ccdc0 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2247701952 0 0) 0x7ff538003530 con 0x7ff5540ccdc0 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 >> v2:172.21.15.165:3300/0 conn(0x7ff55406d0f0 msgr2=0x7ff55406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 --2- 172.21.15.144:0/2425969187 >> v2:172.21.15.165:3300/0 conn(0x7ff55406d0f0 0x7ff55406d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 >> v1:172.21.15.165:6789/0 conn(0x7ff5540b32f0 legacy=0x7ff55415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5540b3e70 con 0x7ff5540ccdc0 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7ff54c001680 con 0x7ff5540ccdc0 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 >> v1:172.21.15.144:6789/0 conn(0x7ff5540ccdc0 legacy=0x7ff5540cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5380039c0 0x7ff538003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff538004810 0x7ff538004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5380051d0 0x7ff53800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5540b3b90 con 0x7ff538004810 2024-09-12T12:16:12.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff53800c170 con 0x7ff5380039c0 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff53800c370 con 0x7ff5380051d0 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff552000640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff538004810 0x7ff538004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff552a00640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5380039c0 0x7ff538003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff553400640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5380051d0 0x7ff53800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff552000640 1 -- 172.21.15.144:0/2425969187 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5380051d0 msgr2=0x7ff53800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff552000640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5380051d0 0x7ff53800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff552000640 1 -- 172.21.15.144:0/2425969187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5380039c0 msgr2=0x7ff538003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff552000640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5380039c0 0x7ff538003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff552000640 1 -- 172.21.15.144:0/2425969187 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff538003530 con 0x7ff538004810 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff553400640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5380051d0 0x7ff53800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:12.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.723+0000 7ff553400640 1 -- 172.21.15.144:0/2425969187 reap_dead start 2024-09-12T12:16:12.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff552000640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff538004810 0x7ff538004c90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff540001780 tx=0x7ff54001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810122d05f26cffe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5400013a0 con 0x7ff538004810 2024-09-12T12:16:12.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5400052f0 con 0x7ff538004810 2024-09-12T12:16:12.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff551600640 1 -- 172.21.15.144:0/2425969187 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540003840 con 0x7ff538004810 2024-09-12T12:16:12.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff559a00640 1 -- 172.21.15.144:0/2425969187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff538004810 msgr2=0x7ff538004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff559a00640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff538004810 0x7ff538004c90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff540001780 tx=0x7ff54001c400 comp rx=0 tx=0).stop 2024-09-12T12:16:12.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff559a00640 1 -- 172.21.15.144:0/2425969187 shutdown_connections 2024-09-12T12:16:12.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff559a00640 1 --2- 172.21.15.144:0/2425969187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff538004810 0x7ff538004c90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff559a00640 1 -- 172.21.15.144:0/2425969187 >> 172.21.15.144:0/2425969187 conn(0x7ff554068030 msgr2=0x7ff5540b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff559a00640 1 -- 172.21.15.144:0/2425969187 shutdown_connections 2024-09-12T12:16:12.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff559a00640 1 -- 172.21.15.144:0/2425969187 wait complete. 2024-09-12T12:16:12.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff559a00640 1 Processor -- start 2024-09-12T12:16:12.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.727+0000 7ff559a00640 1 -- start start 2024-09-12T12:16:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff559a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff538004810 0x7ff55414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff559a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff55414e430 0x7ff55414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff559a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55414c640 0x7ff55414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff559a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5540b4990 con 0x7ff55414c640 2024-09-12T12:16:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff559a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff5540b4810 con 0x7ff538004810 2024-09-12T12:16:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff559a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5540b4b10 con 0x7ff55414e430 2024-09-12T12:16:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff553400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55414c640 0x7ff55414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff553400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55414c640 0x7ff55414cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57542/0 (socket says 172.21.15.144:57542) 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff553400640 1 -- 172.21.15.144:0/2891146129 learned_addr learned my addr 172.21.15.144:0/2891146129 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff552000640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff55414e430 0x7ff55414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff553400640 1 -- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff55414e430 msgr2=0x7ff55414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff552a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff538004810 0x7ff55414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff553400640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff55414e430 0x7ff55414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff553400640 1 -- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff538004810 msgr2=0x7ff55414bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff553400640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff538004810 0x7ff55414bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff553400640 1 -- 172.21.15.144:0/2891146129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55414c0b0 con 0x7ff55414c640 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff552000640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff55414e430 0x7ff55414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff552a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff538004810 0x7ff55414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff553400640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55414c640 0x7ff55414cac0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff5540cd1a0 tx=0x7ff54c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff54aa00640 1 -- 172.21.15.144:0/2891146129 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c00c610 con 0x7ff55414c640 2024-09-12T12:16:12.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff54aa00640 1 -- 172.21.15.144:0/2891146129 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c018070 con 0x7ff55414c640 2024-09-12T12:16:12.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55414d3b0 con 0x7ff55414c640 2024-09-12T12:16:12.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff54aa00640 1 -- 172.21.15.144:0/2891146129 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c00c9f0 con 0x7ff55414c640 2024-09-12T12:16:12.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff55414d970 con 0x7ff55414c640 2024-09-12T12:16:12.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55406d8e0 con 0x7ff55414c640 2024-09-12T12:16:12.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.731+0000 7ff54aa00640 1 -- 172.21.15.144:0/2891146129 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff54c00cb90 con 0x7ff55414c640 2024-09-12T12:16:12.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.735+0000 7ff54aa00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5340678f0 0x7ff534069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.735+0000 7ff54aa00640 1 -- 172.21.15.144:0/2891146129 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7ff54c0856a0 con 0x7ff55414c640 2024-09-12T12:16:12.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.735+0000 7ff552a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5340678f0 0x7ff534069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.735+0000 7ff552a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5340678f0 0x7ff534069db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff54400a340 tx=0x7ff54400a040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.739+0000 7ff54aa00640 1 -- 172.21.15.144:0/2891146129 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff54c056350 con 0x7ff55414c640 2024-09-12T12:16:12.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff55415c2d0 con 0x7ff55414c640 2024-09-12T12:16:12.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff54aa00640 1 -- 172.21.15.144:0/2891146129 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) ==== 93+0+10 (secure 0 0 0) 0x7ff54c055c50 con 0x7ff55414c640 2024-09-12T12:16:12.901 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:16:12.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5340678f0 msgr2=0x7ff534069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5340678f0 0x7ff534069db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff54400a340 tx=0x7ff54400a040 comp rx=0 tx=0).stop 2024-09-12T12:16:12.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55414c640 msgr2=0x7ff55414cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55414c640 0x7ff55414cac0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff5540cd1a0 tx=0x7ff54c00eb90 comp rx=0 tx=0).stop 2024-09-12T12:16:12.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 shutdown_connections 2024-09-12T12:16:12.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5340678f0 0x7ff534069db0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff55414c640 0x7ff55414cac0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff55414e430 0x7ff55414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 --2- 172.21.15.144:0/2891146129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff538004810 0x7ff55414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 >> 172.21.15.144:0/2891146129 conn(0x7ff554068030 msgr2=0x7ff55415aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 shutdown_connections 2024-09-12T12:16:12.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:12.899+0000 7ff559a00640 1 -- 172.21.15.144:0/2891146129 wait complete. 2024-09-12T12:16:12.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-12T12:16:13.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecfbe00640 1 Processor -- start 2024-09-12T12:16:13.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecfbe00640 1 -- start start 2024-09-12T12:16:13.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecfbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf415c4c0 0x7fecf40b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:13.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecfbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fecf40cfb90 0x7fecf4071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:13.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecfbe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf40709f0 con 0x7fecf40719d0 2024-09-12T12:16:13.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecfbe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fecf415c8a0 con 0x7fecf40cfb90 2024-09-12T12:16:13.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecfbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fecf4071000 con 0x7fecf415c4c0 2024-09-12T12:16:13.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf9e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fecf40719d0 0x7fecf40d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43766/0 (socket says 172.21.15.144:43766) 2024-09-12T12:16:13.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf9e00640 1 -- 172.21.15.144:0/3304182186 learned_addr learned my addr 172.21.15.144:0/3304182186 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:13.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf8a00640 1 --2- 172.21.15.144:0/3304182186 >> v2:172.21.15.165:3300/0 conn(0x7fecf40cfb90 0x7fecf4071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:13.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf9400640 1 --2- 172.21.15.144:0/3304182186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf415c4c0 0x7fecf40b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:13.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf3e00640 1 -- 172.21.15.144:0/3304182186 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567352880 0 0) 0x7fecf40709f0 con 0x7fecf40719d0 2024-09-12T12:16:13.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf3e00640 1 -- 172.21.15.144:0/3304182186 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecdc003530 con 0x7fecf40719d0 2024-09-12T12:16:13.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf9400640 1 -- 172.21.15.144:0/3304182186 >> v2:172.21.15.165:3300/0 conn(0x7fecf40cfb90 msgr2=0x7fecf4071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:13.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf9400640 1 --2- 172.21.15.144:0/3304182186 >> v2:172.21.15.165:3300/0 conn(0x7fecf40cfb90 0x7fecf4071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:13.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf9400640 1 -- 172.21.15.144:0/3304182186 >> v1:172.21.15.144:6789/0 conn(0x7fecf40719d0 legacy=0x7fecf40d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:13.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.055+0000 7fecf9400640 1 -- 172.21.15.144:0/3304182186 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf4073bf0 con 0x7fecf415c4c0 2024-09-12T12:16:13.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.059+0000 7fecf9400640 1 --2- 172.21.15.144:0/3304182186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf415c4c0 0x7fecf40b1ac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fece8009d90 tx=0x7fece801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8df95557a0f49c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:13.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.059+0000 7fecf3e00640 1 -- 172.21.15.144:0/3304182186 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece80b2070 con 0x7fecf415c4c0 2024-09-12T12:16:13.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.059+0000 7fecf3e00640 1 -- 172.21.15.144:0/3304182186 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece80a5920 con 0x7fecf415c4c0 2024-09-12T12:16:13.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.059+0000 7fecf3e00640 1 -- 172.21.15.144:0/3304182186 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece80a5cf0 con 0x7fecf415c4c0 2024-09-12T12:16:13.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.059+0000 7fecfbe00640 1 -- 172.21.15.144:0/3304182186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf415c4c0 msgr2=0x7fecf40b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:13.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.059+0000 7fecfbe00640 1 --2- 172.21.15.144:0/3304182186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf415c4c0 0x7fecf40b1ac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fece8009d90 tx=0x7fece801c970 comp rx=0 tx=0).stop 2024-09-12T12:16:13.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 -- 172.21.15.144:0/3304182186 shutdown_connections 2024-09-12T12:16:13.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 --2- 172.21.15.144:0/3304182186 >> v2:172.21.15.165:3300/0 conn(0x7fecf40cfb90 0x7fecf4071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:13.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 --2- 172.21.15.144:0/3304182186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf415c4c0 0x7fecf40b1ac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:13.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 -- 172.21.15.144:0/3304182186 >> 172.21.15.144:0/3304182186 conn(0x7fecf40cef90 msgr2=0x7fecf40cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:13.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 -- 172.21.15.144:0/3304182186 shutdown_connections 2024-09-12T12:16:13.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 -- 172.21.15.144:0/3304182186 wait complete. 2024-09-12T12:16:13.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 Processor -- start 2024-09-12T12:16:13.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 -- start start 2024-09-12T12:16:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf40cfb90 0x7fecf406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecf415c4c0 0x7fecf4160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4160c70 0x7fecf4150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fecf40d0d30 con 0x7fecf415c4c0 2024-09-12T12:16:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecf40d0bb0 con 0x7fecf4160c70 2024-09-12T12:16:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecfbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fecf40b6130 con 0x7fecf40cfb90 2024-09-12T12:16:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecf415c4c0 0x7fecf4160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecf415c4c0 0x7fecf4160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57558/0 (socket says 172.21.15.144:57558) 2024-09-12T12:16:13.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf8a00640 1 -- 172.21.15.144:0/3614174081 learned_addr learned my addr 172.21.15.144:0/3614174081 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf9e00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4160c70 0x7fecf4150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf9400640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf40cfb90 0x7fecf406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf8a00640 1 -- 172.21.15.144:0/3614174081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf40cfb90 msgr2=0x7fecf406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf8a00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf40cfb90 0x7fecf406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf8a00640 1 -- 172.21.15.144:0/3614174081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4160c70 msgr2=0x7fecf4150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf8a00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4160c70 0x7fecf4150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf8a00640 1 -- 172.21.15.144:0/3614174081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf406d260 con 0x7fecf415c4c0 2024-09-12T12:16:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf9e00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4160c70 0x7fecf4150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:13.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.063+0000 7fecf8a00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecf415c4c0 0x7fecf4160730 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fece0006d50 tx=0x7fece000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:13.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecf1600640 1 -- 172.21.15.144:0/3614174081 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0017070 con 0x7fecf415c4c0 2024-09-12T12:16:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecf1600640 1 -- 172.21.15.144:0/3614174081 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece000c8e0 con 0x7fecf415c4c0 2024-09-12T12:16:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecf1600640 1 -- 172.21.15.144:0/3614174081 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece000cc90 con 0x7fecf415c4c0 2024-09-12T12:16:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf406d500 con 0x7fecf415c4c0 2024-09-12T12:16:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf406dac0 con 0x7fecf415c4c0 2024-09-12T12:16:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf4161080 con 0x7fecf415c4c0 2024-09-12T12:16:13.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecf1600640 1 -- 172.21.15.144:0/3614174081 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fece001a070 con 0x7fecf415c4c0 2024-09-12T12:16:13.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecf1600640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecd40678f0 0x7fecd4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:13.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecf1600640 1 -- 172.21.15.144:0/3614174081 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fece0085ad0 con 0x7fecf415c4c0 2024-09-12T12:16:13.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecf9400640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecd40678f0 0x7fecd4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:13.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.067+0000 7fecf9400640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecd40678f0 0x7fecd4069db0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fece80af000 tx=0x7fece80a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:13.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.071+0000 7fecf1600640 1 -- 172.21.15.144:0/3614174081 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecf4161080 con 0x7fecf415c4c0 2024-09-12T12:16:13.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:13.287+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7fecf4071470 con 0x7fecf415c4c0 2024-09-12T12:16:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.235+0000 7fecf1600640 1 -- 172.21.15.144:0/3614174081 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v179) ==== 154+0+0 (secure 0 0 0) 0x7fece00566e0 con 0x7fecf415c4c0 2024-09-12T12:16:14.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecd40678f0 msgr2=0x7fecd4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecd40678f0 0x7fecd4069db0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fece80af000 tx=0x7fece80a7070 comp rx=0 tx=0).stop 2024-09-12T12:16:14.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecf415c4c0 msgr2=0x7fecf4160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecf415c4c0 0x7fecf4160730 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fece0006d50 tx=0x7fece000ed60 comp rx=0 tx=0).stop 2024-09-12T12:16:14.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 shutdown_connections 2024-09-12T12:16:14.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecd40678f0 0x7fecd4069db0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecf4160c70 0x7fecf4150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecf415c4c0 0x7fecf4160730 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 --2- 172.21.15.144:0/3614174081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecf40cfb90 0x7fecf406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 >> 172.21.15.144:0/3614174081 conn(0x7fecf40cef90 msgr2=0x7fecf40b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 shutdown_connections 2024-09-12T12:16:14.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.239+0000 7fecfbe00640 1 -- 172.21.15.144:0/3614174081 wait complete. 2024-09-12T12:16:14.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:16:14.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.407+0000 7fec7a600640 1 Processor -- start 2024-09-12T12:16:14.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.407+0000 7fec7a600640 1 -- start start 2024-09-12T12:16:14.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.407+0000 7fec7a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 0x7fec740ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.407+0000 7fec7a600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fec7406c320 0x7fec740b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.407+0000 7fec7a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec740b4300 con 0x7fec740cd9f0 2024-09-12T12:16:14.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.407+0000 7fec7a600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fec740b32f0 con 0x7fec7406c320 2024-09-12T12:16:14.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.407+0000 7fec7a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec740b3540 con 0x7fec7415af60 2024-09-12T12:16:14.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec72a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fec740cd9f0 0x7fec7406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43770/0 (socket says 172.21.15.144:43770) 2024-09-12T12:16:14.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec72a00640 1 -- 172.21.15.144:0/2510582438 learned_addr learned my addr 172.21.15.144:0/2510582438 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:14.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec73400640 1 --2- 172.21.15.144:0/2510582438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 0x7fec740ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec73e00640 1 --2- 172.21.15.144:0/2510582438 >> v2:172.21.15.165:3300/0 conn(0x7fec7406c320 0x7fec740b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec72000640 1 -- 172.21.15.144:0/2510582438 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906092635 0 0) 0x7fec740b4300 con 0x7fec740cd9f0 2024-09-12T12:16:14.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec72000640 1 -- 172.21.15.144:0/2510582438 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec58003530 con 0x7fec740cd9f0 2024-09-12T12:16:14.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec73400640 1 -- 172.21.15.144:0/2510582438 >> v2:172.21.15.165:3300/0 conn(0x7fec7406c320 msgr2=0x7fec740b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:14.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec73400640 1 --2- 172.21.15.144:0/2510582438 >> v2:172.21.15.165:3300/0 conn(0x7fec7406c320 0x7fec740b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec73400640 1 -- 172.21.15.144:0/2510582438 >> v1:172.21.15.144:6789/0 conn(0x7fec740cd9f0 legacy=0x7fec7406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec73400640 1 -- 172.21.15.144:0/2510582438 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec740b3820 con 0x7fec7415af60 2024-09-12T12:16:14.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec73e00640 1 --2- 172.21.15.144:0/2510582438 >> v2:172.21.15.165:3300/0 conn(0x7fec7406c320 0x7fec740b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:14.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.411+0000 7fec73400640 1 --2- 172.21.15.144:0/2510582438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 0x7fec740ce680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fec640097c0 tx=0x7fec6401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba977ed6f5b57bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec72000640 1 -- 172.21.15.144:0/2510582438 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec640b5070 con 0x7fec7415af60 2024-09-12T12:16:14.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec72000640 1 -- 172.21.15.144:0/2510582438 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec640a8990 con 0x7fec7415af60 2024-09-12T12:16:14.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec72000640 1 -- 172.21.15.144:0/2510582438 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec640a8d40 con 0x7fec7415af60 2024-09-12T12:16:14.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 -- 172.21.15.144:0/2510582438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 msgr2=0x7fec740ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 --2- 172.21.15.144:0/2510582438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 0x7fec740ce680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fec640097c0 tx=0x7fec6401ec90 comp rx=0 tx=0).stop 2024-09-12T12:16:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 -- 172.21.15.144:0/2510582438 shutdown_connections 2024-09-12T12:16:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 --2- 172.21.15.144:0/2510582438 >> v2:172.21.15.165:3300/0 conn(0x7fec7406c320 0x7fec740b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 --2- 172.21.15.144:0/2510582438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 0x7fec740ce680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 -- 172.21.15.144:0/2510582438 >> 172.21.15.144:0/2510582438 conn(0x7fec74068030 msgr2=0x7fec740b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 -- 172.21.15.144:0/2510582438 shutdown_connections 2024-09-12T12:16:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 -- 172.21.15.144:0/2510582438 wait complete. 2024-09-12T12:16:14.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 Processor -- start 2024-09-12T12:16:14.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 -- start start 2024-09-12T12:16:14.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7406c320 0x7fec7414a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec740cd9f0 0x7fec74157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 0x7fec74155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec740cebc0 con 0x7fec740cd9f0 2024-09-12T12:16:14.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec740b3de0 con 0x7fec7406c320 2024-09-12T12:16:14.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec7a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec740ced40 con 0x7fec7415af60 2024-09-12T12:16:14.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.415+0000 7fec72a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec740cd9f0 0x7fec74157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec72a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec740cd9f0 0x7fec74157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57568/0 (socket says 172.21.15.144:57568) 2024-09-12T12:16:14.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec72a00640 1 -- 172.21.15.144:0/1445137912 learned_addr learned my addr 172.21.15.144:0/1445137912 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec73400640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7406c320 0x7fec7414a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec73e00640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 0x7fec74155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec72a00640 1 -- 172.21.15.144:0/1445137912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 msgr2=0x7fec74155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec72a00640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 0x7fec74155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec72a00640 1 -- 172.21.15.144:0/1445137912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7406c320 msgr2=0x7fec7414a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec72a00640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7406c320 0x7fec7414a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec72a00640 1 -- 172.21.15.144:0/1445137912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec74158280 con 0x7fec740cd9f0 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec72a00640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec740cd9f0 0x7fec74157980 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fec6000c420 tx=0x7fec6000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec6b400640 1 -- 172.21.15.144:0/1445137912 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60017070 con 0x7fec740cd9f0 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec6b400640 1 -- 172.21.15.144:0/1445137912 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec60005d10 con 0x7fec740cd9f0 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec6b400640 1 -- 172.21.15.144:0/1445137912 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60007310 con 0x7fec740cd9f0 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec74158560 con 0x7fec740cd9f0 2024-09-12T12:16:14.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7415bc20 con 0x7fec740cd9f0 2024-09-12T12:16:14.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7415b340 con 0x7fec740cd9f0 2024-09-12T12:16:14.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec6b400640 1 -- 172.21.15.144:0/1445137912 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec6001a070 con 0x7fec740cd9f0 2024-09-12T12:16:14.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec6b400640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec540678c0 0x7fec54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.419+0000 7fec6b400640 1 -- 172.21.15.144:0/1445137912 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fec60084e90 con 0x7fec740cd9f0 2024-09-12T12:16:14.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.423+0000 7fec73400640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec540678c0 0x7fec54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.423+0000 7fec73400640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec540678c0 0x7fec54069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fec640b2000 tx=0x7fec640aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.423+0000 7fec6b400640 1 -- 172.21.15.144:0/1445137912 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec600555a0 con 0x7fec740cd9f0 2024-09-12T12:16:14.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.583+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fec740afc20 con 0x7fec740cd9f0 2024-09-12T12:16:14.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec6b400640 1 -- 172.21.15.144:0/1445137912 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fec60086020 con 0x7fec740cd9f0 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec540678c0 msgr2=0x7fec54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec7a600640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec540678c0 0x7fec54069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fec640b2000 tx=0x7fec640aa070 comp rx=0 tx=0).stop 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec740cd9f0 msgr2=0x7fec74157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec7a600640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec740cd9f0 0x7fec74157980 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fec6000c420 tx=0x7fec6000c820 comp rx=0 tx=0).stop 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 shutdown_connections 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec7a600640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fec540678c0 0x7fec54069d80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec7a600640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec7415af60 0x7fec74155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec7a600640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec740cd9f0 0x7fec74157980 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.587+0000 7fec7a600640 1 --2- 172.21.15.144:0/1445137912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec7406c320 0x7fec7414a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.591+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 >> 172.21.15.144:0/1445137912 conn(0x7fec74068030 msgr2=0x7fec7414ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.591+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 shutdown_connections 2024-09-12T12:16:14.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:14.591+0000 7fec7a600640 1 -- 172.21.15.144:0/1445137912 wait complete. 2024-09-12T12:16:14.610 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:16:14.610 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:16:14.706 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:16:14.797 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:16:14.798 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:14.798 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:14.807 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:16:14.807 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:16:14.807 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:14.817 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:16:14.817 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:14.817 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:14.855 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:16:14.855 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:16:14.855 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:14.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:16:14.867 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:16:14.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa113200640 1 Processor -- start 2024-09-12T12:16:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa113200640 1 -- start start 2024-09-12T12:16:15.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa113200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa10c15c360 0x7fa10c0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa113200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c071550 0x7fa10c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa113200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c0b4b80 con 0x7fa10c0b4780 2024-09-12T12:16:15.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa113200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa10c160d50 con 0x7fa10c15c360 2024-09-12T12:16:15.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa113200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa10c071b90 con 0x7fa10c071550 2024-09-12T12:16:15.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa111200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c071550 0x7fa10c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa10be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa10c15c360 0x7fa10c0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa111200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c071550 0x7fa10c0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40460/0 (socket says 172.21.15.144:40460) 2024-09-12T12:16:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.027+0000 7fa111200640 1 -- 172.21.15.144:0/100087515 learned_addr learned my addr 172.21.15.144:0/100087515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10b400640 1 -- 172.21.15.144:0/100087515 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3977109136 0 0) 0x7fa10c0b4b80 con 0x7fa10c0b4780 2024-09-12T12:16:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10b400640 1 -- 172.21.15.144:0/100087515 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0f0003530 con 0x7fa10c0b4780 2024-09-12T12:16:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10be00640 1 -- 172.21.15.144:0/100087515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c071550 msgr2=0x7fa10c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10be00640 1 --2- 172.21.15.144:0/100087515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c071550 0x7fa10c0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10be00640 1 -- 172.21.15.144:0/100087515 >> v1:172.21.15.165:6789/0 conn(0x7fa10c0b4780 legacy=0x7fa10c070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10be00640 1 -- 172.21.15.144:0/100087515 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c15c740 con 0x7fa10c15c360 2024-09-12T12:16:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa111200640 1 --2- 172.21.15.144:0/100087515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c071550 0x7fa10c0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:15.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10be00640 1 --2- 172.21.15.144:0/100087515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa10c15c360 0x7fa10c0b4240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0097c0 tx=0x7fa0fc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17365e2187e2b3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:15.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10b400640 1 -- 172.21.15.144:0/100087515 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0b0070 con 0x7fa10c15c360 2024-09-12T12:16:15.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10b400640 1 -- 172.21.15.144:0/100087515 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0ab600 con 0x7fa10c15c360 2024-09-12T12:16:15.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.031+0000 7fa10b400640 1 -- 172.21.15.144:0/100087515 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0ab9d0 con 0x7fa10c15c360 2024-09-12T12:16:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 -- 172.21.15.144:0/100087515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa10c15c360 msgr2=0x7fa10c0b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 --2- 172.21.15.144:0/100087515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa10c15c360 0x7fa10c0b4240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0097c0 tx=0x7fa0fc01c410 comp rx=0 tx=0).stop 2024-09-12T12:16:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 -- 172.21.15.144:0/100087515 shutdown_connections 2024-09-12T12:16:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 --2- 172.21.15.144:0/100087515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c071550 0x7fa10c0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 --2- 172.21.15.144:0/100087515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa10c15c360 0x7fa10c0b4240 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 -- 172.21.15.144:0/100087515 >> 172.21.15.144:0/100087515 conn(0x7fa10c06f3c0 msgr2=0x7fa10c06f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:15.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 -- 172.21.15.144:0/100087515 shutdown_connections 2024-09-12T12:16:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 -- 172.21.15.144:0/100087515 wait complete. 2024-09-12T12:16:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 Processor -- start 2024-09-12T12:16:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 -- start start 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa10c071550 0x7fa10c15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa10c0b4780 0x7fa10c1f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c15c360 0x7fa10c156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c0b6300 con 0x7fa10c071550 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c160830 con 0x7fa10c0b4780 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa113200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa10c0b6480 con 0x7fa10c15c360 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa10be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa10c071550 0x7fa10c15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa10be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa10c071550 0x7fa10c15efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57584/0 (socket says 172.21.15.144:57584) 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa10be00640 1 -- 172.21.15.144:0/2018688248 learned_addr learned my addr 172.21.15.144:0/2018688248 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa111200640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c15c360 0x7fa10c156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa103400640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa10c0b4780 0x7fa10c1f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa10be00640 1 -- 172.21.15.144:0/2018688248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c15c360 msgr2=0x7fa10c156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa10be00640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c15c360 0x7fa10c156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa10be00640 1 -- 172.21.15.144:0/2018688248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa10c0b4780 msgr2=0x7fa10c1f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa10be00640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa10c0b4780 0x7fa10c1f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.035+0000 7fa10be00640 1 -- 172.21.15.144:0/2018688248 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c15f600 con 0x7fa10c071550 2024-09-12T12:16:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa10be00640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa10c071550 0x7fa10c15efb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc01a040 tx=0x7fa0fc0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa108c00640 1 -- 172.21.15.144:0/2018688248 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0b0040 con 0x7fa10c071550 2024-09-12T12:16:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa108c00640 1 -- 172.21.15.144:0/2018688248 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0b9070 con 0x7fa10c071550 2024-09-12T12:16:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa108c00640 1 -- 172.21.15.144:0/2018688248 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0b4650 con 0x7fa10c071550 2024-09-12T12:16:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10c15f8e0 con 0x7fa10c071550 2024-09-12T12:16:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10c1f5270 con 0x7fa10c071550 2024-09-12T12:16:15.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10c1f4da0 con 0x7fa10c071550 2024-09-12T12:16:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa108c00640 1 -- 172.21.15.144:0/2018688248 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0fc0b47f0 con 0x7fa10c071550 2024-09-12T12:16:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa108c00640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e80678c0 0x7fa0e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa108c00640 1 -- 172.21.15.144:0/2018688248 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7fa0fc11f650 con 0x7fa10c071550 2024-09-12T12:16:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.039+0000 7fa103400640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e80678c0 0x7fa0e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.043+0000 7fa103400640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e80678c0 0x7fa0e8069d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0b7290 tx=0x7fa0f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:15.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.043+0000 7fa108c00640 1 -- 172.21.15.144:0/2018688248 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa0fc016090 con 0x7fa10c071550 2024-09-12T12:16:15.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa10c0b55b0 con 0x7fa10c071550 2024-09-12T12:16:15.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa108c00640 1 -- 172.21.15.144:0/2018688248 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+3917 (secure 0 0 0) 0x7fa0fc0efca0 con 0x7fa10c071550 2024-09-12T12:16:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:15.240 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":32,"btime":"2024-09-12T12:16:09:199100+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/149604375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":149604375},{"type":"v1","addr":"172.21.15.165:6834","nonce":149604375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5194,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3844758833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3844758833},{"type":"v1","addr":"172.21.15.144:6837","nonce":3844758833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5200,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/639962972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":639962972},{"type":"v1","addr":"172.21.15.165:6835","nonce":639962972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":6102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1874508051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1874508051},{"type":"v1","addr":"172.21.15.144:6836","nonce":1874508051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[]} 2024-09-12T12:16:15.241 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 32 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e80678c0 msgr2=0x7fa0e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e80678c0 0x7fa0e8069d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0b7290 tx=0x7fa0f4009040 comp rx=0 tx=0).stop 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa10c071550 msgr2=0x7fa10c15efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa10c071550 0x7fa10c15efb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc01a040 tx=0x7fa0fc0191b0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 shutdown_connections 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e80678c0 0x7fa0e8069d80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10c15c360 0x7fa10c156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa10c0b4780 0x7fa10c1f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 --2- 172.21.15.144:0/2018688248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa10c071550 0x7fa10c15efb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 >> 172.21.15.144:0/2018688248 conn(0x7fa10c06f3c0 msgr2=0x7fa10c166170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 shutdown_connections 2024-09-12T12:16:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.239+0000 7fa113200640 1 -- 172.21.15.144:0/2018688248 wait complete. 2024-09-12T12:16:15.262 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:16:15.262 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:16:15.262 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:16:15.263 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:15.263 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:16:15.263 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:16:15.263 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:16:15.263 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:15.263 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:16:15.263 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:16:15.264 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:16:15.264 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:15.264 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:16:15.264 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:16:15.264 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:16:15.264 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:15.274 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:16:15.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:16:15.275 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:16:15.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:16:15.279 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:16:15.279 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:16:15.280 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:16:15.280 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:16:15.325 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:16:15.326 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:15.328 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:16:15.328 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:15.329 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:16:15.329 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:15.331 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:16:15.331 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:15.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:16:15.411 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:16:15.412 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:16:15.422 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:16:15.422 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:16:15.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.471+0000 7f9e87600640 1 Processor -- start 2024-09-12T12:16:15.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.471+0000 7f9e87600640 1 -- start start 2024-09-12T12:16:15.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e87600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9e8015b4e0 0x7f9e800b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e87600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 0x7f9e800cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e87600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e800b45a0 con 0x7f9e800b3ad0 2024-09-12T12:16:15.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e87600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9e800cd8e0 con 0x7f9e8015b4e0 2024-09-12T12:16:15.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e87600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9e800b3fe0 con 0x7f9e800ccf30 2024-09-12T12:16:15.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e7fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9e800b3ad0 0x7f9e80071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43796/0 (socket says 172.21.15.144:43796) 2024-09-12T12:16:15.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e7fe00640 1 -- 172.21.15.144:0/3921705447 learned_addr learned my addr 172.21.15.144:0/3921705447 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:15.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e84c00640 1 --2- 172.21.15.144:0/3921705447 >> v2:172.21.15.165:3300/0 conn(0x7f9e8015b4e0 0x7f9e800b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e85600640 1 --2- 172.21.15.144:0/3921705447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 0x7f9e800cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e7f400640 1 -- 172.21.15.144:0/3921705447 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3819419034 0 0) 0x7f9e800b45a0 con 0x7f9e800b3ad0 2024-09-12T12:16:15.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e84c00640 1 -- 172.21.15.144:0/3921705447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 msgr2=0x7f9e800cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:15.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e84c00640 1 --2- 172.21.15.144:0/3921705447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 0x7f9e800cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e84c00640 1 -- 172.21.15.144:0/3921705447 >> v1:172.21.15.144:6789/0 conn(0x7f9e800b3ad0 legacy=0x7f9e80071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e84c00640 1 -- 172.21.15.144:0/3921705447 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800b42c0 con 0x7f9e8015b4e0 2024-09-12T12:16:15.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.475+0000 7f9e85600640 1 --2- 172.21.15.144:0/3921705447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 0x7f9e800cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:15.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e84c00640 1 --2- 172.21.15.144:0/3921705447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e8015b4e0 0x7f9e800b3590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009d90 tx=0x7f9e7001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecce8b38a4f5ecdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:15.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e7f400640 1 -- 172.21.15.144:0/3921705447 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700b2070 con 0x7f9e8015b4e0 2024-09-12T12:16:15.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e7f400640 1 -- 172.21.15.144:0/3921705447 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e700a5a00 con 0x7f9e8015b4e0 2024-09-12T12:16:15.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e7f400640 1 -- 172.21.15.144:0/3921705447 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700a5dd0 con 0x7f9e8015b4e0 2024-09-12T12:16:15.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 -- 172.21.15.144:0/3921705447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e8015b4e0 msgr2=0x7f9e800b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 --2- 172.21.15.144:0/3921705447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e8015b4e0 0x7f9e800b3590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009d90 tx=0x7f9e7001c940 comp rx=0 tx=0).stop 2024-09-12T12:16:15.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 -- 172.21.15.144:0/3921705447 shutdown_connections 2024-09-12T12:16:15.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 --2- 172.21.15.144:0/3921705447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 0x7f9e800cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 --2- 172.21.15.144:0/3921705447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e8015b4e0 0x7f9e800b3590 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 -- 172.21.15.144:0/3921705447 >> 172.21.15.144:0/3921705447 conn(0x7f9e8006d0d0 msgr2=0x7f9e8006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:15.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 -- 172.21.15.144:0/3921705447 shutdown_connections 2024-09-12T12:16:15.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 -- 172.21.15.144:0/3921705447 wait complete. 2024-09-12T12:16:15.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 Processor -- start 2024-09-12T12:16:15.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.479+0000 7f9e87600640 1 -- start start 2024-09-12T12:16:15.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e87600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e800b3ad0 0x7f9e80161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e87600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 0x7f9e80160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e87600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e8015b4e0 0x7f9e801624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e87600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8015b8c0 con 0x7f9e8015b4e0 2024-09-12T12:16:15.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e87600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9e800cdef0 con 0x7f9e800b3ad0 2024-09-12T12:16:15.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e87600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9e800adb60 con 0x7f9e800ccf30 2024-09-12T12:16:15.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e85600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e8015b4e0 0x7f9e801624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e85600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e8015b4e0 0x7f9e801624c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57634/0 (socket says 172.21.15.144:57634) 2024-09-12T12:16:15.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e85600640 1 -- 172.21.15.144:0/1647523555 learned_addr learned my addr 172.21.15.144:0/1647523555 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e84c00640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e800b3ad0 0x7f9e80161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e7fe00640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 0x7f9e80160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e85600640 1 -- 172.21.15.144:0/1647523555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 msgr2=0x7f9e80160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e85600640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 0x7f9e80160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e85600640 1 -- 172.21.15.144:0/1647523555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e800b3ad0 msgr2=0x7f9e80161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e85600640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e800b3ad0 0x7f9e80161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e85600640 1 -- 172.21.15.144:0/1647523555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800ade40 con 0x7f9e8015b4e0 2024-09-12T12:16:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e85600640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e8015b4e0 0x7f9e801624c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800e950 tx=0x7f9e7800ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e7cc00640 1 -- 172.21.15.144:0/1647523555 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78017070 con 0x7f9e8015b4e0 2024-09-12T12:16:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e7cc00640 1 -- 172.21.15.144:0/1647523555 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7800ca00 con 0x7f9e8015b4e0 2024-09-12T12:16:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e800ae120 con 0x7f9e8015b4e0 2024-09-12T12:16:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e7cc00640 1 -- 172.21.15.144:0/1647523555 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800cdd0 con 0x7f9e8015b4e0 2024-09-12T12:16:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e80160740 con 0x7f9e8015b4e0 2024-09-12T12:16:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e800cd3a0 con 0x7f9e8015b4e0 2024-09-12T12:16:15.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.483+0000 7f9e7cc00640 1 -- 172.21.15.144:0/1647523555 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e78013470 con 0x7f9e8015b4e0 2024-09-12T12:16:15.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.487+0000 7f9e7cc00640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e600678c0 0x7f9e60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:15.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.487+0000 7f9e7cc00640 1 -- 172.21.15.144:0/1647523555 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f9e780859f0 con 0x7f9e8015b4e0 2024-09-12T12:16:15.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.487+0000 7f9e84c00640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e600678c0 0x7f9e60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:15.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.487+0000 7f9e84c00640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e600678c0 0x7f9e60069d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e700af000 tx=0x7f9e700a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:15.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.491+0000 7f9e7cc00640 1 -- 172.21.15.144:0/1647523555 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e78055fb0 con 0x7f9e8015b4e0 2024-09-12T12:16:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:15.659+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9e800cf500 con 0x7f9e8015b4e0 2024-09-12T12:16:16.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e7cc00640 1 -- 172.21.15.144:0/1647523555 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) ==== 97+0+0 (secure 0 0 0) 0x7f9e7805a2b0 con 0x7f9e8015b4e0 2024-09-12T12:16:16.256 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e600678c0 msgr2=0x7f9e60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e600678c0 0x7f9e60069d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e700af000 tx=0x7f9e700a7070 comp rx=0 tx=0).stop 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e8015b4e0 msgr2=0x7f9e801624c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e8015b4e0 0x7f9e801624c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800e950 tx=0x7f9e7800ee10 comp rx=0 tx=0).stop 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 shutdown_connections 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e600678c0 0x7f9e60069d80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e8015b4e0 0x7f9e801624c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e800ccf30 0x7f9e80160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 --2- 172.21.15.144:0/1647523555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e800b3ad0 0x7f9e80161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 >> 172.21.15.144:0/1647523555 conn(0x7f9e8006d0d0 msgr2=0x7f9e80071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 shutdown_connections 2024-09-12T12:16:16.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.255+0000 7f9e87600640 1 -- 172.21.15.144:0/1647523555 wait complete. 2024-09-12T12:16:16.283 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:16:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0cf600640 1 Processor -- start 2024-09-12T12:16:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0cf600640 1 -- start start 2024-09-12T12:16:16.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0cf600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0c815c220 0x7ff0c80d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0cf600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c80b4200 0x7ff0c80b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0cf600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff0c80732c0 0x7ff0c8073710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0cf600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff0c80b4bb0 con 0x7ff0c815c220 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0cf600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff0c80d1580 con 0x7ff0c80732c0 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0cf600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c80d1860 con 0x7ff0c80b4200 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0ccc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0c815c220 0x7ff0c80d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0ccc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0c815c220 0x7ff0c80d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57640/0 (socket says 172.21.15.144:57640) 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0ccc00640 1 -- 172.21.15.144:0/4018992484 learned_addr learned my addr 172.21.15.144:0/4018992484 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0cd600640 1 --2- 172.21.15.144:0/4018992484 >> v2:172.21.15.165:3300/0 conn(0x7ff0c80732c0 0x7ff0c8073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0c7e00640 1 --2- 172.21.15.144:0/4018992484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c80b4200 0x7ff0c80b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0ccc00640 1 -- 172.21.15.144:0/4018992484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c80b4200 msgr2=0x7ff0c80b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0ccc00640 1 --2- 172.21.15.144:0/4018992484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c80b4200 0x7ff0c80b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0ccc00640 1 -- 172.21.15.144:0/4018992484 >> v2:172.21.15.165:3300/0 conn(0x7ff0c80732c0 msgr2=0x7ff0c8073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0ccc00640 1 --2- 172.21.15.144:0/4018992484 >> v2:172.21.15.165:3300/0 conn(0x7ff0c80732c0 0x7ff0c8073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.419+0000 7ff0ccc00640 1 -- 172.21.15.144:0/4018992484 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c80d1b40 con 0x7ff0c815c220 2024-09-12T12:16:16.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0ccc00640 1 --2- 172.21.15.144:0/4018992484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c815c220 0x7ff0c80d0c10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80b1680 tx=0x7ff0b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ce37dad234b598 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0c7400640 1 -- 172.21.15.144:0/4018992484 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80aa610 con 0x7ff0c815c220 2024-09-12T12:16:16.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0c7400640 1 -- 172.21.15.144:0/4018992484 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b80af070 con 0x7ff0c815c220 2024-09-12T12:16:16.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0c7400640 1 -- 172.21.15.144:0/4018992484 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b80aa9d0 con 0x7ff0c815c220 2024-09-12T12:16:16.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0cf600640 1 -- 172.21.15.144:0/4018992484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c815c220 msgr2=0x7ff0c80d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0cf600640 1 --2- 172.21.15.144:0/4018992484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c815c220 0x7ff0c80d0c10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80b1680 tx=0x7ff0b801c4f0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0cf600640 1 -- 172.21.15.144:0/4018992484 shutdown_connections 2024-09-12T12:16:16.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0cf600640 1 --2- 172.21.15.144:0/4018992484 >> v2:172.21.15.165:3300/0 conn(0x7ff0c80732c0 0x7ff0c8073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0cf600640 1 --2- 172.21.15.144:0/4018992484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c80b4200 0x7ff0c80b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0cf600640 1 --2- 172.21.15.144:0/4018992484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c815c220 0x7ff0c80d0c10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0cf600640 1 -- 172.21.15.144:0/4018992484 >> 172.21.15.144:0/4018992484 conn(0x7ff0c806f400 msgr2=0x7ff0c806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0cf600640 1 -- 172.21.15.144:0/4018992484 shutdown_connections 2024-09-12T12:16:16.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.423+0000 7ff0cf600640 1 -- 172.21.15.144:0/4018992484 wait complete. 2024-09-12T12:16:16.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 Processor -- start 2024-09-12T12:16:16.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 -- start start 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0c80732c0 0x7ff0c80b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c80b4200 0x7ff0c8149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c815c220 0x7ff0c814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c815c780 con 0x7ff0c80b4200 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c815c600 con 0x7ff0c80732c0 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c80d1150 con 0x7ff0c815c220 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c80b4200 0x7ff0c8149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0ccc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0c80732c0 0x7ff0c80b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0ccc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0c80732c0 0x7ff0c80b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:59290/0 (socket says 172.21.15.144:59290) 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0ccc00640 1 -- 172.21.15.144:0/1610360967 learned_addr learned my addr 172.21.15.144:0/1610360967 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c80b4200 0x7ff0c8149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57652/0 (socket says 172.21.15.144:57652) 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cd600640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c815c220 0x7ff0c814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c7e00640 1 -- 172.21.15.144:0/1610360967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c815c220 msgr2=0x7ff0c814a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c7e00640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c815c220 0x7ff0c814a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c7e00640 1 -- 172.21.15.144:0/1610360967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0c80732c0 msgr2=0x7ff0c80b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c7e00640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0c80732c0 0x7ff0c80b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c7e00640 1 -- 172.21.15.144:0/1610360967 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c815e450 con 0x7ff0c80b4200 2024-09-12T12:16:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c7e00640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c80b4200 0x7ff0c8149d00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400d5f0 tx=0x7ff0b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c4c00640 1 -- 172.21.15.144:0/1610360967 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40125f0 con 0x7ff0c80b4200 2024-09-12T12:16:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c4c00640 1 -- 172.21.15.144:0/1610360967 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b4019070 con 0x7ff0c80b4200 2024-09-12T12:16:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c815d3b0 con 0x7ff0c80b4200 2024-09-12T12:16:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0c4c00640 1 -- 172.21.15.144:0/1610360967 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40129d0 con 0x7ff0c80b4200 2024-09-12T12:16:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.427+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c815d970 con 0x7ff0c80b4200 2024-09-12T12:16:16.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.431+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c8070bf0 con 0x7ff0c80b4200 2024-09-12T12:16:16.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.431+0000 7ff0c4c00640 1 -- 172.21.15.144:0/1610360967 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0b4012b70 con 0x7ff0c80b4200 2024-09-12T12:16:16.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.431+0000 7ff0c4c00640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0a80678f0 0x7ff0a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.431+0000 7ff0c4c00640 1 -- 172.21.15.144:0/1610360967 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5249+0+0 (secure 0 0 0) 0x7ff0b4085d60 con 0x7ff0c80b4200 2024-09-12T12:16:16.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.431+0000 7ff0ccc00640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0a80678f0 0x7ff0a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.431+0000 7ff0ccc00640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0a80678f0 0x7ff0a8069db0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff0b801c530 tx=0x7ff0b80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.435+0000 7ff0c4c00640 1 -- 172.21.15.144:0/1610360967 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff0b4056400 con 0x7ff0c80b4200 2024-09-12T12:16:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.647+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff0c80b4810 con 0x7ff0c80b4200 2024-09-12T12:16:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.647+0000 7ff0c4c00640 1 -- 172.21.15.144:0/1610360967 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7ff0b405a700 con 0x7ff0c80b4200 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:16:16.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:16:16.652 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.654 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:16:16.654 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:16:16.654 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.654 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:16:16.654 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:16:16.656 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:16:16.657 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.659 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.660 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:16:16.661 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:16:16.662 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.663 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:16:16.664 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:16:16.665 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:16:16.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.666 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:16:16.666 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:16:16.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0a80678f0 msgr2=0x7ff0a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0a80678f0 0x7ff0a8069db0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff0b801c530 tx=0x7ff0b80a7000 comp rx=0 tx=0).stop 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c80b4200 msgr2=0x7ff0c8149d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c80b4200 0x7ff0c8149d00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400d5f0 tx=0x7ff0b400dab0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 shutdown_connections 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0a80678f0 0x7ff0a8069db0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0c815c220 0x7ff0c814a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0c80b4200 0x7ff0c8149d00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 --2- 172.21.15.144:0/1610360967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0c80732c0 0x7ff0c80b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 >> 172.21.15.144:0/1610360967 conn(0x7ff0c806f400 msgr2=0x7ff0c806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 shutdown_connections 2024-09-12T12:16:16.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.651+0000 7ff0cf600640 1 -- 172.21.15.144:0/1610360967 wait complete. 2024-09-12T12:16:16.672 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:16:16.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff8c00640 1 Processor -- start 2024-09-12T12:16:16.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff8c00640 1 -- start start 2024-09-12T12:16:16.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff40b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff8c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3ff406e300 0x7f3ff406e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff8c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff406ec60 con 0x7f3ff415e5f0 2024-09-12T12:16:16.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff8c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff40b6f60 con 0x7f3ff406e300 2024-09-12T12:16:16.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff40b7240 con 0x7f3ff40b44a0 2024-09-12T12:16:16.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff40b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff2800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3ff406e300 0x7f3ff406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff40b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40562/0 (socket says 172.21.15.144:40562) 2024-09-12T12:16:16.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff1400640 1 -- 172.21.15.144:0/1858794236 learned_addr learned my addr 172.21.15.144:0/1858794236 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:16.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff1400640 1 -- 172.21.15.144:0/1858794236 >> v2:172.21.15.165:3300/0 conn(0x7f3ff406e300 msgr2=0x7f3ff406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff1400640 1 --2- 172.21.15.144:0/1858794236 >> v2:172.21.15.165:3300/0 conn(0x7f3ff406e300 0x7f3ff406e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff1400640 1 -- 172.21.15.144:0/1858794236 >> v1:172.21.15.165:6789/0 conn(0x7f3ff415e5f0 legacy=0x7f3ff406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.807+0000 7f3ff1400640 1 -- 172.21.15.144:0/1858794236 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff40b7520 con 0x7f3ff40b44a0 2024-09-12T12:16:16.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff1400640 1 --2- 172.21.15.144:0/1858794236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff40b48a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009870 tx=0x7f3fe001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c5f0969754b6c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff0a00640 1 -- 172.21.15.144:0/1858794236 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00a9610 con 0x7f3ff40b44a0 2024-09-12T12:16:16.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff0a00640 1 -- 172.21.15.144:0/1858794236 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe00a97b0 con 0x7f3ff40b44a0 2024-09-12T12:16:16.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff0a00640 1 -- 172.21.15.144:0/1858794236 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00a9b80 con 0x7f3ff40b44a0 2024-09-12T12:16:16.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff8c00640 1 -- 172.21.15.144:0/1858794236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 msgr2=0x7f3ff40b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff8c00640 1 --2- 172.21.15.144:0/1858794236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff40b48a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009870 tx=0x7f3fe001c530 comp rx=0 tx=0).stop 2024-09-12T12:16:16.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff8c00640 1 -- 172.21.15.144:0/1858794236 shutdown_connections 2024-09-12T12:16:16.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff8c00640 1 --2- 172.21.15.144:0/1858794236 >> v2:172.21.15.165:3300/0 conn(0x7f3ff406e300 0x7f3ff406e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff8c00640 1 --2- 172.21.15.144:0/1858794236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff40b48a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff8c00640 1 -- 172.21.15.144:0/1858794236 >> 172.21.15.144:0/1858794236 conn(0x7f3ff406f400 msgr2=0x7f3ff406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff8c00640 1 -- 172.21.15.144:0/1858794236 shutdown_connections 2024-09-12T12:16:16.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.811+0000 7f3ff8c00640 1 -- 172.21.15.144:0/1858794236 wait complete. 2024-09-12T12:16:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 Processor -- start 2024-09-12T12:16:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 -- start start 2024-09-12T12:16:16.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff406e300 0x7f3ff414b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff4139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff415e5f0 0x7f3ff4160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff415f880 con 0x7f3ff406e300 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff415f700 con 0x7f3ff415e5f0 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff415fa00 con 0x7f3ff40b44a0 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff406e300 0x7f3ff414b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff406e300 0x7f3ff414b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57654/0 (socket says 172.21.15.144:57654) 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1e00640 1 -- 172.21.15.144:0/930036500 learned_addr learned my addr 172.21.15.144:0/930036500 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1400640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff4139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff2800640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff415e5f0 0x7f3ff4160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1e00640 1 -- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 msgr2=0x7f3ff4139290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1e00640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff4139290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1e00640 1 -- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff415e5f0 msgr2=0x7f3ff4160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1e00640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff415e5f0 0x7f3ff4160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1e00640 1 -- 172.21.15.144:0/930036500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff41397d0 con 0x7f3ff406e300 2024-09-12T12:16:16.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1400640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff4139290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:16.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff2800640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff415e5f0 0x7f3ff4160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:16.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff1e00640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff406e300 0x7f3ff414b860 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c3f0 tx=0x7f3fe400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3fea000640 1 -- 172.21.15.144:0/930036500 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4017070 con 0x7f3ff406e300 2024-09-12T12:16:16.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff414f7e0 con 0x7f3ff406e300 2024-09-12T12:16:16.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3fea000640 1 -- 172.21.15.144:0/930036500 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe40052d0 con 0x7f3ff406e300 2024-09-12T12:16:16.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3fea000640 1 -- 172.21.15.144:0/930036500 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4003840 con 0x7f3ff406e300 2024-09-12T12:16:16.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.815+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff4151ca0 con 0x7f3ff406e300 2024-09-12T12:16:16.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.819+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff406e720 con 0x7f3ff406e300 2024-09-12T12:16:16.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.819+0000 7f3fea000640 1 -- 172.21.15.144:0/930036500 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3fe401a070 con 0x7f3ff406e300 2024-09-12T12:16:16.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.819+0000 7f3fea000640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd40678c0 0x7f3fd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.819+0000 7f3fea000640 1 -- 172.21.15.144:0/930036500 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5249+0+0 (secure 0 0 0) 0x7f3fe4084f90 con 0x7f3ff406e300 2024-09-12T12:16:16.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.819+0000 7f3ff1400640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd40678c0 0x7f3fd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.819+0000 7f3ff1400640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd40678c0 0x7f3fd4069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00ae000 tx=0x7f3fe00b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.823+0000 7f3fea000640 1 -- 172.21.15.144:0/930036500 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3ff41397d0 con 0x7f3ff406e300 2024-09-12T12:16:16.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3ff40b3990 con 0x7f3ff406e300 2024-09-12T12:16:16.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3fea000640 1 -- 172.21.15.144:0/930036500 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) ==== 84+0+65 (secure 0 0 0) 0x7f3fe4005480 con 0x7f3ff406e300 2024-09-12T12:16:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:16.985 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:16:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:16:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:16:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:16:16.985 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:16:16.986 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:16:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd40678c0 msgr2=0x7f3fd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd40678c0 0x7f3fd4069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00ae000 tx=0x7f3fe00b3040 comp rx=0 tx=0).stop 2024-09-12T12:16:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff406e300 msgr2=0x7f3ff414b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff406e300 0x7f3ff414b860 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400c3f0 tx=0x7f3fe400c8b0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 shutdown_connections 2024-09-12T12:16:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fd40678c0 0x7f3fd4069d80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ff415e5f0 0x7f3ff4160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ff40b44a0 0x7f3ff4139290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 --2- 172.21.15.144:0/930036500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ff406e300 0x7f3ff414b860 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 >> 172.21.15.144:0/930036500 conn(0x7f3ff406f400 msgr2=0x7f3ff406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 shutdown_connections 2024-09-12T12:16:16.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:16.983+0000 7f3ff8c00640 1 -- 172.21.15.144:0/930036500 wait complete. 2024-09-12T12:16:17.006 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:16:17.006 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:16:17.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.143+0000 7fecee400640 1 Processor -- start 2024-09-12T12:16:17.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.143+0000 7fecee400640 1 -- start start 2024-09-12T12:16:17.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.143+0000 7fecee400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fece8156c10 0x7fece8072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.143+0000 7fecee400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fece806cff0 0x7fece806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.143+0000 7fecee400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8073360 0x7fece80737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.143+0000 7fecee400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fece806d990 con 0x7fece806cff0 2024-09-12T12:16:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.143+0000 7fecee400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fece8073d30 con 0x7fece8156c10 2024-09-12T12:16:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.143+0000 7fecee400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fece8071be0 con 0x7fece8073360 2024-09-12T12:16:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fece806cff0 0x7fece806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fece806cff0 0x7fece806d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47624/0 (socket says 172.21.15.144:47624) 2024-09-12T12:16:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6a00640 1 -- 172.21.15.144:0/2802431976 learned_addr learned my addr 172.21.15.144:0/2802431976 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece7e00640 1 --2- 172.21.15.144:0/2802431976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8073360 0x7fece80737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece7400640 1 --2- 172.21.15.144:0/2802431976 >> v2:172.21.15.165:3300/0 conn(0x7fece8156c10 0x7fece8072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6a00640 1 -- 172.21.15.144:0/2802431976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8073360 msgr2=0x7fece80737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6a00640 1 --2- 172.21.15.144:0/2802431976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8073360 0x7fece80737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6a00640 1 -- 172.21.15.144:0/2802431976 >> v2:172.21.15.165:3300/0 conn(0x7fece8156c10 msgr2=0x7fece8072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6a00640 1 --2- 172.21.15.144:0/2802431976 >> v2:172.21.15.165:3300/0 conn(0x7fece8156c10 0x7fece8072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6a00640 1 -- 172.21.15.144:0/2802431976 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece806cd20 con 0x7fece806cff0 2024-09-12T12:16:17.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece7400640 1 --2- 172.21.15.144:0/2802431976 >> v2:172.21.15.165:3300/0 conn(0x7fece8156c10 0x7fece8072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:17.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece7e00640 1 --2- 172.21.15.144:0/2802431976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8073360 0x7fece80737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:17.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6a00640 1 --2- 172.21.15.144:0/2802431976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 0x7fece806d450 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fece80742c0 tx=0x7fecd401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba261ea450b5d52f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6000640 1 -- 172.21.15.144:0/2802431976 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd40a6040 con 0x7fece806cff0 2024-09-12T12:16:17.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6000640 1 -- 172.21.15.144:0/2802431976 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd40af070 con 0x7fece806cff0 2024-09-12T12:16:17.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.147+0000 7fece6000640 1 -- 172.21.15.144:0/2802431976 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd40aa860 con 0x7fece806cff0 2024-09-12T12:16:17.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 -- 172.21.15.144:0/2802431976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 msgr2=0x7fece806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 --2- 172.21.15.144:0/2802431976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 0x7fece806d450 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fece80742c0 tx=0x7fecd401c520 comp rx=0 tx=0).stop 2024-09-12T12:16:17.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 -- 172.21.15.144:0/2802431976 shutdown_connections 2024-09-12T12:16:17.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 --2- 172.21.15.144:0/2802431976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 0x7fece806d450 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 --2- 172.21.15.144:0/2802431976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8073360 0x7fece80737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 --2- 172.21.15.144:0/2802431976 >> v2:172.21.15.165:3300/0 conn(0x7fece8156c10 0x7fece8072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 -- 172.21.15.144:0/2802431976 >> 172.21.15.144:0/2802431976 conn(0x7fece806bc10 msgr2=0x7fece806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 -- 172.21.15.144:0/2802431976 shutdown_connections 2024-09-12T12:16:17.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 -- 172.21.15.144:0/2802431976 wait complete. 2024-09-12T12:16:17.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 Processor -- start 2024-09-12T12:16:17.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 -- start start 2024-09-12T12:16:17.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 0x7fece8150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8073360 0x7fece814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8156c10 0x7fece814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fece8156ff0 con 0x7fece806cff0 2024-09-12T12:16:17.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fece8073f70 con 0x7fece8073360 2024-09-12T12:16:17.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fecee400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fece8157170 con 0x7fece8156c10 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 0x7fece8150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 0x7fece8150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47634/0 (socket says 172.21.15.144:47634) 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece7400640 1 -- 172.21.15.144:0/1334686208 learned_addr learned my addr 172.21.15.144:0/1334686208 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece7e00640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8156c10 0x7fece814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece6a00640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8073360 0x7fece814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece7400640 1 -- 172.21.15.144:0/1334686208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8156c10 msgr2=0x7fece814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece7400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8156c10 0x7fece814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece7400640 1 -- 172.21.15.144:0/1334686208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8073360 msgr2=0x7fece814b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece7400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8073360 0x7fece814b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.151+0000 7fece7400640 1 -- 172.21.15.144:0/1334686208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece8150d50 con 0x7fece806cff0 2024-09-12T12:16:17.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fece7400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 0x7fece8150810 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fecd800cf60 tx=0x7fecd800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fecdf400640 1 -- 172.21.15.144:0/1334686208 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd801a070 con 0x7fece806cff0 2024-09-12T12:16:17.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fecdf400640 1 -- 172.21.15.144:0/1334686208 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd800d840 con 0x7fece806cff0 2024-09-12T12:16:17.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fecdf400640 1 -- 172.21.15.144:0/1334686208 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd800dc10 con 0x7fece806cff0 2024-09-12T12:16:17.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece814b8b0 con 0x7fece806cff0 2024-09-12T12:16:17.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece814fa50 con 0x7fece806cff0 2024-09-12T12:16:17.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece806d450 con 0x7fece806cff0 2024-09-12T12:16:17.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fecdf400640 1 -- 172.21.15.144:0/1334686208 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fecd801d070 con 0x7fece806cff0 2024-09-12T12:16:17.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fecdf400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecc80678c0 0x7fecc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.155+0000 7fecdf400640 1 -- 172.21.15.144:0/1334686208 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5249+0+0 (secure 0 0 0) 0x7fecd8086220 con 0x7fece806cff0 2024-09-12T12:16:17.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.159+0000 7fece6a00640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecc80678c0 0x7fecc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.159+0000 7fece6a00640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecc80678c0 0x7fecc8069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fecd40ae000 tx=0x7fecd40a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.163+0000 7fecdf400640 1 -- 172.21.15.144:0/1334686208 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecd80568c0 con 0x7fece806cff0 2024-09-12T12:16:17.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:17.327+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fece806dd80 con 0x7fece806cff0 2024-09-12T12:16:18.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.259+0000 7fecdf400640 1 -- 172.21.15.144:0/1334686208 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) ==== 138+0+0 (secure 0 0 0) 0x7fecd805abc0 con 0x7fece806cff0 2024-09-12T12:16:18.261 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:16:18.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecc80678c0 msgr2=0x7fecc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:18.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecc80678c0 0x7fecc8069d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fecd40ae000 tx=0x7fecd40a7000 comp rx=0 tx=0).stop 2024-09-12T12:16:18.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 msgr2=0x7fece8150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:18.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 0x7fece8150810 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fecd800cf60 tx=0x7fecd800cf90 comp rx=0 tx=0).stop 2024-09-12T12:16:18.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 shutdown_connections 2024-09-12T12:16:18.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fecc80678c0 0x7fecc8069d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fece8156c10 0x7fece814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8073360 0x7fece814b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 --2- 172.21.15.144:0/1334686208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fece806cff0 0x7fece8150810 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 >> 172.21.15.144:0/1334686208 conn(0x7fece806bc10 msgr2=0x7fece80ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:18.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 shutdown_connections 2024-09-12T12:16:18.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.263+0000 7fecee400640 1 -- 172.21.15.144:0/1334686208 wait complete. 2024-09-12T12:16:18.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:16:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f7200640 1 Processor -- start 2024-09-12T12:16:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f7200640 1 -- start start 2024-09-12T12:16:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f37f00b2520 0x7f37f0169100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37f00d0290 con 0x7f37f00cfdd0 2024-09-12T12:16:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f7200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37f00d0570 con 0x7f37f00b4b00 2024-09-12T12:16:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f37f00d0ea0 con 0x7f37f00b2520 2024-09-12T12:16:18.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f5400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f37f00cfdd0 0x7f37f00b1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52558/0 (socket says 172.21.15.144:52558) 2024-09-12T12:16:18.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f5400640 1 -- 172.21.15.144:0/3294328127 learned_addr learned my addr 172.21.15.144:0/3294328127 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f6800640 1 --2- 172.21.15.144:0/3294328127 >> v2:172.21.15.165:3300/0 conn(0x7f37f00b2520 0x7f37f0169100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083535006 0 0) 0x7f37f00d0290 con 0x7f37f00cfdd0 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37d8003530 con 0x7f37f00cfdd0 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 833164577 0 0) 0x7f37d8003530 con 0x7f37f00cfdd0 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 >> v2:172.21.15.165:3300/0 conn(0x7f37f00b2520 msgr2=0x7f37f0169100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 --2- 172.21.15.144:0/3294328127 >> v2:172.21.15.165:3300/0 conn(0x7f37f00b2520 0x7f37f0169100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 >> v1:172.21.15.165:6789/0 conn(0x7f37f00b4b00 legacy=0x7f37f00af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f00d0850 con 0x7f37f00cfdd0 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f37e0001680 con 0x7f37f00cfdd0 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 >> v1:172.21.15.144:6789/0 conn(0x7f37f00cfdd0 legacy=0x7f37f00b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:18.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d80039c0 0x7f37d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37d8004810 0x7f37d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f37f00d0ea0 con 0x7f37d80051d0 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37d800c070 con 0x7f37d80039c0 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f37d800c270 con 0x7f37d8004810 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f6800640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f5e00640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d80039c0 0x7f37d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f5400640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37d8004810 0x7f37d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f6800640 1 -- 172.21.15.144:0/3294328127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37d8004810 msgr2=0x7f37d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f6800640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37d8004810 0x7f37d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f6800640 1 -- 172.21.15.144:0/3294328127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d80039c0 msgr2=0x7f37d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f6800640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d80039c0 0x7f37d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f6800640 1 -- 172.21.15.144:0/3294328127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d8003530 con 0x7f37d80051d0 2024-09-12T12:16:18.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.439+0000 7f37f5400640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37d8004810 0x7f37d8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f6800640 1 -- 172.21.15.144:0/3294328127 reap_dead start 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f6800640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37d800b9d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009fc0 tx=0x7f37ec01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e00eb9704de7a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec009c10 con 0x7f37d80051d0 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec0a5d10 con 0x7f37d80051d0 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f4a00640 1 -- 172.21.15.144:0/3294328127 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec003be0 con 0x7f37d80051d0 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f7200640 1 -- 172.21.15.144:0/3294328127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 msgr2=0x7f37d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f7200640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37d800b9d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009fc0 tx=0x7f37ec01ccc0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f7200640 1 -- 172.21.15.144:0/3294328127 shutdown_connections 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f7200640 1 --2- 172.21.15.144:0/3294328127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37d800b9d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f7200640 1 -- 172.21.15.144:0/3294328127 >> 172.21.15.144:0/3294328127 conn(0x7f37f006e7e0 msgr2=0x7f37f006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f7200640 1 -- 172.21.15.144:0/3294328127 shutdown_connections 2024-09-12T12:16:18.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.443+0000 7f37f7200640 1 -- 172.21.15.144:0/3294328127 wait complete. 2024-09-12T12:16:18.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 Processor -- start 2024-09-12T12:16:18.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 -- start start 2024-09-12T12:16:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37f01386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37f00cc1c0 0x7f37f01f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37f0134f60 0x7f37f0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f37f00b5060 con 0x7f37d80051d0 2024-09-12T12:16:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37f00b4ee0 con 0x7f37f00cc1c0 2024-09-12T12:16:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f37f00b1e10 con 0x7f37f0134f60 2024-09-12T12:16:18.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37f01386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37f01386d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47654/0 (socket says 172.21.15.144:47654) 2024-09-12T12:16:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5e00640 1 -- 172.21.15.144:0/2758149419 learned_addr learned my addr 172.21.15.144:0/2758149419 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5400640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37f00cc1c0 0x7f37f01f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f6800640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37f0134f60 0x7f37f0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5e00640 1 -- 172.21.15.144:0/2758149419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37f0134f60 msgr2=0x7f37f0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5e00640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37f0134f60 0x7f37f0071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5e00640 1 -- 172.21.15.144:0/2758149419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37f00cc1c0 msgr2=0x7f37f01f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5e00640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37f00cc1c0 0x7f37f01f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5e00640 1 -- 172.21.15.144:0/2758149419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f00c5190 con 0x7f37d80051d0 2024-09-12T12:16:18.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f6800640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37f0134f60 0x7f37f0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:18.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f5e00640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37f01386d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f37e400f5f0 tx=0x7f37e400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:18.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37ea000640 1 -- 172.21.15.144:0/2758149419 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e40052e0 con 0x7f37d80051d0 2024-09-12T12:16:18.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37ea000640 1 -- 172.21.15.144:0/2758149419 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4018070 con 0x7f37d80051d0 2024-09-12T12:16:18.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37ea000640 1 -- 172.21.15.144:0/2758149419 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4003820 con 0x7f37d80051d0 2024-09-12T12:16:18.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f01f8490 con 0x7f37d80051d0 2024-09-12T12:16:18.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.447+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f00c5400 con 0x7f37d80051d0 2024-09-12T12:16:18.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.451+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f00b21a0 con 0x7f37d80051d0 2024-09-12T12:16:18.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.451+0000 7f37ea000640 1 -- 172.21.15.144:0/2758149419 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37e40039c0 con 0x7f37d80051d0 2024-09-12T12:16:18.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.451+0000 7f37ea000640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f37d40678f0 0x7f37d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:18.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.451+0000 7f37ea000640 1 -- 172.21.15.144:0/2758149419 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5619+0+0 (secure 0 0 0) 0x7f37e4085980 con 0x7f37d80051d0 2024-09-12T12:16:18.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.451+0000 7f37f5400640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f37d40678f0 0x7f37d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:18.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.451+0000 7f37f5400640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f37d40678f0 0x7f37d4069db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f37f00b08a0 tx=0x7f37e0007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:18.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.455+0000 7f37ea000640 1 -- 172.21.15.144:0/2758149419 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f37e4056470 con 0x7f37d80051d0 2024-09-12T12:16:18.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:18.615+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f37f00cea00 con 0x7f37d80051d0 2024-09-12T12:16:19.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37ea000640 1 -- 172.21.15.144:0/2758149419 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) ==== 170+0+0 (secure 0 0 0) 0x7f37e4005480 con 0x7f37d80051d0 2024-09-12T12:16:19.264 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:16:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f37d40678f0 msgr2=0x7f37d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f37d40678f0 0x7f37d4069db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f37f00b08a0 tx=0x7f37e0007040 comp rx=0 tx=0).stop 2024-09-12T12:16:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 msgr2=0x7f37f01386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37f01386d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f37e400f5f0 tx=0x7f37e400fab0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 shutdown_connections 2024-09-12T12:16:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f37d40678f0 0x7f37d4069db0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37f0134f60 0x7f37f0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37f00cc1c0 0x7f37f01f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 --2- 172.21.15.144:0/2758149419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37d80051d0 0x7f37f01386d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 >> 172.21.15.144:0/2758149419 conn(0x7f37f006e7e0 msgr2=0x7f37f006dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 shutdown_connections 2024-09-12T12:16:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.263+0000 7f37f7200640 1 -- 172.21.15.144:0/2758149419 wait complete. 2024-09-12T12:16:19.301 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:16:19.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b8da00640 1 Processor -- start 2024-09-12T12:16:19.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b8da00640 1 -- start start 2024-09-12T12:16:19.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b8da00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4b8815c2e0 0x7f4b88072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b8da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b880af5f0 0x7f4b8806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b8da00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b880733e0 con 0x7f4b8806c150 2024-09-12T12:16:19.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b8da00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4b8806c5c0 con 0x7f4b8815c2e0 2024-09-12T12:16:19.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b8da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4b880cd290 con 0x7f4b880af5f0 2024-09-12T12:16:19.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b87400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4b8806c150 0x7f4b8806d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52564/0 (socket says 172.21.15.144:52564) 2024-09-12T12:16:19.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b87400640 1 -- 172.21.15.144:0/2881546382 learned_addr learned my addr 172.21.15.144:0/2881546382 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:19.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b7e000640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b880af5f0 0x7f4b8806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86a00640 1 --2- 172.21.15.144:0/2881546382 >> v2:172.21.15.165:3300/0 conn(0x7f4b8815c2e0 0x7f4b88072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572580152 0 0) 0x7f4b880733e0 con 0x7f4b8806c150 2024-09-12T12:16:19.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b6c003530 con 0x7f4b8806c150 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2548756950 0 0) 0x7f4b6c003530 con 0x7f4b8806c150 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b880af5f0 msgr2=0x7f4b8806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b880af5f0 0x7f4b8806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 >> v2:172.21.15.165:3300/0 conn(0x7f4b8815c2e0 msgr2=0x7f4b88072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 --2- 172.21.15.144:0/2881546382 >> v2:172.21.15.165:3300/0 conn(0x7f4b8815c2e0 0x7f4b88072b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b880cd570 con 0x7f4b8806c150 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f4b80001a00 con 0x7f4b8806c150 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86a00640 1 --2- 172.21.15.144:0/2881546382 >> v2:172.21.15.165:3300/0 conn(0x7f4b8815c2e0 0x7f4b88072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 >> v1:172.21.15.144:6789/0 conn(0x7f4b8806c150 legacy=0x7f4b8806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b6c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b880af5f0 0x7f4b6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b6c004d50 0x7f4b6c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8806c5c0 con 0x7f4b6c0039c0 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4b880cd290 con 0x7f4b6c004d50 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c00ba80 con 0x7f4b880af5f0 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b86a00640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b6c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b7e000640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b880af5f0 0x7f4b6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.439+0000 7f4b87400640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b6c004d50 0x7f4b6c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b86a00640 1 -- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b880af5f0 msgr2=0x7f4b6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b86a00640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b880af5f0 0x7f4b6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b86a00640 1 -- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b6c004d50 msgr2=0x7f4b6c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b86a00640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b6c004d50 0x7f4b6c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b86a00640 1 -- 172.21.15.144:0/2881546382 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c003530 con 0x7f4b6c0039c0 2024-09-12T12:16:19.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b86a00640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b6c003de0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009cb0 tx=0x7f4b7801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17df630b3641ddf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b2070 con 0x7f4b6c0039c0 2024-09-12T12:16:19.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b780a5700 con 0x7f4b6c0039c0 2024-09-12T12:16:19.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b86000640 1 -- 172.21.15.144:0/2881546382 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78009880 con 0x7f4b6c0039c0 2024-09-12T12:16:19.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b8da00640 1 -- 172.21.15.144:0/2881546382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 msgr2=0x7f4b6c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b8da00640 1 --2- 172.21.15.144:0/2881546382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b6c003de0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009cb0 tx=0x7f4b7801cc90 comp rx=0 tx=0).stop 2024-09-12T12:16:19.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b87400640 1 -- 172.21.15.144:0/2881546382 reap_dead start 2024-09-12T12:16:19.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b8da00640 1 -- 172.21.15.144:0/2881546382 shutdown_connections 2024-09-12T12:16:19.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.443+0000 7f4b8da00640 1 -- 172.21.15.144:0/2881546382 >> 172.21.15.144:0/2881546382 conn(0x7f4b88068030 msgr2=0x7f4b880b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 -- 172.21.15.144:0/2881546382 shutdown_connections 2024-09-12T12:16:19.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 -- 172.21.15.144:0/2881546382 wait complete. 2024-09-12T12:16:19.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 Processor -- start 2024-09-12T12:16:19.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 -- start start 2024-09-12T12:16:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b8814a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b880b1da0 0x7f4b88160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b88160b90 0x7f4b88158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b88167090 con 0x7f4b6c0039c0 2024-09-12T12:16:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4b88166f10 con 0x7f4b880b1da0 2024-09-12T12:16:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b8da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4b88167210 con 0x7f4b88160b90 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b86a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b8814a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b86a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b8814a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47670/0 (socket says 172.21.15.144:47670) 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b86a00640 1 -- 172.21.15.144:0/4036907730 learned_addr learned my addr 172.21.15.144:0/4036907730 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b7e000640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b880b1da0 0x7f4b88160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b87400640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b88160b90 0x7f4b88158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b86a00640 1 -- 172.21.15.144:0/4036907730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b88160b90 msgr2=0x7f4b88158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b86a00640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b88160b90 0x7f4b88158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b86a00640 1 -- 172.21.15.144:0/4036907730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b880b1da0 msgr2=0x7f4b88160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b86a00640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b880b1da0 0x7f4b88160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.447+0000 7f4b86a00640 1 -- 172.21.15.144:0/4036907730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b88161210 con 0x7f4b6c0039c0 2024-09-12T12:16:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b86a00640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b8814a0a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4b780b0040 tx=0x7f4b6c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b7f400640 1 -- 172.21.15.144:0/4036907730 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780bc030 con 0x7f4b6c0039c0 2024-09-12T12:16:19.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b7f400640 1 -- 172.21.15.144:0/4036907730 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7800f000 con 0x7f4b6c0039c0 2024-09-12T12:16:19.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b7f400640 1 -- 172.21.15.144:0/4036907730 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b2040 con 0x7f4b6c0039c0 2024-09-12T12:16:19.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b880b0fe0 con 0x7f4b6c0039c0 2024-09-12T12:16:19.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b880b15a0 con 0x7f4b6c0039c0 2024-09-12T12:16:19.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b88160f70 con 0x7f4b6c0039c0 2024-09-12T12:16:19.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b7f400640 1 -- 172.21.15.144:0/4036907730 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b780bf070 con 0x7f4b6c0039c0 2024-09-12T12:16:19.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b7f400640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b640678f0 0x7f4b64069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b7f400640 1 -- 172.21.15.144:0/4036907730 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6001+0+0 (secure 0 0 0) 0x7f4b7811f6c0 con 0x7f4b6c0039c0 2024-09-12T12:16:19.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.451+0000 7f4b7e000640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b640678f0 0x7f4b64069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.455+0000 7f4b7e000640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b640678f0 0x7f4b64069db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4b881602b0 tx=0x7f4b70009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.459+0000 7f4b7f400640 1 -- 172.21.15.144:0/4036907730 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b780169a0 con 0x7f4b6c0039c0 2024-09-12T12:16:19.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:19.651+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4b88072b50 con 0x7f4b6c0039c0 2024-09-12T12:16:20.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b7f400640 1 -- 172.21.15.144:0/4036907730 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v35) ==== 173+0+0 (secure 0 0 0) 0x7f4b780efa70 con 0x7f4b6c0039c0 2024-09-12T12:16:20.277 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 9 and data pool 10 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b640678f0 msgr2=0x7f4b64069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b640678f0 0x7f4b64069db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4b881602b0 tx=0x7f4b70009190 comp rx=0 tx=0).stop 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 msgr2=0x7f4b8814a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b8814a0a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4b780b0040 tx=0x7f4b6c005840 comp rx=0 tx=0).stop 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 shutdown_connections 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b640678f0 0x7f4b64069db0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b88160b90 0x7f4b88158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b880b1da0 0x7f4b88160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 --2- 172.21.15.144:0/4036907730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b6c0039c0 0x7f4b8814a0a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 >> 172.21.15.144:0/4036907730 conn(0x7f4b88068030 msgr2=0x7f4b88158360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.275+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 shutdown_connections 2024-09-12T12:16:20.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.279+0000 7f4b8da00640 1 -- 172.21.15.144:0/4036907730 wait complete. 2024-09-12T12:16:20.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:16:20.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.451+0000 7fe0d1000640 1 Processor -- start 2024-09-12T12:16:20.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0d1000640 1 -- start start 2024-09-12T12:16:20.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0d1000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe0cc15c0a0 0x7fe0cc0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0d1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc0ce950 0x7fe0cc15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0d1000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0cc0b6b20 0x7fe0cc0b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0d1000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe0cc1609e0 con 0x7fe0cc0b6b20 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0d1000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe0cc0b7510 con 0x7fe0cc15c0a0 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0d1000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe0cc15c480 con 0x7fe0cc0ce950 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0cc0b6b20 0x7fe0cc0b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0cc0b6b20 0x7fe0cc0b6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47686/0 (socket says 172.21.15.144:47686) 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cbe00640 1 -- 172.21.15.144:0/2199446440 learned_addr learned my addr 172.21.15.144:0/2199446440 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0caa00640 1 --2- 172.21.15.144:0/2199446440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc0ce950 0x7fe0cc15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cb400640 1 --2- 172.21.15.144:0/2199446440 >> v2:172.21.15.165:3300/0 conn(0x7fe0cc15c0a0 0x7fe0cc0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cbe00640 1 -- 172.21.15.144:0/2199446440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc0ce950 msgr2=0x7fe0cc15d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cbe00640 1 --2- 172.21.15.144:0/2199446440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc0ce950 0x7fe0cc15d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cbe00640 1 -- 172.21.15.144:0/2199446440 >> v2:172.21.15.165:3300/0 conn(0x7fe0cc15c0a0 msgr2=0x7fe0cc0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cbe00640 1 --2- 172.21.15.144:0/2199446440 >> v2:172.21.15.165:3300/0 conn(0x7fe0cc15c0a0 0x7fe0cc0b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cbe00640 1 -- 172.21.15.144:0/2199446440 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc15fdd0 con 0x7fe0cc0b6b20 2024-09-12T12:16:20.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.455+0000 7fe0cb400640 1 --2- 172.21.15.144:0/2199446440 >> v2:172.21.15.165:3300/0 conn(0x7fe0cc15c0a0 0x7fe0cc0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:20.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0cbe00640 1 --2- 172.21.15.144:0/2199446440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0b6b20 0x7fe0cc0b6fd0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc072910 tx=0x7fe0c401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c66e8009e923b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0ca000640 1 -- 172.21.15.144:0/2199446440 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40a56d0 con 0x7fe0cc0b6b20 2024-09-12T12:16:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0ca000640 1 -- 172.21.15.144:0/2199446440 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c40a5870 con 0x7fe0cc0b6b20 2024-09-12T12:16:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0ca000640 1 -- 172.21.15.144:0/2199446440 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40a5c40 con 0x7fe0cc0b6b20 2024-09-12T12:16:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 -- 172.21.15.144:0/2199446440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0b6b20 msgr2=0x7fe0cc0b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 --2- 172.21.15.144:0/2199446440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0b6b20 0x7fe0cc0b6fd0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc072910 tx=0x7fe0c401c960 comp rx=0 tx=0).stop 2024-09-12T12:16:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 -- 172.21.15.144:0/2199446440 shutdown_connections 2024-09-12T12:16:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 --2- 172.21.15.144:0/2199446440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0b6b20 0x7fe0cc0b6fd0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 --2- 172.21.15.144:0/2199446440 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc0ce950 0x7fe0cc15d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 --2- 172.21.15.144:0/2199446440 >> v2:172.21.15.165:3300/0 conn(0x7fe0cc15c0a0 0x7fe0cc0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 -- 172.21.15.144:0/2199446440 >> 172.21.15.144:0/2199446440 conn(0x7fe0cc0d2280 msgr2=0x7fe0cc0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 -- 172.21.15.144:0/2199446440 shutdown_connections 2024-09-12T12:16:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 -- 172.21.15.144:0/2199446440 wait complete. 2024-09-12T12:16:20.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 Processor -- start 2024-09-12T12:16:20.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.459+0000 7fe0d1000640 1 -- start start 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0d1000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc0b6b20 0x7fe0cc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0d1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0ce950 0x7fe0cc1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0d1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc15c0a0 0x7fe0cc141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0d1000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc073a20 con 0x7fe0cc0ce950 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0d1000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc0738a0 con 0x7fe0cc0b6b20 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0d1000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe0cc073ba0 con 0x7fe0cc15c0a0 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0ce950 0x7fe0cc1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0ce950 0x7fe0cc1524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47690/0 (socket says 172.21.15.144:47690) 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0caa00640 1 -- 172.21.15.144:0/3511694711 learned_addr learned my addr 172.21.15.144:0/3511694711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:20.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0cb400640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc0b6b20 0x7fe0cc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0cbe00640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc15c0a0 0x7fe0cc141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0caa00640 1 -- 172.21.15.144:0/3511694711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc15c0a0 msgr2=0x7fe0cc141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0caa00640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc15c0a0 0x7fe0cc141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0caa00640 1 -- 172.21.15.144:0/3511694711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc0b6b20 msgr2=0x7fe0cc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0caa00640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc0b6b20 0x7fe0cc15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0caa00640 1 -- 172.21.15.144:0/3511694711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc15f620 con 0x7fe0cc0ce950 2024-09-12T12:16:20.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0caa00640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0ce950 0x7fe0cc1524e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800e980 tx=0x7fe0b800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0c3400640 1 -- 172.21.15.144:0/3511694711 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8017070 con 0x7fe0cc0ce950 2024-09-12T12:16:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0c3400640 1 -- 172.21.15.144:0/3511694711 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b800ca00 con 0x7fe0cc0ce950 2024-09-12T12:16:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc152ec0 con 0x7fe0cc0ce950 2024-09-12T12:16:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0c3400640 1 -- 172.21.15.144:0/3511694711 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b800cdd0 con 0x7fe0cc0ce950 2024-09-12T12:16:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc06d6d0 con 0x7fe0cc0ce950 2024-09-12T12:16:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.463+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0cc0b6fd0 con 0x7fe0cc0ce950 2024-09-12T12:16:20.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.467+0000 7fe0c3400640 1 -- 172.21.15.144:0/3511694711 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe0b8013470 con 0x7fe0cc0ce950 2024-09-12T12:16:20.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.467+0000 7fe0c3400640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0ac0678c0 0x7fe0ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.467+0000 7fe0c3400640 1 -- 172.21.15.144:0/3511694711 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fe0b80859f0 con 0x7fe0cc0ce950 2024-09-12T12:16:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.467+0000 7fe0cb400640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0ac0678c0 0x7fe0ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.467+0000 7fe0cb400640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0ac0678c0 0x7fe0ac069d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc006e90 tx=0x7fe0bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:20.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.471+0000 7fe0c3400640 1 -- 172.21.15.144:0/3511694711 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe0b8055d40 con 0x7fe0cc0ce950 2024-09-12T12:16:20.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.631+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0cc0b1c60 con 0x7fe0cc0ce950 2024-09-12T12:16:20.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.631+0000 7fe0c3400640 1 -- 172.21.15.144:0/3511694711 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16981 (secure 0 0 0) 0x7fe0b805a040 con 0x7fe0cc0ce950 2024-09-12T12:16:20.634 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:20.634 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":64,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:16:19.655049+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:16:17.373953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T12:16:18.661913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0ac0678c0 msgr2=0x7fe0ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0ac0678c0 0x7fe0ac069d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc006e90 tx=0x7fe0bc008040 comp rx=0 tx=0).stop 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0ce950 msgr2=0x7fe0cc1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0ce950 0x7fe0cc1524e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800e980 tx=0x7fe0b800ee40 comp rx=0 tx=0).stop 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 shutdown_connections 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0ac0678c0 0x7fe0ac069d80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0cc15c0a0 0x7fe0cc141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0cc0ce950 0x7fe0cc1524e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 --2- 172.21.15.144:0/3511694711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc0b6b20 0x7fe0cc15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 >> 172.21.15.144:0/3511694711 conn(0x7fe0cc0d2280 msgr2=0x7fe0cc1555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:20.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 shutdown_connections 2024-09-12T12:16:20.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.635+0000 7fe0d1000640 1 -- 172.21.15.144:0/3511694711 wait complete. 2024-09-12T12:16:20.656 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:16:20.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce08c00640 1 Processor -- start 2024-09-12T12:16:20.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce08c00640 1 -- start start 2024-09-12T12:16:20.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce08c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0415bff0 0x7fce0415f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce08c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce04162c30 con 0x7fce0406bc10 2024-09-12T12:16:20.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce08c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce04073600 con 0x7fce040afab0 2024-09-12T12:16:20.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce08c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce04072e60 con 0x7fce0415bff0 2024-09-12T12:16:20.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce02a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fce0406bc10 0x7fce04161e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52578/0 (socket says 172.21.15.144:52578) 2024-09-12T12:16:20.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce02a00640 1 -- 172.21.15.144:0/2614920831 learned_addr learned my addr 172.21.15.144:0/2614920831 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:20.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce03400640 1 --2- 172.21.15.144:0/2614920831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0415bff0 0x7fce0415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce02000640 1 -- 172.21.15.144:0/2614920831 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9990777 0 0) 0x7fce04162c30 con 0x7fce0406bc10 2024-09-12T12:16:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce02000640 1 -- 172.21.15.144:0/2614920831 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcde8003530 con 0x7fce0406bc10 2024-09-12T12:16:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce02000640 1 -- 172.21.15.144:0/2614920831 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993984169 0 0) 0x7fce04073600 con 0x7fce040afab0 2024-09-12T12:16:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce02000640 1 -- 172.21.15.144:0/2614920831 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce04162c30 con 0x7fce040afab0 2024-09-12T12:16:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce03400640 1 -- 172.21.15.144:0/2614920831 >> v1:172.21.15.165:6789/0 conn(0x7fce040afab0 legacy=0x7fce04162520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce03400640 1 -- 172.21.15.144:0/2614920831 >> v1:172.21.15.144:6789/0 conn(0x7fce0406bc10 legacy=0x7fce04161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.791+0000 7fce03400640 1 -- 172.21.15.144:0/2614920831 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0415f790 con 0x7fce0415bff0 2024-09-12T12:16:20.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce03400640 1 --2- 172.21.15.144:0/2614920831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0415bff0 0x7fce0415f250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40097f0 tx=0x7fcdf401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c08ff22ad28b15cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:20.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce02000640 1 -- 172.21.15.144:0/2614920831 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40ab620 con 0x7fce0415bff0 2024-09-12T12:16:20.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce02000640 1 -- 172.21.15.144:0/2614920831 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf40b0070 con 0x7fce0415bff0 2024-09-12T12:16:20.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce02000640 1 -- 172.21.15.144:0/2614920831 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40ab9e0 con 0x7fce0415bff0 2024-09-12T12:16:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce08c00640 1 -- 172.21.15.144:0/2614920831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0415bff0 msgr2=0x7fce0415f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce08c00640 1 --2- 172.21.15.144:0/2614920831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0415bff0 0x7fce0415f250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40097f0 tx=0x7fcdf401c420 comp rx=0 tx=0).stop 2024-09-12T12:16:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce08c00640 1 -- 172.21.15.144:0/2614920831 shutdown_connections 2024-09-12T12:16:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce08c00640 1 --2- 172.21.15.144:0/2614920831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0415bff0 0x7fce0415f250 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce08c00640 1 -- 172.21.15.144:0/2614920831 >> 172.21.15.144:0/2614920831 conn(0x7fce0406e060 msgr2=0x7fce0406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce08c00640 1 -- 172.21.15.144:0/2614920831 shutdown_connections 2024-09-12T12:16:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.795+0000 7fce08c00640 1 -- 172.21.15.144:0/2614920831 wait complete. 2024-09-12T12:16:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 Processor -- start 2024-09-12T12:16:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 -- start start 2024-09-12T12:16:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0406bc10 0x7fce0414f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce040afab0 0x7fce0415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0415bff0 0x7fce041faa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce04071eb0 con 0x7fce0415bff0 2024-09-12T12:16:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce04072af0 con 0x7fce040afab0 2024-09-12T12:16:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce04072030 con 0x7fce0406bc10 2024-09-12T12:16:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0415bff0 0x7fce041faa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0406bc10 0x7fce0414f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0415bff0 0x7fce041faa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47698/0 (socket says 172.21.15.144:47698) 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce02a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce040afab0 0x7fce0415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03e00640 1 -- 172.21.15.144:0/2002687157 learned_addr learned my addr 172.21.15.144:0/2002687157 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03e00640 1 -- 172.21.15.144:0/2002687157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0406bc10 msgr2=0x7fce0414f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03e00640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0406bc10 0x7fce0414f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03e00640 1 -- 172.21.15.144:0/2002687157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce040afab0 msgr2=0x7fce0415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03e00640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce040afab0 0x7fce0415b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03e00640 1 -- 172.21.15.144:0/2002687157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce041503f0 con 0x7fce0415bff0 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce03e00640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0415bff0 0x7fce041faa90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00c6c0 tx=0x7fcdfc00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fcdfb400640 1 -- 172.21.15.144:0/2002687157 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc003b80 con 0x7fce0415bff0 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fcdfb400640 1 -- 172.21.15.144:0/2002687157 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc003d20 con 0x7fce0415bff0 2024-09-12T12:16:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fcdfb400640 1 -- 172.21.15.144:0/2002687157 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0052f0 con 0x7fce0415bff0 2024-09-12T12:16:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce04155070 con 0x7fce0415bff0 2024-09-12T12:16:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce040b4fc0 con 0x7fce0415bff0 2024-09-12T12:16:20.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.799+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce0406c400 con 0x7fce0415bff0 2024-09-12T12:16:20.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.803+0000 7fcdfb400640 1 -- 172.21.15.144:0/2002687157 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcdfc005490 con 0x7fce0415bff0 2024-09-12T12:16:20.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.803+0000 7fcdfb400640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcde40678c0 0x7fcde4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:20.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.803+0000 7fcdfb400640 1 -- 172.21.15.144:0/2002687157 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fcdfc085c20 con 0x7fce0415bff0 2024-09-12T12:16:20.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.803+0000 7fce03400640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcde40678c0 0x7fcde4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:20.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.803+0000 7fce03400640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcde40678c0 0x7fcde4069d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40af000 tx=0x7fcdf40a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:20.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.807+0000 7fcdfb400640 1 -- 172.21.15.144:0/2002687157 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcdfc055ee0 con 0x7fce0415bff0 2024-09-12T12:16:20.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.963+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce040d0ab0 con 0x7fce0415bff0 2024-09-12T12:16:20.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.963+0000 7fcdfb400640 1 -- 172.21.15.144:0/2002687157 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16981 (secure 0 0 0) 0x7fcdfc05a1e0 con 0x7fce0415bff0 2024-09-12T12:16:20.967 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:20.967 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":64,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:16:19.655049+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:16:17.373953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T12:16:18.661913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcde40678c0 msgr2=0x7fcde4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcde40678c0 0x7fcde4069d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40af000 tx=0x7fcdf40a7000 comp rx=0 tx=0).stop 2024-09-12T12:16:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0415bff0 msgr2=0x7fce041faa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0415bff0 0x7fce041faa90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00c6c0 tx=0x7fcdfc00cb80 comp rx=0 tx=0).stop 2024-09-12T12:16:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 shutdown_connections 2024-09-12T12:16:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcde40678c0 0x7fcde4069d80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce0415bff0 0x7fce041faa90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce040afab0 0x7fce0415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 --2- 172.21.15.144:0/2002687157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce0406bc10 0x7fce0414f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 >> 172.21.15.144:0/2002687157 conn(0x7fce0406e060 msgr2=0x7fce0406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:20.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 shutdown_connections 2024-09-12T12:16:20.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:20.967+0000 7fce08c00640 1 -- 172.21.15.144:0/2002687157 wait complete. 2024-09-12T12:16:20.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:16:21.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38b6e00640 1 Processor -- start 2024-09-12T12:16:21.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38b6e00640 1 -- start start 2024-09-12T12:16:21.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38b6e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f38b00cd9f0 0x7f38b006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38b6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015b340 0x7f38b006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38b6e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b00b4300 con 0x7f38b015af60 2024-09-12T12:16:21.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38b6e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f38b00b32f0 con 0x7f38b00cd9f0 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38b6e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f38b00b3540 con 0x7f38b015b340 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38af400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f38b00cd9f0 0x7f38b006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38af400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f38b00cd9f0 0x7f38b006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47706/0 (socket says 172.21.15.144:47706) 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38af400640 1 -- 172.21.15.144:0/1396906303 learned_addr learned my addr 172.21.15.144:0/1396906303 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38b4e00640 1 --2- 172.21.15.144:0/1396906303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015b340 0x7f38b006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38af400640 1 -- 172.21.15.144:0/1396906303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015b340 msgr2=0x7f38b006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38af400640 1 --2- 172.21.15.144:0/1396906303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015b340 0x7f38b006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38af400640 1 -- 172.21.15.144:0/1396906303 >> v1:172.21.15.165:6789/0 conn(0x7f38b015af60 legacy=0x7f38b00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38af400640 1 -- 172.21.15.144:0/1396906303 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b00b3820 con 0x7f38b00cd9f0 2024-09-12T12:16:21.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.127+0000 7f38b4e00640 1 --2- 172.21.15.144:0/1396906303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015b340 0x7f38b006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38af400640 1 --2- 172.21.15.144:0/1396906303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b00cd9f0 0x7f38b006bc10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f389c009870 tx=0x7f389c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36ef1bca3c81b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:21.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38aea00640 1 -- 172.21.15.144:0/1396906303 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c0b2070 con 0x7f38b00cd9f0 2024-09-12T12:16:21.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38aea00640 1 -- 172.21.15.144:0/1396906303 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389c0a9070 con 0x7f38b00cd9f0 2024-09-12T12:16:21.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38aea00640 1 -- 172.21.15.144:0/1396906303 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c0ad880 con 0x7f38b00cd9f0 2024-09-12T12:16:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38b6e00640 1 -- 172.21.15.144:0/1396906303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b00cd9f0 msgr2=0x7f38b006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38b6e00640 1 --2- 172.21.15.144:0/1396906303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b00cd9f0 0x7f38b006bc10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f389c009870 tx=0x7f389c01c560 comp rx=0 tx=0).stop 2024-09-12T12:16:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38b6e00640 1 -- 172.21.15.144:0/1396906303 shutdown_connections 2024-09-12T12:16:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38b6e00640 1 --2- 172.21.15.144:0/1396906303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015b340 0x7f38b006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38b6e00640 1 --2- 172.21.15.144:0/1396906303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b00cd9f0 0x7f38b006bc10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38b6e00640 1 -- 172.21.15.144:0/1396906303 >> 172.21.15.144:0/1396906303 conn(0x7f38b0068030 msgr2=0x7f38b00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38b6e00640 1 -- 172.21.15.144:0/1396906303 shutdown_connections 2024-09-12T12:16:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.131+0000 7f38b6e00640 1 -- 172.21.15.144:0/1396906303 wait complete. 2024-09-12T12:16:21.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 Processor -- start 2024-09-12T12:16:21.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 -- start start 2024-09-12T12:16:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38b00cd9f0 0x7f38b0159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015af60 0x7f38b014c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b015b340 0x7f38b014ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38b00b5180 con 0x7f38b015b340 2024-09-12T12:16:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f38b00b5000 con 0x7f38b00cd9f0 2024-09-12T12:16:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f38b00b5300 con 0x7f38b015af60 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b015b340 0x7f38b014ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b015b340 0x7f38b014ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47708/0 (socket says 172.21.15.144:47708) 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b4e00640 1 -- 172.21.15.144:0/3004291811 learned_addr learned my addr 172.21.15.144:0/3004291811 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38afe00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38b00cd9f0 0x7f38b0159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38af400640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015af60 0x7f38b014c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b4e00640 1 -- 172.21.15.144:0/3004291811 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015af60 msgr2=0x7f38b014c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b4e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015af60 0x7f38b014c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b4e00640 1 -- 172.21.15.144:0/3004291811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38b00cd9f0 msgr2=0x7f38b0159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b4e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38b00cd9f0 0x7f38b0159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b4e00640 1 -- 172.21.15.144:0/3004291811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b015d140 con 0x7f38b015b340 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b4e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b015b340 0x7f38b014ce30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f38a8007ea0 tx=0x7f38a8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38a7e00640 1 -- 172.21.15.144:0/3004291811 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a801a070 con 0x7f38b015b340 2024-09-12T12:16:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38a7e00640 1 -- 172.21.15.144:0/3004291811 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a8003bc0 con 0x7f38b015b340 2024-09-12T12:16:21.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38a7e00640 1 -- 172.21.15.144:0/3004291811 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a800de70 con 0x7f38b015b340 2024-09-12T12:16:21.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b014dac0 con 0x7f38b015b340 2024-09-12T12:16:21.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b014e080 con 0x7f38b015b340 2024-09-12T12:16:21.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.135+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b014e2c0 con 0x7f38b015b340 2024-09-12T12:16:21.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.139+0000 7f38a7e00640 1 -- 172.21.15.144:0/3004291811 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38a801d070 con 0x7f38b015b340 2024-09-12T12:16:21.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.139+0000 7f38a7e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f38900678c0 0x7f3890069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.139+0000 7f38a7e00640 1 -- 172.21.15.144:0/3004291811 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f38a8086100 con 0x7f38b015b340 2024-09-12T12:16:21.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.139+0000 7f38afe00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f38900678c0 0x7f3890069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:21.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.139+0000 7f38afe00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f38900678c0 0x7f3890069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f38a0000f70 tx=0x7f38a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:21.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.143+0000 7f38a7e00640 1 -- 172.21.15.144:0/3004291811 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f38a8010070 con 0x7f38b015b340 2024-09-12T12:16:21.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:21.339+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f38b00afc20 con 0x7f38b015b340 2024-09-12T12:16:22.262 INFO:tasks.ceph.mds.d.smithi165.stderr:2024-09-12T12:16:22.259+0000 7f964b600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:16:22.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38a7e00640 1 -- 172.21.15.144:0/3004291811 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) ==== 118+0+0 (secure 0 0 0) 0x7f38a8056aa0 con 0x7f38b015b340 2024-09-12T12:16:22.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f38900678c0 msgr2=0x7f3890069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:22.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f38900678c0 0x7f3890069d80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f38a0000f70 tx=0x7f38a0009040 comp rx=0 tx=0).stop 2024-09-12T12:16:22.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b015b340 msgr2=0x7f38b014ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:22.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b015b340 0x7f38b014ce30 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f38a8007ea0 tx=0x7f38a8007f90 comp rx=0 tx=0).stop 2024-09-12T12:16:22.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 shutdown_connections 2024-09-12T12:16:22.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f38900678c0 0x7f3890069d80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38b015b340 0x7f38b014ce30 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38b015af60 0x7f38b014c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 --2- 172.21.15.144:0/3004291811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38b00cd9f0 0x7f38b0159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 >> 172.21.15.144:0/3004291811 conn(0x7f38b0068030 msgr2=0x7f38b00b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:22.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 shutdown_connections 2024-09-12T12:16:22.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.311+0000 7f38b6e00640 1 -- 172.21.15.144:0/3004291811 wait complete. 2024-09-12T12:16:22.339 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:16:22.339 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:16:22.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10ee200640 1 Processor -- start 2024-09-12T12:16:22.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10ee200640 1 -- start start 2024-09-12T12:16:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10ee200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f10e80cd9f0 0x7f10e806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10ee200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10e815b340 0x7f10e806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:22.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10ee200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e80b4300 con 0x7f10e815af60 2024-09-12T12:16:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10ee200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f10e80b32f0 con 0x7f10e815b340 2024-09-12T12:16:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10ee200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f10e80b3540 con 0x7f10e80cd9f0 2024-09-12T12:16:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10e7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10e815b340 0x7f10e806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10e7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f10e815af60 0x7f10e80ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52582/0 (socket says 172.21.15.144:52582) 2024-09-12T12:16:22.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10e7400640 1 -- 172.21.15.144:0/1367528968 learned_addr learned my addr 172.21.15.144:0/1367528968 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.479+0000 7f10e6a00640 1 --2- 172.21.15.144:0/1367528968 >> v2:172.21.15.165:3300/0 conn(0x7f10e80cd9f0 0x7f10e806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10e7e00640 1 -- 172.21.15.144:0/1367528968 >> v2:172.21.15.165:3300/0 conn(0x7f10e80cd9f0 msgr2=0x7f10e806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10e7e00640 1 --2- 172.21.15.144:0/1367528968 >> v2:172.21.15.165:3300/0 conn(0x7f10e80cd9f0 0x7f10e806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10e7e00640 1 -- 172.21.15.144:0/1367528968 >> v1:172.21.15.144:6789/0 conn(0x7f10e815af60 legacy=0x7f10e80ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:22.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10e7e00640 1 -- 172.21.15.144:0/1367528968 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e80b3820 con 0x7f10e815b340 2024-09-12T12:16:22.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10e6000640 1 -- 172.21.15.144:0/1367528968 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402141716 0 0) 0x7f10e80b4300 con 0x7f10e815af60 2024-09-12T12:16:22.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10e7e00640 1 --2- 172.21.15.144:0/1367528968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 0x7f10e806c150 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f10e8070d20 tx=0x7f10e001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960235dbfe358b02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10e6000640 1 -- 172.21.15.144:0/1367528968 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00b2070 con 0x7f10e815b340 2024-09-12T12:16:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10e6000640 1 -- 172.21.15.144:0/1367528968 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00a57f0 con 0x7f10e815b340 2024-09-12T12:16:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10e6000640 1 -- 172.21.15.144:0/1367528968 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00a5bc0 con 0x7f10e815b340 2024-09-12T12:16:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10ee200640 1 -- 172.21.15.144:0/1367528968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 msgr2=0x7f10e806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:22.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.483+0000 7f10ee200640 1 --2- 172.21.15.144:0/1367528968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 0x7f10e806c150 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f10e8070d20 tx=0x7f10e001c930 comp rx=0 tx=0).stop 2024-09-12T12:16:22.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 -- 172.21.15.144:0/1367528968 shutdown_connections 2024-09-12T12:16:22.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 --2- 172.21.15.144:0/1367528968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 0x7f10e806c150 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 --2- 172.21.15.144:0/1367528968 >> v2:172.21.15.165:3300/0 conn(0x7f10e80cd9f0 0x7f10e806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 -- 172.21.15.144:0/1367528968 >> 172.21.15.144:0/1367528968 conn(0x7f10e8068030 msgr2=0x7f10e80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:22.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 -- 172.21.15.144:0/1367528968 shutdown_connections 2024-09-12T12:16:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 -- 172.21.15.144:0/1367528968 wait complete. 2024-09-12T12:16:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 Processor -- start 2024-09-12T12:16:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 -- start start 2024-09-12T12:16:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10e80cd9f0 0x7f10e8142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10e815af60 0x7f10e815e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:22.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 0x7f10e8071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10e80b5180 con 0x7f10e815b340 2024-09-12T12:16:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10e80b5000 con 0x7f10e80cd9f0 2024-09-12T12:16:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10ee200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f10e80b5300 con 0x7f10e815af60 2024-09-12T12:16:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 0x7f10e8071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:22.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 0x7f10e8071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47722/0 (socket says 172.21.15.144:47722) 2024-09-12T12:16:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7e00640 1 -- 172.21.15.144:0/1404050794 learned_addr learned my addr 172.21.15.144:0/1404050794 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e6a00640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10e815af60 0x7f10e815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7400640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10e80cd9f0 0x7f10e8142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7e00640 1 -- 172.21.15.144:0/1404050794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10e815af60 msgr2=0x7f10e815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:22.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7e00640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10e815af60 0x7f10e815e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7e00640 1 -- 172.21.15.144:0/1404050794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10e80cd9f0 msgr2=0x7f10e8142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:22.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7e00640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10e80cd9f0 0x7f10e8142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:22.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7e00640 1 -- 172.21.15.144:0/1404050794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e815bfb0 con 0x7f10e815b340 2024-09-12T12:16:22.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e6a00640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10e815af60 0x7f10e815e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:22.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.487+0000 7f10e7e00640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 0x7f10e8071c60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f10e00b0040 tx=0x7f10e00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10df400640 1 -- 172.21.15.144:0/1404050794 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00b2050 con 0x7f10e815b340 2024-09-12T12:16:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10df400640 1 -- 172.21.15.144:0/1404050794 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00b3040 con 0x7f10e815b340 2024-09-12T12:16:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10df400640 1 -- 172.21.15.144:0/1404050794 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0003ba0 con 0x7f10e815b340 2024-09-12T12:16:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e814f3c0 con 0x7f10e815b340 2024-09-12T12:16:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e815bc40 con 0x7f10e815b340 2024-09-12T12:16:22.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e80ce680 con 0x7f10e815b340 2024-09-12T12:16:22.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10df400640 1 -- 172.21.15.144:0/1404050794 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10e00ad650 con 0x7f10e815b340 2024-09-12T12:16:22.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10df400640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10c80678c0 0x7f10c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:22.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10df400640 1 -- 172.21.15.144:0/1404050794 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7f10e01202d0 con 0x7f10e815b340 2024-09-12T12:16:22.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.491+0000 7f10e7400640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10c80678c0 0x7f10c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:22.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.495+0000 7f10e7400640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10c80678c0 0x7f10c8069d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007fd0 tx=0x7f10d8007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:22.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.495+0000 7f10df400640 1 -- 172.21.15.144:0/1404050794 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f10e0016520 con 0x7f10e815b340 2024-09-12T12:16:22.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:22.687+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f10e814a0a0 con 0x7f10e815b340 2024-09-12T12:16:23.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.311+0000 7f10df400640 1 -- 172.21.15.144:0/1404050794 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) ==== 122+0+0 (secure 0 0 0) 0x7f10e00f0630 con 0x7f10e815b340 2024-09-12T12:16:23.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10c80678c0 msgr2=0x7f10c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10c80678c0 0x7f10c8069d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007fd0 tx=0x7f10d8007d60 comp rx=0 tx=0).stop 2024-09-12T12:16:23.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 msgr2=0x7f10e8071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 0x7f10e8071c60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f10e00b0040 tx=0x7f10e00196d0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 shutdown_connections 2024-09-12T12:16:23.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10c80678c0 0x7f10c8069d80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10e815b340 0x7f10e8071c60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10e815af60 0x7f10e815e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 --2- 172.21.15.144:0/1404050794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10e80cd9f0 0x7f10e8142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 >> 172.21.15.144:0/1404050794 conn(0x7f10e8068030 msgr2=0x7f10e80b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:23.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 shutdown_connections 2024-09-12T12:16:23.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.315+0000 7f10ee200640 1 -- 172.21.15.144:0/1404050794 wait complete. 2024-09-12T12:16:23.336 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:16:23.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:23.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.471+0000 7fa41f200640 1 Processor -- start 2024-09-12T12:16:23.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.471+0000 7fa41f200640 1 -- start start 2024-09-12T12:16:23.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.471+0000 7fa41f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41815b160 0x7fa418070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.471+0000 7fa41f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa418073bd0 0x7fa4180ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.471+0000 7fa41f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4180cd4a0 con 0x7fa4180cd000 2024-09-12T12:16:23.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.471+0000 7fa41f200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa41815b540 con 0x7fa418073bd0 2024-09-12T12:16:23.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.471+0000 7fa41f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4180cd780 con 0x7fa41815b160 2024-09-12T12:16:23.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa418073bd0 0x7fa4180ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa4180cd000 0x7fa4180cff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52594/0 (socket says 172.21.15.144:52594) 2024-09-12T12:16:23.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41e800640 1 -- 172.21.15.144:0/869094251 learned_addr learned my addr 172.21.15.144:0/869094251 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:23.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41d400640 1 -- 172.21.15.144:0/869094251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41815b160 msgr2=0x7fa418070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:23.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41de00640 1 --2- 172.21.15.144:0/869094251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41815b160 0x7fa418070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41d400640 1 --2- 172.21.15.144:0/869094251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41815b160 0x7fa418070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41ca00640 1 -- 172.21.15.144:0/869094251 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1849686652 0 0) 0x7fa4180cd4a0 con 0x7fa4180cd000 2024-09-12T12:16:23.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41d400640 1 -- 172.21.15.144:0/869094251 >> v1:172.21.15.144:6789/0 conn(0x7fa4180cd000 legacy=0x7fa4180cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41d400640 1 -- 172.21.15.144:0/869094251 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4180b3180 con 0x7fa418073bd0 2024-09-12T12:16:23.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41de00640 1 --2- 172.21.15.144:0/869094251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41815b160 0x7fa418070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:23.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41d400640 1 --2- 172.21.15.144:0/869094251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073bd0 0x7fa4180ccac0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097c0 tx=0x7fa40801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5834e33b8f9282c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:23.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41ca00640 1 -- 172.21.15.144:0/869094251 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4080b0070 con 0x7fa418073bd0 2024-09-12T12:16:23.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41ca00640 1 -- 172.21.15.144:0/869094251 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4080ab600 con 0x7fa418073bd0 2024-09-12T12:16:23.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.475+0000 7fa41ca00640 1 -- 172.21.15.144:0/869094251 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4080ab9d0 con 0x7fa418073bd0 2024-09-12T12:16:23.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 -- 172.21.15.144:0/869094251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073bd0 msgr2=0x7fa4180ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 --2- 172.21.15.144:0/869094251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073bd0 0x7fa4180ccac0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097c0 tx=0x7fa40801c410 comp rx=0 tx=0).stop 2024-09-12T12:16:23.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 -- 172.21.15.144:0/869094251 shutdown_connections 2024-09-12T12:16:23.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 --2- 172.21.15.144:0/869094251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073bd0 0x7fa4180ccac0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 --2- 172.21.15.144:0/869094251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41815b160 0x7fa418070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 -- 172.21.15.144:0/869094251 >> 172.21.15.144:0/869094251 conn(0x7fa41806bc10 msgr2=0x7fa41806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:23.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 -- 172.21.15.144:0/869094251 shutdown_connections 2024-09-12T12:16:23.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 -- 172.21.15.144:0/869094251 wait complete. 2024-09-12T12:16:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 Processor -- start 2024-09-12T12:16:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 -- start start 2024-09-12T12:16:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa418073bd0 0x7fa418152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4180cd000 0x7fa418155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815b160 0x7fa4180ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4180b4520 con 0x7fa4180cd000 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4180b43a0 con 0x7fa41815b160 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4180b46a0 con 0x7fa418073bd0 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4180cd000 0x7fa418155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4180cd000 0x7fa418155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47738/0 (socket says 172.21.15.144:47738) 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41d400640 1 -- 172.21.15.144:0/4270599505 learned_addr learned my addr 172.21.15.144:0/4270599505 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41de00640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa418073bd0 0x7fa418152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41e800640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815b160 0x7fa4180ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41d400640 1 -- 172.21.15.144:0/4270599505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa418073bd0 msgr2=0x7fa418152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41d400640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa418073bd0 0x7fa418152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41d400640 1 -- 172.21.15.144:0/4270599505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815b160 msgr2=0x7fa4180ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41d400640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815b160 0x7fa4180ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41d400640 1 -- 172.21.15.144:0/4270599505 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa418154360 con 0x7fa4180cd000 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.479+0000 7fa41e800640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815b160 0x7fa4180ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa41d400640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4180cd000 0x7fa418155fc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa4080ae040 tx=0x7fa4080191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa412000640 1 -- 172.21.15.144:0/4270599505 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4080b8020 con 0x7fa4180cd000 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa412000640 1 -- 172.21.15.144:0/4270599505 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4080b4630 con 0x7fa4180cd000 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa412000640 1 -- 172.21.15.144:0/4270599505 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4080b0040 con 0x7fa4180cd000 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa418156a30 con 0x7fa4180cd000 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa418154900 con 0x7fa4180cd000 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4180ccac0 con 0x7fa4180cd000 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa412000640 1 -- 172.21.15.144:0/4270599505 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4080bb020 con 0x7fa4180cd000 2024-09-12T12:16:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa412000640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3fc0678c0 0x7fa3fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa412000640 1 -- 172.21.15.144:0/4270599505 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7fa40811fb30 con 0x7fa4180cd000 2024-09-12T12:16:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa41de00640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3fc0678c0 0x7fa3fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.483+0000 7fa41de00640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3fc0678c0 0x7fa3fc069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa40c006fd0 tx=0x7fa40c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:23.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.487+0000 7fa412000640 1 -- 172.21.15.144:0/4270599505 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4080c2030 con 0x7fa4180cd000 2024-09-12T12:16:23.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.675+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4180731a0 con 0x7fa4180cd000 2024-09-12T12:16:23.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.675+0000 7fa412000640 1 -- 172.21.15.144:0/4270599505 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5230 (secure 0 0 0) 0x7fa408016090 con 0x7fa4180cd000 2024-09-12T12:16:23.680 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:23.680 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":39,"btime":"2024-09-12T12:16:23:314428+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3523411663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3523411663},{"type":"v1","addr":"172.21.15.165:6834","nonce":3523411663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6174,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/831229399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":831229399},{"type":"v1","addr":"172.21.15.144:6836","nonce":831229399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2387261211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2387261211},{"type":"v1","addr":"172.21.15.144:6837","nonce":2387261211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:22.690993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6192":{"gid":6192,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/799094061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":799094061},{"type":"v1","addr":"172.21.15.165:6835","nonce":799094061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6192,"qdb_cluster":[6192]},"id":4}]} 2024-09-12T12:16:23.681 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 39 2024-09-12T12:16:23.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3fc0678c0 msgr2=0x7fa3fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3fc0678c0 0x7fa3fc069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa40c006fd0 tx=0x7fa40c008040 comp rx=0 tx=0).stop 2024-09-12T12:16:23.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4180cd000 msgr2=0x7fa418155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4180cd000 0x7fa418155fc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa4080ae040 tx=0x7fa4080191b0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 shutdown_connections 2024-09-12T12:16:23.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3fc0678c0 0x7fa3fc069d80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815b160 0x7fa4180ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4180cd000 0x7fa418155fc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 --2- 172.21.15.144:0/4270599505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa418073bd0 0x7fa418152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 >> 172.21.15.144:0/4270599505 conn(0x7fa41806bc10 msgr2=0x7fa418158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:23.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 shutdown_connections 2024-09-12T12:16:23.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.679+0000 7fa41f200640 1 -- 172.21.15.144:0/4270599505 wait complete. 2024-09-12T12:16:23.701 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:16:23.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1518e00640 1 Processor -- start 2024-09-12T12:16:23.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1518e00640 1 -- start start 2024-09-12T12:16:23.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1518e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1514071420 0x7f1514071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1518e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f15140ccf30 0x7f15140cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1518e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15140b45a0 con 0x7f151415b4e0 2024-09-12T12:16:23.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1518e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f15140b3fe0 con 0x7f15140ccf30 2024-09-12T12:16:23.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1518e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f15140b42c0 con 0x7f1514071420 2024-09-12T12:16:23.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1511e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f151415b4e0 0x7f15140b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52602/0 (socket says 172.21.15.144:52602) 2024-09-12T12:16:23.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1511e00640 1 -- 172.21.15.144:0/1083388395 learned_addr learned my addr 172.21.15.144:0/1083388395 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1512800640 1 --2- 172.21.15.144:0/1083388395 >> v2:172.21.15.165:3300/0 conn(0x7f15140ccf30 0x7f15140cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1511400640 1 --2- 172.21.15.144:0/1083388395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1514071420 0x7f1514071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1510a00640 1 -- 172.21.15.144:0/1083388395 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259922603 0 0) 0x7f15140b45a0 con 0x7f151415b4e0 2024-09-12T12:16:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.835+0000 7f1510a00640 1 -- 172.21.15.144:0/1083388395 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14f8005740 con 0x7f151415b4e0 2024-09-12T12:16:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1510a00640 1 -- 172.21.15.144:0/1083388395 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1473058861 0 0) 0x7f14f8005740 con 0x7f151415b4e0 2024-09-12T12:16:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1512800640 1 -- 172.21.15.144:0/1083388395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1514071420 msgr2=0x7f1514071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:23.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1512800640 1 --2- 172.21.15.144:0/1083388395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1514071420 0x7f1514071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1512800640 1 -- 172.21.15.144:0/1083388395 >> v1:172.21.15.144:6789/0 conn(0x7f151415b4e0 legacy=0x7f15140b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1512800640 1 -- 172.21.15.144:0/1083388395 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15140b1490 con 0x7f15140ccf30 2024-09-12T12:16:23.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1511400640 1 --2- 172.21.15.144:0/1083388395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1514071420 0x7f1514071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:23.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1512800640 1 --2- 172.21.15.144:0/1083388395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15140ccf30 0x7f15140cd3e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f150c0097c0 tx=0x7f150c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b83c891a3e4fba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:23.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1510a00640 1 -- 172.21.15.144:0/1083388395 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0b0070 con 0x7f15140ccf30 2024-09-12T12:16:23.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1510a00640 1 -- 172.21.15.144:0/1083388395 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c0ab400 con 0x7f15140ccf30 2024-09-12T12:16:23.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.839+0000 7f1510a00640 1 -- 172.21.15.144:0/1083388395 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504001a00 con 0x7f15140ccf30 2024-09-12T12:16:23.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 -- 172.21.15.144:0/1083388395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15140ccf30 msgr2=0x7f15140cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 --2- 172.21.15.144:0/1083388395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15140ccf30 0x7f15140cd3e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f150c0097c0 tx=0x7f150c01c3c0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 -- 172.21.15.144:0/1083388395 shutdown_connections 2024-09-12T12:16:23.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 --2- 172.21.15.144:0/1083388395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15140ccf30 0x7f15140cd3e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 --2- 172.21.15.144:0/1083388395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1514071420 0x7f1514071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 -- 172.21.15.144:0/1083388395 >> 172.21.15.144:0/1083388395 conn(0x7f151406d0d0 msgr2=0x7f151406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:23.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 -- 172.21.15.144:0/1083388395 shutdown_connections 2024-09-12T12:16:23.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 -- 172.21.15.144:0/1083388395 wait complete. 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 Processor -- start 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 -- start start 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1514071420 0x7f1514165bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15140ccf30 0x7f151415e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415b4e0 0x7f15140aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f151415b8c0 con 0x7f151415b4e0 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15140b02e0 con 0x7f1514071420 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1518e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f151415ea70 con 0x7f15140ccf30 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1512800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415b4e0 0x7f15140aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1512800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415b4e0 0x7f15140aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47748/0 (socket says 172.21.15.144:47748) 2024-09-12T12:16:23.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1512800640 1 -- 172.21.15.144:0/2002002579 learned_addr learned my addr 172.21.15.144:0/2002002579 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:23.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1511400640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15140ccf30 0x7f151415e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1511e00640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1514071420 0x7f1514165bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1512800640 1 -- 172.21.15.144:0/2002002579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15140ccf30 msgr2=0x7f151415e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1512800640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15140ccf30 0x7f151415e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1512800640 1 -- 172.21.15.144:0/2002002579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1514071420 msgr2=0x7f1514165bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:23.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1512800640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1514071420 0x7f1514165bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:23.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.843+0000 7f1512800640 1 -- 172.21.15.144:0/2002002579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151415d490 con 0x7f151415b4e0 2024-09-12T12:16:23.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f1512800640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415b4e0 0x7f15140aae90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f150c01aa70 tx=0x7f150c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:23.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f150a000640 1 -- 172.21.15.144:0/2002002579 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0b0050 con 0x7f151415b4e0 2024-09-12T12:16:23.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f150a000640 1 -- 172.21.15.144:0/2002002579 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c0bc070 con 0x7f151415b4e0 2024-09-12T12:16:23.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f150a000640 1 -- 172.21.15.144:0/2002002579 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0b7650 con 0x7f151415b4e0 2024-09-12T12:16:23.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151415d770 con 0x7f151415b4e0 2024-09-12T12:16:23.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151415dd30 con 0x7f151415b4e0 2024-09-12T12:16:23.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15140cd3e0 con 0x7f151415b4e0 2024-09-12T12:16:23.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f150a000640 1 -- 172.21.15.144:0/2002002579 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f150c0b77f0 con 0x7f151415b4e0 2024-09-12T12:16:23.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f150a000640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f40678c0 0x7f14f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:23.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f150a000640 1 -- 172.21.15.144:0/2002002579 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7f150c1204b0 con 0x7f151415b4e0 2024-09-12T12:16:23.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f1511e00640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f40678c0 0x7f14f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:23.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.847+0000 7f1511e00640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f40678c0 0x7f14f4069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1504002240 tx=0x7f1504009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:23.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:23.851+0000 7f150a000640 1 -- 172.21.15.144:0/2002002579 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f150c015fb0 con 0x7f151415b4e0 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1514071ab0 con 0x7f151415b4e0 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f150a000640 1 -- 172.21.15.144:0/2002002579 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16968 (secure 0 0 0) 0x7f150c0f0800 con 0x7f151415b4e0 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":65,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:16:21.294494+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:16:17.373953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T12:16:18.661913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f40678c0 msgr2=0x7f14f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f40678c0 0x7f14f4069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1504002240 tx=0x7f1504009040 comp rx=0 tx=0).stop 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415b4e0 msgr2=0x7f15140aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415b4e0 0x7f15140aae90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f150c01aa70 tx=0x7f150c01ac00 comp rx=0 tx=0).stop 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 shutdown_connections 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f40678c0 0x7f14f4069d80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151415b4e0 0x7f15140aae90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15140ccf30 0x7f151415e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 --2- 172.21.15.144:0/2002002579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1514071420 0x7f1514165bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.011+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 >> 172.21.15.144:0/2002002579 conn(0x7f151406d0d0 msgr2=0x7f15140b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.015+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 shutdown_connections 2024-09-12T12:16:24.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.015+0000 7f1518e00640 1 -- 172.21.15.144:0/2002002579 wait complete. 2024-09-12T12:16:24.036 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:16:24.036 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:16:24.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4927600640 1 Processor -- start 2024-09-12T12:16:24.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4927600640 1 -- start start 2024-09-12T12:16:24.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4927600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f492006c320 0x7f4920072e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4927600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492015e9a0 con 0x7f4920073340 2024-09-12T12:16:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4927600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4920073b70 con 0x7f492015e5c0 2024-09-12T12:16:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4927600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4920073e50 con 0x7f492006c320 2024-09-12T12:16:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4925600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4920073340 0x7f49200af2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52606/0 (socket says 172.21.15.144:52606) 2024-09-12T12:16:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4925600640 1 -- 172.21.15.144:0/979474935 learned_addr learned my addr 172.21.15.144:0/979474935 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491fe00640 1 --2- 172.21.15.144:0/979474935 >> v2:172.21.15.165:3300/0 conn(0x7f492006c320 0x7f4920072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808963805 0 0) 0x7f492015e9a0 con 0x7f4920073340 2024-09-12T12:16:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4904003530 con 0x7f4920073340 2024-09-12T12:16:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1927515080 0 0) 0x7f4904003530 con 0x7f4920073340 2024-09-12T12:16:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 >> v2:172.21.15.165:3300/0 conn(0x7f492006c320 msgr2=0x7f4920072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 --2- 172.21.15.144:0/979474935 >> v2:172.21.15.165:3300/0 conn(0x7f492006c320 0x7f4920072e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 >> v1:172.21.15.165:6789/0 conn(0x7f492015e5c0 legacy=0x7f492006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4920074130 con 0x7f4920073340 2024-09-12T12:16:24.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f4918001a00 con 0x7f4920073340 2024-09-12T12:16:24.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 >> v1:172.21.15.144:6789/0 conn(0x7f4920073340 legacy=0x7f49200af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49040039c0 0x7f4904003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49040043c0 0x7f4904004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4904005130 0x7f490400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4920073e50 con 0x7f49040043c0 2024-09-12T12:16:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f490400c070 con 0x7f4904005130 2024-09-12T12:16:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f490400c270 con 0x7f49040039c0 2024-09-12T12:16:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f491fe00640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49040043c0 0x7f4904004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4925600640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4904005130 0x7f490400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.171+0000 7f4924c00640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49040039c0 0x7f4904003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f491fe00640 1 -- 172.21.15.144:0/979474935 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49040039c0 msgr2=0x7f4904003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:24.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f491fe00640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49040039c0 0x7f4904003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f491fe00640 1 -- 172.21.15.144:0/979474935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4904005130 msgr2=0x7f490400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:24.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f491fe00640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4904005130 0x7f490400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f491fe00640 1 -- 172.21.15.144:0/979474935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4904003530 con 0x7f49040043c0 2024-09-12T12:16:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f4925600640 1 -- 172.21.15.144:0/979474935 reap_dead start 2024-09-12T12:16:24.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f491fe00640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49040043c0 0x7f4904004890 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f490c009ae0 tx=0x7f490c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbbf305d1b2087d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c0b2070 con 0x7f49040043c0 2024-09-12T12:16:24.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490c0a5660 con 0x7f49040043c0 2024-09-12T12:16:24.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f491f400640 1 -- 172.21.15.144:0/979474935 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c0096b0 con 0x7f49040043c0 2024-09-12T12:16:24.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f4927600640 1 -- 172.21.15.144:0/979474935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49040043c0 msgr2=0x7f4904004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f4927600640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49040043c0 0x7f4904004890 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f490c009ae0 tx=0x7f490c01ca70 comp rx=0 tx=0).stop 2024-09-12T12:16:24.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f4927600640 1 -- 172.21.15.144:0/979474935 shutdown_connections 2024-09-12T12:16:24.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f4927600640 1 --2- 172.21.15.144:0/979474935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49040043c0 0x7f4904004890 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f4927600640 1 -- 172.21.15.144:0/979474935 >> 172.21.15.144:0/979474935 conn(0x7f49200b3380 msgr2=0x7f49200b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f4927600640 1 -- 172.21.15.144:0/979474935 shutdown_connections 2024-09-12T12:16:24.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.175+0000 7f4927600640 1 -- 172.21.15.144:0/979474935 wait complete. 2024-09-12T12:16:24.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 Processor -- start 2024-09-12T12:16:24.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 -- start start 2024-09-12T12:16:24.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49040043c0 0x7f4920143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f492015f540 0x7f49201f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49201f48d0 0x7f492006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49200737d0 con 0x7f49201f48d0 2024-09-12T12:16:24.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f49200aea70 con 0x7f49040043c0 2024-09-12T12:16:24.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4920073950 con 0x7f492015f540 2024-09-12T12:16:24.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4925600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49201f48d0 0x7f492006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4925600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49201f48d0 0x7f492006e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47774/0 (socket says 172.21.15.144:47774) 2024-09-12T12:16:24.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f491fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f492015f540 0x7f49201f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4925600640 1 -- 172.21.15.144:0/615428029 learned_addr learned my addr 172.21.15.144:0/615428029 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:24.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4924c00640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49040043c0 0x7f4920143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4925600640 1 -- 172.21.15.144:0/615428029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f492015f540 msgr2=0x7f49201f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4925600640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f492015f540 0x7f49201f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4925600640 1 -- 172.21.15.144:0/615428029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49040043c0 msgr2=0x7f4920143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4925600640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49040043c0 0x7f4920143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4925600640 1 -- 172.21.15.144:0/615428029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49201f4eb0 con 0x7f49201f48d0 2024-09-12T12:16:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4925600640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49201f48d0 0x7f492006e130 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4920070a90 tx=0x7f4918007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f491cc00640 1 -- 172.21.15.144:0/615428029 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491800a9b0 con 0x7f49201f48d0 2024-09-12T12:16:24.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f491cc00640 1 -- 172.21.15.144:0/615428029 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4918019070 con 0x7f49201f48d0 2024-09-12T12:16:24.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f491cc00640 1 -- 172.21.15.144:0/615428029 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491800adb0 con 0x7f49201f48d0 2024-09-12T12:16:24.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49201f5190 con 0x7f49201f48d0 2024-09-12T12:16:24.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.179+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492015f020 con 0x7f49201f48d0 2024-09-12T12:16:24.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.183+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4920068f20 con 0x7f49201f48d0 2024-09-12T12:16:24.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.183+0000 7f491cc00640 1 -- 172.21.15.144:0/615428029 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f491801e460 con 0x7f49201f48d0 2024-09-12T12:16:24.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.183+0000 7f491cc00640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f49000678c0 0x7f4900069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.183+0000 7f491cc00640 1 -- 172.21.15.144:0/615428029 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7f4918086030 con 0x7f49201f48d0 2024-09-12T12:16:24.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.183+0000 7f4924c00640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f49000678c0 0x7f4900069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.183+0000 7f4924c00640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f49000678c0 0x7f4900069d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4910000c10 tx=0x7f4910009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.187+0000 7f491cc00640 1 -- 172.21.15.144:0/615428029 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4918056390 con 0x7f49201f48d0 2024-09-12T12:16:24.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.343+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49201f5360 con 0x7f49000678c0 2024-09-12T12:16:24.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.351+0000 7f491cc00640 1 -- 172.21.15.144:0/615428029 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246711 (secure 0 0 0) 0x7f49201f5360 con 0x7f49000678c0 2024-09-12T12:16:24.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:24.359 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:16:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f49000678c0 msgr2=0x7f4900069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f49000678c0 0x7f4900069d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4910000c10 tx=0x7f4910009040 comp rx=0 tx=0).stop 2024-09-12T12:16:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49201f48d0 msgr2=0x7f492006e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49201f48d0 0x7f492006e130 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4920070a90 tx=0x7f4918007a90 comp rx=0 tx=0).stop 2024-09-12T12:16:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 shutdown_connections 2024-09-12T12:16:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f49000678c0 0x7f4900069d80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49201f48d0 0x7f492006e130 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f492015f540 0x7f49201f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 --2- 172.21.15.144:0/615428029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49040043c0 0x7f4920143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 >> 172.21.15.144:0/615428029 conn(0x7f49200b3380 msgr2=0x7f49200b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 shutdown_connections 2024-09-12T12:16:24.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.355+0000 7f4927600640 1 -- 172.21.15.144:0/615428029 wait complete. 2024-09-12T12:16:24.377 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-12T12:16:23.421310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294004,"kb_used_data":7028,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680716,"statfs":{"total":773094113280,"available":772793053184,"internally_reserved":0,"allocated":7196672,"data_stored":3868739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.156397"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.283693+0000","last_change":"2024-09-12T12:16:19.283693+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.283693+0000","last_undegraded":"2024-09-12T12:16:19.283693+0000","last_fullsized":"2024-09-12T12:16:19.283693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.283657+0000","last_change":"2024-09-12T12:16:19.283657+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.283657+0000","last_undegraded":"2024-09-12T12:16:19.283657+0000","last_fullsized":"2024-09-12T12:16:19.283657+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273939+0000","last_change":"2024-09-12T12:16:19.273939+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273939+0000","last_undegraded":"2024-09-12T12:16:19.273939+0000","last_fullsized":"2024-09-12T12:16:19.273939+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270775+0000","last_change":"2024-09-12T12:16:19.270775+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270775+0000","last_undegraded":"2024-09-12T12:16:19.270775+0000","last_fullsized":"2024-09-12T12:16:19.270775+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.281282+0000","last_change":"2024-09-12T12:16:19.281282+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.281282+0000","last_undegraded":"2024-09-12T12:16:19.281282+0000","last_fullsized":"2024-09-12T12:16:19.281282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278908+0000","last_change":"2024-09-12T12:16:19.278908+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278908+0000","last_undegraded":"2024-09-12T12:16:19.278908+0000","last_fullsized":"2024-09-12T12:16:19.278908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274701+0000","last_change":"2024-09-12T12:16:19.274701+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274701+0000","last_undegraded":"2024-09-12T12:16:19.274701+0000","last_fullsized":"2024-09-12T12:16:19.274701+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274611+0000","last_change":"2024-09-12T12:16:19.274611+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274611+0000","last_undegraded":"2024-09-12T12:16:19.274611+0000","last_fullsized":"2024-09-12T12:16:19.274611+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274282+0000","last_change":"2024-09-12T12:16:19.274282+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274282+0000","last_undegraded":"2024-09-12T12:16:19.274282+0000","last_fullsized":"2024-09-12T12:16:19.274282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276975+0000","last_change":"2024-09-12T12:16:19.276975+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276975+0000","last_undegraded":"2024-09-12T12:16:19.276975+0000","last_fullsized":"2024-09-12T12:16:19.276975+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270822+0000","last_change":"2024-09-12T12:16:19.270822+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270822+0000","last_undegraded":"2024-09-12T12:16:19.270822+0000","last_fullsized":"2024-09-12T12:16:19.270822+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276766+0000","last_change":"2024-09-12T12:16:19.276766+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276766+0000","last_undegraded":"2024-09-12T12:16:19.276766+0000","last_fullsized":"2024-09-12T12:16:19.276766+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280367+0000","last_change":"2024-09-12T12:16:19.280367+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280367+0000","last_undegraded":"2024-09-12T12:16:19.280367+0000","last_fullsized":"2024-09-12T12:16:19.280367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273774+0000","last_change":"2024-09-12T12:16:19.273774+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273774+0000","last_undegraded":"2024-09-12T12:16:19.273774+0000","last_fullsized":"2024-09-12T12:16:19.273774+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277306+0000","last_change":"2024-09-12T12:16:19.277306+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277306+0000","last_undegraded":"2024-09-12T12:16:19.277306+0000","last_fullsized":"2024-09-12T12:16:19.277306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273895+0000","last_change":"2024-09-12T12:16:19.273895+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273895+0000","last_undegraded":"2024-09-12T12:16:19.273895+0000","last_fullsized":"2024-09-12T12:16:19.273895+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.282176+0000","last_change":"2024-09-12T12:16:19.282176+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.282176+0000","last_undegraded":"2024-09-12T12:16:19.282176+0000","last_fullsized":"2024-09-12T12:16:19.282176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.271135+0000","last_change":"2024-09-12T12:16:19.271135+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.271135+0000","last_undegraded":"2024-09-12T12:16:19.271135+0000","last_fullsized":"2024-09-12T12:16:19.271135+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277093+0000","last_change":"2024-09-12T12:16:19.277093+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277093+0000","last_undegraded":"2024-09-12T12:16:19.277093+0000","last_fullsized":"2024-09-12T12:16:19.277093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276494+0000","last_change":"2024-09-12T12:16:19.276494+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276494+0000","last_undegraded":"2024-09-12T12:16:19.276494+0000","last_fullsized":"2024-09-12T12:16:19.276494+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278101+0000","last_change":"2024-09-12T12:16:19.278101+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278101+0000","last_undegraded":"2024-09-12T12:16:19.278101+0000","last_fullsized":"2024-09-12T12:16:19.278101+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276151+0000","last_change":"2024-09-12T12:16:19.276151+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276151+0000","last_undegraded":"2024-09-12T12:16:19.276151+0000","last_fullsized":"2024-09-12T12:16:19.276151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274929+0000","last_change":"2024-09-12T12:16:19.274929+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274929+0000","last_undegraded":"2024-09-12T12:16:19.274929+0000","last_fullsized":"2024-09-12T12:16:19.274929+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273995+0000","last_change":"2024-09-12T12:16:19.273995+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273995+0000","last_undegraded":"2024-09-12T12:16:19.273995+0000","last_fullsized":"2024-09-12T12:16:19.273995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278354+0000","last_change":"2024-09-12T12:16:19.278354+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278354+0000","last_undegraded":"2024-09-12T12:16:19.278354+0000","last_fullsized":"2024-09-12T12:16:19.278354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.279784+0000","last_change":"2024-09-12T12:16:19.279784+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.279784+0000","last_undegraded":"2024-09-12T12:16:19.279784+0000","last_fullsized":"2024-09-12T12:16:19.279784+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270348+0000","last_change":"2024-09-12T12:16:19.270348+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270348+0000","last_undegraded":"2024-09-12T12:16:19.270348+0000","last_fullsized":"2024-09-12T12:16:19.270348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.282488+0000","last_change":"2024-09-12T12:16:19.282488+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.282488+0000","last_undegraded":"2024-09-12T12:16:19.282488+0000","last_fullsized":"2024-09-12T12:16:19.282488+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273950+0000","last_change":"2024-09-12T12:16:19.273950+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273950+0000","last_undegraded":"2024-09-12T12:16:19.273950+0000","last_fullsized":"2024-09-12T12:16:19.273950+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276828+0000","last_change":"2024-09-12T12:16:19.276828+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276828+0000","last_undegraded":"2024-09-12T12:16:19.276828+0000","last_fullsized":"2024-09-12T12:16:19.276828+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270413+0000","last_change":"2024-09-12T12:16:19.270413+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270413+0000","last_undegraded":"2024-09-12T12:16:19.270413+0000","last_fullsized":"2024-09-12T12:16:19.270413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278567+0000","last_change":"2024-09-12T12:16:19.278567+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278567+0000","last_undegraded":"2024-09-12T12:16:19.278567+0000","last_fullsized":"2024-09-12T12:16:19.278567+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273453+0000","last_change":"2024-09-12T12:16:19.273453+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273453+0000","last_undegraded":"2024-09-12T12:16:19.273453+0000","last_fullsized":"2024-09-12T12:16:19.273453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.294772+0000","last_change":"2024-09-12T12:16:19.292137+0000","last_active":"2024-09-12T12:16:19.294772+0000","last_peered":"2024-09-12T12:16:19.294772+0000","last_clean":"2024-09-12T12:16:19.294772+0000","last_became_active":"2024-09-12T12:16:19.291503+0000","last_became_peered":"2024-09-12T12:16:19.291503+0000","last_unstale":"2024-09-12T12:16:19.294772+0000","last_undegraded":"2024-09-12T12:16:19.294772+0000","last_fullsized":"2024-09-12T12:16:19.294772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:12.361202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269831+0000","last_change":"2024-09-12T12:16:19.269831+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269831+0000","last_undegraded":"2024-09-12T12:16:19.269831+0000","last_fullsized":"2024-09-12T12:16:19.269831+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.291924+0000","last_change":"2024-09-12T12:16:19.290400+0000","last_active":"2024-09-12T12:16:19.291924+0000","last_peered":"2024-09-12T12:16:19.291924+0000","last_clean":"2024-09-12T12:16:19.291924+0000","last_became_active":"2024-09-12T12:16:19.290156+0000","last_became_peered":"2024-09-12T12:16:19.290156+0000","last_unstale":"2024-09-12T12:16:19.291924+0000","last_undegraded":"2024-09-12T12:16:19.291924+0000","last_fullsized":"2024-09-12T12:16:19.291924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:50.460933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277968+0000","last_change":"2024-09-12T12:16:19.277968+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277968+0000","last_undegraded":"2024-09-12T12:16:19.277968+0000","last_fullsized":"2024-09-12T12:16:19.277968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.289724+0000","last_change":"2024-09-12T12:16:19.287826+0000","last_active":"2024-09-12T12:16:19.289724+0000","last_peered":"2024-09-12T12:16:19.289724+0000","last_clean":"2024-09-12T12:16:19.289724+0000","last_became_active":"2024-09-12T12:16:19.287566+0000","last_became_peered":"2024-09-12T12:16:19.287566+0000","last_unstale":"2024-09-12T12:16:19.289724+0000","last_undegraded":"2024-09-12T12:16:19.289724+0000","last_fullsized":"2024-09-12T12:16:19.289724+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:06.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274889+0000","last_change":"2024-09-12T12:16:19.274889+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274889+0000","last_undegraded":"2024-09-12T12:16:19.274889+0000","last_fullsized":"2024-09-12T12:16:19.274889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.296013+0000","last_change":"2024-09-12T12:16:19.293865+0000","last_active":"2024-09-12T12:16:19.296013+0000","last_peered":"2024-09-12T12:16:19.296013+0000","last_clean":"2024-09-12T12:16:19.296013+0000","last_became_active":"2024-09-12T12:16:19.293483+0000","last_became_peered":"2024-09-12T12:16:19.293483+0000","last_unstale":"2024-09-12T12:16:19.296013+0000","last_undegraded":"2024-09-12T12:16:19.296013+0000","last_fullsized":"2024-09-12T12:16:19.296013+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:30.715166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273413+0000","last_change":"2024-09-12T12:16:19.273413+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273413+0000","last_undegraded":"2024-09-12T12:16:19.273413+0000","last_fullsized":"2024-09-12T12:16:19.273413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292879+0000","last_change":"2024-09-12T12:16:19.287050+0000","last_active":"2024-09-12T12:16:19.292879+0000","last_peered":"2024-09-12T12:16:19.292879+0000","last_clean":"2024-09-12T12:16:19.292879+0000","last_became_active":"2024-09-12T12:16:19.285906+0000","last_became_peered":"2024-09-12T12:16:19.285906+0000","last_unstale":"2024-09-12T12:16:19.292879+0000","last_undegraded":"2024-09-12T12:16:19.292879+0000","last_fullsized":"2024-09-12T12:16:19.292879+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:32.997009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280086+0000","last_change":"2024-09-12T12:16:19.280086+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280086+0000","last_undegraded":"2024-09-12T12:16:19.280086+0000","last_fullsized":"2024-09-12T12:16:19.280086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.291049+0000","last_change":"2024-09-12T12:16:19.284576+0000","last_active":"2024-09-12T12:16:19.291049+0000","last_peered":"2024-09-12T12:16:19.291049+0000","last_clean":"2024-09-12T12:16:19.291049+0000","last_became_active":"2024-09-12T12:16:19.284314+0000","last_became_peered":"2024-09-12T12:16:19.284314+0000","last_unstale":"2024-09-12T12:16:19.291049+0000","last_undegraded":"2024-09-12T12:16:19.291049+0000","last_fullsized":"2024-09-12T12:16:19.291049+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:07.149683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276322+0000","last_change":"2024-09-12T12:16:19.276322+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276322+0000","last_undegraded":"2024-09-12T12:16:19.276322+0000","last_fullsized":"2024-09-12T12:16:19.276322+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292433+0000","last_change":"2024-09-12T12:16:19.286530+0000","last_active":"2024-09-12T12:16:19.292433+0000","last_peered":"2024-09-12T12:16:19.292433+0000","last_clean":"2024-09-12T12:16:19.292433+0000","last_became_active":"2024-09-12T12:16:19.285761+0000","last_became_peered":"2024-09-12T12:16:19.285761+0000","last_unstale":"2024-09-12T12:16:19.292433+0000","last_undegraded":"2024-09-12T12:16:19.292433+0000","last_fullsized":"2024-09-12T12:16:19.292433+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:27.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275885+0000","last_change":"2024-09-12T12:16:19.275885+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275885+0000","last_undegraded":"2024-09-12T12:16:19.275885+0000","last_fullsized":"2024-09-12T12:16:19.275885+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.287091+0000","last_change":"2024-09-12T12:16:19.280332+0000","last_active":"2024-09-12T12:16:19.287091+0000","last_peered":"2024-09-12T12:16:19.287091+0000","last_clean":"2024-09-12T12:16:19.287091+0000","last_became_active":"2024-09-12T12:16:19.280016+0000","last_became_peered":"2024-09-12T12:16:19.280016+0000","last_unstale":"2024-09-12T12:16:19.287091+0000","last_undegraded":"2024-09-12T12:16:19.287091+0000","last_fullsized":"2024-09-12T12:16:19.287091+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:42.811402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.281737+0000","last_change":"2024-09-12T12:16:19.281737+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.281737+0000","last_undegraded":"2024-09-12T12:16:19.281737+0000","last_fullsized":"2024-09-12T12:16:19.281737+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297740+0000","last_change":"2024-09-12T12:16:19.293341+0000","last_active":"2024-09-12T12:16:19.297740+0000","last_peered":"2024-09-12T12:16:19.297740+0000","last_clean":"2024-09-12T12:16:19.297740+0000","last_became_active":"2024-09-12T12:16:19.293054+0000","last_became_peered":"2024-09-12T12:16:19.293054+0000","last_unstale":"2024-09-12T12:16:19.297740+0000","last_undegraded":"2024-09-12T12:16:19.297740+0000","last_fullsized":"2024-09-12T12:16:19.297740+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:19.578323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277558+0000","last_change":"2024-09-12T12:16:19.277558+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277558+0000","last_undegraded":"2024-09-12T12:16:19.277558+0000","last_fullsized":"2024-09-12T12:16:19.277558+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292325+0000","last_change":"2024-09-12T12:16:19.291302+0000","last_active":"2024-09-12T12:16:19.292325+0000","last_peered":"2024-09-12T12:16:19.292325+0000","last_clean":"2024-09-12T12:16:19.292325+0000","last_became_active":"2024-09-12T12:16:19.291059+0000","last_became_peered":"2024-09-12T12:16:19.291059+0000","last_unstale":"2024-09-12T12:16:19.292325+0000","last_undegraded":"2024-09-12T12:16:19.292325+0000","last_fullsized":"2024-09-12T12:16:19.292325+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:01.724542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272614+0000","last_change":"2024-09-12T12:16:19.272614+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272614+0000","last_undegraded":"2024-09-12T12:16:19.272614+0000","last_fullsized":"2024-09-12T12:16:19.272614+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297786+0000","last_change":"2024-09-12T12:16:19.293736+0000","last_active":"2024-09-12T12:16:19.297786+0000","last_peered":"2024-09-12T12:16:19.297786+0000","last_clean":"2024-09-12T12:16:19.297786+0000","last_became_active":"2024-09-12T12:16:19.293370+0000","last_became_peered":"2024-09-12T12:16:19.293370+0000","last_unstale":"2024-09-12T12:16:19.297786+0000","last_undegraded":"2024-09-12T12:16:19.297786+0000","last_fullsized":"2024-09-12T12:16:19.297786+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:26.002774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269703+0000","last_change":"2024-09-12T12:16:19.269703+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269703+0000","last_undegraded":"2024-09-12T12:16:19.269703+0000","last_fullsized":"2024-09-12T12:16:19.269703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295502+0000","last_change":"2024-09-12T12:16:19.293140+0000","last_active":"2024-09-12T12:16:19.295502+0000","last_peered":"2024-09-12T12:16:19.295502+0000","last_clean":"2024-09-12T12:16:19.295502+0000","last_became_active":"2024-09-12T12:16:19.292230+0000","last_became_peered":"2024-09-12T12:16:19.292230+0000","last_unstale":"2024-09-12T12:16:19.295502+0000","last_undegraded":"2024-09-12T12:16:19.295502+0000","last_fullsized":"2024-09-12T12:16:19.295502+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:09.373959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269699+0000","last_change":"2024-09-12T12:16:19.269699+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269699+0000","last_undegraded":"2024-09-12T12:16:19.269699+0000","last_fullsized":"2024-09-12T12:16:19.269699+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292219+0000","last_change":"2024-09-12T12:16:19.289406+0000","last_active":"2024-09-12T12:16:19.292219+0000","last_peered":"2024-09-12T12:16:19.292219+0000","last_clean":"2024-09-12T12:16:19.292219+0000","last_became_active":"2024-09-12T12:16:19.288998+0000","last_became_peered":"2024-09-12T12:16:19.288998+0000","last_unstale":"2024-09-12T12:16:19.292219+0000","last_undegraded":"2024-09-12T12:16:19.292219+0000","last_fullsized":"2024-09-12T12:16:19.292219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:42.631030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275692+0000","last_change":"2024-09-12T12:16:19.275692+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275692+0000","last_undegraded":"2024-09-12T12:16:19.275692+0000","last_fullsized":"2024-09-12T12:16:19.275692+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297577+0000","last_change":"2024-09-12T12:16:19.295064+0000","last_active":"2024-09-12T12:16:19.297577+0000","last_peered":"2024-09-12T12:16:19.297577+0000","last_clean":"2024-09-12T12:16:19.297577+0000","last_became_active":"2024-09-12T12:16:19.294669+0000","last_became_peered":"2024-09-12T12:16:19.294669+0000","last_unstale":"2024-09-12T12:16:19.297577+0000","last_undegraded":"2024-09-12T12:16:19.297577+0000","last_fullsized":"2024-09-12T12:16:19.297577+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:55.639414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272948+0000","last_change":"2024-09-12T12:16:19.272948+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272948+0000","last_undegraded":"2024-09-12T12:16:19.272948+0000","last_fullsized":"2024-09-12T12:16:19.272948+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297772+0000","last_change":"2024-09-12T12:16:19.293730+0000","last_active":"2024-09-12T12:16:19.297772+0000","last_peered":"2024-09-12T12:16:19.297772+0000","last_clean":"2024-09-12T12:16:19.297772+0000","last_became_active":"2024-09-12T12:16:19.292943+0000","last_became_peered":"2024-09-12T12:16:19.292943+0000","last_unstale":"2024-09-12T12:16:19.297772+0000","last_undegraded":"2024-09-12T12:16:19.297772+0000","last_fullsized":"2024-09-12T12:16:19.297772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:08.254321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280321+0000","last_change":"2024-09-12T12:16:19.280321+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280321+0000","last_undegraded":"2024-09-12T12:16:19.280321+0000","last_fullsized":"2024-09-12T12:16:19.280321+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292283+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:19.292283+0000","last_peered":"2024-09-12T12:16:19.292283+0000","last_clean":"2024-09-12T12:16:19.292283+0000","last_became_active":"2024-09-12T12:16:19.285395+0000","last_became_peered":"2024-09-12T12:16:19.285395+0000","last_unstale":"2024-09-12T12:16:19.292283+0000","last_undegraded":"2024-09-12T12:16:19.292283+0000","last_fullsized":"2024-09-12T12:16:19.292283+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:07:35.820417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273745+0000","last_change":"2024-09-12T12:16:19.273745+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273745+0000","last_undegraded":"2024-09-12T12:16:19.273745+0000","last_fullsized":"2024-09-12T12:16:19.273745+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.294796+0000","last_change":"2024-09-12T12:16:19.293036+0000","last_active":"2024-09-12T12:16:19.294796+0000","last_peered":"2024-09-12T12:16:19.294796+0000","last_clean":"2024-09-12T12:16:19.294796+0000","last_became_active":"2024-09-12T12:16:19.292655+0000","last_became_peered":"2024-09-12T12:16:19.292655+0000","last_unstale":"2024-09-12T12:16:19.294796+0000","last_undegraded":"2024-09-12T12:16:19.294796+0000","last_fullsized":"2024-09-12T12:16:19.294796+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:26.002774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273187+0000","last_change":"2024-09-12T12:16:19.273187+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273187+0000","last_undegraded":"2024-09-12T12:16:19.273187+0000","last_fullsized":"2024-09-12T12:16:19.273187+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297811+0000","last_change":"2024-09-12T12:16:19.294158+0000","last_active":"2024-09-12T12:16:19.297811+0000","last_peered":"2024-09-12T12:16:19.297811+0000","last_clean":"2024-09-12T12:16:19.297811+0000","last_became_active":"2024-09-12T12:16:19.293849+0000","last_became_peered":"2024-09-12T12:16:19.293849+0000","last_unstale":"2024-09-12T12:16:19.297811+0000","last_undegraded":"2024-09-12T12:16:19.297811+0000","last_fullsized":"2024-09-12T12:16:19.297811+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:41.978411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270646+0000","last_change":"2024-09-12T12:16:19.270646+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270646+0000","last_undegraded":"2024-09-12T12:16:19.270646+0000","last_fullsized":"2024-09-12T12:16:19.270646+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297817+0000","last_change":"2024-09-12T12:16:19.293944+0000","last_active":"2024-09-12T12:16:19.297817+0000","last_peered":"2024-09-12T12:16:19.297817+0000","last_clean":"2024-09-12T12:16:19.297817+0000","last_became_active":"2024-09-12T12:16:19.293392+0000","last_became_peered":"2024-09-12T12:16:19.293392+0000","last_unstale":"2024-09-12T12:16:19.297817+0000","last_undegraded":"2024-09-12T12:16:19.297817+0000","last_fullsized":"2024-09-12T12:16:19.297817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:55.639414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275953+0000","last_change":"2024-09-12T12:16:19.275953+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275953+0000","last_undegraded":"2024-09-12T12:16:19.275953+0000","last_fullsized":"2024-09-12T12:16:19.275953+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292398+0000","last_change":"2024-09-12T12:16:19.286376+0000","last_active":"2024-09-12T12:16:19.292398+0000","last_peered":"2024-09-12T12:16:19.292398+0000","last_clean":"2024-09-12T12:16:19.292398+0000","last_became_active":"2024-09-12T12:16:19.286111+0000","last_became_peered":"2024-09-12T12:16:19.286111+0000","last_unstale":"2024-09-12T12:16:19.292398+0000","last_undegraded":"2024-09-12T12:16:19.292398+0000","last_fullsized":"2024-09-12T12:16:19.292398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:41.880340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278171+0000","last_change":"2024-09-12T12:16:19.278171+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278171+0000","last_undegraded":"2024-09-12T12:16:19.278171+0000","last_fullsized":"2024-09-12T12:16:19.278171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.291884+0000","last_change":"2024-09-12T12:16:19.289582+0000","last_active":"2024-09-12T12:16:19.291884+0000","last_peered":"2024-09-12T12:16:19.291884+0000","last_clean":"2024-09-12T12:16:19.291884+0000","last_became_active":"2024-09-12T12:16:19.289038+0000","last_became_peered":"2024-09-12T12:16:19.289038+0000","last_unstale":"2024-09-12T12:16:19.291884+0000","last_undegraded":"2024-09-12T12:16:19.291884+0000","last_fullsized":"2024-09-12T12:16:19.291884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:54.376507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275171+0000","last_change":"2024-09-12T12:16:19.275171+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275171+0000","last_undegraded":"2024-09-12T12:16:19.275171+0000","last_fullsized":"2024-09-12T12:16:19.275171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295195+0000","last_change":"2024-09-12T12:16:19.293030+0000","last_active":"2024-09-12T12:16:19.295195+0000","last_peered":"2024-09-12T12:16:19.295195+0000","last_clean":"2024-09-12T12:16:19.295195+0000","last_became_active":"2024-09-12T12:16:19.292701+0000","last_became_peered":"2024-09-12T12:16:19.292701+0000","last_unstale":"2024-09-12T12:16:19.295195+0000","last_undegraded":"2024-09-12T12:16:19.295195+0000","last_fullsized":"2024-09-12T12:16:19.295195+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:08.254321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272455+0000","last_change":"2024-09-12T12:16:19.272455+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272455+0000","last_undegraded":"2024-09-12T12:16:19.272455+0000","last_fullsized":"2024-09-12T12:16:19.272455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.288720+0000","last_change":"2024-09-12T12:16:19.286130+0000","last_active":"2024-09-12T12:16:19.288720+0000","last_peered":"2024-09-12T12:16:19.288720+0000","last_clean":"2024-09-12T12:16:19.288720+0000","last_became_active":"2024-09-12T12:16:19.285864+0000","last_became_peered":"2024-09-12T12:16:19.285864+0000","last_unstale":"2024-09-12T12:16:19.288720+0000","last_undegraded":"2024-09-12T12:16:19.288720+0000","last_fullsized":"2024-09-12T12:16:19.288720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.039782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277422+0000","last_change":"2024-09-12T12:16:19.277422+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277422+0000","last_undegraded":"2024-09-12T12:16:19.277422+0000","last_fullsized":"2024-09-12T12:16:19.277422+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292038+0000","last_change":"2024-09-12T12:16:19.289187+0000","last_active":"2024-09-12T12:16:19.292038+0000","last_peered":"2024-09-12T12:16:19.292038+0000","last_clean":"2024-09-12T12:16:19.292038+0000","last_became_active":"2024-09-12T12:16:19.286518+0000","last_became_peered":"2024-09-12T12:16:19.286518+0000","last_unstale":"2024-09-12T12:16:19.292038+0000","last_undegraded":"2024-09-12T12:16:19.292038+0000","last_fullsized":"2024-09-12T12:16:19.292038+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:19.578323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273776+0000","last_change":"2024-09-12T12:16:19.273776+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273776+0000","last_undegraded":"2024-09-12T12:16:19.273776+0000","last_fullsized":"2024-09-12T12:16:19.273776+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.286591+0000","last_change":"2024-09-12T12:16:19.285221+0000","last_active":"2024-09-12T12:16:19.286591+0000","last_peered":"2024-09-12T12:16:19.286591+0000","last_clean":"2024-09-12T12:16:19.286591+0000","last_became_active":"2024-09-12T12:16:19.284934+0000","last_became_peered":"2024-09-12T12:16:19.284934+0000","last_unstale":"2024-09-12T12:16:19.286591+0000","last_undegraded":"2024-09-12T12:16:19.286591+0000","last_fullsized":"2024-09-12T12:16:19.286591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:49.052026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277963+0000","last_change":"2024-09-12T12:16:19.277963+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277963+0000","last_undegraded":"2024-09-12T12:16:19.277963+0000","last_fullsized":"2024-09-12T12:16:19.277963+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.289004+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:19.289004+0000","last_peered":"2024-09-12T12:16:19.289004+0000","last_clean":"2024-09-12T12:16:19.289004+0000","last_became_active":"2024-09-12T12:16:19.285402+0000","last_became_peered":"2024-09-12T12:16:19.285402+0000","last_unstale":"2024-09-12T12:16:19.289004+0000","last_undegraded":"2024-09-12T12:16:19.289004+0000","last_fullsized":"2024-09-12T12:16:19.289004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:24.499881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272886+0000","last_change":"2024-09-12T12:16:19.272886+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272886+0000","last_undegraded":"2024-09-12T12:16:19.272886+0000","last_fullsized":"2024-09-12T12:16:19.272886+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295206+0000","last_change":"2024-09-12T12:16:19.292693+0000","last_active":"2024-09-12T12:16:19.295206+0000","last_peered":"2024-09-12T12:16:19.295206+0000","last_clean":"2024-09-12T12:16:19.295206+0000","last_became_active":"2024-09-12T12:16:19.291920+0000","last_became_peered":"2024-09-12T12:16:19.291920+0000","last_unstale":"2024-09-12T12:16:19.295206+0000","last_undegraded":"2024-09-12T12:16:19.295206+0000","last_fullsized":"2024-09-12T12:16:19.295206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:30.207599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272674+0000","last_change":"2024-09-12T12:16:19.272674+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272674+0000","last_undegraded":"2024-09-12T12:16:19.272674+0000","last_fullsized":"2024-09-12T12:16:19.272674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297709+0000","last_change":"2024-09-12T12:16:19.292882+0000","last_active":"2024-09-12T12:16:19.297709+0000","last_peered":"2024-09-12T12:16:19.297709+0000","last_clean":"2024-09-12T12:16:19.297709+0000","last_became_active":"2024-09-12T12:16:19.292639+0000","last_became_peered":"2024-09-12T12:16:19.292639+0000","last_unstale":"2024-09-12T12:16:19.297709+0000","last_undegraded":"2024-09-12T12:16:19.297709+0000","last_fullsized":"2024-09-12T12:16:19.297709+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:49.052026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269910+0000","last_change":"2024-09-12T12:16:19.269910+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269910+0000","last_undegraded":"2024-09-12T12:16:19.269910+0000","last_fullsized":"2024-09-12T12:16:19.269910+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.296410+0000","last_change":"2024-09-12T12:16:19.294703+0000","last_active":"2024-09-12T12:16:19.296410+0000","last_peered":"2024-09-12T12:16:19.296410+0000","last_clean":"2024-09-12T12:16:19.296410+0000","last_became_active":"2024-09-12T12:16:19.294170+0000","last_became_peered":"2024-09-12T12:16:19.294170+0000","last_unstale":"2024-09-12T12:16:19.296410+0000","last_undegraded":"2024-09-12T12:16:19.296410+0000","last_fullsized":"2024-09-12T12:16:19.296410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:52.454304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280517+0000","last_change":"2024-09-12T12:16:19.280517+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280517+0000","last_undegraded":"2024-09-12T12:16:19.280517+0000","last_fullsized":"2024-09-12T12:16:19.280517+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292219+0000","last_change":"2024-09-12T12:16:19.285844+0000","last_active":"2024-09-12T12:16:19.292219+0000","last_peered":"2024-09-12T12:16:19.292219+0000","last_clean":"2024-09-12T12:16:19.292219+0000","last_became_active":"2024-09-12T12:16:19.285560+0000","last_became_peered":"2024-09-12T12:16:19.285560+0000","last_unstale":"2024-09-12T12:16:19.292219+0000","last_undegraded":"2024-09-12T12:16:19.292219+0000","last_fullsized":"2024-09-12T12:16:19.292219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:15.706001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273343+0000","last_change":"2024-09-12T12:16:19.273343+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273343+0000","last_undegraded":"2024-09-12T12:16:19.273343+0000","last_fullsized":"2024-09-12T12:16:19.273343+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295395+0000","last_change":"2024-09-12T12:16:19.293792+0000","last_active":"2024-09-12T12:16:19.295395+0000","last_peered":"2024-09-12T12:16:19.295395+0000","last_clean":"2024-09-12T12:16:19.295395+0000","last_became_active":"2024-09-12T12:16:19.293497+0000","last_became_peered":"2024-09-12T12:16:19.293497+0000","last_unstale":"2024-09-12T12:16:19.295395+0000","last_undegraded":"2024-09-12T12:16:19.295395+0000","last_fullsized":"2024-09-12T12:16:19.295395+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:09.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273624+0000","last_change":"2024-09-12T12:16:19.273624+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273624+0000","last_undegraded":"2024-09-12T12:16:19.273624+0000","last_fullsized":"2024-09-12T12:16:19.273624+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292839+0000","last_change":"2024-09-12T12:16:19.286473+0000","last_active":"2024-09-12T12:16:19.292839+0000","last_peered":"2024-09-12T12:16:19.292839+0000","last_clean":"2024-09-12T12:16:19.292839+0000","last_became_active":"2024-09-12T12:16:19.286196+0000","last_became_peered":"2024-09-12T12:16:19.286196+0000","last_unstale":"2024-09-12T12:16:19.292839+0000","last_undegraded":"2024-09-12T12:16:19.292839+0000","last_fullsized":"2024-09-12T12:16:19.292839+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:01.253597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.279776+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:16:19.279776+0000","last_peered":"2024-09-12T12:16:19.279776+0000","last_clean":"2024-09-12T12:16:19.279776+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:16:19.279776+0000","last_undegraded":"2024-09-12T12:16:19.279776+0000","last_fullsized":"2024-09-12T12:16:19.279776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36660,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335180,"statfs":{"total":96636764160,"available":96599224320,"internally_reserved":0,"allocated":1343488,"data_stored":925536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36096,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335744,"statfs":{"total":96636764160,"available":96599801856,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36092,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335748,"statfs":{"total":96636764160,"available":96599805952,"internally_reserved":0,"allocated":761856,"data_stored":341827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1343488,"data_stored":925536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:16:24.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:16:24.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd066c00640 1 Processor -- start 2024-09-12T12:16:24.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd066c00640 1 -- start start 2024-09-12T12:16:24.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd066c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 0x7fd06015d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd066c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0600b08c0 0x7fd06013f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd066c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd060141c50 con 0x7fd060156190 2024-09-12T12:16:24.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd066c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd0601427d0 con 0x7fd0600b08c0 2024-09-12T12:16:24.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd066c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd06013fd40 con 0x7fd0600b04e0 2024-09-12T12:16:24.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd064e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0600b08c0 0x7fd06013f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd066200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd060156190 0x7fd06006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52622/0 (socket says 172.21.15.144:52622) 2024-09-12T12:16:24.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd066200640 1 -- 172.21.15.144:0/1716951901 learned_addr learned my addr 172.21.15.144:0/1716951901 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:24.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd065800640 1 --2- 172.21.15.144:0/1716951901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 0x7fd06015d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd064e00640 1 -- 172.21.15.144:0/1716951901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 msgr2=0x7fd06015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:24.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd064e00640 1 --2- 172.21.15.144:0/1716951901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 0x7fd06015d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd064e00640 1 -- 172.21.15.144:0/1716951901 >> v1:172.21.15.144:6789/0 conn(0x7fd060156190 legacy=0x7fd06006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd05fe00640 1 -- 172.21.15.144:0/1716951901 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540469408 0 0) 0x7fd060141c50 con 0x7fd060156190 2024-09-12T12:16:24.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd064e00640 1 -- 172.21.15.144:0/1716951901 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd060141f30 con 0x7fd0600b08c0 2024-09-12T12:16:24.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.555+0000 7fd065800640 1 --2- 172.21.15.144:0/1716951901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 0x7fd06015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:24.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd064e00640 1 --2- 172.21.15.144:0/1716951901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0600b08c0 0x7fd06013f800 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0097c0 tx=0x7fd04c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31beb4857781356a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd05fe00640 1 -- 172.21.15.144:0/1716951901 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0b0070 con 0x7fd0600b08c0 2024-09-12T12:16:24.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd05fe00640 1 -- 172.21.15.144:0/1716951901 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c0ab600 con 0x7fd0600b08c0 2024-09-12T12:16:24.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd05fe00640 1 -- 172.21.15.144:0/1716951901 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0ab9d0 con 0x7fd0600b08c0 2024-09-12T12:16:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd066c00640 1 -- 172.21.15.144:0/1716951901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0600b08c0 msgr2=0x7fd06013f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd066c00640 1 --2- 172.21.15.144:0/1716951901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0600b08c0 0x7fd06013f800 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0097c0 tx=0x7fd04c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd066c00640 1 -- 172.21.15.144:0/1716951901 shutdown_connections 2024-09-12T12:16:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd066c00640 1 --2- 172.21.15.144:0/1716951901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0600b08c0 0x7fd06013f800 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd066c00640 1 --2- 172.21.15.144:0/1716951901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 0x7fd06015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd066c00640 1 -- 172.21.15.144:0/1716951901 >> 172.21.15.144:0/1716951901 conn(0x7fd06006e060 msgr2=0x7fd06006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd066c00640 1 -- 172.21.15.144:0/1716951901 shutdown_connections 2024-09-12T12:16:24.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd066c00640 1 -- 172.21.15.144:0/1716951901 wait complete. 2024-09-12T12:16:24.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.559+0000 7fd066c00640 1 Processor -- start 2024-09-12T12:16:24.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 -- start start 2024-09-12T12:16:24.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 0x7fd06013ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0600b08c0 0x7fd06015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd060156190 0x7fd06015e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600ce000 con 0x7fd060156190 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0600cde80 con 0x7fd0600b08c0 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd060141890 con 0x7fd0600b04e0 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd060156190 0x7fd06015e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd060156190 0x7fd06015e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47786/0 (socket says 172.21.15.144:47786) 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066200640 1 -- 172.21.15.144:0/1701723108 learned_addr learned my addr 172.21.15.144:0/1701723108 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd065800640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 0x7fd06013ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd064e00640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0600b08c0 0x7fd06015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066200640 1 -- 172.21.15.144:0/1701723108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 msgr2=0x7fd06013ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066200640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 0x7fd06013ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066200640 1 -- 172.21.15.144:0/1701723108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0600b08c0 msgr2=0x7fd06015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066200640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0600b08c0 0x7fd06015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066200640 1 -- 172.21.15.144:0/1701723108 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06015a920 con 0x7fd060156190 2024-09-12T12:16:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd064e00640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0600b08c0 0x7fd06015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066200640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd060156190 0x7fd06015e810 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c7b0 tx=0x7fd05800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd05d600640 1 -- 172.21.15.144:0/1701723108 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058018070 con 0x7fd060156190 2024-09-12T12:16:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd05d600640 1 -- 172.21.15.144:0/1701723108 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd05800a640 con 0x7fd060156190 2024-09-12T12:16:24.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06015ac00 con 0x7fd060156190 2024-09-12T12:16:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd05d600640 1 -- 172.21.15.144:0/1701723108 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05800aa30 con 0x7fd060156190 2024-09-12T12:16:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06015b1c0 con 0x7fd060156190 2024-09-12T12:16:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.563+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06006ee90 con 0x7fd060156190 2024-09-12T12:16:24.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.567+0000 7fd05d600640 1 -- 172.21.15.144:0/1701723108 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd05801b070 con 0x7fd060156190 2024-09-12T12:16:24.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.567+0000 7fd05d600640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0400678f0 0x7fd040069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.567+0000 7fd05d600640 1 -- 172.21.15.144:0/1701723108 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7fd058085340 con 0x7fd060156190 2024-09-12T12:16:24.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.567+0000 7fd065800640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0400678f0 0x7fd040069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.567+0000 7fd065800640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0400678f0 0x7fd040069db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd05400b930 tx=0x7fd054008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.571+0000 7fd05d600640 1 -- 172.21.15.144:0/1701723108 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd058055d80 con 0x7fd060156190 2024-09-12T12:16:24.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.727+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd06015d0b0 con 0x7fd0400678f0 2024-09-12T12:16:24.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.735+0000 7fd05d600640 1 -- 172.21.15.144:0/1701723108 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246711 (secure 0 0 0) 0x7fd06015d0b0 con 0x7fd0400678f0 2024-09-12T12:16:24.738 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:16:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0400678f0 msgr2=0x7fd040069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0400678f0 0x7fd040069db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd05400b930 tx=0x7fd054008040 comp rx=0 tx=0).stop 2024-09-12T12:16:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd060156190 msgr2=0x7fd06015e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd060156190 0x7fd06015e810 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd05800c7b0 tx=0x7fd05800cc70 comp rx=0 tx=0).stop 2024-09-12T12:16:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 shutdown_connections 2024-09-12T12:16:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0400678f0 0x7fd040069db0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd060156190 0x7fd06015e810 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0600b08c0 0x7fd06015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 --2- 172.21.15.144:0/1701723108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0600b04e0 0x7fd06013ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 >> 172.21.15.144:0/1701723108 conn(0x7fd06006e060 msgr2=0x7fd06006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 shutdown_connections 2024-09-12T12:16:24.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.739+0000 7fd066c00640 1 -- 172.21.15.144:0/1701723108 wait complete. 2024-09-12T12:16:24.759 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-12T12:16:23.421310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294004,"kb_used_data":7028,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680716,"statfs":{"total":773094113280,"available":772793053184,"internally_reserved":0,"allocated":7196672,"data_stored":3868739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.156397"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.283693+0000","last_change":"2024-09-12T12:16:19.283693+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.283693+0000","last_undegraded":"2024-09-12T12:16:19.283693+0000","last_fullsized":"2024-09-12T12:16:19.283693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.283657+0000","last_change":"2024-09-12T12:16:19.283657+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.283657+0000","last_undegraded":"2024-09-12T12:16:19.283657+0000","last_fullsized":"2024-09-12T12:16:19.283657+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273939+0000","last_change":"2024-09-12T12:16:19.273939+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273939+0000","last_undegraded":"2024-09-12T12:16:19.273939+0000","last_fullsized":"2024-09-12T12:16:19.273939+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270775+0000","last_change":"2024-09-12T12:16:19.270775+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270775+0000","last_undegraded":"2024-09-12T12:16:19.270775+0000","last_fullsized":"2024-09-12T12:16:19.270775+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.281282+0000","last_change":"2024-09-12T12:16:19.281282+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.281282+0000","last_undegraded":"2024-09-12T12:16:19.281282+0000","last_fullsized":"2024-09-12T12:16:19.281282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278908+0000","last_change":"2024-09-12T12:16:19.278908+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278908+0000","last_undegraded":"2024-09-12T12:16:19.278908+0000","last_fullsized":"2024-09-12T12:16:19.278908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274701+0000","last_change":"2024-09-12T12:16:19.274701+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274701+0000","last_undegraded":"2024-09-12T12:16:19.274701+0000","last_fullsized":"2024-09-12T12:16:19.274701+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274611+0000","last_change":"2024-09-12T12:16:19.274611+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274611+0000","last_undegraded":"2024-09-12T12:16:19.274611+0000","last_fullsized":"2024-09-12T12:16:19.274611+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274282+0000","last_change":"2024-09-12T12:16:19.274282+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274282+0000","last_undegraded":"2024-09-12T12:16:19.274282+0000","last_fullsized":"2024-09-12T12:16:19.274282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276975+0000","last_change":"2024-09-12T12:16:19.276975+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276975+0000","last_undegraded":"2024-09-12T12:16:19.276975+0000","last_fullsized":"2024-09-12T12:16:19.276975+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270822+0000","last_change":"2024-09-12T12:16:19.270822+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270822+0000","last_undegraded":"2024-09-12T12:16:19.270822+0000","last_fullsized":"2024-09-12T12:16:19.270822+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276766+0000","last_change":"2024-09-12T12:16:19.276766+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276766+0000","last_undegraded":"2024-09-12T12:16:19.276766+0000","last_fullsized":"2024-09-12T12:16:19.276766+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280367+0000","last_change":"2024-09-12T12:16:19.280367+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280367+0000","last_undegraded":"2024-09-12T12:16:19.280367+0000","last_fullsized":"2024-09-12T12:16:19.280367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273774+0000","last_change":"2024-09-12T12:16:19.273774+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273774+0000","last_undegraded":"2024-09-12T12:16:19.273774+0000","last_fullsized":"2024-09-12T12:16:19.273774+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277306+0000","last_change":"2024-09-12T12:16:19.277306+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277306+0000","last_undegraded":"2024-09-12T12:16:19.277306+0000","last_fullsized":"2024-09-12T12:16:19.277306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273895+0000","last_change":"2024-09-12T12:16:19.273895+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273895+0000","last_undegraded":"2024-09-12T12:16:19.273895+0000","last_fullsized":"2024-09-12T12:16:19.273895+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.282176+0000","last_change":"2024-09-12T12:16:19.282176+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.282176+0000","last_undegraded":"2024-09-12T12:16:19.282176+0000","last_fullsized":"2024-09-12T12:16:19.282176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.271135+0000","last_change":"2024-09-12T12:16:19.271135+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.271135+0000","last_undegraded":"2024-09-12T12:16:19.271135+0000","last_fullsized":"2024-09-12T12:16:19.271135+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277093+0000","last_change":"2024-09-12T12:16:19.277093+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277093+0000","last_undegraded":"2024-09-12T12:16:19.277093+0000","last_fullsized":"2024-09-12T12:16:19.277093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276494+0000","last_change":"2024-09-12T12:16:19.276494+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276494+0000","last_undegraded":"2024-09-12T12:16:19.276494+0000","last_fullsized":"2024-09-12T12:16:19.276494+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278101+0000","last_change":"2024-09-12T12:16:19.278101+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278101+0000","last_undegraded":"2024-09-12T12:16:19.278101+0000","last_fullsized":"2024-09-12T12:16:19.278101+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276151+0000","last_change":"2024-09-12T12:16:19.276151+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276151+0000","last_undegraded":"2024-09-12T12:16:19.276151+0000","last_fullsized":"2024-09-12T12:16:19.276151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274929+0000","last_change":"2024-09-12T12:16:19.274929+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274929+0000","last_undegraded":"2024-09-12T12:16:19.274929+0000","last_fullsized":"2024-09-12T12:16:19.274929+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273995+0000","last_change":"2024-09-12T12:16:19.273995+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273995+0000","last_undegraded":"2024-09-12T12:16:19.273995+0000","last_fullsized":"2024-09-12T12:16:19.273995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278354+0000","last_change":"2024-09-12T12:16:19.278354+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278354+0000","last_undegraded":"2024-09-12T12:16:19.278354+0000","last_fullsized":"2024-09-12T12:16:19.278354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.279784+0000","last_change":"2024-09-12T12:16:19.279784+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.279784+0000","last_undegraded":"2024-09-12T12:16:19.279784+0000","last_fullsized":"2024-09-12T12:16:19.279784+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270348+0000","last_change":"2024-09-12T12:16:19.270348+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270348+0000","last_undegraded":"2024-09-12T12:16:19.270348+0000","last_fullsized":"2024-09-12T12:16:19.270348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.282488+0000","last_change":"2024-09-12T12:16:19.282488+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.282488+0000","last_undegraded":"2024-09-12T12:16:19.282488+0000","last_fullsized":"2024-09-12T12:16:19.282488+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273950+0000","last_change":"2024-09-12T12:16:19.273950+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273950+0000","last_undegraded":"2024-09-12T12:16:19.273950+0000","last_fullsized":"2024-09-12T12:16:19.273950+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276828+0000","last_change":"2024-09-12T12:16:19.276828+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276828+0000","last_undegraded":"2024-09-12T12:16:19.276828+0000","last_fullsized":"2024-09-12T12:16:19.276828+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270413+0000","last_change":"2024-09-12T12:16:19.270413+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270413+0000","last_undegraded":"2024-09-12T12:16:19.270413+0000","last_fullsized":"2024-09-12T12:16:19.270413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278567+0000","last_change":"2024-09-12T12:16:19.278567+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278567+0000","last_undegraded":"2024-09-12T12:16:19.278567+0000","last_fullsized":"2024-09-12T12:16:19.278567+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273453+0000","last_change":"2024-09-12T12:16:19.273453+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273453+0000","last_undegraded":"2024-09-12T12:16:19.273453+0000","last_fullsized":"2024-09-12T12:16:19.273453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.294772+0000","last_change":"2024-09-12T12:16:19.292137+0000","last_active":"2024-09-12T12:16:19.294772+0000","last_peered":"2024-09-12T12:16:19.294772+0000","last_clean":"2024-09-12T12:16:19.294772+0000","last_became_active":"2024-09-12T12:16:19.291503+0000","last_became_peered":"2024-09-12T12:16:19.291503+0000","last_unstale":"2024-09-12T12:16:19.294772+0000","last_undegraded":"2024-09-12T12:16:19.294772+0000","last_fullsized":"2024-09-12T12:16:19.294772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:12.361202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269831+0000","last_change":"2024-09-12T12:16:19.269831+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269831+0000","last_undegraded":"2024-09-12T12:16:19.269831+0000","last_fullsized":"2024-09-12T12:16:19.269831+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.291924+0000","last_change":"2024-09-12T12:16:19.290400+0000","last_active":"2024-09-12T12:16:19.291924+0000","last_peered":"2024-09-12T12:16:19.291924+0000","last_clean":"2024-09-12T12:16:19.291924+0000","last_became_active":"2024-09-12T12:16:19.290156+0000","last_became_peered":"2024-09-12T12:16:19.290156+0000","last_unstale":"2024-09-12T12:16:19.291924+0000","last_undegraded":"2024-09-12T12:16:19.291924+0000","last_fullsized":"2024-09-12T12:16:19.291924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:50.460933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277968+0000","last_change":"2024-09-12T12:16:19.277968+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277968+0000","last_undegraded":"2024-09-12T12:16:19.277968+0000","last_fullsized":"2024-09-12T12:16:19.277968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.289724+0000","last_change":"2024-09-12T12:16:19.287826+0000","last_active":"2024-09-12T12:16:19.289724+0000","last_peered":"2024-09-12T12:16:19.289724+0000","last_clean":"2024-09-12T12:16:19.289724+0000","last_became_active":"2024-09-12T12:16:19.287566+0000","last_became_peered":"2024-09-12T12:16:19.287566+0000","last_unstale":"2024-09-12T12:16:19.289724+0000","last_undegraded":"2024-09-12T12:16:19.289724+0000","last_fullsized":"2024-09-12T12:16:19.289724+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:06.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274889+0000","last_change":"2024-09-12T12:16:19.274889+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274889+0000","last_undegraded":"2024-09-12T12:16:19.274889+0000","last_fullsized":"2024-09-12T12:16:19.274889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.296013+0000","last_change":"2024-09-12T12:16:19.293865+0000","last_active":"2024-09-12T12:16:19.296013+0000","last_peered":"2024-09-12T12:16:19.296013+0000","last_clean":"2024-09-12T12:16:19.296013+0000","last_became_active":"2024-09-12T12:16:19.293483+0000","last_became_peered":"2024-09-12T12:16:19.293483+0000","last_unstale":"2024-09-12T12:16:19.296013+0000","last_undegraded":"2024-09-12T12:16:19.296013+0000","last_fullsized":"2024-09-12T12:16:19.296013+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:30.715166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273413+0000","last_change":"2024-09-12T12:16:19.273413+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273413+0000","last_undegraded":"2024-09-12T12:16:19.273413+0000","last_fullsized":"2024-09-12T12:16:19.273413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292879+0000","last_change":"2024-09-12T12:16:19.287050+0000","last_active":"2024-09-12T12:16:19.292879+0000","last_peered":"2024-09-12T12:16:19.292879+0000","last_clean":"2024-09-12T12:16:19.292879+0000","last_became_active":"2024-09-12T12:16:19.285906+0000","last_became_peered":"2024-09-12T12:16:19.285906+0000","last_unstale":"2024-09-12T12:16:19.292879+0000","last_undegraded":"2024-09-12T12:16:19.292879+0000","last_fullsized":"2024-09-12T12:16:19.292879+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:32.997009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280086+0000","last_change":"2024-09-12T12:16:19.280086+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280086+0000","last_undegraded":"2024-09-12T12:16:19.280086+0000","last_fullsized":"2024-09-12T12:16:19.280086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.291049+0000","last_change":"2024-09-12T12:16:19.284576+0000","last_active":"2024-09-12T12:16:19.291049+0000","last_peered":"2024-09-12T12:16:19.291049+0000","last_clean":"2024-09-12T12:16:19.291049+0000","last_became_active":"2024-09-12T12:16:19.284314+0000","last_became_peered":"2024-09-12T12:16:19.284314+0000","last_unstale":"2024-09-12T12:16:19.291049+0000","last_undegraded":"2024-09-12T12:16:19.291049+0000","last_fullsized":"2024-09-12T12:16:19.291049+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:07.149683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276322+0000","last_change":"2024-09-12T12:16:19.276322+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276322+0000","last_undegraded":"2024-09-12T12:16:19.276322+0000","last_fullsized":"2024-09-12T12:16:19.276322+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292433+0000","last_change":"2024-09-12T12:16:19.286530+0000","last_active":"2024-09-12T12:16:19.292433+0000","last_peered":"2024-09-12T12:16:19.292433+0000","last_clean":"2024-09-12T12:16:19.292433+0000","last_became_active":"2024-09-12T12:16:19.285761+0000","last_became_peered":"2024-09-12T12:16:19.285761+0000","last_unstale":"2024-09-12T12:16:19.292433+0000","last_undegraded":"2024-09-12T12:16:19.292433+0000","last_fullsized":"2024-09-12T12:16:19.292433+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:27.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275885+0000","last_change":"2024-09-12T12:16:19.275885+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275885+0000","last_undegraded":"2024-09-12T12:16:19.275885+0000","last_fullsized":"2024-09-12T12:16:19.275885+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.287091+0000","last_change":"2024-09-12T12:16:19.280332+0000","last_active":"2024-09-12T12:16:19.287091+0000","last_peered":"2024-09-12T12:16:19.287091+0000","last_clean":"2024-09-12T12:16:19.287091+0000","last_became_active":"2024-09-12T12:16:19.280016+0000","last_became_peered":"2024-09-12T12:16:19.280016+0000","last_unstale":"2024-09-12T12:16:19.287091+0000","last_undegraded":"2024-09-12T12:16:19.287091+0000","last_fullsized":"2024-09-12T12:16:19.287091+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:42.811402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.281737+0000","last_change":"2024-09-12T12:16:19.281737+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.281737+0000","last_undegraded":"2024-09-12T12:16:19.281737+0000","last_fullsized":"2024-09-12T12:16:19.281737+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297740+0000","last_change":"2024-09-12T12:16:19.293341+0000","last_active":"2024-09-12T12:16:19.297740+0000","last_peered":"2024-09-12T12:16:19.297740+0000","last_clean":"2024-09-12T12:16:19.297740+0000","last_became_active":"2024-09-12T12:16:19.293054+0000","last_became_peered":"2024-09-12T12:16:19.293054+0000","last_unstale":"2024-09-12T12:16:19.297740+0000","last_undegraded":"2024-09-12T12:16:19.297740+0000","last_fullsized":"2024-09-12T12:16:19.297740+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:19.578323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277558+0000","last_change":"2024-09-12T12:16:19.277558+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277558+0000","last_undegraded":"2024-09-12T12:16:19.277558+0000","last_fullsized":"2024-09-12T12:16:19.277558+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292325+0000","last_change":"2024-09-12T12:16:19.291302+0000","last_active":"2024-09-12T12:16:19.292325+0000","last_peered":"2024-09-12T12:16:19.292325+0000","last_clean":"2024-09-12T12:16:19.292325+0000","last_became_active":"2024-09-12T12:16:19.291059+0000","last_became_peered":"2024-09-12T12:16:19.291059+0000","last_unstale":"2024-09-12T12:16:19.292325+0000","last_undegraded":"2024-09-12T12:16:19.292325+0000","last_fullsized":"2024-09-12T12:16:19.292325+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:01.724542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272614+0000","last_change":"2024-09-12T12:16:19.272614+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272614+0000","last_undegraded":"2024-09-12T12:16:19.272614+0000","last_fullsized":"2024-09-12T12:16:19.272614+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297786+0000","last_change":"2024-09-12T12:16:19.293736+0000","last_active":"2024-09-12T12:16:19.297786+0000","last_peered":"2024-09-12T12:16:19.297786+0000","last_clean":"2024-09-12T12:16:19.297786+0000","last_became_active":"2024-09-12T12:16:19.293370+0000","last_became_peered":"2024-09-12T12:16:19.293370+0000","last_unstale":"2024-09-12T12:16:19.297786+0000","last_undegraded":"2024-09-12T12:16:19.297786+0000","last_fullsized":"2024-09-12T12:16:19.297786+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:26.002774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269703+0000","last_change":"2024-09-12T12:16:19.269703+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269703+0000","last_undegraded":"2024-09-12T12:16:19.269703+0000","last_fullsized":"2024-09-12T12:16:19.269703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295502+0000","last_change":"2024-09-12T12:16:19.293140+0000","last_active":"2024-09-12T12:16:19.295502+0000","last_peered":"2024-09-12T12:16:19.295502+0000","last_clean":"2024-09-12T12:16:19.295502+0000","last_became_active":"2024-09-12T12:16:19.292230+0000","last_became_peered":"2024-09-12T12:16:19.292230+0000","last_unstale":"2024-09-12T12:16:19.295502+0000","last_undegraded":"2024-09-12T12:16:19.295502+0000","last_fullsized":"2024-09-12T12:16:19.295502+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:09.373959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269699+0000","last_change":"2024-09-12T12:16:19.269699+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269699+0000","last_undegraded":"2024-09-12T12:16:19.269699+0000","last_fullsized":"2024-09-12T12:16:19.269699+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292219+0000","last_change":"2024-09-12T12:16:19.289406+0000","last_active":"2024-09-12T12:16:19.292219+0000","last_peered":"2024-09-12T12:16:19.292219+0000","last_clean":"2024-09-12T12:16:19.292219+0000","last_became_active":"2024-09-12T12:16:19.288998+0000","last_became_peered":"2024-09-12T12:16:19.288998+0000","last_unstale":"2024-09-12T12:16:19.292219+0000","last_undegraded":"2024-09-12T12:16:19.292219+0000","last_fullsized":"2024-09-12T12:16:19.292219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:42.631030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275692+0000","last_change":"2024-09-12T12:16:19.275692+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275692+0000","last_undegraded":"2024-09-12T12:16:19.275692+0000","last_fullsized":"2024-09-12T12:16:19.275692+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297577+0000","last_change":"2024-09-12T12:16:19.295064+0000","last_active":"2024-09-12T12:16:19.297577+0000","last_peered":"2024-09-12T12:16:19.297577+0000","last_clean":"2024-09-12T12:16:19.297577+0000","last_became_active":"2024-09-12T12:16:19.294669+0000","last_became_peered":"2024-09-12T12:16:19.294669+0000","last_unstale":"2024-09-12T12:16:19.297577+0000","last_undegraded":"2024-09-12T12:16:19.297577+0000","last_fullsized":"2024-09-12T12:16:19.297577+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:55.639414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272948+0000","last_change":"2024-09-12T12:16:19.272948+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272948+0000","last_undegraded":"2024-09-12T12:16:19.272948+0000","last_fullsized":"2024-09-12T12:16:19.272948+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297772+0000","last_change":"2024-09-12T12:16:19.293730+0000","last_active":"2024-09-12T12:16:19.297772+0000","last_peered":"2024-09-12T12:16:19.297772+0000","last_clean":"2024-09-12T12:16:19.297772+0000","last_became_active":"2024-09-12T12:16:19.292943+0000","last_became_peered":"2024-09-12T12:16:19.292943+0000","last_unstale":"2024-09-12T12:16:19.297772+0000","last_undegraded":"2024-09-12T12:16:19.297772+0000","last_fullsized":"2024-09-12T12:16:19.297772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:08.254321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280321+0000","last_change":"2024-09-12T12:16:19.280321+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280321+0000","last_undegraded":"2024-09-12T12:16:19.280321+0000","last_fullsized":"2024-09-12T12:16:19.280321+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292283+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:19.292283+0000","last_peered":"2024-09-12T12:16:19.292283+0000","last_clean":"2024-09-12T12:16:19.292283+0000","last_became_active":"2024-09-12T12:16:19.285395+0000","last_became_peered":"2024-09-12T12:16:19.285395+0000","last_unstale":"2024-09-12T12:16:19.292283+0000","last_undegraded":"2024-09-12T12:16:19.292283+0000","last_fullsized":"2024-09-12T12:16:19.292283+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:07:35.820417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273745+0000","last_change":"2024-09-12T12:16:19.273745+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273745+0000","last_undegraded":"2024-09-12T12:16:19.273745+0000","last_fullsized":"2024-09-12T12:16:19.273745+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.294796+0000","last_change":"2024-09-12T12:16:19.293036+0000","last_active":"2024-09-12T12:16:19.294796+0000","last_peered":"2024-09-12T12:16:19.294796+0000","last_clean":"2024-09-12T12:16:19.294796+0000","last_became_active":"2024-09-12T12:16:19.292655+0000","last_became_peered":"2024-09-12T12:16:19.292655+0000","last_unstale":"2024-09-12T12:16:19.294796+0000","last_undegraded":"2024-09-12T12:16:19.294796+0000","last_fullsized":"2024-09-12T12:16:19.294796+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:26.002774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273187+0000","last_change":"2024-09-12T12:16:19.273187+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273187+0000","last_undegraded":"2024-09-12T12:16:19.273187+0000","last_fullsized":"2024-09-12T12:16:19.273187+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297811+0000","last_change":"2024-09-12T12:16:19.294158+0000","last_active":"2024-09-12T12:16:19.297811+0000","last_peered":"2024-09-12T12:16:19.297811+0000","last_clean":"2024-09-12T12:16:19.297811+0000","last_became_active":"2024-09-12T12:16:19.293849+0000","last_became_peered":"2024-09-12T12:16:19.293849+0000","last_unstale":"2024-09-12T12:16:19.297811+0000","last_undegraded":"2024-09-12T12:16:19.297811+0000","last_fullsized":"2024-09-12T12:16:19.297811+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:41.978411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270646+0000","last_change":"2024-09-12T12:16:19.270646+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270646+0000","last_undegraded":"2024-09-12T12:16:19.270646+0000","last_fullsized":"2024-09-12T12:16:19.270646+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297817+0000","last_change":"2024-09-12T12:16:19.293944+0000","last_active":"2024-09-12T12:16:19.297817+0000","last_peered":"2024-09-12T12:16:19.297817+0000","last_clean":"2024-09-12T12:16:19.297817+0000","last_became_active":"2024-09-12T12:16:19.293392+0000","last_became_peered":"2024-09-12T12:16:19.293392+0000","last_unstale":"2024-09-12T12:16:19.297817+0000","last_undegraded":"2024-09-12T12:16:19.297817+0000","last_fullsized":"2024-09-12T12:16:19.297817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:55.639414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275953+0000","last_change":"2024-09-12T12:16:19.275953+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275953+0000","last_undegraded":"2024-09-12T12:16:19.275953+0000","last_fullsized":"2024-09-12T12:16:19.275953+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292398+0000","last_change":"2024-09-12T12:16:19.286376+0000","last_active":"2024-09-12T12:16:19.292398+0000","last_peered":"2024-09-12T12:16:19.292398+0000","last_clean":"2024-09-12T12:16:19.292398+0000","last_became_active":"2024-09-12T12:16:19.286111+0000","last_became_peered":"2024-09-12T12:16:19.286111+0000","last_unstale":"2024-09-12T12:16:19.292398+0000","last_undegraded":"2024-09-12T12:16:19.292398+0000","last_fullsized":"2024-09-12T12:16:19.292398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:41.880340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278171+0000","last_change":"2024-09-12T12:16:19.278171+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278171+0000","last_undegraded":"2024-09-12T12:16:19.278171+0000","last_fullsized":"2024-09-12T12:16:19.278171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.291884+0000","last_change":"2024-09-12T12:16:19.289582+0000","last_active":"2024-09-12T12:16:19.291884+0000","last_peered":"2024-09-12T12:16:19.291884+0000","last_clean":"2024-09-12T12:16:19.291884+0000","last_became_active":"2024-09-12T12:16:19.289038+0000","last_became_peered":"2024-09-12T12:16:19.289038+0000","last_unstale":"2024-09-12T12:16:19.291884+0000","last_undegraded":"2024-09-12T12:16:19.291884+0000","last_fullsized":"2024-09-12T12:16:19.291884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:54.376507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275171+0000","last_change":"2024-09-12T12:16:19.275171+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275171+0000","last_undegraded":"2024-09-12T12:16:19.275171+0000","last_fullsized":"2024-09-12T12:16:19.275171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295195+0000","last_change":"2024-09-12T12:16:19.293030+0000","last_active":"2024-09-12T12:16:19.295195+0000","last_peered":"2024-09-12T12:16:19.295195+0000","last_clean":"2024-09-12T12:16:19.295195+0000","last_became_active":"2024-09-12T12:16:19.292701+0000","last_became_peered":"2024-09-12T12:16:19.292701+0000","last_unstale":"2024-09-12T12:16:19.295195+0000","last_undegraded":"2024-09-12T12:16:19.295195+0000","last_fullsized":"2024-09-12T12:16:19.295195+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:08.254321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272455+0000","last_change":"2024-09-12T12:16:19.272455+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272455+0000","last_undegraded":"2024-09-12T12:16:19.272455+0000","last_fullsized":"2024-09-12T12:16:19.272455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.288720+0000","last_change":"2024-09-12T12:16:19.286130+0000","last_active":"2024-09-12T12:16:19.288720+0000","last_peered":"2024-09-12T12:16:19.288720+0000","last_clean":"2024-09-12T12:16:19.288720+0000","last_became_active":"2024-09-12T12:16:19.285864+0000","last_became_peered":"2024-09-12T12:16:19.285864+0000","last_unstale":"2024-09-12T12:16:19.288720+0000","last_undegraded":"2024-09-12T12:16:19.288720+0000","last_fullsized":"2024-09-12T12:16:19.288720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.039782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277422+0000","last_change":"2024-09-12T12:16:19.277422+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277422+0000","last_undegraded":"2024-09-12T12:16:19.277422+0000","last_fullsized":"2024-09-12T12:16:19.277422+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292038+0000","last_change":"2024-09-12T12:16:19.289187+0000","last_active":"2024-09-12T12:16:19.292038+0000","last_peered":"2024-09-12T12:16:19.292038+0000","last_clean":"2024-09-12T12:16:19.292038+0000","last_became_active":"2024-09-12T12:16:19.286518+0000","last_became_peered":"2024-09-12T12:16:19.286518+0000","last_unstale":"2024-09-12T12:16:19.292038+0000","last_undegraded":"2024-09-12T12:16:19.292038+0000","last_fullsized":"2024-09-12T12:16:19.292038+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:19.578323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273776+0000","last_change":"2024-09-12T12:16:19.273776+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273776+0000","last_undegraded":"2024-09-12T12:16:19.273776+0000","last_fullsized":"2024-09-12T12:16:19.273776+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.286591+0000","last_change":"2024-09-12T12:16:19.285221+0000","last_active":"2024-09-12T12:16:19.286591+0000","last_peered":"2024-09-12T12:16:19.286591+0000","last_clean":"2024-09-12T12:16:19.286591+0000","last_became_active":"2024-09-12T12:16:19.284934+0000","last_became_peered":"2024-09-12T12:16:19.284934+0000","last_unstale":"2024-09-12T12:16:19.286591+0000","last_undegraded":"2024-09-12T12:16:19.286591+0000","last_fullsized":"2024-09-12T12:16:19.286591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:49.052026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277963+0000","last_change":"2024-09-12T12:16:19.277963+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277963+0000","last_undegraded":"2024-09-12T12:16:19.277963+0000","last_fullsized":"2024-09-12T12:16:19.277963+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.289004+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:19.289004+0000","last_peered":"2024-09-12T12:16:19.289004+0000","last_clean":"2024-09-12T12:16:19.289004+0000","last_became_active":"2024-09-12T12:16:19.285402+0000","last_became_peered":"2024-09-12T12:16:19.285402+0000","last_unstale":"2024-09-12T12:16:19.289004+0000","last_undegraded":"2024-09-12T12:16:19.289004+0000","last_fullsized":"2024-09-12T12:16:19.289004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:24.499881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272886+0000","last_change":"2024-09-12T12:16:19.272886+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272886+0000","last_undegraded":"2024-09-12T12:16:19.272886+0000","last_fullsized":"2024-09-12T12:16:19.272886+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295206+0000","last_change":"2024-09-12T12:16:19.292693+0000","last_active":"2024-09-12T12:16:19.295206+0000","last_peered":"2024-09-12T12:16:19.295206+0000","last_clean":"2024-09-12T12:16:19.295206+0000","last_became_active":"2024-09-12T12:16:19.291920+0000","last_became_peered":"2024-09-12T12:16:19.291920+0000","last_unstale":"2024-09-12T12:16:19.295206+0000","last_undegraded":"2024-09-12T12:16:19.295206+0000","last_fullsized":"2024-09-12T12:16:19.295206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:30.207599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272674+0000","last_change":"2024-09-12T12:16:19.272674+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272674+0000","last_undegraded":"2024-09-12T12:16:19.272674+0000","last_fullsized":"2024-09-12T12:16:19.272674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297709+0000","last_change":"2024-09-12T12:16:19.292882+0000","last_active":"2024-09-12T12:16:19.297709+0000","last_peered":"2024-09-12T12:16:19.297709+0000","last_clean":"2024-09-12T12:16:19.297709+0000","last_became_active":"2024-09-12T12:16:19.292639+0000","last_became_peered":"2024-09-12T12:16:19.292639+0000","last_unstale":"2024-09-12T12:16:19.297709+0000","last_undegraded":"2024-09-12T12:16:19.297709+0000","last_fullsized":"2024-09-12T12:16:19.297709+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:49.052026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269910+0000","last_change":"2024-09-12T12:16:19.269910+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269910+0000","last_undegraded":"2024-09-12T12:16:19.269910+0000","last_fullsized":"2024-09-12T12:16:19.269910+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.296410+0000","last_change":"2024-09-12T12:16:19.294703+0000","last_active":"2024-09-12T12:16:19.296410+0000","last_peered":"2024-09-12T12:16:19.296410+0000","last_clean":"2024-09-12T12:16:19.296410+0000","last_became_active":"2024-09-12T12:16:19.294170+0000","last_became_peered":"2024-09-12T12:16:19.294170+0000","last_unstale":"2024-09-12T12:16:19.296410+0000","last_undegraded":"2024-09-12T12:16:19.296410+0000","last_fullsized":"2024-09-12T12:16:19.296410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:52.454304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280517+0000","last_change":"2024-09-12T12:16:19.280517+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280517+0000","last_undegraded":"2024-09-12T12:16:19.280517+0000","last_fullsized":"2024-09-12T12:16:19.280517+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292219+0000","last_change":"2024-09-12T12:16:19.285844+0000","last_active":"2024-09-12T12:16:19.292219+0000","last_peered":"2024-09-12T12:16:19.292219+0000","last_clean":"2024-09-12T12:16:19.292219+0000","last_became_active":"2024-09-12T12:16:19.285560+0000","last_became_peered":"2024-09-12T12:16:19.285560+0000","last_unstale":"2024-09-12T12:16:19.292219+0000","last_undegraded":"2024-09-12T12:16:19.292219+0000","last_fullsized":"2024-09-12T12:16:19.292219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:15.706001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273343+0000","last_change":"2024-09-12T12:16:19.273343+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273343+0000","last_undegraded":"2024-09-12T12:16:19.273343+0000","last_fullsized":"2024-09-12T12:16:19.273343+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295395+0000","last_change":"2024-09-12T12:16:19.293792+0000","last_active":"2024-09-12T12:16:19.295395+0000","last_peered":"2024-09-12T12:16:19.295395+0000","last_clean":"2024-09-12T12:16:19.295395+0000","last_became_active":"2024-09-12T12:16:19.293497+0000","last_became_peered":"2024-09-12T12:16:19.293497+0000","last_unstale":"2024-09-12T12:16:19.295395+0000","last_undegraded":"2024-09-12T12:16:19.295395+0000","last_fullsized":"2024-09-12T12:16:19.295395+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:09.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273624+0000","last_change":"2024-09-12T12:16:19.273624+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273624+0000","last_undegraded":"2024-09-12T12:16:19.273624+0000","last_fullsized":"2024-09-12T12:16:19.273624+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292839+0000","last_change":"2024-09-12T12:16:19.286473+0000","last_active":"2024-09-12T12:16:19.292839+0000","last_peered":"2024-09-12T12:16:19.292839+0000","last_clean":"2024-09-12T12:16:19.292839+0000","last_became_active":"2024-09-12T12:16:19.286196+0000","last_became_peered":"2024-09-12T12:16:19.286196+0000","last_unstale":"2024-09-12T12:16:19.292839+0000","last_undegraded":"2024-09-12T12:16:19.292839+0000","last_fullsized":"2024-09-12T12:16:19.292839+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:01.253597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.279776+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:16:19.279776+0000","last_peered":"2024-09-12T12:16:19.279776+0000","last_clean":"2024-09-12T12:16:19.279776+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:16:19.279776+0000","last_undegraded":"2024-09-12T12:16:19.279776+0000","last_fullsized":"2024-09-12T12:16:19.279776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36660,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335180,"statfs":{"total":96636764160,"available":96599224320,"internally_reserved":0,"allocated":1343488,"data_stored":925536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36096,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335744,"statfs":{"total":96636764160,"available":96599801856,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36092,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335748,"statfs":{"total":96636764160,"available":96599805952,"internally_reserved":0,"allocated":761856,"data_stored":341827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1343488,"data_stored":925536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:16:24.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:16:24.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f115a800640 1 Processor -- start 2024-09-12T12:16:24.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f115a800640 1 -- start start 2024-09-12T12:16:24.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f115a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540d2e10 0x7f11540737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f115a800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1154162720 con 0x7f115415e4a0 2024-09-12T12:16:24.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f115a800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1154162a00 con 0x7f11540b67c0 2024-09-12T12:16:24.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f115a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1154073310 con 0x7f11540d2e10 2024-09-12T12:16:24.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1159400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f115415e4a0 0x7f1154161e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52626/0 (socket says 172.21.15.144:52626) 2024-09-12T12:16:24.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1159400640 1 -- 172.21.15.144:0/1481551411 learned_addr learned my addr 172.21.15.144:0/1481551411 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:24.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1158a00640 1 --2- 172.21.15.144:0/1481551411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540d2e10 0x7f11540737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1153e00640 1 -- 172.21.15.144:0/1481551411 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207517721 0 0) 0x7f1154162720 con 0x7f115415e4a0 2024-09-12T12:16:24.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1153e00640 1 -- 172.21.15.144:0/1481551411 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f113c003530 con 0x7f115415e4a0 2024-09-12T12:16:24.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1153e00640 1 -- 172.21.15.144:0/1481551411 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394342553 0 0) 0x7f1154162a00 con 0x7f11540b67c0 2024-09-12T12:16:24.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1153e00640 1 -- 172.21.15.144:0/1481551411 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1154162720 con 0x7f11540b67c0 2024-09-12T12:16:24.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1158a00640 1 -- 172.21.15.144:0/1481551411 >> v1:172.21.15.165:6789/0 conn(0x7f11540b67c0 legacy=0x7f11540b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1158a00640 1 -- 172.21.15.144:0/1481551411 >> v1:172.21.15.144:6789/0 conn(0x7f115415e4a0 legacy=0x7f1154161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.979+0000 7f1158a00640 1 -- 172.21.15.144:0/1481551411 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1154162ce0 con 0x7f11540d2e10 2024-09-12T12:16:24.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f1158a00640 1 --2- 172.21.15.144:0/1481551411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540d2e10 0x7f11540737a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f11400097f0 tx=0x7f114001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f970720624de1b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f1153e00640 1 -- 172.21.15.144:0/1481551411 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400b0070 con 0x7f11540d2e10 2024-09-12T12:16:24.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f1153e00640 1 -- 172.21.15.144:0/1481551411 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11400ab600 con 0x7f11540d2e10 2024-09-12T12:16:24.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f1153e00640 1 -- 172.21.15.144:0/1481551411 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400ab9d0 con 0x7f11540d2e10 2024-09-12T12:16:24.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f115a800640 1 -- 172.21.15.144:0/1481551411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540d2e10 msgr2=0x7f11540737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f115a800640 1 --2- 172.21.15.144:0/1481551411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540d2e10 0x7f11540737a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f11400097f0 tx=0x7f114001c4e0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f115a800640 1 -- 172.21.15.144:0/1481551411 shutdown_connections 2024-09-12T12:16:24.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f115a800640 1 --2- 172.21.15.144:0/1481551411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540d2e10 0x7f11540737a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f115a800640 1 -- 172.21.15.144:0/1481551411 >> 172.21.15.144:0/1481551411 conn(0x7f11540d2280 msgr2=0x7f11540d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f115a800640 1 -- 172.21.15.144:0/1481551411 shutdown_connections 2024-09-12T12:16:24.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.983+0000 7f115a800640 1 -- 172.21.15.144:0/1481551411 wait complete. 2024-09-12T12:16:24.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 Processor -- start 2024-09-12T12:16:24.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 -- start start 2024-09-12T12:16:24.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540b67c0 0x7f11540b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540d2e10 0x7f11541601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f115415e4a0 0x7f11540afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f115416c010 con 0x7f11540d2e10 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f115406d800 con 0x7f115415e4a0 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f115416c190 con 0x7f11540b67c0 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1158a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540d2e10 0x7f11541601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1158a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540d2e10 0x7f11541601b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47792/0 (socket says 172.21.15.144:47792) 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1158a00640 1 -- 172.21.15.144:0/3176417119 learned_addr learned my addr 172.21.15.144:0/3176417119 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1159400640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540b67c0 0x7f11540b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1159e00640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f115415e4a0 0x7f11540afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1158a00640 1 -- 172.21.15.144:0/3176417119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540b67c0 msgr2=0x7f11540b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1158a00640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540b67c0 0x7f11540b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1158a00640 1 -- 172.21.15.144:0/3176417119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f115415e4a0 msgr2=0x7f11540afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1158a00640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f115415e4a0 0x7f11540afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1158a00640 1 -- 172.21.15.144:0/3176417119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11540b06b0 con 0x7f11540d2e10 2024-09-12T12:16:24.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1158a00640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540d2e10 0x7f11541601b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f11400190f0 tx=0x7f1140019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1151600640 1 -- 172.21.15.144:0/3176417119 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400b0040 con 0x7f11540d2e10 2024-09-12T12:16:24.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1151600640 1 -- 172.21.15.144:0/3176417119 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11400b9070 con 0x7f11540d2e10 2024-09-12T12:16:24.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f1151600640 1 -- 172.21.15.144:0/3176417119 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400b4690 con 0x7f11540d2e10 2024-09-12T12:16:24.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11540b0990 con 0x7f11540d2e10 2024-09-12T12:16:24.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11540b0f50 con 0x7f11540d2e10 2024-09-12T12:16:24.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.987+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11540737a0 con 0x7f11540d2e10 2024-09-12T12:16:24.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.991+0000 7f1151600640 1 -- 172.21.15.144:0/3176417119 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f11400b4830 con 0x7f11540d2e10 2024-09-12T12:16:24.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.991+0000 7f1151600640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11340678c0 0x7f1134069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.991+0000 7f1151600640 1 -- 172.21.15.144:0/3176417119 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7f114011f8b0 con 0x7f11540d2e10 2024-09-12T12:16:24.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.991+0000 7f1159400640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11340678c0 0x7f1134069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.991+0000 7f1159400640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11340678c0 0x7f1134069d80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1148007fd0 tx=0x7f1148007d80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:24.995+0000 7f1151600640 1 -- 172.21.15.144:0/3176417119 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f11400160d0 con 0x7f11540d2e10 2024-09-12T12:16:25.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.151+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1154071130 con 0x7f11340678c0 2024-09-12T12:16:25.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.155+0000 7f1151600640 1 -- 172.21.15.144:0/3176417119 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246711 (secure 0 0 0) 0x7f1154071130 con 0x7f11340678c0 2024-09-12T12:16:25.160 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:16:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11340678c0 msgr2=0x7f1134069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11340678c0 0x7f1134069d80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1148007fd0 tx=0x7f1148007d80 comp rx=0 tx=0).stop 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540d2e10 msgr2=0x7f11541601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540d2e10 0x7f11541601b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f11400190f0 tx=0x7f1140019280 comp rx=0 tx=0).stop 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 shutdown_connections 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11340678c0 0x7f1134069d80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f115415e4a0 0x7f11540afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540d2e10 0x7f11541601b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 --2- 172.21.15.144:0/3176417119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11540b67c0 0x7f11540b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 >> 172.21.15.144:0/3176417119 conn(0x7f11540d2280 msgr2=0x7f11540b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 shutdown_connections 2024-09-12T12:16:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.159+0000 7f115a800640 1 -- 172.21.15.144:0/3176417119 wait complete. 2024-09-12T12:16:25.181 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-12T12:16:23.421310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294004,"kb_used_data":7028,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680716,"statfs":{"total":773094113280,"available":772793053184,"internally_reserved":0,"allocated":7196672,"data_stored":3868739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.156397"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.283693+0000","last_change":"2024-09-12T12:16:19.283693+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.283693+0000","last_undegraded":"2024-09-12T12:16:19.283693+0000","last_fullsized":"2024-09-12T12:16:19.283693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.283657+0000","last_change":"2024-09-12T12:16:19.283657+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.283657+0000","last_undegraded":"2024-09-12T12:16:19.283657+0000","last_fullsized":"2024-09-12T12:16:19.283657+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273939+0000","last_change":"2024-09-12T12:16:19.273939+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273939+0000","last_undegraded":"2024-09-12T12:16:19.273939+0000","last_fullsized":"2024-09-12T12:16:19.273939+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270775+0000","last_change":"2024-09-12T12:16:19.270775+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270775+0000","last_undegraded":"2024-09-12T12:16:19.270775+0000","last_fullsized":"2024-09-12T12:16:19.270775+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.281282+0000","last_change":"2024-09-12T12:16:19.281282+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.281282+0000","last_undegraded":"2024-09-12T12:16:19.281282+0000","last_fullsized":"2024-09-12T12:16:19.281282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278908+0000","last_change":"2024-09-12T12:16:19.278908+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278908+0000","last_undegraded":"2024-09-12T12:16:19.278908+0000","last_fullsized":"2024-09-12T12:16:19.278908+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274701+0000","last_change":"2024-09-12T12:16:19.274701+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274701+0000","last_undegraded":"2024-09-12T12:16:19.274701+0000","last_fullsized":"2024-09-12T12:16:19.274701+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274611+0000","last_change":"2024-09-12T12:16:19.274611+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274611+0000","last_undegraded":"2024-09-12T12:16:19.274611+0000","last_fullsized":"2024-09-12T12:16:19.274611+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274282+0000","last_change":"2024-09-12T12:16:19.274282+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274282+0000","last_undegraded":"2024-09-12T12:16:19.274282+0000","last_fullsized":"2024-09-12T12:16:19.274282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276975+0000","last_change":"2024-09-12T12:16:19.276975+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276975+0000","last_undegraded":"2024-09-12T12:16:19.276975+0000","last_fullsized":"2024-09-12T12:16:19.276975+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270822+0000","last_change":"2024-09-12T12:16:19.270822+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270822+0000","last_undegraded":"2024-09-12T12:16:19.270822+0000","last_fullsized":"2024-09-12T12:16:19.270822+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276766+0000","last_change":"2024-09-12T12:16:19.276766+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276766+0000","last_undegraded":"2024-09-12T12:16:19.276766+0000","last_fullsized":"2024-09-12T12:16:19.276766+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280367+0000","last_change":"2024-09-12T12:16:19.280367+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280367+0000","last_undegraded":"2024-09-12T12:16:19.280367+0000","last_fullsized":"2024-09-12T12:16:19.280367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273774+0000","last_change":"2024-09-12T12:16:19.273774+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273774+0000","last_undegraded":"2024-09-12T12:16:19.273774+0000","last_fullsized":"2024-09-12T12:16:19.273774+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277306+0000","last_change":"2024-09-12T12:16:19.277306+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277306+0000","last_undegraded":"2024-09-12T12:16:19.277306+0000","last_fullsized":"2024-09-12T12:16:19.277306+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273895+0000","last_change":"2024-09-12T12:16:19.273895+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273895+0000","last_undegraded":"2024-09-12T12:16:19.273895+0000","last_fullsized":"2024-09-12T12:16:19.273895+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.282176+0000","last_change":"2024-09-12T12:16:19.282176+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.282176+0000","last_undegraded":"2024-09-12T12:16:19.282176+0000","last_fullsized":"2024-09-12T12:16:19.282176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.271135+0000","last_change":"2024-09-12T12:16:19.271135+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.271135+0000","last_undegraded":"2024-09-12T12:16:19.271135+0000","last_fullsized":"2024-09-12T12:16:19.271135+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277093+0000","last_change":"2024-09-12T12:16:19.277093+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277093+0000","last_undegraded":"2024-09-12T12:16:19.277093+0000","last_fullsized":"2024-09-12T12:16:19.277093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276494+0000","last_change":"2024-09-12T12:16:19.276494+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276494+0000","last_undegraded":"2024-09-12T12:16:19.276494+0000","last_fullsized":"2024-09-12T12:16:19.276494+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278101+0000","last_change":"2024-09-12T12:16:19.278101+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278101+0000","last_undegraded":"2024-09-12T12:16:19.278101+0000","last_fullsized":"2024-09-12T12:16:19.278101+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276151+0000","last_change":"2024-09-12T12:16:19.276151+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276151+0000","last_undegraded":"2024-09-12T12:16:19.276151+0000","last_fullsized":"2024-09-12T12:16:19.276151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274929+0000","last_change":"2024-09-12T12:16:19.274929+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274929+0000","last_undegraded":"2024-09-12T12:16:19.274929+0000","last_fullsized":"2024-09-12T12:16:19.274929+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273995+0000","last_change":"2024-09-12T12:16:19.273995+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273995+0000","last_undegraded":"2024-09-12T12:16:19.273995+0000","last_fullsized":"2024-09-12T12:16:19.273995+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278354+0000","last_change":"2024-09-12T12:16:19.278354+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278354+0000","last_undegraded":"2024-09-12T12:16:19.278354+0000","last_fullsized":"2024-09-12T12:16:19.278354+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.279784+0000","last_change":"2024-09-12T12:16:19.279784+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.279784+0000","last_undegraded":"2024-09-12T12:16:19.279784+0000","last_fullsized":"2024-09-12T12:16:19.279784+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270348+0000","last_change":"2024-09-12T12:16:19.270348+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270348+0000","last_undegraded":"2024-09-12T12:16:19.270348+0000","last_fullsized":"2024-09-12T12:16:19.270348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.282488+0000","last_change":"2024-09-12T12:16:19.282488+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.282488+0000","last_undegraded":"2024-09-12T12:16:19.282488+0000","last_fullsized":"2024-09-12T12:16:19.282488+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273950+0000","last_change":"2024-09-12T12:16:19.273950+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273950+0000","last_undegraded":"2024-09-12T12:16:19.273950+0000","last_fullsized":"2024-09-12T12:16:19.273950+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276828+0000","last_change":"2024-09-12T12:16:19.276828+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276828+0000","last_undegraded":"2024-09-12T12:16:19.276828+0000","last_fullsized":"2024-09-12T12:16:19.276828+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270413+0000","last_change":"2024-09-12T12:16:19.270413+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270413+0000","last_undegraded":"2024-09-12T12:16:19.270413+0000","last_fullsized":"2024-09-12T12:16:19.270413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278567+0000","last_change":"2024-09-12T12:16:19.278567+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278567+0000","last_undegraded":"2024-09-12T12:16:19.278567+0000","last_fullsized":"2024-09-12T12:16:19.278567+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273453+0000","last_change":"2024-09-12T12:16:19.273453+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273453+0000","last_undegraded":"2024-09-12T12:16:19.273453+0000","last_fullsized":"2024-09-12T12:16:19.273453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.294772+0000","last_change":"2024-09-12T12:16:19.292137+0000","last_active":"2024-09-12T12:16:19.294772+0000","last_peered":"2024-09-12T12:16:19.294772+0000","last_clean":"2024-09-12T12:16:19.294772+0000","last_became_active":"2024-09-12T12:16:19.291503+0000","last_became_peered":"2024-09-12T12:16:19.291503+0000","last_unstale":"2024-09-12T12:16:19.294772+0000","last_undegraded":"2024-09-12T12:16:19.294772+0000","last_fullsized":"2024-09-12T12:16:19.294772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:12.361202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269831+0000","last_change":"2024-09-12T12:16:19.269831+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269831+0000","last_undegraded":"2024-09-12T12:16:19.269831+0000","last_fullsized":"2024-09-12T12:16:19.269831+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.291924+0000","last_change":"2024-09-12T12:16:19.290400+0000","last_active":"2024-09-12T12:16:19.291924+0000","last_peered":"2024-09-12T12:16:19.291924+0000","last_clean":"2024-09-12T12:16:19.291924+0000","last_became_active":"2024-09-12T12:16:19.290156+0000","last_became_peered":"2024-09-12T12:16:19.290156+0000","last_unstale":"2024-09-12T12:16:19.291924+0000","last_undegraded":"2024-09-12T12:16:19.291924+0000","last_fullsized":"2024-09-12T12:16:19.291924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:50.460933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277968+0000","last_change":"2024-09-12T12:16:19.277968+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277968+0000","last_undegraded":"2024-09-12T12:16:19.277968+0000","last_fullsized":"2024-09-12T12:16:19.277968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.289724+0000","last_change":"2024-09-12T12:16:19.287826+0000","last_active":"2024-09-12T12:16:19.289724+0000","last_peered":"2024-09-12T12:16:19.289724+0000","last_clean":"2024-09-12T12:16:19.289724+0000","last_became_active":"2024-09-12T12:16:19.287566+0000","last_became_peered":"2024-09-12T12:16:19.287566+0000","last_unstale":"2024-09-12T12:16:19.289724+0000","last_undegraded":"2024-09-12T12:16:19.289724+0000","last_fullsized":"2024-09-12T12:16:19.289724+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:06.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.274889+0000","last_change":"2024-09-12T12:16:19.274889+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.274889+0000","last_undegraded":"2024-09-12T12:16:19.274889+0000","last_fullsized":"2024-09-12T12:16:19.274889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.296013+0000","last_change":"2024-09-12T12:16:19.293865+0000","last_active":"2024-09-12T12:16:19.296013+0000","last_peered":"2024-09-12T12:16:19.296013+0000","last_clean":"2024-09-12T12:16:19.296013+0000","last_became_active":"2024-09-12T12:16:19.293483+0000","last_became_peered":"2024-09-12T12:16:19.293483+0000","last_unstale":"2024-09-12T12:16:19.296013+0000","last_undegraded":"2024-09-12T12:16:19.296013+0000","last_fullsized":"2024-09-12T12:16:19.296013+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:30.715166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273413+0000","last_change":"2024-09-12T12:16:19.273413+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273413+0000","last_undegraded":"2024-09-12T12:16:19.273413+0000","last_fullsized":"2024-09-12T12:16:19.273413+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292879+0000","last_change":"2024-09-12T12:16:19.287050+0000","last_active":"2024-09-12T12:16:19.292879+0000","last_peered":"2024-09-12T12:16:19.292879+0000","last_clean":"2024-09-12T12:16:19.292879+0000","last_became_active":"2024-09-12T12:16:19.285906+0000","last_became_peered":"2024-09-12T12:16:19.285906+0000","last_unstale":"2024-09-12T12:16:19.292879+0000","last_undegraded":"2024-09-12T12:16:19.292879+0000","last_fullsized":"2024-09-12T12:16:19.292879+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:32.997009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280086+0000","last_change":"2024-09-12T12:16:19.280086+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280086+0000","last_undegraded":"2024-09-12T12:16:19.280086+0000","last_fullsized":"2024-09-12T12:16:19.280086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.291049+0000","last_change":"2024-09-12T12:16:19.284576+0000","last_active":"2024-09-12T12:16:19.291049+0000","last_peered":"2024-09-12T12:16:19.291049+0000","last_clean":"2024-09-12T12:16:19.291049+0000","last_became_active":"2024-09-12T12:16:19.284314+0000","last_became_peered":"2024-09-12T12:16:19.284314+0000","last_unstale":"2024-09-12T12:16:19.291049+0000","last_undegraded":"2024-09-12T12:16:19.291049+0000","last_fullsized":"2024-09-12T12:16:19.291049+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:07.149683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.276322+0000","last_change":"2024-09-12T12:16:19.276322+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.276322+0000","last_undegraded":"2024-09-12T12:16:19.276322+0000","last_fullsized":"2024-09-12T12:16:19.276322+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292433+0000","last_change":"2024-09-12T12:16:19.286530+0000","last_active":"2024-09-12T12:16:19.292433+0000","last_peered":"2024-09-12T12:16:19.292433+0000","last_clean":"2024-09-12T12:16:19.292433+0000","last_became_active":"2024-09-12T12:16:19.285761+0000","last_became_peered":"2024-09-12T12:16:19.285761+0000","last_unstale":"2024-09-12T12:16:19.292433+0000","last_undegraded":"2024-09-12T12:16:19.292433+0000","last_fullsized":"2024-09-12T12:16:19.292433+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:27.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275885+0000","last_change":"2024-09-12T12:16:19.275885+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275885+0000","last_undegraded":"2024-09-12T12:16:19.275885+0000","last_fullsized":"2024-09-12T12:16:19.275885+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.287091+0000","last_change":"2024-09-12T12:16:19.280332+0000","last_active":"2024-09-12T12:16:19.287091+0000","last_peered":"2024-09-12T12:16:19.287091+0000","last_clean":"2024-09-12T12:16:19.287091+0000","last_became_active":"2024-09-12T12:16:19.280016+0000","last_became_peered":"2024-09-12T12:16:19.280016+0000","last_unstale":"2024-09-12T12:16:19.287091+0000","last_undegraded":"2024-09-12T12:16:19.287091+0000","last_fullsized":"2024-09-12T12:16:19.287091+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:42.811402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.281737+0000","last_change":"2024-09-12T12:16:19.281737+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.281737+0000","last_undegraded":"2024-09-12T12:16:19.281737+0000","last_fullsized":"2024-09-12T12:16:19.281737+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297740+0000","last_change":"2024-09-12T12:16:19.293341+0000","last_active":"2024-09-12T12:16:19.297740+0000","last_peered":"2024-09-12T12:16:19.297740+0000","last_clean":"2024-09-12T12:16:19.297740+0000","last_became_active":"2024-09-12T12:16:19.293054+0000","last_became_peered":"2024-09-12T12:16:19.293054+0000","last_unstale":"2024-09-12T12:16:19.297740+0000","last_undegraded":"2024-09-12T12:16:19.297740+0000","last_fullsized":"2024-09-12T12:16:19.297740+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:19.578323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277558+0000","last_change":"2024-09-12T12:16:19.277558+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277558+0000","last_undegraded":"2024-09-12T12:16:19.277558+0000","last_fullsized":"2024-09-12T12:16:19.277558+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292325+0000","last_change":"2024-09-12T12:16:19.291302+0000","last_active":"2024-09-12T12:16:19.292325+0000","last_peered":"2024-09-12T12:16:19.292325+0000","last_clean":"2024-09-12T12:16:19.292325+0000","last_became_active":"2024-09-12T12:16:19.291059+0000","last_became_peered":"2024-09-12T12:16:19.291059+0000","last_unstale":"2024-09-12T12:16:19.292325+0000","last_undegraded":"2024-09-12T12:16:19.292325+0000","last_fullsized":"2024-09-12T12:16:19.292325+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:01.724542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272614+0000","last_change":"2024-09-12T12:16:19.272614+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272614+0000","last_undegraded":"2024-09-12T12:16:19.272614+0000","last_fullsized":"2024-09-12T12:16:19.272614+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297786+0000","last_change":"2024-09-12T12:16:19.293736+0000","last_active":"2024-09-12T12:16:19.297786+0000","last_peered":"2024-09-12T12:16:19.297786+0000","last_clean":"2024-09-12T12:16:19.297786+0000","last_became_active":"2024-09-12T12:16:19.293370+0000","last_became_peered":"2024-09-12T12:16:19.293370+0000","last_unstale":"2024-09-12T12:16:19.297786+0000","last_undegraded":"2024-09-12T12:16:19.297786+0000","last_fullsized":"2024-09-12T12:16:19.297786+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:26.002774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269703+0000","last_change":"2024-09-12T12:16:19.269703+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269703+0000","last_undegraded":"2024-09-12T12:16:19.269703+0000","last_fullsized":"2024-09-12T12:16:19.269703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295502+0000","last_change":"2024-09-12T12:16:19.293140+0000","last_active":"2024-09-12T12:16:19.295502+0000","last_peered":"2024-09-12T12:16:19.295502+0000","last_clean":"2024-09-12T12:16:19.295502+0000","last_became_active":"2024-09-12T12:16:19.292230+0000","last_became_peered":"2024-09-12T12:16:19.292230+0000","last_unstale":"2024-09-12T12:16:19.295502+0000","last_undegraded":"2024-09-12T12:16:19.295502+0000","last_fullsized":"2024-09-12T12:16:19.295502+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:09.373959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269699+0000","last_change":"2024-09-12T12:16:19.269699+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269699+0000","last_undegraded":"2024-09-12T12:16:19.269699+0000","last_fullsized":"2024-09-12T12:16:19.269699+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292219+0000","last_change":"2024-09-12T12:16:19.289406+0000","last_active":"2024-09-12T12:16:19.292219+0000","last_peered":"2024-09-12T12:16:19.292219+0000","last_clean":"2024-09-12T12:16:19.292219+0000","last_became_active":"2024-09-12T12:16:19.288998+0000","last_became_peered":"2024-09-12T12:16:19.288998+0000","last_unstale":"2024-09-12T12:16:19.292219+0000","last_undegraded":"2024-09-12T12:16:19.292219+0000","last_fullsized":"2024-09-12T12:16:19.292219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:42.631030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275692+0000","last_change":"2024-09-12T12:16:19.275692+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275692+0000","last_undegraded":"2024-09-12T12:16:19.275692+0000","last_fullsized":"2024-09-12T12:16:19.275692+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297577+0000","last_change":"2024-09-12T12:16:19.295064+0000","last_active":"2024-09-12T12:16:19.297577+0000","last_peered":"2024-09-12T12:16:19.297577+0000","last_clean":"2024-09-12T12:16:19.297577+0000","last_became_active":"2024-09-12T12:16:19.294669+0000","last_became_peered":"2024-09-12T12:16:19.294669+0000","last_unstale":"2024-09-12T12:16:19.297577+0000","last_undegraded":"2024-09-12T12:16:19.297577+0000","last_fullsized":"2024-09-12T12:16:19.297577+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:55.639414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272948+0000","last_change":"2024-09-12T12:16:19.272948+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272948+0000","last_undegraded":"2024-09-12T12:16:19.272948+0000","last_fullsized":"2024-09-12T12:16:19.272948+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297772+0000","last_change":"2024-09-12T12:16:19.293730+0000","last_active":"2024-09-12T12:16:19.297772+0000","last_peered":"2024-09-12T12:16:19.297772+0000","last_clean":"2024-09-12T12:16:19.297772+0000","last_became_active":"2024-09-12T12:16:19.292943+0000","last_became_peered":"2024-09-12T12:16:19.292943+0000","last_unstale":"2024-09-12T12:16:19.297772+0000","last_undegraded":"2024-09-12T12:16:19.297772+0000","last_fullsized":"2024-09-12T12:16:19.297772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:08.254321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280321+0000","last_change":"2024-09-12T12:16:19.280321+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280321+0000","last_undegraded":"2024-09-12T12:16:19.280321+0000","last_fullsized":"2024-09-12T12:16:19.280321+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292283+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:19.292283+0000","last_peered":"2024-09-12T12:16:19.292283+0000","last_clean":"2024-09-12T12:16:19.292283+0000","last_became_active":"2024-09-12T12:16:19.285395+0000","last_became_peered":"2024-09-12T12:16:19.285395+0000","last_unstale":"2024-09-12T12:16:19.292283+0000","last_undegraded":"2024-09-12T12:16:19.292283+0000","last_fullsized":"2024-09-12T12:16:19.292283+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:07:35.820417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273745+0000","last_change":"2024-09-12T12:16:19.273745+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273745+0000","last_undegraded":"2024-09-12T12:16:19.273745+0000","last_fullsized":"2024-09-12T12:16:19.273745+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.294796+0000","last_change":"2024-09-12T12:16:19.293036+0000","last_active":"2024-09-12T12:16:19.294796+0000","last_peered":"2024-09-12T12:16:19.294796+0000","last_clean":"2024-09-12T12:16:19.294796+0000","last_became_active":"2024-09-12T12:16:19.292655+0000","last_became_peered":"2024-09-12T12:16:19.292655+0000","last_unstale":"2024-09-12T12:16:19.294796+0000","last_undegraded":"2024-09-12T12:16:19.294796+0000","last_fullsized":"2024-09-12T12:16:19.294796+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:26.002774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273187+0000","last_change":"2024-09-12T12:16:19.273187+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273187+0000","last_undegraded":"2024-09-12T12:16:19.273187+0000","last_fullsized":"2024-09-12T12:16:19.273187+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297811+0000","last_change":"2024-09-12T12:16:19.294158+0000","last_active":"2024-09-12T12:16:19.297811+0000","last_peered":"2024-09-12T12:16:19.297811+0000","last_clean":"2024-09-12T12:16:19.297811+0000","last_became_active":"2024-09-12T12:16:19.293849+0000","last_became_peered":"2024-09-12T12:16:19.293849+0000","last_unstale":"2024-09-12T12:16:19.297811+0000","last_undegraded":"2024-09-12T12:16:19.297811+0000","last_fullsized":"2024-09-12T12:16:19.297811+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:41.978411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.270646+0000","last_change":"2024-09-12T12:16:19.270646+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.270646+0000","last_undegraded":"2024-09-12T12:16:19.270646+0000","last_fullsized":"2024-09-12T12:16:19.270646+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297817+0000","last_change":"2024-09-12T12:16:19.293944+0000","last_active":"2024-09-12T12:16:19.297817+0000","last_peered":"2024-09-12T12:16:19.297817+0000","last_clean":"2024-09-12T12:16:19.297817+0000","last_became_active":"2024-09-12T12:16:19.293392+0000","last_became_peered":"2024-09-12T12:16:19.293392+0000","last_unstale":"2024-09-12T12:16:19.297817+0000","last_undegraded":"2024-09-12T12:16:19.297817+0000","last_fullsized":"2024-09-12T12:16:19.297817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:55.639414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275953+0000","last_change":"2024-09-12T12:16:19.275953+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275953+0000","last_undegraded":"2024-09-12T12:16:19.275953+0000","last_fullsized":"2024-09-12T12:16:19.275953+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292398+0000","last_change":"2024-09-12T12:16:19.286376+0000","last_active":"2024-09-12T12:16:19.292398+0000","last_peered":"2024-09-12T12:16:19.292398+0000","last_clean":"2024-09-12T12:16:19.292398+0000","last_became_active":"2024-09-12T12:16:19.286111+0000","last_became_peered":"2024-09-12T12:16:19.286111+0000","last_unstale":"2024-09-12T12:16:19.292398+0000","last_undegraded":"2024-09-12T12:16:19.292398+0000","last_fullsized":"2024-09-12T12:16:19.292398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:41.880340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.278171+0000","last_change":"2024-09-12T12:16:19.278171+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.278171+0000","last_undegraded":"2024-09-12T12:16:19.278171+0000","last_fullsized":"2024-09-12T12:16:19.278171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.291884+0000","last_change":"2024-09-12T12:16:19.289582+0000","last_active":"2024-09-12T12:16:19.291884+0000","last_peered":"2024-09-12T12:16:19.291884+0000","last_clean":"2024-09-12T12:16:19.291884+0000","last_became_active":"2024-09-12T12:16:19.289038+0000","last_became_peered":"2024-09-12T12:16:19.289038+0000","last_unstale":"2024-09-12T12:16:19.291884+0000","last_undegraded":"2024-09-12T12:16:19.291884+0000","last_fullsized":"2024-09-12T12:16:19.291884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:54.376507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.275171+0000","last_change":"2024-09-12T12:16:19.275171+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.275171+0000","last_undegraded":"2024-09-12T12:16:19.275171+0000","last_fullsized":"2024-09-12T12:16:19.275171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295195+0000","last_change":"2024-09-12T12:16:19.293030+0000","last_active":"2024-09-12T12:16:19.295195+0000","last_peered":"2024-09-12T12:16:19.295195+0000","last_clean":"2024-09-12T12:16:19.295195+0000","last_became_active":"2024-09-12T12:16:19.292701+0000","last_became_peered":"2024-09-12T12:16:19.292701+0000","last_unstale":"2024-09-12T12:16:19.295195+0000","last_undegraded":"2024-09-12T12:16:19.295195+0000","last_fullsized":"2024-09-12T12:16:19.295195+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:08.254321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272455+0000","last_change":"2024-09-12T12:16:19.272455+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272455+0000","last_undegraded":"2024-09-12T12:16:19.272455+0000","last_fullsized":"2024-09-12T12:16:19.272455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.288720+0000","last_change":"2024-09-12T12:16:19.286130+0000","last_active":"2024-09-12T12:16:19.288720+0000","last_peered":"2024-09-12T12:16:19.288720+0000","last_clean":"2024-09-12T12:16:19.288720+0000","last_became_active":"2024-09-12T12:16:19.285864+0000","last_became_peered":"2024-09-12T12:16:19.285864+0000","last_unstale":"2024-09-12T12:16:19.288720+0000","last_undegraded":"2024-09-12T12:16:19.288720+0000","last_fullsized":"2024-09-12T12:16:19.288720+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.039782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277422+0000","last_change":"2024-09-12T12:16:19.277422+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277422+0000","last_undegraded":"2024-09-12T12:16:19.277422+0000","last_fullsized":"2024-09-12T12:16:19.277422+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292038+0000","last_change":"2024-09-12T12:16:19.289187+0000","last_active":"2024-09-12T12:16:19.292038+0000","last_peered":"2024-09-12T12:16:19.292038+0000","last_clean":"2024-09-12T12:16:19.292038+0000","last_became_active":"2024-09-12T12:16:19.286518+0000","last_became_peered":"2024-09-12T12:16:19.286518+0000","last_unstale":"2024-09-12T12:16:19.292038+0000","last_undegraded":"2024-09-12T12:16:19.292038+0000","last_fullsized":"2024-09-12T12:16:19.292038+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:19.578323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273776+0000","last_change":"2024-09-12T12:16:19.273776+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273776+0000","last_undegraded":"2024-09-12T12:16:19.273776+0000","last_fullsized":"2024-09-12T12:16:19.273776+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.286591+0000","last_change":"2024-09-12T12:16:19.285221+0000","last_active":"2024-09-12T12:16:19.286591+0000","last_peered":"2024-09-12T12:16:19.286591+0000","last_clean":"2024-09-12T12:16:19.286591+0000","last_became_active":"2024-09-12T12:16:19.284934+0000","last_became_peered":"2024-09-12T12:16:19.284934+0000","last_unstale":"2024-09-12T12:16:19.286591+0000","last_undegraded":"2024-09-12T12:16:19.286591+0000","last_fullsized":"2024-09-12T12:16:19.286591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:49.052026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.277963+0000","last_change":"2024-09-12T12:16:19.277963+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.277963+0000","last_undegraded":"2024-09-12T12:16:19.277963+0000","last_fullsized":"2024-09-12T12:16:19.277963+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.289004+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:19.289004+0000","last_peered":"2024-09-12T12:16:19.289004+0000","last_clean":"2024-09-12T12:16:19.289004+0000","last_became_active":"2024-09-12T12:16:19.285402+0000","last_became_peered":"2024-09-12T12:16:19.285402+0000","last_unstale":"2024-09-12T12:16:19.289004+0000","last_undegraded":"2024-09-12T12:16:19.289004+0000","last_fullsized":"2024-09-12T12:16:19.289004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:24.499881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272886+0000","last_change":"2024-09-12T12:16:19.272886+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272886+0000","last_undegraded":"2024-09-12T12:16:19.272886+0000","last_fullsized":"2024-09-12T12:16:19.272886+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295206+0000","last_change":"2024-09-12T12:16:19.292693+0000","last_active":"2024-09-12T12:16:19.295206+0000","last_peered":"2024-09-12T12:16:19.295206+0000","last_clean":"2024-09-12T12:16:19.295206+0000","last_became_active":"2024-09-12T12:16:19.291920+0000","last_became_peered":"2024-09-12T12:16:19.291920+0000","last_unstale":"2024-09-12T12:16:19.295206+0000","last_undegraded":"2024-09-12T12:16:19.295206+0000","last_fullsized":"2024-09-12T12:16:19.295206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:30.207599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.272674+0000","last_change":"2024-09-12T12:16:19.272674+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.272674+0000","last_undegraded":"2024-09-12T12:16:19.272674+0000","last_fullsized":"2024-09-12T12:16:19.272674+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.297709+0000","last_change":"2024-09-12T12:16:19.292882+0000","last_active":"2024-09-12T12:16:19.297709+0000","last_peered":"2024-09-12T12:16:19.297709+0000","last_clean":"2024-09-12T12:16:19.297709+0000","last_became_active":"2024-09-12T12:16:19.292639+0000","last_became_peered":"2024-09-12T12:16:19.292639+0000","last_unstale":"2024-09-12T12:16:19.297709+0000","last_undegraded":"2024-09-12T12:16:19.297709+0000","last_fullsized":"2024-09-12T12:16:19.297709+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:49.052026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.269910+0000","last_change":"2024-09-12T12:16:19.269910+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.269910+0000","last_undegraded":"2024-09-12T12:16:19.269910+0000","last_fullsized":"2024-09-12T12:16:19.269910+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.296410+0000","last_change":"2024-09-12T12:16:19.294703+0000","last_active":"2024-09-12T12:16:19.296410+0000","last_peered":"2024-09-12T12:16:19.296410+0000","last_clean":"2024-09-12T12:16:19.296410+0000","last_became_active":"2024-09-12T12:16:19.294170+0000","last_became_peered":"2024-09-12T12:16:19.294170+0000","last_unstale":"2024-09-12T12:16:19.296410+0000","last_undegraded":"2024-09-12T12:16:19.296410+0000","last_fullsized":"2024-09-12T12:16:19.296410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:52.454304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.280517+0000","last_change":"2024-09-12T12:16:19.280517+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.280517+0000","last_undegraded":"2024-09-12T12:16:19.280517+0000","last_fullsized":"2024-09-12T12:16:19.280517+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292219+0000","last_change":"2024-09-12T12:16:19.285844+0000","last_active":"2024-09-12T12:16:19.292219+0000","last_peered":"2024-09-12T12:16:19.292219+0000","last_clean":"2024-09-12T12:16:19.292219+0000","last_became_active":"2024-09-12T12:16:19.285560+0000","last_became_peered":"2024-09-12T12:16:19.285560+0000","last_unstale":"2024-09-12T12:16:19.292219+0000","last_undegraded":"2024-09-12T12:16:19.292219+0000","last_fullsized":"2024-09-12T12:16:19.292219+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:15.706001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273343+0000","last_change":"2024-09-12T12:16:19.273343+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273343+0000","last_undegraded":"2024-09-12T12:16:19.273343+0000","last_fullsized":"2024-09-12T12:16:19.273343+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.295395+0000","last_change":"2024-09-12T12:16:19.293792+0000","last_active":"2024-09-12T12:16:19.295395+0000","last_peered":"2024-09-12T12:16:19.295395+0000","last_clean":"2024-09-12T12:16:19.295395+0000","last_became_active":"2024-09-12T12:16:19.293497+0000","last_became_peered":"2024-09-12T12:16:19.293497+0000","last_unstale":"2024-09-12T12:16:19.295395+0000","last_undegraded":"2024-09-12T12:16:19.295395+0000","last_fullsized":"2024-09-12T12:16:19.295395+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:09.458017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-12T12:16:19.273624+0000","last_change":"2024-09-12T12:16:19.273624+0000","last_active":"2024-09-12T12:16:19.263419+0000","last_peered":"2024-09-12T12:16:19.263419+0000","last_clean":"2024-09-12T12:16:19.263419+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:16:19.273624+0000","last_undegraded":"2024-09-12T12:16:19.273624+0000","last_fullsized":"2024-09-12T12:16:19.273624+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.292839+0000","last_change":"2024-09-12T12:16:19.286473+0000","last_active":"2024-09-12T12:16:19.292839+0000","last_peered":"2024-09-12T12:16:19.292839+0000","last_clean":"2024-09-12T12:16:19.292839+0000","last_became_active":"2024-09-12T12:16:19.286196+0000","last_became_peered":"2024-09-12T12:16:19.286196+0000","last_unstale":"2024-09-12T12:16:19.292839+0000","last_undegraded":"2024-09-12T12:16:19.292839+0000","last_fullsized":"2024-09-12T12:16:19.292839+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:01.253597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-12T12:16:19.279776+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:16:19.279776+0000","last_peered":"2024-09-12T12:16:19.279776+0000","last_clean":"2024-09-12T12:16:19.279776+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:16:19.279776+0000","last_undegraded":"2024-09-12T12:16:19.279776+0000","last_fullsized":"2024-09-12T12:16:19.279776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36660,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335180,"statfs":{"total":96636764160,"available":96599224320,"internally_reserved":0,"allocated":1343488,"data_stored":925536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36096,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335744,"statfs":{"total":96636764160,"available":96599801856,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36092,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335748,"statfs":{"total":96636764160,"available":96599805952,"internally_reserved":0,"allocated":761856,"data_stored":341827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36084,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335756,"statfs":{"total":96636764160,"available":96599814144,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":749568,"data_stored":335168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1343488,"data_stored":925536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:16:25.185 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3f is not active+clean 2024-09-12T12:16:25.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.283693+0000', 'last_change': '2024-09-12T12:16:19.283693+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.283693+0000', 'last_undegraded': '2024-09-12T12:16:19.283693+0000', 'last_fullsized': '2024-09-12T12:16:19.283693+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:16:25.185 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3e is not active+clean 2024-09-12T12:16:25.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.283657+0000', 'last_change': '2024-09-12T12:16:19.283657+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.283657+0000', 'last_undegraded': '2024-09-12T12:16:19.283657+0000', 'last_fullsized': '2024-09-12T12:16:19.283657+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:16:25.185 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3d is not active+clean 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273939+0000', 'last_change': '2024-09-12T12:16:19.273939+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273939+0000', 'last_undegraded': '2024-09-12T12:16:19.273939+0000', 'last_fullsized': '2024-09-12T12:16:19.273939+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3c is not active+clean 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.270775+0000', 'last_change': '2024-09-12T12:16:19.270775+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.270775+0000', 'last_undegraded': '2024-09-12T12:16:19.270775+0000', 'last_fullsized': '2024-09-12T12:16:19.270775+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3b is not active+clean 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.281282+0000', 'last_change': '2024-09-12T12:16:19.281282+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.281282+0000', 'last_undegraded': '2024-09-12T12:16:19.281282+0000', 'last_fullsized': '2024-09-12T12:16:19.281282+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3a is not active+clean 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.278908+0000', 'last_change': '2024-09-12T12:16:19.278908+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.278908+0000', 'last_undegraded': '2024-09-12T12:16:19.278908+0000', 'last_fullsized': '2024-09-12T12:16:19.278908+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:PG 10.39 is not active+clean 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.274701+0000', 'last_change': '2024-09-12T12:16:19.274701+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.274701+0000', 'last_undegraded': '2024-09-12T12:16:19.274701+0000', 'last_fullsized': '2024-09-12T12:16:19.274701+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:PG 10.38 is not active+clean 2024-09-12T12:16:25.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.274611+0000', 'last_change': '2024-09-12T12:16:19.274611+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.274611+0000', 'last_undegraded': '2024-09-12T12:16:19.274611+0000', 'last_fullsized': '2024-09-12T12:16:19.274611+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:PG 10.37 is not active+clean 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.274282+0000', 'last_change': '2024-09-12T12:16:19.274282+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.274282+0000', 'last_undegraded': '2024-09-12T12:16:19.274282+0000', 'last_fullsized': '2024-09-12T12:16:19.274282+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:PG 10.36 is not active+clean 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.276975+0000', 'last_change': '2024-09-12T12:16:19.276975+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.276975+0000', 'last_undegraded': '2024-09-12T12:16:19.276975+0000', 'last_fullsized': '2024-09-12T12:16:19.276975+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:PG 10.35 is not active+clean 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.270822+0000', 'last_change': '2024-09-12T12:16:19.270822+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.270822+0000', 'last_undegraded': '2024-09-12T12:16:19.270822+0000', 'last_fullsized': '2024-09-12T12:16:19.270822+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:PG 10.34 is not active+clean 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.276766+0000', 'last_change': '2024-09-12T12:16:19.276766+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.276766+0000', 'last_undegraded': '2024-09-12T12:16:19.276766+0000', 'last_fullsized': '2024-09-12T12:16:19.276766+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:PG 10.33 is not active+clean 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.280367+0000', 'last_change': '2024-09-12T12:16:19.280367+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.280367+0000', 'last_undegraded': '2024-09-12T12:16:19.280367+0000', 'last_fullsized': '2024-09-12T12:16:19.280367+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.187 INFO:tasks.ceph.ceph_manager.ceph:PG 10.32 is not active+clean 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273774+0000', 'last_change': '2024-09-12T12:16:19.273774+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273774+0000', 'last_undegraded': '2024-09-12T12:16:19.273774+0000', 'last_fullsized': '2024-09-12T12:16:19.273774+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:PG 10.31 is not active+clean 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.277306+0000', 'last_change': '2024-09-12T12:16:19.277306+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.277306+0000', 'last_undegraded': '2024-09-12T12:16:19.277306+0000', 'last_fullsized': '2024-09-12T12:16:19.277306+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:PG 10.30 is not active+clean 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273895+0000', 'last_change': '2024-09-12T12:16:19.273895+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273895+0000', 'last_undegraded': '2024-09-12T12:16:19.273895+0000', 'last_fullsized': '2024-09-12T12:16:19.273895+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2f is not active+clean 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.282176+0000', 'last_change': '2024-09-12T12:16:19.282176+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.282176+0000', 'last_undegraded': '2024-09-12T12:16:19.282176+0000', 'last_fullsized': '2024-09-12T12:16:19.282176+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2e is not active+clean 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.271135+0000', 'last_change': '2024-09-12T12:16:19.271135+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.271135+0000', 'last_undegraded': '2024-09-12T12:16:19.271135+0000', 'last_fullsized': '2024-09-12T12:16:19.271135+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.188 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2d is not active+clean 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.277093+0000', 'last_change': '2024-09-12T12:16:19.277093+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.277093+0000', 'last_undegraded': '2024-09-12T12:16:19.277093+0000', 'last_fullsized': '2024-09-12T12:16:19.277093+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2c is not active+clean 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.276494+0000', 'last_change': '2024-09-12T12:16:19.276494+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.276494+0000', 'last_undegraded': '2024-09-12T12:16:19.276494+0000', 'last_fullsized': '2024-09-12T12:16:19.276494+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2b is not active+clean 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.278101+0000', 'last_change': '2024-09-12T12:16:19.278101+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.278101+0000', 'last_undegraded': '2024-09-12T12:16:19.278101+0000', 'last_fullsized': '2024-09-12T12:16:19.278101+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2a is not active+clean 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.276151+0000', 'last_change': '2024-09-12T12:16:19.276151+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.276151+0000', 'last_undegraded': '2024-09-12T12:16:19.276151+0000', 'last_fullsized': '2024-09-12T12:16:19.276151+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:PG 10.29 is not active+clean 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.274929+0000', 'last_change': '2024-09-12T12:16:19.274929+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.274929+0000', 'last_undegraded': '2024-09-12T12:16:19.274929+0000', 'last_fullsized': '2024-09-12T12:16:19.274929+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:PG 10.28 is not active+clean 2024-09-12T12:16:25.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273995+0000', 'last_change': '2024-09-12T12:16:19.273995+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273995+0000', 'last_undegraded': '2024-09-12T12:16:19.273995+0000', 'last_fullsized': '2024-09-12T12:16:19.273995+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:PG 10.27 is not active+clean 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.278354+0000', 'last_change': '2024-09-12T12:16:19.278354+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.278354+0000', 'last_undegraded': '2024-09-12T12:16:19.278354+0000', 'last_fullsized': '2024-09-12T12:16:19.278354+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:PG 10.26 is not active+clean 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.279784+0000', 'last_change': '2024-09-12T12:16:19.279784+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.279784+0000', 'last_undegraded': '2024-09-12T12:16:19.279784+0000', 'last_fullsized': '2024-09-12T12:16:19.279784+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:PG 10.25 is not active+clean 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.270348+0000', 'last_change': '2024-09-12T12:16:19.270348+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.270348+0000', 'last_undegraded': '2024-09-12T12:16:19.270348+0000', 'last_fullsized': '2024-09-12T12:16:19.270348+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:PG 10.24 is not active+clean 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.282488+0000', 'last_change': '2024-09-12T12:16:19.282488+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.282488+0000', 'last_undegraded': '2024-09-12T12:16:19.282488+0000', 'last_fullsized': '2024-09-12T12:16:19.282488+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:PG 10.23 is not active+clean 2024-09-12T12:16:25.190 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273950+0000', 'last_change': '2024-09-12T12:16:19.273950+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273950+0000', 'last_undegraded': '2024-09-12T12:16:19.273950+0000', 'last_fullsized': '2024-09-12T12:16:19.273950+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:PG 10.22 is not active+clean 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.276828+0000', 'last_change': '2024-09-12T12:16:19.276828+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.276828+0000', 'last_undegraded': '2024-09-12T12:16:19.276828+0000', 'last_fullsized': '2024-09-12T12:16:19.276828+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:PG 10.21 is not active+clean 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.270413+0000', 'last_change': '2024-09-12T12:16:19.270413+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.270413+0000', 'last_undegraded': '2024-09-12T12:16:19.270413+0000', 'last_fullsized': '2024-09-12T12:16:19.270413+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:PG 10.20 is not active+clean 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.278567+0000', 'last_change': '2024-09-12T12:16:19.278567+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.278567+0000', 'last_undegraded': '2024-09-12T12:16:19.278567+0000', 'last_fullsized': '2024-09-12T12:16:19.278567+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273453+0000', 'last_change': '2024-09-12T12:16:19.273453+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273453+0000', 'last_undegraded': '2024-09-12T12:16:19.273453+0000', 'last_fullsized': '2024-09-12T12:16:19.273453+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.269831+0000', 'last_change': '2024-09-12T12:16:19.269831+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.269831+0000', 'last_undegraded': '2024-09-12T12:16:19.269831+0000', 'last_fullsized': '2024-09-12T12:16:19.269831+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.191 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1e is not active+clean 2024-09-12T12:16:25.192 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.277968+0000', 'last_change': '2024-09-12T12:16:19.277968+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.277968+0000', 'last_undegraded': '2024-09-12T12:16:19.277968+0000', 'last_fullsized': '2024-09-12T12:16:19.277968+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:16:25.192 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-09-12T12:16:25.192 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.274889+0000', 'last_change': '2024-09-12T12:16:19.274889+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.274889+0000', 'last_undegraded': '2024-09-12T12:16:19.274889+0000', 'last_fullsized': '2024-09-12T12:16:19.274889+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:16:25.192 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-09-12T12:16:25.192 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273413+0000', 'last_change': '2024-09-12T12:16:19.273413+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273413+0000', 'last_undegraded': '2024-09-12T12:16:19.273413+0000', 'last_fullsized': '2024-09-12T12:16:19.273413+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:16:25.192 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-09-12T12:16:25.192 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.280086+0000', 'last_change': '2024-09-12T12:16:19.280086+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.280086+0000', 'last_undegraded': '2024-09-12T12:16:19.280086+0000', 'last_fullsized': '2024-09-12T12:16:19.280086+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:16:25.192 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-09-12T12:16:25.192 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.276322+0000', 'last_change': '2024-09-12T12:16:19.276322+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.276322+0000', 'last_undegraded': '2024-09-12T12:16:19.276322+0000', 'last_fullsized': '2024-09-12T12:16:19.276322+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.275885+0000', 'last_change': '2024-09-12T12:16:19.275885+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.275885+0000', 'last_undegraded': '2024-09-12T12:16:19.275885+0000', 'last_fullsized': '2024-09-12T12:16:19.275885+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.281737+0000', 'last_change': '2024-09-12T12:16:19.281737+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.281737+0000', 'last_undegraded': '2024-09-12T12:16:19.281737+0000', 'last_fullsized': '2024-09-12T12:16:19.281737+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.277558+0000', 'last_change': '2024-09-12T12:16:19.277558+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.277558+0000', 'last_undegraded': '2024-09-12T12:16:19.277558+0000', 'last_fullsized': '2024-09-12T12:16:19.277558+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.272614+0000', 'last_change': '2024-09-12T12:16:19.272614+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.272614+0000', 'last_undegraded': '2024-09-12T12:16:19.272614+0000', 'last_fullsized': '2024-09-12T12:16:19.272614+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-09-12T12:16:25.193 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.269703+0000', 'last_change': '2024-09-12T12:16:19.269703+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.269703+0000', 'last_undegraded': '2024-09-12T12:16:19.269703+0000', 'last_fullsized': '2024-09-12T12:16:19.269703+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.269699+0000', 'last_change': '2024-09-12T12:16:19.269699+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.269699+0000', 'last_undegraded': '2024-09-12T12:16:19.269699+0000', 'last_fullsized': '2024-09-12T12:16:19.269699+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.275692+0000', 'last_change': '2024-09-12T12:16:19.275692+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.275692+0000', 'last_undegraded': '2024-09-12T12:16:19.275692+0000', 'last_fullsized': '2024-09-12T12:16:19.275692+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.272948+0000', 'last_change': '2024-09-12T12:16:19.272948+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.272948+0000', 'last_undegraded': '2024-09-12T12:16:19.272948+0000', 'last_fullsized': '2024-09-12T12:16:19.272948+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.280321+0000', 'last_change': '2024-09-12T12:16:19.280321+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.280321+0000', 'last_undegraded': '2024-09-12T12:16:19.280321+0000', 'last_fullsized': '2024-09-12T12:16:19.280321+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273745+0000', 'last_change': '2024-09-12T12:16:19.273745+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273745+0000', 'last_undegraded': '2024-09-12T12:16:19.273745+0000', 'last_fullsized': '2024-09-12T12:16:19.273745+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:16:25.194 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-09-12T12:16:25.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273187+0000', 'last_change': '2024-09-12T12:16:19.273187+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273187+0000', 'last_undegraded': '2024-09-12T12:16:19.273187+0000', 'last_fullsized': '2024-09-12T12:16:19.273187+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.195 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-09-12T12:16:25.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.270646+0000', 'last_change': '2024-09-12T12:16:19.270646+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.270646+0000', 'last_undegraded': '2024-09-12T12:16:19.270646+0000', 'last_fullsized': '2024-09-12T12:16:19.270646+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.195 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-09-12T12:16:25.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.275953+0000', 'last_change': '2024-09-12T12:16:19.275953+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.275953+0000', 'last_undegraded': '2024-09-12T12:16:19.275953+0000', 'last_fullsized': '2024-09-12T12:16:19.275953+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.195 INFO:tasks.ceph.ceph_manager.ceph:PG 10.8 is not active+clean 2024-09-12T12:16:25.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.278171+0000', 'last_change': '2024-09-12T12:16:19.278171+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.278171+0000', 'last_undegraded': '2024-09-12T12:16:19.278171+0000', 'last_fullsized': '2024-09-12T12:16:19.278171+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:16:25.195 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-12T12:16:25.195 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.275171+0000', 'last_change': '2024-09-12T12:16:19.275171+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.275171+0000', 'last_undegraded': '2024-09-12T12:16:19.275171+0000', 'last_fullsized': '2024-09-12T12:16:19.275171+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.196 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-09-12T12:16:25.196 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.272455+0000', 'last_change': '2024-09-12T12:16:19.272455+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.272455+0000', 'last_undegraded': '2024-09-12T12:16:19.272455+0000', 'last_fullsized': '2024-09-12T12:16:19.272455+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.196 INFO:tasks.ceph.ceph_manager.ceph:PG 10.4 is not active+clean 2024-09-12T12:16:25.196 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.277422+0000', 'last_change': '2024-09-12T12:16:19.277422+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.277422+0000', 'last_undegraded': '2024-09-12T12:16:19.277422+0000', 'last_fullsized': '2024-09-12T12:16:19.277422+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:16:25.196 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-09-12T12:16:25.196 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273776+0000', 'last_change': '2024-09-12T12:16:19.273776+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273776+0000', 'last_undegraded': '2024-09-12T12:16:19.273776+0000', 'last_fullsized': '2024-09-12T12:16:19.273776+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:16:25.197 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-12T12:16:25.197 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.277963+0000', 'last_change': '2024-09-12T12:16:19.277963+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.277963+0000', 'last_undegraded': '2024-09-12T12:16:19.277963+0000', 'last_fullsized': '2024-09-12T12:16:19.277963+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:16:25.197 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-09-12T12:16:25.197 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.272886+0000', 'last_change': '2024-09-12T12:16:19.272886+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.272886+0000', 'last_undegraded': '2024-09-12T12:16:19.272886+0000', 'last_fullsized': '2024-09-12T12:16:19.272886+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.197 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-09-12T12:16:25.197 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.272674+0000', 'last_change': '2024-09-12T12:16:19.272674+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.272674+0000', 'last_undegraded': '2024-09-12T12:16:19.272674+0000', 'last_fullsized': '2024-09-12T12:16:19.272674+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.197 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-09-12T12:16:25.198 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.269910+0000', 'last_change': '2024-09-12T12:16:19.269910+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.269910+0000', 'last_undegraded': '2024-09-12T12:16:19.269910+0000', 'last_fullsized': '2024-09-12T12:16:19.269910+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:16:25.198 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-09-12T12:16:25.198 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.280517+0000', 'last_change': '2024-09-12T12:16:19.280517+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.280517+0000', 'last_undegraded': '2024-09-12T12:16:19.280517+0000', 'last_fullsized': '2024-09-12T12:16:19.280517+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:16:25.198 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-09-12T12:16:25.198 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273343+0000', 'last_change': '2024-09-12T12:16:19.273343+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273343+0000', 'last_undegraded': '2024-09-12T12:16:19.273343+0000', 'last_fullsized': '2024-09-12T12:16:19.273343+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:16:25.198 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-09-12T12:16:25.198 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 63, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:16:19.273624+0000', 'last_change': '2024-09-12T12:16:19.273624+0000', 'last_active': '2024-09-12T12:16:19.263419+0000', 'last_peered': '2024-09-12T12:16:19.263419+0000', 'last_clean': '2024-09-12T12:16:19.263419+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:16:19.273624+0000', 'last_undegraded': '2024-09-12T12:16:19.273624+0000', 'last_fullsized': '2024-09-12T12:16:19.273624+0000', 'mapping_epoch': 63, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 63, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'last_clean_scrub_stamp': '2024-09-12T12:16:19.263419+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:16:25.199 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:16:25.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5f4a00640 1 Processor -- start 2024-09-12T12:16:25.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5f4a00640 1 -- start start 2024-09-12T12:16:25.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5f4a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 0x7fa5f00b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5f4a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f00af6f0 con 0x7fa5f006f0f0 2024-09-12T12:16:25.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5f4a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f00ae890 con 0x7fa5f00afad0 2024-09-12T12:16:25.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5f4a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f00aeb70 con 0x7fa5f0072f70 2024-09-12T12:16:25.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5ed400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa5f006f0f0 0x7fa5f015df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52632/0 (socket says 172.21.15.144:52632) 2024-09-12T12:16:25.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5ed400640 1 -- 172.21.15.144:0/2686364759 learned_addr learned my addr 172.21.15.144:0/2686364759 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:25.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5ede00640 1 --2- 172.21.15.144:0/2686364759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 0x7fa5f00b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5eca00640 1 -- 172.21.15.144:0/2686364759 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931514026 0 0) 0x7fa5f00af6f0 con 0x7fa5f006f0f0 2024-09-12T12:16:25.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5eca00640 1 -- 172.21.15.144:0/2686364759 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5d4003530 con 0x7fa5f006f0f0 2024-09-12T12:16:25.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5ede00640 1 -- 172.21.15.144:0/2686364759 >> v1:172.21.15.165:6789/0 conn(0x7fa5f00afad0 legacy=0x7fa5f0162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5eca00640 1 -- 172.21.15.144:0/2686364759 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494842885 0 0) 0x7fa5f00ae890 con 0x7fa5f00afad0 2024-09-12T12:16:25.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5ede00640 1 -- 172.21.15.144:0/2686364759 >> v1:172.21.15.144:6789/0 conn(0x7fa5f006f0f0 legacy=0x7fa5f015df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.359+0000 7fa5ede00640 1 -- 172.21.15.144:0/2686364759 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f00aee50 con 0x7fa5f0072f70 2024-09-12T12:16:25.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5ede00640 1 --2- 172.21.15.144:0/2686364759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 0x7fa5f00b51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009dc0 tx=0x7fa5e001c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a0e53a41d0f143 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5eca00640 1 -- 172.21.15.144:0/2686364759 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00b2070 con 0x7fa5f0072f70 2024-09-12T12:16:25.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5eca00640 1 -- 172.21.15.144:0/2686364759 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e00a5990 con 0x7fa5f0072f70 2024-09-12T12:16:25.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5eca00640 1 -- 172.21.15.144:0/2686364759 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00a5d60 con 0x7fa5f0072f70 2024-09-12T12:16:25.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5f4a00640 1 -- 172.21.15.144:0/2686364759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 msgr2=0x7fa5f00b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5f4a00640 1 --2- 172.21.15.144:0/2686364759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 0x7fa5f00b51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009dc0 tx=0x7fa5e001c8d0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5f4a00640 1 -- 172.21.15.144:0/2686364759 shutdown_connections 2024-09-12T12:16:25.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5f4a00640 1 --2- 172.21.15.144:0/2686364759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 0x7fa5f00b51b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5f4a00640 1 -- 172.21.15.144:0/2686364759 >> 172.21.15.144:0/2686364759 conn(0x7fa5f006cb50 msgr2=0x7fa5f006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5f4a00640 1 -- 172.21.15.144:0/2686364759 shutdown_connections 2024-09-12T12:16:25.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.363+0000 7fa5f4a00640 1 -- 172.21.15.144:0/2686364759 wait complete. 2024-09-12T12:16:25.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 Processor -- start 2024-09-12T12:16:25.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 -- start start 2024-09-12T12:16:25.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f006f0f0 0x7fa5f014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 0x7fa5f014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f00afad0 0x7fa5f014c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f0162cd0 con 0x7fa5f006f0f0 2024-09-12T12:16:25.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f0162b50 con 0x7fa5f00afad0 2024-09-12T12:16:25.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f0162e50 con 0x7fa5f0072f70 2024-09-12T12:16:25.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f006f0f0 0x7fa5f014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f006f0f0 0x7fa5f014c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47798/0 (socket says 172.21.15.144:47798) 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ede00640 1 -- 172.21.15.144:0/3699939497 learned_addr learned my addr 172.21.15.144:0/3699939497 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ed400640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 0x7fa5f014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ee800640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f00afad0 0x7fa5f014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ede00640 1 -- 172.21.15.144:0/3699939497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 msgr2=0x7fa5f014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ede00640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 0x7fa5f014fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ede00640 1 -- 172.21.15.144:0/3699939497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f00afad0 msgr2=0x7fa5f014c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ede00640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f00afad0 0x7fa5f014c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ede00640 1 -- 172.21.15.144:0/3699939497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f01600e0 con 0x7fa5f006f0f0 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5ede00640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f006f0f0 0x7fa5f014c780 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa5e001a500 tx=0x7fa5e0019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5e6000640 1 -- 172.21.15.144:0/3699939497 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00bd020 con 0x7fa5f006f0f0 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5e6000640 1 -- 172.21.15.144:0/3699939497 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e00b8670 con 0x7fa5f006f0f0 2024-09-12T12:16:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5e6000640 1 -- 172.21.15.144:0/3699939497 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00b2040 con 0x7fa5f006f0f0 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f01603c0 con 0x7fa5f006f0f0 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.367+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f014cd60 con 0x7fa5f006f0f0 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.371+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f00b51b0 con 0x7fa5f006f0f0 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.371+0000 7fa5e6000640 1 -- 172.21.15.144:0/3699939497 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5e00c0020 con 0x7fa5f006f0f0 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.371+0000 7fa5e6000640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5d00678c0 0x7fa5d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.371+0000 7fa5e6000640 1 -- 172.21.15.144:0/3699939497 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7fa5e0120dd0 con 0x7fa5f006f0f0 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.371+0000 7fa5ed400640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5d00678c0 0x7fa5d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.371+0000 7fa5ed400640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5d00678c0 0x7fa5d0069d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc007fd0 tx=0x7fa5dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.375+0000 7fa5e6000640 1 -- 172.21.15.144:0/3699939497 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa5e00c7030 con 0x7fa5f006f0f0 2024-09-12T12:16:25.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.595+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa5f0153600 con 0x7fa5f006f0f0 2024-09-12T12:16:25.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.595+0000 7fa5e6000640 1 -- 172.21.15.144:0/3699939497 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1624 (secure 0 0 0) 0x7fa5e0016580 con 0x7fa5f006f0f0 2024-09-12T12:16:25.598 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:25.599 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":245,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":65,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":301060096,"bytes_avail":772793053184,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":39,"btime":"2024-09-12T12:16:23:314428+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6192}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-12T12:16:07.418562+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:16:25.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5d00678c0 msgr2=0x7fa5d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5d00678c0 0x7fa5d0069d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc007fd0 tx=0x7fa5dc009040 comp rx=0 tx=0).stop 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f006f0f0 msgr2=0x7fa5f014c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f006f0f0 0x7fa5f014c780 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa5e001a500 tx=0x7fa5e0019670 comp rx=0 tx=0).stop 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 shutdown_connections 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5d00678c0 0x7fa5d0069d80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f00afad0 0x7fa5f014c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f0072f70 0x7fa5f014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 --2- 172.21.15.144:0/3699939497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f006f0f0 0x7fa5f014c780 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 >> 172.21.15.144:0/3699939497 conn(0x7fa5f006cb50 msgr2=0x7fa5f0162440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 shutdown_connections 2024-09-12T12:16:25.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.599+0000 7fa5f4a00640 1 -- 172.21.15.144:0/3699939497 wait complete. 2024-09-12T12:16:25.620 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T12:16:25.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:16:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb22dc00640 1 Processor -- start 2024-09-12T12:16:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb22dc00640 1 -- start start 2024-09-12T12:16:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb22dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb22815c220 0x7fb2280d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb22dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b6730 0x7fb2280b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb22dc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2280d1580 con 0x7fb2280b4200 2024-09-12T12:16:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb22dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb2280b4bb0 con 0x7fb22815c220 2024-09-12T12:16:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb22dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb2280d1860 con 0x7fb2280b6730 2024-09-12T12:16:25.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb226a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb22815c220 0x7fb2280d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb227400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b6730 0x7fb2280b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb226a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb22815c220 0x7fb2280d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:54848/0 (socket says 172.21.15.144:54848) 2024-09-12T12:16:25.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb226a00640 1 -- 172.21.15.144:0/2843108501 learned_addr learned my addr 172.21.15.144:0/2843108501 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:25.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb226a00640 1 -- 172.21.15.144:0/2843108501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b6730 msgr2=0x7fb2280b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:25.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb226a00640 1 --2- 172.21.15.144:0/2843108501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b6730 0x7fb2280b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb226a00640 1 -- 172.21.15.144:0/2843108501 >> v1:172.21.15.165:6789/0 conn(0x7fb2280b4200 legacy=0x7fb2280732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.755+0000 7fb226a00640 1 -- 172.21.15.144:0/2843108501 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2280d1b40 con 0x7fb22815c220 2024-09-12T12:16:25.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb226a00640 1 --2- 172.21.15.144:0/2843108501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22815c220 0x7fb2280d0c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb218009870 tx=0x7fb21801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da8df802d2f6aa8a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb225600640 1 -- 172.21.15.144:0/2843108501 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2180ab450 con 0x7fb22815c220 2024-09-12T12:16:25.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb225600640 1 -- 172.21.15.144:0/2843108501 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2180b0070 con 0x7fb22815c220 2024-09-12T12:16:25.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb225600640 1 -- 172.21.15.144:0/2843108501 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2180ab810 con 0x7fb22815c220 2024-09-12T12:16:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb22dc00640 1 -- 172.21.15.144:0/2843108501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22815c220 msgr2=0x7fb2280d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb22dc00640 1 --2- 172.21.15.144:0/2843108501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22815c220 0x7fb2280d0c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb218009870 tx=0x7fb21801c530 comp rx=0 tx=0).stop 2024-09-12T12:16:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb22dc00640 1 -- 172.21.15.144:0/2843108501 shutdown_connections 2024-09-12T12:16:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb22dc00640 1 --2- 172.21.15.144:0/2843108501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b6730 0x7fb2280b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb22dc00640 1 --2- 172.21.15.144:0/2843108501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22815c220 0x7fb2280d0c10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb22dc00640 1 -- 172.21.15.144:0/2843108501 >> 172.21.15.144:0/2843108501 conn(0x7fb22806f400 msgr2=0x7fb22806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb22dc00640 1 -- 172.21.15.144:0/2843108501 shutdown_connections 2024-09-12T12:16:25.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.759+0000 7fb22dc00640 1 -- 172.21.15.144:0/2843108501 wait complete. 2024-09-12T12:16:25.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 Processor -- start 2024-09-12T12:16:25.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 -- start start 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b4200 0x7fb2280ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2280b6730 0x7fb228154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22815c220 0x7fb2281554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280d12d0 con 0x7fb2280b6730 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb2280d1150 con 0x7fb22815c220 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb228070bf0 con 0x7fb2280b4200 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2280b6730 0x7fb228154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2280b6730 0x7fb228154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47804/0 (socket says 172.21.15.144:47804) 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226000640 1 -- 172.21.15.144:0/3482970243 learned_addr learned my addr 172.21.15.144:0/3482970243 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226a00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b4200 0x7fb2280ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb227400640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22815c220 0x7fb2281554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226000640 1 -- 172.21.15.144:0/3482970243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b4200 msgr2=0x7fb2280ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226000640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b4200 0x7fb2280ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226000640 1 -- 172.21.15.144:0/3482970243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22815c220 msgr2=0x7fb2281554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226000640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22815c220 0x7fb2281554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226000640 1 -- 172.21.15.144:0/3482970243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2280b0340 con 0x7fb2280b6730 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb226000640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2280b6730 0x7fb228154fa0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb21400c420 tx=0x7fb21400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb21ea00640 1 -- 172.21.15.144:0/3482970243 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2140052d0 con 0x7fb2280b6730 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb21ea00640 1 -- 172.21.15.144:0/3482970243 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb214005470 con 0x7fb2280b6730 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2280b0620 con 0x7fb2280b6730 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb21ea00640 1 -- 172.21.15.144:0/3482970243 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214007260 con 0x7fb2280b6730 2024-09-12T12:16:25.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2280aaba0 con 0x7fb2280b6730 2024-09-12T12:16:25.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.763+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2280b4670 con 0x7fb2280b6730 2024-09-12T12:16:25.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.767+0000 7fb21ea00640 1 -- 172.21.15.144:0/3482970243 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb214007400 con 0x7fb2280b6730 2024-09-12T12:16:25.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.767+0000 7fb21ea00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb2080678c0 0x7fb208069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.767+0000 7fb21ea00640 1 -- 172.21.15.144:0/3482970243 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6101+0+0 (secure 0 0 0) 0x7fb2140852f0 con 0x7fb2280b6730 2024-09-12T12:16:25.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.767+0000 7fb226a00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb2080678c0 0x7fb208069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.767+0000 7fb226a00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb2080678c0 0x7fb208069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb2180af000 tx=0x7fb2180a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.771+0000 7fb21ea00640 1 -- 172.21.15.144:0/3482970243 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb2140555b0 con 0x7fb2280b6730 2024-09-12T12:16:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.927+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2280b0b40 con 0x7fb2080678c0 2024-09-12T12:16:25.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.935+0000 7fb21ea00640 1 -- 172.21.15.144:0/3482970243 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252020 (secure 0 0 0) 0x7fb2280b0b40 con 0x7fb2080678c0 2024-09-12T12:16:25.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:16:25.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb2080678c0 msgr2=0x7fb208069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb2080678c0 0x7fb208069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb2180af000 tx=0x7fb2180a7000 comp rx=0 tx=0).stop 2024-09-12T12:16:25.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2280b6730 msgr2=0x7fb228154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2280b6730 0x7fb228154fa0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb21400c420 tx=0x7fb21400c8e0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 shutdown_connections 2024-09-12T12:16:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb2080678c0 0x7fb208069d80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22815c220 0x7fb2281554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2280b6730 0x7fb228154fa0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 --2- 172.21.15.144:0/3482970243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb2280b4200 0x7fb2280ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 >> 172.21.15.144:0/3482970243 conn(0x7fb22806f400 msgr2=0x7fb22815f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 shutdown_connections 2024-09-12T12:16:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:25.939+0000 7fb22dc00640 1 -- 172.21.15.144:0/3482970243 wait complete. 2024-09-12T12:16:25.959 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-12T12:16:25.421649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294352,"kb_used_data":7368,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680368,"statfs":{"total":773094113280,"available":772792696832,"internally_reserved":0,"allocated":7544832,"data_stored":4031044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.152629"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.335005+0000","last_change":"2024-09-12T12:16:20.310027+0000","last_active":"2024-09-12T12:16:21.335005+0000","last_peered":"2024-09-12T12:16:21.335005+0000","last_clean":"2024-09-12T12:16:21.335005+0000","last_became_active":"2024-09-12T12:16:20.308254+0000","last_became_peered":"2024-09-12T12:16:20.308254+0000","last_unstale":"2024-09-12T12:16:21.335005+0000","last_undegraded":"2024-09-12T12:16:21.335005+0000","last_fullsized":"2024-09-12T12:16:21.335005+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:07.167204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334858+0000","last_change":"2024-09-12T12:16:20.303599+0000","last_active":"2024-09-12T12:16:21.334858+0000","last_peered":"2024-09-12T12:16:21.334858+0000","last_clean":"2024-09-12T12:16:21.334858+0000","last_became_active":"2024-09-12T12:16:20.303287+0000","last_became_peered":"2024-09-12T12:16:20.303287+0000","last_unstale":"2024-09-12T12:16:21.334858+0000","last_undegraded":"2024-09-12T12:16:21.334858+0000","last_fullsized":"2024-09-12T12:16:21.334858+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:25.506011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333488+0000","last_change":"2024-09-12T12:16:20.317282+0000","last_active":"2024-09-12T12:16:21.333488+0000","last_peered":"2024-09-12T12:16:21.333488+0000","last_clean":"2024-09-12T12:16:21.333488+0000","last_became_active":"2024-09-12T12:16:20.316591+0000","last_became_peered":"2024-09-12T12:16:20.316591+0000","last_unstale":"2024-09-12T12:16:21.333488+0000","last_undegraded":"2024-09-12T12:16:21.333488+0000","last_fullsized":"2024-09-12T12:16:21.333488+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:41.675078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305475+0000","last_change":"2024-09-12T12:16:20.306866+0000","last_active":"2024-09-12T12:16:21.305475+0000","last_peered":"2024-09-12T12:16:21.305475+0000","last_clean":"2024-09-12T12:16:21.305475+0000","last_became_active":"2024-09-12T12:16:20.303224+0000","last_became_peered":"2024-09-12T12:16:20.303224+0000","last_unstale":"2024-09-12T12:16:21.305475+0000","last_undegraded":"2024-09-12T12:16:21.305475+0000","last_fullsized":"2024-09-12T12:16:21.305475+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:15.182116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304877+0000","last_change":"2024-09-12T12:16:20.295505+0000","last_active":"2024-09-12T12:16:21.304877+0000","last_peered":"2024-09-12T12:16:21.304877+0000","last_clean":"2024-09-12T12:16:21.304877+0000","last_became_active":"2024-09-12T12:16:20.293621+0000","last_became_peered":"2024-09-12T12:16:20.293621+0000","last_unstale":"2024-09-12T12:16:21.304877+0000","last_undegraded":"2024-09-12T12:16:21.304877+0000","last_fullsized":"2024-09-12T12:16:21.304877+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:50.058156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302301+0000","last_change":"2024-09-12T12:16:20.321901+0000","last_active":"2024-09-12T12:16:21.302301+0000","last_peered":"2024-09-12T12:16:21.302301+0000","last_clean":"2024-09-12T12:16:21.302301+0000","last_became_active":"2024-09-12T12:16:20.321649+0000","last_became_peered":"2024-09-12T12:16:20.321649+0000","last_unstale":"2024-09-12T12:16:21.302301+0000","last_undegraded":"2024-09-12T12:16:21.302301+0000","last_fullsized":"2024-09-12T12:16:21.302301+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:33.516112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333421+0000","last_change":"2024-09-12T12:16:20.319979+0000","last_active":"2024-09-12T12:16:21.333421+0000","last_peered":"2024-09-12T12:16:21.333421+0000","last_clean":"2024-09-12T12:16:21.333421+0000","last_became_active":"2024-09-12T12:16:20.319502+0000","last_became_peered":"2024-09-12T12:16:20.319502+0000","last_unstale":"2024-09-12T12:16:21.333421+0000","last_undegraded":"2024-09-12T12:16:21.333421+0000","last_fullsized":"2024-09-12T12:16:21.333421+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:26.505428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332542+0000","last_change":"2024-09-12T12:16:20.316918+0000","last_active":"2024-09-12T12:16:21.332542+0000","last_peered":"2024-09-12T12:16:21.332542+0000","last_clean":"2024-09-12T12:16:21.332542+0000","last_became_active":"2024-09-12T12:16:20.315473+0000","last_became_peered":"2024-09-12T12:16:20.315473+0000","last_unstale":"2024-09-12T12:16:21.332542+0000","last_undegraded":"2024-09-12T12:16:21.332542+0000","last_fullsized":"2024-09-12T12:16:21.332542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:02.259727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333865+0000","last_change":"2024-09-12T12:16:20.323791+0000","last_active":"2024-09-12T12:16:21.333865+0000","last_peered":"2024-09-12T12:16:21.333865+0000","last_clean":"2024-09-12T12:16:21.333865+0000","last_became_active":"2024-09-12T12:16:20.323524+0000","last_became_peered":"2024-09-12T12:16:20.323524+0000","last_unstale":"2024-09-12T12:16:21.333865+0000","last_undegraded":"2024-09-12T12:16:21.333865+0000","last_fullsized":"2024-09-12T12:16:21.333865+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.469814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333714+0000","last_change":"2024-09-12T12:16:20.321084+0000","last_active":"2024-09-12T12:16:21.333714+0000","last_peered":"2024-09-12T12:16:21.333714+0000","last_clean":"2024-09-12T12:16:21.333714+0000","last_became_active":"2024-09-12T12:16:20.318390+0000","last_became_peered":"2024-09-12T12:16:20.318390+0000","last_unstale":"2024-09-12T12:16:21.333714+0000","last_undegraded":"2024-09-12T12:16:21.333714+0000","last_fullsized":"2024-09-12T12:16:21.333714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:32.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305386+0000","last_change":"2024-09-12T12:16:20.301277+0000","last_active":"2024-09-12T12:16:21.305386+0000","last_peered":"2024-09-12T12:16:21.305386+0000","last_clean":"2024-09-12T12:16:21.305386+0000","last_became_active":"2024-09-12T12:16:20.296837+0000","last_became_peered":"2024-09-12T12:16:20.296837+0000","last_unstale":"2024-09-12T12:16:21.305386+0000","last_undegraded":"2024-09-12T12:16:21.305386+0000","last_fullsized":"2024-09-12T12:16:21.305386+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:24.929384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332756+0000","last_change":"2024-09-12T12:16:20.315977+0000","last_active":"2024-09-12T12:16:21.332756+0000","last_peered":"2024-09-12T12:16:21.332756+0000","last_clean":"2024-09-12T12:16:21.332756+0000","last_became_active":"2024-09-12T12:16:20.315766+0000","last_became_peered":"2024-09-12T12:16:20.315766+0000","last_unstale":"2024-09-12T12:16:21.332756+0000","last_undegraded":"2024-09-12T12:16:21.332756+0000","last_fullsized":"2024-09-12T12:16:21.332756+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:28.662461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332965+0000","last_change":"2024-09-12T12:16:20.307040+0000","last_active":"2024-09-12T12:16:21.332965+0000","last_peered":"2024-09-12T12:16:21.332965+0000","last_clean":"2024-09-12T12:16:21.332965+0000","last_became_active":"2024-09-12T12:16:20.306760+0000","last_became_peered":"2024-09-12T12:16:20.306760+0000","last_unstale":"2024-09-12T12:16:21.332965+0000","last_undegraded":"2024-09-12T12:16:21.332965+0000","last_fullsized":"2024-09-12T12:16:21.332965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:53.460435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332889+0000","last_change":"2024-09-12T12:16:20.318211+0000","last_active":"2024-09-12T12:16:21.332889+0000","last_peered":"2024-09-12T12:16:21.332889+0000","last_clean":"2024-09-12T12:16:21.332889+0000","last_became_active":"2024-09-12T12:16:20.317956+0000","last_became_peered":"2024-09-12T12:16:20.317956+0000","last_unstale":"2024-09-12T12:16:21.332889+0000","last_undegraded":"2024-09-12T12:16:21.332889+0000","last_fullsized":"2024-09-12T12:16:21.332889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.995518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332976+0000","last_change":"2024-09-12T12:16:20.317519+0000","last_active":"2024-09-12T12:16:21.332976+0000","last_peered":"2024-09-12T12:16:21.332976+0000","last_clean":"2024-09-12T12:16:21.332976+0000","last_became_active":"2024-09-12T12:16:20.317271+0000","last_became_peered":"2024-09-12T12:16:20.317271+0000","last_unstale":"2024-09-12T12:16:21.332976+0000","last_undegraded":"2024-09-12T12:16:21.332976+0000","last_fullsized":"2024-09-12T12:16:21.332976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:39.669084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333365+0000","last_change":"2024-09-12T12:16:20.305205+0000","last_active":"2024-09-12T12:16:21.333365+0000","last_peered":"2024-09-12T12:16:21.333365+0000","last_clean":"2024-09-12T12:16:21.333365+0000","last_became_active":"2024-09-12T12:16:20.304958+0000","last_became_peered":"2024-09-12T12:16:20.304958+0000","last_unstale":"2024-09-12T12:16:21.333365+0000","last_undegraded":"2024-09-12T12:16:21.333365+0000","last_fullsized":"2024-09-12T12:16:21.333365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:28.576261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334998+0000","last_change":"2024-09-12T12:16:20.310044+0000","last_active":"2024-09-12T12:16:21.334998+0000","last_peered":"2024-09-12T12:16:21.334998+0000","last_clean":"2024-09-12T12:16:21.334998+0000","last_became_active":"2024-09-12T12:16:20.307892+0000","last_became_peered":"2024-09-12T12:16:20.307892+0000","last_unstale":"2024-09-12T12:16:21.334998+0000","last_undegraded":"2024-09-12T12:16:21.334998+0000","last_fullsized":"2024-09-12T12:16:21.334998+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.045913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305890+0000","last_change":"2024-09-12T12:16:20.305852+0000","last_active":"2024-09-12T12:16:21.305890+0000","last_peered":"2024-09-12T12:16:21.305890+0000","last_clean":"2024-09-12T12:16:21.305890+0000","last_became_active":"2024-09-12T12:16:20.305604+0000","last_became_peered":"2024-09-12T12:16:20.305604+0000","last_unstale":"2024-09-12T12:16:21.305890+0000","last_undegraded":"2024-09-12T12:16:21.305890+0000","last_fullsized":"2024-09-12T12:16:21.305890+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:43.637160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305429+0000","last_change":"2024-09-12T12:16:20.302076+0000","last_active":"2024-09-12T12:16:21.305429+0000","last_peered":"2024-09-12T12:16:21.305429+0000","last_clean":"2024-09-12T12:16:21.305429+0000","last_became_active":"2024-09-12T12:16:20.301817+0000","last_became_peered":"2024-09-12T12:16:20.301817+0000","last_unstale":"2024-09-12T12:16:21.305429+0000","last_undegraded":"2024-09-12T12:16:21.305429+0000","last_fullsized":"2024-09-12T12:16:21.305429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:24.422064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333810+0000","last_change":"2024-09-12T12:16:20.293969+0000","last_active":"2024-09-12T12:16:21.333810+0000","last_peered":"2024-09-12T12:16:21.333810+0000","last_clean":"2024-09-12T12:16:21.333810+0000","last_became_active":"2024-09-12T12:16:20.293690+0000","last_became_peered":"2024-09-12T12:16:20.293690+0000","last_unstale":"2024-09-12T12:16:21.333810+0000","last_undegraded":"2024-09-12T12:16:21.333810+0000","last_fullsized":"2024-09-12T12:16:21.333810+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:48.095717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333121+0000","last_change":"2024-09-12T12:16:20.306496+0000","last_active":"2024-09-12T12:16:21.333121+0000","last_peered":"2024-09-12T12:16:21.333121+0000","last_clean":"2024-09-12T12:16:21.333121+0000","last_became_active":"2024-09-12T12:16:20.306202+0000","last_became_peered":"2024-09-12T12:16:20.306202+0000","last_unstale":"2024-09-12T12:16:21.333121+0000","last_undegraded":"2024-09-12T12:16:21.333121+0000","last_fullsized":"2024-09-12T12:16:21.333121+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:39.669084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333637+0000","last_change":"2024-09-12T12:16:20.320098+0000","last_active":"2024-09-12T12:16:21.333637+0000","last_peered":"2024-09-12T12:16:21.333637+0000","last_clean":"2024-09-12T12:16:21.333637+0000","last_became_active":"2024-09-12T12:16:20.319837+0000","last_became_peered":"2024-09-12T12:16:20.319837+0000","last_unstale":"2024-09-12T12:16:21.333637+0000","last_undegraded":"2024-09-12T12:16:21.333637+0000","last_fullsized":"2024-09-12T12:16:21.333637+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:13.317753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333329+0000","last_change":"2024-09-12T12:16:20.319730+0000","last_active":"2024-09-12T12:16:21.333329+0000","last_peered":"2024-09-12T12:16:21.333329+0000","last_clean":"2024-09-12T12:16:21.333329+0000","last_became_active":"2024-09-12T12:16:20.319440+0000","last_became_peered":"2024-09-12T12:16:20.319440+0000","last_unstale":"2024-09-12T12:16:21.333329+0000","last_undegraded":"2024-09-12T12:16:21.333329+0000","last_fullsized":"2024-09-12T12:16:21.333329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:25.373924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332532+0000","last_change":"2024-09-12T12:16:20.316998+0000","last_active":"2024-09-12T12:16:21.332532+0000","last_peered":"2024-09-12T12:16:21.332532+0000","last_clean":"2024-09-12T12:16:21.332532+0000","last_became_active":"2024-09-12T12:16:20.315759+0000","last_became_peered":"2024-09-12T12:16:20.315759+0000","last_unstale":"2024-09-12T12:16:21.332532+0000","last_undegraded":"2024-09-12T12:16:21.332532+0000","last_fullsized":"2024-09-12T12:16:21.332532+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:34.003140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332991+0000","last_change":"2024-09-12T12:16:20.308330+0000","last_active":"2024-09-12T12:16:21.332991+0000","last_peered":"2024-09-12T12:16:21.332991+0000","last_clean":"2024-09-12T12:16:21.332991+0000","last_became_active":"2024-09-12T12:16:20.308034+0000","last_became_peered":"2024-09-12T12:16:20.308034+0000","last_unstale":"2024-09-12T12:16:21.332991+0000","last_undegraded":"2024-09-12T12:16:21.332991+0000","last_fullsized":"2024-09-12T12:16:21.332991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.995518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333268+0000","last_change":"2024-09-12T12:16:20.301302+0000","last_active":"2024-09-12T12:16:21.333268+0000","last_peered":"2024-09-12T12:16:21.333268+0000","last_clean":"2024-09-12T12:16:21.333268+0000","last_became_active":"2024-09-12T12:16:20.300988+0000","last_became_peered":"2024-09-12T12:16:20.300988+0000","last_unstale":"2024-09-12T12:16:21.333268+0000","last_undegraded":"2024-09-12T12:16:21.333268+0000","last_fullsized":"2024-09-12T12:16:21.333268+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:49.379152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305553+0000","last_change":"2024-09-12T12:16:20.301860+0000","last_active":"2024-09-12T12:16:21.305553+0000","last_peered":"2024-09-12T12:16:21.305553+0000","last_clean":"2024-09-12T12:16:21.305553+0000","last_became_active":"2024-09-12T12:16:20.301611+0000","last_became_peered":"2024-09-12T12:16:20.301611+0000","last_unstale":"2024-09-12T12:16:21.305553+0000","last_undegraded":"2024-09-12T12:16:21.305553+0000","last_fullsized":"2024-09-12T12:16:21.305553+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:05.943000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334552+0000","last_change":"2024-09-12T12:16:20.309620+0000","last_active":"2024-09-12T12:16:21.334552+0000","last_peered":"2024-09-12T12:16:21.334552+0000","last_clean":"2024-09-12T12:16:21.334552+0000","last_became_active":"2024-09-12T12:16:20.309239+0000","last_became_peered":"2024-09-12T12:16:20.309239+0000","last_unstale":"2024-09-12T12:16:21.334552+0000","last_undegraded":"2024-09-12T12:16:21.334552+0000","last_fullsized":"2024-09-12T12:16:21.334552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:51.925913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332870+0000","last_change":"2024-09-12T12:16:20.321856+0000","last_active":"2024-09-12T12:16:21.332870+0000","last_peered":"2024-09-12T12:16:21.332870+0000","last_clean":"2024-09-12T12:16:21.332870+0000","last_became_active":"2024-09-12T12:16:20.318416+0000","last_became_peered":"2024-09-12T12:16:20.318416+0000","last_unstale":"2024-09-12T12:16:21.332870+0000","last_undegraded":"2024-09-12T12:16:21.332870+0000","last_fullsized":"2024-09-12T12:16:21.332870+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:53.460435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333418+0000","last_change":"2024-09-12T12:16:20.321084+0000","last_active":"2024-09-12T12:16:21.333418+0000","last_peered":"2024-09-12T12:16:21.333418+0000","last_clean":"2024-09-12T12:16:21.333418+0000","last_became_active":"2024-09-12T12:16:20.320750+0000","last_became_peered":"2024-09-12T12:16:20.320750+0000","last_unstale":"2024-09-12T12:16:21.333418+0000","last_undegraded":"2024-09-12T12:16:21.333418+0000","last_fullsized":"2024-09-12T12:16:21.333418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:32.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304542+0000","last_change":"2024-09-12T12:16:20.301081+0000","last_active":"2024-09-12T12:16:21.304542+0000","last_peered":"2024-09-12T12:16:21.304542+0000","last_clean":"2024-09-12T12:16:21.304542+0000","last_became_active":"2024-09-12T12:16:20.300822+0000","last_became_peered":"2024-09-12T12:16:20.300822+0000","last_unstale":"2024-09-12T12:16:21.304542+0000","last_undegraded":"2024-09-12T12:16:21.304542+0000","last_fullsized":"2024-09-12T12:16:21.304542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:10.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.301942+0000","last_change":"2024-09-12T12:16:20.301489+0000","last_active":"2024-09-12T12:16:21.301942+0000","last_peered":"2024-09-12T12:16:21.301942+0000","last_clean":"2024-09-12T12:16:21.301942+0000","last_became_active":"2024-09-12T12:16:20.300839+0000","last_became_peered":"2024-09-12T12:16:20.300839+0000","last_unstale":"2024-09-12T12:16:21.301942+0000","last_undegraded":"2024-09-12T12:16:21.301942+0000","last_fullsized":"2024-09-12T12:16:21.301942+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:32.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305153+0000","last_change":"2024-09-12T12:16:20.307368+0000","last_active":"2024-09-12T12:16:21.305153+0000","last_peered":"2024-09-12T12:16:21.305153+0000","last_clean":"2024-09-12T12:16:21.305153+0000","last_became_active":"2024-09-12T12:16:20.307049+0000","last_became_peered":"2024-09-12T12:16:20.307049+0000","last_unstale":"2024-09-12T12:16:21.305153+0000","last_undegraded":"2024-09-12T12:16:21.305153+0000","last_fullsized":"2024-09-12T12:16:21.305153+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:42.984541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.335048+0000","last_change":"2024-09-12T12:16:19.292137+0000","last_active":"2024-09-12T12:16:21.335048+0000","last_peered":"2024-09-12T12:16:21.335048+0000","last_clean":"2024-09-12T12:16:21.335048+0000","last_became_active":"2024-09-12T12:16:19.291503+0000","last_became_peered":"2024-09-12T12:16:19.291503+0000","last_unstale":"2024-09-12T12:16:21.335048+0000","last_undegraded":"2024-09-12T12:16:21.335048+0000","last_fullsized":"2024-09-12T12:16:21.335048+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:04.936869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305729+0000","last_change":"2024-09-12T12:16:20.307787+0000","last_active":"2024-09-12T12:16:21.305729+0000","last_peered":"2024-09-12T12:16:21.305729+0000","last_clean":"2024-09-12T12:16:21.305729+0000","last_became_active":"2024-09-12T12:16:20.307479+0000","last_became_peered":"2024-09-12T12:16:20.307479+0000","last_unstale":"2024-09-12T12:16:21.305729+0000","last_undegraded":"2024-09-12T12:16:21.305729+0000","last_fullsized":"2024-09-12T12:16:21.305729+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:11.789454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302502+0000","last_change":"2024-09-12T12:16:19.290400+0000","last_active":"2024-09-12T12:16:21.302502+0000","last_peered":"2024-09-12T12:16:21.302502+0000","last_clean":"2024-09-12T12:16:21.302502+0000","last_became_active":"2024-09-12T12:16:19.290156+0000","last_became_peered":"2024-09-12T12:16:19.290156+0000","last_unstale":"2024-09-12T12:16:21.302502+0000","last_undegraded":"2024-09-12T12:16:21.302502+0000","last_fullsized":"2024-09-12T12:16:21.302502+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:27.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302473+0000","last_change":"2024-09-12T12:16:20.301282+0000","last_active":"2024-09-12T12:16:21.302473+0000","last_peered":"2024-09-12T12:16:21.302473+0000","last_clean":"2024-09-12T12:16:21.302473+0000","last_became_active":"2024-09-12T12:16:20.301021+0000","last_became_peered":"2024-09-12T12:16:20.301021+0000","last_unstale":"2024-09-12T12:16:21.302473+0000","last_undegraded":"2024-09-12T12:16:21.302473+0000","last_fullsized":"2024-09-12T12:16:21.302473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.469814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302348+0000","last_change":"2024-09-12T12:16:19.287826+0000","last_active":"2024-09-12T12:16:21.302348+0000","last_peered":"2024-09-12T12:16:21.302348+0000","last_clean":"2024-09-12T12:16:21.302348+0000","last_became_active":"2024-09-12T12:16:19.287566+0000","last_became_peered":"2024-09-12T12:16:19.287566+0000","last_unstale":"2024-09-12T12:16:21.302348+0000","last_undegraded":"2024-09-12T12:16:21.302348+0000","last_fullsized":"2024-09-12T12:16:21.302348+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:41.880340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333771+0000","last_change":"2024-09-12T12:16:20.321875+0000","last_active":"2024-09-12T12:16:21.333771+0000","last_peered":"2024-09-12T12:16:21.333771+0000","last_clean":"2024-09-12T12:16:21.333771+0000","last_became_active":"2024-09-12T12:16:20.318381+0000","last_became_peered":"2024-09-12T12:16:20.318381+0000","last_unstale":"2024-09-12T12:16:21.333771+0000","last_undegraded":"2024-09-12T12:16:21.333771+0000","last_fullsized":"2024-09-12T12:16:21.333771+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:13.752872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302337+0000","last_change":"2024-09-12T12:16:19.293865+0000","last_active":"2024-09-12T12:16:21.302337+0000","last_peered":"2024-09-12T12:16:21.302337+0000","last_clean":"2024-09-12T12:16:21.302337+0000","last_became_active":"2024-09-12T12:16:19.293483+0000","last_became_peered":"2024-09-12T12:16:19.293483+0000","last_unstale":"2024-09-12T12:16:21.302337+0000","last_undegraded":"2024-09-12T12:16:21.302337+0000","last_fullsized":"2024-09-12T12:16:21.302337+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:01.253597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333742+0000","last_change":"2024-09-12T12:16:20.305632+0000","last_active":"2024-09-12T12:16:21.333742+0000","last_peered":"2024-09-12T12:16:21.333742+0000","last_clean":"2024-09-12T12:16:21.333742+0000","last_became_active":"2024-09-12T12:16:20.302535+0000","last_became_peered":"2024-09-12T12:16:20.302535+0000","last_unstale":"2024-09-12T12:16:21.333742+0000","last_undegraded":"2024-09-12T12:16:21.333742+0000","last_fullsized":"2024-09-12T12:16:21.333742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:39.700162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333718+0000","last_change":"2024-09-12T12:16:19.287050+0000","last_active":"2024-09-12T12:16:21.333718+0000","last_peered":"2024-09-12T12:16:21.333718+0000","last_clean":"2024-09-12T12:16:21.333718+0000","last_became_active":"2024-09-12T12:16:19.285906+0000","last_became_peered":"2024-09-12T12:16:19.285906+0000","last_unstale":"2024-09-12T12:16:21.333718+0000","last_undegraded":"2024-09-12T12:16:21.333718+0000","last_fullsized":"2024-09-12T12:16:21.333718+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:31.188968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334366+0000","last_change":"2024-09-12T12:16:20.300551+0000","last_active":"2024-09-12T12:16:21.334366+0000","last_peered":"2024-09-12T12:16:21.334366+0000","last_clean":"2024-09-12T12:16:21.334366+0000","last_became_active":"2024-09-12T12:16:20.300000+0000","last_became_peered":"2024-09-12T12:16:20.300000+0000","last_unstale":"2024-09-12T12:16:21.334366+0000","last_undegraded":"2024-09-12T12:16:21.334366+0000","last_fullsized":"2024-09-12T12:16:21.334366+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:24.422064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333489+0000","last_change":"2024-09-12T12:16:19.284576+0000","last_active":"2024-09-12T12:16:21.333489+0000","last_peered":"2024-09-12T12:16:21.333489+0000","last_clean":"2024-09-12T12:16:21.333489+0000","last_became_active":"2024-09-12T12:16:19.284314+0000","last_became_peered":"2024-09-12T12:16:19.284314+0000","last_unstale":"2024-09-12T12:16:21.333489+0000","last_undegraded":"2024-09-12T12:16:21.333489+0000","last_fullsized":"2024-09-12T12:16:21.333489+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.373021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304718+0000","last_change":"2024-09-12T12:16:20.293668+0000","last_active":"2024-09-12T12:16:21.304718+0000","last_peered":"2024-09-12T12:16:21.304718+0000","last_clean":"2024-09-12T12:16:21.304718+0000","last_became_active":"2024-09-12T12:16:20.293383+0000","last_became_peered":"2024-09-12T12:16:20.293383+0000","last_unstale":"2024-09-12T12:16:21.304718+0000","last_undegraded":"2024-09-12T12:16:21.304718+0000","last_fullsized":"2024-09-12T12:16:21.304718+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:56.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333423+0000","last_change":"2024-09-12T12:16:19.286530+0000","last_active":"2024-09-12T12:16:21.333423+0000","last_peered":"2024-09-12T12:16:21.333423+0000","last_clean":"2024-09-12T12:16:21.333423+0000","last_became_active":"2024-09-12T12:16:19.285761+0000","last_became_peered":"2024-09-12T12:16:19.285761+0000","last_unstale":"2024-09-12T12:16:21.333423+0000","last_undegraded":"2024-09-12T12:16:21.333423+0000","last_fullsized":"2024-09-12T12:16:21.333423+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:38.662954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333590+0000","last_change":"2024-09-12T12:16:20.294267+0000","last_active":"2024-09-12T12:16:21.333590+0000","last_peered":"2024-09-12T12:16:21.333590+0000","last_clean":"2024-09-12T12:16:21.333590+0000","last_became_active":"2024-09-12T12:16:20.293981+0000","last_became_peered":"2024-09-12T12:16:20.293981+0000","last_unstale":"2024-09-12T12:16:21.333590+0000","last_undegraded":"2024-09-12T12:16:21.333590+0000","last_fullsized":"2024-09-12T12:16:21.333590+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:00.093517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304396+0000","last_change":"2024-09-12T12:16:19.280332+0000","last_active":"2024-09-12T12:16:21.304396+0000","last_peered":"2024-09-12T12:16:21.304396+0000","last_clean":"2024-09-12T12:16:21.304396+0000","last_became_active":"2024-09-12T12:16:19.280016+0000","last_became_peered":"2024-09-12T12:16:19.280016+0000","last_unstale":"2024-09-12T12:16:21.304396+0000","last_undegraded":"2024-09-12T12:16:21.304396+0000","last_fullsized":"2024-09-12T12:16:21.304396+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:55.375924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334561+0000","last_change":"2024-09-12T12:16:20.301589+0000","last_active":"2024-09-12T12:16:21.334561+0000","last_peered":"2024-09-12T12:16:21.334561+0000","last_clean":"2024-09-12T12:16:21.334561+0000","last_became_active":"2024-09-12T12:16:20.301329+0000","last_became_peered":"2024-09-12T12:16:20.301329+0000","last_unstale":"2024-09-12T12:16:21.334561+0000","last_undegraded":"2024-09-12T12:16:21.334561+0000","last_fullsized":"2024-09-12T12:16:21.334561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:41.985212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333869+0000","last_change":"2024-09-12T12:16:19.293341+0000","last_active":"2024-09-12T12:16:21.333869+0000","last_peered":"2024-09-12T12:16:21.333869+0000","last_clean":"2024-09-12T12:16:21.333869+0000","last_became_active":"2024-09-12T12:16:19.293054+0000","last_became_peered":"2024-09-12T12:16:19.293054+0000","last_unstale":"2024-09-12T12:16:21.333869+0000","last_undegraded":"2024-09-12T12:16:21.333869+0000","last_fullsized":"2024-09-12T12:16:21.333869+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.039782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333842+0000","last_change":"2024-09-12T12:16:20.302704+0000","last_active":"2024-09-12T12:16:21.333842+0000","last_peered":"2024-09-12T12:16:21.333842+0000","last_clean":"2024-09-12T12:16:21.333842+0000","last_became_active":"2024-09-12T12:16:20.302430+0000","last_became_peered":"2024-09-12T12:16:20.302430+0000","last_unstale":"2024-09-12T12:16:21.333842+0000","last_undegraded":"2024-09-12T12:16:21.333842+0000","last_fullsized":"2024-09-12T12:16:21.333842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:32.756030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.306056+0000","last_change":"2024-09-12T12:16:19.291302+0000","last_active":"2024-09-12T12:16:21.306056+0000","last_peered":"2024-09-12T12:16:21.306056+0000","last_clean":"2024-09-12T12:16:21.306056+0000","last_became_active":"2024-09-12T12:16:19.291059+0000","last_became_peered":"2024-09-12T12:16:19.291059+0000","last_unstale":"2024-09-12T12:16:21.306056+0000","last_undegraded":"2024-09-12T12:16:21.306056+0000","last_fullsized":"2024-09-12T12:16:21.306056+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:16.317990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305695+0000","last_change":"2024-09-12T12:16:20.299586+0000","last_active":"2024-09-12T12:16:21.305695+0000","last_peered":"2024-09-12T12:16:21.305695+0000","last_clean":"2024-09-12T12:16:21.305695+0000","last_became_active":"2024-09-12T12:16:20.299278+0000","last_became_peered":"2024-09-12T12:16:20.299278+0000","last_unstale":"2024-09-12T12:16:21.305695+0000","last_undegraded":"2024-09-12T12:16:21.305695+0000","last_fullsized":"2024-09-12T12:16:21.305695+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:41.985212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333430+0000","last_change":"2024-09-12T12:16:19.293736+0000","last_active":"2024-09-12T12:16:21.333430+0000","last_peered":"2024-09-12T12:16:21.333430+0000","last_clean":"2024-09-12T12:16:21.333430+0000","last_became_active":"2024-09-12T12:16:19.293370+0000","last_became_peered":"2024-09-12T12:16:19.293370+0000","last_unstale":"2024-09-12T12:16:21.333430+0000","last_undegraded":"2024-09-12T12:16:21.333430+0000","last_fullsized":"2024-09-12T12:16:21.333430+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:24.499881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.306010+0000","last_change":"2024-09-12T12:16:20.302446+0000","last_active":"2024-09-12T12:16:21.306010+0000","last_peered":"2024-09-12T12:16:21.306010+0000","last_clean":"2024-09-12T12:16:21.306010+0000","last_became_active":"2024-09-12T12:16:20.301409+0000","last_became_peered":"2024-09-12T12:16:20.301409+0000","last_unstale":"2024-09-12T12:16:21.306010+0000","last_undegraded":"2024-09-12T12:16:21.306010+0000","last_fullsized":"2024-09-12T12:16:21.306010+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:20.584453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334681+0000","last_change":"2024-09-12T12:16:19.293140+0000","last_active":"2024-09-12T12:16:21.334681+0000","last_peered":"2024-09-12T12:16:21.334681+0000","last_clean":"2024-09-12T12:16:21.334681+0000","last_became_active":"2024-09-12T12:16:19.292230+0000","last_became_peered":"2024-09-12T12:16:19.292230+0000","last_unstale":"2024-09-12T12:16:21.334681+0000","last_undegraded":"2024-09-12T12:16:21.334681+0000","last_fullsized":"2024-09-12T12:16:21.334681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:23.923254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304549+0000","last_change":"2024-09-12T12:16:20.318950+0000","last_active":"2024-09-12T12:16:21.304549+0000","last_peered":"2024-09-12T12:16:21.304549+0000","last_clean":"2024-09-12T12:16:21.304549+0000","last_became_active":"2024-09-12T12:16:20.318700+0000","last_became_peered":"2024-09-12T12:16:20.318700+0000","last_unstale":"2024-09-12T12:16:21.304549+0000","last_undegraded":"2024-09-12T12:16:21.304549+0000","last_fullsized":"2024-09-12T12:16:21.304549+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:10.464147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332977+0000","last_change":"2024-09-12T12:16:19.289406+0000","last_active":"2024-09-12T12:16:21.332977+0000","last_peered":"2024-09-12T12:16:21.332977+0000","last_clean":"2024-09-12T12:16:21.332977+0000","last_became_active":"2024-09-12T12:16:19.288998+0000","last_became_peered":"2024-09-12T12:16:19.288998+0000","last_unstale":"2024-09-12T12:16:21.332977+0000","last_undegraded":"2024-09-12T12:16:21.332977+0000","last_fullsized":"2024-09-12T12:16:21.332977+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:04.104037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332811+0000","last_change":"2024-09-12T12:16:20.305753+0000","last_active":"2024-09-12T12:16:21.332811+0000","last_peered":"2024-09-12T12:16:21.332811+0000","last_clean":"2024-09-12T12:16:21.332811+0000","last_became_active":"2024-09-12T12:16:20.305484+0000","last_became_peered":"2024-09-12T12:16:20.305484+0000","last_unstale":"2024-09-12T12:16:21.332811+0000","last_undegraded":"2024-09-12T12:16:21.332811+0000","last_fullsized":"2024-09-12T12:16:21.332811+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:34.003140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332455+0000","last_change":"2024-09-12T12:16:19.295064+0000","last_active":"2024-09-12T12:16:21.332455+0000","last_peered":"2024-09-12T12:16:21.332455+0000","last_clean":"2024-09-12T12:16:21.332455+0000","last_became_active":"2024-09-12T12:16:19.294669+0000","last_became_peered":"2024-09-12T12:16:19.294669+0000","last_unstale":"2024-09-12T12:16:21.332455+0000","last_undegraded":"2024-09-12T12:16:21.332455+0000","last_fullsized":"2024-09-12T12:16:21.332455+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:41.978411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304720+0000","last_change":"2024-09-12T12:16:20.297430+0000","last_active":"2024-09-12T12:16:21.304720+0000","last_peered":"2024-09-12T12:16:21.304720+0000","last_clean":"2024-09-12T12:16:21.304720+0000","last_became_active":"2024-09-12T12:16:20.297177+0000","last_became_peered":"2024-09-12T12:16:20.297177+0000","last_unstale":"2024-09-12T12:16:21.304720+0000","last_undegraded":"2024-09-12T12:16:21.304720+0000","last_fullsized":"2024-09-12T12:16:21.304720+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:20.584453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333184+0000","last_change":"2024-09-12T12:16:19.293730+0000","last_active":"2024-09-12T12:16:21.333184+0000","last_peered":"2024-09-12T12:16:21.333184+0000","last_clean":"2024-09-12T12:16:21.333184+0000","last_became_active":"2024-09-12T12:16:19.292943+0000","last_became_peered":"2024-09-12T12:16:19.292943+0000","last_unstale":"2024-09-12T12:16:21.333184+0000","last_undegraded":"2024-09-12T12:16:21.333184+0000","last_fullsized":"2024-09-12T12:16:21.333184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:07.452549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334553+0000","last_change":"2024-09-12T12:16:20.319403+0000","last_active":"2024-09-12T12:16:21.334553+0000","last_peered":"2024-09-12T12:16:21.334553+0000","last_clean":"2024-09-12T12:16:21.334553+0000","last_became_active":"2024-09-12T12:16:20.319104+0000","last_became_peered":"2024-09-12T12:16:20.319104+0000","last_unstale":"2024-09-12T12:16:21.334553+0000","last_undegraded":"2024-09-12T12:16:21.334553+0000","last_fullsized":"2024-09-12T12:16:21.334553+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:05.110167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304232+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:21.304232+0000","last_peered":"2024-09-12T12:16:21.304232+0000","last_clean":"2024-09-12T12:16:21.304232+0000","last_became_active":"2024-09-12T12:16:19.285395+0000","last_became_peered":"2024-09-12T12:16:19.285395+0000","last_unstale":"2024-09-12T12:16:21.304232+0000","last_undegraded":"2024-09-12T12:16:21.304232+0000","last_fullsized":"2024-09-12T12:16:21.304232+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:38.653133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333241+0000","last_change":"2024-09-12T12:16:20.316024+0000","last_active":"2024-09-12T12:16:21.333241+0000","last_peered":"2024-09-12T12:16:21.333241+0000","last_clean":"2024-09-12T12:16:21.333241+0000","last_became_active":"2024-09-12T12:16:20.315701+0000","last_became_peered":"2024-09-12T12:16:20.315701+0000","last_unstale":"2024-09-12T12:16:21.333241+0000","last_undegraded":"2024-09-12T12:16:21.333241+0000","last_fullsized":"2024-09-12T12:16:21.333241+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:49.379152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333067+0000","last_change":"2024-09-12T12:16:19.293036+0000","last_active":"2024-09-12T12:16:21.333067+0000","last_peered":"2024-09-12T12:16:21.333067+0000","last_clean":"2024-09-12T12:16:21.333067+0000","last_became_active":"2024-09-12T12:16:19.292655+0000","last_became_peered":"2024-09-12T12:16:19.292655+0000","last_unstale":"2024-09-12T12:16:21.333067+0000","last_undegraded":"2024-09-12T12:16:21.333067+0000","last_fullsized":"2024-09-12T12:16:21.333067+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:07.452549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305444+0000","last_change":"2024-09-12T12:16:20.293789+0000","last_active":"2024-09-12T12:16:21.305444+0000","last_peered":"2024-09-12T12:16:21.305444+0000","last_clean":"2024-09-12T12:16:21.305444+0000","last_became_active":"2024-09-12T12:16:20.293512+0000","last_became_peered":"2024-09-12T12:16:20.293512+0000","last_unstale":"2024-09-12T12:16:21.305444+0000","last_undegraded":"2024-09-12T12:16:21.305444+0000","last_fullsized":"2024-09-12T12:16:21.305444+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:08.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333692+0000","last_change":"2024-09-12T12:16:19.294158+0000","last_active":"2024-09-12T12:16:21.333692+0000","last_peered":"2024-09-12T12:16:21.333692+0000","last_clean":"2024-09-12T12:16:21.333692+0000","last_became_active":"2024-09-12T12:16:19.293849+0000","last_became_peered":"2024-09-12T12:16:19.293849+0000","last_unstale":"2024-09-12T12:16:21.333692+0000","last_undegraded":"2024-09-12T12:16:21.333692+0000","last_fullsized":"2024-09-12T12:16:21.333692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:50.919783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305992+0000","last_change":"2024-09-12T12:16:20.303417+0000","last_active":"2024-09-12T12:16:21.305992+0000","last_peered":"2024-09-12T12:16:21.305992+0000","last_clean":"2024-09-12T12:16:21.305992+0000","last_became_active":"2024-09-12T12:16:20.302754+0000","last_became_peered":"2024-09-12T12:16:20.302754+0000","last_unstale":"2024-09-12T12:16:21.305992+0000","last_undegraded":"2024-09-12T12:16:21.305992+0000","last_fullsized":"2024-09-12T12:16:21.305992+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:50.058156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333599+0000","last_change":"2024-09-12T12:16:19.293944+0000","last_active":"2024-09-12T12:16:21.333599+0000","last_peered":"2024-09-12T12:16:21.333599+0000","last_clean":"2024-09-12T12:16:21.333599+0000","last_became_active":"2024-09-12T12:16:19.293392+0000","last_became_peered":"2024-09-12T12:16:19.293392+0000","last_unstale":"2024-09-12T12:16:21.333599+0000","last_undegraded":"2024-09-12T12:16:21.333599+0000","last_fullsized":"2024-09-12T12:16:21.333599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:06.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305668+0000","last_change":"2024-09-12T12:16:20.301937+0000","last_active":"2024-09-12T12:16:21.305668+0000","last_peered":"2024-09-12T12:16:21.305668+0000","last_clean":"2024-09-12T12:16:21.305668+0000","last_became_active":"2024-09-12T12:16:20.301675+0000","last_became_peered":"2024-09-12T12:16:20.301675+0000","last_unstale":"2024-09-12T12:16:21.305668+0000","last_undegraded":"2024-09-12T12:16:21.305668+0000","last_fullsized":"2024-09-12T12:16:21.305668+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:05.110167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333901+0000","last_change":"2024-09-12T12:16:19.286376+0000","last_active":"2024-09-12T12:16:21.333901+0000","last_peered":"2024-09-12T12:16:21.333901+0000","last_clean":"2024-09-12T12:16:21.333901+0000","last_became_active":"2024-09-12T12:16:19.286111+0000","last_became_peered":"2024-09-12T12:16:19.286111+0000","last_unstale":"2024-09-12T12:16:21.333901+0000","last_undegraded":"2024-09-12T12:16:21.333901+0000","last_fullsized":"2024-09-12T12:16:21.333901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:12.746742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302031+0000","last_change":"2024-09-12T12:16:20.301731+0000","last_active":"2024-09-12T12:16:21.302031+0000","last_peered":"2024-09-12T12:16:21.302031+0000","last_clean":"2024-09-12T12:16:21.302031+0000","last_became_active":"2024-09-12T12:16:20.301217+0000","last_became_peered":"2024-09-12T12:16:20.301217+0000","last_unstale":"2024-09-12T12:16:21.302031+0000","last_undegraded":"2024-09-12T12:16:21.302031+0000","last_fullsized":"2024-09-12T12:16:21.302031+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:13.752872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302066+0000","last_change":"2024-09-12T12:16:19.289582+0000","last_active":"2024-09-12T12:16:21.302066+0000","last_peered":"2024-09-12T12:16:21.302066+0000","last_clean":"2024-09-12T12:16:21.302066+0000","last_became_active":"2024-09-12T12:16:19.289038+0000","last_became_peered":"2024-09-12T12:16:19.289038+0000","last_unstale":"2024-09-12T12:16:21.302066+0000","last_undegraded":"2024-09-12T12:16:21.302066+0000","last_fullsized":"2024-09-12T12:16:21.302066+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:15.706001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332480+0000","last_change":"2024-09-12T12:16:20.302567+0000","last_active":"2024-09-12T12:16:21.332480+0000","last_peered":"2024-09-12T12:16:21.332480+0000","last_clean":"2024-09-12T12:16:21.332480+0000","last_became_active":"2024-09-12T12:16:20.302198+0000","last_became_peered":"2024-09-12T12:16:20.302198+0000","last_unstale":"2024-09-12T12:16:21.332480+0000","last_undegraded":"2024-09-12T12:16:21.332480+0000","last_fullsized":"2024-09-12T12:16:21.332480+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:42.886470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332560+0000","last_change":"2024-09-12T12:16:19.293030+0000","last_active":"2024-09-12T12:16:21.332560+0000","last_peered":"2024-09-12T12:16:21.332560+0000","last_clean":"2024-09-12T12:16:21.332560+0000","last_became_active":"2024-09-12T12:16:19.292701+0000","last_became_peered":"2024-09-12T12:16:19.292701+0000","last_unstale":"2024-09-12T12:16:21.332560+0000","last_undegraded":"2024-09-12T12:16:21.332560+0000","last_fullsized":"2024-09-12T12:16:21.332560+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:23.415934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305082+0000","last_change":"2024-09-12T12:16:20.292965+0000","last_active":"2024-09-12T12:16:21.305082+0000","last_peered":"2024-09-12T12:16:21.305082+0000","last_clean":"2024-09-12T12:16:21.305082+0000","last_became_active":"2024-09-12T12:16:20.291159+0000","last_became_peered":"2024-09-12T12:16:20.291159+0000","last_unstale":"2024-09-12T12:16:21.305082+0000","last_undegraded":"2024-09-12T12:16:21.305082+0000","last_fullsized":"2024-09-12T12:16:21.305082+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:27.008905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302026+0000","last_change":"2024-09-12T12:16:19.286130+0000","last_active":"2024-09-12T12:16:21.302026+0000","last_peered":"2024-09-12T12:16:21.302026+0000","last_clean":"2024-09-12T12:16:21.302026+0000","last_became_active":"2024-09-12T12:16:19.285864+0000","last_became_peered":"2024-09-12T12:16:19.285864+0000","last_unstale":"2024-09-12T12:16:21.302026+0000","last_undegraded":"2024-09-12T12:16:21.302026+0000","last_fullsized":"2024-09-12T12:16:21.302026+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:07.149683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302542+0000","last_change":"2024-09-12T12:16:20.293901+0000","last_active":"2024-09-12T12:16:21.302542+0000","last_peered":"2024-09-12T12:16:21.302542+0000","last_clean":"2024-09-12T12:16:21.302542+0000","last_became_active":"2024-09-12T12:16:20.293633+0000","last_became_peered":"2024-09-12T12:16:20.293633+0000","last_unstale":"2024-09-12T12:16:21.302542+0000","last_undegraded":"2024-09-12T12:16:21.302542+0000","last_fullsized":"2024-09-12T12:16:21.302542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:03.749884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333317+0000","last_change":"2024-09-12T12:16:19.289187+0000","last_active":"2024-09-12T12:16:21.333317+0000","last_peered":"2024-09-12T12:16:21.333317+0000","last_clean":"2024-09-12T12:16:21.333317+0000","last_became_active":"2024-09-12T12:16:19.286518+0000","last_became_peered":"2024-09-12T12:16:19.286518+0000","last_unstale":"2024-09-12T12:16:21.333317+0000","last_undegraded":"2024-09-12T12:16:21.333317+0000","last_fullsized":"2024-09-12T12:16:21.333317+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:04.104037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334078+0000","last_change":"2024-09-12T12:16:20.309213+0000","last_active":"2024-09-12T12:16:21.334078+0000","last_peered":"2024-09-12T12:16:21.334078+0000","last_clean":"2024-09-12T12:16:21.334078+0000","last_became_active":"2024-09-12T12:16:20.308934+0000","last_became_peered":"2024-09-12T12:16:20.308934+0000","last_unstale":"2024-09-12T12:16:21.334078+0000","last_undegraded":"2024-09-12T12:16:21.334078+0000","last_fullsized":"2024-09-12T12:16:21.334078+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:52.530003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"65'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333498+0000","last_change":"2024-09-12T12:16:19.285221+0000","last_active":"2024-09-12T12:16:21.333498+0000","last_peered":"2024-09-12T12:16:21.333498+0000","last_clean":"2024-09-12T12:16:21.333498+0000","last_became_active":"2024-09-12T12:16:19.284934+0000","last_became_peered":"2024-09-12T12:16:19.284934+0000","last_unstale":"2024-09-12T12:16:21.333498+0000","last_undegraded":"2024-09-12T12:16:21.333498+0000","last_fullsized":"2024-09-12T12:16:21.333498+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:40.979082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333361+0000","last_change":"2024-09-12T12:16:20.306106+0000","last_active":"2024-09-12T12:16:21.333361+0000","last_peered":"2024-09-12T12:16:21.333361+0000","last_clean":"2024-09-12T12:16:21.333361+0000","last_became_active":"2024-09-12T12:16:20.305819+0000","last_became_peered":"2024-09-12T12:16:20.305819+0000","last_unstale":"2024-09-12T12:16:21.333361+0000","last_undegraded":"2024-09-12T12:16:21.333361+0000","last_fullsized":"2024-09-12T12:16:21.333361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:41.675078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302398+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:21.302398+0000","last_peered":"2024-09-12T12:16:21.302398+0000","last_clean":"2024-09-12T12:16:21.302398+0000","last_became_active":"2024-09-12T12:16:19.285402+0000","last_became_peered":"2024-09-12T12:16:19.285402+0000","last_unstale":"2024-09-12T12:16:21.302398+0000","last_undegraded":"2024-09-12T12:16:21.302398+0000","last_fullsized":"2024-09-12T12:16:21.302398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:32.997009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305877+0000","last_change":"2024-09-12T12:16:20.304222+0000","last_active":"2024-09-12T12:16:21.305877+0000","last_peered":"2024-09-12T12:16:21.305877+0000","last_clean":"2024-09-12T12:16:21.305877+0000","last_became_active":"2024-09-12T12:16:20.303536+0000","last_became_peered":"2024-09-12T12:16:20.303536+0000","last_unstale":"2024-09-12T12:16:21.305877+0000","last_undegraded":"2024-09-12T12:16:21.305877+0000","last_fullsized":"2024-09-12T12:16:21.305877+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:51.925913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334673+0000","last_change":"2024-09-12T12:16:19.292693+0000","last_active":"2024-09-12T12:16:21.334673+0000","last_peered":"2024-09-12T12:16:21.334673+0000","last_clean":"2024-09-12T12:16:21.334673+0000","last_became_active":"2024-09-12T12:16:19.291920+0000","last_became_peered":"2024-09-12T12:16:19.291920+0000","last_unstale":"2024-09-12T12:16:21.334673+0000","last_undegraded":"2024-09-12T12:16:21.334673+0000","last_fullsized":"2024-09-12T12:16:21.334673+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:14.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304384+0000","last_change":"2024-09-12T12:16:20.298973+0000","last_active":"2024-09-12T12:16:21.304384+0000","last_peered":"2024-09-12T12:16:21.304384+0000","last_clean":"2024-09-12T12:16:21.304384+0000","last_became_active":"2024-09-12T12:16:20.298705+0000","last_became_peered":"2024-09-12T12:16:20.298705+0000","last_unstale":"2024-09-12T12:16:21.304384+0000","last_undegraded":"2024-09-12T12:16:21.304384+0000","last_fullsized":"2024-09-12T12:16:21.304384+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:43.637160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333093+0000","last_change":"2024-09-12T12:16:19.292882+0000","last_active":"2024-09-12T12:16:21.333093+0000","last_peered":"2024-09-12T12:16:21.333093+0000","last_clean":"2024-09-12T12:16:21.333093+0000","last_became_active":"2024-09-12T12:16:19.292639+0000","last_became_peered":"2024-09-12T12:16:19.292639+0000","last_unstale":"2024-09-12T12:16:21.333093+0000","last_undegraded":"2024-09-12T12:16:21.333093+0000","last_fullsized":"2024-09-12T12:16:21.333093+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:40.979082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305056+0000","last_change":"2024-09-12T12:16:20.319963+0000","last_active":"2024-09-12T12:16:21.305056+0000","last_peered":"2024-09-12T12:16:21.305056+0000","last_clean":"2024-09-12T12:16:21.305056+0000","last_became_active":"2024-09-12T12:16:20.319680+0000","last_became_peered":"2024-09-12T12:16:20.319680+0000","last_unstale":"2024-09-12T12:16:21.305056+0000","last_undegraded":"2024-09-12T12:16:21.305056+0000","last_fullsized":"2024-09-12T12:16:21.305056+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:47:45.596477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333594+0000","last_change":"2024-09-12T12:16:19.294703+0000","last_active":"2024-09-12T12:16:21.333594+0000","last_peered":"2024-09-12T12:16:21.333594+0000","last_clean":"2024-09-12T12:16:21.333594+0000","last_became_active":"2024-09-12T12:16:19.294170+0000","last_became_peered":"2024-09-12T12:16:19.294170+0000","last_unstale":"2024-09-12T12:16:21.333594+0000","last_undegraded":"2024-09-12T12:16:21.333594+0000","last_fullsized":"2024-09-12T12:16:21.333594+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:11.463684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334466+0000","last_change":"2024-09-12T12:16:20.302578+0000","last_active":"2024-09-12T12:16:21.334466+0000","last_peered":"2024-09-12T12:16:21.334466+0000","last_clean":"2024-09-12T12:16:21.334466+0000","last_became_active":"2024-09-12T12:16:20.296455+0000","last_became_peered":"2024-09-12T12:16:20.296455+0000","last_unstale":"2024-09-12T12:16:21.334466+0000","last_undegraded":"2024-09-12T12:16:21.334466+0000","last_fullsized":"2024-09-12T12:16:21.334466+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:08.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333514+0000","last_change":"2024-09-12T12:16:19.285844+0000","last_active":"2024-09-12T12:16:21.333514+0000","last_peered":"2024-09-12T12:16:21.333514+0000","last_clean":"2024-09-12T12:16:21.333514+0000","last_became_active":"2024-09-12T12:16:19.285560+0000","last_became_peered":"2024-09-12T12:16:19.285560+0000","last_unstale":"2024-09-12T12:16:21.333514+0000","last_undegraded":"2024-09-12T12:16:21.333514+0000","last_fullsized":"2024-09-12T12:16:21.333514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:40.668948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333645+0000","last_change":"2024-09-12T12:16:20.309781+0000","last_active":"2024-09-12T12:16:21.333645+0000","last_peered":"2024-09-12T12:16:21.333645+0000","last_clean":"2024-09-12T12:16:21.333645+0000","last_became_active":"2024-09-12T12:16:20.309543+0000","last_became_peered":"2024-09-12T12:16:20.309543+0000","last_unstale":"2024-09-12T12:16:21.333645+0000","last_undegraded":"2024-09-12T12:16:21.333645+0000","last_fullsized":"2024-09-12T12:16:21.333645+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:24.531059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334220+0000","last_change":"2024-09-12T12:16:19.293792+0000","last_active":"2024-09-12T12:16:21.334220+0000","last_peered":"2024-09-12T12:16:21.334220+0000","last_clean":"2024-09-12T12:16:21.334220+0000","last_became_active":"2024-09-12T12:16:19.293497+0000","last_became_peered":"2024-09-12T12:16:19.293497+0000","last_unstale":"2024-09-12T12:16:21.334220+0000","last_undegraded":"2024-09-12T12:16:21.334220+0000","last_fullsized":"2024-09-12T12:16:21.334220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:47:44.590346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304910+0000","last_change":"2024-09-12T12:16:20.298405+0000","last_active":"2024-09-12T12:16:21.304910+0000","last_peered":"2024-09-12T12:16:21.304910+0000","last_clean":"2024-09-12T12:16:21.304910+0000","last_became_active":"2024-09-12T12:16:20.298044+0000","last_became_peered":"2024-09-12T12:16:20.298044+0000","last_unstale":"2024-09-12T12:16:21.304910+0000","last_undegraded":"2024-09-12T12:16:21.304910+0000","last_fullsized":"2024-09-12T12:16:21.304910+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:09.260451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333194+0000","last_change":"2024-09-12T12:16:19.286473+0000","last_active":"2024-09-12T12:16:21.333194+0000","last_peered":"2024-09-12T12:16:21.333194+0000","last_clean":"2024-09-12T12:16:21.333194+0000","last_became_active":"2024-09-12T12:16:19.286196+0000","last_became_peered":"2024-09-12T12:16:19.286196+0000","last_unstale":"2024-09-12T12:16:21.333194+0000","last_undegraded":"2024-09-12T12:16:21.333194+0000","last_fullsized":"2024-09-12T12:16:21.333194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:53.989387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":253,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332609+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:16:21.332609+0000","last_peered":"2024-09-12T12:16:21.332609+0000","last_clean":"2024-09-12T12:16:21.332609+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:16:21.332609+0000","last_undegraded":"2024-09-12T12:16:21.332609+0000","last_fullsized":"2024-09-12T12:16:21.332609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":1396736,"data_stored":946830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36128,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335712,"statfs":{"total":96636764160,"available":96599769088,"internally_reserved":0,"allocated":790528,"data_stored":355720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":790528,"data_stored":355708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":798720,"data_stored":357298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":786432,"data_stored":355686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":786432,"data_stored":355686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36148,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335692,"statfs":{"total":96636764160,"available":96599748608,"internally_reserved":0,"allocated":815104,"data_stored":358062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40860,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330980,"statfs":{"total":96636764160,"available":96594923520,"internally_reserved":0,"allocated":1380352,"data_stored":946054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:16:28.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:16:29.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.107+0000 7fae3f000640 1 Processor -- start 2024-09-12T12:16:29.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.107+0000 7fae3f000640 1 -- start start 2024-09-12T12:16:29.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3f000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fae3815c7b0 0x7fae380ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815cd30 0x7fae380b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3f000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae380b5de0 0x7fae381601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3f000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fae38072a50 con 0x7fae380b5de0 2024-09-12T12:16:29.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3f000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fae380cde30 con 0x7fae3815c7b0 2024-09-12T12:16:29.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fae380b6210 con 0x7fae3815cd30 2024-09-12T12:16:29.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae380b5de0 0x7fae381601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae380b5de0 0x7fae381601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52766/0 (socket says 172.21.15.144:52766) 2024-09-12T12:16:29.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3d000640 1 -- 172.21.15.144:0/1901754173 learned_addr learned my addr 172.21.15.144:0/1901754173 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:29.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae37400640 1 --2- 172.21.15.144:0/1901754173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815cd30 0x7fae380b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae37e00640 1 --2- 172.21.15.144:0/1901754173 >> v2:172.21.15.165:3300/0 conn(0x7fae3815c7b0 0x7fae380ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3d000640 1 -- 172.21.15.144:0/1901754173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815cd30 msgr2=0x7fae380b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:29.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3d000640 1 --2- 172.21.15.144:0/1901754173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815cd30 0x7fae380b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3d000640 1 -- 172.21.15.144:0/1901754173 >> v2:172.21.15.165:3300/0 conn(0x7fae3815c7b0 msgr2=0x7fae380ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:29.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3d000640 1 --2- 172.21.15.144:0/1901754173 >> v2:172.21.15.165:3300/0 conn(0x7fae3815c7b0 0x7fae380ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.111+0000 7fae3d000640 1 -- 172.21.15.144:0/1901754173 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae380cd870 con 0x7fae380b5de0 2024-09-12T12:16:29.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3d000640 1 --2- 172.21.15.144:0/1901754173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 0x7fae381601d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fae380d14f0 tx=0x7fae3001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a635f1a7a6434899 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae36a00640 1 -- 172.21.15.144:0/1901754173 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae300a64b0 con 0x7fae380b5de0 2024-09-12T12:16:29.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae36a00640 1 -- 172.21.15.144:0/1901754173 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae300a6650 con 0x7fae380b5de0 2024-09-12T12:16:29.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae36a00640 1 -- 172.21.15.144:0/1901754173 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae300a6a20 con 0x7fae380b5de0 2024-09-12T12:16:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 -- 172.21.15.144:0/1901754173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 msgr2=0x7fae381601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 --2- 172.21.15.144:0/1901754173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 0x7fae381601d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fae380d14f0 tx=0x7fae3001c730 comp rx=0 tx=0).stop 2024-09-12T12:16:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 -- 172.21.15.144:0/1901754173 shutdown_connections 2024-09-12T12:16:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 --2- 172.21.15.144:0/1901754173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 0x7fae381601d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 --2- 172.21.15.144:0/1901754173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815cd30 0x7fae380b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 --2- 172.21.15.144:0/1901754173 >> v2:172.21.15.165:3300/0 conn(0x7fae3815c7b0 0x7fae380ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 -- 172.21.15.144:0/1901754173 >> 172.21.15.144:0/1901754173 conn(0x7fae3806d0d0 msgr2=0x7fae3806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 -- 172.21.15.144:0/1901754173 shutdown_connections 2024-09-12T12:16:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 -- 172.21.15.144:0/1901754173 wait complete. 2024-09-12T12:16:29.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 Processor -- start 2024-09-12T12:16:29.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 -- start start 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 0x7fae3814e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815c7b0 0x7fae381508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae3815cd30 0x7fae38150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fae38072ec0 con 0x7fae380b5de0 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fae380cd650 con 0x7fae3815cd30 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae3f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fae38073040 con 0x7fae3815c7b0 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae37e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 0x7fae3814e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae37e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 0x7fae3814e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52782/0 (socket says 172.21.15.144:52782) 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.115+0000 7fae37e00640 1 -- 172.21.15.144:0/2869417633 learned_addr learned my addr 172.21.15.144:0/2869417633 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae37400640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815c7b0 0x7fae381508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae3d000640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae3815cd30 0x7fae38150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae37e00640 1 -- 172.21.15.144:0/2869417633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815c7b0 msgr2=0x7fae381508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae37e00640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815c7b0 0x7fae381508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae37e00640 1 -- 172.21.15.144:0/2869417633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae3815cd30 msgr2=0x7fae38150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae37e00640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae3815cd30 0x7fae38150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae37e00640 1 -- 172.21.15.144:0/2869417633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3814eb80 con 0x7fae380b5de0 2024-09-12T12:16:29.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae3d000640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae3815cd30 0x7fae38150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:29.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae37e00640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 0x7fae3814e640 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fae2800d830 tx=0x7fae2800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae2fe00640 1 -- 172.21.15.144:0/2869417633 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28018020 con 0x7fae380b5de0 2024-09-12T12:16:29.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae2fe00640 1 -- 172.21.15.144:0/2869417633 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae28009640 con 0x7fae380b5de0 2024-09-12T12:16:29.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae2fe00640 1 -- 172.21.15.144:0/2869417633 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae280099f0 con 0x7fae380b5de0 2024-09-12T12:16:29.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae38151870 con 0x7fae380b5de0 2024-09-12T12:16:29.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae38151e30 con 0x7fae380b5de0 2024-09-12T12:16:29.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae380ccf00 con 0x7fae380b5de0 2024-09-12T12:16:29.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae2fe00640 1 -- 172.21.15.144:0/2869417633 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae2801b020 con 0x7fae380b5de0 2024-09-12T12:16:29.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae2fe00640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae180678c0 0x7fae18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae2fe00640 1 -- 172.21.15.144:0/2869417633 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7fae28086690 con 0x7fae380b5de0 2024-09-12T12:16:29.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.119+0000 7fae37400640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae180678c0 0x7fae18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.123+0000 7fae37400640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae180678c0 0x7fae18069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fae38153fc0 tx=0x7fae24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.123+0000 7fae2fe00640 1 -- 172.21.15.144:0/2869417633 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fae28022020 con 0x7fae380b5de0 2024-09-12T12:16:29.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.279+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae380af380 con 0x7fae180678c0 2024-09-12T12:16:29.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.283+0000 7fae2fe00640 1 -- 172.21.15.144:0/2869417633 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252020 (secure 0 0 0) 0x7fae380af380 con 0x7fae180678c0 2024-09-12T12:16:29.289 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:29.291 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae180678c0 msgr2=0x7fae18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae180678c0 0x7fae18069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fae38153fc0 tx=0x7fae24008040 comp rx=0 tx=0).stop 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 msgr2=0x7fae3814e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 0x7fae3814e640 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fae2800d830 tx=0x7fae2800dcf0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 shutdown_connections 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae180678c0 0x7fae18069d80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae3815cd30 0x7fae38150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae3815c7b0 0x7fae381508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 --2- 172.21.15.144:0/2869417633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae380b5de0 0x7fae3814e640 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 >> 172.21.15.144:0/2869417633 conn(0x7fae3806d0d0 msgr2=0x7fae3815f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 shutdown_connections 2024-09-12T12:16:29.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.287+0000 7fae3f000640 1 -- 172.21.15.144:0/2869417633 wait complete. 2024-09-12T12:16:29.310 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-12T12:16:28.349610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":294352,"kb_used_data":7368,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754680368,"statfs":{"total":773094113280,"available":772792696832,"internally_reserved":0,"allocated":7544832,"data_stored":4031044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.046127"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.335005+0000","last_change":"2024-09-12T12:16:20.310027+0000","last_active":"2024-09-12T12:16:21.335005+0000","last_peered":"2024-09-12T12:16:21.335005+0000","last_clean":"2024-09-12T12:16:21.335005+0000","last_became_active":"2024-09-12T12:16:20.308254+0000","last_became_peered":"2024-09-12T12:16:20.308254+0000","last_unstale":"2024-09-12T12:16:21.335005+0000","last_undegraded":"2024-09-12T12:16:21.335005+0000","last_fullsized":"2024-09-12T12:16:21.335005+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:07.167204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334858+0000","last_change":"2024-09-12T12:16:20.303599+0000","last_active":"2024-09-12T12:16:21.334858+0000","last_peered":"2024-09-12T12:16:21.334858+0000","last_clean":"2024-09-12T12:16:21.334858+0000","last_became_active":"2024-09-12T12:16:20.303287+0000","last_became_peered":"2024-09-12T12:16:20.303287+0000","last_unstale":"2024-09-12T12:16:21.334858+0000","last_undegraded":"2024-09-12T12:16:21.334858+0000","last_fullsized":"2024-09-12T12:16:21.334858+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:25.506011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333488+0000","last_change":"2024-09-12T12:16:20.317282+0000","last_active":"2024-09-12T12:16:21.333488+0000","last_peered":"2024-09-12T12:16:21.333488+0000","last_clean":"2024-09-12T12:16:21.333488+0000","last_became_active":"2024-09-12T12:16:20.316591+0000","last_became_peered":"2024-09-12T12:16:20.316591+0000","last_unstale":"2024-09-12T12:16:21.333488+0000","last_undegraded":"2024-09-12T12:16:21.333488+0000","last_fullsized":"2024-09-12T12:16:21.333488+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:41.675078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305475+0000","last_change":"2024-09-12T12:16:20.306866+0000","last_active":"2024-09-12T12:16:21.305475+0000","last_peered":"2024-09-12T12:16:21.305475+0000","last_clean":"2024-09-12T12:16:21.305475+0000","last_became_active":"2024-09-12T12:16:20.303224+0000","last_became_peered":"2024-09-12T12:16:20.303224+0000","last_unstale":"2024-09-12T12:16:21.305475+0000","last_undegraded":"2024-09-12T12:16:21.305475+0000","last_fullsized":"2024-09-12T12:16:21.305475+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:15.182116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304877+0000","last_change":"2024-09-12T12:16:20.295505+0000","last_active":"2024-09-12T12:16:21.304877+0000","last_peered":"2024-09-12T12:16:21.304877+0000","last_clean":"2024-09-12T12:16:21.304877+0000","last_became_active":"2024-09-12T12:16:20.293621+0000","last_became_peered":"2024-09-12T12:16:20.293621+0000","last_unstale":"2024-09-12T12:16:21.304877+0000","last_undegraded":"2024-09-12T12:16:21.304877+0000","last_fullsized":"2024-09-12T12:16:21.304877+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:50.058156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302301+0000","last_change":"2024-09-12T12:16:20.321901+0000","last_active":"2024-09-12T12:16:21.302301+0000","last_peered":"2024-09-12T12:16:21.302301+0000","last_clean":"2024-09-12T12:16:21.302301+0000","last_became_active":"2024-09-12T12:16:20.321649+0000","last_became_peered":"2024-09-12T12:16:20.321649+0000","last_unstale":"2024-09-12T12:16:21.302301+0000","last_undegraded":"2024-09-12T12:16:21.302301+0000","last_fullsized":"2024-09-12T12:16:21.302301+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:33.516112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333421+0000","last_change":"2024-09-12T12:16:20.319979+0000","last_active":"2024-09-12T12:16:21.333421+0000","last_peered":"2024-09-12T12:16:21.333421+0000","last_clean":"2024-09-12T12:16:21.333421+0000","last_became_active":"2024-09-12T12:16:20.319502+0000","last_became_peered":"2024-09-12T12:16:20.319502+0000","last_unstale":"2024-09-12T12:16:21.333421+0000","last_undegraded":"2024-09-12T12:16:21.333421+0000","last_fullsized":"2024-09-12T12:16:21.333421+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:26.505428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332542+0000","last_change":"2024-09-12T12:16:20.316918+0000","last_active":"2024-09-12T12:16:21.332542+0000","last_peered":"2024-09-12T12:16:21.332542+0000","last_clean":"2024-09-12T12:16:21.332542+0000","last_became_active":"2024-09-12T12:16:20.315473+0000","last_became_peered":"2024-09-12T12:16:20.315473+0000","last_unstale":"2024-09-12T12:16:21.332542+0000","last_undegraded":"2024-09-12T12:16:21.332542+0000","last_fullsized":"2024-09-12T12:16:21.332542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:02.259727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333865+0000","last_change":"2024-09-12T12:16:20.323791+0000","last_active":"2024-09-12T12:16:21.333865+0000","last_peered":"2024-09-12T12:16:21.333865+0000","last_clean":"2024-09-12T12:16:21.333865+0000","last_became_active":"2024-09-12T12:16:20.323524+0000","last_became_peered":"2024-09-12T12:16:20.323524+0000","last_unstale":"2024-09-12T12:16:21.333865+0000","last_undegraded":"2024-09-12T12:16:21.333865+0000","last_fullsized":"2024-09-12T12:16:21.333865+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.469814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333714+0000","last_change":"2024-09-12T12:16:20.321084+0000","last_active":"2024-09-12T12:16:21.333714+0000","last_peered":"2024-09-12T12:16:21.333714+0000","last_clean":"2024-09-12T12:16:21.333714+0000","last_became_active":"2024-09-12T12:16:20.318390+0000","last_became_peered":"2024-09-12T12:16:20.318390+0000","last_unstale":"2024-09-12T12:16:21.333714+0000","last_undegraded":"2024-09-12T12:16:21.333714+0000","last_fullsized":"2024-09-12T12:16:21.333714+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:32.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305386+0000","last_change":"2024-09-12T12:16:20.301277+0000","last_active":"2024-09-12T12:16:21.305386+0000","last_peered":"2024-09-12T12:16:21.305386+0000","last_clean":"2024-09-12T12:16:21.305386+0000","last_became_active":"2024-09-12T12:16:20.296837+0000","last_became_peered":"2024-09-12T12:16:20.296837+0000","last_unstale":"2024-09-12T12:16:21.305386+0000","last_undegraded":"2024-09-12T12:16:21.305386+0000","last_fullsized":"2024-09-12T12:16:21.305386+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:24.929384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332756+0000","last_change":"2024-09-12T12:16:20.315977+0000","last_active":"2024-09-12T12:16:21.332756+0000","last_peered":"2024-09-12T12:16:21.332756+0000","last_clean":"2024-09-12T12:16:21.332756+0000","last_became_active":"2024-09-12T12:16:20.315766+0000","last_became_peered":"2024-09-12T12:16:20.315766+0000","last_unstale":"2024-09-12T12:16:21.332756+0000","last_undegraded":"2024-09-12T12:16:21.332756+0000","last_fullsized":"2024-09-12T12:16:21.332756+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:28.662461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332965+0000","last_change":"2024-09-12T12:16:20.307040+0000","last_active":"2024-09-12T12:16:21.332965+0000","last_peered":"2024-09-12T12:16:21.332965+0000","last_clean":"2024-09-12T12:16:21.332965+0000","last_became_active":"2024-09-12T12:16:20.306760+0000","last_became_peered":"2024-09-12T12:16:20.306760+0000","last_unstale":"2024-09-12T12:16:21.332965+0000","last_undegraded":"2024-09-12T12:16:21.332965+0000","last_fullsized":"2024-09-12T12:16:21.332965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:53.460435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332889+0000","last_change":"2024-09-12T12:16:20.318211+0000","last_active":"2024-09-12T12:16:21.332889+0000","last_peered":"2024-09-12T12:16:21.332889+0000","last_clean":"2024-09-12T12:16:21.332889+0000","last_became_active":"2024-09-12T12:16:20.317956+0000","last_became_peered":"2024-09-12T12:16:20.317956+0000","last_unstale":"2024-09-12T12:16:21.332889+0000","last_undegraded":"2024-09-12T12:16:21.332889+0000","last_fullsized":"2024-09-12T12:16:21.332889+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.995518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332976+0000","last_change":"2024-09-12T12:16:20.317519+0000","last_active":"2024-09-12T12:16:21.332976+0000","last_peered":"2024-09-12T12:16:21.332976+0000","last_clean":"2024-09-12T12:16:21.332976+0000","last_became_active":"2024-09-12T12:16:20.317271+0000","last_became_peered":"2024-09-12T12:16:20.317271+0000","last_unstale":"2024-09-12T12:16:21.332976+0000","last_undegraded":"2024-09-12T12:16:21.332976+0000","last_fullsized":"2024-09-12T12:16:21.332976+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:39.669084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333365+0000","last_change":"2024-09-12T12:16:20.305205+0000","last_active":"2024-09-12T12:16:21.333365+0000","last_peered":"2024-09-12T12:16:21.333365+0000","last_clean":"2024-09-12T12:16:21.333365+0000","last_became_active":"2024-09-12T12:16:20.304958+0000","last_became_peered":"2024-09-12T12:16:20.304958+0000","last_unstale":"2024-09-12T12:16:21.333365+0000","last_undegraded":"2024-09-12T12:16:21.333365+0000","last_fullsized":"2024-09-12T12:16:21.333365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:28.576261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334998+0000","last_change":"2024-09-12T12:16:20.310044+0000","last_active":"2024-09-12T12:16:21.334998+0000","last_peered":"2024-09-12T12:16:21.334998+0000","last_clean":"2024-09-12T12:16:21.334998+0000","last_became_active":"2024-09-12T12:16:20.307892+0000","last_became_peered":"2024-09-12T12:16:20.307892+0000","last_unstale":"2024-09-12T12:16:21.334998+0000","last_undegraded":"2024-09-12T12:16:21.334998+0000","last_fullsized":"2024-09-12T12:16:21.334998+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:40.045913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305890+0000","last_change":"2024-09-12T12:16:20.305852+0000","last_active":"2024-09-12T12:16:21.305890+0000","last_peered":"2024-09-12T12:16:21.305890+0000","last_clean":"2024-09-12T12:16:21.305890+0000","last_became_active":"2024-09-12T12:16:20.305604+0000","last_became_peered":"2024-09-12T12:16:20.305604+0000","last_unstale":"2024-09-12T12:16:21.305890+0000","last_undegraded":"2024-09-12T12:16:21.305890+0000","last_fullsized":"2024-09-12T12:16:21.305890+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:43.637160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305429+0000","last_change":"2024-09-12T12:16:20.302076+0000","last_active":"2024-09-12T12:16:21.305429+0000","last_peered":"2024-09-12T12:16:21.305429+0000","last_clean":"2024-09-12T12:16:21.305429+0000","last_became_active":"2024-09-12T12:16:20.301817+0000","last_became_peered":"2024-09-12T12:16:20.301817+0000","last_unstale":"2024-09-12T12:16:21.305429+0000","last_undegraded":"2024-09-12T12:16:21.305429+0000","last_fullsized":"2024-09-12T12:16:21.305429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:24.422064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333810+0000","last_change":"2024-09-12T12:16:20.293969+0000","last_active":"2024-09-12T12:16:21.333810+0000","last_peered":"2024-09-12T12:16:21.333810+0000","last_clean":"2024-09-12T12:16:21.333810+0000","last_became_active":"2024-09-12T12:16:20.293690+0000","last_became_peered":"2024-09-12T12:16:20.293690+0000","last_unstale":"2024-09-12T12:16:21.333810+0000","last_undegraded":"2024-09-12T12:16:21.333810+0000","last_fullsized":"2024-09-12T12:16:21.333810+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:48.095717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333121+0000","last_change":"2024-09-12T12:16:20.306496+0000","last_active":"2024-09-12T12:16:21.333121+0000","last_peered":"2024-09-12T12:16:21.333121+0000","last_clean":"2024-09-12T12:16:21.333121+0000","last_became_active":"2024-09-12T12:16:20.306202+0000","last_became_peered":"2024-09-12T12:16:20.306202+0000","last_unstale":"2024-09-12T12:16:21.333121+0000","last_undegraded":"2024-09-12T12:16:21.333121+0000","last_fullsized":"2024-09-12T12:16:21.333121+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:39.669084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333637+0000","last_change":"2024-09-12T12:16:20.320098+0000","last_active":"2024-09-12T12:16:21.333637+0000","last_peered":"2024-09-12T12:16:21.333637+0000","last_clean":"2024-09-12T12:16:21.333637+0000","last_became_active":"2024-09-12T12:16:20.319837+0000","last_became_peered":"2024-09-12T12:16:20.319837+0000","last_unstale":"2024-09-12T12:16:21.333637+0000","last_undegraded":"2024-09-12T12:16:21.333637+0000","last_fullsized":"2024-09-12T12:16:21.333637+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:13.317753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333329+0000","last_change":"2024-09-12T12:16:20.319730+0000","last_active":"2024-09-12T12:16:21.333329+0000","last_peered":"2024-09-12T12:16:21.333329+0000","last_clean":"2024-09-12T12:16:21.333329+0000","last_became_active":"2024-09-12T12:16:20.319440+0000","last_became_peered":"2024-09-12T12:16:20.319440+0000","last_unstale":"2024-09-12T12:16:21.333329+0000","last_undegraded":"2024-09-12T12:16:21.333329+0000","last_fullsized":"2024-09-12T12:16:21.333329+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:25.373924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332532+0000","last_change":"2024-09-12T12:16:20.316998+0000","last_active":"2024-09-12T12:16:21.332532+0000","last_peered":"2024-09-12T12:16:21.332532+0000","last_clean":"2024-09-12T12:16:21.332532+0000","last_became_active":"2024-09-12T12:16:20.315759+0000","last_became_peered":"2024-09-12T12:16:20.315759+0000","last_unstale":"2024-09-12T12:16:21.332532+0000","last_undegraded":"2024-09-12T12:16:21.332532+0000","last_fullsized":"2024-09-12T12:16:21.332532+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:34.003140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332991+0000","last_change":"2024-09-12T12:16:20.308330+0000","last_active":"2024-09-12T12:16:21.332991+0000","last_peered":"2024-09-12T12:16:21.332991+0000","last_clean":"2024-09-12T12:16:21.332991+0000","last_became_active":"2024-09-12T12:16:20.308034+0000","last_became_peered":"2024-09-12T12:16:20.308034+0000","last_unstale":"2024-09-12T12:16:21.332991+0000","last_undegraded":"2024-09-12T12:16:21.332991+0000","last_fullsized":"2024-09-12T12:16:21.332991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:54.995518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333268+0000","last_change":"2024-09-12T12:16:20.301302+0000","last_active":"2024-09-12T12:16:21.333268+0000","last_peered":"2024-09-12T12:16:21.333268+0000","last_clean":"2024-09-12T12:16:21.333268+0000","last_became_active":"2024-09-12T12:16:20.300988+0000","last_became_peered":"2024-09-12T12:16:20.300988+0000","last_unstale":"2024-09-12T12:16:21.333268+0000","last_undegraded":"2024-09-12T12:16:21.333268+0000","last_fullsized":"2024-09-12T12:16:21.333268+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:49.379152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305553+0000","last_change":"2024-09-12T12:16:20.301860+0000","last_active":"2024-09-12T12:16:21.305553+0000","last_peered":"2024-09-12T12:16:21.305553+0000","last_clean":"2024-09-12T12:16:21.305553+0000","last_became_active":"2024-09-12T12:16:20.301611+0000","last_became_peered":"2024-09-12T12:16:20.301611+0000","last_unstale":"2024-09-12T12:16:21.305553+0000","last_undegraded":"2024-09-12T12:16:21.305553+0000","last_fullsized":"2024-09-12T12:16:21.305553+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:05.943000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334552+0000","last_change":"2024-09-12T12:16:20.309620+0000","last_active":"2024-09-12T12:16:21.334552+0000","last_peered":"2024-09-12T12:16:21.334552+0000","last_clean":"2024-09-12T12:16:21.334552+0000","last_became_active":"2024-09-12T12:16:20.309239+0000","last_became_peered":"2024-09-12T12:16:20.309239+0000","last_unstale":"2024-09-12T12:16:21.334552+0000","last_undegraded":"2024-09-12T12:16:21.334552+0000","last_fullsized":"2024-09-12T12:16:21.334552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:51.925913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332870+0000","last_change":"2024-09-12T12:16:20.321856+0000","last_active":"2024-09-12T12:16:21.332870+0000","last_peered":"2024-09-12T12:16:21.332870+0000","last_clean":"2024-09-12T12:16:21.332870+0000","last_became_active":"2024-09-12T12:16:20.318416+0000","last_became_peered":"2024-09-12T12:16:20.318416+0000","last_unstale":"2024-09-12T12:16:21.332870+0000","last_undegraded":"2024-09-12T12:16:21.332870+0000","last_fullsized":"2024-09-12T12:16:21.332870+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:53.460435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333418+0000","last_change":"2024-09-12T12:16:20.321084+0000","last_active":"2024-09-12T12:16:21.333418+0000","last_peered":"2024-09-12T12:16:21.333418+0000","last_clean":"2024-09-12T12:16:21.333418+0000","last_became_active":"2024-09-12T12:16:20.320750+0000","last_became_peered":"2024-09-12T12:16:20.320750+0000","last_unstale":"2024-09-12T12:16:21.333418+0000","last_undegraded":"2024-09-12T12:16:21.333418+0000","last_fullsized":"2024-09-12T12:16:21.333418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:32.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304542+0000","last_change":"2024-09-12T12:16:20.301081+0000","last_active":"2024-09-12T12:16:21.304542+0000","last_peered":"2024-09-12T12:16:21.304542+0000","last_clean":"2024-09-12T12:16:21.304542+0000","last_became_active":"2024-09-12T12:16:20.300822+0000","last_became_peered":"2024-09-12T12:16:20.300822+0000","last_unstale":"2024-09-12T12:16:21.304542+0000","last_undegraded":"2024-09-12T12:16:21.304542+0000","last_fullsized":"2024-09-12T12:16:21.304542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:10.380089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.301942+0000","last_change":"2024-09-12T12:16:20.301489+0000","last_active":"2024-09-12T12:16:21.301942+0000","last_peered":"2024-09-12T12:16:21.301942+0000","last_clean":"2024-09-12T12:16:21.301942+0000","last_became_active":"2024-09-12T12:16:20.300839+0000","last_became_peered":"2024-09-12T12:16:20.300839+0000","last_unstale":"2024-09-12T12:16:21.301942+0000","last_undegraded":"2024-09-12T12:16:21.301942+0000","last_fullsized":"2024-09-12T12:16:21.301942+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:32.195098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305153+0000","last_change":"2024-09-12T12:16:20.307368+0000","last_active":"2024-09-12T12:16:21.305153+0000","last_peered":"2024-09-12T12:16:21.305153+0000","last_clean":"2024-09-12T12:16:21.305153+0000","last_became_active":"2024-09-12T12:16:20.307049+0000","last_became_peered":"2024-09-12T12:16:20.307049+0000","last_unstale":"2024-09-12T12:16:21.305153+0000","last_undegraded":"2024-09-12T12:16:21.305153+0000","last_fullsized":"2024-09-12T12:16:21.305153+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:42.984541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.335048+0000","last_change":"2024-09-12T12:16:19.292137+0000","last_active":"2024-09-12T12:16:21.335048+0000","last_peered":"2024-09-12T12:16:21.335048+0000","last_clean":"2024-09-12T12:16:21.335048+0000","last_became_active":"2024-09-12T12:16:19.291503+0000","last_became_peered":"2024-09-12T12:16:19.291503+0000","last_unstale":"2024-09-12T12:16:21.335048+0000","last_undegraded":"2024-09-12T12:16:21.335048+0000","last_fullsized":"2024-09-12T12:16:21.335048+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:04.936869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305729+0000","last_change":"2024-09-12T12:16:20.307787+0000","last_active":"2024-09-12T12:16:21.305729+0000","last_peered":"2024-09-12T12:16:21.305729+0000","last_clean":"2024-09-12T12:16:21.305729+0000","last_became_active":"2024-09-12T12:16:20.307479+0000","last_became_peered":"2024-09-12T12:16:20.307479+0000","last_unstale":"2024-09-12T12:16:21.305729+0000","last_undegraded":"2024-09-12T12:16:21.305729+0000","last_fullsized":"2024-09-12T12:16:21.305729+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:11.789454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302502+0000","last_change":"2024-09-12T12:16:19.290400+0000","last_active":"2024-09-12T12:16:21.302502+0000","last_peered":"2024-09-12T12:16:21.302502+0000","last_clean":"2024-09-12T12:16:21.302502+0000","last_became_active":"2024-09-12T12:16:19.290156+0000","last_became_peered":"2024-09-12T12:16:19.290156+0000","last_unstale":"2024-09-12T12:16:21.302502+0000","last_undegraded":"2024-09-12T12:16:21.302502+0000","last_fullsized":"2024-09-12T12:16:21.302502+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:27.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302473+0000","last_change":"2024-09-12T12:16:20.301282+0000","last_active":"2024-09-12T12:16:21.302473+0000","last_peered":"2024-09-12T12:16:21.302473+0000","last_clean":"2024-09-12T12:16:21.302473+0000","last_became_active":"2024-09-12T12:16:20.301021+0000","last_became_peered":"2024-09-12T12:16:20.301021+0000","last_unstale":"2024-09-12T12:16:21.302473+0000","last_undegraded":"2024-09-12T12:16:21.302473+0000","last_fullsized":"2024-09-12T12:16:21.302473+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.469814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302348+0000","last_change":"2024-09-12T12:16:19.287826+0000","last_active":"2024-09-12T12:16:21.302348+0000","last_peered":"2024-09-12T12:16:21.302348+0000","last_clean":"2024-09-12T12:16:21.302348+0000","last_became_active":"2024-09-12T12:16:19.287566+0000","last_became_peered":"2024-09-12T12:16:19.287566+0000","last_unstale":"2024-09-12T12:16:21.302348+0000","last_undegraded":"2024-09-12T12:16:21.302348+0000","last_fullsized":"2024-09-12T12:16:21.302348+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:41.880340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333771+0000","last_change":"2024-09-12T12:16:20.321875+0000","last_active":"2024-09-12T12:16:21.333771+0000","last_peered":"2024-09-12T12:16:21.333771+0000","last_clean":"2024-09-12T12:16:21.333771+0000","last_became_active":"2024-09-12T12:16:20.318381+0000","last_became_peered":"2024-09-12T12:16:20.318381+0000","last_unstale":"2024-09-12T12:16:21.333771+0000","last_undegraded":"2024-09-12T12:16:21.333771+0000","last_fullsized":"2024-09-12T12:16:21.333771+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:13.752872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302337+0000","last_change":"2024-09-12T12:16:19.293865+0000","last_active":"2024-09-12T12:16:21.302337+0000","last_peered":"2024-09-12T12:16:21.302337+0000","last_clean":"2024-09-12T12:16:21.302337+0000","last_became_active":"2024-09-12T12:16:19.293483+0000","last_became_peered":"2024-09-12T12:16:19.293483+0000","last_unstale":"2024-09-12T12:16:21.302337+0000","last_undegraded":"2024-09-12T12:16:21.302337+0000","last_fullsized":"2024-09-12T12:16:21.302337+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:01.253597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333742+0000","last_change":"2024-09-12T12:16:20.305632+0000","last_active":"2024-09-12T12:16:21.333742+0000","last_peered":"2024-09-12T12:16:21.333742+0000","last_clean":"2024-09-12T12:16:21.333742+0000","last_became_active":"2024-09-12T12:16:20.302535+0000","last_became_peered":"2024-09-12T12:16:20.302535+0000","last_unstale":"2024-09-12T12:16:21.333742+0000","last_undegraded":"2024-09-12T12:16:21.333742+0000","last_fullsized":"2024-09-12T12:16:21.333742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:39.700162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333718+0000","last_change":"2024-09-12T12:16:19.287050+0000","last_active":"2024-09-12T12:16:21.333718+0000","last_peered":"2024-09-12T12:16:21.333718+0000","last_clean":"2024-09-12T12:16:21.333718+0000","last_became_active":"2024-09-12T12:16:19.285906+0000","last_became_peered":"2024-09-12T12:16:19.285906+0000","last_unstale":"2024-09-12T12:16:21.333718+0000","last_undegraded":"2024-09-12T12:16:21.333718+0000","last_fullsized":"2024-09-12T12:16:21.333718+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:25:31.188968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334366+0000","last_change":"2024-09-12T12:16:20.300551+0000","last_active":"2024-09-12T12:16:21.334366+0000","last_peered":"2024-09-12T12:16:21.334366+0000","last_clean":"2024-09-12T12:16:21.334366+0000","last_became_active":"2024-09-12T12:16:20.300000+0000","last_became_peered":"2024-09-12T12:16:20.300000+0000","last_unstale":"2024-09-12T12:16:21.334366+0000","last_undegraded":"2024-09-12T12:16:21.334366+0000","last_fullsized":"2024-09-12T12:16:21.334366+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:24.422064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333489+0000","last_change":"2024-09-12T12:16:19.284576+0000","last_active":"2024-09-12T12:16:21.333489+0000","last_peered":"2024-09-12T12:16:21.333489+0000","last_clean":"2024-09-12T12:16:21.333489+0000","last_became_active":"2024-09-12T12:16:19.284314+0000","last_became_peered":"2024-09-12T12:16:19.284314+0000","last_unstale":"2024-09-12T12:16:21.333489+0000","last_undegraded":"2024-09-12T12:16:21.333489+0000","last_fullsized":"2024-09-12T12:16:21.333489+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:48.373021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304718+0000","last_change":"2024-09-12T12:16:20.293668+0000","last_active":"2024-09-12T12:16:21.304718+0000","last_peered":"2024-09-12T12:16:21.304718+0000","last_clean":"2024-09-12T12:16:21.304718+0000","last_became_active":"2024-09-12T12:16:20.293383+0000","last_became_peered":"2024-09-12T12:16:20.293383+0000","last_unstale":"2024-09-12T12:16:21.304718+0000","last_undegraded":"2024-09-12T12:16:21.304718+0000","last_fullsized":"2024-09-12T12:16:21.304718+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:56.645544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333423+0000","last_change":"2024-09-12T12:16:19.286530+0000","last_active":"2024-09-12T12:16:21.333423+0000","last_peered":"2024-09-12T12:16:21.333423+0000","last_clean":"2024-09-12T12:16:21.333423+0000","last_became_active":"2024-09-12T12:16:19.285761+0000","last_became_peered":"2024-09-12T12:16:19.285761+0000","last_unstale":"2024-09-12T12:16:21.333423+0000","last_undegraded":"2024-09-12T12:16:21.333423+0000","last_fullsized":"2024-09-12T12:16:21.333423+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:25:38.662954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333590+0000","last_change":"2024-09-12T12:16:20.294267+0000","last_active":"2024-09-12T12:16:21.333590+0000","last_peered":"2024-09-12T12:16:21.333590+0000","last_clean":"2024-09-12T12:16:21.333590+0000","last_became_active":"2024-09-12T12:16:20.293981+0000","last_became_peered":"2024-09-12T12:16:20.293981+0000","last_unstale":"2024-09-12T12:16:21.333590+0000","last_undegraded":"2024-09-12T12:16:21.333590+0000","last_fullsized":"2024-09-12T12:16:21.333590+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:00.093517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304396+0000","last_change":"2024-09-12T12:16:19.280332+0000","last_active":"2024-09-12T12:16:21.304396+0000","last_peered":"2024-09-12T12:16:21.304396+0000","last_clean":"2024-09-12T12:16:21.304396+0000","last_became_active":"2024-09-12T12:16:19.280016+0000","last_became_peered":"2024-09-12T12:16:19.280016+0000","last_unstale":"2024-09-12T12:16:21.304396+0000","last_undegraded":"2024-09-12T12:16:21.304396+0000","last_fullsized":"2024-09-12T12:16:21.304396+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:55.375924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334561+0000","last_change":"2024-09-12T12:16:20.301589+0000","last_active":"2024-09-12T12:16:21.334561+0000","last_peered":"2024-09-12T12:16:21.334561+0000","last_clean":"2024-09-12T12:16:21.334561+0000","last_became_active":"2024-09-12T12:16:20.301329+0000","last_became_peered":"2024-09-12T12:16:20.301329+0000","last_unstale":"2024-09-12T12:16:21.334561+0000","last_undegraded":"2024-09-12T12:16:21.334561+0000","last_fullsized":"2024-09-12T12:16:21.334561+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:41.985212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333869+0000","last_change":"2024-09-12T12:16:19.293341+0000","last_active":"2024-09-12T12:16:21.333869+0000","last_peered":"2024-09-12T12:16:21.333869+0000","last_clean":"2024-09-12T12:16:21.333869+0000","last_became_active":"2024-09-12T12:16:19.293054+0000","last_became_peered":"2024-09-12T12:16:19.293054+0000","last_unstale":"2024-09-12T12:16:21.333869+0000","last_undegraded":"2024-09-12T12:16:21.333869+0000","last_fullsized":"2024-09-12T12:16:21.333869+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:39.039782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333842+0000","last_change":"2024-09-12T12:16:20.302704+0000","last_active":"2024-09-12T12:16:21.333842+0000","last_peered":"2024-09-12T12:16:21.333842+0000","last_clean":"2024-09-12T12:16:21.333842+0000","last_became_active":"2024-09-12T12:16:20.302430+0000","last_became_peered":"2024-09-12T12:16:20.302430+0000","last_unstale":"2024-09-12T12:16:21.333842+0000","last_undegraded":"2024-09-12T12:16:21.333842+0000","last_fullsized":"2024-09-12T12:16:21.333842+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:26:32.756030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.306056+0000","last_change":"2024-09-12T12:16:19.291302+0000","last_active":"2024-09-12T12:16:21.306056+0000","last_peered":"2024-09-12T12:16:21.306056+0000","last_clean":"2024-09-12T12:16:21.306056+0000","last_became_active":"2024-09-12T12:16:19.291059+0000","last_became_peered":"2024-09-12T12:16:19.291059+0000","last_unstale":"2024-09-12T12:16:21.306056+0000","last_undegraded":"2024-09-12T12:16:21.306056+0000","last_fullsized":"2024-09-12T12:16:21.306056+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:16.317990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305695+0000","last_change":"2024-09-12T12:16:20.299586+0000","last_active":"2024-09-12T12:16:21.305695+0000","last_peered":"2024-09-12T12:16:21.305695+0000","last_clean":"2024-09-12T12:16:21.305695+0000","last_became_active":"2024-09-12T12:16:20.299278+0000","last_became_peered":"2024-09-12T12:16:20.299278+0000","last_unstale":"2024-09-12T12:16:21.305695+0000","last_undegraded":"2024-09-12T12:16:21.305695+0000","last_fullsized":"2024-09-12T12:16:21.305695+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:41.985212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333430+0000","last_change":"2024-09-12T12:16:19.293736+0000","last_active":"2024-09-12T12:16:21.333430+0000","last_peered":"2024-09-12T12:16:21.333430+0000","last_clean":"2024-09-12T12:16:21.333430+0000","last_became_active":"2024-09-12T12:16:19.293370+0000","last_became_peered":"2024-09-12T12:16:19.293370+0000","last_unstale":"2024-09-12T12:16:21.333430+0000","last_undegraded":"2024-09-12T12:16:21.333430+0000","last_fullsized":"2024-09-12T12:16:21.333430+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:24.499881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.306010+0000","last_change":"2024-09-12T12:16:20.302446+0000","last_active":"2024-09-12T12:16:21.306010+0000","last_peered":"2024-09-12T12:16:21.306010+0000","last_clean":"2024-09-12T12:16:21.306010+0000","last_became_active":"2024-09-12T12:16:20.301409+0000","last_became_peered":"2024-09-12T12:16:20.301409+0000","last_unstale":"2024-09-12T12:16:21.306010+0000","last_undegraded":"2024-09-12T12:16:21.306010+0000","last_fullsized":"2024-09-12T12:16:21.306010+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:20.584453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334681+0000","last_change":"2024-09-12T12:16:19.293140+0000","last_active":"2024-09-12T12:16:21.334681+0000","last_peered":"2024-09-12T12:16:21.334681+0000","last_clean":"2024-09-12T12:16:21.334681+0000","last_became_active":"2024-09-12T12:16:19.292230+0000","last_became_peered":"2024-09-12T12:16:19.292230+0000","last_unstale":"2024-09-12T12:16:21.334681+0000","last_undegraded":"2024-09-12T12:16:21.334681+0000","last_fullsized":"2024-09-12T12:16:21.334681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:23.923254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304549+0000","last_change":"2024-09-12T12:16:20.318950+0000","last_active":"2024-09-12T12:16:21.304549+0000","last_peered":"2024-09-12T12:16:21.304549+0000","last_clean":"2024-09-12T12:16:21.304549+0000","last_became_active":"2024-09-12T12:16:20.318700+0000","last_became_peered":"2024-09-12T12:16:20.318700+0000","last_unstale":"2024-09-12T12:16:21.304549+0000","last_undegraded":"2024-09-12T12:16:21.304549+0000","last_fullsized":"2024-09-12T12:16:21.304549+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:10.464147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332977+0000","last_change":"2024-09-12T12:16:19.289406+0000","last_active":"2024-09-12T12:16:21.332977+0000","last_peered":"2024-09-12T12:16:21.332977+0000","last_clean":"2024-09-12T12:16:21.332977+0000","last_became_active":"2024-09-12T12:16:19.288998+0000","last_became_peered":"2024-09-12T12:16:19.288998+0000","last_unstale":"2024-09-12T12:16:21.332977+0000","last_undegraded":"2024-09-12T12:16:21.332977+0000","last_fullsized":"2024-09-12T12:16:21.332977+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:04.104037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332811+0000","last_change":"2024-09-12T12:16:20.305753+0000","last_active":"2024-09-12T12:16:21.332811+0000","last_peered":"2024-09-12T12:16:21.332811+0000","last_clean":"2024-09-12T12:16:21.332811+0000","last_became_active":"2024-09-12T12:16:20.305484+0000","last_became_peered":"2024-09-12T12:16:20.305484+0000","last_unstale":"2024-09-12T12:16:21.332811+0000","last_undegraded":"2024-09-12T12:16:21.332811+0000","last_fullsized":"2024-09-12T12:16:21.332811+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:34.003140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332455+0000","last_change":"2024-09-12T12:16:19.295064+0000","last_active":"2024-09-12T12:16:21.332455+0000","last_peered":"2024-09-12T12:16:21.332455+0000","last_clean":"2024-09-12T12:16:21.332455+0000","last_became_active":"2024-09-12T12:16:19.294669+0000","last_became_peered":"2024-09-12T12:16:19.294669+0000","last_unstale":"2024-09-12T12:16:21.332455+0000","last_undegraded":"2024-09-12T12:16:21.332455+0000","last_fullsized":"2024-09-12T12:16:21.332455+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:30:41.978411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304720+0000","last_change":"2024-09-12T12:16:20.297430+0000","last_active":"2024-09-12T12:16:21.304720+0000","last_peered":"2024-09-12T12:16:21.304720+0000","last_clean":"2024-09-12T12:16:21.304720+0000","last_became_active":"2024-09-12T12:16:20.297177+0000","last_became_peered":"2024-09-12T12:16:20.297177+0000","last_unstale":"2024-09-12T12:16:21.304720+0000","last_undegraded":"2024-09-12T12:16:21.304720+0000","last_fullsized":"2024-09-12T12:16:21.304720+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:20.584453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333184+0000","last_change":"2024-09-12T12:16:19.293730+0000","last_active":"2024-09-12T12:16:21.333184+0000","last_peered":"2024-09-12T12:16:21.333184+0000","last_clean":"2024-09-12T12:16:21.333184+0000","last_became_active":"2024-09-12T12:16:19.292943+0000","last_became_peered":"2024-09-12T12:16:19.292943+0000","last_unstale":"2024-09-12T12:16:21.333184+0000","last_undegraded":"2024-09-12T12:16:21.333184+0000","last_fullsized":"2024-09-12T12:16:21.333184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:07.452549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334553+0000","last_change":"2024-09-12T12:16:20.319403+0000","last_active":"2024-09-12T12:16:21.334553+0000","last_peered":"2024-09-12T12:16:21.334553+0000","last_clean":"2024-09-12T12:16:21.334553+0000","last_became_active":"2024-09-12T12:16:20.319104+0000","last_became_peered":"2024-09-12T12:16:20.319104+0000","last_unstale":"2024-09-12T12:16:21.334553+0000","last_undegraded":"2024-09-12T12:16:21.334553+0000","last_fullsized":"2024-09-12T12:16:21.334553+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:05.110167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304232+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:21.304232+0000","last_peered":"2024-09-12T12:16:21.304232+0000","last_clean":"2024-09-12T12:16:21.304232+0000","last_became_active":"2024-09-12T12:16:19.285395+0000","last_became_peered":"2024-09-12T12:16:19.285395+0000","last_unstale":"2024-09-12T12:16:21.304232+0000","last_undegraded":"2024-09-12T12:16:21.304232+0000","last_fullsized":"2024-09-12T12:16:21.304232+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:38.653133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333241+0000","last_change":"2024-09-12T12:16:20.316024+0000","last_active":"2024-09-12T12:16:21.333241+0000","last_peered":"2024-09-12T12:16:21.333241+0000","last_clean":"2024-09-12T12:16:21.333241+0000","last_became_active":"2024-09-12T12:16:20.315701+0000","last_became_peered":"2024-09-12T12:16:20.315701+0000","last_unstale":"2024-09-12T12:16:21.333241+0000","last_undegraded":"2024-09-12T12:16:21.333241+0000","last_fullsized":"2024-09-12T12:16:21.333241+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:49.379152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333067+0000","last_change":"2024-09-12T12:16:19.293036+0000","last_active":"2024-09-12T12:16:21.333067+0000","last_peered":"2024-09-12T12:16:21.333067+0000","last_clean":"2024-09-12T12:16:21.333067+0000","last_became_active":"2024-09-12T12:16:19.292655+0000","last_became_peered":"2024-09-12T12:16:19.292655+0000","last_unstale":"2024-09-12T12:16:21.333067+0000","last_undegraded":"2024-09-12T12:16:21.333067+0000","last_fullsized":"2024-09-12T12:16:21.333067+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:07.452549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305444+0000","last_change":"2024-09-12T12:16:20.293789+0000","last_active":"2024-09-12T12:16:21.305444+0000","last_peered":"2024-09-12T12:16:21.305444+0000","last_clean":"2024-09-12T12:16:21.305444+0000","last_became_active":"2024-09-12T12:16:20.293512+0000","last_became_peered":"2024-09-12T12:16:20.293512+0000","last_unstale":"2024-09-12T12:16:21.305444+0000","last_undegraded":"2024-09-12T12:16:21.305444+0000","last_fullsized":"2024-09-12T12:16:21.305444+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:08.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333692+0000","last_change":"2024-09-12T12:16:19.294158+0000","last_active":"2024-09-12T12:16:21.333692+0000","last_peered":"2024-09-12T12:16:21.333692+0000","last_clean":"2024-09-12T12:16:21.333692+0000","last_became_active":"2024-09-12T12:16:19.293849+0000","last_became_peered":"2024-09-12T12:16:19.293849+0000","last_unstale":"2024-09-12T12:16:21.333692+0000","last_undegraded":"2024-09-12T12:16:21.333692+0000","last_fullsized":"2024-09-12T12:16:21.333692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:50.919783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305992+0000","last_change":"2024-09-12T12:16:20.303417+0000","last_active":"2024-09-12T12:16:21.305992+0000","last_peered":"2024-09-12T12:16:21.305992+0000","last_clean":"2024-09-12T12:16:21.305992+0000","last_became_active":"2024-09-12T12:16:20.302754+0000","last_became_peered":"2024-09-12T12:16:20.302754+0000","last_unstale":"2024-09-12T12:16:21.305992+0000","last_undegraded":"2024-09-12T12:16:21.305992+0000","last_fullsized":"2024-09-12T12:16:21.305992+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:50.058156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333599+0000","last_change":"2024-09-12T12:16:19.293944+0000","last_active":"2024-09-12T12:16:21.333599+0000","last_peered":"2024-09-12T12:16:21.333599+0000","last_clean":"2024-09-12T12:16:21.333599+0000","last_became_active":"2024-09-12T12:16:19.293392+0000","last_became_peered":"2024-09-12T12:16:19.293392+0000","last_unstale":"2024-09-12T12:16:21.333599+0000","last_undegraded":"2024-09-12T12:16:21.333599+0000","last_fullsized":"2024-09-12T12:16:21.333599+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:39:06.161074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305668+0000","last_change":"2024-09-12T12:16:20.301937+0000","last_active":"2024-09-12T12:16:21.305668+0000","last_peered":"2024-09-12T12:16:21.305668+0000","last_clean":"2024-09-12T12:16:21.305668+0000","last_became_active":"2024-09-12T12:16:20.301675+0000","last_became_peered":"2024-09-12T12:16:20.301675+0000","last_unstale":"2024-09-12T12:16:21.305668+0000","last_undegraded":"2024-09-12T12:16:21.305668+0000","last_fullsized":"2024-09-12T12:16:21.305668+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:05.110167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333901+0000","last_change":"2024-09-12T12:16:19.286376+0000","last_active":"2024-09-12T12:16:21.333901+0000","last_peered":"2024-09-12T12:16:21.333901+0000","last_clean":"2024-09-12T12:16:21.333901+0000","last_became_active":"2024-09-12T12:16:19.286111+0000","last_became_peered":"2024-09-12T12:16:19.286111+0000","last_unstale":"2024-09-12T12:16:21.333901+0000","last_undegraded":"2024-09-12T12:16:21.333901+0000","last_fullsized":"2024-09-12T12:16:21.333901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:12.746742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302031+0000","last_change":"2024-09-12T12:16:20.301731+0000","last_active":"2024-09-12T12:16:21.302031+0000","last_peered":"2024-09-12T12:16:21.302031+0000","last_clean":"2024-09-12T12:16:21.302031+0000","last_became_active":"2024-09-12T12:16:20.301217+0000","last_became_peered":"2024-09-12T12:16:20.301217+0000","last_unstale":"2024-09-12T12:16:21.302031+0000","last_undegraded":"2024-09-12T12:16:21.302031+0000","last_fullsized":"2024-09-12T12:16:21.302031+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:13.752872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302066+0000","last_change":"2024-09-12T12:16:19.289582+0000","last_active":"2024-09-12T12:16:21.302066+0000","last_peered":"2024-09-12T12:16:21.302066+0000","last_clean":"2024-09-12T12:16:21.302066+0000","last_became_active":"2024-09-12T12:16:19.289038+0000","last_became_peered":"2024-09-12T12:16:19.289038+0000","last_unstale":"2024-09-12T12:16:21.302066+0000","last_undegraded":"2024-09-12T12:16:21.302066+0000","last_fullsized":"2024-09-12T12:16:21.302066+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:15.706001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332480+0000","last_change":"2024-09-12T12:16:20.302567+0000","last_active":"2024-09-12T12:16:21.332480+0000","last_peered":"2024-09-12T12:16:21.332480+0000","last_clean":"2024-09-12T12:16:21.332480+0000","last_became_active":"2024-09-12T12:16:20.302198+0000","last_became_peered":"2024-09-12T12:16:20.302198+0000","last_unstale":"2024-09-12T12:16:21.332480+0000","last_undegraded":"2024-09-12T12:16:21.332480+0000","last_fullsized":"2024-09-12T12:16:21.332480+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:42.886470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332560+0000","last_change":"2024-09-12T12:16:19.293030+0000","last_active":"2024-09-12T12:16:21.332560+0000","last_peered":"2024-09-12T12:16:21.332560+0000","last_clean":"2024-09-12T12:16:21.332560+0000","last_became_active":"2024-09-12T12:16:19.292701+0000","last_became_peered":"2024-09-12T12:16:19.292701+0000","last_unstale":"2024-09-12T12:16:21.332560+0000","last_undegraded":"2024-09-12T12:16:21.332560+0000","last_fullsized":"2024-09-12T12:16:21.332560+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:23.415934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305082+0000","last_change":"2024-09-12T12:16:20.292965+0000","last_active":"2024-09-12T12:16:21.305082+0000","last_peered":"2024-09-12T12:16:21.305082+0000","last_clean":"2024-09-12T12:16:21.305082+0000","last_became_active":"2024-09-12T12:16:20.291159+0000","last_became_peered":"2024-09-12T12:16:20.291159+0000","last_unstale":"2024-09-12T12:16:21.305082+0000","last_undegraded":"2024-09-12T12:16:21.305082+0000","last_fullsized":"2024-09-12T12:16:21.305082+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:27.008905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302026+0000","last_change":"2024-09-12T12:16:19.286130+0000","last_active":"2024-09-12T12:16:21.302026+0000","last_peered":"2024-09-12T12:16:21.302026+0000","last_clean":"2024-09-12T12:16:21.302026+0000","last_became_active":"2024-09-12T12:16:19.285864+0000","last_became_peered":"2024-09-12T12:16:19.285864+0000","last_unstale":"2024-09-12T12:16:21.302026+0000","last_undegraded":"2024-09-12T12:16:21.302026+0000","last_fullsized":"2024-09-12T12:16:21.302026+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:07.149683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302542+0000","last_change":"2024-09-12T12:16:20.293901+0000","last_active":"2024-09-12T12:16:21.302542+0000","last_peered":"2024-09-12T12:16:21.302542+0000","last_clean":"2024-09-12T12:16:21.302542+0000","last_became_active":"2024-09-12T12:16:20.293633+0000","last_became_peered":"2024-09-12T12:16:20.293633+0000","last_unstale":"2024-09-12T12:16:21.302542+0000","last_undegraded":"2024-09-12T12:16:21.302542+0000","last_fullsized":"2024-09-12T12:16:21.302542+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:03.749884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":16,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333317+0000","last_change":"2024-09-12T12:16:19.289187+0000","last_active":"2024-09-12T12:16:21.333317+0000","last_peered":"2024-09-12T12:16:21.333317+0000","last_clean":"2024-09-12T12:16:21.333317+0000","last_became_active":"2024-09-12T12:16:19.286518+0000","last_became_peered":"2024-09-12T12:16:19.286518+0000","last_unstale":"2024-09-12T12:16:21.333317+0000","last_undegraded":"2024-09-12T12:16:21.333317+0000","last_fullsized":"2024-09-12T12:16:21.333317+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:04.104037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334078+0000","last_change":"2024-09-12T12:16:20.309213+0000","last_active":"2024-09-12T12:16:21.334078+0000","last_peered":"2024-09-12T12:16:21.334078+0000","last_clean":"2024-09-12T12:16:21.334078+0000","last_became_active":"2024-09-12T12:16:20.308934+0000","last_became_peered":"2024-09-12T12:16:20.308934+0000","last_unstale":"2024-09-12T12:16:21.334078+0000","last_undegraded":"2024-09-12T12:16:21.334078+0000","last_fullsized":"2024-09-12T12:16:21.334078+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:52.530003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"65'1","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333498+0000","last_change":"2024-09-12T12:16:19.285221+0000","last_active":"2024-09-12T12:16:21.333498+0000","last_peered":"2024-09-12T12:16:21.333498+0000","last_clean":"2024-09-12T12:16:21.333498+0000","last_became_active":"2024-09-12T12:16:19.284934+0000","last_became_peered":"2024-09-12T12:16:19.284934+0000","last_unstale":"2024-09-12T12:16:21.333498+0000","last_undegraded":"2024-09-12T12:16:21.333498+0000","last_fullsized":"2024-09-12T12:16:21.333498+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:40.979082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333361+0000","last_change":"2024-09-12T12:16:20.306106+0000","last_active":"2024-09-12T12:16:21.333361+0000","last_peered":"2024-09-12T12:16:21.333361+0000","last_clean":"2024-09-12T12:16:21.333361+0000","last_became_active":"2024-09-12T12:16:20.305819+0000","last_became_peered":"2024-09-12T12:16:20.305819+0000","last_unstale":"2024-09-12T12:16:21.333361+0000","last_undegraded":"2024-09-12T12:16:21.333361+0000","last_fullsized":"2024-09-12T12:16:21.333361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:41.675078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.302398+0000","last_change":"2024-09-12T12:16:19.285706+0000","last_active":"2024-09-12T12:16:21.302398+0000","last_peered":"2024-09-12T12:16:21.302398+0000","last_clean":"2024-09-12T12:16:21.302398+0000","last_became_active":"2024-09-12T12:16:19.285402+0000","last_became_peered":"2024-09-12T12:16:19.285402+0000","last_unstale":"2024-09-12T12:16:21.302398+0000","last_undegraded":"2024-09-12T12:16:21.302398+0000","last_fullsized":"2024-09-12T12:16:21.302398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:32.997009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305877+0000","last_change":"2024-09-12T12:16:20.304222+0000","last_active":"2024-09-12T12:16:21.305877+0000","last_peered":"2024-09-12T12:16:21.305877+0000","last_clean":"2024-09-12T12:16:21.305877+0000","last_became_active":"2024-09-12T12:16:20.303536+0000","last_became_peered":"2024-09-12T12:16:20.303536+0000","last_unstale":"2024-09-12T12:16:21.305877+0000","last_undegraded":"2024-09-12T12:16:21.305877+0000","last_fullsized":"2024-09-12T12:16:21.305877+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:51.925913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334673+0000","last_change":"2024-09-12T12:16:19.292693+0000","last_active":"2024-09-12T12:16:21.334673+0000","last_peered":"2024-09-12T12:16:21.334673+0000","last_clean":"2024-09-12T12:16:21.334673+0000","last_became_active":"2024-09-12T12:16:19.291920+0000","last_became_peered":"2024-09-12T12:16:19.291920+0000","last_unstale":"2024-09-12T12:16:21.334673+0000","last_undegraded":"2024-09-12T12:16:21.334673+0000","last_fullsized":"2024-09-12T12:16:21.334673+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:14.175986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304384+0000","last_change":"2024-09-12T12:16:20.298973+0000","last_active":"2024-09-12T12:16:21.304384+0000","last_peered":"2024-09-12T12:16:21.304384+0000","last_clean":"2024-09-12T12:16:21.304384+0000","last_became_active":"2024-09-12T12:16:20.298705+0000","last_became_peered":"2024-09-12T12:16:20.298705+0000","last_unstale":"2024-09-12T12:16:21.304384+0000","last_undegraded":"2024-09-12T12:16:21.304384+0000","last_fullsized":"2024-09-12T12:16:21.304384+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:43.637160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333093+0000","last_change":"2024-09-12T12:16:19.292882+0000","last_active":"2024-09-12T12:16:21.333093+0000","last_peered":"2024-09-12T12:16:21.333093+0000","last_clean":"2024-09-12T12:16:21.333093+0000","last_became_active":"2024-09-12T12:16:19.292639+0000","last_became_peered":"2024-09-12T12:16:19.292639+0000","last_unstale":"2024-09-12T12:16:21.333093+0000","last_undegraded":"2024-09-12T12:16:21.333093+0000","last_fullsized":"2024-09-12T12:16:21.333093+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:40.979082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.305056+0000","last_change":"2024-09-12T12:16:20.319963+0000","last_active":"2024-09-12T12:16:21.305056+0000","last_peered":"2024-09-12T12:16:21.305056+0000","last_clean":"2024-09-12T12:16:21.305056+0000","last_became_active":"2024-09-12T12:16:20.319680+0000","last_became_peered":"2024-09-12T12:16:20.319680+0000","last_unstale":"2024-09-12T12:16:21.305056+0000","last_undegraded":"2024-09-12T12:16:21.305056+0000","last_fullsized":"2024-09-12T12:16:21.305056+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:47:45.596477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333594+0000","last_change":"2024-09-12T12:16:19.294703+0000","last_active":"2024-09-12T12:16:21.333594+0000","last_peered":"2024-09-12T12:16:21.333594+0000","last_clean":"2024-09-12T12:16:21.333594+0000","last_became_active":"2024-09-12T12:16:19.294170+0000","last_became_peered":"2024-09-12T12:16:19.294170+0000","last_unstale":"2024-09-12T12:16:21.333594+0000","last_undegraded":"2024-09-12T12:16:21.333594+0000","last_fullsized":"2024-09-12T12:16:21.333594+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:11.463684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334466+0000","last_change":"2024-09-12T12:16:20.302578+0000","last_active":"2024-09-12T12:16:21.334466+0000","last_peered":"2024-09-12T12:16:21.334466+0000","last_clean":"2024-09-12T12:16:21.334466+0000","last_became_active":"2024-09-12T12:16:20.296455+0000","last_became_peered":"2024-09-12T12:16:20.296455+0000","last_unstale":"2024-09-12T12:16:21.334466+0000","last_undegraded":"2024-09-12T12:16:21.334466+0000","last_fullsized":"2024-09-12T12:16:21.334466+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:08.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333514+0000","last_change":"2024-09-12T12:16:19.285844+0000","last_active":"2024-09-12T12:16:21.333514+0000","last_peered":"2024-09-12T12:16:21.333514+0000","last_clean":"2024-09-12T12:16:21.333514+0000","last_became_active":"2024-09-12T12:16:19.285560+0000","last_became_peered":"2024-09-12T12:16:19.285560+0000","last_unstale":"2024-09-12T12:16:21.333514+0000","last_undegraded":"2024-09-12T12:16:21.333514+0000","last_fullsized":"2024-09-12T12:16:21.333514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:40.668948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333645+0000","last_change":"2024-09-12T12:16:20.309781+0000","last_active":"2024-09-12T12:16:21.333645+0000","last_peered":"2024-09-12T12:16:21.333645+0000","last_clean":"2024-09-12T12:16:21.333645+0000","last_became_active":"2024-09-12T12:16:20.309543+0000","last_became_peered":"2024-09-12T12:16:20.309543+0000","last_unstale":"2024-09-12T12:16:21.333645+0000","last_undegraded":"2024-09-12T12:16:21.333645+0000","last_fullsized":"2024-09-12T12:16:21.333645+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:24.531059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.334220+0000","last_change":"2024-09-12T12:16:19.293792+0000","last_active":"2024-09-12T12:16:21.334220+0000","last_peered":"2024-09-12T12:16:21.334220+0000","last_clean":"2024-09-12T12:16:21.334220+0000","last_became_active":"2024-09-12T12:16:19.293497+0000","last_became_peered":"2024-09-12T12:16:19.293497+0000","last_unstale":"2024-09-12T12:16:21.334220+0000","last_undegraded":"2024-09-12T12:16:21.334220+0000","last_fullsized":"2024-09-12T12:16:21.334220+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:47:44.590346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.304910+0000","last_change":"2024-09-12T12:16:20.298405+0000","last_active":"2024-09-12T12:16:21.304910+0000","last_peered":"2024-09-12T12:16:21.304910+0000","last_clean":"2024-09-12T12:16:21.304910+0000","last_became_active":"2024-09-12T12:16:20.298044+0000","last_became_peered":"2024-09-12T12:16:20.298044+0000","last_unstale":"2024-09-12T12:16:21.304910+0000","last_undegraded":"2024-09-12T12:16:21.304910+0000","last_fullsized":"2024-09-12T12:16:21.304910+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:19.263419+0000","last_clean_scrub_stamp":"2024-09-12T12:16:19.263419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:09.260451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.333194+0000","last_change":"2024-09-12T12:16:19.286473+0000","last_active":"2024-09-12T12:16:21.333194+0000","last_peered":"2024-09-12T12:16:21.333194+0000","last_clean":"2024-09-12T12:16:21.333194+0000","last_became_active":"2024-09-12T12:16:19.286196+0000","last_became_peered":"2024-09-12T12:16:19.286196+0000","last_unstale":"2024-09-12T12:16:21.333194+0000","last_undegraded":"2024-09-12T12:16:21.333194+0000","last_fullsized":"2024-09-12T12:16:21.333194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:16:18.257289+0000","last_clean_scrub_stamp":"2024-09-12T12:16:18.257289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:53.989387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":253,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-12T12:16:21.332609+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:16:21.332609+0000","last_peered":"2024-09-12T12:16:21.332609+0000","last_clean":"2024-09-12T12:16:21.332609+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:16:21.332609+0000","last_undegraded":"2024-09-12T12:16:21.332609+0000","last_fullsized":"2024-09-12T12:16:21.332609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":1396736,"data_stored":946830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36128,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335712,"statfs":{"total":96636764160,"available":96599769088,"internally_reserved":0,"allocated":790528,"data_stored":355720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":790528,"data_stored":355708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":798720,"data_stored":357298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":786432,"data_stored":355686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":786432,"data_stored":355686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36148,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335692,"statfs":{"total":96636764160,"available":96599748608,"internally_reserved":0,"allocated":815104,"data_stored":358062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40860,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330980,"statfs":{"total":96636764160,"available":96594923520,"internally_reserved":0,"allocated":1380352,"data_stored":946054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:16:29.314 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:16:29.314 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:16:29.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.495+0000 7f197ae00640 1 Processor -- start 2024-09-12T12:16:29.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.495+0000 7f197ae00640 1 -- start start 2024-09-12T12:16:29.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f197ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 0x7f1974073ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f197ae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f197406ea70 0x7f19740b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f197ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197406d730 con 0x7f19740b7220 2024-09-12T12:16:29.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f197ae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1974073550 con 0x7f197406ea70 2024-09-12T12:16:29.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f197ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f197415e950 con 0x7f197415e570 2024-09-12T12:16:29.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f1973400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f197406ea70 0x7f19740b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f1973e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 0x7f1974073ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f1973400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f197406ea70 0x7f19740b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:51464/0 (socket says 172.21.15.144:51464) 2024-09-12T12:16:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f1973400640 1 -- 172.21.15.144:0/3686923848 learned_addr learned my addr 172.21.15.144:0/3686923848 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f1973e00640 1 -- 172.21.15.144:0/3686923848 >> v2:172.21.15.165:3300/0 conn(0x7f197406ea70 msgr2=0x7f19740b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f1973e00640 1 --2- 172.21.15.144:0/3686923848 >> v2:172.21.15.165:3300/0 conn(0x7f197406ea70 0x7f19740b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f1973e00640 1 -- 172.21.15.144:0/3686923848 >> v1:172.21.15.165:6789/0 conn(0x7f19740b7220 legacy=0x7f197406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.499+0000 7f1973e00640 1 -- 172.21.15.144:0/3686923848 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197406d9d0 con 0x7f197415e570 2024-09-12T12:16:29.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f1973e00640 1 --2- 172.21.15.144:0/3686923848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 0x7f1974073ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f19640097c0 tx=0x7f196401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feb596cd0cac974f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f1972a00640 1 -- 172.21.15.144:0/3686923848 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b0070 con 0x7f197415e570 2024-09-12T12:16:29.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f1972a00640 1 -- 172.21.15.144:0/3686923848 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19640ab600 con 0x7f197415e570 2024-09-12T12:16:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f1972a00640 1 -- 172.21.15.144:0/3686923848 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640ab9d0 con 0x7f197415e570 2024-09-12T12:16:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 -- 172.21.15.144:0/3686923848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 msgr2=0x7f1974073ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 --2- 172.21.15.144:0/3686923848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 0x7f1974073ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f19640097c0 tx=0x7f196401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 -- 172.21.15.144:0/3686923848 shutdown_connections 2024-09-12T12:16:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 --2- 172.21.15.144:0/3686923848 >> v2:172.21.15.165:3300/0 conn(0x7f197406ea70 0x7f19740b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 --2- 172.21.15.144:0/3686923848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 0x7f1974073ad0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 -- 172.21.15.144:0/3686923848 >> 172.21.15.144:0/3686923848 conn(0x7f197406c010 msgr2=0x7f1974067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 -- 172.21.15.144:0/3686923848 shutdown_connections 2024-09-12T12:16:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 -- 172.21.15.144:0/3686923848 wait complete. 2024-09-12T12:16:29.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 Processor -- start 2024-09-12T12:16:29.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.503+0000 7f197ae00640 1 -- start start 2024-09-12T12:16:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f197ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f197406ea70 0x7f197414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f197ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19740b7220 0x7f1974155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f197ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 0x7f1974151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f197ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1974074010 con 0x7f19740b7220 2024-09-12T12:16:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f197ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19740b7650 con 0x7f197406ea70 2024-09-12T12:16:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f197ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1974074190 con 0x7f197415e570 2024-09-12T12:16:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19740b7220 0x7f1974155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19740b7220 0x7f1974155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52784/0 (socket says 172.21.15.144:52784) 2024-09-12T12:16:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973400640 1 -- 172.21.15.144:0/3838314476 learned_addr learned my addr 172.21.15.144:0/3838314476 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973e00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f197406ea70 0x7f197414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1978e00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 0x7f1974151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973400640 1 -- 172.21.15.144:0/3838314476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 msgr2=0x7f1974151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973400640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 0x7f1974151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973400640 1 -- 172.21.15.144:0/3838314476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f197406ea70 msgr2=0x7f197414ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973400640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f197406ea70 0x7f197414ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973400640 1 -- 172.21.15.144:0/3838314476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19741509c0 con 0x7f19740b7220 2024-09-12T12:16:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f1973400640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19740b7220 0x7f1974155830 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f196000e820 tx=0x7f196000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f196be00640 1 -- 172.21.15.144:0/3838314476 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960017070 con 0x7f19740b7220 2024-09-12T12:16:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f196be00640 1 -- 172.21.15.144:0/3838314476 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196000c940 con 0x7f19740b7220 2024-09-12T12:16:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1974150ca0 con 0x7f19740b7220 2024-09-12T12:16:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f196be00640 1 -- 172.21.15.144:0/3838314476 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196000ccf0 con 0x7f19740b7220 2024-09-12T12:16:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1974151260 con 0x7f19740b7220 2024-09-12T12:16:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19740b6ce0 con 0x7f19740b7220 2024-09-12T12:16:29.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.507+0000 7f196be00640 1 -- 172.21.15.144:0/3838314476 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f196001a070 con 0x7f19740b7220 2024-09-12T12:16:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.511+0000 7f196be00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19540678c0 0x7f1954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.511+0000 7f196be00640 1 -- 172.21.15.144:0/3838314476 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f19600860e0 con 0x7f19740b7220 2024-09-12T12:16:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.511+0000 7f1973e00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19540678c0 0x7f1954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.511+0000 7f1973e00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19540678c0 0x7f1954069d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f19640ad000 tx=0x7f19640a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.515+0000 7f196be00640 1 -- 172.21.15.144:0/3838314476 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f19600563a0 con 0x7f19740b7220 2024-09-12T12:16:29.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.731+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f19741591b0 con 0x7f19740b7220 2024-09-12T12:16:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f196be00640 1 -- 172.21.15.144:0/3838314476 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f196005a6a0 con 0x7f19740b7220 2024-09-12T12:16:29.736 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:16:29.736 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:16:29.736 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:16:29.736 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:16:29.736 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:16:29.736 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19540678c0 msgr2=0x7f1954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19540678c0 0x7f1954069d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f19640ad000 tx=0x7f19640a6000 comp rx=0 tx=0).stop 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19740b7220 msgr2=0x7f1974155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19740b7220 0x7f1974155830 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f196000e820 tx=0x7f196000ece0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 shutdown_connections 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19540678c0 0x7f1954069d80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f197415e570 0x7f1974151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19740b7220 0x7f1974155830 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 --2- 172.21.15.144:0/3838314476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f197406ea70 0x7f197414ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 >> 172.21.15.144:0/3838314476 conn(0x7f197406c010 msgr2=0x7f19741611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 shutdown_connections 2024-09-12T12:16:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.735+0000 7f197ae00640 1 -- 172.21.15.144:0/3838314476 wait complete. 2024-09-12T12:16:29.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:29.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.891+0000 7fe20bc00640 1 Processor -- start 2024-09-12T12:16:29.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.891+0000 7fe20bc00640 1 -- start start 2024-09-12T12:16:29.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.891+0000 7fe20bc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe20415cd30 0x7fe2040b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.891+0000 7fe20bc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe2040b5de0 0x7fe204072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.891+0000 7fe20bc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2040b61e0 con 0x7fe20415c7b0 2024-09-12T12:16:29.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.891+0000 7fe20bc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe204072a50 con 0x7fe20415cd30 2024-09-12T12:16:29.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.891+0000 7fe20bc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe2040cde30 con 0x7fe2040b5de0 2024-09-12T12:16:29.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe209200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe20415c7b0 0x7fe2040ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49956/0 (socket says 172.21.15.144:49956) 2024-09-12T12:16:29.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe209200640 1 -- 172.21.15.144:0/2879581051 learned_addr learned my addr 172.21.15.144:0/2879581051 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:29.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203e00640 1 --2- 172.21.15.144:0/2879581051 >> v2:172.21.15.144:3300/0 conn(0x7fe20415cd30 0x7fe2040b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe209c00640 1 --2- 172.21.15.144:0/2879581051 >> v2:172.21.15.165:3300/0 conn(0x7fe2040b5de0 0x7fe204072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203e00640 1 -- 172.21.15.144:0/2879581051 >> v2:172.21.15.165:3300/0 conn(0x7fe2040b5de0 msgr2=0x7fe204072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:29.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203e00640 1 --2- 172.21.15.144:0/2879581051 >> v2:172.21.15.165:3300/0 conn(0x7fe2040b5de0 0x7fe204072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203e00640 1 -- 172.21.15.144:0/2879581051 >> v1:172.21.15.144:6789/0 conn(0x7fe20415c7b0 legacy=0x7fe2040ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203e00640 1 -- 172.21.15.144:0/2879581051 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2040cd870 con 0x7fe20415cd30 2024-09-12T12:16:29.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203400640 1 -- 172.21.15.144:0/2879581051 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538445264 0 0) 0x7fe2040b61e0 con 0x7fe20415c7b0 2024-09-12T12:16:29.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203e00640 1 --2- 172.21.15.144:0/2879581051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 0x7fe2040b58a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe2040d0480 tx=0x7fe1f001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c41e36be26c5fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203400640 1 -- 172.21.15.144:0/2879581051 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f00b0070 con 0x7fe20415cd30 2024-09-12T12:16:29.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203400640 1 -- 172.21.15.144:0/2879581051 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f00ab600 con 0x7fe20415cd30 2024-09-12T12:16:29.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.895+0000 7fe203400640 1 -- 172.21.15.144:0/2879581051 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f00ab9d0 con 0x7fe20415cd30 2024-09-12T12:16:29.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 -- 172.21.15.144:0/2879581051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 msgr2=0x7fe2040b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 --2- 172.21.15.144:0/2879581051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 0x7fe2040b58a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe2040d0480 tx=0x7fe1f001c480 comp rx=0 tx=0).stop 2024-09-12T12:16:29.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 -- 172.21.15.144:0/2879581051 shutdown_connections 2024-09-12T12:16:29.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 --2- 172.21.15.144:0/2879581051 >> v2:172.21.15.165:3300/0 conn(0x7fe2040b5de0 0x7fe204072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 --2- 172.21.15.144:0/2879581051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 0x7fe2040b58a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 -- 172.21.15.144:0/2879581051 >> 172.21.15.144:0/2879581051 conn(0x7fe20406d0d0 msgr2=0x7fe20406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 -- 172.21.15.144:0/2879581051 shutdown_connections 2024-09-12T12:16:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 -- 172.21.15.144:0/2879581051 wait complete. 2024-09-12T12:16:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 Processor -- start 2024-09-12T12:16:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 -- start start 2024-09-12T12:16:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2040b5de0 0x7fe204152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20415c7b0 0x7fe204165630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 0x7fe204155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe204074000 con 0x7fe20415cd30 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe204073e80 con 0x7fe2040b5de0 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe20bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe204074180 con 0x7fe20415c7b0 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe209c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 0x7fe204155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe203e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20415c7b0 0x7fe204165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe209c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 0x7fe204155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52790/0 (socket says 172.21.15.144:52790) 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe209200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2040b5de0 0x7fe204152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe209c00640 1 -- 172.21.15.144:0/1204204562 learned_addr learned my addr 172.21.15.144:0/1204204562 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe209c00640 1 -- 172.21.15.144:0/1204204562 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20415c7b0 msgr2=0x7fe204165630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe209c00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20415c7b0 0x7fe204165630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe209c00640 1 -- 172.21.15.144:0/1204204562 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2040b5de0 msgr2=0x7fe204152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:29.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe209c00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2040b5de0 0x7fe204152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:29.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.899+0000 7fe209c00640 1 -- 172.21.15.144:0/1204204562 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe204165b70 con 0x7fe20415cd30 2024-09-12T12:16:29.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe209c00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 0x7fe204155e50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007e40 tx=0x7fe1fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe200c00640 1 -- 172.21.15.144:0/1204204562 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc014620 con 0x7fe20415cd30 2024-09-12T12:16:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe200c00640 1 -- 172.21.15.144:0/1204204562 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc019070 con 0x7fe20415cd30 2024-09-12T12:16:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe200c00640 1 -- 172.21.15.144:0/1204204562 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc014a20 con 0x7fe20415cd30 2024-09-12T12:16:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe204165e10 con 0x7fe20415cd30 2024-09-12T12:16:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe204163010 con 0x7fe20415cd30 2024-09-12T12:16:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2041670f0 con 0x7fe20415cd30 2024-09-12T12:16:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe200c00640 1 -- 172.21.15.144:0/1204204562 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1fc014bc0 con 0x7fe20415cd30 2024-09-12T12:16:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe200c00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e40678c0 0x7fe1e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe200c00640 1 -- 172.21.15.144:0/1204204562 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7fe1fc086650 con 0x7fe20415cd30 2024-09-12T12:16:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.903+0000 7fe209200640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e40678c0 0x7fe1e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.907+0000 7fe209200640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e40678c0 0x7fe1e4069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4007fd0 tx=0x7fe1f4007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:29.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:29.907+0000 7fe200c00640 1 -- 172.21.15.144:0/1204204562 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe1fc056910 con 0x7fe20415cd30 2024-09-12T12:16:30.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.103+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe204072ec0 con 0x7fe20415cd30 2024-09-12T12:16:30.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.103+0000 7fe200c00640 1 -- 172.21.15.144:0/1204204562 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5230 (secure 0 0 0) 0x7fe1fc05ac10 con 0x7fe20415cd30 2024-09-12T12:16:30.106 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:30.106 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":39,"btime":"2024-09-12T12:16:23:314428+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3523411663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3523411663},{"type":"v1","addr":"172.21.15.165:6834","nonce":3523411663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6174,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/831229399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":831229399},{"type":"v1","addr":"172.21.15.144:6836","nonce":831229399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2387261211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2387261211},{"type":"v1","addr":"172.21.15.144:6837","nonce":2387261211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:22.690993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6192":{"gid":6192,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/799094061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":799094061},{"type":"v1","addr":"172.21.15.165:6835","nonce":799094061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6192,"qdb_cluster":[6192]},"id":4}]} 2024-09-12T12:16:30.106 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 39 2024-09-12T12:16:30.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e40678c0 msgr2=0x7fe1e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e40678c0 0x7fe1e4069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4007fd0 tx=0x7fe1f4007d60 comp rx=0 tx=0).stop 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 msgr2=0x7fe204155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 0x7fe204155e50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007e40 tx=0x7fe1fc00e4b0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 shutdown_connections 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e40678c0 0x7fe1e4069d80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20415cd30 0x7fe204155e50 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20415c7b0 0x7fe204165630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 --2- 172.21.15.144:0/1204204562 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2040b5de0 0x7fe204152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 >> 172.21.15.144:0/1204204562 conn(0x7fe20406d0d0 msgr2=0x7fe204153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 shutdown_connections 2024-09-12T12:16:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.107+0000 7fe20bc00640 1 -- 172.21.15.144:0/1204204562 wait complete. 2024-09-12T12:16:30.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:16:19.655379+0000', 'modified': '2024-09-12T12:16:22.690993+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6192}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6192': {'gid': 6192, 'name': 'd', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.165:6835/799094061', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6833', 'nonce': 799094061}, {'type': 'v1', 'addr': '172.21.15.165:6835', 'nonce': 799094061}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6192, 'qdb_cluster': [6192]} 2024-09-12T12:16:30.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:16:30.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T12:16:30.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28cfc00640 1 Processor -- start 2024-09-12T12:16:30.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28cfc00640 1 -- start start 2024-09-12T12:16:30.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28cfc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c81556c0 0x7f28c8162a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28cfc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28c80ccfb0 0x7f28c806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28cfc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c815ec60 con 0x7f28c806ee50 2024-09-12T12:16:30.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28cfc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f28c815fa20 con 0x7f28c80ccfb0 2024-09-12T12:16:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28cfc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28c8162fd0 con 0x7f28c81556c0 2024-09-12T12:16:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28c7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28c80ccfb0 0x7f28c806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28c7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f28c80ccfb0 0x7f28c806e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52800/0 (socket says 172.21.15.144:52800) 2024-09-12T12:16:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28c7e00640 1 -- 172.21.15.144:0/3814904813 learned_addr learned my addr 172.21.15.144:0/3814904813 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28cd200640 1 --2- 172.21.15.144:0/3814904813 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c81556c0 0x7f28c8162a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28c7e00640 1 -- 172.21.15.144:0/3814904813 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c81556c0 msgr2=0x7f28c8162a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28c7e00640 1 --2- 172.21.15.144:0/3814904813 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c81556c0 0x7f28c8162a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28c7e00640 1 -- 172.21.15.144:0/3814904813 >> v1:172.21.15.165:6789/0 conn(0x7f28c806ee50 legacy=0x7f28c80ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.667+0000 7f28c7e00640 1 -- 172.21.15.144:0/3814904813 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c815ef40 con 0x7f28c80ccfb0 2024-09-12T12:16:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28c7e00640 1 --2- 172.21.15.144:0/3814904813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c80ccfb0 0x7f28c806e910 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009870 tx=0x7f28b401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1bcb69e323e067 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28c7400640 1 -- 172.21.15.144:0/3814904813 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40b2070 con 0x7f28c80ccfb0 2024-09-12T12:16:30.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28c7400640 1 -- 172.21.15.144:0/3814904813 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b40a9070 con 0x7f28c80ccfb0 2024-09-12T12:16:30.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28c7400640 1 -- 172.21.15.144:0/3814904813 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40ad880 con 0x7f28c80ccfb0 2024-09-12T12:16:30.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28cfc00640 1 -- 172.21.15.144:0/3814904813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c80ccfb0 msgr2=0x7f28c806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28cfc00640 1 --2- 172.21.15.144:0/3814904813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c80ccfb0 0x7f28c806e910 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009870 tx=0x7f28b401c560 comp rx=0 tx=0).stop 2024-09-12T12:16:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28cfc00640 1 -- 172.21.15.144:0/3814904813 shutdown_connections 2024-09-12T12:16:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28cfc00640 1 --2- 172.21.15.144:0/3814904813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c80ccfb0 0x7f28c806e910 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28cfc00640 1 --2- 172.21.15.144:0/3814904813 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c81556c0 0x7f28c8162a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28cfc00640 1 -- 172.21.15.144:0/3814904813 >> 172.21.15.144:0/3814904813 conn(0x7f28c806ddf0 msgr2=0x7f28c806e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28cfc00640 1 -- 172.21.15.144:0/3814904813 shutdown_connections 2024-09-12T12:16:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.671+0000 7f28cfc00640 1 -- 172.21.15.144:0/3814904813 wait complete. 2024-09-12T12:16:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 Processor -- start 2024-09-12T12:16:30.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 -- start start 2024-09-12T12:16:30.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c806ee50 0x7f28c80ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28c80ccfb0 0x7f28c80b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c81556c0 0x7f28c80b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f28c80b6400 con 0x7f28c81556c0 2024-09-12T12:16:30.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f28c80b6280 con 0x7f28c80ccfb0 2024-09-12T12:16:30.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28c816b220 con 0x7f28c806ee50 2024-09-12T12:16:30.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c81556c0 0x7f28c80b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28c80ccfb0 0x7f28c80b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c81556c0 0x7f28c80b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52814/0 (socket says 172.21.15.144:52814) 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cdc00640 1 -- 172.21.15.144:0/2894435791 learned_addr learned my addr 172.21.15.144:0/2894435791 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cd200640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c806ee50 0x7f28c80ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cdc00640 1 -- 172.21.15.144:0/2894435791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c806ee50 msgr2=0x7f28c80ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cdc00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c806ee50 0x7f28c80ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cdc00640 1 -- 172.21.15.144:0/2894435791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28c80ccfb0 msgr2=0x7f28c80b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cdc00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28c80ccfb0 0x7f28c80b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cdc00640 1 -- 172.21.15.144:0/2894435791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c80cd980 con 0x7f28c81556c0 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cdc00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c81556c0 0x7f28c80b2350 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c730 tx=0x7f28c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28c4c00640 1 -- 172.21.15.144:0/2894435791 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0003b80 con 0x7f28c81556c0 2024-09-12T12:16:30.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28c4c00640 1 -- 172.21.15.144:0/2894435791 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c0003d20 con 0x7f28c81556c0 2024-09-12T12:16:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 -- 172.21.15.144:0/2894435791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c80cdc60 con 0x7f28c81556c0 2024-09-12T12:16:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28c4c00640 1 -- 172.21.15.144:0/2894435791 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c000aa30 con 0x7f28c81556c0 2024-09-12T12:16:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.675+0000 7f28cfc00640 1 -- 172.21.15.144:0/2894435791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c80ce220 con 0x7f28c81556c0 2024-09-12T12:16:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c4c00640 1 -- 172.21.15.144:0/2894435791 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28c000abd0 con 0x7f28c81556c0 2024-09-12T12:16:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c4c00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28a80678c0 0x7f28a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c4c00640 1 -- 172.21.15.144:0/2894435791 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f28c0085c90 con 0x7f28c81556c0 2024-09-12T12:16:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28d2fc6000 1 Processor -- start 2024-09-12T12:16:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28cd200640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28a80678c0 0x7f28a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28d2fc6000 1 -- start start 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28cd200640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28a80678c0 0x7f28a8069d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f28c8150d30 tx=0x7f28bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4ab20 0x55701eb4af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4b440 0x55701eb00d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb01290 0x55701eb01670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55701e9e8b60 con 0x55701eb4b440 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55701e94fc70 con 0x55701eb4ab20 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55701e8f5ed0 con 0x55701eb01290 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4b440 0x55701eb00d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4b440 0x55701eb00d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52826/0 (socket says 172.21.15.144:52826) 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c7e00640 1 -- 172.21.15.144:0/1136584040 learned_addr learned my addr 172.21.15.144:0/1136584040 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28cd200640 1 --2- 172.21.15.144:0/1136584040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4ab20 0x55701eb4af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28cdc00640 1 --2- 172.21.15.144:0/1136584040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb01290 0x55701eb01670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c7e00640 1 -- 172.21.15.144:0/1136584040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb01290 msgr2=0x55701eb01670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c7e00640 1 --2- 172.21.15.144:0/1136584040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb01290 0x55701eb01670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c7e00640 1 -- 172.21.15.144:0/1136584040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4ab20 msgr2=0x55701eb4af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c7e00640 1 --2- 172.21.15.144:0/1136584040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4ab20 0x55701eb4af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.679+0000 7f28c7e00640 1 -- 172.21.15.144:0/1136584040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701e907e50 con 0x55701eb4b440 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28c7e00640 1 --2- 172.21.15.144:0/1136584040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4b440 0x55701eb00d50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009870 tx=0x7f28b40a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7150943f0017f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28b9600640 1 -- 172.21.15.144:0/1136584040 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40b2050 con 0x55701eb4b440 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28b9600640 1 -- 172.21.15.144:0/1136584040 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b40b3040 con 0x55701eb4b440 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28b9600640 1 -- 172.21.15.144:0/1136584040 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40ad970 con 0x55701eb4b440 2024-09-12T12:16:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1136584040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4b440 msgr2=0x55701eb00d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/1136584040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4b440 0x55701eb00d50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009870 tx=0x7f28b40a7000 comp rx=0 tx=0).stop 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1136584040 shutdown_connections 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/1136584040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb01290 0x55701eb01670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/1136584040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4b440 0x55701eb00d50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/1136584040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4ab20 0x55701eb4af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1136584040 >> 172.21.15.144:0/1136584040 conn(0x55701eb07600 msgr2=0x55701eaff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1136584040 shutdown_connections 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1136584040 wait complete. 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 -- start start 2024-09-12T12:16:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 Processor -- start 2024-09-12T12:16:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4ab20 0x55701eb05e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 0x55701eb0bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb06390 0x55701eb0c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55701e9b1b00 con 0x55701eb06390 2024-09-12T12:16:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55701e92a360 con 0x55701eb4b440 2024-09-12T12:16:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55701e9272d0 con 0x55701eb4ab20 2024-09-12T12:16:30.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28d2fc6000 10 client.0 _ll_register_callbacks cb 0x55701eaec820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28cdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb06390 0x55701eb0c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28cdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb06390 0x55701eb0c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52828/0 (socket says 172.21.15.144:52828) 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28cdc00640 1 -- 172.21.15.144:0/4177896447 learned_addr learned my addr 172.21.15.144:0/4177896447 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28cd200640 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4ab20 0x55701eb05e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28c7e00640 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 0x55701eb0bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28cdc00640 1 -- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4ab20 msgr2=0x55701eb05e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28cdc00640 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4ab20 0x55701eb05e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28cdc00640 1 -- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 msgr2=0x55701eb0bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28cdc00640 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 0x55701eb0bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.683+0000 7f28cdc00640 1 -- 172.21.15.144:0/4177896447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701e8f6120 con 0x55701eb06390 2024-09-12T12:16:30.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28cdc00640 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb06390 0x55701eb0c230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f28c000a430 tx=0x7f28c0055ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34fdb70126379ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 1 -- 172.21.15.144:0/4177896447 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0055310 con 0x55701eb06390 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 1 -- 172.21.15.144:0/4177896447 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f28c00554b0 con 0x55701eb06390 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 -- 172.21.15.144:0/4177896447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28b40b3040 con 0x55701eb06390 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 1 -- 172.21.15.144:0/4177896447 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f28c0074170 con 0x55701eb06390 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 10 client.6327 fetch_fsmap learned FSMap version 39 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 -- 172.21.15.144:0/4177896447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55701e8ef450 con 0x55701eb06390 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 1 -- 172.21.15.144:0/4177896447 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b40b3040 con 0x55701eb06390 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 1 -- 172.21.15.144:0/4177896447 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 39) ==== 3502+0+0 (secure 0 0 0) 0x7f28c005c3c0 con 0x55701eb06390 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 10 client.6327 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T12:16:30.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 10 client.6327 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 20 client.6327 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55701eb59280 0x55701eb5b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 4 client.6327 mds_command: new command op to 6192 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 -- 172.21.15.144:0/4177896447 --> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55701e8e9c00 con 0x55701eb59280 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28cd200640 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55701eb59280 0x55701eb5b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 10 client.6327 ms_handle_connect on v2:172.21.15.165:6833/799094061 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28cd200640 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55701eb59280 0x55701eb5b670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f3f5cd6d4d80bd server_cookie=ea90abfa55d6a8a7 in_seq=0 out_seq=0 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 1 -- 172.21.15.144:0/4177896447 <== mds.0 v2:172.21.15.165:6833/799094061 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55701e8e9c00 con 0x55701eb59280 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 10 client.6327 handle_command_reply: tid=0 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 client.6327 shutdown 2024-09-12T12:16:30.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 -- 172.21.15.144:0/4177896447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb06390 msgr2=0x55701eb0c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb06390 0x55701eb0c230 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f28c000a430 tx=0x7f28c0055ec0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 -- 172.21.15.144:0/4177896447 shutdown_connections 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55701eb59280 0x55701eb5b670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb06390 0x55701eb0c230 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 0x55701eb0bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28ae000640 0 client.6327 ms_handle_reset on v2:172.21.15.165:6833/799094061 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/4177896447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4ab20 0x55701eb05e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 -- 172.21.15.144:0/4177896447 >> 172.21.15.144:0/4177896447 conn(0x55701eb01290 msgr2=0x55701eaffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 -- 172.21.15.144:0/4177896447 shutdown_connections 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 1 -- 172.21.15.144:0/4177896447 wait complete. 2024-09-12T12:16:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.687+0000 7f28d2fc6000 20 client.6327 trim_cache size 0 max 16384 2024-09-12T12:16:30.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 Processor -- start 2024-09-12T12:16:30.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 -- start start 2024-09-12T12:16:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb06390 0x55701eb49cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701eb4a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 0x55701eb5b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f28c8203160 con 0x55701eb4ab20 2024-09-12T12:16:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f28c8160770 con 0x55701eb4b440 2024-09-12T12:16:30.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28c8202ae0 con 0x55701eb06390 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701eb4a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701eb4a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52840/0 (socket says 172.21.15.144:52840) 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28c7e00640 1 -- 172.21.15.144:0/1334147876 learned_addr learned my addr 172.21.15.144:0/1334147876 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28cd200640 1 --2- 172.21.15.144:0/1334147876 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb06390 0x55701eb49cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28cdc00640 1 --2- 172.21.15.144:0/1334147876 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 0x55701eb5b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28c7e00640 1 -- 172.21.15.144:0/1334147876 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb06390 msgr2=0x55701eb49cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28c7e00640 1 --2- 172.21.15.144:0/1334147876 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb06390 0x55701eb49cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28c7e00640 1 -- 172.21.15.144:0/1334147876 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 msgr2=0x55701eb5b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28c7e00640 1 --2- 172.21.15.144:0/1334147876 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 0x55701eb5b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28c7e00640 1 -- 172.21.15.144:0/1334147876 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55701e8d6fd0 con 0x55701eb4ab20 2024-09-12T12:16:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28c7e00640 1 --2- 172.21.15.144:0/1334147876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701eb4a200 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009870 tx=0x7f28b4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee5a4a1f1a0de2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28b8c00640 1 -- 172.21.15.144:0/1334147876 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40b2040 con 0x55701eb4ab20 2024-09-12T12:16:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28b8c00640 1 -- 172.21.15.144:0/1334147876 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b4004250 con 0x55701eb4ab20 2024-09-12T12:16:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28b8c00640 1 -- 172.21.15.144:0/1334147876 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40ad770 con 0x55701eb4ab20 2024-09-12T12:16:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1334147876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 msgr2=0x55701eb4a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/1334147876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701eb4a200 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009870 tx=0x7f28b4004740 comp rx=0 tx=0).stop 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.707+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1334147876 shutdown_connections 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/1334147876 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb4b440 0x55701eb5b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/1334147876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701eb4a200 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/1334147876 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb06390 0x55701eb49cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1334147876 >> 172.21.15.144:0/1334147876 conn(0x55701eb01290 msgr2=0x55701eb05650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1334147876 shutdown_connections 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- 172.21.15.144:0/1334147876 wait complete. 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- start start 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 Processor -- start 2024-09-12T12:16:30.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb06390 0x55701eb5e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701ebbd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4b440 0x55701ebbd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55701e94ef80 con 0x55701eb4ab20 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55701e907ca0 con 0x55701eb06390 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55701e9542a0 con 0x55701eb4b440 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 10 client.0 _ll_register_callbacks cb 0x7f28c0007f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701ebbd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701ebbd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52848/0 (socket says 172.21.15.144:52848) 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28c7e00640 1 -- 172.21.15.144:0/407138409 learned_addr learned my addr 172.21.15.144:0/407138409 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28cdc00640 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4b440 0x55701ebbd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28cd200640 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb06390 0x55701eb5e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28c7e00640 1 -- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4b440 msgr2=0x55701ebbd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28c7e00640 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4b440 0x55701ebbd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28c7e00640 1 -- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb06390 msgr2=0x55701eb5e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28c7e00640 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb06390 0x55701eb5e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28c7e00640 1 -- 172.21.15.144:0/407138409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55701e9d2750 con 0x55701eb4ab20 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28c7e00640 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701ebbd000 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f28b4008010 tx=0x7f28b401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2de3880cb3c069 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28ae000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28ae000640 1 -- 172.21.15.144:0/407138409 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40d1060 con 0x55701eb4ab20 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28ae000640 1 -- 172.21.15.144:0/407138409 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f28b4004400 con 0x55701eb4ab20 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- 172.21.15.144:0/407138409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28b4004250 con 0x55701eb4ab20 2024-09-12T12:16:30.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28ae000640 1 -- 172.21.15.144:0/407138409 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f28b40b2050 con 0x55701eb4ab20 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 10 client.6333 fetch_fsmap learned FSMap version 39 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- 172.21.15.144:0/407138409 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55701e8dda30 con 0x55701eb4ab20 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28ae000640 1 -- 172.21.15.144:0/407138409 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b4004250 con 0x55701eb4ab20 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28ae000640 1 -- 172.21.15.144:0/407138409 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 39) ==== 3502+0+0 (secure 0 0 0) 0x7f28b40adb80 con 0x55701eb4ab20 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 10 client.6333 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 10 client.6333 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 20 client.6333 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55701eb79960 0x55701eb79d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 4 client.6333 mds_command: new command op to 6192 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.711+0000 7f28d2fc6000 1 -- 172.21.15.144:0/407138409 --> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] -- command(tid 0: {"prefix": "status"}) -- 0x55701e95d3a0 con 0x55701eb79960 2024-09-12T12:16:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cd200640 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55701eb79960 0x55701eb79d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cd200640 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55701eb79960 0x55701eb79d40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=110c0eb29901ea3c server_cookie=2d6ee495e1078743 in_seq=0 out_seq=0 2024-09-12T12:16:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28ae000640 10 client.6333 ms_handle_connect on v2:172.21.15.165:6833/799094061 2024-09-12T12:16:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28ae000640 1 -- 172.21.15.144:0/407138409 <== mds.0 v2:172.21.15.165:6833/799094061 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55701e95d3a0 con 0x55701eb79960 2024-09-12T12:16:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28ae000640 10 client.6333 handle_command_reply: tid=0 2024-09-12T12:16:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 client.6333 shutdown 2024-09-12T12:16:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 -- 172.21.15.144:0/407138409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 msgr2=0x55701ebbd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701ebbd000 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f28b4008010 tx=0x7f28b401ada0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 -- 172.21.15.144:0/407138409 shutdown_connections 2024-09-12T12:16:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55701eb79960 0x55701eb79d40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55701eb4b440 0x55701ebbd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55701eb4ab20 0x55701ebbd000 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28ae000640 0 client.6333 ms_handle_reset on v2:172.21.15.165:6833/799094061 2024-09-12T12:16:30.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 --2- 172.21.15.144:0/407138409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55701eb06390 0x55701eb5e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 -- 172.21.15.144:0/407138409 >> 172.21.15.144:0/407138409 conn(0x55701eb01290 msgr2=0x55701eb48cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 -- 172.21.15.144:0/407138409 shutdown_connections 2024-09-12T12:16:30.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 1 -- 172.21.15.144:0/407138409 wait complete. 2024-09-12T12:16:30.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28d2fc6000 20 client.6333 trim_cache size 0 max 16384 2024-09-12T12:16:30.722 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 6192, 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 10.438493894, 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 39, 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 67, 2024-09-12T12:16:30.723 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 65, 2024-09-12T12:16:30.724 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 15.290670671000001 2024-09-12T12:16:30.724 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:16:30.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 -- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28a80678c0 msgr2=0x7f28a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28a80678c0 0x7f28a8069d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f28c8150d30 tx=0x7f28bc008040 comp rx=0 tx=0).stop 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 -- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c81556c0 msgr2=0x7f28c80b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c81556c0 0x7f28c80b2350 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f28c000c730 tx=0x7f28c000cbf0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 -- 172.21.15.144:0/2894435791 shutdown_connections 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28a80678c0 0x7f28a8069d80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28c81556c0 0x7f28c80b2350 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28c80ccfb0 0x7f28c80b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 --2- 172.21.15.144:0/2894435791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28c806ee50 0x7f28c80ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 -- 172.21.15.144:0/2894435791 >> 172.21.15.144:0/2894435791 conn(0x7f28c806ddf0 msgr2=0x7f28c80ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 -- 172.21.15.144:0/2894435791 shutdown_connections 2024-09-12T12:16:30.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.715+0000 7f28cfc00640 1 -- 172.21.15.144:0/2894435791 wait complete. 2024-09-12T12:16:30.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:16:30.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f3203400640 1 Processor -- start 2024-09-12T12:16:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f3203400640 1 -- start start 2024-09-12T12:16:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f3203400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc15c7b0 0x7f31fc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f3203400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31fc0cd870 con 0x7f31fc15cd30 2024-09-12T12:16:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f3203400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31fc0cdb50 con 0x7f31fc0b5fb0 2024-09-12T12:16:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f3203400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f31fc072a50 con 0x7f31fc15c7b0 2024-09-12T12:16:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f31fc15cd30 0x7f31fc0b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49972/0 (socket says 172.21.15.144:49972) 2024-09-12T12:16:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fbe00640 1 -- 172.21.15.144:0/925006091 learned_addr learned my addr 172.21.15.144:0/925006091 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f3200a00640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc15c7b0 0x7f31fc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038576746 0 0) 0x7f31fc0cd870 con 0x7f31fc15cd30 2024-09-12T12:16:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31e0003530 con 0x7f31fc15cd30 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1312526255 0 0) 0x7f31e0003530 con 0x7f31fc15cd30 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc15c7b0 msgr2=0x7f31fc0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc15c7b0 0x7f31fc0ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 >> v1:172.21.15.165:6789/0 conn(0x7f31fc0b5fb0 legacy=0x7f31fc072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc0726e0 con 0x7f31fc15cd30 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f31e8001680 con 0x7f31fc15cd30 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 >> v1:172.21.15.144:6789/0 conn(0x7f31fc15cd30 legacy=0x7f31fc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc15c7b0 0x7f31e00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e0003f30 0x7f31e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0004d50 0x7f31e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc072a50 con 0x7f31e0003f30 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f31e000ba30 con 0x7f31e0004d50 2024-09-12T12:16:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.871+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f31e000bc30 con 0x7f31fc15c7b0 2024-09-12T12:16:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fbe00640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e0003f30 0x7f31e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f3200a00640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc15c7b0 0x7f31e00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f3201400640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0004d50 0x7f31e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fbe00640 1 -- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc15c7b0 msgr2=0x7f31e00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fbe00640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc15c7b0 0x7f31e00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fbe00640 1 -- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0004d50 msgr2=0x7f31e00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fbe00640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0004d50 0x7f31e00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fbe00640 1 -- 172.21.15.144:0/925006091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e0003530 con 0x7f31e0003f30 2024-09-12T12:16:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f3201400640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0004d50 0x7f31e00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fbe00640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e0003f30 0x7f31e0004810 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f31e800c210 tx=0x7f31e801caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fb9543ae1bfd5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8007cf0 con 0x7f31e0003f30 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e80a9070 con 0x7f31e0003f30 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.875+0000 7f31fb400640 1 -- 172.21.15.144:0/925006091 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8005d80 con 0x7f31e0003f30 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 -- 172.21.15.144:0/925006091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e0003f30 msgr2=0x7f31e0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 --2- 172.21.15.144:0/925006091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e0003f30 0x7f31e0004810 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f31e800c210 tx=0x7f31e801caa0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3201400640 1 -- 172.21.15.144:0/925006091 reap_dead start 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 -- 172.21.15.144:0/925006091 shutdown_connections 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 -- 172.21.15.144:0/925006091 >> 172.21.15.144:0/925006091 conn(0x7f31fc06d0d0 msgr2=0x7f31fc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 -- 172.21.15.144:0/925006091 shutdown_connections 2024-09-12T12:16:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 -- 172.21.15.144:0/925006091 wait complete. 2024-09-12T12:16:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 Processor -- start 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 -- start start 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0003f30 0x7f31fc1f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc158d10 0x7f31fc159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31fc1fb080 0x7f31fc1fb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc0741d0 con 0x7f31fc1fb080 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc074050 con 0x7f31e0003f30 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3203400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f31fc168320 con 0x7f31fc158d10 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3201400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31fc1fb080 0x7f31fc1fb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3201400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31fc1fb080 0x7f31fc1fb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52858/0 (socket says 172.21.15.144:52858) 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3201400640 1 -- 172.21.15.144:0/4104297778 learned_addr learned my addr 172.21.15.144:0/4104297778 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3200a00640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0003f30 0x7f31fc1f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f31fbe00640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc158d10 0x7f31fc159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3201400640 1 -- 172.21.15.144:0/4104297778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc158d10 msgr2=0x7f31fc159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3201400640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc158d10 0x7f31fc159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3201400640 1 -- 172.21.15.144:0/4104297778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0003f30 msgr2=0x7f31fc1f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3201400640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0003f30 0x7f31fc1f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f3201400640 1 -- 172.21.15.144:0/4104297778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc1fae20 con 0x7f31fc1fb080 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.879+0000 7f31fbe00640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc158d10 0x7f31fc159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f3201400640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31fc1fb080 0x7f31fc1fb500 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0afdb0 tx=0x7f31f400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f31f8c00640 1 -- 172.21.15.144:0/4104297778 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f4019070 con 0x7f31fc1fb080 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f31f8c00640 1 -- 172.21.15.144:0/4104297778 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f40052e0 con 0x7f31fc1fb080 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f31f8c00640 1 -- 172.21.15.144:0/4104297778 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f4003840 con 0x7f31fc1fb080 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31fc15a4c0 con 0x7f31fc1fb080 2024-09-12T12:16:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31fc15e460 con 0x7f31fc1fb080 2024-09-12T12:16:30.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31fc0cdb50 con 0x7f31fc1fb080 2024-09-12T12:16:30.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f31f8c00640 1 -- 172.21.15.144:0/4104297778 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31f40039e0 con 0x7f31fc1fb080 2024-09-12T12:16:30.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f31f8c00640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31dc0678f0 0x7f31dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f31f8c00640 1 -- 172.21.15.144:0/4104297778 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f31f40850f0 con 0x7f31fc1fb080 2024-09-12T12:16:30.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f3200a00640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31dc0678f0 0x7f31dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.883+0000 7f3200a00640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31dc0678f0 0x7f31dc069db0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f31ec014510 tx=0x7f31ec00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:30.887+0000 7f31f8c00640 1 -- 172.21.15.144:0/4104297778 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f31f4055320 con 0x7f31fc1fb080 2024-09-12T12:16:31.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.079+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f31fc1579b0 con 0x7f31fc1fb080 2024-09-12T12:16:31.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.079+0000 7f31f8c00640 1 -- 172.21.15.144:0/4104297778 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) ==== 53+0+73 (secure 0 0 0) 0x7f31f4059620 con 0x7f31fc1fb080 2024-09-12T12:16:31.082 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:16:31.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31dc0678f0 msgr2=0x7f31dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31dc0678f0 0x7f31dc069db0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f31ec014510 tx=0x7f31ec00b040 comp rx=0 tx=0).stop 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31fc1fb080 msgr2=0x7f31fc1fb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31fc1fb080 0x7f31fc1fb500 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0afdb0 tx=0x7f31f400e820 comp rx=0 tx=0).stop 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 shutdown_connections 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31dc0678f0 0x7f31dc069db0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31fc1fb080 0x7f31fc1fb500 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31fc158d10 0x7f31fc159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 --2- 172.21.15.144:0/4104297778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e0003f30 0x7f31fc1f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 >> 172.21.15.144:0/4104297778 conn(0x7f31fc06d0d0 msgr2=0x7f31fc0b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 shutdown_connections 2024-09-12T12:16:31.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.083+0000 7f3203400640 1 -- 172.21.15.144:0/4104297778 wait complete. 2024-09-12T12:16:31.103 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:16:31.103 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:16:31.103 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:16:31.104 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:16:31.104 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:31.104 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:16:31.104 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:16:31.104 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:16:31.104 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:16:31.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:31.104 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:16:31.113 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:16:31.113 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:16:31.113 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:16:31.114 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42192sec preferred_lft 42192sec 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:31.115 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:16:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:16:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:16:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:31.116 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:16:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:16:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:16:31.116 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:31.117 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:16:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:16:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:16:31.117 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:31.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:31.118 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:16:31.177 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:16:31.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:31.179 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:16:31.235 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:16:31.235 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:16:31.235 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:16:31.235 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:16:31.235 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:16:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:16:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:16:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:16:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:16:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:16:31.236 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:16:31.236 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:16:31.236 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:16:31.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:16:31.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:16:31.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:16:31.237 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:16:31.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:16:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:31.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:31.373 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:16:31.382 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:16:31.383 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:16:31.383 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:16:31.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:31.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:16:31.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:16:31.443 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:31.497 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:16:31.497 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:16:31.497 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:31.546 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:16:31.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:31.547 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:16:31.634 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:16:31.634 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:16:31.648 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:16:31.648 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:16:31.648 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:16:31.648 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:16:31.648 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:16:31.652 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:16:31.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:31.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:31.672 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:16:31.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:16:31.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:31.784 INFO:teuthology.orchestra.run.smithi144.stdout:client6342 2024-09-12T12:16:31.784 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:31.784 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:31.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-12T12:16:31.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.971+0000 7fb353800640 1 Processor -- start 2024-09-12T12:16:31.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.971+0000 7fb353800640 1 -- start start 2024-09-12T12:16:31.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.971+0000 7fb353800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb34c15af60 0x7fb34c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:31.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.971+0000 7fb353800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c0cd9f0 0x7fb34c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:31.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.971+0000 7fb353800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34c0b4300 con 0x7fb34c15b340 2024-09-12T12:16:31.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.971+0000 7fb353800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb34c0b32f0 con 0x7fb34c15af60 2024-09-12T12:16:31.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.971+0000 7fb353800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb34c0b3540 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.971+0000 7fb351800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb34c15b340 0x7fb34c15ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49984/0 (socket says 172.21.15.144:49984) 2024-09-12T12:16:31.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.971+0000 7fb351800640 1 -- 172.21.15.144:0/1104670969 learned_addr learned my addr 172.21.15.144:0/1104670969 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:31.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb34be00640 1 --2- 172.21.15.144:0/1104670969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c0cd9f0 0x7fb34c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:31.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb350e00640 1 --2- 172.21.15.144:0/1104670969 >> v2:172.21.15.165:3300/0 conn(0x7fb34c15af60 0x7fb34c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:31.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb34b400640 1 -- 172.21.15.144:0/1104670969 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478672532 0 0) 0x7fb34c0b4300 con 0x7fb34c15b340 2024-09-12T12:16:31.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb34b400640 1 -- 172.21.15.144:0/1104670969 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb330003530 con 0x7fb34c15b340 2024-09-12T12:16:31.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb34be00640 1 -- 172.21.15.144:0/1104670969 >> v2:172.21.15.165:3300/0 conn(0x7fb34c15af60 msgr2=0x7fb34c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:31.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb34be00640 1 --2- 172.21.15.144:0/1104670969 >> v2:172.21.15.165:3300/0 conn(0x7fb34c15af60 0x7fb34c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:31.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb34be00640 1 -- 172.21.15.144:0/1104670969 >> v1:172.21.15.144:6789/0 conn(0x7fb34c15b340 legacy=0x7fb34c15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:31.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb34be00640 1 -- 172.21.15.144:0/1104670969 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c0b3820 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb350e00640 1 --2- 172.21.15.144:0/1104670969 >> v2:172.21.15.165:3300/0 conn(0x7fb34c15af60 0x7fb34c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:31.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb34be00640 1 --2- 172.21.15.144:0/1104670969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c0cd9f0 0x7fb34c06bc10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb3380097c0 tx=0x7fb33801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5485c49262432725 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:31.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.975+0000 7fb34b400640 1 -- 172.21.15.144:0/1104670969 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3380b5070 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb34b400640 1 -- 172.21.15.144:0/1104670969 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3380a8990 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb34b400640 1 -- 172.21.15.144:0/1104670969 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3380a8d40 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 -- 172.21.15.144:0/1104670969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c0cd9f0 msgr2=0x7fb34c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:31.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 --2- 172.21.15.144:0/1104670969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c0cd9f0 0x7fb34c06bc10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb3380097c0 tx=0x7fb33801ec90 comp rx=0 tx=0).stop 2024-09-12T12:16:31.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 -- 172.21.15.144:0/1104670969 shutdown_connections 2024-09-12T12:16:31.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 --2- 172.21.15.144:0/1104670969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c0cd9f0 0x7fb34c06bc10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 --2- 172.21.15.144:0/1104670969 >> v2:172.21.15.165:3300/0 conn(0x7fb34c15af60 0x7fb34c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 -- 172.21.15.144:0/1104670969 >> 172.21.15.144:0/1104670969 conn(0x7fb34c068030 msgr2=0x7fb34c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 -- 172.21.15.144:0/1104670969 shutdown_connections 2024-09-12T12:16:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 -- 172.21.15.144:0/1104670969 wait complete. 2024-09-12T12:16:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 Processor -- start 2024-09-12T12:16:31.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 -- start start 2024-09-12T12:16:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c0cd9f0 0x7fb34c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb34c15af60 0x7fb34c143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c15b340 0x7fb34c14a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c0b5570 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c0b3de0 con 0x7fb34c15af60 2024-09-12T12:16:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb353800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb34c0cebc0 con 0x7fb34c15b340 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb350e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c0cd9f0 0x7fb34c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb350e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c0cd9f0 0x7fb34c155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52874/0 (socket says 172.21.15.144:52874) 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb350e00640 1 -- 172.21.15.144:0/1873185685 learned_addr learned my addr 172.21.15.144:0/1873185685 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb351800640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c15b340 0x7fb34c14a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.979+0000 7fb34be00640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb34c15af60 0x7fb34c143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb350e00640 1 -- 172.21.15.144:0/1873185685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c15b340 msgr2=0x7fb34c14a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb350e00640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c15b340 0x7fb34c14a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb350e00640 1 -- 172.21.15.144:0/1873185685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb34c15af60 msgr2=0x7fb34c143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb350e00640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb34c15af60 0x7fb34c143ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:31.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb350e00640 1 -- 172.21.15.144:0/1873185685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c0d1430 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb350e00640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c0cd9f0 0x7fb34c155a60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00ebe0 tx=0x7fb33c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:31.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb348c00640 1 -- 172.21.15.144:0/1873185685 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c017070 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb348c00640 1 -- 172.21.15.144:0/1873185685 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c00cc30 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb348c00640 1 -- 172.21.15.144:0/1873185685 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c013470 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34c14adb0 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34c14b370 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34c0ce680 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb348c00640 1 -- 172.21.15.144:0/1873185685 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb33c01a070 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb348c00640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb32c0678c0 0x7fb32c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:31.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb348c00640 1 -- 172.21.15.144:0/1873185685 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7fb33c085d70 con 0x7fb34c0cd9f0 2024-09-12T12:16:31.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.983+0000 7fb34be00640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb32c0678c0 0x7fb32c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:31.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.987+0000 7fb34be00640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb32c0678c0 0x7fb32c069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb3380b2000 tx=0x7fb3380aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:31.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:31.991+0000 7fb348c00640 1 -- 172.21.15.144:0/1873185685 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb33c056020 con 0x7fb34c0cd9f0 2024-09-12T12:16:32.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.147+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fb34c149440 con 0x7fb34c0cd9f0 2024-09-12T12:16:32.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.151+0000 7fb348c00640 1 -- 172.21.15.144:0/1873185685 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7fb33c05a320 con 0x7fb34c0cd9f0 2024-09-12T12:16:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb32c0678c0 msgr2=0x7fb32c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb32c0678c0 0x7fb32c069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb3380b2000 tx=0x7fb3380aa070 comp rx=0 tx=0).stop 2024-09-12T12:16:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c0cd9f0 msgr2=0x7fb34c155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c0cd9f0 0x7fb34c155a60 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00ebe0 tx=0x7fb33c00c520 comp rx=0 tx=0).stop 2024-09-12T12:16:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 shutdown_connections 2024-09-12T12:16:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb32c0678c0 0x7fb32c069d80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb34c15b340 0x7fb34c14a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb34c15af60 0x7fb34c143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 --2- 172.21.15.144:0/1873185685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb34c0cd9f0 0x7fb34c155a60 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 >> 172.21.15.144:0/1873185685 conn(0x7fb34c068030 msgr2=0x7fb34c0b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 shutdown_connections 2024-09-12T12:16:32.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.155+0000 7fb353800640 1 -- 172.21.15.144:0/1873185685 wait complete. 2024-09-12T12:16:32.176 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-12T12:16:32.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b8e00640 1 Processor -- start 2024-09-12T12:16:32.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b8e00640 1 -- start start 2024-09-12T12:16:32.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b8e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78b40cd9f0 0x7f78b406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b8e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b40b4300 con 0x7f78b415af60 2024-09-12T12:16:32.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b8e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b40b3540 con 0x7f78b415b340 2024-09-12T12:16:32.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b8e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f78b40b32f0 con 0x7f78b40cd9f0 2024-09-12T12:16:32.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b1400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78b40cd9f0 0x7f78b406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b1400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78b40cd9f0 0x7f78b406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52876/0 (socket says 172.21.15.144:52876) 2024-09-12T12:16:32.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b1400640 1 -- 172.21.15.144:0/3786598045 learned_addr learned my addr 172.21.15.144:0/3786598045 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:32.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b1e00640 1 --1- 172.21.15.144:0/3786598045 >> v1:172.21.15.144:6789/0 conn(0x7f78b415af60 0x7f78b40ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50000/0 (socket says 172.21.15.144:50000) 2024-09-12T12:16:32.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b1400640 1 -- 172.21.15.144:0/3786598045 >> v1:172.21.15.165:6789/0 conn(0x7f78b415b340 legacy=0x7f78b40b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:32.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b1400640 1 -- 172.21.15.144:0/3786598045 >> v1:172.21.15.144:6789/0 conn(0x7f78b415af60 legacy=0x7f78b40ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b1400640 1 -- 172.21.15.144:0/3786598045 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b40b3820 con 0x7f78b40cd9f0 2024-09-12T12:16:32.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.315+0000 7f78b0a00640 1 -- 172.21.15.144:0/3786598045 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333135893 0 0) 0x7f78b40b4300 con 0x7f78b415af60 2024-09-12T12:16:32.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b1400640 1 --2- 172.21.15.144:0/3786598045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b40cd9f0 0x7f78b406bc10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009870 tx=0x7f78a001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1620b0119f8c31e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:32.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b0a00640 1 -- 172.21.15.144:0/3786598045 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a00b0070 con 0x7f78b40cd9f0 2024-09-12T12:16:32.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b0a00640 1 -- 172.21.15.144:0/3786598045 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a00ab600 con 0x7f78b40cd9f0 2024-09-12T12:16:32.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b0a00640 1 -- 172.21.15.144:0/3786598045 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a00ab9d0 con 0x7f78b40cd9f0 2024-09-12T12:16:32.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b8e00640 1 -- 172.21.15.144:0/3786598045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b40cd9f0 msgr2=0x7f78b406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b8e00640 1 --2- 172.21.15.144:0/3786598045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b40cd9f0 0x7f78b406bc10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009870 tx=0x7f78a001c520 comp rx=0 tx=0).stop 2024-09-12T12:16:32.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b8e00640 1 -- 172.21.15.144:0/3786598045 shutdown_connections 2024-09-12T12:16:32.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b8e00640 1 --2- 172.21.15.144:0/3786598045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b40cd9f0 0x7f78b406bc10 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b8e00640 1 -- 172.21.15.144:0/3786598045 >> 172.21.15.144:0/3786598045 conn(0x7f78b4068030 msgr2=0x7f78b40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:32.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b8e00640 1 -- 172.21.15.144:0/3786598045 shutdown_connections 2024-09-12T12:16:32.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.319+0000 7f78b8e00640 1 -- 172.21.15.144:0/3786598045 wait complete. 2024-09-12T12:16:32.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 Processor -- start 2024-09-12T12:16:32.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 -- start start 2024-09-12T12:16:32.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78b40cd9f0 0x7f78b4155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78b415af60 0x7f78b4155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b415b340 0x7f78b414b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f78b4169120 con 0x7f78b415b340 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78b406c560 con 0x7f78b415af60 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f78b41692a0 con 0x7f78b40cd9f0 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b415b340 0x7f78b414b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b415b340 0x7f78b414b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52888/0 (socket says 172.21.15.144:52888) 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b2800640 1 -- 172.21.15.144:0/3850194751 learned_addr learned my addr 172.21.15.144:0/3850194751 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b1e00640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78b40cd9f0 0x7f78b4155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b1400640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78b415af60 0x7f78b4155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b2800640 1 -- 172.21.15.144:0/3850194751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78b40cd9f0 msgr2=0x7f78b4155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b2800640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78b40cd9f0 0x7f78b4155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b2800640 1 -- 172.21.15.144:0/3850194751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78b415af60 msgr2=0x7f78b4155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b2800640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78b415af60 0x7f78b4155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b2800640 1 -- 172.21.15.144:0/3850194751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b415d670 con 0x7f78b415b340 2024-09-12T12:16:32.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b2800640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b415b340 0x7f78b414b550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00b970 tx=0x7f78ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:32.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78aa000640 1 -- 172.21.15.144:0/3850194751 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac019070 con 0x7f78b415b340 2024-09-12T12:16:32.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78aa000640 1 -- 172.21.15.144:0/3850194751 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ac00cb40 con 0x7f78b415b340 2024-09-12T12:16:32.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78aa000640 1 -- 172.21.15.144:0/3850194751 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac014440 con 0x7f78b415b340 2024-09-12T12:16:32.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b415d950 con 0x7f78b415b340 2024-09-12T12:16:32.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b415df10 con 0x7f78b415b340 2024-09-12T12:16:32.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.323+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b406bc10 con 0x7f78b415b340 2024-09-12T12:16:32.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.327+0000 7f78aa000640 1 -- 172.21.15.144:0/3850194751 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78ac01c070 con 0x7f78b415b340 2024-09-12T12:16:32.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.327+0000 7f78aa000640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78940678c0 0x7f7894069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.327+0000 7f78aa000640 1 -- 172.21.15.144:0/3850194751 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f78ac0859e0 con 0x7f78b415b340 2024-09-12T12:16:32.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.327+0000 7f78b1e00640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78940678c0 0x7f7894069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.327+0000 7f78b1e00640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78940678c0 0x7f7894069d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f78a4007fd0 tx=0x7f78a4007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:32.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.331+0000 7f78aa000640 1 -- 172.21.15.144:0/3850194751 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f78ac055d40 con 0x7f78b415b340 2024-09-12T12:16:32.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.491+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f78b40afc20 con 0x7f78b415b340 2024-09-12T12:16:32.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78aa000640 1 -- 172.21.15.144:0/3850194751 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f78ac05a040 con 0x7f78b415b340 2024-09-12T12:16:32.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78940678c0 msgr2=0x7f7894069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78940678c0 0x7f7894069d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f78a4007fd0 tx=0x7f78a4007d60 comp rx=0 tx=0).stop 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b415b340 msgr2=0x7f78b414b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b415b340 0x7f78b414b550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00b970 tx=0x7f78ac00be30 comp rx=0 tx=0).stop 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 shutdown_connections 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78940678c0 0x7f7894069d80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b415b340 0x7f78b414b550 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78b415af60 0x7f78b4155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 --2- 172.21.15.144:0/3850194751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78b40cd9f0 0x7f78b4155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 >> 172.21.15.144:0/3850194751 conn(0x7f78b4068030 msgr2=0x7f78b4150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 shutdown_connections 2024-09-12T12:16:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.495+0000 7f78b8e00640 1 -- 172.21.15.144:0/3850194751 wait complete. 2024-09-12T12:16:32.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-12T12:16:32.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cff400640 1 Processor -- start 2024-09-12T12:16:32.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cff400640 1 -- start start 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cff400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 0x7f5cf80cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cff400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5cf8166510 0x7f5cf8166930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cff400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf80cf900 con 0x7f5cf80af5d0 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cff400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf80cf6d0 con 0x7f5cf8166510 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cff400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf80cfbe0 con 0x7f5cf8162a40 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cf7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5cf80af5d0 0x7f5cf8163650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50016/0 (socket says 172.21.15.144:50016) 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cf7e00640 1 -- 172.21.15.144:0/2611217930 learned_addr learned my addr 172.21.15.144:0/2611217930 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:32.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cfd400640 1 --2- 172.21.15.144:0/2611217930 >> v2:172.21.15.165:3300/0 conn(0x7f5cf8166510 0x7f5cf8166930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cfca00640 1 --2- 172.21.15.144:0/2611217930 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 0x7f5cf80cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cf7400640 1 -- 172.21.15.144:0/2611217930 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555751908 0 0) 0x7f5cf80cf900 con 0x7f5cf80af5d0 2024-09-12T12:16:32.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cf7400640 1 -- 172.21.15.144:0/2611217930 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cdc003530 con 0x7f5cf80af5d0 2024-09-12T12:16:32.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cfd400640 1 -- 172.21.15.144:0/2611217930 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 msgr2=0x7f5cf80cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:32.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cf7400640 1 -- 172.21.15.144:0/2611217930 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3210045195 0 0) 0x7f5cdc003530 con 0x7f5cf80af5d0 2024-09-12T12:16:32.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cfd400640 1 --2- 172.21.15.144:0/2611217930 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 0x7f5cf80cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cfd400640 1 -- 172.21.15.144:0/2611217930 >> v1:172.21.15.144:6789/0 conn(0x7f5cf80af5d0 legacy=0x7f5cf8163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cfd400640 1 -- 172.21.15.144:0/2611217930 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf80cfec0 con 0x7f5cf8166510 2024-09-12T12:16:32.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.659+0000 7f5cfca00640 1 --2- 172.21.15.144:0/2611217930 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 0x7f5cf80cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:32.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cfd400640 1 --2- 172.21.15.144:0/2611217930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cf8166510 0x7f5cf8166930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00097c0 tx=0x7f5cf001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81cfe5aee8a300a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:32.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cf7400640 1 -- 172.21.15.144:0/2611217930 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00b0070 con 0x7f5cf8166510 2024-09-12T12:16:32.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cf7400640 1 -- 172.21.15.144:0/2611217930 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf00ab400 con 0x7f5cf8166510 2024-09-12T12:16:32.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cf7400640 1 -- 172.21.15.144:0/2611217930 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4001680 con 0x7f5cf8166510 2024-09-12T12:16:32.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cff400640 1 -- 172.21.15.144:0/2611217930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cf8166510 msgr2=0x7f5cf8166930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cff400640 1 --2- 172.21.15.144:0/2611217930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cf8166510 0x7f5cf8166930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00097c0 tx=0x7f5cf001c3c0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cff400640 1 -- 172.21.15.144:0/2611217930 shutdown_connections 2024-09-12T12:16:32.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cff400640 1 --2- 172.21.15.144:0/2611217930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cf8166510 0x7f5cf8166930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cff400640 1 --2- 172.21.15.144:0/2611217930 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 0x7f5cf80cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cff400640 1 -- 172.21.15.144:0/2611217930 >> 172.21.15.144:0/2611217930 conn(0x7f5cf8068030 msgr2=0x7f5cf80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:32.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cff400640 1 -- 172.21.15.144:0/2611217930 shutdown_connections 2024-09-12T12:16:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.663+0000 7f5cff400640 1 -- 172.21.15.144:0/2611217930 wait complete. 2024-09-12T12:16:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 Processor -- start 2024-09-12T12:16:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 -- start start 2024-09-12T12:16:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cf80af5d0 0x7f5cf8154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 0x7f5cf8155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cf8166510 0x7f5cf815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf816fa30 con 0x7f5cf80af5d0 2024-09-12T12:16:32.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf816f8b0 con 0x7f5cf8166510 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf816fbb0 con 0x7f5cf8162a40 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cf80af5d0 0x7f5cf8154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cf80af5d0 0x7f5cf8154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52898/0 (socket says 172.21.15.144:52898) 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfca00640 1 -- 172.21.15.144:0/64124860 learned_addr learned my addr 172.21.15.144:0/64124860 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cf7e00640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 0x7f5cf8155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfd400640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cf8166510 0x7f5cf815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfca00640 1 -- 172.21.15.144:0/64124860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 msgr2=0x7f5cf8155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfca00640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 0x7f5cf8155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfca00640 1 -- 172.21.15.144:0/64124860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cf8166510 msgr2=0x7f5cf815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfca00640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cf8166510 0x7f5cf815a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfca00640 1 -- 172.21.15.144:0/64124860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf8072c40 con 0x7f5cf80af5d0 2024-09-12T12:16:32.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cfca00640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cf80af5d0 0x7f5cf8154e20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800efc0 tx=0x7f5ce800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cf4c00640 1 -- 172.21.15.144:0/64124860 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8018020 con 0x7f5cf80af5d0 2024-09-12T12:16:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cf4c00640 1 -- 172.21.15.144:0/64124860 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce8014680 con 0x7f5cf80af5d0 2024-09-12T12:16:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf8072f20 con 0x7f5cf80af5d0 2024-09-12T12:16:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cf4c00640 1 -- 172.21.15.144:0/64124860 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8014a50 con 0x7f5cf80af5d0 2024-09-12T12:16:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.667+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf815e770 con 0x7f5cf80af5d0 2024-09-12T12:16:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.671+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf80cf190 con 0x7f5cf80af5d0 2024-09-12T12:16:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.671+0000 7f5cf4c00640 1 -- 172.21.15.144:0/64124860 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ce801b020 con 0x7f5cf80af5d0 2024-09-12T12:16:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.671+0000 7f5cf4c00640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cd80678c0 0x7f5cd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.671+0000 7f5cf4c00640 1 -- 172.21.15.144:0/64124860 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f5ce8086c20 con 0x7f5cf80af5d0 2024-09-12T12:16:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.671+0000 7f5cf7e00640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cd80678c0 0x7f5cd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.671+0000 7f5cf7e00640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cd80678c0 0x7f5cd8069d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4001330 tx=0x7f5ce40012c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:32.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.675+0000 7f5cf4c00640 1 -- 172.21.15.144:0/64124860 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5ce8022030 con 0x7f5cf80af5d0 2024-09-12T12:16:32.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.831+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f5cf80730f0 con 0x7f5cf80af5d0 2024-09-12T12:16:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.835+0000 7f5cf4c00640 1 -- 172.21.15.144:0/64124860 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v17)=0 v17) ==== 116+0+0 (secure 0 0 0) 0x7f5ce8010040 con 0x7f5cf80af5d0 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cd80678c0 msgr2=0x7f5cd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cd80678c0 0x7f5cd8069d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4001330 tx=0x7f5ce40012c0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cf80af5d0 msgr2=0x7f5cf8154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cf80af5d0 0x7f5cf8154e20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800efc0 tx=0x7f5ce800c490 comp rx=0 tx=0).stop 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 shutdown_connections 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cd80678c0 0x7f5cd8069d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cf8166510 0x7f5cf815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cf8162a40 0x7f5cf8155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 --2- 172.21.15.144:0/64124860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cf80af5d0 0x7f5cf8154e20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 >> 172.21.15.144:0/64124860 conn(0x7f5cf8068030 msgr2=0x7f5cf815bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:32.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 shutdown_connections 2024-09-12T12:16:32.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32.839+0000 7f5cff400640 1 -- 172.21.15.144:0/64124860 wait complete. 2024-09-12T12:16:32.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:32.861 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-12T12:16:32.878 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:16:32.878 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:16:32.878 DEBUG:teuthology.orchestra.run.smithi144:> import stat 2024-09-12T12:16:32.878 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:16:32.878 DEBUG:teuthology.orchestra.run.smithi144:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-12T12:16:32.878 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:16:32.982 INFO:teuthology.orchestra.run.smithi144.stdout:1099511627776 2024-09-12T12:16:32.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:32.991 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:33.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c9600640 1 Processor -- start 2024-09-12T12:16:33.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c9600640 1 -- start start 2024-09-12T12:16:33.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c9600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62c415c7b0 0x7f62c40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c9600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f62c415cd30 0x7f62c40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c9600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c40b61e0 con 0x7f62c40b5de0 2024-09-12T12:16:33.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c9600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f62c4072a50 con 0x7f62c415c7b0 2024-09-12T12:16:33.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c9600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f62c40cde30 con 0x7f62c415cd30 2024-09-12T12:16:33.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62c415c7b0 0x7f62c40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62c415c7b0 0x7f62c40ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52908/0 (socket says 172.21.15.144:52908) 2024-09-12T12:16:33.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c2a00640 1 -- 172.21.15.144:0/1161919198 learned_addr learned my addr 172.21.15.144:0/1161919198 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:33.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c2000640 1 --2- 172.21.15.144:0/1161919198 >> v2:172.21.15.165:3300/0 conn(0x7f62c415cd30 0x7f62c40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c2a00640 1 -- 172.21.15.144:0/1161919198 >> v2:172.21.15.165:3300/0 conn(0x7f62c415cd30 msgr2=0x7f62c40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:33.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c2a00640 1 --2- 172.21.15.144:0/1161919198 >> v2:172.21.15.165:3300/0 conn(0x7f62c415cd30 0x7f62c40b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c2a00640 1 -- 172.21.15.144:0/1161919198 >> v1:172.21.15.144:6789/0 conn(0x7f62c40b5de0 legacy=0x7f62c41601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c2a00640 1 -- 172.21.15.144:0/1161919198 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c40cd870 con 0x7f62c415c7b0 2024-09-12T12:16:33.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.163+0000 7f62c1600640 1 -- 172.21.15.144:0/1161919198 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156092665 0 0) 0x7f62c40b61e0 con 0x7f62c40b5de0 2024-09-12T12:16:33.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c2a00640 1 --2- 172.21.15.144:0/1161919198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 0x7f62c40ccf00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f62c40afd90 tx=0x7f62b401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a043a3a9704f7b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:33.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c1600640 1 -- 172.21.15.144:0/1161919198 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b40a57a0 con 0x7f62c415c7b0 2024-09-12T12:16:33.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c1600640 1 -- 172.21.15.144:0/1161919198 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b40a5940 con 0x7f62c415c7b0 2024-09-12T12:16:33.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c1600640 1 -- 172.21.15.144:0/1161919198 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b40a5d10 con 0x7f62c415c7b0 2024-09-12T12:16:33.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c9600640 1 -- 172.21.15.144:0/1161919198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 msgr2=0x7f62c40ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c9600640 1 --2- 172.21.15.144:0/1161919198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 0x7f62c40ccf00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f62c40afd90 tx=0x7f62b401c9f0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c9600640 1 -- 172.21.15.144:0/1161919198 shutdown_connections 2024-09-12T12:16:33.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c9600640 1 --2- 172.21.15.144:0/1161919198 >> v2:172.21.15.165:3300/0 conn(0x7f62c415cd30 0x7f62c40b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c9600640 1 --2- 172.21.15.144:0/1161919198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 0x7f62c40ccf00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c9600640 1 -- 172.21.15.144:0/1161919198 >> 172.21.15.144:0/1161919198 conn(0x7f62c406d0d0 msgr2=0x7f62c406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:33.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c9600640 1 -- 172.21.15.144:0/1161919198 shutdown_connections 2024-09-12T12:16:33.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.167+0000 7f62c9600640 1 -- 172.21.15.144:0/1161919198 wait complete. 2024-09-12T12:16:33.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 Processor -- start 2024-09-12T12:16:33.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 -- start start 2024-09-12T12:16:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62c40b5de0 0x7f62c4147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 0x7f62c4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62c415cd30 0x7f62c41f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f62c4169320 con 0x7f62c415c7b0 2024-09-12T12:16:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f62c40cd650 con 0x7f62c415cd30 2024-09-12T12:16:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f62c41694a0 con 0x7f62c40b5de0 2024-09-12T12:16:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 0x7f62c4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 0x7f62c4157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52910/0 (socket says 172.21.15.144:52910) 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2000640 1 -- 172.21.15.144:0/1464274651 learned_addr learned my addr 172.21.15.144:0/1464274651 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2a00640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62c40b5de0 0x7f62c4147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c3400640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62c415cd30 0x7f62c41f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2000640 1 -- 172.21.15.144:0/1464274651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62c40b5de0 msgr2=0x7f62c4147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2000640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62c40b5de0 0x7f62c4147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2000640 1 -- 172.21.15.144:0/1464274651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62c415cd30 msgr2=0x7f62c41f7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2000640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62c415cd30 0x7f62c41f7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2000640 1 -- 172.21.15.144:0/1464274651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c4157ec0 con 0x7f62c415c7b0 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c2000640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 0x7f62c4157670 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f62b000d5f0 tx=0x7f62b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62baa00640 1 -- 172.21.15.144:0/1464274651 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00125f0 con 0x7f62c415c7b0 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62baa00640 1 -- 172.21.15.144:0/1464274651 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b0019070 con 0x7f62c415c7b0 2024-09-12T12:16:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c41581a0 con 0x7f62c415c7b0 2024-09-12T12:16:33.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62baa00640 1 -- 172.21.15.144:0/1464274651 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00129b0 con 0x7f62c415c7b0 2024-09-12T12:16:33.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.171+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c4158760 con 0x7f62c415c7b0 2024-09-12T12:16:33.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.175+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c40ccf00 con 0x7f62c415c7b0 2024-09-12T12:16:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.175+0000 7f62baa00640 1 -- 172.21.15.144:0/1464274651 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f62b0012b50 con 0x7f62c415c7b0 2024-09-12T12:16:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.175+0000 7f62baa00640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62a40678c0 0x7f62a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.175+0000 7f62baa00640 1 -- 172.21.15.144:0/1464274651 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f62b00861e0 con 0x7f62c415c7b0 2024-09-12T12:16:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.175+0000 7f62c2a00640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62a40678c0 0x7f62a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.175+0000 7f62c2a00640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62a40678c0 0x7f62a4069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f62b40ae000 tx=0x7f62b40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:33.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.179+0000 7f62baa00640 1 -- 172.21.15.144:0/1464274651 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f62b0056410 con 0x7f62c415c7b0 2024-09-12T12:16:33.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.367+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62c415f0f0 con 0x7f62c415c7b0 2024-09-12T12:16:33.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62baa00640 1 -- 172.21.15.144:0/1464274651 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5230 (secure 0 0 0) 0x7f62b005a710 con 0x7f62c415c7b0 2024-09-12T12:16:33.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:33.372 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":39,"btime":"2024-09-12T12:16:23:314428+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3523411663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3523411663},{"type":"v1","addr":"172.21.15.165:6834","nonce":3523411663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6174,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/831229399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":831229399},{"type":"v1","addr":"172.21.15.144:6836","nonce":831229399}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":6177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2387261211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2387261211},{"type":"v1","addr":"172.21.15.144:6837","nonce":2387261211}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:22.690993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6192},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6192":{"gid":6192,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/799094061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":799094061},{"type":"v1","addr":"172.21.15.165:6835","nonce":799094061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6192,"qdb_cluster":[6192]},"id":4}]} 2024-09-12T12:16:33.372 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 39 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62a40678c0 msgr2=0x7f62a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62a40678c0 0x7f62a4069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f62b40ae000 tx=0x7f62b40a7070 comp rx=0 tx=0).stop 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 msgr2=0x7f62c4157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 0x7f62c4157670 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f62b000d5f0 tx=0x7f62b000dab0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 shutdown_connections 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62a40678c0 0x7f62a4069d80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62c415cd30 0x7f62c41f7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62c415c7b0 0x7f62c4157670 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 --2- 172.21.15.144:0/1464274651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62c40b5de0 0x7f62c4147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 >> 172.21.15.144:0/1464274651 conn(0x7f62c406d0d0 msgr2=0x7f62c40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:33.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 shutdown_connections 2024-09-12T12:16:33.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33.371+0000 7f62c9600640 1 -- 172.21.15.144:0/1464274651 wait complete. 2024-09-12T12:16:33.393 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump inode 1099511627776 2024-09-12T12:16:33.563 INFO:teuthology.orchestra.run.smithi165.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-12T12:16:32.871022+0000","btime":"2024-09-12T12:16:32.871022+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T12:16:32.871022+0000","atime":"2024-09-12T12:16:32.871022+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6342,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6342,"want_loner":6342,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-12T12:16:33.564 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-12T12:16:32.871022+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-12T12:16:32.871022+0000", "change_attr": 0, "client_caps": [ { "client_id": 6342, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-12T12:16:32.871022+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6342, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-12T12:16:32.871022+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6342, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-09-12T12:16:33.564 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:33.564 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:33.573 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:16:33.573 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> import uuid 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> n = 40 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> create_hard_links = False 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> if 0 > 0: 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> create_hard_links = True 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> dpath = os.path.dirname(path) 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> fnameprefix = os.path.basename(path) 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> os.makedirs(dpath, exist_ok=True) 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> try: 2024-09-12T12:16:33.574 DEBUG:teuthology.orchestra.run.smithi144:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> for i in range(n): 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> f.write(f"{i}") 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> f.flush() 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(f.fileno()) 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> os.unlink(fpath) 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(dirfd) 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> if create_hard_links: 2024-09-12T12:16:33.575 DEBUG:teuthology.orchestra.run.smithi144:> for j in range(0): 2024-09-12T12:16:33.576 DEBUG:teuthology.orchestra.run.smithi144:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T12:16:33.576 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:16:33.576 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(dirfd) 2024-09-12T12:16:33.576 DEBUG:teuthology.orchestra.run.smithi144:> finally: 2024-09-12T12:16:33.576 DEBUG:teuthology.orchestra.run.smithi144:> os.close(dirfd) 2024-09-12T12:16:33.576 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:16:33.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:33.761 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:33.761 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:33.816 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:33.816 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:33.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:16:34.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f5716e00640 1 Processor -- start 2024-09-12T12:16:34.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f5716e00640 1 -- start start 2024-09-12T12:16:34.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f5716e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 0x7f57100ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f5716e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5710148570 con 0x7f57100b0480 2024-09-12T12:16:34.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f5716e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57100b41f0 con 0x7f57100cd470 2024-09-12T12:16:34.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f5716e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f57100ce090 con 0x7f5710148190 2024-09-12T12:16:34.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f5714e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f57100b0480 0x7f57100b46d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50038/0 (socket says 172.21.15.144:50038) 2024-09-12T12:16:34.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f5714e00640 1 -- 172.21.15.144:0/2992063586 learned_addr learned my addr 172.21.15.144:0/2992063586 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:34.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f570fe00640 1 --2- 172.21.15.144:0/2992063586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 0x7f57100ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f570f400640 1 -- 172.21.15.144:0/2992063586 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513491050 0 0) 0x7f5710148570 con 0x7f57100b0480 2024-09-12T12:16:34.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f570f400640 1 -- 172.21.15.144:0/2992063586 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56f4003530 con 0x7f57100b0480 2024-09-12T12:16:34.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f570f400640 1 -- 172.21.15.144:0/2992063586 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720871627 0 0) 0x7f57100b41f0 con 0x7f57100cd470 2024-09-12T12:16:34.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f570f400640 1 -- 172.21.15.144:0/2992063586 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5710148570 con 0x7f57100cd470 2024-09-12T12:16:34.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f570fe00640 1 -- 172.21.15.144:0/2992063586 >> v1:172.21.15.165:6789/0 conn(0x7f57100cd470 legacy=0x7f57100afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f570fe00640 1 -- 172.21.15.144:0/2992063586 >> v1:172.21.15.144:6789/0 conn(0x7f57100b0480 legacy=0x7f57100b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.047+0000 7f570fe00640 1 -- 172.21.15.144:0/2992063586 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57100b0950 con 0x7f5710148190 2024-09-12T12:16:34.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f570fe00640 1 --2- 172.21.15.144:0/2992063586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 0x7f57100ccf30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57100b43c0 tx=0x7f570001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f23cfbef3a97ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f570f400640 1 -- 172.21.15.144:0/2992063586 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000b1070 con 0x7f5710148190 2024-09-12T12:16:34.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f570f400640 1 -- 172.21.15.144:0/2992063586 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57000ac630 con 0x7f5710148190 2024-09-12T12:16:34.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f570f400640 1 -- 172.21.15.144:0/2992063586 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000a8050 con 0x7f5710148190 2024-09-12T12:16:34.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f5716e00640 1 -- 172.21.15.144:0/2992063586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 msgr2=0x7f57100ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f5716e00640 1 --2- 172.21.15.144:0/2992063586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 0x7f57100ccf30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57100b43c0 tx=0x7f570001c4c0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f5716e00640 1 -- 172.21.15.144:0/2992063586 shutdown_connections 2024-09-12T12:16:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f5716e00640 1 --2- 172.21.15.144:0/2992063586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 0x7f57100ccf30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f5716e00640 1 -- 172.21.15.144:0/2992063586 >> 172.21.15.144:0/2992063586 conn(0x7f571006d0d0 msgr2=0x7f571006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f5716e00640 1 -- 172.21.15.144:0/2992063586 shutdown_connections 2024-09-12T12:16:34.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.051+0000 7f5716e00640 1 -- 172.21.15.144:0/2992063586 wait complete. 2024-09-12T12:16:34.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 Processor -- start 2024-09-12T12:16:34.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 -- start start 2024-09-12T12:16:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57100b0480 0x7f571013f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57100cd470 0x7f57100726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 0x7f571015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f57100b55f0 con 0x7f57100b0480 2024-09-12T12:16:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f57100b11f0 con 0x7f57100cd470 2024-09-12T12:16:34.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f57100b5770 con 0x7f5710148190 2024-09-12T12:16:34.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57100b0480 0x7f571013f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57100b0480 0x7f571013f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52920/0 (socket says 172.21.15.144:52920) 2024-09-12T12:16:34.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570fe00640 1 -- 172.21.15.144:0/1274481471 learned_addr learned my addr 172.21.15.144:0/1274481471 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5707e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57100cd470 0x7f57100726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5714e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 0x7f571015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570fe00640 1 -- 172.21.15.144:0/1274481471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 msgr2=0x7f571015c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570fe00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 0x7f571015c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570fe00640 1 -- 172.21.15.144:0/1274481471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57100cd470 msgr2=0x7f57100726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570fe00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57100cd470 0x7f57100726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570fe00640 1 -- 172.21.15.144:0/1274481471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571013d550 con 0x7f57100b0480 2024-09-12T12:16:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570fe00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57100b0480 0x7f571013f430 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5700000c10 tx=0x7f570001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570cc00640 1 -- 172.21.15.144:0/1274481471 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000b1050 con 0x7f57100b0480 2024-09-12T12:16:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570cc00640 1 -- 172.21.15.144:0/1274481471 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57000bd070 con 0x7f57100b0480 2024-09-12T12:16:34.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f570cc00640 1 -- 172.21.15.144:0/1274481471 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700006e20 con 0x7f57100b0480 2024-09-12T12:16:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571015dfc0 con 0x7f57100b0480 2024-09-12T12:16:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.055+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5710071bf0 con 0x7f57100b0480 2024-09-12T12:16:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.059+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57100ccf30 con 0x7f57100b0480 2024-09-12T12:16:34.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.059+0000 7f570cc00640 1 -- 172.21.15.144:0/1274481471 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57000b6810 con 0x7f57100b0480 2024-09-12T12:16:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.059+0000 7f570cc00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56ec0678c0 0x7f56ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.059+0000 7f570cc00640 1 -- 172.21.15.144:0/1274481471 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f57001201a0 con 0x7f57100b0480 2024-09-12T12:16:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.059+0000 7f5707e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56ec0678c0 0x7f56ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.059+0000 7f5707e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56ec0678c0 0x7f56ec069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f571013f1c0 tx=0x7f56f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.063+0000 7f570cc00640 1 -- 172.21.15.144:0/1274481471 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f57000160b0 con 0x7f57100b0480 2024-09-12T12:16:34.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.231+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f57100b43d0 con 0x7f57100b0480 2024-09-12T12:16:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.231+0000 7f570cc00640 1 -- 172.21.15.144:0/1274481471 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) ==== 80+0+0 (secure 0 0 0) 0x7f57000f0340 con 0x7f57100b0480 2024-09-12T12:16:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:16:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56ec0678c0 msgr2=0x7f56ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56ec0678c0 0x7f56ec069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f571013f1c0 tx=0x7f56f8009040 comp rx=0 tx=0).stop 2024-09-12T12:16:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57100b0480 msgr2=0x7f571013f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57100b0480 0x7f571013f430 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5700000c10 tx=0x7f570001ad00 comp rx=0 tx=0).stop 2024-09-12T12:16:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 shutdown_connections 2024-09-12T12:16:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56ec0678c0 0x7f56ec069d80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5710148190 0x7f571015c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57100cd470 0x7f57100726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 --2- 172.21.15.144:0/1274481471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57100b0480 0x7f571013f430 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 >> 172.21.15.144:0/1274481471 conn(0x7f571006d0d0 msgr2=0x7f571013ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 shutdown_connections 2024-09-12T12:16:34.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.235+0000 7f5716e00640 1 -- 172.21.15.144:0/1274481471 wait complete. 2024-09-12T12:16:34.257 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:16:34.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:34.257 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:34.343 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:16:34.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:34.343 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:16:34.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-12T12:16:34.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.535+0000 7f869b800640 1 Processor -- start 2024-09-12T12:16:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.535+0000 7f869b800640 1 -- start start 2024-09-12T12:16:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f869b800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f869415c2e0 0x7f8694072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f869b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86940af5f0 0x7f869406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f869b800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86940733e0 con 0x7f869406c150 2024-09-12T12:16:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f869b800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f869406c5c0 con 0x7f869415c2e0 2024-09-12T12:16:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f869b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86940cd290 con 0x7f86940af5f0 2024-09-12T12:16:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8698e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f869415c2e0 0x7f8694072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8699800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f869406c150 0x7f869406d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50040/0 (socket says 172.21.15.144:50040) 2024-09-12T12:16:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8699800640 1 -- 172.21.15.144:0/1890035781 learned_addr learned my addr 172.21.15.144:0/1890035781 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8693e00640 1 --2- 172.21.15.144:0/1890035781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86940af5f0 0x7f869406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8698e00640 1 -- 172.21.15.144:0/1890035781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86940af5f0 msgr2=0x7f869406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8698e00640 1 --2- 172.21.15.144:0/1890035781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86940af5f0 0x7f869406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8698e00640 1 -- 172.21.15.144:0/1890035781 >> v1:172.21.15.144:6789/0 conn(0x7f869406c150 legacy=0x7f869406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8693400640 1 -- 172.21.15.144:0/1890035781 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422701400 0 0) 0x7f86940733e0 con 0x7f869406c150 2024-09-12T12:16:34.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8698e00640 1 -- 172.21.15.144:0/1890035781 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86940cd570 con 0x7f869415c2e0 2024-09-12T12:16:34.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.539+0000 7f8693e00640 1 --2- 172.21.15.144:0/1890035781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86940af5f0 0x7f869406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f8698e00640 1 --2- 172.21.15.144:0/1890035781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 0x7f8694072b50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8684009d90 tx=0x7f868401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f79a7f31a1ceb4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f8693400640 1 -- 172.21.15.144:0/1890035781 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86840b2070 con 0x7f869415c2e0 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f8693400640 1 -- 172.21.15.144:0/1890035781 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86840a5820 con 0x7f869415c2e0 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f8693400640 1 -- 172.21.15.144:0/1890035781 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86840a5bf0 con 0x7f869415c2e0 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 -- 172.21.15.144:0/1890035781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 msgr2=0x7f8694072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 --2- 172.21.15.144:0/1890035781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 0x7f8694072b50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8684009d90 tx=0x7f868401c850 comp rx=0 tx=0).stop 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 -- 172.21.15.144:0/1890035781 shutdown_connections 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 --2- 172.21.15.144:0/1890035781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86940af5f0 0x7f869406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 --2- 172.21.15.144:0/1890035781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 0x7f8694072b50 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 -- 172.21.15.144:0/1890035781 >> 172.21.15.144:0/1890035781 conn(0x7f8694068030 msgr2=0x7f86940b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 -- 172.21.15.144:0/1890035781 shutdown_connections 2024-09-12T12:16:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 -- 172.21.15.144:0/1890035781 wait complete. 2024-09-12T12:16:34.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 Processor -- start 2024-09-12T12:16:34.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 -- start start 2024-09-12T12:16:34.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f869406c150 0x7f8694142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86940af5f0 0x7f869415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 0x7f8694158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86941690a0 con 0x7f869415c2e0 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8694168f20 con 0x7f86940af5f0 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.543+0000 7f869b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8694169220 con 0x7f869406c150 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8699800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 0x7f8694158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8699800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 0x7f8694158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52938/0 (socket says 172.21.15.144:52938) 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8699800640 1 -- 172.21.15.144:0/3236345771 learned_addr learned my addr 172.21.15.144:0/3236345771 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8698e00640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f869406c150 0x7f8694142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8693e00640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86940af5f0 0x7f869415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8699800640 1 -- 172.21.15.144:0/3236345771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f869406c150 msgr2=0x7f8694142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8699800640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f869406c150 0x7f8694142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8699800640 1 -- 172.21.15.144:0/3236345771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86940af5f0 msgr2=0x7f869415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8699800640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86940af5f0 0x7f869415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8699800640 1 -- 172.21.15.144:0/3236345771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86940b3570 con 0x7f869415c2e0 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8693e00640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86940af5f0 0x7f869415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8699800640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 0x7f8694158190 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f868c00c480 tx=0x7f868c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8690c00640 1 -- 172.21.15.144:0/3236345771 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c018070 con 0x7f869415c2e0 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8690c00640 1 -- 172.21.15.144:0/3236345771 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c0074e0 con 0x7f869415c2e0 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8690c00640 1 -- 172.21.15.144:0/3236345771 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c004a30 con 0x7f869415c2e0 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f869b800640 1 -- 172.21.15.144:0/3236345771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86940b3850 con 0x7f869415c2e0 2024-09-12T12:16:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f869b800640 1 -- 172.21.15.144:0/3236345771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86940b3e10 con 0x7f869415c2e0 2024-09-12T12:16:34.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.547+0000 7f8690c00640 1 -- 172.21.15.144:0/3236345771 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f868c004bd0 con 0x7f869415c2e0 2024-09-12T12:16:34.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8690c00640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86740678c0 0x7f8674069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8690c00640 1 -- 172.21.15.144:0/3236345771 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f868c085170 con 0x7f869415c2e0 2024-09-12T12:16:34.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86740678c0 0x7f8674069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 Processor -- start 2024-09-12T12:16:34.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86740678c0 0x7f8674069d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f86840af000 tx=0x7f86840a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 -- start start 2024-09-12T12:16:34.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb535d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5310870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 0x55ecb5311190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ecb51fa960 con 0x55ecb535d690 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ecb513e900 con 0x55ecb5310db0 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ecb5161d40 con 0x55ecb535cd70 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb535d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8693e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5310870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb535d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:44900/0 (socket says 172.21.15.144:44900) 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 -- 172.21.15.144:0/3413490886 learned_addr learned my addr 172.21.15.144:0/3413490886 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8699800640 1 --2- 172.21.15.144:0/3413490886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 0x55ecb5311190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 -- 172.21.15.144:0/3413490886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 msgr2=0x55ecb5311190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 --2- 172.21.15.144:0/3413490886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 0x55ecb5311190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 -- 172.21.15.144:0/3413490886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 msgr2=0x55ecb5310870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 --2- 172.21.15.144:0/3413490886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5310870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 -- 172.21.15.144:0/3413490886 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecb5108580 con 0x55ecb535cd70 2024-09-12T12:16:34.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8693e00640 1 --2- 172.21.15.144:0/3413490886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5310870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:34.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8698e00640 1 --2- 172.21.15.144:0/3413490886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb535d150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f868401a480 tx=0x7f8684004ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6de0adb7bbd8d67e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8689600640 1 -- 172.21.15.144:0/3413490886 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86840cb070 con 0x55ecb535cd70 2024-09-12T12:16:34.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8689600640 1 -- 172.21.15.144:0/3413490886 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86840b9720 con 0x55ecb535cd70 2024-09-12T12:16:34.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f8689600640 1 -- 172.21.15.144:0/3413490886 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86840b2040 con 0x55ecb535cd70 2024-09-12T12:16:34.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 -- 172.21.15.144:0/3413490886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 msgr2=0x55ecb535d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.551+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3413490886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb535d150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f868401a480 tx=0x7f8684004ac0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- 172.21.15.144:0/3413490886 shutdown_connections 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3413490886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 0x55ecb5311190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3413490886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5310870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3413490886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb535d150 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- 172.21.15.144:0/3413490886 >> 172.21.15.144:0/3413490886 conn(0x55ecb533e040 msgr2=0x55ecb5340430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- 172.21.15.144:0/3413490886 shutdown_connections 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- 172.21.15.144:0/3413490886 wait complete. 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- start start 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 Processor -- start 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb5310db0 0x55ecb5363ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb5364220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 0x55ecb5364760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ecb515dd00 con 0x55ecb5310db0 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ecb511caa0 con 0x55ecb535d690 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ecb50fb340 con 0x55ecb535cd70 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 10 client.0 _ll_register_callbacks cb 0x55ecb52fe760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8698e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb5310db0 0x55ecb5363ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8698e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb5310db0 0x55ecb5363ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52950/0 (socket says 172.21.15.144:52950) 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8698e00640 1 -- 172.21.15.144:0/3609913278 learned_addr learned my addr 172.21.15.144:0/3609913278 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8699800640 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 0x55ecb5364760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8693e00640 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb5364220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8698e00640 1 -- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 msgr2=0x55ecb5364220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8698e00640 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb5364220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8698e00640 1 -- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 msgr2=0x55ecb5364760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8698e00640 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 0x55ecb5364760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8698e00640 1 -- 172.21.15.144:0/3609913278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecb5104dc0 con 0x55ecb5310db0 2024-09-12T12:16:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8693e00640 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb5364220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8698e00640 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb5310db0 0x55ecb5363ce0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f868401a480 tx=0x7f868401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f726d5fdd0bea513 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f867e000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f867e000640 1 -- 172.21.15.144:0/3609913278 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86840d6060 con 0x55ecb5310db0 2024-09-12T12:16:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f867e000640 1 -- 172.21.15.144:0/3609913278 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f86840b9ad0 con 0x55ecb5310db0 2024-09-12T12:16:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- 172.21.15.144:0/3609913278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86840b9720 con 0x55ecb5310db0 2024-09-12T12:16:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f867e000640 1 -- 172.21.15.144:0/3609913278 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f86840dc050 con 0x55ecb5310db0 2024-09-12T12:16:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 10 client.6393 fetch_fsmap learned FSMap version 39 2024-09-12T12:16:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- 172.21.15.144:0/3609913278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55ecb51017f0 con 0x55ecb5310db0 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f867e000640 1 -- 172.21.15.144:0/3609913278 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86840b9720 con 0x55ecb5310db0 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f867e000640 1 -- 172.21.15.144:0/3609913278 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 39) ==== 3502+0+0 (secure 0 0 0) 0x7f86840b9cd0 con 0x55ecb5310db0 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 10 client.6393 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 10 client.6393 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 20 client.6393 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55ecb536c0b0 0x55ecb536e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 4 client.6393 mds_command: new command op to 6192 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f869ebf4000 1 -- 172.21.15.144:0/3609913278 --> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecb50fbe10 con 0x55ecb536c0b0 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.555+0000 7f8693e00640 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55ecb536c0b0 0x55ecb536e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f8693e00640 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55ecb536c0b0 0x55ecb536e4a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d68e1622ba6edcb server_cookie=56c7dcd0dbc62707 in_seq=0 out_seq=0 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f867e000640 10 client.6393 ms_handle_connect on v2:172.21.15.165:6833/799094061 2024-09-12T12:16:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f867e000640 1 -- 172.21.15.144:0/3609913278 <== mds.0 v2:172.21.15.165:6833/799094061 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ecb50fbe10 con 0x55ecb536c0b0 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f867e000640 10 client.6393 handle_command_reply: tid=0 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 client.6393 shutdown 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 -- 172.21.15.144:0/3609913278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb5310db0 msgr2=0x55ecb5363ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb5310db0 0x55ecb5363ce0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f868401a480 tx=0x7f868401b090 comp rx=0 tx=0).stop 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 -- 172.21.15.144:0/3609913278 shutdown_connections 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55ecb536c0b0 0x55ecb536e4a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 0x55ecb5364760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f867e000640 0 client.6393 ms_handle_reset on v2:172.21.15.165:6833/799094061 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb5364220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3609913278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb5310db0 0x55ecb5363ce0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 -- 172.21.15.144:0/3609913278 >> 172.21.15.144:0/3609913278 conn(0x55ecb533e040 msgr2=0x55ecb530ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 -- 172.21.15.144:0/3609913278 shutdown_connections 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 1 -- 172.21.15.144:0/3609913278 wait complete. 2024-09-12T12:16:34.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.559+0000 7f869ebf4000 20 client.6393 trim_cache size 0 max 16384 2024-09-12T12:16:34.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 Processor -- start 2024-09-12T12:16:34.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- start start 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 0x55ecb5317bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb5318130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5318670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8694204600 con 0x55ecb535d690 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86942035e0 con 0x55ecb5310db0 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86941f8020 con 0x55ecb535cd70 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8699800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5318670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8699800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5318670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52956/0 (socket says 172.21.15.144:52956) 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8699800640 1 -- 172.21.15.144:0/2545280775 learned_addr learned my addr 172.21.15.144:0/2545280775 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8698e00640 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 0x55ecb5317bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8693e00640 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb5318130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8699800640 1 -- 172.21.15.144:0/2545280775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 msgr2=0x55ecb5318130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8699800640 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb5318130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8699800640 1 -- 172.21.15.144:0/2545280775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 msgr2=0x55ecb5317bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8699800640 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 0x55ecb5317bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8699800640 1 -- 172.21.15.144:0/2545280775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecb511f470 con 0x55ecb535d690 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8698e00640 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 0x55ecb5317bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8699800640 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5318670 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f868c051890 tx=0x7f868c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9e39f8716af3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8688c00640 1 -- 172.21.15.144:0/2545280775 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c053730 con 0x55ecb535d690 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8688c00640 1 -- 172.21.15.144:0/2545280775 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c051aa0 con 0x55ecb535d690 2024-09-12T12:16:34.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f8688c00640 1 -- 172.21.15.144:0/2545280775 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c06d3e0 con 0x55ecb535d690 2024-09-12T12:16:34.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- 172.21.15.144:0/2545280775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 msgr2=0x55ecb5318670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5318670 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f868c051890 tx=0x7f868c009040 comp rx=0 tx=0).stop 2024-09-12T12:16:34.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- 172.21.15.144:0/2545280775 shutdown_connections 2024-09-12T12:16:34.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535d690 0x55ecb5318670 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb535cd70 0x55ecb5318130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 --2- 172.21.15.144:0/2545280775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb5310db0 0x55ecb5317bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- 172.21.15.144:0/2545280775 >> 172.21.15.144:0/2545280775 conn(0x55ecb533e040 msgr2=0x55ecb5315820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- 172.21.15.144:0/2545280775 shutdown_connections 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- 172.21.15.144:0/2545280775 wait complete. 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.575+0000 7f869ebf4000 1 -- start start 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 Processor -- start 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb5310db0 0x55ecb53cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535cd70 0x55ecb53707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 0x55ecb5370d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ecb51207c0 con 0x55ecb535cd70 2024-09-12T12:16:34.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8694202f10 con 0x55ecb535d690 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ecb51203f0 con 0x55ecb5310db0 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 10 client.0 _ll_register_callbacks cb 0x7f86840c9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8693e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535cd70 0x55ecb53707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8698e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb5310db0 0x55ecb53cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8693e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535cd70 0x55ecb53707e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52958/0 (socket says 172.21.15.144:52958) 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8699800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 0x55ecb5370d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8693e00640 1 -- 172.21.15.144:0/3825659704 learned_addr learned my addr 172.21.15.144:0/3825659704 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8698e00640 1 -- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 msgr2=0x55ecb5370d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8698e00640 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 0x55ecb5370d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8698e00640 1 -- 172.21.15.144:0/3825659704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535cd70 msgr2=0x55ecb53707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8698e00640 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535cd70 0x55ecb53707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8698e00640 1 -- 172.21.15.144:0/3825659704 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55ecb50f5640 con 0x55ecb5310db0 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8693e00640 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535cd70 0x55ecb53707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:34.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8699800640 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 0x55ecb5370d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8698e00640 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb5310db0 0x55ecb53cbc60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f868401cdc0 tx=0x7f86840c1000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bf84d85a5746644 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f867e000640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f867e000640 1 -- 172.21.15.144:0/3825659704 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86840cb070 con 0x55ecb5310db0 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f867e000640 1 -- 172.21.15.144:0/3825659704 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f86840d1be0 con 0x55ecb5310db0 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 -- 172.21.15.144:0/3825659704 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f868c051aa0 con 0x55ecb5310db0 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f867e000640 1 -- 172.21.15.144:0/3825659704 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f86840ee050 con 0x55ecb5310db0 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 10 client.5780 fetch_fsmap learned FSMap version 39 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 -- 172.21.15.144:0/3825659704 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55ecb50f93b0 con 0x55ecb5310db0 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f867e000640 1 -- 172.21.15.144:0/3825659704 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f868c051aa0 con 0x55ecb5310db0 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f867e000640 1 -- 172.21.15.144:0/3825659704 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 39) ==== 3502+0+0 (secure 0 0 0) 0x7f86840f1020 con 0x55ecb5310db0 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 10 client.5780 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T12:16:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 10 client.5780 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-12T12:16:34.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 20 client.5780 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:34.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55ecb5371260 0x55ecb5371670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 4 client.5780 mds_command: new command op to 6192 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:16:34.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f869ebf4000 1 -- 172.21.15.144:0/3825659704 --> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ecb516f470 con 0x55ecb5371260 2024-09-12T12:16:34.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8693e00640 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55ecb5371260 0x55ecb5371670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f8693e00640 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55ecb5371260 0x55ecb5371670 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eca0e7cdbd24eec2 server_cookie=542f5f6493835d80 in_seq=0 out_seq=0 2024-09-12T12:16:34.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.579+0000 7f867e000640 10 client.5780 ms_handle_connect on v2:172.21.15.165:6833/799094061 2024-09-12T12:16:34.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f867e000640 1 -- 172.21.15.144:0/3825659704 <== mds.0 v2:172.21.15.165:6833/799094061 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8680000e50 con 0x55ecb5371260 2024-09-12T12:16:34.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f867e000640 10 client.5780 handle_command_reply: tid=0 2024-09-12T12:16:34.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 client.5780 shutdown 2024-09-12T12:16:34.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 -- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb5310db0 msgr2=0x55ecb53cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb5310db0 0x55ecb53cbc60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f868401cdc0 tx=0x7f86840c1000 comp rx=0 tx=0).stop 2024-09-12T12:16:34.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 -- 172.21.15.144:0/3825659704 shutdown_connections 2024-09-12T12:16:34.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:6833/799094061,v1:172.21.15.165:6835/799094061] conn(0x55ecb5371260 0x55ecb5371670 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ecb535d690 0x55ecb5370d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ecb535cd70 0x55ecb53707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 --2- 172.21.15.144:0/3825659704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ecb5310db0 0x55ecb53cbc60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f867e000640 0 client.5780 ms_handle_reset on v2:172.21.15.165:6833/799094061 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 -- 172.21.15.144:0/3825659704 >> 172.21.15.144:0/3825659704 conn(0x55ecb533e040 msgr2=0x55ecb5369ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 -- 172.21.15.144:0/3825659704 shutdown_connections 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 1 -- 172.21.15.144:0/3825659704 wait complete. 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869ebf4000 20 client.5780 trim_cache size 0 max 16384 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:16:34.599 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:16:34.600 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:16:34.600 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:16:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 -- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86740678c0 msgr2=0x7f8674069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86740678c0 0x7f8674069d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f86840af000 tx=0x7f86840a7070 comp rx=0 tx=0).stop 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 -- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 msgr2=0x7f8694158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 0x7f8694158190 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f868c00c480 tx=0x7f868c00c940 comp rx=0 tx=0).stop 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 -- 172.21.15.144:0/3236345771 shutdown_connections 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86740678c0 0x7f8674069d80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f869415c2e0 0x7f8694158190 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86940af5f0 0x7f869415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 --2- 172.21.15.144:0/3236345771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f869406c150 0x7f8694142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 -- 172.21.15.144:0/3236345771 >> 172.21.15.144:0/3236345771 conn(0x7f8694068030 msgr2=0x7f869406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 -- 172.21.15.144:0/3236345771 shutdown_connections 2024-09-12T12:16:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.595+0000 7f869b800640 1 -- 172.21.15.144:0/3236345771 wait complete. 2024-09-12T12:16:34.618 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:16:34.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:34.618 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:16:34.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:34.619 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:16:34.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:34.619 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:16:34.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:34.629 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:16:34.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-12T12:16:34.630 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:16:34.630 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-12T12:16:34.632 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:16:34.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-12T12:16:34.634 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:16:34.634 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-12T12:16:34.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.819+0000 7f07b6000640 1 Processor -- start 2024-09-12T12:16:34.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.819+0000 7f5331000640 1 Processor -- start 2024-09-12T12:16:34.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.819+0000 7f07b6000640 1 -- start start 2024-09-12T12:16:34.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.819+0000 7f632b600640 1 Processor -- start 2024-09-12T12:16:34.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.819+0000 7ff465800640 1 Processor -- start 2024-09-12T12:16:34.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.819+0000 7f5331000640 1 -- start start 2024-09-12T12:16:34.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.819+0000 7f632b600640 1 -- start start 2024-09-12T12:16:34.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.819+0000 7ff465800640 1 -- start start 2024-09-12T12:16:34.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f5331000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f532c155800 0x7f532c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f5331000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 0x7f532c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f5331000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f532c0b65c0 0x7f532c15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f5331000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f532c0b5250 con 0x7f532c0b65c0 2024-09-12T12:16:34.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f5331000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f532c0b6d20 con 0x7f532c155800 2024-09-12T12:16:34.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f5331000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f532c0b7000 con 0x7f532c0b4e10 2024-09-12T12:16:34.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f632b600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f632415c2f0 0x7f63240b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f632b600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 0x7f63240b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f632b600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63240ce730 0x7f63240cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f632b600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f632415cbb0 con 0x7f63240ce730 2024-09-12T12:16:34.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f632b600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f632415ce90 con 0x7f632415c2f0 2024-09-12T12:16:34.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f632b600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f632415d170 con 0x7f632415c6d0 2024-09-12T12:16:34.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f532c0b65c0 0x7f532c15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f532c0b65c0 0x7f532c15eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52972/0 (socket says 172.21.15.144:52972) 2024-09-12T12:16:34.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532be00640 1 -- 172.21.15.144:0/287409082 learned_addr learned my addr 172.21.15.144:0/287409082 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532aa00640 1 --2- 172.21.15.144:0/287409082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 0x7f532c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6328c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f632415c2f0 0x7f63240b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6323e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 0x7f63240b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6328c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f632415c2f0 0x7f63240b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:51690/0 (socket says 172.21.15.144:51690) 2024-09-12T12:16:34.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6328c00640 1 -- 172.21.15.144:0/3179380903 learned_addr learned my addr 172.21.15.144:0/3179380903 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07b6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f07b0147570 0x7f07b006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07b6000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f07b0147a70 0x7f07b006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532b400640 1 --2- 172.21.15.144:0/287409082 >> v2:172.21.15.165:3300/0 conn(0x7f532c155800 0x7f532c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07b6000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b00b6730 con 0x7f07b0147fc0 2024-09-12T12:16:34.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07b6000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f07b0162100 con 0x7f07b0147570 2024-09-12T12:16:34.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07b6000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f07b01623e0 con 0x7f07b0147a70 2024-09-12T12:16:34.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6329600640 1 --2- 172.21.15.144:0/3179380903 >> v2:172.21.15.144:3300/0 conn(0x7f63240ce730 0x7f63240cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532be00640 1 -- 172.21.15.144:0/287409082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 msgr2=0x7f532c0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532be00640 1 --2- 172.21.15.144:0/287409082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 0x7f532c0b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532be00640 1 -- 172.21.15.144:0/287409082 >> v2:172.21.15.165:3300/0 conn(0x7f532c155800 msgr2=0x7f532c0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532be00640 1 --2- 172.21.15.144:0/287409082 >> v2:172.21.15.165:3300/0 conn(0x7f532c155800 0x7f532c0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532be00640 1 -- 172.21.15.144:0/287409082 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c071eb0 con 0x7f532c0b65c0 2024-09-12T12:16:34.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07aea00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f07b0147fc0 0x7f07b00ae890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:41782/0 (socket says 172.21.15.144:41782) 2024-09-12T12:16:34.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07aea00640 1 -- 172.21.15.144:0/529966455 learned_addr learned my addr 172.21.15.144:0/529966455 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:34.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07af400640 1 --2- 172.21.15.144:0/529966455 >> v2:172.21.15.144:3300/0 conn(0x7f07b0147570 0x7f07b006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07afe00640 1 --2- 172.21.15.144:0/529966455 >> v2:172.21.15.165:3300/0 conn(0x7f07b0147a70 0x7f07b006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6328c00640 1 -- 172.21.15.144:0/3179380903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 msgr2=0x7f63240b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6328c00640 1 --2- 172.21.15.144:0/3179380903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 0x7f63240b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6328c00640 1 -- 172.21.15.144:0/3179380903 >> v2:172.21.15.144:3300/0 conn(0x7f63240ce730 msgr2=0x7f63240cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6328c00640 1 --2- 172.21.15.144:0/3179380903 >> v2:172.21.15.144:3300/0 conn(0x7f63240ce730 0x7f63240cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f6328c00640 1 -- 172.21.15.144:0/3179380903 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632415d450 con 0x7f632415c2f0 2024-09-12T12:16:34.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff465800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff46015c220 0x7ff4600d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff465800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4600b4200 0x7ff4600b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff465800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4600d1580 con 0x7ff4600732c0 2024-09-12T12:16:34.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff465800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff4600b4bb0 con 0x7ff4600b4200 2024-09-12T12:16:34.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff465800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff4600d1860 con 0x7ff46015c220 2024-09-12T12:16:34.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff45ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff46015c220 0x7ff4600d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff45ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff46015c220 0x7ff4600d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:51702/0 (socket says 172.21.15.144:51702) 2024-09-12T12:16:34.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff45ea00640 1 -- 172.21.15.144:0/1336962104 learned_addr learned my addr 172.21.15.144:0/1336962104 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f532b400640 1 --2- 172.21.15.144:0/287409082 >> v2:172.21.15.165:3300/0 conn(0x7f532c155800 0x7f532c0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:34.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07af400640 1 -- 172.21.15.144:0/529966455 >> v2:172.21.15.165:3300/0 conn(0x7f07b0147a70 msgr2=0x7f07b006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07af400640 1 --2- 172.21.15.144:0/529966455 >> v2:172.21.15.165:3300/0 conn(0x7f07b0147a70 0x7f07b006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff45e000640 1 --2- 172.21.15.144:0/1336962104 >> v2:172.21.15.144:3300/0 conn(0x7ff4600b4200 0x7ff4600b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07af400640 1 -- 172.21.15.144:0/529966455 >> v1:172.21.15.165:6789/0 conn(0x7f07b0147fc0 legacy=0x7f07b00ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7f07af400640 1 -- 172.21.15.144:0/529966455 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b01626c0 con 0x7f07b0147570 2024-09-12T12:16:34.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff45ea00640 1 -- 172.21.15.144:0/1336962104 >> v2:172.21.15.144:3300/0 conn(0x7ff4600b4200 msgr2=0x7ff4600b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:34.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff45ea00640 1 --2- 172.21.15.144:0/1336962104 >> v2:172.21.15.144:3300/0 conn(0x7ff4600b4200 0x7ff4600b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff45ea00640 1 -- 172.21.15.144:0/1336962104 >> v1:172.21.15.165:6789/0 conn(0x7ff4600732c0 legacy=0x7ff4600736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.823+0000 7ff45ea00640 1 -- 172.21.15.144:0/1336962104 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4600d1b40 con 0x7ff46015c220 2024-09-12T12:16:34.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f532aa00640 1 --2- 172.21.15.144:0/287409082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 0x7f532c0b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f6328c00640 1 --2- 172.21.15.144:0/3179380903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f632415c2f0 0x7f63240b3500 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f632406cc20 tx=0x7f631801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3e99f0f2df000c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f6323400640 1 -- 172.21.15.144:0/3179380903 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180aa660 con 0x7f632415c2f0 2024-09-12T12:16:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f6323400640 1 -- 172.21.15.144:0/3179380903 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63180af070 con 0x7f632415c2f0 2024-09-12T12:16:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f6323400640 1 -- 172.21.15.144:0/3179380903 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180aaa20 con 0x7f632415c2f0 2024-09-12T12:16:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff45ea00640 1 --2- 172.21.15.144:0/1336962104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff46015c220 0x7ff4600d0c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff460074b30 tx=0x7ff45001c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edc1034ffe80ab23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff45d600640 1 -- 172.21.15.144:0/1336962104 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4500b0070 con 0x7ff46015c220 2024-09-12T12:16:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff45d600640 1 -- 172.21.15.144:0/1336962104 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff450004230 con 0x7ff46015c220 2024-09-12T12:16:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff45d600640 1 -- 172.21.15.144:0/1336962104 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450003620 con 0x7ff46015c220 2024-09-12T12:16:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f632b600640 1 -- 172.21.15.144:0/3179380903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f632415c2f0 msgr2=0x7f63240b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f632b600640 1 --2- 172.21.15.144:0/3179380903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f632415c2f0 0x7f63240b3500 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f632406cc20 tx=0x7f631801c520 comp rx=0 tx=0).stop 2024-09-12T12:16:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f632b600640 1 -- 172.21.15.144:0/3179380903 shutdown_connections 2024-09-12T12:16:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f632b600640 1 --2- 172.21.15.144:0/3179380903 >> v2:172.21.15.144:3300/0 conn(0x7f63240ce730 0x7f63240cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f632b600640 1 --2- 172.21.15.144:0/3179380903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 0x7f63240b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f632b600640 1 --2- 172.21.15.144:0/3179380903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f632415c2f0 0x7f63240b3500 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f632b600640 1 -- 172.21.15.144:0/3179380903 >> 172.21.15.144:0/3179380903 conn(0x7f632406f8b0 msgr2=0x7f632406fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f632b600640 1 -- 172.21.15.144:0/3179380903 shutdown_connections 2024-09-12T12:16:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f632b600640 1 -- 172.21.15.144:0/3179380903 wait complete. 2024-09-12T12:16:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff465800640 1 -- 172.21.15.144:0/1336962104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff46015c220 msgr2=0x7ff4600d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff465800640 1 --2- 172.21.15.144:0/1336962104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff46015c220 0x7ff4600d0c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff460074b30 tx=0x7ff45001c3b0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff465800640 1 -- 172.21.15.144:0/1336962104 shutdown_connections 2024-09-12T12:16:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff465800640 1 --2- 172.21.15.144:0/1336962104 >> v2:172.21.15.144:3300/0 conn(0x7ff4600b4200 0x7ff4600b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff465800640 1 --2- 172.21.15.144:0/1336962104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff46015c220 0x7ff4600d0c10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff465800640 1 -- 172.21.15.144:0/1336962104 >> 172.21.15.144:0/1336962104 conn(0x7ff46006f400 msgr2=0x7ff46006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f532be00640 1 --2- 172.21.15.144:0/287409082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 0x7f532c15eb30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f532c0b4060 tx=0x7f532401c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ff7759edece8b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff465800640 1 -- 172.21.15.144:0/1336962104 shutdown_connections 2024-09-12T12:16:34.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7ff465800640 1 -- 172.21.15.144:0/1336962104 wait complete. 2024-09-12T12:16:34.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f07af400640 1 --2- 172.21.15.144:0/529966455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 0x7f07b006bc10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f07b0071bf0 tx=0x7f07a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b829c5509c16fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f532a000640 1 -- 172.21.15.144:0/287409082 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240a64b0 con 0x7f532c0b65c0 2024-09-12T12:16:34.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f532a000640 1 -- 172.21.15.144:0/287409082 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53240a6650 con 0x7f532c0b65c0 2024-09-12T12:16:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f532a000640 1 -- 172.21.15.144:0/287409082 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240a6a20 con 0x7f532c0b65c0 2024-09-12T12:16:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f07ae000640 1 -- 172.21.15.144:0/529966455 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a00b0070 con 0x7f07b0147570 2024-09-12T12:16:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f07ae000640 1 -- 172.21.15.144:0/529966455 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a00ab600 con 0x7f07b0147570 2024-09-12T12:16:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.827+0000 7f07ae000640 1 -- 172.21.15.144:0/529966455 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a00ab9d0 con 0x7f07b0147570 2024-09-12T12:16:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f632b600640 1 Processor -- start 2024-09-12T12:16:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 -- 172.21.15.144:0/529966455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 msgr2=0x7f07b006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 --2- 172.21.15.144:0/529966455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 0x7f07b006bc10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f07b0071bf0 tx=0x7f07a001c480 comp rx=0 tx=0).stop 2024-09-12T12:16:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 -- 172.21.15.144:0/287409082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 msgr2=0x7f532c15eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 --2- 172.21.15.144:0/287409082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 0x7f532c15eb30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f532c0b4060 tx=0x7f532401c750 comp rx=0 tx=0).stop 2024-09-12T12:16:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f632b600640 1 -- start start 2024-09-12T12:16:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 -- 172.21.15.144:0/529966455 shutdown_connections 2024-09-12T12:16:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 --2- 172.21.15.144:0/529966455 >> v2:172.21.15.165:3300/0 conn(0x7f07b0147a70 0x7f07b006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 --2- 172.21.15.144:0/529966455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 0x7f07b006bc10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 -- 172.21.15.144:0/529966455 >> 172.21.15.144:0/529966455 conn(0x7f07b006f8b0 msgr2=0x7f07b006fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 -- 172.21.15.144:0/287409082 shutdown_connections 2024-09-12T12:16:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 --2- 172.21.15.144:0/287409082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 0x7f532c15eb30 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 --2- 172.21.15.144:0/287409082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 0x7f532c0b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 --2- 172.21.15.144:0/287409082 >> v2:172.21.15.165:3300/0 conn(0x7f532c155800 0x7f532c0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 -- 172.21.15.144:0/287409082 >> 172.21.15.144:0/287409082 conn(0x7f532c06e060 msgr2=0x7f532c06e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:34.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 -- 172.21.15.144:0/529966455 shutdown_connections 2024-09-12T12:16:34.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 -- 172.21.15.144:0/529966455 wait complete. 2024-09-12T12:16:34.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 -- 172.21.15.144:0/287409082 shutdown_connections 2024-09-12T12:16:34.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 -- 172.21.15.144:0/287409082 wait complete. 2024-09-12T12:16:34.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff465800640 1 Processor -- start 2024-09-12T12:16:34.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff465800640 1 -- start start 2024-09-12T12:16:34.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f632b600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63240ce730 0x7f63241f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f632b600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f632415c2f0 0x7f6324152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f632b600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 0x7f6324152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f632b600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f632406c7b0 con 0x7f632415c2f0 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f632b600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f632406c630 con 0x7f63240ce730 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f632b600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f632406c930 con 0x7f632415c6d0 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6323e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f632415c2f0 0x7f6324152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6323e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f632415c2f0 0x7f6324152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52998/0 (socket says 172.21.15.144:52998) 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6329600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 0x7f6324152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6323e00640 1 -- 172.21.15.144:0/3370753466 learned_addr learned my addr 172.21.15.144:0/3370753466 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6328c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63240ce730 0x7f63241f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 Processor -- start 2024-09-12T12:16:34.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6328c00640 1 -- 172.21.15.144:0/3370753466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 msgr2=0x7f6324152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6328c00640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 0x7f6324152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6328c00640 1 -- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f632415c2f0 msgr2=0x7f6324152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6328c00640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f632415c2f0 0x7f6324152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff465800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4600732c0 0x7ff46015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff465800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4600b4200 0x7ff46014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff465800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff46015c220 0x7ff460150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff465800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff46015c600 con 0x7ff46015c220 2024-09-12T12:16:34.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6328c00640 1 -- 172.21.15.144:0/3370753466 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6324159ee0 con 0x7f63240ce730 2024-09-12T12:16:34.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6323e00640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f632415c2f0 0x7f6324152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:34.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff465800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4600d2100 con 0x7ff4600b4200 2024-09-12T12:16:34.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff465800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff46015c780 con 0x7ff4600732c0 2024-09-12T12:16:34.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f07b6000640 1 -- start start 2024-09-12T12:16:34.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4600732c0 0x7ff46015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45e000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4600b4200 0x7ff46014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4600732c0 0x7ff46015ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:44950/0 (socket says 172.21.15.144:44950) 2024-09-12T12:16:34.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45ea00640 1 -- 172.21.15.144:0/1191899860 learned_addr learned my addr 172.21.15.144:0/1191899860 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45f400640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff46015c220 0x7ff460150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 Processor -- start 2024-09-12T12:16:34.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6328c00640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63240ce730 0x7f63241f6e80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f63180ab000 tx=0x7f631801ad60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f5331000640 1 -- start start 2024-09-12T12:16:34.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6320c00640 1 -- 172.21.15.144:0/3370753466 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180b3800 con 0x7f63240ce730 2024-09-12T12:16:34.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6320c00640 1 -- 172.21.15.144:0/3370753466 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63180b39a0 con 0x7f63240ce730 2024-09-12T12:16:34.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7f6320c00640 1 -- 172.21.15.144:0/3370753466 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180b3d50 con 0x7f63240ce730 2024-09-12T12:16:34.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45e000640 1 -- 172.21.15.144:0/1191899860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4600732c0 msgr2=0x7ff46015ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45e000640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4600732c0 0x7ff46015ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45e000640 1 -- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff46015c220 msgr2=0x7ff460150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45e000640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff46015c220 0x7ff460150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.831+0000 7ff45e000640 1 -- 172.21.15.144:0/1191899860 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46014ef60 con 0x7ff4600b4200 2024-09-12T12:16:34.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6324154940 con 0x7f63240ce730 2024-09-12T12:16:34.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632415a460 con 0x7f63240ce730 2024-09-12T12:16:34.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7ff45e000640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4600b4200 0x7ff46014f9d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff44800e870 tx=0x7ff44800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07b6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 0x7f07b013e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07b6000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f07b0147a70 0x7f07b013b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07b6000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07b0147fc0 0x7f07b013f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07b6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f07b016b370 con 0x7f07b0147570 2024-09-12T12:16:34.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07b6000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f07b016b1f0 con 0x7f07b0147fc0 2024-09-12T12:16:34.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07b6000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f07b016b4f0 con 0x7f07b0147a70 2024-09-12T12:16:34.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 0x7f07b013e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 0x7f07b013e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53020/0 (socket says 172.21.15.144:53020) 2024-09-12T12:16:34.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07af400640 1 -- 172.21.15.144:0/3160288334 learned_addr learned my addr 172.21.15.144:0/3160288334 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07aea00640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f07b0147a70 0x7f07b013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7ff456a00640 1 -- 172.21.15.144:0/1191899860 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448017070 con 0x7ff4600b4200 2024-09-12T12:16:34.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7ff456a00640 1 -- 172.21.15.144:0/1191899860 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44800c940 con 0x7ff4600b4200 2024-09-12T12:16:34.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7ff456a00640 1 -- 172.21.15.144:0/1191899860 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44800ccf0 con 0x7ff4600b4200 2024-09-12T12:16:34.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5331000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 0x7f532c13a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5331000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 0x7f532c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5331000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f532c155800 0x7f532c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5331000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f532c072b10 con 0x7f532c0b65c0 2024-09-12T12:16:34.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5331000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f532c072990 con 0x7f532c155800 2024-09-12T12:16:34.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5331000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f532c072c90 con 0x7f532c0b4e10 2024-09-12T12:16:34.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f532c155800 0x7f532c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f532c155800 0x7f532c153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:51732/0 (socket says 172.21.15.144:51732) 2024-09-12T12:16:34.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532be00640 1 -- 172.21.15.144:0/2637887555 learned_addr learned my addr 172.21.15.144:0/2637887555 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:34.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07aea00640 1 -- 172.21.15.144:0/3160288334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07b0147fc0 msgr2=0x7f07b013f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07aea00640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07b0147fc0 0x7f07b013f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07aea00640 1 -- 172.21.15.144:0/3160288334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 msgr2=0x7f07b013e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07aea00640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 0x7f07b013e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07aea00640 1 -- 172.21.15.144:0/3160288334 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b013ba70 con 0x7f07b0147a70 2024-09-12T12:16:34.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63240cebc0 con 0x7f63240ce730 2024-09-12T12:16:34.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532aa00640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 0x7f532c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532be00640 1 -- 172.21.15.144:0/2637887555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 msgr2=0x7f532c13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532be00640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 0x7f532c13a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532be00640 1 -- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 msgr2=0x7f532c1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:34.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532be00640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 0x7f532c1531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:34.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532be00640 1 -- 172.21.15.144:0/2637887555 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c14e8f0 con 0x7f532c155800 2024-09-12T12:16:34.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532aa00640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 0x7f532c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:34.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff460150a50 con 0x7ff4600b4200 2024-09-12T12:16:34.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07aea00640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f07b0147a70 0x7f07b013b160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c370 tx=0x7f079c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46014f4b0 con 0x7ff4600b4200 2024-09-12T12:16:34.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07a7400640 1 -- 172.21.15.144:0/3160288334 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c017070 con 0x7f07b0147a70 2024-09-12T12:16:34.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f532be00640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f532c155800 0x7f532c153730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f532401cff0 tx=0x7f53240194f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07a7400640 1 -- 172.21.15.144:0/3160288334 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079c005cf0 con 0x7f07b0147a70 2024-09-12T12:16:34.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b015ffb0 con 0x7f07b0147a70 2024-09-12T12:16:34.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07a7400640 1 -- 172.21.15.144:0/3160288334 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c0072d0 con 0x7f07b0147a70 2024-09-12T12:16:34.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b01614e0 con 0x7f07b0147a70 2024-09-12T12:16:34.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5323400640 1 -- 172.21.15.144:0/2637887555 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240bf070 con 0x7f532c155800 2024-09-12T12:16:34.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5323400640 1 -- 172.21.15.144:0/2637887555 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53240090d0 con 0x7f532c155800 2024-09-12T12:16:34.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5323400640 1 -- 172.21.15.144:0/2637887555 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240a6a40 con 0x7f532c155800 2024-09-12T12:16:34.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532c153d60 con 0x7f532c155800 2024-09-12T12:16:34.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f532c1f56b0 con 0x7f532c155800 2024-09-12T12:16:34.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff46014f6b0 con 0x7ff4600b4200 2024-09-12T12:16:34.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b00ae890 con 0x7f07b0147a70 2024-09-12T12:16:34.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.835+0000 7f6320c00640 1 -- 172.21.15.144:0/3370753466 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63180c6390 con 0x7f63240ce730 2024-09-12T12:16:34.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f532c15eb30 con 0x7f532c155800 2024-09-12T12:16:34.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7ff456a00640 1 -- 172.21.15.144:0/1191899860 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff44801a070 con 0x7ff4600b4200 2024-09-12T12:16:34.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f6320c00640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6304067990 0x7f6304069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f6320c00640 1 -- 172.21.15.144:0/3370753466 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f6318120710 con 0x7f63240ce730 2024-09-12T12:16:34.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f6323e00640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6304067990 0x7f6304069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f07a7400640 1 -- 172.21.15.144:0/3160288334 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f079c01a070 con 0x7f07b0147a70 2024-09-12T12:16:34.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7ff456a00640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c067910 0x7ff43c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7ff456a00640 1 -- 172.21.15.144:0/1191899860 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7ff4480860d0 con 0x7ff4600b4200 2024-09-12T12:16:34.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f6323e00640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6304067990 0x7f6304069e50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f63240b61e0 tx=0x7f6310009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7ff45ea00640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c067910 0x7ff43c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f5323400640 1 -- 172.21.15.144:0/2637887555 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53240a6be0 con 0x7f532c155800 2024-09-12T12:16:34.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f07a7400640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07900678c0 0x7f0790069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7ff45ea00640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c067910 0x7ff43c069dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff45001c3f0 tx=0x7ff450009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f07a7400640 1 -- 172.21.15.144:0/3160288334 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f079c084f90 con 0x7f07b0147a70 2024-09-12T12:16:34.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f07af400640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07900678c0 0x7f0790069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f5323400640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f530c0678c0 0x7f530c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:34.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f5323400640 1 -- 172.21.15.144:0/2637887555 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6246+0+0 (secure 0 0 0) 0x7f532411fc10 con 0x7f532c155800 2024-09-12T12:16:34.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f532b400640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f530c0678c0 0x7f530c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:34.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.839+0000 7f07af400640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07900678c0 0x7f0790069d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07a001c4c0 tx=0x7f07a00a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.842+0000 7f532b400640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f530c0678c0 0x7f530c069d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f531c00b810 tx=0x7f531c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:34.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.842+0000 7f07a7400640 1 -- 172.21.15.144:0/3160288334 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f079c0552c0 con 0x7f07b0147a70 2024-09-12T12:16:34.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.842+0000 7f6320c00640 1 -- 172.21.15.144:0/3370753466 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63180c3060 con 0x7f63240ce730 2024-09-12T12:16:34.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.846+0000 7ff456a00640 1 -- 172.21.15.144:0/1191899860 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff46014f6b0 con 0x7ff4600b4200 2024-09-12T12:16:34.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:34.854+0000 7f5323400640 1 -- 172.21.15.144:0/2637887555 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5324016620 con 0x7f532c155800 2024-09-12T12:16:35.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.070+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f63240b6210 con 0x7f63240ce730 2024-09-12T12:16:35.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.074+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f07b0160460 con 0x7f07b0147a70 2024-09-12T12:16:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.154+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7ff4600d11e0 con 0x7ff4600b4200 2024-09-12T12:16:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.162+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f532c074140 con 0x7f532c155800 2024-09-12T12:16:35.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f6320c00640 1 -- 172.21.15.144:0/3370753466 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5609 v40) ==== 95+0+0 (secure 0 0 0) 0x7f6318016110 con 0x7f63240ce730 2024-09-12T12:16:35.857 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 5609 2024-09-12T12:16:35.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6304067990 msgr2=0x7f6304069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6304067990 0x7f6304069e50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f63240b61e0 tx=0x7f6310009190 comp rx=0 tx=0).stop 2024-09-12T12:16:35.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63240ce730 msgr2=0x7f63241f6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63240ce730 0x7f63241f6e80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f63180ab000 tx=0x7f631801ad60 comp rx=0 tx=0).stop 2024-09-12T12:16:35.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 shutdown_connections 2024-09-12T12:16:35.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6304067990 0x7f6304069e50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f632415c6d0 0x7f6324152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f632415c2f0 0x7f6324152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 --2- 172.21.15.144:0/3370753466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63240ce730 0x7f63241f6e80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 >> 172.21.15.144:0/3370753466 conn(0x7f632406f8b0 msgr2=0x7f63240b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:35.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 shutdown_connections 2024-09-12T12:16:35.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.854+0000 7f632b600640 1 -- 172.21.15.144:0/3370753466 wait complete. 2024-09-12T12:16:35.862 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:16:35.858+0000 7fac6ba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:16:35.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.862+0000 7ff456a00640 1 -- 172.21.15.144:0/1191899860 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6192 v41) ==== 95+0+0 (secure 0 0 0) 0x7ff448056410 con 0x7ff4600b4200 2024-09-12T12:16:35.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.862+0000 7f07a7400640 1 -- 172.21.15.144:0/3160288334 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6174 v41) ==== 95+0+0 (secure 0 0 0) 0x7f079c0595c0 con 0x7f07b0147a70 2024-09-12T12:16:35.868 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 6192 2024-09-12T12:16:35.868 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 6174 2024-09-12T12:16:35.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07900678c0 msgr2=0x7f0790069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07900678c0 0x7f0790069d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07a001c4c0 tx=0x7f07a00a6000 comp rx=0 tx=0).stop 2024-09-12T12:16:35.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f07b0147a70 msgr2=0x7f07b013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f07b0147a70 0x7f07b013b160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c370 tx=0x7f079c00c830 comp rx=0 tx=0).stop 2024-09-12T12:16:35.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 shutdown_connections 2024-09-12T12:16:35.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07900678c0 0x7f0790069d80 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07a001c4c0 tx=0x7f07a00a6000 comp rx=0 tx=0).stop 2024-09-12T12:16:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f07b0147fc0 0x7f07b013f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f07b0147a70 0x7f07b013b160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 --2- 172.21.15.144:0/3160288334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b0147570 0x7f07b013e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 >> 172.21.15.144:0/3160288334 conn(0x7f07b006f8b0 msgr2=0x7f07b00b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.866+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c067910 msgr2=0x7ff43c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.866+0000 7ff465800640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c067910 0x7ff43c069dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff45001c3f0 tx=0x7ff450009040 comp rx=0 tx=0).stop 2024-09-12T12:16:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.866+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4600b4200 msgr2=0x7ff46014f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.866+0000 7ff465800640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4600b4200 0x7ff46014f9d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff44800e870 tx=0x7ff44800ed30 comp rx=0 tx=0).stop 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 shutdown_connections 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7ff465800640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c067910 0x7ff43c069dd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7ff465800640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff46015c220 0x7ff460150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7ff465800640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4600b4200 0x7ff46014f9d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7ff465800640 1 --2- 172.21.15.144:0/1191899860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4600732c0 0x7ff46015ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 >> 172.21.15.144:0/1191899860 conn(0x7ff46006f400 msgr2=0x7ff4600b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 shutdown_connections 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7ff465800640 1 -- 172.21.15.144:0/1191899860 wait complete. 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 shutdown_connections 2024-09-12T12:16:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:35.870+0000 7f07b6000640 1 -- 172.21.15.144:0/3160288334 wait complete. 2024-09-12T12:16:35.891 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:16:35.891 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:16:35.894 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:16:35.894 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:35.899 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:16:35.899 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:16:35.900 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:16:35.900 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:16:35.903 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:16:35.903 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:35.946 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:16:35.946 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:35.979 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:16:35.987 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:16:36.032 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:16:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5323400640 1 -- 172.21.15.144:0/2637887555 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6177 v42) ==== 95+0+0 (secure 0 0 0) 0x7f53240f0490 con 0x7f532c155800 2024-09-12T12:16:36.868 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 6177 2024-09-12T12:16:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f530c0678c0 msgr2=0x7f530c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f530c0678c0 0x7f530c069d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f531c00b810 tx=0x7f531c008040 comp rx=0 tx=0).stop 2024-09-12T12:16:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f532c155800 msgr2=0x7f532c153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f532c155800 0x7f532c153730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f532401cff0 tx=0x7f53240194f0 comp rx=0 tx=0).stop 2024-09-12T12:16:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 shutdown_connections 2024-09-12T12:16:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f530c0678c0 0x7f530c069d80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f532c155800 0x7f532c153730 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f532c0b65c0 0x7f532c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 --2- 172.21.15.144:0/2637887555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f532c0b4e10 0x7f532c13a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 >> 172.21.15.144:0/2637887555 conn(0x7f532c06e060 msgr2=0x7f532c153fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 shutdown_connections 2024-09-12T12:16:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:36.866+0000 7f5331000640 1 -- 172.21.15.144:0/2637887555 wait complete. 2024-09-12T12:16:36.894 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:16:36.895 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:16:36.942 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:16:36.942 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:36.942 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:37.026 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:16:37.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f505dc00640 1 Processor -- start 2024-09-12T12:16:37.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f505dc00640 1 -- start start 2024-09-12T12:16:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f505dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f505815e580 0x7f50580b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f505dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f505806d380 0x7f50580b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f505dc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505806d9a0 con 0x7f505806ea20 2024-09-12T12:16:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f505dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f50580b73e0 con 0x7f505806d380 2024-09-12T12:16:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f505dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f505806df40 con 0x7f505815e580 2024-09-12T12:16:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f5057400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f505806d380 0x7f50580b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f5057400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f505806d380 0x7f50580b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34732/0 (socket says 172.21.15.144:34732) 2024-09-12T12:16:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f5057400640 1 -- 172.21.15.144:0/3534640362 learned_addr learned my addr 172.21.15.144:0/3534640362 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f5056a00640 1 --2- 172.21.15.144:0/3534640362 >> v2:172.21.15.165:3300/0 conn(0x7f505815e580 0x7f50580b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f5057400640 1 -- 172.21.15.144:0/3534640362 >> v2:172.21.15.165:3300/0 conn(0x7f505815e580 msgr2=0x7f50580b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f5057400640 1 --2- 172.21.15.144:0/3534640362 >> v2:172.21.15.165:3300/0 conn(0x7f505815e580 0x7f50580b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f5057400640 1 -- 172.21.15.144:0/3534640362 >> v1:172.21.15.165:6789/0 conn(0x7f505806ea20 legacy=0x7f505806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f5057400640 1 -- 172.21.15.144:0/3534640362 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505806e220 con 0x7f505806d380 2024-09-12T12:16:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.078+0000 7f5056a00640 1 --2- 172.21.15.144:0/3534640362 >> v2:172.21.15.165:3300/0 conn(0x7f505815e580 0x7f50580b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:37.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f5057400640 1 --2- 172.21.15.144:0/3534640362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 0x7f50580b6ea0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f50580b5200 tx=0x7f505001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce202b3e0b732e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f5056000640 1 -- 172.21.15.144:0/3534640362 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50500a5680 con 0x7f505806d380 2024-09-12T12:16:37.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f5056000640 1 -- 172.21.15.144:0/3534640362 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50500a5820 con 0x7f505806d380 2024-09-12T12:16:37.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f5056000640 1 -- 172.21.15.144:0/3534640362 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50500a5bf0 con 0x7f505806d380 2024-09-12T12:16:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 -- 172.21.15.144:0/3534640362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 msgr2=0x7f50580b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 --2- 172.21.15.144:0/3534640362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 0x7f50580b6ea0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f50580b5200 tx=0x7f505001c9b0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 -- 172.21.15.144:0/3534640362 shutdown_connections 2024-09-12T12:16:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 --2- 172.21.15.144:0/3534640362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 0x7f50580b6ea0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 --2- 172.21.15.144:0/3534640362 >> v2:172.21.15.165:3300/0 conn(0x7f505815e580 0x7f50580b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 -- 172.21.15.144:0/3534640362 >> 172.21.15.144:0/3534640362 conn(0x7f5058067a00 msgr2=0x7f5058067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 -- 172.21.15.144:0/3534640362 shutdown_connections 2024-09-12T12:16:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 -- 172.21.15.144:0/3534640362 wait complete. 2024-09-12T12:16:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 Processor -- start 2024-09-12T12:16:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.082+0000 7f505dc00640 1 -- start start 2024-09-12T12:16:37.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f505dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 0x7f50581502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f505dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f505806ea20 0x7f505814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f505dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505815e580 0x7f50580cf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f505dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50580cc3f0 con 0x7f505806d380 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f505dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f50580cc270 con 0x7f505815e580 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f505dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f50580cc570 con 0x7f505806ea20 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5056a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 0x7f50581502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5056a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 0x7f50581502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34740/0 (socket says 172.21.15.144:34740) 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5056a00640 1 -- 172.21.15.144:0/1037006380 learned_addr learned my addr 172.21.15.144:0/1037006380 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f504e000640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f505806ea20 0x7f505814fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5057400640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505815e580 0x7f50580cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5056a00640 1 -- 172.21.15.144:0/1037006380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f505806ea20 msgr2=0x7f505814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5056a00640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f505806ea20 0x7f505814fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5056a00640 1 -- 172.21.15.144:0/1037006380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505815e580 msgr2=0x7f50580cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5056a00640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505815e580 0x7f50580cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5056a00640 1 -- 172.21.15.144:0/1037006380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50580b2d60 con 0x7f505806d380 2024-09-12T12:16:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f5056a00640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 0x7f50581502b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f504800c7f0 tx=0x7f504800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f504f400640 1 -- 172.21.15.144:0/1037006380 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048015070 con 0x7f505806d380 2024-09-12T12:16:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f504f400640 1 -- 172.21.15.144:0/1037006380 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048007820 con 0x7f505806d380 2024-09-12T12:16:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f504f400640 1 -- 172.21.15.144:0/1037006380 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048007c10 con 0x7f505806d380 2024-09-12T12:16:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50580b3040 con 0x7f505806d380 2024-09-12T12:16:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50580b3600 con 0x7f505806d380 2024-09-12T12:16:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.086+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f505806cc70 con 0x7f505806d380 2024-09-12T12:16:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.090+0000 7f504f400640 1 -- 172.21.15.144:0/1037006380 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5048018070 con 0x7f505806d380 2024-09-12T12:16:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.090+0000 7f504f400640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50340678c0 0x7f5034069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.090+0000 7f504f400640 1 -- 172.21.15.144:0/1037006380 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f50480860d0 con 0x7f505806d380 2024-09-12T12:16:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.090+0000 7f504e000640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50340678c0 0x7f5034069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.090+0000 7f504e000640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50340678c0 0x7f5034069d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50580d2a90 tx=0x7f5040007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.094+0000 7f504f400640 1 -- 172.21.15.144:0/1037006380 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5048056220 con 0x7f505806d380 2024-09-12T12:16:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.282+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50580b1c60 con 0x7f505806d380 2024-09-12T12:16:37.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.282+0000 7f504f400640 1 -- 172.21.15.144:0/1037006380 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+4396 (secure 0 0 0) 0x7f504805a520 con 0x7f505806d380 2024-09-12T12:16:37.286 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:37.286 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":43,"btime":"2024-09-12T12:16:36:869143+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:36.869130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-12T12:16:37.286 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 43 2024-09-12T12:16:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50340678c0 msgr2=0x7f5034069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50340678c0 0x7f5034069d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50580d2a90 tx=0x7f5040007e40 comp rx=0 tx=0).stop 2024-09-12T12:16:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 msgr2=0x7f50581502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 0x7f50581502b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f504800c7f0 tx=0x7f504800ccb0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 shutdown_connections 2024-09-12T12:16:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50340678c0 0x7f5034069d80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505815e580 0x7f50580cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f505806ea20 0x7f505814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 --2- 172.21.15.144:0/1037006380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f505806d380 0x7f50581502b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 >> 172.21.15.144:0/1037006380 conn(0x7f5058067a00 msgr2=0x7f50580cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:37.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 shutdown_connections 2024-09-12T12:16:37.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:37.286+0000 7f505dc00640 1 -- 172.21.15.144:0/1037006380 wait complete. 2024-09-12T12:16:37.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:16:19.655379+0000', 'modified': '2024-09-12T12:16:36.869130+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6438}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6438': {'gid': 6438, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.144:6835/3811906714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3811906714}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 3811906714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T12:16:37.710 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6438:up:replay 2024-09-12T12:16:38.711 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:38.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.854+0000 7fc321a00640 1 Processor -- start 2024-09-12T12:16:38.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.854+0000 7fc321a00640 1 -- start start 2024-09-12T12:16:38.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.854+0000 7fc321a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc31c15c7b0 0x7fc31c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.854+0000 7fc321a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31c0cd870 con 0x7fc31c0b5fb0 2024-09-12T12:16:38.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.854+0000 7fc321a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31c0cdb50 con 0x7fc31c15cd30 2024-09-12T12:16:38.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.854+0000 7fc321a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc31c072a50 con 0x7fc31c15c7b0 2024-09-12T12:16:38.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.854+0000 7fc31b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc31c0b5fb0 0x7fc31c072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34610/0 (socket says 172.21.15.144:34610) 2024-09-12T12:16:38.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.854+0000 7fc31b400640 1 -- 172.21.15.144:0/327771633 learned_addr learned my addr 172.21.15.144:0/327771633 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:38.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31aa00640 1 --2- 172.21.15.144:0/327771633 >> v2:172.21.15.165:3300/0 conn(0x7fc31c15c7b0 0x7fc31c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969647830 0 0) 0x7fc31c0cd870 con 0x7fc31c0b5fb0 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc300003530 con 0x7fc31c0b5fb0 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441291382 0 0) 0x7fc31c0cdb50 con 0x7fc31c15cd30 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc31c0cd870 con 0x7fc31c15cd30 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2099060092 0 0) 0x7fc300003530 con 0x7fc31c0b5fb0 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 >> v2:172.21.15.165:3300/0 conn(0x7fc31c15c7b0 msgr2=0x7fc31c0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 --2- 172.21.15.144:0/327771633 >> v2:172.21.15.165:3300/0 conn(0x7fc31c15c7b0 0x7fc31c0ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 >> v1:172.21.15.165:6789/0 conn(0x7fc31c15cd30 legacy=0x7fc31c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c0726e0 con 0x7fc31c0b5fb0 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fc314001680 con 0x7fc31c0b5fb0 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 >> v1:172.21.15.144:6789/0 conn(0x7fc31c0b5fb0 legacy=0x7fc31c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:38.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc300003ba0 0x7fc300003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc300004810 0x7fc300004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3000051d0 0x7fc30000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c072a50 con 0x7fc300003ba0 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc30000c0a0 con 0x7fc300004810 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc30000c2a0 con 0x7fc3000051d0 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31aa00640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc300003ba0 0x7fc300003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31a000640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc300004810 0x7fc300004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31b400640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3000051d0 0x7fc30000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31aa00640 1 -- 172.21.15.144:0/327771633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3000051d0 msgr2=0x7fc30000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31aa00640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3000051d0 0x7fc30000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31aa00640 1 -- 172.21.15.144:0/327771633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc300004810 msgr2=0x7fc300004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31aa00640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc300004810 0x7fc300004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31aa00640 1 -- 172.21.15.144:0/327771633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc300003530 con 0x7fc300003ba0 2024-09-12T12:16:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31b400640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3000051d0 0x7fc30000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.858+0000 7fc31b400640 1 -- 172.21.15.144:0/327771633 reap_dead start 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc31aa00640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc300003ba0 0x7fc300003fa0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009fc0 tx=0x7fc30c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b31f2452b6a589c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0b2070 con 0x7fc300003ba0 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30c0a5a70 con 0x7fc300003ba0 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc319600640 1 -- 172.21.15.144:0/327771633 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c009c10 con 0x7fc300003ba0 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 -- 172.21.15.144:0/327771633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc300003ba0 msgr2=0x7fc300003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc300003ba0 0x7fc300003fa0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009fc0 tx=0x7fc30c01cc80 comp rx=0 tx=0).stop 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 -- 172.21.15.144:0/327771633 shutdown_connections 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 --2- 172.21.15.144:0/327771633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc300003ba0 0x7fc300003fa0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 -- 172.21.15.144:0/327771633 >> 172.21.15.144:0/327771633 conn(0x7fc31c06d0d0 msgr2=0x7fc31c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 -- 172.21.15.144:0/327771633 shutdown_connections 2024-09-12T12:16:38.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 -- 172.21.15.144:0/327771633 wait complete. 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 Processor -- start 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 -- start start 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc300003ba0 0x7fc31c14d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc31c0c5600 0x7fc31c1f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.862+0000 7fc321a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c1f8000 0x7fc31c073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc321a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c160560 con 0x7fc31c1f8000 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc321a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c1603e0 con 0x7fc31c0c5600 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc321a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc31c1606e0 con 0x7fc300003ba0 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c1f8000 0x7fc31c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c1f8000 0x7fc31c073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34760/0 (socket says 172.21.15.144:34760) 2024-09-12T12:16:38.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31b400640 1 -- 172.21.15.144:0/3444030903 learned_addr learned my addr 172.21.15.144:0/3444030903 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31a000640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc31c0c5600 0x7fc31c1f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31aa00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc300003ba0 0x7fc31c14d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31b400640 1 -- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc300003ba0 msgr2=0x7fc31c14d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31b400640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc300003ba0 0x7fc31c14d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31b400640 1 -- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc31c0c5600 msgr2=0x7fc31c1f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31b400640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc31c0c5600 0x7fc31c1f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31b400640 1 -- 172.21.15.144:0/3444030903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c1f8550 con 0x7fc31c1f8000 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31a000640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc31c0c5600 0x7fc31c1f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31aa00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc300003ba0 0x7fc31c14d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc31b400640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c1f8000 0x7fc31c073390 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ce230 tx=0x7fc31400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc312a00640 1 -- 172.21.15.144:0/3444030903 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314019070 con 0x7fc31c1f8000 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc312a00640 1 -- 172.21.15.144:0/3444030903 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc314010510 con 0x7fc31c1f8000 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31c1f8830 con 0x7fc31c1f8000 2024-09-12T12:16:38.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc312a00640 1 -- 172.21.15.144:0/3444030903 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314010900 con 0x7fc31c1f8000 2024-09-12T12:16:38.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc31c15ab10 con 0x7fc31c1f8000 2024-09-12T12:16:38.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31c160a70 con 0x7fc31c1f8000 2024-09-12T12:16:38.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.866+0000 7fc312a00640 1 -- 172.21.15.144:0/3444030903 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc31401c070 con 0x7fc31c1f8000 2024-09-12T12:16:38.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.870+0000 7fc312a00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2fc0678c0 0x7fc2fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:38.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.870+0000 7fc312a00640 1 -- 172.21.15.144:0/3444030903 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7fc3140854b0 con 0x7fc31c1f8000 2024-09-12T12:16:38.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.870+0000 7fc31aa00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2fc0678c0 0x7fc2fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:38.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.870+0000 7fc31aa00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2fc0678c0 0x7fc2fc069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0af000 tx=0x7fc30c0a7040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:38.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:38.874+0000 7fc312a00640 1 -- 172.21.15.144:0/3444030903 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc314055690 con 0x7fc31c1f8000 2024-09-12T12:16:39.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.062+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc31c0cf8a0 con 0x7fc31c1f8000 2024-09-12T12:16:39.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.062+0000 7fc312a00640 1 -- 172.21.15.144:0/3444030903 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5224 (secure 0 0 0) 0x7fc314059990 con 0x7fc31c1f8000 2024-09-12T12:16:39.067 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:39.067 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":45,"btime":"2024-09-12T12:16:38:878976+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:37.879862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-12T12:16:39.067 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 45 2024-09-12T12:16:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2fc0678c0 msgr2=0x7fc2fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2fc0678c0 0x7fc2fc069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0af000 tx=0x7fc30c0a7040 comp rx=0 tx=0).stop 2024-09-12T12:16:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c1f8000 msgr2=0x7fc31c073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c1f8000 0x7fc31c073390 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0ce230 tx=0x7fc31400e960 comp rx=0 tx=0).stop 2024-09-12T12:16:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 shutdown_connections 2024-09-12T12:16:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2fc0678c0 0x7fc2fc069d80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:39.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c1f8000 0x7fc31c073390 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:39.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc31c0c5600 0x7fc31c1f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:39.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 --2- 172.21.15.144:0/3444030903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc300003ba0 0x7fc31c14d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:39.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 >> 172.21.15.144:0/3444030903 conn(0x7fc31c06d0d0 msgr2=0x7fc31c0af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:39.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 shutdown_connections 2024-09-12T12:16:39.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:39.066+0000 7fc321a00640 1 -- 172.21.15.144:0/3444030903 wait complete. 2024-09-12T12:16:39.491 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:16:19.655379+0000', 'modified': '2024-09-12T12:16:37.879862+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6438}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6438': {'gid': 6438, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.144:6835/3811906714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3811906714}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 3811906714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T12:16:39.491 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6438:up:rejoin 2024-09-12T12:16:40.492 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:40.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9eaca00640 1 Processor -- start 2024-09-12T12:16:40.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9eaca00640 1 -- start start 2024-09-12T12:16:40.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9eaca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9ea815b160 0x7f9ea8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9eaca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 0x7f9ea80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9eaca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea80cd4a0 con 0x7f9ea80cd000 2024-09-12T12:16:40.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9eaca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea815b540 con 0x7f9ea815b160 2024-09-12T12:16:40.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9eaca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea80cd780 con 0x7f9ea8073bd0 2024-09-12T12:16:40.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9ea7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9ea80cd000 0x7f9ea80cff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34616/0 (socket says 172.21.15.144:34616) 2024-09-12T12:16:40.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9ea7e00640 1 -- 172.21.15.144:0/643241422 learned_addr learned my addr 172.21.15.144:0/643241422 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:40.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9e9ea00640 1 --2- 172.21.15.144:0/643241422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 0x7f9ea80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.638+0000 7f9ea7400640 1 --2- 172.21.15.144:0/643241422 >> v2:172.21.15.165:3300/0 conn(0x7f9ea815b160 0x7f9ea8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9ea6a00640 1 -- 172.21.15.144:0/643241422 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490663136 0 0) 0x7f9ea80cd4a0 con 0x7f9ea80cd000 2024-09-12T12:16:40.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9ea6a00640 1 -- 172.21.15.144:0/643241422 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e8c003530 con 0x7f9ea80cd000 2024-09-12T12:16:40.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9e9ea00640 1 -- 172.21.15.144:0/643241422 >> v2:172.21.15.165:3300/0 conn(0x7f9ea815b160 msgr2=0x7f9ea8070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:40.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9e9ea00640 1 --2- 172.21.15.144:0/643241422 >> v2:172.21.15.165:3300/0 conn(0x7f9ea815b160 0x7f9ea8070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9e9ea00640 1 -- 172.21.15.144:0/643241422 >> v1:172.21.15.144:6789/0 conn(0x7f9ea80cd000 legacy=0x7f9ea80cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9e9ea00640 1 -- 172.21.15.144:0/643241422 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea80b3180 con 0x7f9ea8073bd0 2024-09-12T12:16:40.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9ea7400640 1 --2- 172.21.15.144:0/643241422 >> v2:172.21.15.165:3300/0 conn(0x7f9ea815b160 0x7f9ea8070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:40.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9e9ea00640 1 --2- 172.21.15.144:0/643241422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 0x7f9ea80ccac0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e900097c0 tx=0x7f9e9001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59bb905ceb18b486 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:40.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9ea6a00640 1 -- 172.21.15.144:0/643241422 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e900b0070 con 0x7f9ea8073bd0 2024-09-12T12:16:40.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9ea6a00640 1 -- 172.21.15.144:0/643241422 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e900ab600 con 0x7f9ea8073bd0 2024-09-12T12:16:40.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.642+0000 7f9ea6a00640 1 -- 172.21.15.144:0/643241422 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e900ab9b0 con 0x7f9ea8073bd0 2024-09-12T12:16:40.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 -- 172.21.15.144:0/643241422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 msgr2=0x7f9ea80ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 --2- 172.21.15.144:0/643241422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 0x7f9ea80ccac0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e900097c0 tx=0x7f9e9001c410 comp rx=0 tx=0).stop 2024-09-12T12:16:40.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 -- 172.21.15.144:0/643241422 shutdown_connections 2024-09-12T12:16:40.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 --2- 172.21.15.144:0/643241422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 0x7f9ea80ccac0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 --2- 172.21.15.144:0/643241422 >> v2:172.21.15.165:3300/0 conn(0x7f9ea815b160 0x7f9ea8070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 -- 172.21.15.144:0/643241422 >> 172.21.15.144:0/643241422 conn(0x7f9ea806bc10 msgr2=0x7f9ea806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:40.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 -- 172.21.15.144:0/643241422 shutdown_connections 2024-09-12T12:16:40.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 -- 172.21.15.144:0/643241422 wait complete. 2024-09-12T12:16:40.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 Processor -- start 2024-09-12T12:16:40.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 -- start start 2024-09-12T12:16:40.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 0x7f9ea814d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea80cd000 0x7f9ea80b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea815b160 0x7f9ea8142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80b4520 con 0x7f9ea815b160 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea80b43a0 con 0x7f9ea80cd000 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9eaca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea80b46a0 con 0x7f9ea8073bd0 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9ea7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea815b160 0x7f9ea8142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9ea7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea815b160 0x7f9ea8142a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34774/0 (socket says 172.21.15.144:34774) 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9ea7e00640 1 -- 172.21.15.144:0/732349536 learned_addr learned my addr 172.21.15.144:0/732349536 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9e9ea00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea80cd000 0x7f9ea80b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9ea7400640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 0x7f9ea814d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9ea7e00640 1 -- 172.21.15.144:0/732349536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 msgr2=0x7f9ea814d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9ea7e00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 0x7f9ea814d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9ea7e00640 1 -- 172.21.15.144:0/732349536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea80cd000 msgr2=0x7f9ea80b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9ea7e00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea80cd000 0x7f9ea80b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9ea7e00640 1 -- 172.21.15.144:0/732349536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea8157600 con 0x7f9ea815b160 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.646+0000 7f9e9ea00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea80cd000 0x7f9ea80b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9ea7e00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea815b160 0x7f9ea8142a20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cae0 tx=0x7f9ea000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9e9fe00640 1 -- 172.21.15.144:0/732349536 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0017070 con 0x7f9ea815b160 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9e9fe00640 1 -- 172.21.15.144:0/732349536 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea000abe0 con 0x7f9ea815b160 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea81578e0 con 0x7f9ea815b160 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9e9fe00640 1 -- 172.21.15.144:0/732349536 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0012640 con 0x7f9ea815b160 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea8157ea0 con 0x7f9ea815b160 2024-09-12T12:16:40.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea80ccac0 con 0x7f9ea815b160 2024-09-12T12:16:40.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9e9fe00640 1 -- 172.21.15.144:0/732349536 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ea001a070 con 0x7f9ea815b160 2024-09-12T12:16:40.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9e9fe00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e840678c0 0x7f9e84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9e9fe00640 1 -- 172.21.15.144:0/732349536 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f9ea0085d20 con 0x7f9ea815b160 2024-09-12T12:16:40.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.650+0000 7f9ea7400640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e840678c0 0x7f9e84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.654+0000 7f9ea7400640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e840678c0 0x7f9e84069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80afcd0 tx=0x7f9e98009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:40.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.658+0000 7f9e9fe00640 1 -- 172.21.15.144:0/732349536 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ea0055f00 con 0x7f9ea815b160 2024-09-12T12:16:40.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.846+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ea8073740 con 0x7f9ea815b160 2024-09-12T12:16:40.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9e9fe00640 1 -- 172.21.15.144:0/732349536 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5231 (secure 0 0 0) 0x7f9ea005a200 con 0x7f9ea815b160 2024-09-12T12:16:40.852 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:40.852 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-12T12:16:39:885036+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:39.885031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6438,"qdb_cluster":[6438]},"id":4}]} 2024-09-12T12:16:40.852 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e840678c0 msgr2=0x7f9e84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e840678c0 0x7f9e84069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80afcd0 tx=0x7f9e98009190 comp rx=0 tx=0).stop 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea815b160 msgr2=0x7f9ea8142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea815b160 0x7f9ea8142a20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cae0 tx=0x7f9ea000a060 comp rx=0 tx=0).stop 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 shutdown_connections 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e840678c0 0x7f9e84069d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea815b160 0x7f9ea8142a20 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea80cd000 0x7f9ea80b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 --2- 172.21.15.144:0/732349536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea8073bd0 0x7f9ea814d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 >> 172.21.15.144:0/732349536 conn(0x7f9ea806bc10 msgr2=0x7f9ea8071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:40.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 shutdown_connections 2024-09-12T12:16:40.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:40.850+0000 7f9eaca00640 1 -- 172.21.15.144:0/732349536 wait complete. 2024-09-12T12:16:41.275 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:16:19.655379+0000', 'modified': '2024-09-12T12:16:39.885031+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6438}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6438': {'gid': 6438, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.144:6835/3811906714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3811906714}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 3811906714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6438, 'qdb_cluster': [6438]} 2024-09-12T12:16:41.275 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:16:41.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T12:16:41.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7beae00640 1 Processor -- start 2024-09-12T12:16:41.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7beae00640 1 -- start start 2024-09-12T12:16:41.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7beae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7be415e800 0x7f7be40d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7beae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be415ebe0 con 0x7f7be40b6820 2024-09-12T12:16:41.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7beae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be40cf9b0 con 0x7f7be40ceef0 2024-09-12T12:16:41.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7beae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7be40cfc90 con 0x7f7be415e800 2024-09-12T12:16:41.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7be3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7be415e800 0x7f7be40d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7be3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7be415e800 0x7f7be40d32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34782/0 (socket says 172.21.15.144:34782) 2024-09-12T12:16:41.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7be3e00640 1 -- 172.21.15.144:0/4211961168 learned_addr learned my addr 172.21.15.144:0/4211961168 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:41.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7be8e00640 1 --1- 172.21.15.144:0/4211961168 >> v1:172.21.15.144:6789/0 conn(0x7f7be40b6820 0x7f7be40b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34624/0 (socket says 172.21.15.144:34624) 2024-09-12T12:16:41.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7be3e00640 1 -- 172.21.15.144:0/4211961168 >> v1:172.21.15.165:6789/0 conn(0x7f7be40ceef0 legacy=0x7f7be40b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7be3e00640 1 -- 172.21.15.144:0/4211961168 >> v1:172.21.15.144:6789/0 conn(0x7f7be40b6820 legacy=0x7f7be40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.410+0000 7f7be3e00640 1 -- 172.21.15.144:0/4211961168 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be40d2810 con 0x7f7be415e800 2024-09-12T12:16:41.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7be3e00640 1 --2- 172.21.15.144:0/4211961168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be415e800 0x7f7be40d32f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009870 tx=0x7f7bd401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5606372a0f5509 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7be2a00640 1 -- 172.21.15.144:0/4211961168 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40b0070 con 0x7f7be415e800 2024-09-12T12:16:41.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7be2a00640 1 -- 172.21.15.144:0/4211961168 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd40ab600 con 0x7f7be415e800 2024-09-12T12:16:41.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7be2a00640 1 -- 172.21.15.144:0/4211961168 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40ab9d0 con 0x7f7be415e800 2024-09-12T12:16:41.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7beae00640 1 -- 172.21.15.144:0/4211961168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be415e800 msgr2=0x7f7be40d32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7beae00640 1 --2- 172.21.15.144:0/4211961168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be415e800 0x7f7be40d32f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009870 tx=0x7f7bd401c560 comp rx=0 tx=0).stop 2024-09-12T12:16:41.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7beae00640 1 -- 172.21.15.144:0/4211961168 shutdown_connections 2024-09-12T12:16:41.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7beae00640 1 --2- 172.21.15.144:0/4211961168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be415e800 0x7f7be40d32f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7beae00640 1 -- 172.21.15.144:0/4211961168 >> 172.21.15.144:0/4211961168 conn(0x7f7be40d12e0 msgr2=0x7f7be40d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7beae00640 1 -- 172.21.15.144:0/4211961168 shutdown_connections 2024-09-12T12:16:41.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.414+0000 7f7beae00640 1 -- 172.21.15.144:0/4211961168 wait complete. 2024-09-12T12:16:41.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 Processor -- start 2024-09-12T12:16:41.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 -- start start 2024-09-12T12:16:41.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7be40b6820 0x7f7be4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be40ceef0 0x7f7be4160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be415e800 0x7f7be415fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7be416c4d0 con 0x7f7be40ceef0 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7be416c350 con 0x7f7be415e800 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7be416c650 con 0x7f7be40b6820 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be40ceef0 0x7f7be4160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be40ceef0 0x7f7be4160810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34786/0 (socket says 172.21.15.144:34786) 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3400640 1 -- 172.21.15.144:0/2379304362 learned_addr learned my addr 172.21.15.144:0/2379304362 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3e00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7be40b6820 0x7f7be4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be8e00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be415e800 0x7f7be415fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3400640 1 -- 172.21.15.144:0/2379304362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7be40b6820 msgr2=0x7f7be4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3400640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7be40b6820 0x7f7be4154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3400640 1 -- 172.21.15.144:0/2379304362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be415e800 msgr2=0x7f7be415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3400640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be415e800 0x7f7be415fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3400640 1 -- 172.21.15.144:0/2379304362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be41551f0 con 0x7f7be40ceef0 2024-09-12T12:16:41.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7be3400640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be40ceef0 0x7f7be4160810 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000c420 tx=0x7f7bd000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7bdbe00640 1 -- 172.21.15.144:0/2379304362 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00052d0 con 0x7f7be40ceef0 2024-09-12T12:16:41.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7bdbe00640 1 -- 172.21.15.144:0/2379304362 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd0005470 con 0x7f7be40ceef0 2024-09-12T12:16:41.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7bdbe00640 1 -- 172.21.15.144:0/2379304362 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0007260 con 0x7f7be40ceef0 2024-09-12T12:16:41.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 -- 172.21.15.144:0/2379304362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be4161060 con 0x7f7be40ceef0 2024-09-12T12:16:41.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.418+0000 7f7beae00640 1 -- 172.21.15.144:0/2379304362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be415f200 con 0x7f7be40ceef0 2024-09-12T12:16:41.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7bdbe00640 1 -- 172.21.15.144:0/2379304362 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7bd0007400 con 0x7f7be40ceef0 2024-09-12T12:16:41.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7bdbe00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bc40678f0 0x7f7bc4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7bdbe00640 1 -- 172.21.15.144:0/2379304362 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f7bd00853e0 con 0x7f7be40ceef0 2024-09-12T12:16:41.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7be3e00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bc40678f0 0x7f7bc4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7bee2b1000 1 Processor -- start 2024-09-12T12:16:41.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7bee2b1000 1 -- start start 2024-09-12T12:16:41.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7be3e00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bc40678f0 0x7f7bc4069db0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7be408d050 tx=0x7f7bd4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 0x55c3a648ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648f440 0x55c3a6444d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.422+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a6445290 0x55c3a6445670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c3a632cb60 con 0x55c3a6445290 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c3a6293c70 con 0x55c3a648eb20 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c3a6239ed0 con 0x55c3a648f440 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a6445290 0x55c3a6445670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a6445290 0x55c3a6445670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34792/0 (socket says 172.21.15.144:34792) 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be8e00640 1 -- 172.21.15.144:0/1544053628 learned_addr learned my addr 172.21.15.144:0/1544053628 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be3e00640 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 0x55c3a648ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be3400640 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648f440 0x55c3a6444d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be8e00640 1 -- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648f440 msgr2=0x55c3a6444d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be8e00640 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648f440 0x55c3a6444d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be8e00640 1 -- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 msgr2=0x55c3a648ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be8e00640 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 0x55c3a648ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be8e00640 1 -- 172.21.15.144:0/1544053628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a624be50 con 0x55c3a6445290 2024-09-12T12:16:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be3e00640 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 0x55c3a648ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be3400640 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648f440 0x55c3a6444d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7be8e00640 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a6445290 0x55c3a6445670 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0073b0 tx=0x7f7bdc007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e457b118e14238 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bd8c00640 1 -- 172.21.15.144:0/1544053628 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc019070 con 0x55c3a6445290 2024-09-12T12:16:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bd8c00640 1 -- 172.21.15.144:0/1544053628 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bdc001d10 con 0x55c3a6445290 2024-09-12T12:16:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bd8c00640 1 -- 172.21.15.144:0/1544053628 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0020c0 con 0x55c3a6445290 2024-09-12T12:16:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- 172.21.15.144:0/1544053628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a6445290 msgr2=0x55c3a6445670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a6445290 0x55c3a6445670 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0073b0 tx=0x7f7bdc007870 comp rx=0 tx=0).stop 2024-09-12T12:16:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- 172.21.15.144:0/1544053628 shutdown_connections 2024-09-12T12:16:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a6445290 0x55c3a6445670 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648f440 0x55c3a6444d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/1544053628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 0x55c3a648ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- 172.21.15.144:0/1544053628 >> 172.21.15.144:0/1544053628 conn(0x55c3a644b600 msgr2=0x55c3a6443630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- 172.21.15.144:0/1544053628 shutdown_connections 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- 172.21.15.144:0/1544053628 wait complete. 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- start start 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 Processor -- start 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 0x55c3a6449e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a644fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a644a390 0x55c3a6450230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c3a62f5b00 con 0x55c3a648f440 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c3a626e360 con 0x55c3a648eb20 2024-09-12T12:16:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c3a626b2d0 con 0x55c3a644a390 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.426+0000 7f7bee2b1000 10 client.0 _ll_register_callbacks cb 0x55c3a6430820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a644fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 0x55c3a6449e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a644fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34800/0 (socket says 172.21.15.144:34800) 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3400640 1 -- 172.21.15.144:0/3350373717 learned_addr learned my addr 172.21.15.144:0/3350373717 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be8e00640 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a644a390 0x55c3a6450230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3400640 1 -- 172.21.15.144:0/3350373717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a644a390 msgr2=0x55c3a6450230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3400640 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a644a390 0x55c3a6450230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3400640 1 -- 172.21.15.144:0/3350373717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 msgr2=0x55c3a6449e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3400640 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 0x55c3a6449e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3400640 1 -- 172.21.15.144:0/3350373717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a623a120 con 0x55c3a648f440 2024-09-12T12:16:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3400640 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a644fcf0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000cde0 tx=0x7f7bd0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57c658afdee321e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 1 -- 172.21.15.144:0/3350373717 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd006d070 con 0x55c3a648f440 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 1 -- 172.21.15.144:0/3350373717 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f7bd0051c10 con 0x55c3a648f440 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3350373717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bdc001d10 con 0x55c3a648f440 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 1 -- 172.21.15.144:0/3350373717 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f7bd005e180 con 0x55c3a648f440 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 10 client.6474 fetch_fsmap learned FSMap version 46 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3350373717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55c3a6233450 con 0x55c3a648f440 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 1 -- 172.21.15.144:0/3350373717 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bdc001d10 con 0x55c3a648f440 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 1 -- 172.21.15.144:0/3350373717 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f7bd0083200 con 0x55c3a648f440 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 10 client.6474 fetch_fsmap finished waiting for FSMap version 46 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 10 client.6474 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 20 client.6474 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x55c3a649d280 0x55c3a649f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 4 client.6474 mds_command: new command op to 6438 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3350373717 --> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3a622dc00 con 0x55c3a649d280 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3e00640 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x55c3a649d280 0x55c3a649f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 10 client.6474 ms_handle_connect on v2:172.21.15.144:6834/3811906714 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7be3e00640 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x55c3a649d280 0x55c3a649f670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5719d4efe56fbd51 server_cookie=852e4b70affeb42c in_seq=0 out_seq=0 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 1 -- 172.21.15.144:0/3350373717 <== mds.0 v2:172.21.15.144:6834/3811906714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3a622dc00 con 0x55c3a649d280 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 10 client.6474 handle_command_reply: tid=0 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 client.6474 shutdown 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3350373717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 msgr2=0x55c3a644fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a644fcf0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000cde0 tx=0x7f7bd0000bd0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3350373717 shutdown_connections 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x55c3a649d280 0x55c3a649f670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a644a390 0x55c3a6450230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a644fcf0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3350373717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a648eb20 0x55c3a6449e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3350373717 >> 172.21.15.144:0/3350373717 conn(0x55c3a6445290 msgr2=0x55c3a6443d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bcd600640 0 client.6474 ms_handle_reset on v2:172.21.15.144:6834/3811906714 2024-09-12T12:16:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3350373717 shutdown_connections 2024-09-12T12:16:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3350373717 wait complete. 2024-09-12T12:16:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.430+0000 7f7bee2b1000 20 client.6474 trim_cache size 0 max 16384 2024-09-12T12:16:41.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7bee2b1000 1 Processor -- start 2024-09-12T12:16:41.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7bee2b1000 1 -- start start 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 0x55c3a648dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 0x55c3a648e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a649f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7be42038a0 con 0x55c3a648f440 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4156090 con 0x55c3a644a390 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7be4203240 con 0x55c3a648eb20 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7be8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a649f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7be8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a649f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34810/0 (socket says 172.21.15.144:34810) 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7be8e00640 1 -- 172.21.15.144:0/3530444321 learned_addr learned my addr 172.21.15.144:0/3530444321 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7be3e00640 1 --2- 172.21.15.144:0/3530444321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 0x55c3a648dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7be3400640 1 --2- 172.21.15.144:0/3530444321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 0x55c3a648e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7be8e00640 1 -- 172.21.15.144:0/3530444321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 msgr2=0x55c3a648e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.450+0000 7f7be8e00640 1 --2- 172.21.15.144:0/3530444321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 0x55c3a648e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 -- 172.21.15.144:0/3530444321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 msgr2=0x55c3a648dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 --2- 172.21.15.144:0/3530444321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 0x55c3a648dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 -- 172.21.15.144:0/3530444321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a621afd0 con 0x55c3a648f440 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 --2- 172.21.15.144:0/3530444321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a649f670 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc017040 tx=0x7f7bdc00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdc3fb1ec44db7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bcfe00640 1 -- 172.21.15.144:0/3530444321 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc019040 con 0x55c3a648f440 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bcfe00640 1 -- 172.21.15.144:0/3530444321 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bdc01a040 con 0x55c3a648f440 2024-09-12T12:16:41.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bcfe00640 1 -- 172.21.15.144:0/3530444321 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc001f50 con 0x55c3a648f440 2024-09-12T12:16:41.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3530444321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 msgr2=0x55c3a649f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3530444321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a649f670 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc017040 tx=0x7f7bdc00c000 comp rx=0 tx=0).stop 2024-09-12T12:16:41.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3530444321 shutdown_connections 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3530444321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a649f670 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3530444321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 0x55c3a648e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/3530444321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 0x55c3a648dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3530444321 >> 172.21.15.144:0/3530444321 conn(0x55c3a6445290 msgr2=0x55c3a6449650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3530444321 shutdown_connections 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 -- 172.21.15.144:0/3530444321 wait complete. 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 -- start start 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 Processor -- start 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 0x55c3a64a2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 0x55c3a64bd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a64bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c3a6292f80 con 0x55c3a648f440 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c3a624bca0 con 0x55c3a644a390 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c3a62520f0 con 0x55c3a648eb20 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7bee2b1000 10 client.0 _ll_register_callbacks cb 0x7f7bd0007770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a64bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a64bdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34820/0 (socket says 172.21.15.144:34820) 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 -- 172.21.15.144:0/701691323 learned_addr learned my addr 172.21.15.144:0/701691323 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be3400640 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 0x55c3a64bd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be3e00640 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 0x55c3a64a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 -- 172.21.15.144:0/701691323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 msgr2=0x55c3a64bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 0x55c3a64bd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 -- 172.21.15.144:0/701691323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 msgr2=0x55c3a64a2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 0x55c3a64a2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.454+0000 7f7be8e00640 1 -- 172.21.15.144:0/701691323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a6316750 con 0x55c3a648f440 2024-09-12T12:16:41.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7be8e00640 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a64bdea0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc000f90 tx=0x7f7bdc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16b0dcb510486a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:41.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 1 -- 172.21.15.144:0/701691323 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc019040 con 0x55c3a648f440 2024-09-12T12:16:41.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 1 -- 172.21.15.144:0/701691323 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f7bdc014690 con 0x55c3a648f440 2024-09-12T12:16:41.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 -- 172.21.15.144:0/701691323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bdc01a040 con 0x55c3a648f440 2024-09-12T12:16:41.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 1 -- 172.21.15.144:0/701691323 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f7bdc03a050 con 0x55c3a648f440 2024-09-12T12:16:41.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 10 client.6480 fetch_fsmap learned FSMap version 46 2024-09-12T12:16:41.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 -- 172.21.15.144:0/701691323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55c3a6221a30 con 0x55c3a648f440 2024-09-12T12:16:41.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 1 -- 172.21.15.144:0/701691323 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bdc01a040 con 0x55c3a648f440 2024-09-12T12:16:41.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 1 -- 172.21.15.144:0/701691323 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f7bdc03d020 con 0x55c3a648f440 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 10 client.6480 fetch_fsmap finished waiting for FSMap version 46 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 10 client.6480 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 20 client.6480 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x55c3a64be3e0 0x55c3a6501ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 4 client.6480 mds_command: new command op to 6438 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 -- 172.21.15.144:0/701691323 --> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] -- command(tid 0: {"prefix": "status"}) -- 0x55c3a62a13a0 con 0x55c3a64be3e0 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7be3e00640 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x55c3a64be3e0 0x55c3a6501ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 10 client.6480 ms_handle_connect on v2:172.21.15.144:6834/3811906714 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7be3e00640 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x55c3a64be3e0 0x55c3a6501ec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72bbff98de24eb29 server_cookie=137db9f2f87f6ee3 in_seq=0 out_seq=0 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 1 -- 172.21.15.144:0/701691323 <== mds.0 v2:172.21.15.144:6834/3811906714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+317 (crc 0 0 0) 0x55c3a62a13a0 con 0x55c3a64be3e0 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 10 client.6480 handle_command_reply: tid=0 2024-09-12T12:16:41.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 client.6480 shutdown 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 -- 172.21.15.144:0/701691323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 msgr2=0x55c3a64bdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a64bdea0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc000f90 tx=0x7f7bdc001260 comp rx=0 tx=0).stop 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 -- 172.21.15.144:0/701691323 shutdown_connections 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x55c3a64be3e0 0x55c3a6501ec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c3a648f440 0x55c3a64bdea0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c3a648eb20 0x55c3a64bd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bcd600640 0 client.6480 ms_handle_reset on v2:172.21.15.144:6834/3811906714 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 --2- 172.21.15.144:0/701691323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3a644a390 0x55c3a64a2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 -- 172.21.15.144:0/701691323 >> 172.21.15.144:0/701691323 conn(0x55c3a6445290 msgr2=0x55c3a648cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 -- 172.21.15.144:0/701691323 shutdown_connections 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 1 -- 172.21.15.144:0/701691323 wait complete. 2024-09-12T12:16:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7bee2b1000 20 client.6480 trim_cache size 0 max 16384 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 6438, 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 4.588799367, 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 46, 2024-09-12T12:16:41.467 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 71, 2024-09-12T12:16:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 71, 2024-09-12T12:16:41.468 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 5.426438171 2024-09-12T12:16:41.468 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:16:41.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 -- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bc40678f0 msgr2=0x7f7bc4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bc40678f0 0x7f7bc4069db0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7be408d050 tx=0x7f7bd4008040 comp rx=0 tx=0).stop 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 -- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be40ceef0 msgr2=0x7f7be4160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be40ceef0 0x7f7be4160810 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000c420 tx=0x7f7bd000c8e0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 -- 172.21.15.144:0/2379304362 shutdown_connections 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bc40678f0 0x7f7bc4069db0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be415e800 0x7f7be415fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be40ceef0 0x7f7be4160810 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 --2- 172.21.15.144:0/2379304362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7be40b6820 0x7f7be4154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 -- 172.21.15.144:0/2379304362 >> 172.21.15.144:0/2379304362 conn(0x7f7be40d12e0 msgr2=0x7f7be406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 -- 172.21.15.144:0/2379304362 shutdown_connections 2024-09-12T12:16:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.458+0000 7f7beae00640 1 -- 172.21.15.144:0/2379304362 wait complete. 2024-09-12T12:16:41.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-12T12:16:41.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7f6c00640 1 Processor -- start 2024-09-12T12:16:41.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7f6c00640 1 -- start start 2024-09-12T12:16:41.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7f6c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff7f015c2e0 0x7ff7f0072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7f6c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f006c320 0x7ff7f00cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7f6c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f00733e0 con 0x7ff7f00af5f0 2024-09-12T12:16:41.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7f6c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f00cd290 con 0x7ff7f015c2e0 2024-09-12T12:16:41.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7f6c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f00cd570 con 0x7ff7f006c320 2024-09-12T12:16:41.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7efe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff7f015c2e0 0x7ff7f0072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7f4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f006c320 0x7ff7f00cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7efe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff7f015c2e0 0x7ff7f0072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:48392/0 (socket says 172.21.15.144:48392) 2024-09-12T12:16:41.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7efe00640 1 -- 172.21.15.144:0/2100087296 learned_addr learned my addr 172.21.15.144:0/2100087296 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:41.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7efe00640 1 -- 172.21.15.144:0/2100087296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f006c320 msgr2=0x7ff7f00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7efe00640 1 --2- 172.21.15.144:0/2100087296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f006c320 0x7ff7f00cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7efe00640 1 -- 172.21.15.144:0/2100087296 >> v1:172.21.15.165:6789/0 conn(0x7ff7f00af5f0 legacy=0x7ff7f006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.618+0000 7ff7efe00640 1 -- 172.21.15.144:0/2100087296 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f00cd850 con 0x7ff7f015c2e0 2024-09-12T12:16:41.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7efe00640 1 --2- 172.21.15.144:0/2100087296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f015c2e0 0x7ff7f0072b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009870 tx=0x7ff7e001c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1315a91899cabfcf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7eea00640 1 -- 172.21.15.144:0/2100087296 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00b0070 con 0x7ff7f015c2e0 2024-09-12T12:16:41.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7eea00640 1 -- 172.21.15.144:0/2100087296 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e00ab600 con 0x7ff7f015c2e0 2024-09-12T12:16:41.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7eea00640 1 -- 172.21.15.144:0/2100087296 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00ab9d0 con 0x7ff7f015c2e0 2024-09-12T12:16:41.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7f6c00640 1 -- 172.21.15.144:0/2100087296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f015c2e0 msgr2=0x7ff7f0072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7f6c00640 1 --2- 172.21.15.144:0/2100087296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f015c2e0 0x7ff7f0072b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009870 tx=0x7ff7e001c440 comp rx=0 tx=0).stop 2024-09-12T12:16:41.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7f6c00640 1 -- 172.21.15.144:0/2100087296 shutdown_connections 2024-09-12T12:16:41.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7f6c00640 1 --2- 172.21.15.144:0/2100087296 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f006c320 0x7ff7f00cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7f6c00640 1 --2- 172.21.15.144:0/2100087296 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f015c2e0 0x7ff7f0072b50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7f6c00640 1 -- 172.21.15.144:0/2100087296 >> 172.21.15.144:0/2100087296 conn(0x7ff7f0068030 msgr2=0x7ff7f00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7f6c00640 1 -- 172.21.15.144:0/2100087296 shutdown_connections 2024-09-12T12:16:41.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.622+0000 7ff7f6c00640 1 -- 172.21.15.144:0/2100087296 wait complete. 2024-09-12T12:16:41.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 Processor -- start 2024-09-12T12:16:41.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 -- start start 2024-09-12T12:16:41.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f006c320 0x7ff7f01494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00af5f0 0x7ff7f014a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c2e0 0x7ff7f014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f00cee50 con 0x7ff7f00af5f0 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f00cecd0 con 0x7ff7f006c320 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f00cefd0 con 0x7ff7f015c2e0 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7ef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00af5f0 0x7ff7f014a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7ef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00af5f0 0x7ff7f014a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34830/0 (socket says 172.21.15.144:34830) 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7ef400640 1 -- 172.21.15.144:0/903157473 learned_addr learned my addr 172.21.15.144:0/903157473 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f4c00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c2e0 0x7ff7f014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7efe00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f006c320 0x7ff7f01494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7ef400640 1 -- 172.21.15.144:0/903157473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c2e0 msgr2=0x7ff7f014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7ef400640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c2e0 0x7ff7f014ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7ef400640 1 -- 172.21.15.144:0/903157473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f006c320 msgr2=0x7ff7f01494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7ef400640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f006c320 0x7ff7f01494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7ef400640 1 -- 172.21.15.144:0/903157473 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f015e520 con 0x7ff7f00af5f0 2024-09-12T12:16:41.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7ef400640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00af5f0 0x7ff7f014a5e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c450 tx=0x7ff7dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7e7e00640 1 -- 172.21.15.144:0/903157473 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0052d0 con 0x7ff7f00af5f0 2024-09-12T12:16:41.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7e7e00640 1 -- 172.21.15.144:0/903157473 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc005470 con 0x7ff7f00af5f0 2024-09-12T12:16:41.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7e7e00640 1 -- 172.21.15.144:0/903157473 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc007260 con 0x7ff7f00af5f0 2024-09-12T12:16:41.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f015e800 con 0x7ff7f00af5f0 2024-09-12T12:16:41.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.626+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f015edc0 con 0x7ff7f00af5f0 2024-09-12T12:16:41.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.630+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f00cdd70 con 0x7ff7f00af5f0 2024-09-12T12:16:41.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.630+0000 7ff7e7e00640 1 -- 172.21.15.144:0/903157473 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7dc007400 con 0x7ff7f00af5f0 2024-09-12T12:16:41.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.630+0000 7ff7e7e00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7d00678c0 0x7ff7d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.630+0000 7ff7e7e00640 1 -- 172.21.15.144:0/903157473 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7ff7dc085410 con 0x7ff7f00af5f0 2024-09-12T12:16:41.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.630+0000 7ff7efe00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7d00678c0 0x7ff7d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.630+0000 7ff7efe00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7d00678c0 0x7ff7d0069d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00ad000 tx=0x7ff7e00a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.634+0000 7ff7e7e00640 1 -- 172.21.15.144:0/903157473 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff7dc0555f0 con 0x7ff7f00af5f0 2024-09-12T12:16:41.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.790+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7ff7f015acc0 con 0x7ff7f00af5f0 2024-09-12T12:16:41.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.794+0000 7ff7e7e00640 1 -- 172.21.15.144:0/903157473 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7ff7dc0598f0 con 0x7ff7f00af5f0 2024-09-12T12:16:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7d00678c0 msgr2=0x7ff7d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7d00678c0 0x7ff7d0069d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00ad000 tx=0x7ff7e00a6000 comp rx=0 tx=0).stop 2024-09-12T12:16:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00af5f0 msgr2=0x7ff7f014a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00af5f0 0x7ff7f014a5e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c450 tx=0x7ff7dc00c910 comp rx=0 tx=0).stop 2024-09-12T12:16:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 shutdown_connections 2024-09-12T12:16:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7d00678c0 0x7ff7d0069d80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c2e0 0x7ff7f014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00af5f0 0x7ff7f014a5e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 --2- 172.21.15.144:0/903157473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f006c320 0x7ff7f01494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 >> 172.21.15.144:0/903157473 conn(0x7ff7f0068030 msgr2=0x7ff7f015b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 shutdown_connections 2024-09-12T12:16:41.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.798+0000 7ff7f6c00640 1 -- 172.21.15.144:0/903157473 wait complete. 2024-09-12T12:16:41.820 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-09-12T12:16:41.874 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-12T12:16:41.870+0000 7fc8b8a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:16:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.958+0000 7f9934200640 1 Processor -- start 2024-09-12T12:16:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.958+0000 7f9934200640 1 -- start start 2024-09-12T12:16:41.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.958+0000 7f9934200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f992c0cd9f0 0x7f992c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.958+0000 7f9934200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f992c0b4300 con 0x7f992c15af60 2024-09-12T12:16:41.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.958+0000 7f9934200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f992c0b3540 con 0x7f992c15b340 2024-09-12T12:16:41.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.958+0000 7f9934200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f992c0b32f0 con 0x7f992c0cd9f0 2024-09-12T12:16:41.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.958+0000 7f9931800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f992c15af60 0x7f992c0ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34640/0 (socket says 172.21.15.144:34640) 2024-09-12T12:16:41.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.958+0000 7f9931800640 1 -- 172.21.15.144:0/3570491693 learned_addr learned my addr 172.21.15.144:0/3570491693 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9930e00640 1 --2- 172.21.15.144:0/3570491693 >> v2:172.21.15.165:3300/0 conn(0x7f992c0cd9f0 0x7f992c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3068529123 0 0) 0x7f992c0b4300 con 0x7f992c15af60 2024-09-12T12:16:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9914003530 con 0x7f992c15af60 2024-09-12T12:16:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095955190 0 0) 0x7f992c0b3540 con 0x7f992c15b340 2024-09-12T12:16:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f992c0b4300 con 0x7f992c15b340 2024-09-12T12:16:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3865999545 0 0) 0x7f9914003530 con 0x7f992c15af60 2024-09-12T12:16:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 >> v2:172.21.15.165:3300/0 conn(0x7f992c0cd9f0 msgr2=0x7f992c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 --2- 172.21.15.144:0/3570491693 >> v2:172.21.15.165:3300/0 conn(0x7f992c0cd9f0 0x7f992c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 >> v1:172.21.15.165:6789/0 conn(0x7f992c15b340 legacy=0x7f992c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c0b3820 con 0x7f992c15af60 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f9920001a00 con 0x7f992c15af60 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 >> v1:172.21.15.144:6789/0 conn(0x7f992c15af60 legacy=0x7f992c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914003b50 0x7f9914003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9914004810 0x7f9914004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140051d0 0x7f991400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f992c0b32f0 con 0x7f9914004810 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f991400c050 con 0x7f99140051d0 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f991400c250 con 0x7f9914003b50 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9930e00640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9914004810 0x7f9914004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9931800640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914003b50 0x7f9914003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9932200640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140051d0 0x7f991400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9930e00640 1 -- 172.21.15.144:0/3570491693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914003b50 msgr2=0x7f9914003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9930e00640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914003b50 0x7f9914003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9930e00640 1 -- 172.21.15.144:0/3570491693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140051d0 msgr2=0x7f991400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9930e00640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140051d0 0x7f991400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9930e00640 1 -- 172.21.15.144:0/3570491693 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9914003530 con 0x7f9914004810 2024-09-12T12:16:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9932200640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99140051d0 0x7f991400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.962+0000 7f9932200640 1 -- 172.21.15.144:0/3570491693 reap_dead start 2024-09-12T12:16:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9930e00640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9914004810 0x7f9914004c90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9918009ae0 tx=0x7f991801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2e03d687469c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99180b2070 con 0x7f9914004810 2024-09-12T12:16:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99180a5660 con 0x7f9914004810 2024-09-12T12:16:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f992be00640 1 -- 172.21.15.144:0/3570491693 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99180096b0 con 0x7f9914004810 2024-09-12T12:16:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 -- 172.21.15.144:0/3570491693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9914004810 msgr2=0x7f9914004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9914004810 0x7f9914004c90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9918009ae0 tx=0x7f991801ca70 comp rx=0 tx=0).stop 2024-09-12T12:16:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 -- 172.21.15.144:0/3570491693 shutdown_connections 2024-09-12T12:16:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 --2- 172.21.15.144:0/3570491693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9914004810 0x7f9914004c90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 -- 172.21.15.144:0/3570491693 >> 172.21.15.144:0/3570491693 conn(0x7f992c068030 msgr2=0x7f992c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 -- 172.21.15.144:0/3570491693 shutdown_connections 2024-09-12T12:16:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 -- 172.21.15.144:0/3570491693 wait complete. 2024-09-12T12:16:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 Processor -- start 2024-09-12T12:16:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 -- start start 2024-09-12T12:16:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914004810 0x7f992c145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c14cf90 0x7f992c1499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992c15deb0 0x7f992c0d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f992c0ce680 con 0x7f992c15deb0 2024-09-12T12:16:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f992c0b3de0 con 0x7f992c14cf90 2024-09-12T12:16:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.966+0000 7f9934200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f992c0ce800 con 0x7f9914004810 2024-09-12T12:16:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9932200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992c15deb0 0x7f992c0d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9932200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992c15deb0 0x7f992c0d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34852/0 (socket says 172.21.15.144:34852) 2024-09-12T12:16:41.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9932200640 1 -- 172.21.15.144:0/2135177524 learned_addr learned my addr 172.21.15.144:0/2135177524 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:41.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9931800640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914004810 0x7f992c145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9930e00640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c14cf90 0x7f992c1499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9932200640 1 -- 172.21.15.144:0/2135177524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914004810 msgr2=0x7f992c145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9932200640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914004810 0x7f992c145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9932200640 1 -- 172.21.15.144:0/2135177524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c14cf90 msgr2=0x7f992c1499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9932200640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c14cf90 0x7f992c1499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9932200640 1 -- 172.21.15.144:0/2135177524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c146200 con 0x7f992c15deb0 2024-09-12T12:16:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9931800640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914004810 0x7f992c145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9932200640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992c15deb0 0x7f992c0d02c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9924007af0 tx=0x7f992400f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9929600640 1 -- 172.21.15.144:0/2135177524 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924010040 con 0x7f992c15deb0 2024-09-12T12:16:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9929600640 1 -- 172.21.15.144:0/2135177524 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992401a070 con 0x7f992c15deb0 2024-09-12T12:16:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9929600640 1 -- 172.21.15.144:0/2135177524 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924015410 con 0x7f992c15deb0 2024-09-12T12:16:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992c15c1d0 con 0x7f992c15deb0 2024-09-12T12:16:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f992c15c790 con 0x7f992c15deb0 2024-09-12T12:16:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f992c0ceb90 con 0x7f992c15deb0 2024-09-12T12:16:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9929600640 1 -- 172.21.15.144:0/2135177524 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99240155b0 con 0x7f992c15deb0 2024-09-12T12:16:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.970+0000 7f9929600640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f990c067860 0x7f990c069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.974+0000 7f9929600640 1 -- 172.21.15.144:0/2135177524 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f99240892a0 con 0x7f992c15deb0 2024-09-12T12:16:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.974+0000 7f9931800640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f990c067860 0x7f990c069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.974+0000 7f9931800640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f990c067860 0x7f990c069d20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9920004d10 tx=0x7f9920006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:41.978+0000 7f9929600640 1 -- 172.21.15.144:0/2135177524 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9924059b60 con 0x7f992c15deb0 2024-09-12T12:16:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.134+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f992c0afc20 con 0x7f992c15deb0 2024-09-12T12:16:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.138+0000 7f9929600640 1 -- 172.21.15.144:0/2135177524 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f9924059460 con 0x7f992c15deb0 2024-09-12T12:16:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f990c067860 msgr2=0x7f990c069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f990c067860 0x7f990c069d20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9920004d10 tx=0x7f9920006040 comp rx=0 tx=0).stop 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992c15deb0 msgr2=0x7f992c0d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992c15deb0 0x7f992c0d02c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9924007af0 tx=0x7f992400f540 comp rx=0 tx=0).stop 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 shutdown_connections 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f990c067860 0x7f990c069d20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f992c15deb0 0x7f992c0d02c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f992c14cf90 0x7f992c1499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 --2- 172.21.15.144:0/2135177524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9914004810 0x7f992c145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 >> 172.21.15.144:0/2135177524 conn(0x7f992c068030 msgr2=0x7f992c0afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 shutdown_connections 2024-09-12T12:16:42.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.142+0000 7f9934200640 1 -- 172.21.15.144:0/2135177524 wait complete. 2024-09-12T12:16:42.165 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:42.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab77400640 1 Processor -- start 2024-09-12T12:16:42.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab77400640 1 -- start start 2024-09-12T12:16:42.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab77400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab7015b4e0 0x7fab700b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab77400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fab700ccf30 0x7fab700cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab77400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab700b45a0 con 0x7fab700b3ad0 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab77400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fab700b3fe0 con 0x7fab700ccf30 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab77400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fab700b42c0 con 0x7fab7015b4e0 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab75400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fab700ccf30 0x7fab700cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab75400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fab700ccf30 0x7fab700cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34866/0 (socket says 172.21.15.144:34866) 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab75400640 1 -- 172.21.15.144:0/2336703990 learned_addr learned my addr 172.21.15.144:0/2336703990 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab6fe00640 1 --1- 172.21.15.144:0/2336703990 >> v1:172.21.15.144:6789/0 conn(0x7fab700b3ad0 0x7fab70071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34644/0 (socket says 172.21.15.144:34644) 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.298+0000 7fab74a00640 1 --2- 172.21.15.144:0/2336703990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab7015b4e0 0x7fab700b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab75400640 1 -- 172.21.15.144:0/2336703990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab7015b4e0 msgr2=0x7fab700b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab75400640 1 --2- 172.21.15.144:0/2336703990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab7015b4e0 0x7fab700b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab75400640 1 -- 172.21.15.144:0/2336703990 >> v1:172.21.15.144:6789/0 conn(0x7fab700b3ad0 legacy=0x7fab70071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab75400640 1 -- 172.21.15.144:0/2336703990 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab700b1490 con 0x7fab700ccf30 2024-09-12T12:16:42.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab6f400640 1 -- 172.21.15.144:0/2336703990 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476564081 0 0) 0x7fab700b45a0 con 0x7fab700b3ad0 2024-09-12T12:16:42.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab74a00640 1 --2- 172.21.15.144:0/2336703990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab7015b4e0 0x7fab700b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:42.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab75400640 1 --2- 172.21.15.144:0/2336703990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab700ccf30 0x7fab700cd3e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fab68009870 tx=0x7fab6801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb8644826a0963f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab6f400640 1 -- 172.21.15.144:0/2336703990 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab680b1070 con 0x7fab700ccf30 2024-09-12T12:16:42.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab6f400640 1 -- 172.21.15.144:0/2336703990 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab680ac410 con 0x7fab700ccf30 2024-09-12T12:16:42.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab6f400640 1 -- 172.21.15.144:0/2336703990 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab680ac7e0 con 0x7fab700ccf30 2024-09-12T12:16:42.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab77400640 1 -- 172.21.15.144:0/2336703990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab700ccf30 msgr2=0x7fab700cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab77400640 1 --2- 172.21.15.144:0/2336703990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab700ccf30 0x7fab700cd3e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fab68009870 tx=0x7fab6801c560 comp rx=0 tx=0).stop 2024-09-12T12:16:42.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab77400640 1 -- 172.21.15.144:0/2336703990 shutdown_connections 2024-09-12T12:16:42.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab77400640 1 --2- 172.21.15.144:0/2336703990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab700ccf30 0x7fab700cd3e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab77400640 1 --2- 172.21.15.144:0/2336703990 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab7015b4e0 0x7fab700b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab77400640 1 -- 172.21.15.144:0/2336703990 >> 172.21.15.144:0/2336703990 conn(0x7fab7006d0d0 msgr2=0x7fab7006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:42.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab77400640 1 -- 172.21.15.144:0/2336703990 shutdown_connections 2024-09-12T12:16:42.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.302+0000 7fab77400640 1 -- 172.21.15.144:0/2336703990 wait complete. 2024-09-12T12:16:42.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 Processor -- start 2024-09-12T12:16:42.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 -- start start 2024-09-12T12:16:42.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab700b3ad0 0x7fab701570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab700ccf30 0x7fab700cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab7015b4e0 0x7fab70160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fab7015b8c0 con 0x7fab7015b4e0 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab700b02e0 con 0x7fab700b3ad0 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fab70157620 con 0x7fab700ccf30 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab75400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab7015b4e0 0x7fab70160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab75400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab7015b4e0 0x7fab70160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34882/0 (socket says 172.21.15.144:34882) 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab75400640 1 -- 172.21.15.144:0/3564597789 learned_addr learned my addr 172.21.15.144:0/3564597789 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab6fe00640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab700ccf30 0x7fab700cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab74a00640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab700b3ad0 0x7fab701570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab75400640 1 -- 172.21.15.144:0/3564597789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab700ccf30 msgr2=0x7fab700cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab75400640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab700ccf30 0x7fab700cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab75400640 1 -- 172.21.15.144:0/3564597789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab700b3ad0 msgr2=0x7fab701570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab75400640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab700b3ad0 0x7fab701570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab75400640 1 -- 172.21.15.144:0/3564597789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab70159f40 con 0x7fab7015b4e0 2024-09-12T12:16:42.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab75400640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab7015b4e0 0x7fab70160b10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fab680af040 tx=0x7fab68019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab6cc00640 1 -- 172.21.15.144:0/3564597789 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab680bc070 con 0x7fab7015b4e0 2024-09-12T12:16:42.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab6cc00640 1 -- 172.21.15.144:0/3564597789 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab680acd20 con 0x7fab7015b4e0 2024-09-12T12:16:42.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab6cc00640 1 -- 172.21.15.144:0/3564597789 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab680b1040 con 0x7fab7015b4e0 2024-09-12T12:16:42.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 -- 172.21.15.144:0/3564597789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab70161a60 con 0x7fab7015b4e0 2024-09-12T12:16:42.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.306+0000 7fab77400640 1 -- 172.21.15.144:0/3564597789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab70160310 con 0x7fab7015b4e0 2024-09-12T12:16:42.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.310+0000 7fab66000640 1 -- 172.21.15.144:0/3564597789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab700cd3e0 con 0x7fab7015b4e0 2024-09-12T12:16:42.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.310+0000 7fab6cc00640 1 -- 172.21.15.144:0/3564597789 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab68004230 con 0x7fab7015b4e0 2024-09-12T12:16:42.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.310+0000 7fab6cc00640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fab500678c0 0x7fab50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.310+0000 7fab6cc00640 1 -- 172.21.15.144:0/3564597789 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7fab6811f5c0 con 0x7fab7015b4e0 2024-09-12T12:16:42.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.310+0000 7fab74a00640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fab500678c0 0x7fab50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.310+0000 7fab74a00640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fab500678c0 0x7fab50069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fab60009fd0 tx=0x7fab60009870 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.314+0000 7fab6cc00640 1 -- 172.21.15.144:0/3564597789 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fab68016150 con 0x7fab7015b4e0 2024-09-12T12:16:42.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 -- 172.21.15.144:0/3564597789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab700b2da0 con 0x7fab7015b4e0 2024-09-12T12:16:42.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab6cc00640 1 -- 172.21.15.144:0/3564597789 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5231 (secure 0 0 0) 0x7fab680ef7a0 con 0x7fab7015b4e0 2024-09-12T12:16:42.509 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:42.510 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-12T12:16:39:885036+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:39.885031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6438,"qdb_cluster":[6438]},"id":4}]} 2024-09-12T12:16:42.510 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-12T12:16:42.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 -- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fab500678c0 msgr2=0x7fab50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fab500678c0 0x7fab50069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fab60009fd0 tx=0x7fab60009870 comp rx=0 tx=0).stop 2024-09-12T12:16:42.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 -- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab7015b4e0 msgr2=0x7fab70160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab7015b4e0 0x7fab70160b10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fab680af040 tx=0x7fab68019300 comp rx=0 tx=0).stop 2024-09-12T12:16:42.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 -- 172.21.15.144:0/3564597789 shutdown_connections 2024-09-12T12:16:42.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fab500678c0 0x7fab50069d80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab7015b4e0 0x7fab70160b10 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab700ccf30 0x7fab700cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 --2- 172.21.15.144:0/3564597789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab700b3ad0 0x7fab701570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.506+0000 7fab66000640 1 -- 172.21.15.144:0/3564597789 >> 172.21.15.144:0/3564597789 conn(0x7fab7006d0d0 msgr2=0x7fab700b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:42.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.510+0000 7fab66000640 1 -- 172.21.15.144:0/3564597789 shutdown_connections 2024-09-12T12:16:42.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.510+0000 7fab66000640 1 -- 172.21.15.144:0/3564597789 wait complete. 2024-09-12T12:16:42.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-12T12:16:42.686 INFO:teuthology.orchestra.run.smithi144.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-12T12:16:33.747012+0000","btime":"2024-09-12T12:16:32.871022+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T12:16:33.747012+0000","atime":"2024-09-12T12:16:32.871022+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-12T12:16:33.747012+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:16:33.747012+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:16:33.747012+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-12T12:16:42.687 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-12T12:16:33.747012+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-12T12:16:32.871022+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-12T12:16:32.871022+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-12T12:16:33.747012+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-12T12:16:33.747012+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-12T12:16:33.747012+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-12T12:16:33.747012+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-12T12:16:42.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:42.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-09-12T12:16:42.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:16:42.733 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:16:42.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f9564a00640 1 Processor -- start 2024-09-12T12:16:42.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f9564a00640 1 -- start start 2024-09-12T12:16:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f9564a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f956006d630 0x7f9560155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f9564a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956006cd20 con 0x7f956006d250 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f9564a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95600b3950 con 0x7f95600b3490 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f9564a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9560072620 con 0x7f956006d630 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955de00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f956006d250 0x7f956015c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34646/0 (socket says 172.21.15.144:34646) 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955de00640 1 -- 172.21.15.144:0/3287661678 learned_addr learned my addr 172.21.15.144:0/3287661678 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955e800640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f956006d630 0x7f9560155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159110843 0 0) 0x7f956006cd20 con 0x7f956006d250 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9544003530 con 0x7f956006d250 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4027577824 0 0) 0x7f9544003530 con 0x7f956006d250 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f956006d630 msgr2=0x7f9560155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f956006d630 0x7f9560155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 >> v1:172.21.15.165:6789/0 conn(0x7f95600b3490 legacy=0x7f95600b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95600b3c30 con 0x7f956006d250 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f9550001680 con 0x7f956006d250 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 >> v1:172.21.15.144:6789/0 conn(0x7f956006d250 legacy=0x7f956015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95440039f0 0x7f9544003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f956006d630 0x7f9544004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9544004d50 0x7f95440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9560072620 con 0x7f95440039f0 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f954400ba00 con 0x7f9544004d50 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f954400de10 con 0x7f956006d630 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955de00640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95440039f0 0x7f9544003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955d400640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f956006d630 0x7f9544004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955e800640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9544004d50 0x7f95440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955de00640 1 -- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f956006d630 msgr2=0x7f9544004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955de00640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f956006d630 0x7f9544004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955de00640 1 -- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9544004d50 msgr2=0x7f95440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955de00640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9544004d50 0x7f95440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.826+0000 7f955de00640 1 -- 172.21.15.144:0/3287661678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9544003530 con 0x7f95440039f0 2024-09-12T12:16:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f955de00640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95440039f0 0x7f9544003dd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f955000c210 tx=0x7f955001cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6686e002a7ddc89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550007cf0 con 0x7f95440039f0 2024-09-12T12:16:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95500a9070 con 0x7f95440039f0 2024-09-12T12:16:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f955ca00640 1 -- 172.21.15.144:0/3287661678 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550005d40 con 0x7f95440039f0 2024-09-12T12:16:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f9564a00640 1 -- 172.21.15.144:0/3287661678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95440039f0 msgr2=0x7f9544003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f9564a00640 1 --2- 172.21.15.144:0/3287661678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95440039f0 0x7f9544003dd0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f955000c210 tx=0x7f955001cb50 comp rx=0 tx=0).stop 2024-09-12T12:16:42.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f955e800640 1 -- 172.21.15.144:0/3287661678 reap_dead start 2024-09-12T12:16:42.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f9564a00640 1 -- 172.21.15.144:0/3287661678 shutdown_connections 2024-09-12T12:16:42.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f9564a00640 1 -- 172.21.15.144:0/3287661678 >> 172.21.15.144:0/3287661678 conn(0x7f956006bc10 msgr2=0x7f956006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:42.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f9564a00640 1 -- 172.21.15.144:0/3287661678 shutdown_connections 2024-09-12T12:16:42.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.830+0000 7f9564a00640 1 -- 172.21.15.144:0/3287661678 wait complete. 2024-09-12T12:16:42.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 Processor -- start 2024-09-12T12:16:42.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 -- start start 2024-09-12T12:16:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95440039f0 0x7f95601552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9560148cf0 0x7f956014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9560150060 0x7f9560157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f956015d000 con 0x7f9560150060 2024-09-12T12:16:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f956015ce80 con 0x7f95440039f0 2024-09-12T12:16:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f956015d180 con 0x7f9560148cf0 2024-09-12T12:16:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9560150060 0x7f9560157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9560150060 0x7f9560157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34906/0 (socket says 172.21.15.144:34906) 2024-09-12T12:16:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955e800640 1 -- 172.21.15.144:0/2494935854 learned_addr learned my addr 172.21.15.144:0/2494935854 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955d400640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9560148cf0 0x7f956014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955de00640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95440039f0 0x7f95601552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955e800640 1 -- 172.21.15.144:0/2494935854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9560148cf0 msgr2=0x7f956014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955e800640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9560148cf0 0x7f956014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955e800640 1 -- 172.21.15.144:0/2494935854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95440039f0 msgr2=0x7f95601552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955e800640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95440039f0 0x7f95601552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955e800640 1 -- 172.21.15.144:0/2494935854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9560073420 con 0x7f9560150060 2024-09-12T12:16:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f955e800640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9560150060 0x7f9560157bd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9558007d10 tx=0x7f95580115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9556000640 1 -- 172.21.15.144:0/2494935854 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558011de0 con 0x7f9560150060 2024-09-12T12:16:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9556000640 1 -- 172.21.15.144:0/2494935854 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955801b070 con 0x7f9560150060 2024-09-12T12:16:42.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9556000640 1 -- 172.21.15.144:0/2494935854 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95580039a0 con 0x7f9560150060 2024-09-12T12:16:42.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 -- 172.21.15.144:0/2494935854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95601517e0 con 0x7f9560150060 2024-09-12T12:16:42.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.834+0000 7f9564a00640 1 -- 172.21.15.144:0/2494935854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9560150690 con 0x7f9560150060 2024-09-12T12:16:42.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9556000640 1 -- 172.21.15.144:0/2494935854 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9558003b40 con 0x7f9560150060 2024-09-12T12:16:42.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9556000640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95400678f0 0x7f9540069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9556000640 1 -- 172.21.15.144:0/2494935854 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f9558086510 con 0x7f9560150060 2024-09-12T12:16:42.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f955de00640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95400678f0 0x7f9540069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9567ecb000 1 Processor -- start 2024-09-12T12:16:42.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9567ecb000 1 -- start start 2024-09-12T12:16:42.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f955de00640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95400678f0 0x7f9540069db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f95500ab000 tx=0x7f95500b1040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac761a840 0x555ac761ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 0x555ac75d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac75d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9567ecb000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555ac741eb20 con 0x555ac75d1000 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9567ecb000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555ac73d9870 con 0x555ac761a840 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.838+0000 7f9567ecb000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555ac741aae0 con 0x555ac761b160 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac75d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac75d13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34922/0 (socket says 172.21.15.144:34922) 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955e800640 1 -- 172.21.15.144:0/754427804 learned_addr learned my addr 172.21.15.144:0/754427804 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955de00640 1 --2- 172.21.15.144:0/754427804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac761a840 0x555ac761ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955d400640 1 --2- 172.21.15.144:0/754427804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 0x555ac75d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955e800640 1 -- 172.21.15.144:0/754427804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 msgr2=0x555ac75d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955e800640 1 --2- 172.21.15.144:0/754427804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 0x555ac75d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955e800640 1 -- 172.21.15.144:0/754427804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac761a840 msgr2=0x555ac761ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955e800640 1 --2- 172.21.15.144:0/754427804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac761a840 0x555ac761ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955e800640 1 -- 172.21.15.144:0/754427804 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ac73f1940 con 0x555ac75d1000 2024-09-12T12:16:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955e800640 1 --2- 172.21.15.144:0/754427804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac75d13e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f955805ed80 tx=0x7f9558056680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6f59a92713c37f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f954aa00640 1 -- 172.21.15.144:0/754427804 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955805f2b0 con 0x555ac75d1000 2024-09-12T12:16:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f954aa00640 1 -- 172.21.15.144:0/754427804 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9558054a80 con 0x555ac75d1000 2024-09-12T12:16:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f954aa00640 1 -- 172.21.15.144:0/754427804 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9558084b90 con 0x555ac75d1000 2024-09-12T12:16:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 -- 172.21.15.144:0/754427804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 msgr2=0x555ac75d13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 --2- 172.21.15.144:0/754427804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac75d13e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f955805ed80 tx=0x7f9558056680 comp rx=0 tx=0).stop 2024-09-12T12:16:42.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 -- 172.21.15.144:0/754427804 shutdown_connections 2024-09-12T12:16:42.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 --2- 172.21.15.144:0/754427804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac75d13e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 --2- 172.21.15.144:0/754427804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 0x555ac75d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 --2- 172.21.15.144:0/754427804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac761a840 0x555ac761ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 -- 172.21.15.144:0/754427804 >> 172.21.15.144:0/754427804 conn(0x555ac75d7160 msgr2=0x555ac75cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:42.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 -- 172.21.15.144:0/754427804 shutdown_connections 2024-09-12T12:16:42.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 -- 172.21.15.144:0/754427804 wait complete. 2024-09-12T12:16:42.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 -- start start 2024-09-12T12:16:42.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 Processor -- start 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d1000 0x555ac7607710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac761a840 0x555ac75d5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 0x555ac75d5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555ac73eb8e0 con 0x555ac761a840 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555ac73c29b0 con 0x555ac75d1000 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555ac73e6260 con 0x555ac761b160 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f9567ecb000 10 client.0 _ll_register_callbacks cb 0x555ac75bc540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac761a840 0x555ac75d5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac761a840 0x555ac75d5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34926/0 (socket says 172.21.15.144:34926) 2024-09-12T12:16:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955d400640 1 -- 172.21.15.144:0/926085652 learned_addr learned my addr 172.21.15.144:0/926085652 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.842+0000 7f955de00640 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d1000 0x555ac7607710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f955e800640 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 0x555ac75d5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f955d400640 1 -- 172.21.15.144:0/926085652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 msgr2=0x555ac75d5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f955d400640 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 0x555ac75d5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f955d400640 1 -- 172.21.15.144:0/926085652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d1000 msgr2=0x555ac7607710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f955d400640 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d1000 0x555ac7607710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f955d400640 1 -- 172.21.15.144:0/926085652 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ac73d9ac0 con 0x555ac761a840 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f955d400640 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac761a840 0x555ac75d5980 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f954c0145c0 tx=0x7f954c014a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1a3556dee1acd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 1 -- 172.21.15.144:0/926085652 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c01a070 con 0x555ac761a840 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 1 -- 172.21.15.144:0/926085652 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f954c0052e0 con 0x555ac761a840 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 -- 172.21.15.144:0/926085652 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9558054a80 con 0x555ac761a840 2024-09-12T12:16:42.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 1 -- 172.21.15.144:0/926085652 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f954c025050 con 0x555ac761a840 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 10 client.6510 fetch_fsmap learned FSMap version 46 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 -- 172.21.15.144:0/926085652 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x555ac73be810 con 0x555ac761a840 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 1 -- 172.21.15.144:0/926085652 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9558054a80 con 0x555ac761a840 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 1 -- 172.21.15.144:0/926085652 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f954c028020 con 0x555ac761a840 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 10 client.6510 fetch_fsmap finished waiting for FSMap version 46 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 10 client.6510 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 20 client.6510 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x555ac7608710 0x555ac762b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 4 client.6510 mds_command: new command op to 6438 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 -- 172.21.15.144:0/926085652 --> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ac73b8e30 con 0x555ac7608710 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f955de00640 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x555ac7608710 0x555ac762b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f955de00640 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x555ac7608710 0x555ac762b8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a95d161d973c37f1 server_cookie=a4cfcef5faff7f3 in_seq=0 out_seq=0 2024-09-12T12:16:42.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 10 client.6510 ms_handle_connect on v2:172.21.15.144:6834/3811906714 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 1 -- 172.21.15.144:0/926085652 <== mds.0 v2:172.21.15.144:6834/3811906714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ac73b8e30 con 0x555ac7608710 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 10 client.6510 handle_command_reply: tid=0 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 client.6510 shutdown 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 -- 172.21.15.144:0/926085652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac761a840 msgr2=0x555ac75d5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac761a840 0x555ac75d5980 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f954c0145c0 tx=0x7f954c014a80 comp rx=0 tx=0).stop 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 -- 172.21.15.144:0/926085652 shutdown_connections 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x555ac7608710 0x555ac762b8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac761b160 0x555ac75d5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f953f400640 0 client.6510 ms_handle_reset on v2:172.21.15.144:6834/3811906714 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac761a840 0x555ac75d5980 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 --2- 172.21.15.144:0/926085652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d1000 0x555ac7607710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 -- 172.21.15.144:0/926085652 >> 172.21.15.144:0/926085652 conn(0x555ac75d7160 msgr2=0x555ac75cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 -- 172.21.15.144:0/926085652 shutdown_connections 2024-09-12T12:16:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 1 -- 172.21.15.144:0/926085652 wait complete. 2024-09-12T12:16:42.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.846+0000 7f9567ecb000 20 client.6510 trim_cache size 0 max 16384 2024-09-12T12:16:42.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 Processor -- start 2024-09-12T12:16:42.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 -- start start 2024-09-12T12:16:42.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d6080 0x555ac75d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d7160 0x555ac75d2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d1000 0x555ac762b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f95602003b0 con 0x555ac75d6080 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f95601ff390 con 0x555ac75d7160 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f95601fe760 con 0x555ac75d1000 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d6080 0x555ac75d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d6080 0x555ac75d2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34940/0 (socket says 172.21.15.144:34940) 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955de00640 1 -- 172.21.15.144:0/1892325897 learned_addr learned my addr 172.21.15.144:0/1892325897 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955d400640 1 --2- 172.21.15.144:0/1892325897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d7160 0x555ac75d2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955e800640 1 --2- 172.21.15.144:0/1892325897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d1000 0x555ac762b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955de00640 1 -- 172.21.15.144:0/1892325897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d1000 msgr2=0x555ac762b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955de00640 1 --2- 172.21.15.144:0/1892325897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d1000 0x555ac762b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955de00640 1 -- 172.21.15.144:0/1892325897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d7160 msgr2=0x555ac75d2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955de00640 1 --2- 172.21.15.144:0/1892325897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d7160 0x555ac75d2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955de00640 1 -- 172.21.15.144:0/1892325897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ac73dc240 con 0x555ac75d6080 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f955de00640 1 --2- 172.21.15.144:0/1892325897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d6080 0x555ac75d2600 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f955000c210 tx=0x7f95600b3e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10143b5e003a9551 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f954a000640 1 -- 172.21.15.144:0/1892325897 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95500a6c90 con 0x555ac75d6080 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f954a000640 1 -- 172.21.15.144:0/1892325897 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95500a9070 con 0x555ac75d6080 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f954a000640 1 -- 172.21.15.144:0/1892325897 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95500070a0 con 0x555ac75d6080 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 -- 172.21.15.144:0/1892325897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d6080 msgr2=0x555ac75d2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 --2- 172.21.15.144:0/1892325897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d6080 0x555ac75d2600 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f955000c210 tx=0x7f95600b3e00 comp rx=0 tx=0).stop 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 -- 172.21.15.144:0/1892325897 shutdown_connections 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 --2- 172.21.15.144:0/1892325897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d1000 0x555ac762b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 --2- 172.21.15.144:0/1892325897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d7160 0x555ac75d2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 --2- 172.21.15.144:0/1892325897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d6080 0x555ac75d2600 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 -- 172.21.15.144:0/1892325897 >> 172.21.15.144:0/1892325897 conn(0x555ac75d5ca0 msgr2=0x555ac7619c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 -- 172.21.15.144:0/1892325897 shutdown_connections 2024-09-12T12:16:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.866+0000 7f9567ecb000 1 -- 172.21.15.144:0/1892325897 wait complete. 2024-09-12T12:16:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 -- start start 2024-09-12T12:16:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 Processor -- start 2024-09-12T12:16:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac762e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d6080 0x555ac768cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d7160 0x555ac768d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555ac73eb520 con 0x555ac75d1000 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f95601fece0 con 0x555ac75d6080 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555ac741de30 con 0x555ac75d7160 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 10 client.0 _ll_register_callbacks cb 0x7f954c001480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac762e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac762e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34952/0 (socket says 172.21.15.144:34952) 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955de00640 1 -- 172.21.15.144:0/3793767007 learned_addr learned my addr 172.21.15.144:0/3793767007 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955d400640 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d6080 0x555ac768cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955e800640 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d7160 0x555ac768d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955de00640 1 -- 172.21.15.144:0/3793767007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d7160 msgr2=0x555ac768d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955de00640 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d7160 0x555ac768d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955de00640 1 -- 172.21.15.144:0/3793767007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d6080 msgr2=0x555ac768cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955de00640 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d6080 0x555ac768cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955de00640 1 -- 172.21.15.144:0/3793767007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ac74a1330 con 0x555ac75d1000 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955d400640 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d6080 0x555ac768cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955de00640 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac762e8b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f955000c210 tx=0x7f95500198f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8819243ab4d0bf8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f953f400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f953f400640 1 -- 172.21.15.144:0/3793767007 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95500a6cd0 con 0x555ac75d1000 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f953f400640 1 -- 172.21.15.144:0/3793767007 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f95500a6e70 con 0x555ac75d1000 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 -- 172.21.15.144:0/3793767007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95500a9070 con 0x555ac75d1000 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f953f400640 1 -- 172.21.15.144:0/3793767007 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f95500d8050 con 0x555ac75d1000 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 10 client.6516 fetch_fsmap learned FSMap version 46 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 -- 172.21.15.144:0/3793767007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x555ac70d9400 con 0x555ac75d1000 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f953f400640 1 -- 172.21.15.144:0/3793767007 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95500a9070 con 0x555ac75d1000 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f953f400640 1 -- 172.21.15.144:0/3793767007 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f95500db020 con 0x555ac75d1000 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 10 client.6516 fetch_fsmap finished waiting for FSMap version 46 2024-09-12T12:16:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 10 client.6516 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 20 client.6516 populate_metadata read hostname 'smithi144' 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x555ac761a840 0x555ac7649bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 4 client.6516 mds_command: new command op to 6438 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f9567ecb000 1 -- 172.21.15.144:0/3793767007 --> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x555ac742c250 con 0x555ac761a840 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955d400640 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x555ac761a840 0x555ac7649bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f955d400640 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x555ac761a840 0x555ac7649bd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9782126ddb0a04c0 server_cookie=4c8c2d1bdb9bb336 in_seq=0 out_seq=0 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.870+0000 7f953f400640 10 client.6516 ms_handle_connect on v2:172.21.15.144:6834/3811906714 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f953f400640 1 -- 172.21.15.144:0/3793767007 <== mds.0 v2:172.21.15.144:6834/3811906714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555ac742c250 con 0x555ac761a840 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f953f400640 10 client.6516 handle_command_reply: tid=0 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 client.6516 shutdown 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 -- 172.21.15.144:0/3793767007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 msgr2=0x555ac762e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac762e8b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f955000c210 tx=0x7f95500198f0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 -- 172.21.15.144:0/3793767007 shutdown_connections 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.144:6834/3811906714,v1:172.21.15.144:6835/3811906714] conn(0x555ac761a840 0x555ac7649bd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555ac75d7160 0x555ac768d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555ac75d6080 0x555ac768cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 --2- 172.21.15.144:0/3793767007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ac75d1000 0x555ac762e8b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f953f400640 0 client.6516 ms_handle_reset on v2:172.21.15.144:6834/3811906714 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 -- 172.21.15.144:0/3793767007 >> 172.21.15.144:0/3793767007 conn(0x555ac75d5ca0 msgr2=0x555ac75d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 -- 172.21.15.144:0/3793767007 shutdown_connections 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 1 -- 172.21.15.144:0/3793767007 wait complete. 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9567ecb000 20 client.6516 trim_cache size 0 max 16384 2024-09-12T12:16:42.880 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:16:42.881 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:16:42.881 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "5ac8b294-a824-4b42-9afa-a8fe3d0e2621", 2024-09-12T12:16:42.881 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:16:42.881 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 -- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95400678f0 msgr2=0x7f9540069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95400678f0 0x7f9540069db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f95500ab000 tx=0x7f95500b1040 comp rx=0 tx=0).stop 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 -- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9560150060 msgr2=0x7f9560157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9560150060 0x7f9560157bd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9558007d10 tx=0x7f95580115a0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 -- 172.21.15.144:0/2494935854 shutdown_connections 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95400678f0 0x7f9540069db0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9560150060 0x7f9560157bd0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9560148cf0 0x7f956014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 --2- 172.21.15.144:0/2494935854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95440039f0 0x7f95601552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 -- 172.21.15.144:0/2494935854 >> 172.21.15.144:0/2494935854 conn(0x7f956006bc10 msgr2=0x7f95600d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:42.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 -- 172.21.15.144:0/2494935854 shutdown_connections 2024-09-12T12:16:42.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:42.874+0000 7f9564a00640 1 -- 172.21.15.144:0/2494935854 wait complete. 2024-09-12T12:16:42.899 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:43.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.030+0000 7f4f35600640 1 Processor -- start 2024-09-12T12:16:43.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.030+0000 7f4f35600640 1 -- start start 2024-09-12T12:16:43.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f35600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4f300b5fb0 0x7f4f30167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f35600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f300cd870 con 0x7f4f3015cd30 2024-09-12T12:16:43.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f35600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f300cdb50 con 0x7f4f3015c7b0 2024-09-12T12:16:43.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f35600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4f30072a50 con 0x7f4f300b5fb0 2024-09-12T12:16:43.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f27e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4f3015cd30 0x7f4f300b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34654/0 (socket says 172.21.15.144:34654) 2024-09-12T12:16:43.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f27e00640 1 -- 172.21.15.144:0/2017073363 learned_addr learned my addr 172.21.15.144:0/2017073363 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:43.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f2f400640 1 --2- 172.21.15.144:0/2017073363 >> v2:172.21.15.165:3300/0 conn(0x7f4f300b5fb0 0x7f4f30167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f2e000640 1 -- 172.21.15.144:0/2017073363 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073402955 0 0) 0x7f4f300cd870 con 0x7f4f3015cd30 2024-09-12T12:16:43.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f2e000640 1 -- 172.21.15.144:0/2017073363 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f14003530 con 0x7f4f3015cd30 2024-09-12T12:16:43.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f2e000640 1 -- 172.21.15.144:0/2017073363 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996917383 0 0) 0x7f4f300cdb50 con 0x7f4f3015c7b0 2024-09-12T12:16:43.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f2e000640 1 -- 172.21.15.144:0/2017073363 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f300cd870 con 0x7f4f3015c7b0 2024-09-12T12:16:43.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f2f400640 1 -- 172.21.15.144:0/2017073363 >> v1:172.21.15.165:6789/0 conn(0x7f4f3015c7b0 legacy=0x7f4f300ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f2f400640 1 -- 172.21.15.144:0/2017073363 >> v1:172.21.15.144:6789/0 conn(0x7f4f3015cd30 legacy=0x7f4f300b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.034+0000 7f4f2f400640 1 -- 172.21.15.144:0/2017073363 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f300726e0 con 0x7f4f300b5fb0 2024-09-12T12:16:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f2f400640 1 --2- 172.21.15.144:0/2017073363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f300b5fb0 0x7f4f30167310 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009d90 tx=0x7f4f2801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fe381e4233de91a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f2e000640 1 -- 172.21.15.144:0/2017073363 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f280b2070 con 0x7f4f300b5fb0 2024-09-12T12:16:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f2e000640 1 -- 172.21.15.144:0/2017073363 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f280a5830 con 0x7f4f300b5fb0 2024-09-12T12:16:43.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f2e000640 1 -- 172.21.15.144:0/2017073363 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f280a5be0 con 0x7f4f300b5fb0 2024-09-12T12:16:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f35600640 1 -- 172.21.15.144:0/2017073363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f300b5fb0 msgr2=0x7f4f30167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f35600640 1 --2- 172.21.15.144:0/2017073363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f300b5fb0 0x7f4f30167310 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009d90 tx=0x7f4f2801c970 comp rx=0 tx=0).stop 2024-09-12T12:16:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f35600640 1 -- 172.21.15.144:0/2017073363 shutdown_connections 2024-09-12T12:16:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f35600640 1 --2- 172.21.15.144:0/2017073363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f300b5fb0 0x7f4f30167310 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f35600640 1 -- 172.21.15.144:0/2017073363 >> 172.21.15.144:0/2017073363 conn(0x7f4f3006d0d0 msgr2=0x7f4f3006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f35600640 1 -- 172.21.15.144:0/2017073363 shutdown_connections 2024-09-12T12:16:43.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f35600640 1 -- 172.21.15.144:0/2017073363 wait complete. 2024-09-12T12:16:43.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f35600640 1 Processor -- start 2024-09-12T12:16:43.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.038+0000 7f4f35600640 1 -- start start 2024-09-12T12:16:43.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f35600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f300b5fb0 0x7f4f3014d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f35600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f3015c7b0 0x7f4f300b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f35600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3015cd30 0x7f4f300cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f35600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3016a690 con 0x7f4f3015cd30 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f35600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4f300cd610 con 0x7f4f3015c7b0 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f35600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4f3016a810 con 0x7f4f300b5fb0 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3015cd30 0x7f4f300cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3015cd30 0x7f4f300cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34958/0 (socket says 172.21.15.144:34958) 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2f400640 1 -- 172.21.15.144:0/3293838181 learned_addr learned my addr 172.21.15.144:0/3293838181 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2f400640 1 -- 172.21.15.144:0/3293838181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f300b5fb0 msgr2=0x7f4f3014d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2ea00640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f300b5fb0 0x7f4f3014d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f27e00640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f3015c7b0 0x7f4f300b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2f400640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f300b5fb0 0x7f4f3014d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2f400640 1 -- 172.21.15.144:0/3293838181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f3015c7b0 msgr2=0x7f4f300b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2f400640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f3015c7b0 0x7f4f300b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2f400640 1 -- 172.21.15.144:0/3293838181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f300b4060 con 0x7f4f3015cd30 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f27e00640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f3015c7b0 0x7f4f300b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f2f400640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3015cd30 0x7f4f300cebd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4f280b0040 tx=0x7f4f28019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f26a00640 1 -- 172.21.15.144:0/3293838181 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f280b2050 con 0x7f4f3015cd30 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f26a00640 1 -- 172.21.15.144:0/3293838181 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f280be070 con 0x7f4f3015cd30 2024-09-12T12:16:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f300b4340 con 0x7f4f3015cd30 2024-09-12T12:16:43.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f26a00640 1 -- 172.21.15.144:0/3293838181 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f28004450 con 0x7f4f3015cd30 2024-09-12T12:16:43.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f300b4900 con 0x7f4f3015cd30 2024-09-12T12:16:43.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f300ccf00 con 0x7f4f3015cd30 2024-09-12T12:16:43.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.042+0000 7f4f26a00640 1 -- 172.21.15.144:0/3293838181 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f280045f0 con 0x7f4f3015cd30 2024-09-12T12:16:43.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.046+0000 7f4f26a00640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f0c0678c0 0x7f4f0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.046+0000 7f4f26a00640 1 -- 172.21.15.144:0/3293838181 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f4f28121350 con 0x7f4f3015cd30 2024-09-12T12:16:43.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.046+0000 7f4f2ea00640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f0c0678c0 0x7f4f0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.046+0000 7f4f2ea00640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f0c0678c0 0x7f4f0c069d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4f30156270 tx=0x7f4f20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:43.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.050+0000 7f4f26a00640 1 -- 172.21.15.144:0/3293838181 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f28016560 con 0x7f4f3015cd30 2024-09-12T12:16:43.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f3015eb90 con 0x7f4f3015cd30 2024-09-12T12:16:43.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f26a00640 1 -- 172.21.15.144:0/3293838181 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5231 (secure 0 0 0) 0x7f4f280f1c10 con 0x7f4f3015cd30 2024-09-12T12:16:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-12T12:16:39:885036+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:39.885031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6438,"qdb_cluster":[6438]},"id":4}]} 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f0c0678c0 msgr2=0x7f4f0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f0c0678c0 0x7f4f0c069d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4f30156270 tx=0x7f4f20009040 comp rx=0 tx=0).stop 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3015cd30 msgr2=0x7f4f300cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3015cd30 0x7f4f300cebd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4f280b0040 tx=0x7f4f28019710 comp rx=0 tx=0).stop 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 shutdown_connections 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f0c0678c0 0x7f4f0c069d80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f3015cd30 0x7f4f300cebd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f3015c7b0 0x7f4f300b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 --2- 172.21.15.144:0/3293838181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f300b5fb0 0x7f4f3014d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 >> 172.21.15.144:0/3293838181 conn(0x7f4f3006d0d0 msgr2=0x7f4f301571a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 shutdown_connections 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:43.242+0000 7f4f35600640 1 -- 172.21.15.144:0/3293838181 wait complete. 2024-09-12T12:16:43.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-12T12:16:43.424 INFO:teuthology.orchestra.run.smithi144.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-12T12:16:33.747012+0000","btime":"2024-09-12T12:16:32.871022+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T12:16:33.747012+0000","atime":"2024-09-12T12:16:32.871022+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-12T12:16:33.747012+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:16:33.747012+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:16:33.747012+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":2,"authpin":0,"scrubqueue":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-12T12:16:43.425 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-12T12:16:33.747012+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-12T12:16:32.871022+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-12T12:16:32.871022+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-12T12:16:33.747012+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-12T12:16:33.747012+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-12T12:16:33.747012+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-12T12:16:33.747012+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-12T12:16:43.425 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-12T12:16:48.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:48.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.570+0000 7f78b4200640 1 Processor -- start 2024-09-12T12:16:48.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.570+0000 7f78b4200640 1 -- start start 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b4200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f78ac15b4e0 0x7f78ac0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b4200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78ac0b3ad0 0x7f78ac071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b4200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78ac0b45a0 con 0x7f78ac071960 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b4200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac0b3fe0 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b4200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac0b42c0 con 0x7f78ac15b4e0 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78ac0b3ad0 0x7f78ac071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78ac0b3ad0 0x7f78ac071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47256/0 (socket says 172.21.15.144:47256) 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b0e00640 1 -- 172.21.15.144:0/2603450787 learned_addr learned my addr 172.21.15.144:0/2603450787 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b1800640 1 --2- 172.21.15.144:0/2603450787 >> v2:172.21.15.165:3300/0 conn(0x7f78ac15b4e0 0x7f78ac0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:48.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b0e00640 1 -- 172.21.15.144:0/2603450787 >> v2:172.21.15.165:3300/0 conn(0x7f78ac15b4e0 msgr2=0x7f78ac0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:48.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b0e00640 1 --2- 172.21.15.144:0/2603450787 >> v2:172.21.15.165:3300/0 conn(0x7f78ac15b4e0 0x7f78ac0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b0e00640 1 -- 172.21.15.144:0/2603450787 >> v1:172.21.15.144:6789/0 conn(0x7f78ac071960 legacy=0x7f78ac0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:48.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.574+0000 7f78b0e00640 1 -- 172.21.15.144:0/2603450787 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac0b1490 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b0e00640 1 --2- 172.21.15.144:0/2603450787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 0x7f78ac071420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f78ac069450 tx=0x7f789801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afc0126616fb805 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:48.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78abe00640 1 -- 172.21.15.144:0/2603450787 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78980aa670 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78abe00640 1 -- 172.21.15.144:0/2603450787 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78980af070 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78abe00640 1 -- 172.21.15.144:0/2603450787 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78980aaa30 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 -- 172.21.15.144:0/2603450787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 msgr2=0x7f78ac071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:48.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 --2- 172.21.15.144:0/2603450787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 0x7f78ac071420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f78ac069450 tx=0x7f789801c4f0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 -- 172.21.15.144:0/2603450787 shutdown_connections 2024-09-12T12:16:48.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 --2- 172.21.15.144:0/2603450787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 0x7f78ac071420 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 --2- 172.21.15.144:0/2603450787 >> v2:172.21.15.165:3300/0 conn(0x7f78ac15b4e0 0x7f78ac0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 -- 172.21.15.144:0/2603450787 >> 172.21.15.144:0/2603450787 conn(0x7f78ac06d0d0 msgr2=0x7f78ac06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:48.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 -- 172.21.15.144:0/2603450787 shutdown_connections 2024-09-12T12:16:48.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 -- 172.21.15.144:0/2603450787 wait complete. 2024-09-12T12:16:48.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 Processor -- start 2024-09-12T12:16:48.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.578+0000 7f78b4200640 1 -- start start 2024-09-12T12:16:48.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78ac071960 0x7f78ac152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:48.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b4200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 0x7f78ac1644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:48.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b4200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78ac15b4e0 0x7f78ac15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:48.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b4200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac0b2620 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b4200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac0b24a0 con 0x7f78ac15b4e0 2024-09-12T12:16:48.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac0cd640 con 0x7f78ac071960 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 0x7f78ac1644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 0x7f78ac1644a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47264/0 (socket says 172.21.15.144:47264) 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b0e00640 1 -- 172.21.15.144:0/2997818432 learned_addr learned my addr 172.21.15.144:0/2997818432 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b1800640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78ac071960 0x7f78ac152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b2200640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78ac15b4e0 0x7f78ac15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b0e00640 1 -- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78ac071960 msgr2=0x7f78ac152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b0e00640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78ac071960 0x7f78ac152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b0e00640 1 -- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78ac15b4e0 msgr2=0x7f78ac15bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b0e00640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78ac15b4e0 0x7f78ac15bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b0e00640 1 -- 172.21.15.144:0/2997818432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac1602a0 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b1800640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78ac071960 0x7f78ac152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b2200640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78ac15b4e0 0x7f78ac15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b0e00640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 0x7f78ac1644a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7898019100 tx=0x7f789801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:48.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78a9600640 1 -- 172.21.15.144:0/2997818432 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78980bd5f0 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78a9600640 1 -- 172.21.15.144:0/2997818432 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78980bd790 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ac1f7650 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78a9600640 1 -- 172.21.15.144:0/2997818432 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78980bdb40 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac1651f0 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ac071420 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.582+0000 7f78a9600640 1 -- 172.21.15.144:0/2997818432 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78980b33f0 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.586+0000 7f78a9600640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f788c0678c0 0x7f788c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:48.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.586+0000 7f78a9600640 1 -- 172.21.15.144:0/2997818432 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f7898120fd0 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.586+0000 7f78b1800640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f788c0678c0 0x7f788c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:48.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.586+0000 7f78b1800640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f788c0678c0 0x7f788c069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009f50 tx=0x7f78a000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:48.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.590+0000 7f78a9600640 1 -- 172.21.15.144:0/2997818432 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f78980c3060 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.778+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78ac0b5180 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78a9600640 1 -- 172.21.15.144:0/2997818432 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5231 (secure 0 0 0) 0x7f7898016110 con 0x7f78ac0b3ad0 2024-09-12T12:16:48.784 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:48.784 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-12T12:16:39:885036+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:39.885031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6438,"qdb_cluster":[6438]},"id":4}]} 2024-09-12T12:16:48.784 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f788c0678c0 msgr2=0x7f788c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f788c0678c0 0x7f788c069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009f50 tx=0x7f78a000b040 comp rx=0 tx=0).stop 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 msgr2=0x7f78ac1644a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 0x7f78ac1644a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7898019100 tx=0x7f789801ad30 comp rx=0 tx=0).stop 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 shutdown_connections 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f788c0678c0 0x7f788c069d80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78ac15b4e0 0x7f78ac15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78ac0b3ad0 0x7f78ac1644a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 --2- 172.21.15.144:0/2997818432 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78ac071960 0x7f78ac152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 >> 172.21.15.144:0/2997818432 conn(0x7f78ac06d0d0 msgr2=0x7f78ac15f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:48.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 shutdown_connections 2024-09-12T12:16:48.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:48.782+0000 7f78b4200640 1 -- 172.21.15.144:0/2997818432 wait complete. 2024-09-12T12:16:48.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-12T12:16:48.960 INFO:teuthology.orchestra.run.smithi144.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-12T12:16:33.747012+0000","btime":"2024-09-12T12:16:32.871022+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T12:16:33.747012+0000","atime":"2024-09-12T12:16:32.871022+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-12T12:16:33.747012+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:16:33.747012+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:16:33.747012+0000"},"version":247,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-12T12:16:42.879343+0000","last_scrub_version":244,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-12T12:16:48.961 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-12T12:16:33.747012+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-12T12:16:32.871022+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-12T12:16:32.871022+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-12T12:16:33.747012+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-12T12:16:33.747012+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-12T12:16:42.879343+0000", "last_scrub_version": 244, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-12T12:16:33.747012+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-12T12:16:33.747012+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 247, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-12T12:16:48.961 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T12:16:48.961 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:16:48.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:16:49.057 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:16:49.141 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:16:49.142 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:16:49.142 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:49.142 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:49.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:16:49.151 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:16:49.151 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:16:49.151 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:49.160 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:16:49.160 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:16:49.160 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:49.160 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:49.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:16:49.199 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:16:49.199 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:16:49.199 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:49.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:16:49.215 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:49.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb6c00640 1 Processor -- start 2024-09-12T12:16:49.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb6c00640 1 -- start start 2024-09-12T12:16:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb6c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb015e4a0 0x7f8fb0161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb6c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8fb00d2e10 0x7f8fb00737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb6c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb0162720 con 0x7f8fb00b67c0 2024-09-12T12:16:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb6c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb0073310 con 0x7f8fb00d2e10 2024-09-12T12:16:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb6c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb0162a00 con 0x7f8fb015e4a0 2024-09-12T12:16:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb4e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8fb00d2e10 0x7f8fb00737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb5800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb015e4a0 0x7f8fb0161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb5800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb015e4a0 0x7f8fb0161e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:37840/0 (socket says 172.21.15.144:37840) 2024-09-12T12:16:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb5800640 1 -- 172.21.15.144:0/743379583 learned_addr learned my addr 172.21.15.144:0/743379583 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb4e00640 1 -- 172.21.15.144:0/743379583 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb015e4a0 msgr2=0x7f8fb0161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb4e00640 1 --2- 172.21.15.144:0/743379583 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb015e4a0 0x7f8fb0161e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb4e00640 1 -- 172.21.15.144:0/743379583 >> v1:172.21.15.165:6789/0 conn(0x7f8fb00b67c0 legacy=0x7f8fb00b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.378+0000 7f8fb4e00640 1 -- 172.21.15.144:0/743379583 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb0162ce0 con 0x7f8fb00d2e10 2024-09-12T12:16:49.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fb4e00640 1 --2- 172.21.15.144:0/743379583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8fb00d2e10 0x7f8fb00737a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0097c0 tx=0x7f8f9c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcd5122f9de9a75b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fafe00640 1 -- 172.21.15.144:0/743379583 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0b1070 con 0x7f8fb00d2e10 2024-09-12T12:16:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fafe00640 1 -- 172.21.15.144:0/743379583 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0ac410 con 0x7f8fb00d2e10 2024-09-12T12:16:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fafe00640 1 -- 172.21.15.144:0/743379583 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0ac7e0 con 0x7f8fb00d2e10 2024-09-12T12:16:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fb6c00640 1 -- 172.21.15.144:0/743379583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8fb00d2e10 msgr2=0x7f8fb00737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fb6c00640 1 --2- 172.21.15.144:0/743379583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8fb00d2e10 0x7f8fb00737a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0097c0 tx=0x7f8f9c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fb6c00640 1 -- 172.21.15.144:0/743379583 shutdown_connections 2024-09-12T12:16:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fb6c00640 1 --2- 172.21.15.144:0/743379583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8fb00d2e10 0x7f8fb00737a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fb6c00640 1 --2- 172.21.15.144:0/743379583 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb015e4a0 0x7f8fb0161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fb6c00640 1 -- 172.21.15.144:0/743379583 >> 172.21.15.144:0/743379583 conn(0x7f8fb00d2280 msgr2=0x7f8fb00d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:49.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fb6c00640 1 -- 172.21.15.144:0/743379583 shutdown_connections 2024-09-12T12:16:49.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.382+0000 7f8fb6c00640 1 -- 172.21.15.144:0/743379583 wait complete. 2024-09-12T12:16:49.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 Processor -- start 2024-09-12T12:16:49.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 -- start start 2024-09-12T12:16:49.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb00b67c0 0x7f8fb014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8fb00d2e10 0x7f8fb00d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb015e4a0 0x7f8fb00d1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb006d6b0 con 0x7f8fb015e4a0 2024-09-12T12:16:49.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb006d530 con 0x7f8fb00d2e10 2024-09-12T12:16:49.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb016b000 con 0x7f8fb00b67c0 2024-09-12T12:16:49.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb015e4a0 0x7f8fb00d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb015e4a0 0x7f8fb00d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47278/0 (socket says 172.21.15.144:47278) 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6200640 1 -- 172.21.15.144:0/3897068218 learned_addr learned my addr 172.21.15.144:0/3897068218 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb5800640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb00b67c0 0x7f8fb014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb4e00640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8fb00d2e10 0x7f8fb00d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6200640 1 -- 172.21.15.144:0/3897068218 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb00b67c0 msgr2=0x7f8fb014b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6200640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb00b67c0 0x7f8fb014b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6200640 1 -- 172.21.15.144:0/3897068218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8fb00d2e10 msgr2=0x7f8fb00d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6200640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8fb00d2e10 0x7f8fb00d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6200640 1 -- 172.21.15.144:0/3897068218 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb00d1890 con 0x7f8fb015e4a0 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6200640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb015e4a0 0x7f8fb00d1000 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c730 tx=0x7f8fa800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fad600640 1 -- 172.21.15.144:0/3897068218 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8003b80 con 0x7f8fb015e4a0 2024-09-12T12:16:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fad600640 1 -- 172.21.15.144:0/3897068218 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa8003d20 con 0x7f8fb015e4a0 2024-09-12T12:16:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb01613e0 con 0x7f8fb015e4a0 2024-09-12T12:16:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fad600640 1 -- 172.21.15.144:0/3897068218 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8005310 con 0x7f8fb015e4a0 2024-09-12T12:16:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb01619a0 con 0x7f8fb015e4a0 2024-09-12T12:16:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.386+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb00737a0 con 0x7f8fb015e4a0 2024-09-12T12:16:49.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.390+0000 7f8fad600640 1 -- 172.21.15.144:0/3897068218 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8fa80056c0 con 0x7f8fb015e4a0 2024-09-12T12:16:49.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.390+0000 7f8fad600640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f900678f0 0x7f8f90069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.390+0000 7f8fad600640 1 -- 172.21.15.144:0/3897068218 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f8fa8085dc0 con 0x7f8fb015e4a0 2024-09-12T12:16:49.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.390+0000 7f8fb5800640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f900678f0 0x7f8f90069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.390+0000 7f8fb5800640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f900678f0 0x7f8f90069db0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8fb015b8e0 tx=0x7f8fa4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:49.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.394+0000 7f8fad600640 1 -- 172.21.15.144:0/3897068218 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8fa8056030 con 0x7f8fb015e4a0 2024-09-12T12:16:49.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.586+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fb00d1540 con 0x7f8fb015e4a0 2024-09-12T12:16:49.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.586+0000 7f8fad600640 1 -- 172.21.15.144:0/3897068218 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5231 (secure 0 0 0) 0x7f8fa805a330 con 0x7f8fb015e4a0 2024-09-12T12:16:49.590 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:49.590 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-12T12:16:39:885036+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:39.885031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6438,"qdb_cluster":[6438]},"id":4}]} 2024-09-12T12:16:49.591 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-12T12:16:49.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f900678f0 msgr2=0x7f8f90069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f900678f0 0x7f8f90069db0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8fb015b8e0 tx=0x7f8fa4009240 comp rx=0 tx=0).stop 2024-09-12T12:16:49.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb015e4a0 msgr2=0x7f8fb00d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb015e4a0 0x7f8fb00d1000 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c730 tx=0x7f8fa800cbf0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 shutdown_connections 2024-09-12T12:16:49.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f900678f0 0x7f8f90069db0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb015e4a0 0x7f8fb00d1000 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8fb00d2e10 0x7f8fb00d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 --2- 172.21.15.144:0/3897068218 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8fb00b67c0 0x7f8fb014b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 >> 172.21.15.144:0/3897068218 conn(0x7f8fb00d2280 msgr2=0x7f8fb00d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:49.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 shutdown_connections 2024-09-12T12:16:49.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.590+0000 7f8fb6c00640 1 -- 172.21.15.144:0/3897068218 wait complete. 2024-09-12T12:16:49.612 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:49.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.746+0000 7f5c94000640 1 Processor -- start 2024-09-12T12:16:49.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.746+0000 7f5c94000640 1 -- start start 2024-09-12T12:16:49.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.746+0000 7f5c94000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5c8c15b4e0 0x7f5c8c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.746+0000 7f5c94000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8c0b45a0 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.746+0000 7f5c94000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8c0b3fe0 con 0x7f5c8c0b3ad0 2024-09-12T12:16:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.746+0000 7f5c94000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5c8c0b42c0 con 0x7f5c8c15b4e0 2024-09-12T12:16:49.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.746+0000 7f5c92000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5c8c0ccf30 0x7f5c8c0b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37470/0 (socket says 172.21.15.144:37470) 2024-09-12T12:16:49.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.746+0000 7f5c92000640 1 -- 172.21.15.144:0/1482224018 learned_addr learned my addr 172.21.15.144:0/1482224018 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:49.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.746+0000 7f5c91600640 1 --2- 172.21.15.144:0/1482224018 >> v2:172.21.15.165:3300/0 conn(0x7f5c8c15b4e0 0x7f5c8c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c8be00640 1 -- 172.21.15.144:0/1482224018 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145533139 0 0) 0x7f5c8c0b45a0 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c8be00640 1 -- 172.21.15.144:0/1482224018 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c74003530 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c8be00640 1 -- 172.21.15.144:0/1482224018 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045600448 0 0) 0x7f5c8c0b3fe0 con 0x7f5c8c0b3ad0 2024-09-12T12:16:49.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c8be00640 1 -- 172.21.15.144:0/1482224018 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c8c0b45a0 con 0x7f5c8c0b3ad0 2024-09-12T12:16:49.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c91600640 1 -- 172.21.15.144:0/1482224018 >> v1:172.21.15.165:6789/0 conn(0x7f5c8c0b3ad0 legacy=0x7f5c8c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c91600640 1 -- 172.21.15.144:0/1482224018 >> v1:172.21.15.144:6789/0 conn(0x7f5c8c0ccf30 legacy=0x7f5c8c0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c8be00640 1 -- 172.21.15.144:0/1482224018 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1132445534 0 0) 0x7f5c74003530 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c91600640 1 -- 172.21.15.144:0/1482224018 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8c0b1490 con 0x7f5c8c15b4e0 2024-09-12T12:16:49.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c91600640 1 --2- 172.21.15.144:0/1482224018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c8c15b4e0 0x7f5c8c0b3590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009d90 tx=0x7f5c8001c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=274073b253d63303 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:49.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c8be00640 1 -- 172.21.15.144:0/1482224018 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c800b2070 con 0x7f5c8c15b4e0 2024-09-12T12:16:49.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c8be00640 1 -- 172.21.15.144:0/1482224018 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c800a5600 con 0x7f5c8c15b4e0 2024-09-12T12:16:49.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.750+0000 7f5c8be00640 1 -- 172.21.15.144:0/1482224018 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c84001680 con 0x7f5c8c15b4e0 2024-09-12T12:16:49.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 -- 172.21.15.144:0/1482224018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c8c15b4e0 msgr2=0x7f5c8c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 --2- 172.21.15.144:0/1482224018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c8c15b4e0 0x7f5c8c0b3590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c80009d90 tx=0x7f5c8001c860 comp rx=0 tx=0).stop 2024-09-12T12:16:49.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 -- 172.21.15.144:0/1482224018 shutdown_connections 2024-09-12T12:16:49.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 --2- 172.21.15.144:0/1482224018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c8c15b4e0 0x7f5c8c0b3590 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 -- 172.21.15.144:0/1482224018 >> 172.21.15.144:0/1482224018 conn(0x7f5c8c06d0d0 msgr2=0x7f5c8c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:49.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 -- 172.21.15.144:0/1482224018 shutdown_connections 2024-09-12T12:16:49.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 -- 172.21.15.144:0/1482224018 wait complete. 2024-09-12T12:16:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 Processor -- start 2024-09-12T12:16:49.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 -- start start 2024-09-12T12:16:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c8c0b3ad0 0x7f5c8c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c8c0ccf30 0x7f5c8c0ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c8c15b4e0 0x7f5c8c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c15b8c0 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c0cd770 con 0x7f5c8c0b3ad0 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c94000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8c142c40 con 0x7f5c8c15b4e0 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c90c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c8c0ccf30 0x7f5c8c0ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c90c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c8c0ccf30 0x7f5c8c0ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47294/0 (socket says 172.21.15.144:47294) 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c90c00640 1 -- 172.21.15.144:0/231138441 learned_addr learned my addr 172.21.15.144:0/231138441 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c91600640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c8c0b3ad0 0x7f5c8c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c92000640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c8c15b4e0 0x7f5c8c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c90c00640 1 -- 172.21.15.144:0/231138441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c8c15b4e0 msgr2=0x7f5c8c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c90c00640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c8c15b4e0 0x7f5c8c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c90c00640 1 -- 172.21.15.144:0/231138441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c8c0b3ad0 msgr2=0x7f5c8c157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c90c00640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c8c0b3ad0 0x7f5c8c157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.754+0000 7f5c90c00640 1 -- 172.21.15.144:0/231138441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8c0ade00 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c90c00640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c8c0ccf30 0x7f5c8c0ad8c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c490 tx=0x7f5c7800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c89600640 1 -- 172.21.15.144:0/231138441 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c780052d0 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c89600640 1 -- 172.21.15.144:0/231138441 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c78005470 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c89600640 1 -- 172.21.15.144:0/231138441 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78012870 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c8c143070 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c8c1435f0 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c8c0b3590 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c89600640 1 -- 172.21.15.144:0/231138441 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c78012a10 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c89600640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c6c0678f0 0x7f5c6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:49.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c89600640 1 -- 172.21.15.144:0/231138441 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f5c78085ba0 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c91600640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c6c0678f0 0x7f5c6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:49.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.758+0000 7f5c91600640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c6c0678f0 0x7f5c6c069db0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5c800af000 tx=0x7f5c800a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:49.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.762+0000 7f5c89600640 1 -- 172.21.15.144:0/231138441 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5c780563d0 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.954+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c8c073a40 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c89600640 1 -- 172.21.15.144:0/231138441 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5231 (secure 0 0 0) 0x7f5c78055cd0 con 0x7f5c8c0ccf30 2024-09-12T12:16:49.960 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:49.960 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-12T12:16:39:885036+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:39.885031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6438,"qdb_cluster":[6438]},"id":4}]} 2024-09-12T12:16:49.960 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c6c0678f0 msgr2=0x7f5c6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c6c0678f0 0x7f5c6c069db0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5c800af000 tx=0x7f5c800a7070 comp rx=0 tx=0).stop 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c8c0ccf30 msgr2=0x7f5c8c0ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c8c0ccf30 0x7f5c8c0ad8c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c490 tx=0x7f5c7800c950 comp rx=0 tx=0).stop 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 shutdown_connections 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c6c0678f0 0x7f5c6c069db0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c8c15b4e0 0x7f5c8c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c8c0ccf30 0x7f5c8c0ad8c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 --2- 172.21.15.144:0/231138441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c8c0b3ad0 0x7f5c8c157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 >> 172.21.15.144:0/231138441 conn(0x7f5c8c06d0d0 msgr2=0x7f5c8c0721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:49.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 shutdown_connections 2024-09-12T12:16:49.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:49.958+0000 7f5c94000640 1 -- 172.21.15.144:0/231138441 wait complete. 2024-09-12T12:16:49.981 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:16:50.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.114+0000 7f5056c00640 1 Processor -- start 2024-09-12T12:16:50.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.114+0000 7f5056c00640 1 -- start start 2024-09-12T12:16:50.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.114+0000 7f5056c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500d32f0 0x7f50500b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.114+0000 7f5056c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f50500b6650 0x7f50500b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.114+0000 7f5056c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505015ebe0 con 0x7f505015e800 2024-09-12T12:16:50.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.114+0000 7f5056c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f50500cfc90 con 0x7f50500b6650 2024-09-12T12:16:50.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.114+0000 7f5056c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f50500d2e60 con 0x7f50500d32f0 2024-09-12T12:16:50.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.114+0000 7f5047400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500d32f0 0x7f50500b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.118+0000 7f5054c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f50500b6650 0x7f50500b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.118+0000 7f5047400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500d32f0 0x7f50500b6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:37874/0 (socket says 172.21.15.144:37874) 2024-09-12T12:16:50.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.118+0000 7f5047400640 1 -- 172.21.15.144:0/3621556018 learned_addr learned my addr 172.21.15.144:0/3621556018 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:50.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.118+0000 7f5054c00640 1 -- 172.21.15.144:0/3621556018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500d32f0 msgr2=0x7f50500b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:50.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.118+0000 7f5054c00640 1 --2- 172.21.15.144:0/3621556018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500d32f0 0x7f50500b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.118+0000 7f5054c00640 1 -- 172.21.15.144:0/3621556018 >> v1:172.21.15.165:6789/0 conn(0x7f505015e800 legacy=0x7f50500ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.118+0000 7f5054c00640 1 -- 172.21.15.144:0/3621556018 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50500cf9b0 con 0x7f50500b6650 2024-09-12T12:16:50.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f5054c00640 1 --2- 172.21.15.144:0/3621556018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50500b6650 0x7f50500b7720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5048009d90 tx=0x7f504801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=555ca3da94a18ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f504f400640 1 -- 172.21.15.144:0/3621556018 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50480b2070 con 0x7f50500b6650 2024-09-12T12:16:50.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f504f400640 1 -- 172.21.15.144:0/3621556018 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50480a5920 con 0x7f50500b6650 2024-09-12T12:16:50.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f504f400640 1 -- 172.21.15.144:0/3621556018 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50480a5cf0 con 0x7f50500b6650 2024-09-12T12:16:50.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f5056c00640 1 -- 172.21.15.144:0/3621556018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50500b6650 msgr2=0x7f50500b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f5056c00640 1 --2- 172.21.15.144:0/3621556018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50500b6650 0x7f50500b7720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5048009d90 tx=0x7f504801c970 comp rx=0 tx=0).stop 2024-09-12T12:16:50.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f5056c00640 1 -- 172.21.15.144:0/3621556018 shutdown_connections 2024-09-12T12:16:50.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f5056c00640 1 --2- 172.21.15.144:0/3621556018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50500b6650 0x7f50500b7720 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f5056c00640 1 --2- 172.21.15.144:0/3621556018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500d32f0 0x7f50500b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f5056c00640 1 -- 172.21.15.144:0/3621556018 >> 172.21.15.144:0/3621556018 conn(0x7f50500d12e0 msgr2=0x7f50500d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:50.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f5056c00640 1 -- 172.21.15.144:0/3621556018 shutdown_connections 2024-09-12T12:16:50.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.122+0000 7f5056c00640 1 -- 172.21.15.144:0/3621556018 wait complete. 2024-09-12T12:16:50.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 Processor -- start 2024-09-12T12:16:50.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 -- start start 2024-09-12T12:16:50.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500b6650 0x7f50501599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50500d32f0 0x7f505015f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505015e800 0x7f50501f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50500b3d90 con 0x7f50500d32f0 2024-09-12T12:16:50.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f50500cf600 con 0x7f505015e800 2024-09-12T12:16:50.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f50500c83d0 con 0x7f50500b6650 2024-09-12T12:16:50.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5047400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50500d32f0 0x7f505015f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5047400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50500d32f0 0x7f505015f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47300/0 (socket says 172.21.15.144:47300) 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5047400640 1 -- 172.21.15.144:0/1109375050 learned_addr learned my addr 172.21.15.144:0/1109375050 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f504fe00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500b6650 0x7f50501599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5054c00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505015e800 0x7f50501f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5047400640 1 -- 172.21.15.144:0/1109375050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500b6650 msgr2=0x7f50501599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5047400640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500b6650 0x7f50501599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5047400640 1 -- 172.21.15.144:0/1109375050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505015e800 msgr2=0x7f50501f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5047400640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505015e800 0x7f50501f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5047400640 1 -- 172.21.15.144:0/1109375050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5050159ef0 con 0x7f50500d32f0 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5047400640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50500d32f0 0x7f505015f7c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f503800e870 tx=0x7f503800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f504cc00640 1 -- 172.21.15.144:0/1109375050 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038017070 con 0x7f50500d32f0 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f504cc00640 1 -- 172.21.15.144:0/1109375050 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503800c940 con 0x7f50500d32f0 2024-09-12T12:16:50.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505015fd00 con 0x7f50500d32f0 2024-09-12T12:16:50.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f504cc00640 1 -- 172.21.15.144:0/1109375050 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503800cd10 con 0x7f50500d32f0 2024-09-12T12:16:50.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50500c8620 con 0x7f50500d32f0 2024-09-12T12:16:50.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.126+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50500b7720 con 0x7f50500d32f0 2024-09-12T12:16:50.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.130+0000 7f504cc00640 1 -- 172.21.15.144:0/1109375050 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f503801a070 con 0x7f50500d32f0 2024-09-12T12:16:50.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.130+0000 7f504cc00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f502c0678c0 0x7f502c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.130+0000 7f504cc00640 1 -- 172.21.15.144:0/1109375050 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f5038085d30 con 0x7f50500d32f0 2024-09-12T12:16:50.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.130+0000 7f504fe00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f502c0678c0 0x7f502c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.130+0000 7f504fe00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f502c0678c0 0x7f502c069d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f505015e0d0 tx=0x7f5040009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.134+0000 7f504cc00640 1 -- 172.21.15.144:0/1109375050 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5038055fa0 con 0x7f50500d32f0 2024-09-12T12:16:50.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.302+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50500b3920 con 0x7f50500d32f0 2024-09-12T12:16:50.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.302+0000 7f504cc00640 1 -- 172.21.15.144:0/1109375050 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+17336 (secure 0 0 0) 0x7f503805a2a0 con 0x7f50500d32f0 2024-09-12T12:16:50.305 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:50.306 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":71,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:16:35.868861+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:16:17.373953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T12:16:18.661913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.c","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.39","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.165:6835/799094061":"2024-09-13T12:16:35.863459+0000","172.21.15.165:6833/799094061":"2024-09-13T12:16:35.863459+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f502c0678c0 msgr2=0x7f502c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f502c0678c0 0x7f502c069d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f505015e0d0 tx=0x7f5040009040 comp rx=0 tx=0).stop 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50500d32f0 msgr2=0x7f505015f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50500d32f0 0x7f505015f7c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f503800e870 tx=0x7f503800ed30 comp rx=0 tx=0).stop 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 shutdown_connections 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f502c0678c0 0x7f502c069d80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f505015e800 0x7f50501f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50500d32f0 0x7f505015f7c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 --2- 172.21.15.144:0/1109375050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50500b6650 0x7f50501599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 >> 172.21.15.144:0/1109375050 conn(0x7f50500d12e0 msgr2=0x7f505015b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 shutdown_connections 2024-09-12T12:16:50.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.306+0000 7f5056c00640 1 -- 172.21.15.144:0/1109375050 wait complete. 2024-09-12T12:16:50.328 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:16:50.329 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.462+0000 7fd5e2600640 1 Processor -- start 2024-09-12T12:16:50.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.462+0000 7fd5e2600640 1 -- start start 2024-09-12T12:16:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5e2600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd5dc0b4950 0x7fd5dc071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5e2600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc1621a0 con 0x7fd5dc0b6bf0 2024-09-12T12:16:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5e2600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc0b7180 con 0x7fd5dc161c40 2024-09-12T12:16:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5e2600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc0b7460 con 0x7fd5dc0b4950 2024-09-12T12:16:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5d3e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd5dc0b6bf0 0x7fd5dc0b4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37472/0 (socket says 172.21.15.144:37472) 2024-09-12T12:16:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5d3e00640 1 -- 172.21.15.144:0/1331810262 learned_addr learned my addr 172.21.15.144:0/1331810262 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5dbe00640 1 --2- 172.21.15.144:0/1331810262 >> v2:172.21.15.165:3300/0 conn(0x7fd5dc0b4950 0x7fd5dc071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5dbe00640 1 -- 172.21.15.144:0/1331810262 >> v1:172.21.15.165:6789/0 conn(0x7fd5dc161c40 legacy=0x7fd5dc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5dbe00640 1 -- 172.21.15.144:0/1331810262 >> v1:172.21.15.144:6789/0 conn(0x7fd5dc0b6bf0 legacy=0x7fd5dc0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5daa00640 1 -- 172.21.15.144:0/1331810262 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683573197 0 0) 0x7fd5dc1621a0 con 0x7fd5dc0b6bf0 2024-09-12T12:16:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.466+0000 7fd5dbe00640 1 -- 172.21.15.144:0/1331810262 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc0b7740 con 0x7fd5dc0b4950 2024-09-12T12:16:50.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5dbe00640 1 --2- 172.21.15.144:0/1331810262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5dc0b4950 0x7fd5dc071850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009d90 tx=0x7fd5d401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abaec4f30f500489 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5daa00640 1 -- 172.21.15.144:0/1331810262 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40b2070 con 0x7fd5dc0b4950 2024-09-12T12:16:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5daa00640 1 -- 172.21.15.144:0/1331810262 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d40a5940 con 0x7fd5dc0b4950 2024-09-12T12:16:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5daa00640 1 -- 172.21.15.144:0/1331810262 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40a5d10 con 0x7fd5dc0b4950 2024-09-12T12:16:50.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 -- 172.21.15.144:0/1331810262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5dc0b4950 msgr2=0x7fd5dc071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 --2- 172.21.15.144:0/1331810262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5dc0b4950 0x7fd5dc071850 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009d90 tx=0x7fd5d401c970 comp rx=0 tx=0).stop 2024-09-12T12:16:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 -- 172.21.15.144:0/1331810262 shutdown_connections 2024-09-12T12:16:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 --2- 172.21.15.144:0/1331810262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5dc0b4950 0x7fd5dc071850 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 -- 172.21.15.144:0/1331810262 >> 172.21.15.144:0/1331810262 conn(0x7fd5dc06f3c0 msgr2=0x7fd5dc06f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 -- 172.21.15.144:0/1331810262 shutdown_connections 2024-09-12T12:16:50.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 -- 172.21.15.144:0/1331810262 wait complete. 2024-09-12T12:16:50.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 Processor -- start 2024-09-12T12:16:50.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 -- start start 2024-09-12T12:16:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5dc0b4950 0x7fd5dc157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5dc0b6bf0 0x7fd5dc154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5dc161c40 0x7fd5dc1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc16c400 con 0x7fd5dc161c40 2024-09-12T12:16:50.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc16c280 con 0x7fd5dc0b4950 2024-09-12T12:16:50.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.470+0000 7fd5e2600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc16c580 con 0x7fd5dc0b6bf0 2024-09-12T12:16:50.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5dbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5dc161c40 0x7fd5dc1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5dbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5dc161c40 0x7fd5dc1542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47308/0 (socket says 172.21.15.144:47308) 2024-09-12T12:16:50.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5dbe00640 1 -- 172.21.15.144:0/2836211113 learned_addr learned my addr 172.21.15.144:0/2836211113 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:50.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5db400640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5dc0b4950 0x7fd5dc157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5d3e00640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5dc0b6bf0 0x7fd5dc154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5dbe00640 1 -- 172.21.15.144:0/2836211113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5dc0b6bf0 msgr2=0x7fd5dc154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5dbe00640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5dc0b6bf0 0x7fd5dc154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5dbe00640 1 -- 172.21.15.144:0/2836211113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5dc0b4950 msgr2=0x7fd5dc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5dbe00640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5dc0b4950 0x7fd5dc157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5dbe00640 1 -- 172.21.15.144:0/2836211113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc161570 con 0x7fd5dc161c40 2024-09-12T12:16:50.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5dbe00640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5dc161c40 0x7fd5dc1542e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40b0040 tx=0x7fd5d4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5d3400640 1 -- 172.21.15.144:0/2836211113 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40b2050 con 0x7fd5dc161c40 2024-09-12T12:16:50.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5d3400640 1 -- 172.21.15.144:0/2836211113 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d40b3040 con 0x7fd5dc161c40 2024-09-12T12:16:50.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc160b30 con 0x7fd5dc161c40 2024-09-12T12:16:50.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5d3400640 1 -- 172.21.15.144:0/2836211113 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4003da0 con 0x7fd5dc161c40 2024-09-12T12:16:50.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc154820 con 0x7fd5dc161c40 2024-09-12T12:16:50.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.474+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc071850 con 0x7fd5dc161c40 2024-09-12T12:16:50.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.478+0000 7fd5d3400640 1 -- 172.21.15.144:0/2836211113 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5d40c1060 con 0x7fd5dc161c40 2024-09-12T12:16:50.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.478+0000 7fd5d3400640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5b80678c0 0x7fd5b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.478+0000 7fd5d3400640 1 -- 172.21.15.144:0/2836211113 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7fd5d411ff20 con 0x7fd5dc161c40 2024-09-12T12:16:50.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.478+0000 7fd5db400640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5b80678c0 0x7fd5b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.478+0000 7fd5db400640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5b80678c0 0x7fd5b8069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0cdc00 tx=0x7fd5cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.482+0000 7fd5d3400640 1 -- 172.21.15.144:0/2836211113 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd5d4016560 con 0x7fd5dc161c40 2024-09-12T12:16:50.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5dc0d2270 con 0x7fd5dc161c40 2024-09-12T12:16:50.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5d3400640 1 -- 172.21.15.144:0/2836211113 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5231 (secure 0 0 0) 0x7fd5d40f0230 con 0x7fd5dc161c40 2024-09-12T12:16:50.682 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:50.682 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-12T12:16:39:885036+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:39.885031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6438,"qdb_cluster":[6438]},"id":4}]} 2024-09-12T12:16:50.682 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-12T12:16:50.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5b80678c0 msgr2=0x7fd5b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5b80678c0 0x7fd5b8069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0cdc00 tx=0x7fd5cc009040 comp rx=0 tx=0).stop 2024-09-12T12:16:50.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5dc161c40 msgr2=0x7fd5dc1542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5dc161c40 0x7fd5dc1542e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40b0040 tx=0x7fd5d4019710 comp rx=0 tx=0).stop 2024-09-12T12:16:50.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 shutdown_connections 2024-09-12T12:16:50.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5b80678c0 0x7fd5b8069d80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5dc161c40 0x7fd5dc1542e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5dc0b6bf0 0x7fd5dc154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 --2- 172.21.15.144:0/2836211113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5dc0b4950 0x7fd5dc157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.678+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 >> 172.21.15.144:0/2836211113 conn(0x7fd5dc06f3c0 msgr2=0x7fd5dc0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:50.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.682+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 shutdown_connections 2024-09-12T12:16:50.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.682+0000 7fd5e2600640 1 -- 172.21.15.144:0/2836211113 wait complete. 2024-09-12T12:16:50.703 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.834+0000 7f9de2200640 1 Processor -- start 2024-09-12T12:16:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.834+0000 7f9de2200640 1 -- start start 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9de2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ddc15c7b0 0x7f9ddc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9de2200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9ddc15cd30 0x7f9ddc0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9de2200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ddc0b61e0 con 0x7f9ddc0b5de0 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9de2200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9ddc072a50 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9de2200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9ddc0cde30 con 0x7f9ddc15cd30 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9ddb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ddc15c7b0 0x7f9ddc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9ddb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ddc15c7b0 0x7f9ddc0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47312/0 (socket says 172.21.15.144:47312) 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9ddb400640 1 -- 172.21.15.144:0/1542194540 learned_addr learned my addr 172.21.15.144:0/1542194540 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9ddb400640 1 -- 172.21.15.144:0/1542194540 >> v2:172.21.15.165:3300/0 conn(0x7f9ddc15cd30 msgr2=0x7f9ddc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9ddaa00640 1 --2- 172.21.15.144:0/1542194540 >> v2:172.21.15.165:3300/0 conn(0x7f9ddc15cd30 0x7f9ddc0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9ddb400640 1 --2- 172.21.15.144:0/1542194540 >> v2:172.21.15.165:3300/0 conn(0x7f9ddc15cd30 0x7f9ddc0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9ddb400640 1 -- 172.21.15.144:0/1542194540 >> v1:172.21.15.165:6789/0 conn(0x7f9ddc0b5de0 legacy=0x7f9ddc1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9ddb400640 1 -- 172.21.15.144:0/1542194540 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc0cd870 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.838+0000 7f9ddaa00640 1 --2- 172.21.15.144:0/1542194540 >> v2:172.21.15.165:3300/0 conn(0x7f9ddc15cd30 0x7f9ddc0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:50.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9ddb400640 1 --2- 172.21.15.144:0/1542194540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 0x7f9ddc0ccf00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0afd90 tx=0x7f9dcc01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213ae219bcb90d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9dda000640 1 -- 172.21.15.144:0/1542194540 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0a5760 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9dda000640 1 -- 172.21.15.144:0/1542194540 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dcc0a5900 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9dda000640 1 -- 172.21.15.144:0/1542194540 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc0a5cd0 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9de2200640 1 -- 172.21.15.144:0/1542194540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 msgr2=0x7f9ddc0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9de2200640 1 --2- 172.21.15.144:0/1542194540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 0x7f9ddc0ccf00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0afd90 tx=0x7f9dcc01c9b0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9de2200640 1 -- 172.21.15.144:0/1542194540 shutdown_connections 2024-09-12T12:16:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9de2200640 1 --2- 172.21.15.144:0/1542194540 >> v2:172.21.15.165:3300/0 conn(0x7f9ddc15cd30 0x7f9ddc0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9de2200640 1 --2- 172.21.15.144:0/1542194540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 0x7f9ddc0ccf00 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9de2200640 1 -- 172.21.15.144:0/1542194540 >> 172.21.15.144:0/1542194540 conn(0x7f9ddc06d0d0 msgr2=0x7f9ddc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9de2200640 1 -- 172.21.15.144:0/1542194540 shutdown_connections 2024-09-12T12:16:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.842+0000 7f9de2200640 1 -- 172.21.15.144:0/1542194540 wait complete. 2024-09-12T12:16:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 Processor -- start 2024-09-12T12:16:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 -- start start 2024-09-12T12:16:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ddc0b5de0 0x7f9ddc153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 0x7f9ddc155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ddc15cd30 0x7f9ddc14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc169320 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0cd650 con 0x7f9ddc0b5de0 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc1694a0 con 0x7f9ddc15cd30 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 0x7f9ddc155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 0x7f9ddc155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47326/0 (socket says 172.21.15.144:47326) 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddaa00640 1 -- 172.21.15.144:0/3662848075 learned_addr learned my addr 172.21.15.144:0/3662848075 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddb400640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ddc0b5de0 0x7f9ddc153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddbe00640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ddc15cd30 0x7f9ddc14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddaa00640 1 -- 172.21.15.144:0/3662848075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ddc15cd30 msgr2=0x7f9ddc14aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddaa00640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ddc15cd30 0x7f9ddc14aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddaa00640 1 -- 172.21.15.144:0/3662848075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ddc0b5de0 msgr2=0x7f9ddc153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddaa00640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ddc0b5de0 0x7f9ddc153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:50.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddaa00640 1 -- 172.21.15.144:0/3662848075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc0b63b0 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9ddaa00640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 0x7f9ddc155810 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c820 tx=0x7f9dc800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9dd3400640 1 -- 172.21.15.144:0/3662848075 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8015070 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9dd3400640 1 -- 172.21.15.144:0/3662848075 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc8007a30 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9dd3400640 1 -- 172.21.15.144:0/3662848075 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8007e40 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc150390 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.846+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc14d890 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.850+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ddc0ccf00 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.850+0000 7f9dd3400640 1 -- 172.21.15.144:0/3662848075 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9dc8018070 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.850+0000 7f9dd3400640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dbc0678c0 0x7f9dbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.850+0000 7f9dd3400640 1 -- 172.21.15.144:0/3662848075 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f9dc8085d00 con 0x7f9ddc15c7b0 2024-09-12T12:16:50.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.850+0000 7f9ddb400640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dbc0678c0 0x7f9dbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:50.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.850+0000 7f9ddb400640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dbc0678c0 0x7f9dbc069d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0ae000 tx=0x7f9dcc0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:50.854+0000 7f9dd3400640 1 -- 172.21.15.144:0/3662848075 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9dc8056010 con 0x7f9ddc15c7b0 2024-09-12T12:16:51.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ddc0af760 con 0x7f9ddc15c7b0 2024-09-12T12:16:51.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9dd3400640 1 -- 172.21.15.144:0/3662848075 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5231 (secure 0 0 0) 0x7f9dc805a310 con 0x7f9ddc15c7b0 2024-09-12T12:16:51.049 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:51.049 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-12T12:16:39:885036+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:16:19.655379+0000","modified":"2024-09-12T12:16:39.885031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6438":{"gid":6438,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/3811906714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3811906714},{"type":"v1","addr":"172.21.15.144:6835","nonce":3811906714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6438,"qdb_cluster":[6438]},"id":4}]} 2024-09-12T12:16:51.049 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-12T12:16:51.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dbc0678c0 msgr2=0x7f9dbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dbc0678c0 0x7f9dbc069d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0ae000 tx=0x7f9dcc0a7070 comp rx=0 tx=0).stop 2024-09-12T12:16:51.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 msgr2=0x7f9ddc155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 0x7f9ddc155810 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c820 tx=0x7f9dc800cce0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 shutdown_connections 2024-09-12T12:16:51.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dbc0678c0 0x7f9dbc069d80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ddc15cd30 0x7f9ddc14aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ddc15c7b0 0x7f9ddc155810 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 --2- 172.21.15.144:0/3662848075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ddc0b5de0 0x7f9ddc153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 >> 172.21.15.144:0/3662848075 conn(0x7f9ddc06d0d0 msgr2=0x7f9ddc152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:51.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 shutdown_connections 2024-09-12T12:16:51.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.046+0000 7f9de2200640 1 -- 172.21.15.144:0/3662848075 wait complete. 2024-09-12T12:16:51.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:16:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.202+0000 7f05e1600640 1 Processor -- start 2024-09-12T12:16:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.202+0000 7f05e1600640 1 -- start start 2024-09-12T12:16:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05e1600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05dc15c0a0 0x7f05dc0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05e1600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f05dc0ce950 0x7f05dc15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05e1600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05dc15c480 con 0x7f05dc0b6b20 2024-09-12T12:16:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05e1600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f05dc1609e0 con 0x7f05dc15c0a0 2024-09-12T12:16:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05e1600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f05dc15fdd0 con 0x7f05dc0ce950 2024-09-12T12:16:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05dc15c0a0 0x7f05dc0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05dc15c0a0 0x7f05dc0b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47336/0 (socket says 172.21.15.144:47336) 2024-09-12T12:16:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05dbe00640 1 -- 172.21.15.144:0/3354028846 learned_addr learned my addr 172.21.15.144:0/3354028846 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05db400640 1 --2- 172.21.15.144:0/3354028846 >> v2:172.21.15.165:3300/0 conn(0x7f05dc0ce950 0x7f05dc15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05dbe00640 1 -- 172.21.15.144:0/3354028846 >> v2:172.21.15.165:3300/0 conn(0x7f05dc0ce950 msgr2=0x7f05dc15d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05dbe00640 1 --2- 172.21.15.144:0/3354028846 >> v2:172.21.15.165:3300/0 conn(0x7f05dc0ce950 0x7f05dc15d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05dbe00640 1 -- 172.21.15.144:0/3354028846 >> v1:172.21.15.165:6789/0 conn(0x7f05dc0b6b20 legacy=0x7f05dc0b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05dbe00640 1 -- 172.21.15.144:0/3354028846 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc1600b0 con 0x7f05dc15c0a0 2024-09-12T12:16:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05db400640 1 --2- 172.21.15.144:0/3354028846 >> v2:172.21.15.165:3300/0 conn(0x7f05dc0ce950 0x7f05dc15d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.206+0000 7f05dbe00640 1 --2- 172.21.15.144:0/3354028846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 0x7f05dc0b5310 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0cf910 tx=0x7f05cc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f734241723a0387 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05daa00640 1 -- 172.21.15.144:0/3354028846 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0a5710 con 0x7f05dc15c0a0 2024-09-12T12:16:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05daa00640 1 -- 172.21.15.144:0/3354028846 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05cc0a58b0 con 0x7f05dc15c0a0 2024-09-12T12:16:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05daa00640 1 -- 172.21.15.144:0/3354028846 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0a5c80 con 0x7f05dc15c0a0 2024-09-12T12:16:51.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 -- 172.21.15.144:0/3354028846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 msgr2=0x7f05dc0b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 --2- 172.21.15.144:0/3354028846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 0x7f05dc0b5310 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0cf910 tx=0x7f05cc01c960 comp rx=0 tx=0).stop 2024-09-12T12:16:51.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 -- 172.21.15.144:0/3354028846 shutdown_connections 2024-09-12T12:16:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 --2- 172.21.15.144:0/3354028846 >> v2:172.21.15.165:3300/0 conn(0x7f05dc0ce950 0x7f05dc15d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 --2- 172.21.15.144:0/3354028846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 0x7f05dc0b5310 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 -- 172.21.15.144:0/3354028846 >> 172.21.15.144:0/3354028846 conn(0x7f05dc0d2280 msgr2=0x7f05dc0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 -- 172.21.15.144:0/3354028846 shutdown_connections 2024-09-12T12:16:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 -- 172.21.15.144:0/3354028846 wait complete. 2024-09-12T12:16:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 Processor -- start 2024-09-12T12:16:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 -- start start 2024-09-12T12:16:51.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05dc0b6b20 0x7f05dc14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05dc0ce950 0x7f05dc153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 0x7f05dc153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc073c90 con 0x7f05dc15c0a0 2024-09-12T12:16:51.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc073b10 con 0x7f05dc0b6b20 2024-09-12T12:16:51.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e1600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc073e10 con 0x7f05dc0ce950 2024-09-12T12:16:51.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.210+0000 7f05e0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 0x7f05dc153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 0x7f05dc153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47348/0 (socket says 172.21.15.144:47348) 2024-09-12T12:16:51.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e0c00640 1 -- 172.21.15.144:0/1168291729 learned_addr learned my addr 172.21.15.144:0/1168291729 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:51.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05dbe00640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05dc0b6b20 0x7f05dc14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05db400640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05dc0ce950 0x7f05dc153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e0c00640 1 -- 172.21.15.144:0/1168291729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05dc0ce950 msgr2=0x7f05dc153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e0c00640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05dc0ce950 0x7f05dc153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e0c00640 1 -- 172.21.15.144:0/1168291729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05dc0b6b20 msgr2=0x7f05dc14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e0c00640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05dc0b6b20 0x7f05dc14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e0c00640 1 -- 172.21.15.144:0/1168291729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc06dfe0 con 0x7f05dc15c0a0 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05dbe00640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05dc0b6b20 0x7f05dc14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e0c00640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 0x7f05dc153d70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c340 tx=0x7f05d400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05d3e00640 1 -- 172.21.15.144:0/1168291729 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4017070 con 0x7f05dc15c0a0 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05d3e00640 1 -- 172.21.15.144:0/1168291729 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d40052d0 con 0x7f05dc15c0a0 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05dc06e2c0 con 0x7f05dc15c0a0 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05d3e00640 1 -- 172.21.15.144:0/1168291729 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4003800 con 0x7f05dc15c0a0 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05dc06e880 con 0x7f05dc15c0a0 2024-09-12T12:16:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05dc15d0c0 con 0x7f05dc15c0a0 2024-09-12T12:16:51.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05d3e00640 1 -- 172.21.15.144:0/1168291729 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f05d401a070 con 0x7f05dc15c0a0 2024-09-12T12:16:51.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05d3e00640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05bc0678c0 0x7f05bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.214+0000 7f05d3e00640 1 -- 172.21.15.144:0/1168291729 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7f05d4085050 con 0x7f05dc15c0a0 2024-09-12T12:16:51.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.218+0000 7f05dbe00640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05bc0678c0 0x7f05bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.218+0000 7f05dbe00640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05bc0678c0 0x7f05bc069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0ae000 tx=0x7f05cc0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.222+0000 7f05d3e00640 1 -- 172.21.15.144:0/1168291729 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f05d4005480 con 0x7f05dc15c0a0 2024-09-12T12:16:51.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.382+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05dc0b1c60 con 0x7f05dc15c0a0 2024-09-12T12:16:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.382+0000 7f05d3e00640 1 -- 172.21.15.144:0/1168291729 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+17336 (secure 0 0 0) 0x7f05d4055360 con 0x7f05dc15c0a0 2024-09-12T12:16:51.386 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:51.386 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":71,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:16:35.868861+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:16:17.373953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T12:16:18.661913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.3","mappings":[{"from":7,"to":2}]},{"pgid":"10.c","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":1,"to":3}]},{"pgid":"10.39","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.165:6835/799094061":"2024-09-13T12:16:35.863459+0000","172.21.15.165:6833/799094061":"2024-09-13T12:16:35.863459+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05bc0678c0 msgr2=0x7f05bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05bc0678c0 0x7f05bc069d80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0ae000 tx=0x7f05cc0a7070 comp rx=0 tx=0).stop 2024-09-12T12:16:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 msgr2=0x7f05dc153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 0x7f05dc153d70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f05d400c340 tx=0x7f05d400c800 comp rx=0 tx=0).stop 2024-09-12T12:16:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 shutdown_connections 2024-09-12T12:16:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05bc0678c0 0x7f05bc069d80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05dc15c0a0 0x7f05dc153d70 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05dc0ce950 0x7f05dc153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 --2- 172.21.15.144:0/1168291729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05dc0b6b20 0x7f05dc14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 >> 172.21.15.144:0/1168291729 conn(0x7f05dc0d2280 msgr2=0x7f05dc0d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 shutdown_connections 2024-09-12T12:16:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.386+0000 7f05e1600640 1 -- 172.21.15.144:0/1168291729 wait complete. 2024-09-12T12:16:51.408 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:16:51.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff503600640 1 Processor -- start 2024-09-12T12:16:51.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff503600640 1 -- start start 2024-09-12T12:16:51.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff503600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4fc15b4e0 0x7ff4fc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff503600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4fc0b45a0 con 0x7ff4fc0b3ad0 2024-09-12T12:16:51.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff503600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4fc0b3fe0 con 0x7ff4fc0ccf30 2024-09-12T12:16:51.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff503600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc0b42c0 con 0x7ff4fc15b4e0 2024-09-12T12:16:51.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff4fbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff4fc0b3ad0 0x7ff4fc071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37488/0 (socket says 172.21.15.144:37488) 2024-09-12T12:16:51.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff4fbe00640 1 -- 172.21.15.144:0/1142130439 learned_addr learned my addr 172.21.15.144:0/1142130439 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:51.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff500c00640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4fc15b4e0 0x7ff4fc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195249488 0 0) 0x7ff4fc0b45a0 con 0x7ff4fc0b3ad0 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.542+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4e0003530 con 0x7ff4fc0b3ad0 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1358687631 0 0) 0x7ff4e0003530 con 0x7ff4fc0b3ad0 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4fc15b4e0 msgr2=0x7ff4fc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4fc15b4e0 0x7ff4fc0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 >> v1:172.21.15.165:6789/0 conn(0x7ff4fc0ccf30 legacy=0x7ff4fc0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc0b1490 con 0x7ff4fc0b3ad0 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7ff4e8001680 con 0x7ff4fc0b3ad0 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 >> v1:172.21.15.144:6789/0 conn(0x7ff4fc0b3ad0 legacy=0x7ff4fc071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4e00039f0 0x7ff4e0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4e0004810 0x7ff4e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4fc15b4e0 0x7ff4e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc0b42c0 con 0x7ff4e0004810 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e000bab0 con 0x7ff4e00039f0 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e000dec0 con 0x7ff4fc15b4e0 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fbe00640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4e0004810 0x7ff4e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff500c00640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4e00039f0 0x7ff4e0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff501600640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4fc15b4e0 0x7ff4e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fbe00640 1 -- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4fc15b4e0 msgr2=0x7ff4e00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fbe00640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4fc15b4e0 0x7ff4e00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fbe00640 1 -- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4e00039f0 msgr2=0x7ff4e0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fbe00640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4e00039f0 0x7ff4e0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fbe00640 1 -- 172.21.15.144:0/1142130439 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e0003530 con 0x7ff4e0004810 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.546+0000 7ff4fbe00640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4e0004810 0x7ff4e0004c90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0b02b0 tx=0x7ff4e801f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9675c1c9c0694d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8007c30 con 0x7ff4e0004810 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e80ac020 con 0x7ff4e0004810 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff4fb400640 1 -- 172.21.15.144:0/1142130439 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80058e0 con 0x7ff4e0004810 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 -- 172.21.15.144:0/1142130439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4e0004810 msgr2=0x7ff4e0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 --2- 172.21.15.144:0/1142130439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4e0004810 0x7ff4e0004c90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0b02b0 tx=0x7ff4e801f270 comp rx=0 tx=0).stop 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff501600640 1 -- 172.21.15.144:0/1142130439 reap_dead start 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 -- 172.21.15.144:0/1142130439 shutdown_connections 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 -- 172.21.15.144:0/1142130439 >> 172.21.15.144:0/1142130439 conn(0x7ff4fc06d0d0 msgr2=0x7ff4fc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 -- 172.21.15.144:0/1142130439 shutdown_connections 2024-09-12T12:16:51.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 -- 172.21.15.144:0/1142130439 wait complete. 2024-09-12T12:16:51.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 Processor -- start 2024-09-12T12:16:51.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 -- start start 2024-09-12T12:16:51.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4e0004810 0x7ff4fc1f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4fc158330 0x7ff4fc158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4fc15a010 0x7ff4fc15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc0cdef0 con 0x7ff4fc158330 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc071b30 con 0x7ff4fc15a010 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff503600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc15b8c0 con 0x7ff4e0004810 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.550+0000 7ff4fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4fc158330 0x7ff4fc158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4fc158330 0x7ff4fc158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47378/0 (socket says 172.21.15.144:47378) 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4fbe00640 1 -- 172.21.15.144:0/3326241391 learned_addr learned my addr 172.21.15.144:0/3326241391 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff500c00640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4e0004810 0x7ff4fc1f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff501600640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4fc15a010 0x7ff4fc15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4fbe00640 1 -- 172.21.15.144:0/3326241391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4e0004810 msgr2=0x7ff4fc1f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4fbe00640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4e0004810 0x7ff4fc1f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4fbe00640 1 -- 172.21.15.144:0/3326241391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4fc15a010 msgr2=0x7ff4fc15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4fbe00640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4fc15a010 0x7ff4fc15a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4fbe00640 1 -- 172.21.15.144:0/3326241391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc15db50 con 0x7ff4fc158330 2024-09-12T12:16:51.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff500c00640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4e0004810 0x7ff4fc1f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:51.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4fbe00640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4fc158330 0x7ff4fc158790 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ae040 tx=0x7ff4e0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4f8c00640 1 -- 172.21.15.144:0/3326241391 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80049f0 con 0x7ff4fc158330 2024-09-12T12:16:51.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4f8c00640 1 -- 172.21.15.144:0/3326241391 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e80b6070 con 0x7ff4fc158330 2024-09-12T12:16:51.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4fc1f3930 con 0x7ff4fc158330 2024-09-12T12:16:51.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4f8c00640 1 -- 172.21.15.144:0/3326241391 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8004dd0 con 0x7ff4fc158330 2024-09-12T12:16:51.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4fc0d0250 con 0x7ff4fc158330 2024-09-12T12:16:51.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4fc0b3590 con 0x7ff4fc158330 2024-09-12T12:16:51.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.554+0000 7ff4f8c00640 1 -- 172.21.15.144:0/3326241391 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4e8007070 con 0x7ff4fc158330 2024-09-12T12:16:51.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.558+0000 7ff4f8c00640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4dc0678c0 0x7ff4dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.558+0000 7ff4f8c00640 1 -- 172.21.15.144:0/3326241391 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6332+0+0 (secure 0 0 0) 0x7ff4e8123180 con 0x7ff4fc158330 2024-09-12T12:16:51.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.558+0000 7ff500c00640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4dc0678c0 0x7ff4dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.558+0000 7ff500c00640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4dc0678c0 0x7ff4dc069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0074d0 tx=0x7ff4ec00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.562+0000 7ff4f8c00640 1 -- 172.21.15.144:0/3326241391 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff4e8018f80 con 0x7ff4fc158330 2024-09-12T12:16:51.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.750+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff4fc15cb70 con 0x7ff4fc158330 2024-09-12T12:16:51.752 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:16:51.750+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:16:51.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.750+0000 7ff4f8c00640 1 -- 172.21.15.144:0/3326241391 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) ==== 161+0+0 (secure 0 0 0) 0x7ff4e80f33f0 con 0x7ff4fc158330 2024-09-12T12:16:51.754 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:16:51.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4dc0678c0 msgr2=0x7ff4dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4dc0678c0 0x7ff4dc069d80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0074d0 tx=0x7ff4ec00b040 comp rx=0 tx=0).stop 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4fc158330 msgr2=0x7ff4fc158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4fc158330 0x7ff4fc158790 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80ae040 tx=0x7ff4e0005840 comp rx=0 tx=0).stop 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 shutdown_connections 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4dc0678c0 0x7ff4dc069d80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4fc15a010 0x7ff4fc15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4fc158330 0x7ff4fc158790 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 --2- 172.21.15.144:0/3326241391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4e0004810 0x7ff4fc1f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 >> 172.21.15.144:0/3326241391 conn(0x7ff4fc06d0d0 msgr2=0x7ff4fc075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 shutdown_connections 2024-09-12T12:16:51.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.754+0000 7ff503600640 1 -- 172.21.15.144:0/3326241391 wait complete. 2024-09-12T12:16:51.764 INFO:tasks.ceph.mds.a.smithi144.stderr: -2132> 2024-09-12T12:16:41.870+0000 7fc8b8a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:16:51.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:16:51.809 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:16:51.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0caf600640 1 Processor -- start 2024-09-12T12:16:51.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0caf600640 1 -- start start 2024-09-12T12:16:51.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0caf600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca815a120 0x7f0ca80730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0caf600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ca8073c50 0x7f0ca80735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0caf600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca80708b0 con 0x7f0ca80b1a20 2024-09-12T12:16:51.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0caf600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0ca8070b90 con 0x7f0ca8073c50 2024-09-12T12:16:51.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0caf600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca8070e70 con 0x7f0ca815a120 2024-09-12T12:16:51.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0ca7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ca8073c50 0x7f0ca80735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0cad600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0ca80b1a20 0x7f0ca8160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37502/0 (socket says 172.21.15.144:37502) 2024-09-12T12:16:51.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0cad600640 1 -- 172.21.15.144:0/3340523149 learned_addr learned my addr 172.21.15.144:0/3340523149 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:51.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0cacc00640 1 --2- 172.21.15.144:0/3340523149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca815a120 0x7f0ca80730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0ca7e00640 1 -- 172.21.15.144:0/3340523149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca815a120 msgr2=0x7f0ca80730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:51.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0ca7e00640 1 --2- 172.21.15.144:0/3340523149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca815a120 0x7f0ca80730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0ca7e00640 1 -- 172.21.15.144:0/3340523149 >> v1:172.21.15.144:6789/0 conn(0x7f0ca80b1a20 legacy=0x7f0ca8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0ca7e00640 1 -- 172.21.15.144:0/3340523149 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca8071150 con 0x7f0ca8073c50 2024-09-12T12:16:51.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.918+0000 7f0ca7400640 1 -- 172.21.15.144:0/3340523149 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531526762 0 0) 0x7f0ca80708b0 con 0x7f0ca80b1a20 2024-09-12T12:16:51.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0ca7e00640 1 --2- 172.21.15.144:0/3340523149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8073c50 0x7f0ca80735f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0c940097c0 tx=0x7f0c9401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b75e34d4365c151 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0ca7400640 1 -- 172.21.15.144:0/3340523149 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c940aa5f0 con 0x7f0ca8073c50 2024-09-12T12:16:51.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0ca7400640 1 -- 172.21.15.144:0/3340523149 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c940af070 con 0x7f0ca8073c50 2024-09-12T12:16:51.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0ca7400640 1 -- 172.21.15.144:0/3340523149 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c940aa9b0 con 0x7f0ca8073c50 2024-09-12T12:16:51.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0caf600640 1 -- 172.21.15.144:0/3340523149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8073c50 msgr2=0x7f0ca80735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0caf600640 1 --2- 172.21.15.144:0/3340523149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8073c50 0x7f0ca80735f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0c940097c0 tx=0x7f0c9401c470 comp rx=0 tx=0).stop 2024-09-12T12:16:51.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0caf600640 1 -- 172.21.15.144:0/3340523149 shutdown_connections 2024-09-12T12:16:51.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0caf600640 1 --2- 172.21.15.144:0/3340523149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca8073c50 0x7f0ca80735f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0caf600640 1 --2- 172.21.15.144:0/3340523149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca815a120 0x7f0ca80730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0caf600640 1 -- 172.21.15.144:0/3340523149 >> 172.21.15.144:0/3340523149 conn(0x7f0ca80d2400 msgr2=0x7f0ca80d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:51.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0caf600640 1 -- 172.21.15.144:0/3340523149 shutdown_connections 2024-09-12T12:16:51.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.922+0000 7f0caf600640 1 -- 172.21.15.144:0/3340523149 wait complete. 2024-09-12T12:16:51.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 Processor -- start 2024-09-12T12:16:51.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 -- start start 2024-09-12T12:16:51.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca8073c50 0x7f0ca814db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ca80b1a20 0x7f0ca806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca815a120 0x7f0ca806dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca8169530 con 0x7f0ca815a120 2024-09-12T12:16:51.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca81693b0 con 0x7f0ca80b1a20 2024-09-12T12:16:51.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca81696b0 con 0x7f0ca8073c50 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cad600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca815a120 0x7f0ca806dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cad600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca815a120 0x7f0ca806dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47410/0 (socket says 172.21.15.144:47410) 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cad600640 1 -- 172.21.15.144:0/2599371840 learned_addr learned my addr 172.21.15.144:0/2599371840 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cacc00640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca8073c50 0x7f0ca814db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0ca7e00640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ca80b1a20 0x7f0ca806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cad600640 1 -- 172.21.15.144:0/2599371840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca8073c50 msgr2=0x7f0ca814db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cad600640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca8073c50 0x7f0ca814db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cad600640 1 -- 172.21.15.144:0/2599371840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ca80b1a20 msgr2=0x7f0ca806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cad600640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ca80b1a20 0x7f0ca806d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cad600640 1 -- 172.21.15.144:0/2599371840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca815dea0 con 0x7f0ca815a120 2024-09-12T12:16:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0ca7e00640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ca80b1a20 0x7f0ca806d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:51.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0cad600640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca815a120 0x7f0ca806dce0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c410 tx=0x7f0ca000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0ca4c00640 1 -- 172.21.15.144:0/2599371840 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00074e0 con 0x7f0ca815a120 2024-09-12T12:16:51.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0ca4c00640 1 -- 172.21.15.144:0/2599371840 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca00047f0 con 0x7f0ca815a120 2024-09-12T12:16:51.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0ca4c00640 1 -- 172.21.15.144:0/2599371840 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0004be0 con 0x7f0ca815a120 2024-09-12T12:16:51.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca815e180 con 0x7f0ca815a120 2024-09-12T12:16:51.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca815e740 con 0x7f0ca815a120 2024-09-12T12:16:51.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.926+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca8160030 con 0x7f0ca815a120 2024-09-12T12:16:51.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.930+0000 7f0ca4c00640 1 -- 172.21.15.144:0/2599371840 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ca0011070 con 0x7f0ca815a120 2024-09-12T12:16:51.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.930+0000 7f0ca4c00640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c880678c0 0x7f0c88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:51.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.930+0000 7f0ca4c00640 1 -- 172.21.15.144:0/2599371840 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6418+0+0 (secure 0 0 0) 0x7f0ca0085990 con 0x7f0ca815a120 2024-09-12T12:16:51.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.930+0000 7f0cacc00640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c880678c0 0x7f0c88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.930+0000 7f0cacc00640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c880678c0 0x7f0c88069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8150880 tx=0x7f0c9800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:51.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:51.934+0000 7f0ca4c00640 1 -- 172.21.15.144:0/2599371840 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ca0056290 con 0x7f0ca815a120 2024-09-12T12:16:52.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.126+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0ca8150ae0 con 0x7f0ca815a120 2024-09-12T12:16:52.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0ca4c00640 1 -- 172.21.15.144:0/2599371840 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) ==== 104+0+0 (secure 0 0 0) 0x7f0ca0055b90 con 0x7f0ca815a120 2024-09-12T12:16:52.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c880678c0 msgr2=0x7f0c88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:52.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c880678c0 0x7f0c88069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8150880 tx=0x7f0c9800b040 comp rx=0 tx=0).stop 2024-09-12T12:16:52.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca815a120 msgr2=0x7f0ca806dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:52.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca815a120 0x7f0ca806dce0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c410 tx=0x7f0ca000c810 comp rx=0 tx=0).stop 2024-09-12T12:16:52.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 shutdown_connections 2024-09-12T12:16:52.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c880678c0 0x7f0c88069d80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:52.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ca815a120 0x7f0ca806dce0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:52.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ca80b1a20 0x7f0ca806d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:52.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 --2- 172.21.15.144:0/2599371840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ca8073c50 0x7f0ca814db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:52.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 >> 172.21.15.144:0/2599371840 conn(0x7f0ca80d2400 msgr2=0x7f0ca815a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:52.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 shutdown_connections 2024-09-12T12:16:52.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.754+0000 7f0caf600640 1 -- 172.21.15.144:0/2599371840 wait complete. 2024-09-12T12:16:52.782 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:16:52.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89f6400640 1 Processor -- start 2024-09-12T12:16:52.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89f6400640 1 -- start start 2024-09-12T12:16:52.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89f6400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0156c10 0x7f89f0072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:52.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89f6400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f006cd20 con 0x7f89f006cff0 2024-09-12T12:16:52.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89f6400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f00712b0 con 0x7f89f0073a70 2024-09-12T12:16:52.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89f6400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89f0071be0 con 0x7f89f0156c10 2024-09-12T12:16:52.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89eea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f89f006cff0 0x7f89f0073360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37504/0 (socket says 172.21.15.144:37504) 2024-09-12T12:16:52.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89eea00640 1 -- 172.21.15.144:0/1942745264 learned_addr learned my addr 172.21.15.144:0/1942745264 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:52.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89ef400640 1 --2- 172.21.15.144:0/1942745264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0156c10 0x7f89f0072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:52.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.962+0000 7f89ee000640 1 -- 172.21.15.144:0/1942745264 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430995780 0 0) 0x7f89f006cd20 con 0x7f89f006cff0 2024-09-12T12:16:52.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ee000640 1 -- 172.21.15.144:0/1942745264 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89d4003530 con 0x7f89f006cff0 2024-09-12T12:16:52.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ee000640 1 -- 172.21.15.144:0/1942745264 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705015692 0 0) 0x7f89f00712b0 con 0x7f89f0073a70 2024-09-12T12:16:52.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ee000640 1 -- 172.21.15.144:0/1942745264 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89f006cd20 con 0x7f89f0073a70 2024-09-12T12:16:52.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ef400640 1 -- 172.21.15.144:0/1942745264 >> v1:172.21.15.165:6789/0 conn(0x7f89f0073a70 legacy=0x7f89f015de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:52.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ef400640 1 -- 172.21.15.144:0/1942745264 >> v1:172.21.15.144:6789/0 conn(0x7f89f006cff0 legacy=0x7f89f0073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:52.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ef400640 1 -- 172.21.15.144:0/1942745264 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f0071590 con 0x7f89f0156c10 2024-09-12T12:16:52.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ef400640 1 --2- 172.21.15.144:0/1942745264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0156c10 0x7f89f0072070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009dc0 tx=0x7f89e001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48516bb691a8d708 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:52.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ee000640 1 -- 172.21.15.144:0/1942745264 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e00b2070 con 0x7f89f0156c10 2024-09-12T12:16:52.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ee000640 1 -- 172.21.15.144:0/1942745264 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e00a5a70 con 0x7f89f0156c10 2024-09-12T12:16:52.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.966+0000 7f89ee000640 1 -- 172.21.15.144:0/1942745264 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e00a5e40 con 0x7f89f0156c10 2024-09-12T12:16:52.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 -- 172.21.15.144:0/1942745264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0156c10 msgr2=0x7f89f0072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 --2- 172.21.15.144:0/1942745264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0156c10 0x7f89f0072070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009dc0 tx=0x7f89e001c990 comp rx=0 tx=0).stop 2024-09-12T12:16:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 -- 172.21.15.144:0/1942745264 shutdown_connections 2024-09-12T12:16:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 --2- 172.21.15.144:0/1942745264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0156c10 0x7f89f0072070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 -- 172.21.15.144:0/1942745264 >> 172.21.15.144:0/1942745264 conn(0x7f89f006bc10 msgr2=0x7f89f006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 -- 172.21.15.144:0/1942745264 shutdown_connections 2024-09-12T12:16:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 -- 172.21.15.144:0/1942745264 wait complete. 2024-09-12T12:16:52.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 Processor -- start 2024-09-12T12:16:52.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 -- start start 2024-09-12T12:16:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f006cff0 0x7f89f0144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0073a70 0x7f89f0144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f0156c10 0x7f89f015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0157170 con 0x7f89f006cff0 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0156ff0 con 0x7f89f0156c10 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89f6400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89f00725b0 con 0x7f89f0073a70 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89ef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f006cff0 0x7f89f0144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89ef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f006cff0 0x7f89f0144d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47418/0 (socket says 172.21.15.144:47418) 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89ef400640 1 -- 172.21.15.144:0/1795159640 learned_addr learned my addr 172.21.15.144:0/1795159640 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89eea00640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0073a70 0x7f89f0144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89efe00640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f0156c10 0x7f89f015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89ef400640 1 -- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0073a70 msgr2=0x7f89f0144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89ef400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0073a70 0x7f89f0144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89ef400640 1 -- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f0156c10 msgr2=0x7f89f015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89ef400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f0156c10 0x7f89f015cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89ef400640 1 -- 172.21.15.144:0/1795159640 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f0154c10 con 0x7f89f006cff0 2024-09-12T12:16:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89eea00640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0073a70 0x7f89f0144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89efe00640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f0156c10 0x7f89f015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.970+0000 7f89ef400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f006cff0 0x7f89f0144d10 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f89e00b0040 tx=0x7f89e0019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89e7400640 1 -- 172.21.15.144:0/1795159640 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e00bd020 con 0x7f89f006cff0 2024-09-12T12:16:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f0154ef0 con 0x7f89f006cff0 2024-09-12T12:16:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89e7400640 1 -- 172.21.15.144:0/1795159640 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e00adb40 con 0x7f89f006cff0 2024-09-12T12:16:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89e7400640 1 -- 172.21.15.144:0/1795159640 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e00b2040 con 0x7f89f006cff0 2024-09-12T12:16:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f0144590 con 0x7f89f006cff0 2024-09-12T12:16:52.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f0072070 con 0x7f89f006cff0 2024-09-12T12:16:52.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89e7400640 1 -- 172.21.15.144:0/1795159640 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f89e00c0020 con 0x7f89f006cff0 2024-09-12T12:16:52.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89e7400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89d00678c0 0x7f89d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:52.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89e7400640 1 -- 172.21.15.144:0/1795159640 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6418+0+0 (secure 0 0 0) 0x7f89e0121420 con 0x7f89f006cff0 2024-09-12T12:16:52.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89eea00640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89d00678c0 0x7f89d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:52.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.974+0000 7f89eea00640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89d00678c0 0x7f89d0069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0010f0 tx=0x7f89dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:52.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:52.978+0000 7f89e7400640 1 -- 172.21.15.144:0/1795159640 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f89e00c7030 con 0x7f89f006cff0 2024-09-12T12:16:53.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.138+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f89f01550c0 con 0x7f89f006cff0 2024-09-12T12:16:53.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.854+0000 7f89e7400640 1 -- 172.21.15.144:0/1795159640 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) ==== 181+0+0 (secure 0 0 0) 0x7f89e0016580 con 0x7f89f006cff0 2024-09-12T12:16:53.857 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:16:53.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89d00678c0 msgr2=0x7f89d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:53.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89d00678c0 0x7f89d0069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0010f0 tx=0x7f89dc009040 comp rx=0 tx=0).stop 2024-09-12T12:16:53.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f006cff0 msgr2=0x7f89f0144d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:53.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f006cff0 0x7f89f0144d10 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f89e00b0040 tx=0x7f89e0019730 comp rx=0 tx=0).stop 2024-09-12T12:16:53.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 shutdown_connections 2024-09-12T12:16:53.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89d00678c0 0x7f89d0069d80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:53.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89f0156c10 0x7f89f015cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:53.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89f0073a70 0x7f89f0144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:53.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 --2- 172.21.15.144:0/1795159640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89f006cff0 0x7f89f0144d10 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:53.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 >> 172.21.15.144:0/1795159640 conn(0x7f89f006bc10 msgr2=0x7f89f00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:53.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 shutdown_connections 2024-09-12T12:16:53.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:53.858+0000 7f89f6400640 1 -- 172.21.15.144:0/1795159640 wait complete. 2024-09-12T12:16:53.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:16:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3ea00640 1 Processor -- start 2024-09-12T12:16:54.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3ea00640 1 -- start start 2024-09-12T12:16:54.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e3815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1e3815ea30 0x7f1e381511e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3ea00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e38074060 con 0x7f1e38073c80 2024-09-12T12:16:54.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3ea00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1e380ce510 con 0x7f1e3815ea30 2024-09-12T12:16:54.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3ea00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e380ce740 con 0x7f1e380ce110 2024-09-12T12:16:54.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3e000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1e3815ea30 0x7f1e381511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e3815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e3815e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:37988/0 (socket says 172.21.15.144:37988) 2024-09-12T12:16:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3cc00640 1 -- 172.21.15.144:0/1905230325 learned_addr learned my addr 172.21.15.144:0/1905230325 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e37e00640 1 -- 172.21.15.144:0/1905230325 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136121799 0 0) 0x7f1e38074060 con 0x7f1e38073c80 2024-09-12T12:16:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3e000640 1 -- 172.21.15.144:0/1905230325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 msgr2=0x7f1e3815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3e000640 1 --2- 172.21.15.144:0/1905230325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e3815e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3e000640 1 -- 172.21.15.144:0/1905230325 >> v1:172.21.15.165:6789/0 conn(0x7f1e38073c80 legacy=0x7f1e380cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3e000640 1 -- 172.21.15.144:0/1905230325 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e380cea20 con 0x7f1e3815ea30 2024-09-12T12:16:54.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.026+0000 7f1e3cc00640 1 --2- 172.21.15.144:0/1905230325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e3815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:54.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e3e000640 1 --2- 172.21.15.144:0/1905230325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e3815ea30 0x7f1e381511e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009d90 tx=0x7f1e3001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60e896d5086c4438 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e37e00640 1 -- 172.21.15.144:0/1905230325 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e300b2070 con 0x7f1e3815ea30 2024-09-12T12:16:54.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e37e00640 1 -- 172.21.15.144:0/1905230325 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e300a57b0 con 0x7f1e3815ea30 2024-09-12T12:16:54.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e37e00640 1 -- 172.21.15.144:0/1905230325 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e300a5b80 con 0x7f1e3815ea30 2024-09-12T12:16:54.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e3ea00640 1 -- 172.21.15.144:0/1905230325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e3815ea30 msgr2=0x7f1e381511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/1905230325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e3815ea30 0x7f1e381511e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009d90 tx=0x7f1e3001c970 comp rx=0 tx=0).stop 2024-09-12T12:16:54.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e3ea00640 1 -- 172.21.15.144:0/1905230325 shutdown_connections 2024-09-12T12:16:54.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/1905230325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e3815ea30 0x7f1e381511e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/1905230325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e3815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e3ea00640 1 -- 172.21.15.144:0/1905230325 >> 172.21.15.144:0/1905230325 conn(0x7f1e3806bc10 msgr2=0x7f1e3806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e3ea00640 1 -- 172.21.15.144:0/1905230325 shutdown_connections 2024-09-12T12:16:54.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.030+0000 7f1e3ea00640 1 -- 172.21.15.144:0/1905230325 wait complete. 2024-09-12T12:16:54.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3ea00640 1 Processor -- start 2024-09-12T12:16:54.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3ea00640 1 -- start start 2024-09-12T12:16:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3ea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e38073c80 0x7f1e38149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e38072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3815ea30 0x7f1e3815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1e381518a0 con 0x7f1e3815ea30 2024-09-12T12:16:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3ea00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e38151720 con 0x7f1e38073c80 2024-09-12T12:16:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3ea00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e38151a20 con 0x7f1e380ce110 2024-09-12T12:16:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3815ea30 0x7f1e3815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3815ea30 0x7f1e3815a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47426/0 (socket says 172.21.15.144:47426) 2024-09-12T12:16:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e38072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e38073c80 0x7f1e38149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3e000640 1 -- 172.21.15.144:0/2766250167 learned_addr learned my addr 172.21.15.144:0/2766250167 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:54.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3e000640 1 -- 172.21.15.144:0/2766250167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 msgr2=0x7f1e38072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3e000640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e38072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3e000640 1 -- 172.21.15.144:0/2766250167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e38073c80 msgr2=0x7f1e38149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3e000640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e38073c80 0x7f1e38149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3e000640 1 -- 172.21.15.144:0/2766250167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e381fa630 con 0x7f1e3815ea30 2024-09-12T12:16:54.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3d600640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e38073c80 0x7f1e38149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:54.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3e000640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3815ea30 0x7f1e3815a0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1e3001b020 tx=0x7f1e30019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e35600640 1 -- 172.21.15.144:0/2766250167 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e300bd020 con 0x7f1e3815ea30 2024-09-12T12:16:54.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e35600640 1 -- 172.21.15.144:0/2766250167 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e300b8470 con 0x7f1e3815ea30 2024-09-12T12:16:54.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e35600640 1 -- 172.21.15.144:0/2766250167 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e300b2040 con 0x7f1e3815ea30 2024-09-12T12:16:54.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.034+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e381fa910 con 0x7f1e3815ea30 2024-09-12T12:16:54.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.038+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e381faed0 con 0x7f1e3815ea30 2024-09-12T12:16:54.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.038+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3815e4f0 con 0x7f1e3815ea30 2024-09-12T12:16:54.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.038+0000 7f1e35600640 1 -- 172.21.15.144:0/2766250167 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e300c0020 con 0x7f1e3815ea30 2024-09-12T12:16:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.038+0000 7f1e35600640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e180678c0 0x7f1e18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.038+0000 7f1e35600640 1 -- 172.21.15.144:0/2766250167 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5951+0+0 (secure 0 0 0) 0x7f1e30120a50 con 0x7f1e3815ea30 2024-09-12T12:16:54.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.038+0000 7f1e3d600640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e180678c0 0x7f1e18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.038+0000 7f1e3d600640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e180678c0 0x7f1e18069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c000f70 tx=0x7f1e2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.042+0000 7f1e35600640 1 -- 172.21.15.144:0/2766250167 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e300c7030 con 0x7f1e3815ea30 2024-09-12T12:16:54.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.202+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1e38149fc0 con 0x7f1e3815ea30 2024-09-12T12:16:54.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.854+0000 7f1e35600640 1 -- 172.21.15.144:0/2766250167 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) ==== 169+0+0 (secure 0 0 0) 0x7f1e30016560 con 0x7f1e3815ea30 2024-09-12T12:16:54.859 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:16:54.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e180678c0 msgr2=0x7f1e18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e180678c0 0x7f1e18069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c000f70 tx=0x7f1e2c009040 comp rx=0 tx=0).stop 2024-09-12T12:16:54.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3815ea30 msgr2=0x7f1e3815a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3815ea30 0x7f1e3815a0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1e3001b020 tx=0x7f1e30019710 comp rx=0 tx=0).stop 2024-09-12T12:16:54.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 shutdown_connections 2024-09-12T12:16:54.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e180678c0 0x7f1e18069d80 secure :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c000f70 tx=0x7f1e2c009040 comp rx=0 tx=0).stop 2024-09-12T12:16:54.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3815ea30 0x7f1e3815a0a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e380ce110 0x7f1e38072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/2766250167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e38073c80 0x7f1e38149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.858+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 >> 172.21.15.144:0/2766250167 conn(0x7f1e3806bc10 msgr2=0x7f1e380cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.862+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 shutdown_connections 2024-09-12T12:16:54.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:54.862+0000 7f1e3ea00640 1 -- 172.21.15.144:0/2766250167 wait complete. 2024-09-12T12:16:54.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-12T12:16:55.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f980dc00640 1 Processor -- start 2024-09-12T12:16:55.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f980dc00640 1 -- start start 2024-09-12T12:16:55.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f980dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9808147cc0 0x7f980806e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f980dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f98081480a0 0x7f98080b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f980dc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f980806d220 con 0x7f9808072fa0 2024-09-12T12:16:55.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f980dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f980806e4e0 con 0x7f98081480a0 2024-09-12T12:16:55.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f980dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f980806d500 con 0x7f9808147cc0 2024-09-12T12:16:55.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f9807400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f98081480a0 0x7f98080b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f980d200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9808072fa0 0x7f9808162130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37512/0 (socket says 172.21.15.144:37512) 2024-09-12T12:16:55.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f980d200640 1 -- 172.21.15.144:0/2814663905 learned_addr learned my addr 172.21.15.144:0/2814663905 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:55.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.022+0000 7f9807400640 1 --2- 172.21.15.144:0/2814663905 >> v2:172.21.15.144:3300/0 conn(0x7f98081480a0 0x7f98080b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47432/0 (socket says 172.21.15.144:47432) 2024-09-12T12:16:55.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9807e00640 1 --2- 172.21.15.144:0/2814663905 >> v2:172.21.15.165:3300/0 conn(0x7f9808147cc0 0x7f980806e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9807400640 1 -- 172.21.15.144:0/2814663905 >> v2:172.21.15.165:3300/0 conn(0x7f9808147cc0 msgr2=0x7f980806e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:55.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9807400640 1 --2- 172.21.15.144:0/2814663905 >> v2:172.21.15.165:3300/0 conn(0x7f9808147cc0 0x7f980806e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9807400640 1 -- 172.21.15.144:0/2814663905 >> v1:172.21.15.144:6789/0 conn(0x7f9808072fa0 legacy=0x7f9808162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9807400640 1 -- 172.21.15.144:0/2814663905 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980806d7e0 con 0x7f98081480a0 2024-09-12T12:16:55.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9806a00640 1 -- 172.21.15.144:0/2814663905 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 787582673 0 0) 0x7f980806d220 con 0x7f9808072fa0 2024-09-12T12:16:55.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9807400640 1 --2- 172.21.15.144:0/2814663905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 0x7f98080b3fa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f98080d33c0 tx=0x7f97f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ea069c05090647 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:55.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9806a00640 1 -- 172.21.15.144:0/2814663905 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f40b2070 con 0x7f98081480a0 2024-09-12T12:16:55.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9806a00640 1 -- 172.21.15.144:0/2814663905 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f40ad640 con 0x7f98081480a0 2024-09-12T12:16:55.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f9806a00640 1 -- 172.21.15.144:0/2814663905 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f40ada10 con 0x7f98081480a0 2024-09-12T12:16:55.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f980dc00640 1 -- 172.21.15.144:0/2814663905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 msgr2=0x7f98080b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.026+0000 7f980dc00640 1 --2- 172.21.15.144:0/2814663905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 0x7f98080b3fa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f98080d33c0 tx=0x7f97f401c480 comp rx=0 tx=0).stop 2024-09-12T12:16:55.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 -- 172.21.15.144:0/2814663905 shutdown_connections 2024-09-12T12:16:55.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 --2- 172.21.15.144:0/2814663905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 0x7f98080b3fa0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 --2- 172.21.15.144:0/2814663905 >> v2:172.21.15.165:3300/0 conn(0x7f9808147cc0 0x7f980806e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 -- 172.21.15.144:0/2814663905 >> 172.21.15.144:0/2814663905 conn(0x7f98080b7c30 msgr2=0x7f9808067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:55.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 -- 172.21.15.144:0/2814663905 shutdown_connections 2024-09-12T12:16:55.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 -- 172.21.15.144:0/2814663905 wait complete. 2024-09-12T12:16:55.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 Processor -- start 2024-09-12T12:16:55.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 -- start start 2024-09-12T12:16:55.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9808072fa0 0x7f980813dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9808147cc0 0x7f980813e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 0x7f980815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f980816b6e0 con 0x7f98081480a0 2024-09-12T12:16:55.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98080b48f0 con 0x7f9808147cc0 2024-09-12T12:16:55.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f980816b860 con 0x7f9808072fa0 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 0x7f980815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 0x7f980815d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47436/0 (socket says 172.21.15.144:47436) 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980d200640 1 -- 172.21.15.144:0/2785382401 learned_addr learned my addr 172.21.15.144:0/2785382401 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f9807e00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9808072fa0 0x7f980813dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f9807400640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9808147cc0 0x7f980813e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980d200640 1 -- 172.21.15.144:0/2785382401 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9808072fa0 msgr2=0x7f980813dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980d200640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9808072fa0 0x7f980813dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980d200640 1 -- 172.21.15.144:0/2785382401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9808147cc0 msgr2=0x7f980813e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980d200640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9808147cc0 0x7f980813e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980d200640 1 -- 172.21.15.144:0/2785382401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98080d1a80 con 0x7f98081480a0 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f9807400640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9808147cc0 0x7f980813e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980d200640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 0x7f980815d4f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f980000c700 tx=0x7f980000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:55.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f97ffe00640 1 -- 172.21.15.144:0/2785382401 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800018070 con 0x7f98081480a0 2024-09-12T12:16:55.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f97ffe00640 1 -- 172.21.15.144:0/2785382401 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980000ce10 con 0x7f98081480a0 2024-09-12T12:16:55.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98080d1d60 con 0x7f98081480a0 2024-09-12T12:16:55.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.030+0000 7f97ffe00640 1 -- 172.21.15.144:0/2785382401 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980000a880 con 0x7f98081480a0 2024-09-12T12:16:55.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.034+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9808145b30 con 0x7f98081480a0 2024-09-12T12:16:55.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.034+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f980806e790 con 0x7f98081480a0 2024-09-12T12:16:55.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.034+0000 7f97ffe00640 1 -- 172.21.15.144:0/2785382401 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f980001b070 con 0x7f98081480a0 2024-09-12T12:16:55.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.034+0000 7f97ffe00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97e80678c0 0x7f97e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.034+0000 7f97ffe00640 1 -- 172.21.15.144:0/2785382401 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f98000851d0 con 0x7f98081480a0 2024-09-12T12:16:55.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.034+0000 7f9807e00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97e80678c0 0x7f97e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.034+0000 7f9807e00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97e80678c0 0x7f97e8069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9808070030 tx=0x7f97f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:55.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.038+0000 7f97ffe00640 1 -- 172.21.15.144:0/2785382401 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9800055d90 con 0x7f98081480a0 2024-09-12T12:16:55.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.198+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f9808141b30 con 0x7f98081480a0 2024-09-12T12:16:55.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.202+0000 7f97ffe00640 1 -- 172.21.15.144:0/2785382401 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v20) ==== 101+0+0 (secure 0 0 0) 0x7f9800055690 con 0x7f98081480a0 2024-09-12T12:16:55.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97e80678c0 msgr2=0x7f97e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97e80678c0 0x7f97e8069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9808070030 tx=0x7f97f8008040 comp rx=0 tx=0).stop 2024-09-12T12:16:55.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 msgr2=0x7f980815d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 0x7f980815d4f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f980000c700 tx=0x7f980000cbc0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 shutdown_connections 2024-09-12T12:16:55.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97e80678c0 0x7f97e8069d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98081480a0 0x7f980815d4f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9808147cc0 0x7f980813e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 --2- 172.21.15.144:0/2785382401 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9808072fa0 0x7f980813dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 >> 172.21.15.144:0/2785382401 conn(0x7f98080b7c30 msgr2=0x7f9808140800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:55.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 shutdown_connections 2024-09-12T12:16:55.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.206+0000 7f980dc00640 1 -- 172.21.15.144:0/2785382401 wait complete. 2024-09-12T12:16:55.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-12T12:16:55.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b1ec00640 1 Processor -- start 2024-09-12T12:16:55.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b1ec00640 1 -- start start 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b1ec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b1815af60 0x7f1b180ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b1ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180cd9f0 0x7f1b1806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b1ec00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b180b4300 con 0x7f1b1815b340 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b1ec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1b180b32f0 con 0x7f1b1815af60 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b1ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b180b3540 con 0x7f1b180cd9f0 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b17e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b1815af60 0x7f1b180ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b17e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b1815af60 0x7f1b180ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47448/0 (socket says 172.21.15.144:47448) 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b17e00640 1 -- 172.21.15.144:0/1235538451 learned_addr learned my addr 172.21.15.144:0/1235538451 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b17400640 1 --2- 172.21.15.144:0/1235538451 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180cd9f0 0x7f1b1806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b17e00640 1 -- 172.21.15.144:0/1235538451 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180cd9f0 msgr2=0x7f1b1806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b17e00640 1 --2- 172.21.15.144:0/1235538451 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180cd9f0 0x7f1b1806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b17e00640 1 -- 172.21.15.144:0/1235538451 >> v1:172.21.15.144:6789/0 conn(0x7f1b1815b340 legacy=0x7f1b1815ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.362+0000 7f1b17e00640 1 -- 172.21.15.144:0/1235538451 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b180b3820 con 0x7f1b1815af60 2024-09-12T12:16:55.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b17e00640 1 --2- 172.21.15.144:0/1235538451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1815af60 0x7f1b180ce680 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009870 tx=0x7f1b00020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfadd8235de900c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:55.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b16a00640 1 -- 172.21.15.144:0/1235538451 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b000b7070 con 0x7f1b1815af60 2024-09-12T12:16:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b16a00640 1 -- 172.21.15.144:0/1235538451 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b000aac60 con 0x7f1b1815af60 2024-09-12T12:16:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b16a00640 1 -- 172.21.15.144:0/1235538451 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b000b2660 con 0x7f1b1815af60 2024-09-12T12:16:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1235538451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1815af60 msgr2=0x7f1b180ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b1ec00640 1 --2- 172.21.15.144:0/1235538451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1815af60 0x7f1b180ce680 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009870 tx=0x7f1b00020f60 comp rx=0 tx=0).stop 2024-09-12T12:16:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1235538451 shutdown_connections 2024-09-12T12:16:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b1ec00640 1 --2- 172.21.15.144:0/1235538451 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180cd9f0 0x7f1b1806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b1ec00640 1 --2- 172.21.15.144:0/1235538451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1815af60 0x7f1b180ce680 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1235538451 >> 172.21.15.144:0/1235538451 conn(0x7f1b18068030 msgr2=0x7f1b180b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1235538451 shutdown_connections 2024-09-12T12:16:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.366+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1235538451 wait complete. 2024-09-12T12:16:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 Processor -- start 2024-09-12T12:16:55.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 -- start start 2024-09-12T12:16:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180cd9f0 0x7f1b180b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815af60 0x7f1b18148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815b340 0x7f1b1814c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b180b5570 con 0x7f1b180cd9f0 2024-09-12T12:16:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b180b3de0 con 0x7f1b1815b340 2024-09-12T12:16:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b180cebc0 con 0x7f1b1815af60 2024-09-12T12:16:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180cd9f0 0x7f1b180b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180cd9f0 0x7f1b180b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47460/0 (socket says 172.21.15.144:47460) 2024-09-12T12:16:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17e00640 1 -- 172.21.15.144:0/1661578457 learned_addr learned my addr 172.21.15.144:0/1661578457 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17400640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815af60 0x7f1b18148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1cc00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815b340 0x7f1b1814c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17e00640 1 -- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815af60 msgr2=0x7f1b18148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17e00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815af60 0x7f1b18148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17e00640 1 -- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815b340 msgr2=0x7f1b1814c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17e00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815b340 0x7f1b1814c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17e00640 1 -- 172.21.15.144:0/1661578457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b180b1250 con 0x7f1b180cd9f0 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17400640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815af60 0x7f1b18148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1cc00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815b340 0x7f1b1814c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b17e00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180cd9f0 0x7f1b180b0c70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1b000b5040 tx=0x7f1b0001dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b0fe00640 1 -- 172.21.15.144:0/1661578457 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b000c0070 con 0x7f1b180cd9f0 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b0fe00640 1 -- 172.21.15.144:0/1661578457 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b000aaa60 con 0x7f1b180cd9f0 2024-09-12T12:16:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b0fe00640 1 -- 172.21.15.144:0/1661578457 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b000b7030 con 0x7f1b180cd9f0 2024-09-12T12:16:55.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1814b710 con 0x7f1b180cd9f0 2024-09-12T12:16:55.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.370+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1814bcd0 con 0x7f1b180cd9f0 2024-09-12T12:16:55.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.374+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b180ce680 con 0x7f1b180cd9f0 2024-09-12T12:16:55.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.374+0000 7f1b0fe00640 1 -- 172.21.15.144:0/1661578457 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b000b07b0 con 0x7f1b180cd9f0 2024-09-12T12:16:55.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.374+0000 7f1b0fe00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1af40678c0 0x7f1af4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.374+0000 7f1b0fe00640 1 -- 172.21.15.144:0/1661578457 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f1b00122f30 con 0x7f1b180cd9f0 2024-09-12T12:16:55.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.374+0000 7f1b17400640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1af40678c0 0x7f1af4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.374+0000 7f1b17400640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1af40678c0 0x7f1af4069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1b180af510 tx=0x7f1b08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:55.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.378+0000 7f1b0fe00640 1 -- 172.21.15.144:0/1661578457 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1b0001aac0 con 0x7f1b180cd9f0 2024-09-12T12:16:55.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.550+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7f1b180cd7b0 con 0x7f1b180cd9f0 2024-09-12T12:16:55.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.554+0000 7f1b0fe00640 1 -- 172.21.15.144:0/1661578457 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v21) ==== 101+0+0 (secure 0 0 0) 0x7f1b000f3b90 con 0x7f1b180cd9f0 2024-09-12T12:16:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1af40678c0 msgr2=0x7f1af4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1af40678c0 0x7f1af4069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1b180af510 tx=0x7f1b08008040 comp rx=0 tx=0).stop 2024-09-12T12:16:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180cd9f0 msgr2=0x7f1b180b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180cd9f0 0x7f1b180b0c70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1b000b5040 tx=0x7f1b0001dd00 comp rx=0 tx=0).stop 2024-09-12T12:16:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 shutdown_connections 2024-09-12T12:16:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1af40678c0 0x7f1af4069d80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815b340 0x7f1b1814c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815af60 0x7f1b18148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 --2- 172.21.15.144:0/1661578457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180cd9f0 0x7f1b180b0c70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 >> 172.21.15.144:0/1661578457 conn(0x7f1b18068030 msgr2=0x7f1b1814fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 shutdown_connections 2024-09-12T12:16:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.558+0000 7f1b1ec00640 1 -- 172.21.15.144:0/1661578457 wait complete. 2024-09-12T12:16:55.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:16:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.714+0000 7fbd77e00640 1 Processor -- start 2024-09-12T12:16:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.714+0000 7fbd77e00640 1 -- start start 2024-09-12T12:16:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd77e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbd700af5f0 0x7fbd7006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd77e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd700733e0 con 0x7fbd7015c2e0 2024-09-12T12:16:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd77e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd700cd290 con 0x7fbd7006c150 2024-09-12T12:16:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd77e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbd7006c5c0 con 0x7fbd700af5f0 2024-09-12T12:16:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd75400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbd7015c2e0 0x7fbd70072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37532/0 (socket says 172.21.15.144:37532) 2024-09-12T12:16:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd75400640 1 -- 172.21.15.144:0/218037854 learned_addr learned my addr 172.21.15.144:0/218037854 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd74a00640 1 --2- 172.21.15.144:0/218037854 >> v2:172.21.15.165:3300/0 conn(0x7fbd700af5f0 0x7fbd7006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453639017 0 0) 0x7fbd700733e0 con 0x7fbd7015c2e0 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd58003530 con 0x7fbd7015c2e0 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2010237504 0 0) 0x7fbd58003530 con 0x7fbd7015c2e0 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 >> v2:172.21.15.165:3300/0 conn(0x7fbd700af5f0 msgr2=0x7fbd7006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 --2- 172.21.15.144:0/218037854 >> v2:172.21.15.165:3300/0 conn(0x7fbd700af5f0 0x7fbd7006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 >> v1:172.21.15.165:6789/0 conn(0x7fbd7006c150 legacy=0x7fbd700cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd700cd570 con 0x7fbd7015c2e0 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fbd64001a00 con 0x7fbd7015c2e0 2024-09-12T12:16:55.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd74a00640 1 --2- 172.21.15.144:0/218037854 >> v2:172.21.15.165:3300/0 conn(0x7fbd700af5f0 0x7fbd7006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 >> v1:172.21.15.144:6789/0 conn(0x7fbd7015c2e0 legacy=0x7fbd70072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd580039c0 0x7fbd58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd58004810 0x7fbd58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7006c5c0 con 0x7fbd58005220 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5800c170 con 0x7fbd58004810 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5800c370 con 0x7fbd580039c0 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd75e00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd74a00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd58004810 0x7fbd58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd75400640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd580039c0 0x7fbd58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd75e00640 1 -- 172.21.15.144:0/218037854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd580039c0 msgr2=0x7fbd58003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd75e00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd580039c0 0x7fbd58003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd75e00640 1 -- 172.21.15.144:0/218037854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd58004810 msgr2=0x7fbd58004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd75e00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd58004810 0x7fbd58004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.718+0000 7fbd75e00640 1 -- 172.21.15.144:0/218037854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd58003530 con 0x7fbd58005220 2024-09-12T12:16:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd75e00640 1 -- 172.21.15.144:0/218037854 reap_dead start 2024-09-12T12:16:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd75e00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd5800b9d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbd68001860 tx=0x7fbd6801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc46f553fc36d00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68001460 con 0x7fbd58005220 2024-09-12T12:16:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd680052d0 con 0x7fbd58005220 2024-09-12T12:16:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd6fe00640 1 -- 172.21.15.144:0/218037854 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd680a88b0 con 0x7fbd58005220 2024-09-12T12:16:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd77e00640 1 -- 172.21.15.144:0/218037854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 msgr2=0x7fbd5800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd77e00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd5800b9d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbd68001860 tx=0x7fbd6801ec70 comp rx=0 tx=0).stop 2024-09-12T12:16:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd77e00640 1 -- 172.21.15.144:0/218037854 shutdown_connections 2024-09-12T12:16:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd77e00640 1 --2- 172.21.15.144:0/218037854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd5800b9d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd77e00640 1 -- 172.21.15.144:0/218037854 >> 172.21.15.144:0/218037854 conn(0x7fbd70068030 msgr2=0x7fbd700b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd77e00640 1 -- 172.21.15.144:0/218037854 shutdown_connections 2024-09-12T12:16:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.722+0000 7fbd77e00640 1 -- 172.21.15.144:0/218037854 wait complete. 2024-09-12T12:16:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 Processor -- start 2024-09-12T12:16:55.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 -- start start 2024-09-12T12:16:55.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd7014d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd70154100 0x7fbd70154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd700cdc70 0x7fbd700ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7015c6c0 con 0x7fbd58005220 2024-09-12T12:16:55.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7006bc10 con 0x7fbd70154100 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbd70155230 con 0x7fbd700cdc70 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd7014d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd7014d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47478/0 (socket says 172.21.15.144:47478) 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75400640 1 -- 172.21.15.144:0/213705607 learned_addr learned my addr 172.21.15.144:0/213705607 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75e00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd700cdc70 0x7fbd700ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd74a00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd70154100 0x7fbd70154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75400640 1 -- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd700cdc70 msgr2=0x7fbd700ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75400640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd700cdc70 0x7fbd700ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75400640 1 -- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd70154100 msgr2=0x7fbd70154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75400640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd70154100 0x7fbd70154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75400640 1 -- 172.21.15.144:0/213705607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7014e450 con 0x7fbd58005220 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75e00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd700cdc70 0x7fbd700ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:55.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd74a00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd70154100 0x7fbd70154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd75400640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd7014d940 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbd64007710 tx=0x7fbd64007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd6d600640 1 -- 172.21.15.144:0/213705607 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6400abe0 con 0x7fbd58005220 2024-09-12T12:16:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd6d600640 1 -- 172.21.15.144:0/213705607 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd64018070 con 0x7fbd58005220 2024-09-12T12:16:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd70154c70 con 0x7fbd58005220 2024-09-12T12:16:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd6d600640 1 -- 172.21.15.144:0/213705607 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd640133f0 con 0x7fbd58005220 2024-09-12T12:16:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd7015ca70 con 0x7fbd58005220 2024-09-12T12:16:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.726+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd700ce630 con 0x7fbd58005220 2024-09-12T12:16:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.730+0000 7fbd6d600640 1 -- 172.21.15.144:0/213705607 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd64013590 con 0x7fbd58005220 2024-09-12T12:16:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.730+0000 7fbd6d600640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd500678f0 0x7fbd50069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.730+0000 7fbd6d600640 1 -- 172.21.15.144:0/213705607 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7fbd64086100 con 0x7fbd58005220 2024-09-12T12:16:55.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.730+0000 7fbd74a00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd500678f0 0x7fbd50069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:55.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.730+0000 7fbd74a00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd500678f0 0x7fbd50069db0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd700b4ed0 tx=0x7fbd5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:55.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.734+0000 7fbd6d600640 1 -- 172.21.15.144:0/213705607 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbd64056df0 con 0x7fbd58005220 2024-09-12T12:16:55.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.894+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbd70072b50 con 0x7fbd58005220 2024-09-12T12:16:55.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.898+0000 7fbd6d600640 1 -- 172.21.15.144:0/213705607 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7fbd640566f0 con 0x7fbd58005220 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd500678f0 msgr2=0x7fbd50069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd500678f0 0x7fbd50069db0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd700b4ed0 tx=0x7fbd5c008040 comp rx=0 tx=0).stop 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 msgr2=0x7fbd7014d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd7014d940 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbd64007710 tx=0x7fbd64007bd0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 shutdown_connections 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd500678f0 0x7fbd50069db0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd700cdc70 0x7fbd700ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd70154100 0x7fbd70154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 --2- 172.21.15.144:0/213705607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd58005220 0x7fbd7014d940 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 >> 172.21.15.144:0/213705607 conn(0x7fbd70068030 msgr2=0x7fbd700ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:55.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 shutdown_connections 2024-09-12T12:16:55.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:55.902+0000 7fbd77e00640 1 -- 172.21.15.144:0/213705607 wait complete. 2024-09-12T12:16:55.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-12T12:16:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73bba00640 1 Processor -- start 2024-09-12T12:16:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73bba00640 1 -- start start 2024-09-12T12:16:56.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73bba00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f73b40cd9f0 0x7f73b406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73bba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b415b340 0x7f73b406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73bba00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73b40b4300 con 0x7f73b415af60 2024-09-12T12:16:56.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73bba00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f73b40b32f0 con 0x7f73b40cd9f0 2024-09-12T12:16:56.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73bba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73b40b3540 con 0x7f73b415b340 2024-09-12T12:16:56.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73b9000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f73b415af60 0x7f73b40ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37534/0 (socket says 172.21.15.144:37534) 2024-09-12T12:16:56.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73b9000640 1 -- 172.21.15.144:0/1367922298 learned_addr learned my addr 172.21.15.144:0/1367922298 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:56.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73b3e00640 1 --2- 172.21.15.144:0/1367922298 >> v2:172.21.15.165:3300/0 conn(0x7f73b40cd9f0 0x7f73b406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73b9a00640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b415b340 0x7f73b406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837651319 0 0) 0x7f73b40b4300 con 0x7f73b415af60 2024-09-12T12:16:56.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.058+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7398005740 con 0x7f73b415af60 2024-09-12T12:16:56.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1075650943 0 0) 0x7f7398005740 con 0x7f73b415af60 2024-09-12T12:16:56.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b415b340 msgr2=0x7f73b406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:56.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b415b340 0x7f73b406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 >> v2:172.21.15.165:3300/0 conn(0x7f73b40cd9f0 msgr2=0x7f73b406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 --2- 172.21.15.144:0/1367922298 >> v2:172.21.15.165:3300/0 conn(0x7f73b40cd9f0 0x7f73b406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b40b3820 con 0x7f73b415af60 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f73a4001a00 con 0x7f73b415af60 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3e00640 1 --2- 172.21.15.144:0/1367922298 >> v2:172.21.15.165:3300/0 conn(0x7f73b40cd9f0 0x7f73b406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 >> v1:172.21.15.144:6789/0 conn(0x7f73b415af60 legacy=0x7f73b40ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7398005bd0 0x7f7398005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b415b340 0x7f7398006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f7398006f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40b32f0 con 0x7f7398006530 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40b3540 con 0x7f7398005bd0 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7398007780 con 0x7f73b415b340 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b9a00640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f7398006f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b9000640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7398005bd0 0x7f7398005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b3e00640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b415b340 0x7f7398006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b9a00640 1 -- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b415b340 msgr2=0x7f7398006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:56.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b9a00640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b415b340 0x7f7398006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b9a00640 1 -- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7398005bd0 msgr2=0x7f7398005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:56.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b9a00640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7398005bd0 0x7f7398005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b9a00640 1 -- 172.21.15.144:0/1367922298 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7398005740 con 0x7f7398006530 2024-09-12T12:16:56.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.062+0000 7f73b9a00640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f7398006f60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009ae0 tx=0x7f73ac01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8985a6052498e50d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:56.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0b2070 con 0x7f7398006530 2024-09-12T12:16:56.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac0a5660 con 0x7f7398006530 2024-09-12T12:16:56.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73b3400640 1 -- 172.21.15.144:0/1367922298 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0096b0 con 0x7f7398006530 2024-09-12T12:16:56.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 -- 172.21.15.144:0/1367922298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 msgr2=0x7f7398006f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 --2- 172.21.15.144:0/1367922298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f7398006f60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009ae0 tx=0x7f73ac01ca70 comp rx=0 tx=0).stop 2024-09-12T12:16:56.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73b9a00640 1 -- 172.21.15.144:0/1367922298 reap_dead start 2024-09-12T12:16:56.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 -- 172.21.15.144:0/1367922298 shutdown_connections 2024-09-12T12:16:56.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 -- 172.21.15.144:0/1367922298 >> 172.21.15.144:0/1367922298 conn(0x7f73b4068030 msgr2=0x7f73b40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:56.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 -- 172.21.15.144:0/1367922298 shutdown_connections 2024-09-12T12:16:56.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 -- 172.21.15.144:0/1367922298 wait complete. 2024-09-12T12:16:56.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 Processor -- start 2024-09-12T12:16:56.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 -- start start 2024-09-12T12:16:56.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f73b414c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73b414cbd0 0x7f73b4158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b414d120 0x7f73b4158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f73b406c150 con 0x7f7398006530 2024-09-12T12:16:56.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40b3de0 con 0x7f73b414cbd0 2024-09-12T12:16:56.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73bba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73b406c2d0 con 0x7f73b414d120 2024-09-12T12:16:56.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73b9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f73b414c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73b9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f73b414c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47488/0 (socket says 172.21.15.144:47488) 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73b9000640 1 -- 172.21.15.144:0/1521400978 learned_addr learned my addr 172.21.15.144:0/1521400978 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73b3e00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73b414cbd0 0x7f73b4158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.066+0000 7f73b9a00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b414d120 0x7f73b4158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b9000640 1 -- 172.21.15.144:0/1521400978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b414d120 msgr2=0x7f73b4158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b9000640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b414d120 0x7f73b4158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b9000640 1 -- 172.21.15.144:0/1521400978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73b414cbd0 msgr2=0x7f73b4158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b9000640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73b414cbd0 0x7f73b4158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b9000640 1 -- 172.21.15.144:0/1521400978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b415b810 con 0x7f7398006530 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b3e00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73b414cbd0 0x7f73b4158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b9000640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f73b414c3e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f73a4002090 tx=0x7f73a400a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b0c00640 1 -- 172.21.15.144:0/1521400978 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4017020 con 0x7f7398006530 2024-09-12T12:16:56.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b0c00640 1 -- 172.21.15.144:0/1521400978 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a4007ab0 con 0x7f7398006530 2024-09-12T12:16:56.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b0c00640 1 -- 172.21.15.144:0/1521400978 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a400ae60 con 0x7f7398006530 2024-09-12T12:16:56.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b415baf0 con 0x7f7398006530 2024-09-12T12:16:56.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b415c0b0 con 0x7f7398006530 2024-09-12T12:16:56.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b406bc10 con 0x7f7398006530 2024-09-12T12:16:56.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b0c00640 1 -- 172.21.15.144:0/1521400978 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73a401a020 con 0x7f7398006530 2024-09-12T12:16:56.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b0c00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73940678f0 0x7f7394069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b0c00640 1 -- 172.21.15.144:0/1521400978 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f73a40865a0 con 0x7f7398006530 2024-09-12T12:16:56.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.070+0000 7f73b3e00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73940678f0 0x7f7394069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.074+0000 7f73b3e00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73940678f0 0x7f7394069db0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f73b40cf1e0 tx=0x7f73a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:56.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.074+0000 7f73b0c00640 1 -- 172.21.15.144:0/1521400978 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f73a4021020 con 0x7f7398006530 2024-09-12T12:16:56.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.242+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f73b40b0da0 con 0x7f7398006530 2024-09-12T12:16:56.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73b0c00640 1 -- 172.21.15.144:0/1521400978 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v23) ==== 101+0+0 (secure 0 0 0) 0x7f73a4057290 con 0x7f7398006530 2024-09-12T12:16:56.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73940678f0 msgr2=0x7f7394069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73940678f0 0x7f7394069db0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f73b40cf1e0 tx=0x7f73a0008040 comp rx=0 tx=0).stop 2024-09-12T12:16:56.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 msgr2=0x7f73b414c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f73b414c3e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f73a4002090 tx=0x7f73a400a750 comp rx=0 tx=0).stop 2024-09-12T12:16:56.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 shutdown_connections 2024-09-12T12:16:56.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73940678f0 0x7f7394069db0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73b414d120 0x7f73b4158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73b414cbd0 0x7f73b4158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 --2- 172.21.15.144:0/1521400978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7398006530 0x7f73b414c3e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 >> 172.21.15.144:0/1521400978 conn(0x7f73b4068030 msgr2=0x7f73b40b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 shutdown_connections 2024-09-12T12:16:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.246+0000 7f73bba00640 1 -- 172.21.15.144:0/1521400978 wait complete. 2024-09-12T12:16:56.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-12T12:16:56.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.402+0000 7f6a2d000640 1 Processor -- start 2024-09-12T12:16:56.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.402+0000 7f6a2d000640 1 -- start start 2024-09-12T12:16:56.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a2d000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6a2815b4e0 0x7f6a280b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a2d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a280b3ad0 0x7f6a28071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a2d000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a280b45a0 con 0x7f6a28071960 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a2d000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6a280b3fe0 con 0x7f6a280b3ad0 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a2d000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6a280b42c0 con 0x7f6a2815b4e0 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a25400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a280b3ad0 0x7f6a28071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a25400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a280b3ad0 0x7f6a28071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47500/0 (socket says 172.21.15.144:47500) 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a25400640 1 -- 172.21.15.144:0/1580938947 learned_addr learned my addr 172.21.15.144:0/1580938947 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a25e00640 1 --2- 172.21.15.144:0/1580938947 >> v2:172.21.15.165:3300/0 conn(0x7f6a2815b4e0 0x7f6a280b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a25400640 1 -- 172.21.15.144:0/1580938947 >> v2:172.21.15.165:3300/0 conn(0x7f6a2815b4e0 msgr2=0x7f6a280b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a25400640 1 --2- 172.21.15.144:0/1580938947 >> v2:172.21.15.165:3300/0 conn(0x7f6a2815b4e0 0x7f6a280b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a25400640 1 -- 172.21.15.144:0/1580938947 >> v1:172.21.15.165:6789/0 conn(0x7f6a28071960 legacy=0x7f6a280ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a25400640 1 -- 172.21.15.144:0/1580938947 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a280b1490 con 0x7f6a280b3ad0 2024-09-12T12:16:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.406+0000 7f6a25e00640 1 --2- 172.21.15.144:0/1580938947 >> v2:172.21.15.165:3300/0 conn(0x7f6a2815b4e0 0x7f6a280b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a25400640 1 --2- 172.21.15.144:0/1580938947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 0x7f6a28071420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6a28069450 tx=0x7f6a1401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de69366921452ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a24a00640 1 -- 172.21.15.144:0/1580938947 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a140aa670 con 0x7f6a280b3ad0 2024-09-12T12:16:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a24a00640 1 -- 172.21.15.144:0/1580938947 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a140af070 con 0x7f6a280b3ad0 2024-09-12T12:16:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a24a00640 1 -- 172.21.15.144:0/1580938947 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a140aaa30 con 0x7f6a280b3ad0 2024-09-12T12:16:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 -- 172.21.15.144:0/1580938947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 msgr2=0x7f6a28071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 --2- 172.21.15.144:0/1580938947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 0x7f6a28071420 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6a28069450 tx=0x7f6a1401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 -- 172.21.15.144:0/1580938947 shutdown_connections 2024-09-12T12:16:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 --2- 172.21.15.144:0/1580938947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 0x7f6a28071420 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 --2- 172.21.15.144:0/1580938947 >> v2:172.21.15.165:3300/0 conn(0x7f6a2815b4e0 0x7f6a280b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 -- 172.21.15.144:0/1580938947 >> 172.21.15.144:0/1580938947 conn(0x7f6a2806d0d0 msgr2=0x7f6a2806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 -- 172.21.15.144:0/1580938947 shutdown_connections 2024-09-12T12:16:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 -- 172.21.15.144:0/1580938947 wait complete. 2024-09-12T12:16:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 Processor -- start 2024-09-12T12:16:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 -- start start 2024-09-12T12:16:56.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a28071960 0x7f6a28141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 0x7f6a28153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a2815b4e0 0x7f6a28160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a280b2620 con 0x7f6a280b3ad0 2024-09-12T12:16:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6a280b24a0 con 0x7f6a28071960 2024-09-12T12:16:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.410+0000 7f6a2d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6a280cd640 con 0x7f6a2815b4e0 2024-09-12T12:16:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 0x7f6a28153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 0x7f6a28153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47506/0 (socket says 172.21.15.144:47506) 2024-09-12T12:16:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25400640 1 -- 172.21.15.144:0/2425312851 learned_addr learned my addr 172.21.15.144:0/2425312851 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25e00640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a28071960 0x7f6a28141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a26800640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a2815b4e0 0x7f6a28160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25400640 1 -- 172.21.15.144:0/2425312851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a2815b4e0 msgr2=0x7f6a28160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25400640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a2815b4e0 0x7f6a28160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25400640 1 -- 172.21.15.144:0/2425312851 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a28071960 msgr2=0x7f6a28141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25400640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a28071960 0x7f6a28141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25400640 1 -- 172.21.15.144:0/2425312851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a281546d0 con 0x7f6a280b3ad0 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a25400640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 0x7f6a28153dd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6a14019100 tx=0x7f6a1401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a1e000640 1 -- 172.21.15.144:0/2425312851 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a140bd5f0 con 0x7f6a280b3ad0 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a1e000640 1 -- 172.21.15.144:0/2425312851 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a140bd790 con 0x7f6a280b3ad0 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a1e000640 1 -- 172.21.15.144:0/2425312851 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a140bdb40 con 0x7f6a280b3ad0 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a281549b0 con 0x7f6a280b3ad0 2024-09-12T12:16:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a28154f70 con 0x7f6a280b3ad0 2024-09-12T12:16:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a28071420 con 0x7f6a280b3ad0 2024-09-12T12:16:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.414+0000 7f6a1e000640 1 -- 172.21.15.144:0/2425312851 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6a140b33f0 con 0x7f6a280b3ad0 2024-09-12T12:16:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.418+0000 7f6a1e000640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6a080678c0 0x7f6a08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.418+0000 7f6a1e000640 1 -- 172.21.15.144:0/2425312851 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f6a14120780 con 0x7f6a280b3ad0 2024-09-12T12:16:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.418+0000 7f6a25e00640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6a080678c0 0x7f6a08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.418+0000 7f6a25e00640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6a080678c0 0x7f6a08069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800b930 tx=0x7f6a18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:56.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.422+0000 7f6a1e000640 1 -- 172.21.15.144:0/2425312851 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6a14016110 con 0x7f6a280b3ad0 2024-09-12T12:16:56.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.634+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f6a280b29b0 con 0x7f6a280b3ad0 2024-09-12T12:16:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.866+0000 7f6a1e000640 1 -- 172.21.15.144:0/2425312851 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v219) ==== 151+0+0 (secure 0 0 0) 0x7f6a140f0cf0 con 0x7f6a280b3ad0 2024-09-12T12:16:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6a080678c0 msgr2=0x7f6a08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6a080678c0 0x7f6a08069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800b930 tx=0x7f6a18008040 comp rx=0 tx=0).stop 2024-09-12T12:16:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 msgr2=0x7f6a28153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 0x7f6a28153dd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6a14019100 tx=0x7f6a1401ad30 comp rx=0 tx=0).stop 2024-09-12T12:16:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 shutdown_connections 2024-09-12T12:16:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6a080678c0 0x7f6a08069d80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a2815b4e0 0x7f6a28160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a280b3ad0 0x7f6a28153dd0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 --2- 172.21.15.144:0/2425312851 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a28071960 0x7f6a28141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 >> 172.21.15.144:0/2425312851 conn(0x7f6a2806d0d0 msgr2=0x7f6a280b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 shutdown_connections 2024-09-12T12:16:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:56.870+0000 7f6a2d000640 1 -- 172.21.15.144:0/2425312851 wait complete. 2024-09-12T12:16:56.893 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-09-12T12:16:56.894 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-12T12:16:56.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:16:57.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.026+0000 7f0c91e00640 1 Processor -- start 2024-09-12T12:16:57.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c91e00640 1 -- start start 2024-09-12T12:16:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c91e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c8c073bd0 0x7f0c8c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c91e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8c0cd1d0 con 0x7f0c8c0cff90 2024-09-12T12:16:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c91e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8c0cd4a0 con 0x7f0c8c15b160 2024-09-12T12:16:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c91e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0c8c15b540 con 0x7f0c8c073bd0 2024-09-12T12:16:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c8be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c8c073bd0 0x7f0c8c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c8be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c8c073bd0 0x7f0c8c070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47516/0 (socket says 172.21.15.144:47516) 2024-09-12T12:16:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c8be00640 1 -- 172.21.15.144:0/743638131 learned_addr learned my addr 172.21.15.144:0/743638131 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c91400640 1 --1- 172.21.15.144:0/743638131 >> v1:172.21.15.144:6789/0 conn(0x7f0c8c0cff90 0x7f0c8c0b3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37540/0 (socket says 172.21.15.144:37540) 2024-09-12T12:16:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c8be00640 1 -- 172.21.15.144:0/743638131 >> v1:172.21.15.165:6789/0 conn(0x7f0c8c15b160 legacy=0x7f0c8c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c8be00640 1 -- 172.21.15.144:0/743638131 >> v1:172.21.15.144:6789/0 conn(0x7f0c8c0cff90 legacy=0x7f0c8c0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.030+0000 7f0c8be00640 1 -- 172.21.15.144:0/743638131 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c0cd780 con 0x7f0c8c073bd0 2024-09-12T12:16:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c8be00640 1 --2- 172.21.15.144:0/743638131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c073bd0 0x7f0c8c070ee0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009870 tx=0x7f0c7801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e72253e160fdb94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c8b400640 1 -- 172.21.15.144:0/743638131 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780b2070 con 0x7f0c8c073bd0 2024-09-12T12:16:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c8b400640 1 -- 172.21.15.144:0/743638131 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c780a9070 con 0x7f0c8c073bd0 2024-09-12T12:16:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c8b400640 1 -- 172.21.15.144:0/743638131 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780ad880 con 0x7f0c8c073bd0 2024-09-12T12:16:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c91e00640 1 -- 172.21.15.144:0/743638131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c073bd0 msgr2=0x7f0c8c070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c91e00640 1 --2- 172.21.15.144:0/743638131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c073bd0 0x7f0c8c070ee0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009870 tx=0x7f0c7801c4d0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c91e00640 1 -- 172.21.15.144:0/743638131 shutdown_connections 2024-09-12T12:16:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c91e00640 1 --2- 172.21.15.144:0/743638131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c073bd0 0x7f0c8c070ee0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c91e00640 1 -- 172.21.15.144:0/743638131 >> 172.21.15.144:0/743638131 conn(0x7f0c8c06bc10 msgr2=0x7f0c8c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c91e00640 1 -- 172.21.15.144:0/743638131 shutdown_connections 2024-09-12T12:16:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c91e00640 1 -- 172.21.15.144:0/743638131 wait complete. 2024-09-12T12:16:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c91e00640 1 Processor -- start 2024-09-12T12:16:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.034+0000 7f0c91e00640 1 -- start start 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c8c073bd0 0x7f0c8c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c0cff90 0x7f0c8c1496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c8c15b160 0x7f0c8c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c168f80 con 0x7f0c8c0cff90 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c168e00 con 0x7f0c8c073bd0 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c169100 con 0x7f0c8c15b160 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c8be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c0cff90 0x7f0c8c1496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c8be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c0cff90 0x7f0c8c1496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47524/0 (socket says 172.21.15.144:47524) 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c8be00640 1 -- 172.21.15.144:0/2800214233 learned_addr learned my addr 172.21.15.144:0/2800214233 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c90a00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c8c073bd0 0x7f0c8c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91400640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c8c15b160 0x7f0c8c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c8be00640 1 -- 172.21.15.144:0/2800214233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c8c15b160 msgr2=0x7f0c8c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c8be00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c8c15b160 0x7f0c8c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c8be00640 1 -- 172.21.15.144:0/2800214233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c8c073bd0 msgr2=0x7f0c8c0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c8be00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c8c073bd0 0x7f0c8c0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c8be00640 1 -- 172.21.15.144:0/2800214233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c14e7b0 con 0x7f0c8c0cff90 2024-09-12T12:16:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c90a00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c8c073bd0 0x7f0c8c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:57.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c8be00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c0cff90 0x7f0c8c1496b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0c780b0040 tx=0x7f0c78019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:57.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c88c00640 1 -- 172.21.15.144:0/2800214233 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780b2040 con 0x7f0c8c0cff90 2024-09-12T12:16:57.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c88c00640 1 -- 172.21.15.144:0/2800214233 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c780b6640 con 0x7f0c8c0cff90 2024-09-12T12:16:57.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c88c00640 1 -- 172.21.15.144:0/2800214233 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780b6a30 con 0x7f0c8c0cff90 2024-09-12T12:16:57.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8c0b2240 con 0x7f0c8c0cff90 2024-09-12T12:16:57.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8c0b2800 con 0x7f0c8c0cff90 2024-09-12T12:16:57.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.038+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8c070ee0 con 0x7f0c8c0cff90 2024-09-12T12:16:57.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.042+0000 7f0c88c00640 1 -- 172.21.15.144:0/2800214233 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c780ab070 con 0x7f0c8c0cff90 2024-09-12T12:16:57.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.042+0000 7f0c88c00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c6c0678c0 0x7f0c6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.042+0000 7f0c88c00640 1 -- 172.21.15.144:0/2800214233 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f0c7811f890 con 0x7f0c8c0cff90 2024-09-12T12:16:57.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.042+0000 7f0c90a00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c6c0678c0 0x7f0c6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.042+0000 7f0c90a00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c6c0678c0 0x7f0c6c069d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c001e10 tx=0x7f0c7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:57.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.046+0000 7f0c88c00640 1 -- 172.21.15.144:0/2800214233 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0c78016150 con 0x7f0c8c0cff90 2024-09-12T12:16:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c8c154550 con 0x7f0c8c0cff90 2024-09-12T12:16:57.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c88c00640 1 -- 172.21.15.144:0/2800214233 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+13462 (secure 0 0 0) 0x7f0c780f0580 con 0x7f0c8c0cff90 2024-09-12T12:16:57.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:57.209 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":74,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:16:54.859848+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/3811906714":"2024-09-13T12:16:51.754603+0000","172.21.15.144:6834/3811906714":"2024-09-13T12:16:51.754603+0000","172.21.15.165:6835/799094061":"2024-09-13T12:16:35.863459+0000","172.21.15.165:6833/799094061":"2024-09-13T12:16:35.863459+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c6c0678c0 msgr2=0x7f0c6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c6c0678c0 0x7f0c6c069d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c001e10 tx=0x7f0c7c009040 comp rx=0 tx=0).stop 2024-09-12T12:16:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c0cff90 msgr2=0x7f0c8c1496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c0cff90 0x7f0c8c1496b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f0c780b0040 tx=0x7f0c78019270 comp rx=0 tx=0).stop 2024-09-12T12:16:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 shutdown_connections 2024-09-12T12:16:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c6c0678c0 0x7f0c6c069d80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c8c15b160 0x7f0c8c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c8c0cff90 0x7f0c8c1496b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 --2- 172.21.15.144:0/2800214233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c8c073bd0 0x7f0c8c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 >> 172.21.15.144:0/2800214233 conn(0x7f0c8c06bc10 msgr2=0x7f0c8c154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 shutdown_connections 2024-09-12T12:16:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.206+0000 7f0c91e00640 1 -- 172.21.15.144:0/2800214233 wait complete. 2024-09-12T12:16:57.230 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:16:57.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:16:57.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.366+0000 7f3c2ca00640 1 Processor -- start 2024-09-12T12:16:57.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.366+0000 7f3c2ca00640 1 -- start start 2024-09-12T12:16:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.366+0000 7f3c2ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c28155810 0x7f3c2815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.366+0000 7f3c2ca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2815fa70 con 0x7f3c280b1e10 2024-09-12T12:16:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.366+0000 7f3c2ca00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2815c5f0 con 0x7f3c280b2280 2024-09-12T12:16:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.366+0000 7f3c2ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3c2815c820 con 0x7f3c28155810 2024-09-12T12:16:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.366+0000 7f3c26800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c28155810 0x7f3c2815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.366+0000 7f3c26800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c28155810 0x7f3c2815c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58728/0 (socket says 172.21.15.144:58728) 2024-09-12T12:16:57.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.366+0000 7f3c26800640 1 -- 172.21.15.144:0/736730208 learned_addr learned my addr 172.21.15.144:0/736730208 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.370+0000 7f3c26800640 1 -- 172.21.15.144:0/736730208 >> v1:172.21.15.165:6789/0 conn(0x7f3c280b2280 legacy=0x7f3c2815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.370+0000 7f3c26800640 1 -- 172.21.15.144:0/736730208 >> v1:172.21.15.144:6789/0 conn(0x7f3c280b1e10 legacy=0x7f3c2815ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.370+0000 7f3c26800640 1 -- 172.21.15.144:0/736730208 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c280b2710 con 0x7f3c28155810 2024-09-12T12:16:57.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.370+0000 7f3c26800640 1 --2- 172.21.15.144:0/736730208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c28155810 0x7f3c2815c0b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800bb10 tx=0x7f3c180213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f7565e4ab25f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:57.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.370+0000 7f3c25400640 1 -- 172.21.15.144:0/736730208 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180b6070 con 0x7f3c28155810 2024-09-12T12:16:57.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.370+0000 7f3c25400640 1 -- 172.21.15.144:0/736730208 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c180b1600 con 0x7f3c28155810 2024-09-12T12:16:57.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.370+0000 7f3c25400640 1 -- 172.21.15.144:0/736730208 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180b19d0 con 0x7f3c28155810 2024-09-12T12:16:57.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 -- 172.21.15.144:0/736730208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c28155810 msgr2=0x7f3c2815c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 --2- 172.21.15.144:0/736730208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c28155810 0x7f3c2815c0b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800bb10 tx=0x7f3c180213e0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 -- 172.21.15.144:0/736730208 shutdown_connections 2024-09-12T12:16:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 --2- 172.21.15.144:0/736730208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c28155810 0x7f3c2815c0b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 -- 172.21.15.144:0/736730208 >> 172.21.15.144:0/736730208 conn(0x7f3c2806e7e0 msgr2=0x7f3c2806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 -- 172.21.15.144:0/736730208 shutdown_connections 2024-09-12T12:16:57.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 -- 172.21.15.144:0/736730208 wait complete. 2024-09-12T12:16:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 Processor -- start 2024-09-12T12:16:57.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 -- start start 2024-09-12T12:16:57.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280b1e10 0x7f3c28159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c280b2280 0x7f3c280720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c28155810 0x7f3c28157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3c280b3a30 con 0x7f3c280b1e10 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3c280b3750 con 0x7f3c28155810 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c2ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3c280b3d10 con 0x7f3c280b2280 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c26800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280b1e10 0x7f3c28159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c26800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280b1e10 0x7f3c28159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58736/0 (socket says 172.21.15.144:58736) 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c26800640 1 -- 172.21.15.144:0/2224688048 learned_addr learned my addr 172.21.15.144:0/2224688048 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c26800640 1 -- 172.21.15.144:0/2224688048 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c280b2280 msgr2=0x7f3c280720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c26800640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c280b2280 0x7f3c280720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c26800640 1 -- 172.21.15.144:0/2224688048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c28155810 msgr2=0x7f3c28157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c26800640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c28155810 0x7f3c28157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c26800640 1 -- 172.21.15.144:0/2224688048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c28158f80 con 0x7f3c280b1e10 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c26800640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280b1e10 0x7f3c28159a40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800b2c0 tx=0x7f3c1801e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.374+0000 7f3c1ea00640 1 -- 172.21.15.144:0/2224688048 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180b6040 con 0x7f3c280b1e10 2024-09-12T12:16:57.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c1ea00640 1 -- 172.21.15.144:0/2224688048 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c180c3070 con 0x7f3c280b1e10 2024-09-12T12:16:57.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c1ea00640 1 -- 172.21.15.144:0/2224688048 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180bb6a0 con 0x7f3c280b1e10 2024-09-12T12:16:57.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c28157db0 con 0x7f3c280b1e10 2024-09-12T12:16:57.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c28159240 con 0x7f3c280b1e10 2024-09-12T12:16:57.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c280b3ff0 con 0x7f3c280b1e10 2024-09-12T12:16:57.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c1ea00640 1 -- 172.21.15.144:0/2224688048 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c180b9070 con 0x7f3c280b1e10 2024-09-12T12:16:57.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c1ea00640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c080678c0 0x7f3c08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c1ea00640 1 -- 172.21.15.144:0/2224688048 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f3c18125eb0 con 0x7f3c280b1e10 2024-09-12T12:16:57.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c25e00640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c080678c0 0x7f3c08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.378+0000 7f3c25e00640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c080678c0 0x7f3c08069d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3c14000f70 tx=0x7f3c140079e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:57.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.382+0000 7f3c1ea00640 1 -- 172.21.15.144:0/2224688048 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3c1801af40 con 0x7f3c280b1e10 2024-09-12T12:16:57.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.542+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3c280d03e0 con 0x7f3c280b1e10 2024-09-12T12:16:57.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.542+0000 7f3c1ea00640 1 -- 172.21.15.144:0/2224688048 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f3c180f6b00 con 0x7f3c280b1e10 2024-09-12T12:16:57.547 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:16:57.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c080678c0 msgr2=0x7f3c08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c080678c0 0x7f3c08069d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3c14000f70 tx=0x7f3c140079e0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280b1e10 msgr2=0x7f3c28159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280b1e10 0x7f3c28159a40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800b2c0 tx=0x7f3c1801e180 comp rx=0 tx=0).stop 2024-09-12T12:16:57.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 shutdown_connections 2024-09-12T12:16:57.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c080678c0 0x7f3c08069d80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c28155810 0x7f3c28157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c280b2280 0x7f3c280720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 --2- 172.21.15.144:0/2224688048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280b1e10 0x7f3c28159a40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 >> 172.21.15.144:0/2224688048 conn(0x7f3c2806e7e0 msgr2=0x7f3c2806d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:57.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 shutdown_connections 2024-09-12T12:16:57.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.546+0000 7f3c2ca00640 1 -- 172.21.15.144:0/2224688048 wait complete. 2024-09-12T12:16:57.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-12T12:16:57.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.698+0000 7f2499800640 1 Processor -- start 2024-09-12T12:16:57.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.698+0000 7f2499800640 1 -- start start 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.698+0000 7f2499800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f249415ad50 0x7f249415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.698+0000 7f2499800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f24940b49e0 0x7f24940b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2499800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24940b3aa0 con 0x7f24940b3590 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2499800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f249415f860 con 0x7f249415ad50 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2499800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f24940cdeb0 con 0x7f24940b49e0 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2492a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f249415ad50 0x7f249415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2492a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f249415ad50 0x7f249415f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58742/0 (socket says 172.21.15.144:58742) 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2492a00640 1 -- 172.21.15.144:0/4164271387 learned_addr learned my addr 172.21.15.144:0/4164271387 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2493400640 1 --2- 172.21.15.144:0/4164271387 >> v2:172.21.15.165:3300/0 conn(0x7f24940b49e0 0x7f24940b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2492a00640 1 -- 172.21.15.144:0/4164271387 >> v2:172.21.15.165:3300/0 conn(0x7f24940b49e0 msgr2=0x7f24940b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:57.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2492a00640 1 --2- 172.21.15.144:0/4164271387 >> v2:172.21.15.165:3300/0 conn(0x7f24940b49e0 0x7f24940b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2492a00640 1 -- 172.21.15.144:0/4164271387 >> v1:172.21.15.165:6789/0 conn(0x7f24940b3590 legacy=0x7f24940b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2492a00640 1 -- 172.21.15.144:0/4164271387 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24940afc10 con 0x7f249415ad50 2024-09-12T12:16:57.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2492a00640 1 --2- 172.21.15.144:0/4164271387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 0x7f249415f320 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f249406f4a0 tx=0x7f248401daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8098f57f732e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:57.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2491600640 1 -- 172.21.15.144:0/4164271387 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248400a2d0 con 0x7f249415ad50 2024-09-12T12:16:57.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2491600640 1 -- 172.21.15.144:0/4164271387 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24840a6820 con 0x7f249415ad50 2024-09-12T12:16:57.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.702+0000 7f2491600640 1 -- 172.21.15.144:0/4164271387 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24840a6bf0 con 0x7f249415ad50 2024-09-12T12:16:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 -- 172.21.15.144:0/4164271387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 msgr2=0x7f249415f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 --2- 172.21.15.144:0/4164271387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 0x7f249415f320 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f249406f4a0 tx=0x7f248401daf0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 -- 172.21.15.144:0/4164271387 shutdown_connections 2024-09-12T12:16:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 --2- 172.21.15.144:0/4164271387 >> v2:172.21.15.165:3300/0 conn(0x7f24940b49e0 0x7f24940b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 --2- 172.21.15.144:0/4164271387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 0x7f249415f320 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 -- 172.21.15.144:0/4164271387 >> 172.21.15.144:0/4164271387 conn(0x7f249406d0d0 msgr2=0x7f249406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 -- 172.21.15.144:0/4164271387 shutdown_connections 2024-09-12T12:16:57.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 -- 172.21.15.144:0/4164271387 wait complete. 2024-09-12T12:16:57.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 Processor -- start 2024-09-12T12:16:57.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 -- start start 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24940b3590 0x7f2494148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24940b49e0 0x7f249415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 0x7f24941f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24940b0db0 con 0x7f249415ad50 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f24940b0c30 con 0x7f24940b49e0 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2499800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f24940b0f30 con 0x7f24940b3590 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2493400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 0x7f24941f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2493400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 0x7f24941f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58748/0 (socket says 172.21.15.144:58748) 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2493400640 1 -- 172.21.15.144:0/2055488776 learned_addr learned my addr 172.21.15.144:0/2055488776 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2492a00640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24940b3590 0x7f2494148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2492000640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24940b49e0 0x7f249415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2493400640 1 -- 172.21.15.144:0/2055488776 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24940b3590 msgr2=0x7f2494148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2493400640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24940b3590 0x7f2494148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2493400640 1 -- 172.21.15.144:0/2055488776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24940b49e0 msgr2=0x7f249415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2493400640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24940b49e0 0x7f249415c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.706+0000 7f2493400640 1 -- 172.21.15.144:0/2055488776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2494071080 con 0x7f249415ad50 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f2493400640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 0x7f24941f7550 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f248c00d800 tx=0x7f248c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f248aa00640 1 -- 172.21.15.144:0/2055488776 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c00b6c0 con 0x7f249415ad50 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f248aa00640 1 -- 172.21.15.144:0/2055488776 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c019070 con 0x7f249415ad50 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249415c820 con 0x7f249415ad50 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f248aa00640 1 -- 172.21.15.144:0/2055488776 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c00baa0 con 0x7f249415ad50 2024-09-12T12:16:57.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24941f82f0 con 0x7f249415ad50 2024-09-12T12:16:57.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24940b06f0 con 0x7f249415ad50 2024-09-12T12:16:57.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f248aa00640 1 -- 172.21.15.144:0/2055488776 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f248c00bc40 con 0x7f249415ad50 2024-09-12T12:16:57.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f248aa00640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24740678c0 0x7f2474069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:57.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f248aa00640 1 -- 172.21.15.144:0/2055488776 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f248c085e00 con 0x7f249415ad50 2024-09-12T12:16:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.710+0000 7f2492a00640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24740678c0 0x7f2474069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:57.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.714+0000 7f2492a00640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24740678c0 0x7f2474069d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f24840af000 tx=0x7f24840a8070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:57.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.714+0000 7f248aa00640 1 -- 172.21.15.144:0/2055488776 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f248c0564a0 con 0x7f249415ad50 2024-09-12T12:16:57.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:57.934+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f2494156030 con 0x7f249415ad50 2024-09-12T12:16:58.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.878+0000 7f248aa00640 1 -- 172.21.15.144:0/2055488776 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v221) ==== 146+0+0 (secure 0 0 0) 0x7f248c05a7a0 con 0x7f249415ad50 2024-09-12T12:16:58.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24740678c0 msgr2=0x7f2474069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:58.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24740678c0 0x7f2474069d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f24840af000 tx=0x7f24840a8070 comp rx=0 tx=0).stop 2024-09-12T12:16:58.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 msgr2=0x7f24941f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:58.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 0x7f24941f7550 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f248c00d800 tx=0x7f248c00dcc0 comp rx=0 tx=0).stop 2024-09-12T12:16:58.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 shutdown_connections 2024-09-12T12:16:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24740678c0 0x7f2474069d80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f249415ad50 0x7f24941f7550 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24940b49e0 0x7f249415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 --2- 172.21.15.144:0/2055488776 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24940b3590 0x7f2494148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 >> 172.21.15.144:0/2055488776 conn(0x7f249406d0d0 msgr2=0x7f24940b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 shutdown_connections 2024-09-12T12:16:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:58.882+0000 7f2499800640 1 -- 172.21.15.144:0/2055488776 wait complete. 2024-09-12T12:16:58.907 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:16:59.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.046+0000 7f56c9800640 1 Processor -- start 2024-09-12T12:16:59.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.046+0000 7f56c9800640 1 -- start start 2024-09-12T12:16:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.046+0000 7f56c9800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f56c415c2e0 0x7f56c4072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.046+0000 7f56c9800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56c40733e0 con 0x7f56c406c320 2024-09-12T12:16:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.046+0000 7f56c9800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56c40cd290 con 0x7f56c40af5f0 2024-09-12T12:16:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.046+0000 7f56c9800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f56c40cd570 con 0x7f56c415c2e0 2024-09-12T12:16:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.046+0000 7f56c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f56c415c2e0 0x7f56c4072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.046+0000 7f56c3400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f56c406c320 0x7f56c40cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52936/0 (socket says 172.21.15.144:52936) 2024-09-12T12:16:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.046+0000 7f56c3400640 1 -- 172.21.15.144:0/2495808278 learned_addr learned my addr 172.21.15.144:0/2495808278 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:59.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.050+0000 7f56c2a00640 1 -- 172.21.15.144:0/2495808278 >> v1:172.21.15.165:6789/0 conn(0x7f56c40af5f0 legacy=0x7f56c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.050+0000 7f56c2a00640 1 -- 172.21.15.144:0/2495808278 >> v1:172.21.15.144:6789/0 conn(0x7f56c406c320 legacy=0x7f56c40cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.050+0000 7f56c2a00640 1 -- 172.21.15.144:0/2495808278 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c40cd850 con 0x7f56c415c2e0 2024-09-12T12:16:59.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.050+0000 7f56c2a00640 1 --2- 172.21.15.144:0/2495808278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c415c2e0 0x7f56c4072b50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0097c0 tx=0x7f56ac01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d5588167f73686 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:59.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.050+0000 7f56c1600640 1 -- 172.21.15.144:0/2495808278 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0b0070 con 0x7f56c415c2e0 2024-09-12T12:16:59.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.050+0000 7f56c1600640 1 -- 172.21.15.144:0/2495808278 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac0ab600 con 0x7f56c415c2e0 2024-09-12T12:16:59.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.050+0000 7f56c1600640 1 -- 172.21.15.144:0/2495808278 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0ab9d0 con 0x7f56c415c2e0 2024-09-12T12:16:59.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.050+0000 7f56c9800640 1 -- 172.21.15.144:0/2495808278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c415c2e0 msgr2=0x7f56c4072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.050+0000 7f56c9800640 1 --2- 172.21.15.144:0/2495808278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c415c2e0 0x7f56c4072b50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0097c0 tx=0x7f56ac01c380 comp rx=0 tx=0).stop 2024-09-12T12:16:59.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 -- 172.21.15.144:0/2495808278 shutdown_connections 2024-09-12T12:16:59.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 --2- 172.21.15.144:0/2495808278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c415c2e0 0x7f56c4072b50 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 -- 172.21.15.144:0/2495808278 >> 172.21.15.144:0/2495808278 conn(0x7f56c4068030 msgr2=0x7f56c40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:59.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 -- 172.21.15.144:0/2495808278 shutdown_connections 2024-09-12T12:16:59.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 -- 172.21.15.144:0/2495808278 wait complete. 2024-09-12T12:16:59.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 Processor -- start 2024-09-12T12:16:59.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 -- start start 2024-09-12T12:16:59.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c406c320 0x7f56c415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56c40af5f0 0x7f56c414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c415c2e0 0x7f56c41f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f56c40cf020 con 0x7f56c406c320 2024-09-12T12:16:59.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56c40ceea0 con 0x7f56c415c2e0 2024-09-12T12:16:59.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f56c4169f30 con 0x7f56c40af5f0 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c406c320 0x7f56c415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c406c320 0x7f56c415e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58764/0 (socket says 172.21.15.144:58764) 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2a00640 1 -- 172.21.15.144:0/3701322323 learned_addr learned my addr 172.21.15.144:0/3701322323 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c3400640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c415c2e0 0x7f56c41f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2000640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56c40af5f0 0x7f56c414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2a00640 1 -- 172.21.15.144:0/3701322323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56c40af5f0 msgr2=0x7f56c414e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2a00640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56c40af5f0 0x7f56c414e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2a00640 1 -- 172.21.15.144:0/3701322323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c415c2e0 msgr2=0x7f56c41f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2a00640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c415c2e0 0x7f56c41f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2a00640 1 -- 172.21.15.144:0/3701322323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c4153ed0 con 0x7f56c406c320 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c2a00640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c406c320 0x7f56c415e3f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f56ac018f90 tx=0x7f56ac01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56baa00640 1 -- 172.21.15.144:0/3701322323 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0b0050 con 0x7f56c406c320 2024-09-12T12:16:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56baa00640 1 -- 172.21.15.144:0/3701322323 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac0bc070 con 0x7f56c406c320 2024-09-12T12:16:59.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56baa00640 1 -- 172.21.15.144:0/3701322323 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0b5a50 con 0x7f56c406c320 2024-09-12T12:16:59.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.054+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c414e8b0 con 0x7f56c406c320 2024-09-12T12:16:59.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.058+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c4155e50 con 0x7f56c406c320 2024-09-12T12:16:59.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.058+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c4072b50 con 0x7f56c406c320 2024-09-12T12:16:59.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.058+0000 7f56baa00640 1 -- 172.21.15.144:0/3701322323 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56ac0ab4a0 con 0x7f56c406c320 2024-09-12T12:16:59.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.058+0000 7f56baa00640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56a00678c0 0x7f56a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.058+0000 7f56baa00640 1 -- 172.21.15.144:0/3701322323 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f56ac120520 con 0x7f56c406c320 2024-09-12T12:16:59.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.058+0000 7f56c2000640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56a00678c0 0x7f56a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.058+0000 7f56c2000640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56a00678c0 0x7f56a0069d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f56c4154db0 tx=0x7f56b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:59.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.062+0000 7f56baa00640 1 -- 172.21.15.144:0/3701322323 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f56ac0a4e20 con 0x7f56c406c320 2024-09-12T12:16:59.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.222+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f56c40cf2a0 con 0x7f56c406c320 2024-09-12T12:16:59.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56baa00640 1 -- 172.21.15.144:0/3701322323 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f56ac016090 con 0x7f56c406c320 2024-09-12T12:16:59.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56a00678c0 msgr2=0x7f56a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56a00678c0 0x7f56a0069d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f56c4154db0 tx=0x7f56b4009040 comp rx=0 tx=0).stop 2024-09-12T12:16:59.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c406c320 msgr2=0x7f56c415e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c406c320 0x7f56c415e3f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f56ac018f90 tx=0x7f56ac01abc0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 shutdown_connections 2024-09-12T12:16:59.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56a00678c0 0x7f56a0069d80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c415c2e0 0x7f56c41f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56c40af5f0 0x7f56c414e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 --2- 172.21.15.144:0/3701322323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c406c320 0x7f56c415e3f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 >> 172.21.15.144:0/3701322323 conn(0x7f56c4068030 msgr2=0x7f56c4073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:59.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 shutdown_connections 2024-09-12T12:16:59.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.226+0000 7f56c9800640 1 -- 172.21.15.144:0/3701322323 wait complete. 2024-09-12T12:16:59.249 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:16:59.249 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:16:59.325 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:16:59.405 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:16:59.406 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:59.406 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:59.414 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:16:59.414 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:16:59.414 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:59.423 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:16:59.423 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:16:59.424 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:59.463 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:16:59.463 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:16:59.463 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:59.475 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:16:59.475 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:16:59.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:16:59.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c8e00640 1 Processor -- start 2024-09-12T12:16:59.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c8e00640 1 -- start start 2024-09-12T12:16:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c8e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35c40b44a0 0x7f35c40b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c406e300 0x7f35c406e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c8e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c40b6f60 con 0x7f35c415e5f0 2024-09-12T12:16:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c8e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f35c406ec90 con 0x7f35c40b44a0 2024-09-12T12:16:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35c40b7240 con 0x7f35c406e300 2024-09-12T12:16:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f35c415e5f0 0x7f35c406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52946/0 (socket says 172.21.15.144:52946) 2024-09-12T12:16:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c1e00640 1 -- 172.21.15.144:0/3664433279 learned_addr learned my addr 172.21.15.144:0/3664433279 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:16:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.638+0000 7f35c1400640 1 --2- 172.21.15.144:0/3664433279 >> v2:172.21.15.144:3300/0 conn(0x7f35c40b44a0 0x7f35c40b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c2800640 1 --2- 172.21.15.144:0/3664433279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c406e300 0x7f35c406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c0a00640 1 -- 172.21.15.144:0/3664433279 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045852381 0 0) 0x7f35c40b6f60 con 0x7f35c415e5f0 2024-09-12T12:16:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c0a00640 1 -- 172.21.15.144:0/3664433279 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35a8003530 con 0x7f35c415e5f0 2024-09-12T12:16:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c1400640 1 -- 172.21.15.144:0/3664433279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c406e300 msgr2=0x7f35c406e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c1400640 1 --2- 172.21.15.144:0/3664433279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c406e300 0x7f35c406e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c1400640 1 -- 172.21.15.144:0/3664433279 >> v1:172.21.15.144:6789/0 conn(0x7f35c415e5f0 legacy=0x7f35c406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c1400640 1 -- 172.21.15.144:0/3664433279 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c40b7520 con 0x7f35c40b44a0 2024-09-12T12:16:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c1400640 1 --2- 172.21.15.144:0/3664433279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c40b44a0 0x7f35c40b48d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f35b00097c0 tx=0x7f35b001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8c619734878df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c0a00640 1 -- 172.21.15.144:0/3664433279 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b00aa5f0 con 0x7f35c40b44a0 2024-09-12T12:16:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c0a00640 1 -- 172.21.15.144:0/3664433279 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b00af070 con 0x7f35c40b44a0 2024-09-12T12:16:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.642+0000 7f35c0a00640 1 -- 172.21.15.144:0/3664433279 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b00aa9b0 con 0x7f35c40b44a0 2024-09-12T12:16:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- 172.21.15.144:0/3664433279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c40b44a0 msgr2=0x7f35c40b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 --2- 172.21.15.144:0/3664433279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c40b44a0 0x7f35c40b48d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f35b00097c0 tx=0x7f35b001c470 comp rx=0 tx=0).stop 2024-09-12T12:16:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- 172.21.15.144:0/3664433279 shutdown_connections 2024-09-12T12:16:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 --2- 172.21.15.144:0/3664433279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c406e300 0x7f35c406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 --2- 172.21.15.144:0/3664433279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c40b44a0 0x7f35c40b48d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- 172.21.15.144:0/3664433279 >> 172.21.15.144:0/3664433279 conn(0x7f35c406f400 msgr2=0x7f35c406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- 172.21.15.144:0/3664433279 shutdown_connections 2024-09-12T12:16:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- 172.21.15.144:0/3664433279 wait complete. 2024-09-12T12:16:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 Processor -- start 2024-09-12T12:16:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- start start 2024-09-12T12:16:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c406e300 0x7f35c41584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c40b44a0 0x7f35c414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c415e5f0 0x7f35c413bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35c415f880 con 0x7f35c406e300 2024-09-12T12:16:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35c415f700 con 0x7f35c40b44a0 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35c415fa00 con 0x7f35c415e5f0 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c406e300 0x7f35c41584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c406e300 0x7f35c41584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58790/0 (socket says 172.21.15.144:58790) 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1e00640 1 -- 172.21.15.144:0/731948084 learned_addr learned my addr 172.21.15.144:0/731948084 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c2800640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c415e5f0 0x7f35c413bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1400640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c40b44a0 0x7f35c414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1e00640 1 -- 172.21.15.144:0/731948084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c415e5f0 msgr2=0x7f35c413bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1e00640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c415e5f0 0x7f35c413bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1e00640 1 -- 172.21.15.144:0/731948084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c40b44a0 msgr2=0x7f35c414bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1e00640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c40b44a0 0x7f35c414bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1e00640 1 -- 172.21.15.144:0/731948084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c414fec0 con 0x7f35c406e300 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c1e00640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c406e300 0x7f35c41584e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f35b400c3c0 tx=0x7f35b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35ba000640 1 -- 172.21.15.144:0/731948084 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4017070 con 0x7f35c406e300 2024-09-12T12:16:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35ba000640 1 -- 172.21.15.144:0/731948084 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b4005cf0 con 0x7f35c406e300 2024-09-12T12:16:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c414ae80 con 0x7f35c406e300 2024-09-12T12:16:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35ba000640 1 -- 172.21.15.144:0/731948084 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b40072f0 con 0x7f35c406e300 2024-09-12T12:16:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.646+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c414fb00 con 0x7f35c406e300 2024-09-12T12:16:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.650+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c406e750 con 0x7f35c406e300 2024-09-12T12:16:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.650+0000 7f35ba000640 1 -- 172.21.15.144:0/731948084 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35b401a070 con 0x7f35c406e300 2024-09-12T12:16:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.650+0000 7f35ba000640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35a40678c0 0x7f35a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.650+0000 7f35ba000640 1 -- 172.21.15.144:0/731948084 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f35b4084f60 con 0x7f35c406e300 2024-09-12T12:16:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.650+0000 7f35c1400640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35a40678c0 0x7f35a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:59.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.650+0000 7f35c1400640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35a40678c0 0x7f35a4069d80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f35b00ae000 tx=0x7f35b00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:59.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.654+0000 7f35ba000640 1 -- 172.21.15.144:0/731948084 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f35b4055bb0 con 0x7f35c406e300 2024-09-12T12:16:59.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.846+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35c406d130 con 0x7f35c406e300 2024-09-12T12:16:59.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.846+0000 7f35ba000640 1 -- 172.21.15.144:0/731948084 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+3914 (secure 0 0 0) 0x7f35b40554b0 con 0x7f35c406e300 2024-09-12T12:16:59.851 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:16:59.851 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":48,"btime":"2024-09-12T12:16:52:756802+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3255412125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3255412125},{"type":"v1","addr":"172.21.15.165:6833","nonce":3255412125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/58470782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":58470782},{"type":"v1","addr":"172.21.15.165:6835","nonce":58470782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6441,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3795347766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3795347766},{"type":"v1","addr":"172.21.15.144:6837","nonce":3795347766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/944623066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":944623066},{"type":"v1","addr":"172.21.15.144:6835","nonce":944623066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[]} 2024-09-12T12:16:59.851 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 48 2024-09-12T12:16:59.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35a40678c0 msgr2=0x7f35a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35a40678c0 0x7f35a4069d80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f35b00ae000 tx=0x7f35b00a7000 comp rx=0 tx=0).stop 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c406e300 msgr2=0x7f35c41584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c406e300 0x7f35c41584e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f35b400c3c0 tx=0x7f35b400c880 comp rx=0 tx=0).stop 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 shutdown_connections 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35a40678c0 0x7f35a4069d80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c415e5f0 0x7f35c413bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c40b44a0 0x7f35c414bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 --2- 172.21.15.144:0/731948084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c406e300 0x7f35c41584e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 >> 172.21.15.144:0/731948084 conn(0x7f35c406f400 msgr2=0x7f35c406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 shutdown_connections 2024-09-12T12:16:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:16:59.850+0000 7f35c8e00640 1 -- 172.21.15.144:0/731948084 wait complete. 2024-09-12T12:16:59.872 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:16:59.872 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:16:59.872 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:16:59.872 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:59.872 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:16:59.872 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:16:59.873 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:16:59.873 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:59.873 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:16:59.873 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:16:59.873 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:16:59.873 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:59.873 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:16:59.874 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:16:59.874 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:16:59.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:16:59.885 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:16:59.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:16:59.887 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:16:59.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:16:59.890 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:16:59.890 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:16:59.891 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:16:59.891 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:16:59.929 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:16:59.930 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:59.931 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:16:59.931 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:59.933 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:16:59.934 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:59.935 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:16:59.935 DEBUG:teuthology.parallel:result is None 2024-09-12T12:16:59.936 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:17:00.017 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:17:00.017 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:17:00.025 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:17:00.027 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:17:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616e00640 1 Processor -- start 2024-09-12T12:17:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616e00640 1 -- start start 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f961015c0a0 0x7f96100b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100ce950 0x7f961015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96100b6b20 0x7f96100b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f96101609e0 con 0x7f96100b6b20 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f96100b7510 con 0x7f961015c0a0 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f961015c480 con 0x7f96100ce950 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96100b6b20 0x7f96100b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9615000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100ce950 0x7f961015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96100b6b20 0x7f96100b6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58808/0 (socket says 172.21.15.144:58808) 2024-09-12T12:17:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616400640 1 -- 172.21.15.144:0/2288378663 learned_addr learned my addr 172.21.15.144:0/2288378663 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:00.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9615a00640 1 --2- 172.21.15.144:0/2288378663 >> v2:172.21.15.165:3300/0 conn(0x7f961015c0a0 0x7f96100b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9615000640 1 -- 172.21.15.144:0/2288378663 >> v2:172.21.15.165:3300/0 conn(0x7f961015c0a0 msgr2=0x7f96100b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:00.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9615000640 1 --2- 172.21.15.144:0/2288378663 >> v2:172.21.15.165:3300/0 conn(0x7f961015c0a0 0x7f96100b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9615000640 1 -- 172.21.15.144:0/2288378663 >> v2:172.21.15.144:3300/0 conn(0x7f96100b6b20 msgr2=0x7f96100b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:00.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9615000640 1 --2- 172.21.15.144:0/2288378663 >> v2:172.21.15.144:3300/0 conn(0x7f96100b6b20 0x7f96100b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9615000640 1 -- 172.21.15.144:0/2288378663 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961015fdd0 con 0x7f96100ce950 2024-09-12T12:17:00.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.078+0000 7f9616400640 1 --2- 172.21.15.144:0/2288378663 >> v2:172.21.15.144:3300/0 conn(0x7f96100b6b20 0x7f96100b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:00.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9615000640 1 --2- 172.21.15.144:0/2288378663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100ce950 0x7f961015d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9610072910 tx=0x7f95fc01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d85bf6f599f871e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:00.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f960fe00640 1 -- 172.21.15.144:0/2288378663 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0b0070 con 0x7f96100ce950 2024-09-12T12:17:00.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f960fe00640 1 -- 172.21.15.144:0/2288378663 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0ab600 con 0x7f96100ce950 2024-09-12T12:17:00.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f960fe00640 1 -- 172.21.15.144:0/2288378663 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0ab9d0 con 0x7f96100ce950 2024-09-12T12:17:00.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9616e00640 1 -- 172.21.15.144:0/2288378663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100ce950 msgr2=0x7f961015d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:00.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9616e00640 1 --2- 172.21.15.144:0/2288378663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100ce950 0x7f961015d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9610072910 tx=0x7f95fc01c3f0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9616e00640 1 -- 172.21.15.144:0/2288378663 shutdown_connections 2024-09-12T12:17:00.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9616e00640 1 --2- 172.21.15.144:0/2288378663 >> v2:172.21.15.144:3300/0 conn(0x7f96100b6b20 0x7f96100b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9616e00640 1 --2- 172.21.15.144:0/2288378663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100ce950 0x7f961015d0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9616e00640 1 --2- 172.21.15.144:0/2288378663 >> v2:172.21.15.165:3300/0 conn(0x7f961015c0a0 0x7f96100b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9616e00640 1 -- 172.21.15.144:0/2288378663 >> 172.21.15.144:0/2288378663 conn(0x7f96100d2280 msgr2=0x7f96100d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:00.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9616e00640 1 -- 172.21.15.144:0/2288378663 shutdown_connections 2024-09-12T12:17:00.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.082+0000 7f9616e00640 1 -- 172.21.15.144:0/2288378663 wait complete. 2024-09-12T12:17:00.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 Processor -- start 2024-09-12T12:17:00.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 -- start start 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100b6b20 0x7f961014f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ce950 0x7f961014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961015c0a0 0x7f9610159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9610073a20 con 0x7f96100ce950 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f96100738a0 con 0x7f961015c0a0 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9610073ba0 con 0x7f96100b6b20 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ce950 0x7f961014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ce950 0x7f961014db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58812/0 (socket says 172.21.15.144:58812) 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615000640 1 -- 172.21.15.144:0/964528803 learned_addr learned my addr 172.21.15.144:0/964528803 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616400640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961015c0a0 0x7f9610159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615a00640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100b6b20 0x7f961014f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615000640 1 -- 172.21.15.144:0/964528803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100b6b20 msgr2=0x7f961014f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:00.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615000640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100b6b20 0x7f961014f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615000640 1 -- 172.21.15.144:0/964528803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961015c0a0 msgr2=0x7f9610159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:00.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615000640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961015c0a0 0x7f9610159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:00.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615000640 1 -- 172.21.15.144:0/964528803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961015a6e0 con 0x7f96100ce950 2024-09-12T12:17:00.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9615000640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ce950 0x7f961014db70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0ae040 tx=0x7f95fc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:00.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f960d600640 1 -- 172.21.15.144:0/964528803 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0b0050 con 0x7f96100ce950 2024-09-12T12:17:00.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f960d600640 1 -- 172.21.15.144:0/964528803 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc0bc070 con 0x7f96100ce950 2024-09-12T12:17:00.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f960d600640 1 -- 172.21.15.144:0/964528803 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc006e20 con 0x7f96100ce950 2024-09-12T12:17:00.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961015b180 con 0x7f96100ce950 2024-09-12T12:17:00.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.086+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961014f160 con 0x7f96100ce950 2024-09-12T12:17:00.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.090+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f961015d0c0 con 0x7f96100ce950 2024-09-12T12:17:00.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.090+0000 7f960d600640 1 -- 172.21.15.144:0/964528803 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f95fc0b5850 con 0x7f96100ce950 2024-09-12T12:17:00.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.090+0000 7f960d600640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95f00678c0 0x7f95f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:00.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.090+0000 7f960d600640 1 -- 172.21.15.144:0/964528803 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5421+0+0 (secure 0 0 0) 0x7f95fc1202b0 con 0x7f96100ce950 2024-09-12T12:17:00.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.090+0000 7f9615a00640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95f00678c0 0x7f95f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:00.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.090+0000 7f9615a00640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95f00678c0 0x7f95f0069d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f96101542a0 tx=0x7f960400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:00.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.094+0000 7f960d600640 1 -- 172.21.15.144:0/964528803 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f95fc016070 con 0x7f96100ce950 2024-09-12T12:17:00.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:00.266+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f96100b1c60 con 0x7f96100ce950 2024-09-12T12:17:01.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.238+0000 7f960d600640 1 -- 172.21.15.144:0/964528803 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v79) ==== 97+0+0 (secure 0 0 0) 0x7f95fc0f0820 con 0x7f96100ce950 2024-09-12T12:17:01.242 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:17:01.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95f00678c0 msgr2=0x7f95f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95f00678c0 0x7f95f0069d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f96101542a0 tx=0x7f960400b040 comp rx=0 tx=0).stop 2024-09-12T12:17:01.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ce950 msgr2=0x7f961014db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ce950 0x7f961014db70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0ae040 tx=0x7f95fc01ac30 comp rx=0 tx=0).stop 2024-09-12T12:17:01.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 shutdown_connections 2024-09-12T12:17:01.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95f00678c0 0x7f95f0069d80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f961015c0a0 0x7f9610159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ce950 0x7f961014db70 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 --2- 172.21.15.144:0/964528803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96100b6b20 0x7f961014f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 >> 172.21.15.144:0/964528803 conn(0x7f96100d2280 msgr2=0x7f961015e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:01.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 shutdown_connections 2024-09-12T12:17:01.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.242+0000 7f9616e00640 1 -- 172.21.15.144:0/964528803 wait complete. 2024-09-12T12:17:01.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:17:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f191a600640 1 Processor -- start 2024-09-12T12:17:01.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f191a600640 1 -- start start 2024-09-12T12:17:01.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f191a600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f191415b4e0 0x7f19140b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f191a600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f19140ccf30 0x7f19140cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f191a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19140b45a0 con 0x7f19140b3ad0 2024-09-12T12:17:01.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f191a600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f19140cd8a0 con 0x7f191415b4e0 2024-09-12T12:17:01.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f191a600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f19140b3fe0 con 0x7f19140ccf30 2024-09-12T12:17:01.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f1913400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f191415b4e0 0x7f19140b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:01.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f1912a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f19140b3ad0 0x7f1914071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52952/0 (socket says 172.21.15.144:52952) 2024-09-12T12:17:01.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f1912a00640 1 -- 172.21.15.144:0/2021656492 learned_addr learned my addr 172.21.15.144:0/2021656492 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:01.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.406+0000 7f1913e00640 1 --2- 172.21.15.144:0/2021656492 >> v2:172.21.15.165:3300/0 conn(0x7f19140ccf30 0x7f19140cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:01.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1913400640 1 -- 172.21.15.144:0/2021656492 >> v2:172.21.15.165:3300/0 conn(0x7f19140ccf30 msgr2=0x7f19140cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:01.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1913400640 1 --2- 172.21.15.144:0/2021656492 >> v2:172.21.15.165:3300/0 conn(0x7f19140ccf30 0x7f19140cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1913400640 1 -- 172.21.15.144:0/2021656492 >> v1:172.21.15.144:6789/0 conn(0x7f19140b3ad0 legacy=0x7f1914071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1913400640 1 -- 172.21.15.144:0/2021656492 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19140b42c0 con 0x7f191415b4e0 2024-09-12T12:17:01.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1913e00640 1 --2- 172.21.15.144:0/2021656492 >> v2:172.21.15.165:3300/0 conn(0x7f19140ccf30 0x7f19140cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:01.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1912000640 1 -- 172.21.15.144:0/2021656492 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 948296042 0 0) 0x7f19140b45a0 con 0x7f19140b3ad0 2024-09-12T12:17:01.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1913400640 1 --2- 172.21.15.144:0/2021656492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191415b4e0 0x7f19140b3590 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f19140b3ef0 tx=0x7f190401eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74941ae27c936ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:01.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1912000640 1 -- 172.21.15.144:0/2021656492 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190400b2d0 con 0x7f191415b4e0 2024-09-12T12:17:01.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1912000640 1 -- 172.21.15.144:0/2021656492 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19040a79d0 con 0x7f191415b4e0 2024-09-12T12:17:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f1912000640 1 -- 172.21.15.144:0/2021656492 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040a7da0 con 0x7f191415b4e0 2024-09-12T12:17:01.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f191a600640 1 -- 172.21.15.144:0/2021656492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191415b4e0 msgr2=0x7f19140b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f191a600640 1 --2- 172.21.15.144:0/2021656492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191415b4e0 0x7f19140b3590 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f19140b3ef0 tx=0x7f190401eb00 comp rx=0 tx=0).stop 2024-09-12T12:17:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f191a600640 1 -- 172.21.15.144:0/2021656492 shutdown_connections 2024-09-12T12:17:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f191a600640 1 --2- 172.21.15.144:0/2021656492 >> v2:172.21.15.165:3300/0 conn(0x7f19140ccf30 0x7f19140cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f191a600640 1 --2- 172.21.15.144:0/2021656492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191415b4e0 0x7f19140b3590 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f191a600640 1 -- 172.21.15.144:0/2021656492 >> 172.21.15.144:0/2021656492 conn(0x7f191406d0d0 msgr2=0x7f191406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f191a600640 1 -- 172.21.15.144:0/2021656492 shutdown_connections 2024-09-12T12:17:01.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.410+0000 7f191a600640 1 -- 172.21.15.144:0/2021656492 wait complete. 2024-09-12T12:17:01.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f191a600640 1 Processor -- start 2024-09-12T12:17:01.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f191a600640 1 -- start start 2024-09-12T12:17:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f191a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19140b3ad0 0x7f1914151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f191a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19140ccf30 0x7f19140cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f191a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191415b4e0 0x7f19140cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f191a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f191415b8c0 con 0x7f19140b3ad0 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f191a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19140cdef0 con 0x7f19140ccf30 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f191a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f191415c500 con 0x7f191415b4e0 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f1913400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19140b3ad0 0x7f1914151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f1913400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19140b3ad0 0x7f1914151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58836/0 (socket says 172.21.15.144:58836) 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f1913400640 1 -- 172.21.15.144:0/916687986 learned_addr learned my addr 172.21.15.144:0/916687986 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f1913400640 1 -- 172.21.15.144:0/916687986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191415b4e0 msgr2=0x7f19140cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f1913400640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191415b4e0 0x7f19140cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f1913400640 1 -- 172.21.15.144:0/916687986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19140ccf30 msgr2=0x7f19140cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f1913400640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19140ccf30 0x7f19140cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f1913400640 1 -- 172.21.15.144:0/916687986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191415d660 con 0x7f19140b3ad0 2024-09-12T12:17:01.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f1913400640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19140b3ad0 0x7f1914151cc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f190401d1b0 tx=0x7f190401b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:01.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f190b400640 1 -- 172.21.15.144:0/916687986 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904009540 con 0x7f19140b3ad0 2024-09-12T12:17:01.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f190b400640 1 -- 172.21.15.144:0/916687986 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19040096e0 con 0x7f19140b3ad0 2024-09-12T12:17:01.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f190b400640 1 -- 172.21.15.144:0/916687986 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904009ab0 con 0x7f19140b3ad0 2024-09-12T12:17:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.414+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191415bbd0 con 0x7f19140b3ad0 2024-09-12T12:17:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.418+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191415c190 con 0x7f19140b3ad0 2024-09-12T12:17:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.418+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19140cd360 con 0x7f19140b3ad0 2024-09-12T12:17:01.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.418+0000 7f190b400640 1 -- 172.21.15.144:0/916687986 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19040c0020 con 0x7f19140b3ad0 2024-09-12T12:17:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.418+0000 7f190b400640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18f40678c0 0x7f18f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.418+0000 7f190b400640 1 -- 172.21.15.144:0/916687986 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5249+0+0 (secure 0 0 0) 0x7f19041205c0 con 0x7f19140b3ad0 2024-09-12T12:17:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.418+0000 7f1912a00640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18f40678c0 0x7f18f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:01.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.418+0000 7f1912a00640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18f40678c0 0x7f18f4069d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f19000011f0 tx=0x7f1900007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:01.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.422+0000 7f190b400640 1 -- 172.21.15.144:0/916687986 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f19040c7020 con 0x7f19140b3ad0 2024-09-12T12:17:01.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.634+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f19140b5490 con 0x7f19140b3ad0 2024-09-12T12:17:01.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.634+0000 7f190b400640 1 -- 172.21.15.144:0/916687986 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f1904018720 con 0x7f19140b3ad0 2024-09-12T12:17:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:01.639 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:17:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:17:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.639 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.640 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:01.641 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.642 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:01.643 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.644 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:01.645 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:17:01.646 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.648 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:17:01.649 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:17:01.651 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:01.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.653 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:17:01.653 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18f40678c0 msgr2=0x7f18f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18f40678c0 0x7f18f4069d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f19000011f0 tx=0x7f1900007930 comp rx=0 tx=0).stop 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19140b3ad0 msgr2=0x7f1914151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19140b3ad0 0x7f1914151cc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f190401d1b0 tx=0x7f190401b8a0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 shutdown_connections 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18f40678c0 0x7f18f4069d80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191415b4e0 0x7f19140cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19140ccf30 0x7f19140cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 --2- 172.21.15.144:0/916687986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19140b3ad0 0x7f1914151cc0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 >> 172.21.15.144:0/916687986 conn(0x7f191406d0d0 msgr2=0x7f19140aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 shutdown_connections 2024-09-12T12:17:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.638+0000 7f191a600640 1 -- 172.21.15.144:0/916687986 wait complete. 2024-09-12T12:17:01.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:17:01.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df9c00640 1 Processor -- start 2024-09-12T12:17:01.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df9c00640 1 -- start start 2024-09-12T12:17:01.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df9c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df9c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df40b54a0 con 0x7f4df40afab0 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df9c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df40b5780 con 0x7f4df415e600 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df9c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4df40b5270 con 0x7f4df406f020 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df3400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4df40afab0 0x7f4df40b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52962/0 (socket says 172.21.15.144:52962) 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df3400640 1 -- 172.21.15.144:0/3421896705 learned_addr learned my addr 172.21.15.144:0/3421896705 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4debe00640 1 --2- 172.21.15.144:0/3421896705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df2000640 1 -- 172.21.15.144:0/3421896705 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084477325 0 0) 0x7f4df40b54a0 con 0x7f4df40afab0 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df2000640 1 -- 172.21.15.144:0/3421896705 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dd8003530 con 0x7f4df40afab0 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df2000640 1 -- 172.21.15.144:0/3421896705 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756514448 0 0) 0x7f4df40b5780 con 0x7f4df415e600 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4df2000640 1 -- 172.21.15.144:0/3421896705 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4df40b54a0 con 0x7f4df415e600 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4debe00640 1 -- 172.21.15.144:0/3421896705 >> v1:172.21.15.165:6789/0 conn(0x7f4df415e600 legacy=0x7f4df406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4debe00640 1 -- 172.21.15.144:0/3421896705 >> v1:172.21.15.144:6789/0 conn(0x7f4df40afab0 legacy=0x7f4df40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.794+0000 7f4debe00640 1 -- 172.21.15.144:0/3421896705 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df40b5a60 con 0x7f4df406f020 2024-09-12T12:17:01.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4debe00640 1 --2- 172.21.15.144:0/3421896705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40717f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc0097f0 tx=0x7f4ddc01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e24cf06849467053 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:01.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df2000640 1 -- 172.21.15.144:0/3421896705 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc0b0070 con 0x7f4df406f020 2024-09-12T12:17:01.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df2000640 1 -- 172.21.15.144:0/3421896705 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0ab600 con 0x7f4df406f020 2024-09-12T12:17:01.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df2000640 1 -- 172.21.15.144:0/3421896705 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc0ab9b0 con 0x7f4df406f020 2024-09-12T12:17:01.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df9c00640 1 -- 172.21.15.144:0/3421896705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 msgr2=0x7f4df40717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df9c00640 1 --2- 172.21.15.144:0/3421896705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40717f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc0097f0 tx=0x7f4ddc01c4e0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df9c00640 1 -- 172.21.15.144:0/3421896705 shutdown_connections 2024-09-12T12:17:01.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df9c00640 1 --2- 172.21.15.144:0/3421896705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40717f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df9c00640 1 -- 172.21.15.144:0/3421896705 >> 172.21.15.144:0/3421896705 conn(0x7f4df406ddf0 msgr2=0x7f4df406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:01.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df9c00640 1 -- 172.21.15.144:0/3421896705 shutdown_connections 2024-09-12T12:17:01.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.798+0000 7f4df9c00640 1 -- 172.21.15.144:0/3421896705 wait complete. 2024-09-12T12:17:01.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 Processor -- start 2024-09-12T12:17:01.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 -- start start 2024-09-12T12:17:01.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df40afab0 0x7f4df4162170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df415e600 0x7f4df4155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4df416cbd0 con 0x7f4df415e600 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4df416ca50 con 0x7f4df40afab0 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4df416cd50 con 0x7f4df406f020 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df415e600 0x7f4df4155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df415e600 0x7f4df4155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58842/0 (socket says 172.21.15.144:58842) 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df3400640 1 -- 172.21.15.144:0/2365637140 learned_addr learned my addr 172.21.15.144:0/2365637140 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4debe00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df40afab0 0x7f4df4162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df2a00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df3400640 1 -- 172.21.15.144:0/2365637140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 msgr2=0x7f4df40cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df3400640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df3400640 1 -- 172.21.15.144:0/2365637140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df40afab0 msgr2=0x7f4df4162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df3400640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df40afab0 0x7f4df4162170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df3400640 1 -- 172.21.15.144:0/2365637140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df40b0690 con 0x7f4df415e600 2024-09-12T12:17:01.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df2a00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:01.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df3400640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df415e600 0x7f4df4155f60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00cac0 tx=0x7f4dec00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:01.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4deaa00640 1 -- 172.21.15.144:0/2365637140 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec017070 con 0x7f4df415e600 2024-09-12T12:17:01.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4deaa00640 1 -- 172.21.15.144:0/2365637140 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dec00ac30 con 0x7f4df415e600 2024-09-12T12:17:01.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df40b0970 con 0x7f4df415e600 2024-09-12T12:17:01.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4deaa00640 1 -- 172.21.15.144:0/2365637140 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec012400 con 0x7f4df415e600 2024-09-12T12:17:01.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.802+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df40cd7a0 con 0x7f4df415e600 2024-09-12T12:17:01.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.806+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df40b0d60 con 0x7f4df415e600 2024-09-12T12:17:01.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.806+0000 7f4deaa00640 1 -- 172.21.15.144:0/2365637140 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4dec01a070 con 0x7f4df415e600 2024-09-12T12:17:01.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.806+0000 7f4deaa00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dd00678c0 0x7f4dd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:01.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.806+0000 7f4deaa00640 1 -- 172.21.15.144:0/2365637140 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5249+0+0 (secure 0 0 0) 0x7f4dec085850 con 0x7f4df415e600 2024-09-12T12:17:01.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.806+0000 7f4df2a00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dd00678c0 0x7f4dd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:01.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.806+0000 7f4df2a00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dd00678c0 0x7f4dd0069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4de40011f0 tx=0x7f4de4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:01.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.810+0000 7f4deaa00640 1 -- 172.21.15.144:0/2365637140 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4dec055e60 con 0x7f4df415e600 2024-09-12T12:17:01.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4df40717f0 con 0x7f4df415e600 2024-09-12T12:17:01.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4deaa00640 1 -- 172.21.15.144:0/2365637140 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7f4dec05a160 con 0x7f4df415e600 2024-09-12T12:17:01.976 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:01.977 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:17:01.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:01.977 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:17:01.977 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:17:01.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:01.977 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:17:01.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dd00678c0 msgr2=0x7f4dd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dd00678c0 0x7f4dd0069d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4de40011f0 tx=0x7f4de4009040 comp rx=0 tx=0).stop 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df415e600 msgr2=0x7f4df4155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df415e600 0x7f4df4155f60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00cac0 tx=0x7f4dec00cf80 comp rx=0 tx=0).stop 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 shutdown_connections 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dd00678c0 0x7f4dd0069d80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df415e600 0x7f4df4155f60 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df40afab0 0x7f4df4162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 --2- 172.21.15.144:0/2365637140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df406f020 0x7f4df40cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 >> 172.21.15.144:0/2365637140 conn(0x7f4df406ddf0 msgr2=0x7f4df414d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 shutdown_connections 2024-09-12T12:17:01.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:01.974+0000 7f4df9c00640 1 -- 172.21.15.144:0/2365637140 wait complete. 2024-09-12T12:17:01.999 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:17:01.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:17:02.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.134+0000 7f172ac00640 1 Processor -- start 2024-09-12T12:17:02.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.134+0000 7f172ac00640 1 -- start start 2024-09-12T12:17:02.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f172ac00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f172406d250 0x7f172415c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:02.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f172ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d630 0x7f1724155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:02.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f172ac00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f172406cd20 con 0x7f17240b3490 2024-09-12T12:17:02.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f172ac00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1724072620 con 0x7f172406d250 2024-09-12T12:17:02.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f172ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f172415cc80 con 0x7f172406d630 2024-09-12T12:17:02.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1723400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f17240b3490 0x7f17240b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52972/0 (socket says 172.21.15.144:52972) 2024-09-12T12:17:02.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1723400640 1 -- 172.21.15.144:0/3012074906 learned_addr learned my addr 172.21.15.144:0/3012074906 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:02.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1723e00640 1 --2- 172.21.15.144:0/3012074906 >> v2:172.21.15.165:3300/0 conn(0x7f172406d250 0x7f172415c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:02.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1728c00640 1 --2- 172.21.15.144:0/3012074906 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d630 0x7f1724155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:02.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1722a00640 1 -- 172.21.15.144:0/3012074906 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880396799 0 0) 0x7f172406cd20 con 0x7f17240b3490 2024-09-12T12:17:02.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1722a00640 1 -- 172.21.15.144:0/3012074906 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1708003530 con 0x7f17240b3490 2024-09-12T12:17:02.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1723e00640 1 -- 172.21.15.144:0/3012074906 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d630 msgr2=0x7f1724155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:02.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1723e00640 1 --2- 172.21.15.144:0/3012074906 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d630 0x7f1724155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1723e00640 1 -- 172.21.15.144:0/3012074906 >> v1:172.21.15.144:6789/0 conn(0x7f17240b3490 legacy=0x7f17240b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:02.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1723e00640 1 -- 172.21.15.144:0/3012074906 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17240b3950 con 0x7f172406d250 2024-09-12T12:17:02.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.138+0000 7f1728c00640 1 --2- 172.21.15.144:0/3012074906 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d630 0x7f1724155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:02.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f1723e00640 1 --2- 172.21.15.144:0/3012074906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f172406d250 0x7f172415c740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1714009dc0 tx=0x7f171401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1671652c838d5d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:02.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f1722a00640 1 -- 172.21.15.144:0/3012074906 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17140b2070 con 0x7f172406d250 2024-09-12T12:17:02.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f1722a00640 1 -- 172.21.15.144:0/3012074906 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17140a5a00 con 0x7f172406d250 2024-09-12T12:17:02.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f1722a00640 1 -- 172.21.15.144:0/3012074906 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17140a5dd0 con 0x7f172406d250 2024-09-12T12:17:02.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 -- 172.21.15.144:0/3012074906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f172406d250 msgr2=0x7f172415c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:02.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 --2- 172.21.15.144:0/3012074906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f172406d250 0x7f172415c740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1714009dc0 tx=0x7f171401c920 comp rx=0 tx=0).stop 2024-09-12T12:17:02.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 -- 172.21.15.144:0/3012074906 shutdown_connections 2024-09-12T12:17:02.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 --2- 172.21.15.144:0/3012074906 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d630 0x7f1724155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 --2- 172.21.15.144:0/3012074906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f172406d250 0x7f172415c740 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 -- 172.21.15.144:0/3012074906 >> 172.21.15.144:0/3012074906 conn(0x7f172406bc10 msgr2=0x7f172406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:02.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 -- 172.21.15.144:0/3012074906 shutdown_connections 2024-09-12T12:17:02.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 -- 172.21.15.144:0/3012074906 wait complete. 2024-09-12T12:17:02.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 Processor -- start 2024-09-12T12:17:02.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.142+0000 7f172ac00640 1 -- start start 2024-09-12T12:17:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f172ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d250 0x7f172414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f172ac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f172406d630 0x7f1724156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f172ac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17240b3490 0x7f172415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:02.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f172ac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f17240b44d0 con 0x7f172406d630 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f172ac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f17240b41f0 con 0x7f17240b3490 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f172ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f172415d690 con 0x7f172406d250 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f172406d630 0x7f1724156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f172406d630 0x7f1724156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58852/0 (socket says 172.21.15.144:58852) 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723400640 1 -- 172.21.15.144:0/3198944459 learned_addr learned my addr 172.21.15.144:0/3198944459 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1728c00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17240b3490 0x7f172415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723e00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d250 0x7f172414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723400640 1 -- 172.21.15.144:0/3198944459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d250 msgr2=0x7f172414d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723400640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d250 0x7f172414d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723400640 1 -- 172.21.15.144:0/3198944459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17240b3490 msgr2=0x7f172415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723400640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17240b3490 0x7f172415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723400640 1 -- 172.21.15.144:0/3198944459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172414df80 con 0x7f172406d630 2024-09-12T12:17:02.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f1723400640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f172406d630 0x7f1724156380 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f171000c3f0 tx=0x7f171000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:02.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f171be00640 1 -- 172.21.15.144:0/3198944459 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710017070 con 0x7f172406d630 2024-09-12T12:17:02.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f171be00640 1 -- 172.21.15.144:0/3198944459 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1710005cf0 con 0x7f172406d630 2024-09-12T12:17:02.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172414ebd0 con 0x7f172406d630 2024-09-12T12:17:02.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f171be00640 1 -- 172.21.15.144:0/3198944459 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17100072f0 con 0x7f172406d630 2024-09-12T12:17:02.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1724152550 con 0x7f172406d630 2024-09-12T12:17:02.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172415c740 con 0x7f172406d630 2024-09-12T12:17:02.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.146+0000 7f171be00640 1 -- 172.21.15.144:0/3198944459 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f171001a070 con 0x7f172406d630 2024-09-12T12:17:02.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.150+0000 7f171be00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17040678c0 0x7f1704069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:02.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.150+0000 7f171be00640 1 -- 172.21.15.144:0/3198944459 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5249+0+0 (secure 0 0 0) 0x7f1710084f70 con 0x7f172406d630 2024-09-12T12:17:02.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.150+0000 7f1723e00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17040678c0 0x7f1704069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:02.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.150+0000 7f1723e00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17040678c0 0x7f1704069d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f17140af000 tx=0x7f17140a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:02.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.154+0000 7f171be00640 1 -- 172.21.15.144:0/3198944459 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1710055c60 con 0x7f172406d630 2024-09-12T12:17:02.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:02.310+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f172414f5f0 con 0x7f172406d630 2024-09-12T12:17:03.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.246+0000 7f171be00640 1 -- 172.21.15.144:0/3198944459 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7f1710055560 con 0x7f172406d630 2024-09-12T12:17:03.249 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:17:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17040678c0 msgr2=0x7f1704069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17040678c0 0x7f1704069d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f17140af000 tx=0x7f17140a7070 comp rx=0 tx=0).stop 2024-09-12T12:17:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f172406d630 msgr2=0x7f1724156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f172406d630 0x7f1724156380 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f171000c3f0 tx=0x7f171000c8b0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 shutdown_connections 2024-09-12T12:17:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17040678c0 0x7f1704069d80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17240b3490 0x7f172415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f172406d630 0x7f1724156380 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 --2- 172.21.15.144:0/3198944459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f172406d250 0x7f172414d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 >> 172.21.15.144:0/3198944459 conn(0x7f172406bc10 msgr2=0x7f17241532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 shutdown_connections 2024-09-12T12:17:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.250+0000 7f172ac00640 1 -- 172.21.15.144:0/3198944459 wait complete. 2024-09-12T12:17:03.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:17:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.422+0000 7f8ef7200640 1 Processor -- start 2024-09-12T12:17:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.422+0000 7f8ef7200640 1 -- start start 2024-09-12T12:17:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8ef7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8ef006c320 0x7f8ef0165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8ef7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ef00b4300 con 0x7f8ef015af60 2024-09-12T12:17:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8ef7200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ef00b3540 con 0x7f8ef00cd9f0 2024-09-12T12:17:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8ef7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8ef00b32f0 con 0x7f8ef006c320 2024-09-12T12:17:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8eefe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8ef015af60 0x7f8ef00ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52980/0 (socket says 172.21.15.144:52980) 2024-09-12T12:17:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8eefe00640 1 -- 172.21.15.144:0/1920010935 learned_addr learned my addr 172.21.15.144:0/1920010935 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8ef5200640 1 --2- 172.21.15.144:0/1920010935 >> v2:172.21.15.165:3300/0 conn(0x7f8ef006c320 0x7f8ef0165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8eeea00640 1 -- 172.21.15.144:0/1920010935 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130770840 0 0) 0x7f8ef00b4300 con 0x7f8ef015af60 2024-09-12T12:17:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8eeea00640 1 -- 172.21.15.144:0/1920010935 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ed4003530 con 0x7f8ef015af60 2024-09-12T12:17:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8ef5200640 1 -- 172.21.15.144:0/1920010935 >> v1:172.21.15.165:6789/0 conn(0x7f8ef00cd9f0 legacy=0x7f8ef006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8eeea00640 1 -- 172.21.15.144:0/1920010935 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742827613 0 0) 0x7f8ef00b3540 con 0x7f8ef00cd9f0 2024-09-12T12:17:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8ef5200640 1 -- 172.21.15.144:0/1920010935 >> v1:172.21.15.144:6789/0 conn(0x7f8ef015af60 legacy=0x7f8ef00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.426+0000 7f8ef5200640 1 -- 172.21.15.144:0/1920010935 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef00b3820 con 0x7f8ef006c320 2024-09-12T12:17:03.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef5200640 1 --2- 172.21.15.144:0/1920010935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ef006c320 0x7f8ef0165ef0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097c0 tx=0x7f8ee801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f28128aeb12ad8d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:03.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8eeea00640 1 -- 172.21.15.144:0/1920010935 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80b0070 con 0x7f8ef006c320 2024-09-12T12:17:03.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8eeea00640 1 -- 172.21.15.144:0/1920010935 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee80ab600 con 0x7f8ef006c320 2024-09-12T12:17:03.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8eeea00640 1 -- 172.21.15.144:0/1920010935 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80ab9b0 con 0x7f8ef006c320 2024-09-12T12:17:03.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef7200640 1 -- 172.21.15.144:0/1920010935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ef006c320 msgr2=0x7f8ef0165ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef7200640 1 --2- 172.21.15.144:0/1920010935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ef006c320 0x7f8ef0165ef0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097c0 tx=0x7f8ee801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef7200640 1 -- 172.21.15.144:0/1920010935 shutdown_connections 2024-09-12T12:17:03.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef7200640 1 --2- 172.21.15.144:0/1920010935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ef006c320 0x7f8ef0165ef0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef7200640 1 -- 172.21.15.144:0/1920010935 >> 172.21.15.144:0/1920010935 conn(0x7f8ef0068030 msgr2=0x7f8ef00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:03.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef7200640 1 -- 172.21.15.144:0/1920010935 shutdown_connections 2024-09-12T12:17:03.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef7200640 1 -- 172.21.15.144:0/1920010935 wait complete. 2024-09-12T12:17:03.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef7200640 1 Processor -- start 2024-09-12T12:17:03.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.430+0000 7f8ef7200640 1 -- start start 2024-09-12T12:17:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ef006c320 0x7f8ef0150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ef00cd9f0 0x7f8ef0150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015af60 0x7f8ef0141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0168dd0 con 0x7f8ef015af60 2024-09-12T12:17:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0168c50 con 0x7f8ef00cd9f0 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef0168f50 con 0x7f8ef006c320 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015af60 0x7f8ef0141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015af60 0x7f8ef0141640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58864/0 (socket says 172.21.15.144:58864) 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef5200640 1 -- 172.21.15.144:0/817408285 learned_addr learned my addr 172.21.15.144:0/817408285 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8eefe00640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ef006c320 0x7f8ef0150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8eef400640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ef00cd9f0 0x7f8ef0150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef5200640 1 -- 172.21.15.144:0/817408285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ef006c320 msgr2=0x7f8ef0150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef5200640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ef006c320 0x7f8ef0150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef5200640 1 -- 172.21.15.144:0/817408285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ef00cd9f0 msgr2=0x7f8ef0150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef5200640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ef00cd9f0 0x7f8ef0150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef5200640 1 -- 172.21.15.144:0/817408285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef015de10 con 0x7f8ef015af60 2024-09-12T12:17:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef5200640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015af60 0x7f8ef0141640 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80ae040 tx=0x7f8ee8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ee7e00640 1 -- 172.21.15.144:0/817408285 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80ba070 con 0x7f8ef015af60 2024-09-12T12:17:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ee7e00640 1 -- 172.21.15.144:0/817408285 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee80ab9b0 con 0x7f8ef015af60 2024-09-12T12:17:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef015e0f0 con 0x7f8ef015af60 2024-09-12T12:17:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ee7e00640 1 -- 172.21.15.144:0/817408285 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80b0040 con 0x7f8ef015af60 2024-09-12T12:17:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef0072ca0 con 0x7f8ef015af60 2024-09-12T12:17:03.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.434+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef0072f90 con 0x7f8ef015af60 2024-09-12T12:17:03.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.438+0000 7f8ee7e00640 1 -- 172.21.15.144:0/817408285 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ee80bd070 con 0x7f8ef015af60 2024-09-12T12:17:03.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.438+0000 7f8ee7e00640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ed00678c0 0x7f8ed0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:03.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.438+0000 7f8ee7e00640 1 -- 172.21.15.144:0/817408285 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5619+0+0 (secure 0 0 0) 0x7f8ee811f370 con 0x7f8ef015af60 2024-09-12T12:17:03.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.438+0000 7f8eefe00640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ed00678c0 0x7f8ed0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:03.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.438+0000 7f8eefe00640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ed00678c0 0x7f8ed0069d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0005c10 tx=0x7f8ee0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:03.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.442+0000 7f8ee7e00640 1 -- 172.21.15.144:0/817408285 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8ef0072f90 con 0x7f8ef015af60 2024-09-12T12:17:03.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:03.602+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8ef006bc10 con 0x7f8ef015af60 2024-09-12T12:17:04.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ee7e00640 1 -- 172.21.15.144:0/817408285 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) ==== 170+0+0 (secure 0 0 0) 0x7f8ee80c4020 con 0x7f8ef015af60 2024-09-12T12:17:04.256 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:17:04.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ed00678c0 msgr2=0x7f8ed0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ed00678c0 0x7f8ed0069d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0005c10 tx=0x7f8ee0009040 comp rx=0 tx=0).stop 2024-09-12T12:17:04.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015af60 msgr2=0x7f8ef0141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015af60 0x7f8ef0141640 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80ae040 tx=0x7f8ee8019240 comp rx=0 tx=0).stop 2024-09-12T12:17:04.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 shutdown_connections 2024-09-12T12:17:04.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ed00678c0 0x7f8ed0069d80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef015af60 0x7f8ef0141640 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ef00cd9f0 0x7f8ef0150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 --2- 172.21.15.144:0/817408285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ef006c320 0x7f8ef0150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 >> 172.21.15.144:0/817408285 conn(0x7f8ef0068030 msgr2=0x7f8ef00afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:04.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 shutdown_connections 2024-09-12T12:17:04.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.254+0000 7f8ef7200640 1 -- 172.21.15.144:0/817408285 wait complete. 2024-09-12T12:17:04.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:17:04.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.430+0000 7fa7c0000640 1 Processor -- start 2024-09-12T12:17:04.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.430+0000 7fa7c0000640 1 -- start start 2024-09-12T12:17:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7c0000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa7b80b32f0 0x7fa7b815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7c0000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b815bf00 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7c0000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b80b38b0 con 0x7fa7b806d0f0 2024-09-12T12:17:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7c0000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b80b3b90 con 0x7fa7b80b32f0 2024-09-12T12:17:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7bcc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa7b80b32f0 0x7fa7b815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7bcc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa7b80b32f0 0x7fa7b815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58876/0 (socket says 172.21.15.144:58876) 2024-09-12T12:17:04.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7bcc00640 1 -- 172.21.15.144:0/1660661330 learned_addr learned my addr 172.21.15.144:0/1660661330 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:04.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7bcc00640 1 -- 172.21.15.144:0/1660661330 >> v1:172.21.15.165:6789/0 conn(0x7fa7b806d0f0 legacy=0x7fa7b806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7bcc00640 1 -- 172.21.15.144:0/1660661330 >> v1:172.21.15.144:6789/0 conn(0x7fa7b80ccdc0 legacy=0x7fa7b80cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7b7e00640 1 -- 172.21.15.144:0/1660661330 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3542514874 0 0) 0x7fa7b815bf00 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.434+0000 7fa7bcc00640 1 -- 172.21.15.144:0/1660661330 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b80b3e70 con 0x7fa7b80b32f0 2024-09-12T12:17:04.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7bcc00640 1 --2- 172.21.15.144:0/1660661330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80b32f0 0x7fa7b815b9c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009870 tx=0x7fa7a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c054fa7714bea12c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:04.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7b7e00640 1 -- 172.21.15.144:0/1660661330 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40b1070 con 0x7fa7b80b32f0 2024-09-12T12:17:04.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7b7e00640 1 -- 172.21.15.144:0/1660661330 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a40a8050 con 0x7fa7b80b32f0 2024-09-12T12:17:04.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7b7e00640 1 -- 172.21.15.144:0/1660661330 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a40ac860 con 0x7fa7b80b32f0 2024-09-12T12:17:04.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 -- 172.21.15.144:0/1660661330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80b32f0 msgr2=0x7fa7b815b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 --2- 172.21.15.144:0/1660661330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80b32f0 0x7fa7b815b9c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009870 tx=0x7fa7a401c4d0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 -- 172.21.15.144:0/1660661330 shutdown_connections 2024-09-12T12:17:04.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 --2- 172.21.15.144:0/1660661330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80b32f0 0x7fa7b815b9c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 -- 172.21.15.144:0/1660661330 >> 172.21.15.144:0/1660661330 conn(0x7fa7b8068030 msgr2=0x7fa7b80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:04.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 -- 172.21.15.144:0/1660661330 shutdown_connections 2024-09-12T12:17:04.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 -- 172.21.15.144:0/1660661330 wait complete. 2024-09-12T12:17:04.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 Processor -- start 2024-09-12T12:17:04.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 -- start start 2024-09-12T12:17:04.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7b806d0f0 0x7fa7b80b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:04.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b80b32f0 0x7fa7b815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:04.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80ccdc0 0x7fa7b81f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b8168970 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81687f0 con 0x7fa7b80b32f0 2024-09-12T12:17:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.438+0000 7fa7c0000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b8168af0 con 0x7fa7b806d0f0 2024-09-12T12:17:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7be000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80ccdc0 0x7fa7b81f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7bd600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7b806d0f0 0x7fa7b80b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7bcc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b80b32f0 0x7fa7b815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7be000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80ccdc0 0x7fa7b81f8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58882/0 (socket says 172.21.15.144:58882) 2024-09-12T12:17:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7be000640 1 -- 172.21.15.144:0/3721606110 learned_addr learned my addr 172.21.15.144:0/3721606110 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:04.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7be000640 1 -- 172.21.15.144:0/3721606110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7b806d0f0 msgr2=0x7fa7b80b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7be000640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7b806d0f0 0x7fa7b80b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7be000640 1 -- 172.21.15.144:0/3721606110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b80b32f0 msgr2=0x7fa7b815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7be000640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b80b32f0 0x7fa7b815b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7be000640 1 -- 172.21.15.144:0/3721606110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b814a1e0 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7be000640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80ccdc0 0x7fa7b81f8b60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c780 tx=0x7fa7b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7b5600640 1 -- 172.21.15.144:0/3721606110 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0003db0 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7b5600640 1 -- 172.21.15.144:0/3721606110 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b000ce30 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7b5600640 1 -- 172.21.15.144:0/3721606110 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0005290 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b814a4c0 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b815bb30 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b806d4d0 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.442+0000 7fa7b5600640 1 -- 172.21.15.144:0/3721606110 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7b0005430 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.446+0000 7fa7b5600640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa7980678c0 0x7fa798069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:04.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.446+0000 7fa7b5600640 1 -- 172.21.15.144:0/3721606110 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6001+0+0 (secure 0 0 0) 0x7fa7b0086660 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.446+0000 7fa7bd600640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa7980678c0 0x7fa798069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:04.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.446+0000 7fa7bd600640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa7980678c0 0x7fa798069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac007fd0 tx=0x7fa7ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:04.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.450+0000 7fa7b5600640 1 -- 172.21.15.144:0/3721606110 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa7b0056a90 con 0x7fa7b80ccdc0 2024-09-12T12:17:04.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:04.638+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa7b80afbe0 con 0x7fa7b80ccdc0 2024-09-12T12:17:05.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.254+0000 7fa7b5600640 1 -- 172.21.15.144:0/3721606110 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v50) ==== 174+0+0 (secure 0 0 0) 0x7fa7b005ad90 con 0x7fa7b80ccdc0 2024-09-12T12:17:05.258 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 11 and data pool 12 2024-09-12T12:17:05.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa7980678c0 msgr2=0x7fa798069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa7980678c0 0x7fa798069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac007fd0 tx=0x7fa7ac009040 comp rx=0 tx=0).stop 2024-09-12T12:17:05.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80ccdc0 msgr2=0x7fa7b81f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80ccdc0 0x7fa7b81f8b60 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c780 tx=0x7fa7b000cc40 comp rx=0 tx=0).stop 2024-09-12T12:17:05.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 shutdown_connections 2024-09-12T12:17:05.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa7980678c0 0x7fa798069d80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7b80ccdc0 0x7fa7b81f8b60 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7b80b32f0 0x7fa7b815b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 --2- 172.21.15.144:0/3721606110 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7b806d0f0 0x7fa7b80b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 >> 172.21.15.144:0/3721606110 conn(0x7fa7b8068030 msgr2=0x7fa7b8151620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.262+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 shutdown_connections 2024-09-12T12:17:05.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.266+0000 7fa7c0000640 1 -- 172.21.15.144:0/3721606110 wait complete. 2024-09-12T12:17:05.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:17:05.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bd800640 1 Processor -- start 2024-09-12T12:17:05.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bd800640 1 -- start start 2024-09-12T12:17:05.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bd800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14b80b04e0 0x7f14b815d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bd800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14b8141c50 con 0x7f14b81568a0 2024-09-12T12:17:05.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bd800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14b8141f30 con 0x7f14b80b08c0 2024-09-12T12:17:05.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bd800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f14b81427d0 con 0x7f14b80b04e0 2024-09-12T12:17:05.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bce00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f14b81568a0 0x7f14b806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53006/0 (socket says 172.21.15.144:53006) 2024-09-12T12:17:05.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bce00640 1 -- 172.21.15.144:0/758219410 learned_addr learned my addr 172.21.15.144:0/758219410 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:05.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b7e00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14b80b04e0 0x7f14b815d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281107496 0 0) 0x7f14b8141c50 con 0x7f14b81568a0 2024-09-12T12:17:05.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f149c003530 con 0x7f14b81568a0 2024-09-12T12:17:05.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1166293593 0 0) 0x7f149c003530 con 0x7f14b81568a0 2024-09-12T12:17:05.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14b80b04e0 msgr2=0x7f14b815d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14b80b04e0 0x7f14b815d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 >> v1:172.21.15.165:6789/0 conn(0x7f14b80b08c0 legacy=0x7f14b8156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b8142210 con 0x7f14b81568a0 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f14b0001a00 con 0x7f14b81568a0 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 >> v1:172.21.15.144:6789/0 conn(0x7f14b81568a0 legacy=0x7f14b806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14b80b04e0 0x7f149c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c003f30 0x7f149c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f149c004d50 0x7f149c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f14b81427d0 con 0x7f149c004d50 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f149c00ba30 con 0x7f149c003f30 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f149c00bc30 con 0x7f14b80b04e0 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bce00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f149c004d50 0x7f149c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b7e00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14b80b04e0 0x7f149c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b7400640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c003f30 0x7f149c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bce00640 1 -- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14b80b04e0 msgr2=0x7f149c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bce00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14b80b04e0 0x7f149c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bce00640 1 -- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c003f30 msgr2=0x7f149c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bce00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c003f30 0x7f149c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14bce00640 1 -- 172.21.15.144:0/758219410 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149c003530 con 0x7f149c004d50 2024-09-12T12:17:05.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.446+0000 7f14b7400640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c003f30 0x7f149c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:05.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14bce00640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f149c004d50 0x7f149c0051d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f14b000a830 tx=0x7f14b001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de0f77aa1ad95fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b000a480 con 0x7f149c004d50 2024-09-12T12:17:05.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b00aa6d0 con 0x7f149c004d50 2024-09-12T12:17:05.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14b6a00640 1 -- 172.21.15.144:0/758219410 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b00aab20 con 0x7f149c004d50 2024-09-12T12:17:05.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14bd800640 1 -- 172.21.15.144:0/758219410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f149c004d50 msgr2=0x7f149c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14bd800640 1 --2- 172.21.15.144:0/758219410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f149c004d50 0x7f149c0051d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f14b000a830 tx=0x7f14b001faa0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14bce00640 1 -- 172.21.15.144:0/758219410 reap_dead start 2024-09-12T12:17:05.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14bd800640 1 -- 172.21.15.144:0/758219410 shutdown_connections 2024-09-12T12:17:05.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14bd800640 1 -- 172.21.15.144:0/758219410 >> 172.21.15.144:0/758219410 conn(0x7f14b806e060 msgr2=0x7f14b806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14bd800640 1 -- 172.21.15.144:0/758219410 shutdown_connections 2024-09-12T12:17:05.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.450+0000 7f14bd800640 1 -- 172.21.15.144:0/758219410 wait complete. 2024-09-12T12:17:05.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 Processor -- start 2024-09-12T12:17:05.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 -- start start 2024-09-12T12:17:05.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f149c004d50 0x7f14b814b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14b815e9a0 0x7f14b8138250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b8155430 0x7f14b8138790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f14b80cde80 con 0x7f14b8155430 2024-09-12T12:17:05.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f14b80b0d20 con 0x7f14b815e9a0 2024-09-12T12:17:05.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f14b80ce000 con 0x7f149c004d50 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b8155430 0x7f14b8138790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b8155430 0x7f14b8138790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58912/0 (socket says 172.21.15.144:58912) 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bce00640 1 -- 172.21.15.144:0/67698947 learned_addr learned my addr 172.21.15.144:0/67698947 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14b7e00640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f149c004d50 0x7f14b814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14b7400640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14b815e9a0 0x7f14b8138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bce00640 1 -- 172.21.15.144:0/67698947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f149c004d50 msgr2=0x7f14b814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bce00640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f149c004d50 0x7f14b814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bce00640 1 -- 172.21.15.144:0/67698947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14b815e9a0 msgr2=0x7f14b8138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bce00640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14b815e9a0 0x7f14b8138250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bce00640 1 -- 172.21.15.144:0/67698947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b815eed0 con 0x7f14b8155430 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bce00640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b8155430 0x7f14b8138790 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f14b001f8d0 tx=0x7f149c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14afe00640 1 -- 172.21.15.144:0/67698947 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b000a480 con 0x7f14b8155430 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14afe00640 1 -- 172.21.15.144:0/67698947 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b00aada0 con 0x7f14b8155430 2024-09-12T12:17:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b815f1b0 con 0x7f14b8155430 2024-09-12T12:17:05.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14afe00640 1 -- 172.21.15.144:0/67698947 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0001fe0 con 0x7f14b8155430 2024-09-12T12:17:05.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.454+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b815f770 con 0x7f14b8155430 2024-09-12T12:17:05.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.458+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b806ee90 con 0x7f14b8155430 2024-09-12T12:17:05.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.458+0000 7f14afe00640 1 -- 172.21.15.144:0/67698947 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14b0004b70 con 0x7f14b8155430 2024-09-12T12:17:05.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.458+0000 7f14afe00640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14980678c0 0x7f1498069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.458+0000 7f14afe00640 1 -- 172.21.15.144:0/67698947 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f14b01235a0 con 0x7f14b8155430 2024-09-12T12:17:05.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.458+0000 7f14b7e00640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14980678c0 0x7f1498069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.458+0000 7f14b7e00640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14980678c0 0x7f1498069d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009be0 tx=0x7f14a8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.462+0000 7f14afe00640 1 -- 172.21.15.144:0/67698947 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f14b00ae030 con 0x7f14b8155430 2024-09-12T12:17:05.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.622+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14b813e280 con 0x7f14b8155430 2024-09-12T12:17:05.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.622+0000 7f14afe00640 1 -- 172.21.15.144:0/67698947 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+17042 (secure 0 0 0) 0x7f14b00197b0 con 0x7f14b8155430 2024-09-12T12:17:05.627 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:05.627 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":82,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:17:04.644377+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:02.359534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:03.653180+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:17:05.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14980678c0 msgr2=0x7f1498069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14980678c0 0x7f1498069d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009be0 tx=0x7f14a8009190 comp rx=0 tx=0).stop 2024-09-12T12:17:05.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b8155430 msgr2=0x7f14b8138790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b8155430 0x7f14b8138790 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f14b001f8d0 tx=0x7f149c005840 comp rx=0 tx=0).stop 2024-09-12T12:17:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 shutdown_connections 2024-09-12T12:17:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14980678c0 0x7f1498069d80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14b8155430 0x7f14b8138790 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14b815e9a0 0x7f14b8138250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 --2- 172.21.15.144:0/67698947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f149c004d50 0x7f14b814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 >> 172.21.15.144:0/67698947 conn(0x7f14b806e060 msgr2=0x7f14b813ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 shutdown_connections 2024-09-12T12:17:05.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.626+0000 7f14bd800640 1 -- 172.21.15.144:0/67698947 wait complete. 2024-09-12T12:17:05.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:17:05.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f1517a00640 1 Processor -- start 2024-09-12T12:17:05.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f1517a00640 1 -- start start 2024-09-12T12:17:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f1517a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f151006c320 0x7f1510072e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f1517a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151015e9a0 con 0x7f151015e5c0 2024-09-12T12:17:05.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f1517a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1510073b70 con 0x7f1510073340 2024-09-12T12:17:05.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f1517a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1510073e50 con 0x7f151006c320 2024-09-12T12:17:05.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f1515000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f151015e5c0 0x7f151006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53020/0 (socket says 172.21.15.144:53020) 2024-09-12T12:17:05.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f1515000640 1 -- 172.21.15.144:0/1741013502 learned_addr learned my addr 172.21.15.144:0/1741013502 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:05.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f150fe00640 1 --2- 172.21.15.144:0/1741013502 >> v2:172.21.15.144:3300/0 conn(0x7f151006c320 0x7f1510072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f150fe00640 1 -- 172.21.15.144:0/1741013502 >> v1:172.21.15.165:6789/0 conn(0x7f1510073340 legacy=0x7f15100af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f150fe00640 1 -- 172.21.15.144:0/1741013502 >> v1:172.21.15.144:6789/0 conn(0x7f151015e5c0 legacy=0x7f151006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f150fe00640 1 -- 172.21.15.144:0/1741013502 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1510074130 con 0x7f151006c320 2024-09-12T12:17:05.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.782+0000 7f150f400640 1 -- 172.21.15.144:0/1741013502 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393265977 0 0) 0x7f151015e9a0 con 0x7f151015e5c0 2024-09-12T12:17:05.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f150fe00640 1 --2- 172.21.15.144:0/1741013502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151006c320 0x7f1510072e00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0097c0 tx=0x7f14fc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625083159e5b91ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f150f400640 1 -- 172.21.15.144:0/1741013502 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0ab600 con 0x7f151006c320 2024-09-12T12:17:05.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f150f400640 1 -- 172.21.15.144:0/1741013502 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14fc0b0070 con 0x7f151006c320 2024-09-12T12:17:05.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f150f400640 1 -- 172.21.15.144:0/1741013502 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0ab9c0 con 0x7f151006c320 2024-09-12T12:17:05.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f1517a00640 1 -- 172.21.15.144:0/1741013502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151006c320 msgr2=0x7f1510072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f1517a00640 1 --2- 172.21.15.144:0/1741013502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151006c320 0x7f1510072e00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0097c0 tx=0x7f14fc01c3e0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f1517a00640 1 -- 172.21.15.144:0/1741013502 shutdown_connections 2024-09-12T12:17:05.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f1517a00640 1 --2- 172.21.15.144:0/1741013502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151006c320 0x7f1510072e00 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f1517a00640 1 -- 172.21.15.144:0/1741013502 >> 172.21.15.144:0/1741013502 conn(0x7f15100b3380 msgr2=0x7f15100b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f1517a00640 1 -- 172.21.15.144:0/1741013502 shutdown_connections 2024-09-12T12:17:05.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.786+0000 7f1517a00640 1 -- 172.21.15.144:0/1741013502 wait complete. 2024-09-12T12:17:05.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 Processor -- start 2024-09-12T12:17:05.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 -- start start 2024-09-12T12:17:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f151006c320 0x7f151014a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1510073340 0x7f1510160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151015e5c0 0x7f1510161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f15100b0380 con 0x7f151015e5c0 2024-09-12T12:17:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15100b0200 con 0x7f151006c320 2024-09-12T12:17:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f15100b0500 con 0x7f1510073340 2024-09-12T12:17:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151015e5c0 0x7f1510161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151015e5c0 0x7f1510161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58930/0 (socket says 172.21.15.144:58930) 2024-09-12T12:17:05.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515a00640 1 -- 172.21.15.144:0/696139533 learned_addr learned my addr 172.21.15.144:0/696139533 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:05.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515000640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f151006c320 0x7f151014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f150fe00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1510073340 0x7f1510160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515a00640 1 -- 172.21.15.144:0/696139533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1510073340 msgr2=0x7f1510160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515a00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1510073340 0x7f1510160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515a00640 1 -- 172.21.15.144:0/696139533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f151006c320 msgr2=0x7f151014a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515a00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f151006c320 0x7f151014a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515a00640 1 -- 172.21.15.144:0/696139533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15101617f0 con 0x7f151015e5c0 2024-09-12T12:17:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1515a00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151015e5c0 0x7f1510161150 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f150800c7a0 tx=0x7f150800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f150cc00640 1 -- 172.21.15.144:0/696139533 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508003b80 con 0x7f151015e5c0 2024-09-12T12:17:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f150cc00640 1 -- 172.21.15.144:0/696139533 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1508003d20 con 0x7f151015e5c0 2024-09-12T12:17:05.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f150cc00640 1 -- 172.21.15.144:0/696139533 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150800aa90 con 0x7f151015e5c0 2024-09-12T12:17:05.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1510161ad0 con 0x7f151015e5c0 2024-09-12T12:17:05.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1510158970 con 0x7f151015e5c0 2024-09-12T12:17:05.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.790+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15100729e0 con 0x7f151015e5c0 2024-09-12T12:17:05.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.794+0000 7f150cc00640 1 -- 172.21.15.144:0/696139533 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f150800ac30 con 0x7f151015e5c0 2024-09-12T12:17:05.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.794+0000 7f150cc00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f00678c0 0x7f14f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.794+0000 7f150cc00640 1 -- 172.21.15.144:0/696139533 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f1508085cd0 con 0x7f151015e5c0 2024-09-12T12:17:05.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.794+0000 7f1515000640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f00678c0 0x7f14f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.794+0000 7f1515000640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f00678c0 0x7f14f0069d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1500007fd0 tx=0x7f1500007ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.798+0000 7f150cc00640 1 -- 172.21.15.144:0/696139533 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1508056710 con 0x7f151015e5c0 2024-09-12T12:17:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.958+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15100703f0 con 0x7f151015e5c0 2024-09-12T12:17:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.958+0000 7f150cc00640 1 -- 172.21.15.144:0/696139533 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+17042 (secure 0 0 0) 0x7f1508056010 con 0x7f151015e5c0 2024-09-12T12:17:05.962 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:05.962 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":82,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:17:04.644377+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:02.359534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:03.653180+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:17:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.958+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f00678c0 msgr2=0x7f14f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f00678c0 0x7f14f0069d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1500007fd0 tx=0x7f1500007ba0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151015e5c0 msgr2=0x7f1510161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151015e5c0 0x7f1510161150 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f150800c7a0 tx=0x7f150800cc60 comp rx=0 tx=0).stop 2024-09-12T12:17:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 shutdown_connections 2024-09-12T12:17:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f14f00678c0 0x7f14f0069d80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f151015e5c0 0x7f1510161150 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1510073340 0x7f1510160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 --2- 172.21.15.144:0/696139533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f151006c320 0x7f151014a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 >> 172.21.15.144:0/696139533 conn(0x7f15100b3380 msgr2=0x7f15100af2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 shutdown_connections 2024-09-12T12:17:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:05.962+0000 7f1517a00640 1 -- 172.21.15.144:0/696139533 wait complete. 2024-09-12T12:17:05.983 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:17:06.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.118+0000 7f2aa6800640 1 Processor -- start 2024-09-12T12:17:06.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.118+0000 7f2aa6800640 1 -- start start 2024-09-12T12:17:06.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2aa6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2aa00af5f0 0x7f2aa006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2aa6800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 0x7f2aa00cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2aa6800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aa00733e0 con 0x7f2aa015c2e0 2024-09-12T12:17:06.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2aa6800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2aa006c5c0 con 0x7f2aa00af5f0 2024-09-12T12:17:06.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2aa6800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa00cd290 con 0x7f2aa006c150 2024-09-12T12:17:06.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2a9ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2aa00af5f0 0x7f2aa006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2a9ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2aa00af5f0 0x7f2aa006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58942/0 (socket says 172.21.15.144:58942) 2024-09-12T12:17:06.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2a9ea00640 1 -- 172.21.15.144:0/555829367 learned_addr learned my addr 172.21.15.144:0/555829367 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:06.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2a9fe00640 1 --2- 172.21.15.144:0/555829367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 0x7f2aa00cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2a9ea00640 1 -- 172.21.15.144:0/555829367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 msgr2=0x7f2aa00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:06.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2a9ea00640 1 --2- 172.21.15.144:0/555829367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 0x7f2aa00cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2a9ea00640 1 -- 172.21.15.144:0/555829367 >> v1:172.21.15.144:6789/0 conn(0x7f2aa015c2e0 legacy=0x7f2aa0072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:06.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2a9ea00640 1 -- 172.21.15.144:0/555829367 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa00cd570 con 0x7f2aa00af5f0 2024-09-12T12:17:06.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.122+0000 7f2a9e000640 1 -- 172.21.15.144:0/555829367 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585409779 0 0) 0x7f2aa00733e0 con 0x7f2aa015c2e0 2024-09-12T12:17:06.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2a9ea00640 1 --2- 172.21.15.144:0/555829367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 0x7f2aa006bc10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009870 tx=0x7f2a8c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abd30ff4ac3a7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:06.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2a9e000640 1 -- 172.21.15.144:0/555829367 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0b0070 con 0x7f2aa00af5f0 2024-09-12T12:17:06.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2a9e000640 1 -- 172.21.15.144:0/555829367 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8c0ab600 con 0x7f2aa00af5f0 2024-09-12T12:17:06.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2a9e000640 1 -- 172.21.15.144:0/555829367 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0ab9d0 con 0x7f2aa00af5f0 2024-09-12T12:17:06.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 -- 172.21.15.144:0/555829367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 msgr2=0x7f2aa006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:06.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 --2- 172.21.15.144:0/555829367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 0x7f2aa006bc10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009870 tx=0x7f2a8c01c440 comp rx=0 tx=0).stop 2024-09-12T12:17:06.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 -- 172.21.15.144:0/555829367 shutdown_connections 2024-09-12T12:17:06.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 --2- 172.21.15.144:0/555829367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 0x7f2aa00cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 --2- 172.21.15.144:0/555829367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 0x7f2aa006bc10 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 -- 172.21.15.144:0/555829367 >> 172.21.15.144:0/555829367 conn(0x7f2aa0068030 msgr2=0x7f2aa00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:06.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 -- 172.21.15.144:0/555829367 shutdown_connections 2024-09-12T12:17:06.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 -- 172.21.15.144:0/555829367 wait complete. 2024-09-12T12:17:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 Processor -- start 2024-09-12T12:17:06.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 -- start start 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 0x7f2aa0152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 0x7f2aa014ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aa015c2e0 0x7f2aa0159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa00cee90 con 0x7f2aa00af5f0 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa00ced10 con 0x7f2aa015c2e0 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.126+0000 7f2aa6800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa00cf010 con 0x7f2aa006c150 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 0x7f2aa014ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 0x7f2aa014ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58956/0 (socket says 172.21.15.144:58956) 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9ea00640 1 -- 172.21.15.144:0/3013286035 learned_addr learned my addr 172.21.15.144:0/3013286035 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9fe00640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aa015c2e0 0x7f2aa0159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9f400640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 0x7f2aa0152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9ea00640 1 -- 172.21.15.144:0/3013286035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 msgr2=0x7f2aa0152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9ea00640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 0x7f2aa0152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9ea00640 1 -- 172.21.15.144:0/3013286035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aa015c2e0 msgr2=0x7f2aa0159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9ea00640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aa015c2e0 0x7f2aa0159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9ea00640 1 -- 172.21.15.144:0/3013286035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa01535c0 con 0x7f2aa00af5f0 2024-09-12T12:17:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9fe00640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aa015c2e0 0x7f2aa0159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:06.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9ea00640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 0x7f2aa014ef60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0ae040 tx=0x7f2a8c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:06.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a97400640 1 -- 172.21.15.144:0/3013286035 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0b0040 con 0x7f2aa00af5f0 2024-09-12T12:17:06.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a97400640 1 -- 172.21.15.144:0/3013286035 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8c0b9070 con 0x7f2aa00af5f0 2024-09-12T12:17:06.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a97400640 1 -- 172.21.15.144:0/3013286035 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0b4660 con 0x7f2aa00af5f0 2024-09-12T12:17:06.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa015d630 con 0x7f2aa00af5f0 2024-09-12T12:17:06.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa015dbf0 con 0x7f2aa00af5f0 2024-09-12T12:17:06.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa00cdd70 con 0x7f2aa00af5f0 2024-09-12T12:17:06.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a97400640 1 -- 172.21.15.144:0/3013286035 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2a8c0b4800 con 0x7f2aa00af5f0 2024-09-12T12:17:06.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a97400640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a800678f0 0x7f2a80069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:06.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a97400640 1 -- 172.21.15.144:0/3013286035 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6101+0+0 (secure 0 0 0) 0x7f2a8c11f900 con 0x7f2aa00af5f0 2024-09-12T12:17:06.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.130+0000 7f2a9f400640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a800678f0 0x7f2a80069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:06.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.134+0000 7f2a9f400640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a800678f0 0x7f2a80069db0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2a90000f70 tx=0x7f2a90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:06.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.134+0000 7f2a97400640 1 -- 172.21.15.144:0/3013286035 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2a8c016150 con 0x7f2aa00af5f0 2024-09-12T12:17:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:06.330+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2aa01584a0 con 0x7f2aa00af5f0 2024-09-12T12:17:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.282+0000 7f2a97400640 1 -- 172.21.15.144:0/3013286035 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) ==== 118+0+0 (secure 0 0 0) 0x7f2a8c0f03c0 con 0x7f2aa00af5f0 2024-09-12T12:17:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a800678f0 msgr2=0x7f2a80069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a800678f0 0x7f2a80069db0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2a90000f70 tx=0x7f2a90009040 comp rx=0 tx=0).stop 2024-09-12T12:17:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 msgr2=0x7f2aa014ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 0x7f2aa014ef60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0ae040 tx=0x7f2a8c0191e0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 shutdown_connections 2024-09-12T12:17:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2a800678f0 0x7f2a80069db0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aa015c2e0 0x7f2aa0159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2aa00af5f0 0x7f2aa014ef60 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 --2- 172.21.15.144:0/3013286035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2aa006c150 0x7f2aa0152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 >> 172.21.15.144:0/3013286035 conn(0x7f2aa0068030 msgr2=0x7f2aa0072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:07.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 shutdown_connections 2024-09-12T12:17:07.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.286+0000 7f2aa6800640 1 -- 172.21.15.144:0/3013286035 wait complete. 2024-09-12T12:17:07.311 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:17:07.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:17:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f1991000640 1 Processor -- start 2024-09-12T12:17:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f1991000640 1 -- start start 2024-09-12T12:17:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f1991000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f198c06c320 0x7f198c165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f1991000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f198c0b4300 con 0x7f198c0cd9f0 2024-09-12T12:17:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f1991000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f198c0b3540 con 0x7f198c15af60 2024-09-12T12:17:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f1991000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f198c0b32f0 con 0x7f198c06c320 2024-09-12T12:17:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f198a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f198c06c320 0x7f198c165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f198a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f198c06c320 0x7f198c165ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41570/0 (socket says 172.21.15.144:41570) 2024-09-12T12:17:07.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f198a800640 1 -- 172.21.15.144:0/2305078469 learned_addr learned my addr 172.21.15.144:0/2305078469 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:07.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f198a800640 1 -- 172.21.15.144:0/2305078469 >> v1:172.21.15.165:6789/0 conn(0x7f198c15af60 legacy=0x7f198c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f198a800640 1 -- 172.21.15.144:0/2305078469 >> v1:172.21.15.144:6789/0 conn(0x7f198c0cd9f0 legacy=0x7f198c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.454+0000 7f198a800640 1 -- 172.21.15.144:0/2305078469 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198c0b3820 con 0x7f198c06c320 2024-09-12T12:17:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f198a800640 1 --2- 172.21.15.144:0/2305078469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 0x7f198c165ef0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1984009870 tx=0x7f198401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b685f49b4ef7bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1988a00640 1 -- 172.21.15.144:0/2305078469 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19840b2070 con 0x7f198c06c320 2024-09-12T12:17:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1988a00640 1 -- 172.21.15.144:0/2305078469 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19840a9070 con 0x7f198c06c320 2024-09-12T12:17:07.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1988a00640 1 -- 172.21.15.144:0/2305078469 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19840ad880 con 0x7f198c06c320 2024-09-12T12:17:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1991000640 1 -- 172.21.15.144:0/2305078469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 msgr2=0x7f198c165ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1991000640 1 --2- 172.21.15.144:0/2305078469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 0x7f198c165ef0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1984009870 tx=0x7f198401c560 comp rx=0 tx=0).stop 2024-09-12T12:17:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1991000640 1 -- 172.21.15.144:0/2305078469 shutdown_connections 2024-09-12T12:17:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1991000640 1 --2- 172.21.15.144:0/2305078469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 0x7f198c165ef0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1991000640 1 -- 172.21.15.144:0/2305078469 >> 172.21.15.144:0/2305078469 conn(0x7f198c068030 msgr2=0x7f198c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1991000640 1 -- 172.21.15.144:0/2305078469 shutdown_connections 2024-09-12T12:17:07.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1991000640 1 -- 172.21.15.144:0/2305078469 wait complete. 2024-09-12T12:17:07.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1991000640 1 Processor -- start 2024-09-12T12:17:07.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.458+0000 7f1991000640 1 -- start start 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1991000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 0x7f198c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1991000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f198c0cd9f0 0x7f198c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1991000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f198c15af60 0x7f198c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1991000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f198c168dd0 con 0x7f198c06c320 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1991000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f198c168c50 con 0x7f198c15af60 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1991000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f198c168f50 con 0x7f198c0cd9f0 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 0x7f198c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 0x7f198c151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41582/0 (socket says 172.21.15.144:41582) 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989e00640 1 -- 172.21.15.144:0/3693558014 learned_addr learned my addr 172.21.15.144:0/3693558014 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f198a800640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f198c15af60 0x7f198c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989400640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f198c0cd9f0 0x7f198c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989e00640 1 -- 172.21.15.144:0/3693558014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f198c0cd9f0 msgr2=0x7f198c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989e00640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f198c0cd9f0 0x7f198c153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989e00640 1 -- 172.21.15.144:0/3693558014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f198c15af60 msgr2=0x7f198c0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989e00640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f198c15af60 0x7f198c0b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989e00640 1 -- 172.21.15.144:0/3693558014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198c1520d0 con 0x7f198c06c320 2024-09-12T12:17:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1989e00640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 0x7f198c151a60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f197c00c7a0 tx=0x7f197c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1982000640 1 -- 172.21.15.144:0/3693558014 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c003b80 con 0x7f198c06c320 2024-09-12T12:17:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1982000640 1 -- 172.21.15.144:0/3693558014 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197c003d20 con 0x7f198c06c320 2024-09-12T12:17:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f198c1523b0 con 0x7f198c06c320 2024-09-12T12:17:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1982000640 1 -- 172.21.15.144:0/3693558014 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c00aa90 con 0x7f198c06c320 2024-09-12T12:17:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198c152970 con 0x7f198c06c320 2024-09-12T12:17:07.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f198c06bc10 con 0x7f198c06c320 2024-09-12T12:17:07.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.462+0000 7f1982000640 1 -- 172.21.15.144:0/3693558014 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f197c00ac30 con 0x7f198c06c320 2024-09-12T12:17:07.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.466+0000 7f1982000640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f196c0678c0 0x7f196c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.466+0000 7f1982000640 1 -- 172.21.15.144:0/3693558014 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f197c085b60 con 0x7f198c06c320 2024-09-12T12:17:07.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.466+0000 7f1989400640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f196c0678c0 0x7f196c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.466+0000 7f1989400640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f196c0678c0 0x7f196c069d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f198c1f8c00 tx=0x7f1978009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:07.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.470+0000 7f1982000640 1 -- 172.21.15.144:0/3693558014 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f197c055f50 con 0x7f198c06c320 2024-09-12T12:17:07.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:07.662+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f198c076180 con 0x7f198c06c320 2024-09-12T12:17:08.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.286+0000 7f1982000640 1 -- 172.21.15.144:0/3693558014 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) ==== 122+0+0 (secure 0 0 0) 0x7f197c05a250 con 0x7f198c06c320 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f196c0678c0 msgr2=0x7f196c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f196c0678c0 0x7f196c069d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f198c1f8c00 tx=0x7f1978009040 comp rx=0 tx=0).stop 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 msgr2=0x7f198c151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 0x7f198c151a60 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f197c00c7a0 tx=0x7f197c00cc60 comp rx=0 tx=0).stop 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 shutdown_connections 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f196c0678c0 0x7f196c069d80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f198c15af60 0x7f198c0b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f198c0cd9f0 0x7f198c153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 --2- 172.21.15.144:0/3693558014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f198c06c320 0x7f198c151a60 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 >> 172.21.15.144:0/3693558014 conn(0x7f198c068030 msgr2=0x7f198c0b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:08.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 shutdown_connections 2024-09-12T12:17:08.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.290+0000 7f1991000640 1 -- 172.21.15.144:0/3693558014 wait complete. 2024-09-12T12:17:08.314 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:17:08.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:08.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.446+0000 7fc250600640 1 Processor -- start 2024-09-12T12:17:08.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.446+0000 7fc250600640 1 -- start start 2024-09-12T12:17:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc250600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc24815b4e0 0x7fc2480b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc250600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc2480b3ad0 0x7fc248071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc250600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc248071960 0x7fc2480ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc250600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc2480b45a0 con 0x7fc248071960 2024-09-12T12:17:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc250600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc2480b3fe0 con 0x7fc2480b3ad0 2024-09-12T12:17:08.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc250600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc2480b42c0 con 0x7fc24815b4e0 2024-09-12T12:17:08.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24e600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc248071960 0x7fc2480ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24e600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc248071960 0x7fc2480ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41592/0 (socket says 172.21.15.144:41592) 2024-09-12T12:17:08.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24e600640 1 -- 172.21.15.144:0/1211642479 learned_addr learned my addr 172.21.15.144:0/1211642479 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:08.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24dc00640 1 --2- 172.21.15.144:0/1211642479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc24815b4e0 0x7fc2480b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24d200640 1 --2- 172.21.15.144:0/1211642479 >> v2:172.21.15.165:3300/0 conn(0x7fc2480b3ad0 0x7fc248071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24e600640 1 -- 172.21.15.144:0/1211642479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc24815b4e0 msgr2=0x7fc2480b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:08.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24e600640 1 --2- 172.21.15.144:0/1211642479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc24815b4e0 0x7fc2480b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24e600640 1 -- 172.21.15.144:0/1211642479 >> v2:172.21.15.165:3300/0 conn(0x7fc2480b3ad0 msgr2=0x7fc248071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:08.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24e600640 1 --2- 172.21.15.144:0/1211642479 >> v2:172.21.15.165:3300/0 conn(0x7fc2480b3ad0 0x7fc248071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.450+0000 7fc24e600640 1 -- 172.21.15.144:0/1211642479 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2480b1490 con 0x7fc248071960 2024-09-12T12:17:08.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc24e600640 1 --2- 172.21.15.144:0/1211642479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc248071960 0x7fc2480ccf30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc24806a020 tx=0x7fc24001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385d9837aff3654e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:08.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc247e00640 1 -- 172.21.15.144:0/1211642479 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2400a5750 con 0x7fc248071960 2024-09-12T12:17:08.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc247e00640 1 -- 172.21.15.144:0/1211642479 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2400a58f0 con 0x7fc248071960 2024-09-12T12:17:08.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc247e00640 1 -- 172.21.15.144:0/1211642479 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2400a5cc0 con 0x7fc248071960 2024-09-12T12:17:08.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 -- 172.21.15.144:0/1211642479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc248071960 msgr2=0x7fc2480ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 --2- 172.21.15.144:0/1211642479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc248071960 0x7fc2480ccf30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc24806a020 tx=0x7fc24001c9c0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 -- 172.21.15.144:0/1211642479 shutdown_connections 2024-09-12T12:17:08.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 --2- 172.21.15.144:0/1211642479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc248071960 0x7fc2480ccf30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 --2- 172.21.15.144:0/1211642479 >> v2:172.21.15.165:3300/0 conn(0x7fc2480b3ad0 0x7fc248071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 --2- 172.21.15.144:0/1211642479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc24815b4e0 0x7fc2480b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 -- 172.21.15.144:0/1211642479 >> 172.21.15.144:0/1211642479 conn(0x7fc24806d0d0 msgr2=0x7fc24806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:08.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 -- 172.21.15.144:0/1211642479 shutdown_connections 2024-09-12T12:17:08.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 -- 172.21.15.144:0/1211642479 wait complete. 2024-09-12T12:17:08.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 Processor -- start 2024-09-12T12:17:08.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.454+0000 7fc250600640 1 -- start start 2024-09-12T12:17:08.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc250600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248071960 0x7fc248158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc250600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2480b3ad0 0x7fc248159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc250600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc24815b4e0 0x7fc248153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc250600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc24815f270 con 0x7fc24815b4e0 2024-09-12T12:17:08.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc250600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc24815f0f0 con 0x7fc248071960 2024-09-12T12:17:08.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc250600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc24815f3f0 con 0x7fc2480b3ad0 2024-09-12T12:17:08.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc24815b4e0 0x7fc248153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc24815b4e0 0x7fc248153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41604/0 (socket says 172.21.15.144:41604) 2024-09-12T12:17:08.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24e600640 1 -- 172.21.15.144:0/898346620 learned_addr learned my addr 172.21.15.144:0/898346620 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:08.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24dc00640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248071960 0x7fc248158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24d200640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2480b3ad0 0x7fc248159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24e600640 1 -- 172.21.15.144:0/898346620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2480b3ad0 msgr2=0x7fc248159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24e600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2480b3ad0 0x7fc248159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24e600640 1 -- 172.21.15.144:0/898346620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248071960 msgr2=0x7fc248158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24e600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248071960 0x7fc248158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24e600640 1 -- 172.21.15.144:0/898346620 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc248155ee0 con 0x7fc24815b4e0 2024-09-12T12:17:08.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc24e600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc24815b4e0 0x7fc248153890 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc2400af040 tx=0x7fc240019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:08.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc245600640 1 -- 172.21.15.144:0/898346620 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2400b8470 con 0x7fc24815b4e0 2024-09-12T12:17:08.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc245600640 1 -- 172.21.15.144:0/898346620 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2400b8610 con 0x7fc24815b4e0 2024-09-12T12:17:08.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2481561c0 con 0x7fc24815b4e0 2024-09-12T12:17:08.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc245600640 1 -- 172.21.15.144:0/898346620 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2400b8a00 con 0x7fc24815b4e0 2024-09-12T12:17:08.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc248156780 con 0x7fc24815b4e0 2024-09-12T12:17:08.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc248071420 con 0x7fc24815b4e0 2024-09-12T12:17:08.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.458+0000 7fc245600640 1 -- 172.21.15.144:0/898346620 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc2400c0020 con 0x7fc24815b4e0 2024-09-12T12:17:08.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.462+0000 7fc245600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2280678f0 0x7fc228069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.462+0000 7fc245600640 1 -- 172.21.15.144:0/898346620 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fc2401206a0 con 0x7fc24815b4e0 2024-09-12T12:17:08.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.462+0000 7fc24dc00640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2280678f0 0x7fc228069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.462+0000 7fc24dc00640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2280678f0 0x7fc228069db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc23c007940 tx=0x7fc23c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:08.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.466+0000 7fc245600640 1 -- 172.21.15.144:0/898346620 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc2400c7020 con 0x7fc24815b4e0 2024-09-12T12:17:08.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2481556c0 con 0x7fc24815b4e0 2024-09-12T12:17:08.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc245600640 1 -- 172.21.15.144:0/898346620 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5237 (secure 0 0 0) 0x7fc2400165e0 con 0x7fc24815b4e0 2024-09-12T12:17:08.661 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:08.661 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":54,"btime":"2024-09-12T12:17:08:287906+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/4129870327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4129870327},{"type":"v1","addr":"172.21.15.165:6833","nonce":4129870327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6481,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2560551355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2560551355},{"type":"v1","addr":"172.21.15.165:6835","nonce":2560551355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2937095908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2937095908},{"type":"v1","addr":"172.21.15.144:6836","nonce":2937095908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:07.666928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2111043825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2111043825},{"type":"v1","addr":"172.21.15.144:6837","nonce":2111043825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6690,"qdb_cluster":[6690]},"id":5}]} 2024-09-12T12:17:08.661 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 54 2024-09-12T12:17:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2280678f0 msgr2=0x7fc228069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2280678f0 0x7fc228069db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc23c007940 tx=0x7fc23c008040 comp rx=0 tx=0).stop 2024-09-12T12:17:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc24815b4e0 msgr2=0x7fc248153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc24815b4e0 0x7fc248153890 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc2400af040 tx=0x7fc240019760 comp rx=0 tx=0).stop 2024-09-12T12:17:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 shutdown_connections 2024-09-12T12:17:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2280678f0 0x7fc228069db0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc24815b4e0 0x7fc248153890 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2480b3ad0 0x7fc248159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 --2- 172.21.15.144:0/898346620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc248071960 0x7fc248158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 >> 172.21.15.144:0/898346620 conn(0x7fc24806d0d0 msgr2=0x7fc2480b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 shutdown_connections 2024-09-12T12:17:08.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.658+0000 7fc250600640 1 -- 172.21.15.144:0/898346620 wait complete. 2024-09-12T12:17:08.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:17:08.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.814+0000 7fbc68400640 1 Processor -- start 2024-09-12T12:17:08.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.814+0000 7fbc68400640 1 -- start start 2024-09-12T12:17:08.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.814+0000 7fbc68400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbc6015b4e0 0x7fbc600b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.814+0000 7fbc68400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc600cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.814+0000 7fbc68400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc600b45a0 con 0x7fbc600b3ad0 2024-09-12T12:17:08.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.814+0000 7fbc68400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbc600cd8e0 con 0x7fbc6015b4e0 2024-09-12T12:17:08.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.814+0000 7fbc68400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc600b3fe0 con 0x7fbc600ccf30 2024-09-12T12:17:08.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.814+0000 7fbc66400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc600cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc65a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbc6015b4e0 0x7fbc600b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc66400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc600cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50064/0 (socket says 172.21.15.144:50064) 2024-09-12T12:17:08.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc66400640 1 -- 172.21.15.144:0/2518431958 learned_addr learned my addr 172.21.15.144:0/2518431958 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:08.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc66400640 1 -- 172.21.15.144:0/2518431958 >> v2:172.21.15.165:3300/0 conn(0x7fbc6015b4e0 msgr2=0x7fbc600b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:08.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc66400640 1 --2- 172.21.15.144:0/2518431958 >> v2:172.21.15.165:3300/0 conn(0x7fbc6015b4e0 0x7fbc600b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc66400640 1 -- 172.21.15.144:0/2518431958 >> v1:172.21.15.165:6789/0 conn(0x7fbc600b3ad0 legacy=0x7fbc60071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc66400640 1 -- 172.21.15.144:0/2518431958 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc600b42c0 con 0x7fbc600ccf30 2024-09-12T12:17:08.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc66400640 1 --2- 172.21.15.144:0/2518431958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc600cd3a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009870 tx=0x7fbc5801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37156d1de3353f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:08.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc5fe00640 1 -- 172.21.15.144:0/2518431958 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc580a95f0 con 0x7fbc600ccf30 2024-09-12T12:17:08.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc5fe00640 1 -- 172.21.15.144:0/2518431958 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc580a9790 con 0x7fbc600ccf30 2024-09-12T12:17:08.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.818+0000 7fbc5fe00640 1 -- 172.21.15.144:0/2518431958 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc580a9b60 con 0x7fbc600ccf30 2024-09-12T12:17:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 -- 172.21.15.144:0/2518431958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 msgr2=0x7fbc600cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 --2- 172.21.15.144:0/2518431958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc600cd3a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009870 tx=0x7fbc5801c530 comp rx=0 tx=0).stop 2024-09-12T12:17:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 -- 172.21.15.144:0/2518431958 shutdown_connections 2024-09-12T12:17:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 --2- 172.21.15.144:0/2518431958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc600cd3a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 --2- 172.21.15.144:0/2518431958 >> v2:172.21.15.165:3300/0 conn(0x7fbc6015b4e0 0x7fbc600b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 -- 172.21.15.144:0/2518431958 >> 172.21.15.144:0/2518431958 conn(0x7fbc6006d0d0 msgr2=0x7fbc6006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 -- 172.21.15.144:0/2518431958 shutdown_connections 2024-09-12T12:17:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 -- 172.21.15.144:0/2518431958 wait complete. 2024-09-12T12:17:08.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 Processor -- start 2024-09-12T12:17:08.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 -- start start 2024-09-12T12:17:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc600b3ad0 0x7fbc6015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc60158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6015b4e0 0x7fbc6015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6015b8c0 con 0x7fbc600b3ad0 2024-09-12T12:17:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc600cdef0 con 0x7fbc6015b4e0 2024-09-12T12:17:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc68400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6015e920 con 0x7fbc600ccf30 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc600b3ad0 0x7fbc6015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc600b3ad0 0x7fbc6015e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41606/0 (socket says 172.21.15.144:41606) 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65a00640 1 -- 172.21.15.144:0/3210069665 learned_addr learned my addr 172.21.15.144:0/3210069665 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc66400640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6015b4e0 0x7fbc6015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65000640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc60158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65a00640 1 -- 172.21.15.144:0/3210069665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 msgr2=0x7fbc60158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65a00640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc60158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65a00640 1 -- 172.21.15.144:0/3210069665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6015b4e0 msgr2=0x7fbc6015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65a00640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6015b4e0 0x7fbc6015be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65a00640 1 -- 172.21.15.144:0/3210069665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc600ccd00 con 0x7fbc600b3ad0 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65000640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc60158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc65a00640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc600b3ad0 0x7fbc6015e3e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400efc0 tx=0x7fbc5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.822+0000 7fbc5d600640 1 -- 172.21.15.144:0/3210069665 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54018020 con 0x7fbc600b3ad0 2024-09-12T12:17:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc5d600640 1 -- 172.21.15.144:0/3210069665 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc54014480 con 0x7fbc600b3ad0 2024-09-12T12:17:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc5d600640 1 -- 172.21.15.144:0/3210069665 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54014850 con 0x7fbc600b3ad0 2024-09-12T12:17:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6015c950 con 0x7fbc600b3ad0 2024-09-12T12:17:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6014fa60 con 0x7fbc600b3ad0 2024-09-12T12:17:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc600cd3a0 con 0x7fbc600b3ad0 2024-09-12T12:17:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc5d600640 1 -- 172.21.15.144:0/3210069665 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc5401b020 con 0x7fbc600b3ad0 2024-09-12T12:17:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc5d600640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc400678c0 0x7fbc40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc5d600640 1 -- 172.21.15.144:0/3210069665 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fbc540868f0 con 0x7fbc600b3ad0 2024-09-12T12:17:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc65000640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc400678c0 0x7fbc40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:08.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.826+0000 7fbc65000640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc400678c0 0x7fbc40069d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0016f0 tx=0x7fbc4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.830+0000 7fbc5d600640 1 -- 172.21.15.144:0/3210069665 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbc54022070 con 0x7fbc600b3ad0 2024-09-12T12:17:08.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.986+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc600af6f0 con 0x7fbc600b3ad0 2024-09-12T12:17:08.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc5d600640 1 -- 172.21.15.144:0/3210069665 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+17029 (secure 0 0 0) 0x7fbc54010040 con 0x7fbc600b3ad0 2024-09-12T12:17:08.992 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:08.993 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":83,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:17:06.274962+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:02.359534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:03.653180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:17:08.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc400678c0 msgr2=0x7fbc40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc400678c0 0x7fbc40069d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0016f0 tx=0x7fbc4c009040 comp rx=0 tx=0).stop 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc600b3ad0 msgr2=0x7fbc6015e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc600b3ad0 0x7fbc6015e3e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400efc0 tx=0x7fbc5400c490 comp rx=0 tx=0).stop 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 shutdown_connections 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc400678c0 0x7fbc40069d80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6015b4e0 0x7fbc6015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc600ccf30 0x7fbc60158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 --2- 172.21.15.144:0/3210069665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc600b3ad0 0x7fbc6015e3e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 >> 172.21.15.144:0/3210069665 conn(0x7fbc6006d0d0 msgr2=0x7fbc60151370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 shutdown_connections 2024-09-12T12:17:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:08.990+0000 7fbc68400640 1 -- 172.21.15.144:0/3210069665 wait complete. 2024-09-12T12:17:09.013 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:17:09.014 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:17:09.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7856a00640 1 Processor -- start 2024-09-12T12:17:09.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7856a00640 1 -- start start 2024-09-12T12:17:09.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7856a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f78500d05c0 0x7f7850072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7856a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 0x7f785015de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7856a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f785015a110 con 0x7f7850159d30 2024-09-12T12:17:09.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7856a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7850073710 con 0x7f78500d05c0 2024-09-12T12:17:09.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7856a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7850072e70 con 0x7f7850072640 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7854c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f78500d05c0 0x7f7850072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7856000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 0x7f785015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7854c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f78500d05c0 0x7f7850072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43568/0 (socket says 172.21.15.144:43568) 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7856000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 0x7f785015de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50094/0 (socket says 172.21.15.144:50094) 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.146+0000 7f7854c00640 1 -- 172.21.15.144:0/4112840539 learned_addr learned my addr 172.21.15.144:0/4112840539 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.150+0000 7f7854c00640 1 -- 172.21.15.144:0/4112840539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 msgr2=0x7f785015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.150+0000 7f7854c00640 1 --2- 172.21.15.144:0/4112840539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 0x7f785015de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.150+0000 7f7854c00640 1 -- 172.21.15.144:0/4112840539 >> v1:172.21.15.165:6789/0 conn(0x7f7850159d30 legacy=0x7f78500cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.150+0000 7f7854c00640 1 -- 172.21.15.144:0/4112840539 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7850073150 con 0x7f78500d05c0 2024-09-12T12:17:09.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.150+0000 7f784fe00640 1 -- 172.21.15.144:0/4112840539 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293641515 0 0) 0x7f785015a110 con 0x7f7850159d30 2024-09-12T12:17:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.150+0000 7f7854c00640 1 --2- 172.21.15.144:0/4112840539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78500d05c0 0x7f7850072100 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f783c009870 tx=0x7f783c01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2139da6e35b7fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.150+0000 7f784fe00640 1 -- 172.21.15.144:0/4112840539 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c0a95f0 con 0x7f78500d05c0 2024-09-12T12:17:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.150+0000 7f784fe00640 1 -- 172.21.15.144:0/4112840539 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c0a9790 con 0x7f78500d05c0 2024-09-12T12:17:09.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.150+0000 7f784fe00640 1 -- 172.21.15.144:0/4112840539 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c0a9b60 con 0x7f78500d05c0 2024-09-12T12:17:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 -- 172.21.15.144:0/4112840539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78500d05c0 msgr2=0x7f7850072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 --2- 172.21.15.144:0/4112840539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78500d05c0 0x7f7850072100 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f783c009870 tx=0x7f783c01c530 comp rx=0 tx=0).stop 2024-09-12T12:17:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 -- 172.21.15.144:0/4112840539 shutdown_connections 2024-09-12T12:17:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 --2- 172.21.15.144:0/4112840539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 0x7f785015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 --2- 172.21.15.144:0/4112840539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78500d05c0 0x7f7850072100 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 -- 172.21.15.144:0/4112840539 >> 172.21.15.144:0/4112840539 conn(0x7f785006bc10 msgr2=0x7f785006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 -- 172.21.15.144:0/4112840539 shutdown_connections 2024-09-12T12:17:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 -- 172.21.15.144:0/4112840539 wait complete. 2024-09-12T12:17:09.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 Processor -- start 2024-09-12T12:17:09.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 -- start start 2024-09-12T12:17:09.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 0x7f7850164030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78500d05c0 0x7f7850157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7850159d30 0x7f78500b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f785015ed30 con 0x7f7850159d30 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f785015ebb0 con 0x7f78500d05c0 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f785015eeb0 con 0x7f7850072640 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7850159d30 0x7f78500b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7850159d30 0x7f78500b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41620/0 (socket says 172.21.15.144:41620) 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856000640 1 -- 172.21.15.144:0/2879932683 learned_addr learned my addr 172.21.15.144:0/2879932683 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7855600640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 0x7f7850164030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7854c00640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78500d05c0 0x7f7850157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856000640 1 -- 172.21.15.144:0/2879932683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 msgr2=0x7f7850164030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856000640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 0x7f7850164030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856000640 1 -- 172.21.15.144:0/2879932683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78500d05c0 msgr2=0x7f7850157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856000640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78500d05c0 0x7f7850157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856000640 1 -- 172.21.15.144:0/2879932683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78500b1df0 con 0x7f7850159d30 2024-09-12T12:17:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.154+0000 7f7856000640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7850159d30 0x7f78500b14c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f784800efc0 tx=0x7f784800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f784d600640 1 -- 172.21.15.144:0/2879932683 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7848018020 con 0x7f7850159d30 2024-09-12T12:17:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f784d600640 1 -- 172.21.15.144:0/2879932683 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7848014480 con 0x7f7850159d30 2024-09-12T12:17:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785015faf0 con 0x7f7850159d30 2024-09-12T12:17:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f784d600640 1 -- 172.21.15.144:0/2879932683 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7848014870 con 0x7f7850159d30 2024-09-12T12:17:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78501600b0 con 0x7f7850159d30 2024-09-12T12:17:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785015de60 con 0x7f7850159d30 2024-09-12T12:17:09.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f784d600640 1 -- 172.21.15.144:0/2879932683 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f784801b020 con 0x7f7850159d30 2024-09-12T12:17:09.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f784d600640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78300678c0 0x7f7830069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f784d600640 1 -- 172.21.15.144:0/2879932683 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f7848086960 con 0x7f7850159d30 2024-09-12T12:17:09.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f7855600640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78300678c0 0x7f7830069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.158+0000 7f7855600640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78300678c0 0x7f7830069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7844000f70 tx=0x7f7844009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:09.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.162+0000 7f784d600640 1 -- 172.21.15.144:0/2879932683 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7848022030 con 0x7f7850159d30 2024-09-12T12:17:09.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.322+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78500b3e20 con 0x7f78300678c0 2024-09-12T12:17:09.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.330+0000 7f784d600640 1 -- 172.21.15.144:0/2879932683 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246753 (secure 0 0 0) 0x7f78500b3e20 con 0x7f78300678c0 2024-09-12T12:17:09.334 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:09.337 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:17:09.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78300678c0 msgr2=0x7f7830069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78300678c0 0x7f7830069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7844000f70 tx=0x7f7844009040 comp rx=0 tx=0).stop 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7850159d30 msgr2=0x7f78500b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7850159d30 0x7f78500b14c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f784800efc0 tx=0x7f784800c490 comp rx=0 tx=0).stop 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 shutdown_connections 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78300678c0 0x7f7830069d80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7850159d30 0x7f78500b14c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78500d05c0 0x7f7850157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 --2- 172.21.15.144:0/2879932683 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7850072640 0x7f7850164030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 >> 172.21.15.144:0/2879932683 conn(0x7f785006bc10 msgr2=0x7f78500b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 shutdown_connections 2024-09-12T12:17:09.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.334+0000 7f7856a00640 1 -- 172.21.15.144:0/2879932683 wait complete. 2024-09-12T12:17:09.355 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-09-12T12:17:07.430562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299952,"kb_used_data":8820,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754674768,"statfs":{"total":773094113280,"available":772786962432,"internally_reserved":0,"allocated":9031680,"data_stored":4775403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.177781"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270944+0000","last_change":"2024-09-12T12:17:04.270944+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270944+0000","last_undegraded":"2024-09-12T12:17:04.270944+0000","last_fullsized":"2024-09-12T12:17:04.270944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269037+0000","last_change":"2024-09-12T12:17:04.269037+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269037+0000","last_undegraded":"2024-09-12T12:17:04.269037+0000","last_fullsized":"2024-09-12T12:17:04.269037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267732+0000","last_change":"2024-09-12T12:17:04.267732+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267732+0000","last_undegraded":"2024-09-12T12:17:04.267732+0000","last_fullsized":"2024-09-12T12:17:04.267732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265910+0000","last_change":"2024-09-12T12:17:04.265910+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265910+0000","last_undegraded":"2024-09-12T12:17:04.265910+0000","last_fullsized":"2024-09-12T12:17:04.265910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271660+0000","last_change":"2024-09-12T12:17:04.271660+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271660+0000","last_undegraded":"2024-09-12T12:17:04.271660+0000","last_fullsized":"2024-09-12T12:17:04.271660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.274579+0000","last_change":"2024-09-12T12:17:04.274579+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.274579+0000","last_undegraded":"2024-09-12T12:17:04.274579+0000","last_fullsized":"2024-09-12T12:17:04.274579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264072+0000","last_change":"2024-09-12T12:17:04.264072+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264072+0000","last_undegraded":"2024-09-12T12:17:04.264072+0000","last_fullsized":"2024-09-12T12:17:04.264072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270786+0000","last_change":"2024-09-12T12:17:04.270786+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270786+0000","last_undegraded":"2024-09-12T12:17:04.270786+0000","last_fullsized":"2024-09-12T12:17:04.270786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271631+0000","last_change":"2024-09-12T12:17:04.271631+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271631+0000","last_undegraded":"2024-09-12T12:17:04.271631+0000","last_fullsized":"2024-09-12T12:17:04.271631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267055+0000","last_change":"2024-09-12T12:17:04.267055+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267055+0000","last_undegraded":"2024-09-12T12:17:04.267055+0000","last_fullsized":"2024-09-12T12:17:04.267055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268623+0000","last_change":"2024-09-12T12:17:04.268623+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268623+0000","last_undegraded":"2024-09-12T12:17:04.268623+0000","last_fullsized":"2024-09-12T12:17:04.268623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265515+0000","last_change":"2024-09-12T12:17:04.265515+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265515+0000","last_undegraded":"2024-09-12T12:17:04.265515+0000","last_fullsized":"2024-09-12T12:17:04.265515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267508+0000","last_change":"2024-09-12T12:17:04.267508+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267508+0000","last_undegraded":"2024-09-12T12:17:04.267508+0000","last_fullsized":"2024-09-12T12:17:04.267508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.274211+0000","last_change":"2024-09-12T12:17:04.274211+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.274211+0000","last_undegraded":"2024-09-12T12:17:04.274211+0000","last_fullsized":"2024-09-12T12:17:04.274211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268541+0000","last_change":"2024-09-12T12:17:04.268541+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268541+0000","last_undegraded":"2024-09-12T12:17:04.268541+0000","last_fullsized":"2024-09-12T12:17:04.268541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271563+0000","last_change":"2024-09-12T12:17:04.271563+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271563+0000","last_undegraded":"2024-09-12T12:17:04.271563+0000","last_fullsized":"2024-09-12T12:17:04.271563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.272248+0000","last_change":"2024-09-12T12:17:04.272248+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.272248+0000","last_undegraded":"2024-09-12T12:17:04.272248+0000","last_fullsized":"2024-09-12T12:17:04.272248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270331+0000","last_change":"2024-09-12T12:17:04.270331+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270331+0000","last_undegraded":"2024-09-12T12:17:04.270331+0000","last_fullsized":"2024-09-12T12:17:04.270331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.273226+0000","last_change":"2024-09-12T12:17:04.273226+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.273226+0000","last_undegraded":"2024-09-12T12:17:04.273226+0000","last_fullsized":"2024-09-12T12:17:04.273226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267656+0000","last_change":"2024-09-12T12:17:04.267656+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267656+0000","last_undegraded":"2024-09-12T12:17:04.267656+0000","last_fullsized":"2024-09-12T12:17:04.267656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271080+0000","last_change":"2024-09-12T12:17:04.271080+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271080+0000","last_undegraded":"2024-09-12T12:17:04.271080+0000","last_fullsized":"2024-09-12T12:17:04.271080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265488+0000","last_change":"2024-09-12T12:17:04.265488+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265488+0000","last_undegraded":"2024-09-12T12:17:04.265488+0000","last_fullsized":"2024-09-12T12:17:04.265488+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269304+0000","last_change":"2024-09-12T12:17:04.269304+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269304+0000","last_undegraded":"2024-09-12T12:17:04.269304+0000","last_fullsized":"2024-09-12T12:17:04.269304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268532+0000","last_change":"2024-09-12T12:17:04.268532+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268532+0000","last_undegraded":"2024-09-12T12:17:04.268532+0000","last_fullsized":"2024-09-12T12:17:04.268532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268366+0000","last_change":"2024-09-12T12:17:04.268366+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268366+0000","last_undegraded":"2024-09-12T12:17:04.268366+0000","last_fullsized":"2024-09-12T12:17:04.268366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266565+0000","last_change":"2024-09-12T12:17:04.266565+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266565+0000","last_undegraded":"2024-09-12T12:17:04.266565+0000","last_fullsized":"2024-09-12T12:17:04.266565+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271881+0000","last_change":"2024-09-12T12:17:04.271881+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271881+0000","last_undegraded":"2024-09-12T12:17:04.271881+0000","last_fullsized":"2024-09-12T12:17:04.271881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266435+0000","last_change":"2024-09-12T12:17:04.266435+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266435+0000","last_undegraded":"2024-09-12T12:17:04.266435+0000","last_fullsized":"2024-09-12T12:17:04.266435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268086+0000","last_change":"2024-09-12T12:17:04.268086+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268086+0000","last_undegraded":"2024-09-12T12:17:04.268086+0000","last_fullsized":"2024-09-12T12:17:04.268086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269588+0000","last_change":"2024-09-12T12:17:04.269588+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269588+0000","last_undegraded":"2024-09-12T12:17:04.269588+0000","last_fullsized":"2024-09-12T12:17:04.269588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265279+0000","last_change":"2024-09-12T12:17:04.265279+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265279+0000","last_undegraded":"2024-09-12T12:17:04.265279+0000","last_fullsized":"2024-09-12T12:17:04.265279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269509+0000","last_change":"2024-09-12T12:17:04.269509+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269509+0000","last_undegraded":"2024-09-12T12:17:04.269509+0000","last_fullsized":"2024-09-12T12:17:04.269509+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264435+0000","last_change":"2024-09-12T12:17:04.264435+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264435+0000","last_undegraded":"2024-09-12T12:17:04.264435+0000","last_fullsized":"2024-09-12T12:17:04.264435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.292579+0000","last_change":"2024-09-12T12:17:04.288167+0000","last_active":"2024-09-12T12:17:04.292579+0000","last_peered":"2024-09-12T12:17:04.292579+0000","last_clean":"2024-09-12T12:17:04.292579+0000","last_became_active":"2024-09-12T12:17:04.287954+0000","last_became_peered":"2024-09-12T12:17:04.287954+0000","last_unstale":"2024-09-12T12:17:04.292579+0000","last_undegraded":"2024-09-12T12:17:04.292579+0000","last_fullsized":"2024-09-12T12:17:04.292579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:10:23.643450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267493+0000","last_change":"2024-09-12T12:17:04.267493+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267493+0000","last_undegraded":"2024-09-12T12:17:04.267493+0000","last_fullsized":"2024-09-12T12:17:04.267493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285040+0000","last_change":"2024-09-12T12:17:04.282927+0000","last_active":"2024-09-12T12:17:04.285040+0000","last_peered":"2024-09-12T12:17:04.285040+0000","last_clean":"2024-09-12T12:17:04.285040+0000","last_became_active":"2024-09-12T12:17:04.282682+0000","last_became_peered":"2024-09-12T12:17:04.282682+0000","last_unstale":"2024-09-12T12:17:04.285040+0000","last_undegraded":"2024-09-12T12:17:04.285040+0000","last_fullsized":"2024-09-12T12:17:04.285040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:17.101878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270032+0000","last_change":"2024-09-12T12:17:04.270032+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270032+0000","last_undegraded":"2024-09-12T12:17:04.270032+0000","last_fullsized":"2024-09-12T12:17:04.270032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286122+0000","last_change":"2024-09-12T12:17:04.284408+0000","last_active":"2024-09-12T12:17:04.286122+0000","last_peered":"2024-09-12T12:17:04.286122+0000","last_clean":"2024-09-12T12:17:04.286122+0000","last_became_active":"2024-09-12T12:17:04.284110+0000","last_became_peered":"2024-09-12T12:17:04.284110+0000","last_unstale":"2024-09-12T12:17:04.286122+0000","last_undegraded":"2024-09-12T12:17:04.286122+0000","last_fullsized":"2024-09-12T12:17:04.286122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:13.958415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270686+0000","last_change":"2024-09-12T12:17:04.270686+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270686+0000","last_undegraded":"2024-09-12T12:17:04.270686+0000","last_fullsized":"2024-09-12T12:17:04.270686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282775+0000","last_change":"2024-09-12T12:17:04.282018+0000","last_active":"2024-09-12T12:17:04.282775+0000","last_peered":"2024-09-12T12:17:04.282775+0000","last_clean":"2024-09-12T12:17:04.282775+0000","last_became_active":"2024-09-12T12:17:04.281347+0000","last_became_peered":"2024-09-12T12:17:04.281347+0000","last_unstale":"2024-09-12T12:17:04.282775+0000","last_undegraded":"2024-09-12T12:17:04.282775+0000","last_fullsized":"2024-09-12T12:17:04.282775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:16.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268510+0000","last_change":"2024-09-12T12:17:04.268510+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268510+0000","last_undegraded":"2024-09-12T12:17:04.268510+0000","last_fullsized":"2024-09-12T12:17:04.268510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281044+0000","last_change":"2024-09-12T12:17:04.277749+0000","last_active":"2024-09-12T12:17:04.281044+0000","last_peered":"2024-09-12T12:17:04.281044+0000","last_clean":"2024-09-12T12:17:04.281044+0000","last_became_active":"2024-09-12T12:17:04.277421+0000","last_became_peered":"2024-09-12T12:17:04.277421+0000","last_unstale":"2024-09-12T12:17:04.281044+0000","last_undegraded":"2024-09-12T12:17:04.281044+0000","last_fullsized":"2024-09-12T12:17:04.281044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:52.140000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267996+0000","last_change":"2024-09-12T12:17:04.267996+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267996+0000","last_undegraded":"2024-09-12T12:17:04.267996+0000","last_fullsized":"2024-09-12T12:17:04.267996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286487+0000","last_change":"2024-09-12T12:17:04.285386+0000","last_active":"2024-09-12T12:17:04.286487+0000","last_peered":"2024-09-12T12:17:04.286487+0000","last_clean":"2024-09-12T12:17:04.286487+0000","last_became_active":"2024-09-12T12:17:04.284833+0000","last_became_peered":"2024-09-12T12:17:04.284833+0000","last_unstale":"2024-09-12T12:17:04.286487+0000","last_undegraded":"2024-09-12T12:17:04.286487+0000","last_fullsized":"2024-09-12T12:17:04.286487+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:04.643981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271974+0000","last_change":"2024-09-12T12:17:04.271974+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271974+0000","last_undegraded":"2024-09-12T12:17:04.271974+0000","last_fullsized":"2024-09-12T12:17:04.271974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281925+0000","last_change":"2024-09-12T12:17:04.278438+0000","last_active":"2024-09-12T12:17:04.281925+0000","last_peered":"2024-09-12T12:17:04.281925+0000","last_clean":"2024-09-12T12:17:04.281925+0000","last_became_active":"2024-09-12T12:17:04.277977+0000","last_became_peered":"2024-09-12T12:17:04.277977+0000","last_unstale":"2024-09-12T12:17:04.281925+0000","last_undegraded":"2024-09-12T12:17:04.281925+0000","last_fullsized":"2024-09-12T12:17:04.281925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:25.066020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265443+0000","last_change":"2024-09-12T12:17:04.265443+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265443+0000","last_undegraded":"2024-09-12T12:17:04.265443+0000","last_fullsized":"2024-09-12T12:17:04.265443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282523+0000","last_change":"2024-09-12T12:17:04.277306+0000","last_active":"2024-09-12T12:17:04.282523+0000","last_peered":"2024-09-12T12:17:04.282523+0000","last_clean":"2024-09-12T12:17:04.282523+0000","last_became_active":"2024-09-12T12:17:04.276970+0000","last_became_peered":"2024-09-12T12:17:04.276970+0000","last_unstale":"2024-09-12T12:17:04.282523+0000","last_undegraded":"2024-09-12T12:17:04.282523+0000","last_fullsized":"2024-09-12T12:17:04.282523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:00.660785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267607+0000","last_change":"2024-09-12T12:17:04.267607+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267607+0000","last_undegraded":"2024-09-12T12:17:04.267607+0000","last_fullsized":"2024-09-12T12:17:04.267607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285712+0000","last_change":"2024-09-12T12:17:04.283614+0000","last_active":"2024-09-12T12:17:04.285712+0000","last_peered":"2024-09-12T12:17:04.285712+0000","last_clean":"2024-09-12T12:17:04.285712+0000","last_became_active":"2024-09-12T12:17:04.283363+0000","last_became_peered":"2024-09-12T12:17:04.283363+0000","last_unstale":"2024-09-12T12:17:04.285712+0000","last_undegraded":"2024-09-12T12:17:04.285712+0000","last_fullsized":"2024-09-12T12:17:04.285712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:52.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265028+0000","last_change":"2024-09-12T12:17:04.265028+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265028+0000","last_undegraded":"2024-09-12T12:17:04.265028+0000","last_fullsized":"2024-09-12T12:17:04.265028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281862+0000","last_change":"2024-09-12T12:17:04.278522+0000","last_active":"2024-09-12T12:17:04.281862+0000","last_peered":"2024-09-12T12:17:04.281862+0000","last_clean":"2024-09-12T12:17:04.281862+0000","last_became_active":"2024-09-12T12:17:04.278250+0000","last_became_peered":"2024-09-12T12:17:04.278250+0000","last_unstale":"2024-09-12T12:17:04.281862+0000","last_undegraded":"2024-09-12T12:17:04.281862+0000","last_fullsized":"2024-09-12T12:17:04.281862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:52.862397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.273845+0000","last_change":"2024-09-12T12:17:04.273845+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.273845+0000","last_undegraded":"2024-09-12T12:17:04.273845+0000","last_fullsized":"2024-09-12T12:17:04.273845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.290142+0000","last_change":"2024-09-12T12:17:04.286746+0000","last_active":"2024-09-12T12:17:04.290142+0000","last_peered":"2024-09-12T12:17:04.290142+0000","last_clean":"2024-09-12T12:17:04.290142+0000","last_became_active":"2024-09-12T12:17:04.286451+0000","last_became_peered":"2024-09-12T12:17:04.286451+0000","last_unstale":"2024-09-12T12:17:04.290142+0000","last_undegraded":"2024-09-12T12:17:04.290142+0000","last_fullsized":"2024-09-12T12:17:04.290142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:20.810734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264005+0000","last_change":"2024-09-12T12:17:04.264005+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264005+0000","last_undegraded":"2024-09-12T12:17:04.264005+0000","last_fullsized":"2024-09-12T12:17:04.264005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281921+0000","last_change":"2024-09-12T12:17:04.278410+0000","last_active":"2024-09-12T12:17:04.281921+0000","last_peered":"2024-09-12T12:17:04.281921+0000","last_clean":"2024-09-12T12:17:04.281921+0000","last_became_active":"2024-09-12T12:17:04.278156+0000","last_became_peered":"2024-09-12T12:17:04.278156+0000","last_unstale":"2024-09-12T12:17:04.281921+0000","last_undegraded":"2024-09-12T12:17:04.281921+0000","last_fullsized":"2024-09-12T12:17:04.281921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:33.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265068+0000","last_change":"2024-09-12T12:17:04.265068+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265068+0000","last_undegraded":"2024-09-12T12:17:04.265068+0000","last_fullsized":"2024-09-12T12:17:04.265068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.280803+0000","last_change":"2024-09-12T12:17:04.275009+0000","last_active":"2024-09-12T12:17:04.280803+0000","last_peered":"2024-09-12T12:17:04.280803+0000","last_clean":"2024-09-12T12:17:04.280803+0000","last_became_active":"2024-09-12T12:17:04.274726+0000","last_became_peered":"2024-09-12T12:17:04.274726+0000","last_unstale":"2024-09-12T12:17:04.280803+0000","last_undegraded":"2024-09-12T12:17:04.280803+0000","last_fullsized":"2024-09-12T12:17:04.280803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:03.544531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265791+0000","last_change":"2024-09-12T12:17:04.265791+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265791+0000","last_undegraded":"2024-09-12T12:17:04.265791+0000","last_fullsized":"2024-09-12T12:17:04.265791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287300+0000","last_change":"2024-09-12T12:17:04.286442+0000","last_active":"2024-09-12T12:17:04.287300+0000","last_peered":"2024-09-12T12:17:04.287300+0000","last_clean":"2024-09-12T12:17:04.287300+0000","last_became_active":"2024-09-12T12:17:04.286168+0000","last_became_peered":"2024-09-12T12:17:04.286168+0000","last_unstale":"2024-09-12T12:17:04.287300+0000","last_undegraded":"2024-09-12T12:17:04.287300+0000","last_fullsized":"2024-09-12T12:17:04.287300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:16.524611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264470+0000","last_change":"2024-09-12T12:17:04.264470+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264470+0000","last_undegraded":"2024-09-12T12:17:04.264470+0000","last_fullsized":"2024-09-12T12:17:04.264470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.288883+0000","last_change":"2024-09-12T12:17:04.283991+0000","last_active":"2024-09-12T12:17:04.288883+0000","last_peered":"2024-09-12T12:17:04.288883+0000","last_clean":"2024-09-12T12:17:04.288883+0000","last_became_active":"2024-09-12T12:17:04.283694+0000","last_became_peered":"2024-09-12T12:17:04.283694+0000","last_unstale":"2024-09-12T12:17:04.288883+0000","last_undegraded":"2024-09-12T12:17:04.288883+0000","last_fullsized":"2024-09-12T12:17:04.288883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:25.373252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265035+0000","last_change":"2024-09-12T12:17:04.265035+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265035+0000","last_undegraded":"2024-09-12T12:17:04.265035+0000","last_fullsized":"2024-09-12T12:17:04.265035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.276490+0000","last_change":"2024-09-12T12:17:04.275540+0000","last_active":"2024-09-12T12:17:04.276490+0000","last_peered":"2024-09-12T12:17:04.276490+0000","last_clean":"2024-09-12T12:17:04.276490+0000","last_became_active":"2024-09-12T12:17:04.275188+0000","last_became_peered":"2024-09-12T12:17:04.275188+0000","last_unstale":"2024-09-12T12:17:04.276490+0000","last_undegraded":"2024-09-12T12:17:04.276490+0000","last_fullsized":"2024-09-12T12:17:04.276490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:39.663729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266674+0000","last_change":"2024-09-12T12:17:04.266674+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266674+0000","last_undegraded":"2024-09-12T12:17:04.266674+0000","last_fullsized":"2024-09-12T12:17:04.266674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285690+0000","last_change":"2024-09-12T12:17:04.282311+0000","last_active":"2024-09-12T12:17:04.285690+0000","last_peered":"2024-09-12T12:17:04.285690+0000","last_clean":"2024-09-12T12:17:04.285690+0000","last_became_active":"2024-09-12T12:17:04.282043+0000","last_became_peered":"2024-09-12T12:17:04.282043+0000","last_unstale":"2024-09-12T12:17:04.285690+0000","last_undegraded":"2024-09-12T12:17:04.285690+0000","last_fullsized":"2024-09-12T12:17:04.285690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:39.663729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264821+0000","last_change":"2024-09-12T12:17:04.264821+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264821+0000","last_undegraded":"2024-09-12T12:17:04.264821+0000","last_fullsized":"2024-09-12T12:17:04.264821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282226+0000","last_change":"2024-09-12T12:17:04.281271+0000","last_active":"2024-09-12T12:17:04.282226+0000","last_peered":"2024-09-12T12:17:04.282226+0000","last_clean":"2024-09-12T12:17:04.282226+0000","last_became_active":"2024-09-12T12:17:04.280997+0000","last_became_peered":"2024-09-12T12:17:04.280997+0000","last_unstale":"2024-09-12T12:17:04.282226+0000","last_undegraded":"2024-09-12T12:17:04.282226+0000","last_fullsized":"2024-09-12T12:17:04.282226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:00.696318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265890+0000","last_change":"2024-09-12T12:17:04.265890+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265890+0000","last_undegraded":"2024-09-12T12:17:04.265890+0000","last_fullsized":"2024-09-12T12:17:04.265890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285121+0000","last_change":"2024-09-12T12:17:04.278980+0000","last_active":"2024-09-12T12:17:04.285121+0000","last_peered":"2024-09-12T12:17:04.285121+0000","last_clean":"2024-09-12T12:17:04.285121+0000","last_became_active":"2024-09-12T12:17:04.278725+0000","last_became_peered":"2024-09-12T12:17:04.278725+0000","last_unstale":"2024-09-12T12:17:04.285121+0000","last_undegraded":"2024-09-12T12:17:04.285121+0000","last_fullsized":"2024-09-12T12:17:04.285121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:15.060762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271885+0000","last_change":"2024-09-12T12:17:04.271885+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271885+0000","last_undegraded":"2024-09-12T12:17:04.271885+0000","last_fullsized":"2024-09-12T12:17:04.271885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282379+0000","last_change":"2024-09-12T12:17:04.277891+0000","last_active":"2024-09-12T12:17:04.282379+0000","last_peered":"2024-09-12T12:17:04.282379+0000","last_clean":"2024-09-12T12:17:04.282379+0000","last_became_active":"2024-09-12T12:17:04.277603+0000","last_became_peered":"2024-09-12T12:17:04.277603+0000","last_unstale":"2024-09-12T12:17:04.282379+0000","last_undegraded":"2024-09-12T12:17:04.282379+0000","last_fullsized":"2024-09-12T12:17:04.282379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:16.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266673+0000","last_change":"2024-09-12T12:17:04.266673+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266673+0000","last_undegraded":"2024-09-12T12:17:04.266673+0000","last_fullsized":"2024-09-12T12:17:04.266673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286235+0000","last_change":"2024-09-12T12:17:04.283216+0000","last_active":"2024-09-12T12:17:04.286235+0000","last_peered":"2024-09-12T12:17:04.286235+0000","last_clean":"2024-09-12T12:17:04.286235+0000","last_became_active":"2024-09-12T12:17:04.282951+0000","last_became_peered":"2024-09-12T12:17:04.282951+0000","last_unstale":"2024-09-12T12:17:04.286235+0000","last_undegraded":"2024-09-12T12:17:04.286235+0000","last_fullsized":"2024-09-12T12:17:04.286235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:01.267449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267693+0000","last_change":"2024-09-12T12:17:04.267693+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267693+0000","last_undegraded":"2024-09-12T12:17:04.267693+0000","last_fullsized":"2024-09-12T12:17:04.267693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.292648+0000","last_change":"2024-09-12T12:17:04.287880+0000","last_active":"2024-09-12T12:17:04.292648+0000","last_peered":"2024-09-12T12:17:04.292648+0000","last_clean":"2024-09-12T12:17:04.292648+0000","last_became_active":"2024-09-12T12:17:04.285568+0000","last_became_peered":"2024-09-12T12:17:04.285568+0000","last_unstale":"2024-09-12T12:17:04.292648+0000","last_undegraded":"2024-09-12T12:17:04.292648+0000","last_fullsized":"2024-09-12T12:17:04.292648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:55.756882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264564+0000","last_change":"2024-09-12T12:17:04.264564+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264564+0000","last_undegraded":"2024-09-12T12:17:04.264564+0000","last_fullsized":"2024-09-12T12:17:04.264564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287352+0000","last_change":"2024-09-12T12:17:04.283598+0000","last_active":"2024-09-12T12:17:04.287352+0000","last_peered":"2024-09-12T12:17:04.287352+0000","last_clean":"2024-09-12T12:17:04.287352+0000","last_became_active":"2024-09-12T12:17:04.283327+0000","last_became_peered":"2024-09-12T12:17:04.283327+0000","last_unstale":"2024-09-12T12:17:04.287352+0000","last_undegraded":"2024-09-12T12:17:04.287352+0000","last_fullsized":"2024-09-12T12:17:04.287352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:22.093367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269248+0000","last_change":"2024-09-12T12:17:04.269248+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269248+0000","last_undegraded":"2024-09-12T12:17:04.269248+0000","last_fullsized":"2024-09-12T12:17:04.269248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.280809+0000","last_change":"2024-09-12T12:17:04.274915+0000","last_active":"2024-09-12T12:17:04.280809+0000","last_peered":"2024-09-12T12:17:04.280809+0000","last_clean":"2024-09-12T12:17:04.280809+0000","last_became_active":"2024-09-12T12:17:04.274601+0000","last_became_peered":"2024-09-12T12:17:04.274601+0000","last_unstale":"2024-09-12T12:17:04.280809+0000","last_undegraded":"2024-09-12T12:17:04.280809+0000","last_fullsized":"2024-09-12T12:17:04.280809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:16.740217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263364+0000","last_change":"2024-09-12T12:17:04.263364+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263364+0000","last_undegraded":"2024-09-12T12:17:04.263364+0000","last_fullsized":"2024-09-12T12:17:04.263364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.284671+0000","last_change":"2024-09-12T12:17:04.281551+0000","last_active":"2024-09-12T12:17:04.284671+0000","last_peered":"2024-09-12T12:17:04.284671+0000","last_clean":"2024-09-12T12:17:04.284671+0000","last_became_active":"2024-09-12T12:17:04.281205+0000","last_became_peered":"2024-09-12T12:17:04.281205+0000","last_unstale":"2024-09-12T12:17:04.284671+0000","last_undegraded":"2024-09-12T12:17:04.284671+0000","last_fullsized":"2024-09-12T12:17:04.284671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:17.101878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269595+0000","last_change":"2024-09-12T12:17:04.269595+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269595+0000","last_undegraded":"2024-09-12T12:17:04.269595+0000","last_fullsized":"2024-09-12T12:17:04.269595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286997+0000","last_change":"2024-09-12T12:17:04.285672+0000","last_active":"2024-09-12T12:17:04.286997+0000","last_peered":"2024-09-12T12:17:04.286997+0000","last_clean":"2024-09-12T12:17:04.286997+0000","last_became_active":"2024-09-12T12:17:04.284212+0000","last_became_peered":"2024-09-12T12:17:04.284212+0000","last_unstale":"2024-09-12T12:17:04.286997+0000","last_undegraded":"2024-09-12T12:17:04.286997+0000","last_fullsized":"2024-09-12T12:17:04.286997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:14.550590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265785+0000","last_change":"2024-09-12T12:17:04.265785+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265785+0000","last_undegraded":"2024-09-12T12:17:04.265785+0000","last_fullsized":"2024-09-12T12:17:04.265785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.284940+0000","last_change":"2024-09-12T12:17:04.282760+0000","last_active":"2024-09-12T12:17:04.284940+0000","last_peered":"2024-09-12T12:17:04.284940+0000","last_clean":"2024-09-12T12:17:04.284940+0000","last_became_active":"2024-09-12T12:17:04.282480+0000","last_became_peered":"2024-09-12T12:17:04.282480+0000","last_unstale":"2024-09-12T12:17:04.284940+0000","last_undegraded":"2024-09-12T12:17:04.284940+0000","last_fullsized":"2024-09-12T12:17:04.284940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:25.066020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263851+0000","last_change":"2024-09-12T12:17:04.263851+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263851+0000","last_undegraded":"2024-09-12T12:17:04.263851+0000","last_fullsized":"2024-09-12T12:17:04.263851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281725+0000","last_change":"2024-09-12T12:17:04.279763+0000","last_active":"2024-09-12T12:17:04.281725+0000","last_peered":"2024-09-12T12:17:04.281725+0000","last_clean":"2024-09-12T12:17:04.281725+0000","last_became_active":"2024-09-12T12:17:04.279478+0000","last_became_peered":"2024-09-12T12:17:04.279478+0000","last_unstale":"2024-09-12T12:17:04.281725+0000","last_undegraded":"2024-09-12T12:17:04.281725+0000","last_fullsized":"2024-09-12T12:17:04.281725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:25.659264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263409+0000","last_change":"2024-09-12T12:17:04.263409+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263409+0000","last_undegraded":"2024-09-12T12:17:04.263409+0000","last_fullsized":"2024-09-12T12:17:04.263409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.290153+0000","last_change":"2024-09-12T12:17:04.287110+0000","last_active":"2024-09-12T12:17:04.290153+0000","last_peered":"2024-09-12T12:17:04.290153+0000","last_clean":"2024-09-12T12:17:04.290153+0000","last_became_active":"2024-09-12T12:17:04.286764+0000","last_became_peered":"2024-09-12T12:17:04.286764+0000","last_unstale":"2024-09-12T12:17:04.290153+0000","last_undegraded":"2024-09-12T12:17:04.290153+0000","last_fullsized":"2024-09-12T12:17:04.290153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.714859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264233+0000","last_change":"2024-09-12T12:17:04.264233+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264233+0000","last_undegraded":"2024-09-12T12:17:04.264233+0000","last_fullsized":"2024-09-12T12:17:04.264233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287959+0000","last_change":"2024-09-12T12:17:04.285150+0000","last_active":"2024-09-12T12:17:04.287959+0000","last_peered":"2024-09-12T12:17:04.287959+0000","last_clean":"2024-09-12T12:17:04.287959+0000","last_became_active":"2024-09-12T12:17:04.284860+0000","last_became_peered":"2024-09-12T12:17:04.284860+0000","last_unstale":"2024-09-12T12:17:04.287959+0000","last_undegraded":"2024-09-12T12:17:04.287959+0000","last_fullsized":"2024-09-12T12:17:04.287959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:57.737059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263965+0000","last_change":"2024-09-12T12:17:04.263965+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263965+0000","last_undegraded":"2024-09-12T12:17:04.263965+0000","last_fullsized":"2024-09-12T12:17:04.263965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282342+0000","last_change":"2024-09-12T12:17:04.277442+0000","last_active":"2024-09-12T12:17:04.282342+0000","last_peered":"2024-09-12T12:17:04.282342+0000","last_clean":"2024-09-12T12:17:04.282342+0000","last_became_active":"2024-09-12T12:17:04.277120+0000","last_became_peered":"2024-09-12T12:17:04.277120+0000","last_unstale":"2024-09-12T12:17:04.282342+0000","last_undegraded":"2024-09-12T12:17:04.282342+0000","last_fullsized":"2024-09-12T12:17:04.282342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:25.659264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271421+0000","last_change":"2024-09-12T12:17:04.271421+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271421+0000","last_undegraded":"2024-09-12T12:17:04.271421+0000","last_fullsized":"2024-09-12T12:17:04.271421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287464+0000","last_change":"2024-09-12T12:17:04.284794+0000","last_active":"2024-09-12T12:17:04.287464+0000","last_peered":"2024-09-12T12:17:04.287464+0000","last_clean":"2024-09-12T12:17:04.287464+0000","last_became_active":"2024-09-12T12:17:04.283991+0000","last_became_peered":"2024-09-12T12:17:04.283991+0000","last_unstale":"2024-09-12T12:17:04.287464+0000","last_undegraded":"2024-09-12T12:17:04.287464+0000","last_fullsized":"2024-09-12T12:17:04.287464+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:04.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.272549+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:17:04.272549+0000","last_peered":"2024-09-12T12:17:04.272549+0000","last_clean":"2024-09-12T12:17:04.272549+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:17:04.272549+0000","last_undegraded":"2024-09-12T12:17:04.272549+0000","last_fullsized":"2024-09-12T12:17:04.272549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1572864,"data_stored":1038868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41064,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330776,"statfs":{"total":96636764160,"available":96594714624,"internally_reserved":0,"allocated":1585152,"data_stored":1045535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:17:09.360 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:17:09.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2ebcc00640 1 Processor -- start 2024-09-12T12:17:09.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2ebcc00640 1 -- start start 2024-09-12T12:17:09.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2ebcc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb815c0a0 0x7f2eb80b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2ebcc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2eb80ce950 0x7f2eb815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2ebcc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb815c480 con 0x7f2eb80b6b20 2024-09-12T12:17:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2ebcc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb81609e0 con 0x7f2eb80ce950 2024-09-12T12:17:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2ebcc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb815fdd0 con 0x7f2eb815c0a0 2024-09-12T12:17:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2eb6a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2eb80ce950 0x7f2eb815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2eb7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb815c0a0 0x7f2eb80b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2eb6a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2eb80ce950 0x7f2eb815d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43588/0 (socket says 172.21.15.144:43588) 2024-09-12T12:17:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2eb6a00640 1 -- 172.21.15.144:0/889831514 learned_addr learned my addr 172.21.15.144:0/889831514 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2eb6a00640 1 -- 172.21.15.144:0/889831514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb815c0a0 msgr2=0x7f2eb80b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2eb6a00640 1 --2- 172.21.15.144:0/889831514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb815c0a0 0x7f2eb80b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2eb6a00640 1 -- 172.21.15.144:0/889831514 >> v1:172.21.15.165:6789/0 conn(0x7f2eb80b6b20 legacy=0x7f2eb80b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.538+0000 7f2eb6a00640 1 -- 172.21.15.144:0/889831514 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb81600b0 con 0x7f2eb80ce950 2024-09-12T12:17:09.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2eb6a00640 1 --2- 172.21.15.144:0/889831514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eb80ce950 0x7f2eb815d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009870 tx=0x7f2ea401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd507cfde93df165 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2eb6000640 1 -- 172.21.15.144:0/889831514 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40b1070 con 0x7f2eb80ce950 2024-09-12T12:17:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2eb6000640 1 -- 172.21.15.144:0/889831514 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea40ac620 con 0x7f2eb80ce950 2024-09-12T12:17:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2eb6000640 1 -- 172.21.15.144:0/889831514 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40ac9f0 con 0x7f2eb80ce950 2024-09-12T12:17:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2ebcc00640 1 -- 172.21.15.144:0/889831514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eb80ce950 msgr2=0x7f2eb815d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2ebcc00640 1 --2- 172.21.15.144:0/889831514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eb80ce950 0x7f2eb815d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009870 tx=0x7f2ea401c4d0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2ebcc00640 1 -- 172.21.15.144:0/889831514 shutdown_connections 2024-09-12T12:17:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2ebcc00640 1 --2- 172.21.15.144:0/889831514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eb80ce950 0x7f2eb815d0c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2ebcc00640 1 --2- 172.21.15.144:0/889831514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb815c0a0 0x7f2eb80b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2ebcc00640 1 -- 172.21.15.144:0/889831514 >> 172.21.15.144:0/889831514 conn(0x7f2eb80d2280 msgr2=0x7f2eb80d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2ebcc00640 1 -- 172.21.15.144:0/889831514 shutdown_connections 2024-09-12T12:17:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.542+0000 7f2ebcc00640 1 -- 172.21.15.144:0/889831514 wait complete. 2024-09-12T12:17:09.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 Processor -- start 2024-09-12T12:17:09.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 -- start start 2024-09-12T12:17:09.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eb80b6b20 0x7f2eb806e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb80ce950 0x7f2eb815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eb815c0a0 0x7f2eb815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8073c30 con 0x7f2eb815c0a0 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8073ab0 con 0x7f2eb80b6b20 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb8073db0 con 0x7f2eb80ce950 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eb815c0a0 0x7f2eb815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eb815c0a0 0x7f2eb815a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41634/0 (socket says 172.21.15.144:41634) 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7e00640 1 -- 172.21.15.144:0/26618133 learned_addr learned my addr 172.21.15.144:0/26618133 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb6a00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb80ce950 0x7f2eb815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7400640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eb80b6b20 0x7f2eb806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7e00640 1 -- 172.21.15.144:0/26618133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb80ce950 msgr2=0x7f2eb815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7e00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb80ce950 0x7f2eb815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7e00640 1 -- 172.21.15.144:0/26618133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eb80b6b20 msgr2=0x7f2eb806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7e00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eb80b6b20 0x7f2eb806e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7e00640 1 -- 172.21.15.144:0/26618133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb814f6c0 con 0x7f2eb815c0a0 2024-09-12T12:17:09.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eb7e00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eb815c0a0 0x7f2eb815a700 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c370 tx=0x7f2eb000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:09.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eaf400640 1 -- 172.21.15.144:0/26618133 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0005220 con 0x7f2eb815c0a0 2024-09-12T12:17:09.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eaf400640 1 -- 172.21.15.144:0/26618133 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb00053c0 con 0x7f2eb815c0a0 2024-09-12T12:17:09.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb814f9a0 con 0x7f2eb815c0a0 2024-09-12T12:17:09.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2eaf400640 1 -- 172.21.15.144:0/26618133 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0007270 con 0x7f2eb815c0a0 2024-09-12T12:17:09.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb814ff60 con 0x7f2eb815c0a0 2024-09-12T12:17:09.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.546+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb815d0c0 con 0x7f2eb815c0a0 2024-09-12T12:17:09.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.550+0000 7f2eaf400640 1 -- 172.21.15.144:0/26618133 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2eb0019020 con 0x7f2eb815c0a0 2024-09-12T12:17:09.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.550+0000 7f2eaf400640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e980678c0 0x7f2e98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.550+0000 7f2eaf400640 1 -- 172.21.15.144:0/26618133 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f2eb0084fb0 con 0x7f2eb815c0a0 2024-09-12T12:17:09.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.550+0000 7f2eb7400640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e980678c0 0x7f2e98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.550+0000 7f2eb7400640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e980678c0 0x7f2e98069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80b39d0 tx=0x7f2ea800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:09.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.554+0000 7f2eaf400640 1 -- 172.21.15.144:0/26618133 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2eb0055300 con 0x7f2eb815c0a0 2024-09-12T12:17:09.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.710+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2eb806ed70 con 0x7f2e980678c0 2024-09-12T12:17:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.714+0000 7f2eaf400640 1 -- 172.21.15.144:0/26618133 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246753 (secure 0 0 0) 0x7f2ea80039a0 con 0x7f2e980678c0 2024-09-12T12:17:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:09.723 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:17:09.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e980678c0 msgr2=0x7f2e98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e980678c0 0x7f2e98069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80b39d0 tx=0x7f2ea800b040 comp rx=0 tx=0).stop 2024-09-12T12:17:09.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eb815c0a0 msgr2=0x7f2eb815a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eb815c0a0 0x7f2eb815a700 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c370 tx=0x7f2eb000c830 comp rx=0 tx=0).stop 2024-09-12T12:17:09.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 shutdown_connections 2024-09-12T12:17:09.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e980678c0 0x7f2e98069d80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eb815c0a0 0x7f2eb815a700 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eb80ce950 0x7f2eb815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 --2- 172.21.15.144:0/26618133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eb80b6b20 0x7f2eb806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 >> 172.21.15.144:0/26618133 conn(0x7f2eb80d2280 msgr2=0x7f2eb80b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:09.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 shutdown_connections 2024-09-12T12:17:09.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.718+0000 7f2ebcc00640 1 -- 172.21.15.144:0/26618133 wait complete. 2024-09-12T12:17:09.742 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-12T12:17:09.430898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299952,"kb_used_data":8820,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754674768,"statfs":{"total":773094113280,"available":772786962432,"internally_reserved":0,"allocated":9031680,"data_stored":4775403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000952"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270944+0000","last_change":"2024-09-12T12:17:04.270944+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270944+0000","last_undegraded":"2024-09-12T12:17:04.270944+0000","last_fullsized":"2024-09-12T12:17:04.270944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269037+0000","last_change":"2024-09-12T12:17:04.269037+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269037+0000","last_undegraded":"2024-09-12T12:17:04.269037+0000","last_fullsized":"2024-09-12T12:17:04.269037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267732+0000","last_change":"2024-09-12T12:17:04.267732+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267732+0000","last_undegraded":"2024-09-12T12:17:04.267732+0000","last_fullsized":"2024-09-12T12:17:04.267732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265910+0000","last_change":"2024-09-12T12:17:04.265910+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265910+0000","last_undegraded":"2024-09-12T12:17:04.265910+0000","last_fullsized":"2024-09-12T12:17:04.265910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271660+0000","last_change":"2024-09-12T12:17:04.271660+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271660+0000","last_undegraded":"2024-09-12T12:17:04.271660+0000","last_fullsized":"2024-09-12T12:17:04.271660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.274579+0000","last_change":"2024-09-12T12:17:04.274579+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.274579+0000","last_undegraded":"2024-09-12T12:17:04.274579+0000","last_fullsized":"2024-09-12T12:17:04.274579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264072+0000","last_change":"2024-09-12T12:17:04.264072+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264072+0000","last_undegraded":"2024-09-12T12:17:04.264072+0000","last_fullsized":"2024-09-12T12:17:04.264072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270786+0000","last_change":"2024-09-12T12:17:04.270786+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270786+0000","last_undegraded":"2024-09-12T12:17:04.270786+0000","last_fullsized":"2024-09-12T12:17:04.270786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271631+0000","last_change":"2024-09-12T12:17:04.271631+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271631+0000","last_undegraded":"2024-09-12T12:17:04.271631+0000","last_fullsized":"2024-09-12T12:17:04.271631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267055+0000","last_change":"2024-09-12T12:17:04.267055+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267055+0000","last_undegraded":"2024-09-12T12:17:04.267055+0000","last_fullsized":"2024-09-12T12:17:04.267055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268623+0000","last_change":"2024-09-12T12:17:04.268623+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268623+0000","last_undegraded":"2024-09-12T12:17:04.268623+0000","last_fullsized":"2024-09-12T12:17:04.268623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265515+0000","last_change":"2024-09-12T12:17:04.265515+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265515+0000","last_undegraded":"2024-09-12T12:17:04.265515+0000","last_fullsized":"2024-09-12T12:17:04.265515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267508+0000","last_change":"2024-09-12T12:17:04.267508+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267508+0000","last_undegraded":"2024-09-12T12:17:04.267508+0000","last_fullsized":"2024-09-12T12:17:04.267508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.274211+0000","last_change":"2024-09-12T12:17:04.274211+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.274211+0000","last_undegraded":"2024-09-12T12:17:04.274211+0000","last_fullsized":"2024-09-12T12:17:04.274211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268541+0000","last_change":"2024-09-12T12:17:04.268541+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268541+0000","last_undegraded":"2024-09-12T12:17:04.268541+0000","last_fullsized":"2024-09-12T12:17:04.268541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271563+0000","last_change":"2024-09-12T12:17:04.271563+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271563+0000","last_undegraded":"2024-09-12T12:17:04.271563+0000","last_fullsized":"2024-09-12T12:17:04.271563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.272248+0000","last_change":"2024-09-12T12:17:04.272248+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.272248+0000","last_undegraded":"2024-09-12T12:17:04.272248+0000","last_fullsized":"2024-09-12T12:17:04.272248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270331+0000","last_change":"2024-09-12T12:17:04.270331+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270331+0000","last_undegraded":"2024-09-12T12:17:04.270331+0000","last_fullsized":"2024-09-12T12:17:04.270331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.273226+0000","last_change":"2024-09-12T12:17:04.273226+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.273226+0000","last_undegraded":"2024-09-12T12:17:04.273226+0000","last_fullsized":"2024-09-12T12:17:04.273226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267656+0000","last_change":"2024-09-12T12:17:04.267656+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267656+0000","last_undegraded":"2024-09-12T12:17:04.267656+0000","last_fullsized":"2024-09-12T12:17:04.267656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271080+0000","last_change":"2024-09-12T12:17:04.271080+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271080+0000","last_undegraded":"2024-09-12T12:17:04.271080+0000","last_fullsized":"2024-09-12T12:17:04.271080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265488+0000","last_change":"2024-09-12T12:17:04.265488+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265488+0000","last_undegraded":"2024-09-12T12:17:04.265488+0000","last_fullsized":"2024-09-12T12:17:04.265488+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269304+0000","last_change":"2024-09-12T12:17:04.269304+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269304+0000","last_undegraded":"2024-09-12T12:17:04.269304+0000","last_fullsized":"2024-09-12T12:17:04.269304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268532+0000","last_change":"2024-09-12T12:17:04.268532+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268532+0000","last_undegraded":"2024-09-12T12:17:04.268532+0000","last_fullsized":"2024-09-12T12:17:04.268532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268366+0000","last_change":"2024-09-12T12:17:04.268366+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268366+0000","last_undegraded":"2024-09-12T12:17:04.268366+0000","last_fullsized":"2024-09-12T12:17:04.268366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266565+0000","last_change":"2024-09-12T12:17:04.266565+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266565+0000","last_undegraded":"2024-09-12T12:17:04.266565+0000","last_fullsized":"2024-09-12T12:17:04.266565+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271881+0000","last_change":"2024-09-12T12:17:04.271881+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271881+0000","last_undegraded":"2024-09-12T12:17:04.271881+0000","last_fullsized":"2024-09-12T12:17:04.271881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266435+0000","last_change":"2024-09-12T12:17:04.266435+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266435+0000","last_undegraded":"2024-09-12T12:17:04.266435+0000","last_fullsized":"2024-09-12T12:17:04.266435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268086+0000","last_change":"2024-09-12T12:17:04.268086+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268086+0000","last_undegraded":"2024-09-12T12:17:04.268086+0000","last_fullsized":"2024-09-12T12:17:04.268086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269588+0000","last_change":"2024-09-12T12:17:04.269588+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269588+0000","last_undegraded":"2024-09-12T12:17:04.269588+0000","last_fullsized":"2024-09-12T12:17:04.269588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265279+0000","last_change":"2024-09-12T12:17:04.265279+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265279+0000","last_undegraded":"2024-09-12T12:17:04.265279+0000","last_fullsized":"2024-09-12T12:17:04.265279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269509+0000","last_change":"2024-09-12T12:17:04.269509+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269509+0000","last_undegraded":"2024-09-12T12:17:04.269509+0000","last_fullsized":"2024-09-12T12:17:04.269509+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264435+0000","last_change":"2024-09-12T12:17:04.264435+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264435+0000","last_undegraded":"2024-09-12T12:17:04.264435+0000","last_fullsized":"2024-09-12T12:17:04.264435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.292579+0000","last_change":"2024-09-12T12:17:04.288167+0000","last_active":"2024-09-12T12:17:04.292579+0000","last_peered":"2024-09-12T12:17:04.292579+0000","last_clean":"2024-09-12T12:17:04.292579+0000","last_became_active":"2024-09-12T12:17:04.287954+0000","last_became_peered":"2024-09-12T12:17:04.287954+0000","last_unstale":"2024-09-12T12:17:04.292579+0000","last_undegraded":"2024-09-12T12:17:04.292579+0000","last_fullsized":"2024-09-12T12:17:04.292579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:10:23.643450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267493+0000","last_change":"2024-09-12T12:17:04.267493+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267493+0000","last_undegraded":"2024-09-12T12:17:04.267493+0000","last_fullsized":"2024-09-12T12:17:04.267493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285040+0000","last_change":"2024-09-12T12:17:04.282927+0000","last_active":"2024-09-12T12:17:04.285040+0000","last_peered":"2024-09-12T12:17:04.285040+0000","last_clean":"2024-09-12T12:17:04.285040+0000","last_became_active":"2024-09-12T12:17:04.282682+0000","last_became_peered":"2024-09-12T12:17:04.282682+0000","last_unstale":"2024-09-12T12:17:04.285040+0000","last_undegraded":"2024-09-12T12:17:04.285040+0000","last_fullsized":"2024-09-12T12:17:04.285040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:17.101878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270032+0000","last_change":"2024-09-12T12:17:04.270032+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270032+0000","last_undegraded":"2024-09-12T12:17:04.270032+0000","last_fullsized":"2024-09-12T12:17:04.270032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286122+0000","last_change":"2024-09-12T12:17:04.284408+0000","last_active":"2024-09-12T12:17:04.286122+0000","last_peered":"2024-09-12T12:17:04.286122+0000","last_clean":"2024-09-12T12:17:04.286122+0000","last_became_active":"2024-09-12T12:17:04.284110+0000","last_became_peered":"2024-09-12T12:17:04.284110+0000","last_unstale":"2024-09-12T12:17:04.286122+0000","last_undegraded":"2024-09-12T12:17:04.286122+0000","last_fullsized":"2024-09-12T12:17:04.286122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:13.958415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270686+0000","last_change":"2024-09-12T12:17:04.270686+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270686+0000","last_undegraded":"2024-09-12T12:17:04.270686+0000","last_fullsized":"2024-09-12T12:17:04.270686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282775+0000","last_change":"2024-09-12T12:17:04.282018+0000","last_active":"2024-09-12T12:17:04.282775+0000","last_peered":"2024-09-12T12:17:04.282775+0000","last_clean":"2024-09-12T12:17:04.282775+0000","last_became_active":"2024-09-12T12:17:04.281347+0000","last_became_peered":"2024-09-12T12:17:04.281347+0000","last_unstale":"2024-09-12T12:17:04.282775+0000","last_undegraded":"2024-09-12T12:17:04.282775+0000","last_fullsized":"2024-09-12T12:17:04.282775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:16.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268510+0000","last_change":"2024-09-12T12:17:04.268510+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268510+0000","last_undegraded":"2024-09-12T12:17:04.268510+0000","last_fullsized":"2024-09-12T12:17:04.268510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281044+0000","last_change":"2024-09-12T12:17:04.277749+0000","last_active":"2024-09-12T12:17:04.281044+0000","last_peered":"2024-09-12T12:17:04.281044+0000","last_clean":"2024-09-12T12:17:04.281044+0000","last_became_active":"2024-09-12T12:17:04.277421+0000","last_became_peered":"2024-09-12T12:17:04.277421+0000","last_unstale":"2024-09-12T12:17:04.281044+0000","last_undegraded":"2024-09-12T12:17:04.281044+0000","last_fullsized":"2024-09-12T12:17:04.281044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:52.140000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267996+0000","last_change":"2024-09-12T12:17:04.267996+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267996+0000","last_undegraded":"2024-09-12T12:17:04.267996+0000","last_fullsized":"2024-09-12T12:17:04.267996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286487+0000","last_change":"2024-09-12T12:17:04.285386+0000","last_active":"2024-09-12T12:17:04.286487+0000","last_peered":"2024-09-12T12:17:04.286487+0000","last_clean":"2024-09-12T12:17:04.286487+0000","last_became_active":"2024-09-12T12:17:04.284833+0000","last_became_peered":"2024-09-12T12:17:04.284833+0000","last_unstale":"2024-09-12T12:17:04.286487+0000","last_undegraded":"2024-09-12T12:17:04.286487+0000","last_fullsized":"2024-09-12T12:17:04.286487+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:04.643981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271974+0000","last_change":"2024-09-12T12:17:04.271974+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271974+0000","last_undegraded":"2024-09-12T12:17:04.271974+0000","last_fullsized":"2024-09-12T12:17:04.271974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281925+0000","last_change":"2024-09-12T12:17:04.278438+0000","last_active":"2024-09-12T12:17:04.281925+0000","last_peered":"2024-09-12T12:17:04.281925+0000","last_clean":"2024-09-12T12:17:04.281925+0000","last_became_active":"2024-09-12T12:17:04.277977+0000","last_became_peered":"2024-09-12T12:17:04.277977+0000","last_unstale":"2024-09-12T12:17:04.281925+0000","last_undegraded":"2024-09-12T12:17:04.281925+0000","last_fullsized":"2024-09-12T12:17:04.281925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:25.066020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265443+0000","last_change":"2024-09-12T12:17:04.265443+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265443+0000","last_undegraded":"2024-09-12T12:17:04.265443+0000","last_fullsized":"2024-09-12T12:17:04.265443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282523+0000","last_change":"2024-09-12T12:17:04.277306+0000","last_active":"2024-09-12T12:17:04.282523+0000","last_peered":"2024-09-12T12:17:04.282523+0000","last_clean":"2024-09-12T12:17:04.282523+0000","last_became_active":"2024-09-12T12:17:04.276970+0000","last_became_peered":"2024-09-12T12:17:04.276970+0000","last_unstale":"2024-09-12T12:17:04.282523+0000","last_undegraded":"2024-09-12T12:17:04.282523+0000","last_fullsized":"2024-09-12T12:17:04.282523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:00.660785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267607+0000","last_change":"2024-09-12T12:17:04.267607+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267607+0000","last_undegraded":"2024-09-12T12:17:04.267607+0000","last_fullsized":"2024-09-12T12:17:04.267607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285712+0000","last_change":"2024-09-12T12:17:04.283614+0000","last_active":"2024-09-12T12:17:04.285712+0000","last_peered":"2024-09-12T12:17:04.285712+0000","last_clean":"2024-09-12T12:17:04.285712+0000","last_became_active":"2024-09-12T12:17:04.283363+0000","last_became_peered":"2024-09-12T12:17:04.283363+0000","last_unstale":"2024-09-12T12:17:04.285712+0000","last_undegraded":"2024-09-12T12:17:04.285712+0000","last_fullsized":"2024-09-12T12:17:04.285712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:52.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265028+0000","last_change":"2024-09-12T12:17:04.265028+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265028+0000","last_undegraded":"2024-09-12T12:17:04.265028+0000","last_fullsized":"2024-09-12T12:17:04.265028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281862+0000","last_change":"2024-09-12T12:17:04.278522+0000","last_active":"2024-09-12T12:17:04.281862+0000","last_peered":"2024-09-12T12:17:04.281862+0000","last_clean":"2024-09-12T12:17:04.281862+0000","last_became_active":"2024-09-12T12:17:04.278250+0000","last_became_peered":"2024-09-12T12:17:04.278250+0000","last_unstale":"2024-09-12T12:17:04.281862+0000","last_undegraded":"2024-09-12T12:17:04.281862+0000","last_fullsized":"2024-09-12T12:17:04.281862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:52.862397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.273845+0000","last_change":"2024-09-12T12:17:04.273845+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.273845+0000","last_undegraded":"2024-09-12T12:17:04.273845+0000","last_fullsized":"2024-09-12T12:17:04.273845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.290142+0000","last_change":"2024-09-12T12:17:04.286746+0000","last_active":"2024-09-12T12:17:04.290142+0000","last_peered":"2024-09-12T12:17:04.290142+0000","last_clean":"2024-09-12T12:17:04.290142+0000","last_became_active":"2024-09-12T12:17:04.286451+0000","last_became_peered":"2024-09-12T12:17:04.286451+0000","last_unstale":"2024-09-12T12:17:04.290142+0000","last_undegraded":"2024-09-12T12:17:04.290142+0000","last_fullsized":"2024-09-12T12:17:04.290142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:20.810734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264005+0000","last_change":"2024-09-12T12:17:04.264005+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264005+0000","last_undegraded":"2024-09-12T12:17:04.264005+0000","last_fullsized":"2024-09-12T12:17:04.264005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281921+0000","last_change":"2024-09-12T12:17:04.278410+0000","last_active":"2024-09-12T12:17:04.281921+0000","last_peered":"2024-09-12T12:17:04.281921+0000","last_clean":"2024-09-12T12:17:04.281921+0000","last_became_active":"2024-09-12T12:17:04.278156+0000","last_became_peered":"2024-09-12T12:17:04.278156+0000","last_unstale":"2024-09-12T12:17:04.281921+0000","last_undegraded":"2024-09-12T12:17:04.281921+0000","last_fullsized":"2024-09-12T12:17:04.281921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:33.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265068+0000","last_change":"2024-09-12T12:17:04.265068+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265068+0000","last_undegraded":"2024-09-12T12:17:04.265068+0000","last_fullsized":"2024-09-12T12:17:04.265068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.280803+0000","last_change":"2024-09-12T12:17:04.275009+0000","last_active":"2024-09-12T12:17:04.280803+0000","last_peered":"2024-09-12T12:17:04.280803+0000","last_clean":"2024-09-12T12:17:04.280803+0000","last_became_active":"2024-09-12T12:17:04.274726+0000","last_became_peered":"2024-09-12T12:17:04.274726+0000","last_unstale":"2024-09-12T12:17:04.280803+0000","last_undegraded":"2024-09-12T12:17:04.280803+0000","last_fullsized":"2024-09-12T12:17:04.280803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:03.544531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265791+0000","last_change":"2024-09-12T12:17:04.265791+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265791+0000","last_undegraded":"2024-09-12T12:17:04.265791+0000","last_fullsized":"2024-09-12T12:17:04.265791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287300+0000","last_change":"2024-09-12T12:17:04.286442+0000","last_active":"2024-09-12T12:17:04.287300+0000","last_peered":"2024-09-12T12:17:04.287300+0000","last_clean":"2024-09-12T12:17:04.287300+0000","last_became_active":"2024-09-12T12:17:04.286168+0000","last_became_peered":"2024-09-12T12:17:04.286168+0000","last_unstale":"2024-09-12T12:17:04.287300+0000","last_undegraded":"2024-09-12T12:17:04.287300+0000","last_fullsized":"2024-09-12T12:17:04.287300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:16.524611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264470+0000","last_change":"2024-09-12T12:17:04.264470+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264470+0000","last_undegraded":"2024-09-12T12:17:04.264470+0000","last_fullsized":"2024-09-12T12:17:04.264470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.288883+0000","last_change":"2024-09-12T12:17:04.283991+0000","last_active":"2024-09-12T12:17:04.288883+0000","last_peered":"2024-09-12T12:17:04.288883+0000","last_clean":"2024-09-12T12:17:04.288883+0000","last_became_active":"2024-09-12T12:17:04.283694+0000","last_became_peered":"2024-09-12T12:17:04.283694+0000","last_unstale":"2024-09-12T12:17:04.288883+0000","last_undegraded":"2024-09-12T12:17:04.288883+0000","last_fullsized":"2024-09-12T12:17:04.288883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:25.373252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265035+0000","last_change":"2024-09-12T12:17:04.265035+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265035+0000","last_undegraded":"2024-09-12T12:17:04.265035+0000","last_fullsized":"2024-09-12T12:17:04.265035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.276490+0000","last_change":"2024-09-12T12:17:04.275540+0000","last_active":"2024-09-12T12:17:04.276490+0000","last_peered":"2024-09-12T12:17:04.276490+0000","last_clean":"2024-09-12T12:17:04.276490+0000","last_became_active":"2024-09-12T12:17:04.275188+0000","last_became_peered":"2024-09-12T12:17:04.275188+0000","last_unstale":"2024-09-12T12:17:04.276490+0000","last_undegraded":"2024-09-12T12:17:04.276490+0000","last_fullsized":"2024-09-12T12:17:04.276490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:39.663729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266674+0000","last_change":"2024-09-12T12:17:04.266674+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266674+0000","last_undegraded":"2024-09-12T12:17:04.266674+0000","last_fullsized":"2024-09-12T12:17:04.266674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285690+0000","last_change":"2024-09-12T12:17:04.282311+0000","last_active":"2024-09-12T12:17:04.285690+0000","last_peered":"2024-09-12T12:17:04.285690+0000","last_clean":"2024-09-12T12:17:04.285690+0000","last_became_active":"2024-09-12T12:17:04.282043+0000","last_became_peered":"2024-09-12T12:17:04.282043+0000","last_unstale":"2024-09-12T12:17:04.285690+0000","last_undegraded":"2024-09-12T12:17:04.285690+0000","last_fullsized":"2024-09-12T12:17:04.285690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:39.663729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264821+0000","last_change":"2024-09-12T12:17:04.264821+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264821+0000","last_undegraded":"2024-09-12T12:17:04.264821+0000","last_fullsized":"2024-09-12T12:17:04.264821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282226+0000","last_change":"2024-09-12T12:17:04.281271+0000","last_active":"2024-09-12T12:17:04.282226+0000","last_peered":"2024-09-12T12:17:04.282226+0000","last_clean":"2024-09-12T12:17:04.282226+0000","last_became_active":"2024-09-12T12:17:04.280997+0000","last_became_peered":"2024-09-12T12:17:04.280997+0000","last_unstale":"2024-09-12T12:17:04.282226+0000","last_undegraded":"2024-09-12T12:17:04.282226+0000","last_fullsized":"2024-09-12T12:17:04.282226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:00.696318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265890+0000","last_change":"2024-09-12T12:17:04.265890+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265890+0000","last_undegraded":"2024-09-12T12:17:04.265890+0000","last_fullsized":"2024-09-12T12:17:04.265890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285121+0000","last_change":"2024-09-12T12:17:04.278980+0000","last_active":"2024-09-12T12:17:04.285121+0000","last_peered":"2024-09-12T12:17:04.285121+0000","last_clean":"2024-09-12T12:17:04.285121+0000","last_became_active":"2024-09-12T12:17:04.278725+0000","last_became_peered":"2024-09-12T12:17:04.278725+0000","last_unstale":"2024-09-12T12:17:04.285121+0000","last_undegraded":"2024-09-12T12:17:04.285121+0000","last_fullsized":"2024-09-12T12:17:04.285121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:15.060762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271885+0000","last_change":"2024-09-12T12:17:04.271885+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271885+0000","last_undegraded":"2024-09-12T12:17:04.271885+0000","last_fullsized":"2024-09-12T12:17:04.271885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282379+0000","last_change":"2024-09-12T12:17:04.277891+0000","last_active":"2024-09-12T12:17:04.282379+0000","last_peered":"2024-09-12T12:17:04.282379+0000","last_clean":"2024-09-12T12:17:04.282379+0000","last_became_active":"2024-09-12T12:17:04.277603+0000","last_became_peered":"2024-09-12T12:17:04.277603+0000","last_unstale":"2024-09-12T12:17:04.282379+0000","last_undegraded":"2024-09-12T12:17:04.282379+0000","last_fullsized":"2024-09-12T12:17:04.282379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:16.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266673+0000","last_change":"2024-09-12T12:17:04.266673+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266673+0000","last_undegraded":"2024-09-12T12:17:04.266673+0000","last_fullsized":"2024-09-12T12:17:04.266673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286235+0000","last_change":"2024-09-12T12:17:04.283216+0000","last_active":"2024-09-12T12:17:04.286235+0000","last_peered":"2024-09-12T12:17:04.286235+0000","last_clean":"2024-09-12T12:17:04.286235+0000","last_became_active":"2024-09-12T12:17:04.282951+0000","last_became_peered":"2024-09-12T12:17:04.282951+0000","last_unstale":"2024-09-12T12:17:04.286235+0000","last_undegraded":"2024-09-12T12:17:04.286235+0000","last_fullsized":"2024-09-12T12:17:04.286235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:01.267449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267693+0000","last_change":"2024-09-12T12:17:04.267693+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267693+0000","last_undegraded":"2024-09-12T12:17:04.267693+0000","last_fullsized":"2024-09-12T12:17:04.267693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.292648+0000","last_change":"2024-09-12T12:17:04.287880+0000","last_active":"2024-09-12T12:17:04.292648+0000","last_peered":"2024-09-12T12:17:04.292648+0000","last_clean":"2024-09-12T12:17:04.292648+0000","last_became_active":"2024-09-12T12:17:04.285568+0000","last_became_peered":"2024-09-12T12:17:04.285568+0000","last_unstale":"2024-09-12T12:17:04.292648+0000","last_undegraded":"2024-09-12T12:17:04.292648+0000","last_fullsized":"2024-09-12T12:17:04.292648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:55.756882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264564+0000","last_change":"2024-09-12T12:17:04.264564+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264564+0000","last_undegraded":"2024-09-12T12:17:04.264564+0000","last_fullsized":"2024-09-12T12:17:04.264564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287352+0000","last_change":"2024-09-12T12:17:04.283598+0000","last_active":"2024-09-12T12:17:04.287352+0000","last_peered":"2024-09-12T12:17:04.287352+0000","last_clean":"2024-09-12T12:17:04.287352+0000","last_became_active":"2024-09-12T12:17:04.283327+0000","last_became_peered":"2024-09-12T12:17:04.283327+0000","last_unstale":"2024-09-12T12:17:04.287352+0000","last_undegraded":"2024-09-12T12:17:04.287352+0000","last_fullsized":"2024-09-12T12:17:04.287352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:22.093367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269248+0000","last_change":"2024-09-12T12:17:04.269248+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269248+0000","last_undegraded":"2024-09-12T12:17:04.269248+0000","last_fullsized":"2024-09-12T12:17:04.269248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.280809+0000","last_change":"2024-09-12T12:17:04.274915+0000","last_active":"2024-09-12T12:17:04.280809+0000","last_peered":"2024-09-12T12:17:04.280809+0000","last_clean":"2024-09-12T12:17:04.280809+0000","last_became_active":"2024-09-12T12:17:04.274601+0000","last_became_peered":"2024-09-12T12:17:04.274601+0000","last_unstale":"2024-09-12T12:17:04.280809+0000","last_undegraded":"2024-09-12T12:17:04.280809+0000","last_fullsized":"2024-09-12T12:17:04.280809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:16.740217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263364+0000","last_change":"2024-09-12T12:17:04.263364+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263364+0000","last_undegraded":"2024-09-12T12:17:04.263364+0000","last_fullsized":"2024-09-12T12:17:04.263364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.284671+0000","last_change":"2024-09-12T12:17:04.281551+0000","last_active":"2024-09-12T12:17:04.284671+0000","last_peered":"2024-09-12T12:17:04.284671+0000","last_clean":"2024-09-12T12:17:04.284671+0000","last_became_active":"2024-09-12T12:17:04.281205+0000","last_became_peered":"2024-09-12T12:17:04.281205+0000","last_unstale":"2024-09-12T12:17:04.284671+0000","last_undegraded":"2024-09-12T12:17:04.284671+0000","last_fullsized":"2024-09-12T12:17:04.284671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:17.101878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269595+0000","last_change":"2024-09-12T12:17:04.269595+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269595+0000","last_undegraded":"2024-09-12T12:17:04.269595+0000","last_fullsized":"2024-09-12T12:17:04.269595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286997+0000","last_change":"2024-09-12T12:17:04.285672+0000","last_active":"2024-09-12T12:17:04.286997+0000","last_peered":"2024-09-12T12:17:04.286997+0000","last_clean":"2024-09-12T12:17:04.286997+0000","last_became_active":"2024-09-12T12:17:04.284212+0000","last_became_peered":"2024-09-12T12:17:04.284212+0000","last_unstale":"2024-09-12T12:17:04.286997+0000","last_undegraded":"2024-09-12T12:17:04.286997+0000","last_fullsized":"2024-09-12T12:17:04.286997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:14.550590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265785+0000","last_change":"2024-09-12T12:17:04.265785+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265785+0000","last_undegraded":"2024-09-12T12:17:04.265785+0000","last_fullsized":"2024-09-12T12:17:04.265785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.284940+0000","last_change":"2024-09-12T12:17:04.282760+0000","last_active":"2024-09-12T12:17:04.284940+0000","last_peered":"2024-09-12T12:17:04.284940+0000","last_clean":"2024-09-12T12:17:04.284940+0000","last_became_active":"2024-09-12T12:17:04.282480+0000","last_became_peered":"2024-09-12T12:17:04.282480+0000","last_unstale":"2024-09-12T12:17:04.284940+0000","last_undegraded":"2024-09-12T12:17:04.284940+0000","last_fullsized":"2024-09-12T12:17:04.284940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:25.066020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263851+0000","last_change":"2024-09-12T12:17:04.263851+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263851+0000","last_undegraded":"2024-09-12T12:17:04.263851+0000","last_fullsized":"2024-09-12T12:17:04.263851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281725+0000","last_change":"2024-09-12T12:17:04.279763+0000","last_active":"2024-09-12T12:17:04.281725+0000","last_peered":"2024-09-12T12:17:04.281725+0000","last_clean":"2024-09-12T12:17:04.281725+0000","last_became_active":"2024-09-12T12:17:04.279478+0000","last_became_peered":"2024-09-12T12:17:04.279478+0000","last_unstale":"2024-09-12T12:17:04.281725+0000","last_undegraded":"2024-09-12T12:17:04.281725+0000","last_fullsized":"2024-09-12T12:17:04.281725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:25.659264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263409+0000","last_change":"2024-09-12T12:17:04.263409+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263409+0000","last_undegraded":"2024-09-12T12:17:04.263409+0000","last_fullsized":"2024-09-12T12:17:04.263409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.290153+0000","last_change":"2024-09-12T12:17:04.287110+0000","last_active":"2024-09-12T12:17:04.290153+0000","last_peered":"2024-09-12T12:17:04.290153+0000","last_clean":"2024-09-12T12:17:04.290153+0000","last_became_active":"2024-09-12T12:17:04.286764+0000","last_became_peered":"2024-09-12T12:17:04.286764+0000","last_unstale":"2024-09-12T12:17:04.290153+0000","last_undegraded":"2024-09-12T12:17:04.290153+0000","last_fullsized":"2024-09-12T12:17:04.290153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.714859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264233+0000","last_change":"2024-09-12T12:17:04.264233+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264233+0000","last_undegraded":"2024-09-12T12:17:04.264233+0000","last_fullsized":"2024-09-12T12:17:04.264233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287959+0000","last_change":"2024-09-12T12:17:04.285150+0000","last_active":"2024-09-12T12:17:04.287959+0000","last_peered":"2024-09-12T12:17:04.287959+0000","last_clean":"2024-09-12T12:17:04.287959+0000","last_became_active":"2024-09-12T12:17:04.284860+0000","last_became_peered":"2024-09-12T12:17:04.284860+0000","last_unstale":"2024-09-12T12:17:04.287959+0000","last_undegraded":"2024-09-12T12:17:04.287959+0000","last_fullsized":"2024-09-12T12:17:04.287959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:57.737059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263965+0000","last_change":"2024-09-12T12:17:04.263965+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263965+0000","last_undegraded":"2024-09-12T12:17:04.263965+0000","last_fullsized":"2024-09-12T12:17:04.263965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282342+0000","last_change":"2024-09-12T12:17:04.277442+0000","last_active":"2024-09-12T12:17:04.282342+0000","last_peered":"2024-09-12T12:17:04.282342+0000","last_clean":"2024-09-12T12:17:04.282342+0000","last_became_active":"2024-09-12T12:17:04.277120+0000","last_became_peered":"2024-09-12T12:17:04.277120+0000","last_unstale":"2024-09-12T12:17:04.282342+0000","last_undegraded":"2024-09-12T12:17:04.282342+0000","last_fullsized":"2024-09-12T12:17:04.282342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:25.659264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271421+0000","last_change":"2024-09-12T12:17:04.271421+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271421+0000","last_undegraded":"2024-09-12T12:17:04.271421+0000","last_fullsized":"2024-09-12T12:17:04.271421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287464+0000","last_change":"2024-09-12T12:17:04.284794+0000","last_active":"2024-09-12T12:17:04.287464+0000","last_peered":"2024-09-12T12:17:04.287464+0000","last_clean":"2024-09-12T12:17:04.287464+0000","last_became_active":"2024-09-12T12:17:04.283991+0000","last_became_peered":"2024-09-12T12:17:04.283991+0000","last_unstale":"2024-09-12T12:17:04.287464+0000","last_undegraded":"2024-09-12T12:17:04.287464+0000","last_fullsized":"2024-09-12T12:17:04.287464+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:04.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.272549+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:17:04.272549+0000","last_peered":"2024-09-12T12:17:04.272549+0000","last_clean":"2024-09-12T12:17:04.272549+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:17:04.272549+0000","last_undegraded":"2024-09-12T12:17:04.272549+0000","last_fullsized":"2024-09-12T12:17:04.272549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1572864,"data_stored":1038868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41064,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330776,"statfs":{"total":96636764160,"available":96594714624,"internally_reserved":0,"allocated":1585152,"data_stored":1045535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:17:09.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:17:09.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05c1200640 1 Processor -- start 2024-09-12T12:17:09.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05c1200640 1 -- start start 2024-09-12T12:17:09.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05c1200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f05bc0cd640 0x7f05bc071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05c1200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc0b45a0 con 0x7f05bc15b4e0 2024-09-12T12:17:09.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05c1200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc0b3fe0 con 0x7f05bc071420 2024-09-12T12:17:09.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05c1200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f05bc0b42c0 con 0x7f05bc0cd640 2024-09-12T12:17:09.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05b9e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f05bc15b4e0 0x7f05bc0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44844/0 (socket says 172.21.15.144:44844) 2024-09-12T12:17:09.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05b9e00640 1 -- 172.21.15.144:0/3156754044 learned_addr learned my addr 172.21.15.144:0/3156754044 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05ba800640 1 --2- 172.21.15.144:0/3156754044 >> v2:172.21.15.165:3300/0 conn(0x7f05bc0cd640 0x7f05bc071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.918+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918648484 0 0) 0x7f05bc0b45a0 con 0x7f05bc15b4e0 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a0003530 con 0x7f05bc15b4e0 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3901342351 0 0) 0x7f05a0003530 con 0x7f05bc15b4e0 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 >> v2:172.21.15.165:3300/0 conn(0x7f05bc0cd640 msgr2=0x7f05bc071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 --2- 172.21.15.144:0/3156754044 >> v2:172.21.15.165:3300/0 conn(0x7f05bc0cd640 0x7f05bc071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 >> v1:172.21.15.165:6789/0 conn(0x7f05bc071420 legacy=0x7f05bc0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc0b1490 con 0x7f05bc15b4e0 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f05ac001a00 con 0x7f05bc15b4e0 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 >> v1:172.21.15.144:6789/0 conn(0x7f05bc15b4e0 legacy=0x7f05bc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a0004320 0x7f05a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05a0004f50 0x7f05a000ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc0b42c0 con 0x7f05a00039c0 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05a0010520 con 0x7f05a0004320 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05a00106a0 con 0x7f05a0004f50 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b9e00640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b9400640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a0004320 0x7f05a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05ba800640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05a0004f50 0x7f05a000ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b9e00640 1 -- 172.21.15.144:0/3156754044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05a0004f50 msgr2=0x7f05a000ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b9e00640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05a0004f50 0x7f05a000ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b9e00640 1 -- 172.21.15.144:0/3156754044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a0004320 msgr2=0x7f05a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:09.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b9e00640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05a0004320 0x7f05a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b9e00640 1 -- 172.21.15.144:0/3156754044 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a0003530 con 0x7f05a00039c0 2024-09-12T12:17:09.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05ba800640 1 -- 172.21.15.144:0/3156754044 reap_dead start 2024-09-12T12:17:09.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.922+0000 7f05b9e00640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05a0003de0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00a840 tx=0x7f05ac01d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16995a53018cedd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:09.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00a460 con 0x7f05a00039c0 2024-09-12T12:17:09.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac0ad650 con 0x7f05a00039c0 2024-09-12T12:17:09.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05b8a00640 1 -- 172.21.15.144:0/3156754044 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0ada80 con 0x7f05a00039c0 2024-09-12T12:17:09.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 -- 172.21.15.144:0/3156754044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 msgr2=0x7f05a0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05a0003de0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00a840 tx=0x7f05ac01d2b0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 -- 172.21.15.144:0/3156754044 shutdown_connections 2024-09-12T12:17:09.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 --2- 172.21.15.144:0/3156754044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05a0003de0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 -- 172.21.15.144:0/3156754044 >> 172.21.15.144:0/3156754044 conn(0x7f05bc06d0d0 msgr2=0x7f05bc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:09.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 -- 172.21.15.144:0/3156754044 shutdown_connections 2024-09-12T12:17:09.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 -- 172.21.15.144:0/3156754044 wait complete. 2024-09-12T12:17:09.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 Processor -- start 2024-09-12T12:17:09.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 -- start start 2024-09-12T12:17:09.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05bc14bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05bc14df90 0x7f05bc14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05bc154f00 0x7f05bc155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc15b8c0 con 0x7f05a00039c0 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc0b3da0 con 0x7f05bc154f00 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05c1200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05bc14e4c0 con 0x7f05bc14df90 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05b9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05bc14bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05b9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05bc14bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41646/0 (socket says 172.21.15.144:41646) 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.926+0000 7f05b9e00640 1 -- 172.21.15.144:0/2519028955 learned_addr learned my addr 172.21.15.144:0/2519028955 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05ba800640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05bc154f00 0x7f05bc155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b9400640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05bc14df90 0x7f05bc14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b9e00640 1 -- 172.21.15.144:0/2519028955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05bc14df90 msgr2=0x7f05bc14ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b9e00640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05bc14df90 0x7f05bc14ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b9e00640 1 -- 172.21.15.144:0/2519028955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05bc154f00 msgr2=0x7f05bc155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:09.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b9e00640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05bc154f00 0x7f05bc155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:09.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b9e00640 1 -- 172.21.15.144:0/2519028955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc14e7a0 con 0x7f05a00039c0 2024-09-12T12:17:09.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05ba800640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05bc154f00 0x7f05bc155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:09.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b9e00640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05bc14bae0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f05ac01d0e0 tx=0x7f05a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:09.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b2000640 1 -- 172.21.15.144:0/2519028955 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac001260 con 0x7f05a00039c0 2024-09-12T12:17:09.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b2000640 1 -- 172.21.15.144:0/2519028955 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac0ad430 con 0x7f05a00039c0 2024-09-12T12:17:09.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b2000640 1 -- 172.21.15.144:0/2519028955 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac001800 con 0x7f05a00039c0 2024-09-12T12:17:09.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc14ea80 con 0x7f05a00039c0 2024-09-12T12:17:09.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05bc14f040 con 0x7f05a00039c0 2024-09-12T12:17:09.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05bc0d15d0 con 0x7f05a00039c0 2024-09-12T12:17:09.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b2000640 1 -- 172.21.15.144:0/2519028955 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f05ac0bc020 con 0x7f05a00039c0 2024-09-12T12:17:09.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b2000640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f059c067a60 0x7f059c069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:09.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b2000640 1 -- 172.21.15.144:0/2519028955 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f05ac11ffc0 con 0x7f05a00039c0 2024-09-12T12:17:09.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.930+0000 7f05b9400640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f059c067a60 0x7f059c069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:09.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.934+0000 7f05b9400640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f059c067a60 0x7f059c069f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f05bc155b30 tx=0x7f05a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:09.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:09.934+0000 7f05b2000640 1 -- 172.21.15.144:0/2519028955 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f05ac016ff0 con 0x7f05a00039c0 2024-09-12T12:17:10.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.090+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05bc14f3b0 con 0x7f059c067a60 2024-09-12T12:17:10.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.098+0000 7f05b2000640 1 -- 172.21.15.144:0/2519028955 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246753 (secure 0 0 0) 0x7f05bc14f3b0 con 0x7f059c067a60 2024-09-12T12:17:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:10.105 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:17:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f059c067a60 msgr2=0x7f059c069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f059c067a60 0x7f059c069f20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f05bc155b30 tx=0x7f05a8009040 comp rx=0 tx=0).stop 2024-09-12T12:17:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 msgr2=0x7f05bc14bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05bc14bae0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f05ac01d0e0 tx=0x7f05a0005840 comp rx=0 tx=0).stop 2024-09-12T12:17:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 shutdown_connections 2024-09-12T12:17:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f059c067a60 0x7f059c069f20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05bc154f00 0x7f05bc155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05bc14df90 0x7f05bc14ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 --2- 172.21.15.144:0/2519028955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05a00039c0 0x7f05bc14bae0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 >> 172.21.15.144:0/2519028955 conn(0x7f05bc06d0d0 msgr2=0x7f05bc0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:10.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 shutdown_connections 2024-09-12T12:17:10.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.102+0000 7f05c1200640 1 -- 172.21.15.144:0/2519028955 wait complete. 2024-09-12T12:17:10.125 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-12T12:17:09.430898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299952,"kb_used_data":8820,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754674768,"statfs":{"total":773094113280,"available":772786962432,"internally_reserved":0,"allocated":9031680,"data_stored":4775403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000952"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270944+0000","last_change":"2024-09-12T12:17:04.270944+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270944+0000","last_undegraded":"2024-09-12T12:17:04.270944+0000","last_fullsized":"2024-09-12T12:17:04.270944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269037+0000","last_change":"2024-09-12T12:17:04.269037+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269037+0000","last_undegraded":"2024-09-12T12:17:04.269037+0000","last_fullsized":"2024-09-12T12:17:04.269037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267732+0000","last_change":"2024-09-12T12:17:04.267732+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267732+0000","last_undegraded":"2024-09-12T12:17:04.267732+0000","last_fullsized":"2024-09-12T12:17:04.267732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265910+0000","last_change":"2024-09-12T12:17:04.265910+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265910+0000","last_undegraded":"2024-09-12T12:17:04.265910+0000","last_fullsized":"2024-09-12T12:17:04.265910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271660+0000","last_change":"2024-09-12T12:17:04.271660+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271660+0000","last_undegraded":"2024-09-12T12:17:04.271660+0000","last_fullsized":"2024-09-12T12:17:04.271660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.274579+0000","last_change":"2024-09-12T12:17:04.274579+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.274579+0000","last_undegraded":"2024-09-12T12:17:04.274579+0000","last_fullsized":"2024-09-12T12:17:04.274579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264072+0000","last_change":"2024-09-12T12:17:04.264072+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264072+0000","last_undegraded":"2024-09-12T12:17:04.264072+0000","last_fullsized":"2024-09-12T12:17:04.264072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270786+0000","last_change":"2024-09-12T12:17:04.270786+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270786+0000","last_undegraded":"2024-09-12T12:17:04.270786+0000","last_fullsized":"2024-09-12T12:17:04.270786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271631+0000","last_change":"2024-09-12T12:17:04.271631+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271631+0000","last_undegraded":"2024-09-12T12:17:04.271631+0000","last_fullsized":"2024-09-12T12:17:04.271631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267055+0000","last_change":"2024-09-12T12:17:04.267055+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267055+0000","last_undegraded":"2024-09-12T12:17:04.267055+0000","last_fullsized":"2024-09-12T12:17:04.267055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268623+0000","last_change":"2024-09-12T12:17:04.268623+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268623+0000","last_undegraded":"2024-09-12T12:17:04.268623+0000","last_fullsized":"2024-09-12T12:17:04.268623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265515+0000","last_change":"2024-09-12T12:17:04.265515+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265515+0000","last_undegraded":"2024-09-12T12:17:04.265515+0000","last_fullsized":"2024-09-12T12:17:04.265515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267508+0000","last_change":"2024-09-12T12:17:04.267508+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267508+0000","last_undegraded":"2024-09-12T12:17:04.267508+0000","last_fullsized":"2024-09-12T12:17:04.267508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.274211+0000","last_change":"2024-09-12T12:17:04.274211+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.274211+0000","last_undegraded":"2024-09-12T12:17:04.274211+0000","last_fullsized":"2024-09-12T12:17:04.274211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268541+0000","last_change":"2024-09-12T12:17:04.268541+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268541+0000","last_undegraded":"2024-09-12T12:17:04.268541+0000","last_fullsized":"2024-09-12T12:17:04.268541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271563+0000","last_change":"2024-09-12T12:17:04.271563+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271563+0000","last_undegraded":"2024-09-12T12:17:04.271563+0000","last_fullsized":"2024-09-12T12:17:04.271563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.272248+0000","last_change":"2024-09-12T12:17:04.272248+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.272248+0000","last_undegraded":"2024-09-12T12:17:04.272248+0000","last_fullsized":"2024-09-12T12:17:04.272248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270331+0000","last_change":"2024-09-12T12:17:04.270331+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270331+0000","last_undegraded":"2024-09-12T12:17:04.270331+0000","last_fullsized":"2024-09-12T12:17:04.270331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.273226+0000","last_change":"2024-09-12T12:17:04.273226+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.273226+0000","last_undegraded":"2024-09-12T12:17:04.273226+0000","last_fullsized":"2024-09-12T12:17:04.273226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267656+0000","last_change":"2024-09-12T12:17:04.267656+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267656+0000","last_undegraded":"2024-09-12T12:17:04.267656+0000","last_fullsized":"2024-09-12T12:17:04.267656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271080+0000","last_change":"2024-09-12T12:17:04.271080+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271080+0000","last_undegraded":"2024-09-12T12:17:04.271080+0000","last_fullsized":"2024-09-12T12:17:04.271080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265488+0000","last_change":"2024-09-12T12:17:04.265488+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265488+0000","last_undegraded":"2024-09-12T12:17:04.265488+0000","last_fullsized":"2024-09-12T12:17:04.265488+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269304+0000","last_change":"2024-09-12T12:17:04.269304+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269304+0000","last_undegraded":"2024-09-12T12:17:04.269304+0000","last_fullsized":"2024-09-12T12:17:04.269304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268532+0000","last_change":"2024-09-12T12:17:04.268532+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268532+0000","last_undegraded":"2024-09-12T12:17:04.268532+0000","last_fullsized":"2024-09-12T12:17:04.268532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268366+0000","last_change":"2024-09-12T12:17:04.268366+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268366+0000","last_undegraded":"2024-09-12T12:17:04.268366+0000","last_fullsized":"2024-09-12T12:17:04.268366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266565+0000","last_change":"2024-09-12T12:17:04.266565+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266565+0000","last_undegraded":"2024-09-12T12:17:04.266565+0000","last_fullsized":"2024-09-12T12:17:04.266565+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271881+0000","last_change":"2024-09-12T12:17:04.271881+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271881+0000","last_undegraded":"2024-09-12T12:17:04.271881+0000","last_fullsized":"2024-09-12T12:17:04.271881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266435+0000","last_change":"2024-09-12T12:17:04.266435+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266435+0000","last_undegraded":"2024-09-12T12:17:04.266435+0000","last_fullsized":"2024-09-12T12:17:04.266435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268086+0000","last_change":"2024-09-12T12:17:04.268086+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268086+0000","last_undegraded":"2024-09-12T12:17:04.268086+0000","last_fullsized":"2024-09-12T12:17:04.268086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269588+0000","last_change":"2024-09-12T12:17:04.269588+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269588+0000","last_undegraded":"2024-09-12T12:17:04.269588+0000","last_fullsized":"2024-09-12T12:17:04.269588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265279+0000","last_change":"2024-09-12T12:17:04.265279+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265279+0000","last_undegraded":"2024-09-12T12:17:04.265279+0000","last_fullsized":"2024-09-12T12:17:04.265279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269509+0000","last_change":"2024-09-12T12:17:04.269509+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269509+0000","last_undegraded":"2024-09-12T12:17:04.269509+0000","last_fullsized":"2024-09-12T12:17:04.269509+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264435+0000","last_change":"2024-09-12T12:17:04.264435+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264435+0000","last_undegraded":"2024-09-12T12:17:04.264435+0000","last_fullsized":"2024-09-12T12:17:04.264435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.292579+0000","last_change":"2024-09-12T12:17:04.288167+0000","last_active":"2024-09-12T12:17:04.292579+0000","last_peered":"2024-09-12T12:17:04.292579+0000","last_clean":"2024-09-12T12:17:04.292579+0000","last_became_active":"2024-09-12T12:17:04.287954+0000","last_became_peered":"2024-09-12T12:17:04.287954+0000","last_unstale":"2024-09-12T12:17:04.292579+0000","last_undegraded":"2024-09-12T12:17:04.292579+0000","last_fullsized":"2024-09-12T12:17:04.292579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:10:23.643450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267493+0000","last_change":"2024-09-12T12:17:04.267493+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267493+0000","last_undegraded":"2024-09-12T12:17:04.267493+0000","last_fullsized":"2024-09-12T12:17:04.267493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285040+0000","last_change":"2024-09-12T12:17:04.282927+0000","last_active":"2024-09-12T12:17:04.285040+0000","last_peered":"2024-09-12T12:17:04.285040+0000","last_clean":"2024-09-12T12:17:04.285040+0000","last_became_active":"2024-09-12T12:17:04.282682+0000","last_became_peered":"2024-09-12T12:17:04.282682+0000","last_unstale":"2024-09-12T12:17:04.285040+0000","last_undegraded":"2024-09-12T12:17:04.285040+0000","last_fullsized":"2024-09-12T12:17:04.285040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:17.101878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270032+0000","last_change":"2024-09-12T12:17:04.270032+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270032+0000","last_undegraded":"2024-09-12T12:17:04.270032+0000","last_fullsized":"2024-09-12T12:17:04.270032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286122+0000","last_change":"2024-09-12T12:17:04.284408+0000","last_active":"2024-09-12T12:17:04.286122+0000","last_peered":"2024-09-12T12:17:04.286122+0000","last_clean":"2024-09-12T12:17:04.286122+0000","last_became_active":"2024-09-12T12:17:04.284110+0000","last_became_peered":"2024-09-12T12:17:04.284110+0000","last_unstale":"2024-09-12T12:17:04.286122+0000","last_undegraded":"2024-09-12T12:17:04.286122+0000","last_fullsized":"2024-09-12T12:17:04.286122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:13.958415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270686+0000","last_change":"2024-09-12T12:17:04.270686+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270686+0000","last_undegraded":"2024-09-12T12:17:04.270686+0000","last_fullsized":"2024-09-12T12:17:04.270686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282775+0000","last_change":"2024-09-12T12:17:04.282018+0000","last_active":"2024-09-12T12:17:04.282775+0000","last_peered":"2024-09-12T12:17:04.282775+0000","last_clean":"2024-09-12T12:17:04.282775+0000","last_became_active":"2024-09-12T12:17:04.281347+0000","last_became_peered":"2024-09-12T12:17:04.281347+0000","last_unstale":"2024-09-12T12:17:04.282775+0000","last_undegraded":"2024-09-12T12:17:04.282775+0000","last_fullsized":"2024-09-12T12:17:04.282775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:16.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268510+0000","last_change":"2024-09-12T12:17:04.268510+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268510+0000","last_undegraded":"2024-09-12T12:17:04.268510+0000","last_fullsized":"2024-09-12T12:17:04.268510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281044+0000","last_change":"2024-09-12T12:17:04.277749+0000","last_active":"2024-09-12T12:17:04.281044+0000","last_peered":"2024-09-12T12:17:04.281044+0000","last_clean":"2024-09-12T12:17:04.281044+0000","last_became_active":"2024-09-12T12:17:04.277421+0000","last_became_peered":"2024-09-12T12:17:04.277421+0000","last_unstale":"2024-09-12T12:17:04.281044+0000","last_undegraded":"2024-09-12T12:17:04.281044+0000","last_fullsized":"2024-09-12T12:17:04.281044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:52.140000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267996+0000","last_change":"2024-09-12T12:17:04.267996+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267996+0000","last_undegraded":"2024-09-12T12:17:04.267996+0000","last_fullsized":"2024-09-12T12:17:04.267996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286487+0000","last_change":"2024-09-12T12:17:04.285386+0000","last_active":"2024-09-12T12:17:04.286487+0000","last_peered":"2024-09-12T12:17:04.286487+0000","last_clean":"2024-09-12T12:17:04.286487+0000","last_became_active":"2024-09-12T12:17:04.284833+0000","last_became_peered":"2024-09-12T12:17:04.284833+0000","last_unstale":"2024-09-12T12:17:04.286487+0000","last_undegraded":"2024-09-12T12:17:04.286487+0000","last_fullsized":"2024-09-12T12:17:04.286487+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:04.643981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271974+0000","last_change":"2024-09-12T12:17:04.271974+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271974+0000","last_undegraded":"2024-09-12T12:17:04.271974+0000","last_fullsized":"2024-09-12T12:17:04.271974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281925+0000","last_change":"2024-09-12T12:17:04.278438+0000","last_active":"2024-09-12T12:17:04.281925+0000","last_peered":"2024-09-12T12:17:04.281925+0000","last_clean":"2024-09-12T12:17:04.281925+0000","last_became_active":"2024-09-12T12:17:04.277977+0000","last_became_peered":"2024-09-12T12:17:04.277977+0000","last_unstale":"2024-09-12T12:17:04.281925+0000","last_undegraded":"2024-09-12T12:17:04.281925+0000","last_fullsized":"2024-09-12T12:17:04.281925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:25.066020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265443+0000","last_change":"2024-09-12T12:17:04.265443+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265443+0000","last_undegraded":"2024-09-12T12:17:04.265443+0000","last_fullsized":"2024-09-12T12:17:04.265443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282523+0000","last_change":"2024-09-12T12:17:04.277306+0000","last_active":"2024-09-12T12:17:04.282523+0000","last_peered":"2024-09-12T12:17:04.282523+0000","last_clean":"2024-09-12T12:17:04.282523+0000","last_became_active":"2024-09-12T12:17:04.276970+0000","last_became_peered":"2024-09-12T12:17:04.276970+0000","last_unstale":"2024-09-12T12:17:04.282523+0000","last_undegraded":"2024-09-12T12:17:04.282523+0000","last_fullsized":"2024-09-12T12:17:04.282523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:00.660785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267607+0000","last_change":"2024-09-12T12:17:04.267607+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267607+0000","last_undegraded":"2024-09-12T12:17:04.267607+0000","last_fullsized":"2024-09-12T12:17:04.267607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285712+0000","last_change":"2024-09-12T12:17:04.283614+0000","last_active":"2024-09-12T12:17:04.285712+0000","last_peered":"2024-09-12T12:17:04.285712+0000","last_clean":"2024-09-12T12:17:04.285712+0000","last_became_active":"2024-09-12T12:17:04.283363+0000","last_became_peered":"2024-09-12T12:17:04.283363+0000","last_unstale":"2024-09-12T12:17:04.285712+0000","last_undegraded":"2024-09-12T12:17:04.285712+0000","last_fullsized":"2024-09-12T12:17:04.285712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:52.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265028+0000","last_change":"2024-09-12T12:17:04.265028+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265028+0000","last_undegraded":"2024-09-12T12:17:04.265028+0000","last_fullsized":"2024-09-12T12:17:04.265028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281862+0000","last_change":"2024-09-12T12:17:04.278522+0000","last_active":"2024-09-12T12:17:04.281862+0000","last_peered":"2024-09-12T12:17:04.281862+0000","last_clean":"2024-09-12T12:17:04.281862+0000","last_became_active":"2024-09-12T12:17:04.278250+0000","last_became_peered":"2024-09-12T12:17:04.278250+0000","last_unstale":"2024-09-12T12:17:04.281862+0000","last_undegraded":"2024-09-12T12:17:04.281862+0000","last_fullsized":"2024-09-12T12:17:04.281862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:52.862397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.273845+0000","last_change":"2024-09-12T12:17:04.273845+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.273845+0000","last_undegraded":"2024-09-12T12:17:04.273845+0000","last_fullsized":"2024-09-12T12:17:04.273845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.290142+0000","last_change":"2024-09-12T12:17:04.286746+0000","last_active":"2024-09-12T12:17:04.290142+0000","last_peered":"2024-09-12T12:17:04.290142+0000","last_clean":"2024-09-12T12:17:04.290142+0000","last_became_active":"2024-09-12T12:17:04.286451+0000","last_became_peered":"2024-09-12T12:17:04.286451+0000","last_unstale":"2024-09-12T12:17:04.290142+0000","last_undegraded":"2024-09-12T12:17:04.290142+0000","last_fullsized":"2024-09-12T12:17:04.290142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:20.810734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264005+0000","last_change":"2024-09-12T12:17:04.264005+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264005+0000","last_undegraded":"2024-09-12T12:17:04.264005+0000","last_fullsized":"2024-09-12T12:17:04.264005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281921+0000","last_change":"2024-09-12T12:17:04.278410+0000","last_active":"2024-09-12T12:17:04.281921+0000","last_peered":"2024-09-12T12:17:04.281921+0000","last_clean":"2024-09-12T12:17:04.281921+0000","last_became_active":"2024-09-12T12:17:04.278156+0000","last_became_peered":"2024-09-12T12:17:04.278156+0000","last_unstale":"2024-09-12T12:17:04.281921+0000","last_undegraded":"2024-09-12T12:17:04.281921+0000","last_fullsized":"2024-09-12T12:17:04.281921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:33.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265068+0000","last_change":"2024-09-12T12:17:04.265068+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265068+0000","last_undegraded":"2024-09-12T12:17:04.265068+0000","last_fullsized":"2024-09-12T12:17:04.265068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.280803+0000","last_change":"2024-09-12T12:17:04.275009+0000","last_active":"2024-09-12T12:17:04.280803+0000","last_peered":"2024-09-12T12:17:04.280803+0000","last_clean":"2024-09-12T12:17:04.280803+0000","last_became_active":"2024-09-12T12:17:04.274726+0000","last_became_peered":"2024-09-12T12:17:04.274726+0000","last_unstale":"2024-09-12T12:17:04.280803+0000","last_undegraded":"2024-09-12T12:17:04.280803+0000","last_fullsized":"2024-09-12T12:17:04.280803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:03.544531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265791+0000","last_change":"2024-09-12T12:17:04.265791+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265791+0000","last_undegraded":"2024-09-12T12:17:04.265791+0000","last_fullsized":"2024-09-12T12:17:04.265791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287300+0000","last_change":"2024-09-12T12:17:04.286442+0000","last_active":"2024-09-12T12:17:04.287300+0000","last_peered":"2024-09-12T12:17:04.287300+0000","last_clean":"2024-09-12T12:17:04.287300+0000","last_became_active":"2024-09-12T12:17:04.286168+0000","last_became_peered":"2024-09-12T12:17:04.286168+0000","last_unstale":"2024-09-12T12:17:04.287300+0000","last_undegraded":"2024-09-12T12:17:04.287300+0000","last_fullsized":"2024-09-12T12:17:04.287300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:16.524611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264470+0000","last_change":"2024-09-12T12:17:04.264470+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264470+0000","last_undegraded":"2024-09-12T12:17:04.264470+0000","last_fullsized":"2024-09-12T12:17:04.264470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.288883+0000","last_change":"2024-09-12T12:17:04.283991+0000","last_active":"2024-09-12T12:17:04.288883+0000","last_peered":"2024-09-12T12:17:04.288883+0000","last_clean":"2024-09-12T12:17:04.288883+0000","last_became_active":"2024-09-12T12:17:04.283694+0000","last_became_peered":"2024-09-12T12:17:04.283694+0000","last_unstale":"2024-09-12T12:17:04.288883+0000","last_undegraded":"2024-09-12T12:17:04.288883+0000","last_fullsized":"2024-09-12T12:17:04.288883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:25.373252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265035+0000","last_change":"2024-09-12T12:17:04.265035+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265035+0000","last_undegraded":"2024-09-12T12:17:04.265035+0000","last_fullsized":"2024-09-12T12:17:04.265035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.276490+0000","last_change":"2024-09-12T12:17:04.275540+0000","last_active":"2024-09-12T12:17:04.276490+0000","last_peered":"2024-09-12T12:17:04.276490+0000","last_clean":"2024-09-12T12:17:04.276490+0000","last_became_active":"2024-09-12T12:17:04.275188+0000","last_became_peered":"2024-09-12T12:17:04.275188+0000","last_unstale":"2024-09-12T12:17:04.276490+0000","last_undegraded":"2024-09-12T12:17:04.276490+0000","last_fullsized":"2024-09-12T12:17:04.276490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:39.663729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266674+0000","last_change":"2024-09-12T12:17:04.266674+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266674+0000","last_undegraded":"2024-09-12T12:17:04.266674+0000","last_fullsized":"2024-09-12T12:17:04.266674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285690+0000","last_change":"2024-09-12T12:17:04.282311+0000","last_active":"2024-09-12T12:17:04.285690+0000","last_peered":"2024-09-12T12:17:04.285690+0000","last_clean":"2024-09-12T12:17:04.285690+0000","last_became_active":"2024-09-12T12:17:04.282043+0000","last_became_peered":"2024-09-12T12:17:04.282043+0000","last_unstale":"2024-09-12T12:17:04.285690+0000","last_undegraded":"2024-09-12T12:17:04.285690+0000","last_fullsized":"2024-09-12T12:17:04.285690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:39.663729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264821+0000","last_change":"2024-09-12T12:17:04.264821+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264821+0000","last_undegraded":"2024-09-12T12:17:04.264821+0000","last_fullsized":"2024-09-12T12:17:04.264821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282226+0000","last_change":"2024-09-12T12:17:04.281271+0000","last_active":"2024-09-12T12:17:04.282226+0000","last_peered":"2024-09-12T12:17:04.282226+0000","last_clean":"2024-09-12T12:17:04.282226+0000","last_became_active":"2024-09-12T12:17:04.280997+0000","last_became_peered":"2024-09-12T12:17:04.280997+0000","last_unstale":"2024-09-12T12:17:04.282226+0000","last_undegraded":"2024-09-12T12:17:04.282226+0000","last_fullsized":"2024-09-12T12:17:04.282226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:00.696318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265890+0000","last_change":"2024-09-12T12:17:04.265890+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265890+0000","last_undegraded":"2024-09-12T12:17:04.265890+0000","last_fullsized":"2024-09-12T12:17:04.265890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285121+0000","last_change":"2024-09-12T12:17:04.278980+0000","last_active":"2024-09-12T12:17:04.285121+0000","last_peered":"2024-09-12T12:17:04.285121+0000","last_clean":"2024-09-12T12:17:04.285121+0000","last_became_active":"2024-09-12T12:17:04.278725+0000","last_became_peered":"2024-09-12T12:17:04.278725+0000","last_unstale":"2024-09-12T12:17:04.285121+0000","last_undegraded":"2024-09-12T12:17:04.285121+0000","last_fullsized":"2024-09-12T12:17:04.285121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:15.060762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271885+0000","last_change":"2024-09-12T12:17:04.271885+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271885+0000","last_undegraded":"2024-09-12T12:17:04.271885+0000","last_fullsized":"2024-09-12T12:17:04.271885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282379+0000","last_change":"2024-09-12T12:17:04.277891+0000","last_active":"2024-09-12T12:17:04.282379+0000","last_peered":"2024-09-12T12:17:04.282379+0000","last_clean":"2024-09-12T12:17:04.282379+0000","last_became_active":"2024-09-12T12:17:04.277603+0000","last_became_peered":"2024-09-12T12:17:04.277603+0000","last_unstale":"2024-09-12T12:17:04.282379+0000","last_undegraded":"2024-09-12T12:17:04.282379+0000","last_fullsized":"2024-09-12T12:17:04.282379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:16.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266673+0000","last_change":"2024-09-12T12:17:04.266673+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266673+0000","last_undegraded":"2024-09-12T12:17:04.266673+0000","last_fullsized":"2024-09-12T12:17:04.266673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286235+0000","last_change":"2024-09-12T12:17:04.283216+0000","last_active":"2024-09-12T12:17:04.286235+0000","last_peered":"2024-09-12T12:17:04.286235+0000","last_clean":"2024-09-12T12:17:04.286235+0000","last_became_active":"2024-09-12T12:17:04.282951+0000","last_became_peered":"2024-09-12T12:17:04.282951+0000","last_unstale":"2024-09-12T12:17:04.286235+0000","last_undegraded":"2024-09-12T12:17:04.286235+0000","last_fullsized":"2024-09-12T12:17:04.286235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:01.267449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267693+0000","last_change":"2024-09-12T12:17:04.267693+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267693+0000","last_undegraded":"2024-09-12T12:17:04.267693+0000","last_fullsized":"2024-09-12T12:17:04.267693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.292648+0000","last_change":"2024-09-12T12:17:04.287880+0000","last_active":"2024-09-12T12:17:04.292648+0000","last_peered":"2024-09-12T12:17:04.292648+0000","last_clean":"2024-09-12T12:17:04.292648+0000","last_became_active":"2024-09-12T12:17:04.285568+0000","last_became_peered":"2024-09-12T12:17:04.285568+0000","last_unstale":"2024-09-12T12:17:04.292648+0000","last_undegraded":"2024-09-12T12:17:04.292648+0000","last_fullsized":"2024-09-12T12:17:04.292648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:55.756882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264564+0000","last_change":"2024-09-12T12:17:04.264564+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264564+0000","last_undegraded":"2024-09-12T12:17:04.264564+0000","last_fullsized":"2024-09-12T12:17:04.264564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287352+0000","last_change":"2024-09-12T12:17:04.283598+0000","last_active":"2024-09-12T12:17:04.287352+0000","last_peered":"2024-09-12T12:17:04.287352+0000","last_clean":"2024-09-12T12:17:04.287352+0000","last_became_active":"2024-09-12T12:17:04.283327+0000","last_became_peered":"2024-09-12T12:17:04.283327+0000","last_unstale":"2024-09-12T12:17:04.287352+0000","last_undegraded":"2024-09-12T12:17:04.287352+0000","last_fullsized":"2024-09-12T12:17:04.287352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:22.093367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269248+0000","last_change":"2024-09-12T12:17:04.269248+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269248+0000","last_undegraded":"2024-09-12T12:17:04.269248+0000","last_fullsized":"2024-09-12T12:17:04.269248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.280809+0000","last_change":"2024-09-12T12:17:04.274915+0000","last_active":"2024-09-12T12:17:04.280809+0000","last_peered":"2024-09-12T12:17:04.280809+0000","last_clean":"2024-09-12T12:17:04.280809+0000","last_became_active":"2024-09-12T12:17:04.274601+0000","last_became_peered":"2024-09-12T12:17:04.274601+0000","last_unstale":"2024-09-12T12:17:04.280809+0000","last_undegraded":"2024-09-12T12:17:04.280809+0000","last_fullsized":"2024-09-12T12:17:04.280809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:16.740217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263364+0000","last_change":"2024-09-12T12:17:04.263364+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263364+0000","last_undegraded":"2024-09-12T12:17:04.263364+0000","last_fullsized":"2024-09-12T12:17:04.263364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.284671+0000","last_change":"2024-09-12T12:17:04.281551+0000","last_active":"2024-09-12T12:17:04.284671+0000","last_peered":"2024-09-12T12:17:04.284671+0000","last_clean":"2024-09-12T12:17:04.284671+0000","last_became_active":"2024-09-12T12:17:04.281205+0000","last_became_peered":"2024-09-12T12:17:04.281205+0000","last_unstale":"2024-09-12T12:17:04.284671+0000","last_undegraded":"2024-09-12T12:17:04.284671+0000","last_fullsized":"2024-09-12T12:17:04.284671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:17.101878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269595+0000","last_change":"2024-09-12T12:17:04.269595+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269595+0000","last_undegraded":"2024-09-12T12:17:04.269595+0000","last_fullsized":"2024-09-12T12:17:04.269595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286997+0000","last_change":"2024-09-12T12:17:04.285672+0000","last_active":"2024-09-12T12:17:04.286997+0000","last_peered":"2024-09-12T12:17:04.286997+0000","last_clean":"2024-09-12T12:17:04.286997+0000","last_became_active":"2024-09-12T12:17:04.284212+0000","last_became_peered":"2024-09-12T12:17:04.284212+0000","last_unstale":"2024-09-12T12:17:04.286997+0000","last_undegraded":"2024-09-12T12:17:04.286997+0000","last_fullsized":"2024-09-12T12:17:04.286997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:14.550590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265785+0000","last_change":"2024-09-12T12:17:04.265785+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265785+0000","last_undegraded":"2024-09-12T12:17:04.265785+0000","last_fullsized":"2024-09-12T12:17:04.265785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.284940+0000","last_change":"2024-09-12T12:17:04.282760+0000","last_active":"2024-09-12T12:17:04.284940+0000","last_peered":"2024-09-12T12:17:04.284940+0000","last_clean":"2024-09-12T12:17:04.284940+0000","last_became_active":"2024-09-12T12:17:04.282480+0000","last_became_peered":"2024-09-12T12:17:04.282480+0000","last_unstale":"2024-09-12T12:17:04.284940+0000","last_undegraded":"2024-09-12T12:17:04.284940+0000","last_fullsized":"2024-09-12T12:17:04.284940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:25.066020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263851+0000","last_change":"2024-09-12T12:17:04.263851+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263851+0000","last_undegraded":"2024-09-12T12:17:04.263851+0000","last_fullsized":"2024-09-12T12:17:04.263851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281725+0000","last_change":"2024-09-12T12:17:04.279763+0000","last_active":"2024-09-12T12:17:04.281725+0000","last_peered":"2024-09-12T12:17:04.281725+0000","last_clean":"2024-09-12T12:17:04.281725+0000","last_became_active":"2024-09-12T12:17:04.279478+0000","last_became_peered":"2024-09-12T12:17:04.279478+0000","last_unstale":"2024-09-12T12:17:04.281725+0000","last_undegraded":"2024-09-12T12:17:04.281725+0000","last_fullsized":"2024-09-12T12:17:04.281725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:25.659264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263409+0000","last_change":"2024-09-12T12:17:04.263409+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263409+0000","last_undegraded":"2024-09-12T12:17:04.263409+0000","last_fullsized":"2024-09-12T12:17:04.263409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.290153+0000","last_change":"2024-09-12T12:17:04.287110+0000","last_active":"2024-09-12T12:17:04.290153+0000","last_peered":"2024-09-12T12:17:04.290153+0000","last_clean":"2024-09-12T12:17:04.290153+0000","last_became_active":"2024-09-12T12:17:04.286764+0000","last_became_peered":"2024-09-12T12:17:04.286764+0000","last_unstale":"2024-09-12T12:17:04.290153+0000","last_undegraded":"2024-09-12T12:17:04.290153+0000","last_fullsized":"2024-09-12T12:17:04.290153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.714859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264233+0000","last_change":"2024-09-12T12:17:04.264233+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264233+0000","last_undegraded":"2024-09-12T12:17:04.264233+0000","last_fullsized":"2024-09-12T12:17:04.264233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287959+0000","last_change":"2024-09-12T12:17:04.285150+0000","last_active":"2024-09-12T12:17:04.287959+0000","last_peered":"2024-09-12T12:17:04.287959+0000","last_clean":"2024-09-12T12:17:04.287959+0000","last_became_active":"2024-09-12T12:17:04.284860+0000","last_became_peered":"2024-09-12T12:17:04.284860+0000","last_unstale":"2024-09-12T12:17:04.287959+0000","last_undegraded":"2024-09-12T12:17:04.287959+0000","last_fullsized":"2024-09-12T12:17:04.287959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:57.737059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263965+0000","last_change":"2024-09-12T12:17:04.263965+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263965+0000","last_undegraded":"2024-09-12T12:17:04.263965+0000","last_fullsized":"2024-09-12T12:17:04.263965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282342+0000","last_change":"2024-09-12T12:17:04.277442+0000","last_active":"2024-09-12T12:17:04.282342+0000","last_peered":"2024-09-12T12:17:04.282342+0000","last_clean":"2024-09-12T12:17:04.282342+0000","last_became_active":"2024-09-12T12:17:04.277120+0000","last_became_peered":"2024-09-12T12:17:04.277120+0000","last_unstale":"2024-09-12T12:17:04.282342+0000","last_undegraded":"2024-09-12T12:17:04.282342+0000","last_fullsized":"2024-09-12T12:17:04.282342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:25.659264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271421+0000","last_change":"2024-09-12T12:17:04.271421+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271421+0000","last_undegraded":"2024-09-12T12:17:04.271421+0000","last_fullsized":"2024-09-12T12:17:04.271421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287464+0000","last_change":"2024-09-12T12:17:04.284794+0000","last_active":"2024-09-12T12:17:04.287464+0000","last_peered":"2024-09-12T12:17:04.287464+0000","last_clean":"2024-09-12T12:17:04.287464+0000","last_became_active":"2024-09-12T12:17:04.283991+0000","last_became_peered":"2024-09-12T12:17:04.283991+0000","last_unstale":"2024-09-12T12:17:04.287464+0000","last_undegraded":"2024-09-12T12:17:04.287464+0000","last_fullsized":"2024-09-12T12:17:04.287464+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:04.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.272549+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:17:04.272549+0000","last_peered":"2024-09-12T12:17:04.272549+0000","last_clean":"2024-09-12T12:17:04.272549+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:17:04.272549+0000","last_undegraded":"2024-09-12T12:17:04.272549+0000","last_fullsized":"2024-09-12T12:17:04.272549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1572864,"data_stored":1038868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41064,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330776,"statfs":{"total":96636764160,"available":96594714624,"internally_reserved":0,"allocated":1585152,"data_stored":1045535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:17:10.129 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3f is not active+clean 2024-09-12T12:17:10.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.270944+0000', 'last_change': '2024-09-12T12:17:04.270944+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.270944+0000', 'last_undegraded': '2024-09-12T12:17:04.270944+0000', 'last_fullsized': '2024-09-12T12:17:04.270944+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:17:10.129 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3e is not active+clean 2024-09-12T12:17:10.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.269037+0000', 'last_change': '2024-09-12T12:17:04.269037+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.269037+0000', 'last_undegraded': '2024-09-12T12:17:04.269037+0000', 'last_fullsized': '2024-09-12T12:17:04.269037+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3d is not active+clean 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.267732+0000', 'last_change': '2024-09-12T12:17:04.267732+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.267732+0000', 'last_undegraded': '2024-09-12T12:17:04.267732+0000', 'last_fullsized': '2024-09-12T12:17:04.267732+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3c is not active+clean 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265910+0000', 'last_change': '2024-09-12T12:17:04.265910+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265910+0000', 'last_undegraded': '2024-09-12T12:17:04.265910+0000', 'last_fullsized': '2024-09-12T12:17:04.265910+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3b is not active+clean 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.271660+0000', 'last_change': '2024-09-12T12:17:04.271660+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.271660+0000', 'last_undegraded': '2024-09-12T12:17:04.271660+0000', 'last_fullsized': '2024-09-12T12:17:04.271660+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3a is not active+clean 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.274579+0000', 'last_change': '2024-09-12T12:17:04.274579+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.274579+0000', 'last_undegraded': '2024-09-12T12:17:04.274579+0000', 'last_fullsized': '2024-09-12T12:17:04.274579+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:PG 12.39 is not active+clean 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.264072+0000', 'last_change': '2024-09-12T12:17:04.264072+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.264072+0000', 'last_undegraded': '2024-09-12T12:17:04.264072+0000', 'last_fullsized': '2024-09-12T12:17:04.264072+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:PG 12.38 is not active+clean 2024-09-12T12:17:10.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.270786+0000', 'last_change': '2024-09-12T12:17:04.270786+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.270786+0000', 'last_undegraded': '2024-09-12T12:17:04.270786+0000', 'last_fullsized': '2024-09-12T12:17:04.270786+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:PG 12.37 is not active+clean 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.271631+0000', 'last_change': '2024-09-12T12:17:04.271631+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.271631+0000', 'last_undegraded': '2024-09-12T12:17:04.271631+0000', 'last_fullsized': '2024-09-12T12:17:04.271631+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:PG 12.36 is not active+clean 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.267055+0000', 'last_change': '2024-09-12T12:17:04.267055+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.267055+0000', 'last_undegraded': '2024-09-12T12:17:04.267055+0000', 'last_fullsized': '2024-09-12T12:17:04.267055+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:PG 12.35 is not active+clean 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.268623+0000', 'last_change': '2024-09-12T12:17:04.268623+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.268623+0000', 'last_undegraded': '2024-09-12T12:17:04.268623+0000', 'last_fullsized': '2024-09-12T12:17:04.268623+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:PG 12.34 is not active+clean 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265515+0000', 'last_change': '2024-09-12T12:17:04.265515+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265515+0000', 'last_undegraded': '2024-09-12T12:17:04.265515+0000', 'last_fullsized': '2024-09-12T12:17:04.265515+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:PG 12.33 is not active+clean 2024-09-12T12:17:10.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.267508+0000', 'last_change': '2024-09-12T12:17:04.267508+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.267508+0000', 'last_undegraded': '2024-09-12T12:17:04.267508+0000', 'last_fullsized': '2024-09-12T12:17:04.267508+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:PG 12.32 is not active+clean 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.274211+0000', 'last_change': '2024-09-12T12:17:04.274211+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.274211+0000', 'last_undegraded': '2024-09-12T12:17:04.274211+0000', 'last_fullsized': '2024-09-12T12:17:04.274211+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:PG 12.31 is not active+clean 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.268541+0000', 'last_change': '2024-09-12T12:17:04.268541+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.268541+0000', 'last_undegraded': '2024-09-12T12:17:04.268541+0000', 'last_fullsized': '2024-09-12T12:17:04.268541+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:PG 12.30 is not active+clean 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.271563+0000', 'last_change': '2024-09-12T12:17:04.271563+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.271563+0000', 'last_undegraded': '2024-09-12T12:17:04.271563+0000', 'last_fullsized': '2024-09-12T12:17:04.271563+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2f is not active+clean 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.272248+0000', 'last_change': '2024-09-12T12:17:04.272248+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.272248+0000', 'last_undegraded': '2024-09-12T12:17:04.272248+0000', 'last_fullsized': '2024-09-12T12:17:04.272248+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2e is not active+clean 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.270331+0000', 'last_change': '2024-09-12T12:17:04.270331+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.270331+0000', 'last_undegraded': '2024-09-12T12:17:04.270331+0000', 'last_fullsized': '2024-09-12T12:17:04.270331+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2d is not active+clean 2024-09-12T12:17:10.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.273226+0000', 'last_change': '2024-09-12T12:17:04.273226+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.273226+0000', 'last_undegraded': '2024-09-12T12:17:04.273226+0000', 'last_fullsized': '2024-09-12T12:17:04.273226+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2c is not active+clean 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.267656+0000', 'last_change': '2024-09-12T12:17:04.267656+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.267656+0000', 'last_undegraded': '2024-09-12T12:17:04.267656+0000', 'last_fullsized': '2024-09-12T12:17:04.267656+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2b is not active+clean 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.271080+0000', 'last_change': '2024-09-12T12:17:04.271080+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.271080+0000', 'last_undegraded': '2024-09-12T12:17:04.271080+0000', 'last_fullsized': '2024-09-12T12:17:04.271080+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2a is not active+clean 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265488+0000', 'last_change': '2024-09-12T12:17:04.265488+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265488+0000', 'last_undegraded': '2024-09-12T12:17:04.265488+0000', 'last_fullsized': '2024-09-12T12:17:04.265488+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:PG 12.29 is not active+clean 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.269304+0000', 'last_change': '2024-09-12T12:17:04.269304+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.269304+0000', 'last_undegraded': '2024-09-12T12:17:04.269304+0000', 'last_fullsized': '2024-09-12T12:17:04.269304+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:PG 12.28 is not active+clean 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.268532+0000', 'last_change': '2024-09-12T12:17:04.268532+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.268532+0000', 'last_undegraded': '2024-09-12T12:17:04.268532+0000', 'last_fullsized': '2024-09-12T12:17:04.268532+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.133 INFO:tasks.ceph.ceph_manager.ceph:PG 12.27 is not active+clean 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.268366+0000', 'last_change': '2024-09-12T12:17:04.268366+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.268366+0000', 'last_undegraded': '2024-09-12T12:17:04.268366+0000', 'last_fullsized': '2024-09-12T12:17:04.268366+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:PG 12.26 is not active+clean 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.266565+0000', 'last_change': '2024-09-12T12:17:04.266565+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.266565+0000', 'last_undegraded': '2024-09-12T12:17:04.266565+0000', 'last_fullsized': '2024-09-12T12:17:04.266565+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:PG 12.25 is not active+clean 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.271881+0000', 'last_change': '2024-09-12T12:17:04.271881+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.271881+0000', 'last_undegraded': '2024-09-12T12:17:04.271881+0000', 'last_fullsized': '2024-09-12T12:17:04.271881+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:PG 12.24 is not active+clean 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.266435+0000', 'last_change': '2024-09-12T12:17:04.266435+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.266435+0000', 'last_undegraded': '2024-09-12T12:17:04.266435+0000', 'last_fullsized': '2024-09-12T12:17:04.266435+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:PG 12.23 is not active+clean 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.268086+0000', 'last_change': '2024-09-12T12:17:04.268086+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.268086+0000', 'last_undegraded': '2024-09-12T12:17:04.268086+0000', 'last_fullsized': '2024-09-12T12:17:04.268086+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:PG 12.22 is not active+clean 2024-09-12T12:17:10.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.269588+0000', 'last_change': '2024-09-12T12:17:04.269588+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.269588+0000', 'last_undegraded': '2024-09-12T12:17:04.269588+0000', 'last_fullsized': '2024-09-12T12:17:04.269588+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:PG 12.21 is not active+clean 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265279+0000', 'last_change': '2024-09-12T12:17:04.265279+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265279+0000', 'last_undegraded': '2024-09-12T12:17:04.265279+0000', 'last_fullsized': '2024-09-12T12:17:04.265279+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:PG 12.20 is not active+clean 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.269509+0000', 'last_change': '2024-09-12T12:17:04.269509+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.269509+0000', 'last_undegraded': '2024-09-12T12:17:04.269509+0000', 'last_fullsized': '2024-09-12T12:17:04.269509+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:PG 12.18 is not active+clean 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.264435+0000', 'last_change': '2024-09-12T12:17:04.264435+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.264435+0000', 'last_undegraded': '2024-09-12T12:17:04.264435+0000', 'last_fullsized': '2024-09-12T12:17:04.264435+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:PG 12.19 is not active+clean 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.267493+0000', 'last_change': '2024-09-12T12:17:04.267493+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.267493+0000', 'last_undegraded': '2024-09-12T12:17:04.267493+0000', 'last_fullsized': '2024-09-12T12:17:04.267493+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.270032+0000', 'last_change': '2024-09-12T12:17:04.270032+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.270032+0000', 'last_undegraded': '2024-09-12T12:17:04.270032+0000', 'last_fullsized': '2024-09-12T12:17:04.270032+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-09-12T12:17:10.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.270686+0000', 'last_change': '2024-09-12T12:17:04.270686+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.270686+0000', 'last_undegraded': '2024-09-12T12:17:04.270686+0000', 'last_fullsized': '2024-09-12T12:17:04.270686+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:17:10.136 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1c is not active+clean 2024-09-12T12:17:10.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.268510+0000', 'last_change': '2024-09-12T12:17:04.268510+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.268510+0000', 'last_undegraded': '2024-09-12T12:17:04.268510+0000', 'last_fullsized': '2024-09-12T12:17:04.268510+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.136 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1d is not active+clean 2024-09-12T12:17:10.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.267996+0000', 'last_change': '2024-09-12T12:17:04.267996+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.267996+0000', 'last_undegraded': '2024-09-12T12:17:04.267996+0000', 'last_fullsized': '2024-09-12T12:17:04.267996+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.136 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-12T12:17:10.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.271974+0000', 'last_change': '2024-09-12T12:17:04.271974+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.271974+0000', 'last_undegraded': '2024-09-12T12:17:04.271974+0000', 'last_fullsized': '2024-09-12T12:17:04.271974+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:17:10.136 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-12T12:17:10.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265443+0000', 'last_change': '2024-09-12T12:17:04.265443+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265443+0000', 'last_undegraded': '2024-09-12T12:17:04.265443+0000', 'last_fullsized': '2024-09-12T12:17:04.265443+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:PG 12.10 is not active+clean 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.267607+0000', 'last_change': '2024-09-12T12:17:04.267607+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.267607+0000', 'last_undegraded': '2024-09-12T12:17:04.267607+0000', 'last_fullsized': '2024-09-12T12:17:04.267607+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265028+0000', 'last_change': '2024-09-12T12:17:04.265028+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265028+0000', 'last_undegraded': '2024-09-12T12:17:04.265028+0000', 'last_fullsized': '2024-09-12T12:17:04.265028+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:PG 12.12 is not active+clean 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.273845+0000', 'last_change': '2024-09-12T12:17:04.273845+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.273845+0000', 'last_undegraded': '2024-09-12T12:17:04.273845+0000', 'last_fullsized': '2024-09-12T12:17:04.273845+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:PG 12.13 is not active+clean 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.264005+0000', 'last_change': '2024-09-12T12:17:04.264005+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.264005+0000', 'last_undegraded': '2024-09-12T12:17:04.264005+0000', 'last_fullsized': '2024-09-12T12:17:04.264005+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265068+0000', 'last_change': '2024-09-12T12:17:04.265068+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265068+0000', 'last_undegraded': '2024-09-12T12:17:04.265068+0000', 'last_fullsized': '2024-09-12T12:17:04.265068+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T12:17:10.137 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265791+0000', 'last_change': '2024-09-12T12:17:04.265791+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265791+0000', 'last_undegraded': '2024-09-12T12:17:04.265791+0000', 'last_fullsized': '2024-09-12T12:17:04.265791+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.264470+0000', 'last_change': '2024-09-12T12:17:04.264470+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.264470+0000', 'last_undegraded': '2024-09-12T12:17:04.264470+0000', 'last_fullsized': '2024-09-12T12:17:04.264470+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265035+0000', 'last_change': '2024-09-12T12:17:04.265035+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265035+0000', 'last_undegraded': '2024-09-12T12:17:04.265035+0000', 'last_fullsized': '2024-09-12T12:17:04.265035+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:PG 12.8 is not active+clean 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.266674+0000', 'last_change': '2024-09-12T12:17:04.266674+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.266674+0000', 'last_undegraded': '2024-09-12T12:17:04.266674+0000', 'last_fullsized': '2024-09-12T12:17:04.266674+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:PG 12.9 is not active+clean 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.264821+0000', 'last_change': '2024-09-12T12:17:04.264821+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.264821+0000', 'last_undegraded': '2024-09-12T12:17:04.264821+0000', 'last_fullsized': '2024-09-12T12:17:04.264821+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:PG 12.a is not active+clean 2024-09-12T12:17:10.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265890+0000', 'last_change': '2024-09-12T12:17:04.265890+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265890+0000', 'last_undegraded': '2024-09-12T12:17:04.265890+0000', 'last_fullsized': '2024-09-12T12:17:04.265890+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:PG 12.b is not active+clean 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.271885+0000', 'last_change': '2024-09-12T12:17:04.271885+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.271885+0000', 'last_undegraded': '2024-09-12T12:17:04.271885+0000', 'last_fullsized': '2024-09-12T12:17:04.271885+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:PG 12.c is not active+clean 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.266673+0000', 'last_change': '2024-09-12T12:17:04.266673+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.266673+0000', 'last_undegraded': '2024-09-12T12:17:04.266673+0000', 'last_fullsized': '2024-09-12T12:17:04.266673+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:PG 12.e is not active+clean 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.267693+0000', 'last_change': '2024-09-12T12:17:04.267693+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.267693+0000', 'last_undegraded': '2024-09-12T12:17:04.267693+0000', 'last_fullsized': '2024-09-12T12:17:04.267693+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.264564+0000', 'last_change': '2024-09-12T12:17:04.264564+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.264564+0000', 'last_undegraded': '2024-09-12T12:17:04.264564+0000', 'last_fullsized': '2024-09-12T12:17:04.264564+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.269248+0000', 'last_change': '2024-09-12T12:17:04.269248+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.269248+0000', 'last_undegraded': '2024-09-12T12:17:04.269248+0000', 'last_fullsized': '2024-09-12T12:17:04.269248+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-09-12T12:17:10.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.263364+0000', 'last_change': '2024-09-12T12:17:04.263364+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.263364+0000', 'last_undegraded': '2024-09-12T12:17:04.263364+0000', 'last_fullsized': '2024-09-12T12:17:04.263364+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.269595+0000', 'last_change': '2024-09-12T12:17:04.269595+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.269595+0000', 'last_undegraded': '2024-09-12T12:17:04.269595+0000', 'last_fullsized': '2024-09-12T12:17:04.269595+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3 is not active+clean 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.265785+0000', 'last_change': '2024-09-12T12:17:04.265785+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.265785+0000', 'last_undegraded': '2024-09-12T12:17:04.265785+0000', 'last_fullsized': '2024-09-12T12:17:04.265785+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.263851+0000', 'last_change': '2024-09-12T12:17:04.263851+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.263851+0000', 'last_undegraded': '2024-09-12T12:17:04.263851+0000', 'last_fullsized': '2024-09-12T12:17:04.263851+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.263409+0000', 'last_change': '2024-09-12T12:17:04.263409+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.263409+0000', 'last_undegraded': '2024-09-12T12:17:04.263409+0000', 'last_fullsized': '2024-09-12T12:17:04.263409+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:PG 12.6 is not active+clean 2024-09-12T12:17:10.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.264233+0000', 'last_change': '2024-09-12T12:17:04.264233+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.264233+0000', 'last_undegraded': '2024-09-12T12:17:04.264233+0000', 'last_fullsized': '2024-09-12T12:17:04.264233+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:17:10.141 INFO:tasks.ceph.ceph_manager.ceph:PG 12.7 is not active+clean 2024-09-12T12:17:10.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.263965+0000', 'last_change': '2024-09-12T12:17:04.263965+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.263965+0000', 'last_undegraded': '2024-09-12T12:17:04.263965+0000', 'last_fullsized': '2024-09-12T12:17:04.263965+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T12:17:10.141 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-12T12:17:10.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:17:04.271421+0000', 'last_change': '2024-09-12T12:17:04.271421+0000', 'last_active': '2024-09-12T12:17:04.252123+0000', 'last_peered': '2024-09-12T12:17:04.252123+0000', 'last_clean': '2024-09-12T12:17:04.252123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:17:04.271421+0000', 'last_undegraded': '2024-09-12T12:17:04.271421+0000', 'last_fullsized': '2024-09-12T12:17:04.271421+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'last_clean_scrub_stamp': '2024-09-12T12:17:04.252123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T12:17:10.141 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:17:10.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.302+0000 7fa4e5a00640 1 Processor -- start 2024-09-12T12:17:10.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.302+0000 7fa4e5a00640 1 -- start start 2024-09-12T12:17:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4e5a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4e015b2c0 0x7fa4e00b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4e5a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e006e180 0x7fa4e006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4e5a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4e006ead0 con 0x7fa4e00b3500 2024-09-12T12:17:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4e5a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e00ccec0 con 0x7fa4e015b2c0 2024-09-12T12:17:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4e5a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e00cd1a0 con 0x7fa4e006e180 2024-09-12T12:17:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4dea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4e015b2c0 0x7fa4e00b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4dea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4e015b2c0 0x7fa4e00b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41656/0 (socket says 172.21.15.144:41656) 2024-09-12T12:17:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4dea00640 1 -- 172.21.15.144:0/4256332832 learned_addr learned my addr 172.21.15.144:0/4256332832 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4de000640 1 --1- 172.21.15.144:0/4256332832 >> v1:172.21.15.144:6789/0 conn(0x7fa4e00b3500 0x7fa4e015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44858/0 (socket says 172.21.15.144:44858) 2024-09-12T12:17:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4df400640 1 --2- 172.21.15.144:0/4256332832 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e006e180 0x7fa4e006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4dea00640 1 -- 172.21.15.144:0/4256332832 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e006e180 msgr2=0x7fa4e006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4dea00640 1 --2- 172.21.15.144:0/4256332832 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e006e180 0x7fa4e006e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4dea00640 1 -- 172.21.15.144:0/4256332832 >> v1:172.21.15.144:6789/0 conn(0x7fa4e00b3500 legacy=0x7fa4e015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4dea00640 1 -- 172.21.15.144:0/4256332832 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e00cd480 con 0x7fa4e015b2c0 2024-09-12T12:17:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.306+0000 7fa4dd600640 1 -- 172.21.15.144:0/4256332832 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784881598 0 0) 0x7fa4cc001120 con 0x7fa4e00b3500 2024-09-12T12:17:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4dea00640 1 --2- 172.21.15.144:0/4256332832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e015b2c0 0x7fa4e00b43d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000bb10 tx=0x7fa4d001ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d9f727e47eb8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4dd600640 1 -- 172.21.15.144:0/4256332832 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00b4070 con 0x7fa4e015b2c0 2024-09-12T12:17:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4dd600640 1 -- 172.21.15.144:0/4256332832 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d00a7cd0 con 0x7fa4e015b2c0 2024-09-12T12:17:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4dd600640 1 -- 172.21.15.144:0/4256332832 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00af660 con 0x7fa4e015b2c0 2024-09-12T12:17:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 -- 172.21.15.144:0/4256332832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e015b2c0 msgr2=0x7fa4e00b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 --2- 172.21.15.144:0/4256332832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e015b2c0 0x7fa4e00b43d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000bb10 tx=0x7fa4d001ec00 comp rx=0 tx=0).stop 2024-09-12T12:17:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 -- 172.21.15.144:0/4256332832 shutdown_connections 2024-09-12T12:17:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 --2- 172.21.15.144:0/4256332832 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e006e180 0x7fa4e006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 --2- 172.21.15.144:0/4256332832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e015b2c0 0x7fa4e00b43d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 -- 172.21.15.144:0/4256332832 >> 172.21.15.144:0/4256332832 conn(0x7fa4e0067e00 msgr2=0x7fa4e00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 -- 172.21.15.144:0/4256332832 shutdown_connections 2024-09-12T12:17:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 -- 172.21.15.144:0/4256332832 wait complete. 2024-09-12T12:17:10.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 Processor -- start 2024-09-12T12:17:10.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 -- start start 2024-09-12T12:17:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e006e180 0x7fa4e0150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e00b3500 0x7fa4e015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e015b2c0 0x7fa4e01597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00ce8f0 con 0x7fa4e006e180 2024-09-12T12:17:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00ce770 con 0x7fa4e00b3500 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4e5a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e00cea70 con 0x7fa4e015b2c0 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e006e180 0x7fa4e0150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e006e180 0x7fa4e0150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41662/0 (socket says 172.21.15.144:41662) 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.310+0000 7fa4dea00640 1 -- 172.21.15.144:0/3347021641 learned_addr learned my addr 172.21.15.144:0/3347021641 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4de000640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e00b3500 0x7fa4e015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4df400640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e015b2c0 0x7fa4e01597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4dea00640 1 -- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e015b2c0 msgr2=0x7fa4e01597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4dea00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e015b2c0 0x7fa4e01597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4dea00640 1 -- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e00b3500 msgr2=0x7fa4e015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4dea00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e00b3500 0x7fa4e015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4dea00640 1 -- 172.21.15.144:0/3347021641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e0151e20 con 0x7fa4e006e180 2024-09-12T12:17:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4de000640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e00b3500 0x7fa4e015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4df400640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e015b2c0 0x7fa4e01597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4dea00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e006e180 0x7fa4e0150cd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000b2c0 tx=0x7fa4d001b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4d6a00640 1 -- 172.21.15.144:0/3347021641 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00b4030 con 0x7fa4e006e180 2024-09-12T12:17:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4d6a00640 1 -- 172.21.15.144:0/3347021641 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d00b6070 con 0x7fa4e006e180 2024-09-12T12:17:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e015c080 con 0x7fa4e006e180 2024-09-12T12:17:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4d6a00640 1 -- 172.21.15.144:0/3347021641 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00ad550 con 0x7fa4e006e180 2024-09-12T12:17:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e0151210 con 0x7fa4e006e180 2024-09-12T12:17:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e006e590 con 0x7fa4e006e180 2024-09-12T12:17:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4d6a00640 1 -- 172.21.15.144:0/3347021641 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4d00c1060 con 0x7fa4e006e180 2024-09-12T12:17:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4d6a00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c00678c0 0x7fa4c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.314+0000 7fa4d6a00640 1 -- 172.21.15.144:0/3347021641 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fa4d0120300 con 0x7fa4e006e180 2024-09-12T12:17:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.318+0000 7fa4de000640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c00678c0 0x7fa4c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.318+0000 7fa4de000640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c00678c0 0x7fa4c0069d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00b2de0 tx=0x7fa4cc007a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.322+0000 7fa4d6a00640 1 -- 172.21.15.144:0/3347021641 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4d0018820 con 0x7fa4e006e180 2024-09-12T12:17:10.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.534+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa4e015c530 con 0x7fa4e006e180 2024-09-12T12:17:10.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4d6a00640 1 -- 172.21.15.144:0/3347021641 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1496 (secure 0 0 0) 0x7fa4d00f0ca0 con 0x7fa4e006e180 2024-09-12T12:17:10.540 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:10.540 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":290,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":83,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":307150848,"bytes_avail":772786962432,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":54,"btime":"2024-09-12T12:17:08:287906+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6690}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-12T12:16:37.424552+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:17:10.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c00678c0 msgr2=0x7fa4c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c00678c0 0x7fa4c0069d80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00b2de0 tx=0x7fa4cc007a20 comp rx=0 tx=0).stop 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e006e180 msgr2=0x7fa4e0150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e006e180 0x7fa4e0150cd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000b2c0 tx=0x7fa4d001b9a0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 shutdown_connections 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c00678c0 0x7fa4c0069d80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e015b2c0 0x7fa4e01597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e00b3500 0x7fa4e015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 --2- 172.21.15.144:0/3347021641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e006e180 0x7fa4e0150cd0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 >> 172.21.15.144:0/3347021641 conn(0x7fa4e0067e00 msgr2=0x7fa4e0165440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 shutdown_connections 2024-09-12T12:17:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.538+0000 7fa4e5a00640 1 -- 172.21.15.144:0/3347021641 wait complete. 2024-09-12T12:17:10.560 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T12:17:10.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:17:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.694+0000 7f232fc00640 1 Processor -- start 2024-09-12T12:17:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.694+0000 7f232fc00640 1 -- start start 2024-09-12T12:17:10.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f232fc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2328071420 0x7f2328071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f232fc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280b45a0 con 0x7f232815b4e0 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f232fc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280b3fe0 con 0x7f23280ccf30 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f232fc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f23280b42c0 con 0x7f2328071420 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f232d200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f232815b4e0 0x7f23280b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44870/0 (socket says 172.21.15.144:44870) 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f232d200640 1 -- 172.21.15.144:0/2241653522 learned_addr learned my addr 172.21.15.144:0/2241653522 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f2327e00640 1 --2- 172.21.15.144:0/2241653522 >> v2:172.21.15.165:3300/0 conn(0x7f2328071420 0x7f2328071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f2327400640 1 -- 172.21.15.144:0/2241653522 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283277385 0 0) 0x7f23280b45a0 con 0x7f232815b4e0 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f2327400640 1 -- 172.21.15.144:0/2241653522 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f230c003530 con 0x7f232815b4e0 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f2327e00640 1 -- 172.21.15.144:0/2241653522 >> v1:172.21.15.165:6789/0 conn(0x7f23280ccf30 legacy=0x7f23280cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f2327e00640 1 -- 172.21.15.144:0/2241653522 >> v1:172.21.15.144:6789/0 conn(0x7f232815b4e0 legacy=0x7f23280b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.698+0000 7f2327e00640 1 -- 172.21.15.144:0/2241653522 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23280b1490 con 0x7f2328071420 2024-09-12T12:17:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f2327e00640 1 --2- 172.21.15.144:0/2241653522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2328071420 0x7f2328071840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f23140097c0 tx=0x7f231401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e72b6c5b8b03e435 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f2327400640 1 -- 172.21.15.144:0/2241653522 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140ab600 con 0x7f2328071420 2024-09-12T12:17:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f2327400640 1 -- 172.21.15.144:0/2241653522 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23140b0070 con 0x7f2328071420 2024-09-12T12:17:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f2327400640 1 -- 172.21.15.144:0/2241653522 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140ab9c0 con 0x7f2328071420 2024-09-12T12:17:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 -- 172.21.15.144:0/2241653522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2328071420 msgr2=0x7f2328071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 --2- 172.21.15.144:0/2241653522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2328071420 0x7f2328071840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f23140097c0 tx=0x7f231401c470 comp rx=0 tx=0).stop 2024-09-12T12:17:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 -- 172.21.15.144:0/2241653522 shutdown_connections 2024-09-12T12:17:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 --2- 172.21.15.144:0/2241653522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2328071420 0x7f2328071840 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 -- 172.21.15.144:0/2241653522 >> 172.21.15.144:0/2241653522 conn(0x7f232806d0d0 msgr2=0x7f232806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 -- 172.21.15.144:0/2241653522 shutdown_connections 2024-09-12T12:17:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 -- 172.21.15.144:0/2241653522 wait complete. 2024-09-12T12:17:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 Processor -- start 2024-09-12T12:17:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 -- start start 2024-09-12T12:17:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2328071420 0x7f232814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23280ccf30 0x7f232815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f232815b4e0 0x7f2328071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f232815b8c0 con 0x7f23280ccf30 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2328169270 con 0x7f232815b4e0 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.702+0000 7f232fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2328159880 con 0x7f2328071420 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2327e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23280ccf30 0x7f232815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2327e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23280ccf30 0x7f232815c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41670/0 (socket says 172.21.15.144:41670) 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2327e00640 1 -- 172.21.15.144:0/2591602753 learned_addr learned my addr 172.21.15.144:0/2591602753 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f232d200640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2328071420 0x7f232814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f232dc00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f232815b4e0 0x7f2328071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2327e00640 1 -- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2328071420 msgr2=0x7f232814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2327e00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2328071420 0x7f232814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2327e00640 1 -- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f232815b4e0 msgr2=0x7f2328071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2327e00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f232815b4e0 0x7f2328071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2327e00640 1 -- 172.21.15.144:0/2591602753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232815cfc0 con 0x7f23280ccf30 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f232dc00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f232815b4e0 0x7f2328071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:10.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f232d200640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2328071420 0x7f232814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2327e00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23280ccf30 0x7f232815c5e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2314019080 tx=0x7f231401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2324c00640 1 -- 172.21.15.144:0/2591602753 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140bf610 con 0x7f23280ccf30 2024-09-12T12:17:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2324c00640 1 -- 172.21.15.144:0/2591602753 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23140bf7d0 con 0x7f23280ccf30 2024-09-12T12:17:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232815d2a0 con 0x7f23280ccf30 2024-09-12T12:17:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2324c00640 1 -- 172.21.15.144:0/2591602753 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140bfbc0 con 0x7f23280ccf30 2024-09-12T12:17:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23280ce3e0 con 0x7f23280ccf30 2024-09-12T12:17:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2328159a00 con 0x7f23280ccf30 2024-09-12T12:17:10.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.706+0000 7f2324c00640 1 -- 172.21.15.144:0/2591602753 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23140bd020 con 0x7f23280ccf30 2024-09-12T12:17:10.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.710+0000 7f2324c00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23080678f0 0x7f2308069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:10.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.710+0000 7f2324c00640 1 -- 172.21.15.144:0/2591602753 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f23141206e0 con 0x7f23280ccf30 2024-09-12T12:17:10.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.710+0000 7f232d200640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23080678f0 0x7f2308069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:10.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.710+0000 7f232d200640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23080678f0 0x7f2308069db0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2318001570 tx=0x7f2318009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:10.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.714+0000 7f2324c00640 1 -- 172.21.15.144:0/2591602753 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f23140c4060 con 0x7f23280ccf30 2024-09-12T12:17:10.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.870+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2328071840 con 0x7f23080678f0 2024-09-12T12:17:10.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.874+0000 7f2324c00640 1 -- 172.21.15.144:0/2591602753 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246753 (secure 0 0 0) 0x7f2328071840 con 0x7f23080678f0 2024-09-12T12:17:10.880 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:10.881 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:17:10.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23080678f0 msgr2=0x7f2308069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23080678f0 0x7f2308069db0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2318001570 tx=0x7f2318009040 comp rx=0 tx=0).stop 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23280ccf30 msgr2=0x7f232815c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23280ccf30 0x7f232815c5e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2314019080 tx=0x7f231401acb0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 shutdown_connections 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23080678f0 0x7f2308069db0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f232815b4e0 0x7f2328071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23280ccf30 0x7f232815c5e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 --2- 172.21.15.144:0/2591602753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2328071420 0x7f232814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 >> 172.21.15.144:0/2591602753 conn(0x7f232806d0d0 msgr2=0x7f2328073690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 shutdown_connections 2024-09-12T12:17:10.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:10.878+0000 7f232fc00640 1 -- 172.21.15.144:0/2591602753 wait complete. 2024-09-12T12:17:10.895 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-12T12:17:10.890+0000 7fb02e000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:17:10.901 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-12T12:17:09.430898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299952,"kb_used_data":8820,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754674768,"statfs":{"total":773094113280,"available":772786962432,"internally_reserved":0,"allocated":9031680,"data_stored":4775403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000952"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270944+0000","last_change":"2024-09-12T12:17:04.270944+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270944+0000","last_undegraded":"2024-09-12T12:17:04.270944+0000","last_fullsized":"2024-09-12T12:17:04.270944+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269037+0000","last_change":"2024-09-12T12:17:04.269037+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269037+0000","last_undegraded":"2024-09-12T12:17:04.269037+0000","last_fullsized":"2024-09-12T12:17:04.269037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267732+0000","last_change":"2024-09-12T12:17:04.267732+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267732+0000","last_undegraded":"2024-09-12T12:17:04.267732+0000","last_fullsized":"2024-09-12T12:17:04.267732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265910+0000","last_change":"2024-09-12T12:17:04.265910+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265910+0000","last_undegraded":"2024-09-12T12:17:04.265910+0000","last_fullsized":"2024-09-12T12:17:04.265910+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271660+0000","last_change":"2024-09-12T12:17:04.271660+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271660+0000","last_undegraded":"2024-09-12T12:17:04.271660+0000","last_fullsized":"2024-09-12T12:17:04.271660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.274579+0000","last_change":"2024-09-12T12:17:04.274579+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.274579+0000","last_undegraded":"2024-09-12T12:17:04.274579+0000","last_fullsized":"2024-09-12T12:17:04.274579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264072+0000","last_change":"2024-09-12T12:17:04.264072+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264072+0000","last_undegraded":"2024-09-12T12:17:04.264072+0000","last_fullsized":"2024-09-12T12:17:04.264072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270786+0000","last_change":"2024-09-12T12:17:04.270786+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270786+0000","last_undegraded":"2024-09-12T12:17:04.270786+0000","last_fullsized":"2024-09-12T12:17:04.270786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271631+0000","last_change":"2024-09-12T12:17:04.271631+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271631+0000","last_undegraded":"2024-09-12T12:17:04.271631+0000","last_fullsized":"2024-09-12T12:17:04.271631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267055+0000","last_change":"2024-09-12T12:17:04.267055+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267055+0000","last_undegraded":"2024-09-12T12:17:04.267055+0000","last_fullsized":"2024-09-12T12:17:04.267055+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268623+0000","last_change":"2024-09-12T12:17:04.268623+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268623+0000","last_undegraded":"2024-09-12T12:17:04.268623+0000","last_fullsized":"2024-09-12T12:17:04.268623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265515+0000","last_change":"2024-09-12T12:17:04.265515+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265515+0000","last_undegraded":"2024-09-12T12:17:04.265515+0000","last_fullsized":"2024-09-12T12:17:04.265515+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267508+0000","last_change":"2024-09-12T12:17:04.267508+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267508+0000","last_undegraded":"2024-09-12T12:17:04.267508+0000","last_fullsized":"2024-09-12T12:17:04.267508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.274211+0000","last_change":"2024-09-12T12:17:04.274211+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.274211+0000","last_undegraded":"2024-09-12T12:17:04.274211+0000","last_fullsized":"2024-09-12T12:17:04.274211+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268541+0000","last_change":"2024-09-12T12:17:04.268541+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268541+0000","last_undegraded":"2024-09-12T12:17:04.268541+0000","last_fullsized":"2024-09-12T12:17:04.268541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271563+0000","last_change":"2024-09-12T12:17:04.271563+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271563+0000","last_undegraded":"2024-09-12T12:17:04.271563+0000","last_fullsized":"2024-09-12T12:17:04.271563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.272248+0000","last_change":"2024-09-12T12:17:04.272248+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.272248+0000","last_undegraded":"2024-09-12T12:17:04.272248+0000","last_fullsized":"2024-09-12T12:17:04.272248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270331+0000","last_change":"2024-09-12T12:17:04.270331+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270331+0000","last_undegraded":"2024-09-12T12:17:04.270331+0000","last_fullsized":"2024-09-12T12:17:04.270331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.273226+0000","last_change":"2024-09-12T12:17:04.273226+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.273226+0000","last_undegraded":"2024-09-12T12:17:04.273226+0000","last_fullsized":"2024-09-12T12:17:04.273226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267656+0000","last_change":"2024-09-12T12:17:04.267656+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267656+0000","last_undegraded":"2024-09-12T12:17:04.267656+0000","last_fullsized":"2024-09-12T12:17:04.267656+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271080+0000","last_change":"2024-09-12T12:17:04.271080+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271080+0000","last_undegraded":"2024-09-12T12:17:04.271080+0000","last_fullsized":"2024-09-12T12:17:04.271080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265488+0000","last_change":"2024-09-12T12:17:04.265488+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265488+0000","last_undegraded":"2024-09-12T12:17:04.265488+0000","last_fullsized":"2024-09-12T12:17:04.265488+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269304+0000","last_change":"2024-09-12T12:17:04.269304+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269304+0000","last_undegraded":"2024-09-12T12:17:04.269304+0000","last_fullsized":"2024-09-12T12:17:04.269304+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268532+0000","last_change":"2024-09-12T12:17:04.268532+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268532+0000","last_undegraded":"2024-09-12T12:17:04.268532+0000","last_fullsized":"2024-09-12T12:17:04.268532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268366+0000","last_change":"2024-09-12T12:17:04.268366+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268366+0000","last_undegraded":"2024-09-12T12:17:04.268366+0000","last_fullsized":"2024-09-12T12:17:04.268366+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266565+0000","last_change":"2024-09-12T12:17:04.266565+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266565+0000","last_undegraded":"2024-09-12T12:17:04.266565+0000","last_fullsized":"2024-09-12T12:17:04.266565+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271881+0000","last_change":"2024-09-12T12:17:04.271881+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271881+0000","last_undegraded":"2024-09-12T12:17:04.271881+0000","last_fullsized":"2024-09-12T12:17:04.271881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266435+0000","last_change":"2024-09-12T12:17:04.266435+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266435+0000","last_undegraded":"2024-09-12T12:17:04.266435+0000","last_fullsized":"2024-09-12T12:17:04.266435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268086+0000","last_change":"2024-09-12T12:17:04.268086+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268086+0000","last_undegraded":"2024-09-12T12:17:04.268086+0000","last_fullsized":"2024-09-12T12:17:04.268086+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269588+0000","last_change":"2024-09-12T12:17:04.269588+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269588+0000","last_undegraded":"2024-09-12T12:17:04.269588+0000","last_fullsized":"2024-09-12T12:17:04.269588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265279+0000","last_change":"2024-09-12T12:17:04.265279+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265279+0000","last_undegraded":"2024-09-12T12:17:04.265279+0000","last_fullsized":"2024-09-12T12:17:04.265279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269509+0000","last_change":"2024-09-12T12:17:04.269509+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269509+0000","last_undegraded":"2024-09-12T12:17:04.269509+0000","last_fullsized":"2024-09-12T12:17:04.269509+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264435+0000","last_change":"2024-09-12T12:17:04.264435+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264435+0000","last_undegraded":"2024-09-12T12:17:04.264435+0000","last_fullsized":"2024-09-12T12:17:04.264435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.292579+0000","last_change":"2024-09-12T12:17:04.288167+0000","last_active":"2024-09-12T12:17:04.292579+0000","last_peered":"2024-09-12T12:17:04.292579+0000","last_clean":"2024-09-12T12:17:04.292579+0000","last_became_active":"2024-09-12T12:17:04.287954+0000","last_became_peered":"2024-09-12T12:17:04.287954+0000","last_unstale":"2024-09-12T12:17:04.292579+0000","last_undegraded":"2024-09-12T12:17:04.292579+0000","last_fullsized":"2024-09-12T12:17:04.292579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:10:23.643450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267493+0000","last_change":"2024-09-12T12:17:04.267493+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267493+0000","last_undegraded":"2024-09-12T12:17:04.267493+0000","last_fullsized":"2024-09-12T12:17:04.267493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285040+0000","last_change":"2024-09-12T12:17:04.282927+0000","last_active":"2024-09-12T12:17:04.285040+0000","last_peered":"2024-09-12T12:17:04.285040+0000","last_clean":"2024-09-12T12:17:04.285040+0000","last_became_active":"2024-09-12T12:17:04.282682+0000","last_became_peered":"2024-09-12T12:17:04.282682+0000","last_unstale":"2024-09-12T12:17:04.285040+0000","last_undegraded":"2024-09-12T12:17:04.285040+0000","last_fullsized":"2024-09-12T12:17:04.285040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:17.101878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270032+0000","last_change":"2024-09-12T12:17:04.270032+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270032+0000","last_undegraded":"2024-09-12T12:17:04.270032+0000","last_fullsized":"2024-09-12T12:17:04.270032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286122+0000","last_change":"2024-09-12T12:17:04.284408+0000","last_active":"2024-09-12T12:17:04.286122+0000","last_peered":"2024-09-12T12:17:04.286122+0000","last_clean":"2024-09-12T12:17:04.286122+0000","last_became_active":"2024-09-12T12:17:04.284110+0000","last_became_peered":"2024-09-12T12:17:04.284110+0000","last_unstale":"2024-09-12T12:17:04.286122+0000","last_undegraded":"2024-09-12T12:17:04.286122+0000","last_fullsized":"2024-09-12T12:17:04.286122+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:13.958415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.270686+0000","last_change":"2024-09-12T12:17:04.270686+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.270686+0000","last_undegraded":"2024-09-12T12:17:04.270686+0000","last_fullsized":"2024-09-12T12:17:04.270686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282775+0000","last_change":"2024-09-12T12:17:04.282018+0000","last_active":"2024-09-12T12:17:04.282775+0000","last_peered":"2024-09-12T12:17:04.282775+0000","last_clean":"2024-09-12T12:17:04.282775+0000","last_became_active":"2024-09-12T12:17:04.281347+0000","last_became_peered":"2024-09-12T12:17:04.281347+0000","last_unstale":"2024-09-12T12:17:04.282775+0000","last_undegraded":"2024-09-12T12:17:04.282775+0000","last_fullsized":"2024-09-12T12:17:04.282775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:16.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.268510+0000","last_change":"2024-09-12T12:17:04.268510+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.268510+0000","last_undegraded":"2024-09-12T12:17:04.268510+0000","last_fullsized":"2024-09-12T12:17:04.268510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281044+0000","last_change":"2024-09-12T12:17:04.277749+0000","last_active":"2024-09-12T12:17:04.281044+0000","last_peered":"2024-09-12T12:17:04.281044+0000","last_clean":"2024-09-12T12:17:04.281044+0000","last_became_active":"2024-09-12T12:17:04.277421+0000","last_became_peered":"2024-09-12T12:17:04.277421+0000","last_unstale":"2024-09-12T12:17:04.281044+0000","last_undegraded":"2024-09-12T12:17:04.281044+0000","last_fullsized":"2024-09-12T12:17:04.281044+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:52.140000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267996+0000","last_change":"2024-09-12T12:17:04.267996+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267996+0000","last_undegraded":"2024-09-12T12:17:04.267996+0000","last_fullsized":"2024-09-12T12:17:04.267996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286487+0000","last_change":"2024-09-12T12:17:04.285386+0000","last_active":"2024-09-12T12:17:04.286487+0000","last_peered":"2024-09-12T12:17:04.286487+0000","last_clean":"2024-09-12T12:17:04.286487+0000","last_became_active":"2024-09-12T12:17:04.284833+0000","last_became_peered":"2024-09-12T12:17:04.284833+0000","last_unstale":"2024-09-12T12:17:04.286487+0000","last_undegraded":"2024-09-12T12:17:04.286487+0000","last_fullsized":"2024-09-12T12:17:04.286487+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:04.643981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271974+0000","last_change":"2024-09-12T12:17:04.271974+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271974+0000","last_undegraded":"2024-09-12T12:17:04.271974+0000","last_fullsized":"2024-09-12T12:17:04.271974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281925+0000","last_change":"2024-09-12T12:17:04.278438+0000","last_active":"2024-09-12T12:17:04.281925+0000","last_peered":"2024-09-12T12:17:04.281925+0000","last_clean":"2024-09-12T12:17:04.281925+0000","last_became_active":"2024-09-12T12:17:04.277977+0000","last_became_peered":"2024-09-12T12:17:04.277977+0000","last_unstale":"2024-09-12T12:17:04.281925+0000","last_undegraded":"2024-09-12T12:17:04.281925+0000","last_fullsized":"2024-09-12T12:17:04.281925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:25.066020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265443+0000","last_change":"2024-09-12T12:17:04.265443+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265443+0000","last_undegraded":"2024-09-12T12:17:04.265443+0000","last_fullsized":"2024-09-12T12:17:04.265443+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282523+0000","last_change":"2024-09-12T12:17:04.277306+0000","last_active":"2024-09-12T12:17:04.282523+0000","last_peered":"2024-09-12T12:17:04.282523+0000","last_clean":"2024-09-12T12:17:04.282523+0000","last_became_active":"2024-09-12T12:17:04.276970+0000","last_became_peered":"2024-09-12T12:17:04.276970+0000","last_unstale":"2024-09-12T12:17:04.282523+0000","last_undegraded":"2024-09-12T12:17:04.282523+0000","last_fullsized":"2024-09-12T12:17:04.282523+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:00.660785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267607+0000","last_change":"2024-09-12T12:17:04.267607+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267607+0000","last_undegraded":"2024-09-12T12:17:04.267607+0000","last_fullsized":"2024-09-12T12:17:04.267607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285712+0000","last_change":"2024-09-12T12:17:04.283614+0000","last_active":"2024-09-12T12:17:04.285712+0000","last_peered":"2024-09-12T12:17:04.285712+0000","last_clean":"2024-09-12T12:17:04.285712+0000","last_became_active":"2024-09-12T12:17:04.283363+0000","last_became_peered":"2024-09-12T12:17:04.283363+0000","last_unstale":"2024-09-12T12:17:04.285712+0000","last_undegraded":"2024-09-12T12:17:04.285712+0000","last_fullsized":"2024-09-12T12:17:04.285712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:52.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265028+0000","last_change":"2024-09-12T12:17:04.265028+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265028+0000","last_undegraded":"2024-09-12T12:17:04.265028+0000","last_fullsized":"2024-09-12T12:17:04.265028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281862+0000","last_change":"2024-09-12T12:17:04.278522+0000","last_active":"2024-09-12T12:17:04.281862+0000","last_peered":"2024-09-12T12:17:04.281862+0000","last_clean":"2024-09-12T12:17:04.281862+0000","last_became_active":"2024-09-12T12:17:04.278250+0000","last_became_peered":"2024-09-12T12:17:04.278250+0000","last_unstale":"2024-09-12T12:17:04.281862+0000","last_undegraded":"2024-09-12T12:17:04.281862+0000","last_fullsized":"2024-09-12T12:17:04.281862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:52.862397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.273845+0000","last_change":"2024-09-12T12:17:04.273845+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.273845+0000","last_undegraded":"2024-09-12T12:17:04.273845+0000","last_fullsized":"2024-09-12T12:17:04.273845+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.290142+0000","last_change":"2024-09-12T12:17:04.286746+0000","last_active":"2024-09-12T12:17:04.290142+0000","last_peered":"2024-09-12T12:17:04.290142+0000","last_clean":"2024-09-12T12:17:04.290142+0000","last_became_active":"2024-09-12T12:17:04.286451+0000","last_became_peered":"2024-09-12T12:17:04.286451+0000","last_unstale":"2024-09-12T12:17:04.290142+0000","last_undegraded":"2024-09-12T12:17:04.290142+0000","last_fullsized":"2024-09-12T12:17:04.290142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:20.810734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264005+0000","last_change":"2024-09-12T12:17:04.264005+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264005+0000","last_undegraded":"2024-09-12T12:17:04.264005+0000","last_fullsized":"2024-09-12T12:17:04.264005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281921+0000","last_change":"2024-09-12T12:17:04.278410+0000","last_active":"2024-09-12T12:17:04.281921+0000","last_peered":"2024-09-12T12:17:04.281921+0000","last_clean":"2024-09-12T12:17:04.281921+0000","last_became_active":"2024-09-12T12:17:04.278156+0000","last_became_peered":"2024-09-12T12:17:04.278156+0000","last_unstale":"2024-09-12T12:17:04.281921+0000","last_undegraded":"2024-09-12T12:17:04.281921+0000","last_fullsized":"2024-09-12T12:17:04.281921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:33.363338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265068+0000","last_change":"2024-09-12T12:17:04.265068+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265068+0000","last_undegraded":"2024-09-12T12:17:04.265068+0000","last_fullsized":"2024-09-12T12:17:04.265068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.280803+0000","last_change":"2024-09-12T12:17:04.275009+0000","last_active":"2024-09-12T12:17:04.280803+0000","last_peered":"2024-09-12T12:17:04.280803+0000","last_clean":"2024-09-12T12:17:04.280803+0000","last_became_active":"2024-09-12T12:17:04.274726+0000","last_became_peered":"2024-09-12T12:17:04.274726+0000","last_unstale":"2024-09-12T12:17:04.280803+0000","last_undegraded":"2024-09-12T12:17:04.280803+0000","last_fullsized":"2024-09-12T12:17:04.280803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:03.544531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265791+0000","last_change":"2024-09-12T12:17:04.265791+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265791+0000","last_undegraded":"2024-09-12T12:17:04.265791+0000","last_fullsized":"2024-09-12T12:17:04.265791+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287300+0000","last_change":"2024-09-12T12:17:04.286442+0000","last_active":"2024-09-12T12:17:04.287300+0000","last_peered":"2024-09-12T12:17:04.287300+0000","last_clean":"2024-09-12T12:17:04.287300+0000","last_became_active":"2024-09-12T12:17:04.286168+0000","last_became_peered":"2024-09-12T12:17:04.286168+0000","last_unstale":"2024-09-12T12:17:04.287300+0000","last_undegraded":"2024-09-12T12:17:04.287300+0000","last_fullsized":"2024-09-12T12:17:04.287300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:16.524611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264470+0000","last_change":"2024-09-12T12:17:04.264470+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264470+0000","last_undegraded":"2024-09-12T12:17:04.264470+0000","last_fullsized":"2024-09-12T12:17:04.264470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.288883+0000","last_change":"2024-09-12T12:17:04.283991+0000","last_active":"2024-09-12T12:17:04.288883+0000","last_peered":"2024-09-12T12:17:04.288883+0000","last_clean":"2024-09-12T12:17:04.288883+0000","last_became_active":"2024-09-12T12:17:04.283694+0000","last_became_peered":"2024-09-12T12:17:04.283694+0000","last_unstale":"2024-09-12T12:17:04.288883+0000","last_undegraded":"2024-09-12T12:17:04.288883+0000","last_fullsized":"2024-09-12T12:17:04.288883+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:25.373252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265035+0000","last_change":"2024-09-12T12:17:04.265035+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265035+0000","last_undegraded":"2024-09-12T12:17:04.265035+0000","last_fullsized":"2024-09-12T12:17:04.265035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.276490+0000","last_change":"2024-09-12T12:17:04.275540+0000","last_active":"2024-09-12T12:17:04.276490+0000","last_peered":"2024-09-12T12:17:04.276490+0000","last_clean":"2024-09-12T12:17:04.276490+0000","last_became_active":"2024-09-12T12:17:04.275188+0000","last_became_peered":"2024-09-12T12:17:04.275188+0000","last_unstale":"2024-09-12T12:17:04.276490+0000","last_undegraded":"2024-09-12T12:17:04.276490+0000","last_fullsized":"2024-09-12T12:17:04.276490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:39.663729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266674+0000","last_change":"2024-09-12T12:17:04.266674+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266674+0000","last_undegraded":"2024-09-12T12:17:04.266674+0000","last_fullsized":"2024-09-12T12:17:04.266674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285690+0000","last_change":"2024-09-12T12:17:04.282311+0000","last_active":"2024-09-12T12:17:04.285690+0000","last_peered":"2024-09-12T12:17:04.285690+0000","last_clean":"2024-09-12T12:17:04.285690+0000","last_became_active":"2024-09-12T12:17:04.282043+0000","last_became_peered":"2024-09-12T12:17:04.282043+0000","last_unstale":"2024-09-12T12:17:04.285690+0000","last_undegraded":"2024-09-12T12:17:04.285690+0000","last_fullsized":"2024-09-12T12:17:04.285690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:39.663729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264821+0000","last_change":"2024-09-12T12:17:04.264821+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264821+0000","last_undegraded":"2024-09-12T12:17:04.264821+0000","last_fullsized":"2024-09-12T12:17:04.264821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282226+0000","last_change":"2024-09-12T12:17:04.281271+0000","last_active":"2024-09-12T12:17:04.282226+0000","last_peered":"2024-09-12T12:17:04.282226+0000","last_clean":"2024-09-12T12:17:04.282226+0000","last_became_active":"2024-09-12T12:17:04.280997+0000","last_became_peered":"2024-09-12T12:17:04.280997+0000","last_unstale":"2024-09-12T12:17:04.282226+0000","last_undegraded":"2024-09-12T12:17:04.282226+0000","last_fullsized":"2024-09-12T12:17:04.282226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:00.696318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265890+0000","last_change":"2024-09-12T12:17:04.265890+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265890+0000","last_undegraded":"2024-09-12T12:17:04.265890+0000","last_fullsized":"2024-09-12T12:17:04.265890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.285121+0000","last_change":"2024-09-12T12:17:04.278980+0000","last_active":"2024-09-12T12:17:04.285121+0000","last_peered":"2024-09-12T12:17:04.285121+0000","last_clean":"2024-09-12T12:17:04.285121+0000","last_became_active":"2024-09-12T12:17:04.278725+0000","last_became_peered":"2024-09-12T12:17:04.278725+0000","last_unstale":"2024-09-12T12:17:04.285121+0000","last_undegraded":"2024-09-12T12:17:04.285121+0000","last_fullsized":"2024-09-12T12:17:04.285121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:15.060762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271885+0000","last_change":"2024-09-12T12:17:04.271885+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271885+0000","last_undegraded":"2024-09-12T12:17:04.271885+0000","last_fullsized":"2024-09-12T12:17:04.271885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282379+0000","last_change":"2024-09-12T12:17:04.277891+0000","last_active":"2024-09-12T12:17:04.282379+0000","last_peered":"2024-09-12T12:17:04.282379+0000","last_clean":"2024-09-12T12:17:04.282379+0000","last_became_active":"2024-09-12T12:17:04.277603+0000","last_became_peered":"2024-09-12T12:17:04.277603+0000","last_unstale":"2024-09-12T12:17:04.282379+0000","last_undegraded":"2024-09-12T12:17:04.282379+0000","last_fullsized":"2024-09-12T12:17:04.282379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:26:16.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.266673+0000","last_change":"2024-09-12T12:17:04.266673+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.266673+0000","last_undegraded":"2024-09-12T12:17:04.266673+0000","last_fullsized":"2024-09-12T12:17:04.266673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286235+0000","last_change":"2024-09-12T12:17:04.283216+0000","last_active":"2024-09-12T12:17:04.286235+0000","last_peered":"2024-09-12T12:17:04.286235+0000","last_clean":"2024-09-12T12:17:04.286235+0000","last_became_active":"2024-09-12T12:17:04.282951+0000","last_became_peered":"2024-09-12T12:17:04.282951+0000","last_unstale":"2024-09-12T12:17:04.286235+0000","last_undegraded":"2024-09-12T12:17:04.286235+0000","last_fullsized":"2024-09-12T12:17:04.286235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:01.267449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.267693+0000","last_change":"2024-09-12T12:17:04.267693+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.267693+0000","last_undegraded":"2024-09-12T12:17:04.267693+0000","last_fullsized":"2024-09-12T12:17:04.267693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.292648+0000","last_change":"2024-09-12T12:17:04.287880+0000","last_active":"2024-09-12T12:17:04.292648+0000","last_peered":"2024-09-12T12:17:04.292648+0000","last_clean":"2024-09-12T12:17:04.292648+0000","last_became_active":"2024-09-12T12:17:04.285568+0000","last_became_peered":"2024-09-12T12:17:04.285568+0000","last_unstale":"2024-09-12T12:17:04.292648+0000","last_undegraded":"2024-09-12T12:17:04.292648+0000","last_fullsized":"2024-09-12T12:17:04.292648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:55.756882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264564+0000","last_change":"2024-09-12T12:17:04.264564+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264564+0000","last_undegraded":"2024-09-12T12:17:04.264564+0000","last_fullsized":"2024-09-12T12:17:04.264564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287352+0000","last_change":"2024-09-12T12:17:04.283598+0000","last_active":"2024-09-12T12:17:04.287352+0000","last_peered":"2024-09-12T12:17:04.287352+0000","last_clean":"2024-09-12T12:17:04.287352+0000","last_became_active":"2024-09-12T12:17:04.283327+0000","last_became_peered":"2024-09-12T12:17:04.283327+0000","last_unstale":"2024-09-12T12:17:04.287352+0000","last_undegraded":"2024-09-12T12:17:04.287352+0000","last_fullsized":"2024-09-12T12:17:04.287352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:22.093367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269248+0000","last_change":"2024-09-12T12:17:04.269248+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269248+0000","last_undegraded":"2024-09-12T12:17:04.269248+0000","last_fullsized":"2024-09-12T12:17:04.269248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.280809+0000","last_change":"2024-09-12T12:17:04.274915+0000","last_active":"2024-09-12T12:17:04.280809+0000","last_peered":"2024-09-12T12:17:04.280809+0000","last_clean":"2024-09-12T12:17:04.280809+0000","last_became_active":"2024-09-12T12:17:04.274601+0000","last_became_peered":"2024-09-12T12:17:04.274601+0000","last_unstale":"2024-09-12T12:17:04.280809+0000","last_undegraded":"2024-09-12T12:17:04.280809+0000","last_fullsized":"2024-09-12T12:17:04.280809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:16.740217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263364+0000","last_change":"2024-09-12T12:17:04.263364+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263364+0000","last_undegraded":"2024-09-12T12:17:04.263364+0000","last_fullsized":"2024-09-12T12:17:04.263364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.284671+0000","last_change":"2024-09-12T12:17:04.281551+0000","last_active":"2024-09-12T12:17:04.284671+0000","last_peered":"2024-09-12T12:17:04.284671+0000","last_clean":"2024-09-12T12:17:04.284671+0000","last_became_active":"2024-09-12T12:17:04.281205+0000","last_became_peered":"2024-09-12T12:17:04.281205+0000","last_unstale":"2024-09-12T12:17:04.284671+0000","last_undegraded":"2024-09-12T12:17:04.284671+0000","last_fullsized":"2024-09-12T12:17:04.284671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:17.101878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.269595+0000","last_change":"2024-09-12T12:17:04.269595+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.269595+0000","last_undegraded":"2024-09-12T12:17:04.269595+0000","last_fullsized":"2024-09-12T12:17:04.269595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.286997+0000","last_change":"2024-09-12T12:17:04.285672+0000","last_active":"2024-09-12T12:17:04.286997+0000","last_peered":"2024-09-12T12:17:04.286997+0000","last_clean":"2024-09-12T12:17:04.286997+0000","last_became_active":"2024-09-12T12:17:04.284212+0000","last_became_peered":"2024-09-12T12:17:04.284212+0000","last_unstale":"2024-09-12T12:17:04.286997+0000","last_undegraded":"2024-09-12T12:17:04.286997+0000","last_fullsized":"2024-09-12T12:17:04.286997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:14.550590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.265785+0000","last_change":"2024-09-12T12:17:04.265785+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.265785+0000","last_undegraded":"2024-09-12T12:17:04.265785+0000","last_fullsized":"2024-09-12T12:17:04.265785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.284940+0000","last_change":"2024-09-12T12:17:04.282760+0000","last_active":"2024-09-12T12:17:04.284940+0000","last_peered":"2024-09-12T12:17:04.284940+0000","last_clean":"2024-09-12T12:17:04.284940+0000","last_became_active":"2024-09-12T12:17:04.282480+0000","last_became_peered":"2024-09-12T12:17:04.282480+0000","last_unstale":"2024-09-12T12:17:04.284940+0000","last_undegraded":"2024-09-12T12:17:04.284940+0000","last_fullsized":"2024-09-12T12:17:04.284940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:25.066020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263851+0000","last_change":"2024-09-12T12:17:04.263851+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263851+0000","last_undegraded":"2024-09-12T12:17:04.263851+0000","last_fullsized":"2024-09-12T12:17:04.263851+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.281725+0000","last_change":"2024-09-12T12:17:04.279763+0000","last_active":"2024-09-12T12:17:04.281725+0000","last_peered":"2024-09-12T12:17:04.281725+0000","last_clean":"2024-09-12T12:17:04.281725+0000","last_became_active":"2024-09-12T12:17:04.279478+0000","last_became_peered":"2024-09-12T12:17:04.279478+0000","last_unstale":"2024-09-12T12:17:04.281725+0000","last_undegraded":"2024-09-12T12:17:04.281725+0000","last_fullsized":"2024-09-12T12:17:04.281725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:25.659264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263409+0000","last_change":"2024-09-12T12:17:04.263409+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263409+0000","last_undegraded":"2024-09-12T12:17:04.263409+0000","last_fullsized":"2024-09-12T12:17:04.263409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.290153+0000","last_change":"2024-09-12T12:17:04.287110+0000","last_active":"2024-09-12T12:17:04.290153+0000","last_peered":"2024-09-12T12:17:04.290153+0000","last_clean":"2024-09-12T12:17:04.290153+0000","last_became_active":"2024-09-12T12:17:04.286764+0000","last_became_peered":"2024-09-12T12:17:04.286764+0000","last_unstale":"2024-09-12T12:17:04.290153+0000","last_undegraded":"2024-09-12T12:17:04.290153+0000","last_fullsized":"2024-09-12T12:17:04.290153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:46.714859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.264233+0000","last_change":"2024-09-12T12:17:04.264233+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.264233+0000","last_undegraded":"2024-09-12T12:17:04.264233+0000","last_fullsized":"2024-09-12T12:17:04.264233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287959+0000","last_change":"2024-09-12T12:17:04.285150+0000","last_active":"2024-09-12T12:17:04.287959+0000","last_peered":"2024-09-12T12:17:04.287959+0000","last_clean":"2024-09-12T12:17:04.287959+0000","last_became_active":"2024-09-12T12:17:04.284860+0000","last_became_peered":"2024-09-12T12:17:04.284860+0000","last_unstale":"2024-09-12T12:17:04.287959+0000","last_undegraded":"2024-09-12T12:17:04.287959+0000","last_fullsized":"2024-09-12T12:17:04.287959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:57.737059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.263965+0000","last_change":"2024-09-12T12:17:04.263965+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.263965+0000","last_undegraded":"2024-09-12T12:17:04.263965+0000","last_fullsized":"2024-09-12T12:17:04.263965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.282342+0000","last_change":"2024-09-12T12:17:04.277442+0000","last_active":"2024-09-12T12:17:04.282342+0000","last_peered":"2024-09-12T12:17:04.282342+0000","last_clean":"2024-09-12T12:17:04.282342+0000","last_became_active":"2024-09-12T12:17:04.277120+0000","last_became_peered":"2024-09-12T12:17:04.277120+0000","last_unstale":"2024-09-12T12:17:04.282342+0000","last_undegraded":"2024-09-12T12:17:04.282342+0000","last_fullsized":"2024-09-12T12:17:04.282342+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:25.659264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-12T12:17:04.271421+0000","last_change":"2024-09-12T12:17:04.271421+0000","last_active":"2024-09-12T12:17:04.252123+0000","last_peered":"2024-09-12T12:17:04.252123+0000","last_clean":"2024-09-12T12:17:04.252123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:04.271421+0000","last_undegraded":"2024-09-12T12:17:04.271421+0000","last_fullsized":"2024-09-12T12:17:04.271421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.287464+0000","last_change":"2024-09-12T12:17:04.284794+0000","last_active":"2024-09-12T12:17:04.287464+0000","last_peered":"2024-09-12T12:17:04.287464+0000","last_clean":"2024-09-12T12:17:04.287464+0000","last_became_active":"2024-09-12T12:17:04.283991+0000","last_became_peered":"2024-09-12T12:17:04.283991+0000","last_unstale":"2024-09-12T12:17:04.287464+0000","last_undegraded":"2024-09-12T12:17:04.287464+0000","last_fullsized":"2024-09-12T12:17:04.287464+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:04.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T12:17:04.272549+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:17:04.272549+0000","last_peered":"2024-09-12T12:17:04.272549+0000","last_clean":"2024-09-12T12:17:04.272549+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:17:04.272549+0000","last_undegraded":"2024-09-12T12:17:04.272549+0000","last_fullsized":"2024-09-12T12:17:04.272549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1572864,"data_stored":1038868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40468,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331372,"statfs":{"total":96636764160,"available":96595324928,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":978944,"data_stored":448500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41064,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330776,"statfs":{"total":96636764160,"available":96594714624,"internally_reserved":0,"allocated":1585152,"data_stored":1045535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:17:12.795 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:17:12.798 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:17:13.906 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:17:14.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.050+0000 7f9146e00640 1 Processor -- start 2024-09-12T12:17:14.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.050+0000 7f9146e00640 1 -- start start 2024-09-12T12:17:14.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.050+0000 7f9146e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015c7b0 0x7f91400ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.050+0000 7f9146e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91400cd870 con 0x7f91400b5fb0 2024-09-12T12:17:14.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.050+0000 7f9146e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91400cdb50 con 0x7f914015cd30 2024-09-12T12:17:14.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.050+0000 7f9146e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9140072a50 con 0x7f914015c7b0 2024-09-12T12:17:14.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.050+0000 7f9144e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f91400b5fb0 0x7f9140072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44874/0 (socket says 172.21.15.144:44874) 2024-09-12T12:17:14.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.050+0000 7f9144e00640 1 -- 172.21.15.144:0/3054294728 learned_addr learned my addr 172.21.15.144:0/3054294728 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:14.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913fe00640 1 --2- 172.21.15.144:0/3054294728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015c7b0 0x7f91400ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913f400640 1 -- 172.21.15.144:0/3054294728 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253502195 0 0) 0x7f91400cd870 con 0x7f91400b5fb0 2024-09-12T12:17:14.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913f400640 1 -- 172.21.15.144:0/3054294728 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9124003530 con 0x7f91400b5fb0 2024-09-12T12:17:14.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913f400640 1 -- 172.21.15.144:0/3054294728 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1586316099 0 0) 0x7f91400cdb50 con 0x7f914015cd30 2024-09-12T12:17:14.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913f400640 1 -- 172.21.15.144:0/3054294728 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91400cd870 con 0x7f914015cd30 2024-09-12T12:17:14.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913fe00640 1 -- 172.21.15.144:0/3054294728 >> v1:172.21.15.165:6789/0 conn(0x7f914015cd30 legacy=0x7f91400b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913fe00640 1 -- 172.21.15.144:0/3054294728 >> v1:172.21.15.144:6789/0 conn(0x7f91400b5fb0 legacy=0x7f9140072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913fe00640 1 -- 172.21.15.144:0/3054294728 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91400726e0 con 0x7f914015c7b0 2024-09-12T12:17:14.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913fe00640 1 --2- 172.21.15.144:0/3054294728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015c7b0 0x7f91400ccf00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91300097f0 tx=0x7f913001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8eda638f0fd219 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:14.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913f400640 1 -- 172.21.15.144:0/3054294728 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91300b0070 con 0x7f914015c7b0 2024-09-12T12:17:14.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913f400640 1 -- 172.21.15.144:0/3054294728 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91300ab600 con 0x7f914015c7b0 2024-09-12T12:17:14.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.054+0000 7f913f400640 1 -- 172.21.15.144:0/3054294728 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91300ab9d0 con 0x7f914015c7b0 2024-09-12T12:17:14.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 -- 172.21.15.144:0/3054294728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015c7b0 msgr2=0x7f91400ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 --2- 172.21.15.144:0/3054294728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015c7b0 0x7f91400ccf00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91300097f0 tx=0x7f913001c4e0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 -- 172.21.15.144:0/3054294728 shutdown_connections 2024-09-12T12:17:14.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 --2- 172.21.15.144:0/3054294728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015c7b0 0x7f91400ccf00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 -- 172.21.15.144:0/3054294728 >> 172.21.15.144:0/3054294728 conn(0x7f914006d0d0 msgr2=0x7f914006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:14.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 -- 172.21.15.144:0/3054294728 shutdown_connections 2024-09-12T12:17:14.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 -- 172.21.15.144:0/3054294728 wait complete. 2024-09-12T12:17:14.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 Processor -- start 2024-09-12T12:17:14.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 -- start start 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91400b5fb0 0x7f9140149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f914015c7b0 0x7f9140167690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015cd30 0x7f9140167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9140074210 con 0x7f91400b5fb0 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9140074090 con 0x7f914015c7b0 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f9146e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f91400cde30 con 0x7f914015cd30 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f913fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91400b5fb0 0x7f9140149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f913fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91400b5fb0 0x7f9140149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41684/0 (socket says 172.21.15.144:41684) 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f913fe00640 1 -- 172.21.15.144:0/3390917595 learned_addr learned my addr 172.21.15.144:0/3390917595 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:14.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f913fe00640 1 -- 172.21.15.144:0/3390917595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015cd30 msgr2=0x7f9140167bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f913fe00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015cd30 0x7f9140167bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f913fe00640 1 -- 172.21.15.144:0/3390917595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f914015c7b0 msgr2=0x7f9140167690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f913fe00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f914015c7b0 0x7f9140167690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.058+0000 7f913fe00640 1 -- 172.21.15.144:0/3390917595 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914015a5a0 con 0x7f91400b5fb0 2024-09-12T12:17:14.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f913fe00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91400b5fb0 0x7f9140149ff0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f91300190f0 tx=0x7f9130019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:14.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f913cc00640 1 -- 172.21.15.144:0/3390917595 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91300b0040 con 0x7f91400b5fb0 2024-09-12T12:17:14.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f913cc00640 1 -- 172.21.15.144:0/3390917595 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91300ba070 con 0x7f91400b5fb0 2024-09-12T12:17:14.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914015a880 con 0x7f91400b5fb0 2024-09-12T12:17:14.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f913cc00640 1 -- 172.21.15.144:0/3390917595 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91300b4670 con 0x7f91400b5fb0 2024-09-12T12:17:14.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f914015ae40 con 0x7f91400b5fb0 2024-09-12T12:17:14.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91400ccf00 con 0x7f91400b5fb0 2024-09-12T12:17:14.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f913cc00640 1 -- 172.21.15.144:0/3390917595 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91300b4810 con 0x7f91400b5fb0 2024-09-12T12:17:14.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f913cc00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f911c0678c0 0x7f911c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f913cc00640 1 -- 172.21.15.144:0/3390917595 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f913011fb40 con 0x7f91400b5fb0 2024-09-12T12:17:14.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.062+0000 7f9137e00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f911c0678c0 0x7f911c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.066+0000 7f9137e00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f911c0678c0 0x7f911c069d80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9128007fd0 tx=0x7f9128007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:14.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.066+0000 7f913cc00640 1 -- 172.21.15.144:0/3390917595 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f91300160d0 con 0x7f91400b5fb0 2024-09-12T12:17:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.222+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91400cf6a0 con 0x7f911c0678c0 2024-09-12T12:17:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.230+0000 7f913cc00640 1 -- 172.21.15.144:0/3390917595 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252083 (secure 0 0 0) 0x7f91400cf6a0 con 0x7f911c0678c0 2024-09-12T12:17:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:17:14.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f911c0678c0 msgr2=0x7f911c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f911c0678c0 0x7f911c069d80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9128007fd0 tx=0x7f9128007900 comp rx=0 tx=0).stop 2024-09-12T12:17:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91400b5fb0 msgr2=0x7f9140149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91400b5fb0 0x7f9140149ff0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f91300190f0 tx=0x7f9130019280 comp rx=0 tx=0).stop 2024-09-12T12:17:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 shutdown_connections 2024-09-12T12:17:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f911c0678c0 0x7f911c069d80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f914015cd30 0x7f9140167bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f914015c7b0 0x7f9140167690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 --2- 172.21.15.144:0/3390917595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91400b5fb0 0x7f9140149ff0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 >> 172.21.15.144:0/3390917595 conn(0x7f914006d0d0 msgr2=0x7f91400ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:14.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 shutdown_connections 2024-09-12T12:17:14.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.234+0000 7f9146e00640 1 -- 172.21.15.144:0/3390917595 wait complete. 2024-09-12T12:17:14.256 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-09-12T12:17:13.431785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300304,"kb_used_data":9160,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754674416,"statfs":{"total":773094113280,"available":772786601984,"internally_reserved":0,"allocated":9379840,"data_stored":4937764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.169665"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283604+0000","last_change":"2024-09-12T12:17:05.286640+0000","last_active":"2024-09-12T12:17:06.283604+0000","last_peered":"2024-09-12T12:17:06.283604+0000","last_clean":"2024-09-12T12:17:06.283604+0000","last_became_active":"2024-09-12T12:17:05.286336+0000","last_became_peered":"2024-09-12T12:17:05.286336+0000","last_unstale":"2024-09-12T12:17:06.283604+0000","last_undegraded":"2024-09-12T12:17:06.283604+0000","last_fullsized":"2024-09-12T12:17:06.283604+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:52.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363417+0000","last_change":"2024-09-12T12:17:05.303379+0000","last_active":"2024-09-12T12:17:06.363417+0000","last_peered":"2024-09-12T12:17:06.363417+0000","last_clean":"2024-09-12T12:17:06.363417+0000","last_became_active":"2024-09-12T12:17:05.303085+0000","last_became_peered":"2024-09-12T12:17:05.303085+0000","last_unstale":"2024-09-12T12:17:06.363417+0000","last_undegraded":"2024-09-12T12:17:06.363417+0000","last_fullsized":"2024-09-12T12:17:06.363417+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:41.813711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362814+0000","last_change":"2024-09-12T12:17:05.282775+0000","last_active":"2024-09-12T12:17:06.362814+0000","last_peered":"2024-09-12T12:17:06.362814+0000","last_clean":"2024-09-12T12:17:06.362814+0000","last_became_active":"2024-09-12T12:17:05.282502+0000","last_became_peered":"2024-09-12T12:17:05.282502+0000","last_unstale":"2024-09-12T12:17:06.362814+0000","last_undegraded":"2024-09-12T12:17:06.362814+0000","last_fullsized":"2024-09-12T12:17:06.362814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:53.866914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361761+0000","last_change":"2024-09-12T12:17:05.286841+0000","last_active":"2024-09-12T12:17:06.361761+0000","last_peered":"2024-09-12T12:17:06.361761+0000","last_clean":"2024-09-12T12:17:06.361761+0000","last_became_active":"2024-09-12T12:17:05.286524+0000","last_became_peered":"2024-09-12T12:17:05.286524+0000","last_unstale":"2024-09-12T12:17:06.361761+0000","last_undegraded":"2024-09-12T12:17:06.361761+0000","last_fullsized":"2024-09-12T12:17:06.361761+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:32.156254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363593+0000","last_change":"2024-09-12T12:17:05.295045+0000","last_active":"2024-09-12T12:17:06.363593+0000","last_peered":"2024-09-12T12:17:06.363593+0000","last_clean":"2024-09-12T12:17:06.363593+0000","last_became_active":"2024-09-12T12:17:05.294783+0000","last_became_peered":"2024-09-12T12:17:05.294783+0000","last_unstale":"2024-09-12T12:17:06.363593+0000","last_undegraded":"2024-09-12T12:17:06.363593+0000","last_fullsized":"2024-09-12T12:17:06.363593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:35.046860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282407+0000","last_change":"2024-09-12T12:17:05.288977+0000","last_active":"2024-09-12T12:17:06.282407+0000","last_peered":"2024-09-12T12:17:06.282407+0000","last_clean":"2024-09-12T12:17:06.282407+0000","last_became_active":"2024-09-12T12:17:05.288084+0000","last_became_peered":"2024-09-12T12:17:05.288084+0000","last_unstale":"2024-09-12T12:17:06.282407+0000","last_undegraded":"2024-09-12T12:17:06.282407+0000","last_fullsized":"2024-09-12T12:17:06.282407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:51:07.212764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362410+0000","last_change":"2024-09-12T12:17:05.301312+0000","last_active":"2024-09-12T12:17:06.362410+0000","last_peered":"2024-09-12T12:17:06.362410+0000","last_clean":"2024-09-12T12:17:06.362410+0000","last_became_active":"2024-09-12T12:17:05.300995+0000","last_became_peered":"2024-09-12T12:17:05.300995+0000","last_unstale":"2024-09-12T12:17:06.362410+0000","last_undegraded":"2024-09-12T12:17:06.362410+0000","last_fullsized":"2024-09-12T12:17:06.362410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:40.668246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362498+0000","last_change":"2024-09-12T12:17:05.294697+0000","last_active":"2024-09-12T12:17:06.362498+0000","last_peered":"2024-09-12T12:17:06.362498+0000","last_clean":"2024-09-12T12:17:06.362498+0000","last_became_active":"2024-09-12T12:17:05.291754+0000","last_became_peered":"2024-09-12T12:17:05.291754+0000","last_unstale":"2024-09-12T12:17:06.362498+0000","last_undegraded":"2024-09-12T12:17:06.362498+0000","last_fullsized":"2024-09-12T12:17:06.362498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:50.931704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283146+0000","last_change":"2024-09-12T12:17:05.287929+0000","last_active":"2024-09-12T12:17:06.283146+0000","last_peered":"2024-09-12T12:17:06.283146+0000","last_clean":"2024-09-12T12:17:06.283146+0000","last_became_active":"2024-09-12T12:17:05.287576+0000","last_became_peered":"2024-09-12T12:17:05.287576+0000","last_unstale":"2024-09-12T12:17:06.283146+0000","last_undegraded":"2024-09-12T12:17:06.283146+0000","last_fullsized":"2024-09-12T12:17:06.283146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:10.362628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361808+0000","last_change":"2024-09-12T12:17:05.292617+0000","last_active":"2024-09-12T12:17:06.361808+0000","last_peered":"2024-09-12T12:17:06.361808+0000","last_clean":"2024-09-12T12:17:06.361808+0000","last_became_active":"2024-09-12T12:17:05.292308+0000","last_became_peered":"2024-09-12T12:17:05.292308+0000","last_unstale":"2024-09-12T12:17:06.361808+0000","last_undegraded":"2024-09-12T12:17:06.361808+0000","last_fullsized":"2024-09-12T12:17:06.361808+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:52.674493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363322+0000","last_change":"2024-09-12T12:17:05.302920+0000","last_active":"2024-09-12T12:17:06.363322+0000","last_peered":"2024-09-12T12:17:06.363322+0000","last_clean":"2024-09-12T12:17:06.363322+0000","last_became_active":"2024-09-12T12:17:05.302462+0000","last_became_peered":"2024-09-12T12:17:05.302462+0000","last_unstale":"2024-09-12T12:17:06.363322+0000","last_undegraded":"2024-09-12T12:17:06.363322+0000","last_fullsized":"2024-09-12T12:17:06.363322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:05.816389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361847+0000","last_change":"2024-09-12T12:17:05.284880+0000","last_active":"2024-09-12T12:17:06.361847+0000","last_peered":"2024-09-12T12:17:06.361847+0000","last_clean":"2024-09-12T12:17:06.361847+0000","last_became_active":"2024-09-12T12:17:05.282464+0000","last_became_peered":"2024-09-12T12:17:05.282464+0000","last_unstale":"2024-09-12T12:17:06.361847+0000","last_undegraded":"2024-09-12T12:17:06.361847+0000","last_fullsized":"2024-09-12T12:17:06.361847+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:02.271966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363658+0000","last_change":"2024-09-12T12:17:05.301153+0000","last_active":"2024-09-12T12:17:06.363658+0000","last_peered":"2024-09-12T12:17:06.363658+0000","last_clean":"2024-09-12T12:17:06.363658+0000","last_became_active":"2024-09-12T12:17:05.296076+0000","last_became_peered":"2024-09-12T12:17:05.296076+0000","last_unstale":"2024-09-12T12:17:06.363658+0000","last_undegraded":"2024-09-12T12:17:06.363658+0000","last_fullsized":"2024-09-12T12:17:06.363658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:54.249155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282376+0000","last_change":"2024-09-12T12:17:05.287871+0000","last_active":"2024-09-12T12:17:06.282376+0000","last_peered":"2024-09-12T12:17:06.282376+0000","last_clean":"2024-09-12T12:17:06.282376+0000","last_became_active":"2024-09-12T12:17:05.287317+0000","last_became_peered":"2024-09-12T12:17:05.287317+0000","last_unstale":"2024-09-12T12:17:06.282376+0000","last_undegraded":"2024-09-12T12:17:06.282376+0000","last_fullsized":"2024-09-12T12:17:06.282376+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:41.813711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362102+0000","last_change":"2024-09-12T12:17:05.285501+0000","last_active":"2024-09-12T12:17:06.362102+0000","last_peered":"2024-09-12T12:17:06.362102+0000","last_clean":"2024-09-12T12:17:06.362102+0000","last_became_active":"2024-09-12T12:17:05.284654+0000","last_became_peered":"2024-09-12T12:17:05.284654+0000","last_unstale":"2024-09-12T12:17:06.362102+0000","last_undegraded":"2024-09-12T12:17:06.362102+0000","last_fullsized":"2024-09-12T12:17:06.362102+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:23.366644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282727+0000","last_change":"2024-09-12T12:17:05.281786+0000","last_active":"2024-09-12T12:17:06.282727+0000","last_peered":"2024-09-12T12:17:06.282727+0000","last_clean":"2024-09-12T12:17:06.282727+0000","last_became_active":"2024-09-12T12:17:05.281299+0000","last_became_peered":"2024-09-12T12:17:05.281299+0000","last_unstale":"2024-09-12T12:17:06.282727+0000","last_undegraded":"2024-09-12T12:17:06.282727+0000","last_fullsized":"2024-09-12T12:17:06.282727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:17.256119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363969+0000","last_change":"2024-09-12T12:17:05.301907+0000","last_active":"2024-09-12T12:17:06.363969+0000","last_peered":"2024-09-12T12:17:06.363969+0000","last_clean":"2024-09-12T12:17:06.363969+0000","last_became_active":"2024-09-12T12:17:05.301592+0000","last_became_peered":"2024-09-12T12:17:05.301592+0000","last_unstale":"2024-09-12T12:17:06.363969+0000","last_undegraded":"2024-09-12T12:17:06.363969+0000","last_fullsized":"2024-09-12T12:17:06.363969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:01:41.634248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362811+0000","last_change":"2024-09-12T12:17:05.284981+0000","last_active":"2024-09-12T12:17:06.362811+0000","last_peered":"2024-09-12T12:17:06.362811+0000","last_clean":"2024-09-12T12:17:06.362811+0000","last_became_active":"2024-09-12T12:17:05.284655+0000","last_became_peered":"2024-09-12T12:17:05.284655+0000","last_unstale":"2024-09-12T12:17:06.362811+0000","last_undegraded":"2024-09-12T12:17:06.362811+0000","last_fullsized":"2024-09-12T12:17:06.362811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:04.549048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282766+0000","last_change":"2024-09-12T12:17:05.304857+0000","last_active":"2024-09-12T12:17:06.282766+0000","last_peered":"2024-09-12T12:17:06.282766+0000","last_clean":"2024-09-12T12:17:06.282766+0000","last_became_active":"2024-09-12T12:17:05.304543+0000","last_became_peered":"2024-09-12T12:17:05.304543+0000","last_unstale":"2024-09-12T12:17:06.282766+0000","last_undegraded":"2024-09-12T12:17:06.282766+0000","last_fullsized":"2024-09-12T12:17:06.282766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:03.632126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363755+0000","last_change":"2024-09-12T12:17:05.294887+0000","last_active":"2024-09-12T12:17:06.363755+0000","last_peered":"2024-09-12T12:17:06.363755+0000","last_clean":"2024-09-12T12:17:06.363755+0000","last_became_active":"2024-09-12T12:17:05.294467+0000","last_became_peered":"2024-09-12T12:17:05.294467+0000","last_unstale":"2024-09-12T12:17:06.363755+0000","last_undegraded":"2024-09-12T12:17:06.363755+0000","last_fullsized":"2024-09-12T12:17:06.363755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:11.997609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282464+0000","last_change":"2024-09-12T12:17:05.290605+0000","last_active":"2024-09-12T12:17:06.282464+0000","last_peered":"2024-09-12T12:17:06.282464+0000","last_clean":"2024-09-12T12:17:06.282464+0000","last_became_active":"2024-09-12T12:17:05.289850+0000","last_became_peered":"2024-09-12T12:17:05.289850+0000","last_unstale":"2024-09-12T12:17:06.282464+0000","last_undegraded":"2024-09-12T12:17:06.282464+0000","last_fullsized":"2024-09-12T12:17:06.282464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:48.738587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363281+0000","last_change":"2024-09-12T12:17:05.300253+0000","last_active":"2024-09-12T12:17:06.363281+0000","last_peered":"2024-09-12T12:17:06.363281+0000","last_clean":"2024-09-12T12:17:06.363281+0000","last_became_active":"2024-09-12T12:17:05.299932+0000","last_became_peered":"2024-09-12T12:17:05.299932+0000","last_unstale":"2024-09-12T12:17:06.363281+0000","last_undegraded":"2024-09-12T12:17:06.363281+0000","last_fullsized":"2024-09-12T12:17:06.363281+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:28.625864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282186+0000","last_change":"2024-09-12T12:17:05.289629+0000","last_active":"2024-09-12T12:17:06.282186+0000","last_peered":"2024-09-12T12:17:06.282186+0000","last_clean":"2024-09-12T12:17:06.282186+0000","last_became_active":"2024-09-12T12:17:05.285401+0000","last_became_peered":"2024-09-12T12:17:05.285401+0000","last_unstale":"2024-09-12T12:17:06.282186+0000","last_undegraded":"2024-09-12T12:17:06.282186+0000","last_fullsized":"2024-09-12T12:17:06.282186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:57.458518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362082+0000","last_change":"2024-09-12T12:17:05.287663+0000","last_active":"2024-09-12T12:17:06.362082+0000","last_peered":"2024-09-12T12:17:06.362082+0000","last_clean":"2024-09-12T12:17:06.362082+0000","last_became_active":"2024-09-12T12:17:05.287415+0000","last_became_peered":"2024-09-12T12:17:05.287415+0000","last_unstale":"2024-09-12T12:17:06.362082+0000","last_undegraded":"2024-09-12T12:17:06.362082+0000","last_fullsized":"2024-09-12T12:17:06.362082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:41.247883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363461+0000","last_change":"2024-09-12T12:17:05.287977+0000","last_active":"2024-09-12T12:17:06.363461+0000","last_peered":"2024-09-12T12:17:06.363461+0000","last_clean":"2024-09-12T12:17:06.363461+0000","last_became_active":"2024-09-12T12:17:05.287662+0000","last_became_peered":"2024-09-12T12:17:05.287662+0000","last_unstale":"2024-09-12T12:17:06.363461+0000","last_undegraded":"2024-09-12T12:17:06.363461+0000","last_fullsized":"2024-09-12T12:17:06.363461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:51:07.212764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361769+0000","last_change":"2024-09-12T12:17:05.285109+0000","last_active":"2024-09-12T12:17:06.361769+0000","last_peered":"2024-09-12T12:17:06.361769+0000","last_clean":"2024-09-12T12:17:06.361769+0000","last_became_active":"2024-09-12T12:17:05.284803+0000","last_became_peered":"2024-09-12T12:17:05.284803+0000","last_unstale":"2024-09-12T12:17:06.361769+0000","last_undegraded":"2024-09-12T12:17:06.361769+0000","last_fullsized":"2024-09-12T12:17:06.361769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:00.686226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283581+0000","last_change":"2024-09-12T12:17:05.289500+0000","last_active":"2024-09-12T12:17:06.283581+0000","last_peered":"2024-09-12T12:17:06.283581+0000","last_clean":"2024-09-12T12:17:06.283581+0000","last_became_active":"2024-09-12T12:17:05.288259+0000","last_became_peered":"2024-09-12T12:17:05.288259+0000","last_unstale":"2024-09-12T12:17:06.283581+0000","last_undegraded":"2024-09-12T12:17:06.283581+0000","last_fullsized":"2024-09-12T12:17:06.283581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:23.366644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363658+0000","last_change":"2024-09-12T12:17:05.295956+0000","last_active":"2024-09-12T12:17:06.363658+0000","last_peered":"2024-09-12T12:17:06.363658+0000","last_clean":"2024-09-12T12:17:06.363658+0000","last_became_active":"2024-09-12T12:17:05.295660+0000","last_became_peered":"2024-09-12T12:17:05.295660+0000","last_unstale":"2024-09-12T12:17:06.363658+0000","last_undegraded":"2024-09-12T12:17:06.363658+0000","last_fullsized":"2024-09-12T12:17:06.363658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:05.573157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362606+0000","last_change":"2024-09-12T12:17:05.273261+0000","last_active":"2024-09-12T12:17:06.362606+0000","last_peered":"2024-09-12T12:17:06.362606+0000","last_clean":"2024-09-12T12:17:06.362606+0000","last_became_active":"2024-09-12T12:17:05.272998+0000","last_became_peered":"2024-09-12T12:17:05.272998+0000","last_unstale":"2024-09-12T12:17:06.362606+0000","last_undegraded":"2024-09-12T12:17:06.362606+0000","last_fullsized":"2024-09-12T12:17:06.362606+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:49.455469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283033+0000","last_change":"2024-09-12T12:17:05.282924+0000","last_active":"2024-09-12T12:17:06.283033+0000","last_peered":"2024-09-12T12:17:06.283033+0000","last_clean":"2024-09-12T12:17:06.283033+0000","last_became_active":"2024-09-12T12:17:05.282651+0000","last_became_peered":"2024-09-12T12:17:05.282651+0000","last_unstale":"2024-09-12T12:17:06.283033+0000","last_undegraded":"2024-09-12T12:17:06.283033+0000","last_fullsized":"2024-09-12T12:17:06.283033+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:11.493681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362391+0000","last_change":"2024-09-12T12:17:05.292025+0000","last_active":"2024-09-12T12:17:06.362391+0000","last_peered":"2024-09-12T12:17:06.362391+0000","last_clean":"2024-09-12T12:17:06.362391+0000","last_became_active":"2024-09-12T12:17:05.291774+0000","last_became_peered":"2024-09-12T12:17:05.291774+0000","last_unstale":"2024-09-12T12:17:06.362391+0000","last_undegraded":"2024-09-12T12:17:06.362391+0000","last_fullsized":"2024-09-12T12:17:06.362391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:33.084421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283054+0000","last_change":"2024-09-12T12:17:05.285632+0000","last_active":"2024-09-12T12:17:06.283054+0000","last_peered":"2024-09-12T12:17:06.283054+0000","last_clean":"2024-09-12T12:17:06.283054+0000","last_became_active":"2024-09-12T12:17:05.285286+0000","last_became_peered":"2024-09-12T12:17:05.285286+0000","last_unstale":"2024-09-12T12:17:06.283054+0000","last_undegraded":"2024-09-12T12:17:06.283054+0000","last_fullsized":"2024-09-12T12:17:06.283054+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:49.455469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362047+0000","last_change":"2024-09-12T12:17:05.283373+0000","last_active":"2024-09-12T12:17:06.362047+0000","last_peered":"2024-09-12T12:17:06.362047+0000","last_clean":"2024-09-12T12:17:06.362047+0000","last_became_active":"2024-09-12T12:17:05.283096+0000","last_became_peered":"2024-09-12T12:17:05.283096+0000","last_unstale":"2024-09-12T12:17:06.362047+0000","last_undegraded":"2024-09-12T12:17:06.362047+0000","last_fullsized":"2024-09-12T12:17:06.362047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:58.306457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363997+0000","last_change":"2024-09-12T12:17:04.288167+0000","last_active":"2024-09-12T12:17:06.363997+0000","last_peered":"2024-09-12T12:17:06.363997+0000","last_clean":"2024-09-12T12:17:06.363997+0000","last_became_active":"2024-09-12T12:17:04.287954+0000","last_became_peered":"2024-09-12T12:17:04.287954+0000","last_unstale":"2024-09-12T12:17:06.363997+0000","last_undegraded":"2024-09-12T12:17:06.363997+0000","last_fullsized":"2024-09-12T12:17:06.363997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:19.936376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362207+0000","last_change":"2024-09-12T12:17:05.285544+0000","last_active":"2024-09-12T12:17:06.362207+0000","last_peered":"2024-09-12T12:17:06.362207+0000","last_clean":"2024-09-12T12:17:06.362207+0000","last_became_active":"2024-09-12T12:17:05.285223+0000","last_became_peered":"2024-09-12T12:17:05.285223+0000","last_unstale":"2024-09-12T12:17:06.362207+0000","last_undegraded":"2024-09-12T12:17:06.362207+0000","last_fullsized":"2024-09-12T12:17:06.362207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:17.256119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283489+0000","last_change":"2024-09-12T12:17:04.282927+0000","last_active":"2024-09-12T12:17:06.283489+0000","last_peered":"2024-09-12T12:17:06.283489+0000","last_clean":"2024-09-12T12:17:06.283489+0000","last_became_active":"2024-09-12T12:17:04.282682+0000","last_became_peered":"2024-09-12T12:17:04.282682+0000","last_unstale":"2024-09-12T12:17:06.283489+0000","last_undegraded":"2024-09-12T12:17:06.283489+0000","last_fullsized":"2024-09-12T12:17:06.283489+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:23.949631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282439+0000","last_change":"2024-09-12T12:17:05.288622+0000","last_active":"2024-09-12T12:17:06.282439+0000","last_peered":"2024-09-12T12:17:06.282439+0000","last_clean":"2024-09-12T12:17:06.282439+0000","last_became_active":"2024-09-12T12:17:05.288043+0000","last_became_peered":"2024-09-12T12:17:05.288043+0000","last_unstale":"2024-09-12T12:17:06.282439+0000","last_undegraded":"2024-09-12T12:17:06.282439+0000","last_fullsized":"2024-09-12T12:17:06.282439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:18.504816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283689+0000","last_change":"2024-09-12T12:17:04.284408+0000","last_active":"2024-09-12T12:17:06.283689+0000","last_peered":"2024-09-12T12:17:06.283689+0000","last_clean":"2024-09-12T12:17:06.283689+0000","last_became_active":"2024-09-12T12:17:04.284110+0000","last_became_peered":"2024-09-12T12:17:04.284110+0000","last_unstale":"2024-09-12T12:17:06.283689+0000","last_undegraded":"2024-09-12T12:17:06.283689+0000","last_fullsized":"2024-09-12T12:17:06.283689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:51.669976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282640+0000","last_change":"2024-09-12T12:17:05.282935+0000","last_active":"2024-09-12T12:17:06.282640+0000","last_peered":"2024-09-12T12:17:06.282640+0000","last_clean":"2024-09-12T12:17:06.282640+0000","last_became_active":"2024-09-12T12:17:05.282662+0000","last_became_peered":"2024-09-12T12:17:05.282662+0000","last_unstale":"2024-09-12T12:17:06.282640+0000","last_undegraded":"2024-09-12T12:17:06.282640+0000","last_fullsized":"2024-09-12T12:17:06.282640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:34:55.886960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362275+0000","last_change":"2024-09-12T12:17:04.282018+0000","last_active":"2024-09-12T12:17:06.362275+0000","last_peered":"2024-09-12T12:17:06.362275+0000","last_clean":"2024-09-12T12:17:06.362275+0000","last_became_active":"2024-09-12T12:17:04.281347+0000","last_became_peered":"2024-09-12T12:17:04.281347+0000","last_unstale":"2024-09-12T12:17:06.362275+0000","last_undegraded":"2024-09-12T12:17:06.362275+0000","last_fullsized":"2024-09-12T12:17:06.362275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:17.500298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363077+0000","last_change":"2024-09-12T12:17:05.295651+0000","last_active":"2024-09-12T12:17:06.363077+0000","last_peered":"2024-09-12T12:17:06.363077+0000","last_clean":"2024-09-12T12:17:06.363077+0000","last_became_active":"2024-09-12T12:17:05.295368+0000","last_became_peered":"2024-09-12T12:17:05.295368+0000","last_unstale":"2024-09-12T12:17:06.363077+0000","last_undegraded":"2024-09-12T12:17:06.363077+0000","last_fullsized":"2024-09-12T12:17:06.363077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:43.509803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282814+0000","last_change":"2024-09-12T12:17:04.277749+0000","last_active":"2024-09-12T12:17:06.282814+0000","last_peered":"2024-09-12T12:17:06.282814+0000","last_clean":"2024-09-12T12:17:06.282814+0000","last_became_active":"2024-09-12T12:17:04.277421+0000","last_became_peered":"2024-09-12T12:17:04.277421+0000","last_unstale":"2024-09-12T12:17:06.282814+0000","last_undegraded":"2024-09-12T12:17:06.282814+0000","last_fullsized":"2024-09-12T12:17:06.282814+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:46.243913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363346+0000","last_change":"2024-09-12T12:17:05.302715+0000","last_active":"2024-09-12T12:17:06.363346+0000","last_peered":"2024-09-12T12:17:06.363346+0000","last_clean":"2024-09-12T12:17:06.363346+0000","last_became_active":"2024-09-12T12:17:05.302100+0000","last_became_peered":"2024-09-12T12:17:05.302100+0000","last_unstale":"2024-09-12T12:17:06.363346+0000","last_undegraded":"2024-09-12T12:17:06.363346+0000","last_fullsized":"2024-09-12T12:17:06.363346+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:43.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361441+0000","last_change":"2024-09-12T12:17:04.285386+0000","last_active":"2024-09-12T12:17:06.361441+0000","last_peered":"2024-09-12T12:17:06.361441+0000","last_clean":"2024-09-12T12:17:06.361441+0000","last_became_active":"2024-09-12T12:17:04.284833+0000","last_became_peered":"2024-09-12T12:17:04.284833+0000","last_unstale":"2024-09-12T12:17:06.361441+0000","last_undegraded":"2024-09-12T12:17:06.361441+0000","last_fullsized":"2024-09-12T12:17:06.361441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:39.663729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283035+0000","last_change":"2024-09-12T12:17:05.293253+0000","last_active":"2024-09-12T12:17:06.283035+0000","last_peered":"2024-09-12T12:17:06.283035+0000","last_clean":"2024-09-12T12:17:06.283035+0000","last_became_active":"2024-09-12T12:17:05.292118+0000","last_became_peered":"2024-09-12T12:17:05.292118+0000","last_unstale":"2024-09-12T12:17:06.283035+0000","last_undegraded":"2024-09-12T12:17:06.283035+0000","last_fullsized":"2024-09-12T12:17:06.283035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:02:12.459709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362292+0000","last_change":"2024-09-12T12:17:04.278438+0000","last_active":"2024-09-12T12:17:06.362292+0000","last_peered":"2024-09-12T12:17:06.362292+0000","last_clean":"2024-09-12T12:17:06.362292+0000","last_became_active":"2024-09-12T12:17:04.277977+0000","last_became_peered":"2024-09-12T12:17:04.277977+0000","last_unstale":"2024-09-12T12:17:06.362292+0000","last_undegraded":"2024-09-12T12:17:06.362292+0000","last_fullsized":"2024-09-12T12:17:06.362292+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:13.958415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362602+0000","last_change":"2024-09-12T12:17:05.301621+0000","last_active":"2024-09-12T12:17:06.362602+0000","last_peered":"2024-09-12T12:17:06.362602+0000","last_clean":"2024-09-12T12:17:06.362602+0000","last_became_active":"2024-09-12T12:17:05.301083+0000","last_became_peered":"2024-09-12T12:17:05.301083+0000","last_unstale":"2024-09-12T12:17:06.362602+0000","last_undegraded":"2024-09-12T12:17:06.362602+0000","last_fullsized":"2024-09-12T12:17:06.362602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:14.962932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362574+0000","last_change":"2024-09-12T12:17:04.277306+0000","last_active":"2024-09-12T12:17:06.362574+0000","last_peered":"2024-09-12T12:17:06.362574+0000","last_clean":"2024-09-12T12:17:06.362574+0000","last_became_active":"2024-09-12T12:17:04.276970+0000","last_became_peered":"2024-09-12T12:17:04.276970+0000","last_unstale":"2024-09-12T12:17:06.362574+0000","last_undegraded":"2024-09-12T12:17:06.362574+0000","last_fullsized":"2024-09-12T12:17:06.362574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:01.308307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362503+0000","last_change":"2024-09-12T12:17:05.281286+0000","last_active":"2024-09-12T12:17:06.362503+0000","last_peered":"2024-09-12T12:17:06.362503+0000","last_clean":"2024-09-12T12:17:06.362503+0000","last_became_active":"2024-09-12T12:17:05.278350+0000","last_became_peered":"2024-09-12T12:17:05.278350+0000","last_unstale":"2024-09-12T12:17:06.362503+0000","last_undegraded":"2024-09-12T12:17:06.362503+0000","last_fullsized":"2024-09-12T12:17:06.362503+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:11.493681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283711+0000","last_change":"2024-09-12T12:17:04.283614+0000","last_active":"2024-09-12T12:17:06.283711+0000","last_peered":"2024-09-12T12:17:06.283711+0000","last_clean":"2024-09-12T12:17:06.283711+0000","last_became_active":"2024-09-12T12:17:04.283363+0000","last_became_peered":"2024-09-12T12:17:04.283363+0000","last_unstale":"2024-09-12T12:17:06.283711+0000","last_undegraded":"2024-09-12T12:17:06.283711+0000","last_fullsized":"2024-09-12T12:17:06.283711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:31.151737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361889+0000","last_change":"2024-09-12T12:17:05.281682+0000","last_active":"2024-09-12T12:17:06.361889+0000","last_peered":"2024-09-12T12:17:06.361889+0000","last_clean":"2024-09-12T12:17:06.361889+0000","last_became_active":"2024-09-12T12:17:05.281172+0000","last_became_peered":"2024-09-12T12:17:05.281172+0000","last_unstale":"2024-09-12T12:17:06.361889+0000","last_undegraded":"2024-09-12T12:17:06.361889+0000","last_fullsized":"2024-09-12T12:17:06.361889+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:23.097884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361925+0000","last_change":"2024-09-12T12:17:04.278522+0000","last_active":"2024-09-12T12:17:06.361925+0000","last_peered":"2024-09-12T12:17:06.361925+0000","last_clean":"2024-09-12T12:17:06.361925+0000","last_became_active":"2024-09-12T12:17:04.278250+0000","last_became_peered":"2024-09-12T12:17:04.278250+0000","last_unstale":"2024-09-12T12:17:06.361925+0000","last_undegraded":"2024-09-12T12:17:06.361925+0000","last_fullsized":"2024-09-12T12:17:06.361925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:52.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282508+0000","last_change":"2024-09-12T12:17:05.292686+0000","last_active":"2024-09-12T12:17:06.282508+0000","last_peered":"2024-09-12T12:17:06.282508+0000","last_clean":"2024-09-12T12:17:06.282508+0000","last_became_active":"2024-09-12T12:17:05.292264+0000","last_became_peered":"2024-09-12T12:17:05.292264+0000","last_unstale":"2024-09-12T12:17:06.282508+0000","last_undegraded":"2024-09-12T12:17:06.282508+0000","last_fullsized":"2024-09-12T12:17:06.282508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:20.222851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"82'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363840+0000","last_change":"2024-09-12T12:17:04.286746+0000","last_active":"2024-09-12T12:17:06.363840+0000","last_peered":"2024-09-12T12:17:06.363840+0000","last_clean":"2024-09-12T12:17:06.363840+0000","last_became_active":"2024-09-12T12:17:04.286451+0000","last_became_peered":"2024-09-12T12:17:04.286451+0000","last_unstale":"2024-09-12T12:17:06.363840+0000","last_undegraded":"2024-09-12T12:17:06.363840+0000","last_fullsized":"2024-09-12T12:17:06.363840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:14.668737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362475+0000","last_change":"2024-09-12T12:17:05.280768+0000","last_active":"2024-09-12T12:17:06.362475+0000","last_peered":"2024-09-12T12:17:06.362475+0000","last_clean":"2024-09-12T12:17:06.362475+0000","last_became_active":"2024-09-12T12:17:05.280481+0000","last_became_peered":"2024-09-12T12:17:05.280481+0000","last_unstale":"2024-09-12T12:17:06.362475+0000","last_undegraded":"2024-09-12T12:17:06.362475+0000","last_fullsized":"2024-09-12T12:17:06.362475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:17.744734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"82'6","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362454+0000","last_change":"2024-09-12T12:17:04.278410+0000","last_active":"2024-09-12T12:17:06.362454+0000","last_peered":"2024-09-12T12:17:06.362454+0000","last_clean":"2024-09-12T12:17:06.362454+0000","last_became_active":"2024-09-12T12:17:04.278156+0000","last_became_peered":"2024-09-12T12:17:04.278156+0000","last_unstale":"2024-09-12T12:17:06.362454+0000","last_undegraded":"2024-09-12T12:17:06.362454+0000","last_fullsized":"2024-09-12T12:17:06.362454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:47.734070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361984+0000","last_change":"2024-09-12T12:17:05.292704+0000","last_active":"2024-09-12T12:17:06.361984+0000","last_peered":"2024-09-12T12:17:06.361984+0000","last_clean":"2024-09-12T12:17:06.361984+0000","last_became_active":"2024-09-12T12:17:05.292334+0000","last_became_peered":"2024-09-12T12:17:05.292334+0000","last_unstale":"2024-09-12T12:17:06.361984+0000","last_undegraded":"2024-09-12T12:17:06.361984+0000","last_fullsized":"2024-09-12T12:17:06.361984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:05.606152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361570+0000","last_change":"2024-09-12T12:17:04.275009+0000","last_active":"2024-09-12T12:17:06.361570+0000","last_peered":"2024-09-12T12:17:06.361570+0000","last_clean":"2024-09-12T12:17:06.361570+0000","last_became_active":"2024-09-12T12:17:04.274726+0000","last_became_peered":"2024-09-12T12:17:04.274726+0000","last_unstale":"2024-09-12T12:17:06.361570+0000","last_undegraded":"2024-09-12T12:17:06.361570+0000","last_fullsized":"2024-09-12T12:17:06.361570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:25.066020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362353+0000","last_change":"2024-09-12T12:17:05.283291+0000","last_active":"2024-09-12T12:17:06.362353+0000","last_peered":"2024-09-12T12:17:06.362353+0000","last_clean":"2024-09-12T12:17:06.362353+0000","last_became_active":"2024-09-12T12:17:05.283009+0000","last_became_peered":"2024-09-12T12:17:05.283009+0000","last_unstale":"2024-09-12T12:17:06.362353+0000","last_undegraded":"2024-09-12T12:17:06.362353+0000","last_fullsized":"2024-09-12T12:17:06.362353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:26.070538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283198+0000","last_change":"2024-09-12T12:17:04.286442+0000","last_active":"2024-09-12T12:17:06.283198+0000","last_peered":"2024-09-12T12:17:06.283198+0000","last_clean":"2024-09-12T12:17:06.283198+0000","last_became_active":"2024-09-12T12:17:04.286168+0000","last_became_peered":"2024-09-12T12:17:04.286168+0000","last_unstale":"2024-09-12T12:17:06.283198+0000","last_undegraded":"2024-09-12T12:17:06.283198+0000","last_fullsized":"2024-09-12T12:17:06.283198+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:31.264311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362667+0000","last_change":"2024-09-12T12:17:05.270175+0000","last_active":"2024-09-12T12:17:06.362667+0000","last_peered":"2024-09-12T12:17:06.362667+0000","last_clean":"2024-09-12T12:17:06.362667+0000","last_became_active":"2024-09-12T12:17:05.268773+0000","last_became_peered":"2024-09-12T12:17:05.268773+0000","last_unstale":"2024-09-12T12:17:06.362667+0000","last_undegraded":"2024-09-12T12:17:06.362667+0000","last_fullsized":"2024-09-12T12:17:06.362667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:15.555107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362547+0000","last_change":"2024-09-12T12:17:04.283991+0000","last_active":"2024-09-12T12:17:06.362547+0000","last_peered":"2024-09-12T12:17:06.362547+0000","last_clean":"2024-09-12T12:17:06.362547+0000","last_became_active":"2024-09-12T12:17:04.283694+0000","last_became_peered":"2024-09-12T12:17:04.283694+0000","last_unstale":"2024-09-12T12:17:06.362547+0000","last_undegraded":"2024-09-12T12:17:06.362547+0000","last_fullsized":"2024-09-12T12:17:06.362547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:18.488897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362670+0000","last_change":"2024-09-12T12:17:05.287897+0000","last_active":"2024-09-12T12:17:06.362670+0000","last_peered":"2024-09-12T12:17:06.362670+0000","last_clean":"2024-09-12T12:17:06.362670+0000","last_became_active":"2024-09-12T12:17:05.287629+0000","last_became_peered":"2024-09-12T12:17:05.287629+0000","last_unstale":"2024-09-12T12:17:06.362670+0000","last_undegraded":"2024-09-12T12:17:06.362670+0000","last_fullsized":"2024-09-12T12:17:06.362670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:17.529129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"82'8","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362270+0000","last_change":"2024-09-12T12:17:04.275540+0000","last_active":"2024-09-12T12:17:06.362270+0000","last_peered":"2024-09-12T12:17:06.362270+0000","last_clean":"2024-09-12T12:17:06.362270+0000","last_became_active":"2024-09-12T12:17:04.275188+0000","last_became_peered":"2024-09-12T12:17:04.275188+0000","last_unstale":"2024-09-12T12:17:06.362270+0000","last_undegraded":"2024-09-12T12:17:06.362270+0000","last_fullsized":"2024-09-12T12:17:06.362270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:52.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282236+0000","last_change":"2024-09-12T12:17:05.296870+0000","last_active":"2024-09-12T12:17:06.282236+0000","last_peered":"2024-09-12T12:17:06.282236+0000","last_clean":"2024-09-12T12:17:06.282236+0000","last_became_active":"2024-09-12T12:17:05.296618+0000","last_became_peered":"2024-09-12T12:17:05.296618+0000","last_unstale":"2024-09-12T12:17:06.282236+0000","last_undegraded":"2024-09-12T12:17:06.282236+0000","last_fullsized":"2024-09-12T12:17:06.282236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:05.816389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283825+0000","last_change":"2024-09-12T12:17:04.282311+0000","last_active":"2024-09-12T12:17:06.283825+0000","last_peered":"2024-09-12T12:17:06.283825+0000","last_clean":"2024-09-12T12:17:06.283825+0000","last_became_active":"2024-09-12T12:17:04.282043+0000","last_became_peered":"2024-09-12T12:17:04.282043+0000","last_unstale":"2024-09-12T12:17:06.283825+0000","last_undegraded":"2024-09-12T12:17:06.283825+0000","last_fullsized":"2024-09-12T12:17:06.283825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:59.681709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362464+0000","last_change":"2024-09-12T12:17:05.301940+0000","last_active":"2024-09-12T12:17:06.362464+0000","last_peered":"2024-09-12T12:17:06.362464+0000","last_clean":"2024-09-12T12:17:06.362464+0000","last_became_active":"2024-09-12T12:17:05.301671+0000","last_became_peered":"2024-09-12T12:17:05.301671+0000","last_unstale":"2024-09-12T12:17:06.362464+0000","last_undegraded":"2024-09-12T12:17:06.362464+0000","last_fullsized":"2024-09-12T12:17:06.362464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:00.170820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283075+0000","last_change":"2024-09-12T12:17:04.281271+0000","last_active":"2024-09-12T12:17:06.283075+0000","last_peered":"2024-09-12T12:17:06.283075+0000","last_clean":"2024-09-12T12:17:06.283075+0000","last_became_active":"2024-09-12T12:17:04.280997+0000","last_became_peered":"2024-09-12T12:17:04.280997+0000","last_unstale":"2024-09-12T12:17:06.283075+0000","last_undegraded":"2024-09-12T12:17:06.283075+0000","last_fullsized":"2024-09-12T12:17:06.283075+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:26.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363024+0000","last_change":"2024-09-12T12:17:05.299850+0000","last_active":"2024-09-12T12:17:06.363024+0000","last_peered":"2024-09-12T12:17:06.363024+0000","last_clean":"2024-09-12T12:17:06.363024+0000","last_became_active":"2024-09-12T12:17:05.291750+0000","last_became_peered":"2024-09-12T12:17:05.291750+0000","last_unstale":"2024-09-12T12:17:06.363024+0000","last_undegraded":"2024-09-12T12:17:06.363024+0000","last_fullsized":"2024-09-12T12:17:06.363024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:56.778158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363902+0000","last_change":"2024-09-12T12:17:04.278980+0000","last_active":"2024-09-12T12:17:06.363902+0000","last_peered":"2024-09-12T12:17:06.363902+0000","last_clean":"2024-09-12T12:17:06.363902+0000","last_became_active":"2024-09-12T12:17:04.278725+0000","last_became_peered":"2024-09-12T12:17:04.278725+0000","last_unstale":"2024-09-12T12:17:06.363902+0000","last_undegraded":"2024-09-12T12:17:06.363902+0000","last_fullsized":"2024-09-12T12:17:06.363902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:27.801719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282359+0000","last_change":"2024-09-12T12:17:05.304943+0000","last_active":"2024-09-12T12:17:06.282359+0000","last_peered":"2024-09-12T12:17:06.282359+0000","last_clean":"2024-09-12T12:17:06.282359+0000","last_became_active":"2024-09-12T12:17:05.304670+0000","last_became_peered":"2024-09-12T12:17:05.304670+0000","last_unstale":"2024-09-12T12:17:06.282359+0000","last_undegraded":"2024-09-12T12:17:06.282359+0000","last_fullsized":"2024-09-12T12:17:06.282359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:43.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362630+0000","last_change":"2024-09-12T12:17:04.277891+0000","last_active":"2024-09-12T12:17:06.362630+0000","last_peered":"2024-09-12T12:17:06.362630+0000","last_clean":"2024-09-12T12:17:06.362630+0000","last_became_active":"2024-09-12T12:17:04.277603+0000","last_became_peered":"2024-09-12T12:17:04.277603+0000","last_unstale":"2024-09-12T12:17:06.362630+0000","last_undegraded":"2024-09-12T12:17:06.362630+0000","last_fullsized":"2024-09-12T12:17:06.362630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:57.737059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363218+0000","last_change":"2024-09-12T12:17:05.289190+0000","last_active":"2024-09-12T12:17:06.363218+0000","last_peered":"2024-09-12T12:17:06.363218+0000","last_clean":"2024-09-12T12:17:06.363218+0000","last_became_active":"2024-09-12T12:17:05.288950+0000","last_became_peered":"2024-09-12T12:17:05.288950+0000","last_unstale":"2024-09-12T12:17:06.363218+0000","last_undegraded":"2024-09-12T12:17:06.363218+0000","last_fullsized":"2024-09-12T12:17:06.363218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:52.198941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282482+0000","last_change":"2024-09-12T12:17:04.283216+0000","last_active":"2024-09-12T12:17:06.282482+0000","last_peered":"2024-09-12T12:17:06.282482+0000","last_clean":"2024-09-12T12:17:06.282482+0000","last_became_active":"2024-09-12T12:17:04.282951+0000","last_became_peered":"2024-09-12T12:17:04.282951+0000","last_unstale":"2024-09-12T12:17:06.282482+0000","last_undegraded":"2024-09-12T12:17:06.282482+0000","last_fullsized":"2024-09-12T12:17:06.282482+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:15.299742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363501+0000","last_change":"2024-09-12T12:17:05.275236+0000","last_active":"2024-09-12T12:17:06.363501+0000","last_peered":"2024-09-12T12:17:06.363501+0000","last_clean":"2024-09-12T12:17:06.363501+0000","last_became_active":"2024-09-12T12:17:05.274976+0000","last_became_peered":"2024-09-12T12:17:05.274976+0000","last_unstale":"2024-09-12T12:17:06.363501+0000","last_undegraded":"2024-09-12T12:17:06.363501+0000","last_fullsized":"2024-09-12T12:17:06.363501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:20.222851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282624+0000","last_change":"2024-09-12T12:17:04.287880+0000","last_active":"2024-09-12T12:17:06.282624+0000","last_peered":"2024-09-12T12:17:06.282624+0000","last_clean":"2024-09-12T12:17:06.282624+0000","last_became_active":"2024-09-12T12:17:04.285568+0000","last_became_peered":"2024-09-12T12:17:04.285568+0000","last_unstale":"2024-09-12T12:17:06.282624+0000","last_undegraded":"2024-09-12T12:17:06.282624+0000","last_fullsized":"2024-09-12T12:17:06.282624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:03:16.251602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362724+0000","last_change":"2024-09-12T12:17:05.288487+0000","last_active":"2024-09-12T12:17:06.362724+0000","last_peered":"2024-09-12T12:17:06.362724+0000","last_clean":"2024-09-12T12:17:06.362724+0000","last_became_active":"2024-09-12T12:17:05.288185+0000","last_became_peered":"2024-09-12T12:17:05.288185+0000","last_unstale":"2024-09-12T12:17:06.362724+0000","last_undegraded":"2024-09-12T12:17:06.362724+0000","last_fullsized":"2024-09-12T12:17:06.362724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:57.959219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282405+0000","last_change":"2024-09-12T12:17:04.283598+0000","last_active":"2024-09-12T12:17:06.282405+0000","last_peered":"2024-09-12T12:17:06.282405+0000","last_clean":"2024-09-12T12:17:06.282405+0000","last_became_active":"2024-09-12T12:17:04.283327+0000","last_became_peered":"2024-09-12T12:17:04.283327+0000","last_unstale":"2024-09-12T12:17:06.282405+0000","last_undegraded":"2024-09-12T12:17:06.282405+0000","last_fullsized":"2024-09-12T12:17:06.282405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:18.854327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282160+0000","last_change":"2024-09-12T12:17:05.272317+0000","last_active":"2024-09-12T12:17:06.282160+0000","last_peered":"2024-09-12T12:17:06.282160+0000","last_clean":"2024-09-12T12:17:06.282160+0000","last_became_active":"2024-09-12T12:17:05.271991+0000","last_became_peered":"2024-09-12T12:17:05.271991+0000","last_unstale":"2024-09-12T12:17:06.282160+0000","last_undegraded":"2024-09-12T12:17:06.282160+0000","last_fullsized":"2024-09-12T12:17:06.282160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:58.741576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.361795+0000","last_change":"2024-09-12T12:17:04.274915+0000","last_active":"2024-09-12T12:17:06.361795+0000","last_peered":"2024-09-12T12:17:06.361795+0000","last_clean":"2024-09-12T12:17:06.361795+0000","last_became_active":"2024-09-12T12:17:04.274601+0000","last_became_peered":"2024-09-12T12:17:04.274601+0000","last_unstale":"2024-09-12T12:17:06.361795+0000","last_undegraded":"2024-09-12T12:17:06.361795+0000","last_fullsized":"2024-09-12T12:17:06.361795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:17.101878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362291+0000","last_change":"2024-09-12T12:17:05.287567+0000","last_active":"2024-09-12T12:17:06.362291+0000","last_peered":"2024-09-12T12:17:06.362291+0000","last_clean":"2024-09-12T12:17:06.362291+0000","last_became_active":"2024-09-12T12:17:05.287295+0000","last_became_peered":"2024-09-12T12:17:05.287295+0000","last_unstale":"2024-09-12T12:17:06.362291+0000","last_undegraded":"2024-09-12T12:17:06.362291+0000","last_fullsized":"2024-09-12T12:17:06.362291+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:05.648498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363620+0000","last_change":"2024-09-12T12:17:04.281551+0000","last_active":"2024-09-12T12:17:06.363620+0000","last_peered":"2024-09-12T12:17:06.363620+0000","last_clean":"2024-09-12T12:17:06.363620+0000","last_became_active":"2024-09-12T12:17:04.281205+0000","last_became_peered":"2024-09-12T12:17:04.281205+0000","last_unstale":"2024-09-12T12:17:06.363620+0000","last_undegraded":"2024-09-12T12:17:06.363620+0000","last_fullsized":"2024-09-12T12:17:06.363620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:14.550590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282608+0000","last_change":"2024-09-12T12:17:05.288401+0000","last_active":"2024-09-12T12:17:06.282608+0000","last_peered":"2024-09-12T12:17:06.282608+0000","last_clean":"2024-09-12T12:17:06.282608+0000","last_became_active":"2024-09-12T12:17:05.287497+0000","last_became_peered":"2024-09-12T12:17:05.287497+0000","last_unstale":"2024-09-12T12:17:06.282608+0000","last_undegraded":"2024-09-12T12:17:06.282608+0000","last_fullsized":"2024-09-12T12:17:06.282608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:05.204003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283809+0000","last_change":"2024-09-12T12:17:04.285672+0000","last_active":"2024-09-12T12:17:06.283809+0000","last_peered":"2024-09-12T12:17:06.283809+0000","last_clean":"2024-09-12T12:17:06.283809+0000","last_became_active":"2024-09-12T12:17:04.284212+0000","last_became_peered":"2024-09-12T12:17:04.284212+0000","last_unstale":"2024-09-12T12:17:06.283809+0000","last_undegraded":"2024-09-12T12:17:06.283809+0000","last_fullsized":"2024-09-12T12:17:06.283809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:01.267449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362920+0000","last_change":"2024-09-12T12:17:05.277812+0000","last_active":"2024-09-12T12:17:06.362920+0000","last_peered":"2024-09-12T12:17:06.362920+0000","last_clean":"2024-09-12T12:17:06.362920+0000","last_became_active":"2024-09-12T12:17:05.277548+0000","last_became_peered":"2024-09-12T12:17:05.277548+0000","last_unstale":"2024-09-12T12:17:06.362920+0000","last_undegraded":"2024-09-12T12:17:06.362920+0000","last_fullsized":"2024-09-12T12:17:06.362920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:52.323798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283930+0000","last_change":"2024-09-12T12:17:04.282760+0000","last_active":"2024-09-12T12:17:06.283930+0000","last_peered":"2024-09-12T12:17:06.283930+0000","last_clean":"2024-09-12T12:17:06.283930+0000","last_became_active":"2024-09-12T12:17:04.282480+0000","last_became_peered":"2024-09-12T12:17:04.282480+0000","last_unstale":"2024-09-12T12:17:06.283930+0000","last_undegraded":"2024-09-12T12:17:06.283930+0000","last_fullsized":"2024-09-12T12:17:06.283930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:04:56.954702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362314+0000","last_change":"2024-09-12T12:17:05.288223+0000","last_active":"2024-09-12T12:17:06.362314+0000","last_peered":"2024-09-12T12:17:06.362314+0000","last_clean":"2024-09-12T12:17:06.362314+0000","last_became_active":"2024-09-12T12:17:05.287967+0000","last_became_peered":"2024-09-12T12:17:05.287967+0000","last_unstale":"2024-09-12T12:17:06.362314+0000","last_undegraded":"2024-09-12T12:17:06.362314+0000","last_fullsized":"2024-09-12T12:17:06.362314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:18.106395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362154+0000","last_change":"2024-09-12T12:17:04.279763+0000","last_active":"2024-09-12T12:17:06.362154+0000","last_peered":"2024-09-12T12:17:06.362154+0000","last_clean":"2024-09-12T12:17:06.362154+0000","last_became_active":"2024-09-12T12:17:04.279478+0000","last_became_peered":"2024-09-12T12:17:04.279478+0000","last_unstale":"2024-09-12T12:17:06.362154+0000","last_undegraded":"2024-09-12T12:17:06.362154+0000","last_fullsized":"2024-09-12T12:17:06.362154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:56.454001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362567+0000","last_change":"2024-09-12T12:17:05.301358+0000","last_active":"2024-09-12T12:17:06.362567+0000","last_peered":"2024-09-12T12:17:06.362567+0000","last_clean":"2024-09-12T12:17:06.362567+0000","last_became_active":"2024-09-12T12:17:05.301052+0000","last_became_peered":"2024-09-12T12:17:05.301052+0000","last_unstale":"2024-09-12T12:17:06.362567+0000","last_undegraded":"2024-09-12T12:17:06.362567+0000","last_fullsized":"2024-09-12T12:17:06.362567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:36:53.906078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363462+0000","last_change":"2024-09-12T12:17:04.287110+0000","last_active":"2024-09-12T12:17:06.363462+0000","last_peered":"2024-09-12T12:17:06.363462+0000","last_clean":"2024-09-12T12:17:06.363462+0000","last_became_active":"2024-09-12T12:17:04.286764+0000","last_became_peered":"2024-09-12T12:17:04.286764+0000","last_unstale":"2024-09-12T12:17:06.363462+0000","last_undegraded":"2024-09-12T12:17:06.363462+0000","last_fullsized":"2024-09-12T12:17:06.363462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:37:33.124232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362844+0000","last_change":"2024-09-12T12:17:05.284912+0000","last_active":"2024-09-12T12:17:06.362844+0000","last_peered":"2024-09-12T12:17:06.362844+0000","last_clean":"2024-09-12T12:17:06.362844+0000","last_became_active":"2024-09-12T12:17:05.284617+0000","last_became_peered":"2024-09-12T12:17:05.284617+0000","last_unstale":"2024-09-12T12:17:06.362844+0000","last_undegraded":"2024-09-12T12:17:06.362844+0000","last_fullsized":"2024-09-12T12:17:06.362844+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:05.648498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362413+0000","last_change":"2024-09-12T12:17:04.285150+0000","last_active":"2024-09-12T12:17:06.362413+0000","last_peered":"2024-09-12T12:17:06.362413+0000","last_clean":"2024-09-12T12:17:06.362413+0000","last_became_active":"2024-09-12T12:17:04.284860+0000","last_became_peered":"2024-09-12T12:17:04.284860+0000","last_unstale":"2024-09-12T12:17:06.362413+0000","last_undegraded":"2024-09-12T12:17:06.362413+0000","last_fullsized":"2024-09-12T12:17:06.362413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:04.199486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.363100+0000","last_change":"2024-09-12T12:17:05.283941+0000","last_active":"2024-09-12T12:17:06.363100+0000","last_peered":"2024-09-12T12:17:06.363100+0000","last_clean":"2024-09-12T12:17:06.363100+0000","last_became_active":"2024-09-12T12:17:05.283687+0000","last_became_peered":"2024-09-12T12:17:05.283687+0000","last_unstale":"2024-09-12T12:17:06.363100+0000","last_undegraded":"2024-09-12T12:17:06.363100+0000","last_fullsized":"2024-09-12T12:17:06.363100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:40.668246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.362127+0000","last_change":"2024-09-12T12:17:04.277442+0000","last_active":"2024-09-12T12:17:06.362127+0000","last_peered":"2024-09-12T12:17:06.362127+0000","last_clean":"2024-09-12T12:17:06.362127+0000","last_became_active":"2024-09-12T12:17:04.277120+0000","last_became_peered":"2024-09-12T12:17:04.277120+0000","last_unstale":"2024-09-12T12:17:06.362127+0000","last_undegraded":"2024-09-12T12:17:06.362127+0000","last_fullsized":"2024-09-12T12:17:06.362127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:56.454001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.283803+0000","last_change":"2024-09-12T12:17:05.284063+0000","last_active":"2024-09-12T12:17:06.283803+0000","last_peered":"2024-09-12T12:17:06.283803+0000","last_clean":"2024-09-12T12:17:06.283803+0000","last_became_active":"2024-09-12T12:17:05.283614+0000","last_became_peered":"2024-09-12T12:17:05.283614+0000","last_unstale":"2024-09-12T12:17:06.283803+0000","last_undegraded":"2024-09-12T12:17:06.283803+0000","last_fullsized":"2024-09-12T12:17:06.283803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:04.252123+0000","last_clean_scrub_stamp":"2024-09-12T12:17:04.252123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:43.509803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282606+0000","last_change":"2024-09-12T12:17:04.284794+0000","last_active":"2024-09-12T12:17:06.282606+0000","last_peered":"2024-09-12T12:17:06.282606+0000","last_clean":"2024-09-12T12:17:06.282606+0000","last_became_active":"2024-09-12T12:17:04.283991+0000","last_became_peered":"2024-09-12T12:17:04.283991+0000","last_unstale":"2024-09-12T12:17:06.282606+0000","last_undegraded":"2024-09-12T12:17:06.282606+0000","last_fullsized":"2024-09-12T12:17:06.282606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:03.247606+0000","last_clean_scrub_stamp":"2024-09-12T12:17:03.247606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:40.243366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":286,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-12T12:17:06.282907+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:17:06.282907+0000","last_peered":"2024-09-12T12:17:06.282907+0000","last_clean":"2024-09-12T12:17:06.282907+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:17:06.282907+0000","last_undegraded":"2024-09-12T12:17:06.282907+0000","last_fullsized":"2024-09-12T12:17:06.282907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1613824,"data_stored":1059416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1028096,"data_stored":470638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1019904,"data_stored":469060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":1036288,"data_stored":470742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1019904,"data_stored":469608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1028096,"data_stored":469768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335488,"statfs":{"total":96636764160,"available":96599539712,"internally_reserved":0,"allocated":1024000,"data_stored":469138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41084,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330756,"statfs":{"total":96636764160,"available":96594694144,"internally_reserved":0,"allocated":1609728,"data_stored":1059394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:17:14.260 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:17:14.260 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:17:14.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6942a00640 1 Processor -- start 2024-09-12T12:17:14.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6942a00640 1 -- start start 2024-09-12T12:17:14.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6942a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f693c147cc0 0x7f693c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6942a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c0b46b0 0x7f693c0d2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6942a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693c06d220 con 0x7f693c1480a0 2024-09-12T12:17:14.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6942a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f693c06e4e0 con 0x7f693c147cc0 2024-09-12T12:17:14.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6942a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f693c06d500 con 0x7f693c0b46b0 2024-09-12T12:17:14.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6941600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f693c147cc0 0x7f693c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6941600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f693c147cc0 0x7f693c06e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41690/0 (socket says 172.21.15.144:41690) 2024-09-12T12:17:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6941600640 1 -- 172.21.15.144:0/461348880 learned_addr learned my addr 172.21.15.144:0/461348880 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6940c00640 1 --1- 172.21.15.144:0/461348880 >> v1:172.21.15.144:6789/0 conn(0x7f693c1480a0 0x7f693c0b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44884/0 (socket says 172.21.15.144:44884) 2024-09-12T12:17:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.438+0000 7f6942000640 1 --2- 172.21.15.144:0/461348880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c0b46b0 0x7f693c0d2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6941600640 1 -- 172.21.15.144:0/461348880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c0b46b0 msgr2=0x7f693c0d2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6941600640 1 --2- 172.21.15.144:0/461348880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c0b46b0 0x7f693c0d2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6941600640 1 -- 172.21.15.144:0/461348880 >> v1:172.21.15.144:6789/0 conn(0x7f693c1480a0 legacy=0x7f693c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6941600640 1 -- 172.21.15.144:0/461348880 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c06d7e0 con 0x7f693c147cc0 2024-09-12T12:17:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f693be00640 1 -- 172.21.15.144:0/461348880 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155357801 0 0) 0x7f693c06d220 con 0x7f693c1480a0 2024-09-12T12:17:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6942000640 1 --2- 172.21.15.144:0/461348880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c0b46b0 0x7f693c0d2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6941600640 1 --2- 172.21.15.144:0/461348880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c147cc0 0x7f693c06e790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6930009e50 tx=0x7f693001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c303786b25c3bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f693be00640 1 -- 172.21.15.144:0/461348880 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69300a5810 con 0x7f693c147cc0 2024-09-12T12:17:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f693be00640 1 -- 172.21.15.144:0/461348880 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69300a59b0 con 0x7f693c147cc0 2024-09-12T12:17:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f693be00640 1 -- 172.21.15.144:0/461348880 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69300a5d80 con 0x7f693c147cc0 2024-09-12T12:17:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6942a00640 1 -- 172.21.15.144:0/461348880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c147cc0 msgr2=0x7f693c06e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6942a00640 1 --2- 172.21.15.144:0/461348880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c147cc0 0x7f693c06e790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6930009e50 tx=0x7f693001ca30 comp rx=0 tx=0).stop 2024-09-12T12:17:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6942a00640 1 -- 172.21.15.144:0/461348880 shutdown_connections 2024-09-12T12:17:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6942a00640 1 --2- 172.21.15.144:0/461348880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c0b46b0 0x7f693c0d2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6942a00640 1 --2- 172.21.15.144:0/461348880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c147cc0 0x7f693c06e790 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.442+0000 7f6942a00640 1 -- 172.21.15.144:0/461348880 >> 172.21.15.144:0/461348880 conn(0x7f693c0b7c30 msgr2=0x7f693c067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:14.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 -- 172.21.15.144:0/461348880 shutdown_connections 2024-09-12T12:17:14.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 -- 172.21.15.144:0/461348880 wait complete. 2024-09-12T12:17:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 Processor -- start 2024-09-12T12:17:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 -- start start 2024-09-12T12:17:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c0b46b0 0x7f693c140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f693c147cc0 0x7f693c160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c1480a0 0x7f693c161110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f693c16b650 con 0x7f693c0b46b0 2024-09-12T12:17:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f693c16b4d0 con 0x7f693c147cc0 2024-09-12T12:17:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f693c16b7d0 con 0x7f693c1480a0 2024-09-12T12:17:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6941600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c0b46b0 0x7f693c140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6941600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c0b46b0 0x7f693c140880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41700/0 (socket says 172.21.15.144:41700) 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6941600640 1 -- 172.21.15.144:0/3912837715 learned_addr learned my addr 172.21.15.144:0/3912837715 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6941600640 1 -- 172.21.15.144:0/3912837715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c1480a0 msgr2=0x7f693c161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6941600640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c1480a0 0x7f693c161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6941600640 1 -- 172.21.15.144:0/3912837715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f693c147cc0 msgr2=0x7f693c160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6941600640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f693c147cc0 0x7f693c160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6941600640 1 -- 172.21.15.144:0/3912837715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c140dc0 con 0x7f693c0b46b0 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6941600640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c0b46b0 0x7f693c140880 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f69300af040 tx=0x7f69300197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6939600640 1 -- 172.21.15.144:0/3912837715 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930003ba0 con 0x7f693c0b46b0 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6939600640 1 -- 172.21.15.144:0/3912837715 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6930003d40 con 0x7f693c0b46b0 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693c137f40 con 0x7f693c0b46b0 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.446+0000 7f6939600640 1 -- 172.21.15.144:0/3912837715 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930004220 con 0x7f693c0b46b0 2024-09-12T12:17:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.450+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f693c138500 con 0x7f693c0b46b0 2024-09-12T12:17:14.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.450+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693c0d2280 con 0x7f693c0b46b0 2024-09-12T12:17:14.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.450+0000 7f6939600640 1 -- 172.21.15.144:0/3912837715 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69300c1060 con 0x7f693c0b46b0 2024-09-12T12:17:14.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.450+0000 7f6939600640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f691c0678c0 0x7f691c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.450+0000 7f6939600640 1 -- 172.21.15.144:0/3912837715 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f6930120510 con 0x7f693c0b46b0 2024-09-12T12:17:14.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.450+0000 7f6940c00640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f691c0678c0 0x7f691c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.450+0000 7f6940c00640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f691c0678c0 0x7f691c069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f693c169490 tx=0x7f6928007970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.454+0000 7f6939600640 1 -- 172.21.15.144:0/3912837715 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6930016620 con 0x7f693c0b46b0 2024-09-12T12:17:14.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.674+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f693c06df70 con 0x7f693c0b46b0 2024-09-12T12:17:14.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6939600640 1 -- 172.21.15.144:0/3912837715 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f69300f0e20 con 0x7f693c0b46b0 2024-09-12T12:17:14.680 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:17:14.680 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:17:14.680 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:17:14.680 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:17:14.680 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:17:14.680 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:17:14.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f691c0678c0 msgr2=0x7f691c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f691c0678c0 0x7f691c069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f693c169490 tx=0x7f6928007970 comp rx=0 tx=0).stop 2024-09-12T12:17:14.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c0b46b0 msgr2=0x7f693c140880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c0b46b0 0x7f693c140880 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f69300af040 tx=0x7f69300197d0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 shutdown_connections 2024-09-12T12:17:14.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f691c0678c0 0x7f691c069d80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f693c1480a0 0x7f693c161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f693c147cc0 0x7f693c160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 --2- 172.21.15.144:0/3912837715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c0b46b0 0x7f693c140880 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 >> 172.21.15.144:0/3912837715 conn(0x7f693c0b7c30 msgr2=0x7f693c13dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:14.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 shutdown_connections 2024-09-12T12:17:14.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.678+0000 7f6942a00640 1 -- 172.21.15.144:0/3912837715 wait complete. 2024-09-12T12:17:14.701 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:14.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2aa000640 1 Processor -- start 2024-09-12T12:17:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2aa000640 1 -- start start 2024-09-12T12:17:14.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2aa000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a4147fa0 0x7fd2a406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2aa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2a40cf920 0x7fd2a415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2aa000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a406c6b0 con 0x7fd2a406c150 2024-09-12T12:17:14.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2aa000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd2a4072a90 con 0x7fd2a40cf920 2024-09-12T12:17:14.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2aa000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a4072ce0 con 0x7fd2a4147fa0 2024-09-12T12:17:14.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2a40cf920 0x7fd2a415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2a40cf920 0x7fd2a415ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41716/0 (socket says 172.21.15.144:41716) 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2a3e00640 1 -- 172.21.15.144:0/2452816078 learned_addr learned my addr 172.21.15.144:0/2452816078 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2a3400640 1 --2- 172.21.15.144:0/2452816078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a4147fa0 0x7fd2a406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2a3e00640 1 -- 172.21.15.144:0/2452816078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a4147fa0 msgr2=0x7fd2a406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2a3e00640 1 --2- 172.21.15.144:0/2452816078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a4147fa0 0x7fd2a406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2a3e00640 1 -- 172.21.15.144:0/2452816078 >> v1:172.21.15.144:6789/0 conn(0x7fd2a406c150 legacy=0x7fd2a40cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.834+0000 7fd2a3e00640 1 -- 172.21.15.144:0/2452816078 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a4072fc0 con 0x7fd2a40cf920 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2a3e00640 1 --2- 172.21.15.144:0/2452816078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a40cf920 0x7fd2a415ea70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009870 tx=0x7fd29c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62c7a6e6b84b77f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2a2000640 1 -- 172.21.15.144:0/2452816078 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0b0070 con 0x7fd2a40cf920 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2a2000640 1 -- 172.21.15.144:0/2452816078 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c0ab600 con 0x7fd2a40cf920 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2a2000640 1 -- 172.21.15.144:0/2452816078 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0ab9d0 con 0x7fd2a40cf920 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2aa000640 1 -- 172.21.15.144:0/2452816078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a40cf920 msgr2=0x7fd2a415ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2aa000640 1 --2- 172.21.15.144:0/2452816078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a40cf920 0x7fd2a415ea70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd29c009870 tx=0x7fd29c01c440 comp rx=0 tx=0).stop 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2aa000640 1 -- 172.21.15.144:0/2452816078 shutdown_connections 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2aa000640 1 --2- 172.21.15.144:0/2452816078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a40cf920 0x7fd2a415ea70 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2aa000640 1 --2- 172.21.15.144:0/2452816078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a4147fa0 0x7fd2a406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2aa000640 1 -- 172.21.15.144:0/2452816078 >> 172.21.15.144:0/2452816078 conn(0x7fd2a406cd20 msgr2=0x7fd2a406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2aa000640 1 -- 172.21.15.144:0/2452816078 shutdown_connections 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.838+0000 7fd2aa000640 1 -- 172.21.15.144:0/2452816078 wait complete. 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 Processor -- start 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 -- start start 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a406c150 0x7fd2a40cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a40cf920 0x7fd2a40ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a4147fa0 0x7fd2a41465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a415f940 con 0x7fd2a4147fa0 2024-09-12T12:17:14.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a415f7c0 con 0x7fd2a406c150 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a415fac0 con 0x7fd2a40cf920 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a4147fa0 0x7fd2a41465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a4147fa0 0x7fd2a41465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41730/0 (socket says 172.21.15.144:41730) 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3e00640 1 -- 172.21.15.144:0/2939294844 learned_addr learned my addr 172.21.15.144:0/2939294844 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a2a00640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a40cf920 0x7fd2a40ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3400640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a406c150 0x7fd2a40cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3e00640 1 -- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a40cf920 msgr2=0x7fd2a40ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3e00640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a40cf920 0x7fd2a40ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3e00640 1 -- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a406c150 msgr2=0x7fd2a40cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3e00640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a406c150 0x7fd2a40cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3e00640 1 -- 172.21.15.144:0/2939294844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a40ca920 con 0x7fd2a4147fa0 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a2a00640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a40cf920 0x7fd2a40ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3400640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a406c150 0x7fd2a40cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2a3e00640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a4147fa0 0x7fd2a41465f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd29c01a070 tx=0x7fd29c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd29b400640 1 -- 172.21.15.144:0/2939294844 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0b0040 con 0x7fd2a4147fa0 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd29b400640 1 -- 172.21.15.144:0/2939294844 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c0b9070 con 0x7fd2a4147fa0 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a40ce710 con 0x7fd2a4147fa0 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd29b400640 1 -- 172.21.15.144:0/2939294844 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0b4640 con 0x7fd2a4147fa0 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a40cecd0 con 0x7fd2a4147fa0 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.842+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a413e310 con 0x7fd2a4147fa0 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.846+0000 7fd29b400640 1 -- 172.21.15.144:0/2939294844 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd29c0b47e0 con 0x7fd2a4147fa0 2024-09-12T12:17:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.846+0000 7fd29b400640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2840678f0 0x7fd284069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:14.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.846+0000 7fd29b400640 1 -- 172.21.15.144:0/2939294844 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fd29c11fb10 con 0x7fd2a4147fa0 2024-09-12T12:17:14.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.846+0000 7fd2a3400640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2840678f0 0x7fd284069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:14.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.846+0000 7fd2a3400640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2840678f0 0x7fd284069db0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd294009f50 tx=0x7fd29400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:14.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:14.850+0000 7fd29b400640 1 -- 172.21.15.144:0/2939294844 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd29c016150 con 0x7fd2a4147fa0 2024-09-12T12:17:15.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.042+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2a40b67d0 con 0x7fd2a4147fa0 2024-09-12T12:17:15.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.042+0000 7fd29b400640 1 -- 172.21.15.144:0/2939294844 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5237 (secure 0 0 0) 0x7fd29c0f0420 con 0x7fd2a4147fa0 2024-09-12T12:17:15.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:15.046 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":54,"btime":"2024-09-12T12:17:08:287906+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/4129870327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4129870327},{"type":"v1","addr":"172.21.15.165:6833","nonce":4129870327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6481,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2560551355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2560551355},{"type":"v1","addr":"172.21.15.165:6835","nonce":2560551355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2937095908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2937095908},{"type":"v1","addr":"172.21.15.144:6836","nonce":2937095908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:07.666928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2111043825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2111043825},{"type":"v1","addr":"172.21.15.144:6837","nonce":2111043825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6690,"qdb_cluster":[6690]},"id":5}]} 2024-09-12T12:17:15.046 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 54 2024-09-12T12:17:15.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2840678f0 msgr2=0x7fd284069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2840678f0 0x7fd284069db0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd294009f50 tx=0x7fd29400b040 comp rx=0 tx=0).stop 2024-09-12T12:17:15.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a4147fa0 msgr2=0x7fd2a41465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a4147fa0 0x7fd2a41465f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd29c01a070 tx=0x7fd29c0191e0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 shutdown_connections 2024-09-12T12:17:15.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2840678f0 0x7fd284069db0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2a4147fa0 0x7fd2a41465f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2a40cf920 0x7fd2a40ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 --2- 172.21.15.144:0/2939294844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2a406c150 0x7fd2a40cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 >> 172.21.15.144:0/2939294844 conn(0x7fd2a406cd20 msgr2=0x7fd2a40b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:15.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 shutdown_connections 2024-09-12T12:17:15.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.046+0000 7fd2aa000640 1 -- 172.21.15.144:0/2939294844 wait complete. 2024-09-12T12:17:15.472 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:17:04.644714+0000', 'modified': '2024-09-12T12:17:07.666928+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6690}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6690': {'gid': 6690, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/2111043825', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 2111043825}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 2111043825}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6690, 'qdb_cluster': [6690]} 2024-09-12T12:17:15.472 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:17:15.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T12:17:15.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.606+0000 7fbee3000640 1 Processor -- start 2024-09-12T12:17:15.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.606+0000 7fbee3000640 1 -- start start 2024-09-12T12:17:15.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.606+0000 7fbee3000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbedc15e080 0x7fbedc15e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.606+0000 7fbee3000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc06ed60 con 0x7fbedc0d18c0 2024-09-12T12:17:15.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.606+0000 7fbee3000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc06e7a0 con 0x7fbedc15f3b0 2024-09-12T12:17:15.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.606+0000 7fbee3000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbedc06ea80 con 0x7fbedc15e080 2024-09-12T12:17:15.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbee1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbedc15e080 0x7fbedc15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbee1200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbedc0d18c0 0x7fbedc162810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44894/0 (socket says 172.21.15.144:44894) 2024-09-12T12:17:15.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbee1200640 1 -- 172.21.15.144:0/3184212569 learned_addr learned my addr 172.21.15.144:0/3184212569 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:15.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbee1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbedc15e080 0x7fbedc15e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41746/0 (socket says 172.21.15.144:41746) 2024-09-12T12:17:15.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbee1c00640 1 -- 172.21.15.144:0/3184212569 >> v1:172.21.15.165:6789/0 conn(0x7fbedc15f3b0 legacy=0x7fbedc06f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbee1c00640 1 -- 172.21.15.144:0/3184212569 >> v1:172.21.15.144:6789/0 conn(0x7fbedc0d18c0 legacy=0x7fbedc162810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbee1c00640 1 -- 172.21.15.144:0/3184212569 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc162010 con 0x7fbedc15e080 2024-09-12T12:17:15.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbee1c00640 1 --2- 172.21.15.144:0/3184212569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15e080 0x7fbedc15e460 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009d90 tx=0x7fbed001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2a28e90d21cb1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbedbe00640 1 -- 172.21.15.144:0/3184212569 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed00b2070 con 0x7fbedc15e080 2024-09-12T12:17:15.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbedbe00640 1 -- 172.21.15.144:0/3184212569 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed00a57f0 con 0x7fbedc15e080 2024-09-12T12:17:15.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.610+0000 7fbedbe00640 1 -- 172.21.15.144:0/3184212569 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed00a5bc0 con 0x7fbedc15e080 2024-09-12T12:17:15.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 -- 172.21.15.144:0/3184212569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15e080 msgr2=0x7fbedc15e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 --2- 172.21.15.144:0/3184212569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15e080 0x7fbedc15e460 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009d90 tx=0x7fbed001c8e0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 -- 172.21.15.144:0/3184212569 shutdown_connections 2024-09-12T12:17:15.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 --2- 172.21.15.144:0/3184212569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15e080 0x7fbedc15e460 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 -- 172.21.15.144:0/3184212569 >> 172.21.15.144:0/3184212569 conn(0x7fbedc06c010 msgr2=0x7fbedc0b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:15.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 -- 172.21.15.144:0/3184212569 shutdown_connections 2024-09-12T12:17:15.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 -- 172.21.15.144:0/3184212569 wait complete. 2024-09-12T12:17:15.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 Processor -- start 2024-09-12T12:17:15.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 -- start start 2024-09-12T12:17:15.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbedc0d18c0 0x7fbedc154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbedc15e080 0x7fbedc1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15f3b0 0x7fbedc160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc0b5c00 con 0x7fbedc15f3b0 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc06fd60 con 0x7fbedc0d18c0 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbedc0b5d80 con 0x7fbedc15e080 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15f3b0 0x7fbedc160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15f3b0 0x7fbedc160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41754/0 (socket says 172.21.15.144:41754) 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee2600640 1 -- 172.21.15.144:0/3871139149 learned_addr learned my addr 172.21.15.144:0/3871139149 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee1c00640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbedc0d18c0 0x7fbedc154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee1200640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbedc15e080 0x7fbedc1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee2600640 1 -- 172.21.15.144:0/3871139149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbedc15e080 msgr2=0x7fbedc1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee2600640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbedc15e080 0x7fbedc1601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee2600640 1 -- 172.21.15.144:0/3871139149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbedc0d18c0 msgr2=0x7fbedc154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee2600640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbedc0d18c0 0x7fbedc154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee2600640 1 -- 172.21.15.144:0/3871139149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc15be70 con 0x7fbedc15f3b0 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.614+0000 7fbee1c00640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbedc0d18c0 0x7fbedc154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbee2600640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15f3b0 0x7fbedc160710 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c340 tx=0x7fbed400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbed9600640 1 -- 172.21.15.144:0/3871139149 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4005220 con 0x7fbedc15f3b0 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbed9600640 1 -- 172.21.15.144:0/3871139149 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed40053c0 con 0x7fbedc15f3b0 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbee3000640 1 -- 172.21.15.144:0/3871139149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc1571e0 con 0x7fbedc15f3b0 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbed9600640 1 -- 172.21.15.144:0/3871139149 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4007270 con 0x7fbedc15f3b0 2024-09-12T12:17:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbee3000640 1 -- 172.21.15.144:0/3871139149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc15c110 con 0x7fbedc15f3b0 2024-09-12T12:17:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbed9600640 1 -- 172.21.15.144:0/3871139149 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbed4019020 con 0x7fbedc15f3b0 2024-09-12T12:17:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbed9600640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbebc0678c0 0x7fbebc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbed9600640 1 -- 172.21.15.144:0/3871139149 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fbed4085130 con 0x7fbedc15f3b0 2024-09-12T12:17:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbee1c00640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbebc0678c0 0x7fbebc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbee7a5f000 1 Processor -- start 2024-09-12T12:17:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.618+0000 7fbee7a5f000 1 -- start start 2024-09-12T12:17:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbebc0678c0 0x7fbebc069d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbed00af000 tx=0x7fbed00a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e71f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e27d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e28290 0x557bd5e28670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557bd5d0fb60 con 0x557bd5e71b20 2024-09-12T12:17:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557bd5c76c70 con 0x557bd5e72440 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557bd5c1ced0 con 0x557bd5e28290 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e71f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e71f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41768/0 (socket says 172.21.15.144:41768) 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 -- 172.21.15.144:0/2441974848 learned_addr learned my addr 172.21.15.144:0/2441974848 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee2600640 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e28290 0x557bd5e28670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 -- 172.21.15.144:0/2441974848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e28290 msgr2=0x557bd5e28670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1200640 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e27d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e28290 0x557bd5e28670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 -- 172.21.15.144:0/2441974848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 msgr2=0x557bd5e27d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e27d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 -- 172.21.15.144:0/2441974848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd5c2ee50 con 0x557bd5e71b20 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1200640 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e27d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee1c00640 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e71f00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009bd0 tx=0x7fbed0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd788a6873af51d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbece000640 1 -- 172.21.15.144:0/2441974848 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed00b2040 con 0x557bd5e71b20 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbece000640 1 -- 172.21.15.144:0/2441974848 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed00b8700 con 0x557bd5e71b20 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbece000640 1 -- 172.21.15.144:0/2441974848 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed00b8ab0 con 0x557bd5e71b20 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2441974848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 msgr2=0x557bd5e71f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e71f00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009bd0 tx=0x7fbed0004ac0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2441974848 shutdown_connections 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e28290 0x557bd5e28670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e27d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2441974848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e71f00 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2441974848 >> 172.21.15.144:0/2441974848 conn(0x557bd5e2e600 msgr2=0x557bd5e26630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2441974848 shutdown_connections 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2441974848 wait complete. 2024-09-12T12:17:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 -- start start 2024-09-12T12:17:15.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.622+0000 7fbee7a5f000 1 Processor -- start 2024-09-12T12:17:15.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 0x557bd5e2ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5e32cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5e33230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557bd5cd8b00 con 0x557bd5e72440 2024-09-12T12:17:15.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557bd5c51360 con 0x557bd5e71b20 2024-09-12T12:17:15.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557bd5c4e2d0 con 0x557bd5e2d390 2024-09-12T12:17:15.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 10 client.0 _ll_register_callbacks cb 0x557bd5e13820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5e32cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5e32cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41774/0 (socket says 172.21.15.144:41774) 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1200640 1 -- 172.21.15.144:0/3753679925 learned_addr learned my addr 172.21.15.144:0/3753679925 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee2600640 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5e33230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1c00640 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 0x557bd5e2ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1200640 1 -- 172.21.15.144:0/3753679925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 msgr2=0x557bd5e33230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1200640 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5e33230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1200640 1 -- 172.21.15.144:0/3753679925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 msgr2=0x557bd5e2ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1200640 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 0x557bd5e2ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1200640 1 -- 172.21.15.144:0/3753679925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd5c1d120 con 0x557bd5e72440 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1c00640 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 0x557bd5e2ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1200640 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5e32cf0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbec80073c0 tx=0x7fbec8007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747f27bbbe187016 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbec2a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbec2a00640 1 -- 172.21.15.144:0/3753679925 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8001c00 con 0x557bd5e72440 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbec2a00640 1 -- 172.21.15.144:0/3753679925 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fbec8014400 con 0x557bd5e72440 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 -- 172.21.15.144:0/3753679925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed00b8700 con 0x557bd5e72440 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbec2a00640 1 -- 172.21.15.144:0/3753679925 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fbec8021050 con 0x557bd5e72440 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 10 client.6846 fetch_fsmap learned FSMap version 54 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 -- 172.21.15.144:0/3753679925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x557bd5c16450 con 0x557bd5e72440 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbec2a00640 1 -- 172.21.15.144:0/3753679925 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed00b8700 con 0x557bd5e72440 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbec2a00640 1 -- 172.21.15.144:0/3753679925 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7fbec8024020 con 0x557bd5e72440 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 10 client.6846 fetch_fsmap finished waiting for FSMap version 54 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 10 client.6846 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 20 client.6846 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] conn(0x557bd5e77f50 0x557bd5e78330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 4 client.6846 mds_command: new command op to 6690 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:15.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee7a5f000 1 -- 172.21.15.144:0/3753679925 --> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bd5c10c00 con 0x557bd5e77f50 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1c00640 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] conn(0x557bd5e77f50 0x557bd5e78330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbee1c00640 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] conn(0x557bd5e77f50 0x557bd5e78330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc575fa9473883f1 server_cookie=8c6f9294b044b805 in_seq=0 out_seq=0 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.626+0000 7fbec2a00640 10 client.6846 ms_handle_connect on v2:172.21.15.144:6835/2111043825 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbec2a00640 1 -- 172.21.15.144:0/3753679925 <== mds.0 v2:172.21.15.144:6835/2111043825 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557bd5c10c00 con 0x557bd5e77f50 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbec2a00640 10 client.6846 handle_command_reply: tid=0 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 client.6846 shutdown 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 -- 172.21.15.144:0/3753679925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 msgr2=0x557bd5e32cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5e32cf0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbec80073c0 tx=0x7fbec8007880 comp rx=0 tx=0).stop 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 -- 172.21.15.144:0/3753679925 shutdown_connections 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] conn(0x557bd5e77f50 0x557bd5e78330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5e33230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5e32cf0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/3753679925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 0x557bd5e2ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbec2a00640 0 client.6846 ms_handle_reset on v2:172.21.15.144:6835/2111043825 2024-09-12T12:17:15.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 -- 172.21.15.144:0/3753679925 >> 172.21.15.144:0/3753679925 conn(0x557bd5e28290 msgr2=0x557bd5e26d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:15.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 -- 172.21.15.144:0/3753679925 shutdown_connections 2024-09-12T12:17:15.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 1 -- 172.21.15.144:0/3753679925 wait complete. 2024-09-12T12:17:15.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.630+0000 7fbee7a5f000 20 client.6846 trim_cache size 0 max 16384 2024-09-12T12:17:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.646+0000 7fbee7a5f000 1 Processor -- start 2024-09-12T12:17:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.646+0000 7fbee7a5f000 1 -- start start 2024-09-12T12:17:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5e88850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e70cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e71230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc203030 con 0x557bd5e71b20 2024-09-12T12:17:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc0cd770 con 0x557bd5e72440 2024-09-12T12:17:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbedc202a10 con 0x557bd5e2d390 2024-09-12T12:17:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e70cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e70cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41788/0 (socket says 172.21.15.144:41788) 2024-09-12T12:17:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1200640 1 -- 172.21.15.144:0/2414269561 learned_addr learned my addr 172.21.15.144:0/2414269561 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1c00640 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5e88850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee2600640 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e71230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1200640 1 -- 172.21.15.144:0/2414269561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 msgr2=0x557bd5e88850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1200640 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5e88850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1200640 1 -- 172.21.15.144:0/2414269561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 msgr2=0x557bd5e71230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1200640 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e71230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1200640 1 -- 172.21.15.144:0/2414269561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd5bfdfd0 con 0x557bd5e71b20 2024-09-12T12:17:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee2600640 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e71230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee1200640 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e70cf0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbec8001ec0 tx=0x7fbec8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29285399087022be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbecd600640 1 -- 172.21.15.144:0/2414269561 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec80016c0 con 0x557bd5e71b20 2024-09-12T12:17:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbecd600640 1 -- 172.21.15.144:0/2414269561 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec8019070 con 0x557bd5e71b20 2024-09-12T12:17:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbecd600640 1 -- 172.21.15.144:0/2414269561 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8007b90 con 0x557bd5e71b20 2024-09-12T12:17:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2414269561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 msgr2=0x557bd5e70cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e70cf0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbec8001ec0 tx=0x7fbec8013000 comp rx=0 tx=0).stop 2024-09-12T12:17:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2414269561 shutdown_connections 2024-09-12T12:17:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e72440 0x557bd5e71230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e71b20 0x557bd5e70cf0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2414269561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5e88850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2414269561 >> 172.21.15.144:0/2414269561 conn(0x557bd5e28290 msgr2=0x557bd5e2c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2414269561 shutdown_connections 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2414269561 wait complete. 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- start start 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 Processor -- start 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5eed620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 0x557bd5eedb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5eee0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557bd5c75f80 con 0x557bd5e72440 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557bd5c2eca0 con 0x557bd5e71b20 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557bd5c7b2a0 con 0x557bd5e2d390 2024-09-12T12:17:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee7a5f000 10 client.0 _ll_register_callbacks cb 0x7fbec80058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:15.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.650+0000 7fbee2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5eee0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5eee0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41796/0 (socket says 172.21.15.144:41796) 2024-09-12T12:17:15.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee2600640 1 -- 172.21.15.144:0/2659122615 learned_addr learned my addr 172.21.15.144:0/2659122615 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:15.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee1c00640 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5eed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee1200640 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 0x557bd5eedb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee2600640 1 -- 172.21.15.144:0/2659122615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 msgr2=0x557bd5eed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:15.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee2600640 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5eed620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee2600640 1 -- 172.21.15.144:0/2659122615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 msgr2=0x557bd5eedb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee2600640 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 0x557bd5eedb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee2600640 1 -- 172.21.15.144:0/2659122615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd5cf9750 con 0x557bd5e72440 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee2600640 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5eee0a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbed405d9f0 tx=0x7fbed4055340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e2e662bd7f0ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 1 -- 172.21.15.144:0/2659122615 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed406d1d0 con 0x557bd5e72440 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 1 -- 172.21.15.144:0/2659122615 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fbed405da90 con 0x557bd5e72440 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2659122615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbec8019070 con 0x557bd5e72440 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 1 -- 172.21.15.144:0/2659122615 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fbed406d370 con 0x557bd5e72440 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 10 client.6852 fetch_fsmap learned FSMap version 54 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2659122615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x557bd5c04a30 con 0x557bd5e72440 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 1 -- 172.21.15.144:0/2659122615 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec8019070 con 0x557bd5e72440 2024-09-12T12:17:15.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 1 -- 172.21.15.144:0/2659122615 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7fbed4007410 con 0x557bd5e72440 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 10 client.6852 fetch_fsmap finished waiting for FSMap version 54 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 10 client.6852 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 20 client.6852 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] conn(0x557bd5e7bc10 0x557bd5e7bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 4 client.6852 mds_command: new command op to 6690 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2659122615 --> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] -- command(tid 0: {"prefix": "status"}) -- 0x557bd5c843a0 con 0x557bd5e7bc10 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee1c00640 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] conn(0x557bd5e7bc10 0x557bd5e7bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 10 client.6852 ms_handle_connect on v2:172.21.15.144:6835/2111043825 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee1c00640 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] conn(0x557bd5e7bc10 0x557bd5e7bff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d667ea1fa6db79ab server_cookie=b5d695ecdec26538 in_seq=0 out_seq=0 2024-09-12T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 1 -- 172.21.15.144:0/2659122615 <== mds.0 v2:172.21.15.144:6835/2111043825 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x557bd5c843a0 con 0x557bd5e7bc10 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 10 client.6852 handle_command_reply: tid=0 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 client.6852 shutdown 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2659122615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 msgr2=0x557bd5eee0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5eee0a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbed405d9f0 tx=0x7fbed4055340 comp rx=0 tx=0).stop 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2659122615 shutdown_connections 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.144:6835/2111043825,v1:172.21.15.144:6837/2111043825] conn(0x557bd5e7bc10 0x557bd5e7bff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557bd5e72440 0x557bd5eee0a0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557bd5e71b20 0x557bd5eedb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbec2a00640 0 client.6852 ms_handle_reset on v2:172.21.15.144:6835/2111043825 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 --2- 172.21.15.144:0/2659122615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557bd5e2d390 0x557bd5eed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2659122615 >> 172.21.15.144:0/2659122615 conn(0x557bd5e28290 msgr2=0x557bd5e6fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2659122615 shutdown_connections 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 1 -- 172.21.15.144:0/2659122615 wait complete. 2024-09-12T12:17:15.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee7a5f000 20 client.6852 trim_cache size 0 max 16384 2024-09-12T12:17:15.663 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:17:15.663 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:17:15.663 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:17:15.663 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 6690, 2024-09-12T12:17:15.663 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:17:15.663 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:17:15.663 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:17:15.663 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 10.399146026, 2024-09-12T12:17:15.663 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 54, 2024-09-12T12:17:15.664 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 83, 2024-09-12T12:17:15.664 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-12T12:17:15.664 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 15.635607821000001 2024-09-12T12:17:15.664 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:17:15.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 -- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbebc0678c0 msgr2=0x7fbebc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbebc0678c0 0x7fbebc069d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbed00af000 tx=0x7fbed00a7070 comp rx=0 tx=0).stop 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 -- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15f3b0 msgr2=0x7fbedc160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15f3b0 0x7fbedc160710 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbed400c340 tx=0x7fbed400c800 comp rx=0 tx=0).stop 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 -- 172.21.15.144:0/3871139149 shutdown_connections 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbebc0678c0 0x7fbebc069d80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbedc15f3b0 0x7fbedc160710 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbedc15e080 0x7fbedc1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 --2- 172.21.15.144:0/3871139149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbedc0d18c0 0x7fbedc154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 -- 172.21.15.144:0/3871139149 >> 172.21.15.144:0/3871139149 conn(0x7fbedc06c010 msgr2=0x7fbedc073010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 -- 172.21.15.144:0/3871139149 shutdown_connections 2024-09-12T12:17:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.654+0000 7fbee3000640 1 -- 172.21.15.144:0/3871139149 wait complete. 2024-09-12T12:17:15.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:17:15.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc97bc00640 1 Processor -- start 2024-09-12T12:17:15.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc97bc00640 1 -- start start 2024-09-12T12:17:15.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc97bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc97bc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc9740afab0 0x7fc9740b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc97bc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9740b54a0 con 0x7fc97415e600 2024-09-12T12:17:15.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc97bc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc9740b5270 con 0x7fc9740afab0 2024-09-12T12:17:15.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc97bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc974163020 con 0x7fc97406f020 2024-09-12T12:17:15.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc973e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc979c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc9740afab0 0x7fc9740b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc973e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50280/0 (socket says 172.21.15.144:50280) 2024-09-12T12:17:15.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc973e00640 1 -- 172.21.15.144:0/2203046414 learned_addr learned my addr 172.21.15.144:0/2203046414 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:15.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc979c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc9740afab0 0x7fc9740b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43736/0 (socket says 172.21.15.144:43736) 2024-09-12T12:17:15.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc973e00640 1 -- 172.21.15.144:0/2203046414 >> v2:172.21.15.165:3300/0 conn(0x7fc9740afab0 msgr2=0x7fc9740b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:15.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc973e00640 1 --2- 172.21.15.144:0/2203046414 >> v2:172.21.15.165:3300/0 conn(0x7fc9740afab0 0x7fc9740b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc973e00640 1 -- 172.21.15.144:0/2203046414 >> v1:172.21.15.165:6789/0 conn(0x7fc97415e600 legacy=0x7fc97406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.810+0000 7fc973e00640 1 -- 172.21.15.144:0/2203046414 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9740b5780 con 0x7fc97406f020 2024-09-12T12:17:15.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc973e00640 1 --2- 172.21.15.144:0/2203046414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740717f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc960009870 tx=0x7fc96001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62d54a7bb6ee690 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc973400640 1 -- 172.21.15.144:0/2203046414 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9600b0070 con 0x7fc97406f020 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc973400640 1 -- 172.21.15.144:0/2203046414 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc960004230 con 0x7fc97406f020 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc973400640 1 -- 172.21.15.144:0/2203046414 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc960003620 con 0x7fc97406f020 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc97bc00640 1 -- 172.21.15.144:0/2203046414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 msgr2=0x7fc9740717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc97bc00640 1 --2- 172.21.15.144:0/2203046414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740717f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc960009870 tx=0x7fc96001c560 comp rx=0 tx=0).stop 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc97bc00640 1 -- 172.21.15.144:0/2203046414 shutdown_connections 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc97bc00640 1 --2- 172.21.15.144:0/2203046414 >> v2:172.21.15.165:3300/0 conn(0x7fc9740afab0 0x7fc9740b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc97bc00640 1 --2- 172.21.15.144:0/2203046414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740717f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc97bc00640 1 -- 172.21.15.144:0/2203046414 >> 172.21.15.144:0/2203046414 conn(0x7fc97406ddf0 msgr2=0x7fc97406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc97bc00640 1 -- 172.21.15.144:0/2203046414 shutdown_connections 2024-09-12T12:17:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.814+0000 7fc97bc00640 1 -- 172.21.15.144:0/2203046414 wait complete. 2024-09-12T12:17:15.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 Processor -- start 2024-09-12T12:17:15.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 -- start start 2024-09-12T12:17:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9740afab0 0x7fc974150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97415e600 0x7fc974151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc97416b3b0 con 0x7fc97415e600 2024-09-12T12:17:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc97416b230 con 0x7fc9740afab0 2024-09-12T12:17:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc97416b530 con 0x7fc97406f020 2024-09-12T12:17:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97415e600 0x7fc974151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97415e600 0x7fc974151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41808/0 (socket says 172.21.15.144:41808) 2024-09-12T12:17:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979c00640 1 -- 172.21.15.144:0/4042870006 learned_addr learned my addr 172.21.15.144:0/4042870006 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979200640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc973e00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9740afab0 0x7fc974150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979c00640 1 -- 172.21.15.144:0/4042870006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 msgr2=0x7fc9740b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979c00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979c00640 1 -- 172.21.15.144:0/4042870006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9740afab0 msgr2=0x7fc974150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979c00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9740afab0 0x7fc974150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979c00640 1 -- 172.21.15.144:0/4042870006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97414fb00 con 0x7fc97415e600 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc979c00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97415e600 0x7fc974151470 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00e880 tx=0x7fc96c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc970c00640 1 -- 172.21.15.144:0/4042870006 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c017070 con 0x7fc97415e600 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc970c00640 1 -- 172.21.15.144:0/4042870006 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96c00c940 con 0x7fc97415e600 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc970c00640 1 -- 172.21.15.144:0/4042870006 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00cd10 con 0x7fc97415e600 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97414fde0 con 0x7fc97415e600 2024-09-12T12:17:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.818+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9741503a0 con 0x7fc97415e600 2024-09-12T12:17:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.822+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9740717f0 con 0x7fc97415e600 2024-09-12T12:17:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.822+0000 7fc970c00640 1 -- 172.21.15.144:0/4042870006 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc96c01a070 con 0x7fc97415e600 2024-09-12T12:17:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.822+0000 7fc970c00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9540678c0 0x7fc954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.822+0000 7fc970c00640 1 -- 172.21.15.144:0/4042870006 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fc96c086260 con 0x7fc97415e600 2024-09-12T12:17:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.822+0000 7fc979200640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9540678c0 0x7fc954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.822+0000 7fc979200640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9540678c0 0x7fc954069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc9740cd0c0 tx=0x7fc964009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:15.826+0000 7fc970c00640 1 -- 172.21.15.144:0/4042870006 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc96c056b70 con 0x7fc97415e600 2024-09-12T12:17:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc974072420 con 0x7fc97415e600 2024-09-12T12:17:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc970c00640 1 -- 172.21.15.144:0/4042870006 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) ==== 53+0+73 (secure 0 0 0) 0x7fc96c056470 con 0x7fc97415e600 2024-09-12T12:17:16.025 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:17:16.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9540678c0 msgr2=0x7fc954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:16.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9540678c0 0x7fc954069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc9740cd0c0 tx=0x7fc964009040 comp rx=0 tx=0).stop 2024-09-12T12:17:16.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97415e600 msgr2=0x7fc974151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:16.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97415e600 0x7fc974151470 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00e880 tx=0x7fc96c00ed40 comp rx=0 tx=0).stop 2024-09-12T12:17:16.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 shutdown_connections 2024-09-12T12:17:16.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9540678c0 0x7fc954069d80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97415e600 0x7fc974151470 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9740afab0 0x7fc974150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 --2- 172.21.15.144:0/4042870006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc97406f020 0x7fc9740b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:16.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 >> 172.21.15.144:0/4042870006 conn(0x7fc97406ddf0 msgr2=0x7fc97406e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:16.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 shutdown_connections 2024-09-12T12:17:16.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16.022+0000 7fc97bc00640 1 -- 172.21.15.144:0/4042870006 wait complete. 2024-09-12T12:17:16.046 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:17:16.046 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:17:16.046 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:17:16.046 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:17:16.046 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:16.046 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:17:16.046 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:17:16.046 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:17:16.047 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:17:16.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:16.047 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:17:16.056 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:17:16.056 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:17:16.056 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:17:16.056 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:16.056 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:17:16.056 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:16.056 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:17:16.056 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42147sec preferred_lft 42147sec 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:16.057 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:17:16.058 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:16.059 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:17:16.059 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:17:16.059 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:17:16.059 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:16.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:16.060 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:17:16.120 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:17:16.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:16.123 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:17:16.177 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:17:16.178 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:17:16.179 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:17:16.179 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:17:16.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:17:16.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:17:16.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:17:16.179 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:17:16.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:17:16.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:17:16.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:16.317 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:17:16.326 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:17:16.326 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:17:16.326 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:17:16.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:16.326 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:17:16.387 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:17:16.387 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:16.443 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:17:16.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:17:16.443 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:16.498 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:17:16.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:16.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:17:16.587 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:17:16.587 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:17:16.600 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:17:16.600 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:17:16.600 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:17:16.600 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:17:16.601 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:17:16.604 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:17:16.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:16.605 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:16.624 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:17:16.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:17:16.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:17:16.734 INFO:teuthology.orchestra.run.smithi144.stdout:client6858 2024-09-12T12:17:16.735 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:16.735 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:16.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:16.744 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-09-12T12:17:16.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:16.806 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-09-12T12:17:16.857 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:17:16.857 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:17:16.857 DEBUG:teuthology.orchestra.run.smithi144:> import stat 2024-09-12T12:17:16.858 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:17:16.858 DEBUG:teuthology.orchestra.run.smithi144:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-09-12T12:17:16.858 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:17:16.961 INFO:teuthology.orchestra.run.smithi144.stdout:1099511627776 2024-09-12T12:17:16.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:17:16.970 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:16.970 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:17.023 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:17.024 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:17.075 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:17:17.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.250+0000 7f9b4ea00640 1 Processor -- start 2024-09-12T12:17:17.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.250+0000 7f9b4ea00640 1 -- start start 2024-09-12T12:17:17.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b4815b4e0 0x7f9b480b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9b480b3ad0 0x7f9b48071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9b48071960 0x7f9b480ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ea00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9b480b45a0 con 0x7f9b48071960 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ea00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9b480b3fe0 con 0x7f9b480b3ad0 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ea00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9b480b42c0 con 0x7f9b4815b4e0 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9b48071960 0x7f9b480ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9b48071960 0x7f9b480ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50234/0 (socket says 172.21.15.144:50234) 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ca00640 1 -- 172.21.15.144:0/346122668 learned_addr learned my addr 172.21.15.144:0/346122668 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b47400640 1 --2- 172.21.15.144:0/346122668 >> v2:172.21.15.165:3300/0 conn(0x7f9b480b3ad0 0x7f9b48071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b47e00640 1 --2- 172.21.15.144:0/346122668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b4815b4e0 0x7f9b480b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ca00640 1 -- 172.21.15.144:0/346122668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b4815b4e0 msgr2=0x7f9b480b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ca00640 1 --2- 172.21.15.144:0/346122668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b4815b4e0 0x7f9b480b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ca00640 1 -- 172.21.15.144:0/346122668 >> v2:172.21.15.165:3300/0 conn(0x7f9b480b3ad0 msgr2=0x7f9b48071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:17.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ca00640 1 --2- 172.21.15.144:0/346122668 >> v2:172.21.15.165:3300/0 conn(0x7f9b480b3ad0 0x7f9b48071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.254+0000 7f9b4ca00640 1 -- 172.21.15.144:0/346122668 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b480b1490 con 0x7f9b48071960 2024-09-12T12:17:17.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ca00640 1 --2- 172.21.15.144:0/346122668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b48071960 0x7f9b480ccf30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9b4806a020 tx=0x7f9b4001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd72ca050091c3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:17.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b46a00640 1 -- 172.21.15.144:0/346122668 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b400b1070 con 0x7f9b48071960 2024-09-12T12:17:17.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b46a00640 1 -- 172.21.15.144:0/346122668 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b400ac620 con 0x7f9b48071960 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b46a00640 1 -- 172.21.15.144:0/346122668 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b400ac9f0 con 0x7f9b48071960 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 -- 172.21.15.144:0/346122668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b48071960 msgr2=0x7f9b480ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/346122668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b48071960 0x7f9b480ccf30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9b4806a020 tx=0x7f9b4001c4f0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 -- 172.21.15.144:0/346122668 shutdown_connections 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/346122668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b48071960 0x7f9b480ccf30 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/346122668 >> v2:172.21.15.165:3300/0 conn(0x7f9b480b3ad0 0x7f9b48071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/346122668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b4815b4e0 0x7f9b480b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 -- 172.21.15.144:0/346122668 >> 172.21.15.144:0/346122668 conn(0x7f9b4806d0d0 msgr2=0x7f9b4806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 -- 172.21.15.144:0/346122668 shutdown_connections 2024-09-12T12:17:17.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 -- 172.21.15.144:0/346122668 wait complete. 2024-09-12T12:17:17.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 Processor -- start 2024-09-12T12:17:17.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 -- start start 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b48071960 0x7f9b4814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b480b3ad0 0x7f9b4814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.258+0000 7f9b4ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b4815b4e0 0x7f9b48164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4815f270 con 0x7f9b4815b4e0 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ea00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4815f0f0 con 0x7f9b480b3ad0 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ea00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4815f3f0 con 0x7f9b48071960 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b4815b4e0 0x7f9b48164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b47e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b48071960 0x7f9b4814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b47e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b48071960 0x7f9b4814db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:42282/0 (socket says 172.21.15.144:42282) 2024-09-12T12:17:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b47e00640 1 -- 172.21.15.144:0/2829393889 learned_addr learned my addr 172.21.15.144:0/2829393889 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b4815b4e0 0x7f9b48164610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50250/0 (socket says 172.21.15.144:50250) 2024-09-12T12:17:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b47400640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b480b3ad0 0x7f9b4814e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ca00640 1 -- 172.21.15.144:0/2829393889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b48071960 msgr2=0x7f9b4814db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ca00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b48071960 0x7f9b4814db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ca00640 1 -- 172.21.15.144:0/2829393889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b480b3ad0 msgr2=0x7f9b4814e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ca00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b480b3ad0 0x7f9b4814e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ca00640 1 -- 172.21.15.144:0/2829393889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4814ebb0 con 0x7f9b4815b4e0 2024-09-12T12:17:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ca00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b4815b4e0 0x7f9b48164610 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9b480b4b40 tx=0x7f9b40019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b3fe00640 1 -- 172.21.15.144:0/2829393889 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b400bb070 con 0x7f9b4815b4e0 2024-09-12T12:17:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b3fe00640 1 -- 172.21.15.144:0/2829393889 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b400b5420 con 0x7f9b4815b4e0 2024-09-12T12:17:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b3fe00640 1 -- 172.21.15.144:0/2829393889 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b400b1040 con 0x7f9b4815b4e0 2024-09-12T12:17:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4814ee90 con 0x7f9b4815b4e0 2024-09-12T12:17:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4814f450 con 0x7f9b4815b4e0 2024-09-12T12:17:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b48071420 con 0x7f9b4815b4e0 2024-09-12T12:17:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.262+0000 7f9b3fe00640 1 -- 172.21.15.144:0/2829393889 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b400be070 con 0x7f9b4815b4e0 2024-09-12T12:17:17.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.266+0000 7f9b3fe00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b280678c0 0x7f9b28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.266+0000 7f9b3fe00640 1 -- 172.21.15.144:0/2829393889 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f9b4011eef0 con 0x7f9b4815b4e0 2024-09-12T12:17:17.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.266+0000 7f9b47e00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b280678c0 0x7f9b28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.266+0000 7f9b47e00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b280678c0 0x7f9b28069d80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b38007440 tx=0x7f9b380098b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:17.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.270+0000 7f9b3fe00640 1 -- 172.21.15.144:0/2829393889 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9b40016110 con 0x7f9b4815b4e0 2024-09-12T12:17:17.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.438+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9b480b62c0 con 0x7f9b4815b4e0 2024-09-12T12:17:17.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.438+0000 7f9b3fe00640 1 -- 172.21.15.144:0/2829393889 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v83) ==== 80+0+0 (secure 0 0 0) 0x7f9b400ef240 con 0x7f9b4815b4e0 2024-09-12T12:17:17.442 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:17:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b280678c0 msgr2=0x7f9b28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b280678c0 0x7f9b28069d80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9b38007440 tx=0x7f9b380098b0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b4815b4e0 msgr2=0x7f9b48164610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b4815b4e0 0x7f9b48164610 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9b480b4b40 tx=0x7f9b40019290 comp rx=0 tx=0).stop 2024-09-12T12:17:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 shutdown_connections 2024-09-12T12:17:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b280678c0 0x7f9b28069d80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b4815b4e0 0x7f9b48164610 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b480b3ad0 0x7f9b4814e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 --2- 172.21.15.144:0/2829393889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b48071960 0x7f9b4814db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 >> 172.21.15.144:0/2829393889 conn(0x7f9b4806d0d0 msgr2=0x7f9b480cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:17.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 shutdown_connections 2024-09-12T12:17:17.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.442+0000 7f9b4ea00640 1 -- 172.21.15.144:0/2829393889 wait complete. 2024-09-12T12:17:17.464 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:17:17.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:17.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:17.512 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:17:17.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:17.512 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:17:17.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.710+0000 7f1e45a00640 1 Processor -- start 2024-09-12T12:17:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.710+0000 7f1e45a00640 1 -- start start 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e45a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e400b0480 0x7f1e40169560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e45a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e40148570 con 0x7f1e40148190 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e45a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e400b41f0 con 0x7f1e400cd640 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e45a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1e400ce090 con 0x7f1e400b0480 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e3f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e400b0480 0x7f1e40169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e3f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e400b0480 0x7f1e40169560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50252/0 (socket says 172.21.15.144:50252) 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e3f400640 1 -- 172.21.15.144:0/3275599589 learned_addr learned my addr 172.21.15.144:0/3275599589 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e3ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1e40148190 0x7f1e400ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37744/0 (socket says 172.21.15.144:37744) 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e3f400640 1 -- 172.21.15.144:0/3275599589 >> v1:172.21.15.165:6789/0 conn(0x7f1e400cd640 legacy=0x7f1e400afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e3f400640 1 -- 172.21.15.144:0/3275599589 >> v1:172.21.15.144:6789/0 conn(0x7f1e40148190 legacy=0x7f1e400ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e3f400640 1 -- 172.21.15.144:0/3275599589 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e400b0950 con 0x7f1e400b0480 2024-09-12T12:17:17.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.714+0000 7f1e3d600640 1 -- 172.21.15.144:0/3275599589 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001482715 0 0) 0x7f1e40148570 con 0x7f1e40148190 2024-09-12T12:17:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e3f400640 1 --2- 172.21.15.144:0/3275599589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 0x7f1e40169560 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1e400b43c0 tx=0x7f1e3801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7f7cbb99b0bed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e3d600640 1 -- 172.21.15.144:0/3275599589 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380ab430 con 0x7f1e400b0480 2024-09-12T12:17:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e3d600640 1 -- 172.21.15.144:0/3275599589 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e380b0070 con 0x7f1e400b0480 2024-09-12T12:17:17.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e3d600640 1 -- 172.21.15.144:0/3275599589 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380ab7f0 con 0x7f1e400b0480 2024-09-12T12:17:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 -- 172.21.15.144:0/3275599589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 msgr2=0x7f1e40169560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 --2- 172.21.15.144:0/3275599589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 0x7f1e40169560 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1e400b43c0 tx=0x7f1e3801c540 comp rx=0 tx=0).stop 2024-09-12T12:17:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 -- 172.21.15.144:0/3275599589 shutdown_connections 2024-09-12T12:17:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 --2- 172.21.15.144:0/3275599589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 0x7f1e40169560 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 -- 172.21.15.144:0/3275599589 >> 172.21.15.144:0/3275599589 conn(0x7f1e4006d0d0 msgr2=0x7f1e4006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 -- 172.21.15.144:0/3275599589 shutdown_connections 2024-09-12T12:17:17.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 -- 172.21.15.144:0/3275599589 wait complete. 2024-09-12T12:17:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 Processor -- start 2024-09-12T12:17:17.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 -- start start 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 0x7f1e40070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.718+0000 7f1e45a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e400cd640 0x7f1e4013d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e45a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e40148190 0x7f1e4015e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e45a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4016c850 con 0x7f1e400b0480 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e45a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4016c6d0 con 0x7f1e400cd640 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e45a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4016c9d0 con 0x7f1e40148190 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 0x7f1e40070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 0x7f1e40070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50268/0 (socket says 172.21.15.144:50268) 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3ea00640 1 -- 172.21.15.144:0/806790547 learned_addr learned my addr 172.21.15.144:0/806790547 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3f400640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e40148190 0x7f1e4015e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3e000640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e400cd640 0x7f1e4013d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3ea00640 1 -- 172.21.15.144:0/806790547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e40148190 msgr2=0x7f1e4015e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e40148190 0x7f1e4015e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3ea00640 1 -- 172.21.15.144:0/806790547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e400cd640 msgr2=0x7f1e4013d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e400cd640 0x7f1e4013d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3ea00640 1 -- 172.21.15.144:0/806790547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4013d860 con 0x7f1e400b0480 2024-09-12T12:17:17.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e3ea00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 0x7f1e40070f00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000c7b0 tx=0x7f1e3000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:17.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e36a00640 1 -- 172.21.15.144:0/806790547 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30018070 con 0x7f1e400b0480 2024-09-12T12:17:17.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e36a00640 1 -- 172.21.15.144:0/806790547 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3000a640 con 0x7f1e400b0480 2024-09-12T12:17:17.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4015d040 con 0x7f1e400b0480 2024-09-12T12:17:17.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e36a00640 1 -- 172.21.15.144:0/806790547 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000aa70 con 0x7f1e400b0480 2024-09-12T12:17:17.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4015d600 con 0x7f1e400b0480 2024-09-12T12:17:17.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e401402e0 con 0x7f1e400b0480 2024-09-12T12:17:17.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.722+0000 7f1e36a00640 1 -- 172.21.15.144:0/806790547 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e3001b070 con 0x7f1e400b0480 2024-09-12T12:17:17.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.726+0000 7f1e36a00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e200678f0 0x7f1e20069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:17.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.726+0000 7f1e36a00640 1 -- 172.21.15.144:0/806790547 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f1e300852d0 con 0x7f1e400b0480 2024-09-12T12:17:17.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.726+0000 7f1e3e000640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e200678f0 0x7f1e20069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:17.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.726+0000 7f1e3e000640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e200678f0 0x7f1e20069db0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1e401402b0 tx=0x7f1e2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:17.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.730+0000 7f1e36a00640 1 -- 172.21.15.144:0/806790547 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e30055620 con 0x7f1e400b0480 2024-09-12T12:17:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.918+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e401443b0 con 0x7f1e400b0480 2024-09-12T12:17:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.918+0000 7f1e36a00640 1 -- 172.21.15.144:0/806790547 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5237 (secure 0 0 0) 0x7f1e30059920 con 0x7f1e400b0480 2024-09-12T12:17:17.923 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:17.923 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":54,"btime":"2024-09-12T12:17:08:287906+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/4129870327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4129870327},{"type":"v1","addr":"172.21.15.165:6833","nonce":4129870327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6481,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2560551355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2560551355},{"type":"v1","addr":"172.21.15.165:6835","nonce":2560551355}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2937095908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2937095908},{"type":"v1","addr":"172.21.15.144:6836","nonce":2937095908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:07.666928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6690},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6690":{"gid":6690,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2111043825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2111043825},{"type":"v1","addr":"172.21.15.144:6837","nonce":2111043825}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6690,"qdb_cluster":[6690]},"id":5}]} 2024-09-12T12:17:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 54 2024-09-12T12:17:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e200678f0 msgr2=0x7f1e20069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e200678f0 0x7f1e20069db0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1e401402b0 tx=0x7f1e2c009040 comp rx=0 tx=0).stop 2024-09-12T12:17:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 msgr2=0x7f1e40070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 0x7f1e40070f00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1e3000c7b0 tx=0x7f1e3000cc70 comp rx=0 tx=0).stop 2024-09-12T12:17:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 shutdown_connections 2024-09-12T12:17:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e200678f0 0x7f1e20069db0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e40148190 0x7f1e4015e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e400cd640 0x7f1e4013d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 --2- 172.21.15.144:0/806790547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e400b0480 0x7f1e40070f00 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 >> 172.21.15.144:0/806790547 conn(0x7f1e4006d0d0 msgr2=0x7f1e40140800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 shutdown_connections 2024-09-12T12:17:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:17.922+0000 7f1e45a00640 1 -- 172.21.15.144:0/806790547 wait complete. 2024-09-12T12:17:17.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-12T12:17:18.111 INFO:teuthology.orchestra.run.smithi144.stdout:{"message":"","return_code":0} 2024-09-12T12:17:18.112 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T12:17:18.112 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:17:18.112 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:18.113 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:17:18.113 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:18.113 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:17:18.113 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:18.114 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:17:18.114 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:18.125 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:17:18.126 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:18.127 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:17:18.127 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:18.129 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:17:18.129 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:18.130 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:17:18.130 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:18.130 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-09-12T12:17:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb20072080 1 Processor -- start 2024-09-12T12:17:18.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb20072080 1 -- start start 2024-09-12T12:17:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb20072080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0697928e0 0x55d0697d9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb20072080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d069867970 0x55d0697c2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb20072080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d0698f1110 0x55d0697b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb20072080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d0697930b0 con 0x55d069867970 2024-09-12T12:17:18.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb20072080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d0696e21b0 con 0x55d0697928e0 2024-09-12T12:17:18.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb20072080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55d069793350 con 0x55d0698f1110 2024-09-12T12:17:18.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d069867970 0x55d0697c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d069867970 0x55d0697c2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50282/0 (socket says 172.21.15.144:50282) 2024-09-12T12:17:18.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb17e00640 1 -- 172.21.15.144:0/1939510119 learned_addr learned my addr 172.21.15.144:0/1939510119 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:18.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb1dc00640 1 --2- 172.21.15.144:0/1939510119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d0698f1110 0x55d0697b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb1d200640 1 --2- 172.21.15.144:0/1939510119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0697928e0 0x55d0697d9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb17e00640 1 -- 172.21.15.144:0/1939510119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d0698f1110 msgr2=0x55d0697b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb17e00640 1 --2- 172.21.15.144:0/1939510119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d0698f1110 0x55d0697b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb17e00640 1 -- 172.21.15.144:0/1939510119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0697928e0 msgr2=0x55d0697d9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb17e00640 1 --2- 172.21.15.144:0/1939510119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0697928e0 0x55d0697d9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb17e00640 1 -- 172.21.15.144:0/1939510119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d069867e10 con 0x55d069867970 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb17e00640 1 --2- 172.21.15.144:0/1939510119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d069867970 0x55d0697c2320 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009820 tx=0x7fcb08005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9d78a2ee41afc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb16a00640 1 -- 172.21.15.144:0/1939510119 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08008b90 con 0x55d069867970 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb16a00640 1 -- 172.21.15.144:0/1939510119 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb08008d30 con 0x55d069867970 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb16a00640 1 -- 172.21.15.144:0/1939510119 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08015690 con 0x55d069867970 2024-09-12T12:17:18.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.218+0000 7fcb20072080 1 -- 172.21.15.144:0/1939510119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d069867970 msgr2=0x55d0697c2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 --2- 172.21.15.144:0/1939510119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d069867970 0x55d0697c2320 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009820 tx=0x7fcb08005a10 comp rx=0 tx=0).stop 2024-09-12T12:17:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- 172.21.15.144:0/1939510119 shutdown_connections 2024-09-12T12:17:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 --2- 172.21.15.144:0/1939510119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d0698f1110 0x55d0697b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 --2- 172.21.15.144:0/1939510119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d069867970 0x55d0697c2320 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 --2- 172.21.15.144:0/1939510119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0697928e0 0x55d0697d9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- 172.21.15.144:0/1939510119 >> 172.21.15.144:0/1939510119 conn(0x55d0697d9d20 msgr2=0x55d06986ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- 172.21.15.144:0/1939510119 shutdown_connections 2024-09-12T12:17:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- 172.21.15.144:0/1939510119 wait complete. 2024-09-12T12:17:18.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 Processor -- start 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- start start 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0697928e0 0x55d069866150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d069867970 0x55d0697d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0698f1110 0x55d0697d8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d06986b790 con 0x55d0697928e0 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d06986ba30 con 0x55d0698f1110 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55d0697b6c00 con 0x55d069867970 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0697928e0 0x55d069866150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0697928e0 0x55d069866150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50284/0 (socket says 172.21.15.144:50284) 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1d200640 1 -- 172.21.15.144:0/2235678701 learned_addr learned my addr 172.21.15.144:0/2235678701 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb17e00640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d069867970 0x55d0697d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1dc00640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0698f1110 0x55d0697d8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1d200640 1 -- 172.21.15.144:0/2235678701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d069867970 msgr2=0x55d0697d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1d200640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d069867970 0x55d0697d7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1d200640 1 -- 172.21.15.144:0/2235678701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0698f1110 msgr2=0x55d0697d8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1d200640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0698f1110 0x55d0697d8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1d200640 1 -- 172.21.15.144:0/2235678701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0699027b0 con 0x55d0697928e0 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1dc00640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d0698f1110 0x55d0697d8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb1d200640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0697928e0 0x55d069866150 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fcb1001c0a0 tx=0x7fcb04004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb15600640 1 -- 172.21.15.144:0/2235678701 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb100bb070 con 0x55d0697928e0 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb15600640 1 -- 172.21.15.144:0/2235678701 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb100b7640 con 0x55d0697928e0 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb15600640 1 -- 172.21.15.144:0/2235678701 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10009680 con 0x55d0697928e0 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d069901fd0 con 0x55d0697928e0 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.222+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d069902510 con 0x55d0697928e0 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.226+0000 7fcb15600640 1 -- 172.21.15.144:0/2235678701 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcb100be070 con 0x55d0697928e0 2024-09-12T12:17:18.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.226+0000 7fcb15600640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcafc0662a0 0x7fcafc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.226+0000 7fcb15600640 1 -- 172.21.15.144:0/2235678701 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7fcb101200b0 con 0x55d0697928e0 2024-09-12T12:17:18.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.226+0000 7fcb17e00640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcafc0662a0 0x7fcafc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.226+0000 7fcb20072080 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x55d0698ff450 0x55d0698ff830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.226+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 --> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83) -- 0x55d0698ffd70 con 0x55d0698ff450 2024-09-12T12:17:18.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.226+0000 7fcb1dc00640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x55d0698ff450 0x55d0698ff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.226+0000 7fcb17e00640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcafc0662a0 0x7fcafc068760 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcb080097c0 tx=0x7fcb08015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.226+0000 7fcb1dc00640 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x55d0698ff450 0x55d0698ff830 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb1dc00640 1 -- 172.21.15.144:0/2235678701 <== osd.0 v2:172.21.15.144:6808/1854211635 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v83'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcb1800a970 con 0x55d0698ff450 2024-09-12T12:17:18.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x55d0698ff450 msgr2=0x55d0698ff830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x55d0698ff450 0x55d0698ff830 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcafc0662a0 msgr2=0x7fcafc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcafc0662a0 0x7fcafc068760 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcb080097c0 tx=0x7fcb08015000 comp rx=0 tx=0).stop 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0697928e0 msgr2=0x55d069866150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 --2- 172.21.15.144:0/2235678701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0697928e0 0x55d069866150 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fcb1001c0a0 tx=0x7fcb04004130 comp rx=0 tx=0).stop 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb1dc00640 1 -- 172.21.15.144:0/2235678701 reap_dead start 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 shutdown_connections 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 >> 172.21.15.144:0/2235678701 conn(0x55d0697d9d20 msgr2=0x55d06986ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 shutdown_connections 2024-09-12T12:17:18.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.230+0000 7fcb20072080 1 -- 172.21.15.144:0/2235678701 wait complete. 2024-09-12T12:17:18.237 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-09-12T12:17:18.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-12T12:17:18.237 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-09-12T12:17:18.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-12T12:17:18.238 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-09-12T12:17:18.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-12T12:17:18.238 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-09-12T12:17:18.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-12T12:17:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91d0c00640 1 Processor -- start 2024-09-12T12:17:18.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d9400640 1 Processor -- start 2024-09-12T12:17:18.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91d0c00640 1 -- start start 2024-09-12T12:17:18.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d9400640 1 -- start start 2024-09-12T12:17:18.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91d0c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f91cc06c320 0x7f91cc15ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91d0c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91cc072080 0x7f91cc15fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91d0c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91cc073820 con 0x7f91cc158bd0 2024-09-12T12:17:18.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91d0c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f91cc06dad0 con 0x7f91cc072080 2024-09-12T12:17:18.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91d0c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f91cc158fb0 con 0x7f91cc06c320 2024-09-12T12:17:18.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55d415c7b0 0x7f55d40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d40b5fb0 0x7f55d4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d9400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d40cd870 con 0x7f55d415cd30 2024-09-12T12:17:18.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d9400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f55d4072a50 con 0x7f55d415c7b0 2024-09-12T12:17:18.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d9400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f55d40cde30 con 0x7f55d40b5fb0 2024-09-12T12:17:18.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55d415c7b0 0x7f55d40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55d415c7b0 0x7f55d40ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50306/0 (socket says 172.21.15.144:50306) 2024-09-12T12:17:18.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d2800640 1 -- 172.21.15.144:0/2236858262 learned_addr learned my addr 172.21.15.144:0/2236858262 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:18.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91ca800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91cc072080 0x7f91cc15fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91c9400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f91cc06c320 0x7f91cc15ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d3200640 1 --2- 172.21.15.144:0/2236858262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d40b5fb0 0x7f55d4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91c9400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f91cc06c320 0x7f91cc15ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:37882/0 (socket says 172.21.15.144:37882) 2024-09-12T12:17:18.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91c9400640 1 -- 172.21.15.144:0/4258756335 learned_addr learned my addr 172.21.15.144:0/4258756335 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:18.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d2800640 1 -- 172.21.15.144:0/2236858262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d40b5fb0 msgr2=0x7f55d4072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:18.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d2800640 1 --2- 172.21.15.144:0/2236858262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d40b5fb0 0x7f55d4072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d2800640 1 -- 172.21.15.144:0/2236858262 >> v1:172.21.15.144:6789/0 conn(0x7f55d415cd30 legacy=0x7f55d40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d2800640 1 -- 172.21.15.144:0/2236858262 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d40cdb50 con 0x7f55d415c7b0 2024-09-12T12:17:18.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91c9400640 1 -- 172.21.15.144:0/4258756335 >> v2:172.21.15.144:3300/0 conn(0x7f91cc072080 msgr2=0x7f91cc15fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:18.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f55d3200640 1 --2- 172.21.15.144:0/2236858262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d40b5fb0 0x7f55d4072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:18.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91c9400640 1 --2- 172.21.15.144:0/4258756335 >> v2:172.21.15.144:3300/0 conn(0x7f91cc072080 0x7f91cc15fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91c9400640 1 -- 172.21.15.144:0/4258756335 >> v1:172.21.15.165:6789/0 conn(0x7f91cc158bd0 legacy=0x7f91cc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91c9400640 1 -- 172.21.15.144:0/4258756335 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc072780 con 0x7f91cc06c320 2024-09-12T12:17:18.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.382+0000 7f91ca800640 1 --2- 172.21.15.144:0/4258756335 >> v2:172.21.15.144:3300/0 conn(0x7f91cc072080 0x7f91cc15fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28f0000640 1 Processor -- start 2024-09-12T12:17:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28f0000640 1 -- start start 2024-09-12T12:17:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f5d600640 1 Processor -- start 2024-09-12T12:17:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f5d600640 1 -- start start 2024-09-12T12:17:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f5d600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8f58071420 0x7f8f58071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f5d600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8f580ccf30 0x7f8f580cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f5d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f580cd890 con 0x7f8f5815b4e0 2024-09-12T12:17:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f5d600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8f580b45a0 con 0x7f8f58071420 2024-09-12T12:17:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f5d600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8f580b3fe0 con 0x7f8f580ccf30 2024-09-12T12:17:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28f0000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f28e80b3c10 0x7f28e80ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28f0000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e815cbb0 con 0x7f28e815c6d0 2024-09-12T12:17:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28f0000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e815ce90 con 0x7f28e815c2f0 2024-09-12T12:17:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28f0000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f28e815d170 con 0x7f28e80b3c10 2024-09-12T12:17:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f56a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8f5815b4e0 0x7f8f580b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37778/0 (socket says 172.21.15.144:37778) 2024-09-12T12:17:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f56a00640 1 -- 172.21.15.144:0/4119454793 learned_addr learned my addr 172.21.15.144:0/4119454793 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f56000640 1 --2- 172.21.15.144:0/4119454793 >> v2:172.21.15.144:3300/0 conn(0x7f8f58071420 0x7f8f58071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28ed600640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f28e815c2f0 0x7f28e80b3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:44170/0 (socket says 172.21.15.144:44170) 2024-09-12T12:17:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28ed600640 1 -- 172.21.15.144:0/3298631600 learned_addr learned my addr 172.21.15.144:0/3298631600 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28ee000640 1 --1- 172.21.15.144:0/3298631600 >> v1:172.21.15.144:6789/0 conn(0x7f28e815c6d0 0x7f28e80b58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37786/0 (socket says 172.21.15.144:37786) 2024-09-12T12:17:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28ecc00640 1 --2- 172.21.15.144:0/3298631600 >> v2:172.21.15.165:3300/0 conn(0x7f28e80b3c10 0x7f28e80ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f57400640 1 --2- 172.21.15.144:0/4119454793 >> v2:172.21.15.165:3300/0 conn(0x7f8f580ccf30 0x7f8f580cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f55600640 1 -- 172.21.15.144:0/4119454793 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1442356030 0 0) 0x7f8f580cd890 con 0x7f8f5815b4e0 2024-09-12T12:17:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f55600640 1 -- 172.21.15.144:0/4119454793 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f3c003530 con 0x7f8f5815b4e0 2024-09-12T12:17:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28e7e00640 1 -- 172.21.15.144:0/3298631600 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914773720 0 0) 0x7f28e815ce90 con 0x7f28e815c2f0 2024-09-12T12:17:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28e7e00640 1 -- 172.21.15.144:0/3298631600 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28d0003530 con 0x7f28e815c2f0 2024-09-12T12:17:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f56000640 1 -- 172.21.15.144:0/4119454793 >> v2:172.21.15.165:3300/0 conn(0x7f8f580ccf30 msgr2=0x7f8f580cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f56000640 1 --2- 172.21.15.144:0/4119454793 >> v2:172.21.15.165:3300/0 conn(0x7f8f580ccf30 0x7f8f580cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f56000640 1 -- 172.21.15.144:0/4119454793 >> v1:172.21.15.144:6789/0 conn(0x7f8f5815b4e0 legacy=0x7f8f580b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f56000640 1 -- 172.21.15.144:0/4119454793 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f580b42c0 con 0x7f8f58071420 2024-09-12T12:17:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f8f57400640 1 --2- 172.21.15.144:0/4119454793 >> v2:172.21.15.165:3300/0 conn(0x7f8f580ccf30 0x7f8f580cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28e7e00640 1 -- 172.21.15.144:0/3298631600 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319704301 0 0) 0x7f28e815cbb0 con 0x7f28e815c6d0 2024-09-12T12:17:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28e7e00640 1 -- 172.21.15.144:0/3298631600 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e815ce90 con 0x7f28e815c6d0 2024-09-12T12:17:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28ecc00640 1 -- 172.21.15.144:0/3298631600 >> v1:172.21.15.165:6789/0 conn(0x7f28e815c2f0 legacy=0x7f28e80b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28ecc00640 1 -- 172.21.15.144:0/3298631600 >> v1:172.21.15.144:6789/0 conn(0x7f28e815c6d0 legacy=0x7f28e80b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f28ecc00640 1 -- 172.21.15.144:0/3298631600 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e815d450 con 0x7f28e80b3c10 2024-09-12T12:17:18.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f91c9400640 1 --2- 172.21.15.144:0/4258756335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc06c320 0x7f91cc15ea40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f91cc163120 tx=0x7f91b801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ca7a76cb324a28f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f55d2800640 1 --2- 172.21.15.144:0/2236858262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 0x7f55d40ccf00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009870 tx=0x7f55c401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f450b7c5ed66937 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f91c8a00640 1 -- 172.21.15.144:0/4258756335 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80b5070 con 0x7f91cc06c320 2024-09-12T12:17:18.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f91c8a00640 1 -- 172.21.15.144:0/4258756335 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b80a8a10 con 0x7f91cc06c320 2024-09-12T12:17:18.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91c8a00640 1 -- 172.21.15.144:0/4258756335 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80a8de0 con 0x7f91cc06c320 2024-09-12T12:17:18.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.386+0000 7f55d1e00640 1 -- 172.21.15.144:0/2236858262 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c40b2070 con 0x7f55d415c7b0 2024-09-12T12:17:18.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d1e00640 1 -- 172.21.15.144:0/2236858262 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c40a9070 con 0x7f55d415c7b0 2024-09-12T12:17:18.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d1e00640 1 -- 172.21.15.144:0/2236858262 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c40ad880 con 0x7f55d415c7b0 2024-09-12T12:17:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 -- 172.21.15.144:0/4258756335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc06c320 msgr2=0x7f91cc15ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 --2- 172.21.15.144:0/4258756335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc06c320 0x7f91cc15ea40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f91cc163120 tx=0x7f91b801ed10 comp rx=0 tx=0).stop 2024-09-12T12:17:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d9400640 1 -- 172.21.15.144:0/2236858262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 msgr2=0x7f55d40ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d9400640 1 --2- 172.21.15.144:0/2236858262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 0x7f55d40ccf00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009870 tx=0x7f55c401c560 comp rx=0 tx=0).stop 2024-09-12T12:17:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 -- 172.21.15.144:0/4258756335 shutdown_connections 2024-09-12T12:17:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 --2- 172.21.15.144:0/4258756335 >> v2:172.21.15.144:3300/0 conn(0x7f91cc072080 0x7f91cc15fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 --2- 172.21.15.144:0/4258756335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc06c320 0x7f91cc15ea40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 -- 172.21.15.144:0/4258756335 >> 172.21.15.144:0/4258756335 conn(0x7f91cc06cd20 msgr2=0x7f91cc06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d9400640 1 -- 172.21.15.144:0/2236858262 shutdown_connections 2024-09-12T12:17:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d9400640 1 --2- 172.21.15.144:0/2236858262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d40b5fb0 0x7f55d4072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d9400640 1 --2- 172.21.15.144:0/2236858262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 0x7f55d40ccf00 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d9400640 1 -- 172.21.15.144:0/2236858262 >> 172.21.15.144:0/2236858262 conn(0x7f55d406d0d0 msgr2=0x7f55d406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 -- 172.21.15.144:0/4258756335 shutdown_connections 2024-09-12T12:17:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d9400640 1 -- 172.21.15.144:0/2236858262 shutdown_connections 2024-09-12T12:17:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d9400640 1 -- 172.21.15.144:0/2236858262 wait complete. 2024-09-12T12:17:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 -- 172.21.15.144:0/4258756335 wait complete. 2024-09-12T12:17:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f28ecc00640 1 --2- 172.21.15.144:0/3298631600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28e80b3c10 0x7f28e80ce730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f28d400f9b0 tx=0x7f28d40207b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a6e1ee3bdfd56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f8f56000640 1 --2- 172.21.15.144:0/4119454793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f58071420 0x7f8f58071840 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8f580d0480 tx=0x7f8f44020740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9605fcd36e1db511 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f8f55600640 1 -- 172.21.15.144:0/4119454793 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440b6070 con 0x7f8f58071420 2024-09-12T12:17:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f8f55600640 1 -- 172.21.15.144:0/4119454793 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f440a9810 con 0x7f8f58071420 2024-09-12T12:17:18.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f28e7e00640 1 -- 172.21.15.144:0/3298631600 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40b6070 con 0x7f28e80b3c10 2024-09-12T12:17:18.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f28e7e00640 1 -- 172.21.15.144:0/3298631600 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d40a98a0 con 0x7f28e80b3c10 2024-09-12T12:17:18.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f28e7e00640 1 -- 172.21.15.144:0/3298631600 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40a9c70 con 0x7f28e80b3c10 2024-09-12T12:17:18.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f8f55600640 1 -- 172.21.15.144:0/4119454793 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440a9be0 con 0x7f8f58071420 2024-09-12T12:17:18.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 Processor -- start 2024-09-12T12:17:18.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f55d9400640 1 Processor -- start 2024-09-12T12:17:18.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f91d0c00640 1 -- start start 2024-09-12T12:17:18.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f28f0000640 1 -- 172.21.15.144:0/3298631600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28e80b3c10 msgr2=0x7f28e80ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f28f0000640 1 --2- 172.21.15.144:0/3298631600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28e80b3c10 0x7f28e80ce730 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f28d400f9b0 tx=0x7f28d40207b0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f28f0000640 1 -- 172.21.15.144:0/3298631600 shutdown_connections 2024-09-12T12:17:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.390+0000 7f28f0000640 1 --2- 172.21.15.144:0/3298631600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28e80b3c10 0x7f28e80ce730 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f28f0000640 1 -- 172.21.15.144:0/3298631600 >> 172.21.15.144:0/3298631600 conn(0x7f28e806f8b0 msgr2=0x7f28e806fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d9400640 1 -- start start 2024-09-12T12:17:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 -- 172.21.15.144:0/4119454793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f58071420 msgr2=0x7f8f58071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 --2- 172.21.15.144:0/4119454793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f58071420 0x7f8f58071840 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8f580d0480 tx=0x7f8f44020740 comp rx=0 tx=0).stop 2024-09-12T12:17:18.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f28f0000640 1 -- 172.21.15.144:0/3298631600 shutdown_connections 2024-09-12T12:17:18.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f28f0000640 1 -- 172.21.15.144:0/3298631600 wait complete. 2024-09-12T12:17:18.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 -- 172.21.15.144:0/4119454793 shutdown_connections 2024-09-12T12:17:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 --2- 172.21.15.144:0/4119454793 >> v2:172.21.15.165:3300/0 conn(0x7f8f580ccf30 0x7f8f580cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 --2- 172.21.15.144:0/4119454793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f58071420 0x7f8f58071840 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 -- 172.21.15.144:0/4119454793 >> 172.21.15.144:0/4119454793 conn(0x7f8f5806d0d0 msgr2=0x7f8f5806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 -- 172.21.15.144:0/4119454793 shutdown_connections 2024-09-12T12:17:18.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 -- 172.21.15.144:0/4119454793 wait complete. 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91d0c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06c320 0x7f91cc1619c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91d0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc072080 0x7f91cc1610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91d0c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc158bd0 0x7f91cc143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91d0c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc073020 con 0x7f91cc072080 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91d0c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc072d40 con 0x7f91cc158bd0 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91d0c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f91cc073300 con 0x7f91cc06c320 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc072080 0x7f91cc1610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc072080 0x7f91cc1610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50320/0 (socket says 172.21.15.144:50320) 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9400640 1 -- 172.21.15.144:0/743362895 learned_addr learned my addr 172.21.15.144:0/743362895 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9e00640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06c320 0x7f91cc1619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91ca800640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc158bd0 0x7f91cc143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55d40b5fb0 0x7f55d40aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 0x7f55d41f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d415cd30 0x7f55d4150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d9400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f55d4073e40 con 0x7f55d415c7b0 2024-09-12T12:17:18.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d9400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f55d40cd650 con 0x7f55d40b5fb0 2024-09-12T12:17:18.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d9400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f55d4073fc0 con 0x7f55d415cd30 2024-09-12T12:17:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9400640 1 -- 172.21.15.144:0/743362895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06c320 msgr2=0x7f91cc1619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9400640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06c320 0x7f91cc1619c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9400640 1 -- 172.21.15.144:0/743362895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc158bd0 msgr2=0x7f91cc143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9400640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc158bd0 0x7f91cc143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9400640 1 -- 172.21.15.144:0/743362895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc160490 con 0x7f91cc072080 2024-09-12T12:17:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d415cd30 0x7f55d4150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 0x7f55d41f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d415cd30 0x7f55d4150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:42356/0 (socket says 172.21.15.144:42356) 2024-09-12T12:17:18.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d2800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55d40b5fb0 0x7f55d40aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d3200640 1 -- 172.21.15.144:0/3165164979 learned_addr learned my addr 172.21.15.144:0/3165164979 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:18.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c9400640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc072080 0x7f91cc1610f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f91b80b3040 tx=0x7f91b801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f28f0000640 1 Processor -- start 2024-09-12T12:17:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d3200640 1 -- 172.21.15.144:0/3165164979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55d40b5fb0 msgr2=0x7f55d40aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d3200640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55d40b5fb0 0x7f55d40aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d3200640 1 -- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 msgr2=0x7f55d41f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d3200640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 0x7f55d41f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d3200640 1 -- 172.21.15.144:0/3165164979 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d40af410 con 0x7f55d415cd30 2024-09-12T12:17:18.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f28f0000640 1 -- start start 2024-09-12T12:17:18.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d2800640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55d40b5fb0 0x7f55d40aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:18.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55cbe00640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 0x7f55d41f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:18.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 Processor -- start 2024-09-12T12:17:18.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c2000640 1 -- 172.21.15.144:0/743362895 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80b5070 con 0x7f91cc072080 2024-09-12T12:17:18.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c2000640 1 -- 172.21.15.144:0/743362895 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b80b0a50 con 0x7f91cc072080 2024-09-12T12:17:18.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91cc160770 con 0x7f91cc072080 2024-09-12T12:17:18.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91c2000640 1 -- 172.21.15.144:0/743362895 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b80b0e40 con 0x7f91cc072080 2024-09-12T12:17:18.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91cc1601a0 con 0x7f91cc072080 2024-09-12T12:17:18.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f8f5d600640 1 -- start start 2024-09-12T12:17:18.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d3200640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d415cd30 0x7f55d4150880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00efb0 tx=0x7f55cc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55caa00640 1 -- 172.21.15.144:0/3165164979 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc018020 con 0x7f55d415cd30 2024-09-12T12:17:18.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55caa00640 1 -- 172.21.15.144:0/3165164979 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55cc014480 con 0x7f55d415cd30 2024-09-12T12:17:18.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55caa00640 1 -- 172.21.15.144:0/3165164979 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc014850 con 0x7f55d415cd30 2024-09-12T12:17:18.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d40b09f0 con 0x7f55d415cd30 2024-09-12T12:17:18.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.394+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d40b0f90 con 0x7f55d415cd30 2024-09-12T12:17:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91cc072490 con 0x7f91cc072080 2024-09-12T12:17:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28f0000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28e80b3c10 0x7f28e813ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28f0000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28e815c2f0 0x7f28e814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28f0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28e815c6d0 0x7f28e815a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28f0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80b6c00 con 0x7f28e815c6d0 2024-09-12T12:17:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28f0000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80b6a80 con 0x7f28e80b3c10 2024-09-12T12:17:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28f0000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28e8167f30 con 0x7f28e815c2f0 2024-09-12T12:17:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f5d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f58071420 0x7f8f58154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f5d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f580ccf30 0x7f8f58160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f5d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f5815b4e0 0x7f8f58160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f5d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5815b8c0 con 0x7f8f58071420 2024-09-12T12:17:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f5d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f580cdef0 con 0x7f8f580ccf30 2024-09-12T12:17:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f5d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8f58161c30 con 0x7f8f5815b4e0 2024-09-12T12:17:18.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d4072ec0 con 0x7f55d415cd30 2024-09-12T12:17:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ecc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28e815c2f0 0x7f28e814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ecc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28e815c2f0 0x7f28e814e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:42372/0 (socket says 172.21.15.144:42372) 2024-09-12T12:17:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ecc00640 1 -- 172.21.15.144:0/1404243858 learned_addr learned my addr 172.21.15.144:0/1404243858 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f56000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f580ccf30 0x7f8f58160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f56000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f580ccf30 0x7f8f58160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:37932/0 (socket says 172.21.15.144:37932) 2024-09-12T12:17:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f56000640 1 -- 172.21.15.144:0/1544944520 learned_addr learned my addr 172.21.15.144:0/1544944520 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f57400640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f5815b4e0 0x7f8f58160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ee000640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28e815c6d0 0x7f28e815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ed600640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28e80b3c10 0x7f28e813ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ecc00640 1 -- 172.21.15.144:0/1404243858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28e80b3c10 msgr2=0x7f28e813ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ecc00640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28e80b3c10 0x7f28e813ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ecc00640 1 -- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28e815c6d0 msgr2=0x7f28e815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ecc00640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28e815c6d0 0x7f28e815a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ecc00640 1 -- 172.21.15.144:0/1404243858 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e815ae60 con 0x7f28e815c2f0 2024-09-12T12:17:18.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f57400640 1 -- 172.21.15.144:0/1544944520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f580ccf30 msgr2=0x7f8f58160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f57400640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f580ccf30 0x7f8f58160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f57400640 1 -- 172.21.15.144:0/1544944520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f58071420 msgr2=0x7f8f58154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f57400640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f58071420 0x7f8f58154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f57400640 1 -- 172.21.15.144:0/1544944520 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f581653e0 con 0x7f8f5815b4e0 2024-09-12T12:17:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f8f57400640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f5815b4e0 0x7f8f58160c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000efc0 tx=0x7f8f5000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f91c2000640 1 -- 172.21.15.144:0/743362895 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91b80c2060 con 0x7f91cc072080 2024-09-12T12:17:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f28ecc00640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28e815c2f0 0x7f28e814e3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f28d401e3e0 tx=0x7f28d401d550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f55caa00640 1 -- 172.21.15.144:0/3165164979 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55cc01b020 con 0x7f55d415cd30 2024-09-12T12:17:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f91c2000640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91ac0678f0 0x7f91ac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f91c2000640 1 -- 172.21.15.144:0/743362895 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f91b8122e30 con 0x7f91cc072080 2024-09-12T12:17:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f55caa00640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55b0067910 0x7f55b0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f55caa00640 1 -- 172.21.15.144:0/3165164979 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f55cc055100 con 0x7f55d415cd30 2024-09-12T12:17:18.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.398+0000 7f91c9e00640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91ac0678f0 0x7f91ac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f55d2800640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55b0067910 0x7f55b0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f91c9e00640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91ac0678f0 0x7f91ac069db0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91bc007fd0 tx=0x7f91bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f55d2800640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55b0067910 0x7f55b0069dd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f55c40af000 tx=0x7f55c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f28e5600640 1 -- 172.21.15.144:0/1404243858 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40b6070 con 0x7f28e815c2f0 2024-09-12T12:17:18.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f8f4ea00640 1 -- 172.21.15.144:0/1544944520 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50018030 con 0x7f8f5815b4e0 2024-09-12T12:17:18.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f8f4ea00640 1 -- 172.21.15.144:0/1544944520 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5000cd30 con 0x7f8f5815b4e0 2024-09-12T12:17:18.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f8f4ea00640 1 -- 172.21.15.144:0/1544944520 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50003bc0 con 0x7f8f5815b4e0 2024-09-12T12:17:18.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f581656c0 con 0x7f8f5815b4e0 2024-09-12T12:17:18.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f28e5600640 1 -- 172.21.15.144:0/1404243858 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d400f340 con 0x7f28e815c2f0 2024-09-12T12:17:18.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e815b100 con 0x7f28e815c2f0 2024-09-12T12:17:18.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f28e5600640 1 -- 172.21.15.144:0/1404243858 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40b2e60 con 0x7f28e815c2f0 2024-09-12T12:17:18.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f581650b0 con 0x7f8f5815b4e0 2024-09-12T12:17:18.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f55caa00640 1 -- 172.21.15.144:0/3165164979 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f55cc022030 con 0x7f55d415cd30 2024-09-12T12:17:18.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e815b6c0 con 0x7f28e815c2f0 2024-09-12T12:17:18.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.402+0000 7f91c2000640 1 -- 172.21.15.144:0/743362895 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f91b8018870 con 0x7f91cc072080 2024-09-12T12:17:18.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f58071840 con 0x7f8f5815b4e0 2024-09-12T12:17:18.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e80ce730 con 0x7f28e815c2f0 2024-09-12T12:17:18.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f8f4ea00640 1 -- 172.21.15.144:0/1544944520 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f5001b070 con 0x7f8f5815b4e0 2024-09-12T12:17:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f28e5600640 1 -- 172.21.15.144:0/1404243858 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28d40c1060 con 0x7f28e815c2f0 2024-09-12T12:17:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f28e5600640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28c80678c0 0x7f28c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f8f4ea00640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f380678c0 0x7f8f38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f8f4ea00640 1 -- 172.21.15.144:0/1544944520 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f8f50086c50 con 0x7f8f5815b4e0 2024-09-12T12:17:18.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f8f56a00640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f380678c0 0x7f8f38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f28ed600640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28c80678c0 0x7f28c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f8f56a00640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f380678c0 0x7f8f38069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8f48007fd0 tx=0x7f8f48007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.406+0000 7f28ed600640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28c80678c0 0x7f28c8069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f28dc000f70 tx=0x7f28dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.410+0000 7f28e5600640 1 -- 172.21.15.144:0/1404243858 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(83..83 src has 1..83) ==== 6101+0+0 (secure 0 0 0) 0x7f28d40ee340 con 0x7f28e815c2f0 2024-09-12T12:17:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.410+0000 7f8f4ea00640 1 -- 172.21.15.144:0/1544944520 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f50010040 con 0x7f8f5815b4e0 2024-09-12T12:17:18.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.414+0000 7f28e5600640 1 -- 172.21.15.144:0/1404243858 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f28d400d040 con 0x7f28e815c2f0 2024-09-12T12:17:18.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.638+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f8f58161db0 con 0x7f8f5815b4e0 2024-09-12T12:17:18.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.642+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f91cc0b4ee0 con 0x7f91cc072080 2024-09-12T12:17:18.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.642+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f55d4075590 con 0x7f55d415cd30 2024-09-12T12:17:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.646+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f28e80d11a0 con 0x7f28e815c2f0 2024-09-12T12:17:18.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.694+0000 7f8f4ea00640 1 -- 172.21.15.144:0/1544944520 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6478 v55) ==== 95+0+0 (secure 0 0 0) 0x7f8f500575e0 con 0x7f8f5815b4e0 2024-09-12T12:17:18.699 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 6478 2024-09-12T12:17:18.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f380678c0 msgr2=0x7f8f38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f380678c0 0x7f8f38069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8f48007fd0 tx=0x7f8f48007900 comp rx=0 tx=0).stop 2024-09-12T12:17:18.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f5815b4e0 msgr2=0x7f8f58160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f5815b4e0 0x7f8f58160c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000efc0 tx=0x7f8f5000c490 comp rx=0 tx=0).stop 2024-09-12T12:17:18.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 shutdown_connections 2024-09-12T12:17:18.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8f380678c0 0x7f8f38069d80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f5815b4e0 0x7f8f58160c50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f580ccf30 0x7f8f58160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 --2- 172.21.15.144:0/1544944520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f58071420 0x7f8f58154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 >> 172.21.15.144:0/1544944520 conn(0x7f8f5806d0d0 msgr2=0x7f8f5815dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:18.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 shutdown_connections 2024-09-12T12:17:18.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.698+0000 7f8f5d600640 1 -- 172.21.15.144:0/1544944520 wait complete. 2024-09-12T12:17:18.702 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:17:18.698+0000 7fac6ba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:17:18.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.702+0000 7f91c2000640 1 -- 172.21.15.144:0/743362895 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6681 v56) ==== 95+0+0 (secure 0 0 0) 0x7f91b80f30f0 con 0x7f91cc072080 2024-09-12T12:17:18.705 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 6681 2024-09-12T12:17:18.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91ac0678f0 msgr2=0x7f91ac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91ac0678f0 0x7f91ac069db0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91bc007fd0 tx=0x7f91bc009040 comp rx=0 tx=0).stop 2024-09-12T12:17:18.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc072080 msgr2=0x7f91cc1610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc072080 0x7f91cc1610f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f91b80b3040 tx=0x7f91b801bab0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f55caa00640 1 -- 172.21.15.144:0/3165164979 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6690 v56) ==== 95+0+0 (secure 0 0 0) 0x7f55d40af410 con 0x7f55d415cd30 2024-09-12T12:17:18.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 shutdown_connections 2024-09-12T12:17:18.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91ac0678f0 0x7f91ac069db0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc158bd0 0x7f91cc143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc072080 0x7f91cc1610f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 --2- 172.21.15.144:0/743362895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06c320 0x7f91cc1619c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 >> 172.21.15.144:0/743362895 conn(0x7f91cc06cd20 msgr2=0x7f91cc157380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:18.710 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 6690 2024-09-12T12:17:18.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 shutdown_connections 2024-09-12T12:17:18.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.706+0000 7f91d0c00640 1 -- 172.21.15.144:0/743362895 wait complete. 2024-09-12T12:17:18.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55b0067910 msgr2=0x7f55b0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55b0067910 0x7f55b0069dd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f55c40af000 tx=0x7f55c4008040 comp rx=0 tx=0).stop 2024-09-12T12:17:18.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d415cd30 msgr2=0x7f55d4150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:18.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d415cd30 0x7f55d4150880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00efb0 tx=0x7f55cc00c490 comp rx=0 tx=0).stop 2024-09-12T12:17:18.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 shutdown_connections 2024-09-12T12:17:18.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55b0067910 0x7f55b0069dd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f55d415cd30 0x7f55d4150880 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55d415c7b0 0x7f55d41f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 --2- 172.21.15.144:0/3165164979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f55d40b5fb0 0x7f55d40aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:18.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 >> 172.21.15.144:0/3165164979 conn(0x7f55d406d0d0 msgr2=0x7f55d415ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:18.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 shutdown_connections 2024-09-12T12:17:18.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:18.710+0000 7f55d9400640 1 -- 172.21.15.144:0/3165164979 wait complete. 2024-09-12T12:17:18.731 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:17:18.731 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:17:18.735 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:17:18.735 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:18.736 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:17:18.736 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:17:18.737 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:17:18.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:17:18.786 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:17:18.786 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:18.787 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:17:18.787 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:18.823 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:17:18.870 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:17:18.871 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:17:19.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28e5600640 1 -- 172.21.15.144:0/1404243858 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6481 v57) ==== 95+0+0 (secure 0 0 0) 0x7f28d401a3a0 con 0x7f28e815c2f0 2024-09-12T12:17:19.712 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 6481 2024-09-12T12:17:19.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28c80678c0 msgr2=0x7f28c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:19.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28c80678c0 0x7f28c8069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f28dc000f70 tx=0x7f28dc009040 comp rx=0 tx=0).stop 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28e815c2f0 msgr2=0x7f28e814e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28e815c2f0 0x7f28e814e3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f28d401e3e0 tx=0x7f28d401d550 comp rx=0 tx=0).stop 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 shutdown_connections 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28c80678c0 0x7f28c8069d80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28e815c6d0 0x7f28e815a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28e815c2f0 0x7f28e814e3f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 --2- 172.21.15.144:0/1404243858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28e80b3c10 0x7f28e813ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 >> 172.21.15.144:0/1404243858 conn(0x7f28e806f8b0 msgr2=0x7f28e815ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 shutdown_connections 2024-09-12T12:17:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.710+0000 7f28f0000640 1 -- 172.21.15.144:0/1404243858 wait complete. 2024-09-12T12:17:19.741 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:17:19.741 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:17:19.744 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:17:19.744 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:19.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:19.831 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:17:19.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.918+0000 7f470ae00640 1 Processor -- start 2024-09-12T12:17:19.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.918+0000 7f470ae00640 1 -- start start 2024-09-12T12:17:19.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f470ae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f470415c7b0 0x7f47040ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:19.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f470ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415cd30 0x7f47040b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:19.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f470ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47040cd870 con 0x7f47040b5de0 2024-09-12T12:17:19.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f470ae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4704072a50 con 0x7f470415c7b0 2024-09-12T12:17:19.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f470ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47040cde30 con 0x7f470415cd30 2024-09-12T12:17:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f4703400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415cd30 0x7f47040b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f4703400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415cd30 0x7f47040b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:42386/0 (socket says 172.21.15.144:42386) 2024-09-12T12:17:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f4703400640 1 -- 172.21.15.144:0/3048413669 learned_addr learned my addr 172.21.15.144:0/3048413669 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f4703e00640 1 --2- 172.21.15.144:0/3048413669 >> v2:172.21.15.165:3300/0 conn(0x7f470415c7b0 0x7f47040ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f4703400640 1 -- 172.21.15.144:0/3048413669 >> v2:172.21.15.165:3300/0 conn(0x7f470415c7b0 msgr2=0x7f47040ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f4703400640 1 --2- 172.21.15.144:0/3048413669 >> v2:172.21.15.165:3300/0 conn(0x7f470415c7b0 0x7f47040ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f4703400640 1 -- 172.21.15.144:0/3048413669 >> v1:172.21.15.165:6789/0 conn(0x7f47040b5de0 legacy=0x7f47041601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f4703400640 1 -- 172.21.15.144:0/3048413669 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47040cdb50 con 0x7f470415cd30 2024-09-12T12:17:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.922+0000 7f4703400640 1 --2- 172.21.15.144:0/3048413669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415cd30 0x7f47040b58a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009870 tx=0x7f46f001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947da674b88260ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f4702a00640 1 -- 172.21.15.144:0/3048413669 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00b2070 con 0x7f470415cd30 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f4702a00640 1 -- 172.21.15.144:0/3048413669 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f00a9070 con 0x7f470415cd30 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f4702a00640 1 -- 172.21.15.144:0/3048413669 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00ad880 con 0x7f470415cd30 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 -- 172.21.15.144:0/3048413669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415cd30 msgr2=0x7f47040b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 --2- 172.21.15.144:0/3048413669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415cd30 0x7f47040b58a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009870 tx=0x7f46f001c560 comp rx=0 tx=0).stop 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 -- 172.21.15.144:0/3048413669 shutdown_connections 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 --2- 172.21.15.144:0/3048413669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415cd30 0x7f47040b58a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 --2- 172.21.15.144:0/3048413669 >> v2:172.21.15.165:3300/0 conn(0x7f470415c7b0 0x7f47040ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 -- 172.21.15.144:0/3048413669 >> 172.21.15.144:0/3048413669 conn(0x7f470406d0d0 msgr2=0x7f470406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 -- 172.21.15.144:0/3048413669 shutdown_connections 2024-09-12T12:17:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 -- 172.21.15.144:0/3048413669 wait complete. 2024-09-12T12:17:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 Processor -- start 2024-09-12T12:17:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 -- start start 2024-09-12T12:17:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47040b5de0 0x7f470414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415c7b0 0x7f4704164b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f470415cd30 0x7f4704153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4704169530 con 0x7f47040b5de0 2024-09-12T12:17:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f47040cd650 con 0x7f470415cd30 2024-09-12T12:17:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f470ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47041696b0 con 0x7f470415c7b0 2024-09-12T12:17:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f4703e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47040b5de0 0x7f470414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f4703e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47040b5de0 0x7f470414e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50400/0 (socket says 172.21.15.144:50400) 2024-09-12T12:17:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f4703e00640 1 -- 172.21.15.144:0/2607922488 learned_addr learned my addr 172.21.15.144:0/2607922488 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f4703400640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415c7b0 0x7f4704164b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.926+0000 7f4708e00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f470415cd30 0x7f4704153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f4703e00640 1 -- 172.21.15.144:0/2607922488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415c7b0 msgr2=0x7f4704164b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f4703e00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415c7b0 0x7f4704164b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f4703e00640 1 -- 172.21.15.144:0/2607922488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f470415cd30 msgr2=0x7f4704153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f4703e00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f470415cd30 0x7f4704153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f4703e00640 1 -- 172.21.15.144:0/2607922488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4704165530 con 0x7f47040b5de0 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f4703e00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47040b5de0 0x7f470414e8b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f46f400e960 tx=0x7f46f400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f46fbe00640 1 -- 172.21.15.144:0/2607922488 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4017070 con 0x7f47040b5de0 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f46fbe00640 1 -- 172.21.15.144:0/2607922488 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f400c9a0 con 0x7f47040b5de0 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4704165810 con 0x7f47040b5de0 2024-09-12T12:17:19.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f46fbe00640 1 -- 172.21.15.144:0/2607922488 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f400cd50 con 0x7f47040b5de0 2024-09-12T12:17:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4704165dd0 con 0x7f47040b5de0 2024-09-12T12:17:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4704162bc0 con 0x7f47040b5de0 2024-09-12T12:17:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f46fbe00640 1 -- 172.21.15.144:0/2607922488 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46f401a070 con 0x7f47040b5de0 2024-09-12T12:17:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f46fbe00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46e40678c0 0x7f46e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f46fbe00640 1 -- 172.21.15.144:0/2607922488 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f46f4086180 con 0x7f47040b5de0 2024-09-12T12:17:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.930+0000 7f4703400640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46e40678c0 0x7f46e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.934+0000 7f4703400640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46e40678c0 0x7f46e4069d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f46f00af000 tx=0x7f46f00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:19.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:19.938+0000 7f46fbe00640 1 -- 172.21.15.144:0/2607922488 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f46f4056490 con 0x7f47040b5de0 2024-09-12T12:17:20.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.126+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47041670f0 con 0x7f47040b5de0 2024-09-12T12:17:20.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.126+0000 7f46fbe00640 1 -- 172.21.15.144:0/2607922488 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+4400 (secure 0 0 0) 0x7f46f405a790 con 0x7f47040b5de0 2024-09-12T12:17:20.131 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:20.131 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":58,"btime":"2024-09-12T12:17:19:713311+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6915,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3715410946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3715410946},{"type":"v1","addr":"172.21.15.165:6833","nonce":3715410946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/974267816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":974267816},{"type":"v1","addr":"172.21.15.144:6836","nonce":974267816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:19.713292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6933},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6933":{"gid":6933,"name":"c","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6837/1622416961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1622416961},{"type":"v1","addr":"172.21.15.144:6837","nonce":1622416961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-12T12:17:20.131 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 58 2024-09-12T12:17:20.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46e40678c0 msgr2=0x7f46e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46e40678c0 0x7f46e4069d80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f46f00af000 tx=0x7f46f00a7000 comp rx=0 tx=0).stop 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47040b5de0 msgr2=0x7f470414e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47040b5de0 0x7f470414e8b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f46f400e960 tx=0x7f46f400ee20 comp rx=0 tx=0).stop 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 shutdown_connections 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46e40678c0 0x7f46e4069d80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f470415cd30 0x7f4704153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f470415c7b0 0x7f4704164b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 --2- 172.21.15.144:0/2607922488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47040b5de0 0x7f470414e8b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 >> 172.21.15.144:0/2607922488 conn(0x7f470406d0d0 msgr2=0x7f47040b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 shutdown_connections 2024-09-12T12:17:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:20.130+0000 7f470ae00640 1 -- 172.21.15.144:0/2607922488 wait complete. 2024-09-12T12:17:20.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:17:04.644714+0000', 'modified': '2024-09-12T12:17:19.713292+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6933}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6933': {'gid': 6933, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.144:6837/1622416961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 1622416961}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 1622416961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T12:17:20.554 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6933:up:replay 2024-09-12T12:17:21.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:21.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc855e00640 1 Processor -- start 2024-09-12T12:17:21.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc855e00640 1 -- start start 2024-09-12T12:17:21.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc855e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc85015c3c0 0x7fc8500cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:21.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc855e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 0x7fc850071e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc855e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8500d0250 con 0x7fc8500b6710 2024-09-12T12:17:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc855e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc8500d0af0 con 0x7fc85015c3c0 2024-09-12T12:17:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc855e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc85015c7a0 con 0x7fc85006f020 2024-09-12T12:17:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc84e000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc8500b6710 0x7fc85006e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37820/0 (socket says 172.21.15.144:37820) 2024-09-12T12:17:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc84ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc85015c3c0 0x7fc8500cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc84e000640 1 -- 172.21.15.144:0/1889866829 learned_addr learned my addr 172.21.15.144:0/1889866829 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:21.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc84f400640 1 --2- 172.21.15.144:0/1889866829 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 0x7fc850071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc84ea00640 1 -- 172.21.15.144:0/1889866829 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 msgr2=0x7fc850071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc84ea00640 1 --2- 172.21.15.144:0/1889866829 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 0x7fc850071e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.702+0000 7fc84ea00640 1 -- 172.21.15.144:0/1889866829 >> v1:172.21.15.144:6789/0 conn(0x7fc8500b6710 legacy=0x7fc85006e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.706+0000 7fc84ea00640 1 -- 172.21.15.144:0/1889866829 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8500d0530 con 0x7fc85015c3c0 2024-09-12T12:17:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.706+0000 7fc84d600640 1 -- 172.21.15.144:0/1889866829 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806085936 0 0) 0x7fc8500d0250 con 0x7fc8500b6710 2024-09-12T12:17:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.706+0000 7fc84ea00640 1 --2- 172.21.15.144:0/1889866829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85015c3c0 0x7fc8500cfc00 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc840009d90 tx=0x7fc84001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a79aaa7498fc0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:21.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.706+0000 7fc84d600640 1 -- 172.21.15.144:0/1889866829 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8400b2070 con 0x7fc85015c3c0 2024-09-12T12:17:21.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.706+0000 7fc84d600640 1 -- 172.21.15.144:0/1889866829 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400a5a20 con 0x7fc85015c3c0 2024-09-12T12:17:21.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.706+0000 7fc84d600640 1 -- 172.21.15.144:0/1889866829 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8400a5df0 con 0x7fc85015c3c0 2024-09-12T12:17:21.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.706+0000 7fc855e00640 1 -- 172.21.15.144:0/1889866829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85015c3c0 msgr2=0x7fc8500cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.706+0000 7fc855e00640 1 --2- 172.21.15.144:0/1889866829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85015c3c0 0x7fc8500cfc00 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc840009d90 tx=0x7fc84001c940 comp rx=0 tx=0).stop 2024-09-12T12:17:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 -- 172.21.15.144:0/1889866829 shutdown_connections 2024-09-12T12:17:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 --2- 172.21.15.144:0/1889866829 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 0x7fc850071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 --2- 172.21.15.144:0/1889866829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85015c3c0 0x7fc8500cfc00 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 -- 172.21.15.144:0/1889866829 >> 172.21.15.144:0/1889866829 conn(0x7fc85006ddf0 msgr2=0x7fc85006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 -- 172.21.15.144:0/1889866829 shutdown_connections 2024-09-12T12:17:21.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 -- 172.21.15.144:0/1889866829 wait complete. 2024-09-12T12:17:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 Processor -- start 2024-09-12T12:17:21.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 -- start start 2024-09-12T12:17:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 0x7fc85014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8500b6710 0x7fc850159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:21.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85015c3c0 0x7fc8500b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc850072f50 con 0x7fc8500b6710 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc850072dd0 con 0x7fc85015c3c0 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc855e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc8500730d0 con 0x7fc85006f020 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8500b6710 0x7fc850159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8500b6710 0x7fc850159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50414/0 (socket says 172.21.15.144:50414) 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84e000640 1 -- 172.21.15.144:0/1548421877 learned_addr learned my addr 172.21.15.144:0/1548421877 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84ea00640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 0x7fc85014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84f400640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85015c3c0 0x7fc8500b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84e000640 1 -- 172.21.15.144:0/1548421877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 msgr2=0x7fc85014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84e000640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 0x7fc85014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84e000640 1 -- 172.21.15.144:0/1548421877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85015c3c0 msgr2=0x7fc8500b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:21.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84e000640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85015c3c0 0x7fc8500b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84e000640 1 -- 172.21.15.144:0/1548421877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85015a600 con 0x7fc8500b6710 2024-09-12T12:17:21.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84f400640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85015c3c0 0x7fc8500b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:21.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.710+0000 7fc84e000640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8500b6710 0x7fc850159c20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00c520 tx=0x7fc83c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:21.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc847400640 1 -- 172.21.15.144:0/1548421877 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c018070 con 0x7fc8500b6710 2024-09-12T12:17:21.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc847400640 1 -- 172.21.15.144:0/1548421877 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83c0074e0 con 0x7fc8500b6710 2024-09-12T12:17:21.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc847400640 1 -- 172.21.15.144:0/1548421877 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c0049f0 con 0x7fc8500b6710 2024-09-12T12:17:21.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85015c920 con 0x7fc8500b6710 2024-09-12T12:17:21.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85015cee0 con 0x7fc8500b6710 2024-09-12T12:17:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc850071e50 con 0x7fc8500b6710 2024-09-12T12:17:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc847400640 1 -- 172.21.15.144:0/1548421877 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc83c004b90 con 0x7fc8500b6710 2024-09-12T12:17:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc847400640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8300678c0 0x7fc830069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc847400640 1 -- 172.21.15.144:0/1548421877 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fc83c085280 con 0x7fc8500b6710 2024-09-12T12:17:21.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.714+0000 7fc84ea00640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8300678c0 0x7fc830069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:21.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.718+0000 7fc84ea00640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8300678c0 0x7fc830069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc8400af000 tx=0x7fc8400a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:21.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.722+0000 7fc847400640 1 -- 172.21.15.144:0/1548421877 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc83c055b40 con 0x7fc8500b6710 2024-09-12T12:17:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.910+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc850157b50 con 0x7fc8500b6710 2024-09-12T12:17:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.910+0000 7fc847400640 1 -- 172.21.15.144:0/1548421877 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5228 (secure 0 0 0) 0x7fc83c055440 con 0x7fc8500b6710 2024-09-12T12:17:21.915 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:21.915 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":60,"btime":"2024-09-12T12:17:21:726078+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1090713174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1090713174},{"type":"v1","addr":"172.21.15.165:6835","nonce":1090713174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6915,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3715410946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3715410946},{"type":"v1","addr":"172.21.15.165:6833","nonce":3715410946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/974267816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":974267816},{"type":"v1","addr":"172.21.15.144:6836","nonce":974267816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:20.727096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6933},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6933":{"gid":6933,"name":"c","rank":0,"incarnation":58,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.144:6837/1622416961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1622416961},{"type":"v1","addr":"172.21.15.144:6837","nonce":1622416961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-12T12:17:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 60 2024-09-12T12:17:21.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8300678c0 msgr2=0x7fc830069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:21.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8300678c0 0x7fc830069d80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc8400af000 tx=0x7fc8400a7070 comp rx=0 tx=0).stop 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8500b6710 msgr2=0x7fc850159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8500b6710 0x7fc850159c20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00c520 tx=0x7fc83c00c9e0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 shutdown_connections 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8300678c0 0x7fc830069d80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc85015c3c0 0x7fc8500b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8500b6710 0x7fc850159c20 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 --2- 172.21.15.144:0/1548421877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc85006f020 0x7fc85014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 >> 172.21.15.144:0/1548421877 conn(0x7fc85006ddf0 msgr2=0x7fc85006e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 shutdown_connections 2024-09-12T12:17:21.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:21.914+0000 7fc855e00640 1 -- 172.21.15.144:0/1548421877 wait complete. 2024-09-12T12:17:22.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:17:04.644714+0000', 'modified': '2024-09-12T12:17:20.727096+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6933}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6933': {'gid': 6933, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.144:6837/1622416961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 1622416961}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 1622416961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T12:17:22.340 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6933:up:rejoin 2024-09-12T12:17:23.341 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f658fa00640 1 Processor -- start 2024-09-12T12:17:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f658fa00640 1 -- start start 2024-09-12T12:17:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f658fa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6588071420 0x7f6588071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f658fa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65880b45a0 con 0x7f65880ccf30 2024-09-12T12:17:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f658fa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65880b3fe0 con 0x7f658815b4e0 2024-09-12T12:17:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f658fa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f65880b42c0 con 0x7f6588071420 2024-09-12T12:17:23.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f658da00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f65880ccf30 0x7f65880cd350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37836/0 (socket says 172.21.15.144:37836) 2024-09-12T12:17:23.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f658da00640 1 -- 172.21.15.144:0/1907826420 learned_addr learned my addr 172.21.15.144:0/1907826420 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:23.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f6587e00640 1 --2- 172.21.15.144:0/1907826420 >> v2:172.21.15.165:3300/0 conn(0x7f6588071420 0x7f6588071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3471017457 0 0) 0x7f65880b45a0 con 0x7f65880ccf30 2024-09-12T12:17:23.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.486+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f656c003530 con 0x7f65880ccf30 2024-09-12T12:17:23.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2147432813 0 0) 0x7f656c003530 con 0x7f65880ccf30 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 >> v2:172.21.15.165:3300/0 conn(0x7f6588071420 msgr2=0x7f6588071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 --2- 172.21.15.144:0/1907826420 >> v2:172.21.15.165:3300/0 conn(0x7f6588071420 0x7f6588071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 >> v1:172.21.15.165:6789/0 conn(0x7f658815b4e0 legacy=0x7f65880b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65880b1490 con 0x7f65880ccf30 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f6580001a00 con 0x7f65880ccf30 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 >> v1:172.21.15.144:6789/0 conn(0x7f65880ccf30 legacy=0x7f65880cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f656c0039c0 0x7f656c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f656c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f656c005090 0x7f656c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65880b42c0 con 0x7f656c0043c0 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f656c00e200 con 0x7f656c005090 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f656c00e400 con 0x7f656c0039c0 2024-09-12T12:17:23.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587e00640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f656c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f658d000640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f656c0039c0 0x7f656c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f658da00640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f656c005090 0x7f656c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587e00640 1 -- 172.21.15.144:0/1907826420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f656c0039c0 msgr2=0x7f656c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:23.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587e00640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f656c0039c0 0x7f656c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587e00640 1 -- 172.21.15.144:0/1907826420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f656c005090 msgr2=0x7f656c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:23.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587e00640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f656c005090 0x7f656c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587e00640 1 -- 172.21.15.144:0/1907826420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656c003530 con 0x7f656c0043c0 2024-09-12T12:17:23.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f658da00640 1 -- 172.21.15.144:0/1907826420 reap_dead start 2024-09-12T12:17:23.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.490+0000 7f6587e00640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f656c004890 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6574009ae0 tx=0x7f657401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fe698a938db408 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:23.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740b2070 con 0x7f656c0043c0 2024-09-12T12:17:23.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65740a5660 con 0x7f656c0043c0 2024-09-12T12:17:23.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f6587400640 1 -- 172.21.15.144:0/1907826420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740096b0 con 0x7f656c0043c0 2024-09-12T12:17:23.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 -- 172.21.15.144:0/1907826420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 msgr2=0x7f656c004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f656c004890 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f6574009ae0 tx=0x7f657401ca70 comp rx=0 tx=0).stop 2024-09-12T12:17:23.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 -- 172.21.15.144:0/1907826420 shutdown_connections 2024-09-12T12:17:23.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 --2- 172.21.15.144:0/1907826420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f656c004890 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 -- 172.21.15.144:0/1907826420 >> 172.21.15.144:0/1907826420 conn(0x7f658806d0d0 msgr2=0x7f658806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:23.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 -- 172.21.15.144:0/1907826420 shutdown_connections 2024-09-12T12:17:23.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 -- 172.21.15.144:0/1907826420 wait complete. 2024-09-12T12:17:23.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 Processor -- start 2024-09-12T12:17:23.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 -- start start 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f658815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65880ceb70 0x7f65880ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6588146c80 0x7f6588147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f658815b8c0 con 0x7f656c0043c0 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f65880cdef0 con 0x7f65880ceb70 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658fa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f65880cf530 con 0x7f6588146c80 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f658815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f658815a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50446/0 (socket says 172.21.15.144:50446) 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658d000640 1 -- 172.21.15.144:0/569268150 learned_addr learned my addr 172.21.15.144:0/569268150 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:23.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658da00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6588146c80 0x7f6588147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f6587e00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65880ceb70 0x7f65880ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658d000640 1 -- 172.21.15.144:0/569268150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6588146c80 msgr2=0x7f6588147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658d000640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6588146c80 0x7f6588147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658d000640 1 -- 172.21.15.144:0/569268150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65880ceb70 msgr2=0x7f65880ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658d000640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65880ceb70 0x7f65880ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.494+0000 7f658d000640 1 -- 172.21.15.144:0/569268150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6588147640 con 0x7f656c0043c0 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f658d000640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f658815a650 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f65780114a0 tx=0x7f65780118a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f6584c00640 1 -- 172.21.15.144:0/569268150 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578019020 con 0x7f656c0043c0 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f6584c00640 1 -- 172.21.15.144:0/569268150 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6578015820 con 0x7f656c0043c0 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f6584c00640 1 -- 172.21.15.144:0/569268150 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578010040 con 0x7f656c0043c0 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658815dde0 con 0x7f656c0043c0 2024-09-12T12:17:23.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658815e3a0 con 0x7f656c0043c0 2024-09-12T12:17:23.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6588071840 con 0x7f656c0043c0 2024-09-12T12:17:23.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f6584c00640 1 -- 172.21.15.144:0/569268150 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f657801c020 con 0x7f656c0043c0 2024-09-12T12:17:23.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f6584c00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65680678f0 0x7f6568069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:23.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f6584c00640 1 -- 172.21.15.144:0/569268150 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f6578088a50 con 0x7f656c0043c0 2024-09-12T12:17:23.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.498+0000 7f6587e00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65680678f0 0x7f6568069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:23.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.502+0000 7f6587e00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65680678f0 0x7f6568069db0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f65740af000 tx=0x7f65740046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:23.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.502+0000 7f6584c00640 1 -- 172.21.15.144:0/569268150 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6578023020 con 0x7f656c0043c0 2024-09-12T12:17:23.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.694+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6588075140 con 0x7f656c0043c0 2024-09-12T12:17:23.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f6584c00640 1 -- 172.21.15.144:0/569268150 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5235 (secure 0 0 0) 0x7f65780593a0 con 0x7f656c0043c0 2024-09-12T12:17:23.699 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:23.700 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":61,"btime":"2024-09-12T12:17:22:733420+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1090713174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1090713174},{"type":"v1","addr":"172.21.15.165:6835","nonce":1090713174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6915,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3715410946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3715410946},{"type":"v1","addr":"172.21.15.165:6833","nonce":3715410946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/974267816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":974267816},{"type":"v1","addr":"172.21.15.144:6836","nonce":974267816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:22.733410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6933},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6933":{"gid":6933,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/1622416961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1622416961},{"type":"v1","addr":"172.21.15.144:6837","nonce":1622416961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6933,"qdb_cluster":[6933]},"id":5}]} 2024-09-12T12:17:23.700 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 61 2024-09-12T12:17:23.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65680678f0 msgr2=0x7f6568069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65680678f0 0x7f6568069db0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f65740af000 tx=0x7f65740046d0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 msgr2=0x7f658815a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f658815a650 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f65780114a0 tx=0x7f65780118a0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 shutdown_connections 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65680678f0 0x7f6568069db0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6588146c80 0x7f6588147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65880ceb70 0x7f65880ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 --2- 172.21.15.144:0/569268150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f656c0043c0 0x7f658815a650 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 >> 172.21.15.144:0/569268150 conn(0x7f658806d0d0 msgr2=0x7f658815f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 shutdown_connections 2024-09-12T12:17:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:23.698+0000 7f658fa00640 1 -- 172.21.15.144:0/569268150 wait complete. 2024-09-12T12:17:24.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:17:04.644714+0000', 'modified': '2024-09-12T12:17:22.733410+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6933}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6933': {'gid': 6933, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.144:6837/1622416961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 1622416961}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 1622416961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6933, 'qdb_cluster': [6933]} 2024-09-12T12:17:24.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:17:24.125 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T12:17:24.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa91d600640 1 Processor -- start 2024-09-12T12:17:24.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa91d600640 1 -- start start 2024-09-12T12:17:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa91d600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa91815b160 0x7fa918070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa91d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 0x7fa9180ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa91d600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa9180cd000 0x7fa9180cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa91d600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa91815b540 con 0x7fa91815b160 2024-09-12T12:17:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa91d600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa9180cd4a0 con 0x7fa9180cd000 2024-09-12T12:17:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa91d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9180cd780 con 0x7fa918073bd0 2024-09-12T12:17:24.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa91815b160 0x7fa918070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa91815b160 0x7fa918070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50458/0 (socket says 172.21.15.144:50458) 2024-09-12T12:17:24.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917e00640 1 -- 172.21.15.144:0/3593609469 learned_addr learned my addr 172.21.15.144:0/3593609469 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:24.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917e00640 1 -- 172.21.15.144:0/3593609469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 msgr2=0x7fa9180ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917400640 1 --2- 172.21.15.144:0/3593609469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 0x7fa9180ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917e00640 1 --2- 172.21.15.144:0/3593609469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 0x7fa9180ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917e00640 1 -- 172.21.15.144:0/3593609469 >> v2:172.21.15.165:3300/0 conn(0x7fa9180cd000 msgr2=0x7fa9180cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917e00640 1 --2- 172.21.15.144:0/3593609469 >> v2:172.21.15.165:3300/0 conn(0x7fa9180cd000 0x7fa9180cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917e00640 1 -- 172.21.15.144:0/3593609469 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9180b3180 con 0x7fa91815b160 2024-09-12T12:17:24.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.262+0000 7fa917400640 1 --2- 172.21.15.144:0/3593609469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 0x7fa9180ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa917e00640 1 --2- 172.21.15.144:0/3593609469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 0x7fa918070ee0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa9180cf650 tx=0x7fa90801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f975d1a966e100 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa916a00640 1 -- 172.21.15.144:0/3593609469 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9080a5600 con 0x7fa91815b160 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa916a00640 1 -- 172.21.15.144:0/3593609469 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9080a57a0 con 0x7fa91815b160 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa916a00640 1 -- 172.21.15.144:0/3593609469 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9080a5b70 con 0x7fa91815b160 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa91d600640 1 -- 172.21.15.144:0/3593609469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 msgr2=0x7fa918070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa91d600640 1 --2- 172.21.15.144:0/3593609469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 0x7fa918070ee0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa9180cf650 tx=0x7fa90801c980 comp rx=0 tx=0).stop 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa91d600640 1 -- 172.21.15.144:0/3593609469 shutdown_connections 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa91d600640 1 --2- 172.21.15.144:0/3593609469 >> v2:172.21.15.165:3300/0 conn(0x7fa9180cd000 0x7fa9180cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa91d600640 1 --2- 172.21.15.144:0/3593609469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 0x7fa9180ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa91d600640 1 --2- 172.21.15.144:0/3593609469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 0x7fa918070ee0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa91d600640 1 -- 172.21.15.144:0/3593609469 >> 172.21.15.144:0/3593609469 conn(0x7fa91806bc10 msgr2=0x7fa91806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:24.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa91d600640 1 -- 172.21.15.144:0/3593609469 shutdown_connections 2024-09-12T12:17:24.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.266+0000 7fa91d600640 1 -- 172.21.15.144:0/3593609469 wait complete. 2024-09-12T12:17:24.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 Processor -- start 2024-09-12T12:17:24.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 -- start start 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 0x7fa9180afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9180cd000 0x7fa918153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 0x7fa918153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9180b4520 con 0x7fa91815b160 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa9180b43a0 con 0x7fa9180cd000 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9180b46a0 con 0x7fa918073bd0 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 0x7fa918153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 0x7fa918153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50474/0 (socket says 172.21.15.144:50474) 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91cc00640 1 -- 172.21.15.144:0/2862139229 learned_addr learned my addr 172.21.15.144:0/2862139229 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa917400640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9180cd000 0x7fa918153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa917e00640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 0x7fa9180afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91cc00640 1 -- 172.21.15.144:0/2862139229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 msgr2=0x7fa9180afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91cc00640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 0x7fa9180afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91cc00640 1 -- 172.21.15.144:0/2862139229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9180cd000 msgr2=0x7fa918153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91cc00640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9180cd000 0x7fa918153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91cc00640 1 -- 172.21.15.144:0/2862139229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9180b05a0 con 0x7fa91815b160 2024-09-12T12:17:24.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91cc00640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 0x7fa918153c70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa91000b410 tx=0x7fa91000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa90fe00640 1 -- 172.21.15.144:0/2862139229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910015020 con 0x7fa91815b160 2024-09-12T12:17:24.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa90fe00640 1 -- 172.21.15.144:0/2862139229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa910011850 con 0x7fa91815b160 2024-09-12T12:17:24.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa90fe00640 1 -- 172.21.15.144:0/2862139229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910011c40 con 0x7fa91815b160 2024-09-12T12:17:24.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 -- 172.21.15.144:0/2862139229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9180b0880 con 0x7fa91815b160 2024-09-12T12:17:24.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.270+0000 7fa91d600640 1 -- 172.21.15.144:0/2862139229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9180b0e40 con 0x7fa91815b160 2024-09-12T12:17:24.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa90fe00640 1 -- 172.21.15.144:0/2862139229 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa910018020 con 0x7fa91815b160 2024-09-12T12:17:24.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa90fe00640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8f80678c0 0x7fa8f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa90fe00640 1 -- 172.21.15.144:0/2862139229 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fa910085d60 con 0x7fa91815b160 2024-09-12T12:17:24.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8f80678c0 0x7fa8f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa921fb0000 1 Processor -- start 2024-09-12T12:17:24.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa921fb0000 1 -- start start 2024-09-12T12:17:24.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8f80678c0 0x7fa8f8069d80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa9080ae000 tx=0x7fa9080a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dedd70 0x55d588dee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 0x55d588da4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588da46a0 0x55d588da4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa921fb0000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d588c87b60 con 0x55d588dedd70 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa921fb0000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d588beec70 con 0x55d588dee690 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa921fb0000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55d588b94ed0 con 0x55d588da46a0 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dedd70 0x55d588dee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dedd70 0x55d588dee150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50488/0 (socket says 172.21.15.144:50488) 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 -- 172.21.15.144:0/2557616515 learned_addr learned my addr 172.21.15.144:0/2557616515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917400640 1 --2- 172.21.15.144:0/2557616515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 0x55d588da4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa91cc00640 1 --2- 172.21.15.144:0/2557616515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588da46a0 0x55d588da4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 -- 172.21.15.144:0/2557616515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588da46a0 msgr2=0x55d588da4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 --2- 172.21.15.144:0/2557616515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588da46a0 0x55d588da4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 -- 172.21.15.144:0/2557616515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 msgr2=0x55d588da4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 --2- 172.21.15.144:0/2557616515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 0x55d588da4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.274+0000 7fa917e00640 1 -- 172.21.15.144:0/2557616515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d588ba6e50 con 0x55d588dedd70 2024-09-12T12:17:24.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa917e00640 1 --2- 172.21.15.144:0/2557616515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dedd70 0x55d588dee150 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa9080af040 tx=0x7fa908004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea005e87d4a7f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa90cc00640 1 -- 172.21.15.144:0/2557616515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9080c6070 con 0x55d588dedd70 2024-09-12T12:17:24.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa90cc00640 1 -- 172.21.15.144:0/2557616515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9080a5e10 con 0x55d588dedd70 2024-09-12T12:17:24.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa90cc00640 1 -- 172.21.15.144:0/2557616515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9080c2620 con 0x55d588dedd70 2024-09-12T12:17:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 -- 172.21.15.144:0/2557616515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dedd70 msgr2=0x55d588dee150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2557616515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dedd70 0x55d588dee150 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa9080af040 tx=0x7fa908004ac0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 -- 172.21.15.144:0/2557616515 shutdown_connections 2024-09-12T12:17:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2557616515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588da46a0 0x55d588da4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2557616515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 0x55d588da4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2557616515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dedd70 0x55d588dee150 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 -- 172.21.15.144:0/2557616515 >> 172.21.15.144:0/2557616515 conn(0x55d588da6600 msgr2=0x55d588d9e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 -- 172.21.15.144:0/2557616515 shutdown_connections 2024-09-12T12:17:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 -- 172.21.15.144:0/2557616515 wait complete. 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 -- start start 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 Processor -- start 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dedd70 0x55d588df3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 0x55d588df44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588dda870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d588c50b00 con 0x55d588dda490 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d588bc9360 con 0x55d588dee690 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55d588bc62d0 con 0x55d588dedd70 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa921fb0000 10 client.0 _ll_register_callbacks cb 0x55d588d8b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa91cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588dda870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa91cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588dda870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50500/0 (socket says 172.21.15.144:50500) 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa91cc00640 1 -- 172.21.15.144:0/669713855 learned_addr learned my addr 172.21.15.144:0/669713855 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa917e00640 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dedd70 0x55d588df3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa917400640 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 0x55d588df44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa91cc00640 1 -- 172.21.15.144:0/669713855 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dedd70 msgr2=0x55d588df3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa91cc00640 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dedd70 0x55d588df3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa91cc00640 1 -- 172.21.15.144:0/669713855 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 msgr2=0x55d588df44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa91cc00640 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 0x55d588df44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.278+0000 7fa91cc00640 1 -- 172.21.15.144:0/669713855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d588b95120 con 0x55d588dda490 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa91cc00640 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588dda870 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa910055f10 tx=0x7fa91005a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f51b20cfbbad298 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 1 -- 172.21.15.144:0/669713855 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910081070 con 0x55d588dda490 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 1 -- 172.21.15.144:0/669713855 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fa910052640 con 0x55d588dda490 2024-09-12T12:17:24.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 -- 172.21.15.144:0/669713855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9080a5e10 con 0x55d588dda490 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 1 -- 172.21.15.144:0/669713855 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fa910055420 con 0x55d588dda490 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 10 client.6969 fetch_fsmap learned FSMap version 61 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 -- 172.21.15.144:0/669713855 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55d588b8e450 con 0x55d588dda490 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 1 -- 172.21.15.144:0/669713855 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9080a5e10 con 0x55d588dda490 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 1 -- 172.21.15.144:0/669713855 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7fa9100555c0 con 0x55d588dda490 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 10 client.6969 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 10 client.6969 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 20 client.6969 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55d588ddb280 0x55d588ddb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 4 client.6969 mds_command: new command op to 6933 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 -- 172.21.15.144:0/669713855 --> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d588b88c00 con 0x55d588ddb280 2024-09-12T12:17:24.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa917e00640 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55d588ddb280 0x55d588ddb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa917e00640 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55d588ddb280 0x55d588ddb660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d583c61a267fa15 server_cookie=c3b38dc7f377ad0b in_seq=0 out_seq=0 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 10 client.6969 ms_handle_connect on v2:172.21.15.144:6835/1622416961 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 1 -- 172.21.15.144:0/669713855 <== mds.0 v2:172.21.15.144:6835/1622416961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d588b88c00 con 0x55d588ddb280 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 10 client.6969 handle_command_reply: tid=0 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 client.6969 shutdown 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 -- 172.21.15.144:0/669713855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 msgr2=0x55d588dda870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588dda870 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa910055f10 tx=0x7fa91005a410 comp rx=0 tx=0).stop 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 -- 172.21.15.144:0/669713855 shutdown_connections 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55d588ddb280 0x55d588ddb660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588dda870 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588dee690 0x55d588df44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa901600640 0 client.6969 ms_handle_reset on v2:172.21.15.144:6835/1622416961 2024-09-12T12:17:24.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 --2- 172.21.15.144:0/669713855 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dedd70 0x55d588df3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 -- 172.21.15.144:0/669713855 >> 172.21.15.144:0/669713855 conn(0x55d588da46a0 msgr2=0x55d588da59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:24.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 -- 172.21.15.144:0/669713855 shutdown_connections 2024-09-12T12:17:24.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 1 -- 172.21.15.144:0/669713855 wait complete. 2024-09-12T12:17:24.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.282+0000 7fa921fb0000 20 client.6969 trim_cache size 0 max 16384 2024-09-12T12:17:24.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 Processor -- start 2024-09-12T12:17:24.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 -- start start 2024-09-12T12:17:24.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 0x55d588e043b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 0x55d588e048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa918167730 con 0x55d588dda490 2024-09-12T12:17:24.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa9181f5de0 con 0x55d588da46a0 2024-09-12T12:17:24.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9181670c0 con 0x55d588dda0b0 2024-09-12T12:17:24.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa91cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa91cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50510/0 (socket says 172.21.15.144:50510) 2024-09-12T12:17:24.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa91cc00640 1 -- 172.21.15.144:0/1877103047 learned_addr learned my addr 172.21.15.144:0/1877103047 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa917400640 1 --2- 172.21.15.144:0/1877103047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 0x55d588e048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa917e00640 1 --2- 172.21.15.144:0/1877103047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 0x55d588e043b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa91cc00640 1 -- 172.21.15.144:0/1877103047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 msgr2=0x55d588e043b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa91cc00640 1 --2- 172.21.15.144:0/1877103047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 0x55d588e043b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa91cc00640 1 -- 172.21.15.144:0/1877103047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 msgr2=0x55d588e048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa91cc00640 1 --2- 172.21.15.144:0/1877103047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 0x55d588e048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa91cc00640 1 -- 172.21.15.144:0/1877103047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d588b75fd0 con 0x55d588dda490 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa91cc00640 1 --2- 172.21.15.144:0/1877103047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df2ca0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa910055ec0 tx=0x7fa910058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48236e95fbd609f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa903e00640 1 -- 172.21.15.144:0/1877103047 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910063070 con 0x55d588dda490 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa903e00640 1 -- 172.21.15.144:0/1877103047 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91006f020 con 0x55d588dda490 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa903e00640 1 -- 172.21.15.144:0/1877103047 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910081040 con 0x55d588dda490 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 -- 172.21.15.144:0/1877103047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 msgr2=0x55d588df2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 --2- 172.21.15.144:0/1877103047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df2ca0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa910055ec0 tx=0x7fa910058000 comp rx=0 tx=0).stop 2024-09-12T12:17:24.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 -- 172.21.15.144:0/1877103047 shutdown_connections 2024-09-12T12:17:24.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 --2- 172.21.15.144:0/1877103047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df2ca0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 --2- 172.21.15.144:0/1877103047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 0x55d588e048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 --2- 172.21.15.144:0/1877103047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 0x55d588e043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 -- 172.21.15.144:0/1877103047 >> 172.21.15.144:0/1877103047 conn(0x55d588dd9cd0 msgr2=0x55d588d9eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:24.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 -- 172.21.15.144:0/1877103047 shutdown_connections 2024-09-12T12:17:24.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.302+0000 7fa921fb0000 1 -- 172.21.15.144:0/1877103047 wait complete. 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 -- start start 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 Processor -- start 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 0x55d588e60cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 0x55d588df7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d588bedf80 con 0x55d588dda490 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d588ba6ca0 con 0x55d588da46a0 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55d588bf32a0 con 0x55d588dda0b0 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 10 client.0 _ll_register_callbacks cb 0x7fa910055a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa91cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa91cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50522/0 (socket says 172.21.15.144:50522) 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa91cc00640 1 -- 172.21.15.144:0/2909620524 learned_addr learned my addr 172.21.15.144:0/2909620524 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:24.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa917e00640 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 0x55d588e60cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa917400640 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 0x55d588df7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa91cc00640 1 -- 172.21.15.144:0/2909620524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 msgr2=0x55d588df7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa91cc00640 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 0x55d588df7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa91cc00640 1 -- 172.21.15.144:0/2909620524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 msgr2=0x55d588e60cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa91cc00640 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 0x55d588e60cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa91cc00640 1 -- 172.21.15.144:0/2909620524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d588c71750 con 0x55d588dda490 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa91cc00640 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df8310 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa910054280 tx=0x7fa9100046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3773e0c6570715 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa901600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa901600640 1 -- 172.21.15.144:0/2909620524 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910063030 con 0x55d588dda490 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa901600640 1 -- 172.21.15.144:0/2909620524 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fa910054e90 con 0x55d588dda490 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 -- 172.21.15.144:0/2909620524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa91006f020 con 0x55d588dda490 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa901600640 1 -- 172.21.15.144:0/2909620524 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fa910081050 con 0x55d588dda490 2024-09-12T12:17:24.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 10 client.6975 fetch_fsmap learned FSMap version 61 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 -- 172.21.15.144:0/2909620524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55d588b7ca30 con 0x55d588dda490 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa901600640 1 -- 172.21.15.144:0/2909620524 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91006f020 con 0x55d588dda490 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa901600640 1 -- 172.21.15.144:0/2909620524 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7fa910055090 con 0x55d588dda490 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 10 client.6975 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 10 client.6975 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 20 client.6975 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55d588dedd70 0x55d588df8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 4 client.6975 mds_command: new command op to 6933 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa921fb0000 1 -- 172.21.15.144:0/2909620524 --> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] -- command(tid 0: {"prefix": "status"}) -- 0x55d588bfc3a0 con 0x55d588dedd70 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.306+0000 7fa917e00640 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55d588dedd70 0x55d588df8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa917e00640 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55d588dedd70 0x55d588df8850 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=716ed7448234874 server_cookie=97e36c14c80e646a in_seq=0 out_seq=0 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa901600640 10 client.6975 ms_handle_connect on v2:172.21.15.144:6835/1622416961 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa901600640 1 -- 172.21.15.144:0/2909620524 <== mds.0 v2:172.21.15.144:6835/1622416961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d588bfc3a0 con 0x55d588dedd70 2024-09-12T12:17:24.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa901600640 10 client.6975 handle_command_reply: tid=0 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 client.6975 shutdown 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 -- 172.21.15.144:0/2909620524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 msgr2=0x55d588df8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df8310 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa910054280 tx=0x7fa9100046d0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 -- 172.21.15.144:0/2909620524 shutdown_connections 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55d588dedd70 0x55d588df8850 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d588dda490 0x55d588df8310 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55d588dda0b0 0x55d588df7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 --2- 172.21.15.144:0/2909620524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d588da46a0 0x55d588e60cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa901600640 0 client.6975 ms_handle_reset on v2:172.21.15.144:6835/1622416961 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 -- 172.21.15.144:0/2909620524 >> 172.21.15.144:0/2909620524 conn(0x55d588dd9cd0 msgr2=0x55d588e033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 -- 172.21.15.144:0/2909620524 shutdown_connections 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 1 -- 172.21.15.144:0/2909620524 wait complete. 2024-09-12T12:17:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa921fb0000 20 client.6975 trim_cache size 0 max 16384 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 6933, 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 4.5949400669999996, 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 61, 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 87, 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 87, 2024-09-12T12:17:24.317 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 5.4368255379999999 2024-09-12T12:17:24.318 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:17:24.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 -- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8f80678c0 msgr2=0x7fa8f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8f80678c0 0x7fa8f8069d80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa9080ae000 tx=0x7fa9080a7070 comp rx=0 tx=0).stop 2024-09-12T12:17:24.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 -- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 msgr2=0x7fa918153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 0x7fa918153c70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa91000b410 tx=0x7fa91000b8d0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 -- 172.21.15.144:0/2862139229 shutdown_connections 2024-09-12T12:17:24.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8f80678c0 0x7fa8f8069d80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa91815b160 0x7fa918153c70 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9180cd000 0x7fa918153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 --2- 172.21.15.144:0/2862139229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa918073bd0 0x7fa9180afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 -- 172.21.15.144:0/2862139229 >> 172.21.15.144:0/2862139229 conn(0x7fa91806bc10 msgr2=0x7fa91815b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:24.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 -- 172.21.15.144:0/2862139229 shutdown_connections 2024-09-12T12:17:24.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.310+0000 7fa91d600640 1 -- 172.21.15.144:0/2862139229 wait complete. 2024-09-12T12:17:24.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:17:24.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecca600640 1 Processor -- start 2024-09-12T12:17:24.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecca600640 1 -- start start 2024-09-12T12:17:24.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecca600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415c7b0 0x7fecc40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecca600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fecc40b5fb0 0x7fecc4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecca600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc40cd870 con 0x7fecc415cd30 2024-09-12T12:17:24.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecca600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fecc4072a50 con 0x7fecc40b5fb0 2024-09-12T12:17:24.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecca600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fecc40cde30 con 0x7fecc415c7b0 2024-09-12T12:17:24.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecc3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fecc40b5fb0 0x7fecc4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecc3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fecc40b5fb0 0x7fecc4072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50534/0 (socket says 172.21.15.144:50534) 2024-09-12T12:17:24.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecc3e00640 1 -- 172.21.15.144:0/1256641688 learned_addr learned my addr 172.21.15.144:0/1256641688 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:24.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecc3400640 1 --2- 172.21.15.144:0/1256641688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415c7b0 0x7fecc40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecc3e00640 1 -- 172.21.15.144:0/1256641688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415c7b0 msgr2=0x7fecc40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:24.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecc3e00640 1 --2- 172.21.15.144:0/1256641688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415c7b0 0x7fecc40ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecc3e00640 1 -- 172.21.15.144:0/1256641688 >> v1:172.21.15.165:6789/0 conn(0x7fecc415cd30 legacy=0x7fecc40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.466+0000 7fecc3e00640 1 -- 172.21.15.144:0/1256641688 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc40cdb50 con 0x7fecc40b5fb0 2024-09-12T12:17:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecc3e00640 1 --2- 172.21.15.144:0/1256641688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 0x7fecc4072ee0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009870 tx=0x7fecbc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b63d341bff79de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecc2000640 1 -- 172.21.15.144:0/1256641688 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0a7070 con 0x7fecc40b5fb0 2024-09-12T12:17:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecc2000640 1 -- 172.21.15.144:0/1256641688 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc0b0070 con 0x7fecc40b5fb0 2024-09-12T12:17:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecc2000640 1 -- 172.21.15.144:0/1256641688 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0ab890 con 0x7fecc40b5fb0 2024-09-12T12:17:24.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecca600640 1 -- 172.21.15.144:0/1256641688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 msgr2=0x7fecc4072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecca600640 1 --2- 172.21.15.144:0/1256641688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 0x7fecc4072ee0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009870 tx=0x7fecbc01c560 comp rx=0 tx=0).stop 2024-09-12T12:17:24.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecca600640 1 -- 172.21.15.144:0/1256641688 shutdown_connections 2024-09-12T12:17:24.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecca600640 1 --2- 172.21.15.144:0/1256641688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 0x7fecc4072ee0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecca600640 1 --2- 172.21.15.144:0/1256641688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415c7b0 0x7fecc40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecca600640 1 -- 172.21.15.144:0/1256641688 >> 172.21.15.144:0/1256641688 conn(0x7fecc406d0d0 msgr2=0x7fecc406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:24.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecca600640 1 -- 172.21.15.144:0/1256641688 shutdown_connections 2024-09-12T12:17:24.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.470+0000 7fecca600640 1 -- 172.21.15.144:0/1256641688 wait complete. 2024-09-12T12:17:24.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 Processor -- start 2024-09-12T12:17:24.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 -- start start 2024-09-12T12:17:24.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 0x7fecc4161fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecc415c7b0 0x7fecc415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415cd30 0x7fecc40b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fecc4073fc0 con 0x7fecc40b5fb0 2024-09-12T12:17:24.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecc4073e40 con 0x7fecc415c7b0 2024-09-12T12:17:24.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fecc4074140 con 0x7fecc415cd30 2024-09-12T12:17:24.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 0x7fecc4161fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 0x7fecc4161fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50550/0 (socket says 172.21.15.144:50550) 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3400640 1 -- 172.21.15.144:0/1550657646 learned_addr learned my addr 172.21.15.144:0/1550657646 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3e00640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415cd30 0x7fecc40b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3400640 1 -- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415cd30 msgr2=0x7fecc40b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc2a00640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecc415c7b0 0x7fecc415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3400640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415cd30 0x7fecc40b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3400640 1 -- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecc415c7b0 msgr2=0x7fecc415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3400640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecc415c7b0 0x7fecc415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3400640 1 -- 172.21.15.144:0/1550657646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc415af20 con 0x7fecc40b5fb0 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3e00640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415cd30 0x7fecc40b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:24.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc2a00640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecc415c7b0 0x7fecc415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:24.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecc3400640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 0x7fecc4161fb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fecb4007ef0 tx=0x7fecb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecbb400640 1 -- 172.21.15.144:0/1550657646 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4014620 con 0x7fecc40b5fb0 2024-09-12T12:17:24.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecbb400640 1 -- 172.21.15.144:0/1550657646 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb4019070 con 0x7fecc40b5fb0 2024-09-12T12:17:24.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecbb400640 1 -- 172.21.15.144:0/1550657646 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4014a00 con 0x7fecc40b5fb0 2024-09-12T12:17:24.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc415b200 con 0x7fecc40b5fb0 2024-09-12T12:17:24.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.474+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc415b7c0 con 0x7fecc40b5fb0 2024-09-12T12:17:24.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.478+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc4072ee0 con 0x7fecc40b5fb0 2024-09-12T12:17:24.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.478+0000 7fecbb400640 1 -- 172.21.15.144:0/1550657646 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fecb4014ba0 con 0x7fecc40b5fb0 2024-09-12T12:17:24.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.478+0000 7fecbb400640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca40678c0 0x7feca4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:24.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.478+0000 7fecbb400640 1 -- 172.21.15.144:0/1550657646 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fecb4086880 con 0x7fecc40b5fb0 2024-09-12T12:17:24.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.478+0000 7fecc2a00640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca40678c0 0x7feca4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:24.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.478+0000 7fecc2a00640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca40678c0 0x7feca4069d80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fecc40cc830 tx=0x7fecb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:24.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.482+0000 7fecbb400640 1 -- 172.21.15.144:0/1550657646 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecb4057140 con 0x7fecc40b5fb0 2024-09-12T12:17:24.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fecc415e090 con 0x7fecc40b5fb0 2024-09-12T12:17:24.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecbb400640 1 -- 172.21.15.144:0/1550657646 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7fecb4056a40 con 0x7fecc40b5fb0 2024-09-12T12:17:24.677 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:17:24.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca40678c0 msgr2=0x7feca4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca40678c0 0x7feca4069d80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fecc40cc830 tx=0x7fecb0009040 comp rx=0 tx=0).stop 2024-09-12T12:17:24.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 msgr2=0x7fecc4161fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:24.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 0x7fecc4161fb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fecb4007ef0 tx=0x7fecb400e4b0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 shutdown_connections 2024-09-12T12:17:24.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca40678c0 0x7feca4069d80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fecc415cd30 0x7fecc40b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecc415c7b0 0x7fecc415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 --2- 172.21.15.144:0/1550657646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fecc40b5fb0 0x7fecc4161fb0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:24.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 >> 172.21.15.144:0/1550657646 conn(0x7fecc406d0d0 msgr2=0x7fecc40cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:24.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 shutdown_connections 2024-09-12T12:17:24.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24.674+0000 7fecca600640 1 -- 172.21.15.144:0/1550657646 wait complete. 2024-09-12T12:17:24.702 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:17:24.702 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:17:24.703 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:17:24.703 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:17:24.703 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:24.703 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:17:24.703 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:17:24.703 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:17:24.703 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:17:24.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:24.704 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:17:24.713 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:17:24.713 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:17:24.713 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:17:24.713 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:24.713 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:17:24.713 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:24.713 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:17:24.713 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42138sec preferred_lft 42138sec 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:17:24.714 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:17:24.715 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:17:24.716 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:17:24.716 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:24.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:24.717 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:17:24.776 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:17:24.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:24.778 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:17:24.834 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:17:24.834 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:17:24.834 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:17:24.834 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:17:24.835 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:17:24.835 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:17:24.835 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:17:24.835 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:17:24.835 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:17:24.835 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:17:24.836 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:17:24.836 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:17:24.836 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:17:24.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:17:24.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:17:24.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:17:24.836 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:17:24.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:17:24.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:17:24.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:24.967 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:17:24.976 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:17:24.976 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:17:24.976 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:17:24.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:24.977 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:17:25.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:17:25.038 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:25.087 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:17:25.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:17:25.087 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:25.138 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:17:25.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:25.139 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:17:25.230 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:17:25.231 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:17:25.245 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:17:25.245 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:17:25.245 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:17:25.245 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:17:25.245 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:17:25.250 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:17:25.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:25.250 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:25.269 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:17:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:17:25.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:17:25.367 INFO:teuthology.orchestra.run.smithi144.stdout:client6721 2024-09-12T12:17:25.367 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:25.367 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:25.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:25.423 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-12T12:17:25.476 INFO:teuthology.orchestra.run.smithi144.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-09-12T12:17:25.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:17:25.477 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-09-12T12:17:25.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-09-12T12:17:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1876400640 1 Processor -- start 2024-09-12T12:17:25.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1876400640 1 -- start start 2024-09-12T12:17:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1876400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1870142480 0x7f1870142d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1876400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1870143780 con 0x7f18700b3ab0 2024-09-12T12:17:25.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1876400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1870143a60 con 0x7f1870072e20 2024-09-12T12:17:25.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1876400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1870142860 con 0x7f1870142480 2024-09-12T12:17:25.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f186fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f18700b3ab0 0x7f1870072710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37850/0 (socket says 172.21.15.144:37850) 2024-09-12T12:17:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f186fe00640 1 -- 172.21.15.144:0/520509111 learned_addr learned my addr 172.21.15.144:0/520509111 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1875000640 1 --2- 172.21.15.144:0/520509111 >> v2:172.21.15.165:3300/0 conn(0x7f1870142480 0x7f1870142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f186f400640 1 -- 172.21.15.144:0/520509111 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091281564 0 0) 0x7f1870143780 con 0x7f18700b3ab0 2024-09-12T12:17:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f186f400640 1 -- 172.21.15.144:0/520509111 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1858003530 con 0x7f18700b3ab0 2024-09-12T12:17:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1875000640 1 -- 172.21.15.144:0/520509111 >> v1:172.21.15.165:6789/0 conn(0x7f1870072e20 legacy=0x7f18700cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1875000640 1 -- 172.21.15.144:0/520509111 >> v1:172.21.15.144:6789/0 conn(0x7f18700b3ab0 legacy=0x7f1870072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.658+0000 7f1875000640 1 -- 172.21.15.144:0/520509111 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1870143d40 con 0x7f1870142480 2024-09-12T12:17:25.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f1875000640 1 --2- 172.21.15.144:0/520509111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1870142480 0x7f1870142d30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f18640097c0 tx=0x7f186401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9290903dd79bcdce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:25.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f186f400640 1 -- 172.21.15.144:0/520509111 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640a7070 con 0x7f1870142480 2024-09-12T12:17:25.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f186f400640 1 -- 172.21.15.144:0/520509111 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18640b0070 con 0x7f1870142480 2024-09-12T12:17:25.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f186f400640 1 -- 172.21.15.144:0/520509111 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640ab870 con 0x7f1870142480 2024-09-12T12:17:25.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f1876400640 1 -- 172.21.15.144:0/520509111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1870142480 msgr2=0x7f1870142d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f1876400640 1 --2- 172.21.15.144:0/520509111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1870142480 0x7f1870142d30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f18640097c0 tx=0x7f186401c470 comp rx=0 tx=0).stop 2024-09-12T12:17:25.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f1876400640 1 -- 172.21.15.144:0/520509111 shutdown_connections 2024-09-12T12:17:25.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f1876400640 1 --2- 172.21.15.144:0/520509111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1870142480 0x7f1870142d30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f1876400640 1 -- 172.21.15.144:0/520509111 >> 172.21.15.144:0/520509111 conn(0x7f187006caf0 msgr2=0x7f187006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:25.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f1876400640 1 -- 172.21.15.144:0/520509111 shutdown_connections 2024-09-12T12:17:25.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f1876400640 1 -- 172.21.15.144:0/520509111 wait complete. 2024-09-12T12:17:25.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.662+0000 7f1876400640 1 Processor -- start 2024-09-12T12:17:25.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1876400640 1 -- start start 2024-09-12T12:17:25.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1876400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1870072e20 0x7f1870139360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1876400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18700b3ab0 0x7f187013cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1876400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1870142480 0x7f187013d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1876400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1870169f80 con 0x7f1870072e20 2024-09-12T12:17:25.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1876400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1870169e00 con 0x7f1870142480 2024-09-12T12:17:25.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1876400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f187016a100 con 0x7f18700b3ab0 2024-09-12T12:17:25.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1870072e20 0x7f1870139360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1870072e20 0x7f1870139360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50566/0 (socket says 172.21.15.144:50566) 2024-09-12T12:17:25.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875000640 1 -- 172.21.15.144:0/4223138462 learned_addr learned my addr 172.21.15.144:0/4223138462 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:25.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f186fe00640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18700b3ab0 0x7f187013cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875a00640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1870142480 0x7f187013d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875000640 1 -- 172.21.15.144:0/4223138462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18700b3ab0 msgr2=0x7f187013cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875000640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18700b3ab0 0x7f187013cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875000640 1 -- 172.21.15.144:0/4223138462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1870142480 msgr2=0x7f187013d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875000640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1870142480 0x7f187013d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875000640 1 -- 172.21.15.144:0/4223138462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187015f350 con 0x7f1870072e20 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f186fe00640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18700b3ab0 0x7f187013cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1875000640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1870072e20 0x7f1870139360 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f18640ad040 tx=0x7f186401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f186cc00640 1 -- 172.21.15.144:0/4223138462 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864006e20 con 0x7f1870072e20 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f186cc00640 1 -- 172.21.15.144:0/4223138462 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1864004220 con 0x7f1870072e20 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1876400640 1 -- 172.21.15.144:0/4223138462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18701399f0 con 0x7f1870072e20 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f186cc00640 1 -- 172.21.15.144:0/4223138462 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864003620 con 0x7f1870072e20 2024-09-12T12:17:25.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.666+0000 7f1876400640 1 -- 172.21.15.144:0/4223138462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1870139fb0 con 0x7f1870072e20 2024-09-12T12:17:25.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f186cc00640 1 -- 172.21.15.144:0/4223138462 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18640037c0 con 0x7f1870072e20 2024-09-12T12:17:25.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f186cc00640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18500678c0 0x7f1850069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f186cc00640 1 -- 172.21.15.144:0/4223138462 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f1864120650 con 0x7f1870072e20 2024-09-12T12:17:25.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f186fe00640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18500678c0 0x7f1850069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f187ae90000 1 Processor -- start 2024-09-12T12:17:25.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f187ae90000 1 -- start start 2024-09-12T12:17:25.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f186fe00640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18500678c0 0x7f1850069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1870134b40 tx=0x7f185c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f187ae90000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 0x55ed9efe1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f187ae90000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe1fd0 0x55ed9ef94ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f187ae90000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9ef95400 0x55ed9ef957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f187ae90000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ed9edc2300 con 0x55ed9ef95400 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f187ae90000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed9ede5d70 con 0x55ed9efe16b0 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f187ae90000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ed9eda0ab0 con 0x55ed9efe1fd0 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f1875a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9ef95400 0x55ed9ef957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f1875a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9ef95400 0x55ed9ef957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50570/0 (socket says 172.21.15.144:50570) 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f1875a00640 1 -- 172.21.15.144:0/1673590686 learned_addr learned my addr 172.21.15.144:0/1673590686 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f1875000640 1 --2- 172.21.15.144:0/1673590686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 0x55ed9efe1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.670+0000 7f186fe00640 1 --2- 172.21.15.144:0/1673590686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe1fd0 0x55ed9ef94ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 -- 172.21.15.144:0/1673590686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe1fd0 msgr2=0x55ed9ef94ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:25.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 --2- 172.21.15.144:0/1673590686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe1fd0 0x55ed9ef94ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 -- 172.21.15.144:0/1673590686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 msgr2=0x55ed9efe1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:25.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 --2- 172.21.15.144:0/1673590686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 0x55ed9efe1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 -- 172.21.15.144:0/1673590686 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed9ed9fb80 con 0x55ed9ef95400 2024-09-12T12:17:25.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 --2- 172.21.15.144:0/1673590686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9ef95400 0x55ed9ef957e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1868001c30 tx=0x7f18680020f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442a5f95e32a6e3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:25.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1861600640 1 -- 172.21.15.144:0/1673590686 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868019070 con 0x55ed9ef95400 2024-09-12T12:17:25.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1861600640 1 -- 172.21.15.144:0/1673590686 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1868003b90 con 0x55ed9ef95400 2024-09-12T12:17:25.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1861600640 1 -- 172.21.15.144:0/1673590686 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186800e860 con 0x55ed9ef95400 2024-09-12T12:17:25.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 -- 172.21.15.144:0/1673590686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9ef95400 msgr2=0x55ed9ef957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 --2- 172.21.15.144:0/1673590686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9ef95400 0x55ed9ef957e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1868001c30 tx=0x7f18680020f0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 -- 172.21.15.144:0/1673590686 shutdown_connections 2024-09-12T12:17:25.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 --2- 172.21.15.144:0/1673590686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9ef95400 0x55ed9ef957e0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 --2- 172.21.15.144:0/1673590686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe1fd0 0x55ed9ef94ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 --2- 172.21.15.144:0/1673590686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 0x55ed9efe1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 -- 172.21.15.144:0/1673590686 >> 172.21.15.144:0/1673590686 conn(0x55ed9efc2450 msgr2=0x55ed9efc4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 -- 172.21.15.144:0/1673590686 shutdown_connections 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 -- 172.21.15.144:0/1673590686 wait complete. 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 -- start start 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 Processor -- start 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9ef95400 0x55ed9efe8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe16b0 0x55ed9efe8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9efe90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ed9ed7f4d0 con 0x55ed9efe1fd0 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed9ede1d30 con 0x55ed9ef95400 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ed9efa0800 con 0x55ed9efe16b0 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f187ae90000 10 client.0 _ll_register_callbacks cb 0x55ed9ee99600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9efe90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9efe90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50584/0 (socket says 172.21.15.144:50584) 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 -- 172.21.15.144:0/2637967693 learned_addr learned my addr 172.21.15.144:0/2637967693 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f186fe00640 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe16b0 0x55ed9efe8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875000640 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9ef95400 0x55ed9efe8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 -- 172.21.15.144:0/2637967693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe16b0 msgr2=0x55ed9efe8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe16b0 0x55ed9efe8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 -- 172.21.15.144:0/2637967693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9ef95400 msgr2=0x55ed9efe8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9ef95400 0x55ed9efe8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.674+0000 7f1875a00640 1 -- 172.21.15.144:0/2637967693 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed9eda2720 con 0x55ed9efe1fd0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1875a00640 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9efe90a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1868000f90 tx=0x7f1868001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fb9cc111f3d307 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 1 -- 172.21.15.144:0/2637967693 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868023020 con 0x55ed9efe1fd0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 1 -- 172.21.15.144:0/2637967693 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f186800e960 con 0x55ed9efe1fd0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 -- 172.21.15.144:0/2637967693 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1868003b90 con 0x55ed9efe1fd0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 1 -- 172.21.15.144:0/2637967693 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f186802d050 con 0x55ed9efe1fd0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 10 client.6993 fetch_fsmap learned FSMap version 61 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 -- 172.21.15.144:0/2637967693 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55ed9eda6570 con 0x55ed9efe1fd0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 1 -- 172.21.15.144:0/2637967693 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1868003b90 con 0x55ed9efe1fd0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 1 -- 172.21.15.144:0/2637967693 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7f1868030020 con 0x55ed9efe1fd0 2024-09-12T12:17:25.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 10 client.6993 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T12:17:25.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 10 client.6993 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-12T12:17:25.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 20 client.6993 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:25.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55ed9eff09f0 0x55ed9eff2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 4 client.6993 mds_command: new command op to 6933 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:25.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 -- 172.21.15.144:0/2637967693 --> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed9ed7ff20 con 0x55ed9eff09f0 2024-09-12T12:17:25.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1875000640 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55ed9eff09f0 0x55ed9eff2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1875000640 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55ed9eff09f0 0x55ed9eff2de0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aab2f8536cd13eec server_cookie=a11d1301f323f562 in_seq=0 out_seq=0 2024-09-12T12:17:25.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 10 client.6993 ms_handle_connect on v2:172.21.15.144:6835/1622416961 2024-09-12T12:17:25.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 1 -- 172.21.15.144:0/2637967693 <== mds.0 v2:172.21.15.144:6835/1622416961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed9ed7ff20 con 0x55ed9eff09f0 2024-09-12T12:17:25.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 10 client.6993 handle_command_reply: tid=0 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 client.6993 shutdown 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 -- 172.21.15.144:0/2637967693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 msgr2=0x55ed9efe90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9efe90a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1868000f90 tx=0x7f1868001260 comp rx=0 tx=0).stop 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 -- 172.21.15.144:0/2637967693 shutdown_connections 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55ed9eff09f0 0x55ed9eff2de0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9efe90a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9efe16b0 0x55ed9efe8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f1856000640 0 client.6993 ms_handle_reset on v2:172.21.15.144:6835/1622416961 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 --2- 172.21.15.144:0/2637967693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9ef95400 0x55ed9efe8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 -- 172.21.15.144:0/2637967693 >> 172.21.15.144:0/2637967693 conn(0x55ed9efc2450 msgr2=0x55ed9ef945c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 -- 172.21.15.144:0/2637967693 shutdown_connections 2024-09-12T12:17:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 1 -- 172.21.15.144:0/2637967693 wait complete. 2024-09-12T12:17:25.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.678+0000 7f187ae90000 20 client.6993 trim_cache size 0 max 16384 2024-09-12T12:17:25.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 Processor -- start 2024-09-12T12:17:25.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 -- start start 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe16b0 0x55ed9ef946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe1fd0 0x55ed9ef94be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f18702041a0 con 0x55ed9efe16b0 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1870203180 con 0x55ed9efe1fd0 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f187006eef0 con 0x55ed9ef95400 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f186fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe16b0 0x55ed9ef946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f186fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe16b0 0x55ed9ef946a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50590/0 (socket says 172.21.15.144:50590) 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f186fe00640 1 -- 172.21.15.144:0/687444412 learned_addr learned my addr 172.21.15.144:0/687444412 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f1875000640 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f1875a00640 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe1fd0 0x55ed9ef94be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f186fe00640 1 -- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 msgr2=0x55ed9eff6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f186fe00640 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f186fe00640 1 -- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe1fd0 msgr2=0x55ed9ef94be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f186fe00640 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe1fd0 0x55ed9ef94be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f186fe00640 1 -- 172.21.15.144:0/687444412 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed9ed85770 con 0x55ed9efe16b0 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f1875000640 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f1875a00640 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe1fd0 0x55ed9ef94be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f186fe00640 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe16b0 0x55ed9ef946a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f185c005b70 tx=0x7f185c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe15dc84a268e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f1860c00640 1 -- 172.21.15.144:0/687444412 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c028070 con 0x55ed9efe16b0 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f1860c00640 1 -- 172.21.15.144:0/687444412 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185c00e9c0 con 0x55ed9efe16b0 2024-09-12T12:17:25.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f1860c00640 1 -- 172.21.15.144:0/687444412 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c00eb70 con 0x55ed9efe16b0 2024-09-12T12:17:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 -- 172.21.15.144:0/687444412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe16b0 msgr2=0x55ed9ef946a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe16b0 0x55ed9ef946a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f185c005b70 tx=0x7f185c011000 comp rx=0 tx=0).stop 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 -- 172.21.15.144:0/687444412 shutdown_connections 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe1fd0 0x55ed9ef94be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe16b0 0x55ed9ef946a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 --2- 172.21.15.144:0/687444412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 -- 172.21.15.144:0/687444412 >> 172.21.15.144:0/687444412 conn(0x55ed9efc2450 msgr2=0x55ed9ef9cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 -- 172.21.15.144:0/687444412 shutdown_connections 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.698+0000 7f187ae90000 1 -- 172.21.15.144:0/687444412 wait complete. 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 -- start start 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 Processor -- start 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 0x55ed9f0110d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9f011610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ed9ede1d30 con 0x55ed9efe1fd0 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f187006f540 con 0x55ed9efe16b0 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ed9ee683f0 con 0x55ed9ef95400 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 10 client.0 _ll_register_callbacks cb 0x7f1868017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9f011610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9f011610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50600/0 (socket says 172.21.15.144:50600) 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875a00640 1 -- 172.21.15.144:0/185446675 learned_addr learned my addr 172.21.15.144:0/185446675 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f186fe00640 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 0x55ed9f0110d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875a00640 1 -- 172.21.15.144:0/185446675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 msgr2=0x55ed9eff5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875a00640 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875a00640 1 -- 172.21.15.144:0/185446675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 msgr2=0x55ed9f0110d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875a00640 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 0x55ed9f0110d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875a00640 1 -- 172.21.15.144:0/185446675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed9ee68880 con 0x55ed9efe1fd0 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875000640 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f186fe00640 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 0x55ed9f0110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875a00640 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9f011610 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f186800e530 tx=0x7f1868009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1744a0e2d864b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1856000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1856000640 1 -- 172.21.15.144:0/185446675 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868036060 con 0x55ed9efe1fd0 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1856000640 1 -- 172.21.15.144:0/185446675 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f1868006d60 con 0x55ed9efe1fd0 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 -- 172.21.15.144:0/185446675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f185c00e9c0 con 0x55ed9efe1fd0 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1856000640 1 -- 172.21.15.144:0/185446675 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f186803c050 con 0x55ed9efe1fd0 2024-09-12T12:17:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 10 client.6999 fetch_fsmap learned FSMap version 61 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 -- 172.21.15.144:0/185446675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55ed9ee3f590 con 0x55ed9efe1fd0 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1856000640 1 -- 172.21.15.144:0/185446675 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185c00e9c0 con 0x55ed9efe1fd0 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1856000640 1 -- 172.21.15.144:0/185446675 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7f186803f020 con 0x55ed9efe1fd0 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 10 client.6999 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 10 client.6999 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 20 client.6999 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55ed9f011b50 0x55ed9f054c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 4 client.6999 mds_command: new command op to 6933 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f187ae90000 1 -- 172.21.15.144:0/185446675 --> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x55ed9edf34a0 con 0x55ed9f011b50 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875000640 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55ed9f011b50 0x55ed9f054c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1856000640 10 client.6999 ms_handle_connect on v2:172.21.15.144:6835/1622416961 2024-09-12T12:17:25.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.702+0000 7f1875000640 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55ed9f011b50 0x55ed9f054c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb9d1d644177890 server_cookie=7d18510c1a829bad in_seq=0 out_seq=0 2024-09-12T12:17:25.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1856000640 1 -- 172.21.15.144:0/185446675 <== mds.0 v2:172.21.15.144:6835/1622416961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ed9edf34a0 con 0x55ed9f011b50 2024-09-12T12:17:25.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1856000640 10 client.6999 handle_command_reply: tid=0 2024-09-12T12:17:25.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 client.6999 shutdown 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 -- 172.21.15.144:0/185446675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 msgr2=0x55ed9f011610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9f011610 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f186800e530 tx=0x7f1868009040 comp rx=0 tx=0).stop 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 -- 172.21.15.144:0/185446675 shutdown_connections 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.144:6835/1622416961,v1:172.21.15.144:6837/1622416961] conn(0x55ed9f011b50 0x55ed9f054c10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9efe1fd0 0x55ed9f011610 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed9efe16b0 0x55ed9f0110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 --2- 172.21.15.144:0/185446675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ed9ef95400 0x55ed9eff5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 -- 172.21.15.144:0/185446675 >> 172.21.15.144:0/185446675 conn(0x55ed9efc2450 msgr2=0x55ed9ef9d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1856000640 0 client.6999 ms_handle_reset on v2:172.21.15.144:6835/1622416961 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 -- 172.21.15.144:0/185446675 shutdown_connections 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 1 -- 172.21.15.144:0/185446675 wait complete. 2024-09-12T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f187ae90000 20 client.6999 trim_cache size 0 max 16384 2024-09-12T12:17:25.713 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:17:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:17:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "0e51ef47-9a14-4bd2-85d6-f6e03012a7de", 2024-09-12T12:17:25.713 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:17:25.713 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:17:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 -- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18500678c0 msgr2=0x7f1850069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18500678c0 0x7f1850069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1870134b40 tx=0x7f185c009040 comp rx=0 tx=0).stop 2024-09-12T12:17:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 -- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1870072e20 msgr2=0x7f1870139360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1870072e20 0x7f1870139360 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f18640ad040 tx=0x7f186401acb0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 -- 172.21.15.144:0/4223138462 shutdown_connections 2024-09-12T12:17:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f18500678c0 0x7f1850069d80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1870142480 0x7f187013d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18700b3ab0 0x7f187013cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 --2- 172.21.15.144:0/4223138462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1870072e20 0x7f1870139360 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:25.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 -- 172.21.15.144:0/4223138462 >> 172.21.15.144:0/4223138462 conn(0x7f187006caf0 msgr2=0x7f18700b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:25.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 -- 172.21.15.144:0/4223138462 shutdown_connections 2024-09-12T12:17:25.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:25.706+0000 7f1876400640 1 -- 172.21.15.144:0/4223138462 wait complete. 2024-09-12T12:17:25.716 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-12T12:17:25.714+0000 7f002cc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:17:25.729 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '0e51ef47-9a14-4bd2-85d6-f6e03012a7de', 'mode': 'asynchronous'}' 2024-09-12T12:17:35.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:35.730 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-12T12:17:35.743 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:17:35.744 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:17:35.874 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:17:35.953 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:17:35.953 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:17:35.953 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:35.953 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:35.963 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:35.963 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:36.015 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:17:36.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8fa000640 1 Processor -- start 2024-09-12T12:17:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8fa000640 1 -- start start 2024-09-12T12:17:36.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8fa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc8f415c7b0 0x7fc8f40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8fa000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f40b5fb0 0x7fc8f4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8fa000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f40cd870 con 0x7fc8f415cd30 2024-09-12T12:17:36.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8fa000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f4072a50 con 0x7fc8f415c7b0 2024-09-12T12:17:36.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8fa000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f40cde30 con 0x7fc8f40b5fb0 2024-09-12T12:17:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc8f415cd30 0x7fc8f40b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52160/0 (socket says 172.21.15.144:52160) 2024-09-12T12:17:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f2a00640 1 -- 172.21.15.144:0/2750341934 learned_addr learned my addr 172.21.15.144:0/2750341934 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f3400640 1 --2- 172.21.15.144:0/2750341934 >> v2:172.21.15.144:3300/0 conn(0x7fc8f415c7b0 0x7fc8f40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f3e00640 1 --2- 172.21.15.144:0/2750341934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f40b5fb0 0x7fc8f4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f2000640 1 -- 172.21.15.144:0/2750341934 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 666137658 0 0) 0x7fc8f40cd870 con 0x7fc8f415cd30 2024-09-12T12:17:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f2000640 1 -- 172.21.15.144:0/2750341934 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8d8003530 con 0x7fc8f415cd30 2024-09-12T12:17:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f3400640 1 -- 172.21.15.144:0/2750341934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f40b5fb0 msgr2=0x7fc8f4072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f3400640 1 --2- 172.21.15.144:0/2750341934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f40b5fb0 0x7fc8f4072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f3400640 1 -- 172.21.15.144:0/2750341934 >> v1:172.21.15.144:6789/0 conn(0x7fc8f415cd30 legacy=0x7fc8f40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.202+0000 7fc8f3400640 1 -- 172.21.15.144:0/2750341934 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f40cdb50 con 0x7fc8f415c7b0 2024-09-12T12:17:36.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8f3400640 1 --2- 172.21.15.144:0/2750341934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 0x7fc8f40ccf00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40097c0 tx=0x7fc8e401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5096a69462cb7db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:36.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8f2000640 1 -- 172.21.15.144:0/2750341934 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40b1070 con 0x7fc8f415c7b0 2024-09-12T12:17:36.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8f2000640 1 -- 172.21.15.144:0/2750341934 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e40ac410 con 0x7fc8f415c7b0 2024-09-12T12:17:36.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8f2000640 1 -- 172.21.15.144:0/2750341934 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40ac7e0 con 0x7fc8f415c7b0 2024-09-12T12:17:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8fa000640 1 -- 172.21.15.144:0/2750341934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 msgr2=0x7fc8f40ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8fa000640 1 --2- 172.21.15.144:0/2750341934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 0x7fc8f40ccf00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40097c0 tx=0x7fc8e401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8fa000640 1 -- 172.21.15.144:0/2750341934 shutdown_connections 2024-09-12T12:17:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8fa000640 1 --2- 172.21.15.144:0/2750341934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f40b5fb0 0x7fc8f4072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8fa000640 1 --2- 172.21.15.144:0/2750341934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 0x7fc8f40ccf00 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8fa000640 1 -- 172.21.15.144:0/2750341934 >> 172.21.15.144:0/2750341934 conn(0x7fc8f406d0d0 msgr2=0x7fc8f406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8fa000640 1 -- 172.21.15.144:0/2750341934 shutdown_connections 2024-09-12T12:17:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.206+0000 7fc8fa000640 1 -- 172.21.15.144:0/2750341934 wait complete. 2024-09-12T12:17:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 Processor -- start 2024-09-12T12:17:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 -- start start 2024-09-12T12:17:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8f40b5fb0 0x7fc8f4165b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 0x7fc8f4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f415cd30 0x7fc8f40b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4073fc0 con 0x7fc8f415c7b0 2024-09-12T12:17:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4073e40 con 0x7fc8f40b5fb0 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f4074140 con 0x7fc8f415cd30 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 0x7fc8f4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 0x7fc8f4152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56124/0 (socket says 172.21.15.144:56124) 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f2a00640 1 -- 172.21.15.144:0/1975179973 learned_addr learned my addr 172.21.15.144:0/1975179973 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f3400640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8f40b5fb0 0x7fc8f4165b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f3e00640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f415cd30 0x7fc8f40b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f2a00640 1 -- 172.21.15.144:0/1975179973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f415cd30 msgr2=0x7fc8f40b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f2a00640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f415cd30 0x7fc8f40b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f2a00640 1 -- 172.21.15.144:0/1975179973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8f40b5fb0 msgr2=0x7fc8f4165b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f2a00640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8f40b5fb0 0x7fc8f4165b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f2a00640 1 -- 172.21.15.144:0/1975179973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f4153150 con 0x7fc8f415c7b0 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8f2a00640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 0x7fc8f4152c10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00010f0 tx=0x7fc8e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8eb400640 1 -- 172.21.15.144:0/1975179973 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0017070 con 0x7fc8f415c7b0 2024-09-12T12:17:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8eb400640 1 -- 172.21.15.144:0/1975179973 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e0005d10 con 0x7fc8f415c7b0 2024-09-12T12:17:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f4153410 con 0x7fc8f415c7b0 2024-09-12T12:17:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8eb400640 1 -- 172.21.15.144:0/1975179973 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0007310 con 0x7fc8f415c7b0 2024-09-12T12:17:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f41635e0 con 0x7fc8f415c7b0 2024-09-12T12:17:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.210+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f4072ec0 con 0x7fc8f415c7b0 2024-09-12T12:17:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.214+0000 7fc8eb400640 1 -- 172.21.15.144:0/1975179973 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc8e001a070 con 0x7fc8f415c7b0 2024-09-12T12:17:36.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.214+0000 7fc8eb400640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8d40678c0 0x7fc8d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.214+0000 7fc8eb400640 1 -- 172.21.15.144:0/1975179973 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fc8e0085230 con 0x7fc8f415c7b0 2024-09-12T12:17:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.214+0000 7fc8f3400640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8d40678c0 0x7fc8d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.214+0000 7fc8f3400640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8d40678c0 0x7fc8d4069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40ae000 tx=0x7fc8e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.218+0000 7fc8eb400640 1 -- 172.21.15.144:0/1975179973 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc8e00554a0 con 0x7fc8f415c7b0 2024-09-12T12:17:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.390+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc8f40afad0 con 0x7fc8f415c7b0 2024-09-12T12:17:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.390+0000 7fc8eb400640 1 -- 172.21.15.144:0/1975179973 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v87) ==== 80+0+124 (secure 0 0 0) 0x7fc8e00597a0 con 0x7fc8f415c7b0 2024-09-12T12:17:36.395 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:6837/2111043825 2024-09-13T12:17:18.704380+0000 2024-09-12T12:17:36.395 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:6835/2111043825 2024-09-13T12:17:18.704380+0000 2024-09-12T12:17:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:listed 2 entries 2024-09-12T12:17:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8d40678c0 msgr2=0x7fc8d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8d40678c0 0x7fc8d4069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40ae000 tx=0x7fc8e4008040 comp rx=0 tx=0).stop 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 msgr2=0x7fc8f4152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 0x7fc8f4152c10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00010f0 tx=0x7fc8e000c890 comp rx=0 tx=0).stop 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 shutdown_connections 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc8d40678c0 0x7fc8d4069d80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8f415cd30 0x7fc8f40b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8f415c7b0 0x7fc8f4152c10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 --2- 172.21.15.144:0/1975179973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8f40b5fb0 0x7fc8f4165b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 >> 172.21.15.144:0/1975179973 conn(0x7fc8f406d0d0 msgr2=0x7fc8f4153ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 shutdown_connections 2024-09-12T12:17:36.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.394+0000 7fc8fa000640 1 -- 172.21.15.144:0/1975179973 wait complete. 2024-09-12T12:17:36.416 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:17:36.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:36.416 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:36.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:17:36.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:36.446 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:17:36.499 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:17:36.499 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:17:36.500 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:36.509 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:17:36.510 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:17:36.510 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:36.510 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:36.552 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:17:36.552 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:17:36.552 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:17:36.552 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:36.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:17:36.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.726+0000 7ff6ec000640 1 Processor -- start 2024-09-12T12:17:36.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.726+0000 7ff6ec000640 1 -- start start 2024-09-12T12:17:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6ec000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6ec000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e40b54a0 con 0x7ff6e40afab0 2024-09-12T12:17:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6ec000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e40b5780 con 0x7ff6e415e600 2024-09-12T12:17:36.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6ec000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e40b5270 con 0x7ff6e406f020 2024-09-12T12:17:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6e8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6ea000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff6e40afab0 0x7ff6e40b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52174/0 (socket says 172.21.15.144:52174) 2024-09-12T12:17:36.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6ea000640 1 -- 172.21.15.144:0/2149895833 learned_addr learned my addr 172.21.15.144:0/2149895833 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:36.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6e8c00640 1 -- 172.21.15.144:0/2149895833 >> v1:172.21.15.165:6789/0 conn(0x7ff6e415e600 legacy=0x7ff6e406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6e8c00640 1 -- 172.21.15.144:0/2149895833 >> v1:172.21.15.144:6789/0 conn(0x7ff6e40afab0 legacy=0x7ff6e40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.730+0000 7ff6e8c00640 1 -- 172.21.15.144:0/2149895833 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e40b5a60 con 0x7ff6e406f020 2024-09-12T12:17:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/2149895833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40717f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00097f0 tx=0x7ff6d001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b120bdd4f506c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6e3e00640 1 -- 172.21.15.144:0/2149895833 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00b0070 con 0x7ff6e406f020 2024-09-12T12:17:36.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6e3e00640 1 -- 172.21.15.144:0/2149895833 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d00ab600 con 0x7ff6e406f020 2024-09-12T12:17:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6e3e00640 1 -- 172.21.15.144:0/2149895833 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00ab9d0 con 0x7ff6e406f020 2024-09-12T12:17:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6ec000640 1 -- 172.21.15.144:0/2149895833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 msgr2=0x7ff6e40717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6ec000640 1 --2- 172.21.15.144:0/2149895833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40717f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00097f0 tx=0x7ff6d001c4e0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6ec000640 1 -- 172.21.15.144:0/2149895833 shutdown_connections 2024-09-12T12:17:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6ec000640 1 --2- 172.21.15.144:0/2149895833 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40717f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6ec000640 1 -- 172.21.15.144:0/2149895833 >> 172.21.15.144:0/2149895833 conn(0x7ff6e406ddf0 msgr2=0x7ff6e406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6ec000640 1 -- 172.21.15.144:0/2149895833 shutdown_connections 2024-09-12T12:17:36.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.734+0000 7ff6ec000640 1 -- 172.21.15.144:0/2149895833 wait complete. 2024-09-12T12:17:36.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ec000640 1 Processor -- start 2024-09-12T12:17:36.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ec000640 1 -- start start 2024-09-12T12:17:36.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ec000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ec000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e40afab0 0x7ff6e4146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ec000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e415e600 0x7ff6e41472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ec000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e416cbd0 con 0x7ff6e415e600 2024-09-12T12:17:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ec000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e416ca50 con 0x7ff6e40afab0 2024-09-12T12:17:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ec000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e416cd50 con 0x7ff6e406f020 2024-09-12T12:17:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e40afab0 0x7ff6e4146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ea000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e415e600 0x7ff6e41472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e9600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e40afab0 0x7ff6e4146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50640/0 (socket says 172.21.15.144:50640) 2024-09-12T12:17:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e8c00640 1 -- 172.21.15.144:0/671965635 learned_addr learned my addr 172.21.15.144:0/671965635 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:36.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e9600640 1 -- 172.21.15.144:0/671965635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e40afab0 msgr2=0x7ff6e4146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e9600640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e40afab0 0x7ff6e4146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e9600640 1 -- 172.21.15.144:0/671965635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e415e600 msgr2=0x7ff6e41472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e9600640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e415e600 0x7ff6e41472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e9600640 1 -- 172.21.15.144:0/671965635 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e414c850 con 0x7ff6e406f020 2024-09-12T12:17:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e40afab0 0x7ff6e4146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e9600640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40d0020 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c3c0 tx=0x7ff6d800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e1600640 1 -- 172.21.15.144:0/671965635 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d80052d0 con 0x7ff6e406f020 2024-09-12T12:17:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e1600640 1 -- 172.21.15.144:0/671965635 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d8005470 con 0x7ff6e406f020 2024-09-12T12:17:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e40725f0 con 0x7ff6e406f020 2024-09-12T12:17:36.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.738+0000 7ff6e1600640 1 -- 172.21.15.144:0/671965635 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8007260 con 0x7ff6e406f020 2024-09-12T12:17:36.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.742+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e4072bb0 con 0x7ff6e406f020 2024-09-12T12:17:36.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.742+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e40717f0 con 0x7ff6e406f020 2024-09-12T12:17:36.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.742+0000 7ff6e1600640 1 -- 172.21.15.144:0/671965635 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff6d8007400 con 0x7ff6e406f020 2024-09-12T12:17:36.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.742+0000 7ff6e1600640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff6c40678c0 0x7ff6c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:36.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.742+0000 7ff6e1600640 1 -- 172.21.15.144:0/671965635 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7ff6d8085380 con 0x7ff6e406f020 2024-09-12T12:17:36.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.742+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff6c40678c0 0x7ff6c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:36.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.742+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff6c40678c0 0x7ff6c4069d80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff6d001a110 tx=0x7ff6d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:36.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.746+0000 7ff6e1600640 1 -- 172.21.15.144:0/671965635 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff6d8055700 con 0x7ff6e406f020 2024-09-12T12:17:36.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6e414e6b0 con 0x7ff6e406f020 2024-09-12T12:17:36.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6e1600640 1 -- 172.21.15.144:0/671965635 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5235 (secure 0 0 0) 0x7ff6d8059a00 con 0x7ff6e406f020 2024-09-12T12:17:36.945 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:36.945 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":61,"btime":"2024-09-12T12:17:22:733420+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1090713174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1090713174},{"type":"v1","addr":"172.21.15.165:6835","nonce":1090713174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6915,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3715410946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3715410946},{"type":"v1","addr":"172.21.15.165:6833","nonce":3715410946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/974267816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":974267816},{"type":"v1","addr":"172.21.15.144:6836","nonce":974267816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:22.733410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6933},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6933":{"gid":6933,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/1622416961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1622416961},{"type":"v1","addr":"172.21.15.144:6837","nonce":1622416961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6933,"qdb_cluster":[6933]},"id":5}]} 2024-09-12T12:17:36.945 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 61 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff6c40678c0 msgr2=0x7ff6c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff6c40678c0 0x7ff6c4069d80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff6d001a110 tx=0x7ff6d0008040 comp rx=0 tx=0).stop 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 msgr2=0x7ff6e40d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40d0020 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c3c0 tx=0x7ff6d800c880 comp rx=0 tx=0).stop 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 shutdown_connections 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff6c40678c0 0x7ff6c4069d80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e415e600 0x7ff6e41472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e40afab0 0x7ff6e4146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 --2- 172.21.15.144:0/671965635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e406f020 0x7ff6e40d0020 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:36.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 >> 172.21.15.144:0/671965635 conn(0x7ff6e406ddf0 msgr2=0x7ff6e415af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:36.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 shutdown_connections 2024-09-12T12:17:36.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:36.942+0000 7ff6ec000640 1 -- 172.21.15.144:0/671965635 wait complete. 2024-09-12T12:17:36.966 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.098+0000 7fb7eda00640 1 Processor -- start 2024-09-12T12:17:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.098+0000 7fb7eda00640 1 -- start start 2024-09-12T12:17:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.098+0000 7fb7eda00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e80b4980 0x7fb7e80b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.098+0000 7fb7eda00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb7e80b7140 0x7fb7e8073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.098+0000 7fb7eda00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e806dfe0 con 0x7fb7e815e440 2024-09-12T12:17:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.098+0000 7fb7eda00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e806ed60 con 0x7fb7e80b7140 2024-09-12T12:17:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.098+0000 7fb7eda00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e806e280 con 0x7fb7e80b4980 2024-09-12T12:17:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb7e815e440 0x7fb7e80b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47158/0 (socket says 172.21.15.144:47158) 2024-09-12T12:17:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6a00640 1 -- 172.21.15.144:0/756282258 learned_addr learned my addr 172.21.15.144:0/756282258 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6000640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e80b4980 0x7fb7e80b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e7400640 1 --2- 172.21.15.144:0/756282258 >> v2:172.21.15.165:3300/0 conn(0x7fb7e80b7140 0x7fb7e8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209686895 0 0) 0x7fb7e806dfe0 con 0x7fb7e815e440 2024-09-12T12:17:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7cc003530 con 0x7fb7e815e440 2024-09-12T12:17:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4047068864 0 0) 0x7fb7cc003530 con 0x7fb7e815e440 2024-09-12T12:17:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e80b4980 msgr2=0x7fb7e80b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e80b4980 0x7fb7e80b6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 >> v2:172.21.15.165:3300/0 conn(0x7fb7e80b7140 msgr2=0x7fb7e8073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 --2- 172.21.15.144:0/756282258 >> v2:172.21.15.165:3300/0 conn(0x7fb7e80b7140 0x7fb7e8073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e806e560 con 0x7fb7e815e440 2024-09-12T12:17:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fb7d8001a00 con 0x7fb7e815e440 2024-09-12T12:17:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 >> v1:172.21.15.144:6789/0 conn(0x7fb7e815e440 legacy=0x7fb7e80b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc0039c0 0x7fb7cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7cc004810 0x7fb7cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e80b4980 0x7fb7cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e806ed60 con 0x7fb7cc0039c0 2024-09-12T12:17:37.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e806e280 con 0x7fb7cc004810 2024-09-12T12:17:37.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7cc00b9d0 con 0x7fb7e80b4980 2024-09-12T12:17:37.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc0039c0 0x7fb7cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e7400640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e80b4980 0x7fb7cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6000640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7cc004810 0x7fb7cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6a00640 1 -- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e80b4980 msgr2=0x7fb7cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e80b4980 0x7fb7cc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6a00640 1 -- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7cc004810 msgr2=0x7fb7cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7cc004810 0x7fb7cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.102+0000 7fb7e6a00640 1 -- 172.21.15.144:0/756282258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc003530 con 0x7fb7cc0039c0 2024-09-12T12:17:37.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc0039c0 0x7fb7cc003de0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800a870 tx=0x7fb7d801d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd566b507408da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800a4c0 con 0x7fb7cc0039c0 2024-09-12T12:17:37.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d80ad630 con 0x7fb7cc0039c0 2024-09-12T12:17:37.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7e5600640 1 -- 172.21.15.144:0/756282258 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80ada20 con 0x7fb7cc0039c0 2024-09-12T12:17:37.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7eda00640 1 -- 172.21.15.144:0/756282258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc0039c0 msgr2=0x7fb7cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7eda00640 1 --2- 172.21.15.144:0/756282258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7cc0039c0 0x7fb7cc003de0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800a870 tx=0x7fb7d801d370 comp rx=0 tx=0).stop 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7e7400640 1 -- 172.21.15.144:0/756282258 reap_dead start 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7eda00640 1 -- 172.21.15.144:0/756282258 shutdown_connections 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7eda00640 1 -- 172.21.15.144:0/756282258 >> 172.21.15.144:0/756282258 conn(0x7fb7e806f3e0 msgr2=0x7fb7e806f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7eda00640 1 -- 172.21.15.144:0/756282258 shutdown_connections 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7eda00640 1 -- 172.21.15.144:0/756282258 wait complete. 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7eda00640 1 Processor -- start 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.106+0000 7fb7eda00640 1 -- start start 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7eda00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7cc0039c0 0x7fb7e8147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7eda00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e8154bf0 0x7fb7e8155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7eda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e8156f10 0x7fb7e81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7eda00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e815e9a0 con 0x7fb7e8156f10 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7eda00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e815e820 con 0x7fb7cc0039c0 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7eda00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e80b7550 con 0x7fb7e8154bf0 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e8156f10 0x7fb7e81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e8156f10 0x7fb7e81573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52420/0 (socket says 172.21.15.144:52420) 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e7400640 1 -- 172.21.15.144:0/1011189757 learned_addr learned my addr 172.21.15.144:0/1011189757 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7cc0039c0 0x7fb7e8147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e6000640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e8154bf0 0x7fb7e8155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e7400640 1 -- 172.21.15.144:0/1011189757 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e8154bf0 msgr2=0x7fb7e8155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e7400640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e8154bf0 0x7fb7e8155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e7400640 1 -- 172.21.15.144:0/1011189757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7cc0039c0 msgr2=0x7fb7e8147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e7400640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7cc0039c0 0x7fb7e8147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e7400640 1 -- 172.21.15.144:0/1011189757 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8161940 con 0x7fb7e8156f10 2024-09-12T12:17:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7e7400640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e8156f10 0x7fb7e81573c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80731e0 tx=0x7fb7e0011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7dea00640 1 -- 172.21.15.144:0/1011189757 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0004240 con 0x7fb7e8156f10 2024-09-12T12:17:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7dea00640 1 -- 172.21.15.144:0/1011189757 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e001b070 con 0x7fb7e8156f10 2024-09-12T12:17:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7dea00640 1 -- 172.21.15.144:0/1011189757 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000f720 con 0x7fb7e8156f10 2024-09-12T12:17:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e815f780 con 0x7fb7e8156f10 2024-09-12T12:17:37.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e815fd40 con 0x7fb7e8156f10 2024-09-12T12:17:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e8073250 con 0x7fb7e8156f10 2024-09-12T12:17:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.110+0000 7fb7dea00640 1 -- 172.21.15.144:0/1011189757 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7e0012040 con 0x7fb7e8156f10 2024-09-12T12:17:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.114+0000 7fb7dea00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7c80678c0 0x7fb7c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.114+0000 7fb7dea00640 1 -- 172.21.15.144:0/1011189757 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fb7e0085de0 con 0x7fb7e8156f10 2024-09-12T12:17:37.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.114+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7c80678c0 0x7fb7c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.114+0000 7fb7e6a00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7c80678c0 0x7fb7c8069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80ad000 tx=0x7fb7d8001370 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.118+0000 7fb7dea00640 1 -- 172.21.15.144:0/1011189757 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7e00566a0 con 0x7fb7e8156f10 2024-09-12T12:17:37.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.310+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7e815b5c0 con 0x7fb7e8156f10 2024-09-12T12:17:37.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.310+0000 7fb7dea00640 1 -- 172.21.15.144:0/1011189757 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5235 (secure 0 0 0) 0x7fb7e0055fa0 con 0x7fb7e8156f10 2024-09-12T12:17:37.314 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:37.314 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":61,"btime":"2024-09-12T12:17:22:733420+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1090713174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1090713174},{"type":"v1","addr":"172.21.15.165:6835","nonce":1090713174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6915,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3715410946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3715410946},{"type":"v1","addr":"172.21.15.165:6833","nonce":3715410946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/974267816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":974267816},{"type":"v1","addr":"172.21.15.144:6836","nonce":974267816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:22.733410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6933},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6933":{"gid":6933,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/1622416961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1622416961},{"type":"v1","addr":"172.21.15.144:6837","nonce":1622416961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6933,"qdb_cluster":[6933]},"id":5}]} 2024-09-12T12:17:37.314 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 61 2024-09-12T12:17:37.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7c80678c0 msgr2=0x7fb7c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7c80678c0 0x7fb7c8069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80ad000 tx=0x7fb7d8001370 comp rx=0 tx=0).stop 2024-09-12T12:17:37.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e8156f10 msgr2=0x7fb7e81573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e8156f10 0x7fb7e81573c0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80731e0 tx=0x7fb7e0011cf0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 shutdown_connections 2024-09-12T12:17:37.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7c80678c0 0x7fb7c8069d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e8156f10 0x7fb7e81573c0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7e8154bf0 0x7fb7e8155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 --2- 172.21.15.144:0/1011189757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7cc0039c0 0x7fb7e8147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 >> 172.21.15.144:0/1011189757 conn(0x7fb7e806f3e0 msgr2=0x7fb7e81622d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:37.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 shutdown_connections 2024-09-12T12:17:37.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.314+0000 7fb7eda00640 1 -- 172.21.15.144:0/1011189757 wait complete. 2024-09-12T12:17:37.336 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:17:37.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.470+0000 7fb829400640 1 Processor -- start 2024-09-12T12:17:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.470+0000 7fb829400640 1 -- start start 2024-09-12T12:17:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.470+0000 7fb829400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb8240b67c0 0x7fb8240b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.470+0000 7fb829400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb824162720 con 0x7fb8240d2e10 2024-09-12T12:17:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.470+0000 7fb829400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb824162a00 con 0x7fb82415e4a0 2024-09-12T12:17:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.470+0000 7fb829400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb824073310 con 0x7fb8240b67c0 2024-09-12T12:17:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.470+0000 7fb823400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb8240d2e10 0x7fb8240737a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47172/0 (socket says 172.21.15.144:47172) 2024-09-12T12:17:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.470+0000 7fb823400640 1 -- 172.21.15.144:0/4203607526 learned_addr learned my addr 172.21.15.144:0/4203607526 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:37.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb828a00640 1 --2- 172.21.15.144:0/4203607526 >> v2:172.21.15.165:3300/0 conn(0x7fb8240b67c0 0x7fb8240b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb822a00640 1 -- 172.21.15.144:0/4203607526 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873187703 0 0) 0x7fb824162720 con 0x7fb8240d2e10 2024-09-12T12:17:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb822a00640 1 -- 172.21.15.144:0/4203607526 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb808003530 con 0x7fb8240d2e10 2024-09-12T12:17:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb822a00640 1 -- 172.21.15.144:0/4203607526 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1120665466 0 0) 0x7fb824162a00 con 0x7fb82415e4a0 2024-09-12T12:17:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb822a00640 1 -- 172.21.15.144:0/4203607526 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb824162720 con 0x7fb82415e4a0 2024-09-12T12:17:37.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb828a00640 1 -- 172.21.15.144:0/4203607526 >> v1:172.21.15.165:6789/0 conn(0x7fb82415e4a0 legacy=0x7fb824161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb828a00640 1 -- 172.21.15.144:0/4203607526 >> v1:172.21.15.144:6789/0 conn(0x7fb8240d2e10 legacy=0x7fb8240737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb828a00640 1 -- 172.21.15.144:0/4203607526 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb824162ce0 con 0x7fb8240b67c0 2024-09-12T12:17:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb828a00640 1 --2- 172.21.15.144:0/4203607526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8240b67c0 0x7fb8240b6c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0097c0 tx=0x7fb81c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=518c7c59763f189e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb822a00640 1 -- 172.21.15.144:0/4203607526 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0b0070 con 0x7fb8240b67c0 2024-09-12T12:17:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb822a00640 1 -- 172.21.15.144:0/4203607526 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81c0ab600 con 0x7fb8240b67c0 2024-09-12T12:17:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.474+0000 7fb822a00640 1 -- 172.21.15.144:0/4203607526 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0ab9b0 con 0x7fb8240b67c0 2024-09-12T12:17:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 -- 172.21.15.144:0/4203607526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8240b67c0 msgr2=0x7fb8240b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 --2- 172.21.15.144:0/4203607526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8240b67c0 0x7fb8240b6c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0097c0 tx=0x7fb81c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 -- 172.21.15.144:0/4203607526 shutdown_connections 2024-09-12T12:17:37.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 --2- 172.21.15.144:0/4203607526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8240b67c0 0x7fb8240b6c50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 -- 172.21.15.144:0/4203607526 >> 172.21.15.144:0/4203607526 conn(0x7fb8240d2280 msgr2=0x7fb8240d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:37.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 -- 172.21.15.144:0/4203607526 shutdown_connections 2024-09-12T12:17:37.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 -- 172.21.15.144:0/4203607526 wait complete. 2024-09-12T12:17:37.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 Processor -- start 2024-09-12T12:17:37.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 -- start start 2024-09-12T12:17:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8240b67c0 0x7fb8240d1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8240d2e10 0x7fb8240ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82415e4a0 0x7fb82413e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb82416c010 con 0x7fb8240d2e10 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb82406d7c0 con 0x7fb8240b67c0 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb829400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb82416c190 con 0x7fb82415e4a0 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb823400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8240d2e10 0x7fb8240ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb823400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8240d2e10 0x7fb8240ceaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52428/0 (socket says 172.21.15.144:52428) 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb823400640 1 -- 172.21.15.144:0/90785367 learned_addr learned my addr 172.21.15.144:0/90785367 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb823e00640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8240b67c0 0x7fb8240d1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb828a00640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82415e4a0 0x7fb82413e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb823400640 1 -- 172.21.15.144:0/90785367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82415e4a0 msgr2=0x7fb82413e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb823400640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82415e4a0 0x7fb82413e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb823400640 1 -- 172.21.15.144:0/90785367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8240b67c0 msgr2=0x7fb8240d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb823400640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8240b67c0 0x7fb8240d1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.478+0000 7fb823400640 1 -- 172.21.15.144:0/90785367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8240d1a20 con 0x7fb8240d2e10 2024-09-12T12:17:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb823400640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8240d2e10 0x7fb8240ceaf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00cbc0 tx=0x7fb80c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb81be00640 1 -- 172.21.15.144:0/90785367 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c017070 con 0x7fb8240d2e10 2024-09-12T12:17:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb81be00640 1 -- 172.21.15.144:0/90785367 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c00ad40 con 0x7fb8240d2e10 2024-09-12T12:17:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb81be00640 1 -- 172.21.15.144:0/90785367 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c012600 con 0x7fb8240d2e10 2024-09-12T12:17:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb824159040 con 0x7fb8240d2e10 2024-09-12T12:17:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8241595c0 con 0x7fb8240d2e10 2024-09-12T12:17:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8240b6c50 con 0x7fb8240d2e10 2024-09-12T12:17:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb81be00640 1 -- 172.21.15.144:0/90785367 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb80c01a070 con 0x7fb8240d2e10 2024-09-12T12:17:37.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb81be00640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb8000678c0 0x7fb800069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.482+0000 7fb81be00640 1 -- 172.21.15.144:0/90785367 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fb80c085b90 con 0x7fb8240d2e10 2024-09-12T12:17:37.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.486+0000 7fb823e00640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb8000678c0 0x7fb800069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.486+0000 7fb823e00640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb8000678c0 0x7fb800069d80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb8140011f0 tx=0x7fb814009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.490+0000 7fb81be00640 1 -- 172.21.15.144:0/90785367 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb80c055e90 con 0x7fb8240d2e10 2024-09-12T12:17:37.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.646+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb824069450 con 0x7fb8240d2e10 2024-09-12T12:17:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb81be00640 1 -- 172.21.15.144:0/90785367 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+17160 (secure 0 0 0) 0x7fb80c05a190 con 0x7fb8240d2e10 2024-09-12T12:17:37.652 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:37.652 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":87,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:17:18.711292+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:02.359534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:03.653180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/2111043825":"2024-09-13T12:17:18.704380+0000","172.21.15.144:6835/2111043825":"2024-09-13T12:17:18.704380+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:17:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb8000678c0 msgr2=0x7fb800069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb8000678c0 0x7fb800069d80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb8140011f0 tx=0x7fb814009040 comp rx=0 tx=0).stop 2024-09-12T12:17:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8240d2e10 msgr2=0x7fb8240ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8240d2e10 0x7fb8240ceaf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00cbc0 tx=0x7fb80c00a430 comp rx=0 tx=0).stop 2024-09-12T12:17:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 shutdown_connections 2024-09-12T12:17:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb8000678c0 0x7fb800069d80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82415e4a0 0x7fb82413e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8240d2e10 0x7fb8240ceaf0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 --2- 172.21.15.144:0/90785367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8240b67c0 0x7fb8240d1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 >> 172.21.15.144:0/90785367 conn(0x7fb8240d2280 msgr2=0x7fb824070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:37.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 shutdown_connections 2024-09-12T12:17:37.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.650+0000 7fb829400640 1 -- 172.21.15.144:0/90785367 wait complete. 2024-09-12T12:17:37.673 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:17:37.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:37.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.806+0000 7f2deae00640 1 Processor -- start 2024-09-12T12:17:37.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.806+0000 7f2deae00640 1 -- start start 2024-09-12T12:17:37.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.806+0000 7f2deae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2de415b4e0 0x7f2de40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.806+0000 7f2deae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de40b3ad0 0x7f2de4071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.806+0000 7f2deae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2de40b45a0 con 0x7f2de4071960 2024-09-12T12:17:37.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.806+0000 7f2deae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2de40b3fe0 con 0x7f2de415b4e0 2024-09-12T12:17:37.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.806+0000 7f2deae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2de40b42c0 con 0x7f2de40b3ad0 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de3400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de40b3ad0 0x7f2de4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2de415b4e0 0x7f2de40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de8e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f2de4071960 0x7f2de40ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:41064/0 (socket says 172.21.15.144:41064) 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de8e00640 1 -- 172.21.15.144:0/4199185788 learned_addr learned my addr 172.21.15.144:0/4199185788 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de3e00640 1 -- 172.21.15.144:0/4199185788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de40b3ad0 msgr2=0x7f2de4071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de3e00640 1 --2- 172.21.15.144:0/4199185788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de40b3ad0 0x7f2de4071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de3e00640 1 -- 172.21.15.144:0/4199185788 >> v1:172.21.15.165:6789/0 conn(0x7f2de4071960 legacy=0x7f2de40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de3e00640 1 -- 172.21.15.144:0/4199185788 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de40b1490 con 0x7f2de415b4e0 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de2a00640 1 -- 172.21.15.144:0/4199185788 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1495859051 0 0) 0x7f2de40b45a0 con 0x7f2de4071960 2024-09-12T12:17:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de3400640 1 --2- 172.21.15.144:0/4199185788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de40b3ad0 0x7f2de4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:37.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de3e00640 1 --2- 172.21.15.144:0/4199185788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2de415b4e0 0x7f2de40b3590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009d90 tx=0x7f2dd401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77d93b19ce0b26b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de2a00640 1 -- 172.21.15.144:0/4199185788 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40b2070 con 0x7f2de415b4e0 2024-09-12T12:17:37.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de2a00640 1 -- 172.21.15.144:0/4199185788 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd40a5a20 con 0x7f2de415b4e0 2024-09-12T12:17:37.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.810+0000 7f2de2a00640 1 -- 172.21.15.144:0/4199185788 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40a5df0 con 0x7f2de415b4e0 2024-09-12T12:17:37.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 -- 172.21.15.144:0/4199185788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2de415b4e0 msgr2=0x7f2de40b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 --2- 172.21.15.144:0/4199185788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2de415b4e0 0x7f2de40b3590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009d90 tx=0x7f2dd401c940 comp rx=0 tx=0).stop 2024-09-12T12:17:37.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 -- 172.21.15.144:0/4199185788 shutdown_connections 2024-09-12T12:17:37.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 --2- 172.21.15.144:0/4199185788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de40b3ad0 0x7f2de4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 --2- 172.21.15.144:0/4199185788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2de415b4e0 0x7f2de40b3590 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 -- 172.21.15.144:0/4199185788 >> 172.21.15.144:0/4199185788 conn(0x7f2de406d0d0 msgr2=0x7f2de406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:37.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 -- 172.21.15.144:0/4199185788 shutdown_connections 2024-09-12T12:17:37.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 -- 172.21.15.144:0/4199185788 wait complete. 2024-09-12T12:17:37.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 Processor -- start 2024-09-12T12:17:37.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 -- start start 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de4071960 0x7f2de415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de40b3ad0 0x7f2de415f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2de415b4e0 0x7f2de415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2de40b2620 con 0x7f2de40b3ad0 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2de40b24a0 con 0x7f2de415b4e0 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2deae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2de40cd640 con 0x7f2de4071960 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de40b3ad0 0x7f2de415f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de40b3ad0 0x7f2de415f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52434/0 (socket says 172.21.15.144:52434) 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de3400640 1 -- 172.21.15.144:0/19987140 learned_addr learned my addr 172.21.15.144:0/19987140 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:37.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de3e00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de4071960 0x7f2de415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de8e00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2de415b4e0 0x7f2de415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de3400640 1 -- 172.21.15.144:0/19987140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de4071960 msgr2=0x7f2de415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de3400640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de4071960 0x7f2de415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de3400640 1 -- 172.21.15.144:0/19987140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2de415b4e0 msgr2=0x7f2de415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:37.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de3400640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2de415b4e0 0x7f2de415deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:37.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.814+0000 7f2de3400640 1 -- 172.21.15.144:0/19987140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de415abe0 con 0x7f2de40b3ad0 2024-09-12T12:17:37.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2de3400640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de40b3ad0 0x7f2de415f4e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000ebb0 tx=0x7f2dd000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2ddbe00640 1 -- 172.21.15.144:0/19987140 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0017070 con 0x7f2de40b3ad0 2024-09-12T12:17:37.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2ddbe00640 1 -- 172.21.15.144:0/19987140 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd000cc30 con 0x7f2de40b3ad0 2024-09-12T12:17:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2ddbe00640 1 -- 172.21.15.144:0/19987140 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd0013470 con 0x7f2de40b3ad0 2024-09-12T12:17:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de41f7ef0 con 0x7f2de40b3ad0 2024-09-12T12:17:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de41f7410 con 0x7f2de40b3ad0 2024-09-12T12:17:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de4071420 con 0x7f2de40b3ad0 2024-09-12T12:17:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2ddbe00640 1 -- 172.21.15.144:0/19987140 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2dd001a070 con 0x7f2de40b3ad0 2024-09-12T12:17:37.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2ddbe00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2dc40678c0 0x7f2dc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:37.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2ddbe00640 1 -- 172.21.15.144:0/19987140 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f2dd0085df0 con 0x7f2de40b3ad0 2024-09-12T12:17:37.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.818+0000 7f2de3e00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2dc40678c0 0x7f2dc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:37.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.822+0000 7f2de3e00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2dc40678c0 0x7f2dc4069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af000 tx=0x7f2dd40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:37.822+0000 7f2ddbe00640 1 -- 172.21.15.144:0/19987140 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2dd0056060 con 0x7f2de40b3ad0 2024-09-12T12:17:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.014+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2de40d0060 con 0x7f2de40b3ad0 2024-09-12T12:17:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.014+0000 7f2ddbe00640 1 -- 172.21.15.144:0/19987140 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5235 (secure 0 0 0) 0x7f2dd005a360 con 0x7f2de40b3ad0 2024-09-12T12:17:38.017 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":61,"btime":"2024-09-12T12:17:22:733420+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1090713174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1090713174},{"type":"v1","addr":"172.21.15.165:6835","nonce":1090713174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6915,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3715410946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3715410946},{"type":"v1","addr":"172.21.15.165:6833","nonce":3715410946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/974267816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":974267816},{"type":"v1","addr":"172.21.15.144:6836","nonce":974267816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:22.733410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6933},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6933":{"gid":6933,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/1622416961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1622416961},{"type":"v1","addr":"172.21.15.144:6837","nonce":1622416961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6933,"qdb_cluster":[6933]},"id":5}]} 2024-09-12T12:17:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 61 2024-09-12T12:17:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.014+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2dc40678c0 msgr2=0x7f2dc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.014+0000 7f2deae00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2dc40678c0 0x7f2dc4069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af000 tx=0x7f2dd40a7070 comp rx=0 tx=0).stop 2024-09-12T12:17:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.014+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de40b3ad0 msgr2=0x7f2de415f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.014+0000 7f2deae00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de40b3ad0 0x7f2de415f4e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2dd000ebb0 tx=0x7f2dd000c520 comp rx=0 tx=0).stop 2024-09-12T12:17:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.018+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 shutdown_connections 2024-09-12T12:17:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.018+0000 7f2deae00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2dc40678c0 0x7f2dc4069d80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.018+0000 7f2deae00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2de415b4e0 0x7f2de415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.018+0000 7f2deae00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2de40b3ad0 0x7f2de415f4e0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.018+0000 7f2deae00640 1 --2- 172.21.15.144:0/19987140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2de4071960 0x7f2de415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.018+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 >> 172.21.15.144:0/19987140 conn(0x7f2de406d0d0 msgr2=0x7f2de4071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.018+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 shutdown_connections 2024-09-12T12:17:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.018+0000 7f2deae00640 1 -- 172.21.15.144:0/19987140 wait complete. 2024-09-12T12:17:38.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:38.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.170+0000 7fbdf4800640 1 Processor -- start 2024-09-12T12:17:38.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.170+0000 7fbdf4800640 1 -- start start 2024-09-12T12:17:38.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf4800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbdec15b4e0 0x7fbdec0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf4800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdec0b45a0 con 0x7fbdec0ccf30 2024-09-12T12:17:38.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf4800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdec0b3fe0 con 0x7fbdec0b3ad0 2024-09-12T12:17:38.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf4800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbdec0b42c0 con 0x7fbdec15b4e0 2024-09-12T12:17:38.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbdec0ccf30 0x7fbdec0b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47186/0 (socket says 172.21.15.144:47186) 2024-09-12T12:17:38.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf2800640 1 -- 172.21.15.144:0/3142403109 learned_addr learned my addr 172.21.15.144:0/3142403109 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:38.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1e00640 1 --2- 172.21.15.144:0/3142403109 >> v2:172.21.15.165:3300/0 conn(0x7fbdec15b4e0 0x7fbdec0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777208391 0 0) 0x7fbdec0b45a0 con 0x7fbdec0ccf30 2024-09-12T12:17:38.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdd4003530 con 0x7fbdec0ccf30 2024-09-12T12:17:38.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1364062086 0 0) 0x7fbdd4003530 con 0x7fbdec0ccf30 2024-09-12T12:17:38.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 >> v2:172.21.15.165:3300/0 conn(0x7fbdec15b4e0 msgr2=0x7fbdec0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:38.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 --2- 172.21.15.144:0/3142403109 >> v2:172.21.15.165:3300/0 conn(0x7fbdec15b4e0 0x7fbdec0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 >> v1:172.21.15.165:6789/0 conn(0x7fbdec0b3ad0 legacy=0x7fbdec071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec0b1490 con 0x7fbdec0ccf30 2024-09-12T12:17:38.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fbde8001a00 con 0x7fbdec0ccf30 2024-09-12T12:17:38.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 >> v1:172.21.15.144:6789/0 conn(0x7fbdec0ccf30 legacy=0x7fbdec0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd40039c0 0x7fbdd4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdd4004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdd4005090 0x7fbdd400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec0b42c0 con 0x7fbdd40043c0 2024-09-12T12:17:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd400bff0 con 0x7fbdd40039c0 2024-09-12T12:17:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd400c1f0 con 0x7fbdd4005090 2024-09-12T12:17:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1e00640 1 --2- 172.21.15.144:0/3142403109 >> v2:172.21.15.165:3300/0 conn(0x7fbdec15b4e0 0x7fbdec0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1400640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdd4004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1e00640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd40039c0 0x7fbdd4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf2800640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdd4005090 0x7fbdd400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1400640 1 -- 172.21.15.144:0/3142403109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdd4005090 msgr2=0x7fbdd400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:38.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1400640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdd4005090 0x7fbdd400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1400640 1 -- 172.21.15.144:0/3142403109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd40039c0 msgr2=0x7fbdd4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:38.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1400640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd40039c0 0x7fbdd4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1400640 1 -- 172.21.15.144:0/3142403109 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd4003530 con 0x7fbdd40043c0 2024-09-12T12:17:38.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf1e00640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd40039c0 0x7fbdd4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:38.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.174+0000 7fbdf2800640 1 -- 172.21.15.144:0/3142403109 reap_dead start 2024-09-12T12:17:38.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf1400640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdd4004890 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fbddc001860 tx=0x7fbddc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82292e74b2d656d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:38.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc001460 con 0x7fbdd40043c0 2024-09-12T12:17:38.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbddc0b0070 con 0x7fbdd40043c0 2024-09-12T12:17:38.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf0a00640 1 -- 172.21.15.144:0/3142403109 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc0ab900 con 0x7fbdd40043c0 2024-09-12T12:17:38.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf4800640 1 -- 172.21.15.144:0/3142403109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 msgr2=0x7fbdd4004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf4800640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdd4004890 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fbddc001860 tx=0x7fbddc01c4b0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf4800640 1 -- 172.21.15.144:0/3142403109 shutdown_connections 2024-09-12T12:17:38.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf4800640 1 --2- 172.21.15.144:0/3142403109 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdd4004890 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf4800640 1 -- 172.21.15.144:0/3142403109 >> 172.21.15.144:0/3142403109 conn(0x7fbdec06d0d0 msgr2=0x7fbdec06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:38.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf4800640 1 -- 172.21.15.144:0/3142403109 shutdown_connections 2024-09-12T12:17:38.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.178+0000 7fbdf4800640 1 -- 172.21.15.144:0/3142403109 wait complete. 2024-09-12T12:17:38.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 Processor -- start 2024-09-12T12:17:38.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 -- start start 2024-09-12T12:17:38.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdec15e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdec15bbd0 0x7fbdec1fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdec1fb590 0x7fbdec1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec15b8c0 con 0x7fbdd40043c0 2024-09-12T12:17:38.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec0cd310 con 0x7fbdec1fb590 2024-09-12T12:17:38.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbdec15c090 con 0x7fbdec15bbd0 2024-09-12T12:17:38.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdec15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdec15e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52452/0 (socket says 172.21.15.144:52452) 2024-09-12T12:17:38.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf1e00640 1 -- 172.21.15.144:0/1187416649 learned_addr learned my addr 172.21.15.144:0/1187416649 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:38.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf1e00640 1 -- 172.21.15.144:0/1187416649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdec15bbd0 msgr2=0x7fbdec1fb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf1e00640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdec15bbd0 0x7fbdec1fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf1e00640 1 -- 172.21.15.144:0/1187416649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdec1fb590 msgr2=0x7fbdec1508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf2800640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdec1fb590 0x7fbdec1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf1e00640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdec1fb590 0x7fbdec1508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf1e00640 1 -- 172.21.15.144:0/1187416649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec15c370 con 0x7fbdd40043c0 2024-09-12T12:17:38.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf2800640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdec1fb590 0x7fbdec1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:38.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf1e00640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdec15e600 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fbde0011830 tx=0x7fbde0011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:38.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbde6000640 1 -- 172.21.15.144:0/1187416649 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde000f9c0 con 0x7fbdd40043c0 2024-09-12T12:17:38.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbde6000640 1 -- 172.21.15.144:0/1187416649 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde000fb60 con 0x7fbdd40043c0 2024-09-12T12:17:38.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbde6000640 1 -- 172.21.15.144:0/1187416649 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0015460 con 0x7fbdd40043c0 2024-09-12T12:17:38.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdec15c650 con 0x7fbdd40043c0 2024-09-12T12:17:38.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdec15cc10 con 0x7fbdd40043c0 2024-09-12T12:17:38.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.182+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdec0d15d0 con 0x7fbdd40043c0 2024-09-12T12:17:38.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.186+0000 7fbde6000640 1 -- 172.21.15.144:0/1187416649 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbde0015810 con 0x7fbdd40043c0 2024-09-12T12:17:38.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.186+0000 7fbde6000640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdd00678c0 0x7fbdd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.186+0000 7fbde6000640 1 -- 172.21.15.144:0/1187416649 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fbde0086bb0 con 0x7fbdd40043c0 2024-09-12T12:17:38.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.186+0000 7fbdf1400640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdd00678c0 0x7fbdd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.186+0000 7fbdf1400640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdd00678c0 0x7fbdd0069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0af000 tx=0x7fbddc001240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:38.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.190+0000 7fbde6000640 1 -- 172.21.15.144:0/1187416649 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbde0019030 con 0x7fbdd40043c0 2024-09-12T12:17:38.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.378+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdec1fb970 con 0x7fbdd40043c0 2024-09-12T12:17:38.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.378+0000 7fbde6000640 1 -- 172.21.15.144:0/1187416649 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5235 (secure 0 0 0) 0x7fbde0057500 con 0x7fbdd40043c0 2024-09-12T12:17:38.382 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:38.382 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":61,"btime":"2024-09-12T12:17:22:733420+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1090713174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1090713174},{"type":"v1","addr":"172.21.15.165:6835","nonce":1090713174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6915,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3715410946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3715410946},{"type":"v1","addr":"172.21.15.165:6833","nonce":3715410946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/974267816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":974267816},{"type":"v1","addr":"172.21.15.144:6836","nonce":974267816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:04.644714+0000","modified":"2024-09-12T12:17:22.733410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6933},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6933":{"gid":6933,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/1622416961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1622416961},{"type":"v1","addr":"172.21.15.144:6837","nonce":1622416961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6933,"qdb_cluster":[6933]},"id":5}]} 2024-09-12T12:17:38.383 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 61 2024-09-12T12:17:38.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdd00678c0 msgr2=0x7fbdd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdd00678c0 0x7fbdd0069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0af000 tx=0x7fbddc001240 comp rx=0 tx=0).stop 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 msgr2=0x7fbdec15e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdec15e600 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fbde0011830 tx=0x7fbde0011cf0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 shutdown_connections 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbdd00678c0 0x7fbdd0069d80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdec1fb590 0x7fbdec1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbdec15bbd0 0x7fbdec1fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 --2- 172.21.15.144:0/1187416649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbdd40043c0 0x7fbdec15e600 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 >> 172.21.15.144:0/1187416649 conn(0x7fbdec06d0d0 msgr2=0x7fbdec0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 shutdown_connections 2024-09-12T12:17:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.382+0000 7fbdf4800640 1 -- 172.21.15.144:0/1187416649 wait complete. 2024-09-12T12:17:38.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:17:38.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf3800640 1 Processor -- start 2024-09-12T12:17:38.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf3800640 1 -- start start 2024-09-12T12:17:38.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 0x7f6cec0b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf3800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6cec0b72e0 0x7f6cec06d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf3800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cec06e4d0 con 0x7f6cec06dce0 2024-09-12T12:17:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf3800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6cec0cba40 con 0x7f6cec0b72e0 2024-09-12T12:17:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6cec06e7b0 con 0x7f6cec15e540 2024-09-12T12:17:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf1800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6cec06dce0 0x7f6cec06f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47198/0 (socket says 172.21.15.144:47198) 2024-09-12T12:17:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cebe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6cec0b72e0 0x7f6cec06d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf1800640 1 -- 172.21.15.144:0/3234647531 learned_addr learned my addr 172.21.15.144:0/3234647531 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf0e00640 1 --2- 172.21.15.144:0/3234647531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 0x7f6cec0b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cebe00640 1 -- 172.21.15.144:0/3234647531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 msgr2=0x7f6cec0b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cebe00640 1 --2- 172.21.15.144:0/3234647531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 0x7f6cec0b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cebe00640 1 -- 172.21.15.144:0/3234647531 >> v1:172.21.15.144:6789/0 conn(0x7f6cec06dce0 legacy=0x7f6cec06f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cebe00640 1 -- 172.21.15.144:0/3234647531 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec06ea90 con 0x7f6cec0b72e0 2024-09-12T12:17:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6ceb400640 1 -- 172.21.15.144:0/3234647531 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756428479 0 0) 0x7f6cec06e4d0 con 0x7f6cec06dce0 2024-09-12T12:17:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.538+0000 7f6cf0e00640 1 --2- 172.21.15.144:0/3234647531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 0x7f6cec0b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:38.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6cebe00640 1 --2- 172.21.15.144:0/3234647531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 0x7f6cec06d7a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80097a0 tx=0x7f6cd801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa72c3ca7f5ff410 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:38.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6ceb400640 1 -- 172.21.15.144:0/3234647531 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80b0070 con 0x7f6cec0b72e0 2024-09-12T12:17:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6ceb400640 1 -- 172.21.15.144:0/3234647531 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd80ab600 con 0x7f6cec0b72e0 2024-09-12T12:17:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6ceb400640 1 -- 172.21.15.144:0/3234647531 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80ab9d0 con 0x7f6cec0b72e0 2024-09-12T12:17:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6cf3800640 1 -- 172.21.15.144:0/3234647531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 msgr2=0x7f6cec06d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6cf3800640 1 --2- 172.21.15.144:0/3234647531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 0x7f6cec06d7a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80097a0 tx=0x7f6cd801c3f0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6cf3800640 1 -- 172.21.15.144:0/3234647531 shutdown_connections 2024-09-12T12:17:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6cf3800640 1 --2- 172.21.15.144:0/3234647531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 0x7f6cec06d7a0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6cf3800640 1 --2- 172.21.15.144:0/3234647531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 0x7f6cec0b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6cf3800640 1 -- 172.21.15.144:0/3234647531 >> 172.21.15.144:0/3234647531 conn(0x7f6cec067a00 msgr2=0x7f6cec067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6cf3800640 1 -- 172.21.15.144:0/3234647531 shutdown_connections 2024-09-12T12:17:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.542+0000 7f6cf3800640 1 -- 172.21.15.144:0/3234647531 wait complete. 2024-09-12T12:17:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 Processor -- start 2024-09-12T12:17:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 -- start start 2024-09-12T12:17:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cec06dce0 0x7f6cec159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 0x7f6cec0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 0x7f6cec150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec16b320 con 0x7f6cec0b72e0 2024-09-12T12:17:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec16b1a0 con 0x7f6cec06dce0 2024-09-12T12:17:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6cec16b4a0 con 0x7f6cec15e540 2024-09-12T12:17:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 0x7f6cec0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 0x7f6cec0cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52470/0 (socket says 172.21.15.144:52470) 2024-09-12T12:17:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cebe00640 1 -- 172.21.15.144:0/1153123968 learned_addr learned my addr 172.21.15.144:0/1153123968 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf0e00640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cec06dce0 0x7f6cec159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf1800640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 0x7f6cec150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cebe00640 1 -- 172.21.15.144:0/1153123968 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 msgr2=0x7f6cec150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cebe00640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 0x7f6cec150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cebe00640 1 -- 172.21.15.144:0/1153123968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cec06dce0 msgr2=0x7f6cec159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cebe00640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cec06dce0 0x7f6cec159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cebe00640 1 -- 172.21.15.144:0/1153123968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec151c20 con 0x7f6cec0b72e0 2024-09-12T12:17:38.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cebe00640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 0x7f6cec0cd5e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6cd801aaa0 tx=0x7f6cd801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:38.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6ce8c00640 1 -- 172.21.15.144:0/1153123968 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80bb020 con 0x7f6cec0b72e0 2024-09-12T12:17:38.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6ce8c00640 1 -- 172.21.15.144:0/1153123968 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd80059a0 con 0x7f6cec0b72e0 2024-09-12T12:17:38.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6ce8c00640 1 -- 172.21.15.144:0/1153123968 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd80b0040 con 0x7f6cec0b72e0 2024-09-12T12:17:38.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cec151f00 con 0x7f6cec0b72e0 2024-09-12T12:17:38.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cec15bc20 con 0x7f6cec0b72e0 2024-09-12T12:17:38.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.546+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cec06d7a0 con 0x7f6cec0b72e0 2024-09-12T12:17:38.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.550+0000 7f6ce8c00640 1 -- 172.21.15.144:0/1153123968 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6cd8004030 con 0x7f6cec0b72e0 2024-09-12T12:17:38.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.550+0000 7f6ce8c00640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ccc0678c0 0x7f6ccc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.550+0000 7f6ce8c00640 1 -- 172.21.15.144:0/1153123968 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f6cd811ff20 con 0x7f6cec0b72e0 2024-09-12T12:17:38.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.550+0000 7f6cf0e00640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ccc0678c0 0x7f6ccc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.550+0000 7f6cf0e00640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ccc0678c0 0x7f6ccc069d80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009fd0 tx=0x7f6cdc009870 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:38.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.554+0000 7f6ce8c00640 1 -- 172.21.15.144:0/1153123968 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6cd80c5020 con 0x7f6cec0b72e0 2024-09-12T12:17:38.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.710+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cec1520d0 con 0x7f6cec0b72e0 2024-09-12T12:17:38.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6ce8c00640 1 -- 172.21.15.144:0/1153123968 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+17160 (secure 0 0 0) 0x7f6cd8016070 con 0x7f6cec0b72e0 2024-09-12T12:17:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:38.717 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":87,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:17:18.711292+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:02.359534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:03.653180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/2111043825":"2024-09-13T12:17:18.704380+0000","172.21.15.144:6835/2111043825":"2024-09-13T12:17:18.704380+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:17:38.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ccc0678c0 msgr2=0x7f6ccc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ccc0678c0 0x7f6ccc069d80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009fd0 tx=0x7f6cdc009870 comp rx=0 tx=0).stop 2024-09-12T12:17:38.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 msgr2=0x7f6cec0cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 0x7f6cec0cd5e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6cd801aaa0 tx=0x7f6cd801ac30 comp rx=0 tx=0).stop 2024-09-12T12:17:38.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 shutdown_connections 2024-09-12T12:17:38.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ccc0678c0 0x7f6ccc069d80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cec15e540 0x7f6cec150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cec0b72e0 0x7f6cec0cd5e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 --2- 172.21.15.144:0/1153123968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cec06dce0 0x7f6cec159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 >> 172.21.15.144:0/1153123968 conn(0x7f6cec067a00 msgr2=0x7f6cec0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:38.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 shutdown_connections 2024-09-12T12:17:38.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.714+0000 7f6cf3800640 1 -- 172.21.15.144:0/1153123968 wait complete. 2024-09-12T12:17:38.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:17:38.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.870+0000 7f8db8c00640 1 Processor -- start 2024-09-12T12:17:38.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.870+0000 7f8db8c00640 1 -- start start 2024-09-12T12:17:38.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 0x7f8db40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db8c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8db415cd30 0x7f8db40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db8c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db40cd870 con 0x7f8db40b5de0 2024-09-12T12:17:38.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db8c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8db4072a50 con 0x7f8db415cd30 2024-09-12T12:17:38.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8db40cde30 con 0x7f8db415c7b0 2024-09-12T12:17:38.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8db40b5de0 0x7f8db41601d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47208/0 (socket says 172.21.15.144:47208) 2024-09-12T12:17:38.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db2800640 1 -- 172.21.15.144:0/3006178298 learned_addr learned my addr 172.21.15.144:0/3006178298 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:38.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db1400640 1 --2- 172.21.15.144:0/3006178298 >> v2:172.21.15.165:3300/0 conn(0x7f8db415cd30 0x7f8db40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db1e00640 1 --2- 172.21.15.144:0/3006178298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 0x7f8db40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db0a00640 1 -- 172.21.15.144:0/3006178298 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886074878 0 0) 0x7f8db40cd870 con 0x7f8db40b5de0 2024-09-12T12:17:38.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db0a00640 1 -- 172.21.15.144:0/3006178298 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d98003530 con 0x7f8db40b5de0 2024-09-12T12:17:38.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db1400640 1 -- 172.21.15.144:0/3006178298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 msgr2=0x7f8db40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:38.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db1400640 1 --2- 172.21.15.144:0/3006178298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 0x7f8db40ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db1400640 1 -- 172.21.15.144:0/3006178298 >> v1:172.21.15.144:6789/0 conn(0x7f8db40b5de0 legacy=0x7f8db41601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.874+0000 7f8db1400640 1 -- 172.21.15.144:0/3006178298 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db40cdb50 con 0x7f8db415cd30 2024-09-12T12:17:38.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db1400640 1 --2- 172.21.15.144:0/3006178298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db415cd30 0x7f8db40b58a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8da00097c0 tx=0x7f8da001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b587f55d0bf4591 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:38.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db0a00640 1 -- 172.21.15.144:0/3006178298 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00b0070 con 0x7f8db415cd30 2024-09-12T12:17:38.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db0a00640 1 -- 172.21.15.144:0/3006178298 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da00ab600 con 0x7f8db415cd30 2024-09-12T12:17:38.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db0a00640 1 -- 172.21.15.144:0/3006178298 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00ab9d0 con 0x7f8db415cd30 2024-09-12T12:17:38.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 -- 172.21.15.144:0/3006178298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db415cd30 msgr2=0x7f8db40b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 --2- 172.21.15.144:0/3006178298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db415cd30 0x7f8db40b58a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8da00097c0 tx=0x7f8da001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 -- 172.21.15.144:0/3006178298 shutdown_connections 2024-09-12T12:17:38.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 --2- 172.21.15.144:0/3006178298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db415cd30 0x7f8db40b58a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 --2- 172.21.15.144:0/3006178298 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 0x7f8db40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 -- 172.21.15.144:0/3006178298 >> 172.21.15.144:0/3006178298 conn(0x7f8db406d0d0 msgr2=0x7f8db406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:38.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 -- 172.21.15.144:0/3006178298 shutdown_connections 2024-09-12T12:17:38.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 -- 172.21.15.144:0/3006178298 wait complete. 2024-09-12T12:17:38.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 Processor -- start 2024-09-12T12:17:38.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.878+0000 7f8db8c00640 1 -- start start 2024-09-12T12:17:38.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db40b5de0 0x7f8db41533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 0x7f8db4165910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8db415cd30 0x7f8db40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db8c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8db4169530 con 0x7f8db415cd30 2024-09-12T12:17:38.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db8c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8db40cd650 con 0x7f8db40b5de0 2024-09-12T12:17:38.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8db41696b0 con 0x7f8db415c7b0 2024-09-12T12:17:38.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8db415cd30 0x7f8db40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db1e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db40b5de0 0x7f8db41533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8db415cd30 0x7f8db40ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52484/0 (socket says 172.21.15.144:52484) 2024-09-12T12:17:38.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db2800640 1 -- 172.21.15.144:0/4133467874 learned_addr learned my addr 172.21.15.144:0/4133467874 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:38.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db1400640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 0x7f8db4165910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db2800640 1 -- 172.21.15.144:0/4133467874 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 msgr2=0x7f8db4165910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db2800640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 0x7f8db4165910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db2800640 1 -- 172.21.15.144:0/4133467874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db40b5de0 msgr2=0x7f8db41533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:38.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db2800640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db40b5de0 0x7f8db41533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:38.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db2800640 1 -- 172.21.15.144:0/4133467874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db4162070 con 0x7f8db415cd30 2024-09-12T12:17:38.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db1e00640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db40b5de0 0x7f8db41533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:38.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db2800640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8db415cd30 0x7f8db40ae890 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00c450 tx=0x7f8dac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:38.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8daa000640 1 -- 172.21.15.144:0/4133467874 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac017070 con 0x7f8db415cd30 2024-09-12T12:17:38.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8daa000640 1 -- 172.21.15.144:0/4133467874 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac005cf0 con 0x7f8db415cd30 2024-09-12T12:17:38.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8daa000640 1 -- 172.21.15.144:0/4133467874 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac007310 con 0x7f8db415cd30 2024-09-12T12:17:38.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db4162350 con 0x7f8db415cd30 2024-09-12T12:17:38.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db4162910 con 0x7f8db415cd30 2024-09-12T12:17:38.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.882+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db40ccf00 con 0x7f8db415cd30 2024-09-12T12:17:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.886+0000 7f8daa000640 1 -- 172.21.15.144:0/4133467874 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8dac0074b0 con 0x7f8db415cd30 2024-09-12T12:17:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.886+0000 7f8daa000640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d940678c0 0x7f8d94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.886+0000 7f8daa000640 1 -- 172.21.15.144:0/4133467874 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f8dac0851b0 con 0x7f8db415cd30 2024-09-12T12:17:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.886+0000 7f8db1e00640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d940678c0 0x7f8d94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.886+0000 7f8db1e00640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d940678c0 0x7f8d94069d80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8db415dd80 tx=0x7f8da400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:38.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:38.890+0000 7f8daa000640 1 -- 172.21.15.144:0/4133467874 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8dac0554b0 con 0x7f8db415cd30 2024-09-12T12:17:39.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.082+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8db40cccb0 con 0x7f8db415cd30 2024-09-12T12:17:39.084 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:17:39.082+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:17:39.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.082+0000 7f8daa000640 1 -- 172.21.15.144:0/4133467874 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) ==== 161+0+0 (secure 0 0 0) 0x7f8dac0597b0 con 0x7f8db415cd30 2024-09-12T12:17:39.086 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:17:39.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d940678c0 msgr2=0x7f8d94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d940678c0 0x7f8d94069d80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8db415dd80 tx=0x7f8da400b040 comp rx=0 tx=0).stop 2024-09-12T12:17:39.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8db415cd30 msgr2=0x7f8db40ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8db415cd30 0x7f8db40ae890 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00c450 tx=0x7f8dac00c910 comp rx=0 tx=0).stop 2024-09-12T12:17:39.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 shutdown_connections 2024-09-12T12:17:39.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8d940678c0 0x7f8d94069d80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8db415cd30 0x7f8db40ae890 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8db415c7b0 0x7f8db4165910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 --2- 172.21.15.144:0/4133467874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db40b5de0 0x7f8db41533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 >> 172.21.15.144:0/4133467874 conn(0x7f8db406d0d0 msgr2=0x7f8db40b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:39.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 shutdown_connections 2024-09-12T12:17:39.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.086+0000 7f8db8c00640 1 -- 172.21.15.144:0/4133467874 wait complete. 2024-09-12T12:17:39.098 INFO:tasks.ceph.mds.c.smithi144.stderr: -1647> 2024-09-12T12:17:25.714+0000 7f002cc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:17:39.110 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:17:39.143 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:17:39.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9cec000640 1 Processor -- start 2024-09-12T12:17:39.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9cec000640 1 -- start start 2024-09-12T12:17:39.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9cec000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ce40af5f0 0x7f9ce406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:39.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9cec000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce40733e0 con 0x7f9ce415c2e0 2024-09-12T12:17:39.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9cec000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce40cd290 con 0x7f9ce406c150 2024-09-12T12:17:39.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9cec000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce406c5c0 con 0x7f9ce40af5f0 2024-09-12T12:17:39.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9ce9600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9ce415c2e0 0x7f9ce4072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47222/0 (socket says 172.21.15.144:47222) 2024-09-12T12:17:39.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9ce9600640 1 -- 172.21.15.144:0/1915008392 learned_addr learned my addr 172.21.15.144:0/1915008392 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:39.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9ce8c00640 1 --2- 172.21.15.144:0/1915008392 >> v2:172.21.15.144:3300/0 conn(0x7f9ce40af5f0 0x7f9ce406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:39.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9ce8c00640 1 -- 172.21.15.144:0/1915008392 >> v1:172.21.15.165:6789/0 conn(0x7f9ce406c150 legacy=0x7f9ce40cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9ce8c00640 1 -- 172.21.15.144:0/1915008392 >> v1:172.21.15.144:6789/0 conn(0x7f9ce415c2e0 legacy=0x7f9ce4072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.250+0000 7f9ce8c00640 1 -- 172.21.15.144:0/1915008392 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce40cd570 con 0x7f9ce40af5f0 2024-09-12T12:17:39.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9ce8c00640 1 --2- 172.21.15.144:0/1915008392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce40af5f0 0x7f9ce406bc10 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00097c0 tx=0x7f9cd001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3010f510924efcdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:39.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9ce3e00640 1 -- 172.21.15.144:0/1915008392 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00b0070 con 0x7f9ce40af5f0 2024-09-12T12:17:39.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9ce3e00640 1 -- 172.21.15.144:0/1915008392 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd00ab600 con 0x7f9ce40af5f0 2024-09-12T12:17:39.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9ce3e00640 1 -- 172.21.15.144:0/1915008392 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00ab9d0 con 0x7f9ce40af5f0 2024-09-12T12:17:39.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9cec000640 1 -- 172.21.15.144:0/1915008392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce40af5f0 msgr2=0x7f9ce406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9cec000640 1 --2- 172.21.15.144:0/1915008392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce40af5f0 0x7f9ce406bc10 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00097c0 tx=0x7f9cd001c380 comp rx=0 tx=0).stop 2024-09-12T12:17:39.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9cec000640 1 -- 172.21.15.144:0/1915008392 shutdown_connections 2024-09-12T12:17:39.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9cec000640 1 --2- 172.21.15.144:0/1915008392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce40af5f0 0x7f9ce406bc10 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9cec000640 1 -- 172.21.15.144:0/1915008392 >> 172.21.15.144:0/1915008392 conn(0x7f9ce4068030 msgr2=0x7f9ce40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:39.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9cec000640 1 -- 172.21.15.144:0/1915008392 shutdown_connections 2024-09-12T12:17:39.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9cec000640 1 -- 172.21.15.144:0/1915008392 wait complete. 2024-09-12T12:17:39.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9cec000640 1 Processor -- start 2024-09-12T12:17:39.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.254+0000 7f9cec000640 1 -- start start 2024-09-12T12:17:39.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cec000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ce406c150 0x7f9ce4149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:39.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cec000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ce40af5f0 0x7f9ce40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cec000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce415c2e0 0x7f9ce40aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cec000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce40cf060 con 0x7f9ce415c2e0 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cec000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce40ceee0 con 0x7f9ce406c150 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cec000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce4169f30 con 0x7f9ce40af5f0 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cea000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce415c2e0 0x7f9ce40aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cea000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce415c2e0 0x7f9ce40aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52514/0 (socket says 172.21.15.144:52514) 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cea000640 1 -- 172.21.15.144:0/2209027756 learned_addr learned my addr 172.21.15.144:0/2209027756 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9ce9600640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ce406c150 0x7f9ce4149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cea000640 1 -- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ce40af5f0 msgr2=0x7f9ce40ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9ce8c00640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ce40af5f0 0x7f9ce40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cea000640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ce40af5f0 0x7f9ce40ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cea000640 1 -- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ce406c150 msgr2=0x7f9ce4149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:39.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cea000640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ce406c150 0x7f9ce4149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:39.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cea000640 1 -- 172.21.15.144:0/2209027756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce40b3640 con 0x7f9ce415c2e0 2024-09-12T12:17:39.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9ce9600640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ce406c150 0x7f9ce4149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:39.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9ce8c00640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ce40af5f0 0x7f9ce40ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:39.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cea000640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce415c2e0 0x7f9ce40aedd0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c370 tx=0x7f9cdc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:39.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9ce1600640 1 -- 172.21.15.144:0/2209027756 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc005220 con 0x7f9ce415c2e0 2024-09-12T12:17:39.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9ce1600640 1 -- 172.21.15.144:0/2209027756 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cdc0053c0 con 0x7f9ce415c2e0 2024-09-12T12:17:39.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce40b3920 con 0x7f9ce415c2e0 2024-09-12T12:17:39.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9ce1600640 1 -- 172.21.15.144:0/2209027756 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc007270 con 0x7f9ce415c2e0 2024-09-12T12:17:39.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce40b3ee0 con 0x7f9ce415c2e0 2024-09-12T12:17:39.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.258+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce406bc10 con 0x7f9ce415c2e0 2024-09-12T12:17:39.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.262+0000 7f9ce1600640 1 -- 172.21.15.144:0/2209027756 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9cdc019020 con 0x7f9ce415c2e0 2024-09-12T12:17:39.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.262+0000 7f9ce1600640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9cc40678c0 0x7f9cc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:39.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.262+0000 7f9ce1600640 1 -- 172.21.15.144:0/2209027756 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6273+0+0 (secure 0 0 0) 0x7f9cdc085110 con 0x7f9ce415c2e0 2024-09-12T12:17:39.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.262+0000 7f9ce9600640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9cc40678c0 0x7f9cc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:39.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.262+0000 7f9ce9600640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9cc40678c0 0x7f9cc4069d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8005c10 tx=0x7f9cd8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:39.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.266+0000 7f9ce1600640 1 -- 172.21.15.144:0/2209027756 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9cdc055aa0 con 0x7f9ce415c2e0 2024-09-12T12:17:39.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:39.458+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9ce40b0100 con 0x7f9ce415c2e0 2024-09-12T12:17:40.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.090+0000 7f9ce1600640 1 -- 172.21.15.144:0/2209027756 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) ==== 104+0+0 (secure 0 0 0) 0x7f9cdc0553a0 con 0x7f9ce415c2e0 2024-09-12T12:17:40.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9cc40678c0 msgr2=0x7f9cc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9cc40678c0 0x7f9cc4069d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8005c10 tx=0x7f9cd8009040 comp rx=0 tx=0).stop 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce415c2e0 msgr2=0x7f9ce40aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce415c2e0 0x7f9ce40aedd0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00c370 tx=0x7f9cdc00c830 comp rx=0 tx=0).stop 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 shutdown_connections 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9cc40678c0 0x7f9cc4069d80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ce415c2e0 0x7f9ce40aedd0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ce40af5f0 0x7f9ce40ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 --2- 172.21.15.144:0/2209027756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ce406c150 0x7f9ce4149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 >> 172.21.15.144:0/2209027756 conn(0x7f9ce4068030 msgr2=0x7f9ce40b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 shutdown_connections 2024-09-12T12:17:40.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.094+0000 7f9cec000640 1 -- 172.21.15.144:0/2209027756 wait complete. 2024-09-12T12:17:40.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:17:40.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f7600640 1 Processor -- start 2024-09-12T12:17:40.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f7600640 1 -- start start 2024-09-12T12:17:40.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f7600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f60f006d250 0x7f60f015c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:40.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f7600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f006cd20 con 0x7f60f006d630 2024-09-12T12:17:40.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f7600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f015cc80 con 0x7f60f00b3490 2024-09-12T12:17:40.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f7600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f60f0072620 con 0x7f60f006d250 2024-09-12T12:17:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f4c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f60f006d250 0x7f60f015c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f5600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f60f006d630 0x7f60f0155820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47238/0 (socket says 172.21.15.144:47238) 2024-09-12T12:17:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f5600640 1 -- 172.21.15.144:0/3698721237 learned_addr learned my addr 172.21.15.144:0/3698721237 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f4c00640 1 -- 172.21.15.144:0/3698721237 >> v1:172.21.15.165:6789/0 conn(0x7f60f00b3490 legacy=0x7f60f00b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f4c00640 1 -- 172.21.15.144:0/3698721237 >> v1:172.21.15.144:6789/0 conn(0x7f60f006d630 legacy=0x7f60f0155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60f4c00640 1 -- 172.21.15.144:0/3698721237 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f00b3950 con 0x7f60f006d250 2024-09-12T12:17:40.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.302+0000 7f60ef400640 1 -- 172.21.15.144:0/3698721237 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048792518 0 0) 0x7f60f006cd20 con 0x7f60f006d630 2024-09-12T12:17:40.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60f4c00640 1 --2- 172.21.15.144:0/3698721237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d250 0x7f60f015c740 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f60e40097f0 tx=0x7f60e401c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9226494ad694f223 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:40.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60ef400640 1 -- 172.21.15.144:0/3698721237 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40b0070 con 0x7f60f006d250 2024-09-12T12:17:40.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60ef400640 1 -- 172.21.15.144:0/3698721237 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e40ab600 con 0x7f60f006d250 2024-09-12T12:17:40.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60ef400640 1 -- 172.21.15.144:0/3698721237 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40ab9d0 con 0x7f60f006d250 2024-09-12T12:17:40.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60f7600640 1 -- 172.21.15.144:0/3698721237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d250 msgr2=0x7f60f015c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:40.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60f7600640 1 --2- 172.21.15.144:0/3698721237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d250 0x7f60f015c740 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f60e40097f0 tx=0x7f60e401c250 comp rx=0 tx=0).stop 2024-09-12T12:17:40.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60f7600640 1 -- 172.21.15.144:0/3698721237 shutdown_connections 2024-09-12T12:17:40.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60f7600640 1 --2- 172.21.15.144:0/3698721237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d250 0x7f60f015c740 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:40.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60f7600640 1 -- 172.21.15.144:0/3698721237 >> 172.21.15.144:0/3698721237 conn(0x7f60f006bc10 msgr2=0x7f60f006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:40.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60f7600640 1 -- 172.21.15.144:0/3698721237 shutdown_connections 2024-09-12T12:17:40.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60f7600640 1 -- 172.21.15.144:0/3698721237 wait complete. 2024-09-12T12:17:40.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.306+0000 7f60f7600640 1 Processor -- start 2024-09-12T12:17:40.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 -- start start 2024-09-12T12:17:40.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60f006d250 0x7f60f014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:40.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d630 0x7f60f0149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:40.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60f00b3490 0x7f60f014b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:40.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60f015d690 con 0x7f60f006d630 2024-09-12T12:17:40.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60f00b44d0 con 0x7f60f00b3490 2024-09-12T12:17:40.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f60f015d810 con 0x7f60f006d250 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60efe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d630 0x7f60f0149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60efe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d630 0x7f60f0149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52532/0 (socket says 172.21.15.144:52532) 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60efe00640 1 -- 172.21.15.144:0/1463162891 learned_addr learned my addr 172.21.15.144:0/1463162891 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f5600640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60f00b3490 0x7f60f014b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f4c00640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60f006d250 0x7f60f014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60efe00640 1 -- 172.21.15.144:0/1463162891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60f006d250 msgr2=0x7f60f014c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60efe00640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60f006d250 0x7f60f014c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60efe00640 1 -- 172.21.15.144:0/1463162891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60f00b3490 msgr2=0x7f60f014b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60efe00640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60f00b3490 0x7f60f014b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:40.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60efe00640 1 -- 172.21.15.144:0/1463162891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f014c890 con 0x7f60f006d630 2024-09-12T12:17:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f5600640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60f00b3490 0x7f60f014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60efe00640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d630 0x7f60f0149690 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00b440 tx=0x7f60dc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60ecc00640 1 -- 172.21.15.144:0/1463162891 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc015020 con 0x7f60f006d630 2024-09-12T12:17:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60ecc00640 1 -- 172.21.15.144:0/1463162891 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60dc011890 con 0x7f60f006d630 2024-09-12T12:17:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60ecc00640 1 -- 172.21.15.144:0/1463162891 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc011c80 con 0x7f60f006d630 2024-09-12T12:17:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f014cb70 con 0x7f60f006d630 2024-09-12T12:17:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f014d130 con 0x7f60f006d630 2024-09-12T12:17:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.310+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f015c740 con 0x7f60f006d630 2024-09-12T12:17:40.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.314+0000 7f60ecc00640 1 -- 172.21.15.144:0/1463162891 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60dc018020 con 0x7f60f006d630 2024-09-12T12:17:40.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.314+0000 7f60ecc00640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f60d00678c0 0x7f60d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:40.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.314+0000 7f60ecc00640 1 -- 172.21.15.144:0/1463162891 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6273+0+0 (secure 0 0 0) 0x7f60dc085e20 con 0x7f60f006d630 2024-09-12T12:17:40.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.314+0000 7f60f4c00640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f60d00678c0 0x7f60d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:40.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.314+0000 7f60f4c00640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f60d00678c0 0x7f60d0069d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f60e40ad000 tx=0x7f60e40a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:40.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.318+0000 7f60ecc00640 1 -- 172.21.15.144:0/1463162891 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f60dc01f030 con 0x7f60f006d630 2024-09-12T12:17:40.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:40.478+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f60f0158680 con 0x7f60f006d630 2024-09-12T12:17:41.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.090+0000 7f60ecc00640 1 -- 172.21.15.144:0/1463162891 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) ==== 181+0+0 (secure 0 0 0) 0x7f60dc00d040 con 0x7f60f006d630 2024-09-12T12:17:41.095 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:17:41.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f60d00678c0 msgr2=0x7f60d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:41.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f60d00678c0 0x7f60d0069d80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f60e40ad000 tx=0x7f60e40a6000 comp rx=0 tx=0).stop 2024-09-12T12:17:41.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d630 msgr2=0x7f60f0149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:41.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d630 0x7f60f0149690 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00b440 tx=0x7f60dc00b900 comp rx=0 tx=0).stop 2024-09-12T12:17:41.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 shutdown_connections 2024-09-12T12:17:41.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f60d00678c0 0x7f60d0069d80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:41.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60f00b3490 0x7f60f014b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:41.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60f006d630 0x7f60f0149690 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:41.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 --2- 172.21.15.144:0/1463162891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60f006d250 0x7f60f014c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:41.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 >> 172.21.15.144:0/1463162891 conn(0x7f60f006bc10 msgr2=0x7f60f00b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:41.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 shutdown_connections 2024-09-12T12:17:41.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.094+0000 7f60f7600640 1 -- 172.21.15.144:0/1463162891 wait complete. 2024-09-12T12:17:41.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:17:41.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5fd000640 1 Processor -- start 2024-09-12T12:17:41.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5fd000640 1 -- start start 2024-09-12T12:17:41.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5fd000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5f8156c10 0x7ff5f8072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:41.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5fd000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f806cd20 con 0x7ff5f806cff0 2024-09-12T12:17:41.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5fd000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f80712b0 con 0x7ff5f8073a70 2024-09-12T12:17:41.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5fd000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f8071be0 con 0x7ff5f8156c10 2024-09-12T12:17:41.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5efe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff5f806cff0 0x7ff5f8073360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47250/0 (socket says 172.21.15.144:47250) 2024-09-12T12:17:41.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5efe00640 1 -- 172.21.15.144:0/683276908 learned_addr learned my addr 172.21.15.144:0/683276908 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:41.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5f5e00640 1 --2- 172.21.15.144:0/683276908 >> v2:172.21.15.144:3300/0 conn(0x7ff5f8156c10 0x7ff5f8072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:41.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5f5e00640 1 -- 172.21.15.144:0/683276908 >> v1:172.21.15.165:6789/0 conn(0x7ff5f8073a70 legacy=0x7ff5f815de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:41.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5f5e00640 1 -- 172.21.15.144:0/683276908 >> v1:172.21.15.144:6789/0 conn(0x7ff5f806cff0 legacy=0x7ff5f8073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:41.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5f5e00640 1 -- 172.21.15.144:0/683276908 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f8071590 con 0x7ff5f8156c10 2024-09-12T12:17:41.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.262+0000 7ff5f5400640 1 -- 172.21.15.144:0/683276908 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 453595599 0 0) 0x7ff5f806cd20 con 0x7ff5f806cff0 2024-09-12T12:17:41.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5f5e00640 1 --2- 172.21.15.144:0/683276908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8156c10 0x7ff5f8072070 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80097c0 tx=0x7ff5e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399d99494cffaa25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:41.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5f5400640 1 -- 172.21.15.144:0/683276908 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80aa620 con 0x7ff5f8156c10 2024-09-12T12:17:41.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5f5400640 1 -- 172.21.15.144:0/683276908 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e80af070 con 0x7ff5f8156c10 2024-09-12T12:17:41.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5f5400640 1 -- 172.21.15.144:0/683276908 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80aa9e0 con 0x7ff5f8156c10 2024-09-12T12:17:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5fd000640 1 -- 172.21.15.144:0/683276908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8156c10 msgr2=0x7ff5f8072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5fd000640 1 --2- 172.21.15.144:0/683276908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8156c10 0x7ff5f8072070 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80097c0 tx=0x7ff5e801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:17:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5fd000640 1 -- 172.21.15.144:0/683276908 shutdown_connections 2024-09-12T12:17:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5fd000640 1 --2- 172.21.15.144:0/683276908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8156c10 0x7ff5f8072070 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5fd000640 1 -- 172.21.15.144:0/683276908 >> 172.21.15.144:0/683276908 conn(0x7ff5f806bc10 msgr2=0x7ff5f806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:41.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5fd000640 1 -- 172.21.15.144:0/683276908 shutdown_connections 2024-09-12T12:17:41.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.266+0000 7ff5fd000640 1 -- 172.21.15.144:0/683276908 wait complete. 2024-09-12T12:17:41.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 Processor -- start 2024-09-12T12:17:41.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 -- start start 2024-09-12T12:17:41.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f806cff0 0x7ff5f814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:41.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8073a70 0x7ff5f814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:41.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f8156c10 0x7ff5f80c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:41.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f8157170 con 0x7ff5f8073a70 2024-09-12T12:17:41.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f8156ff0 con 0x7ff5f806cff0 2024-09-12T12:17:41.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f80725b0 con 0x7ff5f8156c10 2024-09-12T12:17:41.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5efe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8073a70 0x7ff5f814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:41.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5efe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8073a70 0x7ff5f814ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52542/0 (socket says 172.21.15.144:52542) 2024-09-12T12:17:41.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5efe00640 1 -- 172.21.15.144:0/1372868190 learned_addr learned my addr 172.21.15.144:0/1372868190 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:41.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5f5e00640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f806cff0 0x7ff5f814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:41.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5f6800640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f8156c10 0x7ff5f80c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:41.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5efe00640 1 -- 172.21.15.144:0/1372868190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f8156c10 msgr2=0x7ff5f80c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:41.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5efe00640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f8156c10 0x7ff5f80c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5efe00640 1 -- 172.21.15.144:0/1372868190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f806cff0 msgr2=0x7ff5f814e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5efe00640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f806cff0 0x7ff5f814e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5efe00640 1 -- 172.21.15.144:0/1372868190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f80c7190 con 0x7ff5f8073a70 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5efe00640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8073a70 0x7ff5f814ec90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c410 tx=0x7ff5e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5ee000640 1 -- 172.21.15.144:0/1372868190 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00074e0 con 0x7ff5f8073a70 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5ee000640 1 -- 172.21.15.144:0/1372868190 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e00047f0 con 0x7ff5f8073a70 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5ee000640 1 -- 172.21.15.144:0/1372868190 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0007680 con 0x7ff5f8073a70 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f8155740 con 0x7ff5f8073a70 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.270+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f80c76f0 con 0x7ff5f8073a70 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.274+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f806dd80 con 0x7ff5f8073a70 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.274+0000 7ff5ee000640 1 -- 172.21.15.144:0/1372868190 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5e0011070 con 0x7ff5f8073a70 2024-09-12T12:17:41.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.274+0000 7ff5ee000640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5d40678f0 0x7ff5d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:41.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.274+0000 7ff5ee000640 1 -- 172.21.15.144:0/1372868190 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5835+0+0 (secure 0 0 0) 0x7ff5e00856e0 con 0x7ff5f8073a70 2024-09-12T12:17:41.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.274+0000 7ff5f5e00640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5d40678f0 0x7ff5d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:41.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.274+0000 7ff5f5e00640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5d40678f0 0x7ff5d4069db0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80ae000 tx=0x7ff5e80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:41.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.278+0000 7ff5ee000640 1 -- 172.21.15.144:0/1372868190 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff5f80c7190 con 0x7ff5f8073a70 2024-09-12T12:17:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:41.434+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff5f8072050 con 0x7ff5f8073a70 2024-09-12T12:17:42.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5ee000640 1 -- 172.21.15.144:0/1372868190 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) ==== 169+0+0 (secure 0 0 0) 0x7ff5e0055be0 con 0x7ff5f8073a70 2024-09-12T12:17:42.100 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:17:42.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5d40678f0 msgr2=0x7ff5d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5d40678f0 0x7ff5d4069db0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80ae000 tx=0x7ff5e80a7000 comp rx=0 tx=0).stop 2024-09-12T12:17:42.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8073a70 msgr2=0x7ff5f814ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8073a70 0x7ff5f814ec90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c410 tx=0x7ff5e000c8d0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 shutdown_connections 2024-09-12T12:17:42.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff5d40678f0 0x7ff5d4069db0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f8156c10 0x7ff5f80c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f8073a70 0x7ff5f814ec90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 --2- 172.21.15.144:0/1372868190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f806cff0 0x7ff5f814e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 >> 172.21.15.144:0/1372868190 conn(0x7ff5f806bc10 msgr2=0x7ff5f815cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 shutdown_connections 2024-09-12T12:17:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.098+0000 7ff5fd000640 1 -- 172.21.15.144:0/1372868190 wait complete. 2024-09-12T12:17:42.128 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:17:42.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f013d000640 1 Processor -- start 2024-09-12T12:17:42.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f013d000640 1 -- start start 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f013d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01380cd9f0 0x7f013806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f013d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f013815b340 0x7f013806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f013d000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01380b4300 con 0x7f013815af60 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f013d000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f01380b32f0 con 0x7f013815b340 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f013d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f01380b3540 con 0x7f01380cd9f0 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f0135e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f013815af60 0x7f01380ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47256/0 (socket says 172.21.15.144:47256) 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f0135e00640 1 -- 172.21.15.144:0/1495871951 learned_addr learned my addr 172.21.15.144:0/1495871951 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f0136800640 1 --2- 172.21.15.144:0/1495871951 >> v2:172.21.15.144:3300/0 conn(0x7f013815b340 0x7f013806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f012d400640 1 --2- 172.21.15.144:0/1495871951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01380cd9f0 0x7f013806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f0135400640 1 -- 172.21.15.144:0/1495871951 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132671104 0 0) 0x7f01380b4300 con 0x7f013815af60 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f0136800640 1 -- 172.21.15.144:0/1495871951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01380cd9f0 msgr2=0x7f013806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f0136800640 1 --2- 172.21.15.144:0/1495871951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01380cd9f0 0x7f013806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f0136800640 1 -- 172.21.15.144:0/1495871951 >> v1:172.21.15.144:6789/0 conn(0x7f013815af60 legacy=0x7f01380ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.262+0000 7f0136800640 1 -- 172.21.15.144:0/1495871951 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01380b3820 con 0x7f013815b340 2024-09-12T12:17:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f0136800640 1 --2- 172.21.15.144:0/1495871951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 0x7f013806c150 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0130009d90 tx=0x7f013001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e68b1c8dd69383 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f0135400640 1 -- 172.21.15.144:0/1495871951 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01300b4070 con 0x7f013815b340 2024-09-12T12:17:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f0135400640 1 -- 172.21.15.144:0/1495871951 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01300af600 con 0x7f013815b340 2024-09-12T12:17:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f0135400640 1 -- 172.21.15.144:0/1495871951 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01300af9d0 con 0x7f013815b340 2024-09-12T12:17:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f013d000640 1 -- 172.21.15.144:0/1495871951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 msgr2=0x7f013806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f013d000640 1 --2- 172.21.15.144:0/1495871951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 0x7f013806c150 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0130009d90 tx=0x7f013001f150 comp rx=0 tx=0).stop 2024-09-12T12:17:42.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f013d000640 1 -- 172.21.15.144:0/1495871951 shutdown_connections 2024-09-12T12:17:42.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f013d000640 1 --2- 172.21.15.144:0/1495871951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 0x7f013806c150 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f013d000640 1 --2- 172.21.15.144:0/1495871951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01380cd9f0 0x7f013806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f013d000640 1 -- 172.21.15.144:0/1495871951 >> 172.21.15.144:0/1495871951 conn(0x7f0138068030 msgr2=0x7f01380b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:42.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f013d000640 1 -- 172.21.15.144:0/1495871951 shutdown_connections 2024-09-12T12:17:42.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.266+0000 7f013d000640 1 -- 172.21.15.144:0/1495871951 wait complete. 2024-09-12T12:17:42.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f013d000640 1 Processor -- start 2024-09-12T12:17:42.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f013d000640 1 -- start start 2024-09-12T12:17:42.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f013d000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01380cd9f0 0x7f01381f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f013d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013815af60 0x7f013815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f013d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 0x7f0138147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f013d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01380b4560 con 0x7f013815b340 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f013d000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f01380b3de0 con 0x7f01380cd9f0 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f013d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f01380b46e0 con 0x7f013815af60 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0136800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 0x7f0138147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0136800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 0x7f0138147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52560/0 (socket says 172.21.15.144:52560) 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0136800640 1 -- 172.21.15.144:0/496180376 learned_addr learned my addr 172.21.15.144:0/496180376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f012d400640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013815af60 0x7f013815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0135e00640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01380cd9f0 0x7f01381f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0136800640 1 -- 172.21.15.144:0/496180376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013815af60 msgr2=0x7f013815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0136800640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013815af60 0x7f013815de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0136800640 1 -- 172.21.15.144:0/496180376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01380cd9f0 msgr2=0x7f01381f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0136800640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01380cd9f0 0x7f01381f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0136800640 1 -- 172.21.15.144:0/496180376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0138148050 con 0x7f013815b340 2024-09-12T12:17:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f012d400640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013815af60 0x7f013815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f0136800640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 0x7f0138147b10 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f01300b2040 tx=0x7f013001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f012ea00640 1 -- 172.21.15.144:0/496180376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01300b4040 con 0x7f013815b340 2024-09-12T12:17:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f012ea00640 1 -- 172.21.15.144:0/496180376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01300c1070 con 0x7f013815b340 2024-09-12T12:17:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013815e550 con 0x7f013815b340 2024-09-12T12:17:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.270+0000 7f012ea00640 1 -- 172.21.15.144:0/496180376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130009450 con 0x7f013815b340 2024-09-12T12:17:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.274+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0138153610 con 0x7f013815b340 2024-09-12T12:17:42.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.274+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01380ce680 con 0x7f013815b340 2024-09-12T12:17:42.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.274+0000 7f012ea00640 1 -- 172.21.15.144:0/496180376 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f01300ba6b0 con 0x7f013815b340 2024-09-12T12:17:42.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.274+0000 7f012ea00640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01140678f0 0x7f0114069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.274+0000 7f012ea00640 1 -- 172.21.15.144:0/496180376 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5421+0+0 (secure 0 0 0) 0x7f0130124380 con 0x7f013815b340 2024-09-12T12:17:42.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.274+0000 7f0135e00640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01140678f0 0x7f0114069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.274+0000 7f0135e00640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01140678f0 0x7f0114069db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:42.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.278+0000 7f012ea00640 1 -- 172.21.15.144:0/496180376 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0130018cb0 con 0x7f013815b340 2024-09-12T12:17:42.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.438+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f01380afc20 con 0x7f013815b340 2024-09-12T12:17:42.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f012ea00640 1 -- 172.21.15.144:0/496180376 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f01300f4a10 con 0x7f013815b340 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01140678f0 msgr2=0x7f0114069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01140678f0 0x7f0114069db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128007d60 comp rx=0 tx=0).stop 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 msgr2=0x7f0138147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 0x7f0138147b10 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f01300b2040 tx=0x7f013001bef0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 shutdown_connections 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01140678f0 0x7f0114069db0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013815b340 0x7f0138147b10 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013815af60 0x7f013815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 --2- 172.21.15.144:0/496180376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01380cd9f0 0x7f01381f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 >> 172.21.15.144:0/496180376 conn(0x7f0138068030 msgr2=0x7f013806d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 shutdown_connections 2024-09-12T12:17:42.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.442+0000 7f013d000640 1 -- 172.21.15.144:0/496180376 wait complete. 2024-09-12T12:17:42.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-12T12:17:42.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.610+0000 7f7e37000640 1 Processor -- start 2024-09-12T12:17:42.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.610+0000 7f7e37000640 1 -- start start 2024-09-12T12:17:42.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.610+0000 7f7e37000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3015b4e0 0x7f7e300b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.610+0000 7f7e37000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e300b45a0 con 0x7f7e300b3ad0 2024-09-12T12:17:42.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.610+0000 7f7e37000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e300b3fe0 con 0x7f7e300ccf30 2024-09-12T12:17:42.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.610+0000 7f7e37000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7e300b42c0 con 0x7f7e3015b4e0 2024-09-12T12:17:42.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7e300b3ad0 0x7f7e30071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47264/0 (socket says 172.21.15.144:47264) 2024-09-12T12:17:42.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2f400640 1 -- 172.21.15.144:0/2912848474 learned_addr learned my addr 172.21.15.144:0/2912848474 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:42.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2fe00640 1 --2- 172.21.15.144:0/2912848474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3015b4e0 0x7f7e300b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2ea00640 1 -- 172.21.15.144:0/2912848474 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581300832 0 0) 0x7f7e300b45a0 con 0x7f7e300b3ad0 2024-09-12T12:17:42.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2ea00640 1 -- 172.21.15.144:0/2912848474 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e14003530 con 0x7f7e300b3ad0 2024-09-12T12:17:42.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2ea00640 1 -- 172.21.15.144:0/2912848474 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1571309254 0 0) 0x7f7e300b3fe0 con 0x7f7e300ccf30 2024-09-12T12:17:42.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2ea00640 1 -- 172.21.15.144:0/2912848474 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e300b45a0 con 0x7f7e300ccf30 2024-09-12T12:17:42.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2fe00640 1 -- 172.21.15.144:0/2912848474 >> v1:172.21.15.165:6789/0 conn(0x7f7e300ccf30 legacy=0x7f7e300b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2fe00640 1 -- 172.21.15.144:0/2912848474 >> v1:172.21.15.144:6789/0 conn(0x7f7e300b3ad0 legacy=0x7f7e30071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2fe00640 1 -- 172.21.15.144:0/2912848474 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e300b1490 con 0x7f7e3015b4e0 2024-09-12T12:17:42.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.614+0000 7f7e2fe00640 1 --2- 172.21.15.144:0/2912848474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3015b4e0 0x7f7e300b3590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097f0 tx=0x7f7e2001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b38f4ff23d58f8f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:42.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e2ea00640 1 -- 172.21.15.144:0/2912848474 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e200ab610 con 0x7f7e3015b4e0 2024-09-12T12:17:42.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e2ea00640 1 -- 172.21.15.144:0/2912848474 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e200b0070 con 0x7f7e3015b4e0 2024-09-12T12:17:42.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e2ea00640 1 -- 172.21.15.144:0/2912848474 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e200ab9d0 con 0x7f7e3015b4e0 2024-09-12T12:17:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 -- 172.21.15.144:0/2912848474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3015b4e0 msgr2=0x7f7e300b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 --2- 172.21.15.144:0/2912848474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3015b4e0 0x7f7e300b3590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097f0 tx=0x7f7e2001c4b0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 -- 172.21.15.144:0/2912848474 shutdown_connections 2024-09-12T12:17:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 --2- 172.21.15.144:0/2912848474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3015b4e0 0x7f7e300b3590 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 -- 172.21.15.144:0/2912848474 >> 172.21.15.144:0/2912848474 conn(0x7f7e3006d0d0 msgr2=0x7f7e3006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 -- 172.21.15.144:0/2912848474 shutdown_connections 2024-09-12T12:17:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 -- 172.21.15.144:0/2912848474 wait complete. 2024-09-12T12:17:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 Processor -- start 2024-09-12T12:17:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 -- start start 2024-09-12T12:17:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e300b3ad0 0x7f7e300cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e300ccf30 0x7f7e300cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e3015b4e0 0x7f7e30163230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3015b8c0 con 0x7f7e3015b4e0 2024-09-12T12:17:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7e300cd770 con 0x7f7e300ccf30 2024-09-12T12:17:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e37000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7e30161e20 con 0x7f7e300b3ad0 2024-09-12T12:17:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e35000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e3015b4e0 0x7f7e30163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e35000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e3015b4e0 0x7f7e30163230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52562/0 (socket says 172.21.15.144:52562) 2024-09-12T12:17:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e35000640 1 -- 172.21.15.144:0/838425566 learned_addr learned my addr 172.21.15.144:0/838425566 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.618+0000 7f7e2fe00640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e300b3ad0 0x7f7e300cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e2f400640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e300ccf30 0x7f7e300cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e35000640 1 -- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e300b3ad0 msgr2=0x7f7e300cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e35000640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e300b3ad0 0x7f7e300cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e35000640 1 -- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e300ccf30 msgr2=0x7f7e300cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e35000640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e300ccf30 0x7f7e300cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e35000640 1 -- 172.21.15.144:0/838425566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e30161b40 con 0x7f7e3015b4e0 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e2fe00640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e300b3ad0 0x7f7e300cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e2f400640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e300ccf30 0x7f7e300cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e35000640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e3015b4e0 0x7f7e30163230 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800c7c0 tx=0x7f7e2800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e27e00640 1 -- 172.21.15.144:0/838425566 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28003b80 con 0x7f7e3015b4e0 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e27e00640 1 -- 172.21.15.144:0/838425566 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28003d20 con 0x7f7e3015b4e0 2024-09-12T12:17:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3015be20 con 0x7f7e3015b4e0 2024-09-12T12:17:42.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e27e00640 1 -- 172.21.15.144:0/838425566 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2800a9f0 con 0x7f7e3015b4e0 2024-09-12T12:17:42.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e30157070 con 0x7f7e3015b4e0 2024-09-12T12:17:42.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e300b3590 con 0x7f7e3015b4e0 2024-09-12T12:17:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e27e00640 1 -- 172.21.15.144:0/838425566 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e2800ab90 con 0x7f7e3015b4e0 2024-09-12T12:17:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e27e00640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e100678f0 0x7f7e10069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e27e00640 1 -- 172.21.15.144:0/838425566 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5421+0+0 (secure 0 0 0) 0x7f7e28085b70 con 0x7f7e3015b4e0 2024-09-12T12:17:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.622+0000 7f7e2fe00640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e100678f0 0x7f7e10069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.626+0000 7f7e2fe00640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e100678f0 0x7f7e10069db0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7e200af000 tx=0x7f7e200a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:42.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.626+0000 7f7e27e00640 1 -- 172.21.15.144:0/838425566 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7e28056730 con 0x7f7e3015b4e0 2024-09-12T12:17:42.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:42.842+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f7e300b11d0 con 0x7f7e3015b4e0 2024-09-12T12:17:43.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.098+0000 7f7e27e00640 1 -- 172.21.15.144:0/838425566 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v261) ==== 143+0+0 (secure 0 0 0) 0x7f7e28056030 con 0x7f7e3015b4e0 2024-09-12T12:17:43.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e100678f0 msgr2=0x7f7e10069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e100678f0 0x7f7e10069db0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7e200af000 tx=0x7f7e200a7000 comp rx=0 tx=0).stop 2024-09-12T12:17:43.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e3015b4e0 msgr2=0x7f7e30163230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e3015b4e0 0x7f7e30163230 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800c7c0 tx=0x7f7e2800cc80 comp rx=0 tx=0).stop 2024-09-12T12:17:43.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 shutdown_connections 2024-09-12T12:17:43.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e100678f0 0x7f7e10069db0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e3015b4e0 0x7f7e30163230 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e300ccf30 0x7f7e300cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 --2- 172.21.15.144:0/838425566 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e300b3ad0 0x7f7e300cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 >> 172.21.15.144:0/838425566 conn(0x7f7e3006d0d0 msgr2=0x7f7e300af070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:43.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 shutdown_connections 2024-09-12T12:17:43.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.102+0000 7f7e37000640 1 -- 172.21.15.144:0/838425566 wait complete. 2024-09-12T12:17:43.126 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-12T12:17:43.127 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-09-12T12:17:43.127 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-12T12:17:43.129 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:17:43.183 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:17:43.187 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:17:43.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.262+0000 7f29d0c00640 1 Processor -- start 2024-09-12T12:17:43.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.262+0000 7f29d0c00640 1 -- start start 2024-09-12T12:17:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29d0c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f29cc15e5f0 0x7f29cc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29d0c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f29cc0b44a0 0x7f29cc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29d0c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29cc06d260 con 0x7f29cc06e300 2024-09-12T12:17:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29d0c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f29cc0b6f60 con 0x7f29cc15e5f0 2024-09-12T12:17:43.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29d0c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f29cc0b7240 con 0x7f29cc0b44a0 2024-09-12T12:17:43.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29c9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f29cc15e5f0 0x7f29cc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29ca800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f29cc06e300 0x7f29cc15ef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47276/0 (socket says 172.21.15.144:47276) 2024-09-12T12:17:43.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29ca800640 1 -- 172.21.15.144:0/3382061797 learned_addr learned my addr 172.21.15.144:0/3382061797 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:43.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29c1400640 1 --2- 172.21.15.144:0/3382061797 >> v2:172.21.15.165:3300/0 conn(0x7f29cc0b44a0 0x7f29cc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29c9e00640 1 -- 172.21.15.144:0/3382061797 >> v2:172.21.15.165:3300/0 conn(0x7f29cc0b44a0 msgr2=0x7f29cc0b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:43.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29c9e00640 1 --2- 172.21.15.144:0/3382061797 >> v2:172.21.15.165:3300/0 conn(0x7f29cc0b44a0 0x7f29cc0b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29c9e00640 1 -- 172.21.15.144:0/3382061797 >> v1:172.21.15.144:6789/0 conn(0x7f29cc06e300 legacy=0x7f29cc15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29c9e00640 1 -- 172.21.15.144:0/3382061797 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc0b7520 con 0x7f29cc15e5f0 2024-09-12T12:17:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29c1400640 1 --2- 172.21.15.144:0/3382061797 >> v2:172.21.15.165:3300/0 conn(0x7f29cc0b44a0 0x7f29cc0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.266+0000 7f29c9400640 1 -- 172.21.15.144:0/3382061797 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722666441 0 0) 0x7f29cc06d260 con 0x7f29cc06e300 2024-09-12T12:17:43.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29c9e00640 1 --2- 172.21.15.144:0/3382061797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc15e5f0 0x7f29cc06cd20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0b5570 tx=0x7f29bc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8b2b8db58764c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:43.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29c9400640 1 -- 172.21.15.144:0/3382061797 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0b1070 con 0x7f29cc15e5f0 2024-09-12T12:17:43.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29c9400640 1 -- 172.21.15.144:0/3382061797 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29bc0ac600 con 0x7f29cc15e5f0 2024-09-12T12:17:43.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29c9400640 1 -- 172.21.15.144:0/3382061797 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0ac9d0 con 0x7f29cc15e5f0 2024-09-12T12:17:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 -- 172.21.15.144:0/3382061797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc15e5f0 msgr2=0x7f29cc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 --2- 172.21.15.144:0/3382061797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc15e5f0 0x7f29cc06cd20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0b5570 tx=0x7f29bc01c3c0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 -- 172.21.15.144:0/3382061797 shutdown_connections 2024-09-12T12:17:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 --2- 172.21.15.144:0/3382061797 >> v2:172.21.15.165:3300/0 conn(0x7f29cc0b44a0 0x7f29cc0b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 --2- 172.21.15.144:0/3382061797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc15e5f0 0x7f29cc06cd20 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 -- 172.21.15.144:0/3382061797 >> 172.21.15.144:0/3382061797 conn(0x7f29cc06f400 msgr2=0x7f29cc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:43.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 -- 172.21.15.144:0/3382061797 shutdown_connections 2024-09-12T12:17:43.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 -- 172.21.15.144:0/3382061797 wait complete. 2024-09-12T12:17:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 Processor -- start 2024-09-12T12:17:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.270+0000 7f29d0c00640 1 -- start start 2024-09-12T12:17:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29d0c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29cc06e300 0x7f29cc14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29d0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc0b44a0 0x7f29cc149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29d0c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29cc15e5f0 0x7f29cc14a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29d0c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc0b6b90 con 0x7f29cc0b44a0 2024-09-12T12:17:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29d0c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc06eb40 con 0x7f29cc15e5f0 2024-09-12T12:17:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29d0c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f29cc0b6d10 con 0x7f29cc06e300 2024-09-12T12:17:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc0b44a0 0x7f29cc149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc0b44a0 0x7f29cc149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52580/0 (socket says 172.21.15.144:52580) 2024-09-12T12:17:43.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c1400640 1 -- 172.21.15.144:0/1060941788 learned_addr learned my addr 172.21.15.144:0/1060941788 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:43.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29ca800640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29cc15e5f0 0x7f29cc14a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c9e00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29cc06e300 0x7f29cc14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c1400640 1 -- 172.21.15.144:0/1060941788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29cc06e300 msgr2=0x7f29cc14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c1400640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29cc06e300 0x7f29cc14f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c1400640 1 -- 172.21.15.144:0/1060941788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29cc15e5f0 msgr2=0x7f29cc14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c1400640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29cc15e5f0 0x7f29cc14a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c1400640 1 -- 172.21.15.144:0/1060941788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc14dbe0 con 0x7f29cc0b44a0 2024-09-12T12:17:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29ca800640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29cc15e5f0 0x7f29cc14a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c1400640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc0b44a0 0x7f29cc149820 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c7c0 tx=0x7f29b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c2a00640 1 -- 172.21.15.144:0/1060941788 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4007a30 con 0x7f29cc0b44a0 2024-09-12T12:17:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c2a00640 1 -- 172.21.15.144:0/1060941788 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b4007bd0 con 0x7f29cc0b44a0 2024-09-12T12:17:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29cc14f1c0 con 0x7f29cc0b44a0 2024-09-12T12:17:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c2a00640 1 -- 172.21.15.144:0/1060941788 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b40113f0 con 0x7f29cc0b44a0 2024-09-12T12:17:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29cc14d100 con 0x7f29cc0b44a0 2024-09-12T12:17:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29cc0b48d0 con 0x7f29cc0b44a0 2024-09-12T12:17:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.274+0000 7f29c2a00640 1 -- 172.21.15.144:0/1060941788 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29b4011590 con 0x7f29cc0b44a0 2024-09-12T12:17:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.278+0000 7f29c2a00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29a80678f0 0x7f29a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.278+0000 7f29c2a00640 1 -- 172.21.15.144:0/1060941788 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5421+0+0 (secure 0 0 0) 0x7f29b4085d10 con 0x7f29cc0b44a0 2024-09-12T12:17:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.278+0000 7f29c9e00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29a80678f0 0x7f29a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.278+0000 7f29c9e00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29a80678f0 0x7f29a8069db0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0ae000 tx=0x7f29bc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:43.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.282+0000 7f29c2a00640 1 -- 172.21.15.144:0/1060941788 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f29b408b020 con 0x7f29cc0b44a0 2024-09-12T12:17:43.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29cc073fd0 con 0x7f29cc0b44a0 2024-09-12T12:17:43.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29c2a00640 1 -- 172.21.15.144:0/1060941788 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+13464 (secure 0 0 0) 0x7f29b4015020 con 0x7f29cc0b44a0 2024-09-12T12:17:43.444 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:43.444 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":90,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:17:42.097795+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/1622416961":"2024-09-13T12:17:39.087154+0000","172.21.15.144:6835/1622416961":"2024-09-13T12:17:39.087154+0000","172.21.15.144:6837/2111043825":"2024-09-13T12:17:18.704380+0000","172.21.15.144:6835/2111043825":"2024-09-13T12:17:18.704380+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29a80678f0 msgr2=0x7f29a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29a80678f0 0x7f29a8069db0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0ae000 tx=0x7f29bc0a7000 comp rx=0 tx=0).stop 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc0b44a0 msgr2=0x7f29cc149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc0b44a0 0x7f29cc149820 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c7c0 tx=0x7f29b400cc80 comp rx=0 tx=0).stop 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 shutdown_connections 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29a80678f0 0x7f29a8069db0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29cc15e5f0 0x7f29cc14a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29cc0b44a0 0x7f29cc149820 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 --2- 172.21.15.144:0/1060941788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29cc06e300 0x7f29cc14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 >> 172.21.15.144:0/1060941788 conn(0x7f29cc06f400 msgr2=0x7f29cc0b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:43.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 shutdown_connections 2024-09-12T12:17:43.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.442+0000 7f29d0c00640 1 -- 172.21.15.144:0/1060941788 wait complete. 2024-09-12T12:17:43.466 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:17:43.466 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:17:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.642+0000 7f019dc00640 1 Processor -- start 2024-09-12T12:17:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.642+0000 7f019dc00640 1 -- start start 2024-09-12T12:17:43.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f019dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f01980af5f0 0x7f019806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f019dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 0x7f01980cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f019dc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01980733e0 con 0x7f019815c2e0 2024-09-12T12:17:43.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f019dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f019806c5c0 con 0x7f01980af5f0 2024-09-12T12:17:43.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f019dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f01980cd290 con 0x7f019806c150 2024-09-12T12:17:43.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f0196a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f019815c2e0 0x7f0198072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47282/0 (socket says 172.21.15.144:47282) 2024-09-12T12:17:43.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f0196a00640 1 -- 172.21.15.144:0/4221427800 learned_addr learned my addr 172.21.15.144:0/4221427800 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:43.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f0196000640 1 --2- 172.21.15.144:0/4221427800 >> v2:172.21.15.144:3300/0 conn(0x7f01980af5f0 0x7f019806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f0197400640 1 --2- 172.21.15.144:0/4221427800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 0x7f01980cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f0196000640 1 -- 172.21.15.144:0/4221427800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 msgr2=0x7f01980cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f0196000640 1 --2- 172.21.15.144:0/4221427800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 0x7f01980cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f0196000640 1 -- 172.21.15.144:0/4221427800 >> v1:172.21.15.144:6789/0 conn(0x7f019815c2e0 legacy=0x7f0198072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f0195600640 1 -- 172.21.15.144:0/4221427800 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453147140 0 0) 0x7f01980733e0 con 0x7f019815c2e0 2024-09-12T12:17:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.646+0000 7f0196000640 1 -- 172.21.15.144:0/4221427800 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01980cd570 con 0x7f01980af5f0 2024-09-12T12:17:43.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f0196000640 1 --2- 172.21.15.144:0/4221427800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 0x7f019806bc10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f01840097c0 tx=0x7f018401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb179fb34b90238d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:43.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f0195600640 1 -- 172.21.15.144:0/4221427800 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01840b0070 con 0x7f01980af5f0 2024-09-12T12:17:43.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f0195600640 1 -- 172.21.15.144:0/4221427800 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01840ab600 con 0x7f01980af5f0 2024-09-12T12:17:43.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f0195600640 1 -- 172.21.15.144:0/4221427800 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01840ab9d0 con 0x7f01980af5f0 2024-09-12T12:17:43.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 -- 172.21.15.144:0/4221427800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 msgr2=0x7f019806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 --2- 172.21.15.144:0/4221427800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 0x7f019806bc10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f01840097c0 tx=0x7f018401c380 comp rx=0 tx=0).stop 2024-09-12T12:17:43.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 -- 172.21.15.144:0/4221427800 shutdown_connections 2024-09-12T12:17:43.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 --2- 172.21.15.144:0/4221427800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 0x7f01980cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 --2- 172.21.15.144:0/4221427800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 0x7f019806bc10 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 -- 172.21.15.144:0/4221427800 >> 172.21.15.144:0/4221427800 conn(0x7f0198068030 msgr2=0x7f01980b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:43.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 -- 172.21.15.144:0/4221427800 shutdown_connections 2024-09-12T12:17:43.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 -- 172.21.15.144:0/4221427800 wait complete. 2024-09-12T12:17:43.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 Processor -- start 2024-09-12T12:17:43.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.650+0000 7f019dc00640 1 -- start start 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f019dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 0x7f01980b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f019dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 0x7f0198150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f019dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f019815c2e0 0x7f01981510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f019dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01980cee90 con 0x7f01980af5f0 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f019dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f01980ced10 con 0x7f019815c2e0 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f019dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f01980cf010 con 0x7f019806c150 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 0x7f0198150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 0x7f0198150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52598/0 (socket says 172.21.15.144:52598) 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196000640 1 -- 172.21.15.144:0/3323712762 learned_addr learned my addr 172.21.15.144:0/3323712762 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196a00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 0x7f01980b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0197400640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f019815c2e0 0x7f01981510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196000640 1 -- 172.21.15.144:0/3323712762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 msgr2=0x7f01980b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196000640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 0x7f01980b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196000640 1 -- 172.21.15.144:0/3323712762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f019815c2e0 msgr2=0x7f01981510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196000640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f019815c2e0 0x7f01981510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196000640 1 -- 172.21.15.144:0/3323712762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01980b4430 con 0x7f01980af5f0 2024-09-12T12:17:43.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0197400640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f019815c2e0 0x7f01981510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:43.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f0196000640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 0x7f0198150ba0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f01840ae040 tx=0x7f018401abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:43.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f018ea00640 1 -- 172.21.15.144:0/3323712762 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01840bc070 con 0x7f01980af5f0 2024-09-12T12:17:43.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f018ea00640 1 -- 172.21.15.144:0/3323712762 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01840b1040 con 0x7f01980af5f0 2024-09-12T12:17:43.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f018ea00640 1 -- 172.21.15.144:0/3323712762 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01840b0050 con 0x7f01980af5f0 2024-09-12T12:17:43.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01980b4710 con 0x7f01980af5f0 2024-09-12T12:17:43.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019815af00 con 0x7f01980af5f0 2024-09-12T12:17:43.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01980cdd70 con 0x7f01980af5f0 2024-09-12T12:17:43.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.654+0000 7f018ea00640 1 -- 172.21.15.144:0/3323712762 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0184004230 con 0x7f01980af5f0 2024-09-12T12:17:43.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.658+0000 7f018ea00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01780678f0 0x7f0178069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.658+0000 7f018ea00640 1 -- 172.21.15.144:0/3323712762 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5421+0+0 (secure 0 0 0) 0x7f018411f6e0 con 0x7f01980af5f0 2024-09-12T12:17:43.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.658+0000 7f0196a00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01780678f0 0x7f0178069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.658+0000 7f0196a00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01780678f0 0x7f0178069db0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0188004fd0 tx=0x7f0188001770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:43.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.662+0000 7f018ea00640 1 -- 172.21.15.144:0/3323712762 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f01840a4e20 con 0x7f01980af5f0 2024-09-12T12:17:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.822+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f01980685e0 con 0x7f01980af5f0 2024-09-12T12:17:43.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.822+0000 7f018ea00640 1 -- 172.21.15.144:0/3323712762 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f0184016090 con 0x7f01980af5f0 2024-09-12T12:17:43.826 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:17:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01780678f0 msgr2=0x7f0178069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01780678f0 0x7f0178069db0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0188004fd0 tx=0x7f0188001770 comp rx=0 tx=0).stop 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 msgr2=0x7f0198150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 0x7f0198150ba0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f01840ae040 tx=0x7f018401abc0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 shutdown_connections 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01780678f0 0x7f0178069db0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f019815c2e0 0x7f01981510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01980af5f0 0x7f0198150ba0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 --2- 172.21.15.144:0/3323712762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f019806c150 0x7f01980b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 >> 172.21.15.144:0/3323712762 conn(0x7f0198068030 msgr2=0x7f01980d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 shutdown_connections 2024-09-12T12:17:43.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.826+0000 7f019dc00640 1 -- 172.21.15.144:0/3323712762 wait complete. 2024-09-12T12:17:43.847 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-12T12:17:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f639b800640 1 Processor -- start 2024-09-12T12:17:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f639b800640 1 -- start start 2024-09-12T12:17:43.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f639b800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f639406e910 0x7f639406ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f639b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415f210 0x7f639415af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f639b800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639406f230 con 0x7f639415edf0 2024-09-12T12:17:43.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f639b800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f63940727a0 con 0x7f639406e910 2024-09-12T12:17:43.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f639b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f639415be70 con 0x7f639415f210 2024-09-12T12:17:43.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f6398e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f639406e910 0x7f639406ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f6393e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f639415edf0 0x7f6394072090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47290/0 (socket says 172.21.15.144:47290) 2024-09-12T12:17:43.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f6393e00640 1 -- 172.21.15.144:0/182068686 learned_addr learned my addr 172.21.15.144:0/182068686 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:43.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f6399800640 1 --2- 172.21.15.144:0/182068686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415f210 0x7f639415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f6398e00640 1 -- 172.21.15.144:0/182068686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415f210 msgr2=0x7f639415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:43.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f6398e00640 1 --2- 172.21.15.144:0/182068686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415f210 0x7f639415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f6398e00640 1 -- 172.21.15.144:0/182068686 >> v1:172.21.15.144:6789/0 conn(0x7f639415edf0 legacy=0x7f6394072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f6398e00640 1 -- 172.21.15.144:0/182068686 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639415b8b0 con 0x7f639406e910 2024-09-12T12:17:43.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.982+0000 7f6399800640 1 --2- 172.21.15.144:0/182068686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415f210 0x7f639415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:43.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f6398e00640 1 --2- 172.21.15.144:0/182068686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 0x7f639406ecf0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f637c0097c0 tx=0x7f637c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a9f4989d4b74d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:43.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f6393400640 1 -- 172.21.15.144:0/182068686 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c0ab5f0 con 0x7f639406e910 2024-09-12T12:17:43.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f6393400640 1 -- 172.21.15.144:0/182068686 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637c0b0070 con 0x7f639406e910 2024-09-12T12:17:43.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f6393400640 1 -- 172.21.15.144:0/182068686 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c0ab9b0 con 0x7f639406e910 2024-09-12T12:17:43.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f639b800640 1 -- 172.21.15.144:0/182068686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 msgr2=0x7f639406ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f639b800640 1 --2- 172.21.15.144:0/182068686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 0x7f639406ecf0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f637c0097c0 tx=0x7f637c01c470 comp rx=0 tx=0).stop 2024-09-12T12:17:43.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f639b800640 1 -- 172.21.15.144:0/182068686 shutdown_connections 2024-09-12T12:17:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f639b800640 1 --2- 172.21.15.144:0/182068686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415f210 0x7f639415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f639b800640 1 --2- 172.21.15.144:0/182068686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 0x7f639406ecf0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f639b800640 1 -- 172.21.15.144:0/182068686 >> 172.21.15.144:0/182068686 conn(0x7f639406ddf0 msgr2=0x7f639406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f639b800640 1 -- 172.21.15.144:0/182068686 shutdown_connections 2024-09-12T12:17:43.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.986+0000 7f639b800640 1 -- 172.21.15.144:0/182068686 wait complete. 2024-09-12T12:17:43.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 Processor -- start 2024-09-12T12:17:43.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 -- start start 2024-09-12T12:17:43.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 0x7f6394149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415edf0 0x7f63940b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f639415f210 0x7f6394140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f639415b610 con 0x7f639406e910 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f639415b490 con 0x7f639415f210 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f63940b3dc0 con 0x7f639415edf0 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6398e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 0x7f6394149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6398e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 0x7f6394149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52614/0 (socket says 172.21.15.144:52614) 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6398e00640 1 -- 172.21.15.144:0/1793144105 learned_addr learned my addr 172.21.15.144:0/1793144105 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6399800640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f639415f210 0x7f6394140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6393e00640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415edf0 0x7f63940b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6398e00640 1 -- 172.21.15.144:0/1793144105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415edf0 msgr2=0x7f63940b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6398e00640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415edf0 0x7f63940b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6398e00640 1 -- 172.21.15.144:0/1793144105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f639415f210 msgr2=0x7f6394140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:43.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6398e00640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f639415f210 0x7f6394140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:43.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6398e00640 1 -- 172.21.15.144:0/1793144105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639414a540 con 0x7f639406e910 2024-09-12T12:17:43.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6399800640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f639415f210 0x7f6394140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:43.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6398e00640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 0x7f6394149610 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f637c0ad040 tx=0x7f637c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6390c00640 1 -- 172.21.15.144:0/1793144105 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c0bf610 con 0x7f639406e910 2024-09-12T12:17:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6390c00640 1 -- 172.21.15.144:0/1793144105 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637c0bf7d0 con 0x7f639406e910 2024-09-12T12:17:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639414a820 con 0x7f639406e910 2024-09-12T12:17:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f6390c00640 1 -- 172.21.15.144:0/1793144105 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c0bfbc0 con 0x7f639406e910 2024-09-12T12:17:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.990+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f639415c160 con 0x7f639406e910 2024-09-12T12:17:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.994+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f639406ecf0 con 0x7f639406e910 2024-09-12T12:17:43.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.994+0000 7f6390c00640 1 -- 172.21.15.144:0/1793144105 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f637c0bd020 con 0x7f639406e910 2024-09-12T12:17:43.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.994+0000 7f6390c00640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63700678c0 0x7f6370069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:43.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.994+0000 7f6390c00640 1 -- 172.21.15.144:0/1793144105 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5421+0+0 (secure 0 0 0) 0x7f637c11fff0 con 0x7f639406e910 2024-09-12T12:17:43.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.994+0000 7f6393e00640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63700678c0 0x7f6370069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:43.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.994+0000 7f6393e00640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63700678c0 0x7f6370069d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f63941faaf0 tx=0x7f6384009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:43.998+0000 7f6390c00640 1 -- 172.21.15.144:0/1793144105 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f637c016090 con 0x7f639406e910 2024-09-12T12:17:44.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:44.214+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f63940b61b0 con 0x7f639406e910 2024-09-12T12:17:45.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f6390c00640 1 -- 172.21.15.144:0/1793144105 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v263) ==== 154+0+0 (secure 0 0 0) 0x7f637c0f0bd0 con 0x7f639406e910 2024-09-12T12:17:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63700678c0 msgr2=0x7f6370069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63700678c0 0x7f6370069d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f63941faaf0 tx=0x7f6384009040 comp rx=0 tx=0).stop 2024-09-12T12:17:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 msgr2=0x7f6394149610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 0x7f6394149610 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f637c0ad040 tx=0x7f637c01acb0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 shutdown_connections 2024-09-12T12:17:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f63700678c0 0x7f6370069d80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f639415f210 0x7f6394140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f639415edf0 0x7f63940b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 --2- 172.21.15.144:0/1793144105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f639406e910 0x7f6394149610 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 >> 172.21.15.144:0/1793144105 conn(0x7f639406ddf0 msgr2=0x7f639406e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 shutdown_connections 2024-09-12T12:17:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.110+0000 7f639b800640 1 -- 172.21.15.144:0/1793144105 wait complete. 2024-09-12T12:17:45.138 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:17:45.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f9610200640 1 Processor -- start 2024-09-12T12:17:45.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f9610200640 1 -- start start 2024-09-12T12:17:45.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f9610200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96080cd9f0 0x7f960806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f9610200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96080b4300 con 0x7f960815b340 2024-09-12T12:17:45.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f9610200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96080b3540 con 0x7f960815af60 2024-09-12T12:17:45.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f9610200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f96080b32f0 con 0x7f96080cd9f0 2024-09-12T12:17:45.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f960ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96080cd9f0 0x7f960806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f960e200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f960815b340 0x7f96080b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47306/0 (socket says 172.21.15.144:47306) 2024-09-12T12:17:45.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f960e200640 1 -- 172.21.15.144:0/1946120039 learned_addr learned my addr 172.21.15.144:0/1946120039 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:45.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f960ce00640 1 -- 172.21.15.144:0/1946120039 >> v1:172.21.15.165:6789/0 conn(0x7f960815af60 legacy=0x7f96080ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.278+0000 7f960ce00640 1 -- 172.21.15.144:0/1946120039 >> v1:172.21.15.144:6789/0 conn(0x7f960815b340 legacy=0x7f96080b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.282+0000 7f960ce00640 1 -- 172.21.15.144:0/1946120039 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96080b3820 con 0x7f96080cd9f0 2024-09-12T12:17:45.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.282+0000 7f9607e00640 1 -- 172.21.15.144:0/1946120039 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2265592325 0 0) 0x7f96080b4300 con 0x7f960815b340 2024-09-12T12:17:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.282+0000 7f960ce00640 1 --2- 172.21.15.144:0/1946120039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96080cd9f0 0x7f960806bc10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097c0 tx=0x7f95f401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a07e0e52e5de633 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.282+0000 7f9607e00640 1 -- 172.21.15.144:0/1946120039 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f40b0070 con 0x7f96080cd9f0 2024-09-12T12:17:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.282+0000 7f9607e00640 1 -- 172.21.15.144:0/1946120039 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f40ab600 con 0x7f96080cd9f0 2024-09-12T12:17:45.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.282+0000 7f9607e00640 1 -- 172.21.15.144:0/1946120039 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f40ab9d0 con 0x7f96080cd9f0 2024-09-12T12:17:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.282+0000 7f9610200640 1 -- 172.21.15.144:0/1946120039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96080cd9f0 msgr2=0x7f960806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.282+0000 7f9610200640 1 --2- 172.21.15.144:0/1946120039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96080cd9f0 0x7f960806bc10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097c0 tx=0x7f95f401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 -- 172.21.15.144:0/1946120039 shutdown_connections 2024-09-12T12:17:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 --2- 172.21.15.144:0/1946120039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96080cd9f0 0x7f960806bc10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 -- 172.21.15.144:0/1946120039 >> 172.21.15.144:0/1946120039 conn(0x7f9608068030 msgr2=0x7f96080b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 -- 172.21.15.144:0/1946120039 shutdown_connections 2024-09-12T12:17:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 -- 172.21.15.144:0/1946120039 wait complete. 2024-09-12T12:17:45.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 Processor -- start 2024-09-12T12:17:45.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 -- start start 2024-09-12T12:17:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96080cd9f0 0x7f9608147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f960815af60 0x7f960814dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f960815b340 0x7f960814b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9608169120 con 0x7f960815b340 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f960806c560 con 0x7f96080cd9f0 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f9610200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f96081692a0 con 0x7f960815af60 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f960815b340 0x7f960814b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f960815b340 0x7f960814b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52636/0 (socket says 172.21.15.144:52636) 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960e200640 1 -- 172.21.15.144:0/3409334277 learned_addr learned my addr 172.21.15.144:0/3409334277 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960d800640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96080cd9f0 0x7f9608147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960ce00640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f960815af60 0x7f960814dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960e200640 1 -- 172.21.15.144:0/3409334277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f960815af60 msgr2=0x7f960814dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960e200640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f960815af60 0x7f960814dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960e200640 1 -- 172.21.15.144:0/3409334277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96080cd9f0 msgr2=0x7f9608147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960e200640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96080cd9f0 0x7f9608147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960e200640 1 -- 172.21.15.144:0/3409334277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960814e7c0 con 0x7f960815b340 2024-09-12T12:17:45.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.286+0000 7f960e200640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f960815b340 0x7f960814b4c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f960000c700 tx=0x7f960000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:45.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f9605600640 1 -- 172.21.15.144:0/3409334277 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600018070 con 0x7f960815b340 2024-09-12T12:17:45.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f9605600640 1 -- 172.21.15.144:0/3409334277 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960000ce10 con 0x7f960815b340 2024-09-12T12:17:45.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f9605600640 1 -- 172.21.15.144:0/3409334277 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960000a860 con 0x7f960815b340 2024-09-12T12:17:45.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9608148d00 con 0x7f960815b340 2024-09-12T12:17:45.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96081492c0 con 0x7f960815b340 2024-09-12T12:17:45.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f960806bc10 con 0x7f960815b340 2024-09-12T12:17:45.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f9605600640 1 -- 172.21.15.144:0/3409334277 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f960000aa00 con 0x7f960815b340 2024-09-12T12:17:45.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f9605600640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95e80678c0 0x7f95e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f9605600640 1 -- 172.21.15.144:0/3409334277 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5421+0+0 (secure 0 0 0) 0x7f9600085040 con 0x7f960815b340 2024-09-12T12:17:45.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.290+0000 7f960d800640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95e80678c0 0x7f95e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.294+0000 7f960d800640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95e80678c0 0x7f95e8069d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9608156530 tx=0x7f95fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:45.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.298+0000 7f9605600640 1 -- 172.21.15.144:0/3409334277 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f96000556e0 con 0x7f960815b340 2024-09-12T12:17:45.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.454+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f96080afc20 con 0x7f960815b340 2024-09-12T12:17:45.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.458+0000 7f9605600640 1 -- 172.21.15.144:0/3409334277 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f96000599e0 con 0x7f960815b340 2024-09-12T12:17:45.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95e80678c0 msgr2=0x7f95e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95e80678c0 0x7f95e8069d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9608156530 tx=0x7f95fc009040 comp rx=0 tx=0).stop 2024-09-12T12:17:45.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f960815b340 msgr2=0x7f960814b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f960815b340 0x7f960814b4c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f960000c700 tx=0x7f960000cbc0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 shutdown_connections 2024-09-12T12:17:45.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f95e80678c0 0x7f95e8069d80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f960815b340 0x7f960814b4c0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f960815af60 0x7f960814dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 --2- 172.21.15.144:0/3409334277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96080cd9f0 0x7f9608147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 >> 172.21.15.144:0/3409334277 conn(0x7f9608068030 msgr2=0x7f9608157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:45.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 shutdown_connections 2024-09-12T12:17:45.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.462+0000 7f9610200640 1 -- 172.21.15.144:0/3409334277 wait complete. 2024-09-12T12:17:45.483 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:17:45.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:17:45.577 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:17:45.710 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:17:45.711 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:45.711 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:45.728 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:17:45.729 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:17:45.729 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:45.746 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:17:45.746 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:45.746 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:45.785 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:17:45.785 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:17:45.785 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:45.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:17:45.803 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:17:45.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:45.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.958+0000 7f34a1200640 1 Processor -- start 2024-09-12T12:17:45.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.958+0000 7f34a1200640 1 -- start start 2024-09-12T12:17:45.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f34a1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 0x7f349c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f34a1200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f349c0b3ad0 0x7f349c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f34a1200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349c0b45a0 con 0x7f349c071960 2024-09-12T12:17:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f34a1200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f349c0b3fe0 con 0x7f349c0b3ad0 2024-09-12T12:17:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f34a1200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f349c0b42c0 con 0x7f349c15b4e0 2024-09-12T12:17:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f3499e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 0x7f349c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f349a800640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f349c071960 0x7f349c0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:41138/0 (socket says 172.21.15.144:41138) 2024-09-12T12:17:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f349a800640 1 -- 172.21.15.144:0/83895622 learned_addr learned my addr 172.21.15.144:0/83895622 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f3499400640 1 --2- 172.21.15.144:0/83895622 >> v2:172.21.15.165:3300/0 conn(0x7f349c0b3ad0 0x7f349c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f3498a00640 1 -- 172.21.15.144:0/83895622 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130448926 0 0) 0x7f349c0b45a0 con 0x7f349c071960 2024-09-12T12:17:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f3498a00640 1 -- 172.21.15.144:0/83895622 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3480003530 con 0x7f349c071960 2024-09-12T12:17:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f3499e00640 1 -- 172.21.15.144:0/83895622 >> v2:172.21.15.165:3300/0 conn(0x7f349c0b3ad0 msgr2=0x7f349c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f3499e00640 1 --2- 172.21.15.144:0/83895622 >> v2:172.21.15.165:3300/0 conn(0x7f349c0b3ad0 0x7f349c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f3499e00640 1 -- 172.21.15.144:0/83895622 >> v1:172.21.15.165:6789/0 conn(0x7f349c071960 legacy=0x7f349c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f3499e00640 1 -- 172.21.15.144:0/83895622 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c0b1490 con 0x7f349c15b4e0 2024-09-12T12:17:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.962+0000 7f3499400640 1 --2- 172.21.15.144:0/83895622 >> v2:172.21.15.165:3300/0 conn(0x7f349c0b3ad0 0x7f349c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f3499e00640 1 --2- 172.21.15.144:0/83895622 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 0x7f349c0b3590 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f348c009d90 tx=0x7f348c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de8217fae4288f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f3498a00640 1 -- 172.21.15.144:0/83895622 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c0b2070 con 0x7f349c15b4e0 2024-09-12T12:17:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f3498a00640 1 -- 172.21.15.144:0/83895622 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348c0a5a20 con 0x7f349c15b4e0 2024-09-12T12:17:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f3498a00640 1 -- 172.21.15.144:0/83895622 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c0a5df0 con 0x7f349c15b4e0 2024-09-12T12:17:45.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 -- 172.21.15.144:0/83895622 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 msgr2=0x7f349c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 --2- 172.21.15.144:0/83895622 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 0x7f349c0b3590 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f348c009d90 tx=0x7f348c01c940 comp rx=0 tx=0).stop 2024-09-12T12:17:45.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 -- 172.21.15.144:0/83895622 shutdown_connections 2024-09-12T12:17:45.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 --2- 172.21.15.144:0/83895622 >> v2:172.21.15.165:3300/0 conn(0x7f349c0b3ad0 0x7f349c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 --2- 172.21.15.144:0/83895622 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 0x7f349c0b3590 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 -- 172.21.15.144:0/83895622 >> 172.21.15.144:0/83895622 conn(0x7f349c06d0d0 msgr2=0x7f349c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 -- 172.21.15.144:0/83895622 shutdown_connections 2024-09-12T12:17:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 -- 172.21.15.144:0/83895622 wait complete. 2024-09-12T12:17:45.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 Processor -- start 2024-09-12T12:17:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.966+0000 7f34a1200640 1 -- start start 2024-09-12T12:17:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f34a1200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f349c071960 0x7f349c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f34a1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0b3ad0 0x7f349c0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f34a1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 0x7f349c0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f34a1200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f349c0b2620 con 0x7f349c0b3ad0 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f34a1200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f349c0b24a0 con 0x7f349c071960 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f34a1200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f349c0cd640 con 0x7f349c15b4e0 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0b3ad0 0x7f349c0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0b3ad0 0x7f349c0b5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52652/0 (socket says 172.21.15.144:52652) 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499400640 1 -- 172.21.15.144:0/627110286 learned_addr learned my addr 172.21.15.144:0/627110286 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499e00640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f349c071960 0x7f349c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f349a800640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 0x7f349c0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499400640 1 -- 172.21.15.144:0/627110286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 msgr2=0x7f349c0b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499400640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 0x7f349c0b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499400640 1 -- 172.21.15.144:0/627110286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f349c071960 msgr2=0x7f349c15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:45.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499400640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f349c071960 0x7f349c15e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499400640 1 -- 172.21.15.144:0/627110286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c15be90 con 0x7f349c0b3ad0 2024-09-12T12:17:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3499400640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0b3ad0 0x7f349c0b5030 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f348800ebb0 tx=0x7f348800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3492000640 1 -- 172.21.15.144:0/627110286 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3488017070 con 0x7f349c0b3ad0 2024-09-12T12:17:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3492000640 1 -- 172.21.15.144:0/627110286 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348800cc30 con 0x7f349c0b3ad0 2024-09-12T12:17:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3492000640 1 -- 172.21.15.144:0/627110286 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3488013470 con 0x7f349c0b3ad0 2024-09-12T12:17:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349c15c170 con 0x7f349c0b3ad0 2024-09-12T12:17:45.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349c15c730 con 0x7f349c0b3ad0 2024-09-12T12:17:45.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349c071420 con 0x7f349c0b3ad0 2024-09-12T12:17:45.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.970+0000 7f3492000640 1 -- 172.21.15.144:0/627110286 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f348801a070 con 0x7f349c0b3ad0 2024-09-12T12:17:45.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.974+0000 7f3492000640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f347c0678c0 0x7f347c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:45.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.974+0000 7f3492000640 1 -- 172.21.15.144:0/627110286 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5421+0+0 (secure 0 0 0) 0x7f3488085e10 con 0x7f349c0b3ad0 2024-09-12T12:17:45.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.974+0000 7f3499e00640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f347c0678c0 0x7f347c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:45.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.974+0000 7f3499e00640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f347c0678c0 0x7f347c069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f348c0af000 tx=0x7f348c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:45.978+0000 7f3492000640 1 -- 172.21.15.144:0/627110286 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3488056420 con 0x7f349c0b3ad0 2024-09-12T12:17:46.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.178+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f349c0cf520 con 0x7f349c0b3ad0 2024-09-12T12:17:46.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.178+0000 7f3492000640 1 -- 172.21.15.144:0/627110286 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+3920 (secure 0 0 0) 0x7f348805a720 con 0x7f349c0b3ad0 2024-09-12T12:17:46.182 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:46.182 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":63,"btime":"2024-09-12T12:17:40:089911+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1090713174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1090713174},{"type":"v1","addr":"172.21.15.165:6835","nonce":1090713174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6915,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3715410946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3715410946},{"type":"v1","addr":"172.21.15.165:6833","nonce":3715410946}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/974267816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":974267816},{"type":"v1","addr":"172.21.15.144:6836","nonce":974267816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7056,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2117252801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2117252801},{"type":"v1","addr":"172.21.15.144:6837","nonce":2117252801}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[]} 2024-09-12T12:17:46.183 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 63 2024-09-12T12:17:46.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f347c0678c0 msgr2=0x7f347c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f347c0678c0 0x7f347c069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f348c0af000 tx=0x7f348c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0b3ad0 msgr2=0x7f349c0b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0b3ad0 0x7f349c0b5030 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f348800ebb0 tx=0x7f348800c520 comp rx=0 tx=0).stop 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 shutdown_connections 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f347c0678c0 0x7f347c069d80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c15b4e0 0x7f349c0b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0b3ad0 0x7f349c0b5030 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 --2- 172.21.15.144:0/627110286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f349c071960 0x7f349c15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 >> 172.21.15.144:0/627110286 conn(0x7f349c06d0d0 msgr2=0x7f349c0ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 shutdown_connections 2024-09-12T12:17:46.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.182+0000 7f34a1200640 1 -- 172.21.15.144:0/627110286 wait complete. 2024-09-12T12:17:46.204 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:17:46.204 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:17:46.205 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:17:46.205 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:46.205 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:17:46.205 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:17:46.205 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:17:46.205 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:46.206 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:17:46.206 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:17:46.206 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:17:46.206 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:46.206 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:17:46.206 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:17:46.206 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:17:46.207 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:46.216 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:17:46.216 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:17:46.217 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:17:46.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:17:46.221 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:17:46.221 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:17:46.222 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:17:46.222 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:17:46.265 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:17:46.265 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:46.266 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:17:46.266 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:46.267 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:17:46.267 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:46.268 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:17:46.268 DEBUG:teuthology.parallel:result is None 2024-09-12T12:17:46.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:17:46.352 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:17:46.353 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:17:46.356 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:17:46.356 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:17:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.410+0000 7f2e4e800640 1 Processor -- start 2024-09-12T12:17:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.410+0000 7f2e4e800640 1 -- start start 2024-09-12T12:17:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.410+0000 7f2e4e800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2e4815b4e0 0x7f2e480b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.410+0000 7f2e4e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e480b3ad0 0x7f2e48071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.410+0000 7f2e4e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e48071960 0x7f2e480ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.410+0000 7f2e4e800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2e480b45a0 con 0x7f2e480b3ad0 2024-09-12T12:17:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.410+0000 7f2e4e800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2e480b3fe0 con 0x7f2e4815b4e0 2024-09-12T12:17:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.410+0000 7f2e4e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e480b42c0 con 0x7f2e48071960 2024-09-12T12:17:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e480b3ad0 0x7f2e48071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e480b3ad0 0x7f2e48071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52690/0 (socket says 172.21.15.144:52690) 2024-09-12T12:17:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46a00640 1 -- 172.21.15.144:0/3374598661 learned_addr learned my addr 172.21.15.144:0/3374598661 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e47400640 1 --2- 172.21.15.144:0/3374598661 >> v2:172.21.15.165:3300/0 conn(0x7f2e4815b4e0 0x7f2e480b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e47e00640 1 --2- 172.21.15.144:0/3374598661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e48071960 0x7f2e480ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46a00640 1 -- 172.21.15.144:0/3374598661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e48071960 msgr2=0x7f2e480ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46a00640 1 --2- 172.21.15.144:0/3374598661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e48071960 0x7f2e480ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46a00640 1 -- 172.21.15.144:0/3374598661 >> v2:172.21.15.165:3300/0 conn(0x7f2e4815b4e0 msgr2=0x7f2e480b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46a00640 1 --2- 172.21.15.144:0/3374598661 >> v2:172.21.15.165:3300/0 conn(0x7f2e4815b4e0 0x7f2e480b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46a00640 1 -- 172.21.15.144:0/3374598661 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e480b1490 con 0x7f2e480b3ad0 2024-09-12T12:17:46.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e47400640 1 --2- 172.21.15.144:0/3374598661 >> v2:172.21.15.165:3300/0 conn(0x7f2e4815b4e0 0x7f2e480b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:46.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e47e00640 1 --2- 172.21.15.144:0/3374598661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e48071960 0x7f2e480ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:46.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46a00640 1 --2- 172.21.15.144:0/3374598661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480b3ad0 0x7f2e48071420 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2e48069450 tx=0x7f2e3401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3878d51a289b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:46.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46000640 1 -- 172.21.15.144:0/3374598661 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e340b1070 con 0x7f2e480b3ad0 2024-09-12T12:17:46.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46000640 1 -- 172.21.15.144:0/3374598661 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e340ac620 con 0x7f2e480b3ad0 2024-09-12T12:17:46.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.414+0000 7f2e46000640 1 -- 172.21.15.144:0/3374598661 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e340ac9f0 con 0x7f2e480b3ad0 2024-09-12T12:17:46.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 -- 172.21.15.144:0/3374598661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480b3ad0 msgr2=0x7f2e48071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3374598661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480b3ad0 0x7f2e48071420 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2e48069450 tx=0x7f2e3401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 -- 172.21.15.144:0/3374598661 shutdown_connections 2024-09-12T12:17:46.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3374598661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480b3ad0 0x7f2e48071420 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3374598661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e48071960 0x7f2e480ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3374598661 >> v2:172.21.15.165:3300/0 conn(0x7f2e4815b4e0 0x7f2e480b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 -- 172.21.15.144:0/3374598661 >> 172.21.15.144:0/3374598661 conn(0x7f2e4806d0d0 msgr2=0x7f2e4806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:46.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 -- 172.21.15.144:0/3374598661 shutdown_connections 2024-09-12T12:17:46.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 -- 172.21.15.144:0/3374598661 wait complete. 2024-09-12T12:17:46.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 Processor -- start 2024-09-12T12:17:46.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 -- start start 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48071960 0x7f2e481fb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e480b3ad0 0x7f2e4815e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4815b4e0 0x7f2e48148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4815f270 con 0x7f2e48071960 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4815f0f0 con 0x7f2e4815b4e0 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e4e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4815f3f0 con 0x7f2e480b3ad0 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e47400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48071960 0x7f2e481fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e47400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48071960 0x7f2e481fb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52692/0 (socket says 172.21.15.144:52692) 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e47400640 1 -- 172.21.15.144:0/2174589336 learned_addr learned my addr 172.21.15.144:0/2174589336 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e46a00640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e480b3ad0 0x7f2e4815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e47e00640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4815b4e0 0x7f2e48148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e47400640 1 -- 172.21.15.144:0/2174589336 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e480b3ad0 msgr2=0x7f2e4815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e47400640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e480b3ad0 0x7f2e4815e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e47400640 1 -- 172.21.15.144:0/2174589336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4815b4e0 msgr2=0x7f2e48148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e47400640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4815b4e0 0x7f2e48148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.418+0000 7f2e47400640 1 -- 172.21.15.144:0/2174589336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4815ea60 con 0x7f2e48071960 2024-09-12T12:17:46.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e47400640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48071960 0x7f2e481fb090 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c7f0 tx=0x7f2e3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:46.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e3f400640 1 -- 172.21.15.144:0/2174589336 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38015070 con 0x7f2e48071960 2024-09-12T12:17:46.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e3f400640 1 -- 172.21.15.144:0/2174589336 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e38007820 con 0x7f2e48071960 2024-09-12T12:17:46.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e3f400640 1 -- 172.21.15.144:0/2174589336 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38007c10 con 0x7f2e48071960 2024-09-12T12:17:46.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e481fb670 con 0x7f2e48071960 2024-09-12T12:17:46.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e481fbc30 con 0x7f2e48071960 2024-09-12T12:17:46.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e48071420 con 0x7f2e48071960 2024-09-12T12:17:46.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e3f400640 1 -- 172.21.15.144:0/2174589336 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e38018070 con 0x7f2e48071960 2024-09-12T12:17:46.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e3f400640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e280678f0 0x7f2e28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e3f400640 1 -- 172.21.15.144:0/2174589336 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5421+0+0 (secure 0 0 0) 0x7f2e38085be0 con 0x7f2e48071960 2024-09-12T12:17:46.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.422+0000 7f2e46a00640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e280678f0 0x7f2e28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.426+0000 7f2e46a00640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e280678f0 0x7f2e28069db0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2e340ae000 tx=0x7f2e34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:46.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.426+0000 7f2e3f400640 1 -- 172.21.15.144:0/2174589336 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2e38056150 con 0x7f2e48071960 2024-09-12T12:17:46.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:46.594+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2e4814c740 con 0x7f2e48071960 2024-09-12T12:17:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.130+0000 7f2e3f400640 1 -- 172.21.15.144:0/2174589336 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v92) ==== 97+0+0 (secure 0 0 0) 0x7f2e3805a450 con 0x7f2e48071960 2024-09-12T12:17:47.135 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:17:47.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e280678f0 msgr2=0x7f2e28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e280678f0 0x7f2e28069db0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2e340ae000 tx=0x7f2e34008040 comp rx=0 tx=0).stop 2024-09-12T12:17:47.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48071960 msgr2=0x7f2e481fb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48071960 0x7f2e481fb090 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c7f0 tx=0x7f2e3800ccb0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 shutdown_connections 2024-09-12T12:17:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e280678f0 0x7f2e28069db0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4815b4e0 0x7f2e48148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e480b3ad0 0x7f2e4815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 --2- 172.21.15.144:0/2174589336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e48071960 0x7f2e481fb090 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 >> 172.21.15.144:0/2174589336 conn(0x7f2e4806d0d0 msgr2=0x7f2e480af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 shutdown_connections 2024-09-12T12:17:47.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.134+0000 7f2e4e800640 1 -- 172.21.15.144:0/2174589336 wait complete. 2024-09-12T12:17:47.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:17:47.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.294+0000 7f2180000640 1 Processor -- start 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.294+0000 7f2180000640 1 -- start start 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f2180000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f21780afd50 0x7f217806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f2180000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2178073010 0x7f217806e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f2180000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21780d1000 con 0x7f21780b6360 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f2180000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f21780b2ea0 con 0x7f2178073010 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f2180000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f21780b0130 con 0x7f21780afd50 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f217cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2178073010 0x7f217806e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f217e000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f21780b6360 0x7f2178174200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47728/0 (socket says 172.21.15.144:47728) 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f217e000640 1 -- 172.21.15.144:0/811034991 learned_addr learned my addr 172.21.15.144:0/811034991 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f2177e00640 1 -- 172.21.15.144:0/811034991 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194765393 0 0) 0x7f21780d1000 con 0x7f21780b6360 2024-09-12T12:17:47.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.298+0000 7f217d600640 1 --2- 172.21.15.144:0/811034991 >> v2:172.21.15.165:3300/0 conn(0x7f21780afd50 0x7f217806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.302+0000 7f2177e00640 1 -- 172.21.15.144:0/811034991 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2160003510 con 0x7f21780b6360 2024-09-12T12:17:47.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.302+0000 7f217cc00640 1 -- 172.21.15.144:0/811034991 >> v2:172.21.15.165:3300/0 conn(0x7f21780afd50 msgr2=0x7f217806f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:47.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.302+0000 7f217cc00640 1 --2- 172.21.15.144:0/811034991 >> v2:172.21.15.165:3300/0 conn(0x7f21780afd50 0x7f217806f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.302+0000 7f217cc00640 1 -- 172.21.15.144:0/811034991 >> v1:172.21.15.144:6789/0 conn(0x7f21780b6360 legacy=0x7f2178174200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.302+0000 7f2177e00640 1 -- 172.21.15.144:0/811034991 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3808665138 0 0) 0x7f2160003510 con 0x7f21780b6360 2024-09-12T12:17:47.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.302+0000 7f217cc00640 1 -- 172.21.15.144:0/811034991 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21780d12a0 con 0x7f2178073010 2024-09-12T12:17:47.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f217cc00640 1 --2- 172.21.15.144:0/811034991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2178073010 0x7f217806e810 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f21780b3350 tx=0x7f216401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6c8dfa2e0bbdf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:47.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2177e00640 1 -- 172.21.15.144:0/811034991 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21640b0070 con 0x7f2178073010 2024-09-12T12:17:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2177e00640 1 -- 172.21.15.144:0/811034991 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21640089e0 con 0x7f2178073010 2024-09-12T12:17:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2177e00640 1 -- 172.21.15.144:0/811034991 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170001a00 con 0x7f2178073010 2024-09-12T12:17:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2180000640 1 -- 172.21.15.144:0/811034991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2178073010 msgr2=0x7f217806e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2180000640 1 --2- 172.21.15.144:0/811034991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2178073010 0x7f217806e810 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f21780b3350 tx=0x7f216401c2d0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2180000640 1 -- 172.21.15.144:0/811034991 shutdown_connections 2024-09-12T12:17:47.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2180000640 1 --2- 172.21.15.144:0/811034991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2178073010 0x7f217806e810 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2180000640 1 --2- 172.21.15.144:0/811034991 >> v2:172.21.15.165:3300/0 conn(0x7f21780afd50 0x7f217806f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2180000640 1 -- 172.21.15.144:0/811034991 >> 172.21.15.144:0/811034991 conn(0x7f21780d04e0 msgr2=0x7f21780d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:47.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2180000640 1 -- 172.21.15.144:0/811034991 shutdown_connections 2024-09-12T12:17:47.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.306+0000 7f2180000640 1 -- 172.21.15.144:0/811034991 wait complete. 2024-09-12T12:17:47.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 Processor -- start 2024-09-12T12:17:47.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 -- start start 2024-09-12T12:17:47.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2178073010 0x7f217816b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21780afd50 0x7f2178161e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b6360 0x7f2178160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21781782c0 con 0x7f21780b6360 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2178178140 con 0x7f2178073010 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2178178440 con 0x7f21780afd50 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b6360 0x7f2178160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b6360 0x7f2178160000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53092/0 (socket says 172.21.15.144:53092) 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217e000640 1 -- 172.21.15.144:0/2474693469 learned_addr learned my addr 172.21.15.144:0/2474693469 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217d600640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2178073010 0x7f217816b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217cc00640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21780afd50 0x7f2178161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217e000640 1 -- 172.21.15.144:0/2474693469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21780afd50 msgr2=0x7f2178161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217e000640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21780afd50 0x7f2178161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217e000640 1 -- 172.21.15.144:0/2474693469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2178073010 msgr2=0x7f217816b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217e000640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2178073010 0x7f217816b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217e000640 1 -- 172.21.15.144:0/2474693469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2178165bf0 con 0x7f21780b6360 2024-09-12T12:17:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217cc00640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21780afd50 0x7f2178161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f217e000640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b6360 0x7f2178160000 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f21700018a0 tx=0x7f217000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2175600640 1 -- 172.21.15.144:0/2474693469 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2170012400 con 0x7f21780b6360 2024-09-12T12:17:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2175600640 1 -- 172.21.15.144:0/2474693469 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21700125c0 con 0x7f21780b6360 2024-09-12T12:17:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2175600640 1 -- 172.21.15.144:0/2474693469 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21700129b0 con 0x7f21780b6360 2024-09-12T12:17:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2178165ed0 con 0x7f21780b6360 2024-09-12T12:17:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.310+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2178166490 con 0x7f21780b6360 2024-09-12T12:17:47.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.314+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f217806e810 con 0x7f21780b6360 2024-09-12T12:17:47.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.314+0000 7f2175600640 1 -- 172.21.15.144:0/2474693469 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2170012b50 con 0x7f21780b6360 2024-09-12T12:17:47.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.314+0000 7f2175600640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21580678f0 0x7f2158069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.314+0000 7f2175600640 1 -- 172.21.15.144:0/2474693469 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7f2170086310 con 0x7f21780b6360 2024-09-12T12:17:47.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.314+0000 7f217d600640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21580678f0 0x7f2158069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.314+0000 7f217d600640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21580678f0 0x7f2158069db0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2178168200 tx=0x7f216c0083b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:47.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.318+0000 7f2175600640 1 -- 172.21.15.144:0/2474693469 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2170057000 con 0x7f21780b6360 2024-09-12T12:17:47.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.530+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2178168890 con 0x7f21780b6360 2024-09-12T12:17:47.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.530+0000 7f2175600640 1 -- 172.21.15.144:0/2474693469 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f2170056900 con 0x7f21780b6360 2024-09-12T12:17:47.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:47.534 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:17:47.534 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:17:47.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:17:47.535 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:17:47.536 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:47.537 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:17:47.539 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:17:47.541 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:17:47.542 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.542 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:47.542 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:47.542 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.543 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:17:47.545 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:17:47.546 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:17:47.548 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:17:47.549 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:17:47.549 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:17:47.549 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:17:47.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:17:47.549 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:17:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21580678f0 msgr2=0x7f2158069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21580678f0 0x7f2158069db0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2178168200 tx=0x7f216c0083b0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b6360 msgr2=0x7f2178160000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b6360 0x7f2178160000 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f21700018a0 tx=0x7f217000a430 comp rx=0 tx=0).stop 2024-09-12T12:17:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 shutdown_connections 2024-09-12T12:17:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f21580678f0 0x7f2158069db0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21780b6360 0x7f2178160000 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21780afd50 0x7f2178161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 --2- 172.21.15.144:0/2474693469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2178073010 0x7f217816b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 >> 172.21.15.144:0/2474693469 conn(0x7f21780d04e0 msgr2=0x7f21780cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 shutdown_connections 2024-09-12T12:17:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.534+0000 7f2180000640 1 -- 172.21.15.144:0/2474693469 wait complete. 2024-09-12T12:17:47.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:17:47.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd03c600640 1 Processor -- start 2024-09-12T12:17:47.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd03c600640 1 -- start start 2024-09-12T12:17:47.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd03c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd03415b4e0 0x7fd0340b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd03c600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0340b45a0 con 0x7fd0340ccf30 2024-09-12T12:17:47.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd03c600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0340b3fe0 con 0x7fd0340b3ad0 2024-09-12T12:17:47.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd03c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd0340b42c0 con 0x7fd03415b4e0 2024-09-12T12:17:47.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd03a600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd0340ccf30 0x7fd0340b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47744/0 (socket says 172.21.15.144:47744) 2024-09-12T12:17:47.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd03a600640 1 -- 172.21.15.144:0/956037708 learned_addr learned my addr 172.21.15.144:0/956037708 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:47.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd039c00640 1 --2- 172.21.15.144:0/956037708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd03415b4e0 0x7fd0340b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd033e00640 1 -- 172.21.15.144:0/956037708 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996680819 0 0) 0x7fd0340b45a0 con 0x7fd0340ccf30 2024-09-12T12:17:47.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd033e00640 1 -- 172.21.15.144:0/956037708 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd01c005740 con 0x7fd0340ccf30 2024-09-12T12:17:47.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd033e00640 1 -- 172.21.15.144:0/956037708 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211127738 0 0) 0x7fd0340b3fe0 con 0x7fd0340b3ad0 2024-09-12T12:17:47.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd039c00640 1 -- 172.21.15.144:0/956037708 >> v1:172.21.15.165:6789/0 conn(0x7fd0340b3ad0 legacy=0x7fd034071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd039c00640 1 -- 172.21.15.144:0/956037708 >> v1:172.21.15.144:6789/0 conn(0x7fd0340ccf30 legacy=0x7fd0340b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.690+0000 7fd039c00640 1 -- 172.21.15.144:0/956037708 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0340b1490 con 0x7fd03415b4e0 2024-09-12T12:17:47.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd039c00640 1 --2- 172.21.15.144:0/956037708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd03415b4e0 0x7fd0340b3590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd028009dc0 tx=0x7fd02801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b1f541cbf1a3964 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:47.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd033e00640 1 -- 172.21.15.144:0/956037708 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280b2070 con 0x7fd03415b4e0 2024-09-12T12:17:47.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd033e00640 1 -- 172.21.15.144:0/956037708 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0280a5880 con 0x7fd03415b4e0 2024-09-12T12:17:47.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd033e00640 1 -- 172.21.15.144:0/956037708 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280a5c30 con 0x7fd03415b4e0 2024-09-12T12:17:47.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd03c600640 1 -- 172.21.15.144:0/956037708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd03415b4e0 msgr2=0x7fd0340b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd03c600640 1 --2- 172.21.15.144:0/956037708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd03415b4e0 0x7fd0340b3590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd028009dc0 tx=0x7fd02801c960 comp rx=0 tx=0).stop 2024-09-12T12:17:47.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd03c600640 1 -- 172.21.15.144:0/956037708 shutdown_connections 2024-09-12T12:17:47.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd03c600640 1 --2- 172.21.15.144:0/956037708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd03415b4e0 0x7fd0340b3590 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd03c600640 1 -- 172.21.15.144:0/956037708 >> 172.21.15.144:0/956037708 conn(0x7fd03406d0d0 msgr2=0x7fd03406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:47.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd03c600640 1 -- 172.21.15.144:0/956037708 shutdown_connections 2024-09-12T12:17:47.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.694+0000 7fd03c600640 1 -- 172.21.15.144:0/956037708 wait complete. 2024-09-12T12:17:47.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 Processor -- start 2024-09-12T12:17:47.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 -- start start 2024-09-12T12:17:47.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0340b3ad0 0x7fd0341f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0340ccf30 0x7fd034145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd03415b4e0 0x7fd0340b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd03415b8c0 con 0x7fd03415b4e0 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0340cd770 con 0x7fd0340ccf30 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd03415c680 con 0x7fd0340b3ad0 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd03415b4e0 0x7fd0340b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd03415b4e0 0x7fd0340b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53108/0 (socket says 172.21.15.144:53108) 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03a600640 1 -- 172.21.15.144:0/1826025032 learned_addr learned my addr 172.21.15.144:0/1826025032 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd039c00640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0340b3ad0 0x7fd0341f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd039200640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0340ccf30 0x7fd034145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03a600640 1 -- 172.21.15.144:0/1826025032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0340b3ad0 msgr2=0x7fd0341f76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03a600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0340b3ad0 0x7fd0341f76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03a600640 1 -- 172.21.15.144:0/1826025032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0340ccf30 msgr2=0x7fd034145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03a600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0340ccf30 0x7fd034145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03a600640 1 -- 172.21.15.144:0/1826025032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03415c960 con 0x7fd03415b4e0 2024-09-12T12:17:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03a600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd03415b4e0 0x7fd0340b4b70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00c450 tx=0x7fd02c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd031600640 1 -- 172.21.15.144:0/1826025032 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c017070 con 0x7fd03415b4e0 2024-09-12T12:17:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd031600640 1 -- 172.21.15.144:0/1826025032 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02c005cf0 con 0x7fd03415b4e0 2024-09-12T12:17:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd031600640 1 -- 172.21.15.144:0/1826025032 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c0072b0 con 0x7fd03415b4e0 2024-09-12T12:17:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03415cc40 con 0x7fd03415b4e0 2024-09-12T12:17:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.698+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03415d200 con 0x7fd03415b4e0 2024-09-12T12:17:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.702+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03415d400 con 0x7fd03415b4e0 2024-09-12T12:17:47.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.702+0000 7fd031600640 1 -- 172.21.15.144:0/1826025032 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd02c007450 con 0x7fd03415b4e0 2024-09-12T12:17:47.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.702+0000 7fd031600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0140678c0 0x7fd014069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:47.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.702+0000 7fd031600640 1 -- 172.21.15.144:0/1826025032 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7fd02c084da0 con 0x7fd03415b4e0 2024-09-12T12:17:47.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.702+0000 7fd039c00640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0140678c0 0x7fd014069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:47.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.702+0000 7fd039c00640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0140678c0 0x7fd014069d80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd0280af000 tx=0x7fd0280a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:47.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.706+0000 7fd031600640 1 -- 172.21.15.144:0/1826025032 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd03415d400 con 0x7fd03415b4e0 2024-09-12T12:17:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.866+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd0340b3590 con 0x7fd03415b4e0 2024-09-12T12:17:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.866+0000 7fd031600640 1 -- 172.21.15.144:0/1826025032 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) ==== 84+0+65 (secure 0 0 0) 0x7fd02c007740 con 0x7fd03415b4e0 2024-09-12T12:17:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:47.871 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:17:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:17:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:17:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:17:47.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:17:47.871 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0140678c0 msgr2=0x7fd014069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0140678c0 0x7fd014069d80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd0280af000 tx=0x7fd0280a7070 comp rx=0 tx=0).stop 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd03415b4e0 msgr2=0x7fd0340b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd03415b4e0 0x7fd0340b4b70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00c450 tx=0x7fd02c00c910 comp rx=0 tx=0).stop 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 shutdown_connections 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0140678c0 0x7fd014069d80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd03415b4e0 0x7fd0340b4b70 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0340ccf30 0x7fd034145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 --2- 172.21.15.144:0/1826025032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0340b3ad0 0x7fd0341f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 >> 172.21.15.144:0/1826025032 conn(0x7fd03406d0d0 msgr2=0x7fd03415a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 shutdown_connections 2024-09-12T12:17:47.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:47.870+0000 7fd03c600640 1 -- 172.21.15.144:0/1826025032 wait complete. 2024-09-12T12:17:47.891 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:17:47.891 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:17:48.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b2ee00640 1 Processor -- start 2024-09-12T12:17:48.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b2ee00640 1 -- start start 2024-09-12T12:17:48.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b2ee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9b28156c10 0x7f9b28072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:48.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b2ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b2806cff0 0x7f9b2806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:48.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b2ee00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2806cd20 con 0x7f9b28073360 2024-09-12T12:17:48.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b2ee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9b2806d990 con 0x7f9b28156c10 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b2ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9b28071be0 con 0x7f9b2806cff0 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b27e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9b28156c10 0x7f9b28072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b2ce00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9b28073360 0x7f9b2815de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47752/0 (socket says 172.21.15.144:47752) 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b2ce00640 1 -- 172.21.15.144:0/3057164134 learned_addr learned my addr 172.21.15.144:0/3057164134 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b27e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9b28156c10 0x7f9b28072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53116/0 (socket says 172.21.15.144:53116) 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b27400640 1 --2- 172.21.15.144:0/3057164134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b2806cff0 0x7f9b2806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b27e00640 1 -- 172.21.15.144:0/3057164134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b2806cff0 msgr2=0x7f9b2806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b27e00640 1 --2- 172.21.15.144:0/3057164134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b2806cff0 0x7f9b2806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b27e00640 1 -- 172.21.15.144:0/3057164134 >> v1:172.21.15.144:6789/0 conn(0x7f9b28073360 legacy=0x7f9b2815de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b27e00640 1 -- 172.21.15.144:0/3057164134 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b280712b0 con 0x7f9b28156c10 2024-09-12T12:17:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.030+0000 7f9b26a00640 1 -- 172.21.15.144:0/3057164134 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48811630 0 0) 0x7f9b2806cd20 con 0x7f9b28073360 2024-09-12T12:17:48.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b27e00640 1 --2- 172.21.15.144:0/3057164134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b28156c10 0x7f9b28072070 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9b180097c0 tx=0x7f9b1801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec643a1f9ed2cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:48.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b26a00640 1 -- 172.21.15.144:0/3057164134 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b180aa600 con 0x7f9b28156c10 2024-09-12T12:17:48.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b26a00640 1 -- 172.21.15.144:0/3057164134 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b180af070 con 0x7f9b28156c10 2024-09-12T12:17:48.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b26a00640 1 -- 172.21.15.144:0/3057164134 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b180aa9c0 con 0x7f9b28156c10 2024-09-12T12:17:48.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b2ee00640 1 -- 172.21.15.144:0/3057164134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b28156c10 msgr2=0x7f9b28072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:48.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b2ee00640 1 --2- 172.21.15.144:0/3057164134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b28156c10 0x7f9b28072070 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9b180097c0 tx=0x7f9b1801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b2ee00640 1 -- 172.21.15.144:0/3057164134 shutdown_connections 2024-09-12T12:17:48.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b2ee00640 1 --2- 172.21.15.144:0/3057164134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b2806cff0 0x7f9b2806d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b2ee00640 1 --2- 172.21.15.144:0/3057164134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b28156c10 0x7f9b28072070 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b2ee00640 1 -- 172.21.15.144:0/3057164134 >> 172.21.15.144:0/3057164134 conn(0x7f9b2806bc10 msgr2=0x7f9b2806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:48.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b2ee00640 1 -- 172.21.15.144:0/3057164134 shutdown_connections 2024-09-12T12:17:48.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b2ee00640 1 -- 172.21.15.144:0/3057164134 wait complete. 2024-09-12T12:17:48.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.034+0000 7f9b2ee00640 1 Processor -- start 2024-09-12T12:17:48.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 -- start start 2024-09-12T12:17:48.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2806cff0 0x7f9b28159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:48.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b28073360 0x7f9b28147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b28156c10 0x7f9b28154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9b28156ff0 con 0x7f9b2806cff0 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9b28073be0 con 0x7f9b28156c10 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9b28157170 con 0x7f9b28073360 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2806cff0 0x7f9b28159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2806cff0 0x7f9b28159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53124/0 (socket says 172.21.15.144:53124) 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27e00640 1 -- 172.21.15.144:0/2019789555 learned_addr learned my addr 172.21.15.144:0/2019789555 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27400640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b28073360 0x7f9b28147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ce00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b28156c10 0x7f9b28154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27e00640 1 -- 172.21.15.144:0/2019789555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b28073360 msgr2=0x7f9b28147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27e00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b28073360 0x7f9b28147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27e00640 1 -- 172.21.15.144:0/2019789555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b28156c10 msgr2=0x7f9b28154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:48.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27e00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b28156c10 0x7f9b28154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27e00640 1 -- 172.21.15.144:0/2019789555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b281591e0 con 0x7f9b2806cff0 2024-09-12T12:17:48.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27400640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b28073360 0x7f9b28147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:48.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b27e00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2806cff0 0x7f9b28159ea0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f9b180ac040 tx=0x7f9b1801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:48.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b1fe00640 1 -- 172.21.15.144:0/2019789555 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18006e20 con 0x7f9b2806cff0 2024-09-12T12:17:48.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b1fe00640 1 -- 172.21.15.144:0/2019789555 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b18004230 con 0x7f9b2806cff0 2024-09-12T12:17:48.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b1fe00640 1 -- 172.21.15.144:0/2019789555 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18003620 con 0x7f9b2806cff0 2024-09-12T12:17:48.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b28153660 con 0x7f9b2806cff0 2024-09-12T12:17:48.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b28158d70 con 0x7f9b2806cff0 2024-09-12T12:17:48.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.038+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b28153480 con 0x7f9b2806cff0 2024-09-12T12:17:48.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.042+0000 7f9b1fe00640 1 -- 172.21.15.144:0/2019789555 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b180a9070 con 0x7f9b2806cff0 2024-09-12T12:17:48.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.042+0000 7f9b1fe00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b080678f0 0x7f9b08069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:48.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.042+0000 7f9b1fe00640 1 -- 172.21.15.144:0/2019789555 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7f9b1811fdb0 con 0x7f9b2806cff0 2024-09-12T12:17:48.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.042+0000 7f9b27400640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b080678f0 0x7f9b08069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:48.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.042+0000 7f9b27400640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b080678f0 0x7f9b08069db0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9b2815a3e0 tx=0x7f9b14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:48.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.046+0000 7f9b1fe00640 1 -- 172.21.15.144:0/2019789555 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9b28153480 con 0x7f9b2806cff0 2024-09-12T12:17:48.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:48.214+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9b2806d450 con 0x7f9b2806cff0 2024-09-12T12:17:49.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.146+0000 7f9b1fe00640 1 -- 172.21.15.144:0/2019789555 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) ==== 138+0+0 (secure 0 0 0) 0x7f9b18124070 con 0x7f9b2806cff0 2024-09-12T12:17:49.148 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:17:49.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b080678f0 msgr2=0x7f9b08069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b080678f0 0x7f9b08069db0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9b2815a3e0 tx=0x7f9b14008040 comp rx=0 tx=0).stop 2024-09-12T12:17:49.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2806cff0 msgr2=0x7f9b28159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2806cff0 0x7f9b28159ea0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f9b180ac040 tx=0x7f9b1801ace0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 shutdown_connections 2024-09-12T12:17:49.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b080678f0 0x7f9b08069db0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b28156c10 0x7f9b28154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b28073360 0x7f9b28147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 --2- 172.21.15.144:0/2019789555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b2806cff0 0x7f9b28159ea0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 >> 172.21.15.144:0/2019789555 conn(0x7f9b2806bc10 msgr2=0x7f9b280d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:49.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 shutdown_connections 2024-09-12T12:17:49.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.150+0000 7f9b2ee00640 1 -- 172.21.15.144:0/2019789555 wait complete. 2024-09-12T12:17:49.178 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:17:49.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e45200640 1 Processor -- start 2024-09-12T12:17:49.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e45200640 1 -- start start 2024-09-12T12:17:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e45200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e400cd9f0 0x7f0e4006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e45200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e400b4300 con 0x7f0e4015b340 2024-09-12T12:17:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e45200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e400b3540 con 0x7f0e4015af60 2024-09-12T12:17:49.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e45200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0e400b32f0 con 0x7f0e400cd9f0 2024-09-12T12:17:49.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e37e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e400cd9f0 0x7f0e4006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:49.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e37e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e400cd9f0 0x7f0e4006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53126/0 (socket says 172.21.15.144:53126) 2024-09-12T12:17:49.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e3e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0e4015b340 0x7f0e400b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47762/0 (socket says 172.21.15.144:47762) 2024-09-12T12:17:49.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e37e00640 1 -- 172.21.15.144:0/3254976910 learned_addr learned my addr 172.21.15.144:0/3254976910 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:49.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e37e00640 1 -- 172.21.15.144:0/3254976910 >> v1:172.21.15.165:6789/0 conn(0x7f0e4015af60 legacy=0x7f0e400ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e37e00640 1 -- 172.21.15.144:0/3254976910 >> v1:172.21.15.144:6789/0 conn(0x7f0e4015b340 legacy=0x7f0e400b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e37e00640 1 -- 172.21.15.144:0/3254976910 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e400b3820 con 0x7f0e400cd9f0 2024-09-12T12:17:49.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.322+0000 7f0e3d400640 1 -- 172.21.15.144:0/3254976910 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275846329 0 0) 0x7f0e400b4300 con 0x7f0e4015b340 2024-09-12T12:17:49.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e37e00640 1 --2- 172.21.15.144:0/3254976910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e400cd9f0 0x7f0e4006bc10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009870 tx=0x7f0e2801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5082b80ca9f8f24b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:49.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e3d400640 1 -- 172.21.15.144:0/3254976910 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b2070 con 0x7f0e400cd9f0 2024-09-12T12:17:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e3d400640 1 -- 172.21.15.144:0/3254976910 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e280a9070 con 0x7f0e400cd9f0 2024-09-12T12:17:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e3d400640 1 -- 172.21.15.144:0/3254976910 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280ad880 con 0x7f0e400cd9f0 2024-09-12T12:17:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e45200640 1 -- 172.21.15.144:0/3254976910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e400cd9f0 msgr2=0x7f0e4006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e45200640 1 --2- 172.21.15.144:0/3254976910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e400cd9f0 0x7f0e4006bc10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009870 tx=0x7f0e2801c560 comp rx=0 tx=0).stop 2024-09-12T12:17:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e45200640 1 -- 172.21.15.144:0/3254976910 shutdown_connections 2024-09-12T12:17:49.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e45200640 1 --2- 172.21.15.144:0/3254976910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e400cd9f0 0x7f0e4006bc10 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e45200640 1 -- 172.21.15.144:0/3254976910 >> 172.21.15.144:0/3254976910 conn(0x7f0e40068030 msgr2=0x7f0e400b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:49.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e45200640 1 -- 172.21.15.144:0/3254976910 shutdown_connections 2024-09-12T12:17:49.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.326+0000 7f0e45200640 1 -- 172.21.15.144:0/3254976910 wait complete. 2024-09-12T12:17:49.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 Processor -- start 2024-09-12T12:17:49.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 -- start start 2024-09-12T12:17:49.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e400cd9f0 0x7f0e4014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:49.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4015af60 0x7f0e40159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:49.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e4015b340 0x7f0e4014b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0e40169120 con 0x7f0e4015af60 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4006c560 con 0x7f0e4015b340 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0e401692a0 con 0x7f0e400cd9f0 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e37e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4015af60 0x7f0e40159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e37e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4015af60 0x7f0e40159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53128/0 (socket says 172.21.15.144:53128) 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e37e00640 1 -- 172.21.15.144:0/3117562805 learned_addr learned my addr 172.21.15.144:0/3117562805 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:49.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e3de00640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e400cd9f0 0x7f0e4014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e3e800640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e4015b340 0x7f0e4014b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e37e00640 1 -- 172.21.15.144:0/3117562805 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e400cd9f0 msgr2=0x7f0e4014ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e37e00640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e400cd9f0 0x7f0e4014ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e37e00640 1 -- 172.21.15.144:0/3117562805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e4015b340 msgr2=0x7f0e4014b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e37e00640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e4015b340 0x7f0e4014b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e37e00640 1 -- 172.21.15.144:0/3117562805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e401f80a0 con 0x7f0e4015af60 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e37e00640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4015af60 0x7f0e40159b40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009870 tx=0x7f0e2801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e36000640 1 -- 172.21.15.144:0/3117562805 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b2040 con 0x7f0e4015af60 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e36000640 1 -- 172.21.15.144:0/3117562805 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e280addd0 con 0x7f0e4015af60 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e36000640 1 -- 172.21.15.144:0/3117562805 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28004230 con 0x7f0e4015af60 2024-09-12T12:17:49.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4015a390 con 0x7f0e4015af60 2024-09-12T12:17:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e401f8610 con 0x7f0e4015af60 2024-09-12T12:17:49.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.330+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e4006bc10 con 0x7f0e4015af60 2024-09-12T12:17:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.334+0000 7f0e36000640 1 -- 172.21.15.144:0/3117562805 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e280ab070 con 0x7f0e4015af60 2024-09-12T12:17:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.334+0000 7f0e36000640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e1c0678c0 0x7f0e1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.334+0000 7f0e36000640 1 -- 172.21.15.144:0/3117562805 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5619+0+0 (secure 0 0 0) 0x7f0e28120940 con 0x7f0e4015af60 2024-09-12T12:17:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.334+0000 7f0e3de00640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e1c0678c0 0x7f0e1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:49.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.334+0000 7f0e3de00640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e1c0678c0 0x7f0e1c069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000f70 tx=0x7f0e30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:49.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.338+0000 7f0e36000640 1 -- 172.21.15.144:0/3117562805 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e28016150 con 0x7f0e4015af60 2024-09-12T12:17:49.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:49.498+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0e4015f870 con 0x7f0e4015af60 2024-09-12T12:17:50.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.150+0000 7f0e36000640 1 -- 172.21.15.144:0/3117562805 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) ==== 170+0+0 (secure 0 0 0) 0x7f0e280b7380 con 0x7f0e4015af60 2024-09-12T12:17:50.154 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:17:50.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e1c0678c0 msgr2=0x7f0e1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:50.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e1c0678c0 0x7f0e1c069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000f70 tx=0x7f0e30009040 comp rx=0 tx=0).stop 2024-09-12T12:17:50.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4015af60 msgr2=0x7f0e40159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:50.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4015af60 0x7f0e40159b40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009870 tx=0x7f0e2801ada0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 shutdown_connections 2024-09-12T12:17:50.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e1c0678c0 0x7f0e1c069d80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e4015b340 0x7f0e4014b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4015af60 0x7f0e40159b40 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 --2- 172.21.15.144:0/3117562805 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e400cd9f0 0x7f0e4014ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 >> 172.21.15.144:0/3117562805 conn(0x7f0e40068030 msgr2=0x7f0e400b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:50.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 shutdown_connections 2024-09-12T12:17:50.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.154+0000 7f0e45200640 1 -- 172.21.15.144:0/3117562805 wait complete. 2024-09-12T12:17:50.191 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:17:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.326+0000 7fadcbc00640 1 Processor -- start 2024-09-12T12:17:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.326+0000 7fadcbc00640 1 -- start start 2024-09-12T12:17:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.326+0000 7fadcbc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fadc415af60 0x7fadc40ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.326+0000 7fadcbc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc40b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.326+0000 7fadcbc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc40b4300 con 0x7fadc40cd9f0 2024-09-12T12:17:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.326+0000 7fadcbc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fadc40b32f0 con 0x7fadc415af60 2024-09-12T12:17:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.326+0000 7fadcbc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fadc40b3540 con 0x7fadc406c320 2024-09-12T12:17:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc3e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fadc40cd9f0 0x7fadc406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:55816/0 (socket says 172.21.15.144:55816) 2024-09-12T12:17:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc3e00640 1 -- 172.21.15.144:0/2796393199 learned_addr learned my addr 172.21.15.144:0/2796393199 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc9200640 1 --2- 172.21.15.144:0/2796393199 >> v2:172.21.15.165:3300/0 conn(0x7fadc415af60 0x7fadc40ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc9c00640 1 --2- 172.21.15.144:0/2796393199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc40b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc3400640 1 -- 172.21.15.144:0/2796393199 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821405566 0 0) 0x7fadc40b4300 con 0x7fadc40cd9f0 2024-09-12T12:17:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc3400640 1 -- 172.21.15.144:0/2796393199 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada8003530 con 0x7fadc40cd9f0 2024-09-12T12:17:50.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc9200640 1 -- 172.21.15.144:0/2796393199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 msgr2=0x7fadc40b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:50.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc9200640 1 --2- 172.21.15.144:0/2796393199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc40b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc9200640 1 -- 172.21.15.144:0/2796393199 >> v1:172.21.15.165:6789/0 conn(0x7fadc40cd9f0 legacy=0x7fadc406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:50.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc9200640 1 -- 172.21.15.144:0/2796393199 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc40b3820 con 0x7fadc415af60 2024-09-12T12:17:50.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.330+0000 7fadc9200640 1 --2- 172.21.15.144:0/2796393199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc415af60 0x7fadc40ce680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fadb40097c0 tx=0x7fadb401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b48fb591bb77ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:50.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadc3400640 1 -- 172.21.15.144:0/2796393199 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb40b2070 con 0x7fadc415af60 2024-09-12T12:17:50.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadc3400640 1 -- 172.21.15.144:0/2796393199 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb40ad640 con 0x7fadc415af60 2024-09-12T12:17:50.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadc3400640 1 -- 172.21.15.144:0/2796393199 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb40ada10 con 0x7fadc415af60 2024-09-12T12:17:50.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 -- 172.21.15.144:0/2796393199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc415af60 msgr2=0x7fadc40ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:50.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 --2- 172.21.15.144:0/2796393199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc415af60 0x7fadc40ce680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fadb40097c0 tx=0x7fadb401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 -- 172.21.15.144:0/2796393199 shutdown_connections 2024-09-12T12:17:50.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 --2- 172.21.15.144:0/2796393199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc40b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 --2- 172.21.15.144:0/2796393199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc415af60 0x7fadc40ce680 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 -- 172.21.15.144:0/2796393199 >> 172.21.15.144:0/2796393199 conn(0x7fadc4068030 msgr2=0x7fadc40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:50.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 -- 172.21.15.144:0/2796393199 shutdown_connections 2024-09-12T12:17:50.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 -- 172.21.15.144:0/2796393199 wait complete. 2024-09-12T12:17:50.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 Processor -- start 2024-09-12T12:17:50.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 -- start start 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc41438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc40cd9f0 0x7fadc41449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc415af60 0x7fadc415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40b5430 con 0x7fadc415af60 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40b52b0 con 0x7fadc40cd9f0 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadcbc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fadc40b55b0 con 0x7fadc406c320 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadc3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc40cd9f0 0x7fadc41449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadc9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc41438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadc9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc41438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:57532/0 (socket says 172.21.15.144:57532) 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadc9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc415af60 0x7fadc415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.334+0000 7fadc9200640 1 -- 172.21.15.144:0/3529551863 learned_addr learned my addr 172.21.15.144:0/3529551863 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc9200640 1 -- 172.21.15.144:0/3529551863 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc40cd9f0 msgr2=0x7fadc41449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc9200640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc40cd9f0 0x7fadc41449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc9200640 1 -- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc415af60 msgr2=0x7fadc415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc9200640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc415af60 0x7fadc415d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc9200640 1 -- 172.21.15.144:0/3529551863 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc4147710 con 0x7fadc406c320 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc9c00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc415af60 0x7fadc415d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc3e00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc40cd9f0 0x7fadc41449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc9200640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc41438c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fadb40b0040 tx=0x7fadb4019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc0c00640 1 -- 172.21.15.144:0/3529551863 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb40b2040 con 0x7fadc406c320 2024-09-12T12:17:50.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc0c00640 1 -- 172.21.15.144:0/3529551863 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb40bc070 con 0x7fadc406c320 2024-09-12T12:17:50.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc41479f0 con 0x7fadc406c320 2024-09-12T12:17:50.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc0c00640 1 -- 172.21.15.144:0/3529551863 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4006e20 con 0x7fadc406c320 2024-09-12T12:17:50.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc4147fb0 con 0x7fadc406c320 2024-09-12T12:17:50.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc40b4560 con 0x7fadc406c320 2024-09-12T12:17:50.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.338+0000 7fadc0c00640 1 -- 172.21.15.144:0/3529551863 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fadb40b6670 con 0x7fadc406c320 2024-09-12T12:17:50.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.342+0000 7fadc0c00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada40678c0 0x7fada4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:50.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.342+0000 7fadc0c00640 1 -- 172.21.15.144:0/3529551863 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(96..96 src has 1..96) ==== 6001+0+0 (secure 0 0 0) 0x7fadb4120600 con 0x7fadc406c320 2024-09-12T12:17:50.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.342+0000 7fadc3e00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada40678c0 0x7fada4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:50.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.342+0000 7fadc3e00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada40678c0 0x7fada4069d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fadc41456a0 tx=0x7fadb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:50.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.342+0000 7fadc0c00640 1 -- 172.21.15.144:0/3529551863 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fadb4016090 con 0x7fadc406c320 2024-09-12T12:17:50.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:50.534+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fadc4145460 con 0x7fadc406c320 2024-09-12T12:17:51.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.162+0000 7fadc0c00640 1 -- 172.21.15.144:0/3529551863 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v66) ==== 174+0+0 (secure 0 0 0) 0x7fadb40f0ac0 con 0x7fadc406c320 2024-09-12T12:17:51.165 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 13 and data pool 14 2024-09-12T12:17:51.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.170+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada40678c0 msgr2=0x7fada4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.170+0000 7fadcbc00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada40678c0 0x7fada4069d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fadc41456a0 tx=0x7fadb0009040 comp rx=0 tx=0).stop 2024-09-12T12:17:51.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.170+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 msgr2=0x7fadc41438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.170+0000 7fadcbc00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc41438c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fadb40b0040 tx=0x7fadb4019240 comp rx=0 tx=0).stop 2024-09-12T12:17:51.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.174+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 shutdown_connections 2024-09-12T12:17:51.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.174+0000 7fadcbc00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada40678c0 0x7fada4069d80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.174+0000 7fadcbc00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc415af60 0x7fadc415d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.174+0000 7fadcbc00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc40cd9f0 0x7fadc41449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.174+0000 7fadcbc00640 1 --2- 172.21.15.144:0/3529551863 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc406c320 0x7fadc41438c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.174+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 >> 172.21.15.144:0/3529551863 conn(0x7fadc4068030 msgr2=0x7fadc40afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:51.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.174+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 shutdown_connections 2024-09-12T12:17:51.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.174+0000 7fadcbc00640 1 -- 172.21.15.144:0/3529551863 wait complete. 2024-09-12T12:17:51.213 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:17:51.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.346+0000 7ff199000640 1 Processor -- start 2024-09-12T12:17:51.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.346+0000 7ff199000640 1 -- start start 2024-09-12T12:17:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.346+0000 7ff199000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415cd30 0x7ff1940b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.346+0000 7ff199000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff1940b5de0 0x7ff194072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.346+0000 7ff199000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1940cd870 con 0x7ff19415c7b0 2024-09-12T12:17:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.346+0000 7ff199000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff194072a50 con 0x7ff1940b5de0 2024-09-12T12:17:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.346+0000 7ff199000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff1940cde30 con 0x7ff19415cd30 2024-09-12T12:17:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.346+0000 7ff192800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff1940b5de0 0x7ff194072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff192800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff1940b5de0 0x7ff194072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53146/0 (socket says 172.21.15.144:53146) 2024-09-12T12:17:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff192800640 1 -- 172.21.15.144:0/3589918076 learned_addr learned my addr 172.21.15.144:0/3589918076 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:51.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff191400640 1 --2- 172.21.15.144:0/3589918076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415cd30 0x7ff1940b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff192800640 1 -- 172.21.15.144:0/3589918076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415cd30 msgr2=0x7ff1940b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:51.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff192800640 1 --2- 172.21.15.144:0/3589918076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415cd30 0x7ff1940b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff192800640 1 -- 172.21.15.144:0/3589918076 >> v1:172.21.15.165:6789/0 conn(0x7ff19415c7b0 legacy=0x7ff1940ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff192800640 1 -- 172.21.15.144:0/3589918076 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1940cdb50 con 0x7ff1940b5de0 2024-09-12T12:17:51.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff192800640 1 --2- 172.21.15.144:0/3589918076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1940b5de0 0x7ff194072ee0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009e50 tx=0x7ff18c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121ca55964e4ec9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:51.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff190a00640 1 -- 172.21.15.144:0/3589918076 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0a5700 con 0x7ff1940b5de0 2024-09-12T12:17:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff190a00640 1 -- 172.21.15.144:0/3589918076 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff18c0a58a0 con 0x7ff1940b5de0 2024-09-12T12:17:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.350+0000 7ff190a00640 1 -- 172.21.15.144:0/3589918076 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0a5c70 con 0x7ff1940b5de0 2024-09-12T12:17:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 -- 172.21.15.144:0/3589918076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1940b5de0 msgr2=0x7ff194072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 --2- 172.21.15.144:0/3589918076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1940b5de0 0x7ff194072ee0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009e50 tx=0x7ff18c01ca30 comp rx=0 tx=0).stop 2024-09-12T12:17:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 -- 172.21.15.144:0/3589918076 shutdown_connections 2024-09-12T12:17:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 --2- 172.21.15.144:0/3589918076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1940b5de0 0x7ff194072ee0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 --2- 172.21.15.144:0/3589918076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415cd30 0x7ff1940b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 -- 172.21.15.144:0/3589918076 >> 172.21.15.144:0/3589918076 conn(0x7ff19406d0d0 msgr2=0x7ff19406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 -- 172.21.15.144:0/3589918076 shutdown_connections 2024-09-12T12:17:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 -- 172.21.15.144:0/3589918076 wait complete. 2024-09-12T12:17:51.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 Processor -- start 2024-09-12T12:17:51.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 -- start start 2024-09-12T12:17:51.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1940b5de0 0x7ff194151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415c7b0 0x7ff194153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19415cd30 0x7ff1941f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff194074000 con 0x7ff19415cd30 2024-09-12T12:17:51.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff194073e80 con 0x7ff1940b5de0 2024-09-12T12:17:51.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff199000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff194074180 con 0x7ff19415c7b0 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff192800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19415cd30 0x7ff1941f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff192800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19415cd30 0x7ff1941f7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53148/0 (socket says 172.21.15.144:53148) 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff192800640 1 -- 172.21.15.144:0/337496579 learned_addr learned my addr 172.21.15.144:0/337496579 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff191e00640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1940b5de0 0x7ff194151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff191400640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415c7b0 0x7ff194153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff192800640 1 -- 172.21.15.144:0/337496579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415c7b0 msgr2=0x7ff194153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff192800640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415c7b0 0x7ff194153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff192800640 1 -- 172.21.15.144:0/337496579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1940b5de0 msgr2=0x7ff194151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff192800640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1940b5de0 0x7ff194151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.354+0000 7ff192800640 1 -- 172.21.15.144:0/337496579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1940b1200 con 0x7ff19415cd30 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff192800640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19415cd30 0x7ff1941f7690 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0af040 tx=0x7ff18c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff18a000640 1 -- 172.21.15.144:0/337496579 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0bc020 con 0x7ff19415cd30 2024-09-12T12:17:51.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff18a000640 1 -- 172.21.15.144:0/337496579 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff18c0b8880 con 0x7ff19415cd30 2024-09-12T12:17:51.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1940b14e0 con 0x7ff19415cd30 2024-09-12T12:17:51.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff18a000640 1 -- 172.21.15.144:0/337496579 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18c009510 con 0x7ff19415cd30 2024-09-12T12:17:51.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1940b1aa0 con 0x7ff19415cd30 2024-09-12T12:17:51.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff194072ee0 con 0x7ff19415cd30 2024-09-12T12:17:51.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff18a000640 1 -- 172.21.15.144:0/337496579 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff18c0bf020 con 0x7ff19415cd30 2024-09-12T12:17:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff18a000640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1700678f0 0x7ff170069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff18a000640 1 -- 172.21.15.144:0/337496579 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7ff18c1209d0 con 0x7ff19415cd30 2024-09-12T12:17:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.358+0000 7ff191e00640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1700678f0 0x7ff170069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.362+0000 7ff191e00640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1700678f0 0x7ff170069db0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff19414c8d0 tx=0x7ff184009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:51.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.366+0000 7ff18a000640 1 -- 172.21.15.144:0/337496579 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff18c016620 con 0x7ff19415cd30 2024-09-12T12:17:51.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.526+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff194166db0 con 0x7ff19415cd30 2024-09-12T12:17:51.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.526+0000 7ff18a000640 1 -- 172.21.15.144:0/337496579 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16982 (secure 0 0 0) 0x7ff18c0f7070 con 0x7ff19415cd30 2024-09-12T12:17:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:51.530 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":97,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:17:50.542855+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:48.264337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:49.548510+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:17:51.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1700678f0 msgr2=0x7ff170069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1700678f0 0x7ff170069db0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff19414c8d0 tx=0x7ff184009040 comp rx=0 tx=0).stop 2024-09-12T12:17:51.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19415cd30 msgr2=0x7ff1941f7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19415cd30 0x7ff1941f7690 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0af040 tx=0x7ff18c0197d0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 shutdown_connections 2024-09-12T12:17:51.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff1700678f0 0x7ff170069db0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19415cd30 0x7ff1941f7690 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19415c7b0 0x7ff194153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 --2- 172.21.15.144:0/337496579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1940b5de0 0x7ff194151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 >> 172.21.15.144:0/337496579 conn(0x7ff19406d0d0 msgr2=0x7ff1940cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:51.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 shutdown_connections 2024-09-12T12:17:51.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.530+0000 7ff199000640 1 -- 172.21.15.144:0/337496579 wait complete. 2024-09-12T12:17:51.552 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:17:51.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbbce00640 1 Processor -- start 2024-09-12T12:17:51.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbbce00640 1 -- start start 2024-09-12T12:17:51.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbbce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb815bff0 0x7fbbb815f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbbce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbbb806bc10 0x7fbbb806c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbbce00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbb8073600 con 0x7fbbb8161e10 2024-09-12T12:17:51.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbbce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbbb8072e60 con 0x7fbbb806bc10 2024-09-12T12:17:51.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbbce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb806c590 con 0x7fbbb815bff0 2024-09-12T12:17:51.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb6a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbbb806bc10 0x7fbbb806c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb815bff0 0x7fbbb815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb6a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbbb806bc10 0x7fbbb806c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33202/0 (socket says 172.21.15.144:33202) 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb815bff0 0x7fbbb815f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:57540/0 (socket says 172.21.15.144:57540) 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb6a00640 1 -- 172.21.15.144:0/251495087 learned_addr learned my addr 172.21.15.144:0/251495087 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb7e00640 1 --1- 172.21.15.144:0/251495087 >> v1:172.21.15.165:6789/0 conn(0x7fbbb8161e10 0x7fbbb81622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:55826/0 (socket says 172.21.15.144:55826) 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb6a00640 1 -- 172.21.15.144:0/251495087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb815bff0 msgr2=0x7fbbb815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb6a00640 1 --2- 172.21.15.144:0/251495087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb815bff0 0x7fbbb815f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb6a00640 1 -- 172.21.15.144:0/251495087 >> v1:172.21.15.165:6789/0 conn(0x7fbbb8161e10 legacy=0x7fbbb81622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb6a00640 1 -- 172.21.15.144:0/251495087 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb815f790 con 0x7fbbb806bc10 2024-09-12T12:17:51.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.686+0000 7fbbb6000640 1 -- 172.21.15.144:0/251495087 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892460714 0 0) 0x7fbbb8073600 con 0x7fbbb8161e10 2024-09-12T12:17:51.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbb6a00640 1 --2- 172.21.15.144:0/251495087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbb806bc10 0x7fbbb806c050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009870 tx=0x7fbba401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6765430834942a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:51.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbb6000640 1 -- 172.21.15.144:0/251495087 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba40aa600 con 0x7fbbb806bc10 2024-09-12T12:17:51.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbb6000640 1 -- 172.21.15.144:0/251495087 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba40af070 con 0x7fbbb806bc10 2024-09-12T12:17:51.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbb6000640 1 -- 172.21.15.144:0/251495087 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba40aa9c0 con 0x7fbbb806bc10 2024-09-12T12:17:51.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbbce00640 1 -- 172.21.15.144:0/251495087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbb806bc10 msgr2=0x7fbbb806c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbbce00640 1 --2- 172.21.15.144:0/251495087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbb806bc10 0x7fbbb806c050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009870 tx=0x7fbba401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbbce00640 1 -- 172.21.15.144:0/251495087 shutdown_connections 2024-09-12T12:17:51.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbbce00640 1 --2- 172.21.15.144:0/251495087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbb806bc10 0x7fbbb806c050 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbbce00640 1 --2- 172.21.15.144:0/251495087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb815bff0 0x7fbbb815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbbce00640 1 -- 172.21.15.144:0/251495087 >> 172.21.15.144:0/251495087 conn(0x7fbbb806e060 msgr2=0x7fbbb806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:51.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbbce00640 1 -- 172.21.15.144:0/251495087 shutdown_connections 2024-09-12T12:17:51.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.690+0000 7fbbbce00640 1 -- 172.21.15.144:0/251495087 wait complete. 2024-09-12T12:17:51.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 Processor -- start 2024-09-12T12:17:51.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 -- start start 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb806bc10 0x7fbbb814f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb815bff0 0x7fbbb813faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbb8161e10 0x7fbbb81504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8071eb0 con 0x7fbbb815bff0 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8072af0 con 0x7fbbb8161e10 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb8072030 con 0x7fbbb806bc10 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb815bff0 0x7fbbb813faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb815bff0 0x7fbbb813faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53154/0 (socket says 172.21.15.144:53154) 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb6a00640 1 -- 172.21.15.144:0/1571726692 learned_addr learned my addr 172.21.15.144:0/1571726692 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb7400640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb806bc10 0x7fbbb814f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb7e00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbb8161e10 0x7fbbb81504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb6a00640 1 -- 172.21.15.144:0/1571726692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb806bc10 msgr2=0x7fbbb814f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb6a00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb806bc10 0x7fbbb814f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb6a00640 1 -- 172.21.15.144:0/1571726692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbb8161e10 msgr2=0x7fbbb81504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb6a00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbb8161e10 0x7fbbb81504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb6a00640 1 -- 172.21.15.144:0/1571726692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb813ffe0 con 0x7fbbb815bff0 2024-09-12T12:17:51.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbb6a00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb815bff0 0x7fbbb813faa0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbba401ab50 tx=0x7fbba401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:51.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbaf400640 1 -- 172.21.15.144:0/1571726692 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba40bd5f0 con 0x7fbbb815bff0 2024-09-12T12:17:51.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbaf400640 1 -- 172.21.15.144:0/1571726692 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba40bd790 con 0x7fbbb815bff0 2024-09-12T12:17:51.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb81606b0 con 0x7fbbb815bff0 2024-09-12T12:17:51.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbaf400640 1 -- 172.21.15.144:0/1571726692 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba40bdb80 con 0x7fbbb815bff0 2024-09-12T12:17:51.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.694+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb8160c70 con 0x7fbbb815bff0 2024-09-12T12:17:51.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.698+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb806c050 con 0x7fbbb815bff0 2024-09-12T12:17:51.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.698+0000 7fbbaf400640 1 -- 172.21.15.144:0/1571726692 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbba40a9070 con 0x7fbbb815bff0 2024-09-12T12:17:51.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.698+0000 7fbbaf400640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb980678c0 0x7fbb98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:51.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.698+0000 7fbbaf400640 1 -- 172.21.15.144:0/1571726692 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fbba4120740 con 0x7fbbb815bff0 2024-09-12T12:17:51.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.698+0000 7fbbb7400640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb980678c0 0x7fbb98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:51.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.698+0000 7fbbb7400640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb980678c0 0x7fbb98069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbba8011340 tx=0x7fbba800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:51.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.702+0000 7fbbaf400640 1 -- 172.21.15.144:0/1571726692 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbba40c3060 con 0x7fbbb815bff0 2024-09-12T12:17:51.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.862+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbb81521c0 con 0x7fbbb815bff0 2024-09-12T12:17:51.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.862+0000 7fbbaf400640 1 -- 172.21.15.144:0/1571726692 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16982 (secure 0 0 0) 0x7fbba4016150 con 0x7fbbb815bff0 2024-09-12T12:17:51.866 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:51.866 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":97,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:17:50.542855+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:48.264337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:49.548510+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:17:51.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb980678c0 msgr2=0x7fbb98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb980678c0 0x7fbb98069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbba8011340 tx=0x7fbba800b040 comp rx=0 tx=0).stop 2024-09-12T12:17:51.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb815bff0 msgr2=0x7fbbb813faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:51.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb815bff0 0x7fbbb813faa0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbba401ab50 tx=0x7fbba401ace0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 shutdown_connections 2024-09-12T12:17:51.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb980678c0 0x7fbb98069d80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbb8161e10 0x7fbbb81504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbb815bff0 0x7fbbb813faa0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 --2- 172.21.15.144:0/1571726692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbbb806bc10 0x7fbbb814f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:51.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 >> 172.21.15.144:0/1571726692 conn(0x7fbbb806e060 msgr2=0x7fbbb81559c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:51.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 shutdown_connections 2024-09-12T12:17:51.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:51.866+0000 7fbbbce00640 1 -- 172.21.15.144:0/1571726692 wait complete. 2024-09-12T12:17:51.888 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:17:52.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca2a00640 1 Processor -- start 2024-09-12T12:17:52.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca2a00640 1 -- start start 2024-09-12T12:17:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c06d0f0 0x7f1c9c06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1c9c0b32f0 0x7f1c9c15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c9c0b4810 0x7f1c9c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca2a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1c9c06da10 con 0x7f1c9c0b4810 2024-09-12T12:17:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1c9c15bf00 con 0x7f1c9c0b32f0 2024-09-12T12:17:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c0b38b0 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c9c0b4810 0x7f1c9c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c9c0b4810 0x7f1c9c0b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53160/0 (socket says 172.21.15.144:53160) 2024-09-12T12:17:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca0a00640 1 -- 172.21.15.144:0/3130700539 learned_addr learned my addr 172.21.15.144:0/3130700539 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1c9b400640 1 --2- 172.21.15.144:0/3130700539 >> v2:172.21.15.165:3300/0 conn(0x7f1c9c0b32f0 0x7f1c9c15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1c9be00640 1 --2- 172.21.15.144:0/3130700539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c06d0f0 0x7f1c9c06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca0a00640 1 -- 172.21.15.144:0/3130700539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c06d0f0 msgr2=0x7f1c9c06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca0a00640 1 --2- 172.21.15.144:0/3130700539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c06d0f0 0x7f1c9c06d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca0a00640 1 -- 172.21.15.144:0/3130700539 >> v2:172.21.15.165:3300/0 conn(0x7f1c9c0b32f0 msgr2=0x7f1c9c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca0a00640 1 --2- 172.21.15.144:0/3130700539 >> v2:172.21.15.165:3300/0 conn(0x7f1c9c0b32f0 0x7f1c9c15b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1ca0a00640 1 -- 172.21.15.144:0/3130700539 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c0b3b90 con 0x7f1c9c0b4810 2024-09-12T12:17:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1c9be00640 1 --2- 172.21.15.144:0/3130700539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c06d0f0 0x7f1c9c06d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.026+0000 7f1c9b400640 1 --2- 172.21.15.144:0/3130700539 >> v2:172.21.15.165:3300/0 conn(0x7f1c9c0b32f0 0x7f1c9c15b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca0a00640 1 --2- 172.21.15.144:0/3130700539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c0b4810 0x7f1c9c0b4cc0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c06f450 tx=0x7f1c9401db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78775f55e888981 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1c9aa00640 1 -- 172.21.15.144:0/3130700539 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c940a6720 con 0x7f1c9c0b4810 2024-09-12T12:17:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1c9aa00640 1 -- 172.21.15.144:0/3130700539 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c940a68c0 con 0x7f1c9c0b4810 2024-09-12T12:17:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1c9aa00640 1 -- 172.21.15.144:0/3130700539 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c940a6c90 con 0x7f1c9c0b4810 2024-09-12T12:17:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3130700539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c0b4810 msgr2=0x7f1c9c0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3130700539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c0b4810 0x7f1c9c0b4cc0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c06f450 tx=0x7f1c9401db00 comp rx=0 tx=0).stop 2024-09-12T12:17:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3130700539 shutdown_connections 2024-09-12T12:17:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3130700539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c0b4810 0x7f1c9c0b4cc0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3130700539 >> v2:172.21.15.165:3300/0 conn(0x7f1c9c0b32f0 0x7f1c9c15b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:52.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3130700539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c06d0f0 0x7f1c9c06d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3130700539 >> 172.21.15.144:0/3130700539 conn(0x7f1c9c068030 msgr2=0x7f1c9c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3130700539 shutdown_connections 2024-09-12T12:17:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3130700539 wait complete. 2024-09-12T12:17:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 Processor -- start 2024-09-12T12:17:52.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.030+0000 7f1ca2a00640 1 -- start start 2024-09-12T12:17:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c06d0f0 0x7f1c9c13cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c0b32f0 0x7f1c9c155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c9c0b4810 0x7f1c9c14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c1589e0 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c158860 con 0x7f1c9c0b4810 2024-09-12T12:17:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c0ccda0 con 0x7f1c9c0b32f0 2024-09-12T12:17:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c06d0f0 0x7f1c9c13cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:52.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c06d0f0 0x7f1c9c13cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53168/0 (socket says 172.21.15.144:53168) 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9be00640 1 -- 172.21.15.144:0/3432641991 learned_addr learned my addr 172.21.15.144:0/3432641991 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9b400640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c0b32f0 0x7f1c9c155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca0a00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c9c0b4810 0x7f1c9c14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9be00640 1 -- 172.21.15.144:0/3432641991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c0b32f0 msgr2=0x7f1c9c155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9be00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c0b32f0 0x7f1c9c155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9be00640 1 -- 172.21.15.144:0/3432641991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c9c0b4810 msgr2=0x7f1c9c14a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9be00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c9c0b4810 0x7f1c9c14a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9be00640 1 -- 172.21.15.144:0/3432641991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c1569d0 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca0a00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c9c0b4810 0x7f1c9c14a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c9be00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c06d0f0 0x7f1c9c13cf60 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00c7c0 tx=0x7f1c8c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c93e00640 1 -- 172.21.15.144:0/3432641991 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c015070 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c93e00640 1 -- 172.21.15.144:0/3432641991 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8c007a30 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9c156c70 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c93e00640 1 -- 172.21.15.144:0/3432641991 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c007e00 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9c14a580 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9c15b9c0 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.034+0000 7f1c93e00640 1 -- 172.21.15.144:0/3432641991 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c8c018070 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.038+0000 7f1c93e00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1c7c0678c0 0x7f1c7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:52.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.038+0000 7f1c93e00640 1 -- 172.21.15.144:0/3432641991 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f1c8c085c90 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.038+0000 7f1c9b400640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1c7c0678c0 0x7f1c7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:52.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.038+0000 7f1c9b400640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1c7c0678c0 0x7f1c7c069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1c88006fd0 tx=0x7f1c88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:52.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.042+0000 7f1c93e00640 1 -- 172.21.15.144:0/3432641991 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1c8c0566d0 con 0x7f1c9c06d0f0 2024-09-12T12:17:52.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:52.234+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1c9c158090 con 0x7f1c9c06d0f0 2024-09-12T12:17:53.143 INFO:tasks.ceph.mds.d.smithi165.stderr:2024-09-12T12:17:53.142+0000 7f3b57000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:17:53.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.178+0000 7f1c93e00640 1 -- 172.21.15.144:0/3432641991 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) ==== 118+0+0 (secure 0 0 0) 0x7f1c8c055fd0 con 0x7f1c9c06d0f0 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1c7c0678c0 msgr2=0x7f1c7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1c7c0678c0 0x7f1c7c069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1c88006fd0 tx=0x7f1c88008040 comp rx=0 tx=0).stop 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c06d0f0 msgr2=0x7f1c9c13cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c06d0f0 0x7f1c9c13cf60 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00c7c0 tx=0x7f1c8c00cc80 comp rx=0 tx=0).stop 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 shutdown_connections 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1c7c0678c0 0x7f1c7c069d80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c9c0b4810 0x7f1c9c14a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c9c0b32f0 0x7f1c9c155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 --2- 172.21.15.144:0/3432641991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c9c06d0f0 0x7f1c9c13cf60 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 >> 172.21.15.144:0/3432641991 conn(0x7f1c9c068030 msgr2=0x7f1c9c0cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 shutdown_connections 2024-09-12T12:17:53.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.182+0000 7f1ca2a00640 1 -- 172.21.15.144:0/3432641991 wait complete. 2024-09-12T12:17:53.207 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:17:53.207 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:17:53.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.346+0000 7f0e70400640 1 Processor -- start 2024-09-12T12:17:53.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.346+0000 7f0e70400640 1 -- start start 2024-09-12T12:17:53.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e70400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e6815c2e0 0x7f0e68072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e70400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0e680af5f0 0x7f0e6806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e70400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6806c150 0x7f0e6806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e70400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0e6806c5c0 con 0x7f0e6815c2e0 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e70400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0e680733e0 con 0x7f0e680af5f0 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e70400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0e680cd290 con 0x7f0e6806c150 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e6815c2e0 0x7f0e68072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e6815c2e0 0x7f0e68072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53182/0 (socket says 172.21.15.144:53182) 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6da00640 1 -- 172.21.15.144:0/620384115 learned_addr learned my addr 172.21.15.144:0/620384115 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6e400640 1 --2- 172.21.15.144:0/620384115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6806c150 0x7f0e6806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6d000640 1 --2- 172.21.15.144:0/620384115 >> v2:172.21.15.165:3300/0 conn(0x7f0e680af5f0 0x7f0e6806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:53.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6da00640 1 -- 172.21.15.144:0/620384115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6806c150 msgr2=0x7f0e6806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:53.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6da00640 1 --2- 172.21.15.144:0/620384115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6806c150 0x7f0e6806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6da00640 1 -- 172.21.15.144:0/620384115 >> v2:172.21.15.165:3300/0 conn(0x7f0e680af5f0 msgr2=0x7f0e6806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:53.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6da00640 1 --2- 172.21.15.144:0/620384115 >> v2:172.21.15.165:3300/0 conn(0x7f0e680af5f0 0x7f0e6806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6da00640 1 -- 172.21.15.144:0/620384115 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e680cd570 con 0x7f0e6815c2e0 2024-09-12T12:17:53.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.350+0000 7f0e6d000640 1 --2- 172.21.15.144:0/620384115 >> v2:172.21.15.165:3300/0 conn(0x7f0e680af5f0 0x7f0e6806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:53.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e6da00640 1 --2- 172.21.15.144:0/620384115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e6815c2e0 0x7f0e68072b50 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0e680afa60 tx=0x7f0e5c01c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9970ea9f266716 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:53.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e67e00640 1 -- 172.21.15.144:0/620384115 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c0ac070 con 0x7f0e6815c2e0 2024-09-12T12:17:53.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e67e00640 1 -- 172.21.15.144:0/620384115 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e5c0a8410 con 0x7f0e6815c2e0 2024-09-12T12:17:53.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e67e00640 1 -- 172.21.15.144:0/620384115 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c0a87e0 con 0x7f0e6815c2e0 2024-09-12T12:17:53.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 -- 172.21.15.144:0/620384115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e6815c2e0 msgr2=0x7f0e68072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:53.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 --2- 172.21.15.144:0/620384115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e6815c2e0 0x7f0e68072b50 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0e680afa60 tx=0x7f0e5c01c610 comp rx=0 tx=0).stop 2024-09-12T12:17:53.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 -- 172.21.15.144:0/620384115 shutdown_connections 2024-09-12T12:17:53.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 --2- 172.21.15.144:0/620384115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6806c150 0x7f0e6806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 --2- 172.21.15.144:0/620384115 >> v2:172.21.15.165:3300/0 conn(0x7f0e680af5f0 0x7f0e6806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 --2- 172.21.15.144:0/620384115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e6815c2e0 0x7f0e68072b50 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 -- 172.21.15.144:0/620384115 >> 172.21.15.144:0/620384115 conn(0x7f0e68068030 msgr2=0x7f0e680b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:53.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 -- 172.21.15.144:0/620384115 shutdown_connections 2024-09-12T12:17:53.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 -- 172.21.15.144:0/620384115 wait complete. 2024-09-12T12:17:53.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 Processor -- start 2024-09-12T12:17:53.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 -- start start 2024-09-12T12:17:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e6806c150 0x7f0e680b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.354+0000 7f0e70400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e680af5f0 0x7f0e6814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e70400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6815c2e0 0x7f0e6815d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e70400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0e680cdef0 con 0x7f0e680af5f0 2024-09-12T12:17:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e70400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0e680cdd70 con 0x7f0e6806c150 2024-09-12T12:17:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e70400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0e680ce070 con 0x7f0e6815c2e0 2024-09-12T12:17:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e680af5f0 0x7f0e6814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e680af5f0 0x7f0e6814ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53194/0 (socket says 172.21.15.144:53194) 2024-09-12T12:17:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6d000640 1 -- 172.21.15.144:0/3410300464 learned_addr learned my addr 172.21.15.144:0/3410300464 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6e400640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6815c2e0 0x7f0e6815d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6da00640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e6806c150 0x7f0e680b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6d000640 1 -- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6815c2e0 msgr2=0x7f0e6815d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6d000640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6815c2e0 0x7f0e6815d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6d000640 1 -- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e6806c150 msgr2=0x7f0e680b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6d000640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e6806c150 0x7f0e680b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6d000640 1 -- 172.21.15.144:0/3410300464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6806c8f0 con 0x7f0e680af5f0 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6da00640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e6806c150 0x7f0e680b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6e400640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6815c2e0 0x7f0e6815d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e6d000640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e680af5f0 0x7f0e6814ae80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400e840 tx=0x7f0e5400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e65600640 1 -- 172.21.15.144:0/3410300464 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e54017070 con 0x7f0e680af5f0 2024-09-12T12:17:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e65600640 1 -- 172.21.15.144:0/3410300464 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e5400c8d0 con 0x7f0e680af5f0 2024-09-12T12:17:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e65600640 1 -- 172.21.15.144:0/3410300464 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400f040 con 0x7f0e680af5f0 2024-09-12T12:17:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6815dee0 con 0x7f0e680af5f0 2024-09-12T12:17:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6815e4a0 con 0x7f0e680af5f0 2024-09-12T12:17:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.358+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6806bc10 con 0x7f0e680af5f0 2024-09-12T12:17:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.362+0000 7f0e65600640 1 -- 172.21.15.144:0/3410300464 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e5401a070 con 0x7f0e680af5f0 2024-09-12T12:17:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.362+0000 7f0e65600640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e480678c0 0x7f0e48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.362+0000 7f0e65600640 1 -- 172.21.15.144:0/3410300464 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f0e54085ed0 con 0x7f0e680af5f0 2024-09-12T12:17:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.362+0000 7f0e6da00640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e480678c0 0x7f0e48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.362+0000 7f0e6da00640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e480678c0 0x7f0e48069d80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0ae000 tx=0x7f0e5c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:53.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.366+0000 7f0e65600640 1 -- 172.21.15.144:0/3410300464 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e54056860 con 0x7f0e680af5f0 2024-09-12T12:17:53.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:53.562+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0e6815b560 con 0x7f0e680af5f0 2024-09-12T12:17:54.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.182+0000 7f0e65600640 1 -- 172.21.15.144:0/3410300464 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) ==== 122+0+0 (secure 0 0 0) 0x7f0e54056160 con 0x7f0e680af5f0 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e480678c0 msgr2=0x7f0e48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e480678c0 0x7f0e48069d80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0ae000 tx=0x7f0e5c0a7000 comp rx=0 tx=0).stop 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e680af5f0 msgr2=0x7f0e6814ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e680af5f0 0x7f0e6814ae80 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400e840 tx=0x7f0e5400ed00 comp rx=0 tx=0).stop 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 shutdown_connections 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e480678c0 0x7f0e48069d80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e6815c2e0 0x7f0e6815d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e680af5f0 0x7f0e6814ae80 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 --2- 172.21.15.144:0/3410300464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e6806c150 0x7f0e680b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 >> 172.21.15.144:0/3410300464 conn(0x7f0e68068030 msgr2=0x7f0e681584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:54.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 shutdown_connections 2024-09-12T12:17:54.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.186+0000 7f0e70400640 1 -- 172.21.15.144:0/3410300464 wait complete. 2024-09-12T12:17:54.213 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:17:54.213 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:54.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0807e00640 1 Processor -- start 2024-09-12T12:17:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0807e00640 1 -- start start 2024-09-12T12:17:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0807e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08000b4950 0x7f0800071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0807e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08001621a0 con 0x7f08000b6bf0 2024-09-12T12:17:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0807e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08000b7180 con 0x7f0800161c40 2024-09-12T12:17:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0807e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f08000b7460 con 0x7f08000b4950 2024-09-12T12:17:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0805e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08000b4950 0x7f0800071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0805e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08000b4950 0x7f0800071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53200/0 (socket says 172.21.15.144:53200) 2024-09-12T12:17:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0805e00640 1 -- 172.21.15.144:0/3363467829 learned_addr learned my addr 172.21.15.144:0/3363467829 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0804a00640 1 --1- 172.21.15.144:0/3363467829 >> v1:172.21.15.144:6789/0 conn(0x7f08000b6bf0 0x7f08000b4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47764/0 (socket says 172.21.15.144:47764) 2024-09-12T12:17:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0805e00640 1 -- 172.21.15.144:0/3363467829 >> v1:172.21.15.165:6789/0 conn(0x7f0800161c40 legacy=0x7f080006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0805e00640 1 -- 172.21.15.144:0/3363467829 >> v1:172.21.15.144:6789/0 conn(0x7f08000b6bf0 legacy=0x7f08000b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.350+0000 7f0805e00640 1 -- 172.21.15.144:0/3363467829 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08000b7740 con 0x7f08000b4950 2024-09-12T12:17:54.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f0805e00640 1 --2- 172.21.15.144:0/3363467829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 0x7f0800071850 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009e50 tx=0x7f07f801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b8db9b8bd1cc65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:54.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f07ffe00640 1 -- 172.21.15.144:0/3363467829 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f80a57d0 con 0x7f08000b4950 2024-09-12T12:17:54.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f07ffe00640 1 -- 172.21.15.144:0/3363467829 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f80a5970 con 0x7f08000b4950 2024-09-12T12:17:54.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f07ffe00640 1 -- 172.21.15.144:0/3363467829 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f80a5d40 con 0x7f08000b4950 2024-09-12T12:17:54.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f0807e00640 1 -- 172.21.15.144:0/3363467829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 msgr2=0x7f0800071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f0807e00640 1 --2- 172.21.15.144:0/3363467829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 0x7f0800071850 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009e50 tx=0x7f07f801c9f0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f0807e00640 1 -- 172.21.15.144:0/3363467829 shutdown_connections 2024-09-12T12:17:54.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f0807e00640 1 --2- 172.21.15.144:0/3363467829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 0x7f0800071850 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f0807e00640 1 -- 172.21.15.144:0/3363467829 >> 172.21.15.144:0/3363467829 conn(0x7f080006f3c0 msgr2=0x7f080006f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:54.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f0807e00640 1 -- 172.21.15.144:0/3363467829 shutdown_connections 2024-09-12T12:17:54.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.354+0000 7f0807e00640 1 -- 172.21.15.144:0/3363467829 wait complete. 2024-09-12T12:17:54.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 Processor -- start 2024-09-12T12:17:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 -- start start 2024-09-12T12:17:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 0x7f08001507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08000b6bf0 0x7f08001593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0800161c40 0x7f0800159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f080016c400 con 0x7f08000b4950 2024-09-12T12:17:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f080016c280 con 0x7f0800161c40 2024-09-12T12:17:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f080016c580 con 0x7f08000b6bf0 2024-09-12T12:17:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 0x7f08001507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 0x7f08001507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53214/0 (socket says 172.21.15.144:53214) 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805400640 1 -- 172.21.15.144:0/3439737605 learned_addr learned my addr 172.21.15.144:0/3439737605 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0804a00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08000b6bf0 0x7f08001593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805e00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0800161c40 0x7f0800159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805400640 1 -- 172.21.15.144:0/3439737605 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08000b6bf0 msgr2=0x7f08001593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805400640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08000b6bf0 0x7f08001593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805400640 1 -- 172.21.15.144:0/3439737605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0800161c40 msgr2=0x7f0800159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805400640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0800161c40 0x7f0800159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805400640 1 -- 172.21.15.144:0/3439737605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0800150d30 con 0x7f08000b4950 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0804a00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08000b6bf0 0x7f08001593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:54.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0805400640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 0x7f08001507f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c450 tx=0x7f07f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:54.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f07fd600640 1 -- 172.21.15.144:0/3439737605 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4012830 con 0x7f08000b4950 2024-09-12T12:17:54.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f07fd600640 1 -- 172.21.15.144:0/3439737605 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4017070 con 0x7f08000b4950 2024-09-12T12:17:54.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f07fd600640 1 -- 172.21.15.144:0/3439737605 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4012c30 con 0x7f08000b4950 2024-09-12T12:17:54.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080015e9c0 con 0x7f08000b4950 2024-09-12T12:17:54.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.358+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080015ef40 con 0x7f08000b4950 2024-09-12T12:17:54.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.362+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0800071850 con 0x7f08000b4950 2024-09-12T12:17:54.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.362+0000 7f07fd600640 1 -- 172.21.15.144:0/3439737605 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07f401c460 con 0x7f08000b4950 2024-09-12T12:17:54.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.362+0000 7f07fd600640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07e00678c0 0x7f07e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.362+0000 7f07fd600640 1 -- 172.21.15.144:0/3439737605 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f07f4085c60 con 0x7f08000b4950 2024-09-12T12:17:54.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.362+0000 7f0804a00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07e00678c0 0x7f07e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.362+0000 7f0804a00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07e00678c0 0x7f07e0069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f080015ff30 tx=0x7f07ec007d70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:54.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.366+0000 7f07fd600640 1 -- 172.21.15.144:0/3439737605 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0800150d30 con 0x7f08000b4950 2024-09-12T12:17:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.558+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08000d2a30 con 0x7f08000b4950 2024-09-12T12:17:54.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.558+0000 7f07fd600640 1 -- 172.21.15.144:0/3439737605 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5225 (secure 0 0 0) 0x7f07f4056600 con 0x7f08000b4950 2024-09-12T12:17:54.563 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:54.563 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":70,"btime":"2024-09-12T12:17:54:184003+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/494679539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":494679539},{"type":"v1","addr":"172.21.15.165:6834","nonce":494679539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7152,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/76101968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":76101968},{"type":"v1","addr":"172.21.15.144:6836","nonce":76101968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/736758853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":736758853},{"type":"v1","addr":"172.21.15.144:6837","nonce":736758853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:17:53.566919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7161":{"gid":7161,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2978712683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2978712683},{"type":"v1","addr":"172.21.15.165:6835","nonce":2978712683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7161,"qdb_cluster":[7161]},"id":6}]} 2024-09-12T12:17:54.563 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 70 2024-09-12T12:17:54.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07e00678c0 msgr2=0x7f07e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07e00678c0 0x7f07e0069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f080015ff30 tx=0x7f07ec007d70 comp rx=0 tx=0).stop 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 msgr2=0x7f08001507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 0x7f08001507f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c450 tx=0x7f07f400c910 comp rx=0 tx=0).stop 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 shutdown_connections 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f07e00678c0 0x7f07e0069d80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0800161c40 0x7f0800159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f08000b6bf0 0x7f08001593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 --2- 172.21.15.144:0/3439737605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08000b4950 0x7f08001507f0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 >> 172.21.15.144:0/3439737605 conn(0x7f080006f3c0 msgr2=0x7f08000cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:54.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 shutdown_connections 2024-09-12T12:17:54.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.562+0000 7f0807e00640 1 -- 172.21.15.144:0/3439737605 wait complete. 2024-09-12T12:17:54.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:17:54.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.714+0000 7f2be2400640 1 Processor -- start 2024-09-12T12:17:54.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be2400640 1 -- start start 2024-09-12T12:17:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be2400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2bdc0b04e0 0x7f2bdc15d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be2400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2bdc0b08c0 0x7f2bdc13f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be2400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc156190 0x7f2bdc1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be2400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2bdc156ae0 con 0x7f2bdc0b08c0 2024-09-12T12:17:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be2400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2bdc1427d0 con 0x7f2bdc0b04e0 2024-09-12T12:17:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be2400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2bdc13fd40 con 0x7f2bdc156190 2024-09-12T12:17:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2bdbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2bdc0b08c0 0x7f2bdc13f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2bdbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2bdc0b08c0 0x7f2bdc13f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53220/0 (socket says 172.21.15.144:53220) 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2bdbe00640 1 -- 172.21.15.144:0/4211476723 learned_addr learned my addr 172.21.15.144:0/4211476723 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be1a00640 1 --2- 172.21.15.144:0/4211476723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc156190 0x7f2bdc1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2bdbe00640 1 -- 172.21.15.144:0/4211476723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc156190 msgr2=0x7f2bdc1565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2bdbe00640 1 --2- 172.21.15.144:0/4211476723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc156190 0x7f2bdc1565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2bdbe00640 1 -- 172.21.15.144:0/4211476723 >> v2:172.21.15.165:3300/0 conn(0x7f2bdc0b04e0 msgr2=0x7f2bdc15d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be1000640 1 --2- 172.21.15.144:0/4211476723 >> v2:172.21.15.165:3300/0 conn(0x7f2bdc0b04e0 0x7f2bdc15d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2bdbe00640 1 --2- 172.21.15.144:0/4211476723 >> v2:172.21.15.165:3300/0 conn(0x7f2bdc0b04e0 0x7f2bdc15d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2bdbe00640 1 -- 172.21.15.144:0/4211476723 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc0b0d50 con 0x7f2bdc0b08c0 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be1000640 1 --2- 172.21.15.144:0/4211476723 >> v2:172.21.15.165:3300/0 conn(0x7f2bdc0b04e0 0x7f2bdc15d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.718+0000 7f2be1a00640 1 --2- 172.21.15.144:0/4211476723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc156190 0x7f2bdc1565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:54.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2bdbe00640 1 --2- 172.21.15.144:0/4211476723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc0b08c0 0x7f2bdc13f800 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0b4090 tx=0x7f2bc801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5526d6d97f999d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2bdb400640 1 -- 172.21.15.144:0/4211476723 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80b0070 con 0x7f2bdc0b08c0 2024-09-12T12:17:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2bdb400640 1 -- 172.21.15.144:0/4211476723 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc80ab600 con 0x7f2bdc0b08c0 2024-09-12T12:17:54.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2bdb400640 1 -- 172.21.15.144:0/4211476723 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80ab9d0 con 0x7f2bdc0b08c0 2024-09-12T12:17:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 -- 172.21.15.144:0/4211476723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc0b08c0 msgr2=0x7f2bdc13f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 --2- 172.21.15.144:0/4211476723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc0b08c0 0x7f2bdc13f800 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0b4090 tx=0x7f2bc801c520 comp rx=0 tx=0).stop 2024-09-12T12:17:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 -- 172.21.15.144:0/4211476723 shutdown_connections 2024-09-12T12:17:54.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 --2- 172.21.15.144:0/4211476723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc0b08c0 0x7f2bdc13f800 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 --2- 172.21.15.144:0/4211476723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc156190 0x7f2bdc1565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 --2- 172.21.15.144:0/4211476723 >> v2:172.21.15.165:3300/0 conn(0x7f2bdc0b04e0 0x7f2bdc15d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 -- 172.21.15.144:0/4211476723 >> 172.21.15.144:0/4211476723 conn(0x7f2bdc06e060 msgr2=0x7f2bdc06e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:54.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 -- 172.21.15.144:0/4211476723 shutdown_connections 2024-09-12T12:17:54.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 -- 172.21.15.144:0/4211476723 wait complete. 2024-09-12T12:17:54.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 Processor -- start 2024-09-12T12:17:54.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.722+0000 7f2be2400640 1 -- start start 2024-09-12T12:17:54.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be2400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bdc0b04e0 0x7f2bdc1f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be2400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc0b08c0 0x7f2bdc0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be2400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc156190 0x7f2bdc139660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be2400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc0cde80 con 0x7f2bdc156190 2024-09-12T12:17:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be2400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc1424f0 con 0x7f2bdc0b04e0 2024-09-12T12:17:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be2400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2bdc0ce000 con 0x7f2bdc0b08c0 2024-09-12T12:17:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc156190 0x7f2bdc139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc156190 0x7f2bdc139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53228/0 (socket says 172.21.15.144:53228) 2024-09-12T12:17:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1a00640 1 -- 172.21.15.144:0/2479173509 learned_addr learned my addr 172.21.15.144:0/2479173509 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:54.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2bdbe00640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc0b08c0 0x7f2bdc0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1000640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bdc0b04e0 0x7f2bdc1f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1a00640 1 -- 172.21.15.144:0/2479173509 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc0b08c0 msgr2=0x7f2bdc0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1a00640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc0b08c0 0x7f2bdc0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1a00640 1 -- 172.21.15.144:0/2479173509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bdc0b04e0 msgr2=0x7f2bdc1f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1a00640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bdc0b04e0 0x7f2bdc1f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1a00640 1 -- 172.21.15.144:0/2479173509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc0b55f0 con 0x7f2bdc156190 2024-09-12T12:17:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1000640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bdc0b04e0 0x7f2bdc1f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:54.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be1a00640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc156190 0x7f2bdc139660 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400cf20 tx=0x7f2bd400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2bd8c00640 1 -- 172.21.15.144:0/2479173509 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd401a070 con 0x7f2bdc156190 2024-09-12T12:17:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2bd8c00640 1 -- 172.21.15.144:0/2479173509 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd400d840 con 0x7f2bdc156190 2024-09-12T12:17:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2bd8c00640 1 -- 172.21.15.144:0/2479173509 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400dc30 con 0x7f2bdc156190 2024-09-12T12:17:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bdc0b4a70 con 0x7f2bdc156190 2024-09-12T12:17:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bdc0b5030 con 0x7f2bdc156190 2024-09-12T12:17:54.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bdc06ee90 con 0x7f2bdc156190 2024-09-12T12:17:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.726+0000 7f2bd8c00640 1 -- 172.21.15.144:0/2479173509 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2bd401d070 con 0x7f2bdc156190 2024-09-12T12:17:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.730+0000 7f2bd8c00640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2bbc0678c0 0x7f2bbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.730+0000 7f2bd8c00640 1 -- 172.21.15.144:0/2479173509 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f2bd4086650 con 0x7f2bdc156190 2024-09-12T12:17:54.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.730+0000 7f2be1000640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2bbc0678c0 0x7f2bbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:54.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.730+0000 7f2be1000640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2bbc0678c0 0x7f2bbc069d80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000a9b0 tx=0x7f2bd0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:54.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.734+0000 7f2bd8c00640 1 -- 172.21.15.144:0/2479173509 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2bd4056910 con 0x7f2bdc156190 2024-09-12T12:17:54.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.890+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bdc155db0 con 0x7f2bdc156190 2024-09-12T12:17:54.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2bd8c00640 1 -- 172.21.15.144:0/2479173509 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16969 (secure 0 0 0) 0x7f2bd405ac10 con 0x7f2bdc156190 2024-09-12T12:17:54.895 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:54.895 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":98,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:17:52.170098+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:48.264337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:49.548510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:17:54.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2bbc0678c0 msgr2=0x7f2bbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2bbc0678c0 0x7f2bbc069d80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000a9b0 tx=0x7f2bd0008040 comp rx=0 tx=0).stop 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc156190 msgr2=0x7f2bdc139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc156190 0x7f2bdc139660 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400cf20 tx=0x7f2bd400a7d0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 shutdown_connections 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2bbc0678c0 0x7f2bbc069d80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bdc156190 0x7f2bdc139660 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bdc0b08c0 0x7f2bdc0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 --2- 172.21.15.144:0/2479173509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bdc0b04e0 0x7f2bdc1f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 >> 172.21.15.144:0/2479173509 conn(0x7f2bdc06e060 msgr2=0x7f2bdc0b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 shutdown_connections 2024-09-12T12:17:54.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:54.894+0000 7f2be2400640 1 -- 172.21.15.144:0/2479173509 wait complete. 2024-09-12T12:17:54.917 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:17:54.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:17:55.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.050+0000 7f4794a00640 1 Processor -- start 2024-09-12T12:17:55.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.050+0000 7f4794a00640 1 -- start start 2024-09-12T12:17:55.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.050+0000 7f4794a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f479015b4e0 0x7f47900b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.050+0000 7f4794a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47900b45a0 con 0x7f47900ccf30 2024-09-12T12:17:55.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.050+0000 7f4794a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47900b3fe0 con 0x7f47900b3ad0 2024-09-12T12:17:55.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.050+0000 7f4794a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47900b42c0 con 0x7f479015b4e0 2024-09-12T12:17:55.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.050+0000 7f478e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f47900ccf30 0x7f47900b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47768/0 (socket says 172.21.15.144:47768) 2024-09-12T12:17:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.050+0000 7f478e800640 1 -- 172.21.15.144:0/4057781973 learned_addr learned my addr 172.21.15.144:0/4057781973 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478de00640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f479015b4e0 0x7f47900b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719287260 0 0) 0x7f47900b45a0 con 0x7f47900ccf30 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4774005740 con 0x7f47900ccf30 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 704957585 0 0) 0x7f4774005740 con 0x7f47900ccf30 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f479015b4e0 msgr2=0x7f47900b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f479015b4e0 0x7f47900b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 >> v1:172.21.15.165:6789/0 conn(0x7f47900b3ad0 legacy=0x7f4790071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47900b1490 con 0x7f47900ccf30 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f4788001a00 con 0x7f47900ccf30 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478de00640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f479015b4e0 0x7f47900b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 >> v1:172.21.15.144:6789/0 conn(0x7f47900ccf30 legacy=0x7f47900b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774005c00 0x7f4774005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f479015b4e0 0x7f4774006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4774006f60 0x7f47740073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47900b42c0 con 0x7f4774006f60 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f477400dbe0 con 0x7f4774005c00 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f477400dd90 con 0x7f479015b4e0 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478e800640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4774006f60 0x7f47740073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478d400640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f479015b4e0 0x7f4774006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478de00640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774005c00 0x7f4774005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478e800640 1 -- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f479015b4e0 msgr2=0x7f4774006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478e800640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f479015b4e0 0x7f4774006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478e800640 1 -- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774005c00 msgr2=0x7f4774005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478e800640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774005c00 0x7f4774005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.054+0000 7f478e800640 1 -- 172.21.15.144:0/4057781973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4774005740 con 0x7f4774006f60 2024-09-12T12:17:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f478e800640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4774006f60 0x7f47740073e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f478800a860 tx=0x7f478801fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cedba8863419e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478800a480 con 0x7f4774006f60 2024-09-12T12:17:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47880aa6f0 con 0x7f4774006f60 2024-09-12T12:17:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f478ca00640 1 -- 172.21.15.144:0/4057781973 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47880aab00 con 0x7f4774006f60 2024-09-12T12:17:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 -- 172.21.15.144:0/4057781973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4774006f60 msgr2=0x7f47740073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 --2- 172.21.15.144:0/4057781973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4774006f60 0x7f47740073e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f478800a860 tx=0x7f478801fac0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f478e800640 1 -- 172.21.15.144:0/4057781973 reap_dead start 2024-09-12T12:17:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 -- 172.21.15.144:0/4057781973 shutdown_connections 2024-09-12T12:17:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 -- 172.21.15.144:0/4057781973 >> 172.21.15.144:0/4057781973 conn(0x7f479006d0d0 msgr2=0x7f479006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 -- 172.21.15.144:0/4057781973 shutdown_connections 2024-09-12T12:17:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 -- 172.21.15.144:0/4057781973 wait complete. 2024-09-12T12:17:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 Processor -- start 2024-09-12T12:17:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 -- start start 2024-09-12T12:17:55.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774006f60 0x7f479014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f479015e450 0x7f47900ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47900cec50 0x7f4790158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47900cdef0 con 0x7f479015e450 2024-09-12T12:17:55.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4790071b30 con 0x7f4774006f60 2024-09-12T12:17:55.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.058+0000 7f4794a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f479015b8c0 con 0x7f47900cec50 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f479015e450 0x7f47900ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f479015e450 0x7f47900ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53246/0 (socket says 172.21.15.144:53246) 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478d400640 1 -- 172.21.15.144:0/1657390919 learned_addr learned my addr 172.21.15.144:0/1657390919 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478de00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774006f60 0x7f479014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478e800640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47900cec50 0x7f4790158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478d400640 1 -- 172.21.15.144:0/1657390919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47900cec50 msgr2=0x7f4790158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478d400640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47900cec50 0x7f4790158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478d400640 1 -- 172.21.15.144:0/1657390919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774006f60 msgr2=0x7f479014c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478d400640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774006f60 0x7f479014c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478d400640 1 -- 172.21.15.144:0/1657390919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479015d120 con 0x7f479015e450 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478de00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774006f60 0x7f479014c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:55.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f478d400640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f479015e450 0x7f47900ce710 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f477c00f820 tx=0x7f477c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f4786000640 1 -- 172.21.15.144:0/1657390919 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c0052e0 con 0x7f479015e450 2024-09-12T12:17:55.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f4786000640 1 -- 172.21.15.144:0/1657390919 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477c018070 con 0x7f479015e450 2024-09-12T12:17:55.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479015c0f0 con 0x7f479015e450 2024-09-12T12:17:55.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f4786000640 1 -- 172.21.15.144:0/1657390919 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c00d970 con 0x7f479015e450 2024-09-12T12:17:55.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479015d3c0 con 0x7f479015e450 2024-09-12T12:17:55.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47900cf060 con 0x7f479015e450 2024-09-12T12:17:55.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f4786000640 1 -- 172.21.15.144:0/1657390919 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f477c00db10 con 0x7f479015e450 2024-09-12T12:17:55.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.062+0000 7f4786000640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47700678f0 0x7f4770069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.066+0000 7f4786000640 1 -- 172.21.15.144:0/1657390919 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f477c085a70 con 0x7f479015e450 2024-09-12T12:17:55.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.066+0000 7f478de00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47700678f0 0x7f4770069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.066+0000 7f478de00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47700678f0 0x7f4770069db0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4780009fc0 tx=0x7f4780009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.070+0000 7f4786000640 1 -- 172.21.15.144:0/1657390919 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f47900cf060 con 0x7f479015e450 2024-09-12T12:17:55.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.230+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47900b3590 con 0x7f47700678f0 2024-09-12T12:17:55.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.234+0000 7f4786000640 1 -- 172.21.15.144:0/1657390919 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240148 (secure 0 0 0) 0x7f47900b3590 con 0x7f47700678f0 2024-09-12T12:17:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:55.242 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:17:55.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47700678f0 msgr2=0x7f4770069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47700678f0 0x7f4770069db0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4780009fc0 tx=0x7f4780009190 comp rx=0 tx=0).stop 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f479015e450 msgr2=0x7f47900ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f479015e450 0x7f47900ce710 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f477c00f820 tx=0x7f477c00fce0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 shutdown_connections 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47700678f0 0x7f4770069db0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47900cec50 0x7f4790158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f479015e450 0x7f47900ce710 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 --2- 172.21.15.144:0/1657390919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4774006f60 0x7f479014c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 >> 172.21.15.144:0/1657390919 conn(0x7f479006d0d0 msgr2=0x7f47900b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 shutdown_connections 2024-09-12T12:17:55.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.238+0000 7f4794a00640 1 -- 172.21.15.144:0/1657390919 wait complete. 2024-09-12T12:17:55.262 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-09-12T12:17:53.441104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301416,"kb_used_data":10264,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754673304,"statfs":{"total":773094113280,"available":772785463296,"internally_reserved":0,"allocated":10510336,"data_stored":5491004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.289209"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.153909+0000","last_change":"2024-09-12T12:17:49.153909+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.153909+0000","last_undegraded":"2024-09-12T12:17:49.153909+0000","last_fullsized":"2024-09-12T12:17:49.153909+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.154754+0000","last_change":"2024-09-12T12:17:49.154754+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.154754+0000","last_undegraded":"2024-09-12T12:17:49.154754+0000","last_fullsized":"2024-09-12T12:17:49.154754+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.156479+0000","last_change":"2024-09-12T12:17:49.156479+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.156479+0000","last_undegraded":"2024-09-12T12:17:49.156479+0000","last_fullsized":"2024-09-12T12:17:49.156479+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.153615+0000","last_change":"2024-09-12T12:17:49.153615+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.153615+0000","last_undegraded":"2024-09-12T12:17:49.153615+0000","last_fullsized":"2024-09-12T12:17:49.153615+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.153271+0000","last_change":"2024-09-12T12:17:49.153271+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.153271+0000","last_undegraded":"2024-09-12T12:17:49.153271+0000","last_fullsized":"2024-09-12T12:17:49.153271+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.157188+0000","last_change":"2024-09-12T12:17:49.157188+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.157188+0000","last_undegraded":"2024-09-12T12:17:49.157188+0000","last_fullsized":"2024-09-12T12:17:49.157188+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.162700+0000","last_change":"2024-09-12T12:17:49.162700+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.162700+0000","last_undegraded":"2024-09-12T12:17:49.162700+0000","last_fullsized":"2024-09-12T12:17:49.162700+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.157695+0000","last_change":"2024-09-12T12:17:49.157695+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.157695+0000","last_undegraded":"2024-09-12T12:17:49.157695+0000","last_fullsized":"2024-09-12T12:17:49.157695+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.158828+0000","last_change":"2024-09-12T12:17:49.158828+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.158828+0000","last_undegraded":"2024-09-12T12:17:49.158828+0000","last_fullsized":"2024-09-12T12:17:49.158828+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.162694+0000","last_change":"2024-09-12T12:17:49.162694+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.162694+0000","last_undegraded":"2024-09-12T12:17:49.162694+0000","last_fullsized":"2024-09-12T12:17:49.162694+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.154887+0000","last_change":"2024-09-12T12:17:49.154887+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.154887+0000","last_undegraded":"2024-09-12T12:17:49.154887+0000","last_fullsized":"2024-09-12T12:17:49.154887+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.157490+0000","last_change":"2024-09-12T12:17:49.157490+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.157490+0000","last_undegraded":"2024-09-12T12:17:49.157490+0000","last_fullsized":"2024-09-12T12:17:49.157490+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.158019+0000","last_change":"2024-09-12T12:17:49.158019+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.158019+0000","last_undegraded":"2024-09-12T12:17:49.158019+0000","last_fullsized":"2024-09-12T12:17:49.158019+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.158100+0000","last_change":"2024-09-12T12:17:49.158100+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.158100+0000","last_undegraded":"2024-09-12T12:17:49.158100+0000","last_fullsized":"2024-09-12T12:17:49.158100+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.157210+0000","last_change":"2024-09-12T12:17:49.157210+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.157210+0000","last_undegraded":"2024-09-12T12:17:49.157210+0000","last_fullsized":"2024-09-12T12:17:49.157210+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.157193+0000","last_change":"2024-09-12T12:17:49.157193+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.157193+0000","last_undegraded":"2024-09-12T12:17:49.157193+0000","last_fullsized":"2024-09-12T12:17:49.157193+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.153402+0000","last_change":"2024-09-12T12:17:49.153402+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.153402+0000","last_undegraded":"2024-09-12T12:17:49.153402+0000","last_fullsized":"2024-09-12T12:17:49.153402+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.156552+0000","last_change":"2024-09-12T12:17:49.156552+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.156552+0000","last_undegraded":"2024-09-12T12:17:49.156552+0000","last_fullsized":"2024-09-12T12:17:49.156552+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.154472+0000","last_change":"2024-09-12T12:17:49.154472+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.154472+0000","last_undegraded":"2024-09-12T12:17:49.154472+0000","last_fullsized":"2024-09-12T12:17:49.154472+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.159584+0000","last_change":"2024-09-12T12:17:49.159584+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.159584+0000","last_undegraded":"2024-09-12T12:17:49.159584+0000","last_fullsized":"2024-09-12T12:17:49.159584+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.154949+0000","last_change":"2024-09-12T12:17:49.154949+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.154949+0000","last_undegraded":"2024-09-12T12:17:49.154949+0000","last_fullsized":"2024-09-12T12:17:49.154949+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.159236+0000","last_change":"2024-09-12T12:17:49.159236+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.159236+0000","last_undegraded":"2024-09-12T12:17:49.159236+0000","last_fullsized":"2024-09-12T12:17:49.159236+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.154864+0000","last_change":"2024-09-12T12:17:49.154864+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.154864+0000","last_undegraded":"2024-09-12T12:17:49.154864+0000","last_fullsized":"2024-09-12T12:17:49.154864+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.156288+0000","last_change":"2024-09-12T12:17:49.156288+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.156288+0000","last_undegraded":"2024-09-12T12:17:49.156288+0000","last_fullsized":"2024-09-12T12:17:49.156288+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.154269+0000","last_change":"2024-09-12T12:17:49.154269+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.154269+0000","last_undegraded":"2024-09-12T12:17:49.154269+0000","last_fullsized":"2024-09-12T12:17:49.154269+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.153058+0000","last_change":"2024-09-12T12:17:49.153058+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.153058+0000","last_undegraded":"2024-09-12T12:17:49.153058+0000","last_fullsized":"2024-09-12T12:17:49.153058+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.153009+0000","last_change":"2024-09-12T12:17:49.153009+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.153009+0000","last_undegraded":"2024-09-12T12:17:49.153009+0000","last_fullsized":"2024-09-12T12:17:49.153009+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.157710+0000","last_change":"2024-09-12T12:17:49.157710+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.157710+0000","last_undegraded":"2024-09-12T12:17:49.157710+0000","last_fullsized":"2024-09-12T12:17:49.157710+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.159923+0000","last_change":"2024-09-12T12:17:49.159923+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.159923+0000","last_undegraded":"2024-09-12T12:17:49.159923+0000","last_fullsized":"2024-09-12T12:17:49.159923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.153631+0000","last_change":"2024-09-12T12:17:49.153631+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.153631+0000","last_undegraded":"2024-09-12T12:17:49.153631+0000","last_fullsized":"2024-09-12T12:17:49.153631+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.157238+0000","last_change":"2024-09-12T12:17:49.157238+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.157238+0000","last_undegraded":"2024-09-12T12:17:49.157238+0000","last_fullsized":"2024-09-12T12:17:49.157238+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:17:50.151220+0000","last_change":"2024-09-12T12:17:50.151220+0000","last_active":"2024-09-12T12:17:50.151220+0000","last_peered":"2024-09-12T12:17:50.151220+0000","last_clean":"2024-09-12T12:17:50.151220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:50.151220+0000","last_undegraded":"2024-09-12T12:17:50.151220+0000","last_fullsized":"2024-09-12T12:17:50.151220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-12T12:17:49.157247+0000","last_change":"2024-09-12T12:17:49.157247+0000","last_active":"2024-09-12T12:17:49.148020+0000","last_peered":"2024-09-12T12:17:49.148020+0000","last_clean":"2024-09-12T12:17:49.148020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:17:49.157247+0000","last_undegraded":"2024-09-12T12:17:49.157247+0000","last_fullsized":"2024-09-12T12:17:49.157247+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":305,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T12:17:49.158819+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:17:49.158819+0000","last_peered":"2024-09-12T12:17:49.158819+0000","last_clean":"2024-09-12T12:17:49.158819+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:17:49.158819+0000","last_undegraded":"2024-09-12T12:17:49.158819+0000","last_fullsized":"2024-09-12T12:17:49.158819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1753088,"data_stored":1126047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1159168,"data_stored":535679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1171456,"data_stored":541888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36492,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335348,"statfs":{"total":96636764160,"available":96599396352,"internally_reserved":0,"allocated":1159168,"data_stored":535679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40660,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331180,"statfs":{"total":96636764160,"available":96595128320,"internally_reserved":0,"allocated":1171456,"data_stored":541888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36492,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335348,"statfs":{"total":96636764160,"available":96599396352,"internally_reserved":0,"allocated":1171456,"data_stored":541888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36500,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335340,"statfs":{"total":96636764160,"available":96599388160,"internally_reserved":0,"allocated":1171456,"data_stored":541888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41224,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330616,"statfs":{"total":96636764160,"available":96594550784,"internally_reserved":0,"allocated":1753088,"data_stored":1126047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:17:55.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:17:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.434+0000 7f0eb0800640 1 Processor -- start 2024-09-12T12:17:55.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.434+0000 7f0eb0800640 1 -- start start 2024-09-12T12:17:55.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eb0800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 0x7f0ea80ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eb0800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0ea815cd30 0x7f0ea80b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eb0800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ea80b5de0 0x7f0ea81601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eb0800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea8072a50 con 0x7f0ea80b5de0 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eb0800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea80cde30 con 0x7f0ea815cd30 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eb0800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea80b6210 con 0x7f0ea815c7b0 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eae800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ea80b5de0 0x7f0ea81601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eae800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ea80b5de0 0x7f0ea81601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53248/0 (socket says 172.21.15.144:53248) 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eae800640 1 -- 172.21.15.144:0/3407614036 learned_addr learned my addr 172.21.15.144:0/3407614036 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eade00640 1 --2- 172.21.15.144:0/3407614036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 0x7f0ea80ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0ead400640 1 --2- 172.21.15.144:0/3407614036 >> v2:172.21.15.165:3300/0 conn(0x7f0ea815cd30 0x7f0ea80b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eae800640 1 -- 172.21.15.144:0/3407614036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 msgr2=0x7f0ea80ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:55.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eae800640 1 --2- 172.21.15.144:0/3407614036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 0x7f0ea80ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eae800640 1 -- 172.21.15.144:0/3407614036 >> v2:172.21.15.165:3300/0 conn(0x7f0ea815cd30 msgr2=0x7f0ea80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:55.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eae800640 1 --2- 172.21.15.144:0/3407614036 >> v2:172.21.15.165:3300/0 conn(0x7f0ea815cd30 0x7f0ea80b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.438+0000 7f0eae800640 1 -- 172.21.15.144:0/3407614036 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea80cd870 con 0x7f0ea80b5de0 2024-09-12T12:17:55.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eae800640 1 --2- 172.21.15.144:0/3407614036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 0x7f0ea81601d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0ea806a020 tx=0x7f0ea401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d8751a0c7fd420 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eaca00640 1 -- 172.21.15.144:0/3407614036 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40a64b0 con 0x7f0ea80b5de0 2024-09-12T12:17:55.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eaca00640 1 -- 172.21.15.144:0/3407614036 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea40a6650 con 0x7f0ea80b5de0 2024-09-12T12:17:55.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eaca00640 1 -- 172.21.15.144:0/3407614036 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40a6a20 con 0x7f0ea80b5de0 2024-09-12T12:17:55.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 -- 172.21.15.144:0/3407614036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 msgr2=0x7f0ea81601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 --2- 172.21.15.144:0/3407614036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 0x7f0ea81601d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0ea806a020 tx=0x7f0ea401c730 comp rx=0 tx=0).stop 2024-09-12T12:17:55.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 -- 172.21.15.144:0/3407614036 shutdown_connections 2024-09-12T12:17:55.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 --2- 172.21.15.144:0/3407614036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 0x7f0ea81601d0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 --2- 172.21.15.144:0/3407614036 >> v2:172.21.15.165:3300/0 conn(0x7f0ea815cd30 0x7f0ea80b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 --2- 172.21.15.144:0/3407614036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 0x7f0ea80ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 -- 172.21.15.144:0/3407614036 >> 172.21.15.144:0/3407614036 conn(0x7f0ea806d0d0 msgr2=0x7f0ea806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:55.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 -- 172.21.15.144:0/3407614036 shutdown_connections 2024-09-12T12:17:55.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 -- 172.21.15.144:0/3407614036 wait complete. 2024-09-12T12:17:55.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 Processor -- start 2024-09-12T12:17:55.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 -- start start 2024-09-12T12:17:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 0x7f0ea81533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 0x7f0ea80ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ea815cd30 0x7f0ea80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea8072ec0 con 0x7f0ea80b5de0 2024-09-12T12:17:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea80cd650 con 0x7f0ea815cd30 2024-09-12T12:17:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eb0800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea8073040 con 0x7f0ea815c7b0 2024-09-12T12:17:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 0x7f0ea81533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 0x7f0ea81533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53262/0 (socket says 172.21.15.144:53262) 2024-09-12T12:17:55.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.442+0000 7f0eade00640 1 -- 172.21.15.144:0/290218660 learned_addr learned my addr 172.21.15.144:0/290218660 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:55.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eae800640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ea815cd30 0x7f0ea80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0ead400640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 0x7f0ea80ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eade00640 1 -- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 msgr2=0x7f0ea80ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eade00640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 0x7f0ea80ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eade00640 1 -- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ea815cd30 msgr2=0x7f0ea80b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eade00640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ea815cd30 0x7f0ea80b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eade00640 1 -- 172.21.15.144:0/290218660 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea8153d40 con 0x7f0ea80b5de0 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0ead400640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 0x7f0ea80ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eae800640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ea815cd30 0x7f0ea80b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eade00640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 0x7f0ea81533d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00e8d0 tx=0x7f0e9c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0ea2000640 1 -- 172.21.15.144:0/290218660 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c017070 con 0x7f0ea80b5de0 2024-09-12T12:17:55.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0ea2000640 1 -- 172.21.15.144:0/290218660 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9c00c940 con 0x7f0ea80b5de0 2024-09-12T12:17:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea80b4200 con 0x7f0ea80b5de0 2024-09-12T12:17:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0ea2000640 1 -- 172.21.15.144:0/290218660 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00cd10 con 0x7f0ea80b5de0 2024-09-12T12:17:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea80abb80 con 0x7f0ea80b5de0 2024-09-12T12:17:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea80ccf00 con 0x7f0ea80b5de0 2024-09-12T12:17:55.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0ea2000640 1 -- 172.21.15.144:0/290218660 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e9c01a070 con 0x7f0ea80b5de0 2024-09-12T12:17:55.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0ea2000640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e8c0678c0 0x7f0e8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0ea2000640 1 -- 172.21.15.144:0/290218660 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f0e9c085df0 con 0x7f0ea80b5de0 2024-09-12T12:17:55.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.446+0000 7f0ead400640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e8c0678c0 0x7f0e8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.450+0000 7f0ead400640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e8c0678c0 0x7f0e8c069d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0ea815be30 tx=0x7f0e98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.454+0000 7f0ea2000640 1 -- 172.21.15.144:0/290218660 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e9c056790 con 0x7f0ea80b5de0 2024-09-12T12:17:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.606+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ea81569b0 con 0x7f0e8c0678c0 2024-09-12T12:17:55.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.614+0000 7f0ea2000640 1 -- 172.21.15.144:0/290218660 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252075 (secure 0 0 0) 0x7f0ea81569b0 con 0x7f0e8c0678c0 2024-09-12T12:17:55.619 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:55.620 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:17:55.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e8c0678c0 msgr2=0x7f0e8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e8c0678c0 0x7f0e8c069d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0ea815be30 tx=0x7f0e98008040 comp rx=0 tx=0).stop 2024-09-12T12:17:55.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 msgr2=0x7f0ea81533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 0x7f0ea81533d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00e8d0 tx=0x7f0e9c00ed90 comp rx=0 tx=0).stop 2024-09-12T12:17:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 shutdown_connections 2024-09-12T12:17:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0e8c0678c0 0x7f0e8c069d80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ea815cd30 0x7f0ea80b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ea815c7b0 0x7f0ea80ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 --2- 172.21.15.144:0/290218660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ea80b5de0 0x7f0ea81533d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 >> 172.21.15.144:0/290218660 conn(0x7f0ea806d0d0 msgr2=0x7f0ea80b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 shutdown_connections 2024-09-12T12:17:55.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.618+0000 7f0eb0800640 1 -- 172.21.15.144:0/290218660 wait complete. 2024-09-12T12:17:55.639 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-12T12:17:55.441447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301800,"kb_used_data":10664,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754672920,"statfs":{"total":773094113280,"available":772785070080,"internally_reserved":0,"allocated":10919936,"data_stored":5684868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":297913905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001019"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177728+0000","last_change":"2024-09-12T12:17:51.193063+0000","last_active":"2024-09-12T12:17:52.177728+0000","last_peered":"2024-09-12T12:17:52.177728+0000","last_clean":"2024-09-12T12:17:52.177728+0000","last_became_active":"2024-09-12T12:17:51.192825+0000","last_became_peered":"2024-09-12T12:17:51.192825+0000","last_unstale":"2024-09-12T12:17:52.177728+0000","last_undegraded":"2024-09-12T12:17:52.177728+0000","last_fullsized":"2024-09-12T12:17:52.177728+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:33.890743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572515+0000","last_change":"2024-09-12T12:17:51.184073+0000","last_active":"2024-09-12T12:17:52.572515+0000","last_peered":"2024-09-12T12:17:52.572515+0000","last_clean":"2024-09-12T12:17:52.572515+0000","last_became_active":"2024-09-12T12:17:51.183697+0000","last_became_peered":"2024-09-12T12:17:51.183697+0000","last_unstale":"2024-09-12T12:17:52.572515+0000","last_undegraded":"2024-09-12T12:17:52.572515+0000","last_fullsized":"2024-09-12T12:17:52.572515+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:12.382336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177521+0000","last_change":"2024-09-12T12:17:51.185067+0000","last_active":"2024-09-12T12:17:52.177521+0000","last_peered":"2024-09-12T12:17:52.177521+0000","last_clean":"2024-09-12T12:17:52.177521+0000","last_became_active":"2024-09-12T12:17:51.184808+0000","last_became_peered":"2024-09-12T12:17:51.184808+0000","last_unstale":"2024-09-12T12:17:52.177521+0000","last_undegraded":"2024-09-12T12:17:52.177521+0000","last_fullsized":"2024-09-12T12:17:52.177521+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:14.989075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574243+0000","last_change":"2024-09-12T12:17:51.186551+0000","last_active":"2024-09-12T12:17:52.574243+0000","last_peered":"2024-09-12T12:17:52.574243+0000","last_clean":"2024-09-12T12:17:52.574243+0000","last_became_active":"2024-09-12T12:17:51.185696+0000","last_became_peered":"2024-09-12T12:17:51.185696+0000","last_unstale":"2024-09-12T12:17:52.574243+0000","last_undegraded":"2024-09-12T12:17:52.574243+0000","last_fullsized":"2024-09-12T12:17:52.574243+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:37.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178480+0000","last_change":"2024-09-12T12:17:51.172912+0000","last_active":"2024-09-12T12:17:52.178480+0000","last_peered":"2024-09-12T12:17:52.178480+0000","last_clean":"2024-09-12T12:17:52.178480+0000","last_became_active":"2024-09-12T12:17:51.172626+0000","last_became_peered":"2024-09-12T12:17:51.172626+0000","last_unstale":"2024-09-12T12:17:52.178480+0000","last_undegraded":"2024-09-12T12:17:52.178480+0000","last_fullsized":"2024-09-12T12:17:52.178480+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:06.966133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573828+0000","last_change":"2024-09-12T12:17:51.194131+0000","last_active":"2024-09-12T12:17:52.573828+0000","last_peered":"2024-09-12T12:17:52.573828+0000","last_clean":"2024-09-12T12:17:52.573828+0000","last_became_active":"2024-09-12T12:17:51.193686+0000","last_became_peered":"2024-09-12T12:17:51.193686+0000","last_unstale":"2024-09-12T12:17:52.573828+0000","last_undegraded":"2024-09-12T12:17:52.573828+0000","last_fullsized":"2024-09-12T12:17:52.573828+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:01.297565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.365882+0000","last_change":"2024-09-12T12:17:51.186688+0000","last_active":"2024-09-12T12:17:52.365882+0000","last_peered":"2024-09-12T12:17:52.365882+0000","last_clean":"2024-09-12T12:17:52.365882+0000","last_became_active":"2024-09-12T12:17:51.186409+0000","last_became_peered":"2024-09-12T12:17:51.186409+0000","last_unstale":"2024-09-12T12:17:52.365882+0000","last_undegraded":"2024-09-12T12:17:52.365882+0000","last_fullsized":"2024-09-12T12:17:52.365882+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:02:26.368435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573492+0000","last_change":"2024-09-12T12:17:51.190403+0000","last_active":"2024-09-12T12:17:52.573492+0000","last_peered":"2024-09-12T12:17:52.573492+0000","last_clean":"2024-09-12T12:17:52.573492+0000","last_became_active":"2024-09-12T12:17:51.190108+0000","last_became_peered":"2024-09-12T12:17:51.190108+0000","last_unstale":"2024-09-12T12:17:52.573492+0000","last_undegraded":"2024-09-12T12:17:52.573492+0000","last_fullsized":"2024-09-12T12:17:52.573492+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:18.269137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178858+0000","last_change":"2024-09-12T12:17:51.188482+0000","last_active":"2024-09-12T12:17:52.178858+0000","last_peered":"2024-09-12T12:17:52.178858+0000","last_clean":"2024-09-12T12:17:52.178858+0000","last_became_active":"2024-09-12T12:17:51.188198+0000","last_became_peered":"2024-09-12T12:17:51.188198+0000","last_unstale":"2024-09-12T12:17:52.178858+0000","last_undegraded":"2024-09-12T12:17:52.178858+0000","last_fullsized":"2024-09-12T12:17:52.178858+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:55.775903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574837+0000","last_change":"2024-09-12T12:17:51.185630+0000","last_active":"2024-09-12T12:17:52.574837+0000","last_peered":"2024-09-12T12:17:52.574837+0000","last_clean":"2024-09-12T12:17:52.574837+0000","last_became_active":"2024-09-12T12:17:51.185338+0000","last_became_peered":"2024-09-12T12:17:51.185338+0000","last_unstale":"2024-09-12T12:17:52.574837+0000","last_undegraded":"2024-09-12T12:17:52.574837+0000","last_fullsized":"2024-09-12T12:17:52.574837+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:41.786057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.179924+0000","last_change":"2024-09-12T12:17:51.201531+0000","last_active":"2024-09-12T12:17:52.179924+0000","last_peered":"2024-09-12T12:17:52.179924+0000","last_clean":"2024-09-12T12:17:52.179924+0000","last_became_active":"2024-09-12T12:17:51.201317+0000","last_became_peered":"2024-09-12T12:17:51.201317+0000","last_unstale":"2024-09-12T12:17:52.179924+0000","last_undegraded":"2024-09-12T12:17:52.179924+0000","last_fullsized":"2024-09-12T12:17:52.179924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:38.971141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574879+0000","last_change":"2024-09-12T12:17:51.178577+0000","last_active":"2024-09-12T12:17:52.574879+0000","last_peered":"2024-09-12T12:17:52.574879+0000","last_clean":"2024-09-12T12:17:52.574879+0000","last_became_active":"2024-09-12T12:17:51.177901+0000","last_became_peered":"2024-09-12T12:17:51.177901+0000","last_unstale":"2024-09-12T12:17:52.574879+0000","last_undegraded":"2024-09-12T12:17:52.574879+0000","last_fullsized":"2024-09-12T12:17:52.574879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:56.261725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.575473+0000","last_change":"2024-09-12T12:17:51.195693+0000","last_active":"2024-09-12T12:17:52.575473+0000","last_peered":"2024-09-12T12:17:52.575473+0000","last_clean":"2024-09-12T12:17:52.575473+0000","last_became_active":"2024-09-12T12:17:51.195423+0000","last_became_peered":"2024-09-12T12:17:51.195423+0000","last_unstale":"2024-09-12T12:17:52.575473+0000","last_undegraded":"2024-09-12T12:17:52.575473+0000","last_fullsized":"2024-09-12T12:17:52.575473+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:54.250985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.179424+0000","last_change":"2024-09-12T12:17:51.185774+0000","last_active":"2024-09-12T12:17:52.179424+0000","last_peered":"2024-09-12T12:17:52.179424+0000","last_clean":"2024-09-12T12:17:52.179424+0000","last_became_active":"2024-09-12T12:17:51.185325+0000","last_became_peered":"2024-09-12T12:17:51.185325+0000","last_unstale":"2024-09-12T12:17:52.179424+0000","last_undegraded":"2024-09-12T12:17:52.179424+0000","last_fullsized":"2024-09-12T12:17:52.179424+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:18.269137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573802+0000","last_change":"2024-09-12T12:17:51.185685+0000","last_active":"2024-09-12T12:17:52.573802+0000","last_peered":"2024-09-12T12:17:52.573802+0000","last_clean":"2024-09-12T12:17:52.573802+0000","last_became_active":"2024-09-12T12:17:51.184702+0000","last_became_peered":"2024-09-12T12:17:51.184702+0000","last_unstale":"2024-09-12T12:17:52.573802+0000","last_undegraded":"2024-09-12T12:17:52.573802+0000","last_fullsized":"2024-09-12T12:17:52.573802+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:38.971141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573305+0000","last_change":"2024-09-12T12:17:51.181319+0000","last_active":"2024-09-12T12:17:52.573305+0000","last_peered":"2024-09-12T12:17:52.573305+0000","last_clean":"2024-09-12T12:17:52.573305+0000","last_became_active":"2024-09-12T12:17:51.181004+0000","last_became_peered":"2024-09-12T12:17:51.181004+0000","last_unstale":"2024-09-12T12:17:52.573305+0000","last_undegraded":"2024-09-12T12:17:52.573305+0000","last_fullsized":"2024-09-12T12:17:52.573305+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:20.809095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574554+0000","last_change":"2024-09-12T12:17:51.178460+0000","last_active":"2024-09-12T12:17:52.574554+0000","last_peered":"2024-09-12T12:17:52.574554+0000","last_clean":"2024-09-12T12:17:52.574554+0000","last_became_active":"2024-09-12T12:17:51.178214+0000","last_became_peered":"2024-09-12T12:17:51.178214+0000","last_unstale":"2024-09-12T12:17:52.574554+0000","last_undegraded":"2024-09-12T12:17:52.574554+0000","last_fullsized":"2024-09-12T12:17:52.574554+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:05.397330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177647+0000","last_change":"2024-09-12T12:17:51.194394+0000","last_active":"2024-09-12T12:17:52.177647+0000","last_peered":"2024-09-12T12:17:52.177647+0000","last_clean":"2024-09-12T12:17:52.177647+0000","last_became_active":"2024-09-12T12:17:51.193964+0000","last_became_peered":"2024-09-12T12:17:51.193964+0000","last_unstale":"2024-09-12T12:17:52.177647+0000","last_undegraded":"2024-09-12T12:17:52.177647+0000","last_fullsized":"2024-09-12T12:17:52.177647+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:13.400816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.179950+0000","last_change":"2024-09-12T12:17:51.191403+0000","last_active":"2024-09-12T12:17:52.179950+0000","last_peered":"2024-09-12T12:17:52.179950+0000","last_clean":"2024-09-12T12:17:52.179950+0000","last_became_active":"2024-09-12T12:17:51.190960+0000","last_became_peered":"2024-09-12T12:17:51.190960+0000","last_unstale":"2024-09-12T12:17:52.179950+0000","last_undegraded":"2024-09-12T12:17:52.179950+0000","last_fullsized":"2024-09-12T12:17:52.179950+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:37.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574385+0000","last_change":"2024-09-12T12:17:51.186325+0000","last_active":"2024-09-12T12:17:52.574385+0000","last_peered":"2024-09-12T12:17:52.574385+0000","last_clean":"2024-09-12T12:17:52.574385+0000","last_became_active":"2024-09-12T12:17:51.185420+0000","last_became_peered":"2024-09-12T12:17:51.185420+0000","last_unstale":"2024-09-12T12:17:52.574385+0000","last_undegraded":"2024-09-12T12:17:52.574385+0000","last_fullsized":"2024-09-12T12:17:52.574385+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:21.853218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178190+0000","last_change":"2024-09-12T12:17:51.191705+0000","last_active":"2024-09-12T12:17:52.178190+0000","last_peered":"2024-09-12T12:17:52.178190+0000","last_clean":"2024-09-12T12:17:52.178190+0000","last_became_active":"2024-09-12T12:17:51.191420+0000","last_became_peered":"2024-09-12T12:17:51.191420+0000","last_unstale":"2024-09-12T12:17:52.178190+0000","last_undegraded":"2024-09-12T12:17:52.178190+0000","last_fullsized":"2024-09-12T12:17:52.178190+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:06.121948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178103+0000","last_change":"2024-09-12T12:17:51.185486+0000","last_active":"2024-09-12T12:17:52.178103+0000","last_peered":"2024-09-12T12:17:52.178103+0000","last_clean":"2024-09-12T12:17:52.178103+0000","last_became_active":"2024-09-12T12:17:51.185220+0000","last_became_peered":"2024-09-12T12:17:51.185220+0000","last_unstale":"2024-09-12T12:17:52.178103+0000","last_undegraded":"2024-09-12T12:17:52.178103+0000","last_fullsized":"2024-09-12T12:17:52.178103+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:51:53.111861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177918+0000","last_change":"2024-09-12T12:17:51.190102+0000","last_active":"2024-09-12T12:17:52.177918+0000","last_peered":"2024-09-12T12:17:52.177918+0000","last_clean":"2024-09-12T12:17:52.177918+0000","last_became_active":"2024-09-12T12:17:51.189606+0000","last_became_peered":"2024-09-12T12:17:51.189606+0000","last_unstale":"2024-09-12T12:17:52.177918+0000","last_undegraded":"2024-09-12T12:17:52.177918+0000","last_fullsized":"2024-09-12T12:17:52.177918+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:53.949107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177295+0000","last_change":"2024-09-12T12:17:51.178092+0000","last_active":"2024-09-12T12:17:52.177295+0000","last_peered":"2024-09-12T12:17:52.177295+0000","last_clean":"2024-09-12T12:17:52.177295+0000","last_became_active":"2024-09-12T12:17:51.177120+0000","last_became_peered":"2024-09-12T12:17:51.177120+0000","last_unstale":"2024-09-12T12:17:52.177295+0000","last_undegraded":"2024-09-12T12:17:52.177295+0000","last_fullsized":"2024-09-12T12:17:52.177295+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:59.105724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572584+0000","last_change":"2024-09-12T12:17:51.186661+0000","last_active":"2024-09-12T12:17:52.572584+0000","last_peered":"2024-09-12T12:17:52.572584+0000","last_clean":"2024-09-12T12:17:52.572584+0000","last_became_active":"2024-09-12T12:17:51.186400+0000","last_became_peered":"2024-09-12T12:17:51.186400+0000","last_unstale":"2024-09-12T12:17:52.572584+0000","last_undegraded":"2024-09-12T12:17:52.572584+0000","last_fullsized":"2024-09-12T12:17:52.572584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:06.303121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.179754+0000","last_change":"2024-09-12T12:17:51.185751+0000","last_active":"2024-09-12T12:17:52.179754+0000","last_peered":"2024-09-12T12:17:52.179754+0000","last_clean":"2024-09-12T12:17:52.179754+0000","last_became_active":"2024-09-12T12:17:51.185473+0000","last_became_peered":"2024-09-12T12:17:51.185473+0000","last_unstale":"2024-09-12T12:17:52.179754+0000","last_undegraded":"2024-09-12T12:17:52.179754+0000","last_fullsized":"2024-09-12T12:17:52.179754+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:09.052888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574842+0000","last_change":"2024-09-12T12:17:51.176360+0000","last_active":"2024-09-12T12:17:52.574842+0000","last_peered":"2024-09-12T12:17:52.574842+0000","last_clean":"2024-09-12T12:17:52.574842+0000","last_became_active":"2024-09-12T12:17:51.176131+0000","last_became_peered":"2024-09-12T12:17:51.176131+0000","last_unstale":"2024-09-12T12:17:52.574842+0000","last_undegraded":"2024-09-12T12:17:52.574842+0000","last_fullsized":"2024-09-12T12:17:52.574842+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:02:58.358806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574547+0000","last_change":"2024-09-12T12:17:51.186761+0000","last_active":"2024-09-12T12:17:52.574547+0000","last_peered":"2024-09-12T12:17:52.574547+0000","last_clean":"2024-09-12T12:17:52.574547+0000","last_became_active":"2024-09-12T12:17:51.186039+0000","last_became_peered":"2024-09-12T12:17:51.186039+0000","last_unstale":"2024-09-12T12:17:52.574547+0000","last_undegraded":"2024-09-12T12:17:52.574547+0000","last_fullsized":"2024-09-12T12:17:52.574547+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:29:35.405244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.366010+0000","last_change":"2024-09-12T12:17:51.188482+0000","last_active":"2024-09-12T12:17:52.366010+0000","last_peered":"2024-09-12T12:17:52.366010+0000","last_clean":"2024-09-12T12:17:52.366010+0000","last_became_active":"2024-09-12T12:17:51.188226+0000","last_became_peered":"2024-09-12T12:17:51.188226+0000","last_unstale":"2024-09-12T12:17:52.366010+0000","last_undegraded":"2024-09-12T12:17:52.366010+0000","last_fullsized":"2024-09-12T12:17:52.366010+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:42:53.393706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178328+0000","last_change":"2024-09-12T12:17:51.191903+0000","last_active":"2024-09-12T12:17:52.178328+0000","last_peered":"2024-09-12T12:17:52.178328+0000","last_clean":"2024-09-12T12:17:52.178328+0000","last_became_active":"2024-09-12T12:17:51.191626+0000","last_became_peered":"2024-09-12T12:17:51.191626+0000","last_unstale":"2024-09-12T12:17:52.178328+0000","last_undegraded":"2024-09-12T12:17:52.178328+0000","last_fullsized":"2024-09-12T12:17:52.178328+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:49.531223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572189+0000","last_change":"2024-09-12T12:17:51.203032+0000","last_active":"2024-09-12T12:17:52.572189+0000","last_peered":"2024-09-12T12:17:52.572189+0000","last_clean":"2024-09-12T12:17:52.572189+0000","last_became_active":"2024-09-12T12:17:51.202777+0000","last_became_peered":"2024-09-12T12:17:51.202777+0000","last_unstale":"2024-09-12T12:17:52.572189+0000","last_undegraded":"2024-09-12T12:17:52.572189+0000","last_fullsized":"2024-09-12T12:17:52.572189+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:19.873061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573263+0000","last_change":"2024-09-12T12:17:51.181163+0000","last_active":"2024-09-12T12:17:52.573263+0000","last_peered":"2024-09-12T12:17:52.573263+0000","last_clean":"2024-09-12T12:17:52.573263+0000","last_became_active":"2024-09-12T12:17:51.180759+0000","last_became_peered":"2024-09-12T12:17:51.180759+0000","last_unstale":"2024-09-12T12:17:52.573263+0000","last_undegraded":"2024-09-12T12:17:52.573263+0000","last_fullsized":"2024-09-12T12:17:52.573263+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:16.043541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574623+0000","last_change":"2024-09-12T12:17:51.186796+0000","last_active":"2024-09-12T12:17:52.574623+0000","last_peered":"2024-09-12T12:17:52.574623+0000","last_clean":"2024-09-12T12:17:52.574623+0000","last_became_active":"2024-09-12T12:17:51.186571+0000","last_became_peered":"2024-09-12T12:17:51.186571+0000","last_unstale":"2024-09-12T12:17:52.574623+0000","last_undegraded":"2024-09-12T12:17:52.574623+0000","last_fullsized":"2024-09-12T12:17:52.574623+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:32.844527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.179464+0000","last_change":"2024-09-12T12:17:50.177082+0000","last_active":"2024-09-12T12:17:52.179464+0000","last_peered":"2024-09-12T12:17:52.179464+0000","last_clean":"2024-09-12T12:17:52.179464+0000","last_became_active":"2024-09-12T12:17:50.176713+0000","last_became_peered":"2024-09-12T12:17:50.176713+0000","last_unstale":"2024-09-12T12:17:52.179464+0000","last_undegraded":"2024-09-12T12:17:52.179464+0000","last_fullsized":"2024-09-12T12:17:52.179464+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:28.702604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574787+0000","last_change":"2024-09-12T12:17:51.177572+0000","last_active":"2024-09-12T12:17:52.574787+0000","last_peered":"2024-09-12T12:17:52.574787+0000","last_clean":"2024-09-12T12:17:52.574787+0000","last_became_active":"2024-09-12T12:17:51.177271+0000","last_became_peered":"2024-09-12T12:17:51.177271+0000","last_unstale":"2024-09-12T12:17:52.574787+0000","last_undegraded":"2024-09-12T12:17:52.574787+0000","last_fullsized":"2024-09-12T12:17:52.574787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:56:21.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.179800+0000","last_change":"2024-09-12T12:17:50.172496+0000","last_active":"2024-09-12T12:17:52.179800+0000","last_peered":"2024-09-12T12:17:52.179800+0000","last_clean":"2024-09-12T12:17:52.179800+0000","last_became_active":"2024-09-12T12:17:50.172199+0000","last_became_peered":"2024-09-12T12:17:50.172199+0000","last_unstale":"2024-09-12T12:17:52.179800+0000","last_undegraded":"2024-09-12T12:17:52.179800+0000","last_fullsized":"2024-09-12T12:17:52.179800+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:50.502048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.366097+0000","last_change":"2024-09-12T12:17:51.190966+0000","last_active":"2024-09-12T12:17:52.366097+0000","last_peered":"2024-09-12T12:17:52.366097+0000","last_clean":"2024-09-12T12:17:52.366097+0000","last_became_active":"2024-09-12T12:17:51.190710+0000","last_became_peered":"2024-09-12T12:17:51.190710+0000","last_unstale":"2024-09-12T12:17:52.366097+0000","last_undegraded":"2024-09-12T12:17:52.366097+0000","last_fullsized":"2024-09-12T12:17:52.366097+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:03.930043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.365938+0000","last_change":"2024-09-12T12:17:50.180656+0000","last_active":"2024-09-12T12:17:52.365938+0000","last_peered":"2024-09-12T12:17:52.365938+0000","last_clean":"2024-09-12T12:17:52.365938+0000","last_became_active":"2024-09-12T12:17:50.180366+0000","last_became_peered":"2024-09-12T12:17:50.180366+0000","last_unstale":"2024-09-12T12:17:52.365938+0000","last_undegraded":"2024-09-12T12:17:52.365938+0000","last_fullsized":"2024-09-12T12:17:52.365938+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:48.374896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574965+0000","last_change":"2024-09-12T12:17:51.192292+0000","last_active":"2024-09-12T12:17:52.574965+0000","last_peered":"2024-09-12T12:17:52.574965+0000","last_clean":"2024-09-12T12:17:52.574965+0000","last_became_active":"2024-09-12T12:17:51.191317+0000","last_became_peered":"2024-09-12T12:17:51.191317+0000","last_unstale":"2024-09-12T12:17:52.574965+0000","last_undegraded":"2024-09-12T12:17:52.574965+0000","last_fullsized":"2024-09-12T12:17:52.574965+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:25.145978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178536+0000","last_change":"2024-09-12T12:17:50.183720+0000","last_active":"2024-09-12T12:17:52.178536+0000","last_peered":"2024-09-12T12:17:52.178536+0000","last_clean":"2024-09-12T12:17:52.178536+0000","last_became_active":"2024-09-12T12:17:50.183504+0000","last_became_peered":"2024-09-12T12:17:50.183504+0000","last_unstale":"2024-09-12T12:17:52.178536+0000","last_undegraded":"2024-09-12T12:17:52.178536+0000","last_fullsized":"2024-09-12T12:17:52.178536+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:26.709608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573588+0000","last_change":"2024-09-12T12:17:51.186097+0000","last_active":"2024-09-12T12:17:52.573588+0000","last_peered":"2024-09-12T12:17:52.573588+0000","last_clean":"2024-09-12T12:17:52.573588+0000","last_became_active":"2024-09-12T12:17:51.185749+0000","last_became_peered":"2024-09-12T12:17:51.185749+0000","last_unstale":"2024-09-12T12:17:52.573588+0000","last_undegraded":"2024-09-12T12:17:52.573588+0000","last_fullsized":"2024-09-12T12:17:52.573588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:09.052888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178540+0000","last_change":"2024-09-12T12:17:50.171910+0000","last_active":"2024-09-12T12:17:52.178540+0000","last_peered":"2024-09-12T12:17:52.178540+0000","last_clean":"2024-09-12T12:17:52.178540+0000","last_became_active":"2024-09-12T12:17:50.171543+0000","last_became_peered":"2024-09-12T12:17:50.171543+0000","last_unstale":"2024-09-12T12:17:52.178540+0000","last_undegraded":"2024-09-12T12:17:52.178540+0000","last_fullsized":"2024-09-12T12:17:52.178540+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:45.582123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178005+0000","last_change":"2024-09-12T12:17:51.202489+0000","last_active":"2024-09-12T12:17:52.178005+0000","last_peered":"2024-09-12T12:17:52.178005+0000","last_clean":"2024-09-12T12:17:52.178005+0000","last_became_active":"2024-09-12T12:17:51.202204+0000","last_became_peered":"2024-09-12T12:17:51.202204+0000","last_unstale":"2024-09-12T12:17:52.178005+0000","last_undegraded":"2024-09-12T12:17:52.178005+0000","last_fullsized":"2024-09-12T12:17:52.178005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:38.971141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574535+0000","last_change":"2024-09-12T12:17:50.189483+0000","last_active":"2024-09-12T12:17:52.574535+0000","last_peered":"2024-09-12T12:17:52.574535+0000","last_clean":"2024-09-12T12:17:52.574535+0000","last_became_active":"2024-09-12T12:17:50.189096+0000","last_became_peered":"2024-09-12T12:17:50.189096+0000","last_unstale":"2024-09-12T12:17:52.574535+0000","last_undegraded":"2024-09-12T12:17:52.574535+0000","last_fullsized":"2024-09-12T12:17:52.574535+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:28.405699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574098+0000","last_change":"2024-09-12T12:17:51.193918+0000","last_active":"2024-09-12T12:17:52.574098+0000","last_peered":"2024-09-12T12:17:52.574098+0000","last_clean":"2024-09-12T12:17:52.574098+0000","last_became_active":"2024-09-12T12:17:51.193331+0000","last_became_peered":"2024-09-12T12:17:51.193331+0000","last_unstale":"2024-09-12T12:17:52.574098+0000","last_undegraded":"2024-09-12T12:17:52.574098+0000","last_fullsized":"2024-09-12T12:17:52.574098+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:56.149797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177227+0000","last_change":"2024-09-12T12:17:50.183812+0000","last_active":"2024-09-12T12:17:52.177227+0000","last_peered":"2024-09-12T12:17:52.177227+0000","last_clean":"2024-09-12T12:17:52.177227+0000","last_became_active":"2024-09-12T12:17:50.183417+0000","last_became_peered":"2024-09-12T12:17:50.183417+0000","last_unstale":"2024-09-12T12:17:52.177227+0000","last_undegraded":"2024-09-12T12:17:52.177227+0000","last_fullsized":"2024-09-12T12:17:52.177227+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:36.762704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.575359+0000","last_change":"2024-09-12T12:17:51.189219+0000","last_active":"2024-09-12T12:17:52.575359+0000","last_peered":"2024-09-12T12:17:52.575359+0000","last_clean":"2024-09-12T12:17:52.575359+0000","last_became_active":"2024-09-12T12:17:51.188898+0000","last_became_peered":"2024-09-12T12:17:51.188898+0000","last_unstale":"2024-09-12T12:17:52.575359+0000","last_undegraded":"2024-09-12T12:17:52.575359+0000","last_fullsized":"2024-09-12T12:17:52.575359+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:19.873061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.365740+0000","last_change":"2024-09-12T12:17:50.179572+0000","last_active":"2024-09-12T12:17:52.365740+0000","last_peered":"2024-09-12T12:17:52.365740+0000","last_clean":"2024-09-12T12:17:52.365740+0000","last_became_active":"2024-09-12T12:17:50.179284+0000","last_became_peered":"2024-09-12T12:17:50.179284+0000","last_unstale":"2024-09-12T12:17:52.365740+0000","last_undegraded":"2024-09-12T12:17:52.365740+0000","last_fullsized":"2024-09-12T12:17:52.365740+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:53.247785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178962+0000","last_change":"2024-09-12T12:17:51.177523+0000","last_active":"2024-09-12T12:17:52.178962+0000","last_peered":"2024-09-12T12:17:52.178962+0000","last_clean":"2024-09-12T12:17:52.178962+0000","last_became_active":"2024-09-12T12:17:51.177206+0000","last_became_peered":"2024-09-12T12:17:51.177206+0000","last_unstale":"2024-09-12T12:17:52.178962+0000","last_undegraded":"2024-09-12T12:17:52.178962+0000","last_fullsized":"2024-09-12T12:17:52.178962+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:00.242031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572622+0000","last_change":"2024-09-12T12:17:50.178098+0000","last_active":"2024-09-12T12:17:52.572622+0000","last_peered":"2024-09-12T12:17:52.572622+0000","last_clean":"2024-09-12T12:17:52.572622+0000","last_became_active":"2024-09-12T12:17:50.177809+0000","last_became_peered":"2024-09-12T12:17:50.177809+0000","last_unstale":"2024-09-12T12:17:52.572622+0000","last_undegraded":"2024-09-12T12:17:52.572622+0000","last_fullsized":"2024-09-12T12:17:52.572622+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:05.962933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.366008+0000","last_change":"2024-09-12T12:17:51.192993+0000","last_active":"2024-09-12T12:17:52.366008+0000","last_peered":"2024-09-12T12:17:52.366008+0000","last_clean":"2024-09-12T12:17:52.366008+0000","last_became_active":"2024-09-12T12:17:51.192725+0000","last_became_peered":"2024-09-12T12:17:51.192725+0000","last_unstale":"2024-09-12T12:17:52.366008+0000","last_undegraded":"2024-09-12T12:17:52.366008+0000","last_fullsized":"2024-09-12T12:17:52.366008+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:39.330170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177695+0000","last_change":"2024-09-12T12:17:50.190735+0000","last_active":"2024-09-12T12:17:52.177695+0000","last_peered":"2024-09-12T12:17:52.177695+0000","last_clean":"2024-09-12T12:17:52.177695+0000","last_became_active":"2024-09-12T12:17:50.190452+0000","last_became_peered":"2024-09-12T12:17:50.190452+0000","last_unstale":"2024-09-12T12:17:52.177695+0000","last_undegraded":"2024-09-12T12:17:52.177695+0000","last_fullsized":"2024-09-12T12:17:52.177695+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:02:25.365234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177660+0000","last_change":"2024-09-12T12:17:51.190379+0000","last_active":"2024-09-12T12:17:52.177660+0000","last_peered":"2024-09-12T12:17:52.177660+0000","last_clean":"2024-09-12T12:17:52.177660+0000","last_became_active":"2024-09-12T12:17:51.189391+0000","last_became_peered":"2024-09-12T12:17:51.189391+0000","last_unstale":"2024-09-12T12:17:52.177660+0000","last_undegraded":"2024-09-12T12:17:52.177660+0000","last_fullsized":"2024-09-12T12:17:52.177660+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:27.223640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"97'3","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.180016+0000","last_change":"2024-09-12T12:17:50.164344+0000","last_active":"2024-09-12T12:17:52.180016+0000","last_peered":"2024-09-12T12:17:52.180016+0000","last_clean":"2024-09-12T12:17:52.180016+0000","last_became_active":"2024-09-12T12:17:50.164036+0000","last_became_peered":"2024-09-12T12:17:50.164036+0000","last_unstale":"2024-09-12T12:17:52.180016+0000","last_undegraded":"2024-09-12T12:17:52.180016+0000","last_fullsized":"2024-09-12T12:17:52.180016+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:47.167863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.575057+0000","last_change":"2024-09-12T12:17:51.199775+0000","last_active":"2024-09-12T12:17:52.575057+0000","last_peered":"2024-09-12T12:17:52.575057+0000","last_clean":"2024-09-12T12:17:52.575057+0000","last_became_active":"2024-09-12T12:17:51.199549+0000","last_became_peered":"2024-09-12T12:17:51.199549+0000","last_unstale":"2024-09-12T12:17:52.575057+0000","last_undegraded":"2024-09-12T12:17:52.575057+0000","last_fullsized":"2024-09-12T12:17:52.575057+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:25.491942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"97'6","reported_seq":20,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574833+0000","last_change":"2024-09-12T12:17:50.177682+0000","last_active":"2024-09-12T12:17:52.574833+0000","last_peered":"2024-09-12T12:17:52.574833+0000","last_clean":"2024-09-12T12:17:52.574833+0000","last_became_active":"2024-09-12T12:17:50.177304+0000","last_became_peered":"2024-09-12T12:17:50.177304+0000","last_unstale":"2024-09-12T12:17:52.574833+0000","last_undegraded":"2024-09-12T12:17:52.574833+0000","last_fullsized":"2024-09-12T12:17:52.574833+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:21:33.578222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573735+0000","last_change":"2024-09-12T12:17:51.190393+0000","last_active":"2024-09-12T12:17:52.573735+0000","last_peered":"2024-09-12T12:17:52.573735+0000","last_clean":"2024-09-12T12:17:52.573735+0000","last_became_active":"2024-09-12T12:17:51.190074+0000","last_became_peered":"2024-09-12T12:17:51.190074+0000","last_unstale":"2024-09-12T12:17:52.573735+0000","last_undegraded":"2024-09-12T12:17:52.573735+0000","last_fullsized":"2024-09-12T12:17:52.573735+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:53.949107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.365862+0000","last_change":"2024-09-12T12:17:50.180432+0000","last_active":"2024-09-12T12:17:52.365862+0000","last_peered":"2024-09-12T12:17:52.365862+0000","last_clean":"2024-09-12T12:17:52.365862+0000","last_became_active":"2024-09-12T12:17:50.180036+0000","last_became_peered":"2024-09-12T12:17:50.180036+0000","last_unstale":"2024-09-12T12:17:52.365862+0000","last_undegraded":"2024-09-12T12:17:52.365862+0000","last_fullsized":"2024-09-12T12:17:52.365862+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:41.449491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178029+0000","last_change":"2024-09-12T12:17:51.182405+0000","last_active":"2024-09-12T12:17:52.178029+0000","last_peered":"2024-09-12T12:17:52.178029+0000","last_clean":"2024-09-12T12:17:52.178029+0000","last_became_active":"2024-09-12T12:17:51.176801+0000","last_became_peered":"2024-09-12T12:17:51.176801+0000","last_unstale":"2024-09-12T12:17:52.178029+0000","last_undegraded":"2024-09-12T12:17:52.178029+0000","last_fullsized":"2024-09-12T12:17:52.178029+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:52:27.712808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573975+0000","last_change":"2024-09-12T12:17:50.170928+0000","last_active":"2024-09-12T12:17:52.573975+0000","last_peered":"2024-09-12T12:17:52.573975+0000","last_clean":"2024-09-12T12:17:52.573975+0000","last_became_active":"2024-09-12T12:17:50.170502+0000","last_became_peered":"2024-09-12T12:17:50.170502+0000","last_unstale":"2024-09-12T12:17:52.573975+0000","last_undegraded":"2024-09-12T12:17:52.573975+0000","last_fullsized":"2024-09-12T12:17:52.573975+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:48.691049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573828+0000","last_change":"2024-09-12T12:17:51.186762+0000","last_active":"2024-09-12T12:17:52.573828+0000","last_peered":"2024-09-12T12:17:52.573828+0000","last_clean":"2024-09-12T12:17:52.573828+0000","last_became_active":"2024-09-12T12:17:51.186473+0000","last_became_peered":"2024-09-12T12:17:51.186473+0000","last_unstale":"2024-09-12T12:17:52.573828+0000","last_undegraded":"2024-09-12T12:17:52.573828+0000","last_fullsized":"2024-09-12T12:17:52.573828+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:34.637684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573929+0000","last_change":"2024-09-12T12:17:50.181508+0000","last_active":"2024-09-12T12:17:52.573929+0000","last_peered":"2024-09-12T12:17:52.573929+0000","last_clean":"2024-09-12T12:17:52.573929+0000","last_became_active":"2024-09-12T12:17:50.180358+0000","last_became_peered":"2024-09-12T12:17:50.180358+0000","last_unstale":"2024-09-12T12:17:52.573929+0000","last_undegraded":"2024-09-12T12:17:52.573929+0000","last_fullsized":"2024-09-12T12:17:52.573929+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:05:08.262540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574434+0000","last_change":"2024-09-12T12:17:51.193176+0000","last_active":"2024-09-12T12:17:52.574434+0000","last_peered":"2024-09-12T12:17:52.574434+0000","last_clean":"2024-09-12T12:17:52.574434+0000","last_became_active":"2024-09-12T12:17:51.192909+0000","last_became_peered":"2024-09-12T12:17:51.192909+0000","last_unstale":"2024-09-12T12:17:52.574434+0000","last_undegraded":"2024-09-12T12:17:52.574434+0000","last_fullsized":"2024-09-12T12:17:52.574434+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:51.103100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"97'8","reported_seq":22,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573644+0000","last_change":"2024-09-12T12:17:50.187483+0000","last_active":"2024-09-12T12:17:52.573644+0000","last_peered":"2024-09-12T12:17:52.573644+0000","last_clean":"2024-09-12T12:17:52.573644+0000","last_became_active":"2024-09-12T12:17:50.187240+0000","last_became_peered":"2024-09-12T12:17:50.187240+0000","last_unstale":"2024-09-12T12:17:52.573644+0000","last_undegraded":"2024-09-12T12:17:52.573644+0000","last_fullsized":"2024-09-12T12:17:52.573644+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:34.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574776+0000","last_change":"2024-09-12T12:17:51.179617+0000","last_active":"2024-09-12T12:17:52.574776+0000","last_peered":"2024-09-12T12:17:52.574776+0000","last_clean":"2024-09-12T12:17:52.574776+0000","last_became_active":"2024-09-12T12:17:51.179355+0000","last_became_peered":"2024-09-12T12:17:51.179355+0000","last_unstale":"2024-09-12T12:17:52.574776+0000","last_undegraded":"2024-09-12T12:17:52.574776+0000","last_fullsized":"2024-09-12T12:17:52.574776+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:40.853656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.179536+0000","last_change":"2024-09-12T12:17:50.175364+0000","last_active":"2024-09-12T12:17:52.179536+0000","last_peered":"2024-09-12T12:17:52.179536+0000","last_clean":"2024-09-12T12:17:52.179536+0000","last_became_active":"2024-09-12T12:17:50.175006+0000","last_became_peered":"2024-09-12T12:17:50.175006+0000","last_unstale":"2024-09-12T12:17:52.179536+0000","last_undegraded":"2024-09-12T12:17:52.179536+0000","last_fullsized":"2024-09-12T12:17:52.179536+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:51:52.108661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178785+0000","last_change":"2024-09-12T12:17:51.187610+0000","last_active":"2024-09-12T12:17:52.178785+0000","last_peered":"2024-09-12T12:17:52.178785+0000","last_clean":"2024-09-12T12:17:52.178785+0000","last_became_active":"2024-09-12T12:17:51.187322+0000","last_became_peered":"2024-09-12T12:17:51.187322+0000","last_unstale":"2024-09-12T12:17:52.178785+0000","last_undegraded":"2024-09-12T12:17:52.178785+0000","last_fullsized":"2024-09-12T12:17:52.178785+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:21.853218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.366004+0000","last_change":"2024-09-12T12:17:50.181110+0000","last_active":"2024-09-12T12:17:52.366004+0000","last_peered":"2024-09-12T12:17:52.366004+0000","last_clean":"2024-09-12T12:17:52.366004+0000","last_became_active":"2024-09-12T12:17:50.180808+0000","last_became_peered":"2024-09-12T12:17:50.180808+0000","last_unstale":"2024-09-12T12:17:52.366004+0000","last_undegraded":"2024-09-12T12:17:52.366004+0000","last_fullsized":"2024-09-12T12:17:52.366004+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:05.299921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.179811+0000","last_change":"2024-09-12T12:17:51.181784+0000","last_active":"2024-09-12T12:17:52.179811+0000","last_peered":"2024-09-12T12:17:52.179811+0000","last_clean":"2024-09-12T12:17:52.179811+0000","last_became_active":"2024-09-12T12:17:51.177172+0000","last_became_peered":"2024-09-12T12:17:51.177172+0000","last_unstale":"2024-09-12T12:17:52.179811+0000","last_undegraded":"2024-09-12T12:17:52.179811+0000","last_fullsized":"2024-09-12T12:17:52.179811+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:38:53.949107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.180026+0000","last_change":"2024-09-12T12:17:50.185425+0000","last_active":"2024-09-12T12:17:52.180026+0000","last_peered":"2024-09-12T12:17:52.180026+0000","last_clean":"2024-09-12T12:17:52.180026+0000","last_became_active":"2024-09-12T12:17:50.185051+0000","last_became_peered":"2024-09-12T12:17:50.185051+0000","last_unstale":"2024-09-12T12:17:52.180026+0000","last_undegraded":"2024-09-12T12:17:52.180026+0000","last_fullsized":"2024-09-12T12:17:52.180026+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:37.570389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573410+0000","last_change":"2024-09-12T12:17:51.203196+0000","last_active":"2024-09-12T12:17:52.573410+0000","last_peered":"2024-09-12T12:17:52.573410+0000","last_clean":"2024-09-12T12:17:52.573410+0000","last_became_active":"2024-09-12T12:17:51.202710+0000","last_became_peered":"2024-09-12T12:17:51.202710+0000","last_unstale":"2024-09-12T12:17:52.573410+0000","last_undegraded":"2024-09-12T12:17:52.573410+0000","last_fullsized":"2024-09-12T12:17:52.573410+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:48.900720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572102+0000","last_change":"2024-09-12T12:17:50.181769+0000","last_active":"2024-09-12T12:17:52.572102+0000","last_peered":"2024-09-12T12:17:52.572102+0000","last_clean":"2024-09-12T12:17:52.572102+0000","last_became_active":"2024-09-12T12:17:50.181430+0000","last_became_peered":"2024-09-12T12:17:50.181430+0000","last_unstale":"2024-09-12T12:17:52.572102+0000","last_undegraded":"2024-09-12T12:17:52.572102+0000","last_fullsized":"2024-09-12T12:17:52.572102+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:48.528022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572321+0000","last_change":"2024-09-12T12:17:51.185355+0000","last_active":"2024-09-12T12:17:52.572321+0000","last_peered":"2024-09-12T12:17:52.572321+0000","last_clean":"2024-09-12T12:17:52.572321+0000","last_became_active":"2024-09-12T12:17:51.185028+0000","last_became_peered":"2024-09-12T12:17:51.185028+0000","last_unstale":"2024-09-12T12:17:52.572321+0000","last_undegraded":"2024-09-12T12:17:52.572321+0000","last_fullsized":"2024-09-12T12:17:52.572321+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:26.845971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574163+0000","last_change":"2024-09-12T12:17:50.190658+0000","last_active":"2024-09-12T12:17:52.574163+0000","last_peered":"2024-09-12T12:17:52.574163+0000","last_clean":"2024-09-12T12:17:52.574163+0000","last_became_active":"2024-09-12T12:17:50.190380+0000","last_became_peered":"2024-09-12T12:17:50.190380+0000","last_unstale":"2024-09-12T12:17:52.574163+0000","last_undegraded":"2024-09-12T12:17:52.574163+0000","last_fullsized":"2024-09-12T12:17:52.574163+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:03.887740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572233+0000","last_change":"2024-09-12T12:17:51.198889+0000","last_active":"2024-09-12T12:17:52.572233+0000","last_peered":"2024-09-12T12:17:52.572233+0000","last_clean":"2024-09-12T12:17:52.572233+0000","last_became_active":"2024-09-12T12:17:51.198521+0000","last_became_peered":"2024-09-12T12:17:51.198521+0000","last_unstale":"2024-09-12T12:17:52.572233+0000","last_undegraded":"2024-09-12T12:17:52.572233+0000","last_fullsized":"2024-09-12T12:17:52.572233+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:54.250985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572269+0000","last_change":"2024-09-12T12:17:50.177958+0000","last_active":"2024-09-12T12:17:52.572269+0000","last_peered":"2024-09-12T12:17:52.572269+0000","last_clean":"2024-09-12T12:17:52.572269+0000","last_became_active":"2024-09-12T12:17:50.177601+0000","last_became_peered":"2024-09-12T12:17:50.177601+0000","last_unstale":"2024-09-12T12:17:52.572269+0000","last_undegraded":"2024-09-12T12:17:52.572269+0000","last_fullsized":"2024-09-12T12:17:52.572269+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:54.772702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.575503+0000","last_change":"2024-09-12T12:17:51.180294+0000","last_active":"2024-09-12T12:17:52.575503+0000","last_peered":"2024-09-12T12:17:52.575503+0000","last_clean":"2024-09-12T12:17:52.575503+0000","last_became_active":"2024-09-12T12:17:51.179835+0000","last_became_peered":"2024-09-12T12:17:51.179835+0000","last_unstale":"2024-09-12T12:17:52.575503+0000","last_undegraded":"2024-09-12T12:17:52.575503+0000","last_fullsized":"2024-09-12T12:17:52.575503+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:24.689007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573488+0000","last_change":"2024-09-12T12:17:50.182524+0000","last_active":"2024-09-12T12:17:52.573488+0000","last_peered":"2024-09-12T12:17:52.573488+0000","last_clean":"2024-09-12T12:17:52.573488+0000","last_became_active":"2024-09-12T12:17:50.182212+0000","last_became_peered":"2024-09-12T12:17:50.182212+0000","last_unstale":"2024-09-12T12:17:52.573488+0000","last_undegraded":"2024-09-12T12:17:52.573488+0000","last_fullsized":"2024-09-12T12:17:52.573488+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:00:23.345035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178550+0000","last_change":"2024-09-12T12:17:51.188175+0000","last_active":"2024-09-12T12:17:52.178550+0000","last_peered":"2024-09-12T12:17:52.178550+0000","last_clean":"2024-09-12T12:17:52.178550+0000","last_became_active":"2024-09-12T12:17:51.187896+0000","last_became_peered":"2024-09-12T12:17:51.187896+0000","last_unstale":"2024-09-12T12:17:52.178550+0000","last_undegraded":"2024-09-12T12:17:52.178550+0000","last_fullsized":"2024-09-12T12:17:52.178550+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:37.069573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.366151+0000","last_change":"2024-09-12T12:17:50.179349+0000","last_active":"2024-09-12T12:17:52.366151+0000","last_peered":"2024-09-12T12:17:52.366151+0000","last_clean":"2024-09-12T12:17:52.366151+0000","last_became_active":"2024-09-12T12:17:50.179015+0000","last_became_peered":"2024-09-12T12:17:50.179015+0000","last_unstale":"2024-09-12T12:17:52.366151+0000","last_undegraded":"2024-09-12T12:17:52.366151+0000","last_fullsized":"2024-09-12T12:17:52.366151+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:11.379136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574994+0000","last_change":"2024-09-12T12:17:51.197426+0000","last_active":"2024-09-12T12:17:52.574994+0000","last_peered":"2024-09-12T12:17:52.574994+0000","last_clean":"2024-09-12T12:17:52.574994+0000","last_became_active":"2024-09-12T12:17:51.187309+0000","last_became_peered":"2024-09-12T12:17:51.187309+0000","last_unstale":"2024-09-12T12:17:52.574994+0000","last_undegraded":"2024-09-12T12:17:52.574994+0000","last_fullsized":"2024-09-12T12:17:52.574994+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:40.080532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"98'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.179919+0000","last_change":"2024-09-12T12:17:50.176508+0000","last_active":"2024-09-12T12:17:52.179919+0000","last_peered":"2024-09-12T12:17:52.179919+0000","last_clean":"2024-09-12T12:17:52.179919+0000","last_became_active":"2024-09-12T12:17:50.175964+0000","last_became_peered":"2024-09-12T12:17:50.175964+0000","last_unstale":"2024-09-12T12:17:52.179919+0000","last_undegraded":"2024-09-12T12:17:52.179919+0000","last_fullsized":"2024-09-12T12:17:52.179919+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:41.657295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574431+0000","last_change":"2024-09-12T12:17:51.179685+0000","last_active":"2024-09-12T12:17:52.574431+0000","last_peered":"2024-09-12T12:17:52.574431+0000","last_clean":"2024-09-12T12:17:52.574431+0000","last_became_active":"2024-09-12T12:17:51.179436+0000","last_became_peered":"2024-09-12T12:17:51.179436+0000","last_unstale":"2024-09-12T12:17:52.574431+0000","last_undegraded":"2024-09-12T12:17:52.574431+0000","last_fullsized":"2024-09-12T12:17:52.574431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:18.622560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.180088+0000","last_change":"2024-09-12T12:17:50.171287+0000","last_active":"2024-09-12T12:17:52.180088+0000","last_peered":"2024-09-12T12:17:52.180088+0000","last_clean":"2024-09-12T12:17:52.180088+0000","last_became_active":"2024-09-12T12:17:50.171022+0000","last_became_peered":"2024-09-12T12:17:50.171022+0000","last_unstale":"2024-09-12T12:17:52.180088+0000","last_undegraded":"2024-09-12T12:17:52.180088+0000","last_fullsized":"2024-09-12T12:17:52.180088+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:07.993781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572609+0000","last_change":"2024-09-12T12:17:51.185640+0000","last_active":"2024-09-12T12:17:52.572609+0000","last_peered":"2024-09-12T12:17:52.572609+0000","last_clean":"2024-09-12T12:17:52.572609+0000","last_became_active":"2024-09-12T12:17:51.185344+0000","last_became_peered":"2024-09-12T12:17:51.185344+0000","last_unstale":"2024-09-12T12:17:52.572609+0000","last_undegraded":"2024-09-12T12:17:52.572609+0000","last_fullsized":"2024-09-12T12:17:52.572609+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:42.452692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.178604+0000","last_change":"2024-09-12T12:17:50.173287+0000","last_active":"2024-09-12T12:17:52.178604+0000","last_peered":"2024-09-12T12:17:52.178604+0000","last_clean":"2024-09-12T12:17:52.178604+0000","last_became_active":"2024-09-12T12:17:50.173001+0000","last_became_peered":"2024-09-12T12:17:50.173001+0000","last_unstale":"2024-09-12T12:17:52.178604+0000","last_undegraded":"2024-09-12T12:17:52.178604+0000","last_fullsized":"2024-09-12T12:17:52.178604+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:05.118747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.573322+0000","last_change":"2024-09-12T12:17:51.203774+0000","last_active":"2024-09-12T12:17:52.573322+0000","last_peered":"2024-09-12T12:17:52.573322+0000","last_clean":"2024-09-12T12:17:52.573322+0000","last_became_active":"2024-09-12T12:17:51.203518+0000","last_became_peered":"2024-09-12T12:17:51.203518+0000","last_unstale":"2024-09-12T12:17:52.573322+0000","last_undegraded":"2024-09-12T12:17:52.573322+0000","last_fullsized":"2024-09-12T12:17:52.573322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:04.403913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.575557+0000","last_change":"2024-09-12T12:17:50.176109+0000","last_active":"2024-09-12T12:17:52.575557+0000","last_peered":"2024-09-12T12:17:52.575557+0000","last_clean":"2024-09-12T12:17:52.575557+0000","last_became_active":"2024-09-12T12:17:50.174690+0000","last_became_peered":"2024-09-12T12:17:50.174690+0000","last_unstale":"2024-09-12T12:17:52.575557+0000","last_undegraded":"2024-09-12T12:17:52.575557+0000","last_fullsized":"2024-09-12T12:17:52.575557+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:37.418437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177255+0000","last_change":"2024-09-12T12:17:51.198913+0000","last_active":"2024-09-12T12:17:52.177255+0000","last_peered":"2024-09-12T12:17:52.177255+0000","last_clean":"2024-09-12T12:17:52.177255+0000","last_became_active":"2024-09-12T12:17:51.198352+0000","last_became_peered":"2024-09-12T12:17:51.198352+0000","last_unstale":"2024-09-12T12:17:52.177255+0000","last_undegraded":"2024-09-12T12:17:52.177255+0000","last_fullsized":"2024-09-12T12:17:52.177255+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:03.310025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.572211+0000","last_change":"2024-09-12T12:17:50.180179+0000","last_active":"2024-09-12T12:17:52.572211+0000","last_peered":"2024-09-12T12:17:52.572211+0000","last_clean":"2024-09-12T12:17:52.572211+0000","last_became_active":"2024-09-12T12:17:50.179601+0000","last_became_peered":"2024-09-12T12:17:50.179601+0000","last_unstale":"2024-09-12T12:17:52.572211+0000","last_undegraded":"2024-09-12T12:17:52.572211+0000","last_fullsized":"2024-09-12T12:17:52.572211+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:59.238831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177772+0000","last_change":"2024-09-12T12:17:51.199026+0000","last_active":"2024-09-12T12:17:52.177772+0000","last_peered":"2024-09-12T12:17:52.177772+0000","last_clean":"2024-09-12T12:17:52.177772+0000","last_became_active":"2024-09-12T12:17:51.198589+0000","last_became_peered":"2024-09-12T12:17:51.198589+0000","last_unstale":"2024-09-12T12:17:52.177772+0000","last_undegraded":"2024-09-12T12:17:52.177772+0000","last_fullsized":"2024-09-12T12:17:52.177772+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:09.052888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.177975+0000","last_change":"2024-09-12T12:17:50.170392+0000","last_active":"2024-09-12T12:17:52.177975+0000","last_peered":"2024-09-12T12:17:52.177975+0000","last_clean":"2024-09-12T12:17:52.177975+0000","last_became_active":"2024-09-12T12:17:50.169940+0000","last_became_peered":"2024-09-12T12:17:50.169940+0000","last_unstale":"2024-09-12T12:17:52.177975+0000","last_undegraded":"2024-09-12T12:17:52.177975+0000","last_fullsized":"2024-09-12T12:17:52.177975+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:50.712286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.575504+0000","last_change":"2024-09-12T12:17:51.180092+0000","last_active":"2024-09-12T12:17:52.575504+0000","last_peered":"2024-09-12T12:17:52.575504+0000","last_clean":"2024-09-12T12:17:52.575504+0000","last_became_active":"2024-09-12T12:17:51.179526+0000","last_became_peered":"2024-09-12T12:17:51.179526+0000","last_unstale":"2024-09-12T12:17:52.575504+0000","last_undegraded":"2024-09-12T12:17:52.575504+0000","last_fullsized":"2024-09-12T12:17:52.575504+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:50:50.705127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.365781+0000","last_change":"2024-09-12T12:17:50.189307+0000","last_active":"2024-09-12T12:17:52.365781+0000","last_peered":"2024-09-12T12:17:52.365781+0000","last_clean":"2024-09-12T12:17:52.365781+0000","last_became_active":"2024-09-12T12:17:50.189107+0000","last_became_peered":"2024-09-12T12:17:50.189107+0000","last_unstale":"2024-09-12T12:17:52.365781+0000","last_undegraded":"2024-09-12T12:17:52.365781+0000","last_fullsized":"2024-09-12T12:17:52.365781+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:25.842770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.366225+0000","last_change":"2024-09-12T12:17:51.187408+0000","last_active":"2024-09-12T12:17:52.366225+0000","last_peered":"2024-09-12T12:17:52.366225+0000","last_clean":"2024-09-12T12:17:52.366225+0000","last_became_active":"2024-09-12T12:17:51.187158+0000","last_became_peered":"2024-09-12T12:17:51.187158+0000","last_unstale":"2024-09-12T12:17:52.366225+0000","last_undegraded":"2024-09-12T12:17:52.366225+0000","last_fullsized":"2024-09-12T12:17:52.366225+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:50.151220+0000","last_clean_scrub_stamp":"2024-09-12T12:17:50.151220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:42.290811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.574574+0000","last_change":"2024-09-12T12:17:50.184035+0000","last_active":"2024-09-12T12:17:52.574574+0000","last_peered":"2024-09-12T12:17:52.574574+0000","last_clean":"2024-09-12T12:17:52.574574+0000","last_became_active":"2024-09-12T12:17:50.181175+0000","last_became_peered":"2024-09-12T12:17:50.181175+0000","last_unstale":"2024-09-12T12:17:52.574574+0000","last_undegraded":"2024-09-12T12:17:52.574574+0000","last_fullsized":"2024-09-12T12:17:52.574574+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:17:49.148020+0000","last_clean_scrub_stamp":"2024-09-12T12:17:49.148020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:37.219695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":311,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T12:17:52.365933+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:17:52.365933+0000","last_peered":"2024-09-12T12:17:52.365933+0000","last_clean":"2024-09-12T12:17:52.365933+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:17:52.365933+0000","last_undegraded":"2024-09-12T12:17:52.365933+0000","last_fullsized":"2024-09-12T12:17:52.365933+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37120,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334720,"statfs":{"total":96636764160,"available":96598753280,"internally_reserved":0,"allocated":1810432,"data_stored":1152838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574915,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36548,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335292,"statfs":{"total":96636764160,"available":96599339008,"internally_reserved":0,"allocated":1228800,"data_stored":564630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36536,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335304,"statfs":{"total":96636764160,"available":96599351296,"internally_reserved":0,"allocated":1208320,"data_stored":562414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36536,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335304,"statfs":{"total":96636764160,"available":96599351296,"internally_reserved":0,"allocated":1216512,"data_stored":562574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40696,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331144,"statfs":{"total":96636764160,"available":96595091456,"internally_reserved":0,"allocated":1208320,"data_stored":562414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36528,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335312,"statfs":{"total":96636764160,"available":96599359488,"internally_reserved":0,"allocated":1208320,"data_stored":562414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36536,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335304,"statfs":{"total":96636764160,"available":96599351296,"internally_reserved":0,"allocated":1212416,"data_stored":562484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41300,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330540,"statfs":{"total":96636764160,"available":96594472960,"internally_reserved":0,"allocated":1826816,"data_stored":1155100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:17:55.643 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:17:55.643 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:17:55.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f397b400640 1 Processor -- start 2024-09-12T12:17:55.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f397b400640 1 -- start start 2024-09-12T12:17:55.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f397b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f397415c2e0 0x7f3974072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f397b400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f39740af5f0 0x7f397406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f397b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397406c150 0x7f397406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f397b400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f397406c5c0 con 0x7f397415c2e0 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f397b400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f39740733e0 con 0x7f39740af5f0 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f397b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f39740cd290 con 0x7f397406c150 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3978a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f397415c2e0 0x7f3974072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3978a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f397415c2e0 0x7f3974072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53276/0 (socket says 172.21.15.144:53276) 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3978a00640 1 -- 172.21.15.144:0/2138980367 learned_addr learned my addr 172.21.15.144:0/2138980367 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3979400640 1 --2- 172.21.15.144:0/2138980367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397406c150 0x7f397406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3973e00640 1 --2- 172.21.15.144:0/2138980367 >> v2:172.21.15.165:3300/0 conn(0x7f39740af5f0 0x7f397406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3978a00640 1 -- 172.21.15.144:0/2138980367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397406c150 msgr2=0x7f397406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3978a00640 1 --2- 172.21.15.144:0/2138980367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397406c150 0x7f397406d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3978a00640 1 -- 172.21.15.144:0/2138980367 >> v2:172.21.15.165:3300/0 conn(0x7f39740af5f0 msgr2=0x7f397406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3978a00640 1 --2- 172.21.15.144:0/2138980367 >> v2:172.21.15.165:3300/0 conn(0x7f39740af5f0 0x7f397406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3978a00640 1 -- 172.21.15.144:0/2138980367 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39740cd570 con 0x7f397415c2e0 2024-09-12T12:17:55.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.826+0000 7f3973e00640 1 --2- 172.21.15.144:0/2138980367 >> v2:172.21.15.165:3300/0 conn(0x7f39740af5f0 0x7f397406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f3978a00640 1 --2- 172.21.15.144:0/2138980367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f397415c2e0 0x7f3974072b50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f39740afa60 tx=0x7f396801c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d791f43e021260 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f3973400640 1 -- 172.21.15.144:0/2138980367 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39680b0070 con 0x7f397415c2e0 2024-09-12T12:17:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f3973400640 1 -- 172.21.15.144:0/2138980367 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39680ab600 con 0x7f397415c2e0 2024-09-12T12:17:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f3973400640 1 -- 172.21.15.144:0/2138980367 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39680ab9d0 con 0x7f397415c2e0 2024-09-12T12:17:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f397b400640 1 -- 172.21.15.144:0/2138980367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f397415c2e0 msgr2=0x7f3974072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f397b400640 1 --2- 172.21.15.144:0/2138980367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f397415c2e0 0x7f3974072b50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f39740afa60 tx=0x7f396801c140 comp rx=0 tx=0).stop 2024-09-12T12:17:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f397b400640 1 -- 172.21.15.144:0/2138980367 shutdown_connections 2024-09-12T12:17:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f397b400640 1 --2- 172.21.15.144:0/2138980367 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397406c150 0x7f397406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f397b400640 1 --2- 172.21.15.144:0/2138980367 >> v2:172.21.15.165:3300/0 conn(0x7f39740af5f0 0x7f397406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f397b400640 1 --2- 172.21.15.144:0/2138980367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f397415c2e0 0x7f3974072b50 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f397b400640 1 -- 172.21.15.144:0/2138980367 >> 172.21.15.144:0/2138980367 conn(0x7f3974068030 msgr2=0x7f39740b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f397b400640 1 -- 172.21.15.144:0/2138980367 shutdown_connections 2024-09-12T12:17:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.830+0000 7f397b400640 1 -- 172.21.15.144:0/2138980367 wait complete. 2024-09-12T12:17:55.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 Processor -- start 2024-09-12T12:17:55.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 -- start start 2024-09-12T12:17:55.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f397406c150 0x7f3974148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39740af5f0 0x7f39741546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397415c2e0 0x7f3974154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f39740cdef0 con 0x7f39740af5f0 2024-09-12T12:17:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f39740cdd70 con 0x7f397406c150 2024-09-12T12:17:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f39740ce070 con 0x7f397415c2e0 2024-09-12T12:17:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3973e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39740af5f0 0x7f39741546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3973e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39740af5f0 0x7f39741546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53286/0 (socket says 172.21.15.144:53286) 2024-09-12T12:17:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3973e00640 1 -- 172.21.15.144:0/2458907957 learned_addr learned my addr 172.21.15.144:0/2458907957 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3978a00640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f397406c150 0x7f3974148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3979400640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397415c2e0 0x7f3974154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3973e00640 1 -- 172.21.15.144:0/2458907957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397415c2e0 msgr2=0x7f3974154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3973e00640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397415c2e0 0x7f3974154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3973e00640 1 -- 172.21.15.144:0/2458907957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f397406c150 msgr2=0x7f3974148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3973e00640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f397406c150 0x7f3974148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3973e00640 1 -- 172.21.15.144:0/2458907957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39741523d0 con 0x7f39740af5f0 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3973e00640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39740af5f0 0x7f39741546a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f396000e810 tx=0x7f396000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3970c00640 1 -- 172.21.15.144:0/2458907957 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960017070 con 0x7f39740af5f0 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3970c00640 1 -- 172.21.15.144:0/2458907957 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396000c8d0 con 0x7f39740af5f0 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3974152690 con 0x7f39740af5f0 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f3970c00640 1 -- 172.21.15.144:0/2458907957 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396000f040 con 0x7f39740af5f0 2024-09-12T12:17:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3974152c50 con 0x7f39740af5f0 2024-09-12T12:17:55.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.834+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397406bc10 con 0x7f39740af5f0 2024-09-12T12:17:55.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.838+0000 7f3970c00640 1 -- 172.21.15.144:0/2458907957 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f396001a070 con 0x7f39740af5f0 2024-09-12T12:17:55.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.838+0000 7f3970c00640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f39540678c0 0x7f3954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:55.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.838+0000 7f3970c00640 1 -- 172.21.15.144:0/2458907957 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f3960085960 con 0x7f39740af5f0 2024-09-12T12:17:55.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.838+0000 7f3978a00640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f39540678c0 0x7f3954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:55.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.838+0000 7f3978a00640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f39540678c0 0x7f3954069d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f39680ad000 tx=0x7f39680a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:55.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:55.842+0000 7f3970c00640 1 -- 172.21.15.144:0/2458907957 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3960055cb0 con 0x7f39740af5f0 2024-09-12T12:17:56.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.054+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f39740b15f0 con 0x7f39740af5f0 2024-09-12T12:17:56.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.054+0000 7f3970c00640 1 -- 172.21.15.144:0/2458907957 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f3960059fb0 con 0x7f39740af5f0 2024-09-12T12:17:56.058 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:17:56.058 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:17:56.059 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:17:56.059 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:17:56.059 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:17:56.059 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f39540678c0 msgr2=0x7f3954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f39540678c0 0x7f3954069d80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f39680ad000 tx=0x7f39680a6000 comp rx=0 tx=0).stop 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39740af5f0 msgr2=0x7f39741546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39740af5f0 0x7f39741546a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f396000e810 tx=0x7f396000ecd0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 shutdown_connections 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f39540678c0 0x7f3954069d80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f397415c2e0 0x7f3974154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39740af5f0 0x7f39741546a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 --2- 172.21.15.144:0/2458907957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f397406c150 0x7f3974148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 >> 172.21.15.144:0/2458907957 conn(0x7f3974068030 msgr2=0x7f39740b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:56.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 shutdown_connections 2024-09-12T12:17:56.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.058+0000 7f397b400640 1 -- 172.21.15.144:0/2458907957 wait complete. 2024-09-12T12:17:56.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:56.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3ab6a00640 1 Processor -- start 2024-09-12T12:17:56.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3ab6a00640 1 -- start start 2024-09-12T12:17:56.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3ab6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ab00b4200 0x7f3ab00b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3ab6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 0x7f3ab00b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3ab6a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ab00d1580 con 0x7f3ab015c220 2024-09-12T12:17:56.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3ab6a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab00b4bb0 con 0x7f3ab00b4200 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3ab6a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab00d1320 con 0x7f3ab00b5720 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3aaf400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ab00b4200 0x7f3ab00b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3aaf400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ab00b4200 0x7f3ab00b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53296/0 (socket says 172.21.15.144:53296) 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3aaf400640 1 -- 172.21.15.144:0/1305730758 learned_addr learned my addr 172.21.15.144:0/1305730758 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3ab4a00640 1 --2- 172.21.15.144:0/1305730758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 0x7f3ab00b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3aaf400640 1 -- 172.21.15.144:0/1305730758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 msgr2=0x7f3ab00b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3aaf400640 1 --2- 172.21.15.144:0/1305730758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 0x7f3ab00b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3aaf400640 1 -- 172.21.15.144:0/1305730758 >> v1:172.21.15.165:6789/0 conn(0x7f3ab015c220 legacy=0x7f3ab00d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3aaf400640 1 -- 172.21.15.144:0/1305730758 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab00d1860 con 0x7f3ab00b4200 2024-09-12T12:17:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.214+0000 7f3ab4a00640 1 --2- 172.21.15.144:0/1305730758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 0x7f3ab00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3aaf400640 1 --2- 172.21.15.144:0/1305730758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 0x7f3ab00b4670 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0098a0 tx=0x7f3a9c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f34702dfabd8b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3aaea00640 1 -- 172.21.15.144:0/1305730758 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c0aa670 con 0x7f3ab00b4200 2024-09-12T12:17:56.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3aaea00640 1 -- 172.21.15.144:0/1305730758 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9c0af070 con 0x7f3ab00b4200 2024-09-12T12:17:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3aaea00640 1 -- 172.21.15.144:0/1305730758 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c0aaa30 con 0x7f3ab00b4200 2024-09-12T12:17:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1305730758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 msgr2=0x7f3ab00b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3ab6a00640 1 --2- 172.21.15.144:0/1305730758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 0x7f3ab00b4670 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0098a0 tx=0x7f3a9c01c510 comp rx=0 tx=0).stop 2024-09-12T12:17:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1305730758 shutdown_connections 2024-09-12T12:17:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3ab6a00640 1 --2- 172.21.15.144:0/1305730758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 0x7f3ab00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3ab6a00640 1 --2- 172.21.15.144:0/1305730758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 0x7f3ab00b4670 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1305730758 >> 172.21.15.144:0/1305730758 conn(0x7f3ab006f400 msgr2=0x7f3ab006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1305730758 shutdown_connections 2024-09-12T12:17:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.218+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1305730758 wait complete. 2024-09-12T12:17:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 Processor -- start 2024-09-12T12:17:56.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 -- start start 2024-09-12T12:17:56.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 0x7f3ab01fb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 0x7f3ab006e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ab015c220 0x7f3ab0152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab015c780 con 0x7f3ab00b4200 2024-09-12T12:17:56.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab015c600 con 0x7f3ab015c220 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab0070bf0 con 0x7f3ab00b5720 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 0x7f3ab01fb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 0x7f3ab01fb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53300/0 (socket says 172.21.15.144:53300) 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aafe00640 1 -- 172.21.15.144:0/1261312318 learned_addr learned my addr 172.21.15.144:0/1261312318 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab4a00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ab015c220 0x7f3ab0152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aaf400640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 0x7f3ab006e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aafe00640 1 -- 172.21.15.144:0/1261312318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 msgr2=0x7f3ab006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aafe00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 0x7f3ab006e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aafe00640 1 -- 172.21.15.144:0/1261312318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ab015c220 msgr2=0x7f3ab0152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aafe00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ab015c220 0x7f3ab0152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aafe00640 1 -- 172.21.15.144:0/1261312318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab01fb990 con 0x7f3ab00b4200 2024-09-12T12:17:56.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aafe00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 0x7f3ab01fb450 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000c730 tx=0x7f3aa000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aa7e00640 1 -- 172.21.15.144:0/1261312318 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0016020 con 0x7f3ab00b4200 2024-09-12T12:17:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aa7e00640 1 -- 172.21.15.144:0/1261312318 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa0006d60 con 0x7f3ab00b4200 2024-09-12T12:17:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3aa7e00640 1 -- 172.21.15.144:0/1261312318 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0003bc0 con 0x7f3ab00b4200 2024-09-12T12:17:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab006ebe0 con 0x7f3ab00b4200 2024-09-12T12:17:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.222+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab014f830 con 0x7f3ab00b4200 2024-09-12T12:17:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.226+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab00b4670 con 0x7f3ab00b4200 2024-09-12T12:17:56.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.226+0000 7f3aa7e00640 1 -- 172.21.15.144:0/1261312318 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3aa000a850 con 0x7f3ab00b4200 2024-09-12T12:17:56.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.226+0000 7f3aa7e00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3a900678c0 0x7f3a90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.226+0000 7f3aa7e00640 1 -- 172.21.15.144:0/1261312318 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f3aa0085900 con 0x7f3ab00b4200 2024-09-12T12:17:56.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.226+0000 7f3aaf400640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3a900678c0 0x7f3a90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.226+0000 7f3aaf400640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3a900678c0 0x7f3a90069d80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0ae000 tx=0x7f3a9c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:56.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.230+0000 7f3aa7e00640 1 -- 172.21.15.144:0/1261312318 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3aa0020020 con 0x7f3ab00b4200 2024-09-12T12:17:56.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ab00d2ce0 con 0x7f3ab00b4200 2024-09-12T12:17:56.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3aa7e00640 1 -- 172.21.15.144:0/1261312318 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5225 (secure 0 0 0) 0x7f3aa0055cf0 con 0x7f3ab00b4200 2024-09-12T12:17:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:56.424 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":70,"btime":"2024-09-12T12:17:54:184003+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/494679539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":494679539},{"type":"v1","addr":"172.21.15.165:6834","nonce":494679539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7152,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/76101968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":76101968},{"type":"v1","addr":"172.21.15.144:6836","nonce":76101968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/736758853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":736758853},{"type":"v1","addr":"172.21.15.144:6837","nonce":736758853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:17:53.566919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7161":{"gid":7161,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2978712683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2978712683},{"type":"v1","addr":"172.21.15.165:6835","nonce":2978712683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7161,"qdb_cluster":[7161]},"id":6}]} 2024-09-12T12:17:56.425 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 70 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3a900678c0 msgr2=0x7f3a90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3a900678c0 0x7f3a90069d80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0ae000 tx=0x7f3a9c0a7000 comp rx=0 tx=0).stop 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 msgr2=0x7f3ab01fb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 0x7f3ab01fb450 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000c730 tx=0x7f3aa000cbf0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 shutdown_connections 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3a900678c0 0x7f3a90069d80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ab015c220 0x7f3ab0152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ab00b5720 0x7f3ab006e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 --2- 172.21.15.144:0/1261312318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ab00b4200 0x7f3ab01fb450 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 >> 172.21.15.144:0/1261312318 conn(0x7f3ab006f400 msgr2=0x7f3ab006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 shutdown_connections 2024-09-12T12:17:56.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.422+0000 7f3ab6a00640 1 -- 172.21.15.144:0/1261312318 wait complete. 2024-09-12T12:17:56.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:17:50.543209+0000', 'modified': '2024-09-12T12:17:53.566919+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7161}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7161': {'gid': 7161, 'name': 'd', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.165:6835/2978712683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6832', 'nonce': 2978712683}, {'type': 'v1', 'addr': '172.21.15.165:6835', 'nonce': 2978712683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7161, 'qdb_cluster': [7161]} 2024-09-12T12:17:56.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:17:56.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T12:17:56.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f265ee00640 1 Processor -- start 2024-09-12T12:17:56.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f265ee00640 1 -- start start 2024-09-12T12:17:56.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f265ee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26580b49e0 0x7f265815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f265ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b3590 0x7f26580b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f265ee00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26580b3aa0 con 0x7f265815ad50 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f265ee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f265815f860 con 0x7f26580b49e0 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f265ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f26580cdeb0 con 0x7f26580b3590 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f2657400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26580b49e0 0x7f265815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f2657e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f265815ad50 0x7f26580b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:55868/0 (socket says 172.21.15.144:55868) 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f2657400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26580b49e0 0x7f265815f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53308/0 (socket says 172.21.15.144:53308) 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f2657e00640 1 -- 172.21.15.144:0/2840228056 learned_addr learned my addr 172.21.15.144:0/2840228056 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:56.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f265ce00640 1 --2- 172.21.15.144:0/2840228056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b3590 0x7f26580b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f2657400640 1 -- 172.21.15.144:0/2840228056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b3590 msgr2=0x7f26580b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:56.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f2657400640 1 --2- 172.21.15.144:0/2840228056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b3590 0x7f26580b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f2657400640 1 -- 172.21.15.144:0/2840228056 >> v1:172.21.15.165:6789/0 conn(0x7f265815ad50 legacy=0x7f26580b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.986+0000 7f2657400640 1 -- 172.21.15.144:0/2840228056 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26580afc10 con 0x7f26580b49e0 2024-09-12T12:17:56.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f2657400640 1 --2- 172.21.15.144:0/2840228056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26580b49e0 0x7f265815f320 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f264400a960 tx=0x7f264401d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2d8e48c0fd9a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f2656a00640 1 -- 172.21.15.144:0/2840228056 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26440b3070 con 0x7f26580b49e0 2024-09-12T12:17:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f2656a00640 1 -- 172.21.15.144:0/2840228056 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26440a6790 con 0x7f26580b49e0 2024-09-12T12:17:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f2656a00640 1 -- 172.21.15.144:0/2840228056 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264400b040 con 0x7f26580b49e0 2024-09-12T12:17:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 -- 172.21.15.144:0/2840228056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26580b49e0 msgr2=0x7f265815f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 --2- 172.21.15.144:0/2840228056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26580b49e0 0x7f265815f320 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f264400a960 tx=0x7f264401d870 comp rx=0 tx=0).stop 2024-09-12T12:17:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 -- 172.21.15.144:0/2840228056 shutdown_connections 2024-09-12T12:17:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 --2- 172.21.15.144:0/2840228056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b3590 0x7f26580b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 --2- 172.21.15.144:0/2840228056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26580b49e0 0x7f265815f320 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 -- 172.21.15.144:0/2840228056 >> 172.21.15.144:0/2840228056 conn(0x7f265806d0d0 msgr2=0x7f265806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 -- 172.21.15.144:0/2840228056 shutdown_connections 2024-09-12T12:17:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 -- 172.21.15.144:0/2840228056 wait complete. 2024-09-12T12:17:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 Processor -- start 2024-09-12T12:17:56.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.990+0000 7f265ee00640 1 -- start start 2024-09-12T12:17:56.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ee00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26580b3590 0x7f2658150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b49e0 0x7f2658155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265815ad50 0x7f26581571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f26580b0db0 con 0x7f265815ad50 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ee00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26580b0c30 con 0x7f26580b3590 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f26580b0f30 con 0x7f26580b49e0 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265815ad50 0x7f26581571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265815ad50 0x7f26581571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53316/0 (socket says 172.21.15.144:53316) 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ce00640 1 -- 172.21.15.144:0/2730670901 learned_addr learned my addr 172.21.15.144:0/2730670901 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f2657e00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26580b3590 0x7f2658150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f2657400640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b49e0 0x7f2658155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:56.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ce00640 1 -- 172.21.15.144:0/2730670901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b49e0 msgr2=0x7f2658155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ce00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b49e0 0x7f2658155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ce00640 1 -- 172.21.15.144:0/2730670901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26580b3590 msgr2=0x7f2658150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ce00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26580b3590 0x7f2658150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ce00640 1 -- 172.21.15.144:0/2730670901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26581567d0 con 0x7f265815ad50 2024-09-12T12:17:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f2657e00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26580b3590 0x7f2658150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ce00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265815ad50 0x7f26581571b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f265000e880 tx=0x7f265000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f264fe00640 1 -- 172.21.15.144:0/2730670901 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650017070 con 0x7f265815ad50 2024-09-12T12:17:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f264fe00640 1 -- 172.21.15.144:0/2730670901 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265000c940 con 0x7f265815ad50 2024-09-12T12:17:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ee00640 1 -- 172.21.15.144:0/2730670901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2658071150 con 0x7f265815ad50 2024-09-12T12:17:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f264fe00640 1 -- 172.21.15.144:0/2730670901 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265000cd10 con 0x7f265815ad50 2024-09-12T12:17:56.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f265ee00640 1 -- 172.21.15.144:0/2730670901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2658071710 con 0x7f265815ad50 2024-09-12T12:17:56.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.994+0000 7f264fe00640 1 -- 172.21.15.144:0/2730670901 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f265001a070 con 0x7f265815ad50 2024-09-12T12:17:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f264fe00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26380678c0 0x7f2638069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f264fe00640 1 -- 172.21.15.144:0/2730670901 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f26500861f0 con 0x7f265815ad50 2024-09-12T12:17:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26380678c0 0x7f2638069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 Processor -- start 2024-09-12T12:17:57.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 -- start start 2024-09-12T12:17:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26380678c0 0x7f2638069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2648005c10 tx=0x7f2648009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d464b20 0x55fe5d464f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 0x55fe5d41ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d41b290 0x55fe5d41b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fe5d302b60 con 0x55fe5d464b20 2024-09-12T12:17:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fe5d269c70 con 0x55fe5d465440 2024-09-12T12:17:57.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55fe5d20fed0 con 0x55fe5d41b290 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d464b20 0x55fe5d464f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d464b20 0x55fe5d464f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53328/0 (socket says 172.21.15.144:53328) 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 -- 172.21.15.144:0/1497146758 learned_addr learned my addr 172.21.15.144:0/1497146758 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657400640 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 0x55fe5d41ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f265ce00640 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d41b290 0x55fe5d41b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 -- 172.21.15.144:0/1497146758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d41b290 msgr2=0x55fe5d41b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d41b290 0x55fe5d41b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 -- 172.21.15.144:0/1497146758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 msgr2=0x55fe5d41ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 0x55fe5d41ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 -- 172.21.15.144:0/1497146758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe5d221e50 con 0x55fe5d464b20 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f265ce00640 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d41b290 0x55fe5d41b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2657e00640 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d464b20 0x55fe5d464f00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f264800ee90 tx=0x7f2648011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43075d31a4d29029 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:57.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f264cc00640 1 -- 172.21.15.144:0/1497146758 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648007ae0 con 0x55fe5d464b20 2024-09-12T12:17:57.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f264cc00640 1 -- 172.21.15.144:0/1497146758 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2648013630 con 0x55fe5d464b20 2024-09-12T12:17:57.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f264cc00640 1 -- 172.21.15.144:0/1497146758 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26480139e0 con 0x55fe5d464b20 2024-09-12T12:17:57.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 -- 172.21.15.144:0/1497146758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d464b20 msgr2=0x55fe5d464f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d464b20 0x55fe5d464f00 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f264800ee90 tx=0x7f2648011000 comp rx=0 tx=0).stop 2024-09-12T12:17:57.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 -- 172.21.15.144:0/1497146758 shutdown_connections 2024-09-12T12:17:57.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d41b290 0x55fe5d41b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 0x55fe5d41ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 --2- 172.21.15.144:0/1497146758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d464b20 0x55fe5d464f00 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 -- 172.21.15.144:0/1497146758 >> 172.21.15.144:0/1497146758 conn(0x55fe5d421600 msgr2=0x55fe5d419630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 -- 172.21.15.144:0/1497146758 shutdown_connections 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:56.998+0000 7f2662233000 1 -- 172.21.15.144:0/1497146758 wait complete. 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 -- start start 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 Processor -- start 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d41fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d425cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 0x55fe5d426230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fe5d2cbb00 con 0x55fe5d465440 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fe5d244360 con 0x55fe5d420390 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55fe5d2412d0 con 0x55fe5d464b20 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 10 client.0 _ll_register_callbacks cb 0x55fe5d406820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:57.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d425cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d425cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53344/0 (socket says 172.21.15.144:53344) 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657400640 1 -- 172.21.15.144:0/378871904 learned_addr learned my addr 172.21.15.144:0/378871904 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f265ce00640 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 0x55fe5d426230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657e00640 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d41fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657400640 1 -- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 msgr2=0x55fe5d41fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657400640 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d41fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657400640 1 -- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 msgr2=0x55fe5d426230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657400640 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 0x55fe5d426230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657400640 1 -- 172.21.15.144:0/378871904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe5d210120 con 0x55fe5d465440 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2657400640 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d425cf0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f264400a960 tx=0x7f264401c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b613819b1cf88fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2641600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2641600640 1 -- 172.21.15.144:0/378871904 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26440b3070 con 0x55fe5d465440 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 -- 172.21.15.144:0/378871904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2648013630 con 0x55fe5d465440 2024-09-12T12:17:57.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2641600640 1 -- 172.21.15.144:0/378871904 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f26440a6de0 con 0x55fe5d465440 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2641600640 1 -- 172.21.15.144:0/378871904 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f26440c5050 con 0x55fe5d465440 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 10 client.7275 fetch_fsmap learned FSMap version 70 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 -- 172.21.15.144:0/378871904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55fe5d209450 con 0x55fe5d465440 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2641600640 1 -- 172.21.15.144:0/378871904 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2648013630 con 0x55fe5d465440 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2641600640 1 -- 172.21.15.144:0/378871904 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f26440c8020 con 0x55fe5d465440 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 10 client.7275 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 10 client.7275 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 20 client.7275 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55fe5d46af50 0x55fe5d46b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 4 client.7275 mds_command: new command op to 7161 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.002+0000 7f2662233000 1 -- 172.21.15.144:0/378871904 --> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe5d203c00 con 0x55fe5d46af50 2024-09-12T12:17:57.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2657e00640 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55fe5d46af50 0x55fe5d46b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2657e00640 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55fe5d46af50 0x55fe5d46b330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd27ab993a4a9a36 server_cookie=9ec54efcdc7678f in_seq=0 out_seq=0 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2641600640 10 client.7275 ms_handle_connect on v2:172.21.15.165:6832/2978712683 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2641600640 1 -- 172.21.15.144:0/378871904 <== mds.0 v2:172.21.15.165:6832/2978712683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe5d203c00 con 0x55fe5d46af50 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2641600640 10 client.7275 handle_command_reply: tid=0 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 client.7275 shutdown 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 -- 172.21.15.144:0/378871904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 msgr2=0x55fe5d425cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d425cf0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f264400a960 tx=0x7f264401c0b0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 -- 172.21.15.144:0/378871904 shutdown_connections 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55fe5d46af50 0x55fe5d46b330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 0x55fe5d426230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d425cf0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2641600640 0 client.7275 ms_handle_reset on v2:172.21.15.165:6832/2978712683 2024-09-12T12:17:57.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 --2- 172.21.15.144:0/378871904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d41fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 -- 172.21.15.144:0/378871904 >> 172.21.15.144:0/378871904 conn(0x55fe5d41b290 msgr2=0x55fe5d419d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:57.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 -- 172.21.15.144:0/378871904 shutdown_connections 2024-09-12T12:17:57.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 1 -- 172.21.15.144:0/378871904 wait complete. 2024-09-12T12:17:57.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.006+0000 7f2662233000 20 client.7275 trim_cache size 0 max 16384 2024-09-12T12:17:57.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 Processor -- start 2024-09-12T12:17:57.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- start start 2024-09-12T12:17:57.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d420390 0x55fe5d4644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d47b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 0x55fe5d47b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f265815c300 con 0x55fe5d420390 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26581f9dd0 con 0x55fe5d465440 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f265815bcb0 con 0x55fe5d464b20 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d420390 0x55fe5d4644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d420390 0x55fe5d4644d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53360/0 (socket says 172.21.15.144:53360) 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657e00640 1 -- 172.21.15.144:0/3299635423 learned_addr learned my addr 172.21.15.144:0/3299635423 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f265ce00640 1 --2- 172.21.15.144:0/3299635423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 0x55fe5d47b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657400640 1 --2- 172.21.15.144:0/3299635423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d47b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657e00640 1 -- 172.21.15.144:0/3299635423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 msgr2=0x55fe5d47b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657e00640 1 --2- 172.21.15.144:0/3299635423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d47b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657e00640 1 -- 172.21.15.144:0/3299635423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 msgr2=0x55fe5d47b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:57.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657e00640 1 --2- 172.21.15.144:0/3299635423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 0x55fe5d47b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657e00640 1 -- 172.21.15.144:0/3299635423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe5d1f0fd0 con 0x55fe5d420390 2024-09-12T12:17:57.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2657e00640 1 --2- 172.21.15.144:0/3299635423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d420390 0x55fe5d4644d0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2648014000 tx=0x7f2648007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4692397f3b1558 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2643e00640 1 -- 172.21.15.144:0/3299635423 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648033020 con 0x55fe5d420390 2024-09-12T12:17:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2643e00640 1 -- 172.21.15.144:0/3299635423 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2648013960 con 0x55fe5d420390 2024-09-12T12:17:57.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2643e00640 1 -- 172.21.15.144:0/3299635423 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648013d10 con 0x55fe5d420390 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- 172.21.15.144:0/3299635423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d420390 msgr2=0x55fe5d4644d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 --2- 172.21.15.144:0/3299635423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d420390 0x55fe5d4644d0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f2648014000 tx=0x7f2648007000 comp rx=0 tx=0).stop 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- 172.21.15.144:0/3299635423 shutdown_connections 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 --2- 172.21.15.144:0/3299635423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d465440 0x55fe5d47b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 --2- 172.21.15.144:0/3299635423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d47b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 --2- 172.21.15.144:0/3299635423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d420390 0x55fe5d4644d0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- 172.21.15.144:0/3299635423 >> 172.21.15.144:0/3299635423 conn(0x55fe5d41b290 msgr2=0x55fe5d41f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- 172.21.15.144:0/3299635423 shutdown_connections 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- 172.21.15.144:0/3299635423 wait complete. 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 -- start start 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.026+0000 7f2662233000 1 Processor -- start 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 0x55fe5d4e03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d4e0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d46e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fe5d268f80 con 0x55fe5d465440 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fe5d221ca0 con 0x55fe5d420390 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55fe5d26e2a0 con 0x55fe5d464b20 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 10 client.0 _ll_register_callbacks cb 0x7f2650009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f265ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d46e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f265ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d46e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53372/0 (socket says 172.21.15.144:53372) 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f265ce00640 1 -- 172.21.15.144:0/3506459619 learned_addr learned my addr 172.21.15.144:0/3506459619 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2657e00640 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 0x55fe5d4e03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2657400640 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d4e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f265ce00640 1 -- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 msgr2=0x55fe5d4e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f265ce00640 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d4e0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f265ce00640 1 -- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 msgr2=0x55fe5d4e03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:57.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f265ce00640 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 0x55fe5d4e03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f265ce00640 1 -- 172.21.15.144:0/3506459619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe5d2ec750 con 0x55fe5d465440 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2657e00640 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 0x55fe5d4e03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2657400640 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d4e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f265ce00640 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d46e7f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2650004780 tx=0x7f26500564b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dba66c23a7b53d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 1 -- 172.21.15.144:0/3506459619 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650081020 con 0x55fe5d465440 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 1 -- 172.21.15.144:0/3506459619 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f2650055b00 con 0x55fe5d465440 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- 172.21.15.144:0/3506459619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2648013960 con 0x55fe5d465440 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 1 -- 172.21.15.144:0/3506459619 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f2650021040 con 0x55fe5d465440 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 10 client.7281 fetch_fsmap learned FSMap version 70 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- 172.21.15.144:0/3506459619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55fe5d1f7a30 con 0x55fe5d465440 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 1 -- 172.21.15.144:0/3506459619 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2648013960 con 0x55fe5d465440 2024-09-12T12:17:57.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 1 -- 172.21.15.144:0/3506459619 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f265006e100 con 0x55fe5d465440 2024-09-12T12:17:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 10 client.7281 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T12:17:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 10 client.7281 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:17:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 20 client.7281 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55fe5d46ed30 0x55fe5d46f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 4 client.7281 mds_command: new command op to 7161 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:17:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- 172.21.15.144:0/3506459619 --> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] -- command(tid 0: {"prefix": "status"}) -- 0x55fe5d2773a0 con 0x55fe5d46ed30 2024-09-12T12:17:57.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2657e00640 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55fe5d46ed30 0x55fe5d46f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2657e00640 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55fe5d46ed30 0x55fe5d46f110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e692563c08715ffd server_cookie=b174bc668829ac58 in_seq=0 out_seq=0 2024-09-12T12:17:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 10 client.7281 ms_handle_connect on v2:172.21.15.165:6832/2978712683 2024-09-12T12:17:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 1 -- 172.21.15.144:0/3506459619 <== mds.0 v2:172.21.15.165:6832/2978712683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55fe5d2773a0 con 0x55fe5d46ed30 2024-09-12T12:17:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 10 client.7281 handle_command_reply: tid=0 2024-09-12T12:17:57.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 client.7281 shutdown 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- 172.21.15.144:0/3506459619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 msgr2=0x55fe5d46e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d46e7f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2650004780 tx=0x7f26500564b0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- 172.21.15.144:0/3506459619 shutdown_connections 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d465440 0x55fe5d46e7f0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fe5d464b20 0x55fe5d4e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55fe5d46ed30 0x55fe5d46f110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 --2- 172.21.15.144:0/3506459619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fe5d420390 0x55fe5d4e03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- 172.21.15.144:0/3506459619 >> 172.21.15.144:0/3506459619 conn(0x55fe5d41b290 msgr2=0x55fe5d47a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2641600640 0 client.7281 ms_handle_reset on v2:172.21.15.165:6832/2978712683 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- 172.21.15.144:0/3506459619 shutdown_connections 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 1 -- 172.21.15.144:0/3506459619 wait complete. 2024-09-12T12:17:57.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.030+0000 7f2662233000 20 client.7281 trim_cache size 0 max 16384 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 7161, 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 5.876315709, 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 70, 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 98, 2024-09-12T12:17:57.040 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 98, 2024-09-12T12:17:57.041 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.674347645999999 2024-09-12T12:17:57.041 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:17:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 -- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26380678c0 msgr2=0x7f2638069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26380678c0 0x7f2638069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2648005c10 tx=0x7f2648009040 comp rx=0 tx=0).stop 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 -- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265815ad50 msgr2=0x7f26581571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265815ad50 0x7f26581571b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f265000e880 tx=0x7f265000ed40 comp rx=0 tx=0).stop 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 -- 172.21.15.144:0/2730670901 shutdown_connections 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26380678c0 0x7f2638069d80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265815ad50 0x7f26581571b0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26580b49e0 0x7f2658155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 --2- 172.21.15.144:0/2730670901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26580b3590 0x7f2658150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 -- 172.21.15.144:0/2730670901 >> 172.21.15.144:0/2730670901 conn(0x7f265806d0d0 msgr2=0x7f26580cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 -- 172.21.15.144:0/2730670901 shutdown_connections 2024-09-12T12:17:57.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.034+0000 7f265ee00640 1 -- 172.21.15.144:0/2730670901 wait complete. 2024-09-12T12:17:57.055 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:17:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096fe00640 1 Processor -- start 2024-09-12T12:17:57.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096fe00640 1 -- start start 2024-09-12T12:17:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09680b4200 0x7f09680b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f09680b5720 0x7f09680b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096fe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09680d1580 con 0x7f096815c220 2024-09-12T12:17:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f09680b4bb0 con 0x7f09680b5720 2024-09-12T12:17:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f09680d1320 con 0x7f09680b4200 2024-09-12T12:17:57.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f09680b5720 0x7f09680b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096d400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f096815c220 0x7f09680d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:60402/0 (socket says 172.21.15.144:60402) 2024-09-12T12:17:57.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096d400640 1 -- 172.21.15.144:0/4048708124 learned_addr learned my addr 172.21.15.144:0/4048708124 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:57.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096ca00640 1 --2- 172.21.15.144:0/4048708124 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09680b4200 0x7f09680b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f0967e00640 1 -- 172.21.15.144:0/4048708124 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2894665652 0 0) 0x7f09680d1580 con 0x7f096815c220 2024-09-12T12:17:57.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f0967e00640 1 -- 172.21.15.144:0/4048708124 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0950003530 con 0x7f096815c220 2024-09-12T12:17:57.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096ca00640 1 -- 172.21.15.144:0/4048708124 >> v2:172.21.15.165:3300/0 conn(0x7f09680b5720 msgr2=0x7f09680b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:57.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096ca00640 1 --2- 172.21.15.144:0/4048708124 >> v2:172.21.15.165:3300/0 conn(0x7f09680b5720 0x7f09680b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096ca00640 1 -- 172.21.15.144:0/4048708124 >> v1:172.21.15.165:6789/0 conn(0x7f096815c220 legacy=0x7f09680d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.190+0000 7f096ca00640 1 -- 172.21.15.144:0/4048708124 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09680d1860 con 0x7f09680b4200 2024-09-12T12:17:57.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.194+0000 7f096ca00640 1 --2- 172.21.15.144:0/4048708124 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09680b4200 0x7f09680b4670 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09540097c0 tx=0x7f095401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16d08f045178fddb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:57.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f0967e00640 1 -- 172.21.15.144:0/4048708124 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540a7070 con 0x7f09680b4200 2024-09-12T12:17:57.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f0967e00640 1 -- 172.21.15.144:0/4048708124 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09540b0070 con 0x7f09680b4200 2024-09-12T12:17:57.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f0967e00640 1 -- 172.21.15.144:0/4048708124 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540ab890 con 0x7f09680b4200 2024-09-12T12:17:57.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f096fe00640 1 -- 172.21.15.144:0/4048708124 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09680b4200 msgr2=0x7f09680b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f096fe00640 1 --2- 172.21.15.144:0/4048708124 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09680b4200 0x7f09680b4670 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f09540097c0 tx=0x7f095401c470 comp rx=0 tx=0).stop 2024-09-12T12:17:57.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f096fe00640 1 -- 172.21.15.144:0/4048708124 shutdown_connections 2024-09-12T12:17:57.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f096fe00640 1 --2- 172.21.15.144:0/4048708124 >> v2:172.21.15.165:3300/0 conn(0x7f09680b5720 0x7f09680b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f096fe00640 1 --2- 172.21.15.144:0/4048708124 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09680b4200 0x7f09680b4670 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f096fe00640 1 -- 172.21.15.144:0/4048708124 >> 172.21.15.144:0/4048708124 conn(0x7f096806f400 msgr2=0x7f096806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:57.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f096fe00640 1 -- 172.21.15.144:0/4048708124 shutdown_connections 2024-09-12T12:17:57.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.198+0000 7f096fe00640 1 -- 172.21.15.144:0/4048708124 wait complete. 2024-09-12T12:17:57.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 Processor -- start 2024-09-12T12:17:57.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 -- start start 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09680b4200 0x7f09680afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09680b5720 0x7f09681566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096815c220 0x7f096815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f096815c780 con 0x7f09680b5720 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f096815c600 con 0x7f09680b4200 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0968070bf0 con 0x7f096815c220 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09680b5720 0x7f09681566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09680b4200 0x7f09680afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09680b5720 0x7f09681566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38948/0 (socket says 172.21.15.144:38948) 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096ca00640 1 -- 172.21.15.144:0/3143542326 learned_addr learned my addr 172.21.15.144:0/3143542326 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096de00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096815c220 0x7f096815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096ca00640 1 -- 172.21.15.144:0/3143542326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096815c220 msgr2=0x7f096815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096ca00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096815c220 0x7f096815eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096ca00640 1 -- 172.21.15.144:0/3143542326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09680b4200 msgr2=0x7f09680afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096ca00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09680b4200 0x7f09680afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096ca00640 1 -- 172.21.15.144:0/3143542326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09680af070 con 0x7f09680b5720 2024-09-12T12:17:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096ca00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09680b5720 0x7f09681566a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f09540ad040 tx=0x7f095401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f0965600640 1 -- 172.21.15.144:0/3143542326 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540bf410 con 0x7f09680b5720 2024-09-12T12:17:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f0965600640 1 -- 172.21.15.144:0/3143542326 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09540bf5d0 con 0x7f09680b5720 2024-09-12T12:17:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f0965600640 1 -- 172.21.15.144:0/3143542326 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09540bf9c0 con 0x7f09680b5720 2024-09-12T12:17:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09680af350 con 0x7f09680b5720 2024-09-12T12:17:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.202+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09680af910 con 0x7f09680b5720 2024-09-12T12:17:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.206+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09680b4670 con 0x7f09680b5720 2024-09-12T12:17:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.206+0000 7f0965600640 1 -- 172.21.15.144:0/3143542326 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09540bd020 con 0x7f09680b5720 2024-09-12T12:17:57.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.206+0000 7f0965600640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09480678c0 0x7f0948069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:57.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.206+0000 7f0965600640 1 -- 172.21.15.144:0/3143542326 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f095411ffd0 con 0x7f09680b5720 2024-09-12T12:17:57.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.206+0000 7f096d400640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09480678c0 0x7f0948069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:57.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.206+0000 7f096d400640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09480678c0 0x7f0948069d80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f095c007fd0 tx=0x7f095c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:57.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.210+0000 7f0965600640 1 -- 172.21.15.144:0/3143542326 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f09540c6030 con 0x7f09680b5720 2024-09-12T12:17:57.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.402+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f09680b3540 con 0x7f09680b5720 2024-09-12T12:17:57.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.402+0000 7f0965600640 1 -- 172.21.15.144:0/3143542326 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) ==== 53+0+73 (secure 0 0 0) 0x7f0954016090 con 0x7f09680b5720 2024-09-12T12:17:57.406 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:17:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09480678c0 msgr2=0x7f0948069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09480678c0 0x7f0948069d80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f095c007fd0 tx=0x7f095c009040 comp rx=0 tx=0).stop 2024-09-12T12:17:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09680b5720 msgr2=0x7f09681566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:57.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09680b5720 0x7f09681566a0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f09540ad040 tx=0x7f095401acb0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 shutdown_connections 2024-09-12T12:17:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09480678c0 0x7f0948069d80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096815c220 0x7f096815eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09680b5720 0x7f09681566a0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 --2- 172.21.15.144:0/3143542326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09680b4200 0x7f09680afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 >> 172.21.15.144:0/3143542326 conn(0x7f096806f400 msgr2=0x7f0968073a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 shutdown_connections 2024-09-12T12:17:57.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57.406+0000 7f096fe00640 1 -- 172.21.15.144:0/3143542326 wait complete. 2024-09-12T12:17:57.427 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:17:57.427 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:17:57.427 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:17:57.427 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:17:57.427 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:57.427 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:17:57.428 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:17:57.428 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:17:57.428 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:17:57.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:57.428 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:17:57.437 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:57.438 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42105sec preferred_lft 42105sec 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:57.439 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:17:57.440 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:17:57.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:57.444 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:17:57.497 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:17:57.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:57.499 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:17:57.558 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:17:57.558 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:17:57.558 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:17:57.558 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:17:57.558 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:17:57.558 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:17:57.558 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:17:57.559 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:17:57.559 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:17:57.559 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:17:57.559 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:17:57.559 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:17:57.559 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:17:57.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:17:57.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:17:57.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:17:57.559 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:17:57.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:17:57.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:17:57.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:57.692 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:17:57.701 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:17:57.701 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:17:57.702 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:17:57.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:57.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:17:57.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:17:57.766 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:57.819 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:17:57.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:17:57.819 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:57.874 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:17:57.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:57.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:17:57.966 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:17:57.967 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:17:57.982 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:17:57.982 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:17:57.982 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:17:57.982 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:17:57.982 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:17:57.986 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:17:57.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:57.986 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:58.006 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:17:58.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:17:58.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:17:58.112 INFO:teuthology.orchestra.run.smithi144.stdout:client6374 2024-09-12T12:17:58.113 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:58.113 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:58.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:58.122 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-12T12:17:58.179 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:17:58.179 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:17:58.179 DEBUG:teuthology.orchestra.run.smithi144:> import stat 2024-09-12T12:17:58.179 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:17:58.179 DEBUG:teuthology.orchestra.run.smithi144:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-12T12:17:58.180 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:17:58.286 INFO:teuthology.orchestra.run.smithi144.stdout:1099511627776 2024-09-12T12:17:58.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:17:58.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:17:58.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.470+0000 7f3246c00640 1 Processor -- start 2024-09-12T12:17:58.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.470+0000 7f3246c00640 1 -- start start 2024-09-12T12:17:58.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f3246c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f324015c7b0 0x7f32400ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:58.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f3246c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 0x7f32400b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:58.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f3246c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32400cd870 con 0x7f32400b5de0 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f3246c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3240072a50 con 0x7f324015c7b0 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f3246c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32400cde30 con 0x7f324015cd30 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f323fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f324015c7b0 0x7f32400ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f323fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f324015c7b0 0x7f32400ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38958/0 (socket says 172.21.15.144:38958) 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f323fe00640 1 -- 172.21.15.144:0/3864073827 learned_addr learned my addr 172.21.15.144:0/3864073827 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f323f400640 1 --2- 172.21.15.144:0/3864073827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 0x7f32400b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f323fe00640 1 -- 172.21.15.144:0/3864073827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 msgr2=0x7f32400b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f323fe00640 1 --2- 172.21.15.144:0/3864073827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 0x7f32400b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f323fe00640 1 -- 172.21.15.144:0/3864073827 >> v1:172.21.15.165:6789/0 conn(0x7f32400b5de0 legacy=0x7f32401601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:58.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.474+0000 7f323fe00640 1 -- 172.21.15.144:0/3864073827 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32400cdb50 con 0x7f324015c7b0 2024-09-12T12:17:58.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f323fe00640 1 --2- 172.21.15.144:0/3864073827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 0x7f32400ccf00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3230009e50 tx=0x7f323001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c934e8f6bc84d9a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:58.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f323ea00640 1 -- 172.21.15.144:0/3864073827 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32300a5700 con 0x7f324015c7b0 2024-09-12T12:17:58.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f323ea00640 1 -- 172.21.15.144:0/3864073827 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32300a58a0 con 0x7f324015c7b0 2024-09-12T12:17:58.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f323ea00640 1 -- 172.21.15.144:0/3864073827 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32300a5c70 con 0x7f324015c7b0 2024-09-12T12:17:58.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 -- 172.21.15.144:0/3864073827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 msgr2=0x7f32400ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:58.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 --2- 172.21.15.144:0/3864073827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 0x7f32400ccf00 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3230009e50 tx=0x7f323001ca30 comp rx=0 tx=0).stop 2024-09-12T12:17:58.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 -- 172.21.15.144:0/3864073827 shutdown_connections 2024-09-12T12:17:58.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 --2- 172.21.15.144:0/3864073827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 0x7f32400b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 --2- 172.21.15.144:0/3864073827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 0x7f32400ccf00 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 -- 172.21.15.144:0/3864073827 >> 172.21.15.144:0/3864073827 conn(0x7f324006d0d0 msgr2=0x7f324006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:58.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 -- 172.21.15.144:0/3864073827 shutdown_connections 2024-09-12T12:17:58.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 -- 172.21.15.144:0/3864073827 wait complete. 2024-09-12T12:17:58.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 Processor -- start 2024-09-12T12:17:58.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 -- start start 2024-09-12T12:17:58.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.478+0000 7f3246c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32400b5de0 0x7f32400aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:58.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3246c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 0x7f3240154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3246c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 0x7f32401f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3246c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3240169530 con 0x7f324015c7b0 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3246c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f32400cd650 con 0x7f32400b5de0 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3246c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32401696b0 con 0x7f324015cd30 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 0x7f3240154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 0x7f3240154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38972/0 (socket says 172.21.15.144:38972) 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323f400640 1 -- 172.21.15.144:0/1554931795 learned_addr learned my addr 172.21.15.144:0/1554931795 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323fe00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32400b5de0 0x7f32400aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3244c00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 0x7f32401f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323f400640 1 -- 172.21.15.144:0/1554931795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 msgr2=0x7f32401f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323f400640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 0x7f32401f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323f400640 1 -- 172.21.15.144:0/1554931795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32400b5de0 msgr2=0x7f32400aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:58.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323f400640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32400b5de0 0x7f32400aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323f400640 1 -- 172.21.15.144:0/1554931795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32400af360 con 0x7f324015c7b0 2024-09-12T12:17:58.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f323f400640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 0x7f3240154650 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f322c00d800 tx=0x7f322c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:58.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3237e00640 1 -- 172.21.15.144:0/1554931795 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c00b6c0 con 0x7f324015c7b0 2024-09-12T12:17:58.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3237e00640 1 -- 172.21.15.144:0/1554931795 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f322c019070 con 0x7f324015c7b0 2024-09-12T12:17:58.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3237e00640 1 -- 172.21.15.144:0/1554931795 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c00bae0 con 0x7f324015c7b0 2024-09-12T12:17:58.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32400b1200 con 0x7f324015c7b0 2024-09-12T12:17:58.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32400b17c0 con 0x7f324015c7b0 2024-09-12T12:17:58.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32400ccf00 con 0x7f324015c7b0 2024-09-12T12:17:58.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.482+0000 7f3237e00640 1 -- 172.21.15.144:0/1554931795 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f322c00bc80 con 0x7f324015c7b0 2024-09-12T12:17:58.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.486+0000 7f3237e00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32200678c0 0x7f3220069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:58.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.486+0000 7f3237e00640 1 -- 172.21.15.144:0/1554931795 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f322c086210 con 0x7f324015c7b0 2024-09-12T12:17:58.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.486+0000 7f323fe00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32200678c0 0x7f3220069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:58.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.486+0000 7f323fe00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32200678c0 0x7f3220069d80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f32300ae000 tx=0x7f32300a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:58.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.490+0000 7f3237e00640 1 -- 172.21.15.144:0/1554931795 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f32400af360 con 0x7f324015c7b0 2024-09-12T12:17:58.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.678+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3240156700 con 0x7f324015c7b0 2024-09-12T12:17:58.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.678+0000 7f3237e00640 1 -- 172.21.15.144:0/1554931795 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+5225 (secure 0 0 0) 0x7f322c056570 con 0x7f324015c7b0 2024-09-12T12:17:58.681 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:17:58.681 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":70,"btime":"2024-09-12T12:17:54:184003+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/494679539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":494679539},{"type":"v1","addr":"172.21.15.165:6834","nonce":494679539}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7152,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/76101968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":76101968},{"type":"v1","addr":"172.21.15.144:6836","nonce":76101968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/736758853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":736758853},{"type":"v1","addr":"172.21.15.144:6837","nonce":736758853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:17:53.566919+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7161":{"gid":7161,"name":"d","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2978712683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2978712683},{"type":"v1","addr":"172.21.15.165:6835","nonce":2978712683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7161,"qdb_cluster":[7161]},"id":6}]} 2024-09-12T12:17:58.682 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 70 2024-09-12T12:17:58.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32200678c0 msgr2=0x7f3220069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:58.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32200678c0 0x7f3220069d80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f32300ae000 tx=0x7f32300a7070 comp rx=0 tx=0).stop 2024-09-12T12:17:58.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 msgr2=0x7f3240154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:58.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 0x7f3240154650 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f322c00d800 tx=0x7f322c00dcc0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 shutdown_connections 2024-09-12T12:17:58.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32200678c0 0x7f3220069d80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f324015cd30 0x7f32401f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f324015c7b0 0x7f3240154650 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 --2- 172.21.15.144:0/1554931795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32400b5de0 0x7f32400aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:58.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 >> 172.21.15.144:0/1554931795 conn(0x7f324006d0d0 msgr2=0x7f32400cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:58.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 shutdown_connections 2024-09-12T12:17:58.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:58.682+0000 7f3246c00640 1 -- 172.21.15.144:0/1554931795 wait complete. 2024-09-12T12:17:58.702 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump inode 1099511627776 2024-09-12T12:17:58.868 INFO:teuthology.orchestra.run.smithi165.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-12T12:17:58.170062+0000","btime":"2024-09-12T12:17:58.170062+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T12:17:58.170062+0000","atime":"2024-09-12T12:17:58.170062+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6374,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6374,"want_loner":6374,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-12T12:17:58.869 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-12T12:17:58.170062+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-12T12:17:58.170062+0000", "change_attr": 0, "client_caps": [ { "client_id": 6374, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-12T12:17:58.170062+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6374, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-12T12:17:58.170062+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6374, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [] } 2024-09-12T12:17:58.872 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:58.873 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:58.881 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:17:58.881 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:17:58.881 DEBUG:teuthology.orchestra.run.smithi144:> import uuid 2024-09-12T12:17:58.881 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:17:58.881 DEBUG:teuthology.orchestra.run.smithi144:> n = 21 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> create_hard_links = False 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> if 0 > 0: 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> create_hard_links = True 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> dpath = os.path.dirname(path) 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> fnameprefix = os.path.basename(path) 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> os.makedirs(dpath, exist_ok=True) 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> try: 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> for i in range(n): 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T12:17:58.882 DEBUG:teuthology.orchestra.run.smithi144:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> f.write(f"{i}") 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> f.flush() 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(f.fileno()) 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> os.unlink(fpath) 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(dirfd) 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> if create_hard_links: 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> for j in range(0): 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(dirfd) 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> finally: 2024-09-12T12:17:58.883 DEBUG:teuthology.orchestra.run.smithi144:> os.close(dirfd) 2024-09-12T12:17:58.884 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:17:59.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:17:59.032 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:59.032 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:59.087 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:17:59.087 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:17:59.139 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:17:59.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd3200640 1 Processor -- start 2024-09-12T12:17:59.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd3200640 1 -- start start 2024-09-12T12:17:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd3200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9fd40740c0 0x7f9fd40d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fd40d1170 con 0x7f9fd406f550 2024-09-12T12:17:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fd40cf270 con 0x7f9fd415c6a0 2024-09-12T12:17:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd3200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd415cbb0 con 0x7f9fd40740c0 2024-09-12T12:17:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9fd406f550 0x7f9fd41606f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52206/0 (socket says 172.21.15.144:52206) 2024-09-12T12:17:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd1e00640 1 -- 172.21.15.144:0/1182791183 learned_addr learned my addr 172.21.15.144:0/1182791183 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:17:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd2800640 1 --2- 172.21.15.144:0/1182791183 >> v2:172.21.15.165:3300/0 conn(0x7f9fd40740c0 0x7f9fd40d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd0a00640 1 -- 172.21.15.144:0/1182791183 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195974047 0 0) 0x7f9fc4001120 con 0x7f9fd406f550 2024-09-12T12:17:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd0a00640 1 -- 172.21.15.144:0/1182791183 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fb8003530 con 0x7f9fd406f550 2024-09-12T12:17:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd0a00640 1 -- 172.21.15.144:0/1182791183 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933565646 0 0) 0x7f9fd40cf270 con 0x7f9fd415c6a0 2024-09-12T12:17:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd0a00640 1 -- 172.21.15.144:0/1182791183 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fc4001120 con 0x7f9fd415c6a0 2024-09-12T12:17:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd2800640 1 -- 172.21.15.144:0/1182791183 >> v1:172.21.15.165:6789/0 conn(0x7f9fd415c6a0 legacy=0x7f9fd40b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd2800640 1 -- 172.21.15.144:0/1182791183 >> v1:172.21.15.144:6789/0 conn(0x7f9fd406f550 legacy=0x7f9fd41606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd0a00640 1 -- 172.21.15.144:0/1182791183 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 879943961 0 0) 0x7f9fb8003530 con 0x7f9fd406f550 2024-09-12T12:17:59.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.322+0000 7f9fd2800640 1 -- 172.21.15.144:0/1182791183 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd415ce90 con 0x7f9fd40740c0 2024-09-12T12:17:59.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd2800640 1 --2- 172.21.15.144:0/1182791183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fd40740c0 0x7f9fd40d1630 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009d90 tx=0x7f9fcc01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50d891a1b12116b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd0a00640 1 -- 172.21.15.144:0/1182791183 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0b2070 con 0x7f9fd40740c0 2024-09-12T12:17:59.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd0a00640 1 -- 172.21.15.144:0/1182791183 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0a55c0 con 0x7f9fd40740c0 2024-09-12T12:17:59.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd0a00640 1 -- 172.21.15.144:0/1182791183 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4001850 con 0x7f9fd40740c0 2024-09-12T12:17:59.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd3200640 1 -- 172.21.15.144:0/1182791183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fd40740c0 msgr2=0x7f9fd40d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd3200640 1 --2- 172.21.15.144:0/1182791183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fd40740c0 0x7f9fd40d1630 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009d90 tx=0x7f9fcc01c890 comp rx=0 tx=0).stop 2024-09-12T12:17:59.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd3200640 1 -- 172.21.15.144:0/1182791183 shutdown_connections 2024-09-12T12:17:59.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd3200640 1 --2- 172.21.15.144:0/1182791183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fd40740c0 0x7f9fd40d1630 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd3200640 1 -- 172.21.15.144:0/1182791183 >> 172.21.15.144:0/1182791183 conn(0x7f9fd4067a00 msgr2=0x7f9fd4067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:59.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd3200640 1 -- 172.21.15.144:0/1182791183 shutdown_connections 2024-09-12T12:17:59.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.326+0000 7f9fd3200640 1 -- 172.21.15.144:0/1182791183 wait complete. 2024-09-12T12:17:59.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 Processor -- start 2024-09-12T12:17:59.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 -- start start 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fd406f550 0x7f9fd415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd40740c0 0x7f9fd413a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fd415c6a0 0x7f9fd4142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd416a210 con 0x7f9fd40740c0 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd416a090 con 0x7f9fd415c6a0 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd416a390 con 0x7f9fd406f550 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd40740c0 0x7f9fd413a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd40740c0 0x7f9fd413a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38976/0 (socket says 172.21.15.144:38976) 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1400640 1 -- 172.21.15.144:0/3155972593 learned_addr learned my addr 172.21.15.144:0/3155972593 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1e00640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fd406f550 0x7f9fd415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd2800640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fd415c6a0 0x7f9fd4142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1400640 1 -- 172.21.15.144:0/3155972593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fd406f550 msgr2=0x7f9fd415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1400640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fd406f550 0x7f9fd415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1400640 1 -- 172.21.15.144:0/3155972593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fd415c6a0 msgr2=0x7f9fd4142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1400640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fd415c6a0 0x7f9fd4142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1400640 1 -- 172.21.15.144:0/3155972593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd41455f0 con 0x7f9fd40740c0 2024-09-12T12:17:59.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd1400640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd40740c0 0x7f9fd413a440 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c3f0 tx=0x7f9fc000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fca000640 1 -- 172.21.15.144:0/3155972593 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0017070 con 0x7f9fd40740c0 2024-09-12T12:17:59.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fca000640 1 -- 172.21.15.144:0/3155972593 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc00052d0 con 0x7f9fd40740c0 2024-09-12T12:17:59.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fca000640 1 -- 172.21.15.144:0/3155972593 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0003840 con 0x7f9fd40740c0 2024-09-12T12:17:59.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd41440b0 con 0x7f9fd40740c0 2024-09-12T12:17:59.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.330+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd4145200 con 0x7f9fd40740c0 2024-09-12T12:17:59.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.334+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd40d1630 con 0x7f9fd40740c0 2024-09-12T12:17:59.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.334+0000 7f9fca000640 1 -- 172.21.15.144:0/3155972593 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9fc001a070 con 0x7f9fd40740c0 2024-09-12T12:17:59.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.334+0000 7f9fca000640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9fb40678c0 0x7f9fb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.334+0000 7f9fca000640 1 -- 172.21.15.144:0/3155972593 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f9fc0085220 con 0x7f9fd40740c0 2024-09-12T12:17:59.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.334+0000 7f9fd1e00640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9fb40678c0 0x7f9fb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.334+0000 7f9fd1e00640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9fb40678c0 0x7f9fb4069d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4005890 tx=0x7f9fc4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.338+0000 7f9fca000640 1 -- 172.21.15.144:0/3155972593 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9fc0005480 con 0x7f9fd40740c0 2024-09-12T12:17:59.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.510+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9fd415da30 con 0x7f9fd40740c0 2024-09-12T12:17:59.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.510+0000 7f9fca000640 1 -- 172.21.15.144:0/3155972593 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) ==== 80+0+0 (secure 0 0 0) 0x7f9fc0055bc0 con 0x7f9fd40740c0 2024-09-12T12:17:59.515 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9fb40678c0 msgr2=0x7f9fb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9fb40678c0 0x7f9fb4069d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4005890 tx=0x7f9fc4009040 comp rx=0 tx=0).stop 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd40740c0 msgr2=0x7f9fd413a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd40740c0 0x7f9fd413a440 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000c3f0 tx=0x7f9fc000c8b0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 shutdown_connections 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9fb40678c0 0x7f9fb4069d80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fd415c6a0 0x7f9fd4142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd40740c0 0x7f9fd413a440 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 --2- 172.21.15.144:0/3155972593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fd406f550 0x7f9fd415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 >> 172.21.15.144:0/3155972593 conn(0x7f9fd4067a00 msgr2=0x7f9fd41378a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 shutdown_connections 2024-09-12T12:17:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.514+0000 7f9fd3200640 1 -- 172.21.15.144:0/3155972593 wait complete. 2024-09-12T12:17:59.536 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:17:59.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:59.536 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:17:59.623 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:17:59.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:17:59.624 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:17:59.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-12T12:17:59.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b7c800640 1 Processor -- start 2024-09-12T12:17:59.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b7c800640 1 -- start start 2024-09-12T12:17:59.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b7c800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b7415c2e0 0x7f1b74072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b7c800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1b7406c320 0x7f1b740cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b7c800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b740733e0 con 0x7f1b740af5f0 2024-09-12T12:17:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b7c800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1b740cd290 con 0x7f1b7415c2e0 2024-09-12T12:17:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b7c800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1b740cd570 con 0x7f1b7406c320 2024-09-12T12:17:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b79e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b7415c2e0 0x7f1b74072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b79e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b7415c2e0 0x7f1b74072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38984/0 (socket says 172.21.15.144:38984) 2024-09-12T12:17:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b79400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1b740af5f0 0x7f1b7406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52218/0 (socket says 172.21.15.144:52218) 2024-09-12T12:17:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b79e00640 1 -- 172.21.15.144:0/438293089 learned_addr learned my addr 172.21.15.144:0/438293089 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b7a800640 1 --2- 172.21.15.144:0/438293089 >> v2:172.21.15.165:3300/0 conn(0x7f1b7406c320 0x7f1b740cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b79e00640 1 -- 172.21.15.144:0/438293089 >> v2:172.21.15.165:3300/0 conn(0x7f1b7406c320 msgr2=0x7f1b740cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b79e00640 1 --2- 172.21.15.144:0/438293089 >> v2:172.21.15.165:3300/0 conn(0x7f1b7406c320 0x7f1b740cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b79e00640 1 -- 172.21.15.144:0/438293089 >> v1:172.21.15.144:6789/0 conn(0x7f1b740af5f0 legacy=0x7f1b7406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b78a00640 1 -- 172.21.15.144:0/438293089 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975907716 0 0) 0x7f1b740733e0 con 0x7f1b740af5f0 2024-09-12T12:17:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.814+0000 7f1b79e00640 1 -- 172.21.15.144:0/438293089 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b740cd850 con 0x7f1b7415c2e0 2024-09-12T12:17:59.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b79e00640 1 --2- 172.21.15.144:0/438293089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7415c2e0 0x7f1b74072b50 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1b74071bc0 tx=0x7f1b6801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c22b09e429ed4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b78a00640 1 -- 172.21.15.144:0/438293089 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680b0070 con 0x7f1b7415c2e0 2024-09-12T12:17:59.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b78a00640 1 -- 172.21.15.144:0/438293089 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b680ab600 con 0x7f1b7415c2e0 2024-09-12T12:17:59.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b78a00640 1 -- 172.21.15.144:0/438293089 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680ab9d0 con 0x7f1b7415c2e0 2024-09-12T12:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b7c800640 1 -- 172.21.15.144:0/438293089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7415c2e0 msgr2=0x7f1b74072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b7c800640 1 --2- 172.21.15.144:0/438293089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7415c2e0 0x7f1b74072b50 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1b74071bc0 tx=0x7f1b6801c400 comp rx=0 tx=0).stop 2024-09-12T12:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b7c800640 1 -- 172.21.15.144:0/438293089 shutdown_connections 2024-09-12T12:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b7c800640 1 --2- 172.21.15.144:0/438293089 >> v2:172.21.15.165:3300/0 conn(0x7f1b7406c320 0x7f1b740cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b7c800640 1 --2- 172.21.15.144:0/438293089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7415c2e0 0x7f1b74072b50 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b7c800640 1 -- 172.21.15.144:0/438293089 >> 172.21.15.144:0/438293089 conn(0x7f1b74068030 msgr2=0x7f1b740b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b7c800640 1 -- 172.21.15.144:0/438293089 shutdown_connections 2024-09-12T12:17:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.818+0000 7f1b7c800640 1 -- 172.21.15.144:0/438293089 wait complete. 2024-09-12T12:17:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 Processor -- start 2024-09-12T12:17:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 -- start start 2024-09-12T12:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7406c320 0x7f1b7414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b740af5f0 0x7f1b7415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b7415c2e0 0x7f1b74149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b740cee50 con 0x7f1b7406c320 2024-09-12T12:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b740cecd0 con 0x7f1b7415c2e0 2024-09-12T12:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b740cefd0 con 0x7f1b740af5f0 2024-09-12T12:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7406c320 0x7f1b7414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7406c320 0x7f1b7414e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38994/0 (socket says 172.21.15.144:38994) 2024-09-12T12:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79e00640 1 -- 172.21.15.144:0/2616688926 learned_addr learned my addr 172.21.15.144:0/2616688926 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79e00640 1 -- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b740af5f0 msgr2=0x7f1b7415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79400640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b740af5f0 0x7f1b7415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7a800640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b7415c2e0 0x7f1b74149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79e00640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b740af5f0 0x7f1b7415e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79e00640 1 -- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b7415c2e0 msgr2=0x7f1b74149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79e00640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b7415c2e0 0x7f1b74149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79e00640 1 -- 172.21.15.144:0/2616688926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b74158bd0 con 0x7f1b7406c320 2024-09-12T12:17:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7a800640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b7415c2e0 0x7f1b74149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79400640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b740af5f0 0x7f1b7415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b79e00640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7406c320 0x7f1b7414e230 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f1b680ae040 tx=0x7f1b6801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b6e000640 1 -- 172.21.15.144:0/2616688926 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680b0040 con 0x7f1b7406c320 2024-09-12T12:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b6e000640 1 -- 172.21.15.144:0/2616688926 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b68004030 con 0x7f1b7406c320 2024-09-12T12:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 -- 172.21.15.144:0/2616688926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b74158eb0 con 0x7f1b7406c320 2024-09-12T12:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b6e000640 1 -- 172.21.15.144:0/2616688926 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680043e0 con 0x7f1b7406c320 2024-09-12T12:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.822+0000 7f1b7c800640 1 -- 172.21.15.144:0/2616688926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b74159470 con 0x7f1b7406c320 2024-09-12T12:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b6e000640 1 -- 172.21.15.144:0/2616688926 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b680b3070 con 0x7f1b7406c320 2024-09-12T12:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b6e000640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1b580678c0 0x7f1b58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b6e000640 1 -- 172.21.15.144:0/2616688926 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f1b68120260 con 0x7f1b7406c320 2024-09-12T12:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b79400640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1b580678c0 0x7f1b58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b7fc1e000 1 Processor -- start 2024-09-12T12:17:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b7fc1e000 1 -- start start 2024-09-12T12:17:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b79400640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1b580678c0 0x7f1b58069d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1b741543e0 tx=0x7f1b64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 0x55b3bfee4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee4690 0x55b3bfe97870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfe97db0 0x55b3bfe98190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b3bfd81960 con 0x55b3bfee4690 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b3bfcc5900 con 0x55b3bfe97db0 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b3bfce8d40 con 0x55b3bfee3d70 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee4690 0x55b3bfe97870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee4690 0x55b3bfe97870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39004/0 (socket says 172.21.15.144:39004) 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b79400640 1 -- 172.21.15.144:0/1268277807 learned_addr learned my addr 172.21.15.144:0/1268277807 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b7a800640 1 --2- 172.21.15.144:0/1268277807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfe97db0 0x55b3bfe98190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.826+0000 7f1b79e00640 1 --2- 172.21.15.144:0/1268277807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 0x55b3bfee4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 -- 172.21.15.144:0/1268277807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 msgr2=0x55b3bfee4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 --2- 172.21.15.144:0/1268277807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 0x55b3bfee4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 -- 172.21.15.144:0/1268277807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfe97db0 msgr2=0x55b3bfe98190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:59.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 --2- 172.21.15.144:0/1268277807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfe97db0 0x55b3bfe98190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 -- 172.21.15.144:0/1268277807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bfc8f580 con 0x55b3bfee4690 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 --2- 172.21.15.144:0/1268277807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee4690 0x55b3bfe97870 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f1b64007360 tx=0x7f1b64010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3961eca1b28f961 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b62a00640 1 -- 172.21.15.144:0/1268277807 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6400db50 con 0x55b3bfee4690 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b62a00640 1 -- 172.21.15.144:0/1268277807 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6400dcf0 con 0x55b3bfee4690 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b62a00640 1 -- 172.21.15.144:0/1268277807 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6400dea0 con 0x55b3bfee4690 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/1268277807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee4690 msgr2=0x55b3bfe97870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/1268277807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee4690 0x55b3bfe97870 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f1b64007360 tx=0x7f1b64010000 comp rx=0 tx=0).stop 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/1268277807 shutdown_connections 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/1268277807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfe97db0 0x55b3bfe98190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/1268277807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee4690 0x55b3bfe97870 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/1268277807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 0x55b3bfee4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/1268277807 >> 172.21.15.144:0/1268277807 conn(0x55b3bfec5040 msgr2=0x55b3bfec7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:59.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/1268277807 shutdown_connections 2024-09-12T12:17:59.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/1268277807 wait complete. 2024-09-12T12:17:59.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 -- start start 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 Processor -- start 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfe97db0 0x55b3bfe9f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee3d70 0x55b3bfe9fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 0x55b3bfec5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b3bfce4d00 con 0x55b3bfee3d70 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b3bfca3aa0 con 0x55b3bfee4690 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b3bfc82340 con 0x55b3bfe97db0 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7fc1e000 10 client.0 _ll_register_callbacks cb 0x55b3bfe85760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee3d70 0x55b3bfe9fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee3d70 0x55b3bfe9fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39006/0 (socket says 172.21.15.144:39006) 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 0x55b3bfec5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 -- 172.21.15.144:0/885988754 learned_addr learned my addr 172.21.15.144:0/885988754 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79e00640 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfe97db0 0x55b3bfe9f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7a800640 1 -- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfe97db0 msgr2=0x55b3bfe9f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7a800640 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfe97db0 0x55b3bfe9f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7a800640 1 -- 172.21.15.144:0/885988754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee3d70 msgr2=0x55b3bfe9fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7a800640 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee3d70 0x55b3bfe9fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b7a800640 1 -- 172.21.15.144:0/885988754 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3bfc8bdc0 con 0x55b3bfee4690 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.830+0000 7f1b79400640 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee3d70 0x55b3bfe9fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7a800640 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 0x55b3bfec5420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1b74076240 tx=0x7f1b70012610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8dc6736b889c5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 1 -- 172.21.15.144:0/885988754 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7001c020 con 0x55b3bfee4690 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 1 -- 172.21.15.144:0/885988754 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f1b70012e10 con 0x55b3bfee4690 2024-09-12T12:17:59.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/885988754 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b6400dcf0 con 0x55b3bfee4690 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 1 -- 172.21.15.144:0/885988754 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f1b70026050 con 0x55b3bfee4690 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 10 client.6979 fetch_fsmap learned FSMap version 70 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/885988754 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55b3bfc887f0 con 0x55b3bfee4690 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 1 -- 172.21.15.144:0/885988754 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6400dcf0 con 0x55b3bfee4690 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 1 -- 172.21.15.144:0/885988754 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f1b70029020 con 0x55b3bfee4690 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 10 client.6979 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 10 client.6979 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 20 client.6979 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55b3bfec5e30 0x55b3bfef5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 4 client.6979 mds_command: new command op to 7161 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/885988754 --> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3bfc82e10 con 0x55b3bfec5e30 2024-09-12T12:17:59.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b79e00640 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55b3bfec5e30 0x55b3bfef5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b79e00640 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55b3bfec5e30 0x55b3bfef5020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c1ac8e5348d9c73 server_cookie=2ffee3454dfbbc2 in_seq=0 out_seq=0 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 10 client.6979 ms_handle_connect on v2:172.21.15.165:6832/2978712683 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 1 -- 172.21.15.144:0/885988754 <== mds.0 v2:172.21.15.165:6832/2978712683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3bfc82e10 con 0x55b3bfec5e30 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 10 client.6979 handle_command_reply: tid=0 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 client.6979 shutdown 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 msgr2=0x55b3bfec5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 0x55b3bfec5420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1b74076240 tx=0x7f1b70012610 comp rx=0 tx=0).stop 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/885988754 shutdown_connections 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55b3bfec5e30 0x55b3bfef5020 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 0x55b3bfec5420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfee3d70 0x55b3bfe9fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/885988754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfe97db0 0x55b3bfe9f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b57400640 0 client.6979 ms_handle_reset on v2:172.21.15.165:6832/2978712683 2024-09-12T12:17:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/885988754 >> 172.21.15.144:0/885988754 conn(0x55b3bfec5040 msgr2=0x55b3bfe96f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/885988754 shutdown_connections 2024-09-12T12:17:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/885988754 wait complete. 2024-09-12T12:17:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.834+0000 7f1b7fc1e000 20 client.6979 trim_cache size 0 max 16384 2024-09-12T12:17:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b7fc1e000 1 Processor -- start 2024-09-12T12:17:59.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b7fc1e000 1 -- start start 2024-09-12T12:17:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfe9f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 0x55b3bfe9f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 0x55b3bfec2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74201c50 con 0x55b3bfe97db0 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b74200cf0 con 0x55b3bfee4690 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7415dcf0 con 0x55b3bfee3d70 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfe9f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfe9f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39018/0 (socket says 172.21.15.144:39018) 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79e00640 1 -- 172.21.15.144:0/3421513127 learned_addr learned my addr 172.21.15.144:0/3421513127 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b7a800640 1 --2- 172.21.15.144:0/3421513127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 0x55b3bfec2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79400640 1 --2- 172.21.15.144:0/3421513127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 0x55b3bfe9f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79e00640 1 -- 172.21.15.144:0/3421513127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 msgr2=0x55b3bfe9f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79e00640 1 --2- 172.21.15.144:0/3421513127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 0x55b3bfe9f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79e00640 1 -- 172.21.15.144:0/3421513127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 msgr2=0x55b3bfec2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79e00640 1 --2- 172.21.15.144:0/3421513127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 0x55b3bfec2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79e00640 1 -- 172.21.15.144:0/3421513127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bfca6470 con 0x55b3bfe97db0 2024-09-12T12:17:59.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.850+0000 7f1b79e00640 1 --2- 172.21.15.144:0/3421513127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfe9f2c0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f1b68004660 tx=0x7f1b680f3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6234f50d7cb66b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b62000640 1 -- 172.21.15.144:0/3421513127 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680c3040 con 0x55b3bfe97db0 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b62000640 1 -- 172.21.15.144:0/3421513127 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b680f4940 con 0x55b3bfe97db0 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b62000640 1 -- 172.21.15.144:0/3421513127 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b680f9170 con 0x55b3bfe97db0 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/3421513127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 msgr2=0x55b3bfe9f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/3421513127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfe9f2c0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f1b68004660 tx=0x7f1b680f3040 comp rx=0 tx=0).stop 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/3421513127 shutdown_connections 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/3421513127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee4690 0x55b3bfec2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/3421513127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee3d70 0x55b3bfe9f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/3421513127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfe9f2c0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/3421513127 >> 172.21.15.144:0/3421513127 conn(0x55b3bfec5040 msgr2=0x55b3bfee22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/3421513127 shutdown_connections 2024-09-12T12:17:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/3421513127 wait complete. 2024-09-12T12:17:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- start start 2024-09-12T12:17:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 Processor -- start 2024-09-12T12:17:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfec3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee3d70 0x55b3bfef6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee4690 0x55b3bfef65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b3bfc8ef20 con 0x55b3bfe97db0 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b3bfce4d00 con 0x55b3bfee3d70 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b3bfcf6fd0 con 0x55b3bfee4690 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 10 client.0 _ll_register_callbacks cb 0x7f1b70009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfec3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfec3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39020/0 (socket says 172.21.15.144:39020) 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79e00640 1 -- 172.21.15.144:0/2979184331 learned_addr learned my addr 172.21.15.144:0/2979184331 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79400640 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee3d70 0x55b3bfef6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7a800640 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee4690 0x55b3bfef65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79e00640 1 -- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee4690 msgr2=0x55b3bfef65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79e00640 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee4690 0x55b3bfef65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79e00640 1 -- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee3d70 msgr2=0x55b3bfef6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79e00640 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee3d70 0x55b3bfef6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79e00640 1 -- 172.21.15.144:0/2979184331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3bfc7c640 con 0x55b3bfe97db0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b79e00640 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfec3f10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f1b6801c970 tx=0x7f1b68120040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565efec493d5917e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b57400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b57400640 1 -- 172.21.15.144:0/2979184331 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6811b070 con 0x55b3bfe97db0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b57400640 1 -- 172.21.15.144:0/2979184331 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f1b680ecc00 con 0x55b3bfe97db0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/2979184331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b680f4940 con 0x55b3bfe97db0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b57400640 1 -- 172.21.15.144:0/2979184331 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f1b680c3070 con 0x55b3bfe97db0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 10 client.7317 fetch_fsmap learned FSMap version 70 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/2979184331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) -- 0x55b3bfc803b0 con 0x55b3bfe97db0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b57400640 1 -- 172.21.15.144:0/2979184331 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b680f4940 con 0x55b3bfe97db0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b57400640 1 -- 172.21.15.144:0/2979184331 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 70) ==== 3502+0+0 (secure 0 0 0) 0x7f1b680f8ce0 con 0x55b3bfe97db0 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 10 client.7317 fetch_fsmap finished waiting for FSMap version 70 2024-09-12T12:17:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 10 client.7317 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2024-09-12T12:17:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 20 client.7317 populate_metadata read hostname 'smithi144' 2024-09-12T12:17:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.854+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55b3bfec4450 0x55b3bfef6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.858+0000 7f1b7fc1e000 4 client.7317 mds_command: new command op to 7161 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:17:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.858+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/2979184331 --> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3bfcf6470 con 0x55b3bfec4450 2024-09-12T12:17:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.858+0000 7f1b79400640 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55b3bfec4450 0x55b3bfef6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.858+0000 7f1b79400640 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55b3bfec4450 0x55b3bfef6af0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95dcf2e8622d95f9 server_cookie=44e41ef8a5cb6a98 in_seq=0 out_seq=0 2024-09-12T12:17:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.858+0000 7f1b57400640 10 client.7317 ms_handle_connect on v2:172.21.15.165:6832/2978712683 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b57400640 1 -- 172.21.15.144:0/2979184331 <== mds.0 v2:172.21.15.165:6832/2978712683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3bfcf6470 con 0x55b3bfec4450 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b57400640 10 client.7317 handle_command_reply: tid=0 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 client.7317 shutdown 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/2979184331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 msgr2=0x55b3bfec3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfec3f10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f1b6801c970 tx=0x7f1b68120040 comp rx=0 tx=0).stop 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/2979184331 shutdown_connections 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b3bfee4690 0x55b3bfef65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:6832/2978712683,v1:172.21.15.165:6835/2978712683] conn(0x55b3bfec4450 0x55b3bfef6af0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b3bfee3d70 0x55b3bfef6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 --2- 172.21.15.144:0/2979184331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b3bfe97db0 0x55b3bfec3f10 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b57400640 0 client.7317 ms_handle_reset on v2:172.21.15.165:6832/2978712683 2024-09-12T12:17:59.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/2979184331 >> 172.21.15.144:0/2979184331 conn(0x55b3bfec5040 msgr2=0x55b3bfee2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:59.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/2979184331 shutdown_connections 2024-09-12T12:17:59.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 1 -- 172.21.15.144:0/2979184331 wait complete. 2024-09-12T12:17:59.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.870+0000 7f1b7fc1e000 20 client.7317 trim_cache size 0 max 16384 2024-09-12T12:17:59.876 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:17:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:17:59.876 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:17:59.876 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:17:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 -- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1b580678c0 msgr2=0x7f1b58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1b580678c0 0x7f1b58069d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1b741543e0 tx=0x7f1b64009040 comp rx=0 tx=0).stop 2024-09-12T12:17:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 -- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7406c320 msgr2=0x7f1b7414e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7406c320 0x7f1b7414e230 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f1b680ae040 tx=0x7f1b6801ac40 comp rx=0 tx=0).stop 2024-09-12T12:17:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 -- 172.21.15.144:0/2616688926 shutdown_connections 2024-09-12T12:17:59.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1b580678c0 0x7f1b58069d80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b7415c2e0 0x7f1b74149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b740af5f0 0x7f1b7415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 --2- 172.21.15.144:0/2616688926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b7406c320 0x7f1b7414e230 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:59.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 -- 172.21.15.144:0/2616688926 >> 172.21.15.144:0/2616688926 conn(0x7f1b74068030 msgr2=0x7f1b740b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:59.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 -- 172.21.15.144:0/2616688926 shutdown_connections 2024-09-12T12:17:59.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:17:59.874+0000 7f1b7c800640 1 -- 172.21.15.144:0/2616688926 wait complete. 2024-09-12T12:17:59.895 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:17:59.895 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:59.896 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:17:59.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:59.896 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:17:59.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:59.896 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:17:59.897 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:17:59.908 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:17:59.908 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-12T12:17:59.909 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:17:59.909 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-12T12:17:59.910 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:17:59.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-12T12:17:59.911 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:17:59.911 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-12T12:18:00.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2cc000640 1 Processor -- start 2024-09-12T12:18:00.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2cc000640 1 -- start start 2024-09-12T12:18:00.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe13dc00640 1 Processor -- start 2024-09-12T12:18:00.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe13dc00640 1 -- start start 2024-09-12T12:18:00.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2cc000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2c4161cb0 0x7fd2c415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2cc000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c40b4970 0x7fd2c415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2cc000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2c415f0d0 con 0x7fd2c41602e0 2024-09-12T12:18:00.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2cc000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c415fbf0 con 0x7fd2c4161cb0 2024-09-12T12:18:00.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2cc000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c4159100 con 0x7fd2c40b4970 2024-09-12T12:18:00.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fa10c600640 1 Processor -- start 2024-09-12T12:18:00.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe13dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe13815e5f0 0x7fe13806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2ca000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd2c41602e0 0x7fd2c40aef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52226/0 (socket says 172.21.15.144:52226) 2024-09-12T12:18:00.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2ca000640 1 -- 172.21.15.144:0/2643616063 learned_addr learned my addr 172.21.15.144:0/2643616063 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2c8c00640 1 --2- 172.21.15.144:0/2643616063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c40b4970 0x7fd2c415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe13dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe13806ea10 0x7fe1380b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe13dc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13806d260 con 0x7fe1380b44a0 2024-09-12T12:18:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe13dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe1380b6f60 con 0x7fe13806ea10 2024-09-12T12:18:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe13dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe1380b7240 con 0x7fe13815e5f0 2024-09-12T12:18:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fa10c600640 1 -- start start 2024-09-12T12:18:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe136a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe13815e5f0 0x7fe13806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe136a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe13815e5f0 0x7fe13806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:38930/0 (socket says 172.21.15.144:38930) 2024-09-12T12:18:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fe136a00640 1 -- 172.21.15.144:0/2491490714 learned_addr learned my addr 172.21.15.144:0/2491490714 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2c9600640 1 --2- 172.21.15.144:0/2643616063 >> v2:172.21.15.144:3300/0 conn(0x7fd2c4161cb0 0x7fd2c415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2c8c00640 1 -- 172.21.15.144:0/2643616063 >> v2:172.21.15.144:3300/0 conn(0x7fd2c4161cb0 msgr2=0x7fd2c415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2c8c00640 1 --2- 172.21.15.144:0/2643616063 >> v2:172.21.15.144:3300/0 conn(0x7fd2c4161cb0 0x7fd2c415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fe136a00640 1 -- 172.21.15.144:0/2491490714 >> v2:172.21.15.144:3300/0 conn(0x7fe13806ea10 msgr2=0x7fe1380b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:00.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fe136a00640 1 --2- 172.21.15.144:0/2491490714 >> v2:172.21.15.144:3300/0 conn(0x7fe13806ea10 0x7fe1380b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fe136a00640 1 -- 172.21.15.144:0/2491490714 >> v1:172.21.15.165:6789/0 conn(0x7fe1380b44a0 legacy=0x7fe13806e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2c8c00640 1 -- 172.21.15.144:0/2643616063 >> v1:172.21.15.144:6789/0 conn(0x7fd2c41602e0 legacy=0x7fd2c40aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.094+0000 7fd2c8c00640 1 -- 172.21.15.144:0/2643616063 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c415f350 con 0x7fd2c40b4970 2024-09-12T12:18:00.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fe136a00640 1 -- 172.21.15.144:0/2491490714 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1380b7520 con 0x7fe13815e5f0 2024-09-12T12:18:00.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf2d200640 1 Processor -- start 2024-09-12T12:18:00.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf2d200640 1 -- start start 2024-09-12T12:18:00.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa10c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa1040d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa10c600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa1040b6730 0x7fa1040b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa10c600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1040d1580 con 0x7fa1040b4200 2024-09-12T12:18:00.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa10c600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa1040b4b80 con 0x7fa1040b6730 2024-09-12T12:18:00.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa10c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa1040d1860 con 0x7fa10415c220 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa109c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa1040d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa109200640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fa1040b4200 0x7fa1040732c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:60440/0 (socket says 172.21.15.144:60440) 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa109200640 1 -- 172.21.15.144:0/1740526052 learned_addr learned my addr 172.21.15.144:0/1740526052 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa10a600640 1 --2- 172.21.15.144:0/1740526052 >> v2:172.21.15.144:3300/0 conn(0x7fa1040b6730 0x7fa1040b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa109c00640 1 -- 172.21.15.144:0/1740526052 >> v2:172.21.15.144:3300/0 conn(0x7fa1040b6730 msgr2=0x7fa1040b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa109c00640 1 --2- 172.21.15.144:0/1740526052 >> v2:172.21.15.144:3300/0 conn(0x7fa1040b6730 0x7fa1040b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa109c00640 1 -- 172.21.15.144:0/1740526052 >> v1:172.21.15.165:6789/0 conn(0x7fa1040b4200 legacy=0x7fa1040732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa109c00640 1 -- 172.21.15.144:0/1740526052 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1040d1b40 con 0x7fa10415c220 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa103e00640 1 -- 172.21.15.144:0/1740526052 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2502915713 0 0) 0x7fa1040d1580 con 0x7fa1040b4200 2024-09-12T12:18:00.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fa10a600640 1 --2- 172.21.15.144:0/1740526052 >> v2:172.21.15.144:3300/0 conn(0x7fa1040b6730 0x7fa1040b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:00.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf2d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbf280b4200 0x7fbf280b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf2d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b5720 0x7fbf280b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf2d200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf280d1580 con 0x7fbf2815c220 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf2d200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbf280b4bb0 con 0x7fbf280b4200 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf2d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbf280d1320 con 0x7fbf280b5720 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf25e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbf2815c220 0x7fbf280d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52230/0 (socket says 172.21.15.144:52230) 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf25e00640 1 -- 172.21.15.144:0/581088111 learned_addr learned my addr 172.21.15.144:0/581088111 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf25400640 1 --2- 172.21.15.144:0/581088111 >> v2:172.21.15.165:3300/0 conn(0x7fbf280b4200 0x7fbf280b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf26800640 1 --2- 172.21.15.144:0/581088111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b5720 0x7fbf280b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf24a00640 1 -- 172.21.15.144:0/581088111 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279221827 0 0) 0x7fbf280d1580 con 0x7fbf2815c220 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf24a00640 1 -- 172.21.15.144:0/581088111 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf0c003530 con 0x7fbf2815c220 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf25400640 1 -- 172.21.15.144:0/581088111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b5720 msgr2=0x7fbf280b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf25400640 1 --2- 172.21.15.144:0/581088111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b5720 0x7fbf280b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf25400640 1 -- 172.21.15.144:0/581088111 >> v1:172.21.15.144:6789/0 conn(0x7fbf2815c220 legacy=0x7fbf280d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fe136a00640 1 --2- 172.21.15.144:0/2491490714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13815e5f0 0x7fe13806cd20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe138074b30 tx=0x7fe12801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a07f9d61326ed2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.098+0000 7fbf25400640 1 -- 172.21.15.144:0/581088111 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf280d1860 con 0x7fbf280b4200 2024-09-12T12:18:00.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe135600640 1 -- 172.21.15.144:0/2491490714 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280ab680 con 0x7fe13815e5f0 2024-09-12T12:18:00.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe135600640 1 -- 172.21.15.144:0/2491490714 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1280b0070 con 0x7fe13815e5f0 2024-09-12T12:18:00.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe135600640 1 -- 172.21.15.144:0/2491490714 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280aba40 con 0x7fe13815e5f0 2024-09-12T12:18:00.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2c8c00640 1 --2- 172.21.15.144:0/2643616063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c40b4970 0x7fd2c415fda0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00097c0 tx=0x7fd2b001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1e4c23cbb8bd84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2c3e00640 1 -- 172.21.15.144:0/2643616063 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00b2070 con 0x7fd2c40b4970 2024-09-12T12:18:00.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2c3e00640 1 -- 172.21.15.144:0/2643616063 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b00ad640 con 0x7fd2c40b4970 2024-09-12T12:18:00.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2c3e00640 1 -- 172.21.15.144:0/2643616063 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00ada10 con 0x7fd2c40b4970 2024-09-12T12:18:00.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 -- 172.21.15.144:0/2491490714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13815e5f0 msgr2=0x7fe13806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 --2- 172.21.15.144:0/2491490714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13815e5f0 0x7fe13806cd20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe138074b30 tx=0x7fe12801c460 comp rx=0 tx=0).stop 2024-09-12T12:18:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 -- 172.21.15.144:0/2491490714 shutdown_connections 2024-09-12T12:18:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 --2- 172.21.15.144:0/2491490714 >> v2:172.21.15.144:3300/0 conn(0x7fe13806ea10 0x7fe1380b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 --2- 172.21.15.144:0/2491490714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13815e5f0 0x7fe13806cd20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 -- 172.21.15.144:0/2491490714 >> 172.21.15.144:0/2491490714 conn(0x7fe13806f400 msgr2=0x7fe13806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 -- 172.21.15.144:0/2491490714 shutdown_connections 2024-09-12T12:18:00.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 -- 172.21.15.144:0/2491490714 wait complete. 2024-09-12T12:18:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 -- 172.21.15.144:0/2643616063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c40b4970 msgr2=0x7fd2c415fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 --2- 172.21.15.144:0/2643616063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c40b4970 0x7fd2c415fda0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00097c0 tx=0x7fd2b001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 -- 172.21.15.144:0/2643616063 shutdown_connections 2024-09-12T12:18:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 --2- 172.21.15.144:0/2643616063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c40b4970 0x7fd2c415fda0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 --2- 172.21.15.144:0/2643616063 >> v2:172.21.15.144:3300/0 conn(0x7fd2c4161cb0 0x7fd2c415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 -- 172.21.15.144:0/2643616063 >> 172.21.15.144:0/2643616063 conn(0x7fd2c40cd870 msgr2=0x7fd2c40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 -- 172.21.15.144:0/2643616063 shutdown_connections 2024-09-12T12:18:00.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 -- 172.21.15.144:0/2643616063 wait complete. 2024-09-12T12:18:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa109c00640 1 --2- 172.21.15.144:0/1740526052 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa1040d0c10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80097c0 tx=0x7fa0f801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11a925caa93bdfcd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa103e00640 1 -- 172.21.15.144:0/1740526052 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80b0070 con 0x7fa10415c220 2024-09-12T12:18:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa103e00640 1 -- 172.21.15.144:0/1740526052 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f80ab600 con 0x7fa10415c220 2024-09-12T12:18:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa103e00640 1 -- 172.21.15.144:0/1740526052 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80ab9d0 con 0x7fa10415c220 2024-09-12T12:18:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa10c600640 1 -- 172.21.15.144:0/1740526052 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 msgr2=0x7fa1040d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa10c600640 1 --2- 172.21.15.144:0/1740526052 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa1040d0c10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80097c0 tx=0x7fa0f801c470 comp rx=0 tx=0).stop 2024-09-12T12:18:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 Processor -- start 2024-09-12T12:18:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fbf25400640 1 --2- 172.21.15.144:0/581088111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf280b4200 0x7fbf280b4670 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbf140097f0 tx=0x7fbf1401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=599a8781fa041416 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa10c600640 1 -- 172.21.15.144:0/1740526052 shutdown_connections 2024-09-12T12:18:00.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa10c600640 1 --2- 172.21.15.144:0/1740526052 >> v2:172.21.15.144:3300/0 conn(0x7fa1040b6730 0x7fa1040b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa10c600640 1 --2- 172.21.15.144:0/1740526052 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa1040d0c10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa10c600640 1 -- 172.21.15.144:0/1740526052 >> 172.21.15.144:0/1740526052 conn(0x7fa10406f400 msgr2=0x7fa10406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa10c600640 1 -- 172.21.15.144:0/1740526052 shutdown_connections 2024-09-12T12:18:00.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fe13dc00640 1 -- start start 2024-09-12T12:18:00.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 Processor -- start 2024-09-12T12:18:00.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fa10c600640 1 -- 172.21.15.144:0/1740526052 wait complete. 2024-09-12T12:18:00.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fbf24a00640 1 -- 172.21.15.144:0/581088111 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140a7070 con 0x7fbf280b4200 2024-09-12T12:18:00.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fbf24a00640 1 -- 172.21.15.144:0/581088111 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf140b0070 con 0x7fbf280b4200 2024-09-12T12:18:00.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fbf24a00640 1 -- 172.21.15.144:0/581088111 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140ab690 con 0x7fbf280b4200 2024-09-12T12:18:00.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.102+0000 7fd2cc000640 1 -- start start 2024-09-12T12:18:00.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 -- 172.21.15.144:0/581088111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf280b4200 msgr2=0x7fbf280b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 --2- 172.21.15.144:0/581088111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf280b4200 0x7fbf280b4670 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbf140097f0 tx=0x7fbf1401c470 comp rx=0 tx=0).stop 2024-09-12T12:18:00.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2cc000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c40b4970 0x7fd2c414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2cc000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2c41602e0 0x7fd2c41520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2cc000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c4161cb0 0x7fd2c41525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2cc000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c416b3a0 con 0x7fd2c40b4970 2024-09-12T12:18:00.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2cc000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c416b220 con 0x7fd2c41602e0 2024-09-12T12:18:00.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2cc000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c416b520 con 0x7fd2c4161cb0 2024-09-12T12:18:00.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe13dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13806ea10 0x7fe13813bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe13dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1380b44a0 0x7fe13814a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe13dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe13815e5f0 0x7fe13814a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe13dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe13815f8a0 con 0x7fe13815e5f0 2024-09-12T12:18:00.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe13dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe13815f720 con 0x7fe13806ea10 2024-09-12T12:18:00.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe13dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe13815fa20 con 0x7fe1380b44a0 2024-09-12T12:18:00.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13806ea10 0x7fe13813bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13806ea10 0x7fe13813bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:38950/0 (socket says 172.21.15.144:38950) 2024-09-12T12:18:00.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136a00640 1 -- 172.21.15.144:0/876561236 learned_addr learned my addr 172.21.15.144:0/876561236 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:00.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2ca000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c4161cb0 0x7fd2c41525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c40b4970 0x7fd2c414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136000640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1380b44a0 0x7fe13814a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2c41602e0 0x7fd2c41520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c40b4970 0x7fd2c414e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39058/0 (socket says 172.21.15.144:39058) 2024-09-12T12:18:00.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c9600640 1 -- 172.21.15.144:0/3670050481 learned_addr learned my addr 172.21.15.144:0/3670050481 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:00.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2ca000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c4161cb0 0x7fd2c41525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:48152/0 (socket says 172.21.15.144:48152) 2024-09-12T12:18:00.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10c600640 1 Processor -- start 2024-09-12T12:18:00.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 -- 172.21.15.144:0/581088111 shutdown_connections 2024-09-12T12:18:00.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 --2- 172.21.15.144:0/581088111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b5720 0x7fbf280b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 --2- 172.21.15.144:0/581088111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf280b4200 0x7fbf280b4670 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 -- 172.21.15.144:0/581088111 >> 172.21.15.144:0/581088111 conn(0x7fbf2806f400 msgr2=0x7fbf2806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10c600640 1 -- start start 2024-09-12T12:18:00.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 -- 172.21.15.144:0/581088111 shutdown_connections 2024-09-12T12:18:00.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 -- 172.21.15.144:0/581088111 wait complete. 2024-09-12T12:18:00.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c8c00640 1 -- 172.21.15.144:0/3670050481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c4161cb0 msgr2=0x7fd2c41525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c8c00640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c4161cb0 0x7fd2c41525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c8c00640 1 -- 172.21.15.144:0/3670050481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c40b4970 msgr2=0x7fd2c414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136a00640 1 -- 172.21.15.144:0/876561236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1380b44a0 msgr2=0x7fe13814a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136a00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1380b44a0 0x7fe13814a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136a00640 1 -- 172.21.15.144:0/876561236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe13815e5f0 msgr2=0x7fe13814a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136a00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe13815e5f0 0x7fe13814a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136a00640 1 -- 172.21.15.144:0/876561236 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13814fb60 con 0x7fe13806ea10 2024-09-12T12:18:00.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c8c00640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c40b4970 0x7fd2c414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c8c00640 1 -- 172.21.15.144:0/3670050481 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c4159340 con 0x7fd2c41602e0 2024-09-12T12:18:00.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe136a00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13806ea10 0x7fe13813bef0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe1280ad040 tx=0x7fe12801aca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2ca000640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c4161cb0 0x7fd2c41525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:00.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1040b4200 0x7fa104150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe12ea00640 1 -- 172.21.15.144:0/876561236 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280b4800 con 0x7fe13806ea10 2024-09-12T12:18:00.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe12ea00640 1 -- 172.21.15.144:0/876561236 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1280a7070 con 0x7fe13806ea10 2024-09-12T12:18:00.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe138152c10 con 0x7fe13806ea10 2024-09-12T12:18:00.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fd2c8c00640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2c41602e0 0x7fd2c41520b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00ac000 tx=0x7fd2b0019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10c600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1040b6730 0x7fa1041fb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa10415cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1040d12d0 con 0x7fa1040b4200 2024-09-12T12:18:00.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10c600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa1040d1150 con 0x7fa1040b6730 2024-09-12T12:18:00.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa104070bf0 con 0x7fa10415c220 2024-09-12T12:18:00.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe12ea00640 1 -- 172.21.15.144:0/876561236 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280b4c00 con 0x7fe13806ea10 2024-09-12T12:18:00.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1040b4200 0x7fa104150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1040b4200 0x7fa104150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39066/0 (socket says 172.21.15.144:39066) 2024-09-12T12:18:00.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109c00640 1 -- 172.21.15.144:0/1952509898 learned_addr learned my addr 172.21.15.144:0/1952509898 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:00.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fd2c1600640 1 -- 172.21.15.144:0/3670050481 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00ba020 con 0x7fd2c41602e0 2024-09-12T12:18:00.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109200640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1040b6730 0x7fa1041fb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10a600640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa10415cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109c00640 1 -- 172.21.15.144:0/1952509898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 msgr2=0x7fa10415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109c00640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa10415cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109c00640 1 -- 172.21.15.144:0/1952509898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1040b6730 msgr2=0x7fa1041fb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109c00640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1040b6730 0x7fa1041fb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109c00640 1 -- 172.21.15.144:0/1952509898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10415d890 con 0x7fa1040b4200 2024-09-12T12:18:00.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa10a600640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa10415cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:00.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fa109c00640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1040b4200 0x7fa104150c10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80097c0 tx=0x7fa0f8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fa101600640 1 -- 172.21.15.144:0/1952509898 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80b0040 con 0x7fa1040b4200 2024-09-12T12:18:00.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fa101600640 1 -- 172.21.15.144:0/1952509898 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f80ab400 con 0x7fa1040b4200 2024-09-12T12:18:00.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fa101600640 1 -- 172.21.15.144:0/1952509898 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80b4650 con 0x7fa1040b4200 2024-09-12T12:18:00.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1381531d0 con 0x7fe13806ea10 2024-09-12T12:18:00.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 Processor -- start 2024-09-12T12:18:00.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.106+0000 7fbf2d200640 1 -- start start 2024-09-12T12:18:00.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fd2c1600640 1 -- 172.21.15.144:0/3670050481 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b00b6410 con 0x7fd2c41602e0 2024-09-12T12:18:00.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c415baf0 con 0x7fd2c41602e0 2024-09-12T12:18:00.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10415db70 con 0x7fa1040b4200 2024-09-12T12:18:00.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fd2c1600640 1 -- 172.21.15.144:0/3670050481 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00b2040 con 0x7fd2c41602e0 2024-09-12T12:18:00.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1380b48d0 con 0x7fe13806ea10 2024-09-12T12:18:00.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf2d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b4200 0x7fbf281f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf2d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf280b5720 0x7fbf28155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf2d200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2815c220 0x7fbf2815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf2d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2815c780 con 0x7fbf280b5720 2024-09-12T12:18:00.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf2d200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2815c600 con 0x7fbf2815c220 2024-09-12T12:18:00.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf2d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbf28070bf0 con 0x7fbf280b4200 2024-09-12T12:18:00.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b4200 0x7fbf281f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b4200 0x7fbf281f3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:48168/0 (socket says 172.21.15.144:48168) 2024-09-12T12:18:00.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25e00640 1 -- 172.21.15.144:0/3822102164 learned_addr learned my addr 172.21.15.144:0/3822102164 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:00.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1041598f0 con 0x7fa1040b4200 2024-09-12T12:18:00.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25400640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf280b5720 0x7fbf28155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf26800640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2815c220 0x7fbf2815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c415c0b0 con 0x7fd2c41602e0 2024-09-12T12:18:00.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25e00640 1 -- 172.21.15.144:0/3822102164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2815c220 msgr2=0x7fbf2815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25e00640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2815c220 0x7fbf2815ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25e00640 1 -- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf280b5720 msgr2=0x7fbf28155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25e00640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf280b5720 0x7fbf28155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25e00640 1 -- 172.21.15.144:0/3822102164 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf28152fa0 con 0x7fbf280b4200 2024-09-12T12:18:00.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c415fda0 con 0x7fd2c41602e0 2024-09-12T12:18:00.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf25e00640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b4200 0x7fbf281f3d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000caa0 tx=0x7fbf2000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fe12ea00640 1 -- 172.21.15.144:0/876561236 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1280c83d0 con 0x7fe13806ea10 2024-09-12T12:18:00.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1040b4640 con 0x7fa1040b4200 2024-09-12T12:18:00.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf1e000640 1 -- 172.21.15.144:0/3822102164 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20017070 con 0x7fbf280b4200 2024-09-12T12:18:00.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf1e000640 1 -- 172.21.15.144:0/3822102164 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2000ac00 con 0x7fbf280b4200 2024-09-12T12:18:00.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fbf1e000640 1 -- 172.21.15.144:0/3822102164 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20012400 con 0x7fbf280b4200 2024-09-12T12:18:00.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.110+0000 7fd2c1600640 1 -- 172.21.15.144:0/3670050481 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2b00bd020 con 0x7fd2c41602e0 2024-09-12T12:18:00.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fa101600640 1 -- 172.21.15.144:0/1952509898 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0f80bc020 con 0x7fa1040b4200 2024-09-12T12:18:00.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fe12ea00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1180678f0 0x7fe118069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fe12ea00640 1 -- 172.21.15.144:0/876561236 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fe1281209d0 con 0x7fe13806ea10 2024-09-12T12:18:00.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf28153280 con 0x7fbf280b4200 2024-09-12T12:18:00.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf28155ad0 con 0x7fbf280b4200 2024-09-12T12:18:00.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fd2c1600640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2a4067910 0x7fd2a4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fd2c9600640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2a4067910 0x7fd2a4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf280b4670 con 0x7fbf280b4200 2024-09-12T12:18:00.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fa101600640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e40678c0 0x7fa0e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fa101600640 1 -- 172.21.15.144:0/1952509898 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fa0f811f2a0 con 0x7fa1040b4200 2024-09-12T12:18:00.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fd2c9600640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2a4067910 0x7fd2a4069dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8007a70 tx=0x7fd2b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fbf1e000640 1 -- 172.21.15.144:0/3822102164 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbf2001a070 con 0x7fbf280b4200 2024-09-12T12:18:00.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fa109200640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e40678c0 0x7fa0e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fd2c1600640 1 -- 172.21.15.144:0/3670050481 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fd2b011df80 con 0x7fd2c41602e0 2024-09-12T12:18:00.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fe136000640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1180678f0 0x7fe118069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fe12ea00640 1 -- 172.21.15.144:0/876561236 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe128016110 con 0x7fe13806ea10 2024-09-12T12:18:00.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fbf1e000640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbf080678c0 0x7fbf08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fa109200640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e40678c0 0x7fa0e4069d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa104153ee0 tx=0x7fa0f0007b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fe136000640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1180678f0 0x7fe118069db0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe1380d23a0 tx=0x7fe124009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fbf1e000640 1 -- 172.21.15.144:0/3822102164 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7fbf20085af0 con 0x7fbf280b4200 2024-09-12T12:18:00.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.114+0000 7fbf25400640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbf080678c0 0x7fbf08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.118+0000 7fbf25400640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbf080678c0 0x7fbf08069d80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbf140af000 tx=0x7fbf140a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.118+0000 7fd2c1600640 1 -- 172.21.15.144:0/3670050481 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2b00c4030 con 0x7fd2c41602e0 2024-09-12T12:18:00.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.118+0000 7fbf1e000640 1 -- 172.21.15.144:0/3822102164 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbf20055ee0 con 0x7fbf280b4200 2024-09-12T12:18:00.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.122+0000 7fa101600640 1 -- 172.21.15.144:0/1952509898 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa0f80c3020 con 0x7fa1040b4200 2024-09-12T12:18:00.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.346+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7fbf280b1b30 con 0x7fbf280b4200 2024-09-12T12:18:00.352 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:18:00.350+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:18:00.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.354+0000 7fbf1e000640 1 -- 172.21.15.144:0/3822102164 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 7161 v71) ==== 95+0+0 (secure 0 0 0) 0x7fbf2005a1e0 con 0x7fbf280b4200 2024-09-12T12:18:00.357 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 7161 2024-09-12T12:18:00.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fd2c40691d0 con 0x7fd2c41602e0 2024-09-12T12:18:00.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbf080678c0 msgr2=0x7fbf08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbf080678c0 0x7fbf08069d80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fbf140af000 tx=0x7fbf140a7000 comp rx=0 tx=0).stop 2024-09-12T12:18:00.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b4200 msgr2=0x7fbf281f3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b4200 0x7fbf281f3d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000caa0 tx=0x7fbf2000cf60 comp rx=0 tx=0).stop 2024-09-12T12:18:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 shutdown_connections 2024-09-12T12:18:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbf080678c0 0x7fbf08069d80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2815c220 0x7fbf2815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf280b5720 0x7fbf28155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 --2- 172.21.15.144:0/3822102164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf280b4200 0x7fbf281f3d40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 >> 172.21.15.144:0/3822102164 conn(0x7fbf2806f400 msgr2=0x7fbf2815ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 shutdown_connections 2024-09-12T12:18:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fbf2d200640 1 -- 172.21.15.144:0/3822102164 wait complete. 2024-09-12T12:18:00.362 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:18:00.358+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:18:00.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.362+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fe1380b40c0 con 0x7fe13806ea10 2024-09-12T12:18:00.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.366+0000 7fd2c1600640 1 -- 172.21.15.144:0/3670050481 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7155 v73) ==== 95+0+0 (secure 0 0 0) 0x7fd2b0016090 con 0x7fd2c41602e0 2024-09-12T12:18:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 7155 2024-09-12T12:18:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.366+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7fa10406fac0 con 0x7fa1040b4200 2024-09-12T12:18:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2a4067910 msgr2=0x7fd2a4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2a4067910 0x7fd2a4069dd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8007a70 tx=0x7fd2b8008040 comp rx=0 tx=0).stop 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2c41602e0 msgr2=0x7fd2c41520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2c41602e0 0x7fd2c41520b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00ac000 tx=0x7fd2b0019240 comp rx=0 tx=0).stop 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 shutdown_connections 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2a4067910 0x7fd2a4069dd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2c4161cb0 0x7fd2c41525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2c41602e0 0x7fd2c41520b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 --2- 172.21.15.144:0/3670050481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2c40b4970 0x7fd2c414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 >> 172.21.15.144:0/3670050481 conn(0x7fd2c40cd870 msgr2=0x7fd2c4158260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 shutdown_connections 2024-09-12T12:18:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.370+0000 7fd2cc000640 1 -- 172.21.15.144:0/3670050481 wait complete. 2024-09-12T12:18:00.378 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:18:00.374+0000 7fac6ba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:18:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa101600640 1 -- 172.21.15.144:0/1952509898 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7152 v75) ==== 95+0+0 (secure 0 0 0) 0x7fa0f8016090 con 0x7fa1040b4200 2024-09-12T12:18:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 7152 2024-09-12T12:18:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e40678c0 msgr2=0x7fa0e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e40678c0 0x7fa0e4069d80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa104153ee0 tx=0x7fa0f0007b60 comp rx=0 tx=0).stop 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1040b4200 msgr2=0x7fa104150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1040b4200 0x7fa104150c10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80097c0 tx=0x7fa0f8019210 comp rx=0 tx=0).stop 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 shutdown_connections 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa0e40678c0 0x7fa0e4069d80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa10415c220 0x7fa10415cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1040b6730 0x7fa1041fb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 --2- 172.21.15.144:0/1952509898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1040b4200 0x7fa104150c10 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 >> 172.21.15.144:0/1952509898 conn(0x7fa10406f400 msgr2=0x7fa104154600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 shutdown_connections 2024-09-12T12:18:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.378+0000 7fa10c600640 1 -- 172.21.15.144:0/1952509898 wait complete. 2024-09-12T12:18:00.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe12ea00640 1 -- 172.21.15.144:0/876561236 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6278 v75) ==== 95+0+0 (secure 0 0 0) 0x7fe1280f0d30 con 0x7fe13806ea10 2024-09-12T12:18:00.386 INFO:teuthology.orchestra.run.smithi144.stderr:failed mds gid 6278 2024-09-12T12:18:00.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1180678f0 msgr2=0x7fe118069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1180678f0 0x7fe118069db0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe1380d23a0 tx=0x7fe124009040 comp rx=0 tx=0).stop 2024-09-12T12:18:00.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13806ea10 msgr2=0x7fe13813bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13806ea10 0x7fe13813bef0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe1280ad040 tx=0x7fe12801aca0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 shutdown_connections 2024-09-12T12:18:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1180678f0 0x7fe118069db0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe13815e5f0 0x7fe13814a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1380b44a0 0x7fe13814a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 --2- 172.21.15.144:0/876561236 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe13806ea10 0x7fe13813bef0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 >> 172.21.15.144:0/876561236 conn(0x7fe13806f400 msgr2=0x7fe1380b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.382+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 shutdown_connections 2024-09-12T12:18:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.386+0000 7fe13dc00640 1 -- 172.21.15.144:0/876561236 wait complete. 2024-09-12T12:18:00.390 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:18:00.390 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:18:00.393 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:18:00.393 DEBUG:teuthology.parallel:result is None 2024-09-12T12:18:00.399 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:18:00.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:18:00.410 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:18:00.410 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:18:00.411 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:18:00.411 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:18:00.413 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:18:00.413 DEBUG:teuthology.parallel:result is None 2024-09-12T12:18:00.414 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:18:00.415 DEBUG:teuthology.parallel:result is None 2024-09-12T12:18:00.457 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:18:00.457 DEBUG:teuthology.parallel:result is None 2024-09-12T12:18:00.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:00.476 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:18:00.498 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:18:00.501 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:18:00.545 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:18:00.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.598+0000 7fc756800640 1 Processor -- start 2024-09-12T12:18:00.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.598+0000 7fc756800640 1 -- start start 2024-09-12T12:18:00.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc756800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc75015e470 0x7fc750162a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc756800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc7500afab0 0x7fc7500717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc756800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7500b5270 con 0x7fc75006e910 2024-09-12T12:18:00.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc756800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc7500b5e40 con 0x7fc75015e470 2024-09-12T12:18:00.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc756800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc750071d30 con 0x7fc7500afab0 2024-09-12T12:18:00.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc74f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc75015e470 0x7fc750162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc74f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc75015e470 0x7fc750162a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39120/0 (socket says 172.21.15.144:39120) 2024-09-12T12:18:00.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc74f400640 1 -- 172.21.15.144:0/1929005348 learned_addr learned my addr 172.21.15.144:0/1929005348 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:00.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc74ea00640 1 --2- 172.21.15.144:0/1929005348 >> v2:172.21.15.165:3300/0 conn(0x7fc7500afab0 0x7fc7500717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc74f400640 1 -- 172.21.15.144:0/1929005348 >> v2:172.21.15.165:3300/0 conn(0x7fc7500afab0 msgr2=0x7fc7500717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:00.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc74f400640 1 --2- 172.21.15.144:0/1929005348 >> v2:172.21.15.165:3300/0 conn(0x7fc7500afab0 0x7fc7500717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc74f400640 1 -- 172.21.15.144:0/1929005348 >> v1:172.21.15.165:6789/0 conn(0x7fc75006e910 legacy=0x7fc7500b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.602+0000 7fc74f400640 1 -- 172.21.15.144:0/1929005348 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7500b5510 con 0x7fc75015e470 2024-09-12T12:18:00.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc74f400640 1 --2- 172.21.15.144:0/1929005348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc75015e470 0x7fc750162a80 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc75006f640 tx=0x7fc74001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3638cbc03caf2210 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc74e000640 1 -- 172.21.15.144:0/1929005348 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7400ab610 con 0x7fc75015e470 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc74e000640 1 -- 172.21.15.144:0/1929005348 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7400b0070 con 0x7fc75015e470 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc74e000640 1 -- 172.21.15.144:0/1929005348 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7400ab9d0 con 0x7fc75015e470 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 -- 172.21.15.144:0/1929005348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc75015e470 msgr2=0x7fc750162a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 --2- 172.21.15.144:0/1929005348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc75015e470 0x7fc750162a80 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc75006f640 tx=0x7fc74001c520 comp rx=0 tx=0).stop 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 -- 172.21.15.144:0/1929005348 shutdown_connections 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 --2- 172.21.15.144:0/1929005348 >> v2:172.21.15.165:3300/0 conn(0x7fc7500afab0 0x7fc7500717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 --2- 172.21.15.144:0/1929005348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc75015e470 0x7fc750162a80 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 -- 172.21.15.144:0/1929005348 >> 172.21.15.144:0/1929005348 conn(0x7fc75006ddf0 msgr2=0x7fc75006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 -- 172.21.15.144:0/1929005348 shutdown_connections 2024-09-12T12:18:00.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 -- 172.21.15.144:0/1929005348 wait complete. 2024-09-12T12:18:00.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 Processor -- start 2024-09-12T12:18:00.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.606+0000 7fc756800640 1 -- start start 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc756800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75006e910 0x7fc750166220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc756800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7500afab0 0x7fc75015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc756800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc75015e470 0x7fc75015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc756800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc75015e850 con 0x7fc7500afab0 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc756800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7500b6df0 con 0x7fc75006e910 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc756800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc75006f130 con 0x7fc75015e470 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7500afab0 0x7fc75015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7500afab0 0x7fc75015acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39122/0 (socket says 172.21.15.144:39122) 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74ea00640 1 -- 172.21.15.144:0/4204451431 learned_addr learned my addr 172.21.15.144:0/4204451431 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:00.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74f400640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75006e910 0x7fc750166220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74fe00640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc75015e470 0x7fc75015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74ea00640 1 -- 172.21.15.144:0/4204451431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc75015e470 msgr2=0x7fc75015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74ea00640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc75015e470 0x7fc75015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74ea00640 1 -- 172.21.15.144:0/4204451431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75006e910 msgr2=0x7fc750166220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74ea00640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75006e910 0x7fc750166220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74ea00640 1 -- 172.21.15.144:0/4204451431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75015b8d0 con 0x7fc7500afab0 2024-09-12T12:18:00.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc74ea00640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7500afab0 0x7fc75015acf0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00e870 tx=0x7fc73c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc747400640 1 -- 172.21.15.144:0/4204451431 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c017070 con 0x7fc7500afab0 2024-09-12T12:18:00.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc747400640 1 -- 172.21.15.144:0/4204451431 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73c00c940 con 0x7fc7500afab0 2024-09-12T12:18:00.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc747400640 1 -- 172.21.15.144:0/4204451431 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00cd10 con 0x7fc7500afab0 2024-09-12T12:18:00.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75015bbb0 con 0x7fc7500afab0 2024-09-12T12:18:00.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75015fea0 con 0x7fc7500afab0 2024-09-12T12:18:00.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7500717f0 con 0x7fc7500afab0 2024-09-12T12:18:00.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.610+0000 7fc747400640 1 -- 172.21.15.144:0/4204451431 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc73c01a070 con 0x7fc7500afab0 2024-09-12T12:18:00.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.614+0000 7fc747400640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7300678c0 0x7fc730069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:00.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.614+0000 7fc747400640 1 -- 172.21.15.144:0/4204451431 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fc73c086160 con 0x7fc7500afab0 2024-09-12T12:18:00.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.614+0000 7fc74f400640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7300678c0 0x7fc730069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:00.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.614+0000 7fc74f400640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7300678c0 0x7fc730069d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc7400af000 tx=0x7fc7400a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:00.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.618+0000 7fc747400640 1 -- 172.21.15.144:0/4204451431 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc73c056320 con 0x7fc7500afab0 2024-09-12T12:18:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.806+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc750067b00 con 0x7fc7500afab0 2024-09-12T12:18:00.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc747400640 1 -- 172.21.15.144:0/4204451431 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+1912 (secure 0 0 0) 0x7fc73c05a620 con 0x7fc7500afab0 2024-09-12T12:18:00.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:00.811 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":75,"btime":"2024-09-12T12:18:00:380465+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:00.380241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T12:18:00.812 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 75 2024-09-12T12:18:00.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7300678c0 msgr2=0x7fc730069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7300678c0 0x7fc730069d80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc7400af000 tx=0x7fc7400a7000 comp rx=0 tx=0).stop 2024-09-12T12:18:00.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7500afab0 msgr2=0x7fc75015acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:00.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7500afab0 0x7fc75015acf0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00e870 tx=0x7fc73c00ec70 comp rx=0 tx=0).stop 2024-09-12T12:18:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 shutdown_connections 2024-09-12T12:18:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7300678c0 0x7fc730069d80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc75015e470 0x7fc75015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7500afab0 0x7fc75015acf0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 --2- 172.21.15.144:0/4204451431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75006e910 0x7fc750166220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 >> 172.21.15.144:0/4204451431 conn(0x7fc75006ddf0 msgr2=0x7fc75015d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 shutdown_connections 2024-09-12T12:18:00.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:00.810+0000 7fc756800640 1 -- 172.21.15.144:0/4204451431 wait complete. 2024-09-12T12:18:01.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:17:50.543209+0000', 'modified': '2024-09-12T12:18:00.380241+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T12:18:01.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-12T12:18:02.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:02.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee44c00640 1 Processor -- start 2024-09-12T12:18:02.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee44c00640 1 -- start start 2024-09-12T12:18:02.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee44c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee4006eec0 0x7fee4006f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:02.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee44c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee4006ecd0 con 0x7fee400b4060 2024-09-12T12:18:02.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee44c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee4006e710 con 0x7fee4015c540 2024-09-12T12:18:02.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee44c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fee400b3bd0 con 0x7fee4006eec0 2024-09-12T12:18:02.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fee400b4060 0x7fee400b4510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52246/0 (socket says 172.21.15.144:52246) 2024-09-12T12:18:02.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3e800640 1 -- 172.21.15.144:0/1287667888 learned_addr learned my addr 172.21.15.144:0/1287667888 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:02.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3d400640 1 --2- 172.21.15.144:0/1287667888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee4006eec0 0x7fee4006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:02.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3ca00640 1 -- 172.21.15.144:0/1287667888 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970343003 0 0) 0x7fee4006ecd0 con 0x7fee400b4060 2024-09-12T12:18:02.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3ca00640 1 -- 172.21.15.144:0/1287667888 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee24003530 con 0x7fee400b4060 2024-09-12T12:18:02.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3ca00640 1 -- 172.21.15.144:0/1287667888 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904380530 0 0) 0x7fee4006e710 con 0x7fee4015c540 2024-09-12T12:18:02.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3ca00640 1 -- 172.21.15.144:0/1287667888 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee4006ecd0 con 0x7fee4015c540 2024-09-12T12:18:02.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3d400640 1 -- 172.21.15.144:0/1287667888 >> v1:172.21.15.165:6789/0 conn(0x7fee4015c540 legacy=0x7fee4006dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:02.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3d400640 1 -- 172.21.15.144:0/1287667888 >> v1:172.21.15.144:6789/0 conn(0x7fee400b4060 legacy=0x7fee400b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:02.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.382+0000 7fee3d400640 1 -- 172.21.15.144:0/1287667888 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4006e9f0 con 0x7fee4006eec0 2024-09-12T12:18:02.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.386+0000 7fee3d400640 1 --2- 172.21.15.144:0/1287667888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee4006eec0 0x7fee4006f300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0097d0 tx=0x7fee2c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0ed172c7766f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:02.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.386+0000 7fee3ca00640 1 -- 172.21.15.144:0/1287667888 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0b0070 con 0x7fee4006eec0 2024-09-12T12:18:02.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.386+0000 7fee3ca00640 1 -- 172.21.15.144:0/1287667888 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee2c0ab600 con 0x7fee4006eec0 2024-09-12T12:18:02.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.386+0000 7fee3ca00640 1 -- 172.21.15.144:0/1287667888 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0ab9d0 con 0x7fee4006eec0 2024-09-12T12:18:02.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 -- 172.21.15.144:0/1287667888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee4006eec0 msgr2=0x7fee4006f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:02.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 --2- 172.21.15.144:0/1287667888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee4006eec0 0x7fee4006f300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0097d0 tx=0x7fee2c01c410 comp rx=0 tx=0).stop 2024-09-12T12:18:02.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 -- 172.21.15.144:0/1287667888 shutdown_connections 2024-09-12T12:18:02.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 --2- 172.21.15.144:0/1287667888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee4006eec0 0x7fee4006f300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:02.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 -- 172.21.15.144:0/1287667888 >> 172.21.15.144:0/1287667888 conn(0x7fee400b2450 msgr2=0x7fee400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:02.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 -- 172.21.15.144:0/1287667888 shutdown_connections 2024-09-12T12:18:02.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 -- 172.21.15.144:0/1287667888 wait complete. 2024-09-12T12:18:02.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 Processor -- start 2024-09-12T12:18:02.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 -- start start 2024-09-12T12:18:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee4006eec0 0x7fee4015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee400b4060 0x7fee40148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee4015c540 0x7fee4015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee4016a420 con 0x7fee4006eec0 2024-09-12T12:18:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fee4016a2a0 con 0x7fee4015c540 2024-09-12T12:18:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.390+0000 7fee44c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fee4016a5a0 con 0x7fee400b4060 2024-09-12T12:18:02.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee4006eec0 0x7fee4015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:02.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee4006eec0 0x7fee4015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39130/0 (socket says 172.21.15.144:39130) 2024-09-12T12:18:02.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3de00640 1 -- 172.21.15.144:0/424169050 learned_addr learned my addr 172.21.15.144:0/424169050 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:02.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3e800640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee4015c540 0x7fee4015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:02.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3d400640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee400b4060 0x7fee40148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:02.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3de00640 1 -- 172.21.15.144:0/424169050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee400b4060 msgr2=0x7fee40148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:02.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3de00640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee400b4060 0x7fee40148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:02.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3de00640 1 -- 172.21.15.144:0/424169050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee4015c540 msgr2=0x7fee4015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:02.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3de00640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee4015c540 0x7fee4015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:02.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3de00640 1 -- 172.21.15.144:0/424169050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee40151d90 con 0x7fee4006eec0 2024-09-12T12:18:02.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee3de00640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee4006eec0 0x7fee4015c9b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fee3000c430 tx=0x7fee3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:02.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee36000640 1 -- 172.21.15.144:0/424169050 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30017070 con 0x7fee4006eec0 2024-09-12T12:18:02.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee36000640 1 -- 172.21.15.144:0/424169050 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee300052f0 con 0x7fee4006eec0 2024-09-12T12:18:02.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee36000640 1 -- 172.21.15.144:0/424169050 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30003840 con 0x7fee4006eec0 2024-09-12T12:18:02.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee40152070 con 0x7fee4006eec0 2024-09-12T12:18:02.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee401491c0 con 0x7fee4006eec0 2024-09-12T12:18:02.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee40152590 con 0x7fee4006eec0 2024-09-12T12:18:02.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee36000640 1 -- 172.21.15.144:0/424169050 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee3001a070 con 0x7fee4006eec0 2024-09-12T12:18:02.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.394+0000 7fee36000640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee200678c0 0x7fee20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:02.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.398+0000 7fee36000640 1 -- 172.21.15.144:0/424169050 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fee30085200 con 0x7fee4006eec0 2024-09-12T12:18:02.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.398+0000 7fee3d400640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee200678c0 0x7fee20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:02.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.398+0000 7fee3d400640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee200678c0 0x7fee20069d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0ad000 tx=0x7fee2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:02.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.402+0000 7fee36000640 1 -- 172.21.15.144:0/424169050 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fee30055450 con 0x7fee4006eec0 2024-09-12T12:18:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.590+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee4006e710 con 0x7fee4006eec0 2024-09-12T12:18:02.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.590+0000 7fee36000640 1 -- 172.21.15.144:0/424169050 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5235 (secure 0 0 0) 0x7fee30059750 con 0x7fee4006eec0 2024-09-12T12:18:02.594 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:02.595 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":78,"btime":"2024-09-12T12:18:02:389861+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:01.400255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T12:18:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 78 2024-09-12T12:18:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee200678c0 msgr2=0x7fee20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee200678c0 0x7fee20069d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0ad000 tx=0x7fee2c008040 comp rx=0 tx=0).stop 2024-09-12T12:18:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee4006eec0 msgr2=0x7fee4015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee4006eec0 0x7fee4015c9b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fee3000c430 tx=0x7fee3000c8f0 comp rx=0 tx=0).stop 2024-09-12T12:18:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 shutdown_connections 2024-09-12T12:18:02.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fee200678c0 0x7fee20069d80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee4015c540 0x7fee4015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee400b4060 0x7fee40148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 --2- 172.21.15.144:0/424169050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee4006eec0 0x7fee4015c9b0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 >> 172.21.15.144:0/424169050 conn(0x7fee400b2450 msgr2=0x7fee400d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 shutdown_connections 2024-09-12T12:18:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:02.594+0000 7fee44c00640 1 -- 172.21.15.144:0/424169050 wait complete. 2024-09-12T12:18:03.019 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:17:50.543209+0000', 'modified': '2024-09-12T12:18:01.400255+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7347}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7347': {'gid': 7347, 'name': 'a', 'rank': 0, 'incarnation': 77, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.144:6835/1676869896', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 1676869896}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1676869896}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T12:18:03.019 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7347:up:reconnect 2024-09-12T12:18:04.019 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:04.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.161+0000 7fc27d800640 1 Processor -- start 2024-09-12T12:18:04.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.161+0000 7fc27d800640 1 -- start start 2024-09-12T12:18:04.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc27d800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc27815b4e0 0x7fc2780b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:04.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc27d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2780ccf30 0x7fc2780cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:04.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc27d800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2780b45a0 con 0x7fc2780b3ad0 2024-09-12T12:18:04.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc27d800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc2780cd8e0 con 0x7fc27815b4e0 2024-09-12T12:18:04.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc27d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc2780b3fe0 con 0x7fc2780ccf30 2024-09-12T12:18:04.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc2780b3ad0 0x7fc278071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52254/0 (socket says 172.21.15.144:52254) 2024-09-12T12:18:04.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276000640 1 -- 172.21.15.144:0/3603184314 learned_addr learned my addr 172.21.15.144:0/3603184314 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276a00640 1 --2- 172.21.15.144:0/3603184314 >> v2:172.21.15.165:3300/0 conn(0x7fc27815b4e0 0x7fc2780b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc277400640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2780ccf30 0x7fc2780cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606681470 0 0) 0x7fc2780b45a0 con 0x7fc2780b3ad0 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc25c003530 con 0x7fc2780b3ad0 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2258068957 0 0) 0x7fc25c003530 con 0x7fc2780b3ad0 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2780ccf30 msgr2=0x7fc2780cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2780ccf30 0x7fc2780cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 >> v2:172.21.15.165:3300/0 conn(0x7fc27815b4e0 msgr2=0x7fc2780b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 --2- 172.21.15.144:0/3603184314 >> v2:172.21.15.165:3300/0 conn(0x7fc27815b4e0 0x7fc2780b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2780b42c0 con 0x7fc2780b3ad0 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fc264001680 con 0x7fc2780b3ad0 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 >> v1:172.21.15.144:6789/0 conn(0x7fc2780b3ad0 legacy=0x7fc278071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c0039c0 0x7fc25c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:04.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc25c004810 0x7fc25c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2780ccf30 0x7fc25c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc2780cd8e0 con 0x7fc25c004810 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc2780b3fe0 con 0x7fc25c0039c0 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc25c00b9d0 con 0x7fc2780ccf30 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276000640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc25c004810 0x7fc25c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc277400640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2780ccf30 0x7fc25c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276a00640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c0039c0 0x7fc25c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276000640 1 -- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2780ccf30 msgr2=0x7fc25c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276000640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2780ccf30 0x7fc25c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276000640 1 -- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c0039c0 msgr2=0x7fc25c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276000640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c0039c0 0x7fc25c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.165+0000 7fc276000640 1 -- 172.21.15.144:0/3603184314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c003530 con 0x7fc25c004810 2024-09-12T12:18:04.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc276000640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc25c004810 0x7fc25c004c90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fc26400c210 tx=0x7fc26401f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716d21cea1da2dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:04.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264007d60 con 0x7fc25c004810 2024-09-12T12:18:04.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc264005ae0 con 0x7fc25c004810 2024-09-12T12:18:04.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc275600640 1 -- 172.21.15.144:0/3603184314 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264007070 con 0x7fc25c004810 2024-09-12T12:18:04.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc27d800640 1 -- 172.21.15.144:0/3603184314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc25c004810 msgr2=0x7fc25c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:04.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc27d800640 1 --2- 172.21.15.144:0/3603184314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc25c004810 0x7fc25c004c90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fc26400c210 tx=0x7fc26401f3f0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc277400640 1 -- 172.21.15.144:0/3603184314 reap_dead start 2024-09-12T12:18:04.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc27d800640 1 -- 172.21.15.144:0/3603184314 shutdown_connections 2024-09-12T12:18:04.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc27d800640 1 -- 172.21.15.144:0/3603184314 >> 172.21.15.144:0/3603184314 conn(0x7fc27806d0d0 msgr2=0x7fc27806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:04.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc27d800640 1 -- 172.21.15.144:0/3603184314 shutdown_connections 2024-09-12T12:18:04.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.169+0000 7fc27d800640 1 -- 172.21.15.144:0/3603184314 wait complete. 2024-09-12T12:18:04.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 Processor -- start 2024-09-12T12:18:04.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 -- start start 2024-09-12T12:18:04.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c004810 0x7fc278147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:04.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc278148610 0x7fc278144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:04.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc27814ace0 0x7fc278152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:04.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc278071b30 con 0x7fc278148610 2024-09-12T12:18:04.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc2780b1770 con 0x7fc25c004810 2024-09-12T12:18:04.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc2780cdef0 con 0x7fc27814ace0 2024-09-12T12:18:04.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc278148610 0x7fc278144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:04.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc278148610 0x7fc278144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39148/0 (socket says 172.21.15.144:39148) 2024-09-12T12:18:04.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276000640 1 -- 172.21.15.144:0/2665550782 learned_addr learned my addr 172.21.15.144:0/2665550782 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:04.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276a00640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c004810 0x7fc278147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:04.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc277400640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc27814ace0 0x7fc278152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:04.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276000640 1 -- 172.21.15.144:0/2665550782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc27814ace0 msgr2=0x7fc278152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276000640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc27814ace0 0x7fc278152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276000640 1 -- 172.21.15.144:0/2665550782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c004810 msgr2=0x7fc278147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276000640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c004810 0x7fc278147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276000640 1 -- 172.21.15.144:0/2665550782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc278148100 con 0x7fc278148610 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc276000640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc278148610 0x7fc278144810 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fc264025f60 tx=0x7fc25c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc26ea00640 1 -- 172.21.15.144:0/2665550782 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264005c90 con 0x7fc278148610 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc26ea00640 1 -- 172.21.15.144:0/2665550782 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc264005e30 con 0x7fc278148610 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc26ea00640 1 -- 172.21.15.144:0/2665550782 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2640049f0 con 0x7fc278148610 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc278148ae0 con 0x7fc278148610 2024-09-12T12:18:04.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2781455a0 con 0x7fc278148610 2024-09-12T12:18:04.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.173+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27815b8c0 con 0x7fc278148610 2024-09-12T12:18:04.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.177+0000 7fc26ea00640 1 -- 172.21.15.144:0/2665550782 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc264004b90 con 0x7fc278148610 2024-09-12T12:18:04.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.177+0000 7fc26ea00640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2580678f0 0x7fc258069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:04.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.177+0000 7fc26ea00640 1 -- 172.21.15.144:0/2665550782 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fc264122c90 con 0x7fc278148610 2024-09-12T12:18:04.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.177+0000 7fc276a00640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2580678f0 0x7fc258069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:04.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.177+0000 7fc276a00640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2580678f0 0x7fc258069db0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc268009fd0 tx=0x7fc26800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:04.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.181+0000 7fc26ea00640 1 -- 172.21.15.144:0/2665550782 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc2640c3030 con 0x7fc278148610 2024-09-12T12:18:04.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.369+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2780ccb20 con 0x7fc278148610 2024-09-12T12:18:04.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc26ea00640 1 -- 172.21.15.144:0/2665550782 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5232 (secure 0 0 0) 0x7fc278148100 con 0x7fc278148610 2024-09-12T12:18:04.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:04.375 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":79,"btime":"2024-09-12T12:18:03:394787+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:02.395996+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-12T12:18:04.375 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 79 2024-09-12T12:18:04.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2580678f0 msgr2=0x7fc258069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:04.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2580678f0 0x7fc258069db0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc268009fd0 tx=0x7fc26800b040 comp rx=0 tx=0).stop 2024-09-12T12:18:04.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc278148610 msgr2=0x7fc278144810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:04.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc278148610 0x7fc278144810 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fc264025f60 tx=0x7fc25c005840 comp rx=0 tx=0).stop 2024-09-12T12:18:04.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 shutdown_connections 2024-09-12T12:18:04.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc2580678f0 0x7fc258069db0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc27814ace0 0x7fc278152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc278148610 0x7fc278144810 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 --2- 172.21.15.144:0/2665550782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc25c004810 0x7fc278147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:04.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 >> 172.21.15.144:0/2665550782 conn(0x7fc27806d0d0 msgr2=0x7fc2780b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:04.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 shutdown_connections 2024-09-12T12:18:04.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:04.373+0000 7fc27d800640 1 -- 172.21.15.144:0/2665550782 wait complete. 2024-09-12T12:18:04.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:17:50.543209+0000', 'modified': '2024-09-12T12:18:02.395996+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7347}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7347': {'gid': 7347, 'name': 'a', 'rank': 0, 'incarnation': 77, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.144:6835/1676869896', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 1676869896}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1676869896}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T12:18:04.800 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7347:up:rejoin 2024-09-12T12:18:05.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:05.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5cf1800640 1 Processor -- start 2024-09-12T12:18:05.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5cf1800640 1 -- start start 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5cf1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5cec15c2f0 0x7f5cec0b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5cf1800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5cec15c6d0 0x7f5cec0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5cf1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec0ce730 0x7f5cec0cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5cf1800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5cec0cf120 con 0x7f5cec15c2f0 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5cf1800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5cec15cbb0 con 0x7f5cec15c6d0 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5cf1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5cec15ce90 con 0x7f5cec0ce730 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceaa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5cec15c2f0 0x7f5cec0b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceaa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5cec15c2f0 0x7f5cec0b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39160/0 (socket says 172.21.15.144:39160) 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceaa00640 1 -- 172.21.15.144:0/4085503872 learned_addr learned my addr 172.21.15.144:0/4085503872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5cea000640 1 --2- 172.21.15.144:0/4085503872 >> v2:172.21.15.165:3300/0 conn(0x7f5cec15c6d0 0x7f5cec0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:05.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceb400640 1 --2- 172.21.15.144:0/4085503872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec0ce730 0x7f5cec0cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:05.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceaa00640 1 -- 172.21.15.144:0/4085503872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec0ce730 msgr2=0x7f5cec0cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:05.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceaa00640 1 --2- 172.21.15.144:0/4085503872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec0ce730 0x7f5cec0cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:05.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceaa00640 1 -- 172.21.15.144:0/4085503872 >> v2:172.21.15.165:3300/0 conn(0x7f5cec15c6d0 msgr2=0x7f5cec0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:05.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceaa00640 1 --2- 172.21.15.144:0/4085503872 >> v2:172.21.15.165:3300/0 conn(0x7f5cec15c6d0 0x7f5cec0b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:05.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceaa00640 1 -- 172.21.15.144:0/4085503872 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec15d170 con 0x7f5cec15c2f0 2024-09-12T12:18:05.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.949+0000 7f5ceb400640 1 --2- 172.21.15.144:0/4085503872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec0ce730 0x7f5cec0cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:05.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5ceaa00640 1 --2- 172.21.15.144:0/4085503872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 0x7f5cec0b3500 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0ce2f0 tx=0x7f5cdc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8270fdd90691bd12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:05.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5ce9600640 1 -- 172.21.15.144:0/4085503872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0a5890 con 0x7f5cec15c2f0 2024-09-12T12:18:05.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5ce9600640 1 -- 172.21.15.144:0/4085503872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc0a5a30 con 0x7f5cec15c2f0 2024-09-12T12:18:05.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5ce9600640 1 -- 172.21.15.144:0/4085503872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0a5e00 con 0x7f5cec15c2f0 2024-09-12T12:18:05.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5cf1800640 1 -- 172.21.15.144:0/4085503872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 msgr2=0x7f5cec0b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:05.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5cf1800640 1 --2- 172.21.15.144:0/4085503872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 0x7f5cec0b3500 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0ce2f0 tx=0x7f5cdc01c9f0 comp rx=0 tx=0).stop 2024-09-12T12:18:05.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5cf1800640 1 -- 172.21.15.144:0/4085503872 shutdown_connections 2024-09-12T12:18:05.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5cf1800640 1 --2- 172.21.15.144:0/4085503872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec0ce730 0x7f5cec0cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:05.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5cf1800640 1 --2- 172.21.15.144:0/4085503872 >> v2:172.21.15.165:3300/0 conn(0x7f5cec15c6d0 0x7f5cec0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:05.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5cf1800640 1 --2- 172.21.15.144:0/4085503872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 0x7f5cec0b3500 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:05.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5cf1800640 1 -- 172.21.15.144:0/4085503872 >> 172.21.15.144:0/4085503872 conn(0x7f5cec06f8b0 msgr2=0x7f5cec06fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:05.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5cf1800640 1 -- 172.21.15.144:0/4085503872 shutdown_connections 2024-09-12T12:18:05.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.953+0000 7f5cf1800640 1 -- 172.21.15.144:0/4085503872 wait complete. 2024-09-12T12:18:05.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 Processor -- start 2024-09-12T12:18:05.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 -- start start 2024-09-12T12:18:05.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cec0ce730 0x7f5cec155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 0x7f5cec14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec15c6d0 0x7f5cec150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec06c7f0 con 0x7f5cec15c2f0 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec06c670 con 0x7f5cec0ce730 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5cec06c970 con 0x7f5cec15c6d0 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cea000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 0x7f5cec14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cea000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 0x7f5cec14fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39174/0 (socket says 172.21.15.144:39174) 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cea000640 1 -- 172.21.15.144:0/3240970517 learned_addr learned my addr 172.21.15.144:0/3240970517 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5ceaa00640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cec0ce730 0x7f5cec155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5ceb400640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec15c6d0 0x7f5cec150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cea000640 1 -- 172.21.15.144:0/3240970517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec15c6d0 msgr2=0x7f5cec150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:05.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cea000640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec15c6d0 0x7f5cec150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cea000640 1 -- 172.21.15.144:0/3240970517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cec0ce730 msgr2=0x7f5cec155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cea000640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cec0ce730 0x7f5cec155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cea000640 1 -- 172.21.15.144:0/3240970517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec0b6390 con 0x7f5cec15c2f0 2024-09-12T12:18:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5ceb400640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec15c6d0 0x7f5cec150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cea000640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 0x7f5cec14fe30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800e960 tx=0x7f5cd800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5ce2a00640 1 -- 172.21.15.144:0/3240970517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8017070 con 0x7f5cec15c2f0 2024-09-12T12:18:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5ce2a00640 1 -- 172.21.15.144:0/3240970517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd800c9a0 con 0x7f5cec15c2f0 2024-09-12T12:18:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec155030 con 0x7f5cec15c2f0 2024-09-12T12:18:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5ce2a00640 1 -- 172.21.15.144:0/3240970517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800cd50 con 0x7f5cec15c2f0 2024-09-12T12:18:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.957+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec0aed30 con 0x7f5cec15c2f0 2024-09-12T12:18:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.961+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cec0cebe0 con 0x7f5cec15c2f0 2024-09-12T12:18:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.961+0000 7f5ce2a00640 1 -- 172.21.15.144:0/3240970517 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5cd801a070 con 0x7f5cec15c2f0 2024-09-12T12:18:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.961+0000 7f5ce2a00640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ccc0678c0 0x7f5ccc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.961+0000 7f5ce2a00640 1 -- 172.21.15.144:0/3240970517 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f5cd8085de0 con 0x7f5cec15c2f0 2024-09-12T12:18:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.961+0000 7f5ceaa00640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ccc0678c0 0x7f5ccc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.961+0000 7f5ceaa00640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ccc0678c0 0x7f5ccc069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0ae000 tx=0x7f5cdc0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:05.965+0000 7f5ce2a00640 1 -- 172.21.15.144:0/3240970517 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5cd8056030 con 0x7f5cec15c2f0 2024-09-12T12:18:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.153+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cec15fc30 con 0x7f5cec15c2f0 2024-09-12T12:18:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.153+0000 7f5ce2a00640 1 -- 172.21.15.144:0/3240970517 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5239 (secure 0 0 0) 0x7f5cd805a330 con 0x7f5cec15c2f0 2024-09-12T12:18:06.154 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:06.155 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":80,"btime":"2024-09-12T12:18:04:401229+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:04.401224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7347,"qdb_cluster":[7347]},"id":6}]} 2024-09-12T12:18:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 80 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ccc0678c0 msgr2=0x7f5ccc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ccc0678c0 0x7f5ccc069d80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0ae000 tx=0x7f5cdc0a7070 comp rx=0 tx=0).stop 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 msgr2=0x7f5cec14fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 0x7f5cec14fe30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800e960 tx=0x7f5cd800ee20 comp rx=0 tx=0).stop 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 shutdown_connections 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ccc0678c0 0x7f5ccc069d80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cec15c6d0 0x7f5cec150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cec15c2f0 0x7f5cec14fe30 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 --2- 172.21.15.144:0/3240970517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cec0ce730 0x7f5cec155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 >> 172.21.15.144:0/3240970517 conn(0x7f5cec06f8b0 msgr2=0x7f5cec0b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 shutdown_connections 2024-09-12T12:18:06.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.157+0000 7f5cf1800640 1 -- 172.21.15.144:0/3240970517 wait complete. 2024-09-12T12:18:06.578 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:17:50.543209+0000', 'modified': '2024-09-12T12:18:04.401224+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 102, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7347}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7347': {'gid': 7347, 'name': 'a', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.144:6835/1676869896', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 1676869896}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1676869896}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7347, 'qdb_cluster': [7347]} 2024-09-12T12:18:06.578 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:18:06.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T12:18:06.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.717+0000 7ff8c1200640 1 Processor -- start 2024-09-12T12:18:06.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.717+0000 7ff8c1200640 1 -- start start 2024-09-12T12:18:06.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8c1200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff8bc1618f0 0x7ff8bc0b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8c1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc070dd0 0x7ff8bc071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8c1200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8bc0b5610 con 0x7ff8bc073910 2024-09-12T12:18:06.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8c1200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff8bc070660 con 0x7ff8bc1618f0 2024-09-12T12:18:06.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8c1200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc0b70b0 con 0x7ff8bc070dd0 2024-09-12T12:18:06.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8bbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc070dd0 0x7ff8bc071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8baa00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7ff8bc073910 0x7ff8bc06cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:60484/0 (socket says 172.21.15.144:60484) 2024-09-12T12:18:06.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8baa00640 1 -- 172.21.15.144:0/715407565 learned_addr learned my addr 172.21.15.144:0/715407565 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8bb400640 1 --2- 172.21.15.144:0/715407565 >> v2:172.21.15.165:3300/0 conn(0x7ff8bc1618f0 0x7ff8bc0b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8ba000640 1 -- 172.21.15.144:0/715407565 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658244836 0 0) 0x7ff8bc0b5610 con 0x7ff8bc073910 2024-09-12T12:18:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8ba000640 1 -- 172.21.15.144:0/715407565 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8a0003530 con 0x7ff8bc073910 2024-09-12T12:18:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8bb400640 1 -- 172.21.15.144:0/715407565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc070dd0 msgr2=0x7ff8bc071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8bb400640 1 --2- 172.21.15.144:0/715407565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc070dd0 0x7ff8bc071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8bb400640 1 -- 172.21.15.144:0/715407565 >> v1:172.21.15.165:6789/0 conn(0x7ff8bc073910 legacy=0x7ff8bc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8bb400640 1 -- 172.21.15.144:0/715407565 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc0b7390 con 0x7ff8bc1618f0 2024-09-12T12:18:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.721+0000 7ff8bbe00640 1 --2- 172.21.15.144:0/715407565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc070dd0 0x7ff8bc071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8bb400640 1 --2- 172.21.15.144:0/715407565 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc1618f0 0x7ff8bc0b6a60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009d90 tx=0x7ff8ac01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3abb7ac0ea38554 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8ba000640 1 -- 172.21.15.144:0/715407565 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0b2070 con 0x7ff8bc1618f0 2024-09-12T12:18:06.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8ba000640 1 -- 172.21.15.144:0/715407565 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0a5920 con 0x7ff8bc1618f0 2024-09-12T12:18:06.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8ba000640 1 -- 172.21.15.144:0/715407565 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0a5cf0 con 0x7ff8bc1618f0 2024-09-12T12:18:06.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 -- 172.21.15.144:0/715407565 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc1618f0 msgr2=0x7ff8bc0b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 --2- 172.21.15.144:0/715407565 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc1618f0 0x7ff8bc0b6a60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009d90 tx=0x7ff8ac01c970 comp rx=0 tx=0).stop 2024-09-12T12:18:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 -- 172.21.15.144:0/715407565 shutdown_connections 2024-09-12T12:18:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 --2- 172.21.15.144:0/715407565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc070dd0 0x7ff8bc071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 --2- 172.21.15.144:0/715407565 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc1618f0 0x7ff8bc0b6a60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 -- 172.21.15.144:0/715407565 >> 172.21.15.144:0/715407565 conn(0x7ff8bc0d22e0 msgr2=0x7ff8bc0d26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 -- 172.21.15.144:0/715407565 shutdown_connections 2024-09-12T12:18:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 -- 172.21.15.144:0/715407565 wait complete. 2024-09-12T12:18:06.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 Processor -- start 2024-09-12T12:18:06.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 -- start start 2024-09-12T12:18:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc070dd0 0x7ff8bc14a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc073910 0x7ff8bc06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc1618f0 0x7ff8bc06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc073ea0 con 0x7ff8bc070dd0 2024-09-12T12:18:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc073d20 con 0x7ff8bc1618f0 2024-09-12T12:18:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.725+0000 7ff8c1200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc161cd0 con 0x7ff8bc073910 2024-09-12T12:18:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc070dd0 0x7ff8bc14a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc070dd0 0x7ff8bc14a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39182/0 (socket says 172.21.15.144:39182) 2024-09-12T12:18:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bb400640 1 -- 172.21.15.144:0/2306643681 learned_addr learned my addr 172.21.15.144:0/2306643681 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8baa00640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc073910 0x7ff8bc06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bbe00640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc1618f0 0x7ff8bc06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bb400640 1 -- 172.21.15.144:0/2306643681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc073910 msgr2=0x7ff8bc06dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bb400640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc073910 0x7ff8bc06dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bb400640 1 -- 172.21.15.144:0/2306643681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc1618f0 msgr2=0x7ff8bc06e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bb400640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc1618f0 0x7ff8bc06e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bb400640 1 -- 172.21.15.144:0/2306643681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc0b1780 con 0x7ff8bc070dd0 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8bb400640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc070dd0 0x7ff8bc14a910 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009d90 tx=0x7ff8ac019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8b3400640 1 -- 172.21.15.144:0/2306643681 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0bd020 con 0x7ff8bc070dd0 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8b3400640 1 -- 172.21.15.144:0/2306643681 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0b8670 con 0x7ff8bc070dd0 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8b3400640 1 -- 172.21.15.144:0/2306643681 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0b2040 con 0x7ff8bc070dd0 2024-09-12T12:18:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8c1200640 1 -- 172.21.15.144:0/2306643681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8bc0b0ee0 con 0x7ff8bc070dd0 2024-09-12T12:18:06.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.729+0000 7ff8c1200640 1 -- 172.21.15.144:0/2306643681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8bc0b14a0 con 0x7ff8bc070dd0 2024-09-12T12:18:06.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8b3400640 1 -- 172.21.15.144:0/2306643681 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8ac0c0020 con 0x7ff8bc070dd0 2024-09-12T12:18:06.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8b3400640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff89c0678c0 0x7ff89c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8b3400640 1 -- 172.21.15.144:0/2306643681 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7ff8ac120d40 con 0x7ff8bc070dd0 2024-09-12T12:18:06.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8baa00640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff89c0678c0 0x7ff89c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8c5b06000 1 Processor -- start 2024-09-12T12:18:06.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8c5b06000 1 -- start start 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8baa00640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff89c0678c0 0x7ff89c069d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8007fd0 tx=0x7ff8a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759cb20 0x5597e759cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 0x5597e7552d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e7553290 0x5597e7553670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5597e743ab60 con 0x5597e759cb20 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5597e73a1c70 con 0x5597e759d440 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5597e7347ed0 con 0x5597e7553290 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759cb20 0x5597e759cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759cb20 0x5597e759cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39190/0 (socket says 172.21.15.144:39190) 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bb400640 1 -- 172.21.15.144:0/2136147054 learned_addr learned my addr 172.21.15.144:0/2136147054 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8baa00640 1 --2- 172.21.15.144:0/2136147054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 0x5597e7552d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bbe00640 1 --2- 172.21.15.144:0/2136147054 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e7553290 0x5597e7553670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bb400640 1 -- 172.21.15.144:0/2136147054 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e7553290 msgr2=0x5597e7553670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bb400640 1 --2- 172.21.15.144:0/2136147054 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e7553290 0x5597e7553670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bb400640 1 -- 172.21.15.144:0/2136147054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 msgr2=0x5597e7552d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bb400640 1 --2- 172.21.15.144:0/2136147054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 0x5597e7552d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bb400640 1 -- 172.21.15.144:0/2136147054 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e7359e50 con 0x5597e759cb20 2024-09-12T12:18:06.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8bb400640 1 --2- 172.21.15.144:0/2136147054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759cb20 0x5597e759cf00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0f95b0 tx=0x7ff8ac0f0e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7717e0e9a768be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8a7e00640 1 -- 172.21.15.144:0/2136147054 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0f52b0 con 0x5597e759cb20 2024-09-12T12:18:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8a7e00640 1 -- 172.21.15.144:0/2136147054 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0f9ae0 con 0x5597e759cb20 2024-09-12T12:18:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.733+0000 7ff8a7e00640 1 -- 172.21.15.144:0/2136147054 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0a57a0 con 0x5597e759cb20 2024-09-12T12:18:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- 172.21.15.144:0/2136147054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759cb20 msgr2=0x5597e759cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/2136147054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759cb20 0x5597e759cf00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0f95b0 tx=0x7ff8ac0f0e00 comp rx=0 tx=0).stop 2024-09-12T12:18:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- 172.21.15.144:0/2136147054 shutdown_connections 2024-09-12T12:18:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/2136147054 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e7553290 0x5597e7553670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/2136147054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 0x5597e7552d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/2136147054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759cb20 0x5597e759cf00 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- 172.21.15.144:0/2136147054 >> 172.21.15.144:0/2136147054 conn(0x5597e7559600 msgr2=0x5597e7551630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- 172.21.15.144:0/2136147054 shutdown_connections 2024-09-12T12:18:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- 172.21.15.144:0/2136147054 wait complete. 2024-09-12T12:18:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- start start 2024-09-12T12:18:06.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 Processor -- start 2024-09-12T12:18:06.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 0x5597e7557e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 0x5597e755dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e755e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5597e7403b00 con 0x5597e7558390 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5597e737c360 con 0x5597e759d440 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5597e73792d0 con 0x5597e759cb20 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 10 client.0 _ll_register_callbacks cb 0x5597e753e820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e755e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e755e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39196/0 (socket says 172.21.15.144:39196) 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bbe00640 1 -- 172.21.15.144:0/987862051 learned_addr learned my addr 172.21.15.144:0/987862051 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bb400640 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 0x5597e7557e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8baa00640 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 0x5597e755dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bbe00640 1 -- 172.21.15.144:0/987862051 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 msgr2=0x5597e7557e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bbe00640 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 0x5597e7557e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bbe00640 1 -- 172.21.15.144:0/987862051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 msgr2=0x5597e755dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bbe00640 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 0x5597e755dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bbe00640 1 -- 172.21.15.144:0/987862051 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e7348120 con 0x5597e7558390 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8bbe00640 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e755e230 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40149a0 tx=0x7ff8b4014da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d608f47bf3b58be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8a4c00640 1 -- 172.21.15.144:0/987862051 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4004240 con 0x5597e7558390 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- 172.21.15.144:0/987862051 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ac0f9ae0 con 0x5597e7558390 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8a4c00640 1 -- 172.21.15.144:0/987862051 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7ff8b40043e0 con 0x5597e7558390 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8a4c00640 1 -- 172.21.15.144:0/987862051 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff8b40059a0 con 0x5597e7558390 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 10 client.7389 fetch_fsmap learned FSMap version 80 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- 172.21.15.144:0/987862051 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x5597e7341450 con 0x5597e7558390 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8a4c00640 1 -- 172.21.15.144:0/987862051 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0f9ae0 con 0x5597e7558390 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8a4c00640 1 -- 172.21.15.144:0/987862051 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7ff8b4005b40 con 0x5597e7558390 2024-09-12T12:18:06.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 10 client.7389 fetch_fsmap finished waiting for FSMap version 80 2024-09-12T12:18:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 10 client.7389 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:18:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 20 client.7389 populate_metadata read hostname 'smithi144' 2024-09-12T12:18:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x5597e75ab280 0x5597e75ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 4 client.7389 mds_command: new command op to 7347 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:18:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.737+0000 7ff8c5b06000 1 -- 172.21.15.144:0/987862051 --> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597e733bc00 con 0x5597e75ab280 2024-09-12T12:18:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8bb400640 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x5597e75ab280 0x5597e75ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8bb400640 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x5597e75ab280 0x5597e75ad670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c27fb8739468135 server_cookie=5273994e7cded75d in_seq=0 out_seq=0 2024-09-12T12:18:06.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8a4c00640 10 client.7389 ms_handle_connect on v2:172.21.15.144:6834/1676869896 2024-09-12T12:18:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8a4c00640 1 -- 172.21.15.144:0/987862051 <== mds.0 v2:172.21.15.144:6834/1676869896 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597e733bc00 con 0x5597e75ab280 2024-09-12T12:18:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8a4c00640 10 client.7389 handle_command_reply: tid=0 2024-09-12T12:18:06.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 client.7389 shutdown 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 -- 172.21.15.144:0/987862051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 msgr2=0x5597e755e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e755e230 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40149a0 tx=0x7ff8b4014da0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 -- 172.21.15.144:0/987862051 shutdown_connections 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x5597e75ab280 0x5597e75ad670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e755e230 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759d440 0x5597e755dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8a4c00640 0 client.7389 ms_handle_reset on v2:172.21.15.144:6834/1676869896 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/987862051 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 0x5597e7557e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 -- 172.21.15.144:0/987862051 >> 172.21.15.144:0/987862051 conn(0x5597e7553290 msgr2=0x5597e7551d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 -- 172.21.15.144:0/987862051 shutdown_connections 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 1 -- 172.21.15.144:0/987862051 wait complete. 2024-09-12T12:18:06.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.741+0000 7ff8c5b06000 20 client.7389 trim_cache size 0 max 16384 2024-09-12T12:18:06.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.757+0000 7ff8c5b06000 1 Processor -- start 2024-09-12T12:18:06.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- start start 2024-09-12T12:18:06.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e759bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759cb20 0x5597e759c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759d440 0x5597e75ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc2032e0 con 0x5597e7558390 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc14bc10 con 0x5597e759cb20 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc14c260 con 0x5597e759d440 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e759bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e759bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39198/0 (socket says 172.21.15.144:39198) 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bb400640 1 -- 172.21.15.144:0/3236756426 learned_addr learned my addr 172.21.15.144:0/3236756426 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8baa00640 1 --2- 172.21.15.144:0/3236756426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759cb20 0x5597e759c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bbe00640 1 --2- 172.21.15.144:0/3236756426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759d440 0x5597e75ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bb400640 1 -- 172.21.15.144:0/3236756426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759d440 msgr2=0x5597e75ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bb400640 1 --2- 172.21.15.144:0/3236756426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759d440 0x5597e75ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bb400640 1 -- 172.21.15.144:0/3236756426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759cb20 msgr2=0x5597e759c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bb400640 1 --2- 172.21.15.144:0/3236756426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759cb20 0x5597e759c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bb400640 1 -- 172.21.15.144:0/3236756426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e7328fd0 con 0x5597e7558390 2024-09-12T12:18:06.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8bb400640 1 --2- 172.21.15.144:0/3236756426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e759bcc0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac11f0c0 tx=0x7ff8ac0f4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9257242a64b49570 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8a7400640 1 -- 172.21.15.144:0/3236756426 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0f0cd0 con 0x5597e7558390 2024-09-12T12:18:06.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8a7400640 1 -- 172.21.15.144:0/3236756426 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0f9ae0 con 0x5597e7558390 2024-09-12T12:18:06.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8a7400640 1 -- 172.21.15.144:0/3236756426 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0ef200 con 0x5597e7558390 2024-09-12T12:18:06.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- 172.21.15.144:0/3236756426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 msgr2=0x5597e759bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/3236756426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e759bcc0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac11f0c0 tx=0x7ff8ac0f4000 comp rx=0 tx=0).stop 2024-09-12T12:18:06.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- 172.21.15.144:0/3236756426 shutdown_connections 2024-09-12T12:18:06.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/3236756426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759d440 0x5597e75ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/3236756426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e759cb20 0x5597e759c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/3236756426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e7558390 0x5597e759bcc0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- 172.21.15.144:0/3236756426 >> 172.21.15.144:0/3236756426 conn(0x5597e7553290 msgr2=0x5597e7557650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- 172.21.15.144:0/3236756426 shutdown_connections 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- 172.21.15.144:0/3236756426 wait complete. 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 -- start start 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.761+0000 7ff8c5b06000 1 Processor -- start 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e7558390 0x5597e75b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 0x5597e75cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759d440 0x5597e75cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5597e73a0f80 con 0x5597e759d440 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5597e7359ca0 con 0x5597e7558390 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5597e73a62a0 con 0x5597e759cb20 2024-09-12T12:18:06.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 10 client.0 _ll_register_callbacks cb 0x7ff8b4009730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759d440 0x5597e75cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759d440 0x5597e75cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39206/0 (socket says 172.21.15.144:39206) 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bbe00640 1 -- 172.21.15.144:0/96398554 learned_addr learned my addr 172.21.15.144:0/96398554 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bb400640 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e7558390 0x5597e75b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8baa00640 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 0x5597e75cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bb400640 1 -- 172.21.15.144:0/96398554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 msgr2=0x5597e75cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bb400640 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 0x5597e75cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bb400640 1 -- 172.21.15.144:0/96398554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759d440 msgr2=0x5597e75cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bb400640 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759d440 0x5597e75cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bb400640 1 -- 172.21.15.144:0/96398554 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e7424750 con 0x5597e7558390 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bbe00640 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759d440 0x5597e75cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8bb400640 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e7558390 0x5597e75b0590 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac01c7a0 tx=0x7ff8ac000f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b739eb419a234e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 1 -- 172.21.15.144:0/96398554 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0ef200 con 0x5597e7558390 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 1 -- 172.21.15.144:0/96398554 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7ff8ac0ed570 con 0x5597e7558390 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- 172.21.15.144:0/96398554 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ac0f9ae0 con 0x5597e7558390 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 1 -- 172.21.15.144:0/96398554 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff8ac0a5720 con 0x5597e7558390 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 10 client.7081 fetch_fsmap learned FSMap version 80 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- 172.21.15.144:0/96398554 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x5597e732fa30 con 0x5597e7558390 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 1 -- 172.21.15.144:0/96398554 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0f9ae0 con 0x5597e7558390 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 1 -- 172.21.15.144:0/96398554 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7ff8bc0d1e00 con 0x5597e7558390 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 10 client.7081 fetch_fsmap finished waiting for FSMap version 80 2024-09-12T12:18:06.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 10 client.7081 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:18:06.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 20 client.7081 populate_metadata read hostname 'smithi144' 2024-09-12T12:18:06.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x5597e75cc3e0 0x5597e760fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 4 client.7081 mds_command: new command op to 7347 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:18:06.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- 172.21.15.144:0/96398554 --> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] -- command(tid 0: {"prefix": "status"}) -- 0x5597e73af3a0 con 0x5597e75cc3e0 2024-09-12T12:18:06.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8baa00640 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x5597e75cc3e0 0x5597e760fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8baa00640 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x5597e75cc3e0 0x5597e760fc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f6d733b17cad7 server_cookie=15d78ed51e66a0a0 in_seq=0 out_seq=0 2024-09-12T12:18:06.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 10 client.7081 ms_handle_connect on v2:172.21.15.144:6834/1676869896 2024-09-12T12:18:06.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 1 -- 172.21.15.144:0/96398554 <== mds.0 v2:172.21.15.144:6834/1676869896 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5597e73af3a0 con 0x5597e75cc3e0 2024-09-12T12:18:06.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 10 client.7081 handle_command_reply: tid=0 2024-09-12T12:18:06.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 client.7081 shutdown 2024-09-12T12:18:06.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- 172.21.15.144:0/96398554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e7558390 msgr2=0x5597e75b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e7558390 0x5597e75b0590 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac01c7a0 tx=0x7ff8ac000f50 comp rx=0 tx=0).stop 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- 172.21.15.144:0/96398554 shutdown_connections 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x5597e75cc3e0 0x5597e760fc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5597e759d440 0x5597e75cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5597e759cb20 0x5597e75cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 --2- 172.21.15.144:0/96398554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5597e7558390 0x5597e75b0590 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8a4c00640 0 client.7081 ms_handle_reset on v2:172.21.15.144:6834/1676869896 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- 172.21.15.144:0/96398554 >> 172.21.15.144:0/96398554 conn(0x5597e7553290 msgr2=0x5597e759acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- 172.21.15.144:0/96398554 shutdown_connections 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 1 -- 172.21.15.144:0/96398554 wait complete. 2024-09-12T12:18:06.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.765+0000 7ff8c5b06000 20 client.7081 trim_cache size 0 max 16384 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 7347, 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 5.3782511739999999, 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 80, 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 102, 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 102, 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 6.2632639369999996 2024-09-12T12:18:06.772 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:18:06.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 -- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff89c0678c0 msgr2=0x7ff89c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff89c0678c0 0x7ff89c069d80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8007fd0 tx=0x7ff8a8009040 comp rx=0 tx=0).stop 2024-09-12T12:18:06.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 -- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc070dd0 msgr2=0x7ff8bc14a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc070dd0 0x7ff8bc14a910 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009d90 tx=0x7ff8ac019710 comp rx=0 tx=0).stop 2024-09-12T12:18:06.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 -- 172.21.15.144:0/2306643681 shutdown_connections 2024-09-12T12:18:06.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff89c0678c0 0x7ff89c069d80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc1618f0 0x7ff8bc06e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc073910 0x7ff8bc06dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 --2- 172.21.15.144:0/2306643681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc070dd0 0x7ff8bc14a910 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 -- 172.21.15.144:0/2306643681 >> 172.21.15.144:0/2306643681 conn(0x7ff8bc0d22e0 msgr2=0x7ff8bc157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:06.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 -- 172.21.15.144:0/2306643681 shutdown_connections 2024-09-12T12:18:06.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.769+0000 7ff8c1200640 1 -- 172.21.15.144:0/2306643681 wait complete. 2024-09-12T12:18:06.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-12T12:18:06.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.929+0000 7f01d2000640 1 Processor -- start 2024-09-12T12:18:06.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.929+0000 7f01d2000640 1 -- start start 2024-09-12T12:18:06.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01d2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc0cd9f0 0x7f01cc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01d2000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f01cc15b340 0x7f01cc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01d2000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01cc0b4300 con 0x7f01cc15af60 2024-09-12T12:18:06.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01d2000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f01cc0b32f0 con 0x7f01cc15b340 2024-09-12T12:18:06.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01d2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f01cc0b3540 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01caa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc0cd9f0 0x7f01cc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01caa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc0cd9f0 0x7f01cc06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:48378/0 (socket says 172.21.15.144:48378) 2024-09-12T12:18:06.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01caa00640 1 -- 172.21.15.144:0/3200646740 learned_addr learned my addr 172.21.15.144:0/3200646740 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:06.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01cb400640 1 --1- 172.21.15.144:0/3200646740 >> v1:172.21.15.165:6789/0 conn(0x7f01cc15af60 0x7f01cc0ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:60500/0 (socket says 172.21.15.144:60500) 2024-09-12T12:18:06.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01cbe00640 1 --2- 172.21.15.144:0/3200646740 >> v2:172.21.15.165:3300/0 conn(0x7f01cc15b340 0x7f01cc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01caa00640 1 -- 172.21.15.144:0/3200646740 >> v2:172.21.15.165:3300/0 conn(0x7f01cc15b340 msgr2=0x7f01cc06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:06.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01caa00640 1 --2- 172.21.15.144:0/3200646740 >> v2:172.21.15.165:3300/0 conn(0x7f01cc15b340 0x7f01cc06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01caa00640 1 -- 172.21.15.144:0/3200646740 >> v1:172.21.15.165:6789/0 conn(0x7f01cc15af60 legacy=0x7f01cc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.933+0000 7f01caa00640 1 -- 172.21.15.144:0/3200646740 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc0b3820 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01caa00640 1 --2- 172.21.15.144:0/3200646740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc0cd9f0 0x7f01cc06bc10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009870 tx=0x7f01b801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e899a833dd95c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01ca000640 1 -- 172.21.15.144:0/3200646740 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80b5070 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01ca000640 1 -- 172.21.15.144:0/3200646740 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b80a8a50 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01ca000640 1 -- 172.21.15.144:0/3200646740 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80a8e20 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 -- 172.21.15.144:0/3200646740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc0cd9f0 msgr2=0x7f01cc06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 --2- 172.21.15.144:0/3200646740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc0cd9f0 0x7f01cc06bc10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009870 tx=0x7f01b801ed50 comp rx=0 tx=0).stop 2024-09-12T12:18:06.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 -- 172.21.15.144:0/3200646740 shutdown_connections 2024-09-12T12:18:06.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 --2- 172.21.15.144:0/3200646740 >> v2:172.21.15.165:3300/0 conn(0x7f01cc15b340 0x7f01cc06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 --2- 172.21.15.144:0/3200646740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc0cd9f0 0x7f01cc06bc10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 -- 172.21.15.144:0/3200646740 >> 172.21.15.144:0/3200646740 conn(0x7f01cc068030 msgr2=0x7f01cc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:06.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 -- 172.21.15.144:0/3200646740 shutdown_connections 2024-09-12T12:18:06.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 -- 172.21.15.144:0/3200646740 wait complete. 2024-09-12T12:18:06.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 Processor -- start 2024-09-12T12:18:06.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.937+0000 7f01d2000640 1 -- start start 2024-09-12T12:18:06.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01d2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01cc0cd9f0 0x7f01cc070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01d2000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc15af60 0x7f01cc14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01d2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc15b340 0x7f01cc14ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01d2000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc06d0f0 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01d2000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc0b3de0 con 0x7f01cc15af60 2024-09-12T12:18:06.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01d2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f01cc06d270 con 0x7f01cc15b340 2024-09-12T12:18:06.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01cc0cd9f0 0x7f01cc070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01cc0cd9f0 0x7f01cc070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39212/0 (socket says 172.21.15.144:39212) 2024-09-12T12:18:06.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cb400640 1 -- 172.21.15.144:0/3504066752 learned_addr learned my addr 172.21.15.144:0/3504066752 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01caa00640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc15af60 0x7f01cc14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cbe00640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc15b340 0x7f01cc14ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cb400640 1 -- 172.21.15.144:0/3504066752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc15b340 msgr2=0x7f01cc14ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cb400640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc15b340 0x7f01cc14ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cb400640 1 -- 172.21.15.144:0/3504066752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc15af60 msgr2=0x7f01cc14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cb400640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc15af60 0x7f01cc14a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cb400640 1 -- 172.21.15.144:0/3504066752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc155600 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cbe00640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc15b340 0x7f01cc14ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01cb400640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01cc0cd9f0 0x7f01cc070f70 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00c490 tx=0x7f01bc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01c3400640 1 -- 172.21.15.144:0/3504066752 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc018070 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01c3400640 1 -- 172.21.15.144:0/3504066752 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01bc007480 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01c3400640 1 -- 172.21.15.144:0/3504066752 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc004a10 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc1558e0 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc0714b0 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01cc0ce680 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.941+0000 7f01c3400640 1 -- 172.21.15.144:0/3504066752 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f01bc004bb0 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.945+0000 7f01c3400640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01ac0678c0 0x7f01ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:06.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.945+0000 7f01c3400640 1 -- 172.21.15.144:0/3504066752 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f01bc085290 con 0x7f01cc0cd9f0 2024-09-12T12:18:06.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.945+0000 7f01caa00640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01ac0678c0 0x7f01ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:06.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.945+0000 7f01caa00640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01ac0678c0 0x7f01ac069d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f01b80b2000 tx=0x7f01b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:06.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:06.949+0000 7f01c3400640 1 -- 172.21.15.144:0/3504066752 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f01bc0553c0 con 0x7f01cc0cd9f0 2024-09-12T12:18:07.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.105+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f01cc0afc20 con 0x7f01cc0cd9f0 2024-09-12T12:18:07.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.109+0000 7f01c3400640 1 -- 172.21.15.144:0/3504066752 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7f01bc0596c0 con 0x7f01cc0cd9f0 2024-09-12T12:18:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01ac0678c0 msgr2=0x7f01ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01ac0678c0 0x7f01ac069d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f01b80b2000 tx=0x7f01b8009040 comp rx=0 tx=0).stop 2024-09-12T12:18:07.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01cc0cd9f0 msgr2=0x7f01cc070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01cc0cd9f0 0x7f01cc070f70 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00c490 tx=0x7f01bc00c950 comp rx=0 tx=0).stop 2024-09-12T12:18:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 shutdown_connections 2024-09-12T12:18:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01ac0678c0 0x7f01ac069d80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01cc15b340 0x7f01cc14ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc15af60 0x7f01cc14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 --2- 172.21.15.144:0/3504066752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01cc0cd9f0 0x7f01cc070f70 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 >> 172.21.15.144:0/3504066752 conn(0x7f01cc068030 msgr2=0x7f01cc073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 shutdown_connections 2024-09-12T12:18:07.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.113+0000 7f01d2000640 1 -- 172.21.15.144:0/3504066752 wait complete. 2024-09-12T12:18:07.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-12T12:18:07.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.273+0000 7f821d200640 1 Processor -- start 2024-09-12T12:18:07.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.273+0000 7f821d200640 1 -- start start 2024-09-12T12:18:07.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f821d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8218147e30 0x7f821806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f821d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f821806c150 0x7f82180b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f821d200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82180b54e0 con 0x7f82180b4c90 2024-09-12T12:18:07.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f821d200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f821815fcd0 con 0x7f821806c150 2024-09-12T12:18:07.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f821d200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f821815ffb0 con 0x7f8218147e30 2024-09-12T12:18:07.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f8215400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f821806c150 0x7f82180b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f8215400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f821806c150 0x7f82180b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35790/0 (socket says 172.21.15.144:35790) 2024-09-12T12:18:07.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f8215400640 1 -- 172.21.15.144:0/1060108077 learned_addr learned my addr 172.21.15.144:0/1060108077 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:07.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f8215e00640 1 --2- 172.21.15.144:0/1060108077 >> v2:172.21.15.165:3300/0 conn(0x7f8218147e30 0x7f821806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f8215400640 1 -- 172.21.15.144:0/1060108077 >> v2:172.21.15.165:3300/0 conn(0x7f8218147e30 msgr2=0x7f821806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:07.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f8215400640 1 --2- 172.21.15.144:0/1060108077 >> v2:172.21.15.165:3300/0 conn(0x7f8218147e30 0x7f821806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f8215400640 1 -- 172.21.15.144:0/1060108077 >> v1:172.21.15.144:6789/0 conn(0x7f82180b4c90 legacy=0x7f82180b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f8215400640 1 -- 172.21.15.144:0/1060108077 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8218160290 con 0x7f821806c150 2024-09-12T12:18:07.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.277+0000 7f8214a00640 1 -- 172.21.15.144:0/1060108077 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 744641198 0 0) 0x7f82180b54e0 con 0x7f82180b4c90 2024-09-12T12:18:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f8215400640 1 --2- 172.21.15.144:0/1060108077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 0x7f82180b4750 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f8204009870 tx=0x7f820401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ccb51b19dbe003 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f8214a00640 1 -- 172.21.15.144:0/1060108077 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82040b1070 con 0x7f821806c150 2024-09-12T12:18:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f8214a00640 1 -- 172.21.15.144:0/1060108077 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82040ac600 con 0x7f821806c150 2024-09-12T12:18:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f8214a00640 1 -- 172.21.15.144:0/1060108077 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82040ac9d0 con 0x7f821806c150 2024-09-12T12:18:07.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 -- 172.21.15.144:0/1060108077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 msgr2=0x7f82180b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 --2- 172.21.15.144:0/1060108077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 0x7f82180b4750 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f8204009870 tx=0x7f820401c490 comp rx=0 tx=0).stop 2024-09-12T12:18:07.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 -- 172.21.15.144:0/1060108077 shutdown_connections 2024-09-12T12:18:07.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 --2- 172.21.15.144:0/1060108077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 0x7f82180b4750 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 --2- 172.21.15.144:0/1060108077 >> v2:172.21.15.165:3300/0 conn(0x7f8218147e30 0x7f821806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 -- 172.21.15.144:0/1060108077 >> 172.21.15.144:0/1060108077 conn(0x7f821806cd20 msgr2=0x7f821806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:07.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 -- 172.21.15.144:0/1060108077 shutdown_connections 2024-09-12T12:18:07.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 -- 172.21.15.144:0/1060108077 wait complete. 2024-09-12T12:18:07.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 Processor -- start 2024-09-12T12:18:07.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 -- start start 2024-09-12T12:18:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 0x7f821815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82180b4c90 0x7f82180cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8218147e30 0x7f8218162270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f821816b230 con 0x7f821806c150 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f821816b0b0 con 0x7f82180b4c90 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.281+0000 7f821d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f821816b3b0 con 0x7f8218147e30 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 0x7f821815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 0x7f821815af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35804/0 (socket says 172.21.15.144:35804) 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215e00640 1 -- 172.21.15.144:0/1131914742 learned_addr learned my addr 172.21.15.144:0/1131914742 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215400640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82180b4c90 0x7f82180cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8216800640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8218147e30 0x7f8218162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215e00640 1 -- 172.21.15.144:0/1131914742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8218147e30 msgr2=0x7f8218162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215e00640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8218147e30 0x7f8218162270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215e00640 1 -- 172.21.15.144:0/1131914742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82180b4c90 msgr2=0x7f82180cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215e00640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82180b4c90 0x7f82180cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215e00640 1 -- 172.21.15.144:0/1131914742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8218159ef0 con 0x7f821806c150 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215400640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82180b4c90 0x7f82180cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f8215e00640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 0x7f821815af90 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f8208007ef0 tx=0x7f820800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f820e000640 1 -- 172.21.15.144:0/1131914742 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208014620 con 0x7f821806c150 2024-09-12T12:18:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f820e000640 1 -- 172.21.15.144:0/1131914742 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8208019070 con 0x7f821806c150 2024-09-12T12:18:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f820e000640 1 -- 172.21.15.144:0/1131914742 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208014a00 con 0x7f821806c150 2024-09-12T12:18:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821815a1d0 con 0x7f821806c150 2024-09-12T12:18:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821815a790 con 0x7f821806c150 2024-09-12T12:18:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f821806c7d0 con 0x7f821806c150 2024-09-12T12:18:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f820e000640 1 -- 172.21.15.144:0/1131914742 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8208014ba0 con 0x7f821806c150 2024-09-12T12:18:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f820e000640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81f80678c0 0x7f81f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.285+0000 7f820e000640 1 -- 172.21.15.144:0/1131914742 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f82080868a0 con 0x7f821806c150 2024-09-12T12:18:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.289+0000 7f8215400640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81f80678c0 0x7f81f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.289+0000 7f8215400640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81f80678c0 0x7f81f8069d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f82040ae000 tx=0x7f8204008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:07.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.289+0000 7f820e000640 1 -- 172.21.15.144:0/1131914742 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8208057140 con 0x7f821806c150 2024-09-12T12:18:07.388 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-12T12:18:07.389+0000 7f74b4400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:18:07.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.449+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f82180b4750 con 0x7f821806c150 2024-09-12T12:18:07.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f820e000640 1 -- 172.21.15.144:0/1131914742 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v28)=0 v28) ==== 116+0+0 (secure 0 0 0) 0x7f8208056a40 con 0x7f821806c150 2024-09-12T12:18:07.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81f80678c0 msgr2=0x7f81f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81f80678c0 0x7f81f8069d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f82040ae000 tx=0x7f8204008040 comp rx=0 tx=0).stop 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 msgr2=0x7f821815af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 0x7f821815af90 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f8208007ef0 tx=0x7f820800e4b0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 shutdown_connections 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81f80678c0 0x7f81f8069d80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8218147e30 0x7f8218162270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82180b4c90 0x7f82180cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 --2- 172.21.15.144:0/1131914742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f821806c150 0x7f821815af90 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 >> 172.21.15.144:0/1131914742 conn(0x7f821806cd20 msgr2=0x7f82180b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 shutdown_connections 2024-09-12T12:18:07.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.453+0000 7f821d200640 1 -- 172.21.15.144:0/1131914742 wait complete. 2024-09-12T12:18:07.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-12T12:18:07.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.613+0000 7f965ae00640 1 Processor -- start 2024-09-12T12:18:07.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.613+0000 7f965ae00640 1 -- start start 2024-09-12T12:18:07.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f965ae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f96540af5d0 0x7f96540cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f965ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9654166510 0x7f9654166960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f965ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96540cf900 con 0x7f9654162a40 2024-09-12T12:18:07.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f965ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f96540cf6d0 con 0x7f9654166510 2024-09-12T12:18:07.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f965ae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f96540cfbe0 con 0x7f96540af5d0 2024-09-12T12:18:07.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f9658e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9654166510 0x7f9654166960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f9653400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f96540af5d0 0x7f96540cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f9658e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9654166510 0x7f9654166960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35810/0 (socket says 172.21.15.144:35810) 2024-09-12T12:18:07.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f9658e00640 1 -- 172.21.15.144:0/1150972611 learned_addr learned my addr 172.21.15.144:0/1150972611 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:07.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f9658e00640 1 -- 172.21.15.144:0/1150972611 >> v2:172.21.15.165:3300/0 conn(0x7f96540af5d0 msgr2=0x7f96540cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:07.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f9658e00640 1 --2- 172.21.15.144:0/1150972611 >> v2:172.21.15.165:3300/0 conn(0x7f96540af5d0 0x7f96540cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f9658e00640 1 -- 172.21.15.144:0/1150972611 >> v1:172.21.15.165:6789/0 conn(0x7f9654162a40 legacy=0x7f9654163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.617+0000 7f9658e00640 1 -- 172.21.15.144:0/1150972611 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96540cfec0 con 0x7f9654166510 2024-09-12T12:18:07.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f9658e00640 1 --2- 172.21.15.144:0/1150972611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654166510 0x7f9654166960 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f9654074390 tx=0x7f964c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffd6e996edbedee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:07.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f9652a00640 1 -- 172.21.15.144:0/1150972611 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c0b0070 con 0x7f9654166510 2024-09-12T12:18:07.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f9652a00640 1 -- 172.21.15.144:0/1150972611 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964c0ab600 con 0x7f9654166510 2024-09-12T12:18:07.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f9652a00640 1 -- 172.21.15.144:0/1150972611 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c0ab9d0 con 0x7f9654166510 2024-09-12T12:18:07.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 -- 172.21.15.144:0/1150972611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654166510 msgr2=0x7f9654166960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 --2- 172.21.15.144:0/1150972611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654166510 0x7f9654166960 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f9654074390 tx=0x7f964c01c490 comp rx=0 tx=0).stop 2024-09-12T12:18:07.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 -- 172.21.15.144:0/1150972611 shutdown_connections 2024-09-12T12:18:07.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 --2- 172.21.15.144:0/1150972611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654166510 0x7f9654166960 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 --2- 172.21.15.144:0/1150972611 >> v2:172.21.15.165:3300/0 conn(0x7f96540af5d0 0x7f96540cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 -- 172.21.15.144:0/1150972611 >> 172.21.15.144:0/1150972611 conn(0x7f9654068030 msgr2=0x7f96540b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:07.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 -- 172.21.15.144:0/1150972611 shutdown_connections 2024-09-12T12:18:07.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 -- 172.21.15.144:0/1150972611 wait complete. 2024-09-12T12:18:07.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 Processor -- start 2024-09-12T12:18:07.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.621+0000 7f965ae00640 1 -- start start 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f965ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96540af5d0 0x7f9654071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f965ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654162a40 0x7f96541598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f965ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9654166510 0x7f9654153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f965ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f965416fa30 con 0x7f9654162a40 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f965ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f965416f8b0 con 0x7f9654166510 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f965ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f965416fbb0 con 0x7f96540af5d0 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654162a40 0x7f96541598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654162a40 0x7f96541598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35816/0 (socket says 172.21.15.144:35816) 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653400640 1 -- 172.21.15.144:0/1609419720 learned_addr learned my addr 172.21.15.144:0/1609419720 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:07.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653e00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96540af5d0 0x7f9654071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9658e00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9654166510 0x7f9654153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653400640 1 -- 172.21.15.144:0/1609419720 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96540af5d0 msgr2=0x7f9654071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653400640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96540af5d0 0x7f9654071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653400640 1 -- 172.21.15.144:0/1609419720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9654166510 msgr2=0x7f9654153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653400640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9654166510 0x7f9654153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653400640 1 -- 172.21.15.144:0/1609419720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9654153890 con 0x7f9654162a40 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9658e00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9654166510 0x7f9654153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f9653400640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654162a40 0x7f96541598e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f964000e870 tx=0x7f964000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f964be00640 1 -- 172.21.15.144:0/1609419720 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9640017070 con 0x7f9654162a40 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f964be00640 1 -- 172.21.15.144:0/1609419720 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964000c940 con 0x7f9654162a40 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f964be00640 1 -- 172.21.15.144:0/1609419720 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964000ccf0 con 0x7f9654162a40 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9654159fe0 con 0x7f9654162a40 2024-09-12T12:18:07.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965415a5a0 con 0x7f9654162a40 2024-09-12T12:18:07.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96540cf190 con 0x7f9654162a40 2024-09-12T12:18:07.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.625+0000 7f964be00640 1 -- 172.21.15.144:0/1609419720 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f964001a070 con 0x7f9654162a40 2024-09-12T12:18:07.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.629+0000 7f964be00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96340678f0 0x7f9634069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.629+0000 7f964be00640 1 -- 172.21.15.144:0/1609419720 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f9640085df0 con 0x7f9654162a40 2024-09-12T12:18:07.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.629+0000 7f9653e00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96340678f0 0x7f9634069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.629+0000 7f9653e00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96340678f0 0x7f9634069db0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9644001e00 tx=0x7f9644009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:07.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.633+0000 7f964be00640 1 -- 172.21.15.144:0/1609419720 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9654153890 con 0x7f9654162a40 2024-09-12T12:18:07.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.789+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f96540cd940 con 0x7f9654162a40 2024-09-12T12:18:07.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.793+0000 7f964be00640 1 -- 172.21.15.144:0/1609419720 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7f9640055fb0 con 0x7f9654162a40 2024-09-12T12:18:07.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96340678f0 msgr2=0x7f9634069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96340678f0 0x7f9634069db0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9644001e00 tx=0x7f9644009040 comp rx=0 tx=0).stop 2024-09-12T12:18:07.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654162a40 msgr2=0x7f96541598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654162a40 0x7f96541598e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f964000e870 tx=0x7f964000ec70 comp rx=0 tx=0).stop 2024-09-12T12:18:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 shutdown_connections 2024-09-12T12:18:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96340678f0 0x7f9634069db0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9654166510 0x7f9654153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9654162a40 0x7f96541598e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 --2- 172.21.15.144:0/1609419720 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96540af5d0 0x7f9654071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 >> 172.21.15.144:0/1609419720 conn(0x7f9654068030 msgr2=0x7f96540b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 shutdown_connections 2024-09-12T12:18:07.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.797+0000 7f965ae00640 1 -- 172.21.15.144:0/1609419720 wait complete. 2024-09-12T12:18:07.815 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:07.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.949+0000 7f9e71a00640 1 Processor -- start 2024-09-12T12:18:07.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.949+0000 7f9e71a00640 1 -- start start 2024-09-12T12:18:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e71a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9e6c15c580 0x7f9e6c0b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e71a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e6c0b6590 0x7f9e6c15ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e71a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e6c0741c0 con 0x7f9e6c160520 2024-09-12T12:18:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e71a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6c15c960 con 0x7f9e6c15c580 2024-09-12T12:18:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e71a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c0b5bc0 con 0x7f9e6c0b6590 2024-09-12T12:18:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9e6c160520 0x7f9e6c0d2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47178/0 (socket says 172.21.15.144:47178) 2024-09-12T12:18:07.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6b400640 1 -- 172.21.15.144:0/2649557542 learned_addr learned my addr 172.21.15.144:0/2649557542 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6aa00640 1 --2- 172.21.15.144:0/2649557542 >> v2:172.21.15.165:3300/0 conn(0x7f9e6c15c580 0x7f9e6c0b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6a000640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e6c0b6590 0x7f9e6c15ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067060521 0 0) 0x7f9e6c0741c0 con 0x7f9e6c160520 2024-09-12T12:18:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e50003530 con 0x7f9e6c160520 2024-09-12T12:18:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3105673820 0 0) 0x7f9e50003530 con 0x7f9e6c160520 2024-09-12T12:18:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e6c0b6590 msgr2=0x7f9e6c15ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:07.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e6c0b6590 0x7f9e6c15ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 >> v2:172.21.15.165:3300/0 conn(0x7f9e6c15c580 msgr2=0x7f9e6c0b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 --2- 172.21.15.144:0/2649557542 >> v2:172.21.15.165:3300/0 conn(0x7f9e6c15c580 0x7f9e6c0b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c160b50 con 0x7f9e6c160520 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f9e64001a00 con 0x7f9e6c160520 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 >> v1:172.21.15.144:6789/0 conn(0x7f9e6c160520 legacy=0x7f9e6c0d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e500039c0 0x7f9e50003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e50004370 0x7f9e50004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004ec0 0x7f9e5000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c15c960 con 0x7f9e50004370 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c0b5bc0 con 0x7f9e50004ec0 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5000bf10 con 0x7f9e500039c0 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6a000640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e50004370 0x7f9e50004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6aa00640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e500039c0 0x7f9e50003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6b400640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004ec0 0x7f9e5000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6a000640 1 -- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e500039c0 msgr2=0x7f9e50003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6a000640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e500039c0 0x7f9e50003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6a000640 1 -- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004ec0 msgr2=0x7f9e5000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6a000640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004ec0 0x7f9e5000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6a000640 1 -- 172.21.15.144:0/2649557542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e50003530 con 0x7f9e50004370 2024-09-12T12:18:07.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.953+0000 7f9e6b400640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004ec0 0x7f9e5000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e6a000640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e50004370 0x7f9e50004850 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0689e0 tx=0x7f9e5801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4c5fc5b916c15c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e580b2070 con 0x7f9e50004370 2024-09-12T12:18:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e580a5580 con 0x7f9e50004370 2024-09-12T12:18:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e69600640 1 -- 172.21.15.144:0/2649557542 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e580096b0 con 0x7f9e50004370 2024-09-12T12:18:07.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e71a00640 1 -- 172.21.15.144:0/2649557542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e50004370 msgr2=0x7f9e50004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e71a00640 1 --2- 172.21.15.144:0/2649557542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e50004370 0x7f9e50004850 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0689e0 tx=0x7f9e5801ca10 comp rx=0 tx=0).stop 2024-09-12T12:18:07.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e6b400640 1 -- 172.21.15.144:0/2649557542 reap_dead start 2024-09-12T12:18:07.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e71a00640 1 -- 172.21.15.144:0/2649557542 shutdown_connections 2024-09-12T12:18:07.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e71a00640 1 -- 172.21.15.144:0/2649557542 >> 172.21.15.144:0/2649557542 conn(0x7f9e6c067a00 msgr2=0x7f9e6c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:07.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e71a00640 1 -- 172.21.15.144:0/2649557542 shutdown_connections 2024-09-12T12:18:07.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.957+0000 7f9e71a00640 1 -- 172.21.15.144:0/2649557542 wait complete. 2024-09-12T12:18:07.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 Processor -- start 2024-09-12T12:18:07.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 -- start start 2024-09-12T12:18:07.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004370 0x7f9e6c147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6c0ae970 0x7f9e6c144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e6c162440 0x7f9e6c1628f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c0d2a20 con 0x7f9e6c0ae970 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c160e30 con 0x7f9e50004370 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c0d2ba0 con 0x7f9e6c162440 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6c0ae970 0x7f9e6c144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6c0ae970 0x7f9e6c144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35828/0 (socket says 172.21.15.144:35828) 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6a000640 1 -- 172.21.15.144:0/4000999234 learned_addr learned my addr 172.21.15.144:0/4000999234 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6aa00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004370 0x7f9e6c147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6b400640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e6c162440 0x7f9e6c1628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6a000640 1 -- 172.21.15.144:0/4000999234 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e6c162440 msgr2=0x7f9e6c1628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6a000640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e6c162440 0x7f9e6c1628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6a000640 1 -- 172.21.15.144:0/4000999234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004370 msgr2=0x7f9e6c147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6a000640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004370 0x7f9e6c147e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6a000640 1 -- 172.21.15.144:0/4000999234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c1483d0 con 0x7f9e6c0ae970 2024-09-12T12:18:07.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e6a000640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6c0ae970 0x7f9e6c144a70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f9e580b0040 tx=0x7f9e50005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e62a00640 1 -- 172.21.15.144:0/4000999234 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e580bd020 con 0x7f9e6c0ae970 2024-09-12T12:18:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e62a00640 1 -- 172.21.15.144:0/4000999234 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e580a5d30 con 0x7f9e6c0ae970 2024-09-12T12:18:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e62a00640 1 -- 172.21.15.144:0/4000999234 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e580b2040 con 0x7f9e6c0ae970 2024-09-12T12:18:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6c0b08e0 con 0x7f9e6c0ae970 2024-09-12T12:18:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6c0b0ea0 con 0x7f9e6c0ae970 2024-09-12T12:18:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.961+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6c15ffe0 con 0x7f9e6c0ae970 2024-09-12T12:18:07.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.965+0000 7f9e62a00640 1 -- 172.21.15.144:0/4000999234 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e58004260 con 0x7f9e6c0ae970 2024-09-12T12:18:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.965+0000 7f9e62a00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e4c0678c0 0x7f9e4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.965+0000 7f9e62a00640 1 -- 172.21.15.144:0/4000999234 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f9e5811fb50 con 0x7f9e6c0ae970 2024-09-12T12:18:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.965+0000 7f9e6aa00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e4c0678c0 0x7f9e4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:07.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.965+0000 7f9e6aa00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e4c0678c0 0x7f9e4c069d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009ba0 tx=0x7f9e5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:07.969+0000 7f9e62a00640 1 -- 172.21.15.144:0/4000999234 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e6c1483d0 con 0x7f9e6c0ae970 2024-09-12T12:18:08.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.157+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e6c161960 con 0x7f9e6c0ae970 2024-09-12T12:18:08.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e62a00640 1 -- 172.21.15.144:0/4000999234 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5239 (secure 0 0 0) 0x7f9e58016720 con 0x7f9e6c0ae970 2024-09-12T12:18:08.159 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:08.159 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":80,"btime":"2024-09-12T12:18:04:401229+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:04.401224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7347,"qdb_cluster":[7347]},"id":6}]} 2024-09-12T12:18:08.160 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 80 2024-09-12T12:18:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e4c0678c0 msgr2=0x7f9e4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e4c0678c0 0x7f9e4c069d80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009ba0 tx=0x7f9e5c008040 comp rx=0 tx=0).stop 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6c0ae970 msgr2=0x7f9e6c144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6c0ae970 0x7f9e6c144a70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f9e580b0040 tx=0x7f9e50005840 comp rx=0 tx=0).stop 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 shutdown_connections 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e4c0678c0 0x7f9e4c069d80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e6c162440 0x7f9e6c1628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e6c0ae970 0x7f9e6c144a70 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 --2- 172.21.15.144:0/4000999234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e50004370 0x7f9e6c147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 >> 172.21.15.144:0/4000999234 conn(0x7f9e6c067a00 msgr2=0x7f9e6c157460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 shutdown_connections 2024-09-12T12:18:08.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.161+0000 7f9e71a00640 1 -- 172.21.15.144:0/4000999234 wait complete. 2024-09-12T12:18:08.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-12T12:18:08.337 INFO:teuthology.orchestra.run.smithi144.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-12T12:17:59.018053+0000","btime":"2024-09-12T12:17:58.170062+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T12:17:59.018053+0000","atime":"2024-09-12T12:17:58.170062+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-12T12:17:59.018053+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:17:59.018053+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:17:59.018053+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-12T12:18:08.338 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-12T12:17:59.018053+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-12T12:17:58.170062+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-12T12:17:58.170062+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-12T12:17:59.018053+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-12T12:17:59.018053+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-12T12:17:59.018053+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-12T12:17:59.018053+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-12T12:18:08.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:18:08.339 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-09-12T12:18:08.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccba400640 1 Processor -- start 2024-09-12T12:18:08.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccba400640 1 -- start start 2024-09-12T12:18:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccba400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fccb4161b60 0x7fccb415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccba400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb415f4b0 con 0x7fccb406c320 2024-09-12T12:18:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccba400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb415f790 con 0x7fccb415f010 2024-09-12T12:18:08.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccba400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fccb415fa70 con 0x7fccb4161b60 2024-09-12T12:18:08.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb3e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fccb406c320 0x7fccb40729b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47188/0 (socket says 172.21.15.144:47188) 2024-09-12T12:18:08.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb3e00640 1 -- 172.21.15.144:0/3302908140 learned_addr learned my addr 172.21.15.144:0/3302908140 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb3400640 1 --2- 172.21.15.144:0/3302908140 >> v2:172.21.15.165:3300/0 conn(0x7fccb4161b60 0x7fccb415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1780899345 0 0) 0x7fccb415f4b0 con 0x7fccb406c320 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc98003530 con 0x7fccb406c320 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 298443026 0 0) 0x7fcc98003530 con 0x7fccb406c320 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 >> v2:172.21.15.165:3300/0 conn(0x7fccb4161b60 msgr2=0x7fccb415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 --2- 172.21.15.144:0/3302908140 >> v2:172.21.15.165:3300/0 conn(0x7fccb4161b60 0x7fccb415ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 >> v1:172.21.15.165:6789/0 conn(0x7fccb415f010 legacy=0x7fccb406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb40721b0 con 0x7fccb406c320 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fccac0016a0 con 0x7fccb406c320 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 >> v1:172.21.15.144:6789/0 conn(0x7fccb406c320 legacy=0x7fccb40729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fcc98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcc98004810 0x7fcc98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc98005220 0x7fcc9800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fccb415fa70 con 0x7fcc980039c0 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9800c170 con 0x7fcc98004810 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.481+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9800c370 con 0x7fcc98005220 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb3400640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fcc98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb3e00640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc98005220 0x7fcc9800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb2a00640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcc98004810 0x7fcc98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb3400640 1 -- 172.21.15.144:0/3302908140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc98005220 msgr2=0x7fcc9800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb3400640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcc98005220 0x7fcc9800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb3400640 1 -- 172.21.15.144:0/3302908140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcc98004810 msgr2=0x7fcc98004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb3400640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcc98004810 0x7fcc98004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb3400640 1 -- 172.21.15.144:0/3302908140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb40721b0 con 0x7fcc980039c0 2024-09-12T12:18:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb3e00640 1 -- 172.21.15.144:0/3302908140 reap_dead start 2024-09-12T12:18:08.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb3400640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fcc98003de0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009f90 tx=0x7fcca401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6da07848ce25643 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b2070 con 0x7fcc980039c0 2024-09-12T12:18:08.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40a5b60 con 0x7fcc980039c0 2024-09-12T12:18:08.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.485+0000 7fccb2000640 1 -- 172.21.15.144:0/3302908140 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4009c10 con 0x7fcc980039c0 2024-09-12T12:18:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 -- 172.21.15.144:0/3302908140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 msgr2=0x7fcc98003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fcc98003de0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009f90 tx=0x7fcca401cc60 comp rx=0 tx=0).stop 2024-09-12T12:18:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 -- 172.21.15.144:0/3302908140 shutdown_connections 2024-09-12T12:18:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 --2- 172.21.15.144:0/3302908140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fcc98003de0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 -- 172.21.15.144:0/3302908140 >> 172.21.15.144:0/3302908140 conn(0x7fccb406cd20 msgr2=0x7fccb406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:08.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 -- 172.21.15.144:0/3302908140 shutdown_connections 2024-09-12T12:18:08.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 -- 172.21.15.144:0/3302908140 wait complete. 2024-09-12T12:18:08.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 Processor -- start 2024-09-12T12:18:08.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 -- start start 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fccb415a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb4154160 0x7fccb41ec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccb41ecd10 0x7fccb41578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fccb406bfa0 con 0x7fcc980039c0 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fccb406be20 con 0x7fccb4154160 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccba400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fccb406c120 con 0x7fccb41ecd10 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fccb415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fccb415a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35838/0 (socket says 172.21.15.144:35838) 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3400640 1 -- 172.21.15.144:0/3708325022 learned_addr learned my addr 172.21.15.144:0/3708325022 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3e00640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccb41ecd10 0x7fccb41578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb2a00640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb4154160 0x7fccb41ec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3400640 1 -- 172.21.15.144:0/3708325022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccb41ecd10 msgr2=0x7fccb41578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccb41ecd10 0x7fccb41578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3400640 1 -- 172.21.15.144:0/3708325022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb4154160 msgr2=0x7fccb41ec7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb4154160 0x7fccb41ec7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3400640 1 -- 172.21.15.144:0/3708325022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb415ad80 con 0x7fcc980039c0 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.489+0000 7fccb3400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fccb415a840 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fcca401ca90 tx=0x7fcca4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.493+0000 7fccab400640 1 -- 172.21.15.144:0/3708325022 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40ba070 con 0x7fcc980039c0 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.493+0000 7fccab400640 1 -- 172.21.15.144:0/3708325022 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40adb00 con 0x7fcc980039c0 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.493+0000 7fccba400640 1 -- 172.21.15.144:0/3708325022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb41fb520 con 0x7fcc980039c0 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.493+0000 7fccab400640 1 -- 172.21.15.144:0/3708325022 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b2040 con 0x7fcc980039c0 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.493+0000 7fccba400640 1 -- 172.21.15.144:0/3708325022 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb41fbae0 con 0x7fcc980039c0 2024-09-12T12:18:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.493+0000 7fccab400640 1 -- 172.21.15.144:0/3708325022 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcca40bd070 con 0x7fcc980039c0 2024-09-12T12:18:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.493+0000 7fccab400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcc940678f0 0x7fcc94069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.493+0000 7fccab400640 1 -- 172.21.15.144:0/3708325022 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fcca4120a10 con 0x7fcc980039c0 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.493+0000 7fccb2a00640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcc940678f0 0x7fcc94069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 Processor -- start 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb2a00640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcc940678f0 0x7fcc94069db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fccb41552a0 tx=0x7fcca0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- start start 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215aff840 0x55b215affc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 0x55b215ab5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 0x55b215ab63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b215903b20 con 0x55b215aff840 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b2158be870 con 0x55b215b00160 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b2158ffae0 con 0x55b215ab6000 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215aff840 0x55b215affc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215aff840 0x55b215affc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35854/0 (socket says 172.21.15.144:35854) 2024-09-12T12:18:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3400640 1 -- 172.21.15.144:0/3115027702 learned_addr learned my addr 172.21.15.144:0/3115027702 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3e00640 1 --2- 172.21.15.144:0/3115027702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 0x55b215ab63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb2a00640 1 --2- 172.21.15.144:0/3115027702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 0x55b215ab5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3400640 1 -- 172.21.15.144:0/3115027702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 msgr2=0x55b215ab63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3400640 1 --2- 172.21.15.144:0/3115027702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 0x55b215ab63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3400640 1 -- 172.21.15.144:0/3115027702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 msgr2=0x55b215ab5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3400640 1 --2- 172.21.15.144:0/3115027702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 0x55b215ab5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3400640 1 -- 172.21.15.144:0/3115027702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2158d6940 con 0x55b215aff840 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccb3400640 1 --2- 172.21.15.144:0/3115027702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215aff840 0x55b215affc20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ed0c0 tx=0x7fcca4009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c981af091c1192c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fcc9fe00640 1 -- 172.21.15.144:0/3115027702 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40c4070 con 0x55b215aff840 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fcc9fe00640 1 -- 172.21.15.144:0/3115027702 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40f9790 con 0x55b215aff840 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fcc9fe00640 1 -- 172.21.15.144:0/3115027702 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40eef60 con 0x55b215aff840 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- 172.21.15.144:0/3115027702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215aff840 msgr2=0x55b215affc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 --2- 172.21.15.144:0/3115027702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215aff840 0x55b215affc20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ed0c0 tx=0x7fcca4009d90 comp rx=0 tx=0).stop 2024-09-12T12:18:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- 172.21.15.144:0/3115027702 shutdown_connections 2024-09-12T12:18:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 --2- 172.21.15.144:0/3115027702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 0x55b215ab63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 --2- 172.21.15.144:0/3115027702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 0x55b215ab5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 --2- 172.21.15.144:0/3115027702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215aff840 0x55b215affc20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- 172.21.15.144:0/3115027702 >> 172.21.15.144:0/3115027702 conn(0x55b215abc160 msgr2=0x55b215ab43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- 172.21.15.144:0/3115027702 shutdown_connections 2024-09-12T12:18:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- 172.21.15.144:0/3115027702 wait complete. 2024-09-12T12:18:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 -- start start 2024-09-12T12:18:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.497+0000 7fccbd752000 1 Processor -- start 2024-09-12T12:18:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 0x55b215aff070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215aff840 0x55b215aba950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215abae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b2158d08e0 con 0x55b215b00160 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b2158a79b0 con 0x55b215aff840 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b2158cb260 con 0x55b215ab6000 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 10 client.0 _ll_register_callbacks cb 0x55b215aa1540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215abae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215abae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35866/0 (socket says 172.21.15.144:35866) 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3e00640 1 -- 172.21.15.144:0/3946408026 learned_addr learned my addr 172.21.15.144:0/3946408026 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3400640 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 0x55b215aff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb2a00640 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215aff840 0x55b215aba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3e00640 1 -- 172.21.15.144:0/3946408026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 msgr2=0x55b215aff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3e00640 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 0x55b215aff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3e00640 1 -- 172.21.15.144:0/3946408026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215aff840 msgr2=0x55b215aba950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3e00640 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215aff840 0x55b215aba950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3e00640 1 -- 172.21.15.144:0/3946408026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2158beac0 con 0x55b215b00160 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3e00640 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215abae90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fccb4069240 tx=0x7fccac011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3211fe9fae7fef43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fcc9cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3946408026 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac01b060 con 0x55b215b00160 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3946408026 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fccac016d70 con 0x55b215b00160 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 -- 172.21.15.144:0/3946408026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcca40f9790 con 0x55b215b00160 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3946408026 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fccac013540 con 0x55b215b00160 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 10 client.7431 fetch_fsmap learned FSMap version 80 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 -- 172.21.15.144:0/3946408026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x55b2158a3810 con 0x55b215b00160 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3946408026 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40f9790 con 0x55b215b00160 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3946408026 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7fccac0136e0 con 0x55b215b00160 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 10 client.7431 fetch_fsmap finished waiting for FSMap version 80 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 10 client.7431 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 20 client.7431 populate_metadata read hostname 'smithi144' 2024-09-12T12:18:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x55b215ac0ee0 0x55b215ac12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 4 client.7431 mds_command: new command op to 7347 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccbd752000 1 -- 172.21.15.144:0/3946408026 --> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b21589de30 con 0x55b215ac0ee0 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3400640 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x55b215ac0ee0 0x55b215ac12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fccb3400640 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x55b215ac0ee0 0x55b215ac12f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abcf35a8b25d79a1 server_cookie=d2cf07bfe0d2e63a in_seq=0 out_seq=0 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.501+0000 7fcc9cc00640 10 client.7431 ms_handle_connect on v2:172.21.15.144:6834/1676869896 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3946408026 <== mds.0 v2:172.21.15.144:6834/1676869896 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b21589de30 con 0x55b215ac0ee0 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fcc9cc00640 10 client.7431 handle_command_reply: tid=0 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 client.7431 shutdown 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 -- 172.21.15.144:0/3946408026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 msgr2=0x55b215abae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215abae90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fccb4069240 tx=0x7fccac011910 comp rx=0 tx=0).stop 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 -- 172.21.15.144:0/3946408026 shutdown_connections 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x55b215ac0ee0 0x55b215ac12f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215abae90 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215aff840 0x55b215aba950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 --2- 172.21.15.144:0/3946408026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215ab6000 0x55b215aff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fcc9cc00640 0 client.7431 ms_handle_reset on v2:172.21.15.144:6834/1676869896 2024-09-12T12:18:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 -- 172.21.15.144:0/3946408026 >> 172.21.15.144:0/3946408026 conn(0x55b215abc160 msgr2=0x55b215ab43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 -- 172.21.15.144:0/3946408026 shutdown_connections 2024-09-12T12:18:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 1 -- 172.21.15.144:0/3946408026 wait complete. 2024-09-12T12:18:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.505+0000 7fccbd752000 20 client.7431 trim_cache size 0 max 16384 2024-09-12T12:18:08.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccbd752000 1 Processor -- start 2024-09-12T12:18:08.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccbd752000 1 -- start start 2024-09-12T12:18:08.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccbd752000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215ab6000 0x55b215ab7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccbd752000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 0x55b215ab7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccbd752000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215b118f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccbd752000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fccb4205250 con 0x55b215b00160 2024-09-12T12:18:08.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccbd752000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fccb4204290 con 0x55b215ab6000 2024-09-12T12:18:08.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccbd752000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fccb4159c50 con 0x55b215aff840 2024-09-12T12:18:08.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215b118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215b118f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35882/0 (socket says 172.21.15.144:35882) 2024-09-12T12:18:08.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3e00640 1 -- 172.21.15.144:0/4196081026 learned_addr learned my addr 172.21.15.144:0/4196081026 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb2a00640 1 --2- 172.21.15.144:0/4196081026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 0x55b215ab7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3400640 1 --2- 172.21.15.144:0/4196081026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215ab6000 0x55b215ab7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3e00640 1 -- 172.21.15.144:0/4196081026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 msgr2=0x55b215ab7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3e00640 1 --2- 172.21.15.144:0/4196081026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 0x55b215ab7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3e00640 1 -- 172.21.15.144:0/4196081026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215ab6000 msgr2=0x55b215ab7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3e00640 1 --2- 172.21.15.144:0/4196081026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215ab6000 0x55b215ab7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3e00640 1 -- 172.21.15.144:0/4196081026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2158c1240 con 0x55b215b00160 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.521+0000 7fccb3e00640 1 --2- 172.21.15.144:0/4196081026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215b118f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fccac0019a0 tx=0x7fccac00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d3883eb5de3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fcc9f400640 1 -- 172.21.15.144:0/4196081026 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac001cf0 con 0x55b215b00160 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fcc9f400640 1 -- 172.21.15.144:0/4196081026 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccac008040 con 0x55b215b00160 2024-09-12T12:18:08.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fcc9f400640 1 -- 172.21.15.144:0/4196081026 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac0136e0 con 0x55b215b00160 2024-09-12T12:18:08.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- 172.21.15.144:0/4196081026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 msgr2=0x55b215b118f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 --2- 172.21.15.144:0/4196081026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215b118f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fccac0019a0 tx=0x7fccac00a000 comp rx=0 tx=0).stop 2024-09-12T12:18:08.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- 172.21.15.144:0/4196081026 shutdown_connections 2024-09-12T12:18:08.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 --2- 172.21.15.144:0/4196081026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215b00160 0x55b215b118f0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 --2- 172.21.15.144:0/4196081026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 0x55b215ab7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 --2- 172.21.15.144:0/4196081026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215ab6000 0x55b215ab7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- 172.21.15.144:0/4196081026 >> 172.21.15.144:0/4196081026 conn(0x55b215abc160 msgr2=0x55b215ab6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- 172.21.15.144:0/4196081026 shutdown_connections 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- 172.21.15.144:0/4196081026 wait complete. 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- start start 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 Processor -- start 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215ab6000 0x55b215b7a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 0x55b215b7ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 0x55b215b14b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b2158d0520 con 0x55b215ab6000 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fccb4203c70 con 0x55b215b00160 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b215902e30 con 0x55b215aff840 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 10 client.0 _ll_register_callbacks cb 0x7fccac0013e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:08.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215ab6000 0x55b215b7a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215ab6000 0x55b215b7a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35896/0 (socket says 172.21.15.144:35896) 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3400640 1 -- 172.21.15.144:0/3306978223 learned_addr learned my addr 172.21.15.144:0/3306978223 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3e00640 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 0x55b215b14b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb2a00640 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 0x55b215b7ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3400640 1 -- 172.21.15.144:0/3306978223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 msgr2=0x55b215b7ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3400640 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 0x55b215b7ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3400640 1 -- 172.21.15.144:0/3306978223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 msgr2=0x55b215b14b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3400640 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 0x55b215b14b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3400640 1 -- 172.21.15.144:0/3306978223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b215986330 con 0x55b215ab6000 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3e00640 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 0x55b215b14b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccb3400640 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215ab6000 0x55b215b7a900 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fcca40f0910 tx=0x7fcca40f0b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73405ade3f1bde48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fcc9cc00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:18:08.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3306978223 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40f9790 con 0x55b215ab6000 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3306978223 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fcca4110e00 con 0x55b215ab6000 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- 172.21.15.144:0/3306978223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccac008040 con 0x55b215ab6000 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3306978223 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fcca40ed2d0 con 0x55b215ab6000 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 10 client.7437 fetch_fsmap learned FSMap version 80 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.525+0000 7fccbd752000 1 -- 172.21.15.144:0/3306978223 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x55b2155be400 con 0x55b215ab6000 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3306978223 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccac008040 con 0x55b215ab6000 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3306978223 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7fcca40b5050 con 0x55b215ab6000 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 10 client.7437 fetch_fsmap finished waiting for FSMap version 80 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 10 client.7437 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 20 client.7437 populate_metadata read hostname 'smithi144' 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x55b215b15080 0x55b215b15490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 4 client.7437 mds_command: new command op to 7347 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-12T12:18:08.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 -- 172.21.15.144:0/3306978223 --> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x55b215911250 con 0x55b215b15080 2024-09-12T12:18:08.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccb2a00640 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x55b215b15080 0x55b215b15490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccb2a00640 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x55b215b15080 0x55b215b15490 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e1e96475bc3057 server_cookie=17d2b879b7501b5b in_seq=0 out_seq=0 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fcc9cc00640 10 client.7437 ms_handle_connect on v2:172.21.15.144:6834/1676869896 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fcc9cc00640 1 -- 172.21.15.144:0/3306978223 <== mds.0 v2:172.21.15.144:6834/1676869896 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b215911250 con 0x55b215b15080 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fcc9cc00640 10 client.7437 handle_command_reply: tid=0 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 client.7437 shutdown 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 -- 172.21.15.144:0/3306978223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215ab6000 msgr2=0x55b215b7a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215ab6000 0x55b215b7a900 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fcca40f0910 tx=0x7fcca40f0b60 comp rx=0 tx=0).stop 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 -- 172.21.15.144:0/3306978223 shutdown_connections 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b215b00160 0x55b215b14b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b215aff840 0x55b215b7ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.144:6834/1676869896,v1:172.21.15.144:6835/1676869896] conn(0x55b215b15080 0x55b215b15490 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 --2- 172.21.15.144:0/3306978223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b215ab6000 0x55b215b7a900 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fcc9cc00640 0 client.7437 ms_handle_reset on v2:172.21.15.144:6834/1676869896 2024-09-12T12:18:08.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 -- 172.21.15.144:0/3306978223 >> 172.21.15.144:0/3306978223 conn(0x55b215abc160 msgr2=0x55b215ab7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:08.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 -- 172.21.15.144:0/3306978223 shutdown_connections 2024-09-12T12:18:08.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 1 -- 172.21.15.144:0/3306978223 wait complete. 2024-09-12T12:18:08.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccbd752000 20 client.7437 trim_cache size 0 max 16384 2024-09-12T12:18:08.533 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:18:08.533 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:18:08.533 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "17e4e7b9-5b43-4209-982f-1ebd751aaff8", 2024-09-12T12:18:08.533 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:18:08.533 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:18:08.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 -- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcc940678f0 msgr2=0x7fcc94069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcc940678f0 0x7fcc94069db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fccb41552a0 tx=0x7fcca0009040 comp rx=0 tx=0).stop 2024-09-12T12:18:08.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 -- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 msgr2=0x7fccb415a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fccb415a840 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fcca401ca90 tx=0x7fcca4009750 comp rx=0 tx=0).stop 2024-09-12T12:18:08.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 -- 172.21.15.144:0/3708325022 shutdown_connections 2024-09-12T12:18:08.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcc940678f0 0x7fcc94069db0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccb41ecd10 0x7fccb41578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccb4154160 0x7fccb41ec7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 --2- 172.21.15.144:0/3708325022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc980039c0 0x7fccb415a840 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 -- 172.21.15.144:0/3708325022 >> 172.21.15.144:0/3708325022 conn(0x7fccb406cd20 msgr2=0x7fccb41600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:08.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 -- 172.21.15.144:0/3708325022 shutdown_connections 2024-09-12T12:18:08.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.529+0000 7fccba400640 1 -- 172.21.15.144:0/3708325022 wait complete. 2024-09-12T12:18:08.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:08.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.685+0000 7f54b0000640 1 Processor -- start 2024-09-12T12:18:08.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.685+0000 7f54b0000640 1 -- start start 2024-09-12T12:18:08.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54b0000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f54a815b0f0 0x7f54a815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54b0000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a80cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54b0000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a80b6660 con 0x7f54a80b6130 2024-09-12T12:18:08.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54b0000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f54a80b6940 con 0x7f54a815b0f0 2024-09-12T12:18:08.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54b0000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f54a80b6c20 con 0x7f54a815f9d0 2024-09-12T12:18:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54ae000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a80cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54ae000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a80cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:55410/0 (socket says 172.21.15.144:55410) 2024-09-12T12:18:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54ae000640 1 -- 172.21.15.144:0/2858450291 learned_addr learned my addr 172.21.15.144:0/2858450291 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54ad600640 1 --2- 172.21.15.144:0/2858450291 >> v2:172.21.15.165:3300/0 conn(0x7f54a815b0f0 0x7f54a815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54ae000640 1 -- 172.21.15.144:0/2858450291 >> v2:172.21.15.165:3300/0 conn(0x7f54a815b0f0 msgr2=0x7f54a815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54ae000640 1 --2- 172.21.15.144:0/2858450291 >> v2:172.21.15.165:3300/0 conn(0x7f54a815b0f0 0x7f54a815ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54ae000640 1 -- 172.21.15.144:0/2858450291 >> v1:172.21.15.165:6789/0 conn(0x7f54a80b6130 legacy=0x7f54a815f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.689+0000 7f54ae000640 1 -- 172.21.15.144:0/2858450291 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a80b6f00 con 0x7f54a815f9d0 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54ae000640 1 --2- 172.21.15.144:0/2858450291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a80cf8b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009870 tx=0x7f54a001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ccd8887c048d793 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54a7e00640 1 -- 172.21.15.144:0/2858450291 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a00a6040 con 0x7f54a815f9d0 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54a7e00640 1 -- 172.21.15.144:0/2858450291 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a00af070 con 0x7f54a815f9d0 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54a7e00640 1 -- 172.21.15.144:0/2858450291 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a00aa860 con 0x7f54a815f9d0 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 -- 172.21.15.144:0/2858450291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 msgr2=0x7f54a80cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 --2- 172.21.15.144:0/2858450291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a80cf8b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009870 tx=0x7f54a001c560 comp rx=0 tx=0).stop 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 -- 172.21.15.144:0/2858450291 shutdown_connections 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 --2- 172.21.15.144:0/2858450291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a80cf8b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 --2- 172.21.15.144:0/2858450291 >> v2:172.21.15.165:3300/0 conn(0x7f54a815b0f0 0x7f54a815ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 -- 172.21.15.144:0/2858450291 >> 172.21.15.144:0/2858450291 conn(0x7f54a806f8b0 msgr2=0x7f54a806fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:08.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 -- 172.21.15.144:0/2858450291 shutdown_connections 2024-09-12T12:18:08.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 -- 172.21.15.144:0/2858450291 wait complete. 2024-09-12T12:18:08.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 Processor -- start 2024-09-12T12:18:08.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.693+0000 7f54b0000640 1 -- start start 2024-09-12T12:18:08.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54b0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a80b6130 0x7f54a814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54b0000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54a815b0f0 0x7f54a815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54b0000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54b0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f54a80d0780 con 0x7f54a80b6130 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54b0000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f54a80d0600 con 0x7f54a815b0f0 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54b0000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f54a80d0900 con 0x7f54a815f9d0 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ad600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a80b6130 0x7f54a814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ad600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a80b6130 0x7f54a814bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35902/0 (socket says 172.21.15.144:35902) 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ad600640 1 -- 172.21.15.144:0/90790508 learned_addr learned my addr 172.21.15.144:0/90790508 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54acc00640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54a815b0f0 0x7f54a815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ae000640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ad600640 1 -- 172.21.15.144:0/90790508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 msgr2=0x7f54a815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ad600640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a815ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ad600640 1 -- 172.21.15.144:0/90790508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54a815b0f0 msgr2=0x7f54a815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ad600640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54a815b0f0 0x7f54a815b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ad600640 1 -- 172.21.15.144:0/90790508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a80af7f0 con 0x7f54a80b6130 2024-09-12T12:18:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54ad600640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a80b6130 0x7f54a814bdb0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f549c00efc0 tx=0x7f549c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54a5600640 1 -- 172.21.15.144:0/90790508 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c018020 con 0x7f54a80b6130 2024-09-12T12:18:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54a5600640 1 -- 172.21.15.144:0/90790508 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549c014480 con 0x7f54a80b6130 2024-09-12T12:18:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54a5600640 1 -- 172.21.15.144:0/90790508 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c014850 con 0x7f54a80b6130 2024-09-12T12:18:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a80afad0 con 0x7f54a80b6130 2024-09-12T12:18:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a80b0090 con 0x7f54a80b6130 2024-09-12T12:18:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a80cf8b0 con 0x7f54a80b6130 2024-09-12T12:18:08.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.697+0000 7f54a5600640 1 -- 172.21.15.144:0/90790508 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f549c01b020 con 0x7f54a80b6130 2024-09-12T12:18:08.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.701+0000 7f54a5600640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54880678c0 0x7f5488069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:08.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.701+0000 7f54a5600640 1 -- 172.21.15.144:0/90790508 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f549c086930 con 0x7f54a80b6130 2024-09-12T12:18:08.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.701+0000 7f54acc00640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54880678c0 0x7f5488069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:08.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.701+0000 7f54acc00640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54880678c0 0x7f5488069d80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f54a80b5910 tx=0x7f5494009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:08.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.705+0000 7f54a5600640 1 -- 172.21.15.144:0/90790508 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f549c022070 con 0x7f54a80b6130 2024-09-12T12:18:08.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.893+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54a814c2f0 con 0x7f54a80b6130 2024-09-12T12:18:08.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.893+0000 7f54a5600640 1 -- 172.21.15.144:0/90790508 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5239 (secure 0 0 0) 0x7f549c010040 con 0x7f54a80b6130 2024-09-12T12:18:08.895 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:08.895 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":80,"btime":"2024-09-12T12:18:04:401229+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:04.401224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7347,"qdb_cluster":[7347]},"id":6}]} 2024-09-12T12:18:08.895 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 80 2024-09-12T12:18:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54880678c0 msgr2=0x7f5488069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54880678c0 0x7f5488069d80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f54a80b5910 tx=0x7f5494009040 comp rx=0 tx=0).stop 2024-09-12T12:18:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a80b6130 msgr2=0x7f54a814bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a80b6130 0x7f54a814bdb0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f549c00efc0 tx=0x7f549c00c490 comp rx=0 tx=0).stop 2024-09-12T12:18:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 shutdown_connections 2024-09-12T12:18:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54880678c0 0x7f5488069d80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54a815f9d0 0x7f54a815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54a815b0f0 0x7f54a815b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 --2- 172.21.15.144:0/90790508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f54a80b6130 0x7f54a814bdb0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 >> 172.21.15.144:0/90790508 conn(0x7f54a806f8b0 msgr2=0x7f54a80734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 shutdown_connections 2024-09-12T12:18:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:08.897+0000 7f54b0000640 1 -- 172.21.15.144:0/90790508 wait complete. 2024-09-12T12:18:08.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-12T12:18:09.072 INFO:teuthology.orchestra.run.smithi144.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-12T12:17:59.018053+0000","btime":"2024-09-12T12:17:58.170062+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T12:17:59.018053+0000","atime":"2024-09-12T12:17:58.170062+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-12T12:17:59.018053+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:17:59.018053+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:17:59.018053+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-12T12:18:09.073 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-12T12:17:59.018053+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-12T12:17:58.170062+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-12T12:17:58.170062+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-12T12:17:59.018053+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-12T12:17:59.018053+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-12T12:17:59.018053+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-12T12:17:59.018053+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-12T12:18:09.073 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-12T12:18:13.293 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:18:13.296 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:18:14.074 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac9ce00640 1 Processor -- start 2024-09-12T12:18:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac9ce00640 1 -- start start 2024-09-12T12:18:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac9ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac9ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fac980b67c0 0x7fac980b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac9ce00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac98162720 con 0x7fac980d2e10 2024-09-12T12:18:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac9ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fac98073310 con 0x7fac980b67c0 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac9ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac98162a00 con 0x7fac9815e4a0 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac97400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac97400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98161e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:55430/0 (socket says 172.21.15.144:55430) 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac97400640 1 -- 172.21.15.144:0/90709779 learned_addr learned my addr 172.21.15.144:0/90709779 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac8fe00640 1 --1- 172.21.15.144:0/90709779 >> v1:172.21.15.165:6789/0 conn(0x7fac980d2e10 0x7fac980737a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:36424/0 (socket says 172.21.15.144:36424) 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac97e00640 1 --2- 172.21.15.144:0/90709779 >> v2:172.21.15.165:3300/0 conn(0x7fac980b67c0 0x7fac980b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac97400640 1 -- 172.21.15.144:0/90709779 >> v2:172.21.15.165:3300/0 conn(0x7fac980b67c0 msgr2=0x7fac980b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac97400640 1 --2- 172.21.15.144:0/90709779 >> v2:172.21.15.165:3300/0 conn(0x7fac980b67c0 0x7fac980b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac97400640 1 -- 172.21.15.144:0/90709779 >> v1:172.21.15.165:6789/0 conn(0x7fac980d2e10 legacy=0x7fac980737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.225+0000 7fac97400640 1 -- 172.21.15.144:0/90709779 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac98162ce0 con 0x7fac9815e4a0 2024-09-12T12:18:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac97400640 1 --2- 172.21.15.144:0/90709779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98161e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac88009870 tx=0x7fac8801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70811702941a33d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac96a00640 1 -- 172.21.15.144:0/90709779 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac880b2070 con 0x7fac9815e4a0 2024-09-12T12:18:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac96a00640 1 -- 172.21.15.144:0/90709779 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac880a9070 con 0x7fac9815e4a0 2024-09-12T12:18:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac96a00640 1 -- 172.21.15.144:0/90709779 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac880ad880 con 0x7fac9815e4a0 2024-09-12T12:18:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac9ce00640 1 -- 172.21.15.144:0/90709779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 msgr2=0x7fac98161e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac9ce00640 1 --2- 172.21.15.144:0/90709779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98161e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac88009870 tx=0x7fac8801c560 comp rx=0 tx=0).stop 2024-09-12T12:18:14.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac9ce00640 1 -- 172.21.15.144:0/90709779 shutdown_connections 2024-09-12T12:18:14.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac9ce00640 1 --2- 172.21.15.144:0/90709779 >> v2:172.21.15.165:3300/0 conn(0x7fac980b67c0 0x7fac980b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:14.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac9ce00640 1 --2- 172.21.15.144:0/90709779 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98161e90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:14.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac9ce00640 1 -- 172.21.15.144:0/90709779 >> 172.21.15.144:0/90709779 conn(0x7fac980d2280 msgr2=0x7fac980d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:14.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac9ce00640 1 -- 172.21.15.144:0/90709779 shutdown_connections 2024-09-12T12:18:14.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac9ce00640 1 -- 172.21.15.144:0/90709779 wait complete. 2024-09-12T12:18:14.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.229+0000 7fac9ce00640 1 Processor -- start 2024-09-12T12:18:14.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 -- start start 2024-09-12T12:18:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac980b67c0 0x7fac98143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac980d2e10 0x7fac98160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac9806d6b0 con 0x7fac980d2e10 2024-09-12T12:18:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac9806d530 con 0x7fac980b67c0 2024-09-12T12:18:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac9816b000 con 0x7fac9815e4a0 2024-09-12T12:18:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac980d2e10 0x7fac98160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac980d2e10 0x7fac98160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35908/0 (socket says 172.21.15.144:35908) 2024-09-12T12:18:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8fe00640 1 -- 172.21.15.144:0/4267237616 learned_addr learned my addr 172.21.15.144:0/4267237616 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac97400640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac980b67c0 0x7fac98143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac97e00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8fe00640 1 -- 172.21.15.144:0/4267237616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 msgr2=0x7fac98158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8fe00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8fe00640 1 -- 172.21.15.144:0/4267237616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac980b67c0 msgr2=0x7fac98143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8fe00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac980b67c0 0x7fac98143630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8fe00640 1 -- 172.21.15.144:0/4267237616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9815f500 con 0x7fac980d2e10 2024-09-12T12:18:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8fe00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac980d2e10 0x7fac98160450 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fac8000c340 tx=0x7fac8000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8f400640 1 -- 172.21.15.144:0/4267237616 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac800074e0 con 0x7fac980d2e10 2024-09-12T12:18:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8f400640 1 -- 172.21.15.144:0/4267237616 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac80007680 con 0x7fac980d2e10 2024-09-12T12:18:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac8f400640 1 -- 172.21.15.144:0/4267237616 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80004a30 con 0x7fac980d2e10 2024-09-12T12:18:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9815f7e0 con 0x7fac980d2e10 2024-09-12T12:18:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac98158160 con 0x7fac980d2e10 2024-09-12T12:18:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.233+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac980b6c40 con 0x7fac980d2e10 2024-09-12T12:18:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.237+0000 7fac8f400640 1 -- 172.21.15.144:0/4267237616 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac8001a020 con 0x7fac980d2e10 2024-09-12T12:18:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.237+0000 7fac8f400640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.237+0000 7fac8f400640 1 -- 172.21.15.144:0/4267237616 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fac800855f0 con 0x7fac980d2e10 2024-09-12T12:18:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.237+0000 7fac97400640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.237+0000 7fac97400640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fac880af000 tx=0x7fac880a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:14.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.241+0000 7fac8f400640 1 -- 172.21.15.144:0/4267237616 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fac800557b0 con 0x7fac980d2e10 2024-09-12T12:18:14.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.433+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac980d17e0 con 0x7fac980d2e10 2024-09-12T12:18:14.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.433+0000 7fac8f400640 1 -- 172.21.15.144:0/4267237616 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5239 (secure 0 0 0) 0x7fac80059ab0 con 0x7fac980d2e10 2024-09-12T12:18:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:14.435 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":80,"btime":"2024-09-12T12:18:04:401229+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:04.401224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7347,"qdb_cluster":[7347]},"id":6}]} 2024-09-12T12:18:14.435 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 80 2024-09-12T12:18:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 msgr2=0x7fac74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fac880af000 tx=0x7fac880a7000 comp rx=0 tx=0).stop 2024-09-12T12:18:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac980d2e10 msgr2=0x7fac98160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac980d2e10 0x7fac98160450 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fac8000c340 tx=0x7fac8000c800 comp rx=0 tx=0).stop 2024-09-12T12:18:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 shutdown_connections 2024-09-12T12:18:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9815e4a0 0x7fac98158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac980d2e10 0x7fac98160450 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 --2- 172.21.15.144:0/4267237616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac980b67c0 0x7fac98143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:14.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 >> 172.21.15.144:0/4267237616 conn(0x7fac980d2280 msgr2=0x7fac980b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:14.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 shutdown_connections 2024-09-12T12:18:14.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:14.437+0000 7fac9ce00640 1 -- 172.21.15.144:0/4267237616 wait complete. 2024-09-12T12:18:14.457 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-12T12:18:14.614 INFO:teuthology.orchestra.run.smithi144.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-12T12:17:59.018053+0000","btime":"2024-09-12T12:17:58.170062+0000","mode":16893,"uid":1000,"gid":1271,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-12T12:17:59.018053+0000","atime":"2024-09-12T12:17:58.170062+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-12T12:17:59.018053+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:17:59.018053+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-12T12:17:59.018053+0000"},"version":131,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-12T12:18:08.532313+0000","last_scrub_version":128,"symlink":"","xattrs":[],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-12T12:18:14.615 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-12T12:17:59.018053+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-12T12:17:58.170062+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-12T12:17:58.170062+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-12T12:17:59.018053+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-12T12:17:59.018053+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1271, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-12T12:18:08.532313+0000", "last_scrub_version": 128, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16893, "mtime": "2024-09-12T12:17:59.018053+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-12T12:17:59.018053+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 131, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2024-09-12T12:18:14.615 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T12:18:14.615 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:18:14.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:18:14.709 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:18:14.813 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:18:14.813 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:18:14.814 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:18:14.814 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:14.823 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:18:14.823 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:18:14.823 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:18:14.823 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:14.832 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:18:14.833 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:18:14.833 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:18:14.837 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:14.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:18:14.874 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:18:14.874 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:18:14.875 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:14.886 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:18:14.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:15.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.053+0000 7f5fd9600640 1 Processor -- start 2024-09-12T12:18:15.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.053+0000 7f5fd9600640 1 -- start start 2024-09-12T12:18:15.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd9600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd415e5f0 0x7f5fd406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd9600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5fd40b44a0 0x7f5fd40b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd9600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd406d260 con 0x7f5fd406e300 2024-09-12T12:18:15.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd9600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd40b6f60 con 0x7f5fd40b44a0 2024-09-12T12:18:15.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd9600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd40b7240 con 0x7f5fd415e5f0 2024-09-12T12:18:15.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5fd40b44a0 0x7f5fd40b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5fd40b44a0 0x7f5fd40b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35914/0 (socket says 172.21.15.144:35914) 2024-09-12T12:18:15.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd2000640 1 -- 172.21.15.144:0/1805933236 learned_addr learned my addr 172.21.15.144:0/1805933236 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:15.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd2a00640 1 --2- 172.21.15.144:0/1805933236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd415e5f0 0x7f5fd406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd2000640 1 -- 172.21.15.144:0/1805933236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd415e5f0 msgr2=0x7f5fd406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:15.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd2000640 1 --2- 172.21.15.144:0/1805933236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd415e5f0 0x7f5fd406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd2000640 1 -- 172.21.15.144:0/1805933236 >> v1:172.21.15.165:6789/0 conn(0x7f5fd406e300 legacy=0x7f5fd415ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd2000640 1 -- 172.21.15.144:0/1805933236 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd40b7520 con 0x7f5fd40b44a0 2024-09-12T12:18:15.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.057+0000 7f5fd2a00640 1 --2- 172.21.15.144:0/1805933236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd415e5f0 0x7f5fd406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:15.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd2000640 1 --2- 172.21.15.144:0/1805933236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd40b44a0 0x7f5fd40b48a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009870 tx=0x7f5fc001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61ab60eeee5a908 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:15.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd1600640 1 -- 172.21.15.144:0/1805933236 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00aa670 con 0x7f5fd40b44a0 2024-09-12T12:18:15.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd1600640 1 -- 172.21.15.144:0/1805933236 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc00af070 con 0x7f5fd40b44a0 2024-09-12T12:18:15.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd1600640 1 -- 172.21.15.144:0/1805933236 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00aaa30 con 0x7f5fd40b44a0 2024-09-12T12:18:15.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 -- 172.21.15.144:0/1805933236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd40b44a0 msgr2=0x7f5fd40b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 --2- 172.21.15.144:0/1805933236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd40b44a0 0x7f5fd40b48a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009870 tx=0x7f5fc001c530 comp rx=0 tx=0).stop 2024-09-12T12:18:15.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 -- 172.21.15.144:0/1805933236 shutdown_connections 2024-09-12T12:18:15.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 --2- 172.21.15.144:0/1805933236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd40b44a0 0x7f5fd40b48a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 --2- 172.21.15.144:0/1805933236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd415e5f0 0x7f5fd406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 -- 172.21.15.144:0/1805933236 >> 172.21.15.144:0/1805933236 conn(0x7f5fd406f400 msgr2=0x7f5fd406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:15.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 -- 172.21.15.144:0/1805933236 shutdown_connections 2024-09-12T12:18:15.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 -- 172.21.15.144:0/1805933236 wait complete. 2024-09-12T12:18:15.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 Processor -- start 2024-09-12T12:18:15.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 -- start start 2024-09-12T12:18:15.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd406e300 0x7f5fd4152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd40b44a0 0x7f5fd4154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd415e5f0 0x7f5fd414b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd406eb20 con 0x7f5fd415e5f0 2024-09-12T12:18:15.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40b6b90 con 0x7f5fd40b44a0 2024-09-12T12:18:15.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.061+0000 7f5fd9600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd4153da0 con 0x7f5fd406e300 2024-09-12T12:18:15.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd415e5f0 0x7f5fd414b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd406e300 0x7f5fd4152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd415e5f0 0x7f5fd414b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35918/0 (socket says 172.21.15.144:35918) 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd3400640 1 -- 172.21.15.144:0/2971436654 learned_addr learned my addr 172.21.15.144:0/2971436654 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd2000640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd40b44a0 0x7f5fd4154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd3400640 1 -- 172.21.15.144:0/2971436654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd406e300 msgr2=0x7f5fd4152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd3400640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd406e300 0x7f5fd4152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd3400640 1 -- 172.21.15.144:0/2971436654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd40b44a0 msgr2=0x7f5fd4154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd3400640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd40b44a0 0x7f5fd4154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd3400640 1 -- 172.21.15.144:0/2971436654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd4153190 con 0x7f5fd415e5f0 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd3400640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd415e5f0 0x7f5fd414b1f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c430 tx=0x7f5fcc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fcaa00640 1 -- 172.21.15.144:0/2971436654 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc005220 con 0x7f5fd415e5f0 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fcaa00640 1 -- 172.21.15.144:0/2971436654 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fcc0053c0 con 0x7f5fd415e5f0 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd4153470 con 0x7f5fd415e5f0 2024-09-12T12:18:15.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fcaa00640 1 -- 172.21.15.144:0/2971436654 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc007270 con 0x7f5fd415e5f0 2024-09-12T12:18:15.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd4153a30 con 0x7f5fd415e5f0 2024-09-12T12:18:15.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd414b790 con 0x7f5fd415e5f0 2024-09-12T12:18:15.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.065+0000 7f5fcaa00640 1 -- 172.21.15.144:0/2971436654 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5fcc019020 con 0x7f5fd415e5f0 2024-09-12T12:18:15.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.069+0000 7f5fcaa00640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5fb40678c0 0x7f5fb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.069+0000 7f5fcaa00640 1 -- 172.21.15.144:0/2971436654 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f5fcc0851b0 con 0x7f5fd415e5f0 2024-09-12T12:18:15.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.069+0000 7f5fd2a00640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5fb40678c0 0x7f5fb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.069+0000 7f5fd2a00640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5fb40678c0 0x7f5fb4069d80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5fd41fae00 tx=0x7f5fc40097f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:15.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.073+0000 7f5fcaa00640 1 -- 172.21.15.144:0/2971436654 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5fcc055410 con 0x7f5fd415e5f0 2024-09-12T12:18:15.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.269+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fd406cd20 con 0x7f5fd415e5f0 2024-09-12T12:18:15.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.269+0000 7f5fcaa00640 1 -- 172.21.15.144:0/2971436654 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5239 (secure 0 0 0) 0x7f5fcc059710 con 0x7f5fd415e5f0 2024-09-12T12:18:15.269 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:15.269 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":80,"btime":"2024-09-12T12:18:04:401229+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:04.401224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7347,"qdb_cluster":[7347]},"id":6}]} 2024-09-12T12:18:15.269 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 80 2024-09-12T12:18:15.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5fb40678c0 msgr2=0x7f5fb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5fb40678c0 0x7f5fb4069d80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5fd41fae00 tx=0x7f5fc40097f0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd415e5f0 msgr2=0x7f5fd414b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd415e5f0 0x7f5fd414b1f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c430 tx=0x7f5fcc00c8f0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 shutdown_connections 2024-09-12T12:18:15.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5fb40678c0 0x7f5fb4069d80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fd415e5f0 0x7f5fd414b1f0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fd40b44a0 0x7f5fd4154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 --2- 172.21.15.144:0/2971436654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5fd406e300 0x7f5fd4152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 >> 172.21.15.144:0/2971436654 conn(0x7f5fd406f400 msgr2=0x7f5fd40b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:15.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 shutdown_connections 2024-09-12T12:18:15.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.273+0000 7f5fd9600640 1 -- 172.21.15.144:0/2971436654 wait complete. 2024-09-12T12:18:15.290 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:15.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b2c00640 1 Processor -- start 2024-09-12T12:18:15.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b2c00640 1 -- start start 2024-09-12T12:18:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b2c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd3ac070490 0x7fd3ac0afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b2c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3ac0b0720 con 0x7fd3ac073760 2024-09-12T12:18:15.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b2c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3ac147a00 con 0x7fd3ac0b02d0 2024-09-12T12:18:15.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b2c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd3ac0b09e0 con 0x7fd3ac070490 2024-09-12T12:18:15.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd3ac070490 0x7fd3ac0afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b1800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd3ac073760 0x7fd3ac073b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47204/0 (socket says 172.21.15.144:47204) 2024-09-12T12:18:15.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b1800640 1 -- 172.21.15.144:0/2635227278 learned_addr learned my addr 172.21.15.144:0/2635227278 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:15.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b0e00640 1 -- 172.21.15.144:0/2635227278 >> v1:172.21.15.165:6789/0 conn(0x7fd3ac0b02d0 legacy=0x7fd3ac15e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b0e00640 1 -- 172.21.15.144:0/2635227278 >> v1:172.21.15.144:6789/0 conn(0x7fd3ac073760 legacy=0x7fd3ac073b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3b0e00640 1 -- 172.21.15.144:0/2635227278 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ac0b0cc0 con 0x7fd3ac070490 2024-09-12T12:18:15.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.429+0000 7fd3abe00640 1 -- 172.21.15.144:0/2635227278 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890023476 0 0) 0x7fd3ac0b0720 con 0x7fd3ac073760 2024-09-12T12:18:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b0e00640 1 --2- 172.21.15.144:0/2635227278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac070490 0x7fd3ac0afd90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd3980097f0 tx=0x7fd39801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5f44d633c4ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3abe00640 1 -- 172.21.15.144:0/2635227278 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3980a7070 con 0x7fd3ac070490 2024-09-12T12:18:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3abe00640 1 -- 172.21.15.144:0/2635227278 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3980b0070 con 0x7fd3ac070490 2024-09-12T12:18:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3abe00640 1 -- 172.21.15.144:0/2635227278 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3980ab890 con 0x7fd3ac070490 2024-09-12T12:18:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b2c00640 1 -- 172.21.15.144:0/2635227278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac070490 msgr2=0x7fd3ac0afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b2c00640 1 --2- 172.21.15.144:0/2635227278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac070490 0x7fd3ac0afd90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd3980097f0 tx=0x7fd39801c470 comp rx=0 tx=0).stop 2024-09-12T12:18:15.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b2c00640 1 -- 172.21.15.144:0/2635227278 shutdown_connections 2024-09-12T12:18:15.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b2c00640 1 --2- 172.21.15.144:0/2635227278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac070490 0x7fd3ac0afd90 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b2c00640 1 -- 172.21.15.144:0/2635227278 >> 172.21.15.144:0/2635227278 conn(0x7fd3ac06e200 msgr2=0x7fd3ac06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:15.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b2c00640 1 -- 172.21.15.144:0/2635227278 shutdown_connections 2024-09-12T12:18:15.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b2c00640 1 -- 172.21.15.144:0/2635227278 wait complete. 2024-09-12T12:18:15.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b2c00640 1 Processor -- start 2024-09-12T12:18:15.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.433+0000 7fd3b2c00640 1 -- start start 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3ac070490 0x7fd3ac13bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac073760 0x7fd3ac0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3ac0b02d0 0x7fd3ac0d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac147570 con 0x7fd3ac073760 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac1473f0 con 0x7fd3ac0b02d0 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3ac16bf80 con 0x7fd3ac070490 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac073760 0x7fd3ac0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac073760 0x7fd3ac0d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35932/0 (socket says 172.21.15.144:35932) 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b0e00640 1 -- 172.21.15.144:0/822629115 learned_addr learned my addr 172.21.15.144:0/822629115 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b1800640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3ac070490 0x7fd3ac13bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2200640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3ac0b02d0 0x7fd3ac0d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b0e00640 1 -- 172.21.15.144:0/822629115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3ac070490 msgr2=0x7fd3ac13bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b0e00640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3ac070490 0x7fd3ac13bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b0e00640 1 -- 172.21.15.144:0/822629115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3ac0b02d0 msgr2=0x7fd3ac0d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b0e00640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3ac0b02d0 0x7fd3ac0d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b0e00640 1 -- 172.21.15.144:0/822629115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ac13c530 con 0x7fd3ac073760 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b0e00640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac073760 0x7fd3ac0d11e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fd3980097f0 tx=0x7fd39801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3a9600640 1 -- 172.21.15.144:0/822629115 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398004220 con 0x7fd3ac073760 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3a9600640 1 -- 172.21.15.144:0/822629115 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3980043e0 con 0x7fd3ac073760 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3a9600640 1 -- 172.21.15.144:0/822629115 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398003860 con 0x7fd3ac073760 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3ac13c810 con 0x7fd3ac073760 2024-09-12T12:18:15.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3ac0b1430 con 0x7fd3ac073760 2024-09-12T12:18:15.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3ac0afd90 con 0x7fd3ac073760 2024-09-12T12:18:15.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.437+0000 7fd3a9600640 1 -- 172.21.15.144:0/822629115 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd398003a00 con 0x7fd3ac073760 2024-09-12T12:18:15.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.441+0000 7fd3a9600640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd38c0678c0 0x7fd38c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.441+0000 7fd3a9600640 1 -- 172.21.15.144:0/822629115 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fd398120820 con 0x7fd3ac073760 2024-09-12T12:18:15.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.441+0000 7fd3b1800640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd38c0678c0 0x7fd38c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.441+0000 7fd3b1800640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd38c0678c0 0x7fd38c069d80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0007a90 tx=0x7fd3a00079e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:15.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.445+0000 7fd3a9600640 1 -- 172.21.15.144:0/822629115 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd398016090 con 0x7fd3ac073760 2024-09-12T12:18:15.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.641+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3ac13c9e0 con 0x7fd3ac073760 2024-09-12T12:18:15.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.641+0000 7fd3a9600640 1 -- 172.21.15.144:0/822629115 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5239 (secure 0 0 0) 0x7fd3980f09e0 con 0x7fd3ac073760 2024-09-12T12:18:15.642 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:15.642 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":80,"btime":"2024-09-12T12:18:04:401229+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:04.401224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7347,"qdb_cluster":[7347]},"id":6}]} 2024-09-12T12:18:15.642 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 80 2024-09-12T12:18:15.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd38c0678c0 msgr2=0x7fd38c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd38c0678c0 0x7fd38c069d80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0007a90 tx=0x7fd3a00079e0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac073760 msgr2=0x7fd3ac0d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac073760 0x7fd3ac0d11e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fd3980097f0 tx=0x7fd39801acb0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 shutdown_connections 2024-09-12T12:18:15.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd38c0678c0 0x7fd38c069d80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3ac0b02d0 0x7fd3ac0d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3ac073760 0x7fd3ac0d11e0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 --2- 172.21.15.144:0/822629115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3ac070490 0x7fd3ac13bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 >> 172.21.15.144:0/822629115 conn(0x7fd3ac06e200 msgr2=0x7fd3ac0b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:15.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 shutdown_connections 2024-09-12T12:18:15.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.645+0000 7fd3b2c00640 1 -- 172.21.15.144:0/822629115 wait complete. 2024-09-12T12:18:15.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:18:15.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d1be00640 1 Processor -- start 2024-09-12T12:18:15.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d1be00640 1 -- start start 2024-09-12T12:18:15.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d1be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d140b55b0 0x7f1d140713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d1be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1406ec80 con 0x7f1d1406cd20 2024-09-12T12:18:15.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d1be00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d14074170 con 0x7f1d14161aa0 2024-09-12T12:18:15.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d1be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1406e490 con 0x7f1d140b55b0 2024-09-12T12:18:15.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d18a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1d140b55b0 0x7f1d140713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d19e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1d1406cd20 0x7f1d1406d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47218/0 (socket says 172.21.15.144:47218) 2024-09-12T12:18:15.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d19e00640 1 -- 172.21.15.144:0/346582851 learned_addr learned my addr 172.21.15.144:0/346582851 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:15.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d18a00640 1 -- 172.21.15.144:0/346582851 >> v1:172.21.15.165:6789/0 conn(0x7f1d14161aa0 legacy=0x7f1d14073a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d18a00640 1 -- 172.21.15.144:0/346582851 >> v1:172.21.15.144:6789/0 conn(0x7f1d1406cd20 legacy=0x7f1d1406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d18a00640 1 -- 172.21.15.144:0/346582851 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1406e6c0 con 0x7f1d140b55b0 2024-09-12T12:18:15.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.801+0000 7f1d13e00640 1 -- 172.21.15.144:0/346582851 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732780535 0 0) 0x7f1d1406ec80 con 0x7f1d1406cd20 2024-09-12T12:18:15.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d18a00640 1 --2- 172.21.15.144:0/346582851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 0x7f1d140713b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1d000097c0 tx=0x7f1d0001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34eca5c2e53b6cf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:15.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d13e00640 1 -- 172.21.15.144:0/346582851 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000b0070 con 0x7f1d140b55b0 2024-09-12T12:18:15.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d13e00640 1 -- 172.21.15.144:0/346582851 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d000ab600 con 0x7f1d140b55b0 2024-09-12T12:18:15.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d13e00640 1 -- 172.21.15.144:0/346582851 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000ab9d0 con 0x7f1d140b55b0 2024-09-12T12:18:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d1be00640 1 -- 172.21.15.144:0/346582851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 msgr2=0x7f1d140713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d1be00640 1 --2- 172.21.15.144:0/346582851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 0x7f1d140713b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1d000097c0 tx=0x7f1d0001c410 comp rx=0 tx=0).stop 2024-09-12T12:18:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d1be00640 1 -- 172.21.15.144:0/346582851 shutdown_connections 2024-09-12T12:18:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d1be00640 1 --2- 172.21.15.144:0/346582851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 0x7f1d140713b0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d1be00640 1 -- 172.21.15.144:0/346582851 >> 172.21.15.144:0/346582851 conn(0x7f1d140b42b0 msgr2=0x7f1d140b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d1be00640 1 -- 172.21.15.144:0/346582851 shutdown_connections 2024-09-12T12:18:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.805+0000 7f1d1be00640 1 -- 172.21.15.144:0/346582851 wait complete. 2024-09-12T12:18:15.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 Processor -- start 2024-09-12T12:18:15.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 -- start start 2024-09-12T12:18:15.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d1406cd20 0x7f1d141564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 0x7f1d1415e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d14161aa0 0x7f1d1415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1416c790 con 0x7f1d140b55b0 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1416c610 con 0x7f1d14161aa0 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1416c910 con 0x7f1d1406cd20 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d18a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 0x7f1d1415e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d18a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 0x7f1d1415e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35942/0 (socket says 172.21.15.144:35942) 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d18a00640 1 -- 172.21.15.144:0/614003267 learned_addr learned my addr 172.21.15.144:0/614003267 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d19400640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d1406cd20 0x7f1d141564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d19e00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d14161aa0 0x7f1d1415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d18a00640 1 -- 172.21.15.144:0/614003267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d1406cd20 msgr2=0x7f1d141564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d18a00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d1406cd20 0x7f1d141564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d18a00640 1 -- 172.21.15.144:0/614003267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d14161aa0 msgr2=0x7f1d1415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d18a00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d14161aa0 0x7f1d1415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d18a00640 1 -- 172.21.15.144:0/614003267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1415ac50 con 0x7f1d140b55b0 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d19e00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d14161aa0 0x7f1d1415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d18a00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 0x7f1d1415e400 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f1d000ae040 tx=0x7f1d0001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d11600640 1 -- 172.21.15.144:0/614003267 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000bc070 con 0x7f1d140b55b0 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d11600640 1 -- 172.21.15.144:0/614003267 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d000b1040 con 0x7f1d140b55b0 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d11600640 1 -- 172.21.15.144:0/614003267 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000b0050 con 0x7f1d140b55b0 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1415af30 con 0x7f1d140b55b0 2024-09-12T12:18:15.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.809+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d14156d50 con 0x7f1d140b55b0 2024-09-12T12:18:15.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.813+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d14071a80 con 0x7f1d140b55b0 2024-09-12T12:18:15.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.813+0000 7f1d11600640 1 -- 172.21.15.144:0/614003267 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d00004230 con 0x7f1d140b55b0 2024-09-12T12:18:15.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.813+0000 7f1d11600640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cf40678c0 0x7f1cf4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:15.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.813+0000 7f1d11600640 1 -- 172.21.15.144:0/614003267 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f1d0011fae0 con 0x7f1d140b55b0 2024-09-12T12:18:15.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.813+0000 7f1d19400640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cf40678c0 0x7f1cf4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:15.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.813+0000 7f1d19400640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cf40678c0 0x7f1cf4069d80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1d14074070 tx=0x7f1d08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:15.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.817+0000 7f1d11600640 1 -- 172.21.15.144:0/614003267 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d00016090 con 0x7f1d140b55b0 2024-09-12T12:18:15.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d14154ba0 con 0x7f1d140b55b0 2024-09-12T12:18:15.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d11600640 1 -- 172.21.15.144:0/614003267 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+17359 (secure 0 0 0) 0x7f1d000efca0 con 0x7f1d140b55b0 2024-09-12T12:18:15.976 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:15.977 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":102,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:18:00.380258+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:48.264337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:49.548510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6834/76101968":"2024-09-13T12:18:00.380227+0000","172.21.15.144:6837/736758853":"2024-09-13T12:18:00.365431+0000","172.21.15.144:6835/736758853":"2024-09-13T12:18:00.365431+0000","172.21.15.165:6835/2978712683":"2024-09-13T12:18:00.354946+0000","172.21.15.144:6836/76101968":"2024-09-13T12:18:00.380227+0000","172.21.15.165:6832/2978712683":"2024-09-13T12:18:00.354946+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:18:15.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cf40678c0 msgr2=0x7f1cf4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cf40678c0 0x7f1cf4069d80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1d14074070 tx=0x7f1d08009040 comp rx=0 tx=0).stop 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 msgr2=0x7f1d1415e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 0x7f1d1415e400 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f1d000ae040 tx=0x7f1d0001ac50 comp rx=0 tx=0).stop 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 shutdown_connections 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1cf40678c0 0x7f1cf4069d80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d14161aa0 0x7f1d1415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d140b55b0 0x7f1d1415e400 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 --2- 172.21.15.144:0/614003267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d1406cd20 0x7f1d141564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 >> 172.21.15.144:0/614003267 conn(0x7f1d140b42b0 msgr2=0x7f1d14160020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 shutdown_connections 2024-09-12T12:18:15.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:15.977+0000 7f1d1be00640 1 -- 172.21.15.144:0/614003267 wait complete. 2024-09-12T12:18:15.999 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:18:15.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:16.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.133+0000 7fc5aac00640 1 Processor -- start 2024-09-12T12:18:16.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.133+0000 7fc5aac00640 1 -- start start 2024-09-12T12:18:16.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5aac00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5a415b4e0 0x7fc5a40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5aac00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc5a40ccf30 0x7fc5a40cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5aac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a40b45a0 con 0x7fc5a40b3ad0 2024-09-12T12:18:16.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5aac00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a40cd8a0 con 0x7fc5a415b4e0 2024-09-12T12:18:16.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5aac00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a40b3fe0 con 0x7fc5a40ccf30 2024-09-12T12:18:16.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5a415b4e0 0x7fc5a40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5a415b4e0 0x7fc5a40b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35954/0 (socket says 172.21.15.144:35954) 2024-09-12T12:18:16.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5a3e00640 1 -- 172.21.15.144:0/1131042829 learned_addr learned my addr 172.21.15.144:0/1131042829 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:16.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5a8c00640 1 --2- 172.21.15.144:0/1131042829 >> v2:172.21.15.165:3300/0 conn(0x7fc5a40ccf30 0x7fc5a40cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5a3e00640 1 -- 172.21.15.144:0/1131042829 >> v2:172.21.15.165:3300/0 conn(0x7fc5a40ccf30 msgr2=0x7fc5a40cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:16.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5a3e00640 1 --2- 172.21.15.144:0/1131042829 >> v2:172.21.15.165:3300/0 conn(0x7fc5a40ccf30 0x7fc5a40cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5a3e00640 1 -- 172.21.15.144:0/1131042829 >> v1:172.21.15.165:6789/0 conn(0x7fc5a40b3ad0 legacy=0x7fc5a4071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:16.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.137+0000 7fc5a3e00640 1 -- 172.21.15.144:0/1131042829 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a40b42c0 con 0x7fc5a415b4e0 2024-09-12T12:18:16.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5a3e00640 1 --2- 172.21.15.144:0/1131042829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a415b4e0 0x7fc5a40b3590 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40b3ef0 tx=0x7fc59401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5a23325013c528 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:16.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5a2a00640 1 -- 172.21.15.144:0/1131042829 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5940b4070 con 0x7fc5a415b4e0 2024-09-12T12:18:16.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5a2a00640 1 -- 172.21.15.144:0/1131042829 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5940a7c50 con 0x7fc5a415b4e0 2024-09-12T12:18:16.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5a2a00640 1 -- 172.21.15.144:0/1131042829 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5940af440 con 0x7fc5a415b4e0 2024-09-12T12:18:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 -- 172.21.15.144:0/1131042829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a415b4e0 msgr2=0x7fc5a40b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 --2- 172.21.15.144:0/1131042829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a415b4e0 0x7fc5a40b3590 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40b3ef0 tx=0x7fc59401eb80 comp rx=0 tx=0).stop 2024-09-12T12:18:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 -- 172.21.15.144:0/1131042829 shutdown_connections 2024-09-12T12:18:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 --2- 172.21.15.144:0/1131042829 >> v2:172.21.15.165:3300/0 conn(0x7fc5a40ccf30 0x7fc5a40cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 --2- 172.21.15.144:0/1131042829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a415b4e0 0x7fc5a40b3590 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 -- 172.21.15.144:0/1131042829 >> 172.21.15.144:0/1131042829 conn(0x7fc5a406d0d0 msgr2=0x7fc5a406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 -- 172.21.15.144:0/1131042829 shutdown_connections 2024-09-12T12:18:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 -- 172.21.15.144:0/1131042829 wait complete. 2024-09-12T12:18:16.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 Processor -- start 2024-09-12T12:18:16.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 -- start start 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5a40b3ad0 0x7fc5a40d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a40ccf30 0x7fc5a40d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5a415b4e0 0x7fc5a4162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a415b8c0 con 0x7fc5a40ccf30 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a40cdef0 con 0x7fc5a415b4e0 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5aac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a4161340 con 0x7fc5a40b3ad0 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5a3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a40ccf30 0x7fc5a40d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5a3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a40ccf30 0x7fc5a40d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35964/0 (socket says 172.21.15.144:35964) 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.141+0000 7fc5a3400640 1 -- 172.21.15.144:0/1908784481 learned_addr learned my addr 172.21.15.144:0/1908784481 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5a3e00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5a40b3ad0 0x7fc5a40d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5a8c00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5a415b4e0 0x7fc5a4162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5a3400640 1 -- 172.21.15.144:0/1908784481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5a40b3ad0 msgr2=0x7fc5a40d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5a3400640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5a40b3ad0 0x7fc5a40d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5a3400640 1 -- 172.21.15.144:0/1908784481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5a415b4e0 msgr2=0x7fc5a4162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5a3400640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5a415b4e0 0x7fc5a4162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5a3400640 1 -- 172.21.15.144:0/1908784481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a41602a0 con 0x7fc5a40ccf30 2024-09-12T12:18:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5a3e00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5a40b3ad0 0x7fc5a40d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5a3400640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a40ccf30 0x7fc5a40d0ee0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c480 tx=0x7fc59000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc59be00640 1 -- 172.21.15.144:0/1908784481 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590012830 con 0x7fc5a40ccf30 2024-09-12T12:18:16.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc59be00640 1 -- 172.21.15.144:0/1908784481 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc590017070 con 0x7fc5a40ccf30 2024-09-12T12:18:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc59be00640 1 -- 172.21.15.144:0/1908784481 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590012c30 con 0x7fc5a40ccf30 2024-09-12T12:18:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a4160580 con 0x7fc5a40ccf30 2024-09-12T12:18:16.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a4160b40 con 0x7fc5a40ccf30 2024-09-12T12:18:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a4161ee0 con 0x7fc5a40ccf30 2024-09-12T12:18:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc59be00640 1 -- 172.21.15.144:0/1908784481 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc59001c460 con 0x7fc5a40ccf30 2024-09-12T12:18:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc59be00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc5840678c0 0x7fc584069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.145+0000 7fc59be00640 1 -- 172.21.15.144:0/1908784481 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fc590085de0 con 0x7fc5a40ccf30 2024-09-12T12:18:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.149+0000 7fc5a3e00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc5840678c0 0x7fc584069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.149+0000 7fc5a3e00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc5840678c0 0x7fc584069d80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc5940b1000 tx=0x7fc594008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:16.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.149+0000 7fc59be00640 1 -- 172.21.15.144:0/1908784481 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc590056680 con 0x7fc5a40ccf30 2024-09-12T12:18:16.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.337+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5a40686c0 con 0x7fc5a40ccf30 2024-09-12T12:18:16.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc59be00640 1 -- 172.21.15.144:0/1908784481 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5239 (secure 0 0 0) 0x7fc590055f80 con 0x7fc5a40ccf30 2024-09-12T12:18:16.340 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:16.340 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":80,"btime":"2024-09-12T12:18:04:401229+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:04.401224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7347,"qdb_cluster":[7347]},"id":6}]} 2024-09-12T12:18:16.340 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 80 2024-09-12T12:18:16.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc5840678c0 msgr2=0x7fc584069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc5840678c0 0x7fc584069d80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc5940b1000 tx=0x7fc594008040 comp rx=0 tx=0).stop 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a40ccf30 msgr2=0x7fc5a40d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a40ccf30 0x7fc5a40d0ee0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c480 tx=0x7fc59000c940 comp rx=0 tx=0).stop 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 shutdown_connections 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc5840678c0 0x7fc584069d80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5a415b4e0 0x7fc5a4162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5a40ccf30 0x7fc5a40d0ee0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 --2- 172.21.15.144:0/1908784481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5a40b3ad0 0x7fc5a40d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 >> 172.21.15.144:0/1908784481 conn(0x7fc5a406d0d0 msgr2=0x7fc5a415c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 shutdown_connections 2024-09-12T12:18:16.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.341+0000 7fc5aac00640 1 -- 172.21.15.144:0/1908784481 wait complete. 2024-09-12T12:18:16.360 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:16.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.497+0000 7f6de2a00640 1 Processor -- start 2024-09-12T12:18:16.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.497+0000 7f6de2a00640 1 -- start start 2024-09-12T12:18:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6ddc0b49e0 0x7f6ddc15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b3590 0x7f6ddc0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de2a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ddc0b3aa0 con 0x7f6ddc15ad50 2024-09-12T12:18:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6ddc15f860 con 0x7f6ddc0b49e0 2024-09-12T12:18:16.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ddc0cdeb0 con 0x7f6ddc0b3590 2024-09-12T12:18:16.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de0a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b3590 0x7f6ddc0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de0a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b3590 0x7f6ddc0b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:55506/0 (socket says 172.21.15.144:55506) 2024-09-12T12:18:16.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de0a00640 1 -- 172.21.15.144:0/1116749922 learned_addr learned my addr 172.21.15.144:0/1116749922 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6ddb400640 1 --2- 172.21.15.144:0/1116749922 >> v2:172.21.15.165:3300/0 conn(0x7f6ddc0b49e0 0x7f6ddc15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6ddbe00640 1 --1- 172.21.15.144:0/1116749922 >> v1:172.21.15.165:6789/0 conn(0x7f6ddc15ad50 0x7f6ddc0b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:36474/0 (socket says 172.21.15.144:36474) 2024-09-12T12:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de0a00640 1 -- 172.21.15.144:0/1116749922 >> v2:172.21.15.165:3300/0 conn(0x7f6ddc0b49e0 msgr2=0x7f6ddc15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de0a00640 1 --2- 172.21.15.144:0/1116749922 >> v2:172.21.15.165:3300/0 conn(0x7f6ddc0b49e0 0x7f6ddc15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6ddaa00640 1 -- 172.21.15.144:0/1116749922 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561574753 0 0) 0x7f6ddc0b3aa0 con 0x7f6ddc15ad50 2024-09-12T12:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de0a00640 1 -- 172.21.15.144:0/1116749922 >> v1:172.21.15.165:6789/0 conn(0x7f6ddc15ad50 legacy=0x7f6ddc0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6de0a00640 1 -- 172.21.15.144:0/1116749922 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc0afc10 con 0x7f6ddc0b3590 2024-09-12T12:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.501+0000 7f6ddb400640 1 --2- 172.21.15.144:0/1116749922 >> v2:172.21.15.165:3300/0 conn(0x7f6ddc0b49e0 0x7f6ddc15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:16.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de0a00640 1 --2- 172.21.15.144:0/1116749922 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b3590 0x7f6ddc0b06f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006fd0 tx=0x7f6dd401e9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=148b8433d4fb29c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:16.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6ddaa00640 1 -- 172.21.15.144:0/1116749922 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40ad070 con 0x7f6ddc0b3590 2024-09-12T12:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6ddaa00640 1 -- 172.21.15.144:0/1116749922 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd4004230 con 0x7f6ddc0b3590 2024-09-12T12:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6ddaa00640 1 -- 172.21.15.144:0/1116749922 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd40a7730 con 0x7f6ddc0b3590 2024-09-12T12:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 -- 172.21.15.144:0/1116749922 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b3590 msgr2=0x7f6ddc0b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 --2- 172.21.15.144:0/1116749922 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b3590 0x7f6ddc0b06f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006fd0 tx=0x7f6dd401e9f0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 -- 172.21.15.144:0/1116749922 shutdown_connections 2024-09-12T12:18:16.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 --2- 172.21.15.144:0/1116749922 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b3590 0x7f6ddc0b06f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 --2- 172.21.15.144:0/1116749922 >> v2:172.21.15.165:3300/0 conn(0x7f6ddc0b49e0 0x7f6ddc15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 -- 172.21.15.144:0/1116749922 >> 172.21.15.144:0/1116749922 conn(0x7f6ddc06d0d0 msgr2=0x7f6ddc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:16.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 -- 172.21.15.144:0/1116749922 shutdown_connections 2024-09-12T12:18:16.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 -- 172.21.15.144:0/1116749922 wait complete. 2024-09-12T12:18:16.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 Processor -- start 2024-09-12T12:18:16.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.505+0000 7f6de2a00640 1 -- start start 2024-09-12T12:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ddc0b3590 0x7f6ddc1505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b49e0 0x7f6ddc0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ddc15ad50 0x7f6ddc1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc0b0db0 con 0x7f6ddc0b3590 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc0b0c30 con 0x7f6ddc15ad50 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ddc0b0f30 con 0x7f6ddc0b49e0 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ddc0b3590 0x7f6ddc1505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ddc0b3590 0x7f6ddc1505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35974/0 (socket says 172.21.15.144:35974) 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddbe00640 1 -- 172.21.15.144:0/194253414 learned_addr learned my addr 172.21.15.144:0/194253414 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddb400640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b49e0 0x7f6ddc0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de0a00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ddc15ad50 0x7f6ddc1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddbe00640 1 -- 172.21.15.144:0/194253414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b49e0 msgr2=0x7f6ddc0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddbe00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b49e0 0x7f6ddc0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddbe00640 1 -- 172.21.15.144:0/194253414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ddc15ad50 msgr2=0x7f6ddc1511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddbe00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ddc15ad50 0x7f6ddc1511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddbe00640 1 -- 172.21.15.144:0/194253414 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc071940 con 0x7f6ddc0b3590 2024-09-12T12:18:16.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de0a00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ddc15ad50 0x7f6ddc1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:16.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6ddbe00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ddc0b3590 0x7f6ddc1505a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00c780 tx=0x7f6dcc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6dd3e00640 1 -- 172.21.15.144:0/194253414 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc018070 con 0x7f6ddc0b3590 2024-09-12T12:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6dd3e00640 1 -- 172.21.15.144:0/194253414 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dcc00a640 con 0x7f6ddc0b3590 2024-09-12T12:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6dd3e00640 1 -- 172.21.15.144:0/194253414 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00aab0 con 0x7f6ddc0b3590 2024-09-12T12:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ddc1537e0 con 0x7f6ddc0b3590 2024-09-12T12:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ddc153da0 con 0x7f6ddc0b3590 2024-09-12T12:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ddc0b06f0 con 0x7f6ddc0b3590 2024-09-12T12:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.509+0000 7f6dd3e00640 1 -- 172.21.15.144:0/194253414 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6dcc00ac50 con 0x7f6ddc0b3590 2024-09-12T12:18:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.513+0000 7f6dd3e00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6dbc0678c0 0x7f6dbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.513+0000 7f6dd3e00640 1 -- 172.21.15.144:0/194253414 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f6dcc085640 con 0x7f6ddc0b3590 2024-09-12T12:18:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.513+0000 7f6ddb400640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6dbc0678c0 0x7f6dbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.513+0000 7f6ddb400640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6dbc0678c0 0x7f6dbc069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009580 tx=0x7f6dc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.517+0000 7f6dd3e00640 1 -- 172.21.15.144:0/194253414 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6dcc055e50 con 0x7f6ddc0b3590 2024-09-12T12:18:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.705+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ddc0d0060 con 0x7f6ddc0b3590 2024-09-12T12:18:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.705+0000 7f6dd3e00640 1 -- 172.21.15.144:0/194253414 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5239 (secure 0 0 0) 0x7f6dcc055750 con 0x7f6ddc0b3590 2024-09-12T12:18:16.707 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:16.707 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":80,"btime":"2024-09-12T12:18:04:401229+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:17:50.543209+0000","modified":"2024-09-12T12:18:04.401224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6835/1676869896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1676869896},{"type":"v1","addr":"172.21.15.144:6835","nonce":1676869896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7347,"qdb_cluster":[7347]},"id":6}]} 2024-09-12T12:18:16.707 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 80 2024-09-12T12:18:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6dbc0678c0 msgr2=0x7f6dbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6dbc0678c0 0x7f6dbc069d80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009580 tx=0x7f6dc8008040 comp rx=0 tx=0).stop 2024-09-12T12:18:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ddc0b3590 msgr2=0x7f6ddc1505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ddc0b3590 0x7f6ddc1505a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00c780 tx=0x7f6dcc00cc40 comp rx=0 tx=0).stop 2024-09-12T12:18:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 shutdown_connections 2024-09-12T12:18:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6dbc0678c0 0x7f6dbc069d80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ddc15ad50 0x7f6ddc1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ddc0b49e0 0x7f6ddc0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 --2- 172.21.15.144:0/194253414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ddc0b3590 0x7f6ddc1505a0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 >> 172.21.15.144:0/194253414 conn(0x7f6ddc06d0d0 msgr2=0x7f6ddc14d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 shutdown_connections 2024-09-12T12:18:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.709+0000 7f6de2a00640 1 -- 172.21.15.144:0/194253414 wait complete. 2024-09-12T12:18:16.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:18:16.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.865+0000 7fb808200640 1 Processor -- start 2024-09-12T12:18:16.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.865+0000 7fb808200640 1 -- start start 2024-09-12T12:18:16.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.865+0000 7fb808200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb80015cd30 0x7fb8000b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.865+0000 7fb808200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8000cd870 con 0x7fb80015c7b0 2024-09-12T12:18:16.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.865+0000 7fb808200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8000cdb50 con 0x7fb8000b5de0 2024-09-12T12:18:16.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.865+0000 7fb808200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb800072a50 con 0x7fb80015cd30 2024-09-12T12:18:16.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.865+0000 7fb805800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb80015c7b0 0x7fb8000ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47224/0 (socket says 172.21.15.144:47224) 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.865+0000 7fb805800640 1 -- 172.21.15.144:0/581130402 learned_addr learned my addr 172.21.15.144:0/581130402 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 663160844 0 0) 0x7fb8000cd870 con 0x7fb80015c7b0 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e8003530 con 0x7fb80015c7b0 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb804e00640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb80015cd30 0x7fb8000b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3916996050 0 0) 0x7fb7e8003530 con 0x7fb80015c7b0 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb80015cd30 msgr2=0x7fb8000b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb80015cd30 0x7fb8000b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 >> v1:172.21.15.165:6789/0 conn(0x7fb8000b5de0 legacy=0x7fb800072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8000726e0 con 0x7fb80015c7b0 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fb7f4001a00 con 0x7fb80015c7b0 2024-09-12T12:18:16.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 >> v1:172.21.15.144:6789/0 conn(0x7fb80015c7b0 legacy=0x7fb8000ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80039f0 0x7fb7e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7e8004810 0x7fb7e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb80015cd30 0x7fb7e80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb800072a50 con 0x7fb7e80039f0 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e800bab0 con 0x7fb7e8004810 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e800bcb0 con 0x7fb80015cd30 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb805800640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80039f0 0x7fb7e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb804e00640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7e8004810 0x7fb7e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb806200640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb80015cd30 0x7fb7e80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb805800640 1 -- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb80015cd30 msgr2=0x7fb7e80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:16.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb805800640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb80015cd30 0x7fb7e80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb805800640 1 -- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7e8004810 msgr2=0x7fb7e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:16.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb805800640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7e8004810 0x7fb7e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.869+0000 7fb805800640 1 -- 172.21.15.144:0/581130402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8003530 con 0x7fb7e80039f0 2024-09-12T12:18:16.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb805800640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80039f0 0x7fb7e8003e10 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400a830 tx=0x7fb7f401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa933ca4a6d08d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:16.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f400a480 con 0x7fb7e80039f0 2024-09-12T12:18:16.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f40ad630 con 0x7fb7e80039f0 2024-09-12T12:18:16.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb7ffe00640 1 -- 172.21.15.144:0/581130402 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40ada00 con 0x7fb7e80039f0 2024-09-12T12:18:16.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 -- 172.21.15.144:0/581130402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80039f0 msgr2=0x7fb7e8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 --2- 172.21.15.144:0/581130402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7e80039f0 0x7fb7e8003e10 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400a830 tx=0x7fb7f401d340 comp rx=0 tx=0).stop 2024-09-12T12:18:16.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb806200640 1 -- 172.21.15.144:0/581130402 reap_dead start 2024-09-12T12:18:16.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 -- 172.21.15.144:0/581130402 shutdown_connections 2024-09-12T12:18:16.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 -- 172.21.15.144:0/581130402 >> 172.21.15.144:0/581130402 conn(0x7fb80006d0d0 msgr2=0x7fb80006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:16.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 -- 172.21.15.144:0/581130402 shutdown_connections 2024-09-12T12:18:16.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 -- 172.21.15.144:0/581130402 wait complete. 2024-09-12T12:18:16.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 Processor -- start 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 -- start start 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7e80039f0 0x7fb800150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8001fbdd0 0x7fb800153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8000af210 0x7fb800155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb8000741d0 con 0x7fb8001fbdd0 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb800074050 con 0x7fb7e80039f0 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb808200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb8000cd610 con 0x7fb8000af210 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.873+0000 7fb804e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8001fbdd0 0x7fb800153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb804e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8001fbdd0 0x7fb800153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35994/0 (socket says 172.21.15.144:35994) 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb804e00640 1 -- 172.21.15.144:0/706265801 learned_addr learned my addr 172.21.15.144:0/706265801 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:16.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb806200640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8000af210 0x7fb800155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb805800640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7e80039f0 0x7fb800150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb804e00640 1 -- 172.21.15.144:0/706265801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8000af210 msgr2=0x7fb800155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb804e00640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8000af210 0x7fb800155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb804e00640 1 -- 172.21.15.144:0/706265801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7e80039f0 msgr2=0x7fb800150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb804e00640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7e80039f0 0x7fb800150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb804e00640 1 -- 172.21.15.144:0/706265801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb800153e60 con 0x7fb8001fbdd0 2024-09-12T12:18:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb804e00640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8001fbdd0 0x7fb800153530 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec011640 tx=0x7fb7ec011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb7fd600640 1 -- 172.21.15.144:0/706265801 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00f920 con 0x7fb8001fbdd0 2024-09-12T12:18:16.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb7fd600640 1 -- 172.21.15.144:0/706265801 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00fac0 con 0x7fb8001fbdd0 2024-09-12T12:18:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb7fd600640 1 -- 172.21.15.144:0/706265801 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00fe70 con 0x7fb8001fbdd0 2024-09-12T12:18:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8001fb2f0 con 0x7fb8001fbdd0 2024-09-12T12:18:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8001fb8b0 con 0x7fb8001fbdd0 2024-09-12T12:18:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8000ccf00 con 0x7fb8001fbdd0 2024-09-12T12:18:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb7fd600640 1 -- 172.21.15.144:0/706265801 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7ec015460 con 0x7fb8001fbdd0 2024-09-12T12:18:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.877+0000 7fb7fd600640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7e00678c0 0x7fb7e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.881+0000 7fb7fd600640 1 -- 172.21.15.144:0/706265801 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7fb7ec086710 con 0x7fb8001fbdd0 2024-09-12T12:18:16.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.881+0000 7fb805800640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7e00678c0 0x7fb7e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:16.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.881+0000 7fb805800640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7e00678c0 0x7fb7e0069d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ad000 tx=0x7fb7f40a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:16.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:16.881+0000 7fb7fd600640 1 -- 172.21.15.144:0/706265801 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7ec019030 con 0x7fb8001fbdd0 2024-09-12T12:18:17.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.041+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8000afeb0 con 0x7fb8001fbdd0 2024-09-12T12:18:17.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.041+0000 7fb7fd600640 1 -- 172.21.15.144:0/706265801 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+17359 (secure 0 0 0) 0x7fb7ec056960 con 0x7fb8001fbdd0 2024-09-12T12:18:17.042 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:17.043 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":102,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:18:00.380258+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:17:48.264337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T12:17:49.548510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6834/76101968":"2024-09-13T12:18:00.380227+0000","172.21.15.144:6837/736758853":"2024-09-13T12:18:00.365431+0000","172.21.15.144:6835/736758853":"2024-09-13T12:18:00.365431+0000","172.21.15.165:6835/2978712683":"2024-09-13T12:18:00.354946+0000","172.21.15.144:6836/76101968":"2024-09-13T12:18:00.380227+0000","172.21.15.165:6832/2978712683":"2024-09-13T12:18:00.354946+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7e00678c0 msgr2=0x7fb7e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7e00678c0 0x7fb7e0069d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ad000 tx=0x7fb7f40a7000 comp rx=0 tx=0).stop 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8001fbdd0 msgr2=0x7fb800153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8001fbdd0 0x7fb800153530 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec011640 tx=0x7fb7ec011b00 comp rx=0 tx=0).stop 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 shutdown_connections 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7e00678c0 0x7fb7e0069d80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8000af210 0x7fb800155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8001fbdd0 0x7fb800153530 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 --2- 172.21.15.144:0/706265801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7e80039f0 0x7fb800150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 >> 172.21.15.144:0/706265801 conn(0x7fb80006d0d0 msgr2=0x7fb8000b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 shutdown_connections 2024-09-12T12:18:17.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.045+0000 7fb808200640 1 -- 172.21.15.144:0/706265801 wait complete. 2024-09-12T12:18:17.064 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:18:17.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.201+0000 7f6756600640 1 Processor -- start 2024-09-12T12:18:17.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.201+0000 7f6756600640 1 -- start start 2024-09-12T12:18:17.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f6756600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f675015b4e0 0x7f67500b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f6756600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 0x7f67500cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f6756600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67500b45a0 con 0x7f67500b3ad0 2024-09-12T12:18:17.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f6756600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f67500cd8e0 con 0x7f675015b4e0 2024-09-12T12:18:17.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f6756600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f67500b3fe0 con 0x7f67500ccf30 2024-09-12T12:18:17.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f674f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f675015b4e0 0x7f67500b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f674f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f675015b4e0 0x7f67500b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60186/0 (socket says 172.21.15.144:60186) 2024-09-12T12:18:17.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f674f400640 1 -- 172.21.15.144:0/2834348177 learned_addr learned my addr 172.21.15.144:0/2834348177 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:17.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f674fe00640 1 --2- 172.21.15.144:0/2834348177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 0x7f67500cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f674f400640 1 -- 172.21.15.144:0/2834348177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 msgr2=0x7f67500cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:17.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f674f400640 1 --2- 172.21.15.144:0/2834348177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 0x7f67500cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f674f400640 1 -- 172.21.15.144:0/2834348177 >> v1:172.21.15.165:6789/0 conn(0x7f67500b3ad0 legacy=0x7f6750071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.205+0000 7f674f400640 1 -- 172.21.15.144:0/2834348177 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67500b42c0 con 0x7f675015b4e0 2024-09-12T12:18:17.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f674f400640 1 --2- 172.21.15.144:0/2834348177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 0x7f67500b3590 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f6740009870 tx=0x7f674001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cce17b0e9cd03f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:17.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f674e000640 1 -- 172.21.15.144:0/2834348177 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400a95f0 con 0x7f675015b4e0 2024-09-12T12:18:17.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f674e000640 1 -- 172.21.15.144:0/2834348177 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67400a9790 con 0x7f675015b4e0 2024-09-12T12:18:17.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f674e000640 1 -- 172.21.15.144:0/2834348177 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400a9b60 con 0x7f675015b4e0 2024-09-12T12:18:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 -- 172.21.15.144:0/2834348177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 msgr2=0x7f67500b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 --2- 172.21.15.144:0/2834348177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 0x7f67500b3590 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f6740009870 tx=0x7f674001c530 comp rx=0 tx=0).stop 2024-09-12T12:18:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 -- 172.21.15.144:0/2834348177 shutdown_connections 2024-09-12T12:18:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 --2- 172.21.15.144:0/2834348177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 0x7f67500cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 --2- 172.21.15.144:0/2834348177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 0x7f67500b3590 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 -- 172.21.15.144:0/2834348177 >> 172.21.15.144:0/2834348177 conn(0x7f675006d0d0 msgr2=0x7f675006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 -- 172.21.15.144:0/2834348177 shutdown_connections 2024-09-12T12:18:17.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 -- 172.21.15.144:0/2834348177 wait complete. 2024-09-12T12:18:17.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 Processor -- start 2024-09-12T12:18:17.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 -- start start 2024-09-12T12:18:17.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67500b3ad0 0x7f67501f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 0x7f6750155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 0x7f6750165470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f675015b8c0 con 0x7f675015b4e0 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f67500cdef0 con 0x7f67500b3ad0 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f6756600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f67500ac940 con 0x7f67500ccf30 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f674fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 0x7f6750165470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f674fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 0x7f6750165470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60192/0 (socket says 172.21.15.144:60192) 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f674fe00640 1 -- 172.21.15.144:0/2589334446 learned_addr learned my addr 172.21.15.144:0/2589334446 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f674f400640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67500b3ad0 0x7f67501f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.209+0000 7f674ea00640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 0x7f6750155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f674fe00640 1 -- 172.21.15.144:0/2589334446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 msgr2=0x7f6750155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f674fe00640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 0x7f6750155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f674fe00640 1 -- 172.21.15.144:0/2589334446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67500b3ad0 msgr2=0x7f67501f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f674fe00640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67500b3ad0 0x7f67501f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f674fe00640 1 -- 172.21.15.144:0/2589334446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67500aa720 con 0x7f675015b4e0 2024-09-12T12:18:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f674fe00640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 0x7f6750165470 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f674800efc0 tx=0x7f674800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f6747400640 1 -- 172.21.15.144:0/2589334446 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748018020 con 0x7f675015b4e0 2024-09-12T12:18:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f6747400640 1 -- 172.21.15.144:0/2589334446 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6748014480 con 0x7f675015b4e0 2024-09-12T12:18:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f6747400640 1 -- 172.21.15.144:0/2589334446 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748014870 con 0x7f675015b4e0 2024-09-12T12:18:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67500acb90 con 0x7f675015b4e0 2024-09-12T12:18:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67500ad150 con 0x7f675015b4e0 2024-09-12T12:18:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67500cd3a0 con 0x7f675015b4e0 2024-09-12T12:18:17.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f6747400640 1 -- 172.21.15.144:0/2589334446 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f674801b020 con 0x7f675015b4e0 2024-09-12T12:18:17.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f6747400640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67300678c0 0x7f6730069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f6747400640 1 -- 172.21.15.144:0/2589334446 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6359+0+0 (secure 0 0 0) 0x7f6748086b20 con 0x7f675015b4e0 2024-09-12T12:18:17.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.213+0000 7f674f400640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67300678c0 0x7f6730069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.217+0000 7f674f400640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67300678c0 0x7f6730069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f67400ae000 tx=0x7f67400b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:17.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.217+0000 7f6747400640 1 -- 172.21.15.144:0/2589334446 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6748022030 con 0x7f675015b4e0 2024-09-12T12:18:17.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.409+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f675015efa0 con 0x7f675015b4e0 2024-09-12T12:18:17.411 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:18:17.413+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:18:17.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.413+0000 7f6747400640 1 -- 172.21.15.144:0/2589334446 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) ==== 161+0+0 (secure 0 0 0) 0x7f6748010040 con 0x7f675015b4e0 2024-09-12T12:18:17.413 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67300678c0 msgr2=0x7f6730069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67300678c0 0x7f6730069d80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f67400ae000 tx=0x7f67400b3040 comp rx=0 tx=0).stop 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 msgr2=0x7f6750165470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 0x7f6750165470 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f674800efc0 tx=0x7f674800c490 comp rx=0 tx=0).stop 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 shutdown_connections 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67300678c0 0x7f6730069d80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f675015b4e0 0x7f6750165470 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67500ccf30 0x7f6750155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 --2- 172.21.15.144:0/2589334446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67500b3ad0 0x7f67501f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 >> 172.21.15.144:0/2589334446 conn(0x7f675006d0d0 msgr2=0x7f675015dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:17.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 shutdown_connections 2024-09-12T12:18:17.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.417+0000 7f6756600640 1 -- 172.21.15.144:0/2589334446 wait complete. 2024-09-12T12:18:17.422 INFO:tasks.ceph.mds.a.smithi144.stderr: -1480> 2024-09-12T12:18:07.389+0000 7f74b4400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:18:17.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:18:17.468 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:18:17.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.581+0000 7f8511a00640 1 Processor -- start 2024-09-12T12:18:17.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.581+0000 7f8511a00640 1 -- start start 2024-09-12T12:18:17.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.581+0000 7f8511a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f850c0af5f0 0x7f850c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.581+0000 7f8511a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c06c150 0x7f850c0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.581+0000 7f8511a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f850c0733e0 con 0x7f850c15c2e0 2024-09-12T12:18:17.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.581+0000 7f8511a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f850c06c5c0 con 0x7f850c0af5f0 2024-09-12T12:18:17.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.581+0000 7f8511a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f850c0cd290 con 0x7f850c06c150 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f850c0af5f0 0x7f850c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f850c15c2e0 0x7f850c072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58884/0 (socket says 172.21.15.144:58884) 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850aa00640 1 -- 172.21.15.144:0/2339595312 learned_addr learned my addr 172.21.15.144:0/2339595312 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f850c0af5f0 0x7f850c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60212/0 (socket says 172.21.15.144:60212) 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850b400640 1 --2- 172.21.15.144:0/2339595312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c06c150 0x7f850c0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850a000640 1 -- 172.21.15.144:0/2339595312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c06c150 msgr2=0x7f850c0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850a000640 1 --2- 172.21.15.144:0/2339595312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c06c150 0x7f850c0cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850a000640 1 -- 172.21.15.144:0/2339595312 >> v1:172.21.15.144:6789/0 conn(0x7f850c15c2e0 legacy=0x7f850c072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850a000640 1 -- 172.21.15.144:0/2339595312 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c0cd570 con 0x7f850c0af5f0 2024-09-12T12:18:17.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f8509600640 1 -- 172.21.15.144:0/2339595312 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886408017 0 0) 0x7f850c0733e0 con 0x7f850c15c2e0 2024-09-12T12:18:17.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f850a000640 1 --2- 172.21.15.144:0/2339595312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c0af5f0 0x7f850c06bc10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f84f80097c0 tx=0x7f84f801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7548f9523f2584 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:17.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f8509600640 1 -- 172.21.15.144:0/2339595312 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f80b0070 con 0x7f850c0af5f0 2024-09-12T12:18:17.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f8509600640 1 -- 172.21.15.144:0/2339595312 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f80ab600 con 0x7f850c0af5f0 2024-09-12T12:18:17.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.585+0000 7f8509600640 1 -- 172.21.15.144:0/2339595312 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f80ab9d0 con 0x7f850c0af5f0 2024-09-12T12:18:17.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 -- 172.21.15.144:0/2339595312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c0af5f0 msgr2=0x7f850c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 --2- 172.21.15.144:0/2339595312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c0af5f0 0x7f850c06bc10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f84f80097c0 tx=0x7f84f801c380 comp rx=0 tx=0).stop 2024-09-12T12:18:17.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 -- 172.21.15.144:0/2339595312 shutdown_connections 2024-09-12T12:18:17.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 --2- 172.21.15.144:0/2339595312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c06c150 0x7f850c0cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 --2- 172.21.15.144:0/2339595312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c0af5f0 0x7f850c06bc10 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 -- 172.21.15.144:0/2339595312 >> 172.21.15.144:0/2339595312 conn(0x7f850c068030 msgr2=0x7f850c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:17.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 -- 172.21.15.144:0/2339595312 shutdown_connections 2024-09-12T12:18:17.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 -- 172.21.15.144:0/2339595312 wait complete. 2024-09-12T12:18:17.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 Processor -- start 2024-09-12T12:18:17.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 -- start start 2024-09-12T12:18:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c06c150 0x7f850c14c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c0af5f0 0x7f850c157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f850c15c2e0 0x7f850c154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0cee90 con 0x7f850c06c150 2024-09-12T12:18:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0ced10 con 0x7f850c15c2e0 2024-09-12T12:18:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f8511a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f850c0cf010 con 0x7f850c0af5f0 2024-09-12T12:18:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c06c150 0x7f850c14c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c06c150 0x7f850c14c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60226/0 (socket says 172.21.15.144:60226) 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850aa00640 1 -- 172.21.15.144:0/468346312 learned_addr learned my addr 172.21.15.144:0/468346312 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850a000640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c0af5f0 0x7f850c157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850b400640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f850c15c2e0 0x7f850c154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850aa00640 1 -- 172.21.15.144:0/468346312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c0af5f0 msgr2=0x7f850c157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850aa00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c0af5f0 0x7f850c157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850aa00640 1 -- 172.21.15.144:0/468346312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f850c15c2e0 msgr2=0x7f850c154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850aa00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f850c15c2e0 0x7f850c154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850aa00640 1 -- 172.21.15.144:0/468346312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c14cd00 con 0x7f850c06c150 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.589+0000 7f850aa00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c06c150 0x7f850c14c7c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0011f0 tx=0x7f84fc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f8502a00640 1 -- 172.21.15.144:0/468346312 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc018070 con 0x7f850c06c150 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f8502a00640 1 -- 172.21.15.144:0/468346312 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84fc0074e0 con 0x7f850c06c150 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f8502a00640 1 -- 172.21.15.144:0/468346312 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc004a10 con 0x7f850c06c150 2024-09-12T12:18:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850c158570 con 0x7f850c06c150 2024-09-12T12:18:17.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f850c158e10 con 0x7f850c06c150 2024-09-12T12:18:17.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850c0cdd70 con 0x7f850c06c150 2024-09-12T12:18:17.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f8502a00640 1 -- 172.21.15.144:0/468346312 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84fc01b070 con 0x7f850c06c150 2024-09-12T12:18:17.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f8502a00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84ec0678c0 0x7f84ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f8502a00640 1 -- 172.21.15.144:0/468346312 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6445+0+0 (secure 0 0 0) 0x7f84fc0852f0 con 0x7f850c06c150 2024-09-12T12:18:17.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f850a000640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84ec0678c0 0x7f84ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.593+0000 7f850a000640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84ec0678c0 0x7f84ec069d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f84f80ad000 tx=0x7f84f80a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:17.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.597+0000 7f8502a00640 1 -- 172.21.15.144:0/468346312 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f84fc055ab0 con 0x7f850c06c150 2024-09-12T12:18:17.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:17.789+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f850c15b5f0 con 0x7f850c06c150 2024-09-12T12:18:18.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8502a00640 1 -- 172.21.15.144:0/468346312 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) ==== 104+0+0 (secure 0 0 0) 0x7f84fc0553b0 con 0x7f850c06c150 2024-09-12T12:18:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84ec0678c0 msgr2=0x7f84ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84ec0678c0 0x7f84ec069d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f84f80ad000 tx=0x7f84f80a6000 comp rx=0 tx=0).stop 2024-09-12T12:18:18.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c06c150 msgr2=0x7f850c14c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c06c150 0x7f850c14c7c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0011f0 tx=0x7f84fc00c9b0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 shutdown_connections 2024-09-12T12:18:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84ec0678c0 0x7f84ec069d80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f850c15c2e0 0x7f850c154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f850c0af5f0 0x7f850c157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 --2- 172.21.15.144:0/468346312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f850c06c150 0x7f850c14c7c0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 >> 172.21.15.144:0/468346312 conn(0x7f850c068030 msgr2=0x7f850c0aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:18.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 shutdown_connections 2024-09-12T12:18:18.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.421+0000 7f8511a00640 1 -- 172.21.15.144:0/468346312 wait complete. 2024-09-12T12:18:18.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:18:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.637+0000 7ff1a1800640 1 Processor -- start 2024-09-12T12:18:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.637+0000 7ff1a1800640 1 -- start start 2024-09-12T12:18:18.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff1a1800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff19c0b1e10 0x7ff19c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:18.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff1a1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 0x7ff19c070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:18.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff1a1800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff19c0b3840 con 0x7ff19c15c7d0 2024-09-12T12:18:18.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff1a1800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff19c0b3e50 con 0x7ff19c0b1e10 2024-09-12T12:18:18.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff1a1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff19c0b2730 con 0x7ff19c073d30 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff19b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 0x7ff19c070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff1a0e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7ff19c15c7d0 0x7ff19c0b42e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:41178/0 (socket says 172.21.15.144:41178) 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff1a0e00640 1 -- 172.21.15.144:0/1242841500 learned_addr learned my addr 172.21.15.144:0/1242841500 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff19be00640 1 --2- 172.21.15.144:0/1242841500 >> v2:172.21.15.165:3300/0 conn(0x7ff19c0b1e10 0x7ff19c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff19aa00640 1 -- 172.21.15.144:0/1242841500 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471505812 0 0) 0x7ff19c0b3840 con 0x7ff19c15c7d0 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff19aa00640 1 -- 172.21.15.144:0/1242841500 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff180003530 con 0x7ff19c15c7d0 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff19b400640 1 -- 172.21.15.144:0/1242841500 >> v2:172.21.15.165:3300/0 conn(0x7ff19c0b1e10 msgr2=0x7ff19c0b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff19b400640 1 --2- 172.21.15.144:0/1242841500 >> v2:172.21.15.165:3300/0 conn(0x7ff19c0b1e10 0x7ff19c0b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff19b400640 1 -- 172.21.15.144:0/1242841500 >> v1:172.21.15.165:6789/0 conn(0x7ff19c15c7d0 legacy=0x7ff19c0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:18.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.641+0000 7ff19b400640 1 -- 172.21.15.144:0/1242841500 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c071510 con 0x7ff19c073d30 2024-09-12T12:18:18.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff19b400640 1 --2- 172.21.15.144:0/1242841500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 0x7ff19c070fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff1880097c0 tx=0x7ff18801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=186564226f8cf426 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:18.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff19aa00640 1 -- 172.21.15.144:0/1242841500 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1880b2070 con 0x7ff19c073d30 2024-09-12T12:18:18.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff19aa00640 1 -- 172.21.15.144:0/1242841500 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1880ad640 con 0x7ff19c073d30 2024-09-12T12:18:18.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff19aa00640 1 -- 172.21.15.144:0/1242841500 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1880ada10 con 0x7ff19c073d30 2024-09-12T12:18:18.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 -- 172.21.15.144:0/1242841500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 msgr2=0x7ff19c070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:18.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 --2- 172.21.15.144:0/1242841500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 0x7ff19c070fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff1880097c0 tx=0x7ff18801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 -- 172.21.15.144:0/1242841500 shutdown_connections 2024-09-12T12:18:18.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 --2- 172.21.15.144:0/1242841500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 0x7ff19c070fd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 --2- 172.21.15.144:0/1242841500 >> v2:172.21.15.165:3300/0 conn(0x7ff19c0b1e10 0x7ff19c0b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 -- 172.21.15.144:0/1242841500 >> 172.21.15.144:0/1242841500 conn(0x7ff19c06bc10 msgr2=0x7ff19c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:18.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 -- 172.21.15.144:0/1242841500 shutdown_connections 2024-09-12T12:18:18.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 -- 172.21.15.144:0/1242841500 wait complete. 2024-09-12T12:18:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 Processor -- start 2024-09-12T12:18:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.645+0000 7ff1a1800640 1 -- start start 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 0x7ff19c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c0b1e10 0x7ff19c15d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff19c15c7d0 0x7ff19c141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c145d90 con 0x7ff19c0b1e10 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c15d010 con 0x7ff19c15c7d0 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff19c145f10 con 0x7ff19c073d30 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c0b1e10 0x7ff19c15d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c0b1e10 0x7ff19c15d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60242/0 (socket says 172.21.15.144:60242) 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19b400640 1 -- 172.21.15.144:0/1145999814 learned_addr learned my addr 172.21.15.144:0/1145999814 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a0e00640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff19c15c7d0 0x7ff19c141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19be00640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 0x7ff19c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19b400640 1 -- 172.21.15.144:0/1145999814 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 msgr2=0x7ff19c15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19b400640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 0x7ff19c15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19b400640 1 -- 172.21.15.144:0/1145999814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff19c15c7d0 msgr2=0x7ff19c141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19b400640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff19c15c7d0 0x7ff19c141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19b400640 1 -- 172.21.15.144:0/1145999814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c13dbc0 con 0x7ff19c0b1e10 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff19b400640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c0b1e10 0x7ff19c15d650 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff18801a0d0 tx=0x7ff188019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff193e00640 1 -- 172.21.15.144:0/1145999814 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1880b2040 con 0x7ff19c0b1e10 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff193e00640 1 -- 172.21.15.144:0/1145999814 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1880bb070 con 0x7ff19c0b1e10 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff193e00640 1 -- 172.21.15.144:0/1145999814 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1880b6650 con 0x7ff19c0b1e10 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19c13dea0 con 0x7ff19c0b1e10 2024-09-12T12:18:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19c13e460 con 0x7ff19c0b1e10 2024-09-12T12:18:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19c140a90 con 0x7ff19c0b1e10 2024-09-12T12:18:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.649+0000 7ff193e00640 1 -- 172.21.15.144:0/1145999814 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1880b67f0 con 0x7ff19c0b1e10 2024-09-12T12:18:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.653+0000 7ff193e00640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff17c0678c0 0x7ff17c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.653+0000 7ff193e00640 1 -- 172.21.15.144:0/1145999814 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6445+0+0 (secure 0 0 0) 0x7ff18811fec0 con 0x7ff19c0b1e10 2024-09-12T12:18:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.653+0000 7ff19be00640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff17c0678c0 0x7ff17c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.653+0000 7ff19be00640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff17c0678c0 0x7ff17c069d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009a50 tx=0x7ff18c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.657+0000 7ff193e00640 1 -- 172.21.15.144:0/1145999814 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff188016090 con 0x7ff19c0b1e10 2024-09-12T12:18:18.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:18.817+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff19c1407b0 con 0x7ff19c0b1e10 2024-09-12T12:18:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.569+0000 7ff193e00640 1 -- 172.21.15.144:0/1145999814 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) ==== 181+0+0 (secure 0 0 0) 0x7ff1880f0720 con 0x7ff19c0b1e10 2024-09-12T12:18:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:18:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff17c0678c0 msgr2=0x7ff17c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff17c0678c0 0x7ff17c069d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009a50 tx=0x7ff18c008040 comp rx=0 tx=0).stop 2024-09-12T12:18:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c0b1e10 msgr2=0x7ff19c15d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c0b1e10 0x7ff19c15d650 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff18801a0d0 tx=0x7ff188019240 comp rx=0 tx=0).stop 2024-09-12T12:18:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 shutdown_connections 2024-09-12T12:18:19.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff17c0678c0 0x7ff17c069d80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff19c15c7d0 0x7ff19c141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff19c0b1e10 0x7ff19c15d650 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 --2- 172.21.15.144:0/1145999814 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff19c073d30 0x7ff19c15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 >> 172.21.15.144:0/1145999814 conn(0x7ff19c06bc10 msgr2=0x7ff19c1433e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:19.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 shutdown_connections 2024-09-12T12:18:19.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.573+0000 7ff1a1800640 1 -- 172.21.15.144:0/1145999814 wait complete. 2024-09-12T12:18:19.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:18:19.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35e2a00640 1 Processor -- start 2024-09-12T12:18:19.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35e2a00640 1 -- start start 2024-09-12T12:18:19.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35e2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35dc06d630 0x7f35dc155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35e2a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35dc06cd20 con 0x7f35dc0b3490 2024-09-12T12:18:19.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35e2a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35dc0b3950 con 0x7f35dc06d250 2024-09-12T12:18:19.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35e2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f35dc072620 con 0x7f35dc06d630 2024-09-12T12:18:19.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35db400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f35dc0b3490 0x7f35dc0b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58900/0 (socket says 172.21.15.144:58900) 2024-09-12T12:18:19.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35db400640 1 -- 172.21.15.144:0/4078028021 learned_addr learned my addr 172.21.15.144:0/4078028021 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105143337 0 0) 0x7f35dc06cd20 con 0x7f35dc0b3490 2024-09-12T12:18:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.741+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c0003530 con 0x7f35dc0b3490 2024-09-12T12:18:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35e0a00640 1 --2- 172.21.15.144:0/4078028021 >> v2:172.21.15.165:3300/0 conn(0x7f35dc06d630 0x7f35dc155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 846179016 0 0) 0x7f35c0003530 con 0x7f35dc0b3490 2024-09-12T12:18:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 >> v2:172.21.15.165:3300/0 conn(0x7f35dc06d630 msgr2=0x7f35dc155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 --2- 172.21.15.144:0/4078028021 >> v2:172.21.15.165:3300/0 conn(0x7f35dc06d630 0x7f35dc155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 >> v1:172.21.15.165:6789/0 conn(0x7f35dc06d250 legacy=0x7f35dc15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc0b3c30 con 0x7f35dc0b3490 2024-09-12T12:18:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f35c8001680 con 0x7f35dc0b3490 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 >> v1:172.21.15.144:6789/0 conn(0x7f35dc0b3490 legacy=0x7f35dc0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c0003a10 0x7f35c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0004810 0x7f35c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c0005220 0x7f35c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc072620 con 0x7f35c0004810 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35c000c170 con 0x7f35c0003a10 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35c000c370 con 0x7f35c0005220 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35db400640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0004810 0x7f35c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35dbe00640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c0003a10 0x7f35c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35e0a00640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c0005220 0x7f35c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35db400640 1 -- 172.21.15.144:0/4078028021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c0005220 msgr2=0x7f35c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35db400640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35c0005220 0x7f35c000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35db400640 1 -- 172.21.15.144:0/4078028021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c0003a10 msgr2=0x7f35c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35db400640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c0003a10 0x7f35c0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35db400640 1 -- 172.21.15.144:0/4078028021 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c0003530 con 0x7f35c0004810 2024-09-12T12:18:19.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35e0a00640 1 -- 172.21.15.144:0/4078028021 reap_dead start 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.745+0000 7f35db400640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0004810 0x7f35c0004c90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c110 tx=0x7f35c801f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab0cf8451504b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8007c30 con 0x7f35c0004810 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c80ac020 con 0x7f35c0004810 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35daa00640 1 -- 172.21.15.144:0/4078028021 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c80058e0 con 0x7f35c0004810 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 -- 172.21.15.144:0/4078028021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0004810 msgr2=0x7f35c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0004810 0x7f35c0004c90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c110 tx=0x7f35c801f270 comp rx=0 tx=0).stop 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 -- 172.21.15.144:0/4078028021 shutdown_connections 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 --2- 172.21.15.144:0/4078028021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35c0004810 0x7f35c0004c90 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 -- 172.21.15.144:0/4078028021 >> 172.21.15.144:0/4078028021 conn(0x7f35dc06bc10 msgr2=0x7f35dc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 -- 172.21.15.144:0/4078028021 shutdown_connections 2024-09-12T12:18:19.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 -- 172.21.15.144:0/4078028021 wait complete. 2024-09-12T12:18:19.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 Processor -- start 2024-09-12T12:18:19.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 -- start start 2024-09-12T12:18:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c0004810 0x7f35dc156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35dc156aa0 0x7f35dc1e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35dc1e5350 0x7f35dc0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc0b44d0 con 0x7f35dc1e5350 2024-09-12T12:18:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc0b41f0 con 0x7f35c0004810 2024-09-12T12:18:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc0b49f0 con 0x7f35dc156aa0 2024-09-12T12:18:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35dc1e5350 0x7f35dc0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35dc1e5350 0x7f35dc0cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60262/0 (socket says 172.21.15.144:60262) 2024-09-12T12:18:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.749+0000 7f35e0a00640 1 -- 172.21.15.144:0/1816936623 learned_addr learned my addr 172.21.15.144:0/1816936623 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35dbe00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c0004810 0x7f35dc156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35db400640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35dc156aa0 0x7f35dc1e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35e0a00640 1 -- 172.21.15.144:0/1816936623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35dc156aa0 msgr2=0x7f35dc1e85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35e0a00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35dc156aa0 0x7f35dc1e85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35e0a00640 1 -- 172.21.15.144:0/1816936623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c0004810 msgr2=0x7f35dc156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35e0a00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c0004810 0x7f35dc156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35e0a00640 1 -- 172.21.15.144:0/1816936623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc1e8ed0 con 0x7f35dc1e5350 2024-09-12T12:18:19.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35db400640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35dc156aa0 0x7f35dc1e85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35e0a00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35dc1e5350 0x7f35dc0cba60 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f35d40098b0 tx=0x7f35d4009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35d3e00640 1 -- 172.21.15.144:0/1816936623 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4007d20 con 0x7f35dc1e5350 2024-09-12T12:18:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35d3e00640 1 -- 172.21.15.144:0/1816936623 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d4019070 con 0x7f35dc1e5350 2024-09-12T12:18:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35d3e00640 1 -- 172.21.15.144:0/1816936623 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4014650 con 0x7f35dc1e5350 2024-09-12T12:18:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc1e4870 con 0x7f35dc1e5350 2024-09-12T12:18:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1e91b0 con 0x7f35dc1e5350 2024-09-12T12:18:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc0b4d80 con 0x7f35dc1e5350 2024-09-12T12:18:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35d3e00640 1 -- 172.21.15.144:0/1816936623 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35d40147f0 con 0x7f35dc1e5350 2024-09-12T12:18:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35d3e00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35bc0678f0 0x7f35bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35d3e00640 1 -- 172.21.15.144:0/1816936623 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6007+0+0 (secure 0 0 0) 0x7f35d4086200 con 0x7f35dc1e5350 2024-09-12T12:18:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.753+0000 7f35dbe00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35bc0678f0 0x7f35bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.757+0000 7f35dbe00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35bc0678f0 0x7f35bc069db0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f35cc007fd0 tx=0x7f35cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:19.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.757+0000 7f35d3e00640 1 -- 172.21.15.144:0/1816936623 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f35d4056ca0 con 0x7f35dc1e5350 2024-09-12T12:18:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:19.921+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f35dc0cd950 con 0x7f35dc1e5350 2024-09-12T12:18:20.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35d3e00640 1 -- 172.21.15.144:0/1816936623 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) ==== 169+0+0 (secure 0 0 0) 0x7f35d40565a0 con 0x7f35dc1e5350 2024-09-12T12:18:20.572 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:18:20.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35bc0678f0 msgr2=0x7f35bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35bc0678f0 0x7f35bc069db0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f35cc007fd0 tx=0x7f35cc009040 comp rx=0 tx=0).stop 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35dc1e5350 msgr2=0x7f35dc0cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35dc1e5350 0x7f35dc0cba60 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f35d40098b0 tx=0x7f35d4009d70 comp rx=0 tx=0).stop 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 shutdown_connections 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35bc0678f0 0x7f35bc069db0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35dc1e5350 0x7f35dc0cba60 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35dc156aa0 0x7f35dc1e85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 --2- 172.21.15.144:0/1816936623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35c0004810 0x7f35dc156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 >> 172.21.15.144:0/1816936623 conn(0x7f35dc06bc10 msgr2=0x7f35dc0727a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 shutdown_connections 2024-09-12T12:18:20.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.573+0000 7f35e2a00640 1 -- 172.21.15.144:0/1816936623 wait complete. 2024-09-12T12:18:20.600 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-12T12:18:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc123600640 1 Processor -- start 2024-09-12T12:18:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc123600640 1 -- start start 2024-09-12T12:18:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc123600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c0cd9f0 0x7fc11c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc123600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc11c15b340 0x7fc11c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc123600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc11c0b4300 con 0x7fc11c15af60 2024-09-12T12:18:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc123600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc11c0b32f0 con 0x7fc11c15b340 2024-09-12T12:18:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc123600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc11c0b3540 con 0x7fc11c0cd9f0 2024-09-12T12:18:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc11be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c0cd9f0 0x7fc11c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc121600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc11c15b340 0x7fc11c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc120c00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fc11c15af60 0x7fc11c0ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:41194/0 (socket says 172.21.15.144:41194) 2024-09-12T12:18:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc120c00640 1 -- 172.21.15.144:0/1798768373 learned_addr learned my addr 172.21.15.144:0/1798768373 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc121600640 1 -- 172.21.15.144:0/1798768373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c0cd9f0 msgr2=0x7fc11c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc121600640 1 --2- 172.21.15.144:0/1798768373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c0cd9f0 0x7fc11c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc121600640 1 -- 172.21.15.144:0/1798768373 >> v1:172.21.15.165:6789/0 conn(0x7fc11c15af60 legacy=0x7fc11c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.745+0000 7fc121600640 1 -- 172.21.15.144:0/1798768373 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11c0b3820 con 0x7fc11c15b340 2024-09-12T12:18:20.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc121600640 1 --2- 172.21.15.144:0/1798768373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c15b340 0x7fc11c06c150 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc114009d90 tx=0x7fc114021360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f57ae93fdae6fa70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc11b400640 1 -- 172.21.15.144:0/1798768373 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140b6070 con 0x7fc11c15b340 2024-09-12T12:18:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc11b400640 1 -- 172.21.15.144:0/1798768373 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1140b1600 con 0x7fc11c15b340 2024-09-12T12:18:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc11b400640 1 -- 172.21.15.144:0/1798768373 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140aae60 con 0x7fc11c15b340 2024-09-12T12:18:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc123600640 1 -- 172.21.15.144:0/1798768373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c15b340 msgr2=0x7fc11c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc123600640 1 --2- 172.21.15.144:0/1798768373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c15b340 0x7fc11c06c150 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc114009d90 tx=0x7fc114021360 comp rx=0 tx=0).stop 2024-09-12T12:18:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc123600640 1 -- 172.21.15.144:0/1798768373 shutdown_connections 2024-09-12T12:18:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc123600640 1 --2- 172.21.15.144:0/1798768373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c15b340 0x7fc11c06c150 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc123600640 1 --2- 172.21.15.144:0/1798768373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c0cd9f0 0x7fc11c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc123600640 1 -- 172.21.15.144:0/1798768373 >> 172.21.15.144:0/1798768373 conn(0x7fc11c068030 msgr2=0x7fc11c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc123600640 1 -- 172.21.15.144:0/1798768373 shutdown_connections 2024-09-12T12:18:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.749+0000 7fc123600640 1 -- 172.21.15.144:0/1798768373 wait complete. 2024-09-12T12:18:20.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 Processor -- start 2024-09-12T12:18:20.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 -- start start 2024-09-12T12:18:20.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c0cd9f0 0x7fc11c15e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c15af60 0x7fc11c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc11c15b340 0x7fc11c1f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c06d0f0 con 0x7fc11c15b340 2024-09-12T12:18:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc11c0b3de0 con 0x7fc11c0cd9f0 2024-09-12T12:18:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc11c06d270 con 0x7fc11c15af60 2024-09-12T12:18:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc121600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc11c15b340 0x7fc11c1f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc121600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc11c15b340 0x7fc11c1f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60272/0 (socket says 172.21.15.144:60272) 2024-09-12T12:18:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc121600640 1 -- 172.21.15.144:0/1636506856 learned_addr learned my addr 172.21.15.144:0/1636506856 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:20.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc120c00640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c0cd9f0 0x7fc11c15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc11be00640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c15af60 0x7fc11c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc121600640 1 -- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c15af60 msgr2=0x7fc11c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc121600640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c15af60 0x7fc11c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc121600640 1 -- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c0cd9f0 msgr2=0x7fc11c15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc121600640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c0cd9f0 0x7fc11c15e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc121600640 1 -- 172.21.15.144:0/1636506856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11c15bd70 con 0x7fc11c15b340 2024-09-12T12:18:20.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc11be00640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c15af60 0x7fc11c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:20.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc120c00640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c0cd9f0 0x7fc11c15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:20.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc121600640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc11c15b340 0x7fc11c1f4a90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc114009d90 tx=0x7fc11401e100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:20.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc118c00640 1 -- 172.21.15.144:0/1636506856 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140c1070 con 0x7fc11c15b340 2024-09-12T12:18:20.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc118c00640 1 -- 172.21.15.144:0/1636506856 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1140aae60 con 0x7fc11c15b340 2024-09-12T12:18:20.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11c15c050 con 0x7fc11c15b340 2024-09-12T12:18:20.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc118c00640 1 -- 172.21.15.144:0/1636506856 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140b6040 con 0x7fc11c15b340 2024-09-12T12:18:20.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.753+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc11c1f4570 con 0x7fc11c15b340 2024-09-12T12:18:20.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.757+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc11c0ce680 con 0x7fc11c15b340 2024-09-12T12:18:20.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.757+0000 7fc118c00640 1 -- 172.21.15.144:0/1636506856 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1140c4070 con 0x7fc11c15b340 2024-09-12T12:18:20.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.757+0000 7fc118c00640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0fc0678c0 0x7fc0fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:20.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.757+0000 7fc118c00640 1 -- 172.21.15.144:0/1636506856 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7fc114123360 con 0x7fc11c15b340 2024-09-12T12:18:20.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.757+0000 7fc120c00640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0fc0678c0 0x7fc0fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:20.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.757+0000 7fc120c00640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0fc0678c0 0x7fc0fc069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000f70 tx=0x7fc10c007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:20.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.761+0000 7fc118c00640 1 -- 172.21.15.144:0/1636506856 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc11401aec0 con 0x7fc11c15b340 2024-09-12T12:18:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.921+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7fc11c0afc20 con 0x7fc11c15b340 2024-09-12T12:18:20.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc118c00640 1 -- 172.21.15.144:0/1636506856 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v30) ==== 101+0+0 (secure 0 0 0) 0x7fc1140fa0d0 con 0x7fc11c15b340 2024-09-12T12:18:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0fc0678c0 msgr2=0x7fc0fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0fc0678c0 0x7fc0fc069d80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000f70 tx=0x7fc10c007e90 comp rx=0 tx=0).stop 2024-09-12T12:18:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc11c15b340 msgr2=0x7fc11c1f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc11c15b340 0x7fc11c1f4a90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc114009d90 tx=0x7fc11401e100 comp rx=0 tx=0).stop 2024-09-12T12:18:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 shutdown_connections 2024-09-12T12:18:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0fc0678c0 0x7fc0fc069d80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc11c15b340 0x7fc11c1f4a90 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc11c15af60 0x7fc11c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 --2- 172.21.15.144:0/1636506856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc11c0cd9f0 0x7fc11c15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 >> 172.21.15.144:0/1636506856 conn(0x7fc11c068030 msgr2=0x7fc11c0b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 shutdown_connections 2024-09-12T12:18:20.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:20.925+0000 7fc123600640 1 -- 172.21.15.144:0/1636506856 wait complete. 2024-09-12T12:18:20.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-12T12:18:21.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce18400640 1 Processor -- start 2024-09-12T12:18:21.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce18400640 1 -- start start 2024-09-12T12:18:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce18400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce100b60f0 0x7fce100b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce18400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce1006c330 con 0x7fce1015e7e0 2024-09-12T12:18:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce18400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce1006c610 con 0x7fce100b7a00 2024-09-12T12:18:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce18400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fce1006c0e0 con 0x7fce100b60f0 2024-09-12T12:18:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce15000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce100b60f0 0x7fce100b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce15000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce100b60f0 0x7fce100b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60286/0 (socket says 172.21.15.144:60286) 2024-09-12T12:18:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce15000640 1 -- 172.21.15.144:0/1553300197 learned_addr learned my addr 172.21.15.144:0/1553300197 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce15a00640 1 --1- 172.21.15.144:0/1553300197 >> v1:172.21.15.144:6789/0 conn(0x7fce1015e7e0 0x7fce100d3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58916/0 (socket says 172.21.15.144:58916) 2024-09-12T12:18:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce15000640 1 -- 172.21.15.144:0/1553300197 >> v1:172.21.15.165:6789/0 conn(0x7fce100b7a00 legacy=0x7fce100b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce15000640 1 -- 172.21.15.144:0/1553300197 >> v1:172.21.15.144:6789/0 conn(0x7fce1015e7e0 legacy=0x7fce100d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.085+0000 7fce15000640 1 -- 172.21.15.144:0/1553300197 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1006c8f0 con 0x7fce100b60f0 2024-09-12T12:18:21.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce15000640 1 --2- 172.21.15.144:0/1553300197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 0x7fce100b6530 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009870 tx=0x7fcdfc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee24a84398cbfba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce0fe00640 1 -- 172.21.15.144:0/1553300197 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0b0070 con 0x7fce100b60f0 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce0fe00640 1 -- 172.21.15.144:0/1553300197 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdfc0ab600 con 0x7fce100b60f0 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce0fe00640 1 -- 172.21.15.144:0/1553300197 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0ab9d0 con 0x7fce100b60f0 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce18400640 1 -- 172.21.15.144:0/1553300197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 msgr2=0x7fce100b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce18400640 1 --2- 172.21.15.144:0/1553300197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 0x7fce100b6530 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009870 tx=0x7fcdfc01c520 comp rx=0 tx=0).stop 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce18400640 1 -- 172.21.15.144:0/1553300197 shutdown_connections 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce18400640 1 --2- 172.21.15.144:0/1553300197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 0x7fce100b6530 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce18400640 1 -- 172.21.15.144:0/1553300197 >> 172.21.15.144:0/1553300197 conn(0x7fce100d12c0 msgr2=0x7fce100d16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce18400640 1 -- 172.21.15.144:0/1553300197 shutdown_connections 2024-09-12T12:18:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.089+0000 7fce18400640 1 -- 172.21.15.144:0/1553300197 wait complete. 2024-09-12T12:18:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 Processor -- start 2024-09-12T12:18:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 -- start start 2024-09-12T12:18:21.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 0x7fce10150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce100b7a00 0x7fce100c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce1015e7e0 0x7fce100c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce1016c550 con 0x7fce100b60f0 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce1016c3d0 con 0x7fce1015e7e0 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce1016c6d0 con 0x7fce100b7a00 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 0x7fce10150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 0x7fce10150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60302/0 (socket says 172.21.15.144:60302) 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15a00640 1 -- 172.21.15.144:0/210662917 learned_addr learned my addr 172.21.15.144:0/210662917 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15000640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce100b7a00 0x7fce100c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce16400640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce1015e7e0 0x7fce100c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15a00640 1 -- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce100b7a00 msgr2=0x7fce100c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15a00640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce100b7a00 0x7fce100c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15a00640 1 -- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce1015e7e0 msgr2=0x7fce100c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15a00640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce1015e7e0 0x7fce100c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15a00640 1 -- 172.21.15.144:0/210662917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce101553f0 con 0x7fce100b60f0 2024-09-12T12:18:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15000640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce100b7a00 0x7fce100c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce16400640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce1015e7e0 0x7fce100c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce15a00640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 0x7fce10150c50 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fce0400c790 tx=0x7fce0400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce0d600640 1 -- 172.21.15.144:0/210662917 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04017070 con 0x7fce100b60f0 2024-09-12T12:18:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce0d600640 1 -- 172.21.15.144:0/210662917 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0400a640 con 0x7fce100b60f0 2024-09-12T12:18:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce0d600640 1 -- 172.21.15.144:0/210662917 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0400a9f0 con 0x7fce100b60f0 2024-09-12T12:18:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce101556d0 con 0x7fce100b60f0 2024-09-12T12:18:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce10155c90 con 0x7fce100b60f0 2024-09-12T12:18:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.093+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce100b6530 con 0x7fce100b60f0 2024-09-12T12:18:21.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.097+0000 7fce0d600640 1 -- 172.21.15.144:0/210662917 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce0401a070 con 0x7fce100b60f0 2024-09-12T12:18:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.097+0000 7fce0d600640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcdf00678f0 0x7fcdf0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.097+0000 7fce0d600640 1 -- 172.21.15.144:0/210662917 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7fce040851c0 con 0x7fce100b60f0 2024-09-12T12:18:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.097+0000 7fce15000640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcdf00678f0 0x7fcdf0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.097+0000 7fce15000640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcdf00678f0 0x7fcdf0069db0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0ad000 tx=0x7fcdfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:21.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.101+0000 7fce0d600640 1 -- 172.21.15.144:0/210662917 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fce04055710 con 0x7fce100b60f0 2024-09-12T12:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.269+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7fce100b42e0 con 0x7fce100b60f0 2024-09-12T12:18:21.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce0d600640 1 -- 172.21.15.144:0/210662917 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v31) ==== 101+0+0 (secure 0 0 0) 0x7fce04059a10 con 0x7fce100b60f0 2024-09-12T12:18:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcdf00678f0 msgr2=0x7fcdf0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcdf00678f0 0x7fcdf0069db0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0ad000 tx=0x7fcdfc008040 comp rx=0 tx=0).stop 2024-09-12T12:18:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 msgr2=0x7fce10150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 0x7fce10150c50 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fce0400c790 tx=0x7fce0400cc50 comp rx=0 tx=0).stop 2024-09-12T12:18:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 shutdown_connections 2024-09-12T12:18:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcdf00678f0 0x7fcdf0069db0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce1015e7e0 0x7fce100c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce100b7a00 0x7fce100c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 --2- 172.21.15.144:0/210662917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce100b60f0 0x7fce10150c50 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 >> 172.21.15.144:0/210662917 conn(0x7fce100d12c0 msgr2=0x7fce100b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 shutdown_connections 2024-09-12T12:18:21.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.273+0000 7fce18400640 1 -- 172.21.15.144:0/210662917 wait complete. 2024-09-12T12:18:21.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:18:21.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa9e00640 1 Processor -- start 2024-09-12T12:18:21.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa9e00640 1 -- start start 2024-09-12T12:18:21.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2fa40cd9f0 0x7f2fa406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415b340 0x7f2fa406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa9e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa40b4300 con 0x7f2fa415af60 2024-09-12T12:18:21.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa9e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa40b32f0 con 0x7f2fa40cd9f0 2024-09-12T12:18:21.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa9e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa40b3540 con 0x7f2fa415b340 2024-09-12T12:18:21.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2fa415af60 0x7f2fa40ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58926/0 (socket says 172.21.15.144:58926) 2024-09-12T12:18:21.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa2a00640 1 -- 172.21.15.144:0/494577843 learned_addr learned my addr 172.21.15.144:0/494577843 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:21.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa3400640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415b340 0x7f2fa406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa2000640 1 --2- 172.21.15.144:0/494577843 >> v2:172.21.15.165:3300/0 conn(0x7f2fa40cd9f0 0x7f2fa406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1457515320 0 0) 0x7f2fa40b4300 con 0x7f2fa415af60 2024-09-12T12:18:21.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f88003530 con 0x7f2fa415af60 2024-09-12T12:18:21.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 255230911 0 0) 0x7f2f88003530 con 0x7f2fa415af60 2024-09-12T12:18:21.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415b340 msgr2=0x7f2fa406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:21.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415b340 0x7f2fa406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 >> v2:172.21.15.165:3300/0 conn(0x7f2fa40cd9f0 msgr2=0x7f2fa406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:21.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 --2- 172.21.15.144:0/494577843 >> v2:172.21.15.165:3300/0 conn(0x7f2fa40cd9f0 0x7f2fa406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa40b3820 con 0x7f2fa415af60 2024-09-12T12:18:21.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f2f94001a00 con 0x7f2fa415af60 2024-09-12T12:18:21.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 >> v1:172.21.15.144:6789/0 conn(0x7f2fa415af60 legacy=0x7f2fa40ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f880039c0 0x7f2f88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f88004810 0x7f2f88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415b340 0x7f2f880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa40b32f0 con 0x7f2f880039c0 2024-09-12T12:18:21.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa40b3540 con 0x7f2f88004810 2024-09-12T12:18:21.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8800b9d0 con 0x7f2fa415b340 2024-09-12T12:18:21.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa2a00640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f880039c0 0x7f2f88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa3400640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415b340 0x7f2f880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.433+0000 7f2fa2000640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f88004810 0x7f2f88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa2a00640 1 -- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415b340 msgr2=0x7f2f880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:21.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa2a00640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415b340 0x7f2f880051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa2a00640 1 -- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f88004810 msgr2=0x7f2f88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:21.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa2a00640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f88004810 0x7f2f88004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa2a00640 1 -- 172.21.15.144:0/494577843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f88003530 con 0x7f2f880039c0 2024-09-12T12:18:21.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa2a00640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f880039c0 0x7f2f88003de0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400a7d0 tx=0x7f2f9401d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f5472e90571f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:21.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400a3f0 con 0x7f2f880039c0 2024-09-12T12:18:21.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f940a9020 con 0x7f2f880039c0 2024-09-12T12:18:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa1600640 1 -- 172.21.15.144:0/494577843 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f940070d0 con 0x7f2f880039c0 2024-09-12T12:18:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa9e00640 1 -- 172.21.15.144:0/494577843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f880039c0 msgr2=0x7f2f88003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa9e00640 1 --2- 172.21.15.144:0/494577843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f880039c0 0x7f2f88003de0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400a7d0 tx=0x7f2f9401d2a0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.437+0000 7f2fa3400640 1 -- 172.21.15.144:0/494577843 reap_dead start 2024-09-12T12:18:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 -- 172.21.15.144:0/494577843 shutdown_connections 2024-09-12T12:18:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 -- 172.21.15.144:0/494577843 >> 172.21.15.144:0/494577843 conn(0x7f2fa4068030 msgr2=0x7f2fa40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 -- 172.21.15.144:0/494577843 shutdown_connections 2024-09-12T12:18:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 -- 172.21.15.144:0/494577843 wait complete. 2024-09-12T12:18:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 Processor -- start 2024-09-12T12:18:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 -- start start 2024-09-12T12:18:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f880039c0 0x7f2fa415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fa415a120 0x7f2fa414af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415a5a0 0x7f2fa414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa40b5140 con 0x7f2fa415a120 2024-09-12T12:18:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa40b4fc0 con 0x7f2f880039c0 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa40b52c0 con 0x7f2fa415a5a0 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fa415a120 0x7f2fa414af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fa415a120 0x7f2fa414af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60320/0 (socket says 172.21.15.144:60320) 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2000640 1 -- 172.21.15.144:0/2477119702 learned_addr learned my addr 172.21.15.144:0/2477119702 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa3400640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415a5a0 0x7f2fa414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2a00640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f880039c0 0x7f2fa415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2000640 1 -- 172.21.15.144:0/2477119702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415a5a0 msgr2=0x7f2fa414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2000640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415a5a0 0x7f2fa414b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2000640 1 -- 172.21.15.144:0/2477119702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f880039c0 msgr2=0x7f2fa415cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2000640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f880039c0 0x7f2fa415cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2000640 1 -- 172.21.15.144:0/2477119702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa415d1b0 con 0x7f2fa415a120 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa2000640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fa415a120 0x7f2fa414af00 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2f900119d0 tx=0x7f2f90011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2f9b400640 1 -- 172.21.15.144:0/2477119702 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000fb50 con 0x7f2fa415a120 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2f9b400640 1 -- 172.21.15.144:0/2477119702 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9000fcf0 con 0x7f2fa415a120 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa415bbd0 con 0x7f2fa415a120 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.441+0000 7f2f9b400640 1 -- 172.21.15.144:0/2477119702 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000fea0 con 0x7f2fa415a120 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.445+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa415c190 con 0x7f2fa415a120 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.445+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa406bc10 con 0x7f2fa415a120 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.445+0000 7f2f9b400640 1 -- 172.21.15.144:0/2477119702 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f90012040 con 0x7f2fa415a120 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.445+0000 7f2f9b400640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f840678c0 0x7f2f84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.445+0000 7f2f9b400640 1 -- 172.21.15.144:0/2477119702 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7f2f90086280 con 0x7f2fa415a120 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.445+0000 7f2fa2a00640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f840678c0 0x7f2f84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.445+0000 7f2fa2a00640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f840678c0 0x7f2f84069d80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2f940aa000 tx=0x7f2f94001d70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:21.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.449+0000 7f2f9b400640 1 -- 172.21.15.144:0/2477119702 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f90019030 con 0x7f2fa415a120 2024-09-12T12:18:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.609+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2fa40afc20 con 0x7f2fa415a120 2024-09-12T12:18:21.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.613+0000 7f2f9b400640 1 -- 172.21.15.144:0/2477119702 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f2f90056800 con 0x7f2fa415a120 2024-09-12T12:18:21.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f840678c0 msgr2=0x7f2f84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f840678c0 0x7f2f84069d80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2f940aa000 tx=0x7f2f94001d70 comp rx=0 tx=0).stop 2024-09-12T12:18:21.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fa415a120 msgr2=0x7f2fa414af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fa415a120 0x7f2fa414af00 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f2f900119d0 tx=0x7f2f90011e90 comp rx=0 tx=0).stop 2024-09-12T12:18:21.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 shutdown_connections 2024-09-12T12:18:21.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f840678c0 0x7f2f84069d80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fa415a5a0 0x7f2fa414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fa415a120 0x7f2fa414af00 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 --2- 172.21.15.144:0/2477119702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f880039c0 0x7f2fa415cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 >> 172.21.15.144:0/2477119702 conn(0x7f2fa4068030 msgr2=0x7f2fa4073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:21.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 shutdown_connections 2024-09-12T12:18:21.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.617+0000 7f2fa9e00640 1 -- 172.21.15.144:0/2477119702 wait complete. 2024-09-12T12:18:21.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-12T12:18:21.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3f07000640 1 Processor -- start 2024-09-12T12:18:21.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3f07000640 1 -- start start 2024-09-12T12:18:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3f07000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f0015af60 0x7f3f000ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3f07000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f000b4300 con 0x7f3f000cd9f0 2024-09-12T12:18:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3f07000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f000b3540 con 0x7f3f0006c320 2024-09-12T12:18:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3f07000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3f000b32f0 con 0x7f3f0015af60 2024-09-12T12:18:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3eff400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3f000cd9f0 0x7f3f0006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58936/0 (socket says 172.21.15.144:58936) 2024-09-12T12:18:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3eff400640 1 -- 172.21.15.144:0/1678908682 learned_addr learned my addr 172.21.15.144:0/1678908682 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3effe00640 1 --2- 172.21.15.144:0/1678908682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f0015af60 0x7f3f000ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3efea00640 1 -- 172.21.15.144:0/1678908682 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919978152 0 0) 0x7f3f000b4300 con 0x7f3f000cd9f0 2024-09-12T12:18:21.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.773+0000 7f3efea00640 1 -- 172.21.15.144:0/1678908682 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ee4003530 con 0x7f3f000cd9f0 2024-09-12T12:18:21.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3efea00640 1 -- 172.21.15.144:0/1678908682 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673103278 0 0) 0x7f3f000b3540 con 0x7f3f0006c320 2024-09-12T12:18:21.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3efea00640 1 -- 172.21.15.144:0/1678908682 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f000b4300 con 0x7f3f0006c320 2024-09-12T12:18:21.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3efea00640 1 -- 172.21.15.144:0/1678908682 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1525179323 0 0) 0x7f3ee4003530 con 0x7f3f000cd9f0 2024-09-12T12:18:21.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3effe00640 1 -- 172.21.15.144:0/1678908682 >> v1:172.21.15.165:6789/0 conn(0x7f3f0006c320 legacy=0x7f3f000b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3effe00640 1 -- 172.21.15.144:0/1678908682 >> v1:172.21.15.144:6789/0 conn(0x7f3f000cd9f0 legacy=0x7f3f0006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3effe00640 1 -- 172.21.15.144:0/1678908682 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f000b3820 con 0x7f3f0015af60 2024-09-12T12:18:21.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3effe00640 1 --2- 172.21.15.144:0/1678908682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f0015af60 0x7f3f000ce680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00097f0 tx=0x7f3ef001ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e77ce8835519fe73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:21.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3efea00640 1 -- 172.21.15.144:0/1678908682 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00b5070 con 0x7f3f0015af60 2024-09-12T12:18:21.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3efea00640 1 -- 172.21.15.144:0/1678908682 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef00a8670 con 0x7f3f0015af60 2024-09-12T12:18:21.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3efea00640 1 -- 172.21.15.144:0/1678908682 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec001680 con 0x7f3f0015af60 2024-09-12T12:18:21.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3f07000640 1 -- 172.21.15.144:0/1678908682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f0015af60 msgr2=0x7f3f000ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.777+0000 7f3f07000640 1 --2- 172.21.15.144:0/1678908682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f0015af60 0x7f3f000ce680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00097f0 tx=0x7f3ef001ebf0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 -- 172.21.15.144:0/1678908682 shutdown_connections 2024-09-12T12:18:21.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 --2- 172.21.15.144:0/1678908682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f0015af60 0x7f3f000ce680 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 -- 172.21.15.144:0/1678908682 >> 172.21.15.144:0/1678908682 conn(0x7f3f00068030 msgr2=0x7f3f000b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:21.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 -- 172.21.15.144:0/1678908682 shutdown_connections 2024-09-12T12:18:21.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 -- 172.21.15.144:0/1678908682 wait complete. 2024-09-12T12:18:21.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 Processor -- start 2024-09-12T12:18:21.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 -- start start 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0006c320 0x7f3f00157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f000cd9f0 0x7f3f0015dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0015af60 0x7f3f00147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3f000cebc0 con 0x7f3f0015af60 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3f000b3de0 con 0x7f3f0006c320 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f07000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3f000ced40 con 0x7f3f000cd9f0 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f05000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0015af60 0x7f3f00147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3effe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0006c320 0x7f3f00157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3effe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0006c320 0x7f3f00157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:34958/0 (socket says 172.21.15.144:34958) 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3eff400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f000cd9f0 0x7f3f0015dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f05000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0015af60 0x7f3f00147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60326/0 (socket says 172.21.15.144:60326) 2024-09-12T12:18:21.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3effe00640 1 -- 172.21.15.144:0/616306420 learned_addr learned my addr 172.21.15.144:0/616306420 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f05000640 1 -- 172.21.15.144:0/616306420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f000cd9f0 msgr2=0x7f3f0015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f05000640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f000cd9f0 0x7f3f0015dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f05000640 1 -- 172.21.15.144:0/616306420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0006c320 msgr2=0x7f3f00157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f05000640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0006c320 0x7f3f00157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f05000640 1 -- 172.21.15.144:0/616306420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f001477c0 con 0x7f3f0015af60 2024-09-12T12:18:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3effe00640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0006c320 0x7f3f00157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.781+0000 7f3f05000640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0015af60 0x7f3f00147280 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8002240 tx=0x7f3ef800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3ef7e00640 1 -- 172.21.15.144:0/616306420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8016020 con 0x7f3f0015af60 2024-09-12T12:18:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3ef7e00640 1 -- 172.21.15.144:0/616306420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef8006d60 con 0x7f3f0015af60 2024-09-12T12:18:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3ef7e00640 1 -- 172.21.15.144:0/616306420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8005240 con 0x7f3f0015af60 2024-09-12T12:18:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f00159570 con 0x7f3f0015af60 2024-09-12T12:18:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f001587b0 con 0x7f3f0015af60 2024-09-12T12:18:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f001571a0 con 0x7f3f0015af60 2024-09-12T12:18:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3ef7e00640 1 -- 172.21.15.144:0/616306420 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ef80055f0 con 0x7f3f0015af60 2024-09-12T12:18:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3ef7e00640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ee00678c0 0x7f3ee0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3ef7e00640 1 -- 172.21.15.144:0/616306420 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7f3ef8085930 con 0x7f3f0015af60 2024-09-12T12:18:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3effe00640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ee00678c0 0x7f3ee0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.785+0000 7f3effe00640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ee00678c0 0x7f3ee0069d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3ef001d2a0 tx=0x7f3ef00aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.789+0000 7f3ef7e00640 1 -- 172.21.15.144:0/616306420 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3ef8020020 con 0x7f3f0015af60 2024-09-12T12:18:21.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.945+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f3f000afc20 con 0x7f3f0015af60 2024-09-12T12:18:21.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3ef7e00640 1 -- 172.21.15.144:0/616306420 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v33) ==== 101+0+0 (secure 0 0 0) 0x7f3ef8055e90 con 0x7f3f0015af60 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ee00678c0 msgr2=0x7f3ee0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ee00678c0 0x7f3ee0069d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3ef001d2a0 tx=0x7f3ef00aa070 comp rx=0 tx=0).stop 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0015af60 msgr2=0x7f3f00147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0015af60 0x7f3f00147280 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8002240 tx=0x7f3ef800cb90 comp rx=0 tx=0).stop 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 shutdown_connections 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ee00678c0 0x7f3ee0069d80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f0015af60 0x7f3f00147280 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f000cd9f0 0x7f3f0015dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 --2- 172.21.15.144:0/616306420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0006c320 0x7f3f00157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.953+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 >> 172.21.15.144:0/616306420 conn(0x7f3f00068030 msgr2=0x7f3f00155490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.957+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 shutdown_connections 2024-09-12T12:18:21.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:21.957+0000 7f3f07000640 1 -- 172.21.15.144:0/616306420 wait complete. 2024-09-12T12:18:21.974 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-12T12:18:22.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.109+0000 7efc43200640 1 Processor -- start 2024-09-12T12:18:22.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.109+0000 7efc43200640 1 -- start start 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc43200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3c071420 0x7efc3c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc43200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3c0b45a0 con 0x7efc3c15b4e0 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc43200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3c0b3fe0 con 0x7efc3c0ccf30 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc43200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efc3c0b42c0 con 0x7efc3c071420 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc3b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3c071420 0x7efc3c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc3b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3c071420 0x7efc3c071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60332/0 (socket says 172.21.15.144:60332) 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc3b400640 1 -- 172.21.15.144:0/4053740876 learned_addr learned my addr 172.21.15.144:0/4053740876 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc3be00640 1 --1- 172.21.15.144:0/4053740876 >> v1:172.21.15.144:6789/0 conn(0x7efc3c15b4e0 0x7efc3c0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58946/0 (socket says 172.21.15.144:58946) 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc3b400640 1 -- 172.21.15.144:0/4053740876 >> v1:172.21.15.165:6789/0 conn(0x7efc3c0ccf30 legacy=0x7efc3c0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc3b400640 1 -- 172.21.15.144:0/4053740876 >> v1:172.21.15.144:6789/0 conn(0x7efc3c15b4e0 legacy=0x7efc3c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.113+0000 7efc3b400640 1 -- 172.21.15.144:0/4053740876 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c0b1490 con 0x7efc3c071420 2024-09-12T12:18:22.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc3b400640 1 --2- 172.21.15.144:0/4053740876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c071420 0x7efc3c071840 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7efc28009870 tx=0x7efc2801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d6db7a206c82a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:22.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc3aa00640 1 -- 172.21.15.144:0/4053740876 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc280aa620 con 0x7efc3c071420 2024-09-12T12:18:22.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc3aa00640 1 -- 172.21.15.144:0/4053740876 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc280af070 con 0x7efc3c071420 2024-09-12T12:18:22.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc3aa00640 1 -- 172.21.15.144:0/4053740876 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc280aa9e0 con 0x7efc3c071420 2024-09-12T12:18:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 -- 172.21.15.144:0/4053740876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c071420 msgr2=0x7efc3c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 --2- 172.21.15.144:0/4053740876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c071420 0x7efc3c071840 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7efc28009870 tx=0x7efc2801c530 comp rx=0 tx=0).stop 2024-09-12T12:18:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 -- 172.21.15.144:0/4053740876 shutdown_connections 2024-09-12T12:18:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 --2- 172.21.15.144:0/4053740876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c071420 0x7efc3c071840 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 -- 172.21.15.144:0/4053740876 >> 172.21.15.144:0/4053740876 conn(0x7efc3c06d0d0 msgr2=0x7efc3c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 -- 172.21.15.144:0/4053740876 shutdown_connections 2024-09-12T12:18:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 -- 172.21.15.144:0/4053740876 wait complete. 2024-09-12T12:18:22.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 Processor -- start 2024-09-12T12:18:22.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 -- start start 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc3c071420 0x7efc3c151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3c0ccf30 0x7efc3c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c15b4e0 0x7efc3c15f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c15b8c0 con 0x7efc3c15b4e0 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c169270 con 0x7efc3c071420 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc43200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc3c159370 con 0x7efc3c0ccf30 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.117+0000 7efc41200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c15b4e0 0x7efc3c15f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc41200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c15b4e0 0x7efc3c15f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60336/0 (socket says 172.21.15.144:60336) 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc41200640 1 -- 172.21.15.144:0/3650288991 learned_addr learned my addr 172.21.15.144:0/3650288991 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc3be00640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc3c071420 0x7efc3c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc3b400640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3c0ccf30 0x7efc3c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc41200640 1 -- 172.21.15.144:0/3650288991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3c0ccf30 msgr2=0x7efc3c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc41200640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3c0ccf30 0x7efc3c15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc41200640 1 -- 172.21.15.144:0/3650288991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc3c071420 msgr2=0x7efc3c151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc41200640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc3c071420 0x7efc3c151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc41200640 1 -- 172.21.15.144:0/3650288991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c159650 con 0x7efc3c15b4e0 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc41200640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c15b4e0 0x7efc3c15f4e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c460 tx=0x7efc3400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc33e00640 1 -- 172.21.15.144:0/3650288991 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34016020 con 0x7efc3c15b4e0 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc33e00640 1 -- 172.21.15.144:0/3650288991 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc34005220 con 0x7efc3c15b4e0 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3c159930 con 0x7efc3c15b4e0 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc33e00640 1 -- 172.21.15.144:0/3650288991 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34007030 con 0x7efc3c15b4e0 2024-09-12T12:18:22.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3c165e80 con 0x7efc3c15b4e0 2024-09-12T12:18:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3c072000 con 0x7efc3c15b4e0 2024-09-12T12:18:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc33e00640 1 -- 172.21.15.144:0/3650288991 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc340071d0 con 0x7efc3c15b4e0 2024-09-12T12:18:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc33e00640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc1c0678c0 0x7efc1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.121+0000 7efc33e00640 1 -- 172.21.15.144:0/3650288991 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7efc340855b0 con 0x7efc3c15b4e0 2024-09-12T12:18:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.125+0000 7efc3be00640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc1c0678c0 0x7efc1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.125+0000 7efc3be00640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc1c0678c0 0x7efc1c069d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efc2c005fd0 tx=0x7efc2c005ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:22.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.129+0000 7efc33e00640 1 -- 172.21.15.144:0/3650288991 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efc34020020 con 0x7efc3c15b4e0 2024-09-12T12:18:22.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.341+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7efc3c0686c0 con 0x7efc3c15b4e0 2024-09-12T12:18:22.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.585+0000 7efc33e00640 1 -- 172.21.15.144:0/3650288991 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v298) ==== 151+0+0 (secure 0 0 0) 0x7efc340074c0 con 0x7efc3c15b4e0 2024-09-12T12:18:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc1c0678c0 msgr2=0x7efc1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc1c0678c0 0x7efc1c069d80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efc2c005fd0 tx=0x7efc2c005ba0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c15b4e0 msgr2=0x7efc3c15f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c15b4e0 0x7efc3c15f4e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c460 tx=0x7efc3400c920 comp rx=0 tx=0).stop 2024-09-12T12:18:22.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 shutdown_connections 2024-09-12T12:18:22.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc1c0678c0 0x7efc1c069d80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c15b4e0 0x7efc3c15f4e0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3c0ccf30 0x7efc3c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 --2- 172.21.15.144:0/3650288991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc3c071420 0x7efc3c151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 >> 172.21.15.144:0/3650288991 conn(0x7efc3c06d0d0 msgr2=0x7efc3c072740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:22.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 shutdown_connections 2024-09-12T12:18:22.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.589+0000 7efc43200640 1 -- 172.21.15.144:0/3650288991 wait complete. 2024-09-12T12:18:22.608 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-09-12T12:18:22.608 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-09-12T12:18:22.608 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-12T12:18:22.609 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:18:22.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c9400640 1 Processor -- start 2024-09-12T12:18:22.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c9400640 1 -- start start 2024-09-12T12:18:22.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c9400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f32c415ad50 0x7f32c415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32c40b3590 0x7f32c40b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b4810 0x7f32c40b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c9400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f32c415f860 con 0x7f32c40b3590 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c9400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f32c40b4c60 con 0x7f32c415ad50 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c9400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32c40cdeb0 con 0x7f32c40b4810 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32b9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32c40b3590 0x7f32c40b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32b9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32c40b3590 0x7f32c40b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60348/0 (socket says 172.21.15.144:60348) 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32b9e00640 1 -- 172.21.15.144:0/3076589081 learned_addr learned my addr 172.21.15.144:0/3076589081 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c2800640 1 --2- 172.21.15.144:0/3076589081 >> v2:172.21.15.165:3300/0 conn(0x7f32c415ad50 0x7f32c415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32c3200640 1 --2- 172.21.15.144:0/3076589081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b4810 0x7f32c40b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32b9e00640 1 -- 172.21.15.144:0/3076589081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b4810 msgr2=0x7f32c40b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:22.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32b9e00640 1 --2- 172.21.15.144:0/3076589081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b4810 0x7f32c40b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32b9e00640 1 -- 172.21.15.144:0/3076589081 >> v2:172.21.15.165:3300/0 conn(0x7f32c415ad50 msgr2=0x7f32c415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:22.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32b9e00640 1 --2- 172.21.15.144:0/3076589081 >> v2:172.21.15.165:3300/0 conn(0x7f32c415ad50 0x7f32c415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.745+0000 7f32b9e00640 1 -- 172.21.15.144:0/3076589081 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c40b3aa0 con 0x7f32c40b3590 2024-09-12T12:18:22.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32b9e00640 1 --2- 172.21.15.144:0/3076589081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b3590 0x7f32c40b42d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f32c40d14f0 tx=0x7f32ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a3cfc6a0b05e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:22.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c1e00640 1 -- 172.21.15.144:0/3076589081 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0b0070 con 0x7f32c40b3590 2024-09-12T12:18:22.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c1e00640 1 -- 172.21.15.144:0/3076589081 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac004230 con 0x7f32c40b3590 2024-09-12T12:18:22.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c1e00640 1 -- 172.21.15.144:0/3076589081 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac003620 con 0x7f32c40b3590 2024-09-12T12:18:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c9400640 1 -- 172.21.15.144:0/3076589081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b3590 msgr2=0x7f32c40b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c9400640 1 --2- 172.21.15.144:0/3076589081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b3590 0x7f32c40b42d0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f32c40d14f0 tx=0x7f32ac01c520 comp rx=0 tx=0).stop 2024-09-12T12:18:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c9400640 1 -- 172.21.15.144:0/3076589081 shutdown_connections 2024-09-12T12:18:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c9400640 1 --2- 172.21.15.144:0/3076589081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b3590 0x7f32c40b42d0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c9400640 1 --2- 172.21.15.144:0/3076589081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b4810 0x7f32c40b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c9400640 1 --2- 172.21.15.144:0/3076589081 >> v2:172.21.15.165:3300/0 conn(0x7f32c415ad50 0x7f32c415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c9400640 1 -- 172.21.15.144:0/3076589081 >> 172.21.15.144:0/3076589081 conn(0x7f32c406d0d0 msgr2=0x7f32c406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c9400640 1 -- 172.21.15.144:0/3076589081 shutdown_connections 2024-09-12T12:18:22.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.749+0000 7f32c9400640 1 -- 172.21.15.144:0/3076589081 wait complete. 2024-09-12T12:18:22.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 Processor -- start 2024-09-12T12:18:22.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 -- start start 2024-09-12T12:18:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b3590 0x7f32c41f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b4810 0x7f32c415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c415ad50 0x7f32c40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f32c415b2b0 con 0x7f32c40b4810 2024-09-12T12:18:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f32c415b130 con 0x7f32c415ad50 2024-09-12T12:18:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32c40b1800 con 0x7f32c40b3590 2024-09-12T12:18:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32b9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b4810 0x7f32c415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32b9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b4810 0x7f32c415db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60364/0 (socket says 172.21.15.144:60364) 2024-09-12T12:18:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32b9e00640 1 -- 172.21.15.144:0/1596573174 learned_addr learned my addr 172.21.15.144:0/1596573174 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c2800640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b3590 0x7f32c41f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c3200640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c415ad50 0x7f32c40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32b9e00640 1 -- 172.21.15.144:0/1596573174 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b3590 msgr2=0x7f32c41f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32b9e00640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b3590 0x7f32c41f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32b9e00640 1 -- 172.21.15.144:0/1596573174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c415ad50 msgr2=0x7f32c40ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32b9e00640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c415ad50 0x7f32c40ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32b9e00640 1 -- 172.21.15.144:0/1596573174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c414e500 con 0x7f32c40b4810 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32b9e00640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b4810 0x7f32c415db50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f32ac01abd0 tx=0x7f32ac0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32bb400640 1 -- 172.21.15.144:0/1596573174 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0b0040 con 0x7f32c40b4810 2024-09-12T12:18:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32bb400640 1 -- 172.21.15.144:0/1596573174 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac004030 con 0x7f32c40b4810 2024-09-12T12:18:22.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c414e7e0 con 0x7f32c40b4810 2024-09-12T12:18:22.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32bb400640 1 -- 172.21.15.144:0/1596573174 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0ab440 con 0x7f32c40b4810 2024-09-12T12:18:22.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.753+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c414f080 con 0x7f32c40b4810 2024-09-12T12:18:22.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.757+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c414ebd0 con 0x7f32c40b4810 2024-09-12T12:18:22.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.757+0000 7f32bb400640 1 -- 172.21.15.144:0/1596573174 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32ac0bd020 con 0x7f32c40b4810 2024-09-12T12:18:22.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.757+0000 7f32bb400640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32a00678c0 0x7f32a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:22.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.757+0000 7f32bb400640 1 -- 172.21.15.144:0/1596573174 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7f32ac11f670 con 0x7f32c40b4810 2024-09-12T12:18:22.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.757+0000 7f32c2800640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32a00678c0 0x7f32a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:22.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.757+0000 7f32c2800640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32a00678c0 0x7f32a0069d80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f32b4007a60 tx=0x7f32b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:22.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.761+0000 7f32bb400640 1 -- 172.21.15.144:0/1596573174 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f32ac0c4020 con 0x7f32c40b4810 2024-09-12T12:18:22.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.917+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32c414e9b0 con 0x7f32c40b4810 2024-09-12T12:18:22.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32bb400640 1 -- 172.21.15.144:0/1596573174 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+13723 (secure 0 0 0) 0x7f32ac016110 con 0x7f32c40b4810 2024-09-12T12:18:22.919 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:22.919 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":105,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:18:20.572304+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/1676869896":"2024-09-13T12:18:17.413719+0000","172.21.15.144:6834/76101968":"2024-09-13T12:18:00.380227+0000","172.21.15.144:6837/736758853":"2024-09-13T12:18:00.365431+0000","172.21.15.144:6835/736758853":"2024-09-13T12:18:00.365431+0000","172.21.15.165:6835/2978712683":"2024-09-13T12:18:00.354946+0000","172.21.15.144:6834/1676869896":"2024-09-13T12:18:17.413719+0000","172.21.15.144:6836/76101968":"2024-09-13T12:18:00.380227+0000","172.21.15.165:6832/2978712683":"2024-09-13T12:18:00.354946+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:18:22.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32a00678c0 msgr2=0x7f32a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32a00678c0 0x7f32a0069d80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f32b4007a60 tx=0x7f32b4008040 comp rx=0 tx=0).stop 2024-09-12T12:18:22.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b4810 msgr2=0x7f32c415db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:22.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b4810 0x7f32c415db50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f32ac01abd0 tx=0x7f32ac0192c0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 shutdown_connections 2024-09-12T12:18:22.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f32a00678c0 0x7f32a0069d80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c415ad50 0x7f32c40ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c40b4810 0x7f32c415db50 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 --2- 172.21.15.144:0/1596573174 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c40b3590 0x7f32c41f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:22.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 >> 172.21.15.144:0/1596573174 conn(0x7f32c406d0d0 msgr2=0x7f32c41571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:22.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 shutdown_connections 2024-09-12T12:18:22.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:22.921+0000 7f32c9400640 1 -- 172.21.15.144:0/1596573174 wait complete. 2024-09-12T12:18:22.940 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:18:22.940 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:18:23.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.077+0000 7fa667600640 1 Processor -- start 2024-09-12T12:18:23.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.077+0000 7fa667600640 1 -- start start 2024-09-12T12:18:23.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa667600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa6600cd9f0 0x7fa66006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa667600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa66015b340 0x7fa66006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa667600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6600b4300 con 0x7fa66015af60 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa667600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa6600b32f0 con 0x7fa66015b340 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa667600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa6600b3540 con 0x7fa6600cd9f0 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa665600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa66015b340 0x7fa66006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa665600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa66015b340 0x7fa66006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60368/0 (socket says 172.21.15.144:60368) 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa665600640 1 -- 172.21.15.144:0/1947442910 learned_addr learned my addr 172.21.15.144:0/1947442910 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa665600640 1 -- 172.21.15.144:0/1947442910 >> v2:172.21.15.165:3300/0 conn(0x7fa6600cd9f0 msgr2=0x7fa66006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa65fe00640 1 --2- 172.21.15.144:0/1947442910 >> v2:172.21.15.165:3300/0 conn(0x7fa6600cd9f0 0x7fa66006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa665600640 1 --2- 172.21.15.144:0/1947442910 >> v2:172.21.15.165:3300/0 conn(0x7fa6600cd9f0 0x7fa66006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa665600640 1 -- 172.21.15.144:0/1947442910 >> v1:172.21.15.165:6789/0 conn(0x7fa66015af60 legacy=0x7fa6600ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa665600640 1 -- 172.21.15.144:0/1947442910 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6600b3820 con 0x7fa66015b340 2024-09-12T12:18:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.081+0000 7fa65fe00640 1 --2- 172.21.15.144:0/1947442910 >> v2:172.21.15.165:3300/0 conn(0x7fa6600cd9f0 0x7fa66006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:23.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa665600640 1 --2- 172.21.15.144:0/1947442910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa66015b340 0x7fa66006c150 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa660070d20 tx=0x7fa65801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d664e43599f4c45e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:23.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa65f400640 1 -- 172.21.15.144:0/1947442910 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6580b0070 con 0x7fa66015b340 2024-09-12T12:18:23.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa65f400640 1 -- 172.21.15.144:0/1947442910 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6580ab600 con 0x7fa66015b340 2024-09-12T12:18:23.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa65f400640 1 -- 172.21.15.144:0/1947442910 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6580ab9d0 con 0x7fa66015b340 2024-09-12T12:18:23.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 -- 172.21.15.144:0/1947442910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa66015b340 msgr2=0x7fa66006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:23.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 --2- 172.21.15.144:0/1947442910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa66015b340 0x7fa66006c150 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fa660070d20 tx=0x7fa65801c4e0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 -- 172.21.15.144:0/1947442910 shutdown_connections 2024-09-12T12:18:23.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 --2- 172.21.15.144:0/1947442910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa66015b340 0x7fa66006c150 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 --2- 172.21.15.144:0/1947442910 >> v2:172.21.15.165:3300/0 conn(0x7fa6600cd9f0 0x7fa66006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 -- 172.21.15.144:0/1947442910 >> 172.21.15.144:0/1947442910 conn(0x7fa660068030 msgr2=0x7fa6600b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:23.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 -- 172.21.15.144:0/1947442910 shutdown_connections 2024-09-12T12:18:23.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 -- 172.21.15.144:0/1947442910 wait complete. 2024-09-12T12:18:23.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 Processor -- start 2024-09-12T12:18:23.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 -- start start 2024-09-12T12:18:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6600cd9f0 0x7fa66015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.085+0000 7fa667600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa66015af60 0x7fa66015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa667600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa66015b340 0x7fa660071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa667600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600b5180 con 0x7fa6600cd9f0 2024-09-12T12:18:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa667600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600b5000 con 0x7fa66015af60 2024-09-12T12:18:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa667600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6600b5300 con 0x7fa66015b340 2024-09-12T12:18:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa664c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6600cd9f0 0x7fa66015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa664c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6600cd9f0 0x7fa66015a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60378/0 (socket says 172.21.15.144:60378) 2024-09-12T12:18:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa664c00640 1 -- 172.21.15.144:0/4055541319 learned_addr learned my addr 172.21.15.144:0/4055541319 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa664c00640 1 -- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa66015b340 msgr2=0x7fa660071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa665600640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa66015b340 0x7fa660071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa65fe00640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa66015af60 0x7fa66015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa664c00640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa66015b340 0x7fa660071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa664c00640 1 -- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa66015af60 msgr2=0x7fa66015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa664c00640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa66015af60 0x7fa66015bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa664c00640 1 -- 172.21.15.144:0/4055541319 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66015dc30 con 0x7fa6600cd9f0 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa665600640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa66015b340 0x7fa660071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa65fe00640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa66015af60 0x7fa66015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa664c00640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6600cd9f0 0x7fa66015a0b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa65000c7f0 tx=0x7fa65000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa65cc00640 1 -- 172.21.15.144:0/4055541319 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650016020 con 0x7fa6600cd9f0 2024-09-12T12:18:23.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa65cc00640 1 -- 172.21.15.144:0/4055541319 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65000aa50 con 0x7fa6600cd9f0 2024-09-12T12:18:23.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66015df10 con 0x7fa6600cd9f0 2024-09-12T12:18:23.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa65cc00640 1 -- 172.21.15.144:0/4055541319 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65000ae40 con 0x7fa6600cd9f0 2024-09-12T12:18:23.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66015e4d0 con 0x7fa6600cd9f0 2024-09-12T12:18:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6600ce680 con 0x7fa6600cd9f0 2024-09-12T12:18:23.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.089+0000 7fa65cc00640 1 -- 172.21.15.144:0/4055541319 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa650019020 con 0x7fa6600cd9f0 2024-09-12T12:18:23.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.093+0000 7fa65cc00640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6400678c0 0x7fa640069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.093+0000 7fa65cc00640 1 -- 172.21.15.144:0/4055541319 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7fa650085d30 con 0x7fa6600cd9f0 2024-09-12T12:18:23.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.093+0000 7fa65fe00640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6400678c0 0x7fa640069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.093+0000 7fa65fe00640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6400678c0 0x7fa640069d80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa6600af6c0 tx=0x7fa64c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:23.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.097+0000 7fa65cc00640 1 -- 172.21.15.144:0/4055541319 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa650020030 con 0x7fa6600cd9f0 2024-09-12T12:18:23.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.253+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa6600afc20 con 0x7fa6600cd9f0 2024-09-12T12:18:23.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa65cc00640 1 -- 172.21.15.144:0/4055541319 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) ==== 93+0+10 (secure 0 0 0) 0x7fa650056840 con 0x7fa6600cd9f0 2024-09-12T12:18:23.255 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:18:23.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6400678c0 msgr2=0x7fa640069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:23.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6400678c0 0x7fa640069d80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa6600af6c0 tx=0x7fa64c008040 comp rx=0 tx=0).stop 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6600cd9f0 msgr2=0x7fa66015a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6600cd9f0 0x7fa66015a0b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fa65000c7f0 tx=0x7fa65000ccb0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 shutdown_connections 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6400678c0 0x7fa640069d80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa66015b340 0x7fa660071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa66015af60 0x7fa66015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 --2- 172.21.15.144:0/4055541319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6600cd9f0 0x7fa66015a0b0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 >> 172.21.15.144:0/4055541319 conn(0x7fa660068030 msgr2=0x7fa6600b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 shutdown_connections 2024-09-12T12:18:23.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.257+0000 7fa667600640 1 -- 172.21.15.144:0/4055541319 wait complete. 2024-09-12T12:18:23.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-12T12:18:23.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.413+0000 7f83bf200640 1 Processor -- start 2024-09-12T12:18:23.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.413+0000 7f83bf200640 1 -- start start 2024-09-12T12:18:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bf200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f83b8071420 0x7f83b8071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bf200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f83b80ccf30 0x7f83b80cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bf200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b80cd890 con 0x7f83b815b4e0 2024-09-12T12:18:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bf200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f83b80b45a0 con 0x7f83b80ccf30 2024-09-12T12:18:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bf200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f83b80b3fe0 con 0x7f83b8071420 2024-09-12T12:18:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bd200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f83b80ccf30 0x7f83b80cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83b7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f83b815b4e0 0x7f83b80b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58954/0 (socket says 172.21.15.144:58954) 2024-09-12T12:18:23.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83b7e00640 1 -- 172.21.15.144:0/805083654 learned_addr learned my addr 172.21.15.144:0/805083654 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83b7400640 1 --2- 172.21.15.144:0/805083654 >> v2:172.21.15.165:3300/0 conn(0x7f83b8071420 0x7f83b8071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bd200640 1 -- 172.21.15.144:0/805083654 >> v2:172.21.15.165:3300/0 conn(0x7f83b8071420 msgr2=0x7f83b8071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bd200640 1 --2- 172.21.15.144:0/805083654 >> v2:172.21.15.165:3300/0 conn(0x7f83b8071420 0x7f83b8071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83b6a00640 1 -- 172.21.15.144:0/805083654 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016868891 0 0) 0x7f83b80cd890 con 0x7f83b815b4e0 2024-09-12T12:18:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bd200640 1 -- 172.21.15.144:0/805083654 >> v1:172.21.15.144:6789/0 conn(0x7f83b815b4e0 legacy=0x7f83b80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:23.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.417+0000 7f83bd200640 1 -- 172.21.15.144:0/805083654 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b80b42c0 con 0x7f83b80ccf30 2024-09-12T12:18:23.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bd200640 1 --2- 172.21.15.144:0/805083654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b80ccf30 0x7f83b80cd350 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f83b80b02b0 tx=0x7f83b001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1520da03eb4db91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:23.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83b6a00640 1 -- 172.21.15.144:0/805083654 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b00b2070 con 0x7f83b80ccf30 2024-09-12T12:18:23.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83b6a00640 1 -- 172.21.15.144:0/805083654 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b00a59c0 con 0x7f83b80ccf30 2024-09-12T12:18:23.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83b6a00640 1 -- 172.21.15.144:0/805083654 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b00a5d90 con 0x7f83b80ccf30 2024-09-12T12:18:23.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 -- 172.21.15.144:0/805083654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b80ccf30 msgr2=0x7f83b80cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:23.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 --2- 172.21.15.144:0/805083654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b80ccf30 0x7f83b80cd350 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f83b80b02b0 tx=0x7f83b001c900 comp rx=0 tx=0).stop 2024-09-12T12:18:23.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 -- 172.21.15.144:0/805083654 shutdown_connections 2024-09-12T12:18:23.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 --2- 172.21.15.144:0/805083654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b80ccf30 0x7f83b80cd350 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 --2- 172.21.15.144:0/805083654 >> v2:172.21.15.165:3300/0 conn(0x7f83b8071420 0x7f83b8071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 -- 172.21.15.144:0/805083654 >> 172.21.15.144:0/805083654 conn(0x7f83b806d0d0 msgr2=0x7f83b806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:23.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 -- 172.21.15.144:0/805083654 shutdown_connections 2024-09-12T12:18:23.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 -- 172.21.15.144:0/805083654 wait complete. 2024-09-12T12:18:23.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 Processor -- start 2024-09-12T12:18:23.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.421+0000 7f83bf200640 1 -- start start 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83b8071420 0x7f83b8151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bf200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83b80ccf30 0x7f83b8162420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b815b4e0 0x7f83b8152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f83b815b8c0 con 0x7f83b815b4e0 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bf200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83b80cdef0 con 0x7f83b80ccf30 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f83b8160fd0 con 0x7f83b8071420 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b815b4e0 0x7f83b8152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b815b4e0 0x7f83b8152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60408/0 (socket says 172.21.15.144:60408) 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bd200640 1 -- 172.21.15.144:0/1931881290 learned_addr learned my addr 172.21.15.144:0/1931881290 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bd200640 1 -- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83b8071420 msgr2=0x7f83b8151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83b7e00640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83b8071420 0x7f83b8151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83b7400640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83b80ccf30 0x7f83b8162420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bd200640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83b8071420 0x7f83b8151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bd200640 1 -- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83b80ccf30 msgr2=0x7f83b8162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bd200640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83b80ccf30 0x7f83b8162420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bd200640 1 -- 172.21.15.144:0/1931881290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b8152420 con 0x7f83b815b4e0 2024-09-12T12:18:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83b7e00640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83b8071420 0x7f83b8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83b7400640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83b80ccf30 0x7f83b8162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bd200640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b815b4e0 0x7f83b8152610 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f83b00b0040 tx=0x7f83b00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83afe00640 1 -- 172.21.15.144:0/1931881290 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b00b2050 con 0x7f83b815b4e0 2024-09-12T12:18:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83afe00640 1 -- 172.21.15.144:0/1931881290 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b00be070 con 0x7f83b815b4e0 2024-09-12T12:18:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83afe00640 1 -- 172.21.15.144:0/1931881290 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b00ada90 con 0x7f83b815b4e0 2024-09-12T12:18:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b8155e40 con 0x7f83b815b4e0 2024-09-12T12:18:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b8156400 con 0x7f83b815b4e0 2024-09-12T12:18:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b8075400 con 0x7f83b815b4e0 2024-09-12T12:18:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.425+0000 7f83afe00640 1 -- 172.21.15.144:0/1931881290 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83b00adc30 con 0x7f83b815b4e0 2024-09-12T12:18:23.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.429+0000 7f83afe00640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83980678c0 0x7f8398069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:23.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.429+0000 7f83afe00640 1 -- 172.21.15.144:0/1931881290 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7f83b0120fb0 con 0x7f83b815b4e0 2024-09-12T12:18:23.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.429+0000 7f83b7e00640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83980678c0 0x7f8398069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:23.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.429+0000 7f83b7e00640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83980678c0 0x7f8398069d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f83a8007fd0 tx=0x7f83a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:23.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.433+0000 7f83afe00640 1 -- 172.21.15.144:0/1931881290 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83b0016520 con 0x7f83b815b4e0 2024-09-12T12:18:23.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:23.649+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f83b815e090 con 0x7f83b815b4e0 2024-09-12T12:18:24.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.593+0000 7f83afe00640 1 -- 172.21.15.144:0/1931881290 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v300) ==== 161+0+0 (secure 0 0 0) 0x7f83b00f1470 con 0x7f83b815b4e0 2024-09-12T12:18:24.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83980678c0 msgr2=0x7f8398069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:24.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83980678c0 0x7f8398069d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f83a8007fd0 tx=0x7f83a8009040 comp rx=0 tx=0).stop 2024-09-12T12:18:24.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b815b4e0 msgr2=0x7f83b8152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:24.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b815b4e0 0x7f83b8152610 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f83b00b0040 tx=0x7f83b00196a0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 shutdown_connections 2024-09-12T12:18:24.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83980678c0 0x7f8398069d80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83b815b4e0 0x7f83b8152610 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83b80ccf30 0x7f83b8162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 --2- 172.21.15.144:0/1931881290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83b8071420 0x7f83b8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 >> 172.21.15.144:0/1931881290 conn(0x7f83b806d0d0 msgr2=0x7f83b8165b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:24.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 shutdown_connections 2024-09-12T12:18:24.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.597+0000 7f83bf200640 1 -- 172.21.15.144:0/1931881290 wait complete. 2024-09-12T12:18:24.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:18:24.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.761+0000 7f5645c00640 1 Processor -- start 2024-09-12T12:18:24.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f5645c00640 1 -- start start 2024-09-12T12:18:24.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f5645c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f564006c320 0x7f5640165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:24.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f5645c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56400b4300 con 0x7f564015af60 2024-09-12T12:18:24.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f5645c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56400b3540 con 0x7f56400cd9f0 2024-09-12T12:18:24.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f5645c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f56400b32f0 con 0x7f564006c320 2024-09-12T12:18:24.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f563ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f564015af60 0x7f56400ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58966/0 (socket says 172.21.15.144:58966) 2024-09-12T12:18:24.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f563ea00640 1 -- 172.21.15.144:0/3559597001 learned_addr learned my addr 172.21.15.144:0/3559597001 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:24.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f563f400640 1 --2- 172.21.15.144:0/3559597001 >> v2:172.21.15.144:3300/0 conn(0x7f564006c320 0x7f5640165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:24.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f563f400640 1 -- 172.21.15.144:0/3559597001 >> v1:172.21.15.165:6789/0 conn(0x7f56400cd9f0 legacy=0x7f564006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:24.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f563f400640 1 -- 172.21.15.144:0/3559597001 >> v1:172.21.15.144:6789/0 conn(0x7f564015af60 legacy=0x7f56400ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:24.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.765+0000 7f563f400640 1 -- 172.21.15.144:0/3559597001 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56400b3820 con 0x7f564006c320 2024-09-12T12:18:24.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f563f400640 1 --2- 172.21.15.144:0/3559597001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564006c320 0x7f5640165ef0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f56380097c0 tx=0x7f563801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c202ccc5862de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:24.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f563d600640 1 -- 172.21.15.144:0/3559597001 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380b0070 con 0x7f564006c320 2024-09-12T12:18:24.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f563d600640 1 -- 172.21.15.144:0/3559597001 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56380ab600 con 0x7f564006c320 2024-09-12T12:18:24.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f563d600640 1 -- 172.21.15.144:0/3559597001 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380ab9d0 con 0x7f564006c320 2024-09-12T12:18:24.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f5645c00640 1 -- 172.21.15.144:0/3559597001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564006c320 msgr2=0x7f5640165ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:24.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f5645c00640 1 --2- 172.21.15.144:0/3559597001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564006c320 0x7f5640165ef0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f56380097c0 tx=0x7f563801c460 comp rx=0 tx=0).stop 2024-09-12T12:18:24.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f5645c00640 1 -- 172.21.15.144:0/3559597001 shutdown_connections 2024-09-12T12:18:24.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f5645c00640 1 --2- 172.21.15.144:0/3559597001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564006c320 0x7f5640165ef0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f5645c00640 1 -- 172.21.15.144:0/3559597001 >> 172.21.15.144:0/3559597001 conn(0x7f5640068030 msgr2=0x7f56400b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:24.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f5645c00640 1 -- 172.21.15.144:0/3559597001 shutdown_connections 2024-09-12T12:18:24.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f5645c00640 1 -- 172.21.15.144:0/3559597001 wait complete. 2024-09-12T12:18:24.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f5645c00640 1 Processor -- start 2024-09-12T12:18:24.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.769+0000 7f5645c00640 1 -- start start 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5645c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f564006c320 0x7f5640072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5645c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56400cd9f0 0x7f564014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5645c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564015af60 0x7f5640150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5645c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5640168dd0 con 0x7f564015af60 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5645c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5640168c50 con 0x7f56400cd9f0 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5645c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5640168f50 con 0x7f564006c320 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564015af60 0x7f5640150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564015af60 0x7f5640150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60424/0 (socket says 172.21.15.144:60424) 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563f400640 1 -- 172.21.15.144:0/3726729940 learned_addr learned my addr 172.21.15.144:0/3726729940 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563ea00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f564006c320 0x7f5640072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:24.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563e000640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56400cd9f0 0x7f564014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:24.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563f400640 1 -- 172.21.15.144:0/3726729940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f564006c320 msgr2=0x7f5640072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:24.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563f400640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f564006c320 0x7f5640072f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563f400640 1 -- 172.21.15.144:0/3726729940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56400cd9f0 msgr2=0x7f564014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:24.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563f400640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56400cd9f0 0x7f564014f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563f400640 1 -- 172.21.15.144:0/3726729940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564015d230 con 0x7f564015af60 2024-09-12T12:18:24.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f563f400640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564015af60 0x7f5640150bc0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5638019070 tx=0x7f5638019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:24.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5636a00640 1 -- 172.21.15.144:0/3726729940 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380b0040 con 0x7f564015af60 2024-09-12T12:18:24.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5636a00640 1 -- 172.21.15.144:0/3726729940 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56380b9070 con 0x7f564015af60 2024-09-12T12:18:24.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5636a00640 1 -- 172.21.15.144:0/3726729940 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380b4630 con 0x7f564015af60 2024-09-12T12:18:24.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564015d510 con 0x7f564015af60 2024-09-12T12:18:24.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564015dad0 con 0x7f564015af60 2024-09-12T12:18:24.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56400afc20 con 0x7f564015af60 2024-09-12T12:18:24.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.773+0000 7f5636a00640 1 -- 172.21.15.144:0/3726729940 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56380b47d0 con 0x7f564015af60 2024-09-12T12:18:24.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.777+0000 7f5636a00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56200678f0 0x7f5620069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:24.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.777+0000 7f5636a00640 1 -- 172.21.15.144:0/3726729940 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7f563811faf0 con 0x7f564015af60 2024-09-12T12:18:24.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.777+0000 7f563ea00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56200678f0 0x7f5620069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:24.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.777+0000 7f563ea00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56200678f0 0x7f5620069db0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f56300012f0 tx=0x7f5630009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:24.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.781+0000 7f5636a00640 1 -- 172.21.15.144:0/3726729940 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5638016050 con 0x7f564015af60 2024-09-12T12:18:24.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.937+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f56400b1770 con 0x7f564015af60 2024-09-12T12:18:24.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.941+0000 7f5636a00640 1 -- 172.21.15.144:0/3726729940 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f56380f0600 con 0x7f564015af60 2024-09-12T12:18:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.941+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56200678f0 msgr2=0x7f5620069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.941+0000 7f5645c00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56200678f0 0x7f5620069db0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f56300012f0 tx=0x7f5630009040 comp rx=0 tx=0).stop 2024-09-12T12:18:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564015af60 msgr2=0x7f5640150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564015af60 0x7f5640150bc0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5638019070 tx=0x7f5638019200 comp rx=0 tx=0).stop 2024-09-12T12:18:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 shutdown_connections 2024-09-12T12:18:24.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56200678f0 0x7f5620069db0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564015af60 0x7f5640150bc0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56400cd9f0 0x7f564014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 --2- 172.21.15.144:0/3726729940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f564006c320 0x7f5640072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:24.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 >> 172.21.15.144:0/3726729940 conn(0x7f5640068030 msgr2=0x7f56400b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:24.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 shutdown_connections 2024-09-12T12:18:24.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:24.945+0000 7f5645c00640 1 -- 172.21.15.144:0/3726729940 wait complete. 2024-09-12T12:18:24.962 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:18:24.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:18:25.037 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:18:25.122 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:18:25.122 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:18:25.123 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:25.133 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:18:25.133 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:18:25.133 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:25.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:18:25.143 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:18:25.144 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:25.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:18:25.184 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:18:25.184 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:25.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:18:25.199 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:18:25.200 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:25.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.361+0000 7fc4b4e00640 1 Processor -- start 2024-09-12T12:18:25.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.361+0000 7fc4b4e00640 1 -- start start 2024-09-12T12:18:25.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4b4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc4b0071420 0x7fc4b0071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4b4e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b00b45a0 con 0x7fc4b015b4e0 2024-09-12T12:18:25.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4b4e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b00b3fe0 con 0x7fc4b00ccf30 2024-09-12T12:18:25.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4b4e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b00b42c0 con 0x7fc4b0071420 2024-09-12T12:18:25.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4ad400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc4b0071420 0x7fc4b0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4ade00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc4b015b4e0 0x7fc4b00b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58982/0 (socket says 172.21.15.144:58982) 2024-09-12T12:18:25.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4ade00640 1 -- 172.21.15.144:0/3120375509 learned_addr learned my addr 172.21.15.144:0/3120375509 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:25.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4ad400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc4b0071420 0x7fc4b0071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60436/0 (socket says 172.21.15.144:60436) 2024-09-12T12:18:25.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4ad400640 1 -- 172.21.15.144:0/3120375509 >> v1:172.21.15.165:6789/0 conn(0x7fc4b00ccf30 legacy=0x7fc4b00cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4ad400640 1 -- 172.21.15.144:0/3120375509 >> v1:172.21.15.144:6789/0 conn(0x7fc4b015b4e0 legacy=0x7fc4b00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.365+0000 7fc4ad400640 1 -- 172.21.15.144:0/3120375509 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b00b1490 con 0x7fc4b0071420 2024-09-12T12:18:25.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4ad400640 1 --2- 172.21.15.144:0/3120375509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 0x7fc4b0071840 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00ba60 tx=0x7fc49c01eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef64c0f1c2069fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4aca00640 1 -- 172.21.15.144:0/3120375509 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0b4070 con 0x7fc4b0071420 2024-09-12T12:18:25.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4aca00640 1 -- 172.21.15.144:0/3120375509 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c0a7b60 con 0x7fc4b0071420 2024-09-12T12:18:25.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4aca00640 1 -- 172.21.15.144:0/3120375509 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0af440 con 0x7fc4b0071420 2024-09-12T12:18:25.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3120375509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 msgr2=0x7fc4b0071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 --2- 172.21.15.144:0/3120375509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 0x7fc4b0071840 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00ba60 tx=0x7fc49c01eb00 comp rx=0 tx=0).stop 2024-09-12T12:18:25.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3120375509 shutdown_connections 2024-09-12T12:18:25.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 --2- 172.21.15.144:0/3120375509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 0x7fc4b0071840 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3120375509 >> 172.21.15.144:0/3120375509 conn(0x7fc4b006d0d0 msgr2=0x7fc4b006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3120375509 shutdown_connections 2024-09-12T12:18:25.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3120375509 wait complete. 2024-09-12T12:18:25.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 Processor -- start 2024-09-12T12:18:25.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 -- start start 2024-09-12T12:18:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 0x7fc4b00b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.369+0000 7fc4b4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b00ccf30 0x7fc4b015ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4b4e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b015b4e0 0x7fc4b01f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4b4e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b015b8c0 con 0x7fc4b0071420 2024-09-12T12:18:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4b4e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b00b02e0 con 0x7fc4b015b4e0 2024-09-12T12:18:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4b4e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b00d11c0 con 0x7fc4b00ccf30 2024-09-12T12:18:25.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 0x7fc4b00b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 0x7fc4b00b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60448/0 (socket says 172.21.15.144:60448) 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ade00640 1 -- 172.21.15.144:0/3335013986 learned_addr learned my addr 172.21.15.144:0/3335013986 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ae800640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b015b4e0 0x7fc4b01f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ad400640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b00ccf30 0x7fc4b015ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ade00640 1 -- 172.21.15.144:0/3335013986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b00ccf30 msgr2=0x7fc4b015ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ade00640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b00ccf30 0x7fc4b015ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ade00640 1 -- 172.21.15.144:0/3335013986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b015b4e0 msgr2=0x7fc4b01f79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ade00640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b015b4e0 0x7fc4b01f79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ade00640 1 -- 172.21.15.144:0/3335013986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b01f85a0 con 0x7fc4b0071420 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4ade00640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 0x7fc4b00b08d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000ca70 tx=0x7fc4a000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4a6000640 1 -- 172.21.15.144:0/3335013986 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0017070 con 0x7fc4b0071420 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4a6000640 1 -- 172.21.15.144:0/3335013986 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a000abd0 con 0x7fc4b0071420 2024-09-12T12:18:25.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b01f88e0 con 0x7fc4b0071420 2024-09-12T12:18:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4a6000640 1 -- 172.21.15.144:0/3335013986 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0012400 con 0x7fc4b0071420 2024-09-12T12:18:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b015c8f0 con 0x7fc4b0071420 2024-09-12T12:18:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b0071840 con 0x7fc4b0071420 2024-09-12T12:18:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4a6000640 1 -- 172.21.15.144:0/3335013986 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4a001a070 con 0x7fc4b0071420 2024-09-12T12:18:25.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.373+0000 7fc4a6000640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4900678c0 0x7fc490069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.377+0000 7fc4a6000640 1 -- 172.21.15.144:0/3335013986 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7fc4a00859d0 con 0x7fc4b0071420 2024-09-12T12:18:25.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.377+0000 7fc4ad400640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4900678c0 0x7fc490069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.377+0000 7fc4ad400640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4900678c0 0x7fc490069d80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0b1000 tx=0x7fc49c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.381+0000 7fc4a6000640 1 -- 172.21.15.144:0/3335013986 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4b01f88e0 con 0x7fc4b0071420 2024-09-12T12:18:25.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4b0075840 con 0x7fc4b0071420 2024-09-12T12:18:25.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4a6000640 1 -- 172.21.15.144:0/3335013986 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+3923 (secure 0 0 0) 0x7fc4a00564e0 con 0x7fc4b0071420 2024-09-12T12:18:25.577 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:25.577 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":82,"btime":"2024-09-12T12:18:18:416990+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6416,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1662325743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1662325743},{"type":"v1","addr":"172.21.15.165:6833","nonce":1662325743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6431,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3009022271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3009022271},{"type":"v1","addr":"172.21.15.144:6837","nonce":3009022271}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2715930909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2715930909},{"type":"v1","addr":"172.21.15.165:6835","nonce":2715930909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7494,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2599504612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2599504612},{"type":"v1","addr":"172.21.15.144:6835","nonce":2599504612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82}],"filesystems":[]} 2024-09-12T12:18:25.577 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 82 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4900678c0 msgr2=0x7fc490069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4900678c0 0x7fc490069d80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0b1000 tx=0x7fc49c008040 comp rx=0 tx=0).stop 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 msgr2=0x7fc4b00b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 0x7fc4b00b08d0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000ca70 tx=0x7fc4a000cf30 comp rx=0 tx=0).stop 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 shutdown_connections 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc4900678c0 0x7fc490069d80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b015b4e0 0x7fc4b01f79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4b00ccf30 0x7fc4b015ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 --2- 172.21.15.144:0/3335013986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4b0071420 0x7fc4b00b08d0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 >> 172.21.15.144:0/3335013986 conn(0x7fc4b006d0d0 msgr2=0x7fc4b0071e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 shutdown_connections 2024-09-12T12:18:25.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.577+0000 7fc4b4e00640 1 -- 172.21.15.144:0/3335013986 wait complete. 2024-09-12T12:18:25.598 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:18:25.598 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:18:25.598 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:18:25.598 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:18:25.599 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:18:25.599 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:18:25.599 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:18:25.599 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:18:25.599 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:18:25.599 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:18:25.599 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:18:25.599 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:18:25.600 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:18:25.600 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:18:25.600 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:18:25.600 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:18:25.613 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:18:25.613 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:18:25.614 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:18:25.614 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:18:25.615 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:18:25.615 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:18:25.616 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:18:25.616 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:18:25.657 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:18:25.658 DEBUG:teuthology.parallel:result is None 2024-09-12T12:18:25.659 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:18:25.659 DEBUG:teuthology.parallel:result is None 2024-09-12T12:18:25.661 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:18:25.661 DEBUG:teuthology.parallel:result is None 2024-09-12T12:18:25.662 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:18:25.663 DEBUG:teuthology.parallel:result is None 2024-09-12T12:18:25.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:18:25.745 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:18:25.746 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:18:25.754 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:18:25.755 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:18:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa876400640 1 Processor -- start 2024-09-12T12:18:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa876400640 1 -- start start 2024-09-12T12:18:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa876400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa87015e580 0x7fa8700b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa876400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa87006ea20 0x7fa8700b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa876400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87006d9a0 con 0x7fa87006cc70 2024-09-12T12:18:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa876400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa8700b73e0 con 0x7fa87015e580 2024-09-12T12:18:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa876400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa87006df40 con 0x7fa87006ea20 2024-09-12T12:18:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa86f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa87015e580 0x7fa8700b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa86fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa87006cc70 0x7fa87006d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58998/0 (socket says 172.21.15.144:58998) 2024-09-12T12:18:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa86fe00640 1 -- 172.21.15.144:0/880559475 learned_addr learned my addr 172.21.15.144:0/880559475 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa86ea00640 1 --2- 172.21.15.144:0/880559475 >> v2:172.21.15.165:3300/0 conn(0x7fa87006ea20 0x7fa8700b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa86f400640 1 -- 172.21.15.144:0/880559475 >> v2:172.21.15.165:3300/0 conn(0x7fa87006ea20 msgr2=0x7fa8700b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa86f400640 1 --2- 172.21.15.144:0/880559475 >> v2:172.21.15.165:3300/0 conn(0x7fa87006ea20 0x7fa8700b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa86f400640 1 -- 172.21.15.144:0/880559475 >> v1:172.21.15.144:6789/0 conn(0x7fa87006cc70 legacy=0x7fa87006d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa86f400640 1 -- 172.21.15.144:0/880559475 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87006e220 con 0x7fa87015e580 2024-09-12T12:18:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.809+0000 7fa86e000640 1 -- 172.21.15.144:0/880559475 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103107089 0 0) 0x7fa87006d9a0 con 0x7fa87006cc70 2024-09-12T12:18:25.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa86f400640 1 --2- 172.21.15.144:0/880559475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 0x7fa8700b6960 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa8700b16a0 tx=0x7fa86001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bed31cc7333e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa86e000640 1 -- 172.21.15.144:0/880559475 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8600b2070 con 0x7fa87015e580 2024-09-12T12:18:25.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa86e000640 1 -- 172.21.15.144:0/880559475 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8600a5800 con 0x7fa87015e580 2024-09-12T12:18:25.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa86e000640 1 -- 172.21.15.144:0/880559475 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8600a5bd0 con 0x7fa87015e580 2024-09-12T12:18:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa876400640 1 -- 172.21.15.144:0/880559475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 msgr2=0x7fa8700b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa876400640 1 --2- 172.21.15.144:0/880559475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 0x7fa8700b6960 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa8700b16a0 tx=0x7fa86001c930 comp rx=0 tx=0).stop 2024-09-12T12:18:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa876400640 1 -- 172.21.15.144:0/880559475 shutdown_connections 2024-09-12T12:18:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa876400640 1 --2- 172.21.15.144:0/880559475 >> v2:172.21.15.165:3300/0 conn(0x7fa87006ea20 0x7fa8700b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa876400640 1 --2- 172.21.15.144:0/880559475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 0x7fa8700b6960 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa876400640 1 -- 172.21.15.144:0/880559475 >> 172.21.15.144:0/880559475 conn(0x7fa870067a00 msgr2=0x7fa870067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa876400640 1 -- 172.21.15.144:0/880559475 shutdown_connections 2024-09-12T12:18:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.813+0000 7fa876400640 1 -- 172.21.15.144:0/880559475 wait complete. 2024-09-12T12:18:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 Processor -- start 2024-09-12T12:18:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 -- start start 2024-09-12T12:18:25.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa87006cc70 0x7fa87015f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa87006ea20 0x7fa87014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 0x7fa87014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700cc3f0 con 0x7fa87015e580 2024-09-12T12:18:25.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700cc270 con 0x7fa87006cc70 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa8700cc570 con 0x7fa87006ea20 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 0x7fa87014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 0x7fa87014ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60504/0 (socket says 172.21.15.144:60504) 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86fe00640 1 -- 172.21.15.144:0/2712725149 learned_addr learned my addr 172.21.15.144:0/2712725149 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86ea00640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa87006ea20 0x7fa87014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86f400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa87006cc70 0x7fa87015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86fe00640 1 -- 172.21.15.144:0/2712725149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa87006ea20 msgr2=0x7fa87014e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86fe00640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa87006ea20 0x7fa87014e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86fe00640 1 -- 172.21.15.144:0/2712725149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa87006cc70 msgr2=0x7fa87015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86fe00640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa87006cc70 0x7fa87015f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86fe00640 1 -- 172.21.15.144:0/2712725149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87014bbe0 con 0x7fa87015e580 2024-09-12T12:18:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa86fe00640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 0x7fa87014ea10 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c480 tx=0x7fa86800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa867400640 1 -- 172.21.15.144:0/2712725149 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868018070 con 0x7fa87015e580 2024-09-12T12:18:25.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa867400640 1 -- 172.21.15.144:0/2712725149 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8680074e0 con 0x7fa87015e580 2024-09-12T12:18:25.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa867400640 1 -- 172.21.15.144:0/2712725149 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868004a30 con 0x7fa87015e580 2024-09-12T12:18:25.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87014bec0 con 0x7fa87015e580 2024-09-12T12:18:25.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.817+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87014c480 con 0x7fa87015e580 2024-09-12T12:18:25.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.821+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87006d0c0 con 0x7fa87015e580 2024-09-12T12:18:25.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.821+0000 7fa867400640 1 -- 172.21.15.144:0/2712725149 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa868004bd0 con 0x7fa87015e580 2024-09-12T12:18:25.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.821+0000 7fa867400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8500678f0 0x7fa850069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.821+0000 7fa867400640 1 -- 172.21.15.144:0/2712725149 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5593+0+0 (secure 0 0 0) 0x7fa868084e40 con 0x7fa87015e580 2024-09-12T12:18:25.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.821+0000 7fa86f400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8500678f0 0x7fa850069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.821+0000 7fa86f400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8500678f0 0x7fa850069db0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa8600af000 tx=0x7fa8600a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:25.825+0000 7fa867400640 1 -- 172.21.15.144:0/2712725149 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa868055390 con 0x7fa87015e580 2024-09-12T12:18:26.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.005+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa870073aa0 con 0x7fa87015e580 2024-09-12T12:18:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.961+0000 7fa867400640 1 -- 172.21.15.144:0/2712725149 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v110) ==== 97+0+0 (secure 0 0 0) 0x7fa868059690 con 0x7fa87015e580 2024-09-12T12:18:26.961 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8500678f0 msgr2=0x7fa850069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8500678f0 0x7fa850069db0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa8600af000 tx=0x7fa8600a7070 comp rx=0 tx=0).stop 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 msgr2=0x7fa87014ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 0x7fa87014ea10 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c480 tx=0x7fa86800c940 comp rx=0 tx=0).stop 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 shutdown_connections 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8500678f0 0x7fa850069db0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa87015e580 0x7fa87014ea10 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa87006ea20 0x7fa87014e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 --2- 172.21.15.144:0/2712725149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa87006cc70 0x7fa87015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 >> 172.21.15.144:0/2712725149 conn(0x7fa870067a00 msgr2=0x7fa87015c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 shutdown_connections 2024-09-12T12:18:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:26.965+0000 7fa876400640 1 -- 172.21.15.144:0/2712725149 wait complete. 2024-09-12T12:18:26.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:18:27.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bc4e00640 1 Processor -- start 2024-09-12T12:18:27.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bc4e00640 1 -- start start 2024-09-12T12:18:27.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bc4e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4bc0071420 0x7f4bc0071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bc4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4bc00ccf30 0x7f4bc00cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bc4e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc00cd890 con 0x7f4bc015b4e0 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bc4e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc00b45a0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bc4e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc00b3fe0 con 0x7f4bc0071420 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bbe800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4bc00ccf30 0x7f4bc00cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bbe800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4bc00ccf30 0x7f4bc00cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40372/0 (socket says 172.21.15.144:40372) 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bbe800640 1 -- 172.21.15.144:0/458637428 learned_addr learned my addr 172.21.15.144:0/458637428 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bbd400640 1 --2- 172.21.15.144:0/458637428 >> v2:172.21.15.165:3300/0 conn(0x7f4bc0071420 0x7f4bc0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bbe800640 1 -- 172.21.15.144:0/458637428 >> v2:172.21.15.165:3300/0 conn(0x7f4bc0071420 msgr2=0x7f4bc0071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bbe800640 1 --2- 172.21.15.144:0/458637428 >> v2:172.21.15.165:3300/0 conn(0x7f4bc0071420 0x7f4bc0071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bbe800640 1 -- 172.21.15.144:0/458637428 >> v1:172.21.15.165:6789/0 conn(0x7f4bc015b4e0 legacy=0x7f4bc00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bbe800640 1 -- 172.21.15.144:0/458637428 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc00b42c0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.129+0000 7f4bbd400640 1 --2- 172.21.15.144:0/458637428 >> v2:172.21.15.165:3300/0 conn(0x7f4bc0071420 0x7f4bc0071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:27.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bbe800640 1 --2- 172.21.15.144:0/458637428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 0x7f4bc00cd350 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00b02b0 tx=0x7f4bb801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacd1b9b346dfe60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:27.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bbca00640 1 -- 172.21.15.144:0/458637428 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb80a5840 con 0x7f4bc00ccf30 2024-09-12T12:18:27.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bbca00640 1 -- 172.21.15.144:0/458637428 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb80a59e0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bbca00640 1 -- 172.21.15.144:0/458637428 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb80a5db0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bc4e00640 1 -- 172.21.15.144:0/458637428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 msgr2=0x7f4bc00cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bc4e00640 1 --2- 172.21.15.144:0/458637428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 0x7f4bc00cd350 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00b02b0 tx=0x7f4bb801c980 comp rx=0 tx=0).stop 2024-09-12T12:18:27.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bc4e00640 1 -- 172.21.15.144:0/458637428 shutdown_connections 2024-09-12T12:18:27.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bc4e00640 1 --2- 172.21.15.144:0/458637428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 0x7f4bc00cd350 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bc4e00640 1 --2- 172.21.15.144:0/458637428 >> v2:172.21.15.165:3300/0 conn(0x7f4bc0071420 0x7f4bc0071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bc4e00640 1 -- 172.21.15.144:0/458637428 >> 172.21.15.144:0/458637428 conn(0x7f4bc006d0d0 msgr2=0x7f4bc006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:27.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bc4e00640 1 -- 172.21.15.144:0/458637428 shutdown_connections 2024-09-12T12:18:27.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.133+0000 7f4bc4e00640 1 -- 172.21.15.144:0/458637428 wait complete. 2024-09-12T12:18:27.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 Processor -- start 2024-09-12T12:18:27.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 -- start start 2024-09-12T12:18:27.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc0071420 0x7f4bc0160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 0x7f4bc01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bc015b4e0 0x7f4bc0153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc015b8c0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc00cdef0 con 0x7f4bc0071420 2024-09-12T12:18:27.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc00cfc00 con 0x7f4bc015b4e0 2024-09-12T12:18:27.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 0x7f4bc01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 0x7f4bc01557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40388/0 (socket says 172.21.15.144:40388) 2024-09-12T12:18:27.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbd400640 1 -- 172.21.15.144:0/618100326 learned_addr learned my addr 172.21.15.144:0/618100326 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbde00640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc0071420 0x7f4bc0160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbe800640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bc015b4e0 0x7f4bc0153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbd400640 1 -- 172.21.15.144:0/618100326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bc015b4e0 msgr2=0x7f4bc0153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbd400640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bc015b4e0 0x7f4bc0153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbd400640 1 -- 172.21.15.144:0/618100326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc0071420 msgr2=0x7f4bc0160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbd400640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc0071420 0x7f4bc0160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbd400640 1 -- 172.21.15.144:0/618100326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc0074170 con 0x7f4bc00ccf30 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bbd400640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 0x7f4bc01557b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c7c0 tx=0x7f4bac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bb6000640 1 -- 172.21.15.144:0/618100326 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac007a30 con 0x7f4bc00ccf30 2024-09-12T12:18:27.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bb6000640 1 -- 172.21.15.144:0/618100326 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bac007bd0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bb6000640 1 -- 172.21.15.144:0/618100326 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0113f0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc00cfee0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc00d04a0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.137+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc00b52e0 con 0x7f4bc00ccf30 2024-09-12T12:18:27.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.141+0000 7f4bb6000640 1 -- 172.21.15.144:0/618100326 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4bac011590 con 0x7f4bc00ccf30 2024-09-12T12:18:27.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.141+0000 7f4bb6000640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ba00678c0 0x7f4ba0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.141+0000 7f4bb6000640 1 -- 172.21.15.144:0/618100326 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5249+0+0 (secure 0 0 0) 0x7f4bac085d30 con 0x7f4bc00ccf30 2024-09-12T12:18:27.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.141+0000 7f4bbde00640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ba00678c0 0x7f4ba0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.141+0000 7f4bbde00640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ba00678c0 0x7f4ba0069d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000b810 tx=0x7f4bb0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:27.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.145+0000 7f4bb6000640 1 -- 172.21.15.144:0/618100326 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4bac015020 con 0x7f4bc00ccf30 2024-09-12T12:18:27.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4bc00b0f20 con 0x7f4bc00ccf30 2024-09-12T12:18:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bb6000640 1 -- 172.21.15.144:0/618100326 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f4bac056990 con 0x7f4bc00ccf30 2024-09-12T12:18:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:27.357 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:18:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:18:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:18:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:18:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.357 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:18:27.358 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:18:27.359 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.360 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.361 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:18:27.363 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.364 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:18:27.365 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:18:27.366 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:18:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:18:27.371 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:18:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ba00678c0 msgr2=0x7f4ba0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ba00678c0 0x7f4ba0069d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000b810 tx=0x7f4bb0008040 comp rx=0 tx=0).stop 2024-09-12T12:18:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 msgr2=0x7f4bc01557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 0x7f4bc01557b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c7c0 tx=0x7f4bac00cc80 comp rx=0 tx=0).stop 2024-09-12T12:18:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 shutdown_connections 2024-09-12T12:18:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ba00678c0 0x7f4ba0069d80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4bc015b4e0 0x7f4bc0153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bc00ccf30 0x7f4bc01557b0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 --2- 172.21.15.144:0/618100326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc0071420 0x7f4bc0160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.357+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 >> 172.21.15.144:0/618100326 conn(0x7f4bc006d0d0 msgr2=0x7f4bc01561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.361+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 shutdown_connections 2024-09-12T12:18:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.361+0000 7f4bc4e00640 1 -- 172.21.15.144:0/618100326 wait complete. 2024-09-12T12:18:27.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:18:27.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518dc00640 1 Processor -- start 2024-09-12T12:18:27.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518dc00640 1 -- start start 2024-09-12T12:18:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f518815e4a0 0x7f5188161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51880b67c0 0x7f51880b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518dc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5188162720 con 0x7f51880d2e10 2024-09-12T12:18:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5188073310 con 0x7f51880b67c0 2024-09-12T12:18:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5188162a00 con 0x7f518815e4a0 2024-09-12T12:18:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51880b67c0 0x7f51880b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51880b67c0 0x7f51880b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40400/0 (socket says 172.21.15.144:40400) 2024-09-12T12:18:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518d200640 1 -- 172.21.15.144:0/1677280150 learned_addr learned my addr 172.21.15.144:0/1677280150 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:27.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f5187e00640 1 --2- 172.21.15.144:0/1677280150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f518815e4a0 0x7f5188161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518d200640 1 -- 172.21.15.144:0/1677280150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f518815e4a0 msgr2=0x7f5188161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518d200640 1 --2- 172.21.15.144:0/1677280150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f518815e4a0 0x7f5188161e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518d200640 1 -- 172.21.15.144:0/1677280150 >> v1:172.21.15.165:6789/0 conn(0x7f51880d2e10 legacy=0x7f51880737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f518d200640 1 -- 172.21.15.144:0/1677280150 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5188162ce0 con 0x7f51880b67c0 2024-09-12T12:18:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.517+0000 7f5187e00640 1 --2- 172.21.15.144:0/1677280150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f518815e4a0 0x7f5188161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:27.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518d200640 1 --2- 172.21.15.144:0/1677280150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51880b67c0 0x7f51880b6c40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f5180009e50 tx=0x7f518001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52b1a560cf2f998 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:27.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f5186a00640 1 -- 172.21.15.144:0/1677280150 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800a5700 con 0x7f51880b67c0 2024-09-12T12:18:27.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f5186a00640 1 -- 172.21.15.144:0/1677280150 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51800a58a0 con 0x7f51880b67c0 2024-09-12T12:18:27.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f5186a00640 1 -- 172.21.15.144:0/1677280150 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800a5c70 con 0x7f51880b67c0 2024-09-12T12:18:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 -- 172.21.15.144:0/1677280150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51880b67c0 msgr2=0x7f51880b6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 --2- 172.21.15.144:0/1677280150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51880b67c0 0x7f51880b6c40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f5180009e50 tx=0x7f518001ca30 comp rx=0 tx=0).stop 2024-09-12T12:18:27.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 -- 172.21.15.144:0/1677280150 shutdown_connections 2024-09-12T12:18:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 --2- 172.21.15.144:0/1677280150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51880b67c0 0x7f51880b6c40 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 --2- 172.21.15.144:0/1677280150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f518815e4a0 0x7f5188161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 -- 172.21.15.144:0/1677280150 >> 172.21.15.144:0/1677280150 conn(0x7f51880d2280 msgr2=0x7f51880d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 -- 172.21.15.144:0/1677280150 shutdown_connections 2024-09-12T12:18:27.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 -- 172.21.15.144:0/1677280150 wait complete. 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 Processor -- start 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.521+0000 7f518dc00640 1 -- start start 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51880b67c0 0x7f5188163010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51880d2e10 0x7f51880d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f518815e4a0 0x7f51881fa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f518806d6b0 con 0x7f518815e4a0 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f518806d530 con 0x7f51880d2e10 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f518816b000 con 0x7f51880b67c0 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f518815e4a0 0x7f51881fa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f518815e4a0 0x7f51881fa9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40402/0 (socket says 172.21.15.144:40402) 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518d200640 1 -- 172.21.15.144:0/3952282845 learned_addr learned my addr 172.21.15.144:0/3952282845 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f5187e00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51880b67c0 0x7f5188163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f5187400640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51880d2e10 0x7f51880d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518d200640 1 -- 172.21.15.144:0/3952282845 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51880b67c0 msgr2=0x7f5188163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518d200640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51880b67c0 0x7f5188163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518d200640 1 -- 172.21.15.144:0/3952282845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51880d2e10 msgr2=0x7f51880d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518d200640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51880d2e10 0x7f51880d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518d200640 1 -- 172.21.15.144:0/3952282845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51880b1d60 con 0x7f518815e4a0 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518d200640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f518815e4a0 0x7f51881fa9b0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f51800af040 tx=0x7f51800197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f517fe00640 1 -- 172.21.15.144:0/3952282845 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180009510 con 0x7f518815e4a0 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f517fe00640 1 -- 172.21.15.144:0/3952282845 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51800be070 con 0x7f518815e4a0 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f517fe00640 1 -- 172.21.15.144:0/3952282845 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800b88d0 con 0x7f518815e4a0 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51880b0390 con 0x7f518815e4a0 2024-09-12T12:18:27.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51880b0950 con 0x7f518815e4a0 2024-09-12T12:18:27.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51880b6c40 con 0x7f518815e4a0 2024-09-12T12:18:27.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.525+0000 7f517fe00640 1 -- 172.21.15.144:0/3952282845 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51800b8a70 con 0x7f518815e4a0 2024-09-12T12:18:27.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.529+0000 7f517fe00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51680678c0 0x7f5168069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.529+0000 7f517fe00640 1 -- 172.21.15.144:0/3952282845 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5249+0+0 (secure 0 0 0) 0x7f5180120a80 con 0x7f518815e4a0 2024-09-12T12:18:27.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.529+0000 7f5187e00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51680678c0 0x7f5168069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.529+0000 7f5187e00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51680678c0 0x7f5168069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5178006e90 tx=0x7f5178008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:27.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.533+0000 7f517fe00640 1 -- 172.21.15.144:0/3952282845 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5180122e20 con 0x7f518815e4a0 2024-09-12T12:18:27.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.693+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f518815c070 con 0x7f518815e4a0 2024-09-12T12:18:27.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.693+0000 7f517fe00640 1 -- 172.21.15.144:0/3952282845 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v110) ==== 84+0+65 (secure 0 0 0) 0x7f5180016620 con 0x7f518815e4a0 2024-09-12T12:18:27.693 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:27.693 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:18:27.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:18:27.694 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:18:27.694 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:18:27.694 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:18:27.694 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:18:27.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51680678c0 msgr2=0x7f5168069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51680678c0 0x7f5168069d80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5178006e90 tx=0x7f5178008040 comp rx=0 tx=0).stop 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f518815e4a0 msgr2=0x7f51881fa9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f518815e4a0 0x7f51881fa9b0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f51800af040 tx=0x7f51800197d0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 shutdown_connections 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51680678c0 0x7f5168069d80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f518815e4a0 0x7f51881fa9b0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51880d2e10 0x7f51880d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 --2- 172.21.15.144:0/3952282845 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51880b67c0 0x7f5188163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 >> 172.21.15.144:0/3952282845 conn(0x7f51880d2280 msgr2=0x7f5188168440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 shutdown_connections 2024-09-12T12:18:27.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.697+0000 7f518dc00640 1 -- 172.21.15.144:0/3952282845 wait complete. 2024-09-12T12:18:27.715 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:18:27.716 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:18:27.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0097400640 1 Processor -- start 2024-09-12T12:18:27.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0097400640 1 -- start start 2024-09-12T12:18:27.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0097400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00900b3490 0x7f00900b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0097400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f009006d630 0x7f0090155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0097400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009006cd20 con 0x7f009006d250 2024-09-12T12:18:27.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0097400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0090072620 con 0x7f009006d630 2024-09-12T12:18:27.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0097400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f00900b4f30 con 0x7f00900b3490 2024-09-12T12:18:27.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0094a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f009006d250 0x7f009015c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42346/0 (socket says 172.21.15.144:42346) 2024-09-12T12:18:27.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0094a00640 1 -- 172.21.15.144:0/2337147161 learned_addr learned my addr 172.21.15.144:0/2337147161 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:27.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f008fe00640 1 --2- 172.21.15.144:0/2337147161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00900b3490 0x7f00900b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0095400640 1 --2- 172.21.15.144:0/2337147161 >> v2:172.21.15.165:3300/0 conn(0x7f009006d630 0x7f0090155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f008f400640 1 -- 172.21.15.144:0/2337147161 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 28173610 0 0) 0x7f009006cd20 con 0x7f009006d250 2024-09-12T12:18:27.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f008f400640 1 -- 172.21.15.144:0/2337147161 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0074003530 con 0x7f009006d250 2024-09-12T12:18:27.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f008fe00640 1 -- 172.21.15.144:0/2337147161 >> v2:172.21.15.165:3300/0 conn(0x7f009006d630 msgr2=0x7f0090155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:27.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f008fe00640 1 --2- 172.21.15.144:0/2337147161 >> v2:172.21.15.165:3300/0 conn(0x7f009006d630 0x7f0090155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f008fe00640 1 -- 172.21.15.144:0/2337147161 >> v1:172.21.15.144:6789/0 conn(0x7f009006d250 legacy=0x7f009015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f008fe00640 1 -- 172.21.15.144:0/2337147161 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00900b3950 con 0x7f00900b3490 2024-09-12T12:18:27.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.857+0000 7f0095400640 1 --2- 172.21.15.144:0/2337147161 >> v2:172.21.15.165:3300/0 conn(0x7f009006d630 0x7f0090155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:27.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f008fe00640 1 --2- 172.21.15.144:0/2337147161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00900b3490 0x7f00900b49f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f007c0097f0 tx=0x7f007c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=158e43de87dad194 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:27.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f008f400640 1 -- 172.21.15.144:0/2337147161 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c0aa5f0 con 0x7f00900b3490 2024-09-12T12:18:27.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f008f400640 1 -- 172.21.15.144:0/2337147161 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f007c0af070 con 0x7f00900b3490 2024-09-12T12:18:27.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f008f400640 1 -- 172.21.15.144:0/2337147161 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c0aa990 con 0x7f00900b3490 2024-09-12T12:18:27.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f0097400640 1 -- 172.21.15.144:0/2337147161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00900b3490 msgr2=0x7f00900b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f0097400640 1 --2- 172.21.15.144:0/2337147161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00900b3490 0x7f00900b49f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f007c0097f0 tx=0x7f007c01c470 comp rx=0 tx=0).stop 2024-09-12T12:18:27.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f0097400640 1 -- 172.21.15.144:0/2337147161 shutdown_connections 2024-09-12T12:18:27.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f0097400640 1 --2- 172.21.15.144:0/2337147161 >> v2:172.21.15.165:3300/0 conn(0x7f009006d630 0x7f0090155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f0097400640 1 --2- 172.21.15.144:0/2337147161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00900b3490 0x7f00900b49f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f0097400640 1 -- 172.21.15.144:0/2337147161 >> 172.21.15.144:0/2337147161 conn(0x7f009006bc10 msgr2=0x7f009006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:27.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f0097400640 1 -- 172.21.15.144:0/2337147161 shutdown_connections 2024-09-12T12:18:27.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.861+0000 7f0097400640 1 -- 172.21.15.144:0/2337147161 wait complete. 2024-09-12T12:18:27.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 Processor -- start 2024-09-12T12:18:27.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 -- start start 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f009006d250 0x7f009013ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f009006d630 0x7f00901f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00900b3490 0x7f009014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00900b44d0 con 0x7f009006d250 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f00900b41f0 con 0x7f00900b3490 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f009015d690 con 0x7f009006d630 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0094a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f009006d250 0x7f009013ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0094a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f009006d250 0x7f009013ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40414/0 (socket says 172.21.15.144:40414) 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0094a00640 1 -- 172.21.15.144:0/725411890 learned_addr learned my addr 172.21.15.144:0/725411890 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0095400640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00900b3490 0x7f009014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f008fe00640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f009006d630 0x7f00901f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0094a00640 1 -- 172.21.15.144:0/725411890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f009006d630 msgr2=0x7f00901f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0094a00640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f009006d630 0x7f00901f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0094a00640 1 -- 172.21.15.144:0/725411890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00900b3490 msgr2=0x7f009014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:27.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0094a00640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00900b3490 0x7f009014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:27.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0094a00640 1 -- 172.21.15.144:0/725411890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00901404c0 con 0x7f009006d250 2024-09-12T12:18:27.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0094a00640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f009006d250 0x7f009013ff80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f008000cb40 tx=0x7f008000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:27.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f008cc00640 1 -- 172.21.15.144:0/725411890 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080017070 con 0x7f009006d250 2024-09-12T12:18:27.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f008cc00640 1 -- 172.21.15.144:0/725411890 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008000aca0 con 0x7f009006d250 2024-09-12T12:18:27.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f008cc00640 1 -- 172.21.15.144:0/725411890 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080012620 con 0x7f009006d250 2024-09-12T12:18:27.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00901f7010 con 0x7f009006d250 2024-09-12T12:18:27.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00901f75d0 con 0x7f009006d250 2024-09-12T12:18:27.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.865+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0090155820 con 0x7f009006d250 2024-09-12T12:18:27.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.869+0000 7f008cc00640 1 -- 172.21.15.144:0/725411890 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f008001a070 con 0x7f009006d250 2024-09-12T12:18:27.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.869+0000 7f008cc00640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00700678f0 0x7f0070069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:27.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.869+0000 7f008cc00640 1 -- 172.21.15.144:0/725411890 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5249+0+0 (secure 0 0 0) 0x7f00800858f0 con 0x7f009006d250 2024-09-12T12:18:27.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.869+0000 7f008fe00640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00700678f0 0x7f0070069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:27.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.869+0000 7f008fe00640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00700678f0 0x7f0070069db0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f007c0ae000 tx=0x7f007c0b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:27.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:27.873+0000 7f008cc00640 1 -- 172.21.15.144:0/725411890 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00800565e0 con 0x7f009006d250 2024-09-12T12:18:28.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.033+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f009015b680 con 0x7f009006d250 2024-09-12T12:18:28.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.965+0000 7f008cc00640 1 -- 172.21.15.144:0/725411890 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v111) ==== 138+0+0 (secure 0 0 0) 0x7f0080055ee0 con 0x7f009006d250 2024-09-12T12:18:28.965 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:18:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00700678f0 msgr2=0x7f0070069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00700678f0 0x7f0070069db0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f007c0ae000 tx=0x7f007c0b5040 comp rx=0 tx=0).stop 2024-09-12T12:18:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f009006d250 msgr2=0x7f009013ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f009006d250 0x7f009013ff80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f008000cb40 tx=0x7f008000a060 comp rx=0 tx=0).stop 2024-09-12T12:18:28.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 shutdown_connections 2024-09-12T12:18:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00700678f0 0x7f0070069db0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00900b3490 0x7f009014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f009006d630 0x7f00901f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 --2- 172.21.15.144:0/725411890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f009006d250 0x7f009013ff80 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 >> 172.21.15.144:0/725411890 conn(0x7f009006bc10 msgr2=0x7f009015c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 shutdown_connections 2024-09-12T12:18:28.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:28.969+0000 7f0097400640 1 -- 172.21.15.144:0/725411890 wait complete. 2024-09-12T12:18:28.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:18:29.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.141+0000 7efe03c00640 1 Processor -- start 2024-09-12T12:18:29.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.141+0000 7efe03c00640 1 -- start start 2024-09-12T12:18:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efe03c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efdfc0cd9f0 0x7efdfc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efe03c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc0b4300 con 0x7efdfc15af60 2024-09-12T12:18:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efe03c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc0b3540 con 0x7efdfc15b340 2024-09-12T12:18:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efe03c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efdfc0b32f0 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efe01200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efdfc15af60 0x7efdfc0ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42356/0 (socket says 172.21.15.144:42356) 2024-09-12T12:18:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efe01200640 1 -- 172.21.15.144:0/373933459 learned_addr learned my addr 172.21.15.144:0/373933459 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:29.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efdfbe00640 1 --2- 172.21.15.144:0/373933459 >> v2:172.21.15.165:3300/0 conn(0x7efdfc0cd9f0 0x7efdfc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:29.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efdfb400640 1 -- 172.21.15.144:0/373933459 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708098915 0 0) 0x7efdfc0b4300 con 0x7efdfc15af60 2024-09-12T12:18:29.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efdfb400640 1 -- 172.21.15.144:0/373933459 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde0005740 con 0x7efdfc15af60 2024-09-12T12:18:29.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efdfb400640 1 -- 172.21.15.144:0/373933459 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362393195 0 0) 0x7efdfc0b3540 con 0x7efdfc15b340 2024-09-12T12:18:29.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efdfb400640 1 -- 172.21.15.144:0/373933459 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdfc0b4300 con 0x7efdfc15b340 2024-09-12T12:18:29.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efdfb400640 1 -- 172.21.15.144:0/373933459 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1712642798 0 0) 0x7efde0005740 con 0x7efdfc15af60 2024-09-12T12:18:29.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efdfbe00640 1 -- 172.21.15.144:0/373933459 >> v1:172.21.15.165:6789/0 conn(0x7efdfc15b340 legacy=0x7efdfc0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:29.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efdfbe00640 1 -- 172.21.15.144:0/373933459 >> v1:172.21.15.144:6789/0 conn(0x7efdfc15af60 legacy=0x7efdfc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:29.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.145+0000 7efdfbe00640 1 -- 172.21.15.144:0/373933459 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc0b3820 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efdfbe00640 1 --2- 172.21.15.144:0/373933459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc0cd9f0 0x7efdfc06bc10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efde80097c0 tx=0x7efde801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=671653a4b9430d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efdfb400640 1 -- 172.21.15.144:0/373933459 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde80b0070 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efdfb400640 1 -- 172.21.15.144:0/373933459 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde80ab400 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efdfb400640 1 -- 172.21.15.144:0/373933459 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec001a00 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efe03c00640 1 -- 172.21.15.144:0/373933459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc0cd9f0 msgr2=0x7efdfc06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:29.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efe03c00640 1 --2- 172.21.15.144:0/373933459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc0cd9f0 0x7efdfc06bc10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efde80097c0 tx=0x7efde801c3c0 comp rx=0 tx=0).stop 2024-09-12T12:18:29.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efe03c00640 1 -- 172.21.15.144:0/373933459 shutdown_connections 2024-09-12T12:18:29.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efe03c00640 1 --2- 172.21.15.144:0/373933459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc0cd9f0 0x7efdfc06bc10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:29.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efe03c00640 1 -- 172.21.15.144:0/373933459 >> 172.21.15.144:0/373933459 conn(0x7efdfc068030 msgr2=0x7efdfc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:29.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efe03c00640 1 -- 172.21.15.144:0/373933459 shutdown_connections 2024-09-12T12:18:29.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.149+0000 7efe03c00640 1 -- 172.21.15.144:0/373933459 wait complete. 2024-09-12T12:18:29.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 Processor -- start 2024-09-12T12:18:29.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 -- start start 2024-09-12T12:18:29.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdfc0cd9f0 0x7efdfc071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:29.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efdfc15af60 0x7efdfc1fb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc15b340 0x7efdfc070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc06d500 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc06d380 con 0x7efdfc15b340 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc06d680 con 0x7efdfc15af60 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdfc0cd9f0 0x7efdfc071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdfc0cd9f0 0x7efdfc071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40428/0 (socket says 172.21.15.144:40428) 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01200640 1 -- 172.21.15.144:0/4175414869 learned_addr learned my addr 172.21.15.144:0/4175414869 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efdfbe00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efdfc15af60 0x7efdfc1fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01c00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc15b340 0x7efdfc070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01200640 1 -- 172.21.15.144:0/4175414869 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efdfc15af60 msgr2=0x7efdfc1fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01200640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efdfc15af60 0x7efdfc1fb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01200640 1 -- 172.21.15.144:0/4175414869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc15b340 msgr2=0x7efdfc070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01200640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc15b340 0x7efdfc070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01200640 1 -- 172.21.15.144:0/4175414869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc1fbba0 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01c00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc15b340 0x7efdfc070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe01200640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdfc0cd9f0 0x7efdfc071e80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7efdec001f40 tx=0x7efdec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efdf8c00640 1 -- 172.21.15.144:0/4175414869 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec017070 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efdf8c00640 1 -- 172.21.15.144:0/4175414869 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdec012400 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efdf8c00640 1 -- 172.21.15.144:0/4175414869 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec012830 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc151b00 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc153800 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.153+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdfc06bc10 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.157+0000 7efdf8c00640 1 -- 172.21.15.144:0/4175414869 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efdec01a070 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.157+0000 7efdf8c00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efddc0678c0 0x7efddc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.157+0000 7efdf8c00640 1 -- 172.21.15.144:0/4175414869 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5619+0+0 (secure 0 0 0) 0x7efdec085ff0 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.157+0000 7efdfbe00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efddc0678c0 0x7efddc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:29.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.157+0000 7efdfbe00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efddc0678c0 0x7efddc069d80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efde80ad000 tx=0x7efde8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:29.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.161+0000 7efdf8c00640 1 -- 172.21.15.144:0/4175414869 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efdec021020 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.317+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efdfc0afc20 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efdf8c00640 1 -- 172.21.15.144:0/4175414869 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v112) ==== 170+0+0 (secure 0 0 0) 0x7efdfc1fbba0 con 0x7efdfc0cd9f0 2024-09-12T12:18:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:18:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efddc0678c0 msgr2=0x7efddc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efddc0678c0 0x7efddc069d80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efde80ad000 tx=0x7efde8008040 comp rx=0 tx=0).stop 2024-09-12T12:18:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdfc0cd9f0 msgr2=0x7efdfc071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdfc0cd9f0 0x7efdfc071e80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7efdec001f40 tx=0x7efdec00a430 comp rx=0 tx=0).stop 2024-09-12T12:18:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 shutdown_connections 2024-09-12T12:18:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efddc0678c0 0x7efddc069d80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efdfc15b340 0x7efdfc070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efdfc15af60 0x7efdfc1fb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 --2- 172.21.15.144:0/4175414869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdfc0cd9f0 0x7efdfc071e80 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 >> 172.21.15.144:0/4175414869 conn(0x7efdfc068030 msgr2=0x7efdfc0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 shutdown_connections 2024-09-12T12:18:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:29.973+0000 7efe03c00640 1 -- 172.21.15.144:0/4175414869 wait complete. 2024-09-12T12:18:30.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:18:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f7245c00640 1 Processor -- start 2024-09-12T12:18:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f7245c00640 1 -- start start 2024-09-12T12:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f7245c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7240158be0 0x7f72400b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f7245c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72400d2dc0 0x7f72400b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f7245c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72400b7260 con 0x7f7240158800 2024-09-12T12:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f7245c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f72400d2300 con 0x7f7240158be0 2024-09-12T12:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f7245c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f72400d25e0 con 0x7f72400d2dc0 2024-09-12T12:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f723f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7240158be0 0x7f72400b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f723fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7240158800 0x7f72400b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42362/0 (socket says 172.21.15.144:42362) 2024-09-12T12:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f723fe00640 1 -- 172.21.15.144:0/3203541342 learned_addr learned my addr 172.21.15.144:0/3203541342 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.153+0000 7f723f400640 1 --2- 172.21.15.144:0/3203541342 >> v2:172.21.15.144:3300/0 conn(0x7f7240158be0 0x7f72400b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40432/0 (socket says 172.21.15.144:40432) 2024-09-12T12:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f7245200640 1 --2- 172.21.15.144:0/3203541342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72400d2dc0 0x7f72400b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f723f400640 1 -- 172.21.15.144:0/3203541342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72400d2dc0 msgr2=0x7f72400b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f723f400640 1 --2- 172.21.15.144:0/3203541342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72400d2dc0 0x7f72400b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f723f400640 1 -- 172.21.15.144:0/3203541342 >> v1:172.21.15.144:6789/0 conn(0x7f7240158800 legacy=0x7f72400b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f723f400640 1 -- 172.21.15.144:0/3203541342 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72400b7540 con 0x7f7240158be0 2024-09-12T12:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f723ea00640 1 -- 172.21.15.144:0/3203541342 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212469697 0 0) 0x7f72400b7260 con 0x7f7240158800 2024-09-12T12:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f7245200640 1 --2- 172.21.15.144:0/3203541342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72400d2dc0 0x7f72400b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f723f400640 1 --2- 172.21.15.144:0/3203541342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158be0 0x7f72400b3fa0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f722c0097c0 tx=0x7f722c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874f0b230f8e7774 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f723ea00640 1 -- 172.21.15.144:0/3203541342 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c0b0070 con 0x7f7240158be0 2024-09-12T12:18:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f723ea00640 1 -- 172.21.15.144:0/3203541342 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c0ab600 con 0x7f7240158be0 2024-09-12T12:18:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.157+0000 7f723ea00640 1 -- 172.21.15.144:0/3203541342 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c0ab9d0 con 0x7f7240158be0 2024-09-12T12:18:30.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 -- 172.21.15.144:0/3203541342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158be0 msgr2=0x7f72400b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:30.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 --2- 172.21.15.144:0/3203541342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158be0 0x7f72400b3fa0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f722c0097c0 tx=0x7f722c01c410 comp rx=0 tx=0).stop 2024-09-12T12:18:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 -- 172.21.15.144:0/3203541342 shutdown_connections 2024-09-12T12:18:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 --2- 172.21.15.144:0/3203541342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72400d2dc0 0x7f72400b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 --2- 172.21.15.144:0/3203541342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158be0 0x7f72400b3fa0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 -- 172.21.15.144:0/3203541342 >> 172.21.15.144:0/3203541342 conn(0x7f72400b7c30 msgr2=0x7f7240067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 -- 172.21.15.144:0/3203541342 shutdown_connections 2024-09-12T12:18:30.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 -- 172.21.15.144:0/3203541342 wait complete. 2024-09-12T12:18:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 Processor -- start 2024-09-12T12:18:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 -- start start 2024-09-12T12:18:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72400d2dc0 0x7f724014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158800 0x7f724014e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7240158be0 0x7f7240153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f724015f590 con 0x7f7240158800 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f724015f410 con 0x7f72400d2dc0 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f724015f710 con 0x7f7240158be0 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158800 0x7f724014e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158800 0x7f724014e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40440/0 (socket says 172.21.15.144:40440) 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723f400640 1 -- 172.21.15.144:0/1060467729 learned_addr learned my addr 172.21.15.144:0/1060467729 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723f400640 1 -- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7240158be0 msgr2=0x7f7240153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245200640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7240158be0 0x7f7240153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723fe00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72400d2dc0 0x7f724014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723f400640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7240158be0 0x7f7240153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723f400640 1 -- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72400d2dc0 msgr2=0x7f724014dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723f400640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72400d2dc0 0x7f724014dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723f400640 1 -- 172.21.15.144:0/1060467729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724014e630 con 0x7f7240158800 2024-09-12T12:18:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f7245200640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7240158be0 0x7f7240153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723fe00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72400d2dc0 0x7f724014dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.161+0000 7f723f400640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158800 0x7f724014e0f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f722c0ae040 tx=0x7f722c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f7237e00640 1 -- 172.21.15.144:0/1060467729 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c0b0050 con 0x7f7240158800 2024-09-12T12:18:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f7237e00640 1 -- 172.21.15.144:0/1060467729 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722c0b1040 con 0x7f7240158800 2024-09-12T12:18:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724014e900 con 0x7f7240158800 2024-09-12T12:18:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f7237e00640 1 -- 172.21.15.144:0/1060467729 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c004220 con 0x7f7240158800 2024-09-12T12:18:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724014eec0 con 0x7f7240158800 2024-09-12T12:18:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72400b67a0 con 0x7f7240158800 2024-09-12T12:18:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f7237e00640 1 -- 172.21.15.144:0/1060467729 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f722c0be060 con 0x7f7240158800 2024-09-12T12:18:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f7237e00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72200678c0 0x7f7220069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f7237e00640 1 -- 172.21.15.144:0/1060467729 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 6001+0+0 (secure 0 0 0) 0x7f722c11f8a0 con 0x7f7240158800 2024-09-12T12:18:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f723fe00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72200678c0 0x7f7220069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.165+0000 7f723fe00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72200678c0 0x7f7220069d80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f72300012f0 tx=0x7f7230009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.169+0000 7f7237e00640 1 -- 172.21.15.144:0/1060467729 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f722c016090 con 0x7f7240158800 2024-09-12T12:18:30.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.361+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f72401557f0 con 0x7f7240158800 2024-09-12T12:18:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.977+0000 7f7237e00640 1 -- 172.21.15.144:0/1060467729 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v84) ==== 174+0+0 (secure 0 0 0) 0x7f722c0f0210 con 0x7f7240158800 2024-09-12T12:18:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 15 and data pool 16 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.977+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72200678c0 msgr2=0x7f7220069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.977+0000 7f7245c00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72200678c0 0x7f7220069d80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f72300012f0 tx=0x7f7230009040 comp rx=0 tx=0).stop 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.977+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158800 msgr2=0x7f724014e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.977+0000 7f7245c00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158800 0x7f724014e0f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f722c0ae040 tx=0x7f722c01ac50 comp rx=0 tx=0).stop 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.981+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 shutdown_connections 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.981+0000 7f7245c00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72200678c0 0x7f7220069d80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.981+0000 7f7245c00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7240158be0 0x7f7240153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.981+0000 7f7245c00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7240158800 0x7f724014e0f0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.981+0000 7f7245c00640 1 --2- 172.21.15.144:0/1060467729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72400d2dc0 0x7f724014dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.981+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 >> 172.21.15.144:0/1060467729 conn(0x7f72400b7c30 msgr2=0x7f7240073480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:30.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.981+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 shutdown_connections 2024-09-12T12:18:30.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:30.981+0000 7f7245c00640 1 -- 172.21.15.144:0/1060467729 wait complete. 2024-09-12T12:18:31.019 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:18:31.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f4742200640 1 Processor -- start 2024-09-12T12:18:31.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f4742200640 1 -- start start 2024-09-12T12:18:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f4742200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c15c7b0 0x7f473c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f4742200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f473c0b5fb0 0x7f473c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f4742200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473c0cd870 con 0x7f473c15cd30 2024-09-12T12:18:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f4742200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f473c072a50 con 0x7f473c0b5fb0 2024-09-12T12:18:31.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f4742200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f473c0cde30 con 0x7f473c15c7b0 2024-09-12T12:18:31.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f473c0b5fb0 0x7f473c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c15c7b0 0x7f473c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f473c0b5fb0 0x7f473c072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:38410/0 (socket says 172.21.15.144:38410) 2024-09-12T12:18:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473be00640 1 -- 172.21.15.144:0/2986573550 learned_addr learned my addr 172.21.15.144:0/2986573550 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473a000640 1 -- 172.21.15.144:0/2986573550 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029368934 0 0) 0x7f473c0cd870 con 0x7f473c15cd30 2024-09-12T12:18:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473a000640 1 -- 172.21.15.144:0/2986573550 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4720003530 con 0x7f473c15cd30 2024-09-12T12:18:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473b400640 1 -- 172.21.15.144:0/2986573550 >> v2:172.21.15.165:3300/0 conn(0x7f473c0b5fb0 msgr2=0x7f473c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473b400640 1 --2- 172.21.15.144:0/2986573550 >> v2:172.21.15.165:3300/0 conn(0x7f473c0b5fb0 0x7f473c072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473b400640 1 -- 172.21.15.144:0/2986573550 >> v1:172.21.15.165:6789/0 conn(0x7f473c15cd30 legacy=0x7f473c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473b400640 1 -- 172.21.15.144:0/2986573550 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c0cdb50 con 0x7f473c15c7b0 2024-09-12T12:18:31.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.161+0000 7f473be00640 1 --2- 172.21.15.144:0/2986573550 >> v2:172.21.15.165:3300/0 conn(0x7f473c0b5fb0 0x7f473c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f473b400640 1 --2- 172.21.15.144:0/2986573550 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c15c7b0 0x7f473c0ccf00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f472c0097c0 tx=0x7f472c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11951d6de32a1f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f473a000640 1 -- 172.21.15.144:0/2986573550 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0b1070 con 0x7f473c15c7b0 2024-09-12T12:18:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f473a000640 1 -- 172.21.15.144:0/2986573550 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c0ac410 con 0x7f473c15c7b0 2024-09-12T12:18:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f473a000640 1 -- 172.21.15.144:0/2986573550 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0ac7c0 con 0x7f473c15c7b0 2024-09-12T12:18:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f4742200640 1 -- 172.21.15.144:0/2986573550 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c15c7b0 msgr2=0x7f473c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f4742200640 1 --2- 172.21.15.144:0/2986573550 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c15c7b0 0x7f473c0ccf00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f472c0097c0 tx=0x7f472c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f4742200640 1 -- 172.21.15.144:0/2986573550 shutdown_connections 2024-09-12T12:18:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f4742200640 1 --2- 172.21.15.144:0/2986573550 >> v2:172.21.15.165:3300/0 conn(0x7f473c0b5fb0 0x7f473c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f4742200640 1 --2- 172.21.15.144:0/2986573550 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c15c7b0 0x7f473c0ccf00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f4742200640 1 -- 172.21.15.144:0/2986573550 >> 172.21.15.144:0/2986573550 conn(0x7f473c06d0d0 msgr2=0x7f473c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f4742200640 1 -- 172.21.15.144:0/2986573550 shutdown_connections 2024-09-12T12:18:31.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.165+0000 7f4742200640 1 -- 172.21.15.144:0/2986573550 wait complete. 2024-09-12T12:18:31.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 Processor -- start 2024-09-12T12:18:31.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 -- start start 2024-09-12T12:18:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c0b5fb0 0x7f473c14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f473c15c7b0 0x7f473c166540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473c15cd30 0x7f473c166a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f473c073fc0 con 0x7f473c15c7b0 2024-09-12T12:18:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f473c073e40 con 0x7f473c15cd30 2024-09-12T12:18:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f473c074140 con 0x7f473c0b5fb0 2024-09-12T12:18:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c0b5fb0 0x7f473c14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c0b5fb0 0x7f473c14ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60224/0 (socket says 172.21.15.144:60224) 2024-09-12T12:18:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473c15cd30 0x7f473c166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473b400640 1 -- 172.21.15.144:0/467457642 learned_addr learned my addr 172.21.15.144:0/467457642 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473aa00640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f473c15c7b0 0x7f473c166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473b400640 1 -- 172.21.15.144:0/467457642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473c15cd30 msgr2=0x7f473c166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473b400640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473c15cd30 0x7f473c166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473b400640 1 -- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f473c15c7b0 msgr2=0x7f473c166540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473b400640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f473c15c7b0 0x7f473c166540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473b400640 1 -- 172.21.15.144:0/467457642 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c1f8e60 con 0x7f473c0b5fb0 2024-09-12T12:18:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f473b400640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c0b5fb0 0x7f473c14ad00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f472c0af040 tx=0x7f472c019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4733400640 1 -- 172.21.15.144:0/467457642 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0b9020 con 0x7f473c0b5fb0 2024-09-12T12:18:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4733400640 1 -- 172.21.15.144:0/467457642 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c0accc0 con 0x7f473c0b5fb0 2024-09-12T12:18:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c1f9140 con 0x7f473c0b5fb0 2024-09-12T12:18:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4733400640 1 -- 172.21.15.144:0/467457642 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0b1040 con 0x7f473c0b5fb0 2024-09-12T12:18:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.169+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c1f9700 con 0x7f473c0b5fb0 2024-09-12T12:18:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.173+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473c072ee0 con 0x7f473c0b5fb0 2024-09-12T12:18:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.173+0000 7f4733400640 1 -- 172.21.15.144:0/467457642 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f472c0bc020 con 0x7f473c0b5fb0 2024-09-12T12:18:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.173+0000 7f4733400640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f471c0678c0 0x7f471c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.173+0000 7f4733400640 1 -- 172.21.15.144:0/467457642 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f472c11f700 con 0x7f473c0b5fb0 2024-09-12T12:18:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.173+0000 7f473aa00640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f471c0678c0 0x7f471c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.173+0000 7f473aa00640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f471c0678c0 0x7f471c069d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f473c150a60 tx=0x7f4728009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:31.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.177+0000 7f4733400640 1 -- 172.21.15.144:0/467457642 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f472c0c3030 con 0x7f473c0b5fb0 2024-09-12T12:18:31.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.337+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f473c1f66c0 con 0x7f473c0b5fb0 2024-09-12T12:18:31.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4733400640 1 -- 172.21.15.144:0/467457642 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16981 (secure 0 0 0) 0x7f472c016090 con 0x7f473c0b5fb0 2024-09-12T12:18:31.340 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:31.340 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":113,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:18:30.364789+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:18:28.080682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T12:18:29.365313+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:18:31.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f471c0678c0 msgr2=0x7f471c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f471c0678c0 0x7f471c069d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f473c150a60 tx=0x7f4728009040 comp rx=0 tx=0).stop 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c0b5fb0 msgr2=0x7f473c14ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c0b5fb0 0x7f473c14ad00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f472c0af040 tx=0x7f472c019240 comp rx=0 tx=0).stop 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 shutdown_connections 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f471c0678c0 0x7f471c069d80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473c15cd30 0x7f473c166a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f473c15c7b0 0x7f473c166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 --2- 172.21.15.144:0/467457642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473c0b5fb0 0x7f473c14ad00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 >> 172.21.15.144:0/467457642 conn(0x7f473c06d0d0 msgr2=0x7f473c160760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 shutdown_connections 2024-09-12T12:18:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.341+0000 7f4742200640 1 -- 172.21.15.144:0/467457642 wait complete. 2024-09-12T12:18:31.361 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:18:31.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f9442000640 1 Processor -- start 2024-09-12T12:18:31.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f9442000640 1 -- start start 2024-09-12T12:18:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f9442000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c0b3c10 0x7f943c0ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f9442000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f943c15c6d0 0x7f943c0cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f9442000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f943c15cbb0 con 0x7f943c15c2f0 2024-09-12T12:18:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f9442000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f943c0cf1b0 con 0x7f943c15c6d0 2024-09-12T12:18:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f9442000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f943c15ce90 con 0x7f943c0b3c10 2024-09-12T12:18:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f943be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f943c15c6d0 0x7f943c0cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f943be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f943c15c6d0 0x7f943c0cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40454/0 (socket says 172.21.15.144:40454) 2024-09-12T12:18:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f943be00640 1 -- 172.21.15.144:0/2531539719 learned_addr learned my addr 172.21.15.144:0/2531539719 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f943aa00640 1 --2- 172.21.15.144:0/2531539719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c0b3c10 0x7f943c0ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f943be00640 1 -- 172.21.15.144:0/2531539719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c0b3c10 msgr2=0x7f943c0ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f943be00640 1 --2- 172.21.15.144:0/2531539719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c0b3c10 0x7f943c0ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f943be00640 1 -- 172.21.15.144:0/2531539719 >> v1:172.21.15.165:6789/0 conn(0x7f943c15c2f0 legacy=0x7f943c0b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.501+0000 7f943be00640 1 -- 172.21.15.144:0/2531539719 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c15d170 con 0x7f943c15c6d0 2024-09-12T12:18:31.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f943be00640 1 --2- 172.21.15.144:0/2531539719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 0x7f943c0cec70 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f9434009e50 tx=0x7f943401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02c248563765586 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f943a000640 1 -- 172.21.15.144:0/2531539719 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340a5920 con 0x7f943c15c6d0 2024-09-12T12:18:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f943a000640 1 -- 172.21.15.144:0/2531539719 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94340a5ac0 con 0x7f943c15c6d0 2024-09-12T12:18:31.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f943a000640 1 -- 172.21.15.144:0/2531539719 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340ad3f0 con 0x7f943c15c6d0 2024-09-12T12:18:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 -- 172.21.15.144:0/2531539719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 msgr2=0x7f943c0cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 --2- 172.21.15.144:0/2531539719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 0x7f943c0cec70 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f9434009e50 tx=0x7f943401ca30 comp rx=0 tx=0).stop 2024-09-12T12:18:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 -- 172.21.15.144:0/2531539719 shutdown_connections 2024-09-12T12:18:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 --2- 172.21.15.144:0/2531539719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 0x7f943c0cec70 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 --2- 172.21.15.144:0/2531539719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c0b3c10 0x7f943c0ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 -- 172.21.15.144:0/2531539719 >> 172.21.15.144:0/2531539719 conn(0x7f943c06f8b0 msgr2=0x7f943c06fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 -- 172.21.15.144:0/2531539719 shutdown_connections 2024-09-12T12:18:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 -- 172.21.15.144:0/2531539719 wait complete. 2024-09-12T12:18:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 Processor -- start 2024-09-12T12:18:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.505+0000 7f9442000640 1 -- start start 2024-09-12T12:18:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9442000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f943c0b3c10 0x7f943c14d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9442000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c15c2f0 0x7f943c0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9442000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 0x7f943c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9442000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f943c0b64b0 con 0x7f943c15c6d0 2024-09-12T12:18:31.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9442000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f943c0b6330 con 0x7f943c0b3c10 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9442000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f943c0b6630 con 0x7f943c15c2f0 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 0x7f943c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f943c0b3c10 0x7f943c14d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c15c2f0 0x7f943c0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c15c2f0 0x7f943c0b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60246/0 (socket says 172.21.15.144:60246) 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943aa00640 1 -- 172.21.15.144:0/2075614593 learned_addr learned my addr 172.21.15.144:0/2075614593 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 0x7f943c0b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40456/0 (socket says 172.21.15.144:40456) 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f943c0b3c10 0x7f943c14d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:38422/0 (socket says 172.21.15.144:38422) 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943be00640 1 -- 172.21.15.144:0/2075614593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c15c2f0 msgr2=0x7f943c0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943be00640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c15c2f0 0x7f943c0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943be00640 1 -- 172.21.15.144:0/2075614593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f943c0b3c10 msgr2=0x7f943c14d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943be00640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f943c0b3c10 0x7f943c14d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943be00640 1 -- 172.21.15.144:0/2075614593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c0b17e0 con 0x7f943c15c6d0 2024-09-12T12:18:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943aa00640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c15c2f0 0x7f943c0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f943be00640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 0x7f943c0b47c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f943c0b7250 tx=0x7f94340197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9433400640 1 -- 172.21.15.144:0/2075614593 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340bc030 con 0x7f943c15c6d0 2024-09-12T12:18:31.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9433400640 1 -- 172.21.15.144:0/2075614593 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9434007e20 con 0x7f943c15c6d0 2024-09-12T12:18:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943c1546e0 con 0x7f943c15c6d0 2024-09-12T12:18:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9433400640 1 -- 172.21.15.144:0/2075614593 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340a5920 con 0x7f943c15c6d0 2024-09-12T12:18:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943c150bc0 con 0x7f943c15c6d0 2024-09-12T12:18:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.509+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f943c0b69e0 con 0x7f943c15c6d0 2024-09-12T12:18:31.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.513+0000 7f9433400640 1 -- 172.21.15.144:0/2075614593 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f94340bf070 con 0x7f943c15c6d0 2024-09-12T12:18:31.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.513+0000 7f9433400640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f941c0678f0 0x7f941c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.513+0000 7f9433400640 1 -- 172.21.15.144:0/2075614593 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f9434120fe0 con 0x7f943c15c6d0 2024-09-12T12:18:31.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.513+0000 7f943b400640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f941c0678f0 0x7f941c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.513+0000 7f943b400640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f941c0678f0 0x7f941c069db0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f942c007fd0 tx=0x7f942c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:31.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.517+0000 7f9433400640 1 -- 172.21.15.144:0/2075614593 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f94340c7020 con 0x7f943c15c6d0 2024-09-12T12:18:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.677+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f943c0cedf0 con 0x7f943c15c6d0 2024-09-12T12:18:31.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9433400640 1 -- 172.21.15.144:0/2075614593 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16981 (secure 0 0 0) 0x7f9434016620 con 0x7f943c15c6d0 2024-09-12T12:18:31.679 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:31.679 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":113,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:18:30.364789+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:18:28.080682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T12:18:29.365313+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f941c0678f0 msgr2=0x7f941c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f941c0678f0 0x7f941c069db0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f942c007fd0 tx=0x7f942c009040 comp rx=0 tx=0).stop 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 msgr2=0x7f943c0b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 0x7f943c0b47c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f943c0b7250 tx=0x7f94340197d0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 shutdown_connections 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f941c0678f0 0x7f941c069db0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f943c15c6d0 0x7f943c0b47c0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f943c15c2f0 0x7f943c0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 --2- 172.21.15.144:0/2075614593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f943c0b3c10 0x7f943c14d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 >> 172.21.15.144:0/2075614593 conn(0x7f943c06f8b0 msgr2=0x7f943c15a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 shutdown_connections 2024-09-12T12:18:31.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.681+0000 7f9442000640 1 -- 172.21.15.144:0/2075614593 wait complete. 2024-09-12T12:18:31.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:18:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.837+0000 7f9245a00640 1 Processor -- start 2024-09-12T12:18:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.837+0000 7f9245a00640 1 -- start start 2024-09-12T12:18:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f9245a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f924015af60 0x7f92400ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f9245a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f92400cd9f0 0x7f924006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f9245a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92400b4300 con 0x7f924015b340 2024-09-12T12:18:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f9245a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f92400b32f0 con 0x7f92400cd9f0 2024-09-12T12:18:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f9245a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f92400b3540 con 0x7f924015af60 2024-09-12T12:18:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f923e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f92400cd9f0 0x7f924006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f923e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f92400cd9f0 0x7f924006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40460/0 (socket says 172.21.15.144:40460) 2024-09-12T12:18:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f923e000640 1 -- 172.21.15.144:0/4094714517 learned_addr learned my addr 172.21.15.144:0/4094714517 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f923ea00640 1 --2- 172.21.15.144:0/4094714517 >> v2:172.21.15.165:3300/0 conn(0x7f924015af60 0x7f92400ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f923e000640 1 -- 172.21.15.144:0/4094714517 >> v2:172.21.15.165:3300/0 conn(0x7f924015af60 msgr2=0x7f92400ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f923e000640 1 --2- 172.21.15.144:0/4094714517 >> v2:172.21.15.165:3300/0 conn(0x7f924015af60 0x7f92400ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f923e000640 1 -- 172.21.15.144:0/4094714517 >> v1:172.21.15.165:6789/0 conn(0x7f924015b340 legacy=0x7f924015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.841+0000 7f923e000640 1 -- 172.21.15.144:0/4094714517 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92400b3820 con 0x7f92400cd9f0 2024-09-12T12:18:31.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f923e000640 1 --2- 172.21.15.144:0/4094714517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 0x7f924006bc10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f92400d0240 tx=0x7f922c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6ed77c3a52731d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:31.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f923d600640 1 -- 172.21.15.144:0/4094714517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c0b4070 con 0x7f92400cd9f0 2024-09-12T12:18:31.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f923d600640 1 -- 172.21.15.144:0/4094714517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c0a7ac0 con 0x7f92400cd9f0 2024-09-12T12:18:31.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f923d600640 1 -- 172.21.15.144:0/4094714517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c0af440 con 0x7f92400cd9f0 2024-09-12T12:18:31.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 -- 172.21.15.144:0/4094714517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 msgr2=0x7f924006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 --2- 172.21.15.144:0/4094714517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 0x7f924006bc10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f92400d0240 tx=0x7f922c01ebf0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 -- 172.21.15.144:0/4094714517 shutdown_connections 2024-09-12T12:18:31.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 --2- 172.21.15.144:0/4094714517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 0x7f924006bc10 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 --2- 172.21.15.144:0/4094714517 >> v2:172.21.15.165:3300/0 conn(0x7f924015af60 0x7f92400ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 -- 172.21.15.144:0/4094714517 >> 172.21.15.144:0/4094714517 conn(0x7f9240068030 msgr2=0x7f92400b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:31.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 -- 172.21.15.144:0/4094714517 shutdown_connections 2024-09-12T12:18:31.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 -- 172.21.15.144:0/4094714517 wait complete. 2024-09-12T12:18:31.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 Processor -- start 2024-09-12T12:18:31.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.845+0000 7f9245a00640 1 -- start start 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9245a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 0x7f924015e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9245a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f924015af60 0x7f9240153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9245a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f924015b340 0x7f92401539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9245a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f92400ced40 con 0x7f92400cd9f0 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9245a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92400cebc0 con 0x7f924015b340 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9245a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f924006d0f0 con 0x7f924015af60 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 0x7f924015e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 0x7f924015e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40462/0 (socket says 172.21.15.144:40462) 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923ea00640 1 -- 172.21.15.144:0/3966833940 learned_addr learned my addr 172.21.15.144:0/3966833940 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923f400640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f924015b340 0x7f92401539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923ea00640 1 -- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f924015af60 msgr2=0x7f9240153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923e000640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f924015af60 0x7f9240153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923ea00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f924015af60 0x7f9240153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923ea00640 1 -- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f924015b340 msgr2=0x7f92401539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923ea00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f924015b340 0x7f92401539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923ea00640 1 -- 172.21.15.144:0/3966833940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9240072010 con 0x7f92400cd9f0 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923f400640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f924015b340 0x7f92401539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923e000640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f924015af60 0x7f9240153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f923ea00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 0x7f924015e1e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f923000efc0 tx=0x7f923000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9236a00640 1 -- 172.21.15.144:0/3966833940 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230018020 con 0x7f92400cd9f0 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9236a00640 1 -- 172.21.15.144:0/3966833940 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9230014480 con 0x7f92400cd9f0 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9236a00640 1 -- 172.21.15.144:0/3966833940 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230014850 con 0x7f92400cd9f0 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9240153fd0 con 0x7f92400cd9f0 2024-09-12T12:18:31.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9240154590 con 0x7f92400cd9f0 2024-09-12T12:18:31.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.849+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924015c1a0 con 0x7f92400cd9f0 2024-09-12T12:18:31.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.853+0000 7f9236a00640 1 -- 172.21.15.144:0/3966833940 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f923001b020 con 0x7f92400cd9f0 2024-09-12T12:18:31.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.853+0000 7f9236a00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:31.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.853+0000 7f9236a00640 1 -- 172.21.15.144:0/3966833940 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f9230086990 con 0x7f92400cd9f0 2024-09-12T12:18:31.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.853+0000 7f923e000640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:31.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.853+0000 7f923e000640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f922c0b1000 tx=0x7f922c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:31.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:31.857+0000 7f9236a00640 1 -- 172.21.15.144:0/3966833940 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f924015c1a0 con 0x7f92400cd9f0 2024-09-12T12:18:32.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:32.053+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f92400afc20 con 0x7f92400cd9f0 2024-09-12T12:18:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.009+0000 7f9236a00640 1 -- 172.21.15.144:0/3966833940 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v87) ==== 118+0+0 (secure 0 0 0) 0x7f9230022070 con 0x7f92400cd9f0 2024-09-12T12:18:33.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 msgr2=0x7f9220069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:33.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f922c0b1000 tx=0x7f922c008040 comp rx=0 tx=0).stop 2024-09-12T12:18:33.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 msgr2=0x7f924015e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:33.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 0x7f924015e1e0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f923000efc0 tx=0x7f923000c490 comp rx=0 tx=0).stop 2024-09-12T12:18:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 shutdown_connections 2024-09-12T12:18:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f924015b340 0x7f92401539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f924015af60 0x7f9240153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 --2- 172.21.15.144:0/3966833940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92400cd9f0 0x7f924015e1e0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 >> 172.21.15.144:0/3966833940 conn(0x7f9240068030 msgr2=0x7f92400afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 shutdown_connections 2024-09-12T12:18:33.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.013+0000 7f9245a00640 1 -- 172.21.15.144:0/3966833940 wait complete. 2024-09-12T12:18:33.033 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:18:33.033 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:18:33.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.173+0000 7f9bfdc00640 1 Processor -- start 2024-09-12T12:18:33.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.173+0000 7f9bfdc00640 1 -- start start 2024-09-12T12:18:33.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bfdc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9bf80b46b0 0x7f9bf80b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:33.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bfdc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf80d0b20 con 0x7f9bf815c5b0 2024-09-12T12:18:33.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bfdc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf80d0e00 con 0x7f9bf815c1d0 2024-09-12T12:18:33.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bfdc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf8073250 con 0x7f9bf80b46b0 2024-09-12T12:18:33.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bfd200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9bf815c5b0 0x7f9bf80d18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42372/0 (socket says 172.21.15.144:42372) 2024-09-12T12:18:33.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bfd200640 1 -- 172.21.15.144:0/3312322733 learned_addr learned my addr 172.21.15.144:0/3312322733 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:33.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf7400640 1 --2- 172.21.15.144:0/3312322733 >> v2:172.21.15.165:3300/0 conn(0x7f9bf80b46b0 0x7f9bf80b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:33.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769523578 0 0) 0x7f9bf80d0b20 con 0x7f9bf815c5b0 2024-09-12T12:18:33.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bdc003530 con 0x7f9bf815c5b0 2024-09-12T12:18:33.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3937270922 0 0) 0x7f9bdc003530 con 0x7f9bf815c5b0 2024-09-12T12:18:33.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 >> v2:172.21.15.165:3300/0 conn(0x7f9bf80b46b0 msgr2=0x7f9bf80b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:33.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 --2- 172.21.15.144:0/3312322733 >> v2:172.21.15.165:3300/0 conn(0x7f9bf80b46b0 0x7f9bf80b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 >> v1:172.21.15.165:6789/0 conn(0x7f9bf815c1d0 legacy=0x7f9bf80b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:33.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf80d10e0 con 0x7f9bf815c5b0 2024-09-12T12:18:33.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f9bf0001680 con 0x7f9bf815c5b0 2024-09-12T12:18:33.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 >> v1:172.21.15.144:6789/0 conn(0x7f9bf815c5b0 legacy=0x7f9bf80d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:33.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bdc0039c0 0x7f9bdc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:33.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc004810 0x7f9bdc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:33.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bdc0051d0 0x7f9bdc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:33.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc00c040 con 0x7f9bdc004810 2024-09-12T12:18:33.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc00c1f0 con 0x7f9bdc0039c0 2024-09-12T12:18:33.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9bdc00c3f0 con 0x7f9bdc0051d0 2024-09-12T12:18:33.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf7400640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc004810 0x7f9bdc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:33.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf7e00640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bdc0039c0 0x7f9bdc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:33.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bfd200640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bdc0051d0 0x7f9bdc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:33.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf7400640 1 -- 172.21.15.144:0/3312322733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bdc0051d0 msgr2=0x7f9bdc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:33.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf7400640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bdc0051d0 0x7f9bdc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf7400640 1 -- 172.21.15.144:0/3312322733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bdc0039c0 msgr2=0x7f9bdc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:33.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf7400640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bdc0039c0 0x7f9bdc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bf7400640 1 -- 172.21.15.144:0/3312322733 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc003530 con 0x7f9bdc004810 2024-09-12T12:18:33.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.177+0000 7f9bfd200640 1 -- 172.21.15.144:0/3312322733 reap_dead start 2024-09-12T12:18:33.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bf7400640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc004810 0x7f9bdc004c90 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009ae0 tx=0x7f9be401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62128f36d8a7f618 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:33.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be40b2070 con 0x7f9bdc004810 2024-09-12T12:18:33.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be40a5550 con 0x7f9bdc004810 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bf6a00640 1 -- 172.21.15.144:0/3312322733 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be40096b0 con 0x7f9bdc004810 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bfdc00640 1 -- 172.21.15.144:0/3312322733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc004810 msgr2=0x7f9bdc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bfdc00640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc004810 0x7f9bdc004c90 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009ae0 tx=0x7f9be401ca70 comp rx=0 tx=0).stop 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bfdc00640 1 -- 172.21.15.144:0/3312322733 shutdown_connections 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bfdc00640 1 --2- 172.21.15.144:0/3312322733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bdc004810 0x7f9bdc004c90 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bfdc00640 1 -- 172.21.15.144:0/3312322733 >> 172.21.15.144:0/3312322733 conn(0x7f9bf80b7c30 msgr2=0x7f9bf8067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bfdc00640 1 -- 172.21.15.144:0/3312322733 shutdown_connections 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bfdc00640 1 -- 172.21.15.144:0/3312322733 wait complete. 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bfdc00640 1 Processor -- start 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.181+0000 7f9bfdc00640 1 -- start start 2024-09-12T12:18:33.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfdc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bdc004810 0x7f9bf814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfdc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bf80cb690 0x7f9bf81f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfdc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bf80ce700 0x7f9bf815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfdc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf80b3fa0 con 0x7f9bf80ce700 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfdc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf80b74e0 con 0x7f9bdc004810 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfdc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf80b4120 con 0x7f9bf80cb690 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bf80ce700 0x7f9bf815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bf80ce700 0x7f9bf815ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40470/0 (socket says 172.21.15.144:40470) 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfd200640 1 -- 172.21.15.144:0/1273803049 learned_addr learned my addr 172.21.15.144:0/1273803049 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bf7e00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bdc004810 0x7f9bf814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bf7400640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bf80cb690 0x7f9bf81f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:33.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfd200640 1 -- 172.21.15.144:0/1273803049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bf80cb690 msgr2=0x7f9bf81f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:33.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfd200640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bf80cb690 0x7f9bf81f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfd200640 1 -- 172.21.15.144:0/1273803049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bdc004810 msgr2=0x7f9bf814dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:33.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfd200640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bdc004810 0x7f9bf814dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:33.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfd200640 1 -- 172.21.15.144:0/1273803049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf815e020 con 0x7f9bf80ce700 2024-09-12T12:18:33.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfd200640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bf80ce700 0x7f9bf815ac30 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f9bf815fe50 tx=0x7f9bf00119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:33.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9befe00640 1 -- 172.21.15.144:0/1273803049 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0010040 con 0x7f9bf80ce700 2024-09-12T12:18:33.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9befe00640 1 -- 172.21.15.144:0/1273803049 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf001a070 con 0x7f9bf80ce700 2024-09-12T12:18:33.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf815e2c0 con 0x7f9bf80ce700 2024-09-12T12:18:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9befe00640 1 -- 172.21.15.144:0/1273803049 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0013a20 con 0x7f9bf80ce700 2024-09-12T12:18:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf80cbb20 con 0x7f9bf80ce700 2024-09-12T12:18:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf80b68d0 con 0x7f9bf80ce700 2024-09-12T12:18:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.185+0000 7f9befe00640 1 -- 172.21.15.144:0/1273803049 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9bf0013bc0 con 0x7f9bf80ce700 2024-09-12T12:18:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.189+0000 7f9befe00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9bd80678c0 0x7f9bd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.189+0000 7f9befe00640 1 -- 172.21.15.144:0/1273803049 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f9bf0088b70 con 0x7f9bf80ce700 2024-09-12T12:18:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.189+0000 7f9bf7e00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9bd80678c0 0x7f9bd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:33.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.189+0000 7f9bf7e00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9bd80678c0 0x7f9bd8069d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9be8000f90 tx=0x7f9be8001520 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:33.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.193+0000 7f9befe00640 1 -- 172.21.15.144:0/1273803049 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9bf0058da0 con 0x7f9bf80ce700 2024-09-12T12:18:33.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:33.385+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9bf8073bb0 con 0x7f9bf80ce700 2024-09-12T12:18:34.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.017+0000 7f9befe00640 1 -- 172.21.15.144:0/1273803049 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v88) ==== 122+0+0 (secure 0 0 0) 0x7f9bf005d0a0 con 0x7f9bf80ce700 2024-09-12T12:18:34.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9bd80678c0 msgr2=0x7f9bd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9bd80678c0 0x7f9bd8069d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9be8000f90 tx=0x7f9be8001520 comp rx=0 tx=0).stop 2024-09-12T12:18:34.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bf80ce700 msgr2=0x7f9bf815ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bf80ce700 0x7f9bf815ac30 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f9bf815fe50 tx=0x7f9bf00119a0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 shutdown_connections 2024-09-12T12:18:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9bd80678c0 0x7f9bd8069d80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bf80ce700 0x7f9bf815ac30 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bf80cb690 0x7f9bf81f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 --2- 172.21.15.144:0/1273803049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bdc004810 0x7f9bf814dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 >> 172.21.15.144:0/1273803049 conn(0x7f9bf80b7c30 msgr2=0x7f9bf80b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 shutdown_connections 2024-09-12T12:18:34.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.021+0000 7f9bfdc00640 1 -- 172.21.15.144:0/1273803049 wait complete. 2024-09-12T12:18:34.043 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:18:34.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:34.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14de00640 1 Processor -- start 2024-09-12T12:18:34.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14de00640 1 -- start start 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14815f800 0x7fe14806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe14806c150 0x7fe1480d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe14806efd0 con 0x7fe148158d70 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14de00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe14815ed20 con 0x7fe14806c150 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe14815f000 con 0x7fe14815f800 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe14806c150 0x7fe1480d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14ca00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe148158d70 0x7fe14806e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42374/0 (socket says 172.21.15.144:42374) 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14ca00640 1 -- 172.21.15.144:0/1601822547 learned_addr learned my addr 172.21.15.144:0/1601822547 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe147e00640 1 --2- 172.21.15.144:0/1601822547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14815f800 0x7fe14806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14d400640 1 -- 172.21.15.144:0/1601822547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14815f800 msgr2=0x7fe14806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14d400640 1 --2- 172.21.15.144:0/1601822547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14815f800 0x7fe14806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14d400640 1 -- 172.21.15.144:0/1601822547 >> v1:172.21.15.144:6789/0 conn(0x7fe148158d70 legacy=0x7fe14806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.185+0000 7fe14d400640 1 -- 172.21.15.144:0/1601822547 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14815f2e0 con 0x7fe14806c150 2024-09-12T12:18:34.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14d400640 1 --2- 172.21.15.144:0/1601822547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe14806c150 0x7fe1480d1050 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe140009d90 tx=0x7fe14001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b6f11430424506 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:34.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe147400640 1 -- 172.21.15.144:0/1601822547 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1400b2070 con 0x7fe14806c150 2024-09-12T12:18:34.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe147400640 1 -- 172.21.15.144:0/1601822547 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1400a5830 con 0x7fe14806c150 2024-09-12T12:18:34.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe147400640 1 -- 172.21.15.144:0/1601822547 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1400a5c00 con 0x7fe14806c150 2024-09-12T12:18:34.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 -- 172.21.15.144:0/1601822547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe14806c150 msgr2=0x7fe1480d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 --2- 172.21.15.144:0/1601822547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe14806c150 0x7fe1480d1050 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe140009d90 tx=0x7fe14001c970 comp rx=0 tx=0).stop 2024-09-12T12:18:34.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 -- 172.21.15.144:0/1601822547 shutdown_connections 2024-09-12T12:18:34.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 --2- 172.21.15.144:0/1601822547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe14806c150 0x7fe1480d1050 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 --2- 172.21.15.144:0/1601822547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14815f800 0x7fe14806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 -- 172.21.15.144:0/1601822547 >> 172.21.15.144:0/1601822547 conn(0x7fe14806cd20 msgr2=0x7fe14806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:34.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 -- 172.21.15.144:0/1601822547 shutdown_connections 2024-09-12T12:18:34.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 -- 172.21.15.144:0/1601822547 wait complete. 2024-09-12T12:18:34.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 Processor -- start 2024-09-12T12:18:34.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.189+0000 7fe14de00640 1 -- start start 2024-09-12T12:18:34.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14806c150 0x7fe1480b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe148158d70 0x7fe148156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe14815f800 0x7fe1481572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe14816b4e0 con 0x7fe148158d70 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe14816b360 con 0x7fe14815f800 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe14816b660 con 0x7fe14806c150 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe147e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe148158d70 0x7fe148156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe147e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe148158d70 0x7fe148156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40488/0 (socket says 172.21.15.144:40488) 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe147e00640 1 -- 172.21.15.144:0/3131863941 learned_addr learned my addr 172.21.15.144:0/3131863941 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14d400640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe14815f800 0x7fe1481572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14ca00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14806c150 0x7fe1480b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe147e00640 1 -- 172.21.15.144:0/3131863941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14806c150 msgr2=0x7fe1480b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe147e00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14806c150 0x7fe1480b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe147e00640 1 -- 172.21.15.144:0/3131863941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe14815f800 msgr2=0x7fe1481572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe147e00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe14815f800 0x7fe1481572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe147e00640 1 -- 172.21.15.144:0/3131863941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe148150490 con 0x7fe148158d70 2024-09-12T12:18:34.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe147e00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe148158d70 0x7fe148156db0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe13400d620 tx=0x7fe13400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:34.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe144c00640 1 -- 172.21.15.144:0/3131863941 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13400b620 con 0x7fe148158d70 2024-09-12T12:18:34.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe144c00640 1 -- 172.21.15.144:0/3131863941 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe134019070 con 0x7fe148158d70 2024-09-12T12:18:34.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe148150770 con 0x7fe148158d70 2024-09-12T12:18:34.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe144c00640 1 -- 172.21.15.144:0/3131863941 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13400b9e0 con 0x7fe148158d70 2024-09-12T12:18:34.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe148150d30 con 0x7fe148158d70 2024-09-12T12:18:34.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1480d1050 con 0x7fe148158d70 2024-09-12T12:18:34.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.193+0000 7fe144c00640 1 -- 172.21.15.144:0/3131863941 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe13400bb80 con 0x7fe148158d70 2024-09-12T12:18:34.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.197+0000 7fe144c00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1280678c0 0x7fe128069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.197+0000 7fe144c00640 1 -- 172.21.15.144:0/3131863941 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7fe134086100 con 0x7fe148158d70 2024-09-12T12:18:34.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.197+0000 7fe14ca00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1280678c0 0x7fe128069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.197+0000 7fe14ca00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1280678c0 0x7fe128069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe1480b4420 tx=0x7fe13c007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:34.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.201+0000 7fe144c00640 1 -- 172.21.15.144:0/3131863941 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe134056450 con 0x7fe148158d70 2024-09-12T12:18:34.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.389+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1480691c0 con 0x7fe148158d70 2024-09-12T12:18:34.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.389+0000 7fe144c00640 1 -- 172.21.15.144:0/3131863941 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5237 (secure 0 0 0) 0x7fe13405a750 con 0x7fe148158d70 2024-09-12T12:18:34.390 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:34.390 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":88,"btime":"2024-09-12T12:18:34:012867+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6611,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3516117882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3516117882},{"type":"v1","addr":"172.21.15.144:6837","nonce":3516117882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4000269826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4000269826},{"type":"v1","addr":"172.21.15.165:6834","nonce":4000269826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2020456347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2020456347},{"type":"v1","addr":"172.21.15.165:6835","nonce":2020456347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:18:30.365135+0000","modified":"2024-09-12T12:18:33.387023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7273":{"gid":7273,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6836/3880489679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3880489679},{"type":"v1","addr":"172.21.15.144:6836","nonce":3880489679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7273,"qdb_cluster":[7273]},"id":7}]} 2024-09-12T12:18:34.391 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 88 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1280678c0 msgr2=0x7fe128069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1280678c0 0x7fe128069d80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe1480b4420 tx=0x7fe13c007e90 comp rx=0 tx=0).stop 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe148158d70 msgr2=0x7fe148156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe148158d70 0x7fe148156db0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe13400d620 tx=0x7fe13400dae0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 shutdown_connections 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1280678c0 0x7fe128069d80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe14815f800 0x7fe1481572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe148158d70 0x7fe148156db0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 --2- 172.21.15.144:0/3131863941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe14806c150 0x7fe1480b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 >> 172.21.15.144:0/3131863941 conn(0x7fe14806cd20 msgr2=0x7fe14815c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 shutdown_connections 2024-09-12T12:18:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.393+0000 7fe14de00640 1 -- 172.21.15.144:0/3131863941 wait complete. 2024-09-12T12:18:34.411 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:18:34.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4dede00640 1 Processor -- start 2024-09-12T12:18:34.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4dede00640 1 -- start start 2024-09-12T12:18:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4dede00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4de815e560 0x7f4de81629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4dede00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de80cf990 con 0x7f4de80b68f0 2024-09-12T12:18:34.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4dede00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de80cf3d0 con 0x7f4de80cec50 2024-09-12T12:18:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4dede00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4de80b7380 con 0x7f4de815e560 2024-09-12T12:18:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4deca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4de815e560 0x7f4de81629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4ded400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4de80b68f0 0x7f4de80d2f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42380/0 (socket says 172.21.15.144:42380) 2024-09-12T12:18:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4ded400640 1 -- 172.21.15.144:0/2302538564 learned_addr learned my addr 172.21.15.144:0/2302538564 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4deca00640 1 -- 172.21.15.144:0/2302538564 >> v1:172.21.15.165:6789/0 conn(0x7f4de80cec50 legacy=0x7f4de80b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4deca00640 1 -- 172.21.15.144:0/2302538564 >> v1:172.21.15.144:6789/0 conn(0x7f4de80b68f0 legacy=0x7f4de80d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4deca00640 1 -- 172.21.15.144:0/2302538564 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de80cf6b0 con 0x7f4de815e560 2024-09-12T12:18:34.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.549+0000 7f4de7400640 1 -- 172.21.15.144:0/2302538564 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063584383 0 0) 0x7f4de80cf990 con 0x7f4de80b68f0 2024-09-12T12:18:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4deca00640 1 --2- 172.21.15.144:0/2302538564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 0x7f4de81629f0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009d90 tx=0x7f4dd801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ef18cf7ad1c0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4de7400640 1 -- 172.21.15.144:0/2302538564 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80b2070 con 0x7f4de815e560 2024-09-12T12:18:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4de7400640 1 -- 172.21.15.144:0/2302538564 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd80a5920 con 0x7f4de815e560 2024-09-12T12:18:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4de7400640 1 -- 172.21.15.144:0/2302538564 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80a5cf0 con 0x7f4de815e560 2024-09-12T12:18:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4dede00640 1 -- 172.21.15.144:0/2302538564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 msgr2=0x7f4de81629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4dede00640 1 --2- 172.21.15.144:0/2302538564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 0x7f4de81629f0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009d90 tx=0x7f4dd801c970 comp rx=0 tx=0).stop 2024-09-12T12:18:34.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4dede00640 1 -- 172.21.15.144:0/2302538564 shutdown_connections 2024-09-12T12:18:34.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4dede00640 1 --2- 172.21.15.144:0/2302538564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 0x7f4de81629f0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4dede00640 1 -- 172.21.15.144:0/2302538564 >> 172.21.15.144:0/2302538564 conn(0x7f4de80d1270 msgr2=0x7f4de80d1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:34.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4dede00640 1 -- 172.21.15.144:0/2302538564 shutdown_connections 2024-09-12T12:18:34.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.553+0000 7f4dede00640 1 -- 172.21.15.144:0/2302538564 wait complete. 2024-09-12T12:18:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 Processor -- start 2024-09-12T12:18:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 -- start start 2024-09-12T12:18:34.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4de80b68f0 0x7f4de806c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4de80cec50 0x7f4de8150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 0x7f4de8150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4de80d3fa0 con 0x7f4de815e560 2024-09-12T12:18:34.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4de80d3e20 con 0x7f4de80cec50 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4de80d4120 con 0x7f4de80b68f0 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 0x7f4de8150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4ded400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 0x7f4de8150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40514/0 (socket says 172.21.15.144:40514) 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4ded400640 1 -- 172.21.15.144:0/394340924 learned_addr learned my addr 172.21.15.144:0/394340924 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4deca00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4de80b68f0 0x7f4de806c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4de7e00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4de80cec50 0x7f4de8150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4ded400640 1 -- 172.21.15.144:0/394340924 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4de80b68f0 msgr2=0x7f4de806c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4ded400640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4de80b68f0 0x7f4de806c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4ded400640 1 -- 172.21.15.144:0/394340924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4de80cec50 msgr2=0x7f4de8150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4ded400640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4de80cec50 0x7f4de8150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4ded400640 1 -- 172.21.15.144:0/394340924 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de815ee70 con 0x7f4de815e560 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4de7e00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4de80cec50 0x7f4de8150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:34.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4ded400640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 0x7f4de8150bb0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4de000c450 tx=0x7f4de000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:34.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4de4c00640 1 -- 172.21.15.144:0/394340924 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0017070 con 0x7f4de815e560 2024-09-12T12:18:34.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4de4c00640 1 -- 172.21.15.144:0/394340924 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de0005cf0 con 0x7f4de815e560 2024-09-12T12:18:34.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4de4c00640 1 -- 172.21.15.144:0/394340924 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0007310 con 0x7f4de815e560 2024-09-12T12:18:34.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de815f150 con 0x7f4de815e560 2024-09-12T12:18:34.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de815f710 con 0x7f4de815e560 2024-09-12T12:18:34.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.557+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de815f910 con 0x7f4de815e560 2024-09-12T12:18:34.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.561+0000 7f4de4c00640 1 -- 172.21.15.144:0/394340924 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4de001a070 con 0x7f4de815e560 2024-09-12T12:18:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.561+0000 7f4de4c00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dc80678c0 0x7f4dc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.561+0000 7f4de4c00640 1 -- 172.21.15.144:0/394340924 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f4de0085160 con 0x7f4de815e560 2024-09-12T12:18:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.561+0000 7f4deca00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dc80678c0 0x7f4dc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.561+0000 7f4deca00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dc80678c0 0x7f4dc8069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80af000 tx=0x7f4dd80a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:34.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.565+0000 7f4de4c00640 1 -- 172.21.15.144:0/394340924 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4de00554b0 con 0x7f4de815e560 2024-09-12T12:18:34.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.721+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4de81629f0 con 0x7f4de815e560 2024-09-12T12:18:34.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4de4c00640 1 -- 172.21.15.144:0/394340924 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16968 (secure 0 0 0) 0x7f4de00597b0 con 0x7f4de815e560 2024-09-12T12:18:34.723 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:34.723 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:18:31.977957+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:18:28.080682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T12:18:29.365313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:18:34.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dc80678c0 msgr2=0x7f4dc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dc80678c0 0x7f4dc8069d80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80af000 tx=0x7f4dd80a7070 comp rx=0 tx=0).stop 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 msgr2=0x7f4de8150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 0x7f4de8150bb0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4de000c450 tx=0x7f4de000c910 comp rx=0 tx=0).stop 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 shutdown_connections 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4dc80678c0 0x7f4dc8069d80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4de815e560 0x7f4de8150bb0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4de80cec50 0x7f4de8150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 --2- 172.21.15.144:0/394340924 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4de80b68f0 0x7f4de806c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 >> 172.21.15.144:0/394340924 conn(0x7f4de80d1270 msgr2=0x7f4de80b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 shutdown_connections 2024-09-12T12:18:34.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.725+0000 7f4dede00640 1 -- 172.21.15.144:0/394340924 wait complete. 2024-09-12T12:18:34.744 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:18:34.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:18:34.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be3600640 1 Processor -- start 2024-09-12T12:18:34.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be3600640 1 -- start start 2024-09-12T12:18:34.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be3600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 0x7f3bdc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be3600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3bdc0b3ad0 0x7f3bdc071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be3600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3bdc071960 0x7f3bdc0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be3600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3bdc0b45a0 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be3600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3bdc0b3fe0 con 0x7f3bdc071960 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be3600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3bdc0b42c0 con 0x7f3bdc15b4e0 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3bdbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3bdc0b3ad0 0x7f3bdc071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3bdbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3bdc0b3ad0 0x7f3bdc071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40528/0 (socket says 172.21.15.144:40528) 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3bdbe00640 1 -- 172.21.15.144:0/4086770153 learned_addr learned my addr 172.21.15.144:0/4086770153 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be1600640 1 --2- 172.21.15.144:0/4086770153 >> v2:172.21.15.165:3300/0 conn(0x7f3bdc071960 0x7f3bdc0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3be0c00640 1 --2- 172.21.15.144:0/4086770153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 0x7f3bdc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3bdbe00640 1 -- 172.21.15.144:0/4086770153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 msgr2=0x7f3bdc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3bdbe00640 1 --2- 172.21.15.144:0/4086770153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 0x7f3bdc0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3bdbe00640 1 -- 172.21.15.144:0/4086770153 >> v2:172.21.15.165:3300/0 conn(0x7f3bdc071960 msgr2=0x7f3bdc0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.881+0000 7f3bdbe00640 1 --2- 172.21.15.144:0/4086770153 >> v2:172.21.15.165:3300/0 conn(0x7f3bdc071960 0x7f3bdc0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3bdbe00640 1 -- 172.21.15.144:0/4086770153 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc0b1490 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be1600640 1 --2- 172.21.15.144:0/4086770153 >> v2:172.21.15.165:3300/0 conn(0x7f3bdc071960 0x7f3bdc0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:34.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3bdbe00640 1 --2- 172.21.15.144:0/4086770153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 0x7f3bdc071420 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0d04b0 tx=0x7f3bc801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd89b16cbf9ae01e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:34.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3bdb400640 1 -- 172.21.15.144:0/4086770153 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80b1070 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3bdb400640 1 -- 172.21.15.144:0/4086770153 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc80ac620 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3bdb400640 1 -- 172.21.15.144:0/4086770153 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80ac9f0 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be3600640 1 -- 172.21.15.144:0/4086770153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 msgr2=0x7f3bdc071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be3600640 1 --2- 172.21.15.144:0/4086770153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 0x7f3bdc071420 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0d04b0 tx=0x7f3bc801c4f0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be3600640 1 -- 172.21.15.144:0/4086770153 shutdown_connections 2024-09-12T12:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be3600640 1 --2- 172.21.15.144:0/4086770153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 0x7f3bdc071420 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be3600640 1 --2- 172.21.15.144:0/4086770153 >> v2:172.21.15.165:3300/0 conn(0x7f3bdc071960 0x7f3bdc0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be3600640 1 --2- 172.21.15.144:0/4086770153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 0x7f3bdc0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be3600640 1 -- 172.21.15.144:0/4086770153 >> 172.21.15.144:0/4086770153 conn(0x7f3bdc06d0d0 msgr2=0x7f3bdc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be3600640 1 -- 172.21.15.144:0/4086770153 shutdown_connections 2024-09-12T12:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.885+0000 7f3be3600640 1 -- 172.21.15.144:0/4086770153 wait complete. 2024-09-12T12:18:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 Processor -- start 2024-09-12T12:18:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 -- start start 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3bdc071960 0x7f3bdc14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 0x7f3bdc14c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 0x7f3bdc0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc15f270 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc15f0f0 con 0x7f3bdc071960 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3bdc15f3f0 con 0x7f3bdc15b4e0 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 0x7f3bdc14c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bdbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 0x7f3bdc14c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40532/0 (socket says 172.21.15.144:40532) 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bdbe00640 1 -- 172.21.15.144:0/2517256606 learned_addr learned my addr 172.21.15.144:0/2517256606 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be1600640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 0x7f3bdc0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be0c00640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3bdc071960 0x7f3bdc14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bdbe00640 1 -- 172.21.15.144:0/2517256606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 msgr2=0x7f3bdc0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bdbe00640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 0x7f3bdc0b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bdbe00640 1 -- 172.21.15.144:0/2517256606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3bdc071960 msgr2=0x7f3bdc14b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bdbe00640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3bdc071960 0x7f3bdc14b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bdbe00640 1 -- 172.21.15.144:0/2517256606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc14d3e0 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bdbe00640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 0x7f3bdc14c0f0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80af040 tx=0x7f3bc8019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:34.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bd8c00640 1 -- 172.21.15.144:0/2517256606 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80bc070 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bd8c00640 1 -- 172.21.15.144:0/2517256606 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc80b7430 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3bd8c00640 1 -- 172.21.15.144:0/2517256606 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80b1040 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bdc14cb40 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.889+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bdc15c0a0 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.893+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bdc071420 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.893+0000 7f3bd8c00640 1 -- 172.21.15.144:0/2517256606 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3bc80b63d0 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.893+0000 7f3bd8c00640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bbc0678c0 0x7f3bbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.893+0000 7f3bd8c00640 1 -- 172.21.15.144:0/2517256606 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f3bc811f760 con 0x7f3bdc0b3ad0 2024-09-12T12:18:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.893+0000 7f3be0c00640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bbc0678c0 0x7f3bbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.893+0000 7f3be0c00640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bbc0678c0 0x7f3bbc069d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009ee0 tx=0x7f3bcc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:34.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:34.897+0000 7f3bd8c00640 1 -- 172.21.15.144:0/2517256606 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3bc8016110 con 0x7f3bdc0b3ad0 2024-09-12T12:18:35.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.053+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3bdc14cf40 con 0x7f3bbc0678c0 2024-09-12T12:18:35.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.061+0000 7f3bd8c00640 1 -- 172.21.15.144:0/2517256606 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240269 (secure 0 0 0) 0x7f3bcc007e40 con 0x7f3bbc0678c0 2024-09-12T12:18:35.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:35.063 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:18:35.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bbc0678c0 msgr2=0x7f3bbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bbc0678c0 0x7f3bbc069d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009ee0 tx=0x7f3bcc00b040 comp rx=0 tx=0).stop 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 msgr2=0x7f3bdc14c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 0x7f3bdc14c0f0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80af040 tx=0x7f3bc8019290 comp rx=0 tx=0).stop 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 shutdown_connections 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3bbc0678c0 0x7f3bbc069d80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3bdc15b4e0 0x7f3bdc0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bdc0b3ad0 0x7f3bdc14c0f0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 --2- 172.21.15.144:0/2517256606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3bdc071960 0x7f3bdc14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 >> 172.21.15.144:0/2517256606 conn(0x7f3bdc06d0d0 msgr2=0x7f3bdc158350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 shutdown_connections 2024-09-12T12:18:35.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.065+0000 7f3be3600640 1 -- 172.21.15.144:0/2517256606 wait complete. 2024-09-12T12:18:35.083 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-12T12:18:33.449131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307136,"kb_used_data":11816,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754667584,"statfs":{"total":773094113280,"available":772779606016,"internally_reserved":0,"allocated":12099584,"data_stored":6278688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":302173745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.476624"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.971050+0000","last_change":"2024-09-12T12:18:28.971050+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.971050+0000","last_undegraded":"2024-09-12T12:18:28.971050+0000","last_fullsized":"2024-09-12T12:18:28.971050+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.977040+0000","last_change":"2024-09-12T12:18:28.977040+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.977040+0000","last_undegraded":"2024-09-12T12:18:28.977040+0000","last_fullsized":"2024-09-12T12:18:28.977040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.979309+0000","last_change":"2024-09-12T12:18:28.979309+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.979309+0000","last_undegraded":"2024-09-12T12:18:28.979309+0000","last_fullsized":"2024-09-12T12:18:28.979309+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973828+0000","last_change":"2024-09-12T12:18:28.973828+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973828+0000","last_undegraded":"2024-09-12T12:18:28.973828+0000","last_fullsized":"2024-09-12T12:18:28.973828+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.972958+0000","last_change":"2024-09-12T12:18:28.972958+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.972958+0000","last_undegraded":"2024-09-12T12:18:28.972958+0000","last_fullsized":"2024-09-12T12:18:28.972958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.974682+0000","last_change":"2024-09-12T12:18:28.974682+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.974682+0000","last_undegraded":"2024-09-12T12:18:28.974682+0000","last_fullsized":"2024-09-12T12:18:28.974682+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.978769+0000","last_change":"2024-09-12T12:18:28.978769+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.978769+0000","last_undegraded":"2024-09-12T12:18:28.978769+0000","last_fullsized":"2024-09-12T12:18:28.978769+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.971066+0000","last_change":"2024-09-12T12:18:28.971066+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.971066+0000","last_undegraded":"2024-09-12T12:18:28.971066+0000","last_fullsized":"2024-09-12T12:18:28.971066+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.979512+0000","last_change":"2024-09-12T12:18:28.979512+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.979512+0000","last_undegraded":"2024-09-12T12:18:28.979512+0000","last_fullsized":"2024-09-12T12:18:28.979512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.978757+0000","last_change":"2024-09-12T12:18:28.978757+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.978757+0000","last_undegraded":"2024-09-12T12:18:28.978757+0000","last_fullsized":"2024-09-12T12:18:28.978757+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973551+0000","last_change":"2024-09-12T12:18:28.973551+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973551+0000","last_undegraded":"2024-09-12T12:18:28.973551+0000","last_fullsized":"2024-09-12T12:18:28.973551+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973326+0000","last_change":"2024-09-12T12:18:28.973326+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973326+0000","last_undegraded":"2024-09-12T12:18:28.973326+0000","last_fullsized":"2024-09-12T12:18:28.973326+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973230+0000","last_change":"2024-09-12T12:18:28.973230+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973230+0000","last_undegraded":"2024-09-12T12:18:28.973230+0000","last_fullsized":"2024-09-12T12:18:28.973230+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.971157+0000","last_change":"2024-09-12T12:18:28.971157+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.971157+0000","last_undegraded":"2024-09-12T12:18:28.971157+0000","last_fullsized":"2024-09-12T12:18:28.971157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976222+0000","last_change":"2024-09-12T12:18:28.976222+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976222+0000","last_undegraded":"2024-09-12T12:18:28.976222+0000","last_fullsized":"2024-09-12T12:18:28.976222+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.978730+0000","last_change":"2024-09-12T12:18:28.978730+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.978730+0000","last_undegraded":"2024-09-12T12:18:28.978730+0000","last_fullsized":"2024-09-12T12:18:28.978730+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.974006+0000","last_change":"2024-09-12T12:18:28.974006+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.974006+0000","last_undegraded":"2024-09-12T12:18:28.974006+0000","last_fullsized":"2024-09-12T12:18:28.974006+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.972822+0000","last_change":"2024-09-12T12:18:28.972822+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.972822+0000","last_undegraded":"2024-09-12T12:18:28.972822+0000","last_fullsized":"2024-09-12T12:18:28.972822+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.974771+0000","last_change":"2024-09-12T12:18:28.974771+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.974771+0000","last_undegraded":"2024-09-12T12:18:28.974771+0000","last_fullsized":"2024-09-12T12:18:28.974771+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976180+0000","last_change":"2024-09-12T12:18:28.976180+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976180+0000","last_undegraded":"2024-09-12T12:18:28.976180+0000","last_fullsized":"2024-09-12T12:18:28.976180+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976734+0000","last_change":"2024-09-12T12:18:28.976734+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976734+0000","last_undegraded":"2024-09-12T12:18:28.976734+0000","last_fullsized":"2024-09-12T12:18:28.976734+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973536+0000","last_change":"2024-09-12T12:18:28.973536+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973536+0000","last_undegraded":"2024-09-12T12:18:28.973536+0000","last_fullsized":"2024-09-12T12:18:28.973536+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976781+0000","last_change":"2024-09-12T12:18:28.976781+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976781+0000","last_undegraded":"2024-09-12T12:18:28.976781+0000","last_fullsized":"2024-09-12T12:18:28.976781+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973267+0000","last_change":"2024-09-12T12:18:28.973267+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973267+0000","last_undegraded":"2024-09-12T12:18:28.973267+0000","last_fullsized":"2024-09-12T12:18:28.973267+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.978260+0000","last_change":"2024-09-12T12:18:28.978260+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.978260+0000","last_undegraded":"2024-09-12T12:18:28.978260+0000","last_fullsized":"2024-09-12T12:18:28.978260+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973905+0000","last_change":"2024-09-12T12:18:28.973905+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973905+0000","last_undegraded":"2024-09-12T12:18:28.973905+0000","last_fullsized":"2024-09-12T12:18:28.973905+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973301+0000","last_change":"2024-09-12T12:18:28.973301+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973301+0000","last_undegraded":"2024-09-12T12:18:28.973301+0000","last_fullsized":"2024-09-12T12:18:28.973301+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.979093+0000","last_change":"2024-09-12T12:18:28.979093+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.979093+0000","last_undegraded":"2024-09-12T12:18:28.979093+0000","last_fullsized":"2024-09-12T12:18:28.979093+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976314+0000","last_change":"2024-09-12T12:18:28.976314+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976314+0000","last_undegraded":"2024-09-12T12:18:28.976314+0000","last_fullsized":"2024-09-12T12:18:28.976314+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.972999+0000","last_change":"2024-09-12T12:18:28.972999+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.972999+0000","last_undegraded":"2024-09-12T12:18:28.972999+0000","last_fullsized":"2024-09-12T12:18:28.972999+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976031+0000","last_change":"2024-09-12T12:18:28.976031+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976031+0000","last_undegraded":"2024-09-12T12:18:28.976031+0000","last_fullsized":"2024-09-12T12:18:28.976031+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976016+0000","last_change":"2024-09-12T12:18:28.976016+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976016+0000","last_undegraded":"2024-09-12T12:18:28.976016+0000","last_fullsized":"2024-09-12T12:18:28.976016+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":333,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-12T12:18:28.972306+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:18:28.972306+0000","last_peered":"2024-09-12T12:18:28.972306+0000","last_clean":"2024-09-12T12:18:28.972306+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:18:28.972306+0000","last_undegraded":"2024-09-12T12:18:28.972306+0000","last_fullsized":"2024-09-12T12:18:28.972306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37248,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334592,"statfs":{"total":96636764160,"available":96598622208,"internally_reserved":0,"allocated":1945600,"data_stored":1221703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36696,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335144,"statfs":{"total":96636764160,"available":96599187456,"internally_reserved":0,"allocated":1363968,"data_stored":637064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36672,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335168,"statfs":{"total":96636764160,"available":96599212032,"internally_reserved":0,"allocated":1351680,"data_stored":631335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1363968,"data_stored":637064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40860,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330980,"statfs":{"total":96636764160,"available":96594923520,"internally_reserved":0,"allocated":1376256,"data_stored":643273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1376256,"data_stored":643273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1376256,"data_stored":643273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41408,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330432,"statfs":{"total":96636764160,"available":96594362368,"internally_reserved":0,"allocated":1945600,"data_stored":1221703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:18:35.087 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:18:35.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.265+0000 7f7faac00640 1 Processor -- start 2024-09-12T12:18:35.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.265+0000 7f7faac00640 1 -- start start 2024-09-12T12:18:35.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.265+0000 7f7faac00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7fa4071420 0x7f7fa4071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.265+0000 7f7faac00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa40b45a0 con 0x7f7fa40ccf30 2024-09-12T12:18:35.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.265+0000 7f7faac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa40b3fe0 con 0x7f7fa415b4e0 2024-09-12T12:18:35.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.265+0000 7f7faac00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa40b42c0 con 0x7f7fa4071420 2024-09-12T12:18:35.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa8c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7fa40ccf30 0x7f7fa40cd350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42382/0 (socket says 172.21.15.144:42382) 2024-09-12T12:18:35.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa8c00640 1 -- 172.21.15.144:0/2490311682 learned_addr learned my addr 172.21.15.144:0/2490311682 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa3400640 1 --2- 172.21.15.144:0/2490311682 >> v2:172.21.15.165:3300/0 conn(0x7f7fa4071420 0x7f7fa4071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432320088 0 0) 0x7f7fa40b45a0 con 0x7f7fa40ccf30 2024-09-12T12:18:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f88003530 con 0x7f7fa40ccf30 2024-09-12T12:18:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1442316417 0 0) 0x7f7f88003530 con 0x7f7fa40ccf30 2024-09-12T12:18:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 >> v2:172.21.15.165:3300/0 conn(0x7f7fa4071420 msgr2=0x7f7fa4071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 --2- 172.21.15.144:0/2490311682 >> v2:172.21.15.165:3300/0 conn(0x7f7fa4071420 0x7f7fa4071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 >> v1:172.21.15.165:6789/0 conn(0x7f7fa415b4e0 legacy=0x7f7fa40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa40b1490 con 0x7f7fa40ccf30 2024-09-12T12:18:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f7f9c001680 con 0x7f7fa40ccf30 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 >> v1:172.21.15.144:6789/0 conn(0x7f7fa40ccf30 legacy=0x7f7fa40cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f880039c0 0x7f7f88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f88004810 0x7f7f88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880051d0 0x7f7f8800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa40b42c0 con 0x7f7f880051d0 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8800c070 con 0x7f7f880039c0 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7f8800c270 con 0x7f7f88004810 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa8c00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880051d0 0x7f7f8800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa3400640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f88004810 0x7f7f88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa3e00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f880039c0 0x7f7f88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa8c00640 1 -- 172.21.15.144:0/2490311682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f88004810 msgr2=0x7f7f88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa8c00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f88004810 0x7f7f88004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa8c00640 1 -- 172.21.15.144:0/2490311682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f880039c0 msgr2=0x7f7f88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa8c00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f880039c0 0x7f7f88003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.269+0000 7f7fa8c00640 1 -- 172.21.15.144:0/2490311682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f88003530 con 0x7f7f880051d0 2024-09-12T12:18:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7fa8c00640 1 -- 172.21.15.144:0/2490311682 reap_dead start 2024-09-12T12:18:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7fa8c00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880051d0 0x7f7f8800b9d0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c1c0 tx=0x7f7f9c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f771d01b44680a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c007d00 con 0x7f7f880051d0 2024-09-12T12:18:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0a9070 con 0x7f7f880051d0 2024-09-12T12:18:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7fa2a00640 1 -- 172.21.15.144:0/2490311682 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0a5dc0 con 0x7f7f880051d0 2024-09-12T12:18:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7faac00640 1 -- 172.21.15.144:0/2490311682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880051d0 msgr2=0x7f7f8800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7faac00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880051d0 0x7f7f8800b9d0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c1c0 tx=0x7f7f9c01cc60 comp rx=0 tx=0).stop 2024-09-12T12:18:35.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7faac00640 1 -- 172.21.15.144:0/2490311682 shutdown_connections 2024-09-12T12:18:35.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7faac00640 1 --2- 172.21.15.144:0/2490311682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f880051d0 0x7f7f8800b9d0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7faac00640 1 -- 172.21.15.144:0/2490311682 >> 172.21.15.144:0/2490311682 conn(0x7f7fa406d0d0 msgr2=0x7f7fa406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:35.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7faac00640 1 -- 172.21.15.144:0/2490311682 shutdown_connections 2024-09-12T12:18:35.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7faac00640 1 -- 172.21.15.144:0/2490311682 wait complete. 2024-09-12T12:18:35.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7faac00640 1 Processor -- start 2024-09-12T12:18:35.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.273+0000 7f7faac00640 1 -- start start 2024-09-12T12:18:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7faac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f880051d0 0x7f7fa415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7faac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fa415cc20 0x7f7fa415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7faac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa40c9030 0x7f7fa40c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7faac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa415b8c0 con 0x7f7fa40c9030 2024-09-12T12:18:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7faac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa40cdef0 con 0x7f7fa415cc20 2024-09-12T12:18:35.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7faac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa40c6140 con 0x7f7f880051d0 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa40c9030 0x7f7fa40c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa40c9030 0x7f7fa40c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40550/0 (socket says 172.21.15.144:40550) 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa8c00640 1 -- 172.21.15.144:0/3338108444 learned_addr learned my addr 172.21.15.144:0/3338108444 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa3400640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fa415cc20 0x7f7fa415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa3e00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f880051d0 0x7f7fa415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa8c00640 1 -- 172.21.15.144:0/3338108444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f880051d0 msgr2=0x7f7fa415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa8c00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f880051d0 0x7f7fa415a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa8c00640 1 -- 172.21.15.144:0/3338108444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fa415cc20 msgr2=0x7f7fa415d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa8c00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fa415cc20 0x7f7fa415d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa8c00640 1 -- 172.21.15.144:0/3338108444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa40c55a0 con 0x7f7fa40c9030 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa3400640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fa415cc20 0x7f7fa415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7fa8c00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa40c9030 0x7f7fa40c94b0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c01d500 tx=0x7f7f88005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7f9be00640 1 -- 172.21.15.144:0/3338108444 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c001c40 con 0x7f7fa40c9030 2024-09-12T12:18:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7f9be00640 1 -- 172.21.15.144:0/3338108444 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0b4070 con 0x7f7fa40c9030 2024-09-12T12:18:35.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7f9be00640 1 -- 172.21.15.144:0/3338108444 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c004c10 con 0x7f7fa40c9030 2024-09-12T12:18:35.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa40c5810 con 0x7f7fa40c9030 2024-09-12T12:18:35.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa40c5dd0 con 0x7f7fa40c9030 2024-09-12T12:18:35.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa40c62c0 con 0x7f7fa40c9030 2024-09-12T12:18:35.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.277+0000 7f7f9be00640 1 -- 172.21.15.144:0/3338108444 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f9c0070d0 con 0x7f7fa40c9030 2024-09-12T12:18:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.281+0000 7f7f9be00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f840678c0 0x7f7f84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.281+0000 7f7f9be00640 1 -- 172.21.15.144:0/3338108444 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f7f9c11f260 con 0x7f7fa40c9030 2024-09-12T12:18:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.281+0000 7f7fa3e00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f840678c0 0x7f7f84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.281+0000 7f7fa3e00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f840678c0 0x7f7f84069d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4075450 tx=0x7f7f94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.285+0000 7f7f9be00640 1 -- 172.21.15.144:0/3338108444 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7f9c016970 con 0x7f7fa40c9030 2024-09-12T12:18:35.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.437+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fa4071840 con 0x7f7f840678c0 2024-09-12T12:18:35.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7f9be00640 1 -- 172.21.15.144:0/3338108444 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240269 (secure 0 0 0) 0x7f7fa4071840 con 0x7f7f840678c0 2024-09-12T12:18:35.445 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:35.447 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:18:35.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f840678c0 msgr2=0x7f7f84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f840678c0 0x7f7f84069d80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4075450 tx=0x7f7f94009040 comp rx=0 tx=0).stop 2024-09-12T12:18:35.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa40c9030 msgr2=0x7f7fa40c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa40c9030 0x7f7fa40c94b0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c01d500 tx=0x7f7f88005840 comp rx=0 tx=0).stop 2024-09-12T12:18:35.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 shutdown_connections 2024-09-12T12:18:35.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f840678c0 0x7f7f84069d80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa40c9030 0x7f7fa40c94b0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fa415cc20 0x7f7fa415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 --2- 172.21.15.144:0/3338108444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f880051d0 0x7f7fa415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.445+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 >> 172.21.15.144:0/3338108444 conn(0x7f7fa406d0d0 msgr2=0x7f7fa40b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:35.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.449+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 shutdown_connections 2024-09-12T12:18:35.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.449+0000 7f7faac00640 1 -- 172.21.15.144:0/3338108444 wait complete. 2024-09-12T12:18:35.466 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-12T12:18:33.449131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307136,"kb_used_data":11816,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754667584,"statfs":{"total":773094113280,"available":772779606016,"internally_reserved":0,"allocated":12099584,"data_stored":6278688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":302173745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.476624"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.971050+0000","last_change":"2024-09-12T12:18:28.971050+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.971050+0000","last_undegraded":"2024-09-12T12:18:28.971050+0000","last_fullsized":"2024-09-12T12:18:28.971050+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.977040+0000","last_change":"2024-09-12T12:18:28.977040+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.977040+0000","last_undegraded":"2024-09-12T12:18:28.977040+0000","last_fullsized":"2024-09-12T12:18:28.977040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.979309+0000","last_change":"2024-09-12T12:18:28.979309+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.979309+0000","last_undegraded":"2024-09-12T12:18:28.979309+0000","last_fullsized":"2024-09-12T12:18:28.979309+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973828+0000","last_change":"2024-09-12T12:18:28.973828+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973828+0000","last_undegraded":"2024-09-12T12:18:28.973828+0000","last_fullsized":"2024-09-12T12:18:28.973828+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.972958+0000","last_change":"2024-09-12T12:18:28.972958+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.972958+0000","last_undegraded":"2024-09-12T12:18:28.972958+0000","last_fullsized":"2024-09-12T12:18:28.972958+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.974682+0000","last_change":"2024-09-12T12:18:28.974682+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.974682+0000","last_undegraded":"2024-09-12T12:18:28.974682+0000","last_fullsized":"2024-09-12T12:18:28.974682+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.978769+0000","last_change":"2024-09-12T12:18:28.978769+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.978769+0000","last_undegraded":"2024-09-12T12:18:28.978769+0000","last_fullsized":"2024-09-12T12:18:28.978769+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.971066+0000","last_change":"2024-09-12T12:18:28.971066+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.971066+0000","last_undegraded":"2024-09-12T12:18:28.971066+0000","last_fullsized":"2024-09-12T12:18:28.971066+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.979512+0000","last_change":"2024-09-12T12:18:28.979512+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.979512+0000","last_undegraded":"2024-09-12T12:18:28.979512+0000","last_fullsized":"2024-09-12T12:18:28.979512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.978757+0000","last_change":"2024-09-12T12:18:28.978757+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.978757+0000","last_undegraded":"2024-09-12T12:18:28.978757+0000","last_fullsized":"2024-09-12T12:18:28.978757+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973551+0000","last_change":"2024-09-12T12:18:28.973551+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973551+0000","last_undegraded":"2024-09-12T12:18:28.973551+0000","last_fullsized":"2024-09-12T12:18:28.973551+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973326+0000","last_change":"2024-09-12T12:18:28.973326+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973326+0000","last_undegraded":"2024-09-12T12:18:28.973326+0000","last_fullsized":"2024-09-12T12:18:28.973326+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973230+0000","last_change":"2024-09-12T12:18:28.973230+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973230+0000","last_undegraded":"2024-09-12T12:18:28.973230+0000","last_fullsized":"2024-09-12T12:18:28.973230+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.971157+0000","last_change":"2024-09-12T12:18:28.971157+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.971157+0000","last_undegraded":"2024-09-12T12:18:28.971157+0000","last_fullsized":"2024-09-12T12:18:28.971157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976222+0000","last_change":"2024-09-12T12:18:28.976222+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976222+0000","last_undegraded":"2024-09-12T12:18:28.976222+0000","last_fullsized":"2024-09-12T12:18:28.976222+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.978730+0000","last_change":"2024-09-12T12:18:28.978730+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.978730+0000","last_undegraded":"2024-09-12T12:18:28.978730+0000","last_fullsized":"2024-09-12T12:18:28.978730+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.974006+0000","last_change":"2024-09-12T12:18:28.974006+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.974006+0000","last_undegraded":"2024-09-12T12:18:28.974006+0000","last_fullsized":"2024-09-12T12:18:28.974006+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.972822+0000","last_change":"2024-09-12T12:18:28.972822+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.972822+0000","last_undegraded":"2024-09-12T12:18:28.972822+0000","last_fullsized":"2024-09-12T12:18:28.972822+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.974771+0000","last_change":"2024-09-12T12:18:28.974771+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.974771+0000","last_undegraded":"2024-09-12T12:18:28.974771+0000","last_fullsized":"2024-09-12T12:18:28.974771+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976180+0000","last_change":"2024-09-12T12:18:28.976180+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976180+0000","last_undegraded":"2024-09-12T12:18:28.976180+0000","last_fullsized":"2024-09-12T12:18:28.976180+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976734+0000","last_change":"2024-09-12T12:18:28.976734+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976734+0000","last_undegraded":"2024-09-12T12:18:28.976734+0000","last_fullsized":"2024-09-12T12:18:28.976734+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973536+0000","last_change":"2024-09-12T12:18:28.973536+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973536+0000","last_undegraded":"2024-09-12T12:18:28.973536+0000","last_fullsized":"2024-09-12T12:18:28.973536+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976781+0000","last_change":"2024-09-12T12:18:28.976781+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976781+0000","last_undegraded":"2024-09-12T12:18:28.976781+0000","last_fullsized":"2024-09-12T12:18:28.976781+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973267+0000","last_change":"2024-09-12T12:18:28.973267+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973267+0000","last_undegraded":"2024-09-12T12:18:28.973267+0000","last_fullsized":"2024-09-12T12:18:28.973267+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.978260+0000","last_change":"2024-09-12T12:18:28.978260+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.978260+0000","last_undegraded":"2024-09-12T12:18:28.978260+0000","last_fullsized":"2024-09-12T12:18:28.978260+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973905+0000","last_change":"2024-09-12T12:18:28.973905+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973905+0000","last_undegraded":"2024-09-12T12:18:28.973905+0000","last_fullsized":"2024-09-12T12:18:28.973905+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.973301+0000","last_change":"2024-09-12T12:18:28.973301+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.973301+0000","last_undegraded":"2024-09-12T12:18:28.973301+0000","last_fullsized":"2024-09-12T12:18:28.973301+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.979093+0000","last_change":"2024-09-12T12:18:28.979093+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.979093+0000","last_undegraded":"2024-09-12T12:18:28.979093+0000","last_fullsized":"2024-09-12T12:18:28.979093+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976314+0000","last_change":"2024-09-12T12:18:28.976314+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976314+0000","last_undegraded":"2024-09-12T12:18:28.976314+0000","last_fullsized":"2024-09-12T12:18:28.976314+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.972999+0000","last_change":"2024-09-12T12:18:28.972999+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.972999+0000","last_undegraded":"2024-09-12T12:18:28.972999+0000","last_fullsized":"2024-09-12T12:18:28.972999+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976031+0000","last_change":"2024-09-12T12:18:28.976031+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976031+0000","last_undegraded":"2024-09-12T12:18:28.976031+0000","last_fullsized":"2024-09-12T12:18:28.976031+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:18:29.968170+0000","last_change":"2024-09-12T12:18:29.968170+0000","last_active":"2024-09-12T12:18:29.968170+0000","last_peered":"2024-09-12T12:18:29.968170+0000","last_clean":"2024-09-12T12:18:29.968170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:29.968170+0000","last_undegraded":"2024-09-12T12:18:29.968170+0000","last_fullsized":"2024-09-12T12:18:29.968170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2024-09-12T12:18:28.976016+0000","last_change":"2024-09-12T12:18:28.976016+0000","last_active":"2024-09-12T12:18:28.964970+0000","last_peered":"2024-09-12T12:18:28.964970+0000","last_clean":"2024-09-12T12:18:28.964970+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:18:28.976016+0000","last_undegraded":"2024-09-12T12:18:28.976016+0000","last_fullsized":"2024-09-12T12:18:28.976016+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":333,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-12T12:18:28.972306+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:18:28.972306+0000","last_peered":"2024-09-12T12:18:28.972306+0000","last_clean":"2024-09-12T12:18:28.972306+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:18:28.972306+0000","last_undegraded":"2024-09-12T12:18:28.972306+0000","last_fullsized":"2024-09-12T12:18:28.972306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37248,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334592,"statfs":{"total":96636764160,"available":96598622208,"internally_reserved":0,"allocated":1945600,"data_stored":1221703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36696,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335144,"statfs":{"total":96636764160,"available":96599187456,"internally_reserved":0,"allocated":1363968,"data_stored":637064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36672,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335168,"statfs":{"total":96636764160,"available":96599212032,"internally_reserved":0,"allocated":1351680,"data_stored":631335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1363968,"data_stored":637064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40860,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330980,"statfs":{"total":96636764160,"available":96594923520,"internally_reserved":0,"allocated":1376256,"data_stored":643273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1376256,"data_stored":643273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1376256,"data_stored":643273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41408,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330432,"statfs":{"total":96636764160,"available":96594362368,"internally_reserved":0,"allocated":1945600,"data_stored":1221703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:18:35.470 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:18:35.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94f0e00640 1 Processor -- start 2024-09-12T12:18:35.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94f0e00640 1 -- start start 2024-09-12T12:18:35.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94f0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec15c220 0x7f94ec0d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94f0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f94ec0b4200 0x7f94ec0b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94f0e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ec0d1580 con 0x7f94ec0732c0 2024-09-12T12:18:35.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94f0e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f94ec0b4b80 con 0x7f94ec0b4200 2024-09-12T12:18:35.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94f0e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec0d1860 con 0x7f94ec15c220 2024-09-12T12:18:35.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94ea800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f94ec0732c0 0x7f94ec0736f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42388/0 (socket says 172.21.15.144:42388) 2024-09-12T12:18:35.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94ea800640 1 -- 172.21.15.144:0/3976808965 learned_addr learned my addr 172.21.15.144:0/3976808965 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:35.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.649+0000 7f94e9400640 1 --2- 172.21.15.144:0/3976808965 >> v2:172.21.15.144:3300/0 conn(0x7f94ec0b4200 0x7f94ec0b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e9e00640 1 --2- 172.21.15.144:0/3976808965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec15c220 0x7f94ec0d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e9400640 1 -- 172.21.15.144:0/3976808965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec15c220 msgr2=0x7f94ec0d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:35.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e9400640 1 --2- 172.21.15.144:0/3976808965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec15c220 0x7f94ec0d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e9400640 1 -- 172.21.15.144:0/3976808965 >> v1:172.21.15.144:6789/0 conn(0x7f94ec0732c0 legacy=0x7f94ec0736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e9400640 1 -- 172.21.15.144:0/3976808965 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec0d1b40 con 0x7f94ec0b4200 2024-09-12T12:18:35.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e8a00640 1 -- 172.21.15.144:0/3976808965 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161619143 0 0) 0x7f94ec0d1580 con 0x7f94ec0732c0 2024-09-12T12:18:35.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e9400640 1 --2- 172.21.15.144:0/3976808965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0b4200 0x7f94ec0b4640 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f94d80097c0 tx=0x7f94d801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ec9206c51dde4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:35.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e8a00640 1 -- 172.21.15.144:0/3976808965 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d80a7070 con 0x7f94ec0b4200 2024-09-12T12:18:35.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e8a00640 1 -- 172.21.15.144:0/3976808965 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d80b0070 con 0x7f94ec0b4200 2024-09-12T12:18:35.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.653+0000 7f94e8a00640 1 -- 172.21.15.144:0/3976808965 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d80ab890 con 0x7f94ec0b4200 2024-09-12T12:18:35.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 -- 172.21.15.144:0/3976808965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0b4200 msgr2=0x7f94ec0b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 --2- 172.21.15.144:0/3976808965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0b4200 0x7f94ec0b4640 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f94d80097c0 tx=0x7f94d801c470 comp rx=0 tx=0).stop 2024-09-12T12:18:35.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 -- 172.21.15.144:0/3976808965 shutdown_connections 2024-09-12T12:18:35.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 --2- 172.21.15.144:0/3976808965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0b4200 0x7f94ec0b4640 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 --2- 172.21.15.144:0/3976808965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec15c220 0x7f94ec0d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 -- 172.21.15.144:0/3976808965 >> 172.21.15.144:0/3976808965 conn(0x7f94ec06f400 msgr2=0x7f94ec06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:35.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 -- 172.21.15.144:0/3976808965 shutdown_connections 2024-09-12T12:18:35.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 -- 172.21.15.144:0/3976808965 wait complete. 2024-09-12T12:18:35.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 Processor -- start 2024-09-12T12:18:35.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 -- start start 2024-09-12T12:18:35.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0732c0 0x7f94ec1f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec0b4200 0x7f94ec1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94ec15c220 0x7f94ec0aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec0d12d0 con 0x7f94ec0732c0 2024-09-12T12:18:35.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec0d1150 con 0x7f94ec15c220 2024-09-12T12:18:35.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94f0e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec070bf0 con 0x7f94ec0b4200 2024-09-12T12:18:35.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0732c0 0x7f94ec1f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0732c0 0x7f94ec1f7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40566/0 (socket says 172.21.15.144:40566) 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94e9e00640 1 -- 172.21.15.144:0/4236645471 learned_addr learned my addr 172.21.15.144:0/4236645471 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94e9400640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec0b4200 0x7f94ec1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94ea800640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94ec15c220 0x7f94ec0aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94e9e00640 1 -- 172.21.15.144:0/4236645471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec0b4200 msgr2=0x7f94ec1545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94e9e00640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec0b4200 0x7f94ec1545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94e9e00640 1 -- 172.21.15.144:0/4236645471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94ec15c220 msgr2=0x7f94ec0aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94e9e00640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94ec15c220 0x7f94ec0aefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.657+0000 7f94e9e00640 1 -- 172.21.15.144:0/4236645471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec158080 con 0x7f94ec0732c0 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94e9e00640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0732c0 0x7f94ec1f7530 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009d10 tx=0x7f94dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94e2000640 1 -- 172.21.15.144:0/4236645471 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc018020 con 0x7f94ec0732c0 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94e2000640 1 -- 172.21.15.144:0/4236645471 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94dc014480 con 0x7f94ec0732c0 2024-09-12T12:18:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec06ce50 con 0x7f94ec0732c0 2024-09-12T12:18:35.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94e2000640 1 -- 172.21.15.144:0/4236645471 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc014830 con 0x7f94ec0732c0 2024-09-12T12:18:35.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec06d410 con 0x7f94ec0732c0 2024-09-12T12:18:35.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ec0b4640 con 0x7f94ec0732c0 2024-09-12T12:18:35.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94e2000640 1 -- 172.21.15.144:0/4236645471 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f94dc01b020 con 0x7f94ec0732c0 2024-09-12T12:18:35.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94e2000640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f94cc0678c0 0x7f94cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:35.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94e2000640 1 -- 172.21.15.144:0/4236645471 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f94dc0868f0 con 0x7f94ec0732c0 2024-09-12T12:18:35.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.661+0000 7f94e9400640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f94cc0678c0 0x7f94cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:35.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.665+0000 7f94e9400640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f94cc0678c0 0x7f94cc069d80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f94d80af000 tx=0x7f94d80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:35.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.665+0000 7f94e2000640 1 -- 172.21.15.144:0/4236645471 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f94dc022070 con 0x7f94ec0732c0 2024-09-12T12:18:35.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.821+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94ec071bf0 con 0x7f94cc0678c0 2024-09-12T12:18:35.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.829+0000 7f94e2000640 1 -- 172.21.15.144:0/4236645471 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252486 (secure 0 0 0) 0x7f94ec071bf0 con 0x7f94cc0678c0 2024-09-12T12:18:35.830 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:35.831 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:18:35.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f94cc0678c0 msgr2=0x7f94cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f94cc0678c0 0x7f94cc069d80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f94d80af000 tx=0x7f94d80a7000 comp rx=0 tx=0).stop 2024-09-12T12:18:35.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0732c0 msgr2=0x7f94ec1f7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:35.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0732c0 0x7f94ec1f7530 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009d10 tx=0x7f94dc00c490 comp rx=0 tx=0).stop 2024-09-12T12:18:35.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 shutdown_connections 2024-09-12T12:18:35.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f94cc0678c0 0x7f94cc069d80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94ec15c220 0x7f94ec0aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94ec0b4200 0x7f94ec1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 --2- 172.21.15.144:0/4236645471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94ec0732c0 0x7f94ec1f7530 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:35.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 >> 172.21.15.144:0/4236645471 conn(0x7f94ec06f400 msgr2=0x7f94ec06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:35.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 shutdown_connections 2024-09-12T12:18:35.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:35.833+0000 7f94f0e00640 1 -- 172.21.15.144:0/4236645471 wait complete. 2024-09-12T12:18:35.851 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-12T12:18:35.449602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307512,"kb_used_data":12240,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754667208,"statfs":{"total":773094113280,"available":772779220992,"internally_reserved":0,"allocated":12533760,"data_stored":6482564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":302173745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001200"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991370+0000","last_change":"2024-09-12T12:18:31.022353+0000","last_active":"2024-09-12T12:18:32.991370+0000","last_peered":"2024-09-12T12:18:32.991370+0000","last_clean":"2024-09-12T12:18:32.991370+0000","last_became_active":"2024-09-12T12:18:31.022058+0000","last_became_peered":"2024-09-12T12:18:31.022058+0000","last_unstale":"2024-09-12T12:18:32.991370+0000","last_undegraded":"2024-09-12T12:18:32.991370+0000","last_fullsized":"2024-09-12T12:18:32.991370+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:01.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983873+0000","last_change":"2024-09-12T12:18:30.999317+0000","last_active":"2024-09-12T12:18:31.983873+0000","last_peered":"2024-09-12T12:18:31.983873+0000","last_clean":"2024-09-12T12:18:31.983873+0000","last_became_active":"2024-09-12T12:18:30.999035+0000","last_became_peered":"2024-09-12T12:18:30.999035+0000","last_unstale":"2024-09-12T12:18:31.983873+0000","last_undegraded":"2024-09-12T12:18:31.983873+0000","last_fullsized":"2024-09-12T12:18:31.983873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:18.792493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991052+0000","last_change":"2024-09-12T12:18:31.019928+0000","last_active":"2024-09-12T12:18:32.991052+0000","last_peered":"2024-09-12T12:18:32.991052+0000","last_clean":"2024-09-12T12:18:32.991052+0000","last_became_active":"2024-09-12T12:18:31.019253+0000","last_became_peered":"2024-09-12T12:18:31.019253+0000","last_unstale":"2024-09-12T12:18:32.991052+0000","last_undegraded":"2024-09-12T12:18:32.991052+0000","last_fullsized":"2024-09-12T12:18:32.991052+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:43.702735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177829+0000","last_change":"2024-09-12T12:18:31.000255+0000","last_active":"2024-09-12T12:18:32.177829+0000","last_peered":"2024-09-12T12:18:32.177829+0000","last_clean":"2024-09-12T12:18:32.177829+0000","last_became_active":"2024-09-12T12:18:31.000007+0000","last_became_peered":"2024-09-12T12:18:31.000007+0000","last_unstale":"2024-09-12T12:18:32.177829+0000","last_undegraded":"2024-09-12T12:18:32.177829+0000","last_fullsized":"2024-09-12T12:18:32.177829+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:12.244392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156843+0000","last_change":"2024-09-12T12:18:31.005063+0000","last_active":"2024-09-12T12:18:34.156843+0000","last_peered":"2024-09-12T12:18:34.156843+0000","last_clean":"2024-09-12T12:18:34.156843+0000","last_became_active":"2024-09-12T12:18:31.004659+0000","last_became_peered":"2024-09-12T12:18:31.004659+0000","last_unstale":"2024-09-12T12:18:34.156843+0000","last_undegraded":"2024-09-12T12:18:34.156843+0000","last_fullsized":"2024-09-12T12:18:34.156843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982999+0000","last_change":"2024-09-12T12:18:31.018372+0000","last_active":"2024-09-12T12:18:31.982999+0000","last_peered":"2024-09-12T12:18:31.982999+0000","last_clean":"2024-09-12T12:18:31.982999+0000","last_became_active":"2024-09-12T12:18:31.018047+0000","last_became_peered":"2024-09-12T12:18:31.018047+0000","last_unstale":"2024-09-12T12:18:31.982999+0000","last_undegraded":"2024-09-12T12:18:31.982999+0000","last_fullsized":"2024-09-12T12:18:31.982999+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983133+0000","last_change":"2024-09-12T12:18:31.021695+0000","last_active":"2024-09-12T12:18:31.983133+0000","last_peered":"2024-09-12T12:18:31.983133+0000","last_clean":"2024-09-12T12:18:31.983133+0000","last_became_active":"2024-09-12T12:18:31.021390+0000","last_became_peered":"2024-09-12T12:18:31.021390+0000","last_unstale":"2024-09-12T12:18:31.983133+0000","last_undegraded":"2024-09-12T12:18:31.983133+0000","last_fullsized":"2024-09-12T12:18:31.983133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984817+0000","last_change":"2024-09-12T12:18:31.022124+0000","last_active":"2024-09-12T12:18:31.984817+0000","last_peered":"2024-09-12T12:18:31.984817+0000","last_clean":"2024-09-12T12:18:31.984817+0000","last_became_active":"2024-09-12T12:18:31.021796+0000","last_became_peered":"2024-09-12T12:18:31.021796+0000","last_unstale":"2024-09-12T12:18:31.984817+0000","last_undegraded":"2024-09-12T12:18:31.984817+0000","last_fullsized":"2024-09-12T12:18:31.984817+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:07.529758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983686+0000","last_change":"2024-09-12T12:18:31.003510+0000","last_active":"2024-09-12T12:18:31.983686+0000","last_peered":"2024-09-12T12:18:31.983686+0000","last_clean":"2024-09-12T12:18:31.983686+0000","last_became_active":"2024-09-12T12:18:31.001374+0000","last_became_peered":"2024-09-12T12:18:31.001374+0000","last_unstale":"2024-09-12T12:18:31.983686+0000","last_undegraded":"2024-09-12T12:18:31.983686+0000","last_fullsized":"2024-09-12T12:18:31.983686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:04.505957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156897+0000","last_change":"2024-09-12T12:18:31.017067+0000","last_active":"2024-09-12T12:18:34.156897+0000","last_peered":"2024-09-12T12:18:34.156897+0000","last_clean":"2024-09-12T12:18:34.156897+0000","last_became_active":"2024-09-12T12:18:31.016562+0000","last_became_peered":"2024-09-12T12:18:31.016562+0000","last_unstale":"2024-09-12T12:18:34.156897+0000","last_undegraded":"2024-09-12T12:18:34.156897+0000","last_fullsized":"2024-09-12T12:18:34.156897+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321017+0000","last_change":"2024-09-12T12:18:30.996847+0000","last_active":"2024-09-12T12:18:32.321017+0000","last_peered":"2024-09-12T12:18:32.321017+0000","last_clean":"2024-09-12T12:18:32.321017+0000","last_became_active":"2024-09-12T12:18:30.995784+0000","last_became_peered":"2024-09-12T12:18:30.995784+0000","last_unstale":"2024-09-12T12:18:32.321017+0000","last_undegraded":"2024-09-12T12:18:32.321017+0000","last_fullsized":"2024-09-12T12:18:32.321017+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983341+0000","last_change":"2024-09-12T12:18:31.009670+0000","last_active":"2024-09-12T12:18:31.983341+0000","last_peered":"2024-09-12T12:18:31.983341+0000","last_clean":"2024-09-12T12:18:31.983341+0000","last_became_active":"2024-09-12T12:18:31.007942+0000","last_became_peered":"2024-09-12T12:18:31.007942+0000","last_unstale":"2024-09-12T12:18:31.983341+0000","last_undegraded":"2024-09-12T12:18:31.983341+0000","last_fullsized":"2024-09-12T12:18:31.983341+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177773+0000","last_change":"2024-09-12T12:18:30.997142+0000","last_active":"2024-09-12T12:18:32.177773+0000","last_peered":"2024-09-12T12:18:32.177773+0000","last_clean":"2024-09-12T12:18:32.177773+0000","last_became_active":"2024-09-12T12:18:30.996830+0000","last_became_peered":"2024-09-12T12:18:30.996830+0000","last_unstale":"2024-09-12T12:18:32.177773+0000","last_undegraded":"2024-09-12T12:18:32.177773+0000","last_fullsized":"2024-09-12T12:18:32.177773+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:59.048601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155675+0000","last_change":"2024-09-12T12:18:31.004760+0000","last_active":"2024-09-12T12:18:34.155675+0000","last_peered":"2024-09-12T12:18:34.155675+0000","last_clean":"2024-09-12T12:18:34.155675+0000","last_became_active":"2024-09-12T12:18:31.004480+0000","last_became_peered":"2024-09-12T12:18:31.004480+0000","last_unstale":"2024-09-12T12:18:34.155675+0000","last_undegraded":"2024-09-12T12:18:34.155675+0000","last_fullsized":"2024-09-12T12:18:34.155675+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:52.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155425+0000","last_change":"2024-09-12T12:18:31.002415+0000","last_active":"2024-09-12T12:18:34.155425+0000","last_peered":"2024-09-12T12:18:34.155425+0000","last_clean":"2024-09-12T12:18:34.155425+0000","last_became_active":"2024-09-12T12:18:31.001992+0000","last_became_peered":"2024-09-12T12:18:31.001992+0000","last_unstale":"2024-09-12T12:18:34.155425+0000","last_undegraded":"2024-09-12T12:18:34.155425+0000","last_fullsized":"2024-09-12T12:18:34.155425+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:04.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155428+0000","last_change":"2024-09-12T12:18:31.006561+0000","last_active":"2024-09-12T12:18:34.155428+0000","last_peered":"2024-09-12T12:18:34.155428+0000","last_clean":"2024-09-12T12:18:34.155428+0000","last_became_active":"2024-09-12T12:18:31.006288+0000","last_became_peered":"2024-09-12T12:18:31.006288+0000","last_unstale":"2024-09-12T12:18:34.155428+0000","last_undegraded":"2024-09-12T12:18:34.155428+0000","last_fullsized":"2024-09-12T12:18:34.155428+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:18.792493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991485+0000","last_change":"2024-09-12T12:18:31.021654+0000","last_active":"2024-09-12T12:18:32.991485+0000","last_peered":"2024-09-12T12:18:32.991485+0000","last_clean":"2024-09-12T12:18:32.991485+0000","last_became_active":"2024-09-12T12:18:31.021353+0000","last_became_peered":"2024-09-12T12:18:31.021353+0000","last_unstale":"2024-09-12T12:18:32.991485+0000","last_undegraded":"2024-09-12T12:18:32.991485+0000","last_fullsized":"2024-09-12T12:18:32.991485+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:36.388916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983911+0000","last_change":"2024-09-12T12:18:31.018503+0000","last_active":"2024-09-12T12:18:31.983911+0000","last_peered":"2024-09-12T12:18:31.983911+0000","last_clean":"2024-09-12T12:18:31.983911+0000","last_became_active":"2024-09-12T12:18:31.018238+0000","last_became_peered":"2024-09-12T12:18:31.018238+0000","last_unstale":"2024-09-12T12:18:31.983911+0000","last_undegraded":"2024-09-12T12:18:31.983911+0000","last_fullsized":"2024-09-12T12:18:31.983911+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:52.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991108+0000","last_change":"2024-09-12T12:18:31.019533+0000","last_active":"2024-09-12T12:18:32.991108+0000","last_peered":"2024-09-12T12:18:32.991108+0000","last_clean":"2024-09-12T12:18:32.991108+0000","last_became_active":"2024-09-12T12:18:31.018656+0000","last_became_peered":"2024-09-12T12:18:31.018656+0000","last_unstale":"2024-09-12T12:18:32.991108+0000","last_undegraded":"2024-09-12T12:18:32.991108+0000","last_fullsized":"2024-09-12T12:18:32.991108+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:32.527059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983553+0000","last_change":"2024-09-12T12:18:31.003481+0000","last_active":"2024-09-12T12:18:31.983553+0000","last_peered":"2024-09-12T12:18:31.983553+0000","last_clean":"2024-09-12T12:18:31.983553+0000","last_became_active":"2024-09-12T12:18:31.003237+0000","last_became_peered":"2024-09-12T12:18:31.003237+0000","last_unstale":"2024-09-12T12:18:31.983553+0000","last_undegraded":"2024-09-12T12:18:31.983553+0000","last_fullsized":"2024-09-12T12:18:31.983553+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985262+0000","last_change":"2024-09-12T12:18:30.993956+0000","last_active":"2024-09-12T12:18:31.985262+0000","last_peered":"2024-09-12T12:18:31.985262+0000","last_clean":"2024-09-12T12:18:31.985262+0000","last_became_active":"2024-09-12T12:18:30.993616+0000","last_became_peered":"2024-09-12T12:18:30.993616+0000","last_unstale":"2024-09-12T12:18:31.985262+0000","last_undegraded":"2024-09-12T12:18:31.985262+0000","last_fullsized":"2024-09-12T12:18:31.985262+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:58.086086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156664+0000","last_change":"2024-09-12T12:18:31.004298+0000","last_active":"2024-09-12T12:18:34.156664+0000","last_peered":"2024-09-12T12:18:34.156664+0000","last_clean":"2024-09-12T12:18:34.156664+0000","last_became_active":"2024-09-12T12:18:31.004095+0000","last_became_peered":"2024-09-12T12:18:31.004095+0000","last_unstale":"2024-09-12T12:18:34.156664+0000","last_undegraded":"2024-09-12T12:18:34.156664+0000","last_fullsized":"2024-09-12T12:18:34.156664+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:12.661477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991076+0000","last_change":"2024-09-12T12:18:31.013190+0000","last_active":"2024-09-12T12:18:32.991076+0000","last_peered":"2024-09-12T12:18:32.991076+0000","last_clean":"2024-09-12T12:18:32.991076+0000","last_became_active":"2024-09-12T12:18:31.012520+0000","last_became_peered":"2024-09-12T12:18:31.012520+0000","last_unstale":"2024-09-12T12:18:32.991076+0000","last_undegraded":"2024-09-12T12:18:32.991076+0000","last_fullsized":"2024-09-12T12:18:32.991076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:27.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156429+0000","last_change":"2024-09-12T12:18:31.025299+0000","last_active":"2024-09-12T12:18:34.156429+0000","last_peered":"2024-09-12T12:18:34.156429+0000","last_clean":"2024-09-12T12:18:34.156429+0000","last_became_active":"2024-09-12T12:18:31.025002+0000","last_became_peered":"2024-09-12T12:18:31.025002+0000","last_unstale":"2024-09-12T12:18:34.156429+0000","last_undegraded":"2024-09-12T12:18:34.156429+0000","last_fullsized":"2024-09-12T12:18:34.156429+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:58.439510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983365+0000","last_change":"2024-09-12T12:18:30.993055+0000","last_active":"2024-09-12T12:18:31.983365+0000","last_peered":"2024-09-12T12:18:31.983365+0000","last_clean":"2024-09-12T12:18:31.983365+0000","last_became_active":"2024-09-12T12:18:30.992726+0000","last_became_peered":"2024-09-12T12:18:30.992726+0000","last_unstale":"2024-09-12T12:18:31.983365+0000","last_undegraded":"2024-09-12T12:18:31.983365+0000","last_fullsized":"2024-09-12T12:18:31.983365+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983320+0000","last_change":"2024-09-12T12:18:30.991346+0000","last_active":"2024-09-12T12:18:31.983320+0000","last_peered":"2024-09-12T12:18:31.983320+0000","last_clean":"2024-09-12T12:18:31.983320+0000","last_became_active":"2024-09-12T12:18:30.990964+0000","last_became_peered":"2024-09-12T12:18:30.990964+0000","last_unstale":"2024-09-12T12:18:31.983320+0000","last_undegraded":"2024-09-12T12:18:31.983320+0000","last_fullsized":"2024-09-12T12:18:31.983320+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321122+0000","last_change":"2024-09-12T12:18:31.007290+0000","last_active":"2024-09-12T12:18:32.321122+0000","last_peered":"2024-09-12T12:18:32.321122+0000","last_clean":"2024-09-12T12:18:32.321122+0000","last_became_active":"2024-09-12T12:18:31.006757+0000","last_became_peered":"2024-09-12T12:18:31.006757+0000","last_unstale":"2024-09-12T12:18:32.321122+0000","last_undegraded":"2024-09-12T12:18:32.321122+0000","last_fullsized":"2024-09-12T12:18:32.321122+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:04.505957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983715+0000","last_change":"2024-09-12T12:18:30.994217+0000","last_active":"2024-09-12T12:18:31.983715+0000","last_peered":"2024-09-12T12:18:31.983715+0000","last_clean":"2024-09-12T12:18:31.983715+0000","last_became_active":"2024-09-12T12:18:30.994004+0000","last_became_peered":"2024-09-12T12:18:30.994004+0000","last_unstale":"2024-09-12T12:18:31.983715+0000","last_undegraded":"2024-09-12T12:18:31.983715+0000","last_fullsized":"2024-09-12T12:18:31.983715+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:04.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985451+0000","last_change":"2024-09-12T12:18:31.008589+0000","last_active":"2024-09-12T12:18:31.985451+0000","last_peered":"2024-09-12T12:18:31.985451+0000","last_clean":"2024-09-12T12:18:31.985451+0000","last_became_active":"2024-09-12T12:18:31.008317+0000","last_became_peered":"2024-09-12T12:18:31.008317+0000","last_unstale":"2024-09-12T12:18:31.985451+0000","last_undegraded":"2024-09-12T12:18:31.985451+0000","last_fullsized":"2024-09-12T12:18:31.985451+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:33.766056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982838+0000","last_change":"2024-09-12T12:18:30.989833+0000","last_active":"2024-09-12T12:18:31.982838+0000","last_peered":"2024-09-12T12:18:31.982838+0000","last_clean":"2024-09-12T12:18:31.982838+0000","last_became_active":"2024-09-12T12:18:30.989307+0000","last_became_peered":"2024-09-12T12:18:30.989307+0000","last_unstale":"2024-09-12T12:18:31.982838+0000","last_undegraded":"2024-09-12T12:18:31.982838+0000","last_fullsized":"2024-09-12T12:18:31.982838+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:45.214279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982741+0000","last_change":"2024-09-12T12:18:31.014262+0000","last_active":"2024-09-12T12:18:31.982741+0000","last_peered":"2024-09-12T12:18:31.982741+0000","last_clean":"2024-09-12T12:18:31.982741+0000","last_became_active":"2024-09-12T12:18:31.013931+0000","last_became_peered":"2024-09-12T12:18:31.013931+0000","last_unstale":"2024-09-12T12:18:31.982741+0000","last_undegraded":"2024-09-12T12:18:31.982741+0000","last_fullsized":"2024-09-12T12:18:31.982741+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984981+0000","last_change":"2024-09-12T12:18:30.987471+0000","last_active":"2024-09-12T12:18:31.984981+0000","last_peered":"2024-09-12T12:18:31.984981+0000","last_clean":"2024-09-12T12:18:31.984981+0000","last_became_active":"2024-09-12T12:18:30.987146+0000","last_became_peered":"2024-09-12T12:18:30.987146+0000","last_unstale":"2024-09-12T12:18:31.984981+0000","last_undegraded":"2024-09-12T12:18:31.984981+0000","last_fullsized":"2024-09-12T12:18:31.984981+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:52:32.928811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991149+0000","last_change":"2024-09-12T12:18:31.012380+0000","last_active":"2024-09-12T12:18:32.991149+0000","last_peered":"2024-09-12T12:18:32.991149+0000","last_clean":"2024-09-12T12:18:32.991149+0000","last_became_active":"2024-09-12T12:18:31.011284+0000","last_became_peered":"2024-09-12T12:18:31.011284+0000","last_unstale":"2024-09-12T12:18:32.991149+0000","last_undegraded":"2024-09-12T12:18:32.991149+0000","last_fullsized":"2024-09-12T12:18:32.991149+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:50.083315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"113'4","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177969+0000","last_change":"2024-09-12T12:18:29.999114+0000","last_active":"2024-09-12T12:18:32.177969+0000","last_peered":"2024-09-12T12:18:32.177969+0000","last_clean":"2024-09-12T12:18:32.177969+0000","last_became_active":"2024-09-12T12:18:29.998825+0000","last_became_peered":"2024-09-12T12:18:29.998825+0000","last_unstale":"2024-09-12T12:18:32.177969+0000","last_undegraded":"2024-09-12T12:18:32.177969+0000","last_fullsized":"2024-09-12T12:18:32.177969+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:40.296370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984934+0000","last_change":"2024-09-12T12:18:31.025587+0000","last_active":"2024-09-12T12:18:31.984934+0000","last_peered":"2024-09-12T12:18:31.984934+0000","last_clean":"2024-09-12T12:18:31.984934+0000","last_became_active":"2024-09-12T12:18:31.025327+0000","last_became_peered":"2024-09-12T12:18:31.025327+0000","last_unstale":"2024-09-12T12:18:31.984934+0000","last_undegraded":"2024-09-12T12:18:31.984934+0000","last_fullsized":"2024-09-12T12:18:31.984934+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:29.348172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985187+0000","last_change":"2024-09-12T12:18:30.001333+0000","last_active":"2024-09-12T12:18:31.985187+0000","last_peered":"2024-09-12T12:18:31.985187+0000","last_clean":"2024-09-12T12:18:31.985187+0000","last_became_active":"2024-09-12T12:18:30.000855+0000","last_became_peered":"2024-09-12T12:18:30.000855+0000","last_unstale":"2024-09-12T12:18:31.985187+0000","last_undegraded":"2024-09-12T12:18:31.985187+0000","last_fullsized":"2024-09-12T12:18:31.985187+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:26.984813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982980+0000","last_change":"2024-09-12T12:18:31.004310+0000","last_active":"2024-09-12T12:18:31.982980+0000","last_peered":"2024-09-12T12:18:31.982980+0000","last_clean":"2024-09-12T12:18:31.982980+0000","last_became_active":"2024-09-12T12:18:31.003973+0000","last_became_peered":"2024-09-12T12:18:31.003973+0000","last_unstale":"2024-09-12T12:18:31.982980+0000","last_undegraded":"2024-09-12T12:18:31.982980+0000","last_fullsized":"2024-09-12T12:18:31.982980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:12.661477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982972+0000","last_change":"2024-09-12T12:18:29.997014+0000","last_active":"2024-09-12T12:18:31.982972+0000","last_peered":"2024-09-12T12:18:31.982972+0000","last_clean":"2024-09-12T12:18:31.982972+0000","last_became_active":"2024-09-12T12:18:29.996677+0000","last_became_peered":"2024-09-12T12:18:29.996677+0000","last_unstale":"2024-09-12T12:18:31.982972+0000","last_undegraded":"2024-09-12T12:18:31.982972+0000","last_fullsized":"2024-09-12T12:18:31.982972+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:48.178163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321039+0000","last_change":"2024-09-12T12:18:30.993859+0000","last_active":"2024-09-12T12:18:32.321039+0000","last_peered":"2024-09-12T12:18:32.321039+0000","last_clean":"2024-09-12T12:18:32.321039+0000","last_became_active":"2024-09-12T12:18:30.993544+0000","last_became_peered":"2024-09-12T12:18:30.993544+0000","last_unstale":"2024-09-12T12:18:32.321039+0000","last_undegraded":"2024-09-12T12:18:32.321039+0000","last_fullsized":"2024-09-12T12:18:32.321039+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156863+0000","last_change":"2024-09-12T12:18:29.999312+0000","last_active":"2024-09-12T12:18:34.156863+0000","last_peered":"2024-09-12T12:18:34.156863+0000","last_clean":"2024-09-12T12:18:34.156863+0000","last_became_active":"2024-09-12T12:18:29.998546+0000","last_became_peered":"2024-09-12T12:18:29.998546+0000","last_unstale":"2024-09-12T12:18:34.156863+0000","last_undegraded":"2024-09-12T12:18:34.156863+0000","last_fullsized":"2024-09-12T12:18:34.156863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:12.704492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177915+0000","last_change":"2024-09-12T12:18:31.003545+0000","last_active":"2024-09-12T12:18:32.177915+0000","last_peered":"2024-09-12T12:18:32.177915+0000","last_clean":"2024-09-12T12:18:32.177915+0000","last_became_active":"2024-09-12T12:18:31.003272+0000","last_became_peered":"2024-09-12T12:18:31.003272+0000","last_unstale":"2024-09-12T12:18:32.177915+0000","last_undegraded":"2024-09-12T12:18:32.177915+0000","last_fullsized":"2024-09-12T12:18:32.177915+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:29.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155436+0000","last_change":"2024-09-12T12:18:29.997806+0000","last_active":"2024-09-12T12:18:34.155436+0000","last_peered":"2024-09-12T12:18:34.155436+0000","last_clean":"2024-09-12T12:18:34.155436+0000","last_became_active":"2024-09-12T12:18:29.997477+0000","last_became_peered":"2024-09-12T12:18:29.997477+0000","last_unstale":"2024-09-12T12:18:34.155436+0000","last_undegraded":"2024-09-12T12:18:34.155436+0000","last_fullsized":"2024-09-12T12:18:34.155436+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:11.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991359+0000","last_change":"2024-09-12T12:18:31.019734+0000","last_active":"2024-09-12T12:18:32.991359+0000","last_peered":"2024-09-12T12:18:32.991359+0000","last_clean":"2024-09-12T12:18:32.991359+0000","last_became_active":"2024-09-12T12:18:31.018922+0000","last_became_peered":"2024-09-12T12:18:31.018922+0000","last_unstale":"2024-09-12T12:18:32.991359+0000","last_undegraded":"2024-09-12T12:18:32.991359+0000","last_fullsized":"2024-09-12T12:18:32.991359+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:57.568596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.320691+0000","last_change":"2024-09-12T12:18:29.993845+0000","last_active":"2024-09-12T12:18:32.320691+0000","last_peered":"2024-09-12T12:18:32.320691+0000","last_clean":"2024-09-12T12:18:32.320691+0000","last_became_active":"2024-09-12T12:18:29.993573+0000","last_became_peered":"2024-09-12T12:18:29.993573+0000","last_unstale":"2024-09-12T12:18:32.320691+0000","last_undegraded":"2024-09-12T12:18:32.320691+0000","last_fullsized":"2024-09-12T12:18:32.320691+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:06.037389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984009+0000","last_change":"2024-09-12T12:18:30.998680+0000","last_active":"2024-09-12T12:18:31.984009+0000","last_peered":"2024-09-12T12:18:31.984009+0000","last_clean":"2024-09-12T12:18:31.984009+0000","last_became_active":"2024-09-12T12:18:30.998310+0000","last_became_peered":"2024-09-12T12:18:30.998310+0000","last_unstale":"2024-09-12T12:18:31.984009+0000","last_undegraded":"2024-09-12T12:18:31.984009+0000","last_fullsized":"2024-09-12T12:18:31.984009+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:28.015565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982671+0000","last_change":"2024-09-12T12:18:29.991649+0000","last_active":"2024-09-12T12:18:31.982671+0000","last_peered":"2024-09-12T12:18:31.982671+0000","last_clean":"2024-09-12T12:18:31.982671+0000","last_became_active":"2024-09-12T12:18:29.991371+0000","last_became_peered":"2024-09-12T12:18:29.991371+0000","last_unstale":"2024-09-12T12:18:31.982671+0000","last_undegraded":"2024-09-12T12:18:31.982671+0000","last_fullsized":"2024-09-12T12:18:31.982671+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:37.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.178024+0000","last_change":"2024-09-12T12:18:31.026155+0000","last_active":"2024-09-12T12:18:32.178024+0000","last_peered":"2024-09-12T12:18:32.178024+0000","last_clean":"2024-09-12T12:18:32.178024+0000","last_became_active":"2024-09-12T12:18:31.025872+0000","last_became_peered":"2024-09-12T12:18:31.025872+0000","last_unstale":"2024-09-12T12:18:32.178024+0000","last_undegraded":"2024-09-12T12:18:32.178024+0000","last_fullsized":"2024-09-12T12:18:32.178024+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:10.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177889+0000","last_change":"2024-09-12T12:18:29.991538+0000","last_active":"2024-09-12T12:18:32.177889+0000","last_peered":"2024-09-12T12:18:32.177889+0000","last_clean":"2024-09-12T12:18:32.177889+0000","last_became_active":"2024-09-12T12:18:29.991222+0000","last_became_peered":"2024-09-12T12:18:29.991222+0000","last_unstale":"2024-09-12T12:18:32.177889+0000","last_undegraded":"2024-09-12T12:18:32.177889+0000","last_fullsized":"2024-09-12T12:18:32.177889+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:54.006487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.990956+0000","last_change":"2024-09-12T12:18:31.012847+0000","last_active":"2024-09-12T12:18:32.990956+0000","last_peered":"2024-09-12T12:18:32.990956+0000","last_clean":"2024-09-12T12:18:32.990956+0000","last_became_active":"2024-09-12T12:18:31.012481+0000","last_became_peered":"2024-09-12T12:18:31.012481+0000","last_unstale":"2024-09-12T12:18:32.990956+0000","last_undegraded":"2024-09-12T12:18:32.990956+0000","last_fullsized":"2024-09-12T12:18:32.990956+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:20.096960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983388+0000","last_change":"2024-09-12T12:18:29.995711+0000","last_active":"2024-09-12T12:18:31.983388+0000","last_peered":"2024-09-12T12:18:31.983388+0000","last_clean":"2024-09-12T12:18:31.983388+0000","last_became_active":"2024-09-12T12:18:29.995371+0000","last_became_peered":"2024-09-12T12:18:29.995371+0000","last_unstale":"2024-09-12T12:18:31.983388+0000","last_undegraded":"2024-09-12T12:18:31.983388+0000","last_fullsized":"2024-09-12T12:18:31.983388+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:52.214565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156550+0000","last_change":"2024-09-12T12:18:31.019166+0000","last_active":"2024-09-12T12:18:34.156550+0000","last_peered":"2024-09-12T12:18:34.156550+0000","last_clean":"2024-09-12T12:18:34.156550+0000","last_became_active":"2024-09-12T12:18:31.018850+0000","last_became_peered":"2024-09-12T12:18:31.018850+0000","last_unstale":"2024-09-12T12:18:34.156550+0000","last_undegraded":"2024-09-12T12:18:34.156550+0000","last_fullsized":"2024-09-12T12:18:34.156550+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:45.214279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991228+0000","last_change":"2024-09-12T12:18:29.990292+0000","last_active":"2024-09-12T12:18:32.991228+0000","last_peered":"2024-09-12T12:18:32.991228+0000","last_clean":"2024-09-12T12:18:32.991228+0000","last_became_active":"2024-09-12T12:18:29.989785+0000","last_became_peered":"2024-09-12T12:18:29.989785+0000","last_unstale":"2024-09-12T12:18:32.991228+0000","last_undegraded":"2024-09-12T12:18:32.991228+0000","last_fullsized":"2024-09-12T12:18:32.991228+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:14.305898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984932+0000","last_change":"2024-09-12T12:18:31.021909+0000","last_active":"2024-09-12T12:18:31.984932+0000","last_peered":"2024-09-12T12:18:31.984932+0000","last_clean":"2024-09-12T12:18:31.984932+0000","last_became_active":"2024-09-12T12:18:31.021602+0000","last_became_peered":"2024-09-12T12:18:31.021602+0000","last_unstale":"2024-09-12T12:18:31.984932+0000","last_undegraded":"2024-09-12T12:18:31.984932+0000","last_fullsized":"2024-09-12T12:18:31.984932+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:45.938897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"113'3","reported_seq":17,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155382+0000","last_change":"2024-09-12T12:18:29.998684+0000","last_active":"2024-09-12T12:18:34.155382+0000","last_peered":"2024-09-12T12:18:34.155382+0000","last_clean":"2024-09-12T12:18:34.155382+0000","last_became_active":"2024-09-12T12:18:29.998433+0000","last_became_peered":"2024-09-12T12:18:29.998433+0000","last_unstale":"2024-09-12T12:18:34.155382+0000","last_undegraded":"2024-09-12T12:18:34.155382+0000","last_fullsized":"2024-09-12T12:18:34.155382+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:00.362980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156949+0000","last_change":"2024-09-12T12:18:31.003572+0000","last_active":"2024-09-12T12:18:34.156949+0000","last_peered":"2024-09-12T12:18:34.156949+0000","last_clean":"2024-09-12T12:18:34.156949+0000","last_became_active":"2024-09-12T12:18:31.003183+0000","last_became_peered":"2024-09-12T12:18:31.003183+0000","last_unstale":"2024-09-12T12:18:34.156949+0000","last_undegraded":"2024-09-12T12:18:34.156949+0000","last_fullsized":"2024-09-12T12:18:34.156949+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"113'6","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983670+0000","last_change":"2024-09-12T12:18:29.991827+0000","last_active":"2024-09-12T12:18:31.983670+0000","last_peered":"2024-09-12T12:18:31.983670+0000","last_clean":"2024-09-12T12:18:31.983670+0000","last_became_active":"2024-09-12T12:18:29.991527+0000","last_became_peered":"2024-09-12T12:18:29.991527+0000","last_unstale":"2024-09-12T12:18:31.983670+0000","last_undegraded":"2024-09-12T12:18:31.983670+0000","last_fullsized":"2024-09-12T12:18:31.983670+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:52.214565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321084+0000","last_change":"2024-09-12T12:18:31.017369+0000","last_active":"2024-09-12T12:18:32.321084+0000","last_peered":"2024-09-12T12:18:32.321084+0000","last_clean":"2024-09-12T12:18:32.321084+0000","last_became_active":"2024-09-12T12:18:31.017182+0000","last_became_peered":"2024-09-12T12:18:31.017182+0000","last_unstale":"2024-09-12T12:18:32.321084+0000","last_undegraded":"2024-09-12T12:18:32.321084+0000","last_fullsized":"2024-09-12T12:18:32.321084+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156904+0000","last_change":"2024-09-12T12:18:30.001028+0000","last_active":"2024-09-12T12:18:34.156904+0000","last_peered":"2024-09-12T12:18:34.156904+0000","last_clean":"2024-09-12T12:18:34.156904+0000","last_became_active":"2024-09-12T12:18:30.000737+0000","last_became_peered":"2024-09-12T12:18:30.000737+0000","last_unstale":"2024-09-12T12:18:34.156904+0000","last_undegraded":"2024-09-12T12:18:34.156904+0000","last_fullsized":"2024-09-12T12:18:34.156904+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:52.214565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983623+0000","last_change":"2024-09-12T12:18:31.000693+0000","last_active":"2024-09-12T12:18:31.983623+0000","last_peered":"2024-09-12T12:18:31.983623+0000","last_clean":"2024-09-12T12:18:31.983623+0000","last_became_active":"2024-09-12T12:18:31.000423+0000","last_became_peered":"2024-09-12T12:18:31.000423+0000","last_unstale":"2024-09-12T12:18:31.983623+0000","last_undegraded":"2024-09-12T12:18:31.983623+0000","last_fullsized":"2024-09-12T12:18:31.983623+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:30.522076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177687+0000","last_change":"2024-09-12T12:18:29.990655+0000","last_active":"2024-09-12T12:18:32.177687+0000","last_peered":"2024-09-12T12:18:32.177687+0000","last_clean":"2024-09-12T12:18:32.177687+0000","last_became_active":"2024-09-12T12:18:29.990282+0000","last_became_peered":"2024-09-12T12:18:29.990282+0000","last_unstale":"2024-09-12T12:18:32.177687+0000","last_undegraded":"2024-09-12T12:18:32.177687+0000","last_fullsized":"2024-09-12T12:18:32.177687+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:07.785310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985100+0000","last_change":"2024-09-12T12:18:30.993660+0000","last_active":"2024-09-12T12:18:31.985100+0000","last_peered":"2024-09-12T12:18:31.985100+0000","last_clean":"2024-09-12T12:18:31.985100+0000","last_became_active":"2024-09-12T12:18:30.993345+0000","last_became_peered":"2024-09-12T12:18:30.993345+0000","last_unstale":"2024-09-12T12:18:31.985100+0000","last_undegraded":"2024-09-12T12:18:31.985100+0000","last_fullsized":"2024-09-12T12:18:31.985100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:35.592852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984837+0000","last_change":"2024-09-12T12:18:29.989110+0000","last_active":"2024-09-12T12:18:31.984837+0000","last_peered":"2024-09-12T12:18:31.984837+0000","last_clean":"2024-09-12T12:18:31.984837+0000","last_became_active":"2024-09-12T12:18:29.988866+0000","last_became_peered":"2024-09-12T12:18:29.988866+0000","last_unstale":"2024-09-12T12:18:31.984837+0000","last_undegraded":"2024-09-12T12:18:31.984837+0000","last_fullsized":"2024-09-12T12:18:31.984837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:56.981675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991472+0000","last_change":"2024-09-12T12:18:31.017885+0000","last_active":"2024-09-12T12:18:32.991472+0000","last_peered":"2024-09-12T12:18:32.991472+0000","last_clean":"2024-09-12T12:18:32.991472+0000","last_became_active":"2024-09-12T12:18:31.016690+0000","last_became_peered":"2024-09-12T12:18:31.016690+0000","last_unstale":"2024-09-12T12:18:32.991472+0000","last_undegraded":"2024-09-12T12:18:32.991472+0000","last_fullsized":"2024-09-12T12:18:32.991472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:53.793729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982457+0000","last_change":"2024-09-12T12:18:29.986854+0000","last_active":"2024-09-12T12:18:31.982457+0000","last_peered":"2024-09-12T12:18:31.982457+0000","last_clean":"2024-09-12T12:18:31.982457+0000","last_became_active":"2024-09-12T12:18:29.986355+0000","last_became_peered":"2024-09-12T12:18:29.986355+0000","last_unstale":"2024-09-12T12:18:31.982457+0000","last_undegraded":"2024-09-12T12:18:31.982457+0000","last_fullsized":"2024-09-12T12:18:31.982457+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.123774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985172+0000","last_change":"2024-09-12T12:18:31.017522+0000","last_active":"2024-09-12T12:18:31.985172+0000","last_peered":"2024-09-12T12:18:31.985172+0000","last_clean":"2024-09-12T12:18:31.985172+0000","last_became_active":"2024-09-12T12:18:31.016996+0000","last_became_peered":"2024-09-12T12:18:31.016996+0000","last_unstale":"2024-09-12T12:18:31.985172+0000","last_undegraded":"2024-09-12T12:18:31.985172+0000","last_fullsized":"2024-09-12T12:18:31.985172+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:40.058981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983581+0000","last_change":"2024-09-12T12:18:29.995555+0000","last_active":"2024-09-12T12:18:31.983581+0000","last_peered":"2024-09-12T12:18:31.983581+0000","last_clean":"2024-09-12T12:18:31.983581+0000","last_became_active":"2024-09-12T12:18:29.995251+0000","last_became_peered":"2024-09-12T12:18:29.995251+0000","last_unstale":"2024-09-12T12:18:31.983581+0000","last_undegraded":"2024-09-12T12:18:31.983581+0000","last_fullsized":"2024-09-12T12:18:31.983581+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.123774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983159+0000","last_change":"2024-09-12T12:18:31.014477+0000","last_active":"2024-09-12T12:18:31.983159+0000","last_peered":"2024-09-12T12:18:31.983159+0000","last_clean":"2024-09-12T12:18:31.983159+0000","last_became_active":"2024-09-12T12:18:31.014178+0000","last_became_peered":"2024-09-12T12:18:31.014178+0000","last_unstale":"2024-09-12T12:18:31.983159+0000","last_undegraded":"2024-09-12T12:18:31.983159+0000","last_fullsized":"2024-09-12T12:18:31.983159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155561+0000","last_change":"2024-09-12T12:18:29.994438+0000","last_active":"2024-09-12T12:18:34.155561+0000","last_peered":"2024-09-12T12:18:34.155561+0000","last_clean":"2024-09-12T12:18:34.155561+0000","last_became_active":"2024-09-12T12:18:29.994153+0000","last_became_peered":"2024-09-12T12:18:29.994153+0000","last_unstale":"2024-09-12T12:18:34.155561+0000","last_undegraded":"2024-09-12T12:18:34.155561+0000","last_fullsized":"2024-09-12T12:18:34.155561+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:19.667406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156739+0000","last_change":"2024-09-12T12:18:31.007127+0000","last_active":"2024-09-12T12:18:34.156739+0000","last_peered":"2024-09-12T12:18:34.156739+0000","last_clean":"2024-09-12T12:18:34.156739+0000","last_became_active":"2024-09-12T12:18:31.006805+0000","last_became_peered":"2024-09-12T12:18:31.006805+0000","last_unstale":"2024-09-12T12:18:34.156739+0000","last_undegraded":"2024-09-12T12:18:34.156739+0000","last_fullsized":"2024-09-12T12:18:34.156739+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321151+0000","last_change":"2024-09-12T12:18:29.997146+0000","last_active":"2024-09-12T12:18:32.321151+0000","last_peered":"2024-09-12T12:18:32.321151+0000","last_clean":"2024-09-12T12:18:32.321151+0000","last_became_active":"2024-09-12T12:18:29.996862+0000","last_became_peered":"2024-09-12T12:18:29.996862+0000","last_unstale":"2024-09-12T12:18:32.321151+0000","last_undegraded":"2024-09-12T12:18:32.321151+0000","last_fullsized":"2024-09-12T12:18:32.321151+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:12.704492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991107+0000","last_change":"2024-09-12T12:18:31.016129+0000","last_active":"2024-09-12T12:18:32.991107+0000","last_peered":"2024-09-12T12:18:32.991107+0000","last_clean":"2024-09-12T12:18:32.991107+0000","last_became_active":"2024-09-12T12:18:31.015833+0000","last_became_peered":"2024-09-12T12:18:31.015833+0000","last_unstale":"2024-09-12T12:18:32.991107+0000","last_undegraded":"2024-09-12T12:18:32.991107+0000","last_fullsized":"2024-09-12T12:18:32.991107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:54.456454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985337+0000","last_change":"2024-09-12T12:18:29.992741+0000","last_active":"2024-09-12T12:18:31.985337+0000","last_peered":"2024-09-12T12:18:31.985337+0000","last_clean":"2024-09-12T12:18:31.985337+0000","last_became_active":"2024-09-12T12:18:29.992217+0000","last_became_peered":"2024-09-12T12:18:29.992217+0000","last_unstale":"2024-09-12T12:18:31.985337+0000","last_undegraded":"2024-09-12T12:18:31.985337+0000","last_fullsized":"2024-09-12T12:18:31.985337+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.318998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991283+0000","last_change":"2024-09-12T12:18:31.024343+0000","last_active":"2024-09-12T12:18:32.991283+0000","last_peered":"2024-09-12T12:18:32.991283+0000","last_clean":"2024-09-12T12:18:32.991283+0000","last_became_active":"2024-09-12T12:18:31.024077+0000","last_became_peered":"2024-09-12T12:18:31.024077+0000","last_unstale":"2024-09-12T12:18:32.991283+0000","last_undegraded":"2024-09-12T12:18:32.991283+0000","last_fullsized":"2024-09-12T12:18:32.991283+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:52.503849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984766+0000","last_change":"2024-09-12T12:18:30.001790+0000","last_active":"2024-09-12T12:18:31.984766+0000","last_peered":"2024-09-12T12:18:31.984766+0000","last_clean":"2024-09-12T12:18:31.984766+0000","last_became_active":"2024-09-12T12:18:30.000000+0000","last_became_peered":"2024-09-12T12:18:30.000000+0000","last_unstale":"2024-09-12T12:18:31.984766+0000","last_undegraded":"2024-09-12T12:18:31.984766+0000","last_fullsized":"2024-09-12T12:18:31.984766+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:56.869101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177887+0000","last_change":"2024-09-12T12:18:31.008663+0000","last_active":"2024-09-12T12:18:32.177887+0000","last_peered":"2024-09-12T12:18:32.177887+0000","last_clean":"2024-09-12T12:18:32.177887+0000","last_became_active":"2024-09-12T12:18:31.008323+0000","last_became_peered":"2024-09-12T12:18:31.008323+0000","last_unstale":"2024-09-12T12:18:32.177887+0000","last_undegraded":"2024-09-12T12:18:32.177887+0000","last_fullsized":"2024-09-12T12:18:32.177887+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:45.358385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982796+0000","last_change":"2024-09-12T12:18:29.995853+0000","last_active":"2024-09-12T12:18:31.982796+0000","last_peered":"2024-09-12T12:18:31.982796+0000","last_clean":"2024-09-12T12:18:31.982796+0000","last_became_active":"2024-09-12T12:18:29.994997+0000","last_became_peered":"2024-09-12T12:18:29.994997+0000","last_unstale":"2024-09-12T12:18:31.982796+0000","last_undegraded":"2024-09-12T12:18:31.982796+0000","last_fullsized":"2024-09-12T12:18:31.982796+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:37.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985485+0000","last_change":"2024-09-12T12:18:31.023014+0000","last_active":"2024-09-12T12:18:31.985485+0000","last_peered":"2024-09-12T12:18:31.985485+0000","last_clean":"2024-09-12T12:18:31.985485+0000","last_became_active":"2024-09-12T12:18:31.022390+0000","last_became_peered":"2024-09-12T12:18:31.022390+0000","last_unstale":"2024-09-12T12:18:31.985485+0000","last_undegraded":"2024-09-12T12:18:31.985485+0000","last_fullsized":"2024-09-12T12:18:31.985485+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:18.788091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985039+0000","last_change":"2024-09-12T12:18:29.994687+0000","last_active":"2024-09-12T12:18:31.985039+0000","last_peered":"2024-09-12T12:18:31.985039+0000","last_clean":"2024-09-12T12:18:31.985039+0000","last_became_active":"2024-09-12T12:18:29.994184+0000","last_became_peered":"2024-09-12T12:18:29.994184+0000","last_unstale":"2024-09-12T12:18:31.985039+0000","last_undegraded":"2024-09-12T12:18:31.985039+0000","last_fullsized":"2024-09-12T12:18:31.985039+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:25.399072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.990945+0000","last_change":"2024-09-12T12:18:31.012991+0000","last_active":"2024-09-12T12:18:32.990945+0000","last_peered":"2024-09-12T12:18:32.990945+0000","last_clean":"2024-09-12T12:18:32.990945+0000","last_became_active":"2024-09-12T12:18:31.012734+0000","last_became_peered":"2024-09-12T12:18:31.012734+0000","last_unstale":"2024-09-12T12:18:32.990945+0000","last_undegraded":"2024-09-12T12:18:32.990945+0000","last_fullsized":"2024-09-12T12:18:32.990945+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:53.393077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156782+0000","last_change":"2024-09-12T12:18:30.001059+0000","last_active":"2024-09-12T12:18:34.156782+0000","last_peered":"2024-09-12T12:18:34.156782+0000","last_clean":"2024-09-12T12:18:34.156782+0000","last_became_active":"2024-09-12T12:18:30.000719+0000","last_became_peered":"2024-09-12T12:18:30.000719+0000","last_unstale":"2024-09-12T12:18:34.156782+0000","last_undegraded":"2024-09-12T12:18:34.156782+0000","last_fullsized":"2024-09-12T12:18:34.156782+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:59.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982611+0000","last_change":"2024-09-12T12:18:31.007659+0000","last_active":"2024-09-12T12:18:31.982611+0000","last_peered":"2024-09-12T12:18:31.982611+0000","last_clean":"2024-09-12T12:18:31.982611+0000","last_became_active":"2024-09-12T12:18:31.004555+0000","last_became_peered":"2024-09-12T12:18:31.004555+0000","last_unstale":"2024-09-12T12:18:31.982611+0000","last_undegraded":"2024-09-12T12:18:31.982611+0000","last_fullsized":"2024-09-12T12:18:31.982611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:58.439510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"114'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991311+0000","last_change":"2024-09-12T12:18:29.993114+0000","last_active":"2024-09-12T12:18:32.991311+0000","last_peered":"2024-09-12T12:18:32.991311+0000","last_clean":"2024-09-12T12:18:32.991311+0000","last_became_active":"2024-09-12T12:18:29.992820+0000","last_became_peered":"2024-09-12T12:18:29.992820+0000","last_unstale":"2024-09-12T12:18:32.991311+0000","last_undegraded":"2024-09-12T12:18:32.991311+0000","last_fullsized":"2024-09-12T12:18:32.991311+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.193710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177763+0000","last_change":"2024-09-12T12:18:31.000639+0000","last_active":"2024-09-12T12:18:32.177763+0000","last_peered":"2024-09-12T12:18:32.177763+0000","last_clean":"2024-09-12T12:18:32.177763+0000","last_became_active":"2024-09-12T12:18:31.000332+0000","last_became_peered":"2024-09-12T12:18:31.000332+0000","last_unstale":"2024-09-12T12:18:32.177763+0000","last_undegraded":"2024-09-12T12:18:32.177763+0000","last_fullsized":"2024-09-12T12:18:32.177763+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:19.466064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983536+0000","last_change":"2024-09-12T12:18:29.992814+0000","last_active":"2024-09-12T12:18:31.983536+0000","last_peered":"2024-09-12T12:18:31.983536+0000","last_clean":"2024-09-12T12:18:31.983536+0000","last_became_active":"2024-09-12T12:18:29.992541+0000","last_became_peered":"2024-09-12T12:18:29.992541+0000","last_unstale":"2024-09-12T12:18:31.983536+0000","last_undegraded":"2024-09-12T12:18:31.983536+0000","last_fullsized":"2024-09-12T12:18:31.983536+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:48.178163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.320809+0000","last_change":"2024-09-12T12:18:31.021882+0000","last_active":"2024-09-12T12:18:32.320809+0000","last_peered":"2024-09-12T12:18:32.320809+0000","last_clean":"2024-09-12T12:18:32.320809+0000","last_became_active":"2024-09-12T12:18:31.021622+0000","last_became_peered":"2024-09-12T12:18:31.021622+0000","last_unstale":"2024-09-12T12:18:32.320809+0000","last_undegraded":"2024-09-12T12:18:32.320809+0000","last_fullsized":"2024-09-12T12:18:32.320809+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156872+0000","last_change":"2024-09-12T12:18:30.000976+0000","last_active":"2024-09-12T12:18:34.156872+0000","last_peered":"2024-09-12T12:18:34.156872+0000","last_clean":"2024-09-12T12:18:34.156872+0000","last_became_active":"2024-09-12T12:18:30.000647+0000","last_became_peered":"2024-09-12T12:18:30.000647+0000","last_unstale":"2024-09-12T12:18:34.156872+0000","last_undegraded":"2024-09-12T12:18:34.156872+0000","last_fullsized":"2024-09-12T12:18:34.156872+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:06.037389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985398+0000","last_change":"2024-09-12T12:18:31.009029+0000","last_active":"2024-09-12T12:18:31.985398+0000","last_peered":"2024-09-12T12:18:31.985398+0000","last_clean":"2024-09-12T12:18:31.985398+0000","last_became_active":"2024-09-12T12:18:31.008713+0000","last_became_peered":"2024-09-12T12:18:31.008713+0000","last_unstale":"2024-09-12T12:18:31.985398+0000","last_undegraded":"2024-09-12T12:18:31.985398+0000","last_fullsized":"2024-09-12T12:18:31.985398+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:48.869837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982773+0000","last_change":"2024-09-12T12:18:29.996111+0000","last_active":"2024-09-12T12:18:31.982773+0000","last_peered":"2024-09-12T12:18:31.982773+0000","last_clean":"2024-09-12T12:18:31.982773+0000","last_became_active":"2024-09-12T12:18:29.995305+0000","last_became_peered":"2024-09-12T12:18:29.995305+0000","last_unstale":"2024-09-12T12:18:31.982773+0000","last_undegraded":"2024-09-12T12:18:31.982773+0000","last_fullsized":"2024-09-12T12:18:31.982773+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:53.802825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985095+0000","last_change":"2024-09-12T12:18:31.007460+0000","last_active":"2024-09-12T12:18:31.985095+0000","last_peered":"2024-09-12T12:18:31.985095+0000","last_clean":"2024-09-12T12:18:31.985095+0000","last_became_active":"2024-09-12T12:18:31.007188+0000","last_became_peered":"2024-09-12T12:18:31.007188+0000","last_unstale":"2024-09-12T12:18:31.985095+0000","last_undegraded":"2024-09-12T12:18:31.985095+0000","last_fullsized":"2024-09-12T12:18:31.985095+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:46.783083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984874+0000","last_change":"2024-09-12T12:18:29.999200+0000","last_active":"2024-09-12T12:18:31.984874+0000","last_peered":"2024-09-12T12:18:31.984874+0000","last_clean":"2024-09-12T12:18:31.984874+0000","last_became_active":"2024-09-12T12:18:29.997674+0000","last_became_peered":"2024-09-12T12:18:29.997674+0000","last_unstale":"2024-09-12T12:18:31.984874+0000","last_undegraded":"2024-09-12T12:18:31.984874+0000","last_fullsized":"2024-09-12T12:18:31.984874+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:45:21.474245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155733+0000","last_change":"2024-09-12T12:18:31.002573+0000","last_active":"2024-09-12T12:18:34.155733+0000","last_peered":"2024-09-12T12:18:34.155733+0000","last_clean":"2024-09-12T12:18:34.155733+0000","last_became_active":"2024-09-12T12:18:31.002128+0000","last_became_peered":"2024-09-12T12:18:31.002128+0000","last_unstale":"2024-09-12T12:18:34.155733+0000","last_undegraded":"2024-09-12T12:18:34.155733+0000","last_fullsized":"2024-09-12T12:18:34.155733+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:28.015565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982898+0000","last_change":"2024-09-12T12:18:29.992678+0000","last_active":"2024-09-12T12:18:31.982898+0000","last_peered":"2024-09-12T12:18:31.982898+0000","last_clean":"2024-09-12T12:18:31.982898+0000","last_became_active":"2024-09-12T12:18:29.992401+0000","last_became_peered":"2024-09-12T12:18:29.992401+0000","last_unstale":"2024-09-12T12:18:31.982898+0000","last_undegraded":"2024-09-12T12:18:31.982898+0000","last_fullsized":"2024-09-12T12:18:31.982898+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:53.802825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321090+0000","last_change":"2024-09-12T12:18:31.010618+0000","last_active":"2024-09-12T12:18:32.321090+0000","last_peered":"2024-09-12T12:18:32.321090+0000","last_clean":"2024-09-12T12:18:32.321090+0000","last_became_active":"2024-09-12T12:18:31.010337+0000","last_became_peered":"2024-09-12T12:18:31.010337+0000","last_unstale":"2024-09-12T12:18:32.321090+0000","last_undegraded":"2024-09-12T12:18:32.321090+0000","last_fullsized":"2024-09-12T12:18:32.321090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:30.522076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985144+0000","last_change":"2024-09-12T12:18:29.994453+0000","last_active":"2024-09-12T12:18:31.985144+0000","last_peered":"2024-09-12T12:18:31.985144+0000","last_clean":"2024-09-12T12:18:31.985144+0000","last_became_active":"2024-09-12T12:18:29.993835+0000","last_became_peered":"2024-09-12T12:18:29.993835+0000","last_unstale":"2024-09-12T12:18:31.985144+0000","last_undegraded":"2024-09-12T12:18:31.985144+0000","last_fullsized":"2024-09-12T12:18:31.985144+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:17.387339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.320806+0000","last_change":"2024-09-12T12:18:31.015130+0000","last_active":"2024-09-12T12:18:32.320806+0000","last_peered":"2024-09-12T12:18:32.320806+0000","last_clean":"2024-09-12T12:18:32.320806+0000","last_became_active":"2024-09-12T12:18:31.014751+0000","last_became_peered":"2024-09-12T12:18:31.014751+0000","last_unstale":"2024-09-12T12:18:32.320806+0000","last_undegraded":"2024-09-12T12:18:32.320806+0000","last_fullsized":"2024-09-12T12:18:32.320806+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:12.661477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985355+0000","last_change":"2024-09-12T12:18:30.001155+0000","last_active":"2024-09-12T12:18:31.985355+0000","last_peered":"2024-09-12T12:18:31.985355+0000","last_clean":"2024-09-12T12:18:31.985355+0000","last_became_active":"2024-09-12T12:18:30.000465+0000","last_became_peered":"2024-09-12T12:18:30.000465+0000","last_unstale":"2024-09-12T12:18:31.985355+0000","last_undegraded":"2024-09-12T12:18:31.985355+0000","last_fullsized":"2024-09-12T12:18:31.985355+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:47.810731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":339,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155262+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:18:34.155262+0000","last_peered":"2024-09-12T12:18:34.155262+0000","last_clean":"2024-09-12T12:18:34.155262+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:18:34.155262+0000","last_undegraded":"2024-09-12T12:18:34.155262+0000","last_fullsized":"2024-09-12T12:18:34.155262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37308,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334532,"statfs":{"total":96636764160,"available":96598560768,"internally_reserved":0,"allocated":2002944,"data_stored":1247635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36748,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":1433600,"data_stored":666015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":1413120,"data_stored":663799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40896,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330944,"statfs":{"total":96636764160,"available":96594886656,"internally_reserved":0,"allocated":1421312,"data_stored":663891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40892,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330948,"statfs":{"total":96636764160,"available":96594890752,"internally_reserved":0,"allocated":1417216,"data_stored":664381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1417216,"data_stored":663833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":1404928,"data_stored":657141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41484,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330356,"statfs":{"total":96636764160,"available":96594284544,"internally_reserved":0,"allocated":2023424,"data_stored":1255869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:18:35.856 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:18:36.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.029+0000 7fc36d200640 1 Processor -- start 2024-09-12T12:18:36.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.029+0000 7fc36d200640 1 -- start start 2024-09-12T12:18:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc36d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3680d1e70 0x7fc36815d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc36d200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3680d0580 con 0x7fc36815da90 2024-09-12T12:18:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc36d200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3680d0860 con 0x7fc3680731e0 2024-09-12T12:18:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc36d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc368073fb0 con 0x7fc3680d1e70 2024-09-12T12:18:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc366800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc36815da90 0x7fc36815df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42402/0 (socket says 172.21.15.144:42402) 2024-09-12T12:18:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc366800640 1 -- 172.21.15.144:0/3023882430 learned_addr learned my addr 172.21.15.144:0/3023882430 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc35fe00640 1 --2- 172.21.15.144:0/3023882430 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3680d1e70 0x7fc36815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc365400640 1 -- 172.21.15.144:0/3023882430 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006199869 0 0) 0x7fc3680d0580 con 0x7fc36815da90 2024-09-12T12:18:36.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc365400640 1 -- 172.21.15.144:0/3023882430 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc34c003530 con 0x7fc36815da90 2024-09-12T12:18:36.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc35fe00640 1 -- 172.21.15.144:0/3023882430 >> v1:172.21.15.165:6789/0 conn(0x7fc3680731e0 legacy=0x7fc3680735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc35fe00640 1 -- 172.21.15.144:0/3023882430 >> v1:172.21.15.144:6789/0 conn(0x7fc36815da90 legacy=0x7fc36815df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.033+0000 7fc35fe00640 1 -- 172.21.15.144:0/3023882430 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3680d0b40 con 0x7fc3680d1e70 2024-09-12T12:18:36.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc35fe00640 1 --2- 172.21.15.144:0/3023882430 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3680d1e70 0x7fc36815d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3500097f0 tx=0x7fc35001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5327e4a4f389e297 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:36.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc365400640 1 -- 172.21.15.144:0/3023882430 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500b0070 con 0x7fc3680d1e70 2024-09-12T12:18:36.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc365400640 1 -- 172.21.15.144:0/3023882430 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3500ab600 con 0x7fc3680d1e70 2024-09-12T12:18:36.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc365400640 1 -- 172.21.15.144:0/3023882430 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3500ab9d0 con 0x7fc3680d1e70 2024-09-12T12:18:36.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 -- 172.21.15.144:0/3023882430 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3680d1e70 msgr2=0x7fc36815d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 --2- 172.21.15.144:0/3023882430 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3680d1e70 0x7fc36815d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3500097f0 tx=0x7fc35001c4e0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 -- 172.21.15.144:0/3023882430 shutdown_connections 2024-09-12T12:18:36.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 --2- 172.21.15.144:0/3023882430 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3680d1e70 0x7fc36815d390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 -- 172.21.15.144:0/3023882430 >> 172.21.15.144:0/3023882430 conn(0x7fc3680d2500 msgr2=0x7fc3680d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:36.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 -- 172.21.15.144:0/3023882430 shutdown_connections 2024-09-12T12:18:36.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 -- 172.21.15.144:0/3023882430 wait complete. 2024-09-12T12:18:36.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 Processor -- start 2024-09-12T12:18:36.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 -- start start 2024-09-12T12:18:36.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680731e0 0x7fc368159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3680d1e70 0x7fc368157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc36815da90 0x7fc36814c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc36816a730 con 0x7fc3680731e0 2024-09-12T12:18:36.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc36815ea60 con 0x7fc3680d1e70 2024-09-12T12:18:36.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc36d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc36816a8b0 con 0x7fc36815da90 2024-09-12T12:18:36.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.037+0000 7fc365e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680731e0 0x7fc368159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc366800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc36815da90 0x7fc36814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc365e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680731e0 0x7fc368159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40582/0 (socket says 172.21.15.144:40582) 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc365e00640 1 -- 172.21.15.144:0/1000663347 learned_addr learned my addr 172.21.15.144:0/1000663347 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc35fe00640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3680d1e70 0x7fc368157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc365e00640 1 -- 172.21.15.144:0/1000663347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc36815da90 msgr2=0x7fc36814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc365e00640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc36815da90 0x7fc36814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc365e00640 1 -- 172.21.15.144:0/1000663347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3680d1e70 msgr2=0x7fc368157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc365e00640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3680d1e70 0x7fc368157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc365e00640 1 -- 172.21.15.144:0/1000663347 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc368159730 con 0x7fc3680731e0 2024-09-12T12:18:36.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc365e00640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680731e0 0x7fc368159050 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c3f0 tx=0x7fc35800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc35e000640 1 -- 172.21.15.144:0/1000663347 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358017070 con 0x7fc3680731e0 2024-09-12T12:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc35e000640 1 -- 172.21.15.144:0/1000663347 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3580052d0 con 0x7fc3680731e0 2024-09-12T12:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc368151430 con 0x7fc3680731e0 2024-09-12T12:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc35e000640 1 -- 172.21.15.144:0/1000663347 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358003840 con 0x7fc3680731e0 2024-09-12T12:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc368157b80 con 0x7fc3680731e0 2024-09-12T12:18:36.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc36815d390 con 0x7fc3680731e0 2024-09-12T12:18:36.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc35e000640 1 -- 172.21.15.144:0/1000663347 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc35801a070 con 0x7fc3680731e0 2024-09-12T12:18:36.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc35e000640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3440678c0 0x7fc344069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc35e000640 1 -- 172.21.15.144:0/1000663347 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7fc358085170 con 0x7fc3680731e0 2024-09-12T12:18:36.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.041+0000 7fc35fe00640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3440678c0 0x7fc344069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.045+0000 7fc35fe00640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3440678c0 0x7fc344069d80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ad000 tx=0x7fc3500a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:36.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.045+0000 7fc35e000640 1 -- 172.21.15.144:0/1000663347 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc358005480 con 0x7fc3680731e0 2024-09-12T12:18:36.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.257+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc3680d1bd0 con 0x7fc3680731e0 2024-09-12T12:18:36.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc35e000640 1 -- 172.21.15.144:0/1000663347 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1476 (secure 0 0 0) 0x7fc358055430 con 0x7fc3680731e0 2024-09-12T12:18:36.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:36.259 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":375,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":114,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":314892288,"bytes_avail":772779220992,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":88,"btime":"2024-09-12T12:18:34:012867+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":7273}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-09-12T12:18:17.446524+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:18:36.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3440678c0 msgr2=0x7fc344069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3440678c0 0x7fc344069d80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ad000 tx=0x7fc3500a6000 comp rx=0 tx=0).stop 2024-09-12T12:18:36.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680731e0 msgr2=0x7fc368159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680731e0 0x7fc368159050 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c3f0 tx=0x7fc35800c8b0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 shutdown_connections 2024-09-12T12:18:36.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3440678c0 0x7fc344069d80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc36815da90 0x7fc36814c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3680d1e70 0x7fc368157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 --2- 172.21.15.144:0/1000663347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3680731e0 0x7fc368159050 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 >> 172.21.15.144:0/1000663347 conn(0x7fc3680d2500 msgr2=0x7fc3680b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:36.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 shutdown_connections 2024-09-12T12:18:36.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.261+0000 7fc36d200640 1 -- 172.21.15.144:0/1000663347 wait complete. 2024-09-12T12:18:36.280 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T12:18:36.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:18:36.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e8000640 1 Processor -- start 2024-09-12T12:18:36.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e8000640 1 -- start start 2024-09-12T12:18:36.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e8000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f45e0071420 0x7f45e0071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e8000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 0x7f45e00cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e8000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e00b45a0 con 0x7f45e015b4e0 2024-09-12T12:18:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e8000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f45e00cd8e0 con 0x7f45e0071420 2024-09-12T12:18:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e8000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45e00b3fe0 con 0x7f45e00ccf30 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e4c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f45e0071420 0x7f45e0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e6000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 0x7f45e00cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e4c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f45e0071420 0x7f45e0071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:38584/0 (socket says 172.21.15.144:38584) 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.417+0000 7f45e4c00640 1 -- 172.21.15.144:0/1314664452 learned_addr learned my addr 172.21.15.144:0/1314664452 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45e4c00640 1 -- 172.21.15.144:0/1314664452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 msgr2=0x7f45e00cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45e4c00640 1 --2- 172.21.15.144:0/1314664452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 0x7f45e00cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45e4c00640 1 -- 172.21.15.144:0/1314664452 >> v1:172.21.15.165:6789/0 conn(0x7f45e015b4e0 legacy=0x7f45e00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45e4c00640 1 -- 172.21.15.144:0/1314664452 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e00b42c0 con 0x7f45e0071420 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45e6000640 1 --2- 172.21.15.144:0/1314664452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 0x7f45e00cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:36.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45dfe00640 1 -- 172.21.15.144:0/1314664452 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196183298 0 0) 0x7f45e00b45a0 con 0x7f45e015b4e0 2024-09-12T12:18:36.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45e4c00640 1 --2- 172.21.15.144:0/1314664452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45e0071420 0x7f45e0071840 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009870 tx=0x7f45cc01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=776f4e4d7b400da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:36.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45dfe00640 1 -- 172.21.15.144:0/1314664452 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0a95f0 con 0x7f45e0071420 2024-09-12T12:18:36.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45dfe00640 1 -- 172.21.15.144:0/1314664452 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45cc0a9790 con 0x7f45e0071420 2024-09-12T12:18:36.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45dfe00640 1 -- 172.21.15.144:0/1314664452 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0a9b60 con 0x7f45e0071420 2024-09-12T12:18:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45e8000640 1 -- 172.21.15.144:0/1314664452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45e0071420 msgr2=0x7f45e0071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.421+0000 7f45e8000640 1 --2- 172.21.15.144:0/1314664452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45e0071420 0x7f45e0071840 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009870 tx=0x7f45cc01c530 comp rx=0 tx=0).stop 2024-09-12T12:18:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 -- 172.21.15.144:0/1314664452 shutdown_connections 2024-09-12T12:18:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 --2- 172.21.15.144:0/1314664452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 0x7f45e00cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 --2- 172.21.15.144:0/1314664452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45e0071420 0x7f45e0071840 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 -- 172.21.15.144:0/1314664452 >> 172.21.15.144:0/1314664452 conn(0x7f45e006d0d0 msgr2=0x7f45e006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 -- 172.21.15.144:0/1314664452 shutdown_connections 2024-09-12T12:18:36.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 -- 172.21.15.144:0/1314664452 wait complete. 2024-09-12T12:18:36.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 Processor -- start 2024-09-12T12:18:36.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 -- start start 2024-09-12T12:18:36.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e0071420 0x7f45e0157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 0x7f45e015e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45e015b4e0 0x7f45e015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45e015b8c0 con 0x7f45e0071420 2024-09-12T12:18:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45e00cdef0 con 0x7f45e015b4e0 2024-09-12T12:18:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45e01586c0 con 0x7f45e00ccf30 2024-09-12T12:18:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e0071420 0x7f45e0157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e0071420 0x7f45e0157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40594/0 (socket says 172.21.15.144:40594) 2024-09-12T12:18:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e5600640 1 -- 172.21.15.144:0/544048418 learned_addr learned my addr 172.21.15.144:0/544048418 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e6000640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45e015b4e0 0x7f45e015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e4c00640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 0x7f45e015e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e5600640 1 -- 172.21.15.144:0/544048418 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 msgr2=0x7f45e015e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e5600640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 0x7f45e015e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e5600640 1 -- 172.21.15.144:0/544048418 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45e015b4e0 msgr2=0x7f45e015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e5600640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45e015b4e0 0x7f45e015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e5600640 1 -- 172.21.15.144:0/544048418 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e01603a0 con 0x7f45e0071420 2024-09-12T12:18:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e5600640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e0071420 0x7f45e0157b80 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f45d400c780 tx=0x7f45d400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45dd600640 1 -- 172.21.15.144:0/544048418 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4003ba0 con 0x7f45e0071420 2024-09-12T12:18:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45dd600640 1 -- 172.21.15.144:0/544048418 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d4003d40 con 0x7f45e0071420 2024-09-12T12:18:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45dd600640 1 -- 172.21.15.144:0/544048418 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d40052f0 con 0x7f45e0071420 2024-09-12T12:18:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.425+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e0160680 con 0x7f45e0071420 2024-09-12T12:18:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.429+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e0160c40 con 0x7f45e0071420 2024-09-12T12:18:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.429+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e0071840 con 0x7f45e0071420 2024-09-12T12:18:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.429+0000 7f45dd600640 1 -- 172.21.15.144:0/544048418 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45d4005490 con 0x7f45e0071420 2024-09-12T12:18:36.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.429+0000 7f45dd600640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45c00678f0 0x7f45c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:36.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.429+0000 7f45dd600640 1 -- 172.21.15.144:0/544048418 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f45d4085c90 con 0x7f45e0071420 2024-09-12T12:18:36.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.429+0000 7f45e4c00640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45c00678f0 0x7f45c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:36.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.429+0000 7f45e4c00640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45c00678f0 0x7f45c0069db0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0ae000 tx=0x7f45cc0b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:36.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.433+0000 7f45dd600640 1 -- 172.21.15.144:0/544048418 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45d40565a0 con 0x7f45e0071420 2024-09-12T12:18:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.589+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45e01588a0 con 0x7f45c00678f0 2024-09-12T12:18:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.597+0000 7f45dd600640 1 -- 172.21.15.144:0/544048418 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252486 (secure 0 0 0) 0x7f45e01588a0 con 0x7f45c00678f0 2024-09-12T12:18:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:36.599 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:18:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45c00678f0 msgr2=0x7f45c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45c00678f0 0x7f45c0069db0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0ae000 tx=0x7f45cc0b3040 comp rx=0 tx=0).stop 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e0071420 msgr2=0x7f45e0157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e0071420 0x7f45e0157b80 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f45d400c780 tx=0x7f45d400cb80 comp rx=0 tx=0).stop 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 shutdown_connections 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45c00678f0 0x7f45c0069db0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45e015b4e0 0x7f45e015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45e00ccf30 0x7f45e015e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 --2- 172.21.15.144:0/544048418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45e0071420 0x7f45e0157b80 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 >> 172.21.15.144:0/544048418 conn(0x7f45e006d0d0 msgr2=0x7f45e015f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 shutdown_connections 2024-09-12T12:18:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:36.601+0000 7f45e8000640 1 -- 172.21.15.144:0/544048418 wait complete. 2024-09-12T12:18:36.614 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-12T12:18:36.613+0000 7f1427800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:18:36.619 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-12T12:18:35.449602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307512,"kb_used_data":12240,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754667208,"statfs":{"total":773094113280,"available":772779220992,"internally_reserved":0,"allocated":12533760,"data_stored":6482564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":302173745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001200"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991370+0000","last_change":"2024-09-12T12:18:31.022353+0000","last_active":"2024-09-12T12:18:32.991370+0000","last_peered":"2024-09-12T12:18:32.991370+0000","last_clean":"2024-09-12T12:18:32.991370+0000","last_became_active":"2024-09-12T12:18:31.022058+0000","last_became_peered":"2024-09-12T12:18:31.022058+0000","last_unstale":"2024-09-12T12:18:32.991370+0000","last_undegraded":"2024-09-12T12:18:32.991370+0000","last_fullsized":"2024-09-12T12:18:32.991370+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:01.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983873+0000","last_change":"2024-09-12T12:18:30.999317+0000","last_active":"2024-09-12T12:18:31.983873+0000","last_peered":"2024-09-12T12:18:31.983873+0000","last_clean":"2024-09-12T12:18:31.983873+0000","last_became_active":"2024-09-12T12:18:30.999035+0000","last_became_peered":"2024-09-12T12:18:30.999035+0000","last_unstale":"2024-09-12T12:18:31.983873+0000","last_undegraded":"2024-09-12T12:18:31.983873+0000","last_fullsized":"2024-09-12T12:18:31.983873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:18.792493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991052+0000","last_change":"2024-09-12T12:18:31.019928+0000","last_active":"2024-09-12T12:18:32.991052+0000","last_peered":"2024-09-12T12:18:32.991052+0000","last_clean":"2024-09-12T12:18:32.991052+0000","last_became_active":"2024-09-12T12:18:31.019253+0000","last_became_peered":"2024-09-12T12:18:31.019253+0000","last_unstale":"2024-09-12T12:18:32.991052+0000","last_undegraded":"2024-09-12T12:18:32.991052+0000","last_fullsized":"2024-09-12T12:18:32.991052+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:43.702735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177829+0000","last_change":"2024-09-12T12:18:31.000255+0000","last_active":"2024-09-12T12:18:32.177829+0000","last_peered":"2024-09-12T12:18:32.177829+0000","last_clean":"2024-09-12T12:18:32.177829+0000","last_became_active":"2024-09-12T12:18:31.000007+0000","last_became_peered":"2024-09-12T12:18:31.000007+0000","last_unstale":"2024-09-12T12:18:32.177829+0000","last_undegraded":"2024-09-12T12:18:32.177829+0000","last_fullsized":"2024-09-12T12:18:32.177829+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:12.244392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156843+0000","last_change":"2024-09-12T12:18:31.005063+0000","last_active":"2024-09-12T12:18:34.156843+0000","last_peered":"2024-09-12T12:18:34.156843+0000","last_clean":"2024-09-12T12:18:34.156843+0000","last_became_active":"2024-09-12T12:18:31.004659+0000","last_became_peered":"2024-09-12T12:18:31.004659+0000","last_unstale":"2024-09-12T12:18:34.156843+0000","last_undegraded":"2024-09-12T12:18:34.156843+0000","last_fullsized":"2024-09-12T12:18:34.156843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982999+0000","last_change":"2024-09-12T12:18:31.018372+0000","last_active":"2024-09-12T12:18:31.982999+0000","last_peered":"2024-09-12T12:18:31.982999+0000","last_clean":"2024-09-12T12:18:31.982999+0000","last_became_active":"2024-09-12T12:18:31.018047+0000","last_became_peered":"2024-09-12T12:18:31.018047+0000","last_unstale":"2024-09-12T12:18:31.982999+0000","last_undegraded":"2024-09-12T12:18:31.982999+0000","last_fullsized":"2024-09-12T12:18:31.982999+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983133+0000","last_change":"2024-09-12T12:18:31.021695+0000","last_active":"2024-09-12T12:18:31.983133+0000","last_peered":"2024-09-12T12:18:31.983133+0000","last_clean":"2024-09-12T12:18:31.983133+0000","last_became_active":"2024-09-12T12:18:31.021390+0000","last_became_peered":"2024-09-12T12:18:31.021390+0000","last_unstale":"2024-09-12T12:18:31.983133+0000","last_undegraded":"2024-09-12T12:18:31.983133+0000","last_fullsized":"2024-09-12T12:18:31.983133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984817+0000","last_change":"2024-09-12T12:18:31.022124+0000","last_active":"2024-09-12T12:18:31.984817+0000","last_peered":"2024-09-12T12:18:31.984817+0000","last_clean":"2024-09-12T12:18:31.984817+0000","last_became_active":"2024-09-12T12:18:31.021796+0000","last_became_peered":"2024-09-12T12:18:31.021796+0000","last_unstale":"2024-09-12T12:18:31.984817+0000","last_undegraded":"2024-09-12T12:18:31.984817+0000","last_fullsized":"2024-09-12T12:18:31.984817+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:07.529758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983686+0000","last_change":"2024-09-12T12:18:31.003510+0000","last_active":"2024-09-12T12:18:31.983686+0000","last_peered":"2024-09-12T12:18:31.983686+0000","last_clean":"2024-09-12T12:18:31.983686+0000","last_became_active":"2024-09-12T12:18:31.001374+0000","last_became_peered":"2024-09-12T12:18:31.001374+0000","last_unstale":"2024-09-12T12:18:31.983686+0000","last_undegraded":"2024-09-12T12:18:31.983686+0000","last_fullsized":"2024-09-12T12:18:31.983686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:04.505957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156897+0000","last_change":"2024-09-12T12:18:31.017067+0000","last_active":"2024-09-12T12:18:34.156897+0000","last_peered":"2024-09-12T12:18:34.156897+0000","last_clean":"2024-09-12T12:18:34.156897+0000","last_became_active":"2024-09-12T12:18:31.016562+0000","last_became_peered":"2024-09-12T12:18:31.016562+0000","last_unstale":"2024-09-12T12:18:34.156897+0000","last_undegraded":"2024-09-12T12:18:34.156897+0000","last_fullsized":"2024-09-12T12:18:34.156897+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321017+0000","last_change":"2024-09-12T12:18:30.996847+0000","last_active":"2024-09-12T12:18:32.321017+0000","last_peered":"2024-09-12T12:18:32.321017+0000","last_clean":"2024-09-12T12:18:32.321017+0000","last_became_active":"2024-09-12T12:18:30.995784+0000","last_became_peered":"2024-09-12T12:18:30.995784+0000","last_unstale":"2024-09-12T12:18:32.321017+0000","last_undegraded":"2024-09-12T12:18:32.321017+0000","last_fullsized":"2024-09-12T12:18:32.321017+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983341+0000","last_change":"2024-09-12T12:18:31.009670+0000","last_active":"2024-09-12T12:18:31.983341+0000","last_peered":"2024-09-12T12:18:31.983341+0000","last_clean":"2024-09-12T12:18:31.983341+0000","last_became_active":"2024-09-12T12:18:31.007942+0000","last_became_peered":"2024-09-12T12:18:31.007942+0000","last_unstale":"2024-09-12T12:18:31.983341+0000","last_undegraded":"2024-09-12T12:18:31.983341+0000","last_fullsized":"2024-09-12T12:18:31.983341+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177773+0000","last_change":"2024-09-12T12:18:30.997142+0000","last_active":"2024-09-12T12:18:32.177773+0000","last_peered":"2024-09-12T12:18:32.177773+0000","last_clean":"2024-09-12T12:18:32.177773+0000","last_became_active":"2024-09-12T12:18:30.996830+0000","last_became_peered":"2024-09-12T12:18:30.996830+0000","last_unstale":"2024-09-12T12:18:32.177773+0000","last_undegraded":"2024-09-12T12:18:32.177773+0000","last_fullsized":"2024-09-12T12:18:32.177773+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:59.048601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155675+0000","last_change":"2024-09-12T12:18:31.004760+0000","last_active":"2024-09-12T12:18:34.155675+0000","last_peered":"2024-09-12T12:18:34.155675+0000","last_clean":"2024-09-12T12:18:34.155675+0000","last_became_active":"2024-09-12T12:18:31.004480+0000","last_became_peered":"2024-09-12T12:18:31.004480+0000","last_unstale":"2024-09-12T12:18:34.155675+0000","last_undegraded":"2024-09-12T12:18:34.155675+0000","last_fullsized":"2024-09-12T12:18:34.155675+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:52.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155425+0000","last_change":"2024-09-12T12:18:31.002415+0000","last_active":"2024-09-12T12:18:34.155425+0000","last_peered":"2024-09-12T12:18:34.155425+0000","last_clean":"2024-09-12T12:18:34.155425+0000","last_became_active":"2024-09-12T12:18:31.001992+0000","last_became_peered":"2024-09-12T12:18:31.001992+0000","last_unstale":"2024-09-12T12:18:34.155425+0000","last_undegraded":"2024-09-12T12:18:34.155425+0000","last_fullsized":"2024-09-12T12:18:34.155425+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:04.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155428+0000","last_change":"2024-09-12T12:18:31.006561+0000","last_active":"2024-09-12T12:18:34.155428+0000","last_peered":"2024-09-12T12:18:34.155428+0000","last_clean":"2024-09-12T12:18:34.155428+0000","last_became_active":"2024-09-12T12:18:31.006288+0000","last_became_peered":"2024-09-12T12:18:31.006288+0000","last_unstale":"2024-09-12T12:18:34.155428+0000","last_undegraded":"2024-09-12T12:18:34.155428+0000","last_fullsized":"2024-09-12T12:18:34.155428+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:18.792493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991485+0000","last_change":"2024-09-12T12:18:31.021654+0000","last_active":"2024-09-12T12:18:32.991485+0000","last_peered":"2024-09-12T12:18:32.991485+0000","last_clean":"2024-09-12T12:18:32.991485+0000","last_became_active":"2024-09-12T12:18:31.021353+0000","last_became_peered":"2024-09-12T12:18:31.021353+0000","last_unstale":"2024-09-12T12:18:32.991485+0000","last_undegraded":"2024-09-12T12:18:32.991485+0000","last_fullsized":"2024-09-12T12:18:32.991485+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:36.388916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983911+0000","last_change":"2024-09-12T12:18:31.018503+0000","last_active":"2024-09-12T12:18:31.983911+0000","last_peered":"2024-09-12T12:18:31.983911+0000","last_clean":"2024-09-12T12:18:31.983911+0000","last_became_active":"2024-09-12T12:18:31.018238+0000","last_became_peered":"2024-09-12T12:18:31.018238+0000","last_unstale":"2024-09-12T12:18:31.983911+0000","last_undegraded":"2024-09-12T12:18:31.983911+0000","last_fullsized":"2024-09-12T12:18:31.983911+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:52.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991108+0000","last_change":"2024-09-12T12:18:31.019533+0000","last_active":"2024-09-12T12:18:32.991108+0000","last_peered":"2024-09-12T12:18:32.991108+0000","last_clean":"2024-09-12T12:18:32.991108+0000","last_became_active":"2024-09-12T12:18:31.018656+0000","last_became_peered":"2024-09-12T12:18:31.018656+0000","last_unstale":"2024-09-12T12:18:32.991108+0000","last_undegraded":"2024-09-12T12:18:32.991108+0000","last_fullsized":"2024-09-12T12:18:32.991108+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:32.527059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983553+0000","last_change":"2024-09-12T12:18:31.003481+0000","last_active":"2024-09-12T12:18:31.983553+0000","last_peered":"2024-09-12T12:18:31.983553+0000","last_clean":"2024-09-12T12:18:31.983553+0000","last_became_active":"2024-09-12T12:18:31.003237+0000","last_became_peered":"2024-09-12T12:18:31.003237+0000","last_unstale":"2024-09-12T12:18:31.983553+0000","last_undegraded":"2024-09-12T12:18:31.983553+0000","last_fullsized":"2024-09-12T12:18:31.983553+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985262+0000","last_change":"2024-09-12T12:18:30.993956+0000","last_active":"2024-09-12T12:18:31.985262+0000","last_peered":"2024-09-12T12:18:31.985262+0000","last_clean":"2024-09-12T12:18:31.985262+0000","last_became_active":"2024-09-12T12:18:30.993616+0000","last_became_peered":"2024-09-12T12:18:30.993616+0000","last_unstale":"2024-09-12T12:18:31.985262+0000","last_undegraded":"2024-09-12T12:18:31.985262+0000","last_fullsized":"2024-09-12T12:18:31.985262+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:58.086086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156664+0000","last_change":"2024-09-12T12:18:31.004298+0000","last_active":"2024-09-12T12:18:34.156664+0000","last_peered":"2024-09-12T12:18:34.156664+0000","last_clean":"2024-09-12T12:18:34.156664+0000","last_became_active":"2024-09-12T12:18:31.004095+0000","last_became_peered":"2024-09-12T12:18:31.004095+0000","last_unstale":"2024-09-12T12:18:34.156664+0000","last_undegraded":"2024-09-12T12:18:34.156664+0000","last_fullsized":"2024-09-12T12:18:34.156664+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:12.661477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991076+0000","last_change":"2024-09-12T12:18:31.013190+0000","last_active":"2024-09-12T12:18:32.991076+0000","last_peered":"2024-09-12T12:18:32.991076+0000","last_clean":"2024-09-12T12:18:32.991076+0000","last_became_active":"2024-09-12T12:18:31.012520+0000","last_became_peered":"2024-09-12T12:18:31.012520+0000","last_unstale":"2024-09-12T12:18:32.991076+0000","last_undegraded":"2024-09-12T12:18:32.991076+0000","last_fullsized":"2024-09-12T12:18:32.991076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:27.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156429+0000","last_change":"2024-09-12T12:18:31.025299+0000","last_active":"2024-09-12T12:18:34.156429+0000","last_peered":"2024-09-12T12:18:34.156429+0000","last_clean":"2024-09-12T12:18:34.156429+0000","last_became_active":"2024-09-12T12:18:31.025002+0000","last_became_peered":"2024-09-12T12:18:31.025002+0000","last_unstale":"2024-09-12T12:18:34.156429+0000","last_undegraded":"2024-09-12T12:18:34.156429+0000","last_fullsized":"2024-09-12T12:18:34.156429+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:58.439510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983365+0000","last_change":"2024-09-12T12:18:30.993055+0000","last_active":"2024-09-12T12:18:31.983365+0000","last_peered":"2024-09-12T12:18:31.983365+0000","last_clean":"2024-09-12T12:18:31.983365+0000","last_became_active":"2024-09-12T12:18:30.992726+0000","last_became_peered":"2024-09-12T12:18:30.992726+0000","last_unstale":"2024-09-12T12:18:31.983365+0000","last_undegraded":"2024-09-12T12:18:31.983365+0000","last_fullsized":"2024-09-12T12:18:31.983365+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983320+0000","last_change":"2024-09-12T12:18:30.991346+0000","last_active":"2024-09-12T12:18:31.983320+0000","last_peered":"2024-09-12T12:18:31.983320+0000","last_clean":"2024-09-12T12:18:31.983320+0000","last_became_active":"2024-09-12T12:18:30.990964+0000","last_became_peered":"2024-09-12T12:18:30.990964+0000","last_unstale":"2024-09-12T12:18:31.983320+0000","last_undegraded":"2024-09-12T12:18:31.983320+0000","last_fullsized":"2024-09-12T12:18:31.983320+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321122+0000","last_change":"2024-09-12T12:18:31.007290+0000","last_active":"2024-09-12T12:18:32.321122+0000","last_peered":"2024-09-12T12:18:32.321122+0000","last_clean":"2024-09-12T12:18:32.321122+0000","last_became_active":"2024-09-12T12:18:31.006757+0000","last_became_peered":"2024-09-12T12:18:31.006757+0000","last_unstale":"2024-09-12T12:18:32.321122+0000","last_undegraded":"2024-09-12T12:18:32.321122+0000","last_fullsized":"2024-09-12T12:18:32.321122+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:04.505957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983715+0000","last_change":"2024-09-12T12:18:30.994217+0000","last_active":"2024-09-12T12:18:31.983715+0000","last_peered":"2024-09-12T12:18:31.983715+0000","last_clean":"2024-09-12T12:18:31.983715+0000","last_became_active":"2024-09-12T12:18:30.994004+0000","last_became_peered":"2024-09-12T12:18:30.994004+0000","last_unstale":"2024-09-12T12:18:31.983715+0000","last_undegraded":"2024-09-12T12:18:31.983715+0000","last_fullsized":"2024-09-12T12:18:31.983715+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:04.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985451+0000","last_change":"2024-09-12T12:18:31.008589+0000","last_active":"2024-09-12T12:18:31.985451+0000","last_peered":"2024-09-12T12:18:31.985451+0000","last_clean":"2024-09-12T12:18:31.985451+0000","last_became_active":"2024-09-12T12:18:31.008317+0000","last_became_peered":"2024-09-12T12:18:31.008317+0000","last_unstale":"2024-09-12T12:18:31.985451+0000","last_undegraded":"2024-09-12T12:18:31.985451+0000","last_fullsized":"2024-09-12T12:18:31.985451+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:33.766056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982838+0000","last_change":"2024-09-12T12:18:30.989833+0000","last_active":"2024-09-12T12:18:31.982838+0000","last_peered":"2024-09-12T12:18:31.982838+0000","last_clean":"2024-09-12T12:18:31.982838+0000","last_became_active":"2024-09-12T12:18:30.989307+0000","last_became_peered":"2024-09-12T12:18:30.989307+0000","last_unstale":"2024-09-12T12:18:31.982838+0000","last_undegraded":"2024-09-12T12:18:31.982838+0000","last_fullsized":"2024-09-12T12:18:31.982838+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:45.214279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982741+0000","last_change":"2024-09-12T12:18:31.014262+0000","last_active":"2024-09-12T12:18:31.982741+0000","last_peered":"2024-09-12T12:18:31.982741+0000","last_clean":"2024-09-12T12:18:31.982741+0000","last_became_active":"2024-09-12T12:18:31.013931+0000","last_became_peered":"2024-09-12T12:18:31.013931+0000","last_unstale":"2024-09-12T12:18:31.982741+0000","last_undegraded":"2024-09-12T12:18:31.982741+0000","last_fullsized":"2024-09-12T12:18:31.982741+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984981+0000","last_change":"2024-09-12T12:18:30.987471+0000","last_active":"2024-09-12T12:18:31.984981+0000","last_peered":"2024-09-12T12:18:31.984981+0000","last_clean":"2024-09-12T12:18:31.984981+0000","last_became_active":"2024-09-12T12:18:30.987146+0000","last_became_peered":"2024-09-12T12:18:30.987146+0000","last_unstale":"2024-09-12T12:18:31.984981+0000","last_undegraded":"2024-09-12T12:18:31.984981+0000","last_fullsized":"2024-09-12T12:18:31.984981+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:52:32.928811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991149+0000","last_change":"2024-09-12T12:18:31.012380+0000","last_active":"2024-09-12T12:18:32.991149+0000","last_peered":"2024-09-12T12:18:32.991149+0000","last_clean":"2024-09-12T12:18:32.991149+0000","last_became_active":"2024-09-12T12:18:31.011284+0000","last_became_peered":"2024-09-12T12:18:31.011284+0000","last_unstale":"2024-09-12T12:18:32.991149+0000","last_undegraded":"2024-09-12T12:18:32.991149+0000","last_fullsized":"2024-09-12T12:18:32.991149+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:50.083315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"113'4","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177969+0000","last_change":"2024-09-12T12:18:29.999114+0000","last_active":"2024-09-12T12:18:32.177969+0000","last_peered":"2024-09-12T12:18:32.177969+0000","last_clean":"2024-09-12T12:18:32.177969+0000","last_became_active":"2024-09-12T12:18:29.998825+0000","last_became_peered":"2024-09-12T12:18:29.998825+0000","last_unstale":"2024-09-12T12:18:32.177969+0000","last_undegraded":"2024-09-12T12:18:32.177969+0000","last_fullsized":"2024-09-12T12:18:32.177969+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:40.296370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984934+0000","last_change":"2024-09-12T12:18:31.025587+0000","last_active":"2024-09-12T12:18:31.984934+0000","last_peered":"2024-09-12T12:18:31.984934+0000","last_clean":"2024-09-12T12:18:31.984934+0000","last_became_active":"2024-09-12T12:18:31.025327+0000","last_became_peered":"2024-09-12T12:18:31.025327+0000","last_unstale":"2024-09-12T12:18:31.984934+0000","last_undegraded":"2024-09-12T12:18:31.984934+0000","last_fullsized":"2024-09-12T12:18:31.984934+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:29.348172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985187+0000","last_change":"2024-09-12T12:18:30.001333+0000","last_active":"2024-09-12T12:18:31.985187+0000","last_peered":"2024-09-12T12:18:31.985187+0000","last_clean":"2024-09-12T12:18:31.985187+0000","last_became_active":"2024-09-12T12:18:30.000855+0000","last_became_peered":"2024-09-12T12:18:30.000855+0000","last_unstale":"2024-09-12T12:18:31.985187+0000","last_undegraded":"2024-09-12T12:18:31.985187+0000","last_fullsized":"2024-09-12T12:18:31.985187+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:26.984813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982980+0000","last_change":"2024-09-12T12:18:31.004310+0000","last_active":"2024-09-12T12:18:31.982980+0000","last_peered":"2024-09-12T12:18:31.982980+0000","last_clean":"2024-09-12T12:18:31.982980+0000","last_became_active":"2024-09-12T12:18:31.003973+0000","last_became_peered":"2024-09-12T12:18:31.003973+0000","last_unstale":"2024-09-12T12:18:31.982980+0000","last_undegraded":"2024-09-12T12:18:31.982980+0000","last_fullsized":"2024-09-12T12:18:31.982980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:12.661477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982972+0000","last_change":"2024-09-12T12:18:29.997014+0000","last_active":"2024-09-12T12:18:31.982972+0000","last_peered":"2024-09-12T12:18:31.982972+0000","last_clean":"2024-09-12T12:18:31.982972+0000","last_became_active":"2024-09-12T12:18:29.996677+0000","last_became_peered":"2024-09-12T12:18:29.996677+0000","last_unstale":"2024-09-12T12:18:31.982972+0000","last_undegraded":"2024-09-12T12:18:31.982972+0000","last_fullsized":"2024-09-12T12:18:31.982972+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:48.178163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321039+0000","last_change":"2024-09-12T12:18:30.993859+0000","last_active":"2024-09-12T12:18:32.321039+0000","last_peered":"2024-09-12T12:18:32.321039+0000","last_clean":"2024-09-12T12:18:32.321039+0000","last_became_active":"2024-09-12T12:18:30.993544+0000","last_became_peered":"2024-09-12T12:18:30.993544+0000","last_unstale":"2024-09-12T12:18:32.321039+0000","last_undegraded":"2024-09-12T12:18:32.321039+0000","last_fullsized":"2024-09-12T12:18:32.321039+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156863+0000","last_change":"2024-09-12T12:18:29.999312+0000","last_active":"2024-09-12T12:18:34.156863+0000","last_peered":"2024-09-12T12:18:34.156863+0000","last_clean":"2024-09-12T12:18:34.156863+0000","last_became_active":"2024-09-12T12:18:29.998546+0000","last_became_peered":"2024-09-12T12:18:29.998546+0000","last_unstale":"2024-09-12T12:18:34.156863+0000","last_undegraded":"2024-09-12T12:18:34.156863+0000","last_fullsized":"2024-09-12T12:18:34.156863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:12.704492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177915+0000","last_change":"2024-09-12T12:18:31.003545+0000","last_active":"2024-09-12T12:18:32.177915+0000","last_peered":"2024-09-12T12:18:32.177915+0000","last_clean":"2024-09-12T12:18:32.177915+0000","last_became_active":"2024-09-12T12:18:31.003272+0000","last_became_peered":"2024-09-12T12:18:31.003272+0000","last_unstale":"2024-09-12T12:18:32.177915+0000","last_undegraded":"2024-09-12T12:18:32.177915+0000","last_fullsized":"2024-09-12T12:18:32.177915+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:29.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155436+0000","last_change":"2024-09-12T12:18:29.997806+0000","last_active":"2024-09-12T12:18:34.155436+0000","last_peered":"2024-09-12T12:18:34.155436+0000","last_clean":"2024-09-12T12:18:34.155436+0000","last_became_active":"2024-09-12T12:18:29.997477+0000","last_became_peered":"2024-09-12T12:18:29.997477+0000","last_unstale":"2024-09-12T12:18:34.155436+0000","last_undegraded":"2024-09-12T12:18:34.155436+0000","last_fullsized":"2024-09-12T12:18:34.155436+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:11.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991359+0000","last_change":"2024-09-12T12:18:31.019734+0000","last_active":"2024-09-12T12:18:32.991359+0000","last_peered":"2024-09-12T12:18:32.991359+0000","last_clean":"2024-09-12T12:18:32.991359+0000","last_became_active":"2024-09-12T12:18:31.018922+0000","last_became_peered":"2024-09-12T12:18:31.018922+0000","last_unstale":"2024-09-12T12:18:32.991359+0000","last_undegraded":"2024-09-12T12:18:32.991359+0000","last_fullsized":"2024-09-12T12:18:32.991359+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:57.568596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.320691+0000","last_change":"2024-09-12T12:18:29.993845+0000","last_active":"2024-09-12T12:18:32.320691+0000","last_peered":"2024-09-12T12:18:32.320691+0000","last_clean":"2024-09-12T12:18:32.320691+0000","last_became_active":"2024-09-12T12:18:29.993573+0000","last_became_peered":"2024-09-12T12:18:29.993573+0000","last_unstale":"2024-09-12T12:18:32.320691+0000","last_undegraded":"2024-09-12T12:18:32.320691+0000","last_fullsized":"2024-09-12T12:18:32.320691+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:06.037389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984009+0000","last_change":"2024-09-12T12:18:30.998680+0000","last_active":"2024-09-12T12:18:31.984009+0000","last_peered":"2024-09-12T12:18:31.984009+0000","last_clean":"2024-09-12T12:18:31.984009+0000","last_became_active":"2024-09-12T12:18:30.998310+0000","last_became_peered":"2024-09-12T12:18:30.998310+0000","last_unstale":"2024-09-12T12:18:31.984009+0000","last_undegraded":"2024-09-12T12:18:31.984009+0000","last_fullsized":"2024-09-12T12:18:31.984009+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:28.015565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982671+0000","last_change":"2024-09-12T12:18:29.991649+0000","last_active":"2024-09-12T12:18:31.982671+0000","last_peered":"2024-09-12T12:18:31.982671+0000","last_clean":"2024-09-12T12:18:31.982671+0000","last_became_active":"2024-09-12T12:18:29.991371+0000","last_became_peered":"2024-09-12T12:18:29.991371+0000","last_unstale":"2024-09-12T12:18:31.982671+0000","last_undegraded":"2024-09-12T12:18:31.982671+0000","last_fullsized":"2024-09-12T12:18:31.982671+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:37.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.178024+0000","last_change":"2024-09-12T12:18:31.026155+0000","last_active":"2024-09-12T12:18:32.178024+0000","last_peered":"2024-09-12T12:18:32.178024+0000","last_clean":"2024-09-12T12:18:32.178024+0000","last_became_active":"2024-09-12T12:18:31.025872+0000","last_became_peered":"2024-09-12T12:18:31.025872+0000","last_unstale":"2024-09-12T12:18:32.178024+0000","last_undegraded":"2024-09-12T12:18:32.178024+0000","last_fullsized":"2024-09-12T12:18:32.178024+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:10.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177889+0000","last_change":"2024-09-12T12:18:29.991538+0000","last_active":"2024-09-12T12:18:32.177889+0000","last_peered":"2024-09-12T12:18:32.177889+0000","last_clean":"2024-09-12T12:18:32.177889+0000","last_became_active":"2024-09-12T12:18:29.991222+0000","last_became_peered":"2024-09-12T12:18:29.991222+0000","last_unstale":"2024-09-12T12:18:32.177889+0000","last_undegraded":"2024-09-12T12:18:32.177889+0000","last_fullsized":"2024-09-12T12:18:32.177889+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:54.006487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.990956+0000","last_change":"2024-09-12T12:18:31.012847+0000","last_active":"2024-09-12T12:18:32.990956+0000","last_peered":"2024-09-12T12:18:32.990956+0000","last_clean":"2024-09-12T12:18:32.990956+0000","last_became_active":"2024-09-12T12:18:31.012481+0000","last_became_peered":"2024-09-12T12:18:31.012481+0000","last_unstale":"2024-09-12T12:18:32.990956+0000","last_undegraded":"2024-09-12T12:18:32.990956+0000","last_fullsized":"2024-09-12T12:18:32.990956+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:20.096960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983388+0000","last_change":"2024-09-12T12:18:29.995711+0000","last_active":"2024-09-12T12:18:31.983388+0000","last_peered":"2024-09-12T12:18:31.983388+0000","last_clean":"2024-09-12T12:18:31.983388+0000","last_became_active":"2024-09-12T12:18:29.995371+0000","last_became_peered":"2024-09-12T12:18:29.995371+0000","last_unstale":"2024-09-12T12:18:31.983388+0000","last_undegraded":"2024-09-12T12:18:31.983388+0000","last_fullsized":"2024-09-12T12:18:31.983388+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:52.214565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156550+0000","last_change":"2024-09-12T12:18:31.019166+0000","last_active":"2024-09-12T12:18:34.156550+0000","last_peered":"2024-09-12T12:18:34.156550+0000","last_clean":"2024-09-12T12:18:34.156550+0000","last_became_active":"2024-09-12T12:18:31.018850+0000","last_became_peered":"2024-09-12T12:18:31.018850+0000","last_unstale":"2024-09-12T12:18:34.156550+0000","last_undegraded":"2024-09-12T12:18:34.156550+0000","last_fullsized":"2024-09-12T12:18:34.156550+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:45.214279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991228+0000","last_change":"2024-09-12T12:18:29.990292+0000","last_active":"2024-09-12T12:18:32.991228+0000","last_peered":"2024-09-12T12:18:32.991228+0000","last_clean":"2024-09-12T12:18:32.991228+0000","last_became_active":"2024-09-12T12:18:29.989785+0000","last_became_peered":"2024-09-12T12:18:29.989785+0000","last_unstale":"2024-09-12T12:18:32.991228+0000","last_undegraded":"2024-09-12T12:18:32.991228+0000","last_fullsized":"2024-09-12T12:18:32.991228+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:14.305898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984932+0000","last_change":"2024-09-12T12:18:31.021909+0000","last_active":"2024-09-12T12:18:31.984932+0000","last_peered":"2024-09-12T12:18:31.984932+0000","last_clean":"2024-09-12T12:18:31.984932+0000","last_became_active":"2024-09-12T12:18:31.021602+0000","last_became_peered":"2024-09-12T12:18:31.021602+0000","last_unstale":"2024-09-12T12:18:31.984932+0000","last_undegraded":"2024-09-12T12:18:31.984932+0000","last_fullsized":"2024-09-12T12:18:31.984932+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:45.938897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"113'3","reported_seq":17,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155382+0000","last_change":"2024-09-12T12:18:29.998684+0000","last_active":"2024-09-12T12:18:34.155382+0000","last_peered":"2024-09-12T12:18:34.155382+0000","last_clean":"2024-09-12T12:18:34.155382+0000","last_became_active":"2024-09-12T12:18:29.998433+0000","last_became_peered":"2024-09-12T12:18:29.998433+0000","last_unstale":"2024-09-12T12:18:34.155382+0000","last_undegraded":"2024-09-12T12:18:34.155382+0000","last_fullsized":"2024-09-12T12:18:34.155382+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:00.362980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156949+0000","last_change":"2024-09-12T12:18:31.003572+0000","last_active":"2024-09-12T12:18:34.156949+0000","last_peered":"2024-09-12T12:18:34.156949+0000","last_clean":"2024-09-12T12:18:34.156949+0000","last_became_active":"2024-09-12T12:18:31.003183+0000","last_became_peered":"2024-09-12T12:18:31.003183+0000","last_unstale":"2024-09-12T12:18:34.156949+0000","last_undegraded":"2024-09-12T12:18:34.156949+0000","last_fullsized":"2024-09-12T12:18:34.156949+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"113'6","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983670+0000","last_change":"2024-09-12T12:18:29.991827+0000","last_active":"2024-09-12T12:18:31.983670+0000","last_peered":"2024-09-12T12:18:31.983670+0000","last_clean":"2024-09-12T12:18:31.983670+0000","last_became_active":"2024-09-12T12:18:29.991527+0000","last_became_peered":"2024-09-12T12:18:29.991527+0000","last_unstale":"2024-09-12T12:18:31.983670+0000","last_undegraded":"2024-09-12T12:18:31.983670+0000","last_fullsized":"2024-09-12T12:18:31.983670+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:52.214565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321084+0000","last_change":"2024-09-12T12:18:31.017369+0000","last_active":"2024-09-12T12:18:32.321084+0000","last_peered":"2024-09-12T12:18:32.321084+0000","last_clean":"2024-09-12T12:18:32.321084+0000","last_became_active":"2024-09-12T12:18:31.017182+0000","last_became_peered":"2024-09-12T12:18:31.017182+0000","last_unstale":"2024-09-12T12:18:32.321084+0000","last_undegraded":"2024-09-12T12:18:32.321084+0000","last_fullsized":"2024-09-12T12:18:32.321084+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156904+0000","last_change":"2024-09-12T12:18:30.001028+0000","last_active":"2024-09-12T12:18:34.156904+0000","last_peered":"2024-09-12T12:18:34.156904+0000","last_clean":"2024-09-12T12:18:34.156904+0000","last_became_active":"2024-09-12T12:18:30.000737+0000","last_became_peered":"2024-09-12T12:18:30.000737+0000","last_unstale":"2024-09-12T12:18:34.156904+0000","last_undegraded":"2024-09-12T12:18:34.156904+0000","last_fullsized":"2024-09-12T12:18:34.156904+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:52.214565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983623+0000","last_change":"2024-09-12T12:18:31.000693+0000","last_active":"2024-09-12T12:18:31.983623+0000","last_peered":"2024-09-12T12:18:31.983623+0000","last_clean":"2024-09-12T12:18:31.983623+0000","last_became_active":"2024-09-12T12:18:31.000423+0000","last_became_peered":"2024-09-12T12:18:31.000423+0000","last_unstale":"2024-09-12T12:18:31.983623+0000","last_undegraded":"2024-09-12T12:18:31.983623+0000","last_fullsized":"2024-09-12T12:18:31.983623+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:30.522076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177687+0000","last_change":"2024-09-12T12:18:29.990655+0000","last_active":"2024-09-12T12:18:32.177687+0000","last_peered":"2024-09-12T12:18:32.177687+0000","last_clean":"2024-09-12T12:18:32.177687+0000","last_became_active":"2024-09-12T12:18:29.990282+0000","last_became_peered":"2024-09-12T12:18:29.990282+0000","last_unstale":"2024-09-12T12:18:32.177687+0000","last_undegraded":"2024-09-12T12:18:32.177687+0000","last_fullsized":"2024-09-12T12:18:32.177687+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:07.785310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985100+0000","last_change":"2024-09-12T12:18:30.993660+0000","last_active":"2024-09-12T12:18:31.985100+0000","last_peered":"2024-09-12T12:18:31.985100+0000","last_clean":"2024-09-12T12:18:31.985100+0000","last_became_active":"2024-09-12T12:18:30.993345+0000","last_became_peered":"2024-09-12T12:18:30.993345+0000","last_unstale":"2024-09-12T12:18:31.985100+0000","last_undegraded":"2024-09-12T12:18:31.985100+0000","last_fullsized":"2024-09-12T12:18:31.985100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:35.592852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984837+0000","last_change":"2024-09-12T12:18:29.989110+0000","last_active":"2024-09-12T12:18:31.984837+0000","last_peered":"2024-09-12T12:18:31.984837+0000","last_clean":"2024-09-12T12:18:31.984837+0000","last_became_active":"2024-09-12T12:18:29.988866+0000","last_became_peered":"2024-09-12T12:18:29.988866+0000","last_unstale":"2024-09-12T12:18:31.984837+0000","last_undegraded":"2024-09-12T12:18:31.984837+0000","last_fullsized":"2024-09-12T12:18:31.984837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:56.981675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991472+0000","last_change":"2024-09-12T12:18:31.017885+0000","last_active":"2024-09-12T12:18:32.991472+0000","last_peered":"2024-09-12T12:18:32.991472+0000","last_clean":"2024-09-12T12:18:32.991472+0000","last_became_active":"2024-09-12T12:18:31.016690+0000","last_became_peered":"2024-09-12T12:18:31.016690+0000","last_unstale":"2024-09-12T12:18:32.991472+0000","last_undegraded":"2024-09-12T12:18:32.991472+0000","last_fullsized":"2024-09-12T12:18:32.991472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:53.793729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982457+0000","last_change":"2024-09-12T12:18:29.986854+0000","last_active":"2024-09-12T12:18:31.982457+0000","last_peered":"2024-09-12T12:18:31.982457+0000","last_clean":"2024-09-12T12:18:31.982457+0000","last_became_active":"2024-09-12T12:18:29.986355+0000","last_became_peered":"2024-09-12T12:18:29.986355+0000","last_unstale":"2024-09-12T12:18:31.982457+0000","last_undegraded":"2024-09-12T12:18:31.982457+0000","last_fullsized":"2024-09-12T12:18:31.982457+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.123774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985172+0000","last_change":"2024-09-12T12:18:31.017522+0000","last_active":"2024-09-12T12:18:31.985172+0000","last_peered":"2024-09-12T12:18:31.985172+0000","last_clean":"2024-09-12T12:18:31.985172+0000","last_became_active":"2024-09-12T12:18:31.016996+0000","last_became_peered":"2024-09-12T12:18:31.016996+0000","last_unstale":"2024-09-12T12:18:31.985172+0000","last_undegraded":"2024-09-12T12:18:31.985172+0000","last_fullsized":"2024-09-12T12:18:31.985172+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:40.058981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983581+0000","last_change":"2024-09-12T12:18:29.995555+0000","last_active":"2024-09-12T12:18:31.983581+0000","last_peered":"2024-09-12T12:18:31.983581+0000","last_clean":"2024-09-12T12:18:31.983581+0000","last_became_active":"2024-09-12T12:18:29.995251+0000","last_became_peered":"2024-09-12T12:18:29.995251+0000","last_unstale":"2024-09-12T12:18:31.983581+0000","last_undegraded":"2024-09-12T12:18:31.983581+0000","last_fullsized":"2024-09-12T12:18:31.983581+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.123774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983159+0000","last_change":"2024-09-12T12:18:31.014477+0000","last_active":"2024-09-12T12:18:31.983159+0000","last_peered":"2024-09-12T12:18:31.983159+0000","last_clean":"2024-09-12T12:18:31.983159+0000","last_became_active":"2024-09-12T12:18:31.014178+0000","last_became_peered":"2024-09-12T12:18:31.014178+0000","last_unstale":"2024-09-12T12:18:31.983159+0000","last_undegraded":"2024-09-12T12:18:31.983159+0000","last_fullsized":"2024-09-12T12:18:31.983159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155561+0000","last_change":"2024-09-12T12:18:29.994438+0000","last_active":"2024-09-12T12:18:34.155561+0000","last_peered":"2024-09-12T12:18:34.155561+0000","last_clean":"2024-09-12T12:18:34.155561+0000","last_became_active":"2024-09-12T12:18:29.994153+0000","last_became_peered":"2024-09-12T12:18:29.994153+0000","last_unstale":"2024-09-12T12:18:34.155561+0000","last_undegraded":"2024-09-12T12:18:34.155561+0000","last_fullsized":"2024-09-12T12:18:34.155561+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:19.667406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156739+0000","last_change":"2024-09-12T12:18:31.007127+0000","last_active":"2024-09-12T12:18:34.156739+0000","last_peered":"2024-09-12T12:18:34.156739+0000","last_clean":"2024-09-12T12:18:34.156739+0000","last_became_active":"2024-09-12T12:18:31.006805+0000","last_became_peered":"2024-09-12T12:18:31.006805+0000","last_unstale":"2024-09-12T12:18:34.156739+0000","last_undegraded":"2024-09-12T12:18:34.156739+0000","last_fullsized":"2024-09-12T12:18:34.156739+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321151+0000","last_change":"2024-09-12T12:18:29.997146+0000","last_active":"2024-09-12T12:18:32.321151+0000","last_peered":"2024-09-12T12:18:32.321151+0000","last_clean":"2024-09-12T12:18:32.321151+0000","last_became_active":"2024-09-12T12:18:29.996862+0000","last_became_peered":"2024-09-12T12:18:29.996862+0000","last_unstale":"2024-09-12T12:18:32.321151+0000","last_undegraded":"2024-09-12T12:18:32.321151+0000","last_fullsized":"2024-09-12T12:18:32.321151+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:12.704492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991107+0000","last_change":"2024-09-12T12:18:31.016129+0000","last_active":"2024-09-12T12:18:32.991107+0000","last_peered":"2024-09-12T12:18:32.991107+0000","last_clean":"2024-09-12T12:18:32.991107+0000","last_became_active":"2024-09-12T12:18:31.015833+0000","last_became_peered":"2024-09-12T12:18:31.015833+0000","last_unstale":"2024-09-12T12:18:32.991107+0000","last_undegraded":"2024-09-12T12:18:32.991107+0000","last_fullsized":"2024-09-12T12:18:32.991107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:54.456454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985337+0000","last_change":"2024-09-12T12:18:29.992741+0000","last_active":"2024-09-12T12:18:31.985337+0000","last_peered":"2024-09-12T12:18:31.985337+0000","last_clean":"2024-09-12T12:18:31.985337+0000","last_became_active":"2024-09-12T12:18:29.992217+0000","last_became_peered":"2024-09-12T12:18:29.992217+0000","last_unstale":"2024-09-12T12:18:31.985337+0000","last_undegraded":"2024-09-12T12:18:31.985337+0000","last_fullsized":"2024-09-12T12:18:31.985337+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.318998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991283+0000","last_change":"2024-09-12T12:18:31.024343+0000","last_active":"2024-09-12T12:18:32.991283+0000","last_peered":"2024-09-12T12:18:32.991283+0000","last_clean":"2024-09-12T12:18:32.991283+0000","last_became_active":"2024-09-12T12:18:31.024077+0000","last_became_peered":"2024-09-12T12:18:31.024077+0000","last_unstale":"2024-09-12T12:18:32.991283+0000","last_undegraded":"2024-09-12T12:18:32.991283+0000","last_fullsized":"2024-09-12T12:18:32.991283+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:52.503849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984766+0000","last_change":"2024-09-12T12:18:30.001790+0000","last_active":"2024-09-12T12:18:31.984766+0000","last_peered":"2024-09-12T12:18:31.984766+0000","last_clean":"2024-09-12T12:18:31.984766+0000","last_became_active":"2024-09-12T12:18:30.000000+0000","last_became_peered":"2024-09-12T12:18:30.000000+0000","last_unstale":"2024-09-12T12:18:31.984766+0000","last_undegraded":"2024-09-12T12:18:31.984766+0000","last_fullsized":"2024-09-12T12:18:31.984766+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:56.869101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177887+0000","last_change":"2024-09-12T12:18:31.008663+0000","last_active":"2024-09-12T12:18:32.177887+0000","last_peered":"2024-09-12T12:18:32.177887+0000","last_clean":"2024-09-12T12:18:32.177887+0000","last_became_active":"2024-09-12T12:18:31.008323+0000","last_became_peered":"2024-09-12T12:18:31.008323+0000","last_unstale":"2024-09-12T12:18:32.177887+0000","last_undegraded":"2024-09-12T12:18:32.177887+0000","last_fullsized":"2024-09-12T12:18:32.177887+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:45.358385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982796+0000","last_change":"2024-09-12T12:18:29.995853+0000","last_active":"2024-09-12T12:18:31.982796+0000","last_peered":"2024-09-12T12:18:31.982796+0000","last_clean":"2024-09-12T12:18:31.982796+0000","last_became_active":"2024-09-12T12:18:29.994997+0000","last_became_peered":"2024-09-12T12:18:29.994997+0000","last_unstale":"2024-09-12T12:18:31.982796+0000","last_undegraded":"2024-09-12T12:18:31.982796+0000","last_fullsized":"2024-09-12T12:18:31.982796+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:37.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985485+0000","last_change":"2024-09-12T12:18:31.023014+0000","last_active":"2024-09-12T12:18:31.985485+0000","last_peered":"2024-09-12T12:18:31.985485+0000","last_clean":"2024-09-12T12:18:31.985485+0000","last_became_active":"2024-09-12T12:18:31.022390+0000","last_became_peered":"2024-09-12T12:18:31.022390+0000","last_unstale":"2024-09-12T12:18:31.985485+0000","last_undegraded":"2024-09-12T12:18:31.985485+0000","last_fullsized":"2024-09-12T12:18:31.985485+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:18.788091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985039+0000","last_change":"2024-09-12T12:18:29.994687+0000","last_active":"2024-09-12T12:18:31.985039+0000","last_peered":"2024-09-12T12:18:31.985039+0000","last_clean":"2024-09-12T12:18:31.985039+0000","last_became_active":"2024-09-12T12:18:29.994184+0000","last_became_peered":"2024-09-12T12:18:29.994184+0000","last_unstale":"2024-09-12T12:18:31.985039+0000","last_undegraded":"2024-09-12T12:18:31.985039+0000","last_fullsized":"2024-09-12T12:18:31.985039+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:25.399072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.990945+0000","last_change":"2024-09-12T12:18:31.012991+0000","last_active":"2024-09-12T12:18:32.990945+0000","last_peered":"2024-09-12T12:18:32.990945+0000","last_clean":"2024-09-12T12:18:32.990945+0000","last_became_active":"2024-09-12T12:18:31.012734+0000","last_became_peered":"2024-09-12T12:18:31.012734+0000","last_unstale":"2024-09-12T12:18:32.990945+0000","last_undegraded":"2024-09-12T12:18:32.990945+0000","last_fullsized":"2024-09-12T12:18:32.990945+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:53.393077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156782+0000","last_change":"2024-09-12T12:18:30.001059+0000","last_active":"2024-09-12T12:18:34.156782+0000","last_peered":"2024-09-12T12:18:34.156782+0000","last_clean":"2024-09-12T12:18:34.156782+0000","last_became_active":"2024-09-12T12:18:30.000719+0000","last_became_peered":"2024-09-12T12:18:30.000719+0000","last_unstale":"2024-09-12T12:18:34.156782+0000","last_undegraded":"2024-09-12T12:18:34.156782+0000","last_fullsized":"2024-09-12T12:18:34.156782+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:59.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982611+0000","last_change":"2024-09-12T12:18:31.007659+0000","last_active":"2024-09-12T12:18:31.982611+0000","last_peered":"2024-09-12T12:18:31.982611+0000","last_clean":"2024-09-12T12:18:31.982611+0000","last_became_active":"2024-09-12T12:18:31.004555+0000","last_became_peered":"2024-09-12T12:18:31.004555+0000","last_unstale":"2024-09-12T12:18:31.982611+0000","last_undegraded":"2024-09-12T12:18:31.982611+0000","last_fullsized":"2024-09-12T12:18:31.982611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:58.439510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"114'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991311+0000","last_change":"2024-09-12T12:18:29.993114+0000","last_active":"2024-09-12T12:18:32.991311+0000","last_peered":"2024-09-12T12:18:32.991311+0000","last_clean":"2024-09-12T12:18:32.991311+0000","last_became_active":"2024-09-12T12:18:29.992820+0000","last_became_peered":"2024-09-12T12:18:29.992820+0000","last_unstale":"2024-09-12T12:18:32.991311+0000","last_undegraded":"2024-09-12T12:18:32.991311+0000","last_fullsized":"2024-09-12T12:18:32.991311+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.193710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177763+0000","last_change":"2024-09-12T12:18:31.000639+0000","last_active":"2024-09-12T12:18:32.177763+0000","last_peered":"2024-09-12T12:18:32.177763+0000","last_clean":"2024-09-12T12:18:32.177763+0000","last_became_active":"2024-09-12T12:18:31.000332+0000","last_became_peered":"2024-09-12T12:18:31.000332+0000","last_unstale":"2024-09-12T12:18:32.177763+0000","last_undegraded":"2024-09-12T12:18:32.177763+0000","last_fullsized":"2024-09-12T12:18:32.177763+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:19.466064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983536+0000","last_change":"2024-09-12T12:18:29.992814+0000","last_active":"2024-09-12T12:18:31.983536+0000","last_peered":"2024-09-12T12:18:31.983536+0000","last_clean":"2024-09-12T12:18:31.983536+0000","last_became_active":"2024-09-12T12:18:29.992541+0000","last_became_peered":"2024-09-12T12:18:29.992541+0000","last_unstale":"2024-09-12T12:18:31.983536+0000","last_undegraded":"2024-09-12T12:18:31.983536+0000","last_fullsized":"2024-09-12T12:18:31.983536+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:48.178163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.320809+0000","last_change":"2024-09-12T12:18:31.021882+0000","last_active":"2024-09-12T12:18:32.320809+0000","last_peered":"2024-09-12T12:18:32.320809+0000","last_clean":"2024-09-12T12:18:32.320809+0000","last_became_active":"2024-09-12T12:18:31.021622+0000","last_became_peered":"2024-09-12T12:18:31.021622+0000","last_unstale":"2024-09-12T12:18:32.320809+0000","last_undegraded":"2024-09-12T12:18:32.320809+0000","last_fullsized":"2024-09-12T12:18:32.320809+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156872+0000","last_change":"2024-09-12T12:18:30.000976+0000","last_active":"2024-09-12T12:18:34.156872+0000","last_peered":"2024-09-12T12:18:34.156872+0000","last_clean":"2024-09-12T12:18:34.156872+0000","last_became_active":"2024-09-12T12:18:30.000647+0000","last_became_peered":"2024-09-12T12:18:30.000647+0000","last_unstale":"2024-09-12T12:18:34.156872+0000","last_undegraded":"2024-09-12T12:18:34.156872+0000","last_fullsized":"2024-09-12T12:18:34.156872+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:06.037389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985398+0000","last_change":"2024-09-12T12:18:31.009029+0000","last_active":"2024-09-12T12:18:31.985398+0000","last_peered":"2024-09-12T12:18:31.985398+0000","last_clean":"2024-09-12T12:18:31.985398+0000","last_became_active":"2024-09-12T12:18:31.008713+0000","last_became_peered":"2024-09-12T12:18:31.008713+0000","last_unstale":"2024-09-12T12:18:31.985398+0000","last_undegraded":"2024-09-12T12:18:31.985398+0000","last_fullsized":"2024-09-12T12:18:31.985398+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:48.869837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982773+0000","last_change":"2024-09-12T12:18:29.996111+0000","last_active":"2024-09-12T12:18:31.982773+0000","last_peered":"2024-09-12T12:18:31.982773+0000","last_clean":"2024-09-12T12:18:31.982773+0000","last_became_active":"2024-09-12T12:18:29.995305+0000","last_became_peered":"2024-09-12T12:18:29.995305+0000","last_unstale":"2024-09-12T12:18:31.982773+0000","last_undegraded":"2024-09-12T12:18:31.982773+0000","last_fullsized":"2024-09-12T12:18:31.982773+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:53.802825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985095+0000","last_change":"2024-09-12T12:18:31.007460+0000","last_active":"2024-09-12T12:18:31.985095+0000","last_peered":"2024-09-12T12:18:31.985095+0000","last_clean":"2024-09-12T12:18:31.985095+0000","last_became_active":"2024-09-12T12:18:31.007188+0000","last_became_peered":"2024-09-12T12:18:31.007188+0000","last_unstale":"2024-09-12T12:18:31.985095+0000","last_undegraded":"2024-09-12T12:18:31.985095+0000","last_fullsized":"2024-09-12T12:18:31.985095+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:46.783083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984874+0000","last_change":"2024-09-12T12:18:29.999200+0000","last_active":"2024-09-12T12:18:31.984874+0000","last_peered":"2024-09-12T12:18:31.984874+0000","last_clean":"2024-09-12T12:18:31.984874+0000","last_became_active":"2024-09-12T12:18:29.997674+0000","last_became_peered":"2024-09-12T12:18:29.997674+0000","last_unstale":"2024-09-12T12:18:31.984874+0000","last_undegraded":"2024-09-12T12:18:31.984874+0000","last_fullsized":"2024-09-12T12:18:31.984874+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:45:21.474245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155733+0000","last_change":"2024-09-12T12:18:31.002573+0000","last_active":"2024-09-12T12:18:34.155733+0000","last_peered":"2024-09-12T12:18:34.155733+0000","last_clean":"2024-09-12T12:18:34.155733+0000","last_became_active":"2024-09-12T12:18:31.002128+0000","last_became_peered":"2024-09-12T12:18:31.002128+0000","last_unstale":"2024-09-12T12:18:34.155733+0000","last_undegraded":"2024-09-12T12:18:34.155733+0000","last_fullsized":"2024-09-12T12:18:34.155733+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:28.015565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982898+0000","last_change":"2024-09-12T12:18:29.992678+0000","last_active":"2024-09-12T12:18:31.982898+0000","last_peered":"2024-09-12T12:18:31.982898+0000","last_clean":"2024-09-12T12:18:31.982898+0000","last_became_active":"2024-09-12T12:18:29.992401+0000","last_became_peered":"2024-09-12T12:18:29.992401+0000","last_unstale":"2024-09-12T12:18:31.982898+0000","last_undegraded":"2024-09-12T12:18:31.982898+0000","last_fullsized":"2024-09-12T12:18:31.982898+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:53.802825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321090+0000","last_change":"2024-09-12T12:18:31.010618+0000","last_active":"2024-09-12T12:18:32.321090+0000","last_peered":"2024-09-12T12:18:32.321090+0000","last_clean":"2024-09-12T12:18:32.321090+0000","last_became_active":"2024-09-12T12:18:31.010337+0000","last_became_peered":"2024-09-12T12:18:31.010337+0000","last_unstale":"2024-09-12T12:18:32.321090+0000","last_undegraded":"2024-09-12T12:18:32.321090+0000","last_fullsized":"2024-09-12T12:18:32.321090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:30.522076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985144+0000","last_change":"2024-09-12T12:18:29.994453+0000","last_active":"2024-09-12T12:18:31.985144+0000","last_peered":"2024-09-12T12:18:31.985144+0000","last_clean":"2024-09-12T12:18:31.985144+0000","last_became_active":"2024-09-12T12:18:29.993835+0000","last_became_peered":"2024-09-12T12:18:29.993835+0000","last_unstale":"2024-09-12T12:18:31.985144+0000","last_undegraded":"2024-09-12T12:18:31.985144+0000","last_fullsized":"2024-09-12T12:18:31.985144+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:17.387339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.320806+0000","last_change":"2024-09-12T12:18:31.015130+0000","last_active":"2024-09-12T12:18:32.320806+0000","last_peered":"2024-09-12T12:18:32.320806+0000","last_clean":"2024-09-12T12:18:32.320806+0000","last_became_active":"2024-09-12T12:18:31.014751+0000","last_became_peered":"2024-09-12T12:18:31.014751+0000","last_unstale":"2024-09-12T12:18:32.320806+0000","last_undegraded":"2024-09-12T12:18:32.320806+0000","last_fullsized":"2024-09-12T12:18:32.320806+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:12.661477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985355+0000","last_change":"2024-09-12T12:18:30.001155+0000","last_active":"2024-09-12T12:18:31.985355+0000","last_peered":"2024-09-12T12:18:31.985355+0000","last_clean":"2024-09-12T12:18:31.985355+0000","last_became_active":"2024-09-12T12:18:30.000465+0000","last_became_peered":"2024-09-12T12:18:30.000465+0000","last_unstale":"2024-09-12T12:18:31.985355+0000","last_undegraded":"2024-09-12T12:18:31.985355+0000","last_fullsized":"2024-09-12T12:18:31.985355+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:47.810731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":339,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155262+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:18:34.155262+0000","last_peered":"2024-09-12T12:18:34.155262+0000","last_clean":"2024-09-12T12:18:34.155262+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:18:34.155262+0000","last_undegraded":"2024-09-12T12:18:34.155262+0000","last_fullsized":"2024-09-12T12:18:34.155262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37308,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334532,"statfs":{"total":96636764160,"available":96598560768,"internally_reserved":0,"allocated":2002944,"data_stored":1247635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36748,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":1433600,"data_stored":666015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":1413120,"data_stored":663799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40896,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330944,"statfs":{"total":96636764160,"available":96594886656,"internally_reserved":0,"allocated":1421312,"data_stored":663891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40892,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330948,"statfs":{"total":96636764160,"available":96594890752,"internally_reserved":0,"allocated":1417216,"data_stored":664381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1417216,"data_stored":663833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":1404928,"data_stored":657141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41484,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330356,"statfs":{"total":96636764160,"available":96594284544,"internally_reserved":0,"allocated":2023424,"data_stored":1255869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:18:39.625 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:18:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4fe00640 1 Processor -- start 2024-09-12T12:18:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4fe00640 1 -- start start 2024-09-12T12:18:39.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4c4815b4e0 0x7f4c480b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:39.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c480b3ad0 0x7f4c48071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:39.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4c48071960 0x7f4c480ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:39.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4c480b45a0 con 0x7f4c48071960 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4c480b3fe0 con 0x7f4c4815b4e0 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c480b42c0 con 0x7f4c480b3ad0 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4c48071960 0x7f4c480ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4c48071960 0x7f4c480ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43400/0 (socket says 172.21.15.144:43400) 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4de00640 1 -- 172.21.15.144:0/216077176 learned_addr learned my addr 172.21.15.144:0/216077176 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4d400640 1 --2- 172.21.15.144:0/216077176 >> v2:172.21.15.165:3300/0 conn(0x7f4c4815b4e0 0x7f4c480b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4ca00640 1 --2- 172.21.15.144:0/216077176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c480b3ad0 0x7f4c48071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4de00640 1 -- 172.21.15.144:0/216077176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c480b3ad0 msgr2=0x7f4c48071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4de00640 1 --2- 172.21.15.144:0/216077176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c480b3ad0 0x7f4c48071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4de00640 1 -- 172.21.15.144:0/216077176 >> v2:172.21.15.165:3300/0 conn(0x7f4c4815b4e0 msgr2=0x7f4c480b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4de00640 1 --2- 172.21.15.144:0/216077176 >> v2:172.21.15.165:3300/0 conn(0x7f4c4815b4e0 0x7f4c480b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4de00640 1 -- 172.21.15.144:0/216077176 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c480b1490 con 0x7f4c48071960 2024-09-12T12:18:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.773+0000 7f4c4d400640 1 --2- 172.21.15.144:0/216077176 >> v2:172.21.15.165:3300/0 conn(0x7f4c4815b4e0 0x7f4c480b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:39.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4de00640 1 --2- 172.21.15.144:0/216077176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c48071960 0x7f4c480ccf30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f4c48069450 tx=0x7f4c4001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d073c2a17e289cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:39.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c47e00640 1 -- 172.21.15.144:0/216077176 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c400a5750 con 0x7f4c48071960 2024-09-12T12:18:39.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c47e00640 1 -- 172.21.15.144:0/216077176 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c400a58f0 con 0x7f4c48071960 2024-09-12T12:18:39.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c47e00640 1 -- 172.21.15.144:0/216077176 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c400a5cc0 con 0x7f4c48071960 2024-09-12T12:18:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4fe00640 1 -- 172.21.15.144:0/216077176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c48071960 msgr2=0x7f4c480ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/216077176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c48071960 0x7f4c480ccf30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f4c48069450 tx=0x7f4c4001c9c0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4fe00640 1 -- 172.21.15.144:0/216077176 shutdown_connections 2024-09-12T12:18:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/216077176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c48071960 0x7f4c480ccf30 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/216077176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c480b3ad0 0x7f4c48071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/216077176 >> v2:172.21.15.165:3300/0 conn(0x7f4c4815b4e0 0x7f4c480b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4fe00640 1 -- 172.21.15.144:0/216077176 >> 172.21.15.144:0/216077176 conn(0x7f4c4806d0d0 msgr2=0x7f4c4806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4fe00640 1 -- 172.21.15.144:0/216077176 shutdown_connections 2024-09-12T12:18:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.777+0000 7f4c4fe00640 1 -- 172.21.15.144:0/216077176 wait complete. 2024-09-12T12:18:39.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 Processor -- start 2024-09-12T12:18:39.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 -- start start 2024-09-12T12:18:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c48071960 0x7f4c48155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c480b3ad0 0x7f4c481fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c4815b4e0 0x7f4c48157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4815f270 con 0x7f4c480b3ad0 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4815f0f0 con 0x7f4c4815b4e0 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4815f3f0 con 0x7f4c48071960 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c480b3ad0 0x7f4c481fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c480b3ad0 0x7f4c481fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43414/0 (socket says 172.21.15.144:43414) 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4ca00640 1 -- 172.21.15.144:0/3461740197 learned_addr learned my addr 172.21.15.144:0/3461740197 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4d400640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c48071960 0x7f4c48155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4de00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c4815b4e0 0x7f4c48157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4ca00640 1 -- 172.21.15.144:0/3461740197 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c48071960 msgr2=0x7f4c48155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4ca00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c48071960 0x7f4c48155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4ca00640 1 -- 172.21.15.144:0/3461740197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c4815b4e0 msgr2=0x7f4c48157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4ca00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c4815b4e0 0x7f4c48157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4ca00640 1 -- 172.21.15.144:0/3461740197 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c481fc020 con 0x7f4c480b3ad0 2024-09-12T12:18:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4de00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c4815b4e0 0x7f4c48157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4ca00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c480b3ad0 0x7f4c481fbae0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400d7d0 tx=0x7f4c3400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c45600640 1 -- 172.21.15.144:0/3461740197 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34018030 con 0x7f4c480b3ad0 2024-09-12T12:18:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c45600640 1 -- 172.21.15.144:0/3461740197 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c34004020 con 0x7f4c480b3ad0 2024-09-12T12:18:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4815d300 con 0x7f4c480b3ad0 2024-09-12T12:18:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c45600640 1 -- 172.21.15.144:0/3461740197 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34004210 con 0x7f4c480b3ad0 2024-09-12T12:18:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c48159360 con 0x7f4c480b3ad0 2024-09-12T12:18:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.781+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c48071420 con 0x7f4c480b3ad0 2024-09-12T12:18:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.785+0000 7f4c45600640 1 -- 172.21.15.144:0/3461740197 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c3401b070 con 0x7f4c480b3ad0 2024-09-12T12:18:39.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.785+0000 7f4c45600640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4c280678f0 0x7f4c28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:39.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.785+0000 7f4c45600640 1 -- 172.21.15.144:0/3461740197 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f4c34085f30 con 0x7f4c480b3ad0 2024-09-12T12:18:39.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.785+0000 7f4c4d400640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4c280678f0 0x7f4c28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:39.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.785+0000 7f4c4d400640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4c280678f0 0x7f4c28069db0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c006e90 tx=0x7f4c3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:39.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.789+0000 7f4c45600640 1 -- 172.21.15.144:0/3461740197 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4c481fc020 con 0x7f4c480b3ad0 2024-09-12T12:18:39.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.941+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c48155800 con 0x7f4c280678f0 2024-09-12T12:18:39.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.949+0000 7f4c45600640 1 -- 172.21.15.144:0/3461740197 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252486 (secure 0 0 0) 0x7f4c48155800 con 0x7f4c280678f0 2024-09-12T12:18:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:39.953 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:18:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4c280678f0 msgr2=0x7f4c28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4c280678f0 0x7f4c28069db0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c006e90 tx=0x7f4c3c008040 comp rx=0 tx=0).stop 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c480b3ad0 msgr2=0x7f4c481fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c480b3ad0 0x7f4c481fbae0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400d7d0 tx=0x7f4c3400dc90 comp rx=0 tx=0).stop 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 shutdown_connections 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4c280678f0 0x7f4c28069db0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c4815b4e0 0x7f4c48157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c480b3ad0 0x7f4c481fbae0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 --2- 172.21.15.144:0/3461740197 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c48071960 0x7f4c48155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 >> 172.21.15.144:0/3461740197 conn(0x7f4c4806d0d0 msgr2=0x7f4c480af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 shutdown_connections 2024-09-12T12:18:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:39.953+0000 7f4c4fe00640 1 -- 172.21.15.144:0/3461740197 wait complete. 2024-09-12T12:18:39.972 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-12T12:18:39.450677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":307512,"kb_used_data":12240,"kb_used_omap":12,"kb_used_meta":295091,"kb_avail":754667208,"statfs":{"total":773094113280,"available":772779220992,"internally_reserved":0,"allocated":12533760,"data_stored":6482564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":302173745},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.471093"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991370+0000","last_change":"2024-09-12T12:18:31.022353+0000","last_active":"2024-09-12T12:18:32.991370+0000","last_peered":"2024-09-12T12:18:32.991370+0000","last_clean":"2024-09-12T12:18:32.991370+0000","last_became_active":"2024-09-12T12:18:31.022058+0000","last_became_peered":"2024-09-12T12:18:31.022058+0000","last_unstale":"2024-09-12T12:18:32.991370+0000","last_undegraded":"2024-09-12T12:18:32.991370+0000","last_fullsized":"2024-09-12T12:18:32.991370+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:01.414716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983873+0000","last_change":"2024-09-12T12:18:30.999317+0000","last_active":"2024-09-12T12:18:31.983873+0000","last_peered":"2024-09-12T12:18:31.983873+0000","last_clean":"2024-09-12T12:18:31.983873+0000","last_became_active":"2024-09-12T12:18:30.999035+0000","last_became_peered":"2024-09-12T12:18:30.999035+0000","last_unstale":"2024-09-12T12:18:31.983873+0000","last_undegraded":"2024-09-12T12:18:31.983873+0000","last_fullsized":"2024-09-12T12:18:31.983873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:18.792493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991052+0000","last_change":"2024-09-12T12:18:31.019928+0000","last_active":"2024-09-12T12:18:32.991052+0000","last_peered":"2024-09-12T12:18:32.991052+0000","last_clean":"2024-09-12T12:18:32.991052+0000","last_became_active":"2024-09-12T12:18:31.019253+0000","last_became_peered":"2024-09-12T12:18:31.019253+0000","last_unstale":"2024-09-12T12:18:32.991052+0000","last_undegraded":"2024-09-12T12:18:32.991052+0000","last_fullsized":"2024-09-12T12:18:32.991052+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:43.702735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177829+0000","last_change":"2024-09-12T12:18:31.000255+0000","last_active":"2024-09-12T12:18:32.177829+0000","last_peered":"2024-09-12T12:18:32.177829+0000","last_clean":"2024-09-12T12:18:32.177829+0000","last_became_active":"2024-09-12T12:18:31.000007+0000","last_became_peered":"2024-09-12T12:18:31.000007+0000","last_unstale":"2024-09-12T12:18:32.177829+0000","last_undegraded":"2024-09-12T12:18:32.177829+0000","last_fullsized":"2024-09-12T12:18:32.177829+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:44:12.244392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156843+0000","last_change":"2024-09-12T12:18:31.005063+0000","last_active":"2024-09-12T12:18:34.156843+0000","last_peered":"2024-09-12T12:18:34.156843+0000","last_clean":"2024-09-12T12:18:34.156843+0000","last_became_active":"2024-09-12T12:18:31.004659+0000","last_became_peered":"2024-09-12T12:18:31.004659+0000","last_unstale":"2024-09-12T12:18:34.156843+0000","last_undegraded":"2024-09-12T12:18:34.156843+0000","last_fullsized":"2024-09-12T12:18:34.156843+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982999+0000","last_change":"2024-09-12T12:18:31.018372+0000","last_active":"2024-09-12T12:18:31.982999+0000","last_peered":"2024-09-12T12:18:31.982999+0000","last_clean":"2024-09-12T12:18:31.982999+0000","last_became_active":"2024-09-12T12:18:31.018047+0000","last_became_peered":"2024-09-12T12:18:31.018047+0000","last_unstale":"2024-09-12T12:18:31.982999+0000","last_undegraded":"2024-09-12T12:18:31.982999+0000","last_fullsized":"2024-09-12T12:18:31.982999+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983133+0000","last_change":"2024-09-12T12:18:31.021695+0000","last_active":"2024-09-12T12:18:31.983133+0000","last_peered":"2024-09-12T12:18:31.983133+0000","last_clean":"2024-09-12T12:18:31.983133+0000","last_became_active":"2024-09-12T12:18:31.021390+0000","last_became_peered":"2024-09-12T12:18:31.021390+0000","last_unstale":"2024-09-12T12:18:31.983133+0000","last_undegraded":"2024-09-12T12:18:31.983133+0000","last_fullsized":"2024-09-12T12:18:31.983133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984817+0000","last_change":"2024-09-12T12:18:31.022124+0000","last_active":"2024-09-12T12:18:31.984817+0000","last_peered":"2024-09-12T12:18:31.984817+0000","last_clean":"2024-09-12T12:18:31.984817+0000","last_became_active":"2024-09-12T12:18:31.021796+0000","last_became_peered":"2024-09-12T12:18:31.021796+0000","last_unstale":"2024-09-12T12:18:31.984817+0000","last_undegraded":"2024-09-12T12:18:31.984817+0000","last_fullsized":"2024-09-12T12:18:31.984817+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:53:07.529758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983686+0000","last_change":"2024-09-12T12:18:31.003510+0000","last_active":"2024-09-12T12:18:31.983686+0000","last_peered":"2024-09-12T12:18:31.983686+0000","last_clean":"2024-09-12T12:18:31.983686+0000","last_became_active":"2024-09-12T12:18:31.001374+0000","last_became_peered":"2024-09-12T12:18:31.001374+0000","last_unstale":"2024-09-12T12:18:31.983686+0000","last_undegraded":"2024-09-12T12:18:31.983686+0000","last_fullsized":"2024-09-12T12:18:31.983686+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:04.505957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156897+0000","last_change":"2024-09-12T12:18:31.017067+0000","last_active":"2024-09-12T12:18:34.156897+0000","last_peered":"2024-09-12T12:18:34.156897+0000","last_clean":"2024-09-12T12:18:34.156897+0000","last_became_active":"2024-09-12T12:18:31.016562+0000","last_became_peered":"2024-09-12T12:18:31.016562+0000","last_unstale":"2024-09-12T12:18:34.156897+0000","last_undegraded":"2024-09-12T12:18:34.156897+0000","last_fullsized":"2024-09-12T12:18:34.156897+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321017+0000","last_change":"2024-09-12T12:18:30.996847+0000","last_active":"2024-09-12T12:18:32.321017+0000","last_peered":"2024-09-12T12:18:32.321017+0000","last_clean":"2024-09-12T12:18:32.321017+0000","last_became_active":"2024-09-12T12:18:30.995784+0000","last_became_peered":"2024-09-12T12:18:30.995784+0000","last_unstale":"2024-09-12T12:18:32.321017+0000","last_undegraded":"2024-09-12T12:18:32.321017+0000","last_fullsized":"2024-09-12T12:18:32.321017+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983341+0000","last_change":"2024-09-12T12:18:31.009670+0000","last_active":"2024-09-12T12:18:31.983341+0000","last_peered":"2024-09-12T12:18:31.983341+0000","last_clean":"2024-09-12T12:18:31.983341+0000","last_became_active":"2024-09-12T12:18:31.007942+0000","last_became_peered":"2024-09-12T12:18:31.007942+0000","last_unstale":"2024-09-12T12:18:31.983341+0000","last_undegraded":"2024-09-12T12:18:31.983341+0000","last_fullsized":"2024-09-12T12:18:31.983341+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:01.366180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177773+0000","last_change":"2024-09-12T12:18:30.997142+0000","last_active":"2024-09-12T12:18:32.177773+0000","last_peered":"2024-09-12T12:18:32.177773+0000","last_clean":"2024-09-12T12:18:32.177773+0000","last_became_active":"2024-09-12T12:18:30.996830+0000","last_became_peered":"2024-09-12T12:18:30.996830+0000","last_unstale":"2024-09-12T12:18:32.177773+0000","last_undegraded":"2024-09-12T12:18:32.177773+0000","last_fullsized":"2024-09-12T12:18:32.177773+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:59.048601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155675+0000","last_change":"2024-09-12T12:18:31.004760+0000","last_active":"2024-09-12T12:18:34.155675+0000","last_peered":"2024-09-12T12:18:34.155675+0000","last_clean":"2024-09-12T12:18:34.155675+0000","last_became_active":"2024-09-12T12:18:31.004480+0000","last_became_peered":"2024-09-12T12:18:31.004480+0000","last_unstale":"2024-09-12T12:18:34.155675+0000","last_undegraded":"2024-09-12T12:18:34.155675+0000","last_fullsized":"2024-09-12T12:18:34.155675+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:52.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155425+0000","last_change":"2024-09-12T12:18:31.002415+0000","last_active":"2024-09-12T12:18:34.155425+0000","last_peered":"2024-09-12T12:18:34.155425+0000","last_clean":"2024-09-12T12:18:34.155425+0000","last_became_active":"2024-09-12T12:18:31.001992+0000","last_became_peered":"2024-09-12T12:18:31.001992+0000","last_unstale":"2024-09-12T12:18:34.155425+0000","last_undegraded":"2024-09-12T12:18:34.155425+0000","last_fullsized":"2024-09-12T12:18:34.155425+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:04.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155428+0000","last_change":"2024-09-12T12:18:31.006561+0000","last_active":"2024-09-12T12:18:34.155428+0000","last_peered":"2024-09-12T12:18:34.155428+0000","last_clean":"2024-09-12T12:18:34.155428+0000","last_became_active":"2024-09-12T12:18:31.006288+0000","last_became_peered":"2024-09-12T12:18:31.006288+0000","last_unstale":"2024-09-12T12:18:34.155428+0000","last_undegraded":"2024-09-12T12:18:34.155428+0000","last_fullsized":"2024-09-12T12:18:34.155428+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:18.792493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991485+0000","last_change":"2024-09-12T12:18:31.021654+0000","last_active":"2024-09-12T12:18:32.991485+0000","last_peered":"2024-09-12T12:18:32.991485+0000","last_clean":"2024-09-12T12:18:32.991485+0000","last_became_active":"2024-09-12T12:18:31.021353+0000","last_became_peered":"2024-09-12T12:18:31.021353+0000","last_unstale":"2024-09-12T12:18:32.991485+0000","last_undegraded":"2024-09-12T12:18:32.991485+0000","last_fullsized":"2024-09-12T12:18:32.991485+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:36.388916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983911+0000","last_change":"2024-09-12T12:18:31.018503+0000","last_active":"2024-09-12T12:18:31.983911+0000","last_peered":"2024-09-12T12:18:31.983911+0000","last_clean":"2024-09-12T12:18:31.983911+0000","last_became_active":"2024-09-12T12:18:31.018238+0000","last_became_peered":"2024-09-12T12:18:31.018238+0000","last_unstale":"2024-09-12T12:18:31.983911+0000","last_undegraded":"2024-09-12T12:18:31.983911+0000","last_fullsized":"2024-09-12T12:18:31.983911+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:52.120621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991108+0000","last_change":"2024-09-12T12:18:31.019533+0000","last_active":"2024-09-12T12:18:32.991108+0000","last_peered":"2024-09-12T12:18:32.991108+0000","last_clean":"2024-09-12T12:18:32.991108+0000","last_became_active":"2024-09-12T12:18:31.018656+0000","last_became_peered":"2024-09-12T12:18:31.018656+0000","last_unstale":"2024-09-12T12:18:32.991108+0000","last_undegraded":"2024-09-12T12:18:32.991108+0000","last_fullsized":"2024-09-12T12:18:32.991108+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:32.527059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983553+0000","last_change":"2024-09-12T12:18:31.003481+0000","last_active":"2024-09-12T12:18:31.983553+0000","last_peered":"2024-09-12T12:18:31.983553+0000","last_clean":"2024-09-12T12:18:31.983553+0000","last_became_active":"2024-09-12T12:18:31.003237+0000","last_became_peered":"2024-09-12T12:18:31.003237+0000","last_unstale":"2024-09-12T12:18:31.983553+0000","last_undegraded":"2024-09-12T12:18:31.983553+0000","last_fullsized":"2024-09-12T12:18:31.983553+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985262+0000","last_change":"2024-09-12T12:18:30.993956+0000","last_active":"2024-09-12T12:18:31.985262+0000","last_peered":"2024-09-12T12:18:31.985262+0000","last_clean":"2024-09-12T12:18:31.985262+0000","last_became_active":"2024-09-12T12:18:30.993616+0000","last_became_peered":"2024-09-12T12:18:30.993616+0000","last_unstale":"2024-09-12T12:18:31.985262+0000","last_undegraded":"2024-09-12T12:18:31.985262+0000","last_fullsized":"2024-09-12T12:18:31.985262+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:58.086086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156664+0000","last_change":"2024-09-12T12:18:31.004298+0000","last_active":"2024-09-12T12:18:34.156664+0000","last_peered":"2024-09-12T12:18:34.156664+0000","last_clean":"2024-09-12T12:18:34.156664+0000","last_became_active":"2024-09-12T12:18:31.004095+0000","last_became_peered":"2024-09-12T12:18:31.004095+0000","last_unstale":"2024-09-12T12:18:34.156664+0000","last_undegraded":"2024-09-12T12:18:34.156664+0000","last_fullsized":"2024-09-12T12:18:34.156664+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:12.661477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991076+0000","last_change":"2024-09-12T12:18:31.013190+0000","last_active":"2024-09-12T12:18:32.991076+0000","last_peered":"2024-09-12T12:18:32.991076+0000","last_clean":"2024-09-12T12:18:32.991076+0000","last_became_active":"2024-09-12T12:18:31.012520+0000","last_became_peered":"2024-09-12T12:18:31.012520+0000","last_unstale":"2024-09-12T12:18:32.991076+0000","last_undegraded":"2024-09-12T12:18:32.991076+0000","last_fullsized":"2024-09-12T12:18:32.991076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:27.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156429+0000","last_change":"2024-09-12T12:18:31.025299+0000","last_active":"2024-09-12T12:18:34.156429+0000","last_peered":"2024-09-12T12:18:34.156429+0000","last_clean":"2024-09-12T12:18:34.156429+0000","last_became_active":"2024-09-12T12:18:31.025002+0000","last_became_peered":"2024-09-12T12:18:31.025002+0000","last_unstale":"2024-09-12T12:18:34.156429+0000","last_undegraded":"2024-09-12T12:18:34.156429+0000","last_fullsized":"2024-09-12T12:18:34.156429+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:58.439510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983365+0000","last_change":"2024-09-12T12:18:30.993055+0000","last_active":"2024-09-12T12:18:31.983365+0000","last_peered":"2024-09-12T12:18:31.983365+0000","last_clean":"2024-09-12T12:18:31.983365+0000","last_became_active":"2024-09-12T12:18:30.992726+0000","last_became_peered":"2024-09-12T12:18:30.992726+0000","last_unstale":"2024-09-12T12:18:31.983365+0000","last_undegraded":"2024-09-12T12:18:31.983365+0000","last_fullsized":"2024-09-12T12:18:31.983365+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983320+0000","last_change":"2024-09-12T12:18:30.991346+0000","last_active":"2024-09-12T12:18:31.983320+0000","last_peered":"2024-09-12T12:18:31.983320+0000","last_clean":"2024-09-12T12:18:31.983320+0000","last_became_active":"2024-09-12T12:18:30.990964+0000","last_became_peered":"2024-09-12T12:18:30.990964+0000","last_unstale":"2024-09-12T12:18:31.983320+0000","last_undegraded":"2024-09-12T12:18:31.983320+0000","last_fullsized":"2024-09-12T12:18:31.983320+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321122+0000","last_change":"2024-09-12T12:18:31.007290+0000","last_active":"2024-09-12T12:18:32.321122+0000","last_peered":"2024-09-12T12:18:32.321122+0000","last_clean":"2024-09-12T12:18:32.321122+0000","last_became_active":"2024-09-12T12:18:31.006757+0000","last_became_peered":"2024-09-12T12:18:31.006757+0000","last_unstale":"2024-09-12T12:18:32.321122+0000","last_undegraded":"2024-09-12T12:18:32.321122+0000","last_fullsized":"2024-09-12T12:18:32.321122+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:04.505957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983715+0000","last_change":"2024-09-12T12:18:30.994217+0000","last_active":"2024-09-12T12:18:31.983715+0000","last_peered":"2024-09-12T12:18:31.983715+0000","last_clean":"2024-09-12T12:18:31.983715+0000","last_became_active":"2024-09-12T12:18:30.994004+0000","last_became_peered":"2024-09-12T12:18:30.994004+0000","last_unstale":"2024-09-12T12:18:31.983715+0000","last_undegraded":"2024-09-12T12:18:31.983715+0000","last_fullsized":"2024-09-12T12:18:31.983715+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:04.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985451+0000","last_change":"2024-09-12T12:18:31.008589+0000","last_active":"2024-09-12T12:18:31.985451+0000","last_peered":"2024-09-12T12:18:31.985451+0000","last_clean":"2024-09-12T12:18:31.985451+0000","last_became_active":"2024-09-12T12:18:31.008317+0000","last_became_peered":"2024-09-12T12:18:31.008317+0000","last_unstale":"2024-09-12T12:18:31.985451+0000","last_undegraded":"2024-09-12T12:18:31.985451+0000","last_fullsized":"2024-09-12T12:18:31.985451+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:39:33.766056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982838+0000","last_change":"2024-09-12T12:18:30.989833+0000","last_active":"2024-09-12T12:18:31.982838+0000","last_peered":"2024-09-12T12:18:31.982838+0000","last_clean":"2024-09-12T12:18:31.982838+0000","last_became_active":"2024-09-12T12:18:30.989307+0000","last_became_peered":"2024-09-12T12:18:30.989307+0000","last_unstale":"2024-09-12T12:18:31.982838+0000","last_undegraded":"2024-09-12T12:18:31.982838+0000","last_fullsized":"2024-09-12T12:18:31.982838+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:45.214279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982741+0000","last_change":"2024-09-12T12:18:31.014262+0000","last_active":"2024-09-12T12:18:31.982741+0000","last_peered":"2024-09-12T12:18:31.982741+0000","last_clean":"2024-09-12T12:18:31.982741+0000","last_became_active":"2024-09-12T12:18:31.013931+0000","last_became_peered":"2024-09-12T12:18:31.013931+0000","last_unstale":"2024-09-12T12:18:31.982741+0000","last_undegraded":"2024-09-12T12:18:31.982741+0000","last_fullsized":"2024-09-12T12:18:31.982741+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984981+0000","last_change":"2024-09-12T12:18:30.987471+0000","last_active":"2024-09-12T12:18:31.984981+0000","last_peered":"2024-09-12T12:18:31.984981+0000","last_clean":"2024-09-12T12:18:31.984981+0000","last_became_active":"2024-09-12T12:18:30.987146+0000","last_became_peered":"2024-09-12T12:18:30.987146+0000","last_unstale":"2024-09-12T12:18:31.984981+0000","last_undegraded":"2024-09-12T12:18:31.984981+0000","last_fullsized":"2024-09-12T12:18:31.984981+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:52:32.928811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991149+0000","last_change":"2024-09-12T12:18:31.012380+0000","last_active":"2024-09-12T12:18:32.991149+0000","last_peered":"2024-09-12T12:18:32.991149+0000","last_clean":"2024-09-12T12:18:32.991149+0000","last_became_active":"2024-09-12T12:18:31.011284+0000","last_became_peered":"2024-09-12T12:18:31.011284+0000","last_unstale":"2024-09-12T12:18:32.991149+0000","last_undegraded":"2024-09-12T12:18:32.991149+0000","last_fullsized":"2024-09-12T12:18:32.991149+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:50.083315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"113'4","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177969+0000","last_change":"2024-09-12T12:18:29.999114+0000","last_active":"2024-09-12T12:18:32.177969+0000","last_peered":"2024-09-12T12:18:32.177969+0000","last_clean":"2024-09-12T12:18:32.177969+0000","last_became_active":"2024-09-12T12:18:29.998825+0000","last_became_peered":"2024-09-12T12:18:29.998825+0000","last_unstale":"2024-09-12T12:18:32.177969+0000","last_undegraded":"2024-09-12T12:18:32.177969+0000","last_fullsized":"2024-09-12T12:18:32.177969+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:40.296370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984934+0000","last_change":"2024-09-12T12:18:31.025587+0000","last_active":"2024-09-12T12:18:31.984934+0000","last_peered":"2024-09-12T12:18:31.984934+0000","last_clean":"2024-09-12T12:18:31.984934+0000","last_became_active":"2024-09-12T12:18:31.025327+0000","last_became_peered":"2024-09-12T12:18:31.025327+0000","last_unstale":"2024-09-12T12:18:31.984934+0000","last_undegraded":"2024-09-12T12:18:31.984934+0000","last_fullsized":"2024-09-12T12:18:31.984934+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:29.348172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985187+0000","last_change":"2024-09-12T12:18:30.001333+0000","last_active":"2024-09-12T12:18:31.985187+0000","last_peered":"2024-09-12T12:18:31.985187+0000","last_clean":"2024-09-12T12:18:31.985187+0000","last_became_active":"2024-09-12T12:18:30.000855+0000","last_became_peered":"2024-09-12T12:18:30.000855+0000","last_unstale":"2024-09-12T12:18:31.985187+0000","last_undegraded":"2024-09-12T12:18:31.985187+0000","last_fullsized":"2024-09-12T12:18:31.985187+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:23:26.984813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982980+0000","last_change":"2024-09-12T12:18:31.004310+0000","last_active":"2024-09-12T12:18:31.982980+0000","last_peered":"2024-09-12T12:18:31.982980+0000","last_clean":"2024-09-12T12:18:31.982980+0000","last_became_active":"2024-09-12T12:18:31.003973+0000","last_became_peered":"2024-09-12T12:18:31.003973+0000","last_unstale":"2024-09-12T12:18:31.982980+0000","last_undegraded":"2024-09-12T12:18:31.982980+0000","last_fullsized":"2024-09-12T12:18:31.982980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:12.661477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982972+0000","last_change":"2024-09-12T12:18:29.997014+0000","last_active":"2024-09-12T12:18:31.982972+0000","last_peered":"2024-09-12T12:18:31.982972+0000","last_clean":"2024-09-12T12:18:31.982972+0000","last_became_active":"2024-09-12T12:18:29.996677+0000","last_became_peered":"2024-09-12T12:18:29.996677+0000","last_unstale":"2024-09-12T12:18:31.982972+0000","last_undegraded":"2024-09-12T12:18:31.982972+0000","last_fullsized":"2024-09-12T12:18:31.982972+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:48.178163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321039+0000","last_change":"2024-09-12T12:18:30.993859+0000","last_active":"2024-09-12T12:18:32.321039+0000","last_peered":"2024-09-12T12:18:32.321039+0000","last_clean":"2024-09-12T12:18:32.321039+0000","last_became_active":"2024-09-12T12:18:30.993544+0000","last_became_peered":"2024-09-12T12:18:30.993544+0000","last_unstale":"2024-09-12T12:18:32.321039+0000","last_undegraded":"2024-09-12T12:18:32.321039+0000","last_fullsized":"2024-09-12T12:18:32.321039+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:04.962928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156863+0000","last_change":"2024-09-12T12:18:29.999312+0000","last_active":"2024-09-12T12:18:34.156863+0000","last_peered":"2024-09-12T12:18:34.156863+0000","last_clean":"2024-09-12T12:18:34.156863+0000","last_became_active":"2024-09-12T12:18:29.998546+0000","last_became_peered":"2024-09-12T12:18:29.998546+0000","last_unstale":"2024-09-12T12:18:34.156863+0000","last_undegraded":"2024-09-12T12:18:34.156863+0000","last_fullsized":"2024-09-12T12:18:34.156863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:12.704492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177915+0000","last_change":"2024-09-12T12:18:31.003545+0000","last_active":"2024-09-12T12:18:32.177915+0000","last_peered":"2024-09-12T12:18:32.177915+0000","last_clean":"2024-09-12T12:18:32.177915+0000","last_became_active":"2024-09-12T12:18:31.003272+0000","last_became_peered":"2024-09-12T12:18:31.003272+0000","last_unstale":"2024-09-12T12:18:32.177915+0000","last_undegraded":"2024-09-12T12:18:32.177915+0000","last_fullsized":"2024-09-12T12:18:32.177915+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:29.706475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155436+0000","last_change":"2024-09-12T12:18:29.997806+0000","last_active":"2024-09-12T12:18:34.155436+0000","last_peered":"2024-09-12T12:18:34.155436+0000","last_clean":"2024-09-12T12:18:34.155436+0000","last_became_active":"2024-09-12T12:18:29.997477+0000","last_became_peered":"2024-09-12T12:18:29.997477+0000","last_unstale":"2024-09-12T12:18:34.155436+0000","last_undegraded":"2024-09-12T12:18:34.155436+0000","last_fullsized":"2024-09-12T12:18:34.155436+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:11.658277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991359+0000","last_change":"2024-09-12T12:18:31.019734+0000","last_active":"2024-09-12T12:18:32.991359+0000","last_peered":"2024-09-12T12:18:32.991359+0000","last_clean":"2024-09-12T12:18:32.991359+0000","last_became_active":"2024-09-12T12:18:31.018922+0000","last_became_peered":"2024-09-12T12:18:31.018922+0000","last_unstale":"2024-09-12T12:18:32.991359+0000","last_undegraded":"2024-09-12T12:18:32.991359+0000","last_fullsized":"2024-09-12T12:18:32.991359+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:57.568596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.320691+0000","last_change":"2024-09-12T12:18:29.993845+0000","last_active":"2024-09-12T12:18:32.320691+0000","last_peered":"2024-09-12T12:18:32.320691+0000","last_clean":"2024-09-12T12:18:32.320691+0000","last_became_active":"2024-09-12T12:18:29.993573+0000","last_became_peered":"2024-09-12T12:18:29.993573+0000","last_unstale":"2024-09-12T12:18:32.320691+0000","last_undegraded":"2024-09-12T12:18:32.320691+0000","last_fullsized":"2024-09-12T12:18:32.320691+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:06.037389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984009+0000","last_change":"2024-09-12T12:18:30.998680+0000","last_active":"2024-09-12T12:18:31.984009+0000","last_peered":"2024-09-12T12:18:31.984009+0000","last_clean":"2024-09-12T12:18:31.984009+0000","last_became_active":"2024-09-12T12:18:30.998310+0000","last_became_peered":"2024-09-12T12:18:30.998310+0000","last_unstale":"2024-09-12T12:18:31.984009+0000","last_undegraded":"2024-09-12T12:18:31.984009+0000","last_fullsized":"2024-09-12T12:18:31.984009+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:28.015565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982671+0000","last_change":"2024-09-12T12:18:29.991649+0000","last_active":"2024-09-12T12:18:31.982671+0000","last_peered":"2024-09-12T12:18:31.982671+0000","last_clean":"2024-09-12T12:18:31.982671+0000","last_became_active":"2024-09-12T12:18:29.991371+0000","last_became_peered":"2024-09-12T12:18:29.991371+0000","last_unstale":"2024-09-12T12:18:31.982671+0000","last_undegraded":"2024-09-12T12:18:31.982671+0000","last_fullsized":"2024-09-12T12:18:31.982671+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:37.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.178024+0000","last_change":"2024-09-12T12:18:31.026155+0000","last_active":"2024-09-12T12:18:32.178024+0000","last_peered":"2024-09-12T12:18:32.178024+0000","last_clean":"2024-09-12T12:18:32.178024+0000","last_became_active":"2024-09-12T12:18:31.025872+0000","last_became_peered":"2024-09-12T12:18:31.025872+0000","last_unstale":"2024-09-12T12:18:32.178024+0000","last_undegraded":"2024-09-12T12:18:32.178024+0000","last_fullsized":"2024-09-12T12:18:32.178024+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:10.993892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177889+0000","last_change":"2024-09-12T12:18:29.991538+0000","last_active":"2024-09-12T12:18:32.177889+0000","last_peered":"2024-09-12T12:18:32.177889+0000","last_clean":"2024-09-12T12:18:32.177889+0000","last_became_active":"2024-09-12T12:18:29.991222+0000","last_became_peered":"2024-09-12T12:18:29.991222+0000","last_unstale":"2024-09-12T12:18:32.177889+0000","last_undegraded":"2024-09-12T12:18:32.177889+0000","last_fullsized":"2024-09-12T12:18:32.177889+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:54.006487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.990956+0000","last_change":"2024-09-12T12:18:31.012847+0000","last_active":"2024-09-12T12:18:32.990956+0000","last_peered":"2024-09-12T12:18:32.990956+0000","last_clean":"2024-09-12T12:18:32.990956+0000","last_became_active":"2024-09-12T12:18:31.012481+0000","last_became_peered":"2024-09-12T12:18:31.012481+0000","last_unstale":"2024-09-12T12:18:32.990956+0000","last_undegraded":"2024-09-12T12:18:32.990956+0000","last_fullsized":"2024-09-12T12:18:32.990956+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:20.096960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983388+0000","last_change":"2024-09-12T12:18:29.995711+0000","last_active":"2024-09-12T12:18:31.983388+0000","last_peered":"2024-09-12T12:18:31.983388+0000","last_clean":"2024-09-12T12:18:31.983388+0000","last_became_active":"2024-09-12T12:18:29.995371+0000","last_became_peered":"2024-09-12T12:18:29.995371+0000","last_unstale":"2024-09-12T12:18:31.983388+0000","last_undegraded":"2024-09-12T12:18:31.983388+0000","last_fullsized":"2024-09-12T12:18:31.983388+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:52.214565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156550+0000","last_change":"2024-09-12T12:18:31.019166+0000","last_active":"2024-09-12T12:18:34.156550+0000","last_peered":"2024-09-12T12:18:34.156550+0000","last_clean":"2024-09-12T12:18:34.156550+0000","last_became_active":"2024-09-12T12:18:31.018850+0000","last_became_peered":"2024-09-12T12:18:31.018850+0000","last_unstale":"2024-09-12T12:18:34.156550+0000","last_undegraded":"2024-09-12T12:18:34.156550+0000","last_fullsized":"2024-09-12T12:18:34.156550+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:45.214279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991228+0000","last_change":"2024-09-12T12:18:29.990292+0000","last_active":"2024-09-12T12:18:32.991228+0000","last_peered":"2024-09-12T12:18:32.991228+0000","last_clean":"2024-09-12T12:18:32.991228+0000","last_became_active":"2024-09-12T12:18:29.989785+0000","last_became_peered":"2024-09-12T12:18:29.989785+0000","last_unstale":"2024-09-12T12:18:32.991228+0000","last_undegraded":"2024-09-12T12:18:32.991228+0000","last_fullsized":"2024-09-12T12:18:32.991228+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:14.305898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984932+0000","last_change":"2024-09-12T12:18:31.021909+0000","last_active":"2024-09-12T12:18:31.984932+0000","last_peered":"2024-09-12T12:18:31.984932+0000","last_clean":"2024-09-12T12:18:31.984932+0000","last_became_active":"2024-09-12T12:18:31.021602+0000","last_became_peered":"2024-09-12T12:18:31.021602+0000","last_unstale":"2024-09-12T12:18:31.984932+0000","last_undegraded":"2024-09-12T12:18:31.984932+0000","last_fullsized":"2024-09-12T12:18:31.984932+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:45.938897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"113'3","reported_seq":17,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155382+0000","last_change":"2024-09-12T12:18:29.998684+0000","last_active":"2024-09-12T12:18:34.155382+0000","last_peered":"2024-09-12T12:18:34.155382+0000","last_clean":"2024-09-12T12:18:34.155382+0000","last_became_active":"2024-09-12T12:18:29.998433+0000","last_became_peered":"2024-09-12T12:18:29.998433+0000","last_unstale":"2024-09-12T12:18:34.155382+0000","last_undegraded":"2024-09-12T12:18:34.155382+0000","last_fullsized":"2024-09-12T12:18:34.155382+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:00.362980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156949+0000","last_change":"2024-09-12T12:18:31.003572+0000","last_active":"2024-09-12T12:18:34.156949+0000","last_peered":"2024-09-12T12:18:34.156949+0000","last_clean":"2024-09-12T12:18:34.156949+0000","last_became_active":"2024-09-12T12:18:31.003183+0000","last_became_peered":"2024-09-12T12:18:31.003183+0000","last_unstale":"2024-09-12T12:18:34.156949+0000","last_undegraded":"2024-09-12T12:18:34.156949+0000","last_fullsized":"2024-09-12T12:18:34.156949+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"113'6","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983670+0000","last_change":"2024-09-12T12:18:29.991827+0000","last_active":"2024-09-12T12:18:31.983670+0000","last_peered":"2024-09-12T12:18:31.983670+0000","last_clean":"2024-09-12T12:18:31.983670+0000","last_became_active":"2024-09-12T12:18:29.991527+0000","last_became_peered":"2024-09-12T12:18:29.991527+0000","last_unstale":"2024-09-12T12:18:31.983670+0000","last_undegraded":"2024-09-12T12:18:31.983670+0000","last_fullsized":"2024-09-12T12:18:31.983670+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:52.214565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321084+0000","last_change":"2024-09-12T12:18:31.017369+0000","last_active":"2024-09-12T12:18:32.321084+0000","last_peered":"2024-09-12T12:18:32.321084+0000","last_clean":"2024-09-12T12:18:32.321084+0000","last_became_active":"2024-09-12T12:18:31.017182+0000","last_became_peered":"2024-09-12T12:18:31.017182+0000","last_unstale":"2024-09-12T12:18:32.321084+0000","last_undegraded":"2024-09-12T12:18:32.321084+0000","last_fullsized":"2024-09-12T12:18:32.321084+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156904+0000","last_change":"2024-09-12T12:18:30.001028+0000","last_active":"2024-09-12T12:18:34.156904+0000","last_peered":"2024-09-12T12:18:34.156904+0000","last_clean":"2024-09-12T12:18:34.156904+0000","last_became_active":"2024-09-12T12:18:30.000737+0000","last_became_peered":"2024-09-12T12:18:30.000737+0000","last_unstale":"2024-09-12T12:18:34.156904+0000","last_undegraded":"2024-09-12T12:18:34.156904+0000","last_fullsized":"2024-09-12T12:18:34.156904+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:44:52.214565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983623+0000","last_change":"2024-09-12T12:18:31.000693+0000","last_active":"2024-09-12T12:18:31.983623+0000","last_peered":"2024-09-12T12:18:31.983623+0000","last_clean":"2024-09-12T12:18:31.983623+0000","last_became_active":"2024-09-12T12:18:31.000423+0000","last_became_peered":"2024-09-12T12:18:31.000423+0000","last_unstale":"2024-09-12T12:18:31.983623+0000","last_undegraded":"2024-09-12T12:18:31.983623+0000","last_fullsized":"2024-09-12T12:18:31.983623+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:30.522076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177687+0000","last_change":"2024-09-12T12:18:29.990655+0000","last_active":"2024-09-12T12:18:32.177687+0000","last_peered":"2024-09-12T12:18:32.177687+0000","last_clean":"2024-09-12T12:18:32.177687+0000","last_became_active":"2024-09-12T12:18:29.990282+0000","last_became_peered":"2024-09-12T12:18:29.990282+0000","last_unstale":"2024-09-12T12:18:32.177687+0000","last_undegraded":"2024-09-12T12:18:32.177687+0000","last_fullsized":"2024-09-12T12:18:32.177687+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:07.785310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985100+0000","last_change":"2024-09-12T12:18:30.993660+0000","last_active":"2024-09-12T12:18:31.985100+0000","last_peered":"2024-09-12T12:18:31.985100+0000","last_clean":"2024-09-12T12:18:31.985100+0000","last_became_active":"2024-09-12T12:18:30.993345+0000","last_became_peered":"2024-09-12T12:18:30.993345+0000","last_unstale":"2024-09-12T12:18:31.985100+0000","last_undegraded":"2024-09-12T12:18:31.985100+0000","last_fullsized":"2024-09-12T12:18:31.985100+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:35.592852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984837+0000","last_change":"2024-09-12T12:18:29.989110+0000","last_active":"2024-09-12T12:18:31.984837+0000","last_peered":"2024-09-12T12:18:31.984837+0000","last_clean":"2024-09-12T12:18:31.984837+0000","last_became_active":"2024-09-12T12:18:29.988866+0000","last_became_peered":"2024-09-12T12:18:29.988866+0000","last_unstale":"2024-09-12T12:18:31.984837+0000","last_undegraded":"2024-09-12T12:18:31.984837+0000","last_fullsized":"2024-09-12T12:18:31.984837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:56.981675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991472+0000","last_change":"2024-09-12T12:18:31.017885+0000","last_active":"2024-09-12T12:18:32.991472+0000","last_peered":"2024-09-12T12:18:32.991472+0000","last_clean":"2024-09-12T12:18:32.991472+0000","last_became_active":"2024-09-12T12:18:31.016690+0000","last_became_peered":"2024-09-12T12:18:31.016690+0000","last_unstale":"2024-09-12T12:18:32.991472+0000","last_undegraded":"2024-09-12T12:18:32.991472+0000","last_fullsized":"2024-09-12T12:18:32.991472+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:53.793729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982457+0000","last_change":"2024-09-12T12:18:29.986854+0000","last_active":"2024-09-12T12:18:31.982457+0000","last_peered":"2024-09-12T12:18:31.982457+0000","last_clean":"2024-09-12T12:18:31.982457+0000","last_became_active":"2024-09-12T12:18:29.986355+0000","last_became_peered":"2024-09-12T12:18:29.986355+0000","last_unstale":"2024-09-12T12:18:31.982457+0000","last_undegraded":"2024-09-12T12:18:31.982457+0000","last_fullsized":"2024-09-12T12:18:31.982457+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.123774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985172+0000","last_change":"2024-09-12T12:18:31.017522+0000","last_active":"2024-09-12T12:18:31.985172+0000","last_peered":"2024-09-12T12:18:31.985172+0000","last_clean":"2024-09-12T12:18:31.985172+0000","last_became_active":"2024-09-12T12:18:31.016996+0000","last_became_peered":"2024-09-12T12:18:31.016996+0000","last_unstale":"2024-09-12T12:18:31.985172+0000","last_undegraded":"2024-09-12T12:18:31.985172+0000","last_fullsized":"2024-09-12T12:18:31.985172+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:40.058981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983581+0000","last_change":"2024-09-12T12:18:29.995555+0000","last_active":"2024-09-12T12:18:31.983581+0000","last_peered":"2024-09-12T12:18:31.983581+0000","last_clean":"2024-09-12T12:18:31.983581+0000","last_became_active":"2024-09-12T12:18:29.995251+0000","last_became_peered":"2024-09-12T12:18:29.995251+0000","last_unstale":"2024-09-12T12:18:31.983581+0000","last_undegraded":"2024-09-12T12:18:31.983581+0000","last_fullsized":"2024-09-12T12:18:31.983581+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:42.123774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983159+0000","last_change":"2024-09-12T12:18:31.014477+0000","last_active":"2024-09-12T12:18:31.983159+0000","last_peered":"2024-09-12T12:18:31.983159+0000","last_clean":"2024-09-12T12:18:31.983159+0000","last_became_active":"2024-09-12T12:18:31.014178+0000","last_became_peered":"2024-09-12T12:18:31.014178+0000","last_unstale":"2024-09-12T12:18:31.983159+0000","last_undegraded":"2024-09-12T12:18:31.983159+0000","last_fullsized":"2024-09-12T12:18:31.983159+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:19.897482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155561+0000","last_change":"2024-09-12T12:18:29.994438+0000","last_active":"2024-09-12T12:18:34.155561+0000","last_peered":"2024-09-12T12:18:34.155561+0000","last_clean":"2024-09-12T12:18:34.155561+0000","last_became_active":"2024-09-12T12:18:29.994153+0000","last_became_peered":"2024-09-12T12:18:29.994153+0000","last_unstale":"2024-09-12T12:18:34.155561+0000","last_undegraded":"2024-09-12T12:18:34.155561+0000","last_fullsized":"2024-09-12T12:18:34.155561+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:19.667406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156739+0000","last_change":"2024-09-12T12:18:31.007127+0000","last_active":"2024-09-12T12:18:34.156739+0000","last_peered":"2024-09-12T12:18:34.156739+0000","last_clean":"2024-09-12T12:18:34.156739+0000","last_became_active":"2024-09-12T12:18:31.006805+0000","last_became_peered":"2024-09-12T12:18:31.006805+0000","last_unstale":"2024-09-12T12:18:34.156739+0000","last_undegraded":"2024-09-12T12:18:34.156739+0000","last_fullsized":"2024-09-12T12:18:34.156739+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321151+0000","last_change":"2024-09-12T12:18:29.997146+0000","last_active":"2024-09-12T12:18:32.321151+0000","last_peered":"2024-09-12T12:18:32.321151+0000","last_clean":"2024-09-12T12:18:32.321151+0000","last_became_active":"2024-09-12T12:18:29.996862+0000","last_became_peered":"2024-09-12T12:18:29.996862+0000","last_unstale":"2024-09-12T12:18:32.321151+0000","last_undegraded":"2024-09-12T12:18:32.321151+0000","last_fullsized":"2024-09-12T12:18:32.321151+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:12.704492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991107+0000","last_change":"2024-09-12T12:18:31.016129+0000","last_active":"2024-09-12T12:18:32.991107+0000","last_peered":"2024-09-12T12:18:32.991107+0000","last_clean":"2024-09-12T12:18:32.991107+0000","last_became_active":"2024-09-12T12:18:31.015833+0000","last_became_peered":"2024-09-12T12:18:31.015833+0000","last_unstale":"2024-09-12T12:18:32.991107+0000","last_undegraded":"2024-09-12T12:18:32.991107+0000","last_fullsized":"2024-09-12T12:18:32.991107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:54.456454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985337+0000","last_change":"2024-09-12T12:18:29.992741+0000","last_active":"2024-09-12T12:18:31.985337+0000","last_peered":"2024-09-12T12:18:31.985337+0000","last_clean":"2024-09-12T12:18:31.985337+0000","last_became_active":"2024-09-12T12:18:29.992217+0000","last_became_peered":"2024-09-12T12:18:29.992217+0000","last_unstale":"2024-09-12T12:18:31.985337+0000","last_undegraded":"2024-09-12T12:18:31.985337+0000","last_fullsized":"2024-09-12T12:18:31.985337+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.318998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991283+0000","last_change":"2024-09-12T12:18:31.024343+0000","last_active":"2024-09-12T12:18:32.991283+0000","last_peered":"2024-09-12T12:18:32.991283+0000","last_clean":"2024-09-12T12:18:32.991283+0000","last_became_active":"2024-09-12T12:18:31.024077+0000","last_became_peered":"2024-09-12T12:18:31.024077+0000","last_unstale":"2024-09-12T12:18:32.991283+0000","last_undegraded":"2024-09-12T12:18:32.991283+0000","last_fullsized":"2024-09-12T12:18:32.991283+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:52.503849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984766+0000","last_change":"2024-09-12T12:18:30.001790+0000","last_active":"2024-09-12T12:18:31.984766+0000","last_peered":"2024-09-12T12:18:31.984766+0000","last_clean":"2024-09-12T12:18:31.984766+0000","last_became_active":"2024-09-12T12:18:30.000000+0000","last_became_peered":"2024-09-12T12:18:30.000000+0000","last_unstale":"2024-09-12T12:18:31.984766+0000","last_undegraded":"2024-09-12T12:18:31.984766+0000","last_fullsized":"2024-09-12T12:18:31.984766+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:56.869101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177887+0000","last_change":"2024-09-12T12:18:31.008663+0000","last_active":"2024-09-12T12:18:32.177887+0000","last_peered":"2024-09-12T12:18:32.177887+0000","last_clean":"2024-09-12T12:18:32.177887+0000","last_became_active":"2024-09-12T12:18:31.008323+0000","last_became_peered":"2024-09-12T12:18:31.008323+0000","last_unstale":"2024-09-12T12:18:32.177887+0000","last_undegraded":"2024-09-12T12:18:32.177887+0000","last_fullsized":"2024-09-12T12:18:32.177887+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:45.358385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982796+0000","last_change":"2024-09-12T12:18:29.995853+0000","last_active":"2024-09-12T12:18:31.982796+0000","last_peered":"2024-09-12T12:18:31.982796+0000","last_clean":"2024-09-12T12:18:31.982796+0000","last_became_active":"2024-09-12T12:18:29.994997+0000","last_became_peered":"2024-09-12T12:18:29.994997+0000","last_unstale":"2024-09-12T12:18:31.982796+0000","last_undegraded":"2024-09-12T12:18:31.982796+0000","last_fullsized":"2024-09-12T12:18:31.982796+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:37.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985485+0000","last_change":"2024-09-12T12:18:31.023014+0000","last_active":"2024-09-12T12:18:31.985485+0000","last_peered":"2024-09-12T12:18:31.985485+0000","last_clean":"2024-09-12T12:18:31.985485+0000","last_became_active":"2024-09-12T12:18:31.022390+0000","last_became_peered":"2024-09-12T12:18:31.022390+0000","last_unstale":"2024-09-12T12:18:31.985485+0000","last_undegraded":"2024-09-12T12:18:31.985485+0000","last_fullsized":"2024-09-12T12:18:31.985485+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:18.788091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985039+0000","last_change":"2024-09-12T12:18:29.994687+0000","last_active":"2024-09-12T12:18:31.985039+0000","last_peered":"2024-09-12T12:18:31.985039+0000","last_clean":"2024-09-12T12:18:31.985039+0000","last_became_active":"2024-09-12T12:18:29.994184+0000","last_became_peered":"2024-09-12T12:18:29.994184+0000","last_unstale":"2024-09-12T12:18:31.985039+0000","last_undegraded":"2024-09-12T12:18:31.985039+0000","last_fullsized":"2024-09-12T12:18:31.985039+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:25.399072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.990945+0000","last_change":"2024-09-12T12:18:31.012991+0000","last_active":"2024-09-12T12:18:32.990945+0000","last_peered":"2024-09-12T12:18:32.990945+0000","last_clean":"2024-09-12T12:18:32.990945+0000","last_became_active":"2024-09-12T12:18:31.012734+0000","last_became_peered":"2024-09-12T12:18:31.012734+0000","last_unstale":"2024-09-12T12:18:32.990945+0000","last_undegraded":"2024-09-12T12:18:32.990945+0000","last_fullsized":"2024-09-12T12:18:32.990945+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:53.393077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156782+0000","last_change":"2024-09-12T12:18:30.001059+0000","last_active":"2024-09-12T12:18:34.156782+0000","last_peered":"2024-09-12T12:18:34.156782+0000","last_clean":"2024-09-12T12:18:34.156782+0000","last_became_active":"2024-09-12T12:18:30.000719+0000","last_became_peered":"2024-09-12T12:18:30.000719+0000","last_unstale":"2024-09-12T12:18:34.156782+0000","last_undegraded":"2024-09-12T12:18:34.156782+0000","last_fullsized":"2024-09-12T12:18:34.156782+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:59.622844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982611+0000","last_change":"2024-09-12T12:18:31.007659+0000","last_active":"2024-09-12T12:18:31.982611+0000","last_peered":"2024-09-12T12:18:31.982611+0000","last_clean":"2024-09-12T12:18:31.982611+0000","last_became_active":"2024-09-12T12:18:31.004555+0000","last_became_peered":"2024-09-12T12:18:31.004555+0000","last_unstale":"2024-09-12T12:18:31.982611+0000","last_undegraded":"2024-09-12T12:18:31.982611+0000","last_fullsized":"2024-09-12T12:18:31.982611+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:58.439510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"114'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.991311+0000","last_change":"2024-09-12T12:18:29.993114+0000","last_active":"2024-09-12T12:18:32.991311+0000","last_peered":"2024-09-12T12:18:32.991311+0000","last_clean":"2024-09-12T12:18:32.991311+0000","last_became_active":"2024-09-12T12:18:29.992820+0000","last_became_peered":"2024-09-12T12:18:29.992820+0000","last_unstale":"2024-09-12T12:18:32.991311+0000","last_undegraded":"2024-09-12T12:18:32.991311+0000","last_fullsized":"2024-09-12T12:18:32.991311+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:44.193710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.177763+0000","last_change":"2024-09-12T12:18:31.000639+0000","last_active":"2024-09-12T12:18:32.177763+0000","last_peered":"2024-09-12T12:18:32.177763+0000","last_clean":"2024-09-12T12:18:32.177763+0000","last_became_active":"2024-09-12T12:18:31.000332+0000","last_became_peered":"2024-09-12T12:18:31.000332+0000","last_unstale":"2024-09-12T12:18:32.177763+0000","last_undegraded":"2024-09-12T12:18:32.177763+0000","last_fullsized":"2024-09-12T12:18:32.177763+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:45:19.466064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.983536+0000","last_change":"2024-09-12T12:18:29.992814+0000","last_active":"2024-09-12T12:18:31.983536+0000","last_peered":"2024-09-12T12:18:31.983536+0000","last_clean":"2024-09-12T12:18:31.983536+0000","last_became_active":"2024-09-12T12:18:29.992541+0000","last_became_peered":"2024-09-12T12:18:29.992541+0000","last_unstale":"2024-09-12T12:18:31.983536+0000","last_undegraded":"2024-09-12T12:18:31.983536+0000","last_fullsized":"2024-09-12T12:18:31.983536+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:48.178163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.320809+0000","last_change":"2024-09-12T12:18:31.021882+0000","last_active":"2024-09-12T12:18:32.320809+0000","last_peered":"2024-09-12T12:18:32.320809+0000","last_clean":"2024-09-12T12:18:32.320809+0000","last_became_active":"2024-09-12T12:18:31.021622+0000","last_became_peered":"2024-09-12T12:18:31.021622+0000","last_unstale":"2024-09-12T12:18:32.320809+0000","last_undegraded":"2024-09-12T12:18:32.320809+0000","last_fullsized":"2024-09-12T12:18:32.320809+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.670606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.156872+0000","last_change":"2024-09-12T12:18:30.000976+0000","last_active":"2024-09-12T12:18:34.156872+0000","last_peered":"2024-09-12T12:18:34.156872+0000","last_clean":"2024-09-12T12:18:34.156872+0000","last_became_active":"2024-09-12T12:18:30.000647+0000","last_became_peered":"2024-09-12T12:18:30.000647+0000","last_unstale":"2024-09-12T12:18:34.156872+0000","last_undegraded":"2024-09-12T12:18:34.156872+0000","last_fullsized":"2024-09-12T12:18:34.156872+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:06.037389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985398+0000","last_change":"2024-09-12T12:18:31.009029+0000","last_active":"2024-09-12T12:18:31.985398+0000","last_peered":"2024-09-12T12:18:31.985398+0000","last_clean":"2024-09-12T12:18:31.985398+0000","last_became_active":"2024-09-12T12:18:31.008713+0000","last_became_peered":"2024-09-12T12:18:31.008713+0000","last_unstale":"2024-09-12T12:18:31.985398+0000","last_undegraded":"2024-09-12T12:18:31.985398+0000","last_fullsized":"2024-09-12T12:18:31.985398+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:48.869837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982773+0000","last_change":"2024-09-12T12:18:29.996111+0000","last_active":"2024-09-12T12:18:31.982773+0000","last_peered":"2024-09-12T12:18:31.982773+0000","last_clean":"2024-09-12T12:18:31.982773+0000","last_became_active":"2024-09-12T12:18:29.995305+0000","last_became_peered":"2024-09-12T12:18:29.995305+0000","last_unstale":"2024-09-12T12:18:31.982773+0000","last_undegraded":"2024-09-12T12:18:31.982773+0000","last_fullsized":"2024-09-12T12:18:31.982773+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:53.802825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985095+0000","last_change":"2024-09-12T12:18:31.007460+0000","last_active":"2024-09-12T12:18:31.985095+0000","last_peered":"2024-09-12T12:18:31.985095+0000","last_clean":"2024-09-12T12:18:31.985095+0000","last_became_active":"2024-09-12T12:18:31.007188+0000","last_became_peered":"2024-09-12T12:18:31.007188+0000","last_unstale":"2024-09-12T12:18:31.985095+0000","last_undegraded":"2024-09-12T12:18:31.985095+0000","last_fullsized":"2024-09-12T12:18:31.985095+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:46.783083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.984874+0000","last_change":"2024-09-12T12:18:29.999200+0000","last_active":"2024-09-12T12:18:31.984874+0000","last_peered":"2024-09-12T12:18:31.984874+0000","last_clean":"2024-09-12T12:18:31.984874+0000","last_became_active":"2024-09-12T12:18:29.997674+0000","last_became_peered":"2024-09-12T12:18:29.997674+0000","last_unstale":"2024-09-12T12:18:31.984874+0000","last_undegraded":"2024-09-12T12:18:31.984874+0000","last_fullsized":"2024-09-12T12:18:31.984874+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:45:21.474245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155733+0000","last_change":"2024-09-12T12:18:31.002573+0000","last_active":"2024-09-12T12:18:34.155733+0000","last_peered":"2024-09-12T12:18:34.155733+0000","last_clean":"2024-09-12T12:18:34.155733+0000","last_became_active":"2024-09-12T12:18:31.002128+0000","last_became_peered":"2024-09-12T12:18:31.002128+0000","last_unstale":"2024-09-12T12:18:34.155733+0000","last_undegraded":"2024-09-12T12:18:34.155733+0000","last_fullsized":"2024-09-12T12:18:34.155733+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:28.015565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.982898+0000","last_change":"2024-09-12T12:18:29.992678+0000","last_active":"2024-09-12T12:18:31.982898+0000","last_peered":"2024-09-12T12:18:31.982898+0000","last_clean":"2024-09-12T12:18:31.982898+0000","last_became_active":"2024-09-12T12:18:29.992401+0000","last_became_peered":"2024-09-12T12:18:29.992401+0000","last_unstale":"2024-09-12T12:18:31.982898+0000","last_undegraded":"2024-09-12T12:18:31.982898+0000","last_fullsized":"2024-09-12T12:18:31.982898+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:53.802825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.321090+0000","last_change":"2024-09-12T12:18:31.010618+0000","last_active":"2024-09-12T12:18:32.321090+0000","last_peered":"2024-09-12T12:18:32.321090+0000","last_clean":"2024-09-12T12:18:32.321090+0000","last_became_active":"2024-09-12T12:18:31.010337+0000","last_became_peered":"2024-09-12T12:18:31.010337+0000","last_unstale":"2024-09-12T12:18:32.321090+0000","last_undegraded":"2024-09-12T12:18:32.321090+0000","last_fullsized":"2024-09-12T12:18:32.321090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:51:30.522076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985144+0000","last_change":"2024-09-12T12:18:29.994453+0000","last_active":"2024-09-12T12:18:31.985144+0000","last_peered":"2024-09-12T12:18:31.985144+0000","last_clean":"2024-09-12T12:18:31.985144+0000","last_became_active":"2024-09-12T12:18:29.993835+0000","last_became_peered":"2024-09-12T12:18:29.993835+0000","last_unstale":"2024-09-12T12:18:31.985144+0000","last_undegraded":"2024-09-12T12:18:31.985144+0000","last_fullsized":"2024-09-12T12:18:31.985144+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:17.387339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:32.320806+0000","last_change":"2024-09-12T12:18:31.015130+0000","last_active":"2024-09-12T12:18:32.320806+0000","last_peered":"2024-09-12T12:18:32.320806+0000","last_clean":"2024-09-12T12:18:32.320806+0000","last_became_active":"2024-09-12T12:18:31.014751+0000","last_became_peered":"2024-09-12T12:18:31.014751+0000","last_unstale":"2024-09-12T12:18:32.320806+0000","last_undegraded":"2024-09-12T12:18:32.320806+0000","last_fullsized":"2024-09-12T12:18:32.320806+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:29.968170+0000","last_clean_scrub_stamp":"2024-09-12T12:18:29.968170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:12.661477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:31.985355+0000","last_change":"2024-09-12T12:18:30.001155+0000","last_active":"2024-09-12T12:18:31.985355+0000","last_peered":"2024-09-12T12:18:31.985355+0000","last_clean":"2024-09-12T12:18:31.985355+0000","last_became_active":"2024-09-12T12:18:30.000465+0000","last_became_peered":"2024-09-12T12:18:30.000465+0000","last_unstale":"2024-09-12T12:18:31.985355+0000","last_undegraded":"2024-09-12T12:18:31.985355+0000","last_fullsized":"2024-09-12T12:18:31.985355+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:18:28.964970+0000","last_clean_scrub_stamp":"2024-09-12T12:18:28.964970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:47.810731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":339,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-12T12:18:34.155262+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:18:34.155262+0000","last_peered":"2024-09-12T12:18:34.155262+0000","last_clean":"2024-09-12T12:18:34.155262+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:18:34.155262+0000","last_undegraded":"2024-09-12T12:18:34.155262+0000","last_fullsized":"2024-09-12T12:18:34.155262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37308,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334532,"statfs":{"total":96636764160,"available":96598560768,"internally_reserved":0,"allocated":2002944,"data_stored":1247635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36748,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":1433600,"data_stored":666015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":1413120,"data_stored":663799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40896,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330944,"statfs":{"total":96636764160,"available":96594886656,"internally_reserved":0,"allocated":1421312,"data_stored":663891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40892,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330948,"statfs":{"total":96636764160,"available":96594890752,"internally_reserved":0,"allocated":1417216,"data_stored":664381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36732,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335108,"statfs":{"total":96636764160,"available":96599150592,"internally_reserved":0,"allocated":1417216,"data_stored":663833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36724,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335116,"statfs":{"total":96636764160,"available":96599158784,"internally_reserved":0,"allocated":1404928,"data_stored":657141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41484,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330356,"statfs":{"total":96636764160,"available":96594284544,"internally_reserved":0,"allocated":2023424,"data_stored":1255869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:18:39.976 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:18:39.976 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:18:40.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd061400640 1 Processor -- start 2024-09-12T12:18:40.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd061400640 1 -- start start 2024-09-12T12:18:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd061400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c162a40 0x7fd05c0cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd061400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd05c0af5d0 0x7fd05c163650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd061400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05c0cf900 con 0x7fd05c163b90 2024-09-12T12:18:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd061400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd05c0cf6d0 con 0x7fd05c0af5d0 2024-09-12T12:18:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd061400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c0cfbe0 con 0x7fd05c162a40 2024-09-12T12:18:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd05b200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd05c163b90 0x7fd05c166510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41026/0 (socket says 172.21.15.144:41026) 2024-09-12T12:18:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd05b200640 1 -- 172.21.15.144:0/3330316234 learned_addr learned my addr 172.21.15.144:0/3330316234 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd05a800640 1 --2- 172.21.15.144:0/3330316234 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c162a40 0x7fd05c0cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd059e00640 1 --2- 172.21.15.144:0/3330316234 >> v2:172.21.15.165:3300/0 conn(0x7fd05c0af5d0 0x7fd05c163650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.157+0000 7fd059400640 1 -- 172.21.15.144:0/3330316234 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2302556203 0 0) 0x7fd05c0cf900 con 0x7fd05c163b90 2024-09-12T12:18:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd059400640 1 -- 172.21.15.144:0/3330316234 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd040003530 con 0x7fd05c163b90 2024-09-12T12:18:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd05a800640 1 -- 172.21.15.144:0/3330316234 >> v2:172.21.15.165:3300/0 conn(0x7fd05c0af5d0 msgr2=0x7fd05c163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd05a800640 1 --2- 172.21.15.144:0/3330316234 >> v2:172.21.15.165:3300/0 conn(0x7fd05c0af5d0 0x7fd05c163650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd05a800640 1 -- 172.21.15.144:0/3330316234 >> v1:172.21.15.144:6789/0 conn(0x7fd05c163b90 legacy=0x7fd05c166510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd05a800640 1 -- 172.21.15.144:0/3330316234 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c0cfec0 con 0x7fd05c162a40 2024-09-12T12:18:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd05a800640 1 --2- 172.21.15.144:0/3330316234 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c162a40 0x7fd05c0cf190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009d90 tx=0x7fd04c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ebcd788c4eb67a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:40.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd059400640 1 -- 172.21.15.144:0/3330316234 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0b2070 con 0x7fd05c162a40 2024-09-12T12:18:40.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd059400640 1 -- 172.21.15.144:0/3330316234 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c0a5940 con 0x7fd05c162a40 2024-09-12T12:18:40.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd059400640 1 -- 172.21.15.144:0/3330316234 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0a5cf0 con 0x7fd05c162a40 2024-09-12T12:18:40.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd061400640 1 -- 172.21.15.144:0/3330316234 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c162a40 msgr2=0x7fd05c0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.161+0000 7fd061400640 1 --2- 172.21.15.144:0/3330316234 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c162a40 0x7fd05c0cf190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009d90 tx=0x7fd04c01c970 comp rx=0 tx=0).stop 2024-09-12T12:18:40.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 -- 172.21.15.144:0/3330316234 shutdown_connections 2024-09-12T12:18:40.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 --2- 172.21.15.144:0/3330316234 >> v2:172.21.15.165:3300/0 conn(0x7fd05c0af5d0 0x7fd05c163650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 --2- 172.21.15.144:0/3330316234 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c162a40 0x7fd05c0cf190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 -- 172.21.15.144:0/3330316234 >> 172.21.15.144:0/3330316234 conn(0x7fd05c068030 msgr2=0x7fd05c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:40.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 -- 172.21.15.144:0/3330316234 shutdown_connections 2024-09-12T12:18:40.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 -- 172.21.15.144:0/3330316234 wait complete. 2024-09-12T12:18:40.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 Processor -- start 2024-09-12T12:18:40.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 -- start start 2024-09-12T12:18:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd05c0af5d0 0x7fd05c158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c162a40 0x7fd05c165370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c163b90 0x7fd05c160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c16fa30 con 0x7fd05c0af5d0 2024-09-12T12:18:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c16f8b0 con 0x7fd05c162a40 2024-09-12T12:18:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd061400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c16fbb0 con 0x7fd05c163b90 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd05c0af5d0 0x7fd05c158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd05c0af5d0 0x7fd05c158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43426/0 (socket says 172.21.15.144:43426) 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05a800640 1 -- 172.21.15.144:0/4108639838 learned_addr learned my addr 172.21.15.144:0/4108639838 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd059e00640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c162a40 0x7fd05c165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05b200640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c163b90 0x7fd05c160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05a800640 1 -- 172.21.15.144:0/4108639838 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c163b90 msgr2=0x7fd05c160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05a800640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c163b90 0x7fd05c160e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05a800640 1 -- 172.21.15.144:0/4108639838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c162a40 msgr2=0x7fd05c165370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05a800640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c162a40 0x7fd05c165370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05a800640 1 -- 172.21.15.144:0/4108639838 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c15d830 con 0x7fd05c0af5d0 2024-09-12T12:18:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.165+0000 7fd05a800640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd05c0af5d0 0x7fd05c158970 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fd04c01a5a0 tx=0x7fd04c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd052a00640 1 -- 172.21.15.144:0/4108639838 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0b2050 con 0x7fd05c0af5d0 2024-09-12T12:18:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd052a00640 1 -- 172.21.15.144:0/4108639838 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04c0be070 con 0x7fd05c0af5d0 2024-09-12T12:18:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05c15db10 con 0x7fd05c0af5d0 2024-09-12T12:18:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd052a00640 1 -- 172.21.15.144:0/4108639838 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c0ada50 con 0x7fd05c0af5d0 2024-09-12T12:18:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05c160950 con 0x7fd05c0af5d0 2024-09-12T12:18:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05c163650 con 0x7fd05c0af5d0 2024-09-12T12:18:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd052a00640 1 -- 172.21.15.144:0/4108639838 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd04c0a57c0 con 0x7fd05c0af5d0 2024-09-12T12:18:40.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd052a00640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd03c0678c0 0x7fd03c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd052a00640 1 -- 172.21.15.144:0/4108639838 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7fd04c120ca0 con 0x7fd05c0af5d0 2024-09-12T12:18:40.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd059e00640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd03c0678c0 0x7fd03c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.169+0000 7fd059e00640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd03c0678c0 0x7fd03c069d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0afd20 tx=0x7fd048009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:40.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.173+0000 7fd052a00640 1 -- 172.21.15.144:0/4108639838 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd04c016560 con 0x7fd05c0af5d0 2024-09-12T12:18:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.389+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd05c0b35a0 con 0x7fd05c0af5d0 2024-09-12T12:18:40.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.389+0000 7fd052a00640 1 -- 172.21.15.144:0/4108639838 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7fd04c0f1000 con 0x7fd05c0af5d0 2024-09-12T12:18:40.390 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:18:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:18:40.390 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:18:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:18:40.391 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:18:40.391 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:18:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd03c0678c0 msgr2=0x7fd03c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd03c0678c0 0x7fd03c069d80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0afd20 tx=0x7fd048009190 comp rx=0 tx=0).stop 2024-09-12T12:18:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd05c0af5d0 msgr2=0x7fd05c158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd05c0af5d0 0x7fd05c158970 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fd04c01a5a0 tx=0x7fd04c019710 comp rx=0 tx=0).stop 2024-09-12T12:18:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 shutdown_connections 2024-09-12T12:18:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd03c0678c0 0x7fd03c069d80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd05c163b90 0x7fd05c160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd05c162a40 0x7fd05c165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 --2- 172.21.15.144:0/4108639838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd05c0af5d0 0x7fd05c158970 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 >> 172.21.15.144:0/4108639838 conn(0x7fd05c068030 msgr2=0x7fd05c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:40.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 shutdown_connections 2024-09-12T12:18:40.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.393+0000 7fd061400640 1 -- 172.21.15.144:0/4108639838 wait complete. 2024-09-12T12:18:40.413 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7473000640 1 Processor -- start 2024-09-12T12:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7473000640 1 -- start start 2024-09-12T12:18:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7473000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f746c06c320 0x7f746c072e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7473000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f746c15e9a0 con 0x7f746c073340 2024-09-12T12:18:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7473000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f746c073b70 con 0x7f746c15e5c0 2024-09-12T12:18:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7473000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f746c073e50 con 0x7f746c06c320 2024-09-12T12:18:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7463400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f746c06c320 0x7f746c072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7471000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f746c073340 0x7f746c0af2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41042/0 (socket says 172.21.15.144:41042) 2024-09-12T12:18:40.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7471000640 1 -- 172.21.15.144:0/3098885400 learned_addr learned my addr 172.21.15.144:0/3098885400 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:40.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7463400640 1 -- 172.21.15.144:0/3098885400 >> v1:172.21.15.165:6789/0 conn(0x7f746c15e5c0 legacy=0x7f746c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7463400640 1 -- 172.21.15.144:0/3098885400 >> v1:172.21.15.144:6789/0 conn(0x7f746c073340 legacy=0x7f746c0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f7463400640 1 -- 172.21.15.144:0/3098885400 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c074130 con 0x7f746c06c320 2024-09-12T12:18:40.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.553+0000 7f746b400640 1 -- 172.21.15.144:0/3098885400 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161919026 0 0) 0x7f746c15e9a0 con 0x7f746c073340 2024-09-12T12:18:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f7463400640 1 --2- 172.21.15.144:0/3098885400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c06c320 0x7f746c072e00 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f74540097c0 tx=0x7f745401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61eada3bfb917607 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f746b400640 1 -- 172.21.15.144:0/3098885400 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74540ab600 con 0x7f746c06c320 2024-09-12T12:18:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f746b400640 1 -- 172.21.15.144:0/3098885400 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74540b0070 con 0x7f746c06c320 2024-09-12T12:18:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f746b400640 1 -- 172.21.15.144:0/3098885400 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74540ab9c0 con 0x7f746c06c320 2024-09-12T12:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f7473000640 1 -- 172.21.15.144:0/3098885400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c06c320 msgr2=0x7f746c072e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f7473000640 1 --2- 172.21.15.144:0/3098885400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c06c320 0x7f746c072e00 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f74540097c0 tx=0x7f745401c3e0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f7473000640 1 -- 172.21.15.144:0/3098885400 shutdown_connections 2024-09-12T12:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f7473000640 1 --2- 172.21.15.144:0/3098885400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c06c320 0x7f746c072e00 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f7473000640 1 -- 172.21.15.144:0/3098885400 >> 172.21.15.144:0/3098885400 conn(0x7f746c0b3380 msgr2=0x7f746c0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f7473000640 1 -- 172.21.15.144:0/3098885400 shutdown_connections 2024-09-12T12:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.557+0000 7f7473000640 1 -- 172.21.15.144:0/3098885400 wait complete. 2024-09-12T12:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 Processor -- start 2024-09-12T12:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 -- start start 2024-09-12T12:18:40.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746c06c320 0x7f746c0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f746c073340 0x7f746c149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c15e5c0 0x7f746c1609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f746c0b0380 con 0x7f746c15e5c0 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f746c0b0200 con 0x7f746c073340 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f746c0b0500 con 0x7f746c06c320 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7471000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c15e5c0 0x7f746c1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7471000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c15e5c0 0x7f746c1609b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43452/0 (socket says 172.21.15.144:43452) 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7471000640 1 -- 172.21.15.144:0/2196444703 learned_addr learned my addr 172.21.15.144:0/2196444703 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7463400640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f746c073340 0x7f746c149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f746be00640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746c06c320 0x7f746c0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7471000640 1 -- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746c06c320 msgr2=0x7f746c0b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7471000640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746c06c320 0x7f746c0b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7471000640 1 -- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f746c073340 msgr2=0x7f746c149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7471000640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f746c073340 0x7f746c149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7471000640 1 -- 172.21.15.144:0/2196444703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c0b11c0 con 0x7f746c15e5c0 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7463400640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f746c073340 0x7f746c149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f746be00640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746c06c320 0x7f746c0b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7471000640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c15e5c0 0x7f746c1609b0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f746400c7a0 tx=0x7f746400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7468c00640 1 -- 172.21.15.144:0/2196444703 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464018070 con 0x7f746c15e5c0 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7468c00640 1 -- 172.21.15.144:0/2196444703 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746400a640 con 0x7f746c15e5c0 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c0b14a0 con 0x7f746c15e5c0 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7468c00640 1 -- 172.21.15.144:0/2196444703 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400aa70 con 0x7f746c15e5c0 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c0b1a60 con 0x7f746c15e5c0 2024-09-12T12:18:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.561+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c0b27a0 con 0x7f746c15e5c0 2024-09-12T12:18:40.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.565+0000 7f7468c00640 1 -- 172.21.15.144:0/2196444703 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f746401b070 con 0x7f746c15e5c0 2024-09-12T12:18:40.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.565+0000 7f7468c00640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:40.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.565+0000 7f7468c00640 1 -- 172.21.15.144:0/2196444703 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f7464085500 con 0x7f746c15e5c0 2024-09-12T12:18:40.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.565+0000 7f746be00640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:40.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.565+0000 7f746be00640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f746c0b2a00 tx=0x7f745c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:40.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.569+0000 7f7468c00640 1 -- 172.21.15.144:0/2196444703 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f746c0b27a0 con 0x7f746c15e5c0 2024-09-12T12:18:40.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.761+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f746c1547d0 con 0x7f746c15e5c0 2024-09-12T12:18:40.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.761+0000 7f7468c00640 1 -- 172.21.15.144:0/2196444703 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5237 (secure 0 0 0) 0x7f7464055e10 con 0x7f746c15e5c0 2024-09-12T12:18:40.761 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:18:40.762 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":88,"btime":"2024-09-12T12:18:34:012867+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6611,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3516117882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3516117882},{"type":"v1","addr":"172.21.15.144:6837","nonce":3516117882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4000269826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4000269826},{"type":"v1","addr":"172.21.15.165:6834","nonce":4000269826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2020456347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2020456347},{"type":"v1","addr":"172.21.15.165:6835","nonce":2020456347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:18:30.365135+0000","modified":"2024-09-12T12:18:33.387023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7273":{"gid":7273,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6836/3880489679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3880489679},{"type":"v1","addr":"172.21.15.144:6836","nonce":3880489679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7273,"qdb_cluster":[7273]},"id":7}]} 2024-09-12T12:18:40.762 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 88 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 msgr2=0x7f7448069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f746c0b2a00 tx=0x7f745c009040 comp rx=0 tx=0).stop 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c15e5c0 msgr2=0x7f746c1609b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c15e5c0 0x7f746c1609b0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f746400c7a0 tx=0x7f746400cc60 comp rx=0 tx=0).stop 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 shutdown_connections 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f746c15e5c0 0x7f746c1609b0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f746c073340 0x7f746c149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 --2- 172.21.15.144:0/2196444703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746c06c320 0x7f746c0b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 >> 172.21.15.144:0/2196444703 conn(0x7f746c0b3380 msgr2=0x7f746c153e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 shutdown_connections 2024-09-12T12:18:40.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:40.765+0000 7f7473000640 1 -- 172.21.15.144:0/2196444703 wait complete. 2024-09-12T12:18:41.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:18:30.365135+0000', 'modified': '2024-09-12T12:18:33.387023+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7273': {'gid': 7273, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6836/3880489679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3880489679}, {'type': 'v1', 'addr': '172.21.15.144:6836', 'nonce': 3880489679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7273, 'qdb_cluster': [7273]} 2024-09-12T12:18:41.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:18:41.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T12:18:41.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f7401800640 1 Processor -- start 2024-09-12T12:18:41.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f7401800640 1 -- start start 2024-09-12T12:18:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f7401800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73fc0b68f0 0x7f73fc1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f7401800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0cec50 0x7f73fc0d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f7401800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73fc0cf990 con 0x7f73fc15e560 2024-09-12T12:18:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f7401800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f73fc0b7380 con 0x7f73fc0b68f0 2024-09-12T12:18:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f7401800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc0cf3d0 con 0x7f73fc0cec50 2024-09-12T12:18:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f73fbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f73fc15e560 0x7f73fc0b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41046/0 (socket says 172.21.15.144:41046) 2024-09-12T12:18:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f73fbe00640 1 -- 172.21.15.144:0/1440992452 learned_addr learned my addr 172.21.15.144:0/1440992452 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f73fb400640 1 --2- 172.21.15.144:0/1440992452 >> v2:172.21.15.144:3300/0 conn(0x7f73fc0b68f0 0x7f73fc1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f7400e00640 1 --2- 172.21.15.144:0/1440992452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0cec50 0x7f73fc0d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f73fb400640 1 -- 172.21.15.144:0/1440992452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0cec50 msgr2=0x7f73fc0d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f73fb400640 1 --2- 172.21.15.144:0/1440992452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0cec50 0x7f73fc0d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f73fb400640 1 -- 172.21.15.144:0/1440992452 >> v1:172.21.15.144:6789/0 conn(0x7f73fc15e560 legacy=0x7f73fc0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.325+0000 7f73faa00640 1 -- 172.21.15.144:0/1440992452 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753305295 0 0) 0x7f73fc0cf990 con 0x7f73fc15e560 2024-09-12T12:18:41.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f73fb400640 1 -- 172.21.15.144:0/1440992452 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc0cf6b0 con 0x7f73fc0b68f0 2024-09-12T12:18:41.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f73fb400640 1 --2- 172.21.15.144:0/1440992452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc0b68f0 0x7f73fc1629f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f73e80097c0 tx=0x7f73e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68b6cc09cf7c02c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f73faa00640 1 -- 172.21.15.144:0/1440992452 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e80b2070 con 0x7f73fc0b68f0 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f73faa00640 1 -- 172.21.15.144:0/1440992452 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e80ad640 con 0x7f73fc0b68f0 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f73faa00640 1 -- 172.21.15.144:0/1440992452 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e80ada10 con 0x7f73fc0b68f0 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f7401800640 1 -- 172.21.15.144:0/1440992452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc0b68f0 msgr2=0x7f73fc1629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f7401800640 1 --2- 172.21.15.144:0/1440992452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc0b68f0 0x7f73fc1629f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f73e80097c0 tx=0x7f73e801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f7401800640 1 -- 172.21.15.144:0/1440992452 shutdown_connections 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f7401800640 1 --2- 172.21.15.144:0/1440992452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0cec50 0x7f73fc0d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f7401800640 1 --2- 172.21.15.144:0/1440992452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc0b68f0 0x7f73fc1629f0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f7401800640 1 -- 172.21.15.144:0/1440992452 >> 172.21.15.144:0/1440992452 conn(0x7f73fc0d1270 msgr2=0x7f73fc0d1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f7401800640 1 -- 172.21.15.144:0/1440992452 shutdown_connections 2024-09-12T12:18:41.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.329+0000 7f7401800640 1 -- 172.21.15.144:0/1440992452 wait complete. 2024-09-12T12:18:41.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 Processor -- start 2024-09-12T12:18:41.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 -- start start 2024-09-12T12:18:41.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0b68f0 0x7f73fc14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0cec50 0x7f73fc15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc15e560 0x7f73fc15d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0d3dd0 con 0x7f73fc15e560 2024-09-12T12:18:41.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0d3c50 con 0x7f73fc0cec50 2024-09-12T12:18:41.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc0d3f50 con 0x7f73fc0b68f0 2024-09-12T12:18:41.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7400e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc15e560 0x7f73fc15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7400e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc15e560 0x7f73fc15d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43480/0 (socket says 172.21.15.144:43480) 2024-09-12T12:18:41.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7400e00640 1 -- 172.21.15.144:0/1701492740 learned_addr learned my addr 172.21.15.144:0/1701492740 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:41.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f73fb400640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0cec50 0x7f73fc15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0b68f0 0x7f73fc14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7400e00640 1 -- 172.21.15.144:0/1701492740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0b68f0 msgr2=0x7f73fc14ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7400e00640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0b68f0 0x7f73fc14ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7400e00640 1 -- 172.21.15.144:0/1701492740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0cec50 msgr2=0x7f73fc15cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7400e00640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0cec50 0x7f73fc15cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7400e00640 1 -- 172.21.15.144:0/1701492740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc14f0f0 con 0x7f73fc15e560 2024-09-12T12:18:41.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f73fb400640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0cec50 0x7f73fc15cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:41.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7400e00640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc15e560 0x7f73fc15d330 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f73f400d800 tx=0x7f73f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f73f3e00640 1 -- 172.21.15.144:0/1701492740 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f400b6c0 con 0x7f73fc15e560 2024-09-12T12:18:41.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f73f3e00640 1 -- 172.21.15.144:0/1701492740 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f4019070 con 0x7f73fc15e560 2024-09-12T12:18:41.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f73f3e00640 1 -- 172.21.15.144:0/1701492740 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f400baa0 con 0x7f73fc15e560 2024-09-12T12:18:41.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 -- 172.21.15.144:0/1701492740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73fc0cbf70 con 0x7f73fc15e560 2024-09-12T12:18:41.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.333+0000 7f7401800640 1 -- 172.21.15.144:0/1701492740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73fc0cc530 con 0x7f73fc15e560 2024-09-12T12:18:41.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.337+0000 7f73f3e00640 1 -- 172.21.15.144:0/1701492740 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73f400bc40 con 0x7f73fc15e560 2024-09-12T12:18:41.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.337+0000 7f73f3e00640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc0678f0 0x7f73dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.337+0000 7f73f3e00640 1 -- 172.21.15.144:0/1701492740 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f73f4086220 con 0x7f73fc15e560 2024-09-12T12:18:41.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.337+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc0678f0 0x7f73dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.337+0000 7f7405fff000 1 Processor -- start 2024-09-12T12:18:41.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.337+0000 7f7405fff000 1 -- start start 2024-09-12T12:18:41.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.337+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc0678f0 0x7f73dc069db0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0012f0 tx=0x7f73ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06365b20 0x563e06365f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0631bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e0631c290 0x563e0631c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563e06203b60 con 0x563e06366440 2024-09-12T12:18:41.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563e0616ac70 con 0x563e06365b20 2024-09-12T12:18:41.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x563e06110ed0 con 0x563e0631c290 2024-09-12T12:18:41.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0631bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0631bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43496/0 (socket says 172.21.15.144:43496) 2024-09-12T12:18:41.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fb400640 1 -- 172.21.15.144:0/1807163105 learned_addr learned my addr 172.21.15.144:0/1807163105 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1807163105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06365b20 0x563e06365f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7400e00640 1 --2- 172.21.15.144:0/1807163105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e0631c290 0x563e0631c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fb400640 1 -- 172.21.15.144:0/1807163105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e0631c290 msgr2=0x563e0631c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fb400640 1 --2- 172.21.15.144:0/1807163105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e0631c290 0x563e0631c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fb400640 1 -- 172.21.15.144:0/1807163105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06365b20 msgr2=0x563e06365f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fb400640 1 --2- 172.21.15.144:0/1807163105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06365b20 0x563e06365f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fb400640 1 -- 172.21.15.144:0/1807163105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e06122e50 con 0x563e06366440 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73fb400640 1 --2- 172.21.15.144:0/1807163105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0631bd50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f73e801a0d0 tx=0x7f73e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d4a6b4e2c87d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73f0c00640 1 -- 172.21.15.144:0/1807163105 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e80b2040 con 0x563e06366440 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73f0c00640 1 -- 172.21.15.144:0/1807163105 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e8004340 con 0x563e06366440 2024-09-12T12:18:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f73f0c00640 1 -- 172.21.15.144:0/1807163105 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e80044f0 con 0x563e06366440 2024-09-12T12:18:41.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 -- 172.21.15.144:0/1807163105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 msgr2=0x563e0631bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 --2- 172.21.15.144:0/1807163105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0631bd50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f73e801a0d0 tx=0x7f73e8004740 comp rx=0 tx=0).stop 2024-09-12T12:18:41.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 -- 172.21.15.144:0/1807163105 shutdown_connections 2024-09-12T12:18:41.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 --2- 172.21.15.144:0/1807163105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e0631c290 0x563e0631c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 --2- 172.21.15.144:0/1807163105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0631bd50 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 --2- 172.21.15.144:0/1807163105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06365b20 0x563e06365f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 -- 172.21.15.144:0/1807163105 >> 172.21.15.144:0/1807163105 conn(0x563e06322600 msgr2=0x563e0631a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:41.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 -- 172.21.15.144:0/1807163105 shutdown_connections 2024-09-12T12:18:41.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 -- 172.21.15.144:0/1807163105 wait complete. 2024-09-12T12:18:41.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 -- start start 2024-09-12T12:18:41.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.341+0000 7f7405fff000 1 Processor -- start 2024-09-12T12:18:41.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06365b20 0x563e06320e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06366440 0x563e06326cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 0x563e06327230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563e061ccb00 con 0x563e06365b20 2024-09-12T12:18:41.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563e06145360 con 0x563e06321390 2024-09-12T12:18:41.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x563e061422d0 con 0x563e06366440 2024-09-12T12:18:41.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 10 client.0 _ll_register_callbacks cb 0x563e06307820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:41.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06365b20 0x563e06320e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06365b20 0x563e06320e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43510/0 (socket says 172.21.15.144:43510) 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fbe00640 1 -- 172.21.15.144:0/1457861648 learned_addr learned my addr 172.21.15.144:0/1457861648 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fb400640 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06366440 0x563e06326cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7400e00640 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 0x563e06327230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fbe00640 1 -- 172.21.15.144:0/1457861648 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06366440 msgr2=0x563e06326cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06366440 0x563e06326cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fbe00640 1 -- 172.21.15.144:0/1457861648 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 msgr2=0x563e06327230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 0x563e06327230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fbe00640 1 -- 172.21.15.144:0/1457861648 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e06111120 con 0x563e06365b20 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7400e00640 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 0x563e06327230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06365b20 0x563e06320e50 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f73ec007650 tx=0x7f73ec005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330f8c6fb75ca00d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73e5600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73e5600640 1 -- 172.21.15.144:0/1457861648 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec014bc0 con 0x563e06365b20 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73e5600640 1 -- 172.21.15.144:0/1457861648 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f73ec010040 con 0x563e06365b20 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 -- 172.21.15.144:0/1457861648 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73e8004340 con 0x563e06365b20 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73e5600640 1 -- 172.21.15.144:0/1457861648 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f73ec02e050 con 0x563e06365b20 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 10 client.7758 fetch_fsmap learned FSMap version 88 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 -- 172.21.15.144:0/1457861648 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) -- 0x563e0610a450 con 0x563e06365b20 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73e5600640 1 -- 172.21.15.144:0/1457861648 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73e8004340 con 0x563e06365b20 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73e5600640 1 -- 172.21.15.144:0/1457861648 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 88) ==== 3502+0+0 (secure 0 0 0) 0x7f73ec031020 con 0x563e06365b20 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 10 client.7758 fetch_fsmap finished waiting for FSMap version 88 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 10 client.7758 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 20 client.7758 populate_metadata read hostname 'smithi144' 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x563e0636bf50 0x563e0636c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 4 client.7758 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:18:41.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 -- 172.21.15.144:0/1457861648 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e06104c00 con 0x563e0636bf50 2024-09-12T12:18:41.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fb400640 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x563e0636bf50 0x563e0636c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73fb400640 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x563e0636bf50 0x563e0636c330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eb22362a79a552b server_cookie=baa57dbd23311dec in_seq=0 out_seq=0 2024-09-12T12:18:41.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73e5600640 10 client.7758 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:18:41.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73e5600640 1 -- 172.21.15.144:0/1457861648 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e06104c00 con 0x563e0636bf50 2024-09-12T12:18:41.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f73e5600640 10 client.7758 handle_command_reply: tid=0 2024-09-12T12:18:41.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 client.7758 shutdown 2024-09-12T12:18:41.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 -- 172.21.15.144:0/1457861648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06365b20 msgr2=0x563e06320e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06365b20 0x563e06320e50 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f73ec007650 tx=0x7f73ec005b80 comp rx=0 tx=0).stop 2024-09-12T12:18:41.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 -- 172.21.15.144:0/1457861648 shutdown_connections 2024-09-12T12:18:41.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.345+0000 7f7405fff000 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x563e0636bf50 0x563e0636c330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.349+0000 7f7405fff000 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 0x563e06327230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.349+0000 7f7405fff000 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06366440 0x563e06326cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.349+0000 7f7405fff000 1 --2- 172.21.15.144:0/1457861648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06365b20 0x563e06320e50 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.349+0000 7f73e5600640 0 client.7758 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:18:41.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.349+0000 7f7405fff000 1 -- 172.21.15.144:0/1457861648 >> 172.21.15.144:0/1457861648 conn(0x563e0631c290 msgr2=0x563e0631ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:41.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.349+0000 7f7405fff000 1 -- 172.21.15.144:0/1457861648 shutdown_connections 2024-09-12T12:18:41.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.349+0000 7f7405fff000 1 -- 172.21.15.144:0/1457861648 wait complete. 2024-09-12T12:18:41.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.349+0000 7f7405fff000 20 client.7758 trim_cache size 0 max 16384 2024-09-12T12:18:41.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7405fff000 1 Processor -- start 2024-09-12T12:18:41.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7405fff000 1 -- start start 2024-09-12T12:18:41.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7405fff000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 0x563e06364cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7405fff000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 0x563e06365230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7405fff000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0637b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7405fff000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc202b30 con 0x563e06366440 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7405fff000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73fc0c96b0 con 0x563e06321390 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7405fff000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73fc0c9d00 con 0x563e06365b20 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7400e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0637b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7400e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0637b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43512/0 (socket says 172.21.15.144:43512) 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7400e00640 1 -- 172.21.15.144:0/3691932823 learned_addr learned my addr 172.21.15.144:0/3691932823 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f73fbe00640 1 --2- 172.21.15.144:0/3691932823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 0x563e06364cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f73fb400640 1 --2- 172.21.15.144:0/3691932823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 0x563e06365230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7400e00640 1 -- 172.21.15.144:0/3691932823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 msgr2=0x563e06365230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7400e00640 1 --2- 172.21.15.144:0/3691932823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 0x563e06365230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7400e00640 1 -- 172.21.15.144:0/3691932823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 msgr2=0x563e06364cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7400e00640 1 --2- 172.21.15.144:0/3691932823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 0x563e06364cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.365+0000 7f7400e00640 1 -- 172.21.15.144:0/3691932823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e06366270 con 0x563e06366440 2024-09-12T12:18:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7400e00640 1 --2- 172.21.15.144:0/3691932823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0637b070 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f73f40564a0 tx=0x7f73f40528b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7a233a27578869 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73e7e00640 1 -- 172.21.15.144:0/3691932823 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f405a910 con 0x563e06366440 2024-09-12T12:18:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73e7e00640 1 -- 172.21.15.144:0/3691932823 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f405f140 con 0x563e06366440 2024-09-12T12:18:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73e7e00640 1 -- 172.21.15.144:0/3691932823 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4052bd0 con 0x563e06366440 2024-09-12T12:18:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 -- 172.21.15.144:0/3691932823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 msgr2=0x563e0637b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 --2- 172.21.15.144:0/3691932823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0637b070 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f73f40564a0 tx=0x7f73f40528b0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 -- 172.21.15.144:0/3691932823 shutdown_connections 2024-09-12T12:18:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 --2- 172.21.15.144:0/3691932823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06366440 0x563e0637b070 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 --2- 172.21.15.144:0/3691932823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 0x563e06365230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 --2- 172.21.15.144:0/3691932823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06321390 0x563e06364cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 -- 172.21.15.144:0/3691932823 >> 172.21.15.144:0/3691932823 conn(0x563e0631c290 msgr2=0x563e06320ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 -- 172.21.15.144:0/3691932823 shutdown_connections 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 -- 172.21.15.144:0/3691932823 wait complete. 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 -- start start 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 Processor -- start 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06321390 0x563e063d5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 0x563e0636fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06366440 0x563e06370240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563e06169f80 con 0x563e06321390 2024-09-12T12:18:41.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563e06122ca0 con 0x563e06366440 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x563e0616f2a0 con 0x563e06365b20 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7405fff000 10 client.0 _ll_register_callbacks cb 0x7f73ec00ed00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06321390 0x563e063d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06321390 0x563e063d5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43516/0 (socket says 172.21.15.144:43516) 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fbe00640 1 -- 172.21.15.144:0/1956902521 learned_addr learned my addr 172.21.15.144:0/1956902521 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f7400e00640 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06366440 0x563e06370240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fb400640 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 0x563e0636fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fbe00640 1 -- 172.21.15.144:0/1956902521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 msgr2=0x563e0636fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 0x563e0636fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fbe00640 1 -- 172.21.15.144:0/1956902521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06366440 msgr2=0x563e06370240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06366440 0x563e06370240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fbe00640 1 -- 172.21.15.144:0/1956902521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e060f1fd0 con 0x563e06321390 2024-09-12T12:18:41.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73fbe00640 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06321390 0x563e063d5610 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00ea30 tx=0x7f73ec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfccf54712c5f339 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.369+0000 7f73e5600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73e5600640 1 -- 172.21.15.144:0/1956902521 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec036030 con 0x563e06321390 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73e5600640 1 -- 172.21.15.144:0/1956902521 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f73ec010050 con 0x563e06321390 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 -- 172.21.15.144:0/1956902521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73f405f140 con 0x563e06321390 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73e5600640 1 -- 172.21.15.144:0/1956902521 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f73ec014800 con 0x563e06321390 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 10 client.7764 fetch_fsmap learned FSMap version 88 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 -- 172.21.15.144:0/1956902521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) -- 0x563e061ed750 con 0x563e06321390 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73e5600640 1 -- 172.21.15.144:0/1956902521 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f405f140 con 0x563e06321390 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73e5600640 1 -- 172.21.15.144:0/1956902521 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 88) ==== 3502+0+0 (secure 0 0 0) 0x7f73ec031040 con 0x563e06321390 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 10 client.7764 fetch_fsmap finished waiting for FSMap version 88 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 10 client.7764 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 20 client.7764 populate_metadata read hostname 'smithi144' 2024-09-12T12:18:41.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x563e06370780 0x563e06370b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 4 client.7764 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:18:41.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 -- 172.21.15.144:0/1956902521 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "status"}) -- 0x563e061783a0 con 0x563e06370780 2024-09-12T12:18:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73fb400640 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x563e06370780 0x563e06370b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73e5600640 10 client.7764 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:18:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73fb400640 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x563e06370780 0x563e06370b60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11496ebe12e5904e server_cookie=29200dfb4a6c2909 in_seq=0 out_seq=0 2024-09-12T12:18:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73e5600640 1 -- 172.21.15.144:0/1956902521 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x563e061783a0 con 0x563e06370780 2024-09-12T12:18:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73e5600640 10 client.7764 handle_command_reply: tid=0 2024-09-12T12:18:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 client.7764 shutdown 2024-09-12T12:18:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 -- 172.21.15.144:0/1956902521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06321390 msgr2=0x563e063d5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06321390 0x563e063d5610 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00ea30 tx=0x7f73ec013000 comp rx=0 tx=0).stop 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 -- 172.21.15.144:0/1956902521 shutdown_connections 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x563e06370780 0x563e06370b60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563e06366440 0x563e06370240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563e06365b20 0x563e0636fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f73e5600640 0 client.7764 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 --2- 172.21.15.144:0/1956902521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e06321390 0x563e063d5610 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 -- 172.21.15.144:0/1956902521 >> 172.21.15.144:0/1956902521 conn(0x563e0631c290 msgr2=0x563e06363ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 -- 172.21.15.144:0/1956902521 shutdown_connections 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 1 -- 172.21.15.144:0/1956902521 wait complete. 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7405fff000 20 client.7764 trim_cache size 0 max 16384 2024-09-12T12:18:41.377 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 7273, 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 10.39586188, 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 88, 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 114, 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 114, 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 15.624116316 2024-09-12T12:18:41.378 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:18:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 -- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc0678f0 msgr2=0x7f73dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc0678f0 0x7f73dc069db0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0012f0 tx=0x7f73ec009040 comp rx=0 tx=0).stop 2024-09-12T12:18:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 -- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc15e560 msgr2=0x7f73fc15d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc15e560 0x7f73fc15d330 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f73f400d800 tx=0x7f73f400dcc0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 -- 172.21.15.144:0/1701492740 shutdown_connections 2024-09-12T12:18:41.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f73dc0678f0 0x7f73dc069db0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73fc15e560 0x7f73fc15d330 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73fc0cec50 0x7f73fc15cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 --2- 172.21.15.144:0/1701492740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73fc0b68f0 0x7f73fc14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 -- 172.21.15.144:0/1701492740 >> 172.21.15.144:0/1701492740 conn(0x7f73fc0d1270 msgr2=0x7f73fc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:41.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 -- 172.21.15.144:0/1701492740 shutdown_connections 2024-09-12T12:18:41.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.373+0000 7f7401800640 1 -- 172.21.15.144:0/1701492740 wait complete. 2024-09-12T12:18:41.392 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:18:41.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17d0200640 1 Processor -- start 2024-09-12T12:18:41.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17d0200640 1 -- start start 2024-09-12T12:18:41.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17d0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815c7b0 0x7f17c80ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17d0200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f17c80b5fb0 0x7f17c8072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17d0200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c80cd870 con 0x7f17c815cd30 2024-09-12T12:18:41.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17d0200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f17c8072a50 con 0x7f17c80b5fb0 2024-09-12T12:18:41.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17d0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f17c80cde30 con 0x7f17c815c7b0 2024-09-12T12:18:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17ce200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f17c80b5fb0 0x7f17c8072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17cd800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815c7b0 0x7f17c80ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17cce00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f17c815cd30 0x7f17c80b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:59958/0 (socket says 172.21.15.144:59958) 2024-09-12T12:18:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17ce200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f17c80b5fb0 0x7f17c8072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:35670/0 (socket says 172.21.15.144:35670) 2024-09-12T12:18:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.529+0000 7f17cce00640 1 -- 172.21.15.144:0/3388310482 learned_addr learned my addr 172.21.15.144:0/3388310482 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:18:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17cd800640 1 -- 172.21.15.144:0/3388310482 >> v2:172.21.15.165:3300/0 conn(0x7f17c80b5fb0 msgr2=0x7f17c8072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17cd800640 1 --2- 172.21.15.144:0/3388310482 >> v2:172.21.15.165:3300/0 conn(0x7f17c80b5fb0 0x7f17c8072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17cd800640 1 -- 172.21.15.144:0/3388310482 >> v1:172.21.15.165:6789/0 conn(0x7f17c815cd30 legacy=0x7f17c80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17cd800640 1 -- 172.21.15.144:0/3388310482 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c80cdb50 con 0x7f17c815c7b0 2024-09-12T12:18:41.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17ce200640 1 --2- 172.21.15.144:0/3388310482 >> v2:172.21.15.165:3300/0 conn(0x7f17c80b5fb0 0x7f17c8072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:41.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17cd800640 1 --2- 172.21.15.144:0/3388310482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815c7b0 0x7f17c80ccf00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0097c0 tx=0x7f17bc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5b37a863d97ba7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17c7e00640 1 -- 172.21.15.144:0/3388310482 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0b1070 con 0x7f17c815c7b0 2024-09-12T12:18:41.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17c7e00640 1 -- 172.21.15.144:0/3388310482 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17bc0ac410 con 0x7f17c815c7b0 2024-09-12T12:18:41.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17c7e00640 1 -- 172.21.15.144:0/3388310482 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0ac7e0 con 0x7f17c815c7b0 2024-09-12T12:18:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17d0200640 1 -- 172.21.15.144:0/3388310482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815c7b0 msgr2=0x7f17c80ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.533+0000 7f17d0200640 1 --2- 172.21.15.144:0/3388310482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815c7b0 0x7f17c80ccf00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0097c0 tx=0x7f17bc01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 -- 172.21.15.144:0/3388310482 shutdown_connections 2024-09-12T12:18:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 --2- 172.21.15.144:0/3388310482 >> v2:172.21.15.165:3300/0 conn(0x7f17c80b5fb0 0x7f17c8072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 --2- 172.21.15.144:0/3388310482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815c7b0 0x7f17c80ccf00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 -- 172.21.15.144:0/3388310482 >> 172.21.15.144:0/3388310482 conn(0x7f17c806d0d0 msgr2=0x7f17c806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 -- 172.21.15.144:0/3388310482 shutdown_connections 2024-09-12T12:18:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 -- 172.21.15.144:0/3388310482 wait complete. 2024-09-12T12:18:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 Processor -- start 2024-09-12T12:18:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 -- start start 2024-09-12T12:18:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17c80b5fb0 0x7f17c81658b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c815c7b0 0x7f17c80b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815cd30 0x7f17c8159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f17c8073fc0 con 0x7f17c815c7b0 2024-09-12T12:18:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f17c8073e40 con 0x7f17c80b5fb0 2024-09-12T12:18:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f17c8074140 con 0x7f17c815cd30 2024-09-12T12:18:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c815c7b0 0x7f17c80b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c815c7b0 0x7f17c80b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43532/0 (socket says 172.21.15.144:43532) 2024-09-12T12:18:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cce00640 1 -- 172.21.15.144:0/341838764 learned_addr learned my addr 172.21.15.144:0/341838764 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cd800640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17c80b5fb0 0x7f17c81658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17ce200640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815cd30 0x7f17c8159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cce00640 1 -- 172.21.15.144:0/341838764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815cd30 msgr2=0x7f17c8159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cce00640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815cd30 0x7f17c8159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cce00640 1 -- 172.21.15.144:0/341838764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17c80b5fb0 msgr2=0x7f17c81658b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cce00640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17c80b5fb0 0x7f17c81658b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cce00640 1 -- 172.21.15.144:0/341838764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c8157230 con 0x7f17c815c7b0 2024-09-12T12:18:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17cce00640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c815c7b0 0x7f17c80b45b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f17b400c370 tx=0x7f17b400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17c5600640 1 -- 172.21.15.144:0/341838764 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4017070 con 0x7f17c815c7b0 2024-09-12T12:18:41.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17c5600640 1 -- 172.21.15.144:0/341838764 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b4005cf0 con 0x7f17c815c7b0 2024-09-12T12:18:41.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.537+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c8157510 con 0x7f17c815c7b0 2024-09-12T12:18:41.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.541+0000 7f17c5600640 1 -- 172.21.15.144:0/341838764 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b40072f0 con 0x7f17c815c7b0 2024-09-12T12:18:41.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.541+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c80b3920 con 0x7f17c815c7b0 2024-09-12T12:18:41.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.541+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c8072ec0 con 0x7f17c815c7b0 2024-09-12T12:18:41.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.541+0000 7f17c5600640 1 -- 172.21.15.144:0/341838764 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17b401a070 con 0x7f17c815c7b0 2024-09-12T12:18:41.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.541+0000 7f17c5600640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17a80678c0 0x7f17a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:41.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.541+0000 7f17c5600640 1 -- 172.21.15.144:0/341838764 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7f17b4085180 con 0x7f17c815c7b0 2024-09-12T12:18:41.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.541+0000 7f17cd800640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17a80678c0 0x7f17a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:41.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.541+0000 7f17cd800640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17a80678c0 0x7f17a8069d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0ae000 tx=0x7f17bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:41.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.545+0000 7f17c5600640 1 -- 172.21.15.144:0/341838764 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f17b4055450 con 0x7f17c815c7b0 2024-09-12T12:18:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.737+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f17c81609a0 con 0x7f17c815c7b0 2024-09-12T12:18:41.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.737+0000 7f17c5600640 1 -- 172.21.15.144:0/341838764 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) ==== 53+0+73 (secure 0 0 0) 0x7f17b4059750 con 0x7f17c815c7b0 2024-09-12T12:18:41.738 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:18:41.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17a80678c0 msgr2=0x7f17a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17a80678c0 0x7f17a8069d80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0ae000 tx=0x7f17bc008040 comp rx=0 tx=0).stop 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c815c7b0 msgr2=0x7f17c80b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c815c7b0 0x7f17c80b45b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f17b400c370 tx=0x7f17b400c830 comp rx=0 tx=0).stop 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 shutdown_connections 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17a80678c0 0x7f17a8069d80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17c815cd30 0x7f17c8159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17c815c7b0 0x7f17c80b45b0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 --2- 172.21.15.144:0/341838764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17c80b5fb0 0x7f17c81658b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 >> 172.21.15.144:0/341838764 conn(0x7f17c806d0d0 msgr2=0x7f17c80b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 shutdown_connections 2024-09-12T12:18:41.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41.741+0000 7f17d0200640 1 -- 172.21.15.144:0/341838764 wait complete. 2024-09-12T12:18:41.759 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:18:41.759 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:18:41.759 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:18:41.759 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:18:41.759 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:18:41.759 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:18:41.759 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:18:41.759 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:18:41.759 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:18:41.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:18:41.760 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:18:41.769 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:18:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:18:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:18:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:18:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:18:41.769 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:18:41.769 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42061sec preferred_lft 42061sec 2024-09-12T12:18:41.770 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:18:41.771 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:18:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:18:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:18:41.772 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:18:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:18:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:18:41.772 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:18:41.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:18:41.773 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:18:41.831 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:18:41.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:18:41.833 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:18:41.885 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:18:41.885 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:18:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:18:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:18:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:18:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:18:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:18:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:18:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:18:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:18:41.886 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:18:41.887 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:18:41.887 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:18:41.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:18:41.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:18:41.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:18:41.887 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:18:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:18:42.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:18:42.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:18:42.020 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:18:42.029 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:18:42.029 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:18:42.030 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:18:42.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:18:42.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:18:42.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:18:42.094 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:18:42.146 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:18:42.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:18:42.147 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:18:42.197 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:18:42.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:18:42.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:18:42.286 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:18:42.286 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:18:42.299 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:18:42.299 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:18:42.299 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:18:42.299 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:18:42.299 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:18:42.302 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:18:42.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:18:42.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:18:42.322 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:18:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:18:42.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:18:42.435 INFO:teuthology.orchestra.run.smithi144.stdout:client7770 2024-09-12T12:18:42.435 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:18:42.435 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:42.444 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-12T12:18:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.625+0000 7fd8c6c00640 1 Processor -- start 2024-09-12T12:18:42.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.625+0000 7fd8c6c00640 1 -- start start 2024-09-12T12:18:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.625+0000 7fd8c6c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b3490 0x7fd8c00b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.625+0000 7fd8c6c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c006d630 0x7fd8c0155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.625+0000 7fd8c6c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c006cd20 con 0x7fd8c006d250 2024-09-12T12:18:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.625+0000 7fd8c6c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c0072620 con 0x7fd8c006d630 2024-09-12T12:18:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.625+0000 7fd8c6c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c00b4f30 con 0x7fd8c00b3490 2024-09-12T12:18:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8c4c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c006d630 0x7fd8c0155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8c4c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c006d630 0x7fd8c0155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43544/0 (socket says 172.21.15.144:43544) 2024-09-12T12:18:42.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8c4c00640 1 -- 172.21.15.144:0/2948623689 learned_addr learned my addr 172.21.15.144:0/2948623689 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:42.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8bf400640 1 --2- 172.21.15.144:0/2948623689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b3490 0x7fd8c00b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:42.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8c4c00640 1 -- 172.21.15.144:0/2948623689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b3490 msgr2=0x7fd8c00b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:42.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8c4c00640 1 --2- 172.21.15.144:0/2948623689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b3490 0x7fd8c00b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8c4c00640 1 -- 172.21.15.144:0/2948623689 >> v1:172.21.15.165:6789/0 conn(0x7fd8c006d250 legacy=0x7fd8c015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:42.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8c4c00640 1 -- 172.21.15.144:0/2948623689 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c00b3950 con 0x7fd8c006d630 2024-09-12T12:18:42.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8c4c00640 1 --2- 172.21.15.144:0/2948623689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d630 0x7fd8c0155820 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800bb40 tx=0x7fd8b801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbcc3a8b0b06a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:42.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8bea00640 1 -- 172.21.15.144:0/2948623689 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80b4070 con 0x7fd8c006d630 2024-09-12T12:18:42.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8bea00640 1 -- 172.21.15.144:0/2948623689 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b80a7c50 con 0x7fd8c006d630 2024-09-12T12:18:42.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.629+0000 7fd8bea00640 1 -- 172.21.15.144:0/2948623689 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80af440 con 0x7fd8c006d630 2024-09-12T12:18:42.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 -- 172.21.15.144:0/2948623689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d630 msgr2=0x7fd8c0155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:42.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 --2- 172.21.15.144:0/2948623689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d630 0x7fd8c0155820 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800bb40 tx=0x7fd8b801eba0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 -- 172.21.15.144:0/2948623689 shutdown_connections 2024-09-12T12:18:42.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 --2- 172.21.15.144:0/2948623689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d630 0x7fd8c0155820 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 --2- 172.21.15.144:0/2948623689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c00b3490 0x7fd8c00b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 -- 172.21.15.144:0/2948623689 >> 172.21.15.144:0/2948623689 conn(0x7fd8c006bc10 msgr2=0x7fd8c006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:42.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 -- 172.21.15.144:0/2948623689 shutdown_connections 2024-09-12T12:18:42.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 -- 172.21.15.144:0/2948623689 wait complete. 2024-09-12T12:18:42.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 Processor -- start 2024-09-12T12:18:42.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 -- start start 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d250 0x7fd8c0148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c006d630 0x7fd8c0143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00b3490 0x7fd8c0143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c00b44d0 con 0x7fd8c006d250 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c00b41f0 con 0x7fd8c00b3490 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c6c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c015d690 con 0x7fd8c006d630 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d250 0x7fd8c0148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8bfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d250 0x7fd8c0148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43554/0 (socket says 172.21.15.144:43554) 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8bfe00640 1 -- 172.21.15.144:0/530630131 learned_addr learned my addr 172.21.15.144:0/530630131 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:18:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8bf400640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c006d630 0x7fd8c0143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8c4c00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00b3490 0x7fd8c0143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8bfe00640 1 -- 172.21.15.144:0/530630131 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c006d630 msgr2=0x7fd8c0143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c006d630 0x7fd8c0143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8bfe00640 1 -- 172.21.15.144:0/530630131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00b3490 msgr2=0x7fd8c0143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00b3490 0x7fd8c0143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.633+0000 7fd8bfe00640 1 -- 172.21.15.144:0/530630131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c0150a90 con 0x7fd8c006d250 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8bfe00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d250 0x7fd8c0148250 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000c7c0 tx=0x7fd8b000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8b7e00640 1 -- 172.21.15.144:0/530630131 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0016020 con 0x7fd8c006d250 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8b7e00640 1 -- 172.21.15.144:0/530630131 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b000aa50 con 0x7fd8c006d250 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c0150d70 con 0x7fd8c006d250 2024-09-12T12:18:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8b7e00640 1 -- 172.21.15.144:0/530630131 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b0012420 con 0x7fd8c006d250 2024-09-12T12:18:42.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c0151330 con 0x7fd8c006d250 2024-09-12T12:18:42.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c0155820 con 0x7fd8c006d250 2024-09-12T12:18:42.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8b7e00640 1 -- 172.21.15.144:0/530630131 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8b0019020 con 0x7fd8c006d250 2024-09-12T12:18:42.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8b7e00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678c0 0x7fd8a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:42.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8b7e00640 1 -- 172.21.15.144:0/530630131 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6101+0+0 (secure 0 0 0) 0x7fd8b0085dd0 con 0x7fd8c006d250 2024-09-12T12:18:42.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.637+0000 7fd8bf400640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678c0 0x7fd8a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:42.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.641+0000 7fd8bf400640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678c0 0x7fd8a0069d80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0151da0 tx=0x7fd8ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:42.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.641+0000 7fd8b7e00640 1 -- 172.21.15.144:0/530630131 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd8b0020030 con 0x7fd8c006d250 2024-09-12T12:18:42.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:42.833+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fd8c0072c20 con 0x7fd8c006d250 2024-09-12T12:18:43.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:18:43.357 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:18:43.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8b7e00640 1 -- 172.21.15.144:0/530630131 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v89) ==== 167+0+0 (secure 0 0 0) 0x7fd8b0056090 con 0x7fd8c006d250 2024-09-12T12:18:43.563 INFO:teuthology.orchestra.run.smithi144.stderr:enabled new snapshots 2024-09-12T12:18:43.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678c0 msgr2=0x7fd8a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:43.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678c0 0x7fd8a0069d80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0151da0 tx=0x7fd8ac008040 comp rx=0 tx=0).stop 2024-09-12T12:18:43.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d250 msgr2=0x7fd8c0148250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:43.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d250 0x7fd8c0148250 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fd8b000c7c0 tx=0x7fd8b000cc80 comp rx=0 tx=0).stop 2024-09-12T12:18:43.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 shutdown_connections 2024-09-12T12:18:43.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8a00678c0 0x7fd8a0069d80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:43.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00b3490 0x7fd8c0143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:43.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c006d630 0x7fd8c0143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:43.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 --2- 172.21.15.144:0/530630131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c006d250 0x7fd8c0148250 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:43.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 >> 172.21.15.144:0/530630131 conn(0x7fd8c006bc10 msgr2=0x7fd8c015c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:43.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 shutdown_connections 2024-09-12T12:18:43.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:18:43.565+0000 7fd8c6c00640 1 -- 172.21.15.144:0/530630131 wait complete. 2024-09-12T12:18:43.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:18:43.587 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-12T12:18:43.603 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:18:43.603 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:18:43.655 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:18:43.655 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:18:43.655 DEBUG:teuthology.orchestra.run.smithi144:> import uuid 2024-09-12T12:18:43.655 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:18:43.655 DEBUG:teuthology.orchestra.run.smithi144:> n = 2000 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> create_hard_links = False 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> if 3 > 0: 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> create_hard_links = True 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> dpath = os.path.dirname(path) 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> fnameprefix = os.path.basename(path) 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> os.makedirs(dpath, exist_ok=True) 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> try: 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:18:43.656 DEBUG:teuthology.orchestra.run.smithi144:> for i in range(n): 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> f.write(f"{i}") 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> f.flush() 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(f.fileno()) 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> os.unlink(fpath) 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(dirfd) 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> if create_hard_links: 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> for j in range(3): 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T12:18:43.657 DEBUG:teuthology.orchestra.run.smithi144:> if False: 2024-09-12T12:18:43.658 DEBUG:teuthology.orchestra.run.smithi144:> os.fsync(dirfd) 2024-09-12T12:18:43.658 DEBUG:teuthology.orchestra.run.smithi144:> finally: 2024-09-12T12:18:43.658 DEBUG:teuthology.orchestra.run.smithi144:> os.close(dirfd) 2024-09-12T12:18:43.658 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:19:07.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:19:07.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:19:07.207 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-12T12:19:07.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:19:07.416 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-12T12:19:13.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:19:13.435 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:19:36.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:19:36.273 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-12T12:19:36.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-12T12:19:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f93a0e00640 1 Processor -- start 2024-09-12T12:19:36.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f93a0e00640 1 -- start start 2024-09-12T12:19:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f93a0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f939c15c2e0 0x7f939c072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f93a0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c06c320 0x7f939c0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f93a0e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f939c0733e0 con 0x7f939c0af5f0 2024-09-12T12:19:36.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f93a0e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f939c0cd290 con 0x7f939c15c2e0 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f93a0e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f939c0cd570 con 0x7f939c06c320 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f9399e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f939c15c2e0 0x7f939c072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f9399e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f939c15c2e0 0x7f939c072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60618/0 (socket says 172.21.15.144:60618) 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f9399e00640 1 -- 172.21.15.144:0/2007568164 learned_addr learned my addr 172.21.15.144:0/2007568164 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f939a800640 1 --2- 172.21.15.144:0/2007568164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c06c320 0x7f939c0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f9399e00640 1 -- 172.21.15.144:0/2007568164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c06c320 msgr2=0x7f939c0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f9399e00640 1 --2- 172.21.15.144:0/2007568164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c06c320 0x7f939c0cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f9399e00640 1 -- 172.21.15.144:0/2007568164 >> v1:172.21.15.165:6789/0 conn(0x7f939c0af5f0 legacy=0x7f939c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f9399e00640 1 -- 172.21.15.144:0/2007568164 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c0cd850 con 0x7f939c15c2e0 2024-09-12T12:19:36.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.541+0000 7f939a800640 1 --2- 172.21.15.144:0/2007568164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c06c320 0x7f939c0cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f9399e00640 1 --2- 172.21.15.144:0/2007568164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c15c2e0 0x7f939c072b50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f938c009870 tx=0x7f938c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5830f24d0a24d251 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f9398a00640 1 -- 172.21.15.144:0/2007568164 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0b0070 con 0x7f939c15c2e0 2024-09-12T12:19:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f9398a00640 1 -- 172.21.15.144:0/2007568164 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0ab600 con 0x7f939c15c2e0 2024-09-12T12:19:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f9398a00640 1 -- 172.21.15.144:0/2007568164 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0ab9d0 con 0x7f939c15c2e0 2024-09-12T12:19:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f93a0e00640 1 -- 172.21.15.144:0/2007568164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c15c2e0 msgr2=0x7f939c072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f93a0e00640 1 --2- 172.21.15.144:0/2007568164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c15c2e0 0x7f939c072b50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f938c009870 tx=0x7f938c01c440 comp rx=0 tx=0).stop 2024-09-12T12:19:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f93a0e00640 1 -- 172.21.15.144:0/2007568164 shutdown_connections 2024-09-12T12:19:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f93a0e00640 1 --2- 172.21.15.144:0/2007568164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c06c320 0x7f939c0cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f93a0e00640 1 --2- 172.21.15.144:0/2007568164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c15c2e0 0x7f939c072b50 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f93a0e00640 1 -- 172.21.15.144:0/2007568164 >> 172.21.15.144:0/2007568164 conn(0x7f939c068030 msgr2=0x7f939c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f93a0e00640 1 -- 172.21.15.144:0/2007568164 shutdown_connections 2024-09-12T12:19:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.545+0000 7f93a0e00640 1 -- 172.21.15.144:0/2007568164 wait complete. 2024-09-12T12:19:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 Processor -- start 2024-09-12T12:19:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 -- start start 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f939c06c320 0x7f939c1570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c0af5f0 0x7f939c13a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c15c2e0 0x7f939c155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f939c0cee50 con 0x7f939c0af5f0 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f939c0cecd0 con 0x7f939c06c320 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f939c0cefd0 con 0x7f939c15c2e0 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c0af5f0 0x7f939c13a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f939c06c320 0x7f939c1570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c0af5f0 0x7f939c13a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60634/0 (socket says 172.21.15.144:60634) 2024-09-12T12:19:36.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399400640 1 -- 172.21.15.144:0/1257064341 learned_addr learned my addr 172.21.15.144:0/1257064341 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f939a800640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c15c2e0 0x7f939c155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399400640 1 -- 172.21.15.144:0/1257064341 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c15c2e0 msgr2=0x7f939c155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399400640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c15c2e0 0x7f939c155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399400640 1 -- 172.21.15.144:0/1257064341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f939c06c320 msgr2=0x7f939c1570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399400640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f939c06c320 0x7f939c1570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399400640 1 -- 172.21.15.144:0/1257064341 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c156040 con 0x7f939c0af5f0 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9399400640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c0af5f0 0x7f939c13a030 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f938800c420 tx=0x7f938800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9392000640 1 -- 172.21.15.144:0/1257064341 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93880052d0 con 0x7f939c0af5f0 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9392000640 1 -- 172.21.15.144:0/1257064341 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9388005470 con 0x7f939c0af5f0 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 -- 172.21.15.144:0/1257064341 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939c156320 con 0x7f939c0af5f0 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f9392000640 1 -- 172.21.15.144:0/1257064341 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388007260 con 0x7f939c0af5f0 2024-09-12T12:19:36.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.549+0000 7f93a0e00640 1 -- 172.21.15.144:0/1257064341 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c1568e0 con 0x7f939c0af5f0 2024-09-12T12:19:36.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9392000640 1 -- 172.21.15.144:0/1257064341 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9388007400 con 0x7f939c0af5f0 2024-09-12T12:19:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9392000640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f937c0678f0 0x7f937c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9392000640 1 -- 172.21.15.144:0/1257064341 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f93880852c0 con 0x7f939c0af5f0 2024-09-12T12:19:36.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399e00640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f937c0678f0 0x7f937c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f93a4120000 1 Processor -- start 2024-09-12T12:19:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f93a4120000 1 -- start start 2024-09-12T12:19:36.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399e00640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f937c0678f0 0x7f937c069db0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f938c0ad000 tx=0x7f938c0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f93a4120000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18ca1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f93a4120000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 0x55ec18c55240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f93a4120000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18c55b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f93a4120000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec18aa6cc0 con 0x55ec18c55780 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f93a4120000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ec18a61a20 con 0x55ec18ca2530 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f93a4120000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ec18aa2c80 con 0x55ec18ca1c10 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f939a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18c55b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 0x55ec18c55240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18ca1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 0x55ec18c55240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:46928/0 (socket says 172.21.15.144:46928) 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399400640 1 -- 172.21.15.144:0/181544360 learned_addr learned my addr 172.21.15.144:0/181544360 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f939a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18c55b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60644/0 (socket says 172.21.15.144:60644) 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399400640 1 -- 172.21.15.144:0/181544360 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 msgr2=0x55ec18ca1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399400640 1 --2- 172.21.15.144:0/181544360 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18ca1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399400640 1 -- 172.21.15.144:0/181544360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 msgr2=0x55ec18c55b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399400640 1 --2- 172.21.15.144:0/181544360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18c55b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f9399400640 1 -- 172.21.15.144:0/181544360 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec18a49d40 con 0x55ec18ca2530 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.553+0000 7f939a800640 1 --2- 172.21.15.144:0/181544360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18c55b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399400640 1 --2- 172.21.15.144:0/181544360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 0x55ec18c55240 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f938805dbf0 tx=0x7f938800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=421f5fcd2b18e2ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9386a00640 1 -- 172.21.15.144:0/181544360 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93880850c0 con 0x55ec18ca2530 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9386a00640 1 -- 172.21.15.144:0/181544360 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93880836b0 con 0x55ec18ca2530 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9386a00640 1 -- 172.21.15.144:0/181544360 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388054a40 con 0x55ec18ca2530 2024-09-12T12:19:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 -- 172.21.15.144:0/181544360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 msgr2=0x55ec18c55240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 --2- 172.21.15.144:0/181544360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 0x55ec18c55240 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f938805dbf0 tx=0x7f938800cf90 comp rx=0 tx=0).stop 2024-09-12T12:19:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 -- 172.21.15.144:0/181544360 shutdown_connections 2024-09-12T12:19:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 --2- 172.21.15.144:0/181544360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18c55b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 --2- 172.21.15.144:0/181544360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 0x55ec18c55240 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 --2- 172.21.15.144:0/181544360 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18ca1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 -- 172.21.15.144:0/181544360 >> 172.21.15.144:0/181544360 conn(0x55ec18c829b0 msgr2=0x55ec18c84da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 -- 172.21.15.144:0/181544360 shutdown_connections 2024-09-12T12:19:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 -- 172.21.15.144:0/181544360 wait complete. 2024-09-12T12:19:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 -- start start 2024-09-12T12:19:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 Processor -- start 2024-09-12T12:19:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18c55780 0x55ec18ca8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca1c10 0x55ec18ca94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18c5b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec18a402c0 con 0x55ec18ca2530 2024-09-12T12:19:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ec18a65370 con 0x55ec18ca1c10 2024-09-12T12:19:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ec18ab4f50 con 0x55ec18c55780 2024-09-12T12:19:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f93a4120000 10 client.0 _ll_register_callbacks cb 0x55ec18b07db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:36.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18c55780 0x55ec18ca8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f939a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18c5b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca1c10 0x55ec18ca94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18c55780 0x55ec18ca8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:39668/0 (socket says 172.21.15.144:39668) 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399e00640 1 -- 172.21.15.144:0/159854133 learned_addr learned my addr 172.21.15.144:0/159854133 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399400640 1 -- 172.21.15.144:0/159854133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18c55780 msgr2=0x55ec18ca8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399400640 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18c55780 0x55ec18ca8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399400640 1 -- 172.21.15.144:0/159854133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 msgr2=0x55ec18c5b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399400640 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18c5b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399400640 1 -- 172.21.15.144:0/159854133 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec18a46770 con 0x55ec18ca1c10 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f9399e00640 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18c55780 0x55ec18ca8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.557+0000 7f939a800640 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18c5b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f9399400640 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca1c10 0x55ec18ca94b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f938800cde0 tx=0x7f9388000bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e08dbc057032a0ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 1 -- 172.21.15.144:0/159854133 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93880850c0 con 0x55ec18ca1c10 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 -- 172.21.15.144:0/159854133 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93880836b0 con 0x55ec18ca1c10 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 1 -- 172.21.15.144:0/159854133 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f9388054c40 con 0x55ec18ca1c10 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 1 -- 172.21.15.144:0/159854133 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f9388073050 con 0x55ec18ca1c10 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 10 client.7432 fetch_fsmap learned FSMap version 89 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 -- 172.21.15.144:0/159854133 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55ec18a643f0 con 0x55ec18ca1c10 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 1 -- 172.21.15.144:0/159854133 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9388073e50 con 0x55ec18ca1c10 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 1 -- 172.21.15.144:0/159854133 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f9388051340 con 0x55ec18ca1c10 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 10 client.7432 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 10 client.7432 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 20 client.7432 populate_metadata read hostname 'smithi144' 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55ec18c5be00 0x55ec18c5c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 4 client.7432 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:19:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 -- 172.21.15.144:0/159854133 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec18a40d90 con 0x55ec18c5be00 2024-09-12T12:19:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f9399e00640 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55ec18c5be00 0x55ec18c5c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f9399e00640 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55ec18c5be00 0x55ec18c5c210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e00714d8659656 server_cookie=3c8b9747eec45437 in_seq=0 out_seq=0 2024-09-12T12:19:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 10 client.7432 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 1 -- 172.21.15.144:0/159854133 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec18a40d90 con 0x55ec18c5be00 2024-09-12T12:19:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 10 client.7432 handle_command_reply: tid=0 2024-09-12T12:19:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 client.7432 shutdown 2024-09-12T12:19:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 -- 172.21.15.144:0/159854133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca1c10 msgr2=0x55ec18ca94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca1c10 0x55ec18ca94b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f938800cde0 tx=0x7f9388000bd0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 -- 172.21.15.144:0/159854133 shutdown_connections 2024-09-12T12:19:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55ec18c5be00 0x55ec18c5c210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18c5b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f937b400640 0 client.7432 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca1c10 0x55ec18ca94b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 --2- 172.21.15.144:0/159854133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18c55780 0x55ec18ca8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 -- 172.21.15.144:0/159854133 >> 172.21.15.144:0/159854133 conn(0x55ec18c829b0 msgr2=0x55ec18c54940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 -- 172.21.15.144:0/159854133 shutdown_connections 2024-09-12T12:19:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 1 -- 172.21.15.144:0/159854133 wait complete. 2024-09-12T12:19:36.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.561+0000 7f93a4120000 20 client.7432 trim_cache size 0 max 16384 2024-09-12T12:19:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.577+0000 7f93a4120000 1 Processor -- start 2024-09-12T12:19:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.577+0000 7f93a4120000 1 -- start start 2024-09-12T12:19:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18caf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18cb8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 0x55ec18cb8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f939c2031b0 con 0x55ec18c55780 2024-09-12T12:19:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f939c15e640 con 0x55ec18ca2530 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f939c155160 con 0x55ec18ca1c10 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9399e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18caf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9399e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18caf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60660/0 (socket says 172.21.15.144:60660) 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9399e00640 1 -- 172.21.15.144:0/340294669 learned_addr learned my addr 172.21.15.144:0/340294669 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9399e00640 1 -- 172.21.15.144:0/340294669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 msgr2=0x55ec18cb8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9399e00640 1 --2- 172.21.15.144:0/340294669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18cb8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9399e00640 1 -- 172.21.15.144:0/340294669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 msgr2=0x55ec18cb8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9399e00640 1 --2- 172.21.15.144:0/340294669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 0x55ec18cb8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9399e00640 1 -- 172.21.15.144:0/340294669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec18b28320 con 0x55ec18c55780 2024-09-12T12:19:36.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9399e00640 1 --2- 172.21.15.144:0/340294669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18caf600 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f938c0b7040 tx=0x7f938c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adf20df5253f773 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9386000640 1 -- 172.21.15.144:0/340294669 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0d0070 con 0x55ec18c55780 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9386000640 1 -- 172.21.15.144:0/340294669 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0ca390 con 0x55ec18c55780 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f9386000640 1 -- 172.21.15.144:0/340294669 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0b0040 con 0x55ec18c55780 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- 172.21.15.144:0/340294669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 msgr2=0x55ec18caf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- 172.21.15.144:0/340294669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18caf600 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f938c0b7040 tx=0x7f938c004740 comp rx=0 tx=0).stop 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- 172.21.15.144:0/340294669 shutdown_connections 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- 172.21.15.144:0/340294669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18ca2530 0x55ec18cb8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- 172.21.15.144:0/340294669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18cb8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- 172.21.15.144:0/340294669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18c55780 0x55ec18caf600 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- 172.21.15.144:0/340294669 >> 172.21.15.144:0/340294669 conn(0x55ec18c829b0 msgr2=0x55ec18c53a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- 172.21.15.144:0/340294669 shutdown_connections 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- 172.21.15.144:0/340294669 wait complete. 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- start start 2024-09-12T12:19:36.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 Processor -- start 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18c55780 0x55ec18d1db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18d1e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18cae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec18a4e120 con 0x55ec18ca2530 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.581+0000 7f93a4120000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ec18b27e90 con 0x55ec18c55780 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ec18a50b90 con 0x55ec18ca1c10 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 10 client.0 _ll_register_callbacks cb 0x7f938806c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f939a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18cae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f939a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18cae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60668/0 (socket says 172.21.15.144:60668) 2024-09-12T12:19:36.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f939a800640 1 -- 172.21.15.144:0/976984728 learned_addr learned my addr 172.21.15.144:0/976984728 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f9399e00640 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18c55780 0x55ec18d1db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f9399400640 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18d1e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f939a800640 1 -- 172.21.15.144:0/976984728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 msgr2=0x55ec18d1e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f939a800640 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18d1e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f939a800640 1 -- 172.21.15.144:0/976984728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18c55780 msgr2=0x55ec18d1db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f939a800640 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18c55780 0x55ec18d1db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f939a800640 1 -- 172.21.15.144:0/976984728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec18a3a5c0 con 0x55ec18ca2530 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f939a800640 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18cae0d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f9394004a90 tx=0x7f9394004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0467f2a87774a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 1 -- 172.21.15.144:0/976984728 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394016b60 con 0x55ec18ca2530 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 1 -- 172.21.15.144:0/976984728 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f9394016d00 con 0x55ec18ca2530 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 -- 172.21.15.144:0/976984728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f938c0ca390 con 0x55ec18ca2530 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 1 -- 172.21.15.144:0/976984728 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f9394017410 con 0x55ec18ca2530 2024-09-12T12:19:36.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 10 client.7794 fetch_fsmap learned FSMap version 89 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 -- 172.21.15.144:0/976984728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55ec18a3e330 con 0x55ec18ca2530 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 1 -- 172.21.15.144:0/976984728 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0ca390 con 0x55ec18ca2530 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 1 -- 172.21.15.144:0/976984728 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f9394028050 con 0x55ec18ca2530 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 10 client.7794 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 10 client.7794 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 20 client.7794 populate_metadata read hostname 'smithi144' 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55ec18cae610 0x55ec18caea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 4 client.7794 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 -- 172.21.15.144:0/976984728 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55ec18ab43f0 con 0x55ec18cae610 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f9399e00640 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55ec18cae610 0x55ec18caea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 10 client.7794 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:36.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f9399e00640 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55ec18cae610 0x55ec18caea20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a09d0f72cc57ad1 server_cookie=cee6dba5f124d4b4 in_seq=0 out_seq=0 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 1 -- 172.21.15.144:0/976984728 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17987 (crc 0 0 0) 0x55ec18ab43f0 con 0x55ec18cae610 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 10 client.7794 handle_command_reply: tid=0 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 client.7794 shutdown 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 -- 172.21.15.144:0/976984728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 msgr2=0x55ec18cae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18cae0d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f9394004a90 tx=0x7f9394004830 comp rx=0 tx=0).stop 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 -- 172.21.15.144:0/976984728 shutdown_connections 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55ec18cae610 0x55ec18caea20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec18ca2530 0x55ec18cae0d0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ec18ca1c10 0x55ec18d1e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 --2- 172.21.15.144:0/976984728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ec18c55780 0x55ec18d1db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f937b400640 0 client.7794 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 -- 172.21.15.144:0/976984728 >> 172.21.15.144:0/976984728 conn(0x55ec18c829b0 msgr2=0x55ec18cb8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 -- 172.21.15.144:0/976984728 shutdown_connections 2024-09-12T12:19:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 1 -- 172.21.15.144:0/976984728 wait complete. 2024-09-12T12:19:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.585+0000 7f93a4120000 20 client.7794 trim_cache size 0 max 16384 2024-09-12T12:19:36.590 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:19:36.590 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:19:36.590 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 671, 2024-09-12T12:19:36.590 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 664, 2024-09-12T12:19:36.590 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 266648, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 6768944, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.094964827, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.044092560, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.025413991, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.021080101, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 664, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.135321928, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000203798 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:19:36.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000200, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000100 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 116368, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 20416 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1703, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1719, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 428157, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 26098838, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-12T12:19:36.592 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.227413010, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.119832438, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.042269080, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.051373898, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1718, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.248743854, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000144786 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 111712 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 29733, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 52093, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 10737470, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 78411569, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 4.870569422, 2024-09-12T12:19:36.594 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 2.897046752, 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 3.044381831, 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.083222745, 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 52092, 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.872435769, 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000035944 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 72527, 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.015614751, 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000215 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.595 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1571, 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 16.695658092, 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.010627408 2024-09-12T12:19:36.596 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1959, 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.761891552, 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000388918 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 25599, 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 25599, 2024-09-12T12:19:36.597 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 25599, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 333.983582941, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.013046743 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 12, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 19808, 2024-09-12T12:19:36.598 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 19808, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 19807, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 101, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 101, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 46639, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 46036, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-12T12:19:36.599 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 117, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-12T12:19:36.600 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 1411, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 4047, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:19:36.601 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 3641, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 2608, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 17, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 14111 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 2000, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 2, 2024-09-12T12:19:36.602 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 4184, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 1901, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 2242, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:19:36.603 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 29774, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 29774, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-12T12:19:36.604 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 46, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 46, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 4, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 98276140, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2847, 2024-09-12T12:19:36.605 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 98.367032895, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.034551117 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 2014, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 2014, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 0, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 13, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 13, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 0, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 19808, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 19809, 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 1, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 101, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 2251, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 2150, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 114844, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 231732 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 28612, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 25599, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 4, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-12T12:19:36.607 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2000, 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.717099861, 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000858549 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 29, 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.005810458, 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000200360 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 6000, 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 7.054526831, 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001175754 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 7314, 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 5.200133226, 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000710983 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-12T12:19:36.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.610 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000067583, 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000067583 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.003946368, 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.003946368 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:19:36.612 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.140239718, 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.140239718 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000141472, 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000141472 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8, 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.565957359, 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.070744669 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.613 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2242, 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 299.974684520, 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.133797807 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.072983231, 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.072983231 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.615 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000287444, 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000287444 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.616 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.617 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8000, 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 19.247704870, 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002405963 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:19:36.618 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 1, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 0, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 18141, 2024-09-12T12:19:36.619 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 18141, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 53, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:19:36.620 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:19:36.621 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:19:36.622 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 16904351, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 4323, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 5520, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 78, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:19:36.623 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 21201492, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 816811, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 4952, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 94559745, 2024-09-12T12:19:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 37, 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 4952, 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4952, 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 26.351725605, 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.005321430 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4952, 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 5051 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 4952, 2024-09-12T12:19:36.625 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 34, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 4918, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 11, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 34, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 2881, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 24, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 1901, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 34, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-12T12:19:36.626 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 22, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-12T12:19:36.627 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 116, 2024-09-12T12:19:36.628 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 3, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 8, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 8, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 112, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 0, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 32 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2024-09-12T12:19:36.629 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 32, 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 32, 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 1901, 2024-09-12T12:19:36.630 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 1901, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 32103, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 8537977, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 32103, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:19:36.631 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 32103, 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 8537977, 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-12T12:19:36.632 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 4952, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 94766954, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 4952, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 94766954, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.633 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 4952, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 4952, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 4952, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 4952, 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:19:36.634 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 1901, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 207209, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 1901, 2024-09-12T12:19:36.635 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 34, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 207209, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x558d7384c780": { 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 84, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:19:36.636 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 29774, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 94081836, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 29774, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2847, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 94081752, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:36.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:36.638 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:19:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 -- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f937c0678f0 msgr2=0x7f937c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f937c0678f0 0x7f937c069db0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f938c0ad000 tx=0x7f938c0a6000 comp rx=0 tx=0).stop 2024-09-12T12:19:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 -- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c0af5f0 msgr2=0x7f939c13a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c0af5f0 0x7f939c13a030 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f938800c420 tx=0x7f938800c8e0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 -- 172.21.15.144:0/1257064341 shutdown_connections 2024-09-12T12:19:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f937c0678f0 0x7f937c069db0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f939c15c2e0 0x7f939c155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f939c0af5f0 0x7f939c13a030 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 --2- 172.21.15.144:0/1257064341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f939c06c320 0x7f939c1570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 -- 172.21.15.144:0/1257064341 >> 172.21.15.144:0/1257064341 conn(0x7f939c068030 msgr2=0x7f939c0b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 -- 172.21.15.144:0/1257064341 shutdown_connections 2024-09-12T12:19:36.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.589+0000 7f93a0e00640 1 -- 172.21.15.144:0/1257064341 wait complete. 2024-09-12T12:19:36.640 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-12T12:19:36.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:19:36.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-09-12T12:19:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45bc600640 1 Processor -- start 2024-09-12T12:19:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45bc600640 1 -- start start 2024-09-12T12:19:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45bc600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f45b406d630 0x7f45b4155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45bc600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b406cd20 con 0x7f45b40b3490 2024-09-12T12:19:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45bc600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b40b3950 con 0x7f45b406d250 2024-09-12T12:19:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45bc600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f45b4072620 con 0x7f45b406d630 2024-09-12T12:19:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45b9200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f45b40b3490 0x7f45b40b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33814/0 (socket says 172.21.15.144:33814) 2024-09-12T12:19:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45b9200640 1 -- 172.21.15.144:0/1446774163 learned_addr learned my addr 172.21.15.144:0/1446774163 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:19:36.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45ba600640 1 --2- 172.21.15.144:0/1446774163 >> v2:172.21.15.165:3300/0 conn(0x7f45b406d630 0x7f45b4155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45b3e00640 1 -- 172.21.15.144:0/1446774163 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852758951 0 0) 0x7f45b406cd20 con 0x7f45b40b3490 2024-09-12T12:19:36.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45b3e00640 1 -- 172.21.15.144:0/1446774163 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f459c003530 con 0x7f45b40b3490 2024-09-12T12:19:36.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45ba600640 1 -- 172.21.15.144:0/1446774163 >> v1:172.21.15.165:6789/0 conn(0x7f45b406d250 legacy=0x7f45b415c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45b3e00640 1 -- 172.21.15.144:0/1446774163 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 278347136 0 0) 0x7f45b40b3950 con 0x7f45b406d250 2024-09-12T12:19:36.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45ba600640 1 -- 172.21.15.144:0/1446774163 >> v1:172.21.15.144:6789/0 conn(0x7f45b40b3490 legacy=0x7f45b40b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.781+0000 7f45ba600640 1 -- 172.21.15.144:0/1446774163 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b40b3c30 con 0x7f45b406d630 2024-09-12T12:19:36.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45ba600640 1 --2- 172.21.15.144:0/1446774163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b406d630 0x7f45b4155820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0097f0 tx=0x7f45ac01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f19a33e5bf257c72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45b3e00640 1 -- 172.21.15.144:0/1446774163 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0aa5f0 con 0x7f45b406d630 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45b3e00640 1 -- 172.21.15.144:0/1446774163 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ac0af070 con 0x7f45b406d630 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45b3e00640 1 -- 172.21.15.144:0/1446774163 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0aa9b0 con 0x7f45b406d630 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45bc600640 1 -- 172.21.15.144:0/1446774163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b406d630 msgr2=0x7f45b4155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45bc600640 1 --2- 172.21.15.144:0/1446774163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b406d630 0x7f45b4155820 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0097f0 tx=0x7f45ac01c470 comp rx=0 tx=0).stop 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45bc600640 1 -- 172.21.15.144:0/1446774163 shutdown_connections 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45bc600640 1 --2- 172.21.15.144:0/1446774163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b406d630 0x7f45b4155820 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45bc600640 1 -- 172.21.15.144:0/1446774163 >> 172.21.15.144:0/1446774163 conn(0x7f45b406bc10 msgr2=0x7f45b406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45bc600640 1 -- 172.21.15.144:0/1446774163 shutdown_connections 2024-09-12T12:19:36.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.785+0000 7f45bc600640 1 -- 172.21.15.144:0/1446774163 wait complete. 2024-09-12T12:19:36.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 Processor -- start 2024-09-12T12:19:36.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 -- start start 2024-09-12T12:19:36.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b406d250 0x7f45b4157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b406d630 0x7f45b4153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45b40b3490 0x7f45b4150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45b415d690 con 0x7f45b406d250 2024-09-12T12:19:36.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45b40b44d0 con 0x7f45b406d630 2024-09-12T12:19:36.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45b415d810 con 0x7f45b40b3490 2024-09-12T12:19:36.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b406d250 0x7f45b4157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b406d250 0x7f45b4157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60682/0 (socket says 172.21.15.144:60682) 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9c00640 1 -- 172.21.15.144:0/2240754423 learned_addr learned my addr 172.21.15.144:0/2240754423 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9200640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b406d630 0x7f45b4153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45ba600640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45b40b3490 0x7f45b4150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9c00640 1 -- 172.21.15.144:0/2240754423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45b40b3490 msgr2=0x7f45b4150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9c00640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45b40b3490 0x7f45b4150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9c00640 1 -- 172.21.15.144:0/2240754423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b406d630 msgr2=0x7f45b4153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9c00640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b406d630 0x7f45b4153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9c00640 1 -- 172.21.15.144:0/2240754423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b4155290 con 0x7f45b406d250 2024-09-12T12:19:36.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b9c00640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b406d250 0x7f45b4157a80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f45a8001570 tx=0x7f45a800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b1600640 1 -- 172.21.15.144:0/2240754423 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8017070 con 0x7f45b406d250 2024-09-12T12:19:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b1600640 1 -- 172.21.15.144:0/2240754423 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a8003db0 con 0x7f45b406d250 2024-09-12T12:19:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45b1600640 1 -- 172.21.15.144:0/2240754423 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a80052b0 con 0x7f45b406d250 2024-09-12T12:19:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 -- 172.21.15.144:0/2240754423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b4156fa0 con 0x7f45b406d250 2024-09-12T12:19:36.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.789+0000 7f45bc600640 1 -- 172.21.15.144:0/2240754423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b4157560 con 0x7f45b406d250 2024-09-12T12:19:36.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.793+0000 7f45b1600640 1 -- 172.21.15.144:0/2240754423 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45a801a070 con 0x7f45b406d250 2024-09-12T12:19:36.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.793+0000 7f45b1600640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45940678f0 0x7f4594069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.793+0000 7f45b1600640 1 -- 172.21.15.144:0/2240754423 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f45a8085540 con 0x7f45b406d250 2024-09-12T12:19:36.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.793+0000 7f45b9200640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45940678f0 0x7f4594069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.793+0000 7f45bfa77000 1 Processor -- start 2024-09-12T12:19:36.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.793+0000 7f45bfa77000 1 -- start start 2024-09-12T12:19:36.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.793+0000 7f45b9200640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45940678f0 0x7f4594069db0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007fd0 tx=0x7f45a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d81840 0x555822d81c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d37ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d38000 0x555822d383e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555822b85b20 con 0x555822d82160 2024-09-12T12:19:36.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555822b40870 con 0x555822d38000 2024-09-12T12:19:36.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555822b81ae0 con 0x555822d81840 2024-09-12T12:19:36.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d37ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d37ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60696/0 (socket says 172.21.15.144:60696) 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9200640 1 -- 172.21.15.144:0/3958356127 learned_addr learned my addr 172.21.15.144:0/3958356127 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45ba600640 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d38000 0x555822d383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9c00640 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d81840 0x555822d81c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9200640 1 -- 172.21.15.144:0/3958356127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d81840 msgr2=0x555822d81c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9200640 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d81840 0x555822d81c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9200640 1 -- 172.21.15.144:0/3958356127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d38000 msgr2=0x555822d383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9200640 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d38000 0x555822d383e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9200640 1 -- 172.21.15.144:0/3958356127 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555822b58940 con 0x555822d82160 2024-09-12T12:19:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9c00640 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d81840 0x555822d81c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:36.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45b9200640 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d37ac0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f45a000fab0 tx=0x7f45a0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6c198f4857a70a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45a6000640 1 -- 172.21.15.144:0/3958356127 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0025070 con 0x555822d82160 2024-09-12T12:19:36.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45a6000640 1 -- 172.21.15.144:0/3958356127 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a0015bf0 con 0x555822d82160 2024-09-12T12:19:36.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45a6000640 1 -- 172.21.15.144:0/3958356127 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0020400 con 0x555822d82160 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 -- 172.21.15.144:0/3958356127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 msgr2=0x555822d37ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d37ac0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f45a000fab0 tx=0x7f45a0000ee0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 -- 172.21.15.144:0/3958356127 shutdown_connections 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d38000 0x555822d383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d37ac0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3958356127 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d81840 0x555822d81c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 -- 172.21.15.144:0/3958356127 >> 172.21.15.144:0/3958356127 conn(0x555822d3e160 msgr2=0x555822d363a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 -- 172.21.15.144:0/3958356127 shutdown_connections 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 -- 172.21.15.144:0/3958356127 wait complete. 2024-09-12T12:19:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 -- start start 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.797+0000 7f45bfa77000 1 Processor -- start 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 0x555822d6e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d81840 0x555822d3c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d3cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555822b528e0 con 0x555822d82160 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555822b299b0 con 0x555822d81840 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555822b4d260 con 0x555822d38000 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 10 client.0 _ll_register_callbacks cb 0x555822d23540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45ba600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d3cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d81840 0x555822d3c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 0x555822d6e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d81840 0x555822d3c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:46990/0 (socket says 172.21.15.144:46990) 2024-09-12T12:19:36.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9200640 1 -- 172.21.15.144:0/843661121 learned_addr learned my addr 172.21.15.144:0/843661121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9200640 1 -- 172.21.15.144:0/843661121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 msgr2=0x555822d6e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9200640 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 0x555822d6e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9200640 1 -- 172.21.15.144:0/843661121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 msgr2=0x555822d3cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9200640 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d3cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9200640 1 -- 172.21.15.144:0/843661121 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555822b40ac0 con 0x555822d81840 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9200640 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d81840 0x555822d3c980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f45a00068a0 tx=0x7f45a0000bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef4df89012bf513a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f459aa00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f459aa00640 1 -- 172.21.15.144:0/843661121 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0030020 con 0x555822d81840 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f459aa00640 1 -- 172.21.15.144:0/843661121 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f45a0020d00 con 0x555822d81840 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 -- 172.21.15.144:0/843661121 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45a0015bf0 con 0x555822d81840 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f459aa00640 1 -- 172.21.15.144:0/843661121 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f45a003a050 con 0x555822d81840 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 10 client.7450 fetch_fsmap learned FSMap version 89 2024-09-12T12:19:36.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 -- 172.21.15.144:0/843661121 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x555822b25810 con 0x555822d81840 2024-09-12T12:19:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f459aa00640 1 -- 172.21.15.144:0/843661121 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a0015bf0 con 0x555822d81840 2024-09-12T12:19:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f459aa00640 1 -- 172.21.15.144:0/843661121 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f45a003d020 con 0x555822d81840 2024-09-12T12:19:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 10 client.7450 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:19:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 10 client.7450 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:19:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 20 client.7450 populate_metadata read hostname 'smithi144' 2024-09-12T12:19:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555822d6f710 0x555822d928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 4 client.7450 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:19:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 -- 172.21.15.144:0/843661121 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555822b1fe30 con 0x555822d6f710 2024-09-12T12:19:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9c00640 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555822d6f710 0x555822d928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45b9c00640 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555822d6f710 0x555822d928e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=927bee4e42c76ffe server_cookie=da22275e8816cc in_seq=0 out_seq=0 2024-09-12T12:19:36.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f459aa00640 10 client.7450 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f459aa00640 1 -- 172.21.15.144:0/843661121 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555822b1fe30 con 0x555822d6f710 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f459aa00640 10 client.7450 handle_command_reply: tid=0 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.801+0000 7f45bfa77000 1 client.7450 shutdown 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 -- 172.21.15.144:0/843661121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d81840 msgr2=0x555822d3c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d81840 0x555822d3c980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f45a00068a0 tx=0x7f45a0000bd0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 -- 172.21.15.144:0/843661121 shutdown_connections 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555822d6f710 0x555822d928e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d82160 0x555822d3cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d81840 0x555822d3c980 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 --2- 172.21.15.144:0/843661121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 0x555822d6e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 -- 172.21.15.144:0/843661121 >> 172.21.15.144:0/843661121 conn(0x555822d3e160 msgr2=0x555822d363a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f459aa00640 0 client.7450 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:36.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 -- 172.21.15.144:0/843661121 shutdown_connections 2024-09-12T12:19:36.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 1 -- 172.21.15.144:0/843661121 wait complete. 2024-09-12T12:19:36.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.805+0000 7f45bfa77000 20 client.7450 trim_cache size 0 max 16384 2024-09-12T12:19:36.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45bfa77000 1 Processor -- start 2024-09-12T12:19:36.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45bfa77000 1 -- start start 2024-09-12T12:19:36.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3d080 0x555822d39600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d3e160 0x555822d39b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d38000 0x555822d928e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45bfa77000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45b4203dd0 con 0x555822d38000 2024-09-12T12:19:36.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45bfa77000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45b4202e00 con 0x555822d3d080 2024-09-12T12:19:36.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45bfa77000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45b4154af0 con 0x555822d3e160 2024-09-12T12:19:36.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45ba600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d38000 0x555822d928e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45ba600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d38000 0x555822d928e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60712/0 (socket says 172.21.15.144:60712) 2024-09-12T12:19:36.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45ba600640 1 -- 172.21.15.144:0/2912374415 learned_addr learned my addr 172.21.15.144:0/2912374415 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45b9c00640 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3d080 0x555822d39600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45ba600640 1 -- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d3e160 msgr2=0x555822d39b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45b9200640 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d3e160 0x555822d39b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45ba600640 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d3e160 0x555822d39b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45ba600640 1 -- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3d080 msgr2=0x555822d39600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45ba600640 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3d080 0x555822d39600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45ba600640 1 -- 172.21.15.144:0/2912374415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555822b43240 con 0x555822d38000 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45b9c00640 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3d080 0x555822d39600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45b9200640 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d3e160 0x555822d39b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.821+0000 7f45ba600640 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d38000 0x555822d928e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009580 tx=0x7f45ac0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e84709377e55c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45a5600640 1 -- 172.21.15.144:0/2912374415 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0b5a00 con 0x555822d38000 2024-09-12T12:19:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45a5600640 1 -- 172.21.15.144:0/2912374415 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ac0c6070 con 0x555822d38000 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45a5600640 1 -- 172.21.15.144:0/2912374415 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0b5da0 con 0x555822d38000 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- 172.21.15.144:0/2912374415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d38000 msgr2=0x555822d928e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d38000 0x555822d928e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009580 tx=0x7f45ac0a7000 comp rx=0 tx=0).stop 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- 172.21.15.144:0/2912374415 shutdown_connections 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d38000 0x555822d928e0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d3e160 0x555822d39b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 --2- 172.21.15.144:0/2912374415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3d080 0x555822d39600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- 172.21.15.144:0/2912374415 >> 172.21.15.144:0/2912374415 conn(0x555822d3cca0 msgr2=0x555822d80c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- 172.21.15.144:0/2912374415 shutdown_connections 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- 172.21.15.144:0/2912374415 wait complete. 2024-09-12T12:19:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- start start 2024-09-12T12:19:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 Processor -- start 2024-09-12T12:19:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 0x555822d958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d3d080 0x555822db0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3e160 0x555822db1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555822b52520 con 0x555822d3d080 2024-09-12T12:19:36.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45b42028e0 con 0x555822d3e160 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555822b84e30 con 0x555822d38000 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 10 client.0 _ll_register_callbacks cb 0x7f45a0023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d3d080 0x555822db0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d3d080 0x555822db0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60716/0 (socket says 172.21.15.144:60716) 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9200640 1 -- 172.21.15.144:0/3479292663 learned_addr learned my addr 172.21.15.144:0/3479292663 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9c00640 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 0x555822d958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45ba600640 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3e160 0x555822db1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9200640 1 -- 172.21.15.144:0/3479292663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 msgr2=0x555822d958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9200640 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 0x555822d958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9200640 1 -- 172.21.15.144:0/3479292663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3e160 msgr2=0x555822db1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9200640 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3e160 0x555822db1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9200640 1 -- 172.21.15.144:0/3479292663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555822c08330 con 0x555822d3d080 2024-09-12T12:19:36.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45b9200640 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d3d080 0x555822db0bd0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f45a0020c10 tx=0x7f45a0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d54d1c221f5d27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f459aa00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f459aa00640 1 -- 172.21.15.144:0/3479292663 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0030070 con 0x555822d3d080 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f459aa00640 1 -- 172.21.15.144:0/3479292663 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f45a003fc50 con 0x555822d3d080 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.825+0000 7f45bfa77000 1 -- 172.21.15.144:0/3479292663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45ac0c6070 con 0x555822d3d080 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f459aa00640 1 -- 172.21.15.144:0/3479292663 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f45a0046050 con 0x555822d3d080 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45bfa77000 10 client.7812 fetch_fsmap learned FSMap version 89 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45bfa77000 1 -- 172.21.15.144:0/3479292663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x555822840400 con 0x555822d3d080 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f459aa00640 1 -- 172.21.15.144:0/3479292663 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ac0c6070 con 0x555822d3d080 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f459aa00640 1 -- 172.21.15.144:0/3479292663 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f45a0049020 con 0x555822d3d080 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45bfa77000 10 client.7812 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45bfa77000 10 client.7812 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45bfa77000 20 client.7812 populate_metadata read hostname 'smithi144' 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555822d81840 0x555822db1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:36.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45bfa77000 4 client.7812 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-12T12:19:36.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45bfa77000 1 -- 172.21.15.144:0/3479292663 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x555822b93250 con 0x555822d81840 2024-09-12T12:19:36.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45b9c00640 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555822d81840 0x555822db1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:36.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f459aa00640 10 client.7812 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:36.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.829+0000 7f45b9c00640 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555822d81840 0x555822db1650 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c2f85a437597e1 server_cookie=ece7d65f1dbc253 in_seq=0 out_seq=0 2024-09-12T12:19:36.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f459aa00640 1 -- 172.21.15.144:0/3479292663 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555822b93250 con 0x555822d81840 2024-09-12T12:19:36.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f459aa00640 10 client.7812 handle_command_reply: tid=0 2024-09-12T12:19:36.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 client.7812 shutdown 2024-09-12T12:19:36.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 -- 172.21.15.144:0/3479292663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d3d080 msgr2=0x555822db0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d3d080 0x555822db0bd0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f45a0020c10 tx=0x7f45a0012000 comp rx=0 tx=0).stop 2024-09-12T12:19:36.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 -- 172.21.15.144:0/3479292663 shutdown_connections 2024-09-12T12:19:36.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555822d81840 0x555822db1650 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555822d3e160 0x555822db1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555822d3d080 0x555822db0bd0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 --2- 172.21.15.144:0/3479292663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555822d38000 0x555822d958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 -- 172.21.15.144:0/3479292663 >> 172.21.15.144:0/3479292663 conn(0x555822d3cca0 msgr2=0x555822d385f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f459aa00640 0 client.7812 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:36.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 -- 172.21.15.144:0/3479292663 shutdown_connections 2024-09-12T12:19:36.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 1 -- 172.21.15.144:0/3479292663 wait complete. 2024-09-12T12:19:36.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bfa77000 20 client.7812 trim_cache size 0 max 16384 2024-09-12T12:19:36.839 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:19:36.839 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:19:36.839 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "3b1e8448-1489-4d57-a60e-b872bc1bc980", 2024-09-12T12:19:36.839 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:19:36.839 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:19:36.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 -- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45940678f0 msgr2=0x7f4594069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45940678f0 0x7f4594069db0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007fd0 tx=0x7f45a0009040 comp rx=0 tx=0).stop 2024-09-12T12:19:36.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 -- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b406d250 msgr2=0x7f45b4157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:36.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b406d250 0x7f45b4157a80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f45a8001570 tx=0x7f45a800cd00 comp rx=0 tx=0).stop 2024-09-12T12:19:36.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 -- 172.21.15.144:0/2240754423 shutdown_connections 2024-09-12T12:19:36.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45940678f0 0x7f4594069db0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45b40b3490 0x7f45b4150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b406d630 0x7f45b4153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 --2- 172.21.15.144:0/2240754423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45b406d250 0x7f45b4157a80 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:36.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.837+0000 7f45bc600640 1 -- 172.21.15.144:0/2240754423 >> 172.21.15.144:0/2240754423 conn(0x7f45b406bc10 msgr2=0x7f45b40b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:36.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.841+0000 7f45bc600640 1 -- 172.21.15.144:0/2240754423 shutdown_connections 2024-09-12T12:19:36.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:36.841+0000 7f45bc600640 1 -- 172.21.15.144:0/2240754423 wait complete. 2024-09-12T12:19:36.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:19:36.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-12T12:19:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.081+0000 7f20c5400640 1 Processor -- start 2024-09-12T12:19:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.081+0000 7f20c5400640 1 -- start start 2024-09-12T12:19:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.081+0000 7f20c5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20c015c3b0 0x7f20c0073b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.081+0000 7f20c5400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c015cd10 con 0x7f20c0160bf0 2024-09-12T12:19:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.081+0000 7f20c5400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c015cff0 con 0x7f20c00d2b30 2024-09-12T12:19:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.081+0000 7f20c5400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f20c015d640 con 0x7f20c015c3b0 2024-09-12T12:19:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20be800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20c015c3b0 0x7f20c0073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20bde00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f20c0160bf0 0x7f20c00d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46968/0 (socket says 172.21.15.144:46968) 2024-09-12T12:19:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20bde00640 1 -- 172.21.15.144:0/290024890 learned_addr learned my addr 172.21.15.144:0/290024890 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:19:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20be800640 1 -- 172.21.15.144:0/290024890 >> v1:172.21.15.165:6789/0 conn(0x7f20c00d2b30 legacy=0x7f20c00d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20be800640 1 -- 172.21.15.144:0/290024890 >> v1:172.21.15.144:6789/0 conn(0x7f20c0160bf0 legacy=0x7f20c00d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20bd400640 1 -- 172.21.15.144:0/290024890 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3241390687 0 0) 0x7f20c015cd10 con 0x7f20c0160bf0 2024-09-12T12:19:37.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20be800640 1 -- 172.21.15.144:0/290024890 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c015d2d0 con 0x7f20c015c3b0 2024-09-12T12:19:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20be800640 1 --2- 172.21.15.144:0/290024890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c015c3b0 0x7f20c0073b60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f20b00097c0 tx=0x7f20b001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a54166023c4433e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20bd400640 1 -- 172.21.15.144:0/290024890 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b00b1070 con 0x7f20c015c3b0 2024-09-12T12:19:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20bd400640 1 -- 172.21.15.144:0/290024890 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b00a8050 con 0x7f20c015c3b0 2024-09-12T12:19:37.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.085+0000 7f20bd400640 1 -- 172.21.15.144:0/290024890 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b00ac860 con 0x7f20c015c3b0 2024-09-12T12:19:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 -- 172.21.15.144:0/290024890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c015c3b0 msgr2=0x7f20c0073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 --2- 172.21.15.144:0/290024890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c015c3b0 0x7f20c0073b60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f20b00097c0 tx=0x7f20b001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 -- 172.21.15.144:0/290024890 shutdown_connections 2024-09-12T12:19:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 --2- 172.21.15.144:0/290024890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c015c3b0 0x7f20c0073b60 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 -- 172.21.15.144:0/290024890 >> 172.21.15.144:0/290024890 conn(0x7f20c006c010 msgr2=0x7f20c0067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 -- 172.21.15.144:0/290024890 shutdown_connections 2024-09-12T12:19:37.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 -- 172.21.15.144:0/290024890 wait complete. 2024-09-12T12:19:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 Processor -- start 2024-09-12T12:19:37.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 -- start start 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c00d2b30 0x7f20c0155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20c015c3b0 0x7f20c0155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20c0160bf0 0x7f20c014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20c00d15e0 con 0x7f20c00d2b30 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20c00d1460 con 0x7f20c0160bf0 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20c5400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20c016a130 con 0x7f20c015c3b0 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20be800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c00d2b30 0x7f20c0155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20be800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c00d2b30 0x7f20c0155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37602/0 (socket says 172.21.15.144:37602) 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20be800640 1 -- 172.21.15.144:0/774240428 learned_addr learned my addr 172.21.15.144:0/774240428 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:37.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20bde00640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20c015c3b0 0x7f20c0155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20bf200640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20c0160bf0 0x7f20c014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20be800640 1 -- 172.21.15.144:0/774240428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20c015c3b0 msgr2=0x7f20c0155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20be800640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20c015c3b0 0x7f20c0155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20be800640 1 -- 172.21.15.144:0/774240428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20c0160bf0 msgr2=0x7f20c014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20be800640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20c0160bf0 0x7f20c014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20be800640 1 -- 172.21.15.144:0/774240428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c00b3ee0 con 0x7f20c00d2b30 2024-09-12T12:19:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.089+0000 7f20be800640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c00d2b30 0x7f20c0155140 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f20b00097c0 tx=0x7f20b001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20b6a00640 1 -- 172.21.15.144:0/774240428 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b00bd070 con 0x7f20c00d2b30 2024-09-12T12:19:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20b6a00640 1 -- 172.21.15.144:0/774240428 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b00b2040 con 0x7f20c00d2b30 2024-09-12T12:19:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20b6a00640 1 -- 172.21.15.144:0/774240428 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b00b1050 con 0x7f20c00d2b30 2024-09-12T12:19:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20c5400640 1 -- 172.21.15.144:0/774240428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c00b41c0 con 0x7f20c00d2b30 2024-09-12T12:19:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20c5400640 1 -- 172.21.15.144:0/774240428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c0165670 con 0x7f20c00d2b30 2024-09-12T12:19:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20b6a00640 1 -- 172.21.15.144:0/774240428 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20b00c0070 con 0x7f20c00d2b30 2024-09-12T12:19:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20b6a00640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20a00678c0 0x7f20a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20b6a00640 1 -- 172.21.15.144:0/774240428 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f20b011fbc0 con 0x7f20c00d2b30 2024-09-12T12:19:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20bde00640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20a00678c0 0x7f20a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20c87e6000 1 Processor -- start 2024-09-12T12:19:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.093+0000 7f20c87e6000 1 -- start start 2024-09-12T12:19:37.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20bde00640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20a00678c0 0x7f20a0069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f20c0152d40 tx=0x7f20ac007240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966812d70 0x55a966813150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 0x55a9667c6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a9667c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a9666b0960 con 0x55a9667c6db0 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a9665f4900 con 0x55a966813690 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55a966617d40 con 0x55a966812d70 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20bf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a9667c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20bde00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 0x55a9667c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20be800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966812d70 0x55a966813150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20bf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a9667c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37606/0 (socket says 172.21.15.144:37606) 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20bf200640 1 -- 172.21.15.144:0/3638649678 learned_addr learned my addr 172.21.15.144:0/3638649678 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20be800640 1 -- 172.21.15.144:0/3638649678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 msgr2=0x55a9667c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20be800640 1 --2- 172.21.15.144:0/3638649678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 0x55a9667c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20be800640 1 -- 172.21.15.144:0/3638649678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 msgr2=0x55a9667c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20be800640 1 --2- 172.21.15.144:0/3638649678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a9667c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20be800640 1 -- 172.21.15.144:0/3638649678 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9665be580 con 0x55a966812d70 2024-09-12T12:19:37.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20bf200640 1 --2- 172.21.15.144:0/3638649678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a9667c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:19:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20be800640 1 --2- 172.21.15.144:0/3638649678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966812d70 0x55a966813150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f20b011dea0 tx=0x7f20b0019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95dfebd16868c456 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20ab400640 1 -- 172.21.15.144:0/3638649678 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b011c070 con 0x55a966812d70 2024-09-12T12:19:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20ab400640 1 -- 172.21.15.144:0/3638649678 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b00f3030 con 0x55a966812d70 2024-09-12T12:19:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20ab400640 1 -- 172.21.15.144:0/3638649678 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b00f4160 con 0x55a966812d70 2024-09-12T12:19:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 -- 172.21.15.144:0/3638649678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966812d70 msgr2=0x55a966813150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 --2- 172.21.15.144:0/3638649678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966812d70 0x55a966813150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f20b011dea0 tx=0x7f20b0019240 comp rx=0 tx=0).stop 2024-09-12T12:19:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 -- 172.21.15.144:0/3638649678 shutdown_connections 2024-09-12T12:19:37.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 --2- 172.21.15.144:0/3638649678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a9667c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 --2- 172.21.15.144:0/3638649678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 0x55a9667c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 --2- 172.21.15.144:0/3638649678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966812d70 0x55a966813150 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 -- 172.21.15.144:0/3638649678 >> 172.21.15.144:0/3638649678 conn(0x55a9667f4040 msgr2=0x55a9667f6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 -- 172.21.15.144:0/3638649678 shutdown_connections 2024-09-12T12:19:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 -- 172.21.15.144:0/3638649678 wait complete. 2024-09-12T12:19:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 -- start start 2024-09-12T12:19:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.097+0000 7f20c87e6000 1 Processor -- start 2024-09-12T12:19:37.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a9667c6db0 0x55a966819ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a96681a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 0x55a96681a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a966613d00 con 0x55a966812d70 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a9665d2aa0 con 0x55a966813690 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55a9665b1340 con 0x55a9667c6db0 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 10 client.0 _ll_register_callbacks cb 0x55a9667b4760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a96681a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a96681a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37616/0 (socket says 172.21.15.144:37616) 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bde00640 1 -- 172.21.15.144:0/4221875712 learned_addr learned my addr 172.21.15.144:0/4221875712 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bf200640 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 0x55a96681a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20be800640 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a9667c6db0 0x55a966819ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bde00640 1 -- 172.21.15.144:0/4221875712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a9667c6db0 msgr2=0x55a966819ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bde00640 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a9667c6db0 0x55a966819ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bde00640 1 -- 172.21.15.144:0/4221875712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 msgr2=0x55a96681a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bde00640 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 0x55a96681a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bde00640 1 -- 172.21.15.144:0/4221875712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9665badc0 con 0x55a966812d70 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bf200640 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 0x55a96681a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20bde00640 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a96681a220 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f20ac000c10 tx=0x7f20ac007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2676bb296018bf9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f209fe00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f209fe00640 1 -- 172.21.15.144:0/4221875712 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac020580 con 0x55a966812d70 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f209fe00640 1 -- 172.21.15.144:0/4221875712 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f20ac01b9f0 con 0x55a966812d70 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 -- 172.21.15.144:0/4221875712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20b00f3030 con 0x55a966812d70 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f209fe00640 1 -- 172.21.15.144:0/4221875712 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f20ac01bbf0 con 0x55a966812d70 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 10 client.7827 fetch_fsmap learned FSMap version 89 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 -- 172.21.15.144:0/4221875712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55a9665b77f0 con 0x55a966812d70 2024-09-12T12:19:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f209fe00640 1 -- 172.21.15.144:0/4221875712 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b00f3030 con 0x55a966812d70 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f209fe00640 1 -- 172.21.15.144:0/4221875712 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f20ac020720 con 0x55a966812d70 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 10 client.7827 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 10 client.7827 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 20 client.7827 populate_metadata read hostname 'smithi144' 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55a9668220b0 0x55a9668244a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 4 client.7827 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20c87e6000 1 -- 172.21.15.144:0/4221875712 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9665b1e10 con 0x55a9668220b0 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20be800640 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55a9668220b0 0x55a9668244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f209fe00640 10 client.7827 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:37.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f20be800640 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55a9668220b0 0x55a9668244a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cbe1b1756d19ce6 server_cookie=2301e6709778d53a in_seq=0 out_seq=0 2024-09-12T12:19:37.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f209fe00640 1 -- 172.21.15.144:0/4221875712 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9665b1e10 con 0x55a9668220b0 2024-09-12T12:19:37.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.101+0000 7f209fe00640 10 client.7827 handle_command_reply: tid=0 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 client.7827 shutdown 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 -- 172.21.15.144:0/4221875712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 msgr2=0x55a96681a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a96681a220 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f20ac000c10 tx=0x7f20ac007e50 comp rx=0 tx=0).stop 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 -- 172.21.15.144:0/4221875712 shutdown_connections 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55a9668220b0 0x55a9668244a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966813690 0x55a96681a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a96681a220 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 --2- 172.21.15.144:0/4221875712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a9667c6db0 0x55a966819ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f209fe00640 0 client.7827 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 -- 172.21.15.144:0/4221875712 >> 172.21.15.144:0/4221875712 conn(0x55a9667f4040 msgr2=0x55a9667c5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 -- 172.21.15.144:0/4221875712 shutdown_connections 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 1 -- 172.21.15.144:0/4221875712 wait complete. 2024-09-12T12:19:37.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.105+0000 7f20c87e6000 20 client.7827 trim_cache size 0 max 16384 2024-09-12T12:19:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20c87e6000 1 Processor -- start 2024-09-12T12:19:37.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20c87e6000 1 -- start start 2024-09-12T12:19:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9667c6db0 0x55a96681ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a966820480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 0x55a9667cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20c87e6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20c0203f00 con 0x55a966812d70 2024-09-12T12:19:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20c87e6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20c0202ff0 con 0x55a9667c6db0 2024-09-12T12:19:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20c87e6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20c0166900 con 0x55a966813690 2024-09-12T12:19:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a966820480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a966820480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37622/0 (socket says 172.21.15.144:37622) 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bde00640 1 -- 172.21.15.144:0/1167071804 learned_addr learned my addr 172.21.15.144:0/1167071804 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bf200640 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 0x55a9667cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20be800640 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9667c6db0 0x55a96681ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bde00640 1 -- 172.21.15.144:0/1167071804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 msgr2=0x55a9667cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bde00640 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 0x55a9667cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bde00640 1 -- 172.21.15.144:0/1167071804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9667c6db0 msgr2=0x55a96681ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bde00640 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9667c6db0 0x55a96681ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bde00640 1 -- 172.21.15.144:0/1167071804 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9665d5470 con 0x55a966812d70 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20be800640 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9667c6db0 0x55a96681ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20bde00640 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a966820480 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001b80 tx=0x7f20ac021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299c8a99222d0935 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20aaa00640 1 -- 172.21.15.144:0/1167071804 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac020c70 con 0x55a966812d70 2024-09-12T12:19:37.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20aaa00640 1 -- 172.21.15.144:0/1167071804 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac026070 con 0x55a966812d70 2024-09-12T12:19:37.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.121+0000 7f20aaa00640 1 -- 172.21.15.144:0/1167071804 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0207a0 con 0x55a966812d70 2024-09-12T12:19:37.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- 172.21.15.144:0/1167071804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 msgr2=0x55a966820480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a966820480 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001b80 tx=0x7f20ac021000 comp rx=0 tx=0).stop 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- 172.21.15.144:0/1167071804 shutdown_connections 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 0x55a9667cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a966812d70 0x55a966820480 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 --2- 172.21.15.144:0/1167071804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9667c6db0 0x55a96681ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- 172.21.15.144:0/1167071804 >> 172.21.15.144:0/1167071804 conn(0x55a9667f4040 msgr2=0x55a966819aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- 172.21.15.144:0/1167071804 shutdown_connections 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- 172.21.15.144:0/1167071804 wait complete. 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- start start 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 Processor -- start 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a966886770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966812d70 0x55a966886cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 0x55a96681ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a9665bdf20 con 0x55a9667c6db0 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20c0202aa0 con 0x55a966812d70 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55a9665d63f0 con 0x55a966813690 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 10 client.0 _ll_register_callbacks cb 0x7f20ac007cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20be800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a966886770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20be800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a966886770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37626/0 (socket says 172.21.15.144:37626) 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20be800640 1 -- 172.21.15.144:0/374736177 learned_addr learned my addr 172.21.15.144:0/374736177 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20bde00640 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966812d70 0x55a966886cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20bf200640 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 0x55a96681ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20be800640 1 -- 172.21.15.144:0/374736177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 msgr2=0x55a96681ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20be800640 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 0x55a96681ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20be800640 1 -- 172.21.15.144:0/374736177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966812d70 msgr2=0x55a966886cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20be800640 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966812d70 0x55a966886cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20be800640 1 -- 172.21.15.144:0/374736177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9665ab640 con 0x55a9667c6db0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20be800640 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a966886770 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f20b00f0020 tx=0x7f20b011dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b9a9db7f97c974 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f209fe00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f209fe00640 1 -- 172.21.15.144:0/374736177 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b011c040 con 0x55a9667c6db0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f209fe00640 1 -- 172.21.15.144:0/374736177 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 6130+0+0 (secure 0 0 0) 0x7f20b00edf00 con 0x55a9667c6db0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- 172.21.15.144:0/374736177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20ac026070 con 0x55a9667c6db0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f209fe00640 1 -- 172.21.15.144:0/374736177 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f20b00fd050 con 0x55a9667c6db0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 10 client.7833 fetch_fsmap learned FSMap version 89 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- 172.21.15.144:0/374736177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55a9665af3b0 con 0x55a9667c6db0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f209fe00640 1 -- 172.21.15.144:0/374736177 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac026070 con 0x55a9667c6db0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f209fe00640 1 -- 172.21.15.144:0/374736177 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f20b0100020 con 0x55a9667c6db0 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 10 client.7833 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 10 client.7833 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:19:37.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 20 client.7833 populate_metadata read hostname 'smithi144' 2024-09-12T12:19:37.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55a96681f390 0x55a96681f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 4 client.7833 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:19:37.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.125+0000 7f20c87e6000 1 -- 172.21.15.144:0/374736177 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a966625470 con 0x55a96681f390 2024-09-12T12:19:37.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20bde00640 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55a96681f390 0x55a96681f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f209fe00640 10 client.7833 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20bde00640 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55a96681f390 0x55a96681f770 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=710be51443ab71a1 server_cookie=9906c10330bafe06 in_seq=0 out_seq=0 2024-09-12T12:19:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f209fe00640 1 -- 172.21.15.144:0/374736177 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x55a966625470 con 0x55a96681f390 2024-09-12T12:19:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f209fe00640 10 client.7833 handle_command_reply: tid=0 2024-09-12T12:19:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 client.7833 shutdown 2024-09-12T12:19:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 -- 172.21.15.144:0/374736177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 msgr2=0x55a966886770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a966886770 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f20b00f0020 tx=0x7f20b011dd70 comp rx=0 tx=0).stop 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 -- 172.21.15.144:0/374736177 shutdown_connections 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55a96681f390 0x55a96681f770 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55a966813690 0x55a96681ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a966812d70 0x55a966886cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f209fe00640 0 client.7833 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 --2- 172.21.15.144:0/374736177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9667c6db0 0x55a966886770 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 -- 172.21.15.144:0/374736177 >> 172.21.15.144:0/374736177 conn(0x55a9667f4040 msgr2=0x55a966812590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 -- 172.21.15.144:0/374736177 shutdown_connections 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 1 -- 172.21.15.144:0/374736177 wait complete. 2024-09-12T12:19:37.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c87e6000 20 client.7833 trim_cache size 0 max 16384 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout: "3b1e8448-1489-4d57-a60e-b872bc1bc980": { 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "~mds0", 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "3b1e8448-1489-4d57-a60e-b872bc1bc980", 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "recursive" 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:19:37.133 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:19:37.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 -- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20a00678c0 msgr2=0x7f20a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20a00678c0 0x7f20a0069d80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f20c0152d40 tx=0x7f20ac007240 comp rx=0 tx=0).stop 2024-09-12T12:19:37.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 -- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c00d2b30 msgr2=0x7f20c0155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c00d2b30 0x7f20c0155140 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f20b00097c0 tx=0x7f20b001ace0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 -- 172.21.15.144:0/774240428 shutdown_connections 2024-09-12T12:19:37.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20a00678c0 0x7f20a0069d80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20c0160bf0 0x7f20c014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20c015c3b0 0x7f20c0155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 --2- 172.21.15.144:0/774240428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c00d2b30 0x7f20c0155140 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 -- 172.21.15.144:0/774240428 >> 172.21.15.144:0/774240428 conn(0x7f20c006c010 msgr2=0x7f20c006d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 -- 172.21.15.144:0/774240428 shutdown_connections 2024-09-12T12:19:37.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:19:37.129+0000 7f20c5400640 1 -- 172.21.15.144:0/774240428 wait complete. 2024-09-12T12:19:37.146 INFO:tasks.cephfs.filesystem:scrub status for tag:3b1e8448-1489-4d57-a60e-b872bc1bc980 - {'path': '~mds0', 'tag': '3b1e8448-1489-4d57-a60e-b872bc1bc980', 'options': 'recursive'} 2024-09-12T12:19:43.529 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:19:43.533 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:20:07.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:07.153 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-12T12:20:07.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.300+0000 7fa0c2e00640 1 Processor -- start 2024-09-12T12:20:07.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.300+0000 7fa0c2e00640 1 -- start start 2024-09-12T12:20:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.300+0000 7fa0c2e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa0bc147cc0 0x7fa0bc06e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.300+0000 7fa0c2e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0bc1480a0 0x7fa0bc0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c2e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0bc06d220 con 0x7fa0bc072fa0 2024-09-12T12:20:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c2e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa0bc06e4e0 con 0x7fa0bc1480a0 2024-09-12T12:20:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c2e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa0bc06d500 con 0x7fa0bc147cc0 2024-09-12T12:20:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c1000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0bc1480a0 0x7fa0bc0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c1000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0bc1480a0 0x7fa0bc0b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58214/0 (socket says 172.21.15.144:58214) 2024-09-12T12:20:07.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c1000640 1 -- 172.21.15.144:0/514130505 learned_addr learned my addr 172.21.15.144:0/514130505 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/514130505 >> v2:172.21.15.165:3300/0 conn(0x7fa0bc147cc0 0x7fa0bc06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c1000640 1 -- 172.21.15.144:0/514130505 >> v2:172.21.15.165:3300/0 conn(0x7fa0bc147cc0 msgr2=0x7fa0bc06e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c1000640 1 --2- 172.21.15.144:0/514130505 >> v2:172.21.15.165:3300/0 conn(0x7fa0bc147cc0 0x7fa0bc06e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c1000640 1 -- 172.21.15.144:0/514130505 >> v1:172.21.15.165:6789/0 conn(0x7fa0bc072fa0 legacy=0x7fa0bc162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c1000640 1 -- 172.21.15.144:0/514130505 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc06d7e0 con 0x7fa0bc1480a0 2024-09-12T12:20:07.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0c1000640 1 --2- 172.21.15.144:0/514130505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc1480a0 0x7fa0bc0b3fa0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0d33c0 tx=0x7fa0a801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0efa53266d2303 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.304+0000 7fa0bbe00640 1 -- 172.21.15.144:0/514130505 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80ab430 con 0x7fa0bc1480a0 2024-09-12T12:20:07.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0bbe00640 1 -- 172.21.15.144:0/514130505 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a80b0070 con 0x7fa0bc1480a0 2024-09-12T12:20:07.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0bbe00640 1 -- 172.21.15.144:0/514130505 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80ab7f0 con 0x7fa0bc1480a0 2024-09-12T12:20:07.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 -- 172.21.15.144:0/514130505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc1480a0 msgr2=0x7fa0bc0b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 --2- 172.21.15.144:0/514130505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc1480a0 0x7fa0bc0b3fa0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0d33c0 tx=0x7fa0a801c520 comp rx=0 tx=0).stop 2024-09-12T12:20:07.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 -- 172.21.15.144:0/514130505 shutdown_connections 2024-09-12T12:20:07.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 --2- 172.21.15.144:0/514130505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc1480a0 0x7fa0bc0b3fa0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 --2- 172.21.15.144:0/514130505 >> v2:172.21.15.165:3300/0 conn(0x7fa0bc147cc0 0x7fa0bc06e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 -- 172.21.15.144:0/514130505 >> 172.21.15.144:0/514130505 conn(0x7fa0bc0b7c30 msgr2=0x7fa0bc067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 -- 172.21.15.144:0/514130505 shutdown_connections 2024-09-12T12:20:07.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 -- 172.21.15.144:0/514130505 wait complete. 2024-09-12T12:20:07.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 Processor -- start 2024-09-12T12:20:07.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 -- start start 2024-09-12T12:20:07.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0bc072fa0 0x7fa0bc143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc147cc0 0x7fa0bc142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0bc1480a0 0x7fa0bc145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc16b6e0 con 0x7fa0bc147cc0 2024-09-12T12:20:07.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc0b48f0 con 0x7fa0bc1480a0 2024-09-12T12:20:07.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa0bc16b860 con 0x7fa0bc072fa0 2024-09-12T12:20:07.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc147cc0 0x7fa0bc142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc147cc0 0x7fa0bc142030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58228/0 (socket says 172.21.15.144:58228) 2024-09-12T12:20:07.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1000640 1 -- 172.21.15.144:0/745581013 learned_addr learned my addr 172.21.15.144:0/745581013 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0bc072fa0 0x7fa0bc143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2400640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0bc1480a0 0x7fa0bc145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1000640 1 -- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0bc072fa0 msgr2=0x7fa0bc143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1000640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0bc072fa0 0x7fa0bc143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1000640 1 -- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0bc1480a0 msgr2=0x7fa0bc145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1000640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0bc1480a0 0x7fa0bc145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1000640 1 -- 172.21.15.144:0/745581013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc143960 con 0x7fa0bc147cc0 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0bc072fa0 0x7fa0bc143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.308+0000 7fa0c2400640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0bc1480a0 0x7fa0bc145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:07.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0c1000640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc147cc0 0x7fa0bc142030 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8019130 tx=0x7fa0a80192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0b9600640 1 -- 172.21.15.144:0/745581013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80b4420 con 0x7fa0bc147cc0 2024-09-12T12:20:07.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0b9600640 1 -- 172.21.15.144:0/745581013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a80bb070 con 0x7fa0bc147cc0 2024-09-12T12:20:07.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0c2e00640 1 -- 172.21.15.144:0/745581013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0bc143c40 con 0x7fa0bc147cc0 2024-09-12T12:20:07.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0b9600640 1 -- 172.21.15.144:0/745581013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80b47c0 con 0x7fa0bc147cc0 2024-09-12T12:20:07.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0c2e00640 1 -- 172.21.15.144:0/745581013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0bc144200 con 0x7fa0bc147cc0 2024-09-12T12:20:07.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0b9600640 1 -- 172.21.15.144:0/745581013 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0a80b4960 con 0x7fa0bc147cc0 2024-09-12T12:20:07.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0b9600640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa09c0678c0 0x7fa09c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0b9600640 1 -- 172.21.15.144:0/745581013 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fa0a811fe50 con 0x7fa0bc147cc0 2024-09-12T12:20:07.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.312+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa09c0678c0 0x7fa09c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 Processor -- start 2024-09-12T12:20:07.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- start start 2024-09-12T12:20:07.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa09c0678c0 0x7fa09c069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00073f0 tx=0x7fa0b000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 0x555aa1168870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 0x555aa1169190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555aa1052960 con 0x555aa11b4d70 2024-09-12T12:20:07.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555aa0f96900 con 0x555aa1168db0 2024-09-12T12:20:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555aa0fb9d40 con 0x555aa11b5690 2024-09-12T12:20:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58244/0 (socket says 172.21.15.144:58244) 2024-09-12T12:20:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 -- 172.21.15.144:0/1875335604 learned_addr learned my addr 172.21.15.144:0/1875335604 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1000640 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 0x555aa1168870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c2400640 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 0x555aa1169190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 -- 172.21.15.144:0/1875335604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 msgr2=0x555aa1168870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 0x555aa1168870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 -- 172.21.15.144:0/1875335604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 msgr2=0x555aa1169190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 0x555aa1169190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 -- 172.21.15.144:0/1875335604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa0f60580 con 0x555aa11b4d70 2024-09-12T12:20:07.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c2400640 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 0x555aa1169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:07.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11b5150 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009ea0 tx=0x7fa0b0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b29cb349d12f4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0ae000640 1 -- 172.21.15.144:0/1875335604 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0026070 con 0x555aa11b4d70 2024-09-12T12:20:07.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0ae000640 1 -- 172.21.15.144:0/1875335604 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b0014d60 con 0x555aa11b4d70 2024-09-12T12:20:07.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0ae000640 1 -- 172.21.15.144:0/1875335604 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0021640 con 0x555aa11b4d70 2024-09-12T12:20:07.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- 172.21.15.144:0/1875335604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 msgr2=0x555aa11b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11b5150 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009ea0 tx=0x7fa0b0012000 comp rx=0 tx=0).stop 2024-09-12T12:20:07.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- 172.21.15.144:0/1875335604 shutdown_connections 2024-09-12T12:20:07.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 0x555aa1169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 0x555aa1168870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 --2- 172.21.15.144:0/1875335604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11b5150 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- 172.21.15.144:0/1875335604 >> 172.21.15.144:0/1875335604 conn(0x555aa1196040 msgr2=0x555aa1198430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- 172.21.15.144:0/1875335604 shutdown_connections 2024-09-12T12:20:07.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- 172.21.15.144:0/1875335604 wait complete. 2024-09-12T12:20:07.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.316+0000 7fa0c780c000 1 -- start start 2024-09-12T12:20:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 Processor -- start 2024-09-12T12:20:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 0x555aa11bbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11bc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 0x555aa11bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555aa0fb5d00 con 0x555aa11b4d70 2024-09-12T12:20:07.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555aa0f74aa0 con 0x555aa1168db0 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555aa0f53340 con 0x555aa11b5690 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 10 client.0 _ll_register_callbacks cb 0x555aa1156760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11bc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58246/0 (socket says 172.21.15.144:58246) 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1000640 1 -- 172.21.15.144:0/2136746209 learned_addr learned my addr 172.21.15.144:0/2136746209 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 0x555aa11bbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c2400640 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 0x555aa11bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1000640 1 -- 172.21.15.144:0/2136746209 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 msgr2=0x555aa11bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1000640 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 0x555aa11bc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1000640 1 -- 172.21.15.144:0/2136746209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 msgr2=0x555aa11bbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1000640 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 0x555aa11bbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1000640 1 -- 172.21.15.144:0/2136746209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa0f5cdc0 con 0x555aa11b4d70 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1000640 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11bc220 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8097f00 tx=0x7fa0a80f0870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df03255c930ad921 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0a2a00640 1 -- 172.21.15.144:0/2136746209 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80f8c10 con 0x555aa11b4d70 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0a2a00640 1 -- 172.21.15.144:0/2136746209 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fa0a8105d30 con 0x555aa11b4d70 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 -- 172.21.15.144:0/2136746209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b0014d60 con 0x555aa11b4d70 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0a2a00640 1 -- 172.21.15.144:0/2136746209 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa0a80b4c50 con 0x555aa11b4d70 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 10 client.7845 fetch_fsmap learned FSMap version 89 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 -- 172.21.15.144:0/2136746209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x555aa0f597f0 con 0x555aa11b4d70 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0a2a00640 1 -- 172.21.15.144:0/2136746209 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b0014d60 con 0x555aa11b4d70 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0a2a00640 1 -- 172.21.15.144:0/2136746209 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7fa0a80aa070 con 0x555aa11b4d70 2024-09-12T12:20:07.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 10 client.7845 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 10 client.7845 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 20 client.7845 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555aa11c40b0 0x555aa11c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 4 client.7845 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c780c000 1 -- 172.21.15.144:0/2136746209 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aa0f53e10 con 0x555aa11c40b0 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555aa11c40b0 0x555aa11c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0a2a00640 10 client.7845 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.320+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555aa11c40b0 0x555aa11c64a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917d0c020b4cdf5b server_cookie=29480d124d84aad8 in_seq=0 out_seq=0 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0a2a00640 1 -- 172.21.15.144:0/2136746209 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555aa0f53e10 con 0x555aa11c40b0 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0a2a00640 10 client.7845 handle_command_reply: tid=0 2024-09-12T12:20:07.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 client.7845 shutdown 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 -- 172.21.15.144:0/2136746209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 msgr2=0x555aa11bc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11bc220 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8097f00 tx=0x7fa0a80f0870 comp rx=0 tx=0).stop 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 -- 172.21.15.144:0/2136746209 shutdown_connections 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555aa11c40b0 0x555aa11c64a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b5690 0x555aa11bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa11b4d70 0x555aa11bc220 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 --2- 172.21.15.144:0/2136746209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1168db0 0x555aa11bbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0a2a00640 0 client.7845 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 -- 172.21.15.144:0/2136746209 >> 172.21.15.144:0/2136746209 conn(0x555aa1196040 msgr2=0x555aa1167f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 -- 172.21.15.144:0/2136746209 shutdown_connections 2024-09-12T12:20:07.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 1 -- 172.21.15.144:0/2136746209 wait complete. 2024-09-12T12:20:07.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.324+0000 7fa0c780c000 20 client.7845 trim_cache size 0 max 16384 2024-09-12T12:20:07.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.340+0000 7fa0c780c000 1 Processor -- start 2024-09-12T12:20:07.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.340+0000 7fa0c780c000 1 -- start start 2024-09-12T12:20:07.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.340+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1196040 0x555aa1170c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.340+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa1171140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.340+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b4d70 0x555aa11bed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.340+0000 7fa0c780c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc204480 con 0x555aa1168db0 2024-09-12T12:20:07.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.340+0000 7fa0c780c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc203540 con 0x555aa1196040 2024-09-12T12:20:07.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.340+0000 7fa0c780c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa0bc15d4c0 con 0x555aa11b4d70 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa1171140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa1171140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58262/0 (socket says 172.21.15.144:58262) 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 -- 172.21.15.144:0/883095866 learned_addr learned my addr 172.21.15.144:0/883095866 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c2400640 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b4d70 0x555aa11bed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1196040 0x555aa1170c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 -- 172.21.15.144:0/883095866 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b4d70 msgr2=0x555aa11bed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b4d70 0x555aa11bed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 -- 172.21.15.144:0/883095866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1196040 msgr2=0x555aa1170c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1196040 0x555aa1170c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 -- 172.21.15.144:0/883095866 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa0f77470 con 0x555aa1168db0 2024-09-12T12:20:07.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1196040 0x555aa1170c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:07.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa1171140 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80f08e0 tx=0x7fa0a80b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16b4a0c2fea4ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0ad600640 1 -- 172.21.15.144:0/883095866 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80f8c10 con 0x555aa1168db0 2024-09-12T12:20:07.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0ad600640 1 -- 172.21.15.144:0/883095866 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a80b0030 con 0x555aa1168db0 2024-09-12T12:20:07.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0ad600640 1 -- 172.21.15.144:0/883095866 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80b2e00 con 0x555aa1168db0 2024-09-12T12:20:07.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 -- 172.21.15.144:0/883095866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 msgr2=0x555aa1171140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa1171140 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80f08e0 tx=0x7fa0a80b6000 comp rx=0 tx=0).stop 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 -- 172.21.15.144:0/883095866 shutdown_connections 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa11b4d70 0x555aa11bed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa1171140 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 --2- 172.21.15.144:0/883095866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa1196040 0x555aa1170c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 -- 172.21.15.144:0/883095866 >> 172.21.15.144:0/883095866 conn(0x555aa116d770 msgr2=0x555aa11bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 -- 172.21.15.144:0/883095866 shutdown_connections 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 -- 172.21.15.144:0/883095866 wait complete. 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 -- start start 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 Processor -- start 2024-09-12T12:20:07.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa11c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa1196040 0x555aa11c2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa11b4d70 0x555aa1231d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555aa0fc7fd0 con 0x555aa1168db0 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc15db10 con 0x555aa11b4d70 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555aa0f81400 con 0x555aa1196040 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c780c000 10 client.0 _ll_register_callbacks cb 0x7fa0a80efb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa11c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa11c20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58278/0 (socket says 172.21.15.144:58278) 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1a00640 1 -- 172.21.15.144:0/3821570371 learned_addr learned my addr 172.21.15.144:0/3821570371 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c1000640 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa1196040 0x555aa11c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.344+0000 7fa0c2400640 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa11b4d70 0x555aa1231d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c1a00640 1 -- 172.21.15.144:0/3821570371 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa1196040 msgr2=0x555aa11c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa1196040 0x555aa11c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c1a00640 1 -- 172.21.15.144:0/3821570371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa11b4d70 msgr2=0x555aa1231d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa11b4d70 0x555aa1231d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c1a00640 1 -- 172.21.15.144:0/3821570371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa0f4d640 con 0x555aa1168db0 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2400640 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa11b4d70 0x555aa1231d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c1a00640 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa11c20e0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0018010 tx=0x7fa0b0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ea3872e498dd14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 1 -- 172.21.15.144:0/3821570371 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0026040 con 0x555aa1168db0 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 1 -- 172.21.15.144:0/3821570371 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fa0b003acb0 con 0x555aa1168db0 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 -- 172.21.15.144:0/3821570371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0a80b0030 con 0x555aa1168db0 2024-09-12T12:20:07.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 1 -- 172.21.15.144:0/3821570371 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa0b0041050 con 0x555aa1168db0 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 10 client.7851 fetch_fsmap learned FSMap version 89 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 -- 172.21.15.144:0/3821570371 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x555aa0f513b0 con 0x555aa1168db0 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 1 -- 172.21.15.144:0/3821570371 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a80b0030 con 0x555aa1168db0 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 1 -- 172.21.15.144:0/3821570371 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7fa0b0044020 con 0x555aa1168db0 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 10 client.7851 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 10 client.7851 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 20 client.7851 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555aa11b5690 0x555aa12326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 4 client.7851 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 -- 172.21.15.144:0/3821570371 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555aa0fc7470 con 0x555aa11b5690 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c1000640 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555aa11b5690 0x555aa12326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 10 client.7851 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c1000640 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555aa11b5690 0x555aa12326d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c1c74f830165e6a server_cookie=7ea21fa71111a70f in_seq=0 out_seq=0 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 1 -- 172.21.15.144:0/3821570371 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555aa0fc7470 con 0x555aa11b5690 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 10 client.7851 handle_command_reply: tid=0 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 client.7851 shutdown 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 -- 172.21.15.144:0/3821570371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 msgr2=0x555aa11c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa11c20e0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0018010 tx=0x7fa0b0004ac0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 -- 172.21.15.144:0/3821570371 shutdown_connections 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x555aa11b5690 0x555aa12326d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555aa11b4d70 0x555aa1231d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555aa1196040 0x555aa11c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 --2- 172.21.15.144:0/3821570371 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aa1168db0 0x555aa11c20e0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0a2a00640 0 client.7851 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:20:07.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 -- 172.21.15.144:0/3821570371 >> 172.21.15.144:0/3821570371 conn(0x555aa116d770 msgr2=0x555aa116fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 -- 172.21.15.144:0/3821570371 shutdown_connections 2024-09-12T12:20:07.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 1 -- 172.21.15.144:0/3821570371 wait complete. 2024-09-12T12:20:07.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c780c000 20 client.7851 trim_cache size 0 max 16384 2024-09-12T12:20:07.358 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:20:07.358 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "no active scrubs running", 2024-09-12T12:20:07.359 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:20:07.359 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:20:07.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 -- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa09c0678c0 msgr2=0x7fa09c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa09c0678c0 0x7fa09c069d80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00073f0 tx=0x7fa0b000b040 comp rx=0 tx=0).stop 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 -- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc147cc0 msgr2=0x7fa0bc142030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc147cc0 0x7fa0bc142030 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8019130 tx=0x7fa0a80192c0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 -- 172.21.15.144:0/745581013 shutdown_connections 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa09c0678c0 0x7fa09c069d80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0bc1480a0 0x7fa0bc145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0bc147cc0 0x7fa0bc142030 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 --2- 172.21.15.144:0/745581013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0bc072fa0 0x7fa0bc143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 -- 172.21.15.144:0/745581013 >> 172.21.15.144:0/745581013 conn(0x7fa0bc0b7c30 msgr2=0x7fa0bc15eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 -- 172.21.15.144:0/745581013 shutdown_connections 2024-09-12T12:20:07.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.348+0000 7fa0c2e00640 1 -- 172.21.15.144:0/745581013 wait complete. 2024-09-12T12:20:07.368 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:20:07.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-12T12:20:07.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d9200640 1 Processor -- start 2024-09-12T12:20:07.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d9200640 1 -- start start 2024-09-12T12:20:07.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d415c2e0 0x7f44d4072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d9200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d40733e0 con 0x7f44d406c320 2024-09-12T12:20:07.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d9200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d40cd290 con 0x7f44d40af5f0 2024-09-12T12:20:07.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d9200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44d40cd570 con 0x7f44d415c2e0 2024-09-12T12:20:07.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f44d406c320 0x7f44d40cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51620/0 (socket says 172.21.15.144:51620) 2024-09-12T12:20:07.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d2800640 1 -- 172.21.15.144:0/4137819772 learned_addr learned my addr 172.21.15.144:0/4137819772 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:07.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d1e00640 1 --2- 172.21.15.144:0/4137819772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d415c2e0 0x7f44d4072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d0a00640 1 -- 172.21.15.144:0/4137819772 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478888023 0 0) 0x7f44d40733e0 con 0x7f44d406c320 2024-09-12T12:20:07.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d0a00640 1 -- 172.21.15.144:0/4137819772 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b8003530 con 0x7f44d406c320 2024-09-12T12:20:07.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d0a00640 1 -- 172.21.15.144:0/4137819772 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613658666 0 0) 0x7f44d40cd290 con 0x7f44d40af5f0 2024-09-12T12:20:07.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d0a00640 1 -- 172.21.15.144:0/4137819772 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d40733e0 con 0x7f44d40af5f0 2024-09-12T12:20:07.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d1e00640 1 -- 172.21.15.144:0/4137819772 >> v1:172.21.15.165:6789/0 conn(0x7f44d40af5f0 legacy=0x7f44d406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d1e00640 1 -- 172.21.15.144:0/4137819772 >> v1:172.21.15.144:6789/0 conn(0x7f44d406c320 legacy=0x7f44d40cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.508+0000 7f44d1e00640 1 -- 172.21.15.144:0/4137819772 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d40cd850 con 0x7f44d415c2e0 2024-09-12T12:20:07.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d1e00640 1 --2- 172.21.15.144:0/4137819772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d415c2e0 0x7f44d4072b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44c40097f0 tx=0x7f44c401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969b1fab6a0e501a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d0a00640 1 -- 172.21.15.144:0/4137819772 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40b0070 con 0x7f44d415c2e0 2024-09-12T12:20:07.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d0a00640 1 -- 172.21.15.144:0/4137819772 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c40ab600 con 0x7f44d415c2e0 2024-09-12T12:20:07.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d0a00640 1 -- 172.21.15.144:0/4137819772 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40a4e60 con 0x7f44d415c2e0 2024-09-12T12:20:07.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d9200640 1 -- 172.21.15.144:0/4137819772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d415c2e0 msgr2=0x7f44d4072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d9200640 1 --2- 172.21.15.144:0/4137819772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d415c2e0 0x7f44d4072b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44c40097f0 tx=0x7f44c401c3c0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d9200640 1 -- 172.21.15.144:0/4137819772 shutdown_connections 2024-09-12T12:20:07.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d9200640 1 --2- 172.21.15.144:0/4137819772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d415c2e0 0x7f44d4072b50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d9200640 1 -- 172.21.15.144:0/4137819772 >> 172.21.15.144:0/4137819772 conn(0x7f44d4068030 msgr2=0x7f44d40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d9200640 1 -- 172.21.15.144:0/4137819772 shutdown_connections 2024-09-12T12:20:07.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.512+0000 7f44d9200640 1 -- 172.21.15.144:0/4137819772 wait complete. 2024-09-12T12:20:07.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 Processor -- start 2024-09-12T12:20:07.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 -- start start 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d406c320 0x7f44d415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d40af5f0 0x7f44d4140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d415c2e0 0x7f44d41581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4169f30 con 0x7f44d406c320 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f44d40cef60 con 0x7f44d415c2e0 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44d416a0b0 con 0x7f44d40af5f0 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d406c320 0x7f44d415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d406c320 0x7f44d415ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58284/0 (socket says 172.21.15.144:58284) 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1e00640 1 -- 172.21.15.144:0/1817594420 learned_addr learned my addr 172.21.15.144:0/1817594420 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d2800640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d415c2e0 0x7f44d41581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1400640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d40af5f0 0x7f44d4140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1e00640 1 -- 172.21.15.144:0/1817594420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d40af5f0 msgr2=0x7f44d4140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1e00640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d40af5f0 0x7f44d4140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1e00640 1 -- 172.21.15.144:0/1817594420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d415c2e0 msgr2=0x7f44d41581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1e00640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d415c2e0 0x7f44d41581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1e00640 1 -- 172.21.15.144:0/1817594420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d41574f0 con 0x7f44d406c320 2024-09-12T12:20:07.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1400640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d40af5f0 0x7f44d4140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d1e00640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d406c320 0x7f44d415ca80 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f44c4000c10 tx=0x7f44c4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44ca000640 1 -- 172.21.15.144:0/1817594420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40bb070 con 0x7f44d406c320 2024-09-12T12:20:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44ca000640 1 -- 172.21.15.144:0/1817594420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c40a4e60 con 0x7f44d406c320 2024-09-12T12:20:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44ca000640 1 -- 172.21.15.144:0/1817594420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40b0040 con 0x7f44d406c320 2024-09-12T12:20:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 -- 172.21.15.144:0/1817594420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d4156450 con 0x7f44d406c320 2024-09-12T12:20:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.516+0000 7f44d9200640 1 -- 172.21.15.144:0/1817594420 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d4156a10 con 0x7f44d406c320 2024-09-12T12:20:07.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.520+0000 7f44ca000640 1 -- 172.21.15.144:0/1817594420 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f44c40be070 con 0x7f44d406c320 2024-09-12T12:20:07.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.520+0000 7f44ca000640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44b00678c0 0x7f44b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.520+0000 7f44ca000640 1 -- 172.21.15.144:0/1817594420 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f44c4120470 con 0x7f44d406c320 2024-09-12T12:20:07.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.520+0000 7f44d1400640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44b00678c0 0x7f44b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.520+0000 7f44dc6d3000 1 Processor -- start 2024-09-12T12:20:07.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.520+0000 7f44d1400640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44b00678c0 0x7f44b0069d80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f44d415fc70 tx=0x7f44bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.520+0000 7f44dc6d3000 1 -- start start 2024-09-12T12:20:07.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385a92ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a93530 0x55b385a46240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 0x55b385a46b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b385897cc0 con 0x55b385a92c10 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b385852a20 con 0x55b385a46780 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b385893c80 con 0x55b385a93530 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385a92ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385a92ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58290/0 (socket says 172.21.15.144:58290) 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1e00640 1 -- 172.21.15.144:0/2488554521 learned_addr learned my addr 172.21.15.144:0/2488554521 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d2800640 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 0x55b385a46b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1400640 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a93530 0x55b385a46240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1e00640 1 -- 172.21.15.144:0/2488554521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a93530 msgr2=0x55b385a46240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1e00640 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a93530 0x55b385a46240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1e00640 1 -- 172.21.15.144:0/2488554521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 msgr2=0x55b385a46b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1e00640 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 0x55b385a46b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1e00640 1 -- 172.21.15.144:0/2488554521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b38583ad40 con 0x55b385a92c10 2024-09-12T12:20:07.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1400640 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a93530 0x55b385a46240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44d1e00640 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385a92ff0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f44c40f8d90 tx=0x7f44c40f01b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b6b03660fea482 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44c2a00640 1 -- 172.21.15.144:0/2488554521 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40c5070 con 0x55b385a92c10 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44c2a00640 1 -- 172.21.15.144:0/2488554521 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c40f4a90 con 0x55b385a92c10 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44c2a00640 1 -- 172.21.15.144:0/2488554521 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c40f92c0 con 0x55b385a92c10 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 -- 172.21.15.144:0/2488554521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 msgr2=0x55b385a92ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385a92ff0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f44c40f8d90 tx=0x7f44c40f01b0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 -- 172.21.15.144:0/2488554521 shutdown_connections 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 0x55b385a46b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a93530 0x55b385a46240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/2488554521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385a92ff0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 -- 172.21.15.144:0/2488554521 >> 172.21.15.144:0/2488554521 conn(0x55b385a739b0 msgr2=0x55b385a75da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 -- 172.21.15.144:0/2488554521 shutdown_connections 2024-09-12T12:20:07.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 -- 172.21.15.144:0/2488554521 wait complete. 2024-09-12T12:20:07.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 -- start start 2024-09-12T12:20:07.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 Processor -- start 2024-09-12T12:20:07.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 0x55b385a99f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.524+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a92c10 0x55b385a9a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385a4c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b3858312c0 con 0x55b385a93530 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b385856370 con 0x55b385a92c10 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b3858a5f50 con 0x55b385a46780 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 10 client.0 _ll_register_callbacks cb 0x55b3858f8db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385a4c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385a4c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58292/0 (socket says 172.21.15.144:58292) 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d2800640 1 -- 172.21.15.144:0/753496882 learned_addr learned my addr 172.21.15.144:0/753496882 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d1e00640 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 0x55b385a99f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d1400640 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a92c10 0x55b385a9a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d2800640 1 -- 172.21.15.144:0/753496882 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 msgr2=0x55b385a99f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d2800640 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 0x55b385a99f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d2800640 1 -- 172.21.15.144:0/753496882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a92c10 msgr2=0x55b385a9a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d2800640 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a92c10 0x55b385a9a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d2800640 1 -- 172.21.15.144:0/753496882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b385837770 con 0x55b385a93530 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d1400640 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a92c10 0x55b385a9a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d2800640 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385a4c480 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007b30 tx=0x7f44cc012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c558cf1bfdaa8d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 1 -- 172.21.15.144:0/753496882 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc019070 con 0x55b385a93530 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 1 -- 172.21.15.144:0/753496882 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f44cc015440 con 0x55b385a93530 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- 172.21.15.144:0/753496882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44c40f4a90 con 0x55b385a93530 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 1 -- 172.21.15.144:0/753496882 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f44cc024050 con 0x55b385a93530 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 10 client.7863 fetch_fsmap learned FSMap version 89 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- 172.21.15.144:0/753496882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55b3858553f0 con 0x55b385a93530 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 1 -- 172.21.15.144:0/753496882 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c40f4a90 con 0x55b385a93530 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 1 -- 172.21.15.144:0/753496882 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f44cc027020 con 0x55b385a93530 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 10 client.7863 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:20:07.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 10 client.7863 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 20 client.7863 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55b385a4ce90 0x55b385a4d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 4 client.7863 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- 172.21.15.144:0/753496882 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b385831d90 con 0x55b385a4ce90 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d1e00640 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55b385a4ce90 0x55b385a4d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44d1e00640 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55b385a4ce90 0x55b385a4d270 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f8c0305841d0c4 server_cookie=86e85d9f67160488 in_seq=0 out_seq=0 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 10 client.7863 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 1 -- 172.21.15.144:0/753496882 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b385831d90 con 0x55b385a4ce90 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 10 client.7863 handle_command_reply: tid=0 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 client.7863 shutdown 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- 172.21.15.144:0/753496882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 msgr2=0x55b385a4c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385a4c480 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007b30 tx=0x7f44cc012690 comp rx=0 tx=0).stop 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- 172.21.15.144:0/753496882 shutdown_connections 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55b385a4ce90 0x55b385a4d270 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385a4c480 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a92c10 0x55b385a9a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44b7400640 0 client.7863 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/753496882 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 0x55b385a99f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- 172.21.15.144:0/753496882 >> 172.21.15.144:0/753496882 conn(0x55b385a739b0 msgr2=0x55b385a45940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- 172.21.15.144:0/753496882 shutdown_connections 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 1 -- 172.21.15.144:0/753496882 wait complete. 2024-09-12T12:20:07.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.528+0000 7f44dc6d3000 20 client.7863 trim_cache size 0 max 16384 2024-09-12T12:20:07.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.544+0000 7f44dc6d3000 1 Processor -- start 2024-09-12T12:20:07.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- start start 2024-09-12T12:20:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 0x55b385b0a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a92c10 0x55b385b0aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385b0af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f44d4203000 con 0x55b385a93530 2024-09-12T12:20:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f44d415ef20 con 0x55b385a46780 2024-09-12T12:20:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44d4202b00 con 0x55b385a92c10 2024-09-12T12:20:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385b0af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385b0af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58298/0 (socket says 172.21.15.144:58298) 2024-09-12T12:20:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d2800640 1 -- 172.21.15.144:0/3261031934 learned_addr learned my addr 172.21.15.144:0/3261031934 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d1400640 1 --2- 172.21.15.144:0/3261031934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a92c10 0x55b385b0aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d1e00640 1 --2- 172.21.15.144:0/3261031934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 0x55b385b0a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d2800640 1 -- 172.21.15.144:0/3261031934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a92c10 msgr2=0x55b385b0aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d2800640 1 --2- 172.21.15.144:0/3261031934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a92c10 0x55b385b0aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d2800640 1 -- 172.21.15.144:0/3261031934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 msgr2=0x55b385b0a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d2800640 1 --2- 172.21.15.144:0/3261031934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 0x55b385b0a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d2800640 1 -- 172.21.15.144:0/3261031934 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b385919320 con 0x55b385a93530 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44d2800640 1 --2- 172.21.15.144:0/3261031934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385b0af50 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007460 tx=0x7f44cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e3772f11bfe1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44c2000640 1 -- 172.21.15.144:0/3261031934 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc019040 con 0x55b385a93530 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44c2000640 1 -- 172.21.15.144:0/3261031934 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc015640 con 0x55b385a93530 2024-09-12T12:20:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44c2000640 1 -- 172.21.15.144:0/3261031934 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0159f0 con 0x55b385a93530 2024-09-12T12:20:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- 172.21.15.144:0/3261031934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 msgr2=0x55b385b0af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/3261031934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385b0af50 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007460 tx=0x7f44cc016000 comp rx=0 tx=0).stop 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- 172.21.15.144:0/3261031934 shutdown_connections 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/3261031934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a93530 0x55b385b0af50 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/3261031934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a92c10 0x55b385b0aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/3261031934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a46780 0x55b385b0a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- 172.21.15.144:0/3261031934 >> 172.21.15.144:0/3261031934 conn(0x55b385a739b0 msgr2=0x55b385a44a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- 172.21.15.144:0/3261031934 shutdown_connections 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- 172.21.15.144:0/3261031934 wait complete. 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 -- start start 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.548+0000 7f44dc6d3000 1 Processor -- start 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 0x55b385b0f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385b0f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a93530 0x55b385a9f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b38583f120 con 0x55b385a92c10 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b385918e90 con 0x55b385a93530 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b385841b90 con 0x55b385a46780 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 10 client.0 _ll_register_callbacks cb 0x7f44cc001e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385b0f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385b0f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58304/0 (socket says 172.21.15.144:58304) 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1400640 1 -- 172.21.15.144:0/141234739 learned_addr learned my addr 172.21.15.144:0/141234739 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1e00640 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 0x55b385b0f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d2800640 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a93530 0x55b385a9f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1400640 1 -- 172.21.15.144:0/141234739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 msgr2=0x55b385b0f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1400640 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 0x55b385b0f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1400640 1 -- 172.21.15.144:0/141234739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a93530 msgr2=0x55b385a9f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1400640 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a93530 0x55b385a9f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1400640 1 -- 172.21.15.144:0/141234739 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b38582b5c0 con 0x55b385a92c10 2024-09-12T12:20:07.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d2800640 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a93530 0x55b385a9f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:07.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1400640 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385b0f7e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00e7b0 tx=0x7f44bc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b750702ba6a9b9f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 1 -- 172.21.15.144:0/141234739 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44bc029060 con 0x55b385a92c10 2024-09-12T12:20:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 1 -- 172.21.15.144:0/141234739 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f44bc010040 con 0x55b385a92c10 2024-09-12T12:20:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 -- 172.21.15.144:0/141234739 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44cc015640 con 0x55b385a92c10 2024-09-12T12:20:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 1 -- 172.21.15.144:0/141234739 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f44bc02f050 con 0x55b385a92c10 2024-09-12T12:20:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 10 client.7869 fetch_fsmap learned FSMap version 89 2024-09-12T12:20:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 -- 172.21.15.144:0/141234739 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55b38582f330 con 0x55b385a92c10 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 1 -- 172.21.15.144:0/141234739 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc015640 con 0x55b385a92c10 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 1 -- 172.21.15.144:0/141234739 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f44bc032020 con 0x55b385a92c10 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 10 client.7869 fetch_fsmap finished waiting for FSMap version 89 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 10 client.7869 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 20 client.7869 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55b385a9f5e0 0x55b385a9f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 4 client.7869 mds_command: new command op to 7273 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 -- 172.21.15.144:0/141234739 --> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55b3858a53f0 con 0x55b385a9f5e0 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1e00640 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55b385a9f5e0 0x55b385a9f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 10 client.7869 ms_handle_connect on v2:172.21.15.144:6834/3880489679 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44d1e00640 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55b385a9f5e0 0x55b385a9f9c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bf423dd22ed2544 server_cookie=ef55bfc18fed3a11 in_seq=0 out_seq=0 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 1 -- 172.21.15.144:0/141234739 <== mds.0 v2:172.21.15.144:6834/3880489679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18000 (crc 0 0 0) 0x55b3858a53f0 con 0x55b385a9f5e0 2024-09-12T12:20:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 10 client.7869 handle_command_reply: tid=0 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 client.7869 shutdown 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 -- 172.21.15.144:0/141234739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 msgr2=0x55b385b0f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385b0f7e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00e7b0 tx=0x7f44bc000bd0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 -- 172.21.15.144:0/141234739 shutdown_connections 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.144:6834/3880489679,v1:172.21.15.144:6836/3880489679] conn(0x55b385a9f5e0 0x55b385a9f9c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b385a93530 0x55b385a9f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b385a92c10 0x55b385b0f7e0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 --2- 172.21.15.144:0/141234739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b385a46780 0x55b385b0f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44dc6d3000 1 -- 172.21.15.144:0/141234739 >> 172.21.15.144:0/141234739 conn(0x55b385a739b0 msgr2=0x55b385a45230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.552+0000 7f44b7400640 0 client.7869 ms_handle_reset on v2:172.21.15.144:6834/3880489679 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44dc6d3000 1 -- 172.21.15.144:0/141234739 shutdown_connections 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44dc6d3000 1 -- 172.21.15.144:0/141234739 wait complete. 2024-09-12T12:20:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44dc6d3000 20 client.7869 trim_cache size 0 max 16384 2024-09-12T12:20:07.564 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:20:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:20:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1461, 2024-09-12T12:20:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1455, 2024-09-12T12:20:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 467190, 2024-09-12T12:20:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 7144975, 2024-09-12T12:20:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 16, 2024-09-12T12:20:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 6, 2024-09-12T12:20:07.564 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.166630376, 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.066617494, 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.044213042, 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.040968840, 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1455, 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.229301446, 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000157595 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 10, 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000001052, 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000105 2024-09-12T12:20:07.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 120336, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 27408 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 3175, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 3198, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 802831, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 26596178, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.373413815, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.187557440, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.074988043, 2024-09-12T12:20:07.566 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.087234699, 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3197, 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.425638037, 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000133136 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 124368 2024-09-12T12:20:07.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 31561, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 53889, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 11411360, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 80406427, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 5.037353886, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 2.966779200, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 3.079746316, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.131133044, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 53888, 2024-09-12T12:20:07.568 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 2.119276921, 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000039327 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 72563, 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.015621241, 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000215 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-12T12:20:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3060, 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 17.093927063, 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.005586250 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-12T12:20:07.570 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3699, 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.980222389, 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000264996 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 25599, 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 25599, 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 25599, 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 333.983582941, 2024-09-12T12:20:07.571 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.013046743 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 12, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 17808, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 17808, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 17807, 2024-09-12T12:20:07.572 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 2, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 2, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 46640, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 46037, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 117, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-12T12:20:07.573 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 2011, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 2011, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:20:07.574 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 11, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 1, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 10, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 2000, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 1411, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 4047, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 3641, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 2608, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 18, 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 14111 2024-09-12T12:20:07.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 4184, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 3901, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 2242, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-12T12:20:07.576 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 1, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2024-09-12T12:20:07.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 31780, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 31780, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 48, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 48, 2024-09-12T12:20:07.578 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 4, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 99478584, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2851, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 98.401952984, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.034514890 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-12T12:20:07.579 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 14, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 2015, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 2001, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 13, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 13, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 0, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 17808, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 19809, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 2001, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 2, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 2251, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 2249, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 100796, 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 231732 2024-09-12T12:20:07.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 28612, 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 25599, 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 6, 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2000, 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.717099861, 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000858549 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-12T12:20:07.581 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 29, 2024-09-12T12:20:07.582 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.005810458, 2024-09-12T12:20:07.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000200360 2024-09-12T12:20:07.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.582 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-12T12:20:07.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.582 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 6000, 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 7.054526831, 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001175754 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 7314, 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 5.200133226, 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000710983 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-12T12:20:07.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000067583, 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000067583 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.585 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.003946368, 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.003946368 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.140239718, 2024-09-12T12:20:07.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.140239718 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000141472, 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000141472 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8, 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.565957359, 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.070744669 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2242, 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 299.974684520, 2024-09-12T12:20:07.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.133797807 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-12T12:20:07.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.072983231, 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.072983231 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000287444, 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000287444 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8000, 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 19.247704870, 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002405963 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 1, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 1, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 0, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 1, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 18141, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 18141, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 83, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-12T12:20:07.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:20:07.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:20:07.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 250494, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 86, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-12T12:20:07.596 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 5624, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 80, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 13413204, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 660992, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-12T12:20:07.597 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 8987, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 95976943, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 37, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 8987, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8987, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 39.539589058, 2024-09-12T12:20:07.598 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.004399642 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 8987, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 9089 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 8987, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 2053, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 6934, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 11, 2024-09-12T12:20:07.599 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 41, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 2891, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 27, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 1901, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 2034, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 2012, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 22, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:20:07.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-12T12:20:07.601 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 118, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 5, 2024-09-12T12:20:07.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 8, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 8, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 116, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 0, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 34 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.603 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 32, 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 32, 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 3901, 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 3901, 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:20:07.604 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 36193, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 9418350, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 36193, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 36193, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 9418350, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.605 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 8987, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 96386152, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 8987, 2024-09-12T12:20:07.606 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 96386152, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:20:07.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 8987, 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 8987, 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 8987, 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 8987, 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:20:07.608 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 3901, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 409209, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 3901, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 40, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 409209, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x558d7384c780": { 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 31780, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 95284280, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 31780, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2851, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 95284280, 2024-09-12T12:20:07.610 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-12T12:20:07.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-12T12:20:07.611 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-12T12:20:07.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-12T12:20:07.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:07.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:07.611 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:20:07.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 -- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44b00678c0 msgr2=0x7f44b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44b00678c0 0x7f44b0069d80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f44d415fc70 tx=0x7f44bc009040 comp rx=0 tx=0).stop 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 -- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d406c320 msgr2=0x7f44d415ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d406c320 0x7f44d415ca80 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f44c4000c10 tx=0x7f44c4019160 comp rx=0 tx=0).stop 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 -- 172.21.15.144:0/1817594420 shutdown_connections 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44b00678c0 0x7f44b0069d80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d415c2e0 0x7f44d41581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44d40af5f0 0x7f44d4140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 --2- 172.21.15.144:0/1817594420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d406c320 0x7f44d415ca80 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 -- 172.21.15.144:0/1817594420 >> 172.21.15.144:0/1817594420 conn(0x7f44d4068030 msgr2=0x7f44d4073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 -- 172.21.15.144:0/1817594420 shutdown_connections 2024-09-12T12:20:07.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:07.556+0000 7f44d9200640 1 -- 172.21.15.144:0/1817594420 wait complete. 2024-09-12T12:20:07.614 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:20:07.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:20:07.709 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:20:07.796 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:20:07.797 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:20:07.797 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:20:07.797 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:07.806 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:20:07.806 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:07.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:20:08.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.036+0000 7f4548800640 1 Processor -- start 2024-09-12T12:20:08.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.036+0000 7f4548800640 1 -- start start 2024-09-12T12:20:08.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4548800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f454015ad50 0x7f454015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4548800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f45400b3590 0x7f45400b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4548800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45400b3aa0 con 0x7f45400b4810 2024-09-12T12:20:08.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4548800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f454015f860 con 0x7f45400b3590 2024-09-12T12:20:08.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4548800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45400cdeb0 con 0x7f454015ad50 2024-09-12T12:20:08.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4546800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f45400b4810 0x7f45400b2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51630/0 (socket says 172.21.15.144:51630) 2024-09-12T12:20:08.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4546800640 1 -- 172.21.15.144:0/716040610 learned_addr learned my addr 172.21.15.144:0/716040610 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:08.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4545e00640 1 --2- 172.21.15.144:0/716040610 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f454015ad50 0x7f454015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4545400640 1 --2- 172.21.15.144:0/716040610 >> v2:172.21.15.165:3300/0 conn(0x7f45400b3590 0x7f45400b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4544a00640 1 -- 172.21.15.144:0/716040610 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143258451 0 0) 0x7f45400b3aa0 con 0x7f45400b4810 2024-09-12T12:20:08.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4544a00640 1 -- 172.21.15.144:0/716040610 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4528003530 con 0x7f45400b4810 2024-09-12T12:20:08.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4545e00640 1 -- 172.21.15.144:0/716040610 >> v2:172.21.15.165:3300/0 conn(0x7f45400b3590 msgr2=0x7f45400b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:08.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4545e00640 1 --2- 172.21.15.144:0/716040610 >> v2:172.21.15.165:3300/0 conn(0x7f45400b3590 0x7f45400b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4545e00640 1 -- 172.21.15.144:0/716040610 >> v1:172.21.15.144:6789/0 conn(0x7f45400b4810 legacy=0x7f45400b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4545e00640 1 -- 172.21.15.144:0/716040610 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45400afc10 con 0x7f454015ad50 2024-09-12T12:20:08.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.040+0000 7f4545400640 1 --2- 172.21.15.144:0/716040610 >> v2:172.21.15.165:3300/0 conn(0x7f45400b3590 0x7f45400b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:20:08.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4545e00640 1 --2- 172.21.15.144:0/716040610 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f454015ad50 0x7f454015f320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45340097c0 tx=0x7f453401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be17090fbc4e9ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4544a00640 1 -- 172.21.15.144:0/716040610 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45340b0070 con 0x7f454015ad50 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4544a00640 1 -- 172.21.15.144:0/716040610 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45340ab600 con 0x7f454015ad50 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4544a00640 1 -- 172.21.15.144:0/716040610 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45340ab9b0 con 0x7f454015ad50 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 -- 172.21.15.144:0/716040610 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f454015ad50 msgr2=0x7f454015f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 --2- 172.21.15.144:0/716040610 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f454015ad50 0x7f454015f320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f45340097c0 tx=0x7f453401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 -- 172.21.15.144:0/716040610 shutdown_connections 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 --2- 172.21.15.144:0/716040610 >> v2:172.21.15.165:3300/0 conn(0x7f45400b3590 0x7f45400b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 --2- 172.21.15.144:0/716040610 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f454015ad50 0x7f454015f320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 -- 172.21.15.144:0/716040610 >> 172.21.15.144:0/716040610 conn(0x7f454006d0d0 msgr2=0x7f454006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:08.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 -- 172.21.15.144:0/716040610 shutdown_connections 2024-09-12T12:20:08.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 -- 172.21.15.144:0/716040610 wait complete. 2024-09-12T12:20:08.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 Processor -- start 2024-09-12T12:20:08.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.044+0000 7f4548800640 1 -- start start 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4548800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45400b3590 0x7f454014ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4548800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45400b4810 0x7f45400aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4548800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f454015ad50 0x7f454016aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4548800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45400b2bc0 con 0x7f45400b4810 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4548800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45400b2a40 con 0x7f454015ad50 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4548800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45400b2d40 con 0x7f45400b3590 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45400b4810 0x7f45400aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45400b4810 0x7f45400aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58316/0 (socket says 172.21.15.144:58316) 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545400640 1 -- 172.21.15.144:0/671233579 learned_addr learned my addr 172.21.15.144:0/671233579 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:08.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545e00640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45400b3590 0x7f454014ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4546800640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f454015ad50 0x7f454016aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545400640 1 -- 172.21.15.144:0/671233579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45400b3590 msgr2=0x7f454014ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545400640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45400b3590 0x7f454014ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545400640 1 -- 172.21.15.144:0/671233579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f454015ad50 msgr2=0x7f454016aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545400640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f454015ad50 0x7f454016aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545400640 1 -- 172.21.15.144:0/671233579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4540169e50 con 0x7f45400b4810 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4545400640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45400b4810 0x7f45400aeaf0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f453000ebb0 tx=0x7f453000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f453a000640 1 -- 172.21.15.144:0/671233579 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530017070 con 0x7f45400b4810 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f453a000640 1 -- 172.21.15.144:0/671233579 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453000cc30 con 0x7f45400b4810 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f453a000640 1 -- 172.21.15.144:0/671233579 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530013470 con 0x7f45400b4810 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454016a3e0 con 0x7f45400b4810 2024-09-12T12:20:08.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454016a9a0 con 0x7f45400b4810 2024-09-12T12:20:08.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45400b3070 con 0x7f45400b4810 2024-09-12T12:20:08.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.048+0000 7f453a000640 1 -- 172.21.15.144:0/671233579 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f453001a070 con 0x7f45400b4810 2024-09-12T12:20:08.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.052+0000 7f453a000640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45240678c0 0x7f4524069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.052+0000 7f453a000640 1 -- 172.21.15.144:0/671233579 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f4530085da0 con 0x7f45400b4810 2024-09-12T12:20:08.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.052+0000 7f4545e00640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45240678c0 0x7f4524069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.052+0000 7f4545e00640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45240678c0 0x7f4524069d80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f45340ad000 tx=0x7f45340a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:08.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.056+0000 7f453a000640 1 -- 172.21.15.144:0/671233579 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4530056030 con 0x7f45400b4810 2024-09-12T12:20:08.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f45401542b0 con 0x7f45400b4810 2024-09-12T12:20:08.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f453a000640 1 -- 172.21.15.144:0/671233579 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7f453005a330 con 0x7f45400b4810 2024-09-12T12:20:08.224 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:20:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45240678c0 msgr2=0x7f4524069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45240678c0 0x7f4524069d80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f45340ad000 tx=0x7f45340a6000 comp rx=0 tx=0).stop 2024-09-12T12:20:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45400b4810 msgr2=0x7f45400aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45400b4810 0x7f45400aeaf0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f453000ebb0 tx=0x7f453000c520 comp rx=0 tx=0).stop 2024-09-12T12:20:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 shutdown_connections 2024-09-12T12:20:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45240678c0 0x7f4524069d80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f454015ad50 0x7f454016aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45400b4810 0x7f45400aeaf0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 --2- 172.21.15.144:0/671233579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45400b3590 0x7f454014ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 >> 172.21.15.144:0/671233579 conn(0x7f454006d0d0 msgr2=0x7f45400b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 shutdown_connections 2024-09-12T12:20:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.224+0000 7f4548800640 1 -- 172.21.15.144:0/671233579 wait complete. 2024-09-12T12:20:08.245 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:20:08.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:08.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:20:08.307 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:20:08.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:08.308 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:20:08.328 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:20:08.329 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:20:08.329 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:08.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:20:08.338 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:20:08.338 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:20:08.338 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:08.379 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:20:08.379 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:20:08.379 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:20:08.379 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:08.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:20:08.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6b2c00640 1 Processor -- start 2024-09-12T12:20:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6b2c00640 1 -- start start 2024-09-12T12:20:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6b2c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc6ac15c7b0 0x7fc6ac0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6b2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15cd30 0x7fc6ac0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6b2c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc6ac0b5de0 0x7fc6ac1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6b2c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ac072a50 con 0x7fc6ac15c7b0 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6b2c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ac0cde30 con 0x7fc6ac0b5de0 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6b2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac0b6210 con 0x7fc6ac15cd30 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc6ac15c7b0 0x7fc6ac0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc6ac15c7b0 0x7fc6ac0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58332/0 (socket says 172.21.15.144:58332) 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6abe00640 1 -- 172.21.15.144:0/3185073272 learned_addr learned my addr 172.21.15.144:0/3185073272 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6b0c00640 1 --2- 172.21.15.144:0/3185073272 >> v2:172.21.15.165:3300/0 conn(0x7fc6ac0b5de0 0x7fc6ac1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.556+0000 7fc6ab400640 1 --2- 172.21.15.144:0/3185073272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15cd30 0x7fc6ac0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6abe00640 1 -- 172.21.15.144:0/3185073272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15cd30 msgr2=0x7fc6ac0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6abe00640 1 --2- 172.21.15.144:0/3185073272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15cd30 0x7fc6ac0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6abe00640 1 -- 172.21.15.144:0/3185073272 >> v2:172.21.15.165:3300/0 conn(0x7fc6ac0b5de0 msgr2=0x7fc6ac1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6abe00640 1 --2- 172.21.15.144:0/3185073272 >> v2:172.21.15.165:3300/0 conn(0x7fc6ac0b5de0 0x7fc6ac1601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6abe00640 1 -- 172.21.15.144:0/3185073272 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac0cd870 con 0x7fc6ac15c7b0 2024-09-12T12:20:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6ab400640 1 --2- 172.21.15.144:0/3185073272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15cd30 0x7fc6ac0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6abe00640 1 --2- 172.21.15.144:0/3185073272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15c7b0 0x7fc6ac0ccf00 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0ce230 tx=0x7fc69c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bac914a2e3c319c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6aaa00640 1 -- 172.21.15.144:0/3185073272 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c0b0070 con 0x7fc6ac15c7b0 2024-09-12T12:20:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6aaa00640 1 -- 172.21.15.144:0/3185073272 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c0ab600 con 0x7fc6ac15c7b0 2024-09-12T12:20:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6aaa00640 1 -- 172.21.15.144:0/3185073272 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c0ab9d0 con 0x7fc6ac15c7b0 2024-09-12T12:20:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.560+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3185073272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15c7b0 msgr2=0x7fc6ac0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3185073272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15c7b0 0x7fc6ac0ccf00 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0ce230 tx=0x7fc69c01c260 comp rx=0 tx=0).stop 2024-09-12T12:20:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3185073272 shutdown_connections 2024-09-12T12:20:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3185073272 >> v2:172.21.15.165:3300/0 conn(0x7fc6ac0b5de0 0x7fc6ac1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3185073272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15cd30 0x7fc6ac0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3185073272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15c7b0 0x7fc6ac0ccf00 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3185073272 >> 172.21.15.144:0/3185073272 conn(0x7fc6ac06d0d0 msgr2=0x7fc6ac06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3185073272 shutdown_connections 2024-09-12T12:20:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3185073272 wait complete. 2024-09-12T12:20:08.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 Processor -- start 2024-09-12T12:20:08.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 -- start start 2024-09-12T12:20:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6ac0b5de0 0x7fc6ac0b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15c7b0 0x7fc6ac0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15cd30 0x7fc6ac0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac072ee0 con 0x7fc6ac15cd30 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0cd650 con 0x7fc6ac0b5de0 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac073060 con 0x7fc6ac15c7b0 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15cd30 0x7fc6ac0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15cd30 0x7fc6ac0b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58334/0 (socket says 172.21.15.144:58334) 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b0c00640 1 -- 172.21.15.144:0/3516574785 learned_addr learned my addr 172.21.15.144:0/3516574785 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6ab400640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15c7b0 0x7fc6ac0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6abe00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6ac0b5de0 0x7fc6ac0b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b0c00640 1 -- 172.21.15.144:0/3516574785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15c7b0 msgr2=0x7fc6ac0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b0c00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15c7b0 0x7fc6ac0b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b0c00640 1 -- 172.21.15.144:0/3516574785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6ac0b5de0 msgr2=0x7fc6ac0b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b0c00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6ac0b5de0 0x7fc6ac0b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b0c00640 1 -- 172.21.15.144:0/3516574785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac0b4050 con 0x7fc6ac15cd30 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.564+0000 7fc6b0c00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15cd30 0x7fc6ac0b4810 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400eed0 tx=0x7fc6a400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6a3e00640 1 -- 172.21.15.144:0/3516574785 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4018020 con 0x7fc6ac15cd30 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6a3e00640 1 -- 172.21.15.144:0/3516574785 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a4014400 con 0x7fc6ac15cd30 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6a3e00640 1 -- 172.21.15.144:0/3516574785 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40147f0 con 0x7fc6ac15cd30 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac0b2b90 con 0x7fc6ac15cd30 2024-09-12T12:20:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac0b42f0 con 0x7fc6ac15cd30 2024-09-12T12:20:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac0b44f0 con 0x7fc6ac15cd30 2024-09-12T12:20:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6a3e00640 1 -- 172.21.15.144:0/3516574785 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6a401b020 con 0x7fc6ac15cd30 2024-09-12T12:20:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6a3e00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc68c0678c0 0x7fc68c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6a3e00640 1 -- 172.21.15.144:0/3516574785 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fc6a4086330 con 0x7fc6ac15cd30 2024-09-12T12:20:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6abe00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc68c0678c0 0x7fc68c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.568+0000 7fc6abe00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc68c0678c0 0x7fc68c069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0ad000 tx=0x7fc69c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:08.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.572+0000 7fc6a3e00640 1 -- 172.21.15.144:0/3516574785 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc6ac0b44f0 con 0x7fc6ac15cd30 2024-09-12T12:20:08.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6ac0ccf00 con 0x7fc6ac15cd30 2024-09-12T12:20:08.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6a3e00640 1 -- 172.21.15.144:0/3516574785 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5237 (secure 0 0 0) 0x7fc6a4022070 con 0x7fc6ac15cd30 2024-09-12T12:20:08.763 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:08.763 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":89,"btime":"2024-09-12T12:18:43:560260+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6611,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3516117882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3516117882},{"type":"v1","addr":"172.21.15.144:6837","nonce":3516117882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4000269826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4000269826},{"type":"v1","addr":"172.21.15.165:6834","nonce":4000269826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2020456347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2020456347},{"type":"v1","addr":"172.21.15.165:6835","nonce":2020456347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-12T12:18:30.365135+0000","modified":"2024-09-12T12:18:42.837776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7273":{"gid":7273,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6836/3880489679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3880489679},{"type":"v1","addr":"172.21.15.144:6836","nonce":3880489679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7273,"qdb_cluster":[7273]},"id":7}]} 2024-09-12T12:20:08.763 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 89 2024-09-12T12:20:08.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc68c0678c0 msgr2=0x7fc68c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc68c0678c0 0x7fc68c069d80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0ad000 tx=0x7fc69c008040 comp rx=0 tx=0).stop 2024-09-12T12:20:08.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15cd30 msgr2=0x7fc6ac0b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15cd30 0x7fc6ac0b4810 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400eed0 tx=0x7fc6a400b480 comp rx=0 tx=0).stop 2024-09-12T12:20:08.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 shutdown_connections 2024-09-12T12:20:08.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc68c0678c0 0x7fc68c069d80 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6ac15cd30 0x7fc6ac0b4810 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6ac15c7b0 0x7fc6ac0b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 --2- 172.21.15.144:0/3516574785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6ac0b5de0 0x7fc6ac0b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 >> 172.21.15.144:0/3516574785 conn(0x7fc6ac06d0d0 msgr2=0x7fc6ac15b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:08.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 shutdown_connections 2024-09-12T12:20:08.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.764+0000 7fc6b2c00640 1 -- 172.21.15.144:0/3516574785 wait complete. 2024-09-12T12:20:08.787 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:08.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb31e00640 1 Processor -- start 2024-09-12T12:20:08.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb31e00640 1 -- start start 2024-09-12T12:20:08.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb31e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c159e60 0x7feb2c0d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb31e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feb2c0d29a0 0x7feb2c0b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb31e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb2c0b7380 0x7feb2c06f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb31e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7feb2c15d560 con 0x7feb2c0b7380 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb31e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7feb2c15c9b0 con 0x7feb2c0d29a0 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb31e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb2c0d2da0 con 0x7feb2c159e60 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb2b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb2c0b7380 0x7feb2c06f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb2b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb2c0b7380 0x7feb2c06f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58350/0 (socket says 172.21.15.144:58350) 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb2b400640 1 -- 172.21.15.144:0/789263399 learned_addr learned my addr 172.21.15.144:0/789263399 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb2aa00640 1 --2- 172.21.15.144:0/789263399 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c159e60 0x7feb2c0d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb23e00640 1 --2- 172.21.15.144:0/789263399 >> v2:172.21.15.165:3300/0 conn(0x7feb2c0d29a0 0x7feb2c0b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb2b400640 1 -- 172.21.15.144:0/789263399 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c159e60 msgr2=0x7feb2c0d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:08.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb2b400640 1 --2- 172.21.15.144:0/789263399 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c159e60 0x7feb2c0d2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb2b400640 1 -- 172.21.15.144:0/789263399 >> v2:172.21.15.165:3300/0 conn(0x7feb2c0d29a0 msgr2=0x7feb2c0b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:08.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb2b400640 1 --2- 172.21.15.144:0/789263399 >> v2:172.21.15.165:3300/0 conn(0x7feb2c0d29a0 0x7feb2c0b6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb2b400640 1 -- 172.21.15.144:0/789263399 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c15cc30 con 0x7feb2c0b7380 2024-09-12T12:20:08.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.924+0000 7feb23e00640 1 --2- 172.21.15.144:0/789263399 >> v2:172.21.15.165:3300/0 conn(0x7feb2c0d29a0 0x7feb2c0b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:08.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb2b400640 1 --2- 172.21.15.144:0/789263399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c0b7380 0x7feb2c06f340 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7feb2c074ad0 tx=0x7feb2401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63d390421e2e2fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:08.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb2a000640 1 -- 172.21.15.144:0/789263399 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb240a64b0 con 0x7feb2c0b7380 2024-09-12T12:20:08.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb2a000640 1 -- 172.21.15.144:0/789263399 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb240a6650 con 0x7feb2c0b7380 2024-09-12T12:20:08.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb2a000640 1 -- 172.21.15.144:0/789263399 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb240a6a20 con 0x7feb2c0b7380 2024-09-12T12:20:08.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb31e00640 1 -- 172.21.15.144:0/789263399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c0b7380 msgr2=0x7feb2c06f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb31e00640 1 --2- 172.21.15.144:0/789263399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c0b7380 0x7feb2c06f340 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7feb2c074ad0 tx=0x7feb2401c730 comp rx=0 tx=0).stop 2024-09-12T12:20:08.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb31e00640 1 -- 172.21.15.144:0/789263399 shutdown_connections 2024-09-12T12:20:08.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb31e00640 1 --2- 172.21.15.144:0/789263399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c0b7380 0x7feb2c06f340 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb31e00640 1 --2- 172.21.15.144:0/789263399 >> v2:172.21.15.165:3300/0 conn(0x7feb2c0d29a0 0x7feb2c0b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb31e00640 1 --2- 172.21.15.144:0/789263399 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c159e60 0x7feb2c0d2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb31e00640 1 -- 172.21.15.144:0/789263399 >> 172.21.15.144:0/789263399 conn(0x7feb2c067a00 msgr2=0x7feb2c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:08.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb31e00640 1 -- 172.21.15.144:0/789263399 shutdown_connections 2024-09-12T12:20:08.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.928+0000 7feb31e00640 1 -- 172.21.15.144:0/789263399 wait complete. 2024-09-12T12:20:08.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 Processor -- start 2024-09-12T12:20:08.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 -- start start 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c0b7380 0x7feb2c158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2c0d29a0 0x7feb2c0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c159e60 0x7feb2c0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c15a240 con 0x7feb2c159e60 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c0b77c0 con 0x7feb2c0d29a0 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb2c15a3c0 con 0x7feb2c0b7380 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c159e60 0x7feb2c0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c159e60 0x7feb2c0af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58352/0 (socket says 172.21.15.144:58352) 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2b400640 1 -- 172.21.15.144:0/161647279 learned_addr learned my addr 172.21.15.144:0/161647279 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2aa00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c0b7380 0x7feb2c158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb23e00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2c0d29a0 0x7feb2c0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2b400640 1 -- 172.21.15.144:0/161647279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c0b7380 msgr2=0x7feb2c158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2b400640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c0b7380 0x7feb2c158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2b400640 1 -- 172.21.15.144:0/161647279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2c0d29a0 msgr2=0x7feb2c0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2b400640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2c0d29a0 0x7feb2c0b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2b400640 1 -- 172.21.15.144:0/161647279 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c0b0b90 con 0x7feb2c159e60 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb2b400640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c159e60 0x7feb2c0af5c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7feb2401cfd0 tx=0x7feb240194d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb23400640 1 -- 172.21.15.144:0/161647279 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb240bf070 con 0x7feb2c159e60 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb23400640 1 -- 172.21.15.144:0/161647279 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb24009210 con 0x7feb2c159e60 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c0aeae0 con 0x7feb2c159e60 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb23400640 1 -- 172.21.15.144:0/161647279 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb240a6a40 con 0x7feb2c159e60 2024-09-12T12:20:08.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c0af0a0 con 0x7feb2c159e60 2024-09-12T12:20:08.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.932+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2c0af2a0 con 0x7feb2c159e60 2024-09-12T12:20:08.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.936+0000 7feb23400640 1 -- 172.21.15.144:0/161647279 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb240c2070 con 0x7feb2c159e60 2024-09-12T12:20:08.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.936+0000 7feb23400640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb080678c0 0x7feb08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:08.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.936+0000 7feb23400640 1 -- 172.21.15.144:0/161647279 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7feb2411faa0 con 0x7feb2c159e60 2024-09-12T12:20:08.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.936+0000 7feb2aa00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb080678c0 0x7feb08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:08.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.936+0000 7feb2aa00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb080678c0 0x7feb08069d80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7feb2c15fbd0 tx=0x7feb1c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:08.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:08.940+0000 7feb23400640 1 -- 172.21.15.144:0/161647279 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feb2c0af2a0 con 0x7feb2c159e60 2024-09-12T12:20:09.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.128+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb2c0732f0 con 0x7feb2c159e60 2024-09-12T12:20:09.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.128+0000 7feb23400640 1 -- 172.21.15.144:0/161647279 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5237 (secure 0 0 0) 0x7feb240165e0 con 0x7feb2c159e60 2024-09-12T12:20:09.130 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:09.130 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":89,"btime":"2024-09-12T12:18:43:560260+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6611,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3516117882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3516117882},{"type":"v1","addr":"172.21.15.144:6837","nonce":3516117882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4000269826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4000269826},{"type":"v1","addr":"172.21.15.165:6834","nonce":4000269826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2020456347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2020456347},{"type":"v1","addr":"172.21.15.165:6835","nonce":2020456347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-12T12:18:30.365135+0000","modified":"2024-09-12T12:18:42.837776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7273":{"gid":7273,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6836/3880489679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3880489679},{"type":"v1","addr":"172.21.15.144:6836","nonce":3880489679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7273,"qdb_cluster":[7273]},"id":7}]} 2024-09-12T12:20:09.130 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 89 2024-09-12T12:20:09.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb080678c0 msgr2=0x7feb08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb080678c0 0x7feb08069d80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7feb2c15fbd0 tx=0x7feb1c009190 comp rx=0 tx=0).stop 2024-09-12T12:20:09.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c159e60 msgr2=0x7feb2c0af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c159e60 0x7feb2c0af5c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7feb2401cfd0 tx=0x7feb240194d0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 shutdown_connections 2024-09-12T12:20:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb080678c0 0x7feb08069d80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb2c159e60 0x7feb2c0af5c0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb2c0d29a0 0x7feb2c0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 --2- 172.21.15.144:0/161647279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb2c0b7380 0x7feb2c158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 >> 172.21.15.144:0/161647279 conn(0x7feb2c067a00 msgr2=0x7feb2c0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 shutdown_connections 2024-09-12T12:20:09.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.132+0000 7feb31e00640 1 -- 172.21.15.144:0/161647279 wait complete. 2024-09-12T12:20:09.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:20:09.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb77ec00640 1 Processor -- start 2024-09-12T12:20:09.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb77ec00640 1 -- start start 2024-09-12T12:20:09.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb77ec00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb77815b4e0 0x7fb7780b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb77ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7780b3ad0 0x7fb778071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb77ec00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7780b45a0 con 0x7fb778071960 2024-09-12T12:20:09.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb77ec00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb7780b3fe0 con 0x7fb77815b4e0 2024-09-12T12:20:09.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb77ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7780b42c0 con 0x7fb7780b3ad0 2024-09-12T12:20:09.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb77cc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb778071960 0x7fb7780ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51632/0 (socket says 172.21.15.144:51632) 2024-09-12T12:20:09.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb77cc00640 1 -- 172.21.15.144:0/2339233592 learned_addr learned my addr 172.21.15.144:0/2339233592 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:09.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb76fe00640 1 --2- 172.21.15.144:0/2339233592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7780b3ad0 0x7fb778071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb777e00640 1 --2- 172.21.15.144:0/2339233592 >> v2:172.21.15.165:3300/0 conn(0x7fb77815b4e0 0x7fb7780b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb777400640 1 -- 172.21.15.144:0/2339233592 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196987131 0 0) 0x7fb7780b45a0 con 0x7fb778071960 2024-09-12T12:20:09.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb777400640 1 -- 172.21.15.144:0/2339233592 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb75c003530 con 0x7fb778071960 2024-09-12T12:20:09.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb777e00640 1 -- 172.21.15.144:0/2339233592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7780b3ad0 msgr2=0x7fb778071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:09.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb777e00640 1 --2- 172.21.15.144:0/2339233592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7780b3ad0 0x7fb778071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb777e00640 1 -- 172.21.15.144:0/2339233592 >> v1:172.21.15.144:6789/0 conn(0x7fb778071960 legacy=0x7fb7780ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.288+0000 7fb777e00640 1 -- 172.21.15.144:0/2339233592 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7780b1490 con 0x7fb77815b4e0 2024-09-12T12:20:09.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb777e00640 1 --2- 172.21.15.144:0/2339233592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 0x7fb7780b3590 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb7680097c0 tx=0x7fb76801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddf4cdc7ee1447f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:09.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb777400640 1 -- 172.21.15.144:0/2339233592 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7680aa5f0 con 0x7fb77815b4e0 2024-09-12T12:20:09.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb777400640 1 -- 172.21.15.144:0/2339233592 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7680af070 con 0x7fb77815b4e0 2024-09-12T12:20:09.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb777400640 1 -- 172.21.15.144:0/2339233592 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7680aa990 con 0x7fb77815b4e0 2024-09-12T12:20:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb77ec00640 1 -- 172.21.15.144:0/2339233592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 msgr2=0x7fb7780b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb77ec00640 1 --2- 172.21.15.144:0/2339233592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 0x7fb7780b3590 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb7680097c0 tx=0x7fb76801c470 comp rx=0 tx=0).stop 2024-09-12T12:20:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb77ec00640 1 -- 172.21.15.144:0/2339233592 shutdown_connections 2024-09-12T12:20:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb77ec00640 1 --2- 172.21.15.144:0/2339233592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7780b3ad0 0x7fb778071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb77ec00640 1 --2- 172.21.15.144:0/2339233592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 0x7fb7780b3590 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb77ec00640 1 -- 172.21.15.144:0/2339233592 >> 172.21.15.144:0/2339233592 conn(0x7fb77806d0d0 msgr2=0x7fb77806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb77ec00640 1 -- 172.21.15.144:0/2339233592 shutdown_connections 2024-09-12T12:20:09.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.292+0000 7fb77ec00640 1 -- 172.21.15.144:0/2339233592 wait complete. 2024-09-12T12:20:09.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 Processor -- start 2024-09-12T12:20:09.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 -- start start 2024-09-12T12:20:09.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb778071960 0x7fb7780cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7780b3ad0 0x7fb778147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 0x7fb7780ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7780b2620 con 0x7fb7780b3ad0 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7780b24a0 con 0x7fb77815b4e0 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7780cd640 con 0x7fb778071960 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb76fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7780b3ad0 0x7fb778147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb76fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7780b3ad0 0x7fb778147110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58366/0 (socket says 172.21.15.144:58366) 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb76fe00640 1 -- 172.21.15.144:0/3459909224 learned_addr learned my addr 172.21.15.144:0/3459909224 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb777e00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb778071960 0x7fb7780cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77cc00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 0x7fb7780ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb76fe00640 1 -- 172.21.15.144:0/3459909224 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb778071960 msgr2=0x7fb7780cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb76fe00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb778071960 0x7fb7780cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb76fe00640 1 -- 172.21.15.144:0/3459909224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 msgr2=0x7fb7780ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb76fe00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 0x7fb7780ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb76fe00640 1 -- 172.21.15.144:0/3459909224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb778147650 con 0x7fb7780b3ad0 2024-09-12T12:20:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77cc00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 0x7fb7780ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb76fe00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7780b3ad0 0x7fb778147110 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fb76000e900 tx=0x7fb76000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb774c00640 1 -- 172.21.15.144:0/3459909224 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760017070 con 0x7fb7780b3ad0 2024-09-12T12:20:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb774c00640 1 -- 172.21.15.144:0/3459909224 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76000ca00 con 0x7fb7780b3ad0 2024-09-12T12:20:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb774c00640 1 -- 172.21.15.144:0/3459909224 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76000cdd0 con 0x7fb7780b3ad0 2024-09-12T12:20:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7780ad640 con 0x7fb7780b3ad0 2024-09-12T12:20:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7780adc00 con 0x7fb7780b3ad0 2024-09-12T12:20:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.296+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb778071420 con 0x7fb7780b3ad0 2024-09-12T12:20:09.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.300+0000 7fb774c00640 1 -- 172.21.15.144:0/3459909224 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb76001a070 con 0x7fb7780b3ad0 2024-09-12T12:20:09.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.300+0000 7fb774c00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7540678c0 0x7fb754069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.300+0000 7fb774c00640 1 -- 172.21.15.144:0/3459909224 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7fb760085f70 con 0x7fb7780b3ad0 2024-09-12T12:20:09.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.300+0000 7fb777e00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7540678c0 0x7fb754069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.300+0000 7fb777e00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7540678c0 0x7fb754069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb7680ae000 tx=0x7fb7680a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:09.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.304+0000 7fb774c00640 1 -- 172.21.15.144:0/3459909224 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb760056850 con 0x7fb7780b3ad0 2024-09-12T12:20:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.464+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7780b5d80 con 0x7fb7780b3ad0 2024-09-12T12:20:09.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.464+0000 7fb774c00640 1 -- 172.21.15.144:0/3459909224 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+17085 (secure 0 0 0) 0x7fb760056150 con 0x7fb7780b3ad0 2024-09-12T12:20:09.465 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:09.465 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":118,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:19:50.219863+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:18:28.080682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T12:18:29.365313+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:20:09.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7540678c0 msgr2=0x7fb754069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7540678c0 0x7fb754069d80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb7680ae000 tx=0x7fb7680a7000 comp rx=0 tx=0).stop 2024-09-12T12:20:09.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7780b3ad0 msgr2=0x7fb778147110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7780b3ad0 0x7fb778147110 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fb76000e900 tx=0x7fb76000edc0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 shutdown_connections 2024-09-12T12:20:09.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7540678c0 0x7fb754069d80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77815b4e0 0x7fb7780ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7780b3ad0 0x7fb778147110 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 --2- 172.21.15.144:0/3459909224 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb778071960 0x7fb7780cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 >> 172.21.15.144:0/3459909224 conn(0x7fb77806d0d0 msgr2=0x7fb7780b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:09.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 shutdown_connections 2024-09-12T12:20:09.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.468+0000 7fb77ec00640 1 -- 172.21.15.144:0/3459909224 wait complete. 2024-09-12T12:20:09.486 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:20:09.486 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:09.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f4800640 1 Processor -- start 2024-09-12T12:20:09.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f4800640 1 -- start start 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f4800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f42ec071420 0x7f42ec071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f4800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec0ccf30 0x7f42ec0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f4800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ec0b45a0 con 0x7f42ec15b4e0 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f4800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f42ec0cd8e0 con 0x7f42ec071420 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f4800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42ec0b3fe0 con 0x7f42ec0ccf30 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f1400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f42ec071420 0x7f42ec071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec0ccf30 0x7f42ec0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f1400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f42ec071420 0x7f42ec071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:37418/0 (socket says 172.21.15.144:37418) 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f1e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f42ec15b4e0 0x7f42ec0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:45006/0 (socket says 172.21.15.144:45006) 2024-09-12T12:20:09.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.624+0000 7f42f1400640 1 -- 172.21.15.144:0/2541641829 learned_addr learned my addr 172.21.15.144:0/2541641829 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:09.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f2800640 1 -- 172.21.15.144:0/2541641829 >> v2:172.21.15.165:3300/0 conn(0x7f42ec071420 msgr2=0x7f42ec071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:09.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f2800640 1 --2- 172.21.15.144:0/2541641829 >> v2:172.21.15.165:3300/0 conn(0x7f42ec071420 0x7f42ec071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f2800640 1 -- 172.21.15.144:0/2541641829 >> v1:172.21.15.165:6789/0 conn(0x7f42ec15b4e0 legacy=0x7f42ec0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f2800640 1 -- 172.21.15.144:0/2541641829 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec0b42c0 con 0x7f42ec0ccf30 2024-09-12T12:20:09.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f0a00640 1 -- 172.21.15.144:0/2541641829 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176657973 0 0) 0x7f42ec0b45a0 con 0x7f42ec15b4e0 2024-09-12T12:20:09.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f1400640 1 --2- 172.21.15.144:0/2541641829 >> v2:172.21.15.165:3300/0 conn(0x7f42ec071420 0x7f42ec071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:20:09.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f2800640 1 --2- 172.21.15.144:0/2541641829 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec0ccf30 0x7f42ec0cd3a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009d90 tx=0x7f42e801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b578c96d4400097d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:09.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f0a00640 1 -- 172.21.15.144:0/2541641829 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e80b2070 con 0x7f42ec0ccf30 2024-09-12T12:20:09.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f0a00640 1 -- 172.21.15.144:0/2541641829 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e80a5a00 con 0x7f42ec0ccf30 2024-09-12T12:20:09.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.628+0000 7f42f0a00640 1 -- 172.21.15.144:0/2541641829 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e80a5dd0 con 0x7f42ec0ccf30 2024-09-12T12:20:09.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 -- 172.21.15.144:0/2541641829 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec0ccf30 msgr2=0x7f42ec0cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 --2- 172.21.15.144:0/2541641829 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec0ccf30 0x7f42ec0cd3a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009d90 tx=0x7f42e801c940 comp rx=0 tx=0).stop 2024-09-12T12:20:09.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 -- 172.21.15.144:0/2541641829 shutdown_connections 2024-09-12T12:20:09.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 --2- 172.21.15.144:0/2541641829 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec0ccf30 0x7f42ec0cd3a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 --2- 172.21.15.144:0/2541641829 >> v2:172.21.15.165:3300/0 conn(0x7f42ec071420 0x7f42ec071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 -- 172.21.15.144:0/2541641829 >> 172.21.15.144:0/2541641829 conn(0x7f42ec06d0d0 msgr2=0x7f42ec06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:09.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 -- 172.21.15.144:0/2541641829 shutdown_connections 2024-09-12T12:20:09.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 -- 172.21.15.144:0/2541641829 wait complete. 2024-09-12T12:20:09.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 Processor -- start 2024-09-12T12:20:09.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 -- start start 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42ec071420 0x7f42ec0ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42ec0ccf30 0x7f42ec15e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec15b4e0 0x7f42ec1619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec15b8c0 con 0x7f42ec071420 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec0cdef0 con 0x7f42ec0ccf30 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f4800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42ec0ac700 con 0x7f42ec15b4e0 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42ec071420 0x7f42ec0ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42ec071420 0x7f42ec0ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58378/0 (socket says 172.21.15.144:58378) 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1e00640 1 -- 172.21.15.144:0/1657511020 learned_addr learned my addr 172.21.15.144:0/1657511020 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f2800640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec15b4e0 0x7f42ec1619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1400640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42ec0ccf30 0x7f42ec15e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1e00640 1 -- 172.21.15.144:0/1657511020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec15b4e0 msgr2=0x7f42ec1619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1e00640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec15b4e0 0x7f42ec1619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1e00640 1 -- 172.21.15.144:0/1657511020 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42ec0ccf30 msgr2=0x7f42ec15e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1e00640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42ec0ccf30 0x7f42ec15e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1e00640 1 -- 172.21.15.144:0/1657511020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec0ac930 con 0x7f42ec071420 2024-09-12T12:20:09.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.632+0000 7f42f1e00640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42ec071420 0x7f42ec0ac1c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c410 tx=0x7f42e000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:09.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42e6000640 1 -- 172.21.15.144:0/1657511020 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00074e0 con 0x7f42ec071420 2024-09-12T12:20:09.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42e6000640 1 -- 172.21.15.144:0/1657511020 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e00047f0 con 0x7f42ec071420 2024-09-12T12:20:09.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42e6000640 1 -- 172.21.15.144:0/1657511020 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00076a0 con 0x7f42ec071420 2024-09-12T12:20:09.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ec0acc10 con 0x7f42ec071420 2024-09-12T12:20:09.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ec0ad1d0 con 0x7f42ec071420 2024-09-12T12:20:09.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ec071840 con 0x7f42ec071420 2024-09-12T12:20:09.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42e6000640 1 -- 172.21.15.144:0/1657511020 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42e001a020 con 0x7f42ec071420 2024-09-12T12:20:09.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42e6000640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42d00678c0 0x7f42d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42e6000640 1 -- 172.21.15.144:0/1657511020 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f42e0085560 con 0x7f42ec071420 2024-09-12T12:20:09.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.636+0000 7f42f1400640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42d00678c0 0x7f42d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.640+0000 7f42f1400640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42d00678c0 0x7f42d0069d80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f42dc006cb0 tx=0x7f42dc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:09.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.640+0000 7f42e6000640 1 -- 172.21.15.144:0/1657511020 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42e0001090 con 0x7f42ec071420 2024-09-12T12:20:09.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42ec0686c0 con 0x7f42ec071420 2024-09-12T12:20:09.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42e6000640 1 -- 172.21.15.144:0/1657511020 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5237 (secure 0 0 0) 0x7f42e0055880 con 0x7f42ec071420 2024-09-12T12:20:09.832 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:09.833 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":89,"btime":"2024-09-12T12:18:43:560260+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6611,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3516117882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3516117882},{"type":"v1","addr":"172.21.15.144:6837","nonce":3516117882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4000269826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4000269826},{"type":"v1","addr":"172.21.15.165:6834","nonce":4000269826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2020456347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2020456347},{"type":"v1","addr":"172.21.15.165:6835","nonce":2020456347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-12T12:18:30.365135+0000","modified":"2024-09-12T12:18:42.837776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7273":{"gid":7273,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6836/3880489679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3880489679},{"type":"v1","addr":"172.21.15.144:6836","nonce":3880489679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7273,"qdb_cluster":[7273]},"id":7}]} 2024-09-12T12:20:09.833 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 89 2024-09-12T12:20:09.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42d00678c0 msgr2=0x7f42d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42d00678c0 0x7f42d0069d80 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f42dc006cb0 tx=0x7f42dc009240 comp rx=0 tx=0).stop 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42ec071420 msgr2=0x7f42ec0ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42ec071420 0x7f42ec0ac1c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c410 tx=0x7f42e000c8d0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 shutdown_connections 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42d00678c0 0x7f42d0069d80 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42ec15b4e0 0x7f42ec1619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42ec0ccf30 0x7f42ec15e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.832+0000 7f42f4800640 1 --2- 172.21.15.144:0/1657511020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42ec071420 0x7f42ec0ac1c0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.836+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 >> 172.21.15.144:0/1657511020 conn(0x7f42ec06d0d0 msgr2=0x7f42ec0ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.836+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 shutdown_connections 2024-09-12T12:20:09.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.836+0000 7f42f4800640 1 -- 172.21.15.144:0/1657511020 wait complete. 2024-09-12T12:20:09.853 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:09.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.988+0000 7f7974c00640 1 Processor -- start 2024-09-12T12:20:09.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.988+0000 7f7974c00640 1 -- start start 2024-09-12T12:20:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f7974c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 0x7f79700b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f7974c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f79700b3ad0 0x7f7970071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f7974c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79700b45a0 con 0x7f7970071960 2024-09-12T12:20:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f7974c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f79700b3fe0 con 0x7f79700b3ad0 2024-09-12T12:20:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f7974c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f79700b42c0 con 0x7f797015b4e0 2024-09-12T12:20:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f796d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f79700b3ad0 0x7f7970071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f796d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f79700b3ad0 0x7f7970071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58390/0 (socket says 172.21.15.144:58390) 2024-09-12T12:20:09.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f796d400640 1 -- 172.21.15.144:0/3333988946 learned_addr learned my addr 172.21.15.144:0/3333988946 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:09.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f796de00640 1 --2- 172.21.15.144:0/3333988946 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 0x7f79700b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f796d400640 1 -- 172.21.15.144:0/3333988946 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 msgr2=0x7f79700b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:09.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f796d400640 1 --2- 172.21.15.144:0/3333988946 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 0x7f79700b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f796d400640 1 -- 172.21.15.144:0/3333988946 >> v1:172.21.15.165:6789/0 conn(0x7f7970071960 legacy=0x7f79700ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f796d400640 1 -- 172.21.15.144:0/3333988946 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79700b1490 con 0x7f79700b3ad0 2024-09-12T12:20:09.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.992+0000 7f796d400640 1 --2- 172.21.15.144:0/3333988946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 0x7f7970071420 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f795c009870 tx=0x7f795c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f092c706a8a9eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:09.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f796ca00640 1 -- 172.21.15.144:0/3333988946 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0a9610 con 0x7f79700b3ad0 2024-09-12T12:20:09.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f796ca00640 1 -- 172.21.15.144:0/3333988946 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f795c0a97b0 con 0x7f79700b3ad0 2024-09-12T12:20:09.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f796ca00640 1 -- 172.21.15.144:0/3333988946 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0a9b80 con 0x7f79700b3ad0 2024-09-12T12:20:09.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 -- 172.21.15.144:0/3333988946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 msgr2=0x7f7970071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:09.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 --2- 172.21.15.144:0/3333988946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 0x7f7970071420 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f795c009870 tx=0x7f795c01c530 comp rx=0 tx=0).stop 2024-09-12T12:20:09.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 -- 172.21.15.144:0/3333988946 shutdown_connections 2024-09-12T12:20:09.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 --2- 172.21.15.144:0/3333988946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 0x7f7970071420 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 --2- 172.21.15.144:0/3333988946 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 0x7f79700b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:09.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 -- 172.21.15.144:0/3333988946 >> 172.21.15.144:0/3333988946 conn(0x7f797006d0d0 msgr2=0x7f797006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:09.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 -- 172.21.15.144:0/3333988946 shutdown_connections 2024-09-12T12:20:09.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 -- 172.21.15.144:0/3333988946 wait complete. 2024-09-12T12:20:09.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 Processor -- start 2024-09-12T12:20:09.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 -- start start 2024-09-12T12:20:09.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7970071960 0x7f79700c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 0x7f79700cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 0x7f7970154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f79700b2620 con 0x7f79700b3ad0 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79700b24a0 con 0x7f7970071960 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f7974c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f79700cd640 con 0x7f797015b4e0 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f796d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 0x7f79700cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:09.996+0000 7f796d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 0x7f79700cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58404/0 (socket says 172.21.15.144:58404) 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f796d400640 1 -- 172.21.15.144:0/1534565944 learned_addr learned my addr 172.21.15.144:0/1534565944 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f796de00640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7970071960 0x7f79700c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:09.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f796e800640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 0x7f7970154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f796d400640 1 -- 172.21.15.144:0/1534565944 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 msgr2=0x7f7970154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f796d400640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 0x7f7970154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f796d400640 1 -- 172.21.15.144:0/1534565944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7970071960 msgr2=0x7f79700c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f796d400640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7970071960 0x7f79700c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f796d400640 1 -- 172.21.15.144:0/1534565944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797015a860 con 0x7f79700b3ad0 2024-09-12T12:20:10.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f796d400640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 0x7f79700cf780 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f795c0ab040 tx=0x7f795c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:10.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f7966000640 1 -- 172.21.15.144:0/1534565944 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0bc650 con 0x7f79700b3ad0 2024-09-12T12:20:10.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f7966000640 1 -- 172.21.15.144:0/1534565944 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f795c0bc7f0 con 0x7f79700b3ad0 2024-09-12T12:20:10.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797015bc70 con 0x7f79700b3ad0 2024-09-12T12:20:10.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f7966000640 1 -- 172.21.15.144:0/1534565944 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c0bcbe0 con 0x7f79700b3ad0 2024-09-12T12:20:10.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797015c230 con 0x7f79700b3ad0 2024-09-12T12:20:10.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7970071420 con 0x7f79700b3ad0 2024-09-12T12:20:10.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f7966000640 1 -- 172.21.15.144:0/1534565944 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f795c0a9630 con 0x7f79700b3ad0 2024-09-12T12:20:10.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.000+0000 7f7966000640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79500678c0 0x7f7950069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.004+0000 7f7966000640 1 -- 172.21.15.144:0/1534565944 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f795c1205d0 con 0x7f79700b3ad0 2024-09-12T12:20:10.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.004+0000 7f796de00640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79500678c0 0x7f7950069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.004+0000 7f796de00640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79500678c0 0x7f7950069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7970169440 tx=0x7f7960009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:10.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.004+0000 7f7966000640 1 -- 172.21.15.144:0/1534565944 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f795c0ad020 con 0x7f79700b3ad0 2024-09-12T12:20:10.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79700b0ca0 con 0x7f79700b3ad0 2024-09-12T12:20:10.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7966000640 1 -- 172.21.15.144:0/1534565944 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5237 (secure 0 0 0) 0x7f795c016150 con 0x7f79700b3ad0 2024-09-12T12:20:10.196 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:10.196 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":89,"btime":"2024-09-12T12:18:43:560260+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6611,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3516117882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3516117882},{"type":"v1","addr":"172.21.15.144:6837","nonce":3516117882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4000269826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4000269826},{"type":"v1","addr":"172.21.15.165:6834","nonce":4000269826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2020456347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2020456347},{"type":"v1","addr":"172.21.15.165:6835","nonce":2020456347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-12T12:18:30.365135+0000","modified":"2024-09-12T12:18:42.837776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7273":{"gid":7273,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6836/3880489679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3880489679},{"type":"v1","addr":"172.21.15.144:6836","nonce":3880489679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7273,"qdb_cluster":[7273]},"id":7}]} 2024-09-12T12:20:10.196 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 89 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79500678c0 msgr2=0x7f7950069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79500678c0 0x7f7950069d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7970169440 tx=0x7f7960009190 comp rx=0 tx=0).stop 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 msgr2=0x7f79700cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 0x7f79700cf780 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f795c0ab040 tx=0x7f795c01ad70 comp rx=0 tx=0).stop 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 shutdown_connections 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79500678c0 0x7f7950069d80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f797015b4e0 0x7f7970154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79700b3ad0 0x7f79700cf780 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 --2- 172.21.15.144:0/1534565944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7970071960 0x7f79700c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 >> 172.21.15.144:0/1534565944 conn(0x7f797006d0d0 msgr2=0x7f79700ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:10.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 shutdown_connections 2024-09-12T12:20:10.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.196+0000 7f7974c00640 1 -- 172.21.15.144:0/1534565944 wait complete. 2024-09-12T12:20:10.216 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:20:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.352+0000 7f6e4e600640 1 Processor -- start 2024-09-12T12:20:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4e600640 1 -- start start 2024-09-12T12:20:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4e600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e48073b50 0x7f6e4806f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4e600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4806bc10 con 0x7f6e48145d20 2024-09-12T12:20:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4e600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4806beb0 con 0x7f6e480ce800 2024-09-12T12:20:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4e600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6e4806c190 con 0x7f6e48073b50 2024-09-12T12:20:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4d200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6e48145d20 0x7f6e480cf0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51636/0 (socket says 172.21.15.144:51636) 2024-09-12T12:20:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4d200640 1 -- 172.21.15.144:0/2125632447 learned_addr learned my addr 172.21.15.144:0/2125632447 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4dc00640 1 --2- 172.21.15.144:0/2125632447 >> v2:172.21.15.144:3300/0 conn(0x7f6e48073b50 0x7f6e4806f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e47400640 1 -- 172.21.15.144:0/2125632447 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4117459247 0 0) 0x7f6e4806bc10 con 0x7f6e48145d20 2024-09-12T12:20:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e47400640 1 -- 172.21.15.144:0/2125632447 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e30003530 con 0x7f6e48145d20 2024-09-12T12:20:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4dc00640 1 -- 172.21.15.144:0/2125632447 >> v1:172.21.15.165:6789/0 conn(0x7f6e480ce800 legacy=0x7f6e48073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4dc00640 1 -- 172.21.15.144:0/2125632447 >> v1:172.21.15.144:6789/0 conn(0x7f6e48145d20 legacy=0x7f6e480cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.356+0000 7f6e4dc00640 1 -- 172.21.15.144:0/2125632447 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4806c470 con 0x7f6e48073b50 2024-09-12T12:20:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4dc00640 1 --2- 172.21.15.144:0/2125632447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e48073b50 0x7f6e4806f920 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009d90 tx=0x7f6e4001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ad07db570baf11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e47400640 1 -- 172.21.15.144:0/2125632447 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e400b2070 con 0x7f6e48073b50 2024-09-12T12:20:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e47400640 1 -- 172.21.15.144:0/2125632447 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e400a5980 con 0x7f6e48073b50 2024-09-12T12:20:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e47400640 1 -- 172.21.15.144:0/2125632447 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e400a5d30 con 0x7f6e48073b50 2024-09-12T12:20:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4e600640 1 -- 172.21.15.144:0/2125632447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e48073b50 msgr2=0x7f6e4806f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4e600640 1 --2- 172.21.15.144:0/2125632447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e48073b50 0x7f6e4806f920 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009d90 tx=0x7f6e4001c8a0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4e600640 1 -- 172.21.15.144:0/2125632447 shutdown_connections 2024-09-12T12:20:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4e600640 1 --2- 172.21.15.144:0/2125632447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e48073b50 0x7f6e4806f920 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4e600640 1 -- 172.21.15.144:0/2125632447 >> 172.21.15.144:0/2125632447 conn(0x7f6e480cdce0 msgr2=0x7f6e480ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4e600640 1 -- 172.21.15.144:0/2125632447 shutdown_connections 2024-09-12T12:20:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4e600640 1 -- 172.21.15.144:0/2125632447 wait complete. 2024-09-12T12:20:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4e600640 1 Processor -- start 2024-09-12T12:20:10.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.360+0000 7f6e4e600640 1 -- start start 2024-09-12T12:20:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e48073b50 0x7f6e48144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480ce800 0x7f6e480ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e48145d20 0x7f6e480afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4816a3a0 con 0x7f6e480ce800 2024-09-12T12:20:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4e600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4816a220 con 0x7f6e48145d20 2024-09-12T12:20:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6e4816a520 con 0x7f6e48073b50 2024-09-12T12:20:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e47e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480ce800 0x7f6e480ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e47e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480ce800 0x7f6e480ad530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58420/0 (socket says 172.21.15.144:58420) 2024-09-12T12:20:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e47e00640 1 -- 172.21.15.144:0/1491244075 learned_addr learned my addr 172.21.15.144:0/1491244075 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:10.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e47e00640 1 -- 172.21.15.144:0/1491244075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e48073b50 msgr2=0x7f6e48144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e47e00640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e48073b50 0x7f6e48144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4dc00640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e48145d20 0x7f6e480afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e47e00640 1 -- 172.21.15.144:0/1491244075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e48145d20 msgr2=0x7f6e480afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e47e00640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e48145d20 0x7f6e480afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e47e00640 1 -- 172.21.15.144:0/1491244075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4815ee00 con 0x7f6e480ce800 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4dc00640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e48145d20 0x7f6e480afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e47e00640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480ce800 0x7f6e480ad530 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400c450 tx=0x7f6e3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e44c00640 1 -- 172.21.15.144:0/1491244075 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34012830 con 0x7f6e480ce800 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e44c00640 1 -- 172.21.15.144:0/1491244075 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e34017070 con 0x7f6e480ce800 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e480af0e0 con 0x7f6e480ce800 2024-09-12T12:20:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e44c00640 1 -- 172.21.15.144:0/1491244075 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34012c30 con 0x7f6e480ce800 2024-09-12T12:20:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e480af6a0 con 0x7f6e480ce800 2024-09-12T12:20:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e480afb90 con 0x7f6e480ce800 2024-09-12T12:20:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.364+0000 7f6e44c00640 1 -- 172.21.15.144:0/1491244075 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e3401c460 con 0x7f6e480ce800 2024-09-12T12:20:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.368+0000 7f6e44c00640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e280678c0 0x7f6e28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.368+0000 7f6e44c00640 1 -- 172.21.15.144:0/1491244075 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f6e34085c40 con 0x7f6e480ce800 2024-09-12T12:20:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.368+0000 7f6e4d200640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e280678c0 0x7f6e28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.368+0000 7f6e4d200640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e280678c0 0x7f6e28069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007fd0 tx=0x7f6e3c007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.372+0000 7f6e44c00640 1 -- 172.21.15.144:0/1491244075 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6e340565b0 con 0x7f6e480ce800 2024-09-12T12:20:10.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.532+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e4806f920 con 0x7f6e480ce800 2024-09-12T12:20:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e44c00640 1 -- 172.21.15.144:0/1491244075 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+17085 (secure 0 0 0) 0x7f6e34055eb0 con 0x7f6e480ce800 2024-09-12T12:20:10.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:10.535 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":118,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:19:50.219863+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:18:28.080682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T12:18:29.365313+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e280678c0 msgr2=0x7f6e28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e280678c0 0x7f6e28069d80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c007fd0 tx=0x7f6e3c007900 comp rx=0 tx=0).stop 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480ce800 msgr2=0x7f6e480ad530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480ce800 0x7f6e480ad530 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400c450 tx=0x7f6e3400c910 comp rx=0 tx=0).stop 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 shutdown_connections 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e280678c0 0x7f6e28069d80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e48145d20 0x7f6e480afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480ce800 0x7f6e480ad530 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 --2- 172.21.15.144:0/1491244075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e48073b50 0x7f6e48144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 >> 172.21.15.144:0/1491244075 conn(0x7f6e480cdce0 msgr2=0x7f6e480aa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 shutdown_connections 2024-09-12T12:20:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.536+0000 7f6e4e600640 1 -- 172.21.15.144:0/1491244075 wait complete. 2024-09-12T12:20:10.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:20:10.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81b0c00640 1 Processor -- start 2024-09-12T12:20:10.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81b0c00640 1 -- start start 2024-09-12T12:20:10.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81b0c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac145d20 0x7f81ac0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81b0c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81ac073b50 0x7f81ac06f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81b0c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ac06bc10 con 0x7f81ac0ce800 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81b0c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f81ac06beb0 con 0x7f81ac073b50 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81b0c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f81ac06c190 con 0x7f81ac145d20 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81ac073b50 0x7f81ac06f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81ac073b50 0x7f81ac06f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58436/0 (socket says 172.21.15.144:58436) 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81abe00640 1 -- 172.21.15.144:0/46542756 learned_addr learned my addr 172.21.15.144:0/46542756 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81ab400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac145d20 0x7f81ac0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81abe00640 1 -- 172.21.15.144:0/46542756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac145d20 msgr2=0x7f81ac0cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81abe00640 1 --2- 172.21.15.144:0/46542756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac145d20 0x7f81ac0cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81abe00640 1 -- 172.21.15.144:0/46542756 >> v1:172.21.15.165:6789/0 conn(0x7f81ac0ce800 legacy=0x7f81ac073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.696+0000 7f81abe00640 1 -- 172.21.15.144:0/46542756 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac06c470 con 0x7f81ac073b50 2024-09-12T12:20:10.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81abe00640 1 --2- 172.21.15.144:0/46542756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac073b50 0x7f81ac06f920 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009e50 tx=0x7f81a401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257c29545f0a9807 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81aa000640 1 -- 172.21.15.144:0/46542756 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40a5860 con 0x7f81ac073b50 2024-09-12T12:20:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81aa000640 1 -- 172.21.15.144:0/46542756 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a40a5a00 con 0x7f81ac073b50 2024-09-12T12:20:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81aa000640 1 -- 172.21.15.144:0/46542756 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40a5dd0 con 0x7f81ac073b50 2024-09-12T12:20:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81b0c00640 1 -- 172.21.15.144:0/46542756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac073b50 msgr2=0x7f81ac06f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81b0c00640 1 --2- 172.21.15.144:0/46542756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac073b50 0x7f81ac06f920 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009e50 tx=0x7f81a401c9a0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81b0c00640 1 -- 172.21.15.144:0/46542756 shutdown_connections 2024-09-12T12:20:10.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81b0c00640 1 --2- 172.21.15.144:0/46542756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac073b50 0x7f81ac06f920 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81b0c00640 1 --2- 172.21.15.144:0/46542756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac145d20 0x7f81ac0cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81b0c00640 1 -- 172.21.15.144:0/46542756 >> 172.21.15.144:0/46542756 conn(0x7f81ac0cdce0 msgr2=0x7f81ac0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:10.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81b0c00640 1 -- 172.21.15.144:0/46542756 shutdown_connections 2024-09-12T12:20:10.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.700+0000 7f81b0c00640 1 -- 172.21.15.144:0/46542756 wait complete. 2024-09-12T12:20:10.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 Processor -- start 2024-09-12T12:20:10.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 -- start start 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac073b50 0x7f81ac15d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac0ce800 0x7f81ac143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81ac145d20 0x7f81ac0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac0ced60 con 0x7f81ac0ce800 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac0cebe0 con 0x7f81ac145d20 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f81ac169210 con 0x7f81ac073b50 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac0ce800 0x7f81ac143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81ab400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac073b50 0x7f81ac15d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81abe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81ac145d20 0x7f81ac0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac0ce800 0x7f81ac143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58450/0 (socket says 172.21.15.144:58450) 2024-09-12T12:20:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81ab400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac073b50 0x7f81ac15d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:57566/0 (socket says 172.21.15.144:57566) 2024-09-12T12:20:10.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81aaa00640 1 -- 172.21.15.144:0/446668632 learned_addr learned my addr 172.21.15.144:0/446668632 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81aaa00640 1 -- 172.21.15.144:0/446668632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac073b50 msgr2=0x7f81ac15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81aaa00640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac073b50 0x7f81ac15d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81aaa00640 1 -- 172.21.15.144:0/446668632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81ac145d20 msgr2=0x7f81ac0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81aaa00640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81ac145d20 0x7f81ac0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81aaa00640 1 -- 172.21.15.144:0/446668632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac15d760 con 0x7f81ac0ce800 2024-09-12T12:20:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81ab400640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac073b50 0x7f81ac15d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:20:10.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81aaa00640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac0ce800 0x7f81ac143150 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f819800c430 tx=0x7f819800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:10.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81a3400640 1 -- 172.21.15.144:0/446668632 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980052d0 con 0x7f81ac0ce800 2024-09-12T12:20:10.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81a3400640 1 -- 172.21.15.144:0/446668632 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8198005470 con 0x7f81ac0ce800 2024-09-12T12:20:10.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ac143ac0 con 0x7f81ac0ce800 2024-09-12T12:20:10.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81a3400640 1 -- 172.21.15.144:0/446668632 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198007260 con 0x7f81ac0ce800 2024-09-12T12:20:10.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ac144080 con 0x7f81ac0ce800 2024-09-12T12:20:10.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.704+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ac06f920 con 0x7f81ac0ce800 2024-09-12T12:20:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.708+0000 7f81a3400640 1 -- 172.21.15.144:0/446668632 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8198007400 con 0x7f81ac0ce800 2024-09-12T12:20:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.708+0000 7f81a3400640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f818c0678c0 0x7f818c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.708+0000 7f81a3400640 1 -- 172.21.15.144:0/446668632 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6158+0+0 (secure 0 0 0) 0x7f8198085340 con 0x7f81ac0ce800 2024-09-12T12:20:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.708+0000 7f81ab400640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f818c0678c0 0x7f818c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:10.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.708+0000 7f81ab400640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f818c0678c0 0x7f818c069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f819c009eb0 tx=0x7f819c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:10.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.712+0000 7f81a3400640 1 -- 172.21.15.144:0/446668632 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f81980555d0 con 0x7f81ac0ce800 2024-09-12T12:20:10.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.904+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f81ac15faa0 con 0x7f81ac0ce800 2024-09-12T12:20:10.904 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:20:10.904+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:20:10.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81a3400640 1 -- 172.21.15.144:0/446668632 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) ==== 161+0+0 (secure 0 0 0) 0x7f81980598d0 con 0x7f81ac0ce800 2024-09-12T12:20:10.906 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:20:10.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f818c0678c0 msgr2=0x7f818c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f818c0678c0 0x7f818c069d80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f819c009eb0 tx=0x7f819c009190 comp rx=0 tx=0).stop 2024-09-12T12:20:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac0ce800 msgr2=0x7f81ac143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac0ce800 0x7f81ac143150 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f819800c430 tx=0x7f819800c8f0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 shutdown_connections 2024-09-12T12:20:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f818c0678c0 0x7f818c069d80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81ac145d20 0x7f81ac0ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81ac0ce800 0x7f81ac143150 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 --2- 172.21.15.144:0/446668632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81ac073b50 0x7f81ac15d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.908+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 >> 172.21.15.144:0/446668632 conn(0x7f81ac0cdce0 msgr2=0x7f81ac0aa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:10.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.912+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 shutdown_connections 2024-09-12T12:20:10.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:10.912+0000 7f81b0c00640 1 -- 172.21.15.144:0/446668632 wait complete. 2024-09-12T12:20:10.931 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:20:10.981 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:20:11.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.072+0000 7f2f1c200640 1 Processor -- start 2024-09-12T12:20:11.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.072+0000 7f2f1c200640 1 -- start start 2024-09-12T12:20:11.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f1c200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f1415c8c0 0x7f2f14072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f1c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 0x7f2f1415dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f1c200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1415cdb0 con 0x7f2f14142500 2024-09-12T12:20:11.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f1c200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2f140cdc60 con 0x7f2f1415c8c0 2024-09-12T12:20:11.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f1c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1415d090 con 0x7f2f14073020 2024-09-12T12:20:11.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f18e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f1415c8c0 0x7f2f14072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f19800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2f14142500 0x7f2f141608c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51648/0 (socket says 172.21.15.144:51648) 2024-09-12T12:20:11.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f19800640 1 -- 172.21.15.144:0/4193667088 learned_addr learned my addr 172.21.15.144:0/4193667088 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:11.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f1a200640 1 --2- 172.21.15.144:0/4193667088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 0x7f2f1415dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f18e00640 1 -- 172.21.15.144:0/4193667088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 msgr2=0x7f2f1415dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:11.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f18e00640 1 --2- 172.21.15.144:0/4193667088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 0x7f2f1415dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f18e00640 1 -- 172.21.15.144:0/4193667088 >> v1:172.21.15.144:6789/0 conn(0x7f2f14142500 legacy=0x7f2f141608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:11.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f18e00640 1 -- 172.21.15.144:0/4193667088 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1415d370 con 0x7f2f1415c8c0 2024-09-12T12:20:11.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f18e00640 1 --2- 172.21.15.144:0/4193667088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1415c8c0 0x7f2f14072ae0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f2f000097c0 tx=0x7f2f0001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4d4122ecacab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:11.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.076+0000 7f2f13e00640 1 -- 172.21.15.144:0/4193667088 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000b0070 con 0x7f2f1415c8c0 2024-09-12T12:20:11.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f13e00640 1 -- 172.21.15.144:0/4193667088 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f000ab600 con 0x7f2f1415c8c0 2024-09-12T12:20:11.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f13e00640 1 -- 172.21.15.144:0/4193667088 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000ab9d0 con 0x7f2f1415c8c0 2024-09-12T12:20:11.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 -- 172.21.15.144:0/4193667088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1415c8c0 msgr2=0x7f2f14072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:11.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 --2- 172.21.15.144:0/4193667088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1415c8c0 0x7f2f14072ae0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f2f000097c0 tx=0x7f2f0001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 -- 172.21.15.144:0/4193667088 shutdown_connections 2024-09-12T12:20:11.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 --2- 172.21.15.144:0/4193667088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 0x7f2f1415dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 --2- 172.21.15.144:0/4193667088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1415c8c0 0x7f2f14072ae0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 -- 172.21.15.144:0/4193667088 >> 172.21.15.144:0/4193667088 conn(0x7f2f1406cb10 msgr2=0x7f2f1406cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:11.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 -- 172.21.15.144:0/4193667088 shutdown_connections 2024-09-12T12:20:11.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 -- 172.21.15.144:0/4193667088 wait complete. 2024-09-12T12:20:11.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 Processor -- start 2024-09-12T12:20:11.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 -- start start 2024-09-12T12:20:11.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 0x7f2f140c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f14142500 0x7f2f140b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f1415c8c0 0x7f2f14157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1415ed70 con 0x7f2f14142500 2024-09-12T12:20:11.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1415ebf0 con 0x7f2f1415c8c0 2024-09-12T12:20:11.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1415eef0 con 0x7f2f14073020 2024-09-12T12:20:11.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f18e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f14142500 0x7f2f140b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f18e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f14142500 0x7f2f140b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58486/0 (socket says 172.21.15.144:58486) 2024-09-12T12:20:11.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f18e00640 1 -- 172.21.15.144:0/299966748 learned_addr learned my addr 172.21.15.144:0/299966748 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f19800640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 0x7f2f140c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.080+0000 7f2f1a200640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f1415c8c0 0x7f2f14157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f18e00640 1 -- 172.21.15.144:0/299966748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 msgr2=0x7f2f140c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f18e00640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 0x7f2f140c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f18e00640 1 -- 172.21.15.144:0/299966748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f1415c8c0 msgr2=0x7f2f14157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f18e00640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f1415c8c0 0x7f2f14157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f18e00640 1 -- 172.21.15.144:0/299966748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f140c6d40 con 0x7f2f14142500 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f18e00640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f14142500 0x7f2f140b5e60 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f2f0001a0d0 tx=0x7f2f0001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f11600640 1 -- 172.21.15.144:0/299966748 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000b0050 con 0x7f2f14142500 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f11600640 1 -- 172.21.15.144:0/299966748 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f000bc070 con 0x7f2f14142500 2024-09-12T12:20:11.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f140c7020 con 0x7f2f14142500 2024-09-12T12:20:11.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f11600640 1 -- 172.21.15.144:0/299966748 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000b5830 con 0x7f2f14142500 2024-09-12T12:20:11.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f140c75e0 con 0x7f2f14142500 2024-09-12T12:20:11.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f14067f30 con 0x7f2f14142500 2024-09-12T12:20:11.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f11600640 1 -- 172.21.15.144:0/299966748 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f000b59d0 con 0x7f2f14142500 2024-09-12T12:20:11.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f11600640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2ef40678c0 0x7f2ef4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:11.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f11600640 1 -- 172.21.15.144:0/299966748 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6216+0+0 (secure 0 0 0) 0x7f2f001205a0 con 0x7f2f14142500 2024-09-12T12:20:11.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.084+0000 7f2f19800640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2ef40678c0 0x7f2ef4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:11.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.088+0000 7f2f19800640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2ef40678c0 0x7f2ef4069d80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2f080012f0 tx=0x7f2f08001a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:11.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.088+0000 7f2f11600640 1 -- 172.21.15.144:0/299966748 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f00016090 con 0x7f2f14142500 2024-09-12T12:20:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.280+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2f140af340 con 0x7f2f14142500 2024-09-12T12:20:11.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.912+0000 7f2f11600640 1 -- 172.21.15.144:0/299966748 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) ==== 104+0+0 (secure 0 0 0) 0x7f2f000f0760 con 0x7f2f14142500 2024-09-12T12:20:11.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2ef40678c0 msgr2=0x7f2ef4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:11.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2ef40678c0 0x7f2ef4069d80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2f080012f0 tx=0x7f2f08001a40 comp rx=0 tx=0).stop 2024-09-12T12:20:11.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f14142500 msgr2=0x7f2f140b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:11.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f14142500 0x7f2f140b5e60 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f2f0001a0d0 tx=0x7f2f0001ace0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 shutdown_connections 2024-09-12T12:20:11.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2ef40678c0 0x7f2ef4069d80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f1415c8c0 0x7f2f14157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f14142500 0x7f2f140b5e60 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 --2- 172.21.15.144:0/299966748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f14073020 0x7f2f140c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:11.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 >> 172.21.15.144:0/299966748 conn(0x7f2f1406cb10 msgr2=0x7f2f1406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:11.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 shutdown_connections 2024-09-12T12:20:11.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:11.916+0000 7f2f1c200640 1 -- 172.21.15.144:0/299966748 wait complete. 2024-09-12T12:20:11.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:20:12.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f6605400640 1 Processor -- start 2024-09-12T12:20:12.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f6605400640 1 -- start start 2024-09-12T12:20:12.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f6605400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66000b3490 0x7f66000b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:12.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f6605400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f660006d630 0x7f6600155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:12.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f6605400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f660006cd20 con 0x7f660006d250 2024-09-12T12:20:12.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f6605400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6600072620 con 0x7f66000b3490 2024-09-12T12:20:12.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f6605400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f66000b4f30 con 0x7f660006d630 2024-09-12T12:20:12.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f65fde00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66000b3490 0x7f66000b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:12.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f65fde00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f66000b3490 0x7f66000b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58490/0 (socket says 172.21.15.144:58490) 2024-09-12T12:20:12.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f65fde00640 1 -- 172.21.15.144:0/273974973 learned_addr learned my addr 172.21.15.144:0/273974973 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:12.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f65ff200640 1 --2- 172.21.15.144:0/273974973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f660006d630 0x7f6600155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:12.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f65fde00640 1 -- 172.21.15.144:0/273974973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f660006d630 msgr2=0x7f6600155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:12.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f65fde00640 1 --2- 172.21.15.144:0/273974973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f660006d630 0x7f6600155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f65fde00640 1 -- 172.21.15.144:0/273974973 >> v1:172.21.15.165:6789/0 conn(0x7f660006d250 legacy=0x7f660015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:12.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.120+0000 7f65fde00640 1 -- 172.21.15.144:0/273974973 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66000b3950 con 0x7f66000b3490 2024-09-12T12:20:12.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f65fde00640 1 --2- 172.21.15.144:0/273974973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 0x7f66000b49f0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009870 tx=0x7f65ec01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d37b743b4e48e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:12.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f65fd400640 1 -- 172.21.15.144:0/273974973 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0a9610 con 0x7f66000b3490 2024-09-12T12:20:12.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f65fd400640 1 -- 172.21.15.144:0/273974973 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec0a97b0 con 0x7f66000b3490 2024-09-12T12:20:12.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f65fd400640 1 -- 172.21.15.144:0/273974973 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0a9b80 con 0x7f66000b3490 2024-09-12T12:20:12.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f6605400640 1 -- 172.21.15.144:0/273974973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 msgr2=0x7f66000b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:12.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f6605400640 1 --2- 172.21.15.144:0/273974973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 0x7f66000b49f0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009870 tx=0x7f65ec01c530 comp rx=0 tx=0).stop 2024-09-12T12:20:12.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f6605400640 1 -- 172.21.15.144:0/273974973 shutdown_connections 2024-09-12T12:20:12.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f6605400640 1 --2- 172.21.15.144:0/273974973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f660006d630 0x7f6600155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f6605400640 1 --2- 172.21.15.144:0/273974973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 0x7f66000b49f0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f6605400640 1 -- 172.21.15.144:0/273974973 >> 172.21.15.144:0/273974973 conn(0x7f660006bc10 msgr2=0x7f660006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:12.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f6605400640 1 -- 172.21.15.144:0/273974973 shutdown_connections 2024-09-12T12:20:12.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.124+0000 7f6605400640 1 -- 172.21.15.144:0/273974973 wait complete. 2024-09-12T12:20:12.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 Processor -- start 2024-09-12T12:20:12.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 -- start start 2024-09-12T12:20:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f660006d250 0x7f6600141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f660006d630 0x7f6600156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 0x7f66001568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f66000b44d0 con 0x7f66000b3490 2024-09-12T12:20:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f66000b41f0 con 0x7f660006d250 2024-09-12T12:20:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f660015d690 con 0x7f660006d630 2024-09-12T12:20:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65ff200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 0x7f66001568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65ff200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 0x7f66001568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58492/0 (socket says 172.21.15.144:58492) 2024-09-12T12:20:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65ff200640 1 -- 172.21.15.144:0/4180275843 learned_addr learned my addr 172.21.15.144:0/4180275843 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:12.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65ff200640 1 -- 172.21.15.144:0/4180275843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f660006d630 msgr2=0x7f6600156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:12.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65ff200640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f660006d630 0x7f6600156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65ff200640 1 -- 172.21.15.144:0/4180275843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f660006d250 msgr2=0x7f6600141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:12.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65fe800640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f660006d250 0x7f6600141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:12.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65ff200640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f660006d250 0x7f6600141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65ff200640 1 -- 172.21.15.144:0/4180275843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66000d11b0 con 0x7f66000b3490 2024-09-12T12:20:12.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65fe800640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f660006d250 0x7f6600141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:12.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65ff200640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 0x7f66001568c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f65f800d830 tx=0x7f65f800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:12.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65f6a00640 1 -- 172.21.15.144:0/4180275843 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f800b6c0 con 0x7f66000b3490 2024-09-12T12:20:12.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65f6a00640 1 -- 172.21.15.144:0/4180275843 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f8019070 con 0x7f66000b3490 2024-09-12T12:20:12.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6600157530 con 0x7f66000b3490 2024-09-12T12:20:12.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f65f6a00640 1 -- 172.21.15.144:0/4180275843 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f800baa0 con 0x7f66000b3490 2024-09-12T12:20:12.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.128+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6600157af0 con 0x7f66000b3490 2024-09-12T12:20:12.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.132+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6600157d30 con 0x7f66000b3490 2024-09-12T12:20:12.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.132+0000 7f65f6a00640 1 -- 172.21.15.144:0/4180275843 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f65f801e460 con 0x7f66000b3490 2024-09-12T12:20:12.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.132+0000 7f65f6a00640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65e00678c0 0x7f65e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:12.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.132+0000 7f65f6a00640 1 -- 172.21.15.144:0/4180275843 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6216+0+0 (secure 0 0 0) 0x7f65f8086620 con 0x7f66000b3490 2024-09-12T12:20:12.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.132+0000 7f65fe800640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65e00678c0 0x7f65e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:12.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.132+0000 7f65fe800640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65e00678c0 0x7f65e0069d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007fd0 tx=0x7f65f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:12.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.136+0000 7f65f6a00640 1 -- 172.21.15.144:0/4180275843 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f65f8056ec0 con 0x7f66000b3490 2024-09-12T12:20:12.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.296+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6600155820 con 0x7f66000b3490 2024-09-12T12:20:12.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.916+0000 7f65f6a00640 1 -- 172.21.15.144:0/4180275843 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) ==== 181+0+0 (secure 0 0 0) 0x7f65f80567c0 con 0x7f66000b3490 2024-09-12T12:20:12.915 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:20:12.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65e00678c0 msgr2=0x7f65e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:12.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65e00678c0 0x7f65e0069d80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007fd0 tx=0x7f65f0009040 comp rx=0 tx=0).stop 2024-09-12T12:20:12.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 msgr2=0x7f66001568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:12.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 0x7f66001568c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f65f800d830 tx=0x7f65f800dcf0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 shutdown_connections 2024-09-12T12:20:12.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65e00678c0 0x7f65e0069d80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66000b3490 0x7f66001568c0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f660006d630 0x7f6600156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 --2- 172.21.15.144:0/4180275843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f660006d250 0x7f6600141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 >> 172.21.15.144:0/4180275843 conn(0x7f660006bc10 msgr2=0x7f66000d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 shutdown_connections 2024-09-12T12:20:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:12.920+0000 7f6605400640 1 -- 172.21.15.144:0/4180275843 wait complete. 2024-09-12T12:20:12.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:20:13.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bf600640 1 Processor -- start 2024-09-12T12:20:13.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bf600640 1 -- start start 2024-09-12T12:20:13.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bf600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2b815f590 0x7fd2b8169270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:13.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bf600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b8073a20 con 0x7fd2b8162a90 2024-09-12T12:20:13.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bf600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b8072c60 con 0x7fd2b806f020 2024-09-12T12:20:13.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bf600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b8072a10 con 0x7fd2b815f590 2024-09-12T12:20:13.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bcc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd2b8162a90 0x7fd2b806e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51656/0 (socket says 172.21.15.144:51656) 2024-09-12T12:20:13.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bcc00640 1 -- 172.21.15.144:0/369694684 learned_addr learned my addr 172.21.15.144:0/369694684 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:13.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bd600640 1 --2- 172.21.15.144:0/369694684 >> v2:172.21.15.144:3300/0 conn(0x7fd2b815f590 0x7fd2b8169270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:13.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bd600640 1 -- 172.21.15.144:0/369694684 >> v1:172.21.15.165:6789/0 conn(0x7fd2b806f020 legacy=0x7fd2b815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:13.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bd600640 1 -- 172.21.15.144:0/369694684 >> v1:172.21.15.144:6789/0 conn(0x7fd2b8162a90 legacy=0x7fd2b806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:13.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2bd600640 1 -- 172.21.15.144:0/369694684 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b8072f40 con 0x7fd2b815f590 2024-09-12T12:20:13.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.100+0000 7fd2b7400640 1 -- 172.21.15.144:0/369694684 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2175324637 0 0) 0x7fd2b8073a20 con 0x7fd2b8162a90 2024-09-12T12:20:13.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2bd600640 1 --2- 172.21.15.144:0/369694684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b815f590 0x7fd2b8169270 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009dc0 tx=0x7fd2b001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fa70b8ea17966 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:13.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2b7400640 1 -- 172.21.15.144:0/369694684 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00b2070 con 0x7fd2b815f590 2024-09-12T12:20:13.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2b7400640 1 -- 172.21.15.144:0/369694684 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b00a5890 con 0x7fd2b815f590 2024-09-12T12:20:13.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2b7400640 1 -- 172.21.15.144:0/369694684 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00a5c60 con 0x7fd2b815f590 2024-09-12T12:20:13.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2bf600640 1 -- 172.21.15.144:0/369694684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b815f590 msgr2=0x7fd2b8169270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:13.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2bf600640 1 --2- 172.21.15.144:0/369694684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b815f590 0x7fd2b8169270 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009dc0 tx=0x7fd2b001c8c0 comp rx=0 tx=0).stop 2024-09-12T12:20:13.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2bf600640 1 -- 172.21.15.144:0/369694684 shutdown_connections 2024-09-12T12:20:13.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2bf600640 1 --2- 172.21.15.144:0/369694684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b815f590 0x7fd2b8169270 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:13.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2bf600640 1 -- 172.21.15.144:0/369694684 >> 172.21.15.144:0/369694684 conn(0x7fd2b806ddf0 msgr2=0x7fd2b806e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:13.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2bf600640 1 -- 172.21.15.144:0/369694684 shutdown_connections 2024-09-12T12:20:13.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.104+0000 7fd2bf600640 1 -- 172.21.15.144:0/369694684 wait complete. 2024-09-12T12:20:13.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 Processor -- start 2024-09-12T12:20:13.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 -- start start 2024-09-12T12:20:13.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b806f020 0x7fd2b8141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:13.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2b815f590 0x7fd2b81437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:13.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2b8162a90 0x7fd2b80cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:13.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8162ff0 con 0x7fd2b806f020 2024-09-12T12:20:13.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8162e70 con 0x7fd2b815f590 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b816bfd0 con 0x7fd2b8162a90 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b806f020 0x7fd2b8141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b806f020 0x7fd2b8141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58504/0 (socket says 172.21.15.144:58504) 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bcc00640 1 -- 172.21.15.144:0/2757324047 learned_addr learned my addr 172.21.15.144:0/2757324047 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bd600640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2b8162a90 0x7fd2b80cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2b7e00640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2b815f590 0x7fd2b81437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bcc00640 1 -- 172.21.15.144:0/2757324047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2b8162a90 msgr2=0x7fd2b80cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bcc00640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2b8162a90 0x7fd2b80cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bcc00640 1 -- 172.21.15.144:0/2757324047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2b815f590 msgr2=0x7fd2b81437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bcc00640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2b815f590 0x7fd2b81437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bcc00640 1 -- 172.21.15.144:0/2757324047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b8150440 con 0x7fd2b806f020 2024-09-12T12:20:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2b7e00640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2b815f590 0x7fd2b81437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:13.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bcc00640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b806f020 0x7fd2b8141910 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00c4d0 tx=0x7fd2ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:13.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2b4c00640 1 -- 172.21.15.144:0/2757324047 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac018070 con 0x7fd2b806f020 2024-09-12T12:20:13.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2b4c00640 1 -- 172.21.15.144:0/2757324047 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0074e0 con 0x7fd2b806f020 2024-09-12T12:20:13.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2b4c00640 1 -- 172.21.15.144:0/2757324047 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac004a30 con 0x7fd2b806f020 2024-09-12T12:20:13.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b8150720 con 0x7fd2b806f020 2024-09-12T12:20:13.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b80cf150 con 0x7fd2b806f020 2024-09-12T12:20:13.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.108+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b8144270 con 0x7fd2b806f020 2024-09-12T12:20:13.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.112+0000 7fd2b4c00640 1 -- 172.21.15.144:0/2757324047 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2ac004bd0 con 0x7fd2b806f020 2024-09-12T12:20:13.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.112+0000 7fd2b4c00640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2980678c0 0x7fd298069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:13.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.112+0000 7fd2b4c00640 1 -- 172.21.15.144:0/2757324047 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5778+0+0 (secure 0 0 0) 0x7fd2ac084fe0 con 0x7fd2b806f020 2024-09-12T12:20:13.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.112+0000 7fd2b7e00640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2980678c0 0x7fd298069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:13.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.112+0000 7fd2b7e00640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2980678c0 0x7fd298069d80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd2b81fab20 tx=0x7fd2a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:13.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.116+0000 7fd2b4c00640 1 -- 172.21.15.144:0/2757324047 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2ac0554b0 con 0x7fd2b806f020 2024-09-12T12:20:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.276+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd2b8072110 con 0x7fd2b806f020 2024-09-12T12:20:13.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:20:13.629 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:20:13.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.920+0000 7fd2b4c00640 1 -- 172.21.15.144:0/2757324047 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) ==== 169+0+0 (secure 0 0 0) 0x7fd2ac0597b0 con 0x7fd2b806f020 2024-09-12T12:20:13.922 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2980678c0 msgr2=0x7fd298069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2980678c0 0x7fd298069d80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd2b81fab20 tx=0x7fd2a4009040 comp rx=0 tx=0).stop 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b806f020 msgr2=0x7fd2b8141910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b806f020 0x7fd2b8141910 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00c4d0 tx=0x7fd2ac00c990 comp rx=0 tx=0).stop 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 shutdown_connections 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2980678c0 0x7fd298069d80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2b8162a90 0x7fd2b80cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2b815f590 0x7fd2b81437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 --2- 172.21.15.144:0/2757324047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2b806f020 0x7fd2b8141910 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.924+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 >> 172.21.15.144:0/2757324047 conn(0x7fd2b806ddf0 msgr2=0x7fd2b8151cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:13.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.928+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 shutdown_connections 2024-09-12T12:20:13.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:13.928+0000 7fd2bf600640 1 -- 172.21.15.144:0/2757324047 wait complete. 2024-09-12T12:20:13.954 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:20:14.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5aca00640 1 Processor -- start 2024-09-12T12:20:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5aca00640 1 -- start start 2024-09-12T12:20:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5aca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa5a806bc10 0x7fa5a806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5aca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a808c2e0 0x7fa5a808c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5aca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a816c8c0 con 0x7fa5a806d0f0 2024-09-12T12:20:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5aca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a806c530 con 0x7fa5a806bc10 2024-09-12T12:20:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5aca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a80cf530 con 0x7fa5a808c2e0 2024-09-12T12:20:14.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5a6800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa5a806d0f0 0x7fa5a806d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51660/0 (socket says 172.21.15.144:51660) 2024-09-12T12:20:14.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5a6800640 1 -- 172.21.15.144:0/3302011348 learned_addr learned my addr 172.21.15.144:0/3302011348 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:14.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5a5400640 1 --2- 172.21.15.144:0/3302011348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a808c2e0 0x7fa5a808c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:14.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.104+0000 7fa5a5e00640 1 --2- 172.21.15.144:0/3302011348 >> v2:172.21.15.165:3300/0 conn(0x7fa5a806bc10 0x7fa5a806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:14.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.728+0000 7fa5a5e00640 1 -- 172.21.15.144:0/3302011348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a808c2e0 msgr2=0x7fa5a808c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:14.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.728+0000 7fa5a5e00640 1 --2- 172.21.15.144:0/3302011348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a808c2e0 0x7fa5a808c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.728+0000 7fa5a5e00640 1 -- 172.21.15.144:0/3302011348 >> v1:172.21.15.144:6789/0 conn(0x7fa5a806d0f0 legacy=0x7fa5a806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:14.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.728+0000 7fa5a5e00640 1 -- 172.21.15.144:0/3302011348 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a80cf810 con 0x7fa5a806bc10 2024-09-12T12:20:14.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.728+0000 7fa5a5400640 1 --2- 172.21.15.144:0/3302011348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a808c2e0 0x7fa5a808c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:20:14.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5a5e00640 1 --2- 172.21.15.144:0/3302011348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5a806bc10 0x7fa5a806bff0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa5980097c0 tx=0x7fa59801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d8f00de38c98262 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:14.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5a4a00640 1 -- 172.21.15.144:0/3302011348 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5980b1070 con 0x7fa5a806bc10 2024-09-12T12:20:14.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5a4a00640 1 -- 172.21.15.144:0/3302011348 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5980a8050 con 0x7fa5a806bc10 2024-09-12T12:20:14.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5a4a00640 1 -- 172.21.15.144:0/3302011348 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5980ac860 con 0x7fa5a806bc10 2024-09-12T12:20:14.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5aca00640 1 -- 172.21.15.144:0/3302011348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5a806bc10 msgr2=0x7fa5a806bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:14.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5aca00640 1 --2- 172.21.15.144:0/3302011348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5a806bc10 0x7fa5a806bff0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa5980097c0 tx=0x7fa59801c3e0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5aca00640 1 -- 172.21.15.144:0/3302011348 shutdown_connections 2024-09-12T12:20:14.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5aca00640 1 --2- 172.21.15.144:0/3302011348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a808c2e0 0x7fa5a808c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5aca00640 1 --2- 172.21.15.144:0/3302011348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5a806bc10 0x7fa5a806bff0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.732+0000 7fa5aca00640 1 -- 172.21.15.144:0/3302011348 >> 172.21.15.144:0/3302011348 conn(0x7fa5a8067e00 msgr2=0x7fa5a80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:14.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 -- 172.21.15.144:0/3302011348 shutdown_connections 2024-09-12T12:20:14.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 -- 172.21.15.144:0/3302011348 wait complete. 2024-09-12T12:20:14.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 Processor -- start 2024-09-12T12:20:14.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 -- start start 2024-09-12T12:20:14.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a806bc10 0x7fa5a815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:14.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5a806d0f0 0x7fa5a8073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:14.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5a808c2e0 0x7fa5a8073690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:14.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a80b3ae0 con 0x7fa5a806d0f0 2024-09-12T12:20:14.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a80b3960 con 0x7fa5a808c2e0 2024-09-12T12:20:14.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5aca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a80cf150 con 0x7fa5a806bc10 2024-09-12T12:20:14.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5a806d0f0 0x7fa5a8073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:14.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5a806d0f0 0x7fa5a8073150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58514/0 (socket says 172.21.15.144:58514) 2024-09-12T12:20:14.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a5400640 1 -- 172.21.15.144:0/3022606501 learned_addr learned my addr 172.21.15.144:0/3022606501 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:14.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a6800640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5a808c2e0 0x7fa5a8073690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:14.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a5e00640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a806bc10 0x7fa5a815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a5400640 1 -- 172.21.15.144:0/3022606501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a806bc10 msgr2=0x7fa5a815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a5400640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a806bc10 0x7fa5a815dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a5400640 1 -- 172.21.15.144:0/3022606501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5a808c2e0 msgr2=0x7fa5a8073690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a5400640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5a808c2e0 0x7fa5a8073690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.736+0000 7fa5a5400640 1 -- 172.21.15.144:0/3022606501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a815f720 con 0x7fa5a806d0f0 2024-09-12T12:20:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa5a5400640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5a806d0f0 0x7fa5a8073150 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fa59400a7d0 tx=0x7fa59400ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa59e000640 1 -- 172.21.15.144:0/3022606501 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940094e0 con 0x7fa5a806d0f0 2024-09-12T12:20:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa59e000640 1 -- 172.21.15.144:0/3022606501 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa594019070 con 0x7fa5a806d0f0 2024-09-12T12:20:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a815f160 con 0x7fa5a806d0f0 2024-09-12T12:20:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa59e000640 1 -- 172.21.15.144:0/3022606501 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59400e990 con 0x7fa5a806d0f0 2024-09-12T12:20:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a8165330 con 0x7fa5a806d0f0 2024-09-12T12:20:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a80b56a0 con 0x7fa5a806d0f0 2024-09-12T12:20:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa59e000640 1 -- 172.21.15.144:0/3022606501 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa59400eb30 con 0x7fa5a806d0f0 2024-09-12T12:20:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa59e000640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5880678f0 0x7fa588069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa59e000640 1 -- 172.21.15.144:0/3022606501 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7fa594085550 con 0x7fa5a806d0f0 2024-09-12T12:20:14.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.740+0000 7fa5a5e00640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5880678f0 0x7fa588069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:14.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.744+0000 7fa5a5e00640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5880678f0 0x7fa588069db0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa5980ae000 tx=0x7fa5980a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:14.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.748+0000 7fa59e000640 1 -- 172.21.15.144:0/3022606501 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa594022020 con 0x7fa5a806d0f0 2024-09-12T12:20:14.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.908+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa5a8169940 con 0x7fa5a806d0f0 2024-09-12T12:20:14.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa59e000640 1 -- 172.21.15.144:0/3022606501 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7fa594011070 con 0x7fa5a806d0f0 2024-09-12T12:20:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5880678f0 msgr2=0x7fa588069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5880678f0 0x7fa588069db0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa5980ae000 tx=0x7fa5980a7000 comp rx=0 tx=0).stop 2024-09-12T12:20:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5a806d0f0 msgr2=0x7fa5a8073150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5a806d0f0 0x7fa5a8073150 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fa59400a7d0 tx=0x7fa59400ac90 comp rx=0 tx=0).stop 2024-09-12T12:20:14.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 shutdown_connections 2024-09-12T12:20:14.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5880678f0 0x7fa588069db0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5a808c2e0 0x7fa5a8073690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5a806d0f0 0x7fa5a8073150 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 --2- 172.21.15.144:0/3022606501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5a806bc10 0x7fa5a815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:14.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 >> 172.21.15.144:0/3022606501 conn(0x7fa5a8067e00 msgr2=0x7fa5a80752a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:14.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 shutdown_connections 2024-09-12T12:20:14.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:14.912+0000 7fa5aca00640 1 -- 172.21.15.144:0/3022606501 wait complete. 2024-09-12T12:20:14.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-12T12:20:15.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.084+0000 7f2e84600640 1 Processor -- start 2024-09-12T12:20:15.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.084+0000 7f2e84600640 1 -- start start 2024-09-12T12:20:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e84600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e7c071420 0x7f2e7c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e84600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c0ccf30 0x7f2e7c0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e84600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e7c0b45a0 con 0x7f2e7c15b4e0 2024-09-12T12:20:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e84600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2e7c0cd8e0 con 0x7f2e7c071420 2024-09-12T12:20:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e84600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7c0b3fe0 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e81200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e7c071420 0x7f2e7c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e81200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e7c071420 0x7f2e7c071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58520/0 (socket says 172.21.15.144:58520) 2024-09-12T12:20:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e81200640 1 -- 172.21.15.144:0/3133061931 learned_addr learned my addr 172.21.15.144:0/3133061931 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:15.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e82600640 1 --2- 172.21.15.144:0/3133061931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c0ccf30 0x7f2e7c0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:15.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e81200640 1 -- 172.21.15.144:0/3133061931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c0ccf30 msgr2=0x7f2e7c0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:15.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e81200640 1 --2- 172.21.15.144:0/3133061931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c0ccf30 0x7f2e7c0cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:15.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e81200640 1 -- 172.21.15.144:0/3133061931 >> v1:172.21.15.165:6789/0 conn(0x7f2e7c15b4e0 legacy=0x7f2e7c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:15.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e81200640 1 -- 172.21.15.144:0/3133061931 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c0b42c0 con 0x7f2e7c071420 2024-09-12T12:20:15.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.088+0000 7f2e82600640 1 --2- 172.21.15.144:0/3133061931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c0ccf30 0x7f2e7c0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:15.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e81200640 1 --2- 172.21.15.144:0/3133061931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c071420 0x7f2e7c071840 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009870 tx=0x7f2e6801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9f1ee6b2d08961 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:15.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e7be00640 1 -- 172.21.15.144:0/3133061931 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e680a95f0 con 0x7f2e7c071420 2024-09-12T12:20:15.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e7be00640 1 -- 172.21.15.144:0/3133061931 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e680a9790 con 0x7f2e7c071420 2024-09-12T12:20:15.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e7be00640 1 -- 172.21.15.144:0/3133061931 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e680a9b60 con 0x7f2e7c071420 2024-09-12T12:20:15.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 -- 172.21.15.144:0/3133061931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c071420 msgr2=0x7f2e7c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:15.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 --2- 172.21.15.144:0/3133061931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c071420 0x7f2e7c071840 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f2e68009870 tx=0x7f2e6801c530 comp rx=0 tx=0).stop 2024-09-12T12:20:15.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 -- 172.21.15.144:0/3133061931 shutdown_connections 2024-09-12T12:20:15.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 --2- 172.21.15.144:0/3133061931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c0ccf30 0x7f2e7c0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:15.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 --2- 172.21.15.144:0/3133061931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c071420 0x7f2e7c071840 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:15.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 -- 172.21.15.144:0/3133061931 >> 172.21.15.144:0/3133061931 conn(0x7f2e7c06d0d0 msgr2=0x7f2e7c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:15.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 -- 172.21.15.144:0/3133061931 shutdown_connections 2024-09-12T12:20:15.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 -- 172.21.15.144:0/3133061931 wait complete. 2024-09-12T12:20:15.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 Processor -- start 2024-09-12T12:20:15.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.092+0000 7f2e84600640 1 -- start start 2024-09-12T12:20:15.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e84600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c071420 0x7f2e7c153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:15.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e84600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c0ccf30 0x7f2e7c15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:15.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e84600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15b4e0 0x7f2e7c155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:15.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e84600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c15b8c0 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e84600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c0cdef0 con 0x7f2e7c15b4e0 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e84600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7c15bbd0 con 0x7f2e7c071420 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c0ccf30 0x7f2e7c15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c0ccf30 0x7f2e7c15d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58530/0 (socket says 172.21.15.144:58530) 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81200640 1 -- 172.21.15.144:0/3357444644 learned_addr learned my addr 172.21.15.144:0/3357444644 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e82600640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15b4e0 0x7f2e7c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81c00640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c071420 0x7f2e7c153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81200640 1 -- 172.21.15.144:0/3357444644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c071420 msgr2=0x7f2e7c153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81200640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c071420 0x7f2e7c153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81200640 1 -- 172.21.15.144:0/3357444644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15b4e0 msgr2=0x7f2e7c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81200640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15b4e0 0x7f2e7c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:15.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81200640 1 -- 172.21.15.144:0/3357444644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c15e130 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e81200640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c0ccf30 0x7f2e7c15d6e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2e680ab040 tx=0x7f2e6801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:15.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e79600640 1 -- 172.21.15.144:0/3357444644 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e680b1800 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e79600640 1 -- 172.21.15.144:0/3357444644 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e680b19a0 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7c15be20 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e79600640 1 -- 172.21.15.144:0/3357444644 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e680b1d90 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7c15c3e0 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7c071840 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.096+0000 7f2e79600640 1 -- 172.21.15.144:0/3357444644 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e680a9650 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.100+0000 7f2e79600640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e5c0678c0 0x7f2e5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:15.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.100+0000 7f2e79600640 1 -- 172.21.15.144:0/3357444644 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f2e681204e0 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.100+0000 7f2e81c00640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e5c0678c0 0x7f2e5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:15.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.100+0000 7f2e81c00640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e5c0678c0 0x7f2e5c069d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007fd0 tx=0x7f2e70009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:15.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.104+0000 7f2e79600640 1 -- 172.21.15.144:0/3357444644 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2e680ad020 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.316+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f2e7c0686c0 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.928+0000 7f2e79600640 1 -- 172.21.15.144:0/3357444644 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v374) ==== 158+0+0 (secure 0 0 0) 0x7f2e68016150 con 0x7f2e7c0ccf30 2024-09-12T12:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e5c0678c0 msgr2=0x7f2e5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e5c0678c0 0x7f2e5c069d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007fd0 tx=0x7f2e70009040 comp rx=0 tx=0).stop 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c0ccf30 msgr2=0x7f2e7c15d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c0ccf30 0x7f2e7c15d6e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2e680ab040 tx=0x7f2e6801ad70 comp rx=0 tx=0).stop 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 shutdown_connections 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e5c0678c0 0x7f2e5c069d80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15b4e0 0x7f2e7c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c0ccf30 0x7f2e7c15d6e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 --2- 172.21.15.144:0/3357444644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c071420 0x7f2e7c153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 >> 172.21.15.144:0/3357444644 conn(0x7f2e7c06d0d0 msgr2=0x7f2e7c071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 shutdown_connections 2024-09-12T12:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:15.932+0000 7f2e84600640 1 -- 172.21.15.144:0/3357444644 wait complete. 2024-09-12T12:20:15.955 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-09-12T12:20:15.956 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-12T12:20:15.956 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:20:16.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.096+0000 7f36e8c00640 1 Processor -- start 2024-09-12T12:20:16.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.096+0000 7f36e8c00640 1 -- start start 2024-09-12T12:20:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.096+0000 7f36e8c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f36e415b4e0 0x7f36e40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.096+0000 7f36e8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 0x7f36e4071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.096+0000 7f36e8c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36e40b45a0 con 0x7f36e4071960 2024-09-12T12:20:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.096+0000 7f36e8c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f36e40b3fe0 con 0x7f36e415b4e0 2024-09-12T12:20:16.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.096+0000 7f36e8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f36e40b42c0 con 0x7f36e40b3ad0 2024-09-12T12:20:16.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e1e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f36e415b4e0 0x7f36e40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e1e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f36e415b4e0 0x7f36e40b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:37538/0 (socket says 172.21.15.144:37538) 2024-09-12T12:20:16.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e2800640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f36e4071960 0x7f36e40ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:45070/0 (socket says 172.21.15.144:45070) 2024-09-12T12:20:16.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 0x7f36e4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e1e00640 1 -- 172.21.15.144:0/1325240286 learned_addr learned my addr 172.21.15.144:0/1325240286 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:16.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e1e00640 1 -- 172.21.15.144:0/1325240286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 msgr2=0x7f36e4071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:16.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e1e00640 1 --2- 172.21.15.144:0/1325240286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 0x7f36e4071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e1e00640 1 -- 172.21.15.144:0/1325240286 >> v1:172.21.15.165:6789/0 conn(0x7f36e4071960 legacy=0x7f36e40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e1e00640 1 -- 172.21.15.144:0/1325240286 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e40b1490 con 0x7f36e415b4e0 2024-09-12T12:20:16.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.100+0000 7f36e1e00640 1 --2- 172.21.15.144:0/1325240286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e415b4e0 0x7f36e40b3590 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009e50 tx=0x7f36d401ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f250b98f5a71403 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e0a00640 1 -- 172.21.15.144:0/1325240286 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d40a58f0 con 0x7f36e415b4e0 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e0a00640 1 -- 172.21.15.144:0/1325240286 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d40a5a90 con 0x7f36e415b4e0 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e0a00640 1 -- 172.21.15.144:0/1325240286 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d40a5e60 con 0x7f36e415b4e0 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 -- 172.21.15.144:0/1325240286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e415b4e0 msgr2=0x7f36e40b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 --2- 172.21.15.144:0/1325240286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e415b4e0 0x7f36e40b3590 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009e50 tx=0x7f36d401ca00 comp rx=0 tx=0).stop 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 -- 172.21.15.144:0/1325240286 shutdown_connections 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 --2- 172.21.15.144:0/1325240286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 0x7f36e4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 --2- 172.21.15.144:0/1325240286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e415b4e0 0x7f36e40b3590 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 -- 172.21.15.144:0/1325240286 >> 172.21.15.144:0/1325240286 conn(0x7f36e406d0d0 msgr2=0x7f36e406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 -- 172.21.15.144:0/1325240286 shutdown_connections 2024-09-12T12:20:16.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 -- 172.21.15.144:0/1325240286 wait complete. 2024-09-12T12:20:16.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 Processor -- start 2024-09-12T12:20:16.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 -- start start 2024-09-12T12:20:16.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e4071960 0x7f36e41529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 0x7f36e4168a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e415b4e0 0x7f36e4157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36e40b2620 con 0x7f36e415b4e0 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36e40b24a0 con 0x7f36e4071960 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f36e40cd640 con 0x7f36e40b3ad0 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e1e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e4071960 0x7f36e41529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e415b4e0 0x7f36e4157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e1e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e4071960 0x7f36e41529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:37550/0 (socket says 172.21.15.144:37550) 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e1e00640 1 -- 172.21.15.144:0/1573707724 learned_addr learned my addr 172.21.15.144:0/1573707724 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:16.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.104+0000 7f36e1400640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 0x7f36e4168a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e1e00640 1 -- 172.21.15.144:0/1573707724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 msgr2=0x7f36e4168a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e1e00640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 0x7f36e4168a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e1e00640 1 -- 172.21.15.144:0/1573707724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e415b4e0 msgr2=0x7f36e4157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e1e00640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e415b4e0 0x7f36e4157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e1e00640 1 -- 172.21.15.144:0/1573707724 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e4152ee0 con 0x7f36e4071960 2024-09-12T12:20:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e1e00640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e4071960 0x7f36e41529a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f36d401a630 tx=0x7f36d40197a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36da000640 1 -- 172.21.15.144:0/1573707724 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d40bc030 con 0x7f36e4071960 2024-09-12T12:20:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36da000640 1 -- 172.21.15.144:0/1573707724 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d4007c70 con 0x7f36e4071960 2024-09-12T12:20:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e4167970 con 0x7f36e4071960 2024-09-12T12:20:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36da000640 1 -- 172.21.15.144:0/1573707724 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d40a58f0 con 0x7f36e4071960 2024-09-12T12:20:16.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e4167f30 con 0x7f36e4071960 2024-09-12T12:20:16.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e4071420 con 0x7f36e4071960 2024-09-12T12:20:16.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36da000640 1 -- 172.21.15.144:0/1573707724 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36d40bf070 con 0x7f36e4071960 2024-09-12T12:20:16.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36da000640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36c40678c0 0x7f36c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36da000640 1 -- 172.21.15.144:0/1573707724 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f36d4120950 con 0x7f36e4071960 2024-09-12T12:20:16.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.108+0000 7f36e1400640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36c40678c0 0x7f36c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.112+0000 7f36e1400640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36c40678c0 0x7f36c4069d80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f36e4153420 tx=0x7f36d0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:16.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.116+0000 7f36da000640 1 -- 172.21.15.144:0/1573707724 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f36d4016620 con 0x7f36e4071960 2024-09-12T12:20:16.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.280+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36e40af9a0 con 0x7f36e4071960 2024-09-12T12:20:16.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.280+0000 7f36da000640 1 -- 172.21.15.144:0/1573707724 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+13341 (secure 0 0 0) 0x7f36d40f1060 con 0x7f36e4071960 2024-09-12T12:20:16.280 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:16.281 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":121,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:20:13.919056+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6836/3880489679":"2024-09-13T12:20:10.907807+0000","172.21.15.144:6834/3880489679":"2024-09-13T12:20:10.907807+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:20:16.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.280+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36c40678c0 msgr2=0x7f36c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.280+0000 7f36e8c00640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36c40678c0 0x7f36c4069d80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f36e4153420 tx=0x7f36d0009190 comp rx=0 tx=0).stop 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.280+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e4071960 msgr2=0x7f36e41529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.280+0000 7f36e8c00640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e4071960 0x7f36e41529a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f36d401a630 tx=0x7f36d40197a0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.284+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 shutdown_connections 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.284+0000 7f36e8c00640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36c40678c0 0x7f36c4069d80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.284+0000 7f36e8c00640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e415b4e0 0x7f36e4157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.284+0000 7f36e8c00640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36e40b3ad0 0x7f36e4168a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.284+0000 7f36e8c00640 1 --2- 172.21.15.144:0/1573707724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36e4071960 0x7f36e41529a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.284+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 >> 172.21.15.144:0/1573707724 conn(0x7f36e406d0d0 msgr2=0x7f36e40cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.284+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 shutdown_connections 2024-09-12T12:20:16.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.284+0000 7f36e8c00640 1 -- 172.21.15.144:0/1573707724 wait complete. 2024-09-12T12:20:16.301 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:20:16.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:20:16.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2350400640 1 Processor -- start 2024-09-12T12:20:16.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2350400640 1 -- start start 2024-09-12T12:20:16.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2350400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f234806c320 0x7f2348165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2350400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23480b4300 con 0x7f234815af60 2024-09-12T12:20:16.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2350400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23480b3540 con 0x7f23480cd9f0 2024-09-12T12:20:16.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2350400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f23480b32f0 con 0x7f234806c320 2024-09-12T12:20:16.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f234da00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f234815af60 0x7f23480ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51662/0 (socket says 172.21.15.144:51662) 2024-09-12T12:20:16.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f234da00640 1 -- 172.21.15.144:0/1890023552 learned_addr learned my addr 172.21.15.144:0/1890023552 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:16.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f234e400640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f234806c320 0x7f2348165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587672300 0 0) 0x7f23480b4300 con 0x7f234815af60 2024-09-12T12:20:16.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2330003530 con 0x7f234815af60 2024-09-12T12:20:16.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4011637108 0 0) 0x7f2330003530 con 0x7f234815af60 2024-09-12T12:20:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f234806c320 msgr2=0x7f2348165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f234806c320 0x7f2348165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 >> v1:172.21.15.165:6789/0 conn(0x7f23480cd9f0 legacy=0x7f234806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23480b3820 con 0x7f234815af60 2024-09-12T12:20:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f233c001680 con 0x7f234815af60 2024-09-12T12:20:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 >> v1:172.21.15.144:6789/0 conn(0x7f234815af60 legacy=0x7f23480ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f234806c320 0x7f23300039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2330003f30 0x7f2330004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2330004d50 0x7f23300051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f23480b32f0 con 0x7f2330003f30 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f233000ba30 con 0x7f2330004d50 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f233000de40 con 0x7f234806c320 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f234d000640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2330003f30 0x7f2330004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f234da00640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f234806c320 0x7f23300039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f234e400640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2330004d50 0x7f23300051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f234d000640 1 -- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f234806c320 msgr2=0x7f23300039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f234d000640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f234806c320 0x7f23300039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.444+0000 7f234d000640 1 -- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2330004d50 msgr2=0x7f23300051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f234d000640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2330004d50 0x7f23300051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f234d000640 1 -- 172.21.15.144:0/1890023552 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2330003530 con 0x7f2330003f30 2024-09-12T12:20:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f234e400640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2330004d50 0x7f23300051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:16.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f234d000640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2330003f30 0x7f2330004810 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2334001860 tx=0x7f233401ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e723ba5898b2e64f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23340b5070 con 0x7f2330003f30 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23340a87d0 con 0x7f2330003f30 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f2347e00640 1 -- 172.21.15.144:0/1890023552 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334001460 con 0x7f2330003f30 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f2350400640 1 -- 172.21.15.144:0/1890023552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2330003f30 msgr2=0x7f2330004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f2350400640 1 --2- 172.21.15.144:0/1890023552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2330003f30 0x7f2330004810 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2334001860 tx=0x7f233401ebb0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f234e400640 1 -- 172.21.15.144:0/1890023552 reap_dead start 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f2350400640 1 -- 172.21.15.144:0/1890023552 shutdown_connections 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f2350400640 1 -- 172.21.15.144:0/1890023552 >> 172.21.15.144:0/1890023552 conn(0x7f2348068030 msgr2=0x7f23480b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f2350400640 1 -- 172.21.15.144:0/1890023552 shutdown_connections 2024-09-12T12:20:16.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.448+0000 7f2350400640 1 -- 172.21.15.144:0/1890023552 wait complete. 2024-09-12T12:20:16.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 Processor -- start 2024-09-12T12:20:16.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 -- start start 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330003f30 0x7f234814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23481574a0 0x7f23480729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f234814f1a0 0x7f234814f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f23480b5570 con 0x7f23481574a0 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23480b3de0 con 0x7f234814f1a0 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f234815b340 con 0x7f2330003f30 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23481574a0 0x7f23480729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23481574a0 0x7f23480729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58554/0 (socket says 172.21.15.144:58554) 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234d000640 1 -- 172.21.15.144:0/3074185569 learned_addr learned my addr 172.21.15.144:0/3074185569 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234da00640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330003f30 0x7f234814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234e400640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f234814f1a0 0x7f234814f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234d000640 1 -- 172.21.15.144:0/3074185569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330003f30 msgr2=0x7f234814d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234d000640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330003f30 0x7f234814d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234d000640 1 -- 172.21.15.144:0/3074185569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f234814f1a0 msgr2=0x7f234814f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234d000640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f234814f1a0 0x7f234814f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234d000640 1 -- 172.21.15.144:0/3074185569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234814e100 con 0x7f23481574a0 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f234d000640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23481574a0 0x7f23480729d0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2334001890 tx=0x7f2330005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2345600640 1 -- 172.21.15.144:0/3074185569 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23340b5040 con 0x7f23481574a0 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2345600640 1 -- 172.21.15.144:0/3074185569 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2334001440 con 0x7f23481574a0 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234814e3e0 con 0x7f23481574a0 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2345600640 1 -- 172.21.15.144:0/3074185569 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23340052b0 con 0x7f23481574a0 2024-09-12T12:20:16.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.452+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f234814e9a0 con 0x7f23481574a0 2024-09-12T12:20:16.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.456+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234806bc10 con 0x7f23481574a0 2024-09-12T12:20:16.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.456+0000 7f2345600640 1 -- 172.21.15.144:0/3074185569 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23340b8070 con 0x7f23481574a0 2024-09-12T12:20:16.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.456+0000 7f2345600640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23280678c0 0x7f2328069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.456+0000 7f2345600640 1 -- 172.21.15.144:0/3074185569 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f2334122ce0 con 0x7f23481574a0 2024-09-12T12:20:16.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.456+0000 7f234da00640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23280678c0 0x7f2328069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.456+0000 7f234da00640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23280678c0 0x7f2328069d80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f233c007da0 tx=0x7f233c007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:16.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.460+0000 7f2345600640 1 -- 172.21.15.144:0/3074185569 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f23340188c0 con 0x7f23481574a0 2024-09-12T12:20:16.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.632+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f23481582c0 con 0x7f23481574a0 2024-09-12T12:20:16.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.632+0000 7f2345600640 1 -- 172.21.15.144:0/3074185569 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) ==== 93+0+10 (secure 0 0 0) 0x7f23340f39a0 con 0x7f23481574a0 2024-09-12T12:20:16.633 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:20:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23280678c0 msgr2=0x7f2328069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23280678c0 0x7f2328069d80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f233c007da0 tx=0x7f233c007900 comp rx=0 tx=0).stop 2024-09-12T12:20:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23481574a0 msgr2=0x7f23480729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23481574a0 0x7f23480729d0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2334001890 tx=0x7f2330005840 comp rx=0 tx=0).stop 2024-09-12T12:20:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 shutdown_connections 2024-09-12T12:20:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23280678c0 0x7f2328069d80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f234814f1a0 0x7f234814f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23481574a0 0x7f23480729d0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 --2- 172.21.15.144:0/3074185569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330003f30 0x7f234814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 >> 172.21.15.144:0/3074185569 conn(0x7f2348068030 msgr2=0x7f2348073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:16.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 shutdown_connections 2024-09-12T12:20:16.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.636+0000 7f2350400640 1 -- 172.21.15.144:0/3074185569 wait complete. 2024-09-12T12:20:16.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-12T12:20:16.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe42200640 1 Processor -- start 2024-09-12T12:20:16.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe42200640 1 -- start start 2024-09-12T12:20:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe42200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 0x7efe3c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe42200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe3c15cd30 0x7efe3c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe42200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c0cd870 con 0x7efe3c0b5de0 2024-09-12T12:20:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe42200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c072a50 con 0x7efe3c15cd30 2024-09-12T12:20:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe42200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c0cde30 con 0x7efe3c15c7b0 2024-09-12T12:20:16.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe33e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe3c15cd30 0x7efe3c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe33e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe3c15cd30 0x7efe3c0b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58562/0 (socket says 172.21.15.144:58562) 2024-09-12T12:20:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe33e00640 1 -- 172.21.15.144:0/1939759714 learned_addr learned my addr 172.21.15.144:0/1939759714 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe3b400640 1 --2- 172.21.15.144:0/1939759714 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 0x7efe3c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe33e00640 1 -- 172.21.15.144:0/1939759714 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 msgr2=0x7efe3c0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe33e00640 1 --2- 172.21.15.144:0/1939759714 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 0x7efe3c0ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe33e00640 1 -- 172.21.15.144:0/1939759714 >> v1:172.21.15.165:6789/0 conn(0x7efe3c0b5de0 legacy=0x7efe3c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.792+0000 7efe33e00640 1 -- 172.21.15.144:0/1939759714 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0cdb50 con 0x7efe3c15cd30 2024-09-12T12:20:16.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe33e00640 1 --2- 172.21.15.144:0/1939759714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 0x7efe3c0b58a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7efe24009870 tx=0x7efe2401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b150d1019fbb19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe3aa00640 1 -- 172.21.15.144:0/1939759714 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe240b2070 con 0x7efe3c15cd30 2024-09-12T12:20:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe3aa00640 1 -- 172.21.15.144:0/1939759714 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe240a9070 con 0x7efe3c15cd30 2024-09-12T12:20:16.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe3aa00640 1 -- 172.21.15.144:0/1939759714 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe240ad880 con 0x7efe3c15cd30 2024-09-12T12:20:16.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe42200640 1 -- 172.21.15.144:0/1939759714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 msgr2=0x7efe3c0b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe42200640 1 --2- 172.21.15.144:0/1939759714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 0x7efe3c0b58a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7efe24009870 tx=0x7efe2401c560 comp rx=0 tx=0).stop 2024-09-12T12:20:16.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe42200640 1 -- 172.21.15.144:0/1939759714 shutdown_connections 2024-09-12T12:20:16.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe42200640 1 --2- 172.21.15.144:0/1939759714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 0x7efe3c0b58a0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe42200640 1 --2- 172.21.15.144:0/1939759714 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 0x7efe3c0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe42200640 1 -- 172.21.15.144:0/1939759714 >> 172.21.15.144:0/1939759714 conn(0x7efe3c06d0d0 msgr2=0x7efe3c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:16.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe42200640 1 -- 172.21.15.144:0/1939759714 shutdown_connections 2024-09-12T12:20:16.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.796+0000 7efe42200640 1 -- 172.21.15.144:0/1939759714 wait complete. 2024-09-12T12:20:16.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 Processor -- start 2024-09-12T12:20:16.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 -- start start 2024-09-12T12:20:16.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe3c0b5de0 0x7efe3c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 0x7efe3c165950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 0x7efe3c145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c169530 con 0x7efe3c15cd30 2024-09-12T12:20:16.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0cd650 con 0x7efe3c0b5de0 2024-09-12T12:20:16.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c1696b0 con 0x7efe3c15c7b0 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 0x7efe3c145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 0x7efe3c145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58574/0 (socket says 172.21.15.144:58574) 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3be00640 1 -- 172.21.15.144:0/2409180914 learned_addr learned my addr 172.21.15.144:0/2409180914 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3b400640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe3c0b5de0 0x7efe3c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe33e00640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 0x7efe3c165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3be00640 1 -- 172.21.15.144:0/2409180914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 msgr2=0x7efe3c165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3be00640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 0x7efe3c165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3be00640 1 -- 172.21.15.144:0/2409180914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe3c0b5de0 msgr2=0x7efe3c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3be00640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe3c0b5de0 0x7efe3c0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3be00640 1 -- 172.21.15.144:0/2409180914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0b56a0 con 0x7efe3c15cd30 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe3be00640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 0x7efe3c145c70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c770 tx=0x7efe3400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe33400640 1 -- 172.21.15.144:0/2409180914 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34003b80 con 0x7efe3c15cd30 2024-09-12T12:20:16.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe33400640 1 -- 172.21.15.144:0/2409180914 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34003d20 con 0x7efe3c15cd30 2024-09-12T12:20:16.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe33400640 1 -- 172.21.15.144:0/2409180914 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3400aa90 con 0x7efe3c15cd30 2024-09-12T12:20:16.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c0b4600 con 0x7efe3c15cd30 2024-09-12T12:20:16.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.800+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c0b4ea0 con 0x7efe3c15cd30 2024-09-12T12:20:16.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.804+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3c15f9e0 con 0x7efe3c15cd30 2024-09-12T12:20:16.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.804+0000 7efe33400640 1 -- 172.21.15.144:0/2409180914 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe3400ac30 con 0x7efe3c15cd30 2024-09-12T12:20:16.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.804+0000 7efe33400640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe180678c0 0x7efe18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:16.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.804+0000 7efe33400640 1 -- 172.21.15.144:0/2409180914 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7efe34085910 con 0x7efe3c15cd30 2024-09-12T12:20:16.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.804+0000 7efe3b400640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe180678c0 0x7efe18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:16.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.804+0000 7efe3b400640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe180678c0 0x7efe18069d80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efe3c1faf00 tx=0x7efe2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:16.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:16.808+0000 7efe33400640 1 -- 172.21.15.144:0/2409180914 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe34055f60 con 0x7efe3c15cd30 2024-09-12T12:20:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.024+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7efe3c0b42f0 con 0x7efe3c15cd30 2024-09-12T12:20:17.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.936+0000 7efe33400640 1 -- 172.21.15.144:0/2409180914 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v376) ==== 147+0+0 (secure 0 0 0) 0x7efe3405a260 con 0x7efe3c15cd30 2024-09-12T12:20:17.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe180678c0 msgr2=0x7efe18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:17.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe180678c0 0x7efe18069d80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efe3c1faf00 tx=0x7efe2c008040 comp rx=0 tx=0).stop 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 msgr2=0x7efe3c145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 0x7efe3c145c70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c770 tx=0x7efe3400cc30 comp rx=0 tx=0).stop 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 shutdown_connections 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe180678c0 0x7efe18069d80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe3c15cd30 0x7efe3c145c70 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe3c15c7b0 0x7efe3c165950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 --2- 172.21.15.144:0/2409180914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe3c0b5de0 0x7efe3c0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 >> 172.21.15.144:0/2409180914 conn(0x7efe3c06d0d0 msgr2=0x7efe3c0cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 shutdown_connections 2024-09-12T12:20:17.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:17.940+0000 7efe42200640 1 -- 172.21.15.144:0/2409180914 wait complete. 2024-09-12T12:20:17.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:20:18.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f7795a00640 1 Processor -- start 2024-09-12T12:20:18.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f7795a00640 1 -- start start 2024-09-12T12:20:18.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f7795a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f779015c2e0 0x7f7790072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f7795a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77900af5f0 0x7f779006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f7795a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77900733e0 con 0x7f779006c150 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f7795a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f77900cd290 con 0x7f77900af5f0 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f7795a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f77900cd570 con 0x7f779015c2e0 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f778e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77900af5f0 0x7f779006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f778e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77900af5f0 0x7f779006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45206/0 (socket says 172.21.15.144:45206) 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f778e000640 1 -- 172.21.15.144:0/2109767686 learned_addr learned my addr 172.21.15.144:0/2109767686 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f778e000640 1 -- 172.21.15.144:0/2109767686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f779015c2e0 msgr2=0x7f7790072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f778e000640 1 --2- 172.21.15.144:0/2109767686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f779015c2e0 0x7f7790072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f778e000640 1 -- 172.21.15.144:0/2109767686 >> v1:172.21.15.165:6789/0 conn(0x7f779006c150 legacy=0x7f779006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:18.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.108+0000 7f778e000640 1 -- 172.21.15.144:0/2109767686 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77900cd850 con 0x7f77900af5f0 2024-09-12T12:20:18.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f778e000640 1 --2- 172.21.15.144:0/2109767686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77900af5f0 0x7f779006bc10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f777c009870 tx=0x7f777c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6bb39bb20e34c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f778d600640 1 -- 172.21.15.144:0/2109767686 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c0b0070 con 0x7f77900af5f0 2024-09-12T12:20:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f778d600640 1 -- 172.21.15.144:0/2109767686 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f777c0a4e50 con 0x7f77900af5f0 2024-09-12T12:20:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f778d600640 1 -- 172.21.15.144:0/2109767686 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c0ab820 con 0x7f77900af5f0 2024-09-12T12:20:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f7795a00640 1 -- 172.21.15.144:0/2109767686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77900af5f0 msgr2=0x7f779006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f7795a00640 1 --2- 172.21.15.144:0/2109767686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77900af5f0 0x7f779006bc10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f777c009870 tx=0x7f777c01c400 comp rx=0 tx=0).stop 2024-09-12T12:20:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f7795a00640 1 -- 172.21.15.144:0/2109767686 shutdown_connections 2024-09-12T12:20:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f7795a00640 1 --2- 172.21.15.144:0/2109767686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77900af5f0 0x7f779006bc10 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f7795a00640 1 --2- 172.21.15.144:0/2109767686 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f779015c2e0 0x7f7790072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f7795a00640 1 -- 172.21.15.144:0/2109767686 >> 172.21.15.144:0/2109767686 conn(0x7f7790068030 msgr2=0x7f77900b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f7795a00640 1 -- 172.21.15.144:0/2109767686 shutdown_connections 2024-09-12T12:20:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.112+0000 7f7795a00640 1 -- 172.21.15.144:0/2109767686 wait complete. 2024-09-12T12:20:18.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 Processor -- start 2024-09-12T12:20:18.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 -- start start 2024-09-12T12:20:18.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f779006c150 0x7f77901527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77900af5f0 0x7f7790153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f779015c2e0 0x7f7790157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f77901692b0 con 0x7f779015c2e0 2024-09-12T12:20:18.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7790169130 con 0x7f77900af5f0 2024-09-12T12:20:18.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7790169430 con 0x7f779006c150 2024-09-12T12:20:18.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f779015c2e0 0x7f7790157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f779015c2e0 0x7f7790157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45216/0 (socket says 172.21.15.144:45216) 2024-09-12T12:20:18.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778f400640 1 -- 172.21.15.144:0/3846669939 learned_addr learned my addr 172.21.15.144:0/3846669939 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778ea00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f779006c150 0x7f77901527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778e000640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77900af5f0 0x7f7790153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778f400640 1 -- 172.21.15.144:0/3846669939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f779006c150 msgr2=0x7f77901527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778f400640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f779006c150 0x7f77901527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778f400640 1 -- 172.21.15.144:0/3846669939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77900af5f0 msgr2=0x7f7790153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778f400640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77900af5f0 0x7f7790153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778f400640 1 -- 172.21.15.144:0/3846669939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7790156490 con 0x7f779015c2e0 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f778f400640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f779015c2e0 0x7f7790157210 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f778800c7b0 tx=0x7f778800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7786a00640 1 -- 172.21.15.144:0/3846669939 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788017070 con 0x7f779015c2e0 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7786a00640 1 -- 172.21.15.144:0/3846669939 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7788003db0 con 0x7f779015c2e0 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7790156730 con 0x7f779015c2e0 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7786a00640 1 -- 172.21.15.144:0/3846669939 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77880052b0 con 0x7f779015c2e0 2024-09-12T12:20:18.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.116+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7790156cf0 con 0x7f779015c2e0 2024-09-12T12:20:18.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.120+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779006bc10 con 0x7f779015c2e0 2024-09-12T12:20:18.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.120+0000 7f7786a00640 1 -- 172.21.15.144:0/3846669939 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f778801a070 con 0x7f779015c2e0 2024-09-12T12:20:18.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.120+0000 7f7786a00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f77700678c0 0x7f7770069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.120+0000 7f7786a00640 1 -- 172.21.15.144:0/3846669939 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f77880851a0 con 0x7f779015c2e0 2024-09-12T12:20:18.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.120+0000 7f778ea00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f77700678c0 0x7f7770069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.120+0000 7f778ea00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f77700678c0 0x7f7770069d80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f779015b3e0 tx=0x7f7780006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:18.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.124+0000 7f7786a00640 1 -- 172.21.15.144:0/3846669939 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7788055760 con 0x7f779015c2e0 2024-09-12T12:20:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.284+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7790156f30 con 0x7f779015c2e0 2024-09-12T12:20:18.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7786a00640 1 -- 172.21.15.144:0/3846669939 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f7788059a60 con 0x7f779015c2e0 2024-09-12T12:20:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f77700678c0 msgr2=0x7f7770069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7795a00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f77700678c0 0x7f7770069d80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f779015b3e0 tx=0x7f7780006f90 comp rx=0 tx=0).stop 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f779015c2e0 msgr2=0x7f7790157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7795a00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f779015c2e0 0x7f7790157210 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f778800c7b0 tx=0x7f778800cc70 comp rx=0 tx=0).stop 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 shutdown_connections 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7795a00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f77700678c0 0x7f7770069d80 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7795a00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f779015c2e0 0x7f7790157210 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7795a00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77900af5f0 0x7f7790153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.288+0000 7f7795a00640 1 --2- 172.21.15.144:0/3846669939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f779006c150 0x7f77901527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.292+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 >> 172.21.15.144:0/3846669939 conn(0x7f7790068030 msgr2=0x7f77900ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.292+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 shutdown_connections 2024-09-12T12:20:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.292+0000 7f7795a00640 1 -- 172.21.15.144:0/3846669939 wait complete. 2024-09-12T12:20:18.310 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:20:18.310 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:20:18.405 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:20:18.492 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:20:18.492 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:20:18.492 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:18.501 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:20:18.502 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:20:18.502 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:18.511 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:20:18.511 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:20:18.511 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:18.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:20:18.550 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:20:18.550 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:18.566 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:20:18.566 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:20:18.566 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:18.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b4000640 1 Processor -- start 2024-09-12T12:20:18.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b4000640 1 -- start start 2024-09-12T12:20:18.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b4000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f84ac15cd30 0x7f84ac0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b4000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f84ac0b5de0 0x7f84ac072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b4000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84ac0b61e0 con 0x7f84ac15c7b0 2024-09-12T12:20:18.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b4000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f84ac072a50 con 0x7f84ac0b5de0 2024-09-12T12:20:18.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b4000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f84ac0cde30 con 0x7f84ac15cd30 2024-09-12T12:20:18.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f84ac0b5de0 0x7f84ac072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f84ac0b5de0 0x7f84ac072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45220/0 (socket says 172.21.15.144:45220) 2024-09-12T12:20:18.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b1600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f84ac15c7b0 0x7f84ac0ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40308/0 (socket says 172.21.15.144:40308) 2024-09-12T12:20:18.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b2000640 1 -- 172.21.15.144:0/709452522 learned_addr learned my addr 172.21.15.144:0/709452522 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:18.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b0c00640 1 --2- 172.21.15.144:0/709452522 >> v2:172.21.15.165:3300/0 conn(0x7f84ac15cd30 0x7f84ac0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b2000640 1 -- 172.21.15.144:0/709452522 >> v2:172.21.15.165:3300/0 conn(0x7f84ac15cd30 msgr2=0x7f84ac0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:18.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b2000640 1 --2- 172.21.15.144:0/709452522 >> v2:172.21.15.165:3300/0 conn(0x7f84ac15cd30 0x7f84ac0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b2000640 1 -- 172.21.15.144:0/709452522 >> v1:172.21.15.144:6789/0 conn(0x7f84ac15c7b0 legacy=0x7f84ac0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b2000640 1 -- 172.21.15.144:0/709452522 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac0cd870 con 0x7f84ac0b5de0 2024-09-12T12:20:18.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.732+0000 7f84b0c00640 1 --2- 172.21.15.144:0/709452522 >> v2:172.21.15.165:3300/0 conn(0x7f84ac15cd30 0x7f84ac0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:18.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84b2000640 1 --2- 172.21.15.144:0/709452522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac0b5de0 0x7f84ac072ee0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0afd90 tx=0x7f84a401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f85b76bc9851445 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:18.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84abe00640 1 -- 172.21.15.144:0/709452522 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a40a56c0 con 0x7f84ac0b5de0 2024-09-12T12:20:18.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84abe00640 1 -- 172.21.15.144:0/709452522 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a40a5860 con 0x7f84ac0b5de0 2024-09-12T12:20:18.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84abe00640 1 -- 172.21.15.144:0/709452522 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a40a5c30 con 0x7f84ac0b5de0 2024-09-12T12:20:18.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84b4000640 1 -- 172.21.15.144:0/709452522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac0b5de0 msgr2=0x7f84ac072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84b4000640 1 --2- 172.21.15.144:0/709452522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac0b5de0 0x7f84ac072ee0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0afd90 tx=0x7f84a401c9f0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84b4000640 1 -- 172.21.15.144:0/709452522 shutdown_connections 2024-09-12T12:20:18.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84b4000640 1 --2- 172.21.15.144:0/709452522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac0b5de0 0x7f84ac072ee0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84b4000640 1 --2- 172.21.15.144:0/709452522 >> v2:172.21.15.165:3300/0 conn(0x7f84ac15cd30 0x7f84ac0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84b4000640 1 -- 172.21.15.144:0/709452522 >> 172.21.15.144:0/709452522 conn(0x7f84ac06d0d0 msgr2=0x7f84ac06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:18.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84b4000640 1 -- 172.21.15.144:0/709452522 shutdown_connections 2024-09-12T12:20:18.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.736+0000 7f84b4000640 1 -- 172.21.15.144:0/709452522 wait complete. 2024-09-12T12:20:18.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 Processor -- start 2024-09-12T12:20:18.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 -- start start 2024-09-12T12:20:18.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84ac0b5de0 0x7f84ac0b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84ac15c7b0 0x7f84ac14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15cd30 0x7f84ac1656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac073fc0 con 0x7f84ac15cd30 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac073e40 con 0x7f84ac15c7b0 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f84ac074140 con 0x7f84ac0b5de0 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15cd30 0x7f84ac1656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15cd30 0x7f84ac1656f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45224/0 (socket says 172.21.15.144:45224) 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b2000640 1 -- 172.21.15.144:0/2054450917 learned_addr learned my addr 172.21.15.144:0/2054450917 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b1600640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84ac0b5de0 0x7f84ac0b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b0c00640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84ac15c7b0 0x7f84ac14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b2000640 1 -- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84ac0b5de0 msgr2=0x7f84ac0b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b2000640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84ac0b5de0 0x7f84ac0b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b2000640 1 -- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84ac15c7b0 msgr2=0x7f84ac14d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b2000640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84ac15c7b0 0x7f84ac14d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b2000640 1 -- 172.21.15.144:0/2054450917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac1569d0 con 0x7f84ac15cd30 2024-09-12T12:20:18.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b1600640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84ac0b5de0 0x7f84ac0b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:18.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b0c00640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84ac15c7b0 0x7f84ac14d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:18.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b2000640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15cd30 0x7f84ac1656f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f84a40af040 tx=0x7f84a4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:18.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84a9600640 1 -- 172.21.15.144:0/2054450917 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a40bc020 con 0x7f84ac15cd30 2024-09-12T12:20:18.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84a9600640 1 -- 172.21.15.144:0/2054450917 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a40b8670 con 0x7f84ac15cd30 2024-09-12T12:20:18.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84a9600640 1 -- 172.21.15.144:0/2054450917 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a40b8a40 con 0x7f84ac15cd30 2024-09-12T12:20:18.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac14f480 con 0x7f84ac15cd30 2024-09-12T12:20:18.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.740+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac0b1620 con 0x7f84ac15cd30 2024-09-12T12:20:18.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.744+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ac072ee0 con 0x7f84ac15cd30 2024-09-12T12:20:18.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.744+0000 7f84a9600640 1 -- 172.21.15.144:0/2054450917 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84a40bf020 con 0x7f84ac15cd30 2024-09-12T12:20:18.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.744+0000 7f84a9600640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f848c0678c0 0x7f848c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:18.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.744+0000 7f84a9600640 1 -- 172.21.15.144:0/2054450917 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7f84a4120b90 con 0x7f84ac15cd30 2024-09-12T12:20:18.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.744+0000 7f84b1600640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f848c0678c0 0x7f848c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:18.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.744+0000 7f84b1600640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f848c0678c0 0x7f848c069d80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f84a0000f70 tx=0x7f84a0007d70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:18.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.748+0000 7f84a9600640 1 -- 172.21.15.144:0/2054450917 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f84a40c6030 con 0x7f84ac15cd30 2024-09-12T12:20:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84ac0cf910 con 0x7f84ac15cd30 2024-09-12T12:20:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84a9600640 1 -- 172.21.15.144:0/2054450917 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+3923 (secure 0 0 0) 0x7f84a40165e0 con 0x7f84ac15cd30 2024-09-12T12:20:18.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:18.943 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":91,"btime":"2024-09-12T12:20:11:910571+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6611,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3516117882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":3516117882},{"type":"v1","addr":"172.21.15.144:6837","nonce":3516117882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6614,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4000269826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4000269826},{"type":"v1","addr":"172.21.15.165:6834","nonce":4000269826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":6617,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2020456347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2020456347},{"type":"v1","addr":"172.21.15.165:6835","nonce":2020456347}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3159314935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3159314935},{"type":"v1","addr":"172.21.15.144:6836","nonce":3159314935}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[]} 2024-09-12T12:20:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 91 2024-09-12T12:20:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f848c0678c0 msgr2=0x7f848c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f848c0678c0 0x7f848c069d80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f84a0000f70 tx=0x7f84a0007d70 comp rx=0 tx=0).stop 2024-09-12T12:20:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15cd30 msgr2=0x7f84ac1656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15cd30 0x7f84ac1656f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f84a40af040 tx=0x7f84a4019790 comp rx=0 tx=0).stop 2024-09-12T12:20:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 shutdown_connections 2024-09-12T12:20:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f848c0678c0 0x7f848c069d80 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f84ac15cd30 0x7f84ac1656f0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84ac15c7b0 0x7f84ac14d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 --2- 172.21.15.144:0/2054450917 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84ac0b5de0 0x7f84ac0b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:18.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 >> 172.21.15.144:0/2054450917 conn(0x7f84ac06d0d0 msgr2=0x7f84ac0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:18.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 shutdown_connections 2024-09-12T12:20:18.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:18.944+0000 7f84b4000640 1 -- 172.21.15.144:0/2054450917 wait complete. 2024-09-12T12:20:18.964 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:20:18.964 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:20:18.964 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:20:18.964 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:20:18.965 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:20:18.965 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:20:18.965 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:20:18.965 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:20:18.965 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:20:18.965 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:20:18.965 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:20:18.965 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:20:18.966 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:20:18.966 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:20:18.966 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:20:18.966 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:20:18.975 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:20:18.976 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:20:18.977 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:20:18.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:20:18.980 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:20:18.980 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:20:18.981 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:20:18.981 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:20:19.024 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:20:19.024 DEBUG:teuthology.parallel:result is None 2024-09-12T12:20:19.025 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:20:19.025 DEBUG:teuthology.parallel:result is None 2024-09-12T12:20:19.026 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:20:19.027 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:20:19.027 DEBUG:teuthology.parallel:result is None 2024-09-12T12:20:19.027 DEBUG:teuthology.parallel:result is None 2024-09-12T12:20:19.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:20:19.110 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:20:19.112 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:20:19.115 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:20:19.115 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:20:19.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fdddd600640 1 Processor -- start 2024-09-12T12:20:19.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fdddd600640 1 -- start start 2024-09-12T12:20:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fdddd600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147570 0x7fddd806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fdddd600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fddd8147a70 0x7fddd806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fdddd600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd80b6730 con 0x7fddd8147fc0 2024-09-12T12:20:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fdddd600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fddd8162100 con 0x7fddd8147a70 2024-09-12T12:20:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fdddd600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fddd81623e0 con 0x7fddd8147570 2024-09-12T12:20:19.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fddd7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fddd8147a70 0x7fddd806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fddd7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fddd8147a70 0x7fddd806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45262/0 (socket says 172.21.15.144:45262) 2024-09-12T12:20:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fddd7400640 1 -- 172.21.15.144:0/1250900783 learned_addr learned my addr 172.21.15.144:0/1250900783 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fddd7400640 1 -- 172.21.15.144:0/1250900783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147570 msgr2=0x7fddd806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fddd6a00640 1 --2- 172.21.15.144:0/1250900783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147570 0x7fddd806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fddd7400640 1 --2- 172.21.15.144:0/1250900783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147570 0x7fddd806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fddd7400640 1 -- 172.21.15.144:0/1250900783 >> v1:172.21.15.165:6789/0 conn(0x7fddd8147fc0 legacy=0x7fddd80ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:19.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fddd7400640 1 -- 172.21.15.144:0/1250900783 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd81626c0 con 0x7fddd8147a70 2024-09-12T12:20:19.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.176+0000 7fddd6a00640 1 --2- 172.21.15.144:0/1250900783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147570 0x7fddd806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fddd7400640 1 --2- 172.21.15.144:0/1250900783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147a70 0x7fddd806c150 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009e50 tx=0x7fddd001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a318ea55e52031b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fddd5600640 1 -- 172.21.15.144:0/1250900783 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd00a56a0 con 0x7fddd8147a70 2024-09-12T12:20:19.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fddd5600640 1 -- 172.21.15.144:0/1250900783 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd00a5840 con 0x7fddd8147a70 2024-09-12T12:20:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fddd5600640 1 -- 172.21.15.144:0/1250900783 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd00a5c10 con 0x7fddd8147a70 2024-09-12T12:20:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 -- 172.21.15.144:0/1250900783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147a70 msgr2=0x7fddd806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 --2- 172.21.15.144:0/1250900783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147a70 0x7fddd806c150 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009e50 tx=0x7fddd001c9f0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 -- 172.21.15.144:0/1250900783 shutdown_connections 2024-09-12T12:20:19.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 --2- 172.21.15.144:0/1250900783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147a70 0x7fddd806c150 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 --2- 172.21.15.144:0/1250900783 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147570 0x7fddd806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 -- 172.21.15.144:0/1250900783 >> 172.21.15.144:0/1250900783 conn(0x7fddd806f8b0 msgr2=0x7fddd806fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 -- 172.21.15.144:0/1250900783 shutdown_connections 2024-09-12T12:20:19.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 -- 172.21.15.144:0/1250900783 wait complete. 2024-09-12T12:20:19.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 Processor -- start 2024-09-12T12:20:19.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.180+0000 7fdddd600640 1 -- start start 2024-09-12T12:20:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fdddd600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fddd8147570 0x7fddd8160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fdddd600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147a70 0x7fddd8143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fdddd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147fc0 0x7fddd8141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fdddd600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fddd816b1f0 con 0x7fddd8147fc0 2024-09-12T12:20:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fdddd600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fddd80b1f80 con 0x7fddd8147570 2024-09-12T12:20:19.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fdddd600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fddd816b370 con 0x7fddd8147a70 2024-09-12T12:20:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147fc0 0x7fddd8141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147fc0 0x7fddd8141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45276/0 (socket says 172.21.15.144:45276) 2024-09-12T12:20:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd7400640 1 -- 172.21.15.144:0/1420611325 learned_addr learned my addr 172.21.15.144:0/1420611325 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd6000640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147a70 0x7fddd8143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:19.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd6a00640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fddd8147570 0x7fddd8160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd7400640 1 -- 172.21.15.144:0/1420611325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147a70 msgr2=0x7fddd8143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd7400640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147a70 0x7fddd8143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd7400640 1 -- 172.21.15.144:0/1420611325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fddd8147570 msgr2=0x7fddd8160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd7400640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fddd8147570 0x7fddd8160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd7400640 1 -- 172.21.15.144:0/1420611325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd8142510 con 0x7fddd8147fc0 2024-09-12T12:20:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddd7400640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147fc0 0x7fddd8141fd0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fddd00af040 tx=0x7fddd0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddcea00640 1 -- 172.21.15.144:0/1420611325 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd00b8670 con 0x7fddd8147fc0 2024-09-12T12:20:19.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddcea00640 1 -- 172.21.15.144:0/1420611325 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd00be070 con 0x7fddd8147fc0 2024-09-12T12:20:19.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd81fa880 con 0x7fddd8147fc0 2024-09-12T12:20:19.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fddcea00640 1 -- 172.21.15.144:0/1420611325 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd00b8a50 con 0x7fddd8147fc0 2024-09-12T12:20:19.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd81fae00 con 0x7fddd8147fc0 2024-09-12T12:20:19.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.184+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd80ae890 con 0x7fddd8147fc0 2024-09-12T12:20:19.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.188+0000 7fddcea00640 1 -- 172.21.15.144:0/1420611325 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fddd00b8bf0 con 0x7fddd8147fc0 2024-09-12T12:20:19.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.188+0000 7fddcea00640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fddb80678c0 0x7fddb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:19.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.188+0000 7fddcea00640 1 -- 172.21.15.144:0/1420611325 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5335+0+0 (secure 0 0 0) 0x7fddd0120bc0 con 0x7fddd8147fc0 2024-09-12T12:20:19.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.188+0000 7fddd6a00640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fddb80678c0 0x7fddb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:19.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.188+0000 7fddd6a00640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fddb80678c0 0x7fddb8069d80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fddd8164570 tx=0x7fddc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:19.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.192+0000 7fddcea00640 1 -- 172.21.15.144:0/1420611325 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fddd00165e0 con 0x7fddd8147fc0 2024-09-12T12:20:19.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.360+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fddd80d1130 con 0x7fddd8147fc0 2024-09-12T12:20:19.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.952+0000 7fddcea00640 1 -- 172.21.15.144:0/1420611325 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) ==== 97+0+0 (secure 0 0 0) 0x7fddd00f1180 con 0x7fddd8147fc0 2024-09-12T12:20:19.953 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:20:19.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fddb80678c0 msgr2=0x7fddb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:19.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fddb80678c0 0x7fddb8069d80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fddd8164570 tx=0x7fddc8008040 comp rx=0 tx=0).stop 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147fc0 msgr2=0x7fddd8141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147fc0 0x7fddd8141fd0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fddd00af040 tx=0x7fddd0019790 comp rx=0 tx=0).stop 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 shutdown_connections 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fddb80678c0 0x7fddb8069d80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddd8147fc0 0x7fddd8141fd0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fddd8147a70 0x7fddd8143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 --2- 172.21.15.144:0/1420611325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fddd8147570 0x7fddd8160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 >> 172.21.15.144:0/1420611325 conn(0x7fddd806f8b0 msgr2=0x7fddd80b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 shutdown_connections 2024-09-12T12:20:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:19.956+0000 7fdddd600640 1 -- 172.21.15.144:0/1420611325 wait complete. 2024-09-12T12:20:19.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:20:20.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c68a00640 1 Processor -- start 2024-09-12T12:20:20.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c68a00640 1 -- start start 2024-09-12T12:20:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c68a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c6415c7b0 0x7f0c640ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c68a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c640cd870 con 0x7f0c640b5fb0 2024-09-12T12:20:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c68a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c640cdb50 con 0x7f0c6415cd30 2024-09-12T12:20:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c68a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0c64072a50 con 0x7f0c6415c7b0 2024-09-12T12:20:20.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c61e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c6415c7b0 0x7f0c640ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c61e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0c6415c7b0 0x7f0c640ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45290/0 (socket says 172.21.15.144:45290) 2024-09-12T12:20:20.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c61e00640 1 -- 172.21.15.144:0/183220428 learned_addr learned my addr 172.21.15.144:0/183220428 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:20.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c62800640 1 --1- 172.21.15.144:0/183220428 >> v1:172.21.15.144:6789/0 conn(0x7f0c640b5fb0 0x7f0c64072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40348/0 (socket says 172.21.15.144:40348) 2024-09-12T12:20:20.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c61e00640 1 -- 172.21.15.144:0/183220428 >> v1:172.21.15.165:6789/0 conn(0x7f0c6415cd30 legacy=0x7f0c640b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c61e00640 1 -- 172.21.15.144:0/183220428 >> v1:172.21.15.144:6789/0 conn(0x7f0c640b5fb0 legacy=0x7f0c64072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c60a00640 1 -- 172.21.15.144:0/183220428 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260160412 0 0) 0x7f0c640cd870 con 0x7f0c640b5fb0 2024-09-12T12:20:20.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.124+0000 7f0c61e00640 1 -- 172.21.15.144:0/183220428 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c640726e0 con 0x7f0c6415c7b0 2024-09-12T12:20:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c61e00640 1 --2- 172.21.15.144:0/183220428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 0x7f0c640ccf00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009e50 tx=0x7f0c5401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa716c454f4964c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:20.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c60a00640 1 -- 172.21.15.144:0/183220428 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c540a5700 con 0x7f0c6415c7b0 2024-09-12T12:20:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c60a00640 1 -- 172.21.15.144:0/183220428 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c540a58a0 con 0x7f0c6415c7b0 2024-09-12T12:20:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c60a00640 1 -- 172.21.15.144:0/183220428 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c540a5c70 con 0x7f0c6415c7b0 2024-09-12T12:20:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c68a00640 1 -- 172.21.15.144:0/183220428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 msgr2=0x7f0c640ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c68a00640 1 --2- 172.21.15.144:0/183220428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 0x7f0c640ccf00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009e50 tx=0x7f0c5401ca30 comp rx=0 tx=0).stop 2024-09-12T12:20:20.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c68a00640 1 -- 172.21.15.144:0/183220428 shutdown_connections 2024-09-12T12:20:20.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c68a00640 1 --2- 172.21.15.144:0/183220428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 0x7f0c640ccf00 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c68a00640 1 -- 172.21.15.144:0/183220428 >> 172.21.15.144:0/183220428 conn(0x7f0c6406d0d0 msgr2=0x7f0c6406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:20.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c68a00640 1 -- 172.21.15.144:0/183220428 shutdown_connections 2024-09-12T12:20:20.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.128+0000 7f0c68a00640 1 -- 172.21.15.144:0/183220428 wait complete. 2024-09-12T12:20:20.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 Processor -- start 2024-09-12T12:20:20.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 -- start start 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c640b5fb0 0x7f0c640ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 0x7f0c640aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c6415cd30 0x7f0c64155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c640741d0 con 0x7f0c6415c7b0 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c64074050 con 0x7f0c640b5fb0 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c640cde30 con 0x7f0c6415cd30 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 0x7f0c640aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 0x7f0c640aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45296/0 (socket says 172.21.15.144:45296) 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61400640 1 -- 172.21.15.144:0/2191380892 learned_addr learned my addr 172.21.15.144:0/2191380892 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61e00640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c640b5fb0 0x7f0c640ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c62800640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c6415cd30 0x7f0c64155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61400640 1 -- 172.21.15.144:0/2191380892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c6415cd30 msgr2=0x7f0c64155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61400640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c6415cd30 0x7f0c64155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61400640 1 -- 172.21.15.144:0/2191380892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c640b5fb0 msgr2=0x7f0c640ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61400640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c640b5fb0 0x7f0c640ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61400640 1 -- 172.21.15.144:0/2191380892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c640aae40 con 0x7f0c6415c7b0 2024-09-12T12:20:20.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c61400640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 0x7f0c640aea90 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000c3c0 tx=0x7f0c5000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:20.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c5a000640 1 -- 172.21.15.144:0/2191380892 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50017070 con 0x7f0c6415c7b0 2024-09-12T12:20:20.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c5a000640 1 -- 172.21.15.144:0/2191380892 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c500052d0 con 0x7f0c6415c7b0 2024-09-12T12:20:20.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c64160c60 con 0x7f0c6415c7b0 2024-09-12T12:20:20.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c5a000640 1 -- 172.21.15.144:0/2191380892 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50003840 con 0x7f0c6415c7b0 2024-09-12T12:20:20.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.132+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c640ab3c0 con 0x7f0c6415c7b0 2024-09-12T12:20:20.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.136+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c640ccf00 con 0x7f0c6415c7b0 2024-09-12T12:20:20.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.136+0000 7f0c5a000640 1 -- 172.21.15.144:0/2191380892 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c5001a070 con 0x7f0c6415c7b0 2024-09-12T12:20:20.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.136+0000 7f0c5a000640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c440678f0 0x7f0c44069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.136+0000 7f0c5a000640 1 -- 172.21.15.144:0/2191380892 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5249+0+0 (secure 0 0 0) 0x7f0c50084dd0 con 0x7f0c6415c7b0 2024-09-12T12:20:20.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.136+0000 7f0c61e00640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c440678f0 0x7f0c44069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.136+0000 7f0c61e00640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c440678f0 0x7f0c44069db0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ae000 tx=0x7f0c540a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:20.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.140+0000 7f0c5a000640 1 -- 172.21.15.144:0/2191380892 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0c50005480 con 0x7f0c6415c7b0 2024-09-12T12:20:20.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.352+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0c640afc50 con 0x7f0c6415c7b0 2024-09-12T12:20:20.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c5a000640 1 -- 172.21.15.144:0/2191380892 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f0c500553e0 con 0x7f0c6415c7b0 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:20:20.355 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.356 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.357 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.358 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:20:20.359 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:20:20.361 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:20:20.363 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:20:20.364 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.366 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:20:20.367 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:20:20.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:20:20.369 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:20:20.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c440678f0 msgr2=0x7f0c44069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c440678f0 0x7f0c44069db0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ae000 tx=0x7f0c540a7070 comp rx=0 tx=0).stop 2024-09-12T12:20:20.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 msgr2=0x7f0c640aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 0x7f0c640aea90 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000c3c0 tx=0x7f0c5000c880 comp rx=0 tx=0).stop 2024-09-12T12:20:20.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 shutdown_connections 2024-09-12T12:20:20.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c440678f0 0x7f0c44069db0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c6415cd30 0x7f0c64155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c6415c7b0 0x7f0c640aea90 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 --2- 172.21.15.144:0/2191380892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c640b5fb0 0x7f0c640ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 >> 172.21.15.144:0/2191380892 conn(0x7f0c6406d0d0 msgr2=0x7f0c6415e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:20.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 shutdown_connections 2024-09-12T12:20:20.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.356+0000 7f0c68a00640 1 -- 172.21.15.144:0/2191380892 wait complete. 2024-09-12T12:20:20.376 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:20:20.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.512+0000 7fc00be00640 1 Processor -- start 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.512+0000 7fc00be00640 1 -- start start 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.512+0000 7fc00be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 0x7fc00c16f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.512+0000 7fc00be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc00c0735c0 0x7fc00c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.512+0000 7fc00be00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc00c0cefb0 con 0x7fc00c16ae20 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.512+0000 7fc00be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc00c0cdb50 con 0x7fc00c0735c0 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.512+0000 7fc00be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc00c0cd2b0 con 0x7fc00c16b200 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.516+0000 7fc00b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc00c0735c0 0x7fc00c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.516+0000 7fc00b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc00c0735c0 0x7fc00c073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45304/0 (socket says 172.21.15.144:45304) 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.516+0000 7fc00b400640 1 -- 172.21.15.144:0/1369097188 learned_addr learned my addr 172.21.15.144:0/1369097188 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.516+0000 7fc009600640 1 -- 172.21.15.144:0/1369097188 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995098320 0 0) 0x7fbffc001120 con 0x7fc00c16ae20 2024-09-12T12:20:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.516+0000 7fc00a000640 1 --2- 172.21.15.144:0/1369097188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 0x7fc00c16f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.932+0000 7fc009600640 1 -- 172.21.15.144:0/1369097188 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbff0003510 con 0x7fc00c16ae20 2024-09-12T12:20:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.932+0000 7fc00b400640 1 -- 172.21.15.144:0/1369097188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 msgr2=0x7fc00c16f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.932+0000 7fc00b400640 1 --2- 172.21.15.144:0/1369097188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 0x7fc00c16f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.932+0000 7fc00b400640 1 -- 172.21.15.144:0/1369097188 >> v1:172.21.15.165:6789/0 conn(0x7fc00c16ae20 legacy=0x7fc00c0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.932+0000 7fc00b400640 1 -- 172.21.15.144:0/1369097188 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c0cd590 con 0x7fc00c0735c0 2024-09-12T12:20:20.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc00b400640 1 --2- 172.21.15.144:0/1369097188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c0735c0 0x7fc00c073a70 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fc004007eb0 tx=0x7fc00401cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d36af716dd1a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:20.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc009600640 1 -- 172.21.15.144:0/1369097188 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0040a5cf0 con 0x7fc00c0735c0 2024-09-12T12:20:20.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc009600640 1 -- 172.21.15.144:0/1369097188 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00400b170 con 0x7fc00c0735c0 2024-09-12T12:20:20.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc009600640 1 -- 172.21.15.144:0/1369097188 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00400b520 con 0x7fc00c0735c0 2024-09-12T12:20:20.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc00be00640 1 -- 172.21.15.144:0/1369097188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c0735c0 msgr2=0x7fc00c073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc00be00640 1 --2- 172.21.15.144:0/1369097188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c0735c0 0x7fc00c073a70 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fc004007eb0 tx=0x7fc00401cd30 comp rx=0 tx=0).stop 2024-09-12T12:20:20.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc00be00640 1 -- 172.21.15.144:0/1369097188 shutdown_connections 2024-09-12T12:20:20.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc00be00640 1 --2- 172.21.15.144:0/1369097188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c0735c0 0x7fc00c073a70 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc00be00640 1 --2- 172.21.15.144:0/1369097188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 0x7fc00c16f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc00be00640 1 -- 172.21.15.144:0/1369097188 >> 172.21.15.144:0/1369097188 conn(0x7fc00c06bc10 msgr2=0x7fc00c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:20.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc00be00640 1 -- 172.21.15.144:0/1369097188 shutdown_connections 2024-09-12T12:20:20.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.936+0000 7fc00be00640 1 -- 172.21.15.144:0/1369097188 wait complete. 2024-09-12T12:20:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00be00640 1 Processor -- start 2024-09-12T12:20:20.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00be00640 1 -- start start 2024-09-12T12:20:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc00c0735c0 0x7fc00c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c16ae20 0x7fc00c15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 0x7fc00c15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c0d02f0 con 0x7fc00c16ae20 2024-09-12T12:20:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c0d0170 con 0x7fc00c0735c0 2024-09-12T12:20:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc00c0d0470 con 0x7fc00c16b200 2024-09-12T12:20:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c16ae20 0x7fc00c15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 0x7fc00c15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc00c0735c0 0x7fc00c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c16ae20 0x7fc00c15ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45312/0 (socket says 172.21.15.144:45312) 2024-09-12T12:20:20.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00a000640 1 -- 172.21.15.144:0/2885881591 learned_addr learned my addr 172.21.15.144:0/2885881591 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:20.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00a000640 1 -- 172.21.15.144:0/2885881591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 msgr2=0x7fc00c15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00a000640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 0x7fc00c15b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00a000640 1 -- 172.21.15.144:0/2885881591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc00c0735c0 msgr2=0x7fc00c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:20.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00a000640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc00c0735c0 0x7fc00c15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:20.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00a000640 1 -- 172.21.15.144:0/2885881591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c16db60 con 0x7fc00c16ae20 2024-09-12T12:20:20.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc00a000640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c16ae20 0x7fc00c15ddb0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fbff800fab0 tx=0x7fbff800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.940+0000 7fc002a00640 1 -- 172.21.15.144:0/2885881591 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8017070 con 0x7fc00c16ae20 2024-09-12T12:20:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.944+0000 7fc002a00640 1 -- 172.21.15.144:0/2885881591 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff8007e10 con 0x7fc00c16ae20 2024-09-12T12:20:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.944+0000 7fc002a00640 1 -- 172.21.15.144:0/2885881591 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff800d040 con 0x7fc00c16ae20 2024-09-12T12:20:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.944+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00c16de40 con 0x7fc00c16ae20 2024-09-12T12:20:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.944+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00c16e400 con 0x7fc00c16ae20 2024-09-12T12:20:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.944+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc00c0d0880 con 0x7fc00c16ae20 2024-09-12T12:20:20.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.944+0000 7fc002a00640 1 -- 172.21.15.144:0/2885881591 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbff801a070 con 0x7fc00c16ae20 2024-09-12T12:20:20.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.944+0000 7fc002a00640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbfec0678c0 0x7fbfec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:20.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.948+0000 7fc002a00640 1 -- 172.21.15.144:0/2885881591 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5249+0+0 (secure 0 0 0) 0x7fbff80861d0 con 0x7fc00c16ae20 2024-09-12T12:20:20.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.948+0000 7fc00aa00640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbfec0678c0 0x7fbfec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:20.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.948+0000 7fc00aa00640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbfec0678c0 0x7fbfec069d80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc00c1759f0 tx=0x7fbffc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:20.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:20.952+0000 7fc002a00640 1 -- 172.21.15.144:0/2885881591 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbff80567e0 con 0x7fc00c16ae20 2024-09-12T12:20:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc00c068530 con 0x7fc00c16ae20 2024-09-12T12:20:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc002a00640 1 -- 172.21.15.144:0/2885881591 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) ==== 84+0+65 (secure 0 0 0) 0x7fbff805aae0 con 0x7fc00c16ae20 2024-09-12T12:20:21.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:21.135 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:20:21.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:20:21.135 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:20:21.135 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:20:21.136 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:21.136 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:20:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbfec0678c0 msgr2=0x7fbfec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbfec0678c0 0x7fbfec069d80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc00c1759f0 tx=0x7fbffc009040 comp rx=0 tx=0).stop 2024-09-12T12:20:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c16ae20 msgr2=0x7fc00c15ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c16ae20 0x7fc00c15ddb0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fbff800fab0 tx=0x7fbff800ff70 comp rx=0 tx=0).stop 2024-09-12T12:20:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 shutdown_connections 2024-09-12T12:20:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbfec0678c0 0x7fbfec069d80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc00c16b200 0x7fc00c15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc00c16ae20 0x7fc00c15ddb0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 --2- 172.21.15.144:0/2885881591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc00c0735c0 0x7fc00c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 >> 172.21.15.144:0/2885881591 conn(0x7fc00c06bc10 msgr2=0x7fc00c160a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 shutdown_connections 2024-09-12T12:20:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.136+0000 7fc00be00640 1 -- 172.21.15.144:0/2885881591 wait complete. 2024-09-12T12:20:21.156 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:20:21.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:20:21.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.296+0000 7f51dc400640 1 Processor -- start 2024-09-12T12:20:21.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.296+0000 7f51dc400640 1 -- start start 2024-09-12T12:20:21.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51dc400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d4156c10 0x7f51d4072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51dc400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51d406cff0 0x7f51d406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51dc400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f51d4073360 0x7f51d4073810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51dc400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f51d4073d50 con 0x7f51d406cff0 2024-09-12T12:20:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51dc400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f51d406d990 con 0x7f51d4073360 2024-09-12T12:20:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51dc400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51d4071be0 con 0x7f51d4156c10 2024-09-12T12:20:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51d9000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51d406cff0 0x7f51d406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:21.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51d9000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51d406cff0 0x7f51d406d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45316/0 (socket says 172.21.15.144:45316) 2024-09-12T12:20:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51d9000640 1 -- 172.21.15.144:0/1969448656 learned_addr learned my addr 172.21.15.144:0/1969448656 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51d9a00640 1 --2- 172.21.15.144:0/1969448656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d4156c10 0x7f51d4072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51da400640 1 --2- 172.21.15.144:0/1969448656 >> v2:172.21.15.165:3300/0 conn(0x7f51d4073360 0x7f51d4073810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51d9000640 1 -- 172.21.15.144:0/1969448656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d4156c10 msgr2=0x7f51d4072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51d9000640 1 --2- 172.21.15.144:0/1969448656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d4156c10 0x7f51d4072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51d9000640 1 -- 172.21.15.144:0/1969448656 >> v2:172.21.15.165:3300/0 conn(0x7f51d4073360 msgr2=0x7f51d4073810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51d9000640 1 --2- 172.21.15.144:0/1969448656 >> v2:172.21.15.165:3300/0 conn(0x7f51d4073360 0x7f51d4073810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.300+0000 7f51d9000640 1 -- 172.21.15.144:0/1969448656 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d406cd20 con 0x7f51d406cff0 2024-09-12T12:20:21.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51d9000640 1 --2- 172.21.15.144:0/1969448656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d406cff0 0x7f51d406d450 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f51d41601f0 tx=0x7f51c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86eb37b9dd845e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51d3e00640 1 -- 172.21.15.144:0/1969448656 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c00a6040 con 0x7f51d406cff0 2024-09-12T12:20:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51d3e00640 1 -- 172.21.15.144:0/1969448656 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c00af070 con 0x7f51d406cff0 2024-09-12T12:20:21.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51d3e00640 1 -- 172.21.15.144:0/1969448656 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c00aa860 con 0x7f51d406cff0 2024-09-12T12:20:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 -- 172.21.15.144:0/1969448656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d406cff0 msgr2=0x7f51d406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 --2- 172.21.15.144:0/1969448656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d406cff0 0x7f51d406d450 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f51d41601f0 tx=0x7f51c001c520 comp rx=0 tx=0).stop 2024-09-12T12:20:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 -- 172.21.15.144:0/1969448656 shutdown_connections 2024-09-12T12:20:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 --2- 172.21.15.144:0/1969448656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d406cff0 0x7f51d406d450 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 --2- 172.21.15.144:0/1969448656 >> v2:172.21.15.165:3300/0 conn(0x7f51d4073360 0x7f51d4073810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 --2- 172.21.15.144:0/1969448656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d4156c10 0x7f51d4072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 -- 172.21.15.144:0/1969448656 >> 172.21.15.144:0/1969448656 conn(0x7f51d406bc10 msgr2=0x7f51d406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 -- 172.21.15.144:0/1969448656 shutdown_connections 2024-09-12T12:20:21.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 -- 172.21.15.144:0/1969448656 wait complete. 2024-09-12T12:20:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 Processor -- start 2024-09-12T12:20:21.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 -- start start 2024-09-12T12:20:21.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d406cff0 0x7f51d4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:21.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.304+0000 7f51dc400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51d4073360 0x7f51d4163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:21.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51dc400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d4156c10 0x7f51d41644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:21.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51dc400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4156ff0 con 0x7f51d4156c10 2024-09-12T12:20:21.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51dc400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4073f70 con 0x7f51d4073360 2024-09-12T12:20:21.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51dc400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51d4157170 con 0x7f51d406cff0 2024-09-12T12:20:21.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51da400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d4156c10 0x7f51d41644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:21.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51da400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d4156c10 0x7f51d41644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45324/0 (socket says 172.21.15.144:45324) 2024-09-12T12:20:21.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51da400640 1 -- 172.21.15.144:0/2327717406 learned_addr learned my addr 172.21.15.144:0/2327717406 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51d9000640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51d4073360 0x7f51d4163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51d9a00640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d406cff0 0x7f51d4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51da400640 1 -- 172.21.15.144:0/2327717406 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d406cff0 msgr2=0x7f51d4158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51da400640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d406cff0 0x7f51d4158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51da400640 1 -- 172.21.15.144:0/2327717406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51d4073360 msgr2=0x7f51d4163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51da400640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51d4073360 0x7f51d4163fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51da400640 1 -- 172.21.15.144:0/2327717406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d4161910 con 0x7f51d4156c10 2024-09-12T12:20:21.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51da400640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d4156c10 0x7f51d41644f0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f51cc007e60 tx=0x7f51cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51d1600640 1 -- 172.21.15.144:0/2327717406 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc014620 con 0x7f51d4156c10 2024-09-12T12:20:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51d1600640 1 -- 172.21.15.144:0/2327717406 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51cc019070 con 0x7f51d4156c10 2024-09-12T12:20:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51d1600640 1 -- 172.21.15.144:0/2327717406 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc014a20 con 0x7f51d4156c10 2024-09-12T12:20:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d4159390 con 0x7f51d4156c10 2024-09-12T12:20:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d4159950 con 0x7f51d4156c10 2024-09-12T12:20:21.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d406d450 con 0x7f51d4156c10 2024-09-12T12:20:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.308+0000 7f51d1600640 1 -- 172.21.15.144:0/2327717406 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51cc014bc0 con 0x7f51d4156c10 2024-09-12T12:20:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.312+0000 7f51d1600640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51b40678c0 0x7f51b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.312+0000 7f51d1600640 1 -- 172.21.15.144:0/2327717406 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5249+0+0 (secure 0 0 0) 0x7f51cc086290 con 0x7f51d4156c10 2024-09-12T12:20:21.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.312+0000 7f51d9a00640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51b40678c0 0x7f51b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:21.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.312+0000 7f51d9a00640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51b40678c0 0x7f51b4069d80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f51d40b4310 tx=0x7f51c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:21.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.316+0000 7f51d1600640 1 -- 172.21.15.144:0/2327717406 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f51cc0568b0 con 0x7f51d4156c10 2024-09-12T12:20:21.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.476+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f51d406dd80 con 0x7f51d4156c10 2024-09-12T12:20:21.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.964+0000 7f51d1600640 1 -- 172.21.15.144:0/2327717406 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) ==== 138+0+0 (secure 0 0 0) 0x7f51cc05abb0 con 0x7f51d4156c10 2024-09-12T12:20:21.964 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:20:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.964+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51b40678c0 msgr2=0x7f51b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.964+0000 7f51dc400640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51b40678c0 0x7f51b4069d80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f51d40b4310 tx=0x7f51c8008040 comp rx=0 tx=0).stop 2024-09-12T12:20:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.964+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d4156c10 msgr2=0x7f51d41644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:21.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.964+0000 7f51dc400640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d4156c10 0x7f51d41644f0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f51cc007e60 tx=0x7f51cc00e4b0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.968+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 shutdown_connections 2024-09-12T12:20:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.968+0000 7f51dc400640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51b40678c0 0x7f51b4069d80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.968+0000 7f51dc400640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51d4156c10 0x7f51d41644f0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.968+0000 7f51dc400640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51d4073360 0x7f51d4163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.968+0000 7f51dc400640 1 --2- 172.21.15.144:0/2327717406 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51d406cff0 0x7f51d4158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.968+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 >> 172.21.15.144:0/2327717406 conn(0x7f51d406bc10 msgr2=0x7f51d415c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.968+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 shutdown_connections 2024-09-12T12:20:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:21.968+0000 7f51dc400640 1 -- 172.21.15.144:0/2327717406 wait complete. 2024-09-12T12:20:21.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:20:22.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.140+0000 7f16b3e00640 1 Processor -- start 2024-09-12T12:20:22.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.140+0000 7f16b3e00640 1 -- start start 2024-09-12T12:20:22.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16b3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f16b40b2520 0x7f16b4071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:22.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16b3e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16b4073680 con 0x7f16b4159ec0 2024-09-12T12:20:22.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16b3e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16b4072de0 con 0x7f16b40724f0 2024-09-12T12:20:22.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16b3e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f16b40730c0 con 0x7f16b40b2520 2024-09-12T12:20:22.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16b2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f16b4159ec0 0x7f16b40b1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40364/0 (socket says 172.21.15.144:40364) 2024-09-12T12:20:22.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16b2a00640 1 -- 172.21.15.144:0/1192037478 learned_addr learned my addr 172.21.15.144:0/1192037478 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:22.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16aa000640 1 --2- 172.21.15.144:0/1192037478 >> v2:172.21.15.165:3300/0 conn(0x7f16b40b2520 0x7f16b4071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:22.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16b2000640 1 -- 172.21.15.144:0/1192037478 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228112952 0 0) 0x7f16b4073680 con 0x7f16b4159ec0 2024-09-12T12:20:22.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16b2000640 1 -- 172.21.15.144:0/1192037478 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1698003530 con 0x7f16b4159ec0 2024-09-12T12:20:22.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16aa000640 1 -- 172.21.15.144:0/1192037478 >> v1:172.21.15.165:6789/0 conn(0x7f16b40724f0 legacy=0x7f16b415df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:22.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16aa000640 1 -- 172.21.15.144:0/1192037478 >> v1:172.21.15.144:6789/0 conn(0x7f16b4159ec0 legacy=0x7f16b40b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:22.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.144+0000 7f16aa000640 1 -- 172.21.15.144:0/1192037478 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b40733a0 con 0x7f16b40b2520 2024-09-12T12:20:22.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16aa000640 1 --2- 172.21.15.144:0/1192037478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16b40b2520 0x7f16b4071fb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f169c0097c0 tx=0x7f169c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8629a8589932483e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:22.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b2000640 1 -- 172.21.15.144:0/1192037478 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c0aa5f0 con 0x7f16b40b2520 2024-09-12T12:20:22.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b2000640 1 -- 172.21.15.144:0/1192037478 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f169c0af070 con 0x7f16b40b2520 2024-09-12T12:20:22.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b2000640 1 -- 172.21.15.144:0/1192037478 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c0aa990 con 0x7f16b40b2520 2024-09-12T12:20:22.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 -- 172.21.15.144:0/1192037478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16b40b2520 msgr2=0x7f16b4071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:22.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 --2- 172.21.15.144:0/1192037478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16b40b2520 0x7f16b4071fb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f169c0097c0 tx=0x7f169c01c470 comp rx=0 tx=0).stop 2024-09-12T12:20:22.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 -- 172.21.15.144:0/1192037478 shutdown_connections 2024-09-12T12:20:22.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 --2- 172.21.15.144:0/1192037478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16b40b2520 0x7f16b4071fb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:22.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 -- 172.21.15.144:0/1192037478 >> 172.21.15.144:0/1192037478 conn(0x7f16b406e7e0 msgr2=0x7f16b406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:22.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 -- 172.21.15.144:0/1192037478 shutdown_connections 2024-09-12T12:20:22.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 -- 172.21.15.144:0/1192037478 wait complete. 2024-09-12T12:20:22.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 Processor -- start 2024-09-12T12:20:22.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 -- start start 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16b40724f0 0x7f16b414e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.148+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16b40b2520 0x7f16b4151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4159ec0 0x7f16b4152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f16b4169dd0 con 0x7f16b4159ec0 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f16b415f0f0 con 0x7f16b40724f0 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f16b4169f50 con 0x7f16b40b2520 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4159ec0 0x7f16b4152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4159ec0 0x7f16b4152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45338/0 (socket says 172.21.15.144:45338) 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3400640 1 -- 172.21.15.144:0/116544638 learned_addr learned my addr 172.21.15.144:0/116544638 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b2a00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16b40724f0 0x7f16b414e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16aa000640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16b40b2520 0x7f16b4151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3400640 1 -- 172.21.15.144:0/116544638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16b40b2520 msgr2=0x7f16b4151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3400640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16b40b2520 0x7f16b4151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3400640 1 -- 172.21.15.144:0/116544638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16b40724f0 msgr2=0x7f16b414e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3400640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16b40724f0 0x7f16b414e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3400640 1 -- 172.21.15.144:0/116544638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b414ed50 con 0x7f16b4159ec0 2024-09-12T12:20:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3400640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4159ec0 0x7f16b4152130 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00c770 tx=0x7f16ac00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16abe00640 1 -- 172.21.15.144:0/116544638 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac003b80 con 0x7f16b4159ec0 2024-09-12T12:20:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16abe00640 1 -- 172.21.15.144:0/116544638 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ac003d20 con 0x7f16b4159ec0 2024-09-12T12:20:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16abe00640 1 -- 172.21.15.144:0/116544638 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ac00aa90 con 0x7f16b4159ec0 2024-09-12T12:20:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b414f030 con 0x7f16b4159ec0 2024-09-12T12:20:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b414f5f0 con 0x7f16b4159ec0 2024-09-12T12:20:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b4071fb0 con 0x7f16b4159ec0 2024-09-12T12:20:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.152+0000 7f16abe00640 1 -- 172.21.15.144:0/116544638 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16ac00ac30 con 0x7f16b4159ec0 2024-09-12T12:20:22.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.156+0000 7f16abe00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16900678c0 0x7f1690069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:22.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.156+0000 7f16abe00640 1 -- 172.21.15.144:0/116544638 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5619+0+0 (secure 0 0 0) 0x7f16ac085a40 con 0x7f16b4159ec0 2024-09-12T12:20:22.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.156+0000 7f16b2a00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16900678c0 0x7f1690069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:22.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.156+0000 7f16b2a00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16900678c0 0x7f1690069d80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f16a40011f0 tx=0x7f16a4007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:22.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.160+0000 7f16abe00640 1 -- 172.21.15.144:0/116544638 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f16ac055f60 con 0x7f16b4159ec0 2024-09-12T12:20:22.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.332+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f16b41584d0 con 0x7f16b4159ec0 2024-09-12T12:20:22.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16abe00640 1 -- 172.21.15.144:0/116544638 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) ==== 170+0+0 (secure 0 0 0) 0x7f16ac05a260 con 0x7f16b4159ec0 2024-09-12T12:20:22.975 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16900678c0 msgr2=0x7f1690069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16900678c0 0x7f1690069d80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f16a40011f0 tx=0x7f16a4007d40 comp rx=0 tx=0).stop 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4159ec0 msgr2=0x7f16b4152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4159ec0 0x7f16b4152130 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00c770 tx=0x7f16ac00cc30 comp rx=0 tx=0).stop 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 shutdown_connections 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f16900678c0 0x7f1690069d80 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16b4159ec0 0x7f16b4152130 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16b40b2520 0x7f16b4151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 --2- 172.21.15.144:0/116544638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16b40724f0 0x7f16b414e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:22.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 >> 172.21.15.144:0/116544638 conn(0x7f16b406e7e0 msgr2=0x7f16b415cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:22.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 shutdown_connections 2024-09-12T12:20:22.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:22.976+0000 7f16b3e00640 1 -- 172.21.15.144:0/116544638 wait complete. 2024-09-12T12:20:23.023 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:20:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.164+0000 7fd78a000640 1 Processor -- start 2024-09-12T12:20:23.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.164+0000 7fd78a000640 1 -- start start 2024-09-12T12:20:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.164+0000 7fd78a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd7840cd9f0 0x7fd78406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.164+0000 7fd78a000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7840b4300 con 0x7fd78415b340 2024-09-12T12:20:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.164+0000 7fd78a000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7840b3540 con 0x7fd78415af60 2024-09-12T12:20:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.164+0000 7fd78a000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd7840b32f0 con 0x7fd7840cd9f0 2024-09-12T12:20:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd7840cd9f0 0x7fd78406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd7840cd9f0 0x7fd78406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45344/0 (socket says 172.21.15.144:45344) 2024-09-12T12:20:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782a00640 1 -- 172.21.15.144:0/938940261 learned_addr learned my addr 172.21.15.144:0/938940261 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd783e00640 1 --1- 172.21.15.144:0/938940261 >> v1:172.21.15.144:6789/0 conn(0x7fd78415b340 0x7fd7840b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40372/0 (socket says 172.21.15.144:40372) 2024-09-12T12:20:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782a00640 1 -- 172.21.15.144:0/938940261 >> v1:172.21.15.165:6789/0 conn(0x7fd78415af60 legacy=0x7fd7840ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782a00640 1 -- 172.21.15.144:0/938940261 >> v1:172.21.15.144:6789/0 conn(0x7fd78415b340 legacy=0x7fd7840b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782a00640 1 -- 172.21.15.144:0/938940261 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7840b3820 con 0x7fd7840cd9f0 2024-09-12T12:20:23.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782a00640 1 --2- 172.21.15.144:0/938940261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7840cd9f0 0x7fd78406bc10 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd77000bb10 tx=0x7fd77001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d7e451de3f5668 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:23.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782000640 1 -- 172.21.15.144:0/938940261 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7700b4070 con 0x7fd7840cd9f0 2024-09-12T12:20:23.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782000640 1 -- 172.21.15.144:0/938940261 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7700a7b00 con 0x7fd7840cd9f0 2024-09-12T12:20:23.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.168+0000 7fd782000640 1 -- 172.21.15.144:0/938940261 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7700af440 con 0x7fd7840cd9f0 2024-09-12T12:20:23.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 -- 172.21.15.144:0/938940261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7840cd9f0 msgr2=0x7fd78406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:23.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 --2- 172.21.15.144:0/938940261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7840cd9f0 0x7fd78406bc10 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd77000bb10 tx=0x7fd77001ec30 comp rx=0 tx=0).stop 2024-09-12T12:20:23.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 -- 172.21.15.144:0/938940261 shutdown_connections 2024-09-12T12:20:23.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 --2- 172.21.15.144:0/938940261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7840cd9f0 0x7fd78406bc10 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:23.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 -- 172.21.15.144:0/938940261 >> 172.21.15.144:0/938940261 conn(0x7fd784068030 msgr2=0x7fd7840b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:23.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 -- 172.21.15.144:0/938940261 shutdown_connections 2024-09-12T12:20:23.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 -- 172.21.15.144:0/938940261 wait complete. 2024-09-12T12:20:23.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 Processor -- start 2024-09-12T12:20:23.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 -- start start 2024-09-12T12:20:23.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7840cd9f0 0x7fd784148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:23.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78415af60 0x7fd784157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd78415b340 0x7fd78415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd78406d500 con 0x7fd78415b340 2024-09-12T12:20:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd78406d380 con 0x7fd7840cd9f0 2024-09-12T12:20:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd78a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd78406d680 con 0x7fd78415af60 2024-09-12T12:20:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd783e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd78415b340 0x7fd78415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd783e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd78415b340 0x7fd78415d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45358/0 (socket says 172.21.15.144:45358) 2024-09-12T12:20:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd783e00640 1 -- 172.21.15.144:0/4130862937 learned_addr learned my addr 172.21.15.144:0/4130862937 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd783400640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7840cd9f0 0x7fd784148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:23.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd782a00640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78415af60 0x7fd784157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:23.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd783e00640 1 -- 172.21.15.144:0/4130862937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78415af60 msgr2=0x7fd784157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:23.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd783e00640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78415af60 0x7fd784157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:23.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd783e00640 1 -- 172.21.15.144:0/4130862937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7840cd9f0 msgr2=0x7fd784148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:23.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd783e00640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7840cd9f0 0x7fd784148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:23.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.172+0000 7fd783e00640 1 -- 172.21.15.144:0/4130862937 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd784154fe0 con 0x7fd78415b340 2024-09-12T12:20:23.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd783e00640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd78415b340 0x7fd78415d8f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c3c0 tx=0x7fd77c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:23.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd77b400640 1 -- 172.21.15.144:0/4130862937 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0074e0 con 0x7fd78415b340 2024-09-12T12:20:23.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd77b400640 1 -- 172.21.15.144:0/4130862937 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77c007680 con 0x7fd78415b340 2024-09-12T12:20:23.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd77b400640 1 -- 172.21.15.144:0/4130862937 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c004a10 con 0x7fd78415b340 2024-09-12T12:20:23.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78414ccd0 con 0x7fd78415b340 2024-09-12T12:20:23.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78414d290 con 0x7fd78415b340 2024-09-12T12:20:23.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7841551b0 con 0x7fd78415b340 2024-09-12T12:20:23.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd77b400640 1 -- 172.21.15.144:0/4130862937 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd77c01a020 con 0x7fd78415b340 2024-09-12T12:20:23.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd77b400640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7640678c0 0x7fd764069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:23.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd77b400640 1 -- 172.21.15.144:0/4130862937 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 6001+0+0 (secure 0 0 0) 0x7fd77c085bd0 con 0x7fd78415b340 2024-09-12T12:20:23.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.176+0000 7fd783400640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7640678c0 0x7fd764069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:23.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.180+0000 7fd783400640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7640678c0 0x7fd764069d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd7840cd790 tx=0x7fd774009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:23.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.180+0000 7fd77b400640 1 -- 172.21.15.144:0/4130862937 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd77c021070 con 0x7fd78415b340 2024-09-12T12:20:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.388+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd78406bc10 con 0x7fd78415b340 2024-09-12T12:20:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:23.988+0000 7fd77b400640 1 -- 172.21.15.144:0/4130862937 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v94) ==== 174+0+0 (secure 0 0 0) 0x7fd77c055f70 con 0x7fd78415b340 2024-09-12T12:20:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 17 and data pool 18 2024-09-12T12:20:24.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7640678c0 msgr2=0x7fd764069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7640678c0 0x7fd764069d80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd7840cd790 tx=0x7fd774009040 comp rx=0 tx=0).stop 2024-09-12T12:20:24.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd78415b340 msgr2=0x7fd78415d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd78415b340 0x7fd78415d8f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c3c0 tx=0x7fd77c00c880 comp rx=0 tx=0).stop 2024-09-12T12:20:24.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 shutdown_connections 2024-09-12T12:20:24.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7640678c0 0x7fd764069d80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd78415b340 0x7fd78415d8f0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd78415af60 0x7fd784157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 --2- 172.21.15.144:0/4130862937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7840cd9f0 0x7fd784148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.000+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 >> 172.21.15.144:0/4130862937 conn(0x7fd784068030 msgr2=0x7fd7840b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:24.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.004+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 shutdown_connections 2024-09-12T12:20:24.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.004+0000 7fd78a000640 1 -- 172.21.15.144:0/4130862937 wait complete. 2024-09-12T12:20:24.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:20:24.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f824e200640 1 Processor -- start 2024-09-12T12:20:24.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f824e200640 1 -- start start 2024-09-12T12:20:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f824e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f824815cd30 0x7f82480b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f824e200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82480b61e0 con 0x7f82480b5de0 2024-09-12T12:20:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f824e200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82480cd870 con 0x7f824815c7b0 2024-09-12T12:20:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f824e200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8248072a50 con 0x7f824815cd30 2024-09-12T12:20:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f8246a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f824815cd30 0x7f82480b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f8246a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f824815cd30 0x7f82480b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45370/0 (socket says 172.21.15.144:45370) 2024-09-12T12:20:24.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f8247e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f82480b5de0 0x7f8248072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40386/0 (socket says 172.21.15.144:40386) 2024-09-12T12:20:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.176+0000 7f8246a00640 1 -- 172.21.15.144:0/3914008835 learned_addr learned my addr 172.21.15.144:0/3914008835 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.180+0000 7f8246a00640 1 -- 172.21.15.144:0/3914008835 >> v1:172.21.15.165:6789/0 conn(0x7f824815c7b0 legacy=0x7f82480ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.180+0000 7f8246a00640 1 -- 172.21.15.144:0/3914008835 >> v1:172.21.15.144:6789/0 conn(0x7f82480b5de0 legacy=0x7f8248072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.180+0000 7f8246a00640 1 -- 172.21.15.144:0/3914008835 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480cdb50 con 0x7f824815cd30 2024-09-12T12:20:24.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.180+0000 7f8246000640 1 -- 172.21.15.144:0/3914008835 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983722408 0 0) 0x7f82480b61e0 con 0x7f82480b5de0 2024-09-12T12:20:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.180+0000 7f8246a00640 1 --2- 172.21.15.144:0/3914008835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824815cd30 0x7f82480b58a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f8234009870 tx=0x7f823401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0abb8425117bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:24.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.180+0000 7f8246000640 1 -- 172.21.15.144:0/3914008835 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340b2070 con 0x7f824815cd30 2024-09-12T12:20:24.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.180+0000 7f8246000640 1 -- 172.21.15.144:0/3914008835 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82340a9070 con 0x7f824815cd30 2024-09-12T12:20:24.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.180+0000 7f8246000640 1 -- 172.21.15.144:0/3914008835 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340ad880 con 0x7f824815cd30 2024-09-12T12:20:24.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- 172.21.15.144:0/3914008835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824815cd30 msgr2=0x7f82480b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 --2- 172.21.15.144:0/3914008835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824815cd30 0x7f82480b58a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f8234009870 tx=0x7f823401c560 comp rx=0 tx=0).stop 2024-09-12T12:20:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- 172.21.15.144:0/3914008835 shutdown_connections 2024-09-12T12:20:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 --2- 172.21.15.144:0/3914008835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824815cd30 0x7f82480b58a0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- 172.21.15.144:0/3914008835 >> 172.21.15.144:0/3914008835 conn(0x7f824806d0d0 msgr2=0x7f824806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- 172.21.15.144:0/3914008835 shutdown_connections 2024-09-12T12:20:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- 172.21.15.144:0/3914008835 wait complete. 2024-09-12T12:20:24.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 Processor -- start 2024-09-12T12:20:24.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- start start 2024-09-12T12:20:24.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82480b5de0 0x7f824815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824815c7b0 0x7f82480ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824815cd30 0x7f82480aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8248074210 con 0x7f82480b5de0 2024-09-12T12:20:24.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8248074090 con 0x7f824815cd30 2024-09-12T12:20:24.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f82480cd610 con 0x7f824815c7b0 2024-09-12T12:20:24.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82480b5de0 0x7f824815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82480b5de0 0x7f824815ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45374/0 (socket says 172.21.15.144:45374) 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247400640 1 -- 172.21.15.144:0/3291497799 learned_addr learned my addr 172.21.15.144:0/3291497799 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247e00640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824815cd30 0x7f82480aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8246a00640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824815c7b0 0x7f82480ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247400640 1 -- 172.21.15.144:0/3291497799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824815c7b0 msgr2=0x7f82480ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247400640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824815c7b0 0x7f82480ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247400640 1 -- 172.21.15.144:0/3291497799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824815cd30 msgr2=0x7f82480aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247400640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824815cd30 0x7f82480aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247400640 1 -- 172.21.15.144:0/3291497799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82481411f0 con 0x7f82480b5de0 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247e00640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824815cd30 0x7f82480aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f8247400640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82480b5de0 0x7f824815ab10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f823800c530 tx=0x7f823800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f823f400640 1 -- 172.21.15.144:0/3291497799 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238016020 con 0x7f82480b5de0 2024-09-12T12:20:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f823f400640 1 -- 172.21.15.144:0/3291497799 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8238005220 con 0x7f82480b5de0 2024-09-12T12:20:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f823f400640 1 -- 172.21.15.144:0/3291497799 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238007030 con 0x7f82480b5de0 2024-09-12T12:20:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.184+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82481414d0 con 0x7f82480b5de0 2024-09-12T12:20:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.188+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8248141a90 con 0x7f82480b5de0 2024-09-12T12:20:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.188+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82480b58a0 con 0x7f82480b5de0 2024-09-12T12:20:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.188+0000 7f823f400640 1 -- 172.21.15.144:0/3291497799 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f82380071d0 con 0x7f82480b5de0 2024-09-12T12:20:24.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.188+0000 7f823f400640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f82280678c0 0x7f8228069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.188+0000 7f823f400640 1 -- 172.21.15.144:0/3291497799 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 6101+0+0 (secure 0 0 0) 0x7f8238085840 con 0x7f82480b5de0 2024-09-12T12:20:24.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.188+0000 7f8246a00640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f82280678c0 0x7f8228069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.192+0000 7f8246a00640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f82280678c0 0x7f8228069d80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f82340af000 tx=0x7f82340a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.192+0000 7f823f400640 1 -- 172.21.15.144:0/3291497799 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8238020020 con 0x7f82480b5de0 2024-09-12T12:20:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.356+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8248168100 con 0x7f82480b5de0 2024-09-12T12:20:24.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f823f400640 1 -- 172.21.15.144:0/3291497799 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+17049 (secure 0 0 0) 0x7f82380074c0 con 0x7f82480b5de0 2024-09-12T12:20:24.359 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:24.359 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":128,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:20:23.391681+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:20:21.527729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-12T12:20:22.383110+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:20:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f82280678c0 msgr2=0x7f8228069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f82280678c0 0x7f8228069d80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f82340af000 tx=0x7f82340a7000 comp rx=0 tx=0).stop 2024-09-12T12:20:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82480b5de0 msgr2=0x7f824815ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82480b5de0 0x7f824815ab10 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f823800c530 tx=0x7f823800c9f0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 shutdown_connections 2024-09-12T12:20:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f82280678c0 0x7f8228069d80 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824815cd30 0x7f82480aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824815c7b0 0x7f82480ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 --2- 172.21.15.144:0/3291497799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82480b5de0 0x7f824815ab10 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 >> 172.21.15.144:0/3291497799 conn(0x7f824806d0d0 msgr2=0x7f82480b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 shutdown_connections 2024-09-12T12:20:24.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.360+0000 7f824e200640 1 -- 172.21.15.144:0/3291497799 wait complete. 2024-09-12T12:20:24.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:20:24.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.516+0000 7fed91800640 1 Processor -- start 2024-09-12T12:20:24.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.516+0000 7fed91800640 1 -- start start 2024-09-12T12:20:24.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed91800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fed8c148190 0x7fed8c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed91800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed8c0b0480 0x7fed8c0b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed91800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8c148570 con 0x7fed8c0cd470 2024-09-12T12:20:24.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed91800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fed8c0ce090 con 0x7fed8c0b0480 2024-09-12T12:20:24.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed91800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fed8c0cd8b0 con 0x7fed8c148190 2024-09-12T12:20:24.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed8b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed8c0b0480 0x7fed8c0b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed8b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed8c0b0480 0x7fed8c0b46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45390/0 (socket says 172.21.15.144:45390) 2024-09-12T12:20:24.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed8b400640 1 -- 172.21.15.144:0/26198612 learned_addr learned my addr 172.21.15.144:0/26198612 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:24.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed8aa00640 1 --2- 172.21.15.144:0/26198612 >> v2:172.21.15.165:3300/0 conn(0x7fed8c148190 0x7fed8c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed8b400640 1 -- 172.21.15.144:0/26198612 >> v2:172.21.15.165:3300/0 conn(0x7fed8c148190 msgr2=0x7fed8c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:24.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed8b400640 1 --2- 172.21.15.144:0/26198612 >> v2:172.21.15.165:3300/0 conn(0x7fed8c148190 0x7fed8c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed8b400640 1 -- 172.21.15.144:0/26198612 >> v1:172.21.15.165:6789/0 conn(0x7fed8c0cd470 legacy=0x7fed8c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.520+0000 7fed8b400640 1 -- 172.21.15.144:0/26198612 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c0b41f0 con 0x7fed8c0b0480 2024-09-12T12:20:24.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed8b400640 1 --2- 172.21.15.144:0/26198612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0b0480 0x7fed8c0b46d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fed8c069f00 tx=0x7fed8401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10012979b88f7bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:24.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed89600640 1 -- 172.21.15.144:0/26198612 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840a57a0 con 0x7fed8c0b0480 2024-09-12T12:20:24.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed89600640 1 -- 172.21.15.144:0/26198612 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed840a5940 con 0x7fed8c0b0480 2024-09-12T12:20:24.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed89600640 1 -- 172.21.15.144:0/26198612 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840a5d10 con 0x7fed8c0b0480 2024-09-12T12:20:24.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 -- 172.21.15.144:0/26198612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0b0480 msgr2=0x7fed8c0b46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 --2- 172.21.15.144:0/26198612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0b0480 0x7fed8c0b46d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fed8c069f00 tx=0x7fed8401c9f0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 -- 172.21.15.144:0/26198612 shutdown_connections 2024-09-12T12:20:24.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 --2- 172.21.15.144:0/26198612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0b0480 0x7fed8c0b46d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 --2- 172.21.15.144:0/26198612 >> v2:172.21.15.165:3300/0 conn(0x7fed8c148190 0x7fed8c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 -- 172.21.15.144:0/26198612 >> 172.21.15.144:0/26198612 conn(0x7fed8c06d0d0 msgr2=0x7fed8c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:24.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 -- 172.21.15.144:0/26198612 shutdown_connections 2024-09-12T12:20:24.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 -- 172.21.15.144:0/26198612 wait complete. 2024-09-12T12:20:24.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 Processor -- start 2024-09-12T12:20:24.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.524+0000 7fed91800640 1 -- start start 2024-09-12T12:20:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed91800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8c0b0480 0x7fed8c073a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed91800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0cd470 0x7fed8c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed91800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed8c148190 0x7fed8c15f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed91800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c0b5420 con 0x7fed8c0cd470 2024-09-12T12:20:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed91800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c0b11f0 con 0x7fed8c0b0480 2024-09-12T12:20:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed91800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed8c0b55a0 con 0x7fed8c148190 2024-09-12T12:20:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0cd470 0x7fed8c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0cd470 0x7fed8c15d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45396/0 (socket says 172.21.15.144:45396) 2024-09-12T12:20:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8a000640 1 -- 172.21.15.144:0/4044347488 learned_addr learned my addr 172.21.15.144:0/4044347488 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8aa00640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8c0b0480 0x7fed8c073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8b400640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed8c148190 0x7fed8c15f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8a000640 1 -- 172.21.15.144:0/4044347488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed8c148190 msgr2=0x7fed8c15f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8a000640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed8c148190 0x7fed8c15f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8a000640 1 -- 172.21.15.144:0/4044347488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8c0b0480 msgr2=0x7fed8c073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8a000640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8c0b0480 0x7fed8c073a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8a000640 1 -- 172.21.15.144:0/4044347488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c15e060 con 0x7fed8c0cd470 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed8a000640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0cd470 0x7fed8c15d5b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fed7800c450 tx=0x7fed7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed82a00640 1 -- 172.21.15.144:0/4044347488 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78016020 con 0x7fed8c0cd470 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed82a00640 1 -- 172.21.15.144:0/4044347488 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed780052d0 con 0x7fed8c0cd470 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed82a00640 1 -- 172.21.15.144:0/4044347488 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78007260 con 0x7fed8c0cd470 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8c1409c0 con 0x7fed8c0cd470 2024-09-12T12:20:24.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8c071f90 con 0x7fed8c0cd470 2024-09-12T12:20:24.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed8c0b5930 con 0x7fed8c0cd470 2024-09-12T12:20:24.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.528+0000 7fed82a00640 1 -- 172.21.15.144:0/4044347488 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed78007400 con 0x7fed8c0cd470 2024-09-12T12:20:24.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.532+0000 7fed82a00640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed6c0678c0 0x7fed6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.532+0000 7fed82a00640 1 -- 172.21.15.144:0/4044347488 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 6101+0+0 (secure 0 0 0) 0x7fed78086450 con 0x7fed8c0cd470 2024-09-12T12:20:24.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.532+0000 7fed8aa00640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed6c0678c0 0x7fed6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.532+0000 7fed8aa00640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed6c0678c0 0x7fed6c069d80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009ac0 tx=0x7fed7c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:24.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.536+0000 7fed82a00640 1 -- 172.21.15.144:0/4044347488 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed78020020 con 0x7fed8c0cd470 2024-09-12T12:20:24.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.700+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed8c0b60a0 con 0x7fed8c0cd470 2024-09-12T12:20:24.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.700+0000 7fed82a00640 1 -- 172.21.15.144:0/4044347488 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+17049 (secure 0 0 0) 0x7fed78005480 con 0x7fed8c0cd470 2024-09-12T12:20:24.701 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:24.701 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":128,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:20:23.391681+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:20:21.527729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-12T12:20:22.383110+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed6c0678c0 msgr2=0x7fed6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed6c0678c0 0x7fed6c069d80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009ac0 tx=0x7fed7c009190 comp rx=0 tx=0).stop 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0cd470 msgr2=0x7fed8c15d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0cd470 0x7fed8c15d5b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fed7800c450 tx=0x7fed7800c910 comp rx=0 tx=0).stop 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 shutdown_connections 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed6c0678c0 0x7fed6c069d80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed8c148190 0x7fed8c15f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8c0cd470 0x7fed8c15d5b0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 --2- 172.21.15.144:0/4044347488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8c0b0480 0x7fed8c073a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 >> 172.21.15.144:0/4044347488 conn(0x7fed8c06d0d0 msgr2=0x7fed8c0afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 shutdown_connections 2024-09-12T12:20:24.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.704+0000 7fed91800640 1 -- 172.21.15.144:0/4044347488 wait complete. 2024-09-12T12:20:24.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:20:24.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c7bc00640 1 Processor -- start 2024-09-12T12:20:24.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c7bc00640 1 -- start start 2024-09-12T12:20:24.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c7bc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0c740b32f0 0x7f0c7415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c7bc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c7415bf00 con 0x7f0c7406d0f0 2024-09-12T12:20:24.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c7bc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c740b38b0 con 0x7f0c740ccdc0 2024-09-12T12:20:24.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c7bc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0c740b3b90 con 0x7f0c740b32f0 2024-09-12T12:20:24.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c79200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0c7406d0f0 0x7f0c7406d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40396/0 (socket says 172.21.15.144:40396) 2024-09-12T12:20:24.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c79200640 1 -- 172.21.15.144:0/3166955864 learned_addr learned my addr 172.21.15.144:0/3166955864 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:24.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c73e00640 1 --2- 172.21.15.144:0/3166955864 >> v2:172.21.15.165:3300/0 conn(0x7f0c740b32f0 0x7f0c7415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c73400640 1 -- 172.21.15.144:0/3166955864 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 801711335 0 0) 0x7f0c7415bf00 con 0x7f0c7406d0f0 2024-09-12T12:20:24.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c73400640 1 -- 172.21.15.144:0/3166955864 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c5c003530 con 0x7f0c7406d0f0 2024-09-12T12:20:24.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c73e00640 1 -- 172.21.15.144:0/3166955864 >> v1:172.21.15.165:6789/0 conn(0x7f0c740ccdc0 legacy=0x7f0c740cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c73e00640 1 -- 172.21.15.144:0/3166955864 >> v1:172.21.15.144:6789/0 conn(0x7f0c7406d0f0 legacy=0x7f0c7406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.868+0000 7f0c73e00640 1 -- 172.21.15.144:0/3166955864 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c740b3e70 con 0x7f0c740b32f0 2024-09-12T12:20:24.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c73e00640 1 --2- 172.21.15.144:0/3166955864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c740b32f0 0x7f0c7415b9c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0c600097c0 tx=0x7f0c6001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bedd3ec463158345 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:24.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c73400640 1 -- 172.21.15.144:0/3166955864 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c600b0070 con 0x7f0c740b32f0 2024-09-12T12:20:24.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c73400640 1 -- 172.21.15.144:0/3166955864 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c600ab600 con 0x7f0c740b32f0 2024-09-12T12:20:24.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c73400640 1 -- 172.21.15.144:0/3166955864 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c600ab9b0 con 0x7f0c740b32f0 2024-09-12T12:20:24.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c7bc00640 1 -- 172.21.15.144:0/3166955864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c740b32f0 msgr2=0x7f0c7415b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c7bc00640 1 --2- 172.21.15.144:0/3166955864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c740b32f0 0x7f0c7415b9c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0c600097c0 tx=0x7f0c6001c410 comp rx=0 tx=0).stop 2024-09-12T12:20:24.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c7bc00640 1 -- 172.21.15.144:0/3166955864 shutdown_connections 2024-09-12T12:20:24.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c7bc00640 1 --2- 172.21.15.144:0/3166955864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c740b32f0 0x7f0c7415b9c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c7bc00640 1 -- 172.21.15.144:0/3166955864 >> 172.21.15.144:0/3166955864 conn(0x7f0c74068030 msgr2=0x7f0c740b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:24.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c7bc00640 1 -- 172.21.15.144:0/3166955864 shutdown_connections 2024-09-12T12:20:24.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.872+0000 7f0c7bc00640 1 -- 172.21.15.144:0/3166955864 wait complete. 2024-09-12T12:20:24.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 Processor -- start 2024-09-12T12:20:24.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 -- start start 2024-09-12T12:20:24.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c7406d0f0 0x7f0c74147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740b32f0 0x7f0c74072b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c740ccdc0 0x7f0c74150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74168970 con 0x7f0c740b32f0 2024-09-12T12:20:24.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741687f0 con 0x7f0c7406d0f0 2024-09-12T12:20:24.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c74168af0 con 0x7f0c740ccdc0 2024-09-12T12:20:24.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740b32f0 0x7f0c74072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740b32f0 0x7f0c74072b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45406/0 (socket says 172.21.15.144:45406) 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c73e00640 1 -- 172.21.15.144:0/593441327 learned_addr learned my addr 172.21.15.144:0/593441327 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c79c00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c740ccdc0 0x7f0c74150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c79200640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c7406d0f0 0x7f0c74147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c73e00640 1 -- 172.21.15.144:0/593441327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c740ccdc0 msgr2=0x7f0c74150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c73e00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c740ccdc0 0x7f0c74150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c73e00640 1 -- 172.21.15.144:0/593441327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c7406d0f0 msgr2=0x7f0c74147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c73e00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c7406d0f0 0x7f0c74147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c73e00640 1 -- 172.21.15.144:0/593441327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c741487b0 con 0x7f0c740b32f0 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c79200640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c7406d0f0 0x7f0c74147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c73e00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740b32f0 0x7f0c74072b80 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0c600ae040 tx=0x7f0c6001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c70c00640 1 -- 172.21.15.144:0/593441327 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c600b0050 con 0x7f0c740b32f0 2024-09-12T12:20:24.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c70c00640 1 -- 172.21.15.144:0/593441327 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c600b1040 con 0x7f0c740b32f0 2024-09-12T12:20:24.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c74148a90 con 0x7f0c740b32f0 2024-09-12T12:20:24.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c70c00640 1 -- 172.21.15.144:0/593441327 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60006e20 con 0x7f0c740b32f0 2024-09-12T12:20:24.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.876+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c7414cac0 con 0x7f0c740b32f0 2024-09-12T12:20:24.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.880+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7415b9c0 con 0x7f0c740b32f0 2024-09-12T12:20:24.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.880+0000 7f0c70c00640 1 -- 172.21.15.144:0/593441327 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c600be060 con 0x7f0c740b32f0 2024-09-12T12:20:24.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.880+0000 7f0c70c00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678f0 0x7f0c54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:24.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.880+0000 7f0c70c00640 1 -- 172.21.15.144:0/593441327 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 6101+0+0 (secure 0 0 0) 0x7f0c6011f550 con 0x7f0c740b32f0 2024-09-12T12:20:24.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.880+0000 7f0c79200640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678f0 0x7f0c54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:24.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.880+0000 7f0c79200640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678f0 0x7f0c54069db0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0c680011f0 tx=0x7f0c68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:24.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:24.884+0000 7f0c70c00640 1 -- 172.21.15.144:0/593441327 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0c60016090 con 0x7f0c740b32f0 2024-09-12T12:20:25.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:25.080+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0c74148c60 con 0x7f0c740b32f0 2024-09-12T12:20:25.964 INFO:tasks.ceph.mds.d.smithi165.stderr:2024-09-12T12:20:25.961+0000 7fc4b5800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:20:26.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.000+0000 7f0c70c00640 1 -- 172.21.15.144:0/593441327 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v97) ==== 118+0+0 (secure 0 0 0) 0x7f0c600eff00 con 0x7f0c740b32f0 2024-09-12T12:20:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678f0 msgr2=0x7f0c54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678f0 0x7f0c54069db0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0c680011f0 tx=0x7f0c68009040 comp rx=0 tx=0).stop 2024-09-12T12:20:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740b32f0 msgr2=0x7f0c74072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740b32f0 0x7f0c74072b80 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0c600ae040 tx=0x7f0c6001ac50 comp rx=0 tx=0).stop 2024-09-12T12:20:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 shutdown_connections 2024-09-12T12:20:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0c540678f0 0x7f0c54069db0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c740ccdc0 0x7f0c74150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c740b32f0 0x7f0c74072b80 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 --2- 172.21.15.144:0/593441327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c7406d0f0 0x7f0c74147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 >> 172.21.15.144:0/593441327 conn(0x7f0c74068030 msgr2=0x7f0c7415b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 shutdown_connections 2024-09-12T12:20:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.004+0000 7f0c7bc00640 1 -- 172.21.15.144:0/593441327 wait complete. 2024-09-12T12:20:26.027 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:20:26.028 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:20:26.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.172+0000 7f0a4ca00640 1 Processor -- start 2024-09-12T12:20:26.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a4ca00640 1 -- start start 2024-09-12T12:20:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a4ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a480af5d0 0x7f0a480cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a4ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 0x7f0a48166960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a4ca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a480cf900 con 0x7f0a48162a40 2024-09-12T12:20:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a4ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0a480cf6d0 con 0x7f0a480af5d0 2024-09-12T12:20:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a4ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0a480cfbe0 con 0x7f0a48166510 2024-09-12T12:20:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a45400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a480af5d0 0x7f0a480cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a45400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a480af5d0 0x7f0a480cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45412/0 (socket says 172.21.15.144:45412) 2024-09-12T12:20:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a45400640 1 -- 172.21.15.144:0/1912785955 learned_addr learned my addr 172.21.15.144:0/1912785955 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a45e00640 1 --1- 172.21.15.144:0/1912785955 >> v1:172.21.15.144:6789/0 conn(0x7f0a48162a40 0x7f0a48163650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40402/0 (socket says 172.21.15.144:40402) 2024-09-12T12:20:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a45400640 1 -- 172.21.15.144:0/1912785955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 msgr2=0x7f0a48166960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a46800640 1 --2- 172.21.15.144:0/1912785955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 0x7f0a48166960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a45400640 1 --2- 172.21.15.144:0/1912785955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 0x7f0a48166960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a45400640 1 -- 172.21.15.144:0/1912785955 >> v1:172.21.15.144:6789/0 conn(0x7f0a48162a40 legacy=0x7f0a48163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a45400640 1 -- 172.21.15.144:0/1912785955 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a480cfec0 con 0x7f0a480af5d0 2024-09-12T12:20:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a44a00640 1 -- 172.21.15.144:0/1912785955 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184452040 0 0) 0x7f0a480cf900 con 0x7f0a48162a40 2024-09-12T12:20:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.176+0000 7f0a46800640 1 --2- 172.21.15.144:0/1912785955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 0x7f0a48166960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:26.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a45400640 1 --2- 172.21.15.144:0/1912785955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a480af5d0 0x7f0a480cf190 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009870 tx=0x7f0a3401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df87e60f280dd7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:26.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a44a00640 1 -- 172.21.15.144:0/1912785955 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a340b0070 con 0x7f0a480af5d0 2024-09-12T12:20:26.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a44a00640 1 -- 172.21.15.144:0/1912785955 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a340ab600 con 0x7f0a480af5d0 2024-09-12T12:20:26.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a44a00640 1 -- 172.21.15.144:0/1912785955 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a340ab9d0 con 0x7f0a480af5d0 2024-09-12T12:20:26.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1912785955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a480af5d0 msgr2=0x7f0a480cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:26.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 --2- 172.21.15.144:0/1912785955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a480af5d0 0x7f0a480cf190 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009870 tx=0x7f0a3401c4d0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1912785955 shutdown_connections 2024-09-12T12:20:26.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 --2- 172.21.15.144:0/1912785955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 0x7f0a48166960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 --2- 172.21.15.144:0/1912785955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a480af5d0 0x7f0a480cf190 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1912785955 >> 172.21.15.144:0/1912785955 conn(0x7f0a48068030 msgr2=0x7f0a480b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:26.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1912785955 shutdown_connections 2024-09-12T12:20:26.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1912785955 wait complete. 2024-09-12T12:20:26.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 Processor -- start 2024-09-12T12:20:26.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.180+0000 7f0a4ca00640 1 -- start start 2024-09-12T12:20:26.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a4ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a480af5d0 0x7f0a4815eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:26.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a4ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a48162a40 0x7f0a480b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:26.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a4ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 0x7f0a481498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:26.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a4ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4816fa30 con 0x7f0a48162a40 2024-09-12T12:20:26.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a4ca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4816f8b0 con 0x7f0a480af5d0 2024-09-12T12:20:26.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a4ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0a4816fbb0 con 0x7f0a48166510 2024-09-12T12:20:26.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a48162a40 0x7f0a480b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:26.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a48162a40 0x7f0a480b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45426/0 (socket says 172.21.15.144:45426) 2024-09-12T12:20:26.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a45400640 1 -- 172.21.15.144:0/1039015931 learned_addr learned my addr 172.21.15.144:0/1039015931 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:26.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a45400640 1 -- 172.21.15.144:0/1039015931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 msgr2=0x7f0a481498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:26.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a45400640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 0x7f0a481498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a45400640 1 -- 172.21.15.144:0/1039015931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a480af5d0 msgr2=0x7f0a4815eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:26.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a45400640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a480af5d0 0x7f0a4815eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:26.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a45400640 1 -- 172.21.15.144:0/1039015931 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4815f280 con 0x7f0a48162a40 2024-09-12T12:20:26.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a45400640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a48162a40 0x7f0a480b51d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f0a340ae040 tx=0x7f0a3401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:26.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a3e000640 1 -- 172.21.15.144:0/1039015931 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a340bc070 con 0x7f0a48162a40 2024-09-12T12:20:26.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a3e000640 1 -- 172.21.15.144:0/1039015931 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a34004230 con 0x7f0a48162a40 2024-09-12T12:20:26.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a3e000640 1 -- 172.21.15.144:0/1039015931 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a340b0040 con 0x7f0a48162a40 2024-09-12T12:20:26.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a4815f560 con 0x7f0a48162a40 2024-09-12T12:20:26.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a4814a500 con 0x7f0a48162a40 2024-09-12T12:20:26.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a480cf190 con 0x7f0a48162a40 2024-09-12T12:20:26.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.184+0000 7f0a3e000640 1 -- 172.21.15.144:0/1039015931 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a340ab4c0 con 0x7f0a48162a40 2024-09-12T12:20:26.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.188+0000 7f0a3e000640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a280678f0 0x7f0a28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:26.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.188+0000 7f0a3e000640 1 -- 172.21.15.144:0/1039015931 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f0a3411f980 con 0x7f0a48162a40 2024-09-12T12:20:26.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.188+0000 7f0a45e00640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a280678f0 0x7f0a28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:26.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.188+0000 7f0a45e00640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a280678f0 0x7f0a28069db0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0a480736e0 tx=0x7f0a38007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:26.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.192+0000 7f0a3e000640 1 -- 172.21.15.144:0/1039015931 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a34016150 con 0x7f0a48162a40 2024-09-12T12:20:26.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:26.384+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0a4806da90 con 0x7f0a48162a40 2024-09-12T12:20:27.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.228+0000 7f0a3e000640 1 -- 172.21.15.144:0/1039015931 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v98) ==== 122+0+0 (secure 0 0 0) 0x7f0a340f0200 con 0x7f0a48162a40 2024-09-12T12:20:27.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a280678f0 msgr2=0x7f0a28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a280678f0 0x7f0a28069db0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0a480736e0 tx=0x7f0a38007d10 comp rx=0 tx=0).stop 2024-09-12T12:20:27.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a48162a40 msgr2=0x7f0a480b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a48162a40 0x7f0a480b51d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f0a340ae040 tx=0x7f0a3401ad10 comp rx=0 tx=0).stop 2024-09-12T12:20:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 shutdown_connections 2024-09-12T12:20:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a280678f0 0x7f0a28069db0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a48166510 0x7f0a481498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a48162a40 0x7f0a480b51d0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 --2- 172.21.15.144:0/1039015931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a480af5d0 0x7f0a4815eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 >> 172.21.15.144:0/1039015931 conn(0x7f0a48068030 msgr2=0x7f0a480b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 shutdown_connections 2024-09-12T12:20:27.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.232+0000 7f0a4ca00640 1 -- 172.21.15.144:0/1039015931 wait complete. 2024-09-12T12:20:27.254 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:20:27.254 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:27.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f54a00640 1 Processor -- start 2024-09-12T12:20:27.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f54a00640 1 -- start start 2024-09-12T12:20:27.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f54a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f5015c7b0 0x7f5f500ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f54a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f5015cd30 0x7f5f500b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f54a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f500cd870 con 0x7f5f500b5de0 2024-09-12T12:20:27.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f54a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5f50072a50 con 0x7f5f5015cd30 2024-09-12T12:20:27.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f54a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5f500cde30 con 0x7f5f5015c7b0 2024-09-12T12:20:27.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f4d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f5015cd30 0x7f5f500b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f4d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f5015cd30 0x7f5f500b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46756/0 (socket says 172.21.15.144:46756) 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f4d400640 1 -- 172.21.15.144:0/339698159 learned_addr learned my addr 172.21.15.144:0/339698159 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f4d400640 1 -- 172.21.15.144:0/339698159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f5015c7b0 msgr2=0x7f5f500ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f4d400640 1 --2- 172.21.15.144:0/339698159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f5015c7b0 0x7f5f500ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f4d400640 1 -- 172.21.15.144:0/339698159 >> v1:172.21.15.144:6789/0 conn(0x7f5f500b5de0 legacy=0x7f5f501601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.392+0000 7f5f4d400640 1 -- 172.21.15.144:0/339698159 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f500cdb50 con 0x7f5f5015cd30 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f4d400640 1 --2- 172.21.15.144:0/339698159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 0x7f5f500b58a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009870 tx=0x7f5f3c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d24c245fc0abc40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f4ca00640 1 -- 172.21.15.144:0/339698159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0b2070 con 0x7f5f5015cd30 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f4ca00640 1 -- 172.21.15.144:0/339698159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c0a9070 con 0x7f5f5015cd30 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f4ca00640 1 -- 172.21.15.144:0/339698159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0ad880 con 0x7f5f5015cd30 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f54a00640 1 -- 172.21.15.144:0/339698159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 msgr2=0x7f5f500b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f54a00640 1 --2- 172.21.15.144:0/339698159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 0x7f5f500b58a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009870 tx=0x7f5f3c01c560 comp rx=0 tx=0).stop 2024-09-12T12:20:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f54a00640 1 -- 172.21.15.144:0/339698159 shutdown_connections 2024-09-12T12:20:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f54a00640 1 --2- 172.21.15.144:0/339698159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 0x7f5f500b58a0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f54a00640 1 --2- 172.21.15.144:0/339698159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f5015c7b0 0x7f5f500ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f54a00640 1 -- 172.21.15.144:0/339698159 >> 172.21.15.144:0/339698159 conn(0x7f5f5006d0d0 msgr2=0x7f5f5006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f54a00640 1 -- 172.21.15.144:0/339698159 shutdown_connections 2024-09-12T12:20:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.396+0000 7f5f54a00640 1 -- 172.21.15.144:0/339698159 wait complete. 2024-09-12T12:20:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 Processor -- start 2024-09-12T12:20:27.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 -- start start 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f500b5de0 0x7f5f501fbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f5015c7b0 0x7f5f50165980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 0x7f5f50152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50169530 con 0x7f5f5015cd30 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5f500cd650 con 0x7f5f5015c7b0 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5f501696b0 con 0x7f5f500b5de0 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 0x7f5f50152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 0x7f5f50152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46758/0 (socket says 172.21.15.144:46758) 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4e800640 1 -- 172.21.15.144:0/2418341673 learned_addr learned my addr 172.21.15.144:0/2418341673 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:27.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4de00640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f500b5de0 0x7f5f501fbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4d400640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f5015c7b0 0x7f5f50165980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4e800640 1 -- 172.21.15.144:0/2418341673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f500b5de0 msgr2=0x7f5f501fbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4e800640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f500b5de0 0x7f5f501fbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4e800640 1 -- 172.21.15.144:0/2418341673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f5015c7b0 msgr2=0x7f5f50165980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4e800640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f5015c7b0 0x7f5f50165980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4e800640 1 -- 172.21.15.144:0/2418341673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f500b5220 con 0x7f5f5015cd30 2024-09-12T12:20:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f4e800640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 0x7f5f50152bb0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800c430 tx=0x7f5f4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f46000640 1 -- 172.21.15.144:0/2418341673 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48005220 con 0x7f5f5015cd30 2024-09-12T12:20:27.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f46000640 1 -- 172.21.15.144:0/2418341673 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f480053c0 con 0x7f5f5015cd30 2024-09-12T12:20:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f500b5500 con 0x7f5f5015cd30 2024-09-12T12:20:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f46000640 1 -- 172.21.15.144:0/2418341673 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48007270 con 0x7f5f5015cd30 2024-09-12T12:20:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.400+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5015a6f0 con 0x7f5f5015cd30 2024-09-12T12:20:27.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.404+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f500b4940 con 0x7f5f5015cd30 2024-09-12T12:20:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.404+0000 7f5f46000640 1 -- 172.21.15.144:0/2418341673 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f48019020 con 0x7f5f5015cd30 2024-09-12T12:20:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.404+0000 7f5f46000640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f300678c0 0x7f5f30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.404+0000 7f5f46000640 1 -- 172.21.15.144:0/2418341673 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f5f48085150 con 0x7f5f5015cd30 2024-09-12T12:20:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.404+0000 7f5f4de00640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f300678c0 0x7f5f30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.404+0000 7f5f4de00640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f300678c0 0x7f5f30069d80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000a400 tx=0x7f5f4000d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:27.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.408+0000 7f5f46000640 1 -- 172.21.15.144:0/2418341673 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5f48055410 con 0x7f5f5015cd30 2024-09-12T12:20:27.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.600+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f5015f870 con 0x7f5f5015cd30 2024-09-12T12:20:27.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f46000640 1 -- 172.21.15.144:0/2418341673 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5237 (secure 0 0 0) 0x7f5f48059710 con 0x7f5f5015cd30 2024-09-12T12:20:27.603 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:27.604 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":98,"btime":"2024-09-12T12:20:27:230311+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6911,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3824078479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3824078479},{"type":"v1","addr":"172.21.15.144:6837","nonce":3824078479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2364982071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2364982071},{"type":"v1","addr":"172.21.15.165:6835","nonce":2364982071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1068048719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1068048719},{"type":"v1","addr":"172.21.15.144:6835","nonce":1068048719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:20:23.392012+0000","modified":"2024-09-12T12:20:26.388950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6834/3565473111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3565473111},{"type":"v1","addr":"172.21.15.165:6834","nonce":3565473111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8010,"qdb_cluster":[8010]},"id":8}]} 2024-09-12T12:20:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 98 2024-09-12T12:20:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f300678c0 msgr2=0x7f5f30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f300678c0 0x7f5f30069d80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000a400 tx=0x7f5f4000d040 comp rx=0 tx=0).stop 2024-09-12T12:20:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 msgr2=0x7f5f50152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 0x7f5f50152bb0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800c430 tx=0x7f5f4800c8f0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 shutdown_connections 2024-09-12T12:20:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f300678c0 0x7f5f30069d80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f5015cd30 0x7f5f50152bb0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f5015c7b0 0x7f5f50165980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 --2- 172.21.15.144:0/2418341673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f500b5de0 0x7f5f501fbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 >> 172.21.15.144:0/2418341673 conn(0x7f5f5006d0d0 msgr2=0x7f5f500d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 shutdown_connections 2024-09-12T12:20:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.604+0000 7f5f54a00640 1 -- 172.21.15.144:0/2418341673 wait complete. 2024-09-12T12:20:27.625 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:20:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1024800640 1 Processor -- start 2024-09-12T12:20:27.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1024800640 1 -- start start 2024-09-12T12:20:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1024800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f101c15b4e0 0x7f101c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1024800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f101c0b3ad0 0x7f101c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1024800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c071960 0x7f101c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1024800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f101c0b45a0 con 0x7f101c15b4e0 2024-09-12T12:20:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1024800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f101c0b3fe0 con 0x7f101c0b3ad0 2024-09-12T12:20:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1024800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f101c0b42c0 con 0x7f101c071960 2024-09-12T12:20:27.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1021e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f101c15b4e0 0x7f101c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1021e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f101c15b4e0 0x7f101c0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46772/0 (socket says 172.21.15.144:46772) 2024-09-12T12:20:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1021e00640 1 -- 172.21.15.144:0/1436397302 learned_addr learned my addr 172.21.15.144:0/1436397302 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1022800640 1 --2- 172.21.15.144:0/1436397302 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c071960 0x7f101c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.760+0000 7f1021400640 1 --2- 172.21.15.144:0/1436397302 >> v2:172.21.15.165:3300/0 conn(0x7f101c0b3ad0 0x7f101c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1021e00640 1 -- 172.21.15.144:0/1436397302 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c071960 msgr2=0x7f101c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1021e00640 1 --2- 172.21.15.144:0/1436397302 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c071960 0x7f101c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1021e00640 1 -- 172.21.15.144:0/1436397302 >> v2:172.21.15.165:3300/0 conn(0x7f101c0b3ad0 msgr2=0x7f101c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1021e00640 1 --2- 172.21.15.144:0/1436397302 >> v2:172.21.15.165:3300/0 conn(0x7f101c0b3ad0 0x7f101c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1021e00640 1 -- 172.21.15.144:0/1436397302 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c0b1490 con 0x7f101c15b4e0 2024-09-12T12:20:27.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1021e00640 1 --2- 172.21.15.144:0/1436397302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 0x7f101c0b3590 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f101c0b02b0 tx=0x7f101001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbba7a88b09e545b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:27.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1020a00640 1 -- 172.21.15.144:0/1436397302 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10100b1070 con 0x7f101c15b4e0 2024-09-12T12:20:27.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1020a00640 1 -- 172.21.15.144:0/1436397302 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10100ac620 con 0x7f101c15b4e0 2024-09-12T12:20:27.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1020a00640 1 -- 172.21.15.144:0/1436397302 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10100ac9f0 con 0x7f101c15b4e0 2024-09-12T12:20:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1024800640 1 -- 172.21.15.144:0/1436397302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 msgr2=0x7f101c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1024800640 1 --2- 172.21.15.144:0/1436397302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 0x7f101c0b3590 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f101c0b02b0 tx=0x7f101001c4f0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1024800640 1 -- 172.21.15.144:0/1436397302 shutdown_connections 2024-09-12T12:20:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1024800640 1 --2- 172.21.15.144:0/1436397302 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c071960 0x7f101c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1024800640 1 --2- 172.21.15.144:0/1436397302 >> v2:172.21.15.165:3300/0 conn(0x7f101c0b3ad0 0x7f101c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1024800640 1 --2- 172.21.15.144:0/1436397302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 0x7f101c0b3590 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1024800640 1 -- 172.21.15.144:0/1436397302 >> 172.21.15.144:0/1436397302 conn(0x7f101c06d0d0 msgr2=0x7f101c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:27.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1024800640 1 -- 172.21.15.144:0/1436397302 shutdown_connections 2024-09-12T12:20:27.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.764+0000 7f1024800640 1 -- 172.21.15.144:0/1436397302 wait complete. 2024-09-12T12:20:27.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 Processor -- start 2024-09-12T12:20:27.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 -- start start 2024-09-12T12:20:27.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101c071960 0x7f101c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c0b3ad0 0x7f101c1fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 0x7f101c0aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f101c15f270 con 0x7f101c15b4e0 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f101c15f0f0 con 0x7f101c071960 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f101c15f3f0 con 0x7f101c0b3ad0 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1022800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 0x7f101c0aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1022800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 0x7f101c0aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46786/0 (socket says 172.21.15.144:46786) 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1022800640 1 -- 172.21.15.144:0/3959329803 learned_addr learned my addr 172.21.15.144:0/3959329803 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1021400640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c0b3ad0 0x7f101c1fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1021e00640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101c071960 0x7f101c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1022800640 1 -- 172.21.15.144:0/3959329803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c0b3ad0 msgr2=0x7f101c1fba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1022800640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c0b3ad0 0x7f101c1fba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1022800640 1 -- 172.21.15.144:0/3959329803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101c071960 msgr2=0x7f101c154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1022800640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101c071960 0x7f101c154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1022800640 1 -- 172.21.15.144:0/3959329803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c1fbf80 con 0x7f101c15b4e0 2024-09-12T12:20:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1022800640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 0x7f101c0aa480 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1018007e30 tx=0x7f101800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:27.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1016000640 1 -- 172.21.15.144:0/3959329803 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018014620 con 0x7f101c15b4e0 2024-09-12T12:20:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1016000640 1 -- 172.21.15.144:0/3959329803 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1018019070 con 0x7f101c15b4e0 2024-09-12T12:20:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1016000640 1 -- 172.21.15.144:0/3959329803 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1018014a00 con 0x7f101c15b4e0 2024-09-12T12:20:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101c15d890 con 0x7f101c15b4e0 2024-09-12T12:20:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.768+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101c155570 con 0x7f101c15b4e0 2024-09-12T12:20:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.772+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f101c071420 con 0x7f101c15b4e0 2024-09-12T12:20:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.772+0000 7f1016000640 1 -- 172.21.15.144:0/3959329803 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1018014ba0 con 0x7f101c15b4e0 2024-09-12T12:20:27.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.772+0000 7f1016000640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10000678c0 0x7f1000069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.772+0000 7f1016000640 1 -- 172.21.15.144:0/3959329803 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f1018086760 con 0x7f101c15b4e0 2024-09-12T12:20:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.772+0000 7f1021e00640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10000678c0 0x7f1000069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:27.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.772+0000 7f1021e00640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10000678c0 0x7f1000069d80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10100ae000 tx=0x7f1010008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:27.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.776+0000 7f1016000640 1 -- 172.21.15.144:0/3959329803 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f101c1fbf80 con 0x7f101c15b4e0 2024-09-12T12:20:27.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f101c1653a0 con 0x7f101c15b4e0 2024-09-12T12:20:27.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1016000640 1 -- 172.21.15.144:0/3959329803 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+17036 (secure 0 0 0) 0x7f1018057070 con 0x7f101c15b4e0 2024-09-12T12:20:27.936 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:27.936 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":129,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:20:24.980221+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:20:21.527729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-12T12:20:22.383110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:20:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10000678c0 msgr2=0x7f1000069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10000678c0 0x7f1000069d80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10100ae000 tx=0x7f1010008040 comp rx=0 tx=0).stop 2024-09-12T12:20:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 msgr2=0x7f101c0aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 0x7f101c0aa480 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f1018007e30 tx=0x7f101800e4b0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 shutdown_connections 2024-09-12T12:20:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f10000678c0 0x7f1000069d80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101c15b4e0 0x7f101c0aa480 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101c0b3ad0 0x7f101c1fba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.936+0000 7f1024800640 1 --2- 172.21.15.144:0/3959329803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101c071960 0x7f101c154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.940+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 >> 172.21.15.144:0/3959329803 conn(0x7f101c06d0d0 msgr2=0x7f101c15a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.940+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 shutdown_connections 2024-09-12T12:20:27.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:27.940+0000 7f1024800640 1 -- 172.21.15.144:0/3959329803 wait complete. 2024-09-12T12:20:27.959 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:20:27.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:20:28.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c6a600640 1 Processor -- start 2024-09-12T12:20:28.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c6a600640 1 -- start start 2024-09-12T12:20:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c6a600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c640b74b0 0x7f3c6406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c6a600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3c6406dce0 0x7f3c640cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c6a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c6406e4d0 con 0x7f3c6415e540 2024-09-12T12:20:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c6a600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3c640cba40 con 0x7f3c640b74b0 2024-09-12T12:20:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c6a600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3c6406e7b0 con 0x7f3c6406dce0 2024-09-12T12:20:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c5aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c640b74b0 0x7f3c6406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c63400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3c6415e540 0x7f3c640b6da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35786/0 (socket says 172.21.15.144:35786) 2024-09-12T12:20:28.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c63400640 1 -- 172.21.15.144:0/3042879670 learned_addr learned my addr 172.21.15.144:0/3042879670 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:28.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c63e00640 1 --2- 172.21.15.144:0/3042879670 >> v2:172.21.15.165:3300/0 conn(0x7f3c6406dce0 0x7f3c640cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c5aa00640 1 -- 172.21.15.144:0/3042879670 >> v2:172.21.15.165:3300/0 conn(0x7f3c6406dce0 msgr2=0x7f3c640cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:28.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c5aa00640 1 --2- 172.21.15.144:0/3042879670 >> v2:172.21.15.165:3300/0 conn(0x7f3c6406dce0 0x7f3c640cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c5aa00640 1 -- 172.21.15.144:0/3042879670 >> v1:172.21.15.144:6789/0 conn(0x7f3c6415e540 legacy=0x7f3c640b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c5aa00640 1 -- 172.21.15.144:0/3042879670 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6406ea90 con 0x7f3c640b74b0 2024-09-12T12:20:28.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.096+0000 7f3c62a00640 1 -- 172.21.15.144:0/3042879670 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826331073 0 0) 0x7f3c6406e4d0 con 0x7f3c6415e540 2024-09-12T12:20:28.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c5aa00640 1 --2- 172.21.15.144:0/3042879670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c640b74b0 0x7f3c6406d7a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f3c640cbbc0 tx=0x7f3c4c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3de87565d972832 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:28.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c62a00640 1 -- 172.21.15.144:0/3042879670 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0b0070 con 0x7f3c640b74b0 2024-09-12T12:20:28.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c62a00640 1 -- 172.21.15.144:0/3042879670 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0ab600 con 0x7f3c640b74b0 2024-09-12T12:20:28.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c62a00640 1 -- 172.21.15.144:0/3042879670 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0ab9d0 con 0x7f3c640b74b0 2024-09-12T12:20:28.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c6a600640 1 -- 172.21.15.144:0/3042879670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c640b74b0 msgr2=0x7f3c6406d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c6a600640 1 --2- 172.21.15.144:0/3042879670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c640b74b0 0x7f3c6406d7a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f3c640cbbc0 tx=0x7f3c4c01c3b0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c6a600640 1 -- 172.21.15.144:0/3042879670 shutdown_connections 2024-09-12T12:20:28.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c6a600640 1 --2- 172.21.15.144:0/3042879670 >> v2:172.21.15.165:3300/0 conn(0x7f3c6406dce0 0x7f3c640cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c6a600640 1 --2- 172.21.15.144:0/3042879670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c640b74b0 0x7f3c6406d7a0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c6a600640 1 -- 172.21.15.144:0/3042879670 >> 172.21.15.144:0/3042879670 conn(0x7f3c64067a00 msgr2=0x7f3c64067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:28.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c6a600640 1 -- 172.21.15.144:0/3042879670 shutdown_connections 2024-09-12T12:20:28.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.100+0000 7f3c6a600640 1 -- 172.21.15.144:0/3042879670 wait complete. 2024-09-12T12:20:28.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 Processor -- start 2024-09-12T12:20:28.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 -- start start 2024-09-12T12:20:28.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c6406dce0 0x7f3c64159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c640b74b0 0x7f3c641526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c6415e540 0x7f3c641568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3c640ccff0 con 0x7f3c6406dce0 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3c640cce70 con 0x7f3c6415e540 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3c640cd170 con 0x7f3c640b74b0 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c6406dce0 0x7f3c64159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c6406dce0 0x7f3c64159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46812/0 (socket says 172.21.15.144:46812) 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63400640 1 -- 172.21.15.144:0/299376053 learned_addr learned my addr 172.21.15.144:0/299376053 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c5aa00640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c640b74b0 0x7f3c641526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63e00640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c6415e540 0x7f3c641568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63400640 1 -- 172.21.15.144:0/299376053 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c640b74b0 msgr2=0x7f3c641526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63400640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c640b74b0 0x7f3c641526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63400640 1 -- 172.21.15.144:0/299376053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c6415e540 msgr2=0x7f3c641568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63400640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c6415e540 0x7f3c641568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63400640 1 -- 172.21.15.144:0/299376053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c640d13f0 con 0x7f3c6406dce0 2024-09-12T12:20:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c63400640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c6406dce0 0x7f3c64159400 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c480 tx=0x7f3c5400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c5be00640 1 -- 172.21.15.144:0/299376053 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54018070 con 0x7f3c6406dce0 2024-09-12T12:20:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c5be00640 1 -- 172.21.15.144:0/299376053 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c54007500 con 0x7f3c6406dce0 2024-09-12T12:20:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c5be00640 1 -- 172.21.15.144:0/299376053 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54004a30 con 0x7f3c6406dce0 2024-09-12T12:20:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c640d16d0 con 0x7f3c6406dce0 2024-09-12T12:20:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c640d1c90 con 0x7f3c6406dce0 2024-09-12T12:20:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.104+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c640cbeb0 con 0x7f3c6406dce0 2024-09-12T12:20:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.108+0000 7f3c5be00640 1 -- 172.21.15.144:0/299376053 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c54004bd0 con 0x7f3c6406dce0 2024-09-12T12:20:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.108+0000 7f3c5be00640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c400678f0 0x7f3c40069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.108+0000 7f3c5be00640 1 -- 172.21.15.144:0/299376053 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f3c54084fe0 con 0x7f3c6406dce0 2024-09-12T12:20:28.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.108+0000 7f3c5aa00640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c400678f0 0x7f3c40069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.108+0000 7f3c5aa00640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c400678f0 0x7f3c40069db0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0ad000 tx=0x7f3c4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:28.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.112+0000 7f3c5be00640 1 -- 172.21.15.144:0/299376053 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3c54055390 con 0x7f3c6406dce0 2024-09-12T12:20:28.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.268+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c640ce670 con 0x7f3c400678f0 2024-09-12T12:20:28.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.272+0000 7f3c5be00640 1 -- 172.21.15.144:0/299376053 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252415 (secure 0 0 0) 0x7f3c640ce670 con 0x7f3c400678f0 2024-09-12T12:20:28.276 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:28.278 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:20:28.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c400678f0 msgr2=0x7f3c40069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c400678f0 0x7f3c40069db0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0ad000 tx=0x7f3c4c008040 comp rx=0 tx=0).stop 2024-09-12T12:20:28.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c6406dce0 msgr2=0x7f3c64159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c6406dce0 0x7f3c64159400 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c480 tx=0x7f3c5400c940 comp rx=0 tx=0).stop 2024-09-12T12:20:28.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 shutdown_connections 2024-09-12T12:20:28.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3c400678f0 0x7f3c40069db0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c6415e540 0x7f3c641568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3c640b74b0 0x7f3c641526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 --2- 172.21.15.144:0/299376053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c6406dce0 0x7f3c64159400 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 >> 172.21.15.144:0/299376053 conn(0x7f3c64067a00 msgr2=0x7f3c640b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:28.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 shutdown_connections 2024-09-12T12:20:28.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.276+0000 7f3c6a600640 1 -- 172.21.15.144:0/299376053 wait complete. 2024-09-12T12:20:28.296 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-09-12T12:20:27.475334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":401964,"kb_used_data":13620,"kb_used_omap":12,"kb_used_meta":388147,"kb_avail":754572756,"statfs":{"total":773094113280,"available":772682502144,"internally_reserved":0,"allocated":13946880,"data_stored":7166517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":397463089},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.507115"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.991176+0000","last_change":"2024-09-12T12:20:23.990124+0000","last_active":"2024-09-12T12:20:23.991176+0000","last_peered":"2024-09-12T12:20:23.991176+0000","last_clean":"2024-09-12T12:20:23.991176+0000","last_became_active":"2024-09-12T12:20:23.989829+0000","last_became_peered":"2024-09-12T12:20:23.989829+0000","last_unstale":"2024-09-12T12:20:23.991176+0000","last_undegraded":"2024-09-12T12:20:23.991176+0000","last_fullsized":"2024-09-12T12:20:23.991176+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:07.296069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020128+0000","last_change":"2024-09-12T12:20:24.017243+0000","last_active":"2024-09-12T12:20:24.020128+0000","last_peered":"2024-09-12T12:20:24.020128+0000","last_clean":"2024-09-12T12:20:24.020128+0000","last_became_active":"2024-09-12T12:20:24.017012+0000","last_became_peered":"2024-09-12T12:20:24.017012+0000","last_unstale":"2024-09-12T12:20:24.020128+0000","last_undegraded":"2024-09-12T12:20:24.020128+0000","last_fullsized":"2024-09-12T12:20:24.020128+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:38.672150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.014358+0000","last_change":"2024-09-12T12:20:24.013541+0000","last_active":"2024-09-12T12:20:24.014358+0000","last_peered":"2024-09-12T12:20:24.014358+0000","last_clean":"2024-09-12T12:20:24.014358+0000","last_became_active":"2024-09-12T12:20:24.012905+0000","last_became_peered":"2024-09-12T12:20:24.012905+0000","last_unstale":"2024-09-12T12:20:24.014358+0000","last_undegraded":"2024-09-12T12:20:24.014358+0000","last_fullsized":"2024-09-12T12:20:24.014358+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:24.571001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.017710+0000","last_change":"2024-09-12T12:20:24.014534+0000","last_active":"2024-09-12T12:20:24.017710+0000","last_peered":"2024-09-12T12:20:24.017710+0000","last_clean":"2024-09-12T12:20:24.017710+0000","last_became_active":"2024-09-12T12:20:24.013035+0000","last_became_peered":"2024-09-12T12:20:24.013035+0000","last_unstale":"2024-09-12T12:20:24.017710+0000","last_undegraded":"2024-09-12T12:20:24.017710+0000","last_fullsized":"2024-09-12T12:20:24.017710+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:04:36.698463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.987925+0000","last_change":"2024-09-12T12:20:23.987042+0000","last_active":"2024-09-12T12:20:23.987925+0000","last_peered":"2024-09-12T12:20:23.987925+0000","last_clean":"2024-09-12T12:20:23.987925+0000","last_became_active":"2024-09-12T12:20:23.986735+0000","last_became_peered":"2024-09-12T12:20:23.986735+0000","last_unstale":"2024-09-12T12:20:23.987925+0000","last_undegraded":"2024-09-12T12:20:23.987925+0000","last_fullsized":"2024-09-12T12:20:23.987925+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.884993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.013169+0000","last_change":"2024-09-12T12:20:24.010527+0000","last_active":"2024-09-12T12:20:24.013169+0000","last_peered":"2024-09-12T12:20:24.013169+0000","last_clean":"2024-09-12T12:20:24.013169+0000","last_became_active":"2024-09-12T12:20:24.010056+0000","last_became_peered":"2024-09-12T12:20:24.010056+0000","last_unstale":"2024-09-12T12:20:24.013169+0000","last_undegraded":"2024-09-12T12:20:24.013169+0000","last_fullsized":"2024-09-12T12:20:24.013169+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:41.668146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.004902+0000","last_change":"2024-09-12T12:20:23.998989+0000","last_active":"2024-09-12T12:20:24.004902+0000","last_peered":"2024-09-12T12:20:24.004902+0000","last_clean":"2024-09-12T12:20:24.004902+0000","last_became_active":"2024-09-12T12:20:23.998673+0000","last_became_peered":"2024-09-12T12:20:23.998673+0000","last_unstale":"2024-09-12T12:20:24.004902+0000","last_undegraded":"2024-09-12T12:20:24.004902+0000","last_fullsized":"2024-09-12T12:20:24.004902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:09.097182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.018081+0000","last_change":"2024-09-12T12:20:24.014876+0000","last_active":"2024-09-12T12:20:24.018081+0000","last_peered":"2024-09-12T12:20:24.018081+0000","last_clean":"2024-09-12T12:20:24.018081+0000","last_became_active":"2024-09-12T12:20:24.014620+0000","last_became_peered":"2024-09-12T12:20:24.014620+0000","last_unstale":"2024-09-12T12:20:24.018081+0000","last_undegraded":"2024-09-12T12:20:24.018081+0000","last_fullsized":"2024-09-12T12:20:24.018081+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:23.320973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020198+0000","last_change":"2024-09-12T12:20:24.015253+0000","last_active":"2024-09-12T12:20:24.020198+0000","last_peered":"2024-09-12T12:20:24.020198+0000","last_clean":"2024-09-12T12:20:24.020198+0000","last_became_active":"2024-09-12T12:20:24.014940+0000","last_became_peered":"2024-09-12T12:20:24.014940+0000","last_unstale":"2024-09-12T12:20:24.020198+0000","last_undegraded":"2024-09-12T12:20:24.020198+0000","last_fullsized":"2024-09-12T12:20:24.020198+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:59.723323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.004339+0000","last_change":"2024-09-12T12:20:23.997340+0000","last_active":"2024-09-12T12:20:24.004339+0000","last_peered":"2024-09-12T12:20:24.004339+0000","last_clean":"2024-09-12T12:20:24.004339+0000","last_became_active":"2024-09-12T12:20:23.997050+0000","last_became_peered":"2024-09-12T12:20:23.997050+0000","last_unstale":"2024-09-12T12:20:24.004339+0000","last_undegraded":"2024-09-12T12:20:24.004339+0000","last_fullsized":"2024-09-12T12:20:24.004339+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.367347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.006001+0000","last_change":"2024-09-12T12:20:24.004444+0000","last_active":"2024-09-12T12:20:24.006001+0000","last_peered":"2024-09-12T12:20:24.006001+0000","last_clean":"2024-09-12T12:20:24.006001+0000","last_became_active":"2024-09-12T12:20:24.004108+0000","last_became_peered":"2024-09-12T12:20:24.004108+0000","last_unstale":"2024-09-12T12:20:24.006001+0000","last_undegraded":"2024-09-12T12:20:24.006001+0000","last_fullsized":"2024-09-12T12:20:24.006001+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.636997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008789+0000","last_change":"2024-09-12T12:20:24.003904+0000","last_active":"2024-09-12T12:20:24.008789+0000","last_peered":"2024-09-12T12:20:24.008789+0000","last_clean":"2024-09-12T12:20:24.008789+0000","last_became_active":"2024-09-12T12:20:24.001012+0000","last_became_peered":"2024-09-12T12:20:24.001012+0000","last_unstale":"2024-09-12T12:20:24.008789+0000","last_undegraded":"2024-09-12T12:20:24.008789+0000","last_fullsized":"2024-09-12T12:20:24.008789+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:10.633686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.003423+0000","last_change":"2024-09-12T12:20:24.000865+0000","last_active":"2024-09-12T12:20:24.003423+0000","last_peered":"2024-09-12T12:20:24.003423+0000","last_clean":"2024-09-12T12:20:24.003423+0000","last_became_active":"2024-09-12T12:20:24.000507+0000","last_became_peered":"2024-09-12T12:20:24.000507+0000","last_unstale":"2024-09-12T12:20:24.003423+0000","last_undegraded":"2024-09-12T12:20:24.003423+0000","last_fullsized":"2024-09-12T12:20:24.003423+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.636997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.015875+0000","last_change":"2024-09-12T12:20:24.014297+0000","last_active":"2024-09-12T12:20:24.015875+0000","last_peered":"2024-09-12T12:20:24.015875+0000","last_clean":"2024-09-12T12:20:24.015875+0000","last_became_active":"2024-09-12T12:20:24.013941+0000","last_became_peered":"2024-09-12T12:20:24.013941+0000","last_unstale":"2024-09-12T12:20:24.015875+0000","last_undegraded":"2024-09-12T12:20:24.015875+0000","last_fullsized":"2024-09-12T12:20:24.015875+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:27.673390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.004283+0000","last_change":"2024-09-12T12:20:24.003424+0000","last_active":"2024-09-12T12:20:24.004283+0000","last_peered":"2024-09-12T12:20:24.004283+0000","last_clean":"2024-09-12T12:20:24.004283+0000","last_became_active":"2024-09-12T12:20:24.003148+0000","last_became_peered":"2024-09-12T12:20:24.003148+0000","last_unstale":"2024-09-12T12:20:24.004283+0000","last_undegraded":"2024-09-12T12:20:24.004283+0000","last_fullsized":"2024-09-12T12:20:24.004283+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.310467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008807+0000","last_change":"2024-09-12T12:20:24.003344+0000","last_active":"2024-09-12T12:20:24.008807+0000","last_peered":"2024-09-12T12:20:24.008807+0000","last_clean":"2024-09-12T12:20:24.008807+0000","last_became_active":"2024-09-12T12:20:23.998169+0000","last_became_peered":"2024-09-12T12:20:23.998169+0000","last_unstale":"2024-09-12T12:20:24.008807+0000","last_undegraded":"2024-09-12T12:20:24.008807+0000","last_fullsized":"2024-09-12T12:20:24.008807+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:36.962232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.001717+0000","last_change":"2024-09-12T12:20:23.999947+0000","last_active":"2024-09-12T12:20:24.001717+0000","last_peered":"2024-09-12T12:20:24.001717+0000","last_clean":"2024-09-12T12:20:24.001717+0000","last_became_active":"2024-09-12T12:20:23.999666+0000","last_became_peered":"2024-09-12T12:20:23.999666+0000","last_unstale":"2024-09-12T12:20:24.001717+0000","last_undegraded":"2024-09-12T12:20:24.001717+0000","last_fullsized":"2024-09-12T12:20:24.001717+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.310467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020028+0000","last_change":"2024-09-12T12:20:24.017167+0000","last_active":"2024-09-12T12:20:24.020028+0000","last_peered":"2024-09-12T12:20:24.020028+0000","last_clean":"2024-09-12T12:20:24.020028+0000","last_became_active":"2024-09-12T12:20:24.016724+0000","last_became_peered":"2024-09-12T12:20:24.016724+0000","last_unstale":"2024-09-12T12:20:24.020028+0000","last_undegraded":"2024-09-12T12:20:24.020028+0000","last_fullsized":"2024-09-12T12:20:24.020028+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:11.877005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010840+0000","last_change":"2024-09-12T12:20:24.001286+0000","last_active":"2024-09-12T12:20:24.010840+0000","last_peered":"2024-09-12T12:20:24.010840+0000","last_clean":"2024-09-12T12:20:24.010840+0000","last_became_active":"2024-09-12T12:20:24.000744+0000","last_became_peered":"2024-09-12T12:20:24.000744+0000","last_unstale":"2024-09-12T12:20:24.010840+0000","last_undegraded":"2024-09-12T12:20:24.010840+0000","last_fullsized":"2024-09-12T12:20:24.010840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.594553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.007503+0000","last_change":"2024-09-12T12:20:24.002897+0000","last_active":"2024-09-12T12:20:24.007503+0000","last_peered":"2024-09-12T12:20:24.007503+0000","last_clean":"2024-09-12T12:20:24.007503+0000","last_became_active":"2024-09-12T12:20:24.002618+0000","last_became_peered":"2024-09-12T12:20:24.002618+0000","last_unstale":"2024-09-12T12:20:24.007503+0000","last_undegraded":"2024-09-12T12:20:24.007503+0000","last_fullsized":"2024-09-12T12:20:24.007503+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:38.196196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.016504+0000","last_change":"2024-09-12T12:20:24.008730+0000","last_active":"2024-09-12T12:20:24.016504+0000","last_peered":"2024-09-12T12:20:24.016504+0000","last_clean":"2024-09-12T12:20:24.016504+0000","last_became_active":"2024-09-12T12:20:24.007205+0000","last_became_peered":"2024-09-12T12:20:24.007205+0000","last_unstale":"2024-09-12T12:20:24.016504+0000","last_undegraded":"2024-09-12T12:20:24.016504+0000","last_fullsized":"2024-09-12T12:20:24.016504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:09.395075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.011395+0000","last_change":"2024-09-12T12:20:24.009092+0000","last_active":"2024-09-12T12:20:24.011395+0000","last_peered":"2024-09-12T12:20:24.011395+0000","last_clean":"2024-09-12T12:20:24.011395+0000","last_became_active":"2024-09-12T12:20:24.008798+0000","last_became_peered":"2024-09-12T12:20:24.008798+0000","last_unstale":"2024-09-12T12:20:24.011395+0000","last_undegraded":"2024-09-12T12:20:24.011395+0000","last_fullsized":"2024-09-12T12:20:24.011395+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.808361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020596+0000","last_change":"2024-09-12T12:20:24.015241+0000","last_active":"2024-09-12T12:20:24.020596+0000","last_peered":"2024-09-12T12:20:24.020596+0000","last_clean":"2024-09-12T12:20:24.020596+0000","last_became_active":"2024-09-12T12:20:24.014953+0000","last_became_peered":"2024-09-12T12:20:24.014953+0000","last_unstale":"2024-09-12T12:20:24.020596+0000","last_undegraded":"2024-09-12T12:20:24.020596+0000","last_fullsized":"2024-09-12T12:20:24.020596+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:39.047632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.013747+0000","last_change":"2024-09-12T12:20:24.012240+0000","last_active":"2024-09-12T12:20:24.013747+0000","last_peered":"2024-09-12T12:20:24.013747+0000","last_clean":"2024-09-12T12:20:24.013747+0000","last_became_active":"2024-09-12T12:20:24.011962+0000","last_became_peered":"2024-09-12T12:20:24.011962+0000","last_unstale":"2024-09-12T12:20:24.013747+0000","last_undegraded":"2024-09-12T12:20:24.013747+0000","last_fullsized":"2024-09-12T12:20:24.013747+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:41.735115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.006830+0000","last_change":"2024-09-12T12:20:24.003580+0000","last_active":"2024-09-12T12:20:24.006830+0000","last_peered":"2024-09-12T12:20:24.006830+0000","last_clean":"2024-09-12T12:20:24.006830+0000","last_became_active":"2024-09-12T12:20:24.003314+0000","last_became_peered":"2024-09-12T12:20:24.003314+0000","last_unstale":"2024-09-12T12:20:24.006830+0000","last_undegraded":"2024-09-12T12:20:24.006830+0000","last_fullsized":"2024-09-12T12:20:24.006830+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:18.872310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008003+0000","last_change":"2024-09-12T12:20:24.006853+0000","last_active":"2024-09-12T12:20:24.008003+0000","last_peered":"2024-09-12T12:20:24.008003+0000","last_clean":"2024-09-12T12:20:24.008003+0000","last_became_active":"2024-09-12T12:20:24.005977+0000","last_became_peered":"2024-09-12T12:20:24.005977+0000","last_unstale":"2024-09-12T12:20:24.008003+0000","last_undegraded":"2024-09-12T12:20:24.008003+0000","last_fullsized":"2024-09-12T12:20:24.008003+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:12.465350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010819+0000","last_change":"2024-09-12T12:20:24.001027+0000","last_active":"2024-09-12T12:20:24.010819+0000","last_peered":"2024-09-12T12:20:24.010819+0000","last_clean":"2024-09-12T12:20:24.010819+0000","last_became_active":"2024-09-12T12:20:24.000316+0000","last_became_peered":"2024-09-12T12:20:24.000316+0000","last_unstale":"2024-09-12T12:20:24.010819+0000","last_undegraded":"2024-09-12T12:20:24.010819+0000","last_fullsized":"2024-09-12T12:20:24.010819+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:15.622725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008026+0000","last_change":"2024-09-12T12:20:24.000160+0000","last_active":"2024-09-12T12:20:24.008026+0000","last_peered":"2024-09-12T12:20:24.008026+0000","last_clean":"2024-09-12T12:20:24.008026+0000","last_became_active":"2024-09-12T12:20:23.999806+0000","last_became_peered":"2024-09-12T12:20:23.999806+0000","last_unstale":"2024-09-12T12:20:24.008026+0000","last_undegraded":"2024-09-12T12:20:24.008026+0000","last_fullsized":"2024-09-12T12:20:24.008026+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:06.250945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.014544+0000","last_change":"2024-09-12T12:20:24.013616+0000","last_active":"2024-09-12T12:20:24.014544+0000","last_peered":"2024-09-12T12:20:24.014544+0000","last_clean":"2024-09-12T12:20:24.014544+0000","last_became_active":"2024-09-12T12:20:24.012888+0000","last_became_peered":"2024-09-12T12:20:24.012888+0000","last_unstale":"2024-09-12T12:20:24.014544+0000","last_undegraded":"2024-09-12T12:20:24.014544+0000","last_fullsized":"2024-09-12T12:20:24.014544+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:05.243678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010896+0000","last_change":"2024-09-12T12:20:24.009874+0000","last_active":"2024-09-12T12:20:24.010896+0000","last_peered":"2024-09-12T12:20:24.010896+0000","last_clean":"2024-09-12T12:20:24.010896+0000","last_became_active":"2024-09-12T12:20:24.009563+0000","last_became_peered":"2024-09-12T12:20:24.009563+0000","last_unstale":"2024-09-12T12:20:24.010896+0000","last_undegraded":"2024-09-12T12:20:24.010896+0000","last_fullsized":"2024-09-12T12:20:24.010896+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:54.901459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.999485+0000","last_change":"2024-09-12T12:20:23.998206+0000","last_active":"2024-09-12T12:20:23.999485+0000","last_peered":"2024-09-12T12:20:23.999485+0000","last_clean":"2024-09-12T12:20:23.999485+0000","last_became_active":"2024-09-12T12:20:23.997905+0000","last_became_peered":"2024-09-12T12:20:23.997905+0000","last_unstale":"2024-09-12T12:20:23.999485+0000","last_undegraded":"2024-09-12T12:20:23.999485+0000","last_fullsized":"2024-09-12T12:20:23.999485+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:36.596088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.012865+0000","last_change":"2024-09-12T12:20:24.011702+0000","last_active":"2024-09-12T12:20:24.012865+0000","last_peered":"2024-09-12T12:20:24.012865+0000","last_clean":"2024-09-12T12:20:24.012865+0000","last_became_active":"2024-09-12T12:20:24.011419+0000","last_became_peered":"2024-09-12T12:20:24.011419+0000","last_unstale":"2024-09-12T12:20:24.012865+0000","last_undegraded":"2024-09-12T12:20:24.012865+0000","last_fullsized":"2024-09-12T12:20:24.012865+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:59.898033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.998715+0000","last_change":"2024-09-12T12:20:23.997328+0000","last_active":"2024-09-12T12:20:23.998715+0000","last_peered":"2024-09-12T12:20:23.998715+0000","last_clean":"2024-09-12T12:20:23.998715+0000","last_became_active":"2024-09-12T12:20:23.997013+0000","last_became_peered":"2024-09-12T12:20:23.997013+0000","last_unstale":"2024-09-12T12:20:23.998715+0000","last_undegraded":"2024-09-12T12:20:23.998715+0000","last_fullsized":"2024-09-12T12:20:23.998715+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:07.296069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"128'4","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.022216+0000","last_change":"2024-09-12T12:20:22.992547+0000","last_active":"2024-09-12T12:20:24.022216+0000","last_peered":"2024-09-12T12:20:24.022216+0000","last_clean":"2024-09-12T12:20:24.022216+0000","last_became_active":"2024-09-12T12:20:22.992143+0000","last_became_peered":"2024-09-12T12:20:22.992143+0000","last_unstale":"2024-09-12T12:20:24.022216+0000","last_undegraded":"2024-09-12T12:20:24.022216+0000","last_fullsized":"2024-09-12T12:20:24.022216+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:26.185606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.009080+0000","last_change":"2024-09-12T12:20:24.003677+0000","last_active":"2024-09-12T12:20:24.009080+0000","last_peered":"2024-09-12T12:20:24.009080+0000","last_clean":"2024-09-12T12:20:24.009080+0000","last_became_active":"2024-09-12T12:20:24.003400+0000","last_became_peered":"2024-09-12T12:20:24.003400+0000","last_unstale":"2024-09-12T12:20:24.009080+0000","last_undegraded":"2024-09-12T12:20:24.009080+0000","last_fullsized":"2024-09-12T12:20:24.009080+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:33:07.854490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.024244+0000","last_change":"2024-09-12T12:20:22.996575+0000","last_active":"2024-09-12T12:20:24.024244+0000","last_peered":"2024-09-12T12:20:24.024244+0000","last_clean":"2024-09-12T12:20:24.024244+0000","last_became_active":"2024-09-12T12:20:22.996320+0000","last_became_peered":"2024-09-12T12:20:22.996320+0000","last_unstale":"2024-09-12T12:20:24.024244+0000","last_undegraded":"2024-09-12T12:20:24.024244+0000","last_fullsized":"2024-09-12T12:20:24.024244+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:45.786045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.999440+0000","last_change":"2024-09-12T12:20:23.996805+0000","last_active":"2024-09-12T12:20:23.999440+0000","last_peered":"2024-09-12T12:20:23.999440+0000","last_clean":"2024-09-12T12:20:23.999440+0000","last_became_active":"2024-09-12T12:20:23.996413+0000","last_became_peered":"2024-09-12T12:20:23.996413+0000","last_unstale":"2024-09-12T12:20:23.999440+0000","last_undegraded":"2024-09-12T12:20:23.999440+0000","last_fullsized":"2024-09-12T12:20:23.999440+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.367347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.021921+0000","last_change":"2024-09-12T12:20:23.005201+0000","last_active":"2024-09-12T12:20:24.021921+0000","last_peered":"2024-09-12T12:20:24.021921+0000","last_clean":"2024-09-12T12:20:24.021921+0000","last_became_active":"2024-09-12T12:20:23.004478+0000","last_became_peered":"2024-09-12T12:20:23.004478+0000","last_unstale":"2024-09-12T12:20:24.021921+0000","last_undegraded":"2024-09-12T12:20:24.021921+0000","last_fullsized":"2024-09-12T12:20:24.021921+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:26.185606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.018066+0000","last_change":"2024-09-12T12:20:24.008389+0000","last_active":"2024-09-12T12:20:24.018066+0000","last_peered":"2024-09-12T12:20:24.018066+0000","last_clean":"2024-09-12T12:20:24.018066+0000","last_became_active":"2024-09-12T12:20:24.008028+0000","last_became_peered":"2024-09-12T12:20:24.008028+0000","last_unstale":"2024-09-12T12:20:24.018066+0000","last_undegraded":"2024-09-12T12:20:24.018066+0000","last_fullsized":"2024-09-12T12:20:24.018066+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:15.622725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.024093+0000","last_change":"2024-09-12T12:20:23.003650+0000","last_active":"2024-09-12T12:20:24.024093+0000","last_peered":"2024-09-12T12:20:24.024093+0000","last_clean":"2024-09-12T12:20:24.024093+0000","last_became_active":"2024-09-12T12:20:23.003152+0000","last_became_peered":"2024-09-12T12:20:23.003152+0000","last_unstale":"2024-09-12T12:20:24.024093+0000","last_undegraded":"2024-09-12T12:20:24.024093+0000","last_fullsized":"2024-09-12T12:20:24.024093+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:49.560912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.991823+0000","last_change":"2024-09-12T12:20:23.988741+0000","last_active":"2024-09-12T12:20:23.991823+0000","last_peered":"2024-09-12T12:20:23.991823+0000","last_clean":"2024-09-12T12:20:23.991823+0000","last_became_active":"2024-09-12T12:20:23.988354+0000","last_became_peered":"2024-09-12T12:20:23.988354+0000","last_unstale":"2024-09-12T12:20:23.991823+0000","last_undegraded":"2024-09-12T12:20:23.991823+0000","last_fullsized":"2024-09-12T12:20:23.991823+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:29.388202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.021144+0000","last_change":"2024-09-12T12:20:22.993708+0000","last_active":"2024-09-12T12:20:24.021144+0000","last_peered":"2024-09-12T12:20:24.021144+0000","last_clean":"2024-09-12T12:20:24.021144+0000","last_became_active":"2024-09-12T12:20:22.993421+0000","last_became_peered":"2024-09-12T12:20:22.993421+0000","last_unstale":"2024-09-12T12:20:24.021144+0000","last_undegraded":"2024-09-12T12:20:24.021144+0000","last_fullsized":"2024-09-12T12:20:24.021144+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:53.407032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008560+0000","last_change":"2024-09-12T12:20:24.006248+0000","last_active":"2024-09-12T12:20:24.008560+0000","last_peered":"2024-09-12T12:20:24.008560+0000","last_clean":"2024-09-12T12:20:24.008560+0000","last_became_active":"2024-09-12T12:20:24.005978+0000","last_became_peered":"2024-09-12T12:20:24.005978+0000","last_unstale":"2024-09-12T12:20:24.008560+0000","last_undegraded":"2024-09-12T12:20:24.008560+0000","last_fullsized":"2024-09-12T12:20:24.008560+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:36.596088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.023847+0000","last_change":"2024-09-12T12:20:23.005378+0000","last_active":"2024-09-12T12:20:24.023847+0000","last_peered":"2024-09-12T12:20:24.023847+0000","last_clean":"2024-09-12T12:20:24.023847+0000","last_became_active":"2024-09-12T12:20:23.005106+0000","last_became_peered":"2024-09-12T12:20:23.005106+0000","last_unstale":"2024-09-12T12:20:24.023847+0000","last_undegraded":"2024-09-12T12:20:24.023847+0000","last_fullsized":"2024-09-12T12:20:24.023847+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:21.963653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.014163+0000","last_change":"2024-09-12T12:20:24.010756+0000","last_active":"2024-09-12T12:20:24.014163+0000","last_peered":"2024-09-12T12:20:24.014163+0000","last_clean":"2024-09-12T12:20:24.014163+0000","last_became_active":"2024-09-12T12:20:24.010489+0000","last_became_peered":"2024-09-12T12:20:24.010489+0000","last_unstale":"2024-09-12T12:20:24.014163+0000","last_undegraded":"2024-09-12T12:20:24.014163+0000","last_fullsized":"2024-09-12T12:20:24.014163+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:50.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.995889+0000","last_change":"2024-09-12T12:20:22.995541+0000","last_active":"2024-09-12T12:20:23.995889+0000","last_peered":"2024-09-12T12:20:23.995889+0000","last_clean":"2024-09-12T12:20:23.995889+0000","last_became_active":"2024-09-12T12:20:22.995232+0000","last_became_peered":"2024-09-12T12:20:22.995232+0000","last_unstale":"2024-09-12T12:20:23.995889+0000","last_undegraded":"2024-09-12T12:20:23.995889+0000","last_fullsized":"2024-09-12T12:20:23.995889+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:56.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.013121+0000","last_change":"2024-09-12T12:20:24.011638+0000","last_active":"2024-09-12T12:20:24.013121+0000","last_peered":"2024-09-12T12:20:24.013121+0000","last_clean":"2024-09-12T12:20:24.013121+0000","last_became_active":"2024-09-12T12:20:24.011344+0000","last_became_peered":"2024-09-12T12:20:24.011344+0000","last_unstale":"2024-09-12T12:20:24.013121+0000","last_undegraded":"2024-09-12T12:20:24.013121+0000","last_fullsized":"2024-09-12T12:20:24.013121+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:21.717428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.990914+0000","last_change":"2024-09-12T12:20:23.007323+0000","last_active":"2024-09-12T12:20:23.990914+0000","last_peered":"2024-09-12T12:20:23.990914+0000","last_clean":"2024-09-12T12:20:23.990914+0000","last_became_active":"2024-09-12T12:20:23.002408+0000","last_became_peered":"2024-09-12T12:20:23.002408+0000","last_unstale":"2024-09-12T12:20:23.990914+0000","last_undegraded":"2024-09-12T12:20:23.990914+0000","last_fullsized":"2024-09-12T12:20:23.990914+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:49:27.568175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.012056+0000","last_change":"2024-09-12T12:20:24.006336+0000","last_active":"2024-09-12T12:20:24.012056+0000","last_peered":"2024-09-12T12:20:24.012056+0000","last_clean":"2024-09-12T12:20:24.012056+0000","last_became_active":"2024-09-12T12:20:24.005743+0000","last_became_peered":"2024-09-12T12:20:24.005743+0000","last_unstale":"2024-09-12T12:20:24.012056+0000","last_undegraded":"2024-09-12T12:20:24.012056+0000","last_fullsized":"2024-09-12T12:20:24.012056+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:39.047632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.983433+0000","last_change":"2024-09-12T12:20:23.005989+0000","last_active":"2024-09-12T12:20:23.983433+0000","last_peered":"2024-09-12T12:20:23.983433+0000","last_clean":"2024-09-12T12:20:23.983433+0000","last_became_active":"2024-09-12T12:20:23.005712+0000","last_became_peered":"2024-09-12T12:20:23.005712+0000","last_unstale":"2024-09-12T12:20:23.983433+0000","last_undegraded":"2024-09-12T12:20:23.983433+0000","last_fullsized":"2024-09-12T12:20:23.983433+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:08.388105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.006569+0000","last_change":"2024-09-12T12:20:24.005029+0000","last_active":"2024-09-12T12:20:24.006569+0000","last_peered":"2024-09-12T12:20:24.006569+0000","last_clean":"2024-09-12T12:20:24.006569+0000","last_became_active":"2024-09-12T12:20:24.004713+0000","last_became_peered":"2024-09-12T12:20:24.004713+0000","last_unstale":"2024-09-12T12:20:24.006569+0000","last_undegraded":"2024-09-12T12:20:24.006569+0000","last_fullsized":"2024-09-12T12:20:24.006569+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:39:15.198556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.998834+0000","last_change":"2024-09-12T12:20:23.003174+0000","last_active":"2024-09-12T12:20:23.998834+0000","last_peered":"2024-09-12T12:20:23.998834+0000","last_clean":"2024-09-12T12:20:23.998834+0000","last_became_active":"2024-09-12T12:20:23.002860+0000","last_became_peered":"2024-09-12T12:20:23.002860+0000","last_unstale":"2024-09-12T12:20:23.998834+0000","last_undegraded":"2024-09-12T12:20:23.998834+0000","last_fullsized":"2024-09-12T12:20:23.998834+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:20.710458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020004+0000","last_change":"2024-09-12T12:20:24.016965+0000","last_active":"2024-09-12T12:20:24.020004+0000","last_peered":"2024-09-12T12:20:24.020004+0000","last_clean":"2024-09-12T12:20:24.020004+0000","last_became_active":"2024-09-12T12:20:24.016684+0000","last_became_peered":"2024-09-12T12:20:24.016684+0000","last_unstale":"2024-09-12T12:20:24.020004+0000","last_undegraded":"2024-09-12T12:20:24.020004+0000","last_fullsized":"2024-09-12T12:20:24.020004+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:21.809231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"128'3","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.023865+0000","last_change":"2024-09-12T12:20:22.998687+0000","last_active":"2024-09-12T12:20:24.023865+0000","last_peered":"2024-09-12T12:20:24.023865+0000","last_clean":"2024-09-12T12:20:24.023865+0000","last_became_active":"2024-09-12T12:20:22.998384+0000","last_became_peered":"2024-09-12T12:20:22.998384+0000","last_unstale":"2024-09-12T12:20:24.023865+0000","last_undegraded":"2024-09-12T12:20:24.023865+0000","last_fullsized":"2024-09-12T12:20:24.023865+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:06.289099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010319+0000","last_change":"2024-09-12T12:20:24.008200+0000","last_active":"2024-09-12T12:20:24.010319+0000","last_peered":"2024-09-12T12:20:24.010319+0000","last_clean":"2024-09-12T12:20:24.010319+0000","last_became_active":"2024-09-12T12:20:24.007873+0000","last_became_peered":"2024-09-12T12:20:24.007873+0000","last_unstale":"2024-09-12T12:20:24.010319+0000","last_undegraded":"2024-09-12T12:20:24.010319+0000","last_fullsized":"2024-09-12T12:20:24.010319+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:21.455714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"128'6","reported_seq":18,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.028041+0000","last_change":"2024-09-12T12:20:23.007167+0000","last_active":"2024-09-12T12:20:24.028041+0000","last_peered":"2024-09-12T12:20:24.028041+0000","last_clean":"2024-09-12T12:20:24.028041+0000","last_became_active":"2024-09-12T12:20:23.006882+0000","last_became_peered":"2024-09-12T12:20:23.006882+0000","last_unstale":"2024-09-12T12:20:24.028041+0000","last_undegraded":"2024-09-12T12:20:24.028041+0000","last_fullsized":"2024-09-12T12:20:24.028041+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:02.482524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010662+0000","last_change":"2024-09-12T12:20:24.004967+0000","last_active":"2024-09-12T12:20:24.010662+0000","last_peered":"2024-09-12T12:20:24.010662+0000","last_clean":"2024-09-12T12:20:24.010662+0000","last_became_active":"2024-09-12T12:20:24.004697+0000","last_became_peered":"2024-09-12T12:20:24.004697+0000","last_unstale":"2024-09-12T12:20:24.010662+0000","last_undegraded":"2024-09-12T12:20:24.010662+0000","last_fullsized":"2024-09-12T12:20:24.010662+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:04:36.698463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.025941+0000","last_change":"2024-09-12T12:20:23.004333+0000","last_active":"2024-09-12T12:20:24.025941+0000","last_peered":"2024-09-12T12:20:24.025941+0000","last_clean":"2024-09-12T12:20:24.025941+0000","last_became_active":"2024-09-12T12:20:23.004050+0000","last_became_peered":"2024-09-12T12:20:23.004050+0000","last_unstale":"2024-09-12T12:20:24.025941+0000","last_undegraded":"2024-09-12T12:20:24.025941+0000","last_fullsized":"2024-09-12T12:20:24.025941+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:24.405992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.003644+0000","last_change":"2024-09-12T12:20:24.002180+0000","last_active":"2024-09-12T12:20:24.003644+0000","last_peered":"2024-09-12T12:20:24.003644+0000","last_clean":"2024-09-12T12:20:24.003644+0000","last_became_active":"2024-09-12T12:20:24.001897+0000","last_became_peered":"2024-09-12T12:20:24.001897+0000","last_unstale":"2024-09-12T12:20:24.003644+0000","last_undegraded":"2024-09-12T12:20:24.003644+0000","last_fullsized":"2024-09-12T12:20:24.003644+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.808361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.009380+0000","last_change":"2024-09-12T12:20:23.007690+0000","last_active":"2024-09-12T12:20:24.009380+0000","last_peered":"2024-09-12T12:20:24.009380+0000","last_clean":"2024-09-12T12:20:24.009380+0000","last_became_active":"2024-09-12T12:20:23.006237+0000","last_became_peered":"2024-09-12T12:20:23.006237+0000","last_unstale":"2024-09-12T12:20:24.009380+0000","last_undegraded":"2024-09-12T12:20:24.009380+0000","last_fullsized":"2024-09-12T12:20:24.009380+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:26.006120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010640+0000","last_change":"2024-09-12T12:20:24.008026+0000","last_active":"2024-09-12T12:20:24.010640+0000","last_peered":"2024-09-12T12:20:24.010640+0000","last_clean":"2024-09-12T12:20:24.010640+0000","last_became_active":"2024-09-12T12:20:24.007209+0000","last_became_peered":"2024-09-12T12:20:24.007209+0000","last_unstale":"2024-09-12T12:20:24.010640+0000","last_undegraded":"2024-09-12T12:20:24.010640+0000","last_fullsized":"2024-09-12T12:20:24.010640+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:52.047887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008526+0000","last_change":"2024-09-12T12:20:23.007660+0000","last_active":"2024-09-12T12:20:24.008526+0000","last_peered":"2024-09-12T12:20:24.008526+0000","last_clean":"2024-09-12T12:20:24.008526+0000","last_became_active":"2024-09-12T12:20:23.007378+0000","last_became_peered":"2024-09-12T12:20:23.007378+0000","last_unstale":"2024-09-12T12:20:24.008526+0000","last_undegraded":"2024-09-12T12:20:24.008526+0000","last_fullsized":"2024-09-12T12:20:24.008526+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:11:27.565007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.999869+0000","last_change":"2024-09-12T12:20:23.996807+0000","last_active":"2024-09-12T12:20:23.999869+0000","last_peered":"2024-09-12T12:20:23.999869+0000","last_clean":"2024-09-12T12:20:23.999869+0000","last_became_active":"2024-09-12T12:20:23.996538+0000","last_became_peered":"2024-09-12T12:20:23.996538+0000","last_unstale":"2024-09-12T12:20:23.999869+0000","last_undegraded":"2024-09-12T12:20:23.999869+0000","last_fullsized":"2024-09-12T12:20:23.999869+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.310467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.024517+0000","last_change":"2024-09-12T12:20:23.001746+0000","last_active":"2024-09-12T12:20:24.024517+0000","last_peered":"2024-09-12T12:20:24.024517+0000","last_clean":"2024-09-12T12:20:24.024517+0000","last_became_active":"2024-09-12T12:20:22.997873+0000","last_became_peered":"2024-09-12T12:20:22.997873+0000","last_unstale":"2024-09-12T12:20:24.024517+0000","last_undegraded":"2024-09-12T12:20:24.024517+0000","last_fullsized":"2024-09-12T12:20:24.024517+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:53.407032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.004590+0000","last_change":"2024-09-12T12:20:24.002685+0000","last_active":"2024-09-12T12:20:24.004590+0000","last_peered":"2024-09-12T12:20:24.004590+0000","last_clean":"2024-09-12T12:20:24.004590+0000","last_became_active":"2024-09-12T12:20:24.002391+0000","last_became_peered":"2024-09-12T12:20:24.002391+0000","last_unstale":"2024-09-12T12:20:24.004590+0000","last_undegraded":"2024-09-12T12:20:24.004590+0000","last_fullsized":"2024-09-12T12:20:24.004590+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.367347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.018199+0000","last_change":"2024-09-12T12:20:23.011465+0000","last_active":"2024-09-12T12:20:24.018199+0000","last_peered":"2024-09-12T12:20:24.018199+0000","last_clean":"2024-09-12T12:20:24.018199+0000","last_became_active":"2024-09-12T12:20:23.010683+0000","last_became_peered":"2024-09-12T12:20:23.010683+0000","last_unstale":"2024-09-12T12:20:24.018199+0000","last_undegraded":"2024-09-12T12:20:24.018199+0000","last_fullsized":"2024-09-12T12:20:24.018199+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:34.385980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.017840+0000","last_change":"2024-09-12T12:20:24.016400+0000","last_active":"2024-09-12T12:20:24.017840+0000","last_peered":"2024-09-12T12:20:24.017840+0000","last_clean":"2024-09-12T12:20:24.017840+0000","last_became_active":"2024-09-12T12:20:24.016140+0000","last_became_peered":"2024-09-12T12:20:24.016140+0000","last_unstale":"2024-09-12T12:20:24.017840+0000","last_undegraded":"2024-09-12T12:20:24.017840+0000","last_fullsized":"2024-09-12T12:20:24.017840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:22.612658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.022744+0000","last_change":"2024-09-12T12:20:23.000845+0000","last_active":"2024-09-12T12:20:24.022744+0000","last_peered":"2024-09-12T12:20:24.022744+0000","last_clean":"2024-09-12T12:20:24.022744+0000","last_became_active":"2024-09-12T12:20:23.000341+0000","last_became_peered":"2024-09-12T12:20:23.000341+0000","last_unstale":"2024-09-12T12:20:24.022744+0000","last_undegraded":"2024-09-12T12:20:24.022744+0000","last_fullsized":"2024-09-12T12:20:24.022744+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:58.891063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.999515+0000","last_change":"2024-09-12T12:20:23.997927+0000","last_active":"2024-09-12T12:20:23.999515+0000","last_peered":"2024-09-12T12:20:23.999515+0000","last_clean":"2024-09-12T12:20:23.999515+0000","last_became_active":"2024-09-12T12:20:23.997655+0000","last_became_peered":"2024-09-12T12:20:23.997655+0000","last_unstale":"2024-09-12T12:20:23.999515+0000","last_undegraded":"2024-09-12T12:20:23.999515+0000","last_fullsized":"2024-09-12T12:20:23.999515+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.636997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.994084+0000","last_change":"2024-09-12T12:20:23.008068+0000","last_active":"2024-09-12T12:20:23.994084+0000","last_peered":"2024-09-12T12:20:23.994084+0000","last_clean":"2024-09-12T12:20:23.994084+0000","last_became_active":"2024-09-12T12:20:23.007727+0000","last_became_peered":"2024-09-12T12:20:23.007727+0000","last_unstale":"2024-09-12T12:20:23.994084+0000","last_undegraded":"2024-09-12T12:20:23.994084+0000","last_fullsized":"2024-09-12T12:20:23.994084+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:20.448744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.014629+0000","last_change":"2024-09-12T12:20:24.012340+0000","last_active":"2024-09-12T12:20:24.014629+0000","last_peered":"2024-09-12T12:20:24.014629+0000","last_clean":"2024-09-12T12:20:24.014629+0000","last_became_active":"2024-09-12T12:20:24.011844+0000","last_became_peered":"2024-09-12T12:20:24.011844+0000","last_unstale":"2024-09-12T12:20:24.014629+0000","last_undegraded":"2024-09-12T12:20:24.014629+0000","last_fullsized":"2024-09-12T12:20:24.014629+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:08.207987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.024959+0000","last_change":"2024-09-12T12:20:23.000887+0000","last_active":"2024-09-12T12:20:24.024959+0000","last_peered":"2024-09-12T12:20:24.024959+0000","last_clean":"2024-09-12T12:20:24.024959+0000","last_became_active":"2024-09-12T12:20:23.000587+0000","last_became_peered":"2024-09-12T12:20:23.000587+0000","last_unstale":"2024-09-12T12:20:24.024959+0000","last_undegraded":"2024-09-12T12:20:24.024959+0000","last_fullsized":"2024-09-12T12:20:24.024959+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:49.436590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.015846+0000","last_change":"2024-09-12T12:20:24.014210+0000","last_active":"2024-09-12T12:20:24.015846+0000","last_peered":"2024-09-12T12:20:24.015846+0000","last_clean":"2024-09-12T12:20:24.015846+0000","last_became_active":"2024-09-12T12:20:24.013813+0000","last_became_peered":"2024-09-12T12:20:24.013813+0000","last_unstale":"2024-09-12T12:20:24.015846+0000","last_undegraded":"2024-09-12T12:20:24.015846+0000","last_fullsized":"2024-09-12T12:20:24.015846+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:39.041573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992746+0000","last_change":"2024-09-12T12:20:23.000600+0000","last_active":"2024-09-12T12:20:23.992746+0000","last_peered":"2024-09-12T12:20:23.992746+0000","last_clean":"2024-09-12T12:20:23.992746+0000","last_became_active":"2024-09-12T12:20:22.999999+0000","last_became_peered":"2024-09-12T12:20:22.999999+0000","last_unstale":"2024-09-12T12:20:23.992746+0000","last_undegraded":"2024-09-12T12:20:23.992746+0000","last_fullsized":"2024-09-12T12:20:23.992746+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:17.865340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.018850+0000","last_change":"2024-09-12T12:20:24.015007+0000","last_active":"2024-09-12T12:20:24.018850+0000","last_peered":"2024-09-12T12:20:24.018850+0000","last_clean":"2024-09-12T12:20:24.018850+0000","last_became_active":"2024-09-12T12:20:24.013399+0000","last_became_peered":"2024-09-12T12:20:24.013399+0000","last_unstale":"2024-09-12T12:20:24.018850+0000","last_undegraded":"2024-09-12T12:20:24.018850+0000","last_fullsized":"2024-09-12T12:20:24.018850+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:34.946428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008715+0000","last_change":"2024-09-12T12:20:23.010809+0000","last_active":"2024-09-12T12:20:24.008715+0000","last_peered":"2024-09-12T12:20:24.008715+0000","last_clean":"2024-09-12T12:20:24.008715+0000","last_became_active":"2024-09-12T12:20:23.010477+0000","last_became_peered":"2024-09-12T12:20:23.010477+0000","last_unstale":"2024-09-12T12:20:24.008715+0000","last_undegraded":"2024-09-12T12:20:24.008715+0000","last_fullsized":"2024-09-12T12:20:24.008715+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:52:09.565876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.001302+0000","last_change":"2024-09-12T12:20:23.998719+0000","last_active":"2024-09-12T12:20:24.001302+0000","last_peered":"2024-09-12T12:20:24.001302+0000","last_clean":"2024-09-12T12:20:24.001302+0000","last_became_active":"2024-09-12T12:20:23.998113+0000","last_became_peered":"2024-09-12T12:20:23.998113+0000","last_unstale":"2024-09-12T12:20:24.001302+0000","last_undegraded":"2024-09-12T12:20:24.001302+0000","last_fullsized":"2024-09-12T12:20:24.001302+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.808361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992652+0000","last_change":"2024-09-12T12:20:23.005527+0000","last_active":"2024-09-12T12:20:23.992652+0000","last_peered":"2024-09-12T12:20:23.992652+0000","last_clean":"2024-09-12T12:20:23.992652+0000","last_became_active":"2024-09-12T12:20:23.004505+0000","last_became_peered":"2024-09-12T12:20:23.004505+0000","last_unstale":"2024-09-12T12:20:23.992652+0000","last_undegraded":"2024-09-12T12:20:23.992652+0000","last_fullsized":"2024-09-12T12:20:23.992652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:20.710458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.001338+0000","last_change":"2024-09-12T12:20:23.996734+0000","last_active":"2024-09-12T12:20:24.001338+0000","last_peered":"2024-09-12T12:20:24.001338+0000","last_clean":"2024-09-12T12:20:24.001338+0000","last_became_active":"2024-09-12T12:20:23.995841+0000","last_became_peered":"2024-09-12T12:20:23.995841+0000","last_unstale":"2024-09-12T12:20:24.001338+0000","last_undegraded":"2024-09-12T12:20:24.001338+0000","last_fullsized":"2024-09-12T12:20:24.001338+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:46:52.114062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.025757+0000","last_change":"2024-09-12T12:20:23.003872+0000","last_active":"2024-09-12T12:20:24.025757+0000","last_peered":"2024-09-12T12:20:24.025757+0000","last_clean":"2024-09-12T12:20:24.025757+0000","last_became_active":"2024-09-12T12:20:23.003450+0000","last_became_peered":"2024-09-12T12:20:23.003450+0000","last_unstale":"2024-09-12T12:20:24.025757+0000","last_undegraded":"2024-09-12T12:20:24.025757+0000","last_fullsized":"2024-09-12T12:20:24.025757+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:47.061478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992289+0000","last_change":"2024-09-12T12:20:23.990461+0000","last_active":"2024-09-12T12:20:23.992289+0000","last_peered":"2024-09-12T12:20:23.992289+0000","last_clean":"2024-09-12T12:20:23.992289+0000","last_became_active":"2024-09-12T12:20:23.990187+0000","last_became_peered":"2024-09-12T12:20:23.990187+0000","last_unstale":"2024-09-12T12:20:23.992289+0000","last_undegraded":"2024-09-12T12:20:23.992289+0000","last_fullsized":"2024-09-12T12:20:23.992289+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.884993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.983076+0000","last_change":"2024-09-12T12:20:23.004829+0000","last_active":"2024-09-12T12:20:23.983076+0000","last_peered":"2024-09-12T12:20:23.983076+0000","last_clean":"2024-09-12T12:20:23.983076+0000","last_became_active":"2024-09-12T12:20:23.004562+0000","last_became_peered":"2024-09-12T12:20:23.004562+0000","last_unstale":"2024-09-12T12:20:23.983076+0000","last_undegraded":"2024-09-12T12:20:23.983076+0000","last_fullsized":"2024-09-12T12:20:23.983076+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:40.728145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.017712+0000","last_change":"2024-09-12T12:20:24.014457+0000","last_active":"2024-09-12T12:20:24.017712+0000","last_peered":"2024-09-12T12:20:24.017712+0000","last_clean":"2024-09-12T12:20:24.017712+0000","last_became_active":"2024-09-12T12:20:24.012890+0000","last_became_peered":"2024-09-12T12:20:24.012890+0000","last_unstale":"2024-09-12T12:20:24.017712+0000","last_undegraded":"2024-09-12T12:20:24.017712+0000","last_fullsized":"2024-09-12T12:20:24.017712+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.594553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.983573+0000","last_change":"2024-09-12T12:20:23.006047+0000","last_active":"2024-09-12T12:20:23.983573+0000","last_peered":"2024-09-12T12:20:23.983573+0000","last_clean":"2024-09-12T12:20:23.983573+0000","last_became_active":"2024-09-12T12:20:23.005657+0000","last_became_peered":"2024-09-12T12:20:23.005657+0000","last_unstale":"2024-09-12T12:20:23.983573+0000","last_undegraded":"2024-09-12T12:20:23.983573+0000","last_fullsized":"2024-09-12T12:20:23.983573+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:22.510834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.003077+0000","last_change":"2024-09-12T12:20:23.999841+0000","last_active":"2024-09-12T12:20:24.003077+0000","last_peered":"2024-09-12T12:20:24.003077+0000","last_clean":"2024-09-12T12:20:24.003077+0000","last_became_active":"2024-09-12T12:20:23.999536+0000","last_became_peered":"2024-09-12T12:20:23.999536+0000","last_unstale":"2024-09-12T12:20:24.003077+0000","last_undegraded":"2024-09-12T12:20:24.003077+0000","last_fullsized":"2024-09-12T12:20:24.003077+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:08.308384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.991459+0000","last_change":"2024-09-12T12:20:23.005838+0000","last_active":"2024-09-12T12:20:23.991459+0000","last_peered":"2024-09-12T12:20:23.991459+0000","last_clean":"2024-09-12T12:20:23.991459+0000","last_became_active":"2024-09-12T12:20:23.005411+0000","last_became_peered":"2024-09-12T12:20:23.005411+0000","last_unstale":"2024-09-12T12:20:23.991459+0000","last_undegraded":"2024-09-12T12:20:23.991459+0000","last_fullsized":"2024-09-12T12:20:23.991459+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:33.309971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008781+0000","last_change":"2024-09-12T12:20:24.000348+0000","last_active":"2024-09-12T12:20:24.008781+0000","last_peered":"2024-09-12T12:20:24.008781+0000","last_clean":"2024-09-12T12:20:24.008781+0000","last_became_active":"2024-09-12T12:20:23.998686+0000","last_became_peered":"2024-09-12T12:20:23.998686+0000","last_unstale":"2024-09-12T12:20:24.008781+0000","last_undegraded":"2024-09-12T12:20:24.008781+0000","last_fullsized":"2024-09-12T12:20:24.008781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:54.559548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.984993+0000","last_change":"2024-09-12T12:20:22.997359+0000","last_active":"2024-09-12T12:20:23.984993+0000","last_peered":"2024-09-12T12:20:23.984993+0000","last_clean":"2024-09-12T12:20:23.984993+0000","last_became_active":"2024-09-12T12:20:22.996699+0000","last_became_peered":"2024-09-12T12:20:22.996699+0000","last_unstale":"2024-09-12T12:20:23.984993+0000","last_undegraded":"2024-09-12T12:20:23.984993+0000","last_fullsized":"2024-09-12T12:20:23.984993+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:45.786045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.019507+0000","last_change":"2024-09-12T12:20:24.015719+0000","last_active":"2024-09-12T12:20:24.019507+0000","last_peered":"2024-09-12T12:20:24.019507+0000","last_clean":"2024-09-12T12:20:24.019507+0000","last_became_active":"2024-09-12T12:20:24.015470+0000","last_became_peered":"2024-09-12T12:20:24.015470+0000","last_unstale":"2024-09-12T12:20:24.019507+0000","last_undegraded":"2024-09-12T12:20:24.019507+0000","last_fullsized":"2024-09-12T12:20:24.019507+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:19.904491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.985242+0000","last_change":"2024-09-12T12:20:22.991226+0000","last_active":"2024-09-12T12:20:23.985242+0000","last_peered":"2024-09-12T12:20:23.985242+0000","last_clean":"2024-09-12T12:20:23.985242+0000","last_became_active":"2024-09-12T12:20:22.990954+0000","last_became_peered":"2024-09-12T12:20:22.990954+0000","last_unstale":"2024-09-12T12:20:23.985242+0000","last_undegraded":"2024-09-12T12:20:23.985242+0000","last_fullsized":"2024-09-12T12:20:23.985242+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:28.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.013153+0000","last_change":"2024-09-12T12:20:24.001289+0000","last_active":"2024-09-12T12:20:24.013153+0000","last_peered":"2024-09-12T12:20:24.013153+0000","last_clean":"2024-09-12T12:20:24.013153+0000","last_became_active":"2024-09-12T12:20:24.000972+0000","last_became_peered":"2024-09-12T12:20:24.000972+0000","last_unstale":"2024-09-12T12:20:24.013153+0000","last_undegraded":"2024-09-12T12:20:24.013153+0000","last_fullsized":"2024-09-12T12:20:24.013153+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:41.735115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.990457+0000","last_change":"2024-09-12T12:20:22.996191+0000","last_active":"2024-09-12T12:20:23.990457+0000","last_peered":"2024-09-12T12:20:23.990457+0000","last_clean":"2024-09-12T12:20:23.990457+0000","last_became_active":"2024-09-12T12:20:22.995734+0000","last_became_peered":"2024-09-12T12:20:22.995734+0000","last_unstale":"2024-09-12T12:20:23.990457+0000","last_undegraded":"2024-09-12T12:20:23.990457+0000","last_fullsized":"2024-09-12T12:20:23.990457+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:45.704581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.003446+0000","last_change":"2024-09-12T12:20:24.001475+0000","last_active":"2024-09-12T12:20:24.003446+0000","last_peered":"2024-09-12T12:20:24.003446+0000","last_clean":"2024-09-12T12:20:24.003446+0000","last_became_active":"2024-09-12T12:20:24.001192+0000","last_became_peered":"2024-09-12T12:20:24.001192+0000","last_unstale":"2024-09-12T12:20:24.003446+0000","last_undegraded":"2024-09-12T12:20:24.003446+0000","last_fullsized":"2024-09-12T12:20:24.003446+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:36.596088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992831+0000","last_change":"2024-09-12T12:20:23.000084+0000","last_active":"2024-09-12T12:20:23.992831+0000","last_peered":"2024-09-12T12:20:23.992831+0000","last_clean":"2024-09-12T12:20:23.992831+0000","last_became_active":"2024-09-12T12:20:22.999735+0000","last_became_peered":"2024-09-12T12:20:22.999735+0000","last_unstale":"2024-09-12T12:20:23.992831+0000","last_undegraded":"2024-09-12T12:20:23.992831+0000","last_fullsized":"2024-09-12T12:20:23.992831+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:39:14.191586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.016526+0000","last_change":"2024-09-12T12:20:24.008931+0000","last_active":"2024-09-12T12:20:24.016526+0000","last_peered":"2024-09-12T12:20:24.016526+0000","last_clean":"2024-09-12T12:20:24.016526+0000","last_became_active":"2024-09-12T12:20:24.007601+0000","last_became_peered":"2024-09-12T12:20:24.007601+0000","last_unstale":"2024-09-12T12:20:24.016526+0000","last_undegraded":"2024-09-12T12:20:24.016526+0000","last_fullsized":"2024-09-12T12:20:24.016526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:23.517804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"128'8","reported_seq":20,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.026366+0000","last_change":"2024-09-12T12:20:23.006167+0000","last_active":"2024-09-12T12:20:24.026366+0000","last_peered":"2024-09-12T12:20:24.026366+0000","last_clean":"2024-09-12T12:20:24.026366+0000","last_became_active":"2024-09-12T12:20:23.005700+0000","last_became_peered":"2024-09-12T12:20:23.005700+0000","last_unstale":"2024-09-12T12:20:24.026366+0000","last_undegraded":"2024-09-12T12:20:24.026366+0000","last_fullsized":"2024-09-12T12:20:24.026366+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:19.585354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":365,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992986+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:20:23.992986+0000","last_peered":"2024-09-12T12:20:23.992986+0000","last_clean":"2024-09-12T12:20:23.992986+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:20:23.992986+0000","last_undegraded":"2024-09-12T12:20:23.992986+0000","last_fullsized":"2024-09-12T12:20:23.992986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41660,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330180,"statfs":{"total":96636764160,"available":96594104320,"internally_reserved":0,"allocated":2203648,"data_stored":1341726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46620,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325220,"statfs":{"total":96636764160,"available":96589025280,"internally_reserved":0,"allocated":1581056,"data_stored":743415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59124,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312716,"statfs":{"total":96636764160,"available":96576221184,"internally_reserved":0,"allocated":1601536,"data_stored":750742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50784,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1581056,"data_stored":743415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50812,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321028,"statfs":{"total":96636764160,"available":96584732672,"internally_reserved":0,"allocated":1609728,"data_stored":752228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50784,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1581056,"data_stored":743415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1597440,"data_stored":750604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51376,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320464,"statfs":{"total":96636764160,"available":96584155136,"internally_reserved":0,"allocated":2191360,"data_stored":1340972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:20:28.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:20:28.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.476+0000 7f6f4d200640 1 Processor -- start 2024-09-12T12:20:28.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.476+0000 7f6f4d200640 1 -- start start 2024-09-12T12:20:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f4d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6f48071420 0x7f6f48071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f4d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f480ccf30 0x7f6f480cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f4d200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f480b45a0 con 0x7f6f4815b4e0 2024-09-12T12:20:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f4d200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6f480cd8e0 con 0x7f6f48071420 2024-09-12T12:20:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f4d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6f480b3fe0 con 0x7f6f480ccf30 2024-09-12T12:20:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f45e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6f4815b4e0 0x7f6f480b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35792/0 (socket says 172.21.15.144:35792) 2024-09-12T12:20:28.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f45e00640 1 -- 172.21.15.144:0/1530558167 learned_addr learned my addr 172.21.15.144:0/1530558167 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:28.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f46800640 1 --2- 172.21.15.144:0/1530558167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f480ccf30 0x7f6f480cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f45400640 1 --2- 172.21.15.144:0/1530558167 >> v2:172.21.15.165:3300/0 conn(0x7f6f48071420 0x7f6f48071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f44a00640 1 -- 172.21.15.144:0/1530558167 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315641229 0 0) 0x7f6f480b45a0 con 0x7f6f4815b4e0 2024-09-12T12:20:28.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f44a00640 1 -- 172.21.15.144:0/1530558167 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f2c003530 con 0x7f6f4815b4e0 2024-09-12T12:20:28.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f46800640 1 -- 172.21.15.144:0/1530558167 >> v2:172.21.15.165:3300/0 conn(0x7f6f48071420 msgr2=0x7f6f48071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:28.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f46800640 1 --2- 172.21.15.144:0/1530558167 >> v2:172.21.15.165:3300/0 conn(0x7f6f48071420 0x7f6f48071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f46800640 1 -- 172.21.15.144:0/1530558167 >> v1:172.21.15.144:6789/0 conn(0x7f6f4815b4e0 legacy=0x7f6f480b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.480+0000 7f6f46800640 1 -- 172.21.15.144:0/1530558167 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f480b42c0 con 0x7f6f480ccf30 2024-09-12T12:20:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f46800640 1 --2- 172.21.15.144:0/1530558167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f480ccf30 0x7f6f480cd3a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009d90 tx=0x7f6f4001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed5ac63d8fb28be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f44a00640 1 -- 172.21.15.144:0/1530558167 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f400b2070 con 0x7f6f480ccf30 2024-09-12T12:20:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f44a00640 1 -- 172.21.15.144:0/1530558167 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f400a5a00 con 0x7f6f480ccf30 2024-09-12T12:20:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f44a00640 1 -- 172.21.15.144:0/1530558167 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f400a5db0 con 0x7f6f480ccf30 2024-09-12T12:20:28.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 -- 172.21.15.144:0/1530558167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f480ccf30 msgr2=0x7f6f480cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 --2- 172.21.15.144:0/1530558167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f480ccf30 0x7f6f480cd3a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009d90 tx=0x7f6f4001c940 comp rx=0 tx=0).stop 2024-09-12T12:20:28.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 -- 172.21.15.144:0/1530558167 shutdown_connections 2024-09-12T12:20:28.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 --2- 172.21.15.144:0/1530558167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f480ccf30 0x7f6f480cd3a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 --2- 172.21.15.144:0/1530558167 >> v2:172.21.15.165:3300/0 conn(0x7f6f48071420 0x7f6f48071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 -- 172.21.15.144:0/1530558167 >> 172.21.15.144:0/1530558167 conn(0x7f6f4806d0d0 msgr2=0x7f6f4806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:28.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 -- 172.21.15.144:0/1530558167 shutdown_connections 2024-09-12T12:20:28.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 -- 172.21.15.144:0/1530558167 wait complete. 2024-09-12T12:20:28.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 Processor -- start 2024-09-12T12:20:28.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.484+0000 7f6f4d200640 1 -- start start 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f4d200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f48071420 0x7f6f480ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f4d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f480ccf30 0x7f6f48154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f4d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f4815b4e0 0x7f6f48152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f4d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4815b8c0 con 0x7f6f480ccf30 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f4d200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480cdef0 con 0x7f6f48071420 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f4d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6f48166050 con 0x7f6f4815b4e0 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f480ccf30 0x7f6f48154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f480ccf30 0x7f6f48154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46820/0 (socket says 172.21.15.144:46820) 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45400640 1 -- 172.21.15.144:0/2964907291 learned_addr learned my addr 172.21.15.144:0/2964907291 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45e00640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f48071420 0x7f6f480ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f46800640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f4815b4e0 0x7f6f48152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45400640 1 -- 172.21.15.144:0/2964907291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f4815b4e0 msgr2=0x7f6f48152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45400640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f4815b4e0 0x7f6f48152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45400640 1 -- 172.21.15.144:0/2964907291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f48071420 msgr2=0x7f6f480ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45400640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f48071420 0x7f6f480ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45400640 1 -- 172.21.15.144:0/2964907291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f480adca0 con 0x7f6f480ccf30 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f45400640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f480ccf30 0x7f6f48154ad0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400e930 tx=0x7f6f3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f3e000640 1 -- 172.21.15.144:0/2964907291 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34017070 con 0x7f6f480ccf30 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f3e000640 1 -- 172.21.15.144:0/2964907291 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3400ca00 con 0x7f6f480ccf30 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f3e000640 1 -- 172.21.15.144:0/2964907291 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3400cdb0 con 0x7f6f480ccf30 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f48165a90 con 0x7f6f480ccf30 2024-09-12T12:20:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f481561c0 con 0x7f6f480ccf30 2024-09-12T12:20:28.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f48071840 con 0x7f6f480ccf30 2024-09-12T12:20:28.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.488+0000 7f6f3e000640 1 -- 172.21.15.144:0/2964907291 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f3401a070 con 0x7f6f480ccf30 2024-09-12T12:20:28.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.492+0000 7f6f3e000640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6f280678f0 0x7f6f28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.492+0000 7f6f3e000640 1 -- 172.21.15.144:0/2964907291 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f6f34085dd0 con 0x7f6f480ccf30 2024-09-12T12:20:28.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.492+0000 7f6f45e00640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6f280678f0 0x7f6f28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.492+0000 7f6f45e00640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6f280678f0 0x7f6f28069db0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001210 tx=0x7f6f38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:28.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.496+0000 7f6f3e000640 1 -- 172.21.15.144:0/2964907291 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6f340568d0 con 0x7f6f480ccf30 2024-09-12T12:20:28.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.652+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f480b51d0 con 0x7f6f280678f0 2024-09-12T12:20:28.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.656+0000 7f6f3e000640 1 -- 172.21.15.144:0/2964907291 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252415 (secure 0 0 0) 0x7f6f480b51d0 con 0x7f6f280678f0 2024-09-12T12:20:28.659 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:20:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6f280678f0 msgr2=0x7f6f28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6f280678f0 0x7f6f28069db0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001210 tx=0x7f6f38009040 comp rx=0 tx=0).stop 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f480ccf30 msgr2=0x7f6f48154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f480ccf30 0x7f6f48154ad0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400e930 tx=0x7f6f3400edf0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 shutdown_connections 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6f280678f0 0x7f6f28069db0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f4815b4e0 0x7f6f48152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f480ccf30 0x7f6f48154ad0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 --2- 172.21.15.144:0/2964907291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f48071420 0x7f6f480ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 >> 172.21.15.144:0/2964907291 conn(0x7f6f4806d0d0 msgr2=0x7f6f480b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 shutdown_connections 2024-09-12T12:20:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.660+0000 7f6f4d200640 1 -- 172.21.15.144:0/2964907291 wait complete. 2024-09-12T12:20:28.679 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-09-12T12:20:27.475334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":401964,"kb_used_data":13620,"kb_used_omap":12,"kb_used_meta":388147,"kb_avail":754572756,"statfs":{"total":773094113280,"available":772682502144,"internally_reserved":0,"allocated":13946880,"data_stored":7166517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":397463089},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.507115"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.991176+0000","last_change":"2024-09-12T12:20:23.990124+0000","last_active":"2024-09-12T12:20:23.991176+0000","last_peered":"2024-09-12T12:20:23.991176+0000","last_clean":"2024-09-12T12:20:23.991176+0000","last_became_active":"2024-09-12T12:20:23.989829+0000","last_became_peered":"2024-09-12T12:20:23.989829+0000","last_unstale":"2024-09-12T12:20:23.991176+0000","last_undegraded":"2024-09-12T12:20:23.991176+0000","last_fullsized":"2024-09-12T12:20:23.991176+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:07.296069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020128+0000","last_change":"2024-09-12T12:20:24.017243+0000","last_active":"2024-09-12T12:20:24.020128+0000","last_peered":"2024-09-12T12:20:24.020128+0000","last_clean":"2024-09-12T12:20:24.020128+0000","last_became_active":"2024-09-12T12:20:24.017012+0000","last_became_peered":"2024-09-12T12:20:24.017012+0000","last_unstale":"2024-09-12T12:20:24.020128+0000","last_undegraded":"2024-09-12T12:20:24.020128+0000","last_fullsized":"2024-09-12T12:20:24.020128+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:27:38.672150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.014358+0000","last_change":"2024-09-12T12:20:24.013541+0000","last_active":"2024-09-12T12:20:24.014358+0000","last_peered":"2024-09-12T12:20:24.014358+0000","last_clean":"2024-09-12T12:20:24.014358+0000","last_became_active":"2024-09-12T12:20:24.012905+0000","last_became_peered":"2024-09-12T12:20:24.012905+0000","last_unstale":"2024-09-12T12:20:24.014358+0000","last_undegraded":"2024-09-12T12:20:24.014358+0000","last_fullsized":"2024-09-12T12:20:24.014358+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:24.571001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.017710+0000","last_change":"2024-09-12T12:20:24.014534+0000","last_active":"2024-09-12T12:20:24.017710+0000","last_peered":"2024-09-12T12:20:24.017710+0000","last_clean":"2024-09-12T12:20:24.017710+0000","last_became_active":"2024-09-12T12:20:24.013035+0000","last_became_peered":"2024-09-12T12:20:24.013035+0000","last_unstale":"2024-09-12T12:20:24.017710+0000","last_undegraded":"2024-09-12T12:20:24.017710+0000","last_fullsized":"2024-09-12T12:20:24.017710+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:04:36.698463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.987925+0000","last_change":"2024-09-12T12:20:23.987042+0000","last_active":"2024-09-12T12:20:23.987925+0000","last_peered":"2024-09-12T12:20:23.987925+0000","last_clean":"2024-09-12T12:20:23.987925+0000","last_became_active":"2024-09-12T12:20:23.986735+0000","last_became_peered":"2024-09-12T12:20:23.986735+0000","last_unstale":"2024-09-12T12:20:23.987925+0000","last_undegraded":"2024-09-12T12:20:23.987925+0000","last_fullsized":"2024-09-12T12:20:23.987925+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.884993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.013169+0000","last_change":"2024-09-12T12:20:24.010527+0000","last_active":"2024-09-12T12:20:24.013169+0000","last_peered":"2024-09-12T12:20:24.013169+0000","last_clean":"2024-09-12T12:20:24.013169+0000","last_became_active":"2024-09-12T12:20:24.010056+0000","last_became_peered":"2024-09-12T12:20:24.010056+0000","last_unstale":"2024-09-12T12:20:24.013169+0000","last_undegraded":"2024-09-12T12:20:24.013169+0000","last_fullsized":"2024-09-12T12:20:24.013169+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:41.668146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.004902+0000","last_change":"2024-09-12T12:20:23.998989+0000","last_active":"2024-09-12T12:20:24.004902+0000","last_peered":"2024-09-12T12:20:24.004902+0000","last_clean":"2024-09-12T12:20:24.004902+0000","last_became_active":"2024-09-12T12:20:23.998673+0000","last_became_peered":"2024-09-12T12:20:23.998673+0000","last_unstale":"2024-09-12T12:20:24.004902+0000","last_undegraded":"2024-09-12T12:20:24.004902+0000","last_fullsized":"2024-09-12T12:20:24.004902+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:09.097182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.018081+0000","last_change":"2024-09-12T12:20:24.014876+0000","last_active":"2024-09-12T12:20:24.018081+0000","last_peered":"2024-09-12T12:20:24.018081+0000","last_clean":"2024-09-12T12:20:24.018081+0000","last_became_active":"2024-09-12T12:20:24.014620+0000","last_became_peered":"2024-09-12T12:20:24.014620+0000","last_unstale":"2024-09-12T12:20:24.018081+0000","last_undegraded":"2024-09-12T12:20:24.018081+0000","last_fullsized":"2024-09-12T12:20:24.018081+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:23.320973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020198+0000","last_change":"2024-09-12T12:20:24.015253+0000","last_active":"2024-09-12T12:20:24.020198+0000","last_peered":"2024-09-12T12:20:24.020198+0000","last_clean":"2024-09-12T12:20:24.020198+0000","last_became_active":"2024-09-12T12:20:24.014940+0000","last_became_peered":"2024-09-12T12:20:24.014940+0000","last_unstale":"2024-09-12T12:20:24.020198+0000","last_undegraded":"2024-09-12T12:20:24.020198+0000","last_fullsized":"2024-09-12T12:20:24.020198+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:59.723323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.004339+0000","last_change":"2024-09-12T12:20:23.997340+0000","last_active":"2024-09-12T12:20:24.004339+0000","last_peered":"2024-09-12T12:20:24.004339+0000","last_clean":"2024-09-12T12:20:24.004339+0000","last_became_active":"2024-09-12T12:20:23.997050+0000","last_became_peered":"2024-09-12T12:20:23.997050+0000","last_unstale":"2024-09-12T12:20:24.004339+0000","last_undegraded":"2024-09-12T12:20:24.004339+0000","last_fullsized":"2024-09-12T12:20:24.004339+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.367347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.006001+0000","last_change":"2024-09-12T12:20:24.004444+0000","last_active":"2024-09-12T12:20:24.006001+0000","last_peered":"2024-09-12T12:20:24.006001+0000","last_clean":"2024-09-12T12:20:24.006001+0000","last_became_active":"2024-09-12T12:20:24.004108+0000","last_became_peered":"2024-09-12T12:20:24.004108+0000","last_unstale":"2024-09-12T12:20:24.006001+0000","last_undegraded":"2024-09-12T12:20:24.006001+0000","last_fullsized":"2024-09-12T12:20:24.006001+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.636997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008789+0000","last_change":"2024-09-12T12:20:24.003904+0000","last_active":"2024-09-12T12:20:24.008789+0000","last_peered":"2024-09-12T12:20:24.008789+0000","last_clean":"2024-09-12T12:20:24.008789+0000","last_became_active":"2024-09-12T12:20:24.001012+0000","last_became_peered":"2024-09-12T12:20:24.001012+0000","last_unstale":"2024-09-12T12:20:24.008789+0000","last_undegraded":"2024-09-12T12:20:24.008789+0000","last_fullsized":"2024-09-12T12:20:24.008789+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:10.633686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.003423+0000","last_change":"2024-09-12T12:20:24.000865+0000","last_active":"2024-09-12T12:20:24.003423+0000","last_peered":"2024-09-12T12:20:24.003423+0000","last_clean":"2024-09-12T12:20:24.003423+0000","last_became_active":"2024-09-12T12:20:24.000507+0000","last_became_peered":"2024-09-12T12:20:24.000507+0000","last_unstale":"2024-09-12T12:20:24.003423+0000","last_undegraded":"2024-09-12T12:20:24.003423+0000","last_fullsized":"2024-09-12T12:20:24.003423+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.636997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.015875+0000","last_change":"2024-09-12T12:20:24.014297+0000","last_active":"2024-09-12T12:20:24.015875+0000","last_peered":"2024-09-12T12:20:24.015875+0000","last_clean":"2024-09-12T12:20:24.015875+0000","last_became_active":"2024-09-12T12:20:24.013941+0000","last_became_peered":"2024-09-12T12:20:24.013941+0000","last_unstale":"2024-09-12T12:20:24.015875+0000","last_undegraded":"2024-09-12T12:20:24.015875+0000","last_fullsized":"2024-09-12T12:20:24.015875+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:27.673390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.004283+0000","last_change":"2024-09-12T12:20:24.003424+0000","last_active":"2024-09-12T12:20:24.004283+0000","last_peered":"2024-09-12T12:20:24.004283+0000","last_clean":"2024-09-12T12:20:24.004283+0000","last_became_active":"2024-09-12T12:20:24.003148+0000","last_became_peered":"2024-09-12T12:20:24.003148+0000","last_unstale":"2024-09-12T12:20:24.004283+0000","last_undegraded":"2024-09-12T12:20:24.004283+0000","last_fullsized":"2024-09-12T12:20:24.004283+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.310467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008807+0000","last_change":"2024-09-12T12:20:24.003344+0000","last_active":"2024-09-12T12:20:24.008807+0000","last_peered":"2024-09-12T12:20:24.008807+0000","last_clean":"2024-09-12T12:20:24.008807+0000","last_became_active":"2024-09-12T12:20:23.998169+0000","last_became_peered":"2024-09-12T12:20:23.998169+0000","last_unstale":"2024-09-12T12:20:24.008807+0000","last_undegraded":"2024-09-12T12:20:24.008807+0000","last_fullsized":"2024-09-12T12:20:24.008807+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:36.962232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.001717+0000","last_change":"2024-09-12T12:20:23.999947+0000","last_active":"2024-09-12T12:20:24.001717+0000","last_peered":"2024-09-12T12:20:24.001717+0000","last_clean":"2024-09-12T12:20:24.001717+0000","last_became_active":"2024-09-12T12:20:23.999666+0000","last_became_peered":"2024-09-12T12:20:23.999666+0000","last_unstale":"2024-09-12T12:20:24.001717+0000","last_undegraded":"2024-09-12T12:20:24.001717+0000","last_fullsized":"2024-09-12T12:20:24.001717+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.310467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020028+0000","last_change":"2024-09-12T12:20:24.017167+0000","last_active":"2024-09-12T12:20:24.020028+0000","last_peered":"2024-09-12T12:20:24.020028+0000","last_clean":"2024-09-12T12:20:24.020028+0000","last_became_active":"2024-09-12T12:20:24.016724+0000","last_became_peered":"2024-09-12T12:20:24.016724+0000","last_unstale":"2024-09-12T12:20:24.020028+0000","last_undegraded":"2024-09-12T12:20:24.020028+0000","last_fullsized":"2024-09-12T12:20:24.020028+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:11.877005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010840+0000","last_change":"2024-09-12T12:20:24.001286+0000","last_active":"2024-09-12T12:20:24.010840+0000","last_peered":"2024-09-12T12:20:24.010840+0000","last_clean":"2024-09-12T12:20:24.010840+0000","last_became_active":"2024-09-12T12:20:24.000744+0000","last_became_peered":"2024-09-12T12:20:24.000744+0000","last_unstale":"2024-09-12T12:20:24.010840+0000","last_undegraded":"2024-09-12T12:20:24.010840+0000","last_fullsized":"2024-09-12T12:20:24.010840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.594553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.007503+0000","last_change":"2024-09-12T12:20:24.002897+0000","last_active":"2024-09-12T12:20:24.007503+0000","last_peered":"2024-09-12T12:20:24.007503+0000","last_clean":"2024-09-12T12:20:24.007503+0000","last_became_active":"2024-09-12T12:20:24.002618+0000","last_became_peered":"2024-09-12T12:20:24.002618+0000","last_unstale":"2024-09-12T12:20:24.007503+0000","last_undegraded":"2024-09-12T12:20:24.007503+0000","last_fullsized":"2024-09-12T12:20:24.007503+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:38.196196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.016504+0000","last_change":"2024-09-12T12:20:24.008730+0000","last_active":"2024-09-12T12:20:24.016504+0000","last_peered":"2024-09-12T12:20:24.016504+0000","last_clean":"2024-09-12T12:20:24.016504+0000","last_became_active":"2024-09-12T12:20:24.007205+0000","last_became_peered":"2024-09-12T12:20:24.007205+0000","last_unstale":"2024-09-12T12:20:24.016504+0000","last_undegraded":"2024-09-12T12:20:24.016504+0000","last_fullsized":"2024-09-12T12:20:24.016504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:09.395075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.011395+0000","last_change":"2024-09-12T12:20:24.009092+0000","last_active":"2024-09-12T12:20:24.011395+0000","last_peered":"2024-09-12T12:20:24.011395+0000","last_clean":"2024-09-12T12:20:24.011395+0000","last_became_active":"2024-09-12T12:20:24.008798+0000","last_became_peered":"2024-09-12T12:20:24.008798+0000","last_unstale":"2024-09-12T12:20:24.011395+0000","last_undegraded":"2024-09-12T12:20:24.011395+0000","last_fullsized":"2024-09-12T12:20:24.011395+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.808361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020596+0000","last_change":"2024-09-12T12:20:24.015241+0000","last_active":"2024-09-12T12:20:24.020596+0000","last_peered":"2024-09-12T12:20:24.020596+0000","last_clean":"2024-09-12T12:20:24.020596+0000","last_became_active":"2024-09-12T12:20:24.014953+0000","last_became_peered":"2024-09-12T12:20:24.014953+0000","last_unstale":"2024-09-12T12:20:24.020596+0000","last_undegraded":"2024-09-12T12:20:24.020596+0000","last_fullsized":"2024-09-12T12:20:24.020596+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:39.047632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.013747+0000","last_change":"2024-09-12T12:20:24.012240+0000","last_active":"2024-09-12T12:20:24.013747+0000","last_peered":"2024-09-12T12:20:24.013747+0000","last_clean":"2024-09-12T12:20:24.013747+0000","last_became_active":"2024-09-12T12:20:24.011962+0000","last_became_peered":"2024-09-12T12:20:24.011962+0000","last_unstale":"2024-09-12T12:20:24.013747+0000","last_undegraded":"2024-09-12T12:20:24.013747+0000","last_fullsized":"2024-09-12T12:20:24.013747+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:41.735115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.006830+0000","last_change":"2024-09-12T12:20:24.003580+0000","last_active":"2024-09-12T12:20:24.006830+0000","last_peered":"2024-09-12T12:20:24.006830+0000","last_clean":"2024-09-12T12:20:24.006830+0000","last_became_active":"2024-09-12T12:20:24.003314+0000","last_became_peered":"2024-09-12T12:20:24.003314+0000","last_unstale":"2024-09-12T12:20:24.006830+0000","last_undegraded":"2024-09-12T12:20:24.006830+0000","last_fullsized":"2024-09-12T12:20:24.006830+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:18.872310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008003+0000","last_change":"2024-09-12T12:20:24.006853+0000","last_active":"2024-09-12T12:20:24.008003+0000","last_peered":"2024-09-12T12:20:24.008003+0000","last_clean":"2024-09-12T12:20:24.008003+0000","last_became_active":"2024-09-12T12:20:24.005977+0000","last_became_peered":"2024-09-12T12:20:24.005977+0000","last_unstale":"2024-09-12T12:20:24.008003+0000","last_undegraded":"2024-09-12T12:20:24.008003+0000","last_fullsized":"2024-09-12T12:20:24.008003+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:12.465350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010819+0000","last_change":"2024-09-12T12:20:24.001027+0000","last_active":"2024-09-12T12:20:24.010819+0000","last_peered":"2024-09-12T12:20:24.010819+0000","last_clean":"2024-09-12T12:20:24.010819+0000","last_became_active":"2024-09-12T12:20:24.000316+0000","last_became_peered":"2024-09-12T12:20:24.000316+0000","last_unstale":"2024-09-12T12:20:24.010819+0000","last_undegraded":"2024-09-12T12:20:24.010819+0000","last_fullsized":"2024-09-12T12:20:24.010819+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:15.622725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008026+0000","last_change":"2024-09-12T12:20:24.000160+0000","last_active":"2024-09-12T12:20:24.008026+0000","last_peered":"2024-09-12T12:20:24.008026+0000","last_clean":"2024-09-12T12:20:24.008026+0000","last_became_active":"2024-09-12T12:20:23.999806+0000","last_became_peered":"2024-09-12T12:20:23.999806+0000","last_unstale":"2024-09-12T12:20:24.008026+0000","last_undegraded":"2024-09-12T12:20:24.008026+0000","last_fullsized":"2024-09-12T12:20:24.008026+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:06.250945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.014544+0000","last_change":"2024-09-12T12:20:24.013616+0000","last_active":"2024-09-12T12:20:24.014544+0000","last_peered":"2024-09-12T12:20:24.014544+0000","last_clean":"2024-09-12T12:20:24.014544+0000","last_became_active":"2024-09-12T12:20:24.012888+0000","last_became_peered":"2024-09-12T12:20:24.012888+0000","last_unstale":"2024-09-12T12:20:24.014544+0000","last_undegraded":"2024-09-12T12:20:24.014544+0000","last_fullsized":"2024-09-12T12:20:24.014544+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:05.243678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010896+0000","last_change":"2024-09-12T12:20:24.009874+0000","last_active":"2024-09-12T12:20:24.010896+0000","last_peered":"2024-09-12T12:20:24.010896+0000","last_clean":"2024-09-12T12:20:24.010896+0000","last_became_active":"2024-09-12T12:20:24.009563+0000","last_became_peered":"2024-09-12T12:20:24.009563+0000","last_unstale":"2024-09-12T12:20:24.010896+0000","last_undegraded":"2024-09-12T12:20:24.010896+0000","last_fullsized":"2024-09-12T12:20:24.010896+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:54.901459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.999485+0000","last_change":"2024-09-12T12:20:23.998206+0000","last_active":"2024-09-12T12:20:23.999485+0000","last_peered":"2024-09-12T12:20:23.999485+0000","last_clean":"2024-09-12T12:20:23.999485+0000","last_became_active":"2024-09-12T12:20:23.997905+0000","last_became_peered":"2024-09-12T12:20:23.997905+0000","last_unstale":"2024-09-12T12:20:23.999485+0000","last_undegraded":"2024-09-12T12:20:23.999485+0000","last_fullsized":"2024-09-12T12:20:23.999485+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:36.596088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.012865+0000","last_change":"2024-09-12T12:20:24.011702+0000","last_active":"2024-09-12T12:20:24.012865+0000","last_peered":"2024-09-12T12:20:24.012865+0000","last_clean":"2024-09-12T12:20:24.012865+0000","last_became_active":"2024-09-12T12:20:24.011419+0000","last_became_peered":"2024-09-12T12:20:24.011419+0000","last_unstale":"2024-09-12T12:20:24.012865+0000","last_undegraded":"2024-09-12T12:20:24.012865+0000","last_fullsized":"2024-09-12T12:20:24.012865+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:59.898033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.998715+0000","last_change":"2024-09-12T12:20:23.997328+0000","last_active":"2024-09-12T12:20:23.998715+0000","last_peered":"2024-09-12T12:20:23.998715+0000","last_clean":"2024-09-12T12:20:23.998715+0000","last_became_active":"2024-09-12T12:20:23.997013+0000","last_became_peered":"2024-09-12T12:20:23.997013+0000","last_unstale":"2024-09-12T12:20:23.998715+0000","last_undegraded":"2024-09-12T12:20:23.998715+0000","last_fullsized":"2024-09-12T12:20:23.998715+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:07.296069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"128'4","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.022216+0000","last_change":"2024-09-12T12:20:22.992547+0000","last_active":"2024-09-12T12:20:24.022216+0000","last_peered":"2024-09-12T12:20:24.022216+0000","last_clean":"2024-09-12T12:20:24.022216+0000","last_became_active":"2024-09-12T12:20:22.992143+0000","last_became_peered":"2024-09-12T12:20:22.992143+0000","last_unstale":"2024-09-12T12:20:24.022216+0000","last_undegraded":"2024-09-12T12:20:24.022216+0000","last_fullsized":"2024-09-12T12:20:24.022216+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:26.185606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.009080+0000","last_change":"2024-09-12T12:20:24.003677+0000","last_active":"2024-09-12T12:20:24.009080+0000","last_peered":"2024-09-12T12:20:24.009080+0000","last_clean":"2024-09-12T12:20:24.009080+0000","last_became_active":"2024-09-12T12:20:24.003400+0000","last_became_peered":"2024-09-12T12:20:24.003400+0000","last_unstale":"2024-09-12T12:20:24.009080+0000","last_undegraded":"2024-09-12T12:20:24.009080+0000","last_fullsized":"2024-09-12T12:20:24.009080+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:33:07.854490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.024244+0000","last_change":"2024-09-12T12:20:22.996575+0000","last_active":"2024-09-12T12:20:24.024244+0000","last_peered":"2024-09-12T12:20:24.024244+0000","last_clean":"2024-09-12T12:20:24.024244+0000","last_became_active":"2024-09-12T12:20:22.996320+0000","last_became_peered":"2024-09-12T12:20:22.996320+0000","last_unstale":"2024-09-12T12:20:24.024244+0000","last_undegraded":"2024-09-12T12:20:24.024244+0000","last_fullsized":"2024-09-12T12:20:24.024244+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:45.786045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.999440+0000","last_change":"2024-09-12T12:20:23.996805+0000","last_active":"2024-09-12T12:20:23.999440+0000","last_peered":"2024-09-12T12:20:23.999440+0000","last_clean":"2024-09-12T12:20:23.999440+0000","last_became_active":"2024-09-12T12:20:23.996413+0000","last_became_peered":"2024-09-12T12:20:23.996413+0000","last_unstale":"2024-09-12T12:20:23.999440+0000","last_undegraded":"2024-09-12T12:20:23.999440+0000","last_fullsized":"2024-09-12T12:20:23.999440+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.367347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.021921+0000","last_change":"2024-09-12T12:20:23.005201+0000","last_active":"2024-09-12T12:20:24.021921+0000","last_peered":"2024-09-12T12:20:24.021921+0000","last_clean":"2024-09-12T12:20:24.021921+0000","last_became_active":"2024-09-12T12:20:23.004478+0000","last_became_peered":"2024-09-12T12:20:23.004478+0000","last_unstale":"2024-09-12T12:20:24.021921+0000","last_undegraded":"2024-09-12T12:20:24.021921+0000","last_fullsized":"2024-09-12T12:20:24.021921+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:26.185606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.018066+0000","last_change":"2024-09-12T12:20:24.008389+0000","last_active":"2024-09-12T12:20:24.018066+0000","last_peered":"2024-09-12T12:20:24.018066+0000","last_clean":"2024-09-12T12:20:24.018066+0000","last_became_active":"2024-09-12T12:20:24.008028+0000","last_became_peered":"2024-09-12T12:20:24.008028+0000","last_unstale":"2024-09-12T12:20:24.018066+0000","last_undegraded":"2024-09-12T12:20:24.018066+0000","last_fullsized":"2024-09-12T12:20:24.018066+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:15.622725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.024093+0000","last_change":"2024-09-12T12:20:23.003650+0000","last_active":"2024-09-12T12:20:24.024093+0000","last_peered":"2024-09-12T12:20:24.024093+0000","last_clean":"2024-09-12T12:20:24.024093+0000","last_became_active":"2024-09-12T12:20:23.003152+0000","last_became_peered":"2024-09-12T12:20:23.003152+0000","last_unstale":"2024-09-12T12:20:24.024093+0000","last_undegraded":"2024-09-12T12:20:24.024093+0000","last_fullsized":"2024-09-12T12:20:24.024093+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:49.560912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.991823+0000","last_change":"2024-09-12T12:20:23.988741+0000","last_active":"2024-09-12T12:20:23.991823+0000","last_peered":"2024-09-12T12:20:23.991823+0000","last_clean":"2024-09-12T12:20:23.991823+0000","last_became_active":"2024-09-12T12:20:23.988354+0000","last_became_peered":"2024-09-12T12:20:23.988354+0000","last_unstale":"2024-09-12T12:20:23.991823+0000","last_undegraded":"2024-09-12T12:20:23.991823+0000","last_fullsized":"2024-09-12T12:20:23.991823+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:29.388202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.021144+0000","last_change":"2024-09-12T12:20:22.993708+0000","last_active":"2024-09-12T12:20:24.021144+0000","last_peered":"2024-09-12T12:20:24.021144+0000","last_clean":"2024-09-12T12:20:24.021144+0000","last_became_active":"2024-09-12T12:20:22.993421+0000","last_became_peered":"2024-09-12T12:20:22.993421+0000","last_unstale":"2024-09-12T12:20:24.021144+0000","last_undegraded":"2024-09-12T12:20:24.021144+0000","last_fullsized":"2024-09-12T12:20:24.021144+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:53.407032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008560+0000","last_change":"2024-09-12T12:20:24.006248+0000","last_active":"2024-09-12T12:20:24.008560+0000","last_peered":"2024-09-12T12:20:24.008560+0000","last_clean":"2024-09-12T12:20:24.008560+0000","last_became_active":"2024-09-12T12:20:24.005978+0000","last_became_peered":"2024-09-12T12:20:24.005978+0000","last_unstale":"2024-09-12T12:20:24.008560+0000","last_undegraded":"2024-09-12T12:20:24.008560+0000","last_fullsized":"2024-09-12T12:20:24.008560+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:36.596088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.023847+0000","last_change":"2024-09-12T12:20:23.005378+0000","last_active":"2024-09-12T12:20:24.023847+0000","last_peered":"2024-09-12T12:20:24.023847+0000","last_clean":"2024-09-12T12:20:24.023847+0000","last_became_active":"2024-09-12T12:20:23.005106+0000","last_became_peered":"2024-09-12T12:20:23.005106+0000","last_unstale":"2024-09-12T12:20:24.023847+0000","last_undegraded":"2024-09-12T12:20:24.023847+0000","last_fullsized":"2024-09-12T12:20:24.023847+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:21.963653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.014163+0000","last_change":"2024-09-12T12:20:24.010756+0000","last_active":"2024-09-12T12:20:24.014163+0000","last_peered":"2024-09-12T12:20:24.014163+0000","last_clean":"2024-09-12T12:20:24.014163+0000","last_became_active":"2024-09-12T12:20:24.010489+0000","last_became_peered":"2024-09-12T12:20:24.010489+0000","last_unstale":"2024-09-12T12:20:24.014163+0000","last_undegraded":"2024-09-12T12:20:24.014163+0000","last_fullsized":"2024-09-12T12:20:24.014163+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:50.832505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.995889+0000","last_change":"2024-09-12T12:20:22.995541+0000","last_active":"2024-09-12T12:20:23.995889+0000","last_peered":"2024-09-12T12:20:23.995889+0000","last_clean":"2024-09-12T12:20:23.995889+0000","last_became_active":"2024-09-12T12:20:22.995232+0000","last_became_peered":"2024-09-12T12:20:22.995232+0000","last_unstale":"2024-09-12T12:20:23.995889+0000","last_undegraded":"2024-09-12T12:20:23.995889+0000","last_fullsized":"2024-09-12T12:20:23.995889+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:56.878023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.013121+0000","last_change":"2024-09-12T12:20:24.011638+0000","last_active":"2024-09-12T12:20:24.013121+0000","last_peered":"2024-09-12T12:20:24.013121+0000","last_clean":"2024-09-12T12:20:24.013121+0000","last_became_active":"2024-09-12T12:20:24.011344+0000","last_became_peered":"2024-09-12T12:20:24.011344+0000","last_unstale":"2024-09-12T12:20:24.013121+0000","last_undegraded":"2024-09-12T12:20:24.013121+0000","last_fullsized":"2024-09-12T12:20:24.013121+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:21.717428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.990914+0000","last_change":"2024-09-12T12:20:23.007323+0000","last_active":"2024-09-12T12:20:23.990914+0000","last_peered":"2024-09-12T12:20:23.990914+0000","last_clean":"2024-09-12T12:20:23.990914+0000","last_became_active":"2024-09-12T12:20:23.002408+0000","last_became_peered":"2024-09-12T12:20:23.002408+0000","last_unstale":"2024-09-12T12:20:23.990914+0000","last_undegraded":"2024-09-12T12:20:23.990914+0000","last_fullsized":"2024-09-12T12:20:23.990914+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:49:27.568175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.012056+0000","last_change":"2024-09-12T12:20:24.006336+0000","last_active":"2024-09-12T12:20:24.012056+0000","last_peered":"2024-09-12T12:20:24.012056+0000","last_clean":"2024-09-12T12:20:24.012056+0000","last_became_active":"2024-09-12T12:20:24.005743+0000","last_became_peered":"2024-09-12T12:20:24.005743+0000","last_unstale":"2024-09-12T12:20:24.012056+0000","last_undegraded":"2024-09-12T12:20:24.012056+0000","last_fullsized":"2024-09-12T12:20:24.012056+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:39.047632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.983433+0000","last_change":"2024-09-12T12:20:23.005989+0000","last_active":"2024-09-12T12:20:23.983433+0000","last_peered":"2024-09-12T12:20:23.983433+0000","last_clean":"2024-09-12T12:20:23.983433+0000","last_became_active":"2024-09-12T12:20:23.005712+0000","last_became_peered":"2024-09-12T12:20:23.005712+0000","last_unstale":"2024-09-12T12:20:23.983433+0000","last_undegraded":"2024-09-12T12:20:23.983433+0000","last_fullsized":"2024-09-12T12:20:23.983433+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:08.388105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.006569+0000","last_change":"2024-09-12T12:20:24.005029+0000","last_active":"2024-09-12T12:20:24.006569+0000","last_peered":"2024-09-12T12:20:24.006569+0000","last_clean":"2024-09-12T12:20:24.006569+0000","last_became_active":"2024-09-12T12:20:24.004713+0000","last_became_peered":"2024-09-12T12:20:24.004713+0000","last_unstale":"2024-09-12T12:20:24.006569+0000","last_undegraded":"2024-09-12T12:20:24.006569+0000","last_fullsized":"2024-09-12T12:20:24.006569+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:39:15.198556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.998834+0000","last_change":"2024-09-12T12:20:23.003174+0000","last_active":"2024-09-12T12:20:23.998834+0000","last_peered":"2024-09-12T12:20:23.998834+0000","last_clean":"2024-09-12T12:20:23.998834+0000","last_became_active":"2024-09-12T12:20:23.002860+0000","last_became_peered":"2024-09-12T12:20:23.002860+0000","last_unstale":"2024-09-12T12:20:23.998834+0000","last_undegraded":"2024-09-12T12:20:23.998834+0000","last_fullsized":"2024-09-12T12:20:23.998834+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:20.710458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.020004+0000","last_change":"2024-09-12T12:20:24.016965+0000","last_active":"2024-09-12T12:20:24.020004+0000","last_peered":"2024-09-12T12:20:24.020004+0000","last_clean":"2024-09-12T12:20:24.020004+0000","last_became_active":"2024-09-12T12:20:24.016684+0000","last_became_peered":"2024-09-12T12:20:24.016684+0000","last_unstale":"2024-09-12T12:20:24.020004+0000","last_undegraded":"2024-09-12T12:20:24.020004+0000","last_fullsized":"2024-09-12T12:20:24.020004+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:21.809231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"128'3","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.023865+0000","last_change":"2024-09-12T12:20:22.998687+0000","last_active":"2024-09-12T12:20:24.023865+0000","last_peered":"2024-09-12T12:20:24.023865+0000","last_clean":"2024-09-12T12:20:24.023865+0000","last_became_active":"2024-09-12T12:20:22.998384+0000","last_became_peered":"2024-09-12T12:20:22.998384+0000","last_unstale":"2024-09-12T12:20:24.023865+0000","last_undegraded":"2024-09-12T12:20:24.023865+0000","last_fullsized":"2024-09-12T12:20:24.023865+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:06.289099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010319+0000","last_change":"2024-09-12T12:20:24.008200+0000","last_active":"2024-09-12T12:20:24.010319+0000","last_peered":"2024-09-12T12:20:24.010319+0000","last_clean":"2024-09-12T12:20:24.010319+0000","last_became_active":"2024-09-12T12:20:24.007873+0000","last_became_peered":"2024-09-12T12:20:24.007873+0000","last_unstale":"2024-09-12T12:20:24.010319+0000","last_undegraded":"2024-09-12T12:20:24.010319+0000","last_fullsized":"2024-09-12T12:20:24.010319+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:21.455714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"128'6","reported_seq":18,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.028041+0000","last_change":"2024-09-12T12:20:23.007167+0000","last_active":"2024-09-12T12:20:24.028041+0000","last_peered":"2024-09-12T12:20:24.028041+0000","last_clean":"2024-09-12T12:20:24.028041+0000","last_became_active":"2024-09-12T12:20:23.006882+0000","last_became_peered":"2024-09-12T12:20:23.006882+0000","last_unstale":"2024-09-12T12:20:24.028041+0000","last_undegraded":"2024-09-12T12:20:24.028041+0000","last_fullsized":"2024-09-12T12:20:24.028041+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:02.482524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010662+0000","last_change":"2024-09-12T12:20:24.004967+0000","last_active":"2024-09-12T12:20:24.010662+0000","last_peered":"2024-09-12T12:20:24.010662+0000","last_clean":"2024-09-12T12:20:24.010662+0000","last_became_active":"2024-09-12T12:20:24.004697+0000","last_became_peered":"2024-09-12T12:20:24.004697+0000","last_unstale":"2024-09-12T12:20:24.010662+0000","last_undegraded":"2024-09-12T12:20:24.010662+0000","last_fullsized":"2024-09-12T12:20:24.010662+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:04:36.698463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.025941+0000","last_change":"2024-09-12T12:20:23.004333+0000","last_active":"2024-09-12T12:20:24.025941+0000","last_peered":"2024-09-12T12:20:24.025941+0000","last_clean":"2024-09-12T12:20:24.025941+0000","last_became_active":"2024-09-12T12:20:23.004050+0000","last_became_peered":"2024-09-12T12:20:23.004050+0000","last_unstale":"2024-09-12T12:20:24.025941+0000","last_undegraded":"2024-09-12T12:20:24.025941+0000","last_fullsized":"2024-09-12T12:20:24.025941+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:24.405992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.003644+0000","last_change":"2024-09-12T12:20:24.002180+0000","last_active":"2024-09-12T12:20:24.003644+0000","last_peered":"2024-09-12T12:20:24.003644+0000","last_clean":"2024-09-12T12:20:24.003644+0000","last_became_active":"2024-09-12T12:20:24.001897+0000","last_became_peered":"2024-09-12T12:20:24.001897+0000","last_unstale":"2024-09-12T12:20:24.003644+0000","last_undegraded":"2024-09-12T12:20:24.003644+0000","last_fullsized":"2024-09-12T12:20:24.003644+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.808361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.009380+0000","last_change":"2024-09-12T12:20:23.007690+0000","last_active":"2024-09-12T12:20:24.009380+0000","last_peered":"2024-09-12T12:20:24.009380+0000","last_clean":"2024-09-12T12:20:24.009380+0000","last_became_active":"2024-09-12T12:20:23.006237+0000","last_became_peered":"2024-09-12T12:20:23.006237+0000","last_unstale":"2024-09-12T12:20:24.009380+0000","last_undegraded":"2024-09-12T12:20:24.009380+0000","last_fullsized":"2024-09-12T12:20:24.009380+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:26.006120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.010640+0000","last_change":"2024-09-12T12:20:24.008026+0000","last_active":"2024-09-12T12:20:24.010640+0000","last_peered":"2024-09-12T12:20:24.010640+0000","last_clean":"2024-09-12T12:20:24.010640+0000","last_became_active":"2024-09-12T12:20:24.007209+0000","last_became_peered":"2024-09-12T12:20:24.007209+0000","last_unstale":"2024-09-12T12:20:24.010640+0000","last_undegraded":"2024-09-12T12:20:24.010640+0000","last_fullsized":"2024-09-12T12:20:24.010640+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:52.047887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008526+0000","last_change":"2024-09-12T12:20:23.007660+0000","last_active":"2024-09-12T12:20:24.008526+0000","last_peered":"2024-09-12T12:20:24.008526+0000","last_clean":"2024-09-12T12:20:24.008526+0000","last_became_active":"2024-09-12T12:20:23.007378+0000","last_became_peered":"2024-09-12T12:20:23.007378+0000","last_unstale":"2024-09-12T12:20:24.008526+0000","last_undegraded":"2024-09-12T12:20:24.008526+0000","last_fullsized":"2024-09-12T12:20:24.008526+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:11:27.565007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.999869+0000","last_change":"2024-09-12T12:20:23.996807+0000","last_active":"2024-09-12T12:20:23.999869+0000","last_peered":"2024-09-12T12:20:23.999869+0000","last_clean":"2024-09-12T12:20:23.999869+0000","last_became_active":"2024-09-12T12:20:23.996538+0000","last_became_peered":"2024-09-12T12:20:23.996538+0000","last_unstale":"2024-09-12T12:20:23.999869+0000","last_undegraded":"2024-09-12T12:20:23.999869+0000","last_fullsized":"2024-09-12T12:20:23.999869+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:10.310467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.024517+0000","last_change":"2024-09-12T12:20:23.001746+0000","last_active":"2024-09-12T12:20:24.024517+0000","last_peered":"2024-09-12T12:20:24.024517+0000","last_clean":"2024-09-12T12:20:24.024517+0000","last_became_active":"2024-09-12T12:20:22.997873+0000","last_became_peered":"2024-09-12T12:20:22.997873+0000","last_unstale":"2024-09-12T12:20:24.024517+0000","last_undegraded":"2024-09-12T12:20:24.024517+0000","last_fullsized":"2024-09-12T12:20:24.024517+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:53.407032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.004590+0000","last_change":"2024-09-12T12:20:24.002685+0000","last_active":"2024-09-12T12:20:24.004590+0000","last_peered":"2024-09-12T12:20:24.004590+0000","last_clean":"2024-09-12T12:20:24.004590+0000","last_became_active":"2024-09-12T12:20:24.002391+0000","last_became_peered":"2024-09-12T12:20:24.002391+0000","last_unstale":"2024-09-12T12:20:24.004590+0000","last_undegraded":"2024-09-12T12:20:24.004590+0000","last_fullsized":"2024-09-12T12:20:24.004590+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:21.367347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.018199+0000","last_change":"2024-09-12T12:20:23.011465+0000","last_active":"2024-09-12T12:20:24.018199+0000","last_peered":"2024-09-12T12:20:24.018199+0000","last_clean":"2024-09-12T12:20:24.018199+0000","last_became_active":"2024-09-12T12:20:23.010683+0000","last_became_peered":"2024-09-12T12:20:23.010683+0000","last_unstale":"2024-09-12T12:20:24.018199+0000","last_undegraded":"2024-09-12T12:20:24.018199+0000","last_fullsized":"2024-09-12T12:20:24.018199+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:34.385980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.017840+0000","last_change":"2024-09-12T12:20:24.016400+0000","last_active":"2024-09-12T12:20:24.017840+0000","last_peered":"2024-09-12T12:20:24.017840+0000","last_clean":"2024-09-12T12:20:24.017840+0000","last_became_active":"2024-09-12T12:20:24.016140+0000","last_became_peered":"2024-09-12T12:20:24.016140+0000","last_unstale":"2024-09-12T12:20:24.017840+0000","last_undegraded":"2024-09-12T12:20:24.017840+0000","last_fullsized":"2024-09-12T12:20:24.017840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:22.612658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"128'1","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.022744+0000","last_change":"2024-09-12T12:20:23.000845+0000","last_active":"2024-09-12T12:20:24.022744+0000","last_peered":"2024-09-12T12:20:24.022744+0000","last_clean":"2024-09-12T12:20:24.022744+0000","last_became_active":"2024-09-12T12:20:23.000341+0000","last_became_peered":"2024-09-12T12:20:23.000341+0000","last_unstale":"2024-09-12T12:20:24.022744+0000","last_undegraded":"2024-09-12T12:20:24.022744+0000","last_fullsized":"2024-09-12T12:20:24.022744+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:58.891063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.999515+0000","last_change":"2024-09-12T12:20:23.997927+0000","last_active":"2024-09-12T12:20:23.999515+0000","last_peered":"2024-09-12T12:20:23.999515+0000","last_clean":"2024-09-12T12:20:23.999515+0000","last_became_active":"2024-09-12T12:20:23.997655+0000","last_became_peered":"2024-09-12T12:20:23.997655+0000","last_unstale":"2024-09-12T12:20:23.999515+0000","last_undegraded":"2024-09-12T12:20:23.999515+0000","last_fullsized":"2024-09-12T12:20:23.999515+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.636997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.994084+0000","last_change":"2024-09-12T12:20:23.008068+0000","last_active":"2024-09-12T12:20:23.994084+0000","last_peered":"2024-09-12T12:20:23.994084+0000","last_clean":"2024-09-12T12:20:23.994084+0000","last_became_active":"2024-09-12T12:20:23.007727+0000","last_became_peered":"2024-09-12T12:20:23.007727+0000","last_unstale":"2024-09-12T12:20:23.994084+0000","last_undegraded":"2024-09-12T12:20:23.994084+0000","last_fullsized":"2024-09-12T12:20:23.994084+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:47:20.448744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.014629+0000","last_change":"2024-09-12T12:20:24.012340+0000","last_active":"2024-09-12T12:20:24.014629+0000","last_peered":"2024-09-12T12:20:24.014629+0000","last_clean":"2024-09-12T12:20:24.014629+0000","last_became_active":"2024-09-12T12:20:24.011844+0000","last_became_peered":"2024-09-12T12:20:24.011844+0000","last_unstale":"2024-09-12T12:20:24.014629+0000","last_undegraded":"2024-09-12T12:20:24.014629+0000","last_fullsized":"2024-09-12T12:20:24.014629+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:08.207987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.024959+0000","last_change":"2024-09-12T12:20:23.000887+0000","last_active":"2024-09-12T12:20:24.024959+0000","last_peered":"2024-09-12T12:20:24.024959+0000","last_clean":"2024-09-12T12:20:24.024959+0000","last_became_active":"2024-09-12T12:20:23.000587+0000","last_became_peered":"2024-09-12T12:20:23.000587+0000","last_unstale":"2024-09-12T12:20:24.024959+0000","last_undegraded":"2024-09-12T12:20:24.024959+0000","last_fullsized":"2024-09-12T12:20:24.024959+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:49.436590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.015846+0000","last_change":"2024-09-12T12:20:24.014210+0000","last_active":"2024-09-12T12:20:24.015846+0000","last_peered":"2024-09-12T12:20:24.015846+0000","last_clean":"2024-09-12T12:20:24.015846+0000","last_became_active":"2024-09-12T12:20:24.013813+0000","last_became_peered":"2024-09-12T12:20:24.013813+0000","last_unstale":"2024-09-12T12:20:24.015846+0000","last_undegraded":"2024-09-12T12:20:24.015846+0000","last_fullsized":"2024-09-12T12:20:24.015846+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:57:39.041573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992746+0000","last_change":"2024-09-12T12:20:23.000600+0000","last_active":"2024-09-12T12:20:23.992746+0000","last_peered":"2024-09-12T12:20:23.992746+0000","last_clean":"2024-09-12T12:20:23.992746+0000","last_became_active":"2024-09-12T12:20:22.999999+0000","last_became_peered":"2024-09-12T12:20:22.999999+0000","last_unstale":"2024-09-12T12:20:23.992746+0000","last_undegraded":"2024-09-12T12:20:23.992746+0000","last_fullsized":"2024-09-12T12:20:23.992746+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:17.865340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.018850+0000","last_change":"2024-09-12T12:20:24.015007+0000","last_active":"2024-09-12T12:20:24.018850+0000","last_peered":"2024-09-12T12:20:24.018850+0000","last_clean":"2024-09-12T12:20:24.018850+0000","last_became_active":"2024-09-12T12:20:24.013399+0000","last_became_peered":"2024-09-12T12:20:24.013399+0000","last_unstale":"2024-09-12T12:20:24.018850+0000","last_undegraded":"2024-09-12T12:20:24.018850+0000","last_fullsized":"2024-09-12T12:20:24.018850+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:34.946428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008715+0000","last_change":"2024-09-12T12:20:23.010809+0000","last_active":"2024-09-12T12:20:24.008715+0000","last_peered":"2024-09-12T12:20:24.008715+0000","last_clean":"2024-09-12T12:20:24.008715+0000","last_became_active":"2024-09-12T12:20:23.010477+0000","last_became_peered":"2024-09-12T12:20:23.010477+0000","last_unstale":"2024-09-12T12:20:24.008715+0000","last_undegraded":"2024-09-12T12:20:24.008715+0000","last_fullsized":"2024-09-12T12:20:24.008715+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:52:09.565876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.001302+0000","last_change":"2024-09-12T12:20:23.998719+0000","last_active":"2024-09-12T12:20:24.001302+0000","last_peered":"2024-09-12T12:20:24.001302+0000","last_clean":"2024-09-12T12:20:24.001302+0000","last_became_active":"2024-09-12T12:20:23.998113+0000","last_became_peered":"2024-09-12T12:20:23.998113+0000","last_unstale":"2024-09-12T12:20:24.001302+0000","last_undegraded":"2024-09-12T12:20:24.001302+0000","last_fullsized":"2024-09-12T12:20:24.001302+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.808361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992652+0000","last_change":"2024-09-12T12:20:23.005527+0000","last_active":"2024-09-12T12:20:23.992652+0000","last_peered":"2024-09-12T12:20:23.992652+0000","last_clean":"2024-09-12T12:20:23.992652+0000","last_became_active":"2024-09-12T12:20:23.004505+0000","last_became_peered":"2024-09-12T12:20:23.004505+0000","last_unstale":"2024-09-12T12:20:23.992652+0000","last_undegraded":"2024-09-12T12:20:23.992652+0000","last_fullsized":"2024-09-12T12:20:23.992652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:20.710458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.001338+0000","last_change":"2024-09-12T12:20:23.996734+0000","last_active":"2024-09-12T12:20:24.001338+0000","last_peered":"2024-09-12T12:20:24.001338+0000","last_clean":"2024-09-12T12:20:24.001338+0000","last_became_active":"2024-09-12T12:20:23.995841+0000","last_became_peered":"2024-09-12T12:20:23.995841+0000","last_unstale":"2024-09-12T12:20:24.001338+0000","last_undegraded":"2024-09-12T12:20:24.001338+0000","last_fullsized":"2024-09-12T12:20:24.001338+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:46:52.114062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"128'2","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.025757+0000","last_change":"2024-09-12T12:20:23.003872+0000","last_active":"2024-09-12T12:20:24.025757+0000","last_peered":"2024-09-12T12:20:24.025757+0000","last_clean":"2024-09-12T12:20:24.025757+0000","last_became_active":"2024-09-12T12:20:23.003450+0000","last_became_peered":"2024-09-12T12:20:23.003450+0000","last_unstale":"2024-09-12T12:20:24.025757+0000","last_undegraded":"2024-09-12T12:20:24.025757+0000","last_fullsized":"2024-09-12T12:20:24.025757+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:47.061478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992289+0000","last_change":"2024-09-12T12:20:23.990461+0000","last_active":"2024-09-12T12:20:23.992289+0000","last_peered":"2024-09-12T12:20:23.992289+0000","last_clean":"2024-09-12T12:20:23.992289+0000","last_became_active":"2024-09-12T12:20:23.990187+0000","last_became_peered":"2024-09-12T12:20:23.990187+0000","last_unstale":"2024-09-12T12:20:23.992289+0000","last_undegraded":"2024-09-12T12:20:23.992289+0000","last_fullsized":"2024-09-12T12:20:23.992289+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:57.884993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.983076+0000","last_change":"2024-09-12T12:20:23.004829+0000","last_active":"2024-09-12T12:20:23.983076+0000","last_peered":"2024-09-12T12:20:23.983076+0000","last_clean":"2024-09-12T12:20:23.983076+0000","last_became_active":"2024-09-12T12:20:23.004562+0000","last_became_peered":"2024-09-12T12:20:23.004562+0000","last_unstale":"2024-09-12T12:20:23.983076+0000","last_undegraded":"2024-09-12T12:20:23.983076+0000","last_fullsized":"2024-09-12T12:20:23.983076+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:40.728145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.017712+0000","last_change":"2024-09-12T12:20:24.014457+0000","last_active":"2024-09-12T12:20:24.017712+0000","last_peered":"2024-09-12T12:20:24.017712+0000","last_clean":"2024-09-12T12:20:24.017712+0000","last_became_active":"2024-09-12T12:20:24.012890+0000","last_became_peered":"2024-09-12T12:20:24.012890+0000","last_unstale":"2024-09-12T12:20:24.017712+0000","last_undegraded":"2024-09-12T12:20:24.017712+0000","last_fullsized":"2024-09-12T12:20:24.017712+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:09.594553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.983573+0000","last_change":"2024-09-12T12:20:23.006047+0000","last_active":"2024-09-12T12:20:23.983573+0000","last_peered":"2024-09-12T12:20:23.983573+0000","last_clean":"2024-09-12T12:20:23.983573+0000","last_became_active":"2024-09-12T12:20:23.005657+0000","last_became_peered":"2024-09-12T12:20:23.005657+0000","last_unstale":"2024-09-12T12:20:23.983573+0000","last_undegraded":"2024-09-12T12:20:23.983573+0000","last_fullsized":"2024-09-12T12:20:23.983573+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:22.510834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.003077+0000","last_change":"2024-09-12T12:20:23.999841+0000","last_active":"2024-09-12T12:20:24.003077+0000","last_peered":"2024-09-12T12:20:24.003077+0000","last_clean":"2024-09-12T12:20:24.003077+0000","last_became_active":"2024-09-12T12:20:23.999536+0000","last_became_peered":"2024-09-12T12:20:23.999536+0000","last_unstale":"2024-09-12T12:20:24.003077+0000","last_undegraded":"2024-09-12T12:20:24.003077+0000","last_fullsized":"2024-09-12T12:20:24.003077+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:08.308384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.991459+0000","last_change":"2024-09-12T12:20:23.005838+0000","last_active":"2024-09-12T12:20:23.991459+0000","last_peered":"2024-09-12T12:20:23.991459+0000","last_clean":"2024-09-12T12:20:23.991459+0000","last_became_active":"2024-09-12T12:20:23.005411+0000","last_became_peered":"2024-09-12T12:20:23.005411+0000","last_unstale":"2024-09-12T12:20:23.991459+0000","last_undegraded":"2024-09-12T12:20:23.991459+0000","last_fullsized":"2024-09-12T12:20:23.991459+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:33.309971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.008781+0000","last_change":"2024-09-12T12:20:24.000348+0000","last_active":"2024-09-12T12:20:24.008781+0000","last_peered":"2024-09-12T12:20:24.008781+0000","last_clean":"2024-09-12T12:20:24.008781+0000","last_became_active":"2024-09-12T12:20:23.998686+0000","last_became_peered":"2024-09-12T12:20:23.998686+0000","last_unstale":"2024-09-12T12:20:24.008781+0000","last_undegraded":"2024-09-12T12:20:24.008781+0000","last_fullsized":"2024-09-12T12:20:24.008781+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:54.559548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.984993+0000","last_change":"2024-09-12T12:20:22.997359+0000","last_active":"2024-09-12T12:20:23.984993+0000","last_peered":"2024-09-12T12:20:23.984993+0000","last_clean":"2024-09-12T12:20:23.984993+0000","last_became_active":"2024-09-12T12:20:22.996699+0000","last_became_peered":"2024-09-12T12:20:22.996699+0000","last_unstale":"2024-09-12T12:20:23.984993+0000","last_undegraded":"2024-09-12T12:20:23.984993+0000","last_fullsized":"2024-09-12T12:20:23.984993+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:45.786045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.019507+0000","last_change":"2024-09-12T12:20:24.015719+0000","last_active":"2024-09-12T12:20:24.019507+0000","last_peered":"2024-09-12T12:20:24.019507+0000","last_clean":"2024-09-12T12:20:24.019507+0000","last_became_active":"2024-09-12T12:20:24.015470+0000","last_became_peered":"2024-09-12T12:20:24.015470+0000","last_unstale":"2024-09-12T12:20:24.019507+0000","last_undegraded":"2024-09-12T12:20:24.019507+0000","last_fullsized":"2024-09-12T12:20:24.019507+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:19.904491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.985242+0000","last_change":"2024-09-12T12:20:22.991226+0000","last_active":"2024-09-12T12:20:23.985242+0000","last_peered":"2024-09-12T12:20:23.985242+0000","last_clean":"2024-09-12T12:20:23.985242+0000","last_became_active":"2024-09-12T12:20:22.990954+0000","last_became_peered":"2024-09-12T12:20:22.990954+0000","last_unstale":"2024-09-12T12:20:23.985242+0000","last_undegraded":"2024-09-12T12:20:23.985242+0000","last_fullsized":"2024-09-12T12:20:23.985242+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:28.381232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.013153+0000","last_change":"2024-09-12T12:20:24.001289+0000","last_active":"2024-09-12T12:20:24.013153+0000","last_peered":"2024-09-12T12:20:24.013153+0000","last_clean":"2024-09-12T12:20:24.013153+0000","last_became_active":"2024-09-12T12:20:24.000972+0000","last_became_peered":"2024-09-12T12:20:24.000972+0000","last_unstale":"2024-09-12T12:20:24.013153+0000","last_undegraded":"2024-09-12T12:20:24.013153+0000","last_fullsized":"2024-09-12T12:20:24.013153+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:41.735115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.990457+0000","last_change":"2024-09-12T12:20:22.996191+0000","last_active":"2024-09-12T12:20:23.990457+0000","last_peered":"2024-09-12T12:20:23.990457+0000","last_clean":"2024-09-12T12:20:23.990457+0000","last_became_active":"2024-09-12T12:20:22.995734+0000","last_became_peered":"2024-09-12T12:20:22.995734+0000","last_unstale":"2024-09-12T12:20:23.990457+0000","last_undegraded":"2024-09-12T12:20:23.990457+0000","last_fullsized":"2024-09-12T12:20:23.990457+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:24:45.704581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.003446+0000","last_change":"2024-09-12T12:20:24.001475+0000","last_active":"2024-09-12T12:20:24.003446+0000","last_peered":"2024-09-12T12:20:24.003446+0000","last_clean":"2024-09-12T12:20:24.003446+0000","last_became_active":"2024-09-12T12:20:24.001192+0000","last_became_peered":"2024-09-12T12:20:24.001192+0000","last_unstale":"2024-09-12T12:20:24.003446+0000","last_undegraded":"2024-09-12T12:20:24.003446+0000","last_fullsized":"2024-09-12T12:20:24.003446+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:36.596088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992831+0000","last_change":"2024-09-12T12:20:23.000084+0000","last_active":"2024-09-12T12:20:23.992831+0000","last_peered":"2024-09-12T12:20:23.992831+0000","last_clean":"2024-09-12T12:20:23.992831+0000","last_became_active":"2024-09-12T12:20:22.999735+0000","last_became_peered":"2024-09-12T12:20:22.999735+0000","last_unstale":"2024-09-12T12:20:23.992831+0000","last_undegraded":"2024-09-12T12:20:23.992831+0000","last_fullsized":"2024-09-12T12:20:23.992831+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:39:14.191586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.016526+0000","last_change":"2024-09-12T12:20:24.008931+0000","last_active":"2024-09-12T12:20:24.016526+0000","last_peered":"2024-09-12T12:20:24.016526+0000","last_clean":"2024-09-12T12:20:24.016526+0000","last_became_active":"2024-09-12T12:20:24.007601+0000","last_became_peered":"2024-09-12T12:20:24.007601+0000","last_unstale":"2024-09-12T12:20:24.016526+0000","last_undegraded":"2024-09-12T12:20:24.016526+0000","last_fullsized":"2024-09-12T12:20:24.016526+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:22.967456+0000","last_clean_scrub_stamp":"2024-09-12T12:20:22.967456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:23.517804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"128'8","reported_seq":20,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:24.026366+0000","last_change":"2024-09-12T12:20:23.006167+0000","last_active":"2024-09-12T12:20:24.026366+0000","last_peered":"2024-09-12T12:20:24.026366+0000","last_clean":"2024-09-12T12:20:24.026366+0000","last_became_active":"2024-09-12T12:20:23.005700+0000","last_became_peered":"2024-09-12T12:20:23.005700+0000","last_unstale":"2024-09-12T12:20:24.026366+0000","last_undegraded":"2024-09-12T12:20:24.026366+0000","last_fullsized":"2024-09-12T12:20:24.026366+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:20:21.960486+0000","last_clean_scrub_stamp":"2024-09-12T12:20:21.960486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:19.585354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":365,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T12:20:23.992986+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:20:23.992986+0000","last_peered":"2024-09-12T12:20:23.992986+0000","last_clean":"2024-09-12T12:20:23.992986+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:20:23.992986+0000","last_undegraded":"2024-09-12T12:20:23.992986+0000","last_fullsized":"2024-09-12T12:20:23.992986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41660,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330180,"statfs":{"total":96636764160,"available":96594104320,"internally_reserved":0,"allocated":2203648,"data_stored":1341726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46620,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325220,"statfs":{"total":96636764160,"available":96589025280,"internally_reserved":0,"allocated":1581056,"data_stored":743415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59124,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312716,"statfs":{"total":96636764160,"available":96576221184,"internally_reserved":0,"allocated":1601536,"data_stored":750742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50784,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1581056,"data_stored":743415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50812,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321028,"statfs":{"total":96636764160,"available":96584732672,"internally_reserved":0,"allocated":1609728,"data_stored":752228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50784,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1581056,"data_stored":743415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50804,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321036,"statfs":{"total":96636764160,"available":96584740864,"internally_reserved":0,"allocated":1597440,"data_stored":750604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51376,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320464,"statfs":{"total":96636764160,"available":96584155136,"internally_reserved":0,"allocated":2191360,"data_stored":1340972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:20:28.683 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:20:28.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:20:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.864+0000 7f0a8d400640 1 Processor -- start 2024-09-12T12:20:28.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.864+0000 7f0a8d400640 1 -- start start 2024-09-12T12:20:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.864+0000 7f0a8d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0a8815af60 0x7f0a880ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.864+0000 7f0a8d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a8806c320 0x7f0a880b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.864+0000 7f0a8d400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a880b4300 con 0x7f0a880cd9f0 2024-09-12T12:20:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.864+0000 7f0a8d400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0a880b32f0 con 0x7f0a8806c320 2024-09-12T12:20:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.864+0000 7f0a8d400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0a880b3540 con 0x7f0a8815af60 2024-09-12T12:20:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a87200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a8806c320 0x7f0a880b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a87200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a8806c320 0x7f0a880b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46830/0 (socket says 172.21.15.144:46830) 2024-09-12T12:20:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a87200640 1 -- 172.21.15.144:0/463571403 learned_addr learned my addr 172.21.15.144:0/463571403 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a86800640 1 --2- 172.21.15.144:0/463571403 >> v2:172.21.15.165:3300/0 conn(0x7f0a8815af60 0x7f0a880ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a87200640 1 -- 172.21.15.144:0/463571403 >> v2:172.21.15.165:3300/0 conn(0x7f0a8815af60 msgr2=0x7f0a880ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a87200640 1 --2- 172.21.15.144:0/463571403 >> v2:172.21.15.165:3300/0 conn(0x7f0a8815af60 0x7f0a880ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a87200640 1 -- 172.21.15.144:0/463571403 >> v1:172.21.15.144:6789/0 conn(0x7f0a880cd9f0 legacy=0x7f0a8806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a87200640 1 -- 172.21.15.144:0/463571403 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a880b3820 con 0x7f0a8806c320 2024-09-12T12:20:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a85400640 1 -- 172.21.15.144:0/463571403 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3570962890 0 0) 0x7f0a880b4300 con 0x7f0a880cd9f0 2024-09-12T12:20:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a87200640 1 --2- 172.21.15.144:0/463571403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 0x7f0a880b4560 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f0a880d0240 tx=0x7f0a8001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6de3ef916877bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a85400640 1 -- 172.21.15.144:0/463571403 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a800a57a0 con 0x7f0a8806c320 2024-09-12T12:20:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a85400640 1 -- 172.21.15.144:0/463571403 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a800a5940 con 0x7f0a8806c320 2024-09-12T12:20:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.868+0000 7f0a85400640 1 -- 172.21.15.144:0/463571403 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a800a5d10 con 0x7f0a8806c320 2024-09-12T12:20:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 -- 172.21.15.144:0/463571403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 msgr2=0x7f0a880b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 --2- 172.21.15.144:0/463571403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 0x7f0a880b4560 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f0a880d0240 tx=0x7f0a8001c9f0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 -- 172.21.15.144:0/463571403 shutdown_connections 2024-09-12T12:20:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 --2- 172.21.15.144:0/463571403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 0x7f0a880b4560 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 --2- 172.21.15.144:0/463571403 >> v2:172.21.15.165:3300/0 conn(0x7f0a8815af60 0x7f0a880ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 -- 172.21.15.144:0/463571403 >> 172.21.15.144:0/463571403 conn(0x7f0a88068030 msgr2=0x7f0a880b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 -- 172.21.15.144:0/463571403 shutdown_connections 2024-09-12T12:20:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 -- 172.21.15.144:0/463571403 wait complete. 2024-09-12T12:20:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 Processor -- start 2024-09-12T12:20:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 -- start start 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 0x7f0a8813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a880cd9f0 0x7f0a8815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a8815af60 0x7f0a8815df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880b5430 con 0x7f0a8806c320 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880b52b0 con 0x7f0a8815af60 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a8d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0a880b55b0 con 0x7f0a880cd9f0 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a86800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 0x7f0a8813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a86800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 0x7f0a8813cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46840/0 (socket says 172.21.15.144:46840) 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a86800640 1 -- 172.21.15.144:0/1172938351 learned_addr learned my addr 172.21.15.144:0/1172938351 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a87200640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a8815af60 0x7f0a8815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a85e00640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a880cd9f0 0x7f0a8815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a86800640 1 -- 172.21.15.144:0/1172938351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a880cd9f0 msgr2=0x7f0a8815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a86800640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a880cd9f0 0x7f0a8815da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a86800640 1 -- 172.21.15.144:0/1172938351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a8815af60 msgr2=0x7f0a8815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a86800640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a8815af60 0x7f0a8815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.872+0000 7f0a86800640 1 -- 172.21.15.144:0/1172938351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8814fb90 con 0x7f0a8806c320 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a86800640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 0x7f0a8813cff0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800e870 tx=0x7f0a7800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a7ea00640 1 -- 172.21.15.144:0/1172938351 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78017070 con 0x7f0a8806c320 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a7ea00640 1 -- 172.21.15.144:0/1172938351 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7800c940 con 0x7f0a8806c320 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a7ea00640 1 -- 172.21.15.144:0/1172938351 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800ccf0 con 0x7f0a8806c320 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8814fe30 con 0x7f0a8806c320 2024-09-12T12:20:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8815c480 con 0x7f0a8806c320 2024-09-12T12:20:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a880b4560 con 0x7f0a8806c320 2024-09-12T12:20:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a7ea00640 1 -- 172.21.15.144:0/1172938351 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a7801a070 con 0x7f0a8806c320 2024-09-12T12:20:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a7ea00640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a680678f0 0x7f0a68069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a7ea00640 1 -- 172.21.15.144:0/1172938351 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f0a78085fe0 con 0x7f0a8806c320 2024-09-12T12:20:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.876+0000 7f0a85e00640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a680678f0 0x7f0a68069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.880+0000 7f0a85e00640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a680678f0 0x7f0a68069db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0a88154040 tx=0x7f0a74009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:28.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:28.880+0000 7f0a7ea00640 1 -- 172.21.15.144:0/1172938351 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a78056340 con 0x7f0a8806c320 2024-09-12T12:20:29.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.096+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0a880735b0 con 0x7f0a8806c320 2024-09-12T12:20:29.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a7ea00640 1 -- 172.21.15.144:0/1172938351 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f0a7805a640 con 0x7f0a8806c320 2024-09-12T12:20:29.099 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:20:29.099 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:20:29.099 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:20:29.099 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:20:29.099 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:20:29.099 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:20:29.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a680678f0 msgr2=0x7f0a68069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:29.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a680678f0 0x7f0a68069db0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0a88154040 tx=0x7f0a74009040 comp rx=0 tx=0).stop 2024-09-12T12:20:29.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 msgr2=0x7f0a8813cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 0x7f0a8813cff0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800e870 tx=0x7f0a7800ec70 comp rx=0 tx=0).stop 2024-09-12T12:20:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 shutdown_connections 2024-09-12T12:20:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a680678f0 0x7f0a68069db0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a8815af60 0x7f0a8815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a880cd9f0 0x7f0a8815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 --2- 172.21.15.144:0/1172938351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8806c320 0x7f0a8813cff0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 >> 172.21.15.144:0/1172938351 conn(0x7f0a88068030 msgr2=0x7f0a880b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 shutdown_connections 2024-09-12T12:20:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.100+0000 7f0a8d400640 1 -- 172.21.15.144:0/1172938351 wait complete. 2024-09-12T12:20:29.120 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:29.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd468000640 1 Processor -- start 2024-09-12T12:20:29.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd468000640 1 -- start start 2024-09-12T12:20:29.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd468000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd46015e440 0x7fd4600b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:29.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd468000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd4600b7310 0x7fd460073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:29.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd468000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd46006dfe0 con 0x7fd4600b47b0 2024-09-12T12:20:29.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd468000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd46006ed60 con 0x7fd4600b7310 2024-09-12T12:20:29.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd468000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd4600b4be0 con 0x7fd46015e440 2024-09-12T12:20:29.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd466000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd4600b7310 0x7fd460073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:29.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd466000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd4600b7310 0x7fd460073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46848/0 (socket says 172.21.15.144:46848) 2024-09-12T12:20:29.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd466000640 1 -- 172.21.15.144:0/1618899661 learned_addr learned my addr 172.21.15.144:0/1618899661 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:29.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd466000640 1 -- 172.21.15.144:0/1618899661 >> v2:172.21.15.165:3300/0 conn(0x7fd46015e440 msgr2=0x7fd4600b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:29.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd465600640 1 --2- 172.21.15.144:0/1618899661 >> v2:172.21.15.165:3300/0 conn(0x7fd46015e440 0x7fd4600b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:29.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd466000640 1 --2- 172.21.15.144:0/1618899661 >> v2:172.21.15.165:3300/0 conn(0x7fd46015e440 0x7fd4600b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd466000640 1 -- 172.21.15.144:0/1618899661 >> v1:172.21.15.165:6789/0 conn(0x7fd4600b47b0 legacy=0x7fd4600b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:29.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd466000640 1 -- 172.21.15.144:0/1618899661 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46006e280 con 0x7fd4600b7310 2024-09-12T12:20:29.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.256+0000 7fd465600640 1 --2- 172.21.15.144:0/1618899661 >> v2:172.21.15.165:3300/0 conn(0x7fd46015e440 0x7fd4600b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:29.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd466000640 1 --2- 172.21.15.144:0/1618899661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4600b7310 0x7fd460073250 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd460070720 tx=0x7fd45801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6393cfb4ec05160f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd45fe00640 1 -- 172.21.15.144:0/1618899661 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4580a5840 con 0x7fd4600b7310 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd45fe00640 1 -- 172.21.15.144:0/1618899661 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4580a59e0 con 0x7fd4600b7310 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd45fe00640 1 -- 172.21.15.144:0/1618899661 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4580a5db0 con 0x7fd4600b7310 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd468000640 1 -- 172.21.15.144:0/1618899661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4600b7310 msgr2=0x7fd460073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd468000640 1 --2- 172.21.15.144:0/1618899661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4600b7310 0x7fd460073250 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd460070720 tx=0x7fd45801c980 comp rx=0 tx=0).stop 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd468000640 1 -- 172.21.15.144:0/1618899661 shutdown_connections 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd468000640 1 --2- 172.21.15.144:0/1618899661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4600b7310 0x7fd460073250 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd468000640 1 --2- 172.21.15.144:0/1618899661 >> v2:172.21.15.165:3300/0 conn(0x7fd46015e440 0x7fd4600b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd468000640 1 -- 172.21.15.144:0/1618899661 >> 172.21.15.144:0/1618899661 conn(0x7fd46006f3e0 msgr2=0x7fd46006f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd468000640 1 -- 172.21.15.144:0/1618899661 shutdown_connections 2024-09-12T12:20:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.260+0000 7fd468000640 1 -- 172.21.15.144:0/1618899661 wait complete. 2024-09-12T12:20:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 Processor -- start 2024-09-12T12:20:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 -- start start 2024-09-12T12:20:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4600b47b0 0x7fd4600b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4600b7310 0x7fd460163be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd46015e440 0x7fd4601652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd4601620c0 con 0x7fd46015e440 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd4600b76f0 con 0x7fd4600b47b0 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd460162240 con 0x7fd4600b7310 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd466000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd46015e440 0x7fd4601652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd466000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd46015e440 0x7fd4601652f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46850/0 (socket says 172.21.15.144:46850) 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd466000640 1 -- 172.21.15.144:0/3092643651 learned_addr learned my addr 172.21.15.144:0/3092643651 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd465600640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4600b47b0 0x7fd4600b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd464c00640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4600b7310 0x7fd460163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd466000640 1 -- 172.21.15.144:0/3092643651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4600b7310 msgr2=0x7fd460163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd466000640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4600b7310 0x7fd460163be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd466000640 1 -- 172.21.15.144:0/3092643651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4600b47b0 msgr2=0x7fd4600b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd466000640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4600b47b0 0x7fd4600b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd466000640 1 -- 172.21.15.144:0/3092643651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd460159500 con 0x7fd46015e440 2024-09-12T12:20:29.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd465600640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4600b47b0 0x7fd4600b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:29.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd466000640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd46015e440 0x7fd4601652f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fd4580af040 tx=0x7fd458019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:29.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd45d600640 1 -- 172.21.15.144:0/3092643651 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4580bc020 con 0x7fd46015e440 2024-09-12T12:20:29.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd45d600640 1 -- 172.21.15.144:0/3092643651 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4580b8880 con 0x7fd46015e440 2024-09-12T12:20:29.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd460164250 con 0x7fd46015e440 2024-09-12T12:20:29.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd45d600640 1 -- 172.21.15.144:0/3092643651 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4580b8c70 con 0x7fd46015e440 2024-09-12T12:20:29.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.264+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd460164810 con 0x7fd46015e440 2024-09-12T12:20:29.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.268+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46015e940 con 0x7fd46015e440 2024-09-12T12:20:29.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.268+0000 7fd45d600640 1 -- 172.21.15.144:0/3092643651 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd4580bf020 con 0x7fd46015e440 2024-09-12T12:20:29.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.268+0000 7fd45d600640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4400678c0 0x7fd440069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:29.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.268+0000 7fd45d600640 1 -- 172.21.15.144:0/3092643651 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fd458120fe0 con 0x7fd46015e440 2024-09-12T12:20:29.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.268+0000 7fd465600640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4400678c0 0x7fd440069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:29.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.268+0000 7fd465600640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4400678c0 0x7fd440069d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd460071160 tx=0x7fd454008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:29.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.272+0000 7fd45d600640 1 -- 172.21.15.144:0/3092643651 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd4580c6030 con 0x7fd46015e440 2024-09-12T12:20:29.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.460+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd46015cfe0 con 0x7fd46015e440 2024-09-12T12:20:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd45d600640 1 -- 172.21.15.144:0/3092643651 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5237 (secure 0 0 0) 0x7fd460159500 con 0x7fd46015e440 2024-09-12T12:20:29.463 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:29.463 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":98,"btime":"2024-09-12T12:20:27:230311+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6911,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3824078479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3824078479},{"type":"v1","addr":"172.21.15.144:6837","nonce":3824078479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2364982071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2364982071},{"type":"v1","addr":"172.21.15.165:6835","nonce":2364982071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1068048719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1068048719},{"type":"v1","addr":"172.21.15.144:6835","nonce":1068048719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:20:23.392012+0000","modified":"2024-09-12T12:20:26.388950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6834/3565473111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3565473111},{"type":"v1","addr":"172.21.15.165:6834","nonce":3565473111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8010,"qdb_cluster":[8010]},"id":8}]} 2024-09-12T12:20:29.464 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 98 2024-09-12T12:20:29.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4400678c0 msgr2=0x7fd440069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:29.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4400678c0 0x7fd440069d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd460071160 tx=0x7fd454008040 comp rx=0 tx=0).stop 2024-09-12T12:20:29.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd46015e440 msgr2=0x7fd4601652f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:29.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd46015e440 0x7fd4601652f0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fd4580af040 tx=0x7fd458019720 comp rx=0 tx=0).stop 2024-09-12T12:20:29.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 shutdown_connections 2024-09-12T12:20:29.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd4400678c0 0x7fd440069d80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd46015e440 0x7fd4601652f0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4600b7310 0x7fd460163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 --2- 172.21.15.144:0/3092643651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4600b47b0 0x7fd4600b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 >> 172.21.15.144:0/3092643651 conn(0x7fd46006f3e0 msgr2=0x7fd4600b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 shutdown_connections 2024-09-12T12:20:29.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:29.464+0000 7fd468000640 1 -- 172.21.15.144:0/3092643651 wait complete. 2024-09-12T12:20:29.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:20:23.392012+0000', 'modified': '2024-09-12T12:20:26.388950+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8010}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8010': {'gid': 8010, 'name': 'd', 'rank': 0, 'incarnation': 94, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.165:6834/3565473111', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6832', 'nonce': 3565473111}, {'type': 'v1', 'addr': '172.21.15.165:6834', 'nonce': 3565473111}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8010, 'qdb_cluster': [8010]} 2024-09-12T12:20:29.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:20:29.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T12:20:30.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f661be00640 1 Processor -- start 2024-09-12T12:20:30.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f661be00640 1 -- start start 2024-09-12T12:20:30.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f661be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6614071420 0x7f6614071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f661be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f66140ccf30 0x7f66140cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f661be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66140cd890 con 0x7f661415b4e0 2024-09-12T12:20:30.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f661be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f66140b45a0 con 0x7f6614071420 2024-09-12T12:20:30.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f661be00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f66140b3fe0 con 0x7f66140ccf30 2024-09-12T12:20:30.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6619400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f661415b4e0 0x7f66140b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35800/0 (socket says 172.21.15.144:35800) 2024-09-12T12:20:30.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6619400640 1 -- 172.21.15.144:0/4241106025 learned_addr learned my addr 172.21.15.144:0/4241106025 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:30.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6618a00640 1 --2- 172.21.15.144:0/4241106025 >> v2:172.21.15.144:3300/0 conn(0x7f6614071420 0x7f6614071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6618a00640 1 -- 172.21.15.144:0/4241106025 >> v2:172.21.15.165:3300/0 conn(0x7f66140ccf30 msgr2=0x7f66140cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6619e00640 1 --2- 172.21.15.144:0/4241106025 >> v2:172.21.15.165:3300/0 conn(0x7f66140ccf30 0x7f66140cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6618a00640 1 --2- 172.21.15.144:0/4241106025 >> v2:172.21.15.165:3300/0 conn(0x7f66140ccf30 0x7f66140cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6618a00640 1 -- 172.21.15.144:0/4241106025 >> v1:172.21.15.144:6789/0 conn(0x7f661415b4e0 legacy=0x7f66140b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6618a00640 1 -- 172.21.15.144:0/4241106025 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66140b42c0 con 0x7f6614071420 2024-09-12T12:20:30.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6613e00640 1 -- 172.21.15.144:0/4241106025 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 795999306 0 0) 0x7f66140cd890 con 0x7f661415b4e0 2024-09-12T12:20:30.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.028+0000 7f6619e00640 1 --2- 172.21.15.144:0/4241106025 >> v2:172.21.15.165:3300/0 conn(0x7f66140ccf30 0x7f66140cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:30.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f6618a00640 1 --2- 172.21.15.144:0/4241106025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614071420 0x7f6614071840 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f66140d0480 tx=0x7f660001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4424074e224f4da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f6613e00640 1 -- 172.21.15.144:0/4241106025 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66000ab650 con 0x7f6614071420 2024-09-12T12:20:30.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f6613e00640 1 -- 172.21.15.144:0/4241106025 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66000b0070 con 0x7f6614071420 2024-09-12T12:20:30.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f6613e00640 1 -- 172.21.15.144:0/4241106025 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66000aba10 con 0x7f6614071420 2024-09-12T12:20:30.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f661be00640 1 -- 172.21.15.144:0/4241106025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614071420 msgr2=0x7f6614071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f661be00640 1 --2- 172.21.15.144:0/4241106025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614071420 0x7f6614071840 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f66140d0480 tx=0x7f660001c450 comp rx=0 tx=0).stop 2024-09-12T12:20:30.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f661be00640 1 -- 172.21.15.144:0/4241106025 shutdown_connections 2024-09-12T12:20:30.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f661be00640 1 --2- 172.21.15.144:0/4241106025 >> v2:172.21.15.165:3300/0 conn(0x7f66140ccf30 0x7f66140cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f661be00640 1 --2- 172.21.15.144:0/4241106025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6614071420 0x7f6614071840 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f661be00640 1 -- 172.21.15.144:0/4241106025 >> 172.21.15.144:0/4241106025 conn(0x7f661406d0d0 msgr2=0x7f661406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:30.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f661be00640 1 -- 172.21.15.144:0/4241106025 shutdown_connections 2024-09-12T12:20:30.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f661be00640 1 -- 172.21.15.144:0/4241106025 wait complete. 2024-09-12T12:20:30.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.032+0000 7f661be00640 1 Processor -- start 2024-09-12T12:20:30.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f661be00640 1 -- start start 2024-09-12T12:20:30.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f661be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6614071420 0x7f6614159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f661be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 0x7f66141f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f661be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f661415b4e0 0x7f6614152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f661be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f661415b8c0 con 0x7f661415b4e0 2024-09-12T12:20:30.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f661be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f66140cdef0 con 0x7f6614071420 2024-09-12T12:20:30.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f661be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f661415dbf0 con 0x7f66140ccf30 2024-09-12T12:20:30.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f661415b4e0 0x7f6614152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f661415b4e0 0x7f6614152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46882/0 (socket says 172.21.15.144:46882) 2024-09-12T12:20:30.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619e00640 1 -- 172.21.15.144:0/2564491455 learned_addr learned my addr 172.21.15.144:0/2564491455 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:30.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619400640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6614071420 0x7f6614159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6618a00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 0x7f66141f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619e00640 1 -- 172.21.15.144:0/2564491455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 msgr2=0x7f66141f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619e00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 0x7f66141f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619e00640 1 -- 172.21.15.144:0/2564491455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6614071420 msgr2=0x7f6614159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619e00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6614071420 0x7f6614159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619e00640 1 -- 172.21.15.144:0/2564491455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661415cfe0 con 0x7f661415b4e0 2024-09-12T12:20:30.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6618a00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 0x7f66141f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:30.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6619e00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f661415b4e0 0x7f6614152060 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f660c00cef0 tx=0x7f660c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6611600640 1 -- 172.21.15.144:0/2564491455 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c01a070 con 0x7f661415b4e0 2024-09-12T12:20:30.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6611600640 1 -- 172.21.15.144:0/2564491455 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c00d860 con 0x7f661415b4e0 2024-09-12T12:20:30.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f661be00640 1 -- 172.21.15.144:0/2564491455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f661415d2c0 con 0x7f661415b4e0 2024-09-12T12:20:30.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f6611600640 1 -- 172.21.15.144:0/2564491455 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c00dc50 con 0x7f661415b4e0 2024-09-12T12:20:30.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.036+0000 7f661be00640 1 -- 172.21.15.144:0/2564491455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661415d880 con 0x7f661415b4e0 2024-09-12T12:20:30.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6611600640 1 -- 172.21.15.144:0/2564491455 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f660c01d070 con 0x7f661415b4e0 2024-09-12T12:20:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6611600640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6611600640 1 -- 172.21.15.144:0/2564491455 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f660c0866e0 con 0x7f661415b4e0 2024-09-12T12:20:30.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f661f28d000 1 Processor -- start 2024-09-12T12:20:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619400640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f661f28d000 1 -- start start 2024-09-12T12:20:30.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619400640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6608000f70 tx=0x7f6608007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f661f28d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a07b20 0x5639d2a07f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f661f28d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 0x5639d29bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f661f28d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d29be290 0x5639d29be670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f661f28d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5639d28a5b60 con 0x5639d29be290 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f661f28d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5639d280cc70 con 0x5639d2a08440 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f661f28d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5639d27b2ed0 con 0x5639d2a07b20 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d29be290 0x5639d29be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d29be290 0x5639d29be670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46892/0 (socket says 172.21.15.144:46892) 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619e00640 1 -- 172.21.15.144:0/1056010940 learned_addr learned my addr 172.21.15.144:0/1056010940 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619400640 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a07b20 0x5639d2a07f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6618a00640 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 0x5639d29bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619e00640 1 -- 172.21.15.144:0/1056010940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a07b20 msgr2=0x5639d2a07f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619e00640 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a07b20 0x5639d2a07f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619e00640 1 -- 172.21.15.144:0/1056010940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 msgr2=0x5639d29bdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619e00640 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 0x5639d29bdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6619e00640 1 -- 172.21.15.144:0/1056010940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d27c4e50 con 0x5639d29be290 2024-09-12T12:20:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.040+0000 7f6618a00640 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 0x5639d29bdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619e00640 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d29be290 0x5639d29be670 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f660c00ae50 tx=0x7f660c0568a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8ab72cc5d8d037 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6606000640 1 -- 172.21.15.144:0/1056010940 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c054d50 con 0x5639d29be290 2024-09-12T12:20:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6606000640 1 -- 172.21.15.144:0/1056010940 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c0530c0 con 0x5639d29be290 2024-09-12T12:20:30.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6606000640 1 -- 172.21.15.144:0/1056010940 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c05d2f0 con 0x5639d29be290 2024-09-12T12:20:30.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 -- 172.21.15.144:0/1056010940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d29be290 msgr2=0x5639d29be670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d29be290 0x5639d29be670 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f660c00ae50 tx=0x7f660c0568a0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 -- 172.21.15.144:0/1056010940 shutdown_connections 2024-09-12T12:20:30.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d29be290 0x5639d29be670 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 0x5639d29bdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 --2- 172.21.15.144:0/1056010940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a07b20 0x5639d2a07f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 -- 172.21.15.144:0/1056010940 >> 172.21.15.144:0/1056010940 conn(0x5639d29c4600 msgr2=0x5639d29bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 -- 172.21.15.144:0/1056010940 shutdown_connections 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 -- 172.21.15.144:0/1056010940 wait complete. 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 -- start start 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 Processor -- start 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d29c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a08440 0x5639d29c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d29c3390 0x5639d29c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5639d286eb00 con 0x5639d2a07b20 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5639d27e7360 con 0x5639d29c3390 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5639d27e42d0 con 0x5639d2a08440 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f661f28d000 10 client.0 _ll_register_callbacks cb 0x5639d29a9820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d29c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d29c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46900/0 (socket says 172.21.15.144:46900) 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619400640 1 -- 172.21.15.144:0/3875294407 learned_addr learned my addr 172.21.15.144:0/3875294407 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6618a00640 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a08440 0x5639d29c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619e00640 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d29c3390 0x5639d29c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619400640 1 -- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a08440 msgr2=0x5639d29c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619400640 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a08440 0x5639d29c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619400640 1 -- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d29c3390 msgr2=0x5639d29c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619400640 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d29c3390 0x5639d29c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619400640 1 -- 172.21.15.144:0/3875294407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639d27b3120 con 0x5639d2a07b20 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f6619400640 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d29c2e50 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f6608001d60 tx=0x7f6608000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5325c2075b35488e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.044+0000 7f65faa00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f65faa00640 1 -- 172.21.15.144:0/3875294407 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608014e40 con 0x5639d2a07b20 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f65faa00640 1 -- 172.21.15.144:0/3875294407 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f6608010040 con 0x5639d2a07b20 2024-09-12T12:20:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 -- 172.21.15.144:0/3875294407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f660c0530c0 con 0x5639d2a07b20 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f65faa00640 1 -- 172.21.15.144:0/3875294407 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f660802e050 con 0x5639d2a07b20 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 10 client.8145 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 -- 172.21.15.144:0/3875294407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x5639d27ac450 con 0x5639d2a07b20 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f65faa00640 1 -- 172.21.15.144:0/3875294407 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c0530c0 con 0x5639d2a07b20 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f65faa00640 1 -- 172.21.15.144:0/3875294407 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f6608031020 con 0x5639d2a07b20 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 10 client.8145 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 10 client.8145 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 20 client.8145 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5639d2a16280 0x5639d2a18670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 4 client.8145 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:20:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 -- 172.21.15.144:0/3875294407 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639d27a6c00 con 0x5639d2a16280 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f6618a00640 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5639d2a16280 0x5639d2a18670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f6618a00640 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5639d2a16280 0x5639d2a18670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b2958968248fc84 server_cookie=bc4510c1438caabe in_seq=0 out_seq=0 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f65faa00640 10 client.8145 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f65faa00640 1 -- 172.21.15.144:0/3875294407 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5639d27a6c00 con 0x5639d2a16280 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f65faa00640 10 client.8145 handle_command_reply: tid=0 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 client.8145 shutdown 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 -- 172.21.15.144:0/3875294407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 msgr2=0x5639d29c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d29c2e50 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f6608001d60 tx=0x7f6608000ee0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 -- 172.21.15.144:0/3875294407 shutdown_connections 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5639d2a16280 0x5639d2a18670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d29c3390 0x5639d29c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d2a08440 0x5639d29c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 --2- 172.21.15.144:0/3875294407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d29c2e50 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f65faa00640 0 client.8145 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:30.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 -- 172.21.15.144:0/3875294407 >> 172.21.15.144:0/3875294407 conn(0x5639d29be290 msgr2=0x5639d29bcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:30.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 -- 172.21.15.144:0/3875294407 shutdown_connections 2024-09-12T12:20:30.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 1 -- 172.21.15.144:0/3875294407 wait complete. 2024-09-12T12:20:30.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.048+0000 7f661f28d000 20 client.8145 trim_cache size 0 max 16384 2024-09-12T12:20:30.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f661f28d000 1 Processor -- start 2024-09-12T12:20:30.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f661f28d000 1 -- start start 2024-09-12T12:20:30.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f661f28d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d29c3390 0x5639d2a06cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f661f28d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d2a07230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f661f28d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 0x5639d2a18670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f661f28d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6614202f60 con 0x5639d2a07b20 2024-09-12T12:20:30.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f661f28d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f66140cfc00 con 0x5639d2a08440 2024-09-12T12:20:30.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f661f28d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f661415c7a0 con 0x5639d29c3390 2024-09-12T12:20:30.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6618a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d2a07230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6618a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d2a07230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46912/0 (socket says 172.21.15.144:46912) 2024-09-12T12:20:30.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6618a00640 1 -- 172.21.15.144:0/2055147558 learned_addr learned my addr 172.21.15.144:0/2055147558 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:30.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6618a00640 1 -- 172.21.15.144:0/2055147558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d29c3390 msgr2=0x5639d2a06cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6618a00640 1 --2- 172.21.15.144:0/2055147558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d29c3390 0x5639d2a06cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6618a00640 1 -- 172.21.15.144:0/2055147558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 msgr2=0x5639d2a18670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6618a00640 1 --2- 172.21.15.144:0/2055147558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 0x5639d2a18670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6618a00640 1 -- 172.21.15.144:0/2055147558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d2793fd0 con 0x5639d2a07b20 2024-09-12T12:20:30.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6618a00640 1 --2- 172.21.15.144:0/2055147558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d2a07230 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f660001a080 tx=0x7f66000a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a6966963223b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6605600640 1 -- 172.21.15.144:0/2055147558 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600003820 con 0x5639d2a07b20 2024-09-12T12:20:30.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6605600640 1 -- 172.21.15.144:0/2055147558 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66000b0040 con 0x5639d2a07b20 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.068+0000 7f6605600640 1 -- 172.21.15.144:0/2055147558 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600003bc0 con 0x5639d2a07b20 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- 172.21.15.144:0/2055147558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 msgr2=0x5639d2a07230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 --2- 172.21.15.144:0/2055147558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d2a07230 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f660001a080 tx=0x7f66000a7000 comp rx=0 tx=0).stop 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- 172.21.15.144:0/2055147558 shutdown_connections 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 --2- 172.21.15.144:0/2055147558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a08440 0x5639d2a18670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 --2- 172.21.15.144:0/2055147558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a07b20 0x5639d2a07230 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 --2- 172.21.15.144:0/2055147558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d29c3390 0x5639d2a06cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- 172.21.15.144:0/2055147558 >> 172.21.15.144:0/2055147558 conn(0x5639d29be290 msgr2=0x5639d29c2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- 172.21.15.144:0/2055147558 shutdown_connections 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- 172.21.15.144:0/2055147558 wait complete. 2024-09-12T12:20:30.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- start start 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 Processor -- start 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d29c3390 0x5639d2a1b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a07b20 0x5639d2a3f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a08440 0x5639d2a3f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5639d280bf80 con 0x5639d2a08440 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5639d27c4ca0 con 0x5639d2a07b20 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5639d28112a0 con 0x5639d29c3390 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 10 client.0 _ll_register_callbacks cb 0x7f6608005c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a08440 0x5639d2a3f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a08440 0x5639d2a3f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46924/0 (socket says 172.21.15.144:46924) 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619e00640 1 -- 172.21.15.144:0/830745266 learned_addr learned my addr 172.21.15.144:0/830745266 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:30.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6618a00640 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a07b20 0x5639d2a3f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619400640 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d29c3390 0x5639d2a1b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619e00640 1 -- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d29c3390 msgr2=0x5639d2a1b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619e00640 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d29c3390 0x5639d2a1b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619e00640 1 -- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a07b20 msgr2=0x5639d2a3f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619e00640 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a07b20 0x5639d2a3f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619e00640 1 -- 172.21.15.144:0/830745266 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639d288f750 con 0x5639d2a08440 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f6619e00640 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a08440 0x5639d2a3f6b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f660c05afc0 tx=0x7f660c021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1359e302976136e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f65faa00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f65faa00640 1 -- 172.21.15.144:0/830745266 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c056820 con 0x5639d2a08440 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f65faa00640 1 -- 172.21.15.144:0/830745266 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f660c05f1a0 con 0x5639d2a08440 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- 172.21.15.144:0/830745266 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66000b0040 con 0x5639d2a08440 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f65faa00640 1 -- 172.21.15.144:0/830745266 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f660c07c050 con 0x5639d2a08440 2024-09-12T12:20:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 10 client.8151 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- 172.21.15.144:0/830745266 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x5639d279aa30 con 0x5639d2a08440 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f65faa00640 1 -- 172.21.15.144:0/830745266 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66000b0040 con 0x5639d2a08440 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f65faa00640 1 -- 172.21.15.144:0/830745266 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f660c05d0c0 con 0x5639d2a08440 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 10 client.8151 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 10 client.8151 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 20 client.8151 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5639d2a3fbf0 0x5639d2a83770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 4 client.8151 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.072+0000 7f661f28d000 1 -- 172.21.15.144:0/830745266 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "status"}) -- 0x5639d281a3a0 con 0x5639d2a3fbf0 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f6619400640 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5639d2a3fbf0 0x5639d2a83770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f6619400640 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5639d2a3fbf0 0x5639d2a83770 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452964bf2c8629c0 server_cookie=59405ef5bd34b742 in_seq=0 out_seq=0 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f65faa00640 10 client.8151 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f65faa00640 1 -- 172.21.15.144:0/830745266 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5639d281a3a0 con 0x5639d2a3fbf0 2024-09-12T12:20:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f65faa00640 10 client.8151 handle_command_reply: tid=0 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 client.8151 shutdown 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 -- 172.21.15.144:0/830745266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a08440 msgr2=0x5639d2a3f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a08440 0x5639d2a3f6b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f660c05afc0 tx=0x7f660c021070 comp rx=0 tx=0).stop 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 -- 172.21.15.144:0/830745266 shutdown_connections 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5639d2a3fbf0 0x5639d2a83770 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5639d2a08440 0x5639d2a3f6b0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5639d2a07b20 0x5639d2a3f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 --2- 172.21.15.144:0/830745266 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5639d29c3390 0x5639d2a1b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f65faa00640 0 client.8151 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 -- 172.21.15.144:0/830745266 >> 172.21.15.144:0/830745266 conn(0x5639d29be290 msgr2=0x5639d2a05ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 -- 172.21.15.144:0/830745266 shutdown_connections 2024-09-12T12:20:30.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 1 -- 172.21.15.144:0/830745266 wait complete. 2024-09-12T12:20:30.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661f28d000 20 client.8151 trim_cache size 0 max 16384 2024-09-12T12:20:30.080 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:20:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:20:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:20:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 8010, 2024-09-12T12:20:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:20:30.080 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:20:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:20:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.0857445889999999, 2024-09-12T12:20:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 98, 2024-09-12T12:20:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 129, 2024-09-12T12:20:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 129, 2024-09-12T12:20:30.081 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.956718751 2024-09-12T12:20:30.081 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 -- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 msgr2=0x7f65f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6608000f70 tx=0x7f6608007c10 comp rx=0 tx=0).stop 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 -- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f661415b4e0 msgr2=0x7f6614152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f661415b4e0 0x7f6614152060 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f660c00cef0 tx=0x7f660c00a710 comp rx=0 tx=0).stop 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 -- 172.21.15.144:0/2564491455 shutdown_connections 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f65f40678c0 0x7f65f4069d80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f661415b4e0 0x7f6614152060 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66140ccf30 0x7f66141f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 --2- 172.21.15.144:0/2564491455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6614071420 0x7f6614159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 -- 172.21.15.144:0/2564491455 >> 172.21.15.144:0/2564491455 conn(0x7f661406d0d0 msgr2=0x7f66140b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 -- 172.21.15.144:0/2564491455 shutdown_connections 2024-09-12T12:20:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.076+0000 7f661be00640 1 -- 172.21.15.144:0/2564491455 wait complete. 2024-09-12T12:20:30.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:20:30.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec1800640 1 Processor -- start 2024-09-12T12:20:30.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec1800640 1 -- start start 2024-09-12T12:20:30.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec1800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2ebc15e080 0x7f2ebc15e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15f3b0 0x7f2ebc06f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec1800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ebc06ed60 con 0x7f2ebc0d18c0 2024-09-12T12:20:30.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec1800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2ebc06e7a0 con 0x7f2ebc15e080 2024-09-12T12:20:30.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc06ea80 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ebb400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2ebc0d18c0 0x7f2ebc162810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35816/0 (socket says 172.21.15.144:35816) 2024-09-12T12:20:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ebb400640 1 -- 172.21.15.144:0/2595103976 learned_addr learned my addr 172.21.15.144:0/2595103976 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec0e00640 1 --2- 172.21.15.144:0/2595103976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15f3b0 0x7f2ebc06f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ebbe00640 1 --2- 172.21.15.144:0/2595103976 >> v2:172.21.15.165:3300/0 conn(0x7f2ebc15e080 0x7f2ebc15e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ebaa00640 1 -- 172.21.15.144:0/2595103976 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019314468 0 0) 0x7f2ebc06ed60 con 0x7f2ebc0d18c0 2024-09-12T12:20:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ebaa00640 1 -- 172.21.15.144:0/2595103976 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ea0003530 con 0x7f2ebc0d18c0 2024-09-12T12:20:30.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec0e00640 1 -- 172.21.15.144:0/2595103976 >> v2:172.21.15.165:3300/0 conn(0x7f2ebc15e080 msgr2=0x7f2ebc15e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:30.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec0e00640 1 --2- 172.21.15.144:0/2595103976 >> v2:172.21.15.165:3300/0 conn(0x7f2ebc15e080 0x7f2ebc15e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec0e00640 1 -- 172.21.15.144:0/2595103976 >> v1:172.21.15.144:6789/0 conn(0x7f2ebc0d18c0 legacy=0x7f2ebc162810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.232+0000 7f2ec0e00640 1 -- 172.21.15.144:0/2595103976 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc162010 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ec0e00640 1 --2- 172.21.15.144:0/2595103976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15f3b0 0x7f2ebc06f400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009d90 tx=0x7f2eb401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae59d6c25ee05bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ebaa00640 1 -- 172.21.15.144:0/2595103976 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40b2070 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ebaa00640 1 -- 172.21.15.144:0/2595103976 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb40a57a0 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ebaa00640 1 -- 172.21.15.144:0/2595103976 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40a5b70 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ec1800640 1 -- 172.21.15.144:0/2595103976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15f3b0 msgr2=0x7f2ebc06f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ec1800640 1 --2- 172.21.15.144:0/2595103976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15f3b0 0x7f2ebc06f400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009d90 tx=0x7f2eb401c8e0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ec1800640 1 -- 172.21.15.144:0/2595103976 shutdown_connections 2024-09-12T12:20:30.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ec1800640 1 --2- 172.21.15.144:0/2595103976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15f3b0 0x7f2ebc06f400 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ec1800640 1 --2- 172.21.15.144:0/2595103976 >> v2:172.21.15.165:3300/0 conn(0x7f2ebc15e080 0x7f2ebc15e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ec1800640 1 -- 172.21.15.144:0/2595103976 >> 172.21.15.144:0/2595103976 conn(0x7f2ebc06c010 msgr2=0x7f2ebc0b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:30.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ec1800640 1 -- 172.21.15.144:0/2595103976 shutdown_connections 2024-09-12T12:20:30.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.236+0000 7f2ec1800640 1 -- 172.21.15.144:0/2595103976 wait complete. 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 Processor -- start 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 -- start start 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ebc0d18c0 0x7f2ebc0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15e080 0x7f2ebc0ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ebc15f3b0 0x7f2ebc0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc16b090 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc0b5e50 con 0x7f2ebc0d18c0 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc16b210 con 0x7f2ebc15e080 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ebc15f3b0 0x7f2ebc0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ebc15f3b0 0x7f2ebc0cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46940/0 (socket says 172.21.15.144:46940) 2024-09-12T12:20:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec0e00640 1 -- 172.21.15.144:0/1820696580 learned_addr learned my addr 172.21.15.144:0/1820696580 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ebb400640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15e080 0x7f2ebc0ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ebbe00640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ebc0d18c0 0x7f2ebc0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec0e00640 1 -- 172.21.15.144:0/1820696580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15e080 msgr2=0x7f2ebc0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec0e00640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15e080 0x7f2ebc0ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec0e00640 1 -- 172.21.15.144:0/1820696580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ebc0d18c0 msgr2=0x7f2ebc0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec0e00640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ebc0d18c0 0x7f2ebc0d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec0e00640 1 -- 172.21.15.144:0/1820696580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc0cbb50 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec0e00640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ebc15f3b0 0x7f2ebc0cd130 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40b0040 tx=0x7f2eb4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2eb3e00640 1 -- 172.21.15.144:0/1820696580 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40b2050 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2eb3e00640 1 -- 172.21.15.144:0/1820696580 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb40be070 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ebc0cbe30 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2eb3e00640 1 -- 172.21.15.144:0/1820696580 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40ad890 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.240+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ebc0cc3f0 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.244+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ebc15e460 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.244+0000 7f2eb3e00640 1 -- 172.21.15.144:0/1820696580 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2eb40ada30 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.244+0000 7f2eb3e00640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e9c0678f0 0x7f2e9c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:30.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.244+0000 7f2eb3e00640 1 -- 172.21.15.144:0/1820696580 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f2eb4120820 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.244+0000 7f2ebbe00640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e9c0678f0 0x7f2e9c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:30.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.244+0000 7f2ebbe00640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e9c0678f0 0x7f2e9c069db0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009ac0 tx=0x7f2eac009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:30.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.252+0000 7f2eb3e00640 1 -- 172.21.15.144:0/1820696580 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2eb40c7020 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2ebc06cee0 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2eb3e00640 1 -- 172.21.15.144:0/1820696580 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v98) ==== 53+0+73 (secure 0 0 0) 0x7f2eb4016560 con 0x7f2ebc15f3b0 2024-09-12T12:20:30.444 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:20:30.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e9c0678f0 msgr2=0x7f2e9c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e9c0678f0 0x7f2e9c069db0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009ac0 tx=0x7f2eac009190 comp rx=0 tx=0).stop 2024-09-12T12:20:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ebc15f3b0 msgr2=0x7f2ebc0cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ebc15f3b0 0x7f2ebc0cd130 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40b0040 tx=0x7f2eb4019680 comp rx=0 tx=0).stop 2024-09-12T12:20:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 shutdown_connections 2024-09-12T12:20:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e9c0678f0 0x7f2e9c069db0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ebc15f3b0 0x7f2ebc0cd130 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2ebc15e080 0x7f2ebc0ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 --2- 172.21.15.144:0/1820696580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ebc0d18c0 0x7f2ebc0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 >> 172.21.15.144:0/1820696580 conn(0x7f2ebc06c010 msgr2=0x7f2ebc15fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.444+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 shutdown_connections 2024-09-12T12:20:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30.448+0000 7f2ec1800640 1 -- 172.21.15.144:0/1820696580 wait complete. 2024-09-12T12:20:30.465 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:20:30.466 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:20:30.466 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:20:30.466 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:20:30.466 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:20:30.466 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:20:30.466 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:20:30.466 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:20:30.466 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:20:30.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:30.467 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:20:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41952sec preferred_lft 41952sec 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:20:30.478 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:20:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:20:30.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:30.480 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:20:30.535 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:20:30.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:30.537 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:20:30.593 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:20:30.594 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:20:30.595 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:20:30.595 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:30.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:20:30.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:20:30.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:20:30.595 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:30.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:20:30.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:30.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:30.730 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:20:30.782 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:20:30.782 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:20:30.783 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:20:30.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:30.783 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:20:30.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:20:30.845 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:20:30.894 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:20:30.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:20:30.894 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:20:30.945 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:20:30.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:30.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:20:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:20:31.035 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:20:31.049 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:20:31.049 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:20:31.049 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:20:31.049 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:20:31.050 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:20:31.053 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:20:31.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:31.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:20:31.073 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:20:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:31.179 INFO:teuthology.orchestra.run.smithi144.stdout:client8160 2024-09-12T12:20:31.179 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:20:31.179 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:31.188 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:31.188 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:31.188 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.0 2024-09-12T12:20:31.188 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:31.188 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:31.188 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:31.188 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:31.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.320 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195869 s, 53.5 MB/s 2024-09-12T12:20:31.340 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.340 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.340 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165868 s, 63.2 MB/s 2024-09-12T12:20:31.358 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.358 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.358 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148504 s, 70.6 MB/s 2024-09-12T12:20:31.374 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.374 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.374 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128979 s, 81.3 MB/s 2024-09-12T12:20:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014935 s, 70.2 MB/s 2024-09-12T12:20:31.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.409 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149685 s, 70.1 MB/s 2024-09-12T12:20:31.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.430 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168798 s, 62.1 MB/s 2024-09-12T12:20:31.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.449 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157255 s, 66.7 MB/s 2024-09-12T12:20:31.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.466 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141805 s, 73.9 MB/s 2024-09-12T12:20:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173397 s, 60.5 MB/s 2024-09-12T12:20:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167771 s, 62.5 MB/s 2024-09-12T12:20:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159526 s, 65.7 MB/s 2024-09-12T12:20:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142204 s, 73.7 MB/s 2024-09-12T12:20:31.563 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.563 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.563 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178963 s, 58.6 MB/s 2024-09-12T12:20:31.579 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.580 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134344 s, 78.1 MB/s 2024-09-12T12:20:31.598 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.598 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.598 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150314 s, 69.8 MB/s 2024-09-12T12:20:31.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.617 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015999 s, 65.5 MB/s 2024-09-12T12:20:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016274 s, 64.4 MB/s 2024-09-12T12:20:31.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.653 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137781 s, 76.1 MB/s 2024-09-12T12:20:31.669 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.669 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.669 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130462 s, 80.4 MB/s 2024-09-12T12:20:31.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.689 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160823 s, 65.2 MB/s 2024-09-12T12:20:31.706 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.706 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.706 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137644 s, 76.2 MB/s 2024-09-12T12:20:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.723 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143294 s, 73.2 MB/s 2024-09-12T12:20:31.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.742 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163019 s, 64.3 MB/s 2024-09-12T12:20:31.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143576 s, 73.0 MB/s 2024-09-12T12:20:31.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.780 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173928 s, 60.3 MB/s 2024-09-12T12:20:31.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.797 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137431 s, 76.3 MB/s 2024-09-12T12:20:31.813 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.813 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.813 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136666 s, 76.7 MB/s 2024-09-12T12:20:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146944 s, 71.4 MB/s 2024-09-12T12:20:31.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.849 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145869 s, 71.9 MB/s 2024-09-12T12:20:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172927 s, 60.6 MB/s 2024-09-12T12:20:31.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.887 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149801 s, 70.0 MB/s 2024-09-12T12:20:31.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:31.895 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:31.895 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:31.895 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.1 2024-09-12T12:20:31.895 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:31.895 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:31.895 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:31.895 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:31.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:31.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.964 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014608 s, 71.8 MB/s 2024-09-12T12:20:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161587 s, 64.9 MB/s 2024-09-12T12:20:32.000 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.000 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.000 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146936 s, 71.4 MB/s 2024-09-12T12:20:32.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.018 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152347 s, 68.8 MB/s 2024-09-12T12:20:32.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.034 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138734 s, 75.6 MB/s 2024-09-12T12:20:32.053 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.053 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.053 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156493 s, 67.0 MB/s 2024-09-12T12:20:32.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.068 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125737 s, 83.4 MB/s 2024-09-12T12:20:32.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.086 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150149 s, 69.8 MB/s 2024-09-12T12:20:32.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.102 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134684 s, 77.9 MB/s 2024-09-12T12:20:32.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.121 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162234 s, 64.6 MB/s 2024-09-12T12:20:32.138 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.138 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.138 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141758 s, 74.0 MB/s 2024-09-12T12:20:32.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.156 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156538 s, 67.0 MB/s 2024-09-12T12:20:32.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.171 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118983 s, 88.1 MB/s 2024-09-12T12:20:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.186 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126755 s, 82.7 MB/s 2024-09-12T12:20:32.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.203 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144364 s, 72.6 MB/s 2024-09-12T12:20:32.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126421 s, 82.9 MB/s 2024-09-12T12:20:32.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.234 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125194 s, 83.8 MB/s 2024-09-12T12:20:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.252 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152779 s, 68.6 MB/s 2024-09-12T12:20:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132332 s, 79.2 MB/s 2024-09-12T12:20:32.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138166 s, 75.9 MB/s 2024-09-12T12:20:32.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.302 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140042 s, 74.9 MB/s 2024-09-12T12:20:32.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.319 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153712 s, 68.2 MB/s 2024-09-12T12:20:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142217 s, 73.7 MB/s 2024-09-12T12:20:32.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.353 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138672 s, 75.6 MB/s 2024-09-12T12:20:32.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.368 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127284 s, 82.4 MB/s 2024-09-12T12:20:32.386 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.386 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.386 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154269 s, 68.0 MB/s 2024-09-12T12:20:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.402 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128547 s, 81.6 MB/s 2024-09-12T12:20:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.416 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117948 s, 88.9 MB/s 2024-09-12T12:20:32.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.433 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138501 s, 75.7 MB/s 2024-09-12T12:20:32.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.448 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126624 s, 82.8 MB/s 2024-09-12T12:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129916 s, 80.7 MB/s 2024-09-12T12:20:32.481 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.481 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.481 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139772 s, 75.0 MB/s 2024-09-12T12:20:32.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:32.488 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:32.488 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:32.488 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.2 2024-09-12T12:20:32.488 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:32.488 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:32.488 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:32.489 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:32.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:32.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.557 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145832 s, 71.9 MB/s 2024-09-12T12:20:32.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.573 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137789 s, 76.1 MB/s 2024-09-12T12:20:32.589 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.589 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.589 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129299 s, 81.1 MB/s 2024-09-12T12:20:32.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.605 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135741 s, 77.2 MB/s 2024-09-12T12:20:32.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.622 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141219 s, 74.3 MB/s 2024-09-12T12:20:32.639 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.639 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.639 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138645 s, 75.6 MB/s 2024-09-12T12:20:32.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.656 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142649 s, 73.5 MB/s 2024-09-12T12:20:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.672 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134632 s, 77.9 MB/s 2024-09-12T12:20:32.691 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.691 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.691 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167443 s, 62.6 MB/s 2024-09-12T12:20:32.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.708 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142585 s, 73.5 MB/s 2024-09-12T12:20:32.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.724 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127841 s, 82.0 MB/s 2024-09-12T12:20:32.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.744 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168984 s, 62.1 MB/s 2024-09-12T12:20:32.762 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.763 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.763 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165382 s, 63.4 MB/s 2024-09-12T12:20:32.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.782 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167108 s, 62.7 MB/s 2024-09-12T12:20:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.797 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122095 s, 85.9 MB/s 2024-09-12T12:20:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.814 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143337 s, 73.2 MB/s 2024-09-12T12:20:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.832 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016027 s, 65.4 MB/s 2024-09-12T12:20:32.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.849 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134017 s, 78.2 MB/s 2024-09-12T12:20:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138369 s, 75.8 MB/s 2024-09-12T12:20:32.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.881 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136224 s, 77.0 MB/s 2024-09-12T12:20:32.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.897 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127237 s, 82.4 MB/s 2024-09-12T12:20:32.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.913 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137044 s, 76.5 MB/s 2024-09-12T12:20:32.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.930 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142346 s, 73.7 MB/s 2024-09-12T12:20:32.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.946 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133439 s, 78.6 MB/s 2024-09-12T12:20:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.965 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158148 s, 66.3 MB/s 2024-09-12T12:20:32.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.981 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137718 s, 76.1 MB/s 2024-09-12T12:20:32.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:32.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:32.997 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131166 s, 79.9 MB/s 2024-09-12T12:20:33.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.014 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144622 s, 72.5 MB/s 2024-09-12T12:20:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.029 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126708 s, 82.8 MB/s 2024-09-12T12:20:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123455 s, 84.9 MB/s 2024-09-12T12:20:33.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.061 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139394 s, 75.2 MB/s 2024-09-12T12:20:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138747 s, 75.6 MB/s 2024-09-12T12:20:33.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:33.085 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:33.085 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:33.085 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.3 2024-09-12T12:20:33.085 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:33.085 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:33.085 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:33.085 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:33.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:33.152 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.153 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140573 s, 74.6 MB/s 2024-09-12T12:20:33.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.169 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140568 s, 74.6 MB/s 2024-09-12T12:20:33.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.185 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131191 s, 79.9 MB/s 2024-09-12T12:20:33.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.201 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133004 s, 78.8 MB/s 2024-09-12T12:20:33.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.220 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160827 s, 65.2 MB/s 2024-09-12T12:20:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.235 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01269 s, 82.6 MB/s 2024-09-12T12:20:33.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.252 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137115 s, 76.5 MB/s 2024-09-12T12:20:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125847 s, 83.3 MB/s 2024-09-12T12:20:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158307 s, 66.2 MB/s 2024-09-12T12:20:33.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132941 s, 78.9 MB/s 2024-09-12T12:20:33.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.318 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136238 s, 77.0 MB/s 2024-09-12T12:20:33.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.333 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130258 s, 80.5 MB/s 2024-09-12T12:20:33.349 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.349 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.349 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013215 s, 79.3 MB/s 2024-09-12T12:20:33.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012565 s, 83.5 MB/s 2024-09-12T12:20:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149354 s, 70.2 MB/s 2024-09-12T12:20:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138093 s, 75.9 MB/s 2024-09-12T12:20:33.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.415 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.415 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132779 s, 79.0 MB/s 2024-09-12T12:20:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132076 s, 79.4 MB/s 2024-09-12T12:20:33.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.446 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128389 s, 81.7 MB/s 2024-09-12T12:20:33.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.462 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129849 s, 80.8 MB/s 2024-09-12T12:20:33.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.479 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014436 s, 72.6 MB/s 2024-09-12T12:20:33.494 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.494 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.494 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125303 s, 83.7 MB/s 2024-09-12T12:20:33.511 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.512 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146428 s, 71.6 MB/s 2024-09-12T12:20:33.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.528 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014185 s, 73.9 MB/s 2024-09-12T12:20:33.544 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.544 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133603 s, 78.5 MB/s 2024-09-12T12:20:33.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012277 s, 85.4 MB/s 2024-09-12T12:20:33.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.576 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136451 s, 76.8 MB/s 2024-09-12T12:20:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.592 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139079 s, 75.4 MB/s 2024-09-12T12:20:33.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.608 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.608 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127055 s, 82.5 MB/s 2024-09-12T12:20:33.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.625 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141245 s, 74.2 MB/s 2024-09-12T12:20:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132032 s, 79.4 MB/s 2024-09-12T12:20:33.655 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.656 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128374 s, 81.7 MB/s 2024-09-12T12:20:33.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:33.663 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:33.663 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:33.663 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.4 2024-09-12T12:20:33.663 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:33.663 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:33.664 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:33.664 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:33.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:33.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.773 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013131 s, 79.9 MB/s 2024-09-12T12:20:33.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.789 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137681 s, 76.2 MB/s 2024-09-12T12:20:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140191 s, 74.8 MB/s 2024-09-12T12:20:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131887 s, 79.5 MB/s 2024-09-12T12:20:33.838 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.838 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.838 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136562 s, 76.8 MB/s 2024-09-12T12:20:33.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.854 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134217 s, 78.1 MB/s 2024-09-12T12:20:33.873 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.874 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169281 s, 61.9 MB/s 2024-09-12T12:20:33.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.891 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.891 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140081 s, 74.9 MB/s 2024-09-12T12:20:33.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.907 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135848 s, 77.2 MB/s 2024-09-12T12:20:33.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.923 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.923 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135289 s, 77.5 MB/s 2024-09-12T12:20:33.938 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.938 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.938 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130025 s, 80.6 MB/s 2024-09-12T12:20:33.954 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.954 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.954 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129202 s, 81.2 MB/s 2024-09-12T12:20:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126221 s, 83.1 MB/s 2024-09-12T12:20:33.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:33.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:33.986 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137568 s, 76.2 MB/s 2024-09-12T12:20:34.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.002 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.002 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133525 s, 78.5 MB/s 2024-09-12T12:20:34.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.018 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134125 s, 78.2 MB/s 2024-09-12T12:20:34.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.033 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128435 s, 81.6 MB/s 2024-09-12T12:20:34.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129227 s, 81.1 MB/s 2024-09-12T12:20:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.065 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131978 s, 79.5 MB/s 2024-09-12T12:20:34.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.085 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165917 s, 63.2 MB/s 2024-09-12T12:20:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.103 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163956 s, 64.0 MB/s 2024-09-12T12:20:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.119 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127534 s, 82.2 MB/s 2024-09-12T12:20:34.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.137 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154153 s, 68.0 MB/s 2024-09-12T12:20:34.157 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.157 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.157 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163855 s, 64.0 MB/s 2024-09-12T12:20:34.173 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.173 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.173 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131189 s, 79.9 MB/s 2024-09-12T12:20:34.189 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.190 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.190 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138297 s, 75.8 MB/s 2024-09-12T12:20:34.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124517 s, 84.2 MB/s 2024-09-12T12:20:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127834 s, 82.0 MB/s 2024-09-12T12:20:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014198 s, 73.9 MB/s 2024-09-12T12:20:34.256 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.256 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.256 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162339 s, 64.6 MB/s 2024-09-12T12:20:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.272 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.273 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136256 s, 77.0 MB/s 2024-09-12T12:20:34.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.288 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129517 s, 81.0 MB/s 2024-09-12T12:20:34.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:34.295 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:34.296 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:34.296 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.5 2024-09-12T12:20:34.296 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:34.296 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:34.296 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:34.296 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:34.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:34.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.363 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130255 s, 80.5 MB/s 2024-09-12T12:20:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134783 s, 77.8 MB/s 2024-09-12T12:20:34.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.396 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138648 s, 75.6 MB/s 2024-09-12T12:20:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.413 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015134 s, 69.3 MB/s 2024-09-12T12:20:34.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.430 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143663 s, 73.0 MB/s 2024-09-12T12:20:34.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.448 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149097 s, 70.3 MB/s 2024-09-12T12:20:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133562 s, 78.5 MB/s 2024-09-12T12:20:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.482 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154791 s, 67.7 MB/s 2024-09-12T12:20:34.502 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.503 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169685 s, 61.8 MB/s 2024-09-12T12:20:34.519 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.519 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.519 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138995 s, 75.4 MB/s 2024-09-12T12:20:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153762 s, 68.2 MB/s 2024-09-12T12:20:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.553 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133807 s, 78.4 MB/s 2024-09-12T12:20:34.570 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.570 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.570 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141978 s, 73.9 MB/s 2024-09-12T12:20:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.585 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129861 s, 80.7 MB/s 2024-09-12T12:20:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.601 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131541 s, 79.7 MB/s 2024-09-12T12:20:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.617 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127122 s, 82.5 MB/s 2024-09-12T12:20:34.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.633 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131844 s, 79.5 MB/s 2024-09-12T12:20:34.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.650 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134397 s, 78.0 MB/s 2024-09-12T12:20:34.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.665 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133822 s, 78.4 MB/s 2024-09-12T12:20:34.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.684 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016173 s, 64.8 MB/s 2024-09-12T12:20:34.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.699 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129119 s, 81.2 MB/s 2024-09-12T12:20:34.714 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.715 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127104 s, 82.5 MB/s 2024-09-12T12:20:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.731 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143463 s, 73.1 MB/s 2024-09-12T12:20:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132434 s, 79.2 MB/s 2024-09-12T12:20:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.764 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141323 s, 74.2 MB/s 2024-09-12T12:20:34.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.780 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136167 s, 77.0 MB/s 2024-09-12T12:20:34.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.796 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131477 s, 79.8 MB/s 2024-09-12T12:20:34.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.813 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138784 s, 75.6 MB/s 2024-09-12T12:20:34.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.829 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140302 s, 74.7 MB/s 2024-09-12T12:20:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121503 s, 86.3 MB/s 2024-09-12T12:20:34.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.860 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133496 s, 78.5 MB/s 2024-09-12T12:20:34.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.876 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129515 s, 81.0 MB/s 2024-09-12T12:20:34.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:34.883 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:34.883 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:34.883 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.6 2024-09-12T12:20:34.883 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:34.883 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:34.883 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:34.883 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:34.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:34.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:34.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:34.993 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013892 s, 75.5 MB/s 2024-09-12T12:20:35.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.008 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129881 s, 80.7 MB/s 2024-09-12T12:20:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128552 s, 81.6 MB/s 2024-09-12T12:20:35.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.041 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136219 s, 77.0 MB/s 2024-09-12T12:20:35.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.057 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130859 s, 80.1 MB/s 2024-09-12T12:20:35.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.073 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132386 s, 79.2 MB/s 2024-09-12T12:20:35.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.088 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127081 s, 82.5 MB/s 2024-09-12T12:20:35.103 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127428 s, 82.3 MB/s 2024-09-12T12:20:35.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.121 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144247 s, 72.7 MB/s 2024-09-12T12:20:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.138 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145973 s, 71.8 MB/s 2024-09-12T12:20:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145927 s, 71.9 MB/s 2024-09-12T12:20:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134662 s, 77.9 MB/s 2024-09-12T12:20:35.188 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.188 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.188 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140731 s, 74.5 MB/s 2024-09-12T12:20:35.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.203 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125199 s, 83.8 MB/s 2024-09-12T12:20:35.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125582 s, 83.5 MB/s 2024-09-12T12:20:35.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.237 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015489 s, 67.7 MB/s 2024-09-12T12:20:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130329 s, 80.5 MB/s 2024-09-12T12:20:35.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132839 s, 78.9 MB/s 2024-09-12T12:20:35.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139615 s, 75.1 MB/s 2024-09-12T12:20:35.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129173 s, 81.2 MB/s 2024-09-12T12:20:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.317 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135164 s, 77.6 MB/s 2024-09-12T12:20:35.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.337 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017371 s, 60.4 MB/s 2024-09-12T12:20:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145451 s, 72.1 MB/s 2024-09-12T12:20:35.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.371 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134655 s, 77.9 MB/s 2024-09-12T12:20:35.386 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.387 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.387 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127861 s, 82.0 MB/s 2024-09-12T12:20:35.404 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.404 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.404 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143907 s, 72.9 MB/s 2024-09-12T12:20:35.419 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.419 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.419 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128427 s, 81.6 MB/s 2024-09-12T12:20:35.434 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.434 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.434 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125467 s, 83.6 MB/s 2024-09-12T12:20:35.450 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.450 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.450 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133151 s, 78.8 MB/s 2024-09-12T12:20:35.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.467 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140094 s, 74.8 MB/s 2024-09-12T12:20:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.482 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127833 s, 82.0 MB/s 2024-09-12T12:20:35.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.499 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138816 s, 75.5 MB/s 2024-09-12T12:20:35.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:35.506 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:35.506 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:35.507 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.7 2024-09-12T12:20:35.507 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:35.507 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:35.507 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:35.507 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:35.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:35.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.577 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.577 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146449 s, 71.6 MB/s 2024-09-12T12:20:35.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.594 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145295 s, 72.2 MB/s 2024-09-12T12:20:35.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.611 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143929 s, 72.9 MB/s 2024-09-12T12:20:35.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.626 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128733 s, 81.5 MB/s 2024-09-12T12:20:35.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.642 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133335 s, 78.6 MB/s 2024-09-12T12:20:35.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144234 s, 72.7 MB/s 2024-09-12T12:20:35.675 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.675 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.675 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128744 s, 81.4 MB/s 2024-09-12T12:20:35.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.690 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126176 s, 83.1 MB/s 2024-09-12T12:20:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.707 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133182 s, 78.7 MB/s 2024-09-12T12:20:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137278 s, 76.4 MB/s 2024-09-12T12:20:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013238 s, 79.2 MB/s 2024-09-12T12:20:35.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.755 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125494 s, 83.6 MB/s 2024-09-12T12:20:35.771 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.771 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.771 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131395 s, 79.8 MB/s 2024-09-12T12:20:35.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.788 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144964 s, 72.3 MB/s 2024-09-12T12:20:35.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.801 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112497 s, 93.2 MB/s 2024-09-12T12:20:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147189 s, 71.2 MB/s 2024-09-12T12:20:35.834 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.835 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128721 s, 81.5 MB/s 2024-09-12T12:20:35.850 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.850 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.850 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125501 s, 83.6 MB/s 2024-09-12T12:20:35.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.866 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134615 s, 77.9 MB/s 2024-09-12T12:20:35.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.882 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130643 s, 80.3 MB/s 2024-09-12T12:20:35.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.897 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127778 s, 82.1 MB/s 2024-09-12T12:20:35.914 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.914 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.914 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140229 s, 74.8 MB/s 2024-09-12T12:20:35.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.930 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013559 s, 77.3 MB/s 2024-09-12T12:20:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.947 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146297 s, 71.7 MB/s 2024-09-12T12:20:35.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.963 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012876 s, 81.4 MB/s 2024-09-12T12:20:35.980 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.980 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.980 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140298 s, 74.7 MB/s 2024-09-12T12:20:35.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:35.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:35.996 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013493 s, 77.7 MB/s 2024-09-12T12:20:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138943 s, 75.5 MB/s 2024-09-12T12:20:36.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012943 s, 81.0 MB/s 2024-09-12T12:20:36.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.045 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142627 s, 73.5 MB/s 2024-09-12T12:20:36.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.060 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122877 s, 85.3 MB/s 2024-09-12T12:20:36.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143301 s, 73.2 MB/s 2024-09-12T12:20:36.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:36.085 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:36.085 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:36.086 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.8 2024-09-12T12:20:36.086 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:36.086 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:36.086 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:36.086 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:36.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:36.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.193 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142266 s, 73.7 MB/s 2024-09-12T12:20:36.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.210 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135286 s, 77.5 MB/s 2024-09-12T12:20:36.229 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.229 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.229 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169079 s, 62.0 MB/s 2024-09-12T12:20:36.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.244 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127275 s, 82.4 MB/s 2024-09-12T12:20:36.262 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.263 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.263 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151815 s, 69.1 MB/s 2024-09-12T12:20:36.278 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.278 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.278 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124892 s, 84.0 MB/s 2024-09-12T12:20:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.294 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129272 s, 81.1 MB/s 2024-09-12T12:20:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.311 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014199 s, 73.8 MB/s 2024-09-12T12:20:36.326 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.327 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.327 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134172 s, 78.2 MB/s 2024-09-12T12:20:36.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.342 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125924 s, 83.3 MB/s 2024-09-12T12:20:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.360 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155653 s, 67.4 MB/s 2024-09-12T12:20:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.377 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144612 s, 72.5 MB/s 2024-09-12T12:20:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124947 s, 83.9 MB/s 2024-09-12T12:20:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.409 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140674 s, 74.5 MB/s 2024-09-12T12:20:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146747 s, 71.5 MB/s 2024-09-12T12:20:36.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.443 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131448 s, 79.8 MB/s 2024-09-12T12:20:36.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.458 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127769 s, 82.1 MB/s 2024-09-12T12:20:36.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.475 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141359 s, 74.2 MB/s 2024-09-12T12:20:36.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.491 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134766 s, 77.8 MB/s 2024-09-12T12:20:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.507 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134148 s, 78.2 MB/s 2024-09-12T12:20:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124472 s, 84.2 MB/s 2024-09-12T12:20:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.539 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136384 s, 76.9 MB/s 2024-09-12T12:20:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.557 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147827 s, 70.9 MB/s 2024-09-12T12:20:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.576 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166581 s, 62.9 MB/s 2024-09-12T12:20:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133002 s, 78.8 MB/s 2024-09-12T12:20:36.608 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.608 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.608 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137851 s, 76.1 MB/s 2024-09-12T12:20:36.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.628 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166886 s, 62.8 MB/s 2024-09-12T12:20:36.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.644 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134269 s, 78.1 MB/s 2024-09-12T12:20:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129736 s, 80.8 MB/s 2024-09-12T12:20:36.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.674 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125583 s, 83.5 MB/s 2024-09-12T12:20:36.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.690 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131835 s, 79.5 MB/s 2024-09-12T12:20:36.706 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.706 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.706 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134495 s, 78.0 MB/s 2024-09-12T12:20:36.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:36.714 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:36.714 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:36.714 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.9 2024-09-12T12:20:36.714 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:36.714 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:36.715 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:36.715 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140384 s, 74.7 MB/s 2024-09-12T12:20:36.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.844 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166355 s, 63.0 MB/s 2024-09-12T12:20:36.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.860 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138975 s, 75.5 MB/s 2024-09-12T12:20:36.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.875 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126148 s, 83.1 MB/s 2024-09-12T12:20:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.891 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129208 s, 81.2 MB/s 2024-09-12T12:20:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.908 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143767 s, 72.9 MB/s 2024-09-12T12:20:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.923 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125021 s, 83.9 MB/s 2024-09-12T12:20:36.940 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.940 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.940 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138952 s, 75.5 MB/s 2024-09-12T12:20:36.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.955 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126625 s, 82.8 MB/s 2024-09-12T12:20:36.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.969 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108645 s, 96.5 MB/s 2024-09-12T12:20:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138394 s, 75.8 MB/s 2024-09-12T12:20:37.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.001 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134737 s, 77.8 MB/s 2024-09-12T12:20:37.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.018 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014072 s, 74.5 MB/s 2024-09-12T12:20:37.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.035 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132497 s, 79.1 MB/s 2024-09-12T12:20:37.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131574 s, 79.7 MB/s 2024-09-12T12:20:37.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.069 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147674 s, 71.0 MB/s 2024-09-12T12:20:37.085 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.085 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.085 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134609 s, 77.9 MB/s 2024-09-12T12:20:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.103 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144914 s, 72.4 MB/s 2024-09-12T12:20:37.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.119 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131728 s, 79.6 MB/s 2024-09-12T12:20:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.136 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145265 s, 72.2 MB/s 2024-09-12T12:20:37.152 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.153 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134671 s, 77.9 MB/s 2024-09-12T12:20:37.170 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.170 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.170 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138495 s, 75.7 MB/s 2024-09-12T12:20:37.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139657 s, 75.1 MB/s 2024-09-12T12:20:37.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.203 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131166 s, 79.9 MB/s 2024-09-12T12:20:37.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126317 s, 83.0 MB/s 2024-09-12T12:20:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137547 s, 76.2 MB/s 2024-09-12T12:20:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132233 s, 79.3 MB/s 2024-09-12T12:20:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.268 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139714 s, 75.1 MB/s 2024-09-12T12:20:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128558 s, 81.6 MB/s 2024-09-12T12:20:37.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01304 s, 80.4 MB/s 2024-09-12T12:20:37.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.316 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013264 s, 79.1 MB/s 2024-09-12T12:20:37.331 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.331 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.331 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012803 s, 81.9 MB/s 2024-09-12T12:20:37.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:37.338 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:37.338 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:37.338 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.10 2024-09-12T12:20:37.338 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:37.339 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:37.339 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:37.339 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:37.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.407 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.408 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147475 s, 71.1 MB/s 2024-09-12T12:20:37.422 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.422 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.422 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125348 s, 83.7 MB/s 2024-09-12T12:20:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.443 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171686 s, 61.1 MB/s 2024-09-12T12:20:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130428 s, 80.4 MB/s 2024-09-12T12:20:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.474 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132752 s, 79.0 MB/s 2024-09-12T12:20:37.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012541 s, 83.6 MB/s 2024-09-12T12:20:37.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.507 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141428 s, 74.1 MB/s 2024-09-12T12:20:37.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.521 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118479 s, 88.5 MB/s 2024-09-12T12:20:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.538 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142911 s, 73.4 MB/s 2024-09-12T12:20:37.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.553 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124688 s, 84.1 MB/s 2024-09-12T12:20:37.569 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.570 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.570 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135525 s, 77.4 MB/s 2024-09-12T12:20:37.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.586 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133824 s, 78.4 MB/s 2024-09-12T12:20:37.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.604 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158647 s, 66.1 MB/s 2024-09-12T12:20:37.623 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.623 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.624 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016428 s, 63.8 MB/s 2024-09-12T12:20:37.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112828 s, 92.9 MB/s 2024-09-12T12:20:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137625 s, 76.2 MB/s 2024-09-12T12:20:37.670 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.670 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.671 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136368 s, 76.9 MB/s 2024-09-12T12:20:37.686 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.686 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.686 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131929 s, 79.5 MB/s 2024-09-12T12:20:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142779 s, 73.4 MB/s 2024-09-12T12:20:37.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.719 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129922 s, 80.7 MB/s 2024-09-12T12:20:37.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.735 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01287 s, 81.5 MB/s 2024-09-12T12:20:37.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.755 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175292 s, 59.8 MB/s 2024-09-12T12:20:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140554 s, 74.6 MB/s 2024-09-12T12:20:37.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.788 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136607 s, 76.8 MB/s 2024-09-12T12:20:37.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.808 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016861 s, 62.2 MB/s 2024-09-12T12:20:37.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.823 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131593 s, 79.7 MB/s 2024-09-12T12:20:37.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.839 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131777 s, 79.6 MB/s 2024-09-12T12:20:37.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.854 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127874 s, 82.0 MB/s 2024-09-12T12:20:37.870 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.870 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.870 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131083 s, 80.0 MB/s 2024-09-12T12:20:37.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.887 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144176 s, 72.7 MB/s 2024-09-12T12:20:37.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.903 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133468 s, 78.6 MB/s 2024-09-12T12:20:37.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:37.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:37.920 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138404 s, 75.8 MB/s 2024-09-12T12:20:37.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:37.927 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:37.927 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:37.927 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.11 2024-09-12T12:20:37.927 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:37.927 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:37.928 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:37.928 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:38.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.041 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137228 s, 76.4 MB/s 2024-09-12T12:20:38.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.057 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.057 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129483 s, 81.0 MB/s 2024-09-12T12:20:38.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.072 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130876 s, 80.1 MB/s 2024-09-12T12:20:38.089 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.089 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.089 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139632 s, 75.1 MB/s 2024-09-12T12:20:38.108 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.109 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.109 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167566 s, 62.6 MB/s 2024-09-12T12:20:38.124 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.124 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.125 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129199 s, 81.2 MB/s 2024-09-12T12:20:38.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.140 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013339 s, 78.6 MB/s 2024-09-12T12:20:38.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.156 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128568 s, 81.6 MB/s 2024-09-12T12:20:38.172 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.172 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.172 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133425 s, 78.6 MB/s 2024-09-12T12:20:38.191 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.191 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.191 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163482 s, 64.1 MB/s 2024-09-12T12:20:38.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.206 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012263 s, 85.5 MB/s 2024-09-12T12:20:38.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.223 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136517 s, 76.8 MB/s 2024-09-12T12:20:38.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01235 s, 84.9 MB/s 2024-09-12T12:20:38.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.253 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130271 s, 80.5 MB/s 2024-09-12T12:20:38.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.269 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127776 s, 82.1 MB/s 2024-09-12T12:20:38.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.288 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163038 s, 64.3 MB/s 2024-09-12T12:20:38.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.305 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141778 s, 74.0 MB/s 2024-09-12T12:20:38.323 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.323 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.323 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148867 s, 70.4 MB/s 2024-09-12T12:20:38.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.339 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129673 s, 80.9 MB/s 2024-09-12T12:20:38.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.352 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113331 s, 92.5 MB/s 2024-09-12T12:20:38.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.370 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151924 s, 69.0 MB/s 2024-09-12T12:20:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.385 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124665 s, 84.1 MB/s 2024-09-12T12:20:38.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.402 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135759 s, 77.2 MB/s 2024-09-12T12:20:38.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.417 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128318 s, 81.7 MB/s 2024-09-12T12:20:38.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.433 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129743 s, 80.8 MB/s 2024-09-12T12:20:38.454 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.455 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.455 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193259 s, 54.3 MB/s 2024-09-12T12:20:38.470 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.470 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.470 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129076 s, 81.2 MB/s 2024-09-12T12:20:38.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.487 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140063 s, 74.9 MB/s 2024-09-12T12:20:38.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.504 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140705 s, 74.5 MB/s 2024-09-12T12:20:38.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.519 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123855 s, 84.7 MB/s 2024-09-12T12:20:38.536 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.536 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.536 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145335 s, 72.1 MB/s 2024-09-12T12:20:38.552 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.552 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014003 s, 74.9 MB/s 2024-09-12T12:20:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:38.560 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:38.560 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:38.560 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.12 2024-09-12T12:20:38.560 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:38.560 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:38.561 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:38.561 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:38.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:38.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.627 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128154 s, 81.8 MB/s 2024-09-12T12:20:38.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.643 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134637 s, 77.9 MB/s 2024-09-12T12:20:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140912 s, 74.4 MB/s 2024-09-12T12:20:38.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.674 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123479 s, 84.9 MB/s 2024-09-12T12:20:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162876 s, 64.4 MB/s 2024-09-12T12:20:38.709 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.709 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.709 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012922 s, 81.1 MB/s 2024-09-12T12:20:38.725 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.725 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.725 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133751 s, 78.4 MB/s 2024-09-12T12:20:38.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.740 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124965 s, 83.9 MB/s 2024-09-12T12:20:38.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.759 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159408 s, 65.8 MB/s 2024-09-12T12:20:38.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.775 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012809 s, 81.9 MB/s 2024-09-12T12:20:38.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.792 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145441 s, 72.1 MB/s 2024-09-12T12:20:38.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.808 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138173 s, 75.9 MB/s 2024-09-12T12:20:38.828 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.828 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.828 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168808 s, 62.1 MB/s 2024-09-12T12:20:38.844 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.844 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.844 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135406 s, 77.4 MB/s 2024-09-12T12:20:38.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.860 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128223 s, 81.8 MB/s 2024-09-12T12:20:38.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.875 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129673 s, 80.9 MB/s 2024-09-12T12:20:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127761 s, 82.1 MB/s 2024-09-12T12:20:38.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.907 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134573 s, 77.9 MB/s 2024-09-12T12:20:38.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.923 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.923 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131178 s, 79.9 MB/s 2024-09-12T12:20:38.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.937 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011983 s, 87.5 MB/s 2024-09-12T12:20:38.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.953 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132106 s, 79.4 MB/s 2024-09-12T12:20:38.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.968 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125245 s, 83.7 MB/s 2024-09-12T12:20:38.984 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:38.984 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:38.984 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131574 s, 79.7 MB/s 2024-09-12T12:20:39.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.001 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140194 s, 74.8 MB/s 2024-09-12T12:20:39.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.018 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140826 s, 74.5 MB/s 2024-09-12T12:20:39.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.033 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120391 s, 87.1 MB/s 2024-09-12T12:20:39.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.048 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129645 s, 80.9 MB/s 2024-09-12T12:20:39.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.063 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115929 s, 90.4 MB/s 2024-09-12T12:20:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127671 s, 82.1 MB/s 2024-09-12T12:20:39.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.094 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136756 s, 76.7 MB/s 2024-09-12T12:20:39.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.113 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159568 s, 65.7 MB/s 2024-09-12T12:20:39.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.134 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179483 s, 58.4 MB/s 2024-09-12T12:20:39.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:39.141 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:39.141 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:39.141 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.13 2024-09-12T12:20:39.141 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:39.141 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:39.141 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:39.142 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:39.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:39.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141762 s, 74.0 MB/s 2024-09-12T12:20:39.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.235 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133549 s, 78.5 MB/s 2024-09-12T12:20:39.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.252 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143247 s, 73.2 MB/s 2024-09-12T12:20:39.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.269 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134532 s, 77.9 MB/s 2024-09-12T12:20:39.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136501 s, 76.8 MB/s 2024-09-12T12:20:39.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.300 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.300 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122896 s, 85.3 MB/s 2024-09-12T12:20:39.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.316 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134918 s, 77.7 MB/s 2024-09-12T12:20:39.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.332 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134565 s, 77.9 MB/s 2024-09-12T12:20:39.347 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127165 s, 82.5 MB/s 2024-09-12T12:20:39.363 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.363 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.363 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130545 s, 80.3 MB/s 2024-09-12T12:20:39.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.381 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155278 s, 67.5 MB/s 2024-09-12T12:20:39.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.398 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013556 s, 77.4 MB/s 2024-09-12T12:20:39.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.416 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143309 s, 73.2 MB/s 2024-09-12T12:20:39.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.435 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165868 s, 63.2 MB/s 2024-09-12T12:20:39.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.451 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133074 s, 78.8 MB/s 2024-09-12T12:20:39.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.467 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129888 s, 80.7 MB/s 2024-09-12T12:20:39.483 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.483 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.483 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131861 s, 79.5 MB/s 2024-09-12T12:20:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.499 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129703 s, 80.8 MB/s 2024-09-12T12:20:39.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.517 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144003 s, 72.8 MB/s 2024-09-12T12:20:39.533 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.533 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.533 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134004 s, 78.2 MB/s 2024-09-12T12:20:39.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.550 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013174 s, 79.6 MB/s 2024-09-12T12:20:39.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.568 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150351 s, 69.7 MB/s 2024-09-12T12:20:39.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.584 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130425 s, 80.4 MB/s 2024-09-12T12:20:39.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.599 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122405 s, 85.7 MB/s 2024-09-12T12:20:39.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.617 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142513 s, 73.6 MB/s 2024-09-12T12:20:39.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.633 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129422 s, 81.0 MB/s 2024-09-12T12:20:39.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.649 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123841 s, 84.7 MB/s 2024-09-12T12:20:39.666 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.666 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.666 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140994 s, 74.4 MB/s 2024-09-12T12:20:39.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.684 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141658 s, 74.0 MB/s 2024-09-12T12:20:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.701 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147956 s, 70.9 MB/s 2024-09-12T12:20:39.718 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.718 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.718 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134268 s, 78.1 MB/s 2024-09-12T12:20:39.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.735 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142451 s, 73.6 MB/s 2024-09-12T12:20:39.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:39.743 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:39.743 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:39.743 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.14 2024-09-12T12:20:39.743 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:39.743 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:39.743 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:39.743 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:39.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:39.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.811 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135785 s, 77.2 MB/s 2024-09-12T12:20:39.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.827 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130086 s, 80.6 MB/s 2024-09-12T12:20:39.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.845 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013598 s, 77.1 MB/s 2024-09-12T12:20:39.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.860 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129436 s, 81.0 MB/s 2024-09-12T12:20:39.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.874 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114522 s, 91.6 MB/s 2024-09-12T12:20:39.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.890 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132919 s, 78.9 MB/s 2024-09-12T12:20:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124688 s, 84.1 MB/s 2024-09-12T12:20:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013217 s, 79.3 MB/s 2024-09-12T12:20:39.938 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.938 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.938 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127336 s, 82.3 MB/s 2024-09-12T12:20:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141644 s, 74.0 MB/s 2024-09-12T12:20:39.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.971 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137085 s, 76.5 MB/s 2024-09-12T12:20:39.988 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:39.988 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:39.988 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132978 s, 78.9 MB/s 2024-09-12T12:20:40.006 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.006 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.006 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154226 s, 68.0 MB/s 2024-09-12T12:20:40.026 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.026 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.026 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167232 s, 62.7 MB/s 2024-09-12T12:20:40.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.043 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138787 s, 75.6 MB/s 2024-09-12T12:20:40.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.059 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.059 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131516 s, 79.7 MB/s 2024-09-12T12:20:40.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.075 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127796 s, 82.1 MB/s 2024-09-12T12:20:40.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122617 s, 85.5 MB/s 2024-09-12T12:20:40.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.106 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129347 s, 81.1 MB/s 2024-09-12T12:20:40.122 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.122 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.122 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133105 s, 78.8 MB/s 2024-09-12T12:20:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166426 s, 63.0 MB/s 2024-09-12T12:20:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.158 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131283 s, 79.9 MB/s 2024-09-12T12:20:40.175 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.175 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.175 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144828 s, 72.4 MB/s 2024-09-12T12:20:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145736 s, 72.0 MB/s 2024-09-12T12:20:40.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.211 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153979 s, 68.1 MB/s 2024-09-12T12:20:40.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.227 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126458 s, 82.9 MB/s 2024-09-12T12:20:40.243 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.243 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.243 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131163 s, 79.9 MB/s 2024-09-12T12:20:40.257 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.257 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.257 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111315 s, 94.2 MB/s 2024-09-12T12:20:40.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.273 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127413 s, 82.3 MB/s 2024-09-12T12:20:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123511 s, 84.9 MB/s 2024-09-12T12:20:40.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.306 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013923 s, 75.3 MB/s 2024-09-12T12:20:40.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.321 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128208 s, 81.8 MB/s 2024-09-12T12:20:40.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:40.329 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:40.329 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:40.329 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.15 2024-09-12T12:20:40.329 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:40.329 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:40.329 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:40.329 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:40.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:40.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.441 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133991 s, 78.3 MB/s 2024-09-12T12:20:40.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.458 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138559 s, 75.7 MB/s 2024-09-12T12:20:40.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.474 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130677 s, 80.2 MB/s 2024-09-12T12:20:40.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.491 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140926 s, 74.4 MB/s 2024-09-12T12:20:40.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.507 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130894 s, 80.1 MB/s 2024-09-12T12:20:40.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.524 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142191 s, 73.7 MB/s 2024-09-12T12:20:40.542 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.542 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.542 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014197 s, 73.9 MB/s 2024-09-12T12:20:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135222 s, 77.5 MB/s 2024-09-12T12:20:40.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.576 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150633 s, 69.6 MB/s 2024-09-12T12:20:40.593 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.593 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.593 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135014 s, 77.7 MB/s 2024-09-12T12:20:40.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.610 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141966 s, 73.9 MB/s 2024-09-12T12:20:40.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.627 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133672 s, 78.4 MB/s 2024-09-12T12:20:40.645 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.645 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.645 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154648 s, 67.8 MB/s 2024-09-12T12:20:40.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.661 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133581 s, 78.5 MB/s 2024-09-12T12:20:40.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.677 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01243 s, 84.4 MB/s 2024-09-12T12:20:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175521 s, 59.7 MB/s 2024-09-12T12:20:40.713 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.713 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.713 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126623 s, 82.8 MB/s 2024-09-12T12:20:40.729 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.729 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.729 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126234 s, 83.1 MB/s 2024-09-12T12:20:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139077 s, 75.4 MB/s 2024-09-12T12:20:40.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.766 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172265 s, 60.9 MB/s 2024-09-12T12:20:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134101 s, 78.2 MB/s 2024-09-12T12:20:40.798 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.798 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.798 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128021 s, 81.9 MB/s 2024-09-12T12:20:40.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.818 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165113 s, 63.5 MB/s 2024-09-12T12:20:40.832 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.833 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.833 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122283 s, 85.7 MB/s 2024-09-12T12:20:40.849 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.849 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.849 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130585 s, 80.3 MB/s 2024-09-12T12:20:40.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.867 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144325 s, 72.7 MB/s 2024-09-12T12:20:40.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.883 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139458 s, 75.2 MB/s 2024-09-12T12:20:40.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.901 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014058 s, 74.6 MB/s 2024-09-12T12:20:40.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139115 s, 75.4 MB/s 2024-09-12T12:20:40.936 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.936 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.936 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153317 s, 68.4 MB/s 2024-09-12T12:20:40.952 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.952 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.952 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129854 s, 80.8 MB/s 2024-09-12T12:20:40.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:40.970 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:40.970 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143427 s, 73.1 MB/s 2024-09-12T12:20:40.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:40.977 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:40.977 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:40.977 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.16 2024-09-12T12:20:40.977 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:40.977 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:40.978 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:40.978 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:41.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:41.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.046 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133106 s, 78.8 MB/s 2024-09-12T12:20:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147861 s, 70.9 MB/s 2024-09-12T12:20:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129964 s, 80.7 MB/s 2024-09-12T12:20:41.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.096 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136705 s, 76.7 MB/s 2024-09-12T12:20:41.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.116 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165924 s, 63.2 MB/s 2024-09-12T12:20:41.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.132 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.132 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130701 s, 80.2 MB/s 2024-09-12T12:20:41.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.148 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132884 s, 78.9 MB/s 2024-09-12T12:20:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017026 s, 61.6 MB/s 2024-09-12T12:20:41.182 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.182 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.182 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107793 s, 97.3 MB/s 2024-09-12T12:20:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.198 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128965 s, 81.3 MB/s 2024-09-12T12:20:41.214 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.214 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.214 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128653 s, 81.5 MB/s 2024-09-12T12:20:41.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.231 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135718 s, 77.3 MB/s 2024-09-12T12:20:41.246 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.247 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.247 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128504 s, 81.6 MB/s 2024-09-12T12:20:41.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.267 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170485 s, 61.5 MB/s 2024-09-12T12:20:41.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142395 s, 73.6 MB/s 2024-09-12T12:20:41.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141212 s, 74.3 MB/s 2024-09-12T12:20:41.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.320 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160736 s, 65.2 MB/s 2024-09-12T12:20:41.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.336 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134573 s, 77.9 MB/s 2024-09-12T12:20:41.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.352 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123984 s, 84.6 MB/s 2024-09-12T12:20:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.371 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158026 s, 66.4 MB/s 2024-09-12T12:20:41.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.389 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147891 s, 70.9 MB/s 2024-09-12T12:20:41.406 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.406 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.406 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142413 s, 73.6 MB/s 2024-09-12T12:20:41.422 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.422 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.422 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131155 s, 79.9 MB/s 2024-09-12T12:20:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129262 s, 81.1 MB/s 2024-09-12T12:20:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.456 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153071 s, 68.5 MB/s 2024-09-12T12:20:41.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.473 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138594 s, 75.7 MB/s 2024-09-12T12:20:41.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135136 s, 77.6 MB/s 2024-09-12T12:20:41.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.506 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126818 s, 82.7 MB/s 2024-09-12T12:20:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144649 s, 72.5 MB/s 2024-09-12T12:20:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132317 s, 79.2 MB/s 2024-09-12T12:20:41.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.557 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143558 s, 73.0 MB/s 2024-09-12T12:20:41.577 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.577 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.577 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017139 s, 61.2 MB/s 2024-09-12T12:20:41.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:41.585 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:41.585 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:41.585 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.17 2024-09-12T12:20:41.585 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:41.585 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:41.585 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:41.585 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:41.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:41.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.692 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127197 s, 82.4 MB/s 2024-09-12T12:20:41.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129099 s, 81.2 MB/s 2024-09-12T12:20:41.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.724 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124228 s, 84.4 MB/s 2024-09-12T12:20:41.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.743 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164119 s, 63.9 MB/s 2024-09-12T12:20:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129662 s, 80.9 MB/s 2024-09-12T12:20:41.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.775 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124655 s, 84.1 MB/s 2024-09-12T12:20:41.791 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.791 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.791 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131242 s, 79.9 MB/s 2024-09-12T12:20:41.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.808 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136119 s, 77.0 MB/s 2024-09-12T12:20:41.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.825 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138882 s, 75.5 MB/s 2024-09-12T12:20:41.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.842 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136994 s, 76.5 MB/s 2024-09-12T12:20:41.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.858 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128933 s, 81.3 MB/s 2024-09-12T12:20:41.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134038 s, 78.2 MB/s 2024-09-12T12:20:41.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.891 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.891 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134172 s, 78.2 MB/s 2024-09-12T12:20:41.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.907 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133373 s, 78.6 MB/s 2024-09-12T12:20:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126736 s, 82.7 MB/s 2024-09-12T12:20:41.939 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.939 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.939 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013728 s, 76.4 MB/s 2024-09-12T12:20:41.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.955 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128782 s, 81.4 MB/s 2024-09-12T12:20:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122132 s, 85.9 MB/s 2024-09-12T12:20:41.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:41.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:41.986 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120285 s, 87.2 MB/s 2024-09-12T12:20:42.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.005 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160242 s, 65.4 MB/s 2024-09-12T12:20:42.022 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.022 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.022 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142378 s, 73.6 MB/s 2024-09-12T12:20:42.038 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.038 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.038 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125402 s, 83.6 MB/s 2024-09-12T12:20:42.054 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.054 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.055 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138163 s, 75.9 MB/s 2024-09-12T12:20:42.070 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.070 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.071 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130366 s, 80.4 MB/s 2024-09-12T12:20:42.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017009 s, 61.6 MB/s 2024-09-12T12:20:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109641 s, 95.6 MB/s 2024-09-12T12:20:42.120 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.121 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129009 s, 81.3 MB/s 2024-09-12T12:20:42.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.137 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133756 s, 78.4 MB/s 2024-09-12T12:20:42.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.154 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141111 s, 74.3 MB/s 2024-09-12T12:20:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.172 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143117 s, 73.3 MB/s 2024-09-12T12:20:42.188 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.188 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.188 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135981 s, 77.1 MB/s 2024-09-12T12:20:42.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131699 s, 79.6 MB/s 2024-09-12T12:20:42.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:42.212 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:42.212 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:42.212 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.18 2024-09-12T12:20:42.212 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:42.212 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:42.212 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:42.212 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:42.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:42.283 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.283 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.283 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169621 s, 61.8 MB/s 2024-09-12T12:20:42.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012929 s, 81.1 MB/s 2024-09-12T12:20:42.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.319 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167142 s, 62.7 MB/s 2024-09-12T12:20:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.336 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132059 s, 79.4 MB/s 2024-09-12T12:20:42.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.355 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165975 s, 63.2 MB/s 2024-09-12T12:20:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127664 s, 82.1 MB/s 2024-09-12T12:20:42.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.389 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150256 s, 69.8 MB/s 2024-09-12T12:20:42.407 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.407 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.408 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159535 s, 65.7 MB/s 2024-09-12T12:20:42.423 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.423 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.423 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128399 s, 81.7 MB/s 2024-09-12T12:20:42.439 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.439 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.439 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131575 s, 79.7 MB/s 2024-09-12T12:20:42.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.456 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145055 s, 72.3 MB/s 2024-09-12T12:20:42.471 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.471 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.471 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122263 s, 85.8 MB/s 2024-09-12T12:20:42.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.487 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136872 s, 76.6 MB/s 2024-09-12T12:20:42.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.504 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141716 s, 74.0 MB/s 2024-09-12T12:20:42.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.520 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012976 s, 80.8 MB/s 2024-09-12T12:20:42.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.538 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149029 s, 70.4 MB/s 2024-09-12T12:20:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165876 s, 63.2 MB/s 2024-09-12T12:20:42.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.573 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130724 s, 80.2 MB/s 2024-09-12T12:20:42.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.588 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123179 s, 85.1 MB/s 2024-09-12T12:20:42.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.604 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135412 s, 77.4 MB/s 2024-09-12T12:20:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134515 s, 78.0 MB/s 2024-09-12T12:20:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166126 s, 63.1 MB/s 2024-09-12T12:20:42.655 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.656 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131726 s, 79.6 MB/s 2024-09-12T12:20:42.671 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.671 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.671 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130886 s, 80.1 MB/s 2024-09-12T12:20:42.687 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.687 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.688 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136975 s, 76.6 MB/s 2024-09-12T12:20:42.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.704 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137386 s, 76.3 MB/s 2024-09-12T12:20:42.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.724 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016617 s, 63.1 MB/s 2024-09-12T12:20:42.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.739 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131574 s, 79.7 MB/s 2024-09-12T12:20:42.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.755 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129166 s, 81.2 MB/s 2024-09-12T12:20:42.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.772 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144875 s, 72.4 MB/s 2024-09-12T12:20:42.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.788 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129517 s, 81.0 MB/s 2024-09-12T12:20:42.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.803 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127094 s, 82.5 MB/s 2024-09-12T12:20:42.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:42.810 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:42.810 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:42.810 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.19 2024-09-12T12:20:42.811 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:42.811 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:42.811 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:42.811 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:42.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136836 s, 76.6 MB/s 2024-09-12T12:20:42.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.893 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128315 s, 81.7 MB/s 2024-09-12T12:20:42.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141965 s, 73.9 MB/s 2024-09-12T12:20:42.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.927 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143997 s, 72.8 MB/s 2024-09-12T12:20:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126664 s, 82.8 MB/s 2024-09-12T12:20:42.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.960 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141129 s, 74.3 MB/s 2024-09-12T12:20:42.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.976 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142643 s, 73.5 MB/s 2024-09-12T12:20:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:42.993 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134575 s, 77.9 MB/s 2024-09-12T12:20:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126805 s, 82.7 MB/s 2024-09-12T12:20:43.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.024 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126746 s, 82.7 MB/s 2024-09-12T12:20:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147345 s, 71.2 MB/s 2024-09-12T12:20:43.057 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.058 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138202 s, 75.9 MB/s 2024-09-12T12:20:43.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.074 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137251 s, 76.4 MB/s 2024-09-12T12:20:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129305 s, 81.1 MB/s 2024-09-12T12:20:43.108 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.108 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.108 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140256 s, 74.8 MB/s 2024-09-12T12:20:43.122 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.122 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.122 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131064 s, 80.0 MB/s 2024-09-12T12:20:43.139 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.139 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.139 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140794 s, 74.5 MB/s 2024-09-12T12:20:43.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.156 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141138 s, 74.3 MB/s 2024-09-12T12:20:43.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.171 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124412 s, 84.3 MB/s 2024-09-12T12:20:43.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132246 s, 79.3 MB/s 2024-09-12T12:20:43.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.202 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124679 s, 84.1 MB/s 2024-09-12T12:20:43.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132223 s, 79.3 MB/s 2024-09-12T12:20:43.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.234 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132376 s, 79.2 MB/s 2024-09-12T12:20:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.254 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016666 s, 62.9 MB/s 2024-09-12T12:20:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.271 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140897 s, 74.4 MB/s 2024-09-12T12:20:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127853 s, 82.0 MB/s 2024-09-12T12:20:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128016 s, 81.9 MB/s 2024-09-12T12:20:43.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.318 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137008 s, 76.5 MB/s 2024-09-12T12:20:43.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.335 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142512 s, 73.6 MB/s 2024-09-12T12:20:43.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.353 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161651 s, 64.9 MB/s 2024-09-12T12:20:43.369 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.369 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.369 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128738 s, 81.5 MB/s 2024-09-12T12:20:43.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.385 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135534 s, 77.4 MB/s 2024-09-12T12:20:43.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:43.393 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:43.393 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:43.393 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.20 2024-09-12T12:20:43.393 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:43.393 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:43.393 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:43.394 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:43.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:43.500 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.500 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.500 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135883 s, 77.2 MB/s 2024-09-12T12:20:43.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.518 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151936 s, 69.0 MB/s 2024-09-12T12:20:43.534 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137141 s, 76.5 MB/s 2024-09-12T12:20:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.551 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013463 s, 77.9 MB/s 2024-09-12T12:20:43.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.568 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143887 s, 72.9 MB/s 2024-09-12T12:20:43.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.585 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139297 s, 75.3 MB/s 2024-09-12T12:20:43.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.602 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141495 s, 74.1 MB/s 2024-09-12T12:20:43.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.617 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129297 s, 81.1 MB/s 2024-09-12T12:20:43.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.633 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134392 s, 78.0 MB/s 2024-09-12T12:20:43.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.651 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149089 s, 70.3 MB/s 2024-09-12T12:20:43.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.667 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131659 s, 79.6 MB/s 2024-09-12T12:20:43.682 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.683 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128278 s, 81.7 MB/s 2024-09-12T12:20:43.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.701 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159764 s, 65.6 MB/s 2024-09-12T12:20:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013261 s, 79.1 MB/s 2024-09-12T12:20:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.733 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128752 s, 81.4 MB/s 2024-09-12T12:20:43.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.750 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.750 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140533 s, 74.6 MB/s 2024-09-12T12:20:43.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.766 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136352 s, 76.9 MB/s 2024-09-12T12:20:43.783 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.783 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.783 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146722 s, 71.5 MB/s 2024-09-12T12:20:43.798 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.799 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125607 s, 83.5 MB/s 2024-09-12T12:20:43.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.815 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131896 s, 79.5 MB/s 2024-09-12T12:20:43.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.832 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140365 s, 74.7 MB/s 2024-09-12T12:20:43.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.848 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140252 s, 74.8 MB/s 2024-09-12T12:20:43.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.868 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170007 s, 61.7 MB/s 2024-09-12T12:20:43.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.883 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128198 s, 81.8 MB/s 2024-09-12T12:20:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144439 s, 72.6 MB/s 2024-09-12T12:20:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133413 s, 78.6 MB/s 2024-09-12T12:20:43.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.935 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161887 s, 64.8 MB/s 2024-09-12T12:20:43.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.951 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128756 s, 81.4 MB/s 2024-09-12T12:20:43.967 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.968 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142361 s, 73.7 MB/s 2024-09-12T12:20:43.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:43.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:43.983 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132709 s, 79.0 MB/s 2024-09-12T12:20:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151102 s, 69.4 MB/s 2024-09-12T12:20:44.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.017 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132945 s, 78.9 MB/s 2024-09-12T12:20:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:44.024 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:44.024 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:44.024 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.21 2024-09-12T12:20:44.025 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:44.025 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:44.025 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:44.025 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:44.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.095 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159799 s, 65.6 MB/s 2024-09-12T12:20:44.110 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.110 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.111 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135463 s, 77.4 MB/s 2024-09-12T12:20:44.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178885 s, 58.6 MB/s 2024-09-12T12:20:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146472 s, 71.6 MB/s 2024-09-12T12:20:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.168 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158995 s, 66.0 MB/s 2024-09-12T12:20:44.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164789 s, 63.6 MB/s 2024-09-12T12:20:44.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.204 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144731 s, 72.4 MB/s 2024-09-12T12:20:44.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.222 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139299 s, 75.3 MB/s 2024-09-12T12:20:44.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.238 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128977 s, 81.3 MB/s 2024-09-12T12:20:44.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.255 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141762 s, 74.0 MB/s 2024-09-12T12:20:44.272 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.272 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.272 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141436 s, 74.1 MB/s 2024-09-12T12:20:44.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.288 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129631 s, 80.9 MB/s 2024-09-12T12:20:44.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.304 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128143 s, 81.8 MB/s 2024-09-12T12:20:44.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.321 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134589 s, 77.9 MB/s 2024-09-12T12:20:44.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.336 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128516 s, 81.6 MB/s 2024-09-12T12:20:44.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.356 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167934 s, 62.4 MB/s 2024-09-12T12:20:44.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.373 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133646 s, 78.5 MB/s 2024-09-12T12:20:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119656 s, 87.6 MB/s 2024-09-12T12:20:44.404 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.404 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.405 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130023 s, 80.6 MB/s 2024-09-12T12:20:44.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.418 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109171 s, 96.0 MB/s 2024-09-12T12:20:44.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.435 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014175 s, 74.0 MB/s 2024-09-12T12:20:44.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.453 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143296 s, 73.2 MB/s 2024-09-12T12:20:44.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.469 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134368 s, 78.0 MB/s 2024-09-12T12:20:44.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.486 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134651 s, 77.9 MB/s 2024-09-12T12:20:44.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.504 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143668 s, 73.0 MB/s 2024-09-12T12:20:44.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.523 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163114 s, 64.3 MB/s 2024-09-12T12:20:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013133 s, 79.8 MB/s 2024-09-12T12:20:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016928 s, 61.9 MB/s 2024-09-12T12:20:44.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137596 s, 76.2 MB/s 2024-09-12T12:20:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.592 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127258 s, 82.4 MB/s 2024-09-12T12:20:44.608 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.608 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.608 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126415 s, 82.9 MB/s 2024-09-12T12:20:44.625 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.625 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.625 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137723 s, 76.1 MB/s 2024-09-12T12:20:44.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:44.633 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:44.633 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:44.633 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.22 2024-09-12T12:20:44.633 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:44.633 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:44.633 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:44.634 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:44.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:44.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.702 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.702 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142167 s, 73.8 MB/s 2024-09-12T12:20:44.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.718 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.718 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130531 s, 80.3 MB/s 2024-09-12T12:20:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125655 s, 83.4 MB/s 2024-09-12T12:20:44.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171048 s, 61.3 MB/s 2024-09-12T12:20:44.769 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.769 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.769 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012458 s, 84.2 MB/s 2024-09-12T12:20:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012913 s, 81.2 MB/s 2024-09-12T12:20:44.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.801 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131139 s, 80.0 MB/s 2024-09-12T12:20:44.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142721 s, 73.5 MB/s 2024-09-12T12:20:44.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.835 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129297 s, 81.1 MB/s 2024-09-12T12:20:44.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.852 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136002 s, 77.1 MB/s 2024-09-12T12:20:44.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.868 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129383 s, 81.0 MB/s 2024-09-12T12:20:44.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.884 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130249 s, 80.5 MB/s 2024-09-12T12:20:44.899 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.900 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129139 s, 81.2 MB/s 2024-09-12T12:20:44.915 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.916 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126911 s, 82.6 MB/s 2024-09-12T12:20:44.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.931 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123085 s, 85.2 MB/s 2024-09-12T12:20:44.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.948 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140465 s, 74.7 MB/s 2024-09-12T12:20:44.967 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.968 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162722 s, 64.4 MB/s 2024-09-12T12:20:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127179 s, 82.4 MB/s 2024-09-12T12:20:45.000 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.000 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139379 s, 75.2 MB/s 2024-09-12T12:20:45.016 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127228 s, 82.4 MB/s 2024-09-12T12:20:45.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.033 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133991 s, 78.3 MB/s 2024-09-12T12:20:45.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123839 s, 84.7 MB/s 2024-09-12T12:20:45.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.065 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131592 s, 79.7 MB/s 2024-09-12T12:20:45.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.082 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136949 s, 76.6 MB/s 2024-09-12T12:20:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127273 s, 82.4 MB/s 2024-09-12T12:20:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133752 s, 78.4 MB/s 2024-09-12T12:20:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.134 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166105 s, 63.1 MB/s 2024-09-12T12:20:45.152 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013495 s, 77.7 MB/s 2024-09-12T12:20:45.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.167 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140424 s, 74.7 MB/s 2024-09-12T12:20:45.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.185 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015091 s, 69.5 MB/s 2024-09-12T12:20:45.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164543 s, 63.7 MB/s 2024-09-12T12:20:45.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124876 s, 84.0 MB/s 2024-09-12T12:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:45.228 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:45.229 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:45.229 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.23 2024-09-12T12:20:45.229 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:45.229 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:45.229 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:45.229 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:45.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:45.296 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.296 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.296 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125475 s, 83.6 MB/s 2024-09-12T12:20:45.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.313 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140034 s, 74.9 MB/s 2024-09-12T12:20:45.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.330 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137699 s, 76.1 MB/s 2024-09-12T12:20:45.346 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.347 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.347 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136056 s, 77.1 MB/s 2024-09-12T12:20:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013725 s, 76.4 MB/s 2024-09-12T12:20:45.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.382 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153685 s, 68.2 MB/s 2024-09-12T12:20:45.398 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.398 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138149 s, 75.9 MB/s 2024-09-12T12:20:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012898 s, 81.3 MB/s 2024-09-12T12:20:45.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.431 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137617 s, 76.2 MB/s 2024-09-12T12:20:45.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.451 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166951 s, 62.8 MB/s 2024-09-12T12:20:45.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.467 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131862 s, 79.5 MB/s 2024-09-12T12:20:45.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.482 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122995 s, 85.3 MB/s 2024-09-12T12:20:45.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.499 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135992 s, 77.1 MB/s 2024-09-12T12:20:45.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.517 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014574 s, 71.9 MB/s 2024-09-12T12:20:45.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.532 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118961 s, 88.1 MB/s 2024-09-12T12:20:45.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.549 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137661 s, 76.2 MB/s 2024-09-12T12:20:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.565 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132929 s, 78.9 MB/s 2024-09-12T12:20:45.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.581 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012903 s, 81.3 MB/s 2024-09-12T12:20:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134214 s, 78.1 MB/s 2024-09-12T12:20:45.614 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.614 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.614 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137024 s, 76.5 MB/s 2024-09-12T12:20:45.630 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.630 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.630 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130805 s, 80.2 MB/s 2024-09-12T12:20:45.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.647 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014831 s, 70.7 MB/s 2024-09-12T12:20:45.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.663 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125102 s, 83.8 MB/s 2024-09-12T12:20:45.678 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.678 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129584 s, 80.9 MB/s 2024-09-12T12:20:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132581 s, 79.1 MB/s 2024-09-12T12:20:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131518 s, 79.7 MB/s 2024-09-12T12:20:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.727 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146526 s, 71.6 MB/s 2024-09-12T12:20:45.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.744 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135626 s, 77.3 MB/s 2024-09-12T12:20:45.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.765 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.765 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159117 s, 65.9 MB/s 2024-09-12T12:20:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138125 s, 75.9 MB/s 2024-09-12T12:20:45.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.796 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145357 s, 72.1 MB/s 2024-09-12T12:20:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.811 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132204 s, 79.3 MB/s 2024-09-12T12:20:45.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:45.819 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:45.819 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:45.819 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.24 2024-09-12T12:20:45.819 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:45.819 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:45.819 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:45.819 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:45.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:45.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.887 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134568 s, 77.9 MB/s 2024-09-12T12:20:45.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.907 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174699 s, 60.0 MB/s 2024-09-12T12:20:45.924 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.924 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.924 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144103 s, 72.8 MB/s 2024-09-12T12:20:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.940 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.940 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133951 s, 78.3 MB/s 2024-09-12T12:20:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154377 s, 67.9 MB/s 2024-09-12T12:20:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133703 s, 78.4 MB/s 2024-09-12T12:20:45.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:45.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:45.989 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127942 s, 82.0 MB/s 2024-09-12T12:20:46.004 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.004 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.004 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012093 s, 86.7 MB/s 2024-09-12T12:20:46.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.019 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116326 s, 90.1 MB/s 2024-09-12T12:20:46.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.036 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143245 s, 73.2 MB/s 2024-09-12T12:20:46.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.052 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130793 s, 80.2 MB/s 2024-09-12T12:20:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.068 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014307 s, 73.3 MB/s 2024-09-12T12:20:46.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.084 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134173 s, 78.2 MB/s 2024-09-12T12:20:46.100 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.100 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.100 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136585 s, 76.8 MB/s 2024-09-12T12:20:46.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.117 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141653 s, 74.0 MB/s 2024-09-12T12:20:46.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165208 s, 63.5 MB/s 2024-09-12T12:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123036 s, 85.2 MB/s 2024-09-12T12:20:46.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:20:46.163 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:20:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.168 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133355 s, 78.6 MB/s 2024-09-12T12:20:46.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164859 s, 63.6 MB/s 2024-09-12T12:20:46.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.202 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130849 s, 80.1 MB/s 2024-09-12T12:20:46.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137256 s, 76.4 MB/s 2024-09-12T12:20:46.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.235 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014041 s, 74.7 MB/s 2024-09-12T12:20:46.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.254 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161294 s, 65.0 MB/s 2024-09-12T12:20:46.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.336 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135137 s, 77.6 MB/s 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141528 s, 74.1 MB/s 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114514 s, 91.6 MB/s 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125879 s, 83.3 MB/s 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.338 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136151 s, 77.0 MB/s 2024-09-12T12:20:46.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128296 s, 81.7 MB/s 2024-09-12T12:20:46.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.364 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133052 s, 78.8 MB/s 2024-09-12T12:20:46.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.381 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138905 s, 75.5 MB/s 2024-09-12T12:20:46.396 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.396 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.396 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128066 s, 81.9 MB/s 2024-09-12T12:20:46.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:46.404 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:46.404 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:46.404 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.25 2024-09-12T12:20:46.404 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:46.404 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:46.404 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:46.404 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:46.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:46.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.512 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132172 s, 79.3 MB/s 2024-09-12T12:20:46.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.531 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167666 s, 62.5 MB/s 2024-09-12T12:20:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131777 s, 79.6 MB/s 2024-09-12T12:20:46.564 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.564 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.564 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145247 s, 72.2 MB/s 2024-09-12T12:20:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.582 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144399 s, 72.6 MB/s 2024-09-12T12:20:46.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.599 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141554 s, 74.1 MB/s 2024-09-12T12:20:46.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.617 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146744 s, 71.5 MB/s 2024-09-12T12:20:46.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.633 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127856 s, 82.0 MB/s 2024-09-12T12:20:46.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.649 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133286 s, 78.7 MB/s 2024-09-12T12:20:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130826 s, 80.2 MB/s 2024-09-12T12:20:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168497 s, 62.2 MB/s 2024-09-12T12:20:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129773 s, 80.8 MB/s 2024-09-12T12:20:46.718 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.718 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.718 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141846 s, 73.9 MB/s 2024-09-12T12:20:46.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.734 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127774 s, 82.1 MB/s 2024-09-12T12:20:46.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.749 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121228 s, 86.5 MB/s 2024-09-12T12:20:46.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.766 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146956 s, 71.4 MB/s 2024-09-12T12:20:46.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.786 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.786 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135534 s, 77.4 MB/s 2024-09-12T12:20:46.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.799 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138556 s, 75.7 MB/s 2024-09-12T12:20:46.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.818 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016143 s, 65.0 MB/s 2024-09-12T12:20:46.832 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.833 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.833 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123942 s, 84.6 MB/s 2024-09-12T12:20:46.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.852 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166043 s, 63.2 MB/s 2024-09-12T12:20:46.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.869 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139554 s, 75.1 MB/s 2024-09-12T12:20:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126503 s, 82.9 MB/s 2024-09-12T12:20:46.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.902 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142599 s, 73.5 MB/s 2024-09-12T12:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128939 s, 81.3 MB/s 2024-09-12T12:20:46.936 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.936 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.936 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161172 s, 65.1 MB/s 2024-09-12T12:20:46.952 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.952 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.952 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135727 s, 77.3 MB/s 2024-09-12T12:20:46.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.969 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013849 s, 75.7 MB/s 2024-09-12T12:20:46.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:46.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:46.989 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169281 s, 61.9 MB/s 2024-09-12T12:20:47.007 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.007 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.007 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152819 s, 68.6 MB/s 2024-09-12T12:20:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131786 s, 79.6 MB/s 2024-09-12T12:20:47.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140737 s, 74.5 MB/s 2024-09-12T12:20:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:47.047 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:47.047 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:47.047 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.26 2024-09-12T12:20:47.047 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:47.047 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:47.047 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:47.047 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:47.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:47.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.155 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125098 s, 83.8 MB/s 2024-09-12T12:20:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.174 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163375 s, 64.2 MB/s 2024-09-12T12:20:47.189 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.189 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.189 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125721 s, 83.4 MB/s 2024-09-12T12:20:47.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.206 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140102 s, 74.8 MB/s 2024-09-12T12:20:47.223 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.223 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.223 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141271 s, 74.2 MB/s 2024-09-12T12:20:47.239 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.240 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.240 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138934 s, 75.5 MB/s 2024-09-12T12:20:47.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.256 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134938 s, 77.7 MB/s 2024-09-12T12:20:47.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.272 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132184 s, 79.3 MB/s 2024-09-12T12:20:47.287 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.288 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135455 s, 77.4 MB/s 2024-09-12T12:20:47.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.305 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143078 s, 73.3 MB/s 2024-09-12T12:20:47.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114195 s, 91.8 MB/s 2024-09-12T12:20:47.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.335 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139025 s, 75.4 MB/s 2024-09-12T12:20:47.351 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.352 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013815 s, 75.9 MB/s 2024-09-12T12:20:47.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.368 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136994 s, 76.5 MB/s 2024-09-12T12:20:47.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.383 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.383 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121173 s, 86.5 MB/s 2024-09-12T12:20:47.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146981 s, 71.3 MB/s 2024-09-12T12:20:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.417 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137167 s, 76.4 MB/s 2024-09-12T12:20:47.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.432 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124751 s, 84.1 MB/s 2024-09-12T12:20:47.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.448 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130357 s, 80.4 MB/s 2024-09-12T12:20:47.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.463 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123223 s, 85.1 MB/s 2024-09-12T12:20:47.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.479 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138576 s, 75.7 MB/s 2024-09-12T12:20:47.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.495 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133804 s, 78.4 MB/s 2024-09-12T12:20:47.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.512 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144189 s, 72.7 MB/s 2024-09-12T12:20:47.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.529 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133724 s, 78.4 MB/s 2024-09-12T12:20:47.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.546 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144944 s, 72.3 MB/s 2024-09-12T12:20:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.562 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013702 s, 76.5 MB/s 2024-09-12T12:20:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.579 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.579 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136738 s, 76.7 MB/s 2024-09-12T12:20:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133644 s, 78.5 MB/s 2024-09-12T12:20:47.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.610 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132571 s, 79.1 MB/s 2024-09-12T12:20:47.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.627 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143787 s, 72.9 MB/s 2024-09-12T12:20:47.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.645 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.645 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145909 s, 71.9 MB/s 2024-09-12T12:20:47.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.661 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134048 s, 78.2 MB/s 2024-09-12T12:20:47.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:47.668 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:47.668 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:47.668 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.27 2024-09-12T12:20:47.668 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:47.669 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:47.669 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:47.669 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:47.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.738 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014966 s, 70.1 MB/s 2024-09-12T12:20:47.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138408 s, 75.8 MB/s 2024-09-12T12:20:47.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.772 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150705 s, 69.6 MB/s 2024-09-12T12:20:47.791 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.792 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163512 s, 64.1 MB/s 2024-09-12T12:20:47.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.808 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141318 s, 74.2 MB/s 2024-09-12T12:20:47.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.825 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142304 s, 73.7 MB/s 2024-09-12T12:20:47.838 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.838 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.838 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104553 s, 100 MB/s 2024-09-12T12:20:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.855 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134928 s, 77.7 MB/s 2024-09-12T12:20:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.870 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012752 s, 82.2 MB/s 2024-09-12T12:20:47.886 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.887 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140502 s, 74.6 MB/s 2024-09-12T12:20:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.903 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132786 s, 79.0 MB/s 2024-09-12T12:20:47.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.918 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132883 s, 78.9 MB/s 2024-09-12T12:20:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.935 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140569 s, 74.6 MB/s 2024-09-12T12:20:47.950 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.950 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.950 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124036 s, 84.5 MB/s 2024-09-12T12:20:47.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.966 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132448 s, 79.2 MB/s 2024-09-12T12:20:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138528 s, 75.7 MB/s 2024-09-12T12:20:47.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:47.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.000 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139504 s, 75.2 MB/s 2024-09-12T12:20:48.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.018 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156901 s, 66.8 MB/s 2024-09-12T12:20:48.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.035 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139884 s, 75.0 MB/s 2024-09-12T12:20:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.051 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132521 s, 79.1 MB/s 2024-09-12T12:20:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.070 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015968 s, 65.7 MB/s 2024-09-12T12:20:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129925 s, 80.7 MB/s 2024-09-12T12:20:48.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.102 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127837 s, 82.0 MB/s 2024-09-12T12:20:48.118 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.119 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136253 s, 77.0 MB/s 2024-09-12T12:20:48.135 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.135 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.135 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135478 s, 77.4 MB/s 2024-09-12T12:20:48.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.151 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126641 s, 82.8 MB/s 2024-09-12T12:20:48.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.167 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129989 s, 80.7 MB/s 2024-09-12T12:20:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138118 s, 75.9 MB/s 2024-09-12T12:20:48.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.200 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129736 s, 80.8 MB/s 2024-09-12T12:20:48.217 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.217 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.217 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014149 s, 74.1 MB/s 2024-09-12T12:20:48.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.234 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013141 s, 79.8 MB/s 2024-09-12T12:20:48.250 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.251 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138568 s, 75.7 MB/s 2024-09-12T12:20:48.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:48.258 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:48.258 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:48.258 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.28 2024-09-12T12:20:48.258 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:48.259 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:48.259 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:48.259 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:48.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:48.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.373 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129131 s, 81.2 MB/s 2024-09-12T12:20:48.390 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.390 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.390 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140571 s, 74.6 MB/s 2024-09-12T12:20:48.407 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.407 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.408 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145734 s, 72.0 MB/s 2024-09-12T12:20:48.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162678 s, 64.5 MB/s 2024-09-12T12:20:48.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.442 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124401 s, 84.3 MB/s 2024-09-12T12:20:48.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.458 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127157 s, 82.5 MB/s 2024-09-12T12:20:48.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.476 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141841 s, 73.9 MB/s 2024-09-12T12:20:48.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.492 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140085 s, 74.9 MB/s 2024-09-12T12:20:48.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.508 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129013 s, 81.3 MB/s 2024-09-12T12:20:48.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.524 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130956 s, 80.1 MB/s 2024-09-12T12:20:48.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.541 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138445 s, 75.7 MB/s 2024-09-12T12:20:48.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.557 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128972 s, 81.3 MB/s 2024-09-12T12:20:48.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.573 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126119 s, 83.1 MB/s 2024-09-12T12:20:48.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124543 s, 84.2 MB/s 2024-09-12T12:20:48.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.604 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123377 s, 85.0 MB/s 2024-09-12T12:20:48.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.621 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127978 s, 81.9 MB/s 2024-09-12T12:20:48.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126425 s, 82.9 MB/s 2024-09-12T12:20:48.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.656 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165064 s, 63.5 MB/s 2024-09-12T12:20:48.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.673 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133002 s, 78.8 MB/s 2024-09-12T12:20:48.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.690 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141244 s, 74.2 MB/s 2024-09-12T12:20:48.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.707 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140975 s, 74.4 MB/s 2024-09-12T12:20:48.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.724 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137266 s, 76.4 MB/s 2024-09-12T12:20:48.741 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.742 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145873 s, 71.9 MB/s 2024-09-12T12:20:48.758 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.758 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.758 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129115 s, 81.2 MB/s 2024-09-12T12:20:48.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.775 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142495 s, 73.6 MB/s 2024-09-12T12:20:48.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.792 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138822 s, 75.5 MB/s 2024-09-12T12:20:48.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.809 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130211 s, 80.5 MB/s 2024-09-12T12:20:48.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.827 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160624 s, 65.3 MB/s 2024-09-12T12:20:48.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.845 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144029 s, 72.8 MB/s 2024-09-12T12:20:48.861 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.861 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.862 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139189 s, 75.3 MB/s 2024-09-12T12:20:48.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.878 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.878 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131613 s, 79.7 MB/s 2024-09-12T12:20:48.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.893 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126697 s, 82.8 MB/s 2024-09-12T12:20:48.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:48.901 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:48.901 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:48.901 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.29 2024-09-12T12:20:48.901 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:48.901 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:48.901 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:48.901 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:48.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:48.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.969 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013724 s, 76.4 MB/s 2024-09-12T12:20:48.984 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:48.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:48.985 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126577 s, 82.8 MB/s 2024-09-12T12:20:49.000 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.000 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.000 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123623 s, 84.8 MB/s 2024-09-12T12:20:49.016 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.016 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.016 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125774 s, 83.4 MB/s 2024-09-12T12:20:49.031 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.031 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.032 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128659 s, 81.5 MB/s 2024-09-12T12:20:49.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.048 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133111 s, 78.8 MB/s 2024-09-12T12:20:49.063 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.063 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.063 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120723 s, 86.9 MB/s 2024-09-12T12:20:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130329 s, 80.5 MB/s 2024-09-12T12:20:49.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.098 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167374 s, 62.6 MB/s 2024-09-12T12:20:49.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.114 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132557 s, 79.1 MB/s 2024-09-12T12:20:49.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014118 s, 74.3 MB/s 2024-09-12T12:20:49.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.151 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167754 s, 62.5 MB/s 2024-09-12T12:20:49.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.169 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147472 s, 71.1 MB/s 2024-09-12T12:20:49.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.185 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131059 s, 80.0 MB/s 2024-09-12T12:20:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167958 s, 62.4 MB/s 2024-09-12T12:20:49.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.222 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137141 s, 76.5 MB/s 2024-09-12T12:20:49.236 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.236 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.237 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122244 s, 85.8 MB/s 2024-09-12T12:20:49.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.252 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013221 s, 79.3 MB/s 2024-09-12T12:20:49.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.268 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129065 s, 81.2 MB/s 2024-09-12T12:20:49.287 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.288 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167462 s, 62.6 MB/s 2024-09-12T12:20:49.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.303 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.303 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124656 s, 84.1 MB/s 2024-09-12T12:20:49.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.318 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129565 s, 80.9 MB/s 2024-09-12T12:20:49.334 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.334 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.334 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130911 s, 80.1 MB/s 2024-09-12T12:20:49.350 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.350 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.350 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130237 s, 80.5 MB/s 2024-09-12T12:20:49.366 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.366 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.367 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135009 s, 77.7 MB/s 2024-09-12T12:20:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133828 s, 78.4 MB/s 2024-09-12T12:20:49.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151185 s, 69.4 MB/s 2024-09-12T12:20:49.415 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.415 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.415 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012367 s, 84.8 MB/s 2024-09-12T12:20:49.432 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.432 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.432 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142027 s, 73.8 MB/s 2024-09-12T12:20:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162188 s, 64.7 MB/s 2024-09-12T12:20:49.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.468 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013271 s, 79.0 MB/s 2024-09-12T12:20:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.484 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.484 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134146 s, 78.2 MB/s 2024-09-12T12:20:49.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:49.491 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:49.491 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:49.491 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.30 2024-09-12T12:20:49.491 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:49.491 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:49.491 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:49.491 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:49.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:49.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.561 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138336 s, 75.8 MB/s 2024-09-12T12:20:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.579 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145716 s, 72.0 MB/s 2024-09-12T12:20:49.596 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.596 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.596 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151753 s, 69.1 MB/s 2024-09-12T12:20:49.613 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.613 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.613 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138054 s, 76.0 MB/s 2024-09-12T12:20:49.629 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.629 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.629 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130731 s, 80.2 MB/s 2024-09-12T12:20:49.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.649 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176765 s, 59.3 MB/s 2024-09-12T12:20:49.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.665 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131297 s, 79.9 MB/s 2024-09-12T12:20:49.681 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.681 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.681 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133477 s, 78.6 MB/s 2024-09-12T12:20:49.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.697 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130006 s, 80.7 MB/s 2024-09-12T12:20:49.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.712 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131888 s, 79.5 MB/s 2024-09-12T12:20:49.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.728 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131579 s, 79.7 MB/s 2024-09-12T12:20:49.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.745 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136654 s, 76.7 MB/s 2024-09-12T12:20:49.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.761 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132975 s, 78.9 MB/s 2024-09-12T12:20:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132765 s, 79.0 MB/s 2024-09-12T12:20:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142668 s, 73.5 MB/s 2024-09-12T12:20:49.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.809 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126642 s, 82.8 MB/s 2024-09-12T12:20:49.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.825 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012831 s, 81.7 MB/s 2024-09-12T12:20:49.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.842 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014165 s, 74.0 MB/s 2024-09-12T12:20:49.857 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.857 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.857 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012974 s, 80.8 MB/s 2024-09-12T12:20:49.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.872 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012382 s, 84.7 MB/s 2024-09-12T12:20:49.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.888 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012916 s, 81.2 MB/s 2024-09-12T12:20:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.903 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126427 s, 82.9 MB/s 2024-09-12T12:20:49.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160053 s, 65.5 MB/s 2024-09-12T12:20:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139711 s, 75.1 MB/s 2024-09-12T12:20:49.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.955 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136046 s, 77.1 MB/s 2024-09-12T12:20:49.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.973 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161992 s, 64.7 MB/s 2024-09-12T12:20:49.990 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:49.990 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:49.990 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140033 s, 74.9 MB/s 2024-09-12T12:20:50.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.005 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125669 s, 83.4 MB/s 2024-09-12T12:20:50.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.027 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165828 s, 63.2 MB/s 2024-09-12T12:20:50.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.042 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125066 s, 83.8 MB/s 2024-09-12T12:20:50.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.061 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144105 s, 72.8 MB/s 2024-09-12T12:20:50.075 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.075 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.075 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129973 s, 80.7 MB/s 2024-09-12T12:20:50.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:50.082 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:20:50.082 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:20:50.082 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.31 2024-09-12T12:20:50.082 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:20:50.083 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:20:50.083 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:20:50.083 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:20:50.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:20:50.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.193 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137834 s, 76.1 MB/s 2024-09-12T12:20:50.208 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.208 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.208 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127745 s, 82.1 MB/s 2024-09-12T12:20:50.223 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.223 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.223 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124706 s, 84.1 MB/s 2024-09-12T12:20:50.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.239 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.239 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124603 s, 84.2 MB/s 2024-09-12T12:20:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141344 s, 74.2 MB/s 2024-09-12T12:20:50.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.271 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01297 s, 80.8 MB/s 2024-09-12T12:20:50.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106306 s, 98.6 MB/s 2024-09-12T12:20:50.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138553 s, 75.7 MB/s 2024-09-12T12:20:50.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.319 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140873 s, 74.4 MB/s 2024-09-12T12:20:50.334 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.334 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.334 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130876 s, 80.1 MB/s 2024-09-12T12:20:50.350 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.350 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.350 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131172 s, 79.9 MB/s 2024-09-12T12:20:50.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.365 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012429 s, 84.4 MB/s 2024-09-12T12:20:50.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.382 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138345 s, 75.8 MB/s 2024-09-12T12:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123539 s, 84.9 MB/s 2024-09-12T12:20:50.412 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.412 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.412 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123993 s, 84.6 MB/s 2024-09-12T12:20:50.432 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.432 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.432 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171147 s, 61.3 MB/s 2024-09-12T12:20:50.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.448 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013145 s, 79.8 MB/s 2024-09-12T12:20:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.463 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121971 s, 86.0 MB/s 2024-09-12T12:20:50.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.480 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.480 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139547 s, 75.1 MB/s 2024-09-12T12:20:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141704 s, 74.0 MB/s 2024-09-12T12:20:50.513 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.513 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.513 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138623 s, 75.6 MB/s 2024-09-12T12:20:50.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.528 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128261 s, 81.8 MB/s 2024-09-12T12:20:50.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132906 s, 78.9 MB/s 2024-09-12T12:20:50.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.561 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142867 s, 73.4 MB/s 2024-09-12T12:20:50.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.578 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142965 s, 73.3 MB/s 2024-09-12T12:20:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125886 s, 83.3 MB/s 2024-09-12T12:20:50.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.611 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145669 s, 72.0 MB/s 2024-09-12T12:20:50.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.628 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139773 s, 75.0 MB/s 2024-09-12T12:20:50.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.643 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125819 s, 83.3 MB/s 2024-09-12T12:20:50.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.658 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122242 s, 85.8 MB/s 2024-09-12T12:20:50.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.675 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130872 s, 80.1 MB/s 2024-09-12T12:20:50.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:20:50.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:20:50.690 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132012 s, 79.4 MB/s 2024-09-12T12:20:50.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:20:50.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:50.697 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-09-12T12:20:50.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.835+0000 7f6064200640 1 Processor -- start 2024-09-12T12:20:50.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.835+0000 7f6064200640 1 -- start start 2024-09-12T12:20:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6064200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f605c156c10 0x7f605c072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6064200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c06cd20 con 0x7f605c073a70 2024-09-12T12:20:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6064200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c0712b0 con 0x7f605c06cff0 2024-09-12T12:20:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6064200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f605c071be0 con 0x7f605c156c10 2024-09-12T12:20:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6061800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f605c156c10 0x7f605c072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6062200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f605c073a70 0x7f605c15de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39052/0 (socket says 172.21.15.144:39052) 2024-09-12T12:20:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6062200640 1 -- 172.21.15.144:0/562736231 learned_addr learned my addr 172.21.15.144:0/562736231 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6061800640 1 -- 172.21.15.144:0/562736231 >> v1:172.21.15.165:6789/0 conn(0x7f605c06cff0 legacy=0x7f605c073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6061800640 1 -- 172.21.15.144:0/562736231 >> v1:172.21.15.144:6789/0 conn(0x7f605c073a70 legacy=0x7f605c15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f6061800640 1 -- 172.21.15.144:0/562736231 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c071590 con 0x7f605c156c10 2024-09-12T12:20:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.839+0000 7f605be00640 1 -- 172.21.15.144:0/562736231 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101651343 0 0) 0x7f605c06cd20 con 0x7f605c073a70 2024-09-12T12:20:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6061800640 1 --2- 172.21.15.144:0/562736231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c156c10 0x7f605c072070 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f6050009d90 tx=0x7f605001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1be26738ee3f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f605be00640 1 -- 172.21.15.144:0/562736231 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500b2070 con 0x7f605c156c10 2024-09-12T12:20:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f605be00640 1 -- 172.21.15.144:0/562736231 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60500a5a50 con 0x7f605c156c10 2024-09-12T12:20:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f605be00640 1 -- 172.21.15.144:0/562736231 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500a5e20 con 0x7f605c156c10 2024-09-12T12:20:50.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 -- 172.21.15.144:0/562736231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c156c10 msgr2=0x7f605c072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 --2- 172.21.15.144:0/562736231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c156c10 0x7f605c072070 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f6050009d90 tx=0x7f605001c970 comp rx=0 tx=0).stop 2024-09-12T12:20:50.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 -- 172.21.15.144:0/562736231 shutdown_connections 2024-09-12T12:20:50.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 --2- 172.21.15.144:0/562736231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c156c10 0x7f605c072070 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 -- 172.21.15.144:0/562736231 >> 172.21.15.144:0/562736231 conn(0x7f605c06bc10 msgr2=0x7f605c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:50.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 -- 172.21.15.144:0/562736231 shutdown_connections 2024-09-12T12:20:50.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 -- 172.21.15.144:0/562736231 wait complete. 2024-09-12T12:20:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 Processor -- start 2024-09-12T12:20:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 -- start start 2024-09-12T12:20:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f605c06cff0 0x7f605c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c073a70 0x7f605c144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f605c156c10 0x7f605c145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f605c157170 con 0x7f605c073a70 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f605c156ff0 con 0x7f605c156c10 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6064200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f605c0725b0 con 0x7f605c06cff0 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.843+0000 7f6060e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c073a70 0x7f605c144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6060e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c073a70 0x7f605c144f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51720/0 (socket says 172.21.15.144:51720) 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6060e00640 1 -- 172.21.15.144:0/1379096523 learned_addr learned my addr 172.21.15.144:0/1379096523 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6061800640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f605c06cff0 0x7f605c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6062200640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f605c156c10 0x7f605c145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6060e00640 1 -- 172.21.15.144:0/1379096523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f605c06cff0 msgr2=0x7f605c0b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6060e00640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f605c06cff0 0x7f605c0b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6060e00640 1 -- 172.21.15.144:0/1379096523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f605c156c10 msgr2=0x7f605c145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6060e00640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f605c156c10 0x7f605c145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6060e00640 1 -- 172.21.15.144:0/1379096523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c14a040 con 0x7f605c073a70 2024-09-12T12:20:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6062200640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f605c156c10 0x7f605c145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6060e00640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c073a70 0x7f605c144f10 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f604800c3c0 tx=0x7f604800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6059600640 1 -- 172.21.15.144:0/1379096523 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048017070 con 0x7f605c073a70 2024-09-12T12:20:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6059600640 1 -- 172.21.15.144:0/1379096523 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60480052d0 con 0x7f605c073a70 2024-09-12T12:20:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6064200640 1 -- 172.21.15.144:0/1379096523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605c14a320 con 0x7f605c073a70 2024-09-12T12:20:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6059600640 1 -- 172.21.15.144:0/1379096523 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048003840 con 0x7f605c073a70 2024-09-12T12:20:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6064200640 1 -- 172.21.15.144:0/1379096523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605c14a8e0 con 0x7f605c073a70 2024-09-12T12:20:50.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.847+0000 7f6059600640 1 -- 172.21.15.144:0/1379096523 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f604801a070 con 0x7f605c073a70 2024-09-12T12:20:50.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6059600640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f603c0678c0 0x7f603c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6059600640 1 -- 172.21.15.144:0/1379096523 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f60480851a0 con 0x7f605c073a70 2024-09-12T12:20:50.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6061800640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f603c0678c0 0x7f603c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 Processor -- start 2024-09-12T12:20:50.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 -- start start 2024-09-12T12:20:50.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6061800640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f603c0678c0 0x7f603c069d80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f60500af000 tx=0x7f60500a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc9956160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc9956a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555bc97a6ba0 con 0x555bc99a2ff0 2024-09-12T12:20:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555bc974c350 con 0x555bc99566a0 2024-09-12T12:20:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555bc97a2b60 con 0x555bc99a26d0 2024-09-12T12:20:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6060e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc9956160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6060e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc9956160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51724/0 (socket says 172.21.15.144:51724) 2024-09-12T12:20:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6060e00640 1 -- 172.21.15.144:0/2198298694 learned_addr learned my addr 172.21.15.144:0/2198298694 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:50.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6060e00640 1 -- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 msgr2=0x555bc99a2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:50.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6061800640 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6060e00640 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99a2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6062200640 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc9956a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6060e00640 1 -- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 msgr2=0x555bc9956a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6060e00640 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc9956a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6060e00640 1 -- 172.21.15.144:0/2198298694 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc974fbd0 con 0x555bc99a2ff0 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6061800640 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99a2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6062200640 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc9956a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f6060e00640 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc9956160 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f604805da60 tx=0x7f60480555a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a78cdf1f84ebac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f604e000640 1 -- 172.21.15.144:0/2198298694 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048051ad0 con 0x555bc99a2ff0 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f604e000640 1 -- 172.21.15.144:0/2198298694 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604806d1c0 con 0x555bc99a2ff0 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f604e000640 1 -- 172.21.15.144:0/2198298694 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048051c70 con 0x555bc99a2ff0 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 -- 172.21.15.144:0/2198298694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 msgr2=0x555bc9956160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc9956160 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f604805da60 tx=0x7f60480555a0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 -- 172.21.15.144:0/2198298694 shutdown_connections 2024-09-12T12:20:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc9956a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc9956160 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 --2- 172.21.15.144:0/2198298694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99a2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.851+0000 7f606764b000 1 -- 172.21.15.144:0/2198298694 >> 172.21.15.144:0/2198298694 conn(0x555bc9983470 msgr2=0x555bc9985860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 -- 172.21.15.144:0/2198298694 shutdown_connections 2024-09-12T12:20:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 -- 172.21.15.144:0/2198298694 wait complete. 2024-09-12T12:20:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 -- start start 2024-09-12T12:20:50.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 Processor -- start 2024-09-12T12:20:50.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc99a8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99a26d0 0x555bc99a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc99a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555bc97402a0 con 0x555bc99a2ff0 2024-09-12T12:20:50.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555bc97657d0 con 0x555bc99a26d0 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555bc9767f70 con 0x555bc99566a0 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 10 client.0 _ll_register_callbacks cb 0x555bc9943b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6062200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc99a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6061800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc99a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6062200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc99a90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51732/0 (socket says 172.21.15.144:51732) 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6062200640 1 -- 172.21.15.144:0/4018168696 learned_addr learned my addr 172.21.15.144:0/4018168696 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6060e00640 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99a26d0 0x555bc99a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6062200640 1 -- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 msgr2=0x555bc99a8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6062200640 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc99a8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6062200640 1 -- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99a26d0 msgr2=0x555bc99a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6062200640 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99a26d0 0x555bc99a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6062200640 1 -- 172.21.15.144:0/4018168696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bc97af810 con 0x555bc99a2ff0 2024-09-12T12:20:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6062200640 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc99a90b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f60540076f0 tx=0x7f6054001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a970a881a0d524c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6042a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6042a00640 1 -- 172.21.15.144:0/4018168696 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054019060 con 0x555bc99a2ff0 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6042a00640 1 -- 172.21.15.144:0/4018168696 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f60540145f0 con 0x555bc99a2ff0 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 -- 172.21.15.144:0/4018168696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f604806d1c0 con 0x555bc99a2ff0 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6042a00640 1 -- 172.21.15.144:0/4018168696 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f605401f050 con 0x555bc99a2ff0 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 10 client.8175 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 -- 172.21.15.144:0/4018168696 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x555bc97509f0 con 0x555bc99a2ff0 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6042a00640 1 -- 172.21.15.144:0/4018168696 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604806d1c0 con 0x555bc99a2ff0 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f6042a00640 1 -- 172.21.15.144:0/4018168696 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f6054022020 con 0x555bc99a2ff0 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 10 client.8175 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 10 client.8175 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 20 client.8175 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x555bc99b0a00 0x555bc99b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 4 client.8175 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.855+0000 7f606764b000 1 -- 172.21.15.144:0/4018168696 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bc9740bd0 con 0x555bc99b0a00 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f6061800640 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x555bc99b0a00 0x555bc99b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f6061800640 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x555bc99b0a00 0x555bc99b2df0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7f2c865a8bd8d7c server_cookie=336c38403e11fc31 in_seq=0 out_seq=0 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f6042a00640 10 client.8175 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f6042a00640 1 -- 172.21.15.144:0/4018168696 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555bc9740bd0 con 0x555bc99b0a00 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f6042a00640 10 client.8175 handle_command_reply: tid=0 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 client.8175 shutdown 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 -- 172.21.15.144:0/4018168696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 msgr2=0x555bc99a90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc99a90b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f60540076f0 tx=0x7f6054001690 comp rx=0 tx=0).stop 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 -- 172.21.15.144:0/4018168696 shutdown_connections 2024-09-12T12:20:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x555bc99b0a00 0x555bc99b2df0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a2ff0 0x555bc99a90b0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99a26d0 0x555bc99a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 --2- 172.21.15.144:0/4018168696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc99a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f6042a00640 0 client.8175 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:50.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 -- 172.21.15.144:0/4018168696 >> 172.21.15.144:0/4018168696 conn(0x555bc9983470 msgr2=0x555bc9985860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:50.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 -- 172.21.15.144:0/4018168696 shutdown_connections 2024-09-12T12:20:50.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 1 -- 172.21.15.144:0/4018168696 wait complete. 2024-09-12T12:20:50.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.859+0000 7f606764b000 20 client.8175 trim_cache size 0 max 16384 2024-09-12T12:20:50.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.875+0000 7f606764b000 1 Processor -- start 2024-09-12T12:20:50.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.875+0000 7f606764b000 1 -- start start 2024-09-12T12:20:50.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc9983470 0x555bc99a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc99a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99d78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f605c2037a0 con 0x555bc9983470 2024-09-12T12:20:50.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f605c154870 con 0x555bc99566a0 2024-09-12T12:20:50.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f605c154ec0 con 0x555bc99a26d0 2024-09-12T12:20:50.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6061800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc9983470 0x555bc99a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6061800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc9983470 0x555bc99a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51748/0 (socket says 172.21.15.144:51748) 2024-09-12T12:20:50.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6061800640 1 -- 172.21.15.144:0/3953510282 learned_addr learned my addr 172.21.15.144:0/3953510282 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:50.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6062200640 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99d78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6061800640 1 -- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 msgr2=0x555bc99d78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6061800640 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99d78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6060e00640 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc99a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6061800640 1 -- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 msgr2=0x555bc99a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6061800640 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc99a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6061800640 1 -- 172.21.15.144:0/3953510282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc974c5a0 con 0x555bc9983470 2024-09-12T12:20:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6062200640 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99d78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6060e00640 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc99a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:50.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f6061800640 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc9983470 0x555bc99a7dd0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6050019580 tx=0x7f6050004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca225de583fef4ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f604d600640 1 -- 172.21.15.144:0/3953510282 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500b2040 con 0x555bc9983470 2024-09-12T12:20:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f604d600640 1 -- 172.21.15.144:0/3953510282 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60500b9af0 con 0x555bc9983470 2024-09-12T12:20:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f604d600640 1 -- 172.21.15.144:0/3953510282 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500d1450 con 0x555bc9983470 2024-09-12T12:20:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- 172.21.15.144:0/3953510282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc9983470 msgr2=0x555bc99a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc9983470 0x555bc99a7dd0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6050019580 tx=0x7f6050004ac0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- 172.21.15.144:0/3953510282 shutdown_connections 2024-09-12T12:20:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99a26d0 0x555bc99d78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc99566a0 0x555bc99a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- 172.21.15.144:0/3953510282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc9983470 0x555bc99a7dd0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- 172.21.15.144:0/3953510282 >> 172.21.15.144:0/3953510282 conn(0x555bc9955ca0 msgr2=0x555bc99a66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- 172.21.15.144:0/3953510282 shutdown_connections 2024-09-12T12:20:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- 172.21.15.144:0/3953510282 wait complete. 2024-09-12T12:20:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- start start 2024-09-12T12:20:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 Processor -- start 2024-09-12T12:20:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc9a1ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc9983470 0x555bc9a1f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a26d0 0x555bc9a1f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555bc9752c10 con 0x555bc99a26d0 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555bc974de30 con 0x555bc9983470 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x555bc972b8f0 con 0x555bc99566a0 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.879+0000 7f606764b000 10 client.0 _ll_register_callbacks cb 0x7f6054007dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6062200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a26d0 0x555bc9a1f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6061800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc9a1ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6060e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc9983470 0x555bc9a1f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6061800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc9a1ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34366/0 (socket says 172.21.15.144:34366) 2024-09-12T12:20:50.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6061800640 1 -- 172.21.15.144:0/1977351470 learned_addr learned my addr 172.21.15.144:0/1977351470 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6061800640 1 -- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc9983470 msgr2=0x555bc9a1f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6061800640 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc9983470 0x555bc9a1f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6061800640 1 -- 172.21.15.144:0/1977351470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a26d0 msgr2=0x555bc9a1f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6061800640 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a26d0 0x555bc9a1f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6061800640 1 -- 172.21.15.144:0/1977351470 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x555bc97465b0 con 0x555bc99566a0 2024-09-12T12:20:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6062200640 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a26d0 0x555bc9a1f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:20:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6061800640 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc9a1ed30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6050003b50 tx=0x7f605001b1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49467d5240ac8fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6042a00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:20:50.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6042a00640 1 -- 172.21.15.144:0/1977351470 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500b2050 con 0x555bc99566a0 2024-09-12T12:20:50.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6042a00640 1 -- 172.21.15.144:0/1977351470 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f60500d1650 con 0x555bc99566a0 2024-09-12T12:20:50.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f606764b000 1 -- 172.21.15.144:0/1977351470 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60500b9af0 con 0x555bc99566a0 2024-09-12T12:20:50.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6042a00640 1 -- 172.21.15.144:0/1977351470 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f60500e1050 con 0x555bc99566a0 2024-09-12T12:20:50.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f606764b000 10 client.6998 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:50.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f606764b000 1 -- 172.21.15.144:0/1977351470 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x555bc973e330 con 0x555bc99566a0 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6042a00640 1 -- 172.21.15.144:0/1977351470 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60500b9af0 con 0x555bc99566a0 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6042a00640 1 -- 172.21.15.144:0/1977351470 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f60500e4020 con 0x555bc99566a0 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f606764b000 10 client.6998 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f606764b000 10 client.6998 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f606764b000 20 client.6998 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f606764b000 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x555bc99a2ff0 0x555bc99da9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f606764b000 4 client.6998 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f606764b000 1 -- 172.21.15.144:0/1977351470 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x555bc97b42d0 con 0x555bc99a2ff0 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6060e00640 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x555bc99a2ff0 0x555bc99da9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:50.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6060e00640 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x555bc99a2ff0 0x555bc99da9b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21986172afea685b server_cookie=7a3525dc85be8cd6 in_seq=0 out_seq=0 2024-09-12T12:20:50.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.883+0000 7f6042a00640 10 client.6998 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6042a00640 1 -- 172.21.15.144:0/1977351470 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555bc97b42d0 con 0x555bc99a2ff0 2024-09-12T12:20:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6042a00640 10 client.6998 handle_command_reply: tid=0 2024-09-12T12:20:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 client.6998 shutdown 2024-09-12T12:20:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 -- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 msgr2=0x555bc9a1ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc9a1ed30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6050003b50 tx=0x7f605001b1b0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 -- 172.21.15.144:0/1977351470 shutdown_connections 2024-09-12T12:20:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x555bc99a2ff0 0x555bc99da9b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555bc99a26d0 0x555bc9a1f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555bc9983470 0x555bc9a1f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6042a00640 0 client.6998 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 --2- 172.21.15.144:0/1977351470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x555bc99566a0 0x555bc9a1ed30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 -- 172.21.15.144:0/1977351470 >> 172.21.15.144:0/1977351470 conn(0x555bc9955ca0 msgr2=0x555bc99a6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 -- 172.21.15.144:0/1977351470 shutdown_connections 2024-09-12T12:20:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 1 -- 172.21.15.144:0/1977351470 wait complete. 2024-09-12T12:20:50.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f606764b000 20 client.6998 trim_cache size 0 max 16384 2024-09-12T12:20:50.896 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:20:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:20:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "2e31ca82-3ea8-42cd-8e0f-ad303555bdac", 2024-09-12T12:20:50.897 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:20:50.897 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:20:50.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 -- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f603c0678c0 msgr2=0x7f603c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f603c0678c0 0x7f603c069d80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f60500af000 tx=0x7f60500a7070 comp rx=0 tx=0).stop 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 -- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c073a70 msgr2=0x7f605c144f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c073a70 0x7f605c144f10 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f604800c3c0 tx=0x7f604800c880 comp rx=0 tx=0).stop 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 -- 172.21.15.144:0/1379096523 shutdown_connections 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f603c0678c0 0x7f603c069d80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f605c156c10 0x7f605c145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c073a70 0x7f605c144f10 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 --2- 172.21.15.144:0/1379096523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f605c06cff0 0x7f605c0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 -- 172.21.15.144:0/1379096523 >> 172.21.15.144:0/1379096523 conn(0x7f605c06bc10 msgr2=0x7f605c0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:50.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 -- 172.21.15.144:0/1379096523 shutdown_connections 2024-09-12T12:20:50.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:50.887+0000 7f6064200640 1 -- 172.21.15.144:0/1379096523 wait complete. 2024-09-12T12:20:50.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:50.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-09-12T12:20:51.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.063+0000 7f7c01e00640 1 Processor -- start 2024-09-12T12:20:51.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.063+0000 7f7c01e00640 1 -- start start 2024-09-12T12:20:51.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7c01e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bfc15eb20 0x7f7bfc0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7c01e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7bfc0b3970 0x7f7bfc0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7c01e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc0b3470 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7c01e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7bfc0b5440 con 0x7f7bfc15eb20 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7c01e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7bfc15f270 con 0x7f7bfc0b3970 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7bfa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bfc15eb20 0x7f7bfc0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7bfa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7bfc15eb20 0x7f7bfc0b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51774/0 (socket says 172.21.15.144:51774) 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7bfa000640 1 -- 172.21.15.144:0/259011281 learned_addr learned my addr 172.21.15.144:0/259011281 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7bfb400640 1 --2- 172.21.15.144:0/259011281 >> v2:172.21.15.165:3300/0 conn(0x7f7bfc0b3970 0x7f7bfc0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7bfa000640 1 -- 172.21.15.144:0/259011281 >> v2:172.21.15.165:3300/0 conn(0x7f7bfc0b3970 msgr2=0x7f7bfc0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7bfa000640 1 --2- 172.21.15.144:0/259011281 >> v2:172.21.15.165:3300/0 conn(0x7f7bfc0b3970 0x7f7bfc0b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7bfa000640 1 -- 172.21.15.144:0/259011281 >> v1:172.21.15.165:6789/0 conn(0x7f7bfc0b4b20 legacy=0x7f7bfc162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.067+0000 7f7bfa000640 1 -- 172.21.15.144:0/259011281 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc15f550 con 0x7f7bfc15eb20 2024-09-12T12:20:51.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7bfa000640 1 --2- 172.21.15.144:0/259011281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc15eb20 0x7f7bfc0b4f00 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0b4340 tx=0x7f7be801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613850c4eb9d9244 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7bf9600640 1 -- 172.21.15.144:0/259011281 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80b2070 con 0x7f7bfc15eb20 2024-09-12T12:20:51.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7bf9600640 1 -- 172.21.15.144:0/259011281 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80ad680 con 0x7f7bfc15eb20 2024-09-12T12:20:51.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7bf9600640 1 -- 172.21.15.144:0/259011281 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80ada50 con 0x7f7bfc15eb20 2024-09-12T12:20:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 -- 172.21.15.144:0/259011281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc15eb20 msgr2=0x7f7bfc0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 --2- 172.21.15.144:0/259011281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc15eb20 0x7f7bfc0b4f00 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0b4340 tx=0x7f7be801c490 comp rx=0 tx=0).stop 2024-09-12T12:20:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 -- 172.21.15.144:0/259011281 shutdown_connections 2024-09-12T12:20:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 --2- 172.21.15.144:0/259011281 >> v2:172.21.15.165:3300/0 conn(0x7f7bfc0b3970 0x7f7bfc0b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 --2- 172.21.15.144:0/259011281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc15eb20 0x7f7bfc0b4f00 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 -- 172.21.15.144:0/259011281 >> 172.21.15.144:0/259011281 conn(0x7f7bfc068030 msgr2=0x7f7bfc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 -- 172.21.15.144:0/259011281 shutdown_connections 2024-09-12T12:20:51.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 -- 172.21.15.144:0/259011281 wait complete. 2024-09-12T12:20:51.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 Processor -- start 2024-09-12T12:20:51.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 -- start start 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc0b3970 0x7f7bfc071ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc0b4b20 0x7f7bfc13c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc15eb20 0x7f7bfc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc06bfa0 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc06be20 con 0x7f7bfc15eb20 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7c01e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc06c120 con 0x7f7bfc0b3970 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7bfa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc0b4b20 0x7f7bfc13c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7bfa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc0b4b20 0x7f7bfc13c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51788/0 (socket says 172.21.15.144:51788) 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.071+0000 7f7bfa000640 1 -- 172.21.15.144:0/4125192926 learned_addr learned my addr 172.21.15.144:0/4125192926 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfb400640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc15eb20 0x7f7bfc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc0b3970 0x7f7bfc071ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfa000640 1 -- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc0b3970 msgr2=0x7f7bfc071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfa000640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc0b3970 0x7f7bfc071ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfa000640 1 -- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc15eb20 msgr2=0x7f7bfc072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfa000640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc15eb20 0x7f7bfc072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfa000640 1 -- 172.21.15.144:0/4125192926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc13f290 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc0b3970 0x7f7bfc071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfb400640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc15eb20 0x7f7bfc072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bfa000640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc0b4b20 0x7f7bfc13c1e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7be801a0c0 tx=0x7f7be8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bf3400640 1 -- 172.21.15.144:0/4125192926 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80bd070 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bf3400640 1 -- 172.21.15.144:0/4125192926 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80adcf0 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bf3400640 1 -- 172.21.15.144:0/4125192926 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80b2040 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7c01e00640 1 -- 172.21.15.144:0/4125192926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bfc073660 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7c01e00640 1 -- 172.21.15.144:0/4125192926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bfc0713a0 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.075+0000 7f7bf3400640 1 -- 172.21.15.144:0/4125192926 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7be80b53c0 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bf3400640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bf3400640 1 -- 172.21.15.144:0/4125192926 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f7be811f5d0 con 0x7f7bfc0b4b20 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 Processor -- start 2024-09-12T12:20:51.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 -- start start 2024-09-12T12:20:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7bec001e10 tx=0x7f7bec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7040c10 0x55b4c7040ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7041530 0x55b4c6ff4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b4c6e45cc0 con 0x55b4c6ff4780 2024-09-12T12:20:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b4c6e00a20 con 0x55b4c7040c10 2024-09-12T12:20:51.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b4c6e41c80 con 0x55b4c7041530 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51798/0 (socket says 172.21.15.144:51798) 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfaa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7040c10 0x55b4c7040ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfb400640 1 -- 172.21.15.144:0/2665842226 learned_addr learned my addr 172.21.15.144:0/2665842226 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfa000640 1 --2- 172.21.15.144:0/2665842226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7041530 0x55b4c6ff4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfb400640 1 -- 172.21.15.144:0/2665842226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7041530 msgr2=0x55b4c6ff4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfb400640 1 --2- 172.21.15.144:0/2665842226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7041530 0x55b4c6ff4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfb400640 1 -- 172.21.15.144:0/2665842226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7040c10 msgr2=0x55b4c7040ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfb400640 1 --2- 172.21.15.144:0/2665842226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7040c10 0x55b4c7040ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfb400640 1 -- 172.21.15.144:0/2665842226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c6de8d40 con 0x55b4c6ff4780 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7bfb400640 1 --2- 172.21.15.144:0/2665842226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff4b60 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400b9c0 tx=0x7f7bf400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebd51c6e3963f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7be7e00640 1 -- 172.21.15.144:0/2665842226 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4018020 con 0x55b4c6ff4780 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7be7e00640 1 -- 172.21.15.144:0/2665842226 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf400fae0 con 0x55b4c6ff4780 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7be7e00640 1 -- 172.21.15.144:0/2665842226 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400fe90 con 0x55b4c6ff4780 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 -- 172.21.15.144:0/2665842226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c6ff4780 msgr2=0x55b4c6ff4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 --2- 172.21.15.144:0/2665842226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff4b60 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400b9c0 tx=0x7f7bf400be80 comp rx=0 tx=0).stop 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 -- 172.21.15.144:0/2665842226 shutdown_connections 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 --2- 172.21.15.144:0/2665842226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff4b60 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 --2- 172.21.15.144:0/2665842226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7041530 0x55b4c6ff4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 --2- 172.21.15.144:0/2665842226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7040c10 0x55b4c7040ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.079+0000 7f7c050f3000 1 -- 172.21.15.144:0/2665842226 >> 172.21.15.144:0/2665842226 conn(0x55b4c70219b0 msgr2=0x55b4c7023da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 -- 172.21.15.144:0/2665842226 shutdown_connections 2024-09-12T12:20:51.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 -- 172.21.15.144:0/2665842226 wait complete. 2024-09-12T12:20:51.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 -- start start 2024-09-12T12:20:51.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 Processor -- start 2024-09-12T12:20:51.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c6ff4780 0x55b4c7047d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7040c10 0x55b4c70482d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7041530 0x55b4c7048810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b4c6ddf2c0 con 0x55b4c7040c10 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b4c6e04370 con 0x55b4c7041530 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b4c6e53f50 con 0x55b4c6ff4780 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 10 client.0 _ll_register_callbacks cb 0x55b4c6ea6db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7040c10 0x55b4c70482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7040c10 0x55b4c70482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51808/0 (socket says 172.21.15.144:51808) 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfaa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c6ff4780 0x55b4c7047d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfa000640 1 -- 172.21.15.144:0/1784641856 learned_addr learned my addr 172.21.15.144:0/1784641856 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfb400640 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7041530 0x55b4c7048810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfa000640 1 -- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c6ff4780 msgr2=0x55b4c7047d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfa000640 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c6ff4780 0x55b4c7047d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfa000640 1 -- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7041530 msgr2=0x55b4c7048810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfa000640 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7041530 0x55b4c7048810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfa000640 1 -- 172.21.15.144:0/1784641856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c6de5770 con 0x55b4c7040c10 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfa000640 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7040c10 0x55b4c70482d0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7be801c970 tx=0x7f7be80ef4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b84dc1871098d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7be4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7be4c00640 1 -- 172.21.15.144:0/1784641856 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80f3ca0 con 0x55b4c7040c10 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7be4c00640 1 -- 172.21.15.144:0/1784641856 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f7be80ebf60 con 0x55b4c7040c10 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 -- 172.21.15.144:0/1784641856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bf400fae0 con 0x55b4c7040c10 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7be4c00640 1 -- 172.21.15.144:0/1784641856 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f7be80f84d0 con 0x55b4c7040c10 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 10 client.8193 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 -- 172.21.15.144:0/1784641856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55b4c6e033f0 con 0x55b4c7040c10 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7be4c00640 1 -- 172.21.15.144:0/1784641856 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf400fae0 con 0x55b4c7040c10 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7be4c00640 1 -- 172.21.15.144:0/1784641856 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f7be8107b50 con 0x55b4c7040c10 2024-09-12T12:20:51.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 10 client.8193 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 10 client.8193 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 20 client.8193 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55b4c7050160 0x55b4c7052550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 4 client.8193 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7c050f3000 1 -- 172.21.15.144:0/1784641856 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4c6ddfd90 con 0x55b4c7050160 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.083+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55b4c7050160 0x55b4c7052550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55b4c7050160 0x55b4c7052550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e240856c6af08f6e server_cookie=49da57e71419f020 in_seq=0 out_seq=0 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7be4c00640 10 client.8193 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7be4c00640 1 -- 172.21.15.144:0/1784641856 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4c6ddfd90 con 0x55b4c7050160 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7be4c00640 10 client.8193 handle_command_reply: tid=0 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 client.8193 shutdown 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 -- 172.21.15.144:0/1784641856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7040c10 msgr2=0x55b4c70482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7040c10 0x55b4c70482d0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7be801c970 tx=0x7f7be80ef4b0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 -- 172.21.15.144:0/1784641856 shutdown_connections 2024-09-12T12:20:51.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55b4c7050160 0x55b4c7052550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c7041530 0x55b4c7048810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7040c10 0x55b4c70482d0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 --2- 172.21.15.144:0/1784641856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c6ff4780 0x55b4c7047d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7be4c00640 0 client.8193 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:51.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 -- 172.21.15.144:0/1784641856 >> 172.21.15.144:0/1784641856 conn(0x55b4c70219b0 msgr2=0x55b4c6ff3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 -- 172.21.15.144:0/1784641856 shutdown_connections 2024-09-12T12:20:51.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 1 -- 172.21.15.144:0/1784641856 wait complete. 2024-09-12T12:20:51.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.087+0000 7f7c050f3000 20 client.8193 trim_cache size 0 max 16384 2024-09-12T12:20:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7c050f3000 1 Processor -- start 2024-09-12T12:20:51.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7c050f3000 1 -- start start 2024-09-12T12:20:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c6ff3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c704e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7c050f3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc203090 con 0x55b4c7041530 2024-09-12T12:20:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7c050f3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc0b0870 con 0x55b4c6ff4780 2024-09-12T12:20:51.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7c050f3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc202c00 con 0x55b4c7040c10 2024-09-12T12:20:51.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c704e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c704e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51816/0 (socket says 172.21.15.144:51816) 2024-09-12T12:20:51.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.103+0000 7f7bfb400640 1 -- 172.21.15.144:0/58298997 learned_addr learned my addr 172.21.15.144:0/58298997 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/58298997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfa000640 1 --2- 172.21.15.144:0/58298997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c6ff3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfb400640 1 -- 172.21.15.144:0/58298997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 msgr2=0x55b4c6ff3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfb400640 1 --2- 172.21.15.144:0/58298997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c6ff3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfb400640 1 -- 172.21.15.144:0/58298997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 msgr2=0x55b4c6ff3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfb400640 1 --2- 172.21.15.144:0/58298997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfb400640 1 -- 172.21.15.144:0/58298997 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c6ec7320 con 0x55b4c7041530 2024-09-12T12:20:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfb400640 1 --2- 172.21.15.144:0/58298997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c704e290 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400bec0 tx=0x7f7bf4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37db3a8a54548821 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7be7400640 1 -- 172.21.15.144:0/58298997 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4018040 con 0x55b4c7041530 2024-09-12T12:20:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7be7400640 1 -- 172.21.15.144:0/58298997 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf402c070 con 0x55b4c7041530 2024-09-12T12:20:51.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7be7400640 1 -- 172.21.15.144:0/58298997 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400fd40 con 0x55b4c7041530 2024-09-12T12:20:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 -- 172.21.15.144:0/58298997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 msgr2=0x55b4c704e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 --2- 172.21.15.144:0/58298997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c704e290 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400bec0 tx=0x7f7bf4014000 comp rx=0 tx=0).stop 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 -- 172.21.15.144:0/58298997 shutdown_connections 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 --2- 172.21.15.144:0/58298997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c704e290 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 --2- 172.21.15.144:0/58298997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c6ff3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 --2- 172.21.15.144:0/58298997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 0x55b4c6ff3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 -- 172.21.15.144:0/58298997 >> 172.21.15.144:0/58298997 conn(0x55b4c70219b0 msgr2=0x55b4c704d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 -- 172.21.15.144:0/58298997 shutdown_connections 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 -- 172.21.15.144:0/58298997 wait complete. 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 -- start start 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 Processor -- start 2024-09-12T12:20:51.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 0x55b4c70b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c70b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c7054890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b4c6ded120 con 0x55b4c7041530 2024-09-12T12:20:51.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b4c6ec6e90 con 0x55b4c6ff4780 2024-09-12T12:20:51.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b4c6defb90 con 0x55b4c7040c10 2024-09-12T12:20:51.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7c050f3000 10 client.0 _ll_register_callbacks cb 0x7f7be8006d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:51.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c7054890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfa000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c70b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfaa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 0x55b4c70b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfa000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c70b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34418/0 (socket says 172.21.15.144:34418) 2024-09-12T12:20:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfa000640 1 -- 172.21.15.144:0/3460421598 learned_addr learned my addr 172.21.15.144:0/3460421598 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.107+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c7054890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51820/0 (socket says 172.21.15.144:51820) 2024-09-12T12:20:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7bfa000640 1 -- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 msgr2=0x55b4c70b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7bfa000640 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 0x55b4c70b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7bfa000640 1 -- 172.21.15.144:0/3460421598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 msgr2=0x55b4c7054890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7bfa000640 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c7054890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7bfa000640 1 -- 172.21.15.144:0/3460421598 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c6dd95c0 con 0x55b4c7040c10 2024-09-12T12:20:51.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7bfa000640 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c70b4e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7be80ef5f0 tx=0x7f7be80ba040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19726fedea5b808d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 1 -- 172.21.15.144:0/3460421598 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80ef6c0 con 0x55b4c7040c10 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 1 -- 172.21.15.144:0/3460421598 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f7be80eef40 con 0x55b4c7040c10 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 -- 172.21.15.144:0/3460421598 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bf402c070 con 0x55b4c7040c10 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 1 -- 172.21.15.144:0/3460421598 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f7be80f3ca0 con 0x55b4c7040c10 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 10 client.7013 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 -- 172.21.15.144:0/3460421598 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55b4c6ddd330 con 0x55b4c7040c10 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 1 -- 172.21.15.144:0/3460421598 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf402c070 con 0x55b4c7040c10 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 1 -- 172.21.15.144:0/3460421598 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f7be811f0b0 con 0x55b4c7040c10 2024-09-12T12:20:51.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 10 client.7013 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:51.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 10 client.7013 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-12T12:20:51.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 20 client.7013 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:51.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55b4c7054dd0 0x55b4c70551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 4 client.7013 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-12T12:20:51.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 -- 172.21.15.144:0/3460421598 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55b4c6e533f0 con 0x55b4c7054dd0 2024-09-12T12:20:51.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55b4c7054dd0 0x55b4c70551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 10 client.7013 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:51.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55b4c7054dd0 0x55b4c70551e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4d076dff119c369 server_cookie=7c81cc50e9144a5f in_seq=0 out_seq=0 2024-09-12T12:20:51.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 1 -- 172.21.15.144:0/3460421598 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b4c6e533f0 con 0x55b4c7054dd0 2024-09-12T12:20:51.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 10 client.7013 handle_command_reply: tid=0 2024-09-12T12:20:51.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 client.7013 shutdown 2024-09-12T12:20:51.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 -- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 msgr2=0x55b4c70b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c70b4e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7be80ef5f0 tx=0x7f7be80ba040 comp rx=0 tx=0).stop 2024-09-12T12:20:51.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 -- 172.21.15.144:0/3460421598 shutdown_connections 2024-09-12T12:20:51.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55b4c7054dd0 0x55b4c70551e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b4c7041530 0x55b4c7054890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b4c7040c10 0x55b4c70b4e20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7be4c00640 0 client.7013 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:51.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 --2- 172.21.15.144:0/3460421598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b4c6ff4780 0x55b4c70b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 -- 172.21.15.144:0/3460421598 >> 172.21.15.144:0/3460421598 conn(0x55b4c70219b0 msgr2=0x55b4c704e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 -- 172.21.15.144:0/3460421598 shutdown_connections 2024-09-12T12:20:51.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 1 -- 172.21.15.144:0/3460421598 wait complete. 2024-09-12T12:20:51.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c050f3000 20 client.7013 trim_cache size 0 max 16384 2024-09-12T12:20:51.121 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:20:51.122 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:20:51.122 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:20:51.122 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 -- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 msgr2=0x7f7bdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7bec001e10 tx=0x7f7bec009040 comp rx=0 tx=0).stop 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 -- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc0b4b20 msgr2=0x7f7bfc13c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc0b4b20 0x7f7bfc13c1e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7be801a0c0 tx=0x7f7be8019230 comp rx=0 tx=0).stop 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 -- 172.21.15.144:0/4125192926 shutdown_connections 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc15eb20 0x7f7bfc072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7bfc0b4b20 0x7f7bfc13c1e0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 --2- 172.21.15.144:0/4125192926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc0b3970 0x7f7bfc071ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 -- 172.21.15.144:0/4125192926 >> 172.21.15.144:0/4125192926 conn(0x7f7bfc068030 msgr2=0x7f7bfc1418c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 -- 172.21.15.144:0/4125192926 shutdown_connections 2024-09-12T12:20:51.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.111+0000 7f7c01e00640 1 -- 172.21.15.144:0/4125192926 wait complete. 2024-09-12T12:20:51.133 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-12T12:20:51.133 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-12T12:20:51.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccfb400640 1 Processor -- start 2024-09-12T12:20:51.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccfb400640 1 -- start start 2024-09-12T12:20:51.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccfb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf415e470 0x7fccf40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccfb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fccf406fd10 0x7fccf4072a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccfb400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccf4070150 con 0x7fccf4072fa0 2024-09-12T12:20:51.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccfb400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fccf40b63d0 con 0x7fccf406fd10 2024-09-12T12:20:51.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccfb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fccf40b66b0 con 0x7fccf415e470 2024-09-12T12:20:51.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccf3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fccf406fd10 0x7fccf4072a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccf9400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fccf4072fa0 0x7fccf406da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39060/0 (socket says 172.21.15.144:39060) 2024-09-12T12:20:51.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccf9400640 1 -- 172.21.15.144:0/4140748647 learned_addr learned my addr 172.21.15.144:0/4140748647 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:51.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccf3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fccf406fd10 0x7fccf4072a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51830/0 (socket says 172.21.15.144:51830) 2024-09-12T12:20:51.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccf8a00640 1 --2- 172.21.15.144:0/4140748647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf415e470 0x7fccf40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccf3e00640 1 -- 172.21.15.144:0/4140748647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf415e470 msgr2=0x7fccf40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccf3e00640 1 --2- 172.21.15.144:0/4140748647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf415e470 0x7fccf40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.271+0000 7fccf3e00640 1 -- 172.21.15.144:0/4140748647 >> v1:172.21.15.144:6789/0 conn(0x7fccf4072fa0 legacy=0x7fccf406da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.275+0000 7fccf3e00640 1 -- 172.21.15.144:0/4140748647 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf40b6990 con 0x7fccf406fd10 2024-09-12T12:20:51.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.275+0000 7fccf3400640 1 -- 172.21.15.144:0/4140748647 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009122250 0 0) 0x7fccf4070150 con 0x7fccf4072fa0 2024-09-12T12:20:51.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.275+0000 7fccf3e00640 1 --2- 172.21.15.144:0/4140748647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf406fd10 0x7fccf4072a60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fcce00097c0 tx=0x7fcce001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1ebba6e6ea685f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.275+0000 7fccf3400640 1 -- 172.21.15.144:0/4140748647 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce00b2070 con 0x7fccf406fd10 2024-09-12T12:20:51.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.275+0000 7fccf3400640 1 -- 172.21.15.144:0/4140748647 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce00ad640 con 0x7fccf406fd10 2024-09-12T12:20:51.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.275+0000 7fccf3400640 1 -- 172.21.15.144:0/4140748647 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce00ada10 con 0x7fccf406fd10 2024-09-12T12:20:51.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 -- 172.21.15.144:0/4140748647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf406fd10 msgr2=0x7fccf4072a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 --2- 172.21.15.144:0/4140748647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf406fd10 0x7fccf4072a60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fcce00097c0 tx=0x7fcce001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 -- 172.21.15.144:0/4140748647 shutdown_connections 2024-09-12T12:20:51.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 --2- 172.21.15.144:0/4140748647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf406fd10 0x7fccf4072a60 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 --2- 172.21.15.144:0/4140748647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf415e470 0x7fccf40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 -- 172.21.15.144:0/4140748647 >> 172.21.15.144:0/4140748647 conn(0x7fccf406cb10 msgr2=0x7fccf406cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 -- 172.21.15.144:0/4140748647 shutdown_connections 2024-09-12T12:20:51.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 -- 172.21.15.144:0/4140748647 wait complete. 2024-09-12T12:20:51.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 Processor -- start 2024-09-12T12:20:51.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 -- start start 2024-09-12T12:20:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf406fd10 0x7fccf414d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf4072fa0 0x7fccf4151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccf415e470 0x7fccf4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fccf416b230 con 0x7fccf4072fa0 2024-09-12T12:20:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fccf416b0b0 con 0x7fccf415e470 2024-09-12T12:20:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccfb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fccf416b3b0 con 0x7fccf406fd10 2024-09-12T12:20:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf4072fa0 0x7fccf4151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf4072fa0 0x7fccf4151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51834/0 (socket says 172.21.15.144:51834) 2024-09-12T12:20:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf3e00640 1 -- 172.21.15.144:0/2745057360 learned_addr learned my addr 172.21.15.144:0/2745057360 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf8a00640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf406fd10 0x7fccf414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf9400640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccf415e470 0x7fccf4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf3e00640 1 -- 172.21.15.144:0/2745057360 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf406fd10 msgr2=0x7fccf414d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf3e00640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf406fd10 0x7fccf414d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf3e00640 1 -- 172.21.15.144:0/2745057360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccf415e470 msgr2=0x7fccf4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf3e00640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccf415e470 0x7fccf4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf3e00640 1 -- 172.21.15.144:0/2745057360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf41523a0 con 0x7fccf4072fa0 2024-09-12T12:20:51.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.279+0000 7fccf3e00640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf4072fa0 0x7fccf4151920 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fcce00b0040 tx=0x7fcce0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccf0c00640 1 -- 172.21.15.144:0/2745057360 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce00bd070 con 0x7fccf4072fa0 2024-09-12T12:20:51.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccf0c00640 1 -- 172.21.15.144:0/2745057360 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce0004030 con 0x7fccf4072fa0 2024-09-12T12:20:51.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccf0c00640 1 -- 172.21.15.144:0/2745057360 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce00b2040 con 0x7fccf4072fa0 2024-09-12T12:20:51.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccfb400640 1 -- 172.21.15.144:0/2745057360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf4152610 con 0x7fccf4072fa0 2024-09-12T12:20:51.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccfb400640 1 -- 172.21.15.144:0/2745057360 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf4153f80 con 0x7fccf4072fa0 2024-09-12T12:20:51.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccf0c00640 1 -- 172.21.15.144:0/2745057360 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcce0003620 con 0x7fccf4072fa0 2024-09-12T12:20:51.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccf0c00640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccd40678c0 0x7fccd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccf0c00640 1 -- 172.21.15.144:0/2745057360 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fcce011f230 con 0x7fccf4072fa0 2024-09-12T12:20:51.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccf8a00640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccd40678c0 0x7fccd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.283+0000 7fccfe869000 1 Processor -- start 2024-09-12T12:20:51.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- start start 2024-09-12T12:20:51.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf8a00640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccd40678c0 0x7fccd4069d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcce4003b90 tx=0x7fcce40098d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 0x55fd86bfe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86bb1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86bb2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fd86a9b960 con 0x55fd86bfe690 2024-09-12T12:20:51.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fd869df900 con 0x55fd86bb1db0 2024-09-12T12:20:51.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55fd86a02d40 con 0x55fd86bfdd70 2024-09-12T12:20:51.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86bb1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 0x55fd86bfe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86bb2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 0x55fd86bfe150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34452/0 (socket says 172.21.15.144:34452) 2024-09-12T12:20:51.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf8a00640 1 -- 172.21.15.144:0/1877129088 learned_addr learned my addr 172.21.15.144:0/1877129088 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf9400640 1 -- 172.21.15.144:0/1877129088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 msgr2=0x55fd86bfe150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf9400640 1 --2- 172.21.15.144:0/1877129088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 0x55fd86bfe150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf9400640 1 -- 172.21.15.144:0/1877129088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 msgr2=0x55fd86bb1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf9400640 1 --2- 172.21.15.144:0/1877129088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86bb1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf9400640 1 -- 172.21.15.144:0/1877129088 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd869a9580 con 0x55fd86bb1db0 2024-09-12T12:20:51.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccf9400640 1 --2- 172.21.15.144:0/1877129088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86bb2190 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fccec000c10 tx=0x7fccec004bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d731080bcb4de4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fcce9600640 1 -- 172.21.15.144:0/1877129088 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec0018a0 con 0x55fd86bb1db0 2024-09-12T12:20:51.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fcce9600640 1 -- 172.21.15.144:0/1877129088 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccec018070 con 0x55fd86bb1db0 2024-09-12T12:20:51.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fcce9600640 1 -- 172.21.15.144:0/1877129088 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec001ca0 con 0x55fd86bb1db0 2024-09-12T12:20:51.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- 172.21.15.144:0/1877129088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 msgr2=0x55fd86bb2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 --2- 172.21.15.144:0/1877129088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86bb2190 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fccec000c10 tx=0x7fccec004bc0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- 172.21.15.144:0/1877129088 shutdown_connections 2024-09-12T12:20:51.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 --2- 172.21.15.144:0/1877129088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86bb2190 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 --2- 172.21.15.144:0/1877129088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86bb1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 --2- 172.21.15.144:0/1877129088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 0x55fd86bfe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- 172.21.15.144:0/1877129088 >> 172.21.15.144:0/1877129088 conn(0x55fd86bdf040 msgr2=0x55fd86be1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- 172.21.15.144:0/1877129088 shutdown_connections 2024-09-12T12:20:51.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- 172.21.15.144:0/1877129088 wait complete. 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 -- start start 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.287+0000 7fccfe869000 1 Processor -- start 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86c04ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 0x55fd86c05220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86c05760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fd869fed00 con 0x55fd86bfe690 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fd869bdaa0 con 0x55fd86bb1db0 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55fd8699c340 con 0x55fd86bfdd70 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 10 client.0 _ll_register_callbacks cb 0x55fd86b9f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86c05760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86c05760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51854/0 (socket says 172.21.15.144:51854) 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf9400640 1 -- 172.21.15.144:0/156965837 learned_addr learned my addr 172.21.15.144:0/156965837 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf8a00640 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86c04ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf3e00640 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 0x55fd86c05220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf9400640 1 -- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 msgr2=0x55fd86c05220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf9400640 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 0x55fd86c05220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf9400640 1 -- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 msgr2=0x55fd86c04ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf9400640 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86c04ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf9400640 1 -- 172.21.15.144:0/156965837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd869a5dc0 con 0x55fd86bfe690 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf8a00640 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86c04ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf9400640 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86c05760 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fccec015040 tx=0x7fccec012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab107254dd5a4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccde000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccde000640 1 -- 172.21.15.144:0/156965837 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec01d820 con 0x55fd86bfe690 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccde000640 1 -- 172.21.15.144:0/156965837 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fccec01d9c0 con 0x55fd86bfe690 2024-09-12T12:20:51.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 -- 172.21.15.144:0/156965837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccec018070 con 0x55fd86bfe690 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccde000640 1 -- 172.21.15.144:0/156965837 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fccec02e050 con 0x55fd86bfe690 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 10 client.8214 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 -- 172.21.15.144:0/156965837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55fd869a27f0 con 0x55fd86bfe690 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccde000640 1 -- 172.21.15.144:0/156965837 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccec018070 con 0x55fd86bfe690 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccde000640 1 -- 172.21.15.144:0/156965837 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fccec031020 con 0x55fd86bfe690 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 10 client.8214 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 10 client.8214 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 20 client.8214 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55fd86c0d0b0 0x55fd86c0f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 4 client.8214 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccfe869000 1 -- 172.21.15.144:0/156965837 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd8699ce10 con 0x55fd86c0d0b0 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf8a00640 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55fd86c0d0b0 0x55fd86c0f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccf8a00640 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55fd86c0d0b0 0x55fd86c0f4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f90cb7837f9dc5d server_cookie=8f4a439f6c148921 in_seq=0 out_seq=0 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.291+0000 7fccde000640 10 client.8214 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccde000640 1 -- 172.21.15.144:0/156965837 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd8699ce10 con 0x55fd86c0d0b0 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccde000640 10 client.8214 handle_command_reply: tid=0 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 client.8214 shutdown 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 -- 172.21.15.144:0/156965837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 msgr2=0x55fd86c05760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86c05760 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fccec015040 tx=0x7fccec012000 comp rx=0 tx=0).stop 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 -- 172.21.15.144:0/156965837 shutdown_connections 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55fd86c0d0b0 0x55fd86c0f4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bfe690 0x55fd86c05760 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfdd70 0x55fd86c05220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 --2- 172.21.15.144:0/156965837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bb1db0 0x55fd86c04ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccde000640 0 client.8214 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:51.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 -- 172.21.15.144:0/156965837 >> 172.21.15.144:0/156965837 conn(0x55fd86bdf040 msgr2=0x55fd86bb0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 -- 172.21.15.144:0/156965837 shutdown_connections 2024-09-12T12:20:51.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 1 -- 172.21.15.144:0/156965837 wait complete. 2024-09-12T12:20:51.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.295+0000 7fccfe869000 20 client.8214 trim_cache size 0 max 16384 2024-09-12T12:20:51.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccfe869000 1 Processor -- start 2024-09-12T12:20:51.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccfe869000 1 -- start start 2024-09-12T12:20:51.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccfe869000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86bb9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccfe869000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 0x55fd86bba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccfe869000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 0x55fd86c0f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccfe869000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4204300 con 0x55fd86bb1db0 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccfe869000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4203340 con 0x55fd86bfdd70 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccfe869000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fccf42026a0 con 0x55fd86bfe690 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86bb9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86bb9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51856/0 (socket says 172.21.15.144:51856) 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf8a00640 1 -- 172.21.15.144:0/2328715702 learned_addr learned my addr 172.21.15.144:0/2328715702 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf9400640 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 0x55fd86c0f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf3e00640 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 0x55fd86bba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf8a00640 1 -- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 msgr2=0x55fd86c0f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf8a00640 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 0x55fd86c0f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf8a00640 1 -- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 msgr2=0x55fd86bba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf8a00640 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 0x55fd86bba140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf8a00640 1 -- 172.21.15.144:0/2328715702 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd869c0470 con 0x55fd86bb1db0 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf3e00640 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 0x55fd86bba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.311+0000 7fccf9400640 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 0x55fd86c0f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86bb9c00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009f50 tx=0x7fcce4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe235dc00f3671f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fcce8c00640 1 -- 172.21.15.144:0/2328715702 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4017c90 con 0x55fd86bb1db0 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fcce8c00640 1 -- 172.21.15.144:0/2328715702 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce4017e30 con 0x55fd86bb1db0 2024-09-12T12:20:51.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fcce8c00640 1 -- 172.21.15.144:0/2328715702 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce402c2c0 con 0x55fd86bb1db0 2024-09-12T12:20:51.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 -- 172.21.15.144:0/2328715702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 msgr2=0x55fd86bb9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86bb9c00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009f50 tx=0x7fcce4003f90 comp rx=0 tx=0).stop 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 -- 172.21.15.144:0/2328715702 shutdown_connections 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 0x55fd86c0f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 0x55fd86bba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 --2- 172.21.15.144:0/2328715702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86bb9c00 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 -- 172.21.15.144:0/2328715702 >> 172.21.15.144:0/2328715702 conn(0x55fd86bdf040 msgr2=0x55fd86c0aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 -- 172.21.15.144:0/2328715702 shutdown_connections 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 -- 172.21.15.144:0/2328715702 wait complete. 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 -- start start 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 Processor -- start 2024-09-12T12:20:51.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86c12330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 0x55fd86c71e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 0x55fd86c72360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fd869c13f0 con 0x55fd86bb1db0 2024-09-12T12:20:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fd86bbd3f0 con 0x55fd86bfdd70 2024-09-12T12:20:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55fd869ca400 con 0x55fd86bfe690 2024-09-12T12:20:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccfe869000 10 client.0 _ll_register_callbacks cb 0x7fcce4009770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86c12330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86c12330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51860/0 (socket says 172.21.15.144:51860) 2024-09-12T12:20:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 -- 172.21.15.144:0/3719159229 learned_addr learned my addr 172.21.15.144:0/3719159229 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf9400640 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 0x55fd86c72360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf3e00640 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 0x55fd86c71e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 -- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 msgr2=0x55fd86c72360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 0x55fd86c72360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 -- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 msgr2=0x55fd86c71e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 0x55fd86c71e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 -- 172.21.15.144:0/3719159229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd86996640 con 0x55fd86bb1db0 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccf8a00640 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86c12330 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fcce40044d0 tx=0x7fcce4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc53735b2466c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccde000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.315+0000 7fccde000640 1 -- 172.21.15.144:0/3719159229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce402ca00 con 0x55fd86bb1db0 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccde000640 1 -- 172.21.15.144:0/3719159229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fcce402cba0 con 0x55fd86bb1db0 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 -- 172.21.15.144:0/3719159229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce4017e30 con 0x55fd86bb1db0 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccde000640 1 -- 172.21.15.144:0/3719159229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fcce4043050 con 0x55fd86bb1db0 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 10 client.8220 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 -- 172.21.15.144:0/3719159229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55fd8699a3b0 con 0x55fd86bb1db0 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccde000640 1 -- 172.21.15.144:0/3719159229 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce4017e30 con 0x55fd86bb1db0 2024-09-12T12:20:51.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccde000640 1 -- 172.21.15.144:0/3719159229 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fcce4046020 con 0x55fd86bb1db0 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 10 client.8220 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 10 client.8220 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 20 client.8220 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55fd86c728a0 0x55fd86c6e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 4 client.8220 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 -- 172.21.15.144:0/3719159229 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fd86a10470 con 0x55fd86c728a0 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccf3e00640 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55fd86c728a0 0x55fd86c6e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccf3e00640 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55fd86c728a0 0x55fd86c6e7f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80e0895e27351ee9 server_cookie=12f299179e779c7 in_seq=0 out_seq=0 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccde000640 10 client.8220 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccde000640 1 -- 172.21.15.144:0/3719159229 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x55fd86a10470 con 0x55fd86c728a0 2024-09-12T12:20:51.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccde000640 10 client.8220 handle_command_reply: tid=0 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 client.8220 shutdown 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 -- 172.21.15.144:0/3719159229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 msgr2=0x55fd86c12330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86c12330 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fcce40044d0 tx=0x7fcce4004ac0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 -- 172.21.15.144:0/3719159229 shutdown_connections 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x55fd86c728a0 0x55fd86c6e7f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55fd86bfe690 0x55fd86c72360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fd86bfdd70 0x55fd86c71e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 --2- 172.21.15.144:0/3719159229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd86bb1db0 0x55fd86c12330 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 -- 172.21.15.144:0/3719159229 >> 172.21.15.144:0/3719159229 conn(0x55fd86bdf040 msgr2=0x55fd86c0b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccde000640 0 client.8220 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 -- 172.21.15.144:0/3719159229 shutdown_connections 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 1 -- 172.21.15.144:0/3719159229 wait complete. 2024-09-12T12:20:51.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfe869000 20 client.8220 trim_cache size 0 max 16384 2024-09-12T12:20:51.328 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:20:51.328 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:20:51.328 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:20:51.328 INFO:teuthology.orchestra.run.smithi144.stdout: "2e31ca82-3ea8-42cd-8e0f-ad303555bdac": { 2024-09-12T12:20:51.328 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_control_test_path", 2024-09-12T12:20:51.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "2e31ca82-3ea8-42cd-8e0f-ad303555bdac", 2024-09-12T12:20:51.328 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "recursive" 2024-09-12T12:20:51.328 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:51.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:20:51.329 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:20:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 -- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccd40678c0 msgr2=0x7fccd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccd40678c0 0x7fccd4069d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcce4003b90 tx=0x7fcce40098d0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 -- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf4072fa0 msgr2=0x7fccf4151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf4072fa0 0x7fccf4151920 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fcce00b0040 tx=0x7fcce0019240 comp rx=0 tx=0).stop 2024-09-12T12:20:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 -- 172.21.15.144:0/2745057360 shutdown_connections 2024-09-12T12:20:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fccd40678c0 0x7fccd4069d80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccf415e470 0x7fccf4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccf4072fa0 0x7fccf4151920 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 --2- 172.21.15.144:0/2745057360 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccf406fd10 0x7fccf414d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:51.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 -- 172.21.15.144:0/2745057360 >> 172.21.15.144:0/2745057360 conn(0x7fccf406cb10 msgr2=0x7fccf406da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:51.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 -- 172.21.15.144:0/2745057360 shutdown_connections 2024-09-12T12:20:51.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:51.319+0000 7fccfb400640 1 -- 172.21.15.144:0/2745057360 wait complete. 2024-09-12T12:20:56.341 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-12T12:20:56.341 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-12T12:20:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2eee00640 1 Processor -- start 2024-09-12T12:20:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2eee00640 1 -- start start 2024-09-12T12:20:56.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2eee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2e815af60 0x7fd2e80ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2eee00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd2e806c320 0x7fd2e80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2eee00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e80b4300 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2eee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e80b32f0 con 0x7fd2e815af60 2024-09-12T12:20:56.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2eee00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e80b3540 con 0x7fd2e806c320 2024-09-12T12:20:56.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2e7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd2e815af60 0x7fd2e80ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2e7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd2e80cd9f0 0x7fd2e806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39072/0 (socket says 172.21.15.144:39072) 2024-09-12T12:20:56.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2e7400640 1 -- 172.21.15.144:0/2083873781 learned_addr learned my addr 172.21.15.144:0/2083873781 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:56.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2ece00640 1 --2- 172.21.15.144:0/2083873781 >> v2:172.21.15.165:3300/0 conn(0x7fd2e806c320 0x7fd2e80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2e7e00640 1 -- 172.21.15.144:0/2083873781 >> v2:172.21.15.165:3300/0 conn(0x7fd2e806c320 msgr2=0x7fd2e80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/2083873781 >> v2:172.21.15.165:3300/0 conn(0x7fd2e806c320 0x7fd2e80b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2e7e00640 1 -- 172.21.15.144:0/2083873781 >> v1:172.21.15.144:6789/0 conn(0x7fd2e80cd9f0 legacy=0x7fd2e806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.491+0000 7fd2e7e00640 1 -- 172.21.15.144:0/2083873781 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e80b3820 con 0x7fd2e815af60 2024-09-12T12:20:56.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/2083873781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e815af60 0x7fd2e80ce680 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd2e806f190 tx=0x7fd2d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9fb1069bc08596 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2e6a00640 1 -- 172.21.15.144:0/2083873781 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80b0070 con 0x7fd2e815af60 2024-09-12T12:20:56.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2e6a00640 1 -- 172.21.15.144:0/2083873781 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80ab600 con 0x7fd2e815af60 2024-09-12T12:20:56.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2e6a00640 1 -- 172.21.15.144:0/2083873781 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80ab9d0 con 0x7fd2e815af60 2024-09-12T12:20:56.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 -- 172.21.15.144:0/2083873781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e815af60 msgr2=0x7fd2e80ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 --2- 172.21.15.144:0/2083873781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e815af60 0x7fd2e80ce680 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fd2e806f190 tx=0x7fd2d801c480 comp rx=0 tx=0).stop 2024-09-12T12:20:56.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 -- 172.21.15.144:0/2083873781 shutdown_connections 2024-09-12T12:20:56.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 --2- 172.21.15.144:0/2083873781 >> v2:172.21.15.165:3300/0 conn(0x7fd2e806c320 0x7fd2e80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 --2- 172.21.15.144:0/2083873781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e815af60 0x7fd2e80ce680 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 -- 172.21.15.144:0/2083873781 >> 172.21.15.144:0/2083873781 conn(0x7fd2e8068030 msgr2=0x7fd2e80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:56.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 -- 172.21.15.144:0/2083873781 shutdown_connections 2024-09-12T12:20:56.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 -- 172.21.15.144:0/2083873781 wait complete. 2024-09-12T12:20:56.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 Processor -- start 2024-09-12T12:20:56.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.495+0000 7fd2eee00640 1 -- start start 2024-09-12T12:20:56.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2eee00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e806c320 0x7fd2e8156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2eee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e80cd9f0 0x7fd2e814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2eee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2e815af60 0x7fd2e8153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2eee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80b5430 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2eee00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80b52b0 con 0x7fd2e806c320 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2eee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e80b55b0 con 0x7fd2e815af60 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e80cd9f0 0x7fd2e814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e80cd9f0 0x7fd2e814f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51876/0 (socket says 172.21.15.144:51876) 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7400640 1 -- 172.21.15.144:0/2566407179 learned_addr learned my addr 172.21.15.144:0/2566407179 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e806c320 0x7fd2e8156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2ece00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2e815af60 0x7fd2e8153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7400640 1 -- 172.21.15.144:0/2566407179 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2e815af60 msgr2=0x7fd2e8153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7400640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2e815af60 0x7fd2e8153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7400640 1 -- 172.21.15.144:0/2566407179 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e806c320 msgr2=0x7fd2e8156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7400640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e806c320 0x7fd2e8156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7400640 1 -- 172.21.15.144:0/2566407179 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e814f7c0 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e806c320 0x7fd2e8156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2e7400640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e80cd9f0 0x7fd2e814f280 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400c420 tx=0x7fd2d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2dfe00640 1 -- 172.21.15.144:0/2566407179 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4017070 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2dfe00640 1 -- 172.21.15.144:0/2566407179 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d4005cf0 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2dfe00640 1 -- 172.21.15.144:0/2566407179 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40072f0 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2eee00640 1 -- 172.21.15.144:0/2566407179 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e8154410 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.499+0000 7fd2eee00640 1 -- 172.21.15.144:0/2566407179 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e81549d0 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2dfe00640 1 -- 172.21.15.144:0/2566407179 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2d401a070 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2dfe00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2c80678c0 0x7fd2c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2dfe00640 1 -- 172.21.15.144:0/2566407179 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fd2d40852f0 con 0x7fd2e80cd9f0 2024-09-12T12:20:56.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2c80678c0 0x7fd2c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2f2198000 1 Processor -- start 2024-09-12T12:20:56.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2f2198000 1 -- start start 2024-09-12T12:20:56.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2c80678c0 0x7fd2c8069d80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80ad000 tx=0x7fd2d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f06dc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f068f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 0x5652f0690190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2f2198000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5652f0579960 con 0x5652f06dc690 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2f2198000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5652f04bd900 con 0x5652f06dbd70 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2f2198000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5652f04e0d40 con 0x5652f068fdb0 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f068f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f068f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51890/0 (socket says 172.21.15.144:51890) 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7400640 1 -- 172.21.15.144:0/3074908695 learned_addr learned my addr 172.21.15.144:0/3074908695 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2ece00640 1 --2- 172.21.15.144:0/3074908695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 0x5652f0690190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/3074908695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f06dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7400640 1 -- 172.21.15.144:0/3074908695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 msgr2=0x5652f0690190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7400640 1 --2- 172.21.15.144:0/3074908695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 0x5652f0690190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7400640 1 -- 172.21.15.144:0/3074908695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 msgr2=0x5652f06dc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7400640 1 --2- 172.21.15.144:0/3074908695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f06dc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7400640 1 -- 172.21.15.144:0/3074908695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f0487580 con 0x5652f06dc690 2024-09-12T12:20:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2e7400640 1 --2- 172.21.15.144:0/3074908695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f068f870 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fd2d405dbb0 tx=0x7fd2d400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda9e55fc37f3d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2dcc00640 1 -- 172.21.15.144:0/3074908695 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40535a0 con 0x5652f06dc690 2024-09-12T12:20:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2dcc00640 1 -- 172.21.15.144:0/3074908695 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d4053800 con 0x5652f06dc690 2024-09-12T12:20:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.503+0000 7fd2dcc00640 1 -- 172.21.15.144:0/3074908695 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4007490 con 0x5652f06dc690 2024-09-12T12:20:56.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- 172.21.15.144:0/3074908695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 msgr2=0x5652f068f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 --2- 172.21.15.144:0/3074908695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f068f870 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fd2d405dbb0 tx=0x7fd2d400cf90 comp rx=0 tx=0).stop 2024-09-12T12:20:56.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- 172.21.15.144:0/3074908695 shutdown_connections 2024-09-12T12:20:56.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 --2- 172.21.15.144:0/3074908695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 0x5652f0690190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 --2- 172.21.15.144:0/3074908695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f068f870 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 --2- 172.21.15.144:0/3074908695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f06dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- 172.21.15.144:0/3074908695 >> 172.21.15.144:0/3074908695 conn(0x5652f06bd040 msgr2=0x5652f06bf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- 172.21.15.144:0/3074908695 shutdown_connections 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- 172.21.15.144:0/3074908695 wait complete. 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- start start 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 Processor -- start 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 0x5652f06e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f06e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f06e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5652f04dcd00 con 0x5652f06dc690 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5652f049baa0 con 0x5652f06dbd70 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5652f047a340 con 0x5652f068fdb0 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 10 client.0 _ll_register_callbacks cb 0x5652f067d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2ece00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f06e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2ece00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f06e3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51906/0 (socket says 172.21.15.144:51906) 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2ece00640 1 -- 172.21.15.144:0/1920120144 learned_addr learned my addr 172.21.15.144:0/1920120144 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2e7400640 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f06e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 0x5652f06e2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2ece00640 1 -- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 msgr2=0x5652f06e2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2ece00640 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 0x5652f06e2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2ece00640 1 -- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 msgr2=0x5652f06e3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2ece00640 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f06e3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2ece00640 1 -- 172.21.15.144:0/1920120144 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652f0483dc0 con 0x5652f06dc690 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2ece00640 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f06e3760 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0007de0 tx=0x7fd2e0012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92ffb40d574530f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2d1600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:56.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2d1600640 1 -- 172.21.15.144:0/1920120144 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e001c020 con 0x5652f06dc690 2024-09-12T12:20:56.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2d1600640 1 -- 172.21.15.144:0/1920120144 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fd2e0018670 con 0x5652f06dc690 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- 172.21.15.144:0/1920120144 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d4053800 con 0x5652f06dc690 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2d1600640 1 -- 172.21.15.144:0/1920120144 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fd2e0026050 con 0x5652f06dc690 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 10 client.8235 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.507+0000 7fd2f2198000 1 -- 172.21.15.144:0/1920120144 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x5652f04807f0 con 0x5652f06dc690 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2d1600640 1 -- 172.21.15.144:0/1920120144 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d4053800 con 0x5652f06dc690 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2d1600640 1 -- 172.21.15.144:0/1920120144 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fd2e0029020 con 0x5652f06dc690 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 10 client.8235 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 10 client.8235 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 20 client.8235 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5652f06eb0b0 0x5652f06ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 4 client.8235 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 -- 172.21.15.144:0/1920120144 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652f047ae10 con 0x5652f06eb0b0 2024-09-12T12:20:56.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5652f06eb0b0 0x5652f06ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5652f06eb0b0 0x5652f06ed4a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c622cd671541edd server_cookie=b8cf9083a2f61ceb in_seq=0 out_seq=0 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2d1600640 10 client.8235 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2d1600640 1 -- 172.21.15.144:0/1920120144 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652f047ae10 con 0x5652f06eb0b0 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2d1600640 10 client.8235 handle_command_reply: tid=0 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 client.8235 shutdown 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 -- 172.21.15.144:0/1920120144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 msgr2=0x5652f06e3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f06e3760 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0007de0 tx=0x7fd2e0012610 comp rx=0 tx=0).stop 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 -- 172.21.15.144:0/1920120144 shutdown_connections 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5652f06eb0b0 0x5652f06ed4a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f06dc690 0x5652f06e3760 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f06e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 --2- 172.21.15.144:0/1920120144 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f068fdb0 0x5652f06e2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2d1600640 0 client.8235 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:56.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 -- 172.21.15.144:0/1920120144 >> 172.21.15.144:0/1920120144 conn(0x5652f06bd040 msgr2=0x5652f068ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 -- 172.21.15.144:0/1920120144 shutdown_connections 2024-09-12T12:20:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 1 -- 172.21.15.144:0/1920120144 wait complete. 2024-09-12T12:20:56.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.511+0000 7fd2f2198000 20 client.8235 trim_cache size 0 max 16384 2024-09-12T12:20:56.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.527+0000 7fd2f2198000 1 Processor -- start 2024-09-12T12:20:56.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- start start 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f0697c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f0698140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dc690 0x5652f06e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8204420 con 0x5652f068fdb0 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8203420 con 0x5652f06dbd70 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e815ce50 con 0x5652f06dc690 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f0697c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f0697c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51920/0 (socket says 172.21.15.144:51920) 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7e00640 1 -- 172.21.15.144:0/3182182268 learned_addr learned my addr 172.21.15.144:0/3182182268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7400640 1 --2- 172.21.15.144:0/3182182268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f0698140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2ece00640 1 --2- 172.21.15.144:0/3182182268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dc690 0x5652f06e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7e00640 1 -- 172.21.15.144:0/3182182268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dc690 msgr2=0x5652f06e5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/3182182268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dc690 0x5652f06e5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7e00640 1 -- 172.21.15.144:0/3182182268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 msgr2=0x5652f0698140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/3182182268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f0698140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7e00640 1 -- 172.21.15.144:0/3182182268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f049e470 con 0x5652f068fdb0 2024-09-12T12:20:56.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/3182182268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f0697c00 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8008010 tx=0x7fd2d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9630d27065cecb9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2d3e00640 1 -- 172.21.15.144:0/3182182268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80d3070 con 0x5652f068fdb0 2024-09-12T12:20:56.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2d3e00640 1 -- 172.21.15.144:0/3182182268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80b1040 con 0x5652f068fdb0 2024-09-12T12:20:56.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2d3e00640 1 -- 172.21.15.144:0/3182182268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80b7880 con 0x5652f068fdb0 2024-09-12T12:20:56.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- 172.21.15.144:0/3182182268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 msgr2=0x5652f0697c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 --2- 172.21.15.144:0/3182182268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f0697c00 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8008010 tx=0x7fd2d8004740 comp rx=0 tx=0).stop 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- 172.21.15.144:0/3182182268 shutdown_connections 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 --2- 172.21.15.144:0/3182182268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dc690 0x5652f06e5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 --2- 172.21.15.144:0/3182182268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dbd70 0x5652f0698140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 --2- 172.21.15.144:0/3182182268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f0697c00 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- 172.21.15.144:0/3182182268 >> 172.21.15.144:0/3182182268 conn(0x5652f06bd040 msgr2=0x5652f06e2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- 172.21.15.144:0/3182182268 shutdown_connections 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- 172.21.15.144:0/3182182268 wait complete. 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 -- start start 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.531+0000 7fd2f2198000 1 Processor -- start 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f06e8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dbd70 0x5652f074f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dc690 0x5652f074f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5652f04e0050 con 0x5652f068fdb0 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8202dd0 con 0x5652f06dc690 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5652f0520780 con 0x5652f06dbd70 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 10 client.0 _ll_register_callbacks cb 0x7fd2e0009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f06e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f06e8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51922/0 (socket says 172.21.15.144:51922) 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7e00640 1 -- 172.21.15.144:0/2828208190 learned_addr learned my addr 172.21.15.144:0/2828208190 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2ece00640 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dc690 0x5652f074f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7400640 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dbd70 0x5652f074f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7e00640 1 -- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dbd70 msgr2=0x5652f074f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dbd70 0x5652f074f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7e00640 1 -- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dc690 msgr2=0x5652f074f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dc690 0x5652f074f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7e00640 1 -- 172.21.15.144:0/2828208190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652f0474640 con 0x5652f068fdb0 2024-09-12T12:20:56.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7e00640 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f06e8950 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80ae040 tx=0x7fd2d801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db906f89e0d74d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:20:56.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 1 -- 172.21.15.144:0/2828208190 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80d3070 con 0x5652f068fdb0 2024-09-12T12:20:56.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 1 -- 172.21.15.144:0/2828208190 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fd2d80d8c40 con 0x5652f068fdb0 2024-09-12T12:20:56.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- 172.21.15.144:0/2828208190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d80b1040 con 0x5652f068fdb0 2024-09-12T12:20:56.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 1 -- 172.21.15.144:0/2828208190 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fd2d80d8e40 con 0x5652f068fdb0 2024-09-12T12:20:56.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 10 client.8241 fetch_fsmap learned FSMap version 98 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- 172.21.15.144:0/2828208190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x5652f04783b0 con 0x5652f068fdb0 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 1 -- 172.21.15.144:0/2828208190 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80b1040 con 0x5652f068fdb0 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 1 -- 172.21.15.144:0/2828208190 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fd2d80cd070 con 0x5652f068fdb0 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 10 client.8241 fetch_fsmap finished waiting for FSMap version 98 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 10 client.8241 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 20 client.8241 populate_metadata read hostname 'smithi144' 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5652f070b790 0x5652f070bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 4 client.8241 mds_command: new command op to 8010 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- 172.21.15.144:0/2828208190 --> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5652f04ee470 con 0x5652f070b790 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7400640 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5652f070b790 0x5652f070bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 10 client.8241 ms_handle_connect on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:56.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2e7400640 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5652f070b790 0x5652f070bba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb56e1d5fcb18d65 server_cookie=f9e9c1f85bd80dd1 in_seq=0 out_seq=0 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 1 -- 172.21.15.144:0/2828208190 <== mds.0 v2:172.21.15.165:6832/3565473111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5652f04ee470 con 0x5652f070b790 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 10 client.8241 handle_command_reply: tid=0 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 client.8241 shutdown 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- 172.21.15.144:0/2828208190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 msgr2=0x5652f06e8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f06e8950 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80ae040 tx=0x7fd2d801acc0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- 172.21.15.144:0/2828208190 shutdown_connections 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:6832/3565473111,v1:172.21.15.165:6834/3565473111] conn(0x5652f070b790 0x5652f070bba0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5652f06dc690 0x5652f074f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5652f06dbd70 0x5652f074f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2d1600640 0 client.8241 ms_handle_reset on v2:172.21.15.165:6832/3565473111 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 --2- 172.21.15.144:0/2828208190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5652f068fdb0 0x5652f06e8950 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- 172.21.15.144:0/2828208190 >> 172.21.15.144:0/2828208190 conn(0x5652f06bd040 msgr2=0x5652f0697410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.535+0000 7fd2f2198000 1 -- 172.21.15.144:0/2828208190 shutdown_connections 2024-09-12T12:20:56.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2f2198000 1 -- 172.21.15.144:0/2828208190 wait complete. 2024-09-12T12:20:56.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2f2198000 20 client.8241 trim_cache size 0 max 16384 2024-09-12T12:20:56.542 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:20:56.542 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "no active scrubs running", 2024-09-12T12:20:56.542 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:20:56.542 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 -- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2c80678c0 msgr2=0x7fd2c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2c80678c0 0x7fd2c8069d80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80ad000 tx=0x7fd2d8008040 comp rx=0 tx=0).stop 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 -- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e80cd9f0 msgr2=0x7fd2e814f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e80cd9f0 0x7fd2e814f280 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400c420 tx=0x7fd2d400c8e0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 -- 172.21.15.144:0/2566407179 shutdown_connections 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd2c80678c0 0x7fd2c8069d80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd2e815af60 0x7fd2e8153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2e80cd9f0 0x7fd2e814f280 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 --2- 172.21.15.144:0/2566407179 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e806c320 0x7fd2e8156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 -- 172.21.15.144:0/2566407179 >> 172.21.15.144:0/2566407179 conn(0x7fd2e8068030 msgr2=0x7fd2e8151040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 -- 172.21.15.144:0/2566407179 shutdown_connections 2024-09-12T12:20:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.539+0000 7fd2eee00640 1 -- 172.21.15.144:0/2566407179 wait complete. 2024-09-12T12:20:56.557 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:20:56.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.691+0000 7f4b9e400640 1 Processor -- start 2024-09-12T12:20:56.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b9e400640 1 -- start start 2024-09-12T12:20:56.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b9e400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4b9815b4e0 0x7f4b980b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b9e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b980b3ad0 0x7f4b98071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b9e400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b980b45a0 con 0x7f4b98071960 2024-09-12T12:20:56.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b9e400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4b980b3fe0 con 0x7f4b9815b4e0 2024-09-12T12:20:56.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b9e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4b980b42c0 con 0x7f4b980b3ad0 2024-09-12T12:20:56.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b97e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4b98071960 0x7f4b980ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39078/0 (socket says 172.21.15.144:39078) 2024-09-12T12:20:56.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b97400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4b9815b4e0 0x7f4b980b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b97e00640 1 -- 172.21.15.144:0/655615139 learned_addr learned my addr 172.21.15.144:0/655615139 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:56.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b8ea00640 1 --2- 172.21.15.144:0/655615139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b980b3ad0 0x7f4b98071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b96a00640 1 -- 172.21.15.144:0/655615139 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085714786 0 0) 0x7f4b980b45a0 con 0x7f4b98071960 2024-09-12T12:20:56.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b96a00640 1 -- 172.21.15.144:0/655615139 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b7c005740 con 0x7f4b98071960 2024-09-12T12:20:56.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b97400640 1 -- 172.21.15.144:0/655615139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b980b3ad0 msgr2=0x7f4b98071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:56.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b97400640 1 --2- 172.21.15.144:0/655615139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b980b3ad0 0x7f4b98071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b97400640 1 -- 172.21.15.144:0/655615139 >> v1:172.21.15.144:6789/0 conn(0x7f4b98071960 legacy=0x7f4b980ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.695+0000 7f4b97400640 1 -- 172.21.15.144:0/655615139 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b980b1490 con 0x7f4b9815b4e0 2024-09-12T12:20:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b97400640 1 --2- 172.21.15.144:0/655615139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9815b4e0 0x7f4b980b3590 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4b880097c0 tx=0x7f4b8801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc02fb405f99716 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b96a00640 1 -- 172.21.15.144:0/655615139 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880aa5f0 con 0x7f4b9815b4e0 2024-09-12T12:20:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b96a00640 1 -- 172.21.15.144:0/655615139 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b880af070 con 0x7f4b9815b4e0 2024-09-12T12:20:56.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b96a00640 1 -- 172.21.15.144:0/655615139 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880aa9b0 con 0x7f4b9815b4e0 2024-09-12T12:20:56.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 -- 172.21.15.144:0/655615139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9815b4e0 msgr2=0x7f4b980b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 --2- 172.21.15.144:0/655615139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9815b4e0 0x7f4b980b3590 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4b880097c0 tx=0x7f4b8801c470 comp rx=0 tx=0).stop 2024-09-12T12:20:56.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 -- 172.21.15.144:0/655615139 shutdown_connections 2024-09-12T12:20:56.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 --2- 172.21.15.144:0/655615139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b980b3ad0 0x7f4b98071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 --2- 172.21.15.144:0/655615139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9815b4e0 0x7f4b980b3590 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 -- 172.21.15.144:0/655615139 >> 172.21.15.144:0/655615139 conn(0x7f4b9806d0d0 msgr2=0x7f4b9806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:56.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 -- 172.21.15.144:0/655615139 shutdown_connections 2024-09-12T12:20:56.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 -- 172.21.15.144:0/655615139 wait complete. 2024-09-12T12:20:56.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 Processor -- start 2024-09-12T12:20:56.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.699+0000 7f4b9e400640 1 -- start start 2024-09-12T12:20:56.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b9e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b98071960 0x7f4b98146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b9e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b980b3ad0 0x7f4b98157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b9e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9815b4e0 0x7f4b98071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b9e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b980b2620 con 0x7f4b980b3ad0 2024-09-12T12:20:56.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b9e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4b980b24a0 con 0x7f4b98071960 2024-09-12T12:20:56.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b9e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4b980cd640 con 0x7f4b9815b4e0 2024-09-12T12:20:56.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b980b3ad0 0x7f4b98157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b980b3ad0 0x7f4b98157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51940/0 (socket says 172.21.15.144:51940) 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8ea00640 1 -- 172.21.15.144:0/2208424837 learned_addr learned my addr 172.21.15.144:0/2208424837 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b97400640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b98071960 0x7f4b98146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b97e00640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9815b4e0 0x7f4b98071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8ea00640 1 -- 172.21.15.144:0/2208424837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9815b4e0 msgr2=0x7f4b98071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8ea00640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9815b4e0 0x7f4b98071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8ea00640 1 -- 172.21.15.144:0/2208424837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b98071960 msgr2=0x7f4b98146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8ea00640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b98071960 0x7f4b98146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8ea00640 1 -- 172.21.15.144:0/2208424837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9815a6b0 con 0x7f4b980b3ad0 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b97e00640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9815b4e0 0x7f4b98071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8ea00640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b980b3ad0 0x7f4b98157680 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000e900 tx=0x7f4b8000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8fe00640 1 -- 172.21.15.144:0/2208424837 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80017070 con 0x7f4b980b3ad0 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8fe00640 1 -- 172.21.15.144:0/2208424837 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8000ca00 con 0x7f4b980b3ad0 2024-09-12T12:20:56.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9815ac30 con 0x7f4b980b3ad0 2024-09-12T12:20:56.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b8fe00640 1 -- 172.21.15.144:0/2208424837 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000cdd0 con 0x7f4b980b3ad0 2024-09-12T12:20:56.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b98155a80 con 0x7f4b980b3ad0 2024-09-12T12:20:56.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.703+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b98071420 con 0x7f4b980b3ad0 2024-09-12T12:20:56.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.707+0000 7f4b8fe00640 1 -- 172.21.15.144:0/2208424837 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b8001a070 con 0x7f4b980b3ad0 2024-09-12T12:20:56.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.707+0000 7f4b8fe00640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b740678f0 0x7f4b74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:56.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.707+0000 7f4b8fe00640 1 -- 172.21.15.144:0/2208424837 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f4b80085e20 con 0x7f4b980b3ad0 2024-09-12T12:20:56.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.707+0000 7f4b97400640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b740678f0 0x7f4b74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:56.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.707+0000 7f4b97400640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b740678f0 0x7f4b74069db0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4b880ae000 tx=0x7f4b880a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:56.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.711+0000 7f4b8fe00640 1 -- 172.21.15.144:0/2208424837 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b800567c0 con 0x7f4b980b3ad0 2024-09-12T12:20:56.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.899+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b980b4d90 con 0x7f4b980b3ad0 2024-09-12T12:20:56.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.899+0000 7f4b8fe00640 1 -- 172.21.15.144:0/2208424837 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5237 (secure 0 0 0) 0x7f4b800560c0 con 0x7f4b980b3ad0 2024-09-12T12:20:56.901 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:56.901 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":98,"btime":"2024-09-12T12:20:27:230311+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6911,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3824078479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3824078479},{"type":"v1","addr":"172.21.15.144:6837","nonce":3824078479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2364982071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2364982071},{"type":"v1","addr":"172.21.15.165:6835","nonce":2364982071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1068048719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1068048719},{"type":"v1","addr":"172.21.15.144:6835","nonce":1068048719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:20:23.392012+0000","modified":"2024-09-12T12:20:26.388950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6834/3565473111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3565473111},{"type":"v1","addr":"172.21.15.165:6834","nonce":3565473111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8010,"qdb_cluster":[8010]},"id":8}]} 2024-09-12T12:20:56.902 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 98 2024-09-12T12:20:56.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b740678f0 msgr2=0x7f4b74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b740678f0 0x7f4b74069db0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4b880ae000 tx=0x7f4b880a7000 comp rx=0 tx=0).stop 2024-09-12T12:20:56.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b980b3ad0 msgr2=0x7f4b98157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:56.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b980b3ad0 0x7f4b98157680 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000e900 tx=0x7f4b8000edc0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 shutdown_connections 2024-09-12T12:20:56.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4b740678f0 0x7f4b74069db0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9815b4e0 0x7f4b98071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b980b3ad0 0x7f4b98157680 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 --2- 172.21.15.144:0/2208424837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b98071960 0x7f4b98146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:56.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 >> 172.21.15.144:0/2208424837 conn(0x7f4b9806d0d0 msgr2=0x7f4b980ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:56.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 shutdown_connections 2024-09-12T12:20:56.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:56.903+0000 7f4b9e400640 1 -- 172.21.15.144:0/2208424837 wait complete. 2024-09-12T12:20:56.921 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-12T12:20:56.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:20:57.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.055+0000 7fadc7200640 1 Processor -- start 2024-09-12T12:20:57.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.055+0000 7fadc7200640 1 -- start start 2024-09-12T12:20:57.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.055+0000 7fadc7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fadc015b2c0 0x7fadc00b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadc7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc006e180 0x7fadc006e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadc7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc006ead0 con 0x7fadc00b3500 2024-09-12T12:20:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadc7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fadc00ccec0 con 0x7fadc015b2c0 2024-09-12T12:20:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadc7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fadc00cd1a0 con 0x7fadc006e180 2024-09-12T12:20:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadbf400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fadc00b3500 0x7fadc015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57926/0 (socket says 172.21.15.144:57926) 2024-09-12T12:20:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadbf400640 1 -- 172.21.15.144:0/2743757502 learned_addr learned my addr 172.21.15.144:0/2743757502 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadc5200640 1 --2- 172.21.15.144:0/2743757502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc006e180 0x7fadc006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadbfe00640 1 --2- 172.21.15.144:0/2743757502 >> v2:172.21.15.165:3300/0 conn(0x7fadc015b2c0 0x7fadc00b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadbea00640 1 -- 172.21.15.144:0/2743757502 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1538582964 0 0) 0x7fadac001120 con 0x7fadc00b3500 2024-09-12T12:20:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadbea00640 1 -- 172.21.15.144:0/2743757502 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada4003530 con 0x7fadc00b3500 2024-09-12T12:20:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadc5200640 1 -- 172.21.15.144:0/2743757502 >> v2:172.21.15.165:3300/0 conn(0x7fadc015b2c0 msgr2=0x7fadc00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadc5200640 1 --2- 172.21.15.144:0/2743757502 >> v2:172.21.15.165:3300/0 conn(0x7fadc015b2c0 0x7fadc00b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadc5200640 1 -- 172.21.15.144:0/2743757502 >> v1:172.21.15.144:6789/0 conn(0x7fadc00b3500 legacy=0x7fadc015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadc5200640 1 -- 172.21.15.144:0/2743757502 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc00cd480 con 0x7fadc006e180 2024-09-12T12:20:57.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.059+0000 7fadbfe00640 1 --2- 172.21.15.144:0/2743757502 >> v2:172.21.15.165:3300/0 conn(0x7fadc015b2c0 0x7fadc00b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:20:57.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc5200640 1 --2- 172.21.15.144:0/2743757502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc006e180 0x7fadc006e590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009d90 tx=0x7fadb801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c03977fef91affb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:57.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadbea00640 1 -- 172.21.15.144:0/2743757502 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb80b2070 con 0x7fadc006e180 2024-09-12T12:20:57.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadbea00640 1 -- 172.21.15.144:0/2743757502 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb80a5a00 con 0x7fadc006e180 2024-09-12T12:20:57.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadbea00640 1 -- 172.21.15.144:0/2743757502 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb80a5db0 con 0x7fadc006e180 2024-09-12T12:20:57.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 -- 172.21.15.144:0/2743757502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc006e180 msgr2=0x7fadc006e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 --2- 172.21.15.144:0/2743757502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc006e180 0x7fadc006e590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009d90 tx=0x7fadb801c940 comp rx=0 tx=0).stop 2024-09-12T12:20:57.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 -- 172.21.15.144:0/2743757502 shutdown_connections 2024-09-12T12:20:57.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 --2- 172.21.15.144:0/2743757502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc006e180 0x7fadc006e590 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 --2- 172.21.15.144:0/2743757502 >> v2:172.21.15.165:3300/0 conn(0x7fadc015b2c0 0x7fadc00b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 -- 172.21.15.144:0/2743757502 >> 172.21.15.144:0/2743757502 conn(0x7fadc0067e00 msgr2=0x7fadc00d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:57.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 -- 172.21.15.144:0/2743757502 shutdown_connections 2024-09-12T12:20:57.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 -- 172.21.15.144:0/2743757502 wait complete. 2024-09-12T12:20:57.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 Processor -- start 2024-09-12T12:20:57.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.063+0000 7fadc7200640 1 -- start start 2024-09-12T12:20:57.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadc7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc006e180 0x7fadc015c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadc7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc00b3500 0x7fadc0165570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadc7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc015b2c0 0x7fadc0151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadc7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fadc00ce8f0 con 0x7fadc006e180 2024-09-12T12:20:57.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadc7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fadc00ce770 con 0x7fadc00b3500 2024-09-12T12:20:57.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadc7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fadc00cea70 con 0x7fadc015b2c0 2024-09-12T12:20:57.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadbfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc006e180 0x7fadc015c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadbfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc006e180 0x7fadc015c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41282/0 (socket says 172.21.15.144:41282) 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadbfe00640 1 -- 172.21.15.144:0/3747949554 learned_addr learned my addr 172.21.15.144:0/3747949554 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadbfe00640 1 -- 172.21.15.144:0/3747949554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc015b2c0 msgr2=0x7fadc0151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadbfe00640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc015b2c0 0x7fadc0151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadbfe00640 1 -- 172.21.15.144:0/3747949554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc00b3500 msgr2=0x7fadc0165570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadbfe00640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc00b3500 0x7fadc0165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadbfe00640 1 -- 172.21.15.144:0/3747949554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc0165ab0 con 0x7fadc006e180 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadbfe00640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc006e180 0x7fadc015c350 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fadb000e9b0 tx=0x7fadb000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadb7e00640 1 -- 172.21.15.144:0/3747949554 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0017070 con 0x7fadc006e180 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadb7e00640 1 -- 172.21.15.144:0/3747949554 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb000ca00 con 0x7fadc006e180 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadb7e00640 1 -- 172.21.15.144:0/3747949554 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb000cdd0 con 0x7fadc006e180 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc0156f90 con 0x7fadc006e180 2024-09-12T12:20:57.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc0157550 con 0x7fadc006e180 2024-09-12T12:20:57.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc006e590 con 0x7fadc006e180 2024-09-12T12:20:57.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.067+0000 7fadb7e00640 1 -- 172.21.15.144:0/3747949554 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fadb001a070 con 0x7fadc006e180 2024-09-12T12:20:57.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.071+0000 7fadb7e00640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada00678c0 0x7fada0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.071+0000 7fadb7e00640 1 -- 172.21.15.144:0/3747949554 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fadb0086020 con 0x7fadc006e180 2024-09-12T12:20:57.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.071+0000 7fadbf400640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada00678c0 0x7fada0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.071+0000 7fadbf400640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada00678c0 0x7fada0069d80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fadac000f70 tx=0x7fadac001120 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.075+0000 7fadb7e00640 1 -- 172.21.15.144:0/3747949554 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fadb0056a40 con 0x7fadc006e180 2024-09-12T12:20:57.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.287+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fadc0158b00 con 0x7fadc006e180 2024-09-12T12:20:57.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.287+0000 7fadb7e00640 1 -- 172.21.15.144:0/3747949554 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1069 (secure 0 0 0) 0x7fadb0056340 con 0x7fadc006e180 2024-09-12T12:20:57.290 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:57.290 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":516,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":129,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076442083,"bytes_used":2550460416,"bytes_avail":770543652864,"bytes_total":773094113280,"write_bytes_sec":51743259,"read_op_per_sec":0,"write_op_per_sec":51},"fsmap":{"epoch":98,"btime":"2024-09-12T12:20:27:230311+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8010}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-12T12:20:11.471690+0000","services":{}},"progress_events":{}} 2024-09-12T12:20:57.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada00678c0 msgr2=0x7fada0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada00678c0 0x7fada0069d80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fadac000f70 tx=0x7fadac001120 comp rx=0 tx=0).stop 2024-09-12T12:20:57.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc006e180 msgr2=0x7fadc015c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc006e180 0x7fadc015c350 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fadb000e9b0 tx=0x7fadb000ee70 comp rx=0 tx=0).stop 2024-09-12T12:20:57.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 shutdown_connections 2024-09-12T12:20:57.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fada00678c0 0x7fada0069d80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadc015b2c0 0x7fadc0151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadc00b3500 0x7fadc0165570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 --2- 172.21.15.144:0/3747949554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc006e180 0x7fadc015c350 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 >> 172.21.15.144:0/3747949554 conn(0x7fadc0067e00 msgr2=0x7fadc00b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:57.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 shutdown_connections 2024-09-12T12:20:57.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.291+0000 7fadc7200640 1 -- 172.21.15.144:0/3747949554 wait complete. 2024-09-12T12:20:57.311 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:20:57.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:20:57.401 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:20:57.484 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:20:57.484 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:20:57.484 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:20:57.485 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:57.493 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:20:57.493 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:57.542 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:20:57.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3891000640 1 Processor -- start 2024-09-12T12:20:57.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3891000640 1 -- start start 2024-09-12T12:20:57.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3891000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c071420 0x7f388c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3891000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f388c0ccf30 0x7f388c0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3891000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f388c0b45a0 con 0x7f388c15b4e0 2024-09-12T12:20:57.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3891000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f388c0b3fe0 con 0x7f388c0ccf30 2024-09-12T12:20:57.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3891000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f388c0b42c0 con 0x7f388c071420 2024-09-12T12:20:57.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3889e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f388c15b4e0 0x7f388c0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57930/0 (socket says 172.21.15.144:57930) 2024-09-12T12:20:57.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3889e00640 1 -- 172.21.15.144:0/2788223099 learned_addr learned my addr 172.21.15.144:0/2788223099 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:57.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3889400640 1 --2- 172.21.15.144:0/2788223099 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c071420 0x7f388c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f388a800640 1 --2- 172.21.15.144:0/2788223099 >> v2:172.21.15.165:3300/0 conn(0x7f388c0ccf30 0x7f388c0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3888a00640 1 -- 172.21.15.144:0/2788223099 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1082713370 0 0) 0x7f388c0b45a0 con 0x7f388c15b4e0 2024-09-12T12:20:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3888a00640 1 -- 172.21.15.144:0/2788223099 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3870003530 con 0x7f388c15b4e0 2024-09-12T12:20:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3889400640 1 -- 172.21.15.144:0/2788223099 >> v2:172.21.15.165:3300/0 conn(0x7f388c0ccf30 msgr2=0x7f388c0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3889400640 1 --2- 172.21.15.144:0/2788223099 >> v2:172.21.15.165:3300/0 conn(0x7f388c0ccf30 0x7f388c0cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3889400640 1 -- 172.21.15.144:0/2788223099 >> v1:172.21.15.144:6789/0 conn(0x7f388c15b4e0 legacy=0x7f388c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.723+0000 7f3889400640 1 -- 172.21.15.144:0/2788223099 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c0b1490 con 0x7f388c071420 2024-09-12T12:20:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3889400640 1 --2- 172.21.15.144:0/2788223099 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c071420 0x7f388c071840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38780097c0 tx=0x7f387801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61f4fa38ad16df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3888a00640 1 -- 172.21.15.144:0/2788223099 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38780b0070 con 0x7f388c071420 2024-09-12T12:20:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3888a00640 1 -- 172.21.15.144:0/2788223099 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38780ab600 con 0x7f388c071420 2024-09-12T12:20:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3888a00640 1 -- 172.21.15.144:0/2788223099 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38780ab9b0 con 0x7f388c071420 2024-09-12T12:20:57.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3891000640 1 -- 172.21.15.144:0/2788223099 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c071420 msgr2=0x7f388c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3891000640 1 --2- 172.21.15.144:0/2788223099 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c071420 0x7f388c071840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38780097c0 tx=0x7f387801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3891000640 1 -- 172.21.15.144:0/2788223099 shutdown_connections 2024-09-12T12:20:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3891000640 1 --2- 172.21.15.144:0/2788223099 >> v2:172.21.15.165:3300/0 conn(0x7f388c0ccf30 0x7f388c0cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3891000640 1 --2- 172.21.15.144:0/2788223099 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c071420 0x7f388c071840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3891000640 1 -- 172.21.15.144:0/2788223099 >> 172.21.15.144:0/2788223099 conn(0x7f388c06d0d0 msgr2=0x7f388c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3891000640 1 -- 172.21.15.144:0/2788223099 shutdown_connections 2024-09-12T12:20:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.727+0000 7f3891000640 1 -- 172.21.15.144:0/2788223099 wait complete. 2024-09-12T12:20:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 Processor -- start 2024-09-12T12:20:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 -- start start 2024-09-12T12:20:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f388c071420 0x7f388c142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f388c0ccf30 0x7f388c156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c15b4e0 0x7f388c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f388c15b8c0 con 0x7f388c0ccf30 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f388c168260 con 0x7f388c071420 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f388c142670 con 0x7f388c15b4e0 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f388c0ccf30 0x7f388c156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f388c0ccf30 0x7f388c156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41290/0 (socket says 172.21.15.144:41290) 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889400640 1 -- 172.21.15.144:0/1203274573 learned_addr learned my addr 172.21.15.144:0/1203274573 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889e00640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f388c071420 0x7f388c142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f388a800640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c15b4e0 0x7f388c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889400640 1 -- 172.21.15.144:0/1203274573 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c15b4e0 msgr2=0x7f388c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889400640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c15b4e0 0x7f388c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889400640 1 -- 172.21.15.144:0/1203274573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f388c071420 msgr2=0x7f388c142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889400640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f388c071420 0x7f388c142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889400640 1 -- 172.21.15.144:0/1203274573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c1653d0 con 0x7f388c0ccf30 2024-09-12T12:20:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3889400640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f388c0ccf30 0x7f388c156f70 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f3878000c10 tx=0x7f3878019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3882000640 1 -- 172.21.15.144:0/1203274573 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38780b0040 con 0x7f388c0ccf30 2024-09-12T12:20:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3882000640 1 -- 172.21.15.144:0/1203274573 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38780ab400 con 0x7f388c0ccf30 2024-09-12T12:20:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3882000640 1 -- 172.21.15.144:0/1203274573 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38780ab9b0 con 0x7f388c0ccf30 2024-09-12T12:20:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c1656b0 con 0x7f388c0ccf30 2024-09-12T12:20:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c165c70 con 0x7f388c0ccf30 2024-09-12T12:20:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.731+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388c071840 con 0x7f388c0ccf30 2024-09-12T12:20:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.735+0000 7f3882000640 1 -- 172.21.15.144:0/1203274573 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38780bd020 con 0x7f388c0ccf30 2024-09-12T12:20:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.735+0000 7f3882000640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f386c0678c0 0x7f386c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:57.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.735+0000 7f3882000640 1 -- 172.21.15.144:0/1203274573 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f387811f7f0 con 0x7f388c0ccf30 2024-09-12T12:20:57.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.735+0000 7f3889e00640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f386c0678c0 0x7f386c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:57.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.735+0000 7f3889e00640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f386c0678c0 0x7f386c069d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f387c005890 tx=0x7f387c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:57.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.739+0000 7f3882000640 1 -- 172.21.15.144:0/1203274573 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3878016090 con 0x7f388c0ccf30 2024-09-12T12:20:57.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.907+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f388c073770 con 0x7f388c0ccf30 2024-09-12T12:20:57.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.907+0000 7f3882000640 1 -- 172.21.15.144:0/1203274573 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) ==== 80+0+0 (secure 0 0 0) 0x7f38780b3360 con 0x7f388c0ccf30 2024-09-12T12:20:57.909 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:20:57.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f386c0678c0 msgr2=0x7f386c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f386c0678c0 0x7f386c069d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f387c005890 tx=0x7f387c009040 comp rx=0 tx=0).stop 2024-09-12T12:20:57.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f388c0ccf30 msgr2=0x7f388c156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f388c0ccf30 0x7f388c156f70 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f3878000c10 tx=0x7f3878019240 comp rx=0 tx=0).stop 2024-09-12T12:20:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 shutdown_connections 2024-09-12T12:20:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f386c0678c0 0x7f386c069d80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f388c15b4e0 0x7f388c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f388c0ccf30 0x7f388c156f70 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 --2- 172.21.15.144:0/1203274573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f388c071420 0x7f388c142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 >> 172.21.15.144:0/1203274573 conn(0x7f388c06d0d0 msgr2=0x7f388c0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 shutdown_connections 2024-09-12T12:20:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:57.911+0000 7f3891000640 1 -- 172.21.15.144:0/1203274573 wait complete. 2024-09-12T12:20:57.930 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:20:57.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:57.930 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:20:58.697 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:20:58.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:20:58.697 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:20:58.708 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:20:58.708 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:20:58.709 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:58.717 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:20:58.718 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:20:58.718 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:20:58.718 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:58.758 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:20:58.758 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:20:58.758 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:20:58.758 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:20:58.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:20:58.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:58.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.935+0000 7fbdada00640 1 Processor -- start 2024-09-12T12:20:58.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.935+0000 7fbdada00640 1 -- start start 2024-09-12T12:20:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbdada00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbda80cd640 0x7fbda8071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbdada00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda80b45a0 con 0x7fbda8071420 2024-09-12T12:20:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbdada00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda80b3fe0 con 0x7fbda815b4e0 2024-09-12T12:20:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbdada00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbda80b42c0 con 0x7fbda80cd640 2024-09-12T12:20:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbda8071420 0x7fbda80ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57938/0 (socket says 172.21.15.144:57938) 2024-09-12T12:20:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6000640 1 -- 172.21.15.144:0/2862437759 learned_addr learned my addr 172.21.15.144:0/2862437759 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:58.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda7400640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbda80cd640 0x7fbda8071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:58.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762104807 0 0) 0x7fbda80b45a0 con 0x7fbda8071420 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd8c005740 con 0x7fbda8071420 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4002503718 0 0) 0x7fbd8c005740 con 0x7fbda8071420 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbda80cd640 msgr2=0x7fbda8071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbda80cd640 0x7fbda8071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 >> v1:172.21.15.165:6789/0 conn(0x7fbda815b4e0 legacy=0x7fbda80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda80b1490 con 0x7fbda8071420 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fbd94001680 con 0x7fbda8071420 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 >> v1:172.21.15.144:6789/0 conn(0x7fbda8071420 legacy=0x7fbda80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd8c005c00 0x7fbd8c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd8c0065b0 0x7fbd8c006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbda80cd640 0x7fbd8c0072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbda80b42c0 con 0x7fbd8c005c00 2024-09-12T12:20:58.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c00dc10 con 0x7fbd8c0065b0 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c00de10 con 0x7fbda80cd640 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6a00640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd8c005c00 0x7fbd8c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda7400640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbda80cd640 0x7fbd8c0072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6000640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd8c0065b0 0x7fbd8c006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6a00640 1 -- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbda80cd640 msgr2=0x7fbd8c0072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6a00640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbda80cd640 0x7fbd8c0072e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6a00640 1 -- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd8c0065b0 msgr2=0x7fbd8c006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6a00640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd8c0065b0 0x7fbd8c006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6a00640 1 -- 172.21.15.144:0/2862437759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c005740 con 0x7fbd8c005c00 2024-09-12T12:20:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.939+0000 7fbda6000640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbd8c0065b0 0x7fbd8c006a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:20:58.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbda6a00640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd8c005c00 0x7fbd8c005fe0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fbd98001910 tx=0x7fbd9801c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebc9857c47a2727 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:58.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd980b2070 con 0x7fbd8c005c00 2024-09-12T12:20:58.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd980ad6a0 con 0x7fbd8c005c00 2024-09-12T12:20:58.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbda5600640 1 -- 172.21.15.144:0/2862437759 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98001510 con 0x7fbd8c005c00 2024-09-12T12:20:58.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbdada00640 1 -- 172.21.15.144:0/2862437759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd8c005c00 msgr2=0x7fbd8c005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:58.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbdada00640 1 --2- 172.21.15.144:0/2862437759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd8c005c00 0x7fbd8c005fe0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fbd98001910 tx=0x7fbd9801c550 comp rx=0 tx=0).stop 2024-09-12T12:20:58.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbda7400640 1 -- 172.21.15.144:0/2862437759 reap_dead start 2024-09-12T12:20:58.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbdada00640 1 -- 172.21.15.144:0/2862437759 shutdown_connections 2024-09-12T12:20:58.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbdada00640 1 -- 172.21.15.144:0/2862437759 >> 172.21.15.144:0/2862437759 conn(0x7fbda806d0d0 msgr2=0x7fbda806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:58.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbdada00640 1 -- 172.21.15.144:0/2862437759 shutdown_connections 2024-09-12T12:20:58.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbdada00640 1 -- 172.21.15.144:0/2862437759 wait complete. 2024-09-12T12:20:58.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbdada00640 1 Processor -- start 2024-09-12T12:20:58.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.943+0000 7fbdada00640 1 -- start start 2024-09-12T12:20:58.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbdada00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd8c005c00 0x7fbda8150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:58.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbdada00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda8153730 0x7fbda8153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:58.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbdada00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbda81583e0 0x7fbda8158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:58.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbdada00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbda815b8c0 con 0x7fbda8153730 2024-09-12T12:20:58.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbdada00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbda80b02e0 con 0x7fbda81583e0 2024-09-12T12:20:58.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbdada00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbda815a890 con 0x7fbd8c005c00 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda8153730 0x7fbda8153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda8153730 0x7fbda8153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41322/0 (socket says 172.21.15.144:41322) 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6000640 1 -- 172.21.15.144:0/1805529794 learned_addr learned my addr 172.21.15.144:0/1805529794 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6a00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd8c005c00 0x7fbda8150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda7400640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbda81583e0 0x7fbda8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6000640 1 -- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd8c005c00 msgr2=0x7fbda8150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6000640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd8c005c00 0x7fbda8150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6000640 1 -- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbda81583e0 msgr2=0x7fbda8158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6000640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbda81583e0 0x7fbda8158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6000640 1 -- 172.21.15.144:0/1805529794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda8158dd0 con 0x7fbda8153730 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6a00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd8c005c00 0x7fbda8150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda7400640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbda81583e0 0x7fbda8158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:20:58.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbda6000640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda8153730 0x7fbda8153b90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400e7b0 tx=0x7fbd9400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbd9ea00640 1 -- 172.21.15.144:0/1805529794 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400c6c0 con 0x7fbda8153730 2024-09-12T12:20:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbd9ea00640 1 -- 172.21.15.144:0/1805529794 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd94018070 con 0x7fbda8153730 2024-09-12T12:20:58.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbd9ea00640 1 -- 172.21.15.144:0/1805529794 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400ca60 con 0x7fbda8153730 2024-09-12T12:20:58.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda81540d0 con 0x7fbda8153730 2024-09-12T12:20:58.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda8154660 con 0x7fbda8153730 2024-09-12T12:20:58.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda80ccf30 con 0x7fbda8153730 2024-09-12T12:20:58.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.947+0000 7fbd9ea00640 1 -- 172.21.15.144:0/1805529794 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd9400cc00 con 0x7fbda8153730 2024-09-12T12:20:58.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.951+0000 7fbd9ea00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd880678c0 0x7fbd88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:58.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.951+0000 7fbd9ea00640 1 -- 172.21.15.144:0/1805529794 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7fbd94085d30 con 0x7fbda8153730 2024-09-12T12:20:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.951+0000 7fbda6a00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd880678c0 0x7fbd88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:58.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.951+0000 7fbda6a00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd880678c0 0x7fbd88069d80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbd980af000 tx=0x7fbd98005040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:58.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:58.955+0000 7fbd9ea00640 1 -- 172.21.15.144:0/1805529794 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbd94055f60 con 0x7fbda8153730 2024-09-12T12:20:59.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbda8073bb0 con 0x7fbda8153730 2024-09-12T12:20:59.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbd9ea00640 1 -- 172.21.15.144:0/1805529794 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5237 (secure 0 0 0) 0x7fbd9405a260 con 0x7fbda8153730 2024-09-12T12:20:59.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:59.148 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":98,"btime":"2024-09-12T12:20:27:230311+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6911,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3824078479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3824078479},{"type":"v1","addr":"172.21.15.144:6837","nonce":3824078479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2364982071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2364982071},{"type":"v1","addr":"172.21.15.165:6835","nonce":2364982071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1068048719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1068048719},{"type":"v1","addr":"172.21.15.144:6835","nonce":1068048719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:20:23.392012+0000","modified":"2024-09-12T12:20:26.388950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6834/3565473111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3565473111},{"type":"v1","addr":"172.21.15.165:6834","nonce":3565473111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8010,"qdb_cluster":[8010]},"id":8}]} 2024-09-12T12:20:59.148 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 98 2024-09-12T12:20:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd880678c0 msgr2=0x7fbd88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd880678c0 0x7fbd88069d80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbd980af000 tx=0x7fbd98005040 comp rx=0 tx=0).stop 2024-09-12T12:20:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda8153730 msgr2=0x7fbda8153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda8153730 0x7fbda8153b90 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400e7b0 tx=0x7fbd9400ec70 comp rx=0 tx=0).stop 2024-09-12T12:20:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 shutdown_connections 2024-09-12T12:20:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbd880678c0 0x7fbd88069d80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbda81583e0 0x7fbda8158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda8153730 0x7fbda8153b90 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 --2- 172.21.15.144:0/1805529794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbd8c005c00 0x7fbda8150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 >> 172.21.15.144:0/1805529794 conn(0x7fbda806d0d0 msgr2=0x7fbda8072940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 shutdown_connections 2024-09-12T12:20:59.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.147+0000 7fbdada00640 1 -- 172.21.15.144:0/1805529794 wait complete. 2024-09-12T12:20:59.170 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:20:59.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97afe00640 1 Processor -- start 2024-09-12T12:20:59.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97afe00640 1 -- start start 2024-09-12T12:20:59.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97afe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f97b0152240 0x7f97b015c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97afe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 0x7f97b00b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97afe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97b0152620 con 0x7f97b00b6690 2024-09-12T12:20:59.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97afe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f97b00b0010 con 0x7f97b0152240 2024-09-12T12:20:59.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97afe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f97b00b02f0 con 0x7f97b00afb10 2024-09-12T12:20:59.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97aea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f97b0152240 0x7f97b015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97af400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f97b00b6690 0x7f97b00cc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:41468/0 (socket says 172.21.15.144:41468) 2024-09-12T12:20:59.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97ae000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 0x7f97b00b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97af400640 1 -- 172.21.15.144:0/3096495299 learned_addr learned my addr 172.21.15.144:0/3096495299 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:20:59.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97aea00640 1 -- 172.21.15.144:0/3096495299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 msgr2=0x7f97b00b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:59.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97aea00640 1 --2- 172.21.15.144:0/3096495299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 0x7f97b00b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97aea00640 1 -- 172.21.15.144:0/3096495299 >> v1:172.21.15.165:6789/0 conn(0x7f97b00b6690 legacy=0x7f97b00cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97aea00640 1 -- 172.21.15.144:0/3096495299 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b015b840 con 0x7f97b0152240 2024-09-12T12:20:59.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.307+0000 7f97ad600640 1 -- 172.21.15.144:0/3096495299 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722552708 0 0) 0x7f97b0152620 con 0x7f97b00b6690 2024-09-12T12:20:59.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97aea00640 1 --2- 172.21.15.144:0/3096495299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0152240 0x7f97b015c320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f97a00097c0 tx=0x7f97a001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6ede635fd94e607 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:59.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97ad600640 1 -- 172.21.15.144:0/3096495299 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a00b2070 con 0x7f97b0152240 2024-09-12T12:20:59.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97ad600640 1 -- 172.21.15.144:0/3096495299 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a00ad680 con 0x7f97b0152240 2024-09-12T12:20:59.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97ad600640 1 -- 172.21.15.144:0/3096495299 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a00ada50 con 0x7f97b0152240 2024-09-12T12:20:59.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97afe00640 1 -- 172.21.15.144:0/3096495299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0152240 msgr2=0x7f97b015c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97afe00640 1 --2- 172.21.15.144:0/3096495299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0152240 0x7f97b015c320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f97a00097c0 tx=0x7f97a001c470 comp rx=0 tx=0).stop 2024-09-12T12:20:59.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97afe00640 1 -- 172.21.15.144:0/3096495299 shutdown_connections 2024-09-12T12:20:59.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97afe00640 1 --2- 172.21.15.144:0/3096495299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 0x7f97b00b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97afe00640 1 --2- 172.21.15.144:0/3096495299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0152240 0x7f97b015c320 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97afe00640 1 -- 172.21.15.144:0/3096495299 >> 172.21.15.144:0/3096495299 conn(0x7f97b00b0580 msgr2=0x7f97b00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:59.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97afe00640 1 -- 172.21.15.144:0/3096495299 shutdown_connections 2024-09-12T12:20:59.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.311+0000 7f97afe00640 1 -- 172.21.15.144:0/3096495299 wait complete. 2024-09-12T12:20:59.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 Processor -- start 2024-09-12T12:20:59.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 -- start start 2024-09-12T12:20:59.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 0x7f97b014cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b00b6690 0x7f97b0149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0152240 0x7f97b014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f97b0168240 con 0x7f97b00b6690 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f97b01680c0 con 0x7f97b0152240 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f97b01683c0 con 0x7f97b00afb10 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97ae000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b00b6690 0x7f97b0149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97af400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0152240 0x7f97b014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97aea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 0x7f97b014cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97ae000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b00b6690 0x7f97b0149d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41338/0 (socket says 172.21.15.144:41338) 2024-09-12T12:20:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97ae000640 1 -- 172.21.15.144:0/3885838988 learned_addr learned my addr 172.21.15.144:0/3885838988 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:59.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97aea00640 1 -- 172.21.15.144:0/3885838988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0152240 msgr2=0x7f97b014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97aea00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0152240 0x7f97b014fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97aea00640 1 -- 172.21.15.144:0/3885838988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b00b6690 msgr2=0x7f97b0149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97aea00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b00b6690 0x7f97b0149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97aea00640 1 -- 172.21.15.144:0/3885838988 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b014a580 con 0x7f97b00afb10 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97aea00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 0x7f97b014cc20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f97a00ac000 tx=0x7f97a0019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97a6a00640 1 -- 172.21.15.144:0/3885838988 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a00b2040 con 0x7f97b00afb10 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97a6a00640 1 -- 172.21.15.144:0/3885838988 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a00ad970 con 0x7f97b00afb10 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b014a860 con 0x7f97b00afb10 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97a6a00640 1 -- 172.21.15.144:0/3885838988 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a00add40 con 0x7f97b00afb10 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b014ae20 con 0x7f97b00afb10 2024-09-12T12:20:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.315+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b00b3910 con 0x7f97b00afb10 2024-09-12T12:20:59.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.319+0000 7f97a6a00640 1 -- 172.21.15.144:0/3885838988 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f97a00b6410 con 0x7f97b00afb10 2024-09-12T12:20:59.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.319+0000 7f97a6a00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97900678c0 0x7f9790069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.319+0000 7f97a6a00640 1 -- 172.21.15.144:0/3885838988 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f97a011f1a0 con 0x7f97b00afb10 2024-09-12T12:20:59.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.319+0000 7f97ae000640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97900678c0 0x7f9790069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.319+0000 7f97ae000640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97900678c0 0x7f9790069d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f97b00cbf60 tx=0x7f979c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:59.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.323+0000 7f97a6a00640 1 -- 172.21.15.144:0/3885838988 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f97a0016090 con 0x7f97b00afb10 2024-09-12T12:20:59.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.515+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97b00b4ee0 con 0x7f97b00afb10 2024-09-12T12:20:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.515+0000 7f97a6a00640 1 -- 172.21.15.144:0/3885838988 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5237 (secure 0 0 0) 0x7f97a00ad650 con 0x7f97b00afb10 2024-09-12T12:20:59.517 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:59.517 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":98,"btime":"2024-09-12T12:20:27:230311+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6911,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3824078479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3824078479},{"type":"v1","addr":"172.21.15.144:6837","nonce":3824078479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2364982071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2364982071},{"type":"v1","addr":"172.21.15.165:6835","nonce":2364982071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1068048719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1068048719},{"type":"v1","addr":"172.21.15.144:6835","nonce":1068048719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:20:23.392012+0000","modified":"2024-09-12T12:20:26.388950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6834/3565473111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3565473111},{"type":"v1","addr":"172.21.15.165:6834","nonce":3565473111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8010,"qdb_cluster":[8010]},"id":8}]} 2024-09-12T12:20:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 98 2024-09-12T12:20:59.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97900678c0 msgr2=0x7f9790069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97900678c0 0x7f9790069d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f97b00cbf60 tx=0x7f979c009190 comp rx=0 tx=0).stop 2024-09-12T12:20:59.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 msgr2=0x7f97b014cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 0x7f97b014cc20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f97a00ac000 tx=0x7f97a0019210 comp rx=0 tx=0).stop 2024-09-12T12:20:59.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 shutdown_connections 2024-09-12T12:20:59.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f97900678c0 0x7f9790069d80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0152240 0x7f97b014fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b00b6690 0x7f97b0149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 --2- 172.21.15.144:0/3885838988 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97b00afb10 0x7f97b014cc20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 >> 172.21.15.144:0/3885838988 conn(0x7f97b00b0580 msgr2=0x7f97b00ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:59.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 shutdown_connections 2024-09-12T12:20:59.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.519+0000 7f97afe00640 1 -- 172.21.15.144:0/3885838988 wait complete. 2024-09-12T12:20:59.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:20:59.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.671+0000 7f40a2a00640 1 Processor -- start 2024-09-12T12:20:59.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.671+0000 7f40a2a00640 1 -- start start 2024-09-12T12:20:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f409c1605e0 0x7f409c1643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f409c1609c0 0x7f409c163230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f409c0cdd40 0x7f409c0b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a2a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f409c0b1af0 con 0x7f409c0cdd40 2024-09-12T12:20:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f409c0b17c0 con 0x7f409c1609c0 2024-09-12T12:20:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f409c163af0 con 0x7f409c1605e0 2024-09-12T12:20:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f409c0cdd40 0x7f409c0b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f409c0cdd40 0x7f409c0b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41348/0 (socket says 172.21.15.144:41348) 2024-09-12T12:20:59.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a0a00640 1 -- 172.21.15.144:0/364257133 learned_addr learned my addr 172.21.15.144:0/364257133 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:59.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f409b400640 1 --2- 172.21.15.144:0/364257133 >> v2:172.21.15.165:3300/0 conn(0x7f409c1609c0 0x7f409c163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f409be00640 1 --2- 172.21.15.144:0/364257133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f409c1605e0 0x7f409c1643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a0a00640 1 -- 172.21.15.144:0/364257133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f409c1605e0 msgr2=0x7f409c1643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:59.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a0a00640 1 --2- 172.21.15.144:0/364257133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f409c1605e0 0x7f409c1643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a0a00640 1 -- 172.21.15.144:0/364257133 >> v2:172.21.15.165:3300/0 conn(0x7f409c1609c0 msgr2=0x7f409c163230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:20:59.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a0a00640 1 --2- 172.21.15.144:0/364257133 >> v2:172.21.15.165:3300/0 conn(0x7f409c1609c0 0x7f409c163230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f40a0a00640 1 -- 172.21.15.144:0/364257133 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c163dd0 con 0x7f409c0cdd40 2024-09-12T12:20:59.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.675+0000 7f409b400640 1 --2- 172.21.15.144:0/364257133 >> v2:172.21.15.165:3300/0 conn(0x7f409c1609c0 0x7f409c163230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:20:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a0a00640 1 --2- 172.21.15.144:0/364257133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 0x7f409c0b5b40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f409c06a020 tx=0x7f409401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84919f28d68c0ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f409aa00640 1 -- 172.21.15.144:0/364257133 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40940ab640 con 0x7f409c0cdd40 2024-09-12T12:20:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f409aa00640 1 -- 172.21.15.144:0/364257133 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40940b0070 con 0x7f409c0cdd40 2024-09-12T12:20:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f409aa00640 1 -- 172.21.15.144:0/364257133 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40940aba00 con 0x7f409c0cdd40 2024-09-12T12:20:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 -- 172.21.15.144:0/364257133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 msgr2=0x7f409c0b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 --2- 172.21.15.144:0/364257133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 0x7f409c0b5b40 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f409c06a020 tx=0x7f409401c460 comp rx=0 tx=0).stop 2024-09-12T12:20:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 -- 172.21.15.144:0/364257133 shutdown_connections 2024-09-12T12:20:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 --2- 172.21.15.144:0/364257133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 0x7f409c0b5b40 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 --2- 172.21.15.144:0/364257133 >> v2:172.21.15.165:3300/0 conn(0x7f409c1609c0 0x7f409c163230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 --2- 172.21.15.144:0/364257133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f409c1605e0 0x7f409c1643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 -- 172.21.15.144:0/364257133 >> 172.21.15.144:0/364257133 conn(0x7f409c06d0d0 msgr2=0x7f409c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:59.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 -- 172.21.15.144:0/364257133 shutdown_connections 2024-09-12T12:20:59.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 -- 172.21.15.144:0/364257133 wait complete. 2024-09-12T12:20:59.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 Processor -- start 2024-09-12T12:20:59.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.679+0000 7f40a2a00640 1 -- start start 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f40a2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 0x7f409c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f40a2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f409c1605e0 0x7f409c162230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f40a2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409c1609c0 0x7f409c1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f40a2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f409c0b28f0 con 0x7f409c0cdd40 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f40a2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f409c0b2770 con 0x7f409c1609c0 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f40a2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f409c0b2a70 con 0x7f409c1605e0 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f409be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 0x7f409c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f409be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 0x7f409c150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41350/0 (socket says 172.21.15.144:41350) 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f409be00640 1 -- 172.21.15.144:0/1736610196 learned_addr learned my addr 172.21.15.144:0/1736610196 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:20:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f409be00640 1 -- 172.21.15.144:0/1736610196 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f409c1605e0 msgr2=0x7f409c162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f409be00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f409c1605e0 0x7f409c162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f409be00640 1 -- 172.21.15.144:0/1736610196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409c1609c0 msgr2=0x7f409c1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f409be00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409c1609c0 0x7f409c1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f409be00640 1 -- 172.21.15.144:0/1736610196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c0b5330 con 0x7f409c0cdd40 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f409be00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 0x7f409c150d80 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f408c009d30 tx=0x7f408c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f4093e00640 1 -- 172.21.15.144:0/1736610196 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c018020 con 0x7f409c0cdd40 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f4093e00640 1 -- 172.21.15.144:0/1736610196 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408c014480 con 0x7f409c0cdd40 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f4093e00640 1 -- 172.21.15.144:0/1736610196 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c014870 con 0x7f409c0cdd40 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409c15b0f0 con 0x7f409c0cdd40 2024-09-12T12:20:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409c153460 con 0x7f409c0cdd40 2024-09-12T12:20:59.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409c0b5b40 con 0x7f409c0cdd40 2024-09-12T12:20:59.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.683+0000 7f4093e00640 1 -- 172.21.15.144:0/1736610196 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f408c01b020 con 0x7f409c0cdd40 2024-09-12T12:20:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.687+0000 7f4093e00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f407c0678f0 0x7f407c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:20:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.687+0000 7f4093e00640 1 -- 172.21.15.144:0/1736610196 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f408c086940 con 0x7f409c0cdd40 2024-09-12T12:20:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.687+0000 7f409b400640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f407c0678f0 0x7f407c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:20:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.687+0000 7f409b400640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f407c0678f0 0x7f407c069db0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f409c1512c0 tx=0x7f4088009480 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:20:59.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.691+0000 7f4093e00640 1 -- 172.21.15.144:0/1736610196 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f408c022070 con 0x7f409c0cdd40 2024-09-12T12:20:59.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.851+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f409c073940 con 0x7f409c0cdd40 2024-09-12T12:20:59.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.851+0000 7f4093e00640 1 -- 172.21.15.144:0/1736610196 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+17036 (secure 0 0 0) 0x7f408c010040 con 0x7f409c0cdd40 2024-09-12T12:20:59.857 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:20:59.857 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":129,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:20:24.980221+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:20:21.527729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-12T12:20:22.383110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f407c0678f0 msgr2=0x7f407c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f407c0678f0 0x7f407c069db0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f409c1512c0 tx=0x7f4088009480 comp rx=0 tx=0).stop 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 msgr2=0x7f409c150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 0x7f409c150d80 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f408c009d30 tx=0x7f408c00c490 comp rx=0 tx=0).stop 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 shutdown_connections 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f407c0678f0 0x7f407c069db0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409c1609c0 0x7f409c1588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f409c1605e0 0x7f409c162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 --2- 172.21.15.144:0/1736610196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409c0cdd40 0x7f409c150d80 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 >> 172.21.15.144:0/1736610196 conn(0x7f409c06d0d0 msgr2=0x7f409c165220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 shutdown_connections 2024-09-12T12:20:59.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:20:59.855+0000 7f40a2a00640 1 -- 172.21.15.144:0/1736610196 wait complete. 2024-09-12T12:20:59.875 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:20:59.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:00.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b22a00640 1 Processor -- start 2024-09-12T12:21:00.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b22a00640 1 -- start start 2024-09-12T12:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b22a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b1c0b4200 0x7f1b1c0b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b22a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1b1c0b5720 0x7f1b1c0b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b22a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1c0d1580 con 0x7f1b1c15c220 2024-09-12T12:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b22a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1c0b4bb0 con 0x7f1b1c0b4200 2024-09-12T12:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b22a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1c0d1320 con 0x7f1b1c0b5720 2024-09-12T12:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b1be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1b1c15c220 0x7f1b1c0d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57950/0 (socket says 172.21.15.144:57950) 2024-09-12T12:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b1be00640 1 -- 172.21.15.144:0/393049319 learned_addr learned my addr 172.21.15.144:0/393049319 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b1b400640 1 --2- 172.21.15.144:0/393049319 >> v2:172.21.15.144:3300/0 conn(0x7f1b1c0b4200 0x7f1b1c0b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b20a00640 1 --2- 172.21.15.144:0/393049319 >> v2:172.21.15.165:3300/0 conn(0x7f1b1c0b5720 0x7f1b1c0b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b1b400640 1 -- 172.21.15.144:0/393049319 >> v2:172.21.15.165:3300/0 conn(0x7f1b1c0b5720 msgr2=0x7f1b1c0b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b1b400640 1 --2- 172.21.15.144:0/393049319 >> v2:172.21.15.165:3300/0 conn(0x7f1b1c0b5720 0x7f1b1c0b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b1b400640 1 -- 172.21.15.144:0/393049319 >> v1:172.21.15.144:6789/0 conn(0x7f1b1c15c220 legacy=0x7f1b1c0d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b1aa00640 1 -- 172.21.15.144:0/393049319 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110039788 0 0) 0x7f1b1c0d1580 con 0x7f1b1c15c220 2024-09-12T12:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.011+0000 7f1b1b400640 1 -- 172.21.15.144:0/393049319 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c0d1860 con 0x7f1b1c0b4200 2024-09-12T12:21:00.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b1b400640 1 --2- 172.21.15.144:0/393049319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 0x7f1b1c0b4670 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0cf990 tx=0x7f1b0801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98315ffd4266df6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:00.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b1aa00640 1 -- 172.21.15.144:0/393049319 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080ab430 con 0x7f1b1c0b4200 2024-09-12T12:21:00.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b1aa00640 1 -- 172.21.15.144:0/393049319 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b080b0070 con 0x7f1b1c0b4200 2024-09-12T12:21:00.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b1aa00640 1 -- 172.21.15.144:0/393049319 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b080ab7f0 con 0x7f1b1c0b4200 2024-09-12T12:21:00.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b22a00640 1 -- 172.21.15.144:0/393049319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 msgr2=0x7f1b1c0b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b22a00640 1 --2- 172.21.15.144:0/393049319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 0x7f1b1c0b4670 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0cf990 tx=0x7f1b0801c430 comp rx=0 tx=0).stop 2024-09-12T12:21:00.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b22a00640 1 -- 172.21.15.144:0/393049319 shutdown_connections 2024-09-12T12:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b22a00640 1 --2- 172.21.15.144:0/393049319 >> v2:172.21.15.165:3300/0 conn(0x7f1b1c0b5720 0x7f1b1c0b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b22a00640 1 --2- 172.21.15.144:0/393049319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 0x7f1b1c0b4670 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b22a00640 1 -- 172.21.15.144:0/393049319 >> 172.21.15.144:0/393049319 conn(0x7f1b1c06f400 msgr2=0x7f1b1c06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b22a00640 1 -- 172.21.15.144:0/393049319 shutdown_connections 2024-09-12T12:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.015+0000 7f1b22a00640 1 -- 172.21.15.144:0/393049319 wait complete. 2024-09-12T12:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 Processor -- start 2024-09-12T12:21:00.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 -- start start 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 0x7f1b1c158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1c0b5720 0x7f1b1c1661b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1c15c220 0x7f1b1c1666f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c15c780 con 0x7f1b1c0b4200 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c15c600 con 0x7f1b1c0b5720 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1c070bf0 con 0x7f1b1c15c220 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 0x7f1b1c158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 0x7f1b1c158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41372/0 (socket says 172.21.15.144:41372) 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1be00640 1 -- 172.21.15.144:0/2730806571 learned_addr learned my addr 172.21.15.144:0/2730806571 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1b400640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1c0b5720 0x7f1b1c1661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b20a00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1c15c220 0x7f1b1c1666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1be00640 1 -- 172.21.15.144:0/2730806571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1c15c220 msgr2=0x7f1b1c1666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1be00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1c15c220 0x7f1b1c1666f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1be00640 1 -- 172.21.15.144:0/2730806571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1c0b5720 msgr2=0x7f1b1c1661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1be00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1c0b5720 0x7f1b1c1661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1be00640 1 -- 172.21.15.144:0/2730806571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c1623c0 con 0x7f1b1c0b4200 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b20a00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1c15c220 0x7f1b1c1666f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b1be00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 0x7f1b1c158e10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00c4b0 tx=0x7f1b0c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b13e00640 1 -- 172.21.15.144:0/2730806571 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c018070 con 0x7f1b1c0b4200 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b13e00640 1 -- 172.21.15.144:0/2730806571 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c007500 con 0x7f1b1c0b4200 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b13e00640 1 -- 172.21.15.144:0/2730806571 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c004a30 con 0x7f1b1c0b4200 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1c161e00 con 0x7f1b1c0b4200 2024-09-12T12:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1c15d9f0 con 0x7f1b1c0b4200 2024-09-12T12:21:00.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.019+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b1c0b4670 con 0x7f1b1c0b4200 2024-09-12T12:21:00.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.023+0000 7f1b13e00640 1 -- 172.21.15.144:0/2730806571 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b0c004bd0 con 0x7f1b1c0b4200 2024-09-12T12:21:00.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.023+0000 7f1b13e00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1afc0678c0 0x7f1afc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.023+0000 7f1b13e00640 1 -- 172.21.15.144:0/2730806571 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f1b0c084ff0 con 0x7f1b1c0b4200 2024-09-12T12:21:00.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.023+0000 7f1b1b400640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1afc0678c0 0x7f1afc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.023+0000 7f1b1b400640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1afc0678c0 0x7f1afc069d80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1b080af000 tx=0x7f1b080a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:00.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.027+0000 7f1b13e00640 1 -- 172.21.15.144:0/2730806571 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1b0c0552f0 con 0x7f1b1c0b4200 2024-09-12T12:21:00.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.219+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b1c06e600 con 0x7f1b1c0b4200 2024-09-12T12:21:00.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.219+0000 7f1b13e00640 1 -- 172.21.15.144:0/2730806571 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5237 (secure 0 0 0) 0x7f1b0c0595f0 con 0x7f1b1c0b4200 2024-09-12T12:21:00.220 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":98,"btime":"2024-09-12T12:20:27:230311+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6911,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3824078479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3824078479},{"type":"v1","addr":"172.21.15.144:6837","nonce":3824078479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2364982071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2364982071},{"type":"v1","addr":"172.21.15.165:6835","nonce":2364982071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1068048719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1068048719},{"type":"v1","addr":"172.21.15.144:6835","nonce":1068048719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:20:23.392012+0000","modified":"2024-09-12T12:20:26.388950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6834/3565473111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3565473111},{"type":"v1","addr":"172.21.15.165:6834","nonce":3565473111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8010,"qdb_cluster":[8010]},"id":8}]} 2024-09-12T12:21:00.221 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 98 2024-09-12T12:21:00.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1afc0678c0 msgr2=0x7f1afc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1afc0678c0 0x7f1afc069d80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1b080af000 tx=0x7f1b080a7000 comp rx=0 tx=0).stop 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 msgr2=0x7f1b1c158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 0x7f1b1c158e10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00c4b0 tx=0x7f1b0c00c970 comp rx=0 tx=0).stop 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 shutdown_connections 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1afc0678c0 0x7f1afc069d80 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1c15c220 0x7f1b1c1666f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1c0b5720 0x7f1b1c1661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 --2- 172.21.15.144:0/2730806571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1c0b4200 0x7f1b1c158e10 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 >> 172.21.15.144:0/2730806571 conn(0x7f1b1c06f400 msgr2=0x7f1b1c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 shutdown_connections 2024-09-12T12:21:00.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.223+0000 7f1b22a00640 1 -- 172.21.15.144:0/2730806571 wait complete. 2024-09-12T12:21:00.242 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.375+0000 7f69cb200640 1 Processor -- start 2024-09-12T12:21:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.375+0000 7f69cb200640 1 -- start start 2024-09-12T12:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69cb200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f69c415e580 0x7f69c40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69cb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406ea20 0x7f69c40b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69cb200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c406d9a0 con 0x7f69c406cc70 2024-09-12T12:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69cb200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f69c40b73e0 con 0x7f69c415e580 2024-09-12T12:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69cb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69c406df40 con 0x7f69c406ea20 2024-09-12T12:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f69c415e580 0x7f69c40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f69c415e580 0x7f69c40b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41388/0 (socket says 172.21.15.144:41388) 2024-09-12T12:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c3e00640 1 -- 172.21.15.144:0/3190419705 learned_addr learned my addr 172.21.15.144:0/3190419705 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c9200640 1 --1- 172.21.15.144:0/3190419705 >> v1:172.21.15.144:6789/0 conn(0x7f69c406cc70 0x7f69c406d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57956/0 (socket says 172.21.15.144:57956) 2024-09-12T12:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c3400640 1 --2- 172.21.15.144:0/3190419705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406ea20 0x7f69c40b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c3e00640 1 -- 172.21.15.144:0/3190419705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406ea20 msgr2=0x7f69c40b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c3e00640 1 --2- 172.21.15.144:0/3190419705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406ea20 0x7f69c40b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c3e00640 1 -- 172.21.15.144:0/3190419705 >> v1:172.21.15.144:6789/0 conn(0x7f69c406cc70 legacy=0x7f69c406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c3e00640 1 -- 172.21.15.144:0/3190419705 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c406e220 con 0x7f69c415e580 2024-09-12T12:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c2a00640 1 -- 172.21.15.144:0/3190419705 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359280824 0 0) 0x7f69c406d9a0 con 0x7f69c406cc70 2024-09-12T12:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.379+0000 7f69c3400640 1 --2- 172.21.15.144:0/3190419705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406ea20 0x7f69c40b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69c3e00640 1 --2- 172.21.15.144:0/3190419705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c415e580 0x7f69c40b6960 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009870 tx=0x7f69b401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24d08fe55e14717 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69c2a00640 1 -- 172.21.15.144:0/3190419705 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b40b0070 con 0x7f69c415e580 2024-09-12T12:21:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69c2a00640 1 -- 172.21.15.144:0/3190419705 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b40ab600 con 0x7f69c415e580 2024-09-12T12:21:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69c2a00640 1 -- 172.21.15.144:0/3190419705 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b40ab9d0 con 0x7f69c415e580 2024-09-12T12:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 -- 172.21.15.144:0/3190419705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c415e580 msgr2=0x7f69c40b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 --2- 172.21.15.144:0/3190419705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c415e580 0x7f69c40b6960 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009870 tx=0x7f69b401c560 comp rx=0 tx=0).stop 2024-09-12T12:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 -- 172.21.15.144:0/3190419705 shutdown_connections 2024-09-12T12:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 --2- 172.21.15.144:0/3190419705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406ea20 0x7f69c40b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 --2- 172.21.15.144:0/3190419705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c415e580 0x7f69c40b6960 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 -- 172.21.15.144:0/3190419705 >> 172.21.15.144:0/3190419705 conn(0x7f69c4067a00 msgr2=0x7f69c4067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 -- 172.21.15.144:0/3190419705 shutdown_connections 2024-09-12T12:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 -- 172.21.15.144:0/3190419705 wait complete. 2024-09-12T12:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 Processor -- start 2024-09-12T12:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 -- start start 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406cc70 0x7f69c4155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c406ea20 0x7f69c41492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.383+0000 7f69cb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69c415e580 0x7f69c4153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69cb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f69c40cc3f0 con 0x7f69c406ea20 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69cb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f69c40cc270 con 0x7f69c415e580 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69cb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69c40cc570 con 0x7f69c406cc70 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c406ea20 0x7f69c41492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c406ea20 0x7f69c41492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41390/0 (socket says 172.21.15.144:41390) 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3400640 1 -- 172.21.15.144:0/1813916315 learned_addr learned my addr 172.21.15.144:0/1813916315 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3e00640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406cc70 0x7f69c4155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c9200640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69c415e580 0x7f69c4153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3400640 1 -- 172.21.15.144:0/1813916315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406cc70 msgr2=0x7f69c4155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3400640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406cc70 0x7f69c4155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3400640 1 -- 172.21.15.144:0/1813916315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69c415e580 msgr2=0x7f69c4153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3400640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69c415e580 0x7f69c4153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3400640 1 -- 172.21.15.144:0/1813916315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c415efc0 con 0x7f69c406ea20 2024-09-12T12:21:00.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69c3400640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c406ea20 0x7f69c41492c0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f69b000c7f0 tx=0x7f69b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:00.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69bbe00640 1 -- 172.21.15.144:0/1813916315 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0007a30 con 0x7f69c406ea20 2024-09-12T12:21:00.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69bbe00640 1 -- 172.21.15.144:0/1813916315 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b0007bd0 con 0x7f69c406ea20 2024-09-12T12:21:00.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c415f2a0 con 0x7f69c406ea20 2024-09-12T12:21:00.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69bbe00640 1 -- 172.21.15.144:0/1813916315 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b00113f0 con 0x7f69c406ea20 2024-09-12T12:21:00.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c415f860 con 0x7f69c406ea20 2024-09-12T12:21:00.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c406d0e0 con 0x7f69c406ea20 2024-09-12T12:21:00.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.387+0000 7f69bbe00640 1 -- 172.21.15.144:0/1813916315 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69b0011590 con 0x7f69c406ea20 2024-09-12T12:21:00.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.391+0000 7f69bbe00640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69a40678c0 0x7f69a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.391+0000 7f69bbe00640 1 -- 172.21.15.144:0/1813916315 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f69b0085f80 con 0x7f69c406ea20 2024-09-12T12:21:00.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.391+0000 7f69c3e00640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69a40678c0 0x7f69a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.391+0000 7f69c3e00640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69a40678c0 0x7f69a4069d80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f69b40ad000 tx=0x7f69b40a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.395+0000 7f69bbe00640 1 -- 172.21.15.144:0/1813916315 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f69b0015020 con 0x7f69c406ea20 2024-09-12T12:21:00.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.587+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69c415fa30 con 0x7f69c406ea20 2024-09-12T12:21:00.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69bbe00640 1 -- 172.21.15.144:0/1813916315 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5237 (secure 0 0 0) 0x7f69b00562d0 con 0x7f69c406ea20 2024-09-12T12:21:00.590 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:00.590 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":98,"btime":"2024-09-12T12:20:27:230311+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6911,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3824078479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3824078479},{"type":"v1","addr":"172.21.15.144:6837","nonce":3824078479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2364982071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2364982071},{"type":"v1","addr":"172.21.15.165:6835","nonce":2364982071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1068048719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1068048719},{"type":"v1","addr":"172.21.15.144:6835","nonce":1068048719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:20:23.392012+0000","modified":"2024-09-12T12:20:26.388950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8010},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8010":{"gid":8010,"name":"d","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6834/3565473111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3565473111},{"type":"v1","addr":"172.21.15.165:6834","nonce":3565473111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8010,"qdb_cluster":[8010]},"id":8}]} 2024-09-12T12:21:00.591 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 98 2024-09-12T12:21:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69a40678c0 msgr2=0x7f69a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69a40678c0 0x7f69a4069d80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f69b40ad000 tx=0x7f69b40a6000 comp rx=0 tx=0).stop 2024-09-12T12:21:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c406ea20 msgr2=0x7f69c41492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c406ea20 0x7f69c41492c0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f69b000c7f0 tx=0x7f69b000ccb0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 shutdown_connections 2024-09-12T12:21:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69a40678c0 0x7f69a4069d80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69c415e580 0x7f69c4153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69c406ea20 0x7f69c41492c0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 --2- 172.21.15.144:0/1813916315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69c406cc70 0x7f69c4155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 >> 172.21.15.144:0/1813916315 conn(0x7f69c4067a00 msgr2=0x7f69c415c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 shutdown_connections 2024-09-12T12:21:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.591+0000 7f69cb200640 1 -- 172.21.15.144:0/1813916315 wait complete. 2024-09-12T12:21:00.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:21:00.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3032800640 1 Processor -- start 2024-09-12T12:21:00.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3032800640 1 -- start start 2024-09-12T12:21:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3032800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f302c15c0a0 0x7f302c0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3032800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 0x7f302c15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3032800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f302c15c480 con 0x7f302c0b6b20 2024-09-12T12:21:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3032800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f302c1609e0 con 0x7f302c15c0a0 2024-09-12T12:21:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3032800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f302c15fdd0 con 0x7f302c0ce950 2024-09-12T12:21:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3031400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f302c15c0a0 0x7f302c0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3031400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f302c15c0a0 0x7f302c0b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41396/0 (socket says 172.21.15.144:41396) 2024-09-12T12:21:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3031400640 1 -- 172.21.15.144:0/1169555008 learned_addr learned my addr 172.21.15.144:0/1169555008 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3030a00640 1 --2- 172.21.15.144:0/1169555008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 0x7f302c15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3031400640 1 -- 172.21.15.144:0/1169555008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 msgr2=0x7f302c15d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3031400640 1 --2- 172.21.15.144:0/1169555008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 0x7f302c15d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3031400640 1 -- 172.21.15.144:0/1169555008 >> v1:172.21.15.165:6789/0 conn(0x7f302c0b6b20 legacy=0x7f302c0b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.747+0000 7f3031400640 1 -- 172.21.15.144:0/1169555008 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c1600b0 con 0x7f302c15c0a0 2024-09-12T12:21:00.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f3031400640 1 --2- 172.21.15.144:0/1169555008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c15c0a0 0x7f302c0b5310 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3020009e50 tx=0x7f302001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5f8c04cc45bb50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:00.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f302be00640 1 -- 172.21.15.144:0/1169555008 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30200a5750 con 0x7f302c15c0a0 2024-09-12T12:21:00.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f302be00640 1 -- 172.21.15.144:0/1169555008 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30200a58f0 con 0x7f302c15c0a0 2024-09-12T12:21:00.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f302be00640 1 -- 172.21.15.144:0/1169555008 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30200a5cc0 con 0x7f302c15c0a0 2024-09-12T12:21:00.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f3032800640 1 -- 172.21.15.144:0/1169555008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c15c0a0 msgr2=0x7f302c0b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f3032800640 1 --2- 172.21.15.144:0/1169555008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c15c0a0 0x7f302c0b5310 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3020009e50 tx=0x7f302001c9a0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f3032800640 1 -- 172.21.15.144:0/1169555008 shutdown_connections 2024-09-12T12:21:00.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f3032800640 1 --2- 172.21.15.144:0/1169555008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 0x7f302c15d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f3032800640 1 --2- 172.21.15.144:0/1169555008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c15c0a0 0x7f302c0b5310 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f3032800640 1 -- 172.21.15.144:0/1169555008 >> 172.21.15.144:0/1169555008 conn(0x7f302c0d2280 msgr2=0x7f302c0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:00.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f3032800640 1 -- 172.21.15.144:0/1169555008 shutdown_connections 2024-09-12T12:21:00.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.751+0000 7f3032800640 1 -- 172.21.15.144:0/1169555008 wait complete. 2024-09-12T12:21:00.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 Processor -- start 2024-09-12T12:21:00.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 -- start start 2024-09-12T12:21:00.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b6b20 0x7f302c142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 0x7f302c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f302c15c0a0 0x7f302c0cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f302c073c50 con 0x7f302c0b6b20 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f302c073ad0 con 0x7f302c15c0a0 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f302c073dd0 con 0x7f302c0ce950 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b6b20 0x7f302c142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b6b20 0x7f302c142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41410/0 (socket says 172.21.15.144:41410) 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031400640 1 -- 172.21.15.144:0/2289604453 learned_addr learned my addr 172.21.15.144:0/2289604453 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3030a00640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 0x7f302c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031e00640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f302c15c0a0 0x7f302c0cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031400640 1 -- 172.21.15.144:0/2289604453 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 msgr2=0x7f302c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031400640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 0x7f302c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031400640 1 -- 172.21.15.144:0/2289604453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f302c15c0a0 msgr2=0x7f302c0cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031400640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f302c15c0a0 0x7f302c0cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031400640 1 -- 172.21.15.144:0/2289604453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c157310 con 0x7f302c0b6b20 2024-09-12T12:21:00.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3031400640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b6b20 0x7f302c142da0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f30200af040 tx=0x7f3020019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:00.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3029600640 1 -- 172.21.15.144:0/2289604453 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30200bc020 con 0x7f302c0b6b20 2024-09-12T12:21:00.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3029600640 1 -- 172.21.15.144:0/2289604453 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30200b8670 con 0x7f302c0b6b20 2024-09-12T12:21:00.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3029600640 1 -- 172.21.15.144:0/2289604453 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30200b8a60 con 0x7f302c0b6b20 2024-09-12T12:21:00.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302c1575f0 con 0x7f302c0b6b20 2024-09-12T12:21:00.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.755+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302c1524b0 con 0x7f302c0b6b20 2024-09-12T12:21:00.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.759+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302c0b1c60 con 0x7f302c0b6b20 2024-09-12T12:21:00.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.759+0000 7f3029600640 1 -- 172.21.15.144:0/2289604453 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30200bf020 con 0x7f302c0b6b20 2024-09-12T12:21:00.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.759+0000 7f3029600640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f300c0678c0 0x7f300c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:00.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.759+0000 7f3029600640 1 -- 172.21.15.144:0/2289604453 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f3020120e70 con 0x7f302c0b6b20 2024-09-12T12:21:00.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.759+0000 7f3030a00640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f300c0678c0 0x7f300c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:00.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.759+0000 7f3030a00640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f300c0678c0 0x7f300c069d80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f302c0d0fc0 tx=0x7f3018008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:00.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.763+0000 7f3029600640 1 -- 172.21.15.144:0/2289604453 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f30200c6030 con 0x7f302c0b6b20 2024-09-12T12:21:00.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.923+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f302c0b5b30 con 0x7f302c0b6b20 2024-09-12T12:21:00.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.923+0000 7f3029600640 1 -- 172.21.15.144:0/2289604453 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+17036 (secure 0 0 0) 0x7f3020016620 con 0x7f302c0b6b20 2024-09-12T12:21:00.925 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:00.925 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":129,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:20:24.980221+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:20:21.527729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-12T12:20:22.383110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:21:00.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.923+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f300c0678c0 msgr2=0x7f300c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.923+0000 7f3032800640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f300c0678c0 0x7f300c069d80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f302c0d0fc0 tx=0x7f3018008040 comp rx=0 tx=0).stop 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.923+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b6b20 msgr2=0x7f302c142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.923+0000 7f3032800640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b6b20 0x7f302c142da0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f30200af040 tx=0x7f3020019740 comp rx=0 tx=0).stop 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.923+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 shutdown_connections 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.927+0000 7f3032800640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f300c0678c0 0x7f300c069d80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.927+0000 7f3032800640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f302c15c0a0 0x7f302c0cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.927+0000 7f3032800640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302c0ce950 0x7f302c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.927+0000 7f3032800640 1 --2- 172.21.15.144:0/2289604453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f302c0b6b20 0x7f302c142da0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.927+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 >> 172.21.15.144:0/2289604453 conn(0x7f302c0d2280 msgr2=0x7f302c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.927+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 shutdown_connections 2024-09-12T12:21:00.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:00.927+0000 7f3032800640 1 -- 172.21.15.144:0/2289604453 wait complete. 2024-09-12T12:21:00.946 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:21:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e1b200640 1 Processor -- start 2024-09-12T12:21:01.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e1b200640 1 -- start start 2024-09-12T12:21:01.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e1b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e1c0ce950 0x7f3e1c0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e1b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c15c480 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e1b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c15fdd0 con 0x7f3e1c0b7230 2024-09-12T12:21:01.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e1b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1c1609e0 con 0x7f3e1c0ce950 2024-09-12T12:21:01.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e19400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e1c0ce950 0x7f3e1c0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:01.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e19400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e1c0ce950 0x7f3e1c0b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41426/0 (socket says 172.21.15.144:41426) 2024-09-12T12:21:01.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e19400640 1 -- 172.21.15.144:0/445120005 learned_addr learned my addr 172.21.15.144:0/445120005 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:01.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e19e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3e1c15c0a0 0x7f3e1c0b6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57964/0 (socket says 172.21.15.144:57964) 2024-09-12T12:21:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e19400640 1 -- 172.21.15.144:0/445120005 >> v1:172.21.15.165:6789/0 conn(0x7f3e1c0b7230 legacy=0x7f3e1c0730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e19400640 1 -- 172.21.15.144:0/445120005 >> v1:172.21.15.144:6789/0 conn(0x7f3e1c15c0a0 legacy=0x7f3e1c0b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e19400640 1 -- 172.21.15.144:0/445120005 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c1600b0 con 0x7f3e1c0ce950 2024-09-12T12:21:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.083+0000 7f3e18a00640 1 -- 172.21.15.144:0/445120005 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004452789 0 0) 0x7f3e1c15c480 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e19400640 1 --2- 172.21.15.144:0/445120005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c0ce950 0x7f3e1c0b5310 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009870 tx=0x7f3e0801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67bc72e56b7cb70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e18a00640 1 -- 172.21.15.144:0/445120005 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080ab680 con 0x7f3e1c0ce950 2024-09-12T12:21:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e18a00640 1 -- 172.21.15.144:0/445120005 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e080b0070 con 0x7f3e1c0ce950 2024-09-12T12:21:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e18a00640 1 -- 172.21.15.144:0/445120005 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080aba40 con 0x7f3e1c0ce950 2024-09-12T12:21:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e1b200640 1 -- 172.21.15.144:0/445120005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c0ce950 msgr2=0x7f3e1c0b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e1b200640 1 --2- 172.21.15.144:0/445120005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c0ce950 0x7f3e1c0b5310 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009870 tx=0x7f3e0801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e1b200640 1 -- 172.21.15.144:0/445120005 shutdown_connections 2024-09-12T12:21:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e1b200640 1 --2- 172.21.15.144:0/445120005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c0ce950 0x7f3e1c0b5310 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e1b200640 1 -- 172.21.15.144:0/445120005 >> 172.21.15.144:0/445120005 conn(0x7f3e1c0d2280 msgr2=0x7f3e1c0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:01.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e1b200640 1 -- 172.21.15.144:0/445120005 shutdown_connections 2024-09-12T12:21:01.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.087+0000 7f3e1b200640 1 -- 172.21.15.144:0/445120005 wait complete. 2024-09-12T12:21:01.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 Processor -- start 2024-09-12T12:21:01.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 -- start start 2024-09-12T12:21:01.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e1c0b7230 0x7f3e1c146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e1c0ce950 0x7f3e1c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c15c0a0 0x7f3e1c0d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c16a160 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c169fe0 con 0x7f3e1c0b7230 2024-09-12T12:21:01.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c16a2e0 con 0x7f3e1c0ce950 2024-09-12T12:21:01.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c15c0a0 0x7f3e1c0d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c15c0a0 0x7f3e1c0d0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41432/0 (socket says 172.21.15.144:41432) 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1a800640 1 -- 172.21.15.144:0/2705502704 learned_addr learned my addr 172.21.15.144:0/2705502704 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e19e00640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e1c0b7230 0x7f3e1c146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e19400640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e1c0ce950 0x7f3e1c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1a800640 1 -- 172.21.15.144:0/2705502704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e1c0ce950 msgr2=0x7f3e1c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1a800640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e1c0ce950 0x7f3e1c0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1a800640 1 -- 172.21.15.144:0/2705502704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e1c0b7230 msgr2=0x7f3e1c146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1a800640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e1c0b7230 0x7f3e1c146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1a800640 1 -- 172.21.15.144:0/2705502704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c06d9a0 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1a800640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c15c0a0 0x7f3e1c0d0c80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c730 tx=0x7f3e1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e12000640 1 -- 172.21.15.144:0/2705502704 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14003b80 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e12000640 1 -- 172.21.15.144:0/2705502704 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e14003d20 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e12000640 1 -- 172.21.15.144:0/2705502704 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14005310 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c06dc80 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c06e240 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.091+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c0b5310 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.095+0000 7f3e12000640 1 -- 172.21.15.144:0/2705502704 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e140054b0 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.095+0000 7f3e12000640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dfc0678c0 0x7f3dfc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.095+0000 7f3e12000640 1 -- 172.21.15.144:0/2705502704 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 6101+0+0 (secure 0 0 0) 0x7f3e14085c60 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.095+0000 7f3e19e00640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dfc0678c0 0x7f3dfc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:01.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.095+0000 7f3e19e00640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dfc0678c0 0x7f3dfc069d80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c007a90 tx=0x7f3e0c0079e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:01.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.099+0000 7f3e12000640 1 -- 172.21.15.144:0/2705502704 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3e14055ea0 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.291+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3e1c167db0 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.291 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:21:01.291+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:21:01.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.291+0000 7f3e12000640 1 -- 172.21.15.144:0/2705502704 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v99) ==== 161+0+0 (secure 0 0 0) 0x7f3e1405a1a0 con 0x7f3e1c15c0a0 2024-09-12T12:21:01.293 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:21:01.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dfc0678c0 msgr2=0x7f3dfc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dfc0678c0 0x7f3dfc069d80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c007a90 tx=0x7f3e0c0079e0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c15c0a0 msgr2=0x7f3e1c0d0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c15c0a0 0x7f3e1c0d0c80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c730 tx=0x7f3e1400cbf0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 shutdown_connections 2024-09-12T12:21:01.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dfc0678c0 0x7f3dfc069d80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e1c15c0a0 0x7f3e1c0d0c80 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e1c0ce950 0x7f3e1c0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 --2- 172.21.15.144:0/2705502704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e1c0b7230 0x7f3e1c146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 >> 172.21.15.144:0/2705502704 conn(0x7f3e1c0d2280 msgr2=0x7f3e1c15f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:01.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 shutdown_connections 2024-09-12T12:21:01.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.295+0000 7f3e1b200640 1 -- 172.21.15.144:0/2705502704 wait complete. 2024-09-12T12:21:01.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:21:01.362 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:21:01.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb155a00640 1 Processor -- start 2024-09-12T12:21:01.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb155a00640 1 -- start start 2024-09-12T12:21:01.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb155a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb15015af60 0x7fb1500ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb155a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1500cd9f0 0x7fb15006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb155a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1500b4300 con 0x7fb15015b340 2024-09-12T12:21:01.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb155a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb1500b32f0 con 0x7fb15015af60 2024-09-12T12:21:01.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb155a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1500b3540 con 0x7fb1500cd9f0 2024-09-12T12:21:01.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb14ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb15015af60 0x7fb1500ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:01.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb14f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb15015b340 0x7fb15015ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57970/0 (socket says 172.21.15.144:57970) 2024-09-12T12:21:01.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb14f400640 1 -- 172.21.15.144:0/1402935204 learned_addr learned my addr 172.21.15.144:0/1402935204 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:01.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb147e00640 1 --2- 172.21.15.144:0/1402935204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1500cd9f0 0x7fb15006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:01.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb14ea00640 1 -- 172.21.15.144:0/1402935204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1500cd9f0 msgr2=0x7fb15006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:01.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb14ea00640 1 --2- 172.21.15.144:0/1402935204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1500cd9f0 0x7fb15006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb14ea00640 1 -- 172.21.15.144:0/1402935204 >> v1:172.21.15.144:6789/0 conn(0x7fb15015b340 legacy=0x7fb15015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb14ea00640 1 -- 172.21.15.144:0/1402935204 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1500b3820 con 0x7fb15015af60 2024-09-12T12:21:01.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.455+0000 7fb14e000640 1 -- 172.21.15.144:0/1402935204 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204855650 0 0) 0x7fb1500b4300 con 0x7fb15015b340 2024-09-12T12:21:01.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb14ea00640 1 --2- 172.21.15.144:0/1402935204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb15015af60 0x7fb1500ce680 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fb1400097c0 tx=0x7fb14001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04f06c0874fcae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:01.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb14e000640 1 -- 172.21.15.144:0/1402935204 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1400b5070 con 0x7fb15015af60 2024-09-12T12:21:01.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb14e000640 1 -- 172.21.15.144:0/1402935204 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1400a8990 con 0x7fb15015af60 2024-09-12T12:21:01.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb14e000640 1 -- 172.21.15.144:0/1402935204 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1400a8d60 con 0x7fb15015af60 2024-09-12T12:21:01.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 -- 172.21.15.144:0/1402935204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb15015af60 msgr2=0x7fb1500ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 --2- 172.21.15.144:0/1402935204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb15015af60 0x7fb1500ce680 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fb1400097c0 tx=0x7fb14001ec90 comp rx=0 tx=0).stop 2024-09-12T12:21:01.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 -- 172.21.15.144:0/1402935204 shutdown_connections 2024-09-12T12:21:01.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 --2- 172.21.15.144:0/1402935204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1500cd9f0 0x7fb15006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 --2- 172.21.15.144:0/1402935204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb15015af60 0x7fb1500ce680 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 -- 172.21.15.144:0/1402935204 >> 172.21.15.144:0/1402935204 conn(0x7fb150068030 msgr2=0x7fb1500b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:01.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 -- 172.21.15.144:0/1402935204 shutdown_connections 2024-09-12T12:21:01.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 -- 172.21.15.144:0/1402935204 wait complete. 2024-09-12T12:21:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 Processor -- start 2024-09-12T12:21:01.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.459+0000 7fb155a00640 1 -- start start 2024-09-12T12:21:01.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb155a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1500cd9f0 0x7fb15015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb155a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb15015af60 0x7fb150150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb155a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15015b340 0x7fb15015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb155a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1500b5570 con 0x7fb1500cd9f0 2024-09-12T12:21:01.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb155a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb1500b3de0 con 0x7fb15015af60 2024-09-12T12:21:01.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb155a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1500cebc0 con 0x7fb15015b340 2024-09-12T12:21:01.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb14ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1500cd9f0 0x7fb15015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:01.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb14ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1500cd9f0 0x7fb15015ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41446/0 (socket says 172.21.15.144:41446) 2024-09-12T12:21:01.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb14ea00640 1 -- 172.21.15.144:0/92166675 learned_addr learned my addr 172.21.15.144:0/92166675 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:01.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb14ea00640 1 -- 172.21.15.144:0/92166675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15015b340 msgr2=0x7fb15015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb14ea00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15015b340 0x7fb15015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb14ea00640 1 -- 172.21.15.144:0/92166675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb15015af60 msgr2=0x7fb150150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:01.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb14ea00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb15015af60 0x7fb150150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:01.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb14ea00640 1 -- 172.21.15.144:0/92166675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15015d140 con 0x7fb1500cd9f0 2024-09-12T12:21:01.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb14ea00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1500cd9f0 0x7fb15015ca60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fb1400097c0 tx=0x7fb14001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:01.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb146a00640 1 -- 172.21.15.144:0/92166675 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1400c0070 con 0x7fb1500cd9f0 2024-09-12T12:21:01.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb146a00640 1 -- 172.21.15.144:0/92166675 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb140004230 con 0x7fb1500cd9f0 2024-09-12T12:21:01.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15015d420 con 0x7fb1500cd9f0 2024-09-12T12:21:01.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb146a00640 1 -- 172.21.15.144:0/92166675 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1400b5040 con 0x7fb1500cd9f0 2024-09-12T12:21:01.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15015c6f0 con 0x7fb1500cd9f0 2024-09-12T12:21:01.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.463+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1500ce680 con 0x7fb1500cd9f0 2024-09-12T12:21:01.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.467+0000 7fb146a00640 1 -- 172.21.15.144:0/92166675 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1400c3070 con 0x7fb1500cd9f0 2024-09-12T12:21:01.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.467+0000 7fb146a00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb12c0678c0 0x7fb12c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:01.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.467+0000 7fb146a00640 1 -- 172.21.15.144:0/92166675 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 6187+0+0 (secure 0 0 0) 0x7fb1401227c0 con 0x7fb1500cd9f0 2024-09-12T12:21:01.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.467+0000 7fb147e00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb12c0678c0 0x7fb12c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:01.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.467+0000 7fb147e00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb12c0678c0 0x7fb12c069d80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb15014e9c0 tx=0x7fb1380095c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:01.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.471+0000 7fb146a00640 1 -- 172.21.15.144:0/92166675 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb1400187f0 con 0x7fb1500cd9f0 2024-09-12T12:21:01.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:01.663+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb150076180 con 0x7fb1500cd9f0 2024-09-12T12:21:02.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.295+0000 7fb146a00640 1 -- 172.21.15.144:0/92166675 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v100) ==== 104+0+0 (secure 0 0 0) 0x7fb1400f3190 con 0x7fb1500cd9f0 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb12c0678c0 msgr2=0x7fb12c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb12c0678c0 0x7fb12c069d80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb15014e9c0 tx=0x7fb1380095c0 comp rx=0 tx=0).stop 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1500cd9f0 msgr2=0x7fb15015ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1500cd9f0 0x7fb15015ca60 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fb1400097c0 tx=0x7fb14001ba30 comp rx=0 tx=0).stop 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 shutdown_connections 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb12c0678c0 0x7fb12c069d80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15015b340 0x7fb15015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb15015af60 0x7fb150150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 --2- 172.21.15.144:0/92166675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1500cd9f0 0x7fb15015ca60 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:02.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 >> 172.21.15.144:0/92166675 conn(0x7fb150068030 msgr2=0x7fb150168460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:02.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 shutdown_connections 2024-09-12T12:21:02.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.299+0000 7fb155a00640 1 -- 172.21.15.144:0/92166675 wait complete. 2024-09-12T12:21:02.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:21:02.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.467+0000 7f9e7a000640 1 Processor -- start 2024-09-12T12:21:02.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.467+0000 7f9e7a000640 1 -- start start 2024-09-12T12:21:02.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.467+0000 7f9e7a000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9e74073a70 0x7f9e7406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:02.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.467+0000 7f9e7a000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7406cd20 con 0x7f9e7406cff0 2024-09-12T12:21:02.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.467+0000 7f9e7a000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e74072780 con 0x7f9e74156c10 2024-09-12T12:21:02.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.467+0000 7f9e7a000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9e7406d990 con 0x7f9e74073a70 2024-09-12T12:21:02.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.467+0000 7f9e72a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9e7406cff0 0x7f9e74073360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57986/0 (socket says 172.21.15.144:57986) 2024-09-12T12:21:02.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.467+0000 7f9e72a00640 1 -- 172.21.15.144:0/33195365 learned_addr learned my addr 172.21.15.144:0/33195365 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:02.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.467+0000 7f9e73e00640 1 --2- 172.21.15.144:0/33195365 >> v2:172.21.15.165:3300/0 conn(0x7f9e74073a70 0x7f9e7406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:02.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e72000640 1 -- 172.21.15.144:0/33195365 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437053353 0 0) 0x7f9e7406cd20 con 0x7f9e7406cff0 2024-09-12T12:21:02.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e72000640 1 -- 172.21.15.144:0/33195365 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e58003530 con 0x7f9e7406cff0 2024-09-12T12:21:02.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e72000640 1 -- 172.21.15.144:0/33195365 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4150198042 0 0) 0x7f9e74072780 con 0x7f9e74156c10 2024-09-12T12:21:02.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e72000640 1 -- 172.21.15.144:0/33195365 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e7406cd20 con 0x7f9e74156c10 2024-09-12T12:21:02.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e73e00640 1 -- 172.21.15.144:0/33195365 >> v1:172.21.15.165:6789/0 conn(0x7f9e74156c10 legacy=0x7f9e74072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:02.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e73e00640 1 -- 172.21.15.144:0/33195365 >> v1:172.21.15.144:6789/0 conn(0x7f9e7406cff0 legacy=0x7f9e74073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:02.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e73e00640 1 -- 172.21.15.144:0/33195365 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e740712b0 con 0x7f9e74073a70 2024-09-12T12:21:02.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e73e00640 1 --2- 172.21.15.144:0/33195365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e74073a70 0x7f9e7406d450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097c0 tx=0x7f9e6c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3afcfd4682f9d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:02.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e72000640 1 -- 172.21.15.144:0/33195365 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0b1070 con 0x7f9e74073a70 2024-09-12T12:21:02.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e72000640 1 -- 172.21.15.144:0/33195365 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0ac410 con 0x7f9e74073a70 2024-09-12T12:21:02.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e72000640 1 -- 172.21.15.144:0/33195365 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0ac7c0 con 0x7f9e74073a70 2024-09-12T12:21:02.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e7a000640 1 -- 172.21.15.144:0/33195365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e74073a70 msgr2=0x7f9e7406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:02.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.471+0000 7f9e7a000640 1 --2- 172.21.15.144:0/33195365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e74073a70 0x7f9e7406d450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097c0 tx=0x7f9e6c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:21:02.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 -- 172.21.15.144:0/33195365 shutdown_connections 2024-09-12T12:21:02.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 --2- 172.21.15.144:0/33195365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e74073a70 0x7f9e7406d450 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:02.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 -- 172.21.15.144:0/33195365 >> 172.21.15.144:0/33195365 conn(0x7f9e7406bc10 msgr2=0x7f9e7406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:02.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 -- 172.21.15.144:0/33195365 shutdown_connections 2024-09-12T12:21:02.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 -- 172.21.15.144:0/33195365 wait complete. 2024-09-12T12:21:02.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 Processor -- start 2024-09-12T12:21:02.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 -- start start 2024-09-12T12:21:02.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7406cff0 0x7f9e74152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:02.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e74073a70 0x7f9e7415fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:02.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e74156c10 0x7f9e741555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:02.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9e74157170 con 0x7f9e74073a70 2024-09-12T12:21:02.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9e74156ff0 con 0x7f9e7406cff0 2024-09-12T12:21:02.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e7a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7416a670 con 0x7f9e74156c10 2024-09-12T12:21:02.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e72a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e74073a70 0x7f9e7415fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:02.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e72a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e74073a70 0x7f9e7415fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41448/0 (socket says 172.21.15.144:41448) 2024-09-12T12:21:02.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e72a00640 1 -- 172.21.15.144:0/1906390424 learned_addr learned my addr 172.21.15.144:0/1906390424 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:02.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e73e00640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e74156c10 0x7f9e741555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:02.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e73400640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7406cff0 0x7f9e74152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:02.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e72a00640 1 -- 172.21.15.144:0/1906390424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e74156c10 msgr2=0x7f9e741555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:02.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e72a00640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e74156c10 0x7f9e741555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:02.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e72a00640 1 -- 172.21.15.144:0/1906390424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7406cff0 msgr2=0x7f9e74152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:02.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e72a00640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7406cff0 0x7f9e74152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:02.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e72a00640 1 -- 172.21.15.144:0/1906390424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7415ec20 con 0x7f9e74073a70 2024-09-12T12:21:02.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e72a00640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e74073a70 0x7f9e7415fcc0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000c450 tx=0x7f9e6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:02.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.475+0000 7f9e6b400640 1 -- 172.21.15.144:0/1906390424 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60017070 con 0x7f9e74073a70 2024-09-12T12:21:02.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e6b400640 1 -- 172.21.15.144:0/1906390424 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e60005cf0 con 0x7f9e74073a70 2024-09-12T12:21:02.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7415ef00 con 0x7f9e74073a70 2024-09-12T12:21:02.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e6b400640 1 -- 172.21.15.144:0/1906390424 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60007270 con 0x7f9e74073a70 2024-09-12T12:21:02.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7415f4c0 con 0x7f9e74073a70 2024-09-12T12:21:02.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e7406d450 con 0x7f9e74073a70 2024-09-12T12:21:02.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e6b400640 1 -- 172.21.15.144:0/1906390424 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e6001a070 con 0x7f9e74073a70 2024-09-12T12:21:02.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e6b400640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:02.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e6b400640 1 -- 172.21.15.144:0/1906390424 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 6187+0+0 (secure 0 0 0) 0x7f9e60085150 con 0x7f9e74073a70 2024-09-12T12:21:02.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e73400640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:02.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.479+0000 7f9e73400640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9e64007fd0 tx=0x7f9e64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:02.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.483+0000 7f9e6b400640 1 -- 172.21.15.144:0/1906390424 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e600553c0 con 0x7f9e74073a70 2024-09-12T12:21:02.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:02.643+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9e7406dd80 con 0x7f9e74073a70 2024-09-12T12:21:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.299+0000 7f9e6b400640 1 -- 172.21.15.144:0/1906390424 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v131) ==== 181+0+0 (secure 0 0 0) 0x7f9e600596c0 con 0x7f9e74073a70 2024-09-12T12:21:03.300 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:21:03.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 msgr2=0x7f9e54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:03.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9e64007fd0 tx=0x7f9e64009040 comp rx=0 tx=0).stop 2024-09-12T12:21:03.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e74073a70 msgr2=0x7f9e7415fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:03.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e74073a70 0x7f9e7415fcc0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000c450 tx=0x7f9e6000c910 comp rx=0 tx=0).stop 2024-09-12T12:21:03.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 shutdown_connections 2024-09-12T12:21:03.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e540678c0 0x7f9e54069d80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:03.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e74156c10 0x7f9e741555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:03.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e74073a70 0x7f9e7415fcc0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:03.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 --2- 172.21.15.144:0/1906390424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e7406cff0 0x7f9e74152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:03.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 >> 172.21.15.144:0/1906390424 conn(0x7f9e7406bc10 msgr2=0x7f9e741678b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:03.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 shutdown_connections 2024-09-12T12:21:03.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.303+0000 7f9e7a000640 1 -- 172.21.15.144:0/1906390424 wait complete. 2024-09-12T12:21:03.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:21:03.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.463+0000 7fec0b000640 1 Processor -- start 2024-09-12T12:21:03.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec0b000640 1 -- start start 2024-09-12T12:21:03.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec0b000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fec04156c10 0x7fec04072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:03.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec0b000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec0406cff0 0x7fec0406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:03.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec0b000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0406cd20 con 0x7fec04073360 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec0b000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fec0406d990 con 0x7fec0406cff0 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec0b000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fec04071be0 con 0x7fec04156c10 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec03400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec0406cff0 0x7fec0406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec09000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fec04073360 0x7fec040737c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58002/0 (socket says 172.21.15.144:58002) 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec09000640 1 -- 172.21.15.144:0/81750019 learned_addr learned my addr 172.21.15.144:0/81750019 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec03e00640 1 --2- 172.21.15.144:0/81750019 >> v2:172.21.15.165:3300/0 conn(0x7fec04156c10 0x7fec04072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec03400640 1 -- 172.21.15.144:0/81750019 >> v2:172.21.15.165:3300/0 conn(0x7fec04156c10 msgr2=0x7fec04072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec03400640 1 --2- 172.21.15.144:0/81750019 >> v2:172.21.15.165:3300/0 conn(0x7fec04156c10 0x7fec04072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec03400640 1 -- 172.21.15.144:0/81750019 >> v1:172.21.15.144:6789/0 conn(0x7fec04073360 legacy=0x7fec040737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec03400640 1 -- 172.21.15.144:0/81750019 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec040712b0 con 0x7fec0406cff0 2024-09-12T12:21:03.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.467+0000 7fec02a00640 1 -- 172.21.15.144:0/81750019 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740850 0 0) 0x7fec0406cd20 con 0x7fec04073360 2024-09-12T12:21:03.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec03400640 1 --2- 172.21.15.144:0/81750019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 0x7fec0406d450 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fec040742c0 tx=0x7febf001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31031194bce309a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:03.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec02a00640 1 -- 172.21.15.144:0/81750019 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00ab680 con 0x7fec0406cff0 2024-09-12T12:21:03.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec02a00640 1 -- 172.21.15.144:0/81750019 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf00b0070 con 0x7fec0406cff0 2024-09-12T12:21:03.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec02a00640 1 -- 172.21.15.144:0/81750019 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf00aba40 con 0x7fec0406cff0 2024-09-12T12:21:03.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 -- 172.21.15.144:0/81750019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 msgr2=0x7fec0406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:03.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 --2- 172.21.15.144:0/81750019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 0x7fec0406d450 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fec040742c0 tx=0x7febf001c480 comp rx=0 tx=0).stop 2024-09-12T12:21:03.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 -- 172.21.15.144:0/81750019 shutdown_connections 2024-09-12T12:21:03.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 --2- 172.21.15.144:0/81750019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 0x7fec0406d450 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:03.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 --2- 172.21.15.144:0/81750019 >> v2:172.21.15.165:3300/0 conn(0x7fec04156c10 0x7fec04072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:03.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 -- 172.21.15.144:0/81750019 >> 172.21.15.144:0/81750019 conn(0x7fec0406bc10 msgr2=0x7fec0406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:03.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 -- 172.21.15.144:0/81750019 shutdown_connections 2024-09-12T12:21:03.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 -- 172.21.15.144:0/81750019 wait complete. 2024-09-12T12:21:03.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 Processor -- start 2024-09-12T12:21:03.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.471+0000 7fec0b000640 1 -- start start 2024-09-12T12:21:03.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec0b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 0x7fec041572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec0b000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec04073360 0x7fec04166200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec0b000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec04156c10 0x7fec04166740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec0b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec04157170 con 0x7fec0406cff0 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec0b000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec04156ff0 con 0x7fec04073360 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec0b000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec040725b0 con 0x7fec04156c10 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 0x7fec041572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 0x7fec041572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41476/0 (socket says 172.21.15.144:41476) 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03e00640 1 -- 172.21.15.144:0/533123788 learned_addr learned my addr 172.21.15.144:0/533123788 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03400640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec04073360 0x7fec04166200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec09000640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec04156c10 0x7fec04166740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03e00640 1 -- 172.21.15.144:0/533123788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec04156c10 msgr2=0x7fec04166740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:03.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03e00640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec04156c10 0x7fec04166740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03e00640 1 -- 172.21.15.144:0/533123788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec04073360 msgr2=0x7fec04166200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03e00640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec04073360 0x7fec04166200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03e00640 1 -- 172.21.15.144:0/533123788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec04157b40 con 0x7fec0406cff0 2024-09-12T12:21:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec03e00640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 0x7fec041572f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7febf400d620 tx=0x7febf400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7febfbe00640 1 -- 172.21.15.144:0/533123788 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf400b620 con 0x7fec0406cff0 2024-09-12T12:21:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7febfbe00640 1 -- 172.21.15.144:0/533123788 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf4019070 con 0x7fec0406cff0 2024-09-12T12:21:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7febfbe00640 1 -- 172.21.15.144:0/533123788 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf400b9e0 con 0x7fec0406cff0 2024-09-12T12:21:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec04157e20 con 0x7fec0406cff0 2024-09-12T12:21:03.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0414fd60 con 0x7fec0406cff0 2024-09-12T12:21:03.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0406d450 con 0x7fec0406cff0 2024-09-12T12:21:03.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.475+0000 7febfbe00640 1 -- 172.21.15.144:0/533123788 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7febf400bb80 con 0x7fec0406cff0 2024-09-12T12:21:03.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.479+0000 7febfbe00640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febe40678c0 0x7febe4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:03.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.479+0000 7febfbe00640 1 -- 172.21.15.144:0/533123788 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5749+0+0 (secure 0 0 0) 0x7febf4086050 con 0x7fec0406cff0 2024-09-12T12:21:03.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.479+0000 7fec03400640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febe40678c0 0x7febe4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:03.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.479+0000 7fec03400640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febe40678c0 0x7febe4069d80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7febf00af000 tx=0x7febf00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:03.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.483+0000 7febfbe00640 1 -- 172.21.15.144:0/533123788 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7febf4056bf0 con 0x7fec0406cff0 2024-09-12T12:21:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:03.647+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec0406dd80 con 0x7fec0406cff0 2024-09-12T12:21:04.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.303+0000 7febfbe00640 1 -- 172.21.15.144:0/533123788 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v132) ==== 169+0+0 (secure 0 0 0) 0x7febf40564f0 con 0x7fec0406cff0 2024-09-12T12:21:04.306 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:21:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febe40678c0 msgr2=0x7febe4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febe40678c0 0x7febe4069d80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7febf00af000 tx=0x7febf00a7000 comp rx=0 tx=0).stop 2024-09-12T12:21:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 msgr2=0x7fec041572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 0x7fec041572f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7febf400d620 tx=0x7febf400dae0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 shutdown_connections 2024-09-12T12:21:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febe40678c0 0x7febe4069d80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec04156c10 0x7fec04166740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec04073360 0x7fec04166200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 --2- 172.21.15.144:0/533123788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec0406cff0 0x7fec041572f0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.307+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 >> 172.21.15.144:0/533123788 conn(0x7fec0406bc10 msgr2=0x7fec0415cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.311+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 shutdown_connections 2024-09-12T12:21:04.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.311+0000 7fec0b000640 1 -- 172.21.15.144:0/533123788 wait complete. 2024-09-12T12:21:04.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:21:04.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe989400640 1 Processor -- start 2024-09-12T12:21:04.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe989400640 1 -- start start 2024-09-12T12:21:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe989400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe98415af60 0x7fe9840ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe989400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe9840cd9f0 0x7fe98406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe989400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9840b4300 con 0x7fe98415b340 2024-09-12T12:21:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe989400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe9840b32f0 con 0x7fe9840cd9f0 2024-09-12T12:21:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe989400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe9840b3540 con 0x7fe98415af60 2024-09-12T12:21:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe982800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe98415af60 0x7fe9840ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe981e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe9840cd9f0 0x7fe98406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe982800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe98415af60 0x7fe9840ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34416/0 (socket says 172.21.15.144:34416) 2024-09-12T12:21:04.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe982800640 1 -- 172.21.15.144:0/979972308 learned_addr learned my addr 172.21.15.144:0/979972308 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe981e00640 1 -- 172.21.15.144:0/979972308 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe98415af60 msgr2=0x7fe9840ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe981e00640 1 --2- 172.21.15.144:0/979972308 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe98415af60 0x7fe9840ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe981e00640 1 -- 172.21.15.144:0/979972308 >> v1:172.21.15.165:6789/0 conn(0x7fe98415b340 legacy=0x7fe98415ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe981e00640 1 -- 172.21.15.144:0/979972308 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9840b3820 con 0x7fe9840cd9f0 2024-09-12T12:21:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.515+0000 7fe981400640 1 -- 172.21.15.144:0/979972308 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334336346 0 0) 0x7fe9840b4300 con 0x7fe98415b340 2024-09-12T12:21:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe981e00640 1 --2- 172.21.15.144:0/979972308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9840cd9f0 0x7fe98406bc10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe97000ba60 tx=0x7fe970021360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d8319f77e3184be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe981400640 1 -- 172.21.15.144:0/979972308 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9700b6070 con 0x7fe9840cd9f0 2024-09-12T12:21:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe981400640 1 -- 172.21.15.144:0/979972308 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9700b1600 con 0x7fe9840cd9f0 2024-09-12T12:21:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe981400640 1 -- 172.21.15.144:0/979972308 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9700aae60 con 0x7fe9840cd9f0 2024-09-12T12:21:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe989400640 1 -- 172.21.15.144:0/979972308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9840cd9f0 msgr2=0x7fe98406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe989400640 1 --2- 172.21.15.144:0/979972308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9840cd9f0 0x7fe98406bc10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe97000ba60 tx=0x7fe970021360 comp rx=0 tx=0).stop 2024-09-12T12:21:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe989400640 1 -- 172.21.15.144:0/979972308 shutdown_connections 2024-09-12T12:21:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe989400640 1 --2- 172.21.15.144:0/979972308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9840cd9f0 0x7fe98406bc10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe989400640 1 --2- 172.21.15.144:0/979972308 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe98415af60 0x7fe9840ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe989400640 1 -- 172.21.15.144:0/979972308 >> 172.21.15.144:0/979972308 conn(0x7fe984068030 msgr2=0x7fe9840b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe989400640 1 -- 172.21.15.144:0/979972308 shutdown_connections 2024-09-12T12:21:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.519+0000 7fe989400640 1 -- 172.21.15.144:0/979972308 wait complete. 2024-09-12T12:21:04.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 Processor -- start 2024-09-12T12:21:04.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 -- start start 2024-09-12T12:21:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9840cd9f0 0x7fe98415a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe98415af60 0x7fe98415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe98415b340 0x7fe98414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9840b5570 con 0x7fe98415af60 2024-09-12T12:21:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe9840b3de0 con 0x7fe98415b340 2024-09-12T12:21:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe9840cebc0 con 0x7fe9840cd9f0 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe981e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe98415af60 0x7fe98415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe981e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe98415af60 0x7fe98415cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41482/0 (socket says 172.21.15.144:41482) 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe981e00640 1 -- 172.21.15.144:0/4187755960 learned_addr learned my addr 172.21.15.144:0/4187755960 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe982800640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9840cd9f0 0x7fe98415a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe983200640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe98415b340 0x7fe98414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe981e00640 1 -- 172.21.15.144:0/4187755960 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9840cd9f0 msgr2=0x7fe98415a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe981e00640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9840cd9f0 0x7fe98415a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe981e00640 1 -- 172.21.15.144:0/4187755960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe98415b340 msgr2=0x7fe98414df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe981e00640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe98415b340 0x7fe98414df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe981e00640 1 -- 172.21.15.144:0/4187755960 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98415d1b0 con 0x7fe98415af60 2024-09-12T12:21:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe981e00640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe98415af60 0x7fe98415cc70 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fe9700b4040 tx=0x7fe97001e100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe97aa00640 1 -- 172.21.15.144:0/4187755960 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9700b6040 con 0x7fe98415af60 2024-09-12T12:21:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe97aa00640 1 -- 172.21.15.144:0/4187755960 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9700bf070 con 0x7fe98415af60 2024-09-12T12:21:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98415d450 con 0x7fe98415af60 2024-09-12T12:21:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe97aa00640 1 -- 172.21.15.144:0/4187755960 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970006e20 con 0x7fe98415af60 2024-09-12T12:21:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.523+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98415da10 con 0x7fe98415af60 2024-09-12T12:21:04.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.527+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9840ce680 con 0x7fe98415af60 2024-09-12T12:21:04.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.527+0000 7fe97aa00640 1 -- 172.21.15.144:0/4187755960 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9700ba6a0 con 0x7fe98415af60 2024-09-12T12:21:04.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.527+0000 7fe97aa00640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9640678c0 0x7fe964069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.527+0000 7fe97aa00640 1 -- 172.21.15.144:0/4187755960 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7fe9701237b0 con 0x7fe98415af60 2024-09-12T12:21:04.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.527+0000 7fe982800640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9640678c0 0x7fe964069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.527+0000 7fe982800640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9640678c0 0x7fe964069d80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe974009b50 tx=0x7fe974009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:04.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.531+0000 7fe97aa00640 1 -- 172.21.15.144:0/4187755960 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe97001aec0 con 0x7fe98415af60 2024-09-12T12:21:04.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.687+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe9840afc20 con 0x7fe98415af60 2024-09-12T12:21:04.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.691+0000 7fe97aa00640 1 -- 172.21.15.144:0/4187755960 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7fe9700f3c60 con 0x7fe98415af60 2024-09-12T12:21:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9640678c0 msgr2=0x7fe964069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9640678c0 0x7fe964069d80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe974009b50 tx=0x7fe974009240 comp rx=0 tx=0).stop 2024-09-12T12:21:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe98415af60 msgr2=0x7fe98415cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe98415af60 0x7fe98415cc70 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fe9700b4040 tx=0x7fe97001e100 comp rx=0 tx=0).stop 2024-09-12T12:21:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 shutdown_connections 2024-09-12T12:21:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9640678c0 0x7fe964069d80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe98415b340 0x7fe98414df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe98415af60 0x7fe98415cc70 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 --2- 172.21.15.144:0/4187755960 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9840cd9f0 0x7fe98415a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 >> 172.21.15.144:0/4187755960 conn(0x7fe984068030 msgr2=0x7fe9840b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:04.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 shutdown_connections 2024-09-12T12:21:04.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.695+0000 7fe989400640 1 -- 172.21.15.144:0/4187755960 wait complete. 2024-09-12T12:21:04.715 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-12T12:21:04.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64c5e00640 1 Processor -- start 2024-09-12T12:21:04.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64c5e00640 1 -- start start 2024-09-12T12:21:04.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64c5e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f64c015c7b0 0x7f64c00ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64c5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f64c015cd30 0x7f64c00b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64c5e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c00b61e0 con 0x7f64c00b5de0 2024-09-12T12:21:04.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64c5e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f64c0072a50 con 0x7f64c015cd30 2024-09-12T12:21:04.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64c5e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f64c00cde30 con 0x7f64c015c7b0 2024-09-12T12:21:04.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64b6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f64c015cd30 0x7f64c00b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64b6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f64c015cd30 0x7f64c00b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41496/0 (socket says 172.21.15.144:41496) 2024-09-12T12:21:04.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64b6000640 1 -- 172.21.15.144:0/1411362008 learned_addr learned my addr 172.21.15.144:0/1411362008 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:04.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64bea00640 1 --2- 172.21.15.144:0/1411362008 >> v2:172.21.15.165:3300/0 conn(0x7f64c015c7b0 0x7f64c00ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64b6000640 1 -- 172.21.15.144:0/1411362008 >> v2:172.21.15.165:3300/0 conn(0x7f64c015c7b0 msgr2=0x7f64c00ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:04.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64b6000640 1 --2- 172.21.15.144:0/1411362008 >> v2:172.21.15.165:3300/0 conn(0x7f64c015c7b0 0x7f64c00ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64b6000640 1 -- 172.21.15.144:0/1411362008 >> v1:172.21.15.165:6789/0 conn(0x7f64c00b5de0 legacy=0x7f64c01601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:04.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.851+0000 7f64b6000640 1 -- 172.21.15.144:0/1411362008 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c00cd870 con 0x7f64c015cd30 2024-09-12T12:21:04.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64b6000640 1 --2- 172.21.15.144:0/1411362008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c015cd30 0x7f64c00b58a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f64c00d14f0 tx=0x7f64a801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8f2c49c30f0a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:04.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64be000640 1 -- 172.21.15.144:0/1411362008 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a80b1070 con 0x7f64c015cd30 2024-09-12T12:21:04.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64be000640 1 -- 172.21.15.144:0/1411362008 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a80ac630 con 0x7f64c015cd30 2024-09-12T12:21:04.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64be000640 1 -- 172.21.15.144:0/1411362008 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a80a8050 con 0x7f64c015cd30 2024-09-12T12:21:04.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64c5e00640 1 -- 172.21.15.144:0/1411362008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c015cd30 msgr2=0x7f64c00b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64c5e00640 1 --2- 172.21.15.144:0/1411362008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c015cd30 0x7f64c00b58a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f64c00d14f0 tx=0x7f64a801c4e0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64c5e00640 1 -- 172.21.15.144:0/1411362008 shutdown_connections 2024-09-12T12:21:04.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64c5e00640 1 --2- 172.21.15.144:0/1411362008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c015cd30 0x7f64c00b58a0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64c5e00640 1 --2- 172.21.15.144:0/1411362008 >> v2:172.21.15.165:3300/0 conn(0x7f64c015c7b0 0x7f64c00ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64c5e00640 1 -- 172.21.15.144:0/1411362008 >> 172.21.15.144:0/1411362008 conn(0x7f64c006d0d0 msgr2=0x7f64c006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:04.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64c5e00640 1 -- 172.21.15.144:0/1411362008 shutdown_connections 2024-09-12T12:21:04.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.855+0000 7f64c5e00640 1 -- 172.21.15.144:0/1411362008 wait complete. 2024-09-12T12:21:04.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 Processor -- start 2024-09-12T12:21:04.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 -- start start 2024-09-12T12:21:04.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c00b5de0 0x7f64c015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64c015c7b0 0x7f64c01f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64c015cd30 0x7f64c00b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f64c0169320 con 0x7f64c00b5de0 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f64c00cd650 con 0x7f64c015cd30 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f64c01694a0 con 0x7f64c015c7b0 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c00b5de0 0x7f64c015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c00b5de0 0x7f64c015bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41504/0 (socket says 172.21.15.144:41504) 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bea00640 1 -- 172.21.15.144:0/1072521651 learned_addr learned my addr 172.21.15.144:0/1072521651 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64b6000640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64c015c7b0 0x7f64c01f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bf400640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64c015cd30 0x7f64c00b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bea00640 1 -- 172.21.15.144:0/1072521651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64c015c7b0 msgr2=0x7f64c01f7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bea00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64c015c7b0 0x7f64c01f7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bea00640 1 -- 172.21.15.144:0/1072521651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64c015cd30 msgr2=0x7f64c00b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:04.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bea00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64c015cd30 0x7f64c00b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:04.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bea00640 1 -- 172.21.15.144:0/1072521651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c00b1f70 con 0x7f64c00b5de0 2024-09-12T12:21:04.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64bea00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c00b5de0 0x7f64c015bb40 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f64b000d800 tx=0x7f64b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:04.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64b7e00640 1 -- 172.21.15.144:0/1072521651 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b000b6c0 con 0x7f64c00b5de0 2024-09-12T12:21:04.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64b7e00640 1 -- 172.21.15.144:0/1072521651 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b0019070 con 0x7f64c00b5de0 2024-09-12T12:21:04.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c01f84d0 con 0x7f64c00b5de0 2024-09-12T12:21:04.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64b7e00640 1 -- 172.21.15.144:0/1072521651 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b000bae0 con 0x7f64c00b5de0 2024-09-12T12:21:04.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c01f8a90 con 0x7f64c00b5de0 2024-09-12T12:21:04.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.859+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c00ccf00 con 0x7f64c00b5de0 2024-09-12T12:21:04.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.863+0000 7f64b7e00640 1 -- 172.21.15.144:0/1072521651 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f64b000bc80 con 0x7f64c00b5de0 2024-09-12T12:21:04.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.863+0000 7f64b7e00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f649c0678c0 0x7f649c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:04.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.863+0000 7f64b7e00640 1 -- 172.21.15.144:0/1072521651 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7f64b0085f90 con 0x7f64c00b5de0 2024-09-12T12:21:04.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.863+0000 7f64b6000640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f649c0678c0 0x7f649c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:04.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.863+0000 7f64b6000640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f649c0678c0 0x7f649c069d80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f64a80ae000 tx=0x7f64a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:04.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:04.867+0000 7f64b7e00640 1 -- 172.21.15.144:0/1072521651 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f64b0056550 con 0x7f64c00b5de0 2024-09-12T12:21:05.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.083+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f64c00af830 con 0x7f64c00b5de0 2024-09-12T12:21:05.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64b7e00640 1 -- 172.21.15.144:0/1072521651 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v413) ==== 144+0+0 (secure 0 0 0) 0x7f64b005a850 con 0x7f64c00b5de0 2024-09-12T12:21:05.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f649c0678c0 msgr2=0x7f649c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f649c0678c0 0x7f649c069d80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f64a80ae000 tx=0x7f64a8009040 comp rx=0 tx=0).stop 2024-09-12T12:21:05.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c00b5de0 msgr2=0x7f64c015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c00b5de0 0x7f64c015bb40 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f64b000d800 tx=0x7f64b000dcc0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 shutdown_connections 2024-09-12T12:21:05.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f649c0678c0 0x7f649c069d80 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64c015cd30 0x7f64c00b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f64c015c7b0 0x7f64c01f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 --2- 172.21.15.144:0/1072521651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64c00b5de0 0x7f64c015bb40 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.307+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 >> 172.21.15.144:0/1072521651 conn(0x7f64c006d0d0 msgr2=0x7f64c00b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:05.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.311+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 shutdown_connections 2024-09-12T12:21:05.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.311+0000 7f64c5e00640 1 -- 172.21.15.144:0/1072521651 wait complete. 2024-09-12T12:21:05.329 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-12T12:21:05.329 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-12T12:21:05.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:21:05.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.463+0000 7f6d9ca00640 1 Processor -- start 2024-09-12T12:21:05.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d9ca00640 1 -- start start 2024-09-12T12:21:05.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d9ca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6d9815c6a0 0x7f6d980b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d9ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d980b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d9ca00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d980d1170 con 0x7f6d9806f550 2024-09-12T12:21:05.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d9ca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6d980cf270 con 0x7f6d9815c6a0 2024-09-12T12:21:05.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d9ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6d9815cbb0 con 0x7f6d9806f930 2024-09-12T12:21:05.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d8fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6d9815c6a0 0x7f6d980b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d97e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d980b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d97e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d980b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34432/0 (socket says 172.21.15.144:34432) 2024-09-12T12:21:05.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d97e00640 1 -- 172.21.15.144:0/477374870 learned_addr learned my addr 172.21.15.144:0/477374870 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:05.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d97400640 1 --1- 172.21.15.144:0/477374870 >> v1:172.21.15.165:6789/0 conn(0x7f6d9806f550 0x7f6d981606f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:41534/0 (socket says 172.21.15.144:41534) 2024-09-12T12:21:05.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d97e00640 1 -- 172.21.15.144:0/477374870 >> v2:172.21.15.165:3300/0 conn(0x7f6d9815c6a0 msgr2=0x7f6d980b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:05.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d97e00640 1 --2- 172.21.15.144:0/477374870 >> v2:172.21.15.165:3300/0 conn(0x7f6d9815c6a0 0x7f6d980b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d97e00640 1 -- 172.21.15.144:0/477374870 >> v1:172.21.15.165:6789/0 conn(0x7f6d9806f550 legacy=0x7f6d981606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d97e00640 1 -- 172.21.15.144:0/477374870 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9815ce90 con 0x7f6d9806f930 2024-09-12T12:21:05.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.467+0000 7f6d8fe00640 1 --2- 172.21.15.144:0/477374870 >> v2:172.21.15.165:3300/0 conn(0x7f6d9815c6a0 0x7f6d980b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:05.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d97e00640 1 --2- 172.21.15.144:0/477374870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d980b1a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009e50 tx=0x7f6d9001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfa0cc44ad205b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:05.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d96a00640 1 -- 172.21.15.144:0/477374870 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d900a5700 con 0x7f6d9806f930 2024-09-12T12:21:05.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d96a00640 1 -- 172.21.15.144:0/477374870 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d900a58a0 con 0x7f6d9806f930 2024-09-12T12:21:05.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d96a00640 1 -- 172.21.15.144:0/477374870 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d900a5c70 con 0x7f6d9806f930 2024-09-12T12:21:05.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d9ca00640 1 -- 172.21.15.144:0/477374870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 msgr2=0x7f6d980b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d9ca00640 1 --2- 172.21.15.144:0/477374870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d980b1a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009e50 tx=0x7f6d9001ca30 comp rx=0 tx=0).stop 2024-09-12T12:21:05.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d9ca00640 1 -- 172.21.15.144:0/477374870 shutdown_connections 2024-09-12T12:21:05.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d9ca00640 1 --2- 172.21.15.144:0/477374870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d980b1a30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d9ca00640 1 --2- 172.21.15.144:0/477374870 >> v2:172.21.15.165:3300/0 conn(0x7f6d9815c6a0 0x7f6d980b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d9ca00640 1 -- 172.21.15.144:0/477374870 >> 172.21.15.144:0/477374870 conn(0x7f6d98067a00 msgr2=0x7f6d98067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:05.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d9ca00640 1 -- 172.21.15.144:0/477374870 shutdown_connections 2024-09-12T12:21:05.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d9ca00640 1 -- 172.21.15.144:0/477374870 wait complete. 2024-09-12T12:21:05.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.471+0000 7f6d9ca00640 1 Processor -- start 2024-09-12T12:21:05.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 -- start start 2024-09-12T12:21:05.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d9806f550 0x7f6d9813e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d981423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d9815c6a0 0x7f6d981428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d980730b0 con 0x7f6d9806f550 2024-09-12T12:21:05.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6d980d20d0 con 0x7f6d9815c6a0 2024-09-12T12:21:05.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6d98073230 con 0x7f6d9806f930 2024-09-12T12:21:05.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d9806f550 0x7f6d9813e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d9806f550 0x7f6d9813e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41514/0 (socket says 172.21.15.144:41514) 2024-09-12T12:21:05.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97400640 1 -- 172.21.15.144:0/3599473563 learned_addr learned my addr 172.21.15.144:0/3599473563 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:05.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d8fe00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d981423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97e00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d9815c6a0 0x7f6d981428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97400640 1 -- 172.21.15.144:0/3599473563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 msgr2=0x7f6d981423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97400640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d981423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97400640 1 -- 172.21.15.144:0/3599473563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d9815c6a0 msgr2=0x7f6d981428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97400640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d9815c6a0 0x7f6d981428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97400640 1 -- 172.21.15.144:0/3599473563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d981588b0 con 0x7f6d9806f550 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d8fe00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d981423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d97400640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d9806f550 0x7f6d9813e420 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800c420 tx=0x7f6d8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d8f400640 1 -- 172.21.15.144:0/3599473563 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d880074e0 con 0x7f6d9806f550 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d8f400640 1 -- 172.21.15.144:0/3599473563 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d88007680 con 0x7f6d9806f550 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d98158b50 con 0x7f6d9806f550 2024-09-12T12:21:05.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d8f400640 1 -- 172.21.15.144:0/3599473563 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88004a30 con 0x7f6d9806f550 2024-09-12T12:21:05.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d98159110 con 0x7f6d9806f550 2024-09-12T12:21:05.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.475+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d981606f0 con 0x7f6d9806f550 2024-09-12T12:21:05.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.479+0000 7f6d8f400640 1 -- 172.21.15.144:0/3599473563 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6d8801a020 con 0x7f6d9806f550 2024-09-12T12:21:05.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.479+0000 7f6d8f400640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6d740678c0 0x7f6d74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.479+0000 7f6d8f400640 1 -- 172.21.15.144:0/3599473563 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7f6d88085360 con 0x7f6d9806f550 2024-09-12T12:21:05.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.479+0000 7f6d8fe00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6d740678c0 0x7f6d74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.479+0000 7f6d8fe00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6d740678c0 0x7f6d74069d80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6d980b5e90 tx=0x7f6d80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:05.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.483+0000 7f6d8f400640 1 -- 172.21.15.144:0/3599473563 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6d980d1170 con 0x7f6d9806f550 2024-09-12T12:21:05.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.643+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d980b58c0 con 0x7f6d9806f550 2024-09-12T12:21:05.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.643+0000 7f6d8f400640 1 -- 172.21.15.144:0/3599473563 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+13341 (secure 0 0 0) 0x7f6d88055f70 con 0x7f6d9806f550 2024-09-12T12:21:05.646 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:05.646 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":132,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:21:04.303836+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.165:6834/3565473111":"2024-09-13T12:21:01.294398+0000","172.21.15.165:6832/3565473111":"2024-09-13T12:21:01.294398+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:21:05.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6d740678c0 msgr2=0x7f6d74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6d740678c0 0x7f6d74069d80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6d980b5e90 tx=0x7f6d80008040 comp rx=0 tx=0).stop 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d9806f550 msgr2=0x7f6d9813e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d9806f550 0x7f6d9813e420 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800c420 tx=0x7f6d8800c8e0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 shutdown_connections 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6d740678c0 0x7f6d74069d80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d9815c6a0 0x7f6d981428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d9806f930 0x7f6d981423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 --2- 172.21.15.144:0/3599473563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d9806f550 0x7f6d9813e420 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 >> 172.21.15.144:0/3599473563 conn(0x7f6d98067a00 msgr2=0x7f6d980b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 shutdown_connections 2024-09-12T12:21:05.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.647+0000 7f6d9ca00640 1 -- 172.21.15.144:0/3599473563 wait complete. 2024-09-12T12:21:05.669 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:21:05.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:21:05.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1ce200640 1 Processor -- start 2024-09-12T12:21:05.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1ce200640 1 -- start start 2024-09-12T12:21:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1ce200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1c80b1e10 0x7fb1c80b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1ce200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 0x7fb1c80b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1ce200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c80b3470 con 0x7fb1c8155810 2024-09-12T12:21:05.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1ce200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c80b27c0 con 0x7fb1c80b1e10 2024-09-12T12:21:05.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1ce200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c815c820 con 0x7fb1c80b4580 2024-09-12T12:21:05.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1bfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1c80b1e10 0x7fb1c80b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1bfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1c80b1e10 0x7fb1c80b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41530/0 (socket says 172.21.15.144:41530) 2024-09-12T12:21:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1bfe00640 1 -- 172.21.15.144:0/581015082 learned_addr learned my addr 172.21.15.144:0/581015082 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1cd800640 1 --2- 172.21.15.144:0/581015082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 0x7fb1c80b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1bfe00640 1 -- 172.21.15.144:0/581015082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 msgr2=0x7fb1c80b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1bfe00640 1 --2- 172.21.15.144:0/581015082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 0x7fb1c80b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1bfe00640 1 -- 172.21.15.144:0/581015082 >> v1:172.21.15.165:6789/0 conn(0x7fb1c8155810 legacy=0x7fb1c815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1bfe00640 1 -- 172.21.15.144:0/581015082 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c80b3750 con 0x7fb1c80b1e10 2024-09-12T12:21:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.807+0000 7fb1cd800640 1 --2- 172.21.15.144:0/581015082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 0x7fb1c80b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:05.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1bfe00640 1 --2- 172.21.15.144:0/581015082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c80b1e10 0x7fb1c80b2280 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00098a0 tx=0x7fb1b001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4972df2a836893b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1c7e00640 1 -- 172.21.15.144:0/581015082 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b00b5070 con 0x7fb1c80b1e10 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1c7e00640 1 -- 172.21.15.144:0/581015082 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b00a89b0 con 0x7fb1c80b1e10 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1c7e00640 1 -- 172.21.15.144:0/581015082 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b00a8d80 con 0x7fb1c80b1e10 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1ce200640 1 -- 172.21.15.144:0/581015082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c80b1e10 msgr2=0x7fb1c80b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1ce200640 1 --2- 172.21.15.144:0/581015082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c80b1e10 0x7fb1c80b2280 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00098a0 tx=0x7fb1b001ecf0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1ce200640 1 -- 172.21.15.144:0/581015082 shutdown_connections 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1ce200640 1 --2- 172.21.15.144:0/581015082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 0x7fb1c80b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1ce200640 1 --2- 172.21.15.144:0/581015082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c80b1e10 0x7fb1c80b2280 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1ce200640 1 -- 172.21.15.144:0/581015082 >> 172.21.15.144:0/581015082 conn(0x7fb1c806e7e0 msgr2=0x7fb1c806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1ce200640 1 -- 172.21.15.144:0/581015082 shutdown_connections 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.811+0000 7fb1ce200640 1 -- 172.21.15.144:0/581015082 wait complete. 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 Processor -- start 2024-09-12T12:21:05.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 -- start start 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1c80b1e10 0x7fb1c8154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 0x7fb1c80af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8155810 0x7fb1c80d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c80b3ff0 con 0x7fb1c8155810 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c80b3d10 con 0x7fb1c80b1e10 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c80b3180 con 0x7fb1c80b4580 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8155810 0x7fb1c80d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8155810 0x7fb1c80d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41538/0 (socket says 172.21.15.144:41538) 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cd800640 1 -- 172.21.15.144:0/3701344852 learned_addr learned my addr 172.21.15.144:0/3701344852 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cce00640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1c80b1e10 0x7fb1c8154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1bfe00640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 0x7fb1c80af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cd800640 1 -- 172.21.15.144:0/3701344852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 msgr2=0x7fb1c80af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cd800640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 0x7fb1c80af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cd800640 1 -- 172.21.15.144:0/3701344852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1c80b1e10 msgr2=0x7fb1c8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cd800640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1c80b1e10 0x7fb1c8154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cd800640 1 -- 172.21.15.144:0/3701344852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c80afc10 con 0x7fb1c8155810 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1cd800640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8155810 0x7fb1c80d00f0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000cef0 tx=0x7fb1c000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1c5600640 1 -- 172.21.15.144:0/3701344852 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c001a070 con 0x7fb1c8155810 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1c5600640 1 -- 172.21.15.144:0/3701344852 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c000d860 con 0x7fb1c8155810 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1c5600640 1 -- 172.21.15.144:0/3701344852 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000dc50 con 0x7fb1c8155810 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c80afef0 con 0x7fb1c8155810 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.815+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c80b04b0 con 0x7fb1c8155810 2024-09-12T12:21:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.819+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c80ce040 con 0x7fb1c8155810 2024-09-12T12:21:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.819+0000 7fb1c5600640 1 -- 172.21.15.144:0/3701344852 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1c001d070 con 0x7fb1c8155810 2024-09-12T12:21:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.819+0000 7fb1c5600640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1a40678c0 0x7fb1a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.819+0000 7fb1c5600640 1 -- 172.21.15.144:0/3701344852 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7fb1c0086330 con 0x7fb1c8155810 2024-09-12T12:21:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.819+0000 7fb1cce00640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1a40678c0 0x7fb1a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.819+0000 7fb1cce00640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1a40678c0 0x7fb1a4069d80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80098e0 tx=0x7fb1b8009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:05.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.823+0000 7fb1c5600640 1 -- 172.21.15.144:0/3701344852 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb1c0056a50 con 0x7fb1c8155810 2024-09-12T12:21:05.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb1c80729a0 con 0x7fb1c8155810 2024-09-12T12:21:05.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1c5600640 1 -- 172.21.15.144:0/3701344852 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) ==== 93+0+10 (secure 0 0 0) 0x7fb1c005ad50 con 0x7fb1c8155810 2024-09-12T12:21:05.983 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:21:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1a40678c0 msgr2=0x7fb1a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1a40678c0 0x7fb1a4069d80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80098e0 tx=0x7fb1b8009060 comp rx=0 tx=0).stop 2024-09-12T12:21:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8155810 msgr2=0x7fb1c80d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8155810 0x7fb1c80d00f0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000cef0 tx=0x7fb1c000a710 comp rx=0 tx=0).stop 2024-09-12T12:21:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 shutdown_connections 2024-09-12T12:21:05.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1a40678c0 0x7fb1a4069d80 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1c8155810 0x7fb1c80d00f0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1c80b4580 0x7fb1c80af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 --2- 172.21.15.144:0/3701344852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1c80b1e10 0x7fb1c8154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:05.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 >> 172.21.15.144:0/3701344852 conn(0x7fb1c806e7e0 msgr2=0x7fb1c8070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:05.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 shutdown_connections 2024-09-12T12:21:05.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:05.983+0000 7fb1ce200640 1 -- 172.21.15.144:0/3701344852 wait complete. 2024-09-12T12:21:06.006 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-12T12:21:06.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.139+0000 7fa701e00640 1 Processor -- start 2024-09-12T12:21:06.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.139+0000 7fa701e00640 1 -- start start 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa6fc06fb10 0x7fa6fc15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6fc0d1100 con 0x7fa6fc15c700 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6fc0d1380 con 0x7fa6fc159c50 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa6fc15d1c0 con 0x7fa6fc06fb10 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa6fc15c700 0x7fa6fc06f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58014/0 (socket says 172.21.15.144:58014) 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fbe00640 1 -- 172.21.15.144:0/3057592137 learned_addr learned my addr 172.21.15.144:0/3057592137 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701400640 1 --2- 172.21.15.144:0/3057592137 >> v2:172.21.15.165:3300/0 conn(0x7fa6fc06fb10 0x7fa6fc15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809710054 0 0) 0x7fa6e8001120 con 0x7fa6fc15c700 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e0003530 con 0x7fa6fc15c700 2024-09-12T12:21:06.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4134606991 0 0) 0x7fa6e0003530 con 0x7fa6fc15c700 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 >> v2:172.21.15.165:3300/0 conn(0x7fa6fc06fb10 msgr2=0x7fa6fc15cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 --2- 172.21.15.144:0/3057592137 >> v2:172.21.15.165:3300/0 conn(0x7fa6fc06fb10 0x7fa6fc15cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 >> v1:172.21.15.165:6789/0 conn(0x7fa6fc159c50 legacy=0x7fa6fc0d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc15d4a0 con 0x7fa6fc15c700 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fa6e8001850 con 0x7fa6fc15c700 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 >> v1:172.21.15.144:6789/0 conn(0x7fa6fc15c700 legacy=0x7fa6fc06f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6e00039c0 0x7fa6e0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6e00043c0 0x7fa6e0004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc15d1c0 con 0x7fa6e0005130 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e000c070 con 0x7fa6e00043c0 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e000c270 con 0x7fa6e00039c0 2024-09-12T12:21:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701400640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6e00043c0 0x7fa6e0004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa700a00640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6e00039c0 0x7fa6e0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701400640 1 -- 172.21.15.144:0/3057592137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6e00039c0 msgr2=0x7fa6e0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701400640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6e00039c0 0x7fa6e0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701400640 1 -- 172.21.15.144:0/3057592137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6e00043c0 msgr2=0x7fa6e0004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701400640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6e00043c0 0x7fa6e0004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa701400640 1 -- 172.21.15.144:0/3057592137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e0003530 con 0x7fa6e0005130 2024-09-12T12:21:06.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.143+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6e00043c0 0x7fa6e0004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa701400640 1 -- 172.21.15.144:0/3057592137 reap_dead start 2024-09-12T12:21:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa701400640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6e000b9d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009ab0 tx=0x7fa6f401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d65004dae6bd08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800c0e0 con 0x7fa6e0005130 2024-09-12T12:21:06.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f40a5680 con 0x7fa6e0005130 2024-09-12T12:21:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa6fb400640 1 -- 172.21.15.144:0/3057592137 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40096b0 con 0x7fa6e0005130 2024-09-12T12:21:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa701e00640 1 -- 172.21.15.144:0/3057592137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 msgr2=0x7fa6e000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa701e00640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6e000b9d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009ab0 tx=0x7fa6f401ca90 comp rx=0 tx=0).stop 2024-09-12T12:21:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa701e00640 1 -- 172.21.15.144:0/3057592137 shutdown_connections 2024-09-12T12:21:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa701e00640 1 --2- 172.21.15.144:0/3057592137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6e000b9d0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa701e00640 1 -- 172.21.15.144:0/3057592137 >> 172.21.15.144:0/3057592137 conn(0x7fa6fc06c010 msgr2=0x7fa6fc0b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa701e00640 1 -- 172.21.15.144:0/3057592137 shutdown_connections 2024-09-12T12:21:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.147+0000 7fa701e00640 1 -- 172.21.15.144:0/3057592137 wait complete. 2024-09-12T12:21:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 Processor -- start 2024-09-12T12:21:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 -- start start 2024-09-12T12:21:06.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6fc1f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6fc158b00 0x7fa6fc15a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6fc157f30 0x7fa6fc1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc15feb0 con 0x7fa6e0005130 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc15a030 con 0x7fa6fc157f30 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6fc160030 con 0x7fa6fc158b00 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa700a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6fc1f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa700a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6fc1f3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41568/0 (socket says 172.21.15.144:41568) 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa700a00640 1 -- 172.21.15.144:0/1565945126 learned_addr learned my addr 172.21.15.144:0/1565945126 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6fc158b00 0x7fa6fc15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa700a00640 1 -- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6fc158b00 msgr2=0x7fa6fc15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701400640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6fc157f30 0x7fa6fc1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa700a00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6fc158b00 0x7fa6fc15a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa700a00640 1 -- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6fc157f30 msgr2=0x7fa6fc1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa700a00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6fc157f30 0x7fa6fc1583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa700a00640 1 -- 172.21.15.144:0/1565945126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc1588f0 con 0x7fa6e0005130 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6fc158b00 0x7fa6fc15a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701400640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6fc157f30 0x7fa6fc1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa700a00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6fc1f3e70 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec011c30 tx=0x7fa6ec00f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa6f8c00640 1 -- 172.21.15.144:0/1565945126 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec019020 con 0x7fa6e0005130 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa6f8c00640 1 -- 172.21.15.144:0/1565945126 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6ec00fcb0 con 0x7fa6e0005130 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa6f8c00640 1 -- 172.21.15.144:0/1565945126 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec003ba0 con 0x7fa6e0005130 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6fc0af8e0 con 0x7fa6e0005130 2024-09-12T12:21:06.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.151+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6fc0afea0 con 0x7fa6e0005130 2024-09-12T12:21:06.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.155+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6fc068d40 con 0x7fa6e0005130 2024-09-12T12:21:06.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.155+0000 7fa6f8c00640 1 -- 172.21.15.144:0/1565945126 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6ec01c020 con 0x7fa6e0005130 2024-09-12T12:21:06.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.155+0000 7fa6f8c00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6dc0678f0 0x7fa6dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.155+0000 7fa6f8c00640 1 -- 172.21.15.144:0/1565945126 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7fa6ec0891f0 con 0x7fa6e0005130 2024-09-12T12:21:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.155+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6dc0678f0 0x7fa6dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:06.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.155+0000 7fa6fbe00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6dc0678f0 0x7fa6dc069db0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8000fe0 tx=0x7fa6e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:06.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.159+0000 7fa6f8c00640 1 -- 172.21.15.144:0/1565945126 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa6ec023020 con 0x7fa6e0005130 2024-09-12T12:21:06.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:06.375+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7fa6fc0b6cf0 con 0x7fa6e0005130 2024-09-12T12:21:07.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.315+0000 7fa6f8c00640 1 -- 172.21.15.144:0/1565945126 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v415) ==== 158+0+0 (secure 0 0 0) 0x7fa6ec013330 con 0x7fa6e0005130 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6dc0678f0 msgr2=0x7fa6dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6dc0678f0 0x7fa6dc069db0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8000fe0 tx=0x7fa6e8009040 comp rx=0 tx=0).stop 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 msgr2=0x7fa6fc1f3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6fc1f3e70 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec011c30 tx=0x7fa6ec00f5a0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 shutdown_connections 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6dc0678f0 0x7fa6dc069db0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6fc157f30 0x7fa6fc1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6fc158b00 0x7fa6fc15a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 --2- 172.21.15.144:0/1565945126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e0005130 0x7fa6fc1f3e70 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 >> 172.21.15.144:0/1565945126 conn(0x7fa6fc06c010 msgr2=0x7fa6fc15b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 shutdown_connections 2024-09-12T12:21:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.319+0000 7fa701e00640 1 -- 172.21.15.144:0/1565945126 wait complete. 2024-09-12T12:21:07.342 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:21:07.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b8e00640 1 Processor -- start 2024-09-12T12:21:07.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b8e00640 1 -- start start 2024-09-12T12:21:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b4147e30 0x7fd6b406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b8e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6b406c150 0x7fd6b40b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b8e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6b40b54e0 con 0x7fd6b40b4c90 2024-09-12T12:21:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b8e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd6b406c5b0 con 0x7fd6b406c150 2024-09-12T12:21:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b415fcd0 con 0x7fd6b4147e30 2024-09-12T12:21:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6b406c150 0x7fd6b40b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:07.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6b406c150 0x7fd6b40b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36958/0 (socket says 172.21.15.144:36958) 2024-09-12T12:21:07.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd6b40b4c90 0x7fd6b40b5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54416/0 (socket says 172.21.15.144:54416) 2024-09-12T12:21:07.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6abe00640 1 -- 172.21.15.144:0/2260805326 learned_addr learned my addr 172.21.15.144:0/2260805326 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:07.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b1e00640 1 --2- 172.21.15.144:0/2260805326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b4147e30 0x7fd6b406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:07.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6abe00640 1 -- 172.21.15.144:0/2260805326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b4147e30 msgr2=0x7fd6b406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:07.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6abe00640 1 --2- 172.21.15.144:0/2260805326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b4147e30 0x7fd6b406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6abe00640 1 -- 172.21.15.144:0/2260805326 >> v1:172.21.15.144:6789/0 conn(0x7fd6b40b4c90 legacy=0x7fd6b40b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:07.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6abe00640 1 -- 172.21.15.144:0/2260805326 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b415ffb0 con 0x7fd6b406c150 2024-09-12T12:21:07.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b1e00640 1 --2- 172.21.15.144:0/2260805326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b4147e30 0x7fd6b406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:07.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.487+0000 7fd6b1400640 1 -- 172.21.15.144:0/2260805326 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362547811 0 0) 0x7fd6b40b54e0 con 0x7fd6b40b4c90 2024-09-12T12:21:07.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6abe00640 1 --2- 172.21.15.144:0/2260805326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b406c150 0x7fd6b40b4750 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009870 tx=0x7fd69c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cac8fbc376f7177 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:07.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b1400640 1 -- 172.21.15.144:0/2260805326 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0aa600 con 0x7fd6b406c150 2024-09-12T12:21:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b1400640 1 -- 172.21.15.144:0/2260805326 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c0af070 con 0x7fd6b406c150 2024-09-12T12:21:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b1400640 1 -- 172.21.15.144:0/2260805326 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0aa9c0 con 0x7fd6b406c150 2024-09-12T12:21:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 -- 172.21.15.144:0/2260805326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b406c150 msgr2=0x7fd6b40b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 --2- 172.21.15.144:0/2260805326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b406c150 0x7fd6b40b4750 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009870 tx=0x7fd69c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 -- 172.21.15.144:0/2260805326 shutdown_connections 2024-09-12T12:21:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 --2- 172.21.15.144:0/2260805326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b406c150 0x7fd6b40b4750 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 --2- 172.21.15.144:0/2260805326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b4147e30 0x7fd6b406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 -- 172.21.15.144:0/2260805326 >> 172.21.15.144:0/2260805326 conn(0x7fd6b406cd20 msgr2=0x7fd6b406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 -- 172.21.15.144:0/2260805326 shutdown_connections 2024-09-12T12:21:07.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 -- 172.21.15.144:0/2260805326 wait complete. 2024-09-12T12:21:07.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 Processor -- start 2024-09-12T12:21:07.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.491+0000 7fd6b8e00640 1 -- start start 2024-09-12T12:21:07.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b406c150 0x7fd6b4141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:07.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b40b4c90 0x7fd6b415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:07.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b8e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b4147e30 0x7fd6b40ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:07.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b40b5260 con 0x7fd6b40b4c90 2024-09-12T12:21:07.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b8e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b40b50e0 con 0x7fd6b4147e30 2024-09-12T12:21:07.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b416b0b0 con 0x7fd6b406c150 2024-09-12T12:21:07.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6abe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b40b4c90 0x7fd6b415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:07.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6abe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b40b4c90 0x7fd6b415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36968/0 (socket says 172.21.15.144:36968) 2024-09-12T12:21:07.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6abe00640 1 -- 172.21.15.144:0/3088934678 learned_addr learned my addr 172.21.15.144:0/3088934678 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:07.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b2800640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b4147e30 0x7fd6b40ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:07.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b1e00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b406c150 0x7fd6b4141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:07.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6abe00640 1 -- 172.21.15.144:0/3088934678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b406c150 msgr2=0x7fd6b4141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:07.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6abe00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b406c150 0x7fd6b4141050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6abe00640 1 -- 172.21.15.144:0/3088934678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b4147e30 msgr2=0x7fd6b40ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:07.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6abe00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b4147e30 0x7fd6b40ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6abe00640 1 -- 172.21.15.144:0/3088934678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b4141590 con 0x7fd6b40b4c90 2024-09-12T12:21:07.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6abe00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b40b4c90 0x7fd6b415a4f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0ac040 tx=0x7fd69c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:07.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6aa000640 1 -- 172.21.15.144:0/3088934678 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0bd5f0 con 0x7fd6b40b4c90 2024-09-12T12:21:07.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6aa000640 1 -- 172.21.15.144:0/3088934678 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69c0bd7b0 con 0x7fd6b40b4c90 2024-09-12T12:21:07.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6aa000640 1 -- 172.21.15.144:0/3088934678 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0bdba0 con 0x7fd6b40b4c90 2024-09-12T12:21:07.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b415aa30 con 0x7fd6b40b4c90 2024-09-12T12:21:07.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b41423e0 con 0x7fd6b40b4c90 2024-09-12T12:21:07.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b415e880 con 0x7fd6b40b4c90 2024-09-12T12:21:07.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.495+0000 7fd6aa000640 1 -- 172.21.15.144:0/3088934678 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd69c0a9070 con 0x7fd6b40b4c90 2024-09-12T12:21:07.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.499+0000 7fd6aa000640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6900678c0 0x7fd690069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:07.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.499+0000 7fd6aa000640 1 -- 172.21.15.144:0/3088934678 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7fd69c1205a0 con 0x7fd6b40b4c90 2024-09-12T12:21:07.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.499+0000 7fd6b1e00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6900678c0 0x7fd690069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:07.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.499+0000 7fd6b1e00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6900678c0 0x7fd690069d80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4006fd0 tx=0x7fd6a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:07.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.503+0000 7fd6aa000640 1 -- 172.21.15.144:0/3088934678 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd6b415aa30 con 0x7fd6b40b4c90 2024-09-12T12:21:07.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.659+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd6b406ffa0 con 0x7fd6b40b4c90 2024-09-12T12:21:07.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.663+0000 7fd6aa000640 1 -- 172.21.15.144:0/3088934678 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7fd69c016150 con 0x7fd6b40b4c90 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6900678c0 msgr2=0x7fd690069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6900678c0 0x7fd690069d80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4006fd0 tx=0x7fd6a4008040 comp rx=0 tx=0).stop 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b40b4c90 msgr2=0x7fd6b415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b40b4c90 0x7fd6b415a4f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0ac040 tx=0x7fd69c01ace0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 shutdown_connections 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6900678c0 0x7fd690069d80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6b4147e30 0x7fd6b40ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6b40b4c90 0x7fd6b415a4f0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 --2- 172.21.15.144:0/3088934678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd6b406c150 0x7fd6b4141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 >> 172.21.15.144:0/3088934678 conn(0x7fd6b406cd20 msgr2=0x7fd6b40b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 shutdown_connections 2024-09-12T12:21:07.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:07.667+0000 7fd6b8e00640 1 -- 172.21.15.144:0/3088934678 wait complete. 2024-09-12T12:21:07.686 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:21:07.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:21:07.777 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:21:07.860 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:21:07.860 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:21:07.860 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:07.869 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:21:07.869 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:21:07.870 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:07.880 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:21:07.881 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:21:07.881 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:07.922 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:21:07.922 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:21:07.922 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:07.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:21:07.933 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:21:07.934 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:08.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.103+0000 7f96a5a00640 1 Processor -- start 2024-09-12T12:21:08.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.103+0000 7f96a5a00640 1 -- start start 2024-09-12T12:21:08.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f96a5a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f96a0071420 0x7f96a0071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f96a5a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96a00ccf30 0x7f96a00cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f96a5a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a00cd890 con 0x7f96a015b4e0 2024-09-12T12:21:08.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f96a5a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f96a00b45a0 con 0x7f96a00ccf30 2024-09-12T12:21:08.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f96a5a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f96a00b3fe0 con 0x7f96a0071420 2024-09-12T12:21:08.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f969f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96a00ccf30 0x7f96a00cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f969f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96a00ccf30 0x7f96a00cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36974/0 (socket says 172.21.15.144:36974) 2024-09-12T12:21:08.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f969f400640 1 -- 172.21.15.144:0/4033273287 learned_addr learned my addr 172.21.15.144:0/4033273287 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:08.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f969e000640 1 --2- 172.21.15.144:0/4033273287 >> v2:172.21.15.165:3300/0 conn(0x7f96a0071420 0x7f96a0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f969f400640 1 -- 172.21.15.144:0/4033273287 >> v2:172.21.15.165:3300/0 conn(0x7f96a0071420 msgr2=0x7f96a0071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:08.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f969f400640 1 --2- 172.21.15.144:0/4033273287 >> v2:172.21.15.165:3300/0 conn(0x7f96a0071420 0x7f96a0071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f969f400640 1 -- 172.21.15.144:0/4033273287 >> v1:172.21.15.165:6789/0 conn(0x7f96a015b4e0 legacy=0x7f96a00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:08.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.107+0000 7f969f400640 1 -- 172.21.15.144:0/4033273287 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a00b42c0 con 0x7f96a00ccf30 2024-09-12T12:21:08.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f969f400640 1 --2- 172.21.15.144:0/4033273287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 0x7f96a00cd350 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f96a00b02b0 tx=0x7f969801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30aedb0f8ca8cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:08.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f969d600640 1 -- 172.21.15.144:0/4033273287 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96980aa610 con 0x7f96a00ccf30 2024-09-12T12:21:08.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f969d600640 1 -- 172.21.15.144:0/4033273287 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96980af070 con 0x7f96a00ccf30 2024-09-12T12:21:08.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f969d600640 1 -- 172.21.15.144:0/4033273287 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96980aa9d0 con 0x7f96a00ccf30 2024-09-12T12:21:08.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 -- 172.21.15.144:0/4033273287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 msgr2=0x7f96a00cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:08.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 --2- 172.21.15.144:0/4033273287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 0x7f96a00cd350 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f96a00b02b0 tx=0x7f969801c4b0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 -- 172.21.15.144:0/4033273287 shutdown_connections 2024-09-12T12:21:08.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 --2- 172.21.15.144:0/4033273287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 0x7f96a00cd350 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 --2- 172.21.15.144:0/4033273287 >> v2:172.21.15.165:3300/0 conn(0x7f96a0071420 0x7f96a0071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 -- 172.21.15.144:0/4033273287 >> 172.21.15.144:0/4033273287 conn(0x7f96a006d0d0 msgr2=0x7f96a006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:08.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 -- 172.21.15.144:0/4033273287 shutdown_connections 2024-09-12T12:21:08.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 -- 172.21.15.144:0/4033273287 wait complete. 2024-09-12T12:21:08.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 Processor -- start 2024-09-12T12:21:08.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.111+0000 7f96a5a00640 1 -- start start 2024-09-12T12:21:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f96a5a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0071420 0x7f96a0155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f96a5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 0x7f96a0160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f96a5a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a015b4e0 0x7f96a0161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f96a5a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f96a015b8c0 con 0x7f96a00ccf30 2024-09-12T12:21:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f96a5a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f96a00cdef0 con 0x7f96a015b4e0 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f96a5a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f96a0162800 con 0x7f96a0071420 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 0x7f96a0160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 0x7f96a0160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36990/0 (socket says 172.21.15.144:36990) 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969e000640 1 -- 172.21.15.144:0/3128866182 learned_addr learned my addr 172.21.15.144:0/3128866182 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969ea00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0071420 0x7f96a0155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969f400640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a015b4e0 0x7f96a0161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969e000640 1 -- 172.21.15.144:0/3128866182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0071420 msgr2=0x7f96a0155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969e000640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0071420 0x7f96a0155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969e000640 1 -- 172.21.15.144:0/3128866182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a015b4e0 msgr2=0x7f96a0161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969e000640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a015b4e0 0x7f96a0161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969e000640 1 -- 172.21.15.144:0/3128866182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a0161760 con 0x7f96a00ccf30 2024-09-12T12:21:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f969e000640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 0x7f96a0160bf0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f968c00d830 tx=0x7f968c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f9696a00640 1 -- 172.21.15.144:0/3128866182 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c00b660 con 0x7f96a00ccf30 2024-09-12T12:21:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f9696a00640 1 -- 172.21.15.144:0/3128866182 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968c019070 con 0x7f96a00ccf30 2024-09-12T12:21:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a0161a40 con 0x7f96a00ccf30 2024-09-12T12:21:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f9696a00640 1 -- 172.21.15.144:0/3128866182 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c00ba80 con 0x7f96a00ccf30 2024-09-12T12:21:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a0162000 con 0x7f96a00ccf30 2024-09-12T12:21:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a00b2a90 con 0x7f96a00ccf30 2024-09-12T12:21:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.115+0000 7f9696a00640 1 -- 172.21.15.144:0/3128866182 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f968c01e460 con 0x7f96a00ccf30 2024-09-12T12:21:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.119+0000 7f9696a00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96800678c0 0x7f9680069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.119+0000 7f9696a00640 1 -- 172.21.15.144:0/3128866182 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7f968c086130 con 0x7f96a00ccf30 2024-09-12T12:21:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.119+0000 7f969ea00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96800678c0 0x7f9680069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.119+0000 7f969ea00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96800678c0 0x7f9680069d80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f96a0165390 tx=0x7f969000d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:08.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.123+0000 7f9696a00640 1 -- 172.21.15.144:0/3128866182 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f968c056780 con 0x7f96a00ccf30 2024-09-12T12:21:08.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.311+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96a01566d0 con 0x7f96a00ccf30 2024-09-12T12:21:08.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.311+0000 7f9696a00640 1 -- 172.21.15.144:0/3128866182 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+3925 (secure 0 0 0) 0x7f968c05aa80 con 0x7f96a00ccf30 2024-09-12T12:21:08.314 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:08.314 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":100,"btime":"2024-09-12T12:21:02:297197+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6911,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/3824078479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":3824078479},{"type":"v1","addr":"172.21.15.144:6837","nonce":3824078479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1173253128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1173253128},{"type":"v1","addr":"172.21.15.165:6834","nonce":1173253128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":7633,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2364982071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2364982071},{"type":"v1","addr":"172.21.15.165:6835","nonce":2364982071}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":8004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1068048719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1068048719},{"type":"v1","addr":"172.21.15.144:6835","nonce":1068048719}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[]} 2024-09-12T12:21:08.314 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 100 2024-09-12T12:21:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96800678c0 msgr2=0x7f9680069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96800678c0 0x7f9680069d80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f96a0165390 tx=0x7f969000d040 comp rx=0 tx=0).stop 2024-09-12T12:21:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 msgr2=0x7f96a0160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 0x7f96a0160bf0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f968c00d830 tx=0x7f968c00dcf0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 shutdown_connections 2024-09-12T12:21:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96800678c0 0x7f9680069d80 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a015b4e0 0x7f96a0161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00ccf30 0x7f96a0160bf0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 --2- 172.21.15.144:0/3128866182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0071420 0x7f96a0155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 >> 172.21.15.144:0/3128866182 conn(0x7f96a006d0d0 msgr2=0x7f96a00b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:08.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 shutdown_connections 2024-09-12T12:21:08.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.315+0000 7f96a5a00640 1 -- 172.21.15.144:0/3128866182 wait complete. 2024-09-12T12:21:08.338 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:21:08.338 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:21:08.338 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:21:08.338 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:21:08.339 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:21:08.339 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:21:08.339 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:21:08.339 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:21:08.340 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:21:08.340 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:21:08.340 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:21:08.340 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:21:08.340 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:21:08.340 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:21:08.340 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:21:08.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:21:08.351 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:21:08.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:21:08.353 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:21:08.353 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:21:08.357 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:21:08.357 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:21:08.358 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:21:08.358 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:21:08.401 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:21:08.402 DEBUG:teuthology.parallel:result is None 2024-09-12T12:21:08.402 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:21:08.403 DEBUG:teuthology.parallel:result is None 2024-09-12T12:21:08.409 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:21:08.410 DEBUG:teuthology.parallel:result is None 2024-09-12T12:21:08.411 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:21:08.411 DEBUG:teuthology.parallel:result is None 2024-09-12T12:21:08.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:21:08.488 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:21:08.489 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:21:08.500 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:21:08.500 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:21:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0ea400640 1 Processor -- start 2024-09-12T12:21:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0ea400640 1 -- start start 2024-09-12T12:21:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0ea400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 0x7ff0e40ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0ea400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff0e40cd470 0x7ff0e40afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0ea400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0e40b02b0 0x7ff0e40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0ea400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e40b0730 con 0x7ff0e40b02b0 2024-09-12T12:21:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0ea400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e40ce090 con 0x7ff0e40cd470 2024-09-12T12:21:08.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0ea400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e40cd8b0 con 0x7ff0e4148190 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0e3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0e40b02b0 0x7ff0e40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0e3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0e40b02b0 0x7ff0e40ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37002/0 (socket says 172.21.15.144:37002) 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0e3e00640 1 -- 172.21.15.144:0/3854991515 learned_addr learned my addr 172.21.15.144:0/3854991515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0e3400640 1 --2- 172.21.15.144:0/3854991515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 0x7ff0e40ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.555+0000 7ff0e2a00640 1 --2- 172.21.15.144:0/3854991515 >> v2:172.21.15.165:3300/0 conn(0x7ff0e40cd470 0x7ff0e40afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0e3e00640 1 -- 172.21.15.144:0/3854991515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 msgr2=0x7ff0e40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0e3e00640 1 --2- 172.21.15.144:0/3854991515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 0x7ff0e40ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0e3e00640 1 -- 172.21.15.144:0/3854991515 >> v2:172.21.15.165:3300/0 conn(0x7ff0e40cd470 msgr2=0x7ff0e40afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0e3e00640 1 --2- 172.21.15.144:0/3854991515 >> v2:172.21.15.165:3300/0 conn(0x7ff0e40cd470 0x7ff0e40afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0e3e00640 1 -- 172.21.15.144:0/3854991515 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e4148570 con 0x7ff0e40b02b0 2024-09-12T12:21:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0e3e00640 1 --2- 172.21.15.144:0/3854991515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b02b0 0x7ff0e40ae890 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff0e406a020 tx=0x7ff0dc01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c92b3b2b45ea4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0e2000640 1 -- 172.21.15.144:0/3854991515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0ac070 con 0x7ff0e40b02b0 2024-09-12T12:21:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0e2000640 1 -- 172.21.15.144:0/3854991515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0a8420 con 0x7ff0e40b02b0 2024-09-12T12:21:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0e2000640 1 -- 172.21.15.144:0/3854991515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0a87f0 con 0x7ff0e40b02b0 2024-09-12T12:21:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0ea400640 1 -- 172.21.15.144:0/3854991515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b02b0 msgr2=0x7ff0e40ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0ea400640 1 --2- 172.21.15.144:0/3854991515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b02b0 0x7ff0e40ae890 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff0e406a020 tx=0x7ff0dc01c730 comp rx=0 tx=0).stop 2024-09-12T12:21:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0ea400640 1 -- 172.21.15.144:0/3854991515 shutdown_connections 2024-09-12T12:21:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0ea400640 1 --2- 172.21.15.144:0/3854991515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b02b0 0x7ff0e40ae890 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0ea400640 1 --2- 172.21.15.144:0/3854991515 >> v2:172.21.15.165:3300/0 conn(0x7ff0e40cd470 0x7ff0e40afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0ea400640 1 --2- 172.21.15.144:0/3854991515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 0x7ff0e40ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0ea400640 1 -- 172.21.15.144:0/3854991515 >> 172.21.15.144:0/3854991515 conn(0x7ff0e406d0d0 msgr2=0x7ff0e406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0ea400640 1 -- 172.21.15.144:0/3854991515 shutdown_connections 2024-09-12T12:21:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.559+0000 7ff0ea400640 1 -- 172.21.15.144:0/3854991515 wait complete. 2024-09-12T12:21:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0ea400640 1 Processor -- start 2024-09-12T12:21:08.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0ea400640 1 -- start start 2024-09-12T12:21:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0ea400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0e40b02b0 0x7ff0e4165690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0ea400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40cd470 0x7ff0e41440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0ea400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 0x7ff0e40cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0ea400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e40b46d0 con 0x7ff0e40cd470 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0ea400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e40b11f0 con 0x7ff0e40b02b0 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0ea400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e40b4850 con 0x7ff0e4148190 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40cd470 0x7ff0e41440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40cd470 0x7ff0e41440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37006/0 (socket says 172.21.15.144:37006) 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e3400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0e40b02b0 0x7ff0e4165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e2a00640 1 -- 172.21.15.144:0/1467655621 learned_addr learned my addr 172.21.15.144:0/1467655621 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e3e00640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 0x7ff0e40cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e2a00640 1 -- 172.21.15.144:0/1467655621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 msgr2=0x7ff0e40cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e2a00640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 0x7ff0e40cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e2a00640 1 -- 172.21.15.144:0/1467655621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0e40b02b0 msgr2=0x7ff0e4165690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e2a00640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0e40b02b0 0x7ff0e4165690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e2a00640 1 -- 172.21.15.144:0/1467655621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e4163530 con 0x7ff0e40cd470 2024-09-12T12:21:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e3400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0e40b02b0 0x7ff0e4165690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0e2a00640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40cd470 0x7ff0e41440e0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000d7d0 tx=0x7ff0d000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.563+0000 7ff0db400640 1 -- 172.21.15.144:0/1467655621 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0004020 con 0x7ff0e40cd470 2024-09-12T12:21:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0db400640 1 -- 172.21.15.144:0/1467655621 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d00041c0 con 0x7ff0e40cd470 2024-09-12T12:21:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e4163810 con 0x7ff0e40cd470 2024-09-12T12:21:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0db400640 1 -- 172.21.15.144:0/1467655621 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00043b0 con 0x7ff0e40cd470 2024-09-12T12:21:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e4163dd0 con 0x7ff0e40cd470 2024-09-12T12:21:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e4160750 con 0x7ff0e40cd470 2024-09-12T12:21:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0db400640 1 -- 172.21.15.144:0/1467655621 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0d001b020 con 0x7ff0e40cd470 2024-09-12T12:21:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0db400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0c40678c0 0x7ff0c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0db400640 1 -- 172.21.15.144:0/1467655621 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5335+0+0 (secure 0 0 0) 0x7ff0d0085800 con 0x7ff0e40cd470 2024-09-12T12:21:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0e3400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0c40678c0 0x7ff0c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.567+0000 7ff0e3400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0c40678c0 0x7ff0c4069d80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4007d30 tx=0x7ff0d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:08.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.571+0000 7ff0db400640 1 -- 172.21.15.144:0/1467655621 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff0d0055e50 con 0x7ff0e40cd470 2024-09-12T12:21:08.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:08.739+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff0e4144620 con 0x7ff0e40cd470 2024-09-12T12:21:09.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.331+0000 7ff0db400640 1 -- 172.21.15.144:0/1467655621 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) ==== 97+0+0 (secure 0 0 0) 0x7ff0d005a150 con 0x7ff0e40cd470 2024-09-12T12:21:09.332 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0c40678c0 msgr2=0x7ff0c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0c40678c0 0x7ff0c4069d80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4007d30 tx=0x7ff0d4008040 comp rx=0 tx=0).stop 2024-09-12T12:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40cd470 msgr2=0x7ff0e41440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40cd470 0x7ff0e41440e0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000d7d0 tx=0x7ff0d000dc90 comp rx=0 tx=0).stop 2024-09-12T12:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 shutdown_connections 2024-09-12T12:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff0c40678c0 0x7ff0c4069d80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0e4148190 0x7ff0e40cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40cd470 0x7ff0e41440e0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 --2- 172.21.15.144:0/1467655621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0e40b02b0 0x7ff0e4165690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 >> 172.21.15.144:0/1467655621 conn(0x7ff0e406d0d0 msgr2=0x7ff0e415f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:09.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 shutdown_connections 2024-09-12T12:21:09.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.335+0000 7ff0ea400640 1 -- 172.21.15.144:0/1467655621 wait complete. 2024-09-12T12:21:09.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:21:09.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.495+0000 7f90a2a00640 1 Processor -- start 2024-09-12T12:21:09.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.495+0000 7f90a2a00640 1 -- start start 2024-09-12T12:21:09.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.495+0000 7f90a2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f909c0cd640 0x7f909c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.495+0000 7f90a2a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909c0b45a0 con 0x7f909c071420 2024-09-12T12:21:09.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.495+0000 7f90a2a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909c0b3fe0 con 0x7f909c15b4e0 2024-09-12T12:21:09.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.495+0000 7f90a2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f909c0b42c0 con 0x7f909c0cd640 2024-09-12T12:21:09.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.495+0000 7f909b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f909c071420 0x7f909c0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54432/0 (socket says 172.21.15.144:54432) 2024-09-12T12:21:09.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.495+0000 7f909b400640 1 -- 172.21.15.144:0/3575440969 learned_addr learned my addr 172.21.15.144:0/3575440969 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:09.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f90a0a00640 1 --2- 172.21.15.144:0/3575440969 >> v2:172.21.15.165:3300/0 conn(0x7f909c0cd640 0x7f909c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699137739 0 0) 0x7f909c0b45a0 con 0x7f909c071420 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9080003530 con 0x7f909c071420 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3728789578 0 0) 0x7f9080003530 con 0x7f909c071420 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 >> v2:172.21.15.165:3300/0 conn(0x7f909c0cd640 msgr2=0x7f909c071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 --2- 172.21.15.144:0/3575440969 >> v2:172.21.15.165:3300/0 conn(0x7f909c0cd640 0x7f909c071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 >> v1:172.21.15.165:6789/0 conn(0x7f909c15b4e0 legacy=0x7f909c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909c0b1490 con 0x7f909c071420 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f9088001680 con 0x7f909c071420 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 >> v1:172.21.15.144:6789/0 conn(0x7f909c071420 legacy=0x7f909c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f9080003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90800043c0 0x7f9080004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9080005090 0x7f908000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f909c0b42c0 con 0x7f90800039c0 2024-09-12T12:21:09.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f908000e200 con 0x7f9080005090 2024-09-12T12:21:09.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f908000bfc0 con 0x7f90800043c0 2024-09-12T12:21:09.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909be00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f9080003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f90a0a00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9080005090 0x7f908000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909b400640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90800043c0 0x7f9080004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909be00640 1 -- 172.21.15.144:0/3575440969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90800043c0 msgr2=0x7f9080004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:09.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909be00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90800043c0 0x7f9080004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909be00640 1 -- 172.21.15.144:0/3575440969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9080005090 msgr2=0x7f908000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:09.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909be00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9080005090 0x7f908000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f909be00640 1 -- 172.21.15.144:0/3575440969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9080003530 con 0x7f90800039c0 2024-09-12T12:21:09.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.499+0000 7f90a0a00640 1 -- 172.21.15.144:0/3575440969 reap_dead start 2024-09-12T12:21:09.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f909be00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f9080003da0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f908c002010 tx=0x7f908c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed545c8645bf164f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:09.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c001c10 con 0x7f90800039c0 2024-09-12T12:21:09.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c0a66c0 con 0x7f90800039c0 2024-09-12T12:21:09.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f909aa00640 1 -- 172.21.15.144:0/3575440969 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0a6ab0 con 0x7f90800039c0 2024-09-12T12:21:09.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 -- 172.21.15.144:0/3575440969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 msgr2=0x7f9080003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f9080003da0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f908c002010 tx=0x7f908c01c8b0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 -- 172.21.15.144:0/3575440969 shutdown_connections 2024-09-12T12:21:09.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 --2- 172.21.15.144:0/3575440969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f9080003da0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 -- 172.21.15.144:0/3575440969 >> 172.21.15.144:0/3575440969 conn(0x7f909c06d0d0 msgr2=0x7f909c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:09.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 -- 172.21.15.144:0/3575440969 shutdown_connections 2024-09-12T12:21:09.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 -- 172.21.15.144:0/3575440969 wait complete. 2024-09-12T12:21:09.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 Processor -- start 2024-09-12T12:21:09.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 -- start start 2024-09-12T12:21:09.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f909c14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f909c157840 0x7f909c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f909c153980 0x7f909c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f909c15b8c0 con 0x7f90800039c0 2024-09-12T12:21:09.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f909c0b3da0 con 0x7f909c157840 2024-09-12T12:21:09.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.503+0000 7f90a2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f909c15d760 con 0x7f909c153980 2024-09-12T12:21:09.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f909c14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f909c14f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37034/0 (socket says 172.21.15.144:37034) 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909be00640 1 -- 172.21.15.144:0/1797303970 learned_addr learned my addr 172.21.15.144:0/1797303970 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909b400640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f909c157840 0x7f909c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f90a0a00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f909c153980 0x7f909c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909be00640 1 -- 172.21.15.144:0/1797303970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f909c153980 msgr2=0x7f909c1510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909be00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f909c153980 0x7f909c1510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909be00640 1 -- 172.21.15.144:0/1797303970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f909c157840 msgr2=0x7f909c153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909be00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f909c157840 0x7f909c153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909be00640 1 -- 172.21.15.144:0/1797303970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909c15da40 con 0x7f90800039c0 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909be00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f909c14f440 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f908c01c6e0 tx=0x7f908c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f9093e00640 1 -- 172.21.15.144:0/1797303970 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c001bf0 con 0x7f90800039c0 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f9093e00640 1 -- 172.21.15.144:0/1797303970 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c006b60 con 0x7f90800039c0 2024-09-12T12:21:09.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909c15dd20 con 0x7f90800039c0 2024-09-12T12:21:09.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f9093e00640 1 -- 172.21.15.144:0/1797303970 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0a7480 con 0x7f90800039c0 2024-09-12T12:21:09.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909c15e2e0 con 0x7f90800039c0 2024-09-12T12:21:09.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f909c153d90 con 0x7f90800039c0 2024-09-12T12:21:09.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f9093e00640 1 -- 172.21.15.144:0/1797303970 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f908c0a7620 con 0x7f90800039c0 2024-09-12T12:21:09.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f9093e00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f907c0678c0 0x7f907c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f9093e00640 1 -- 172.21.15.144:0/1797303970 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5249+0+0 (secure 0 0 0) 0x7f908c11fc90 con 0x7f90800039c0 2024-09-12T12:21:09.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.507+0000 7f909b400640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f907c0678c0 0x7f907c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.511+0000 7f909b400640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f907c0678c0 0x7f907c069d80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f909c0d0320 tx=0x7f9088009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:09.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.515+0000 7f9093e00640 1 -- 172.21.15.144:0/1797303970 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f909c153d90 con 0x7f90800039c0 2024-09-12T12:21:09.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.727+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f909c0d15d0 con 0x7f90800039c0 2024-09-12T12:21:09.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.727+0000 7f9093e00640 1 -- 172.21.15.144:0/1797303970 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f908c0ac020 con 0x7f90800039c0 2024-09-12T12:21:09.728 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:09.728 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:21:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:21:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.729 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:21:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:21:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:21:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:21:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:21:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:21:09.732 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:21:09.733 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.735 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:21:09.736 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.737 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:21:09.738 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.740 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:21:09.741 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.742 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:21:09.743 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:21:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:09.744 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:21:09.744 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.727+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f907c0678c0 msgr2=0x7f907c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.727+0000 7f90a2a00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f907c0678c0 0x7f907c069d80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f909c0d0320 tx=0x7f9088009040 comp rx=0 tx=0).stop 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.727+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 msgr2=0x7f909c14f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.731+0000 7f90a2a00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f909c14f440 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f908c01c6e0 tx=0x7f908c019650 comp rx=0 tx=0).stop 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.731+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 shutdown_connections 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.731+0000 7f90a2a00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f907c0678c0 0x7f907c069d80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.731+0000 7f90a2a00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f909c153980 0x7f909c1510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.731+0000 7f90a2a00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f909c157840 0x7f909c153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.731+0000 7f90a2a00640 1 --2- 172.21.15.144:0/1797303970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90800039c0 0x7f909c14f440 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.731+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 >> 172.21.15.144:0/1797303970 conn(0x7f909c06d0d0 msgr2=0x7f909c072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.731+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 shutdown_connections 2024-09-12T12:21:09.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.731+0000 7f90a2a00640 1 -- 172.21.15.144:0/1797303970 wait complete. 2024-09-12T12:21:09.750 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:21:09.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.883+0000 7f00fb200640 1 Processor -- start 2024-09-12T12:21:09.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00fb200640 1 -- start start 2024-09-12T12:21:09.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00fb200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00fc0b4020 0x7f00fc15c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00fb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc0afb10 0x7f00fc0cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00fb200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00fc152620 con 0x7f00fc152240 2024-09-12T12:21:09.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00fb200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f00fc0b0010 con 0x7f00fc0b4020 2024-09-12T12:21:09.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00fb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc0b02f0 con 0x7f00fc0afb10 2024-09-12T12:21:09.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00f9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00fc0b4020 0x7f00fc15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00f9e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f00fc152240 0x7f00fc0b3910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54448/0 (socket says 172.21.15.144:54448) 2024-09-12T12:21:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00f9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00fc0b4020 0x7f00fc15c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37040/0 (socket says 172.21.15.144:37040) 2024-09-12T12:21:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00f9e00640 1 -- 172.21.15.144:0/3223586089 learned_addr learned my addr 172.21.15.144:0/3223586089 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00fa800640 1 --2- 172.21.15.144:0/3223586089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc0afb10 0x7f00fc0cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00f9400640 1 -- 172.21.15.144:0/3223586089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc0afb10 msgr2=0x7f00fc0cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00f9400640 1 --2- 172.21.15.144:0/3223586089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc0afb10 0x7f00fc0cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00f9400640 1 -- 172.21.15.144:0/3223586089 >> v1:172.21.15.144:6789/0 conn(0x7f00fc152240 legacy=0x7f00fc0b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.887+0000 7f00f9400640 1 -- 172.21.15.144:0/3223586089 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc15b840 con 0x7f00fc0b4020 2024-09-12T12:21:09.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00f9400640 1 --2- 172.21.15.144:0/3223586089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 0x7f00fc15c320 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f00e80097f0 tx=0x7f00e801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9da5575b2e43e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:09.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00f8a00640 1 -- 172.21.15.144:0/3223586089 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e80a7070 con 0x7f00fc0b4020 2024-09-12T12:21:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00f8a00640 1 -- 172.21.15.144:0/3223586089 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e80b0070 con 0x7f00fc0b4020 2024-09-12T12:21:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00f8a00640 1 -- 172.21.15.144:0/3223586089 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e80ab890 con 0x7f00fc0b4020 2024-09-12T12:21:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 -- 172.21.15.144:0/3223586089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 msgr2=0x7f00fc15c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 --2- 172.21.15.144:0/3223586089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 0x7f00fc15c320 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f00e80097f0 tx=0x7f00e801c470 comp rx=0 tx=0).stop 2024-09-12T12:21:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 -- 172.21.15.144:0/3223586089 shutdown_connections 2024-09-12T12:21:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 --2- 172.21.15.144:0/3223586089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc0afb10 0x7f00fc0cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 --2- 172.21.15.144:0/3223586089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 0x7f00fc15c320 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 -- 172.21.15.144:0/3223586089 >> 172.21.15.144:0/3223586089 conn(0x7f00fc0b0580 msgr2=0x7f00fc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 -- 172.21.15.144:0/3223586089 shutdown_connections 2024-09-12T12:21:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 -- 172.21.15.144:0/3223586089 wait complete. 2024-09-12T12:21:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 Processor -- start 2024-09-12T12:21:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.891+0000 7f00fb200640 1 -- start start 2024-09-12T12:21:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00fc0afb10 0x7f00fc1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 0x7f00fc15d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc152240 0x7f00fc15de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc1680c0 con 0x7f00fc0b4020 2024-09-12T12:21:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc067d60 con 0x7f00fc0afb10 2024-09-12T12:21:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc168240 con 0x7f00fc152240 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 0x7f00fc15d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 0x7f00fc15d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37052/0 (socket says 172.21.15.144:37052) 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9400640 1 -- 172.21.15.144:0/2438373390 learned_addr learned my addr 172.21.15.144:0/2438373390 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fa800640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc152240 0x7f00fc15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9e00640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00fc0afb10 0x7f00fc1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9400640 1 -- 172.21.15.144:0/2438373390 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc152240 msgr2=0x7f00fc15de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9400640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc152240 0x7f00fc15de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9400640 1 -- 172.21.15.144:0/2438373390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00fc0afb10 msgr2=0x7f00fc1432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9400640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00fc0afb10 0x7f00fc1432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9400640 1 -- 172.21.15.144:0/2438373390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc06bd40 con 0x7f00fc0b4020 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f9400640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 0x7f00fc15d940 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f00e801a0a0 tx=0x7f00e801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f2000640 1 -- 172.21.15.144:0/2438373390 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e80bf610 con 0x7f00fc0b4020 2024-09-12T12:21:09.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f2000640 1 -- 172.21.15.144:0/2438373390 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e80bf7b0 con 0x7f00fc0b4020 2024-09-12T12:21:09.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc06c020 con 0x7f00fc0b4020 2024-09-12T12:21:09.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f2000640 1 -- 172.21.15.144:0/2438373390 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e80bfba0 con 0x7f00fc0b4020 2024-09-12T12:21:09.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc06c5e0 con 0x7f00fc0b4020 2024-09-12T12:21:09.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc0cc0a0 con 0x7f00fc0b4020 2024-09-12T12:21:09.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.895+0000 7f00f2000640 1 -- 172.21.15.144:0/2438373390 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00e80bd020 con 0x7f00fc0b4020 2024-09-12T12:21:09.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.899+0000 7f00f2000640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00dc0678c0 0x7f00dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:09.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.899+0000 7f00f2000640 1 -- 172.21.15.144:0/2438373390 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5249+0+0 (secure 0 0 0) 0x7f00e8120290 con 0x7f00fc0b4020 2024-09-12T12:21:09.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.899+0000 7f00f9e00640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00dc0678c0 0x7f00dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:09.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.899+0000 7f00f9e00640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00dc0678c0 0x7f00dc069d80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f00ec000f70 tx=0x7f00ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:09.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:09.903+0000 7f00f2000640 1 -- 172.21.15.144:0/2438373390 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00e8016090 con 0x7f00fc0b4020 2024-09-12T12:21:10.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.059+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f00fc0b2230 con 0x7f00fc0b4020 2024-09-12T12:21:10.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00f2000640 1 -- 172.21.15.144:0/2438373390 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v136) ==== 84+0+65 (secure 0 0 0) 0x7f00e80f0f80 con 0x7f00fc0b4020 2024-09-12T12:21:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:10.063 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:21:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:21:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:21:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:21:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:10.064 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:21:10.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00dc0678c0 msgr2=0x7f00dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:10.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00dc0678c0 0x7f00dc069d80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f00ec000f70 tx=0x7f00ec009040 comp rx=0 tx=0).stop 2024-09-12T12:21:10.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 msgr2=0x7f00fc15d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:10.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 0x7f00fc15d940 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f00e801a0a0 tx=0x7f00e801acb0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 shutdown_connections 2024-09-12T12:21:10.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00dc0678c0 0x7f00dc069d80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00fc152240 0x7f00fc15de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00fc0b4020 0x7f00fc15d940 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 --2- 172.21.15.144:0/2438373390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00fc0afb10 0x7f00fc1432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 >> 172.21.15.144:0/2438373390 conn(0x7f00fc0b0580 msgr2=0x7f00fc0c9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:10.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 shutdown_connections 2024-09-12T12:21:10.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.063+0000 7f00fb200640 1 -- 172.21.15.144:0/2438373390 wait complete. 2024-09-12T12:21:10.084 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:21:10.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:21:10.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f4876000640 1 Processor -- start 2024-09-12T12:21:10.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f4876000640 1 -- start start 2024-09-12T12:21:10.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f4876000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f487006d250 0x7f487015c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:10.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f4876000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f48700b3490 0x7f48700b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:10.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f4876000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487006cd20 con 0x7f487006d630 2024-09-12T12:21:10.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f4876000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4870072620 con 0x7f48700b3490 2024-09-12T12:21:10.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f4876000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f487015cc80 con 0x7f487006d250 2024-09-12T12:21:10.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f486f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f487006d250 0x7f487015c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:10.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f486f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f487006d250 0x7f487015c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60050/0 (socket says 172.21.15.144:60050) 2024-09-12T12:21:10.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f486ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f48700b3490 0x7f48700b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:10.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f486f400640 1 -- 172.21.15.144:0/2130492995 learned_addr learned my addr 172.21.15.144:0/2130492995 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:10.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f486f400640 1 -- 172.21.15.144:0/2130492995 >> v2:172.21.15.165:3300/0 conn(0x7f48700b3490 msgr2=0x7f48700b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:10.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.223+0000 7f486f400640 1 --2- 172.21.15.144:0/2130492995 >> v2:172.21.15.165:3300/0 conn(0x7f48700b3490 0x7f48700b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f486f400640 1 -- 172.21.15.144:0/2130492995 >> v1:172.21.15.165:6789/0 conn(0x7f487006d630 legacy=0x7f4870155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:10.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f486f400640 1 -- 172.21.15.144:0/2130492995 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48700b4f30 con 0x7f487006d250 2024-09-12T12:21:10.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f486f400640 1 --2- 172.21.15.144:0/2130492995 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f487006d250 0x7f487015c740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f48600098a0 tx=0x7f486001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e10ef233b466662 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:10.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f486e000640 1 -- 172.21.15.144:0/2130492995 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48600aa670 con 0x7f487006d250 2024-09-12T12:21:10.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f486e000640 1 -- 172.21.15.144:0/2130492995 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48600af070 con 0x7f487006d250 2024-09-12T12:21:10.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f486e000640 1 -- 172.21.15.144:0/2130492995 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48600aaa30 con 0x7f487006d250 2024-09-12T12:21:10.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f4876000640 1 -- 172.21.15.144:0/2130492995 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f487006d250 msgr2=0x7f487015c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:10.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f4876000640 1 --2- 172.21.15.144:0/2130492995 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f487006d250 0x7f487015c740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f48600098a0 tx=0x7f486001c510 comp rx=0 tx=0).stop 2024-09-12T12:21:10.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f4876000640 1 -- 172.21.15.144:0/2130492995 shutdown_connections 2024-09-12T12:21:10.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f4876000640 1 --2- 172.21.15.144:0/2130492995 >> v2:172.21.15.165:3300/0 conn(0x7f48700b3490 0x7f48700b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f4876000640 1 --2- 172.21.15.144:0/2130492995 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f487006d250 0x7f487015c740 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f4876000640 1 -- 172.21.15.144:0/2130492995 >> 172.21.15.144:0/2130492995 conn(0x7f487006bc10 msgr2=0x7f487006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:10.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f4876000640 1 -- 172.21.15.144:0/2130492995 shutdown_connections 2024-09-12T12:21:10.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.227+0000 7f4876000640 1 -- 172.21.15.144:0/2130492995 wait complete. 2024-09-12T12:21:10.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f4876000640 1 Processor -- start 2024-09-12T12:21:10.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f4876000640 1 -- start start 2024-09-12T12:21:10.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f4876000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f487006d250 0x7f48700cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:10.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f4876000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f487006d630 0x7f4870157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f4876000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48700b3490 0x7f48700cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f4876000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f48700b44d0 con 0x7f487006d250 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f4876000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f48700b41f0 con 0x7f487006d630 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f4876000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f487015d690 con 0x7f48700b3490 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f487006d250 0x7f48700cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f487006d250 0x7f48700cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37064/0 (socket says 172.21.15.144:37064) 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486f400640 1 -- 172.21.15.144:0/3313047128 learned_addr learned my addr 172.21.15.144:0/3313047128 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486ea00640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f487006d630 0x7f4870157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486fe00640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48700b3490 0x7f48700cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486f400640 1 -- 172.21.15.144:0/3313047128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48700b3490 msgr2=0x7f48700cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486f400640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48700b3490 0x7f48700cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486f400640 1 -- 172.21.15.144:0/3313047128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f487006d630 msgr2=0x7f4870157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:10.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486f400640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f487006d630 0x7f4870157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:10.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486f400640 1 -- 172.21.15.144:0/3313047128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4870158370 con 0x7f487006d250 2024-09-12T12:21:10.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f486f400640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f487006d250 0x7f48700cb130 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f48600ac040 tx=0x7f486001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:10.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.231+0000 7f4867400640 1 -- 172.21.15.144:0/3313047128 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48600bd5f0 con 0x7f487006d250 2024-09-12T12:21:10.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f4867400640 1 -- 172.21.15.144:0/3313047128 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48600bd7b0 con 0x7f487006d250 2024-09-12T12:21:10.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f4867400640 1 -- 172.21.15.144:0/3313047128 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48600bdba0 con 0x7f487006d250 2024-09-12T12:21:10.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48700aa480 con 0x7f487006d250 2024-09-12T12:21:10.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48700cbd60 con 0x7f487006d250 2024-09-12T12:21:10.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487015c740 con 0x7f487006d250 2024-09-12T12:21:10.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f4867400640 1 -- 172.21.15.144:0/3313047128 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f48600b33f0 con 0x7f487006d250 2024-09-12T12:21:10.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f4867400640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48500678c0 0x7f4850069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:10.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f4867400640 1 -- 172.21.15.144:0/3313047128 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5249+0+0 (secure 0 0 0) 0x7f48601206d0 con 0x7f487006d250 2024-09-12T12:21:10.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f486ea00640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48500678c0 0x7f4850069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:10.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.235+0000 7f486ea00640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48500678c0 0x7f4850069d80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f485c009ac0 tx=0x7f485c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:10.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.239+0000 7f4867400640 1 -- 172.21.15.144:0/3313047128 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4870158370 con 0x7f487006d250 2024-09-12T12:21:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:10.403+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f48701552b0 con 0x7f487006d250 2024-09-12T12:21:11.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.347+0000 7f4867400640 1 -- 172.21.15.144:0/3313047128 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v137) ==== 138+0+0 (secure 0 0 0) 0x7f4860016130 con 0x7f487006d250 2024-09-12T12:21:11.349 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:21:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48500678c0 msgr2=0x7f4850069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48500678c0 0x7f4850069d80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f485c009ac0 tx=0x7f485c009190 comp rx=0 tx=0).stop 2024-09-12T12:21:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f487006d250 msgr2=0x7f48700cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f487006d250 0x7f48700cb130 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f48600ac040 tx=0x7f486001ad50 comp rx=0 tx=0).stop 2024-09-12T12:21:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 shutdown_connections 2024-09-12T12:21:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f48500678c0 0x7f4850069d80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f48700b3490 0x7f48700cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f487006d630 0x7f4870157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 --2- 172.21.15.144:0/3313047128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f487006d250 0x7f48700cb130 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 >> 172.21.15.144:0/3313047128 conn(0x7f487006bc10 msgr2=0x7f48700cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 shutdown_connections 2024-09-12T12:21:11.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.351+0000 7f4876000640 1 -- 172.21.15.144:0/3313047128 wait complete. 2024-09-12T12:21:11.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:21:11.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.523+0000 7f8127600640 1 Processor -- start 2024-09-12T12:21:11.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.523+0000 7f8127600640 1 -- start start 2024-09-12T12:21:11.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.523+0000 7f8127600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f812015af60 0x7f81200ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:11.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.523+0000 7f8127600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f81200cd9f0 0x7f812006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:11.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8127600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81200b4300 con 0x7f812015b340 2024-09-12T12:21:11.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8127600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f81200b32f0 con 0x7f812015af60 2024-09-12T12:21:11.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8127600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f81200b3540 con 0x7f81200cd9f0 2024-09-12T12:21:11.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8124c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f812015af60 0x7f81200ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:11.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8124c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f812015af60 0x7f81200ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37072/0 (socket says 172.21.15.144:37072) 2024-09-12T12:21:11.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8124c00640 1 -- 172.21.15.144:0/1026488286 learned_addr learned my addr 172.21.15.144:0/1026488286 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:11.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f811fe00640 1 --2- 172.21.15.144:0/1026488286 >> v2:172.21.15.165:3300/0 conn(0x7f81200cd9f0 0x7f812006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:11.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8124c00640 1 -- 172.21.15.144:0/1026488286 >> v2:172.21.15.165:3300/0 conn(0x7f81200cd9f0 msgr2=0x7f812006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:11.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8124c00640 1 --2- 172.21.15.144:0/1026488286 >> v2:172.21.15.165:3300/0 conn(0x7f81200cd9f0 0x7f812006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:11.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8124c00640 1 -- 172.21.15.144:0/1026488286 >> v1:172.21.15.144:6789/0 conn(0x7f812015b340 legacy=0x7f812015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:11.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8124c00640 1 -- 172.21.15.144:0/1026488286 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81200b3820 con 0x7f812015af60 2024-09-12T12:21:11.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f8124c00640 1 --2- 172.21.15.144:0/1026488286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f812015af60 0x7f81200ce680 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8120070d20 tx=0x7f811001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11965bf506854783 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:11.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f811f400640 1 -- 172.21.15.144:0/1026488286 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81100b0070 con 0x7f812015af60 2024-09-12T12:21:11.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f811f400640 1 -- 172.21.15.144:0/1026488286 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81100ab600 con 0x7f812015af60 2024-09-12T12:21:11.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.527+0000 7f811f400640 1 -- 172.21.15.144:0/1026488286 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81100ab9d0 con 0x7f812015af60 2024-09-12T12:21:11.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 -- 172.21.15.144:0/1026488286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f812015af60 msgr2=0x7f81200ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:11.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 --2- 172.21.15.144:0/1026488286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f812015af60 0x7f81200ce680 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8120070d20 tx=0x7f811001c520 comp rx=0 tx=0).stop 2024-09-12T12:21:11.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 -- 172.21.15.144:0/1026488286 shutdown_connections 2024-09-12T12:21:11.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 --2- 172.21.15.144:0/1026488286 >> v2:172.21.15.165:3300/0 conn(0x7f81200cd9f0 0x7f812006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:11.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 --2- 172.21.15.144:0/1026488286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f812015af60 0x7f81200ce680 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:11.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 -- 172.21.15.144:0/1026488286 >> 172.21.15.144:0/1026488286 conn(0x7f8120068030 msgr2=0x7f81200b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:11.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 -- 172.21.15.144:0/1026488286 shutdown_connections 2024-09-12T12:21:11.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 -- 172.21.15.144:0/1026488286 wait complete. 2024-09-12T12:21:11.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 Processor -- start 2024-09-12T12:21:11.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 -- start start 2024-09-12T12:21:11.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81200cd9f0 0x7f81200acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:11.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f812015af60 0x7f8120073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f812015b340 0x7f8120073d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81200ced40 con 0x7f81200cd9f0 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f81200cebc0 con 0x7f812015af60 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8127600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8120167f00 con 0x7f812015b340 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8124c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81200cd9f0 0x7f81200acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8124c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81200cd9f0 0x7f81200acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37086/0 (socket says 172.21.15.144:37086) 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8124c00640 1 -- 172.21.15.144:0/1730101846 learned_addr learned my addr 172.21.15.144:0/1730101846 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8125600640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f812015b340 0x7f8120073d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f811fe00640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f812015af60 0x7f8120073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8124c00640 1 -- 172.21.15.144:0/1730101846 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f812015b340 msgr2=0x7f8120073d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8124c00640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f812015b340 0x7f8120073d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:11.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8124c00640 1 -- 172.21.15.144:0/1730101846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f812015af60 msgr2=0x7f8120073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:11.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8124c00640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f812015af60 0x7f8120073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:11.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.531+0000 7f8124c00640 1 -- 172.21.15.144:0/1730101846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81200ae9e0 con 0x7f81200cd9f0 2024-09-12T12:21:11.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f8124c00640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81200cd9f0 0x7f81200acd30 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f81100ae040 tx=0x7f81100192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:11.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f811cc00640 1 -- 172.21.15.144:0/1730101846 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81100b0040 con 0x7f81200cd9f0 2024-09-12T12:21:11.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f811cc00640 1 -- 172.21.15.144:0/1730101846 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81100b4410 con 0x7f81200cd9f0 2024-09-12T12:21:11.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81200aecc0 con 0x7f81200cd9f0 2024-09-12T12:21:11.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f811cc00640 1 -- 172.21.15.144:0/1730101846 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81100b4800 con 0x7f81200cd9f0 2024-09-12T12:21:11.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81200af280 con 0x7f81200cd9f0 2024-09-12T12:21:11.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812006bc10 con 0x7f81200cd9f0 2024-09-12T12:21:11.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f811cc00640 1 -- 172.21.15.144:0/1730101846 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81100bc030 con 0x7f81200cd9f0 2024-09-12T12:21:11.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f811cc00640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81000678c0 0x7f8100069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:11.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f811cc00640 1 -- 172.21.15.144:0/1730101846 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5619+0+0 (secure 0 0 0) 0x7f811011f1c0 con 0x7f81200cd9f0 2024-09-12T12:21:11.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.535+0000 7f811fe00640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81000678c0 0x7f8100069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:11.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.539+0000 7f811fe00640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81000678c0 0x7f8100069d80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f81200ac210 tx=0x7f810c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:11.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.539+0000 7f811cc00640 1 -- 172.21.15.144:0/1730101846 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8110016110 con 0x7f81200cd9f0 2024-09-12T12:21:11.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:11.699+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f812014fdc0 con 0x7f81200cd9f0 2024-09-12T12:21:12.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f811cc00640 1 -- 172.21.15.144:0/1730101846 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v138) ==== 170+0+0 (secure 0 0 0) 0x7f81100ef770 con 0x7f81200cd9f0 2024-09-12T12:21:12.371 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:21:12.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81000678c0 msgr2=0x7f8100069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:12.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81000678c0 0x7f8100069d80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f81200ac210 tx=0x7f810c008040 comp rx=0 tx=0).stop 2024-09-12T12:21:12.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81200cd9f0 msgr2=0x7f81200acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:12.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81200cd9f0 0x7f81200acd30 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f81100ae040 tx=0x7f81100192c0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 shutdown_connections 2024-09-12T12:21:12.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81000678c0 0x7f8100069d80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f812015b340 0x7f8120073d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f812015af60 0x7f8120073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 --2- 172.21.15.144:0/1730101846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81200cd9f0 0x7f81200acd30 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 >> 172.21.15.144:0/1730101846 conn(0x7f8120068030 msgr2=0x7f81201502e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:12.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 shutdown_connections 2024-09-12T12:21:12.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.359+0000 7f8127600640 1 -- 172.21.15.144:0/1730101846 wait complete. 2024-09-12T12:21:12.401 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:21:12.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6c200640 1 Processor -- start 2024-09-12T12:21:12.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6c200640 1 -- start start 2024-09-12T12:21:12.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6c200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef640cf190 0x7fef6406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:12.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6c200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef640cf900 con 0x7fef640af5d0 2024-09-12T12:21:12.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6c200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef640cfbe0 con 0x7fef64162a40 2024-09-12T12:21:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6c200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fef640cfec0 con 0x7fef640cf190 2024-09-12T12:21:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef640cf190 0x7fef6406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef640cf190 0x7fef6406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37094/0 (socket says 172.21.15.144:37094) 2024-09-12T12:21:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6a200640 1 -- 172.21.15.144:0/1681891123 learned_addr learned my addr 172.21.15.144:0/1681891123 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef68e00640 1 --1- 172.21.15.144:0/1681891123 >> v1:172.21.15.144:6789/0 conn(0x7fef640af5d0 0x7fef64166510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54478/0 (socket says 172.21.15.144:54478) 2024-09-12T12:21:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6a200640 1 -- 172.21.15.144:0/1681891123 >> v1:172.21.15.165:6789/0 conn(0x7fef64162a40 legacy=0x7fef64163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6a200640 1 -- 172.21.15.144:0/1681891123 >> v1:172.21.15.144:6789/0 conn(0x7fef640af5d0 legacy=0x7fef64166510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:12.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.551+0000 7fef6a200640 1 -- 172.21.15.144:0/1681891123 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef64162e20 con 0x7fef640cf190 2024-09-12T12:21:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef6a200640 1 --2- 172.21.15.144:0/1681891123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef640cf190 0x7fef6406bc10 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009e50 tx=0x7fef5c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6423b9d13a6b5860 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef63e00640 1 -- 172.21.15.144:0/1681891123 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c0a5660 con 0x7fef640cf190 2024-09-12T12:21:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef63e00640 1 -- 172.21.15.144:0/1681891123 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef5c0a5800 con 0x7fef640cf190 2024-09-12T12:21:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef63e00640 1 -- 172.21.15.144:0/1681891123 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c0a5bd0 con 0x7fef640cf190 2024-09-12T12:21:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef6c200640 1 -- 172.21.15.144:0/1681891123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef640cf190 msgr2=0x7fef6406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef6c200640 1 --2- 172.21.15.144:0/1681891123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef640cf190 0x7fef6406bc10 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009e50 tx=0x7fef5c01c9a0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef6c200640 1 -- 172.21.15.144:0/1681891123 shutdown_connections 2024-09-12T12:21:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef6c200640 1 --2- 172.21.15.144:0/1681891123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef640cf190 0x7fef6406bc10 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef6c200640 1 -- 172.21.15.144:0/1681891123 >> 172.21.15.144:0/1681891123 conn(0x7fef64068030 msgr2=0x7fef640b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef6c200640 1 -- 172.21.15.144:0/1681891123 shutdown_connections 2024-09-12T12:21:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef6c200640 1 -- 172.21.15.144:0/1681891123 wait complete. 2024-09-12T12:21:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.555+0000 7fef6c200640 1 Processor -- start 2024-09-12T12:21:12.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 -- start start 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef640af5d0 0x7fef641fd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef640cf190 0x7fef64152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef64162a40 0x7fef64159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fef64166c20 con 0x7fef64162a40 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fef6406c560 con 0x7fef640af5d0 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fef64166da0 con 0x7fef640cf190 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef64162a40 0x7fef64159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef64162a40 0x7fef64159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37102/0 (socket says 172.21.15.144:37102) 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6a200640 1 -- 172.21.15.144:0/2216541323 learned_addr learned my addr 172.21.15.144:0/2216541323 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef69800640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef640af5d0 0x7fef641fd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef68e00640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef640cf190 0x7fef64152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6a200640 1 -- 172.21.15.144:0/2216541323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef640cf190 msgr2=0x7fef64152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6a200640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef640cf190 0x7fef64152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6a200640 1 -- 172.21.15.144:0/2216541323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef640af5d0 msgr2=0x7fef641fd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6a200640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef640af5d0 0x7fef641fd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6a200640 1 -- 172.21.15.144:0/2216541323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6415a520 con 0x7fef64162a40 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef69800640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef640af5d0 0x7fef641fd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6a200640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef64162a40 0x7fef64159b10 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0195b0 tx=0x7fef5c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef61600640 1 -- 172.21.15.144:0/2216541323 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c0bc020 con 0x7fef64162a40 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef61600640 1 -- 172.21.15.144:0/2216541323 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef5c0b8670 con 0x7fef64162a40 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef61600640 1 -- 172.21.15.144:0/2216541323 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c0b8a20 con 0x7fef64162a40 2024-09-12T12:21:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6415a240 con 0x7fef64162a40 2024-09-12T12:21:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef641fcd90 con 0x7fef64162a40 2024-09-12T12:21:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.559+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef640b39f0 con 0x7fef64162a40 2024-09-12T12:21:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.563+0000 7fef61600640 1 -- 172.21.15.144:0/2216541323 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef5c0bf020 con 0x7fef64162a40 2024-09-12T12:21:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.563+0000 7fef61600640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fef440678c0 0x7fef44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.563+0000 7fef61600640 1 -- 172.21.15.144:0/2216541323 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 6001+0+0 (secure 0 0 0) 0x7fef5c121410 con 0x7fef64162a40 2024-09-12T12:21:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.563+0000 7fef69800640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fef440678c0 0x7fef44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.563+0000 7fef69800640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fef440678c0 0x7fef44069d80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fef58000f70 tx=0x7fef58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.567+0000 7fef61600640 1 -- 172.21.15.144:0/2216541323 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fef5c0c6030 con 0x7fef64162a40 2024-09-12T12:21:12.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:12.759+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fef640b35a0 con 0x7fef64162a40 2024-09-12T12:21:13.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.359+0000 7fef61600640 1 -- 172.21.15.144:0/2216541323 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v103) ==== 174+0+0 (secure 0 0 0) 0x7fef5c016620 con 0x7fef64162a40 2024-09-12T12:21:13.361 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 19 and data pool 20 2024-09-12T12:21:13.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fef440678c0 msgr2=0x7fef44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fef440678c0 0x7fef44069d80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fef58000f70 tx=0x7fef58009040 comp rx=0 tx=0).stop 2024-09-12T12:21:13.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef64162a40 msgr2=0x7fef64159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef64162a40 0x7fef64159b10 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0195b0 tx=0x7fef5c019740 comp rx=0 tx=0).stop 2024-09-12T12:21:13.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 shutdown_connections 2024-09-12T12:21:13.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fef440678c0 0x7fef44069d80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef64162a40 0x7fef64159b10 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef640cf190 0x7fef64152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 --2- 172.21.15.144:0/2216541323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef640af5d0 0x7fef641fd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.363+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 >> 172.21.15.144:0/2216541323 conn(0x7fef64068030 msgr2=0x7fef640b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:13.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.367+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 shutdown_connections 2024-09-12T12:21:13.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.367+0000 7fef6c200640 1 -- 172.21.15.144:0/2216541323 wait complete. 2024-09-12T12:21:13.411 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:21:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe40a800640 1 Processor -- start 2024-09-12T12:21:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe40a800640 1 -- start start 2024-09-12T12:21:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe40a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe40415b310 0x7fe404073380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe40a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 0x7fe404070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe40a800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4040b4ff0 con 0x7fe404074030 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe40a800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe40415b6f0 con 0x7fe40415b310 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe40a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe404072940 con 0x7fe40406fc90 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe409400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe40415b310 0x7fe404073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe409400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe40415b310 0x7fe404073380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37106/0 (socket says 172.21.15.144:37106) 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe409400640 1 -- 172.21.15.144:0/3039544711 learned_addr learned my addr 172.21.15.144:0/3039544711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe409e00640 1 --2- 172.21.15.144:0/3039544711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 0x7fe404070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe409400640 1 -- 172.21.15.144:0/3039544711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 msgr2=0x7fe404070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe409400640 1 --2- 172.21.15.144:0/3039544711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 0x7fe404070490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe409400640 1 -- 172.21.15.144:0/3039544711 >> v1:172.21.15.165:6789/0 conn(0x7fe404074030 legacy=0x7fe40406f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe409400640 1 -- 172.21.15.144:0/3039544711 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4040b52d0 con 0x7fe40415b310 2024-09-12T12:21:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.551+0000 7fe409e00640 1 --2- 172.21.15.144:0/3039544711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 0x7fe404070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:13.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe409400640 1 --2- 172.21.15.144:0/3039544711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe40415b310 0x7fe404073380 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009870 tx=0x7fe3f801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45af380ace7ead5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe403e00640 1 -- 172.21.15.144:0/3039544711 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f80b2070 con 0x7fe40415b310 2024-09-12T12:21:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe403e00640 1 -- 172.21.15.144:0/3039544711 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f80a9070 con 0x7fe40415b310 2024-09-12T12:21:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe403e00640 1 -- 172.21.15.144:0/3039544711 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f80ad880 con 0x7fe40415b310 2024-09-12T12:21:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe40a800640 1 -- 172.21.15.144:0/3039544711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe40415b310 msgr2=0x7fe404073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe40a800640 1 --2- 172.21.15.144:0/3039544711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe40415b310 0x7fe404073380 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009870 tx=0x7fe3f801c560 comp rx=0 tx=0).stop 2024-09-12T12:21:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe40a800640 1 -- 172.21.15.144:0/3039544711 shutdown_connections 2024-09-12T12:21:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe40a800640 1 --2- 172.21.15.144:0/3039544711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 0x7fe404070490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe40a800640 1 --2- 172.21.15.144:0/3039544711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe40415b310 0x7fe404073380 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe40a800640 1 -- 172.21.15.144:0/3039544711 >> 172.21.15.144:0/3039544711 conn(0x7fe4040b2f90 msgr2=0x7fe4040b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe40a800640 1 -- 172.21.15.144:0/3039544711 shutdown_connections 2024-09-12T12:21:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.555+0000 7fe40a800640 1 -- 172.21.15.144:0/3039544711 wait complete. 2024-09-12T12:21:13.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 Processor -- start 2024-09-12T12:21:13.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 -- start start 2024-09-12T12:21:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 0x7fe40414f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe404074030 0x7fe404157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe40415b310 0x7fe404157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4040ce740 con 0x7fe404074030 2024-09-12T12:21:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe4040b4da0 con 0x7fe40415b310 2024-09-12T12:21:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4040ce8c0 con 0x7fe40406fc90 2024-09-12T12:21:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe408a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe404074030 0x7fe404157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe408a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe404074030 0x7fe404157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37118/0 (socket says 172.21.15.144:37118) 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe408a00640 1 -- 172.21.15.144:0/842086114 learned_addr learned my addr 172.21.15.144:0/842086114 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe409400640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 0x7fe40414f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe409e00640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe40415b310 0x7fe404157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe408a00640 1 -- 172.21.15.144:0/842086114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 msgr2=0x7fe40414f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe408a00640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 0x7fe40414f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe408a00640 1 -- 172.21.15.144:0/842086114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe40415b310 msgr2=0x7fe404157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe408a00640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe40415b310 0x7fe404157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe408a00640 1 -- 172.21.15.144:0/842086114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40415ae80 con 0x7fe404074030 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe408a00640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe404074030 0x7fe404157000 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c420 tx=0x7fe3f000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe401600640 1 -- 172.21.15.144:0/842086114 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f00052d0 con 0x7fe404074030 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe401600640 1 -- 172.21.15.144:0/842086114 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f0005470 con 0x7fe404074030 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe401600640 1 -- 172.21.15.144:0/842086114 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0007260 con 0x7fe404074030 2024-09-12T12:21:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40414e840 con 0x7fe404074030 2024-09-12T12:21:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.559+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40414ee00 con 0x7fe404074030 2024-09-12T12:21:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.563+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe404073380 con 0x7fe404074030 2024-09-12T12:21:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.563+0000 7fe401600640 1 -- 172.21.15.144:0/842086114 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3f0007400 con 0x7fe404074030 2024-09-12T12:21:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.563+0000 7fe401600640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3e40678c0 0x7fe3e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.563+0000 7fe401600640 1 -- 172.21.15.144:0/842086114 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 6101+0+0 (secure 0 0 0) 0x7fe3f00852f0 con 0x7fe404074030 2024-09-12T12:21:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.563+0000 7fe409400640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3e40678c0 0x7fe3e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.563+0000 7fe409400640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3e40678c0 0x7fe3e4069d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80af000 tx=0x7fe3f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.567+0000 7fe401600640 1 -- 172.21.15.144:0/842086114 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe3f00555b0 con 0x7fe404074030 2024-09-12T12:21:13.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.727+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4040d0a90 con 0x7fe404074030 2024-09-12T12:21:13.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.727+0000 7fe401600640 1 -- 172.21.15.144:0/842086114 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16997 (secure 0 0 0) 0x7fe3f00598b0 con 0x7fe404074030 2024-09-12T12:21:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:13.729 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":139,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:21:12.766119+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:21:10.454030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-12T12:21:11.747676+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:21:13.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3e40678c0 msgr2=0x7fe3e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3e40678c0 0x7fe3e4069d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80af000 tx=0x7fe3f8008040 comp rx=0 tx=0).stop 2024-09-12T12:21:13.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe404074030 msgr2=0x7fe404157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe404074030 0x7fe404157000 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000c420 tx=0x7fe3f000c8e0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 shutdown_connections 2024-09-12T12:21:13.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3e40678c0 0x7fe3e4069d80 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe40415b310 0x7fe404157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe404074030 0x7fe404157000 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 --2- 172.21.15.144:0/842086114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe40406fc90 0x7fe40414f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 >> 172.21.15.144:0/842086114 conn(0x7fe4040b2f90 msgr2=0x7fe404075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 shutdown_connections 2024-09-12T12:21:13.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.731+0000 7fe40a800640 1 -- 172.21.15.144:0/842086114 wait complete. 2024-09-12T12:21:13.751 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:21:13.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dfa00640 1 Processor -- start 2024-09-12T12:21:13.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dfa00640 1 -- start start 2024-09-12T12:21:13.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dfa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 0x7fa6d806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dfa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa6d8147a70 0x7fa6d806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dfa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d80b6730 con 0x7fa6d8147fc0 2024-09-12T12:21:13.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dfa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa6d8162100 con 0x7fa6d8147a70 2024-09-12T12:21:13.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dfa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d81623e0 con 0x7fa6d8147570 2024-09-12T12:21:13.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6d7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa6d8147fc0 0x7fa6d80ae890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54492/0 (socket says 172.21.15.144:54492) 2024-09-12T12:21:13.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6d7e00640 1 -- 172.21.15.144:0/531134066 learned_addr learned my addr 172.21.15.144:0/531134066 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:13.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dda00640 1 --2- 172.21.15.144:0/531134066 >> v2:172.21.15.165:3300/0 conn(0x7fa6d8147a70 0x7fa6d806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dd000640 1 --2- 172.21.15.144:0/531134066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 0x7fa6d806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6d7400640 1 -- 172.21.15.144:0/531134066 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757910042 0 0) 0x7fa6d80b6730 con 0x7fa6d8147fc0 2024-09-12T12:21:13.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6d7400640 1 -- 172.21.15.144:0/531134066 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6c0003530 con 0x7fa6d8147fc0 2024-09-12T12:21:13.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dda00640 1 -- 172.21.15.144:0/531134066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 msgr2=0x7fa6d806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:13.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dda00640 1 --2- 172.21.15.144:0/531134066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 0x7fa6d806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dda00640 1 -- 172.21.15.144:0/531134066 >> v1:172.21.15.144:6789/0 conn(0x7fa6d8147fc0 legacy=0x7fa6d80ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.887+0000 7fa6dda00640 1 -- 172.21.15.144:0/531134066 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d81626c0 con 0x7fa6d8147a70 2024-09-12T12:21:13.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6dda00640 1 --2- 172.21.15.144:0/531134066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6d8147a70 0x7fa6d806c150 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009d90 tx=0x7fa6d001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e83f698895591b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6d7400640 1 -- 172.21.15.144:0/531134066 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00b2070 con 0x7fa6d8147a70 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6d7400640 1 -- 172.21.15.144:0/531134066 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d00a5860 con 0x7fa6d8147a70 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6d7400640 1 -- 172.21.15.144:0/531134066 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00a5c10 con 0x7fa6d8147a70 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6dfa00640 1 -- 172.21.15.144:0/531134066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6d8147a70 msgr2=0x7fa6d806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6dfa00640 1 --2- 172.21.15.144:0/531134066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6d8147a70 0x7fa6d806c150 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009d90 tx=0x7fa6d001c970 comp rx=0 tx=0).stop 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6dfa00640 1 -- 172.21.15.144:0/531134066 shutdown_connections 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6dfa00640 1 --2- 172.21.15.144:0/531134066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6d8147a70 0x7fa6d806c150 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6dfa00640 1 --2- 172.21.15.144:0/531134066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 0x7fa6d806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6dfa00640 1 -- 172.21.15.144:0/531134066 >> 172.21.15.144:0/531134066 conn(0x7fa6d806f8b0 msgr2=0x7fa6d806fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:13.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6dfa00640 1 -- 172.21.15.144:0/531134066 shutdown_connections 2024-09-12T12:21:13.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.891+0000 7fa6dfa00640 1 -- 172.21.15.144:0/531134066 wait complete. 2024-09-12T12:21:13.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 Processor -- start 2024-09-12T12:21:13.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 -- start start 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 0x7fa6d8145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d8147a70 0x7fa6d81649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6d8147fc0 0x7fa6d8164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d816b1f0 con 0x7fa6d8147a70 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d80b1f80 con 0x7fa6d8147fc0 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d816b370 con 0x7fa6d8147570 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d8147a70 0x7fa6d81649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d8147a70 0x7fa6d81649a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37130/0 (socket says 172.21.15.144:37130) 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d7e00640 1 -- 172.21.15.144:0/1197173599 learned_addr learned my addr 172.21.15.144:0/1197173599 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:13.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dda00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6d8147fc0 0x7fa6d8164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dd000640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 0x7fa6d8145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d7e00640 1 -- 172.21.15.144:0/1197173599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 msgr2=0x7fa6d8145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d7e00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 0x7fa6d8145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d7e00640 1 -- 172.21.15.144:0/1197173599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6d8147fc0 msgr2=0x7fa6d8164ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d7e00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6d8147fc0 0x7fa6d8164ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d7e00640 1 -- 172.21.15.144:0/1197173599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d8165420 con 0x7fa6d8147a70 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dd000640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 0x7fa6d8145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d7e00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d8147a70 0x7fa6d81649a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c390 tx=0x7fa6c400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d4c00640 1 -- 172.21.15.144:0/1197173599 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4017070 con 0x7fa6d8147a70 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d4c00640 1 -- 172.21.15.144:0/1197173599 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c4005d10 con 0x7fa6d8147a70 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6d4c00640 1 -- 172.21.15.144:0/1197173599 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4007310 con 0x7fa6d8147a70 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d81656d0 con 0x7fa6d8147a70 2024-09-12T12:21:13.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d8165c90 con 0x7fa6d8147a70 2024-09-12T12:21:13.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.895+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d8073ea0 con 0x7fa6d8147a70 2024-09-12T12:21:13.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.899+0000 7fa6d4c00640 1 -- 172.21.15.144:0/1197173599 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6c401a070 con 0x7fa6d8147a70 2024-09-12T12:21:13.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.899+0000 7fa6d4c00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6b80678c0 0x7fa6b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:13.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.899+0000 7fa6d4c00640 1 -- 172.21.15.144:0/1197173599 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 6101+0+0 (secure 0 0 0) 0x7fa6c40852e0 con 0x7fa6d8147a70 2024-09-12T12:21:13.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.899+0000 7fa6dd000640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6b80678c0 0x7fa6b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:13.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.899+0000 7fa6dd000640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6b80678c0 0x7fa6b8069d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009ae0 tx=0x7fa6cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:13.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:13.903+0000 7fa6d4c00640 1 -- 172.21.15.144:0/1197173599 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa6c4055cb0 con 0x7fa6d8147a70 2024-09-12T12:21:14.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.063+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6d80ae890 con 0x7fa6d8147a70 2024-09-12T12:21:14.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6d4c00640 1 -- 172.21.15.144:0/1197173599 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16997 (secure 0 0 0) 0x7fa6c40555b0 con 0x7fa6d8147a70 2024-09-12T12:21:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:14.067 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":139,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:21:12.766119+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:21:10.454030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-12T12:21:11.747676+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:21:14.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6b80678c0 msgr2=0x7fa6b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:14.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6b80678c0 0x7fa6b8069d80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009ae0 tx=0x7fa6cc008040 comp rx=0 tx=0).stop 2024-09-12T12:21:14.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d8147a70 msgr2=0x7fa6d81649a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:14.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d8147a70 0x7fa6d81649a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c390 tx=0x7fa6c400c850 comp rx=0 tx=0).stop 2024-09-12T12:21:14.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 shutdown_connections 2024-09-12T12:21:14.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6b80678c0 0x7fa6b8069d80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:14.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6d8147fc0 0x7fa6d8164ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:14.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6d8147a70 0x7fa6d81649a0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:14.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 --2- 172.21.15.144:0/1197173599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6d8147570 0x7fa6d8145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:14.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 >> 172.21.15.144:0/1197173599 conn(0x7fa6d806f8b0 msgr2=0x7fa6d80b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:14.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 shutdown_connections 2024-09-12T12:21:14.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.067+0000 7fa6dfa00640 1 -- 172.21.15.144:0/1197173599 wait complete. 2024-09-12T12:21:14.088 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:21:14.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f558ac00640 1 Processor -- start 2024-09-12T12:21:14.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f558ac00640 1 -- start start 2024-09-12T12:21:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f558ac00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55840af5f0 0x7f558406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f558ac00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f558406c150 0x7f55840cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f558ac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55840733e0 con 0x7f558415c2e0 2024-09-12T12:21:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f558ac00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f558406c5c0 con 0x7f55840af5f0 2024-09-12T12:21:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f558ac00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f55840cd290 con 0x7f558406c150 2024-09-12T12:21:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f5583400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55840af5f0 0x7f558406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f5583400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f55840af5f0 0x7f558406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37134/0 (socket says 172.21.15.144:37134) 2024-09-12T12:21:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f5583400640 1 -- 172.21.15.144:0/3741805296 learned_addr learned my addr 172.21.15.144:0/3741805296 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f5588c00640 1 --2- 172.21.15.144:0/3741805296 >> v2:172.21.15.165:3300/0 conn(0x7f558406c150 0x7f55840cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f5583400640 1 -- 172.21.15.144:0/3741805296 >> v2:172.21.15.165:3300/0 conn(0x7f558406c150 msgr2=0x7f55840cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f5583400640 1 --2- 172.21.15.144:0/3741805296 >> v2:172.21.15.165:3300/0 conn(0x7f558406c150 0x7f55840cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f5583400640 1 -- 172.21.15.144:0/3741805296 >> v1:172.21.15.165:6789/0 conn(0x7f558415c2e0 legacy=0x7f5584072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:14.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.227+0000 7f5583400640 1 -- 172.21.15.144:0/3741805296 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55840cd570 con 0x7f55840af5f0 2024-09-12T12:21:14.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f5583400640 1 --2- 172.21.15.144:0/3741805296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 0x7f558406bc10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5584071bc0 tx=0x7f557001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b614b4d33cae5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:14.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f5582a00640 1 -- 172.21.15.144:0/3741805296 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55700b0070 con 0x7f55840af5f0 2024-09-12T12:21:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f5582a00640 1 -- 172.21.15.144:0/3741805296 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55700ab600 con 0x7f55840af5f0 2024-09-12T12:21:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f5582a00640 1 -- 172.21.15.144:0/3741805296 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55700ab9d0 con 0x7f55840af5f0 2024-09-12T12:21:14.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 -- 172.21.15.144:0/3741805296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 msgr2=0x7f558406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 --2- 172.21.15.144:0/3741805296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 0x7f558406bc10 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5584071bc0 tx=0x7f557001c400 comp rx=0 tx=0).stop 2024-09-12T12:21:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 -- 172.21.15.144:0/3741805296 shutdown_connections 2024-09-12T12:21:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 --2- 172.21.15.144:0/3741805296 >> v2:172.21.15.165:3300/0 conn(0x7f558406c150 0x7f55840cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 --2- 172.21.15.144:0/3741805296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 0x7f558406bc10 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 -- 172.21.15.144:0/3741805296 >> 172.21.15.144:0/3741805296 conn(0x7f5584068030 msgr2=0x7f55840b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 -- 172.21.15.144:0/3741805296 shutdown_connections 2024-09-12T12:21:14.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 -- 172.21.15.144:0/3741805296 wait complete. 2024-09-12T12:21:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 Processor -- start 2024-09-12T12:21:14.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.231+0000 7f558ac00640 1 -- start start 2024-09-12T12:21:14.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f558ac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f558406c150 0x7f558413be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f558ac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 0x7f558415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f558ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f558415c2e0 0x7f558415e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f558ac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f55840cee50 con 0x7f55840af5f0 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f558ac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f55840cecd0 con 0x7f558406c150 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f558ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f55840cefd0 con 0x7f558415c2e0 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 0x7f558415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 0x7f558415d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37148/0 (socket says 172.21.15.144:37148) 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583400640 1 -- 172.21.15.144:0/4168441515 learned_addr learned my addr 172.21.15.144:0/4168441515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583e00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f558406c150 0x7f558413be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5588c00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f558415c2e0 0x7f558415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:14.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583400640 1 -- 172.21.15.144:0/4168441515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f558415c2e0 msgr2=0x7f558415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:14.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583400640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f558415c2e0 0x7f558415e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:14.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583400640 1 -- 172.21.15.144:0/4168441515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f558406c150 msgr2=0x7f558413be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:14.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583400640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f558406c150 0x7f558413be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:14.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583400640 1 -- 172.21.15.144:0/4168441515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55840d1430 con 0x7f55840af5f0 2024-09-12T12:21:14.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5588c00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f558415c2e0 0x7f558415e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:14.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f5583400640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 0x7f558415d3e0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f55700ae040 tx=0x7f55700191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f557be00640 1 -- 172.21.15.144:0/4168441515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55700b0040 con 0x7f55840af5f0 2024-09-12T12:21:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f557be00640 1 -- 172.21.15.144:0/4168441515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55700b4420 con 0x7f55840af5f0 2024-09-12T12:21:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558415dd50 con 0x7f55840af5f0 2024-09-12T12:21:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f557be00640 1 -- 172.21.15.144:0/4168441515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55700b4810 con 0x7f55840af5f0 2024-09-12T12:21:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55841558b0 con 0x7f55840af5f0 2024-09-12T12:21:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.235+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55840cdd70 con 0x7f55840af5f0 2024-09-12T12:21:14.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.239+0000 7f557be00640 1 -- 172.21.15.144:0/4168441515 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55700b49b0 con 0x7f55840af5f0 2024-09-12T12:21:14.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.239+0000 7f557be00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55640678c0 0x7f5564069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:14.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.239+0000 7f557be00640 1 -- 172.21.15.144:0/4168441515 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 6101+0+0 (secure 0 0 0) 0x7f557011fa60 con 0x7f55840af5f0 2024-09-12T12:21:14.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.239+0000 7f5583e00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55640678c0 0x7f5564069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:14.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.239+0000 7f5583e00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55640678c0 0x7f5564069d80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f558415a160 tx=0x7f5574009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:14.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.243+0000 7f557be00640 1 -- 172.21.15.144:0/4168441515 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5570016110 con 0x7f55840af5f0 2024-09-12T12:21:14.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:14.439+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f55840cc960 con 0x7f55840af5f0 2024-09-12T12:21:15.341 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-12T12:21:15.339+0000 7f4761000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:21:15.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.399+0000 7f557be00640 1 -- 172.21.15.144:0/4168441515 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v106) ==== 118+0+0 (secure 0 0 0) 0x7f55700f0400 con 0x7f55840af5f0 2024-09-12T12:21:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55640678c0 msgr2=0x7f5564069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55640678c0 0x7f5564069d80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f558415a160 tx=0x7f5574009040 comp rx=0 tx=0).stop 2024-09-12T12:21:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 msgr2=0x7f558415d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 0x7f558415d3e0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f55700ae040 tx=0x7f55700191a0 comp rx=0 tx=0).stop 2024-09-12T12:21:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 shutdown_connections 2024-09-12T12:21:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55640678c0 0x7f5564069d80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f558415c2e0 0x7f558415e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55840af5f0 0x7f558415d3e0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 --2- 172.21.15.144:0/4168441515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f558406c150 0x7f558413be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 >> 172.21.15.144:0/4168441515 conn(0x7f5584068030 msgr2=0x7f55840b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 shutdown_connections 2024-09-12T12:21:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.403+0000 7f558ac00640 1 -- 172.21.15.144:0/4168441515 wait complete. 2024-09-12T12:21:15.429 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:21:15.429 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:21:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.571+0000 7fc338e00640 1 Processor -- start 2024-09-12T12:21:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.571+0000 7fc338e00640 1 -- start start 2024-09-12T12:21:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc338e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc33406c320 0x7fc334165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc338e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3340b4300 con 0x7fc3340cd9f0 2024-09-12T12:21:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc338e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3340b3540 con 0x7fc33415af60 2024-09-12T12:21:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc338e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc3340b32f0 con 0x7fc33406c320 2024-09-12T12:21:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc331400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc3340cd9f0 0x7fc33406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54508/0 (socket says 172.21.15.144:54508) 2024-09-12T12:21:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc331400640 1 -- 172.21.15.144:0/2606009264 learned_addr learned my addr 172.21.15.144:0/2606009264 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:15.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc332800640 1 --2- 172.21.15.144:0/2606009264 >> v2:172.21.15.165:3300/0 conn(0x7fc33406c320 0x7fc334165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:15.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc330a00640 1 -- 172.21.15.144:0/2606009264 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937717218 0 0) 0x7fc3340b4300 con 0x7fc3340cd9f0 2024-09-12T12:21:15.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc330a00640 1 -- 172.21.15.144:0/2606009264 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc318003530 con 0x7fc3340cd9f0 2024-09-12T12:21:15.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc332800640 1 -- 172.21.15.144:0/2606009264 >> v1:172.21.15.165:6789/0 conn(0x7fc33415af60 legacy=0x7fc3340ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:15.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc332800640 1 -- 172.21.15.144:0/2606009264 >> v1:172.21.15.144:6789/0 conn(0x7fc3340cd9f0 legacy=0x7fc33406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:15.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc330a00640 1 -- 172.21.15.144:0/2606009264 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3483503557 0 0) 0x7fc318003530 con 0x7fc3340cd9f0 2024-09-12T12:21:15.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.575+0000 7fc332800640 1 -- 172.21.15.144:0/2606009264 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3340b3820 con 0x7fc33406c320 2024-09-12T12:21:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc332800640 1 --2- 172.21.15.144:0/2606009264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33406c320 0x7fc334165ef0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097c0 tx=0x7fc32c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b46aef10df41942b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc330a00640 1 -- 172.21.15.144:0/2606009264 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0b0070 con 0x7fc33406c320 2024-09-12T12:21:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc330a00640 1 -- 172.21.15.144:0/2606009264 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c0ab400 con 0x7fc33406c320 2024-09-12T12:21:15.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc330a00640 1 -- 172.21.15.144:0/2606009264 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c001680 con 0x7fc33406c320 2024-09-12T12:21:15.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc338e00640 1 -- 172.21.15.144:0/2606009264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33406c320 msgr2=0x7fc334165ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:15.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc338e00640 1 --2- 172.21.15.144:0/2606009264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33406c320 0x7fc334165ef0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097c0 tx=0x7fc32c01c3c0 comp rx=0 tx=0).stop 2024-09-12T12:21:15.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc338e00640 1 -- 172.21.15.144:0/2606009264 shutdown_connections 2024-09-12T12:21:15.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc338e00640 1 --2- 172.21.15.144:0/2606009264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc33406c320 0x7fc334165ef0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:15.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc338e00640 1 -- 172.21.15.144:0/2606009264 >> 172.21.15.144:0/2606009264 conn(0x7fc334068030 msgr2=0x7fc3340b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:15.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc338e00640 1 -- 172.21.15.144:0/2606009264 shutdown_connections 2024-09-12T12:21:15.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc338e00640 1 -- 172.21.15.144:0/2606009264 wait complete. 2024-09-12T12:21:15.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc338e00640 1 Processor -- start 2024-09-12T12:21:15.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.579+0000 7fc338e00640 1 -- start start 2024-09-12T12:21:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc338e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc33406c320 0x7fc334071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:15.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc338e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3340cd9f0 0x7fc334158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc338e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33415af60 0x7fc334144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc338e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc334168dd0 con 0x7fc33415af60 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc338e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc334168c50 con 0x7fc3340cd9f0 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc338e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc334168f50 con 0x7fc33406c320 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc332800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33415af60 0x7fc334144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc332800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33415af60 0x7fc334144fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37150/0 (socket says 172.21.15.144:37150) 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc332800640 1 -- 172.21.15.144:0/2173056282 learned_addr learned my addr 172.21.15.144:0/2173056282 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc331400640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3340cd9f0 0x7fc334158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc331e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc33406c320 0x7fc334071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc332800640 1 -- 172.21.15.144:0/2173056282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc33406c320 msgr2=0x7fc334071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc332800640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc33406c320 0x7fc334071620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc332800640 1 -- 172.21.15.144:0/2173056282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3340cd9f0 msgr2=0x7fc334158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:15.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc332800640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3340cd9f0 0x7fc334158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:15.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc332800640 1 -- 172.21.15.144:0/2173056282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33414cd10 con 0x7fc33415af60 2024-09-12T12:21:15.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc331e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc33406c320 0x7fc334071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:15.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc332800640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33415af60 0x7fc334144fc0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097c0 tx=0x7fc32c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:15.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc32a000640 1 -- 172.21.15.144:0/2173056282 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0bb070 con 0x7fc33415af60 2024-09-12T12:21:15.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc32a000640 1 -- 172.21.15.144:0/2173056282 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c004030 con 0x7fc33415af60 2024-09-12T12:21:15.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc32a000640 1 -- 172.21.15.144:0/2173056282 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0b0040 con 0x7fc33415af60 2024-09-12T12:21:15.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc334158d90 con 0x7fc33415af60 2024-09-12T12:21:15.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc334159350 con 0x7fc33415af60 2024-09-12T12:21:15.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33414cee0 con 0x7fc33415af60 2024-09-12T12:21:15.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.583+0000 7fc32a000640 1 -- 172.21.15.144:0/2173056282 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc32c003620 con 0x7fc33415af60 2024-09-12T12:21:15.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.587+0000 7fc32a000640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3100678c0 0x7fc310069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:15.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.587+0000 7fc32a000640 1 -- 172.21.15.144:0/2173056282 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fc32c11efa0 con 0x7fc33415af60 2024-09-12T12:21:15.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.587+0000 7fc331e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3100678c0 0x7fc310069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:15.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.587+0000 7fc331e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3100678c0 0x7fc310069d80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc324007fd0 tx=0x7fc324009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:15.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.591+0000 7fc32a000640 1 -- 172.21.15.144:0/2173056282 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc32c015fb0 con 0x7fc33415af60 2024-09-12T12:21:15.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:15.783+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc3340afc20 con 0x7fc33415af60 2024-09-12T12:21:16.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:21:16.221 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:21:16.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.407+0000 7fc32a000640 1 -- 172.21.15.144:0/2173056282 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v107) ==== 122+0+0 (secure 0 0 0) 0x7fc32c0ef8b0 con 0x7fc33415af60 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3100678c0 msgr2=0x7fc310069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3100678c0 0x7fc310069d80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc324007fd0 tx=0x7fc324009040 comp rx=0 tx=0).stop 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33415af60 msgr2=0x7fc334144fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33415af60 0x7fc334144fc0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097c0 tx=0x7fc32c019160 comp rx=0 tx=0).stop 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 shutdown_connections 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc3100678c0 0x7fc310069d80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc33415af60 0x7fc334144fc0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3340cd9f0 0x7fc334158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 --2- 172.21.15.144:0/2173056282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc33406c320 0x7fc334071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 >> 172.21.15.144:0/2173056282 conn(0x7fc334068030 msgr2=0x7fc33414ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:16.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 shutdown_connections 2024-09-12T12:21:16.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.411+0000 7fc338e00640 1 -- 172.21.15.144:0/2173056282 wait complete. 2024-09-12T12:21:16.434 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:21:16.434 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:16.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.571+0000 7f27ac000640 1 Processor -- start 2024-09-12T12:21:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.571+0000 7f27ac000640 1 -- start start 2024-09-12T12:21:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27ac000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f27a40b5fb0 0x7f27a4167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27ac000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27a40cd870 con 0x7f27a415cd30 2024-09-12T12:21:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27ac000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27a40cdb50 con 0x7f27a415c7b0 2024-09-12T12:21:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27ac000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f27a4072a50 con 0x7f27a40b5fb0 2024-09-12T12:21:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27a8c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f27a415cd30 0x7f27a40b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54518/0 (socket says 172.21.15.144:54518) 2024-09-12T12:21:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27a8c00640 1 -- 172.21.15.144:0/2763736267 learned_addr learned my addr 172.21.15.144:0/2763736267 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27aa000640 1 --2- 172.21.15.144:0/2763736267 >> v2:172.21.15.165:3300/0 conn(0x7f27a40b5fb0 0x7f27a4167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27a3e00640 1 -- 172.21.15.144:0/2763736267 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921899140 0 0) 0x7f27a40cd870 con 0x7f27a415cd30 2024-09-12T12:21:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27a3e00640 1 -- 172.21.15.144:0/2763736267 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f278c003530 con 0x7f27a415cd30 2024-09-12T12:21:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27aa000640 1 -- 172.21.15.144:0/2763736267 >> v1:172.21.15.165:6789/0 conn(0x7f27a415c7b0 legacy=0x7f27a40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27aa000640 1 -- 172.21.15.144:0/2763736267 >> v1:172.21.15.144:6789/0 conn(0x7f27a415cd30 legacy=0x7f27a40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.575+0000 7f27aa000640 1 -- 172.21.15.144:0/2763736267 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a40726e0 con 0x7f27a40b5fb0 2024-09-12T12:21:16.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27aa000640 1 --2- 172.21.15.144:0/2763736267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27a40b5fb0 0x7f27a4167310 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f279c0097c0 tx=0x7f279c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dd7c7500b5f35a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:16.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27a3e00640 1 -- 172.21.15.144:0/2763736267 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0b0070 con 0x7f27a40b5fb0 2024-09-12T12:21:16.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27a3e00640 1 -- 172.21.15.144:0/2763736267 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279c0ab600 con 0x7f27a40b5fb0 2024-09-12T12:21:16.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27a3e00640 1 -- 172.21.15.144:0/2763736267 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0ab9d0 con 0x7f27a40b5fb0 2024-09-12T12:21:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 -- 172.21.15.144:0/2763736267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27a40b5fb0 msgr2=0x7f27a4167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 --2- 172.21.15.144:0/2763736267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27a40b5fb0 0x7f27a4167310 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f279c0097c0 tx=0x7f279c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 -- 172.21.15.144:0/2763736267 shutdown_connections 2024-09-12T12:21:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 --2- 172.21.15.144:0/2763736267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27a40b5fb0 0x7f27a4167310 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 -- 172.21.15.144:0/2763736267 >> 172.21.15.144:0/2763736267 conn(0x7f27a406d0d0 msgr2=0x7f27a406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 -- 172.21.15.144:0/2763736267 shutdown_connections 2024-09-12T12:21:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 -- 172.21.15.144:0/2763736267 wait complete. 2024-09-12T12:21:16.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 Processor -- start 2024-09-12T12:21:16.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 -- start start 2024-09-12T12:21:16.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27a40b5fb0 0x7f27a414b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27a415c7b0 0x7f27a4152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a415cd30 0x7f27a4151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f27a416a690 con 0x7f27a415cd30 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f27a40cd610 con 0x7f27a40b5fb0 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.579+0000 7f27ac000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f27a416a810 con 0x7f27a415c7b0 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27aa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a415cd30 0x7f27a4151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27aa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a415cd30 0x7f27a4151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37154/0 (socket says 172.21.15.144:37154) 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27aa000640 1 -- 172.21.15.144:0/1954551283 learned_addr learned my addr 172.21.15.144:0/1954551283 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27a9600640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27a40b5fb0 0x7f27a414b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27a8c00640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27a415c7b0 0x7f27a4152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27aa000640 1 -- 172.21.15.144:0/1954551283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27a415c7b0 msgr2=0x7f27a4152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27aa000640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27a415c7b0 0x7f27a4152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27aa000640 1 -- 172.21.15.144:0/1954551283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27a40b5fb0 msgr2=0x7f27a414b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27aa000640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27a40b5fb0 0x7f27a414b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27aa000640 1 -- 172.21.15.144:0/1954551283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a414b560 con 0x7f27a415cd30 2024-09-12T12:21:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27aa000640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a415cd30 0x7f27a4151770 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f279c01a0d0 tx=0x7f279c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27a1600640 1 -- 172.21.15.144:0/1954551283 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0b0040 con 0x7f27a415cd30 2024-09-12T12:21:16.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27a1600640 1 -- 172.21.15.144:0/1954551283 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279c0b9070 con 0x7f27a415cd30 2024-09-12T12:21:16.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a4154ea0 con 0x7f27a415cd30 2024-09-12T12:21:16.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27a1600640 1 -- 172.21.15.144:0/1954551283 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0aa970 con 0x7f27a415cd30 2024-09-12T12:21:16.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a4155460 con 0x7f27a415cd30 2024-09-12T12:21:16.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a4167550 con 0x7f27a415cd30 2024-09-12T12:21:16.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27a1600640 1 -- 172.21.15.144:0/1954551283 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f279c0aab10 con 0x7f27a415cd30 2024-09-12T12:21:16.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27a1600640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27840678c0 0x7f2784069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.583+0000 7f27a1600640 1 -- 172.21.15.144:0/1954551283 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f279c11fe80 con 0x7f27a415cd30 2024-09-12T12:21:16.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.587+0000 7f27a9600640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27840678c0 0x7f2784069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.587+0000 7f27a9600640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27840678c0 0x7f2784069d80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f27a40cf040 tx=0x7f2798009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:16.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.587+0000 7f27a1600640 1 -- 172.21.15.144:0/1954551283 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f279c016090 con 0x7f27a415cd30 2024-09-12T12:21:16.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27a4160b50 con 0x7f27a415cd30 2024-09-12T12:21:16.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27a1600640 1 -- 172.21.15.144:0/1954551283 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7f279c0f0150 con 0x7f27a415cd30 2024-09-12T12:21:16.779 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:16.779 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:16.779 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27840678c0 msgr2=0x7f2784069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27840678c0 0x7f2784069d80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f27a40cf040 tx=0x7f2798009040 comp rx=0 tx=0).stop 2024-09-12T12:21:16.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a415cd30 msgr2=0x7f27a4151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a415cd30 0x7f27a4151770 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f279c01a0d0 tx=0x7f279c019240 comp rx=0 tx=0).stop 2024-09-12T12:21:16.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 shutdown_connections 2024-09-12T12:21:16.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27840678c0 0x7f2784069d80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27a415cd30 0x7f27a4151770 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27a415c7b0 0x7f27a4152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 --2- 172.21.15.144:0/1954551283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27a40b5fb0 0x7f27a414b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 >> 172.21.15.144:0/1954551283 conn(0x7f27a406d0d0 msgr2=0x7f27a40b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:16.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 shutdown_connections 2024-09-12T12:21:16.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.779+0000 7f27ac000640 1 -- 172.21.15.144:0/1954551283 wait complete. 2024-09-12T12:21:16.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:21:16.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f6923200640 1 Processor -- start 2024-09-12T12:21:16.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f6923200640 1 -- start start 2024-09-12T12:21:16.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f6923200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f691c15b4e0 0x7f691c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f6923200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f691c0b3ad0 0x7f691c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f6923200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691c0b45a0 con 0x7f691c071960 2024-09-12T12:21:16.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f6923200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f691c0b3fe0 con 0x7f691c15b4e0 2024-09-12T12:21:16.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f6923200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f691c0b42c0 con 0x7f691c0b3ad0 2024-09-12T12:21:16.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f691be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f691c15b4e0 0x7f691c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f691be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f691c15b4e0 0x7f691c0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37170/0 (socket says 172.21.15.144:37170) 2024-09-12T12:21:16.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.935+0000 7f691be00640 1 -- 172.21.15.144:0/2879738492 learned_addr learned my addr 172.21.15.144:0/2879738492 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:16.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691be00640 1 -- 172.21.15.144:0/2879738492 >> v2:172.21.15.165:3300/0 conn(0x7f691c0b3ad0 msgr2=0x7f691c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:16.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691b400640 1 --2- 172.21.15.144:0/2879738492 >> v2:172.21.15.165:3300/0 conn(0x7f691c0b3ad0 0x7f691c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691be00640 1 --2- 172.21.15.144:0/2879738492 >> v2:172.21.15.165:3300/0 conn(0x7f691c0b3ad0 0x7f691c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691be00640 1 -- 172.21.15.144:0/2879738492 >> v1:172.21.15.165:6789/0 conn(0x7f691c071960 legacy=0x7f691c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:16.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691be00640 1 -- 172.21.15.144:0/2879738492 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c0b1490 con 0x7f691c15b4e0 2024-09-12T12:21:16.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691b400640 1 --2- 172.21.15.144:0/2879738492 >> v2:172.21.15.165:3300/0 conn(0x7f691c0b3ad0 0x7f691c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:16.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691be00640 1 --2- 172.21.15.144:0/2879738492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c15b4e0 0x7f691c0b3590 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f691c0b02b0 tx=0x7f690c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d114944cf7d9ac36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:16.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691aa00640 1 -- 172.21.15.144:0/2879738492 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c0aa430 con 0x7f691c15b4e0 2024-09-12T12:21:16.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691aa00640 1 -- 172.21.15.144:0/2879738492 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690c0af070 con 0x7f691c15b4e0 2024-09-12T12:21:16.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.939+0000 7f691aa00640 1 -- 172.21.15.144:0/2879738492 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c0aa7f0 con 0x7f691c15b4e0 2024-09-12T12:21:16.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 -- 172.21.15.144:0/2879738492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c15b4e0 msgr2=0x7f691c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 --2- 172.21.15.144:0/2879738492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c15b4e0 0x7f691c0b3590 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f691c0b02b0 tx=0x7f690c01c4b0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 -- 172.21.15.144:0/2879738492 shutdown_connections 2024-09-12T12:21:16.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 --2- 172.21.15.144:0/2879738492 >> v2:172.21.15.165:3300/0 conn(0x7f691c0b3ad0 0x7f691c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 --2- 172.21.15.144:0/2879738492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c15b4e0 0x7f691c0b3590 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 -- 172.21.15.144:0/2879738492 >> 172.21.15.144:0/2879738492 conn(0x7f691c06d0d0 msgr2=0x7f691c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:16.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 -- 172.21.15.144:0/2879738492 shutdown_connections 2024-09-12T12:21:16.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 -- 172.21.15.144:0/2879738492 wait complete. 2024-09-12T12:21:16.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 Processor -- start 2024-09-12T12:21:16.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 -- start start 2024-09-12T12:21:16.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c071960 0x7f691c140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f691c0b3ad0 0x7f691c15d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f691c15b4e0 0x7f691c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f691c0b2620 con 0x7f691c071960 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f691c0b24a0 con 0x7f691c0b3ad0 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6923200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f691c0cd640 con 0x7f691c15b4e0 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c071960 0x7f691c140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c071960 0x7f691c140f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37184/0 (socket says 172.21.15.144:37184) 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691be00640 1 -- 172.21.15.144:0/376882222 learned_addr learned my addr 172.21.15.144:0/376882222 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691b400640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f691c0b3ad0 0x7f691c15d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6921200640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f691c15b4e0 0x7f691c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691be00640 1 -- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f691c15b4e0 msgr2=0x7f691c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691be00640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f691c15b4e0 0x7f691c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691be00640 1 -- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f691c0b3ad0 msgr2=0x7f691c15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:16.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691be00640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f691c0b3ad0 0x7f691c15d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:16.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691be00640 1 -- 172.21.15.144:0/376882222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c15bc70 con 0x7f691c071960 2024-09-12T12:21:16.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691b400640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f691c0b3ad0 0x7f691c15d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:16.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6921200640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f691c15b4e0 0x7f691c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:16.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f691be00640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c071960 0x7f691c140f80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f690c01ab60 tx=0x7f690c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:16.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.943+0000 7f6913e00640 1 -- 172.21.15.144:0/376882222 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c0b3800 con 0x7f691c071960 2024-09-12T12:21:16.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.947+0000 7f6913e00640 1 -- 172.21.15.144:0/376882222 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690c0b39c0 con 0x7f691c071960 2024-09-12T12:21:16.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.947+0000 7f6913e00640 1 -- 172.21.15.144:0/376882222 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c0b3db0 con 0x7f691c071960 2024-09-12T12:21:16.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.947+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691c15bf50 con 0x7f691c071960 2024-09-12T12:21:16.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.947+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f691c15c510 con 0x7f691c071960 2024-09-12T12:21:16.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.947+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691c071420 con 0x7f691c071960 2024-09-12T12:21:16.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.947+0000 7f6913e00640 1 -- 172.21.15.144:0/376882222 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f690c0b2380 con 0x7f691c071960 2024-09-12T12:21:16.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.947+0000 7f6913e00640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68fc0678f0 0x7f68fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:16.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.947+0000 7f6913e00640 1 -- 172.21.15.144:0/376882222 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f690c11fca0 con 0x7f691c071960 2024-09-12T12:21:16.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.947+0000 7f691b400640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68fc0678f0 0x7f68fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:16.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.951+0000 7f691b400640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68fc0678f0 0x7f68fc069db0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6908006fd0 tx=0x7f6908008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:16.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:16.951+0000 7f6913e00640 1 -- 172.21.15.144:0/376882222 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f690c0160d0 con 0x7f691c071960 2024-09-12T12:21:17.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.111+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f691c0b62b0 con 0x7f691c071960 2024-09-12T12:21:17.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.111+0000 7f6913e00640 1 -- 172.21.15.144:0/376882222 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16984 (secure 0 0 0) 0x7f690c0eff50 con 0x7f691c071960 2024-09-12T12:21:17.114 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:17.114 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":140,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:21:14.364804+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:21:10.454030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-12T12:21:11.747676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:21:17.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68fc0678f0 msgr2=0x7f68fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68fc0678f0 0x7f68fc069db0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6908006fd0 tx=0x7f6908008040 comp rx=0 tx=0).stop 2024-09-12T12:21:17.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c071960 msgr2=0x7f691c140f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c071960 0x7f691c140f80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f690c01ab60 tx=0x7f690c01acf0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 shutdown_connections 2024-09-12T12:21:17.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68fc0678f0 0x7f68fc069db0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f691c15b4e0 0x7f691c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f691c0b3ad0 0x7f691c15d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 --2- 172.21.15.144:0/376882222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f691c071960 0x7f691c140f80 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 >> 172.21.15.144:0/376882222 conn(0x7f691c06d0d0 msgr2=0x7f691c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:17.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 shutdown_connections 2024-09-12T12:21:17.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.115+0000 7f6923200640 1 -- 172.21.15.144:0/376882222 wait complete. 2024-09-12T12:21:17.136 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:21:17.136 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:21:17.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc3a800640 1 Processor -- start 2024-09-12T12:21:17.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc3a800640 1 -- start start 2024-09-12T12:21:17.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc3a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 0x7fbc340717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc3a800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc340b54a0 con 0x7fbc3415e600 2024-09-12T12:21:17.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc3a800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc340b5780 con 0x7fbc340afab0 2024-09-12T12:21:17.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc3a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc340b5270 con 0x7fbc3406f020 2024-09-12T12:21:17.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc33400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbc3415e600 0x7fbc3406e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52842/0 (socket says 172.21.15.144:52842) 2024-09-12T12:21:17.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc33400640 1 -- 172.21.15.144:0/61494243 learned_addr learned my addr 172.21.15.144:0/61494243 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc32a00640 1 --2- 172.21.15.144:0/61494243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 0x7fbc340717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc32000640 1 -- 172.21.15.144:0/61494243 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128006018 0 0) 0x7fbc340b54a0 con 0x7fbc3415e600 2024-09-12T12:21:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc32000640 1 -- 172.21.15.144:0/61494243 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc18003530 con 0x7fbc3415e600 2024-09-12T12:21:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc32000640 1 -- 172.21.15.144:0/61494243 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186621083 0 0) 0x7fbc340b5780 con 0x7fbc340afab0 2024-09-12T12:21:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc32000640 1 -- 172.21.15.144:0/61494243 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc340b54a0 con 0x7fbc340afab0 2024-09-12T12:21:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc32000640 1 -- 172.21.15.144:0/61494243 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1041860896 0 0) 0x7fbc18003530 con 0x7fbc3415e600 2024-09-12T12:21:17.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc32a00640 1 -- 172.21.15.144:0/61494243 >> v1:172.21.15.165:6789/0 conn(0x7fbc340afab0 legacy=0x7fbc340b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc32a00640 1 -- 172.21.15.144:0/61494243 >> v1:172.21.15.144:6789/0 conn(0x7fbc3415e600 legacy=0x7fbc3406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.271+0000 7fbc32a00640 1 -- 172.21.15.144:0/61494243 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc340b5a60 con 0x7fbc3406f020 2024-09-12T12:21:17.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.275+0000 7fbc32a00640 1 --2- 172.21.15.144:0/61494243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 0x7fbc340717f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbc200097f0 tx=0x7fbc2001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e6ccc27b7ed457d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:17.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.275+0000 7fbc32000640 1 -- 172.21.15.144:0/61494243 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc200b0070 con 0x7fbc3406f020 2024-09-12T12:21:17.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.275+0000 7fbc32000640 1 -- 172.21.15.144:0/61494243 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc200ab400 con 0x7fbc3406f020 2024-09-12T12:21:17.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.275+0000 7fbc32000640 1 -- 172.21.15.144:0/61494243 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24001a00 con 0x7fbc3406f020 2024-09-12T12:21:17.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.275+0000 7fbc3a800640 1 -- 172.21.15.144:0/61494243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 msgr2=0x7fbc340717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.275+0000 7fbc3a800640 1 --2- 172.21.15.144:0/61494243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 0x7fbc340717f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbc200097f0 tx=0x7fbc2001c400 comp rx=0 tx=0).stop 2024-09-12T12:21:17.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.275+0000 7fbc3a800640 1 -- 172.21.15.144:0/61494243 shutdown_connections 2024-09-12T12:21:17.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.275+0000 7fbc3a800640 1 --2- 172.21.15.144:0/61494243 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 0x7fbc340717f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.275+0000 7fbc3a800640 1 -- 172.21.15.144:0/61494243 >> 172.21.15.144:0/61494243 conn(0x7fbc3406ddf0 msgr2=0x7fbc3406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:17.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 -- 172.21.15.144:0/61494243 shutdown_connections 2024-09-12T12:21:17.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 -- 172.21.15.144:0/61494243 wait complete. 2024-09-12T12:21:17.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 Processor -- start 2024-09-12T12:21:17.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 -- start start 2024-09-12T12:21:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 0x7fbc34155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc340afab0 0x7fbc341519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc3415e600 0x7fbc340b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3416cbd0 con 0x7fbc3415e600 2024-09-12T12:21:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3416ca50 con 0x7fbc340afab0 2024-09-12T12:21:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3416cd50 con 0x7fbc3406f020 2024-09-12T12:21:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc3415e600 0x7fbc340b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc3415e600 0x7fbc340b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47312/0 (socket says 172.21.15.144:47312) 2024-09-12T12:21:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33e00640 1 -- 172.21.15.144:0/3686542577 learned_addr learned my addr 172.21.15.144:0/3686542577 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33400640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 0x7fbc34155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc32a00640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc340afab0 0x7fbc341519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33e00640 1 -- 172.21.15.144:0/3686542577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 msgr2=0x7fbc34155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33e00640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 0x7fbc34155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33e00640 1 -- 172.21.15.144:0/3686542577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc340afab0 msgr2=0x7fbc341519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33e00640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc340afab0 0x7fbc341519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33e00640 1 -- 172.21.15.144:0/3686542577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc34155640 con 0x7fbc3415e600 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc32a00640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc340afab0 0x7fbc341519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc33e00640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc3415e600 0x7fbc340b11e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c390 tx=0x7fbc2c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc2b400640 1 -- 172.21.15.144:0/3686542577 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c017070 con 0x7fbc3415e600 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc2b400640 1 -- 172.21.15.144:0/3686542577 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2c0052d0 con 0x7fbc3415e600 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc2b400640 1 -- 172.21.15.144:0/3686542577 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c0054c0 con 0x7fbc3415e600 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc340cefb0 con 0x7fbc3415e600 2024-09-12T12:21:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.279+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc34152620 con 0x7fbc3415e600 2024-09-12T12:21:17.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.283+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc340717f0 con 0x7fbc3415e600 2024-09-12T12:21:17.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.283+0000 7fbc2b400640 1 -- 172.21.15.144:0/3686542577 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc2c01a070 con 0x7fbc3415e600 2024-09-12T12:21:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.283+0000 7fbc2b400640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc140678f0 0x7fbc14069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.283+0000 7fbc2b400640 1 -- 172.21.15.144:0/3686542577 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fbc2c084fe0 con 0x7fbc3415e600 2024-09-12T12:21:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.283+0000 7fbc33400640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc140678f0 0x7fbc14069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.283+0000 7fbc33400640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc140678f0 0x7fbc14069db0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbc24001570 tx=0x7fbc24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:17.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.287+0000 7fbc2b400640 1 -- 172.21.15.144:0/3686542577 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbc2c055370 con 0x7fbc3415e600 2024-09-12T12:21:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.443+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc3414ac90 con 0x7fbc140678f0 2024-09-12T12:21:17.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.447+0000 7fbc2b400640 1 -- 172.21.15.144:0/3686542577 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252453 (secure 0 0 0) 0x7fbc3414ac90 con 0x7fbc140678f0 2024-09-12T12:21:17.453 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:17.454 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:21:17.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc140678f0 msgr2=0x7fbc14069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc140678f0 0x7fbc14069db0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbc24001570 tx=0x7fbc24009040 comp rx=0 tx=0).stop 2024-09-12T12:21:17.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc3415e600 msgr2=0x7fbc340b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc3415e600 0x7fbc340b11e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c390 tx=0x7fbc2c00c850 comp rx=0 tx=0).stop 2024-09-12T12:21:17.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 shutdown_connections 2024-09-12T12:21:17.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc140678f0 0x7fbc14069db0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc3415e600 0x7fbc340b11e0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc340afab0 0x7fbc341519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 --2- 172.21.15.144:0/3686542577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc3406f020 0x7fbc34155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 >> 172.21.15.144:0/3686542577 conn(0x7fbc3406ddf0 msgr2=0x7fbc3415bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:17.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 shutdown_connections 2024-09-12T12:21:17.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.451+0000 7fbc3a800640 1 -- 172.21.15.144:0/3686542577 wait complete. 2024-09-12T12:21:17.473 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-09-12T12:21:15.485098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":394832,"kb_used_data":14792,"kb_used_omap":12,"kb_used_meta":379827,"kb_avail":754579888,"statfs":{"total":773094113280,"available":772689805312,"internally_reserved":0,"allocated":15147008,"data_stored":7730244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":388943409},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.131033"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467822+0000","last_change":"2024-09-12T12:21:13.399898+0000","last_active":"2024-09-12T12:21:14.467822+0000","last_peered":"2024-09-12T12:21:14.467822+0000","last_clean":"2024-09-12T12:21:14.467822+0000","last_became_active":"2024-09-12T12:21:13.398311+0000","last_became_peered":"2024-09-12T12:21:13.398311+0000","last_unstale":"2024-09-12T12:21:14.467822+0000","last_undegraded":"2024-09-12T12:21:14.467822+0000","last_fullsized":"2024-09-12T12:21:14.467822+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:28.433436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.392952+0000","last_change":"2024-09-12T12:21:13.388907+0000","last_active":"2024-09-12T12:21:13.392952+0000","last_peered":"2024-09-12T12:21:13.392952+0000","last_clean":"2024-09-12T12:21:13.392952+0000","last_became_active":"2024-09-12T12:21:13.388630+0000","last_became_peered":"2024-09-12T12:21:13.388630+0000","last_unstale":"2024-09-12T12:21:13.392952+0000","last_undegraded":"2024-09-12T12:21:13.392952+0000","last_fullsized":"2024-09-12T12:21:13.392952+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:42.339330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371106+0000","last_change":"2024-09-12T12:21:13.381636+0000","last_active":"2024-09-12T12:21:14.371106+0000","last_peered":"2024-09-12T12:21:14.371106+0000","last_clean":"2024-09-12T12:21:14.371106+0000","last_became_active":"2024-09-12T12:21:13.381305+0000","last_became_peered":"2024-09-12T12:21:13.381305+0000","last_unstale":"2024-09-12T12:21:14.371106+0000","last_undegraded":"2024-09-12T12:21:14.371106+0000","last_fullsized":"2024-09-12T12:21:14.371106+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:26.348036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.395496+0000","last_change":"2024-09-12T12:21:13.391915+0000","last_active":"2024-09-12T12:21:13.395496+0000","last_peered":"2024-09-12T12:21:13.395496+0000","last_clean":"2024-09-12T12:21:13.395496+0000","last_became_active":"2024-09-12T12:21:13.391649+0000","last_became_peered":"2024-09-12T12:21:13.391649+0000","last_unstale":"2024-09-12T12:21:13.395496+0000","last_undegraded":"2024-09-12T12:21:13.395496+0000","last_fullsized":"2024-09-12T12:21:13.395496+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:14:09.804903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.392745+0000","last_change":"2024-09-12T12:21:13.389041+0000","last_active":"2024-09-12T12:21:13.392745+0000","last_peered":"2024-09-12T12:21:13.392745+0000","last_clean":"2024-09-12T12:21:13.392745+0000","last_became_active":"2024-09-12T12:21:13.388784+0000","last_became_peered":"2024-09-12T12:21:13.388784+0000","last_unstale":"2024-09-12T12:21:13.392745+0000","last_undegraded":"2024-09-12T12:21:13.392745+0000","last_fullsized":"2024-09-12T12:21:13.392745+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:56.929518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369025+0000","last_change":"2024-09-12T12:21:13.381047+0000","last_active":"2024-09-12T12:21:14.369025+0000","last_peered":"2024-09-12T12:21:14.369025+0000","last_clean":"2024-09-12T12:21:14.369025+0000","last_became_active":"2024-09-12T12:21:13.380777+0000","last_became_peered":"2024-09-12T12:21:13.380777+0000","last_unstale":"2024-09-12T12:21:14.369025+0000","last_undegraded":"2024-09-12T12:21:14.369025+0000","last_fullsized":"2024-09-12T12:21:14.369025+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.454252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.396448+0000","last_change":"2024-09-12T12:21:13.392806+0000","last_active":"2024-09-12T12:21:13.396448+0000","last_peered":"2024-09-12T12:21:13.396448+0000","last_clean":"2024-09-12T12:21:13.396448+0000","last_became_active":"2024-09-12T12:21:13.390785+0000","last_became_peered":"2024-09-12T12:21:13.390785+0000","last_unstale":"2024-09-12T12:21:13.396448+0000","last_undegraded":"2024-09-12T12:21:13.396448+0000","last_fullsized":"2024-09-12T12:21:13.396448+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370634+0000","last_change":"2024-09-12T12:21:13.402925+0000","last_active":"2024-09-12T12:21:14.370634+0000","last_peered":"2024-09-12T12:21:14.370634+0000","last_clean":"2024-09-12T12:21:14.370634+0000","last_became_active":"2024-09-12T12:21:13.402634+0000","last_became_peered":"2024-09-12T12:21:13.402634+0000","last_unstale":"2024-09-12T12:21:14.370634+0000","last_undegraded":"2024-09-12T12:21:14.370634+0000","last_fullsized":"2024-09-12T12:21:14.370634+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:08.075425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369621+0000","last_change":"2024-09-12T12:21:13.388248+0000","last_active":"2024-09-12T12:21:14.369621+0000","last_peered":"2024-09-12T12:21:14.369621+0000","last_clean":"2024-09-12T12:21:14.369621+0000","last_became_active":"2024-09-12T12:21:13.387795+0000","last_became_peered":"2024-09-12T12:21:13.387795+0000","last_unstale":"2024-09-12T12:21:14.369621+0000","last_undegraded":"2024-09-12T12:21:14.369621+0000","last_fullsized":"2024-09-12T12:21:14.369621+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.398689+0000","last_change":"2024-09-12T12:21:13.388353+0000","last_active":"2024-09-12T12:21:13.398689+0000","last_peered":"2024-09-12T12:21:13.398689+0000","last_clean":"2024-09-12T12:21:13.398689+0000","last_became_active":"2024-09-12T12:21:13.388043+0000","last_became_peered":"2024-09-12T12:21:13.388043+0000","last_unstale":"2024-09-12T12:21:13.398689+0000","last_undegraded":"2024-09-12T12:21:13.398689+0000","last_fullsized":"2024-09-12T12:21:13.398689+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:00.157866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.392498+0000","last_change":"2024-09-12T12:21:13.389038+0000","last_active":"2024-09-12T12:21:13.392498+0000","last_peered":"2024-09-12T12:21:13.392498+0000","last_clean":"2024-09-12T12:21:13.392498+0000","last_became_active":"2024-09-12T12:21:13.388756+0000","last_became_peered":"2024-09-12T12:21:13.388756+0000","last_unstale":"2024-09-12T12:21:13.392498+0000","last_undegraded":"2024-09-12T12:21:13.392498+0000","last_fullsized":"2024-09-12T12:21:13.392498+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:24.155582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467820+0000","last_change":"2024-09-12T12:21:13.396187+0000","last_active":"2024-09-12T12:21:14.467820+0000","last_peered":"2024-09-12T12:21:14.467820+0000","last_clean":"2024-09-12T12:21:14.467820+0000","last_became_active":"2024-09-12T12:21:13.395842+0000","last_became_peered":"2024-09-12T12:21:13.395842+0000","last_unstale":"2024-09-12T12:21:14.467820+0000","last_undegraded":"2024-09-12T12:21:14.467820+0000","last_fullsized":"2024-09-12T12:21:14.467820+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:05:26.084267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369179+0000","last_change":"2024-09-12T12:21:13.379512+0000","last_active":"2024-09-12T12:21:14.369179+0000","last_peered":"2024-09-12T12:21:14.369179+0000","last_clean":"2024-09-12T12:21:14.369179+0000","last_became_active":"2024-09-12T12:21:13.379211+0000","last_became_peered":"2024-09-12T12:21:13.379211+0000","last_unstale":"2024-09-12T12:21:14.369179+0000","last_undegraded":"2024-09-12T12:21:14.369179+0000","last_fullsized":"2024-09-12T12:21:14.369179+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:50:17.960949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467597+0000","last_change":"2024-09-12T12:21:13.392910+0000","last_active":"2024-09-12T12:21:14.467597+0000","last_peered":"2024-09-12T12:21:14.467597+0000","last_clean":"2024-09-12T12:21:14.467597+0000","last_became_active":"2024-09-12T12:21:13.392239+0000","last_became_peered":"2024-09-12T12:21:13.392239+0000","last_unstale":"2024-09-12T12:21:14.467597+0000","last_undegraded":"2024-09-12T12:21:14.467597+0000","last_fullsized":"2024-09-12T12:21:14.467597+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:05.008529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467518+0000","last_change":"2024-09-12T12:21:13.397559+0000","last_active":"2024-09-12T12:21:14.467518+0000","last_peered":"2024-09-12T12:21:14.467518+0000","last_clean":"2024-09-12T12:21:14.467518+0000","last_became_active":"2024-09-12T12:21:13.396710+0000","last_became_peered":"2024-09-12T12:21:13.396710+0000","last_unstale":"2024-09-12T12:21:14.467518+0000","last_undegraded":"2024-09-12T12:21:14.467518+0000","last_fullsized":"2024-09-12T12:21:14.467518+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:31.120920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368670+0000","last_change":"2024-09-12T12:21:13.390406+0000","last_active":"2024-09-12T12:21:14.368670+0000","last_peered":"2024-09-12T12:21:14.368670+0000","last_clean":"2024-09-12T12:21:14.368670+0000","last_became_active":"2024-09-12T12:21:13.390089+0000","last_became_peered":"2024-09-12T12:21:13.390089+0000","last_unstale":"2024-09-12T12:21:14.368670+0000","last_undegraded":"2024-09-12T12:21:14.368670+0000","last_fullsized":"2024-09-12T12:21:14.368670+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:39.829364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369664+0000","last_change":"2024-09-12T12:21:13.392177+0000","last_active":"2024-09-12T12:21:14.369664+0000","last_peered":"2024-09-12T12:21:14.369664+0000","last_clean":"2024-09-12T12:21:14.369664+0000","last_became_active":"2024-09-12T12:21:13.389401+0000","last_became_peered":"2024-09-12T12:21:13.389401+0000","last_unstale":"2024-09-12T12:21:14.369664+0000","last_undegraded":"2024-09-12T12:21:14.369664+0000","last_fullsized":"2024-09-12T12:21:14.369664+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:55.636749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.393273+0000","last_change":"2024-09-12T12:21:13.389660+0000","last_active":"2024-09-12T12:21:13.393273+0000","last_peered":"2024-09-12T12:21:13.393273+0000","last_clean":"2024-09-12T12:21:13.393273+0000","last_became_active":"2024-09-12T12:21:13.389388+0000","last_became_peered":"2024-09-12T12:21:13.389388+0000","last_unstale":"2024-09-12T12:21:13.393273+0000","last_undegraded":"2024-09-12T12:21:13.393273+0000","last_fullsized":"2024-09-12T12:21:13.393273+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:30:27.388416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.396528+0000","last_change":"2024-09-12T12:21:13.393188+0000","last_active":"2024-09-12T12:21:13.396528+0000","last_peered":"2024-09-12T12:21:13.396528+0000","last_clean":"2024-09-12T12:21:13.396528+0000","last_became_active":"2024-09-12T12:21:13.392343+0000","last_became_peered":"2024-09-12T12:21:13.392343+0000","last_unstale":"2024-09-12T12:21:13.396528+0000","last_undegraded":"2024-09-12T12:21:13.396528+0000","last_fullsized":"2024-09-12T12:21:13.396528+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:55.636749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.388770+0000","last_change":"2024-09-12T12:21:13.382442+0000","last_active":"2024-09-12T12:21:13.388770+0000","last_peered":"2024-09-12T12:21:13.388770+0000","last_clean":"2024-09-12T12:21:13.388770+0000","last_became_active":"2024-09-12T12:21:13.382135+0000","last_became_peered":"2024-09-12T12:21:13.382135+0000","last_unstale":"2024-09-12T12:21:13.388770+0000","last_undegraded":"2024-09-12T12:21:13.388770+0000","last_fullsized":"2024-09-12T12:21:13.388770+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:55.224628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.385211+0000","last_change":"2024-09-12T12:21:13.383430+0000","last_active":"2024-09-12T12:21:13.385211+0000","last_peered":"2024-09-12T12:21:13.385211+0000","last_clean":"2024-09-12T12:21:13.385211+0000","last_became_active":"2024-09-12T12:21:13.380958+0000","last_became_peered":"2024-09-12T12:21:13.380958+0000","last_unstale":"2024-09-12T12:21:13.385211+0000","last_undegraded":"2024-09-12T12:21:13.385211+0000","last_fullsized":"2024-09-12T12:21:13.385211+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:28.608303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467530+0000","last_change":"2024-09-12T12:21:13.395860+0000","last_active":"2024-09-12T12:21:14.467530+0000","last_peered":"2024-09-12T12:21:14.467530+0000","last_clean":"2024-09-12T12:21:14.467530+0000","last_became_active":"2024-09-12T12:21:13.395535+0000","last_became_peered":"2024-09-12T12:21:13.395535+0000","last_unstale":"2024-09-12T12:21:14.467530+0000","last_undegraded":"2024-09-12T12:21:14.467530+0000","last_fullsized":"2024-09-12T12:21:14.467530+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:16.578380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.387708+0000","last_change":"2024-09-12T12:21:13.385067+0000","last_active":"2024-09-12T12:21:13.387708+0000","last_peered":"2024-09-12T12:21:13.387708+0000","last_clean":"2024-09-12T12:21:13.387708+0000","last_became_active":"2024-09-12T12:21:13.384492+0000","last_became_peered":"2024-09-12T12:21:13.384492+0000","last_unstale":"2024-09-12T12:21:13.387708+0000","last_undegraded":"2024-09-12T12:21:13.387708+0000","last_fullsized":"2024-09-12T12:21:13.387708+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:08.075425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368740+0000","last_change":"2024-09-12T12:21:13.385768+0000","last_active":"2024-09-12T12:21:14.368740+0000","last_peered":"2024-09-12T12:21:14.368740+0000","last_clean":"2024-09-12T12:21:14.368740+0000","last_became_active":"2024-09-12T12:21:13.384894+0000","last_became_peered":"2024-09-12T12:21:13.384894+0000","last_unstale":"2024-09-12T12:21:14.368740+0000","last_undegraded":"2024-09-12T12:21:14.368740+0000","last_fullsized":"2024-09-12T12:21:14.368740+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.356428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371416+0000","last_change":"2024-09-12T12:21:13.396857+0000","last_active":"2024-09-12T12:21:14.371416+0000","last_peered":"2024-09-12T12:21:14.371416+0000","last_clean":"2024-09-12T12:21:14.371416+0000","last_became_active":"2024-09-12T12:21:13.395733+0000","last_became_peered":"2024-09-12T12:21:13.395733+0000","last_unstale":"2024-09-12T12:21:14.371416+0000","last_undegraded":"2024-09-12T12:21:14.371416+0000","last_fullsized":"2024-09-12T12:21:14.371416+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:11.998462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371254+0000","last_change":"2024-09-12T12:21:13.385053+0000","last_active":"2024-09-12T12:21:14.371254+0000","last_peered":"2024-09-12T12:21:14.371254+0000","last_clean":"2024-09-12T12:21:14.371254+0000","last_became_active":"2024-09-12T12:21:13.384722+0000","last_became_peered":"2024-09-12T12:21:13.384722+0000","last_unstale":"2024-09-12T12:21:14.371254+0000","last_undegraded":"2024-09-12T12:21:14.371254+0000","last_fullsized":"2024-09-12T12:21:14.371254+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:42:00.019490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.406968+0000","last_change":"2024-09-12T12:21:13.405425+0000","last_active":"2024-09-12T12:21:13.406968+0000","last_peered":"2024-09-12T12:21:13.406968+0000","last_clean":"2024-09-12T12:21:13.406968+0000","last_became_active":"2024-09-12T12:21:13.405108+0000","last_became_peered":"2024-09-12T12:21:13.405108+0000","last_unstale":"2024-09-12T12:21:13.406968+0000","last_undegraded":"2024-09-12T12:21:13.406968+0000","last_fullsized":"2024-09-12T12:21:13.406968+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:42:00.019490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.401617+0000","last_change":"2024-09-12T12:21:13.390382+0000","last_active":"2024-09-12T12:21:13.401617+0000","last_peered":"2024-09-12T12:21:13.401617+0000","last_clean":"2024-09-12T12:21:13.401617+0000","last_became_active":"2024-09-12T12:21:13.390058+0000","last_became_peered":"2024-09-12T12:21:13.390058+0000","last_unstale":"2024-09-12T12:21:13.401617+0000","last_undegraded":"2024-09-12T12:21:13.401617+0000","last_fullsized":"2024-09-12T12:21:13.401617+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:57.308131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370924+0000","last_change":"2024-09-12T12:21:13.384369+0000","last_active":"2024-09-12T12:21:14.370924+0000","last_peered":"2024-09-12T12:21:14.370924+0000","last_clean":"2024-09-12T12:21:14.370924+0000","last_became_active":"2024-09-12T12:21:13.381293+0000","last_became_peered":"2024-09-12T12:21:13.381293+0000","last_unstale":"2024-09-12T12:21:14.370924+0000","last_undegraded":"2024-09-12T12:21:14.370924+0000","last_fullsized":"2024-09-12T12:21:14.370924+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:55.636749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371265+0000","last_change":"2024-09-12T12:21:13.390005+0000","last_active":"2024-09-12T12:21:14.371265+0000","last_peered":"2024-09-12T12:21:14.371265+0000","last_clean":"2024-09-12T12:21:14.371265+0000","last_became_active":"2024-09-12T12:21:13.388836+0000","last_became_peered":"2024-09-12T12:21:13.388836+0000","last_unstale":"2024-09-12T12:21:14.371265+0000","last_undegraded":"2024-09-12T12:21:14.371265+0000","last_fullsized":"2024-09-12T12:21:14.371265+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:31.053950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369761+0000","last_change":"2024-09-12T12:21:13.387288+0000","last_active":"2024-09-12T12:21:14.369761+0000","last_peered":"2024-09-12T12:21:14.369761+0000","last_clean":"2024-09-12T12:21:14.369761+0000","last_became_active":"2024-09-12T12:21:13.387010+0000","last_became_peered":"2024-09-12T12:21:13.387010+0000","last_unstale":"2024-09-12T12:21:14.369761+0000","last_undegraded":"2024-09-12T12:21:14.369761+0000","last_fullsized":"2024-09-12T12:21:14.369761+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:15.420156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.394593+0000","last_change":"2024-09-12T12:21:13.384143+0000","last_active":"2024-09-12T12:21:13.394593+0000","last_peered":"2024-09-12T12:21:13.394593+0000","last_clean":"2024-09-12T12:21:13.394593+0000","last_became_active":"2024-09-12T12:21:13.383877+0000","last_became_peered":"2024-09-12T12:21:13.383877+0000","last_unstale":"2024-09-12T12:21:13.394593+0000","last_undegraded":"2024-09-12T12:21:13.394593+0000","last_fullsized":"2024-09-12T12:21:13.394593+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:20.704211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369754+0000","last_change":"2024-09-12T12:21:13.391857+0000","last_active":"2024-09-12T12:21:14.369754+0000","last_peered":"2024-09-12T12:21:14.369754+0000","last_clean":"2024-09-12T12:21:14.369754+0000","last_became_active":"2024-09-12T12:21:13.391611+0000","last_became_peered":"2024-09-12T12:21:13.391611+0000","last_unstale":"2024-09-12T12:21:14.369754+0000","last_undegraded":"2024-09-12T12:21:14.369754+0000","last_fullsized":"2024-09-12T12:21:14.369754+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:28.057955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"139'4","reported_seq":18,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371424+0000","last_change":"2024-09-12T12:21:12.387744+0000","last_active":"2024-09-12T12:21:14.371424+0000","last_peered":"2024-09-12T12:21:14.371424+0000","last_clean":"2024-09-12T12:21:14.371424+0000","last_became_active":"2024-09-12T12:21:12.387394+0000","last_became_peered":"2024-09-12T12:21:12.387394+0000","last_unstale":"2024-09-12T12:21:14.371424+0000","last_undegraded":"2024-09-12T12:21:14.371424+0000","last_fullsized":"2024-09-12T12:21:14.371424+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:33.314114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467572+0000","last_change":"2024-09-12T12:21:13.387308+0000","last_active":"2024-09-12T12:21:14.467572+0000","last_peered":"2024-09-12T12:21:14.467572+0000","last_clean":"2024-09-12T12:21:14.467572+0000","last_became_active":"2024-09-12T12:21:13.386997+0000","last_became_peered":"2024-09-12T12:21:13.386997+0000","last_unstale":"2024-09-12T12:21:14.467572+0000","last_undegraded":"2024-09-12T12:21:14.467572+0000","last_fullsized":"2024-09-12T12:21:14.467572+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:58.780879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"139'1","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.405476+0000","last_change":"2024-09-12T12:21:12.383972+0000","last_active":"2024-09-12T12:21:13.405476+0000","last_peered":"2024-09-12T12:21:13.405476+0000","last_clean":"2024-09-12T12:21:13.405476+0000","last_became_active":"2024-09-12T12:21:12.382896+0000","last_became_peered":"2024-09-12T12:21:12.382896+0000","last_unstale":"2024-09-12T12:21:13.405476+0000","last_undegraded":"2024-09-12T12:21:13.405476+0000","last_fullsized":"2024-09-12T12:21:13.405476+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:35.241768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.393807+0000","last_change":"2024-09-12T12:21:13.390943+0000","last_active":"2024-09-12T12:21:13.393807+0000","last_peered":"2024-09-12T12:21:13.393807+0000","last_clean":"2024-09-12T12:21:13.393807+0000","last_became_active":"2024-09-12T12:21:13.390615+0000","last_became_peered":"2024-09-12T12:21:13.390615+0000","last_unstale":"2024-09-12T12:21:13.393807+0000","last_undegraded":"2024-09-12T12:21:13.393807+0000","last_fullsized":"2024-09-12T12:21:13.393807+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:11.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"139'2","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.407148+0000","last_change":"2024-09-12T12:21:12.387883+0000","last_active":"2024-09-12T12:21:13.407148+0000","last_peered":"2024-09-12T12:21:13.407148+0000","last_clean":"2024-09-12T12:21:13.407148+0000","last_became_active":"2024-09-12T12:21:12.387368+0000","last_became_peered":"2024-09-12T12:21:12.387368+0000","last_unstale":"2024-09-12T12:21:13.407148+0000","last_undegraded":"2024-09-12T12:21:13.407148+0000","last_fullsized":"2024-09-12T12:21:13.407148+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:36.450860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467582+0000","last_change":"2024-09-12T12:21:13.394712+0000","last_active":"2024-09-12T12:21:14.467582+0000","last_peered":"2024-09-12T12:21:14.467582+0000","last_clean":"2024-09-12T12:21:14.467582+0000","last_became_active":"2024-09-12T12:21:13.394427+0000","last_became_peered":"2024-09-12T12:21:13.394427+0000","last_unstale":"2024-09-12T12:21:14.467582+0000","last_undegraded":"2024-09-12T12:21:14.467582+0000","last_fullsized":"2024-09-12T12:21:14.467582+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:12.903609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"139'2","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.406956+0000","last_change":"2024-09-12T12:21:12.382360+0000","last_active":"2024-09-12T12:21:13.406956+0000","last_peered":"2024-09-12T12:21:13.406956+0000","last_clean":"2024-09-12T12:21:13.406956+0000","last_became_active":"2024-09-12T12:21:12.382048+0000","last_became_peered":"2024-09-12T12:21:12.382048+0000","last_unstale":"2024-09-12T12:21:13.406956+0000","last_undegraded":"2024-09-12T12:21:13.406956+0000","last_fullsized":"2024-09-12T12:21:13.406956+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:35.093964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370487+0000","last_change":"2024-09-12T12:21:13.400944+0000","last_active":"2024-09-12T12:21:14.370487+0000","last_peered":"2024-09-12T12:21:14.370487+0000","last_clean":"2024-09-12T12:21:14.370487+0000","last_became_active":"2024-09-12T12:21:13.400608+0000","last_became_peered":"2024-09-12T12:21:13.400608+0000","last_unstale":"2024-09-12T12:21:14.370487+0000","last_undegraded":"2024-09-12T12:21:14.370487+0000","last_fullsized":"2024-09-12T12:21:14.370487+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:47.690428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"139'1","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370281+0000","last_change":"2024-09-12T12:21:12.383823+0000","last_active":"2024-09-12T12:21:14.370281+0000","last_peered":"2024-09-12T12:21:14.370281+0000","last_clean":"2024-09-12T12:21:14.370281+0000","last_became_active":"2024-09-12T12:21:12.383485+0000","last_became_peered":"2024-09-12T12:21:12.383485+0000","last_unstale":"2024-09-12T12:21:14.370281+0000","last_undegraded":"2024-09-12T12:21:14.370281+0000","last_fullsized":"2024-09-12T12:21:14.370281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:39.214918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370569+0000","last_change":"2024-09-12T12:21:13.403519+0000","last_active":"2024-09-12T12:21:14.370569+0000","last_peered":"2024-09-12T12:21:14.370569+0000","last_clean":"2024-09-12T12:21:14.370569+0000","last_became_active":"2024-09-12T12:21:13.403254+0000","last_became_peered":"2024-09-12T12:21:13.403254+0000","last_unstale":"2024-09-12T12:21:14.370569+0000","last_undegraded":"2024-09-12T12:21:14.370569+0000","last_fullsized":"2024-09-12T12:21:14.370569+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:28.608303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"139'1","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.404590+0000","last_change":"2024-09-12T12:21:12.378580+0000","last_active":"2024-09-12T12:21:13.404590+0000","last_peered":"2024-09-12T12:21:13.404590+0000","last_clean":"2024-09-12T12:21:13.404590+0000","last_became_active":"2024-09-12T12:21:12.378320+0000","last_became_peered":"2024-09-12T12:21:12.378320+0000","last_unstale":"2024-09-12T12:21:13.404590+0000","last_undegraded":"2024-09-12T12:21:13.404590+0000","last_fullsized":"2024-09-12T12:21:13.404590+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:59.904600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.388011+0000","last_change":"2024-09-12T12:21:13.383605+0000","last_active":"2024-09-12T12:21:13.388011+0000","last_peered":"2024-09-12T12:21:13.388011+0000","last_clean":"2024-09-12T12:21:13.388011+0000","last_became_active":"2024-09-12T12:21:13.383235+0000","last_became_peered":"2024-09-12T12:21:13.383235+0000","last_unstale":"2024-09-12T12:21:13.388011+0000","last_undegraded":"2024-09-12T12:21:13.388011+0000","last_fullsized":"2024-09-12T12:21:13.388011+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:57:58.209405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368757+0000","last_change":"2024-09-12T12:21:12.380913+0000","last_active":"2024-09-12T12:21:14.368757+0000","last_peered":"2024-09-12T12:21:14.368757+0000","last_clean":"2024-09-12T12:21:14.368757+0000","last_became_active":"2024-09-12T12:21:12.380646+0000","last_became_peered":"2024-09-12T12:21:12.380646+0000","last_unstale":"2024-09-12T12:21:14.368757+0000","last_undegraded":"2024-09-12T12:21:14.368757+0000","last_fullsized":"2024-09-12T12:21:14.368757+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:08.286903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.406906+0000","last_change":"2024-09-12T12:21:13.402040+0000","last_active":"2024-09-12T12:21:13.406906+0000","last_peered":"2024-09-12T12:21:13.406906+0000","last_clean":"2024-09-12T12:21:13.406906+0000","last_became_active":"2024-09-12T12:21:13.401751+0000","last_became_peered":"2024-09-12T12:21:13.401751+0000","last_unstale":"2024-09-12T12:21:13.406906+0000","last_undegraded":"2024-09-12T12:21:13.406906+0000","last_fullsized":"2024-09-12T12:21:13.406906+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:31.053950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370683+0000","last_change":"2024-09-12T12:21:12.381350+0000","last_active":"2024-09-12T12:21:14.370683+0000","last_peered":"2024-09-12T12:21:14.370683+0000","last_clean":"2024-09-12T12:21:14.370683+0000","last_became_active":"2024-09-12T12:21:12.380913+0000","last_became_peered":"2024-09-12T12:21:12.380913+0000","last_unstale":"2024-09-12T12:21:14.370683+0000","last_undegraded":"2024-09-12T12:21:14.370683+0000","last_fullsized":"2024-09-12T12:21:14.370683+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:27.604911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467508+0000","last_change":"2024-09-12T12:21:13.386309+0000","last_active":"2024-09-12T12:21:14.467508+0000","last_peered":"2024-09-12T12:21:14.467508+0000","last_clean":"2024-09-12T12:21:14.467508+0000","last_became_active":"2024-09-12T12:21:13.385984+0000","last_became_peered":"2024-09-12T12:21:13.385984+0000","last_unstale":"2024-09-12T12:21:14.467508+0000","last_undegraded":"2024-09-12T12:21:14.467508+0000","last_fullsized":"2024-09-12T12:21:14.467508+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:49.283837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.375829+0000","last_change":"2024-09-12T12:21:12.391700+0000","last_active":"2024-09-12T12:21:13.375829+0000","last_peered":"2024-09-12T12:21:13.375829+0000","last_clean":"2024-09-12T12:21:13.375829+0000","last_became_active":"2024-09-12T12:21:12.391392+0000","last_became_peered":"2024-09-12T12:21:12.391392+0000","last_unstale":"2024-09-12T12:21:13.375829+0000","last_undegraded":"2024-09-12T12:21:13.375829+0000","last_fullsized":"2024-09-12T12:21:13.375829+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:27.054563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368971+0000","last_change":"2024-09-12T12:21:13.384013+0000","last_active":"2024-09-12T12:21:14.368971+0000","last_peered":"2024-09-12T12:21:14.368971+0000","last_clean":"2024-09-12T12:21:14.368971+0000","last_became_active":"2024-09-12T12:21:13.382528+0000","last_became_peered":"2024-09-12T12:21:13.382528+0000","last_unstale":"2024-09-12T12:21:14.368971+0000","last_undegraded":"2024-09-12T12:21:14.368971+0000","last_fullsized":"2024-09-12T12:21:14.368971+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:36.097355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467782+0000","last_change":"2024-09-12T12:21:12.390351+0000","last_active":"2024-09-12T12:21:14.467782+0000","last_peered":"2024-09-12T12:21:14.467782+0000","last_clean":"2024-09-12T12:21:14.467782+0000","last_became_active":"2024-09-12T12:21:12.389273+0000","last_became_peered":"2024-09-12T12:21:12.389273+0000","last_unstale":"2024-09-12T12:21:14.467782+0000","last_undegraded":"2024-09-12T12:21:14.467782+0000","last_fullsized":"2024-09-12T12:21:14.467782+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:17.770615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371412+0000","last_change":"2024-09-12T12:21:13.385400+0000","last_active":"2024-09-12T12:21:14.371412+0000","last_peered":"2024-09-12T12:21:14.371412+0000","last_clean":"2024-09-12T12:21:14.371412+0000","last_became_active":"2024-09-12T12:21:13.384347+0000","last_became_peered":"2024-09-12T12:21:13.384347+0000","last_unstale":"2024-09-12T12:21:14.371412+0000","last_undegraded":"2024-09-12T12:21:14.371412+0000","last_fullsized":"2024-09-12T12:21:14.371412+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:57.593791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"139'3","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.406923+0000","last_change":"2024-09-12T12:21:12.381304+0000","last_active":"2024-09-12T12:21:13.406923+0000","last_peered":"2024-09-12T12:21:13.406923+0000","last_clean":"2024-09-12T12:21:13.406923+0000","last_became_active":"2024-09-12T12:21:12.381050+0000","last_became_peered":"2024-09-12T12:21:12.381050+0000","last_unstale":"2024-09-12T12:21:13.406923+0000","last_undegraded":"2024-09-12T12:21:13.406923+0000","last_fullsized":"2024-09-12T12:21:13.406923+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:50:16.957557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370965+0000","last_change":"2024-09-12T12:21:13.377293+0000","last_active":"2024-09-12T12:21:14.370965+0000","last_peered":"2024-09-12T12:21:14.370965+0000","last_clean":"2024-09-12T12:21:14.370965+0000","last_became_active":"2024-09-12T12:21:13.376996+0000","last_became_peered":"2024-09-12T12:21:13.376996+0000","last_unstale":"2024-09-12T12:21:14.370965+0000","last_undegraded":"2024-09-12T12:21:14.370965+0000","last_fullsized":"2024-09-12T12:21:14.370965+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:43.945352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"139'6","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.410483+0000","last_change":"2024-09-12T12:21:12.390446+0000","last_active":"2024-09-12T12:21:13.410483+0000","last_peered":"2024-09-12T12:21:13.410483+0000","last_clean":"2024-09-12T12:21:13.410483+0000","last_became_active":"2024-09-12T12:21:12.390070+0000","last_became_peered":"2024-09-12T12:21:12.390070+0000","last_unstale":"2024-09-12T12:21:13.410483+0000","last_undegraded":"2024-09-12T12:21:13.410483+0000","last_fullsized":"2024-09-12T12:21:13.410483+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:37.195040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.401641+0000","last_change":"2024-09-12T12:21:13.393130+0000","last_active":"2024-09-12T12:21:13.401641+0000","last_peered":"2024-09-12T12:21:13.401641+0000","last_clean":"2024-09-12T12:21:13.401641+0000","last_became_active":"2024-09-12T12:21:13.392861+0000","last_became_peered":"2024-09-12T12:21:13.392861+0000","last_unstale":"2024-09-12T12:21:13.401641+0000","last_undegraded":"2024-09-12T12:21:13.401641+0000","last_fullsized":"2024-09-12T12:21:13.401641+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:45.398397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"139'2","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467680+0000","last_change":"2024-09-12T12:21:12.391971+0000","last_active":"2024-09-12T12:21:14.467680+0000","last_peered":"2024-09-12T12:21:14.467680+0000","last_clean":"2024-09-12T12:21:14.467680+0000","last_became_active":"2024-09-12T12:21:12.391698+0000","last_became_peered":"2024-09-12T12:21:12.391698+0000","last_unstale":"2024-09-12T12:21:14.467680+0000","last_undegraded":"2024-09-12T12:21:14.467680+0000","last_fullsized":"2024-09-12T12:21:14.467680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:42.796414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.398373+0000","last_change":"2024-09-12T12:21:13.395587+0000","last_active":"2024-09-12T12:21:13.398373+0000","last_peered":"2024-09-12T12:21:13.398373+0000","last_clean":"2024-09-12T12:21:13.398373+0000","last_became_active":"2024-09-12T12:21:13.395242+0000","last_became_peered":"2024-09-12T12:21:13.395242+0000","last_unstale":"2024-09-12T12:21:13.398373+0000","last_undegraded":"2024-09-12T12:21:13.398373+0000","last_fullsized":"2024-09-12T12:21:13.398373+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:26.348036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370407+0000","last_change":"2024-09-12T12:21:12.373718+0000","last_active":"2024-09-12T12:21:14.370407+0000","last_peered":"2024-09-12T12:21:14.370407+0000","last_clean":"2024-09-12T12:21:14.370407+0000","last_became_active":"2024-09-12T12:21:12.373435+0000","last_became_peered":"2024-09-12T12:21:12.373435+0000","last_unstale":"2024-09-12T12:21:14.370407+0000","last_undegraded":"2024-09-12T12:21:14.370407+0000","last_fullsized":"2024-09-12T12:21:14.370407+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.388633+0000","last_change":"2024-09-12T12:21:13.385549+0000","last_active":"2024-09-12T12:21:13.388633+0000","last_peered":"2024-09-12T12:21:13.388633+0000","last_clean":"2024-09-12T12:21:13.388633+0000","last_became_active":"2024-09-12T12:21:13.385299+0000","last_became_peered":"2024-09-12T12:21:13.385299+0000","last_unstale":"2024-09-12T12:21:13.388633+0000","last_undegraded":"2024-09-12T12:21:13.388633+0000","last_fullsized":"2024-09-12T12:21:13.388633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:29.936773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"139'8","reported_seq":22,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368768+0000","last_change":"2024-09-12T12:21:12.380667+0000","last_active":"2024-09-12T12:21:14.368768+0000","last_peered":"2024-09-12T12:21:14.368768+0000","last_clean":"2024-09-12T12:21:14.368768+0000","last_became_active":"2024-09-12T12:21:12.380358+0000","last_became_peered":"2024-09-12T12:21:12.380358+0000","last_unstale":"2024-09-12T12:21:14.368768+0000","last_undegraded":"2024-09-12T12:21:14.368768+0000","last_fullsized":"2024-09-12T12:21:14.368768+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:23.328841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370289+0000","last_change":"2024-09-12T12:21:13.384613+0000","last_active":"2024-09-12T12:21:14.370289+0000","last_peered":"2024-09-12T12:21:14.370289+0000","last_clean":"2024-09-12T12:21:14.370289+0000","last_became_active":"2024-09-12T12:21:13.381613+0000","last_became_peered":"2024-09-12T12:21:13.381613+0000","last_unstale":"2024-09-12T12:21:14.370289+0000","last_undegraded":"2024-09-12T12:21:14.370289+0000","last_fullsized":"2024-09-12T12:21:14.370289+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"139'1","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.404736+0000","last_change":"2024-09-12T12:21:12.379544+0000","last_active":"2024-09-12T12:21:13.404736+0000","last_peered":"2024-09-12T12:21:13.404736+0000","last_clean":"2024-09-12T12:21:13.404736+0000","last_became_active":"2024-09-12T12:21:12.379063+0000","last_became_peered":"2024-09-12T12:21:12.379063+0000","last_unstale":"2024-09-12T12:21:13.404736+0000","last_undegraded":"2024-09-12T12:21:13.404736+0000","last_fullsized":"2024-09-12T12:21:13.404736+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:14.416764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.398053+0000","last_change":"2024-09-12T12:21:13.394324+0000","last_active":"2024-09-12T12:21:13.398053+0000","last_peered":"2024-09-12T12:21:13.398053+0000","last_clean":"2024-09-12T12:21:13.398053+0000","last_became_active":"2024-09-12T12:21:13.394023+0000","last_became_peered":"2024-09-12T12:21:13.394023+0000","last_unstale":"2024-09-12T12:21:13.398053+0000","last_undegraded":"2024-09-12T12:21:13.398053+0000","last_fullsized":"2024-09-12T12:21:13.398053+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:43.945352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"139'2","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371379+0000","last_change":"2024-09-12T12:21:12.385047+0000","last_active":"2024-09-12T12:21:14.371379+0000","last_peered":"2024-09-12T12:21:14.371379+0000","last_clean":"2024-09-12T12:21:14.371379+0000","last_became_active":"2024-09-12T12:21:12.384576+0000","last_became_peered":"2024-09-12T12:21:12.384576+0000","last_unstale":"2024-09-12T12:21:14.371379+0000","last_undegraded":"2024-09-12T12:21:14.371379+0000","last_fullsized":"2024-09-12T12:21:14.371379+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:07.072034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.394049+0000","last_change":"2024-09-12T12:21:13.391300+0000","last_active":"2024-09-12T12:21:13.394049+0000","last_peered":"2024-09-12T12:21:13.394049+0000","last_clean":"2024-09-12T12:21:13.394049+0000","last_became_active":"2024-09-12T12:21:13.391008+0000","last_became_peered":"2024-09-12T12:21:13.391008+0000","last_unstale":"2024-09-12T12:21:13.394049+0000","last_undegraded":"2024-09-12T12:21:13.394049+0000","last_fullsized":"2024-09-12T12:21:13.394049+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:41.499866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"139'1","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369579+0000","last_change":"2024-09-12T12:21:12.380400+0000","last_active":"2024-09-12T12:21:14.369579+0000","last_peered":"2024-09-12T12:21:14.369579+0000","last_clean":"2024-09-12T12:21:14.369579+0000","last_became_active":"2024-09-12T12:21:12.380112+0000","last_became_peered":"2024-09-12T12:21:12.380112+0000","last_unstale":"2024-09-12T12:21:14.369579+0000","last_undegraded":"2024-09-12T12:21:14.369579+0000","last_fullsized":"2024-09-12T12:21:14.369579+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:14.416764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.397375+0000","last_change":"2024-09-12T12:21:13.385373+0000","last_active":"2024-09-12T12:21:13.397375+0000","last_peered":"2024-09-12T12:21:13.397375+0000","last_clean":"2024-09-12T12:21:13.397375+0000","last_became_active":"2024-09-12T12:21:13.384663+0000","last_became_peered":"2024-09-12T12:21:13.384663+0000","last_unstale":"2024-09-12T12:21:13.397375+0000","last_undegraded":"2024-09-12T12:21:13.397375+0000","last_fullsized":"2024-09-12T12:21:13.397375+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:38.607461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.370053+0000","last_change":"2024-09-12T12:21:12.387440+0000","last_active":"2024-09-12T12:21:13.370053+0000","last_peered":"2024-09-12T12:21:13.370053+0000","last_clean":"2024-09-12T12:21:13.370053+0000","last_became_active":"2024-09-12T12:21:12.387172+0000","last_became_peered":"2024-09-12T12:21:12.387172+0000","last_unstale":"2024-09-12T12:21:13.370053+0000","last_undegraded":"2024-09-12T12:21:13.370053+0000","last_fullsized":"2024-09-12T12:21:13.370053+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:58.499071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.395940+0000","last_change":"2024-09-12T12:21:13.393819+0000","last_active":"2024-09-12T12:21:13.395940+0000","last_peered":"2024-09-12T12:21:13.395940+0000","last_clean":"2024-09-12T12:21:13.395940+0000","last_became_active":"2024-09-12T12:21:13.393555+0000","last_became_peered":"2024-09-12T12:21:13.393555+0000","last_unstale":"2024-09-12T12:21:13.395940+0000","last_undegraded":"2024-09-12T12:21:13.395940+0000","last_fullsized":"2024-09-12T12:21:13.395940+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:32.872122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"139'2","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370815+0000","last_change":"2024-09-12T12:21:12.375166+0000","last_active":"2024-09-12T12:21:14.370815+0000","last_peered":"2024-09-12T12:21:14.370815+0000","last_clean":"2024-09-12T12:21:14.370815+0000","last_became_active":"2024-09-12T12:21:12.374906+0000","last_became_peered":"2024-09-12T12:21:12.374906+0000","last_unstale":"2024-09-12T12:21:14.370815+0000","last_undegraded":"2024-09-12T12:21:14.370815+0000","last_fullsized":"2024-09-12T12:21:14.370815+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:12.953413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467778+0000","last_change":"2024-09-12T12:21:13.393688+0000","last_active":"2024-09-12T12:21:14.467778+0000","last_peered":"2024-09-12T12:21:14.467778+0000","last_clean":"2024-09-12T12:21:14.467778+0000","last_became_active":"2024-09-12T12:21:13.393440+0000","last_became_peered":"2024-09-12T12:21:13.393440+0000","last_unstale":"2024-09-12T12:21:14.467778+0000","last_undegraded":"2024-09-12T12:21:14.467778+0000","last_fullsized":"2024-09-12T12:21:14.467778+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:58.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467628+0000","last_change":"2024-09-12T12:21:12.391146+0000","last_active":"2024-09-12T12:21:14.467628+0000","last_peered":"2024-09-12T12:21:14.467628+0000","last_clean":"2024-09-12T12:21:14.467628+0000","last_became_active":"2024-09-12T12:21:12.390765+0000","last_became_peered":"2024-09-12T12:21:12.390765+0000","last_unstale":"2024-09-12T12:21:14.467628+0000","last_undegraded":"2024-09-12T12:21:14.467628+0000","last_fullsized":"2024-09-12T12:21:14.467628+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:35.175428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.387987+0000","last_change":"2024-09-12T12:21:13.380957+0000","last_active":"2024-09-12T12:21:13.387987+0000","last_peered":"2024-09-12T12:21:13.387987+0000","last_clean":"2024-09-12T12:21:13.387987+0000","last_became_active":"2024-09-12T12:21:13.379524+0000","last_became_peered":"2024-09-12T12:21:13.379524+0000","last_unstale":"2024-09-12T12:21:13.387987+0000","last_undegraded":"2024-09-12T12:21:13.387987+0000","last_fullsized":"2024-09-12T12:21:13.387987+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:59.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.383562+0000","last_change":"2024-09-12T12:21:12.393235+0000","last_active":"2024-09-12T12:21:13.383562+0000","last_peered":"2024-09-12T12:21:13.383562+0000","last_clean":"2024-09-12T12:21:13.383562+0000","last_became_active":"2024-09-12T12:21:12.392931+0000","last_became_peered":"2024-09-12T12:21:12.392931+0000","last_unstale":"2024-09-12T12:21:13.383562+0000","last_undegraded":"2024-09-12T12:21:13.383562+0000","last_fullsized":"2024-09-12T12:21:13.383562+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:11.314153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.390146+0000","last_change":"2024-09-12T12:21:13.387480+0000","last_active":"2024-09-12T12:21:13.390146+0000","last_peered":"2024-09-12T12:21:13.390146+0000","last_clean":"2024-09-12T12:21:13.390146+0000","last_became_active":"2024-09-12T12:21:13.386946+0000","last_became_peered":"2024-09-12T12:21:13.386946+0000","last_unstale":"2024-09-12T12:21:13.390146+0000","last_undegraded":"2024-09-12T12:21:13.390146+0000","last_fullsized":"2024-09-12T12:21:13.390146+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:34.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368830+0000","last_change":"2024-09-12T12:21:12.387407+0000","last_active":"2024-09-12T12:21:14.368830+0000","last_peered":"2024-09-12T12:21:14.368830+0000","last_clean":"2024-09-12T12:21:14.368830+0000","last_became_active":"2024-09-12T12:21:12.387092+0000","last_became_peered":"2024-09-12T12:21:12.387092+0000","last_unstale":"2024-09-12T12:21:14.368830+0000","last_undegraded":"2024-09-12T12:21:14.368830+0000","last_fullsized":"2024-09-12T12:21:14.368830+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:10.191644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.390683+0000","last_change":"2024-09-12T12:21:13.387089+0000","last_active":"2024-09-12T12:21:13.390683+0000","last_peered":"2024-09-12T12:21:13.390683+0000","last_clean":"2024-09-12T12:21:13.390683+0000","last_became_active":"2024-09-12T12:21:13.386722+0000","last_became_peered":"2024-09-12T12:21:13.386722+0000","last_unstale":"2024-09-12T12:21:13.390683+0000","last_undegraded":"2024-09-12T12:21:13.390683+0000","last_fullsized":"2024-09-12T12:21:13.390683+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:07.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"139'2","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467965+0000","last_change":"2024-09-12T12:21:12.388421+0000","last_active":"2024-09-12T12:21:14.467965+0000","last_peered":"2024-09-12T12:21:14.467965+0000","last_clean":"2024-09-12T12:21:14.467965+0000","last_became_active":"2024-09-12T12:21:12.388167+0000","last_became_peered":"2024-09-12T12:21:12.388167+0000","last_unstale":"2024-09-12T12:21:14.467965+0000","last_undegraded":"2024-09-12T12:21:14.467965+0000","last_fullsized":"2024-09-12T12:21:14.467965+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:46.267405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370210+0000","last_change":"2024-09-12T12:21:13.377415+0000","last_active":"2024-09-12T12:21:14.370210+0000","last_peered":"2024-09-12T12:21:14.370210+0000","last_clean":"2024-09-12T12:21:14.370210+0000","last_became_active":"2024-09-12T12:21:13.377134+0000","last_became_peered":"2024-09-12T12:21:13.377134+0000","last_unstale":"2024-09-12T12:21:14.370210+0000","last_undegraded":"2024-09-12T12:21:14.370210+0000","last_fullsized":"2024-09-12T12:21:14.370210+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:41.499866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370696+0000","last_change":"2024-09-12T12:21:12.372917+0000","last_active":"2024-09-12T12:21:14.370696+0000","last_peered":"2024-09-12T12:21:14.370696+0000","last_clean":"2024-09-12T12:21:14.370696+0000","last_became_active":"2024-09-12T12:21:12.372379+0000","last_became_peered":"2024-09-12T12:21:12.372379+0000","last_unstale":"2024-09-12T12:21:14.370696+0000","last_undegraded":"2024-09-12T12:21:14.370696+0000","last_fullsized":"2024-09-12T12:21:14.370696+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:27.423986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.394030+0000","last_change":"2024-09-12T12:21:13.391299+0000","last_active":"2024-09-12T12:21:13.394030+0000","last_peered":"2024-09-12T12:21:13.394030+0000","last_clean":"2024-09-12T12:21:13.394030+0000","last_became_active":"2024-09-12T12:21:13.390980+0000","last_became_peered":"2024-09-12T12:21:13.390980+0000","last_unstale":"2024-09-12T12:21:13.394030+0000","last_undegraded":"2024-09-12T12:21:13.394030+0000","last_fullsized":"2024-09-12T12:21:13.394030+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:23.702746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370680+0000","last_change":"2024-09-12T12:21:12.383886+0000","last_active":"2024-09-12T12:21:14.370680+0000","last_peered":"2024-09-12T12:21:14.370680+0000","last_clean":"2024-09-12T12:21:14.370680+0000","last_became_active":"2024-09-12T12:21:12.383596+0000","last_became_peered":"2024-09-12T12:21:12.383596+0000","last_unstale":"2024-09-12T12:21:14.370680+0000","last_undegraded":"2024-09-12T12:21:14.370680+0000","last_fullsized":"2024-09-12T12:21:14.370680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:16.055803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.401174+0000","last_change":"2024-09-12T12:21:13.390363+0000","last_active":"2024-09-12T12:21:13.401174+0000","last_peered":"2024-09-12T12:21:13.401174+0000","last_clean":"2024-09-12T12:21:13.401174+0000","last_became_active":"2024-09-12T12:21:13.390094+0000","last_became_peered":"2024-09-12T12:21:13.390094+0000","last_unstale":"2024-09-12T12:21:13.401174+0000","last_undegraded":"2024-09-12T12:21:13.401174+0000","last_fullsized":"2024-09-12T12:21:13.401174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:08.370441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369455+0000","last_change":"2024-09-12T12:21:12.383757+0000","last_active":"2024-09-12T12:21:14.369455+0000","last_peered":"2024-09-12T12:21:14.369455+0000","last_clean":"2024-09-12T12:21:14.369455+0000","last_became_active":"2024-09-12T12:21:12.383480+0000","last_became_peered":"2024-09-12T12:21:12.383480+0000","last_unstale":"2024-09-12T12:21:14.369455+0000","last_undegraded":"2024-09-12T12:21:14.369455+0000","last_fullsized":"2024-09-12T12:21:14.369455+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:27.054563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369360+0000","last_change":"2024-09-12T12:21:13.393328+0000","last_active":"2024-09-12T12:21:14.369360+0000","last_peered":"2024-09-12T12:21:14.369360+0000","last_clean":"2024-09-12T12:21:14.369360+0000","last_became_active":"2024-09-12T12:21:13.393074+0000","last_became_peered":"2024-09-12T12:21:13.393074+0000","last_unstale":"2024-09-12T12:21:14.369360+0000","last_undegraded":"2024-09-12T12:21:14.369360+0000","last_fullsized":"2024-09-12T12:21:14.369360+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:23.702746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.377330+0000","last_change":"2024-09-12T12:21:12.387426+0000","last_active":"2024-09-12T12:21:13.377330+0000","last_peered":"2024-09-12T12:21:13.377330+0000","last_clean":"2024-09-12T12:21:13.377330+0000","last_became_active":"2024-09-12T12:21:12.387012+0000","last_became_peered":"2024-09-12T12:21:12.387012+0000","last_unstale":"2024-09-12T12:21:13.377330+0000","last_undegraded":"2024-09-12T12:21:13.377330+0000","last_fullsized":"2024-09-12T12:21:13.377330+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369502+0000","last_change":"2024-09-12T12:21:13.398368+0000","last_active":"2024-09-12T12:21:14.369502+0000","last_peered":"2024-09-12T12:21:14.369502+0000","last_clean":"2024-09-12T12:21:14.369502+0000","last_became_active":"2024-09-12T12:21:13.396752+0000","last_became_peered":"2024-09-12T12:21:13.396752+0000","last_unstale":"2024-09-12T12:21:14.369502+0000","last_undegraded":"2024-09-12T12:21:14.369502+0000","last_fullsized":"2024-09-12T12:21:14.369502+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:41.499866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.385591+0000","last_change":"2024-09-12T12:21:12.382046+0000","last_active":"2024-09-12T12:21:13.385591+0000","last_peered":"2024-09-12T12:21:13.385591+0000","last_clean":"2024-09-12T12:21:13.385591+0000","last_became_active":"2024-09-12T12:21:12.381778+0000","last_became_peered":"2024-09-12T12:21:12.381778+0000","last_unstale":"2024-09-12T12:21:13.385591+0000","last_undegraded":"2024-09-12T12:21:13.385591+0000","last_fullsized":"2024-09-12T12:21:13.385591+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:38.825973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369679+0000","last_change":"2024-09-12T12:21:13.384340+0000","last_active":"2024-09-12T12:21:14.369679+0000","last_peered":"2024-09-12T12:21:14.369679+0000","last_clean":"2024-09-12T12:21:14.369679+0000","last_became_active":"2024-09-12T12:21:13.384089+0000","last_became_peered":"2024-09-12T12:21:13.384089+0000","last_unstale":"2024-09-12T12:21:14.369679+0000","last_undegraded":"2024-09-12T12:21:14.369679+0000","last_fullsized":"2024-09-12T12:21:14.369679+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:43.945352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368912+0000","last_change":"2024-09-12T12:21:12.383569+0000","last_active":"2024-09-12T12:21:14.368912+0000","last_peered":"2024-09-12T12:21:14.368912+0000","last_clean":"2024-09-12T12:21:14.368912+0000","last_became_active":"2024-09-12T12:21:12.383186+0000","last_became_peered":"2024-09-12T12:21:12.383186+0000","last_unstale":"2024-09-12T12:21:14.368912+0000","last_undegraded":"2024-09-12T12:21:14.368912+0000","last_fullsized":"2024-09-12T12:21:14.368912+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:00.259417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.399784+0000","last_change":"2024-09-12T12:21:13.398610+0000","last_active":"2024-09-12T12:21:13.399784+0000","last_peered":"2024-09-12T12:21:13.399784+0000","last_clean":"2024-09-12T12:21:13.399784+0000","last_became_active":"2024-09-12T12:21:13.397661+0000","last_became_peered":"2024-09-12T12:21:13.397661+0000","last_unstale":"2024-09-12T12:21:13.399784+0000","last_undegraded":"2024-09-12T12:21:13.399784+0000","last_fullsized":"2024-09-12T12:21:13.399784+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:33:57.240294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.368860+0000","last_change":"2024-09-12T12:21:12.379477+0000","last_active":"2024-09-12T12:21:13.368860+0000","last_peered":"2024-09-12T12:21:13.368860+0000","last_clean":"2024-09-12T12:21:13.368860+0000","last_became_active":"2024-09-12T12:21:12.379212+0000","last_became_peered":"2024-09-12T12:21:12.379212+0000","last_unstale":"2024-09-12T12:21:13.368860+0000","last_undegraded":"2024-09-12T12:21:13.368860+0000","last_fullsized":"2024-09-12T12:21:13.368860+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:42.692308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371160+0000","last_change":"2024-09-12T12:21:13.380012+0000","last_active":"2024-09-12T12:21:14.371160+0000","last_peered":"2024-09-12T12:21:14.371160+0000","last_clean":"2024-09-12T12:21:14.371160+0000","last_became_active":"2024-09-12T12:21:13.379734+0000","last_became_peered":"2024-09-12T12:21:13.379734+0000","last_unstale":"2024-09-12T12:21:14.371160+0000","last_undegraded":"2024-09-12T12:21:14.371160+0000","last_fullsized":"2024-09-12T12:21:14.371160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:33:57.240294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.385743+0000","last_change":"2024-09-12T12:21:12.393577+0000","last_active":"2024-09-12T12:21:13.385743+0000","last_peered":"2024-09-12T12:21:13.385743+0000","last_clean":"2024-09-12T12:21:13.385743+0000","last_became_active":"2024-09-12T12:21:12.393310+0000","last_became_peered":"2024-09-12T12:21:12.393310+0000","last_unstale":"2024-09-12T12:21:13.385743+0000","last_undegraded":"2024-09-12T12:21:13.385743+0000","last_fullsized":"2024-09-12T12:21:13.385743+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:11.353036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":386,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.376986+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:21:13.376986+0000","last_peered":"2024-09-12T12:21:13.376986+0000","last_clean":"2024-09-12T12:21:13.376986+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:21:13.376986+0000","last_undegraded":"2024-09-12T12:21:13.376986+0000","last_fullsized":"2024-09-12T12:21:13.376986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":2347008,"data_stored":1410156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46788,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325052,"statfs":{"total":96636764160,"available":96588853248,"internally_reserved":0,"allocated":1744896,"data_stored":818758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46784,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325056,"statfs":{"total":96636764160,"available":96588857344,"internally_reserved":0,"allocated":1740800,"data_stored":818108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55092,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316748,"statfs":{"total":96636764160,"available":96580349952,"internally_reserved":0,"allocated":1736704,"data_stored":818086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50960,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320880,"statfs":{"total":96636764160,"available":96584581120,"internally_reserved":0,"allocated":1753088,"data_stored":819768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1744896,"data_stored":818702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50936,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320904,"statfs":{"total":96636764160,"available":96584605696,"internally_reserved":0,"allocated":1740800,"data_stored":818156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51524,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320316,"statfs":{"total":96636764160,"available":96584003584,"internally_reserved":0,"allocated":2338816,"data_stored":1408510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:21:17.478 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:21:17.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.647+0000 7f1fc0e00640 1 Processor -- start 2024-09-12T12:21:17.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.647+0000 7f1fc0e00640 1 -- start start 2024-09-12T12:21:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.647+0000 7f1fc0e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1fbc071420 0x7f1fbc071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.647+0000 7f1fc0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1fbc0ccf30 0x7f1fbc0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.647+0000 7f1fc0e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fbc0cd890 con 0x7f1fbc15b4e0 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.647+0000 7f1fc0e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1fbc0b45a0 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.647+0000 7f1fc0e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1fbc0b3fe0 con 0x7f1fbc071420 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fba800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1fbc0ccf30 0x7f1fbc0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fba800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1fbc0ccf30 0x7f1fbc0cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47328/0 (socket says 172.21.15.144:47328) 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fba800640 1 -- 172.21.15.144:0/723383349 learned_addr learned my addr 172.21.15.144:0/723383349 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fb9400640 1 --2- 172.21.15.144:0/723383349 >> v2:172.21.15.165:3300/0 conn(0x7f1fbc071420 0x7f1fbc071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fba800640 1 -- 172.21.15.144:0/723383349 >> v2:172.21.15.165:3300/0 conn(0x7f1fbc071420 msgr2=0x7f1fbc071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fba800640 1 --2- 172.21.15.144:0/723383349 >> v2:172.21.15.165:3300/0 conn(0x7f1fbc071420 0x7f1fbc071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fba800640 1 -- 172.21.15.144:0/723383349 >> v1:172.21.15.165:6789/0 conn(0x7f1fbc15b4e0 legacy=0x7f1fbc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:17.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fba800640 1 -- 172.21.15.144:0/723383349 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc0b42c0 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fba800640 1 --2- 172.21.15.144:0/723383349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 0x7f1fbc0cd350 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc0b02b0 tx=0x7f1fb401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abceb6aaf13d0bda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fb8a00640 1 -- 172.21.15.144:0/723383349 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40aa610 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fb8a00640 1 -- 172.21.15.144:0/723383349 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb40af070 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.651+0000 7f1fb8a00640 1 -- 172.21.15.144:0/723383349 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40aa9d0 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 -- 172.21.15.144:0/723383349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 msgr2=0x7f1fbc0cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 --2- 172.21.15.144:0/723383349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 0x7f1fbc0cd350 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc0b02b0 tx=0x7f1fb401c4b0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 -- 172.21.15.144:0/723383349 shutdown_connections 2024-09-12T12:21:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 --2- 172.21.15.144:0/723383349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 0x7f1fbc0cd350 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 --2- 172.21.15.144:0/723383349 >> v2:172.21.15.165:3300/0 conn(0x7f1fbc071420 0x7f1fbc071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 -- 172.21.15.144:0/723383349 >> 172.21.15.144:0/723383349 conn(0x7f1fbc06d0d0 msgr2=0x7f1fbc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 -- 172.21.15.144:0/723383349 shutdown_connections 2024-09-12T12:21:17.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 -- 172.21.15.144:0/723383349 wait complete. 2024-09-12T12:21:17.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 Processor -- start 2024-09-12T12:21:17.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 -- start start 2024-09-12T12:21:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fbc071420 0x7f1fbc14d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 0x7f1fbc14daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fbc15b4e0 0x7f1fbc15e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc15b8c0 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0cdef0 con 0x7f1fbc15b4e0 2024-09-12T12:21:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fc0e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc14dfe0 con 0x7f1fbc071420 2024-09-12T12:21:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fb9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 0x7f1fbc14daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fb9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 0x7f1fbc14daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47338/0 (socket says 172.21.15.144:47338) 2024-09-12T12:21:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fb9400640 1 -- 172.21.15.144:0/2057365000 learned_addr learned my addr 172.21.15.144:0/2057365000 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fb9e00640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fbc071420 0x7f1fbc14d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fba800640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fbc15b4e0 0x7f1fbc15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fb9400640 1 -- 172.21.15.144:0/2057365000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fbc071420 msgr2=0x7f1fbc14d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fb9400640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fbc071420 0x7f1fbc14d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fb9400640 1 -- 172.21.15.144:0/2057365000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fbc15b4e0 msgr2=0x7f1fbc15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fb9400640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fbc15b4e0 0x7f1fbc15e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.655+0000 7f1fb9400640 1 -- 172.21.15.144:0/2057365000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc0b12c0 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fb9400640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 0x7f1fbc14daa0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800d830 tx=0x7f1fa800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:17.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fb2000640 1 -- 172.21.15.144:0/2057365000 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800b6c0 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fb2000640 1 -- 172.21.15.144:0/2057365000 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa8019070 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fb2000640 1 -- 172.21.15.144:0/2057365000 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800bae0 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc0cf6c0 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc0cfc80 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fbc071800 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fb2000640 1 -- 172.21.15.144:0/2057365000 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fa801e460 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fb2000640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f9c0678c0 0x7f1f9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fb2000640 1 -- 172.21.15.144:0/2057365000 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f1fa8086430 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.659+0000 7f1fb9e00640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f9c0678c0 0x7f1f9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.663+0000 7f1fb9e00640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f9c0678c0 0x7f1f9c069d80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00b450 tx=0x7f1fac00d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:17.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.663+0000 7f1fb2000640 1 -- 172.21.15.144:0/2057365000 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1fa8056780 con 0x7f1fbc0ccf30 2024-09-12T12:21:17.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.827+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fbc0686c0 con 0x7f1f9c0678c0 2024-09-12T12:21:17.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.835+0000 7f1fb2000640 1 -- 172.21.15.144:0/2057365000 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252453 (secure 0 0 0) 0x7f1fbc0686c0 con 0x7f1f9c0678c0 2024-09-12T12:21:17.838 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:17.840 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:21:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f9c0678c0 msgr2=0x7f1f9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f9c0678c0 0x7f1f9c069d80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00b450 tx=0x7f1fac00d040 comp rx=0 tx=0).stop 2024-09-12T12:21:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 msgr2=0x7f1fbc14daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 0x7f1fbc14daa0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800d830 tx=0x7f1fa800dcf0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 shutdown_connections 2024-09-12T12:21:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f9c0678c0 0x7f1f9c069d80 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fbc15b4e0 0x7f1fbc15e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fbc0ccf30 0x7f1fbc14daa0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 --2- 172.21.15.144:0/2057365000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fbc071420 0x7f1fbc14d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:17.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 >> 172.21.15.144:0/2057365000 conn(0x7f1fbc06d0d0 msgr2=0x7f1fbc165470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:17.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 shutdown_connections 2024-09-12T12:21:17.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:17.839+0000 7f1fc0e00640 1 -- 172.21.15.144:0/2057365000 wait complete. 2024-09-12T12:21:17.859 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":395,"stamp":"2024-09-12T12:21:17.485622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":394832,"kb_used_data":14792,"kb_used_omap":12,"kb_used_meta":379827,"kb_avail":754579888,"statfs":{"total":773094113280,"available":772689805312,"internally_reserved":0,"allocated":15147008,"data_stored":7730244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":388943409},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001181"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467822+0000","last_change":"2024-09-12T12:21:13.399898+0000","last_active":"2024-09-12T12:21:14.467822+0000","last_peered":"2024-09-12T12:21:14.467822+0000","last_clean":"2024-09-12T12:21:14.467822+0000","last_became_active":"2024-09-12T12:21:13.398311+0000","last_became_peered":"2024-09-12T12:21:13.398311+0000","last_unstale":"2024-09-12T12:21:14.467822+0000","last_undegraded":"2024-09-12T12:21:14.467822+0000","last_fullsized":"2024-09-12T12:21:14.467822+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:28.433436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.392952+0000","last_change":"2024-09-12T12:21:13.388907+0000","last_active":"2024-09-12T12:21:13.392952+0000","last_peered":"2024-09-12T12:21:13.392952+0000","last_clean":"2024-09-12T12:21:13.392952+0000","last_became_active":"2024-09-12T12:21:13.388630+0000","last_became_peered":"2024-09-12T12:21:13.388630+0000","last_unstale":"2024-09-12T12:21:13.392952+0000","last_undegraded":"2024-09-12T12:21:13.392952+0000","last_fullsized":"2024-09-12T12:21:13.392952+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:42.339330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371106+0000","last_change":"2024-09-12T12:21:13.381636+0000","last_active":"2024-09-12T12:21:14.371106+0000","last_peered":"2024-09-12T12:21:14.371106+0000","last_clean":"2024-09-12T12:21:14.371106+0000","last_became_active":"2024-09-12T12:21:13.381305+0000","last_became_peered":"2024-09-12T12:21:13.381305+0000","last_unstale":"2024-09-12T12:21:14.371106+0000","last_undegraded":"2024-09-12T12:21:14.371106+0000","last_fullsized":"2024-09-12T12:21:14.371106+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:26.348036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.395496+0000","last_change":"2024-09-12T12:21:13.391915+0000","last_active":"2024-09-12T12:21:13.395496+0000","last_peered":"2024-09-12T12:21:13.395496+0000","last_clean":"2024-09-12T12:21:13.395496+0000","last_became_active":"2024-09-12T12:21:13.391649+0000","last_became_peered":"2024-09-12T12:21:13.391649+0000","last_unstale":"2024-09-12T12:21:13.395496+0000","last_undegraded":"2024-09-12T12:21:13.395496+0000","last_fullsized":"2024-09-12T12:21:13.395496+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:14:09.804903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.392745+0000","last_change":"2024-09-12T12:21:13.389041+0000","last_active":"2024-09-12T12:21:13.392745+0000","last_peered":"2024-09-12T12:21:13.392745+0000","last_clean":"2024-09-12T12:21:13.392745+0000","last_became_active":"2024-09-12T12:21:13.388784+0000","last_became_peered":"2024-09-12T12:21:13.388784+0000","last_unstale":"2024-09-12T12:21:13.392745+0000","last_undegraded":"2024-09-12T12:21:13.392745+0000","last_fullsized":"2024-09-12T12:21:13.392745+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:00:56.929518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369025+0000","last_change":"2024-09-12T12:21:13.381047+0000","last_active":"2024-09-12T12:21:14.369025+0000","last_peered":"2024-09-12T12:21:14.369025+0000","last_clean":"2024-09-12T12:21:14.369025+0000","last_became_active":"2024-09-12T12:21:13.380777+0000","last_became_peered":"2024-09-12T12:21:13.380777+0000","last_unstale":"2024-09-12T12:21:14.369025+0000","last_undegraded":"2024-09-12T12:21:14.369025+0000","last_fullsized":"2024-09-12T12:21:14.369025+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.454252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.396448+0000","last_change":"2024-09-12T12:21:13.392806+0000","last_active":"2024-09-12T12:21:13.396448+0000","last_peered":"2024-09-12T12:21:13.396448+0000","last_clean":"2024-09-12T12:21:13.396448+0000","last_became_active":"2024-09-12T12:21:13.390785+0000","last_became_peered":"2024-09-12T12:21:13.390785+0000","last_unstale":"2024-09-12T12:21:13.396448+0000","last_undegraded":"2024-09-12T12:21:13.396448+0000","last_fullsized":"2024-09-12T12:21:13.396448+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370634+0000","last_change":"2024-09-12T12:21:13.402925+0000","last_active":"2024-09-12T12:21:14.370634+0000","last_peered":"2024-09-12T12:21:14.370634+0000","last_clean":"2024-09-12T12:21:14.370634+0000","last_became_active":"2024-09-12T12:21:13.402634+0000","last_became_peered":"2024-09-12T12:21:13.402634+0000","last_unstale":"2024-09-12T12:21:14.370634+0000","last_undegraded":"2024-09-12T12:21:14.370634+0000","last_fullsized":"2024-09-12T12:21:14.370634+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:08.075425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369621+0000","last_change":"2024-09-12T12:21:13.388248+0000","last_active":"2024-09-12T12:21:14.369621+0000","last_peered":"2024-09-12T12:21:14.369621+0000","last_clean":"2024-09-12T12:21:14.369621+0000","last_became_active":"2024-09-12T12:21:13.387795+0000","last_became_peered":"2024-09-12T12:21:13.387795+0000","last_unstale":"2024-09-12T12:21:14.369621+0000","last_undegraded":"2024-09-12T12:21:14.369621+0000","last_fullsized":"2024-09-12T12:21:14.369621+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.398689+0000","last_change":"2024-09-12T12:21:13.388353+0000","last_active":"2024-09-12T12:21:13.398689+0000","last_peered":"2024-09-12T12:21:13.398689+0000","last_clean":"2024-09-12T12:21:13.398689+0000","last_became_active":"2024-09-12T12:21:13.388043+0000","last_became_peered":"2024-09-12T12:21:13.388043+0000","last_unstale":"2024-09-12T12:21:13.398689+0000","last_undegraded":"2024-09-12T12:21:13.398689+0000","last_fullsized":"2024-09-12T12:21:13.398689+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:00.157866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.392498+0000","last_change":"2024-09-12T12:21:13.389038+0000","last_active":"2024-09-12T12:21:13.392498+0000","last_peered":"2024-09-12T12:21:13.392498+0000","last_clean":"2024-09-12T12:21:13.392498+0000","last_became_active":"2024-09-12T12:21:13.388756+0000","last_became_peered":"2024-09-12T12:21:13.388756+0000","last_unstale":"2024-09-12T12:21:13.392498+0000","last_undegraded":"2024-09-12T12:21:13.392498+0000","last_fullsized":"2024-09-12T12:21:13.392498+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:24.155582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467820+0000","last_change":"2024-09-12T12:21:13.396187+0000","last_active":"2024-09-12T12:21:14.467820+0000","last_peered":"2024-09-12T12:21:14.467820+0000","last_clean":"2024-09-12T12:21:14.467820+0000","last_became_active":"2024-09-12T12:21:13.395842+0000","last_became_peered":"2024-09-12T12:21:13.395842+0000","last_unstale":"2024-09-12T12:21:14.467820+0000","last_undegraded":"2024-09-12T12:21:14.467820+0000","last_fullsized":"2024-09-12T12:21:14.467820+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:05:26.084267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369179+0000","last_change":"2024-09-12T12:21:13.379512+0000","last_active":"2024-09-12T12:21:14.369179+0000","last_peered":"2024-09-12T12:21:14.369179+0000","last_clean":"2024-09-12T12:21:14.369179+0000","last_became_active":"2024-09-12T12:21:13.379211+0000","last_became_peered":"2024-09-12T12:21:13.379211+0000","last_unstale":"2024-09-12T12:21:14.369179+0000","last_undegraded":"2024-09-12T12:21:14.369179+0000","last_fullsized":"2024-09-12T12:21:14.369179+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:50:17.960949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467597+0000","last_change":"2024-09-12T12:21:13.392910+0000","last_active":"2024-09-12T12:21:14.467597+0000","last_peered":"2024-09-12T12:21:14.467597+0000","last_clean":"2024-09-12T12:21:14.467597+0000","last_became_active":"2024-09-12T12:21:13.392239+0000","last_became_peered":"2024-09-12T12:21:13.392239+0000","last_unstale":"2024-09-12T12:21:14.467597+0000","last_undegraded":"2024-09-12T12:21:14.467597+0000","last_fullsized":"2024-09-12T12:21:14.467597+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:05.008529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467518+0000","last_change":"2024-09-12T12:21:13.397559+0000","last_active":"2024-09-12T12:21:14.467518+0000","last_peered":"2024-09-12T12:21:14.467518+0000","last_clean":"2024-09-12T12:21:14.467518+0000","last_became_active":"2024-09-12T12:21:13.396710+0000","last_became_peered":"2024-09-12T12:21:13.396710+0000","last_unstale":"2024-09-12T12:21:14.467518+0000","last_undegraded":"2024-09-12T12:21:14.467518+0000","last_fullsized":"2024-09-12T12:21:14.467518+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:31.120920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368670+0000","last_change":"2024-09-12T12:21:13.390406+0000","last_active":"2024-09-12T12:21:14.368670+0000","last_peered":"2024-09-12T12:21:14.368670+0000","last_clean":"2024-09-12T12:21:14.368670+0000","last_became_active":"2024-09-12T12:21:13.390089+0000","last_became_peered":"2024-09-12T12:21:13.390089+0000","last_unstale":"2024-09-12T12:21:14.368670+0000","last_undegraded":"2024-09-12T12:21:14.368670+0000","last_fullsized":"2024-09-12T12:21:14.368670+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:39.829364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369664+0000","last_change":"2024-09-12T12:21:13.392177+0000","last_active":"2024-09-12T12:21:14.369664+0000","last_peered":"2024-09-12T12:21:14.369664+0000","last_clean":"2024-09-12T12:21:14.369664+0000","last_became_active":"2024-09-12T12:21:13.389401+0000","last_became_peered":"2024-09-12T12:21:13.389401+0000","last_unstale":"2024-09-12T12:21:14.369664+0000","last_undegraded":"2024-09-12T12:21:14.369664+0000","last_fullsized":"2024-09-12T12:21:14.369664+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:55.636749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.393273+0000","last_change":"2024-09-12T12:21:13.389660+0000","last_active":"2024-09-12T12:21:13.393273+0000","last_peered":"2024-09-12T12:21:13.393273+0000","last_clean":"2024-09-12T12:21:13.393273+0000","last_became_active":"2024-09-12T12:21:13.389388+0000","last_became_peered":"2024-09-12T12:21:13.389388+0000","last_unstale":"2024-09-12T12:21:13.393273+0000","last_undegraded":"2024-09-12T12:21:13.393273+0000","last_fullsized":"2024-09-12T12:21:13.393273+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:30:27.388416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.396528+0000","last_change":"2024-09-12T12:21:13.393188+0000","last_active":"2024-09-12T12:21:13.396528+0000","last_peered":"2024-09-12T12:21:13.396528+0000","last_clean":"2024-09-12T12:21:13.396528+0000","last_became_active":"2024-09-12T12:21:13.392343+0000","last_became_peered":"2024-09-12T12:21:13.392343+0000","last_unstale":"2024-09-12T12:21:13.396528+0000","last_undegraded":"2024-09-12T12:21:13.396528+0000","last_fullsized":"2024-09-12T12:21:13.396528+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:55.636749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.388770+0000","last_change":"2024-09-12T12:21:13.382442+0000","last_active":"2024-09-12T12:21:13.388770+0000","last_peered":"2024-09-12T12:21:13.388770+0000","last_clean":"2024-09-12T12:21:13.388770+0000","last_became_active":"2024-09-12T12:21:13.382135+0000","last_became_peered":"2024-09-12T12:21:13.382135+0000","last_unstale":"2024-09-12T12:21:13.388770+0000","last_undegraded":"2024-09-12T12:21:13.388770+0000","last_fullsized":"2024-09-12T12:21:13.388770+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:55.224628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.385211+0000","last_change":"2024-09-12T12:21:13.383430+0000","last_active":"2024-09-12T12:21:13.385211+0000","last_peered":"2024-09-12T12:21:13.385211+0000","last_clean":"2024-09-12T12:21:13.385211+0000","last_became_active":"2024-09-12T12:21:13.380958+0000","last_became_peered":"2024-09-12T12:21:13.380958+0000","last_unstale":"2024-09-12T12:21:13.385211+0000","last_undegraded":"2024-09-12T12:21:13.385211+0000","last_fullsized":"2024-09-12T12:21:13.385211+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:28.608303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467530+0000","last_change":"2024-09-12T12:21:13.395860+0000","last_active":"2024-09-12T12:21:14.467530+0000","last_peered":"2024-09-12T12:21:14.467530+0000","last_clean":"2024-09-12T12:21:14.467530+0000","last_became_active":"2024-09-12T12:21:13.395535+0000","last_became_peered":"2024-09-12T12:21:13.395535+0000","last_unstale":"2024-09-12T12:21:14.467530+0000","last_undegraded":"2024-09-12T12:21:14.467530+0000","last_fullsized":"2024-09-12T12:21:14.467530+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:16.578380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.387708+0000","last_change":"2024-09-12T12:21:13.385067+0000","last_active":"2024-09-12T12:21:13.387708+0000","last_peered":"2024-09-12T12:21:13.387708+0000","last_clean":"2024-09-12T12:21:13.387708+0000","last_became_active":"2024-09-12T12:21:13.384492+0000","last_became_peered":"2024-09-12T12:21:13.384492+0000","last_unstale":"2024-09-12T12:21:13.387708+0000","last_undegraded":"2024-09-12T12:21:13.387708+0000","last_fullsized":"2024-09-12T12:21:13.387708+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:08.075425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368740+0000","last_change":"2024-09-12T12:21:13.385768+0000","last_active":"2024-09-12T12:21:14.368740+0000","last_peered":"2024-09-12T12:21:14.368740+0000","last_clean":"2024-09-12T12:21:14.368740+0000","last_became_active":"2024-09-12T12:21:13.384894+0000","last_became_peered":"2024-09-12T12:21:13.384894+0000","last_unstale":"2024-09-12T12:21:14.368740+0000","last_undegraded":"2024-09-12T12:21:14.368740+0000","last_fullsized":"2024-09-12T12:21:14.368740+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.356428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371416+0000","last_change":"2024-09-12T12:21:13.396857+0000","last_active":"2024-09-12T12:21:14.371416+0000","last_peered":"2024-09-12T12:21:14.371416+0000","last_clean":"2024-09-12T12:21:14.371416+0000","last_became_active":"2024-09-12T12:21:13.395733+0000","last_became_peered":"2024-09-12T12:21:13.395733+0000","last_unstale":"2024-09-12T12:21:14.371416+0000","last_undegraded":"2024-09-12T12:21:14.371416+0000","last_fullsized":"2024-09-12T12:21:14.371416+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:11.998462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371254+0000","last_change":"2024-09-12T12:21:13.385053+0000","last_active":"2024-09-12T12:21:14.371254+0000","last_peered":"2024-09-12T12:21:14.371254+0000","last_clean":"2024-09-12T12:21:14.371254+0000","last_became_active":"2024-09-12T12:21:13.384722+0000","last_became_peered":"2024-09-12T12:21:13.384722+0000","last_unstale":"2024-09-12T12:21:14.371254+0000","last_undegraded":"2024-09-12T12:21:14.371254+0000","last_fullsized":"2024-09-12T12:21:14.371254+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:42:00.019490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.406968+0000","last_change":"2024-09-12T12:21:13.405425+0000","last_active":"2024-09-12T12:21:13.406968+0000","last_peered":"2024-09-12T12:21:13.406968+0000","last_clean":"2024-09-12T12:21:13.406968+0000","last_became_active":"2024-09-12T12:21:13.405108+0000","last_became_peered":"2024-09-12T12:21:13.405108+0000","last_unstale":"2024-09-12T12:21:13.406968+0000","last_undegraded":"2024-09-12T12:21:13.406968+0000","last_fullsized":"2024-09-12T12:21:13.406968+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:42:00.019490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.401617+0000","last_change":"2024-09-12T12:21:13.390382+0000","last_active":"2024-09-12T12:21:13.401617+0000","last_peered":"2024-09-12T12:21:13.401617+0000","last_clean":"2024-09-12T12:21:13.401617+0000","last_became_active":"2024-09-12T12:21:13.390058+0000","last_became_peered":"2024-09-12T12:21:13.390058+0000","last_unstale":"2024-09-12T12:21:13.401617+0000","last_undegraded":"2024-09-12T12:21:13.401617+0000","last_fullsized":"2024-09-12T12:21:13.401617+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:57.308131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370924+0000","last_change":"2024-09-12T12:21:13.384369+0000","last_active":"2024-09-12T12:21:14.370924+0000","last_peered":"2024-09-12T12:21:14.370924+0000","last_clean":"2024-09-12T12:21:14.370924+0000","last_became_active":"2024-09-12T12:21:13.381293+0000","last_became_peered":"2024-09-12T12:21:13.381293+0000","last_unstale":"2024-09-12T12:21:14.370924+0000","last_undegraded":"2024-09-12T12:21:14.370924+0000","last_fullsized":"2024-09-12T12:21:14.370924+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:55.636749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371265+0000","last_change":"2024-09-12T12:21:13.390005+0000","last_active":"2024-09-12T12:21:14.371265+0000","last_peered":"2024-09-12T12:21:14.371265+0000","last_clean":"2024-09-12T12:21:14.371265+0000","last_became_active":"2024-09-12T12:21:13.388836+0000","last_became_peered":"2024-09-12T12:21:13.388836+0000","last_unstale":"2024-09-12T12:21:14.371265+0000","last_undegraded":"2024-09-12T12:21:14.371265+0000","last_fullsized":"2024-09-12T12:21:14.371265+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:31.053950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369761+0000","last_change":"2024-09-12T12:21:13.387288+0000","last_active":"2024-09-12T12:21:14.369761+0000","last_peered":"2024-09-12T12:21:14.369761+0000","last_clean":"2024-09-12T12:21:14.369761+0000","last_became_active":"2024-09-12T12:21:13.387010+0000","last_became_peered":"2024-09-12T12:21:13.387010+0000","last_unstale":"2024-09-12T12:21:14.369761+0000","last_undegraded":"2024-09-12T12:21:14.369761+0000","last_fullsized":"2024-09-12T12:21:14.369761+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:15.420156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.394593+0000","last_change":"2024-09-12T12:21:13.384143+0000","last_active":"2024-09-12T12:21:13.394593+0000","last_peered":"2024-09-12T12:21:13.394593+0000","last_clean":"2024-09-12T12:21:13.394593+0000","last_became_active":"2024-09-12T12:21:13.383877+0000","last_became_peered":"2024-09-12T12:21:13.383877+0000","last_unstale":"2024-09-12T12:21:13.394593+0000","last_undegraded":"2024-09-12T12:21:13.394593+0000","last_fullsized":"2024-09-12T12:21:13.394593+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:20.704211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369754+0000","last_change":"2024-09-12T12:21:13.391857+0000","last_active":"2024-09-12T12:21:14.369754+0000","last_peered":"2024-09-12T12:21:14.369754+0000","last_clean":"2024-09-12T12:21:14.369754+0000","last_became_active":"2024-09-12T12:21:13.391611+0000","last_became_peered":"2024-09-12T12:21:13.391611+0000","last_unstale":"2024-09-12T12:21:14.369754+0000","last_undegraded":"2024-09-12T12:21:14.369754+0000","last_fullsized":"2024-09-12T12:21:14.369754+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:28.057955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"139'4","reported_seq":18,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371424+0000","last_change":"2024-09-12T12:21:12.387744+0000","last_active":"2024-09-12T12:21:14.371424+0000","last_peered":"2024-09-12T12:21:14.371424+0000","last_clean":"2024-09-12T12:21:14.371424+0000","last_became_active":"2024-09-12T12:21:12.387394+0000","last_became_peered":"2024-09-12T12:21:12.387394+0000","last_unstale":"2024-09-12T12:21:14.371424+0000","last_undegraded":"2024-09-12T12:21:14.371424+0000","last_fullsized":"2024-09-12T12:21:14.371424+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:33.314114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467572+0000","last_change":"2024-09-12T12:21:13.387308+0000","last_active":"2024-09-12T12:21:14.467572+0000","last_peered":"2024-09-12T12:21:14.467572+0000","last_clean":"2024-09-12T12:21:14.467572+0000","last_became_active":"2024-09-12T12:21:13.386997+0000","last_became_peered":"2024-09-12T12:21:13.386997+0000","last_unstale":"2024-09-12T12:21:14.467572+0000","last_undegraded":"2024-09-12T12:21:14.467572+0000","last_fullsized":"2024-09-12T12:21:14.467572+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:58.780879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"139'1","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.405476+0000","last_change":"2024-09-12T12:21:12.383972+0000","last_active":"2024-09-12T12:21:13.405476+0000","last_peered":"2024-09-12T12:21:13.405476+0000","last_clean":"2024-09-12T12:21:13.405476+0000","last_became_active":"2024-09-12T12:21:12.382896+0000","last_became_peered":"2024-09-12T12:21:12.382896+0000","last_unstale":"2024-09-12T12:21:13.405476+0000","last_undegraded":"2024-09-12T12:21:13.405476+0000","last_fullsized":"2024-09-12T12:21:13.405476+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:35.241768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.393807+0000","last_change":"2024-09-12T12:21:13.390943+0000","last_active":"2024-09-12T12:21:13.393807+0000","last_peered":"2024-09-12T12:21:13.393807+0000","last_clean":"2024-09-12T12:21:13.393807+0000","last_became_active":"2024-09-12T12:21:13.390615+0000","last_became_peered":"2024-09-12T12:21:13.390615+0000","last_unstale":"2024-09-12T12:21:13.393807+0000","last_undegraded":"2024-09-12T12:21:13.393807+0000","last_fullsized":"2024-09-12T12:21:13.393807+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:11.073373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"139'2","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.407148+0000","last_change":"2024-09-12T12:21:12.387883+0000","last_active":"2024-09-12T12:21:13.407148+0000","last_peered":"2024-09-12T12:21:13.407148+0000","last_clean":"2024-09-12T12:21:13.407148+0000","last_became_active":"2024-09-12T12:21:12.387368+0000","last_became_peered":"2024-09-12T12:21:12.387368+0000","last_unstale":"2024-09-12T12:21:13.407148+0000","last_undegraded":"2024-09-12T12:21:13.407148+0000","last_fullsized":"2024-09-12T12:21:13.407148+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:36.450860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467582+0000","last_change":"2024-09-12T12:21:13.394712+0000","last_active":"2024-09-12T12:21:14.467582+0000","last_peered":"2024-09-12T12:21:14.467582+0000","last_clean":"2024-09-12T12:21:14.467582+0000","last_became_active":"2024-09-12T12:21:13.394427+0000","last_became_peered":"2024-09-12T12:21:13.394427+0000","last_unstale":"2024-09-12T12:21:14.467582+0000","last_undegraded":"2024-09-12T12:21:14.467582+0000","last_fullsized":"2024-09-12T12:21:14.467582+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:12.903609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"139'2","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.406956+0000","last_change":"2024-09-12T12:21:12.382360+0000","last_active":"2024-09-12T12:21:13.406956+0000","last_peered":"2024-09-12T12:21:13.406956+0000","last_clean":"2024-09-12T12:21:13.406956+0000","last_became_active":"2024-09-12T12:21:12.382048+0000","last_became_peered":"2024-09-12T12:21:12.382048+0000","last_unstale":"2024-09-12T12:21:13.406956+0000","last_undegraded":"2024-09-12T12:21:13.406956+0000","last_fullsized":"2024-09-12T12:21:13.406956+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:35.093964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370487+0000","last_change":"2024-09-12T12:21:13.400944+0000","last_active":"2024-09-12T12:21:14.370487+0000","last_peered":"2024-09-12T12:21:14.370487+0000","last_clean":"2024-09-12T12:21:14.370487+0000","last_became_active":"2024-09-12T12:21:13.400608+0000","last_became_peered":"2024-09-12T12:21:13.400608+0000","last_unstale":"2024-09-12T12:21:14.370487+0000","last_undegraded":"2024-09-12T12:21:14.370487+0000","last_fullsized":"2024-09-12T12:21:14.370487+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:47.690428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"139'1","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370281+0000","last_change":"2024-09-12T12:21:12.383823+0000","last_active":"2024-09-12T12:21:14.370281+0000","last_peered":"2024-09-12T12:21:14.370281+0000","last_clean":"2024-09-12T12:21:14.370281+0000","last_became_active":"2024-09-12T12:21:12.383485+0000","last_became_peered":"2024-09-12T12:21:12.383485+0000","last_unstale":"2024-09-12T12:21:14.370281+0000","last_undegraded":"2024-09-12T12:21:14.370281+0000","last_fullsized":"2024-09-12T12:21:14.370281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:39.214918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370569+0000","last_change":"2024-09-12T12:21:13.403519+0000","last_active":"2024-09-12T12:21:14.370569+0000","last_peered":"2024-09-12T12:21:14.370569+0000","last_clean":"2024-09-12T12:21:14.370569+0000","last_became_active":"2024-09-12T12:21:13.403254+0000","last_became_peered":"2024-09-12T12:21:13.403254+0000","last_unstale":"2024-09-12T12:21:14.370569+0000","last_undegraded":"2024-09-12T12:21:14.370569+0000","last_fullsized":"2024-09-12T12:21:14.370569+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:28.608303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"139'1","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.404590+0000","last_change":"2024-09-12T12:21:12.378580+0000","last_active":"2024-09-12T12:21:13.404590+0000","last_peered":"2024-09-12T12:21:13.404590+0000","last_clean":"2024-09-12T12:21:13.404590+0000","last_became_active":"2024-09-12T12:21:12.378320+0000","last_became_peered":"2024-09-12T12:21:12.378320+0000","last_unstale":"2024-09-12T12:21:13.404590+0000","last_undegraded":"2024-09-12T12:21:13.404590+0000","last_fullsized":"2024-09-12T12:21:13.404590+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:59.904600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.388011+0000","last_change":"2024-09-12T12:21:13.383605+0000","last_active":"2024-09-12T12:21:13.388011+0000","last_peered":"2024-09-12T12:21:13.388011+0000","last_clean":"2024-09-12T12:21:13.388011+0000","last_became_active":"2024-09-12T12:21:13.383235+0000","last_became_peered":"2024-09-12T12:21:13.383235+0000","last_unstale":"2024-09-12T12:21:13.388011+0000","last_undegraded":"2024-09-12T12:21:13.388011+0000","last_fullsized":"2024-09-12T12:21:13.388011+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:57:58.209405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368757+0000","last_change":"2024-09-12T12:21:12.380913+0000","last_active":"2024-09-12T12:21:14.368757+0000","last_peered":"2024-09-12T12:21:14.368757+0000","last_clean":"2024-09-12T12:21:14.368757+0000","last_became_active":"2024-09-12T12:21:12.380646+0000","last_became_peered":"2024-09-12T12:21:12.380646+0000","last_unstale":"2024-09-12T12:21:14.368757+0000","last_undegraded":"2024-09-12T12:21:14.368757+0000","last_fullsized":"2024-09-12T12:21:14.368757+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:08.286903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.406906+0000","last_change":"2024-09-12T12:21:13.402040+0000","last_active":"2024-09-12T12:21:13.406906+0000","last_peered":"2024-09-12T12:21:13.406906+0000","last_clean":"2024-09-12T12:21:13.406906+0000","last_became_active":"2024-09-12T12:21:13.401751+0000","last_became_peered":"2024-09-12T12:21:13.401751+0000","last_unstale":"2024-09-12T12:21:13.406906+0000","last_undegraded":"2024-09-12T12:21:13.406906+0000","last_fullsized":"2024-09-12T12:21:13.406906+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:31.053950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370683+0000","last_change":"2024-09-12T12:21:12.381350+0000","last_active":"2024-09-12T12:21:14.370683+0000","last_peered":"2024-09-12T12:21:14.370683+0000","last_clean":"2024-09-12T12:21:14.370683+0000","last_became_active":"2024-09-12T12:21:12.380913+0000","last_became_peered":"2024-09-12T12:21:12.380913+0000","last_unstale":"2024-09-12T12:21:14.370683+0000","last_undegraded":"2024-09-12T12:21:14.370683+0000","last_fullsized":"2024-09-12T12:21:14.370683+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:27.604911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467508+0000","last_change":"2024-09-12T12:21:13.386309+0000","last_active":"2024-09-12T12:21:14.467508+0000","last_peered":"2024-09-12T12:21:14.467508+0000","last_clean":"2024-09-12T12:21:14.467508+0000","last_became_active":"2024-09-12T12:21:13.385984+0000","last_became_peered":"2024-09-12T12:21:13.385984+0000","last_unstale":"2024-09-12T12:21:14.467508+0000","last_undegraded":"2024-09-12T12:21:14.467508+0000","last_fullsized":"2024-09-12T12:21:14.467508+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:49.283837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.375829+0000","last_change":"2024-09-12T12:21:12.391700+0000","last_active":"2024-09-12T12:21:13.375829+0000","last_peered":"2024-09-12T12:21:13.375829+0000","last_clean":"2024-09-12T12:21:13.375829+0000","last_became_active":"2024-09-12T12:21:12.391392+0000","last_became_peered":"2024-09-12T12:21:12.391392+0000","last_unstale":"2024-09-12T12:21:13.375829+0000","last_undegraded":"2024-09-12T12:21:13.375829+0000","last_fullsized":"2024-09-12T12:21:13.375829+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:27.054563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368971+0000","last_change":"2024-09-12T12:21:13.384013+0000","last_active":"2024-09-12T12:21:14.368971+0000","last_peered":"2024-09-12T12:21:14.368971+0000","last_clean":"2024-09-12T12:21:14.368971+0000","last_became_active":"2024-09-12T12:21:13.382528+0000","last_became_peered":"2024-09-12T12:21:13.382528+0000","last_unstale":"2024-09-12T12:21:14.368971+0000","last_undegraded":"2024-09-12T12:21:14.368971+0000","last_fullsized":"2024-09-12T12:21:14.368971+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:36.097355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467782+0000","last_change":"2024-09-12T12:21:12.390351+0000","last_active":"2024-09-12T12:21:14.467782+0000","last_peered":"2024-09-12T12:21:14.467782+0000","last_clean":"2024-09-12T12:21:14.467782+0000","last_became_active":"2024-09-12T12:21:12.389273+0000","last_became_peered":"2024-09-12T12:21:12.389273+0000","last_unstale":"2024-09-12T12:21:14.467782+0000","last_undegraded":"2024-09-12T12:21:14.467782+0000","last_fullsized":"2024-09-12T12:21:14.467782+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:17.770615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371412+0000","last_change":"2024-09-12T12:21:13.385400+0000","last_active":"2024-09-12T12:21:14.371412+0000","last_peered":"2024-09-12T12:21:14.371412+0000","last_clean":"2024-09-12T12:21:14.371412+0000","last_became_active":"2024-09-12T12:21:13.384347+0000","last_became_peered":"2024-09-12T12:21:13.384347+0000","last_unstale":"2024-09-12T12:21:14.371412+0000","last_undegraded":"2024-09-12T12:21:14.371412+0000","last_fullsized":"2024-09-12T12:21:14.371412+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:57.593791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"139'3","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.406923+0000","last_change":"2024-09-12T12:21:12.381304+0000","last_active":"2024-09-12T12:21:13.406923+0000","last_peered":"2024-09-12T12:21:13.406923+0000","last_clean":"2024-09-12T12:21:13.406923+0000","last_became_active":"2024-09-12T12:21:12.381050+0000","last_became_peered":"2024-09-12T12:21:12.381050+0000","last_unstale":"2024-09-12T12:21:13.406923+0000","last_undegraded":"2024-09-12T12:21:13.406923+0000","last_fullsized":"2024-09-12T12:21:13.406923+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:50:16.957557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370965+0000","last_change":"2024-09-12T12:21:13.377293+0000","last_active":"2024-09-12T12:21:14.370965+0000","last_peered":"2024-09-12T12:21:14.370965+0000","last_clean":"2024-09-12T12:21:14.370965+0000","last_became_active":"2024-09-12T12:21:13.376996+0000","last_became_peered":"2024-09-12T12:21:13.376996+0000","last_unstale":"2024-09-12T12:21:14.370965+0000","last_undegraded":"2024-09-12T12:21:14.370965+0000","last_fullsized":"2024-09-12T12:21:14.370965+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:43.945352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"139'6","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.410483+0000","last_change":"2024-09-12T12:21:12.390446+0000","last_active":"2024-09-12T12:21:13.410483+0000","last_peered":"2024-09-12T12:21:13.410483+0000","last_clean":"2024-09-12T12:21:13.410483+0000","last_became_active":"2024-09-12T12:21:12.390070+0000","last_became_peered":"2024-09-12T12:21:12.390070+0000","last_unstale":"2024-09-12T12:21:13.410483+0000","last_undegraded":"2024-09-12T12:21:13.410483+0000","last_fullsized":"2024-09-12T12:21:13.410483+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:37.195040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.401641+0000","last_change":"2024-09-12T12:21:13.393130+0000","last_active":"2024-09-12T12:21:13.401641+0000","last_peered":"2024-09-12T12:21:13.401641+0000","last_clean":"2024-09-12T12:21:13.401641+0000","last_became_active":"2024-09-12T12:21:13.392861+0000","last_became_peered":"2024-09-12T12:21:13.392861+0000","last_unstale":"2024-09-12T12:21:13.401641+0000","last_undegraded":"2024-09-12T12:21:13.401641+0000","last_fullsized":"2024-09-12T12:21:13.401641+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:45.398397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"139'2","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467680+0000","last_change":"2024-09-12T12:21:12.391971+0000","last_active":"2024-09-12T12:21:14.467680+0000","last_peered":"2024-09-12T12:21:14.467680+0000","last_clean":"2024-09-12T12:21:14.467680+0000","last_became_active":"2024-09-12T12:21:12.391698+0000","last_became_peered":"2024-09-12T12:21:12.391698+0000","last_unstale":"2024-09-12T12:21:14.467680+0000","last_undegraded":"2024-09-12T12:21:14.467680+0000","last_fullsized":"2024-09-12T12:21:14.467680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:42.796414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.398373+0000","last_change":"2024-09-12T12:21:13.395587+0000","last_active":"2024-09-12T12:21:13.398373+0000","last_peered":"2024-09-12T12:21:13.398373+0000","last_clean":"2024-09-12T12:21:13.398373+0000","last_became_active":"2024-09-12T12:21:13.395242+0000","last_became_peered":"2024-09-12T12:21:13.395242+0000","last_unstale":"2024-09-12T12:21:13.398373+0000","last_undegraded":"2024-09-12T12:21:13.398373+0000","last_fullsized":"2024-09-12T12:21:13.398373+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:26.348036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370407+0000","last_change":"2024-09-12T12:21:12.373718+0000","last_active":"2024-09-12T12:21:14.370407+0000","last_peered":"2024-09-12T12:21:14.370407+0000","last_clean":"2024-09-12T12:21:14.370407+0000","last_became_active":"2024-09-12T12:21:12.373435+0000","last_became_peered":"2024-09-12T12:21:12.373435+0000","last_unstale":"2024-09-12T12:21:14.370407+0000","last_undegraded":"2024-09-12T12:21:14.370407+0000","last_fullsized":"2024-09-12T12:21:14.370407+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.388633+0000","last_change":"2024-09-12T12:21:13.385549+0000","last_active":"2024-09-12T12:21:13.388633+0000","last_peered":"2024-09-12T12:21:13.388633+0000","last_clean":"2024-09-12T12:21:13.388633+0000","last_became_active":"2024-09-12T12:21:13.385299+0000","last_became_peered":"2024-09-12T12:21:13.385299+0000","last_unstale":"2024-09-12T12:21:13.388633+0000","last_undegraded":"2024-09-12T12:21:13.388633+0000","last_fullsized":"2024-09-12T12:21:13.388633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:29.936773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"139'8","reported_seq":22,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368768+0000","last_change":"2024-09-12T12:21:12.380667+0000","last_active":"2024-09-12T12:21:14.368768+0000","last_peered":"2024-09-12T12:21:14.368768+0000","last_clean":"2024-09-12T12:21:14.368768+0000","last_became_active":"2024-09-12T12:21:12.380358+0000","last_became_peered":"2024-09-12T12:21:12.380358+0000","last_unstale":"2024-09-12T12:21:14.368768+0000","last_undegraded":"2024-09-12T12:21:14.368768+0000","last_fullsized":"2024-09-12T12:21:14.368768+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:23.328841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370289+0000","last_change":"2024-09-12T12:21:13.384613+0000","last_active":"2024-09-12T12:21:14.370289+0000","last_peered":"2024-09-12T12:21:14.370289+0000","last_clean":"2024-09-12T12:21:14.370289+0000","last_became_active":"2024-09-12T12:21:13.381613+0000","last_became_peered":"2024-09-12T12:21:13.381613+0000","last_unstale":"2024-09-12T12:21:14.370289+0000","last_undegraded":"2024-09-12T12:21:14.370289+0000","last_fullsized":"2024-09-12T12:21:14.370289+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:58.482987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"139'1","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.404736+0000","last_change":"2024-09-12T12:21:12.379544+0000","last_active":"2024-09-12T12:21:13.404736+0000","last_peered":"2024-09-12T12:21:13.404736+0000","last_clean":"2024-09-12T12:21:13.404736+0000","last_became_active":"2024-09-12T12:21:12.379063+0000","last_became_peered":"2024-09-12T12:21:12.379063+0000","last_unstale":"2024-09-12T12:21:13.404736+0000","last_undegraded":"2024-09-12T12:21:13.404736+0000","last_fullsized":"2024-09-12T12:21:13.404736+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:14.416764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.398053+0000","last_change":"2024-09-12T12:21:13.394324+0000","last_active":"2024-09-12T12:21:13.398053+0000","last_peered":"2024-09-12T12:21:13.398053+0000","last_clean":"2024-09-12T12:21:13.398053+0000","last_became_active":"2024-09-12T12:21:13.394023+0000","last_became_peered":"2024-09-12T12:21:13.394023+0000","last_unstale":"2024-09-12T12:21:13.398053+0000","last_undegraded":"2024-09-12T12:21:13.398053+0000","last_fullsized":"2024-09-12T12:21:13.398053+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:43.945352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"139'2","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371379+0000","last_change":"2024-09-12T12:21:12.385047+0000","last_active":"2024-09-12T12:21:14.371379+0000","last_peered":"2024-09-12T12:21:14.371379+0000","last_clean":"2024-09-12T12:21:14.371379+0000","last_became_active":"2024-09-12T12:21:12.384576+0000","last_became_peered":"2024-09-12T12:21:12.384576+0000","last_unstale":"2024-09-12T12:21:14.371379+0000","last_undegraded":"2024-09-12T12:21:14.371379+0000","last_fullsized":"2024-09-12T12:21:14.371379+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:07.072034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.394049+0000","last_change":"2024-09-12T12:21:13.391300+0000","last_active":"2024-09-12T12:21:13.394049+0000","last_peered":"2024-09-12T12:21:13.394049+0000","last_clean":"2024-09-12T12:21:13.394049+0000","last_became_active":"2024-09-12T12:21:13.391008+0000","last_became_peered":"2024-09-12T12:21:13.391008+0000","last_unstale":"2024-09-12T12:21:13.394049+0000","last_undegraded":"2024-09-12T12:21:13.394049+0000","last_fullsized":"2024-09-12T12:21:13.394049+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:41.499866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"139'1","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369579+0000","last_change":"2024-09-12T12:21:12.380400+0000","last_active":"2024-09-12T12:21:14.369579+0000","last_peered":"2024-09-12T12:21:14.369579+0000","last_clean":"2024-09-12T12:21:14.369579+0000","last_became_active":"2024-09-12T12:21:12.380112+0000","last_became_peered":"2024-09-12T12:21:12.380112+0000","last_unstale":"2024-09-12T12:21:14.369579+0000","last_undegraded":"2024-09-12T12:21:14.369579+0000","last_fullsized":"2024-09-12T12:21:14.369579+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:14.416764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.397375+0000","last_change":"2024-09-12T12:21:13.385373+0000","last_active":"2024-09-12T12:21:13.397375+0000","last_peered":"2024-09-12T12:21:13.397375+0000","last_clean":"2024-09-12T12:21:13.397375+0000","last_became_active":"2024-09-12T12:21:13.384663+0000","last_became_peered":"2024-09-12T12:21:13.384663+0000","last_unstale":"2024-09-12T12:21:13.397375+0000","last_undegraded":"2024-09-12T12:21:13.397375+0000","last_fullsized":"2024-09-12T12:21:13.397375+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:38.607461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.370053+0000","last_change":"2024-09-12T12:21:12.387440+0000","last_active":"2024-09-12T12:21:13.370053+0000","last_peered":"2024-09-12T12:21:13.370053+0000","last_clean":"2024-09-12T12:21:13.370053+0000","last_became_active":"2024-09-12T12:21:12.387172+0000","last_became_peered":"2024-09-12T12:21:12.387172+0000","last_unstale":"2024-09-12T12:21:13.370053+0000","last_undegraded":"2024-09-12T12:21:13.370053+0000","last_fullsized":"2024-09-12T12:21:13.370053+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:58.499071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.395940+0000","last_change":"2024-09-12T12:21:13.393819+0000","last_active":"2024-09-12T12:21:13.395940+0000","last_peered":"2024-09-12T12:21:13.395940+0000","last_clean":"2024-09-12T12:21:13.395940+0000","last_became_active":"2024-09-12T12:21:13.393555+0000","last_became_peered":"2024-09-12T12:21:13.393555+0000","last_unstale":"2024-09-12T12:21:13.395940+0000","last_undegraded":"2024-09-12T12:21:13.395940+0000","last_fullsized":"2024-09-12T12:21:13.395940+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:32.872122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"139'2","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370815+0000","last_change":"2024-09-12T12:21:12.375166+0000","last_active":"2024-09-12T12:21:14.370815+0000","last_peered":"2024-09-12T12:21:14.370815+0000","last_clean":"2024-09-12T12:21:14.370815+0000","last_became_active":"2024-09-12T12:21:12.374906+0000","last_became_peered":"2024-09-12T12:21:12.374906+0000","last_unstale":"2024-09-12T12:21:14.370815+0000","last_undegraded":"2024-09-12T12:21:14.370815+0000","last_fullsized":"2024-09-12T12:21:14.370815+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:12.953413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467778+0000","last_change":"2024-09-12T12:21:13.393688+0000","last_active":"2024-09-12T12:21:14.467778+0000","last_peered":"2024-09-12T12:21:14.467778+0000","last_clean":"2024-09-12T12:21:14.467778+0000","last_became_active":"2024-09-12T12:21:13.393440+0000","last_became_peered":"2024-09-12T12:21:13.393440+0000","last_unstale":"2024-09-12T12:21:14.467778+0000","last_undegraded":"2024-09-12T12:21:14.467778+0000","last_fullsized":"2024-09-12T12:21:14.467778+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:58.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467628+0000","last_change":"2024-09-12T12:21:12.391146+0000","last_active":"2024-09-12T12:21:14.467628+0000","last_peered":"2024-09-12T12:21:14.467628+0000","last_clean":"2024-09-12T12:21:14.467628+0000","last_became_active":"2024-09-12T12:21:12.390765+0000","last_became_peered":"2024-09-12T12:21:12.390765+0000","last_unstale":"2024-09-12T12:21:14.467628+0000","last_undegraded":"2024-09-12T12:21:14.467628+0000","last_fullsized":"2024-09-12T12:21:14.467628+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:35.175428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.387987+0000","last_change":"2024-09-12T12:21:13.380957+0000","last_active":"2024-09-12T12:21:13.387987+0000","last_peered":"2024-09-12T12:21:13.387987+0000","last_clean":"2024-09-12T12:21:13.387987+0000","last_became_active":"2024-09-12T12:21:13.379524+0000","last_became_peered":"2024-09-12T12:21:13.379524+0000","last_unstale":"2024-09-12T12:21:13.387987+0000","last_undegraded":"2024-09-12T12:21:13.387987+0000","last_fullsized":"2024-09-12T12:21:13.387987+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:59.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.383562+0000","last_change":"2024-09-12T12:21:12.393235+0000","last_active":"2024-09-12T12:21:13.383562+0000","last_peered":"2024-09-12T12:21:13.383562+0000","last_clean":"2024-09-12T12:21:13.383562+0000","last_became_active":"2024-09-12T12:21:12.392931+0000","last_became_peered":"2024-09-12T12:21:12.392931+0000","last_unstale":"2024-09-12T12:21:13.383562+0000","last_undegraded":"2024-09-12T12:21:13.383562+0000","last_fullsized":"2024-09-12T12:21:13.383562+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:11.314153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.390146+0000","last_change":"2024-09-12T12:21:13.387480+0000","last_active":"2024-09-12T12:21:13.390146+0000","last_peered":"2024-09-12T12:21:13.390146+0000","last_clean":"2024-09-12T12:21:13.390146+0000","last_became_active":"2024-09-12T12:21:13.386946+0000","last_became_peered":"2024-09-12T12:21:13.386946+0000","last_unstale":"2024-09-12T12:21:13.390146+0000","last_undegraded":"2024-09-12T12:21:13.390146+0000","last_fullsized":"2024-09-12T12:21:13.390146+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:34.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368830+0000","last_change":"2024-09-12T12:21:12.387407+0000","last_active":"2024-09-12T12:21:14.368830+0000","last_peered":"2024-09-12T12:21:14.368830+0000","last_clean":"2024-09-12T12:21:14.368830+0000","last_became_active":"2024-09-12T12:21:12.387092+0000","last_became_peered":"2024-09-12T12:21:12.387092+0000","last_unstale":"2024-09-12T12:21:14.368830+0000","last_undegraded":"2024-09-12T12:21:14.368830+0000","last_fullsized":"2024-09-12T12:21:14.368830+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:10.191644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.390683+0000","last_change":"2024-09-12T12:21:13.387089+0000","last_active":"2024-09-12T12:21:13.390683+0000","last_peered":"2024-09-12T12:21:13.390683+0000","last_clean":"2024-09-12T12:21:13.390683+0000","last_became_active":"2024-09-12T12:21:13.386722+0000","last_became_peered":"2024-09-12T12:21:13.386722+0000","last_unstale":"2024-09-12T12:21:13.390683+0000","last_undegraded":"2024-09-12T12:21:13.390683+0000","last_fullsized":"2024-09-12T12:21:13.390683+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:07.026950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"139'2","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.467965+0000","last_change":"2024-09-12T12:21:12.388421+0000","last_active":"2024-09-12T12:21:14.467965+0000","last_peered":"2024-09-12T12:21:14.467965+0000","last_clean":"2024-09-12T12:21:14.467965+0000","last_became_active":"2024-09-12T12:21:12.388167+0000","last_became_peered":"2024-09-12T12:21:12.388167+0000","last_unstale":"2024-09-12T12:21:14.467965+0000","last_undegraded":"2024-09-12T12:21:14.467965+0000","last_fullsized":"2024-09-12T12:21:14.467965+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:46.267405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370210+0000","last_change":"2024-09-12T12:21:13.377415+0000","last_active":"2024-09-12T12:21:14.370210+0000","last_peered":"2024-09-12T12:21:14.370210+0000","last_clean":"2024-09-12T12:21:14.370210+0000","last_became_active":"2024-09-12T12:21:13.377134+0000","last_became_peered":"2024-09-12T12:21:13.377134+0000","last_unstale":"2024-09-12T12:21:14.370210+0000","last_undegraded":"2024-09-12T12:21:14.370210+0000","last_fullsized":"2024-09-12T12:21:14.370210+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:41.499866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370696+0000","last_change":"2024-09-12T12:21:12.372917+0000","last_active":"2024-09-12T12:21:14.370696+0000","last_peered":"2024-09-12T12:21:14.370696+0000","last_clean":"2024-09-12T12:21:14.370696+0000","last_became_active":"2024-09-12T12:21:12.372379+0000","last_became_peered":"2024-09-12T12:21:12.372379+0000","last_unstale":"2024-09-12T12:21:14.370696+0000","last_undegraded":"2024-09-12T12:21:14.370696+0000","last_fullsized":"2024-09-12T12:21:14.370696+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:58:27.423986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.394030+0000","last_change":"2024-09-12T12:21:13.391299+0000","last_active":"2024-09-12T12:21:13.394030+0000","last_peered":"2024-09-12T12:21:13.394030+0000","last_clean":"2024-09-12T12:21:13.394030+0000","last_became_active":"2024-09-12T12:21:13.390980+0000","last_became_peered":"2024-09-12T12:21:13.390980+0000","last_unstale":"2024-09-12T12:21:13.394030+0000","last_undegraded":"2024-09-12T12:21:13.394030+0000","last_fullsized":"2024-09-12T12:21:13.394030+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:23.702746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.370680+0000","last_change":"2024-09-12T12:21:12.383886+0000","last_active":"2024-09-12T12:21:14.370680+0000","last_peered":"2024-09-12T12:21:14.370680+0000","last_clean":"2024-09-12T12:21:14.370680+0000","last_became_active":"2024-09-12T12:21:12.383596+0000","last_became_peered":"2024-09-12T12:21:12.383596+0000","last_unstale":"2024-09-12T12:21:14.370680+0000","last_undegraded":"2024-09-12T12:21:14.370680+0000","last_fullsized":"2024-09-12T12:21:14.370680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:16.055803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.401174+0000","last_change":"2024-09-12T12:21:13.390363+0000","last_active":"2024-09-12T12:21:13.401174+0000","last_peered":"2024-09-12T12:21:13.401174+0000","last_clean":"2024-09-12T12:21:13.401174+0000","last_became_active":"2024-09-12T12:21:13.390094+0000","last_became_peered":"2024-09-12T12:21:13.390094+0000","last_unstale":"2024-09-12T12:21:13.401174+0000","last_undegraded":"2024-09-12T12:21:13.401174+0000","last_fullsized":"2024-09-12T12:21:13.401174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:08.370441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369455+0000","last_change":"2024-09-12T12:21:12.383757+0000","last_active":"2024-09-12T12:21:14.369455+0000","last_peered":"2024-09-12T12:21:14.369455+0000","last_clean":"2024-09-12T12:21:14.369455+0000","last_became_active":"2024-09-12T12:21:12.383480+0000","last_became_peered":"2024-09-12T12:21:12.383480+0000","last_unstale":"2024-09-12T12:21:14.369455+0000","last_undegraded":"2024-09-12T12:21:14.369455+0000","last_fullsized":"2024-09-12T12:21:14.369455+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:27.054563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369360+0000","last_change":"2024-09-12T12:21:13.393328+0000","last_active":"2024-09-12T12:21:14.369360+0000","last_peered":"2024-09-12T12:21:14.369360+0000","last_clean":"2024-09-12T12:21:14.369360+0000","last_became_active":"2024-09-12T12:21:13.393074+0000","last_became_peered":"2024-09-12T12:21:13.393074+0000","last_unstale":"2024-09-12T12:21:14.369360+0000","last_undegraded":"2024-09-12T12:21:14.369360+0000","last_fullsized":"2024-09-12T12:21:14.369360+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:23.702746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.377330+0000","last_change":"2024-09-12T12:21:12.387426+0000","last_active":"2024-09-12T12:21:13.377330+0000","last_peered":"2024-09-12T12:21:13.377330+0000","last_clean":"2024-09-12T12:21:13.377330+0000","last_became_active":"2024-09-12T12:21:12.387012+0000","last_became_peered":"2024-09-12T12:21:12.387012+0000","last_unstale":"2024-09-12T12:21:13.377330+0000","last_undegraded":"2024-09-12T12:21:13.377330+0000","last_fullsized":"2024-09-12T12:21:13.377330+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:46.687036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369502+0000","last_change":"2024-09-12T12:21:13.398368+0000","last_active":"2024-09-12T12:21:14.369502+0000","last_peered":"2024-09-12T12:21:14.369502+0000","last_clean":"2024-09-12T12:21:14.369502+0000","last_became_active":"2024-09-12T12:21:13.396752+0000","last_became_peered":"2024-09-12T12:21:13.396752+0000","last_unstale":"2024-09-12T12:21:14.369502+0000","last_undegraded":"2024-09-12T12:21:14.369502+0000","last_fullsized":"2024-09-12T12:21:14.369502+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:47:41.499866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.385591+0000","last_change":"2024-09-12T12:21:12.382046+0000","last_active":"2024-09-12T12:21:13.385591+0000","last_peered":"2024-09-12T12:21:13.385591+0000","last_clean":"2024-09-12T12:21:13.385591+0000","last_became_active":"2024-09-12T12:21:12.381778+0000","last_became_peered":"2024-09-12T12:21:12.381778+0000","last_unstale":"2024-09-12T12:21:13.385591+0000","last_undegraded":"2024-09-12T12:21:13.385591+0000","last_fullsized":"2024-09-12T12:21:13.385591+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:38.825973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.369679+0000","last_change":"2024-09-12T12:21:13.384340+0000","last_active":"2024-09-12T12:21:14.369679+0000","last_peered":"2024-09-12T12:21:14.369679+0000","last_clean":"2024-09-12T12:21:14.369679+0000","last_became_active":"2024-09-12T12:21:13.384089+0000","last_became_peered":"2024-09-12T12:21:13.384089+0000","last_unstale":"2024-09-12T12:21:14.369679+0000","last_undegraded":"2024-09-12T12:21:14.369679+0000","last_fullsized":"2024-09-12T12:21:14.369679+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:43.945352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.368912+0000","last_change":"2024-09-12T12:21:12.383569+0000","last_active":"2024-09-12T12:21:14.368912+0000","last_peered":"2024-09-12T12:21:14.368912+0000","last_clean":"2024-09-12T12:21:14.368912+0000","last_became_active":"2024-09-12T12:21:12.383186+0000","last_became_peered":"2024-09-12T12:21:12.383186+0000","last_unstale":"2024-09-12T12:21:14.368912+0000","last_undegraded":"2024-09-12T12:21:14.368912+0000","last_fullsized":"2024-09-12T12:21:14.368912+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:00.259417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.399784+0000","last_change":"2024-09-12T12:21:13.398610+0000","last_active":"2024-09-12T12:21:13.399784+0000","last_peered":"2024-09-12T12:21:13.399784+0000","last_clean":"2024-09-12T12:21:13.399784+0000","last_became_active":"2024-09-12T12:21:13.397661+0000","last_became_peered":"2024-09-12T12:21:13.397661+0000","last_unstale":"2024-09-12T12:21:13.399784+0000","last_undegraded":"2024-09-12T12:21:13.399784+0000","last_fullsized":"2024-09-12T12:21:13.399784+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:33:57.240294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.368860+0000","last_change":"2024-09-12T12:21:12.379477+0000","last_active":"2024-09-12T12:21:13.368860+0000","last_peered":"2024-09-12T12:21:13.368860+0000","last_clean":"2024-09-12T12:21:13.368860+0000","last_became_active":"2024-09-12T12:21:12.379212+0000","last_became_peered":"2024-09-12T12:21:12.379212+0000","last_unstale":"2024-09-12T12:21:13.368860+0000","last_undegraded":"2024-09-12T12:21:13.368860+0000","last_fullsized":"2024-09-12T12:21:13.368860+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:42.692308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T12:21:14.371160+0000","last_change":"2024-09-12T12:21:13.380012+0000","last_active":"2024-09-12T12:21:14.371160+0000","last_peered":"2024-09-12T12:21:14.371160+0000","last_clean":"2024-09-12T12:21:14.371160+0000","last_became_active":"2024-09-12T12:21:13.379734+0000","last_became_peered":"2024-09-12T12:21:13.379734+0000","last_unstale":"2024-09-12T12:21:14.371160+0000","last_undegraded":"2024-09-12T12:21:14.371160+0000","last_fullsized":"2024-09-12T12:21:14.371160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:12.353260+0000","last_clean_scrub_stamp":"2024-09-12T12:21:12.353260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:33:57.240294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.385743+0000","last_change":"2024-09-12T12:21:12.393577+0000","last_active":"2024-09-12T12:21:13.385743+0000","last_peered":"2024-09-12T12:21:13.385743+0000","last_clean":"2024-09-12T12:21:13.385743+0000","last_became_active":"2024-09-12T12:21:12.393310+0000","last_became_peered":"2024-09-12T12:21:12.393310+0000","last_unstale":"2024-09-12T12:21:13.385743+0000","last_undegraded":"2024-09-12T12:21:13.385743+0000","last_fullsized":"2024-09-12T12:21:13.385743+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:21:11.349868+0000","last_clean_scrub_stamp":"2024-09-12T12:21:11.349868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:11.353036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":386,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T12:21:13.376986+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:21:13.376986+0000","last_peered":"2024-09-12T12:21:13.376986+0000","last_clean":"2024-09-12T12:21:13.376986+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:21:13.376986+0000","last_undegraded":"2024-09-12T12:21:13.376986+0000","last_fullsized":"2024-09-12T12:21:13.376986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":2347008,"data_stored":1410156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46788,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325052,"statfs":{"total":96636764160,"available":96588853248,"internally_reserved":0,"allocated":1744896,"data_stored":818758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46784,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325056,"statfs":{"total":96636764160,"available":96588857344,"internally_reserved":0,"allocated":1740800,"data_stored":818108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55092,"kb_used_data":1696,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316748,"statfs":{"total":96636764160,"available":96580349952,"internally_reserved":0,"allocated":1736704,"data_stored":818086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50960,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320880,"statfs":{"total":96636764160,"available":96584581120,"internally_reserved":0,"allocated":1753088,"data_stored":819768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1744896,"data_stored":818702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50936,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320904,"statfs":{"total":96636764160,"available":96584605696,"internally_reserved":0,"allocated":1740800,"data_stored":818156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51524,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320316,"statfs":{"total":96636764160,"available":96584003584,"internally_reserved":0,"allocated":2338816,"data_stored":1408510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:21:17.864 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:21:17.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:21:18.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f92200640 1 Processor -- start 2024-09-12T12:21:18.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f92200640 1 -- start start 2024-09-12T12:21:18.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f92200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c15af60 0x7f2f8c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f92200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f8c0b4300 con 0x7f2f8c0cd9f0 2024-09-12T12:21:18.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f92200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f8c0b3540 con 0x7f2f8c06c320 2024-09-12T12:21:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f92200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8c0b32f0 con 0x7f2f8c15af60 2024-09-12T12:21:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f8aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2f8c0cd9f0 0x7f2f8c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52848/0 (socket says 172.21.15.144:52848) 2024-09-12T12:21:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f8aa00640 1 -- 172.21.15.144:0/2779831837 learned_addr learned my addr 172.21.15.144:0/2779831837 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f8b400640 1 --2- 172.21.15.144:0/2779831837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c15af60 0x7f2f8c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f8a000640 1 -- 172.21.15.144:0/2779831837 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639983779 0 0) 0x7f2f8c0b4300 con 0x7f2f8c0cd9f0 2024-09-12T12:21:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f8a000640 1 -- 172.21.15.144:0/2779831837 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f70005740 con 0x7f2f8c0cd9f0 2024-09-12T12:21:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f8b400640 1 -- 172.21.15.144:0/2779831837 >> v1:172.21.15.165:6789/0 conn(0x7f2f8c06c320 legacy=0x7f2f8c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f8b400640 1 -- 172.21.15.144:0/2779831837 >> v1:172.21.15.144:6789/0 conn(0x7f2f8c0cd9f0 legacy=0x7f2f8c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.047+0000 7f2f8b400640 1 -- 172.21.15.144:0/2779831837 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8c0b3820 con 0x7f2f8c15af60 2024-09-12T12:21:18.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f8b400640 1 --2- 172.21.15.144:0/2779831837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c15af60 0x7f2f8c0ce680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009dc0 tx=0x7f2f7c01f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1c5ca3219a7d296 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:18.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f8a000640 1 -- 172.21.15.144:0/2779831837 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0b4070 con 0x7f2f8c15af60 2024-09-12T12:21:18.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f8a000640 1 -- 172.21.15.144:0/2779831837 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7c0af600 con 0x7f2f8c15af60 2024-09-12T12:21:18.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f8a000640 1 -- 172.21.15.144:0/2779831837 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0af9b0 con 0x7f2f8c15af60 2024-09-12T12:21:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f92200640 1 -- 172.21.15.144:0/2779831837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c15af60 msgr2=0x7f2f8c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f92200640 1 --2- 172.21.15.144:0/2779831837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c15af60 0x7f2f8c0ce680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009dc0 tx=0x7f2f7c01f170 comp rx=0 tx=0).stop 2024-09-12T12:21:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f92200640 1 -- 172.21.15.144:0/2779831837 shutdown_connections 2024-09-12T12:21:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f92200640 1 --2- 172.21.15.144:0/2779831837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c15af60 0x7f2f8c0ce680 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f92200640 1 -- 172.21.15.144:0/2779831837 >> 172.21.15.144:0/2779831837 conn(0x7f2f8c068030 msgr2=0x7f2f8c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f92200640 1 -- 172.21.15.144:0/2779831837 shutdown_connections 2024-09-12T12:21:18.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.051+0000 7f2f92200640 1 -- 172.21.15.144:0/2779831837 wait complete. 2024-09-12T12:21:18.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 Processor -- start 2024-09-12T12:21:18.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 -- start start 2024-09-12T12:21:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c06c320 0x7f2f8c151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8c0cd9f0 0x7f2f8c158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f8c15af60 0x7f2f8c153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c0cebc0 con 0x7f2f8c15af60 2024-09-12T12:21:18.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c0b3de0 con 0x7f2f8c0cd9f0 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8c0ced40 con 0x7f2f8c06c320 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f8c15af60 0x7f2f8c153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f8c15af60 0x7f2f8c153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47344/0 (socket says 172.21.15.144:47344) 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8be00640 1 -- 172.21.15.144:0/3387827517 learned_addr learned my addr 172.21.15.144:0/3387827517 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8b400640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c06c320 0x7f2f8c151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8aa00640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8c0cd9f0 0x7f2f8c158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8be00640 1 -- 172.21.15.144:0/3387827517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c06c320 msgr2=0x7f2f8c151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8be00640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c06c320 0x7f2f8c151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8be00640 1 -- 172.21.15.144:0/3387827517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8c0cd9f0 msgr2=0x7f2f8c158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8be00640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8c0cd9f0 0x7f2f8c158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8be00640 1 -- 172.21.15.144:0/3387827517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8c158fd0 con 0x7f2f8c15af60 2024-09-12T12:21:18.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f8be00640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f8c15af60 0x7f2f8c153d30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400c400 tx=0x7f2f8400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:18.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f83400640 1 -- 172.21.15.144:0/3387827517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84017070 con 0x7f2f8c15af60 2024-09-12T12:21:18.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f83400640 1 -- 172.21.15.144:0/3387827517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f840052d0 con 0x7f2f8c15af60 2024-09-12T12:21:18.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f83400640 1 -- 172.21.15.144:0/3387827517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84003800 con 0x7f2f8c15af60 2024-09-12T12:21:18.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8c1592b0 con 0x7f2f8c15af60 2024-09-12T12:21:18.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.055+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8c159870 con 0x7f2f8c15af60 2024-09-12T12:21:18.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.059+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f8c14fbc0 con 0x7f2f8c15af60 2024-09-12T12:21:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.059+0000 7f2f83400640 1 -- 172.21.15.144:0/3387827517 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f8401a070 con 0x7f2f8c15af60 2024-09-12T12:21:18.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.059+0000 7f2f83400640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f6c0678c0 0x7f2f6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.059+0000 7f2f83400640 1 -- 172.21.15.144:0/3387827517 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f2f840850c0 con 0x7f2f8c15af60 2024-09-12T12:21:18.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.059+0000 7f2f8b400640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f6c0678c0 0x7f2f6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.059+0000 7f2f8b400640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f6c0678c0 0x7f2f6c069d80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0b1000 tx=0x7f2f7c0aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:18.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.063+0000 7f2f83400640 1 -- 172.21.15.144:0/3387827517 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f84005480 con 0x7f2f8c15af60 2024-09-12T12:21:18.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.275+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2f8c15b340 con 0x7f2f8c15af60 2024-09-12T12:21:18.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.279+0000 7f2f83400640 1 -- 172.21.15.144:0/3387827517 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f2f84055380 con 0x7f2f8c15af60 2024-09-12T12:21:18.280 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:21:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:21:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:21:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:21:18.280 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:21:18.281 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:21:18.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f6c0678c0 msgr2=0x7f2f6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f6c0678c0 0x7f2f6c069d80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0b1000 tx=0x7f2f7c0aa000 comp rx=0 tx=0).stop 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f8c15af60 msgr2=0x7f2f8c153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f8c15af60 0x7f2f8c153d30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400c400 tx=0x7f2f8400c8c0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 shutdown_connections 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f6c0678c0 0x7f2f6c069d80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f8c15af60 0x7f2f8c153d30 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8c0cd9f0 0x7f2f8c158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 --2- 172.21.15.144:0/3387827517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f8c06c320 0x7f2f8c151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 >> 172.21.15.144:0/3387827517 conn(0x7f2f8c068030 msgr2=0x7f2f8c0b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 shutdown_connections 2024-09-12T12:21:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.283+0000 7f2f92200640 1 -- 172.21.15.144:0/3387827517 wait complete. 2024-09-12T12:21:18.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:18.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc60200640 1 Processor -- start 2024-09-12T12:21:18.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc60200640 1 -- start start 2024-09-12T12:21:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc60200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b4200 0x7fbc580b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc60200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc580d1580 con 0x7fbc5815c220 2024-09-12T12:21:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc60200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc580d1860 con 0x7fbc580b5720 2024-09-12T12:21:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc60200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc580b4bb0 con 0x7fbc580b4200 2024-09-12T12:21:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc5d800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbc5815c220 0x7fbc580d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52850/0 (socket says 172.21.15.144:52850) 2024-09-12T12:21:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc5d800640 1 -- 172.21.15.144:0/830292342 learned_addr learned my addr 172.21.15.144:0/830292342 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:18.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc5ce00640 1 --2- 172.21.15.144:0/830292342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b4200 0x7fbc580b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc57e00640 1 -- 172.21.15.144:0/830292342 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591586086 0 0) 0x7fbc580d1580 con 0x7fbc5815c220 2024-09-12T12:21:18.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc57e00640 1 -- 172.21.15.144:0/830292342 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc40003530 con 0x7fbc5815c220 2024-09-12T12:21:18.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc57e00640 1 -- 172.21.15.144:0/830292342 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899531829 0 0) 0x7fbc580d1860 con 0x7fbc580b5720 2024-09-12T12:21:18.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc57e00640 1 -- 172.21.15.144:0/830292342 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc580d1580 con 0x7fbc580b5720 2024-09-12T12:21:18.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc5ce00640 1 -- 172.21.15.144:0/830292342 >> v1:172.21.15.165:6789/0 conn(0x7fbc580b5720 legacy=0x7fbc580b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc5ce00640 1 -- 172.21.15.144:0/830292342 >> v1:172.21.15.144:6789/0 conn(0x7fbc5815c220 legacy=0x7fbc580d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.439+0000 7fbc5ce00640 1 -- 172.21.15.144:0/830292342 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc580d1b40 con 0x7fbc580b4200 2024-09-12T12:21:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc5ce00640 1 --2- 172.21.15.144:0/830292342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b4200 0x7fbc580b4670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc440097f0 tx=0x7fbc4401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=980a13d71b1328a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc57e00640 1 -- 172.21.15.144:0/830292342 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc440b1070 con 0x7fbc580b4200 2024-09-12T12:21:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc57e00640 1 -- 172.21.15.144:0/830292342 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc440ac630 con 0x7fbc580b4200 2024-09-12T12:21:18.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc57e00640 1 -- 172.21.15.144:0/830292342 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc440a8050 con 0x7fbc580b4200 2024-09-12T12:21:18.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc60200640 1 -- 172.21.15.144:0/830292342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b4200 msgr2=0x7fbc580b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc60200640 1 --2- 172.21.15.144:0/830292342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b4200 0x7fbc580b4670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc440097f0 tx=0x7fbc4401c4e0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc60200640 1 -- 172.21.15.144:0/830292342 shutdown_connections 2024-09-12T12:21:18.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc60200640 1 --2- 172.21.15.144:0/830292342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b4200 0x7fbc580b4670 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc60200640 1 -- 172.21.15.144:0/830292342 >> 172.21.15.144:0/830292342 conn(0x7fbc5806f400 msgr2=0x7fbc5806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:18.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc60200640 1 -- 172.21.15.144:0/830292342 shutdown_connections 2024-09-12T12:21:18.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.443+0000 7fbc60200640 1 -- 172.21.15.144:0/830292342 wait complete. 2024-09-12T12:21:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 Processor -- start 2024-09-12T12:21:18.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 -- start start 2024-09-12T12:21:18.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc580b4200 0x7fbc58150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b5720 0x7fbc5815f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc5815c220 0x7fbc58158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc58070d70 con 0x7fbc5815c220 2024-09-12T12:21:18.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc58070bf0 con 0x7fbc580b4200 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc58169f20 con 0x7fbc580b5720 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc5815c220 0x7fbc58158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc5815c220 0x7fbc58158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47358/0 (socket says 172.21.15.144:47358) 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5e200640 1 -- 172.21.15.144:0/1653797626 learned_addr learned my addr 172.21.15.144:0/1653797626 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5d800640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc580b4200 0x7fbc58150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5ce00640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b5720 0x7fbc5815f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5e200640 1 -- 172.21.15.144:0/1653797626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b5720 msgr2=0x7fbc5815f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5e200640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b5720 0x7fbc5815f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5e200640 1 -- 172.21.15.144:0/1653797626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc580b4200 msgr2=0x7fbc58150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5e200640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc580b4200 0x7fbc58150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5e200640 1 -- 172.21.15.144:0/1653797626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc58154e90 con 0x7fbc5815c220 2024-09-12T12:21:18.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc5e200640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc5815c220 0x7fbc58158500 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000c410 tx=0x7fbc5000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:18.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc55600640 1 -- 172.21.15.144:0/1653797626 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc50017070 con 0x7fbc5815c220 2024-09-12T12:21:18.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc55600640 1 -- 172.21.15.144:0/1653797626 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc500052d0 con 0x7fbc5815c220 2024-09-12T12:21:18.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc55600640 1 -- 172.21.15.144:0/1653797626 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc500054c0 con 0x7fbc5815c220 2024-09-12T12:21:18.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc58155170 con 0x7fbc5815c220 2024-09-12T12:21:18.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.447+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc58155730 con 0x7fbc5815c220 2024-09-12T12:21:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.451+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc580b4670 con 0x7fbc5815c220 2024-09-12T12:21:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.451+0000 7fbc55600640 1 -- 172.21.15.144:0/1653797626 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc5001a070 con 0x7fbc5815c220 2024-09-12T12:21:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.451+0000 7fbc55600640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc380678f0 0x7fbc38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:18.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.451+0000 7fbc55600640 1 -- 172.21.15.144:0/1653797626 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fbc50085170 con 0x7fbc5815c220 2024-09-12T12:21:18.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.451+0000 7fbc5d800640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc380678f0 0x7fbc38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:18.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.451+0000 7fbc5d800640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc380678f0 0x7fbc38069db0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c001570 tx=0x7fbc4c001a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:18.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.455+0000 7fbc55600640 1 -- 172.21.15.144:0/1653797626 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbc50055430 con 0x7fbc5815c220 2024-09-12T12:21:18.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.647+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc5806fce0 con 0x7fbc5815c220 2024-09-12T12:21:18.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.647+0000 7fbc55600640 1 -- 172.21.15.144:0/1653797626 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7fbc50059730 con 0x7fbc5815c220 2024-09-12T12:21:18.649 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:18.649 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc380678f0 msgr2=0x7fbc38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc380678f0 0x7fbc38069db0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c001570 tx=0x7fbc4c001a00 comp rx=0 tx=0).stop 2024-09-12T12:21:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc5815c220 msgr2=0x7fbc58158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc5815c220 0x7fbc58158500 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000c410 tx=0x7fbc5000c8d0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 shutdown_connections 2024-09-12T12:21:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc380678f0 0x7fbc38069db0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc5815c220 0x7fbc58158500 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc580b5720 0x7fbc5815f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 --2- 172.21.15.144:0/1653797626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc580b4200 0x7fbc58150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 >> 172.21.15.144:0/1653797626 conn(0x7fbc5806f400 msgr2=0x7fbc58156380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 shutdown_connections 2024-09-12T12:21:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:18.651+0000 7fbc60200640 1 -- 172.21.15.144:0/1653797626 wait complete. 2024-09-12T12:21:19.073 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 107, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:21:12.766465+0000', 'modified': '2024-09-12T12:21:15.787143+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8391}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8391': {'gid': 8391, 'name': 'a', 'rank': 0, 'incarnation': 103, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/2508228850', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 2508228850}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 2508228850}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8391, 'qdb_cluster': [8391]} 2024-09-12T12:21:19.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:21:19.074 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T12:21:19.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb02bc00640 1 Processor -- start 2024-09-12T12:21:19.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb02bc00640 1 -- start start 2024-09-12T12:21:19.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb02bc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb02415c7b0 0x7fb0240ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb02bc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0240cd870 con 0x7fb02415cd30 2024-09-12T12:21:19.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb02bc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0240cdb50 con 0x7fb0240b5fb0 2024-09-12T12:21:19.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb02bc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb024072a50 con 0x7fb02415c7b0 2024-09-12T12:21:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb02415cd30 0x7fb0240b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52860/0 (socket says 172.21.15.144:52860) 2024-09-12T12:21:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023e00640 1 -- 172.21.15.144:0/1646184012 learned_addr learned my addr 172.21.15.144:0/1646184012 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb029200640 1 --2- 172.21.15.144:0/1646184012 >> v2:172.21.15.165:3300/0 conn(0x7fb02415c7b0 0x7fb0240ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208815355 0 0) 0x7fb0240cd870 con 0x7fb02415cd30 2024-09-12T12:21:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb008003530 con 0x7fb02415cd30 2024-09-12T12:21:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1768868833 0 0) 0x7fb008003530 con 0x7fb02415cd30 2024-09-12T12:21:19.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 >> v2:172.21.15.165:3300/0 conn(0x7fb02415c7b0 msgr2=0x7fb0240ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 --2- 172.21.15.144:0/1646184012 >> v2:172.21.15.165:3300/0 conn(0x7fb02415c7b0 0x7fb0240ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 >> v1:172.21.15.165:6789/0 conn(0x7fb0240b5fb0 legacy=0x7fb024072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0240726e0 con 0x7fb02415cd30 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fb010001680 con 0x7fb02415cd30 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb029200640 1 --2- 172.21.15.144:0/1646184012 >> v2:172.21.15.165:3300/0 conn(0x7fb02415c7b0 0x7fb0240ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 >> v1:172.21.15.144:6789/0 conn(0x7fb02415cd30 legacy=0x7fb0240b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0080039c0 0x7fb008003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb008004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0080051d0 0x7fb00800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb024072a50 con 0x7fb008004810 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb00800c070 con 0x7fb0080039c0 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb00800c270 con 0x7fb0080051d0 2024-09-12T12:21:19.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023e00640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb008004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb029200640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0080039c0 0x7fb008003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb029c00640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0080051d0 0x7fb00800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023e00640 1 -- 172.21.15.144:0/1646184012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0080051d0 msgr2=0x7fb00800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023e00640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0080051d0 0x7fb00800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023e00640 1 -- 172.21.15.144:0/1646184012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0080039c0 msgr2=0x7fb008003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023e00640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0080039c0 0x7fb008003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb023e00640 1 -- 172.21.15.144:0/1646184012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb008003530 con 0x7fb008004810 2024-09-12T12:21:19.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.215+0000 7fb029c00640 1 -- 172.21.15.144:0/1646184012 reap_dead start 2024-09-12T12:21:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb023e00640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb008004c90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c240 tx=0x7fb01001f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c113a71ede6eee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010007d20 con 0x7fb008004810 2024-09-12T12:21:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb010005ae0 con 0x7fb008004810 2024-09-12T12:21:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb023400640 1 -- 172.21.15.144:0/1646184012 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010007070 con 0x7fb008004810 2024-09-12T12:21:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb02bc00640 1 -- 172.21.15.144:0/1646184012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 msgr2=0x7fb008004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb02bc00640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb008004c90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fb01000c240 tx=0x7fb01001f3f0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb02bc00640 1 -- 172.21.15.144:0/1646184012 shutdown_connections 2024-09-12T12:21:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb02bc00640 1 --2- 172.21.15.144:0/1646184012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb008004c90 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb02bc00640 1 -- 172.21.15.144:0/1646184012 >> 172.21.15.144:0/1646184012 conn(0x7fb02406d0d0 msgr2=0x7fb02406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:19.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb02bc00640 1 -- 172.21.15.144:0/1646184012 shutdown_connections 2024-09-12T12:21:19.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.219+0000 7fb02bc00640 1 -- 172.21.15.144:0/1646184012 wait complete. 2024-09-12T12:21:19.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 Processor -- start 2024-09-12T12:21:19.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 -- start start 2024-09-12T12:21:19.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb0240b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb024156ed0 0x7fb024151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0240ae8c0 0x7fb0240aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb0240b5c30 con 0x7fb008004810 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0240b5ab0 con 0x7fb024156ed0 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0240b5db0 con 0x7fb0240ae8c0 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb029200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb0240b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb029200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb0240b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47382/0 (socket says 172.21.15.144:47382) 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb029200640 1 -- 172.21.15.144:0/3152321099 learned_addr learned my addr 172.21.15.144:0/3152321099 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb023e00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb024156ed0 0x7fb024151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb029200640 1 -- 172.21.15.144:0/3152321099 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0240ae8c0 msgr2=0x7fb0240aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb029200640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0240ae8c0 0x7fb0240aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb029200640 1 -- 172.21.15.144:0/3152321099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb024156ed0 msgr2=0x7fb024151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb029200640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb024156ed0 0x7fb024151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb029200640 1 -- 172.21.15.144:0/3152321099 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0240b5560 con 0x7fb008004810 2024-09-12T12:21:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb023e00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb024156ed0 0x7fb024151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:19.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb029200640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb0240b5020 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb014011c00 tx=0x7fb01400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb020c00640 1 -- 172.21.15.144:0/3152321099 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014011cf0 con 0x7fb008004810 2024-09-12T12:21:19.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb020c00640 1 -- 172.21.15.144:0/3152321099 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb014011e90 con 0x7fb008004810 2024-09-12T12:21:19.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb020c00640 1 -- 172.21.15.144:0/3152321099 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014004270 con 0x7fb008004810 2024-09-12T12:21:19.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 -- 172.21.15.144:0/3152321099 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0241f4a70 con 0x7fb008004810 2024-09-12T12:21:19.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.223+0000 7fb02bc00640 1 -- 172.21.15.144:0/3152321099 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0241f5010 con 0x7fb008004810 2024-09-12T12:21:19.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.227+0000 7fb020c00640 1 -- 172.21.15.144:0/3152321099 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb014012040 con 0x7fb008004810 2024-09-12T12:21:19.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.227+0000 7fb020c00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0040678f0 0x7fb004069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.227+0000 7fb020c00640 1 -- 172.21.15.144:0/3152321099 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fb014086340 con 0x7fb008004810 2024-09-12T12:21:19.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.227+0000 7fb023e00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0040678f0 0x7fb004069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.227+0000 7fb02f011000 1 Processor -- start 2024-09-12T12:21:19.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.227+0000 7fb02f011000 1 -- start start 2024-09-12T12:21:19.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.227+0000 7fb023e00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0040678f0 0x7fb004069db0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb0100af000 tx=0x7fb0100aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b1b20 0x5570af3b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b2440 0x5570af367d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af368290 0x5570af368670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5570af24fb60 con 0x5570af368290 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5570af1b6c70 con 0x5570af3b2440 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5570af15ced0 con 0x5570af3b1b20 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb029c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af368290 0x5570af368670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb029c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af368290 0x5570af368670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47394/0 (socket says 172.21.15.144:47394) 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb029c00640 1 -- 172.21.15.144:0/3033298014 learned_addr learned my addr 172.21.15.144:0/3033298014 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb029c00640 1 -- 172.21.15.144:0/3033298014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b1b20 msgr2=0x5570af3b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb029c00640 1 --2- 172.21.15.144:0/3033298014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b1b20 0x5570af3b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb029c00640 1 -- 172.21.15.144:0/3033298014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b2440 msgr2=0x5570af367d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb029c00640 1 --2- 172.21.15.144:0/3033298014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b2440 0x5570af367d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb029c00640 1 -- 172.21.15.144:0/3033298014 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570af16ee50 con 0x5570af368290 2024-09-12T12:21:19.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb029c00640 1 --2- 172.21.15.144:0/3033298014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af368290 0x5570af368670 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fb0240ce230 tx=0x7fb01c001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5007e7ed317490 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb019600640 1 -- 172.21.15.144:0/3033298014 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c019070 con 0x5570af368290 2024-09-12T12:21:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb019600640 1 -- 172.21.15.144:0/3033298014 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01c003980 con 0x5570af368290 2024-09-12T12:21:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb019600640 1 -- 172.21.15.144:0/3033298014 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c003d90 con 0x5570af368290 2024-09-12T12:21:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- 172.21.15.144:0/3033298014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af368290 msgr2=0x5570af368670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- 172.21.15.144:0/3033298014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af368290 0x5570af368670 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fb0240ce230 tx=0x7fb01c001dc0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- 172.21.15.144:0/3033298014 shutdown_connections 2024-09-12T12:21:19.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- 172.21.15.144:0/3033298014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af368290 0x5570af368670 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- 172.21.15.144:0/3033298014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b2440 0x5570af367d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- 172.21.15.144:0/3033298014 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b1b20 0x5570af3b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- 172.21.15.144:0/3033298014 >> 172.21.15.144:0/3033298014 conn(0x5570af36e600 msgr2=0x5570af366630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:19.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- 172.21.15.144:0/3033298014 shutdown_connections 2024-09-12T12:21:19.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- 172.21.15.144:0/3033298014 wait complete. 2024-09-12T12:21:19.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- start start 2024-09-12T12:21:19.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 Processor -- start 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 0x5570af36cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 0x5570af372cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af36d330 0x5570af373230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5570af218b00 con 0x5570af36d330 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5570af191360 con 0x5570af3b1b20 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5570af18e2d0 con 0x5570af3b2440 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.231+0000 7fb02f011000 10 client.0 _ll_register_callbacks cb 0x5570af353820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af36d330 0x5570af373230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af36d330 0x5570af373230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47406/0 (socket says 172.21.15.144:47406) 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029c00640 1 -- 172.21.15.144:0/1392412239 learned_addr learned my addr 172.21.15.144:0/1392412239 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb023e00640 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 0x5570af372cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029200640 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 0x5570af36cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029c00640 1 -- 172.21.15.144:0/1392412239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 msgr2=0x5570af372cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029c00640 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 0x5570af372cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029c00640 1 -- 172.21.15.144:0/1392412239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 msgr2=0x5570af36cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029c00640 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 0x5570af36cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029c00640 1 -- 172.21.15.144:0/1392412239 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570af15d120 con 0x5570af36d330 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb023e00640 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 0x5570af372cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029c00640 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af36d330 0x5570af373230 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x5570af26eac0 tx=0x7fb01c007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19495ee9dac7893b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 1 -- 172.21.15.144:0/1392412239 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c023020 con 0x5570af36d330 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 -- 172.21.15.144:0/1392412239 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb01c003980 con 0x5570af36d330 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 1 -- 172.21.15.144:0/1392412239 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fb01c0054e0 con 0x5570af36d330 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 1 -- 172.21.15.144:0/1392412239 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7fb01c02d050 con 0x5570af36d330 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 10 client.8520 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:19.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 -- 172.21.15.144:0/1392412239 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x5570af156450 con 0x5570af36d330 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 1 -- 172.21.15.144:0/1392412239 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01c003980 con 0x5570af36d330 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 1 -- 172.21.15.144:0/1392412239 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7fb01c030020 con 0x5570af36d330 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 10 client.8520 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 10 client.8520 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 20 client.8520 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5570af3c0280 0x5570af3c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 4 client.8520 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 -- 172.21.15.144:0/1392412239 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570af150c00 con 0x5570af3c0280 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029200640 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5570af3c0280 0x5570af3c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb029200640 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5570af3c0280 0x5570af3c2670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b767ab45909edbe8 server_cookie=b84805ec9fdcc7ba in_seq=0 out_seq=0 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 10 client.8520 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 1 -- 172.21.15.144:0/1392412239 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570af150c00 con 0x5570af3c0280 2024-09-12T12:21:19.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 10 client.8520 handle_command_reply: tid=0 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 client.8520 shutdown 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 -- 172.21.15.144:0/1392412239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af36d330 msgr2=0x5570af373230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af36d330 0x5570af373230 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x5570af26eac0 tx=0x7fb01c007dc0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 -- 172.21.15.144:0/1392412239 shutdown_connections 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af36d330 0x5570af373230 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 0x5570af372cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5570af3c0280 0x5570af3c2670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 --2- 172.21.15.144:0/1392412239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 0x5570af36cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 -- 172.21.15.144:0/1392412239 >> 172.21.15.144:0/1392412239 conn(0x5570af368290 msgr2=0x5570af366d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb00e000640 0 client.8520 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 -- 172.21.15.144:0/1392412239 shutdown_connections 2024-09-12T12:21:19.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 1 -- 172.21.15.144:0/1392412239 wait complete. 2024-09-12T12:21:19.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.235+0000 7fb02f011000 20 client.8520 trim_cache size 0 max 16384 2024-09-12T12:21:19.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb02f011000 1 Processor -- start 2024-09-12T12:21:19.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb02f011000 1 -- start start 2024-09-12T12:21:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb02f011000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af36d330 0x5570af3b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb02f011000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b1b20 0x5570af3b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb02f011000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 0x5570af3c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb02f011000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb0242009d0 con 0x5570af3b1b20 2024-09-12T12:21:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb02f011000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0241f8ad0 con 0x5570af36d330 2024-09-12T12:21:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb02f011000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0242003b0 con 0x5570af3b2440 2024-09-12T12:21:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb023e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b1b20 0x5570af3b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb023e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b1b20 0x5570af3b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47416/0 (socket says 172.21.15.144:47416) 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb023e00640 1 -- 172.21.15.144:0/812083558 learned_addr learned my addr 172.21.15.144:0/812083558 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb029200640 1 --2- 172.21.15.144:0/812083558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af36d330 0x5570af3b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb029c00640 1 --2- 172.21.15.144:0/812083558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 0x5570af3c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb023e00640 1 -- 172.21.15.144:0/812083558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 msgr2=0x5570af3c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb023e00640 1 --2- 172.21.15.144:0/812083558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 0x5570af3c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb023e00640 1 -- 172.21.15.144:0/812083558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af36d330 msgr2=0x5570af3b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb023e00640 1 --2- 172.21.15.144:0/812083558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af36d330 0x5570af3b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb023e00640 1 -- 172.21.15.144:0/812083558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570af13dfd0 con 0x5570af3b1b20 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb023e00640 1 --2- 172.21.15.144:0/812083558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b1b20 0x5570af3b1230 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb010001450 tx=0x7fb0240cdd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b7111108a90914 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.255+0000 7fb018c00640 1 -- 172.21.15.144:0/812083558 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010007270 con 0x5570af3b1b20 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb018c00640 1 -- 172.21.15.144:0/812083558 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb010007410 con 0x5570af3b1b20 2024-09-12T12:21:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb018c00640 1 -- 172.21.15.144:0/812083558 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0100b0430 con 0x5570af3b1b20 2024-09-12T12:21:19.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- 172.21.15.144:0/812083558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b1b20 msgr2=0x5570af3b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 --2- 172.21.15.144:0/812083558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b1b20 0x5570af3b1230 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb010001450 tx=0x7fb0240cdd20 comp rx=0 tx=0).stop 2024-09-12T12:21:19.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- 172.21.15.144:0/812083558 shutdown_connections 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 --2- 172.21.15.144:0/812083558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af3b2440 0x5570af3c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 --2- 172.21.15.144:0/812083558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b1b20 0x5570af3b1230 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 --2- 172.21.15.144:0/812083558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af36d330 0x5570af3b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- 172.21.15.144:0/812083558 >> 172.21.15.144:0/812083558 conn(0x5570af368290 msgr2=0x5570af36c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- 172.21.15.144:0/812083558 shutdown_connections 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- 172.21.15.144:0/812083558 wait complete. 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- start start 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 Processor -- start 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af36d330 0x5570af3c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 0x5570af3e0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b2440 0x5570af3e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5570af1b5f80 con 0x5570af3b2440 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5570af16eca0 con 0x5570af3b1b20 2024-09-12T12:21:19.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5570af1bb2a0 con 0x5570af36d330 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 10 client.0 _ll_register_callbacks cb 0x7fb01c017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b2440 0x5570af3e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af36d330 0x5570af3c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af36d330 0x5570af3c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:37194/0 (socket says 172.21.15.144:37194) 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b2440 0x5570af3e0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47424/0 (socket says 172.21.15.144:47424) 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029c00640 1 -- 172.21.15.144:0/1532986241 learned_addr learned my addr 172.21.15.144:0/1532986241 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb023e00640 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 0x5570af3e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029c00640 1 -- 172.21.15.144:0/1532986241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af36d330 msgr2=0x5570af3c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029c00640 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af36d330 0x5570af3c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029c00640 1 -- 172.21.15.144:0/1532986241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 msgr2=0x5570af3e0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:19.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029c00640 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 0x5570af3e0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029c00640 1 -- 172.21.15.144:0/1532986241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570af239750 con 0x5570af3b2440 2024-09-12T12:21:19.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb029c00640 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b2440 0x5570af3e0ea0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb01c001e00 tx=0x7fb01c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c765bb3f323cba3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb00e000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb00e000640 1 -- 172.21.15.144:0/1532986241 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c036060 con 0x5570af3b2440 2024-09-12T12:21:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb00e000640 1 -- 172.21.15.144:0/1532986241 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fb01c006d70 con 0x5570af3b2440 2024-09-12T12:21:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.259+0000 7fb02f011000 1 -- 172.21.15.144:0/1532986241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb010007410 con 0x5570af3b2440 2024-09-12T12:21:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb00e000640 1 -- 172.21.15.144:0/1532986241 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7fb01c03c050 con 0x5570af3b2440 2024-09-12T12:21:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 10 client.8526 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 -- 172.21.15.144:0/1532986241 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x5570af144a30 con 0x5570af3b2440 2024-09-12T12:21:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb00e000640 1 -- 172.21.15.144:0/1532986241 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb010007410 con 0x5570af3b2440 2024-09-12T12:21:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb00e000640 1 -- 172.21.15.144:0/1532986241 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7fb01c03f020 con 0x5570af3b2440 2024-09-12T12:21:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 10 client.8526 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 10 client.8526 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:21:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 20 client.8526 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5570af3e13e0 0x5570af424ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 4 client.8526 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 -- 172.21.15.144:0/1532986241 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "status"}) -- 0x5570af1c43a0 con 0x5570af3e13e0 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb029200640 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5570af3e13e0 0x5570af424ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb029200640 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5570af3e13e0 0x5570af424ce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceeec5980026d4a server_cookie=c390698a6dc378fa in_seq=0 out_seq=0 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb00e000640 10 client.8526 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb00e000640 1 -- 172.21.15.144:0/1532986241 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x5570af1c43a0 con 0x5570af3e13e0 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb00e000640 10 client.8526 handle_command_reply: tid=0 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 client.8526 shutdown 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 -- 172.21.15.144:0/1532986241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b2440 msgr2=0x5570af3e0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b2440 0x5570af3e0ea0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb01c001e00 tx=0x7fb01c012000 comp rx=0 tx=0).stop 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 -- 172.21.15.144:0/1532986241 shutdown_connections 2024-09-12T12:21:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5570af3b2440 0x5570af3e0ea0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5570af3e13e0 0x5570af424ce0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5570af3b1b20 0x5570af3e0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 --2- 172.21.15.144:0/1532986241 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5570af36d330 0x5570af3c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 -- 172.21.15.144:0/1532986241 >> 172.21.15.144:0/1532986241 conn(0x5570af368290 msgr2=0x5570af3afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb00e000640 0 client.8526 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 -- 172.21.15.144:0/1532986241 shutdown_connections 2024-09-12T12:21:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 1 -- 172.21.15.144:0/1532986241 wait complete. 2024-09-12T12:21:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02f011000 20 client.8526 trim_cache size 0 max 16384 2024-09-12T12:21:19.269 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 8391, 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 5.9015277680000002, 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 107, 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 140, 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 140, 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.770329200000001 2024-09-12T12:21:19.270 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:21:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 -- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0040678f0 msgr2=0x7fb004069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0040678f0 0x7fb004069db0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb0100af000 tx=0x7fb0100aa000 comp rx=0 tx=0).stop 2024-09-12T12:21:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 -- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 msgr2=0x7fb0240b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb0240b5020 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb014011c00 tx=0x7fb01400f610 comp rx=0 tx=0).stop 2024-09-12T12:21:19.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 -- 172.21.15.144:0/3152321099 shutdown_connections 2024-09-12T12:21:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0040678f0 0x7fb004069db0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0240ae8c0 0x7fb0240aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb024156ed0 0x7fb024151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 --2- 172.21.15.144:0/3152321099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb008004810 0x7fb0240b5020 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 -- 172.21.15.144:0/3152321099 >> 172.21.15.144:0/3152321099 conn(0x7fb02406d0d0 msgr2=0x7fb0241605f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 -- 172.21.15.144:0/3152321099 shutdown_connections 2024-09-12T12:21:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.263+0000 7fb02bc00640 1 -- 172.21.15.144:0/3152321099 wait complete. 2024-09-12T12:21:19.283 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:21:19.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30d600640 1 Processor -- start 2024-09-12T12:21:19.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30d600640 1 -- start start 2024-09-12T12:21:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30d600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff3080b67c0 0x7ff3080b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff308162720 con 0x7ff3080d2e10 2024-09-12T12:21:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30d600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff308162a00 con 0x7ff30815e4a0 2024-09-12T12:21:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30d600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff308073310 con 0x7ff3080b67c0 2024-09-12T12:21:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff307400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff3080d2e10 0x7ff3080737a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52864/0 (socket says 172.21.15.144:52864) 2024-09-12T12:21:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff307400640 1 -- 172.21.15.144:0/1047691459 learned_addr learned my addr 172.21.15.144:0/1047691459 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30cc00640 1 --2- 172.21.15.144:0/1047691459 >> v2:172.21.15.165:3300/0 conn(0x7ff3080b67c0 0x7ff3080b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30cc00640 1 -- 172.21.15.144:0/1047691459 >> v1:172.21.15.165:6789/0 conn(0x7ff30815e4a0 legacy=0x7ff308161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30cc00640 1 -- 172.21.15.144:0/1047691459 >> v1:172.21.15.144:6789/0 conn(0x7ff3080d2e10 legacy=0x7ff3080737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.419+0000 7ff30cc00640 1 -- 172.21.15.144:0/1047691459 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff308162ce0 con 0x7ff3080b67c0 2024-09-12T12:21:19.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff30cc00640 1 --2- 172.21.15.144:0/1047691459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3080b67c0 0x7ff3080b6c50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff3000097c0 tx=0x7ff30001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4df95e532588b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff306a00640 1 -- 172.21.15.144:0/1047691459 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000b0070 con 0x7ff3080b67c0 2024-09-12T12:21:19.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff306a00640 1 -- 172.21.15.144:0/1047691459 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3000ab600 con 0x7ff3080b67c0 2024-09-12T12:21:19.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff306a00640 1 -- 172.21.15.144:0/1047691459 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000ab9d0 con 0x7ff3080b67c0 2024-09-12T12:21:19.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff30d600640 1 -- 172.21.15.144:0/1047691459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3080b67c0 msgr2=0x7ff3080b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff30d600640 1 --2- 172.21.15.144:0/1047691459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3080b67c0 0x7ff3080b6c50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff3000097c0 tx=0x7ff30001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff30d600640 1 -- 172.21.15.144:0/1047691459 shutdown_connections 2024-09-12T12:21:19.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff30d600640 1 --2- 172.21.15.144:0/1047691459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3080b67c0 0x7ff3080b6c50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff30d600640 1 -- 172.21.15.144:0/1047691459 >> 172.21.15.144:0/1047691459 conn(0x7ff3080d2280 msgr2=0x7ff3080d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:19.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff30d600640 1 -- 172.21.15.144:0/1047691459 shutdown_connections 2024-09-12T12:21:19.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.423+0000 7ff30d600640 1 -- 172.21.15.144:0/1047691459 wait complete. 2024-09-12T12:21:19.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 Processor -- start 2024-09-12T12:21:19.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 -- start start 2024-09-12T12:21:19.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3080b67c0 0x7ff30814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3080d2e10 0x7ff3080d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30815e4a0 0x7ff3081fa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff30816c010 con 0x7ff3080b67c0 2024-09-12T12:21:19.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff30806d7c0 con 0x7ff30815e4a0 2024-09-12T12:21:19.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff30816c190 con 0x7ff3080d2e10 2024-09-12T12:21:19.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3080b67c0 0x7ff30814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3080b67c0 0x7ff30814f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47426/0 (socket says 172.21.15.144:47426) 2024-09-12T12:21:19.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3080d2e10 0x7ff3080d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307e00640 1 -- 172.21.15.144:0/4269777348 learned_addr learned my addr 172.21.15.144:0/4269777348 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:19.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30cc00640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30815e4a0 0x7ff3081fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307e00640 1 -- 172.21.15.144:0/4269777348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3080d2e10 msgr2=0x7ff3080d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307e00640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3080d2e10 0x7ff3080d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307e00640 1 -- 172.21.15.144:0/4269777348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30815e4a0 msgr2=0x7ff3081fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307e00640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30815e4a0 0x7ff3081fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307e00640 1 -- 172.21.15.144:0/4269777348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff308150010 con 0x7ff3080b67c0 2024-09-12T12:21:19.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff307e00640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3080b67c0 0x7ff30814f910 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800c7c0 tx=0x7ff2f800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff2ffe00640 1 -- 172.21.15.144:0/4269777348 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8016020 con 0x7ff3080b67c0 2024-09-12T12:21:19.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff2ffe00640 1 -- 172.21.15.144:0/4269777348 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f8006d60 con 0x7ff3080b67c0 2024-09-12T12:21:19.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3081502f0 con 0x7ff3080b67c0 2024-09-12T12:21:19.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff2ffe00640 1 -- 172.21.15.144:0/4269777348 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8003bc0 con 0x7ff3080b67c0 2024-09-12T12:21:19.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.427+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3081508b0 con 0x7ff3080b67c0 2024-09-12T12:21:19.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.431+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3080b6c50 con 0x7ff3080b67c0 2024-09-12T12:21:19.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.431+0000 7ff2ffe00640 1 -- 172.21.15.144:0/4269777348 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2f800a850 con 0x7ff3080b67c0 2024-09-12T12:21:19.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.431+0000 7ff2ffe00640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2e80678c0 0x7ff2e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:19.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.431+0000 7ff2ffe00640 1 -- 172.21.15.144:0/4269777348 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7ff2f80859f0 con 0x7ff3080b67c0 2024-09-12T12:21:19.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.431+0000 7ff307400640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2e80678c0 0x7ff2e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:19.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.431+0000 7ff307400640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2e80678c0 0x7ff2e8069d80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4005890 tx=0x7ff2f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:19.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.435+0000 7ff2ffe00640 1 -- 172.21.15.144:0/4269777348 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff2f8087e20 con 0x7ff3080b67c0 2024-09-12T12:21:19.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.627+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff308151180 con 0x7ff3080b67c0 2024-09-12T12:21:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.627+0000 7ff2ffe00640 1 -- 172.21.15.144:0/4269777348 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v107) ==== 53+0+73 (secure 0 0 0) 0x7ff2f8020020 con 0x7ff3080b67c0 2024-09-12T12:21:19.630 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:21:19.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2e80678c0 msgr2=0x7ff2e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2e80678c0 0x7ff2e8069d80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4005890 tx=0x7ff2f4009040 comp rx=0 tx=0).stop 2024-09-12T12:21:19.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3080b67c0 msgr2=0x7ff30814f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:19.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3080b67c0 0x7ff30814f910 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800c7c0 tx=0x7ff2f800cc80 comp rx=0 tx=0).stop 2024-09-12T12:21:19.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 shutdown_connections 2024-09-12T12:21:19.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2e80678c0 0x7ff2e8069d80 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30815e4a0 0x7ff3081fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff3080d2e10 0x7ff3080d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 --2- 172.21.15.144:0/4269777348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3080b67c0 0x7ff30814f910 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 >> 172.21.15.144:0/4269777348 conn(0x7ff3080d2280 msgr2=0x7ff3080737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 shutdown_connections 2024-09-12T12:21:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19.631+0000 7ff30d600640 1 -- 172.21.15.144:0/4269777348 wait complete. 2024-09-12T12:21:19.651 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:21:19.651 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:21:19.651 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:21:19.651 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:21:19.651 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:21:19.651 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:21:19.651 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:21:19.651 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:21:19.651 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:21:19.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:19.652 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:21:19.660 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:21:19.661 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41903sec preferred_lft 41903sec 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:21:19.662 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:21:19.663 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:21:19.663 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:21:19.663 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:21:19.663 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:21:19.663 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:21:19.663 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:21:19.663 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:21:19.663 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:21:19.663 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:21:19.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:19.664 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:21:19.723 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:21:19.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:19.725 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:21:19.777 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:21:19.778 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:21:19.778 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:19.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:21:19.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:21:19.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:21:19.778 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:19.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:21:19.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:19.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:19.912 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:21:19.921 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:21:19.921 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:21:19.921 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:21:19.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:19.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:21:19.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:21:19.985 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:21:20.038 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:21:20.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:21:20.038 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:21:20.089 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:21:20.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:20.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:21:20.178 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:21:20.178 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:21:20.190 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:21:20.190 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:21:20.190 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:21:20.190 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:21:20.190 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:21:20.194 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:21:20.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:20.194 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:21:20.214 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:21:20.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:20.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:20.321 INFO:teuthology.orchestra.run.smithi144.stdout:client7208 2024-09-12T12:21:20.321 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:21:20.321 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:20.332 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-12T12:21:20.333 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-09-12T12:21:20.333 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:20.333 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:20.333 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.0 2024-09-12T12:21:20.333 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:20.333 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:20.333 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:20.333 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:20.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:20.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.453 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163052 s, 64.3 MB/s 2024-09-12T12:21:20.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.474 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189359 s, 55.4 MB/s 2024-09-12T12:21:20.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.493 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155964 s, 67.2 MB/s 2024-09-12T12:21:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.510 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153312 s, 68.4 MB/s 2024-09-12T12:21:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.526 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133947 s, 78.3 MB/s 2024-09-12T12:21:20.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.543 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139477 s, 75.2 MB/s 2024-09-12T12:21:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146263 s, 71.7 MB/s 2024-09-12T12:21:20.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.576 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132335 s, 79.2 MB/s 2024-09-12T12:21:20.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.592 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135208 s, 77.6 MB/s 2024-09-12T12:21:20.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.610 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014581 s, 71.9 MB/s 2024-09-12T12:21:20.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.626 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139932 s, 74.9 MB/s 2024-09-12T12:21:20.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.643 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151088 s, 69.4 MB/s 2024-09-12T12:21:20.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.659 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128915 s, 81.3 MB/s 2024-09-12T12:21:20.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.677 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151983 s, 69.0 MB/s 2024-09-12T12:21:20.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.692 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012986 s, 80.7 MB/s 2024-09-12T12:21:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157989 s, 66.4 MB/s 2024-09-12T12:21:20.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.727 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140324 s, 74.7 MB/s 2024-09-12T12:21:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121572 s, 86.3 MB/s 2024-09-12T12:21:20.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.759 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146131 s, 71.8 MB/s 2024-09-12T12:21:20.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.777 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153407 s, 68.4 MB/s 2024-09-12T12:21:20.794 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152548 s, 68.7 MB/s 2024-09-12T12:21:20.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.811 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013703 s, 76.5 MB/s 2024-09-12T12:21:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153202 s, 68.4 MB/s 2024-09-12T12:21:20.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.849 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.849 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171705 s, 61.1 MB/s 2024-09-12T12:21:20.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.868 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169608 s, 61.8 MB/s 2024-09-12T12:21:20.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.885 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144634 s, 72.5 MB/s 2024-09-12T12:21:20.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.902 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135932 s, 77.1 MB/s 2024-09-12T12:21:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124081 s, 84.5 MB/s 2024-09-12T12:21:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.933 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140558 s, 74.6 MB/s 2024-09-12T12:21:20.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.951 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155552 s, 67.4 MB/s 2024-09-12T12:21:20.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.969 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144553 s, 72.5 MB/s 2024-09-12T12:21:20.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:20.984 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:20.984 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125632 s, 83.5 MB/s 2024-09-12T12:21:20.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:20.991 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:20.991 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:20.991 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.1 2024-09-12T12:21:20.991 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:20.991 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:20.991 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:20.991 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:21.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131557 s, 79.7 MB/s 2024-09-12T12:21:21.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.074 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136648 s, 76.7 MB/s 2024-09-12T12:21:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140202 s, 74.8 MB/s 2024-09-12T12:21:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.106 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135787 s, 77.2 MB/s 2024-09-12T12:21:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.122 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130121 s, 80.6 MB/s 2024-09-12T12:21:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128412 s, 81.7 MB/s 2024-09-12T12:21:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155285 s, 67.5 MB/s 2024-09-12T12:21:21.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.171 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128871 s, 81.4 MB/s 2024-09-12T12:21:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139683 s, 75.1 MB/s 2024-09-12T12:21:21.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149243 s, 70.3 MB/s 2024-09-12T12:21:21.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.221 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128902 s, 81.3 MB/s 2024-09-12T12:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013454 s, 77.9 MB/s 2024-09-12T12:21:21.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.253 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130362 s, 80.4 MB/s 2024-09-12T12:21:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142653 s, 73.5 MB/s 2024-09-12T12:21:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.286 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130402 s, 80.4 MB/s 2024-09-12T12:21:21.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109321 s, 95.9 MB/s 2024-09-12T12:21:21.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.316 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148873 s, 70.4 MB/s 2024-09-12T12:21:21.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.332 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01329 s, 78.9 MB/s 2024-09-12T12:21:21.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01315 s, 79.7 MB/s 2024-09-12T12:21:21.366 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.366 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.366 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154293 s, 68.0 MB/s 2024-09-12T12:21:21.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.382 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138648 s, 75.6 MB/s 2024-09-12T12:21:21.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.401 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.401 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139777 s, 75.0 MB/s 2024-09-12T12:21:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145555 s, 72.0 MB/s 2024-09-12T12:21:21.432 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.433 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013854 s, 75.7 MB/s 2024-09-12T12:21:21.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.449 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013223 s, 79.3 MB/s 2024-09-12T12:21:21.465 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.466 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145422 s, 72.1 MB/s 2024-09-12T12:21:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150779 s, 69.5 MB/s 2024-09-12T12:21:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.499 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012545 s, 83.6 MB/s 2024-09-12T12:21:21.514 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.514 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.514 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013018 s, 80.5 MB/s 2024-09-12T12:21:21.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.529 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124967 s, 83.9 MB/s 2024-09-12T12:21:21.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.546 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143428 s, 73.1 MB/s 2024-09-12T12:21:21.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.562 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134317 s, 78.1 MB/s 2024-09-12T12:21:21.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:21.570 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:21.570 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:21.570 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.2 2024-09-12T12:21:21.570 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:21.570 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:21.570 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:21.570 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:21.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:21.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142669 s, 73.5 MB/s 2024-09-12T12:21:21.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.654 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.654 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141724 s, 74.0 MB/s 2024-09-12T12:21:21.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.673 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163983 s, 63.9 MB/s 2024-09-12T12:21:21.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.689 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137395 s, 76.3 MB/s 2024-09-12T12:21:21.705 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.705 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.705 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138656 s, 75.6 MB/s 2024-09-12T12:21:21.722 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.722 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.722 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138697 s, 75.6 MB/s 2024-09-12T12:21:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.738 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130409 s, 80.4 MB/s 2024-09-12T12:21:21.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013922 s, 75.3 MB/s 2024-09-12T12:21:21.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.771 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.771 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138228 s, 75.9 MB/s 2024-09-12T12:21:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164919 s, 63.6 MB/s 2024-09-12T12:21:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130818 s, 80.2 MB/s 2024-09-12T12:21:21.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.823 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149814 s, 70.0 MB/s 2024-09-12T12:21:21.838 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.838 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.838 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123984 s, 84.6 MB/s 2024-09-12T12:21:21.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.854 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129853 s, 80.8 MB/s 2024-09-12T12:21:21.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.872 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158522 s, 66.1 MB/s 2024-09-12T12:21:21.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.888 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137075 s, 76.5 MB/s 2024-09-12T12:21:21.904 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.904 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.904 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130376 s, 80.4 MB/s 2024-09-12T12:21:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.919 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129999 s, 80.7 MB/s 2024-09-12T12:21:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.938 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161417 s, 65.0 MB/s 2024-09-12T12:21:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.953 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126609 s, 82.8 MB/s 2024-09-12T12:21:21.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.969 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132729 s, 79.0 MB/s 2024-09-12T12:21:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:21.986 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014227 s, 73.7 MB/s 2024-09-12T12:21:22.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.005 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164331 s, 63.8 MB/s 2024-09-12T12:21:22.020 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.020 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131077 s, 80.0 MB/s 2024-09-12T12:21:22.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.035 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124313 s, 84.3 MB/s 2024-09-12T12:21:22.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.051 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133167 s, 78.7 MB/s 2024-09-12T12:21:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.067 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131869 s, 79.5 MB/s 2024-09-12T12:21:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123355 s, 85.0 MB/s 2024-09-12T12:21:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127671 s, 82.1 MB/s 2024-09-12T12:21:22.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.113 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131563 s, 79.7 MB/s 2024-09-12T12:21:22.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.130 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138253 s, 75.8 MB/s 2024-09-12T12:21:22.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.149 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167805 s, 62.5 MB/s 2024-09-12T12:21:22.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:22.156 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:22.156 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:22.156 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.3 2024-09-12T12:21:22.156 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:22.157 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:22.157 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:22.157 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:22.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:22.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.223 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.223 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130283 s, 80.5 MB/s 2024-09-12T12:21:22.239 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.239 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.239 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013996 s, 74.9 MB/s 2024-09-12T12:21:22.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.255 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128581 s, 81.5 MB/s 2024-09-12T12:21:22.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.270 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125387 s, 83.6 MB/s 2024-09-12T12:21:22.286 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.286 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.286 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013317 s, 78.7 MB/s 2024-09-12T12:21:22.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.303 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014115 s, 74.3 MB/s 2024-09-12T12:21:22.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.318 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126831 s, 82.7 MB/s 2024-09-12T12:21:22.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.336 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126183 s, 83.1 MB/s 2024-09-12T12:21:22.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126379 s, 83.0 MB/s 2024-09-12T12:21:22.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.364 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132799 s, 79.0 MB/s 2024-09-12T12:21:22.379 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.379 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.380 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126972 s, 82.6 MB/s 2024-09-12T12:21:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.395 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130079 s, 80.6 MB/s 2024-09-12T12:21:22.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131346 s, 79.8 MB/s 2024-09-12T12:21:22.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131568 s, 79.7 MB/s 2024-09-12T12:21:22.445 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.445 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.445 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154663 s, 67.8 MB/s 2024-09-12T12:21:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013837 s, 75.8 MB/s 2024-09-12T12:21:22.477 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.477 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.477 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134841 s, 77.8 MB/s 2024-09-12T12:21:22.494 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.494 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.494 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01401 s, 74.8 MB/s 2024-09-12T12:21:22.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.510 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01256 s, 83.5 MB/s 2024-09-12T12:21:22.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.525 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128421 s, 81.7 MB/s 2024-09-12T12:21:22.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129783 s, 80.8 MB/s 2024-09-12T12:21:22.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.557 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136977 s, 76.6 MB/s 2024-09-12T12:21:22.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.573 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131576 s, 79.7 MB/s 2024-09-12T12:21:22.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.593 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.593 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170841 s, 61.4 MB/s 2024-09-12T12:21:22.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.609 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138939 s, 75.5 MB/s 2024-09-12T12:21:22.625 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.626 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139915 s, 74.9 MB/s 2024-09-12T12:21:22.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.643 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142336 s, 73.7 MB/s 2024-09-12T12:21:22.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.658 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130768 s, 80.2 MB/s 2024-09-12T12:21:22.675 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.675 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.675 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143003 s, 73.3 MB/s 2024-09-12T12:21:22.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.693 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.693 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014938 s, 70.2 MB/s 2024-09-12T12:21:22.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.709 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.709 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133618 s, 78.5 MB/s 2024-09-12T12:21:22.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.725 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129043 s, 81.3 MB/s 2024-09-12T12:21:22.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:22.731 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:22.731 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:22.732 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.4 2024-09-12T12:21:22.732 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:22.732 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:22.732 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:22.732 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:22.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.800 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144777 s, 72.4 MB/s 2024-09-12T12:21:22.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.816 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.816 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131459 s, 79.8 MB/s 2024-09-12T12:21:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.829 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111132 s, 94.4 MB/s 2024-09-12T12:21:22.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.848 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165679 s, 63.3 MB/s 2024-09-12T12:21:22.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.863 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123545 s, 84.9 MB/s 2024-09-12T12:21:22.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.879 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131235 s, 79.9 MB/s 2024-09-12T12:21:22.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.894 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01277 s, 82.1 MB/s 2024-09-12T12:21:22.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130657 s, 80.3 MB/s 2024-09-12T12:21:22.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.930 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169058 s, 62.0 MB/s 2024-09-12T12:21:22.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.944 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121264 s, 86.5 MB/s 2024-09-12T12:21:22.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.959 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123393 s, 85.0 MB/s 2024-09-12T12:21:22.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.976 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139307 s, 75.3 MB/s 2024-09-12T12:21:22.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:22.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:22.993 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013942 s, 75.2 MB/s 2024-09-12T12:21:23.010 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.011 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154382 s, 67.9 MB/s 2024-09-12T12:21:23.026 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.026 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.026 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128367 s, 81.7 MB/s 2024-09-12T12:21:23.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.042 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127105 s, 82.5 MB/s 2024-09-12T12:21:23.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.061 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166215 s, 63.1 MB/s 2024-09-12T12:21:23.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132917 s, 78.9 MB/s 2024-09-12T12:21:23.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165707 s, 63.3 MB/s 2024-09-12T12:21:23.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.113 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128992 s, 81.3 MB/s 2024-09-12T12:21:23.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.128 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133662 s, 78.4 MB/s 2024-09-12T12:21:23.142 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.142 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.142 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116355 s, 90.1 MB/s 2024-09-12T12:21:23.158 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.158 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.158 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139351 s, 75.2 MB/s 2024-09-12T12:21:23.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.178 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167185 s, 62.7 MB/s 2024-09-12T12:21:23.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.194 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131447 s, 79.8 MB/s 2024-09-12T12:21:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.209 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126698 s, 82.8 MB/s 2024-09-12T12:21:23.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.222 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109706 s, 95.6 MB/s 2024-09-12T12:21:23.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129782 s, 80.8 MB/s 2024-09-12T12:21:23.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.255 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140684 s, 74.5 MB/s 2024-09-12T12:21:23.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.274 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167377 s, 62.6 MB/s 2024-09-12T12:21:23.291 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.291 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.291 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143045 s, 73.3 MB/s 2024-09-12T12:21:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134427 s, 78.0 MB/s 2024-09-12T12:21:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:23.314 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:23.314 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:23.314 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.5 2024-09-12T12:21:23.314 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:23.314 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:23.314 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:23.314 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:23.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143247 s, 73.2 MB/s 2024-09-12T12:21:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.398 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136473 s, 76.8 MB/s 2024-09-12T12:21:23.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.414 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140158 s, 74.8 MB/s 2024-09-12T12:21:23.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.431 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142912 s, 73.4 MB/s 2024-09-12T12:21:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.447 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125989 s, 83.2 MB/s 2024-09-12T12:21:23.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.460 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109807 s, 95.5 MB/s 2024-09-12T12:21:23.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.476 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128656 s, 81.5 MB/s 2024-09-12T12:21:23.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.491 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124022 s, 84.5 MB/s 2024-09-12T12:21:23.510 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.510 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.511 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173305 s, 60.5 MB/s 2024-09-12T12:21:23.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.529 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153751 s, 68.2 MB/s 2024-09-12T12:21:23.548 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.548 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.549 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163675 s, 64.1 MB/s 2024-09-12T12:21:23.567 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.567 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.567 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149255 s, 70.3 MB/s 2024-09-12T12:21:23.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.586 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169207 s, 62.0 MB/s 2024-09-12T12:21:23.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.602 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01296 s, 80.9 MB/s 2024-09-12T12:21:23.618 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.618 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.618 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132436 s, 79.2 MB/s 2024-09-12T12:21:23.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.634 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132071 s, 79.4 MB/s 2024-09-12T12:21:23.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.651 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148731 s, 70.5 MB/s 2024-09-12T12:21:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.667 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135863 s, 77.2 MB/s 2024-09-12T12:21:23.682 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.682 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.682 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123488 s, 84.9 MB/s 2024-09-12T12:21:23.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.701 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01584 s, 66.2 MB/s 2024-09-12T12:21:23.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.717 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134384 s, 78.0 MB/s 2024-09-12T12:21:23.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.734 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145086 s, 72.3 MB/s 2024-09-12T12:21:23.750 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.750 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.751 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141925 s, 73.9 MB/s 2024-09-12T12:21:23.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.767 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.767 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134298 s, 78.1 MB/s 2024-09-12T12:21:23.784 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.784 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.784 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145523 s, 72.1 MB/s 2024-09-12T12:21:23.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.800 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.800 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131929 s, 79.5 MB/s 2024-09-12T12:21:23.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.815 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013005 s, 80.6 MB/s 2024-09-12T12:21:23.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.831 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132909 s, 78.9 MB/s 2024-09-12T12:21:23.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.846 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125335 s, 83.7 MB/s 2024-09-12T12:21:23.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.862 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127963 s, 81.9 MB/s 2024-09-12T12:21:23.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.879 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146448 s, 71.6 MB/s 2024-09-12T12:21:23.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:23.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:23.894 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123939 s, 84.6 MB/s 2024-09-12T12:21:23.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:23.902 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:23.902 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:23.902 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.6 2024-09-12T12:21:23.902 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:23.902 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:23.902 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:23.902 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:24.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.011 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127413 s, 82.3 MB/s 2024-09-12T12:21:24.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.027 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130676 s, 80.2 MB/s 2024-09-12T12:21:24.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.042 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123248 s, 85.1 MB/s 2024-09-12T12:21:24.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.058 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138062 s, 75.9 MB/s 2024-09-12T12:21:24.073 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.073 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.073 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122722 s, 85.4 MB/s 2024-09-12T12:21:24.089 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.089 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.089 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132437 s, 79.2 MB/s 2024-09-12T12:21:24.105 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.106 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138912 s, 75.5 MB/s 2024-09-12T12:21:24.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.121 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131901 s, 79.5 MB/s 2024-09-12T12:21:24.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.136 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125936 s, 83.3 MB/s 2024-09-12T12:21:24.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.151 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122156 s, 85.8 MB/s 2024-09-12T12:21:24.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.168 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140595 s, 74.6 MB/s 2024-09-12T12:21:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129231 s, 81.1 MB/s 2024-09-12T12:21:24.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.200 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014139 s, 74.2 MB/s 2024-09-12T12:21:24.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.220 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141988 s, 73.8 MB/s 2024-09-12T12:21:24.232 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.232 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.232 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124239 s, 84.4 MB/s 2024-09-12T12:21:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133967 s, 78.3 MB/s 2024-09-12T12:21:24.263 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.263 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.264 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128072 s, 81.9 MB/s 2024-09-12T12:21:24.278 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.279 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124982 s, 83.9 MB/s 2024-09-12T12:21:24.294 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.294 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.294 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125855 s, 83.3 MB/s 2024-09-12T12:21:24.310 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.310 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.310 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139514 s, 75.2 MB/s 2024-09-12T12:21:24.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.325 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128049 s, 81.9 MB/s 2024-09-12T12:21:24.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.342 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136612 s, 76.8 MB/s 2024-09-12T12:21:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127636 s, 82.2 MB/s 2024-09-12T12:21:24.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.373 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132367 s, 79.2 MB/s 2024-09-12T12:21:24.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.389 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124202 s, 84.4 MB/s 2024-09-12T12:21:24.408 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.408 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.408 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168851 s, 62.1 MB/s 2024-09-12T12:21:24.423 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.424 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130432 s, 80.4 MB/s 2024-09-12T12:21:24.439 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.439 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.439 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129791 s, 80.8 MB/s 2024-09-12T12:21:24.454 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.454 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.454 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126775 s, 82.7 MB/s 2024-09-12T12:21:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169048 s, 62.0 MB/s 2024-09-12T12:21:24.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136362 s, 76.9 MB/s 2024-09-12T12:21:24.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.507 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143352 s, 73.1 MB/s 2024-09-12T12:21:24.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:24.515 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:24.515 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:24.515 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.7 2024-09-12T12:21:24.515 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:24.515 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:24.515 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:24.516 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:24.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:24.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.627 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128778 s, 81.4 MB/s 2024-09-12T12:21:24.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.644 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142288 s, 73.7 MB/s 2024-09-12T12:21:24.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.660 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136129 s, 77.0 MB/s 2024-09-12T12:21:24.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.677 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142104 s, 73.8 MB/s 2024-09-12T12:21:24.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.696 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165596 s, 63.3 MB/s 2024-09-12T12:21:24.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.712 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125588 s, 83.5 MB/s 2024-09-12T12:21:24.726 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.727 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129697 s, 80.8 MB/s 2024-09-12T12:21:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.742 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012549 s, 83.6 MB/s 2024-09-12T12:21:24.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111761 s, 93.8 MB/s 2024-09-12T12:21:24.771 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.772 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135564 s, 77.3 MB/s 2024-09-12T12:21:24.786 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.787 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126001 s, 83.2 MB/s 2024-09-12T12:21:24.802 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.802 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.802 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128368 s, 81.7 MB/s 2024-09-12T12:21:24.818 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136084 s, 77.1 MB/s 2024-09-12T12:21:24.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.836 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124618 s, 84.1 MB/s 2024-09-12T12:21:24.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.853 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165013 s, 63.5 MB/s 2024-09-12T12:21:24.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.869 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130498 s, 80.4 MB/s 2024-09-12T12:21:24.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.885 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139398 s, 75.2 MB/s 2024-09-12T12:21:24.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.901 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131995 s, 79.4 MB/s 2024-09-12T12:21:24.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.918 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145161 s, 72.2 MB/s 2024-09-12T12:21:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.934 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132326 s, 79.2 MB/s 2024-09-12T12:21:24.949 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.949 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.949 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125496 s, 83.6 MB/s 2024-09-12T12:21:24.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.964 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126428 s, 82.9 MB/s 2024-09-12T12:21:24.980 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.981 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01365 s, 76.8 MB/s 2024-09-12T12:21:24.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:24.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:24.997 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139659 s, 75.1 MB/s 2024-09-12T12:21:25.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.015 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140698 s, 74.5 MB/s 2024-09-12T12:21:25.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.030 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132677 s, 79.0 MB/s 2024-09-12T12:21:25.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164807 s, 63.6 MB/s 2024-09-12T12:21:25.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.065 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135539 s, 77.4 MB/s 2024-09-12T12:21:25.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.084 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160097 s, 65.5 MB/s 2024-09-12T12:21:25.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.099 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124832 s, 84.0 MB/s 2024-09-12T12:21:25.115 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.115 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.115 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137388 s, 76.3 MB/s 2024-09-12T12:21:25.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139221 s, 75.3 MB/s 2024-09-12T12:21:25.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:25.139 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:25.139 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:25.139 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.8 2024-09-12T12:21:25.139 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:25.139 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:25.139 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:25.139 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:25.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:25.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.206 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139659 s, 75.1 MB/s 2024-09-12T12:21:25.224 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.224 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.224 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160728 s, 65.2 MB/s 2024-09-12T12:21:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137972 s, 76.0 MB/s 2024-09-12T12:21:25.256 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.256 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.257 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013622 s, 77.0 MB/s 2024-09-12T12:21:25.272 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.272 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.272 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132437 s, 79.2 MB/s 2024-09-12T12:21:25.291 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.291 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.291 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158702 s, 66.1 MB/s 2024-09-12T12:21:25.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.306 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130156 s, 80.6 MB/s 2024-09-12T12:21:25.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.321 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126106 s, 83.2 MB/s 2024-09-12T12:21:25.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.337 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126564 s, 82.8 MB/s 2024-09-12T12:21:25.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.353 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134427 s, 78.0 MB/s 2024-09-12T12:21:25.369 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.369 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.369 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138011 s, 76.0 MB/s 2024-09-12T12:21:25.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.385 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126908 s, 82.6 MB/s 2024-09-12T12:21:25.401 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.401 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.401 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138874 s, 75.5 MB/s 2024-09-12T12:21:25.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.418 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146708 s, 71.5 MB/s 2024-09-12T12:21:25.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.435 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144507 s, 72.6 MB/s 2024-09-12T12:21:25.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.451 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013256 s, 79.1 MB/s 2024-09-12T12:21:25.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.468 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144346 s, 72.6 MB/s 2024-09-12T12:21:25.484 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.484 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.484 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135765 s, 77.2 MB/s 2024-09-12T12:21:25.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.500 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.500 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124787 s, 84.0 MB/s 2024-09-12T12:21:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135231 s, 77.5 MB/s 2024-09-12T12:21:25.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.532 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013059 s, 80.3 MB/s 2024-09-12T12:21:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139633 s, 75.1 MB/s 2024-09-12T12:21:25.563 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.563 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.563 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127814 s, 82.0 MB/s 2024-09-12T12:21:25.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.581 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144242 s, 72.7 MB/s 2024-09-12T12:21:25.596 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.596 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.596 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01304 s, 80.4 MB/s 2024-09-12T12:21:25.615 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.615 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.615 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166954 s, 62.8 MB/s 2024-09-12T12:21:25.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.631 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128906 s, 81.3 MB/s 2024-09-12T12:21:25.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.647 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138334 s, 75.8 MB/s 2024-09-12T12:21:25.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.663 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129272 s, 81.1 MB/s 2024-09-12T12:21:25.680 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.680 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.680 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143156 s, 73.2 MB/s 2024-09-12T12:21:25.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.698 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015901 s, 65.9 MB/s 2024-09-12T12:21:25.713 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.713 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127269 s, 82.4 MB/s 2024-09-12T12:21:25.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:25.721 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:25.721 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:25.721 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.9 2024-09-12T12:21:25.721 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:25.721 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:25.721 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:25.721 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:25.830 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.830 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.830 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163648 s, 64.1 MB/s 2024-09-12T12:21:25.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.846 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132762 s, 79.0 MB/s 2024-09-12T12:21:25.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.865 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161745 s, 64.8 MB/s 2024-09-12T12:21:25.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.882 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136572 s, 76.8 MB/s 2024-09-12T12:21:25.898 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.898 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.898 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136241 s, 77.0 MB/s 2024-09-12T12:21:25.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.914 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.914 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135133 s, 77.6 MB/s 2024-09-12T12:21:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.931 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014342 s, 73.1 MB/s 2024-09-12T12:21:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.947 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139239 s, 75.3 MB/s 2024-09-12T12:21:25.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.962 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126787 s, 82.7 MB/s 2024-09-12T12:21:25.978 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.979 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.979 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138822 s, 75.5 MB/s 2024-09-12T12:21:25.995 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:25.995 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:25.995 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141047 s, 74.3 MB/s 2024-09-12T12:21:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141952 s, 73.9 MB/s 2024-09-12T12:21:26.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.029 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143924 s, 72.9 MB/s 2024-09-12T12:21:26.044 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.044 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.044 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123242 s, 85.1 MB/s 2024-09-12T12:21:26.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.061 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125713 s, 83.4 MB/s 2024-09-12T12:21:26.076 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.076 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.077 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142295 s, 73.7 MB/s 2024-09-12T12:21:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.092 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134626 s, 77.9 MB/s 2024-09-12T12:21:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172926 s, 60.6 MB/s 2024-09-12T12:21:26.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.128 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134221 s, 78.1 MB/s 2024-09-12T12:21:26.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.145 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013906 s, 75.4 MB/s 2024-09-12T12:21:26.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.161 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134892 s, 77.7 MB/s 2024-09-12T12:21:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135791 s, 77.2 MB/s 2024-09-12T12:21:26.192 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.192 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.192 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131139 s, 80.0 MB/s 2024-09-12T12:21:26.207 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.208 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.208 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127554 s, 82.2 MB/s 2024-09-12T12:21:26.223 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.223 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.223 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132019 s, 79.4 MB/s 2024-09-12T12:21:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131671 s, 79.6 MB/s 2024-09-12T12:21:26.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.255 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133133 s, 78.8 MB/s 2024-09-12T12:21:26.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.271 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135338 s, 77.5 MB/s 2024-09-12T12:21:26.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.290 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166694 s, 62.9 MB/s 2024-09-12T12:21:26.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.306 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130955 s, 80.1 MB/s 2024-09-12T12:21:26.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.321 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126521 s, 82.9 MB/s 2024-09-12T12:21:26.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.337 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132876 s, 78.9 MB/s 2024-09-12T12:21:26.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:26.345 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:26.345 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:26.345 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.10 2024-09-12T12:21:26.345 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:26.345 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:26.345 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:26.345 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:26.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:26.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.457 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.457 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141015 s, 74.4 MB/s 2024-09-12T12:21:26.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.474 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143605 s, 73.0 MB/s 2024-09-12T12:21:26.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139348 s, 75.2 MB/s 2024-09-12T12:21:26.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.506 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132787 s, 79.0 MB/s 2024-09-12T12:21:26.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.522 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013753 s, 76.2 MB/s 2024-09-12T12:21:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.538 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129823 s, 80.8 MB/s 2024-09-12T12:21:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.556 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156626 s, 66.9 MB/s 2024-09-12T12:21:26.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.572 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130847 s, 80.1 MB/s 2024-09-12T12:21:26.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.588 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136966 s, 76.6 MB/s 2024-09-12T12:21:26.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.605 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140107 s, 74.8 MB/s 2024-09-12T12:21:26.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.622 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142106 s, 73.8 MB/s 2024-09-12T12:21:26.635 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.636 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112225 s, 93.4 MB/s 2024-09-12T12:21:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.651 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130523 s, 80.3 MB/s 2024-09-12T12:21:26.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.668 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142825 s, 73.4 MB/s 2024-09-12T12:21:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.685 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143299 s, 73.2 MB/s 2024-09-12T12:21:26.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.700 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012692 s, 82.6 MB/s 2024-09-12T12:21:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.717 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137029 s, 76.5 MB/s 2024-09-12T12:21:26.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.735 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155978 s, 67.2 MB/s 2024-09-12T12:21:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013455 s, 77.9 MB/s 2024-09-12T12:21:26.765 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.765 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.766 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118165 s, 88.7 MB/s 2024-09-12T12:21:26.781 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.781 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.781 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128208 s, 81.8 MB/s 2024-09-12T12:21:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.798 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138235 s, 75.9 MB/s 2024-09-12T12:21:26.814 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.814 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.814 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143763 s, 72.9 MB/s 2024-09-12T12:21:26.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.831 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141704 s, 74.0 MB/s 2024-09-12T12:21:26.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.847 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133575 s, 78.5 MB/s 2024-09-12T12:21:26.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.863 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135771 s, 77.2 MB/s 2024-09-12T12:21:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130392 s, 80.4 MB/s 2024-09-12T12:21:26.896 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.896 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.896 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143331 s, 73.2 MB/s 2024-09-12T12:21:26.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.912 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.912 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130138 s, 80.6 MB/s 2024-09-12T12:21:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130819 s, 80.2 MB/s 2024-09-12T12:21:26.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.944 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144352 s, 72.6 MB/s 2024-09-12T12:21:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128524 s, 81.6 MB/s 2024-09-12T12:21:26.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:26.967 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:26.967 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:26.967 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.11 2024-09-12T12:21:26.967 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:26.967 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:26.967 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:26.967 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:27.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.033 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135873 s, 77.2 MB/s 2024-09-12T12:21:27.052 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.052 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.052 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166763 s, 62.9 MB/s 2024-09-12T12:21:27.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.068 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129725 s, 80.8 MB/s 2024-09-12T12:21:27.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.084 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131034 s, 80.0 MB/s 2024-09-12T12:21:27.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.100 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.100 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133864 s, 78.3 MB/s 2024-09-12T12:21:27.115 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.115 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.115 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131329 s, 79.8 MB/s 2024-09-12T12:21:27.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130545 s, 80.3 MB/s 2024-09-12T12:21:27.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.147 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130251 s, 80.5 MB/s 2024-09-12T12:21:27.162 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.162 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.162 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126725 s, 82.7 MB/s 2024-09-12T12:21:27.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.178 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013444 s, 78.0 MB/s 2024-09-12T12:21:27.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.193 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126844 s, 82.7 MB/s 2024-09-12T12:21:27.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.209 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01283 s, 81.7 MB/s 2024-09-12T12:21:27.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.227 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146284 s, 71.7 MB/s 2024-09-12T12:21:27.245 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.246 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.246 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015809 s, 66.3 MB/s 2024-09-12T12:21:27.262 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.262 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.262 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131836 s, 79.5 MB/s 2024-09-12T12:21:27.277 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.277 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.277 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127902 s, 82.0 MB/s 2024-09-12T12:21:27.292 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112211 s, 93.4 MB/s 2024-09-12T12:21:27.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.309 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141438 s, 74.1 MB/s 2024-09-12T12:21:27.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.325 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131019 s, 80.0 MB/s 2024-09-12T12:21:27.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.342 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139445 s, 75.2 MB/s 2024-09-12T12:21:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139577 s, 75.1 MB/s 2024-09-12T12:21:27.379 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.379 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.379 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168844 s, 62.1 MB/s 2024-09-12T12:21:27.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.397 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156591 s, 67.0 MB/s 2024-09-12T12:21:27.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.413 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128853 s, 81.4 MB/s 2024-09-12T12:21:27.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.430 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140369 s, 74.7 MB/s 2024-09-12T12:21:27.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.448 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144098 s, 72.8 MB/s 2024-09-12T12:21:27.464 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.464 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.464 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132394 s, 79.2 MB/s 2024-09-12T12:21:27.478 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.478 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.478 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110566 s, 94.8 MB/s 2024-09-12T12:21:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.498 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016478 s, 63.6 MB/s 2024-09-12T12:21:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127495 s, 82.2 MB/s 2024-09-12T12:21:27.530 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.530 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.530 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136058 s, 77.1 MB/s 2024-09-12T12:21:27.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.546 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131322 s, 79.8 MB/s 2024-09-12T12:21:27.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:27.553 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:27.554 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:27.554 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.12 2024-09-12T12:21:27.554 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:27.554 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:27.554 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:27.554 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:27.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:27.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.662 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139365 s, 75.2 MB/s 2024-09-12T12:21:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144883 s, 72.4 MB/s 2024-09-12T12:21:27.695 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.695 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.695 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128645 s, 81.5 MB/s 2024-09-12T12:21:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.711 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128933 s, 81.3 MB/s 2024-09-12T12:21:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.728 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136062 s, 77.1 MB/s 2024-09-12T12:21:27.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.744 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131408 s, 79.8 MB/s 2024-09-12T12:21:27.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.761 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142044 s, 73.8 MB/s 2024-09-12T12:21:27.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.779 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.779 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151267 s, 69.3 MB/s 2024-09-12T12:21:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.796 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145894 s, 71.9 MB/s 2024-09-12T12:21:27.813 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.813 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.813 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124087 s, 84.5 MB/s 2024-09-12T12:21:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.828 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.828 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135481 s, 77.4 MB/s 2024-09-12T12:21:27.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135275 s, 77.5 MB/s 2024-09-12T12:21:27.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.863 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167421 s, 62.6 MB/s 2024-09-12T12:21:27.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.879 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132417 s, 79.2 MB/s 2024-09-12T12:21:27.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.897 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131748 s, 79.6 MB/s 2024-09-12T12:21:27.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.911 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142156 s, 73.8 MB/s 2024-09-12T12:21:27.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.927 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134639 s, 77.9 MB/s 2024-09-12T12:21:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.943 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137004 s, 76.5 MB/s 2024-09-12T12:21:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.960 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013875 s, 75.6 MB/s 2024-09-12T12:21:27.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.976 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130963 s, 80.1 MB/s 2024-09-12T12:21:27.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:27.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:27.993 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145989 s, 71.8 MB/s 2024-09-12T12:21:28.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.009 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130705 s, 80.2 MB/s 2024-09-12T12:21:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183772 s, 57.1 MB/s 2024-09-12T12:21:28.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.046 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129649 s, 80.9 MB/s 2024-09-12T12:21:28.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.062 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131457 s, 79.8 MB/s 2024-09-12T12:21:28.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.077 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130215 s, 80.5 MB/s 2024-09-12T12:21:28.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.096 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154831 s, 67.7 MB/s 2024-09-12T12:21:28.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.112 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142602 s, 73.5 MB/s 2024-09-12T12:21:28.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.129 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141098 s, 74.3 MB/s 2024-09-12T12:21:28.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.144 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126254 s, 83.1 MB/s 2024-09-12T12:21:28.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.160 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129115 s, 81.2 MB/s 2024-09-12T12:21:28.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.176 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137392 s, 76.3 MB/s 2024-09-12T12:21:28.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:28.183 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:28.183 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:28.184 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.13 2024-09-12T12:21:28.184 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:28.184 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:28.184 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:28.184 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:28.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.250 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.250 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128215 s, 81.8 MB/s 2024-09-12T12:21:28.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.266 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143057 s, 73.3 MB/s 2024-09-12T12:21:28.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161834 s, 64.8 MB/s 2024-09-12T12:21:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.304 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135526 s, 77.4 MB/s 2024-09-12T12:21:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145231 s, 72.2 MB/s 2024-09-12T12:21:28.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.333 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123464 s, 84.9 MB/s 2024-09-12T12:21:28.350 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.350 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.350 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014046 s, 74.7 MB/s 2024-09-12T12:21:28.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.365 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122942 s, 85.3 MB/s 2024-09-12T12:21:28.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.383 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149403 s, 70.2 MB/s 2024-09-12T12:21:28.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.401 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.401 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148351 s, 70.7 MB/s 2024-09-12T12:21:28.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.417 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128965 s, 81.3 MB/s 2024-09-12T12:21:28.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.432 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.432 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129415 s, 81.0 MB/s 2024-09-12T12:21:28.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.451 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168662 s, 62.2 MB/s 2024-09-12T12:21:28.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.470 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156978 s, 66.8 MB/s 2024-09-12T12:21:28.484 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.485 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.485 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124308 s, 84.4 MB/s 2024-09-12T12:21:28.510 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.510 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.510 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224233 s, 46.8 MB/s 2024-09-12T12:21:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.526 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136166 s, 77.0 MB/s 2024-09-12T12:21:28.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159022 s, 65.9 MB/s 2024-09-12T12:21:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.560 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123732 s, 84.7 MB/s 2024-09-12T12:21:28.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.580 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165216 s, 63.5 MB/s 2024-09-12T12:21:28.596 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.596 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.596 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131766 s, 79.6 MB/s 2024-09-12T12:21:28.615 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.615 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.615 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167527 s, 62.6 MB/s 2024-09-12T12:21:28.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.631 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127172 s, 82.5 MB/s 2024-09-12T12:21:28.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.648 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.648 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141206 s, 74.3 MB/s 2024-09-12T12:21:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.663 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129809 s, 80.8 MB/s 2024-09-12T12:21:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.679 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133823 s, 78.4 MB/s 2024-09-12T12:21:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.696 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139531 s, 75.1 MB/s 2024-09-12T12:21:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.715 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167778 s, 62.5 MB/s 2024-09-12T12:21:28.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.732 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139286 s, 75.3 MB/s 2024-09-12T12:21:28.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.750 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153127 s, 68.5 MB/s 2024-09-12T12:21:28.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.764 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116968 s, 89.6 MB/s 2024-09-12T12:21:28.779 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.779 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.780 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129763 s, 80.8 MB/s 2024-09-12T12:21:28.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:28.786 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:28.786 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:28.787 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.14 2024-09-12T12:21:28.787 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:28.787 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:28.787 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:28.787 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:28.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:28.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.895 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132248 s, 79.3 MB/s 2024-09-12T12:21:28.912 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.912 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.912 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146574 s, 71.5 MB/s 2024-09-12T12:21:28.928 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.928 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.928 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131472 s, 79.8 MB/s 2024-09-12T12:21:28.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.944 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131315 s, 79.9 MB/s 2024-09-12T12:21:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143134 s, 73.3 MB/s 2024-09-12T12:21:28.978 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.978 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.978 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148049 s, 70.8 MB/s 2024-09-12T12:21:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:28.994 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132845 s, 78.9 MB/s 2024-09-12T12:21:29.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.009 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012443 s, 84.3 MB/s 2024-09-12T12:21:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.025 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133522 s, 78.5 MB/s 2024-09-12T12:21:29.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.042 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140568 s, 74.6 MB/s 2024-09-12T12:21:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138337 s, 75.8 MB/s 2024-09-12T12:21:29.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.074 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132102 s, 79.4 MB/s 2024-09-12T12:21:29.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139449 s, 75.2 MB/s 2024-09-12T12:21:29.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.107 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135529 s, 77.4 MB/s 2024-09-12T12:21:29.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.123 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141579 s, 74.1 MB/s 2024-09-12T12:21:29.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.140 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138002 s, 76.0 MB/s 2024-09-12T12:21:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134604 s, 77.9 MB/s 2024-09-12T12:21:29.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.171 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126167 s, 83.1 MB/s 2024-09-12T12:21:29.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126881 s, 82.6 MB/s 2024-09-12T12:21:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134694 s, 77.8 MB/s 2024-09-12T12:21:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141192 s, 74.3 MB/s 2024-09-12T12:21:29.236 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.236 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.236 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140837 s, 74.5 MB/s 2024-09-12T12:21:29.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.252 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134524 s, 77.9 MB/s 2024-09-12T12:21:29.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.271 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164888 s, 63.6 MB/s 2024-09-12T12:21:29.287 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.287 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.287 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130788 s, 80.2 MB/s 2024-09-12T12:21:29.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.306 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169169 s, 62.0 MB/s 2024-09-12T12:21:29.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.325 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132606 s, 79.1 MB/s 2024-09-12T12:21:29.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.338 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135263 s, 77.5 MB/s 2024-09-12T12:21:29.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.354 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125167 s, 83.8 MB/s 2024-09-12T12:21:29.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.370 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140748 s, 74.5 MB/s 2024-09-12T12:21:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158022 s, 66.4 MB/s 2024-09-12T12:21:29.406 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.406 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.406 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140786 s, 74.5 MB/s 2024-09-12T12:21:29.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:29.414 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:29.414 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:29.414 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.15 2024-09-12T12:21:29.414 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:29.415 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:29.415 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:29.415 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:29.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:29.481 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.481 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.481 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140301 s, 74.7 MB/s 2024-09-12T12:21:29.497 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.498 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013547 s, 77.4 MB/s 2024-09-12T12:21:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125164 s, 83.8 MB/s 2024-09-12T12:21:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154871 s, 67.7 MB/s 2024-09-12T12:21:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162052 s, 64.7 MB/s 2024-09-12T12:21:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142902 s, 73.4 MB/s 2024-09-12T12:21:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136003 s, 77.1 MB/s 2024-09-12T12:21:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165107 s, 63.5 MB/s 2024-09-12T12:21:29.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.620 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132152 s, 79.3 MB/s 2024-09-12T12:21:29.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.636 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132091 s, 79.4 MB/s 2024-09-12T12:21:29.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.652 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130794 s, 80.2 MB/s 2024-09-12T12:21:29.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.667 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123278 s, 85.1 MB/s 2024-09-12T12:21:29.682 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.682 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.683 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126144 s, 83.1 MB/s 2024-09-12T12:21:29.697 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.697 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.697 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117621 s, 89.1 MB/s 2024-09-12T12:21:29.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.712 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127713 s, 82.1 MB/s 2024-09-12T12:21:29.729 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.729 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.729 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142954 s, 73.4 MB/s 2024-09-12T12:21:29.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.744 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125881 s, 83.3 MB/s 2024-09-12T12:21:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125959 s, 83.2 MB/s 2024-09-12T12:21:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015277 s, 68.6 MB/s 2024-09-12T12:21:29.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129359 s, 81.1 MB/s 2024-09-12T12:21:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126455 s, 82.9 MB/s 2024-09-12T12:21:29.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.825 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139624 s, 75.1 MB/s 2024-09-12T12:21:29.841 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.841 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.841 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132888 s, 78.9 MB/s 2024-09-12T12:21:29.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.858 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141221 s, 74.3 MB/s 2024-09-12T12:21:29.873 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.873 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.873 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126371 s, 83.0 MB/s 2024-09-12T12:21:29.889 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.889 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.889 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130109 s, 80.6 MB/s 2024-09-12T12:21:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142868 s, 73.4 MB/s 2024-09-12T12:21:29.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.922 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135106 s, 77.6 MB/s 2024-09-12T12:21:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128211 s, 81.8 MB/s 2024-09-12T12:21:29.952 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127944 s, 82.0 MB/s 2024-09-12T12:21:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131529 s, 79.7 MB/s 2024-09-12T12:21:29.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:29.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:29.985 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140067 s, 74.9 MB/s 2024-09-12T12:21:29.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:29.993 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:29.993 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:29.993 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.16 2024-09-12T12:21:29.993 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:29.993 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:29.993 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:29.993 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:30.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:30.103 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.104 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.104 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135966 s, 77.1 MB/s 2024-09-12T12:21:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.120 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140622 s, 74.6 MB/s 2024-09-12T12:21:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.136 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128637 s, 81.5 MB/s 2024-09-12T12:21:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.151 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123944 s, 84.6 MB/s 2024-09-12T12:21:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143291 s, 73.2 MB/s 2024-09-12T12:21:30.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.183 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012707 s, 82.5 MB/s 2024-09-12T12:21:30.198 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.198 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.198 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125302 s, 83.7 MB/s 2024-09-12T12:21:30.215 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.215 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.215 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138514 s, 75.7 MB/s 2024-09-12T12:21:30.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.228 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104749 s, 100 MB/s 2024-09-12T12:21:30.243 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.244 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135031 s, 77.7 MB/s 2024-09-12T12:21:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126691 s, 82.8 MB/s 2024-09-12T12:21:30.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.274 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126882 s, 82.6 MB/s 2024-09-12T12:21:30.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.290 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125846 s, 83.3 MB/s 2024-09-12T12:21:30.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.305 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128561 s, 81.6 MB/s 2024-09-12T12:21:30.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.321 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135221 s, 77.5 MB/s 2024-09-12T12:21:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127867 s, 82.0 MB/s 2024-09-12T12:21:30.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.352 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127281 s, 82.4 MB/s 2024-09-12T12:21:30.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.368 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132816 s, 78.9 MB/s 2024-09-12T12:21:30.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.385 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144508 s, 72.6 MB/s 2024-09-12T12:21:30.401 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.402 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139659 s, 75.1 MB/s 2024-09-12T12:21:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129952 s, 80.7 MB/s 2024-09-12T12:21:30.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.433 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132208 s, 79.3 MB/s 2024-09-12T12:21:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129752 s, 80.8 MB/s 2024-09-12T12:21:30.464 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.465 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135753 s, 77.2 MB/s 2024-09-12T12:21:30.481 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.481 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.481 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143786 s, 72.9 MB/s 2024-09-12T12:21:30.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.498 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136451 s, 76.8 MB/s 2024-09-12T12:21:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.515 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142335 s, 73.7 MB/s 2024-09-12T12:21:30.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.532 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149223 s, 70.3 MB/s 2024-09-12T12:21:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.549 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141713 s, 74.0 MB/s 2024-09-12T12:21:30.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.565 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140088 s, 74.9 MB/s 2024-09-12T12:21:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137489 s, 76.3 MB/s 2024-09-12T12:21:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134094 s, 78.2 MB/s 2024-09-12T12:21:30.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:30.604 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:30.605 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:30.605 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.17 2024-09-12T12:21:30.605 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:30.605 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:30.605 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:30.605 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:30.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:30.671 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137743 s, 76.1 MB/s 2024-09-12T12:21:30.687 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.688 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138883 s, 75.5 MB/s 2024-09-12T12:21:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.704 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013329 s, 78.7 MB/s 2024-09-12T12:21:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149378 s, 70.2 MB/s 2024-09-12T12:21:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.740 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165187 s, 63.5 MB/s 2024-09-12T12:21:30.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.757 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144789 s, 72.4 MB/s 2024-09-12T12:21:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130709 s, 80.2 MB/s 2024-09-12T12:21:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126688 s, 82.8 MB/s 2024-09-12T12:21:30.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.805 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144637 s, 72.5 MB/s 2024-09-12T12:21:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170696 s, 61.4 MB/s 2024-09-12T12:21:30.841 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.841 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136645 s, 76.7 MB/s 2024-09-12T12:21:30.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.856 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122713 s, 85.4 MB/s 2024-09-12T12:21:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.871 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122432 s, 85.6 MB/s 2024-09-12T12:21:30.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.887 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134884 s, 77.7 MB/s 2024-09-12T12:21:30.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.903 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131549 s, 79.7 MB/s 2024-09-12T12:21:30.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.919 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.919 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131411 s, 79.8 MB/s 2024-09-12T12:21:30.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.936 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142141 s, 73.8 MB/s 2024-09-12T12:21:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.951 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128424 s, 81.6 MB/s 2024-09-12T12:21:30.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.969 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124448 s, 84.3 MB/s 2024-09-12T12:21:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.984 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145275 s, 72.2 MB/s 2024-09-12T12:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126162 s, 83.1 MB/s 2024-09-12T12:21:31.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.015 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132895 s, 78.9 MB/s 2024-09-12T12:21:31.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.029 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123371 s, 85.0 MB/s 2024-09-12T12:21:31.046 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.046 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.046 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141311 s, 74.2 MB/s 2024-09-12T12:21:31.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.060 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109033 s, 96.2 MB/s 2024-09-12T12:21:31.076 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.076 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.076 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139971 s, 74.9 MB/s 2024-09-12T12:21:31.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.093 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138972 s, 75.5 MB/s 2024-09-12T12:21:31.108 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137299 s, 76.4 MB/s 2024-09-12T12:21:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118028 s, 88.8 MB/s 2024-09-12T12:21:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.139 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132223 s, 79.3 MB/s 2024-09-12T12:21:31.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132313 s, 79.2 MB/s 2024-09-12T12:21:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133808 s, 78.4 MB/s 2024-09-12T12:21:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:31.178 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:31.178 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:31.178 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.18 2024-09-12T12:21:31.178 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:31.178 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:31.178 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:31.178 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:31.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.245 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.245 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133786 s, 78.4 MB/s 2024-09-12T12:21:31.263 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.263 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.263 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162968 s, 64.3 MB/s 2024-09-12T12:21:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136315 s, 76.9 MB/s 2024-09-12T12:21:31.294 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.295 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.295 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126848 s, 82.7 MB/s 2024-09-12T12:21:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.312 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143079 s, 73.3 MB/s 2024-09-12T12:21:31.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.328 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135866 s, 77.2 MB/s 2024-09-12T12:21:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.345 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136968 s, 76.6 MB/s 2024-09-12T12:21:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.360 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131946 s, 79.5 MB/s 2024-09-12T12:21:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133086 s, 78.8 MB/s 2024-09-12T12:21:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121607 s, 86.2 MB/s 2024-09-12T12:21:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171274 s, 61.2 MB/s 2024-09-12T12:21:31.426 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013081 s, 80.2 MB/s 2024-09-12T12:21:31.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.443 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138664 s, 75.6 MB/s 2024-09-12T12:21:31.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.459 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128663 s, 81.5 MB/s 2024-09-12T12:21:31.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.474 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126873 s, 82.6 MB/s 2024-09-12T12:21:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.493 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165431 s, 63.4 MB/s 2024-09-12T12:21:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.509 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132324 s, 79.2 MB/s 2024-09-12T12:21:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.525 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137156 s, 76.5 MB/s 2024-09-12T12:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149985 s, 69.9 MB/s 2024-09-12T12:21:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133583 s, 78.5 MB/s 2024-09-12T12:21:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.581 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165437 s, 63.4 MB/s 2024-09-12T12:21:31.593 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.594 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119381 s, 87.8 MB/s 2024-09-12T12:21:31.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.610 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134621 s, 77.9 MB/s 2024-09-12T12:21:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149895 s, 70.0 MB/s 2024-09-12T12:21:31.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.644 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123797 s, 84.7 MB/s 2024-09-12T12:21:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139434 s, 75.2 MB/s 2024-09-12T12:21:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.678 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.679 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148874 s, 70.4 MB/s 2024-09-12T12:21:31.695 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.695 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.695 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130813 s, 80.2 MB/s 2024-09-12T12:21:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140641 s, 74.6 MB/s 2024-09-12T12:21:31.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.728 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134878 s, 77.7 MB/s 2024-09-12T12:21:31.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.744 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131511 s, 79.7 MB/s 2024-09-12T12:21:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.760 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136364 s, 76.9 MB/s 2024-09-12T12:21:31.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:31.768 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:31.768 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:31.768 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.19 2024-09-12T12:21:31.768 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:31.768 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:31.768 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:31.768 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:31.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:31.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.879 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173353 s, 60.5 MB/s 2024-09-12T12:21:31.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.894 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118095 s, 88.8 MB/s 2024-09-12T12:21:31.909 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136288 s, 76.9 MB/s 2024-09-12T12:21:31.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.927 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151049 s, 69.4 MB/s 2024-09-12T12:21:31.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.944 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014237 s, 73.7 MB/s 2024-09-12T12:21:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.960 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135979 s, 77.1 MB/s 2024-09-12T12:21:31.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.977 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147498 s, 71.1 MB/s 2024-09-12T12:21:31.994 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:31.994 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:31.994 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140048 s, 74.9 MB/s 2024-09-12T12:21:32.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.013 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163873 s, 64.0 MB/s 2024-09-12T12:21:32.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.030 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139031 s, 75.4 MB/s 2024-09-12T12:21:32.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167228 s, 62.7 MB/s 2024-09-12T12:21:32.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.065 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138943 s, 75.5 MB/s 2024-09-12T12:21:32.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.082 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143043 s, 73.3 MB/s 2024-09-12T12:21:32.101 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.101 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.101 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162297 s, 64.6 MB/s 2024-09-12T12:21:32.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.116 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122922 s, 85.3 MB/s 2024-09-12T12:21:32.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.132 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.132 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128535 s, 81.6 MB/s 2024-09-12T12:21:32.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.148 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138682 s, 75.6 MB/s 2024-09-12T12:21:32.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.165 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142663 s, 73.5 MB/s 2024-09-12T12:21:32.180 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.181 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.181 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131602 s, 79.7 MB/s 2024-09-12T12:21:32.196 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.197 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132674 s, 79.0 MB/s 2024-09-12T12:21:32.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.213 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141002 s, 74.4 MB/s 2024-09-12T12:21:32.230 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.230 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.230 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144165 s, 72.7 MB/s 2024-09-12T12:21:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.246 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131561 s, 79.7 MB/s 2024-09-12T12:21:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131098 s, 80.0 MB/s 2024-09-12T12:21:32.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.279 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143399 s, 73.1 MB/s 2024-09-12T12:21:32.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.294 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.294 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123247 s, 85.1 MB/s 2024-09-12T12:21:32.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.310 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133745 s, 78.4 MB/s 2024-09-12T12:21:32.329 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.329 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.329 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166769 s, 62.9 MB/s 2024-09-12T12:21:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013072 s, 80.2 MB/s 2024-09-12T12:21:32.359 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.359 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.359 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123401 s, 85.0 MB/s 2024-09-12T12:21:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131921 s, 79.5 MB/s 2024-09-12T12:21:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166568 s, 63.0 MB/s 2024-09-12T12:21:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:32.402 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:32.402 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:32.402 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.20 2024-09-12T12:21:32.402 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:32.402 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:32.402 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:32.402 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:32.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:32.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.468 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127167 s, 82.5 MB/s 2024-09-12T12:21:32.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.487 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168753 s, 62.1 MB/s 2024-09-12T12:21:32.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.503 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135065 s, 77.6 MB/s 2024-09-12T12:21:32.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.520 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142476 s, 73.6 MB/s 2024-09-12T12:21:32.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.536 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126416 s, 82.9 MB/s 2024-09-12T12:21:32.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.551 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132026 s, 79.4 MB/s 2024-09-12T12:21:32.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.568 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139842 s, 75.0 MB/s 2024-09-12T12:21:32.583 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.584 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133581 s, 78.5 MB/s 2024-09-12T12:21:32.600 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.601 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135972 s, 77.1 MB/s 2024-09-12T12:21:32.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.616 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139132 s, 75.4 MB/s 2024-09-12T12:21:32.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.633 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138027 s, 76.0 MB/s 2024-09-12T12:21:32.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.650 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143311 s, 73.2 MB/s 2024-09-12T12:21:32.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.666 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133057 s, 78.8 MB/s 2024-09-12T12:21:32.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.683 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147102 s, 71.3 MB/s 2024-09-12T12:21:32.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.699 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137334 s, 76.4 MB/s 2024-09-12T12:21:32.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.716 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144352 s, 72.6 MB/s 2024-09-12T12:21:32.733 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.733 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.733 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144564 s, 72.5 MB/s 2024-09-12T12:21:32.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.749 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132651 s, 79.0 MB/s 2024-09-12T12:21:32.765 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.766 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137589 s, 76.2 MB/s 2024-09-12T12:21:32.783 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.783 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.783 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147154 s, 71.3 MB/s 2024-09-12T12:21:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136108 s, 77.0 MB/s 2024-09-12T12:21:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.816 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134281 s, 78.1 MB/s 2024-09-12T12:21:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.831 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133673 s, 78.4 MB/s 2024-09-12T12:21:32.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.847 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129064 s, 81.2 MB/s 2024-09-12T12:21:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012573 s, 83.4 MB/s 2024-09-12T12:21:32.878 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.878 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.878 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135791 s, 77.2 MB/s 2024-09-12T12:21:32.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.896 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144342 s, 72.6 MB/s 2024-09-12T12:21:32.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.911 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013164 s, 79.7 MB/s 2024-09-12T12:21:32.928 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.928 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.928 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142278 s, 73.7 MB/s 2024-09-12T12:21:32.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.946 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139285 s, 75.3 MB/s 2024-09-12T12:21:32.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.962 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014638 s, 71.6 MB/s 2024-09-12T12:21:32.979 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:32.979 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:32.979 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143904 s, 72.9 MB/s 2024-09-12T12:21:32.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:32.988 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:32.988 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:32.989 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.21 2024-09-12T12:21:32.989 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:32.989 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:32.989 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:32.989 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:33.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:33.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.130 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.130 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135848 s, 77.2 MB/s 2024-09-12T12:21:33.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.146 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129621 s, 80.9 MB/s 2024-09-12T12:21:33.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.161 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139247 s, 75.3 MB/s 2024-09-12T12:21:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.178 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014006 s, 74.9 MB/s 2024-09-12T12:21:33.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.197 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016051 s, 65.3 MB/s 2024-09-12T12:21:33.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.213 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131465 s, 79.8 MB/s 2024-09-12T12:21:33.230 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.230 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.230 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143443 s, 73.1 MB/s 2024-09-12T12:21:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.246 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133752 s, 78.4 MB/s 2024-09-12T12:21:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160214 s, 65.4 MB/s 2024-09-12T12:21:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137098 s, 76.5 MB/s 2024-09-12T12:21:33.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.302 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167372 s, 62.6 MB/s 2024-09-12T12:21:33.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.317 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131649 s, 79.6 MB/s 2024-09-12T12:21:33.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.333 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013186 s, 79.5 MB/s 2024-09-12T12:21:33.350 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.350 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.350 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135273 s, 77.5 MB/s 2024-09-12T12:21:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.366 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129867 s, 80.7 MB/s 2024-09-12T12:21:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.382 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143472 s, 73.1 MB/s 2024-09-12T12:21:33.398 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.398 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.398 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133176 s, 78.7 MB/s 2024-09-12T12:21:33.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.414 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124905 s, 84.0 MB/s 2024-09-12T12:21:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132644 s, 79.1 MB/s 2024-09-12T12:21:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.449 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161863 s, 64.8 MB/s 2024-09-12T12:21:33.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.468 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163242 s, 64.2 MB/s 2024-09-12T12:21:33.485 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.485 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.485 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014133 s, 74.2 MB/s 2024-09-12T12:21:33.502 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.502 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.502 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013926 s, 75.3 MB/s 2024-09-12T12:21:33.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.522 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172807 s, 60.7 MB/s 2024-09-12T12:21:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164713 s, 63.7 MB/s 2024-09-12T12:21:33.566 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.566 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.567 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223328 s, 47.0 MB/s 2024-09-12T12:21:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.591 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.591 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211935 s, 49.5 MB/s 2024-09-12T12:21:33.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.607 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139051 s, 75.4 MB/s 2024-09-12T12:21:33.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.622 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127645 s, 82.1 MB/s 2024-09-12T12:21:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151063 s, 69.4 MB/s 2024-09-12T12:21:33.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.657 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144459 s, 72.6 MB/s 2024-09-12T12:21:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129152 s, 81.2 MB/s 2024-09-12T12:21:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:33.680 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:33.680 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:33.681 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.22 2024-09-12T12:21:33.681 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:33.681 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:33.681 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:33.681 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:33.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135494 s, 77.4 MB/s 2024-09-12T12:21:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.806 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146832 s, 71.4 MB/s 2024-09-12T12:21:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127783 s, 82.1 MB/s 2024-09-12T12:21:33.838 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.838 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.838 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014397 s, 72.8 MB/s 2024-09-12T12:21:33.855 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.855 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.855 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144591 s, 72.5 MB/s 2024-09-12T12:21:33.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.872 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141065 s, 74.3 MB/s 2024-09-12T12:21:33.889 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.890 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152022 s, 69.0 MB/s 2024-09-12T12:21:33.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.906 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014165 s, 74.0 MB/s 2024-09-12T12:21:33.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.925 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159554 s, 65.7 MB/s 2024-09-12T12:21:33.940 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.940 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.940 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125818 s, 83.3 MB/s 2024-09-12T12:21:33.956 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.956 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.956 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136587 s, 76.8 MB/s 2024-09-12T12:21:33.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.971 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124692 s, 84.1 MB/s 2024-09-12T12:21:33.988 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:33.988 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:33.988 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136305 s, 76.9 MB/s 2024-09-12T12:21:34.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.005 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146912 s, 71.4 MB/s 2024-09-12T12:21:34.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.024 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166738 s, 62.9 MB/s 2024-09-12T12:21:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133022 s, 78.8 MB/s 2024-09-12T12:21:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.057 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139476 s, 75.2 MB/s 2024-09-12T12:21:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132796 s, 79.0 MB/s 2024-09-12T12:21:34.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139047 s, 75.4 MB/s 2024-09-12T12:21:34.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.106 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132014 s, 79.4 MB/s 2024-09-12T12:21:34.120 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.121 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012436 s, 84.3 MB/s 2024-09-12T12:21:34.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.137 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136988 s, 76.5 MB/s 2024-09-12T12:21:34.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.153 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132458 s, 79.2 MB/s 2024-09-12T12:21:34.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.170 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138023 s, 76.0 MB/s 2024-09-12T12:21:34.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.184 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121851 s, 86.1 MB/s 2024-09-12T12:21:34.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.201 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143701 s, 73.0 MB/s 2024-09-12T12:21:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.220 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163073 s, 64.3 MB/s 2024-09-12T12:21:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.237 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140199 s, 74.8 MB/s 2024-09-12T12:21:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.253 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132615 s, 79.1 MB/s 2024-09-12T12:21:34.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.268 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126541 s, 82.9 MB/s 2024-09-12T12:21:34.283 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129912 s, 80.7 MB/s 2024-09-12T12:21:34.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142562 s, 73.6 MB/s 2024-09-12T12:21:34.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:34.308 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:34.308 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:34.308 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.23 2024-09-12T12:21:34.308 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:34.308 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:34.308 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:34.308 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:34.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:34.374 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.374 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.374 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134202 s, 78.1 MB/s 2024-09-12T12:21:34.391 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.391 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.391 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141744 s, 74.0 MB/s 2024-09-12T12:21:34.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167339 s, 62.7 MB/s 2024-09-12T12:21:34.425 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.425 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.426 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124952 s, 83.9 MB/s 2024-09-12T12:21:34.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.442 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134663 s, 77.9 MB/s 2024-09-12T12:21:34.457 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.457 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.457 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134311 s, 78.1 MB/s 2024-09-12T12:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.474 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133039 s, 78.8 MB/s 2024-09-12T12:21:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140198 s, 74.8 MB/s 2024-09-12T12:21:34.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.507 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139751 s, 75.0 MB/s 2024-09-12T12:21:34.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.521 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120224 s, 87.2 MB/s 2024-09-12T12:21:34.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.538 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141973 s, 73.9 MB/s 2024-09-12T12:21:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.556 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149707 s, 70.0 MB/s 2024-09-12T12:21:34.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.572 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138132 s, 75.9 MB/s 2024-09-12T12:21:34.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.588 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138992 s, 75.4 MB/s 2024-09-12T12:21:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144604 s, 72.5 MB/s 2024-09-12T12:21:34.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.621 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013336 s, 78.6 MB/s 2024-09-12T12:21:34.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126538 s, 82.9 MB/s 2024-09-12T12:21:34.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.653 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127082 s, 82.5 MB/s 2024-09-12T12:21:34.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.672 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170025 s, 61.7 MB/s 2024-09-12T12:21:34.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.689 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140861 s, 74.4 MB/s 2024-09-12T12:21:34.703 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.703 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.703 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122403 s, 85.7 MB/s 2024-09-12T12:21:34.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.720 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.720 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137997 s, 76.0 MB/s 2024-09-12T12:21:34.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.736 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140409 s, 74.7 MB/s 2024-09-12T12:21:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136428 s, 76.9 MB/s 2024-09-12T12:21:34.769 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.770 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130893 s, 80.1 MB/s 2024-09-12T12:21:34.784 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.784 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.784 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139054 s, 75.4 MB/s 2024-09-12T12:21:34.800 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.801 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013908 s, 75.4 MB/s 2024-09-12T12:21:34.816 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.816 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.817 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132853 s, 78.9 MB/s 2024-09-12T12:21:34.832 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.832 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.832 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130195 s, 80.5 MB/s 2024-09-12T12:21:34.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.847 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124943 s, 83.9 MB/s 2024-09-12T12:21:34.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.863 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126749 s, 82.7 MB/s 2024-09-12T12:21:34.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.879 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141616 s, 74.0 MB/s 2024-09-12T12:21:34.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:34.887 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:34.887 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:34.887 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.24 2024-09-12T12:21:34.887 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:34.887 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:34.887 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:34.888 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.954 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138086 s, 75.9 MB/s 2024-09-12T12:21:34.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.970 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.970 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134853 s, 77.8 MB/s 2024-09-12T12:21:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131227 s, 79.9 MB/s 2024-09-12T12:21:35.000 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125374 s, 83.6 MB/s 2024-09-12T12:21:35.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.017 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139562 s, 75.1 MB/s 2024-09-12T12:21:35.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.034 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139542 s, 75.1 MB/s 2024-09-12T12:21:35.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.050 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139044 s, 75.4 MB/s 2024-09-12T12:21:35.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.066 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128793 s, 81.4 MB/s 2024-09-12T12:21:35.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.082 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135446 s, 77.4 MB/s 2024-09-12T12:21:35.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.098 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134928 s, 77.7 MB/s 2024-09-12T12:21:35.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.113 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122417 s, 85.7 MB/s 2024-09-12T12:21:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157334 s, 66.6 MB/s 2024-09-12T12:21:35.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.148 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146331 s, 71.7 MB/s 2024-09-12T12:21:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138699 s, 75.6 MB/s 2024-09-12T12:21:35.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.184 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166754 s, 62.9 MB/s 2024-09-12T12:21:35.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.200 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128767 s, 81.4 MB/s 2024-09-12T12:21:35.216 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.216 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.216 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014317 s, 73.2 MB/s 2024-09-12T12:21:35.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.233 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141367 s, 74.2 MB/s 2024-09-12T12:21:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164352 s, 63.8 MB/s 2024-09-12T12:21:35.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.267 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125879 s, 83.3 MB/s 2024-09-12T12:21:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.283 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136374 s, 76.9 MB/s 2024-09-12T12:21:35.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013243 s, 79.2 MB/s 2024-09-12T12:21:35.314 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.315 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128786 s, 81.4 MB/s 2024-09-12T12:21:35.331 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.332 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142091 s, 73.8 MB/s 2024-09-12T12:21:35.347 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.347 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.347 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128831 s, 81.4 MB/s 2024-09-12T12:21:35.363 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.363 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.363 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133541 s, 78.5 MB/s 2024-09-12T12:21:35.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.380 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142512 s, 73.6 MB/s 2024-09-12T12:21:35.396 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.396 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.396 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133329 s, 78.6 MB/s 2024-09-12T12:21:35.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125812 s, 83.3 MB/s 2024-09-12T12:21:35.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.430 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169757 s, 61.8 MB/s 2024-09-12T12:21:35.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.447 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142679 s, 73.5 MB/s 2024-09-12T12:21:35.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.467 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165547 s, 63.3 MB/s 2024-09-12T12:21:35.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:35.474 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:35.474 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:35.474 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.25 2024-09-12T12:21:35.474 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:35.474 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:35.474 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:35.474 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:35.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.588 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165083 s, 63.5 MB/s 2024-09-12T12:21:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148669 s, 70.5 MB/s 2024-09-12T12:21:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.622 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133506 s, 78.5 MB/s 2024-09-12T12:21:35.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130182 s, 80.5 MB/s 2024-09-12T12:21:35.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.652 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124448 s, 84.3 MB/s 2024-09-12T12:21:35.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.673 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171997 s, 61.0 MB/s 2024-09-12T12:21:35.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.688 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130333 s, 80.5 MB/s 2024-09-12T12:21:35.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.705 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.705 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135636 s, 77.3 MB/s 2024-09-12T12:21:35.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.722 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141965 s, 73.9 MB/s 2024-09-12T12:21:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.739 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152674 s, 68.7 MB/s 2024-09-12T12:21:35.756 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.756 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.756 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138443 s, 75.7 MB/s 2024-09-12T12:21:35.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.770 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120785 s, 86.8 MB/s 2024-09-12T12:21:35.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.785 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122255 s, 85.8 MB/s 2024-09-12T12:21:35.806 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.806 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.806 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179515 s, 58.4 MB/s 2024-09-12T12:21:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144416 s, 72.6 MB/s 2024-09-12T12:21:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139664 s, 75.1 MB/s 2024-09-12T12:21:35.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.856 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143904 s, 72.9 MB/s 2024-09-12T12:21:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151032 s, 69.4 MB/s 2024-09-12T12:21:35.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.890 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136873 s, 76.6 MB/s 2024-09-12T12:21:35.905 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.905 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.905 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126523 s, 82.9 MB/s 2024-09-12T12:21:35.921 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.922 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013789 s, 76.0 MB/s 2024-09-12T12:21:35.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.937 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013137 s, 79.8 MB/s 2024-09-12T12:21:35.952 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.953 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127399 s, 82.3 MB/s 2024-09-12T12:21:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161746 s, 64.8 MB/s 2024-09-12T12:21:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:35.988 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139382 s, 75.2 MB/s 2024-09-12T12:21:36.004 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.004 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.004 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137216 s, 76.4 MB/s 2024-09-12T12:21:36.020 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.020 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.021 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139758 s, 75.0 MB/s 2024-09-12T12:21:36.036 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.036 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.036 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133223 s, 78.7 MB/s 2024-09-12T12:21:36.053 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.053 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.053 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140821 s, 74.5 MB/s 2024-09-12T12:21:36.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.073 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.073 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169871 s, 61.7 MB/s 2024-09-12T12:21:36.089 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.089 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.089 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141006 s, 74.4 MB/s 2024-09-12T12:21:36.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.106 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143364 s, 73.1 MB/s 2024-09-12T12:21:36.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:36.113 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:36.113 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:36.113 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.26 2024-09-12T12:21:36.114 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:36.114 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:36.114 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:36.114 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:36.181 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.181 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.181 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146893 s, 71.4 MB/s 2024-09-12T12:21:36.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.197 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013448 s, 78.0 MB/s 2024-09-12T12:21:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130806 s, 80.2 MB/s 2024-09-12T12:21:36.229 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.229 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.229 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132564 s, 79.1 MB/s 2024-09-12T12:21:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169138 s, 62.0 MB/s 2024-09-12T12:21:36.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.265 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140498 s, 74.6 MB/s 2024-09-12T12:21:36.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.282 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110787 s, 94.6 MB/s 2024-09-12T12:21:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.293 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125726 s, 83.4 MB/s 2024-09-12T12:21:36.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.309 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131635 s, 79.7 MB/s 2024-09-12T12:21:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.325 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131916 s, 79.5 MB/s 2024-09-12T12:21:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.346 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172979 s, 60.6 MB/s 2024-09-12T12:21:36.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.363 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.363 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014499 s, 72.3 MB/s 2024-09-12T12:21:36.379 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.380 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014592 s, 71.9 MB/s 2024-09-12T12:21:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.396 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134102 s, 78.2 MB/s 2024-09-12T12:21:36.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122554 s, 85.6 MB/s 2024-09-12T12:21:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141192 s, 74.3 MB/s 2024-09-12T12:21:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159637 s, 65.7 MB/s 2024-09-12T12:21:36.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.462 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141134 s, 74.3 MB/s 2024-09-12T12:21:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.479 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140698 s, 74.5 MB/s 2024-09-12T12:21:36.494 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.494 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.494 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123641 s, 84.8 MB/s 2024-09-12T12:21:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.511 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140977 s, 74.4 MB/s 2024-09-12T12:21:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.527 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136554 s, 76.8 MB/s 2024-09-12T12:21:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.543 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014034 s, 74.7 MB/s 2024-09-12T12:21:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013139 s, 79.8 MB/s 2024-09-12T12:21:36.574 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.574 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.575 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129266 s, 81.1 MB/s 2024-09-12T12:21:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012944 s, 81.0 MB/s 2024-09-12T12:21:36.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.607 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132796 s, 79.0 MB/s 2024-09-12T12:21:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141156 s, 74.3 MB/s 2024-09-12T12:21:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.639 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133363 s, 78.6 MB/s 2024-09-12T12:21:36.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.657 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146739 s, 71.5 MB/s 2024-09-12T12:21:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.673 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133563 s, 78.5 MB/s 2024-09-12T12:21:36.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.689 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01283 s, 81.7 MB/s 2024-09-12T12:21:36.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:36.696 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:36.696 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:36.696 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.27 2024-09-12T12:21:36.696 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:36.696 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:36.696 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:36.696 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:36.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118972 s, 88.1 MB/s 2024-09-12T12:21:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.781 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175498 s, 59.7 MB/s 2024-09-12T12:21:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.797 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134833 s, 77.8 MB/s 2024-09-12T12:21:36.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.817 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170957 s, 61.3 MB/s 2024-09-12T12:21:36.833 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.833 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.833 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141298 s, 74.2 MB/s 2024-09-12T12:21:36.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.848 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125691 s, 83.4 MB/s 2024-09-12T12:21:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140745 s, 74.5 MB/s 2024-09-12T12:21:36.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.881 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134514 s, 78.0 MB/s 2024-09-12T12:21:36.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.897 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132417 s, 79.2 MB/s 2024-09-12T12:21:36.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.914 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136494 s, 76.8 MB/s 2024-09-12T12:21:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.929 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131892 s, 79.5 MB/s 2024-09-12T12:21:36.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.945 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131011 s, 80.0 MB/s 2024-09-12T12:21:36.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.961 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136502 s, 76.8 MB/s 2024-09-12T12:21:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.975 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117451 s, 89.3 MB/s 2024-09-12T12:21:36.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:36.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:36.992 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014105 s, 74.3 MB/s 2024-09-12T12:21:37.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.009 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013725 s, 76.4 MB/s 2024-09-12T12:21:37.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013169 s, 79.6 MB/s 2024-09-12T12:21:37.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.041 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142379 s, 73.6 MB/s 2024-09-12T12:21:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162153 s, 64.7 MB/s 2024-09-12T12:21:37.075 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.075 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.075 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126715 s, 82.8 MB/s 2024-09-12T12:21:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.093 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138704 s, 75.6 MB/s 2024-09-12T12:21:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.108 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130139 s, 80.6 MB/s 2024-09-12T12:21:37.124 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.124 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.124 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140242 s, 74.8 MB/s 2024-09-12T12:21:37.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.140 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138368 s, 75.8 MB/s 2024-09-12T12:21:37.157 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.157 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.157 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142725 s, 73.5 MB/s 2024-09-12T12:21:37.175 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.176 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159195 s, 65.9 MB/s 2024-09-12T12:21:37.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.195 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167186 s, 62.7 MB/s 2024-09-12T12:21:37.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.211 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129312 s, 81.1 MB/s 2024-09-12T12:21:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.230 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167792 s, 62.5 MB/s 2024-09-12T12:21:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169585 s, 61.8 MB/s 2024-09-12T12:21:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.267 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147015 s, 71.3 MB/s 2024-09-12T12:21:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145774 s, 71.9 MB/s 2024-09-12T12:21:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:37.292 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:37.292 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:37.292 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.28 2024-09-12T12:21:37.292 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:37.293 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:37.293 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:37.293 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:37.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.360 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142348 s, 73.7 MB/s 2024-09-12T12:21:37.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.376 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130859 s, 80.1 MB/s 2024-09-12T12:21:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.395 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158396 s, 66.2 MB/s 2024-09-12T12:21:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137153 s, 76.5 MB/s 2024-09-12T12:21:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125941 s, 83.3 MB/s 2024-09-12T12:21:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167088 s, 62.8 MB/s 2024-09-12T12:21:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136762 s, 76.7 MB/s 2024-09-12T12:21:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138777 s, 75.6 MB/s 2024-09-12T12:21:37.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.495 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137827 s, 76.1 MB/s 2024-09-12T12:21:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175931 s, 59.6 MB/s 2024-09-12T12:21:37.530 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.531 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130363 s, 80.4 MB/s 2024-09-12T12:21:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139703 s, 75.1 MB/s 2024-09-12T12:21:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015023 s, 69.8 MB/s 2024-09-12T12:21:37.582 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.582 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.582 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144667 s, 72.5 MB/s 2024-09-12T12:21:37.598 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.599 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139397 s, 75.2 MB/s 2024-09-12T12:21:37.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.617 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.617 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158505 s, 66.2 MB/s 2024-09-12T12:21:37.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.633 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133666 s, 78.4 MB/s 2024-09-12T12:21:37.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.649 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131552 s, 79.7 MB/s 2024-09-12T12:21:37.666 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.666 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.666 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147341 s, 71.2 MB/s 2024-09-12T12:21:37.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.683 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014256 s, 73.6 MB/s 2024-09-12T12:21:37.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.701 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145332 s, 72.2 MB/s 2024-09-12T12:21:37.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.717 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139941 s, 74.9 MB/s 2024-09-12T12:21:37.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.734 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142221 s, 73.7 MB/s 2024-09-12T12:21:37.751 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.752 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155517 s, 67.4 MB/s 2024-09-12T12:21:37.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.768 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139809 s, 75.0 MB/s 2024-09-12T12:21:37.783 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.784 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.784 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012682 s, 82.7 MB/s 2024-09-12T12:21:37.800 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.800 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.800 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139113 s, 75.4 MB/s 2024-09-12T12:21:37.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.817 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142026 s, 73.8 MB/s 2024-09-12T12:21:37.833 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.833 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.833 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133554 s, 78.5 MB/s 2024-09-12T12:21:37.849 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.849 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.849 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139649 s, 75.1 MB/s 2024-09-12T12:21:37.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.867 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141721 s, 74.0 MB/s 2024-09-12T12:21:37.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.883 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139453 s, 75.2 MB/s 2024-09-12T12:21:37.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:37.891 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:37.891 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:37.891 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.29 2024-09-12T12:21:37.891 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:37.891 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:37.891 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:37.891 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:37.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:37.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.960 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142191 s, 73.7 MB/s 2024-09-12T12:21:37.975 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.975 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.976 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131064 s, 80.0 MB/s 2024-09-12T12:21:37.991 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:37.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:37.992 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135402 s, 77.4 MB/s 2024-09-12T12:21:38.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.008 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134509 s, 78.0 MB/s 2024-09-12T12:21:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165757 s, 63.3 MB/s 2024-09-12T12:21:38.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.043 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134954 s, 77.7 MB/s 2024-09-12T12:21:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130803 s, 80.2 MB/s 2024-09-12T12:21:38.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167661 s, 62.5 MB/s 2024-09-12T12:21:38.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.096 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145065 s, 72.3 MB/s 2024-09-12T12:21:38.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.112 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014013 s, 74.8 MB/s 2024-09-12T12:21:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160954 s, 65.1 MB/s 2024-09-12T12:21:38.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.148 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144448 s, 72.6 MB/s 2024-09-12T12:21:38.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.164 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131571 s, 79.7 MB/s 2024-09-12T12:21:38.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.179 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128918 s, 81.3 MB/s 2024-09-12T12:21:38.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.195 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134229 s, 78.1 MB/s 2024-09-12T12:21:38.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.212 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140222 s, 74.8 MB/s 2024-09-12T12:21:38.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.227 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129018 s, 81.3 MB/s 2024-09-12T12:21:38.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01266 s, 82.8 MB/s 2024-09-12T12:21:38.258 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.258 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.258 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129853 s, 80.8 MB/s 2024-09-12T12:21:38.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.275 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143235 s, 73.2 MB/s 2024-09-12T12:21:38.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.291 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129356 s, 81.1 MB/s 2024-09-12T12:21:38.307 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.307 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.307 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141777 s, 74.0 MB/s 2024-09-12T12:21:38.323 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.324 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137209 s, 76.4 MB/s 2024-09-12T12:21:38.343 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.343 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.343 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166995 s, 62.8 MB/s 2024-09-12T12:21:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.361 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.361 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150618 s, 69.6 MB/s 2024-09-12T12:21:38.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.380 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170751 s, 61.4 MB/s 2024-09-12T12:21:38.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.397 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.397 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142717 s, 73.5 MB/s 2024-09-12T12:21:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132746 s, 79.0 MB/s 2024-09-12T12:21:38.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.430 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138192 s, 75.9 MB/s 2024-09-12T12:21:38.445 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.445 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.445 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129612 s, 80.9 MB/s 2024-09-12T12:21:38.465 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.465 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.465 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164508 s, 63.7 MB/s 2024-09-12T12:21:38.481 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.481 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.481 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139275 s, 75.3 MB/s 2024-09-12T12:21:38.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:38.488 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:38.489 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:38.489 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.30 2024-09-12T12:21:38.489 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:38.489 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:38.489 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:38.489 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:38.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:38.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.599 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134599 s, 77.9 MB/s 2024-09-12T12:21:38.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.616 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141651 s, 74.0 MB/s 2024-09-12T12:21:38.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.633 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.633 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014511 s, 72.3 MB/s 2024-09-12T12:21:38.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.649 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.649 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139129 s, 75.4 MB/s 2024-09-12T12:21:38.666 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.667 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014898 s, 70.4 MB/s 2024-09-12T12:21:38.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.684 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146779 s, 71.4 MB/s 2024-09-12T12:21:38.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.700 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137062 s, 76.5 MB/s 2024-09-12T12:21:38.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.716 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130088 s, 80.6 MB/s 2024-09-12T12:21:38.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.732 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130575 s, 80.3 MB/s 2024-09-12T12:21:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014211 s, 73.8 MB/s 2024-09-12T12:21:38.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.765 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135882 s, 77.2 MB/s 2024-09-12T12:21:38.779 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.779 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.779 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127022 s, 82.6 MB/s 2024-09-12T12:21:38.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.795 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131143 s, 80.0 MB/s 2024-09-12T12:21:38.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.811 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131597 s, 79.7 MB/s 2024-09-12T12:21:38.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.828 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139351 s, 75.2 MB/s 2024-09-12T12:21:38.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.842 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125146 s, 83.8 MB/s 2024-09-12T12:21:38.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.858 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128472 s, 81.6 MB/s 2024-09-12T12:21:38.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.874 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137283 s, 76.4 MB/s 2024-09-12T12:21:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.891 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141604 s, 74.0 MB/s 2024-09-12T12:21:38.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.907 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133854 s, 78.3 MB/s 2024-09-12T12:21:38.923 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.923 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.923 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135717 s, 77.3 MB/s 2024-09-12T12:21:38.939 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.940 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.940 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140547 s, 74.6 MB/s 2024-09-12T12:21:38.956 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.956 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.956 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134363 s, 78.0 MB/s 2024-09-12T12:21:38.972 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.972 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.972 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137564 s, 76.2 MB/s 2024-09-12T12:21:38.991 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:38.991 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:38.992 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016484 s, 63.6 MB/s 2024-09-12T12:21:39.007 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.007 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.007 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131319 s, 79.8 MB/s 2024-09-12T12:21:39.026 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.026 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.026 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163863 s, 64.0 MB/s 2024-09-12T12:21:39.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.043 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139987 s, 74.9 MB/s 2024-09-12T12:21:39.059 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.059 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.060 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143614 s, 73.0 MB/s 2024-09-12T12:21:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015952 s, 65.7 MB/s 2024-09-12T12:21:39.093 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.093 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.093 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128223 s, 81.8 MB/s 2024-09-12T12:21:39.110 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.110 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.110 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139993 s, 74.9 MB/s 2024-09-12T12:21:39.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:39.117 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:21:39.117 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:21:39.117 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.31 2024-09-12T12:21:39.117 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:21:39.118 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:21:39.118 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:21:39.118 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:21:39.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:21:39.223 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.223 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.223 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133648 s, 78.5 MB/s 2024-09-12T12:21:39.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.242 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165161 s, 63.5 MB/s 2024-09-12T12:21:39.261 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.261 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.261 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165125 s, 63.5 MB/s 2024-09-12T12:21:39.277 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.277 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.277 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135187 s, 77.6 MB/s 2024-09-12T12:21:39.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.293 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133902 s, 78.3 MB/s 2024-09-12T12:21:39.310 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.310 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.310 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014165 s, 74.0 MB/s 2024-09-12T12:21:39.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.329 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.329 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158679 s, 66.1 MB/s 2024-09-12T12:21:39.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.345 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138447 s, 75.7 MB/s 2024-09-12T12:21:39.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.362 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138717 s, 75.6 MB/s 2024-09-12T12:21:39.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.377 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132935 s, 78.9 MB/s 2024-09-12T12:21:39.393 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.394 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137263 s, 76.4 MB/s 2024-09-12T12:21:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143462 s, 73.1 MB/s 2024-09-12T12:21:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132504 s, 79.1 MB/s 2024-09-12T12:21:39.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.443 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142456 s, 73.6 MB/s 2024-09-12T12:21:39.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.459 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127874 s, 82.0 MB/s 2024-09-12T12:21:39.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.475 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135519 s, 77.4 MB/s 2024-09-12T12:21:39.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.491 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136512 s, 76.8 MB/s 2024-09-12T12:21:39.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.508 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144912 s, 72.4 MB/s 2024-09-12T12:21:39.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.525 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137896 s, 76.0 MB/s 2024-09-12T12:21:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152141 s, 68.9 MB/s 2024-09-12T12:21:39.560 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.560 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.560 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145923 s, 71.9 MB/s 2024-09-12T12:21:39.579 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.579 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.579 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164208 s, 63.9 MB/s 2024-09-12T12:21:39.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.595 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135565 s, 77.3 MB/s 2024-09-12T12:21:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.613 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143947 s, 72.8 MB/s 2024-09-12T12:21:39.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.628 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131868 s, 79.5 MB/s 2024-09-12T12:21:39.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.644 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013478 s, 77.8 MB/s 2024-09-12T12:21:39.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.660 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134413 s, 78.0 MB/s 2024-09-12T12:21:39.676 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.676 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.676 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132597 s, 79.1 MB/s 2024-09-12T12:21:39.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.696 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169227 s, 62.0 MB/s 2024-09-12T12:21:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136636 s, 76.7 MB/s 2024-09-12T12:21:39.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.728 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132393 s, 79.2 MB/s 2024-09-12T12:21:39.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139467 s, 75.2 MB/s 2024-09-12T12:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:21:39.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:39.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-09-12T12:21:39.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.891+0000 7f2062800640 1 Processor -- start 2024-09-12T12:21:39.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.891+0000 7f2062800640 1 -- start start 2024-09-12T12:21:39.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f2062800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f205c06d250 0x7f205c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f2062800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205c06cd20 con 0x7f205c06d630 2024-09-12T12:21:39.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f2062800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205c15cc80 con 0x7f205c0b3490 2024-09-12T12:21:39.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f2062800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f205c072620 con 0x7f205c06d250 2024-09-12T12:21:39.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f205b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f205c06d250 0x7f205c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f205b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f205c06d250 0x7f205c15c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35480/0 (socket says 172.21.15.144:35480) 2024-09-12T12:21:39.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f205b400640 1 -- 172.21.15.144:0/2839087227 learned_addr learned my addr 172.21.15.144:0/2839087227 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:39.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f205be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f205c06d630 0x7f205c155820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40602/0 (socket says 172.21.15.144:40602) 2024-09-12T12:21:39.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f205b400640 1 -- 172.21.15.144:0/2839087227 >> v1:172.21.15.165:6789/0 conn(0x7f205c0b3490 legacy=0x7f205c0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f205b400640 1 -- 172.21.15.144:0/2839087227 >> v1:172.21.15.144:6789/0 conn(0x7f205c06d630 legacy=0x7f205c155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f205b400640 1 -- 172.21.15.144:0/2839087227 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c0b3950 con 0x7f205c06d250 2024-09-12T12:21:39.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.895+0000 7f205aa00640 1 -- 172.21.15.144:0/2839087227 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874130153 0 0) 0x7f205c06cd20 con 0x7f205c06d630 2024-09-12T12:21:39.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f205b400640 1 --2- 172.21.15.144:0/2839087227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d250 0x7f205c15c740 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f204c0098a0 tx=0x7f204c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb0861033a3a097 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:39.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f205aa00640 1 -- 172.21.15.144:0/2839087227 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c0aa670 con 0x7f205c06d250 2024-09-12T12:21:39.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f205aa00640 1 -- 172.21.15.144:0/2839087227 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c0af070 con 0x7f205c06d250 2024-09-12T12:21:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f205aa00640 1 -- 172.21.15.144:0/2839087227 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c0aaa30 con 0x7f205c06d250 2024-09-12T12:21:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f2062800640 1 -- 172.21.15.144:0/2839087227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d250 msgr2=0x7f205c15c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f2062800640 1 --2- 172.21.15.144:0/2839087227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d250 0x7f205c15c740 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f204c0098a0 tx=0x7f204c01c510 comp rx=0 tx=0).stop 2024-09-12T12:21:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f2062800640 1 -- 172.21.15.144:0/2839087227 shutdown_connections 2024-09-12T12:21:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f2062800640 1 --2- 172.21.15.144:0/2839087227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d250 0x7f205c15c740 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f2062800640 1 -- 172.21.15.144:0/2839087227 >> 172.21.15.144:0/2839087227 conn(0x7f205c06bc10 msgr2=0x7f205c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f2062800640 1 -- 172.21.15.144:0/2839087227 shutdown_connections 2024-09-12T12:21:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f2062800640 1 -- 172.21.15.144:0/2839087227 wait complete. 2024-09-12T12:21:39.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f2062800640 1 Processor -- start 2024-09-12T12:21:39.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.899+0000 7f2062800640 1 -- start start 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2062800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205c06d250 0x7f205c157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2062800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d630 0x7f205c146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2062800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f205c0b3490 0x7f205c156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2062800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f205c15d690 con 0x7f205c06d630 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2062800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0b44d0 con 0x7f205c0b3490 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2062800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f205c15d810 con 0x7f205c06d250 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d630 0x7f205c146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d630 0x7f205c146000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35482/0 (socket says 172.21.15.144:35482) 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053e00640 1 -- 172.21.15.144:0/1209159149 learned_addr learned my addr 172.21.15.144:0/1209159149 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f205be00640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f205c0b3490 0x7f205c156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f205b400640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205c06d250 0x7f205c157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053e00640 1 -- 172.21.15.144:0/1209159149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205c06d250 msgr2=0x7f205c157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053e00640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205c06d250 0x7f205c157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053e00640 1 -- 172.21.15.144:0/1209159149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f205c0b3490 msgr2=0x7f205c156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053e00640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f205c0b3490 0x7f205c156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053e00640 1 -- 172.21.15.144:0/1209159149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c146540 con 0x7f205c06d630 2024-09-12T12:21:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053e00640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d630 0x7f205c146000 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f204400c3c0 tx=0x7f204400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053400640 1 -- 172.21.15.144:0/1209159149 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044017070 con 0x7f205c06d630 2024-09-12T12:21:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053400640 1 -- 172.21.15.144:0/1209159149 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20440052d0 con 0x7f205c06d630 2024-09-12T12:21:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2062800640 1 -- 172.21.15.144:0/1209159149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205c156e00 con 0x7f205c06d630 2024-09-12T12:21:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053400640 1 -- 172.21.15.144:0/1209159149 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044003840 con 0x7f205c06d630 2024-09-12T12:21:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2062800640 1 -- 172.21.15.144:0/1209159149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205c1576a0 con 0x7f205c06d630 2024-09-12T12:21:39.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.903+0000 7f2053400640 1 -- 172.21.15.144:0/1209159149 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f204401a070 con 0x7f205c06d630 2024-09-12T12:21:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053400640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053400640 1 -- 172.21.15.144:0/1209159149 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f20440850b0 con 0x7f205c06d630 2024-09-12T12:21:39.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f205b400640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 Processor -- start 2024-09-12T12:21:39.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 -- start start 2024-09-12T12:21:39.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f205b400640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f204c0ae000 tx=0x7f204c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 0x560cfdafdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 0x560cfdab1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560cfd901ba0 con 0x560cfdafdff0 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560cfd8a7350 con 0x560cfdab16a0 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560cfd8fdb60 con 0x560cfdafd6d0 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f205be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 0x560cfdab1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35496/0 (socket says 172.21.15.144:35496) 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053e00640 1 -- 172.21.15.144:0/2692531083 learned_addr learned my addr 172.21.15.144:0/2692531083 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f205b400640 1 --2- 172.21.15.144:0/2692531083 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 0x560cfdafdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053e00640 1 -- 172.21.15.144:0/2692531083 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 msgr2=0x560cfdafdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053e00640 1 --2- 172.21.15.144:0/2692531083 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 0x560cfdafdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053e00640 1 -- 172.21.15.144:0/2692531083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 msgr2=0x560cfdab1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053e00640 1 --2- 172.21.15.144:0/2692531083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 0x560cfdab1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053e00640 1 -- 172.21.15.144:0/2692531083 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfd8aabd0 con 0x560cfdafdff0 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f205be00640 1 --2- 172.21.15.144:0/2692531083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 0x560cfdab1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:39.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2053e00640 1 --2- 172.21.15.144:0/2692531083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab1160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f20440010d0 tx=0x7f2044055540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0fb18aba648520 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f204be00640 1 -- 172.21.15.144:0/2692531083 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044053700 con 0x560cfdafdff0 2024-09-12T12:21:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f204be00640 1 -- 172.21.15.144:0/2692531083 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044051a70 con 0x560cfdafdff0 2024-09-12T12:21:39.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f204be00640 1 -- 172.21.15.144:0/2692531083 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204406d370 con 0x560cfdafdff0 2024-09-12T12:21:39.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 -- 172.21.15.144:0/2692531083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 msgr2=0x560cfdab1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 --2- 172.21.15.144:0/2692531083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab1160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f20440010d0 tx=0x7f2044055540 comp rx=0 tx=0).stop 2024-09-12T12:21:39.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 -- 172.21.15.144:0/2692531083 shutdown_connections 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 --2- 172.21.15.144:0/2692531083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 0x560cfdab1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 --2- 172.21.15.144:0/2692531083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab1160 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 --2- 172.21.15.144:0/2692531083 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 0x560cfdafdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 -- 172.21.15.144:0/2692531083 >> 172.21.15.144:0/2692531083 conn(0x560cfdade470 msgr2=0x560cfdae0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 -- 172.21.15.144:0/2692531083 shutdown_connections 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.907+0000 7f2065b89000 1 -- 172.21.15.144:0/2692531083 wait complete. 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 -- start start 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 Processor -- start 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 0x560cfdb03810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 0x560cfdb03d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560cfd89b2a0 con 0x560cfdafdff0 2024-09-12T12:21:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560cfd8c07d0 con 0x560cfdab16a0 2024-09-12T12:21:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560cfd8c2f70 con 0x560cfdafd6d0 2024-09-12T12:21:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 10 client.0 _ll_register_callbacks cb 0x560cfda9eb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 0x560cfdb03810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2053e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 0x560cfdb03d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35504/0 (socket says 172.21.15.144:35504) 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205be00640 1 -- 172.21.15.144:0/2627533840 learned_addr learned my addr 172.21.15.144:0/2627533840 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205be00640 1 -- 172.21.15.144:0/2627533840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 msgr2=0x560cfdb03d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205be00640 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 0x560cfdb03d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205be00640 1 -- 172.21.15.144:0/2627533840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 msgr2=0x560cfdb03810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205be00640 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 0x560cfdb03810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205be00640 1 -- 172.21.15.144:0/2627533840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfd90a810 con 0x560cfdafdff0 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205be00640 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab5570 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2054007330 tx=0x7f20540077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431f363bdfc76b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2048c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2048c00640 1 -- 172.21.15.144:0/2627533840 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054012720 con 0x560cfdafdff0 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2048c00640 1 -- 172.21.15.144:0/2627533840 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f20540128c0 con 0x560cfdafdff0 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 -- 172.21.15.144:0/2627533840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2044051a70 con 0x560cfdafdff0 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2048c00640 1 -- 172.21.15.144:0/2627533840 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f2054022050 con 0x560cfdafdff0 2024-09-12T12:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 10 client.8544 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 -- 172.21.15.144:0/2627533840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x560cfd8ab9f0 con 0x560cfdafdff0 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2048c00640 1 -- 172.21.15.144:0/2627533840 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044051a70 con 0x560cfdafdff0 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2048c00640 1 -- 172.21.15.144:0/2627533840 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f2054025020 con 0x560cfdafdff0 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 10 client.8544 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 10 client.8544 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 20 client.8544 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x560cfdab5f80 0x560cfdab6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 4 client.8544 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f2065b89000 1 -- 172.21.15.144:0/2627533840 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cfd89bbd0 con 0x560cfdab5f80 2024-09-12T12:21:39.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.911+0000 7f205b400640 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x560cfdab5f80 0x560cfdab6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f205b400640 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x560cfdab5f80 0x560cfdab6390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c075f35dfda4876e server_cookie=aaf6e700c396c433 in_seq=0 out_seq=0 2024-09-12T12:21:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2048c00640 10 client.8544 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2048c00640 1 -- 172.21.15.144:0/2627533840 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560cfd89bbd0 con 0x560cfdab5f80 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2048c00640 10 client.8544 handle_command_reply: tid=0 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 client.8544 shutdown 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 -- 172.21.15.144:0/2627533840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 msgr2=0x560cfdab5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab5570 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2054007330 tx=0x7f20540077f0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 -- 172.21.15.144:0/2627533840 shutdown_connections 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafdff0 0x560cfdab5570 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdafd6d0 0x560cfdb03d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x560cfdab5f80 0x560cfdab6390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 --2- 172.21.15.144:0/2627533840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdab16a0 0x560cfdb03810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2048c00640 0 client.8544 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 -- 172.21.15.144:0/2627533840 >> 172.21.15.144:0/2627533840 conn(0x560cfdade470 msgr2=0x560cfdae0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 -- 172.21.15.144:0/2627533840 shutdown_connections 2024-09-12T12:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 1 -- 172.21.15.144:0/2627533840 wait complete. 2024-09-12T12:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.915+0000 7f2065b89000 20 client.8544 trim_cache size 0 max 16384 2024-09-12T12:21:39.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.931+0000 7f2065b89000 1 Processor -- start 2024-09-12T12:21:39.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.931+0000 7f2065b89000 1 -- start start 2024-09-12T12:21:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdade470 0x560cfdb09e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 0x560cfdadd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafd6d0 0x560cfdadd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f205c203150 con 0x560cfdafd6d0 2024-09-12T12:21:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0cb530 con 0x560cfdade470 2024-09-12T12:21:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f205c202b00 con 0x560cfdab16a0 2024-09-12T12:21:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafd6d0 0x560cfdadd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafd6d0 0x560cfdadd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35512/0 (socket says 172.21.15.144:35512) 2024-09-12T12:21:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205be00640 1 -- 172.21.15.144:0/944665909 learned_addr learned my addr 172.21.15.144:0/944665909 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205b400640 1 --2- 172.21.15.144:0/944665909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdade470 0x560cfdb09e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2053e00640 1 --2- 172.21.15.144:0/944665909 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 0x560cfdadd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205be00640 1 -- 172.21.15.144:0/944665909 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 msgr2=0x560cfdadd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205be00640 1 --2- 172.21.15.144:0/944665909 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 0x560cfdadd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205be00640 1 -- 172.21.15.144:0/944665909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdade470 msgr2=0x560cfdb09e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205be00640 1 --2- 172.21.15.144:0/944665909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdade470 0x560cfdb09e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205be00640 1 -- 172.21.15.144:0/944665909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfd8a75a0 con 0x560cfdafd6d0 2024-09-12T12:21:39.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f205be00640 1 --2- 172.21.15.144:0/944665909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafd6d0 0x560cfdadd6a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2054012e10 tx=0x7f205400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81df4d27cf09d4ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:39.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f204b400640 1 -- 172.21.15.144:0/944665909 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054012920 con 0x560cfdafd6d0 2024-09-12T12:21:39.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f204b400640 1 -- 172.21.15.144:0/944665909 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205401a070 con 0x560cfdafd6d0 2024-09-12T12:21:39.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f204b400640 1 -- 172.21.15.144:0/944665909 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540156d0 con 0x560cfdafd6d0 2024-09-12T12:21:39.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- 172.21.15.144:0/944665909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafd6d0 msgr2=0x560cfdadd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- 172.21.15.144:0/944665909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafd6d0 0x560cfdadd6a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f2054012e10 tx=0x7f205400c000 comp rx=0 tx=0).stop 2024-09-12T12:21:39.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- 172.21.15.144:0/944665909 shutdown_connections 2024-09-12T12:21:39.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- 172.21.15.144:0/944665909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdafd6d0 0x560cfdadd6a0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- 172.21.15.144:0/944665909 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 0x560cfdadd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- 172.21.15.144:0/944665909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdade470 0x560cfdb09e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- 172.21.15.144:0/944665909 >> 172.21.15.144:0/944665909 conn(0x560cfdab8eb0 msgr2=0x560cfdaaf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:39.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- 172.21.15.144:0/944665909 shutdown_connections 2024-09-12T12:21:39.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- 172.21.15.144:0/944665909 wait complete. 2024-09-12T12:21:39.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- start start 2024-09-12T12:21:39.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 Processor -- start 2024-09-12T12:21:39.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 0x560cfdb79db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdade470 0x560cfdb7a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdafd6d0 0x560cfdb7a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560cfd8adc10 con 0x560cfdade470 2024-09-12T12:21:39.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.935+0000 7f2065b89000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560cfd8a8e30 con 0x560cfdafd6d0 2024-09-12T12:21:39.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560cfd8868f0 con 0x560cfdab16a0 2024-09-12T12:21:39.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 10 client.0 _ll_register_callbacks cb 0x7f2054001930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:39.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2053e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdade470 0x560cfdb7a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f205b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 0x560cfdb79db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2053e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdade470 0x560cfdb7a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35524/0 (socket says 172.21.15.144:35524) 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2053e00640 1 -- 172.21.15.144:0/4050186340 learned_addr learned my addr 172.21.15.144:0/4050186340 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f205be00640 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdafd6d0 0x560cfdb7a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2053e00640 1 -- 172.21.15.144:0/4050186340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 msgr2=0x560cfdb79db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2053e00640 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 0x560cfdb79db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2053e00640 1 -- 172.21.15.144:0/4050186340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdafd6d0 msgr2=0x560cfdb7a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2053e00640 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdafd6d0 0x560cfdb7a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2053e00640 1 -- 172.21.15.144:0/4050186340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfd8a15b0 con 0x560cfdade470 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f205be00640 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdafd6d0 0x560cfdb7a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:39.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2053e00640 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdade470 0x560cfdb7a2f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f2044055390 tx=0x7f2044014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9c43421b978c42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2048c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2048c00640 1 -- 172.21.15.144:0/4050186340 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204406d170 con 0x560cfdade470 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2048c00640 1 -- 172.21.15.144:0/4050186340 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f204406d310 con 0x560cfdade470 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 1 -- 172.21.15.144:0/4050186340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f205401a070 con 0x560cfdade470 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2048c00640 1 -- 172.21.15.144:0/4050186340 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f2044054850 con 0x560cfdade470 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 10 client.8550 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 1 -- 172.21.15.144:0/4050186340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x560cfd899330 con 0x560cfdade470 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2048c00640 1 -- 172.21.15.144:0/4050186340 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205401a070 con 0x560cfdade470 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2048c00640 1 -- 172.21.15.144:0/4050186340 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f20440549f0 con 0x560cfdade470 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 10 client.8550 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 10 client.8550 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 20 client.8550 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:39.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x560cfdafdff0 0x560cfdb06a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:39.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 4 client.8550 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-12T12:21:39.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2065b89000 1 -- 172.21.15.144:0/4050186340 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x560cfd90f2d0 con 0x560cfdafdff0 2024-09-12T12:21:39.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f205b400640 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x560cfdafdff0 0x560cfdb06a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:39.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f205b400640 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x560cfdafdff0 0x560cfdb06a20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d511f59fc808aed server_cookie=a3e6d9eb824135e3 in_seq=0 out_seq=0 2024-09-12T12:21:39.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.939+0000 7f2048c00640 10 client.8550 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:39.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2048c00640 1 -- 172.21.15.144:0/4050186340 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560cfd90f2d0 con 0x560cfdafdff0 2024-09-12T12:21:39.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2048c00640 10 client.8550 handle_command_reply: tid=0 2024-09-12T12:21:39.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 client.8550 shutdown 2024-09-12T12:21:39.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 -- 172.21.15.144:0/4050186340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdade470 msgr2=0x560cfdb7a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdade470 0x560cfdb7a2f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f2044055390 tx=0x7f2044014040 comp rx=0 tx=0).stop 2024-09-12T12:21:39.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 -- 172.21.15.144:0/4050186340 shutdown_connections 2024-09-12T12:21:39.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x560cfdafdff0 0x560cfdb06a20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560cfdafd6d0 0x560cfdb7a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560cfdade470 0x560cfdb7a2f0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2048c00640 0 client.8550 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:39.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 --2- 172.21.15.144:0/4050186340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560cfdab16a0 0x560cfdb79db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 -- 172.21.15.144:0/4050186340 >> 172.21.15.144:0/4050186340 conn(0x560cfdab8eb0 msgr2=0x560cfdab52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:39.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 -- 172.21.15.144:0/4050186340 shutdown_connections 2024-09-12T12:21:39.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 1 -- 172.21.15.144:0/4050186340 wait complete. 2024-09-12T12:21:39.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2065b89000 20 client.8550 trim_cache size 0 max 16384 2024-09-12T12:21:39.952 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:21:39.952 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:21:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "d52fbe0d-aad8-433d-b95a-1edbe9c40e2f", 2024-09-12T12:21:39.953 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:21:39.953 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:21:39.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 -- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 msgr2=0x7f2038069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f204c0ae000 tx=0x7f204c0a7000 comp rx=0 tx=0).stop 2024-09-12T12:21:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 -- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d630 msgr2=0x7f205c146000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d630 0x7f205c146000 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f204400c3c0 tx=0x7f204400c880 comp rx=0 tx=0).stop 2024-09-12T12:21:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 -- 172.21.15.144:0/1209159149 shutdown_connections 2024-09-12T12:21:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f205c0b3490 0x7f205c156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205c06d630 0x7f205c146000 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 --2- 172.21.15.144:0/1209159149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205c06d250 0x7f205c157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.943+0000 7f2062800640 1 -- 172.21.15.144:0/1209159149 >> 172.21.15.144:0/1209159149 conn(0x7f205c06bc10 msgr2=0x7f205c0d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.947+0000 7f2062800640 1 -- 172.21.15.144:0/1209159149 shutdown_connections 2024-09-12T12:21:39.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:39.947+0000 7f2062800640 1 -- 172.21.15.144:0/1209159149 wait complete. 2024-09-12T12:21:39.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:39.970 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-09-12T12:21:40.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.139+0000 7fb928a00640 1 Processor -- start 2024-09-12T12:21:40.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.139+0000 7fb928a00640 1 -- start start 2024-09-12T12:21:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.139+0000 7fb928a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb92415c2e0 0x7fb924072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.139+0000 7fb928a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 0x7fb92406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb928a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9240733e0 con 0x7fb92406c150 2024-09-12T12:21:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb928a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb92406c5c0 con 0x7fb92415c2e0 2024-09-12T12:21:40.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb928a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9240cd290 con 0x7fb9240af5f0 2024-09-12T12:21:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb922800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb92406c150 0x7fb92406d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40606/0 (socket says 172.21.15.144:40606) 2024-09-12T12:21:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb922800640 1 -- 172.21.15.144:0/1862478541 learned_addr learned my addr 172.21.15.144:0/1862478541 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb921e00640 1 --2- 172.21.15.144:0/1862478541 >> v2:172.21.15.165:3300/0 conn(0x7fb92415c2e0 0x7fb924072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb921400640 1 --2- 172.21.15.144:0/1862478541 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 0x7fb92406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb920a00640 1 -- 172.21.15.144:0/1862478541 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602205641 0 0) 0x7fb9240733e0 con 0x7fb92406c150 2024-09-12T12:21:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb920a00640 1 -- 172.21.15.144:0/1862478541 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb908003530 con 0x7fb92406c150 2024-09-12T12:21:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb921e00640 1 -- 172.21.15.144:0/1862478541 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 msgr2=0x7fb92406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb921e00640 1 --2- 172.21.15.144:0/1862478541 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 0x7fb92406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb921e00640 1 -- 172.21.15.144:0/1862478541 >> v1:172.21.15.144:6789/0 conn(0x7fb92406c150 legacy=0x7fb92406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb921e00640 1 -- 172.21.15.144:0/1862478541 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9240cd570 con 0x7fb92415c2e0 2024-09-12T12:21:40.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb921400640 1 --2- 172.21.15.144:0/1862478541 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 0x7fb92406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:40.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.143+0000 7fb921e00640 1 --2- 172.21.15.144:0/1862478541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92415c2e0 0x7fb924072b50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb9140097c0 tx=0x7fb91401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98a8de808aae7ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb920a00640 1 -- 172.21.15.144:0/1862478541 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140b0070 con 0x7fb92415c2e0 2024-09-12T12:21:40.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb920a00640 1 -- 172.21.15.144:0/1862478541 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140ab600 con 0x7fb92415c2e0 2024-09-12T12:21:40.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb920a00640 1 -- 172.21.15.144:0/1862478541 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140ab9b0 con 0x7fb92415c2e0 2024-09-12T12:21:40.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 -- 172.21.15.144:0/1862478541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92415c2e0 msgr2=0x7fb924072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 --2- 172.21.15.144:0/1862478541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92415c2e0 0x7fb924072b50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb9140097c0 tx=0x7fb91401c380 comp rx=0 tx=0).stop 2024-09-12T12:21:40.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 -- 172.21.15.144:0/1862478541 shutdown_connections 2024-09-12T12:21:40.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 --2- 172.21.15.144:0/1862478541 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 0x7fb92406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 --2- 172.21.15.144:0/1862478541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92415c2e0 0x7fb924072b50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 -- 172.21.15.144:0/1862478541 >> 172.21.15.144:0/1862478541 conn(0x7fb924068030 msgr2=0x7fb9240b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 -- 172.21.15.144:0/1862478541 shutdown_connections 2024-09-12T12:21:40.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 -- 172.21.15.144:0/1862478541 wait complete. 2024-09-12T12:21:40.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 Processor -- start 2024-09-12T12:21:40.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 -- start start 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92406c150 0x7fb92415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 0x7fb924160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92415c2e0 0x7fb924155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9241690a0 con 0x7fb92415c2e0 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb924168f20 con 0x7fb92406c150 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb928a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb924169220 con 0x7fb9240af5f0 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb922800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92415c2e0 0x7fb924155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb922800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92415c2e0 0x7fb924155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35532/0 (socket says 172.21.15.144:35532) 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.147+0000 7fb922800640 1 -- 172.21.15.144:0/3692728218 learned_addr learned my addr 172.21.15.144:0/3692728218 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb921e00640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92406c150 0x7fb92415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb921400640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 0x7fb924160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb922800640 1 -- 172.21.15.144:0/3692728218 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 msgr2=0x7fb924160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb922800640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 0x7fb924160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb922800640 1 -- 172.21.15.144:0/3692728218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92406c150 msgr2=0x7fb92415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb922800640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92406c150 0x7fb92415a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb922800640 1 -- 172.21.15.144:0/3692728218 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb924155c20 con 0x7fb92415c2e0 2024-09-12T12:21:40.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb922800640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92415c2e0 0x7fb924155050 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00caa0 tx=0x7fb91c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb91a000640 1 -- 172.21.15.144:0/3692728218 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c017070 con 0x7fb92415c2e0 2024-09-12T12:21:40.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb91a000640 1 -- 172.21.15.144:0/3692728218 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c00ac00 con 0x7fb92415c2e0 2024-09-12T12:21:40.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb928a00640 1 -- 172.21.15.144:0/3692728218 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92415eb40 con 0x7fb92415c2e0 2024-09-12T12:21:40.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb91a000640 1 -- 172.21.15.144:0/3692728218 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c012400 con 0x7fb92415c2e0 2024-09-12T12:21:40.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb928a00640 1 -- 172.21.15.144:0/3692728218 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92415f100 con 0x7fb92415c2e0 2024-09-12T12:21:40.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.151+0000 7fb91a000640 1 -- 172.21.15.144:0/3692728218 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb91c01a070 con 0x7fb92415c2e0 2024-09-12T12:21:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb91a000640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9040678c0 0x7fb904069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb91a000640 1 -- 172.21.15.144:0/3692728218 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fb91c085c10 con 0x7fb92415c2e0 2024-09-12T12:21:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb921e00640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9040678c0 0x7fb904069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 Processor -- start 2024-09-12T12:21:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 -- start start 2024-09-12T12:21:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb921e00640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9040678c0 0x7fb904069d80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb9140ad000 tx=0x7fb9140a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 0x5555e803fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e8040530 0x5555e7ff3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e7ff3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5555e7e44cc0 con 0x5555e7ff3780 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5555e7dffa20 con 0x5555e8040530 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5555e7e40c80 con 0x5555e803fc10 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb922800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e7ff3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb921e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 0x5555e803fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb921400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e8040530 0x5555e7ff3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb922800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e7ff3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35546/0 (socket says 172.21.15.144:35546) 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb922800640 1 -- 172.21.15.144:0/3245398806 learned_addr learned my addr 172.21.15.144:0/3245398806 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb922800640 1 -- 172.21.15.144:0/3245398806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 msgr2=0x5555e803fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb922800640 1 --2- 172.21.15.144:0/3245398806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 0x5555e803fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb922800640 1 -- 172.21.15.144:0/3245398806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e8040530 msgr2=0x5555e7ff3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb922800640 1 --2- 172.21.15.144:0/3245398806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e8040530 0x5555e7ff3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb922800640 1 -- 172.21.15.144:0/3245398806 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e7de7d40 con 0x5555e7ff3780 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb922800640 1 --2- 172.21.15.144:0/3245398806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e7ff3b60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00cfd0 tx=0x7fb91c055f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5800b9d9cf53b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb90ea00640 1 -- 172.21.15.144:0/3245398806 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c052490 con 0x5555e7ff3780 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb90ea00640 1 -- 172.21.15.144:0/3245398806 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c05e570 con 0x5555e7ff3780 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb90ea00640 1 -- 172.21.15.144:0/3245398806 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c052630 con 0x5555e7ff3780 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 -- 172.21.15.144:0/3245398806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 msgr2=0x5555e7ff3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3245398806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e7ff3b60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00cfd0 tx=0x7fb91c055f60 comp rx=0 tx=0).stop 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 -- 172.21.15.144:0/3245398806 shutdown_connections 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3245398806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e7ff3b60 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3245398806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e8040530 0x5555e7ff3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3245398806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 0x5555e803fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 -- 172.21.15.144:0/3245398806 >> 172.21.15.144:0/3245398806 conn(0x5555e80209b0 msgr2=0x5555e8022da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 -- 172.21.15.144:0/3245398806 shutdown_connections 2024-09-12T12:21:40.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.155+0000 7fb92bea3000 1 -- 172.21.15.144:0/3245398806 wait complete. 2024-09-12T12:21:40.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 -- start start 2024-09-12T12:21:40.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 Processor -- start 2024-09-12T12:21:40.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e8046d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 0x5555e80472d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e8040530 0x5555e8047810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5555e7dde2c0 con 0x5555e8040530 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5555e7e03370 con 0x5555e7ff3780 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5555e7e52f50 con 0x5555e803fc10 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 10 client.0 _ll_register_callbacks cb 0x5555e7ea5db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb922800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e8040530 0x5555e8047810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb922800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e8040530 0x5555e8047810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35556/0 (socket says 172.21.15.144:35556) 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb922800640 1 -- 172.21.15.144:0/390549887 learned_addr learned my addr 172.21.15.144:0/390549887 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb921400640 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 0x5555e80472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb921e00640 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e8046d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb922800640 1 -- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 msgr2=0x5555e80472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb922800640 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 0x5555e80472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb922800640 1 -- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 msgr2=0x5555e8046d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb922800640 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e8046d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb922800640 1 -- 172.21.15.144:0/390549887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555e7de4770 con 0x5555e8040530 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb921400640 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 0x5555e80472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb921e00640 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e8046d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb922800640 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e8040530 0x5555e8047810 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0540d0 tx=0x7fb91c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d5ed609e4fa87a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb903400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb903400640 1 -- 172.21.15.144:0/390549887 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c071030 con 0x5555e8040530 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb903400640 1 -- 172.21.15.144:0/390549887 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fb91c074350 con 0x5555e8040530 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 -- 172.21.15.144:0/390549887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb91c05e570 con 0x5555e8040530 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb903400640 1 -- 172.21.15.144:0/390549887 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7fb91c07a050 con 0x5555e8040530 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 10 client.8562 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 -- 172.21.15.144:0/390549887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x5555e7e023f0 con 0x5555e8040530 2024-09-12T12:21:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb903400640 1 -- 172.21.15.144:0/390549887 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c05e570 con 0x5555e8040530 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb903400640 1 -- 172.21.15.144:0/390549887 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7fb91c07d020 con 0x5555e8040530 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 10 client.8562 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 10 client.8562 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 20 client.8562 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5555e804f160 0x5555e8051550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 4 client.8562 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb92bea3000 1 -- 172.21.15.144:0/390549887 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555e7dded90 con 0x5555e804f160 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb921e00640 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5555e804f160 0x5555e8051550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb921e00640 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5555e804f160 0x5555e8051550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3160a7b0bbfc409 server_cookie=9c5542ebd1e6881f in_seq=0 out_seq=0 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.159+0000 7fb903400640 10 client.8562 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb903400640 1 -- 172.21.15.144:0/390549887 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555e7dded90 con 0x5555e804f160 2024-09-12T12:21:40.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb903400640 10 client.8562 handle_command_reply: tid=0 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 client.8562 shutdown 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 -- 172.21.15.144:0/390549887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e8040530 msgr2=0x5555e8047810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e8040530 0x5555e8047810 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0540d0 tx=0x7fb91c001260 comp rx=0 tx=0).stop 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 -- 172.21.15.144:0/390549887 shutdown_connections 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e8040530 0x5555e8047810 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e803fc10 0x5555e80472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5555e804f160 0x5555e8051550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 --2- 172.21.15.144:0/390549887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e8046d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 -- 172.21.15.144:0/390549887 >> 172.21.15.144:0/390549887 conn(0x5555e80209b0 msgr2=0x5555e7ff2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb903400640 0 client.8562 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 -- 172.21.15.144:0/390549887 shutdown_connections 2024-09-12T12:21:40.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 1 -- 172.21.15.144:0/390549887 wait complete. 2024-09-12T12:21:40.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.163+0000 7fb92bea3000 20 client.8562 trim_cache size 0 max 16384 2024-09-12T12:21:40.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb92bea3000 1 Processor -- start 2024-09-12T12:21:40.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb92bea3000 1 -- start start 2024-09-12T12:21:40.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e8054dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e803fc10 0x5555e7ff2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 0x5555e7ff2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb92bea3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb924203350 con 0x5555e7ff3780 2024-09-12T12:21:40.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb92bea3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb924159110 con 0x5555e803fc10 2024-09-12T12:21:40.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb92bea3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb924202e60 con 0x5555e8040530 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e8054dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e8054dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35572/0 (socket says 172.21.15.144:35572) 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921e00640 1 -- 172.21.15.144:0/2957084192 learned_addr learned my addr 172.21.15.144:0/2957084192 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb922800640 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 0x5555e7ff2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921400640 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e803fc10 0x5555e7ff2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921e00640 1 -- 172.21.15.144:0/2957084192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 msgr2=0x5555e7ff2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921e00640 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 0x5555e7ff2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921e00640 1 -- 172.21.15.144:0/2957084192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e803fc10 msgr2=0x5555e7ff2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921e00640 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e803fc10 0x5555e7ff2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921e00640 1 -- 172.21.15.144:0/2957084192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e7ec6320 con 0x5555e7ff3780 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.179+0000 7fb921400640 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e803fc10 0x5555e7ff2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921e00640 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e8054dc0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fb914009580 tx=0x7fb914004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70667832ed229348 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb90e000640 1 -- 172.21.15.144:0/2957084192 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140d0070 con 0x5555e7ff3780 2024-09-12T12:21:40.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb90e000640 1 -- 172.21.15.144:0/2957084192 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140abaa0 con 0x5555e7ff3780 2024-09-12T12:21:40.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb90e000640 1 -- 172.21.15.144:0/2957084192 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140b0040 con 0x5555e7ff3780 2024-09-12T12:21:40.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- 172.21.15.144:0/2957084192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 msgr2=0x5555e8054dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e8054dc0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fb914009580 tx=0x7fb914004740 comp rx=0 tx=0).stop 2024-09-12T12:21:40.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- 172.21.15.144:0/2957084192 shutdown_connections 2024-09-12T12:21:40.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 0x5555e7ff2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e803fc10 0x5555e7ff2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 --2- 172.21.15.144:0/2957084192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e7ff3780 0x5555e8054dc0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- 172.21.15.144:0/2957084192 >> 172.21.15.144:0/2957084192 conn(0x5555e80209b0 msgr2=0x5555e804c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- 172.21.15.144:0/2957084192 shutdown_connections 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- 172.21.15.144:0/2957084192 wait complete. 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- start start 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 Processor -- start 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e80ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e803fc10 0x5555e80aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 0x5555e8053890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5555e7dec120 con 0x5555e803fc10 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5555e7ec5e90 con 0x5555e7ff3780 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5555e7deeb90 con 0x5555e8040530 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 10 client.0 _ll_register_callbacks cb 0x7fb910009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e803fc10 0x5555e80aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e80ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e803fc10 0x5555e80aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35582/0 (socket says 172.21.15.144:35582) 2024-09-12T12:21:40.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921400640 1 -- 172.21.15.144:0/3503787537 learned_addr learned my addr 172.21.15.144:0/3503787537 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb922800640 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 0x5555e8053890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921e00640 1 -- 172.21.15.144:0/3503787537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 msgr2=0x5555e8053890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921e00640 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 0x5555e8053890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921e00640 1 -- 172.21.15.144:0/3503787537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e803fc10 msgr2=0x5555e80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921e00640 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e803fc10 0x5555e80aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921e00640 1 -- 172.21.15.144:0/3503787537 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555e7dd85c0 con 0x5555e7ff3780 2024-09-12T12:21:40.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921400640 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e803fc10 0x5555e80aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb921e00640 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e80ae9b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb91401aa30 tx=0x7fb91401abc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1648e802bfccf261 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb903400640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb903400640 1 -- 172.21.15.144:0/3503787537 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140d0070 con 0x5555e7ff3780 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb903400640 1 -- 172.21.15.144:0/3503787537 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fb9140d5c40 con 0x5555e7ff3780 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.183+0000 7fb92bea3000 1 -- 172.21.15.144:0/3503787537 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9140abaa0 con 0x5555e7ff3780 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb903400640 1 -- 172.21.15.144:0/3503787537 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7fb9140b0040 con 0x5555e7ff3780 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 10 client.8104 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 -- 172.21.15.144:0/3503787537 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x5555e7ddc330 con 0x5555e7ff3780 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb903400640 1 -- 172.21.15.144:0/3503787537 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140abaa0 con 0x5555e7ff3780 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb903400640 1 -- 172.21.15.144:0/3503787537 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7fb9140b6440 con 0x5555e7ff3780 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 10 client.8104 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 10 client.8104 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:40.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 20 client.8104 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5555e80541f0 0x5555e80545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 4 client.8104 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 -- 172.21.15.144:0/3503787537 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x5555e7e523f0 con 0x5555e80541f0 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb921400640 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5555e80541f0 0x5555e80545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb903400640 10 client.8104 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb921400640 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5555e80541f0 0x5555e80545d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d428cc793470b1bc server_cookie=1746b67269cdae20 in_seq=0 out_seq=0 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb903400640 1 -- 172.21.15.144:0/3503787537 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5555e7e523f0 con 0x5555e80541f0 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb903400640 10 client.8104 handle_command_reply: tid=0 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 client.8104 shutdown 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 -- 172.21.15.144:0/3503787537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 msgr2=0x5555e80ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e80ae9b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb91401aa30 tx=0x7fb91401abc0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 -- 172.21.15.144:0/3503787537 shutdown_connections 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5555e8040530 0x5555e8053890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5555e803fc10 0x5555e80aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x5555e80541f0 0x5555e80545d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 --2- 172.21.15.144:0/3503787537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5555e7ff3780 0x5555e80ae9b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 -- 172.21.15.144:0/3503787537 >> 172.21.15.144:0/3503787537 conn(0x5555e80209b0 msgr2=0x5555e7ffbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb903400640 0 client.8104 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 -- 172.21.15.144:0/3503787537 shutdown_connections 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 1 -- 172.21.15.144:0/3503787537 wait complete. 2024-09-12T12:21:40.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb92bea3000 20 client.8104 trim_cache size 0 max 16384 2024-09-12T12:21:40.195 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:21:40.195 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:21:40.195 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:21:40.195 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:21:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 -- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9040678c0 msgr2=0x7fb904069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9040678c0 0x7fb904069d80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb9140ad000 tx=0x7fb9140a6000 comp rx=0 tx=0).stop 2024-09-12T12:21:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 -- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92415c2e0 msgr2=0x7fb924155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92415c2e0 0x7fb924155050 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00caa0 tx=0x7fb91c00cf60 comp rx=0 tx=0).stop 2024-09-12T12:21:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 -- 172.21.15.144:0/3692728218 shutdown_connections 2024-09-12T12:21:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9040678c0 0x7fb904069d80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb92415c2e0 0x7fb924155050 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9240af5f0 0x7fb924160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 --2- 172.21.15.144:0/3692728218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb92406c150 0x7fb92415a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 -- 172.21.15.144:0/3692728218 >> 172.21.15.144:0/3692728218 conn(0x7fb924068030 msgr2=0x7fb9240b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 -- 172.21.15.144:0/3692728218 shutdown_connections 2024-09-12T12:21:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.187+0000 7fb928a00640 1 -- 172.21.15.144:0/3692728218 wait complete. 2024-09-12T12:21:40.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:40.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-12T12:21:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.343+0000 7f1e5b200640 1 Processor -- start 2024-09-12T12:21:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.343+0000 7f1e5b200640 1 -- start start 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e5b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e5415c2e0 0x7f1e54072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e5b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e540af5f0 0x7f1e5406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e5b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e540733e0 con 0x7f1e5406c150 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e5b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1e5406c5c0 con 0x7f1e5415c2e0 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e5b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e540cd290 con 0x7f1e540af5f0 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e53e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e5415c2e0 0x7f1e54072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e59200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1e5406c150 0x7f1e5406d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40612/0 (socket says 172.21.15.144:40612) 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e53e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e5415c2e0 0x7f1e54072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35586/0 (socket says 172.21.15.144:35586) 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e59200640 1 -- 172.21.15.144:0/3975731327 learned_addr learned my addr 172.21.15.144:0/3975731327 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e53400640 1 --2- 172.21.15.144:0/3975731327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e540af5f0 0x7f1e5406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e53e00640 1 -- 172.21.15.144:0/3975731327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e540af5f0 msgr2=0x7f1e5406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e53e00640 1 --2- 172.21.15.144:0/3975731327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e540af5f0 0x7f1e5406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e53e00640 1 -- 172.21.15.144:0/3975731327 >> v1:172.21.15.144:6789/0 conn(0x7f1e5406c150 legacy=0x7f1e5406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e53e00640 1 -- 172.21.15.144:0/3975731327 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e540cd570 con 0x7f1e5415c2e0 2024-09-12T12:21:40.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.347+0000 7f1e52a00640 1 -- 172.21.15.144:0/3975731327 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436811555 0 0) 0x7f1e540733e0 con 0x7f1e5406c150 2024-09-12T12:21:40.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e53e00640 1 --2- 172.21.15.144:0/3975731327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5415c2e0 0x7f1e54072b50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009d90 tx=0x7f1e4401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650e4911058681d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e52a00640 1 -- 172.21.15.144:0/3975731327 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440b2070 con 0x7f1e5415c2e0 2024-09-12T12:21:40.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e52a00640 1 -- 172.21.15.144:0/3975731327 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e440a5820 con 0x7f1e5415c2e0 2024-09-12T12:21:40.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e52a00640 1 -- 172.21.15.144:0/3975731327 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440a5bf0 con 0x7f1e5415c2e0 2024-09-12T12:21:40.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 -- 172.21.15.144:0/3975731327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5415c2e0 msgr2=0x7f1e54072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 --2- 172.21.15.144:0/3975731327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5415c2e0 0x7f1e54072b50 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009d90 tx=0x7f1e4401c850 comp rx=0 tx=0).stop 2024-09-12T12:21:40.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 -- 172.21.15.144:0/3975731327 shutdown_connections 2024-09-12T12:21:40.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 --2- 172.21.15.144:0/3975731327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e540af5f0 0x7f1e5406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 --2- 172.21.15.144:0/3975731327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5415c2e0 0x7f1e54072b50 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 -- 172.21.15.144:0/3975731327 >> 172.21.15.144:0/3975731327 conn(0x7f1e54068030 msgr2=0x7f1e540b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 -- 172.21.15.144:0/3975731327 shutdown_connections 2024-09-12T12:21:40.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 -- 172.21.15.144:0/3975731327 wait complete. 2024-09-12T12:21:40.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 Processor -- start 2024-09-12T12:21:40.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.351+0000 7f1e5b200640 1 -- start start 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e5b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5406c150 0x7f1e54147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e5b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e540af5f0 0x7f1e540b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e5b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5415c2e0 0x7f1e540ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e5b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1e541690a0 con 0x7f1e540af5f0 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e5b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e54168f20 con 0x7f1e5415c2e0 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e5b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e54169220 con 0x7f1e5406c150 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e540af5f0 0x7f1e540b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e540af5f0 0x7f1e540b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35602/0 (socket says 172.21.15.144:35602) 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53400640 1 -- 172.21.15.144:0/1643018425 learned_addr learned my addr 172.21.15.144:0/1643018425 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e59200640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5415c2e0 0x7f1e540ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53e00640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5406c150 0x7f1e54147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53400640 1 -- 172.21.15.144:0/1643018425 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5406c150 msgr2=0x7f1e54147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53400640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5406c150 0x7f1e54147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53400640 1 -- 172.21.15.144:0/1643018425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5415c2e0 msgr2=0x7f1e540ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53400640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5415c2e0 0x7f1e540ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53400640 1 -- 172.21.15.144:0/1643018425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e540b4340 con 0x7f1e540af5f0 2024-09-12T12:21:40.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e53400640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e540af5f0 0x7f1e540b3e00 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000e930 tx=0x7f1e4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e4be00640 1 -- 172.21.15.144:0/1643018425 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40017070 con 0x7f1e540af5f0 2024-09-12T12:21:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e4be00640 1 -- 172.21.15.144:0/1643018425 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4000ca00 con 0x7f1e540af5f0 2024-09-12T12:21:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e4be00640 1 -- 172.21.15.144:0/1643018425 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000cdb0 con 0x7f1e540af5f0 2024-09-12T12:21:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e5b200640 1 -- 172.21.15.144:0/1643018425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5415e0e0 con 0x7f1e540af5f0 2024-09-12T12:21:40.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e5b200640 1 -- 172.21.15.144:0/1643018425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5415e6a0 con 0x7f1e540af5f0 2024-09-12T12:21:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.355+0000 7f1e4be00640 1 -- 172.21.15.144:0/1643018425 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e4001a070 con 0x7f1e540af5f0 2024-09-12T12:21:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e4be00640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e340678c0 0x7f1e34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e4be00640 1 -- 172.21.15.144:0/1643018425 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f1e40085dc0 con 0x7f1e540af5f0 2024-09-12T12:21:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53e00640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e340678c0 0x7f1e34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e5e5c1000 1 Processor -- start 2024-09-12T12:21:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e5e5c1000 1 -- start start 2024-09-12T12:21:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53e00640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e340678c0 0x7f1e34069d80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1e440af000 tx=0x7f1e440a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d66d70 0x55de73d67150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d67690 0x55de73d1a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 0x55de73d1b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55de73c04960 con 0x55de73d67690 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55de73b48900 con 0x55de73d1adb0 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55de73b6bd40 con 0x55de73d66d70 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d67690 0x55de73d1a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d67690 0x55de73d1a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35616/0 (socket says 172.21.15.144:35616) 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53400640 1 -- 172.21.15.144:0/4183643928 learned_addr learned my addr 172.21.15.144:0/4183643928 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53e00640 1 --2- 172.21.15.144:0/4183643928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d66d70 0x55de73d67150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e59200640 1 --2- 172.21.15.144:0/4183643928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 0x55de73d1b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53400640 1 -- 172.21.15.144:0/4183643928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d66d70 msgr2=0x55de73d67150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53400640 1 --2- 172.21.15.144:0/4183643928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d66d70 0x55de73d67150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53400640 1 -- 172.21.15.144:0/4183643928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 msgr2=0x55de73d1b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53400640 1 --2- 172.21.15.144:0/4183643928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 0x55de73d1b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53400640 1 -- 172.21.15.144:0/4183643928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de73b12580 con 0x55de73d67690 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e53400640 1 --2- 172.21.15.144:0/4183643928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d67690 0x55de73d1a870 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000cfd0 tx=0x7f1e4005a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ffc91957d9eb0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e48c00640 1 -- 172.21.15.144:0/4183643928 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40081020 con 0x55de73d67690 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e48c00640 1 -- 172.21.15.144:0/4183643928 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4005a170 con 0x55de73d67690 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.359+0000 7f1e48c00640 1 -- 172.21.15.144:0/4183643928 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40021040 con 0x55de73d67690 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/4183643928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d67690 msgr2=0x55de73d1a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/4183643928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d67690 0x55de73d1a870 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000cfd0 tx=0x7f1e4005a4d0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/4183643928 shutdown_connections 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/4183643928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 0x55de73d1b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/4183643928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d67690 0x55de73d1a870 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/4183643928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d66d70 0x55de73d67150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/4183643928 >> 172.21.15.144:0/4183643928 conn(0x55de73d48040 msgr2=0x55de73d4a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/4183643928 shutdown_connections 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/4183643928 wait complete. 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- start start 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 Processor -- start 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 0x55de73d6dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d6e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 0x55de73d6e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55de73b67d00 con 0x55de73d66d70 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55de73b26aa0 con 0x55de73d67690 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55de73b05340 con 0x55de73d1adb0 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 10 client.0 _ll_register_callbacks cb 0x55de73d08760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d6e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d6e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35618/0 (socket says 172.21.15.144:35618) 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e59200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 0x55de73d6e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53400640 1 -- 172.21.15.144:0/3933448229 learned_addr learned my addr 172.21.15.144:0/3933448229 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 0x55de73d6dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53400640 1 -- 172.21.15.144:0/3933448229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 msgr2=0x55de73d6dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53400640 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 0x55de73d6dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53400640 1 -- 172.21.15.144:0/3933448229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 msgr2=0x55de73d6e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53400640 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 0x55de73d6e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53400640 1 -- 172.21.15.144:0/3933448229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de73b0edc0 con 0x55de73d66d70 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e59200640 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 0x55de73d6e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e53400640 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d6e220 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f1e4005e7d0 tx=0x7f1e40000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b504af55bc3dbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e3d600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e3d600640 1 -- 172.21.15.144:0/3933448229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40081030 con 0x55de73d66d70 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e3d600640 1 -- 172.21.15.144:0/3933448229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f1e40051f20 con 0x55de73d66d70 2024-09-12T12:21:40.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3933448229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e4005a170 con 0x55de73d66d70 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e3d600640 1 -- 172.21.15.144:0/3933448229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f1e40021070 con 0x55de73d66d70 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 10 client.8583 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3933448229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55de73b0b7f0 con 0x55de73d66d70 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e3d600640 1 -- 172.21.15.144:0/3933448229 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4005a170 con 0x55de73d66d70 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e3d600640 1 -- 172.21.15.144:0/3933448229 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f1e40024060 con 0x55de73d66d70 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 10 client.8583 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 10 client.8583 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 20 client.8583 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55de73d760b0 0x55de73d784a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 4 client.8583 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.363+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3933448229 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de73b05e10 con 0x55de73d760b0 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e53e00640 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55de73d760b0 0x55de73d784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e53e00640 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55de73d760b0 0x55de73d784a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d4e73ab3ddfa8cb server_cookie=9b515ad407012824 in_seq=0 out_seq=0 2024-09-12T12:21:40.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e3d600640 10 client.8583 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e3d600640 1 -- 172.21.15.144:0/3933448229 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de73b05e10 con 0x55de73d760b0 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e3d600640 10 client.8583 handle_command_reply: tid=0 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 client.8583 shutdown 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3933448229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 msgr2=0x55de73d6e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d6e220 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f1e4005e7d0 tx=0x7f1e40000bd0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3933448229 shutdown_connections 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55de73d760b0 0x55de73d784a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 0x55de73d6e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d6e220 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3933448229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 0x55de73d6dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3933448229 >> 172.21.15.144:0/3933448229 conn(0x55de73d48040 msgr2=0x55de73d19f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e3d600640 0 client.8583 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:40.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3933448229 shutdown_connections 2024-09-12T12:21:40.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3933448229 wait complete. 2024-09-12T12:21:40.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.367+0000 7f1e5e5c1000 20 client.8583 trim_cache size 0 max 16384 2024-09-12T12:21:40.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.383+0000 7f1e5e5c1000 1 Processor -- start 2024-09-12T12:21:40.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.383+0000 7f1e5e5c1000 1 -- start start 2024-09-12T12:21:40.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 0x55de73d74360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d22bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d67690 0x55de73d23130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1e542041b0 con 0x55de73d66d70 2024-09-12T12:21:40.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e54203210 con 0x55de73d1adb0 2024-09-12T12:21:40.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e54148d20 con 0x55de73d67690 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d22bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d22bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35622/0 (socket says 172.21.15.144:35622) 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 -- 172.21.15.144:0/2312728240 learned_addr learned my addr 172.21.15.144:0/2312728240 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e59200640 1 --2- 172.21.15.144:0/2312728240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d67690 0x55de73d23130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53e00640 1 --2- 172.21.15.144:0/2312728240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 0x55de73d74360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 -- 172.21.15.144:0/2312728240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d67690 msgr2=0x55de73d23130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 --2- 172.21.15.144:0/2312728240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d67690 0x55de73d23130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 -- 172.21.15.144:0/2312728240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 msgr2=0x55de73d74360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 --2- 172.21.15.144:0/2312728240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 0x55de73d74360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 -- 172.21.15.144:0/2312728240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de73b29470 con 0x55de73d66d70 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 --2- 172.21.15.144:0/2312728240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d22bf0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c520 tx=0x7f1e40083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809b70a337944794 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e3fe00640 1 -- 172.21.15.144:0/2312728240 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40081070 con 0x55de73d66d70 2024-09-12T12:21:40.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e3fe00640 1 -- 172.21.15.144:0/2312728240 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e40051f20 con 0x55de73d66d70 2024-09-12T12:21:40.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e3fe00640 1 -- 172.21.15.144:0/2312728240 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4007dab0 con 0x55de73d66d70 2024-09-12T12:21:40.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/2312728240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 msgr2=0x55de73d22bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/2312728240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d22bf0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c520 tx=0x7f1e40083000 comp rx=0 tx=0).stop 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/2312728240 shutdown_connections 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/2312728240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d67690 0x55de73d23130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/2312728240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73d22bf0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/2312728240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d1adb0 0x55de73d74360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/2312728240 >> 172.21.15.144:0/2312728240 conn(0x55de73d48040 msgr2=0x55de73d6daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/2312728240 shutdown_connections 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/2312728240 wait complete. 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- start start 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 Processor -- start 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 0x55de73d73950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73dda850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 0x55de73ddad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55de73c280c0 con 0x55de73d66d70 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55de73d263f0 con 0x55de73d67690 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55de73bab780 con 0x55de73d1adb0 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e5e5c1000 10 client.0 _ll_register_callbacks cb 0x7f1e4c007060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73dda850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73dda850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35632/0 (socket says 172.21.15.144:35632) 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53400640 1 -- 172.21.15.144:0/3008882730 learned_addr learned my addr 172.21.15.144:0/3008882730 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e59200640 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 0x55de73ddad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.387+0000 7f1e53e00640 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 0x55de73d73950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e53400640 1 -- 172.21.15.144:0/3008882730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 msgr2=0x55de73d73950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e53400640 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 0x55de73d73950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e53400640 1 -- 172.21.15.144:0/3008882730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 msgr2=0x55de73ddad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e53400640 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 0x55de73ddad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e53400640 1 -- 172.21.15.144:0/3008882730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de73aff640 con 0x55de73d66d70 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e53400640 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73dda850 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f1e400561f0 tx=0x7f1e400524f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6eaf805bcfe8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 1 -- 172.21.15.144:0/3008882730 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40081040 con 0x55de73d66d70 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 1 -- 172.21.15.144:0/3008882730 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f1e40055090 con 0x55de73d66d70 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3008882730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e40051f20 con 0x55de73d66d70 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 1 -- 172.21.15.144:0/3008882730 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f1e40055290 con 0x55de73d66d70 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 10 client.8589 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3008882730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55de73b033b0 con 0x55de73d66d70 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 1 -- 172.21.15.144:0/3008882730 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e40051f20 con 0x55de73d66d70 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 1 -- 172.21.15.144:0/3008882730 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f1e400059a0 con 0x55de73d66d70 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 10 client.8589 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 10 client.8589 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:40.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 20 client.8589 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:40.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55de73ddb2d0 0x55de73dd72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 4 client.8589 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:21:40.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3008882730 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55de73b79470 con 0x55de73ddb2d0 2024-09-12T12:21:40.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e53e00640 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55de73ddb2d0 0x55de73dd72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e53e00640 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55de73ddb2d0 0x55de73dd72b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b601ebf598fa26 server_cookie=86672ed626cd6144 in_seq=0 out_seq=0 2024-09-12T12:21:40.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 10 client.8589 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:40.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 1 -- 172.21.15.144:0/3008882730 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x55de73b79470 con 0x55de73ddb2d0 2024-09-12T12:21:40.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 10 client.8589 handle_command_reply: tid=0 2024-09-12T12:21:40.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 client.8589 shutdown 2024-09-12T12:21:40.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3008882730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 msgr2=0x55de73dda850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73dda850 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f1e400561f0 tx=0x7f1e400524f0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3008882730 shutdown_connections 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55de73ddb2d0 0x55de73dd72b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de73d67690 0x55de73ddad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55de73d66d70 0x55de73dda850 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 --2- 172.21.15.144:0/3008882730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55de73d1adb0 0x55de73d73950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e3d600640 0 client.8589 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3008882730 >> 172.21.15.144:0/3008882730 conn(0x55de73d48040 msgr2=0x55de73d22400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3008882730 shutdown_connections 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 1 -- 172.21.15.144:0/3008882730 wait complete. 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5e5c1000 20 client.8589 trim_cache size 0 max 16384 2024-09-12T12:21:40.397 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:21:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-12T12:21:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:21:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "d52fbe0d-aad8-433d-b95a-1edbe9c40e2f": { 2024-09-12T12:21:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_control_test_path", 2024-09-12T12:21:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "d52fbe0d-aad8-433d-b95a-1edbe9c40e2f", 2024-09-12T12:21:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "recursive" 2024-09-12T12:21:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:40.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:21:40.398 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 -- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e340678c0 msgr2=0x7f1e34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e340678c0 0x7f1e34069d80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1e440af000 tx=0x7f1e440a7070 comp rx=0 tx=0).stop 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 -- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e540af5f0 msgr2=0x7f1e540b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e540af5f0 0x7f1e540b3e00 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000e930 tx=0x7f1e4000edf0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 -- 172.21.15.144:0/1643018425 shutdown_connections 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e340678c0 0x7f1e34069d80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5415c2e0 0x7f1e540ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e540af5f0 0x7f1e540b3e00 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 --2- 172.21.15.144:0/1643018425 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5406c150 0x7f1e54147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 -- 172.21.15.144:0/1643018425 >> 172.21.15.144:0/1643018425 conn(0x7f1e54068030 msgr2=0x7f1e5415af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 -- 172.21.15.144:0/1643018425 shutdown_connections 2024-09-12T12:21:40.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.391+0000 7f1e5b200640 1 -- 172.21.15.144:0/1643018425 wait complete. 2024-09-12T12:21:40.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.547+0000 7f01c8e00640 1 Processor -- start 2024-09-12T12:21:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.547+0000 7f01c8e00640 1 -- start start 2024-09-12T12:21:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c8e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f01c415cd30 0x7f01c40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c40b5de0 0x7f01c4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c8e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c40cd870 con 0x7f01c415c7b0 2024-09-12T12:21:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c8e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f01c40b6230 con 0x7f01c415cd30 2024-09-12T12:21:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f01c4072a50 con 0x7f01c40b5de0 2024-09-12T12:21:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f01c415c7b0 0x7f01c40ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40614/0 (socket says 172.21.15.144:40614) 2024-09-12T12:21:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c1e00640 1 -- 172.21.15.144:0/1433587324 learned_addr learned my addr 172.21.15.144:0/1433587324 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c1400640 1 --2- 172.21.15.144:0/1433587324 >> v2:172.21.15.165:3300/0 conn(0x7f01c415cd30 0x7f01c40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c2800640 1 --2- 172.21.15.144:0/1433587324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c40b5de0 0x7f01c4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c0a00640 1 -- 172.21.15.144:0/1433587324 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554548892 0 0) 0x7f01c40cd870 con 0x7f01c415c7b0 2024-09-12T12:21:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c0a00640 1 -- 172.21.15.144:0/1433587324 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01a8003530 con 0x7f01c415c7b0 2024-09-12T12:21:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c1400640 1 -- 172.21.15.144:0/1433587324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c40b5de0 msgr2=0x7f01c4072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c1400640 1 --2- 172.21.15.144:0/1433587324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c40b5de0 0x7f01c4072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c1400640 1 -- 172.21.15.144:0/1433587324 >> v1:172.21.15.144:6789/0 conn(0x7f01c415c7b0 legacy=0x7f01c40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.551+0000 7f01c1400640 1 -- 172.21.15.144:0/1433587324 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c40cdb50 con 0x7f01c415cd30 2024-09-12T12:21:40.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c1400640 1 --2- 172.21.15.144:0/1433587324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01c415cd30 0x7f01c40b58a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f01b00097c0 tx=0x7f01b001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7106c9c7256d76b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c0a00640 1 -- 172.21.15.144:0/1433587324 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b00b0070 con 0x7f01c415cd30 2024-09-12T12:21:40.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c0a00640 1 -- 172.21.15.144:0/1433587324 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b00ab600 con 0x7f01c415cd30 2024-09-12T12:21:40.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c0a00640 1 -- 172.21.15.144:0/1433587324 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b00ab9d0 con 0x7f01c415cd30 2024-09-12T12:21:40.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 -- 172.21.15.144:0/1433587324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01c415cd30 msgr2=0x7f01c40b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 --2- 172.21.15.144:0/1433587324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01c415cd30 0x7f01c40b58a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f01b00097c0 tx=0x7f01b001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 -- 172.21.15.144:0/1433587324 shutdown_connections 2024-09-12T12:21:40.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 --2- 172.21.15.144:0/1433587324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c40b5de0 0x7f01c4072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 --2- 172.21.15.144:0/1433587324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01c415cd30 0x7f01c40b58a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 -- 172.21.15.144:0/1433587324 >> 172.21.15.144:0/1433587324 conn(0x7f01c406d0d0 msgr2=0x7f01c406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 -- 172.21.15.144:0/1433587324 shutdown_connections 2024-09-12T12:21:40.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 -- 172.21.15.144:0/1433587324 wait complete. 2024-09-12T12:21:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 Processor -- start 2024-09-12T12:21:40.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.555+0000 7f01c8e00640 1 -- start start 2024-09-12T12:21:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c40b5de0 0x7f01c40aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c415c7b0 0x7f01c40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c8e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01c415cd30 0x7f01c40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01c4073fc0 con 0x7f01c40b5de0 2024-09-12T12:21:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c8e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f01c4073e40 con 0x7f01c415cd30 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f01c4074140 con 0x7f01c415c7b0 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c40b5de0 0x7f01c40aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c40b5de0 0x7f01c40aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35640/0 (socket says 172.21.15.144:35640) 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1e00640 1 -- 172.21.15.144:0/2817720939 learned_addr learned my addr 172.21.15.144:0/2817720939 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1400640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c415c7b0 0x7f01c40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c2800640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01c415cd30 0x7f01c40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1e00640 1 -- 172.21.15.144:0/2817720939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c415c7b0 msgr2=0x7f01c40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1e00640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c415c7b0 0x7f01c40b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1e00640 1 -- 172.21.15.144:0/2817720939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01c415cd30 msgr2=0x7f01c40b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1e00640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01c415cd30 0x7f01c40b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1e00640 1 -- 172.21.15.144:0/2817720939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c40b4d20 con 0x7f01c40b5de0 2024-09-12T12:21:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c1e00640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c40b5de0 0x7f01c40aeaf0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f01b4001470 tx=0x7f01b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01ba000640 1 -- 172.21.15.144:0/2817720939 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b4017070 con 0x7f01c40b5de0 2024-09-12T12:21:40.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01ba000640 1 -- 172.21.15.144:0/2817720939 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b400ad00 con 0x7f01c40b5de0 2024-09-12T12:21:40.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01ba000640 1 -- 172.21.15.144:0/2817720939 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b4012640 con 0x7f01c40b5de0 2024-09-12T12:21:40.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c41534a0 con 0x7f01c40b5de0 2024-09-12T12:21:40.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c4153740 con 0x7f01c40b5de0 2024-09-12T12:21:40.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c4072ee0 con 0x7f01c40b5de0 2024-09-12T12:21:40.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.559+0000 7f01ba000640 1 -- 172.21.15.144:0/2817720939 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f01b401a070 con 0x7f01c40b5de0 2024-09-12T12:21:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.563+0000 7f01ba000640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01a40678c0 0x7f01a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.563+0000 7f01ba000640 1 -- 172.21.15.144:0/2817720939 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f01b4085c40 con 0x7f01c40b5de0 2024-09-12T12:21:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.563+0000 7f01c1400640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01a40678c0 0x7f01a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.563+0000 7f01c1400640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01a40678c0 0x7f01a4069d80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f01b00ad000 tx=0x7f01b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.567+0000 7f01ba000640 1 -- 172.21.15.144:0/2817720939 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f01b4055f00 con 0x7f01c40b5de0 2024-09-12T12:21:40.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.759+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01c415e910 con 0x7f01c40b5de0 2024-09-12T12:21:40.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.759+0000 7f01ba000640 1 -- 172.21.15.144:0/2817720939 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7f01b405a200 con 0x7f01c40b5de0 2024-09-12T12:21:40.760 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:40.761 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:40.761 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01a40678c0 msgr2=0x7f01a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01a40678c0 0x7f01a4069d80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f01b00ad000 tx=0x7f01b0008040 comp rx=0 tx=0).stop 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c40b5de0 msgr2=0x7f01c40aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c40b5de0 0x7f01c40aeaf0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f01b4001470 tx=0x7f01b400a430 comp rx=0 tx=0).stop 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 shutdown_connections 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f01a40678c0 0x7f01a4069d80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01c415cd30 0x7f01c40b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f01c415c7b0 0x7f01c40b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 --2- 172.21.15.144:0/2817720939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01c40b5de0 0x7f01c40aeaf0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 >> 172.21.15.144:0/2817720939 conn(0x7f01c406d0d0 msgr2=0x7f01c415f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 shutdown_connections 2024-09-12T12:21:40.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.763+0000 7f01c8e00640 1 -- 172.21.15.144:0/2817720939 wait complete. 2024-09-12T12:21:40.782 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-12T12:21:40.782 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:21:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.915+0000 7f1dd1400640 1 Processor -- start 2024-09-12T12:21:40.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dd1400640 1 -- start start 2024-09-12T12:21:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dd1400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1dcc15c6f0 0x7f1dcc06e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dd1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dd1400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dcc0d1310 con 0x7f1dcc0b3500 2024-09-12T12:21:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dd1400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1dcc072e30 con 0x7f1dcc15c6f0 2024-09-12T12:21:40.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dd1400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1dcc072500 con 0x7f1dcc06e8e0 2024-09-12T12:21:40.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dc9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1dcc15c6f0 0x7f1dcc06e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dcb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dca800640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f1dcc0b3500 0x7f1dcc0b38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:45050/0 (socket says 172.21.15.144:45050) 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dc9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1dcc15c6f0 0x7f1dcc06e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33488/0 (socket says 172.21.15.144:33488) 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dca800640 1 -- 172.21.15.144:0/3673692012 learned_addr learned my addr 172.21.15.144:0/3673692012 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dc9e00640 1 -- 172.21.15.144:0/3673692012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 msgr2=0x7f1dcc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dc9e00640 1 --2- 172.21.15.144:0/3673692012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dc9e00640 1 -- 172.21.15.144:0/3673692012 >> v1:172.21.15.165:6789/0 conn(0x7f1dcc0b3500 legacy=0x7f1dcc0b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dc9e00640 1 -- 172.21.15.144:0/3673692012 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc0727e0 con 0x7f1dcc15c6f0 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dcb200640 1 --2- 172.21.15.144:0/3673692012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:40.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.919+0000 7f1dc9400640 1 -- 172.21.15.144:0/3673692012 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581440305 0 0) 0x7f1dcc0d1310 con 0x7f1dcc0b3500 2024-09-12T12:21:40.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dc9e00640 1 --2- 172.21.15.144:0/3673692012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc15c6f0 0x7f1dcc06e3a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1db80097c0 tx=0x7f1db801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9907dab4c1323fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dc9400640 1 -- 172.21.15.144:0/3673692012 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db80b0070 con 0x7f1dcc15c6f0 2024-09-12T12:21:40.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dc9400640 1 -- 172.21.15.144:0/3673692012 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db80ab600 con 0x7f1dcc15c6f0 2024-09-12T12:21:40.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dc9400640 1 -- 172.21.15.144:0/3673692012 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db80ab9d0 con 0x7f1dcc15c6f0 2024-09-12T12:21:40.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 -- 172.21.15.144:0/3673692012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc15c6f0 msgr2=0x7f1dcc06e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 --2- 172.21.15.144:0/3673692012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc15c6f0 0x7f1dcc06e3a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1db80097c0 tx=0x7f1db801c3e0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 -- 172.21.15.144:0/3673692012 shutdown_connections 2024-09-12T12:21:40.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 --2- 172.21.15.144:0/3673692012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 --2- 172.21.15.144:0/3673692012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc15c6f0 0x7f1dcc06e3a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 -- 172.21.15.144:0/3673692012 >> 172.21.15.144:0/3673692012 conn(0x7f1dcc0703a0 msgr2=0x7f1dcc0d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:40.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 -- 172.21.15.144:0/3673692012 shutdown_connections 2024-09-12T12:21:40.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 -- 172.21.15.144:0/3673692012 wait complete. 2024-09-12T12:21:40.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 Processor -- start 2024-09-12T12:21:40.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.923+0000 7f1dd1400640 1 -- start start 2024-09-12T12:21:40.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dd1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dd1400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc0b3500 0x7f1dcc1422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dd1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dcc0b1930 0x7f1dcc154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dd1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc0d00b0 con 0x7f1dcc0b1930 2024-09-12T12:21:40.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dd1400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc0cff30 con 0x7f1dcc0b3500 2024-09-12T12:21:40.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dd1400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1dcc0d0230 con 0x7f1dcc06e8e0 2024-09-12T12:21:40.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dcb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dcc0b1930 0x7f1dcc154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dcb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dcc0b1930 0x7f1dcc154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35654/0 (socket says 172.21.15.144:35654) 2024-09-12T12:21:40.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dcb200640 1 -- 172.21.15.144:0/159462942 learned_addr learned my addr 172.21.15.144:0/159462942 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:40.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dca800640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dc9e00640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc0b3500 0x7f1dcc1422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dcb200640 1 -- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 msgr2=0x7f1dcc1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dcb200640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc1542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dcb200640 1 -- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc0b3500 msgr2=0x7f1dcc1422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:40.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dcb200640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc0b3500 0x7f1dcc1422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:40.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dcb200640 1 -- 172.21.15.144:0/159462942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc0b2110 con 0x7f1dcc0b1930 2024-09-12T12:21:40.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dca800640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc1542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:40.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dc9e00640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc0b3500 0x7f1dcc1422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:40.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dcb200640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dcc0b1930 0x7f1dcc154e20 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400efc0 tx=0x7f1dc4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dc2a00640 1 -- 172.21.15.144:0/159462942 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4018030 con 0x7f1dcc0b1930 2024-09-12T12:21:40.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dc2a00640 1 -- 172.21.15.144:0/159462942 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc400cde0 con 0x7f1dcc0b1930 2024-09-12T12:21:40.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc0b23f0 con 0x7f1dcc0b1930 2024-09-12T12:21:40.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dc2a00640 1 -- 172.21.15.144:0/159462942 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4003bc0 con 0x7f1dcc0b1930 2024-09-12T12:21:40.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc0b29b0 con 0x7f1dcc0b1930 2024-09-12T12:21:40.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.927+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc0cf1e0 con 0x7f1dcc0b1930 2024-09-12T12:21:40.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.931+0000 7f1dc2a00640 1 -- 172.21.15.144:0/159462942 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1dc401b070 con 0x7f1dcc0b1930 2024-09-12T12:21:40.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.931+0000 7f1dc2a00640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dac0678f0 0x7f1dac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:40.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.931+0000 7f1dc2a00640 1 -- 172.21.15.144:0/159462942 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f1dc40867d0 con 0x7f1dcc0b1930 2024-09-12T12:21:40.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.931+0000 7f1dca800640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dac0678f0 0x7f1dac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:40.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.931+0000 7f1dca800640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dac0678f0 0x7f1dac069db0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc007fd0 tx=0x7f1dbc007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:40.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:40.935+0000 7f1dc2a00640 1 -- 172.21.15.144:0/159462942 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1dc4010040 con 0x7f1dcc0b1930 2024-09-12T12:21:41.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.147+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1dcc15b4c0 con 0x7f1dcc0b1930 2024-09-12T12:21:41.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.147+0000 7f1dc2a00640 1 -- 172.21.15.144:0/159462942 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1487 (secure 0 0 0) 0x7f1dc4056a90 con 0x7f1dcc0b1930 2024-09-12T12:21:41.150 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:41.150 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":560,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":846,"data_bytes":863953342,"bytes_used":2037596160,"bytes_avail":771056517120,"bytes_total":773094113280,"write_bytes_sec":52427136,"read_op_per_sec":0,"write_op_per_sec":52},"fsmap":{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8391}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-12T12:21:01.483116+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:21:41.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dac0678f0 msgr2=0x7f1dac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:41.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dac0678f0 0x7f1dac069db0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc007fd0 tx=0x7f1dbc007d60 comp rx=0 tx=0).stop 2024-09-12T12:21:41.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dcc0b1930 msgr2=0x7f1dcc154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:41.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dcc0b1930 0x7f1dcc154e20 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400efc0 tx=0x7f1dc4009f90 comp rx=0 tx=0).stop 2024-09-12T12:21:41.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 shutdown_connections 2024-09-12T12:21:41.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1dac0678f0 0x7f1dac069db0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:41.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dcc0b1930 0x7f1dcc154e20 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:41.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dcc0b3500 0x7f1dcc1422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:41.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 --2- 172.21.15.144:0/159462942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dcc06e8e0 0x7f1dcc1542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:41.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 >> 172.21.15.144:0/159462942 conn(0x7f1dcc0703a0 msgr2=0x7f1dcc15b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:41.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 shutdown_connections 2024-09-12T12:21:41.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:41.151+0000 7f1dd1400640 1 -- 172.21.15.144:0/159462942 wait complete. 2024-09-12T12:21:41.170 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:21:42.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:42.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176e00640 1 Processor -- start 2024-09-12T12:21:42.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176e00640 1 -- start start 2024-09-12T12:21:42.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc17015c0a0 0x7fc1700b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc17015c480 con 0x7fc1700ce950 2024-09-12T12:21:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc1701609e0 con 0x7fc17015c0a0 2024-09-12T12:21:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc17015fdd0 con 0x7fc1700b7230 2024-09-12T12:21:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc175a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc17015c0a0 0x7fc1700b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:43274/0 (socket says 172.21.15.144:43274) 2024-09-12T12:21:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176400640 1 -- 172.21.15.144:0/4144431996 learned_addr learned my addr 172.21.15.144:0/4144431996 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc175a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc17015c0a0 0x7fc1700b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33498/0 (socket says 172.21.15.144:33498) 2024-09-12T12:21:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176400640 1 -- 172.21.15.144:0/4144431996 >> v2:172.21.15.165:3300/0 conn(0x7fc17015c0a0 msgr2=0x7fc1700b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176400640 1 --2- 172.21.15.144:0/4144431996 >> v2:172.21.15.165:3300/0 conn(0x7fc17015c0a0 0x7fc1700b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc16fe00640 1 -- 172.21.15.144:0/4144431996 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937255872 0 0) 0x7fc17015c480 con 0x7fc1700ce950 2024-09-12T12:21:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176400640 1 -- 172.21.15.144:0/4144431996 >> v1:172.21.15.165:6789/0 conn(0x7fc1700ce950 legacy=0x7fc1700b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.359+0000 7fc176400640 1 -- 172.21.15.144:0/4144431996 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1701600b0 con 0x7fc1700b7230 2024-09-12T12:21:42.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176400640 1 --2- 172.21.15.144:0/4144431996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc168009e50 tx=0x7fc16801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f500bbce3256cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc16fe00640 1 -- 172.21.15.144:0/4144431996 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1680a5750 con 0x7fc1700b7230 2024-09-12T12:21:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc16fe00640 1 -- 172.21.15.144:0/4144431996 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1680a58f0 con 0x7fc1700b7230 2024-09-12T12:21:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc16fe00640 1 -- 172.21.15.144:0/4144431996 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1680a5cc0 con 0x7fc1700b7230 2024-09-12T12:21:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176e00640 1 -- 172.21.15.144:0/4144431996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 msgr2=0x7fc17015d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176e00640 1 --2- 172.21.15.144:0/4144431996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc168009e50 tx=0x7fc16801c9a0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176e00640 1 -- 172.21.15.144:0/4144431996 shutdown_connections 2024-09-12T12:21:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176e00640 1 --2- 172.21.15.144:0/4144431996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015d0c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176e00640 1 --2- 172.21.15.144:0/4144431996 >> v2:172.21.15.165:3300/0 conn(0x7fc17015c0a0 0x7fc1700b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176e00640 1 -- 172.21.15.144:0/4144431996 >> 172.21.15.144:0/4144431996 conn(0x7fc1700d2280 msgr2=0x7fc1700d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176e00640 1 -- 172.21.15.144:0/4144431996 shutdown_connections 2024-09-12T12:21:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176e00640 1 -- 172.21.15.144:0/4144431996 wait complete. 2024-09-12T12:21:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.363+0000 7fc176e00640 1 Processor -- start 2024-09-12T12:21:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 -- start start 2024-09-12T12:21:42.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1700ce950 0x7fc170148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc17015c0a0 0x7fc170146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc170073c70 con 0x7fc1700ce950 2024-09-12T12:21:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc170073af0 con 0x7fc17015c0a0 2024-09-12T12:21:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc170073df0 con 0x7fc1700b7230 2024-09-12T12:21:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1700ce950 0x7fc170148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1700ce950 0x7fc170148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35666/0 (socket says 172.21.15.144:35666) 2024-09-12T12:21:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175000640 1 -- 172.21.15.144:0/2880475900 learned_addr learned my addr 172.21.15.144:0/2880475900 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175a00640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176400640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc17015c0a0 0x7fc170146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175000640 1 -- 172.21.15.144:0/2880475900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 msgr2=0x7fc17015a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175000640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175000640 1 -- 172.21.15.144:0/2880475900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc17015c0a0 msgr2=0x7fc170146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175000640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc17015c0a0 0x7fc170146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175000640 1 -- 172.21.15.144:0/2880475900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1701496f0 con 0x7fc1700ce950 2024-09-12T12:21:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc175000640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1700ce950 0x7fc170148ca0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c520 tx=0x7fc15c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc16d600640 1 -- 172.21.15.144:0/2880475900 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c017070 con 0x7fc1700ce950 2024-09-12T12:21:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc16d600640 1 -- 172.21.15.144:0/2880475900 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c003600 con 0x7fc1700ce950 2024-09-12T12:21:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc16d600640 1 -- 172.21.15.144:0/2880475900 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0039f0 con 0x7fc1700ce950 2024-09-12T12:21:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1701499d0 con 0x7fc1700ce950 2024-09-12T12:21:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17014bd80 con 0x7fc1700ce950 2024-09-12T12:21:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.367+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17015d0c0 con 0x7fc1700ce950 2024-09-12T12:21:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.371+0000 7fc16d600640 1 -- 172.21.15.144:0/2880475900 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc15c01a070 con 0x7fc1700ce950 2024-09-12T12:21:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.371+0000 7fc16d600640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1500678c0 0x7fc150069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.371+0000 7fc16d600640 1 -- 172.21.15.144:0/2880475900 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fc15c085130 con 0x7fc1700ce950 2024-09-12T12:21:42.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.371+0000 7fc175a00640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1500678c0 0x7fc150069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.371+0000 7fc175a00640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1500678c0 0x7fc150069d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc164009ac0 tx=0x7fc164009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:42.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.375+0000 7fc16d600640 1 -- 172.21.15.144:0/2880475900 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc15c055500 con 0x7fc1700ce950 2024-09-12T12:21:42.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1700b1c60 con 0x7fc1700ce950 2024-09-12T12:21:42.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc16d600640 1 -- 172.21.15.144:0/2880475900 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7fc15c059800 con 0x7fc1700ce950 2024-09-12T12:21:42.567 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:42.567 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:42.567 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1500678c0 msgr2=0x7fc150069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1500678c0 0x7fc150069d80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc164009ac0 tx=0x7fc164009190 comp rx=0 tx=0).stop 2024-09-12T12:21:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1700ce950 msgr2=0x7fc170148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1700ce950 0x7fc170148ca0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c520 tx=0x7fc15c00c9e0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 shutdown_connections 2024-09-12T12:21:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1500678c0 0x7fc150069d80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc17015c0a0 0x7fc170146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1700ce950 0x7fc170148ca0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 --2- 172.21.15.144:0/2880475900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1700b7230 0x7fc17015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 >> 172.21.15.144:0/2880475900 conn(0x7fc1700d2280 msgr2=0x7fc170151750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:42.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 shutdown_connections 2024-09-12T12:21:42.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.567+0000 7fc176e00640 1 -- 172.21.15.144:0/2880475900 wait complete. 2024-09-12T12:21:42.588 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-12T12:21:42.588 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:21:42.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c7f000640 1 Processor -- start 2024-09-12T12:21:42.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c7f000640 1 -- start start 2024-09-12T12:21:42.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c7f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c2b0 0x7f8c7806da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c7f000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c780d0ee0 0x7f8c780cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c7f000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7806e360 con 0x7f8c7815c690 2024-09-12T12:21:42.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c7f000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8c780cd830 con 0x7f8c780d0ee0 2024-09-12T12:21:42.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c7f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7806e640 con 0x7f8c7815c2b0 2024-09-12T12:21:42.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c77400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c780d0ee0 0x7f8c780cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c77400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c780d0ee0 0x7f8c780cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35680/0 (socket says 172.21.15.144:35680) 2024-09-12T12:21:42.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c77400640 1 -- 172.21.15.144:0/2498964872 learned_addr learned my addr 172.21.15.144:0/2498964872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:42.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c77e00640 1 --2- 172.21.15.144:0/2498964872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c2b0 0x7f8c7806da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c77400640 1 -- 172.21.15.144:0/2498964872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c2b0 msgr2=0x7f8c7806da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:42.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c77400640 1 --2- 172.21.15.144:0/2498964872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c2b0 0x7f8c7806da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c77400640 1 -- 172.21.15.144:0/2498964872 >> v1:172.21.15.165:6789/0 conn(0x7f8c7815c690 legacy=0x7f8c7815fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c77400640 1 -- 172.21.15.144:0/2498964872 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c780cd4c0 con 0x7f8c780d0ee0 2024-09-12T12:21:42.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.723+0000 7f8c77e00640 1 --2- 172.21.15.144:0/2498964872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c2b0 0x7f8c7806da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:42.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c77400640 1 --2- 172.21.15.144:0/2498964872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c780d0ee0 0x7f8c780cf1a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009870 tx=0x7f8c6401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b29f8a5b460eaa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:42.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c76a00640 1 -- 172.21.15.144:0/2498964872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c640ab5f0 con 0x7f8c780d0ee0 2024-09-12T12:21:42.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c76a00640 1 -- 172.21.15.144:0/2498964872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c640b0070 con 0x7f8c780d0ee0 2024-09-12T12:21:42.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c76a00640 1 -- 172.21.15.144:0/2498964872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c640ab9b0 con 0x7f8c780d0ee0 2024-09-12T12:21:42.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c7f000640 1 -- 172.21.15.144:0/2498964872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c780d0ee0 msgr2=0x7f8c780cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c7f000640 1 --2- 172.21.15.144:0/2498964872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c780d0ee0 0x7f8c780cf1a0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009870 tx=0x7f8c6401c560 comp rx=0 tx=0).stop 2024-09-12T12:21:42.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c7f000640 1 -- 172.21.15.144:0/2498964872 shutdown_connections 2024-09-12T12:21:42.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c7f000640 1 --2- 172.21.15.144:0/2498964872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c780d0ee0 0x7f8c780cf1a0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c7f000640 1 --2- 172.21.15.144:0/2498964872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c2b0 0x7f8c7806da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c7f000640 1 -- 172.21.15.144:0/2498964872 >> 172.21.15.144:0/2498964872 conn(0x7f8c78067e00 msgr2=0x7f8c780d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:42.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c7f000640 1 -- 172.21.15.144:0/2498964872 shutdown_connections 2024-09-12T12:21:42.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.727+0000 7f8c7f000640 1 -- 172.21.15.144:0/2498964872 wait complete. 2024-09-12T12:21:42.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 Processor -- start 2024-09-12T12:21:42.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 -- start start 2024-09-12T12:21:42.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c780d0ee0 0x7f8c781419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7815c2b0 0x7f8c78150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c690 0x7f8c78150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8c781693f0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78169270 con 0x7f8c780d0ee0 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8c78169570 con 0x7f8c7815c690 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7815c2b0 0x7f8c78150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7815c2b0 0x7f8c78150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35696/0 (socket says 172.21.15.144:35696) 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77400640 1 -- 172.21.15.144:0/465547376 learned_addr learned my addr 172.21.15.144:0/465547376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7d000640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c690 0x7f8c78150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77e00640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c780d0ee0 0x7f8c781419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77400640 1 -- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c690 msgr2=0x7f8c78150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77400640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c690 0x7f8c78150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77400640 1 -- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c780d0ee0 msgr2=0x7f8c781419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77400640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c780d0ee0 0x7f8c781419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77400640 1 -- 172.21.15.144:0/465547376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c781458f0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7d000640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c690 0x7f8c78150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77e00640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c780d0ee0 0x7f8c781419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c77400640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7815c2b0 0x7f8c78150a40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8c640ad040 tx=0x7f8c6401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c6fe00640 1 -- 172.21.15.144:0/465547376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c640be5f0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c6fe00640 1 -- 172.21.15.144:0/465547376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c640be7b0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c6fe00640 1 -- 172.21.15.144:0/465547376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c640beba0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c78145bd0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c78146190 con 0x7f8c7815c2b0 2024-09-12T12:21:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.731+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c780cf1a0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.735+0000 7f8c6fe00640 1 -- 172.21.15.144:0/465547376 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c640b43f0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.735+0000 7f8c6fe00640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c580678f0 0x7f8c58069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:42.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.735+0000 7f8c6fe00640 1 -- 172.21.15.144:0/465547376 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f8c64120450 con 0x7f8c7815c2b0 2024-09-12T12:21:42.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.735+0000 7f8c77e00640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c580678f0 0x7f8c58069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:42.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.735+0000 7f8c77e00640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c580678f0 0x7f8c58069db0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009970 tx=0x7f8c68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:42.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.739+0000 7f8c6fe00640 1 -- 172.21.15.144:0/465547376 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c64016150 con 0x7f8c7815c2b0 2024-09-12T12:21:42.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8c780732e0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c6fe00640 1 -- 172.21.15.144:0/465547376 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f8c640f08c0 con 0x7f8c7815c2b0 2024-09-12T12:21:42.956 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:42.957 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":562,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1033,"data_bytes":1060582496,"bytes_used":2465521664,"bytes_avail":770628591616,"bytes_total":773094113280,"write_bytes_sec":65229998,"read_op_per_sec":0,"write_op_per_sec":65},"fsmap":{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8391}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-12T12:21:01.483116+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:21:42.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c580678f0 msgr2=0x7f8c58069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c580678f0 0x7f8c58069db0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009970 tx=0x7f8c68008040 comp rx=0 tx=0).stop 2024-09-12T12:21:42.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7815c2b0 msgr2=0x7f8c78150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:42.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7815c2b0 0x7f8c78150a40 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8c640ad040 tx=0x7f8c6401ada0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 shutdown_connections 2024-09-12T12:21:42.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c580678f0 0x7f8c58069db0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c7815c690 0x7f8c78150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7815c2b0 0x7f8c78150a40 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 --2- 172.21.15.144:0/465547376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c780d0ee0 0x7f8c781419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:42.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 >> 172.21.15.144:0/465547376 conn(0x7f8c78067e00 msgr2=0x7f8c78151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:42.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 shutdown_connections 2024-09-12T12:21:42.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:42.955+0000 7f8c7f000640 1 -- 172.21.15.144:0/465547376 wait complete. 2024-09-12T12:21:42.978 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:21:43.979 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.135+0000 7fabfb600640 1 Processor -- start 2024-09-12T12:21:44.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.135+0000 7fabfb600640 1 -- start start 2024-09-12T12:21:44.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabfb600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fabf415f320 0x7fabf40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabfb600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf40b3aa0 con 0x7fabf40b3590 2024-09-12T12:21:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabfb600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf40afc10 con 0x7fabf40b42d0 2024-09-12T12:21:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabfb600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fabf40cdeb0 con 0x7fabf415f320 2024-09-12T12:21:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf8c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fabf40b3590 0x7fabf415ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40628/0 (socket says 172.21.15.144:40628) 2024-09-12T12:21:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf8c00640 1 -- 172.21.15.144:0/328871633 learned_addr learned my addr 172.21.15.144:0/328871633 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:44.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf3e00640 1 --2- 172.21.15.144:0/328871633 >> v2:172.21.15.165:3300/0 conn(0x7fabf415f320 0x7fabf40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf3400640 1 -- 172.21.15.144:0/328871633 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164811383 0 0) 0x7fabf40b3aa0 con 0x7fabf40b3590 2024-09-12T12:21:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf3400640 1 -- 172.21.15.144:0/328871633 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabd8003530 con 0x7fabf40b3590 2024-09-12T12:21:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf3400640 1 -- 172.21.15.144:0/328871633 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386271456 0 0) 0x7fabf40afc10 con 0x7fabf40b42d0 2024-09-12T12:21:44.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf3400640 1 -- 172.21.15.144:0/328871633 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabf40b3aa0 con 0x7fabf40b42d0 2024-09-12T12:21:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf3400640 1 -- 172.21.15.144:0/328871633 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2098423840 0 0) 0x7fabd8003530 con 0x7fabf40b3590 2024-09-12T12:21:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf3e00640 1 -- 172.21.15.144:0/328871633 >> v1:172.21.15.165:6789/0 conn(0x7fabf40b42d0 legacy=0x7fabf40b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf3e00640 1 -- 172.21.15.144:0/328871633 >> v1:172.21.15.144:6789/0 conn(0x7fabf40b3590 legacy=0x7fabf415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.139+0000 7fabf3e00640 1 -- 172.21.15.144:0/328871633 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf40afef0 con 0x7fabf415f320 2024-09-12T12:21:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabf3e00640 1 --2- 172.21.15.144:0/328871633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabf415f320 0x7fabf40ccfe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fabe00097c0 tx=0x7fabe001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98981d4b72f88264 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabf3400640 1 -- 172.21.15.144:0/328871633 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00b0070 con 0x7fabf415f320 2024-09-12T12:21:44.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabf3400640 1 -- 172.21.15.144:0/328871633 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe00a4e50 con 0x7fabf415f320 2024-09-12T12:21:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabf3400640 1 -- 172.21.15.144:0/328871633 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4001680 con 0x7fabf415f320 2024-09-12T12:21:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabfb600640 1 -- 172.21.15.144:0/328871633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabf415f320 msgr2=0x7fabf40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabfb600640 1 --2- 172.21.15.144:0/328871633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabf415f320 0x7fabf40ccfe0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fabe00097c0 tx=0x7fabe001c330 comp rx=0 tx=0).stop 2024-09-12T12:21:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabfb600640 1 -- 172.21.15.144:0/328871633 shutdown_connections 2024-09-12T12:21:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabfb600640 1 --2- 172.21.15.144:0/328871633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabf415f320 0x7fabf40ccfe0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabfb600640 1 -- 172.21.15.144:0/328871633 >> 172.21.15.144:0/328871633 conn(0x7fabf406d0d0 msgr2=0x7fabf406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabfb600640 1 -- 172.21.15.144:0/328871633 shutdown_connections 2024-09-12T12:21:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabfb600640 1 -- 172.21.15.144:0/328871633 wait complete. 2024-09-12T12:21:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabfb600640 1 Processor -- start 2024-09-12T12:21:44.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.143+0000 7fabfb600640 1 -- start start 2024-09-12T12:21:44.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabfb600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabf40b3590 0x7fabf414f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabfb600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabf40b42d0 0x7fabf4156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabfb600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabf415f320 0x7fabf4152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabfb600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fabf40b1980 con 0x7fabf40b3590 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabfb600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fabf40b1800 con 0x7fabf40b42d0 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabfb600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fabf4169700 con 0x7fabf415f320 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabf40b3590 0x7fabf414f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabf40b3590 0x7fabf414f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35712/0 (socket says 172.21.15.144:35712) 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf8c00640 1 -- 172.21.15.144:0/1412439724 learned_addr learned my addr 172.21.15.144:0/1412439724 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf3e00640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabf40b42d0 0x7fabf4156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf9600640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabf415f320 0x7fabf4152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf8c00640 1 -- 172.21.15.144:0/1412439724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabf415f320 msgr2=0x7fabf4152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf8c00640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabf415f320 0x7fabf4152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf8c00640 1 -- 172.21.15.144:0/1412439724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabf40b42d0 msgr2=0x7fabf4156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf8c00640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabf40b42d0 0x7fabf4156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf8c00640 1 -- 172.21.15.144:0/1412439724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf40720f0 con 0x7fabf40b3590 2024-09-12T12:21:44.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf8c00640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabf40b3590 0x7fabf414f040 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fabe400c760 tx=0x7fabe400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:44.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf0c00640 1 -- 172.21.15.144:0/1412439724 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4017070 con 0x7fabf40b3590 2024-09-12T12:21:44.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf0c00640 1 -- 172.21.15.144:0/1412439724 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe4005b00 con 0x7fabf40b3590 2024-09-12T12:21:44.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf40723d0 con 0x7fabf40b3590 2024-09-12T12:21:44.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabf0c00640 1 -- 172.21.15.144:0/1412439724 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4007070 con 0x7fabf40b3590 2024-09-12T12:21:44.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf414f580 con 0x7fabf40b3590 2024-09-12T12:21:44.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.147+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf40ccfe0 con 0x7fabf40b3590 2024-09-12T12:21:44.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.151+0000 7fabf0c00640 1 -- 172.21.15.144:0/1412439724 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fabe401a070 con 0x7fabf40b3590 2024-09-12T12:21:44.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.151+0000 7fabf0c00640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fabd40678c0 0x7fabd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.151+0000 7fabf0c00640 1 -- 172.21.15.144:0/1412439724 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fabe40852f0 con 0x7fabf40b3590 2024-09-12T12:21:44.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.151+0000 7fabf3e00640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fabd40678c0 0x7fabd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.151+0000 7fabf3e00640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fabd40678c0 0x7fabd4069d80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ad000 tx=0x7fabe0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:44.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.155+0000 7fabf0c00640 1 -- 172.21.15.144:0/1412439724 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fabe40555b0 con 0x7fabf40b3590 2024-09-12T12:21:44.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.343+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabf4073fc0 con 0x7fabf40b3590 2024-09-12T12:21:44.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.343+0000 7fabf0c00640 1 -- 172.21.15.144:0/1412439724 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7fabe40598b0 con 0x7fabf40b3590 2024-09-12T12:21:44.345 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:44.345 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:44.345 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fabd40678c0 msgr2=0x7fabd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fabd40678c0 0x7fabd4069d80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ad000 tx=0x7fabe0008040 comp rx=0 tx=0).stop 2024-09-12T12:21:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabf40b3590 msgr2=0x7fabf414f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabf40b3590 0x7fabf414f040 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fabe400c760 tx=0x7fabe400cc20 comp rx=0 tx=0).stop 2024-09-12T12:21:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 shutdown_connections 2024-09-12T12:21:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fabd40678c0 0x7fabd4069d80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabf415f320 0x7fabf4152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabf40b42d0 0x7fabf4156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 --2- 172.21.15.144:0/1412439724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabf40b3590 0x7fabf414f040 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 >> 172.21.15.144:0/1412439724 conn(0x7fabf406d0d0 msgr2=0x7fabf40ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:44.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 shutdown_connections 2024-09-12T12:21:44.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.347+0000 7fabfb600640 1 -- 172.21.15.144:0/1412439724 wait complete. 2024-09-12T12:21:44.366 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-12T12:21:44.367 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:21:44.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.503+0000 7fa5bb200640 1 Processor -- start 2024-09-12T12:21:44.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.503+0000 7fa5bb200640 1 -- start start 2024-09-12T12:21:44.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.503+0000 7fa5bb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b415b2c0 0x7fa5b40b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.503+0000 7fa5bb200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa5b406e180 0x7fa5b406e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.503+0000 7fa5bb200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b40ccec0 con 0x7fa5b40b3500 2024-09-12T12:21:44.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.503+0000 7fa5bb200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa5b406eb10 con 0x7fa5b406e180 2024-09-12T12:21:44.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.503+0000 7fa5bb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b40cd1a0 con 0x7fa5b415b2c0 2024-09-12T12:21:44.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b9200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa5b406e180 0x7fa5b406e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b415b2c0 0x7fa5b40b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b9200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa5b406e180 0x7fa5b406e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33546/0 (socket says 172.21.15.144:33546) 2024-09-12T12:21:44.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b9200640 1 -- 172.21.15.144:0/2483627568 learned_addr learned my addr 172.21.15.144:0/2483627568 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:44.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b3e00640 1 -- 172.21.15.144:0/2483627568 >> v2:172.21.15.165:3300/0 conn(0x7fa5b406e180 msgr2=0x7fa5b406e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:44.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b3e00640 1 --2- 172.21.15.144:0/2483627568 >> v2:172.21.15.165:3300/0 conn(0x7fa5b406e180 0x7fa5b406e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b3e00640 1 -- 172.21.15.144:0/2483627568 >> v1:172.21.15.165:6789/0 conn(0x7fa5b40b3500 legacy=0x7fa5b415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b3e00640 1 -- 172.21.15.144:0/2483627568 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b40cd480 con 0x7fa5b415b2c0 2024-09-12T12:21:44.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b9200640 1 --2- 172.21.15.144:0/2483627568 >> v2:172.21.15.165:3300/0 conn(0x7fa5b406e180 0x7fa5b406e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:44.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b2a00640 1 -- 172.21.15.144:0/2483627568 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957515256 0 0) 0x7fa5b40ccec0 con 0x7fa5b40b3500 2024-09-12T12:21:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.507+0000 7fa5b3e00640 1 --2- 172.21.15.144:0/2483627568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b415b2c0 0x7fa5b40b43d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=337fecb15919f7ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5b2a00640 1 -- 172.21.15.144:0/2483627568 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40a7070 con 0x7fa5b415b2c0 2024-09-12T12:21:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5b2a00640 1 -- 172.21.15.144:0/2483627568 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a40b0070 con 0x7fa5b415b2c0 2024-09-12T12:21:44.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5b2a00640 1 -- 172.21.15.144:0/2483627568 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40ab890 con 0x7fa5b415b2c0 2024-09-12T12:21:44.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 -- 172.21.15.144:0/2483627568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b415b2c0 msgr2=0x7fa5b40b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 --2- 172.21.15.144:0/2483627568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b415b2c0 0x7fa5b40b43d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a401c470 comp rx=0 tx=0).stop 2024-09-12T12:21:44.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 -- 172.21.15.144:0/2483627568 shutdown_connections 2024-09-12T12:21:44.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 --2- 172.21.15.144:0/2483627568 >> v2:172.21.15.165:3300/0 conn(0x7fa5b406e180 0x7fa5b406e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 --2- 172.21.15.144:0/2483627568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b415b2c0 0x7fa5b40b43d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 -- 172.21.15.144:0/2483627568 >> 172.21.15.144:0/2483627568 conn(0x7fa5b4067e00 msgr2=0x7fa5b40d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:44.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 -- 172.21.15.144:0/2483627568 shutdown_connections 2024-09-12T12:21:44.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 -- 172.21.15.144:0/2483627568 wait complete. 2024-09-12T12:21:44.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 Processor -- start 2024-09-12T12:21:44.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 -- start start 2024-09-12T12:21:44.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b406e180 0x7fa5b4153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5b40b3500 0x7fa5b415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5b415b2c0 0x7fa5b4145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b40ce8f0 con 0x7fa5b40b3500 2024-09-12T12:21:44.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b40ce770 con 0x7fa5b415b2c0 2024-09-12T12:21:44.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5bb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b40cea70 con 0x7fa5b406e180 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5b40b3500 0x7fa5b415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5b3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5b40b3500 0x7fa5b415c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35716/0 (socket says 172.21.15.144:35716) 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.511+0000 7fa5b3400640 1 -- 172.21.15.144:0/370560971 learned_addr learned my addr 172.21.15.144:0/370560971 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b3e00640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b406e180 0x7fa5b4153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b9200640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5b415b2c0 0x7fa5b4145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b3400640 1 -- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b406e180 msgr2=0x7fa5b4153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b3400640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b406e180 0x7fa5b4153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b3400640 1 -- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5b415b2c0 msgr2=0x7fa5b4145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b3400640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5b415b2c0 0x7fa5b4145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b3400640 1 -- 172.21.15.144:0/370560971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b41537c0 con 0x7fa5b40b3500 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b3e00640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b406e180 0x7fa5b4153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:44.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b9200640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5b415b2c0 0x7fa5b4145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:44.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b3400640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5b40b3500 0x7fa5b415c9e0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000c550 tx=0x7fa5a000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:44.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5abe00640 1 -- 172.21.15.144:0/370560971 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0017070 con 0x7fa5b40b3500 2024-09-12T12:21:44.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5abe00640 1 -- 172.21.15.144:0/370560971 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a0003600 con 0x7fa5b40b3500 2024-09-12T12:21:44.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5abe00640 1 -- 172.21.15.144:0/370560971 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00039f0 con 0x7fa5b40b3500 2024-09-12T12:21:44.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b4153aa0 con 0x7fa5b40b3500 2024-09-12T12:21:44.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b4154060 con 0x7fa5b40b3500 2024-09-12T12:21:44.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b406e5d0 con 0x7fa5b40b3500 2024-09-12T12:21:44.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5abe00640 1 -- 172.21.15.144:0/370560971 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5a001a070 con 0x7fa5b40b3500 2024-09-12T12:21:44.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5abe00640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5940678c0 0x7fa594069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:44.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5abe00640 1 -- 172.21.15.144:0/370560971 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fa5a0085280 con 0x7fa5b40b3500 2024-09-12T12:21:44.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.515+0000 7fa5b3e00640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5940678c0 0x7fa594069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:44.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.519+0000 7fa5b3e00640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5940678c0 0x7fa594069d80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40af000 tx=0x7fa5a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:44.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.519+0000 7fa5abe00640 1 -- 172.21.15.144:0/370560971 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa5a0055c20 con 0x7fa5b40b3500 2024-09-12T12:21:44.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.735+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa5b4158cd0 con 0x7fa5b40b3500 2024-09-12T12:21:44.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.735+0000 7fa5abe00640 1 -- 172.21.15.144:0/370560971 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7fa5a0055520 con 0x7fa5b40b3500 2024-09-12T12:21:44.737 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:44.738 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":564,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1033,"data_bytes":1060582496,"bytes_used":2465521664,"bytes_avail":770628591616,"bytes_total":773094113280,"write_bytes_sec":46135122,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8391}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-12T12:21:01.483116+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:21:44.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5940678c0 msgr2=0x7fa594069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5940678c0 0x7fa594069d80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40af000 tx=0x7fa5a4008040 comp rx=0 tx=0).stop 2024-09-12T12:21:44.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5b40b3500 msgr2=0x7fa5b415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:44.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5b40b3500 0x7fa5b415c9e0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000c550 tx=0x7fa5a000ca10 comp rx=0 tx=0).stop 2024-09-12T12:21:44.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 shutdown_connections 2024-09-12T12:21:44.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5940678c0 0x7fa594069d80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5b415b2c0 0x7fa5b4145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5b40b3500 0x7fa5b415c9e0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 --2- 172.21.15.144:0/370560971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5b406e180 0x7fa5b4153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:44.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 >> 172.21.15.144:0/370560971 conn(0x7fa5b4067e00 msgr2=0x7fa5b406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:44.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 shutdown_connections 2024-09-12T12:21:44.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:44.739+0000 7fa5bb200640 1 -- 172.21.15.144:0/370560971 wait complete. 2024-09-12T12:21:44.758 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:21:45.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:45.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce7200640 1 Processor -- start 2024-09-12T12:21:45.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce7200640 1 -- start start 2024-09-12T12:21:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8ce80d06a0 0x7f8ce8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:45.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce80cd1d0 con 0x7f8ce815b160 2024-09-12T12:21:45.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce7200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce80cd4a0 con 0x7f8ce8073bd0 2024-09-12T12:21:45.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce815b540 con 0x7f8ce80d06a0 2024-09-12T12:21:45.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8ce80d06a0 0x7f8ce8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:45.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8ce815b160 0x7f8ce80ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40638/0 (socket says 172.21.15.144:40638) 2024-09-12T12:21:45.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce5e00640 1 -- 172.21.15.144:0/2369482121 learned_addr learned my addr 172.21.15.144:0/2369482121 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:45.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce6800640 1 -- 172.21.15.144:0/2369482121 >> v1:172.21.15.165:6789/0 conn(0x7f8ce8073bd0 legacy=0x7f8ce80cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:45.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce6800640 1 -- 172.21.15.144:0/2369482121 >> v1:172.21.15.144:6789/0 conn(0x7f8ce815b160 legacy=0x7f8ce80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:45.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce6800640 1 -- 172.21.15.144:0/2369482121 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce80cd780 con 0x7f8ce80d06a0 2024-09-12T12:21:45.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.899+0000 7f8ce4a00640 1 -- 172.21.15.144:0/2369482121 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758356587 0 0) 0x7f8ce80cd1d0 con 0x7f8ce815b160 2024-09-12T12:21:45.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce6800640 1 --2- 172.21.15.144:0/2369482121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce80d06a0 0x7f8ce8070ee0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097c0 tx=0x7f8ce001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bd795311dc4e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:45.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce4a00640 1 -- 172.21.15.144:0/2369482121 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00b0070 con 0x7f8ce80d06a0 2024-09-12T12:21:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce4a00640 1 -- 172.21.15.144:0/2369482121 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce00ab600 con 0x7f8ce80d06a0 2024-09-12T12:21:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce4a00640 1 -- 172.21.15.144:0/2369482121 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00ab9d0 con 0x7f8ce80d06a0 2024-09-12T12:21:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce7200640 1 -- 172.21.15.144:0/2369482121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce80d06a0 msgr2=0x7f8ce8070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce7200640 1 --2- 172.21.15.144:0/2369482121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce80d06a0 0x7f8ce8070ee0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097c0 tx=0x7f8ce001c3d0 comp rx=0 tx=0).stop 2024-09-12T12:21:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce7200640 1 -- 172.21.15.144:0/2369482121 shutdown_connections 2024-09-12T12:21:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce7200640 1 --2- 172.21.15.144:0/2369482121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce80d06a0 0x7f8ce8070ee0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce7200640 1 -- 172.21.15.144:0/2369482121 >> 172.21.15.144:0/2369482121 conn(0x7f8ce806bc10 msgr2=0x7f8ce806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce7200640 1 -- 172.21.15.144:0/2369482121 shutdown_connections 2024-09-12T12:21:45.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.903+0000 7f8ce7200640 1 -- 172.21.15.144:0/2369482121 wait complete. 2024-09-12T12:21:45.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 Processor -- start 2024-09-12T12:21:45.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 -- start start 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ce8073bd0 0x7f8ce80b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce80d06a0 0x7f8ce815a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce815b160 0x7f8ce80ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce80b4560 con 0x7f8ce815b160 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce80b43e0 con 0x7f8ce80d06a0 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce80b46e0 con 0x7f8ce8073bd0 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce815b160 0x7f8ce80ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce815b160 0x7f8ce80ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35732/0 (socket says 172.21.15.144:35732) 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce6800640 1 -- 172.21.15.144:0/4117848183 learned_addr learned my addr 172.21.15.144:0/4117848183 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:45.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce5e00640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ce8073bd0 0x7f8ce80b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:45.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce5400640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce80d06a0 0x7f8ce815a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce6800640 1 -- 172.21.15.144:0/4117848183 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ce8073bd0 msgr2=0x7f8ce80b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce6800640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ce8073bd0 0x7f8ce80b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce6800640 1 -- 172.21.15.144:0/4117848183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce80d06a0 msgr2=0x7f8ce815a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce6800640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce80d06a0 0x7f8ce815a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce6800640 1 -- 172.21.15.144:0/4117848183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce815a790 con 0x7f8ce815b160 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce5400640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce80d06a0 0x7f8ce815a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce6800640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce815b160 0x7f8ce80ae890 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ae040 tx=0x7f8ce001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8cde000640 1 -- 172.21.15.144:0/4117848183 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00b0040 con 0x7f8ce815b160 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8cde000640 1 -- 172.21.15.144:0/4117848183 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce0004030 con 0x7f8ce815b160 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce80b2110 con 0x7f8ce815b160 2024-09-12T12:21:45.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8cde000640 1 -- 172.21.15.144:0/4117848183 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00043e0 con 0x7f8ce815b160 2024-09-12T12:21:45.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.907+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce80b26d0 con 0x7f8ce815b160 2024-09-12T12:21:45.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.911+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce8070ee0 con 0x7f8ce815b160 2024-09-12T12:21:45.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.911+0000 7f8cde000640 1 -- 172.21.15.144:0/4117848183 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ce0003620 con 0x7f8ce815b160 2024-09-12T12:21:45.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.911+0000 7f8cde000640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8cc80678f0 0x7f8cc8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:45.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.911+0000 7f8cde000640 1 -- 172.21.15.144:0/4117848183 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f8ce01209d0 con 0x7f8ce815b160 2024-09-12T12:21:45.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.911+0000 7f8ce5e00640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8cc80678f0 0x7f8cc8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:45.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.911+0000 7f8ce5e00640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8cc80678f0 0x7f8cc8069db0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80012f0 tx=0x7f8cd8001690 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:45.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:45.915+0000 7f8cde000640 1 -- 172.21.15.144:0/4117848183 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8ce815a790 con 0x7f8ce815b160 2024-09-12T12:21:46.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.107+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ce80cee50 con 0x7f8ce815b160 2024-09-12T12:21:46.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.107+0000 7f8cde000640 1 -- 172.21.15.144:0/4117848183 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7f8ce0016050 con 0x7f8ce815b160 2024-09-12T12:21:46.108 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:46.109 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:46.109 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8cc80678f0 msgr2=0x7f8cc8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8cc80678f0 0x7f8cc8069db0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80012f0 tx=0x7f8cd8001690 comp rx=0 tx=0).stop 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce815b160 msgr2=0x7f8ce80ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce815b160 0x7f8ce80ae890 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ae040 tx=0x7f8ce001ac10 comp rx=0 tx=0).stop 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 shutdown_connections 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8cc80678f0 0x7f8cc8069db0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ce815b160 0x7f8ce80ae890 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce80d06a0 0x7f8ce815a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 --2- 172.21.15.144:0/4117848183 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ce8073bd0 0x7f8ce80b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 >> 172.21.15.144:0/4117848183 conn(0x7f8ce806bc10 msgr2=0x7f8ce815b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 shutdown_connections 2024-09-12T12:21:46.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.111+0000 7f8ce7200640 1 -- 172.21.15.144:0/4117848183 wait complete. 2024-09-12T12:21:46.130 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-12T12:21:46.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:21:46.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.263+0000 7fc104600640 1 Processor -- start 2024-09-12T12:21:46.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.263+0000 7fc104600640 1 -- start start 2024-09-12T12:21:46.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc104600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc161a00 0x7fc0fc0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc104600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc0fc0ccdf0 0x7fc0fc0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc104600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0fc0d1300 con 0x7fc0fc0d0ee0 2024-09-12T12:21:46.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc104600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc0fc0b41e0 con 0x7fc0fc0ccdf0 2024-09-12T12:21:46.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc104600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc0fc0d0200 con 0x7fc0fc161a00 2024-09-12T12:21:46.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc101200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc0fc0d0ee0 0x7fc0fc0b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40642/0 (socket says 172.21.15.144:40642) 2024-09-12T12:21:46.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc101200640 1 -- 172.21.15.144:0/4255358145 learned_addr learned my addr 172.21.15.144:0/4255358145 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:46.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc101c00640 1 --2- 172.21.15.144:0/4255358145 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc161a00 0x7fc0fc0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc102600640 1 --2- 172.21.15.144:0/4255358145 >> v2:172.21.15.165:3300/0 conn(0x7fc0fc0ccdf0 0x7fc0fc0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc0fbe00640 1 -- 172.21.15.144:0/4255358145 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798952418 0 0) 0x7fc0fc0d1300 con 0x7fc0fc0d0ee0 2024-09-12T12:21:46.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc0fbe00640 1 -- 172.21.15.144:0/4255358145 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0e4003530 con 0x7fc0fc0d0ee0 2024-09-12T12:21:46.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc102600640 1 -- 172.21.15.144:0/4255358145 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc161a00 msgr2=0x7fc0fc0cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc102600640 1 --2- 172.21.15.144:0/4255358145 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc161a00 0x7fc0fc0cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc102600640 1 -- 172.21.15.144:0/4255358145 >> v1:172.21.15.144:6789/0 conn(0x7fc0fc0d0ee0 legacy=0x7fc0fc0b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc102600640 1 -- 172.21.15.144:0/4255358145 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc06d1a0 con 0x7fc0fc0ccdf0 2024-09-12T12:21:46.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.267+0000 7fc101c00640 1 --2- 172.21.15.144:0/4255358145 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc161a00 0x7fc0fc0cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:46.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc102600640 1 --2- 172.21.15.144:0/4255358145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0fc0ccdf0 0x7fc0fc0cd280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40097c0 tx=0x7fc0f401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1194181e5d26e800 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc0fbe00640 1 -- 172.21.15.144:0/4255358145 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40b0070 con 0x7fc0fc0ccdf0 2024-09-12T12:21:46.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc0fbe00640 1 -- 172.21.15.144:0/4255358145 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f40ab600 con 0x7fc0fc0ccdf0 2024-09-12T12:21:46.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc0fbe00640 1 -- 172.21.15.144:0/4255358145 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40ab9d0 con 0x7fc0fc0ccdf0 2024-09-12T12:21:46.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 -- 172.21.15.144:0/4255358145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0fc0ccdf0 msgr2=0x7fc0fc0cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 --2- 172.21.15.144:0/4255358145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0fc0ccdf0 0x7fc0fc0cd280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40097c0 tx=0x7fc0f401c410 comp rx=0 tx=0).stop 2024-09-12T12:21:46.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 -- 172.21.15.144:0/4255358145 shutdown_connections 2024-09-12T12:21:46.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 --2- 172.21.15.144:0/4255358145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0fc0ccdf0 0x7fc0fc0cd280 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 --2- 172.21.15.144:0/4255358145 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc161a00 0x7fc0fc0cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 -- 172.21.15.144:0/4255358145 >> 172.21.15.144:0/4255358145 conn(0x7fc0fc067e00 msgr2=0x7fc0fc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 -- 172.21.15.144:0/4255358145 shutdown_connections 2024-09-12T12:21:46.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 -- 172.21.15.144:0/4255358145 wait complete. 2024-09-12T12:21:46.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 Processor -- start 2024-09-12T12:21:46.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.271+0000 7fc104600640 1 -- start start 2024-09-12T12:21:46.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc104600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc0ccdf0 0x7fc0fc15db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc104600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0fc0d0ee0 0x7fc0fc151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc104600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0fc161a00 0x7fc0fc140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc104600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc161f60 con 0x7fc0fc161a00 2024-09-12T12:21:46.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc104600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc161de0 con 0x7fc0fc0d0ee0 2024-09-12T12:21:46.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc104600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc0fc06e770 con 0x7fc0fc0ccdf0 2024-09-12T12:21:46.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc102600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0fc161a00 0x7fc0fc140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc102600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0fc161a00 0x7fc0fc140c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35744/0 (socket says 172.21.15.144:35744) 2024-09-12T12:21:46.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc102600640 1 -- 172.21.15.144:0/350343378 learned_addr learned my addr 172.21.15.144:0/350343378 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc101200640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0fc0d0ee0 0x7fc0fc151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc101c00640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc0ccdf0 0x7fc0fc15db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc102600640 1 -- 172.21.15.144:0/350343378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc0ccdf0 msgr2=0x7fc0fc15db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc102600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc0ccdf0 0x7fc0fc15db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc102600640 1 -- 172.21.15.144:0/350343378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0fc0d0ee0 msgr2=0x7fc0fc151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc102600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0fc0d0ee0 0x7fc0fc151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc102600640 1 -- 172.21.15.144:0/350343378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc15e3e0 con 0x7fc0fc161a00 2024-09-12T12:21:46.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc102600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0fc161a00 0x7fc0fc140c90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40ae040 tx=0x7fc0f40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc0f9600640 1 -- 172.21.15.144:0/350343378 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40b8070 con 0x7fc0fc161a00 2024-09-12T12:21:46.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc0f9600640 1 -- 172.21.15.144:0/350343378 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f40abe10 con 0x7fc0fc161a00 2024-09-12T12:21:46.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0fc15e6c0 con 0x7fc0fc161a00 2024-09-12T12:21:46.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc0f9600640 1 -- 172.21.15.144:0/350343378 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f40b0040 con 0x7fc0fc161a00 2024-09-12T12:21:46.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0fc159e40 con 0x7fc0fc161a00 2024-09-12T12:21:46.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0fc0cd280 con 0x7fc0fc161a00 2024-09-12T12:21:46.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.275+0000 7fc0f9600640 1 -- 172.21.15.144:0/350343378 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc0f40bb070 con 0x7fc0fc161a00 2024-09-12T12:21:46.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.279+0000 7fc0f9600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0dc0678c0 0x7fc0dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.279+0000 7fc0f9600640 1 -- 172.21.15.144:0/350343378 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fc0f411f790 con 0x7fc0fc161a00 2024-09-12T12:21:46.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.279+0000 7fc101c00640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0dc0678c0 0x7fc0dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.279+0000 7fc101c00640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0dc0678c0 0x7fc0dc069d80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009bd0 tx=0x7fc0f000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.282 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:21:46.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.283+0000 7fc0f9600640 1 -- 172.21.15.144:0/350343378 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc0f4016090 con 0x7fc0fc161a00 2024-09-12T12:21:46.286 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:21:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc0fc0732e0 con 0x7fc0fc161a00 2024-09-12T12:21:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc0f9600640 1 -- 172.21.15.144:0/350343378 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fc0f40efae0 con 0x7fc0fc161a00 2024-09-12T12:21:46.499 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:46.499 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":566,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076442083,"bytes_used":2551767040,"bytes_avail":770542346240,"bytes_total":773094113280,"write_bytes_sec":47456913,"read_op_per_sec":0,"write_op_per_sec":47},"fsmap":{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8391}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-12T12:21:45.491668+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:21:46.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0dc0678c0 msgr2=0x7fc0dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0dc0678c0 0x7fc0dc069d80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009bd0 tx=0x7fc0f000b040 comp rx=0 tx=0).stop 2024-09-12T12:21:46.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0fc161a00 msgr2=0x7fc0fc140c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0fc161a00 0x7fc0fc140c90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40ae040 tx=0x7fc0f40191b0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 shutdown_connections 2024-09-12T12:21:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc0dc0678c0 0x7fc0dc069d80 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0fc161a00 0x7fc0fc140c90 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0fc0d0ee0 0x7fc0fc151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 --2- 172.21.15.144:0/350343378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc0fc0ccdf0 0x7fc0fc15db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 >> 172.21.15.144:0/350343378 conn(0x7fc0fc067e00 msgr2=0x7fc0fc0cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 shutdown_connections 2024-09-12T12:21:46.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.499+0000 7fc104600640 1 -- 172.21.15.144:0/350343378 wait complete. 2024-09-12T12:21:46.520 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-12T12:21:46.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:46.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-09-12T12:21:46.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efd02400640 1 Processor -- start 2024-09-12T12:21:46.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efd02400640 1 -- start start 2024-09-12T12:21:46.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efd02400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcfc15c2e0 0x7efcfc072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efd02400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efcfc0af5f0 0x7efcfc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efd02400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc06c150 0x7efcfc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efd02400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efcfc06c5c0 con 0x7efcfc15c2e0 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efd02400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efcfc0733e0 con 0x7efcfc0af5f0 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efd02400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efcfc0cd290 con 0x7efcfc06c150 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcfc15c2e0 0x7efcfc072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efcfc15c2e0 0x7efcfc072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35752/0 (socket says 172.21.15.144:35752) 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfb400640 1 -- 172.21.15.144:0/2496327823 learned_addr learned my addr 172.21.15.144:0/2496327823 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfbe00640 1 --2- 172.21.15.144:0/2496327823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc06c150 0x7efcfc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfaa00640 1 --2- 172.21.15.144:0/2496327823 >> v2:172.21.15.165:3300/0 conn(0x7efcfc0af5f0 0x7efcfc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfb400640 1 -- 172.21.15.144:0/2496327823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc06c150 msgr2=0x7efcfc06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfb400640 1 --2- 172.21.15.144:0/2496327823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc06c150 0x7efcfc06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfb400640 1 -- 172.21.15.144:0/2496327823 >> v2:172.21.15.165:3300/0 conn(0x7efcfc0af5f0 msgr2=0x7efcfc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfb400640 1 --2- 172.21.15.144:0/2496327823 >> v2:172.21.15.165:3300/0 conn(0x7efcfc0af5f0 0x7efcfc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.659+0000 7efcfb400640 1 -- 172.21.15.144:0/2496327823 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc0cd570 con 0x7efcfc15c2e0 2024-09-12T12:21:46.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efcfb400640 1 --2- 172.21.15.144:0/2496327823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc15c2e0 0x7efcfc072b50 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0afa60 tx=0x7efcec01c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edd547c2e380cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efcfa000640 1 -- 172.21.15.144:0/2496327823 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec0b0070 con 0x7efcfc15c2e0 2024-09-12T12:21:46.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efcfa000640 1 -- 172.21.15.144:0/2496327823 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcec0ab600 con 0x7efcfc15c2e0 2024-09-12T12:21:46.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efcfa000640 1 -- 172.21.15.144:0/2496327823 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec0ab9d0 con 0x7efcfc15c2e0 2024-09-12T12:21:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efd02400640 1 -- 172.21.15.144:0/2496327823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc15c2e0 msgr2=0x7efcfc072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efd02400640 1 --2- 172.21.15.144:0/2496327823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc15c2e0 0x7efcfc072b50 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0afa60 tx=0x7efcec01c140 comp rx=0 tx=0).stop 2024-09-12T12:21:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efd02400640 1 -- 172.21.15.144:0/2496327823 shutdown_connections 2024-09-12T12:21:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efd02400640 1 --2- 172.21.15.144:0/2496327823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc06c150 0x7efcfc06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efd02400640 1 --2- 172.21.15.144:0/2496327823 >> v2:172.21.15.165:3300/0 conn(0x7efcfc0af5f0 0x7efcfc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efd02400640 1 --2- 172.21.15.144:0/2496327823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc15c2e0 0x7efcfc072b50 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efd02400640 1 -- 172.21.15.144:0/2496327823 >> 172.21.15.144:0/2496327823 conn(0x7efcfc068030 msgr2=0x7efcfc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efd02400640 1 -- 172.21.15.144:0/2496327823 shutdown_connections 2024-09-12T12:21:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.663+0000 7efd02400640 1 -- 172.21.15.144:0/2496327823 wait complete. 2024-09-12T12:21:46.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 Processor -- start 2024-09-12T12:21:46.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 -- start start 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc06c150 0x7efcfc148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcfc0af5f0 0x7efcfc1fb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc15c2e0 0x7efcfc073880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc0cdef0 con 0x7efcfc06c150 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc0cdd70 con 0x7efcfc0af5f0 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efcfc0ce070 con 0x7efcfc15c2e0 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc06c150 0x7efcfc148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc06c150 0x7efcfc148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35764/0 (socket says 172.21.15.144:35764) 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfb400640 1 -- 172.21.15.144:0/1959913246 learned_addr learned my addr 172.21.15.144:0/1959913246 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfbe00640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc15c2e0 0x7efcfc073880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfb400640 1 -- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc15c2e0 msgr2=0x7efcfc073880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfaa00640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcfc0af5f0 0x7efcfc1fb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfb400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc15c2e0 0x7efcfc073880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfb400640 1 -- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcfc0af5f0 msgr2=0x7efcfc1fb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfb400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcfc0af5f0 0x7efcfc1fb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfb400640 1 -- 172.21.15.144:0/1959913246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc152380 con 0x7efcfc06c150 2024-09-12T12:21:46.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfaa00640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcfc0af5f0 0x7efcfc1fb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:46.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfbe00640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc15c2e0 0x7efcfc073880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcfb400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc06c150 0x7efcfc148210 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7efcec01c9e0 tx=0x7efcec01a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcf3400640 1 -- 172.21.15.144:0/1959913246 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec0ba020 con 0x7efcfc06c150 2024-09-12T12:21:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcf3400640 1 -- 172.21.15.144:0/1959913246 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcec0b6620 con 0x7efcfc06c150 2024-09-12T12:21:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 -- 172.21.15.144:0/1959913246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcfc152660 con 0x7efcfc06c150 2024-09-12T12:21:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efcf3400640 1 -- 172.21.15.144:0/1959913246 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec0b0040 con 0x7efcfc06c150 2024-09-12T12:21:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.667+0000 7efd02400640 1 -- 172.21.15.144:0/1959913246 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcfc152c20 con 0x7efcfc06c150 2024-09-12T12:21:46.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcf3400640 1 -- 172.21.15.144:0/1959913246 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efcec0bd020 con 0x7efcfc06c150 2024-09-12T12:21:46.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcf3400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efcdc0678c0 0x7efcdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcf3400640 1 -- 172.21.15.144:0/1959913246 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7efcec1201c0 con 0x7efcfc06c150 2024-09-12T12:21:46.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efcdc0678c0 0x7efcdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efd0586e000 1 Processor -- start 2024-09-12T12:21:46.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efcdc0678c0 0x7efcdc069d80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efcfc154680 tx=0x7efce8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efd0586e000 1 -- start start 2024-09-12T12:21:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efd0586e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc1d70 0x56293efc2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efd0586e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293ef75870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efd0586e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293ef76190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efd0586e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56293ee5f960 con 0x56293efc2690 2024-09-12T12:21:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efd0586e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56293eda3900 con 0x56293efc1d70 2024-09-12T12:21:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efd0586e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56293edc6d40 con 0x56293ef75db0 2024-09-12T12:21:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293ef75870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293ef75870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35780/0 (socket says 172.21.15.144:35780) 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 -- 172.21.15.144:0/1576023206 learned_addr learned my addr 172.21.15.144:0/1576023206 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfb400640 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc1d70 0x56293efc2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfbe00640 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293ef76190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 -- 172.21.15.144:0/1576023206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 msgr2=0x56293ef76190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293ef76190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 -- 172.21.15.144:0/1576023206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc1d70 msgr2=0x56293efc2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc1d70 0x56293efc2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfaa00640 1 -- 172.21.15.144:0/1576023206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56293ed6d580 con 0x56293efc2690 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.671+0000 7efcfb400640 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc1d70 0x56293efc2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293ef75870 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7efce80041f0 tx=0x7efce8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96afec3a94be9e85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efce7e00640 1 -- 172.21.15.144:0/1576023206 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce800f040 con 0x56293efc2690 2024-09-12T12:21:46.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efce7e00640 1 -- 172.21.15.144:0/1576023206 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce800ee40 con 0x56293efc2690 2024-09-12T12:21:46.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efce7e00640 1 -- 172.21.15.144:0/1576023206 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce8003820 con 0x56293efc2690 2024-09-12T12:21:46.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 -- 172.21.15.144:0/1576023206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 msgr2=0x56293ef75870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293ef75870 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7efce80041f0 tx=0x7efce8011000 comp rx=0 tx=0).stop 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 -- 172.21.15.144:0/1576023206 shutdown_connections 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293ef76190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293ef75870 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 --2- 172.21.15.144:0/1576023206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc1d70 0x56293efc2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 -- 172.21.15.144:0/1576023206 >> 172.21.15.144:0/1576023206 conn(0x56293efa3040 msgr2=0x56293efa5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 -- 172.21.15.144:0/1576023206 shutdown_connections 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 -- 172.21.15.144:0/1576023206 wait complete. 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 -- start start 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 Processor -- start 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293efc8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293efc9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 0x56293efc9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56293edc2d00 con 0x56293efc1d70 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56293ed81aa0 con 0x56293efc2690 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56293ed60340 con 0x56293ef75db0 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efd0586e000 10 client.0 _ll_register_callbacks cb 0x56293ef63760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293efc9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293efc9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35786/0 (socket says 172.21.15.144:35786) 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 -- 172.21.15.144:0/2243735339 learned_addr learned my addr 172.21.15.144:0/2243735339 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfb400640 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293efc8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfbe00640 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 0x56293efc9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 -- 172.21.15.144:0/2243735339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 msgr2=0x56293efc8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293efc8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 -- 172.21.15.144:0/2243735339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 msgr2=0x56293efc9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 0x56293efc9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 -- 172.21.15.144:0/2243735339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56293ed69dc0 con 0x56293efc1d70 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efcfaa00640 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293efc9220 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7efce8008010 tx=0x7efce8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0fe9ea374d5d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.675+0000 7efce4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efce4c00640 1 -- 172.21.15.144:0/2243735339 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce802c440 con 0x56293efc1d70 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efce4c00640 1 -- 172.21.15.144:0/2243735339 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7efce801e040 con 0x56293efc1d70 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 -- 172.21.15.144:0/2243735339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efce800ee40 con 0x56293efc1d70 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efce4c00640 1 -- 172.21.15.144:0/2243735339 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7efce8039050 con 0x56293efc1d70 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 10 client.8643 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 -- 172.21.15.144:0/2243735339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x56293ed667f0 con 0x56293efc1d70 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efce4c00640 1 -- 172.21.15.144:0/2243735339 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce800ee40 con 0x56293efc1d70 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efce4c00640 1 -- 172.21.15.144:0/2243735339 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7efce803c020 con 0x56293efc1d70 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 10 client.8643 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:46.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 10 client.8643 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 20 client.8643 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x56293efd10b0 0x56293efd34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 4 client.8643 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 -- 172.21.15.144:0/2243735339 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56293ed60e10 con 0x56293efd10b0 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efcfb400640 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x56293efd10b0 0x56293efd34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efce4c00640 10 client.8643 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efcfb400640 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x56293efd10b0 0x56293efd34a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43dbf4342b8c7f3c server_cookie=81fca069d92035d in_seq=0 out_seq=0 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efce4c00640 1 -- 172.21.15.144:0/2243735339 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56293ed60e10 con 0x56293efd10b0 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efce4c00640 10 client.8643 handle_command_reply: tid=0 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 client.8643 shutdown 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 -- 172.21.15.144:0/2243735339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 msgr2=0x56293efc9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293efc9220 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7efce8008010 tx=0x7efce8004740 comp rx=0 tx=0).stop 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 -- 172.21.15.144:0/2243735339 shutdown_connections 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x56293efd10b0 0x56293efd34a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 0x56293efc9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293efc9220 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 --2- 172.21.15.144:0/2243735339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293efc8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efce4c00640 0 client.8643 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 -- 172.21.15.144:0/2243735339 >> 172.21.15.144:0/2243735339 conn(0x56293efa3040 msgr2=0x56293ef74f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 -- 172.21.15.144:0/2243735339 shutdown_connections 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 1 -- 172.21.15.144:0/2243735339 wait complete. 2024-09-12T12:21:46.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.679+0000 7efd0586e000 20 client.8643 trim_cache size 0 max 16384 2024-09-12T12:21:46.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 Processor -- start 2024-09-12T12:21:46.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- start start 2024-09-12T12:21:46.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293ef75db0 0x56293ef7dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293efc1d70 0x56293ef7e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293efcbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc204110 con 0x56293efc2690 2024-09-12T12:21:46.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc203170 con 0x56293ef75db0 2024-09-12T12:21:46.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efcfc15f340 con 0x56293efc1d70 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293efcbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293efcbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35792/0 (socket says 172.21.15.144:35792) 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfbe00640 1 -- 172.21.15.144:0/110763835 learned_addr learned my addr 172.21.15.144:0/110763835 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfbe00640 1 -- 172.21.15.144:0/110763835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293efc1d70 msgr2=0x56293ef7e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfbe00640 1 --2- 172.21.15.144:0/110763835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293efc1d70 0x56293ef7e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfbe00640 1 -- 172.21.15.144:0/110763835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293ef75db0 msgr2=0x56293ef7dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfb400640 1 --2- 172.21.15.144:0/110763835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293ef75db0 0x56293ef7dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfbe00640 1 --2- 172.21.15.144:0/110763835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293ef75db0 0x56293ef7dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfbe00640 1 -- 172.21.15.144:0/110763835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56293ef7b960 con 0x56293efc2690 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfb400640 1 --2- 172.21.15.144:0/110763835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293ef75db0 0x56293ef7dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efcfbe00640 1 --2- 172.21.15.144:0/110763835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293efcbd00 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009440 tx=0x7efcf4015950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e03ca3c9d97556 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efce7400640 1 -- 172.21.15.144:0/110763835 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4003ba0 con 0x56293efc2690 2024-09-12T12:21:46.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efce7400640 1 -- 172.21.15.144:0/110763835 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf4003d40 con 0x56293efc2690 2024-09-12T12:21:46.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efce7400640 1 -- 172.21.15.144:0/110763835 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf40178e0 con 0x56293efc2690 2024-09-12T12:21:46.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- 172.21.15.144:0/110763835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 msgr2=0x56293efcbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 --2- 172.21.15.144:0/110763835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293efcbd00 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009440 tx=0x7efcf4015950 comp rx=0 tx=0).stop 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- 172.21.15.144:0/110763835 shutdown_connections 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 --2- 172.21.15.144:0/110763835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc2690 0x56293efcbd00 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 --2- 172.21.15.144:0/110763835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293efc1d70 0x56293ef7e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 --2- 172.21.15.144:0/110763835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293ef75db0 0x56293ef7dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- 172.21.15.144:0/110763835 >> 172.21.15.144:0/110763835 conn(0x56293efa3040 msgr2=0x56293efc8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- 172.21.15.144:0/110763835 shutdown_connections 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- 172.21.15.144:0/110763835 wait complete. 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 -- start start 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.699+0000 7efd0586e000 1 Processor -- start 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293efce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293f0324c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 0x56293f032a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56293ee06780 con 0x56293efc1d70 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc202b50 con 0x56293efc2690 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56293ed6cf20 con 0x56293ef75db0 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 10 client.0 _ll_register_callbacks cb 0x7efcec0ec700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293f0324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293f0324c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35806/0 (socket says 172.21.15.144:35806) 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfaa00640 1 -- 172.21.15.144:0/3681412230 learned_addr learned my addr 172.21.15.144:0/3681412230 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfb400640 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293efce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfbe00640 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 0x56293f032a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfaa00640 1 -- 172.21.15.144:0/3681412230 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 msgr2=0x56293efce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfaa00640 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293efce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfaa00640 1 -- 172.21.15.144:0/3681412230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 msgr2=0x56293f032a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfaa00640 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 0x56293f032a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfaa00640 1 -- 172.21.15.144:0/3681412230 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56293ed84470 con 0x56293efc1d70 2024-09-12T12:21:46.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfb400640 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293efce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfaa00640 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293f0324c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7efce8006c10 tx=0x7efce80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc53f672a76bb05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 1 -- 172.21.15.144:0/3681412230 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce802c440 con 0x56293efc1d70 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 1 -- 172.21.15.144:0/3681412230 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7efce8013430 con 0x56293efc1d70 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- 172.21.15.144:0/3681412230 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf4003d40 con 0x56293efc1d70 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 1 -- 172.21.15.144:0/3681412230 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7efce804b050 con 0x56293efc1d70 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 10 client.8649 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- 172.21.15.144:0/3681412230 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x56293ed5a640 con 0x56293efc1d70 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 1 -- 172.21.15.144:0/3681412230 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf4003d40 con 0x56293efc1d70 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 1 -- 172.21.15.144:0/3681412230 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7efce804e020 con 0x56293efc1d70 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 10 client.8649 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 10 client.8649 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 20 client.8649 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:46.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x56293f032f40 0x56293f035a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 4 client.8649 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-12T12:21:46.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- 172.21.15.144:0/3681412230 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x56293edd4470 con 0x56293f032f40 2024-09-12T12:21:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfb400640 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x56293f032f40 0x56293f035a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 10 client.8649 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efcfb400640 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x56293f032f40 0x56293f035a30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1ec85e196e46f17 server_cookie=cfd373d8c76aed65 in_seq=0 out_seq=0 2024-09-12T12:21:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 1 -- 172.21.15.144:0/3681412230 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56293edd4470 con 0x56293f032f40 2024-09-12T12:21:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 10 client.8649 handle_command_reply: tid=0 2024-09-12T12:21:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 client.8649 shutdown 2024-09-12T12:21:46.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- 172.21.15.144:0/3681412230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 msgr2=0x56293f0324c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293f0324c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7efce8006c10 tx=0x7efce80046d0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- 172.21.15.144:0/3681412230 shutdown_connections 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x56293f032f40 0x56293f035a30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56293efc2690 0x56293f032a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56293efc1d70 0x56293f0324c0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 --2- 172.21.15.144:0/3681412230 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56293ef75db0 0x56293efce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efce4c00640 0 client.8649 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- 172.21.15.144:0/3681412230 >> 172.21.15.144:0/3681412230 conn(0x56293efa3040 msgr2=0x56293ef7d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- 172.21.15.144:0/3681412230 shutdown_connections 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.703+0000 7efd0586e000 1 -- 172.21.15.144:0/3681412230 wait complete. 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd0586e000 20 client.8649 trim_cache size 0 max 16384 2024-09-12T12:21:46.710 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:21:46.711 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:21:46.711 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:21:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 -- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efcdc0678c0 msgr2=0x7efcdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efcdc0678c0 0x7efcdc069d80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efcfc154680 tx=0x7efce8008040 comp rx=0 tx=0).stop 2024-09-12T12:21:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 -- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc06c150 msgr2=0x7efcfc148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc06c150 0x7efcfc148210 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7efcec01c9e0 tx=0x7efcec01a980 comp rx=0 tx=0).stop 2024-09-12T12:21:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 -- 172.21.15.144:0/1959913246 shutdown_connections 2024-09-12T12:21:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efcdc0678c0 0x7efcdc069d80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efcfc15c2e0 0x7efcfc073880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efcfc0af5f0 0x7efcfc1fb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 --2- 172.21.15.144:0/1959913246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc06c150 0x7efcfc148210 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 -- 172.21.15.144:0/1959913246 >> 172.21.15.144:0/1959913246 conn(0x7efcfc068030 msgr2=0x7efcfc0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 -- 172.21.15.144:0/1959913246 shutdown_connections 2024-09-12T12:21:46.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.707+0000 7efd02400640 1 -- 172.21.15.144:0/1959913246 wait complete. 2024-09-12T12:21:46.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:46.726 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-12T12:21:46.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd54e600640 1 Processor -- start 2024-09-12T12:21:46.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd54e600640 1 -- start start 2024-09-12T12:21:46.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd54e600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd54806c320 0x7fd548166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd54e600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5480733e0 con 0x7fd5480af5f0 2024-09-12T12:21:46.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd54e600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5480cd290 con 0x7fd54815c2e0 2024-09-12T12:21:46.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd54e600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd5480cd570 con 0x7fd54806c320 2024-09-12T12:21:46.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd547e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd54806c320 0x7fd548166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd546a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd5480af5f0 0x7fd54806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40648/0 (socket says 172.21.15.144:40648) 2024-09-12T12:21:46.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd547e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd54806c320 0x7fd548166f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35816/0 (socket says 172.21.15.144:35816) 2024-09-12T12:21:46.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd546a00640 1 -- 172.21.15.144:0/780842416 learned_addr learned my addr 172.21.15.144:0/780842416 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:46.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd547e00640 1 -- 172.21.15.144:0/780842416 >> v1:172.21.15.165:6789/0 conn(0x7fd54815c2e0 legacy=0x7fd548072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd547e00640 1 -- 172.21.15.144:0/780842416 >> v1:172.21.15.144:6789/0 conn(0x7fd5480af5f0 legacy=0x7fd54806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd547e00640 1 -- 172.21.15.144:0/780842416 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5480cd850 con 0x7fd54806c320 2024-09-12T12:21:46.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.867+0000 7fd546000640 1 -- 172.21.15.144:0/780842416 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834027438 0 0) 0x7fd5480733e0 con 0x7fd5480af5f0 2024-09-12T12:21:46.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd547e00640 1 --2- 172.21.15.144:0/780842416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd54806c320 0x7fd548166f10 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fd5400097c0 tx=0x7fd54001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c64a89eb7685fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd546000640 1 -- 172.21.15.144:0/780842416 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5400b0070 con 0x7fd54806c320 2024-09-12T12:21:46.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd546000640 1 -- 172.21.15.144:0/780842416 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5400ab600 con 0x7fd54806c320 2024-09-12T12:21:46.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd546000640 1 -- 172.21.15.144:0/780842416 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5400ab9d0 con 0x7fd54806c320 2024-09-12T12:21:46.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd54e600640 1 -- 172.21.15.144:0/780842416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd54806c320 msgr2=0x7fd548166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd54e600640 1 --2- 172.21.15.144:0/780842416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd54806c320 0x7fd548166f10 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fd5400097c0 tx=0x7fd54001c340 comp rx=0 tx=0).stop 2024-09-12T12:21:46.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd54e600640 1 -- 172.21.15.144:0/780842416 shutdown_connections 2024-09-12T12:21:46.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd54e600640 1 --2- 172.21.15.144:0/780842416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd54806c320 0x7fd548166f10 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd54e600640 1 -- 172.21.15.144:0/780842416 >> 172.21.15.144:0/780842416 conn(0x7fd548068030 msgr2=0x7fd5480b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd54e600640 1 -- 172.21.15.144:0/780842416 shutdown_connections 2024-09-12T12:21:46.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd54e600640 1 -- 172.21.15.144:0/780842416 wait complete. 2024-09-12T12:21:46.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd54e600640 1 Processor -- start 2024-09-12T12:21:46.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.871+0000 7fd54e600640 1 -- start start 2024-09-12T12:21:46.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd54e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd54806c320 0x7fd5481fb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd54e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5480af5f0 0x7fd548148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd54e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd54815c2e0 0x7fd5480b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd54e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd54816a000 con 0x7fd5480af5f0 2024-09-12T12:21:46.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd54e600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd548169e80 con 0x7fd54806c320 2024-09-12T12:21:46.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd54e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd54816a180 con 0x7fd54815c2e0 2024-09-12T12:21:46.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd546a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5480af5f0 0x7fd548148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd546a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5480af5f0 0x7fd548148c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35832/0 (socket says 172.21.15.144:35832) 2024-09-12T12:21:46.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd546a00640 1 -- 172.21.15.144:0/29140559 learned_addr learned my addr 172.21.15.144:0/29140559 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd547400640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd54806c320 0x7fd5481fb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd547e00640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd54815c2e0 0x7fd5480b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd546a00640 1 -- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd54815c2e0 msgr2=0x7fd5480b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd546a00640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd54815c2e0 0x7fd5480b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd546a00640 1 -- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd54806c320 msgr2=0x7fd5481fb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd546a00640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd54806c320 0x7fd5481fb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd546a00640 1 -- 172.21.15.144:0/29140559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd548149180 con 0x7fd5480af5f0 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd547400640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd54806c320 0x7fd5481fb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd547e00640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd54815c2e0 0x7fd5480b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:46.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd546a00640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5480af5f0 0x7fd548148c40 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fd53400c520 tx=0x7fd53400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd53f400640 1 -- 172.21.15.144:0/29140559 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534018070 con 0x7fd5480af5f0 2024-09-12T12:21:46.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd53f400640 1 -- 172.21.15.144:0/29140559 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5340074e0 con 0x7fd5480af5f0 2024-09-12T12:21:46.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd53f400640 1 -- 172.21.15.144:0/29140559 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5340049f0 con 0x7fd5480af5f0 2024-09-12T12:21:46.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd54e600640 1 -- 172.21.15.144:0/29140559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5480b5330 con 0x7fd5480af5f0 2024-09-12T12:21:46.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.875+0000 7fd54e600640 1 -- 172.21.15.144:0/29140559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd548155bc0 con 0x7fd5480af5f0 2024-09-12T12:21:46.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd53f400640 1 -- 172.21.15.144:0/29140559 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd53401b070 con 0x7fd5480af5f0 2024-09-12T12:21:46.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd53f400640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5280678f0 0x7fd528069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd53f400640 1 -- 172.21.15.144:0/29140559 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fd5340852e0 con 0x7fd5480af5f0 2024-09-12T12:21:46.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 Processor -- start 2024-09-12T12:21:46.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5280678f0 0x7fd528069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 -- start start 2024-09-12T12:21:46.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5280678f0 0x7fd528069db0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd53800c420 tx=0x7fd538009570 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32268d70 0x55bc32269150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32269690 0x55bc3221c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 0x55bc3221d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc32106960 con 0x55bc32268d70 2024-09-12T12:21:46.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55bc3204a900 con 0x55bc3221cdb0 2024-09-12T12:21:46.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55bc3206dd40 con 0x55bc32269690 2024-09-12T12:21:46.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32268d70 0x55bc32269150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32268d70 0x55bc32269150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35838/0 (socket says 172.21.15.144:35838) 2024-09-12T12:21:46.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 -- 172.21.15.144:0/1909626672 learned_addr learned my addr 172.21.15.144:0/1909626672 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547e00640 1 --2- 172.21.15.144:0/1909626672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 0x55bc3221d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd546a00640 1 --2- 172.21.15.144:0/1909626672 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32269690 0x55bc3221c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 -- 172.21.15.144:0/1909626672 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32269690 msgr2=0x55bc3221c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 --2- 172.21.15.144:0/1909626672 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32269690 0x55bc3221c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 -- 172.21.15.144:0/1909626672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 msgr2=0x55bc3221d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 --2- 172.21.15.144:0/1909626672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 0x55bc3221d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 -- 172.21.15.144:0/1909626672 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc32014580 con 0x55bc32268d70 2024-09-12T12:21:46.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd547400640 1 --2- 172.21.15.144:0/1909626672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32268d70 0x55bc32269150 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fd538018820 tx=0x7fd538011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a327f97f9e3d11e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd533e00640 1 -- 172.21.15.144:0/1909626672 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd538027070 con 0x55bc32268d70 2024-09-12T12:21:46.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd533e00640 1 -- 172.21.15.144:0/1909626672 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd538018050 con 0x55bc32268d70 2024-09-12T12:21:46.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd533e00640 1 -- 172.21.15.144:0/1909626672 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd538018240 con 0x55bc32268d70 2024-09-12T12:21:46.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 -- 172.21.15.144:0/1909626672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32268d70 msgr2=0x55bc32269150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.879+0000 7fd5519d7000 1 --2- 172.21.15.144:0/1909626672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32268d70 0x55bc32269150 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fd538018820 tx=0x7fd538011000 comp rx=0 tx=0).stop 2024-09-12T12:21:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- 172.21.15.144:0/1909626672 shutdown_connections 2024-09-12T12:21:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 --2- 172.21.15.144:0/1909626672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 0x55bc3221d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 --2- 172.21.15.144:0/1909626672 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32269690 0x55bc3221c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 --2- 172.21.15.144:0/1909626672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32268d70 0x55bc32269150 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- 172.21.15.144:0/1909626672 >> 172.21.15.144:0/1909626672 conn(0x55bc3224a040 msgr2=0x55bc3224c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- 172.21.15.144:0/1909626672 shutdown_connections 2024-09-12T12:21:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- 172.21.15.144:0/1909626672 wait complete. 2024-09-12T12:21:46.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- start start 2024-09-12T12:21:46.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 Processor -- start 2024-09-12T12:21:46.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 0x55bc3226fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 0x55bc32270220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32270760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc32069d00 con 0x55bc32269690 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55bc32028aa0 con 0x55bc32268d70 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55bc32007340 con 0x55bc3221cdb0 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 10 client.0 _ll_register_callbacks cb 0x55bc3220a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32270760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32270760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35846/0 (socket says 172.21.15.144:35846) 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547e00640 1 -- 172.21.15.144:0/2604330340 learned_addr learned my addr 172.21.15.144:0/2604330340 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547400640 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 0x55bc3226fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd546a00640 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 0x55bc32270220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547e00640 1 -- 172.21.15.144:0/2604330340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 msgr2=0x55bc3226fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547e00640 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 0x55bc3226fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547e00640 1 -- 172.21.15.144:0/2604330340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 msgr2=0x55bc32270220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547e00640 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 0x55bc32270220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547e00640 1 -- 172.21.15.144:0/2604330340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc32010dc0 con 0x55bc32269690 2024-09-12T12:21:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd547e00640 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32270760 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fd5400ae040 tx=0x7fd54001ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408ea1c8260564a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd530c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd530c00640 1 -- 172.21.15.144:0/2604330340 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5400bc070 con 0x55bc32269690 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd530c00640 1 -- 172.21.15.144:0/2604330340 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fd540003620 con 0x55bc32269690 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- 172.21.15.144:0/2604330340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd538018050 con 0x55bc32269690 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd530c00640 1 -- 172.21.15.144:0/2604330340 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7fd5400c9050 con 0x55bc32269690 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 10 client.8664 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- 172.21.15.144:0/2604330340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55bc3200d7f0 con 0x55bc32269690 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd530c00640 1 -- 172.21.15.144:0/2604330340 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd538018050 con 0x55bc32269690 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd530c00640 1 -- 172.21.15.144:0/2604330340 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7fd5400cc020 con 0x55bc32269690 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 10 client.8664 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 10 client.8664 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 20 client.8664 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55bc322780b0 0x55bc3227a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 4 client.8664 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.883+0000 7fd5519d7000 1 -- 172.21.15.144:0/2604330340 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc32007e10 con 0x55bc322780b0 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd547400640 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55bc322780b0 0x55bc3227a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd547400640 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55bc322780b0 0x55bc3227a4a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57d37ddc9c8b97ec server_cookie=acd12f047f89a342 in_seq=0 out_seq=0 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd530c00640 10 client.8664 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd530c00640 1 -- 172.21.15.144:0/2604330340 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc32007e10 con 0x55bc322780b0 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd530c00640 10 client.8664 handle_command_reply: tid=0 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 client.8664 shutdown 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 -- 172.21.15.144:0/2604330340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 msgr2=0x55bc32270760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32270760 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fd5400ae040 tx=0x7fd54001ab80 comp rx=0 tx=0).stop 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 -- 172.21.15.144:0/2604330340 shutdown_connections 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32270760 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55bc322780b0 0x55bc3227a4a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 0x55bc32270220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2604330340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 0x55bc3226fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd530c00640 0 client.8664 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:46.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 -- 172.21.15.144:0/2604330340 >> 172.21.15.144:0/2604330340 conn(0x55bc3224a040 msgr2=0x55bc3221bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 -- 172.21.15.144:0/2604330340 shutdown_connections 2024-09-12T12:21:46.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 1 -- 172.21.15.144:0/2604330340 wait complete. 2024-09-12T12:21:46.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.887+0000 7fd5519d7000 20 client.8664 trim_cache size 0 max 16384 2024-09-12T12:21:46.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.903+0000 7fd5519d7000 1 Processor -- start 2024-09-12T12:21:46.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.903+0000 7fd5519d7000 1 -- start start 2024-09-12T12:21:46.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 0x55bc3227d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32268d70 0x55bc32224c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32225140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd548203fa0 con 0x55bc32269690 2024-09-12T12:21:46.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd548203010 con 0x55bc3221cdb0 2024-09-12T12:21:46.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd54815f460 con 0x55bc32268d70 2024-09-12T12:21:46.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32225140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32225140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35860/0 (socket says 172.21.15.144:35860) 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547e00640 1 -- 172.21.15.144:0/2366413621 learned_addr learned my addr 172.21.15.144:0/2366413621 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd546a00640 1 --2- 172.21.15.144:0/2366413621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32268d70 0x55bc32224c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547400640 1 --2- 172.21.15.144:0/2366413621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 0x55bc3227d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547e00640 1 -- 172.21.15.144:0/2366413621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32268d70 msgr2=0x55bc32224c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547e00640 1 --2- 172.21.15.144:0/2366413621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32268d70 0x55bc32224c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547e00640 1 -- 172.21.15.144:0/2366413621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 msgr2=0x55bc3227d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547e00640 1 --2- 172.21.15.144:0/2366413621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 0x55bc3227d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547e00640 1 -- 172.21.15.144:0/2366413621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc3202b470 con 0x55bc32269690 2024-09-12T12:21:46.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd547e00640 1 --2- 172.21.15.144:0/2366413621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32225140 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fd540018f50 tx=0x7fd5400b9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2d250fa9076a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd533400640 1 -- 172.21.15.144:0/2366413621 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5400bc070 con 0x55bc32269690 2024-09-12T12:21:46.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd533400640 1 -- 172.21.15.144:0/2366413621 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5400038f0 con 0x55bc32269690 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd533400640 1 -- 172.21.15.144:0/2366413621 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5400b0040 con 0x55bc32269690 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- 172.21.15.144:0/2366413621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 msgr2=0x55bc32225140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2366413621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32225140 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fd540018f50 tx=0x7fd5400b9000 comp rx=0 tx=0).stop 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- 172.21.15.144:0/2366413621 shutdown_connections 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2366413621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc32225140 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2366413621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc32268d70 0x55bc32224c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2366413621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc3221cdb0 0x55bc3227d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- 172.21.15.144:0/2366413621 >> 172.21.15.144:0/2366413621 conn(0x55bc3224a040 msgr2=0x55bc32275ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- 172.21.15.144:0/2366413621 shutdown_connections 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- 172.21.15.144:0/2366413621 wait complete. 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- start start 2024-09-12T12:21:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 Processor -- start 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 0x55bc322dc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 0x55bc322dce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc3227c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc32013f20 con 0x55bc32269690 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd5480b4150 con 0x55bc32268d70 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.907+0000 7fd5519d7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55bc3206d050 con 0x55bc3221cdb0 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 10 client.0 _ll_register_callbacks cb 0x7fd540009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc3227c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc3227c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35864/0 (socket says 172.21.15.144:35864) 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547e00640 1 -- 172.21.15.144:0/2187813707 learned_addr learned my addr 172.21.15.144:0/2187813707 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd546a00640 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 0x55bc322dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547400640 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 0x55bc322dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547e00640 1 -- 172.21.15.144:0/2187813707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 msgr2=0x55bc322dc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547e00640 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 0x55bc322dc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547e00640 1 -- 172.21.15.144:0/2187813707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 msgr2=0x55bc322dce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547e00640 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 0x55bc322dce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547e00640 1 -- 172.21.15.144:0/2187813707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc32001640 con 0x55bc32269690 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547e00640 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc3227c7e0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd54001c8b0 tx=0x7fd540008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b456e01695efbbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 1 -- 172.21.15.144:0/2187813707 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5400bc070 con 0x55bc32269690 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 1 -- 172.21.15.144:0/2187813707 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fd5400d6c40 con 0x55bc32269690 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 -- 172.21.15.144:0/2187813707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc3207b470 con 0x55bc32269690 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 1 -- 172.21.15.144:0/2187813707 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7fd5400b0040 con 0x55bc32269690 2024-09-12T12:21:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 10 client.8670 fetch_fsmap learned FSMap version 107 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 -- 172.21.15.144:0/2187813707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55bc320053b0 con 0x55bc32269690 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 1 -- 172.21.15.144:0/2187813707 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5400db080 con 0x55bc32269690 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 1 -- 172.21.15.144:0/2187813707 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7fd5400cc040 con 0x55bc32269690 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 10 client.8670 fetch_fsmap finished waiting for FSMap version 107 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 10 client.8670 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 20 client.8670 populate_metadata read hostname 'smithi144' 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55bc3227cd20 0x55bc3227d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 4 client.8670 mds_command: new command op to 8391 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 -- 172.21.15.144:0/2187813707 --> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bc320757c0 con 0x55bc3227cd20 2024-09-12T12:21:46.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547400640 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55bc3227cd20 0x55bc3227d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd547400640 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55bc3227cd20 0x55bc3227d100 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2dbc65d6a0c984e server_cookie=1a92f3ea614bde32 in_seq=0 out_seq=0 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 10 client.8670 ms_handle_connect on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 1 -- 172.21.15.144:0/2187813707 <== mds.0 v2:172.21.15.144:6835/2508228850 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bc320757c0 con 0x55bc3227cd20 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 10 client.8670 handle_command_reply: tid=0 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 client.8670 shutdown 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 -- 172.21.15.144:0/2187813707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 msgr2=0x55bc3227c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc3227c7e0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd54001c8b0 tx=0x7fd540008040 comp rx=0 tx=0).stop 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 -- 172.21.15.144:0/2187813707 shutdown_connections 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc32269690 0x55bc3227c7e0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.144:6835/2508228850,v1:172.21.15.144:6837/2508228850] conn(0x55bc3227cd20 0x55bc3227d100 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bc32268d70 0x55bc322dce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 --2- 172.21.15.144:0/2187813707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bc3221cdb0 0x55bc322dc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd530c00640 0 client.8670 ms_handle_reset on v2:172.21.15.144:6835/2508228850 2024-09-12T12:21:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 -- 172.21.15.144:0/2187813707 >> 172.21.15.144:0/2187813707 conn(0x55bc3224a040 msgr2=0x55bc322762f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 -- 172.21.15.144:0/2187813707 shutdown_connections 2024-09-12T12:21:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 1 -- 172.21.15.144:0/2187813707 wait complete. 2024-09-12T12:21:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd5519d7000 20 client.8670 trim_cache size 0 max 16384 2024-09-12T12:21:46.918 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:21:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "no active scrubs running", 2024-09-12T12:21:46.918 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:21:46.919 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:21:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 -- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5280678f0 msgr2=0x7fd528069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5280678f0 0x7fd528069db0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd53800c420 tx=0x7fd538009570 comp rx=0 tx=0).stop 2024-09-12T12:21:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 -- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5480af5f0 msgr2=0x7fd548148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5480af5f0 0x7fd548148c40 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fd53400c520 tx=0x7fd53400c9e0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 -- 172.21.15.144:0/29140559 shutdown_connections 2024-09-12T12:21:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd5280678f0 0x7fd528069db0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd54815c2e0 0x7fd5480b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5480af5f0 0x7fd548148c40 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 --2- 172.21.15.144:0/29140559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd54806c320 0x7fd5481fb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 -- 172.21.15.144:0/29140559 >> 172.21.15.144:0/29140559 conn(0x7fd548068030 msgr2=0x7fd5481566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 -- 172.21.15.144:0/29140559 shutdown_connections 2024-09-12T12:21:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:46.911+0000 7fd54e600640 1 -- 172.21.15.144:0/29140559 wait complete. 2024-09-12T12:21:46.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:47.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc9400640 1 Processor -- start 2024-09-12T12:21:47.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc9400640 1 -- start start 2024-09-12T12:21:47.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4dc415b4e0 0x7f4dc40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc9400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4dc40b3ad0 0x7f4dc4071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc9400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc40b45a0 con 0x7f4dc4071960 2024-09-12T12:21:47.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc9400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc40b3fe0 con 0x7f4dc415b4e0 2024-09-12T12:21:47.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc9400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc40b42c0 con 0x7f4dc40b3ad0 2024-09-12T12:21:47.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4dc415b4e0 0x7f4dc40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4dc415b4e0 0x7f4dc40b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39024/0 (socket says 172.21.15.144:39024) 2024-09-12T12:21:47.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc2800640 1 -- 172.21.15.144:0/3890953491 learned_addr learned my addr 172.21.15.144:0/3890953491 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:47.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc1e00640 1 --2- 172.21.15.144:0/3890953491 >> v2:172.21.15.165:3300/0 conn(0x7f4dc40b3ad0 0x7f4dc4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc2800640 1 -- 172.21.15.144:0/3890953491 >> v2:172.21.15.165:3300/0 conn(0x7f4dc40b3ad0 msgr2=0x7f4dc4071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:47.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc2800640 1 --2- 172.21.15.144:0/3890953491 >> v2:172.21.15.165:3300/0 conn(0x7f4dc40b3ad0 0x7f4dc4071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc2800640 1 -- 172.21.15.144:0/3890953491 >> v1:172.21.15.144:6789/0 conn(0x7f4dc4071960 legacy=0x7f4dc40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc2800640 1 -- 172.21.15.144:0/3890953491 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc40b1490 con 0x7f4dc415b4e0 2024-09-12T12:21:47.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.067+0000 7f4dc1400640 1 -- 172.21.15.144:0/3890953491 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503814197 0 0) 0x7f4dc40b45a0 con 0x7f4dc4071960 2024-09-12T12:21:47.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc2800640 1 --2- 172.21.15.144:0/3890953491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 0x7f4dc40b3590 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40b02b0 tx=0x7f4db401ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3eb210853e1abb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:47.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc1400640 1 -- 172.21.15.144:0/3890953491 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db40b4070 con 0x7f4dc415b4e0 2024-09-12T12:21:47.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc1400640 1 -- 172.21.15.144:0/3890953491 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db40a7cb0 con 0x7f4dc415b4e0 2024-09-12T12:21:47.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc1400640 1 -- 172.21.15.144:0/3890953491 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db40a7e60 con 0x7f4dc415b4e0 2024-09-12T12:21:47.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc9400640 1 -- 172.21.15.144:0/3890953491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 msgr2=0x7f4dc40b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc9400640 1 --2- 172.21.15.144:0/3890953491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 0x7f4dc40b3590 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40b02b0 tx=0x7f4db401ebc0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc9400640 1 -- 172.21.15.144:0/3890953491 shutdown_connections 2024-09-12T12:21:47.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc9400640 1 --2- 172.21.15.144:0/3890953491 >> v2:172.21.15.165:3300/0 conn(0x7f4dc40b3ad0 0x7f4dc4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc9400640 1 --2- 172.21.15.144:0/3890953491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 0x7f4dc40b3590 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc9400640 1 -- 172.21.15.144:0/3890953491 >> 172.21.15.144:0/3890953491 conn(0x7f4dc406d0d0 msgr2=0x7f4dc406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:47.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc9400640 1 -- 172.21.15.144:0/3890953491 shutdown_connections 2024-09-12T12:21:47.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.071+0000 7f4dc9400640 1 -- 172.21.15.144:0/3890953491 wait complete. 2024-09-12T12:21:47.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 Processor -- start 2024-09-12T12:21:47.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 -- start start 2024-09-12T12:21:47.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dc4071960 0x7f4dc40b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc40b3ad0 0x7f4dc4159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 0x7f4dc41f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc40b2620 con 0x7f4dc415b4e0 2024-09-12T12:21:47.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc40b24a0 con 0x7f4dc40b3ad0 2024-09-12T12:21:47.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc40cd640 con 0x7f4dc4071960 2024-09-12T12:21:47.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 0x7f4dc41f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 0x7f4dc41f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39028/0 (socket says 172.21.15.144:39028) 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc3200640 1 -- 172.21.15.144:0/312846402 learned_addr learned my addr 172.21.15.144:0/312846402 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc1e00640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc40b3ad0 0x7f4dc4159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc2800640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dc4071960 0x7f4dc40b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc3200640 1 -- 172.21.15.144:0/312846402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dc4071960 msgr2=0x7f4dc40b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc3200640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dc4071960 0x7f4dc40b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc3200640 1 -- 172.21.15.144:0/312846402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc40b3ad0 msgr2=0x7f4dc4159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc3200640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc40b3ad0 0x7f4dc4159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc3200640 1 -- 172.21.15.144:0/312846402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc415a100 con 0x7f4dc415b4e0 2024-09-12T12:21:47.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc3200640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 0x7f4dc41f89c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00c780 tx=0x7f4dbc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:47.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dbaa00640 1 -- 172.21.15.144:0/312846402 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc003db0 con 0x7f4dc415b4e0 2024-09-12T12:21:47.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dbaa00640 1 -- 172.21.15.144:0/312846402 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc005070 con 0x7f4dc415b4e0 2024-09-12T12:21:47.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dbaa00640 1 -- 172.21.15.144:0/312846402 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc005460 con 0x7f4dc415b4e0 2024-09-12T12:21:47.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc415a3e0 con 0x7f4dc415b4e0 2024-09-12T12:21:47.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.075+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc41f7740 con 0x7f4dc415b4e0 2024-09-12T12:21:47.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.079+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc41f7510 con 0x7f4dc415b4e0 2024-09-12T12:21:47.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.079+0000 7f4dbaa00640 1 -- 172.21.15.144:0/312846402 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4dbc005600 con 0x7f4dc415b4e0 2024-09-12T12:21:47.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.079+0000 7f4dbaa00640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4da40678c0 0x7f4da4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.079+0000 7f4dbaa00640 1 -- 172.21.15.144:0/312846402 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f4dbc085ca0 con 0x7f4dc415b4e0 2024-09-12T12:21:47.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.079+0000 7f4dc2800640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4da40678c0 0x7f4da4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.079+0000 7f4dc2800640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4da40678c0 0x7f4da4069d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4db40b1000 tx=0x7f4db40a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:47.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.083+0000 7f4dbaa00640 1 -- 172.21.15.144:0/312846402 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4dbc055ff0 con 0x7f4dc415b4e0 2024-09-12T12:21:47.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.271+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4dc4154a70 con 0x7f4dc415b4e0 2024-09-12T12:21:47.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.271+0000 7f4dbaa00640 1 -- 172.21.15.144:0/312846402 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7f4dbc05a2f0 con 0x7f4dc415b4e0 2024-09-12T12:21:47.274 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:47.274 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:47.274 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:47.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4da40678c0 msgr2=0x7f4da4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4da40678c0 0x7f4da4069d80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4db40b1000 tx=0x7f4db40a9070 comp rx=0 tx=0).stop 2024-09-12T12:21:47.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 msgr2=0x7f4dc41f89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 0x7f4dc41f89c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00c780 tx=0x7f4dbc00cc40 comp rx=0 tx=0).stop 2024-09-12T12:21:47.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 shutdown_connections 2024-09-12T12:21:47.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4da40678c0 0x7f4da4069d80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc415b4e0 0x7f4dc41f89c0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc40b3ad0 0x7f4dc4159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 --2- 172.21.15.144:0/312846402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4dc4071960 0x7f4dc40b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 >> 172.21.15.144:0/312846402 conn(0x7f4dc406d0d0 msgr2=0x7f4dc40cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:47.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 shutdown_connections 2024-09-12T12:21:47.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.275+0000 7f4dc9400640 1 -- 172.21.15.144:0/312846402 wait complete. 2024-09-12T12:21:47.295 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-12T12:21:47.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:21:47.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.427+0000 7f746ec00640 1 Processor -- start 2024-09-12T12:21:47.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.427+0000 7f746ec00640 1 -- start start 2024-09-12T12:21:47.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7468072fa0 0x7f746806f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746ec00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74680734a0 con 0x7f74680d27b0 2024-09-12T12:21:47.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7468073780 con 0x7f746815e5b0 2024-09-12T12:21:47.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f746806ce30 con 0x7f7468072fa0 2024-09-12T12:21:47.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746ce00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f74680d27b0 0x7f746806d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48932/0 (socket says 172.21.15.144:48932) 2024-09-12T12:21:47.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746ce00640 1 -- 172.21.15.144:0/836307087 learned_addr learned my addr 172.21.15.144:0/836307087 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746e200640 1 --2- 172.21.15.144:0/836307087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7468072fa0 0x7f746806f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f7467e00640 1 -- 172.21.15.144:0/836307087 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898552038 0 0) 0x7f74680734a0 con 0x7f74680d27b0 2024-09-12T12:21:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f7467e00640 1 -- 172.21.15.144:0/836307087 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7450003530 con 0x7f74680d27b0 2024-09-12T12:21:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f7467e00640 1 -- 172.21.15.144:0/836307087 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 921556336 0 0) 0x7f7468073780 con 0x7f746815e5b0 2024-09-12T12:21:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f7467e00640 1 -- 172.21.15.144:0/836307087 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74680734a0 con 0x7f746815e5b0 2024-09-12T12:21:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f7467e00640 1 -- 172.21.15.144:0/836307087 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 204191878 0 0) 0x7f7450003530 con 0x7f74680d27b0 2024-09-12T12:21:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746e200640 1 -- 172.21.15.144:0/836307087 >> v1:172.21.15.165:6789/0 conn(0x7f746815e5b0 legacy=0x7f74680d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746e200640 1 -- 172.21.15.144:0/836307087 >> v1:172.21.15.144:6789/0 conn(0x7f74680d27b0 legacy=0x7f746806d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.431+0000 7f746e200640 1 -- 172.21.15.144:0/836307087 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7468073a60 con 0x7f7468072fa0 2024-09-12T12:21:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746e200640 1 --2- 172.21.15.144:0/836307087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7468072fa0 0x7f746806f7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f74600097f0 tx=0x7f746001ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c55a2251aba0fafb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f7467e00640 1 -- 172.21.15.144:0/836307087 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600b5070 con 0x7f7468072fa0 2024-09-12T12:21:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f7467e00640 1 -- 172.21.15.144:0/836307087 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74600a8670 con 0x7f7468072fa0 2024-09-12T12:21:47.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f7467e00640 1 -- 172.21.15.144:0/836307087 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454001680 con 0x7f7468072fa0 2024-09-12T12:21:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746ec00640 1 -- 172.21.15.144:0/836307087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7468072fa0 msgr2=0x7f746806f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746ec00640 1 --2- 172.21.15.144:0/836307087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7468072fa0 0x7f746806f7f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f74600097f0 tx=0x7f746001ebf0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746ec00640 1 -- 172.21.15.144:0/836307087 shutdown_connections 2024-09-12T12:21:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746ec00640 1 --2- 172.21.15.144:0/836307087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7468072fa0 0x7f746806f7f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746ec00640 1 -- 172.21.15.144:0/836307087 >> 172.21.15.144:0/836307087 conn(0x7f7468067a00 msgr2=0x7f7468067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746ec00640 1 -- 172.21.15.144:0/836307087 shutdown_connections 2024-09-12T12:21:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746ec00640 1 -- 172.21.15.144:0/836307087 wait complete. 2024-09-12T12:21:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746ec00640 1 Processor -- start 2024-09-12T12:21:47.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.435+0000 7f746ec00640 1 -- start start 2024-09-12T12:21:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7468072fa0 0x7f7468153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74680d27b0 0x7f74681550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746815e5b0 0x7f7468145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f746815e990 con 0x7f7468072fa0 2024-09-12T12:21:47.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7468074020 con 0x7f74680d27b0 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f746806ff70 con 0x7f746815e5b0 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7468072fa0 0x7f7468153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7468072fa0 0x7f7468153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39042/0 (socket says 172.21.15.144:39042) 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746d800640 1 -- 172.21.15.144:0/3943727925 learned_addr learned my addr 172.21.15.144:0/3943727925 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ce00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74680d27b0 0x7f74681550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746e200640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746815e5b0 0x7f7468145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746d800640 1 -- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746815e5b0 msgr2=0x7f7468145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746d800640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746815e5b0 0x7f7468145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746d800640 1 -- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74680d27b0 msgr2=0x7f74681550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746d800640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74680d27b0 0x7f74681550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746d800640 1 -- 172.21.15.144:0/3943727925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7468154050 con 0x7f7468072fa0 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746e200640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746815e5b0 0x7f7468145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:47.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ce00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74680d27b0 0x7f74681550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:47.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746d800640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7468072fa0 0x7f7468153770 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c770 tx=0x7f745c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:47.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f7465600640 1 -- 172.21.15.144:0/3943727925 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c003b80 con 0x7f7468072fa0 2024-09-12T12:21:47.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f7465600640 1 -- 172.21.15.144:0/3943727925 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745c003d20 con 0x7f7468072fa0 2024-09-12T12:21:47.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7468154330 con 0x7f7468072fa0 2024-09-12T12:21:47.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f7465600640 1 -- 172.21.15.144:0/3943727925 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c00aa90 con 0x7f7468072fa0 2024-09-12T12:21:47.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7468154bd0 con 0x7f7468072fa0 2024-09-12T12:21:47.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746806f7f0 con 0x7f7468072fa0 2024-09-12T12:21:47.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.439+0000 7f7465600640 1 -- 172.21.15.144:0/3943727925 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f745c00ac30 con 0x7f7468072fa0 2024-09-12T12:21:47.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.443+0000 7f7465600640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:47.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.443+0000 7f7465600640 1 -- 172.21.15.144:0/3943727925 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f745c085dc0 con 0x7f7468072fa0 2024-09-12T12:21:47.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.443+0000 7f746ce00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:47.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.443+0000 7f746ce00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f74681595d0 tx=0x7f7454009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:47.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.447+0000 7f7465600640 1 -- 172.21.15.144:0/3943727925 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f745c056760 con 0x7f7468072fa0 2024-09-12T12:21:47.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.667+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7468154500 con 0x7f7468072fa0 2024-09-12T12:21:47.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.667+0000 7f7465600640 1 -- 172.21.15.144:0/3943727925 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7f745c056060 con 0x7f7468072fa0 2024-09-12T12:21:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:47.669 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":567,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076442083,"bytes_used":2551767040,"bytes_avail":770542346240,"bytes_total":773094113280,"write_bytes_sec":24520894,"read_op_per_sec":0,"write_op_per_sec":24},"fsmap":{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8391}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-12T12:21:45.491668+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 msgr2=0x7f7448069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f74681595d0 tx=0x7f7454009040 comp rx=0 tx=0).stop 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7468072fa0 msgr2=0x7f7468153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7468072fa0 0x7f7468153770 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c770 tx=0x7f745c00cc30 comp rx=0 tx=0).stop 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 shutdown_connections 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74480678c0 0x7f7448069d80 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f746815e5b0 0x7f7468145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74680d27b0 0x7f74681550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 --2- 172.21.15.144:0/3943727925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7468072fa0 0x7f7468153770 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 >> 172.21.15.144:0/3943727925 conn(0x7f7468067a00 msgr2=0x7f746815b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 shutdown_connections 2024-09-12T12:21:47.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:47.671+0000 7f746ec00640 1 -- 172.21.15.144:0/3943727925 wait complete. 2024-09-12T12:21:47.690 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-12T12:21:48.691 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:48.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6081400640 1 Processor -- start 2024-09-12T12:21:48.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6081400640 1 -- start start 2024-09-12T12:21:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6081400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f607c0b4db0 0x7f607c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6081400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f607c06c150 0x7f607c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6081400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c06c570 con 0x7f607c147fa0 2024-09-12T12:21:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6081400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f607c0b51f0 con 0x7f607c0b4db0 2024-09-12T12:21:48.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6081400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f607c148380 con 0x7f607c06c150 2024-09-12T12:21:48.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f607a800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f607c147fa0 0x7f607c0b2850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48944/0 (socket says 172.21.15.144:48944) 2024-09-12T12:21:48.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f607a800640 1 -- 172.21.15.144:0/834819473 learned_addr learned my addr 172.21.15.144:0/834819473 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:48.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6079e00640 1 --2- 172.21.15.144:0/834819473 >> v2:172.21.15.144:3300/0 conn(0x7f607c0b4db0 0x7f607c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:48.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f607b200640 1 --2- 172.21.15.144:0/834819473 >> v2:172.21.15.165:3300/0 conn(0x7f607c06c150 0x7f607c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:48.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6079400640 1 -- 172.21.15.144:0/834819473 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2971270445 0 0) 0x7f607c06c570 con 0x7f607c147fa0 2024-09-12T12:21:48.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6079400640 1 -- 172.21.15.144:0/834819473 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6060003530 con 0x7f607c147fa0 2024-09-12T12:21:48.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6079e00640 1 -- 172.21.15.144:0/834819473 >> v2:172.21.15.165:3300/0 conn(0x7f607c06c150 msgr2=0x7f607c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:48.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6079e00640 1 --2- 172.21.15.144:0/834819473 >> v2:172.21.15.165:3300/0 conn(0x7f607c06c150 0x7f607c0d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:48.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6079e00640 1 -- 172.21.15.144:0/834819473 >> v1:172.21.15.144:6789/0 conn(0x7f607c147fa0 legacy=0x7f607c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:48.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.838+0000 7f6079e00640 1 -- 172.21.15.144:0/834819473 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c162110 con 0x7f607c0b4db0 2024-09-12T12:21:48.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6079e00640 1 --2- 172.21.15.144:0/834819473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 0x7f607c06bc10 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f607c0b27d0 tx=0x7f606801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95af2b0fe7e7baa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:48.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6079400640 1 -- 172.21.15.144:0/834819473 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680b1070 con 0x7f607c0b4db0 2024-09-12T12:21:48.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6079400640 1 -- 172.21.15.144:0/834819473 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60680ac600 con 0x7f607c0b4db0 2024-09-12T12:21:48.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6079400640 1 -- 172.21.15.144:0/834819473 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680ac9b0 con 0x7f607c0b4db0 2024-09-12T12:21:48.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6081400640 1 -- 172.21.15.144:0/834819473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 msgr2=0x7f607c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:48.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6081400640 1 --2- 172.21.15.144:0/834819473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 0x7f607c06bc10 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f607c0b27d0 tx=0x7f606801c3a0 comp rx=0 tx=0).stop 2024-09-12T12:21:48.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6081400640 1 -- 172.21.15.144:0/834819473 shutdown_connections 2024-09-12T12:21:48.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6081400640 1 --2- 172.21.15.144:0/834819473 >> v2:172.21.15.165:3300/0 conn(0x7f607c06c150 0x7f607c0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6081400640 1 --2- 172.21.15.144:0/834819473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 0x7f607c06bc10 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6081400640 1 -- 172.21.15.144:0/834819473 >> 172.21.15.144:0/834819473 conn(0x7f607c0b3280 msgr2=0x7f607c0b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6081400640 1 -- 172.21.15.144:0/834819473 shutdown_connections 2024-09-12T12:21:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.842+0000 7f6081400640 1 -- 172.21.15.144:0/834819473 wait complete. 2024-09-12T12:21:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 Processor -- start 2024-09-12T12:21:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 -- start start 2024-09-12T12:21:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f607c06c150 0x7f607c15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 0x7f607c13f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f607c147fa0 0x7f607c13f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f607c162f70 con 0x7f607c0b4db0 2024-09-12T12:21:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f607c162c90 con 0x7f607c147fa0 2024-09-12T12:21:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f607c0b2f60 con 0x7f607c06c150 2024-09-12T12:21:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6079e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 0x7f607c13f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6079e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 0x7f607c13f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39062/0 (socket says 172.21.15.144:39062) 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6079e00640 1 -- 172.21.15.144:0/1249009963 learned_addr learned my addr 172.21.15.144:0/1249009963 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f607b200640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f607c147fa0 0x7f607c13f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f607a800640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f607c06c150 0x7f607c15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6079e00640 1 -- 172.21.15.144:0/1249009963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f607c06c150 msgr2=0x7f607c15b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6079e00640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f607c06c150 0x7f607c15b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6079e00640 1 -- 172.21.15.144:0/1249009963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f607c147fa0 msgr2=0x7f607c13f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6079e00640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f607c147fa0 0x7f607c13f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6079e00640 1 -- 172.21.15.144:0/1249009963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c1440e0 con 0x7f607c0b4db0 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6079e00640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 0x7f607c13f100 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f6068019fd0 tx=0x7f606801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6072a00640 1 -- 172.21.15.144:0/1249009963 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680b1040 con 0x7f607c0b4db0 2024-09-12T12:21:48.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6072a00640 1 -- 172.21.15.144:0/1249009963 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60680ac400 con 0x7f607c0b4db0 2024-09-12T12:21:48.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6072a00640 1 -- 172.21.15.144:0/1249009963 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680b7670 con 0x7f607c0b4db0 2024-09-12T12:21:48.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607c1443c0 con 0x7f607c0b4db0 2024-09-12T12:21:48.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607c144980 con 0x7f607c0b4db0 2024-09-12T12:21:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.846+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607c0d0630 con 0x7f607c0b4db0 2024-09-12T12:21:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.850+0000 7f6072a00640 1 -- 172.21.15.144:0/1249009963 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60680bf3c0 con 0x7f607c0b4db0 2024-09-12T12:21:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.850+0000 7f6072a00640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f605c0678c0 0x7f605c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.850+0000 7f6072a00640 1 -- 172.21.15.144:0/1249009963 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f606811f790 con 0x7f607c0b4db0 2024-09-12T12:21:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.850+0000 7f607a800640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f605c0678c0 0x7f605c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.850+0000 7f607a800640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f605c0678c0 0x7f605c069d80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f606c005890 tx=0x7f606c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:48.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:48.854+0000 7f6072a00640 1 -- 172.21.15.144:0/1249009963 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6068016050 con 0x7f607c0b4db0 2024-09-12T12:21:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f607c13cf00 con 0x7f607c0b4db0 2024-09-12T12:21:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6072a00640 1 -- 172.21.15.144:0/1249009963 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7f60680f0130 con 0x7f607c0b4db0 2024-09-12T12:21:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:49.047 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:49.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f605c0678c0 msgr2=0x7f605c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:49.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f605c0678c0 0x7f605c069d80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f606c005890 tx=0x7f606c009040 comp rx=0 tx=0).stop 2024-09-12T12:21:49.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 msgr2=0x7f607c13f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 0x7f607c13f100 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f6068019fd0 tx=0x7f606801abe0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 shutdown_connections 2024-09-12T12:21:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f605c0678c0 0x7f605c069d80 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f607c147fa0 0x7f607c13f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f607c0b4db0 0x7f607c13f100 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 --2- 172.21.15.144:0/1249009963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f607c06c150 0x7f607c15b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 >> 172.21.15.144:0/1249009963 conn(0x7f607c0b3280 msgr2=0x7f607c073710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 shutdown_connections 2024-09-12T12:21:49.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.046+0000 7f6081400640 1 -- 172.21.15.144:0/1249009963 wait complete. 2024-09-12T12:21:49.068 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-12T12:21:49.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:21:49.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff89400640 1 Processor -- start 2024-09-12T12:21:49.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff89400640 1 -- start start 2024-09-12T12:21:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff89400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff84147180 0x7eff84147560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff89400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff840cefa0 con 0x7eff840aefa0 2024-09-12T12:21:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff89400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff840cf280 con 0x7eff840b2820 2024-09-12T12:21:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff89400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7eff840ced70 con 0x7eff84147180 2024-09-12T12:21:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff83e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff84147180 0x7eff84147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff88a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7eff840aefa0 0x7eff840b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48946/0 (socket says 172.21.15.144:48946) 2024-09-12T12:21:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff88a00640 1 -- 172.21.15.144:0/1729312162 learned_addr learned my addr 172.21.15.144:0/1729312162 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.202+0000 7eff83e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff84147180 0x7eff84147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39072/0 (socket says 172.21.15.144:39072) 2024-09-12T12:21:49.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff83e00640 1 -- 172.21.15.144:0/1729312162 >> v1:172.21.15.165:6789/0 conn(0x7eff840b2820 legacy=0x7eff840ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:49.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff83e00640 1 -- 172.21.15.144:0/1729312162 >> v1:172.21.15.144:6789/0 conn(0x7eff840aefa0 legacy=0x7eff840b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:49.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff83e00640 1 -- 172.21.15.144:0/1729312162 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff840cf560 con 0x7eff84147180 2024-09-12T12:21:49.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff83400640 1 -- 172.21.15.144:0/1729312162 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325590788 0 0) 0x7eff840cefa0 con 0x7eff840aefa0 2024-09-12T12:21:49.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff83e00640 1 --2- 172.21.15.144:0/1729312162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 0x7eff84147560 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7eff74009d90 tx=0x7eff7401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55db032f63f198e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff83400640 1 -- 172.21.15.144:0/1729312162 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740b2070 con 0x7eff84147180 2024-09-12T12:21:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff83400640 1 -- 172.21.15.144:0/1729312162 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff740a58b0 con 0x7eff84147180 2024-09-12T12:21:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff83400640 1 -- 172.21.15.144:0/1729312162 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740a5c80 con 0x7eff84147180 2024-09-12T12:21:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff89400640 1 -- 172.21.15.144:0/1729312162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 msgr2=0x7eff84147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff89400640 1 --2- 172.21.15.144:0/1729312162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 0x7eff84147560 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7eff74009d90 tx=0x7eff7401c8e0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff89400640 1 -- 172.21.15.144:0/1729312162 shutdown_connections 2024-09-12T12:21:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff89400640 1 --2- 172.21.15.144:0/1729312162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 0x7eff84147560 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff89400640 1 -- 172.21.15.144:0/1729312162 >> 172.21.15.144:0/1729312162 conn(0x7eff8406bc10 msgr2=0x7eff8406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:49.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff89400640 1 -- 172.21.15.144:0/1729312162 shutdown_connections 2024-09-12T12:21:49.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.206+0000 7eff89400640 1 -- 172.21.15.144:0/1729312162 wait complete. 2024-09-12T12:21:49.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 Processor -- start 2024-09-12T12:21:49.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 -- start start 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff840aefa0 0x7eff841421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff840b2820 0x7eff841428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 0x7eff84161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff840b4a00 con 0x7eff84147180 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7eff840b4880 con 0x7eff840b2820 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff8416c150 con 0x7eff840aefa0 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff88a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 0x7eff84161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff7b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff840b2820 0x7eff841428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff83e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff840aefa0 0x7eff841421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff88a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 0x7eff84161150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39080/0 (socket says 172.21.15.144:39080) 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff88a00640 1 -- 172.21.15.144:0/1787970958 learned_addr learned my addr 172.21.15.144:0/1787970958 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:49.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff88a00640 1 -- 172.21.15.144:0/1787970958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff840aefa0 msgr2=0x7eff841421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff88a00640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff840aefa0 0x7eff841421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff88a00640 1 -- 172.21.15.144:0/1787970958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff840b2820 msgr2=0x7eff841428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff88a00640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff840b2820 0x7eff841428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff88a00640 1 -- 172.21.15.144:0/1787970958 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff84163280 con 0x7eff84147180 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff88a00640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 0x7eff84161150 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c410 tx=0x7eff7c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff80c00640 1 -- 172.21.15.144:0/1787970958 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0074e0 con 0x7eff84147180 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff80c00640 1 -- 172.21.15.144:0/1787970958 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c0047f0 con 0x7eff84147180 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff80c00640 1 -- 172.21.15.144:0/1787970958 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c007680 con 0x7eff84147180 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff84163560 con 0x7eff84147180 2024-09-12T12:21:49.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.210+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff84163b20 con 0x7eff84147180 2024-09-12T12:21:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.214+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff84147560 con 0x7eff84147180 2024-09-12T12:21:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.214+0000 7eff80c00640 1 -- 172.21.15.144:0/1787970958 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff7c011070 con 0x7eff84147180 2024-09-12T12:21:49.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.214+0000 7eff80c00640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7eff600678c0 0x7eff60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.214+0000 7eff80c00640 1 -- 172.21.15.144:0/1787970958 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7eff7c085770 con 0x7eff84147180 2024-09-12T12:21:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.214+0000 7eff83e00640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7eff600678c0 0x7eff60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:49.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.214+0000 7eff83e00640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7eff600678c0 0x7eff60069d80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7eff740af000 tx=0x7eff740a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:49.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.218+0000 7eff80c00640 1 -- 172.21.15.144:0/1787970958 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff7c055b60 con 0x7eff84147180 2024-09-12T12:21:49.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.446+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7eff840b3910 con 0x7eff84147180 2024-09-12T12:21:49.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.446+0000 7eff80c00640 1 -- 172.21.15.144:0/1787970958 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7eff7c059e60 con 0x7eff84147180 2024-09-12T12:21:49.450 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:49.450 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":569,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076442083,"bytes_used":2551767040,"bytes_avail":770542346240,"bytes_total":773094113280,"write_bytes_sec":24520894,"read_op_per_sec":0,"write_op_per_sec":24},"fsmap":{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8391}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-12T12:21:45.491668+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:21:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7eff600678c0 msgr2=0x7eff60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7eff600678c0 0x7eff60069d80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7eff740af000 tx=0x7eff740a7070 comp rx=0 tx=0).stop 2024-09-12T12:21:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 msgr2=0x7eff84161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 0x7eff84161150 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c410 tx=0x7eff7c00c810 comp rx=0 tx=0).stop 2024-09-12T12:21:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 shutdown_connections 2024-09-12T12:21:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7eff600678c0 0x7eff60069d80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff84147180 0x7eff84161150 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff840b2820 0x7eff841428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 --2- 172.21.15.144:0/1787970958 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff840aefa0 0x7eff841421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:49.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 >> 172.21.15.144:0/1787970958 conn(0x7eff8406bc10 msgr2=0x7eff84169940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:49.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 shutdown_connections 2024-09-12T12:21:49.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:49.450+0000 7eff89400640 1 -- 172.21.15.144:0/1787970958 wait complete. 2024-09-12T12:21:49.471 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-12T12:21:50.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:50.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7fecd3000640 1 Processor -- start 2024-09-12T12:21:50.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7fecd3000640 1 -- start start 2024-09-12T12:21:50.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7fecd3000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feccc15c7b0 0x7feccc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7fecd3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 0x7feccc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7fecd3000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feccc0cd870 con 0x7feccc15cd30 2024-09-12T12:21:50.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7fecd3000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7feccc072a50 con 0x7feccc15c7b0 2024-09-12T12:21:50.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7fecd3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feccc0cde30 con 0x7feccc0b5fb0 2024-09-12T12:21:50.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7feccbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feccc15c7b0 0x7feccc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7feccbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feccc15c7b0 0x7feccc0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:57758/0 (socket says 172.21.15.144:57758) 2024-09-12T12:21:50.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7feccbe00640 1 -- 172.21.15.144:0/1730006707 learned_addr learned my addr 172.21.15.144:0/1730006707 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:50.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7fecd1000640 1 --2- 172.21.15.144:0/1730006707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 0x7feccc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7feccbe00640 1 -- 172.21.15.144:0/1730006707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 msgr2=0x7feccc072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:50.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7feccbe00640 1 --2- 172.21.15.144:0/1730006707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 0x7feccc072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7feccbe00640 1 -- 172.21.15.144:0/1730006707 >> v1:172.21.15.165:6789/0 conn(0x7feccc15cd30 legacy=0x7feccc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.610+0000 7feccbe00640 1 -- 172.21.15.144:0/1730006707 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc0cdb50 con 0x7feccc15c7b0 2024-09-12T12:21:50.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7feccbe00640 1 --2- 172.21.15.144:0/1730006707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feccc15c7b0 0x7feccc0ccf00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009870 tx=0x7fecbc01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=730301ba48c2ada1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7feccb400640 1 -- 172.21.15.144:0/1730006707 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0a7070 con 0x7feccc15c7b0 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7feccb400640 1 -- 172.21.15.144:0/1730006707 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc0b0070 con 0x7feccc15c7b0 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7feccb400640 1 -- 172.21.15.144:0/1730006707 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0ab890 con 0x7feccc15c7b0 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7fecd3000640 1 -- 172.21.15.144:0/1730006707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feccc15c7b0 msgr2=0x7feccc0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7fecd3000640 1 --2- 172.21.15.144:0/1730006707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feccc15c7b0 0x7feccc0ccf00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009870 tx=0x7fecbc01c560 comp rx=0 tx=0).stop 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7fecd3000640 1 -- 172.21.15.144:0/1730006707 shutdown_connections 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7fecd3000640 1 --2- 172.21.15.144:0/1730006707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 0x7feccc072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7fecd3000640 1 --2- 172.21.15.144:0/1730006707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feccc15c7b0 0x7feccc0ccf00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7fecd3000640 1 -- 172.21.15.144:0/1730006707 >> 172.21.15.144:0/1730006707 conn(0x7feccc06d0d0 msgr2=0x7feccc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7fecd3000640 1 -- 172.21.15.144:0/1730006707 shutdown_connections 2024-09-12T12:21:50.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7fecd3000640 1 -- 172.21.15.144:0/1730006707 wait complete. 2024-09-12T12:21:50.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.614+0000 7fecd3000640 1 Processor -- start 2024-09-12T12:21:50.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 -- start start 2024-09-12T12:21:50.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 0x7feccc1fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feccc15c7b0 0x7feccc144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feccc15cd30 0x7feccc147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feccc073fc0 con 0x7feccc15c7b0 2024-09-12T12:21:50.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feccc073e40 con 0x7feccc15cd30 2024-09-12T12:21:50.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feccc074140 con 0x7feccc0b5fb0 2024-09-12T12:21:50.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecc3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feccc15c7b0 0x7feccc144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecc3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feccc15c7b0 0x7feccc144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39082/0 (socket says 172.21.15.144:39082) 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecc3e00640 1 -- 172.21.15.144:0/3573045431 learned_addr learned my addr 172.21.15.144:0/3573045431 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7feccbe00640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 0x7feccc1fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd1000640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feccc15cd30 0x7feccc147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7feccbe00640 1 -- 172.21.15.144:0/3573045431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feccc15cd30 msgr2=0x7feccc147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7feccbe00640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feccc15cd30 0x7feccc147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7feccbe00640 1 -- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feccc15c7b0 msgr2=0x7feccc144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7feccbe00640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feccc15c7b0 0x7feccc144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7feccbe00640 1 -- 172.21.15.144:0/3573045431 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc144e00 con 0x7feccc0b5fb0 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecc3e00640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feccc15c7b0 0x7feccc144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:50.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7feccbe00640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 0x7feccc1fbbc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0ac000 tx=0x7fecbc01ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:50.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecc8c00640 1 -- 172.21.15.144:0/3573045431 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0be5f0 con 0x7feccc0b5fb0 2024-09-12T12:21:50.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecc8c00640 1 -- 172.21.15.144:0/3573045431 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc0be7b0 con 0x7feccc0b5fb0 2024-09-12T12:21:50.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc1450e0 con 0x7feccc0b5fb0 2024-09-12T12:21:50.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecc8c00640 1 -- 172.21.15.144:0/3573045431 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0beba0 con 0x7feccc0b5fb0 2024-09-12T12:21:50.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc0b4320 con 0x7feccc0b5fb0 2024-09-12T12:21:50.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.618+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feccc072ee0 con 0x7feccc0b5fb0 2024-09-12T12:21:50.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.622+0000 7fecc8c00640 1 -- 172.21.15.144:0/3573045431 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fecbc0c9470 con 0x7feccc0b5fb0 2024-09-12T12:21:50.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.622+0000 7fecc8c00640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca80678c0 0x7feca8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.622+0000 7fecc8c00640 1 -- 172.21.15.144:0/3573045431 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fecbc120cb0 con 0x7feccc0b5fb0 2024-09-12T12:21:50.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.622+0000 7fecc3e00640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca80678c0 0x7feca8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.622+0000 7fecc3e00640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca80678c0 0x7feca8069d80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feccc0b3c20 tx=0x7fecb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:50.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.626+0000 7fecc8c00640 1 -- 172.21.15.144:0/3573045431 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fecbc0c4060 con 0x7feccc0b5fb0 2024-09-12T12:21:50.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.818+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feccc15e480 con 0x7feccc0b5fb0 2024-09-12T12:21:50.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.818+0000 7fecc8c00640 1 -- 172.21.15.144:0/3573045431 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7fecbc016150 con 0x7feccc0b5fb0 2024-09-12T12:21:50.821 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:50.821 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:50.821 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:50.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca80678c0 msgr2=0x7feca8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca80678c0 0x7feca8069d80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feccc0b3c20 tx=0x7fecb4009040 comp rx=0 tx=0).stop 2024-09-12T12:21:50.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 msgr2=0x7feccc1fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 0x7feccc1fbbc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0ac000 tx=0x7fecbc01ada0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 shutdown_connections 2024-09-12T12:21:50.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feca80678c0 0x7feca8069d80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feccc15cd30 0x7feccc147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feccc15c7b0 0x7feccc144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 --2- 172.21.15.144:0/3573045431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feccc0b5fb0 0x7feccc1fbbc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 >> 172.21.15.144:0/3573045431 conn(0x7feccc06d0d0 msgr2=0x7feccc0ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:50.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 shutdown_connections 2024-09-12T12:21:50.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.822+0000 7fecd3000640 1 -- 172.21.15.144:0/3573045431 wait complete. 2024-09-12T12:21:50.842 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-12T12:21:50.842 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:21:50.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.974+0000 7fcd6fc00640 1 Processor -- start 2024-09-12T12:21:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6fc00640 1 -- start start 2024-09-12T12:21:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6fc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcd6815e7e0 0x7fcd680b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd680d1c70 0x7fcd680b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6fc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd6806e210 con 0x7fcd680b55b0 2024-09-12T12:21:50.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6fc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcd680b7710 con 0x7fcd6815e7e0 2024-09-12T12:21:50.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcd68073f60 con 0x7fcd680d1c70 2024-09-12T12:21:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcd6815e7e0 0x7fcd680b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd680d1c70 0x7fcd680b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcd6815e7e0 0x7fcd680b6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:57782/0 (socket says 172.21.15.144:57782) 2024-09-12T12:21:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6d200640 1 -- 172.21.15.144:0/2670019422 learned_addr learned my addr 172.21.15.144:0/2670019422 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6d200640 1 -- 172.21.15.144:0/2670019422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd680d1c70 msgr2=0x7fcd680b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6d200640 1 --2- 172.21.15.144:0/2670019422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd680d1c70 0x7fcd680b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6d200640 1 -- 172.21.15.144:0/2670019422 >> v1:172.21.15.165:6789/0 conn(0x7fcd680b55b0 legacy=0x7fcd680709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6d200640 1 -- 172.21.15.144:0/2670019422 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6806e700 con 0x7fcd6815e7e0 2024-09-12T12:21:50.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd67400640 1 -- 172.21.15.144:0/2670019422 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 677744228 0 0) 0x7fcd6806e210 con 0x7fcd680b55b0 2024-09-12T12:21:50.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.978+0000 7fcd6dc00640 1 --2- 172.21.15.144:0/2670019422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd680d1c70 0x7fcd680b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:50.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6d200640 1 --2- 172.21.15.144:0/2670019422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd6815e7e0 0x7fcd680b6c90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009870 tx=0x7fcd5801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b5c2fff5551cef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:50.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd67400640 1 -- 172.21.15.144:0/2670019422 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd580ab610 con 0x7fcd6815e7e0 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd67400640 1 -- 172.21.15.144:0/2670019422 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd580b0070 con 0x7fcd6815e7e0 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd67400640 1 -- 172.21.15.144:0/2670019422 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd580ab9d0 con 0x7fcd6815e7e0 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6fc00640 1 -- 172.21.15.144:0/2670019422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd6815e7e0 msgr2=0x7fcd680b6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6fc00640 1 --2- 172.21.15.144:0/2670019422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd6815e7e0 0x7fcd680b6c90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009870 tx=0x7fcd5801c4d0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6fc00640 1 -- 172.21.15.144:0/2670019422 shutdown_connections 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6fc00640 1 --2- 172.21.15.144:0/2670019422 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd680d1c70 0x7fcd680b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6fc00640 1 --2- 172.21.15.144:0/2670019422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd6815e7e0 0x7fcd680b6c90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6fc00640 1 -- 172.21.15.144:0/2670019422 >> 172.21.15.144:0/2670019422 conn(0x7fcd680d2500 msgr2=0x7fcd680d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6fc00640 1 -- 172.21.15.144:0/2670019422 shutdown_connections 2024-09-12T12:21:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6fc00640 1 -- 172.21.15.144:0/2670019422 wait complete. 2024-09-12T12:21:50.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.982+0000 7fcd6fc00640 1 Processor -- start 2024-09-12T12:21:50.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 -- start start 2024-09-12T12:21:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd680b55b0 0x7fcd68144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd680d1c70 0x7fcd68153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd6815e7e0 0x7fcd681fa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6815ebc0 con 0x7fcd680b55b0 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68073bf0 con 0x7fcd680d1c70 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcd6815ed40 con 0x7fcd6815e7e0 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd680b55b0 0x7fcd68144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd680b55b0 0x7fcd68144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39086/0 (socket says 172.21.15.144:39086) 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6d200640 1 -- 172.21.15.144:0/3302016468 learned_addr learned my addr 172.21.15.144:0/3302016468 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6dc00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd6815e7e0 0x7fcd681fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd67e00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd680d1c70 0x7fcd68153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6d200640 1 -- 172.21.15.144:0/3302016468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd6815e7e0 msgr2=0x7fcd681fa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6d200640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd6815e7e0 0x7fcd681fa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6d200640 1 -- 172.21.15.144:0/3302016468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd680d1c70 msgr2=0x7fcd68153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6d200640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd680d1c70 0x7fcd68153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6d200640 1 -- 172.21.15.144:0/3302016468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd68152890 con 0x7fcd680b55b0 2024-09-12T12:21:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6d200640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd680b55b0 0x7fcd68144dd0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fcd580ad040 tx=0x7fcd5801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd64c00640 1 -- 172.21.15.144:0/3302016468 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd580abe60 con 0x7fcd680b55b0 2024-09-12T12:21:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd64c00640 1 -- 172.21.15.144:0/3302016468 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd580be610 con 0x7fcd680b55b0 2024-09-12T12:21:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd64c00640 1 -- 172.21.15.144:0/3302016468 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd580bea00 con 0x7fcd680b55b0 2024-09-12T12:21:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd681522d0 con 0x7fcd680b55b0 2024-09-12T12:21:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd68147130 con 0x7fcd680b55b0 2024-09-12T12:21:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.986+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd680709a0 con 0x7fcd680b55b0 2024-09-12T12:21:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.990+0000 7fcd64c00640 1 -- 172.21.15.144:0/3302016468 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd580b43f0 con 0x7fcd680b55b0 2024-09-12T12:21:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.990+0000 7fcd64c00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd480678f0 0x7fcd48069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.990+0000 7fcd64c00640 1 -- 172.21.15.144:0/3302016468 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fcd581202a0 con 0x7fcd680b55b0 2024-09-12T12:21:50.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.990+0000 7fcd67e00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd480678f0 0x7fcd48069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:50.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.990+0000 7fcd67e00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd480678f0 0x7fcd48069db0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcd68152ed0 tx=0x7fcd54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:50.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:50.994+0000 7fcd64c00640 1 -- 172.21.15.144:0/3302016468 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcd580c4060 con 0x7fcd680b55b0 2024-09-12T12:21:51.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcd68152660 con 0x7fcd680b55b0 2024-09-12T12:21:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd64c00640 1 -- 172.21.15.144:0/3302016468 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fcd580a8050 con 0x7fcd680b55b0 2024-09-12T12:21:51.208 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:51.208 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":570,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076442083,"bytes_used":2551767040,"bytes_avail":770542346240,"bytes_total":773094113280,"write_bytes_sec":24521161,"read_op_per_sec":0,"write_op_per_sec":24},"fsmap":{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8391}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-12T12:21:45.491668+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:21:51.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd480678f0 msgr2=0x7fcd48069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:51.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd480678f0 0x7fcd48069db0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcd68152ed0 tx=0x7fcd54009040 comp rx=0 tx=0).stop 2024-09-12T12:21:51.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd680b55b0 msgr2=0x7fcd68144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:51.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd680b55b0 0x7fcd68144dd0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fcd580ad040 tx=0x7fcd5801ad10 comp rx=0 tx=0).stop 2024-09-12T12:21:51.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 shutdown_connections 2024-09-12T12:21:51.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd480678f0 0x7fcd48069db0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd6815e7e0 0x7fcd681fa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd680d1c70 0x7fcd68153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 --2- 172.21.15.144:0/3302016468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd680b55b0 0x7fcd68144dd0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.206+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 >> 172.21.15.144:0/3302016468 conn(0x7fcd680d2500 msgr2=0x7fcd6814fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.210+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 shutdown_connections 2024-09-12T12:21:51.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:51.210+0000 7fcd6fc00640 1 -- 172.21.15.144:0/3302016468 wait complete. 2024-09-12T12:21:51.229 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-12T12:21:52.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:52.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.374+0000 7fd157c00640 1 Processor -- start 2024-09-12T12:21:52.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.374+0000 7fd157c00640 1 -- start start 2024-09-12T12:21:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd157c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd15015e5f0 0x7fd15006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd157c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd1500b44a0 0x7fd1500b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd157c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 0x7fd15006e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd157c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd15006ecb0 con 0x7fd15015e5f0 2024-09-12T12:21:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd157c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd15006d260 con 0x7fd1500b44a0 2024-09-12T12:21:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd157c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd1500b6f60 con 0x7fd15006e300 2024-09-12T12:21:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd155200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd15015e5f0 0x7fd15006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd155200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd15015e5f0 0x7fd15006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39102/0 (socket says 172.21.15.144:39102) 2024-09-12T12:21:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd155200640 1 -- 172.21.15.144:0/3959421766 learned_addr learned my addr 172.21.15.144:0/3959421766 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd14fe00640 1 --2- 172.21.15.144:0/3959421766 >> v2:172.21.15.165:3300/0 conn(0x7fd1500b44a0 0x7fd1500b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd155c00640 1 --2- 172.21.15.144:0/3959421766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 0x7fd15006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd155200640 1 -- 172.21.15.144:0/3959421766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 msgr2=0x7fd15006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd155200640 1 --2- 172.21.15.144:0/3959421766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 0x7fd15006e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd155200640 1 -- 172.21.15.144:0/3959421766 >> v2:172.21.15.165:3300/0 conn(0x7fd1500b44a0 msgr2=0x7fd1500b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd155200640 1 --2- 172.21.15.144:0/3959421766 >> v2:172.21.15.165:3300/0 conn(0x7fd1500b44a0 0x7fd1500b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.378+0000 7fd155200640 1 -- 172.21.15.144:0/3959421766 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1500b7240 con 0x7fd15015e5f0 2024-09-12T12:21:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd155200640 1 --2- 172.21.15.144:0/3959421766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd15015e5f0 0x7fd15006cd20 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd1500b5570 tx=0x7fd14401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270dec6169fce40b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd14f400640 1 -- 172.21.15.144:0/3959421766 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1440aa610 con 0x7fd15015e5f0 2024-09-12T12:21:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd14f400640 1 -- 172.21.15.144:0/3959421766 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1440af070 con 0x7fd15015e5f0 2024-09-12T12:21:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd14f400640 1 -- 172.21.15.144:0/3959421766 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1440aa9d0 con 0x7fd15015e5f0 2024-09-12T12:21:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 -- 172.21.15.144:0/3959421766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd15015e5f0 msgr2=0x7fd15006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 --2- 172.21.15.144:0/3959421766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd15015e5f0 0x7fd15006cd20 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd1500b5570 tx=0x7fd14401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 -- 172.21.15.144:0/3959421766 shutdown_connections 2024-09-12T12:21:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 --2- 172.21.15.144:0/3959421766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 0x7fd15006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 --2- 172.21.15.144:0/3959421766 >> v2:172.21.15.165:3300/0 conn(0x7fd1500b44a0 0x7fd1500b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 --2- 172.21.15.144:0/3959421766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd15015e5f0 0x7fd15006cd20 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 -- 172.21.15.144:0/3959421766 >> 172.21.15.144:0/3959421766 conn(0x7fd15006f400 msgr2=0x7fd15006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 -- 172.21.15.144:0/3959421766 shutdown_connections 2024-09-12T12:21:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 -- 172.21.15.144:0/3959421766 wait complete. 2024-09-12T12:21:52.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.382+0000 7fd157c00640 1 Processor -- start 2024-09-12T12:21:52.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 -- start start 2024-09-12T12:21:52.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 0x7fd150150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1500b44a0 0x7fd15014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd15015e5f0 0x7fd15015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd1500b6d10 con 0x7fd1500b44a0 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1500b6b90 con 0x7fd15015e5f0 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd15015f720 con 0x7fd15006e300 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1500b44a0 0x7fd15014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1500b44a0 0x7fd15014e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39106/0 (socket says 172.21.15.144:39106) 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14fe00640 1 -- 172.21.15.144:0/2013569769 learned_addr learned my addr 172.21.15.144:0/2013569769 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd155200640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 0x7fd150150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd155c00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd15015e5f0 0x7fd15015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14fe00640 1 -- 172.21.15.144:0/2013569769 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 msgr2=0x7fd150150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14fe00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 0x7fd150150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14fe00640 1 -- 172.21.15.144:0/2013569769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd15015e5f0 msgr2=0x7fd15015cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14fe00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd15015e5f0 0x7fd15015cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14fe00640 1 -- 172.21.15.144:0/2013569769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15015d200 con 0x7fd1500b44a0 2024-09-12T12:21:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14fe00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1500b44a0 0x7fd15014e820 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00e930 tx=0x7fd13c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14cc00640 1 -- 172.21.15.144:0/2013569769 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c017070 con 0x7fd1500b44a0 2024-09-12T12:21:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd150153860 con 0x7fd1500b44a0 2024-09-12T12:21:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14cc00640 1 -- 172.21.15.144:0/2013569769 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd13c00ca00 con 0x7fd1500b44a0 2024-09-12T12:21:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd14cc00640 1 -- 172.21.15.144:0/2013569769 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00cdb0 con 0x7fd1500b44a0 2024-09-12T12:21:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd150153e20 con 0x7fd1500b44a0 2024-09-12T12:21:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.386+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1500b48d0 con 0x7fd1500b44a0 2024-09-12T12:21:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.390+0000 7fd14cc00640 1 -- 172.21.15.144:0/2013569769 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd13c01a070 con 0x7fd1500b44a0 2024-09-12T12:21:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.390+0000 7fd14cc00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1300678f0 0x7fd130069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.390+0000 7fd14cc00640 1 -- 172.21.15.144:0/2013569769 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fd13c086120 con 0x7fd1500b44a0 2024-09-12T12:21:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.390+0000 7fd155200640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1300678f0 0x7fd130069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.390+0000 7fd155200640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1300678f0 0x7fd130069db0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd1440ae000 tx=0x7fd1440a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.394+0000 7fd14cc00640 1 -- 172.21.15.144:0/2013569769 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd13c056530 con 0x7fd1500b44a0 2024-09-12T12:21:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.582+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd150155910 con 0x7fd1500b44a0 2024-09-12T12:21:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd14cc00640 1 -- 172.21.15.144:0/2013569769 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7fd13c05a830 con 0x7fd1500b44a0 2024-09-12T12:21:52.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:52.586 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1300678f0 msgr2=0x7fd130069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1300678f0 0x7fd130069db0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd1440ae000 tx=0x7fd1440a7000 comp rx=0 tx=0).stop 2024-09-12T12:21:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1500b44a0 msgr2=0x7fd15014e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1500b44a0 0x7fd15014e820 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00e930 tx=0x7fd13c00edf0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 shutdown_connections 2024-09-12T12:21:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd1300678f0 0x7fd130069db0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd15015e5f0 0x7fd15015cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1500b44a0 0x7fd15014e820 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 --2- 172.21.15.144:0/2013569769 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd15006e300 0x7fd150150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 >> 172.21.15.144:0/2013569769 conn(0x7fd15006f400 msgr2=0x7fd1500b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 shutdown_connections 2024-09-12T12:21:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.586+0000 7fd157c00640 1 -- 172.21.15.144:0/2013569769 wait complete. 2024-09-12T12:21:52.607 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-12T12:21:52.607 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:21:52.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.738+0000 7fcf79a00640 1 Processor -- start 2024-09-12T12:21:52.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.738+0000 7fcf79a00640 1 -- start start 2024-09-12T12:21:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf79a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcf740aff50 0x7fcf74072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf79a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf7415f800 con 0x7fcf7406ea40 2024-09-12T12:21:52.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf79a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf7406dc80 con 0x7fcf740b0330 2024-09-12T12:21:52.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf79a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcf740b5fc0 con 0x7fcf740aff50 2024-09-12T12:21:52.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf79000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcf7406ea40 0x7fcf74154b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48958/0 (socket says 172.21.15.144:48958) 2024-09-12T12:21:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf79000640 1 -- 172.21.15.144:0/1882480320 learned_addr learned my addr 172.21.15.144:0/1882480320 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf73e00640 1 --2- 172.21.15.144:0/1882480320 >> v2:172.21.15.165:3300/0 conn(0x7fcf740aff50 0x7fcf74072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf72a00640 1 -- 172.21.15.144:0/1882480320 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121547929 0 0) 0x7fcf7415f800 con 0x7fcf7406ea40 2024-09-12T12:21:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf72a00640 1 -- 172.21.15.144:0/1882480320 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf58003530 con 0x7fcf7406ea40 2024-09-12T12:21:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf72a00640 1 -- 172.21.15.144:0/1882480320 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1639375969 0 0) 0x7fcf58003530 con 0x7fcf7406ea40 2024-09-12T12:21:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf73e00640 1 -- 172.21.15.144:0/1882480320 >> v1:172.21.15.165:6789/0 conn(0x7fcf740b0330 legacy=0x7fcf7415ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf73e00640 1 -- 172.21.15.144:0/1882480320 >> v1:172.21.15.144:6789/0 conn(0x7fcf7406ea40 legacy=0x7fcf74154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.742+0000 7fcf73e00640 1 -- 172.21.15.144:0/1882480320 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7406df60 con 0x7fcf740aff50 2024-09-12T12:21:52.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf73e00640 1 --2- 172.21.15.144:0/1882480320 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf740aff50 0x7fcf74072710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097c0 tx=0x7fcf6401c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cf92b900151f90e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf72a00640 1 -- 172.21.15.144:0/1882480320 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf640b0070 con 0x7fcf740aff50 2024-09-12T12:21:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf72a00640 1 -- 172.21.15.144:0/1882480320 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf640ab400 con 0x7fcf740aff50 2024-09-12T12:21:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf72a00640 1 -- 172.21.15.144:0/1882480320 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c001a00 con 0x7fcf740aff50 2024-09-12T12:21:52.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf79a00640 1 -- 172.21.15.144:0/1882480320 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf740aff50 msgr2=0x7fcf74072710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf79a00640 1 --2- 172.21.15.144:0/1882480320 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf740aff50 0x7fcf74072710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097c0 tx=0x7fcf6401c300 comp rx=0 tx=0).stop 2024-09-12T12:21:52.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf79a00640 1 -- 172.21.15.144:0/1882480320 shutdown_connections 2024-09-12T12:21:52.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf79a00640 1 --2- 172.21.15.144:0/1882480320 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf740aff50 0x7fcf74072710 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf79a00640 1 -- 172.21.15.144:0/1882480320 >> 172.21.15.144:0/1882480320 conn(0x7fcf7406cb10 msgr2=0x7fcf7406cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:52.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf79a00640 1 -- 172.21.15.144:0/1882480320 shutdown_connections 2024-09-12T12:21:52.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf79a00640 1 -- 172.21.15.144:0/1882480320 wait complete. 2024-09-12T12:21:52.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf79a00640 1 Processor -- start 2024-09-12T12:21:52.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.746+0000 7fcf79a00640 1 -- start start 2024-09-12T12:21:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf7406ea40 0x7fcf74141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf740aff50 0x7fcf741573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf741518b0 0x7fcf741559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf741555e0 con 0x7fcf741518b0 2024-09-12T12:21:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcf74155460 con 0x7fcf7406ea40 2024-09-12T12:21:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcf74155760 con 0x7fcf740aff50 2024-09-12T12:21:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf7406ea40 0x7fcf74141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf741518b0 0x7fcf741559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf7406ea40 0x7fcf74141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:57822/0 (socket says 172.21.15.144:57822) 2024-09-12T12:21:52.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73e00640 1 -- 172.21.15.144:0/350804409 learned_addr learned my addr 172.21.15.144:0/350804409 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:52.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73400640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf740aff50 0x7fcf741573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73e00640 1 -- 172.21.15.144:0/350804409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf740aff50 msgr2=0x7fcf741573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73e00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf740aff50 0x7fcf741573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73e00640 1 -- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf741518b0 msgr2=0x7fcf741559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73e00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf741518b0 0x7fcf741559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73e00640 1 -- 172.21.15.144:0/350804409 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf74156320 con 0x7fcf7406ea40 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79000640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf741518b0 0x7fcf741559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf73e00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf7406ea40 0x7fcf74141210 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097c0 tx=0x7fcf6401ab40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf6be00640 1 -- 172.21.15.144:0/350804409 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf640bb020 con 0x7fcf7406ea40 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf6be00640 1 -- 172.21.15.144:0/350804409 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf640b1040 con 0x7fcf7406ea40 2024-09-12T12:21:52.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf74156600 con 0x7fcf7406ea40 2024-09-12T12:21:52.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf6be00640 1 -- 172.21.15.144:0/350804409 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf640b0050 con 0x7fcf7406ea40 2024-09-12T12:21:52.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf74156bc0 con 0x7fcf7406ea40 2024-09-12T12:21:52.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf74072710 con 0x7fcf7406ea40 2024-09-12T12:21:52.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.750+0000 7fcf6be00640 1 -- 172.21.15.144:0/350804409 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf640be070 con 0x7fcf7406ea40 2024-09-12T12:21:52.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.754+0000 7fcf6be00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf540678c0 0x7fcf54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:52.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.754+0000 7fcf6be00640 1 -- 172.21.15.144:0/350804409 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fcf6411f820 con 0x7fcf7406ea40 2024-09-12T12:21:52.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.754+0000 7fcf73400640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf540678c0 0x7fcf54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:52.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.754+0000 7fcf73400640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf540678c0 0x7fcf54069d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcf74073a70 tx=0x7fcf60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:52.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.758+0000 7fcf6be00640 1 -- 172.21.15.144:0/350804409 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf640c4020 con 0x7fcf7406ea40 2024-09-12T12:21:52.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.970+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcf74161cb0 con 0x7fcf7406ea40 2024-09-12T12:21:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.970+0000 7fcf6be00640 1 -- 172.21.15.144:0/350804409 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7fcf640a4e20 con 0x7fcf7406ea40 2024-09-12T12:21:52.973 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:52.973 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":572,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076445225,"bytes_used":2551775232,"bytes_avail":770542338048,"bytes_total":773094113280,"write_bytes_sec":17707116,"read_op_per_sec":0,"write_op_per_sec":18},"fsmap":{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8391}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-12T12:21:51.493039+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf540678c0 msgr2=0x7fcf54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf540678c0 0x7fcf54069d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcf74073a70 tx=0x7fcf60009040 comp rx=0 tx=0).stop 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf7406ea40 msgr2=0x7fcf74141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf7406ea40 0x7fcf74141210 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fcf640097c0 tx=0x7fcf6401ab40 comp rx=0 tx=0).stop 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 shutdown_connections 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf540678c0 0x7fcf54069d80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf741518b0 0x7fcf741559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf740aff50 0x7fcf741573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 --2- 172.21.15.144:0/350804409 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf7406ea40 0x7fcf74141210 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 >> 172.21.15.144:0/350804409 conn(0x7fcf7406cb10 msgr2=0x7fcf74075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 shutdown_connections 2024-09-12T12:21:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:52.974+0000 7fcf79a00640 1 -- 172.21.15.144:0/350804409 wait complete. 2024-09-12T12:21:52.993 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:21:52.994 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:21:52.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:21:53.086 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:21:53.168 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:21:53.169 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:21:53.169 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:21:53.169 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:53.179 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:21:53.180 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:53.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:21:53.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2db400640 1 Processor -- start 2024-09-12T12:21:53.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2db400640 1 -- start start 2024-09-12T12:21:53.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2db400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff2d415b4e0 0x7ff2d40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2db400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff2d40b3ad0 0x7ff2d4071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2db400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d4071960 0x7ff2d40ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2db400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d40b45a0 con 0x7ff2d40b3ad0 2024-09-12T12:21:53.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2db400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d40b3fe0 con 0x7ff2d415b4e0 2024-09-12T12:21:53.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2db400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d40b42c0 con 0x7ff2d4071960 2024-09-12T12:21:53.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2d3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff2d40b3ad0 0x7ff2d4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2d3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff2d40b3ad0 0x7ff2d4071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39120/0 (socket says 172.21.15.144:39120) 2024-09-12T12:21:53.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.410+0000 7ff2d3e00640 1 -- 172.21.15.144:0/1545407324 learned_addr learned my addr 172.21.15.144:0/1545407324 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:53.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d8a00640 1 --2- 172.21.15.144:0/1545407324 >> v2:172.21.15.165:3300/0 conn(0x7ff2d415b4e0 0x7ff2d40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d9400640 1 --2- 172.21.15.144:0/1545407324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d4071960 0x7ff2d40ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d3e00640 1 -- 172.21.15.144:0/1545407324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d4071960 msgr2=0x7ff2d40ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:53.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/1545407324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d4071960 0x7ff2d40ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d3e00640 1 -- 172.21.15.144:0/1545407324 >> v2:172.21.15.165:3300/0 conn(0x7ff2d415b4e0 msgr2=0x7ff2d40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:53.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/1545407324 >> v2:172.21.15.165:3300/0 conn(0x7ff2d415b4e0 0x7ff2d40b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d3e00640 1 -- 172.21.15.144:0/1545407324 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d40b1490 con 0x7ff2d40b3ad0 2024-09-12T12:21:53.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d8a00640 1 --2- 172.21.15.144:0/1545407324 >> v2:172.21.15.165:3300/0 conn(0x7ff2d415b4e0 0x7ff2d40b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:53.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/1545407324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d40b3ad0 0x7ff2d4071420 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4069450 tx=0x7ff2bc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ce2df81b228b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:53.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d3400640 1 -- 172.21.15.144:0/1545407324 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0b1070 con 0x7ff2d40b3ad0 2024-09-12T12:21:53.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d3400640 1 -- 172.21.15.144:0/1545407324 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0ac620 con 0x7ff2d40b3ad0 2024-09-12T12:21:53.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.414+0000 7ff2d3400640 1 -- 172.21.15.144:0/1545407324 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0ac9f0 con 0x7ff2d40b3ad0 2024-09-12T12:21:53.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- 172.21.15.144:0/1545407324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d40b3ad0 msgr2=0x7ff2d4071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 --2- 172.21.15.144:0/1545407324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d40b3ad0 0x7ff2d4071420 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4069450 tx=0x7ff2bc01c4f0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- 172.21.15.144:0/1545407324 shutdown_connections 2024-09-12T12:21:53.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 --2- 172.21.15.144:0/1545407324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d40b3ad0 0x7ff2d4071420 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 --2- 172.21.15.144:0/1545407324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d4071960 0x7ff2d40ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 --2- 172.21.15.144:0/1545407324 >> v2:172.21.15.165:3300/0 conn(0x7ff2d415b4e0 0x7ff2d40b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- 172.21.15.144:0/1545407324 >> 172.21.15.144:0/1545407324 conn(0x7ff2d406d0d0 msgr2=0x7ff2d406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:53.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- 172.21.15.144:0/1545407324 shutdown_connections 2024-09-12T12:21:53.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- 172.21.15.144:0/1545407324 wait complete. 2024-09-12T12:21:53.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 Processor -- start 2024-09-12T12:21:53.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- start start 2024-09-12T12:21:53.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d4071960 0x7ff2d41f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2d40b3ad0 0x7ff2d41f8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d415b4e0 0x7ff2d41f9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d415f270 con 0x7ff2d4071960 2024-09-12T12:21:53.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d415f0f0 con 0x7ff2d40b3ad0 2024-09-12T12:21:53.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d415f3f0 con 0x7ff2d415b4e0 2024-09-12T12:21:53.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d4071960 0x7ff2d41f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d4071960 0x7ff2d41f7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39136/0 (socket says 172.21.15.144:39136) 2024-09-12T12:21:53.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d8a00640 1 -- 172.21.15.144:0/1373324983 learned_addr learned my addr 172.21.15.144:0/1373324983 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:53.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2d40b3ad0 0x7ff2d41f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d9400640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d415b4e0 0x7ff2d41f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d8a00640 1 -- 172.21.15.144:0/1373324983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d415b4e0 msgr2=0x7ff2d41f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d8a00640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d415b4e0 0x7ff2d41f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d8a00640 1 -- 172.21.15.144:0/1373324983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2d40b3ad0 msgr2=0x7ff2d41f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d8a00640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2d40b3ad0 0x7ff2d41f8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d8a00640 1 -- 172.21.15.144:0/1373324983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d4160880 con 0x7ff2d4071960 2024-09-12T12:21:53.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d9400640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d415b4e0 0x7ff2d41f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:53.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d8a00640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d4071960 0x7ff2d41f7960 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009fd0 tx=0x7ff2c400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:53.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d0c00640 1 -- 172.21.15.144:0/1373324983 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c401a070 con 0x7ff2d4071960 2024-09-12T12:21:53.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d0c00640 1 -- 172.21.15.144:0/1373324983 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c4003bc0 con 0x7ff2d4071960 2024-09-12T12:21:53.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2d0c00640 1 -- 172.21.15.144:0/1373324983 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4004030 con 0x7ff2d4071960 2024-09-12T12:21:53.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.418+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d4160b60 con 0x7ff2d4071960 2024-09-12T12:21:53.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.422+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d415cef0 con 0x7ff2d4071960 2024-09-12T12:21:53.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.422+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d4071420 con 0x7ff2d4071960 2024-09-12T12:21:53.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.422+0000 7ff2d0c00640 1 -- 172.21.15.144:0/1373324983 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2c401d070 con 0x7ff2d4071960 2024-09-12T12:21:53.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.422+0000 7ff2d0c00640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2b00678c0 0x7ff2b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:53.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.422+0000 7ff2d0c00640 1 -- 172.21.15.144:0/1373324983 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7ff2c4085fe0 con 0x7ff2d4071960 2024-09-12T12:21:53.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.422+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2b00678c0 0x7ff2b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:53.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.422+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2b00678c0 0x7ff2b0069d80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0ae000 tx=0x7ff2bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:53.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.426+0000 7ff2d0c00640 1 -- 172.21.15.144:0/1373324983 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff2c4010070 con 0x7ff2d4071960 2024-09-12T12:21:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff2d40cf9b0 con 0x7ff2d4071960 2024-09-12T12:21:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2d0c00640 1 -- 172.21.15.144:0/1373324983 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v140) ==== 80+0+0 (secure 0 0 0) 0x7ff2c4056370 con 0x7ff2d4071960 2024-09-12T12:21:53.604 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:21:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2b00678c0 msgr2=0x7ff2b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2b00678c0 0x7ff2b0069d80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0ae000 tx=0x7ff2bc008040 comp rx=0 tx=0).stop 2024-09-12T12:21:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d4071960 msgr2=0x7ff2d41f7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d4071960 0x7ff2d41f7960 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4009fd0 tx=0x7ff2c400d560 comp rx=0 tx=0).stop 2024-09-12T12:21:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 shutdown_connections 2024-09-12T12:21:53.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2b00678c0 0x7ff2b0069d80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2d415b4e0 0x7ff2d41f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2d40b3ad0 0x7ff2d41f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 --2- 172.21.15.144:0/1373324983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2d4071960 0x7ff2d41f7960 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 >> 172.21.15.144:0/1373324983 conn(0x7ff2d406d0d0 msgr2=0x7ff2d4158330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 shutdown_connections 2024-09-12T12:21:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:53.602+0000 7ff2db400640 1 -- 172.21.15.144:0/1373324983 wait complete. 2024-09-12T12:21:53.629 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:21:53.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:53.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:21:54.365 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:21:54.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:21:54.365 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:21:54.376 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:21:54.377 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:21:54.377 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:54.386 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:21:54.386 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:21:54.387 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:21:54.387 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:54.426 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:21:54.426 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:21:54.426 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:21:54.426 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:21:54.436 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:21:54.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:54.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.602+0000 7f7ea6800640 1 Processor -- start 2024-09-12T12:21:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.602+0000 7f7ea6800640 1 -- start start 2024-09-12T12:21:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7ea00d2e10 0x7f7ea00737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea6800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7ea00b67c0 0x7f7ea00b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea6800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea0162720 con 0x7f7ea015e4a0 2024-09-12T12:21:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea6800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea0073310 con 0x7f7ea00d2e10 2024-09-12T12:21:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea6800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea0162a00 con 0x7f7ea00b67c0 2024-09-12T12:21:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7ea00d2e10 0x7f7ea00737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7ea00d2e10 0x7f7ea00737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39148/0 (socket says 172.21.15.144:39148) 2024-09-12T12:21:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea4a00640 1 -- 172.21.15.144:0/754596667 learned_addr learned my addr 172.21.15.144:0/754596667 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea5e00640 1 --2- 172.21.15.144:0/754596667 >> v2:172.21.15.165:3300/0 conn(0x7f7ea00b67c0 0x7f7ea00b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea4a00640 1 -- 172.21.15.144:0/754596667 >> v2:172.21.15.165:3300/0 conn(0x7f7ea00b67c0 msgr2=0x7f7ea00b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea4a00640 1 --2- 172.21.15.144:0/754596667 >> v2:172.21.15.165:3300/0 conn(0x7f7ea00b67c0 0x7f7ea00b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea4a00640 1 -- 172.21.15.144:0/754596667 >> v1:172.21.15.165:6789/0 conn(0x7f7ea015e4a0 legacy=0x7f7ea0161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.606+0000 7f7ea4a00640 1 -- 172.21.15.144:0/754596667 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea0162ce0 con 0x7f7ea00d2e10 2024-09-12T12:21:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea4a00640 1 --2- 172.21.15.144:0/754596667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 0x7f7ea00737a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7ea00d3360 tx=0x7f7e8c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d30f77f7ecf2f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7e9fe00640 1 -- 172.21.15.144:0/754596667 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0ab610 con 0x7f7ea00d2e10 2024-09-12T12:21:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7e9fe00640 1 -- 172.21.15.144:0/754596667 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0b0070 con 0x7f7ea00d2e10 2024-09-12T12:21:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7e9fe00640 1 -- 172.21.15.144:0/754596667 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0ab9d0 con 0x7f7ea00d2e10 2024-09-12T12:21:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 -- 172.21.15.144:0/754596667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 msgr2=0x7f7ea00737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 --2- 172.21.15.144:0/754596667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 0x7f7ea00737a0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7ea00d3360 tx=0x7f7e8c01c520 comp rx=0 tx=0).stop 2024-09-12T12:21:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 -- 172.21.15.144:0/754596667 shutdown_connections 2024-09-12T12:21:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 --2- 172.21.15.144:0/754596667 >> v2:172.21.15.165:3300/0 conn(0x7f7ea00b67c0 0x7f7ea00b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 --2- 172.21.15.144:0/754596667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 0x7f7ea00737a0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 -- 172.21.15.144:0/754596667 >> 172.21.15.144:0/754596667 conn(0x7f7ea00d2280 msgr2=0x7f7ea00d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 -- 172.21.15.144:0/754596667 shutdown_connections 2024-09-12T12:21:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 -- 172.21.15.144:0/754596667 wait complete. 2024-09-12T12:21:54.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 Processor -- start 2024-09-12T12:21:54.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.610+0000 7f7ea6800640 1 -- start start 2024-09-12T12:21:54.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea6800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ea00b67c0 0x7f7ea00b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 0x7f7ea0159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea6800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ea015e4a0 0x7f7ea01611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea006d6b0 con 0x7f7ea00d2e10 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea6800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea006d530 con 0x7f7ea015e4a0 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea6800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea016b000 con 0x7f7ea00b67c0 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 0x7f7ea0159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 0x7f7ea0159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39160/0 (socket says 172.21.15.144:39160) 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea4a00640 1 -- 172.21.15.144:0/4166607644 learned_addr learned my addr 172.21.15.144:0/4166607644 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea5400640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ea00b67c0 0x7f7ea00b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea5e00640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ea015e4a0 0x7f7ea01611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea4a00640 1 -- 172.21.15.144:0/4166607644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ea00b67c0 msgr2=0x7f7ea00b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea4a00640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ea00b67c0 0x7f7ea00b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea4a00640 1 -- 172.21.15.144:0/4166607644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ea015e4a0 msgr2=0x7f7ea01611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea4a00640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ea015e4a0 0x7f7ea01611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea4a00640 1 -- 172.21.15.144:0/4166607644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea0160110 con 0x7f7ea00d2e10 2024-09-12T12:21:54.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea5e00640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ea015e4a0 0x7f7ea01611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:54.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea4a00640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 0x7f7ea0159090 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c01a150 tx=0x7f7e8c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:54.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7e9d600640 1 -- 172.21.15.144:0/4166607644 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0be5f0 con 0x7f7ea00d2e10 2024-09-12T12:21:54.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7e9d600640 1 -- 172.21.15.144:0/4166607644 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0be7b0 con 0x7f7ea00d2e10 2024-09-12T12:21:54.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7e9d600640 1 -- 172.21.15.144:0/4166607644 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0beba0 con 0x7f7ea00d2e10 2024-09-12T12:21:54.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea01603f0 con 0x7f7ea00d2e10 2024-09-12T12:21:54.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea01609b0 con 0x7f7ea00d2e10 2024-09-12T12:21:54.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea00b6c30 con 0x7f7ea00d2e10 2024-09-12T12:21:54.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.614+0000 7f7e9d600640 1 -- 172.21.15.144:0/4166607644 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e8c0b43f0 con 0x7f7ea00d2e10 2024-09-12T12:21:54.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.618+0000 7f7e9d600640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e800678c0 0x7f7e80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.618+0000 7f7e9d600640 1 -- 172.21.15.144:0/4166607644 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f7e8c120060 con 0x7f7ea00d2e10 2024-09-12T12:21:54.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.618+0000 7f7ea5400640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e800678c0 0x7f7e80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.618+0000 7f7ea5400640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e800678c0 0x7f7e80069d80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7e94007fd0 tx=0x7f7e94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:54.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.622+0000 7f7e9d600640 1 -- 172.21.15.144:0/4166607644 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7e8c0a8050 con 0x7f7ea00d2e10 2024-09-12T12:21:54.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ea00d1870 con 0x7f7ea00d2e10 2024-09-12T12:21:54.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7e9d600640 1 -- 172.21.15.144:0/4166607644 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7f7e8c016110 con 0x7f7ea00d2e10 2024-09-12T12:21:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:54.812 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:54.812 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:54.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e800678c0 msgr2=0x7f7e80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:54.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e800678c0 0x7f7e80069d80 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7e94007fd0 tx=0x7f7e94009040 comp rx=0 tx=0).stop 2024-09-12T12:21:54.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 msgr2=0x7f7ea0159090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:54.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 0x7f7ea0159090 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c01a150 tx=0x7f7e8c01ad60 comp rx=0 tx=0).stop 2024-09-12T12:21:54.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 shutdown_connections 2024-09-12T12:21:54.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7e800678c0 0x7f7e80069d80 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ea015e4a0 0x7f7ea01611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea00d2e10 0x7f7ea0159090 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 --2- 172.21.15.144:0/4166607644 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ea00b67c0 0x7f7ea00b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 >> 172.21.15.144:0/4166607644 conn(0x7f7ea00d2280 msgr2=0x7f7ea006d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:54.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 shutdown_connections 2024-09-12T12:21:54.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.810+0000 7f7ea6800640 1 -- 172.21.15.144:0/4166607644 wait complete. 2024-09-12T12:21:54.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.966+0000 7f7f60800640 1 Processor -- start 2024-09-12T12:21:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.966+0000 7f7f60800640 1 -- start start 2024-09-12T12:21:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f60800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f5815b4e0 0x7f7f580b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f60800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f580ccf30 0x7f7f580cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f60800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f580b45a0 con 0x7f7f580b3ad0 2024-09-12T12:21:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f60800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7f580cd8e0 con 0x7f7f5815b4e0 2024-09-12T12:21:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f60800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7f580b3fe0 con 0x7f7f580ccf30 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f5815b4e0 0x7f7f580b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5d400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7f580b3ad0 0x7f7f58071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48960/0 (socket says 172.21.15.144:48960) 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5d400640 1 -- 172.21.15.144:0/2183066108 learned_addr learned my addr 172.21.15.144:0/2183066108 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5e800640 1 --2- 172.21.15.144:0/2183066108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f580ccf30 0x7f7f580cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5de00640 1 -- 172.21.15.144:0/2183066108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f580ccf30 msgr2=0x7f7f580cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5de00640 1 --2- 172.21.15.144:0/2183066108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f580ccf30 0x7f7f580cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5de00640 1 -- 172.21.15.144:0/2183066108 >> v1:172.21.15.144:6789/0 conn(0x7f7f580b3ad0 legacy=0x7f7f58071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5de00640 1 -- 172.21.15.144:0/2183066108 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f580b42c0 con 0x7f7f5815b4e0 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5e800640 1 --2- 172.21.15.144:0/2183066108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f580ccf30 0x7f7f580cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:54.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5ca00640 1 -- 172.21.15.144:0/2183066108 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1765544178 0 0) 0x7f7f580b45a0 con 0x7f7f580b3ad0 2024-09-12T12:21:54.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5de00640 1 --2- 172.21.15.144:0/2183066108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5815b4e0 0x7f7f580b3590 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0097c0 tx=0x7f7f4c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733431cc02938762 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:54.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.970+0000 7f7f5ca00640 1 -- 172.21.15.144:0/2183066108 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0a7070 con 0x7f7f5815b4e0 2024-09-12T12:21:54.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5ca00640 1 -- 172.21.15.144:0/2183066108 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0b0070 con 0x7f7f5815b4e0 2024-09-12T12:21:54.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5ca00640 1 -- 172.21.15.144:0/2183066108 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0ab890 con 0x7f7f5815b4e0 2024-09-12T12:21:54.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 -- 172.21.15.144:0/2183066108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5815b4e0 msgr2=0x7f7f580b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:54.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 --2- 172.21.15.144:0/2183066108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5815b4e0 0x7f7f580b3590 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0097c0 tx=0x7f7f4c01c470 comp rx=0 tx=0).stop 2024-09-12T12:21:54.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 -- 172.21.15.144:0/2183066108 shutdown_connections 2024-09-12T12:21:54.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 --2- 172.21.15.144:0/2183066108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f580ccf30 0x7f7f580cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 --2- 172.21.15.144:0/2183066108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5815b4e0 0x7f7f580b3590 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 -- 172.21.15.144:0/2183066108 >> 172.21.15.144:0/2183066108 conn(0x7f7f5806d0d0 msgr2=0x7f7f5806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:54.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 -- 172.21.15.144:0/2183066108 shutdown_connections 2024-09-12T12:21:54.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 -- 172.21.15.144:0/2183066108 wait complete. 2024-09-12T12:21:54.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 Processor -- start 2024-09-12T12:21:54.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 -- start start 2024-09-12T12:21:54.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f580b3ad0 0x7f7f58163380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580ccf30 0x7f7f58157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f5815b4e0 0x7f7f5815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5815b8c0 con 0x7f7f580ccf30 2024-09-12T12:21:54.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7f580cdef0 con 0x7f7f580b3ad0 2024-09-12T12:21:54.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f60800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7f58163a60 con 0x7f7f5815b4e0 2024-09-12T12:21:54.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580ccf30 0x7f7f58157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580ccf30 0x7f7f58157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39172/0 (socket says 172.21.15.144:39172) 2024-09-12T12:21:54.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5d400640 1 -- 172.21.15.144:0/1329635872 learned_addr learned my addr 172.21.15.144:0/1329635872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:54.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5de00640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f580b3ad0 0x7f7f58163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5e800640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f5815b4e0 0x7f7f5815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5d400640 1 -- 172.21.15.144:0/1329635872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f5815b4e0 msgr2=0x7f7f5815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:54.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5d400640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f5815b4e0 0x7f7f5815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5d400640 1 -- 172.21.15.144:0/1329635872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f580b3ad0 msgr2=0x7f7f58163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:54.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5d400640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f580b3ad0 0x7f7f58163380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:54.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5d400640 1 -- 172.21.15.144:0/1329635872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f58163d40 con 0x7f7f580ccf30 2024-09-12T12:21:54.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.974+0000 7f7f5de00640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f580b3ad0 0x7f7f58163380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:54.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f5d400640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580ccf30 0x7f7f58157110 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f7f480011f0 tx=0x7f7f4800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:54.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f52000640 1 -- 172.21.15.144:0/1329635872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48018070 con 0x7f7f580ccf30 2024-09-12T12:21:54.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f52000640 1 -- 172.21.15.144:0/1329635872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f480074e0 con 0x7f7f580ccf30 2024-09-12T12:21:54.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f52000640 1 -- 172.21.15.144:0/1329635872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48004a10 con 0x7f7f580ccf30 2024-09-12T12:21:54.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f58164020 con 0x7f7f580ccf30 2024-09-12T12:21:54.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f58157650 con 0x7f7f580ccf30 2024-09-12T12:21:54.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f580cd3a0 con 0x7f7f580ccf30 2024-09-12T12:21:54.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f52000640 1 -- 172.21.15.144:0/1329635872 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f48004bb0 con 0x7f7f580ccf30 2024-09-12T12:21:54.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f52000640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f3c0678c0 0x7f7f3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:54.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f52000640 1 -- 172.21.15.144:0/1329635872 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f7f480851a0 con 0x7f7f580ccf30 2024-09-12T12:21:54.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.978+0000 7f7f5de00640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f3c0678c0 0x7f7f3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:54.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.982+0000 7f7f5de00640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f3c0678c0 0x7f7f3c069d80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0af000 tx=0x7f7f4c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:54.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:54.982+0000 7f7f52000640 1 -- 172.21.15.144:0/1329635872 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7f48055ab0 con 0x7f7f580ccf30 2024-09-12T12:21:55.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f580b37a0 con 0x7f7f580ccf30 2024-09-12T12:21:55.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f52000640 1 -- 172.21.15.144:0/1329635872 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7f7f480553b0 con 0x7f7f580ccf30 2024-09-12T12:21:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:55.176 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:55.176 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:55.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f3c0678c0 msgr2=0x7f7f3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f3c0678c0 0x7f7f3c069d80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0af000 tx=0x7f7f4c0a7000 comp rx=0 tx=0).stop 2024-09-12T12:21:55.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580ccf30 msgr2=0x7f7f58157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580ccf30 0x7f7f58157110 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f7f480011f0 tx=0x7f7f4800c9b0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 shutdown_connections 2024-09-12T12:21:55.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f3c0678c0 0x7f7f3c069d80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f5815b4e0 0x7f7f5815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f580ccf30 0x7f7f58157110 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 --2- 172.21.15.144:0/1329635872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f580b3ad0 0x7f7f58163380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 >> 172.21.15.144:0/1329635872 conn(0x7f7f5806d0d0 msgr2=0x7f7f580b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:55.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 shutdown_connections 2024-09-12T12:21:55.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.174+0000 7f7f60800640 1 -- 172.21.15.144:0/1329635872 wait complete. 2024-09-12T12:21:55.197 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:21:55.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.330+0000 7fa564800640 1 Processor -- start 2024-09-12T12:21:55.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.330+0000 7fa564800640 1 -- start start 2024-09-12T12:21:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa564800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa55c15ad50 0x7fa55c15f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa564800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa55c0b49e0 0x7fa55c0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa564800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c0b3aa0 con 0x7fa55c0b3590 2024-09-12T12:21:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa564800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa55c15f860 con 0x7fa55c0b49e0 2024-09-12T12:21:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa564800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa55c0cdeb0 con 0x7fa55c15ad50 2024-09-12T12:21:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa562800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa55c0b49e0 0x7fa55c0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa562800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa55c0b49e0 0x7fa55c0b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39176/0 (socket says 172.21.15.144:39176) 2024-09-12T12:21:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa562800640 1 -- 172.21.15.144:0/3717063177 learned_addr learned my addr 172.21.15.144:0/3717063177 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:55.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa561400640 1 --1- 172.21.15.144:0/3717063177 >> v1:172.21.15.144:6789/0 conn(0x7fa55c0b3590 0x7fa55c0b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48968/0 (socket says 172.21.15.144:48968) 2024-09-12T12:21:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa561e00640 1 --2- 172.21.15.144:0/3717063177 >> v2:172.21.15.165:3300/0 conn(0x7fa55c15ad50 0x7fa55c15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa562800640 1 -- 172.21.15.144:0/3717063177 >> v2:172.21.15.165:3300/0 conn(0x7fa55c15ad50 msgr2=0x7fa55c15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa562800640 1 --2- 172.21.15.144:0/3717063177 >> v2:172.21.15.165:3300/0 conn(0x7fa55c15ad50 0x7fa55c15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa562800640 1 -- 172.21.15.144:0/3717063177 >> v1:172.21.15.144:6789/0 conn(0x7fa55c0b3590 legacy=0x7fa55c0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa562800640 1 -- 172.21.15.144:0/3717063177 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c0afc10 con 0x7fa55c0b49e0 2024-09-12T12:21:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.334+0000 7fa562800640 1 --2- 172.21.15.144:0/3717063177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c0b49e0 0x7fa55c0b06f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0d14f0 tx=0x7fa55801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc02845022734568 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa560a00640 1 -- 172.21.15.144:0/3717063177 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5580a5720 con 0x7fa55c0b49e0 2024-09-12T12:21:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa560a00640 1 -- 172.21.15.144:0/3717063177 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5580a58c0 con 0x7fa55c0b49e0 2024-09-12T12:21:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa560a00640 1 -- 172.21.15.144:0/3717063177 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5580a5c90 con 0x7fa55c0b49e0 2024-09-12T12:21:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 -- 172.21.15.144:0/3717063177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c0b49e0 msgr2=0x7fa55c0b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 --2- 172.21.15.144:0/3717063177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c0b49e0 0x7fa55c0b06f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0d14f0 tx=0x7fa55801c9f0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 -- 172.21.15.144:0/3717063177 shutdown_connections 2024-09-12T12:21:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 --2- 172.21.15.144:0/3717063177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c0b49e0 0x7fa55c0b06f0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 --2- 172.21.15.144:0/3717063177 >> v2:172.21.15.165:3300/0 conn(0x7fa55c15ad50 0x7fa55c15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 -- 172.21.15.144:0/3717063177 >> 172.21.15.144:0/3717063177 conn(0x7fa55c06d0d0 msgr2=0x7fa55c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 -- 172.21.15.144:0/3717063177 shutdown_connections 2024-09-12T12:21:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 -- 172.21.15.144:0/3717063177 wait complete. 2024-09-12T12:21:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 Processor -- start 2024-09-12T12:21:55.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 -- start start 2024-09-12T12:21:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa55c0b3590 0x7fa55c146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa55c0b49e0 0x7fa55c0713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c15ad50 0x7fa55c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0b0db0 con 0x7fa55c15ad50 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0b0c30 con 0x7fa55c0b3590 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa564800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c0b0f30 con 0x7fa55c0b49e0 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa562800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c15ad50 0x7fa55c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa562800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c15ad50 0x7fa55c156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39190/0 (socket says 172.21.15.144:39190) 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.338+0000 7fa562800640 1 -- 172.21.15.144:0/3026051324 learned_addr learned my addr 172.21.15.144:0/3026051324 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa561e00640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa55c0b3590 0x7fa55c146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa561400640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa55c0b49e0 0x7fa55c0713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa562800640 1 -- 172.21.15.144:0/3026051324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa55c0b49e0 msgr2=0x7fa55c0713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa562800640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa55c0b49e0 0x7fa55c0713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa562800640 1 -- 172.21.15.144:0/3026051324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa55c0b3590 msgr2=0x7fa55c146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa562800640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa55c0b3590 0x7fa55c146830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa562800640 1 -- 172.21.15.144:0/3026051324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c15b6b0 con 0x7fa55c15ad50 2024-09-12T12:21:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa561400640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa55c0b49e0 0x7fa55c0713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa562800640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c15ad50 0x7fa55c156220 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fa5580af040 tx=0x7fa558019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa556000640 1 -- 172.21.15.144:0/3026051324 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5580b8670 con 0x7fa55c15ad50 2024-09-12T12:21:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa556000640 1 -- 172.21.15.144:0/3026051324 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5580be070 con 0x7fa55c15ad50 2024-09-12T12:21:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55c15b990 con 0x7fa55c15ad50 2024-09-12T12:21:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa556000640 1 -- 172.21.15.144:0/3026051324 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5580b8a70 con 0x7fa55c15ad50 2024-09-12T12:21:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55c15bf50 con 0x7fa55c15ad50 2024-09-12T12:21:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55c0b06f0 con 0x7fa55c15ad50 2024-09-12T12:21:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa556000640 1 -- 172.21.15.144:0/3026051324 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5580b8c10 con 0x7fa55c15ad50 2024-09-12T12:21:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa556000640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5400678c0 0x7fa540069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa556000640 1 -- 172.21.15.144:0/3026051324 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7fa558120f60 con 0x7fa55c15ad50 2024-09-12T12:21:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.342+0000 7fa561e00640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5400678c0 0x7fa540069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.346+0000 7fa561e00640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5400678c0 0x7fa540069d80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa55000b930 tx=0x7fa550008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:55.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.350+0000 7fa556000640 1 -- 172.21.15.144:0/3026051324 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa5580165e0 con 0x7fa55c15ad50 2024-09-12T12:21:55.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa55c146d70 con 0x7fa55c15ad50 2024-09-12T12:21:55.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa556000640 1 -- 172.21.15.144:0/3026051324 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16984 (secure 0 0 0) 0x7fa5580f19d0 con 0x7fa55c15ad50 2024-09-12T12:21:55.512 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:55.512 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":140,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:21:14.364804+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:21:10.454030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-12T12:21:11.747676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:21:55.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5400678c0 msgr2=0x7fa540069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5400678c0 0x7fa540069d80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa55000b930 tx=0x7fa550008040 comp rx=0 tx=0).stop 2024-09-12T12:21:55.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c15ad50 msgr2=0x7fa55c156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c15ad50 0x7fa55c156220 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fa5580af040 tx=0x7fa558019790 comp rx=0 tx=0).stop 2024-09-12T12:21:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 shutdown_connections 2024-09-12T12:21:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5400678c0 0x7fa540069d80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa55c15ad50 0x7fa55c156220 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa55c0b49e0 0x7fa55c0713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 --2- 172.21.15.144:0/3026051324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa55c0b3590 0x7fa55c146830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 >> 172.21.15.144:0/3026051324 conn(0x7fa55c06d0d0 msgr2=0x7fa55c0cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.510+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 shutdown_connections 2024-09-12T12:21:55.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.514+0000 7fa564800640 1 -- 172.21.15.144:0/3026051324 wait complete. 2024-09-12T12:21:55.534 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:21:55.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:55.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.670+0000 7f121ec00640 1 Processor -- start 2024-09-12T12:21:55.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.670+0000 7f121ec00640 1 -- start start 2024-09-12T12:21:55.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.670+0000 7f121ec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f121815ad50 0x7f121815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.670+0000 7f121ec00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f12180b49e0 0x7f12180b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.670+0000 7f121ec00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12180b3aa0 con 0x7f12180b3590 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.670+0000 7f121ec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f121815f860 con 0x7f121815ad50 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.670+0000 7f121ec00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f12180cdeb0 con 0x7f12180b49e0 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1217e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f121815ad50 0x7f121815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1217400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f12180b3590 0x7f12180b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48970/0 (socket says 172.21.15.144:48970) 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1217400640 1 -- 172.21.15.144:0/1267834612 learned_addr learned my addr 172.21.15.144:0/1267834612 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f121cc00640 1 --2- 172.21.15.144:0/1267834612 >> v2:172.21.15.165:3300/0 conn(0x7f12180b49e0 0x7f12180b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1217e00640 1 -- 172.21.15.144:0/1267834612 >> v2:172.21.15.165:3300/0 conn(0x7f12180b49e0 msgr2=0x7f12180b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:55.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1217e00640 1 --2- 172.21.15.144:0/1267834612 >> v2:172.21.15.165:3300/0 conn(0x7f12180b49e0 0x7f12180b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1217e00640 1 -- 172.21.15.144:0/1267834612 >> v1:172.21.15.144:6789/0 conn(0x7f12180b3590 legacy=0x7f12180b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1217e00640 1 -- 172.21.15.144:0/1267834612 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12180afc10 con 0x7f121815ad50 2024-09-12T12:21:55.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1216a00640 1 -- 172.21.15.144:0/1267834612 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347600605 0 0) 0x7f12180b3aa0 con 0x7f12180b3590 2024-09-12T12:21:55.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1217e00640 1 --2- 172.21.15.144:0/1267834612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121815ad50 0x7f121815f320 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f121806f4a0 tx=0x7f120801d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9129d464ddc974a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:55.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1216a00640 1 -- 172.21.15.144:0/1267834612 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12080b3070 con 0x7f121815ad50 2024-09-12T12:21:55.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1216a00640 1 -- 172.21.15.144:0/1267834612 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12080a6770 con 0x7f121815ad50 2024-09-12T12:21:55.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.674+0000 7f1216a00640 1 -- 172.21.15.144:0/1267834612 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120800b040 con 0x7f121815ad50 2024-09-12T12:21:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 -- 172.21.15.144:0/1267834612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121815ad50 msgr2=0x7f121815f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 --2- 172.21.15.144:0/1267834612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121815ad50 0x7f121815f320 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f121806f4a0 tx=0x7f120801d850 comp rx=0 tx=0).stop 2024-09-12T12:21:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 -- 172.21.15.144:0/1267834612 shutdown_connections 2024-09-12T12:21:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 --2- 172.21.15.144:0/1267834612 >> v2:172.21.15.165:3300/0 conn(0x7f12180b49e0 0x7f12180b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 --2- 172.21.15.144:0/1267834612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121815ad50 0x7f121815f320 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 -- 172.21.15.144:0/1267834612 >> 172.21.15.144:0/1267834612 conn(0x7f121806d0d0 msgr2=0x7f121806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 -- 172.21.15.144:0/1267834612 shutdown_connections 2024-09-12T12:21:55.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 -- 172.21.15.144:0/1267834612 wait complete. 2024-09-12T12:21:55.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 Processor -- start 2024-09-12T12:21:55.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 -- start start 2024-09-12T12:21:55.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12180b3590 0x7f121815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180b49e0 0x7f12181fac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121815ad50 0x7f121815dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f12180b0db0 con 0x7f12180b49e0 2024-09-12T12:21:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12180b0c30 con 0x7f12180b3590 2024-09-12T12:21:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f12180b0f30 con 0x7f121815ad50 2024-09-12T12:21:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f1217400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180b49e0 0x7f12181fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f1217400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180b49e0 0x7f12181fac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39210/0 (socket says 172.21.15.144:39210) 2024-09-12T12:21:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f1217400640 1 -- 172.21.15.144:0/2579208791 learned_addr learned my addr 172.21.15.144:0/2579208791 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f1217e00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12180b3590 0x7f121815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f121cc00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121815ad50 0x7f121815dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f1217400640 1 -- 172.21.15.144:0/2579208791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121815ad50 msgr2=0x7f121815dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f1217400640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121815ad50 0x7f121815dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f1217400640 1 -- 172.21.15.144:0/2579208791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12180b3590 msgr2=0x7f121815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f1217400640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12180b3590 0x7f121815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.678+0000 7f1217400640 1 -- 172.21.15.144:0/2579208791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121815b4e0 con 0x7f12180b49e0 2024-09-12T12:21:55.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f1217400640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180b49e0 0x7f12181fac50 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f120400c520 tx=0x7f120400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:55.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f120fe00640 1 -- 172.21.15.144:0/2579208791 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204018070 con 0x7f12180b49e0 2024-09-12T12:21:55.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f120fe00640 1 -- 172.21.15.144:0/2579208791 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12040074e0 con 0x7f12180b49e0 2024-09-12T12:21:55.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f120fe00640 1 -- 172.21.15.144:0/2579208791 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12040049f0 con 0x7f12180b49e0 2024-09-12T12:21:55.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121815b7c0 con 0x7f12180b49e0 2024-09-12T12:21:55.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f121815bd80 con 0x7f12180b49e0 2024-09-12T12:21:55.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12180b06f0 con 0x7f12180b49e0 2024-09-12T12:21:55.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f120fe00640 1 -- 172.21.15.144:0/2579208791 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f120401b070 con 0x7f12180b49e0 2024-09-12T12:21:55.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f120fe00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11f80678c0 0x7f11f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:55.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f120fe00640 1 -- 172.21.15.144:0/2579208791 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f1204085260 con 0x7f12180b49e0 2024-09-12T12:21:55.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.682+0000 7f1217e00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11f80678c0 0x7f11f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:55.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.686+0000 7f1217e00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11f80678c0 0x7f11f8069d80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f12080b0000 tx=0x7f12080a8070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:55.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.686+0000 7f120fe00640 1 -- 172.21.15.144:0/2579208791 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1204055520 con 0x7f12180b49e0 2024-09-12T12:21:55.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.878+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12180aec10 con 0x7f12180b49e0 2024-09-12T12:21:55.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.878+0000 7f120fe00640 1 -- 172.21.15.144:0/2579208791 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7f1204059820 con 0x7f12180b49e0 2024-09-12T12:21:55.883 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:55.883 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:55.885 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:55.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11f80678c0 msgr2=0x7f11f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11f80678c0 0x7f11f8069d80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f12080b0000 tx=0x7f12080a8070 comp rx=0 tx=0).stop 2024-09-12T12:21:55.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180b49e0 msgr2=0x7f12181fac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:55.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180b49e0 0x7f12181fac50 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f120400c520 tx=0x7f120400c9e0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 shutdown_connections 2024-09-12T12:21:55.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11f80678c0 0x7f11f8069d80 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121815ad50 0x7f121815dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180b49e0 0x7f12181fac50 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 --2- 172.21.15.144:0/2579208791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12180b3590 0x7f121815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:55.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 >> 172.21.15.144:0/2579208791 conn(0x7f121806d0d0 msgr2=0x7f12180b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:55.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 shutdown_connections 2024-09-12T12:21:55.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:55.882+0000 7f121ec00640 1 -- 172.21.15.144:0/2579208791 wait complete. 2024-09-12T12:21:55.903 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:21:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb80200640 1 Processor -- start 2024-09-12T12:21:56.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb80200640 1 -- start start 2024-09-12T12:21:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb80200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffb7815c7b0 0x7ffb780ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb80200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb780b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb80200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb780cd870 con 0x7ffb780b5de0 2024-09-12T12:21:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb80200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffb78072a50 con 0x7ffb7815c7b0 2024-09-12T12:21:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb80200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb780cde30 con 0x7ffb7815cd30 2024-09-12T12:21:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb7d800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffb7815c7b0 0x7ffb780ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb7e200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ffb780b5de0 0x7ffb781601d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48984/0 (socket says 172.21.15.144:48984) 2024-09-12T12:21:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb7e200640 1 -- 172.21.15.144:0/1302173387 learned_addr learned my addr 172.21.15.144:0/1302173387 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb7ce00640 1 --2- 172.21.15.144:0/1302173387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb780b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb77e00640 1 -- 172.21.15.144:0/1302173387 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144363181 0 0) 0x7ffb780cd870 con 0x7ffb780b5de0 2024-09-12T12:21:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb77e00640 1 -- 172.21.15.144:0/1302173387 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb60003530 con 0x7ffb780b5de0 2024-09-12T12:21:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb7d800640 1 -- 172.21.15.144:0/1302173387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 msgr2=0x7ffb780b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb7d800640 1 --2- 172.21.15.144:0/1302173387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb780b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb7d800640 1 -- 172.21.15.144:0/1302173387 >> v1:172.21.15.144:6789/0 conn(0x7ffb780b5de0 legacy=0x7ffb781601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb7d800640 1 -- 172.21.15.144:0/1302173387 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb780cdb50 con 0x7ffb7815c7b0 2024-09-12T12:21:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.038+0000 7ffb7ce00640 1 --2- 172.21.15.144:0/1302173387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb780b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb7d800640 1 --2- 172.21.15.144:0/1302173387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 0x7ffb780ccf00 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d90 tx=0x7ffb6c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b560368e29bd3648 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb77e00640 1 -- 172.21.15.144:0/1302173387 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0b2070 con 0x7ffb7815c7b0 2024-09-12T12:21:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb77e00640 1 -- 172.21.15.144:0/1302173387 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6c0a5830 con 0x7ffb7815c7b0 2024-09-12T12:21:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb77e00640 1 -- 172.21.15.144:0/1302173387 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0a5be0 con 0x7ffb7815c7b0 2024-09-12T12:21:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb80200640 1 -- 172.21.15.144:0/1302173387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 msgr2=0x7ffb780ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb80200640 1 --2- 172.21.15.144:0/1302173387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 0x7ffb780ccf00 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d90 tx=0x7ffb6c01c970 comp rx=0 tx=0).stop 2024-09-12T12:21:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb80200640 1 -- 172.21.15.144:0/1302173387 shutdown_connections 2024-09-12T12:21:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb80200640 1 --2- 172.21.15.144:0/1302173387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb780b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb80200640 1 --2- 172.21.15.144:0/1302173387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 0x7ffb780ccf00 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb80200640 1 -- 172.21.15.144:0/1302173387 >> 172.21.15.144:0/1302173387 conn(0x7ffb7806d0d0 msgr2=0x7ffb7806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb80200640 1 -- 172.21.15.144:0/1302173387 shutdown_connections 2024-09-12T12:21:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.042+0000 7ffb80200640 1 -- 172.21.15.144:0/1302173387 wait complete. 2024-09-12T12:21:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 Processor -- start 2024-09-12T12:21:56.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 -- start start 2024-09-12T12:21:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb780b5de0 0x7ffb780b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 0x7ffb78155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb7815af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb78169530 con 0x7ffb7815c7b0 2024-09-12T12:21:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffb780cd650 con 0x7ffb780b5de0 2024-09-12T12:21:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb781696b0 con 0x7ffb7815cd30 2024-09-12T12:21:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 0x7ffb78155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 0x7ffb78155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39226/0 (socket says 172.21.15.144:39226) 2024-09-12T12:21:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7ce00640 1 -- 172.21.15.144:0/1750335555 learned_addr learned my addr 172.21.15.144:0/1750335555 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7d800640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb780b5de0 0x7ffb780b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7e200640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb7815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7ce00640 1 -- 172.21.15.144:0/1750335555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 msgr2=0x7ffb7815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7ce00640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb7815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7ce00640 1 -- 172.21.15.144:0/1750335555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb780b5de0 msgr2=0x7ffb780b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7ce00640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb780b5de0 0x7ffb780b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7ce00640 1 -- 172.21.15.144:0/1750335555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb78162eb0 con 0x7ffb7815c7b0 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7e200640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb7815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb7ce00640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 0x7ffb78155c00 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400d830 tx=0x7ffb6400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb75600640 1 -- 172.21.15.144:0/1750335555 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64018020 con 0x7ffb7815c7b0 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb75600640 1 -- 172.21.15.144:0/1750335555 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb640096c0 con 0x7ffb7815c7b0 2024-09-12T12:21:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb78163190 con 0x7ffb7815c7b0 2024-09-12T12:21:56.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb75600640 1 -- 172.21.15.144:0/1750335555 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64009ab0 con 0x7ffb7815c7b0 2024-09-12T12:21:56.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.046+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb78163750 con 0x7ffb7815c7b0 2024-09-12T12:21:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.050+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb780ccf00 con 0x7ffb7815c7b0 2024-09-12T12:21:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.050+0000 7ffb75600640 1 -- 172.21.15.144:0/1750335555 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb6401b020 con 0x7ffb7815c7b0 2024-09-12T12:21:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.050+0000 7ffb75600640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb580678c0 0x7ffb58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.050+0000 7ffb75600640 1 -- 172.21.15.144:0/1750335555 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7ffb64086520 con 0x7ffb7815c7b0 2024-09-12T12:21:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.050+0000 7ffb7d800640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb580678c0 0x7ffb58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.050+0000 7ffb7d800640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb580678c0 0x7ffb58069d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0af000 tx=0x7ffb6c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.054+0000 7ffb75600640 1 -- 172.21.15.144:0/1750335555 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffb64022020 con 0x7ffb7815c7b0 2024-09-12T12:21:56.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.246+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb780753c0 con 0x7ffb7815c7b0 2024-09-12T12:21:56.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.246+0000 7ffb75600640 1 -- 172.21.15.144:0/1750335555 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5234 (secure 0 0 0) 0x7ffb64056ec0 con 0x7ffb7815c7b0 2024-09-12T12:21:56.250 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:56.250 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":107,"btime":"2024-09-12T12:21:16:405971+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:21:12.766465+0000","modified":"2024-09-12T12:21:15.787143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8391},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8391":{"gid":8391,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2508228850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2508228850},{"type":"v1","addr":"172.21.15.144:6837","nonce":2508228850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8391,"qdb_cluster":[8391]},"id":9}]} 2024-09-12T12:21:56.250 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 107 2024-09-12T12:21:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb580678c0 msgr2=0x7ffb58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb580678c0 0x7ffb58069d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c0af000 tx=0x7ffb6c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:21:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 msgr2=0x7ffb78155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 0x7ffb78155c00 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400d830 tx=0x7ffb6400dcf0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 shutdown_connections 2024-09-12T12:21:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffb580678c0 0x7ffb58069d80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb7815cd30 0x7ffb7815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb7815c7b0 0x7ffb78155c00 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 --2- 172.21.15.144:0/1750335555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb780b5de0 0x7ffb780b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 >> 172.21.15.144:0/1750335555 conn(0x7ffb7806d0d0 msgr2=0x7ffb780b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 shutdown_connections 2024-09-12T12:21:56.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.250+0000 7ffb80200640 1 -- 172.21.15.144:0/1750335555 wait complete. 2024-09-12T12:21:56.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:21:56.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feeeea00640 1 Processor -- start 2024-09-12T12:21:56.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feeeea00640 1 -- start start 2024-09-12T12:21:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feeeea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feee80d06a0 0x7feee8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feeeea00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee80cd1d0 con 0x7feee815b160 2024-09-12T12:21:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feeeea00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee80cd4a0 con 0x7feee8073bd0 2024-09-12T12:21:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feeeea00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7feee815b540 con 0x7feee80d06a0 2024-09-12T12:21:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feeed600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7feee815b160 0x7feee80ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48996/0 (socket says 172.21.15.144:48996) 2024-09-12T12:21:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feeed600640 1 -- 172.21.15.144:0/1169110295 learned_addr learned my addr 172.21.15.144:0/1169110295 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feeee000640 1 --2- 172.21.15.144:0/1169110295 >> v2:172.21.15.165:3300/0 conn(0x7feee80d06a0 0x7feee8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880322059 0 0) 0x7feee80cd1d0 con 0x7feee815b160 2024-09-12T12:21:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feed0003530 con 0x7feee815b160 2024-09-12T12:21:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1316412359 0 0) 0x7feed0003530 con 0x7feee815b160 2024-09-12T12:21:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 >> v2:172.21.15.165:3300/0 conn(0x7feee80d06a0 msgr2=0x7feee8070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 --2- 172.21.15.144:0/1169110295 >> v2:172.21.15.165:3300/0 conn(0x7feee80d06a0 0x7feee8070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 >> v1:172.21.15.165:6789/0 conn(0x7feee8073bd0 legacy=0x7feee80cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee80cd780 con 0x7feee815b160 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7feedc001a00 con 0x7feee815b160 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 >> v1:172.21.15.144:6789/0 conn(0x7feee815b160 legacy=0x7feee80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed00039c0 0x7feed0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed0004810 0x7feed0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feed00051d0 0x7feed000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feee815b540 con 0x7feed0004810 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feed000c170 con 0x7feed00051d0 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.406+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feed000c370 con 0x7feed00039c0 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeecc00640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed0004810 0x7feed0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeed600640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed00039c0 0x7feed0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeee000640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feed00051d0 0x7feed000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeecc00640 1 -- 172.21.15.144:0/1169110295 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed00039c0 msgr2=0x7feed0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeecc00640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed00039c0 0x7feed0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeecc00640 1 -- 172.21.15.144:0/1169110295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feed00051d0 msgr2=0x7feed000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeecc00640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feed00051d0 0x7feed000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeecc00640 1 -- 172.21.15.144:0/1169110295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed0003530 con 0x7feed0004810 2024-09-12T12:21:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeee000640 1 -- 172.21.15.144:0/1169110295 reap_dead start 2024-09-12T12:21:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feeecc00640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed0004810 0x7feed0004c90 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7feed4001360 tx=0x7feed401e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38beca8088c70826 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed40b2070 con 0x7feed0004810 2024-09-12T12:21:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed40052f0 con 0x7feed0004810 2024-09-12T12:21:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.410+0000 7feee7e00640 1 -- 172.21.15.144:0/1169110295 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed40013a0 con 0x7feed0004810 2024-09-12T12:21:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 -- 172.21.15.144:0/1169110295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed0004810 msgr2=0x7feed0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed0004810 0x7feed0004c90 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7feed4001360 tx=0x7feed401e610 comp rx=0 tx=0).stop 2024-09-12T12:21:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 -- 172.21.15.144:0/1169110295 shutdown_connections 2024-09-12T12:21:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 --2- 172.21.15.144:0/1169110295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed0004810 0x7feed0004c90 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 -- 172.21.15.144:0/1169110295 >> 172.21.15.144:0/1169110295 conn(0x7feee806bc10 msgr2=0x7feee806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 -- 172.21.15.144:0/1169110295 shutdown_connections 2024-09-12T12:21:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 -- 172.21.15.144:0/1169110295 wait complete. 2024-09-12T12:21:56.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 Processor -- start 2024-09-12T12:21:56.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 -- start start 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed0004810 0x7feee81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee80ae510 0x7feee80ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feee8157750 0x7feee8157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feee80d0520 con 0x7feee80ae510 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feee80d03a0 con 0x7feee8157750 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeeea00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feee80ccac0 con 0x7feed0004810 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeecc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee80ae510 0x7feee80ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeecc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee80ae510 0x7feee80ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39244/0 (socket says 172.21.15.144:39244) 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeecc00640 1 -- 172.21.15.144:0/3485771586 learned_addr learned my addr 172.21.15.144:0/3485771586 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeee000640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feee8157750 0x7feee8157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeed600640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed0004810 0x7feee81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeecc00640 1 -- 172.21.15.144:0/3485771586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed0004810 msgr2=0x7feee81522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeecc00640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed0004810 0x7feee81522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeecc00640 1 -- 172.21.15.144:0/3485771586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feee8157750 msgr2=0x7feee8157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeecc00640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feee8157750 0x7feee8157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeecc00640 1 -- 172.21.15.144:0/3485771586 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee8156160 con 0x7feee80ae510 2024-09-12T12:21:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeed600640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed0004810 0x7feee81522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.414+0000 7feeecc00640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee80ae510 0x7feee80ae990 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7feed4099f20 tx=0x7feed0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feee5600640 1 -- 172.21.15.144:0/3485771586 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed40b2040 con 0x7feee80ae510 2024-09-12T12:21:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feee5600640 1 -- 172.21.15.144:0/3485771586 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed40bc070 con 0x7feee80ae510 2024-09-12T12:21:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feee5600640 1 -- 172.21.15.144:0/3485771586 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4007a40 con 0x7feee80ae510 2024-09-12T12:21:56.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee8156440 con 0x7feee80ae510 2024-09-12T12:21:56.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee8156a00 con 0x7feee80ae510 2024-09-12T12:21:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee8158110 con 0x7feee80ae510 2024-09-12T12:21:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feee5600640 1 -- 172.21.15.144:0/3485771586 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feed40052f0 con 0x7feee80ae510 2024-09-12T12:21:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feee5600640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feec80678c0 0x7feec8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feee5600640 1 -- 172.21.15.144:0/3485771586 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7feed4121de0 con 0x7feee80ae510 2024-09-12T12:21:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feeed600640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feec80678c0 0x7feec8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.418+0000 7feeed600640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feec80678c0 0x7feec8069d80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7feedc000f90 tx=0x7feedc006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.422+0000 7feee5600640 1 -- 172.21.15.144:0/3485771586 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feed4018320 con 0x7feee80ae510 2024-09-12T12:21:56.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.582+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feee80cce50 con 0x7feee80ae510 2024-09-12T12:21:56.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.582+0000 7feee5600640 1 -- 172.21.15.144:0/3485771586 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16984 (secure 0 0 0) 0x7feed40f2780 con 0x7feee80ae510 2024-09-12T12:21:56.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:21:56.586 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":140,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:21:14.364804+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:21:10.454030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-12T12:21:11.747676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:21:56.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feec80678c0 msgr2=0x7feec8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feec80678c0 0x7feec8069d80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7feedc000f90 tx=0x7feedc006040 comp rx=0 tx=0).stop 2024-09-12T12:21:56.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee80ae510 msgr2=0x7feee80ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee80ae510 0x7feee80ae990 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7feed4099f20 tx=0x7feed0005840 comp rx=0 tx=0).stop 2024-09-12T12:21:56.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 shutdown_connections 2024-09-12T12:21:56.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feec80678c0 0x7feec8069d80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feee8157750 0x7feee8157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feee80ae510 0x7feee80ae990 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 --2- 172.21.15.144:0/3485771586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feed0004810 0x7feee81522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 >> 172.21.15.144:0/3485771586 conn(0x7feee806bc10 msgr2=0x7feee8072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:56.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 shutdown_connections 2024-09-12T12:21:56.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.586+0000 7feeeea00640 1 -- 172.21.15.144:0/3485771586 wait complete. 2024-09-12T12:21:56.610 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:21:56.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd7e00640 1 Processor -- start 2024-09-12T12:21:56.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd7e00640 1 -- start start 2024-09-12T12:21:56.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd0161c40 0x7f5cd0071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd01621a0 con 0x7f5cd00b4240 2024-09-12T12:21:56.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd7e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd00b7180 con 0x7f5cd00b6bf0 2024-09-12T12:21:56.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd00b7460 con 0x7f5cd0161c40 2024-09-12T12:21:56.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5cd00b4240 0x7f5cd0162650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49004/0 (socket says 172.21.15.144:49004) 2024-09-12T12:21:56.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd5e00640 1 -- 172.21.15.144:0/3067169011 learned_addr learned my addr 172.21.15.144:0/3067169011 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:56.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd5400640 1 --2- 172.21.15.144:0/3067169011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd0161c40 0x7f5cd0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5ccfe00640 1 -- 172.21.15.144:0/3067169011 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946948611 0 0) 0x7f5cd01621a0 con 0x7f5cd00b4240 2024-09-12T12:21:56.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5ccfe00640 1 -- 172.21.15.144:0/3067169011 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cb8003530 con 0x7f5cd00b4240 2024-09-12T12:21:56.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5ccfe00640 1 -- 172.21.15.144:0/3067169011 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344808057 0 0) 0x7f5cd00b7180 con 0x7f5cd00b6bf0 2024-09-12T12:21:56.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5ccfe00640 1 -- 172.21.15.144:0/3067169011 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cd01621a0 con 0x7f5cd00b6bf0 2024-09-12T12:21:56.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd5400640 1 -- 172.21.15.144:0/3067169011 >> v1:172.21.15.165:6789/0 conn(0x7f5cd00b6bf0 legacy=0x7f5cd006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd5400640 1 -- 172.21.15.144:0/3067169011 >> v1:172.21.15.144:6789/0 conn(0x7f5cd00b4240 legacy=0x7f5cd0162650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5ccfe00640 1 -- 172.21.15.144:0/3067169011 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1463920324 0 0) 0x7f5cb8003530 con 0x7f5cd00b4240 2024-09-12T12:21:56.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.746+0000 7f5cd5400640 1 -- 172.21.15.144:0/3067169011 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd00b7740 con 0x7f5cd0161c40 2024-09-12T12:21:56.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5cd5400640 1 --2- 172.21.15.144:0/3067169011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd0161c40 0x7f5cd0071850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009dc0 tx=0x7f5cc401c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b635d96439e7558 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5ccfe00640 1 -- 172.21.15.144:0/3067169011 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40b2070 con 0x7f5cd0161c40 2024-09-12T12:21:56.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5ccfe00640 1 -- 172.21.15.144:0/3067169011 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc40a5570 con 0x7f5cd0161c40 2024-09-12T12:21:56.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5ccfe00640 1 -- 172.21.15.144:0/3067169011 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8001680 con 0x7f5cd0161c40 2024-09-12T12:21:56.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5cd7e00640 1 -- 172.21.15.144:0/3067169011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd0161c40 msgr2=0x7f5cd0071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5cd7e00640 1 --2- 172.21.15.144:0/3067169011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd0161c40 0x7f5cd0071850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009dc0 tx=0x7f5cc401c820 comp rx=0 tx=0).stop 2024-09-12T12:21:56.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5cd7e00640 1 -- 172.21.15.144:0/3067169011 shutdown_connections 2024-09-12T12:21:56.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5cd7e00640 1 --2- 172.21.15.144:0/3067169011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd0161c40 0x7f5cd0071850 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5cd7e00640 1 -- 172.21.15.144:0/3067169011 >> 172.21.15.144:0/3067169011 conn(0x7f5cd006f3c0 msgr2=0x7f5cd006f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:56.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5cd7e00640 1 -- 172.21.15.144:0/3067169011 shutdown_connections 2024-09-12T12:21:56.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.750+0000 7f5cd7e00640 1 -- 172.21.15.144:0/3067169011 wait complete. 2024-09-12T12:21:56.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 Processor -- start 2024-09-12T12:21:56.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 -- start start 2024-09-12T12:21:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd00b4240 0x7f5cd0163350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cd00b6bf0 0x7f5cd015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cd0161c40 0x7f5cd015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd00715d0 con 0x7f5cd0161c40 2024-09-12T12:21:56.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd0071450 con 0x7f5cd00b6bf0 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd016ca90 con 0x7f5cd00b4240 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cd0161c40 0x7f5cd015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cd0161c40 0x7f5cd015a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39250/0 (socket says 172.21.15.144:39250) 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5e00640 1 -- 172.21.15.144:0/1109090376 learned_addr learned my addr 172.21.15.144:0/1109090376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5400640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd00b4240 0x7f5cd0163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd4a00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cd00b6bf0 0x7f5cd015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5e00640 1 -- 172.21.15.144:0/1109090376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd00b4240 msgr2=0x7f5cd0163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5e00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd00b4240 0x7f5cd0163350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5e00640 1 -- 172.21.15.144:0/1109090376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cd00b6bf0 msgr2=0x7f5cd015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5e00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cd00b6bf0 0x7f5cd015a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5e00640 1 -- 172.21.15.144:0/1109090376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd0159490 con 0x7f5cd0161c40 2024-09-12T12:21:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd5e00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cd0161c40 0x7f5cd015a750 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800c750 tx=0x7f5cc800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5ccd600640 1 -- 172.21.15.144:0/1109090376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8005ae0 con 0x7f5cd0161c40 2024-09-12T12:21:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5ccd600640 1 -- 172.21.15.144:0/1109090376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc8005ca0 con 0x7f5cd0161c40 2024-09-12T12:21:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5ccd600640 1 -- 172.21.15.144:0/1109090376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc80072b0 con 0x7f5cd0161c40 2024-09-12T12:21:56.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd0159730 con 0x7f5cd0161c40 2024-09-12T12:21:56.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.754+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd0159cf0 con 0x7f5cd0161c40 2024-09-12T12:21:56.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.758+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd0071850 con 0x7f5cd0161c40 2024-09-12T12:21:56.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.758+0000 7f5ccd600640 1 -- 172.21.15.144:0/1109090376 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5cc8007450 con 0x7f5cd0161c40 2024-09-12T12:21:56.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.758+0000 7f5ccd600640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cb00678c0 0x7f5cb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:56.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.758+0000 7f5ccd600640 1 -- 172.21.15.144:0/1109090376 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 6101+0+0 (secure 0 0 0) 0x7f5cc8085c70 con 0x7f5cd0161c40 2024-09-12T12:21:56.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.758+0000 7f5cd5400640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cb00678c0 0x7f5cb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:56.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.758+0000 7f5cd5400640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cb00678c0 0x7f5cb0069d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40af000 tx=0x7f5cc40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:56.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.762+0000 7f5ccd600640 1 -- 172.21.15.144:0/1109090376 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5cc8019300 con 0x7f5cd0161c40 2024-09-12T12:21:56.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.954+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5cd00d2270 con 0x7f5cd0161c40 2024-09-12T12:21:56.956 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:21:56.954+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:21:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.954+0000 7f5ccd600640 1 -- 172.21.15.144:0/1109090376 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v108) ==== 161+0+0 (secure 0 0 0) 0x7f5cc8056640 con 0x7f5cd0161c40 2024-09-12T12:21:56.958 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:21:56.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cb00678c0 msgr2=0x7f5cb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cb00678c0 0x7f5cb0069d80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40af000 tx=0x7f5cc40a7070 comp rx=0 tx=0).stop 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cd0161c40 msgr2=0x7f5cd015a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cd0161c40 0x7f5cd015a750 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5cc800c750 tx=0x7f5cc800cc10 comp rx=0 tx=0).stop 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 shutdown_connections 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5cb00678c0 0x7f5cb0069d80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5cd0161c40 0x7f5cd015a750 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5cd00b6bf0 0x7f5cd015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 --2- 172.21.15.144:0/1109090376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5cd00b4240 0x7f5cd0163350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 >> 172.21.15.144:0/1109090376 conn(0x7f5cd006f3c0 msgr2=0x7f5cd00cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 shutdown_connections 2024-09-12T12:21:56.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:56.958+0000 7f5cd7e00640 1 -- 172.21.15.144:0/1109090376 wait complete. 2024-09-12T12:21:56.981 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:21:57.030 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:21:57.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae1c600640 1 Processor -- start 2024-09-12T12:21:57.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae1c600640 1 -- start start 2024-09-12T12:21:57.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae1c600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae140b4b20 0x7fae1415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:57.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae1c600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fae140b3970 0x7fae140b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:57.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae1c600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae140b3470 con 0x7fae140b4f00 2024-09-12T12:21:57.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae1c600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fae1415f270 con 0x7fae140b4b20 2024-09-12T12:21:57.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae1c600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fae1415f550 con 0x7fae140b3970 2024-09-12T12:21:57.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae19c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae140b4b20 0x7fae1415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:57.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae19200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fae140b4f00 0x7fae14162950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53654/0 (socket says 172.21.15.144:53654) 2024-09-12T12:21:57.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae19200640 1 -- 172.21.15.144:0/320282140 learned_addr learned my addr 172.21.15.144:0/320282140 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:57.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae1a600640 1 --2- 172.21.15.144:0/320282140 >> v2:172.21.15.165:3300/0 conn(0x7fae140b3970 0x7fae140b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:57.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae19c00640 1 -- 172.21.15.144:0/320282140 >> v2:172.21.15.165:3300/0 conn(0x7fae140b3970 msgr2=0x7fae140b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:57.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae19c00640 1 --2- 172.21.15.144:0/320282140 >> v2:172.21.15.165:3300/0 conn(0x7fae140b3970 0x7fae140b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae13e00640 1 -- 172.21.15.144:0/320282140 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606448679 0 0) 0x7fae140b3470 con 0x7fae140b4f00 2024-09-12T12:21:57.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae19c00640 1 -- 172.21.15.144:0/320282140 >> v1:172.21.15.144:6789/0 conn(0x7fae140b4f00 legacy=0x7fae14162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:57.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae19c00640 1 -- 172.21.15.144:0/320282140 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1415f830 con 0x7fae140b4b20 2024-09-12T12:21:57.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.122+0000 7fae1a600640 1 --2- 172.21.15.144:0/320282140 >> v2:172.21.15.165:3300/0 conn(0x7fae140b3970 0x7fae140b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:57.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae19c00640 1 --2- 172.21.15.144:0/320282140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b4b20 0x7fae1415eb20 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fae140b4340 tx=0x7fae0801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703ecf5a9644fb0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:57.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae13e00640 1 -- 172.21.15.144:0/320282140 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae080b2070 con 0x7fae140b4b20 2024-09-12T12:21:57.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae13e00640 1 -- 172.21.15.144:0/320282140 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae080a5760 con 0x7fae140b4b20 2024-09-12T12:21:57.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae13e00640 1 -- 172.21.15.144:0/320282140 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae080a5b30 con 0x7fae140b4b20 2024-09-12T12:21:57.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae1c600640 1 -- 172.21.15.144:0/320282140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b4b20 msgr2=0x7fae1415eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:57.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae1c600640 1 --2- 172.21.15.144:0/320282140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b4b20 0x7fae1415eb20 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fae140b4340 tx=0x7fae0801c8a0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae1c600640 1 -- 172.21.15.144:0/320282140 shutdown_connections 2024-09-12T12:21:57.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae1c600640 1 --2- 172.21.15.144:0/320282140 >> v2:172.21.15.165:3300/0 conn(0x7fae140b3970 0x7fae140b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae1c600640 1 --2- 172.21.15.144:0/320282140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b4b20 0x7fae1415eb20 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae1c600640 1 -- 172.21.15.144:0/320282140 >> 172.21.15.144:0/320282140 conn(0x7fae14068030 msgr2=0x7fae140b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:57.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae1c600640 1 -- 172.21.15.144:0/320282140 shutdown_connections 2024-09-12T12:21:57.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.126+0000 7fae1c600640 1 -- 172.21.15.144:0/320282140 wait complete. 2024-09-12T12:21:57.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 Processor -- start 2024-09-12T12:21:57.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 -- start start 2024-09-12T12:21:57.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b3970 0x7fae1413f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae140b4b20 0x7fae14158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae140b4f00 0x7fae1413da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fae140cc450 con 0x7fae140b3970 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fae140cc2d0 con 0x7fae140b4f00 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fae140cc5d0 con 0x7fae140b4b20 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b3970 0x7fae1413f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b3970 0x7fae1413f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47182/0 (socket says 172.21.15.144:47182) 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19c00640 1 -- 172.21.15.144:0/164935548 learned_addr learned my addr 172.21.15.144:0/164935548 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1a600640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae140b4f00 0x7fae1413da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19200640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae140b4b20 0x7fae14158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19c00640 1 -- 172.21.15.144:0/164935548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae140b4b20 msgr2=0x7fae14158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:57.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19c00640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae140b4b20 0x7fae14158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19c00640 1 -- 172.21.15.144:0/164935548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae140b4f00 msgr2=0x7fae1413da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19c00640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae140b4f00 0x7fae1413da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19c00640 1 -- 172.21.15.144:0/164935548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae14158e50 con 0x7fae140b3970 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19200640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae140b4b20 0x7fae14158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae19c00640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b3970 0x7fae1413f4c0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fae0801a4d0 tx=0x7fae08019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae11600640 1 -- 172.21.15.144:0/164935548 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae080bd020 con 0x7fae140b3970 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae11600640 1 -- 172.21.15.144:0/164935548 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae080ad870 con 0x7fae140b3970 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae11600640 1 -- 172.21.15.144:0/164935548 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae080b2040 con 0x7fae140b3970 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1413faa0 con 0x7fae140b3970 2024-09-12T12:21:57.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae14140060 con 0x7fae140b3970 2024-09-12T12:21:57.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.130+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae140aea40 con 0x7fae140b3970 2024-09-12T12:21:57.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.134+0000 7fae11600640 1 -- 172.21.15.144:0/164935548 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae080c0020 con 0x7fae140b3970 2024-09-12T12:21:57.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.134+0000 7fae11600640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fadf40678c0 0x7fadf4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:57.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.134+0000 7fae11600640 1 -- 172.21.15.144:0/164935548 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6187+0+0 (secure 0 0 0) 0x7fae081210d0 con 0x7fae140b3970 2024-09-12T12:21:57.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.134+0000 7fae19200640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fadf40678c0 0x7fadf4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:57.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.134+0000 7fae19200640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fadf40678c0 0x7fadf4069d80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fae00007fd0 tx=0x7fae00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:57.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.138+0000 7fae11600640 1 -- 172.21.15.144:0/164935548 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fae080c7030 con 0x7fae140b3970 2024-09-12T12:21:57.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.326+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fae1413b940 con 0x7fae140b3970 2024-09-12T12:21:57.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae11600640 1 -- 172.21.15.144:0/164935548 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v109) ==== 104+0+0 (secure 0 0 0) 0x7fae08016520 con 0x7fae140b3970 2024-09-12T12:21:57.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fadf40678c0 msgr2=0x7fadf4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:57.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fadf40678c0 0x7fadf4069d80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fae00007fd0 tx=0x7fae00009040 comp rx=0 tx=0).stop 2024-09-12T12:21:57.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b3970 msgr2=0x7fae1413f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:57.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b3970 0x7fae1413f4c0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fae0801a4d0 tx=0x7fae08019640 comp rx=0 tx=0).stop 2024-09-12T12:21:57.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 shutdown_connections 2024-09-12T12:21:57.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fadf40678c0 0x7fadf4069d80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae140b4f00 0x7fae1413da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae140b4b20 0x7fae14158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 --2- 172.21.15.144:0/164935548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae140b3970 0x7fae1413f4c0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 >> 172.21.15.144:0/164935548 conn(0x7fae14068030 msgr2=0x7fae140b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 shutdown_connections 2024-09-12T12:21:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:57.962+0000 7fae1c600640 1 -- 172.21.15.144:0/164935548 wait complete. 2024-09-12T12:21:57.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:21:58.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf40400640 1 Processor -- start 2024-09-12T12:21:58.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf40400640 1 -- start start 2024-09-12T12:21:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf40400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcf38156c10 0x7fcf38072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf40400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf3806cff0 0x7fcf3806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf40400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcf38073360 0x7fcf38073810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf40400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcf38073d50 con 0x7fcf38156c10 2024-09-12T12:21:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf40400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcf3806d990 con 0x7fcf38073360 2024-09-12T12:21:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf40400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcf38071be0 con 0x7fcf3806cff0 2024-09-12T12:21:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcf38156c10 0x7fcf38072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcf38156c10 0x7fcf38072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47186/0 (socket says 172.21.15.144:47186) 2024-09-12T12:21:58.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3da00640 1 -- 172.21.15.144:0/2965497242 learned_addr learned my addr 172.21.15.144:0/2965497242 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:58.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3d000640 1 --2- 172.21.15.144:0/2965497242 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf3806cff0 0x7fcf3806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:58.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3e400640 1 --2- 172.21.15.144:0/2965497242 >> v2:172.21.15.165:3300/0 conn(0x7fcf38073360 0x7fcf38073810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:58.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3da00640 1 -- 172.21.15.144:0/2965497242 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf3806cff0 msgr2=0x7fcf3806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:58.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3da00640 1 --2- 172.21.15.144:0/2965497242 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf3806cff0 0x7fcf3806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3da00640 1 -- 172.21.15.144:0/2965497242 >> v2:172.21.15.165:3300/0 conn(0x7fcf38073360 msgr2=0x7fcf38073810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:58.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3da00640 1 --2- 172.21.15.144:0/2965497242 >> v2:172.21.15.165:3300/0 conn(0x7fcf38073360 0x7fcf38073810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3da00640 1 -- 172.21.15.144:0/2965497242 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3806cd20 con 0x7fcf38156c10 2024-09-12T12:21:58.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.130+0000 7fcf3e400640 1 --2- 172.21.15.144:0/2965497242 >> v2:172.21.15.165:3300/0 conn(0x7fcf38073360 0x7fcf38073810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:21:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.134+0000 7fcf3da00640 1 --2- 172.21.15.144:0/2965497242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 0x7fcf38072070 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fcf381601f0 tx=0x7fcf2c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b9cc717956fe93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.134+0000 7fcf37e00640 1 -- 172.21.15.144:0/2965497242 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0a6040 con 0x7fcf38156c10 2024-09-12T12:21:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.134+0000 7fcf37e00640 1 -- 172.21.15.144:0/2965497242 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0af070 con 0x7fcf38156c10 2024-09-12T12:21:58.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.134+0000 7fcf37e00640 1 -- 172.21.15.144:0/2965497242 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0aa860 con 0x7fcf38156c10 2024-09-12T12:21:58.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- 172.21.15.144:0/2965497242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 msgr2=0x7fcf38072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:58.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 --2- 172.21.15.144:0/2965497242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 0x7fcf38072070 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fcf381601f0 tx=0x7fcf2c01c520 comp rx=0 tx=0).stop 2024-09-12T12:21:58.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- 172.21.15.144:0/2965497242 shutdown_connections 2024-09-12T12:21:58.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 --2- 172.21.15.144:0/2965497242 >> v2:172.21.15.165:3300/0 conn(0x7fcf38073360 0x7fcf38073810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 --2- 172.21.15.144:0/2965497242 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf3806cff0 0x7fcf3806d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 --2- 172.21.15.144:0/2965497242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 0x7fcf38072070 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- 172.21.15.144:0/2965497242 >> 172.21.15.144:0/2965497242 conn(0x7fcf3806bc10 msgr2=0x7fcf3806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:58.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- 172.21.15.144:0/2965497242 shutdown_connections 2024-09-12T12:21:58.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- 172.21.15.144:0/2965497242 wait complete. 2024-09-12T12:21:58.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 Processor -- start 2024-09-12T12:21:58.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- start start 2024-09-12T12:21:58.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf3806cff0 0x7fcf38153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:58.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf38073360 0x7fcf3815ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:58.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 0x7fcf3815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38156ff0 con 0x7fcf38156c10 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38073f70 con 0x7fcf3806cff0 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcf38157170 con 0x7fcf38073360 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 0x7fcf3815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 0x7fcf3815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47194/0 (socket says 172.21.15.144:47194) 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3e400640 1 -- 172.21.15.144:0/3695078843 learned_addr learned my addr 172.21.15.144:0/3695078843 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3da00640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf3806cff0 0x7fcf38153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3d000640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf38073360 0x7fcf3815ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3e400640 1 -- 172.21.15.144:0/3695078843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf38073360 msgr2=0x7fcf3815ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3e400640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf38073360 0x7fcf3815ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3e400640 1 -- 172.21.15.144:0/3695078843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf3806cff0 msgr2=0x7fcf38153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3e400640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf3806cff0 0x7fcf38153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3e400640 1 -- 172.21.15.144:0/3695078843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf38155f80 con 0x7fcf38156c10 2024-09-12T12:21:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf3e400640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 0x7fcf3815efa0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fcf30007f20 tx=0x7fcf3000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf35600640 1 -- 172.21.15.144:0/3695078843 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3001a070 con 0x7fcf38156c10 2024-09-12T12:21:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf35600640 1 -- 172.21.15.144:0/3695078843 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf30003ba0 con 0x7fcf38156c10 2024-09-12T12:21:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf35600640 1 -- 172.21.15.144:0/3695078843 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30004030 con 0x7fcf38156c10 2024-09-12T12:21:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.138+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3813ccf0 con 0x7fcf38156c10 2024-09-12T12:21:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.142+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf3813d7d0 con 0x7fcf38156c10 2024-09-12T12:21:58.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.142+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf3806d450 con 0x7fcf38156c10 2024-09-12T12:21:58.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.142+0000 7fcf35600640 1 -- 172.21.15.144:0/3695078843 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf3001d070 con 0x7fcf38156c10 2024-09-12T12:21:58.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.142+0000 7fcf35600640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf180678c0 0x7fcf18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:58.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.142+0000 7fcf35600640 1 -- 172.21.15.144:0/3695078843 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 6187+0+0 (secure 0 0 0) 0x7fcf30086160 con 0x7fcf38156c10 2024-09-12T12:21:58.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.142+0000 7fcf3da00640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf180678c0 0x7fcf18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:58.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.146+0000 7fcf3da00640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf180678c0 0x7fcf18069d80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0ae000 tx=0x7fcf2c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:58.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.146+0000 7fcf35600640 1 -- 172.21.15.144:0/3695078843 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf30010070 con 0x7fcf38156c10 2024-09-12T12:21:58.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.306+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcf3806dd80 con 0x7fcf38156c10 2024-09-12T12:21:58.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.962+0000 7fcf35600640 1 -- 172.21.15.144:0/3695078843 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v142) ==== 181+0+0 (secure 0 0 0) 0x7fcf30056410 con 0x7fcf38156c10 2024-09-12T12:21:58.965 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:21:58.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf180678c0 msgr2=0x7fcf18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:58.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf180678c0 0x7fcf18069d80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0ae000 tx=0x7fcf2c0a7000 comp rx=0 tx=0).stop 2024-09-12T12:21:58.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 msgr2=0x7fcf3815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:58.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 0x7fcf3815efa0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fcf30007f20 tx=0x7fcf3000d560 comp rx=0 tx=0).stop 2024-09-12T12:21:58.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 shutdown_connections 2024-09-12T12:21:58.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcf180678c0 0x7fcf18069d80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf38156c10 0x7fcf3815efa0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf38073360 0x7fcf3815ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 --2- 172.21.15.144:0/3695078843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf3806cff0 0x7fcf38153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:58.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 >> 172.21.15.144:0/3695078843 conn(0x7fcf3806bc10 msgr2=0x7fcf38165dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:58.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 shutdown_connections 2024-09-12T12:21:58.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:58.966+0000 7fcf40400640 1 -- 172.21.15.144:0/3695078843 wait complete. 2024-09-12T12:21:58.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:21:59.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.134+0000 7f96e7200640 1 Processor -- start 2024-09-12T12:21:59.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e7200640 1 -- start start 2024-09-12T12:21:59.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96e8073c80 0x7f96e80b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e815e4f0 0x7f96e815e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e8074080 con 0x7f96e80ce110 2024-09-12T12:21:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f96e80ce4f0 con 0x7f96e8073c80 2024-09-12T12:21:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f96e80ce740 con 0x7f96e815e4f0 2024-09-12T12:21:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96e8073c80 0x7f96e80b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f96e80ce110 0x7f96e80cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53668/0 (socket says 172.21.15.144:53668) 2024-09-12T12:21:59.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e5e00640 1 -- 172.21.15.144:0/3311098804 learned_addr learned my addr 172.21.15.144:0/3311098804 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:21:59.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e6800640 1 --2- 172.21.15.144:0/3311098804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e815e4f0 0x7f96e815e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e5400640 1 -- 172.21.15.144:0/3311098804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e815e4f0 msgr2=0x7f96e815e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:21:59.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e5400640 1 --2- 172.21.15.144:0/3311098804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e815e4f0 0x7f96e815e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e5400640 1 -- 172.21.15.144:0/3311098804 >> v1:172.21.15.144:6789/0 conn(0x7f96e80ce110 legacy=0x7f96e80cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.138+0000 7f96e5400640 1 -- 172.21.15.144:0/3311098804 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e80cea20 con 0x7f96e8073c80 2024-09-12T12:21:59.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e5400640 1 --2- 172.21.15.144:0/3311098804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 0x7f96e80b1e80 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f96d40097c0 tx=0x7f96d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7503511885a14c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:59.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e4a00640 1 -- 172.21.15.144:0/3311098804 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d40b0070 con 0x7f96e8073c80 2024-09-12T12:21:59.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e4a00640 1 -- 172.21.15.144:0/3311098804 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d40ab600 con 0x7f96e8073c80 2024-09-12T12:21:59.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e4a00640 1 -- 172.21.15.144:0/3311098804 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d40ab9d0 con 0x7f96e8073c80 2024-09-12T12:21:59.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 -- 172.21.15.144:0/3311098804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 msgr2=0x7f96e80b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 --2- 172.21.15.144:0/3311098804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 0x7f96e80b1e80 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f96d40097c0 tx=0x7f96d401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 -- 172.21.15.144:0/3311098804 shutdown_connections 2024-09-12T12:21:59.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 --2- 172.21.15.144:0/3311098804 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e815e4f0 0x7f96e815e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 --2- 172.21.15.144:0/3311098804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 0x7f96e80b1e80 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 -- 172.21.15.144:0/3311098804 >> 172.21.15.144:0/3311098804 conn(0x7f96e806bc10 msgr2=0x7f96e806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 -- 172.21.15.144:0/3311098804 shutdown_connections 2024-09-12T12:21:59.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 -- 172.21.15.144:0/3311098804 wait complete. 2024-09-12T12:21:59.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 Processor -- start 2024-09-12T12:21:59.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.142+0000 7f96e7200640 1 -- start start 2024-09-12T12:21:59.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 0x7f96e8147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e80ce110 0x7f96e80b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96e815e4f0 0x7f96e80b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f96e80b2540 con 0x7f96e8073c80 2024-09-12T12:21:59.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f96e80b23c0 con 0x7f96e815e4f0 2024-09-12T12:21:59.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f96e80b4370 con 0x7f96e80ce110 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 0x7f96e8147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 0x7f96e8147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47214/0 (socket says 172.21.15.144:47214) 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5e00640 1 -- 172.21.15.144:0/701737361 learned_addr learned my addr 172.21.15.144:0/701737361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5400640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e80ce110 0x7f96e80b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e6800640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96e815e4f0 0x7f96e80b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5e00640 1 -- 172.21.15.144:0/701737361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e80ce110 msgr2=0x7f96e80b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5e00640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e80ce110 0x7f96e80b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5e00640 1 -- 172.21.15.144:0/701737361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96e815e4f0 msgr2=0x7f96e80b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5e00640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96e815e4f0 0x7f96e80b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5e00640 1 -- 172.21.15.144:0/701737361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e8159fd0 con 0x7f96e8073c80 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e5e00640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 0x7f96e8147bb0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f96d800cb10 tx=0x7f96d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96de000640 1 -- 172.21.15.144:0/701737361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8017070 con 0x7f96e8073c80 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96de000640 1 -- 172.21.15.144:0/701737361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d800ac70 con 0x7f96e8073c80 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96de000640 1 -- 172.21.15.144:0/701737361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8012620 con 0x7f96e8073c80 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e81fa890 con 0x7f96e8073c80 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e81fae50 con 0x7f96e8073c80 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e80b1e80 con 0x7f96e8073c80 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.146+0000 7f96de000640 1 -- 172.21.15.144:0/701737361 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96d801a070 con 0x7f96e8073c80 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.150+0000 7f96de000640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96c80678c0 0x7f96c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.150+0000 7f96de000640 1 -- 172.21.15.144:0/701737361 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5749+0+0 (secure 0 0 0) 0x7f96d8085a10 con 0x7f96e8073c80 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.150+0000 7f96e5400640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96c80678c0 0x7f96c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:21:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.150+0000 7f96e5400640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96c80678c0 0x7f96c8069d80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f96d40ad000 tx=0x7f96d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:21:59.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.154+0000 7f96de000640 1 -- 172.21.15.144:0/701737361 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f96d8055ec0 con 0x7f96e8073c80 2024-09-12T12:21:59.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.310+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f96e8070e30 con 0x7f96e8073c80 2024-09-12T12:21:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.970+0000 7f96de000640 1 -- 172.21.15.144:0/701737361 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v143) ==== 169+0+0 (secure 0 0 0) 0x7f96d805a1c0 con 0x7f96e8073c80 2024-09-12T12:21:59.971 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:21:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96c80678c0 msgr2=0x7f96c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96c80678c0 0x7f96c8069d80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f96d40ad000 tx=0x7f96d4008040 comp rx=0 tx=0).stop 2024-09-12T12:21:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 msgr2=0x7f96e8147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:21:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 0x7f96e8147bb0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f96d800cb10 tx=0x7f96d800a060 comp rx=0 tx=0).stop 2024-09-12T12:21:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 shutdown_connections 2024-09-12T12:21:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96c80678c0 0x7f96c8069d80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96e815e4f0 0x7f96e80b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96e80ce110 0x7f96e80b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 --2- 172.21.15.144:0/701737361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96e8073c80 0x7f96e8147bb0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:21:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 >> 172.21.15.144:0/701737361 conn(0x7f96e806bc10 msgr2=0x7f96e80cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:21:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 shutdown_connections 2024-09-12T12:21:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:21:59.974+0000 7f96e7200640 1 -- 172.21.15.144:0/701737361 wait complete. 2024-09-12T12:22:00.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:22:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b97c00640 1 Processor -- start 2024-09-12T12:22:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b97c00640 1 -- start start 2024-09-12T12:22:00.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b97c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9b9015c6f0 0x7f9b9006e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b97c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9b9006e8e0 0x7f9b900cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b97c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b900d1310 con 0x7f9b900b3500 2024-09-12T12:22:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b97c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9b90072e30 con 0x7f9b9015c6f0 2024-09-12T12:22:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b97c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9b90072500 con 0x7f9b9006e8e0 2024-09-12T12:22:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b95200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9b900b3500 0x7f9b900b38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53672/0 (socket says 172.21.15.144:53672) 2024-09-12T12:22:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b95200640 1 -- 172.21.15.144:0/2420061641 learned_addr learned my addr 172.21.15.144:0/2420061641 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b8fe00640 1 --2- 172.21.15.144:0/2420061641 >> v2:172.21.15.144:3300/0 conn(0x7f9b9015c6f0 0x7f9b9006e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.182+0000 7f9b95c00640 1 --2- 172.21.15.144:0/2420061641 >> v2:172.21.15.165:3300/0 conn(0x7f9b9006e8e0 0x7f9b900cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8f400640 1 -- 172.21.15.144:0/2420061641 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022589618 0 0) 0x7f9b900d1310 con 0x7f9b900b3500 2024-09-12T12:22:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8f400640 1 -- 172.21.15.144:0/2420061641 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b78003530 con 0x7f9b900b3500 2024-09-12T12:22:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8fe00640 1 -- 172.21.15.144:0/2420061641 >> v2:172.21.15.165:3300/0 conn(0x7f9b9006e8e0 msgr2=0x7f9b900cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8fe00640 1 --2- 172.21.15.144:0/2420061641 >> v2:172.21.15.165:3300/0 conn(0x7f9b9006e8e0 0x7f9b900cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8fe00640 1 -- 172.21.15.144:0/2420061641 >> v1:172.21.15.144:6789/0 conn(0x7f9b900b3500 legacy=0x7f9b900b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8fe00640 1 -- 172.21.15.144:0/2420061641 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b900727e0 con 0x7f9b9015c6f0 2024-09-12T12:22:00.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8fe00640 1 --2- 172.21.15.144:0/2420061641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b9015c6f0 0x7f9b9006e3a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f9b900b12a0 tx=0x7f9b7c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a41d42326968de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8f400640 1 -- 172.21.15.144:0/2420061641 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c0b0070 con 0x7f9b9015c6f0 2024-09-12T12:22:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8f400640 1 -- 172.21.15.144:0/2420061641 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7c0ab600 con 0x7f9b9015c6f0 2024-09-12T12:22:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.186+0000 7f9b8f400640 1 -- 172.21.15.144:0/2420061641 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c0ab9d0 con 0x7f9b9015c6f0 2024-09-12T12:22:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 -- 172.21.15.144:0/2420061641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b9015c6f0 msgr2=0x7f9b9006e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 --2- 172.21.15.144:0/2420061641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b9015c6f0 0x7f9b9006e3a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f9b900b12a0 tx=0x7f9b7c01c3c0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 -- 172.21.15.144:0/2420061641 shutdown_connections 2024-09-12T12:22:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 --2- 172.21.15.144:0/2420061641 >> v2:172.21.15.165:3300/0 conn(0x7f9b9006e8e0 0x7f9b900cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 --2- 172.21.15.144:0/2420061641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b9015c6f0 0x7f9b9006e3a0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 -- 172.21.15.144:0/2420061641 >> 172.21.15.144:0/2420061641 conn(0x7f9b900703a0 msgr2=0x7f9b900d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 -- 172.21.15.144:0/2420061641 shutdown_connections 2024-09-12T12:22:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 -- 172.21.15.144:0/2420061641 wait complete. 2024-09-12T12:22:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 Processor -- start 2024-09-12T12:22:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 -- start start 2024-09-12T12:22:00.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b9006e8e0 0x7f9b90150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b900b3500 0x7f9b900b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b900b59a0 0x7f9b900aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9b900d00b0 con 0x7f9b900b3500 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9b900cff30 con 0x7f9b900b59a0 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b97c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9b900d0230 con 0x7f9b9006e8e0 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b900b3500 0x7f9b900b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b900b3500 0x7f9b900b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47234/0 (socket says 172.21.15.144:47234) 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b8fe00640 1 -- 172.21.15.144:0/1005956911 learned_addr learned my addr 172.21.15.144:0/1005956911 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b95c00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b900b59a0 0x7f9b900aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b95200640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b9006e8e0 0x7f9b90150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b8fe00640 1 -- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b9006e8e0 msgr2=0x7f9b90150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b8fe00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b9006e8e0 0x7f9b90150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b8fe00640 1 -- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b900b59a0 msgr2=0x7f9b900aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b8fe00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b900b59a0 0x7f9b900aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b8fe00640 1 -- 172.21.15.144:0/1005956911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b900abbf0 con 0x7f9b900b3500 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b95c00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b900b59a0 0x7f9b900aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.190+0000 7f9b95200640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b9006e8e0 0x7f9b90150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b8fe00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b900b3500 0x7f9b900b5460 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c019ff0 tx=0x7f9b7c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b8cc00640 1 -- 172.21.15.144:0/1005956911 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c0b0050 con 0x7f9b900b3500 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b8cc00640 1 -- 172.21.15.144:0/1005956911 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7c0bc070 con 0x7f9b900b3500 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b900abed0 con 0x7f9b900b3500 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b8cc00640 1 -- 172.21.15.144:0/1005956911 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c006e20 con 0x7f9b900b3500 2024-09-12T12:22:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b901505b0 con 0x7f9b900b3500 2024-09-12T12:22:00.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b900cf1e0 con 0x7f9b900b3500 2024-09-12T12:22:00.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b8cc00640 1 -- 172.21.15.144:0/1005956911 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b7c0b5850 con 0x7f9b900b3500 2024-09-12T12:22:00.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b8cc00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b700678c0 0x7f9b70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b8cc00640 1 -- 172.21.15.144:0/1005956911 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5335+0+0 (secure 0 0 0) 0x7f9b7c120330 con 0x7f9b900b3500 2024-09-12T12:22:00.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.194+0000 7f9b95200640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b700678c0 0x7f9b70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.198+0000 7f9b95200640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b700678c0 0x7f9b70069d80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9b84005890 tx=0x7f9b84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:00.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.198+0000 7f9b8cc00640 1 -- 172.21.15.144:0/1005956911 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9b7c016070 con 0x7f9b900b3500 2024-09-12T12:22:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.358+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f9b900aa9d0 con 0x7f9b900b3500 2024-09-12T12:22:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.362+0000 7f9b8cc00640 1 -- 172.21.15.144:0/1005956911 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f9b7c0f1060 con 0x7f9b900b3500 2024-09-12T12:22:00.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b700678c0 msgr2=0x7f9b70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b700678c0 0x7f9b70069d80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9b84005890 tx=0x7f9b84009040 comp rx=0 tx=0).stop 2024-09-12T12:22:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b900b3500 msgr2=0x7f9b900b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b900b3500 0x7f9b900b5460 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c019ff0 tx=0x7f9b7c01ac00 comp rx=0 tx=0).stop 2024-09-12T12:22:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 shutdown_connections 2024-09-12T12:22:00.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9b700678c0 0x7f9b70069d80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b900b59a0 0x7f9b900aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b900b3500 0x7f9b900b5460 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 --2- 172.21.15.144:0/1005956911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9b9006e8e0 0x7f9b90150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 >> 172.21.15.144:0/1005956911 conn(0x7f9b900703a0 msgr2=0x7f9b9006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 shutdown_connections 2024-09-12T12:22:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.366+0000 7f9b97c00640 1 -- 172.21.15.144:0/1005956911 wait complete. 2024-09-12T12:22:00.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-12T12:22:00.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.522+0000 7f9eaa000640 1 Processor -- start 2024-09-12T12:22:00.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.522+0000 7f9eaa000640 1 -- start start 2024-09-12T12:22:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.522+0000 7f9eaa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ea40b4200 0x7f9ea40b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.522+0000 7f9eaa000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9ea40b5720 0x7f9ea40b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.522+0000 7f9eaa000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea40d1580 con 0x7f9ea415c220 2024-09-12T12:22:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.522+0000 7f9eaa000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea40b4bb0 con 0x7f9ea40b4200 2024-09-12T12:22:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.522+0000 7f9eaa000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea40d1320 con 0x7f9ea40b5720 2024-09-12T12:22:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9e9aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ea40b4200 0x7f9ea40b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9e9aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ea40b4200 0x7f9ea40b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47250/0 (socket says 172.21.15.144:47250) 2024-09-12T12:22:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9e9aa00640 1 -- 172.21.15.144:0/1431272141 learned_addr learned my addr 172.21.15.144:0/1431272141 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9ea3e00640 1 --2- 172.21.15.144:0/1431272141 >> v2:172.21.15.165:3300/0 conn(0x7f9ea40b5720 0x7f9ea40b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9e9aa00640 1 -- 172.21.15.144:0/1431272141 >> v2:172.21.15.165:3300/0 conn(0x7f9ea40b5720 msgr2=0x7f9ea40b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9e9aa00640 1 --2- 172.21.15.144:0/1431272141 >> v2:172.21.15.165:3300/0 conn(0x7f9ea40b5720 0x7f9ea40b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9e9aa00640 1 -- 172.21.15.144:0/1431272141 >> v1:172.21.15.165:6789/0 conn(0x7f9ea415c220 legacy=0x7f9ea40d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9e9aa00640 1 -- 172.21.15.144:0/1431272141 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea40d1860 con 0x7f9ea40b4200 2024-09-12T12:22:00.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9e9aa00640 1 --2- 172.21.15.144:0/1431272141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea40b4200 0x7f9ea40b4670 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40cf990 tx=0x7f9e8c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c942aac14ac00ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:00.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9ea2a00640 1 -- 172.21.15.144:0/1431272141 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0aa650 con 0x7f9ea40b4200 2024-09-12T12:22:00.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9ea2a00640 1 -- 172.21.15.144:0/1431272141 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c0af070 con 0x7f9ea40b4200 2024-09-12T12:22:00.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.526+0000 7f9ea2a00640 1 -- 172.21.15.144:0/1431272141 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0aaa10 con 0x7f9ea40b4200 2024-09-12T12:22:00.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 -- 172.21.15.144:0/1431272141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea40b4200 msgr2=0x7f9ea40b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 --2- 172.21.15.144:0/1431272141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea40b4200 0x7f9ea40b4670 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40cf990 tx=0x7f9e8c01c4f0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 -- 172.21.15.144:0/1431272141 shutdown_connections 2024-09-12T12:22:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 --2- 172.21.15.144:0/1431272141 >> v2:172.21.15.165:3300/0 conn(0x7f9ea40b5720 0x7f9ea40b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 --2- 172.21.15.144:0/1431272141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea40b4200 0x7f9ea40b4670 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 -- 172.21.15.144:0/1431272141 >> 172.21.15.144:0/1431272141 conn(0x7f9ea406f400 msgr2=0x7f9ea406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 -- 172.21.15.144:0/1431272141 shutdown_connections 2024-09-12T12:22:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 -- 172.21.15.144:0/1431272141 wait complete. 2024-09-12T12:22:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 Processor -- start 2024-09-12T12:22:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 -- start start 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40b4200 0x7f9ea4162350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea40b5720 0x7f9ea4162890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415c220 0x7f9ea4153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea415c780 con 0x7f9ea415c220 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea415c600 con 0x7f9ea40b5720 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9eaa000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea4070bf0 con 0x7f9ea40b4200 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9ea3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415c220 0x7f9ea4153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9ea3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415c220 0x7f9ea4153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47252/0 (socket says 172.21.15.144:47252) 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9e9aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea40b5720 0x7f9ea4162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9ea3e00640 1 -- 172.21.15.144:0/4256879669 learned_addr learned my addr 172.21.15.144:0/4256879669 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9ea3400640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40b4200 0x7f9ea4162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9ea3e00640 1 -- 172.21.15.144:0/4256879669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40b4200 msgr2=0x7f9ea4162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9ea3e00640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40b4200 0x7f9ea4162350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9ea3e00640 1 -- 172.21.15.144:0/4256879669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea40b5720 msgr2=0x7f9ea4162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9ea3e00640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea40b5720 0x7f9ea4162890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.530+0000 7f9ea3e00640 1 -- 172.21.15.144:0/4256879669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea41587c0 con 0x7f9ea415c220 2024-09-12T12:22:00.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9ea3e00640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415c220 0x7f9ea4153b50 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00efc0 tx=0x7f9e9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:00.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9e9be00640 1 -- 172.21.15.144:0/4256879669 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c018020 con 0x7f9ea415c220 2024-09-12T12:22:00.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9e9be00640 1 -- 172.21.15.144:0/4256879669 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c014480 con 0x7f9ea415c220 2024-09-12T12:22:00.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9e9be00640 1 -- 172.21.15.144:0/4256879669 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c014870 con 0x7f9ea415c220 2024-09-12T12:22:00.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea4158aa0 con 0x7f9ea415c220 2024-09-12T12:22:00.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea415fe80 con 0x7f9ea415c220 2024-09-12T12:22:00.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea40b4670 con 0x7f9ea415c220 2024-09-12T12:22:00.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9e9be00640 1 -- 172.21.15.144:0/4256879669 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e9c01b020 con 0x7f9ea415c220 2024-09-12T12:22:00.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9e9be00640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:00.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9e9be00640 1 -- 172.21.15.144:0/4256879669 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5335+0+0 (secure 0 0 0) 0x7f9e9c0869e0 con 0x7f9ea415c220 2024-09-12T12:22:00.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.534+0000 7f9ea3400640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.538+0000 7f9ea3400640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9e94007fd0 tx=0x7f9e94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:00.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.538+0000 7f9e9be00640 1 -- 172.21.15.144:0/4256879669 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e9c022030 con 0x7f9ea415c220 2024-09-12T12:22:00.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.754+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f9ea40b1af0 con 0x7f9ea415c220 2024-09-12T12:22:00.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.970+0000 7f9e9be00640 1 -- 172.21.15.144:0/4256879669 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v459) ==== 155+0+0 (secure 0 0 0) 0x7f9e9c010040 con 0x7f9ea415c220 2024-09-12T12:22:00.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 msgr2=0x7f9e80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9e94007fd0 tx=0x7f9e94009040 comp rx=0 tx=0).stop 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415c220 msgr2=0x7f9ea4153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415c220 0x7f9ea4153b50 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00efc0 tx=0x7f9e9c00c490 comp rx=0 tx=0).stop 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 shutdown_connections 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415c220 0x7f9ea4153b50 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea40b5720 0x7f9ea4162890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 --2- 172.21.15.144:0/4256879669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40b4200 0x7f9ea4162350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 >> 172.21.15.144:0/4256879669 conn(0x7f9ea406f400 msgr2=0x7f9ea40d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 shutdown_connections 2024-09-12T12:22:00.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:00.974+0000 7f9eaa000640 1 -- 172.21.15.144:0/4256879669 wait complete. 2024-09-12T12:22:00.997 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-12T12:22:00.997 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-12T12:22:00.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:22:01.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.130+0000 7f747ae00640 1 Processor -- start 2024-09-12T12:22:01.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.130+0000 7f747ae00640 1 -- start start 2024-09-12T12:22:01.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f747ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 0x7f7474070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f747ae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74740cd1d0 con 0x7f74740cff90 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f747ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74740cd4a0 con 0x7f747415b160 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f747ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f747415b540 con 0x7f7474073bd0 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f747a400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f74740cff90 0x7f74740b3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53678/0 (socket says 172.21.15.144:53678) 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f747a400640 1 -- 172.21.15.144:0/3943024387 learned_addr learned my addr 172.21.15.144:0/3943024387 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f7479000640 1 --2- 172.21.15.144:0/3943024387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 0x7f7474070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f7473e00640 1 -- 172.21.15.144:0/3943024387 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3361860062 0 0) 0x7f74740cd1d0 con 0x7f74740cff90 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f7473e00640 1 -- 172.21.15.144:0/3943024387 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f745c003530 con 0x7f74740cff90 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f7473e00640 1 -- 172.21.15.144:0/3943024387 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923447022 0 0) 0x7f74740cd4a0 con 0x7f747415b160 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f7473e00640 1 -- 172.21.15.144:0/3943024387 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74740cd1d0 con 0x7f747415b160 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f7479000640 1 -- 172.21.15.144:0/3943024387 >> v1:172.21.15.165:6789/0 conn(0x7f747415b160 legacy=0x7f74740ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f7479000640 1 -- 172.21.15.144:0/3943024387 >> v1:172.21.15.144:6789/0 conn(0x7f74740cff90 legacy=0x7f74740b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.134+0000 7f7479000640 1 -- 172.21.15.144:0/3943024387 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74740cd780 con 0x7f7474073bd0 2024-09-12T12:22:01.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f7479000640 1 --2- 172.21.15.144:0/3943024387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 0x7f7474070ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f74600097f0 tx=0x7f746001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6c1a9a48dcd936a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f7473e00640 1 -- 172.21.15.144:0/3943024387 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600b0070 con 0x7f7474073bd0 2024-09-12T12:22:01.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f7473e00640 1 -- 172.21.15.144:0/3943024387 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74600ab600 con 0x7f7474073bd0 2024-09-12T12:22:01.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f7473e00640 1 -- 172.21.15.144:0/3943024387 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74600ab9d0 con 0x7f7474073bd0 2024-09-12T12:22:01.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f747ae00640 1 -- 172.21.15.144:0/3943024387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 msgr2=0x7f7474070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f747ae00640 1 --2- 172.21.15.144:0/3943024387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 0x7f7474070ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f74600097f0 tx=0x7f746001c450 comp rx=0 tx=0).stop 2024-09-12T12:22:01.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f747ae00640 1 -- 172.21.15.144:0/3943024387 shutdown_connections 2024-09-12T12:22:01.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f747ae00640 1 --2- 172.21.15.144:0/3943024387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 0x7f7474070ee0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f747ae00640 1 -- 172.21.15.144:0/3943024387 >> 172.21.15.144:0/3943024387 conn(0x7f747406bc10 msgr2=0x7f747406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:01.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f747ae00640 1 -- 172.21.15.144:0/3943024387 shutdown_connections 2024-09-12T12:22:01.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f747ae00640 1 -- 172.21.15.144:0/3943024387 wait complete. 2024-09-12T12:22:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f747ae00640 1 Processor -- start 2024-09-12T12:22:01.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.138+0000 7f747ae00640 1 -- start start 2024-09-12T12:22:01.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 0x7f74740aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74740cff90 0x7f74740724d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f747415b160 0x7f7474072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f747406cea0 con 0x7f747415b160 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f747406cd20 con 0x7f74740cff90 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f747406d020 con 0x7f7474073bd0 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f747415b160 0x7f7474072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f747415b160 0x7f7474072a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47266/0 (socket says 172.21.15.144:47266) 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747a400640 1 -- 172.21.15.144:0/2255609121 learned_addr learned my addr 172.21.15.144:0/2255609121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f7479000640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74740cff90 0x7f74740724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f7479a00640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 0x7f74740aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747a400640 1 -- 172.21.15.144:0/2255609121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 msgr2=0x7f74740aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747a400640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 0x7f74740aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747a400640 1 -- 172.21.15.144:0/2255609121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74740cff90 msgr2=0x7f74740724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747a400640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74740cff90 0x7f74740724d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747a400640 1 -- 172.21.15.144:0/2255609121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7474156ac0 con 0x7f747415b160 2024-09-12T12:22:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747a400640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f747415b160 0x7f7474072a10 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c450 tx=0x7f746c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f7471600640 1 -- 172.21.15.144:0/2255609121 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c017070 con 0x7f747415b160 2024-09-12T12:22:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f7471600640 1 -- 172.21.15.144:0/2255609121 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f746c005db0 con 0x7f747415b160 2024-09-12T12:22:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f7471600640 1 -- 172.21.15.144:0/2255609121 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c007290 con 0x7f747415b160 2024-09-12T12:22:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7474156da0 con 0x7f747415b160 2024-09-12T12:22:01.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7474157360 con 0x7f747415b160 2024-09-12T12:22:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74741403a0 con 0x7f747415b160 2024-09-12T12:22:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.142+0000 7f7471600640 1 -- 172.21.15.144:0/2255609121 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f746c01a070 con 0x7f747415b160 2024-09-12T12:22:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.146+0000 7f7471600640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74540678c0 0x7f7454069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.146+0000 7f7471600640 1 -- 172.21.15.144:0/2255609121 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5335+0+0 (secure 0 0 0) 0x7f746c084e40 con 0x7f747415b160 2024-09-12T12:22:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.146+0000 7f7479a00640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74540678c0 0x7f7454069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.146+0000 7f7479a00640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74540678c0 0x7f7454069d80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7468007fd0 tx=0x7f7468009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.150+0000 7f7471600640 1 -- 172.21.15.144:0/2255609121 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f74741403a0 con 0x7f747415b160 2024-09-12T12:22:01.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.306+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7474155ac0 con 0x7f747415b160 2024-09-12T12:22:01.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f7471600640 1 -- 172.21.15.144:0/2255609121 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+13341 (secure 0 0 0) 0x7f746c055490 con 0x7f747415b160 2024-09-12T12:22:01.311 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:01.311 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":143,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:21:59.969329+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/2508228850":"2024-09-13T12:21:56.959403+0000","172.21.15.144:6835/2508228850":"2024-09-13T12:21:56.959403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:22:01.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74540678c0 msgr2=0x7f7454069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74540678c0 0x7f7454069d80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7468007fd0 tx=0x7f7468009040 comp rx=0 tx=0).stop 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f747415b160 msgr2=0x7f7474072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f747415b160 0x7f7474072a10 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c450 tx=0x7f746c00c910 comp rx=0 tx=0).stop 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 shutdown_connections 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f74540678c0 0x7f7454069d80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f747415b160 0x7f7474072a10 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74740cff90 0x7f74740724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 --2- 172.21.15.144:0/2255609121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7474073bd0 0x7f74740aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 >> 172.21.15.144:0/2255609121 conn(0x7f747406bc10 msgr2=0x7f74740b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 shutdown_connections 2024-09-12T12:22:01.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.310+0000 7f747ae00640 1 -- 172.21.15.144:0/2255609121 wait complete. 2024-09-12T12:22:01.333 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:22:01.333 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:22:01.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc697000640 1 Processor -- start 2024-09-12T12:22:01.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc697000640 1 -- start start 2024-09-12T12:22:01.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc697000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6900cd9f0 0x7fc69006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc697000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc69015b340 0x7fc69006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc697000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6900b4300 con 0x7fc69015af60 2024-09-12T12:22:01.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc697000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc6900b32f0 con 0x7fc69015b340 2024-09-12T12:22:01.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc697000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc6900b3540 con 0x7fc6900cd9f0 2024-09-12T12:22:01.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc695000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc69015b340 0x7fc69006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc68f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6900cd9f0 0x7fc69006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc695000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc69015b340 0x7fc69006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:55508/0 (socket says 172.21.15.144:55508) 2024-09-12T12:22:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc695000640 1 -- 172.21.15.144:0/2776554761 learned_addr learned my addr 172.21.15.144:0/2776554761 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc68f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6900cd9f0 0x7fc69006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:55264/0 (socket says 172.21.15.144:55264) 2024-09-12T12:22:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc695000640 1 -- 172.21.15.144:0/2776554761 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6900cd9f0 msgr2=0x7fc69006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc695000640 1 --2- 172.21.15.144:0/2776554761 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6900cd9f0 0x7fc69006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc695000640 1 -- 172.21.15.144:0/2776554761 >> v1:172.21.15.165:6789/0 conn(0x7fc69015af60 legacy=0x7fc6900ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.474+0000 7fc695000640 1 -- 172.21.15.144:0/2776554761 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6900b3820 con 0x7fc69015b340 2024-09-12T12:22:01.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc695000640 1 --2- 172.21.15.144:0/2776554761 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69015b340 0x7fc69006c150 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc688009e50 tx=0x7fc68801f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcecd7848ec2ce8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc68ea00640 1 -- 172.21.15.144:0/2776554761 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6880b4070 con 0x7fc69015b340 2024-09-12T12:22:01.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc68ea00640 1 -- 172.21.15.144:0/2776554761 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6880af400 con 0x7fc69015b340 2024-09-12T12:22:01.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc68ea00640 1 -- 172.21.15.144:0/2776554761 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6880af7d0 con 0x7fc69015b340 2024-09-12T12:22:01.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 -- 172.21.15.144:0/2776554761 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69015b340 msgr2=0x7fc69006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 --2- 172.21.15.144:0/2776554761 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69015b340 0x7fc69006c150 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc688009e50 tx=0x7fc68801f210 comp rx=0 tx=0).stop 2024-09-12T12:22:01.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 -- 172.21.15.144:0/2776554761 shutdown_connections 2024-09-12T12:22:01.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 --2- 172.21.15.144:0/2776554761 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69015b340 0x7fc69006c150 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 --2- 172.21.15.144:0/2776554761 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc6900cd9f0 0x7fc69006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 -- 172.21.15.144:0/2776554761 >> 172.21.15.144:0/2776554761 conn(0x7fc690068030 msgr2=0x7fc6900b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:01.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 -- 172.21.15.144:0/2776554761 shutdown_connections 2024-09-12T12:22:01.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 -- 172.21.15.144:0/2776554761 wait complete. 2024-09-12T12:22:01.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 Processor -- start 2024-09-12T12:22:01.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.478+0000 7fc697000640 1 -- start start 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc697000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6900cd9f0 0x7fc6900b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc697000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69015af60 0x7fc690144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc697000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69015b340 0x7fc690145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc697000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc69006d0f0 con 0x7fc6900cd9f0 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc697000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc6900b3de0 con 0x7fc69015af60 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc697000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc69006d270 con 0x7fc69015b340 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6900cd9f0 0x7fc6900b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6900cd9f0 0x7fc6900b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47268/0 (socket says 172.21.15.144:47268) 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68fe00640 1 -- 172.21.15.144:0/2623162564 learned_addr learned my addr 172.21.15.144:0/2623162564 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68f400640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69015af60 0x7fc690144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc695000640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69015b340 0x7fc690145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68fe00640 1 -- 172.21.15.144:0/2623162564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69015b340 msgr2=0x7fc690145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68fe00640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69015b340 0x7fc690145070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68fe00640 1 -- 172.21.15.144:0/2623162564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69015af60 msgr2=0x7fc690144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68fe00640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69015af60 0x7fc690144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68fe00640 1 -- 172.21.15.144:0/2623162564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6901e4bd0 con 0x7fc6900cd9f0 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc68fe00640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6900cd9f0 0x7fc6900b4ff0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fc68000c420 tx=0x7fc68000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc687e00640 1 -- 172.21.15.144:0/2623162564 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6800052d0 con 0x7fc6900cd9f0 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc687e00640 1 -- 172.21.15.144:0/2623162564 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc680005470 con 0x7fc6900cd9f0 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc687e00640 1 -- 172.21.15.144:0/2623162564 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680007260 con 0x7fc6900cd9f0 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6901e4e70 con 0x7fc6900cd9f0 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6901e5430 con 0x7fc6900cd9f0 2024-09-12T12:22:01.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.482+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6900ce680 con 0x7fc6900cd9f0 2024-09-12T12:22:01.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.486+0000 7fc687e00640 1 -- 172.21.15.144:0/2623162564 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc680007400 con 0x7fc6900cd9f0 2024-09-12T12:22:01.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.486+0000 7fc687e00640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6700678c0 0x7fc670069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.486+0000 7fc687e00640 1 -- 172.21.15.144:0/2623162564 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5335+0+0 (secure 0 0 0) 0x7fc680084fc0 con 0x7fc6900cd9f0 2024-09-12T12:22:01.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.486+0000 7fc68f400640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6700678c0 0x7fc670069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.486+0000 7fc68f400640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6700678c0 0x7fc670069d80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc69015f470 tx=0x7fc67c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.490+0000 7fc687e00640 1 -- 172.21.15.144:0/2623162564 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc680055610 con 0x7fc6900cd9f0 2024-09-12T12:22:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.646+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc6900685e0 con 0x7fc6900cd9f0 2024-09-12T12:22:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.646+0000 7fc687e00640 1 -- 172.21.15.144:0/2623162564 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v143) ==== 93+0+10 (secure 0 0 0) 0x7fc680059910 con 0x7fc6900cd9f0 2024-09-12T12:22:01.650 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6700678c0 msgr2=0x7fc670069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6700678c0 0x7fc670069d80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc69015f470 tx=0x7fc67c009190 comp rx=0 tx=0).stop 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6900cd9f0 msgr2=0x7fc6900b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6900cd9f0 0x7fc6900b4ff0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fc68000c420 tx=0x7fc68000c8e0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 shutdown_connections 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc6700678c0 0x7fc670069d80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc69015b340 0x7fc690145070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc69015af60 0x7fc690144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 --2- 172.21.15.144:0/2623162564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6900cd9f0 0x7fc6900b4ff0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 >> 172.21.15.144:0/2623162564 conn(0x7fc690068030 msgr2=0x7fc6900b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:01.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 shutdown_connections 2024-09-12T12:22:01.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.650+0000 7fc697000640 1 -- 172.21.15.144:0/2623162564 wait complete. 2024-09-12T12:22:01.672 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-12T12:22:01.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.806+0000 7fdb69200640 1 Processor -- start 2024-09-12T12:22:01.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.806+0000 7fdb69200640 1 -- start start 2024-09-12T12:22:01.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.806+0000 7fdb69200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdb6415c7b0 0x7fdb640ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb69200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb640cd870 con 0x7fdb6415cd30 2024-09-12T12:22:01.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb69200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb640cdb50 con 0x7fdb640b5fb0 2024-09-12T12:22:01.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb69200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdb64072a50 con 0x7fdb6415c7b0 2024-09-12T12:22:01.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb61e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdb6415c7b0 0x7fdb640ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb61400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdb6415cd30 0x7fdb640b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53680/0 (socket says 172.21.15.144:53680) 2024-09-12T12:22:01.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb61400640 1 -- 172.21.15.144:0/1511957216 learned_addr learned my addr 172.21.15.144:0/1511957216 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:01.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb61e00640 1 -- 172.21.15.144:0/1511957216 >> v1:172.21.15.165:6789/0 conn(0x7fdb640b5fb0 legacy=0x7fdb64072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:01.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb61e00640 1 -- 172.21.15.144:0/1511957216 >> v1:172.21.15.144:6789/0 conn(0x7fdb6415cd30 legacy=0x7fdb640b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb61e00640 1 -- 172.21.15.144:0/1511957216 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb640726e0 con 0x7fdb6415c7b0 2024-09-12T12:22:01.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb60a00640 1 -- 172.21.15.144:0/1511957216 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847261456 0 0) 0x7fdb640cd870 con 0x7fdb6415cd30 2024-09-12T12:22:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb61e00640 1 --2- 172.21.15.144:0/1511957216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415c7b0 0x7fdb640ccf00 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009d90 tx=0x7fdb5401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9232796016dfe74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb60a00640 1 -- 172.21.15.144:0/1511957216 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540b2070 con 0x7fdb6415c7b0 2024-09-12T12:22:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb60a00640 1 -- 172.21.15.144:0/1511957216 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb540a57f0 con 0x7fdb6415c7b0 2024-09-12T12:22:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.810+0000 7fdb60a00640 1 -- 172.21.15.144:0/1511957216 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540a5bc0 con 0x7fdb6415c7b0 2024-09-12T12:22:01.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 -- 172.21.15.144:0/1511957216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415c7b0 msgr2=0x7fdb640ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 --2- 172.21.15.144:0/1511957216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415c7b0 0x7fdb640ccf00 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009d90 tx=0x7fdb5401c930 comp rx=0 tx=0).stop 2024-09-12T12:22:01.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 -- 172.21.15.144:0/1511957216 shutdown_connections 2024-09-12T12:22:01.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 --2- 172.21.15.144:0/1511957216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415c7b0 0x7fdb640ccf00 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 -- 172.21.15.144:0/1511957216 >> 172.21.15.144:0/1511957216 conn(0x7fdb6406d0d0 msgr2=0x7fdb6406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:01.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 -- 172.21.15.144:0/1511957216 shutdown_connections 2024-09-12T12:22:01.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 -- 172.21.15.144:0/1511957216 wait complete. 2024-09-12T12:22:01.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 Processor -- start 2024-09-12T12:22:01.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 -- start start 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdb640b5fb0 0x7fdb640b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6415c7b0 0x7fdb640ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415cd30 0x7fdb640b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdb640741d0 con 0x7fdb6415cd30 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdb64074050 con 0x7fdb6415c7b0 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb69200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdb640cde30 con 0x7fdb640b5fb0 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb62800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415cd30 0x7fdb640b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb62800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415cd30 0x7fdb640b3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47282/0 (socket says 172.21.15.144:47282) 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb62800640 1 -- 172.21.15.144:0/837257130 learned_addr learned my addr 172.21.15.144:0/837257130 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:01.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb61400640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6415c7b0 0x7fdb640ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb61e00640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdb640b5fb0 0x7fdb640b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb62800640 1 -- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdb640b5fb0 msgr2=0x7fdb640b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb62800640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdb640b5fb0 0x7fdb640b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb62800640 1 -- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6415c7b0 msgr2=0x7fdb640ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb62800640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6415c7b0 0x7fdb640ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb62800640 1 -- 172.21.15.144:0/837257130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb640b1740 con 0x7fdb6415cd30 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb61e00640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdb640b5fb0 0x7fdb640b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.814+0000 7fdb61400640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6415c7b0 0x7fdb640ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb62800640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415cd30 0x7fdb640b3910 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c3c0 tx=0x7fdb5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb5a000640 1 -- 172.21.15.144:0/837257130 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c011790 con 0x7fdb6415cd30 2024-09-12T12:22:01.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb5a000640 1 -- 172.21.15.144:0/837257130 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c017070 con 0x7fdb6415cd30 2024-09-12T12:22:01.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb640b19e0 con 0x7fdb6415cd30 2024-09-12T12:22:01.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb5a000640 1 -- 172.21.15.144:0/837257130 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c011b70 con 0x7fdb6415cd30 2024-09-12T12:22:01.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb640b1fa0 con 0x7fdb6415cd30 2024-09-12T12:22:01.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb640ccf00 con 0x7fdb6415cd30 2024-09-12T12:22:01.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb5a000640 1 -- 172.21.15.144:0/837257130 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb5c011d10 con 0x7fdb6415cd30 2024-09-12T12:22:01.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb5a000640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdb440678c0 0x7fdb44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:01.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb5a000640 1 -- 172.21.15.144:0/837257130 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5335+0+0 (secure 0 0 0) 0x7fdb5c0858e0 con 0x7fdb6415cd30 2024-09-12T12:22:01.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb61e00640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdb440678c0 0x7fdb44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:01.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.818+0000 7fdb61e00640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdb440678c0 0x7fdb44069d80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdb540af000 tx=0x7fdb540a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:01.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:01.822+0000 7fdb5a000640 1 -- 172.21.15.144:0/837257130 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdb5c056580 con 0x7fdb6415cd30 2024-09-12T12:22:02.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.050+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7fdb64157830 con 0x7fdb6415cd30 2024-09-12T12:22:02.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.978+0000 7fdb5a000640 1 -- 172.21.15.144:0/837257130 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v461) ==== 169+0+0 (secure 0 0 0) 0x7fdb5c055e80 con 0x7fdb6415cd30 2024-09-12T12:22:02.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdb440678c0 msgr2=0x7fdb44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:02.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdb440678c0 0x7fdb44069d80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdb540af000 tx=0x7fdb540a7070 comp rx=0 tx=0).stop 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415cd30 msgr2=0x7fdb640b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415cd30 0x7fdb640b3910 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c3c0 tx=0x7fdb5c00c880 comp rx=0 tx=0).stop 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 shutdown_connections 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdb440678c0 0x7fdb44069d80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6415cd30 0x7fdb640b3910 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6415c7b0 0x7fdb640ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 --2- 172.21.15.144:0/837257130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdb640b5fb0 0x7fdb640b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 >> 172.21.15.144:0/837257130 conn(0x7fdb6406d0d0 msgr2=0x7fdb640b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 shutdown_connections 2024-09-12T12:22:02.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:02.982+0000 7fdb69200640 1 -- 172.21.15.144:0/837257130 wait complete. 2024-09-12T12:22:03.007 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:22:03.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.146+0000 7f5a9ec00640 1 Processor -- start 2024-09-12T12:22:03.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.146+0000 7f5a9ec00640 1 -- start start 2024-09-12T12:22:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.146+0000 7f5a9ec00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5a9815c2e0 0x7f5a98072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.146+0000 7f5a9ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a980cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a980733e0 con 0x7f5a980af5f0 2024-09-12T12:22:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9ec00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5a980cd290 con 0x7f5a9815c2e0 2024-09-12T12:22:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5a980cd570 con 0x7f5a9806c320 2024-09-12T12:22:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a980cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a97e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5a9815c2e0 0x7f5a98072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a980cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:55284/0 (socket says 172.21.15.144:55284) 2024-09-12T12:22:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9cc00640 1 -- 172.21.15.144:0/2455138223 learned_addr learned my addr 172.21.15.144:0/2455138223 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9cc00640 1 -- 172.21.15.144:0/2455138223 >> v2:172.21.15.165:3300/0 conn(0x7f5a9815c2e0 msgr2=0x7f5a98072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9cc00640 1 --2- 172.21.15.144:0/2455138223 >> v2:172.21.15.165:3300/0 conn(0x7f5a9815c2e0 0x7f5a98072b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9cc00640 1 -- 172.21.15.144:0/2455138223 >> v1:172.21.15.165:6789/0 conn(0x7f5a980af5f0 legacy=0x7f5a9806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a9cc00640 1 -- 172.21.15.144:0/2455138223 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a980cd850 con 0x7f5a9806c320 2024-09-12T12:22:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a96a00640 1 -- 172.21.15.144:0/2455138223 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284714344 0 0) 0x7f5a980733e0 con 0x7f5a980af5f0 2024-09-12T12:22:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.150+0000 7f5a97e00640 1 --2- 172.21.15.144:0/2455138223 >> v2:172.21.15.165:3300/0 conn(0x7f5a9815c2e0 0x7f5a98072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:03.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9cc00640 1 --2- 172.21.15.144:0/2455138223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a980cdd70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009e50 tx=0x7f5a9001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb41a0e9b6541581 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:03.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a96a00640 1 -- 172.21.15.144:0/2455138223 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a900a55e0 con 0x7f5a9806c320 2024-09-12T12:22:03.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a96a00640 1 -- 172.21.15.144:0/2455138223 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a900a5780 con 0x7f5a9806c320 2024-09-12T12:22:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a96a00640 1 -- 172.21.15.144:0/2455138223 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a900a5b50 con 0x7f5a9806c320 2024-09-12T12:22:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 -- 172.21.15.144:0/2455138223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 msgr2=0x7f5a980cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 --2- 172.21.15.144:0/2455138223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a980cdd70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009e50 tx=0x7f5a9001c910 comp rx=0 tx=0).stop 2024-09-12T12:22:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 -- 172.21.15.144:0/2455138223 shutdown_connections 2024-09-12T12:22:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 --2- 172.21.15.144:0/2455138223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a980cdd70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 --2- 172.21.15.144:0/2455138223 >> v2:172.21.15.165:3300/0 conn(0x7f5a9815c2e0 0x7f5a98072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 -- 172.21.15.144:0/2455138223 >> 172.21.15.144:0/2455138223 conn(0x7f5a98068030 msgr2=0x7f5a980b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 -- 172.21.15.144:0/2455138223 shutdown_connections 2024-09-12T12:22:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 -- 172.21.15.144:0/2455138223 wait complete. 2024-09-12T12:22:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 Processor -- start 2024-09-12T12:22:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.154+0000 7f5a9ec00640 1 -- start start 2024-09-12T12:22:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a981547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a980af5f0 0x7f5a9814c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a9815c2e0 0x7f5a980d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5a980cee50 con 0x7f5a980af5f0 2024-09-12T12:22:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5a980cecd0 con 0x7f5a9815c2e0 2024-09-12T12:22:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5a980cefd0 con 0x7f5a9806c320 2024-09-12T12:22:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a980af5f0 0x7f5a9814c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a980af5f0 0x7f5a9814c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47288/0 (socket says 172.21.15.144:47288) 2024-09-12T12:22:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97400640 1 -- 172.21.15.144:0/1099609760 learned_addr learned my addr 172.21.15.144:0/1099609760 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9cc00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a9815c2e0 0x7f5a980d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97e00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a981547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97400640 1 -- 172.21.15.144:0/1099609760 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 msgr2=0x7f5a981547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97400640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a981547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97400640 1 -- 172.21.15.144:0/1099609760 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a9815c2e0 msgr2=0x7f5a980d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97400640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a9815c2e0 0x7f5a980d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97400640 1 -- 172.21.15.144:0/1099609760 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a98154d10 con 0x7f5a980af5f0 2024-09-12T12:22:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a97400640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a980af5f0 0x7f5a9814c7a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400c4d0 tx=0x7f5a8400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:03.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a8fe00640 1 -- 172.21.15.144:0/1099609760 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a84017070 con 0x7f5a980af5f0 2024-09-12T12:22:03.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a8fe00640 1 -- 172.21.15.144:0/1099609760 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a84005480 con 0x7f5a980af5f0 2024-09-12T12:22:03.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a98156050 con 0x7f5a980af5f0 2024-09-12T12:22:03.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a8fe00640 1 -- 172.21.15.144:0/1099609760 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a84003840 con 0x7f5a980af5f0 2024-09-12T12:22:03.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a98155290 con 0x7f5a980af5f0 2024-09-12T12:22:03.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a980cdd70 con 0x7f5a980af5f0 2024-09-12T12:22:03.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.158+0000 7f5a8fe00640 1 -- 172.21.15.144:0/1099609760 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a8401a070 con 0x7f5a980af5f0 2024-09-12T12:22:03.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.162+0000 7f5a8fe00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a780678f0 0x7f5a78069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.162+0000 7f5a8fe00640 1 -- 172.21.15.144:0/1099609760 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5335+0+0 (secure 0 0 0) 0x7f5a84084ef0 con 0x7f5a980af5f0 2024-09-12T12:22:03.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.162+0000 7f5a97e00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a780678f0 0x7f5a78069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.162+0000 7f5a97e00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a780678f0 0x7f5a78069db0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009a50 tx=0x7f5a88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:03.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.166+0000 7f5a8fe00640 1 -- 172.21.15.144:0/1099609760 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a84055c60 con 0x7f5a980af5f0 2024-09-12T12:22:03.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.322+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5a9814cce0 con 0x7f5a980af5f0 2024-09-12T12:22:03.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.326+0000 7f5a8fe00640 1 -- 172.21.15.144:0/1099609760 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f5a84055560 con 0x7f5a980af5f0 2024-09-12T12:22:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a780678f0 msgr2=0x7f5a78069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a780678f0 0x7f5a78069db0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009a50 tx=0x7f5a88008040 comp rx=0 tx=0).stop 2024-09-12T12:22:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a980af5f0 msgr2=0x7f5a9814c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a980af5f0 0x7f5a9814c7a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400c4d0 tx=0x7f5a8400c990 comp rx=0 tx=0).stop 2024-09-12T12:22:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 shutdown_connections 2024-09-12T12:22:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a780678f0 0x7f5a78069db0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a9815c2e0 0x7f5a980d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a980af5f0 0x7f5a9814c7a0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 --2- 172.21.15.144:0/1099609760 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9806c320 0x7f5a981547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 >> 172.21.15.144:0/1099609760 conn(0x7f5a98068030 msgr2=0x7f5a980b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 shutdown_connections 2024-09-12T12:22:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.330+0000 7f5a9ec00640 1 -- 172.21.15.144:0/1099609760 wait complete. 2024-09-12T12:22:03.350 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:22:03.350 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:22:03.433 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:22:03.531 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:22:03.532 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:22:03.532 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:03.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:22:03.541 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:22:03.541 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:03.551 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:22:03.551 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:22:03.551 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:03.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:22:03.590 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:22:03.590 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:03.605 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:22:03.605 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:22:03.605 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:03.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd7e00640 1 Processor -- start 2024-09-12T12:22:03.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd7e00640 1 -- start start 2024-09-12T12:22:03.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd80b7230 0x7f6bd80b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd815c480 con 0x7f6bd815c0a0 2024-09-12T12:22:03.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd7e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd815fdd0 con 0x7f6bd80ce950 2024-09-12T12:22:03.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd81609e0 con 0x7f6bd80b7230 2024-09-12T12:22:03.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6bd815c0a0 0x7f6bd80b6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53686/0 (socket says 172.21.15.144:53686) 2024-09-12T12:22:03.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3097117999 learned_addr learned my addr 172.21.15.144:0/3097117999 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:03.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd7400640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd80b7230 0x7f6bd80b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3356745707 0 0) 0x7f6bd815c480 con 0x7f6bd815c0a0 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bbc003530 con 0x7f6bd815c0a0 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3885011308 0 0) 0x7f6bbc003530 con 0x7f6bd815c0a0 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd80b7230 msgr2=0x7f6bd80b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd80b7230 0x7f6bd80b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 >> v1:172.21.15.165:6789/0 conn(0x7f6bd80ce950 legacy=0x7f6bd80730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd81600b0 con 0x7f6bd815c0a0 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f6bc8001680 con 0x7f6bd815c0a0 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 >> v1:172.21.15.144:6789/0 conn(0x7f6bd815c0a0 legacy=0x7f6bd80b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bbc0039f0 0x7f6bbc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bbc004810 0x7f6bbc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd80b7230 0x7f6bbc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd81609e0 con 0x7f6bbc004810 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc00bb00 con 0x7f6bbc0039f0 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bbc00bd00 con 0x7f6bd80b7230 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bbc004810 0x7f6bbc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bbc0039f0 0x7f6bbc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bd7400640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd80b7230 0x7f6bbc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bcfe00640 1 -- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd80b7230 msgr2=0x7f6bbc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd80b7230 0x7f6bbc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bcfe00640 1 -- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bbc0039f0 msgr2=0x7f6bbc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bbc0039f0 0x7f6bbc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.770+0000 7f6bcfe00640 1 -- 172.21.15.144:0/3097117999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc003530 con 0x7f6bbc004810 2024-09-12T12:22:03.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bbc004810 0x7f6bbc004c90 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0001750 tx=0x7f6bc001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4033a1defaf90a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:03.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00013a0 con 0x7f6bbc004810 2024-09-12T12:22:03.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc00052f0 con 0x7f6bbc004810 2024-09-12T12:22:03.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd6000640 1 -- 172.21.15.144:0/3097117999 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0003840 con 0x7f6bbc004810 2024-09-12T12:22:03.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd7e00640 1 -- 172.21.15.144:0/3097117999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bbc004810 msgr2=0x7f6bbc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd7e00640 1 --2- 172.21.15.144:0/3097117999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bbc004810 0x7f6bbc004c90 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0001750 tx=0x7f6bc001c3b0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd7400640 1 -- 172.21.15.144:0/3097117999 reap_dead start 2024-09-12T12:22:03.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd7e00640 1 -- 172.21.15.144:0/3097117999 shutdown_connections 2024-09-12T12:22:03.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd7e00640 1 -- 172.21.15.144:0/3097117999 >> 172.21.15.144:0/3097117999 conn(0x7f6bd80d2280 msgr2=0x7f6bd80d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:03.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd7e00640 1 -- 172.21.15.144:0/3097117999 shutdown_connections 2024-09-12T12:22:03.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.774+0000 7f6bd7e00640 1 -- 172.21.15.144:0/3097117999 wait complete. 2024-09-12T12:22:03.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 Processor -- start 2024-09-12T12:22:03.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 -- start start 2024-09-12T12:22:03.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bbc004810 0x7f6bd814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd8156020 0x7f6bd80d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd8154060 0x7f6bd81544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd8168150 con 0x7f6bd8156020 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd8167fd0 con 0x7f6bd8154060 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd81682d0 con 0x7f6bbc004810 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd8156020 0x7f6bd80d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd8156020 0x7f6bd80d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47314/0 (socket says 172.21.15.144:47314) 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcfe00640 1 -- 172.21.15.144:0/475011235 learned_addr learned my addr 172.21.15.144:0/475011235 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7400640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd8154060 0x7f6bd81544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bbc004810 0x7f6bd814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcfe00640 1 -- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bbc004810 msgr2=0x7f6bd814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bbc004810 0x7f6bd814d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcfe00640 1 -- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd8154060 msgr2=0x7f6bd81544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd8154060 0x7f6bd81544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcfe00640 1 -- 172.21.15.144:0/475011235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd8156550 con 0x7f6bd8156020 2024-09-12T12:22:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7400640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd8154060 0x7f6bd81544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bbc004810 0x7f6bd814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:03.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd8156020 0x7f6bd80d0710 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0001750 tx=0x7f6bbc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcf400640 1 -- 172.21.15.144:0/475011235 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00ba020 con 0x7f6bd8156020 2024-09-12T12:22:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcf400640 1 -- 172.21.15.144:0/475011235 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc0000ee0 con 0x7f6bd8156020 2024-09-12T12:22:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bcf400640 1 -- 172.21.15.144:0/475011235 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0007a40 con 0x7f6bd8156020 2024-09-12T12:22:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd806ce50 con 0x7f6bd8156020 2024-09-12T12:22:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.778+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd806d410 con 0x7f6bd8156020 2024-09-12T12:22:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.782+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd80730b0 con 0x7f6bd8156020 2024-09-12T12:22:03.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.782+0000 7f6bcf400640 1 -- 172.21.15.144:0/475011235 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6bc00bd070 con 0x7f6bd8156020 2024-09-12T12:22:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.782+0000 7f6bcf400640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bb40678c0 0x7f6bb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.782+0000 7f6bcf400640 1 -- 172.21.15.144:0/475011235 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5335+0+0 (secure 0 0 0) 0x7f6bc011f2e0 con 0x7f6bd8156020 2024-09-12T12:22:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.782+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bb40678c0 0x7f6bb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.782+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bb40678c0 0x7f6bb4069d80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8007cc0 tx=0x7f6bc8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:03.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.786+0000 7f6bcf400640 1 -- 172.21.15.144:0/475011235 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6bc00160f0 con 0x7f6bd8156020 2024-09-12T12:22:03.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.974+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bd80b7010 con 0x7f6bd8156020 2024-09-12T12:22:03.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bcf400640 1 -- 172.21.15.144:0/475011235 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+3919 (secure 0 0 0) 0x7f6bc00eff80 con 0x7f6bd8156020 2024-09-12T12:22:03.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:03.979 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":109,"btime":"2024-09-12T12:21:57:962045+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7133,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/13234607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":13234607},{"type":"v1","addr":"172.21.15.165:6835","nonce":13234607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7927,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1849063559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1849063559},{"type":"v1","addr":"172.21.15.144:6836","nonce":1849063559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":7942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/238347578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":238347578},{"type":"v1","addr":"172.21.15.165:6834","nonce":238347578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2823731706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2823731706},{"type":"v1","addr":"172.21.15.144:6837","nonce":2823731706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":109}],"filesystems":[]} 2024-09-12T12:22:03.979 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 109 2024-09-12T12:22:03.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bb40678c0 msgr2=0x7f6bb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bb40678c0 0x7f6bb4069d80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8007cc0 tx=0x7f6bc8009040 comp rx=0 tx=0).stop 2024-09-12T12:22:03.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd8156020 msgr2=0x7f6bd80d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:03.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd8156020 0x7f6bd80d0710 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0001750 tx=0x7f6bbc005840 comp rx=0 tx=0).stop 2024-09-12T12:22:03.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 shutdown_connections 2024-09-12T12:22:03.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bb40678c0 0x7f6bb4069d80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd8154060 0x7f6bd81544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd8156020 0x7f6bd80d0710 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 --2- 172.21.15.144:0/475011235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bbc004810 0x7f6bd814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:03.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 >> 172.21.15.144:0/475011235 conn(0x7f6bd80d2280 msgr2=0x7f6bd814ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:03.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 shutdown_connections 2024-09-12T12:22:03.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:03.978+0000 7f6bd7e00640 1 -- 172.21.15.144:0/475011235 wait complete. 2024-09-12T12:22:04.002 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:22:04.002 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:22:04.003 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:22:04.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:22:04.003 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:22:04.003 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:22:04.003 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:22:04.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:22:04.004 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:22:04.004 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:22:04.004 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:22:04.004 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:22:04.004 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:22:04.004 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:22:04.005 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:22:04.005 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:22:04.017 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:22:04.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:22:04.017 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:22:04.018 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:22:04.019 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:22:04.019 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:22:04.020 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:22:04.020 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:22:04.064 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:22:04.064 DEBUG:teuthology.parallel:result is None 2024-09-12T12:22:04.066 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:22:04.066 DEBUG:teuthology.parallel:result is None 2024-09-12T12:22:04.067 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:22:04.067 DEBUG:teuthology.parallel:result is None 2024-09-12T12:22:04.069 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:22:04.069 DEBUG:teuthology.parallel:result is None 2024-09-12T12:22:04.070 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:22:04.152 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:22:04.153 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:22:04.158 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:22:04.159 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:22:04.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa187a00640 1 Processor -- start 2024-09-12T12:22:04.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa187a00640 1 -- start start 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa187a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa180161cb0 0x7fa18015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa187a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 0x7fa18015fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa187a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18015f0d0 con 0x7fa1801602e0 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa187a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa18015fbf0 con 0x7fa180161cb0 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa187a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa180159100 con 0x7fa1800b4970 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa185000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa180161cb0 0x7fa18015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa17fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 0x7fa18015fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa185000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa180161cb0 0x7fa18015eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47360/0 (socket says 172.21.15.144:47360) 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa185000640 1 -- 172.21.15.144:0/1660608146 learned_addr learned my addr 172.21.15.144:0/1660608146 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa17fe00640 1 -- 172.21.15.144:0/1660608146 >> v2:172.21.15.144:3300/0 conn(0x7fa180161cb0 msgr2=0x7fa18015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa17fe00640 1 --2- 172.21.15.144:0/1660608146 >> v2:172.21.15.144:3300/0 conn(0x7fa180161cb0 0x7fa18015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa17fe00640 1 -- 172.21.15.144:0/1660608146 >> v1:172.21.15.165:6789/0 conn(0x7fa1801602e0 legacy=0x7fa1800aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.214+0000 7fa17fe00640 1 -- 172.21.15.144:0/1660608146 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18015f350 con 0x7fa1800b4970 2024-09-12T12:22:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa17fe00640 1 --2- 172.21.15.144:0/1660608146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 0x7fa18015fda0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0097c0 tx=0x7fa16c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45432db2e5cedabd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:04.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa17f400640 1 -- 172.21.15.144:0/1660608146 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0b2070 con 0x7fa1800b4970 2024-09-12T12:22:04.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa17f400640 1 -- 172.21.15.144:0/1660608146 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa16c0ad640 con 0x7fa1800b4970 2024-09-12T12:22:04.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa17f400640 1 -- 172.21.15.144:0/1660608146 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0ada10 con 0x7fa1800b4970 2024-09-12T12:22:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa187a00640 1 -- 172.21.15.144:0/1660608146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 msgr2=0x7fa18015fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa187a00640 1 --2- 172.21.15.144:0/1660608146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 0x7fa18015fda0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0097c0 tx=0x7fa16c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:22:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa187a00640 1 -- 172.21.15.144:0/1660608146 shutdown_connections 2024-09-12T12:22:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa187a00640 1 --2- 172.21.15.144:0/1660608146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 0x7fa18015fda0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa187a00640 1 --2- 172.21.15.144:0/1660608146 >> v2:172.21.15.144:3300/0 conn(0x7fa180161cb0 0x7fa18015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa187a00640 1 -- 172.21.15.144:0/1660608146 >> 172.21.15.144:0/1660608146 conn(0x7fa1800cd870 msgr2=0x7fa1800cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:04.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa187a00640 1 -- 172.21.15.144:0/1660608146 shutdown_connections 2024-09-12T12:22:04.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.218+0000 7fa187a00640 1 -- 172.21.15.144:0/1660608146 wait complete. 2024-09-12T12:22:04.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 Processor -- start 2024-09-12T12:22:04.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 -- start start 2024-09-12T12:22:04.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 0x7fa180142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:04.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1801602e0 0x7fa1801598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:04.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa180161cb0 0x7fa180159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:04.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa18016b3a0 con 0x7fa1801602e0 2024-09-12T12:22:04.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa18016b220 con 0x7fa180161cb0 2024-09-12T12:22:04.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa18016b520 con 0x7fa1800b4970 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1801602e0 0x7fa1801598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1801602e0 0x7fa1801598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47362/0 (socket says 172.21.15.144:47362) 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17fe00640 1 -- 172.21.15.144:0/3526111376 learned_addr learned my addr 172.21.15.144:0/3526111376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa185000640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 0x7fa180142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa185a00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa180161cb0 0x7fa180159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17fe00640 1 -- 172.21.15.144:0/3526111376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 msgr2=0x7fa180142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17fe00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 0x7fa180142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17fe00640 1 -- 172.21.15.144:0/3526111376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa180161cb0 msgr2=0x7fa180159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17fe00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa180161cb0 0x7fa180159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17fe00640 1 -- 172.21.15.144:0/3526111376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa180141760 con 0x7fa1801602e0 2024-09-12T12:22:04.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa185a00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa180161cb0 0x7fa180159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17fe00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1801602e0 0x7fa1801598e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0b0040 tx=0x7fa16c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17cc00640 1 -- 172.21.15.144:0/3526111376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0b2040 con 0x7fa1801602e0 2024-09-12T12:22:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17cc00640 1 -- 172.21.15.144:0/3526111376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa16c0ad440 con 0x7fa1801602e0 2024-09-12T12:22:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa17cc00640 1 -- 172.21.15.144:0/3526111376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0b6650 con 0x7fa1801602e0 2024-09-12T12:22:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa180141a40 con 0x7fa1801602e0 2024-09-12T12:22:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa180142000 con 0x7fa1801602e0 2024-09-12T12:22:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.222+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa18015fda0 con 0x7fa1801602e0 2024-09-12T12:22:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.226+0000 7fa17cc00640 1 -- 172.21.15.144:0/3526111376 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa16c0be020 con 0x7fa1801602e0 2024-09-12T12:22:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.226+0000 7fa17cc00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1600678c0 0x7fa160069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.226+0000 7fa17cc00640 1 -- 172.21.15.144:0/3526111376 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5335+0+0 (secure 0 0 0) 0x7fa16c11f500 con 0x7fa1801602e0 2024-09-12T12:22:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.226+0000 7fa185000640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1600678c0 0x7fa160069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.226+0000 7fa185000640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1600678c0 0x7fa160069d80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa174009ab0 tx=0x7fa174009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.230+0000 7fa17cc00640 1 -- 172.21.15.144:0/3526111376 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa16c016090 con 0x7fa1801602e0 2024-09-12T12:22:04.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:04.402+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa1800691d0 con 0x7fa1801602e0 2024-09-12T12:22:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.358+0000 7fa17cc00640 1 -- 172.21.15.144:0/3526111376 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v148) ==== 97+0+0 (secure 0 0 0) 0x7fa16c0f0090 con 0x7fa1801602e0 2024-09-12T12:22:05.360 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:22:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1600678c0 msgr2=0x7fa160069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1600678c0 0x7fa160069d80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa174009ab0 tx=0x7fa174009240 comp rx=0 tx=0).stop 2024-09-12T12:22:05.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1801602e0 msgr2=0x7fa1801598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1801602e0 0x7fa1801598e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0b0040 tx=0x7fa16c019240 comp rx=0 tx=0).stop 2024-09-12T12:22:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 shutdown_connections 2024-09-12T12:22:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1600678c0 0x7fa160069d80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa180161cb0 0x7fa180159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1801602e0 0x7fa1801598e0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 --2- 172.21.15.144:0/3526111376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1800b4970 0x7fa180142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 >> 172.21.15.144:0/3526111376 conn(0x7fa1800cd870 msgr2=0x7fa180073870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 shutdown_connections 2024-09-12T12:22:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.362+0000 7fa187a00640 1 -- 172.21.15.144:0/3526111376 wait complete. 2024-09-12T12:22:05.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:22:05.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.522+0000 7ffb1cc00640 1 Processor -- start 2024-09-12T12:22:05.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.522+0000 7ffb1cc00640 1 -- start start 2024-09-12T12:22:05.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb1cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb1815e580 0x7ffb180b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb1cc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1806d9a0 con 0x7ffb1806ea20 2024-09-12T12:22:05.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb1cc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1806df40 con 0x7ffb1806d380 2024-09-12T12:22:05.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb1cc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1806e220 con 0x7ffb1815e580 2024-09-12T12:22:05.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ffb1806ea20 0x7ffb1806cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53690/0 (socket says 172.21.15.144:53690) 2024-09-12T12:22:05.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15400640 1 -- 172.21.15.144:0/3393054185 learned_addr learned my addr 172.21.15.144:0/3393054185 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:05.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15e00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb1815e580 0x7ffb180b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705968976 0 0) 0x7ffb1806d9a0 con 0x7ffb1806ea20 2024-09-12T12:22:05.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffafc003530 con 0x7ffb1806ea20 2024-09-12T12:22:05.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060491617 0 0) 0x7ffb1806df40 con 0x7ffb1806d380 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb1806d9a0 con 0x7ffb1806d380 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4116512797 0 0) 0x7ffafc003530 con 0x7ffb1806ea20 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb1815e580 msgr2=0x7ffb180b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb1815e580 0x7ffb180b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 >> v1:172.21.15.165:6789/0 conn(0x7ffb1806d380 legacy=0x7ffb180cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1806e500 con 0x7ffb1806ea20 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7ffb04001680 con 0x7ffb1806ea20 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 >> v1:172.21.15.144:6789/0 conn(0x7ffb1806ea20 legacy=0x7ffb1806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffafc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffafc004810 0x7ffafc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb1815e580 0x7ffafc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1806e220 con 0x7ffafc003b80 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc00ba80 con 0x7ffafc004810 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc00bc50 con 0x7ffb1815e580 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15e00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffafc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb16800640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb1815e580 0x7ffafc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15400640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffafc004810 0x7ffafc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15e00640 1 -- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb1815e580 msgr2=0x7ffafc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15e00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb1815e580 0x7ffafc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15e00640 1 -- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffafc004810 msgr2=0x7ffafc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15e00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffafc004810 0x7ffafc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.526+0000 7ffb15e00640 1 -- 172.21.15.144:0/3393054185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc003530 con 0x7ffafc003b80 2024-09-12T12:22:05.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb15e00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffafc003f80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009ae0 tx=0x7ffb0801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbff7ea2b5d2607 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:05.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080096b0 con 0x7ffafc003b80 2024-09-12T12:22:05.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb080a6410 con 0x7ffafc003b80 2024-09-12T12:22:05.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb14a00640 1 -- 172.21.15.144:0/3393054185 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080a6800 con 0x7ffafc003b80 2024-09-12T12:22:05.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3393054185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 msgr2=0x7ffafc003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb1cc00640 1 --2- 172.21.15.144:0/3393054185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffafc003f80 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009ae0 tx=0x7ffb0801c9c0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb16800640 1 -- 172.21.15.144:0/3393054185 reap_dead start 2024-09-12T12:22:05.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3393054185 shutdown_connections 2024-09-12T12:22:05.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3393054185 >> 172.21.15.144:0/3393054185 conn(0x7ffb18067a00 msgr2=0x7ffb18067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3393054185 shutdown_connections 2024-09-12T12:22:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.530+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3393054185 wait complete. 2024-09-12T12:22:05.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 Processor -- start 2024-09-12T12:22:05.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 -- start start 2024-09-12T12:22:05.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffb181430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb18151c00 0x7ffb18152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb180d0850 0x7ffb180d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1816a1c0 con 0x7ffafc003b80 2024-09-12T12:22:05.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180b73c0 con 0x7ffb180d0850 2024-09-12T12:22:05.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1816a340 con 0x7ffb18151c00 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffb181430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffb181430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47390/0 (socket says 172.21.15.144:47390) 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15e00640 1 -- 172.21.15.144:0/3419751164 learned_addr learned my addr 172.21.15.144:0/3419751164 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb16800640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb180d0850 0x7ffb180d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15400640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb18151c00 0x7ffb18152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15e00640 1 -- 172.21.15.144:0/3419751164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb18151c00 msgr2=0x7ffb18152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15e00640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb18151c00 0x7ffb18152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15e00640 1 -- 172.21.15.144:0/3419751164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb180d0850 msgr2=0x7ffb180d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15e00640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb180d0850 0x7ffb180d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15e00640 1 -- 172.21.15.144:0/3419751164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb180d1660 con 0x7ffafc003b80 2024-09-12T12:22:05.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb15e00640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffb181430d0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ffb0801cea0 tx=0x7ffafc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb0e000640 1 -- 172.21.15.144:0/3419751164 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800f000 con 0x7ffafc003b80 2024-09-12T12:22:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb0e000640 1 -- 172.21.15.144:0/3419751164 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb080a6b40 con 0x7ffafc003b80 2024-09-12T12:22:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb0e000640 1 -- 172.21.15.144:0/3419751164 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08004020 con 0x7ffafc003b80 2024-09-12T12:22:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb180d1940 con 0x7ffafc003b80 2024-09-12T12:22:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.534+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb180d1f00 con 0x7ffafc003b80 2024-09-12T12:22:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.538+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb180cb850 con 0x7ffafc003b80 2024-09-12T12:22:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.538+0000 7ffb0e000640 1 -- 172.21.15.144:0/3419751164 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb080041c0 con 0x7ffafc003b80 2024-09-12T12:22:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.538+0000 7ffb0e000640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffaf80678f0 0x7ffaf8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.538+0000 7ffb0e000640 1 -- 172.21.15.144:0/3419751164 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5249+0+0 (secure 0 0 0) 0x7ffb0811f980 con 0x7ffafc003b80 2024-09-12T12:22:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.538+0000 7ffb15400640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffaf80678f0 0x7ffaf8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.538+0000 7ffb15400640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffaf80678f0 0x7ffaf8069db0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ffb180b1d10 tx=0x7ffb04007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:05.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.542+0000 7ffb0e000640 1 -- 172.21.15.144:0/3419751164 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffb080ac020 con 0x7ffafc003b80 2024-09-12T12:22:05.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ffb1815d610 con 0x7ffafc003b80 2024-09-12T12:22:05.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb0e000640 1 -- 172.21.15.144:0/3419751164 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7ffb08016760 con 0x7ffafc003b80 2024-09-12T12:22:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:05.756 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:22:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:22:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:22:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:22:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:22:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:22:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:22:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:22:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:22:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:22:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:22:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:22:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:22:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:22:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:22:05.770 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:22:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffaf80678f0 msgr2=0x7ffaf8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffaf80678f0 0x7ffaf8069db0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ffb180b1d10 tx=0x7ffb04007040 comp rx=0 tx=0).stop 2024-09-12T12:22:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 msgr2=0x7ffb181430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffb181430d0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ffb0801cea0 tx=0x7ffafc005840 comp rx=0 tx=0).stop 2024-09-12T12:22:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 shutdown_connections 2024-09-12T12:22:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ffaf80678f0 0x7ffaf8069db0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb180d0850 0x7ffb180d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb18151c00 0x7ffb18152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 --2- 172.21.15.144:0/3419751164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffafc003b80 0x7ffb181430d0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 >> 172.21.15.144:0/3419751164 conn(0x7ffb18067a00 msgr2=0x7ffb1815cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:05.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 shutdown_connections 2024-09-12T12:22:05.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.754+0000 7ffb1cc00640 1 -- 172.21.15.144:0/3419751164 wait complete. 2024-09-12T12:22:05.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:22:05.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe200000640 1 Processor -- start 2024-09-12T12:22:05.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe200000640 1 -- start start 2024-09-12T12:22:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe200000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe1f815c580 0x7fe1f80b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe200000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f80b6590 0x7fe1f815ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe200000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f80741c0 con 0x7fe1f8160520 2024-09-12T12:22:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe200000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f815c960 con 0x7fe1f815c580 2024-09-12T12:22:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe200000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f80b5bc0 con 0x7fe1f80b6590 2024-09-12T12:22:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe1fcc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f80b6590 0x7fe1f815ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe1fcc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f80b6590 0x7fe1f815ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:55410/0 (socket says 172.21.15.144:55410) 2024-09-12T12:22:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe1fcc00640 1 -- 172.21.15.144:0/2057293285 learned_addr learned my addr 172.21.15.144:0/2057293285 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe1fd600640 1 --2- 172.21.15.144:0/2057293285 >> v2:172.21.15.165:3300/0 conn(0x7fe1f815c580 0x7fe1f80b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe1fcc00640 1 -- 172.21.15.144:0/2057293285 >> v2:172.21.15.165:3300/0 conn(0x7fe1f815c580 msgr2=0x7fe1f80b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe1fcc00640 1 --2- 172.21.15.144:0/2057293285 >> v2:172.21.15.165:3300/0 conn(0x7fe1f815c580 0x7fe1f80b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe1fcc00640 1 -- 172.21.15.144:0/2057293285 >> v1:172.21.15.165:6789/0 conn(0x7fe1f8160520 legacy=0x7fe1f80d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe1fcc00640 1 -- 172.21.15.144:0/2057293285 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f8160b50 con 0x7fe1f80b6590 2024-09-12T12:22:05.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.914+0000 7fe1f7e00640 1 -- 172.21.15.144:0/2057293285 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828329348 0 0) 0x7fe1f80741c0 con 0x7fe1f8160520 2024-09-12T12:22:05.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe1fcc00640 1 --2- 172.21.15.144:0/2057293285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f80b6590 0x7fe1f815ffe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009870 tx=0x7fe1e401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8446d4cbfb603a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:05.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe1f7e00640 1 -- 172.21.15.144:0/2057293285 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40b1070 con 0x7fe1f80b6590 2024-09-12T12:22:05.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe1f7e00640 1 -- 172.21.15.144:0/2057293285 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e40ac620 con 0x7fe1f80b6590 2024-09-12T12:22:05.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe1f7e00640 1 -- 172.21.15.144:0/2057293285 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40ac9f0 con 0x7fe1f80b6590 2024-09-12T12:22:05.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe200000640 1 -- 172.21.15.144:0/2057293285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f80b6590 msgr2=0x7fe1f815ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe200000640 1 --2- 172.21.15.144:0/2057293285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f80b6590 0x7fe1f815ffe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009870 tx=0x7fe1e401c4d0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe200000640 1 -- 172.21.15.144:0/2057293285 shutdown_connections 2024-09-12T12:22:05.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe200000640 1 --2- 172.21.15.144:0/2057293285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f80b6590 0x7fe1f815ffe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe200000640 1 --2- 172.21.15.144:0/2057293285 >> v2:172.21.15.165:3300/0 conn(0x7fe1f815c580 0x7fe1f80b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe200000640 1 -- 172.21.15.144:0/2057293285 >> 172.21.15.144:0/2057293285 conn(0x7fe1f8067a00 msgr2=0x7fe1f8067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe200000640 1 -- 172.21.15.144:0/2057293285 shutdown_connections 2024-09-12T12:22:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.918+0000 7fe200000640 1 -- 172.21.15.144:0/2057293285 wait complete. 2024-09-12T12:22:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 Processor -- start 2024-09-12T12:22:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 -- start start 2024-09-12T12:22:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1f815c580 0x7fe1f80b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f8160520 0x7fe1f8144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f8152730 0x7fe1f815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f80d2ba0 con 0x7fe1f8160520 2024-09-12T12:22:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f80d2a20 con 0x7fe1f815c580 2024-09-12T12:22:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f80d0920 con 0x7fe1f8152730 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f8160520 0x7fe1f8144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f8160520 0x7fe1f8144fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47396/0 (socket says 172.21.15.144:47396) 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fcc00640 1 -- 172.21.15.144:0/2438718735 learned_addr learned my addr 172.21.15.144:0/2438718735 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fd600640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1f815c580 0x7fe1f80b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fe000640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f8152730 0x7fe1f815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fcc00640 1 -- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f8152730 msgr2=0x7fe1f815e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fcc00640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f8152730 0x7fe1f815e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fcc00640 1 -- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1f815c580 msgr2=0x7fe1f80b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fcc00640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1f815c580 0x7fe1f80b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fcc00640 1 -- 172.21.15.144:0/2438718735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f815d820 con 0x7fe1f8160520 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fd600640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1f815c580 0x7fe1f80b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fe000640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f8152730 0x7fe1f815e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1fcc00640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f8160520 0x7fe1f8144fc0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fe1e401ab80 tx=0x7fe1e401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1f5600640 1 -- 172.21.15.144:0/2438718735 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40bb070 con 0x7fe1f8160520 2024-09-12T12:22:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1f5600640 1 -- 172.21.15.144:0/2438718735 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e4004020 con 0x7fe1f8160520 2024-09-12T12:22:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe1f5600640 1 -- 172.21.15.144:0/2438718735 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40b1040 con 0x7fe1f8160520 2024-09-12T12:22:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f815db00 con 0x7fe1f8160520 2024-09-12T12:22:05.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f815e0c0 con 0x7fe1f8160520 2024-09-12T12:22:05.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.922+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f815ffe0 con 0x7fe1f8160520 2024-09-12T12:22:05.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.926+0000 7fe1f5600640 1 -- 172.21.15.144:0/2438718735 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1e4003620 con 0x7fe1f8160520 2024-09-12T12:22:05.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.926+0000 7fe1f5600640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1d80678c0 0x7fe1d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:05.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.926+0000 7fe1f5600640 1 -- 172.21.15.144:0/2438718735 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5249+0+0 (secure 0 0 0) 0x7fe1e411fe30 con 0x7fe1f8160520 2024-09-12T12:22:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.926+0000 7fe1fd600640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1d80678c0 0x7fe1d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.926+0000 7fe1fd600640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1d80678c0 0x7fe1d8069d80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009ae0 tx=0x7fe1ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:05.930+0000 7fe1f5600640 1 -- 172.21.15.144:0/2438718735 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe1e4016150 con 0x7fe1f8160520 2024-09-12T12:22:06.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.094+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe1f815bd10 con 0x7fe1f8160520 2024-09-12T12:22:06.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.094+0000 7fe1f5600640 1 -- 172.21.15.144:0/2438718735 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v148) ==== 84+0+65 (secure 0 0 0) 0x7fe1e40f0a90 con 0x7fe1f8160520 2024-09-12T12:22:06.098 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:06.098 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:22:06.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:22:06.098 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:22:06.098 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:22:06.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:06.098 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:22:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1d80678c0 msgr2=0x7fe1d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1d80678c0 0x7fe1d8069d80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009ae0 tx=0x7fe1ec008040 comp rx=0 tx=0).stop 2024-09-12T12:22:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f8160520 msgr2=0x7fe1f8144fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:06.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f8160520 0x7fe1f8144fc0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fe1e401ab80 tx=0x7fe1e401ad10 comp rx=0 tx=0).stop 2024-09-12T12:22:06.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 shutdown_connections 2024-09-12T12:22:06.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1d80678c0 0x7fe1d8069d80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:06.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1f8152730 0x7fe1f815e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:06.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1f8160520 0x7fe1f8144fc0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:06.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 --2- 172.21.15.144:0/2438718735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1f815c580 0x7fe1f80b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:06.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 >> 172.21.15.144:0/2438718735 conn(0x7fe1f8067a00 msgr2=0x7fe1f806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:06.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 shutdown_connections 2024-09-12T12:22:06.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.098+0000 7fe200000640 1 -- 172.21.15.144:0/2438718735 wait complete. 2024-09-12T12:22:06.119 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:22:06.120 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:22:06.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a8600640 1 Processor -- start 2024-09-12T12:22:06.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a8600640 1 -- start start 2024-09-12T12:22:06.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a8600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd8a00b3490 0x7fd8a00b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:06.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a8600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8a006d630 0x7fd8a0155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:06.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a8600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a006cd20 con 0x7fd8a006d250 2024-09-12T12:22:06.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a8600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a0072620 con 0x7fd8a006d630 2024-09-12T12:22:06.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a8600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a00b4f30 con 0x7fd8a00b3490 2024-09-12T12:22:06.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a6600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8a006d630 0x7fd8a0155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:06.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a6600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8a006d630 0x7fd8a0155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47402/0 (socket says 172.21.15.144:47402) 2024-09-12T12:22:06.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a6600640 1 -- 172.21.15.144:0/1676107337 learned_addr learned my addr 172.21.15.144:0/1676107337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:06.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a5200640 1 --2- 172.21.15.144:0/1676107337 >> v2:172.21.15.165:3300/0 conn(0x7fd8a00b3490 0x7fd8a00b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:06.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a6600640 1 -- 172.21.15.144:0/1676107337 >> v2:172.21.15.165:3300/0 conn(0x7fd8a00b3490 msgr2=0x7fd8a00b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:06.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a6600640 1 --2- 172.21.15.144:0/1676107337 >> v2:172.21.15.165:3300/0 conn(0x7fd8a00b3490 0x7fd8a00b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:06.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a6600640 1 -- 172.21.15.144:0/1676107337 >> v1:172.21.15.165:6789/0 conn(0x7fd8a006d250 legacy=0x7fd8a015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:06.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.258+0000 7fd8a6600640 1 -- 172.21.15.144:0/1676107337 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a00b3950 con 0x7fd8a006d630 2024-09-12T12:22:06.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd8a6600640 1 --2- 172.21.15.144:0/1676107337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d630 0x7fd8a0155820 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0073fc0 tx=0x7fd89801e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48aafb037fe0aaa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:06.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd89fe00640 1 -- 172.21.15.144:0/1676107337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8980a86f0 con 0x7fd8a006d630 2024-09-12T12:22:06.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd89fe00640 1 -- 172.21.15.144:0/1676107337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8980a8890 con 0x7fd8a006d630 2024-09-12T12:22:06.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd89fe00640 1 -- 172.21.15.144:0/1676107337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8980a8c60 con 0x7fd8a006d630 2024-09-12T12:22:06.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd8a8600640 1 -- 172.21.15.144:0/1676107337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d630 msgr2=0x7fd8a0155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:06.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd8a8600640 1 --2- 172.21.15.144:0/1676107337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d630 0x7fd8a0155820 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0073fc0 tx=0x7fd89801e700 comp rx=0 tx=0).stop 2024-09-12T12:22:06.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd8a8600640 1 -- 172.21.15.144:0/1676107337 shutdown_connections 2024-09-12T12:22:06.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd8a8600640 1 --2- 172.21.15.144:0/1676107337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d630 0x7fd8a0155820 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:06.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd8a8600640 1 --2- 172.21.15.144:0/1676107337 >> v2:172.21.15.165:3300/0 conn(0x7fd8a00b3490 0x7fd8a00b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:06.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd8a8600640 1 -- 172.21.15.144:0/1676107337 >> 172.21.15.144:0/1676107337 conn(0x7fd8a006bc10 msgr2=0x7fd8a006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:06.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd8a8600640 1 -- 172.21.15.144:0/1676107337 shutdown_connections 2024-09-12T12:22:06.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.262+0000 7fd8a8600640 1 -- 172.21.15.144:0/1676107337 wait complete. 2024-09-12T12:22:06.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 Processor -- start 2024-09-12T12:22:06.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 -- start start 2024-09-12T12:22:06.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d250 0x7fd8a014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:06.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a006d630 0x7fd8a0147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:06.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a00b3490 0x7fd8a0145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:06.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a00b44d0 con 0x7fd8a006d250 2024-09-12T12:22:06.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a00b41f0 con 0x7fd8a00b3490 2024-09-12T12:22:06.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a015d690 con 0x7fd8a006d630 2024-09-12T12:22:06.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d250 0x7fd8a014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:06.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d250 0x7fd8a014c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47408/0 (socket says 172.21.15.144:47408) 2024-09-12T12:22:06.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5c00640 1 -- 172.21.15.144:0/3975616982 learned_addr learned my addr 172.21.15.144:0/3975616982 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:06.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a6600640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a00b3490 0x7fd8a0145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:06.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5200640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a006d630 0x7fd8a0147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:06.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5c00640 1 -- 172.21.15.144:0/3975616982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a006d630 msgr2=0x7fd8a0147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:06.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5c00640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a006d630 0x7fd8a0147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:06.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5c00640 1 -- 172.21.15.144:0/3975616982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a00b3490 msgr2=0x7fd8a0145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:06.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5c00640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a00b3490 0x7fd8a0145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:06.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5c00640 1 -- 172.21.15.144:0/3975616982 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a01460d0 con 0x7fd8a006d250 2024-09-12T12:22:06.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5200640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a006d630 0x7fd8a0147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:06.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a5c00640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d250 0x7fd8a014c870 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c790 tx=0x7fd89400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:06.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd89d600640 1 -- 172.21.15.144:0/3975616982 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894016020 con 0x7fd8a006d250 2024-09-12T12:22:06.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd89d600640 1 -- 172.21.15.144:0/3975616982 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd894006d60 con 0x7fd8a006d250 2024-09-12T12:22:06.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd89d600640 1 -- 172.21.15.144:0/3975616982 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894003bc0 con 0x7fd8a006d250 2024-09-12T12:22:06.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a01463b0 con 0x7fd8a006d250 2024-09-12T12:22:06.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a0146970 con 0x7fd8a006d250 2024-09-12T12:22:06.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.266+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a0155820 con 0x7fd8a006d250 2024-09-12T12:22:06.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.270+0000 7fd89d600640 1 -- 172.21.15.144:0/3975616982 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd89400a7f0 con 0x7fd8a006d250 2024-09-12T12:22:06.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.270+0000 7fd89d600640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8800678c0 0x7fd880069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:06.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.270+0000 7fd89d600640 1 -- 172.21.15.144:0/3975616982 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5249+0+0 (secure 0 0 0) 0x7fd894085710 con 0x7fd8a006d250 2024-09-12T12:22:06.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.270+0000 7fd8a5200640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8800678c0 0x7fd880069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:06.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.270+0000 7fd8a5200640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8800678c0 0x7fd880069d80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0145f40 tx=0x7fd88c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:06.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.274+0000 7fd89d600640 1 -- 172.21.15.144:0/3975616982 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd894020020 con 0x7fd8a006d250 2024-09-12T12:22:06.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:06.434+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd8a006c570 con 0x7fd8a006d250 2024-09-12T12:22:07.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.362+0000 7fd89d600640 1 -- 172.21.15.144:0/3975616982 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v149) ==== 138+0+0 (secure 0 0 0) 0x7fd894056400 con 0x7fd8a006d250 2024-09-12T12:22:07.364 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:22:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8800678c0 msgr2=0x7fd880069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8800678c0 0x7fd880069d80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0145f40 tx=0x7fd88c008040 comp rx=0 tx=0).stop 2024-09-12T12:22:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d250 msgr2=0x7fd8a014c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d250 0x7fd8a014c870 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c790 tx=0x7fd89400cc50 comp rx=0 tx=0).stop 2024-09-12T12:22:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 shutdown_connections 2024-09-12T12:22:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd8800678c0 0x7fd880069d80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a00b3490 0x7fd8a0145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a006d630 0x7fd8a0147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 --2- 172.21.15.144:0/3975616982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a006d250 0x7fd8a014c870 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 >> 172.21.15.144:0/3975616982 conn(0x7fd8a006bc10 msgr2=0x7fd8a015c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 shutdown_connections 2024-09-12T12:22:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.366+0000 7fd8a8600640 1 -- 172.21.15.144:0/3975616982 wait complete. 2024-09-12T12:22:07.395 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:22:07.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.538+0000 7f13c2200640 1 Processor -- start 2024-09-12T12:22:07.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.538+0000 7f13c2200640 1 -- start start 2024-09-12T12:22:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13c2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13bc15af60 0x7f13bc0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13c2200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f13bc0cd9f0 0x7f13bc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13c2200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13bc0b4300 con 0x7f13bc15b340 2024-09-12T12:22:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13c2200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f13bc0b32f0 con 0x7f13bc15af60 2024-09-12T12:22:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13c2200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f13bc0b3540 con 0x7f13bc0cd9f0 2024-09-12T12:22:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13bb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13bc15af60 0x7f13bc0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13bb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13bc15af60 0x7f13bc0ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58078/0 (socket says 172.21.15.144:58078) 2024-09-12T12:22:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13bb400640 1 -- 172.21.15.144:0/260009983 learned_addr learned my addr 172.21.15.144:0/260009983 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13bb400640 1 -- 172.21.15.144:0/260009983 >> v2:172.21.15.165:3300/0 conn(0x7f13bc0cd9f0 msgr2=0x7f13bc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:07.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13bb400640 1 --2- 172.21.15.144:0/260009983 >> v2:172.21.15.165:3300/0 conn(0x7f13bc0cd9f0 0x7f13bc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13bb400640 1 -- 172.21.15.144:0/260009983 >> v1:172.21.15.165:6789/0 conn(0x7f13bc15b340 legacy=0x7f13bc15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:07.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.542+0000 7f13bb400640 1 -- 172.21.15.144:0/260009983 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc0b3820 con 0x7f13bc15af60 2024-09-12T12:22:07.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13bb400640 1 --2- 172.21.15.144:0/260009983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 0x7f13bc0ce680 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f13bc070d20 tx=0x7f13ac01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2240f1ad229a0aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13ba000640 1 -- 172.21.15.144:0/260009983 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac0a5670 con 0x7f13bc15af60 2024-09-12T12:22:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13ba000640 1 -- 172.21.15.144:0/260009983 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ac0a5810 con 0x7f13bc15af60 2024-09-12T12:22:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13ba000640 1 -- 172.21.15.144:0/260009983 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac0a5be0 con 0x7f13bc15af60 2024-09-12T12:22:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 -- 172.21.15.144:0/260009983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 msgr2=0x7f13bc0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 --2- 172.21.15.144:0/260009983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 0x7f13bc0ce680 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f13bc070d20 tx=0x7f13ac01c9b0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 -- 172.21.15.144:0/260009983 shutdown_connections 2024-09-12T12:22:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 --2- 172.21.15.144:0/260009983 >> v2:172.21.15.165:3300/0 conn(0x7f13bc0cd9f0 0x7f13bc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 --2- 172.21.15.144:0/260009983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 0x7f13bc0ce680 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 -- 172.21.15.144:0/260009983 >> 172.21.15.144:0/260009983 conn(0x7f13bc068030 msgr2=0x7f13bc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 -- 172.21.15.144:0/260009983 shutdown_connections 2024-09-12T12:22:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 -- 172.21.15.144:0/260009983 wait complete. 2024-09-12T12:22:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 Processor -- start 2024-09-12T12:22:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 -- start start 2024-09-12T12:22:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0cd9f0 0x7f13bc15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 0x7f13bc15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc15b340 0x7f13bc0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc0ced40 con 0x7f13bc15af60 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc0cebc0 con 0x7f13bc0cd9f0 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.546+0000 7f13c2200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f13bc167f00 con 0x7f13bc15b340 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13baa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 0x7f13bc15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13baa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 0x7f13bc15c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58090/0 (socket says 172.21.15.144:58090) 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13baa00640 1 -- 172.21.15.144:0/2626447213 learned_addr learned my addr 172.21.15.144:0/2626447213 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13bb400640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0cd9f0 0x7f13bc15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13bbe00640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc15b340 0x7f13bc0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13baa00640 1 -- 172.21.15.144:0/2626447213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc15b340 msgr2=0x7f13bc0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13baa00640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc15b340 0x7f13bc0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13baa00640 1 -- 172.21.15.144:0/2626447213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0cd9f0 msgr2=0x7f13bc15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13baa00640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0cd9f0 0x7f13bc15a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13baa00640 1 -- 172.21.15.144:0/2626447213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc146190 con 0x7f13bc15af60 2024-09-12T12:22:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13baa00640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 0x7f13bc15c220 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f13a800b550 tx=0x7f13a800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13b3400640 1 -- 172.21.15.144:0/2626447213 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8014070 con 0x7f13bc15af60 2024-09-12T12:22:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13b3400640 1 -- 172.21.15.144:0/2626447213 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a8010890 con 0x7f13bc15af60 2024-09-12T12:22:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13b3400640 1 -- 172.21.15.144:0/2626447213 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8010c80 con 0x7f13bc15af60 2024-09-12T12:22:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc146430 con 0x7f13bc15af60 2024-09-12T12:22:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc1469f0 con 0x7f13bc15af60 2024-09-12T12:22:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc06bc10 con 0x7f13bc15af60 2024-09-12T12:22:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.550+0000 7f13b3400640 1 -- 172.21.15.144:0/2626447213 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f13a8017070 con 0x7f13bc15af60 2024-09-12T12:22:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.554+0000 7f13b3400640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f139c0678c0 0x7f139c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.554+0000 7f13b3400640 1 -- 172.21.15.144:0/2626447213 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5619+0+0 (secure 0 0 0) 0x7f13a8085b10 con 0x7f13bc15af60 2024-09-12T12:22:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.554+0000 7f13bb400640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f139c0678c0 0x7f139c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.554+0000 7f13bb400640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f139c0678c0 0x7f139c069d80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0ae000 tx=0x7f13ac0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.558+0000 7f13b3400640 1 -- 172.21.15.144:0/2626447213 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f13a8055f30 con 0x7f13bc15af60 2024-09-12T12:22:07.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:07.718+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f13bc0afc20 con 0x7f13bc15af60 2024-09-12T12:22:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13b3400640 1 -- 172.21.15.144:0/2626447213 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v150) ==== 170+0+0 (secure 0 0 0) 0x7f13a8010e20 con 0x7f13bc15af60 2024-09-12T12:22:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:22:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f139c0678c0 msgr2=0x7f139c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f139c0678c0 0x7f139c069d80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0ae000 tx=0x7f13ac0a7070 comp rx=0 tx=0).stop 2024-09-12T12:22:08.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 msgr2=0x7f13bc15c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 0x7f13bc15c220 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f13a800b550 tx=0x7f13a800ba10 comp rx=0 tx=0).stop 2024-09-12T12:22:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 shutdown_connections 2024-09-12T12:22:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f139c0678c0 0x7f139c069d80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc15b340 0x7f13bc0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15af60 0x7f13bc15c220 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 --2- 172.21.15.144:0/2626447213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0cd9f0 0x7f13bc15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 >> 172.21.15.144:0/2626447213 conn(0x7f13bc068030 msgr2=0x7f13bc06d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 shutdown_connections 2024-09-12T12:22:08.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.370+0000 7f13c2200640 1 -- 172.21.15.144:0/2626447213 wait complete. 2024-09-12T12:22:08.410 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:22:08.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.546+0000 7f1226000640 1 Processor -- start 2024-09-12T12:22:08.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.546+0000 7f1226000640 1 -- start start 2024-09-12T12:22:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1226000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1220155810 0x7f122015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1226000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 0x7f122015f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1226000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f122015c5f0 con 0x7f12200b1e10 2024-09-12T12:22:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1226000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f122015c820 con 0x7f1220155810 2024-09-12T12:22:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1226000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f12200b2710 con 0x7f12200b2280 2024-09-12T12:22:08.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f121fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f12200b1e10 0x7f122015ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34796/0 (socket says 172.21.15.144:34796) 2024-09-12T12:22:08.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f121fe00640 1 -- 172.21.15.144:0/2041551119 learned_addr learned my addr 172.21.15.144:0/2041551119 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:08.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1224c00640 1 --2- 172.21.15.144:0/2041551119 >> v2:172.21.15.165:3300/0 conn(0x7f1220155810 0x7f122015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:08.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1225600640 1 --2- 172.21.15.144:0/2041551119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 0x7f122015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:08.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f121f400640 1 -- 172.21.15.144:0/2041551119 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3068316554 0 0) 0x7f122015c5f0 con 0x7f12200b1e10 2024-09-12T12:22:08.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f121f400640 1 -- 172.21.15.144:0/2041551119 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1204003530 con 0x7f12200b1e10 2024-09-12T12:22:08.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1224c00640 1 -- 172.21.15.144:0/2041551119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 msgr2=0x7f122015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:08.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1224c00640 1 --2- 172.21.15.144:0/2041551119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 0x7f122015f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1224c00640 1 -- 172.21.15.144:0/2041551119 >> v1:172.21.15.144:6789/0 conn(0x7f12200b1e10 legacy=0x7f122015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:08.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.550+0000 7f1224c00640 1 -- 172.21.15.144:0/2041551119 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12200b3470 con 0x7f1220155810 2024-09-12T12:22:08.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1224c00640 1 --2- 172.21.15.144:0/2041551119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1220155810 0x7f122015c0b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1210009d90 tx=0x7f121001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cddf6e76d8234ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:08.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f121f400640 1 -- 172.21.15.144:0/2041551119 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12100b4070 con 0x7f1220155810 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f121f400640 1 -- 172.21.15.144:0/2041551119 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12100af600 con 0x7f1220155810 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f121f400640 1 -- 172.21.15.144:0/2041551119 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12100af9b0 con 0x7f1220155810 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 -- 172.21.15.144:0/2041551119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1220155810 msgr2=0x7f122015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 --2- 172.21.15.144:0/2041551119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1220155810 0x7f122015c0b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1210009d90 tx=0x7f121001f150 comp rx=0 tx=0).stop 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 -- 172.21.15.144:0/2041551119 shutdown_connections 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 --2- 172.21.15.144:0/2041551119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 0x7f122015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 --2- 172.21.15.144:0/2041551119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1220155810 0x7f122015c0b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 -- 172.21.15.144:0/2041551119 >> 172.21.15.144:0/2041551119 conn(0x7f122006e7e0 msgr2=0x7f122006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 -- 172.21.15.144:0/2041551119 shutdown_connections 2024-09-12T12:22:08.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 -- 172.21.15.144:0/2041551119 wait complete. 2024-09-12T12:22:08.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 Processor -- start 2024-09-12T12:22:08.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 -- start start 2024-09-12T12:22:08.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12200b1e10 0x7f12201492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:08.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 0x7f122014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:08.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1220155810 0x7f12200ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f12200b3d10 con 0x7f1220155810 2024-09-12T12:22:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12200b3a30 con 0x7f12200b1e10 2024-09-12T12:22:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.554+0000 7f1226000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f12200b3ff0 con 0x7f12200b2280 2024-09-12T12:22:08.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1225600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1220155810 0x7f12200ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1225600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1220155810 0x7f12200ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58100/0 (socket says 172.21.15.144:58100) 2024-09-12T12:22:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1225600640 1 -- 172.21.15.144:0/3255571661 learned_addr learned my addr 172.21.15.144:0/3255571661 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1224c00640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12200b1e10 0x7f12201492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f121fe00640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 0x7f122014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1225600640 1 -- 172.21.15.144:0/3255571661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 msgr2=0x7f122014d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:08.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1225600640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 0x7f122014d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1225600640 1 -- 172.21.15.144:0/3255571661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12200b1e10 msgr2=0x7f12201492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1225600640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12200b1e10 0x7f12201492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1225600640 1 -- 172.21.15.144:0/3255571661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1220155d90 con 0x7f1220155810 2024-09-12T12:22:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1225600640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1220155810 0x7f12200ae890 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f121800e930 tx=0x7f121800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f121cc00640 1 -- 172.21.15.144:0/3255571661 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218017070 con 0x7f1220155810 2024-09-12T12:22:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f121cc00640 1 -- 172.21.15.144:0/3255571661 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121800c8e0 con 0x7f1220155810 2024-09-12T12:22:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1220156070 con 0x7f1220155810 2024-09-12T12:22:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f121cc00640 1 -- 172.21.15.144:0/3255571661 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121800ccb0 con 0x7f1220155810 2024-09-12T12:22:08.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1220156630 con 0x7f1220155810 2024-09-12T12:22:08.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1220156b10 con 0x7f1220155810 2024-09-12T12:22:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.558+0000 7f121cc00640 1 -- 172.21.15.144:0/3255571661 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f121801a070 con 0x7f1220155810 2024-09-12T12:22:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.562+0000 7f121cc00640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12000678f0 0x7f1200069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.562+0000 7f121cc00640 1 -- 172.21.15.144:0/3255571661 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 6001+0+0 (secure 0 0 0) 0x7f1218086440 con 0x7f1220155810 2024-09-12T12:22:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.562+0000 7f1224c00640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12000678f0 0x7f1200069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.562+0000 7f1224c00640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12000678f0 0x7f1200069db0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f12100b1000 tx=0x7f12100aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.566+0000 7f121cc00640 1 -- 172.21.15.144:0/3255571661 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1220156b10 con 0x7f1220155810 2024-09-12T12:22:08.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:08.754+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f122015b2e0 con 0x7f1220155810 2024-09-12T12:22:09.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.370+0000 7f121cc00640 1 -- 172.21.15.144:0/3255571661 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v111) ==== 174+0+0 (secure 0 0 0) 0x7f1218056870 con 0x7f1220155810 2024-09-12T12:22:09.374 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 21 and data pool 22 2024-09-12T12:22:09.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12000678f0 msgr2=0x7f1200069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12000678f0 0x7f1200069db0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f12100b1000 tx=0x7f12100aa000 comp rx=0 tx=0).stop 2024-09-12T12:22:09.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1220155810 msgr2=0x7f12200ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1220155810 0x7f12200ae890 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f121800e930 tx=0x7f121800edf0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 shutdown_connections 2024-09-12T12:22:09.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f12000678f0 0x7f1200069db0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1220155810 0x7f12200ae890 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12200b2280 0x7f122014d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 --2- 172.21.15.144:0/3255571661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12200b1e10 0x7f12201492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 >> 172.21.15.144:0/3255571661 conn(0x7f122006e7e0 msgr2=0x7f12200b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:09.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 shutdown_connections 2024-09-12T12:22:09.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.374+0000 7f1226000640 1 -- 172.21.15.144:0/3255571661 wait complete. 2024-09-12T12:22:09.422 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:22:09.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.558+0000 7f03f1c00640 1 Processor -- start 2024-09-12T12:22:09.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.558+0000 7f03f1c00640 1 -- start start 2024-09-12T12:22:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03f1c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f03ec1605e0 0x7f03ec1643f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03f1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f03ec1609c0 0x7f03ec163230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03f1c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ec0b17c0 con 0x7f03ec0cdd40 2024-09-12T12:22:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03f1c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f03ec0b1af0 con 0x7f03ec1609c0 2024-09-12T12:22:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03f1c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f03ec163af0 con 0x7f03ec1605e0 2024-09-12T12:22:09.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03ea000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f03ec1609c0 0x7f03ec163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03ea000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f03ec1609c0 0x7f03ec163230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58116/0 (socket says 172.21.15.144:58116) 2024-09-12T12:22:09.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03ea000640 1 -- 172.21.15.144:0/861348456 learned_addr learned my addr 172.21.15.144:0/861348456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:09.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03eaa00640 1 --2- 172.21.15.144:0/861348456 >> v2:172.21.15.165:3300/0 conn(0x7f03ec1605e0 0x7f03ec1643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03ea000640 1 -- 172.21.15.144:0/861348456 >> v2:172.21.15.165:3300/0 conn(0x7f03ec1605e0 msgr2=0x7f03ec1643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:09.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03ea000640 1 --2- 172.21.15.144:0/861348456 >> v2:172.21.15.165:3300/0 conn(0x7f03ec1605e0 0x7f03ec1643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03ea000640 1 -- 172.21.15.144:0/861348456 >> v1:172.21.15.144:6789/0 conn(0x7f03ec0cdd40 legacy=0x7f03ec0b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.562+0000 7f03ea000640 1 -- 172.21.15.144:0/861348456 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec163dd0 con 0x7f03ec1609c0 2024-09-12T12:22:09.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03ea000640 1 --2- 172.21.15.144:0/861348456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1609c0 0x7f03ec163230 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0d14f0 tx=0x7f03d401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a07ce9464fa0d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:09.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03e9600640 1 -- 172.21.15.144:0/861348456 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d40ab600 con 0x7f03ec1609c0 2024-09-12T12:22:09.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03e9600640 1 -- 172.21.15.144:0/861348456 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d40b0070 con 0x7f03ec1609c0 2024-09-12T12:22:09.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03e9600640 1 -- 172.21.15.144:0/861348456 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d40ab9c0 con 0x7f03ec1609c0 2024-09-12T12:22:09.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 -- 172.21.15.144:0/861348456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1609c0 msgr2=0x7f03ec163230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 --2- 172.21.15.144:0/861348456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1609c0 0x7f03ec163230 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0d14f0 tx=0x7f03d401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 -- 172.21.15.144:0/861348456 shutdown_connections 2024-09-12T12:22:09.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 --2- 172.21.15.144:0/861348456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1609c0 0x7f03ec163230 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 --2- 172.21.15.144:0/861348456 >> v2:172.21.15.165:3300/0 conn(0x7f03ec1605e0 0x7f03ec1643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 -- 172.21.15.144:0/861348456 >> 172.21.15.144:0/861348456 conn(0x7f03ec06d0d0 msgr2=0x7f03ec06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:09.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 -- 172.21.15.144:0/861348456 shutdown_connections 2024-09-12T12:22:09.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 -- 172.21.15.144:0/861348456 wait complete. 2024-09-12T12:22:09.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 Processor -- start 2024-09-12T12:22:09.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 -- start start 2024-09-12T12:22:09.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03ec0cdd40 0x7f03ec15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1605e0 0x7f03ec15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.566+0000 7f03f1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03ec1609c0 0x7f03ec15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03f1c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec0b2b00 con 0x7f03ec1605e0 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03f1c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec0b2980 con 0x7f03ec0cdd40 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03f1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f03ec0b2c80 con 0x7f03ec1609c0 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03ea000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1605e0 0x7f03ec15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03ea000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1605e0 0x7f03ec15b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58126/0 (socket says 172.21.15.144:58126) 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03ea000640 1 -- 172.21.15.144:0/3344603256 learned_addr learned my addr 172.21.15.144:0/3344603256 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03eaa00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03ec0cdd40 0x7f03ec15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03eb400640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03ec1609c0 0x7f03ec15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03ea000640 1 -- 172.21.15.144:0/3344603256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03ec1609c0 msgr2=0x7f03ec15bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03ea000640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03ec1609c0 0x7f03ec15bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03ea000640 1 -- 172.21.15.144:0/3344603256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03ec0cdd40 msgr2=0x7f03ec15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03ea000640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03ec0cdd40 0x7f03ec15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03ea000640 1 -- 172.21.15.144:0/3344603256 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec15c3e0 con 0x7f03ec1605e0 2024-09-12T12:22:09.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03eb400640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03ec1609c0 0x7f03ec15bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:09.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03ea000640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1605e0 0x7f03ec15b960 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f03d40ad040 tx=0x7f03d4019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:09.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03e2a00640 1 -- 172.21.15.144:0/3344603256 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d40bf610 con 0x7f03ec1605e0 2024-09-12T12:22:09.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03e2a00640 1 -- 172.21.15.144:0/3344603256 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d40bf7b0 con 0x7f03ec1605e0 2024-09-12T12:22:09.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec15c670 con 0x7f03ec1605e0 2024-09-12T12:22:09.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03e2a00640 1 -- 172.21.15.144:0/3344603256 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d40bfba0 con 0x7f03ec1605e0 2024-09-12T12:22:09.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec0ce910 con 0x7f03ec1605e0 2024-09-12T12:22:09.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec1643f0 con 0x7f03ec1605e0 2024-09-12T12:22:09.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03e2a00640 1 -- 172.21.15.144:0/3344603256 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03d40bd020 con 0x7f03ec1605e0 2024-09-12T12:22:09.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.570+0000 7f03e2a00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03c80678c0 0x7f03c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.574+0000 7f03e2a00640 1 -- 172.21.15.144:0/3344603256 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 6101+0+0 (secure 0 0 0) 0x7f03d4120360 con 0x7f03ec1605e0 2024-09-12T12:22:09.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.574+0000 7f03eaa00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03c80678c0 0x7f03c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.574+0000 7f03eaa00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03c80678c0 0x7f03c8069d80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f03dc003b90 tx=0x7f03dc0098d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:09.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.578+0000 7f03e2a00640 1 -- 172.21.15.144:0/3344603256 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f03d4016110 con 0x7f03ec1605e0 2024-09-12T12:22:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.734+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03ec0d13b0 con 0x7f03ec1605e0 2024-09-12T12:22:09.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03e2a00640 1 -- 172.21.15.144:0/3344603256 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16989 (secure 0 0 0) 0x7f03d40f06b0 con 0x7f03ec1605e0 2024-09-12T12:22:09.739 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:09.739 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":151,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:22:08.760465+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:06.483487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:07.768699+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:22:09.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03c80678c0 msgr2=0x7f03c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03c80678c0 0x7f03c8069d80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f03dc003b90 tx=0x7f03dc0098d0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1605e0 msgr2=0x7f03ec15b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1605e0 0x7f03ec15b960 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f03d40ad040 tx=0x7f03d4019290 comp rx=0 tx=0).stop 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 shutdown_connections 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f03c80678c0 0x7f03c8069d80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03ec1609c0 0x7f03ec15bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03ec1605e0 0x7f03ec15b960 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 --2- 172.21.15.144:0/3344603256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03ec0cdd40 0x7f03ec15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 >> 172.21.15.144:0/3344603256 conn(0x7f03ec06d0d0 msgr2=0x7f03ec075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 shutdown_connections 2024-09-12T12:22:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.738+0000 7f03f1c00640 1 -- 172.21.15.144:0/3344603256 wait complete. 2024-09-12T12:22:09.761 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:22:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.894+0000 7f5607200640 1 Processor -- start 2024-09-12T12:22:09.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.894+0000 7f5607200640 1 -- start start 2024-09-12T12:22:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.894+0000 7f5607200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 0x7f56080cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.894+0000 7f5607200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5608072810 0x7f560815de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.894+0000 7f5607200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560815a110 con 0x7f56080d03f0 2024-09-12T12:22:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5607200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5608072c40 con 0x7f5608072810 2024-09-12T12:22:09.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5607200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5608073710 con 0x7f5608159d30 2024-09-12T12:22:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5606800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5608072810 0x7f560815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5605e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 0x7f56080cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5605400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f56080d03f0 0x7f5608072100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:36318/0 (socket says 172.21.15.144:36318) 2024-09-12T12:22:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5605400640 1 -- 172.21.15.144:0/1400837668 learned_addr learned my addr 172.21.15.144:0/1400837668 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5606800640 1 -- 172.21.15.144:0/1400837668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 msgr2=0x7f56080cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:09.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5606800640 1 --2- 172.21.15.144:0/1400837668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 0x7f56080cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5606800640 1 -- 172.21.15.144:0/1400837668 >> v1:172.21.15.165:6789/0 conn(0x7f56080d03f0 legacy=0x7f5608072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5606800640 1 -- 172.21.15.144:0/1400837668 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5608072e70 con 0x7f5608072810 2024-09-12T12:22:09.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.898+0000 7f5606800640 1 --2- 172.21.15.144:0/1400837668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5608072810 0x7f560815de60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5600009d90 tx=0x7f560001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced6085ad0285ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:09.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5604a00640 1 -- 172.21.15.144:0/1400837668 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56000b2070 con 0x7f5608072810 2024-09-12T12:22:09.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5604a00640 1 -- 172.21.15.144:0/1400837668 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56000a5a00 con 0x7f5608072810 2024-09-12T12:22:09.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5604a00640 1 -- 172.21.15.144:0/1400837668 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56000a5dd0 con 0x7f5608072810 2024-09-12T12:22:09.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 -- 172.21.15.144:0/1400837668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5608072810 msgr2=0x7f560815de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 --2- 172.21.15.144:0/1400837668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5608072810 0x7f560815de60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5600009d90 tx=0x7f560001c940 comp rx=0 tx=0).stop 2024-09-12T12:22:09.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 -- 172.21.15.144:0/1400837668 shutdown_connections 2024-09-12T12:22:09.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 --2- 172.21.15.144:0/1400837668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5608072810 0x7f560815de60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 --2- 172.21.15.144:0/1400837668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 0x7f56080cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 -- 172.21.15.144:0/1400837668 >> 172.21.15.144:0/1400837668 conn(0x7f560806bc10 msgr2=0x7f560806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:09.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 -- 172.21.15.144:0/1400837668 shutdown_connections 2024-09-12T12:22:09.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 -- 172.21.15.144:0/1400837668 wait complete. 2024-09-12T12:22:09.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 Processor -- start 2024-09-12T12:22:09.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 -- start start 2024-09-12T12:22:09.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5608072810 0x7f5608151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56080d03f0 0x7f5608158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 0x7f56080b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f560815ebb0 con 0x7f5608072810 2024-09-12T12:22:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56080d07d0 con 0x7f56080d03f0 2024-09-12T12:22:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5607200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f560815ed30 con 0x7f5608159d30 2024-09-12T12:22:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.902+0000 7f5605e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5608072810 0x7f5608151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5608072810 0x7f5608151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58134/0 (socket says 172.21.15.144:58134) 2024-09-12T12:22:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605e00640 1 -- 172.21.15.144:0/2015299705 learned_addr learned my addr 172.21.15.144:0/2015299705 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605400640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56080d03f0 0x7f5608158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5606800640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 0x7f56080b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605e00640 1 -- 172.21.15.144:0/2015299705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 msgr2=0x7f56080b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605e00640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 0x7f56080b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605e00640 1 -- 172.21.15.144:0/2015299705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56080d03f0 msgr2=0x7f5608158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605e00640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56080d03f0 0x7f5608158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605e00640 1 -- 172.21.15.144:0/2015299705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560815af40 con 0x7f5608072810 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605400640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56080d03f0 0x7f5608158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5605e00640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5608072810 0x7f5608151940 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f55f800e870 tx=0x7f55f800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f55fe000640 1 -- 172.21.15.144:0/2015299705 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8017070 con 0x7f5608072810 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f55fe000640 1 -- 172.21.15.144:0/2015299705 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f800c940 con 0x7f5608072810 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f55fe000640 1 -- 172.21.15.144:0/2015299705 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f800ccf0 con 0x7f5608072810 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560815b220 con 0x7f5608072810 2024-09-12T12:22:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560815b7e0 con 0x7f5608072810 2024-09-12T12:22:09.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560815f0c0 con 0x7f5608072810 2024-09-12T12:22:09.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f55fe000640 1 -- 172.21.15.144:0/2015299705 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55f801a070 con 0x7f5608072810 2024-09-12T12:22:09.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.906+0000 7f55fe000640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55e80678c0 0x7f55e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:09.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.910+0000 7f55fe000640 1 -- 172.21.15.144:0/2015299705 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 6101+0+0 (secure 0 0 0) 0x7f55f8085c70 con 0x7f5608072810 2024-09-12T12:22:09.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.910+0000 7f5605400640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55e80678c0 0x7f55e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:09.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.910+0000 7f5605400640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55e80678c0 0x7f55e8069d80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f56080cf1c0 tx=0x7f55f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:09.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:09.914+0000 7f55fe000640 1 -- 172.21.15.144:0/2015299705 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f55f8055fc0 con 0x7f5608072810 2024-09-12T12:22:10.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.070+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5608075450 con 0x7f5608072810 2024-09-12T12:22:10.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f55fe000640 1 -- 172.21.15.144:0/2015299705 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16989 (secure 0 0 0) 0x7f55f805a2c0 con 0x7f5608072810 2024-09-12T12:22:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:10.075 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":151,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:22:08.760465+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:06.483487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:07.768699+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:22:10.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55e80678c0 msgr2=0x7f55e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55e80678c0 0x7f55e8069d80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f56080cf1c0 tx=0x7f55f4009040 comp rx=0 tx=0).stop 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5608072810 msgr2=0x7f5608151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5608072810 0x7f5608151940 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f55f800e870 tx=0x7f55f800ec70 comp rx=0 tx=0).stop 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 shutdown_connections 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f55e80678c0 0x7f55e8069d80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5608159d30 0x7f56080b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56080d03f0 0x7f5608158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 --2- 172.21.15.144:0/2015299705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5608072810 0x7f5608151940 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 >> 172.21.15.144:0/2015299705 conn(0x7f560806bc10 msgr2=0x7f56080cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 shutdown_connections 2024-09-12T12:22:10.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.074+0000 7f5607200640 1 -- 172.21.15.144:0/2015299705 wait complete. 2024-09-12T12:22:10.097 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:22:10.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e61a00640 1 Processor -- start 2024-09-12T12:22:10.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e61a00640 1 -- start start 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e61a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e5c15af60 0x7f1e5c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e61a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1e5c0cd9f0 0x7f1e5c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e61a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c15b340 0x7f1e5c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e61a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1e5c0b32f0 con 0x7f1e5c15af60 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e61a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1e5c0b4300 con 0x7f1e5c0cd9f0 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e61a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5c0b3540 con 0x7f1e5c15b340 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e5c15af60 0x7f1e5c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e5c15af60 0x7f1e5c0ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58146/0 (socket says 172.21.15.144:58146) 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5aa00640 1 -- 172.21.15.144:0/3285949287 learned_addr learned my addr 172.21.15.144:0/3285949287 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5a000640 1 --2- 172.21.15.144:0/3285949287 >> v2:172.21.15.165:3300/0 conn(0x7f1e5c0cd9f0 0x7f1e5c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5b400640 1 --2- 172.21.15.144:0/3285949287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c15b340 0x7f1e5c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:10.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5aa00640 1 -- 172.21.15.144:0/3285949287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c15b340 msgr2=0x7f1e5c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:10.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5aa00640 1 --2- 172.21.15.144:0/3285949287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c15b340 0x7f1e5c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5aa00640 1 -- 172.21.15.144:0/3285949287 >> v2:172.21.15.165:3300/0 conn(0x7f1e5c0cd9f0 msgr2=0x7f1e5c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:10.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5aa00640 1 --2- 172.21.15.144:0/3285949287 >> v2:172.21.15.165:3300/0 conn(0x7f1e5c0cd9f0 0x7f1e5c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.234+0000 7f1e5aa00640 1 -- 172.21.15.144:0/3285949287 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c0b3820 con 0x7f1e5c15af60 2024-09-12T12:22:10.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e5aa00640 1 --2- 172.21.15.144:0/3285949287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 0x7f1e5c0ce680 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c070d20 tx=0x7f1e4c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fb70ea91785216 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:10.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e59600640 1 -- 172.21.15.144:0/3285949287 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0a5760 con 0x7f1e5c15af60 2024-09-12T12:22:10.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e59600640 1 -- 172.21.15.144:0/3285949287 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c0a5900 con 0x7f1e5c15af60 2024-09-12T12:22:10.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e59600640 1 -- 172.21.15.144:0/3285949287 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0a5cd0 con 0x7f1e5c15af60 2024-09-12T12:22:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e61a00640 1 -- 172.21.15.144:0/3285949287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 msgr2=0x7f1e5c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e61a00640 1 --2- 172.21.15.144:0/3285949287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 0x7f1e5c0ce680 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c070d20 tx=0x7f1e4c01c9f0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e61a00640 1 -- 172.21.15.144:0/3285949287 shutdown_connections 2024-09-12T12:22:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e61a00640 1 --2- 172.21.15.144:0/3285949287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c15b340 0x7f1e5c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e61a00640 1 --2- 172.21.15.144:0/3285949287 >> v2:172.21.15.165:3300/0 conn(0x7f1e5c0cd9f0 0x7f1e5c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e61a00640 1 --2- 172.21.15.144:0/3285949287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 0x7f1e5c0ce680 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e61a00640 1 -- 172.21.15.144:0/3285949287 >> 172.21.15.144:0/3285949287 conn(0x7f1e5c068030 msgr2=0x7f1e5c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e61a00640 1 -- 172.21.15.144:0/3285949287 shutdown_connections 2024-09-12T12:22:10.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.238+0000 7f1e61a00640 1 -- 172.21.15.144:0/3285949287 wait complete. 2024-09-12T12:22:10.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e61a00640 1 Processor -- start 2024-09-12T12:22:10.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e61a00640 1 -- start start 2024-09-12T12:22:10.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e61a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c0cd9f0 0x7f1e5c144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e61a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 0x7f1e5c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e61a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5c15b340 0x7f1e5c0aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e61a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c15f720 con 0x7f1e5c15af60 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e61a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c15f5a0 con 0x7f1e5c15b340 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e61a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5c15f8a0 con 0x7f1e5c0cd9f0 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 0x7f1e5c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 0x7f1e5c0ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58160/0 (socket says 172.21.15.144:58160) 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5a000640 1 -- 172.21.15.144:0/304298861 learned_addr learned my addr 172.21.15.144:0/304298861 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5aa00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c0cd9f0 0x7f1e5c144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5b400640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5c15b340 0x7f1e5c0aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5a000640 1 -- 172.21.15.144:0/304298861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c0cd9f0 msgr2=0x7f1e5c144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:10.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5a000640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c0cd9f0 0x7f1e5c144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5a000640 1 -- 172.21.15.144:0/304298861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5c15b340 msgr2=0x7f1e5c0aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:10.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5a000640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5c15b340 0x7f1e5c0aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:10.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5a000640 1 -- 172.21.15.144:0/304298861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c070f70 con 0x7f1e5c15af60 2024-09-12T12:22:10.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5b400640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5c15b340 0x7f1e5c0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:10.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.242+0000 7f1e5a000640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 0x7f1e5c0ae890 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800d800 tx=0x7f1e4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:10.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.246+0000 7f1e52a00640 1 -- 172.21.15.144:0/304298861 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800b6c0 con 0x7f1e5c15af60 2024-09-12T12:22:10.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.246+0000 7f1e52a00640 1 -- 172.21.15.144:0/304298861 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e48019070 con 0x7f1e5c15af60 2024-09-12T12:22:10.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.246+0000 7f1e52a00640 1 -- 172.21.15.144:0/304298861 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800ba60 con 0x7f1e5c15af60 2024-09-12T12:22:10.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.246+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c071210 con 0x7f1e5c15af60 2024-09-12T12:22:10.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.246+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5c0717d0 con 0x7f1e5c15af60 2024-09-12T12:22:10.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.246+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e5c0ce680 con 0x7f1e5c15af60 2024-09-12T12:22:10.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.246+0000 7f1e52a00640 1 -- 172.21.15.144:0/304298861 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e4800bc00 con 0x7f1e5c15af60 2024-09-12T12:22:10.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.246+0000 7f1e52a00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e3c0678c0 0x7f1e3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:10.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.246+0000 7f1e52a00640 1 -- 172.21.15.144:0/304298861 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 6101+0+0 (secure 0 0 0) 0x7f1e480861c0 con 0x7f1e5c15af60 2024-09-12T12:22:10.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.250+0000 7f1e5aa00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e3c0678c0 0x7f1e3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:10.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.250+0000 7f1e5aa00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e3c0678c0 0x7f1e3c069d80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0ae000 tx=0x7f1e4c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:10.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.254+0000 7f1e52a00640 1 -- 172.21.15.144:0/304298861 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e48056c00 con 0x7f1e5c15af60 2024-09-12T12:22:10.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:10.446+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1e5c0afc20 con 0x7f1e5c15af60 2024-09-12T12:22:11.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.394+0000 7f1e52a00640 1 -- 172.21.15.144:0/304298861 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v113) ==== 118+0+0 (secure 0 0 0) 0x7f1e48056500 con 0x7f1e5c15af60 2024-09-12T12:22:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e3c0678c0 msgr2=0x7f1e3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e3c0678c0 0x7f1e3c069d80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0ae000 tx=0x7f1e4c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:22:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 msgr2=0x7f1e5c0ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 0x7f1e5c0ae890 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800d800 tx=0x7f1e4800dcc0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 shutdown_connections 2024-09-12T12:22:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e3c0678c0 0x7f1e3c069d80 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e5c15b340 0x7f1e5c0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e5c15af60 0x7f1e5c0ae890 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 --2- 172.21.15.144:0/304298861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e5c0cd9f0 0x7f1e5c144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 >> 172.21.15.144:0/304298861 conn(0x7f1e5c068030 msgr2=0x7f1e5c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:11.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 shutdown_connections 2024-09-12T12:22:11.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.398+0000 7f1e61a00640 1 -- 172.21.15.144:0/304298861 wait complete. 2024-09-12T12:22:11.425 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:22:11.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:22:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.566+0000 7f2fc6400640 1 Processor -- start 2024-09-12T12:22:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.566+0000 7f2fc6400640 1 -- start start 2024-09-12T12:22:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.566+0000 7f2fc6400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0162a40 0x7f2fc00cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.566+0000 7f2fc6400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc00cf900 con 0x7f2fc0166510 2024-09-12T12:22:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.566+0000 7f2fc6400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc00cfbe0 con 0x7f2fc00af5d0 2024-09-12T12:22:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.566+0000 7f2fc6400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc00cf6d0 con 0x7f2fc0162a40 2024-09-12T12:22:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2fc0166510 0x7f2fc006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34816/0 (socket says 172.21.15.144:34816) 2024-09-12T12:22:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbfe00640 1 -- 172.21.15.144:0/2623562597 learned_addr learned my addr 172.21.15.144:0/2623562597 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbf400640 1 --2- 172.21.15.144:0/2623562597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0162a40 0x7f2fc00cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbe000640 1 -- 172.21.15.144:0/2623562597 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787928128 0 0) 0x7f2fc00cf900 con 0x7f2fc0166510 2024-09-12T12:22:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbe000640 1 -- 172.21.15.144:0/2623562597 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fa4003530 con 0x7f2fc0166510 2024-09-12T12:22:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbe000640 1 -- 172.21.15.144:0/2623562597 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164649590 0 0) 0x7f2fc00cfbe0 con 0x7f2fc00af5d0 2024-09-12T12:22:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbe000640 1 -- 172.21.15.144:0/2623562597 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc00cf900 con 0x7f2fc00af5d0 2024-09-12T12:22:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbe000640 1 -- 172.21.15.144:0/2623562597 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 873958478 0 0) 0x7f2fa4003530 con 0x7f2fc0166510 2024-09-12T12:22:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbf400640 1 -- 172.21.15.144:0/2623562597 >> v1:172.21.15.165:6789/0 conn(0x7f2fc00af5d0 legacy=0x7f2fc0163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbf400640 1 -- 172.21.15.144:0/2623562597 >> v1:172.21.15.144:6789/0 conn(0x7f2fc0166510 legacy=0x7f2fc006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbf400640 1 -- 172.21.15.144:0/2623562597 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc00cfec0 con 0x7f2fc0162a40 2024-09-12T12:22:11.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.570+0000 7f2fbf400640 1 --2- 172.21.15.144:0/2623562597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0162a40 0x7f2fc00cf190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80097f0 tx=0x7f2fa801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57821b455f91d2f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:11.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fbe000640 1 -- 172.21.15.144:0/2623562597 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80b0070 con 0x7f2fc0162a40 2024-09-12T12:22:11.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fbe000640 1 -- 172.21.15.144:0/2623562597 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa80ab400 con 0x7f2fc0162a40 2024-09-12T12:22:11.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fbe000640 1 -- 172.21.15.144:0/2623562597 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8001a00 con 0x7f2fc0162a40 2024-09-12T12:22:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 -- 172.21.15.144:0/2623562597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0162a40 msgr2=0x7f2fc00cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 --2- 172.21.15.144:0/2623562597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0162a40 0x7f2fc00cf190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80097f0 tx=0x7f2fa801c400 comp rx=0 tx=0).stop 2024-09-12T12:22:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 -- 172.21.15.144:0/2623562597 shutdown_connections 2024-09-12T12:22:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 --2- 172.21.15.144:0/2623562597 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0162a40 0x7f2fc00cf190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 -- 172.21.15.144:0/2623562597 >> 172.21.15.144:0/2623562597 conn(0x7f2fc0068030 msgr2=0x7f2fc00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 -- 172.21.15.144:0/2623562597 shutdown_connections 2024-09-12T12:22:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 -- 172.21.15.144:0/2623562597 wait complete. 2024-09-12T12:22:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 Processor -- start 2024-09-12T12:22:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 -- start start 2024-09-12T12:22:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc00af5d0 0x7f2fc015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fc0162a40 0x7f2fc0159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0166510 0x7f2fc0159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc006c4a0 con 0x7f2fc00af5d0 2024-09-12T12:22:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc006c320 con 0x7f2fc0162a40 2024-09-12T12:22:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fc6400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc0166930 con 0x7f2fc0166510 2024-09-12T12:22:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fbf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc00af5d0 0x7f2fc015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fbf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc00af5d0 0x7f2fc015ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58172/0 (socket says 172.21.15.144:58172) 2024-09-12T12:22:11.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.574+0000 7f2fbf400640 1 -- 172.21.15.144:0/1877745442 learned_addr learned my addr 172.21.15.144:0/1877745442 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fbea00640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fc0162a40 0x7f2fc0159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fbf400640 1 -- 172.21.15.144:0/1877745442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0166510 msgr2=0x7f2fc0159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fbf400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0166510 0x7f2fc0159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fbf400640 1 -- 172.21.15.144:0/1877745442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fc0162a40 msgr2=0x7f2fc0159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fbf400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fc0162a40 0x7f2fc0159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fbf400640 1 -- 172.21.15.144:0/1877745442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc0159bd0 con 0x7f2fc00af5d0 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fbea00640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fc0162a40 0x7f2fc0159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fbf400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc00af5d0 0x7f2fc015ed90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80ae040 tx=0x7f2fa801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fb7400640 1 -- 172.21.15.144:0/1877745442 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80bb020 con 0x7f2fc00af5d0 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fb7400640 1 -- 172.21.15.144:0/1877745442 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa80b1040 con 0x7f2fc00af5d0 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc015c490 con 0x7f2fc00af5d0 2024-09-12T12:22:11.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fb7400640 1 -- 172.21.15.144:0/1877745442 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80b0050 con 0x7f2fc00af5d0 2024-09-12T12:22:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc015ca50 con 0x7f2fc00af5d0 2024-09-12T12:22:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc0166d90 con 0x7f2fc00af5d0 2024-09-12T12:22:11.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fb7400640 1 -- 172.21.15.144:0/1877745442 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fa80be070 con 0x7f2fc00af5d0 2024-09-12T12:22:11.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.578+0000 7f2fb7400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f9c0678c0 0x7f2f9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:11.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.582+0000 7f2fb7400640 1 -- 172.21.15.144:0/1877745442 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f2fa811f3d0 con 0x7f2fc00af5d0 2024-09-12T12:22:11.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.582+0000 7f2fbea00640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f9c0678c0 0x7f2f9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:11.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.582+0000 7f2fbea00640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f9c0678c0 0x7f2f9c069d80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00734e0 tx=0x7f2fb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.586+0000 7f2fb7400640 1 -- 172.21.15.144:0/1877745442 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2fa8015ff0 con 0x7f2fc00af5d0 2024-09-12T12:22:11.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:11.774+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2fc015cc90 con 0x7f2fc00af5d0 2024-09-12T12:22:12.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fb7400640 1 -- 172.21.15.144:0/1877745442 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v114) ==== 122+0+0 (secure 0 0 0) 0x7f2fa80efd80 con 0x7f2fc00af5d0 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f9c0678c0 msgr2=0x7f2f9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f9c0678c0 0x7f2f9c069d80 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00734e0 tx=0x7f2fb0009040 comp rx=0 tx=0).stop 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc00af5d0 msgr2=0x7f2fc015ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc00af5d0 0x7f2fc015ed90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80ae040 tx=0x7f2fa801ac40 comp rx=0 tx=0).stop 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 shutdown_connections 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2f9c0678c0 0x7f2f9c069d80 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2fc0166510 0x7f2fc0159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fc0162a40 0x7f2fc0159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 --2- 172.21.15.144:0/1877745442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc00af5d0 0x7f2fc015ed90 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 >> 172.21.15.144:0/1877745442 conn(0x7f2fc0068030 msgr2=0x7f2fc006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:12.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 shutdown_connections 2024-09-12T12:22:12.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.402+0000 7f2fc6400640 1 -- 172.21.15.144:0/1877745442 wait complete. 2024-09-12T12:22:12.428 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:22:12.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4063800640 1 Processor -- start 2024-09-12T12:22:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4063800640 1 -- start start 2024-09-12T12:22:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4063800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f405c15cd30 0x7f405c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4063800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c0b5de0 0x7f405c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4063800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405c0cd870 con 0x7f405c15c7b0 2024-09-12T12:22:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4063800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f405c0b6230 con 0x7f405c15cd30 2024-09-12T12:22:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4063800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f405c072a50 con 0x7f405c0b5de0 2024-09-12T12:22:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4061800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c0b5de0 0x7f405c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4053e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f405c15cd30 0x7f405c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4060e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f405c15c7b0 0x7f405c0ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:36332/0 (socket says 172.21.15.144:36332) 2024-09-12T12:22:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4061800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c0b5de0 0x7f405c072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:43674/0 (socket says 172.21.15.144:43674) 2024-09-12T12:22:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.562+0000 7f4060e00640 1 -- 172.21.15.144:0/2621937724 learned_addr learned my addr 172.21.15.144:0/2621937724 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f4061800640 1 -- 172.21.15.144:0/2621937724 >> v2:172.21.15.165:3300/0 conn(0x7f405c15cd30 msgr2=0x7f405c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f4061800640 1 --2- 172.21.15.144:0/2621937724 >> v2:172.21.15.165:3300/0 conn(0x7f405c15cd30 0x7f405c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f4061800640 1 -- 172.21.15.144:0/2621937724 >> v1:172.21.15.165:6789/0 conn(0x7f405c15c7b0 legacy=0x7f405c0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f4061800640 1 -- 172.21.15.144:0/2621937724 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c0cdb50 con 0x7f405c0b5de0 2024-09-12T12:22:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f4053e00640 1 --2- 172.21.15.144:0/2621937724 >> v2:172.21.15.165:3300/0 conn(0x7f405c15cd30 0x7f405c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f4061800640 1 --2- 172.21.15.144:0/2621937724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c0b5de0 0x7f405c072ee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4054009d90 tx=0x7f405401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ed92eb1edadecee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f405be00640 1 -- 172.21.15.144:0/2621937724 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540b2070 con 0x7f405c0b5de0 2024-09-12T12:22:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f405be00640 1 -- 172.21.15.144:0/2621937724 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40540a5830 con 0x7f405c0b5de0 2024-09-12T12:22:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f405be00640 1 -- 172.21.15.144:0/2621937724 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540a5c00 con 0x7f405c0b5de0 2024-09-12T12:22:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f4063800640 1 -- 172.21.15.144:0/2621937724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c0b5de0 msgr2=0x7f405c072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.566+0000 7f4063800640 1 --2- 172.21.15.144:0/2621937724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c0b5de0 0x7f405c072ee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4054009d90 tx=0x7f405401c970 comp rx=0 tx=0).stop 2024-09-12T12:22:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 -- 172.21.15.144:0/2621937724 shutdown_connections 2024-09-12T12:22:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 --2- 172.21.15.144:0/2621937724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c0b5de0 0x7f405c072ee0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 --2- 172.21.15.144:0/2621937724 >> v2:172.21.15.165:3300/0 conn(0x7f405c15cd30 0x7f405c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 -- 172.21.15.144:0/2621937724 >> 172.21.15.144:0/2621937724 conn(0x7f405c06d0d0 msgr2=0x7f405c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 -- 172.21.15.144:0/2621937724 shutdown_connections 2024-09-12T12:22:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 -- 172.21.15.144:0/2621937724 wait complete. 2024-09-12T12:22:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 Processor -- start 2024-09-12T12:22:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 -- start start 2024-09-12T12:22:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c0b5de0 0x7f405c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c15c7b0 0x7f405c0b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c15cd30 0x7f405c15aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f405c073fc0 con 0x7f405c15cd30 2024-09-12T12:22:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f405c073e40 con 0x7f405c0b5de0 2024-09-12T12:22:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4063800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f405c074140 con 0x7f405c15c7b0 2024-09-12T12:22:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4061800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c15cd30 0x7f405c15aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4061800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c15cd30 0x7f405c15aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58184/0 (socket says 172.21.15.144:58184) 2024-09-12T12:22:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4061800640 1 -- 172.21.15.144:0/2972659117 learned_addr learned my addr 172.21.15.144:0/2972659117 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4060e00640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c0b5de0 0x7f405c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4053e00640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c15c7b0 0x7f405c0b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4061800640 1 -- 172.21.15.144:0/2972659117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c15c7b0 msgr2=0x7f405c0b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4061800640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c15c7b0 0x7f405c0b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4061800640 1 -- 172.21.15.144:0/2972659117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c0b5de0 msgr2=0x7f405c1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4061800640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c0b5de0 0x7f405c1472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4061800640 1 -- 172.21.15.144:0/2972659117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c162c50 con 0x7f405c15cd30 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4060e00640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c0b5de0 0x7f405c1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.570+0000 7f4061800640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c15cd30 0x7f405c15aff0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f40540b0040 tx=0x7f4054019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4059600640 1 -- 172.21.15.144:0/2972659117 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40540b2050 con 0x7f405c15cd30 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4059600640 1 -- 172.21.15.144:0/2972659117 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40540be070 con 0x7f405c15cd30 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c162f30 con 0x7f405c15cd30 2024-09-12T12:22:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4059600640 1 -- 172.21.15.144:0/2972659117 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054009450 con 0x7f405c15cd30 2024-09-12T12:22:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c1634f0 con 0x7f405c15cd30 2024-09-12T12:22:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f405c072ee0 con 0x7f405c15cd30 2024-09-12T12:22:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4059600640 1 -- 172.21.15.144:0/2972659117 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40540adc40 con 0x7f405c15cd30 2024-09-12T12:22:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4059600640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f40380678f0 0x7f4038069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4059600640 1 -- 172.21.15.144:0/2972659117 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f40541210f0 con 0x7f405c15cd30 2024-09-12T12:22:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.574+0000 7f4060e00640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f40380678f0 0x7f4038069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.578+0000 7f4060e00640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f40380678f0 0x7f4038069db0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f404c000f70 tx=0x7f404c007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:12.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.578+0000 7f4059600640 1 -- 172.21.15.144:0/2972659117 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4054016560 con 0x7f405c15cd30 2024-09-12T12:22:12.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.770+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f405c1603c0 con 0x7f405c15cd30 2024-09-12T12:22:12.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.770+0000 7f4059600640 1 -- 172.21.15.144:0/2972659117 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7f40540f13b0 con 0x7f405c15cd30 2024-09-12T12:22:12.772 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:12.773 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:12.773 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:12.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.770+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f40380678f0 msgr2=0x7f4038069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.770+0000 7f4063800640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f40380678f0 0x7f4038069db0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f404c000f70 tx=0x7f404c007e90 comp rx=0 tx=0).stop 2024-09-12T12:22:12.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.770+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c15cd30 msgr2=0x7f405c15aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.770+0000 7f4063800640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c15cd30 0x7f405c15aff0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f40540b0040 tx=0x7f4054019710 comp rx=0 tx=0).stop 2024-09-12T12:22:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.770+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 shutdown_connections 2024-09-12T12:22:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.770+0000 7f4063800640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f40380678f0 0x7f4038069db0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.774+0000 7f4063800640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f405c15cd30 0x7f405c15aff0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.774+0000 7f4063800640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f405c15c7b0 0x7f405c0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.774+0000 7f4063800640 1 --2- 172.21.15.144:0/2972659117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f405c0b5de0 0x7f405c1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.774+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 >> 172.21.15.144:0/2972659117 conn(0x7f405c06d0d0 msgr2=0x7f405c0cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.774+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 shutdown_connections 2024-09-12T12:22:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.774+0000 7f4063800640 1 -- 172.21.15.144:0/2972659117 wait complete. 2024-09-12T12:22:12.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:22:12.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.926+0000 7f181a800640 1 Processor -- start 2024-09-12T12:22:12.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.926+0000 7f181a800640 1 -- start start 2024-09-12T12:22:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f181a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f181415c7b0 0x7f18140ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f181a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 0x7f18140b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f181a800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18140cd870 con 0x7f18140b5de0 2024-09-12T12:22:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f181a800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1814072a50 con 0x7f181415c7b0 2024-09-12T12:22:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f181a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f18140cde30 con 0x7f181415cd30 2024-09-12T12:22:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1813400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f181415c7b0 0x7f18140ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1813400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f181415c7b0 0x7f18140ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58188/0 (socket says 172.21.15.144:58188) 2024-09-12T12:22:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1813400640 1 -- 172.21.15.144:0/3799624752 learned_addr learned my addr 172.21.15.144:0/3799624752 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1813e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f18140b5de0 0x7f18141601d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34824/0 (socket says 172.21.15.144:34824) 2024-09-12T12:22:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1812a00640 1 --2- 172.21.15.144:0/3799624752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 0x7f18140b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1813400640 1 -- 172.21.15.144:0/3799624752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 msgr2=0x7f18140b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1813400640 1 --2- 172.21.15.144:0/3799624752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 0x7f18140b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1813400640 1 -- 172.21.15.144:0/3799624752 >> v1:172.21.15.144:6789/0 conn(0x7f18140b5de0 legacy=0x7f18141601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1813400640 1 -- 172.21.15.144:0/3799624752 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18140cdb50 con 0x7f181415c7b0 2024-09-12T12:22:12.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1812a00640 1 --2- 172.21.15.144:0/3799624752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 0x7f18140b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:12.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.930+0000 7f1812000640 1 -- 172.21.15.144:0/3799624752 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818002785 0 0) 0x7f18140cd870 con 0x7f18140b5de0 2024-09-12T12:22:12.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f1813400640 1 --2- 172.21.15.144:0/3799624752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f181415c7b0 0x7f18140ccf00 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f1804009870 tx=0x7f180401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124f64a7eb7564ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:12.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f1812000640 1 -- 172.21.15.144:0/3799624752 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040b2070 con 0x7f181415c7b0 2024-09-12T12:22:12.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f1812000640 1 -- 172.21.15.144:0/3799624752 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18040a9070 con 0x7f181415c7b0 2024-09-12T12:22:12.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f1812000640 1 -- 172.21.15.144:0/3799624752 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040ad880 con 0x7f181415c7b0 2024-09-12T12:22:12.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 -- 172.21.15.144:0/3799624752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f181415c7b0 msgr2=0x7f18140ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 --2- 172.21.15.144:0/3799624752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f181415c7b0 0x7f18140ccf00 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f1804009870 tx=0x7f180401c560 comp rx=0 tx=0).stop 2024-09-12T12:22:12.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 -- 172.21.15.144:0/3799624752 shutdown_connections 2024-09-12T12:22:12.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 --2- 172.21.15.144:0/3799624752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 0x7f18140b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 --2- 172.21.15.144:0/3799624752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f181415c7b0 0x7f18140ccf00 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 -- 172.21.15.144:0/3799624752 >> 172.21.15.144:0/3799624752 conn(0x7f181406d0d0 msgr2=0x7f181406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:12.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 -- 172.21.15.144:0/3799624752 shutdown_connections 2024-09-12T12:22:12.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 -- 172.21.15.144:0/3799624752 wait complete. 2024-09-12T12:22:12.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 Processor -- start 2024-09-12T12:22:12.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.934+0000 7f181a800640 1 -- start start 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f181a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18140b5de0 0x7f1814156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f181a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f181415c7b0 0x7f18140b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f181a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 0x7f18140b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f181a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1814169530 con 0x7f18140b5de0 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f181a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f18140cd650 con 0x7f181415c7b0 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f181a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f18141696b0 con 0x7f181415cd30 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f1813400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18140b5de0 0x7f1814156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f1813400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18140b5de0 0x7f1814156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58198/0 (socket says 172.21.15.144:58198) 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f1813400640 1 -- 172.21.15.144:0/3625741081 learned_addr learned my addr 172.21.15.144:0/3625741081 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:12.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f1813400640 1 -- 172.21.15.144:0/3625741081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 msgr2=0x7f18140b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f1813400640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 0x7f18140b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f1813400640 1 -- 172.21.15.144:0/3625741081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f181415c7b0 msgr2=0x7f18140b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:12.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f1813400640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f181415c7b0 0x7f18140b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:12.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f1813400640 1 -- 172.21.15.144:0/3625741081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1814165890 con 0x7f18140b5de0 2024-09-12T12:22:12.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f1813400640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18140b5de0 0x7f1814156080 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f18040b0040 tx=0x7f180401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:12.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f180b400640 1 -- 172.21.15.144:0/3625741081 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040b2040 con 0x7f18140b5de0 2024-09-12T12:22:12.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f180b400640 1 -- 172.21.15.144:0/3625741081 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18040addb0 con 0x7f18140b5de0 2024-09-12T12:22:12.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f180b400640 1 -- 172.21.15.144:0/3625741081 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1804004220 con 0x7f18140b5de0 2024-09-12T12:22:12.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1814165b70 con 0x7f18140b5de0 2024-09-12T12:22:12.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1814166130 con 0x7f18140b5de0 2024-09-12T12:22:12.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18140ccf00 con 0x7f18140b5de0 2024-09-12T12:22:12.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.938+0000 7f180b400640 1 -- 172.21.15.144:0/3625741081 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f18040c1060 con 0x7f18140b5de0 2024-09-12T12:22:12.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.942+0000 7f180b400640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17f40678c0 0x7f17f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:12.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.942+0000 7f180b400640 1 -- 172.21.15.144:0/3625741081 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f180411f330 con 0x7f18140b5de0 2024-09-12T12:22:12.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.942+0000 7f1812a00640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17f40678c0 0x7f17f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:12.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.942+0000 7f1812a00640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17f40678c0 0x7f17f4069d80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1800006f10 tx=0x7f1800008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:12.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:12.946+0000 7f180b400640 1 -- 172.21.15.144:0/3625741081 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1804016150 con 0x7f18140b5de0 2024-09-12T12:22:13.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.102+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1814075670 con 0x7f18140b5de0 2024-09-12T12:22:13.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f180b400640 1 -- 172.21.15.144:0/3625741081 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16976 (secure 0 0 0) 0x7f18040ab360 con 0x7f18140b5de0 2024-09-12T12:22:13.107 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:13.107 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":152,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:22:10.377038+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:06.483487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:07.768699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17f40678c0 msgr2=0x7f17f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17f40678c0 0x7f17f4069d80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1800006f10 tx=0x7f1800008040 comp rx=0 tx=0).stop 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18140b5de0 msgr2=0x7f1814156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18140b5de0 0x7f1814156080 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f18040b0040 tx=0x7f180401ada0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 shutdown_connections 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17f40678c0 0x7f17f4069d80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f181415cd30 0x7f18140b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f181415c7b0 0x7f18140b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 --2- 172.21.15.144:0/3625741081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18140b5de0 0x7f1814156080 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 >> 172.21.15.144:0/3625741081 conn(0x7f181406d0d0 msgr2=0x7f181415d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:13.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 shutdown_connections 2024-09-12T12:22:13.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.106+0000 7f181a800640 1 -- 172.21.15.144:0/3625741081 wait complete. 2024-09-12T12:22:13.128 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:22:13.129 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:22:13.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f786d400640 1 Processor -- start 2024-09-12T12:22:13.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f786d400640 1 -- start start 2024-09-12T12:22:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f786d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f786815b4e0 0x7f78680b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f786d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78680ccf30 0x7f78680cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f786d400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78680b45a0 con 0x7f78680b3ad0 2024-09-12T12:22:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f786d400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f78680cd8a0 con 0x7f78680ccf30 2024-09-12T12:22:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f786d400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f78680b3fe0 con 0x7f786815b4e0 2024-09-12T12:22:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f7867200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78680ccf30 0x7f78680cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f7867200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f78680ccf30 0x7f78680cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58204/0 (socket says 172.21.15.144:58204) 2024-09-12T12:22:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f7867200640 1 -- 172.21.15.144:0/2842293008 learned_addr learned my addr 172.21.15.144:0/2842293008 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f7866800640 1 --2- 172.21.15.144:0/2842293008 >> v2:172.21.15.165:3300/0 conn(0x7f786815b4e0 0x7f78680b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f7867200640 1 -- 172.21.15.144:0/2842293008 >> v2:172.21.15.165:3300/0 conn(0x7f786815b4e0 msgr2=0x7f78680b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f7867200640 1 --2- 172.21.15.144:0/2842293008 >> v2:172.21.15.165:3300/0 conn(0x7f786815b4e0 0x7f78680b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f7867200640 1 -- 172.21.15.144:0/2842293008 >> v1:172.21.15.144:6789/0 conn(0x7f78680b3ad0 legacy=0x7f7868071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f7865400640 1 -- 172.21.15.144:0/2842293008 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561874526 0 0) 0x7f78680b45a0 con 0x7f78680b3ad0 2024-09-12T12:22:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.266+0000 7f7867200640 1 -- 172.21.15.144:0/2842293008 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78680b42c0 con 0x7f78680ccf30 2024-09-12T12:22:13.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f7867200640 1 --2- 172.21.15.144:0/2842293008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78680ccf30 0x7f78680cd360 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f7868069450 tx=0x7f786001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f064efe523f34fea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:13.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f7865400640 1 -- 172.21.15.144:0/2842293008 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600a5880 con 0x7f78680ccf30 2024-09-12T12:22:13.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f7865400640 1 -- 172.21.15.144:0/2842293008 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78600a5a20 con 0x7f78680ccf30 2024-09-12T12:22:13.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f7865400640 1 -- 172.21.15.144:0/2842293008 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600a5df0 con 0x7f78680ccf30 2024-09-12T12:22:13.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 -- 172.21.15.144:0/2842293008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78680ccf30 msgr2=0x7f78680cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 --2- 172.21.15.144:0/2842293008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78680ccf30 0x7f78680cd360 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f7868069450 tx=0x7f786001c9c0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 -- 172.21.15.144:0/2842293008 shutdown_connections 2024-09-12T12:22:13.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 --2- 172.21.15.144:0/2842293008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78680ccf30 0x7f78680cd360 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 --2- 172.21.15.144:0/2842293008 >> v2:172.21.15.165:3300/0 conn(0x7f786815b4e0 0x7f78680b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 -- 172.21.15.144:0/2842293008 >> 172.21.15.144:0/2842293008 conn(0x7f786806d0d0 msgr2=0x7f786806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:13.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 -- 172.21.15.144:0/2842293008 shutdown_connections 2024-09-12T12:22:13.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 -- 172.21.15.144:0/2842293008 wait complete. 2024-09-12T12:22:13.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 Processor -- start 2024-09-12T12:22:13.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.270+0000 7f786d400640 1 -- start start 2024-09-12T12:22:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f786d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78680b3ad0 0x7f7868157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f786d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78680ccf30 0x7f7868149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f786d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786815b4e0 0x7f786814a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f786d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f786815b8c0 con 0x7f786815b4e0 2024-09-12T12:22:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f786d400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78680cdef0 con 0x7f78680ccf30 2024-09-12T12:22:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f786d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f786814a940 con 0x7f78680b3ad0 2024-09-12T12:22:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7867200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786815b4e0 0x7f786814a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7867200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786815b4e0 0x7f786814a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58212/0 (socket says 172.21.15.144:58212) 2024-09-12T12:22:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7867200640 1 -- 172.21.15.144:0/1703583530 learned_addr learned my addr 172.21.15.144:0/1703583530 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:13.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7866800640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78680b3ad0 0x7f7868157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7867200640 1 -- 172.21.15.144:0/1703583530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78680b3ad0 msgr2=0x7f7868157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7867200640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78680b3ad0 0x7f7868157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7865e00640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78680ccf30 0x7f7868149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7867200640 1 -- 172.21.15.144:0/1703583530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78680ccf30 msgr2=0x7f7868149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7867200640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78680ccf30 0x7f7868149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7867200640 1 -- 172.21.15.144:0/1703583530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78681579d0 con 0x7f786815b4e0 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7865e00640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78680ccf30 0x7f7868149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f7867200640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786815b4e0 0x7f786814a400 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f78600af040 tx=0x7f7860019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f785ea00640 1 -- 172.21.15.144:0/1703583530 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600b8670 con 0x7f786815b4e0 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f785ea00640 1 -- 172.21.15.144:0/1703583530 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78600be070 con 0x7f786815b4e0 2024-09-12T12:22:13.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7868157cb0 con 0x7f786815b4e0 2024-09-12T12:22:13.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f785ea00640 1 -- 172.21.15.144:0/1703583530 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600b8a70 con 0x7f786815b4e0 2024-09-12T12:22:13.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7868158270 con 0x7f786815b4e0 2024-09-12T12:22:13.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.274+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f786815ba40 con 0x7f786815b4e0 2024-09-12T12:22:13.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.278+0000 7f785ea00640 1 -- 172.21.15.144:0/1703583530 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78600b8c10 con 0x7f786815b4e0 2024-09-12T12:22:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.278+0000 7f785ea00640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78480678c0 0x7f7848069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.278+0000 7f785ea00640 1 -- 172.21.15.144:0/1703583530 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f78601210d0 con 0x7f786815b4e0 2024-09-12T12:22:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.278+0000 7f7866800640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78480678c0 0x7f7848069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.278+0000 7f7866800640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78480678c0 0x7f7848069d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f78580096f0 tx=0x7f7858008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:13.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.282+0000 7f785ea00640 1 -- 172.21.15.144:0/1703583530 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f78600165e0 con 0x7f786815b4e0 2024-09-12T12:22:13.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.438+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78680cd360 con 0x7f78480678c0 2024-09-12T12:22:13.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.446+0000 7f785ea00640 1 -- 172.21.15.144:0/1703583530 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252416 (secure 0 0 0) 0x7f78680cd360 con 0x7f78480678c0 2024-09-12T12:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:13.451 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:22:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78480678c0 msgr2=0x7f7848069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78480678c0 0x7f7848069d80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f78580096f0 tx=0x7f7858008040 comp rx=0 tx=0).stop 2024-09-12T12:22:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786815b4e0 msgr2=0x7f786814a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786815b4e0 0x7f786814a400 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f78600af040 tx=0x7f7860019760 comp rx=0 tx=0).stop 2024-09-12T12:22:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 shutdown_connections 2024-09-12T12:22:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78480678c0 0x7f7848069d80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f786815b4e0 0x7f786814a400 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78680ccf30 0x7f7868149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 --2- 172.21.15.144:0/1703583530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78680b3ad0 0x7f7868157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 >> 172.21.15.144:0/1703583530 conn(0x7f786806d0d0 msgr2=0x7f7868075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:13.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 shutdown_connections 2024-09-12T12:22:13.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.450+0000 7f786d400640 1 -- 172.21.15.144:0/1703583530 wait complete. 2024-09-12T12:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":434,"stamp":"2024-09-12T12:22:11.496834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":395920,"kb_used_data":15876,"kb_used_omap":12,"kb_used_meta":379827,"kb_avail":754578800,"statfs":{"total":773094113280,"available":772688691200,"internally_reserved":0,"allocated":16257024,"data_stored":8268244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":388943409},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.128194"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418087+0000","last_change":"2024-09-12T12:22:09.414454+0000","last_active":"2024-09-12T12:22:09.418087+0000","last_peered":"2024-09-12T12:22:09.418087+0000","last_clean":"2024-09-12T12:22:09.418087+0000","last_became_active":"2024-09-12T12:22:09.412761+0000","last_became_peered":"2024-09-12T12:22:09.412761+0000","last_unstale":"2024-09-12T12:22:09.418087+0000","last_undegraded":"2024-09-12T12:22:09.418087+0000","last_fullsized":"2024-09-12T12:22:09.418087+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:20.627412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.407913+0000","last_change":"2024-09-12T12:22:09.402847+0000","last_active":"2024-09-12T12:22:09.407913+0000","last_peered":"2024-09-12T12:22:09.407913+0000","last_clean":"2024-09-12T12:22:09.407913+0000","last_became_active":"2024-09-12T12:22:09.402564+0000","last_became_peered":"2024-09-12T12:22:09.402564+0000","last_unstale":"2024-09-12T12:22:09.407913+0000","last_undegraded":"2024-09-12T12:22:09.407913+0000","last_fullsized":"2024-09-12T12:22:09.407913+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:28.002090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.410808+0000","last_change":"2024-09-12T12:22:09.409712+0000","last_active":"2024-09-12T12:22:09.410808+0000","last_peered":"2024-09-12T12:22:09.410808+0000","last_clean":"2024-09-12T12:22:09.410808+0000","last_became_active":"2024-09-12T12:22:09.409205+0000","last_became_peered":"2024-09-12T12:22:09.409205+0000","last_unstale":"2024-09-12T12:22:09.410808+0000","last_undegraded":"2024-09-12T12:22:09.410808+0000","last_fullsized":"2024-09-12T12:22:09.410808+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:11.285579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.407073+0000","last_change":"2024-09-12T12:22:09.397545+0000","last_active":"2024-09-12T12:22:09.407073+0000","last_peered":"2024-09-12T12:22:09.407073+0000","last_clean":"2024-09-12T12:22:09.407073+0000","last_became_active":"2024-09-12T12:22:09.397199+0000","last_became_peered":"2024-09-12T12:22:09.397199+0000","last_unstale":"2024-09-12T12:22:09.407073+0000","last_undegraded":"2024-09-12T12:22:09.407073+0000","last_fullsized":"2024-09-12T12:22:09.407073+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:34.622188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417091+0000","last_change":"2024-09-12T12:22:09.410075+0000","last_active":"2024-09-12T12:22:09.417091+0000","last_peered":"2024-09-12T12:22:09.417091+0000","last_clean":"2024-09-12T12:22:09.417091+0000","last_became_active":"2024-09-12T12:22:09.405919+0000","last_became_peered":"2024-09-12T12:22:09.405919+0000","last_unstale":"2024-09-12T12:22:09.417091+0000","last_undegraded":"2024-09-12T12:22:09.417091+0000","last_fullsized":"2024-09-12T12:22:09.417091+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:27.432063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416905+0000","last_change":"2024-09-12T12:22:09.407071+0000","last_active":"2024-09-12T12:22:09.416905+0000","last_peered":"2024-09-12T12:22:09.416905+0000","last_clean":"2024-09-12T12:22:09.416905+0000","last_became_active":"2024-09-12T12:22:09.406723+0000","last_became_peered":"2024-09-12T12:22:09.406723+0000","last_unstale":"2024-09-12T12:22:09.416905+0000","last_undegraded":"2024-09-12T12:22:09.416905+0000","last_fullsized":"2024-09-12T12:22:09.416905+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:20.828679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417432+0000","last_change":"2024-09-12T12:22:09.414415+0000","last_active":"2024-09-12T12:22:09.417432+0000","last_peered":"2024-09-12T12:22:09.417432+0000","last_clean":"2024-09-12T12:22:09.417432+0000","last_became_active":"2024-09-12T12:22:09.414115+0000","last_became_peered":"2024-09-12T12:22:09.414115+0000","last_unstale":"2024-09-12T12:22:09.417432+0000","last_undegraded":"2024-09-12T12:22:09.417432+0000","last_fullsized":"2024-09-12T12:22:09.417432+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:45.126846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.412467+0000","last_change":"2024-09-12T12:22:09.406335+0000","last_active":"2024-09-12T12:22:09.412467+0000","last_peered":"2024-09-12T12:22:09.412467+0000","last_clean":"2024-09-12T12:22:09.412467+0000","last_became_active":"2024-09-12T12:22:09.405991+0000","last_became_peered":"2024-09-12T12:22:09.405991+0000","last_unstale":"2024-09-12T12:22:09.412467+0000","last_undegraded":"2024-09-12T12:22:09.412467+0000","last_fullsized":"2024-09-12T12:22:09.412467+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:51.239355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.412854+0000","last_change":"2024-09-12T12:22:09.402856+0000","last_active":"2024-09-12T12:22:09.412854+0000","last_peered":"2024-09-12T12:22:09.412854+0000","last_clean":"2024-09-12T12:22:09.412854+0000","last_became_active":"2024-09-12T12:22:09.402610+0000","last_became_peered":"2024-09-12T12:22:09.402610+0000","last_unstale":"2024-09-12T12:22:09.412854+0000","last_undegraded":"2024-09-12T12:22:09.412854+0000","last_fullsized":"2024-09-12T12:22:09.412854+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:50.090783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.406553+0000","last_change":"2024-09-12T12:22:09.398967+0000","last_active":"2024-09-12T12:22:09.406553+0000","last_peered":"2024-09-12T12:22:09.406553+0000","last_clean":"2024-09-12T12:22:09.406553+0000","last_became_active":"2024-09-12T12:22:09.398671+0000","last_became_peered":"2024-09-12T12:22:09.398671+0000","last_unstale":"2024-09-12T12:22:09.406553+0000","last_undegraded":"2024-09-12T12:22:09.406553+0000","last_fullsized":"2024-09-12T12:22:09.406553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:50.642709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.415110+0000","last_change":"2024-09-12T12:22:09.414102+0000","last_active":"2024-09-12T12:22:09.415110+0000","last_peered":"2024-09-12T12:22:09.415110+0000","last_clean":"2024-09-12T12:22:09.415110+0000","last_became_active":"2024-09-12T12:22:09.413809+0000","last_became_peered":"2024-09-12T12:22:09.413809+0000","last_unstale":"2024-09-12T12:22:09.415110+0000","last_undegraded":"2024-09-12T12:22:09.415110+0000","last_fullsized":"2024-09-12T12:22:09.415110+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:38.354057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408820+0000","last_change":"2024-09-12T12:22:09.407620+0000","last_active":"2024-09-12T12:22:09.408820+0000","last_peered":"2024-09-12T12:22:09.408820+0000","last_clean":"2024-09-12T12:22:09.408820+0000","last_became_active":"2024-09-12T12:22:09.407284+0000","last_became_peered":"2024-09-12T12:22:09.407284+0000","last_unstale":"2024-09-12T12:22:09.408820+0000","last_undegraded":"2024-09-12T12:22:09.408820+0000","last_fullsized":"2024-09-12T12:22:09.408820+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:53.322858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.411046+0000","last_change":"2024-09-12T12:22:09.397835+0000","last_active":"2024-09-12T12:22:09.411046+0000","last_peered":"2024-09-12T12:22:09.411046+0000","last_clean":"2024-09-12T12:22:09.411046+0000","last_became_active":"2024-09-12T12:22:09.397534+0000","last_became_peered":"2024-09-12T12:22:09.397534+0000","last_unstale":"2024-09-12T12:22:09.411046+0000","last_undegraded":"2024-09-12T12:22:09.411046+0000","last_fullsized":"2024-09-12T12:22:09.411046+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:52:39.734503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.410568+0000","last_change":"2024-09-12T12:22:09.409751+0000","last_active":"2024-09-12T12:22:09.410568+0000","last_peered":"2024-09-12T12:22:09.410568+0000","last_clean":"2024-09-12T12:22:09.410568+0000","last_became_active":"2024-09-12T12:22:09.408991+0000","last_became_peered":"2024-09-12T12:22:09.408991+0000","last_unstale":"2024-09-12T12:22:09.410568+0000","last_undegraded":"2024-09-12T12:22:09.410568+0000","last_fullsized":"2024-09-12T12:22:09.410568+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:41.413124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.401879+0000","last_change":"2024-09-12T12:22:09.399136+0000","last_active":"2024-09-12T12:22:09.401879+0000","last_peered":"2024-09-12T12:22:09.401879+0000","last_clean":"2024-09-12T12:22:09.401879+0000","last_became_active":"2024-09-12T12:22:09.398893+0000","last_became_peered":"2024-09-12T12:22:09.398893+0000","last_unstale":"2024-09-12T12:22:09.401879+0000","last_undegraded":"2024-09-12T12:22:09.401879+0000","last_fullsized":"2024-09-12T12:22:09.401879+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:15.980239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408198+0000","last_change":"2024-09-12T12:22:09.399416+0000","last_active":"2024-09-12T12:22:09.408198+0000","last_peered":"2024-09-12T12:22:09.408198+0000","last_clean":"2024-09-12T12:22:09.408198+0000","last_became_active":"2024-09-12T12:22:09.399146+0000","last_became_peered":"2024-09-12T12:22:09.399146+0000","last_unstale":"2024-09-12T12:22:09.408198+0000","last_undegraded":"2024-09-12T12:22:09.408198+0000","last_fullsized":"2024-09-12T12:22:09.408198+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:57.360222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.393257+0000","last_change":"2024-09-12T12:22:09.388504+0000","last_active":"2024-09-12T12:22:09.393257+0000","last_peered":"2024-09-12T12:22:09.393257+0000","last_clean":"2024-09-12T12:22:09.393257+0000","last_became_active":"2024-09-12T12:22:09.387638+0000","last_became_peered":"2024-09-12T12:22:09.387638+0000","last_unstale":"2024-09-12T12:22:09.393257+0000","last_undegraded":"2024-09-12T12:22:09.393257+0000","last_fullsized":"2024-09-12T12:22:09.393257+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:16.718938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.410238+0000","last_change":"2024-09-12T12:22:09.406889+0000","last_active":"2024-09-12T12:22:09.410238+0000","last_peered":"2024-09-12T12:22:09.410238+0000","last_clean":"2024-09-12T12:22:09.410238+0000","last_became_active":"2024-09-12T12:22:09.404016+0000","last_became_peered":"2024-09-12T12:22:09.404016+0000","last_unstale":"2024-09-12T12:22:09.410238+0000","last_undegraded":"2024-09-12T12:22:09.410238+0000","last_fullsized":"2024-09-12T12:22:09.410238+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:04.090152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417346+0000","last_change":"2024-09-12T12:22:09.413452+0000","last_active":"2024-09-12T12:22:09.417346+0000","last_peered":"2024-09-12T12:22:09.417346+0000","last_clean":"2024-09-12T12:22:09.417346+0000","last_became_active":"2024-09-12T12:22:09.413206+0000","last_became_peered":"2024-09-12T12:22:09.413206+0000","last_unstale":"2024-09-12T12:22:09.417346+0000","last_undegraded":"2024-09-12T12:22:09.417346+0000","last_fullsized":"2024-09-12T12:22:09.417346+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:16.476980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.398928+0000","last_change":"2024-09-12T12:22:09.393557+0000","last_active":"2024-09-12T12:22:09.398928+0000","last_peered":"2024-09-12T12:22:09.398928+0000","last_clean":"2024-09-12T12:22:09.398928+0000","last_became_active":"2024-09-12T12:22:09.392979+0000","last_became_peered":"2024-09-12T12:22:09.392979+0000","last_unstale":"2024-09-12T12:22:09.398928+0000","last_undegraded":"2024-09-12T12:22:09.398928+0000","last_fullsized":"2024-09-12T12:22:09.398928+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:20.828679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417224+0000","last_change":"2024-09-12T12:22:09.410075+0000","last_active":"2024-09-12T12:22:09.417224+0000","last_peered":"2024-09-12T12:22:09.417224+0000","last_clean":"2024-09-12T12:22:09.417224+0000","last_became_active":"2024-09-12T12:22:09.405907+0000","last_became_peered":"2024-09-12T12:22:09.405907+0000","last_unstale":"2024-09-12T12:22:09.417224+0000","last_undegraded":"2024-09-12T12:22:09.417224+0000","last_fullsized":"2024-09-12T12:22:09.417224+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:40.263363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416907+0000","last_change":"2024-09-12T12:22:09.414349+0000","last_active":"2024-09-12T12:22:09.416907+0000","last_peered":"2024-09-12T12:22:09.416907+0000","last_clean":"2024-09-12T12:22:09.416907+0000","last_became_active":"2024-09-12T12:22:09.412550+0000","last_became_peered":"2024-09-12T12:22:09.412550+0000","last_unstale":"2024-09-12T12:22:09.416907+0000","last_undegraded":"2024-09-12T12:22:09.416907+0000","last_fullsized":"2024-09-12T12:22:09.416907+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:28.002090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417981+0000","last_change":"2024-09-12T12:22:09.410046+0000","last_active":"2024-09-12T12:22:09.417981+0000","last_peered":"2024-09-12T12:22:09.417981+0000","last_clean":"2024-09-12T12:22:09.417981+0000","last_became_active":"2024-09-12T12:22:09.404106+0000","last_became_peered":"2024-09-12T12:22:09.404106+0000","last_unstale":"2024-09-12T12:22:09.417981+0000","last_undegraded":"2024-09-12T12:22:09.417981+0000","last_fullsized":"2024-09-12T12:22:09.417981+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:25.951500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.412456+0000","last_change":"2024-09-12T12:22:09.410761+0000","last_active":"2024-09-12T12:22:09.412456+0000","last_peered":"2024-09-12T12:22:09.412456+0000","last_clean":"2024-09-12T12:22:09.412456+0000","last_became_active":"2024-09-12T12:22:09.409150+0000","last_became_peered":"2024-09-12T12:22:09.409150+0000","last_unstale":"2024-09-12T12:22:09.412456+0000","last_undegraded":"2024-09-12T12:22:09.412456+0000","last_fullsized":"2024-09-12T12:22:09.412456+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:30.332232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.414734+0000","last_change":"2024-09-12T12:22:09.408179+0000","last_active":"2024-09-12T12:22:09.414734+0000","last_peered":"2024-09-12T12:22:09.414734+0000","last_clean":"2024-09-12T12:22:09.414734+0000","last_became_active":"2024-09-12T12:22:09.406439+0000","last_became_peered":"2024-09-12T12:22:09.406439+0000","last_unstale":"2024-09-12T12:22:09.414734+0000","last_undegraded":"2024-09-12T12:22:09.414734+0000","last_fullsized":"2024-09-12T12:22:09.414734+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:15.980239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.415437+0000","last_change":"2024-09-12T12:22:09.409085+0000","last_active":"2024-09-12T12:22:09.415437+0000","last_peered":"2024-09-12T12:22:09.415437+0000","last_clean":"2024-09-12T12:22:09.415437+0000","last_became_active":"2024-09-12T12:22:09.406252+0000","last_became_peered":"2024-09-12T12:22:09.406252+0000","last_unstale":"2024-09-12T12:22:09.415437+0000","last_undegraded":"2024-09-12T12:22:09.415437+0000","last_fullsized":"2024-09-12T12:22:09.415437+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:34.497665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417116+0000","last_change":"2024-09-12T12:22:09.410418+0000","last_active":"2024-09-12T12:22:09.417116+0000","last_peered":"2024-09-12T12:22:09.417116+0000","last_clean":"2024-09-12T12:22:09.417116+0000","last_became_active":"2024-09-12T12:22:09.410113+0000","last_became_peered":"2024-09-12T12:22:09.410113+0000","last_unstale":"2024-09-12T12:22:09.417116+0000","last_undegraded":"2024-09-12T12:22:09.417116+0000","last_fullsized":"2024-09-12T12:22:09.417116+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:21.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.402147+0000","last_change":"2024-09-12T12:22:09.397612+0000","last_active":"2024-09-12T12:22:09.402147+0000","last_peered":"2024-09-12T12:22:09.402147+0000","last_clean":"2024-09-12T12:22:09.402147+0000","last_became_active":"2024-09-12T12:22:09.397349+0000","last_became_peered":"2024-09-12T12:22:09.397349+0000","last_unstale":"2024-09-12T12:22:09.402147+0000","last_undegraded":"2024-09-12T12:22:09.402147+0000","last_fullsized":"2024-09-12T12:22:09.402147+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:11.434883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418000+0000","last_change":"2024-09-12T12:22:09.411784+0000","last_active":"2024-09-12T12:22:09.418000+0000","last_peered":"2024-09-12T12:22:09.418000+0000","last_clean":"2024-09-12T12:22:09.418000+0000","last_became_active":"2024-09-12T12:22:09.411422+0000","last_became_peered":"2024-09-12T12:22:09.411422+0000","last_unstale":"2024-09-12T12:22:09.418000+0000","last_undegraded":"2024-09-12T12:22:09.418000+0000","last_fullsized":"2024-09-12T12:22:09.418000+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:03.041677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.402663+0000","last_change":"2024-09-12T12:22:09.398222+0000","last_active":"2024-09-12T12:22:09.402663+0000","last_peered":"2024-09-12T12:22:09.402663+0000","last_clean":"2024-09-12T12:22:09.402663+0000","last_became_active":"2024-09-12T12:22:09.397951+0000","last_became_peered":"2024-09-12T12:22:09.397951+0000","last_unstale":"2024-09-12T12:22:09.402663+0000","last_undegraded":"2024-09-12T12:22:09.402663+0000","last_fullsized":"2024-09-12T12:22:09.402663+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:43.705155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416919+0000","last_change":"2024-09-12T12:22:09.407491+0000","last_active":"2024-09-12T12:22:09.416919+0000","last_peered":"2024-09-12T12:22:09.416919+0000","last_clean":"2024-09-12T12:22:09.416919+0000","last_became_active":"2024-09-12T12:22:09.407228+0000","last_became_peered":"2024-09-12T12:22:09.407228+0000","last_unstale":"2024-09-12T12:22:09.416919+0000","last_undegraded":"2024-09-12T12:22:09.416919+0000","last_fullsized":"2024-09-12T12:22:09.416919+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:23.135920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.411520+0000","last_change":"2024-09-12T12:22:09.406099+0000","last_active":"2024-09-12T12:22:09.411520+0000","last_peered":"2024-09-12T12:22:09.411520+0000","last_clean":"2024-09-12T12:22:09.411520+0000","last_became_active":"2024-09-12T12:22:09.405584+0000","last_became_peered":"2024-09-12T12:22:09.405584+0000","last_unstale":"2024-09-12T12:22:09.411520+0000","last_undegraded":"2024-09-12T12:22:09.411520+0000","last_fullsized":"2024-09-12T12:22:09.411520+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:55.965450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408648+0000","last_change":"2024-09-12T12:22:09.404883+0000","last_active":"2024-09-12T12:22:09.408648+0000","last_peered":"2024-09-12T12:22:09.408648+0000","last_clean":"2024-09-12T12:22:09.408648+0000","last_became_active":"2024-09-12T12:22:09.404618+0000","last_became_peered":"2024-09-12T12:22:09.404618+0000","last_unstale":"2024-09-12T12:22:09.408648+0000","last_undegraded":"2024-09-12T12:22:09.408648+0000","last_fullsized":"2024-09-12T12:22:09.408648+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:20.627412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"151'4","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417060+0000","last_change":"2024-09-12T12:22:08.394193+0000","last_active":"2024-09-12T12:22:09.417060+0000","last_peered":"2024-09-12T12:22:09.417060+0000","last_clean":"2024-09-12T12:22:09.417060+0000","last_became_active":"2024-09-12T12:22:08.393840+0000","last_became_peered":"2024-09-12T12:22:08.393840+0000","last_unstale":"2024-09-12T12:22:09.417060+0000","last_undegraded":"2024-09-12T12:22:09.417060+0000","last_fullsized":"2024-09-12T12:22:09.417060+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:34.749305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408581+0000","last_change":"2024-09-12T12:22:09.403135+0000","last_active":"2024-09-12T12:22:09.408581+0000","last_peered":"2024-09-12T12:22:09.408581+0000","last_clean":"2024-09-12T12:22:09.408581+0000","last_became_active":"2024-09-12T12:22:09.402834+0000","last_became_peered":"2024-09-12T12:22:09.402834+0000","last_unstale":"2024-09-12T12:22:09.408581+0000","last_undegraded":"2024-09-12T12:22:09.408581+0000","last_fullsized":"2024-09-12T12:22:09.408581+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:45.126846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.409806+0000","last_change":"2024-09-12T12:22:08.394093+0000","last_active":"2024-09-12T12:22:09.409806+0000","last_peered":"2024-09-12T12:22:09.409806+0000","last_clean":"2024-09-12T12:22:09.409806+0000","last_became_active":"2024-09-12T12:22:08.393821+0000","last_became_peered":"2024-09-12T12:22:08.393821+0000","last_unstale":"2024-09-12T12:22:09.409806+0000","last_undegraded":"2024-09-12T12:22:09.409806+0000","last_fullsized":"2024-09-12T12:22:09.409806+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:40.409910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.411290+0000","last_change":"2024-09-12T12:22:09.402516+0000","last_active":"2024-09-12T12:22:09.411290+0000","last_peered":"2024-09-12T12:22:09.411290+0000","last_clean":"2024-09-12T12:22:09.411290+0000","last_became_active":"2024-09-12T12:22:09.402231+0000","last_became_peered":"2024-09-12T12:22:09.402231+0000","last_unstale":"2024-09-12T12:22:09.411290+0000","last_undegraded":"2024-09-12T12:22:09.411290+0000","last_fullsized":"2024-09-12T12:22:09.411290+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:55.517190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.415830+0000","last_change":"2024-09-12T12:22:08.392398+0000","last_active":"2024-09-12T12:22:09.415830+0000","last_peered":"2024-09-12T12:22:09.415830+0000","last_clean":"2024-09-12T12:22:09.415830+0000","last_became_active":"2024-09-12T12:22:08.392061+0000","last_became_peered":"2024-09-12T12:22:08.392061+0000","last_unstale":"2024-09-12T12:22:09.415830+0000","last_undegraded":"2024-09-12T12:22:09.415830+0000","last_fullsized":"2024-09-12T12:22:09.415830+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:55:24.492237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417104+0000","last_change":"2024-09-12T12:22:09.413749+0000","last_active":"2024-09-12T12:22:09.417104+0000","last_peered":"2024-09-12T12:22:09.417104+0000","last_clean":"2024-09-12T12:22:09.417104+0000","last_became_active":"2024-09-12T12:22:09.411635+0000","last_became_peered":"2024-09-12T12:22:09.411635+0000","last_unstale":"2024-09-12T12:22:09.417104+0000","last_undegraded":"2024-09-12T12:22:09.417104+0000","last_fullsized":"2024-09-12T12:22:09.417104+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:27.900506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.409565+0000","last_change":"2024-09-12T12:22:08.401787+0000","last_active":"2024-09-12T12:22:09.409565+0000","last_peered":"2024-09-12T12:22:09.409565+0000","last_clean":"2024-09-12T12:22:09.409565+0000","last_became_active":"2024-09-12T12:22:08.401507+0000","last_became_peered":"2024-09-12T12:22:08.401507+0000","last_unstale":"2024-09-12T12:22:09.409565+0000","last_undegraded":"2024-09-12T12:22:09.409565+0000","last_fullsized":"2024-09-12T12:22:09.409565+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:31:22.399929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.391999+0000","last_change":"2024-09-12T12:22:09.387874+0000","last_active":"2024-09-12T12:22:09.391999+0000","last_peered":"2024-09-12T12:22:09.391999+0000","last_clean":"2024-09-12T12:22:09.391999+0000","last_became_active":"2024-09-12T12:22:09.387580+0000","last_became_peered":"2024-09-12T12:22:09.387580+0000","last_unstale":"2024-09-12T12:22:09.391999+0000","last_undegraded":"2024-09-12T12:22:09.391999+0000","last_fullsized":"2024-09-12T12:22:09.391999+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:31.769679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.406666+0000","last_change":"2024-09-12T12:22:08.398076+0000","last_active":"2024-09-12T12:22:09.406666+0000","last_peered":"2024-09-12T12:22:09.406666+0000","last_clean":"2024-09-12T12:22:09.406666+0000","last_became_active":"2024-09-12T12:22:08.397121+0000","last_became_peered":"2024-09-12T12:22:08.397121+0000","last_unstale":"2024-09-12T12:22:09.406666+0000","last_undegraded":"2024-09-12T12:22:09.406666+0000","last_fullsized":"2024-09-12T12:22:09.406666+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:07.009975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.405853+0000","last_change":"2024-09-12T12:22:09.400995+0000","last_active":"2024-09-12T12:22:09.405853+0000","last_peered":"2024-09-12T12:22:09.405853+0000","last_clean":"2024-09-12T12:22:09.405853+0000","last_became_active":"2024-09-12T12:22:09.400501+0000","last_became_peered":"2024-09-12T12:22:09.400501+0000","last_unstale":"2024-09-12T12:22:09.405853+0000","last_undegraded":"2024-09-12T12:22:09.405853+0000","last_fullsized":"2024-09-12T12:22:09.405853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:56.172592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416935+0000","last_change":"2024-09-12T12:22:08.397268+0000","last_active":"2024-09-12T12:22:09.416935+0000","last_peered":"2024-09-12T12:22:09.416935+0000","last_clean":"2024-09-12T12:22:09.416935+0000","last_became_active":"2024-09-12T12:22:08.396965+0000","last_became_peered":"2024-09-12T12:22:08.396965+0000","last_unstale":"2024-09-12T12:22:09.416935+0000","last_undegraded":"2024-09-12T12:22:09.416935+0000","last_fullsized":"2024-09-12T12:22:09.416935+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:12:26.398334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.401035+0000","last_change":"2024-09-12T12:22:09.397041+0000","last_active":"2024-09-12T12:22:09.401035+0000","last_peered":"2024-09-12T12:22:09.401035+0000","last_clean":"2024-09-12T12:22:09.401035+0000","last_became_active":"2024-09-12T12:22:09.396780+0000","last_became_peered":"2024-09-12T12:22:09.396780+0000","last_unstale":"2024-09-12T12:22:09.401035+0000","last_undegraded":"2024-09-12T12:22:09.401035+0000","last_fullsized":"2024-09-12T12:22:09.401035+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:50.879267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.397758+0000","last_change":"2024-09-12T12:22:08.387024+0000","last_active":"2024-09-12T12:22:09.397758+0000","last_peered":"2024-09-12T12:22:09.397758+0000","last_clean":"2024-09-12T12:22:09.397758+0000","last_became_active":"2024-09-12T12:22:08.386707+0000","last_became_peered":"2024-09-12T12:22:08.386707+0000","last_unstale":"2024-09-12T12:22:09.397758+0000","last_undegraded":"2024-09-12T12:22:09.397758+0000","last_fullsized":"2024-09-12T12:22:09.397758+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:31:22.399929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418131+0000","last_change":"2024-09-12T12:22:09.415029+0000","last_active":"2024-09-12T12:22:09.418131+0000","last_peered":"2024-09-12T12:22:09.418131+0000","last_clean":"2024-09-12T12:22:09.418131+0000","last_became_active":"2024-09-12T12:22:09.412568+0000","last_became_peered":"2024-09-12T12:22:09.412568+0000","last_unstale":"2024-09-12T12:22:09.418131+0000","last_undegraded":"2024-09-12T12:22:09.418131+0000","last_fullsized":"2024-09-12T12:22:09.418131+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:11.285579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.384768+0000","last_change":"2024-09-12T12:22:08.398634+0000","last_active":"2024-09-12T12:22:09.384768+0000","last_peered":"2024-09-12T12:22:09.384768+0000","last_clean":"2024-09-12T12:22:09.384768+0000","last_became_active":"2024-09-12T12:22:08.397748+0000","last_became_peered":"2024-09-12T12:22:08.397748+0000","last_unstale":"2024-09-12T12:22:09.384768+0000","last_undegraded":"2024-09-12T12:22:09.384768+0000","last_fullsized":"2024-09-12T12:22:09.384768+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:30.227310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.413360+0000","last_change":"2024-09-12T12:22:09.407447+0000","last_active":"2024-09-12T12:22:09.413360+0000","last_peered":"2024-09-12T12:22:09.413360+0000","last_clean":"2024-09-12T12:22:09.413360+0000","last_became_active":"2024-09-12T12:22:09.404529+0000","last_became_peered":"2024-09-12T12:22:09.404529+0000","last_unstale":"2024-09-12T12:22:09.413360+0000","last_undegraded":"2024-09-12T12:22:09.413360+0000","last_fullsized":"2024-09-12T12:22:09.413360+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:54.224131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.396127+0000","last_change":"2024-09-12T12:22:08.394317+0000","last_active":"2024-09-12T12:22:09.396127+0000","last_peered":"2024-09-12T12:22:09.396127+0000","last_clean":"2024-09-12T12:22:09.396127+0000","last_became_active":"2024-09-12T12:22:08.394060+0000","last_became_peered":"2024-09-12T12:22:08.394060+0000","last_unstale":"2024-09-12T12:22:09.396127+0000","last_undegraded":"2024-09-12T12:22:09.396127+0000","last_fullsized":"2024-09-12T12:22:09.396127+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:07.957390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416864+0000","last_change":"2024-09-12T12:22:09.416099+0000","last_active":"2024-09-12T12:22:09.416864+0000","last_peered":"2024-09-12T12:22:09.416864+0000","last_clean":"2024-09-12T12:22:09.416864+0000","last_became_active":"2024-09-12T12:22:09.415807+0000","last_became_peered":"2024-09-12T12:22:09.415807+0000","last_unstale":"2024-09-12T12:22:09.416864+0000","last_undegraded":"2024-09-12T12:22:09.416864+0000","last_fullsized":"2024-09-12T12:22:09.416864+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:20.170308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.399354+0000","last_change":"2024-09-12T12:22:08.398784+0000","last_active":"2024-09-12T12:22:09.399354+0000","last_peered":"2024-09-12T12:22:09.399354+0000","last_clean":"2024-09-12T12:22:09.399354+0000","last_became_active":"2024-09-12T12:22:08.398466+0000","last_became_peered":"2024-09-12T12:22:08.398466+0000","last_unstale":"2024-09-12T12:22:09.399354+0000","last_undegraded":"2024-09-12T12:22:09.399354+0000","last_fullsized":"2024-09-12T12:22:09.399354+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:49.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.410213+0000","last_change":"2024-09-12T12:22:09.406297+0000","last_active":"2024-09-12T12:22:09.410213+0000","last_peered":"2024-09-12T12:22:09.410213+0000","last_clean":"2024-09-12T12:22:09.410213+0000","last_became_active":"2024-09-12T12:22:09.404358+0000","last_became_peered":"2024-09-12T12:22:09.404358+0000","last_unstale":"2024-09-12T12:22:09.410213+0000","last_undegraded":"2024-09-12T12:22:09.410213+0000","last_fullsized":"2024-09-12T12:22:09.410213+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:24.623030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"151'3","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416650+0000","last_change":"2024-09-12T12:22:08.402984+0000","last_active":"2024-09-12T12:22:09.416650+0000","last_peered":"2024-09-12T12:22:09.416650+0000","last_clean":"2024-09-12T12:22:09.416650+0000","last_became_active":"2024-09-12T12:22:08.402722+0000","last_became_peered":"2024-09-12T12:22:08.402722+0000","last_unstale":"2024-09-12T12:22:09.416650+0000","last_undegraded":"2024-09-12T12:22:09.416650+0000","last_fullsized":"2024-09-12T12:22:09.416650+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:23.069468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.411496+0000","last_change":"2024-09-12T12:22:09.405516+0000","last_active":"2024-09-12T12:22:09.411496+0000","last_peered":"2024-09-12T12:22:09.411496+0000","last_clean":"2024-09-12T12:22:09.411496+0000","last_became_active":"2024-09-12T12:22:09.404264+0000","last_became_peered":"2024-09-12T12:22:09.404264+0000","last_unstale":"2024-09-12T12:22:09.411496+0000","last_undegraded":"2024-09-12T12:22:09.411496+0000","last_fullsized":"2024-09-12T12:22:09.411496+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:32.259886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417177+0000","last_change":"2024-09-12T12:22:08.396221+0000","last_active":"2024-09-12T12:22:09.417177+0000","last_peered":"2024-09-12T12:22:09.417177+0000","last_clean":"2024-09-12T12:22:09.417177+0000","last_became_active":"2024-09-12T12:22:08.394676+0000","last_became_peered":"2024-09-12T12:22:08.394676+0000","last_unstale":"2024-09-12T12:22:09.417177+0000","last_undegraded":"2024-09-12T12:22:09.417177+0000","last_fullsized":"2024-09-12T12:22:09.417177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:58.365392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.401851+0000","last_change":"2024-09-12T12:22:09.397404+0000","last_active":"2024-09-12T12:22:09.401851+0000","last_peered":"2024-09-12T12:22:09.401851+0000","last_clean":"2024-09-12T12:22:09.401851+0000","last_became_active":"2024-09-12T12:22:09.397158+0000","last_became_peered":"2024-09-12T12:22:09.397158+0000","last_unstale":"2024-09-12T12:22:09.401851+0000","last_undegraded":"2024-09-12T12:22:09.401851+0000","last_fullsized":"2024-09-12T12:22:09.401851+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:28.889997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.382664+0000","last_change":"2024-09-12T12:22:08.395776+0000","last_active":"2024-09-12T12:22:09.382664+0000","last_peered":"2024-09-12T12:22:09.382664+0000","last_clean":"2024-09-12T12:22:09.382664+0000","last_became_active":"2024-09-12T12:22:08.395509+0000","last_became_peered":"2024-09-12T12:22:08.395509+0000","last_unstale":"2024-09-12T12:22:09.382664+0000","last_undegraded":"2024-09-12T12:22:09.382664+0000","last_fullsized":"2024-09-12T12:22:09.382664+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:19.624198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.407673+0000","last_change":"2024-09-12T12:22:09.402638+0000","last_active":"2024-09-12T12:22:09.407673+0000","last_peered":"2024-09-12T12:22:09.407673+0000","last_clean":"2024-09-12T12:22:09.407673+0000","last_became_active":"2024-09-12T12:22:09.402384+0000","last_became_peered":"2024-09-12T12:22:09.402384+0000","last_unstale":"2024-09-12T12:22:09.407673+0000","last_undegraded":"2024-09-12T12:22:09.407673+0000","last_fullsized":"2024-09-12T12:22:09.407673+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:35.873808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.382977+0000","last_change":"2024-09-12T12:22:08.397393+0000","last_active":"2024-09-12T12:22:09.382977+0000","last_peered":"2024-09-12T12:22:09.382977+0000","last_clean":"2024-09-12T12:22:09.382977+0000","last_became_active":"2024-09-12T12:22:08.397116+0000","last_became_peered":"2024-09-12T12:22:08.397116+0000","last_unstale":"2024-09-12T12:22:09.382977+0000","last_undegraded":"2024-09-12T12:22:09.382977+0000","last_fullsized":"2024-09-12T12:22:09.382977+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:10.282365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.413985+0000","last_change":"2024-09-12T12:22:09.412980+0000","last_active":"2024-09-12T12:22:09.413985+0000","last_peered":"2024-09-12T12:22:09.413985+0000","last_clean":"2024-09-12T12:22:09.413985+0000","last_became_active":"2024-09-12T12:22:09.412695+0000","last_became_peered":"2024-09-12T12:22:09.412695+0000","last_unstale":"2024-09-12T12:22:09.413985+0000","last_undegraded":"2024-09-12T12:22:09.413985+0000","last_fullsized":"2024-09-12T12:22:09.413985+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:16.718938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"151'8","reported_seq":20,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417755+0000","last_change":"2024-09-12T12:22:08.388172+0000","last_active":"2024-09-12T12:22:09.417755+0000","last_peered":"2024-09-12T12:22:09.417755+0000","last_clean":"2024-09-12T12:22:09.417755+0000","last_became_active":"2024-09-12T12:22:08.387866+0000","last_became_peered":"2024-09-12T12:22:08.387866+0000","last_unstale":"2024-09-12T12:22:09.417755+0000","last_undegraded":"2024-09-12T12:22:09.417755+0000","last_fullsized":"2024-09-12T12:22:09.417755+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:51.905295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416121+0000","last_change":"2024-09-12T12:22:09.409349+0000","last_active":"2024-09-12T12:22:09.416121+0000","last_peered":"2024-09-12T12:22:09.416121+0000","last_clean":"2024-09-12T12:22:09.416121+0000","last_became_active":"2024-09-12T12:22:09.409085+0000","last_became_peered":"2024-09-12T12:22:09.409085+0000","last_unstale":"2024-09-12T12:22:09.416121+0000","last_undegraded":"2024-09-12T12:22:09.416121+0000","last_fullsized":"2024-09-12T12:22:09.416121+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:40.303043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417737+0000","last_change":"2024-09-12T12:22:08.400163+0000","last_active":"2024-09-12T12:22:09.417737+0000","last_peered":"2024-09-12T12:22:09.417737+0000","last_clean":"2024-09-12T12:22:09.417737+0000","last_became_active":"2024-09-12T12:22:08.399867+0000","last_became_peered":"2024-09-12T12:22:08.399867+0000","last_unstale":"2024-09-12T12:22:09.417737+0000","last_undegraded":"2024-09-12T12:22:09.417737+0000","last_fullsized":"2024-09-12T12:22:09.417737+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:56.274322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417365+0000","last_change":"2024-09-12T12:22:09.415166+0000","last_active":"2024-09-12T12:22:09.417365+0000","last_peered":"2024-09-12T12:22:09.417365+0000","last_clean":"2024-09-12T12:22:09.417365+0000","last_became_active":"2024-09-12T12:22:09.414773+0000","last_became_peered":"2024-09-12T12:22:09.414773+0000","last_unstale":"2024-09-12T12:22:09.417365+0000","last_undegraded":"2024-09-12T12:22:09.417365+0000","last_fullsized":"2024-09-12T12:22:09.417365+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:55.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.409755+0000","last_change":"2024-09-12T12:22:08.399242+0000","last_active":"2024-09-12T12:22:09.409755+0000","last_peered":"2024-09-12T12:22:09.409755+0000","last_clean":"2024-09-12T12:22:09.409755+0000","last_became_active":"2024-09-12T12:22:08.398954+0000","last_became_peered":"2024-09-12T12:22:08.398954+0000","last_unstale":"2024-09-12T12:22:09.409755+0000","last_undegraded":"2024-09-12T12:22:09.409755+0000","last_fullsized":"2024-09-12T12:22:09.409755+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:03.027136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418823+0000","last_change":"2024-09-12T12:22:09.417841+0000","last_active":"2024-09-12T12:22:09.418823+0000","last_peered":"2024-09-12T12:22:09.418823+0000","last_clean":"2024-09-12T12:22:09.418823+0000","last_became_active":"2024-09-12T12:22:09.416794+0000","last_became_peered":"2024-09-12T12:22:09.416794+0000","last_unstale":"2024-09-12T12:22:09.418823+0000","last_undegraded":"2024-09-12T12:22:09.418823+0000","last_fullsized":"2024-09-12T12:22:09.418823+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:34.622188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.407870+0000","last_change":"2024-09-12T12:22:08.397706+0000","last_active":"2024-09-12T12:22:09.407870+0000","last_peered":"2024-09-12T12:22:09.407870+0000","last_clean":"2024-09-12T12:22:09.407870+0000","last_became_active":"2024-09-12T12:22:08.397445+0000","last_became_peered":"2024-09-12T12:22:08.397445+0000","last_unstale":"2024-09-12T12:22:09.407870+0000","last_undegraded":"2024-09-12T12:22:09.407870+0000","last_fullsized":"2024-09-12T12:22:09.407870+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:51.941031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.414711+0000","last_change":"2024-09-12T12:22:09.407932+0000","last_active":"2024-09-12T12:22:09.414711+0000","last_peered":"2024-09-12T12:22:09.414711+0000","last_clean":"2024-09-12T12:22:09.414711+0000","last_became_active":"2024-09-12T12:22:09.406116+0000","last_became_peered":"2024-09-12T12:22:09.406116+0000","last_unstale":"2024-09-12T12:22:09.414711+0000","last_undegraded":"2024-09-12T12:22:09.414711+0000","last_fullsized":"2024-09-12T12:22:09.414711+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:16.652604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.382309+0000","last_change":"2024-09-12T12:22:08.401548+0000","last_active":"2024-09-12T12:22:09.382309+0000","last_peered":"2024-09-12T12:22:09.382309+0000","last_clean":"2024-09-12T12:22:09.382309+0000","last_became_active":"2024-09-12T12:22:08.401281+0000","last_became_peered":"2024-09-12T12:22:08.401281+0000","last_unstale":"2024-09-12T12:22:09.382309+0000","last_undegraded":"2024-09-12T12:22:09.382309+0000","last_fullsized":"2024-09-12T12:22:09.382309+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:44.123632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417000+0000","last_change":"2024-09-12T12:22:09.411055+0000","last_active":"2024-09-12T12:22:09.417000+0000","last_peered":"2024-09-12T12:22:09.417000+0000","last_clean":"2024-09-12T12:22:09.417000+0000","last_became_active":"2024-09-12T12:22:09.408206+0000","last_became_peered":"2024-09-12T12:22:09.408206+0000","last_unstale":"2024-09-12T12:22:09.417000+0000","last_undegraded":"2024-09-12T12:22:09.417000+0000","last_fullsized":"2024-09-12T12:22:09.417000+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:12.644654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.413191+0000","last_change":"2024-09-12T12:22:08.399392+0000","last_active":"2024-09-12T12:22:09.413191+0000","last_peered":"2024-09-12T12:22:09.413191+0000","last_clean":"2024-09-12T12:22:09.413191+0000","last_became_active":"2024-09-12T12:22:08.399013+0000","last_became_peered":"2024-09-12T12:22:08.399013+0000","last_unstale":"2024-09-12T12:22:09.413191+0000","last_undegraded":"2024-09-12T12:22:09.413191+0000","last_fullsized":"2024-09-12T12:22:09.413191+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:34.870594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.405855+0000","last_change":"2024-09-12T12:22:09.400826+0000","last_active":"2024-09-12T12:22:09.405855+0000","last_peered":"2024-09-12T12:22:09.405855+0000","last_clean":"2024-09-12T12:22:09.405855+0000","last_became_active":"2024-09-12T12:22:09.400551+0000","last_became_peered":"2024-09-12T12:22:09.400551+0000","last_unstale":"2024-09-12T12:22:09.405855+0000","last_undegraded":"2024-09-12T12:22:09.405855+0000","last_fullsized":"2024-09-12T12:22:09.405855+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:34.497665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.385855+0000","last_change":"2024-09-12T12:22:08.398047+0000","last_active":"2024-09-12T12:22:09.385855+0000","last_peered":"2024-09-12T12:22:09.385855+0000","last_clean":"2024-09-12T12:22:09.385855+0000","last_became_active":"2024-09-12T12:22:08.397533+0000","last_became_peered":"2024-09-12T12:22:08.397533+0000","last_unstale":"2024-09-12T12:22:09.385855+0000","last_undegraded":"2024-09-12T12:22:09.385855+0000","last_fullsized":"2024-09-12T12:22:09.385855+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:51.447080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.415857+0000","last_change":"2024-09-12T12:22:09.408720+0000","last_active":"2024-09-12T12:22:09.415857+0000","last_peered":"2024-09-12T12:22:09.415857+0000","last_clean":"2024-09-12T12:22:09.415857+0000","last_became_active":"2024-09-12T12:22:09.404530+0000","last_became_peered":"2024-09-12T12:22:09.404530+0000","last_unstale":"2024-09-12T12:22:09.415857+0000","last_undegraded":"2024-09-12T12:22:09.415857+0000","last_fullsized":"2024-09-12T12:22:09.415857+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:52.585101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.380400+0000","last_change":"2024-09-12T12:22:08.395900+0000","last_active":"2024-09-12T12:22:09.380400+0000","last_peered":"2024-09-12T12:22:09.380400+0000","last_clean":"2024-09-12T12:22:09.380400+0000","last_became_active":"2024-09-12T12:22:08.395274+0000","last_became_peered":"2024-09-12T12:22:08.395274+0000","last_unstale":"2024-09-12T12:22:09.380400+0000","last_undegraded":"2024-09-12T12:22:09.380400+0000","last_fullsized":"2024-09-12T12:22:09.380400+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:49.087569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.403258+0000","last_change":"2024-09-12T12:22:09.398585+0000","last_active":"2024-09-12T12:22:09.403258+0000","last_peered":"2024-09-12T12:22:09.403258+0000","last_clean":"2024-09-12T12:22:09.403258+0000","last_became_active":"2024-09-12T12:22:09.398323+0000","last_became_peered":"2024-09-12T12:22:09.398323+0000","last_unstale":"2024-09-12T12:22:09.403258+0000","last_undegraded":"2024-09-12T12:22:09.403258+0000","last_fullsized":"2024-09-12T12:22:09.403258+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:16.652604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.383493+0000","last_change":"2024-09-12T12:22:08.398338+0000","last_active":"2024-09-12T12:22:09.383493+0000","last_peered":"2024-09-12T12:22:09.383493+0000","last_clean":"2024-09-12T12:22:09.383493+0000","last_became_active":"2024-09-12T12:22:08.396709+0000","last_became_peered":"2024-09-12T12:22:08.396709+0000","last_unstale":"2024-09-12T12:22:09.383493+0000","last_undegraded":"2024-09-12T12:22:09.383493+0000","last_fullsized":"2024-09-12T12:22:09.383493+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:23.002498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416869+0000","last_change":"2024-09-12T12:22:09.406979+0000","last_active":"2024-09-12T12:22:09.416869+0000","last_peered":"2024-09-12T12:22:09.416869+0000","last_clean":"2024-09-12T12:22:09.416869+0000","last_became_active":"2024-09-12T12:22:09.406425+0000","last_became_peered":"2024-09-12T12:22:09.406425+0000","last_unstale":"2024-09-12T12:22:09.416869+0000","last_undegraded":"2024-09-12T12:22:09.416869+0000","last_fullsized":"2024-09-12T12:22:09.416869+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:31.769679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.403683+0000","last_change":"2024-09-12T12:22:08.401957+0000","last_active":"2024-09-12T12:22:09.403683+0000","last_peered":"2024-09-12T12:22:09.403683+0000","last_clean":"2024-09-12T12:22:09.403683+0000","last_became_active":"2024-09-12T12:22:08.401674+0000","last_became_peered":"2024-09-12T12:22:08.401674+0000","last_unstale":"2024-09-12T12:22:09.403683+0000","last_undegraded":"2024-09-12T12:22:09.403683+0000","last_fullsized":"2024-09-12T12:22:09.403683+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:26.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416524+0000","last_change":"2024-09-12T12:22:09.412231+0000","last_active":"2024-09-12T12:22:09.416524+0000","last_peered":"2024-09-12T12:22:09.416524+0000","last_clean":"2024-09-12T12:22:09.416524+0000","last_became_active":"2024-09-12T12:22:09.411952+0000","last_became_peered":"2024-09-12T12:22:09.411952+0000","last_unstale":"2024-09-12T12:22:09.416524+0000","last_undegraded":"2024-09-12T12:22:09.416524+0000","last_fullsized":"2024-09-12T12:22:09.416524+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:04.030350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.399509+0000","last_change":"2024-09-12T12:22:08.388752+0000","last_active":"2024-09-12T12:22:09.399509+0000","last_peered":"2024-09-12T12:22:09.399509+0000","last_clean":"2024-09-12T12:22:09.399509+0000","last_became_active":"2024-09-12T12:22:08.388445+0000","last_became_peered":"2024-09-12T12:22:08.388445+0000","last_unstale":"2024-09-12T12:22:09.399509+0000","last_undegraded":"2024-09-12T12:22:09.399509+0000","last_fullsized":"2024-09-12T12:22:09.399509+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:27.886783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418464+0000","last_change":"2024-09-12T12:22:09.415035+0000","last_active":"2024-09-12T12:22:09.418464+0000","last_peered":"2024-09-12T12:22:09.418464+0000","last_clean":"2024-09-12T12:22:09.418464+0000","last_became_active":"2024-09-12T12:22:09.414765+0000","last_became_peered":"2024-09-12T12:22:09.414765+0000","last_unstale":"2024-09-12T12:22:09.418464+0000","last_undegraded":"2024-09-12T12:22:09.418464+0000","last_fullsized":"2024-09-12T12:22:09.418464+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:16.718938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.390159+0000","last_change":"2024-09-12T12:22:08.399922+0000","last_active":"2024-09-12T12:22:09.390159+0000","last_peered":"2024-09-12T12:22:09.390159+0000","last_clean":"2024-09-12T12:22:09.390159+0000","last_became_active":"2024-09-12T12:22:08.399521+0000","last_became_peered":"2024-09-12T12:22:08.399521+0000","last_unstale":"2024-09-12T12:22:09.390159+0000","last_undegraded":"2024-09-12T12:22:09.390159+0000","last_fullsized":"2024-09-12T12:22:09.390159+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:27.883635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.406151+0000","last_change":"2024-09-12T12:22:09.401971+0000","last_active":"2024-09-12T12:22:09.406151+0000","last_peered":"2024-09-12T12:22:09.406151+0000","last_clean":"2024-09-12T12:22:09.406151+0000","last_became_active":"2024-09-12T12:22:09.400197+0000","last_became_peered":"2024-09-12T12:22:09.400197+0000","last_unstale":"2024-09-12T12:22:09.406151+0000","last_undegraded":"2024-09-12T12:22:09.406151+0000","last_fullsized":"2024-09-12T12:22:09.406151+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:02.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.401560+0000","last_change":"2024-09-12T12:22:08.404822+0000","last_active":"2024-09-12T12:22:09.401560+0000","last_peered":"2024-09-12T12:22:09.401560+0000","last_clean":"2024-09-12T12:22:09.401560+0000","last_became_active":"2024-09-12T12:22:08.404494+0000","last_became_peered":"2024-09-12T12:22:08.404494+0000","last_unstale":"2024-09-12T12:22:09.401560+0000","last_undegraded":"2024-09-12T12:22:09.401560+0000","last_fullsized":"2024-09-12T12:22:09.401560+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:08.616413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.403992+0000","last_change":"2024-09-12T12:22:09.392317+0000","last_active":"2024-09-12T12:22:09.403992+0000","last_peered":"2024-09-12T12:22:09.403992+0000","last_clean":"2024-09-12T12:22:09.403992+0000","last_became_active":"2024-09-12T12:22:09.391938+0000","last_became_peered":"2024-09-12T12:22:09.391938+0000","last_unstale":"2024-09-12T12:22:09.403992+0000","last_undegraded":"2024-09-12T12:22:09.403992+0000","last_fullsized":"2024-09-12T12:22:09.403992+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:39.710427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.397553+0000","last_change":"2024-09-12T12:22:08.397496+0000","last_active":"2024-09-12T12:22:09.397553+0000","last_peered":"2024-09-12T12:22:09.397553+0000","last_clean":"2024-09-12T12:22:09.397553+0000","last_became_active":"2024-09-12T12:22:08.397144+0000","last_became_peered":"2024-09-12T12:22:08.397144+0000","last_unstale":"2024-09-12T12:22:09.397553+0000","last_undegraded":"2024-09-12T12:22:09.397553+0000","last_fullsized":"2024-09-12T12:22:09.397553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:51.941031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408867+0000","last_change":"2024-09-12T12:22:09.403777+0000","last_active":"2024-09-12T12:22:09.408867+0000","last_peered":"2024-09-12T12:22:09.408867+0000","last_clean":"2024-09-12T12:22:09.408867+0000","last_became_active":"2024-09-12T12:22:09.403490+0000","last_became_peered":"2024-09-12T12:22:09.403490+0000","last_unstale":"2024-09-12T12:22:09.408867+0000","last_undegraded":"2024-09-12T12:22:09.408867+0000","last_fullsized":"2024-09-12T12:22:09.408867+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:04.385168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.384570+0000","last_change":"2024-09-12T12:22:08.402702+0000","last_active":"2024-09-12T12:22:09.384570+0000","last_peered":"2024-09-12T12:22:09.384570+0000","last_clean":"2024-09-12T12:22:09.384570+0000","last_became_active":"2024-09-12T12:22:08.402433+0000","last_became_peered":"2024-09-12T12:22:08.402433+0000","last_unstale":"2024-09-12T12:22:09.384570+0000","last_undegraded":"2024-09-12T12:22:09.384570+0000","last_fullsized":"2024-09-12T12:22:09.384570+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:06.206549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.399767+0000","last_change":"2024-09-12T12:22:09.395329+0000","last_active":"2024-09-12T12:22:09.399767+0000","last_peered":"2024-09-12T12:22:09.399767+0000","last_clean":"2024-09-12T12:22:09.399767+0000","last_became_active":"2024-09-12T12:22:09.395005+0000","last_became_peered":"2024-09-12T12:22:09.395005+0000","last_unstale":"2024-09-12T12:22:09.399767+0000","last_undegraded":"2024-09-12T12:22:09.399767+0000","last_fullsized":"2024-09-12T12:22:09.399767+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:52.908509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.397771+0000","last_change":"2024-09-12T12:22:08.396371+0000","last_active":"2024-09-12T12:22:09.397771+0000","last_peered":"2024-09-12T12:22:09.397771+0000","last_clean":"2024-09-12T12:22:09.397771+0000","last_became_active":"2024-09-12T12:22:08.396015+0000","last_became_peered":"2024-09-12T12:22:08.396015+0000","last_unstale":"2024-09-12T12:22:09.397771+0000","last_undegraded":"2024-09-12T12:22:09.397771+0000","last_fullsized":"2024-09-12T12:22:09.397771+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:27.883635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418017+0000","last_change":"2024-09-12T12:22:09.412176+0000","last_active":"2024-09-12T12:22:09.418017+0000","last_peered":"2024-09-12T12:22:09.418017+0000","last_clean":"2024-09-12T12:22:09.418017+0000","last_became_active":"2024-09-12T12:22:09.411819+0000","last_became_peered":"2024-09-12T12:22:09.411819+0000","last_unstale":"2024-09-12T12:22:09.418017+0000","last_undegraded":"2024-09-12T12:22:09.418017+0000","last_fullsized":"2024-09-12T12:22:09.418017+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:52.944244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.392552+0000","last_change":"2024-09-12T12:22:08.401273+0000","last_active":"2024-09-12T12:22:09.392552+0000","last_peered":"2024-09-12T12:22:09.392552+0000","last_clean":"2024-09-12T12:22:09.392552+0000","last_became_active":"2024-09-12T12:22:08.400971+0000","last_became_peered":"2024-09-12T12:22:08.400971+0000","last_unstale":"2024-09-12T12:22:09.392552+0000","last_undegraded":"2024-09-12T12:22:09.392552+0000","last_fullsized":"2024-09-12T12:22:09.392552+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:52.319644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.399710+0000","last_change":"2024-09-12T12:22:09.391478+0000","last_active":"2024-09-12T12:22:09.399710+0000","last_peered":"2024-09-12T12:22:09.399710+0000","last_clean":"2024-09-12T12:22:09.399710+0000","last_became_active":"2024-09-12T12:22:09.391144+0000","last_became_peered":"2024-09-12T12:22:09.391144+0000","last_unstale":"2024-09-12T12:22:09.399710+0000","last_undegraded":"2024-09-12T12:22:09.399710+0000","last_fullsized":"2024-09-12T12:22:09.399710+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:56.922718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"151'6","reported_seq":18,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.419467+0000","last_change":"2024-09-12T12:22:08.402739+0000","last_active":"2024-09-12T12:22:09.419467+0000","last_peered":"2024-09-12T12:22:09.419467+0000","last_clean":"2024-09-12T12:22:09.419467+0000","last_became_active":"2024-09-12T12:22:08.402429+0000","last_became_peered":"2024-09-12T12:22:08.402429+0000","last_unstale":"2024-09-12T12:22:09.419467+0000","last_undegraded":"2024-09-12T12:22:09.419467+0000","last_fullsized":"2024-09-12T12:22:09.419467+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:34.749305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":407,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.392607+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:22:09.392607+0000","last_peered":"2024-09-12T12:22:09.392607+0000","last_clean":"2024-09-12T12:22:09.392607+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:22:09.392607+0000","last_undegraded":"2024-09-12T12:22:09.392607+0000","last_fullsized":"2024-09-12T12:22:09.392607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29456,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342384,"statfs":{"total":96636764160,"available":96606601216,"internally_reserved":0,"allocated":2473984,"data_stored":1474506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51092,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320748,"statfs":{"total":96636764160,"available":96584445952,"internally_reserved":0,"allocated":1896448,"data_stored":891375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46928,"kb_used_data":1848,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324912,"statfs":{"total":96636764160,"available":96588709888,"internally_reserved":0,"allocated":1892352,"data_stored":891305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55236,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316604,"statfs":{"total":96636764160,"available":96580202496,"internally_reserved":0,"allocated":1880064,"data_stored":884138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55232,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316608,"statfs":{"total":96636764160,"available":96580206592,"internally_reserved":0,"allocated":1880064,"data_stored":884138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55236,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316604,"statfs":{"total":96636764160,"available":96580202496,"internally_reserved":0,"allocated":1880064,"data_stored":884138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51076,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320764,"statfs":{"total":96636764160,"available":96584462336,"internally_reserved":0,"allocated":1880064,"data_stored":884138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51664,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320176,"statfs":{"total":96636764160,"available":96583860224,"internally_reserved":0,"allocated":2473984,"data_stored":1474506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:22:13.474 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:22:13.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.646+0000 7faf14200640 1 Processor -- start 2024-09-12T12:22:13.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.646+0000 7faf14200640 1 -- start start 2024-09-12T12:22:13.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf14200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7faf0c15b4e0 0x7faf0c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf14200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf0c0ccf30 0x7faf0c0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf14200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf0c0b45a0 con 0x7faf0c0b3ad0 2024-09-12T12:22:13.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf14200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faf0c0cd8a0 con 0x7faf0c0ccf30 2024-09-12T12:22:13.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf14200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7faf0c0b3fe0 con 0x7faf0c15b4e0 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf12200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf0c0ccf30 0x7faf0c0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf12200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf0c0ccf30 0x7faf0c0cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58224/0 (socket says 172.21.15.144:58224) 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf12200640 1 -- 172.21.15.144:0/1830962100 learned_addr learned my addr 172.21.15.144:0/1830962100 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf10e00640 1 --1- 172.21.15.144:0/1830962100 >> v1:172.21.15.144:6789/0 conn(0x7faf0c0b3ad0 0x7faf0c071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34848/0 (socket says 172.21.15.144:34848) 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf11800640 1 --2- 172.21.15.144:0/1830962100 >> v2:172.21.15.165:3300/0 conn(0x7faf0c15b4e0 0x7faf0c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf12200640 1 -- 172.21.15.144:0/1830962100 >> v2:172.21.15.165:3300/0 conn(0x7faf0c15b4e0 msgr2=0x7faf0c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf12200640 1 --2- 172.21.15.144:0/1830962100 >> v2:172.21.15.165:3300/0 conn(0x7faf0c15b4e0 0x7faf0c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf12200640 1 -- 172.21.15.144:0/1830962100 >> v1:172.21.15.144:6789/0 conn(0x7faf0c0b3ad0 legacy=0x7faf0c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf12200640 1 -- 172.21.15.144:0/1830962100 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c0b42c0 con 0x7faf0c0ccf30 2024-09-12T12:22:13.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.650+0000 7faf11800640 1 --2- 172.21.15.144:0/1830962100 >> v2:172.21.15.165:3300/0 conn(0x7faf0c15b4e0 0x7faf0c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:13.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf12200640 1 --2- 172.21.15.144:0/1830962100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 0x7faf0c0cd360 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7faf0c069450 tx=0x7faf0401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce38a577990f5f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:13.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf0be00640 1 -- 172.21.15.144:0/1830962100 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf040a5880 con 0x7faf0c0ccf30 2024-09-12T12:22:13.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf0be00640 1 -- 172.21.15.144:0/1830962100 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf040a5a20 con 0x7faf0c0ccf30 2024-09-12T12:22:13.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf0be00640 1 -- 172.21.15.144:0/1830962100 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf040a5df0 con 0x7faf0c0ccf30 2024-09-12T12:22:13.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 -- 172.21.15.144:0/1830962100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 msgr2=0x7faf0c0cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 --2- 172.21.15.144:0/1830962100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 0x7faf0c0cd360 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7faf0c069450 tx=0x7faf0401c9c0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 -- 172.21.15.144:0/1830962100 shutdown_connections 2024-09-12T12:22:13.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 --2- 172.21.15.144:0/1830962100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 0x7faf0c0cd360 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 --2- 172.21.15.144:0/1830962100 >> v2:172.21.15.165:3300/0 conn(0x7faf0c15b4e0 0x7faf0c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 -- 172.21.15.144:0/1830962100 >> 172.21.15.144:0/1830962100 conn(0x7faf0c06d0d0 msgr2=0x7faf0c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:13.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 -- 172.21.15.144:0/1830962100 shutdown_connections 2024-09-12T12:22:13.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 -- 172.21.15.144:0/1830962100 wait complete. 2024-09-12T12:22:13.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 Processor -- start 2024-09-12T12:22:13.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.654+0000 7faf14200640 1 -- start start 2024-09-12T12:22:13.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf14200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf0c0b3ad0 0x7faf0c164350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf14200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 0x7faf0c14c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf14200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf0c15b4e0 0x7faf0c15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf14200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c15b8c0 con 0x7faf0c0ccf30 2024-09-12T12:22:13.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf14200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c0cdef0 con 0x7faf0c0b3ad0 2024-09-12T12:22:13.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf14200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c164930 con 0x7faf0c15b4e0 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf10e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 0x7faf0c14c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf10e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 0x7faf0c14c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58236/0 (socket says 172.21.15.144:58236) 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf10e00640 1 -- 172.21.15.144:0/483360378 learned_addr learned my addr 172.21.15.144:0/483360378 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf11800640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf0c0b3ad0 0x7faf0c164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf12200640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf0c15b4e0 0x7faf0c15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf10e00640 1 -- 172.21.15.144:0/483360378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf0c15b4e0 msgr2=0x7faf0c15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf10e00640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf0c15b4e0 0x7faf0c15e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf10e00640 1 -- 172.21.15.144:0/483360378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf0c0b3ad0 msgr2=0x7faf0c164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf10e00640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf0c0b3ad0 0x7faf0c164350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf10e00640 1 -- 172.21.15.144:0/483360378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c164c10 con 0x7faf0c0ccf30 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf12200640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf0c15b4e0 0x7faf0c15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf10e00640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 0x7faf0c14c2f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7faef800c450 tx=0x7faef800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:13.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf09600640 1 -- 172.21.15.144:0/483360378 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef8017070 con 0x7faf0c0ccf30 2024-09-12T12:22:13.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf09600640 1 -- 172.21.15.144:0/483360378 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef8006480 con 0x7faf0c0ccf30 2024-09-12T12:22:13.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf09600640 1 -- 172.21.15.144:0/483360378 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef80049f0 con 0x7faf0c0ccf30 2024-09-12T12:22:13.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c164ef0 con 0x7faf0c0ccf30 2024-09-12T12:22:13.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c15ea10 con 0x7faf0c0ccf30 2024-09-12T12:22:13.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.658+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c0cd360 con 0x7faf0c0ccf30 2024-09-12T12:22:13.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.662+0000 7faf09600640 1 -- 172.21.15.144:0/483360378 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faef801a070 con 0x7faf0c0ccf30 2024-09-12T12:22:13.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.662+0000 7faf09600640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faeec0678c0 0x7faeec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:13.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.662+0000 7faf09600640 1 -- 172.21.15.144:0/483360378 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7faef8085110 con 0x7faf0c0ccf30 2024-09-12T12:22:13.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.662+0000 7faf11800640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faeec0678c0 0x7faeec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:13.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.662+0000 7faf11800640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faeec0678c0 0x7faeec069d80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7faf00006fd0 tx=0x7faf00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.666+0000 7faf09600640 1 -- 172.21.15.144:0/483360378 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faef8055ab0 con 0x7faf0c0ccf30 2024-09-12T12:22:13.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.822+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf0c15ac00 con 0x7faeec0678c0 2024-09-12T12:22:13.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.830+0000 7faf09600640 1 -- 172.21.15.144:0/483360378 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252416 (secure 0 0 0) 0x7faf0c15ac00 con 0x7faeec0678c0 2024-09-12T12:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:13.834 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:22:13.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faeec0678c0 msgr2=0x7faeec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faeec0678c0 0x7faeec069d80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7faf00006fd0 tx=0x7faf00008040 comp rx=0 tx=0).stop 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 msgr2=0x7faf0c14c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 0x7faf0c14c2f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7faef800c450 tx=0x7faef800c910 comp rx=0 tx=0).stop 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 shutdown_connections 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faeec0678c0 0x7faeec069d80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf0c15b4e0 0x7faf0c15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf0c0ccf30 0x7faf0c14c2f0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 --2- 172.21.15.144:0/483360378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf0c0b3ad0 0x7faf0c164350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 >> 172.21.15.144:0/483360378 conn(0x7faf0c06d0d0 msgr2=0x7faf0c0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 shutdown_connections 2024-09-12T12:22:13.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:13.834+0000 7faf14200640 1 -- 172.21.15.144:0/483360378 wait complete. 2024-09-12T12:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2024-09-12T12:22:13.497176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":395920,"kb_used_data":15876,"kb_used_omap":12,"kb_used_meta":379827,"kb_avail":754578800,"statfs":{"total":773094113280,"available":772688691200,"internally_reserved":0,"allocated":16257024,"data_stored":8268244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":388943409},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001086"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418087+0000","last_change":"2024-09-12T12:22:09.414454+0000","last_active":"2024-09-12T12:22:09.418087+0000","last_peered":"2024-09-12T12:22:09.418087+0000","last_clean":"2024-09-12T12:22:09.418087+0000","last_became_active":"2024-09-12T12:22:09.412761+0000","last_became_peered":"2024-09-12T12:22:09.412761+0000","last_unstale":"2024-09-12T12:22:09.418087+0000","last_undegraded":"2024-09-12T12:22:09.418087+0000","last_fullsized":"2024-09-12T12:22:09.418087+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:20.627412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.407913+0000","last_change":"2024-09-12T12:22:09.402847+0000","last_active":"2024-09-12T12:22:09.407913+0000","last_peered":"2024-09-12T12:22:09.407913+0000","last_clean":"2024-09-12T12:22:09.407913+0000","last_became_active":"2024-09-12T12:22:09.402564+0000","last_became_peered":"2024-09-12T12:22:09.402564+0000","last_unstale":"2024-09-12T12:22:09.407913+0000","last_undegraded":"2024-09-12T12:22:09.407913+0000","last_fullsized":"2024-09-12T12:22:09.407913+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:28.002090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.410808+0000","last_change":"2024-09-12T12:22:09.409712+0000","last_active":"2024-09-12T12:22:09.410808+0000","last_peered":"2024-09-12T12:22:09.410808+0000","last_clean":"2024-09-12T12:22:09.410808+0000","last_became_active":"2024-09-12T12:22:09.409205+0000","last_became_peered":"2024-09-12T12:22:09.409205+0000","last_unstale":"2024-09-12T12:22:09.410808+0000","last_undegraded":"2024-09-12T12:22:09.410808+0000","last_fullsized":"2024-09-12T12:22:09.410808+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:11.285579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.407073+0000","last_change":"2024-09-12T12:22:09.397545+0000","last_active":"2024-09-12T12:22:09.407073+0000","last_peered":"2024-09-12T12:22:09.407073+0000","last_clean":"2024-09-12T12:22:09.407073+0000","last_became_active":"2024-09-12T12:22:09.397199+0000","last_became_peered":"2024-09-12T12:22:09.397199+0000","last_unstale":"2024-09-12T12:22:09.407073+0000","last_undegraded":"2024-09-12T12:22:09.407073+0000","last_fullsized":"2024-09-12T12:22:09.407073+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:34.622188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417091+0000","last_change":"2024-09-12T12:22:09.410075+0000","last_active":"2024-09-12T12:22:09.417091+0000","last_peered":"2024-09-12T12:22:09.417091+0000","last_clean":"2024-09-12T12:22:09.417091+0000","last_became_active":"2024-09-12T12:22:09.405919+0000","last_became_peered":"2024-09-12T12:22:09.405919+0000","last_unstale":"2024-09-12T12:22:09.417091+0000","last_undegraded":"2024-09-12T12:22:09.417091+0000","last_fullsized":"2024-09-12T12:22:09.417091+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:27.432063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416905+0000","last_change":"2024-09-12T12:22:09.407071+0000","last_active":"2024-09-12T12:22:09.416905+0000","last_peered":"2024-09-12T12:22:09.416905+0000","last_clean":"2024-09-12T12:22:09.416905+0000","last_became_active":"2024-09-12T12:22:09.406723+0000","last_became_peered":"2024-09-12T12:22:09.406723+0000","last_unstale":"2024-09-12T12:22:09.416905+0000","last_undegraded":"2024-09-12T12:22:09.416905+0000","last_fullsized":"2024-09-12T12:22:09.416905+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:20.828679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417432+0000","last_change":"2024-09-12T12:22:09.414415+0000","last_active":"2024-09-12T12:22:09.417432+0000","last_peered":"2024-09-12T12:22:09.417432+0000","last_clean":"2024-09-12T12:22:09.417432+0000","last_became_active":"2024-09-12T12:22:09.414115+0000","last_became_peered":"2024-09-12T12:22:09.414115+0000","last_unstale":"2024-09-12T12:22:09.417432+0000","last_undegraded":"2024-09-12T12:22:09.417432+0000","last_fullsized":"2024-09-12T12:22:09.417432+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:45.126846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.412467+0000","last_change":"2024-09-12T12:22:09.406335+0000","last_active":"2024-09-12T12:22:09.412467+0000","last_peered":"2024-09-12T12:22:09.412467+0000","last_clean":"2024-09-12T12:22:09.412467+0000","last_became_active":"2024-09-12T12:22:09.405991+0000","last_became_peered":"2024-09-12T12:22:09.405991+0000","last_unstale":"2024-09-12T12:22:09.412467+0000","last_undegraded":"2024-09-12T12:22:09.412467+0000","last_fullsized":"2024-09-12T12:22:09.412467+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:51.239355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.412854+0000","last_change":"2024-09-12T12:22:09.402856+0000","last_active":"2024-09-12T12:22:09.412854+0000","last_peered":"2024-09-12T12:22:09.412854+0000","last_clean":"2024-09-12T12:22:09.412854+0000","last_became_active":"2024-09-12T12:22:09.402610+0000","last_became_peered":"2024-09-12T12:22:09.402610+0000","last_unstale":"2024-09-12T12:22:09.412854+0000","last_undegraded":"2024-09-12T12:22:09.412854+0000","last_fullsized":"2024-09-12T12:22:09.412854+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:50.090783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.406553+0000","last_change":"2024-09-12T12:22:09.398967+0000","last_active":"2024-09-12T12:22:09.406553+0000","last_peered":"2024-09-12T12:22:09.406553+0000","last_clean":"2024-09-12T12:22:09.406553+0000","last_became_active":"2024-09-12T12:22:09.398671+0000","last_became_peered":"2024-09-12T12:22:09.398671+0000","last_unstale":"2024-09-12T12:22:09.406553+0000","last_undegraded":"2024-09-12T12:22:09.406553+0000","last_fullsized":"2024-09-12T12:22:09.406553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:50.642709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.415110+0000","last_change":"2024-09-12T12:22:09.414102+0000","last_active":"2024-09-12T12:22:09.415110+0000","last_peered":"2024-09-12T12:22:09.415110+0000","last_clean":"2024-09-12T12:22:09.415110+0000","last_became_active":"2024-09-12T12:22:09.413809+0000","last_became_peered":"2024-09-12T12:22:09.413809+0000","last_unstale":"2024-09-12T12:22:09.415110+0000","last_undegraded":"2024-09-12T12:22:09.415110+0000","last_fullsized":"2024-09-12T12:22:09.415110+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:38.354057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408820+0000","last_change":"2024-09-12T12:22:09.407620+0000","last_active":"2024-09-12T12:22:09.408820+0000","last_peered":"2024-09-12T12:22:09.408820+0000","last_clean":"2024-09-12T12:22:09.408820+0000","last_became_active":"2024-09-12T12:22:09.407284+0000","last_became_peered":"2024-09-12T12:22:09.407284+0000","last_unstale":"2024-09-12T12:22:09.408820+0000","last_undegraded":"2024-09-12T12:22:09.408820+0000","last_fullsized":"2024-09-12T12:22:09.408820+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:53.322858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.411046+0000","last_change":"2024-09-12T12:22:09.397835+0000","last_active":"2024-09-12T12:22:09.411046+0000","last_peered":"2024-09-12T12:22:09.411046+0000","last_clean":"2024-09-12T12:22:09.411046+0000","last_became_active":"2024-09-12T12:22:09.397534+0000","last_became_peered":"2024-09-12T12:22:09.397534+0000","last_unstale":"2024-09-12T12:22:09.411046+0000","last_undegraded":"2024-09-12T12:22:09.411046+0000","last_fullsized":"2024-09-12T12:22:09.411046+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:52:39.734503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.410568+0000","last_change":"2024-09-12T12:22:09.409751+0000","last_active":"2024-09-12T12:22:09.410568+0000","last_peered":"2024-09-12T12:22:09.410568+0000","last_clean":"2024-09-12T12:22:09.410568+0000","last_became_active":"2024-09-12T12:22:09.408991+0000","last_became_peered":"2024-09-12T12:22:09.408991+0000","last_unstale":"2024-09-12T12:22:09.410568+0000","last_undegraded":"2024-09-12T12:22:09.410568+0000","last_fullsized":"2024-09-12T12:22:09.410568+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:41.413124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.401879+0000","last_change":"2024-09-12T12:22:09.399136+0000","last_active":"2024-09-12T12:22:09.401879+0000","last_peered":"2024-09-12T12:22:09.401879+0000","last_clean":"2024-09-12T12:22:09.401879+0000","last_became_active":"2024-09-12T12:22:09.398893+0000","last_became_peered":"2024-09-12T12:22:09.398893+0000","last_unstale":"2024-09-12T12:22:09.401879+0000","last_undegraded":"2024-09-12T12:22:09.401879+0000","last_fullsized":"2024-09-12T12:22:09.401879+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:15.980239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408198+0000","last_change":"2024-09-12T12:22:09.399416+0000","last_active":"2024-09-12T12:22:09.408198+0000","last_peered":"2024-09-12T12:22:09.408198+0000","last_clean":"2024-09-12T12:22:09.408198+0000","last_became_active":"2024-09-12T12:22:09.399146+0000","last_became_peered":"2024-09-12T12:22:09.399146+0000","last_unstale":"2024-09-12T12:22:09.408198+0000","last_undegraded":"2024-09-12T12:22:09.408198+0000","last_fullsized":"2024-09-12T12:22:09.408198+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:57.360222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.393257+0000","last_change":"2024-09-12T12:22:09.388504+0000","last_active":"2024-09-12T12:22:09.393257+0000","last_peered":"2024-09-12T12:22:09.393257+0000","last_clean":"2024-09-12T12:22:09.393257+0000","last_became_active":"2024-09-12T12:22:09.387638+0000","last_became_peered":"2024-09-12T12:22:09.387638+0000","last_unstale":"2024-09-12T12:22:09.393257+0000","last_undegraded":"2024-09-12T12:22:09.393257+0000","last_fullsized":"2024-09-12T12:22:09.393257+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:16.718938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.410238+0000","last_change":"2024-09-12T12:22:09.406889+0000","last_active":"2024-09-12T12:22:09.410238+0000","last_peered":"2024-09-12T12:22:09.410238+0000","last_clean":"2024-09-12T12:22:09.410238+0000","last_became_active":"2024-09-12T12:22:09.404016+0000","last_became_peered":"2024-09-12T12:22:09.404016+0000","last_unstale":"2024-09-12T12:22:09.410238+0000","last_undegraded":"2024-09-12T12:22:09.410238+0000","last_fullsized":"2024-09-12T12:22:09.410238+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:04.090152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417346+0000","last_change":"2024-09-12T12:22:09.413452+0000","last_active":"2024-09-12T12:22:09.417346+0000","last_peered":"2024-09-12T12:22:09.417346+0000","last_clean":"2024-09-12T12:22:09.417346+0000","last_became_active":"2024-09-12T12:22:09.413206+0000","last_became_peered":"2024-09-12T12:22:09.413206+0000","last_unstale":"2024-09-12T12:22:09.417346+0000","last_undegraded":"2024-09-12T12:22:09.417346+0000","last_fullsized":"2024-09-12T12:22:09.417346+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:16.476980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.398928+0000","last_change":"2024-09-12T12:22:09.393557+0000","last_active":"2024-09-12T12:22:09.398928+0000","last_peered":"2024-09-12T12:22:09.398928+0000","last_clean":"2024-09-12T12:22:09.398928+0000","last_became_active":"2024-09-12T12:22:09.392979+0000","last_became_peered":"2024-09-12T12:22:09.392979+0000","last_unstale":"2024-09-12T12:22:09.398928+0000","last_undegraded":"2024-09-12T12:22:09.398928+0000","last_fullsized":"2024-09-12T12:22:09.398928+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:20.828679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417224+0000","last_change":"2024-09-12T12:22:09.410075+0000","last_active":"2024-09-12T12:22:09.417224+0000","last_peered":"2024-09-12T12:22:09.417224+0000","last_clean":"2024-09-12T12:22:09.417224+0000","last_became_active":"2024-09-12T12:22:09.405907+0000","last_became_peered":"2024-09-12T12:22:09.405907+0000","last_unstale":"2024-09-12T12:22:09.417224+0000","last_undegraded":"2024-09-12T12:22:09.417224+0000","last_fullsized":"2024-09-12T12:22:09.417224+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:40.263363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416907+0000","last_change":"2024-09-12T12:22:09.414349+0000","last_active":"2024-09-12T12:22:09.416907+0000","last_peered":"2024-09-12T12:22:09.416907+0000","last_clean":"2024-09-12T12:22:09.416907+0000","last_became_active":"2024-09-12T12:22:09.412550+0000","last_became_peered":"2024-09-12T12:22:09.412550+0000","last_unstale":"2024-09-12T12:22:09.416907+0000","last_undegraded":"2024-09-12T12:22:09.416907+0000","last_fullsized":"2024-09-12T12:22:09.416907+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:28.002090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417981+0000","last_change":"2024-09-12T12:22:09.410046+0000","last_active":"2024-09-12T12:22:09.417981+0000","last_peered":"2024-09-12T12:22:09.417981+0000","last_clean":"2024-09-12T12:22:09.417981+0000","last_became_active":"2024-09-12T12:22:09.404106+0000","last_became_peered":"2024-09-12T12:22:09.404106+0000","last_unstale":"2024-09-12T12:22:09.417981+0000","last_undegraded":"2024-09-12T12:22:09.417981+0000","last_fullsized":"2024-09-12T12:22:09.417981+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:25.951500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.412456+0000","last_change":"2024-09-12T12:22:09.410761+0000","last_active":"2024-09-12T12:22:09.412456+0000","last_peered":"2024-09-12T12:22:09.412456+0000","last_clean":"2024-09-12T12:22:09.412456+0000","last_became_active":"2024-09-12T12:22:09.409150+0000","last_became_peered":"2024-09-12T12:22:09.409150+0000","last_unstale":"2024-09-12T12:22:09.412456+0000","last_undegraded":"2024-09-12T12:22:09.412456+0000","last_fullsized":"2024-09-12T12:22:09.412456+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:30.332232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.414734+0000","last_change":"2024-09-12T12:22:09.408179+0000","last_active":"2024-09-12T12:22:09.414734+0000","last_peered":"2024-09-12T12:22:09.414734+0000","last_clean":"2024-09-12T12:22:09.414734+0000","last_became_active":"2024-09-12T12:22:09.406439+0000","last_became_peered":"2024-09-12T12:22:09.406439+0000","last_unstale":"2024-09-12T12:22:09.414734+0000","last_undegraded":"2024-09-12T12:22:09.414734+0000","last_fullsized":"2024-09-12T12:22:09.414734+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:15.980239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.415437+0000","last_change":"2024-09-12T12:22:09.409085+0000","last_active":"2024-09-12T12:22:09.415437+0000","last_peered":"2024-09-12T12:22:09.415437+0000","last_clean":"2024-09-12T12:22:09.415437+0000","last_became_active":"2024-09-12T12:22:09.406252+0000","last_became_peered":"2024-09-12T12:22:09.406252+0000","last_unstale":"2024-09-12T12:22:09.415437+0000","last_undegraded":"2024-09-12T12:22:09.415437+0000","last_fullsized":"2024-09-12T12:22:09.415437+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:34.497665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417116+0000","last_change":"2024-09-12T12:22:09.410418+0000","last_active":"2024-09-12T12:22:09.417116+0000","last_peered":"2024-09-12T12:22:09.417116+0000","last_clean":"2024-09-12T12:22:09.417116+0000","last_became_active":"2024-09-12T12:22:09.410113+0000","last_became_peered":"2024-09-12T12:22:09.410113+0000","last_unstale":"2024-09-12T12:22:09.417116+0000","last_undegraded":"2024-09-12T12:22:09.417116+0000","last_fullsized":"2024-09-12T12:22:09.417116+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:21.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.402147+0000","last_change":"2024-09-12T12:22:09.397612+0000","last_active":"2024-09-12T12:22:09.402147+0000","last_peered":"2024-09-12T12:22:09.402147+0000","last_clean":"2024-09-12T12:22:09.402147+0000","last_became_active":"2024-09-12T12:22:09.397349+0000","last_became_peered":"2024-09-12T12:22:09.397349+0000","last_unstale":"2024-09-12T12:22:09.402147+0000","last_undegraded":"2024-09-12T12:22:09.402147+0000","last_fullsized":"2024-09-12T12:22:09.402147+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:11.434883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418000+0000","last_change":"2024-09-12T12:22:09.411784+0000","last_active":"2024-09-12T12:22:09.418000+0000","last_peered":"2024-09-12T12:22:09.418000+0000","last_clean":"2024-09-12T12:22:09.418000+0000","last_became_active":"2024-09-12T12:22:09.411422+0000","last_became_peered":"2024-09-12T12:22:09.411422+0000","last_unstale":"2024-09-12T12:22:09.418000+0000","last_undegraded":"2024-09-12T12:22:09.418000+0000","last_fullsized":"2024-09-12T12:22:09.418000+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:03.041677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.402663+0000","last_change":"2024-09-12T12:22:09.398222+0000","last_active":"2024-09-12T12:22:09.402663+0000","last_peered":"2024-09-12T12:22:09.402663+0000","last_clean":"2024-09-12T12:22:09.402663+0000","last_became_active":"2024-09-12T12:22:09.397951+0000","last_became_peered":"2024-09-12T12:22:09.397951+0000","last_unstale":"2024-09-12T12:22:09.402663+0000","last_undegraded":"2024-09-12T12:22:09.402663+0000","last_fullsized":"2024-09-12T12:22:09.402663+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:43.705155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416919+0000","last_change":"2024-09-12T12:22:09.407491+0000","last_active":"2024-09-12T12:22:09.416919+0000","last_peered":"2024-09-12T12:22:09.416919+0000","last_clean":"2024-09-12T12:22:09.416919+0000","last_became_active":"2024-09-12T12:22:09.407228+0000","last_became_peered":"2024-09-12T12:22:09.407228+0000","last_unstale":"2024-09-12T12:22:09.416919+0000","last_undegraded":"2024-09-12T12:22:09.416919+0000","last_fullsized":"2024-09-12T12:22:09.416919+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:23.135920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.411520+0000","last_change":"2024-09-12T12:22:09.406099+0000","last_active":"2024-09-12T12:22:09.411520+0000","last_peered":"2024-09-12T12:22:09.411520+0000","last_clean":"2024-09-12T12:22:09.411520+0000","last_became_active":"2024-09-12T12:22:09.405584+0000","last_became_peered":"2024-09-12T12:22:09.405584+0000","last_unstale":"2024-09-12T12:22:09.411520+0000","last_undegraded":"2024-09-12T12:22:09.411520+0000","last_fullsized":"2024-09-12T12:22:09.411520+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:55.965450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408648+0000","last_change":"2024-09-12T12:22:09.404883+0000","last_active":"2024-09-12T12:22:09.408648+0000","last_peered":"2024-09-12T12:22:09.408648+0000","last_clean":"2024-09-12T12:22:09.408648+0000","last_became_active":"2024-09-12T12:22:09.404618+0000","last_became_peered":"2024-09-12T12:22:09.404618+0000","last_unstale":"2024-09-12T12:22:09.408648+0000","last_undegraded":"2024-09-12T12:22:09.408648+0000","last_fullsized":"2024-09-12T12:22:09.408648+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:20.627412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"151'4","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417060+0000","last_change":"2024-09-12T12:22:08.394193+0000","last_active":"2024-09-12T12:22:09.417060+0000","last_peered":"2024-09-12T12:22:09.417060+0000","last_clean":"2024-09-12T12:22:09.417060+0000","last_became_active":"2024-09-12T12:22:08.393840+0000","last_became_peered":"2024-09-12T12:22:08.393840+0000","last_unstale":"2024-09-12T12:22:09.417060+0000","last_undegraded":"2024-09-12T12:22:09.417060+0000","last_fullsized":"2024-09-12T12:22:09.417060+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:34.749305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408581+0000","last_change":"2024-09-12T12:22:09.403135+0000","last_active":"2024-09-12T12:22:09.408581+0000","last_peered":"2024-09-12T12:22:09.408581+0000","last_clean":"2024-09-12T12:22:09.408581+0000","last_became_active":"2024-09-12T12:22:09.402834+0000","last_became_peered":"2024-09-12T12:22:09.402834+0000","last_unstale":"2024-09-12T12:22:09.408581+0000","last_undegraded":"2024-09-12T12:22:09.408581+0000","last_fullsized":"2024-09-12T12:22:09.408581+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:45.126846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.409806+0000","last_change":"2024-09-12T12:22:08.394093+0000","last_active":"2024-09-12T12:22:09.409806+0000","last_peered":"2024-09-12T12:22:09.409806+0000","last_clean":"2024-09-12T12:22:09.409806+0000","last_became_active":"2024-09-12T12:22:08.393821+0000","last_became_peered":"2024-09-12T12:22:08.393821+0000","last_unstale":"2024-09-12T12:22:09.409806+0000","last_undegraded":"2024-09-12T12:22:09.409806+0000","last_fullsized":"2024-09-12T12:22:09.409806+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:23:40.409910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.411290+0000","last_change":"2024-09-12T12:22:09.402516+0000","last_active":"2024-09-12T12:22:09.411290+0000","last_peered":"2024-09-12T12:22:09.411290+0000","last_clean":"2024-09-12T12:22:09.411290+0000","last_became_active":"2024-09-12T12:22:09.402231+0000","last_became_peered":"2024-09-12T12:22:09.402231+0000","last_unstale":"2024-09-12T12:22:09.411290+0000","last_undegraded":"2024-09-12T12:22:09.411290+0000","last_fullsized":"2024-09-12T12:22:09.411290+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:55.517190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.415830+0000","last_change":"2024-09-12T12:22:08.392398+0000","last_active":"2024-09-12T12:22:09.415830+0000","last_peered":"2024-09-12T12:22:09.415830+0000","last_clean":"2024-09-12T12:22:09.415830+0000","last_became_active":"2024-09-12T12:22:08.392061+0000","last_became_peered":"2024-09-12T12:22:08.392061+0000","last_unstale":"2024-09-12T12:22:09.415830+0000","last_undegraded":"2024-09-12T12:22:09.415830+0000","last_fullsized":"2024-09-12T12:22:09.415830+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:55:24.492237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417104+0000","last_change":"2024-09-12T12:22:09.413749+0000","last_active":"2024-09-12T12:22:09.417104+0000","last_peered":"2024-09-12T12:22:09.417104+0000","last_clean":"2024-09-12T12:22:09.417104+0000","last_became_active":"2024-09-12T12:22:09.411635+0000","last_became_peered":"2024-09-12T12:22:09.411635+0000","last_unstale":"2024-09-12T12:22:09.417104+0000","last_undegraded":"2024-09-12T12:22:09.417104+0000","last_fullsized":"2024-09-12T12:22:09.417104+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:27.900506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.409565+0000","last_change":"2024-09-12T12:22:08.401787+0000","last_active":"2024-09-12T12:22:09.409565+0000","last_peered":"2024-09-12T12:22:09.409565+0000","last_clean":"2024-09-12T12:22:09.409565+0000","last_became_active":"2024-09-12T12:22:08.401507+0000","last_became_peered":"2024-09-12T12:22:08.401507+0000","last_unstale":"2024-09-12T12:22:09.409565+0000","last_undegraded":"2024-09-12T12:22:09.409565+0000","last_fullsized":"2024-09-12T12:22:09.409565+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:31:22.399929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.391999+0000","last_change":"2024-09-12T12:22:09.387874+0000","last_active":"2024-09-12T12:22:09.391999+0000","last_peered":"2024-09-12T12:22:09.391999+0000","last_clean":"2024-09-12T12:22:09.391999+0000","last_became_active":"2024-09-12T12:22:09.387580+0000","last_became_peered":"2024-09-12T12:22:09.387580+0000","last_unstale":"2024-09-12T12:22:09.391999+0000","last_undegraded":"2024-09-12T12:22:09.391999+0000","last_fullsized":"2024-09-12T12:22:09.391999+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:31.769679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.406666+0000","last_change":"2024-09-12T12:22:08.398076+0000","last_active":"2024-09-12T12:22:09.406666+0000","last_peered":"2024-09-12T12:22:09.406666+0000","last_clean":"2024-09-12T12:22:09.406666+0000","last_became_active":"2024-09-12T12:22:08.397121+0000","last_became_peered":"2024-09-12T12:22:08.397121+0000","last_unstale":"2024-09-12T12:22:09.406666+0000","last_undegraded":"2024-09-12T12:22:09.406666+0000","last_fullsized":"2024-09-12T12:22:09.406666+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:06:07.009975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.405853+0000","last_change":"2024-09-12T12:22:09.400995+0000","last_active":"2024-09-12T12:22:09.405853+0000","last_peered":"2024-09-12T12:22:09.405853+0000","last_clean":"2024-09-12T12:22:09.405853+0000","last_became_active":"2024-09-12T12:22:09.400501+0000","last_became_peered":"2024-09-12T12:22:09.400501+0000","last_unstale":"2024-09-12T12:22:09.405853+0000","last_undegraded":"2024-09-12T12:22:09.405853+0000","last_fullsized":"2024-09-12T12:22:09.405853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:56.172592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416935+0000","last_change":"2024-09-12T12:22:08.397268+0000","last_active":"2024-09-12T12:22:09.416935+0000","last_peered":"2024-09-12T12:22:09.416935+0000","last_clean":"2024-09-12T12:22:09.416935+0000","last_became_active":"2024-09-12T12:22:08.396965+0000","last_became_peered":"2024-09-12T12:22:08.396965+0000","last_unstale":"2024-09-12T12:22:09.416935+0000","last_undegraded":"2024-09-12T12:22:09.416935+0000","last_fullsized":"2024-09-12T12:22:09.416935+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:12:26.398334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.401035+0000","last_change":"2024-09-12T12:22:09.397041+0000","last_active":"2024-09-12T12:22:09.401035+0000","last_peered":"2024-09-12T12:22:09.401035+0000","last_clean":"2024-09-12T12:22:09.401035+0000","last_became_active":"2024-09-12T12:22:09.396780+0000","last_became_peered":"2024-09-12T12:22:09.396780+0000","last_unstale":"2024-09-12T12:22:09.401035+0000","last_undegraded":"2024-09-12T12:22:09.401035+0000","last_fullsized":"2024-09-12T12:22:09.401035+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:50.879267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.397758+0000","last_change":"2024-09-12T12:22:08.387024+0000","last_active":"2024-09-12T12:22:09.397758+0000","last_peered":"2024-09-12T12:22:09.397758+0000","last_clean":"2024-09-12T12:22:09.397758+0000","last_became_active":"2024-09-12T12:22:08.386707+0000","last_became_peered":"2024-09-12T12:22:08.386707+0000","last_unstale":"2024-09-12T12:22:09.397758+0000","last_undegraded":"2024-09-12T12:22:09.397758+0000","last_fullsized":"2024-09-12T12:22:09.397758+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:31:22.399929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418131+0000","last_change":"2024-09-12T12:22:09.415029+0000","last_active":"2024-09-12T12:22:09.418131+0000","last_peered":"2024-09-12T12:22:09.418131+0000","last_clean":"2024-09-12T12:22:09.418131+0000","last_became_active":"2024-09-12T12:22:09.412568+0000","last_became_peered":"2024-09-12T12:22:09.412568+0000","last_unstale":"2024-09-12T12:22:09.418131+0000","last_undegraded":"2024-09-12T12:22:09.418131+0000","last_fullsized":"2024-09-12T12:22:09.418131+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:11.285579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.384768+0000","last_change":"2024-09-12T12:22:08.398634+0000","last_active":"2024-09-12T12:22:09.384768+0000","last_peered":"2024-09-12T12:22:09.384768+0000","last_clean":"2024-09-12T12:22:09.384768+0000","last_became_active":"2024-09-12T12:22:08.397748+0000","last_became_peered":"2024-09-12T12:22:08.397748+0000","last_unstale":"2024-09-12T12:22:09.384768+0000","last_undegraded":"2024-09-12T12:22:09.384768+0000","last_fullsized":"2024-09-12T12:22:09.384768+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:30.227310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.413360+0000","last_change":"2024-09-12T12:22:09.407447+0000","last_active":"2024-09-12T12:22:09.413360+0000","last_peered":"2024-09-12T12:22:09.413360+0000","last_clean":"2024-09-12T12:22:09.413360+0000","last_became_active":"2024-09-12T12:22:09.404529+0000","last_became_peered":"2024-09-12T12:22:09.404529+0000","last_unstale":"2024-09-12T12:22:09.413360+0000","last_undegraded":"2024-09-12T12:22:09.413360+0000","last_fullsized":"2024-09-12T12:22:09.413360+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:58:54.224131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.396127+0000","last_change":"2024-09-12T12:22:08.394317+0000","last_active":"2024-09-12T12:22:09.396127+0000","last_peered":"2024-09-12T12:22:09.396127+0000","last_clean":"2024-09-12T12:22:09.396127+0000","last_became_active":"2024-09-12T12:22:08.394060+0000","last_became_peered":"2024-09-12T12:22:08.394060+0000","last_unstale":"2024-09-12T12:22:09.396127+0000","last_undegraded":"2024-09-12T12:22:09.396127+0000","last_fullsized":"2024-09-12T12:22:09.396127+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:08:07.957390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416864+0000","last_change":"2024-09-12T12:22:09.416099+0000","last_active":"2024-09-12T12:22:09.416864+0000","last_peered":"2024-09-12T12:22:09.416864+0000","last_clean":"2024-09-12T12:22:09.416864+0000","last_became_active":"2024-09-12T12:22:09.415807+0000","last_became_peered":"2024-09-12T12:22:09.415807+0000","last_unstale":"2024-09-12T12:22:09.416864+0000","last_undegraded":"2024-09-12T12:22:09.416864+0000","last_fullsized":"2024-09-12T12:22:09.416864+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:20.170308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.399354+0000","last_change":"2024-09-12T12:22:08.398784+0000","last_active":"2024-09-12T12:22:09.399354+0000","last_peered":"2024-09-12T12:22:09.399354+0000","last_clean":"2024-09-12T12:22:09.399354+0000","last_became_active":"2024-09-12T12:22:08.398466+0000","last_became_peered":"2024-09-12T12:22:08.398466+0000","last_unstale":"2024-09-12T12:22:09.399354+0000","last_undegraded":"2024-09-12T12:22:09.399354+0000","last_fullsized":"2024-09-12T12:22:09.399354+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:49.876054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.410213+0000","last_change":"2024-09-12T12:22:09.406297+0000","last_active":"2024-09-12T12:22:09.410213+0000","last_peered":"2024-09-12T12:22:09.410213+0000","last_clean":"2024-09-12T12:22:09.410213+0000","last_became_active":"2024-09-12T12:22:09.404358+0000","last_became_peered":"2024-09-12T12:22:09.404358+0000","last_unstale":"2024-09-12T12:22:09.410213+0000","last_undegraded":"2024-09-12T12:22:09.410213+0000","last_fullsized":"2024-09-12T12:22:09.410213+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:24.623030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"151'3","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416650+0000","last_change":"2024-09-12T12:22:08.402984+0000","last_active":"2024-09-12T12:22:09.416650+0000","last_peered":"2024-09-12T12:22:09.416650+0000","last_clean":"2024-09-12T12:22:09.416650+0000","last_became_active":"2024-09-12T12:22:08.402722+0000","last_became_peered":"2024-09-12T12:22:08.402722+0000","last_unstale":"2024-09-12T12:22:09.416650+0000","last_undegraded":"2024-09-12T12:22:09.416650+0000","last_fullsized":"2024-09-12T12:22:09.416650+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:23.069468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.411496+0000","last_change":"2024-09-12T12:22:09.405516+0000","last_active":"2024-09-12T12:22:09.411496+0000","last_peered":"2024-09-12T12:22:09.411496+0000","last_clean":"2024-09-12T12:22:09.411496+0000","last_became_active":"2024-09-12T12:22:09.404264+0000","last_became_peered":"2024-09-12T12:22:09.404264+0000","last_unstale":"2024-09-12T12:22:09.411496+0000","last_undegraded":"2024-09-12T12:22:09.411496+0000","last_fullsized":"2024-09-12T12:22:09.411496+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:32.259886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417177+0000","last_change":"2024-09-12T12:22:08.396221+0000","last_active":"2024-09-12T12:22:09.417177+0000","last_peered":"2024-09-12T12:22:09.417177+0000","last_clean":"2024-09-12T12:22:09.417177+0000","last_became_active":"2024-09-12T12:22:08.394676+0000","last_became_peered":"2024-09-12T12:22:08.394676+0000","last_unstale":"2024-09-12T12:22:09.417177+0000","last_undegraded":"2024-09-12T12:22:09.417177+0000","last_fullsized":"2024-09-12T12:22:09.417177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:58.365392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.401851+0000","last_change":"2024-09-12T12:22:09.397404+0000","last_active":"2024-09-12T12:22:09.401851+0000","last_peered":"2024-09-12T12:22:09.401851+0000","last_clean":"2024-09-12T12:22:09.401851+0000","last_became_active":"2024-09-12T12:22:09.397158+0000","last_became_peered":"2024-09-12T12:22:09.397158+0000","last_unstale":"2024-09-12T12:22:09.401851+0000","last_undegraded":"2024-09-12T12:22:09.401851+0000","last_fullsized":"2024-09-12T12:22:09.401851+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:28.889997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.382664+0000","last_change":"2024-09-12T12:22:08.395776+0000","last_active":"2024-09-12T12:22:09.382664+0000","last_peered":"2024-09-12T12:22:09.382664+0000","last_clean":"2024-09-12T12:22:09.382664+0000","last_became_active":"2024-09-12T12:22:08.395509+0000","last_became_peered":"2024-09-12T12:22:08.395509+0000","last_unstale":"2024-09-12T12:22:09.382664+0000","last_undegraded":"2024-09-12T12:22:09.382664+0000","last_fullsized":"2024-09-12T12:22:09.382664+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:19.624198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.407673+0000","last_change":"2024-09-12T12:22:09.402638+0000","last_active":"2024-09-12T12:22:09.407673+0000","last_peered":"2024-09-12T12:22:09.407673+0000","last_clean":"2024-09-12T12:22:09.407673+0000","last_became_active":"2024-09-12T12:22:09.402384+0000","last_became_peered":"2024-09-12T12:22:09.402384+0000","last_unstale":"2024-09-12T12:22:09.407673+0000","last_undegraded":"2024-09-12T12:22:09.407673+0000","last_fullsized":"2024-09-12T12:22:09.407673+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:35.873808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.382977+0000","last_change":"2024-09-12T12:22:08.397393+0000","last_active":"2024-09-12T12:22:09.382977+0000","last_peered":"2024-09-12T12:22:09.382977+0000","last_clean":"2024-09-12T12:22:09.382977+0000","last_became_active":"2024-09-12T12:22:08.397116+0000","last_became_peered":"2024-09-12T12:22:08.397116+0000","last_unstale":"2024-09-12T12:22:09.382977+0000","last_undegraded":"2024-09-12T12:22:09.382977+0000","last_fullsized":"2024-09-12T12:22:09.382977+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:10.282365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.413985+0000","last_change":"2024-09-12T12:22:09.412980+0000","last_active":"2024-09-12T12:22:09.413985+0000","last_peered":"2024-09-12T12:22:09.413985+0000","last_clean":"2024-09-12T12:22:09.413985+0000","last_became_active":"2024-09-12T12:22:09.412695+0000","last_became_peered":"2024-09-12T12:22:09.412695+0000","last_unstale":"2024-09-12T12:22:09.413985+0000","last_undegraded":"2024-09-12T12:22:09.413985+0000","last_fullsized":"2024-09-12T12:22:09.413985+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:16.718938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"151'8","reported_seq":20,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417755+0000","last_change":"2024-09-12T12:22:08.388172+0000","last_active":"2024-09-12T12:22:09.417755+0000","last_peered":"2024-09-12T12:22:09.417755+0000","last_clean":"2024-09-12T12:22:09.417755+0000","last_became_active":"2024-09-12T12:22:08.387866+0000","last_became_peered":"2024-09-12T12:22:08.387866+0000","last_unstale":"2024-09-12T12:22:09.417755+0000","last_undegraded":"2024-09-12T12:22:09.417755+0000","last_fullsized":"2024-09-12T12:22:09.417755+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:51.905295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416121+0000","last_change":"2024-09-12T12:22:09.409349+0000","last_active":"2024-09-12T12:22:09.416121+0000","last_peered":"2024-09-12T12:22:09.416121+0000","last_clean":"2024-09-12T12:22:09.416121+0000","last_became_active":"2024-09-12T12:22:09.409085+0000","last_became_peered":"2024-09-12T12:22:09.409085+0000","last_unstale":"2024-09-12T12:22:09.416121+0000","last_undegraded":"2024-09-12T12:22:09.416121+0000","last_fullsized":"2024-09-12T12:22:09.416121+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:40.303043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417737+0000","last_change":"2024-09-12T12:22:08.400163+0000","last_active":"2024-09-12T12:22:09.417737+0000","last_peered":"2024-09-12T12:22:09.417737+0000","last_clean":"2024-09-12T12:22:09.417737+0000","last_became_active":"2024-09-12T12:22:08.399867+0000","last_became_peered":"2024-09-12T12:22:08.399867+0000","last_unstale":"2024-09-12T12:22:09.417737+0000","last_undegraded":"2024-09-12T12:22:09.417737+0000","last_fullsized":"2024-09-12T12:22:09.417737+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:56.274322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417365+0000","last_change":"2024-09-12T12:22:09.415166+0000","last_active":"2024-09-12T12:22:09.417365+0000","last_peered":"2024-09-12T12:22:09.417365+0000","last_clean":"2024-09-12T12:22:09.417365+0000","last_became_active":"2024-09-12T12:22:09.414773+0000","last_became_peered":"2024-09-12T12:22:09.414773+0000","last_unstale":"2024-09-12T12:22:09.417365+0000","last_undegraded":"2024-09-12T12:22:09.417365+0000","last_fullsized":"2024-09-12T12:22:09.417365+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:43:55.516002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.409755+0000","last_change":"2024-09-12T12:22:08.399242+0000","last_active":"2024-09-12T12:22:09.409755+0000","last_peered":"2024-09-12T12:22:09.409755+0000","last_clean":"2024-09-12T12:22:09.409755+0000","last_became_active":"2024-09-12T12:22:08.398954+0000","last_became_peered":"2024-09-12T12:22:08.398954+0000","last_unstale":"2024-09-12T12:22:09.409755+0000","last_undegraded":"2024-09-12T12:22:09.409755+0000","last_fullsized":"2024-09-12T12:22:09.409755+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:03.027136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418823+0000","last_change":"2024-09-12T12:22:09.417841+0000","last_active":"2024-09-12T12:22:09.418823+0000","last_peered":"2024-09-12T12:22:09.418823+0000","last_clean":"2024-09-12T12:22:09.418823+0000","last_became_active":"2024-09-12T12:22:09.416794+0000","last_became_peered":"2024-09-12T12:22:09.416794+0000","last_unstale":"2024-09-12T12:22:09.418823+0000","last_undegraded":"2024-09-12T12:22:09.418823+0000","last_fullsized":"2024-09-12T12:22:09.418823+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:34.622188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"151'1","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.407870+0000","last_change":"2024-09-12T12:22:08.397706+0000","last_active":"2024-09-12T12:22:09.407870+0000","last_peered":"2024-09-12T12:22:09.407870+0000","last_clean":"2024-09-12T12:22:09.407870+0000","last_became_active":"2024-09-12T12:22:08.397445+0000","last_became_peered":"2024-09-12T12:22:08.397445+0000","last_unstale":"2024-09-12T12:22:09.407870+0000","last_undegraded":"2024-09-12T12:22:09.407870+0000","last_fullsized":"2024-09-12T12:22:09.407870+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:51.941031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.414711+0000","last_change":"2024-09-12T12:22:09.407932+0000","last_active":"2024-09-12T12:22:09.414711+0000","last_peered":"2024-09-12T12:22:09.414711+0000","last_clean":"2024-09-12T12:22:09.414711+0000","last_became_active":"2024-09-12T12:22:09.406116+0000","last_became_peered":"2024-09-12T12:22:09.406116+0000","last_unstale":"2024-09-12T12:22:09.414711+0000","last_undegraded":"2024-09-12T12:22:09.414711+0000","last_fullsized":"2024-09-12T12:22:09.414711+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:16.652604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.382309+0000","last_change":"2024-09-12T12:22:08.401548+0000","last_active":"2024-09-12T12:22:09.382309+0000","last_peered":"2024-09-12T12:22:09.382309+0000","last_clean":"2024-09-12T12:22:09.382309+0000","last_became_active":"2024-09-12T12:22:08.401281+0000","last_became_peered":"2024-09-12T12:22:08.401281+0000","last_unstale":"2024-09-12T12:22:09.382309+0000","last_undegraded":"2024-09-12T12:22:09.382309+0000","last_fullsized":"2024-09-12T12:22:09.382309+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:44.123632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.417000+0000","last_change":"2024-09-12T12:22:09.411055+0000","last_active":"2024-09-12T12:22:09.417000+0000","last_peered":"2024-09-12T12:22:09.417000+0000","last_clean":"2024-09-12T12:22:09.417000+0000","last_became_active":"2024-09-12T12:22:09.408206+0000","last_became_peered":"2024-09-12T12:22:09.408206+0000","last_unstale":"2024-09-12T12:22:09.417000+0000","last_undegraded":"2024-09-12T12:22:09.417000+0000","last_fullsized":"2024-09-12T12:22:09.417000+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:12.644654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.413191+0000","last_change":"2024-09-12T12:22:08.399392+0000","last_active":"2024-09-12T12:22:09.413191+0000","last_peered":"2024-09-12T12:22:09.413191+0000","last_clean":"2024-09-12T12:22:09.413191+0000","last_became_active":"2024-09-12T12:22:08.399013+0000","last_became_peered":"2024-09-12T12:22:08.399013+0000","last_unstale":"2024-09-12T12:22:09.413191+0000","last_undegraded":"2024-09-12T12:22:09.413191+0000","last_fullsized":"2024-09-12T12:22:09.413191+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:34.870594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.405855+0000","last_change":"2024-09-12T12:22:09.400826+0000","last_active":"2024-09-12T12:22:09.405855+0000","last_peered":"2024-09-12T12:22:09.405855+0000","last_clean":"2024-09-12T12:22:09.405855+0000","last_became_active":"2024-09-12T12:22:09.400551+0000","last_became_peered":"2024-09-12T12:22:09.400551+0000","last_unstale":"2024-09-12T12:22:09.405855+0000","last_undegraded":"2024-09-12T12:22:09.405855+0000","last_fullsized":"2024-09-12T12:22:09.405855+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:34.497665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.385855+0000","last_change":"2024-09-12T12:22:08.398047+0000","last_active":"2024-09-12T12:22:09.385855+0000","last_peered":"2024-09-12T12:22:09.385855+0000","last_clean":"2024-09-12T12:22:09.385855+0000","last_became_active":"2024-09-12T12:22:08.397533+0000","last_became_peered":"2024-09-12T12:22:08.397533+0000","last_unstale":"2024-09-12T12:22:09.385855+0000","last_undegraded":"2024-09-12T12:22:09.385855+0000","last_fullsized":"2024-09-12T12:22:09.385855+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:51.447080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.415857+0000","last_change":"2024-09-12T12:22:09.408720+0000","last_active":"2024-09-12T12:22:09.415857+0000","last_peered":"2024-09-12T12:22:09.415857+0000","last_clean":"2024-09-12T12:22:09.415857+0000","last_became_active":"2024-09-12T12:22:09.404530+0000","last_became_peered":"2024-09-12T12:22:09.404530+0000","last_unstale":"2024-09-12T12:22:09.415857+0000","last_undegraded":"2024-09-12T12:22:09.415857+0000","last_fullsized":"2024-09-12T12:22:09.415857+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:52.585101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.380400+0000","last_change":"2024-09-12T12:22:08.395900+0000","last_active":"2024-09-12T12:22:09.380400+0000","last_peered":"2024-09-12T12:22:09.380400+0000","last_clean":"2024-09-12T12:22:09.380400+0000","last_became_active":"2024-09-12T12:22:08.395274+0000","last_became_peered":"2024-09-12T12:22:08.395274+0000","last_unstale":"2024-09-12T12:22:09.380400+0000","last_undegraded":"2024-09-12T12:22:09.380400+0000","last_fullsized":"2024-09-12T12:22:09.380400+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:49.087569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.403258+0000","last_change":"2024-09-12T12:22:09.398585+0000","last_active":"2024-09-12T12:22:09.403258+0000","last_peered":"2024-09-12T12:22:09.403258+0000","last_clean":"2024-09-12T12:22:09.403258+0000","last_became_active":"2024-09-12T12:22:09.398323+0000","last_became_peered":"2024-09-12T12:22:09.398323+0000","last_unstale":"2024-09-12T12:22:09.403258+0000","last_undegraded":"2024-09-12T12:22:09.403258+0000","last_fullsized":"2024-09-12T12:22:09.403258+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:16.652604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.383493+0000","last_change":"2024-09-12T12:22:08.398338+0000","last_active":"2024-09-12T12:22:09.383493+0000","last_peered":"2024-09-12T12:22:09.383493+0000","last_clean":"2024-09-12T12:22:09.383493+0000","last_became_active":"2024-09-12T12:22:08.396709+0000","last_became_peered":"2024-09-12T12:22:08.396709+0000","last_unstale":"2024-09-12T12:22:09.383493+0000","last_undegraded":"2024-09-12T12:22:09.383493+0000","last_fullsized":"2024-09-12T12:22:09.383493+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:23.002498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416869+0000","last_change":"2024-09-12T12:22:09.406979+0000","last_active":"2024-09-12T12:22:09.416869+0000","last_peered":"2024-09-12T12:22:09.416869+0000","last_clean":"2024-09-12T12:22:09.416869+0000","last_became_active":"2024-09-12T12:22:09.406425+0000","last_became_peered":"2024-09-12T12:22:09.406425+0000","last_unstale":"2024-09-12T12:22:09.416869+0000","last_undegraded":"2024-09-12T12:22:09.416869+0000","last_fullsized":"2024-09-12T12:22:09.416869+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:31.769679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"151'2","reported_seq":14,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.403683+0000","last_change":"2024-09-12T12:22:08.401957+0000","last_active":"2024-09-12T12:22:09.403683+0000","last_peered":"2024-09-12T12:22:09.403683+0000","last_clean":"2024-09-12T12:22:09.403683+0000","last_became_active":"2024-09-12T12:22:08.401674+0000","last_became_peered":"2024-09-12T12:22:08.401674+0000","last_unstale":"2024-09-12T12:22:09.403683+0000","last_undegraded":"2024-09-12T12:22:09.403683+0000","last_fullsized":"2024-09-12T12:22:09.403683+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:26.998876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.416524+0000","last_change":"2024-09-12T12:22:09.412231+0000","last_active":"2024-09-12T12:22:09.416524+0000","last_peered":"2024-09-12T12:22:09.416524+0000","last_clean":"2024-09-12T12:22:09.416524+0000","last_became_active":"2024-09-12T12:22:09.411952+0000","last_became_peered":"2024-09-12T12:22:09.411952+0000","last_unstale":"2024-09-12T12:22:09.416524+0000","last_undegraded":"2024-09-12T12:22:09.416524+0000","last_fullsized":"2024-09-12T12:22:09.416524+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:04.030350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.399509+0000","last_change":"2024-09-12T12:22:08.388752+0000","last_active":"2024-09-12T12:22:09.399509+0000","last_peered":"2024-09-12T12:22:09.399509+0000","last_clean":"2024-09-12T12:22:09.399509+0000","last_became_active":"2024-09-12T12:22:08.388445+0000","last_became_peered":"2024-09-12T12:22:08.388445+0000","last_unstale":"2024-09-12T12:22:09.399509+0000","last_undegraded":"2024-09-12T12:22:09.399509+0000","last_fullsized":"2024-09-12T12:22:09.399509+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:27.886783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418464+0000","last_change":"2024-09-12T12:22:09.415035+0000","last_active":"2024-09-12T12:22:09.418464+0000","last_peered":"2024-09-12T12:22:09.418464+0000","last_clean":"2024-09-12T12:22:09.418464+0000","last_became_active":"2024-09-12T12:22:09.414765+0000","last_became_peered":"2024-09-12T12:22:09.414765+0000","last_unstale":"2024-09-12T12:22:09.418464+0000","last_undegraded":"2024-09-12T12:22:09.418464+0000","last_fullsized":"2024-09-12T12:22:09.418464+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:16.718938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.390159+0000","last_change":"2024-09-12T12:22:08.399922+0000","last_active":"2024-09-12T12:22:09.390159+0000","last_peered":"2024-09-12T12:22:09.390159+0000","last_clean":"2024-09-12T12:22:09.390159+0000","last_became_active":"2024-09-12T12:22:08.399521+0000","last_became_peered":"2024-09-12T12:22:08.399521+0000","last_unstale":"2024-09-12T12:22:09.390159+0000","last_undegraded":"2024-09-12T12:22:09.390159+0000","last_fullsized":"2024-09-12T12:22:09.390159+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:27.883635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.406151+0000","last_change":"2024-09-12T12:22:09.401971+0000","last_active":"2024-09-12T12:22:09.406151+0000","last_peered":"2024-09-12T12:22:09.406151+0000","last_clean":"2024-09-12T12:22:09.406151+0000","last_became_active":"2024-09-12T12:22:09.400197+0000","last_became_peered":"2024-09-12T12:22:09.400197+0000","last_unstale":"2024-09-12T12:22:09.406151+0000","last_undegraded":"2024-09-12T12:22:09.406151+0000","last_fullsized":"2024-09-12T12:22:09.406151+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:02.286177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.401560+0000","last_change":"2024-09-12T12:22:08.404822+0000","last_active":"2024-09-12T12:22:09.401560+0000","last_peered":"2024-09-12T12:22:09.401560+0000","last_clean":"2024-09-12T12:22:09.401560+0000","last_became_active":"2024-09-12T12:22:08.404494+0000","last_became_peered":"2024-09-12T12:22:08.404494+0000","last_unstale":"2024-09-12T12:22:09.401560+0000","last_undegraded":"2024-09-12T12:22:09.401560+0000","last_fullsized":"2024-09-12T12:22:09.401560+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:08.616413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.403992+0000","last_change":"2024-09-12T12:22:09.392317+0000","last_active":"2024-09-12T12:22:09.403992+0000","last_peered":"2024-09-12T12:22:09.403992+0000","last_clean":"2024-09-12T12:22:09.403992+0000","last_became_active":"2024-09-12T12:22:09.391938+0000","last_became_peered":"2024-09-12T12:22:09.391938+0000","last_unstale":"2024-09-12T12:22:09.403992+0000","last_undegraded":"2024-09-12T12:22:09.403992+0000","last_fullsized":"2024-09-12T12:22:09.403992+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:39.710427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.397553+0000","last_change":"2024-09-12T12:22:08.397496+0000","last_active":"2024-09-12T12:22:09.397553+0000","last_peered":"2024-09-12T12:22:09.397553+0000","last_clean":"2024-09-12T12:22:09.397553+0000","last_became_active":"2024-09-12T12:22:08.397144+0000","last_became_peered":"2024-09-12T12:22:08.397144+0000","last_unstale":"2024-09-12T12:22:09.397553+0000","last_undegraded":"2024-09-12T12:22:09.397553+0000","last_fullsized":"2024-09-12T12:22:09.397553+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:51.941031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.408867+0000","last_change":"2024-09-12T12:22:09.403777+0000","last_active":"2024-09-12T12:22:09.408867+0000","last_peered":"2024-09-12T12:22:09.408867+0000","last_clean":"2024-09-12T12:22:09.408867+0000","last_became_active":"2024-09-12T12:22:09.403490+0000","last_became_peered":"2024-09-12T12:22:09.403490+0000","last_unstale":"2024-09-12T12:22:09.408867+0000","last_undegraded":"2024-09-12T12:22:09.408867+0000","last_fullsized":"2024-09-12T12:22:09.408867+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:04.385168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.384570+0000","last_change":"2024-09-12T12:22:08.402702+0000","last_active":"2024-09-12T12:22:09.384570+0000","last_peered":"2024-09-12T12:22:09.384570+0000","last_clean":"2024-09-12T12:22:09.384570+0000","last_became_active":"2024-09-12T12:22:08.402433+0000","last_became_peered":"2024-09-12T12:22:08.402433+0000","last_unstale":"2024-09-12T12:22:09.384570+0000","last_undegraded":"2024-09-12T12:22:09.384570+0000","last_fullsized":"2024-09-12T12:22:09.384570+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:06.206549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.399767+0000","last_change":"2024-09-12T12:22:09.395329+0000","last_active":"2024-09-12T12:22:09.399767+0000","last_peered":"2024-09-12T12:22:09.399767+0000","last_clean":"2024-09-12T12:22:09.399767+0000","last_became_active":"2024-09-12T12:22:09.395005+0000","last_became_peered":"2024-09-12T12:22:09.395005+0000","last_unstale":"2024-09-12T12:22:09.399767+0000","last_undegraded":"2024-09-12T12:22:09.399767+0000","last_fullsized":"2024-09-12T12:22:09.399767+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:35:52.908509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.397771+0000","last_change":"2024-09-12T12:22:08.396371+0000","last_active":"2024-09-12T12:22:09.397771+0000","last_peered":"2024-09-12T12:22:09.397771+0000","last_clean":"2024-09-12T12:22:09.397771+0000","last_became_active":"2024-09-12T12:22:08.396015+0000","last_became_peered":"2024-09-12T12:22:08.396015+0000","last_unstale":"2024-09-12T12:22:09.397771+0000","last_undegraded":"2024-09-12T12:22:09.397771+0000","last_fullsized":"2024-09-12T12:22:09.397771+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:27.883635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.418017+0000","last_change":"2024-09-12T12:22:09.412176+0000","last_active":"2024-09-12T12:22:09.418017+0000","last_peered":"2024-09-12T12:22:09.418017+0000","last_clean":"2024-09-12T12:22:09.418017+0000","last_became_active":"2024-09-12T12:22:09.411819+0000","last_became_peered":"2024-09-12T12:22:09.411819+0000","last_unstale":"2024-09-12T12:22:09.418017+0000","last_undegraded":"2024-09-12T12:22:09.418017+0000","last_fullsized":"2024-09-12T12:22:09.418017+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:01:52.944244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.392552+0000","last_change":"2024-09-12T12:22:08.401273+0000","last_active":"2024-09-12T12:22:09.392552+0000","last_peered":"2024-09-12T12:22:09.392552+0000","last_clean":"2024-09-12T12:22:09.392552+0000","last_became_active":"2024-09-12T12:22:08.400971+0000","last_became_peered":"2024-09-12T12:22:08.400971+0000","last_unstale":"2024-09-12T12:22:09.392552+0000","last_undegraded":"2024-09-12T12:22:09.392552+0000","last_fullsized":"2024-09-12T12:22:09.392552+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:52.319644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.399710+0000","last_change":"2024-09-12T12:22:09.391478+0000","last_active":"2024-09-12T12:22:09.399710+0000","last_peered":"2024-09-12T12:22:09.399710+0000","last_clean":"2024-09-12T12:22:09.399710+0000","last_became_active":"2024-09-12T12:22:09.391144+0000","last_became_peered":"2024-09-12T12:22:09.391144+0000","last_unstale":"2024-09-12T12:22:09.399710+0000","last_undegraded":"2024-09-12T12:22:09.399710+0000","last_fullsized":"2024-09-12T12:22:09.399710+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:08.367987+0000","last_clean_scrub_stamp":"2024-09-12T12:22:08.367987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:56.922718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"151'6","reported_seq":18,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.419467+0000","last_change":"2024-09-12T12:22:08.402739+0000","last_active":"2024-09-12T12:22:09.419467+0000","last_peered":"2024-09-12T12:22:09.419467+0000","last_clean":"2024-09-12T12:22:09.419467+0000","last_became_active":"2024-09-12T12:22:08.402429+0000","last_became_peered":"2024-09-12T12:22:08.402429+0000","last_unstale":"2024-09-12T12:22:09.419467+0000","last_undegraded":"2024-09-12T12:22:09.419467+0000","last_fullsized":"2024-09-12T12:22:09.419467+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:22:07.364773+0000","last_clean_scrub_stamp":"2024-09-12T12:22:07.364773+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:34.749305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":407,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-12T12:22:09.392607+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:22:09.392607+0000","last_peered":"2024-09-12T12:22:09.392607+0000","last_clean":"2024-09-12T12:22:09.392607+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:22:09.392607+0000","last_undegraded":"2024-09-12T12:22:09.392607+0000","last_fullsized":"2024-09-12T12:22:09.392607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29456,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342384,"statfs":{"total":96636764160,"available":96606601216,"internally_reserved":0,"allocated":2473984,"data_stored":1474506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574966,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51092,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320748,"statfs":{"total":96636764160,"available":96584445952,"internally_reserved":0,"allocated":1896448,"data_stored":891375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46928,"kb_used_data":1848,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324912,"statfs":{"total":96636764160,"available":96588709888,"internally_reserved":0,"allocated":1892352,"data_stored":891305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55236,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316604,"statfs":{"total":96636764160,"available":96580202496,"internally_reserved":0,"allocated":1880064,"data_stored":884138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55232,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316608,"statfs":{"total":96636764160,"available":96580206592,"internally_reserved":0,"allocated":1880064,"data_stored":884138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55236,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316604,"statfs":{"total":96636764160,"available":96580202496,"internally_reserved":0,"allocated":1880064,"data_stored":884138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51076,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320764,"statfs":{"total":96636764160,"available":96584462336,"internally_reserved":0,"allocated":1880064,"data_stored":884138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51664,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320176,"statfs":{"total":96636764160,"available":96583860224,"internally_reserved":0,"allocated":2473984,"data_stored":1474506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:22:13.857 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:22:13.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:22:14.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71f6a00640 1 Processor -- start 2024-09-12T12:22:14.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71f6a00640 1 -- start start 2024-09-12T12:22:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71f6a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f71f00b1c70 0x7f71f006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71f6a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f00730b0 con 0x7f71f00d1710 2024-09-12T12:22:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71f6a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f0073390 con 0x7f71f006e9e0 2024-09-12T12:22:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71f6a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f71f0073670 con 0x7f71f00b1c70 2024-09-12T12:22:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71efe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f71f00d1710 0x7f71f00d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34850/0 (socket says 172.21.15.144:34850) 2024-09-12T12:22:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71efe00640 1 -- 172.21.15.144:0/900092925 learned_addr learned my addr 172.21.15.144:0/900092925 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71e7400640 1 --2- 172.21.15.144:0/900092925 >> v2:172.21.15.165:3300/0 conn(0x7f71f00b1c70 0x7f71f006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71ef400640 1 -- 172.21.15.144:0/900092925 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249527320 0 0) 0x7f71f00730b0 con 0x7f71f00d1710 2024-09-12T12:22:14.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71ef400640 1 -- 172.21.15.144:0/900092925 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d4003530 con 0x7f71f00d1710 2024-09-12T12:22:14.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71e7400640 1 -- 172.21.15.144:0/900092925 >> v1:172.21.15.165:6789/0 conn(0x7f71f006e9e0 legacy=0x7f71f0070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71e7400640 1 -- 172.21.15.144:0/900092925 >> v1:172.21.15.144:6789/0 conn(0x7f71f00d1710 legacy=0x7f71f00d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.038+0000 7f71e7400640 1 -- 172.21.15.144:0/900092925 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0073950 con 0x7f71f00b1c70 2024-09-12T12:22:14.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71e7400640 1 --2- 172.21.15.144:0/900092925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71f00b1c70 0x7f71f006e4a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f71d80097c0 tx=0x7f71d801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8385ba49f2fe09d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:14.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71ef400640 1 -- 172.21.15.144:0/900092925 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d80ab600 con 0x7f71f00b1c70 2024-09-12T12:22:14.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71ef400640 1 -- 172.21.15.144:0/900092925 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d80b0070 con 0x7f71f00b1c70 2024-09-12T12:22:14.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71ef400640 1 -- 172.21.15.144:0/900092925 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d80ab9c0 con 0x7f71f00b1c70 2024-09-12T12:22:14.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71f6a00640 1 -- 172.21.15.144:0/900092925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71f00b1c70 msgr2=0x7f71f006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71f6a00640 1 --2- 172.21.15.144:0/900092925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71f00b1c70 0x7f71f006e4a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f71d80097c0 tx=0x7f71d801c3e0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71f6a00640 1 -- 172.21.15.144:0/900092925 shutdown_connections 2024-09-12T12:22:14.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71f6a00640 1 --2- 172.21.15.144:0/900092925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71f00b1c70 0x7f71f006e4a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71f6a00640 1 -- 172.21.15.144:0/900092925 >> 172.21.15.144:0/900092925 conn(0x7f71f00d2400 msgr2=0x7f71f00d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:14.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71f6a00640 1 -- 172.21.15.144:0/900092925 shutdown_connections 2024-09-12T12:22:14.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.042+0000 7f71f6a00640 1 -- 172.21.15.144:0/900092925 wait complete. 2024-09-12T12:22:14.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 Processor -- start 2024-09-12T12:22:14.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 -- start start 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71f006e9e0 0x7f71f0153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f00d1710 0x7f71f00cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71f00ccae0 0x7f71f00cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71f016c660 con 0x7f71f00d1710 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f71f016c4e0 con 0x7f71f006e9e0 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f71f016c7e0 con 0x7f71f00ccae0 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f00d1710 0x7f71f00cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f00d1710 0x7f71f00cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58248/0 (socket says 172.21.15.144:58248) 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71e7400640 1 -- 172.21.15.144:0/1669079459 learned_addr learned my addr 172.21.15.144:0/1669079459 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71efe00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71f006e9e0 0x7f71f0153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f4a00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71f00ccae0 0x7f71f00cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71e7400640 1 -- 172.21.15.144:0/1669079459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71f00ccae0 msgr2=0x7f71f00cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71e7400640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71f00ccae0 0x7f71f00cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71e7400640 1 -- 172.21.15.144:0/1669079459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71f006e9e0 msgr2=0x7f71f0153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71e7400640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71f006e9e0 0x7f71f0153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71e7400640 1 -- 172.21.15.144:0/1669079459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0154220 con 0x7f71f00d1710 2024-09-12T12:22:14.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f4a00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71f00ccae0 0x7f71f00cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:14.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71e7400640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f00d1710 0x7f71f00cc180 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f71d80ad040 tx=0x7f71d801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:14.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71ecc00640 1 -- 172.21.15.144:0/1669079459 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d80bf610 con 0x7f71f00d1710 2024-09-12T12:22:14.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71ecc00640 1 -- 172.21.15.144:0/1669079459 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d80abe50 con 0x7f71f00d1710 2024-09-12T12:22:14.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f0156cb0 con 0x7f71f00d1710 2024-09-12T12:22:14.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71ecc00640 1 -- 172.21.15.144:0/1669079459 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d80bfa30 con 0x7f71f00d1710 2024-09-12T12:22:14.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.046+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f00ceb20 con 0x7f71f00d1710 2024-09-12T12:22:14.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.050+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f006e4a0 con 0x7f71f00d1710 2024-09-12T12:22:14.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.050+0000 7f71ecc00640 1 -- 172.21.15.144:0/1669079459 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f71d80bd020 con 0x7f71f00d1710 2024-09-12T12:22:14.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.050+0000 7f71ecc00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71cc0678c0 0x7f71cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.050+0000 7f71ecc00640 1 -- 172.21.15.144:0/1669079459 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f71d811ffb0 con 0x7f71f00d1710 2024-09-12T12:22:14.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.050+0000 7f71efe00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71cc0678c0 0x7f71cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.050+0000 7f71efe00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71cc0678c0 0x7f71cc069d80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f71e00011f0 tx=0x7f71e0007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:14.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.054+0000 7f71ecc00640 1 -- 172.21.15.144:0/1669079459 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f71d80c6070 con 0x7f71f00d1710 2024-09-12T12:22:14.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.266+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f71f0075270 con 0x7f71f00d1710 2024-09-12T12:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.270+0000 7f71ecc00640 1 -- 172.21.15.144:0/1669079459 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f71f0156cb0 con 0x7f71f00d1710 2024-09-12T12:22:14.273 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:22:14.274 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:22:14.274 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:22:14.274 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:22:14.274 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:22:14.274 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71cc0678c0 msgr2=0x7f71cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71cc0678c0 0x7f71cc069d80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f71e00011f0 tx=0x7f71e0007d40 comp rx=0 tx=0).stop 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f00d1710 msgr2=0x7f71f00cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f00d1710 0x7f71f00cc180 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f71d80ad040 tx=0x7f71d801ac20 comp rx=0 tx=0).stop 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 shutdown_connections 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71cc0678c0 0x7f71cc069d80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71f00ccae0 0x7f71f00cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71f00d1710 0x7f71f00cc180 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 --2- 172.21.15.144:0/1669079459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71f006e9e0 0x7f71f0153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 >> 172.21.15.144:0/1669079459 conn(0x7f71f00d2400 msgr2=0x7f71f006fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:14.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 shutdown_connections 2024-09-12T12:22:14.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.274+0000 7f71f6a00640 1 -- 172.21.15.144:0/1669079459 wait complete. 2024-09-12T12:22:14.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:14.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd38e400640 1 Processor -- start 2024-09-12T12:22:14.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd38e400640 1 -- start start 2024-09-12T12:22:14.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd38e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 0x7fd3880d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd38e400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3880740e0 con 0x7fd3880b6730 2024-09-12T12:22:14.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd38e400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3880d1580 con 0x7fd3880b4200 2024-09-12T12:22:14.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd38e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3880d1860 con 0x7fd38815c220 2024-09-12T12:22:14.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd387e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd3880b6730 0x7fd3880739d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34862/0 (socket says 172.21.15.144:34862) 2024-09-12T12:22:14.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd387e00640 1 -- 172.21.15.144:0/1004255412 learned_addr learned my addr 172.21.15.144:0/1004255412 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:14.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd387400640 1 --2- 172.21.15.144:0/1004255412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 0x7fd3880d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd386000640 1 -- 172.21.15.144:0/1004255412 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801924527 0 0) 0x7fd3880740e0 con 0x7fd3880b6730 2024-09-12T12:22:14.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd386000640 1 -- 172.21.15.144:0/1004255412 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd36c003530 con 0x7fd3880b6730 2024-09-12T12:22:14.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd386000640 1 -- 172.21.15.144:0/1004255412 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219955713 0 0) 0x7fd3880d1580 con 0x7fd3880b4200 2024-09-12T12:22:14.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd386000640 1 -- 172.21.15.144:0/1004255412 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3880740e0 con 0x7fd3880b4200 2024-09-12T12:22:14.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd387400640 1 -- 172.21.15.144:0/1004255412 >> v1:172.21.15.165:6789/0 conn(0x7fd3880b4200 legacy=0x7fd3880732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd387400640 1 -- 172.21.15.144:0/1004255412 >> v1:172.21.15.144:6789/0 conn(0x7fd3880b6730 legacy=0x7fd3880739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.430+0000 7fd387400640 1 -- 172.21.15.144:0/1004255412 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3880d1b40 con 0x7fd38815c220 2024-09-12T12:22:14.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd387400640 1 --2- 172.21.15.144:0/1004255412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 0x7fd3880d0c10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd3780097f0 tx=0x7fd37801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e4aeb1f97fabe92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:14.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd386000640 1 -- 172.21.15.144:0/1004255412 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780aa610 con 0x7fd38815c220 2024-09-12T12:22:14.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd386000640 1 -- 172.21.15.144:0/1004255412 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3780af070 con 0x7fd38815c220 2024-09-12T12:22:14.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd386000640 1 -- 172.21.15.144:0/1004255412 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780aa9b0 con 0x7fd38815c220 2024-09-12T12:22:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd38e400640 1 -- 172.21.15.144:0/1004255412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 msgr2=0x7fd3880d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd38e400640 1 --2- 172.21.15.144:0/1004255412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 0x7fd3880d0c10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd3780097f0 tx=0x7fd37801c4b0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd38e400640 1 -- 172.21.15.144:0/1004255412 shutdown_connections 2024-09-12T12:22:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd38e400640 1 --2- 172.21.15.144:0/1004255412 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 0x7fd3880d0c10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd38e400640 1 -- 172.21.15.144:0/1004255412 >> 172.21.15.144:0/1004255412 conn(0x7fd38806f400 msgr2=0x7fd38806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd38e400640 1 -- 172.21.15.144:0/1004255412 shutdown_connections 2024-09-12T12:22:14.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.434+0000 7fd38e400640 1 -- 172.21.15.144:0/1004255412 wait complete. 2024-09-12T12:22:14.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 Processor -- start 2024-09-12T12:22:14.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 -- start start 2024-09-12T12:22:14.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3880b4200 0x7fd388154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3880b6730 0x7fd38815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 0x7fd38815d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3880b4b70 con 0x7fd3880b6730 2024-09-12T12:22:14.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3880b49f0 con 0x7fd3880b4200 2024-09-12T12:22:14.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3880d1150 con 0x7fd38815c220 2024-09-12T12:22:14.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd386a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3880b6730 0x7fd38815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd386a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3880b6730 0x7fd38815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58262/0 (socket says 172.21.15.144:58262) 2024-09-12T12:22:14.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd386a00640 1 -- 172.21.15.144:0/1324425976 learned_addr learned my addr 172.21.15.144:0/1324425976 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:14.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd387400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3880b4200 0x7fd388154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd387e00640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 0x7fd38815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd386a00640 1 -- 172.21.15.144:0/1324425976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 msgr2=0x7fd38815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd386a00640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 0x7fd38815d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd386a00640 1 -- 172.21.15.144:0/1324425976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3880b4200 msgr2=0x7fd388154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd386a00640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3880b4200 0x7fd388154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd386a00640 1 -- 172.21.15.144:0/1324425976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38815f710 con 0x7fd3880b6730 2024-09-12T12:22:14.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd386a00640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3880b6730 0x7fd38815f1d0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c500 tx=0x7fd37400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:14.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd37f400640 1 -- 172.21.15.144:0/1324425976 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374017070 con 0x7fd3880b6730 2024-09-12T12:22:14.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd37f400640 1 -- 172.21.15.144:0/1324425976 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd374005310 con 0x7fd3880b6730 2024-09-12T12:22:14.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd37f400640 1 -- 172.21.15.144:0/1324425976 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3740054c0 con 0x7fd3880b6730 2024-09-12T12:22:14.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd388157fe0 con 0x7fd3880b6730 2024-09-12T12:22:14.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3881585a0 con 0x7fd3880b6730 2024-09-12T12:22:14.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.438+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd388070bf0 con 0x7fd3880b6730 2024-09-12T12:22:14.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.442+0000 7fd37f400640 1 -- 172.21.15.144:0/1324425976 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd37401a070 con 0x7fd3880b6730 2024-09-12T12:22:14.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.442+0000 7fd37f400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3680678c0 0x7fd368069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:14.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.442+0000 7fd37f400640 1 -- 172.21.15.144:0/1324425976 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7fd3740851a0 con 0x7fd3880b6730 2024-09-12T12:22:14.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.442+0000 7fd387400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3680678c0 0x7fd368069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:14.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.442+0000 7fd387400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3680678c0 0x7fd368069d80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd3780ae000 tx=0x7fd3780b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.446+0000 7fd37f400640 1 -- 172.21.15.144:0/1324425976 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd374055470 con 0x7fd3880b6730 2024-09-12T12:22:14.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.638+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd388156180 con 0x7fd3880b6730 2024-09-12T12:22:14.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.638+0000 7fd37f400640 1 -- 172.21.15.144:0/1324425976 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7fd374059770 con 0x7fd3880b6730 2024-09-12T12:22:14.640 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:14.640 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:14.641 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:14.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3680678c0 msgr2=0x7fd368069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3680678c0 0x7fd368069d80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd3780ae000 tx=0x7fd3780b5040 comp rx=0 tx=0).stop 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3880b6730 msgr2=0x7fd38815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3880b6730 0x7fd38815f1d0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c500 tx=0x7fd37400c9c0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 shutdown_connections 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3680678c0 0x7fd368069d80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd38815c220 0x7fd38815d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3880b6730 0x7fd38815f1d0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 --2- 172.21.15.144:0/1324425976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3880b4200 0x7fd388154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 >> 172.21.15.144:0/1324425976 conn(0x7fd38806f400 msgr2=0x7fd388156980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 shutdown_connections 2024-09-12T12:22:14.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:14.642+0000 7fd38e400640 1 -- 172.21.15.144:0/1324425976 wait complete. 2024-09-12T12:22:15.000 INFO:tasks.ceph.mds.b.smithi165.stderr:2024-09-12T12:22:15.000+0000 7fc187a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:22:15.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 114, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:22:08.760789+0000', 'modified': '2024-09-12T12:22:11.782243+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8874}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8874': {'gid': 8874, 'name': 'b', 'rank': 0, 'incarnation': 111, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.165:6835/1602168377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6833', 'nonce': 1602168377}, {'type': 'v1', 'addr': '172.21.15.165:6835', 'nonce': 1602168377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8874, 'qdb_cluster': [8874]} 2024-09-12T12:22:15.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:22:15.065 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T12:22:15.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f8252800640 1 Processor -- start 2024-09-12T12:22:15.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f8252800640 1 -- start start 2024-09-12T12:22:15.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f8252800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f824c0cd640 0x7f824c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f8252800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824c0b45a0 con 0x7f824c071420 2024-09-12T12:22:15.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f8252800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824c0b3fe0 con 0x7f824c15b4e0 2024-09-12T12:22:15.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f8252800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f824c0b42c0 con 0x7f824c0cd640 2024-09-12T12:22:15.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f824be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f824c0cd640 0x7f824c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f824aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f824c071420 0x7f824c0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34870/0 (socket says 172.21.15.144:34870) 2024-09-12T12:22:15.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f824aa00640 1 -- 172.21.15.144:0/817335787 learned_addr learned my addr 172.21.15.144:0/817335787 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:15.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f824be00640 1 -- 172.21.15.144:0/817335787 >> v1:172.21.15.165:6789/0 conn(0x7f824c15b4e0 legacy=0x7f824c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f824be00640 1 -- 172.21.15.144:0/817335787 >> v1:172.21.15.144:6789/0 conn(0x7f824c071420 legacy=0x7f824c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f824be00640 1 -- 172.21.15.144:0/817335787 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c0b1490 con 0x7f824c0cd640 2024-09-12T12:22:15.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.202+0000 7f824a000640 1 -- 172.21.15.144:0/817335787 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188561004 0 0) 0x7f824c0b45a0 con 0x7f824c071420 2024-09-12T12:22:15.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f824be00640 1 --2- 172.21.15.144:0/817335787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c0cd640 0x7f824c071840 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f8244009d90 tx=0x7f824401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823e4476030a7d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f824a000640 1 -- 172.21.15.144:0/817335787 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82440b2070 con 0x7f824c0cd640 2024-09-12T12:22:15.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f824a000640 1 -- 172.21.15.144:0/817335787 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82440a5990 con 0x7f824c0cd640 2024-09-12T12:22:15.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f824a000640 1 -- 172.21.15.144:0/817335787 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82440a5d60 con 0x7f824c0cd640 2024-09-12T12:22:15.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f8252800640 1 -- 172.21.15.144:0/817335787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c0cd640 msgr2=0x7f824c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f8252800640 1 --2- 172.21.15.144:0/817335787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c0cd640 0x7f824c071840 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f8244009d90 tx=0x7f824401c940 comp rx=0 tx=0).stop 2024-09-12T12:22:15.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f8252800640 1 -- 172.21.15.144:0/817335787 shutdown_connections 2024-09-12T12:22:15.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f8252800640 1 --2- 172.21.15.144:0/817335787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c0cd640 0x7f824c071840 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f8252800640 1 -- 172.21.15.144:0/817335787 >> 172.21.15.144:0/817335787 conn(0x7f824c06d0d0 msgr2=0x7f824c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:15.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f8252800640 1 -- 172.21.15.144:0/817335787 shutdown_connections 2024-09-12T12:22:15.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.206+0000 7f8252800640 1 -- 172.21.15.144:0/817335787 wait complete. 2024-09-12T12:22:15.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 Processor -- start 2024-09-12T12:22:15.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 -- start start 2024-09-12T12:22:15.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c071420 0x7f824c149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0cd640 0x7f824c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15b4e0 0x7f824c15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f824c15b8c0 con 0x7f824c071420 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f824c0b02e0 con 0x7f824c15b4e0 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f824c157460 con 0x7f824c0cd640 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c071420 0x7f824c149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c071420 0x7f824c149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58280/0 (socket says 172.21.15.144:58280) 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824b400640 1 -- 172.21.15.144:0/456462037 learned_addr learned my addr 172.21.15.144:0/456462037 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824aa00640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0cd640 0x7f824c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824be00640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15b4e0 0x7f824c15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824b400640 1 -- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0cd640 msgr2=0x7f824c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824b400640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0cd640 0x7f824c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824b400640 1 -- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15b4e0 msgr2=0x7f824c15d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824b400640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15b4e0 0x7f824c15d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824b400640 1 -- 172.21.15.144:0/456462037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c15d680 con 0x7f824c071420 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824be00640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15b4e0 0x7f824c15d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824aa00640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0cd640 0x7f824c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f824b400640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c071420 0x7f824c149cf0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c3f0 tx=0x7f823c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8243400640 1 -- 172.21.15.144:0/456462037 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c017070 con 0x7f824c071420 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8243400640 1 -- 172.21.15.144:0/456462037 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823c0052d0 con 0x7f824c071420 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8243400640 1 -- 172.21.15.144:0/456462037 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c003840 con 0x7f824c071420 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 -- 172.21.15.144:0/456462037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824c15d960 con 0x7f824c071420 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.210+0000 7f8252800640 1 -- 172.21.15.144:0/456462037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824c154d20 con 0x7f824c071420 2024-09-12T12:22:15.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8243400640 1 -- 172.21.15.144:0/456462037 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f823c01a070 con 0x7f824c071420 2024-09-12T12:22:15.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8243400640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f822c0678f0 0x7f822c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8243400640 1 -- 172.21.15.144:0/456462037 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f823c085120 con 0x7f824c071420 2024-09-12T12:22:15.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8255b72000 1 Processor -- start 2024-09-12T12:22:15.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f824aa00640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f822c0678f0 0x7f822c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8255b72000 1 -- start start 2024-09-12T12:22:15.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f824aa00640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f822c0678f0 0x7f822c069db0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f824c0afd70 tx=0x7f8238007c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8255b72000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec1d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8255b72000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1d690 0x55649ebd3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8255b72000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 0x55649ebd3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8255b72000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55649eab6b60 con 0x55649ec1cd70 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8255b72000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55649ea1dc70 con 0x55649ebd36a0 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.214+0000 7f8255b72000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55649e9c3ed0 con 0x55649ec1d690 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec1d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec1d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58286/0 (socket says 172.21.15.144:58286) 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 -- 172.21.15.144:0/2279575139 learned_addr learned my addr 172.21.15.144:0/2279575139 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824aa00640 1 --2- 172.21.15.144:0/2279575139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1d690 0x55649ebd3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824be00640 1 --2- 172.21.15.144:0/2279575139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 0x55649ebd3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 -- 172.21.15.144:0/2279575139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1d690 msgr2=0x55649ebd3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 --2- 172.21.15.144:0/2279575139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1d690 0x55649ebd3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 -- 172.21.15.144:0/2279575139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 msgr2=0x55649ebd3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:15.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 --2- 172.21.15.144:0/2279575139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 0x55649ebd3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 -- 172.21.15.144:0/2279575139 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649e9d5e50 con 0x55649ec1cd70 2024-09-12T12:22:15.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 --2- 172.21.15.144:0/2279575139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec1d150 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f823c0010d0 tx=0x7f823c055c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211c25d7f980dc0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8237e00640 1 -- 172.21.15.144:0/2279575139 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c05e040 con 0x55649ec1cd70 2024-09-12T12:22:15.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8237e00640 1 -- 172.21.15.144:0/2279575139 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823c053760 con 0x55649ec1cd70 2024-09-12T12:22:15.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8237e00640 1 -- 172.21.15.144:0/2279575139 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c0548b0 con 0x55649ec1cd70 2024-09-12T12:22:15.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 -- 172.21.15.144:0/2279575139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 msgr2=0x55649ec1d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 --2- 172.21.15.144:0/2279575139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec1d150 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f823c0010d0 tx=0x7f823c055c20 comp rx=0 tx=0).stop 2024-09-12T12:22:15.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 -- 172.21.15.144:0/2279575139 shutdown_connections 2024-09-12T12:22:15.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 --2- 172.21.15.144:0/2279575139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 0x55649ebd3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 --2- 172.21.15.144:0/2279575139 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1d690 0x55649ebd3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 --2- 172.21.15.144:0/2279575139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec1d150 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 -- 172.21.15.144:0/2279575139 >> 172.21.15.144:0/2279575139 conn(0x55649ebd5600 msgr2=0x55649ebcd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:15.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 -- 172.21.15.144:0/2279575139 shutdown_connections 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 -- 172.21.15.144:0/2279575139 wait complete. 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 -- start start 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 Processor -- start 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec22eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec1d690 0x55649ec233f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec09490 0x55649ec09870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55649ea7fb00 con 0x55649ec1cd70 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55649e9f8360 con 0x55649ec1d690 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55649e9f52d0 con 0x55649ec09490 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f8255b72000 10 client.0 _ll_register_callbacks cb 0x55649ebba820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec22eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec22eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58292/0 (socket says 172.21.15.144:58292) 2024-09-12T12:22:15.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824b400640 1 -- 172.21.15.144:0/1848279081 learned_addr learned my addr 172.21.15.144:0/1848279081 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:15.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824be00640 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec09490 0x55649ec09870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.218+0000 7f824aa00640 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec1d690 0x55649ec233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f824b400640 1 -- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec09490 msgr2=0x55649ec09870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:15.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f824b400640 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec09490 0x55649ec09870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f824b400640 1 -- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec1d690 msgr2=0x55649ec233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:15.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f824b400640 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec1d690 0x55649ec233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f824b400640 1 -- 172.21.15.144:0/1848279081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649e9c4120 con 0x55649ec1cd70 2024-09-12T12:22:15.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f824b400640 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec22eb0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c3c0 tx=0x7f823c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8366d1a99904a9d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:15.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 1 -- 172.21.15.144:0/1848279081 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c054ab0 con 0x55649ec1cd70 2024-09-12T12:22:15.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 1 -- 172.21.15.144:0/1848279081 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f823c06d170 con 0x55649ec1cd70 2024-09-12T12:22:15.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 -- 172.21.15.144:0/1848279081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f823c053760 con 0x55649ec1cd70 2024-09-12T12:22:15.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 1 -- 172.21.15.144:0/1848279081 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f823c06d390 con 0x55649ec1cd70 2024-09-12T12:22:15.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 10 client.8988 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:15.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 -- 172.21.15.144:0/1848279081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55649e9bd450 con 0x55649ec1cd70 2024-09-12T12:22:15.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 1 -- 172.21.15.144:0/1848279081 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823c053760 con 0x55649ec1cd70 2024-09-12T12:22:15.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 1 -- 172.21.15.144:0/1848279081 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f823c0511b0 con 0x55649ec1cd70 2024-09-12T12:22:15.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 10 client.8988 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:15.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 10 client.8988 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:22:15.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 20 client.8988 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:15.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55649ec0a280 0x55649ec0a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 4 client.8988 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:22:15.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 -- 172.21.15.144:0/1848279081 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55649e9b7c00 con 0x55649ec0a280 2024-09-12T12:22:15.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f824aa00640 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55649ec0a280 0x55649ec0a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f824aa00640 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55649ec0a280 0x55649ec0a660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e6984e6c9af5dd server_cookie=be180ebf42831209 in_seq=0 out_seq=0 2024-09-12T12:22:15.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 10 client.8988 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:15.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 1 -- 172.21.15.144:0/1848279081 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55649e9b7c00 con 0x55649ec0a280 2024-09-12T12:22:15.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 10 client.8988 handle_command_reply: tid=0 2024-09-12T12:22:15.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 client.8988 shutdown 2024-09-12T12:22:15.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 -- 172.21.15.144:0/1848279081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 msgr2=0x55649ec22eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec22eb0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c3c0 tx=0x7f823c000ee0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 -- 172.21.15.144:0/1848279081 shutdown_connections 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55649ec0a280 0x55649ec0a660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec09490 0x55649ec09870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec1d690 0x55649ec233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8234c00640 0 client.8988 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 --2- 172.21.15.144:0/1848279081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec1cd70 0x55649ec22eb0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 -- 172.21.15.144:0/1848279081 >> 172.21.15.144:0/1848279081 conn(0x55649ebd36a0 msgr2=0x55649ebd49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 -- 172.21.15.144:0/1848279081 shutdown_connections 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 1 -- 172.21.15.144:0/1848279081 wait complete. 2024-09-12T12:22:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.222+0000 7f8255b72000 20 client.8988 trim_cache size 0 max 16384 2024-09-12T12:22:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8255b72000 1 Processor -- start 2024-09-12T12:22:15.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8255b72000 1 -- start start 2024-09-12T12:22:15.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8255b72000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 0x55649ec1b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8255b72000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec09490 0x55649ec1bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8255b72000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 0x55649ec28ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8255b72000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f824c1fec60 con 0x55649ec09490 2024-09-12T12:22:15.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8255b72000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f824c155c20 con 0x55649ebd36a0 2024-09-12T12:22:15.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8255b72000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f824c156270 con 0x55649ec1cd70 2024-09-12T12:22:15.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec09490 0x55649ec1bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec09490 0x55649ec1bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58300/0 (socket says 172.21.15.144:58300) 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824aa00640 1 -- 172.21.15.144:0/367788967 learned_addr learned my addr 172.21.15.144:0/367788967 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824be00640 1 --2- 172.21.15.144:0/367788967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 0x55649ec28ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824b400640 1 --2- 172.21.15.144:0/367788967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 0x55649ec1b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824aa00640 1 -- 172.21.15.144:0/367788967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 msgr2=0x55649ec28ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824aa00640 1 --2- 172.21.15.144:0/367788967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 0x55649ec28ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824aa00640 1 -- 172.21.15.144:0/367788967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 msgr2=0x55649ec1b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824aa00640 1 --2- 172.21.15.144:0/367788967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 0x55649ec1b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824aa00640 1 -- 172.21.15.144:0/367788967 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649e9a4fd0 con 0x55649ec09490 2024-09-12T12:22:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f824aa00640 1 --2- 172.21.15.144:0/367788967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec09490 0x55649ec1bc30 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f824c0b3790 tx=0x7f8238012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c039a38511bbfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8237400640 1 -- 172.21.15.144:0/367788967 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238031070 con 0x55649ec09490 2024-09-12T12:22:15.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8237400640 1 -- 172.21.15.144:0/367788967 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82380149c0 con 0x55649ec09490 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.242+0000 7f8237400640 1 -- 172.21.15.144:0/367788967 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238028040 con 0x55649ec09490 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- 172.21.15.144:0/367788967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec09490 msgr2=0x55649ec1bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 --2- 172.21.15.144:0/367788967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec09490 0x55649ec1bc30 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f824c0b3790 tx=0x7f8238012000 comp rx=0 tx=0).stop 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- 172.21.15.144:0/367788967 shutdown_connections 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 --2- 172.21.15.144:0/367788967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 0x55649ec28ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 --2- 172.21.15.144:0/367788967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ec09490 0x55649ec1bc30 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 --2- 172.21.15.144:0/367788967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ebd36a0 0x55649ec1b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- 172.21.15.144:0/367788967 >> 172.21.15.144:0/367788967 conn(0x55649ec08bf0 msgr2=0x55649ebcdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- 172.21.15.144:0/367788967 shutdown_connections 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- 172.21.15.144:0/367788967 wait complete. 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- start start 2024-09-12T12:22:15.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 Processor -- start 2024-09-12T12:22:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ebd36a0 0x55649ec22cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec09490 0x55649ec23230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 0x55649ec25ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55649ea1cf80 con 0x55649ebd36a0 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55649e9d5ca0 con 0x55649ec09490 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55649ea222a0 con 0x55649ec1cd70 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 10 client.0 _ll_register_callbacks cb 0x7f823c06c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ebd36a0 0x55649ec22cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ebd36a0 0x55649ec22cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58308/0 (socket says 172.21.15.144:58308) 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824b400640 1 -- 172.21.15.144:0/1516870932 learned_addr learned my addr 172.21.15.144:0/1516870932 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824be00640 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 0x55649ec25ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824aa00640 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec09490 0x55649ec23230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824b400640 1 -- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 msgr2=0x55649ec25ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824b400640 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 0x55649ec25ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824b400640 1 -- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec09490 msgr2=0x55649ec23230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824b400640 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec09490 0x55649ec23230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824b400640 1 -- 172.21.15.144:0/1516870932 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649eaa0750 con 0x55649ebd36a0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f824b400640 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ebd36a0 0x55649ec22cf0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f823c053710 tx=0x7f823c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b4a86d006a2b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8234c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8234c00640 1 -- 172.21.15.144:0/1516870932 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c054ab0 con 0x55649ebd36a0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8234c00640 1 -- 172.21.15.144:0/1516870932 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7f823c054320 con 0x55649ebd36a0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- 172.21.15.144:0/1516870932 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82380149c0 con 0x55649ebd36a0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8234c00640 1 -- 172.21.15.144:0/1516870932 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f823c054520 con 0x55649ebd36a0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 10 client.8994 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- 172.21.15.144:0/1516870932 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55649e9aba30 con 0x55649ebd36a0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8234c00640 1 -- 172.21.15.144:0/1516870932 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82380149c0 con 0x55649ebd36a0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8234c00640 1 -- 172.21.15.144:0/1516870932 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f823c0591b0 con 0x55649ebd36a0 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 10 client.8994 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 10 client.8994 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 20 client.8994 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55649ec1d690 0x55649ec26660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 4 client.8994 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.246+0000 7f8255b72000 1 -- 172.21.15.144:0/1516870932 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "status"}) -- 0x55649ea2b3a0 con 0x55649ec1d690 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f824aa00640 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55649ec1d690 0x55649ec26660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8234c00640 10 client.8994 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f824aa00640 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55649ec1d690 0x55649ec26660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6a17b270cb5ea82 server_cookie=79b32fdf5f4cfa2f in_seq=0 out_seq=0 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8234c00640 1 -- 172.21.15.144:0/1516870932 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55649ea2b3a0 con 0x55649ec1d690 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8234c00640 10 client.8994 handle_command_reply: tid=0 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 client.8994 shutdown 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 -- 172.21.15.144:0/1516870932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ebd36a0 msgr2=0x55649ec22cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ebd36a0 0x55649ec22cf0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f823c053710 tx=0x7f823c014000 comp rx=0 tx=0).stop 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 -- 172.21.15.144:0/1516870932 shutdown_connections 2024-09-12T12:22:15.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55649ec1d690 0x55649ec26660 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55649ec1cd70 0x55649ec25ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55649ec09490 0x55649ec23230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8234c00640 0 client.8994 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:15.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 --2- 172.21.15.144:0/1516870932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55649ebd36a0 0x55649ec22cf0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 -- 172.21.15.144:0/1516870932 >> 172.21.15.144:0/1516870932 conn(0x55649ec08bf0 msgr2=0x55649ec1a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:15.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 -- 172.21.15.144:0/1516870932 shutdown_connections 2024-09-12T12:22:15.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 1 -- 172.21.15.144:0/1516870932 wait complete. 2024-09-12T12:22:15.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8255b72000 20 client.8994 trim_cache size 0 max 16384 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 8874, 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 5.8768204669999999, 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 114, 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 152, 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 152, 2024-09-12T12:22:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 11.087727699 2024-09-12T12:22:15.257 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:22:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 -- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f822c0678f0 msgr2=0x7f822c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f822c0678f0 0x7f822c069db0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f824c0afd70 tx=0x7f8238007c60 comp rx=0 tx=0).stop 2024-09-12T12:22:15.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 -- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c071420 msgr2=0x7f824c149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c071420 0x7f824c149cf0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c3f0 tx=0x7f823c00c8b0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 -- 172.21.15.144:0/456462037 shutdown_connections 2024-09-12T12:22:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f822c0678f0 0x7f822c069db0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15b4e0 0x7f824c15d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0cd640 0x7f824c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 --2- 172.21.15.144:0/456462037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c071420 0x7f824c149cf0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 -- 172.21.15.144:0/456462037 >> 172.21.15.144:0/456462037 conn(0x7f824c06d0d0 msgr2=0x7f824c0b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 -- 172.21.15.144:0/456462037 shutdown_connections 2024-09-12T12:22:15.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.250+0000 7f8252800640 1 -- 172.21.15.144:0/456462037 wait complete. 2024-09-12T12:22:15.271 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:22:15.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd72a200640 1 Processor -- start 2024-09-12T12:22:15.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd72a200640 1 -- start start 2024-09-12T12:22:15.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd72a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd72415c0a0 0x7fd7240b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd72a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd7240ce950 0x7fd72415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd72a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72415c480 con 0x7fd7240b6b20 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd72a200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd7241609e0 con 0x7fd72415c0a0 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd72a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd72415fdd0 con 0x7fd7240ce950 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd728e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd72415c0a0 0x7fd7240b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd728e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd72415c0a0 0x7fd7240b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58320/0 (socket says 172.21.15.144:58320) 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd729800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd7240b6b20 0x7fd7240b6fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34884/0 (socket says 172.21.15.144:34884) 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd728e00640 1 -- 172.21.15.144:0/2279650730 learned_addr learned my addr 172.21.15.144:0/2279650730 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd723e00640 1 --2- 172.21.15.144:0/2279650730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd7240ce950 0x7fd72415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd728e00640 1 -- 172.21.15.144:0/2279650730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd7240ce950 msgr2=0x7fd72415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd728e00640 1 --2- 172.21.15.144:0/2279650730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd7240ce950 0x7fd72415d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd728e00640 1 -- 172.21.15.144:0/2279650730 >> v1:172.21.15.144:6789/0 conn(0x7fd7240b6b20 legacy=0x7fd7240b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.406+0000 7fd728e00640 1 -- 172.21.15.144:0/2279650730 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7241600b0 con 0x7fd72415c0a0 2024-09-12T12:22:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd728e00640 1 --2- 172.21.15.144:0/2279650730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd72415c0a0 0x7fd7240b5310 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd718009870 tx=0x7fd71801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf362efd9fb8b2d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd723400640 1 -- 172.21.15.144:0/2279650730 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7180b1070 con 0x7fd72415c0a0 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd723400640 1 -- 172.21.15.144:0/2279650730 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7180ac620 con 0x7fd72415c0a0 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd723400640 1 -- 172.21.15.144:0/2279650730 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7180ac9f0 con 0x7fd72415c0a0 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd72a200640 1 -- 172.21.15.144:0/2279650730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd72415c0a0 msgr2=0x7fd7240b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd72a200640 1 --2- 172.21.15.144:0/2279650730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd72415c0a0 0x7fd7240b5310 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd718009870 tx=0x7fd71801c4d0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd72a200640 1 -- 172.21.15.144:0/2279650730 shutdown_connections 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd72a200640 1 --2- 172.21.15.144:0/2279650730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd7240ce950 0x7fd72415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd72a200640 1 --2- 172.21.15.144:0/2279650730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd72415c0a0 0x7fd7240b5310 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd72a200640 1 -- 172.21.15.144:0/2279650730 >> 172.21.15.144:0/2279650730 conn(0x7fd7240d2280 msgr2=0x7fd7240d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd72a200640 1 -- 172.21.15.144:0/2279650730 shutdown_connections 2024-09-12T12:22:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.410+0000 7fd72a200640 1 -- 172.21.15.144:0/2279650730 wait complete. 2024-09-12T12:22:15.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 Processor -- start 2024-09-12T12:22:15.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 -- start start 2024-09-12T12:22:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7240b6b20 0x7fd7241552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7240ce950 0x7fd72414ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd72415c0a0 0x7fd724143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd724073c50 con 0x7fd7240ce950 2024-09-12T12:22:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd724073ad0 con 0x7fd7240b6b20 2024-09-12T12:22:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd724073dd0 con 0x7fd72415c0a0 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd723e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7240ce950 0x7fd72414ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd723e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7240ce950 0x7fd72414ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58332/0 (socket says 172.21.15.144:58332) 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd723e00640 1 -- 172.21.15.144:0/3865815821 learned_addr learned my addr 172.21.15.144:0/3865815821 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd728e00640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7240b6b20 0x7fd7241552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd729800640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd72415c0a0 0x7fd724143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd723e00640 1 -- 172.21.15.144:0/3865815821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd72415c0a0 msgr2=0x7fd724143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd723e00640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd72415c0a0 0x7fd724143630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd723e00640 1 -- 172.21.15.144:0/3865815821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7240b6b20 msgr2=0x7fd7241552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd723e00640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7240b6b20 0x7fd7241552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd723e00640 1 -- 172.21.15.144:0/3865815821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd724143b70 con 0x7fd7240ce950 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd723e00640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7240ce950 0x7fd72414ee80 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d5d0 tx=0x7fd71000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd720c00640 1 -- 172.21.15.144:0/3865815821 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710004240 con 0x7fd7240ce950 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd720c00640 1 -- 172.21.15.144:0/3865815821 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7100043e0 con 0x7fd7240ce950 2024-09-12T12:22:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7241558c0 con 0x7fd7240ce950 2024-09-12T12:22:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd720c00640 1 -- 172.21.15.144:0/3865815821 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710003840 con 0x7fd7240ce950 2024-09-12T12:22:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72414c920 con 0x7fd7240ce950 2024-09-12T12:22:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.414+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72415d0c0 con 0x7fd7240ce950 2024-09-12T12:22:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.418+0000 7fd720c00640 1 -- 172.21.15.144:0/3865815821 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd7100039e0 con 0x7fd7240ce950 2024-09-12T12:22:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.418+0000 7fd720c00640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7040678c0 0x7fd704069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.418+0000 7fd720c00640 1 -- 172.21.15.144:0/3865815821 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 6101+0+0 (secure 0 0 0) 0x7fd710086980 con 0x7fd7240ce950 2024-09-12T12:22:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.418+0000 7fd728e00640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7040678c0 0x7fd704069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.418+0000 7fd728e00640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7040678c0 0x7fd704069d80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ae000 tx=0x7fd7180a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:15.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.422+0000 7fd720c00640 1 -- 172.21.15.144:0/3865815821 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd724143b70 con 0x7fd7240ce950 2024-09-12T12:22:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.618+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd7240b1c60 con 0x7fd7240ce950 2024-09-12T12:22:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.618+0000 7fd720c00640 1 -- 172.21.15.144:0/3865815821 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v114) ==== 53+0+73 (secure 0 0 0) 0x7fd710056dc0 con 0x7fd7240ce950 2024-09-12T12:22:15.621 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:22:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7040678c0 msgr2=0x7fd704069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7040678c0 0x7fd704069d80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ae000 tx=0x7fd7180a7000 comp rx=0 tx=0).stop 2024-09-12T12:22:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7240ce950 msgr2=0x7fd72414ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7240ce950 0x7fd72414ee80 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d5d0 tx=0x7fd71000da90 comp rx=0 tx=0).stop 2024-09-12T12:22:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 shutdown_connections 2024-09-12T12:22:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd7040678c0 0x7fd704069d80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd72415c0a0 0x7fd724143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7240ce950 0x7fd72414ee80 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 --2- 172.21.15.144:0/3865815821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7240b6b20 0x7fd7241552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 >> 172.21.15.144:0/3865815821 conn(0x7fd7240d2280 msgr2=0x7fd72415c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 shutdown_connections 2024-09-12T12:22:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15.622+0000 7fd72a200640 1 -- 172.21.15.144:0/3865815821 wait complete. 2024-09-12T12:22:15.643 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:22:15.643 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:22:15.643 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:22:15.643 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:22:15.643 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:22:15.643 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:22:15.643 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:22:15.643 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:22:15.644 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:22:15.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:15.644 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:22:15.654 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:22:15.654 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:22:15.654 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:22:15.654 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:22:15.654 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:22:15.655 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:22:15.656 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:22:15.656 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:22:15.656 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41847sec preferred_lft 41847sec 2024-09-12T12:22:15.656 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:22:15.656 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:22:15.656 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:22:15.656 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:22:15.656 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:22:15.657 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:22:15.657 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:22:15.657 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:22:15.657 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:22:15.657 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:22:15.657 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:22:15.657 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:22:15.657 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:22:15.657 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:22:15.658 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:22:15.658 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:22:15.658 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:22:15.658 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:22:15.658 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:22:15.658 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:22:15.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:15.659 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:22:15.719 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:22:15.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:15.721 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:22:15.777 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:22:15.777 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:22:15.777 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:22:15.777 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:22:15.777 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:22:15.777 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:22:15.777 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:22:15.778 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:22:15.778 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:22:15.778 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:22:15.778 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:22:15.778 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:22:15.778 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:15.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:22:15.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:22:15.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:22:15.778 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:15.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:22:15.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:15.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:15.913 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:22:15.922 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:22:15.922 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:22:15.922 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:22:15.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:15.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:22:15.987 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:22:15.987 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:22:16.041 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:22:16.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:22:16.042 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:22:16.093 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:22:16.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:16.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:22:16.185 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:22:16.186 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:22:16.199 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:22:16.199 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:22:16.199 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:22:16.199 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:22:16.199 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:22:16.203 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:22:16.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:16.203 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:22:16.223 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:22:16.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:16.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:16.336 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:22:16.339 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:22:16.340 INFO:teuthology.orchestra.run.smithi144.stdout:client9006 2024-09-12T12:22:16.340 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:22:16.340 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:16.390 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:16.391 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:16.391 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.0 2024-09-12T12:22:16.391 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:16.391 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:16.391 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:16.391 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:16.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:16.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.526 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.526 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177225 s, 59.2 MB/s 2024-09-12T12:22:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016734 s, 62.7 MB/s 2024-09-12T12:22:16.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.565 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165822 s, 63.2 MB/s 2024-09-12T12:22:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158436 s, 66.2 MB/s 2024-09-12T12:22:16.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.602 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141308 s, 74.2 MB/s 2024-09-12T12:22:16.619 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.619 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.619 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014599 s, 71.8 MB/s 2024-09-12T12:22:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.635 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132984 s, 78.8 MB/s 2024-09-12T12:22:16.654 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.654 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.654 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161306 s, 65.0 MB/s 2024-09-12T12:22:16.671 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.671 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.671 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136937 s, 76.6 MB/s 2024-09-12T12:22:16.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.690 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150664 s, 69.6 MB/s 2024-09-12T12:22:16.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.708 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015785 s, 66.4 MB/s 2024-09-12T12:22:16.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.727 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015654 s, 67.0 MB/s 2024-09-12T12:22:16.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.742 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122433 s, 85.6 MB/s 2024-09-12T12:22:16.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.759 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138865 s, 75.5 MB/s 2024-09-12T12:22:16.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.775 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132774 s, 79.0 MB/s 2024-09-12T12:22:16.791 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.791 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.791 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131607 s, 79.7 MB/s 2024-09-12T12:22:16.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.809 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155322 s, 67.5 MB/s 2024-09-12T12:22:16.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.826 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141959 s, 73.9 MB/s 2024-09-12T12:22:16.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146579 s, 71.5 MB/s 2024-09-12T12:22:16.864 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.865 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184703 s, 56.8 MB/s 2024-09-12T12:22:16.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.883 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159309 s, 65.8 MB/s 2024-09-12T12:22:16.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.901 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153449 s, 68.3 MB/s 2024-09-12T12:22:16.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.918 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139126 s, 75.4 MB/s 2024-09-12T12:22:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.934 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134573 s, 77.9 MB/s 2024-09-12T12:22:16.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.953 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162786 s, 64.4 MB/s 2024-09-12T12:22:16.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.971 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157983 s, 66.4 MB/s 2024-09-12T12:22:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140724 s, 74.5 MB/s 2024-09-12T12:22:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160102 s, 65.5 MB/s 2024-09-12T12:22:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148547 s, 70.6 MB/s 2024-09-12T12:22:17.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.041 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134706 s, 77.8 MB/s 2024-09-12T12:22:17.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.057 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133583 s, 78.5 MB/s 2024-09-12T12:22:17.073 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.074 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144506 s, 72.6 MB/s 2024-09-12T12:22:17.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:17.081 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:17.081 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:17.081 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.1 2024-09-12T12:22:17.081 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:17.081 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:17.081 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:17.081 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:17.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.149 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133163 s, 78.7 MB/s 2024-09-12T12:22:17.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.166 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137105 s, 76.5 MB/s 2024-09-12T12:22:17.181 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.181 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.181 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130609 s, 80.3 MB/s 2024-09-12T12:22:17.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.197 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134172 s, 78.2 MB/s 2024-09-12T12:22:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.213 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137783 s, 76.1 MB/s 2024-09-12T12:22:17.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.231 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154916 s, 67.7 MB/s 2024-09-12T12:22:17.247 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.247 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.247 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131391 s, 79.8 MB/s 2024-09-12T12:22:17.264 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.265 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149875 s, 70.0 MB/s 2024-09-12T12:22:17.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.282 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138128 s, 75.9 MB/s 2024-09-12T12:22:17.297 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.297 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.297 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012592 s, 83.3 MB/s 2024-09-12T12:22:17.314 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.314 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.314 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137464 s, 76.3 MB/s 2024-09-12T12:22:17.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.330 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136004 s, 77.1 MB/s 2024-09-12T12:22:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.345 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127661 s, 82.1 MB/s 2024-09-12T12:22:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124486 s, 84.2 MB/s 2024-09-12T12:22:17.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.377 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130945 s, 80.1 MB/s 2024-09-12T12:22:17.393 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.393 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.393 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138987 s, 75.4 MB/s 2024-09-12T12:22:17.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142291 s, 73.7 MB/s 2024-09-12T12:22:17.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134829 s, 77.8 MB/s 2024-09-12T12:22:17.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.443 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135046 s, 77.6 MB/s 2024-09-12T12:22:17.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.459 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135843 s, 77.2 MB/s 2024-09-12T12:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142693 s, 73.5 MB/s 2024-09-12T12:22:17.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.492 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127621 s, 82.2 MB/s 2024-09-12T12:22:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164257 s, 63.8 MB/s 2024-09-12T12:22:17.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.528 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013675 s, 76.7 MB/s 2024-09-12T12:22:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142495 s, 73.6 MB/s 2024-09-12T12:22:17.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.562 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013162 s, 79.7 MB/s 2024-09-12T12:22:17.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.578 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012956 s, 80.9 MB/s 2024-09-12T12:22:17.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.596 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.596 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144165 s, 72.7 MB/s 2024-09-12T12:22:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.611 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012443 s, 84.3 MB/s 2024-09-12T12:22:17.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.628 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013684 s, 76.6 MB/s 2024-09-12T12:22:17.645 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.645 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.646 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138541 s, 75.7 MB/s 2024-09-12T12:22:17.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130157 s, 80.6 MB/s 2024-09-12T12:22:17.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:17.669 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:17.669 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:17.669 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.2 2024-09-12T12:22:17.670 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:17.670 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:17.670 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:17.670 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:17.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.778 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142614 s, 73.5 MB/s 2024-09-12T12:22:17.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.797 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163511 s, 64.1 MB/s 2024-09-12T12:22:17.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.812 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126768 s, 82.7 MB/s 2024-09-12T12:22:17.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.831 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015172 s, 69.1 MB/s 2024-09-12T12:22:17.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.846 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123225 s, 85.1 MB/s 2024-09-12T12:22:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.863 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139247 s, 75.3 MB/s 2024-09-12T12:22:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140291 s, 74.7 MB/s 2024-09-12T12:22:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142555 s, 73.6 MB/s 2024-09-12T12:22:17.915 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.915 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.915 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143031 s, 73.3 MB/s 2024-09-12T12:22:17.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.931 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133746 s, 78.4 MB/s 2024-09-12T12:22:17.950 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.950 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.950 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161746 s, 64.8 MB/s 2024-09-12T12:22:17.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.970 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.970 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160129 s, 65.5 MB/s 2024-09-12T12:22:17.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:17.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:17.985 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127502 s, 82.2 MB/s 2024-09-12T12:22:18.002 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.002 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.002 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136745 s, 76.7 MB/s 2024-09-12T12:22:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.018 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131673 s, 79.6 MB/s 2024-09-12T12:22:18.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.034 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135068 s, 77.6 MB/s 2024-09-12T12:22:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.050 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124887 s, 84.0 MB/s 2024-09-12T12:22:18.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.066 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132678 s, 79.0 MB/s 2024-09-12T12:22:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.083 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135769 s, 77.2 MB/s 2024-09-12T12:22:18.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.099 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128678 s, 81.5 MB/s 2024-09-12T12:22:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.114 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131094 s, 80.0 MB/s 2024-09-12T12:22:18.130 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.130 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.130 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129375 s, 81.0 MB/s 2024-09-12T12:22:18.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.147 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140187 s, 74.8 MB/s 2024-09-12T12:22:18.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.163 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143259 s, 73.2 MB/s 2024-09-12T12:22:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.179 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127006 s, 82.6 MB/s 2024-09-12T12:22:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.195 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135166 s, 77.6 MB/s 2024-09-12T12:22:18.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.209 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115677 s, 90.6 MB/s 2024-09-12T12:22:18.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.227 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151151 s, 69.4 MB/s 2024-09-12T12:22:18.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.244 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142936 s, 73.4 MB/s 2024-09-12T12:22:18.259 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.259 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.259 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126313 s, 83.0 MB/s 2024-09-12T12:22:18.276 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.276 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.277 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134952 s, 77.7 MB/s 2024-09-12T12:22:18.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.293 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132153 s, 79.3 MB/s 2024-09-12T12:22:18.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:18.300 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:18.300 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:18.300 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.3 2024-09-12T12:22:18.300 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:18.300 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:18.300 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:18.301 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:18.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:18.369 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.369 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.369 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137912 s, 76.0 MB/s 2024-09-12T12:22:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.384 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126353 s, 83.0 MB/s 2024-09-12T12:22:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144932 s, 72.3 MB/s 2024-09-12T12:22:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.418 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134137 s, 78.2 MB/s 2024-09-12T12:22:18.434 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.435 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138225 s, 75.9 MB/s 2024-09-12T12:22:18.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.452 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143929 s, 72.9 MB/s 2024-09-12T12:22:18.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.467 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122965 s, 85.3 MB/s 2024-09-12T12:22:18.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.482 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130685 s, 80.2 MB/s 2024-09-12T12:22:18.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.498 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136675 s, 76.7 MB/s 2024-09-12T12:22:18.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.518 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166914 s, 62.8 MB/s 2024-09-12T12:22:18.534 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.535 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141852 s, 73.9 MB/s 2024-09-12T12:22:18.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.550 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129133 s, 81.2 MB/s 2024-09-12T12:22:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153961 s, 68.1 MB/s 2024-09-12T12:22:18.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.584 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123772 s, 84.7 MB/s 2024-09-12T12:22:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117558 s, 89.2 MB/s 2024-09-12T12:22:18.615 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.615 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139208 s, 75.3 MB/s 2024-09-12T12:22:18.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.631 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132559 s, 79.1 MB/s 2024-09-12T12:22:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162512 s, 64.5 MB/s 2024-09-12T12:22:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.667 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144186 s, 72.7 MB/s 2024-09-12T12:22:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.684 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139151 s, 75.4 MB/s 2024-09-12T12:22:18.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.700 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138215 s, 75.9 MB/s 2024-09-12T12:22:18.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.717 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144478 s, 72.6 MB/s 2024-09-12T12:22:18.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.737 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167933 s, 62.4 MB/s 2024-09-12T12:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.753 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.753 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129374 s, 81.1 MB/s 2024-09-12T12:22:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.773 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166538 s, 63.0 MB/s 2024-09-12T12:22:18.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.788 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129476 s, 81.0 MB/s 2024-09-12T12:22:18.804 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.805 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138395 s, 75.8 MB/s 2024-09-12T12:22:18.820 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.820 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.821 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132008 s, 79.4 MB/s 2024-09-12T12:22:18.837 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.837 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.838 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140493 s, 74.6 MB/s 2024-09-12T12:22:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.854 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142016 s, 73.8 MB/s 2024-09-12T12:22:18.870 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.871 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.871 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136585 s, 76.8 MB/s 2024-09-12T12:22:18.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.887 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139299 s, 75.3 MB/s 2024-09-12T12:22:18.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:18.895 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:18.895 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:18.895 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.4 2024-09-12T12:22:18.895 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:18.896 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:18.896 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:18.896 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:18.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:18.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.963 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132447 s, 79.2 MB/s 2024-09-12T12:22:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132116 s, 79.4 MB/s 2024-09-12T12:22:18.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:18.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:18.997 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161394 s, 65.0 MB/s 2024-09-12T12:22:19.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.016 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.016 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159535 s, 65.7 MB/s 2024-09-12T12:22:19.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.035 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160612 s, 65.3 MB/s 2024-09-12T12:22:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.050 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128546 s, 81.6 MB/s 2024-09-12T12:22:19.069 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.069 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.069 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163052 s, 64.3 MB/s 2024-09-12T12:22:19.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.086 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141324 s, 74.2 MB/s 2024-09-12T12:22:19.103 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.103 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.103 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141965 s, 73.9 MB/s 2024-09-12T12:22:19.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.122 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.122 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162998 s, 64.3 MB/s 2024-09-12T12:22:19.138 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.139 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.139 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141151 s, 74.3 MB/s 2024-09-12T12:22:19.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.155 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139811 s, 75.0 MB/s 2024-09-12T12:22:19.172 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.172 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.172 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143581 s, 73.0 MB/s 2024-09-12T12:22:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.192 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164994 s, 63.6 MB/s 2024-09-12T12:22:19.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.209 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135653 s, 77.3 MB/s 2024-09-12T12:22:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.226 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146661 s, 71.5 MB/s 2024-09-12T12:22:19.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.243 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131231 s, 79.9 MB/s 2024-09-12T12:22:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.259 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.260 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144904 s, 72.4 MB/s 2024-09-12T12:22:19.276 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.276 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.276 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131519 s, 79.7 MB/s 2024-09-12T12:22:19.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.293 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150738 s, 69.6 MB/s 2024-09-12T12:22:19.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.310 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.310 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136484 s, 76.8 MB/s 2024-09-12T12:22:19.327 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.327 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.327 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148285 s, 70.7 MB/s 2024-09-12T12:22:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165593 s, 63.3 MB/s 2024-09-12T12:22:19.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.364 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135497 s, 77.4 MB/s 2024-09-12T12:22:19.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126408 s, 83.0 MB/s 2024-09-12T12:22:19.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.394 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137293 s, 76.4 MB/s 2024-09-12T12:22:19.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.409 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124465 s, 84.2 MB/s 2024-09-12T12:22:19.425 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.425 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.425 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130879 s, 80.1 MB/s 2024-09-12T12:22:19.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.441 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130158 s, 80.6 MB/s 2024-09-12T12:22:19.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.460 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160106 s, 65.5 MB/s 2024-09-12T12:22:19.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.476 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130218 s, 80.5 MB/s 2024-09-12T12:22:19.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.492 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139194 s, 75.3 MB/s 2024-09-12T12:22:19.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:19.500 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:19.500 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:19.500 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.5 2024-09-12T12:22:19.501 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:19.501 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:19.501 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:19.501 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:19.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135257 s, 77.5 MB/s 2024-09-12T12:22:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014338 s, 73.1 MB/s 2024-09-12T12:22:19.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.603 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.603 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134273 s, 78.1 MB/s 2024-09-12T12:22:19.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.620 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014579 s, 71.9 MB/s 2024-09-12T12:22:19.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143669 s, 73.0 MB/s 2024-09-12T12:22:19.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.653 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132872 s, 78.9 MB/s 2024-09-12T12:22:19.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.673 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170212 s, 61.6 MB/s 2024-09-12T12:22:19.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.688 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127302 s, 82.4 MB/s 2024-09-12T12:22:19.703 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.704 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128302 s, 81.7 MB/s 2024-09-12T12:22:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148638 s, 70.5 MB/s 2024-09-12T12:22:19.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.738 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141613 s, 74.0 MB/s 2024-09-12T12:22:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.758 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170021 s, 61.7 MB/s 2024-09-12T12:22:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131498 s, 79.7 MB/s 2024-09-12T12:22:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168457 s, 62.2 MB/s 2024-09-12T12:22:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.808 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126985 s, 82.6 MB/s 2024-09-12T12:22:19.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.824 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123799 s, 84.7 MB/s 2024-09-12T12:22:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169669 s, 61.8 MB/s 2024-09-12T12:22:19.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.861 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.861 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147554 s, 71.1 MB/s 2024-09-12T12:22:19.878 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.879 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151877 s, 69.0 MB/s 2024-09-12T12:22:19.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.894 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130092 s, 80.6 MB/s 2024-09-12T12:22:19.909 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013255 s, 79.1 MB/s 2024-09-12T12:22:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012752 s, 82.2 MB/s 2024-09-12T12:22:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133826 s, 78.4 MB/s 2024-09-12T12:22:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.957 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134174 s, 78.2 MB/s 2024-09-12T12:22:19.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.973 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129656 s, 80.9 MB/s 2024-09-12T12:22:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:19.990 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149755 s, 70.0 MB/s 2024-09-12T12:22:20.006 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.006 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.006 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013178 s, 79.6 MB/s 2024-09-12T12:22:20.023 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.023 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.023 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135579 s, 77.3 MB/s 2024-09-12T12:22:20.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.039 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137058 s, 76.5 MB/s 2024-09-12T12:22:20.055 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.055 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.055 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138387 s, 75.8 MB/s 2024-09-12T12:22:20.073 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.074 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016067 s, 65.3 MB/s 2024-09-12T12:22:20.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140641 s, 74.6 MB/s 2024-09-12T12:22:20.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:20.098 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:20.098 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:20.099 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.6 2024-09-12T12:22:20.099 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:20.099 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:20.099 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:20.099 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:20.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.213 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136293 s, 76.9 MB/s 2024-09-12T12:22:20.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.227 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012338 s, 85.0 MB/s 2024-09-12T12:22:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136554 s, 76.8 MB/s 2024-09-12T12:22:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.260 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129613 s, 80.9 MB/s 2024-09-12T12:22:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137672 s, 76.2 MB/s 2024-09-12T12:22:20.292 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.292 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.292 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130923 s, 80.1 MB/s 2024-09-12T12:22:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.308 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130117 s, 80.6 MB/s 2024-09-12T12:22:20.323 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.324 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130113 s, 80.6 MB/s 2024-09-12T12:22:20.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.341 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144116 s, 72.8 MB/s 2024-09-12T12:22:20.357 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.357 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.357 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135635 s, 77.3 MB/s 2024-09-12T12:22:20.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.377 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166816 s, 62.9 MB/s 2024-09-12T12:22:20.393 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.393 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.393 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013978 s, 75.0 MB/s 2024-09-12T12:22:20.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.414 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187975 s, 55.8 MB/s 2024-09-12T12:22:20.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.431 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134425 s, 78.0 MB/s 2024-09-12T12:22:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131239 s, 79.9 MB/s 2024-09-12T12:22:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.461 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.462 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127067 s, 82.5 MB/s 2024-09-12T12:22:20.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.479 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142329 s, 73.7 MB/s 2024-09-12T12:22:20.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.496 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139014 s, 75.4 MB/s 2024-09-12T12:22:20.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.512 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136094 s, 77.0 MB/s 2024-09-12T12:22:20.527 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.528 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01332 s, 78.7 MB/s 2024-09-12T12:22:20.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.547 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163888 s, 64.0 MB/s 2024-09-12T12:22:20.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.563 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134033 s, 78.2 MB/s 2024-09-12T12:22:20.579 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.579 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.579 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139108 s, 75.4 MB/s 2024-09-12T12:22:20.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.595 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130374 s, 80.4 MB/s 2024-09-12T12:22:20.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.611 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141631 s, 74.0 MB/s 2024-09-12T12:22:20.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.627 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134503 s, 78.0 MB/s 2024-09-12T12:22:20.646 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.646 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.646 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162783 s, 64.4 MB/s 2024-09-12T12:22:20.662 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.663 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136431 s, 76.9 MB/s 2024-09-12T12:22:20.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.679 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135592 s, 77.3 MB/s 2024-09-12T12:22:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169211 s, 62.0 MB/s 2024-09-12T12:22:20.714 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.714 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.714 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129571 s, 80.9 MB/s 2024-09-12T12:22:20.732 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.732 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.732 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152737 s, 68.7 MB/s 2024-09-12T12:22:20.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:20.739 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:20.739 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:20.740 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.7 2024-09-12T12:22:20.740 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:20.740 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:20.740 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:20.740 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:20.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112689 s, 93.1 MB/s 2024-09-12T12:22:20.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.820 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.820 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013278 s, 79.0 MB/s 2024-09-12T12:22:20.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.836 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013806 s, 76.0 MB/s 2024-09-12T12:22:20.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.852 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135305 s, 77.5 MB/s 2024-09-12T12:22:20.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.869 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142992 s, 73.3 MB/s 2024-09-12T12:22:20.886 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.887 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148197 s, 70.8 MB/s 2024-09-12T12:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167667 s, 62.5 MB/s 2024-09-12T12:22:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128747 s, 81.4 MB/s 2024-09-12T12:22:20.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.937 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125209 s, 83.7 MB/s 2024-09-12T12:22:20.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.954 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140079 s, 74.9 MB/s 2024-09-12T12:22:20.969 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.970 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130519 s, 80.3 MB/s 2024-09-12T12:22:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143465 s, 73.1 MB/s 2024-09-12T12:22:21.003 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.003 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.003 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143687 s, 73.0 MB/s 2024-09-12T12:22:21.022 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.022 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.022 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168129 s, 62.4 MB/s 2024-09-12T12:22:21.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.039 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133651 s, 78.5 MB/s 2024-09-12T12:22:21.055 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.055 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.055 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013797 s, 76.0 MB/s 2024-09-12T12:22:21.071 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.072 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132047 s, 79.4 MB/s 2024-09-12T12:22:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126219 s, 83.1 MB/s 2024-09-12T12:22:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133114 s, 78.8 MB/s 2024-09-12T12:22:21.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.118 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.118 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123961 s, 84.6 MB/s 2024-09-12T12:22:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.137 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168182 s, 62.3 MB/s 2024-09-12T12:22:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125833 s, 83.3 MB/s 2024-09-12T12:22:21.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.169 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139592 s, 75.1 MB/s 2024-09-12T12:22:21.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.185 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135964 s, 77.1 MB/s 2024-09-12T12:22:21.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.204 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148238 s, 70.7 MB/s 2024-09-12T12:22:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134736 s, 77.8 MB/s 2024-09-12T12:22:21.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.235 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127421 s, 82.3 MB/s 2024-09-12T12:22:21.250 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.251 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131893 s, 79.5 MB/s 2024-09-12T12:22:21.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.266 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130984 s, 80.1 MB/s 2024-09-12T12:22:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167173 s, 62.7 MB/s 2024-09-12T12:22:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126482 s, 82.9 MB/s 2024-09-12T12:22:21.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.320 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162305 s, 64.6 MB/s 2024-09-12T12:22:21.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:21.327 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:21.327 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:21.328 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.8 2024-09-12T12:22:21.328 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:21.328 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:21.328 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:21.328 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:21.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:21.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.395 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132995 s, 78.8 MB/s 2024-09-12T12:22:21.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138523 s, 75.7 MB/s 2024-09-12T12:22:21.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.425 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.425 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113777 s, 92.2 MB/s 2024-09-12T12:22:21.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.441 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134771 s, 77.8 MB/s 2024-09-12T12:22:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.457 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.458 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138829 s, 75.5 MB/s 2024-09-12T12:22:21.477 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.478 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172504 s, 60.8 MB/s 2024-09-12T12:22:21.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.492 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123726 s, 84.7 MB/s 2024-09-12T12:22:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.509 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139303 s, 75.3 MB/s 2024-09-12T12:22:21.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.524 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117112 s, 89.5 MB/s 2024-09-12T12:22:21.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.541 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140659 s, 74.5 MB/s 2024-09-12T12:22:21.558 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.558 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.558 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143018 s, 73.3 MB/s 2024-09-12T12:22:21.574 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.575 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140667 s, 74.5 MB/s 2024-09-12T12:22:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.592 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139904 s, 74.9 MB/s 2024-09-12T12:22:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130887 s, 80.1 MB/s 2024-09-12T12:22:21.623 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.623 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.623 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127118 s, 82.5 MB/s 2024-09-12T12:22:21.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.643 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170549 s, 61.5 MB/s 2024-09-12T12:22:21.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.658 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124254 s, 84.4 MB/s 2024-09-12T12:22:21.675 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.676 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.676 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146501 s, 71.6 MB/s 2024-09-12T12:22:21.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.693 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140531 s, 74.6 MB/s 2024-09-12T12:22:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.708 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126959 s, 82.6 MB/s 2024-09-12T12:22:21.725 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.725 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.725 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139424 s, 75.2 MB/s 2024-09-12T12:22:21.741 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.741 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.741 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136179 s, 77.0 MB/s 2024-09-12T12:22:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.757 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130294 s, 80.5 MB/s 2024-09-12T12:22:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.774 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143471 s, 73.1 MB/s 2024-09-12T12:22:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126897 s, 82.6 MB/s 2024-09-12T12:22:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128308 s, 81.7 MB/s 2024-09-12T12:22:21.821 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.822 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.822 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014035 s, 74.7 MB/s 2024-09-12T12:22:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.839 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143293 s, 73.2 MB/s 2024-09-12T12:22:21.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.858 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167031 s, 62.8 MB/s 2024-09-12T12:22:21.873 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.874 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130072 s, 80.6 MB/s 2024-09-12T12:22:21.889 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.890 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133734 s, 78.4 MB/s 2024-09-12T12:22:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147358 s, 71.2 MB/s 2024-09-12T12:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:21.914 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:21.914 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:21.914 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.9 2024-09-12T12:22:21.914 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:21.915 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:21.915 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:21.915 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:21.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:21.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.982 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140967 s, 74.4 MB/s 2024-09-12T12:22:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148558 s, 70.6 MB/s 2024-09-12T12:22:22.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.017 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014782 s, 70.9 MB/s 2024-09-12T12:22:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.033 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126993 s, 82.6 MB/s 2024-09-12T12:22:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131713 s, 79.6 MB/s 2024-09-12T12:22:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.066 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137518 s, 76.3 MB/s 2024-09-12T12:22:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144195 s, 72.7 MB/s 2024-09-12T12:22:22.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.099 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141667 s, 74.0 MB/s 2024-09-12T12:22:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.116 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136115 s, 77.0 MB/s 2024-09-12T12:22:22.132 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.132 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.132 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139053 s, 75.4 MB/s 2024-09-12T12:22:22.150 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.150 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.150 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152415 s, 68.8 MB/s 2024-09-12T12:22:22.166 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.167 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140384 s, 74.7 MB/s 2024-09-12T12:22:22.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.183 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135915 s, 77.1 MB/s 2024-09-12T12:22:22.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.200 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139032 s, 75.4 MB/s 2024-09-12T12:22:22.216 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.216 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.216 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013777 s, 76.1 MB/s 2024-09-12T12:22:22.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.232 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.232 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130789 s, 80.2 MB/s 2024-09-12T12:22:22.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.248 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135508 s, 77.4 MB/s 2024-09-12T12:22:22.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.265 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014329 s, 73.2 MB/s 2024-09-12T12:22:22.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.282 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139855 s, 75.0 MB/s 2024-09-12T12:22:22.297 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.297 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.297 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128164 s, 81.8 MB/s 2024-09-12T12:22:22.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.313 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132391 s, 79.2 MB/s 2024-09-12T12:22:22.329 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.329 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.329 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136702 s, 76.7 MB/s 2024-09-12T12:22:22.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.345 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133735 s, 78.4 MB/s 2024-09-12T12:22:22.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.360 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123346 s, 85.0 MB/s 2024-09-12T12:22:22.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.376 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012898 s, 81.3 MB/s 2024-09-12T12:22:22.392 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.393 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.393 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139762 s, 75.0 MB/s 2024-09-12T12:22:22.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.410 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142634 s, 73.5 MB/s 2024-09-12T12:22:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.429 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129996 s, 80.7 MB/s 2024-09-12T12:22:22.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.443 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145432 s, 72.1 MB/s 2024-09-12T12:22:22.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.457 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.457 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111008 s, 94.5 MB/s 2024-09-12T12:22:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124361 s, 84.3 MB/s 2024-09-12T12:22:22.488 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.489 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141279 s, 74.2 MB/s 2024-09-12T12:22:22.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:22.496 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:22.496 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:22.496 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.10 2024-09-12T12:22:22.496 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:22.496 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:22.496 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:22.496 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:22.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:22.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.609 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132367 s, 79.2 MB/s 2024-09-12T12:22:22.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.624 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124538 s, 84.2 MB/s 2024-09-12T12:22:22.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.640 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135264 s, 77.5 MB/s 2024-09-12T12:22:22.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.659 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158324 s, 66.2 MB/s 2024-09-12T12:22:22.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.674 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125544 s, 83.5 MB/s 2024-09-12T12:22:22.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.690 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130823 s, 80.2 MB/s 2024-09-12T12:22:22.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.707 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014334 s, 73.2 MB/s 2024-09-12T12:22:22.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.724 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143556 s, 73.0 MB/s 2024-09-12T12:22:22.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.741 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.741 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135421 s, 77.4 MB/s 2024-09-12T12:22:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.756 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123316 s, 85.0 MB/s 2024-09-12T12:22:22.771 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.771 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.772 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129925 s, 80.7 MB/s 2024-09-12T12:22:22.786 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.786 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.786 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120371 s, 87.1 MB/s 2024-09-12T12:22:22.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.803 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013995 s, 74.9 MB/s 2024-09-12T12:22:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133559 s, 78.5 MB/s 2024-09-12T12:22:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.834 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129449 s, 81.0 MB/s 2024-09-12T12:22:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.851 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139961 s, 74.9 MB/s 2024-09-12T12:22:22.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.866 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127298 s, 82.4 MB/s 2024-09-12T12:22:22.882 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.882 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.883 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133866 s, 78.3 MB/s 2024-09-12T12:22:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.900 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151405 s, 69.3 MB/s 2024-09-12T12:22:22.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.917 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134186 s, 78.1 MB/s 2024-09-12T12:22:22.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.933 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140481 s, 74.6 MB/s 2024-09-12T12:22:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.951 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147975 s, 70.9 MB/s 2024-09-12T12:22:22.967 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.967 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.967 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134762 s, 77.8 MB/s 2024-09-12T12:22:22.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:22.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:22.987 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164641 s, 63.7 MB/s 2024-09-12T12:22:23.003 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.003 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.004 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141216 s, 74.3 MB/s 2024-09-12T12:22:23.019 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.019 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.019 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133645 s, 78.5 MB/s 2024-09-12T12:22:23.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.035 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129315 s, 81.1 MB/s 2024-09-12T12:22:23.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116832 s, 89.8 MB/s 2024-09-12T12:22:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.067 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013401 s, 78.2 MB/s 2024-09-12T12:22:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.081 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131798 s, 79.6 MB/s 2024-09-12T12:22:23.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.098 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135723 s, 77.3 MB/s 2024-09-12T12:22:23.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.115 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.115 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145128 s, 72.3 MB/s 2024-09-12T12:22:23.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:23.122 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:23.122 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:23.122 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.11 2024-09-12T12:22:23.122 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:23.122 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:23.123 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:23.123 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:23.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:23.190 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.191 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.191 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133696 s, 78.4 MB/s 2024-09-12T12:22:23.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.206 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129783 s, 80.8 MB/s 2024-09-12T12:22:23.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.222 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127369 s, 82.3 MB/s 2024-09-12T12:22:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142136 s, 73.8 MB/s 2024-09-12T12:22:23.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.255 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140889 s, 74.4 MB/s 2024-09-12T12:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134811 s, 77.8 MB/s 2024-09-12T12:22:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.287 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013342 s, 78.6 MB/s 2024-09-12T12:22:23.303 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.303 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.304 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014148 s, 74.1 MB/s 2024-09-12T12:22:23.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.320 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141923 s, 73.9 MB/s 2024-09-12T12:22:23.339 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.339 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.339 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159637 s, 65.7 MB/s 2024-09-12T12:22:23.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.355 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134731 s, 77.8 MB/s 2024-09-12T12:22:23.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.371 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130493 s, 80.4 MB/s 2024-09-12T12:22:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129713 s, 80.8 MB/s 2024-09-12T12:22:23.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.403 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132597 s, 79.1 MB/s 2024-09-12T12:22:23.419 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.419 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.419 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141155 s, 74.3 MB/s 2024-09-12T12:22:23.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.436 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.436 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138506 s, 75.7 MB/s 2024-09-12T12:22:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.455 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016044 s, 65.4 MB/s 2024-09-12T12:22:23.470 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.470 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.470 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129527 s, 81.0 MB/s 2024-09-12T12:22:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.489 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016054 s, 65.3 MB/s 2024-09-12T12:22:23.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.505 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136271 s, 76.9 MB/s 2024-09-12T12:22:23.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.521 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133639 s, 78.5 MB/s 2024-09-12T12:22:23.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.539 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147842 s, 70.9 MB/s 2024-09-12T12:22:23.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.555 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137318 s, 76.4 MB/s 2024-09-12T12:22:23.571 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.571 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.571 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129222 s, 81.1 MB/s 2024-09-12T12:22:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.587 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136397 s, 76.9 MB/s 2024-09-12T12:22:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.604 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135621 s, 77.3 MB/s 2024-09-12T12:22:23.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.621 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143269 s, 73.2 MB/s 2024-09-12T12:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135159 s, 77.6 MB/s 2024-09-12T12:22:23.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.656 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164154 s, 63.9 MB/s 2024-09-12T12:22:23.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.672 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139782 s, 75.0 MB/s 2024-09-12T12:22:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.691 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.691 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154727 s, 67.8 MB/s 2024-09-12T12:22:23.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.708 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147766 s, 71.0 MB/s 2024-09-12T12:22:23.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:23.715 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:23.715 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:23.715 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.12 2024-09-12T12:22:23.716 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:23.716 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:23.716 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:23.716 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:23.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.824 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135436 s, 77.4 MB/s 2024-09-12T12:22:23.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016436 s, 63.8 MB/s 2024-09-12T12:22:23.861 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.861 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.861 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149087 s, 70.3 MB/s 2024-09-12T12:22:23.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.880 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160973 s, 65.1 MB/s 2024-09-12T12:22:23.896 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.896 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.897 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138581 s, 75.7 MB/s 2024-09-12T12:22:23.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.917 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174104 s, 60.2 MB/s 2024-09-12T12:22:23.932 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.932 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.932 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133073 s, 78.8 MB/s 2024-09-12T12:22:23.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.948 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132604 s, 79.1 MB/s 2024-09-12T12:22:23.965 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.965 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.965 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142357 s, 73.7 MB/s 2024-09-12T12:22:23.979 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.979 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.979 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113716 s, 92.2 MB/s 2024-09-12T12:22:23.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:23.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:23.996 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140595 s, 74.6 MB/s 2024-09-12T12:22:24.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.012 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128498 s, 81.6 MB/s 2024-09-12T12:22:24.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.028 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141132 s, 74.3 MB/s 2024-09-12T12:22:24.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.045 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138213 s, 75.9 MB/s 2024-09-12T12:22:24.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.061 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130562 s, 80.3 MB/s 2024-09-12T12:22:24.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01443 s, 72.7 MB/s 2024-09-12T12:22:24.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.094 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135071 s, 77.6 MB/s 2024-09-12T12:22:24.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151149 s, 69.4 MB/s 2024-09-12T12:22:24.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.128 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136818 s, 76.6 MB/s 2024-09-12T12:22:24.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.144 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140275 s, 74.8 MB/s 2024-09-12T12:22:24.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.161 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133554 s, 78.5 MB/s 2024-09-12T12:22:24.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.177 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01305 s, 80.4 MB/s 2024-09-12T12:22:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.194 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152356 s, 68.8 MB/s 2024-09-12T12:22:24.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.212 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151401 s, 69.3 MB/s 2024-09-12T12:22:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.230 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147008 s, 71.3 MB/s 2024-09-12T12:22:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148049 s, 70.8 MB/s 2024-09-12T12:22:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163164 s, 64.3 MB/s 2024-09-12T12:22:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152113 s, 68.9 MB/s 2024-09-12T12:22:24.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134183 s, 78.1 MB/s 2024-09-12T12:22:24.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.317 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129654 s, 80.9 MB/s 2024-09-12T12:22:24.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.333 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130245 s, 80.5 MB/s 2024-09-12T12:22:24.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128536 s, 81.6 MB/s 2024-09-12T12:22:24.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:24.355 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:24.355 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:24.355 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.13 2024-09-12T12:22:24.355 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:24.356 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:24.356 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:24.356 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:24.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:24.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.425 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133847 s, 78.3 MB/s 2024-09-12T12:22:24.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.441 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142528 s, 73.6 MB/s 2024-09-12T12:22:24.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.458 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137159 s, 76.4 MB/s 2024-09-12T12:22:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.474 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136977 s, 76.6 MB/s 2024-09-12T12:22:24.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.491 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145382 s, 72.1 MB/s 2024-09-12T12:22:24.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.508 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135335 s, 77.5 MB/s 2024-09-12T12:22:24.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.524 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013794 s, 76.0 MB/s 2024-09-12T12:22:24.542 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.542 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.542 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153372 s, 68.4 MB/s 2024-09-12T12:22:24.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142031 s, 73.8 MB/s 2024-09-12T12:22:24.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.576 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145008 s, 72.3 MB/s 2024-09-12T12:22:24.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.595 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165173 s, 63.5 MB/s 2024-09-12T12:22:24.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.611 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126938 s, 82.6 MB/s 2024-09-12T12:22:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.629 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155299 s, 67.5 MB/s 2024-09-12T12:22:24.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.648 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.648 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156208 s, 67.1 MB/s 2024-09-12T12:22:24.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.668 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177367 s, 59.1 MB/s 2024-09-12T12:22:24.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.686 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.686 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148579 s, 70.6 MB/s 2024-09-12T12:22:24.702 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.702 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.702 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142195 s, 73.7 MB/s 2024-09-12T12:22:24.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.719 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143493 s, 73.1 MB/s 2024-09-12T12:22:24.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.737 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146853 s, 71.4 MB/s 2024-09-12T12:22:24.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.752 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130634 s, 80.3 MB/s 2024-09-12T12:22:24.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.768 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130396 s, 80.4 MB/s 2024-09-12T12:22:24.783 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.783 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.784 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01275 s, 82.2 MB/s 2024-09-12T12:22:24.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.799 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127141 s, 82.5 MB/s 2024-09-12T12:22:24.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.815 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136379 s, 76.9 MB/s 2024-09-12T12:22:24.834 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.835 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169318 s, 61.9 MB/s 2024-09-12T12:22:24.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.852 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145365 s, 72.1 MB/s 2024-09-12T12:22:24.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.867 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125972 s, 83.2 MB/s 2024-09-12T12:22:24.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.883 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136549 s, 76.8 MB/s 2024-09-12T12:22:24.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.900 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142608 s, 73.5 MB/s 2024-09-12T12:22:24.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.917 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013776 s, 76.1 MB/s 2024-09-12T12:22:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.934 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136843 s, 76.6 MB/s 2024-09-12T12:22:24.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:24.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:24.948 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116317 s, 90.1 MB/s 2024-09-12T12:22:24.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:24.955 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:24.955 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:24.955 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.14 2024-09-12T12:22:24.955 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:24.955 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:24.955 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:24.956 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:25.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:25.070 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.070 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.070 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157286 s, 66.7 MB/s 2024-09-12T12:22:25.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175494 s, 59.8 MB/s 2024-09-12T12:22:25.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.107 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140589 s, 74.6 MB/s 2024-09-12T12:22:25.124 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.124 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.124 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142922 s, 73.4 MB/s 2024-09-12T12:22:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016823 s, 62.3 MB/s 2024-09-12T12:22:25.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.160 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141517 s, 74.1 MB/s 2024-09-12T12:22:25.175 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.176 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129603 s, 80.9 MB/s 2024-09-12T12:22:25.191 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.191 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.191 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124952 s, 83.9 MB/s 2024-09-12T12:22:25.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.206 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123357 s, 85.0 MB/s 2024-09-12T12:22:25.225 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.225 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.225 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162469 s, 64.5 MB/s 2024-09-12T12:22:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132548 s, 79.1 MB/s 2024-09-12T12:22:25.256 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.257 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.257 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130845 s, 80.1 MB/s 2024-09-12T12:22:25.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.273 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013485 s, 77.8 MB/s 2024-09-12T12:22:25.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.289 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139586 s, 75.1 MB/s 2024-09-12T12:22:25.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.305 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130678 s, 80.2 MB/s 2024-09-12T12:22:25.322 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.322 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.322 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141423 s, 74.1 MB/s 2024-09-12T12:22:25.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.342 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167639 s, 62.5 MB/s 2024-09-12T12:22:25.361 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.361 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.361 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016802 s, 62.4 MB/s 2024-09-12T12:22:25.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141021 s, 74.4 MB/s 2024-09-12T12:22:25.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.396 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144141 s, 72.7 MB/s 2024-09-12T12:22:25.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.413 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142661 s, 73.5 MB/s 2024-09-12T12:22:25.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.430 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013685 s, 76.6 MB/s 2024-09-12T12:22:25.450 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.450 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.450 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173853 s, 60.3 MB/s 2024-09-12T12:22:25.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.468 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01414 s, 74.2 MB/s 2024-09-12T12:22:25.488 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.489 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158592 s, 66.1 MB/s 2024-09-12T12:22:25.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.504 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141081 s, 74.3 MB/s 2024-09-12T12:22:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125065 s, 83.8 MB/s 2024-09-12T12:22:25.536 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.536 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.536 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014049 s, 74.6 MB/s 2024-09-12T12:22:25.554 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.555 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150377 s, 69.7 MB/s 2024-09-12T12:22:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.572 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140584 s, 74.6 MB/s 2024-09-12T12:22:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.589 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142179 s, 73.8 MB/s 2024-09-12T12:22:25.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.606 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140299 s, 74.7 MB/s 2024-09-12T12:22:25.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:25.614 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:25.614 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:25.614 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.15 2024-09-12T12:22:25.614 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:25.614 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:25.614 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:25.614 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:25.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:25.681 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.682 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132062 s, 79.4 MB/s 2024-09-12T12:22:25.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.698 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134512 s, 78.0 MB/s 2024-09-12T12:22:25.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.716 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014736 s, 71.2 MB/s 2024-09-12T12:22:25.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.732 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.732 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012357 s, 84.9 MB/s 2024-09-12T12:22:25.747 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129476 s, 81.0 MB/s 2024-09-12T12:22:25.765 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147274 s, 71.2 MB/s 2024-09-12T12:22:25.783 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.784 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.784 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147705 s, 71.0 MB/s 2024-09-12T12:22:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.802 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014581 s, 71.9 MB/s 2024-09-12T12:22:25.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014179 s, 74.0 MB/s 2024-09-12T12:22:25.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.836 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139498 s, 75.2 MB/s 2024-09-12T12:22:25.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.853 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01457 s, 72.0 MB/s 2024-09-12T12:22:25.870 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.870 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.870 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132655 s, 79.0 MB/s 2024-09-12T12:22:25.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.887 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.887 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142096 s, 73.8 MB/s 2024-09-12T12:22:25.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.906 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015961 s, 65.7 MB/s 2024-09-12T12:22:25.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134142 s, 78.2 MB/s 2024-09-12T12:22:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136522 s, 76.8 MB/s 2024-09-12T12:22:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.956 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138551 s, 75.7 MB/s 2024-09-12T12:22:25.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.973 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138852 s, 75.5 MB/s 2024-09-12T12:22:25.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:25.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:25.989 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130818 s, 80.2 MB/s 2024-09-12T12:22:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138183 s, 75.9 MB/s 2024-09-12T12:22:26.023 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.023 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.023 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142816 s, 73.4 MB/s 2024-09-12T12:22:26.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.040 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132064 s, 79.4 MB/s 2024-09-12T12:22:26.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.056 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125676 s, 83.4 MB/s 2024-09-12T12:22:26.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.072 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134498 s, 78.0 MB/s 2024-09-12T12:22:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.088 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125721 s, 83.4 MB/s 2024-09-12T12:22:26.105 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.105 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140853 s, 74.4 MB/s 2024-09-12T12:22:26.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.121 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.121 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123371 s, 85.0 MB/s 2024-09-12T12:22:26.138 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.138 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.138 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141555 s, 74.1 MB/s 2024-09-12T12:22:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.156 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142249 s, 73.7 MB/s 2024-09-12T12:22:26.170 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.171 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122954 s, 85.3 MB/s 2024-09-12T12:22:26.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130514 s, 80.3 MB/s 2024-09-12T12:22:26.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.203 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129559 s, 80.9 MB/s 2024-09-12T12:22:26.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:26.210 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:26.211 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:26.211 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.16 2024-09-12T12:22:26.211 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:26.211 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:26.211 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:26.211 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:26.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:26.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.321 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138566 s, 75.7 MB/s 2024-09-12T12:22:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.339 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144041 s, 72.8 MB/s 2024-09-12T12:22:26.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.355 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125443 s, 83.6 MB/s 2024-09-12T12:22:26.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.371 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133196 s, 78.7 MB/s 2024-09-12T12:22:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.388 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138663 s, 75.6 MB/s 2024-09-12T12:22:26.405 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.405 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.405 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140658 s, 74.5 MB/s 2024-09-12T12:22:26.421 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.421 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133076 s, 78.8 MB/s 2024-09-12T12:22:26.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.439 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139514 s, 75.2 MB/s 2024-09-12T12:22:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.454 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125347 s, 83.7 MB/s 2024-09-12T12:22:26.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.470 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127182 s, 82.4 MB/s 2024-09-12T12:22:26.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.488 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145169 s, 72.2 MB/s 2024-09-12T12:22:26.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.505 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014185 s, 73.9 MB/s 2024-09-12T12:22:26.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.522 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139628 s, 75.1 MB/s 2024-09-12T12:22:26.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.538 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132248 s, 79.3 MB/s 2024-09-12T12:22:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.555 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139559 s, 75.1 MB/s 2024-09-12T12:22:26.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.572 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140177 s, 74.8 MB/s 2024-09-12T12:22:26.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.588 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121948 s, 86.0 MB/s 2024-09-12T12:22:26.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.605 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135578 s, 77.3 MB/s 2024-09-12T12:22:26.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.621 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131052 s, 80.0 MB/s 2024-09-12T12:22:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.640 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166758 s, 62.9 MB/s 2024-09-12T12:22:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137833 s, 76.1 MB/s 2024-09-12T12:22:26.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.674 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013781 s, 76.1 MB/s 2024-09-12T12:22:26.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.690 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133324 s, 78.6 MB/s 2024-09-12T12:22:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.710 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165909 s, 63.2 MB/s 2024-09-12T12:22:26.726 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.726 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.726 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125179 s, 83.8 MB/s 2024-09-12T12:22:26.741 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.741 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.741 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124221 s, 84.4 MB/s 2024-09-12T12:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138441 s, 75.7 MB/s 2024-09-12T12:22:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148834 s, 70.5 MB/s 2024-09-12T12:22:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140456 s, 74.7 MB/s 2024-09-12T12:22:26.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.809 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130507 s, 80.3 MB/s 2024-09-12T12:22:26.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.826 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140214 s, 74.8 MB/s 2024-09-12T12:22:26.844 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.844 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.844 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144757 s, 72.4 MB/s 2024-09-12T12:22:26.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:26.851 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:26.851 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:26.851 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.17 2024-09-12T12:22:26.851 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:26.851 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:26.851 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:26.851 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.961 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140262 s, 74.8 MB/s 2024-09-12T12:22:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.977 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124853 s, 84.0 MB/s 2024-09-12T12:22:26.995 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:26.995 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:26.995 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150814 s, 69.5 MB/s 2024-09-12T12:22:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149004 s, 70.4 MB/s 2024-09-12T12:22:27.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.028 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012061 s, 86.9 MB/s 2024-09-12T12:22:27.046 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.046 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.047 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148927 s, 70.4 MB/s 2024-09-12T12:22:27.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.063 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130247 s, 80.5 MB/s 2024-09-12T12:22:27.080 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.080 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.080 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143777 s, 72.9 MB/s 2024-09-12T12:22:27.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134582 s, 77.9 MB/s 2024-09-12T12:22:27.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.113 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137985 s, 76.0 MB/s 2024-09-12T12:22:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.130 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133631 s, 78.5 MB/s 2024-09-12T12:22:27.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.148 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147157 s, 71.3 MB/s 2024-09-12T12:22:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.165 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014202 s, 73.8 MB/s 2024-09-12T12:22:27.182 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.182 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.182 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139905 s, 74.9 MB/s 2024-09-12T12:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144607 s, 72.5 MB/s 2024-09-12T12:22:27.216 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.217 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.217 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136098 s, 77.0 MB/s 2024-09-12T12:22:27.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.233 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013143 s, 79.8 MB/s 2024-09-12T12:22:27.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.249 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131659 s, 79.6 MB/s 2024-09-12T12:22:27.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.265 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129909 s, 80.7 MB/s 2024-09-12T12:22:27.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.282 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132372 s, 79.2 MB/s 2024-09-12T12:22:27.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140828 s, 74.5 MB/s 2024-09-12T12:22:27.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.321 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192471 s, 54.5 MB/s 2024-09-12T12:22:27.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.338 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137093 s, 76.5 MB/s 2024-09-12T12:22:27.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.356 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146335 s, 71.7 MB/s 2024-09-12T12:22:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132538 s, 79.1 MB/s 2024-09-12T12:22:27.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.389 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130635 s, 80.3 MB/s 2024-09-12T12:22:27.408 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.409 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161167 s, 65.1 MB/s 2024-09-12T12:22:27.426 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.426 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.426 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143623 s, 73.0 MB/s 2024-09-12T12:22:27.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.444 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144676 s, 72.5 MB/s 2024-09-12T12:22:27.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.460 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128792 s, 81.4 MB/s 2024-09-12T12:22:27.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.476 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131757 s, 79.6 MB/s 2024-09-12T12:22:27.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169769 s, 61.8 MB/s 2024-09-12T12:22:27.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:27.504 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:27.504 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:27.504 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.18 2024-09-12T12:22:27.504 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:27.504 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:27.504 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:27.505 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:27.574 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.574 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.574 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143188 s, 73.2 MB/s 2024-09-12T12:22:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135216 s, 77.5 MB/s 2024-09-12T12:22:27.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:27.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:27.607 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123604 s, 84.8 MB/s 2024-09-12T12:22:28.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.512 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.901857 s, 1.2 MB/s 2024-09-12T12:22:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.534 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194005 s, 54.0 MB/s 2024-09-12T12:22:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215674 s, 48.6 MB/s 2024-09-12T12:22:28.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.581 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166514 s, 63.0 MB/s 2024-09-12T12:22:28.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.601 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162696 s, 64.4 MB/s 2024-09-12T12:22:28.619 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.619 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.619 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149275 s, 70.2 MB/s 2024-09-12T12:22:28.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.635 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120778 s, 86.8 MB/s 2024-09-12T12:22:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141157 s, 74.3 MB/s 2024-09-12T12:22:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127297 s, 82.4 MB/s 2024-09-12T12:22:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132242 s, 79.3 MB/s 2024-09-12T12:22:28.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.702 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141476 s, 74.1 MB/s 2024-09-12T12:22:28.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.717 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122576 s, 85.5 MB/s 2024-09-12T12:22:28.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.737 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016743 s, 62.6 MB/s 2024-09-12T12:22:28.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142947 s, 73.4 MB/s 2024-09-12T12:22:28.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.773 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166922 s, 62.8 MB/s 2024-09-12T12:22:28.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.789 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130291 s, 80.5 MB/s 2024-09-12T12:22:28.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.803 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011517 s, 91.0 MB/s 2024-09-12T12:22:28.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136149 s, 77.0 MB/s 2024-09-12T12:22:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148466 s, 70.6 MB/s 2024-09-12T12:22:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.854 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143949 s, 72.8 MB/s 2024-09-12T12:22:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.869 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125088 s, 83.8 MB/s 2024-09-12T12:22:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.886 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.886 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136591 s, 76.8 MB/s 2024-09-12T12:22:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.900 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118288 s, 88.6 MB/s 2024-09-12T12:22:28.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.917 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013586 s, 77.2 MB/s 2024-09-12T12:22:28.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.932 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.932 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126525 s, 82.9 MB/s 2024-09-12T12:22:28.949 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.949 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.949 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148067 s, 70.8 MB/s 2024-09-12T12:22:28.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.966 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142749 s, 73.5 MB/s 2024-09-12T12:22:28.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:28.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:28.983 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143221 s, 73.2 MB/s 2024-09-12T12:22:29.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.001 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152207 s, 68.9 MB/s 2024-09-12T12:22:29.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:29.008 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:29.009 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:29.009 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.19 2024-09-12T12:22:29.009 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:29.009 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:29.009 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:29.009 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:29.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:29.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.077 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148167 s, 70.8 MB/s 2024-09-12T12:22:29.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.093 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.093 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129129 s, 81.2 MB/s 2024-09-12T12:22:29.110 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.111 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147823 s, 70.9 MB/s 2024-09-12T12:22:29.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.127 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132461 s, 79.2 MB/s 2024-09-12T12:22:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.145 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151402 s, 69.3 MB/s 2024-09-12T12:22:29.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.163 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163202 s, 64.3 MB/s 2024-09-12T12:22:29.180 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.180 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.180 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142832 s, 73.4 MB/s 2024-09-12T12:22:29.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.201 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017944 s, 58.4 MB/s 2024-09-12T12:22:29.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.218 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147687 s, 71.0 MB/s 2024-09-12T12:22:29.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.235 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137412 s, 76.3 MB/s 2024-09-12T12:22:29.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.251 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013342 s, 78.6 MB/s 2024-09-12T12:22:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125594 s, 83.5 MB/s 2024-09-12T12:22:29.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.282 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130586 s, 80.3 MB/s 2024-09-12T12:22:29.298 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.298 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.298 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128141 s, 81.8 MB/s 2024-09-12T12:22:29.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.315 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141881 s, 73.9 MB/s 2024-09-12T12:22:29.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.332 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142707 s, 73.5 MB/s 2024-09-12T12:22:29.349 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.349 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.349 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01391 s, 75.4 MB/s 2024-09-12T12:22:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131237 s, 79.9 MB/s 2024-09-12T12:22:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137 s, 76.5 MB/s 2024-09-12T12:22:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142858 s, 73.4 MB/s 2024-09-12T12:22:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135019 s, 77.7 MB/s 2024-09-12T12:22:29.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.430 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129885 s, 80.7 MB/s 2024-09-12T12:22:29.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.446 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131938 s, 79.5 MB/s 2024-09-12T12:22:29.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.462 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135892 s, 77.2 MB/s 2024-09-12T12:22:29.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.479 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136832 s, 76.6 MB/s 2024-09-12T12:22:29.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.495 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137432 s, 76.3 MB/s 2024-09-12T12:22:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140332 s, 74.7 MB/s 2024-09-12T12:22:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145015 s, 72.3 MB/s 2024-09-12T12:22:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.550 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172895 s, 60.6 MB/s 2024-09-12T12:22:29.570 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.570 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.571 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161134 s, 65.1 MB/s 2024-09-12T12:22:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123581 s, 84.8 MB/s 2024-09-12T12:22:29.600 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134283 s, 78.1 MB/s 2024-09-12T12:22:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:29.609 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:29.609 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:29.609 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.20 2024-09-12T12:22:29.609 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:29.609 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:29.609 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:29.609 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:29.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135237 s, 77.5 MB/s 2024-09-12T12:22:29.693 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.693 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.693 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139302 s, 75.3 MB/s 2024-09-12T12:22:29.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.712 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162165 s, 64.7 MB/s 2024-09-12T12:22:29.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.728 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130914 s, 80.1 MB/s 2024-09-12T12:22:29.748 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016962 s, 61.8 MB/s 2024-09-12T12:22:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137916 s, 76.0 MB/s 2024-09-12T12:22:29.781 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.781 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.781 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142645 s, 73.5 MB/s 2024-09-12T12:22:29.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.797 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129714 s, 80.8 MB/s 2024-09-12T12:22:29.813 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.813 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.813 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132741 s, 79.0 MB/s 2024-09-12T12:22:29.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.829 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133659 s, 78.5 MB/s 2024-09-12T12:22:29.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.845 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125104 s, 83.8 MB/s 2024-09-12T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115886 s, 90.5 MB/s 2024-09-12T12:22:29.876 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.876 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.876 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144677 s, 72.5 MB/s 2024-09-12T12:22:29.892 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.893 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138411 s, 75.8 MB/s 2024-09-12T12:22:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.908 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128467 s, 81.6 MB/s 2024-09-12T12:22:29.924 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138006 s, 76.0 MB/s 2024-09-12T12:22:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159249 s, 65.8 MB/s 2024-09-12T12:22:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.960 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136124 s, 77.0 MB/s 2024-09-12T12:22:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.978 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013013 s, 80.6 MB/s 2024-09-12T12:22:29.995 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:29.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:29.996 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173758 s, 60.3 MB/s 2024-09-12T12:22:30.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.016 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.016 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169252 s, 62.0 MB/s 2024-09-12T12:22:30.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.034 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163069 s, 64.3 MB/s 2024-09-12T12:22:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.050 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132013 s, 79.4 MB/s 2024-09-12T12:22:30.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.065 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125271 s, 83.7 MB/s 2024-09-12T12:22:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141078 s, 74.3 MB/s 2024-09-12T12:22:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.102 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174535 s, 60.1 MB/s 2024-09-12T12:22:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.118 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.119 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133098 s, 78.8 MB/s 2024-09-12T12:22:30.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.137 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154866 s, 67.7 MB/s 2024-09-12T12:22:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132215 s, 79.3 MB/s 2024-09-12T12:22:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.168 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125927 s, 83.3 MB/s 2024-09-12T12:22:30.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.184 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133322 s, 78.6 MB/s 2024-09-12T12:22:30.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.201 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138311 s, 75.8 MB/s 2024-09-12T12:22:30.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:30.208 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:30.208 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:30.208 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.21 2024-09-12T12:22:30.208 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:30.208 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:30.209 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:30.209 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:30.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:30.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.275 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012987 s, 80.7 MB/s 2024-09-12T12:22:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.291 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013221 s, 79.3 MB/s 2024-09-12T12:22:30.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.306 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131611 s, 79.7 MB/s 2024-09-12T12:22:30.323 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.323 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.323 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140196 s, 74.8 MB/s 2024-09-12T12:22:30.339 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.339 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.339 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138275 s, 75.8 MB/s 2024-09-12T12:22:30.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.355 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132406 s, 79.2 MB/s 2024-09-12T12:22:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108187 s, 96.9 MB/s 2024-09-12T12:22:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.386 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141764 s, 74.0 MB/s 2024-09-12T12:22:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113819 s, 92.1 MB/s 2024-09-12T12:22:30.415 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.416 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133566 s, 78.5 MB/s 2024-09-12T12:22:30.432 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.432 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.432 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135037 s, 77.7 MB/s 2024-09-12T12:22:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125014 s, 83.9 MB/s 2024-09-12T12:22:30.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.462 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121266 s, 86.5 MB/s 2024-09-12T12:22:30.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.479 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140378 s, 74.7 MB/s 2024-09-12T12:22:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.496 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138239 s, 75.9 MB/s 2024-09-12T12:22:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150031 s, 69.9 MB/s 2024-09-12T12:22:30.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.532 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164267 s, 63.8 MB/s 2024-09-12T12:22:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.553 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175321 s, 59.8 MB/s 2024-09-12T12:22:30.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.568 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01272 s, 82.4 MB/s 2024-09-12T12:22:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139971 s, 74.9 MB/s 2024-09-12T12:22:30.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.602 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145444 s, 72.1 MB/s 2024-09-12T12:22:30.619 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.619 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.619 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01395 s, 75.2 MB/s 2024-09-12T12:22:30.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.636 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142503 s, 73.6 MB/s 2024-09-12T12:22:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.652 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138567 s, 75.7 MB/s 2024-09-12T12:22:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.670 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142649 s, 73.5 MB/s 2024-09-12T12:22:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.686 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130199 s, 80.5 MB/s 2024-09-12T12:22:30.703 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.703 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.703 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145858 s, 71.9 MB/s 2024-09-12T12:22:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.719 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135913 s, 77.2 MB/s 2024-09-12T12:22:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.736 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144526 s, 72.6 MB/s 2024-09-12T12:22:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.752 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129291 s, 81.1 MB/s 2024-09-12T12:22:30.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.768 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136618 s, 76.8 MB/s 2024-09-12T12:22:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174139 s, 60.2 MB/s 2024-09-12T12:22:30.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:30.795 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:30.795 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:30.795 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.22 2024-09-12T12:22:30.795 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:30.796 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:30.796 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:30.796 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:30.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.864 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145071 s, 72.3 MB/s 2024-09-12T12:22:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138683 s, 75.6 MB/s 2024-09-12T12:22:30.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.897 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141988 s, 73.8 MB/s 2024-09-12T12:22:30.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.913 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135993 s, 77.1 MB/s 2024-09-12T12:22:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.929 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130634 s, 80.3 MB/s 2024-09-12T12:22:30.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.948 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157468 s, 66.6 MB/s 2024-09-12T12:22:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136599 s, 76.8 MB/s 2024-09-12T12:22:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013576 s, 77.2 MB/s 2024-09-12T12:22:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138246 s, 75.8 MB/s 2024-09-12T12:22:31.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.014 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141863 s, 73.9 MB/s 2024-09-12T12:22:31.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.031 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.031 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144921 s, 72.4 MB/s 2024-09-12T12:22:31.047 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.047 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.047 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137368 s, 76.3 MB/s 2024-09-12T12:22:31.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.066 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167838 s, 62.5 MB/s 2024-09-12T12:22:31.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.083 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144711 s, 72.5 MB/s 2024-09-12T12:22:31.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.100 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013448 s, 78.0 MB/s 2024-09-12T12:22:31.115 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.115 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.115 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129215 s, 81.1 MB/s 2024-09-12T12:22:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129553 s, 80.9 MB/s 2024-09-12T12:22:31.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.147 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128122 s, 81.8 MB/s 2024-09-12T12:22:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136507 s, 76.8 MB/s 2024-09-12T12:22:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.179 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013926 s, 75.3 MB/s 2024-09-12T12:22:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.196 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143494 s, 73.1 MB/s 2024-09-12T12:22:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.211 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124112 s, 84.5 MB/s 2024-09-12T12:22:31.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.228 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132911 s, 78.9 MB/s 2024-09-12T12:22:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.244 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136669 s, 76.7 MB/s 2024-09-12T12:22:31.260 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.260 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.260 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132821 s, 78.9 MB/s 2024-09-12T12:22:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.279 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164507 s, 63.7 MB/s 2024-09-12T12:22:31.295 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.295 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.296 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138781 s, 75.6 MB/s 2024-09-12T12:22:31.310 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.311 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.311 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125353 s, 83.6 MB/s 2024-09-12T12:22:31.326 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.327 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.327 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131624 s, 79.7 MB/s 2024-09-12T12:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141798 s, 73.9 MB/s 2024-09-12T12:22:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.359 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133447 s, 78.6 MB/s 2024-09-12T12:22:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146432 s, 71.6 MB/s 2024-09-12T12:22:31.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:31.384 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:31.384 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:31.384 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.23 2024-09-12T12:22:31.384 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:31.384 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:31.384 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:31.384 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:31.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:31.452 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.452 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.452 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141642 s, 74.0 MB/s 2024-09-12T12:22:31.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.468 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135989 s, 77.1 MB/s 2024-09-12T12:22:31.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.488 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.488 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170484 s, 61.5 MB/s 2024-09-12T12:22:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.506 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151437 s, 69.2 MB/s 2024-09-12T12:22:31.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.522 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014038 s, 74.7 MB/s 2024-09-12T12:22:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.539 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014456 s, 72.5 MB/s 2024-09-12T12:22:31.558 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167766 s, 62.5 MB/s 2024-09-12T12:22:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.575 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140953 s, 74.4 MB/s 2024-09-12T12:22:31.591 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.592 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136429 s, 76.9 MB/s 2024-09-12T12:22:31.608 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.608 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.608 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133832 s, 78.4 MB/s 2024-09-12T12:22:31.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.624 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135511 s, 77.4 MB/s 2024-09-12T12:22:31.639 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.639 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.640 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131322 s, 79.8 MB/s 2024-09-12T12:22:31.655 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.656 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131086 s, 80.0 MB/s 2024-09-12T12:22:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131966 s, 79.5 MB/s 2024-09-12T12:22:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.688 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131249 s, 79.9 MB/s 2024-09-12T12:22:31.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.704 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140185 s, 74.8 MB/s 2024-09-12T12:22:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01445 s, 72.6 MB/s 2024-09-12T12:22:31.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.738 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139838 s, 75.0 MB/s 2024-09-12T12:22:31.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135699 s, 77.3 MB/s 2024-09-12T12:22:31.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.770 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132192 s, 79.3 MB/s 2024-09-12T12:22:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.786 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133424 s, 78.6 MB/s 2024-09-12T12:22:31.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.803 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144846 s, 72.4 MB/s 2024-09-12T12:22:31.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133497 s, 78.5 MB/s 2024-09-12T12:22:31.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.836 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142362 s, 73.7 MB/s 2024-09-12T12:22:31.851 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.852 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129082 s, 81.2 MB/s 2024-09-12T12:22:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132871 s, 78.9 MB/s 2024-09-12T12:22:31.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.884 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013697 s, 76.6 MB/s 2024-09-12T12:22:31.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.902 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146955 s, 71.4 MB/s 2024-09-12T12:22:31.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.918 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133228 s, 78.7 MB/s 2024-09-12T12:22:31.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.935 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144013 s, 72.8 MB/s 2024-09-12T12:22:31.952 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.952 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.952 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143144 s, 73.3 MB/s 2024-09-12T12:22:31.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:31.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:31.968 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129101 s, 81.2 MB/s 2024-09-12T12:22:31.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:31.975 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:31.975 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:31.976 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.24 2024-09-12T12:22:31.976 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:31.976 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:31.976 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:31.976 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:32.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:32.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.043 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127395 s, 82.3 MB/s 2024-09-12T12:22:32.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.060 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145284 s, 72.2 MB/s 2024-09-12T12:22:32.076 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.077 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013361 s, 78.5 MB/s 2024-09-12T12:22:32.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.095 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147367 s, 71.2 MB/s 2024-09-12T12:22:32.110 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.110 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.110 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131931 s, 79.5 MB/s 2024-09-12T12:22:32.126 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.126 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.126 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130997 s, 80.0 MB/s 2024-09-12T12:22:32.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.145 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158474 s, 66.2 MB/s 2024-09-12T12:22:32.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.160 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130161 s, 80.6 MB/s 2024-09-12T12:22:32.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.177 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144194 s, 72.7 MB/s 2024-09-12T12:22:32.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.194 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.194 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137764 s, 76.1 MB/s 2024-09-12T12:22:32.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.211 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143609 s, 73.0 MB/s 2024-09-12T12:22:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136868 s, 76.6 MB/s 2024-09-12T12:22:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.244 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142953 s, 73.4 MB/s 2024-09-12T12:22:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133705 s, 78.4 MB/s 2024-09-12T12:22:32.276 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.276 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.276 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013118 s, 79.9 MB/s 2024-09-12T12:22:32.292 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.292 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.292 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130929 s, 80.1 MB/s 2024-09-12T12:22:32.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.308 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132109 s, 79.4 MB/s 2024-09-12T12:22:32.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.325 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138448 s, 75.7 MB/s 2024-09-12T12:22:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164904 s, 63.6 MB/s 2024-09-12T12:22:32.361 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.361 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.361 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143991 s, 72.8 MB/s 2024-09-12T12:22:32.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136028 s, 77.1 MB/s 2024-09-12T12:22:32.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.394 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136683 s, 76.7 MB/s 2024-09-12T12:22:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.410 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128395 s, 81.7 MB/s 2024-09-12T12:22:32.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.430 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.430 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165567 s, 63.3 MB/s 2024-09-12T12:22:32.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.447 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140076 s, 74.9 MB/s 2024-09-12T12:22:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160705 s, 65.2 MB/s 2024-09-12T12:22:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012647 s, 82.9 MB/s 2024-09-12T12:22:32.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.500 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140986 s, 74.4 MB/s 2024-09-12T12:22:32.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.517 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145143 s, 72.2 MB/s 2024-09-12T12:22:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131312 s, 79.9 MB/s 2024-09-12T12:22:32.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.550 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138006 s, 76.0 MB/s 2024-09-12T12:22:32.566 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.566 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.566 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129985 s, 80.7 MB/s 2024-09-12T12:22:32.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:32.574 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:32.574 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:32.574 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.25 2024-09-12T12:22:32.574 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:32.574 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:32.574 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:32.574 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:32.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:32.686 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.686 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.686 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142224 s, 73.7 MB/s 2024-09-12T12:22:32.703 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.704 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149207 s, 70.3 MB/s 2024-09-12T12:22:32.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.723 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016197 s, 64.7 MB/s 2024-09-12T12:22:32.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.741 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148116 s, 70.8 MB/s 2024-09-12T12:22:32.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.759 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151396 s, 69.3 MB/s 2024-09-12T12:22:32.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.776 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014284 s, 73.4 MB/s 2024-09-12T12:22:32.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137929 s, 76.0 MB/s 2024-09-12T12:22:32.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.809 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135648 s, 77.3 MB/s 2024-09-12T12:22:32.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.826 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135224 s, 77.5 MB/s 2024-09-12T12:22:32.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.844 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.844 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146408 s, 71.6 MB/s 2024-09-12T12:22:32.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.858 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117259 s, 89.4 MB/s 2024-09-12T12:22:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.875 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143841 s, 72.9 MB/s 2024-09-12T12:22:32.892 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.892 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.892 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138312 s, 75.8 MB/s 2024-09-12T12:22:32.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.911 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151028 s, 69.4 MB/s 2024-09-12T12:22:32.926 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.926 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.926 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127453 s, 82.3 MB/s 2024-09-12T12:22:32.943 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.943 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.943 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135926 s, 77.1 MB/s 2024-09-12T12:22:32.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.960 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142019 s, 73.8 MB/s 2024-09-12T12:22:32.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.976 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136004 s, 77.1 MB/s 2024-09-12T12:22:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167537 s, 62.6 MB/s 2024-09-12T12:22:33.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.012 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136579 s, 76.8 MB/s 2024-09-12T12:22:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.028 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133161 s, 78.7 MB/s 2024-09-12T12:22:33.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.045 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141622 s, 74.0 MB/s 2024-09-12T12:22:33.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.061 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135526 s, 77.4 MB/s 2024-09-12T12:22:33.076 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.077 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129325 s, 81.1 MB/s 2024-09-12T12:22:33.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.092 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130945 s, 80.1 MB/s 2024-09-12T12:22:33.109 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.109 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.110 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143954 s, 72.8 MB/s 2024-09-12T12:22:33.126 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.126 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.126 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139925 s, 74.9 MB/s 2024-09-12T12:22:33.143 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.143 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.143 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139839 s, 75.0 MB/s 2024-09-12T12:22:33.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.160 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136979 s, 76.6 MB/s 2024-09-12T12:22:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129833 s, 80.8 MB/s 2024-09-12T12:22:33.190 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.190 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.191 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129223 s, 81.1 MB/s 2024-09-12T12:22:33.207 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.207 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.207 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013662 s, 76.8 MB/s 2024-09-12T12:22:33.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:33.214 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:33.214 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:33.214 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.26 2024-09-12T12:22:33.214 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:33.214 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:33.215 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:33.215 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.283 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.283 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141329 s, 74.2 MB/s 2024-09-12T12:22:33.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136322 s, 76.9 MB/s 2024-09-12T12:22:33.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.318 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167665 s, 62.5 MB/s 2024-09-12T12:22:33.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.334 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.334 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130542 s, 80.3 MB/s 2024-09-12T12:22:33.349 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.349 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.350 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130197 s, 80.5 MB/s 2024-09-12T12:22:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.365 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013316 s, 78.7 MB/s 2024-09-12T12:22:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.381 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129895 s, 80.7 MB/s 2024-09-12T12:22:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.399 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153351 s, 68.4 MB/s 2024-09-12T12:22:33.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.418 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153606 s, 68.3 MB/s 2024-09-12T12:22:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140645 s, 74.6 MB/s 2024-09-12T12:22:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.450 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01337 s, 78.4 MB/s 2024-09-12T12:22:33.470 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.471 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.471 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172458 s, 60.8 MB/s 2024-09-12T12:22:33.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.487 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140167 s, 74.8 MB/s 2024-09-12T12:22:33.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.503 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138131 s, 75.9 MB/s 2024-09-12T12:22:33.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.523 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167627 s, 62.6 MB/s 2024-09-12T12:22:33.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.540 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142464 s, 73.6 MB/s 2024-09-12T12:22:33.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.557 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143284 s, 73.2 MB/s 2024-09-12T12:22:33.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.574 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.574 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138422 s, 75.8 MB/s 2024-09-12T12:22:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.590 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142234 s, 73.7 MB/s 2024-09-12T12:22:33.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.607 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141013 s, 74.4 MB/s 2024-09-12T12:22:33.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.624 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144589 s, 72.5 MB/s 2024-09-12T12:22:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.640 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131424 s, 79.8 MB/s 2024-09-12T12:22:33.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.656 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.656 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129837 s, 80.8 MB/s 2024-09-12T12:22:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.674 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145513 s, 72.1 MB/s 2024-09-12T12:22:33.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.690 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137444 s, 76.3 MB/s 2024-09-12T12:22:33.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.707 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142564 s, 73.6 MB/s 2024-09-12T12:22:33.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.724 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143535 s, 73.1 MB/s 2024-09-12T12:22:33.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.740 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138567 s, 75.7 MB/s 2024-09-12T12:22:33.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.757 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137744 s, 76.1 MB/s 2024-09-12T12:22:33.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.774 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.774 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139951 s, 74.9 MB/s 2024-09-12T12:22:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139554 s, 75.1 MB/s 2024-09-12T12:22:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139788 s, 75.0 MB/s 2024-09-12T12:22:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:33.814 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:33.814 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:33.815 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.27 2024-09-12T12:22:33.815 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:33.815 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:33.815 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:33.815 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:33.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:33.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.927 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.927 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131877 s, 79.5 MB/s 2024-09-12T12:22:33.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.945 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132891 s, 78.9 MB/s 2024-09-12T12:22:33.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.961 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150066 s, 69.9 MB/s 2024-09-12T12:22:33.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.977 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013402 s, 78.2 MB/s 2024-09-12T12:22:33.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:33.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:33.996 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164384 s, 63.8 MB/s 2024-09-12T12:22:34.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.012 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137061 s, 76.5 MB/s 2024-09-12T12:22:34.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.028 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137211 s, 76.4 MB/s 2024-09-12T12:22:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.045 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135533 s, 77.4 MB/s 2024-09-12T12:22:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.063 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157419 s, 66.6 MB/s 2024-09-12T12:22:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130339 s, 80.4 MB/s 2024-09-12T12:22:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126869 s, 82.7 MB/s 2024-09-12T12:22:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141343 s, 74.2 MB/s 2024-09-12T12:22:34.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.127 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139051 s, 75.4 MB/s 2024-09-12T12:22:34.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.147 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172443 s, 60.8 MB/s 2024-09-12T12:22:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140991 s, 74.4 MB/s 2024-09-12T12:22:34.182 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.182 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.182 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157756 s, 66.5 MB/s 2024-09-12T12:22:34.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.201 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015743 s, 66.6 MB/s 2024-09-12T12:22:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.217 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136765 s, 76.7 MB/s 2024-09-12T12:22:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014987 s, 70.0 MB/s 2024-09-12T12:22:34.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.254 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156784 s, 66.9 MB/s 2024-09-12T12:22:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124149 s, 84.5 MB/s 2024-09-12T12:22:34.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136934 s, 76.6 MB/s 2024-09-12T12:22:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.302 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014053 s, 74.6 MB/s 2024-09-12T12:22:34.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.322 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.322 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168896 s, 62.1 MB/s 2024-09-12T12:22:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.337 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133785 s, 78.4 MB/s 2024-09-12T12:22:34.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.353 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131148 s, 80.0 MB/s 2024-09-12T12:22:34.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.370 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142004 s, 73.8 MB/s 2024-09-12T12:22:34.387 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.388 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147686 s, 71.0 MB/s 2024-09-12T12:22:34.403 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.403 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.403 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131115 s, 80.0 MB/s 2024-09-12T12:22:34.419 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.420 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.420 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132294 s, 79.3 MB/s 2024-09-12T12:22:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133855 s, 78.3 MB/s 2024-09-12T12:22:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135981 s, 77.1 MB/s 2024-09-12T12:22:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:34.459 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:34.459 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:34.459 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.28 2024-09-12T12:22:34.459 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:34.459 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:34.459 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:34.459 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:34.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:34.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.529 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014825 s, 70.7 MB/s 2024-09-12T12:22:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.546 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141232 s, 74.2 MB/s 2024-09-12T12:22:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.565 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170154 s, 61.6 MB/s 2024-09-12T12:22:34.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.580 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121069 s, 86.6 MB/s 2024-09-12T12:22:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.600 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168688 s, 62.2 MB/s 2024-09-12T12:22:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.616 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133578 s, 78.5 MB/s 2024-09-12T12:22:34.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.632 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.632 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013079 s, 80.2 MB/s 2024-09-12T12:22:34.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.650 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154725 s, 67.8 MB/s 2024-09-12T12:22:34.669 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.670 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.670 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133581 s, 78.5 MB/s 2024-09-12T12:22:34.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.685 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166379 s, 63.0 MB/s 2024-09-12T12:22:34.702 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.702 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.702 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141579 s, 74.1 MB/s 2024-09-12T12:22:34.718 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.718 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.718 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134837 s, 77.8 MB/s 2024-09-12T12:22:34.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.735 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144602 s, 72.5 MB/s 2024-09-12T12:22:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.751 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129814 s, 80.8 MB/s 2024-09-12T12:22:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.768 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144859 s, 72.4 MB/s 2024-09-12T12:22:34.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.785 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137734 s, 76.1 MB/s 2024-09-12T12:22:34.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.801 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130909 s, 80.1 MB/s 2024-09-12T12:22:34.820 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.820 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.820 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165258 s, 63.5 MB/s 2024-09-12T12:22:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141223 s, 74.2 MB/s 2024-09-12T12:22:34.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.853 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128531 s, 81.6 MB/s 2024-09-12T12:22:34.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.869 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134633 s, 77.9 MB/s 2024-09-12T12:22:34.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.886 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137566 s, 76.2 MB/s 2024-09-12T12:22:34.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.903 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143746 s, 72.9 MB/s 2024-09-12T12:22:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.919 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136114 s, 77.0 MB/s 2024-09-12T12:22:34.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.935 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130898 s, 80.1 MB/s 2024-09-12T12:22:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.951 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142215 s, 73.7 MB/s 2024-09-12T12:22:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.968 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.969 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142742 s, 73.5 MB/s 2024-09-12T12:22:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:34.985 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138629 s, 75.6 MB/s 2024-09-12T12:22:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.001 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134448 s, 78.0 MB/s 2024-09-12T12:22:35.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.018 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142113 s, 73.8 MB/s 2024-09-12T12:22:35.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.034 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132956 s, 78.9 MB/s 2024-09-12T12:22:35.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.051 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144529 s, 72.6 MB/s 2024-09-12T12:22:35.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:35.058 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:35.058 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:35.059 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.29 2024-09-12T12:22:35.059 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:35.059 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:35.059 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:35.059 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:35.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.125 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129574 s, 80.9 MB/s 2024-09-12T12:22:35.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.141 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.141 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128088 s, 81.9 MB/s 2024-09-12T12:22:35.157 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.157 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.157 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134348 s, 78.0 MB/s 2024-09-12T12:22:35.174 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.174 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.174 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139821 s, 75.0 MB/s 2024-09-12T12:22:35.189 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.190 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.190 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131455 s, 79.8 MB/s 2024-09-12T12:22:35.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126512 s, 82.9 MB/s 2024-09-12T12:22:35.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.221 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129223 s, 81.1 MB/s 2024-09-12T12:22:35.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.237 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136738 s, 76.7 MB/s 2024-09-12T12:22:35.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.253 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129782 s, 80.8 MB/s 2024-09-12T12:22:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.269 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135573 s, 77.3 MB/s 2024-09-12T12:22:35.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132821 s, 78.9 MB/s 2024-09-12T12:22:35.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.302 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141675 s, 74.0 MB/s 2024-09-12T12:22:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.318 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137237 s, 76.4 MB/s 2024-09-12T12:22:35.334 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.334 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.334 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127915 s, 82.0 MB/s 2024-09-12T12:22:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170436 s, 61.5 MB/s 2024-09-12T12:22:35.372 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.372 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.373 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163917 s, 64.0 MB/s 2024-09-12T12:22:35.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.389 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141322 s, 74.2 MB/s 2024-09-12T12:22:35.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.409 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.409 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176615 s, 59.4 MB/s 2024-09-12T12:22:35.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.424 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120644 s, 86.9 MB/s 2024-09-12T12:22:35.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.441 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137911 s, 76.0 MB/s 2024-09-12T12:22:35.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.456 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122164 s, 85.8 MB/s 2024-09-12T12:22:35.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.473 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146367 s, 71.6 MB/s 2024-09-12T12:22:35.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141806 s, 73.9 MB/s 2024-09-12T12:22:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.506 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013336 s, 78.6 MB/s 2024-09-12T12:22:35.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.524 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142422 s, 73.6 MB/s 2024-09-12T12:22:35.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.539 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130765 s, 80.2 MB/s 2024-09-12T12:22:35.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.556 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135646 s, 77.3 MB/s 2024-09-12T12:22:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016692 s, 62.8 MB/s 2024-09-12T12:22:35.591 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.592 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141317 s, 74.2 MB/s 2024-09-12T12:22:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110055 s, 95.3 MB/s 2024-09-12T12:22:35.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.621 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131011 s, 80.0 MB/s 2024-09-12T12:22:35.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133516 s, 78.5 MB/s 2024-09-12T12:22:35.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:35.645 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:35.645 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:35.645 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.30 2024-09-12T12:22:35.645 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:35.645 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:35.645 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:35.645 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:35.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:35.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.757 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143815 s, 72.9 MB/s 2024-09-12T12:22:35.774 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148657 s, 70.5 MB/s 2024-09-12T12:22:35.790 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.791 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.791 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134167 s, 78.2 MB/s 2024-09-12T12:22:35.807 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.808 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140466 s, 74.6 MB/s 2024-09-12T12:22:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.824 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133432 s, 78.6 MB/s 2024-09-12T12:22:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.839 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132131 s, 79.4 MB/s 2024-09-12T12:22:35.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.856 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145434 s, 72.1 MB/s 2024-09-12T12:22:35.876 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.876 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.876 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016785 s, 62.5 MB/s 2024-09-12T12:22:35.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.893 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141315 s, 74.2 MB/s 2024-09-12T12:22:35.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014118 s, 74.3 MB/s 2024-09-12T12:22:35.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.925 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122248 s, 85.8 MB/s 2024-09-12T12:22:35.942 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.942 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.942 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014564 s, 72.0 MB/s 2024-09-12T12:22:35.958 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.959 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135068 s, 77.6 MB/s 2024-09-12T12:22:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015489 s, 67.7 MB/s 2024-09-12T12:22:35.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:35.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:35.996 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166622 s, 62.9 MB/s 2024-09-12T12:22:36.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132358 s, 79.2 MB/s 2024-09-12T12:22:36.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.033 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017539 s, 59.8 MB/s 2024-09-12T12:22:36.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.048 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130047 s, 80.6 MB/s 2024-09-12T12:22:36.064 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.064 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.064 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131651 s, 79.6 MB/s 2024-09-12T12:22:36.080 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.080 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.080 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132044 s, 79.4 MB/s 2024-09-12T12:22:36.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130994 s, 80.0 MB/s 2024-09-12T12:22:36.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.112 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131976 s, 79.5 MB/s 2024-09-12T12:22:36.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.129 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140486 s, 74.6 MB/s 2024-09-12T12:22:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130883 s, 80.1 MB/s 2024-09-12T12:22:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134816 s, 77.8 MB/s 2024-09-12T12:22:36.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.179 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145484 s, 72.1 MB/s 2024-09-12T12:22:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.195 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135739 s, 77.2 MB/s 2024-09-12T12:22:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.212 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142791 s, 73.4 MB/s 2024-09-12T12:22:36.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.228 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133267 s, 78.7 MB/s 2024-09-12T12:22:36.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.244 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135758 s, 77.2 MB/s 2024-09-12T12:22:36.263 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.263 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.263 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163778 s, 64.0 MB/s 2024-09-12T12:22:36.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.281 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144529 s, 72.6 MB/s 2024-09-12T12:22:36.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:36.288 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:22:36.288 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:22:36.288 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.31 2024-09-12T12:22:36.288 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:22:36.288 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:22:36.288 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:22:36.288 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:22:36.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:22:36.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.356 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142036 s, 73.8 MB/s 2024-09-12T12:22:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.370 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117253 s, 89.4 MB/s 2024-09-12T12:22:36.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.384 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116573 s, 90.0 MB/s 2024-09-12T12:22:36.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130704 s, 80.2 MB/s 2024-09-12T12:22:36.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.418 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137324 s, 76.4 MB/s 2024-09-12T12:22:36.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.433 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130703 s, 80.2 MB/s 2024-09-12T12:22:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.449 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137564 s, 76.2 MB/s 2024-09-12T12:22:36.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.466 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141664 s, 74.0 MB/s 2024-09-12T12:22:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133235 s, 78.7 MB/s 2024-09-12T12:22:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143935 s, 72.9 MB/s 2024-09-12T12:22:36.514 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.515 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130509 s, 80.3 MB/s 2024-09-12T12:22:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.531 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133739 s, 78.4 MB/s 2024-09-12T12:22:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.546 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123001 s, 85.2 MB/s 2024-09-12T12:22:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.563 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147135 s, 71.3 MB/s 2024-09-12T12:22:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129143 s, 81.2 MB/s 2024-09-12T12:22:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133125 s, 78.8 MB/s 2024-09-12T12:22:36.612 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.612 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.612 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145503 s, 72.1 MB/s 2024-09-12T12:22:36.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.628 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132174 s, 79.3 MB/s 2024-09-12T12:22:36.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.644 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130272 s, 80.5 MB/s 2024-09-12T12:22:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.660 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013149 s, 79.7 MB/s 2024-09-12T12:22:36.675 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.676 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.676 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135637 s, 77.3 MB/s 2024-09-12T12:22:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.692 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137717 s, 76.1 MB/s 2024-09-12T12:22:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.709 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139951 s, 74.9 MB/s 2024-09-12T12:22:36.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.724 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129882 s, 80.7 MB/s 2024-09-12T12:22:36.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.743 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154486 s, 67.9 MB/s 2024-09-12T12:22:36.758 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.758 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.759 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133569 s, 78.5 MB/s 2024-09-12T12:22:36.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.776 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145946 s, 71.8 MB/s 2024-09-12T12:22:36.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.792 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133699 s, 78.4 MB/s 2024-09-12T12:22:36.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.808 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136385 s, 76.9 MB/s 2024-09-12T12:22:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.825 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134051 s, 78.2 MB/s 2024-09-12T12:22:36.841 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.841 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.841 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013775 s, 76.1 MB/s 2024-09-12T12:22:36.857 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:22:36.857 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:22:36.857 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013398 s, 78.3 MB/s 2024-09-12T12:22:36.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:22:36.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:36.865 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-09-12T12:22:37.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.002+0000 7f302d400640 1 Processor -- start 2024-09-12T12:22:37.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.002+0000 7f302d400640 1 -- start start 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f302d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3028156c10 0x7f3028072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f302d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f302806cff0 0x7f302806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f302d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3028073360 0x7f3028073810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f302d400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3028073d50 con 0x7f3028073360 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f302d400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f302806d990 con 0x7f302806cff0 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f302d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3028071be0 con 0x7f3028156c10 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3027200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3028073360 0x7f3028073810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3027200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3028073360 0x7f3028073810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56422/0 (socket says 172.21.15.144:56422) 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3027200640 1 -- 172.21.15.144:0/4016134248 learned_addr learned my addr 172.21.15.144:0/4016134248 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3025e00640 1 --2- 172.21.15.144:0/4016134248 >> v2:172.21.15.165:3300/0 conn(0x7f302806cff0 0x7f302806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3026800640 1 --2- 172.21.15.144:0/4016134248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3028156c10 0x7f3028072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3027200640 1 -- 172.21.15.144:0/4016134248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3028156c10 msgr2=0x7f3028072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3027200640 1 --2- 172.21.15.144:0/4016134248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3028156c10 0x7f3028072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3027200640 1 -- 172.21.15.144:0/4016134248 >> v2:172.21.15.165:3300/0 conn(0x7f302806cff0 msgr2=0x7f302806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3027200640 1 --2- 172.21.15.144:0/4016134248 >> v2:172.21.15.165:3300/0 conn(0x7f302806cff0 0x7f302806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3027200640 1 -- 172.21.15.144:0/4016134248 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302806cd20 con 0x7f3028073360 2024-09-12T12:22:37.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.006+0000 7f3025e00640 1 --2- 172.21.15.144:0/4016134248 >> v2:172.21.15.165:3300/0 conn(0x7f302806cff0 0x7f302806d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:37.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f3027200640 1 --2- 172.21.15.144:0/4016134248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 0x7f3028073810 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f30280b57f0 tx=0x7f302001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776c68c27ef39277 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f3025400640 1 -- 172.21.15.144:0/4016134248 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30200a5870 con 0x7f3028073360 2024-09-12T12:22:37.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f3025400640 1 -- 172.21.15.144:0/4016134248 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30200a5a10 con 0x7f3028073360 2024-09-12T12:22:37.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f3025400640 1 -- 172.21.15.144:0/4016134248 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30200a5de0 con 0x7f3028073360 2024-09-12T12:22:37.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 -- 172.21.15.144:0/4016134248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 msgr2=0x7f3028073810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 --2- 172.21.15.144:0/4016134248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 0x7f3028073810 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f30280b57f0 tx=0x7f302001c9f0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 -- 172.21.15.144:0/4016134248 shutdown_connections 2024-09-12T12:22:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 --2- 172.21.15.144:0/4016134248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 0x7f3028073810 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 --2- 172.21.15.144:0/4016134248 >> v2:172.21.15.165:3300/0 conn(0x7f302806cff0 0x7f302806d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 --2- 172.21.15.144:0/4016134248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3028156c10 0x7f3028072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 -- 172.21.15.144:0/4016134248 >> 172.21.15.144:0/4016134248 conn(0x7f302806bc10 msgr2=0x7f302806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 -- 172.21.15.144:0/4016134248 shutdown_connections 2024-09-12T12:22:37.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 -- 172.21.15.144:0/4016134248 wait complete. 2024-09-12T12:22:37.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 Processor -- start 2024-09-12T12:22:37.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.010+0000 7f302d400640 1 -- start start 2024-09-12T12:22:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f302d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302806cff0 0x7f3028151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f302d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 0x7f302814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f302d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3028156c10 0x7f3028157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f302d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3028156ff0 con 0x7f3028073360 2024-09-12T12:22:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f302d400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3028073f70 con 0x7f3028156c10 2024-09-12T12:22:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f302d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3028157170 con 0x7f302806cff0 2024-09-12T12:22:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3025e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 0x7f302814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3025e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 0x7f302814e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56426/0 (socket says 172.21.15.144:56426) 2024-09-12T12:22:37.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3025e00640 1 -- 172.21.15.144:0/841493920 learned_addr learned my addr 172.21.15.144:0/841493920 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3026800640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302806cff0 0x7f3028151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3027200640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3028156c10 0x7f3028157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3025e00640 1 -- 172.21.15.144:0/841493920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302806cff0 msgr2=0x7f3028151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3025e00640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302806cff0 0x7f3028151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3025e00640 1 -- 172.21.15.144:0/841493920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3028156c10 msgr2=0x7f3028157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3025e00640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3028156c10 0x7f3028157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3025e00640 1 -- 172.21.15.144:0/841493920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30281515b0 con 0x7f3028073360 2024-09-12T12:22:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f3025e00640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 0x7f302814e0f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f3014009fd0 tx=0x7f301400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f301ea00640 1 -- 172.21.15.144:0/841493920 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014017070 con 0x7f3028073360 2024-09-12T12:22:37.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f301ea00640 1 -- 172.21.15.144:0/841493920 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301400ca00 con 0x7f3028073360 2024-09-12T12:22:37.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f301ea00640 1 -- 172.21.15.144:0/841493920 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301400cdd0 con 0x7f3028073360 2024-09-12T12:22:37.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f302d400640 1 -- 172.21.15.144:0/841493920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30280b5280 con 0x7f3028073360 2024-09-12T12:22:37.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f302d400640 1 -- 172.21.15.144:0/841493920 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3028150590 con 0x7f3028073360 2024-09-12T12:22:37.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.014+0000 7f301ea00640 1 -- 172.21.15.144:0/841493920 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f301401a070 con 0x7f3028073360 2024-09-12T12:22:37.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f301ea00640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30080678f0 0x7f3008069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f301ea00640 1 -- 172.21.15.144:0/841493920 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f3014085d10 con 0x7f3028073360 2024-09-12T12:22:37.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30080678f0 0x7f3008069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 Processor -- start 2024-09-12T12:22:37.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 -- start start 2024-09-12T12:22:37.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30080678f0 0x7f3008069db0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3018009ac0 tx=0x7f3018009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f30132fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132fff0 0x55f3012e3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f3012e36a0 0x55f3012e3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f301133ba0 con 0x55f30132f6d0 2024-09-12T12:22:37.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f3010d9350 con 0x55f30132fff0 2024-09-12T12:22:37.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f30112fb60 con 0x55f3012e36a0 2024-09-12T12:22:37.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f30132fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f30132fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56436/0 (socket says 172.21.15.144:56436) 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 -- 172.21.15.144:0/3774206473 learned_addr learned my addr 172.21.15.144:0/3774206473 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3025e00640 1 --2- 172.21.15.144:0/3774206473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132fff0 0x55f3012e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3027200640 1 --2- 172.21.15.144:0/3774206473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f3012e36a0 0x55f3012e3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 -- 172.21.15.144:0/3774206473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f3012e36a0 msgr2=0x55f3012e3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 --2- 172.21.15.144:0/3774206473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f3012e36a0 0x55f3012e3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 -- 172.21.15.144:0/3774206473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132fff0 msgr2=0x55f3012e3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 --2- 172.21.15.144:0/3774206473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132fff0 0x55f3012e3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 -- 172.21.15.144:0/3774206473 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3010dcbd0 con 0x55f30132f6d0 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3026800640 1 --2- 172.21.15.144:0/3774206473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f30132fab0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f3018006aa0 tx=0x7f3018014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972962145f293e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3013400640 1 -- 172.21.15.144:0/3774206473 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301801b070 con 0x55f30132f6d0 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3013400640 1 -- 172.21.15.144:0/3774206473 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3018027070 con 0x55f30132f6d0 2024-09-12T12:22:37.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f3013400640 1 -- 172.21.15.144:0/3774206473 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018003a30 con 0x55f30132f6d0 2024-09-12T12:22:37.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 -- 172.21.15.144:0/3774206473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 msgr2=0x55f30132fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 --2- 172.21.15.144:0/3774206473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f30132fab0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f3018006aa0 tx=0x7f3018014000 comp rx=0 tx=0).stop 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 -- 172.21.15.144:0/3774206473 shutdown_connections 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 --2- 172.21.15.144:0/3774206473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f3012e36a0 0x55f3012e3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 --2- 172.21.15.144:0/3774206473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132fff0 0x55f3012e3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 --2- 172.21.15.144:0/3774206473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f30132fab0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.018+0000 7f30307c3000 1 -- 172.21.15.144:0/3774206473 >> 172.21.15.144:0/3774206473 conn(0x55f301310470 msgr2=0x55f301312860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 -- 172.21.15.144:0/3774206473 shutdown_connections 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 -- 172.21.15.144:0/3774206473 wait complete. 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 -- start start 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 Processor -- start 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 0x55f301335810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f301335d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132fff0 0x55f3012e7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f3010cd2a0 con 0x55f30132f6d0 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f3010f27d0 con 0x55f3012e36a0 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f3010f4f70 con 0x55f30132fff0 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 10 client.0 _ll_register_callbacks cb 0x55f3012d0b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3025e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f301335d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3025e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f301335d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56438/0 (socket says 172.21.15.144:56438) 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3025e00640 1 -- 172.21.15.144:0/2135631931 learned_addr learned my addr 172.21.15.144:0/2135631931 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3026800640 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 0x55f301335810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3027200640 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132fff0 0x55f3012e7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3025e00640 1 -- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132fff0 msgr2=0x55f3012e7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3025e00640 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132fff0 0x55f3012e7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3025e00640 1 -- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 msgr2=0x55f301335810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3025e00640 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 0x55f301335810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3025e00640 1 -- 172.21.15.144:0/2135631931 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f30113c810 con 0x55f30132f6d0 2024-09-12T12:22:37.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3026800640 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 0x55f301335810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:37.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3025e00640 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f301335d50 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3014055c90 tx=0x7f3014056050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b76e2a56658e439 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3007e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:37.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3007e00640 1 -- 172.21.15.144:0/2135631931 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014021030 con 0x55f30132f6d0 2024-09-12T12:22:37.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3007e00640 1 -- 172.21.15.144:0/2135631931 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f30140555e0 con 0x55f30132f6d0 2024-09-12T12:22:37.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 -- 172.21.15.144:0/2135631931 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3018027070 con 0x55f30132f6d0 2024-09-12T12:22:37.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3007e00640 1 -- 172.21.15.144:0/2135631931 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f3014051ce0 con 0x55f30132f6d0 2024-09-12T12:22:37.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 10 client.9018 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:37.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 -- 172.21.15.144:0/2135631931 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55f3010dd9f0 con 0x55f30132f6d0 2024-09-12T12:22:37.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3007e00640 1 -- 172.21.15.144:0/2135631931 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3018027070 con 0x55f30132f6d0 2024-09-12T12:22:37.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f3007e00640 1 -- 172.21.15.144:0/2135631931 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f3014024060 con 0x55f30132f6d0 2024-09-12T12:22:37.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 10 client.9018 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 10 client.9018 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 20 client.9018 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55f3012e7f80 0x55f3012e8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 4 client.9018 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.022+0000 7f30307c3000 1 -- 172.21.15.144:0/2135631931 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3010cdbd0 con 0x55f3012e7f80 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f3026800640 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55f3012e7f80 0x55f3012e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f3026800640 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55f3012e7f80 0x55f3012e8360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15c393495eea9b9 server_cookie=fcafab366f683695 in_seq=0 out_seq=0 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f3007e00640 10 client.9018 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f3007e00640 1 -- 172.21.15.144:0/2135631931 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3010cdbd0 con 0x55f3012e7f80 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f3007e00640 10 client.9018 handle_command_reply: tid=0 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 client.9018 shutdown 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 -- 172.21.15.144:0/2135631931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 msgr2=0x55f301335d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f301335d50 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3014055c90 tx=0x7f3014056050 comp rx=0 tx=0).stop 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 -- 172.21.15.144:0/2135631931 shutdown_connections 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55f3012e7f80 0x55f3012e8360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132fff0 0x55f3012e7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f30132f6d0 0x55f301335d50 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f3007e00640 0 client.9018 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 --2- 172.21.15.144:0/2135631931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 0x55f301335810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 -- 172.21.15.144:0/2135631931 >> 172.21.15.144:0/2135631931 conn(0x55f301310470 msgr2=0x55f301312860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 -- 172.21.15.144:0/2135631931 shutdown_connections 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 1 -- 172.21.15.144:0/2135631931 wait complete. 2024-09-12T12:22:37.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.026+0000 7f30307c3000 20 client.9018 trim_cache size 0 max 16384 2024-09-12T12:22:37.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.042+0000 7f30307c3000 1 Processor -- start 2024-09-12T12:22:37.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.042+0000 7f30307c3000 1 -- start start 2024-09-12T12:22:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f301310470 0x55f301344bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 0x55f3013450f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132f6d0 0x55f301345630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3028203360 con 0x55f301310470 2024-09-12T12:22:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f30280b49a0 con 0x55f3012e36a0 2024-09-12T12:22:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f30280b4ff0 con 0x55f30132f6d0 2024-09-12T12:22:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3026800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f301310470 0x55f301344bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3026800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f301310470 0x55f301344bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56440/0 (socket says 172.21.15.144:56440) 2024-09-12T12:22:37.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3026800640 1 -- 172.21.15.144:0/1179709563 learned_addr learned my addr 172.21.15.144:0/1179709563 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3027200640 1 --2- 172.21.15.144:0/1179709563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132f6d0 0x55f301345630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3025e00640 1 --2- 172.21.15.144:0/1179709563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 0x55f3013450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3026800640 1 -- 172.21.15.144:0/1179709563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132f6d0 msgr2=0x55f301345630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3026800640 1 --2- 172.21.15.144:0/1179709563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132f6d0 0x55f301345630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3026800640 1 -- 172.21.15.144:0/1179709563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 msgr2=0x55f3013450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3026800640 1 --2- 172.21.15.144:0/1179709563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 0x55f3013450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3026800640 1 -- 172.21.15.144:0/1179709563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3010d95a0 con 0x55f301310470 2024-09-12T12:22:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3026800640 1 --2- 172.21.15.144:0/1179709563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f301310470 0x55f301344bb0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f3018004490 tx=0x7f3018020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4e128be211ced0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3012a00640 1 -- 172.21.15.144:0/1179709563 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301801b040 con 0x55f301310470 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3012a00640 1 -- 172.21.15.144:0/1179709563 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301803a070 con 0x55f301310470 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f3012a00640 1 -- 172.21.15.144:0/1179709563 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018035340 con 0x55f301310470 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 -- 172.21.15.144:0/1179709563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f301310470 msgr2=0x55f301344bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 --2- 172.21.15.144:0/1179709563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f301310470 0x55f301344bb0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f3018004490 tx=0x7f3018020000 comp rx=0 tx=0).stop 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 -- 172.21.15.144:0/1179709563 shutdown_connections 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 --2- 172.21.15.144:0/1179709563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f30132f6d0 0x55f301345630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 --2- 172.21.15.144:0/1179709563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f3012e36a0 0x55f3013450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 --2- 172.21.15.144:0/1179709563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f301310470 0x55f301344bb0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 -- 172.21.15.144:0/1179709563 >> 172.21.15.144:0/1179709563 conn(0x55f3012eaed0 msgr2=0x55f3012e7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 -- 172.21.15.144:0/1179709563 shutdown_connections 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 -- 172.21.15.144:0/1179709563 wait complete. 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 -- start start 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 Processor -- start 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.046+0000 7f30307c3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3012e36a0 0x55f3013a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f301310470 0x55f3013a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132f6d0 0x55f3013a4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f3010dfc10 con 0x55f3012e36a0 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f3010dae30 con 0x55f30132f6d0 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f3010b88f0 con 0x55f301310470 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 10 client.0 _ll_register_callbacks cb 0x7f30140522e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3026800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3012e36a0 0x55f3013a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3026800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3012e36a0 0x55f3013a39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56442/0 (socket says 172.21.15.144:56442) 2024-09-12T12:22:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3026800640 1 -- 172.21.15.144:0/1436989200 learned_addr learned my addr 172.21.15.144:0/1436989200 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3027200640 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132f6d0 0x55f3013a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3025e00640 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f301310470 0x55f3013a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3026800640 1 -- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f301310470 msgr2=0x55f3013a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3026800640 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f301310470 0x55f3013a3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3026800640 1 -- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132f6d0 msgr2=0x55f3013a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3026800640 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132f6d0 0x55f3013a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3026800640 1 -- 172.21.15.144:0/1436989200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3010d35b0 con 0x55f3012e36a0 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3027200640 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132f6d0 0x55f3013a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3025e00640 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f301310470 0x55f3013a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3026800640 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3012e36a0 0x55f3013a39d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f3018011690 tx=0x7f3018004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1684a0ea60d96db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3007e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3007e00640 1 -- 172.21.15.144:0/1436989200 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018044020 con 0x55f3012e36a0 2024-09-12T12:22:37.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3007e00640 1 -- 172.21.15.144:0/1436989200 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f3018035340 con 0x55f3012e36a0 2024-09-12T12:22:37.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 1 -- 172.21.15.144:0/1436989200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f301803a070 con 0x55f3012e36a0 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3007e00640 1 -- 172.21.15.144:0/1436989200 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f301804e050 con 0x55f3012e36a0 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 10 client.9024 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 1 -- 172.21.15.144:0/1436989200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55f3010cb330 con 0x55f3012e36a0 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3007e00640 1 -- 172.21.15.144:0/1436989200 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301803a070 con 0x55f3012e36a0 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3007e00640 1 -- 172.21.15.144:0/1436989200 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f3018051020 con 0x55f3012e36a0 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 10 client.9024 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 10 client.9024 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 20 client.9024 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55f30132fff0 0x55f30133a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 4 client.9024 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f30307c3000 1 -- 172.21.15.144:0/1436989200 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55f3011412d0 con 0x55f30132fff0 2024-09-12T12:22:37.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3025e00640 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55f30132fff0 0x55f30133a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3025e00640 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55f30132fff0 0x55f30133a030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16aa847fcf1bfeb server_cookie=61b850f110b46525 in_seq=0 out_seq=0 2024-09-12T12:22:37.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.050+0000 7f3007e00640 10 client.9024 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f3007e00640 1 -- 172.21.15.144:0/1436989200 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f3011412d0 con 0x55f30132fff0 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f3007e00640 10 client.9024 handle_command_reply: tid=0 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 client.9024 shutdown 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 -- 172.21.15.144:0/1436989200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3012e36a0 msgr2=0x55f3013a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3012e36a0 0x55f3013a39d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f3018011690 tx=0x7f3018004740 comp rx=0 tx=0).stop 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 -- 172.21.15.144:0/1436989200 shutdown_connections 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55f30132fff0 0x55f30133a030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f30132f6d0 0x55f3013a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f301310470 0x55f3013a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f3007e00640 0 client.9024 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 --2- 172.21.15.144:0/1436989200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3012e36a0 0x55f3013a39d0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 -- 172.21.15.144:0/1436989200 >> 172.21.15.144:0/1436989200 conn(0x55f3012eaed0 msgr2=0x55f30133bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 -- 172.21.15.144:0/1436989200 shutdown_connections 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 1 -- 172.21.15.144:0/1436989200 wait complete. 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f30307c3000 20 client.9024 trim_cache size 0 max 16384 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "991ff452-16ef-415b-80da-c96f0d33b114", 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:22:37.058 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:22:37.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 -- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30080678f0 msgr2=0x7f3008069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30080678f0 0x7f3008069db0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3018009ac0 tx=0x7f3018009190 comp rx=0 tx=0).stop 2024-09-12T12:22:37.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 -- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 msgr2=0x7f302814e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 0x7f302814e0f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f3014009fd0 tx=0x7f301400ee10 comp rx=0 tx=0).stop 2024-09-12T12:22:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 -- 172.21.15.144:0/841493920 shutdown_connections 2024-09-12T12:22:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f30080678f0 0x7f3008069db0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3028156c10 0x7f3028157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3028073360 0x7f302814e0f0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 --2- 172.21.15.144:0/841493920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f302806cff0 0x7f3028151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 -- 172.21.15.144:0/841493920 >> 172.21.15.144:0/841493920 conn(0x7f302806bc10 msgr2=0x7f30281661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 -- 172.21.15.144:0/841493920 shutdown_connections 2024-09-12T12:22:37.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.054+0000 7f302d400640 1 -- 172.21.15.144:0/841493920 wait complete. 2024-09-12T12:22:37.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:37.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-09-12T12:22:37.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bf200640 1 Processor -- start 2024-09-12T12:22:37.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bf200640 1 -- start start 2024-09-12T12:22:37.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c1d0 0x7fb7c00b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bf200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7c00b6fe0 0x7fb7c00b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bf200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7c00d0b20 con 0x7fb7c015c5b0 2024-09-12T12:22:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bf200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb7c0073250 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c00d0e00 con 0x7fb7c015c1d0 2024-09-12T12:22:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7be800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7c00b6fe0 0x7fb7c00b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bd400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb7c015c5b0 0x7fb7c00b68d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42854/0 (socket says 172.21.15.144:42854) 2024-09-12T12:22:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bd400640 1 -- 172.21.15.144:0/174543540 learned_addr learned my addr 172.21.15.144:0/174543540 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:37.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.230+0000 7fb7bde00640 1 --2- 172.21.15.144:0/174543540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c1d0 0x7fb7c00b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7bca00640 1 -- 172.21.15.144:0/174543540 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311070954 0 0) 0x7fb7c00d0b20 con 0x7fb7c015c5b0 2024-09-12T12:22:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7bca00640 1 -- 172.21.15.144:0/174543540 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a4003530 con 0x7fb7c015c5b0 2024-09-12T12:22:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7be800640 1 -- 172.21.15.144:0/174543540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c1d0 msgr2=0x7fb7c00b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7be800640 1 --2- 172.21.15.144:0/174543540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c1d0 0x7fb7c00b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7be800640 1 -- 172.21.15.144:0/174543540 >> v1:172.21.15.144:6789/0 conn(0x7fb7c015c5b0 legacy=0x7fb7c00b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7be800640 1 -- 172.21.15.144:0/174543540 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c00d10e0 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7be800640 1 --2- 172.21.15.144:0/174543540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 0x7fb7c00b44e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80097c0 tx=0x7fb7b801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9000c70c06170cb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7bca00640 1 -- 172.21.15.144:0/174543540 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80aa5f0 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7bca00640 1 -- 172.21.15.144:0/174543540 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b80af070 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7bca00640 1 -- 172.21.15.144:0/174543540 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80aa9b0 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7bf200640 1 -- 172.21.15.144:0/174543540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 msgr2=0x7fb7c00b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.234+0000 7fb7bf200640 1 --2- 172.21.15.144:0/174543540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 0x7fb7c00b44e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80097c0 tx=0x7fb7b801c470 comp rx=0 tx=0).stop 2024-09-12T12:22:37.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- 172.21.15.144:0/174543540 shutdown_connections 2024-09-12T12:22:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 --2- 172.21.15.144:0/174543540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 0x7fb7c00b44e0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 --2- 172.21.15.144:0/174543540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c1d0 0x7fb7c00b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- 172.21.15.144:0/174543540 >> 172.21.15.144:0/174543540 conn(0x7fb7c00b7c30 msgr2=0x7fb7c0067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- 172.21.15.144:0/174543540 shutdown_connections 2024-09-12T12:22:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- 172.21.15.144:0/174543540 wait complete. 2024-09-12T12:22:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 Processor -- start 2024-09-12T12:22:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- start start 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 0x7fb7c014d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7c015c1d0 0x7fb7c014ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c5b0 0x7fb7c0146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c00d2480 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c00d2300 con 0x7fb7c015c1d0 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c00d2600 con 0x7fb7c015c5b0 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 0x7fb7c014d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 0x7fb7c014d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51130/0 (socket says 172.21.15.144:51130) 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bde00640 1 -- 172.21.15.144:0/2100912837 learned_addr learned my addr 172.21.15.144:0/2100912837 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7be800640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c5b0 0x7fb7c0146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bd400640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7c015c1d0 0x7fb7c014ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bde00640 1 -- 172.21.15.144:0/2100912837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c5b0 msgr2=0x7fb7c0146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bde00640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c5b0 0x7fb7c0146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bde00640 1 -- 172.21.15.144:0/2100912837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7c015c1d0 msgr2=0x7fb7c014ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bde00640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7c015c1d0 0x7fb7c014ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bde00640 1 -- 172.21.15.144:0/2100912837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c015f790 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7be800640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c5b0 0x7fb7c0146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bde00640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 0x7fb7c014d3c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000efc0 tx=0x7fb7b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7b6000640 1 -- 172.21.15.144:0/2100912837 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0018020 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7b6000640 1 -- 172.21.15.144:0/2100912837 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b0014480 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7b6000640 1 -- 172.21.15.144:0/2100912837 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0014870 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- 172.21.15.144:0/2100912837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c014b770 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.238+0000 7fb7bf200640 1 -- 172.21.15.144:0/2100912837 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c014bd30 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.242+0000 7fb7b6000640 1 -- 172.21.15.144:0/2100912837 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7b001b020 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.242+0000 7fb7b6000640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7a00678c0 0x7fb7a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.242+0000 7fb7b6000640 1 -- 172.21.15.144:0/2100912837 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fb7b0086df0 con 0x7fb7c00b6fe0 2024-09-12T12:22:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.242+0000 7fb7bd400640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7a00678c0 0x7fb7a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.242+0000 7fb7c8662000 1 Processor -- start 2024-09-12T12:22:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.242+0000 7fb7c8662000 1 -- start start 2024-09-12T12:22:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.242+0000 7fb7bd400640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7a00678c0 0x7fb7a0069d80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb7c015a250 tx=0x7fb7ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245660d50 0x558245661130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245661670 0x558245614650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245614f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558245461cc0 con 0x558245661670 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55824541ca20 con 0x558245660d50 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55824545dc80 con 0x558245614b90 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245661670 0x558245614650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bde00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245660d50 0x558245661130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245661670 0x558245614650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51144/0 (socket says 172.21.15.144:51144) 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bd400640 1 -- 172.21.15.144:0/2755599911 learned_addr learned my addr 172.21.15.144:0/2755599911 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7be800640 1 --2- 172.21.15.144:0/2755599911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245614f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bd400640 1 -- 172.21.15.144:0/2755599911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 msgr2=0x558245614f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bd400640 1 --2- 172.21.15.144:0/2755599911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245614f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bd400640 1 -- 172.21.15.144:0/2755599911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245660d50 msgr2=0x558245661130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bd400640 1 --2- 172.21.15.144:0/2755599911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245660d50 0x558245661130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bd400640 1 -- 172.21.15.144:0/2755599911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558245404d40 con 0x558245661670 2024-09-12T12:22:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7bd400640 1 --2- 172.21.15.144:0/2755599911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245661670 0x558245614650 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac001480 tx=0x7fb7ac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0601800481245d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7aaa00640 1 -- 172.21.15.144:0/2755599911 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac005e10 con 0x558245661670 2024-09-12T12:22:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7aaa00640 1 -- 172.21.15.144:0/2755599911 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac00e750 con 0x558245661670 2024-09-12T12:22:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7aaa00640 1 -- 172.21.15.144:0/2755599911 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00eb00 con 0x558245661670 2024-09-12T12:22:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- 172.21.15.144:0/2755599911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245661670 msgr2=0x558245614650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2755599911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245661670 0x558245614650 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac001480 tx=0x7fb7ac011000 comp rx=0 tx=0).stop 2024-09-12T12:22:37.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- 172.21.15.144:0/2755599911 shutdown_connections 2024-09-12T12:22:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2755599911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245614f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2755599911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245661670 0x558245614650 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2755599911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245660d50 0x558245661130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- 172.21.15.144:0/2755599911 >> 172.21.15.144:0/2755599911 conn(0x55824563d9b0 msgr2=0x55824563fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- 172.21.15.144:0/2755599911 shutdown_connections 2024-09-12T12:22:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- 172.21.15.144:0/2755599911 wait complete. 2024-09-12T12:22:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- start start 2024-09-12T12:22:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 Processor -- start 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245667f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x55824565ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5582453fb2c0 con 0x558245660d50 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558245420370 con 0x558245661670 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.246+0000 7fb7c8662000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55824546ff50 con 0x558245614b90 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 10 client.0 _ll_register_callbacks cb 0x5582454c2db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245667f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245667f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34844/0 (socket says 172.21.15.144:34844) 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bde00640 1 -- 172.21.15.144:0/3066819623 learned_addr learned my addr 172.21.15.144:0/3066819623 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456684c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51150/0 (socket says 172.21.15.144:51150) 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7be800640 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x55824565ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bde00640 1 -- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 msgr2=0x55824565ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bde00640 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x55824565ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bde00640 1 -- 172.21.15.144:0/3066819623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 msgr2=0x5582456684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bde00640 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bde00640 1 -- 172.21.15.144:0/3066819623 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x558245401770 con 0x558245614b90 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bde00640 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245667f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c990 tx=0x7fb7b0057040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b546398a55c148ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 1 -- 172.21.15.144:0/3066819623 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b005f990 con 0x558245614b90 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 1 -- 172.21.15.144:0/3066819623 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fb7b0056490 con 0x558245614b90 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 -- 172.21.15.144:0/3066819623 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7ac00e750 con 0x558245614b90 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 1 -- 172.21.15.144:0/3066819623 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fb7b005fc20 con 0x558245614b90 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 10 client.7571 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 -- 172.21.15.144:0/3066819623 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55824541f3f0 con 0x558245614b90 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 1 -- 172.21.15.144:0/3066819623 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac00e750 con 0x558245614b90 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 1 -- 172.21.15.144:0/3066819623 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7fb7b0052d90 con 0x558245614b90 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 10 client.7571 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 10 client.7571 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 20 client.7571 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x558245661a50 0x558245661e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 4 client.7571 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 -- 172.21.15.144:0/3066819623 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582453fbd90 con 0x558245661a50 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bd400640 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x558245661a50 0x558245661e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7bd400640 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x558245661a50 0x558245661e30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e169ccec4e3d6b server_cookie=e3872e9071eb22cb in_seq=0 out_seq=0 2024-09-12T12:22:37.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 10 client.7571 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 1 -- 172.21.15.144:0/3066819623 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582453fbd90 con 0x558245661a50 2024-09-12T12:22:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 10 client.7571 handle_command_reply: tid=0 2024-09-12T12:22:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 client.7571 shutdown 2024-09-12T12:22:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 -- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 msgr2=0x558245667f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245667f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c990 tx=0x7fb7b0057040 comp rx=0 tx=0).stop 2024-09-12T12:22:37.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 -- 172.21.15.144:0/3066819623 shutdown_connections 2024-09-12T12:22:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x558245661a50 0x558245661e30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x55824565ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 --2- 172.21.15.144:0/3066819623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x558245667f80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb79f400640 0 client.7571 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 -- 172.21.15.144:0/3066819623 >> 172.21.15.144:0/3066819623 conn(0x55824563d9b0 msgr2=0x558245616f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 -- 172.21.15.144:0/3066819623 shutdown_connections 2024-09-12T12:22:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.250+0000 7fb7c8662000 1 -- 172.21.15.144:0/3066819623 wait complete. 2024-09-12T12:22:37.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.254+0000 7fb7c8662000 20 client.7571 trim_cache size 0 max 16384 2024-09-12T12:22:37.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 Processor -- start 2024-09-12T12:22:37.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 -- start start 2024-09-12T12:22:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x5582456cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x5582456d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c006e8b0 con 0x558245660d50 2024-09-12T12:22:37.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0145ff0 con 0x558245661670 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c006e260 con 0x558245614b90 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51162/0 (socket says 172.21.15.144:51162) 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bd400640 1 -- 172.21.15.144:0/180709401 learned_addr learned my addr 172.21.15.144:0/180709401 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bde00640 1 --2- 172.21.15.144:0/180709401 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x5582456cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7be800640 1 --2- 172.21.15.144:0/180709401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x5582456d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bd400640 1 -- 172.21.15.144:0/180709401 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 msgr2=0x5582456cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bd400640 1 --2- 172.21.15.144:0/180709401 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x5582456cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bd400640 1 -- 172.21.15.144:0/180709401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 msgr2=0x5582456d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bd400640 1 --2- 172.21.15.144:0/180709401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x5582456d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bd400640 1 -- 172.21.15.144:0/180709401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582454e3320 con 0x558245660d50 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7bd400640 1 --2- 172.21.15.144:0/180709401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456d02c0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac001d70 tx=0x7fb7ac007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e1fc4a196f2d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7aa000640 1 -- 172.21.15.144:0/180709401 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00e6d0 con 0x558245660d50 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7aa000640 1 -- 172.21.15.144:0/180709401 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac017070 con 0x558245660d50 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7aa000640 1 -- 172.21.15.144:0/180709401 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00ec20 con 0x558245660d50 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 -- 172.21.15.144:0/180709401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 msgr2=0x5582456d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 --2- 172.21.15.144:0/180709401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456d02c0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac001d70 tx=0x7fb7ac007000 comp rx=0 tx=0).stop 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 -- 172.21.15.144:0/180709401 shutdown_connections 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 --2- 172.21.15.144:0/180709401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x5582456d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 --2- 172.21.15.144:0/180709401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245660d50 0x5582456d02c0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 --2- 172.21.15.144:0/180709401 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245614b90 0x5582456cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.270+0000 7fb7c8662000 1 -- 172.21.15.144:0/180709401 >> 172.21.15.144:0/180709401 conn(0x55824563d9b0 msgr2=0x55824563c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 -- 172.21.15.144:0/180709401 shutdown_connections 2024-09-12T12:22:37.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 -- 172.21.15.144:0/180709401 wait complete. 2024-09-12T12:22:37.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 -- start start 2024-09-12T12:22:37.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 Processor -- start 2024-09-12T12:22:37.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245614b90 0x5582456d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245660d50 0x558245665940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x558245665e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558245409120 con 0x558245614b90 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5582454e2e90 con 0x558245661670 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55824540bb90 con 0x558245660d50 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 10 client.0 _ll_register_callbacks cb 0x7fb7b0056eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245614b90 0x5582456d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245660d50 0x558245665940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245614b90 0x5582456d0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51168/0 (socket says 172.21.15.144:51168) 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bde00640 1 -- 172.21.15.144:0/2185076462 learned_addr learned my addr 172.21.15.144:0/2185076462 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7be800640 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x558245665e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bd400640 1 -- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 msgr2=0x558245665e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bd400640 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x558245665e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bd400640 1 -- 172.21.15.144:0/2185076462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245614b90 msgr2=0x5582456d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bd400640 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245614b90 0x5582456d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bd400640 1 -- 172.21.15.144:0/2185076462 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5582453f55c0 con 0x558245660d50 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bde00640 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245614b90 0x5582456d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bd400640 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245660d50 0x558245665940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac000f70 tx=0x7fb7ac0010b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7561685fc6930c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb79f400640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb79f400640 1 -- 172.21.15.144:0/2185076462 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac03d060 con 0x558245660d50 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb79f400640 1 -- 172.21.15.144:0/2185076462 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fb7ac00ecd0 con 0x558245660d50 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 -- 172.21.15.144:0/2185076462 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7ac017070 con 0x558245660d50 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb79f400640 1 -- 172.21.15.144:0/2185076462 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fb7ac030430 con 0x558245660d50 2024-09-12T12:22:37.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 10 client.7577 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 -- 172.21.15.144:0/2185076462 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x5582453f9330 con 0x558245660d50 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb79f400640 1 -- 172.21.15.144:0/2185076462 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac017070 con 0x558245660d50 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb79f400640 1 -- 172.21.15.144:0/2185076462 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7fb7ac0305d0 con 0x558245660d50 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 10 client.7577 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 10 client.7577 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 20 client.7577 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5582456d1380 0x5582456663c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 4 client.7577 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7c8662000 1 -- 172.21.15.144:0/2185076462 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55824546f3f0 con 0x5582456d1380 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.274+0000 7fb7bde00640 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5582456d1380 0x5582456663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bde00640 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5582456d1380 0x5582456663c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea3b2a51fbc5f41a server_cookie=2a09269ad566e693 in_seq=0 out_seq=0 2024-09-12T12:22:37.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb79f400640 10 client.7577 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb79f400640 1 -- 172.21.15.144:0/2185076462 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55824546f3f0 con 0x5582456d1380 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb79f400640 10 client.7577 handle_command_reply: tid=0 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 client.7577 shutdown 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 -- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245660d50 msgr2=0x558245665940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245660d50 0x558245665940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac000f70 tx=0x7fb7ac0010b0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 -- 172.21.15.144:0/2185076462 shutdown_connections 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5582456d1380 0x5582456663c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558245661670 0x558245665e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558245660d50 0x558245665940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb79f400640 0 client.7577 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 --2- 172.21.15.144:0/2185076462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558245614b90 0x5582456d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 -- 172.21.15.144:0/2185076462 >> 172.21.15.144:0/2185076462 conn(0x55824563d9b0 msgr2=0x55824561ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 -- 172.21.15.144:0/2185076462 shutdown_connections 2024-09-12T12:22:37.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 1 -- 172.21.15.144:0/2185076462 wait complete. 2024-09-12T12:22:37.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7c8662000 20 client.7577 trim_cache size 0 max 16384 2024-09-12T12:22:37.286 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:22:37.286 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:22:37.286 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:22:37.287 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:22:37.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 -- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7a00678c0 msgr2=0x7fb7a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7a00678c0 0x7fb7a0069d80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb7c015a250 tx=0x7fb7ac009040 comp rx=0 tx=0).stop 2024-09-12T12:22:37.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 -- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 msgr2=0x7fb7c014d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 0x7fb7c014d3c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000efc0 tx=0x7fb7b000c490 comp rx=0 tx=0).stop 2024-09-12T12:22:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 -- 172.21.15.144:0/2100912837 shutdown_connections 2024-09-12T12:22:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7a00678c0 0x7fb7a0069d80 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7c015c5b0 0x7fb7c0146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7c015c1d0 0x7fb7c014ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 --2- 172.21.15.144:0/2100912837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7c00b6fe0 0x7fb7c014d3c0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 -- 172.21.15.144:0/2100912837 >> 172.21.15.144:0/2100912837 conn(0x7fb7c00b7c30 msgr2=0x7fb7c00b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 -- 172.21.15.144:0/2100912837 shutdown_connections 2024-09-12T12:22:37.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.278+0000 7fb7bf200640 1 -- 172.21.15.144:0/2100912837 wait complete. 2024-09-12T12:22:37.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:37.298 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-12T12:22:37.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c89600640 1 Processor -- start 2024-09-12T12:22:37.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c89600640 1 -- start start 2024-09-12T12:22:37.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c89600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8406c320 0x7f8c84166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c89600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c840733e0 con 0x7f8c8415c2e0 2024-09-12T12:22:37.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c89600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c840cd290 con 0x7f8c840af5f0 2024-09-12T12:22:37.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c89600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8c840cd570 con 0x7f8c8406c320 2024-09-12T12:22:37.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c82a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8c8415c2e0 0x7f8c84072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42856/0 (socket says 172.21.15.144:42856) 2024-09-12T12:22:37.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c82a00640 1 -- 172.21.15.144:0/3173238817 learned_addr learned my addr 172.21.15.144:0/3173238817 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:37.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c83400640 1 --2- 172.21.15.144:0/3173238817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8406c320 0x7f8c84166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c81600640 1 -- 172.21.15.144:0/3173238817 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277318086 0 0) 0x7f8c840733e0 con 0x7f8c8415c2e0 2024-09-12T12:22:37.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c81600640 1 -- 172.21.15.144:0/3173238817 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c68003530 con 0x7f8c8415c2e0 2024-09-12T12:22:37.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c81600640 1 -- 172.21.15.144:0/3173238817 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2855748653 0 0) 0x7f8c840cd290 con 0x7f8c840af5f0 2024-09-12T12:22:37.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.434+0000 7f8c81600640 1 -- 172.21.15.144:0/3173238817 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c840733e0 con 0x7f8c840af5f0 2024-09-12T12:22:37.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c83400640 1 -- 172.21.15.144:0/3173238817 >> v1:172.21.15.165:6789/0 conn(0x7f8c840af5f0 legacy=0x7f8c8406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c83400640 1 -- 172.21.15.144:0/3173238817 >> v1:172.21.15.144:6789/0 conn(0x7f8c8415c2e0 legacy=0x7f8c84072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c83400640 1 -- 172.21.15.144:0/3173238817 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c840cd850 con 0x7f8c8406c320 2024-09-12T12:22:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c83400640 1 --2- 172.21.15.144:0/3173238817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8406c320 0x7f8c84166f10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009dc0 tx=0x7f8c7c01c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf1a2dc1a2fe514b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c81600640 1 -- 172.21.15.144:0/3173238817 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0b2070 con 0x7f8c8406c320 2024-09-12T12:22:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c81600640 1 -- 172.21.15.144:0/3173238817 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0a5840 con 0x7f8c8406c320 2024-09-12T12:22:37.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c81600640 1 -- 172.21.15.144:0/3173238817 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0a5c10 con 0x7f8c8406c320 2024-09-12T12:22:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c89600640 1 -- 172.21.15.144:0/3173238817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8406c320 msgr2=0x7f8c84166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c89600640 1 --2- 172.21.15.144:0/3173238817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8406c320 0x7f8c84166f10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009dc0 tx=0x7f8c7c01c870 comp rx=0 tx=0).stop 2024-09-12T12:22:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c89600640 1 -- 172.21.15.144:0/3173238817 shutdown_connections 2024-09-12T12:22:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c89600640 1 --2- 172.21.15.144:0/3173238817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8406c320 0x7f8c84166f10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.438+0000 7f8c89600640 1 -- 172.21.15.144:0/3173238817 >> 172.21.15.144:0/3173238817 conn(0x7f8c84068030 msgr2=0x7f8c840b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 -- 172.21.15.144:0/3173238817 shutdown_connections 2024-09-12T12:22:37.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 -- 172.21.15.144:0/3173238817 wait complete. 2024-09-12T12:22:37.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 Processor -- start 2024-09-12T12:22:37.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 -- start start 2024-09-12T12:22:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c8406c320 0x7f8c8414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c840af5f0 0x7f8c840b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8415c2e0 0x7f8c84150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8416a000 con 0x7f8c8406c320 2024-09-12T12:22:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84169e80 con 0x7f8c840af5f0 2024-09-12T12:22:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8416a180 con 0x7f8c8415c2e0 2024-09-12T12:22:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c8406c320 0x7f8c8414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c8406c320 0x7f8c8414f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51174/0 (socket says 172.21.15.144:51174) 2024-09-12T12:22:37.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82a00640 1 -- 172.21.15.144:0/306223808 learned_addr learned my addr 172.21.15.144:0/306223808 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82000640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c840af5f0 0x7f8c840b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c83400640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8415c2e0 0x7f8c84150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82a00640 1 -- 172.21.15.144:0/306223808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8415c2e0 msgr2=0x7f8c84150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82a00640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8415c2e0 0x7f8c84150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82a00640 1 -- 172.21.15.144:0/306223808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c840af5f0 msgr2=0x7f8c840b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82a00640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c840af5f0 0x7f8c840b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82a00640 1 -- 172.21.15.144:0/306223808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c840b43c0 con 0x7f8c8406c320 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c82a00640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c8406c320 0x7f8c8414f1f0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c420 tx=0x7f8c7400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c7aa00640 1 -- 172.21.15.144:0/306223808 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74017070 con 0x7f8c8406c320 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c7aa00640 1 -- 172.21.15.144:0/306223808 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c74005cf0 con 0x7f8c8406c320 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c89600640 1 -- 172.21.15.144:0/306223808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c840b4140 con 0x7f8c8406c320 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.442+0000 7f8c7aa00640 1 -- 172.21.15.144:0/306223808 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c740072d0 con 0x7f8c8406c320 2024-09-12T12:22:37.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.446+0000 7f8c89600640 1 -- 172.21.15.144:0/306223808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c840b3da0 con 0x7f8c8406c320 2024-09-12T12:22:37.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.446+0000 7f8c7aa00640 1 -- 172.21.15.144:0/306223808 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c7401a070 con 0x7f8c8406c320 2024-09-12T12:22:37.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.446+0000 7f8c7aa00640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c640678f0 0x7f8c64069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.446+0000 7f8c7aa00640 1 -- 172.21.15.144:0/306223808 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f8c740851d0 con 0x7f8c8406c320 2024-09-12T12:22:37.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.446+0000 7f8c82000640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c640678f0 0x7f8c64069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.446+0000 7f8c8ca87000 1 Processor -- start 2024-09-12T12:22:37.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.446+0000 7f8c8ca87000 1 -- start start 2024-09-12T12:22:37.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.446+0000 7f8c82000640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c640678f0 0x7f8c64069db0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8c84151570 tx=0x7f8c70009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8ad70 0x556224e8b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e3e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 0x556224e3f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556224d28960 con 0x556224e8ad70 2024-09-12T12:22:37.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556224c6c900 con 0x556224e3edb0 2024-09-12T12:22:37.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x556224c8fd40 con 0x556224e8b690 2024-09-12T12:22:37.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8ad70 0x556224e8b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c82000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e3e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c83400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 0x556224e3f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c82000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e3e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34880/0 (socket says 172.21.15.144:34880) 2024-09-12T12:22:37.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c82000640 1 -- 172.21.15.144:0/1703848928 learned_addr learned my addr 172.21.15.144:0/1703848928 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c83400640 1 -- 172.21.15.144:0/1703848928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 msgr2=0x556224e3e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c83400640 1 --2- 172.21.15.144:0/1703848928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e3e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c83400640 1 -- 172.21.15.144:0/1703848928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8ad70 msgr2=0x556224e8b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c83400640 1 --2- 172.21.15.144:0/1703848928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8ad70 0x556224e8b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c83400640 1 -- 172.21.15.144:0/1703848928 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556224c36580 con 0x556224e3edb0 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c82000640 1 --2- 172.21.15.144:0/1703848928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e3e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c82a00640 1 --2- 172.21.15.144:0/1703848928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8ad70 0x556224e8b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c83400640 1 --2- 172.21.15.144:0/1703848928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 0x556224e3f190 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0ac000 tx=0x7f8c7c004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1067f615f132dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c6f400640 1 -- 172.21.15.144:0/1703848928 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0be070 con 0x556224e3edb0 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c6f400640 1 -- 172.21.15.144:0/1703848928 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0b3040 con 0x556224e3edb0 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c6f400640 1 -- 172.21.15.144:0/1703848928 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0b2040 con 0x556224e3edb0 2024-09-12T12:22:37.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1703848928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 msgr2=0x556224e3f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1703848928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 0x556224e3f190 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0ac000 tx=0x7f8c7c004ac0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1703848928 shutdown_connections 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1703848928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 0x556224e3f190 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1703848928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e3e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1703848928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8ad70 0x556224e8b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1703848928 >> 172.21.15.144:0/1703848928 conn(0x556224e6c040 msgr2=0x556224e6e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1703848928 shutdown_connections 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1703848928 wait complete. 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 -- start start 2024-09-12T12:22:37.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 Processor -- start 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.450+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e3edb0 0x556224e91ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 0x556224e92220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e92760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556224c8bd00 con 0x556224e8b690 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556224c4aaa0 con 0x556224e8ad70 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x556224c29340 con 0x556224e3edb0 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 10 client.0 _ll_register_callbacks cb 0x556224e2c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e92760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e92760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51188/0 (socket says 172.21.15.144:51188) 2024-09-12T12:22:37.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c83400640 1 -- 172.21.15.144:0/2892096678 learned_addr learned my addr 172.21.15.144:0/2892096678 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c82a00640 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e3edb0 0x556224e91ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c82000640 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 0x556224e92220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c83400640 1 -- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e3edb0 msgr2=0x556224e91ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c83400640 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e3edb0 0x556224e91ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c83400640 1 -- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 msgr2=0x556224e92220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c83400640 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 0x556224e92220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c83400640 1 -- 172.21.15.144:0/2892096678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556224c32dc0 con 0x556224e8b690 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c82a00640 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e3edb0 0x556224e91ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c83400640 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e92760 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c01cd50 tx=0x7f8c7c01b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6086f622fafccb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 1 -- 172.21.15.144:0/2892096678 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0bc070 con 0x556224e8b690 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 1 -- 172.21.15.144:0/2892096678 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f8c7c0a5b90 con 0x556224e8b690 2024-09-12T12:22:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 -- 172.21.15.144:0/2892096678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c7c0b3040 con 0x556224e8b690 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 1 -- 172.21.15.144:0/2892096678 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f8c7c0d0050 con 0x556224e8b690 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 10 client.9057 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 -- 172.21.15.144:0/2892096678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x556224c2f7f0 con 0x556224e8b690 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 1 -- 172.21.15.144:0/2892096678 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0b3040 con 0x556224e8b690 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 1 -- 172.21.15.144:0/2892096678 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f8c7c0d3020 con 0x556224e8b690 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 10 client.9057 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 10 client.9057 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 20 client.9057 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x556224e9a0b0 0x556224e9c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 4 client.9057 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 -- 172.21.15.144:0/2892096678 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556224c29e10 con 0x556224e9a0b0 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c82a00640 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x556224e9a0b0 0x556224e9c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c82a00640 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x556224e9a0b0 0x556224e9c4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf84184f14a2d92f server_cookie=d09de2969899e97b in_seq=0 out_seq=0 2024-09-12T12:22:37.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 10 client.9057 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 1 -- 172.21.15.144:0/2892096678 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556224c29e10 con 0x556224e9a0b0 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 10 client.9057 handle_command_reply: tid=0 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 client.9057 shutdown 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 -- 172.21.15.144:0/2892096678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 msgr2=0x556224e92760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e92760 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c01cd50 tx=0x7f8c7c01b0b0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 -- 172.21.15.144:0/2892096678 shutdown_connections 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x556224e9a0b0 0x556224e9c4a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e92760 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 0x556224e92220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/2892096678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e3edb0 0x556224e91ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c63e00640 0 client.9057 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.454+0000 7f8c8ca87000 1 -- 172.21.15.144:0/2892096678 >> 172.21.15.144:0/2892096678 conn(0x556224e6c040 msgr2=0x556224e3df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.458+0000 7f8c8ca87000 1 -- 172.21.15.144:0/2892096678 shutdown_connections 2024-09-12T12:22:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.458+0000 7f8c8ca87000 1 -- 172.21.15.144:0/2892096678 wait complete. 2024-09-12T12:22:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.458+0000 7f8c8ca87000 20 client.9057 trim_cache size 0 max 16384 2024-09-12T12:22:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c8ca87000 1 Processor -- start 2024-09-12T12:22:37.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c8ca87000 1 -- start start 2024-09-12T12:22:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 0x556224e46c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8ad70 0x556224e47140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e9f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84203ee0 con 0x556224e8b690 2024-09-12T12:22:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84202f00 con 0x556224e3edb0 2024-09-12T12:22:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8c841522e0 con 0x556224e8ad70 2024-09-12T12:22:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e9f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e9f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51198/0 (socket says 172.21.15.144:51198) 2024-09-12T12:22:37.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c83400640 1 -- 172.21.15.144:0/4101990146 learned_addr learned my addr 172.21.15.144:0/4101990146 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c82a00640 1 --2- 172.21.15.144:0/4101990146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 0x556224e46c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c82000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8ad70 0x556224e47140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c83400640 1 -- 172.21.15.144:0/4101990146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8ad70 msgr2=0x556224e47140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c83400640 1 --2- 172.21.15.144:0/4101990146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8ad70 0x556224e47140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c83400640 1 -- 172.21.15.144:0/4101990146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 msgr2=0x556224e46c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c83400640 1 --2- 172.21.15.144:0/4101990146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 0x556224e46c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c83400640 1 -- 172.21.15.144:0/4101990146 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556224c4d470 con 0x556224e8b690 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.474+0000 7f8c83400640 1 --2- 172.21.15.144:0/4101990146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e9f4d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c01a4a0 tx=0x7f8c7c0bb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf3072d04ef8e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c6ea00640 1 -- 172.21.15.144:0/4101990146 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0d9070 con 0x556224e8b690 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c6ea00640 1 -- 172.21.15.144:0/4101990146 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0c8070 con 0x556224e8b690 2024-09-12T12:22:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c6ea00640 1 -- 172.21.15.144:0/4101990146 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0bc070 con 0x556224e8b690 2024-09-12T12:22:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- 172.21.15.144:0/4101990146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 msgr2=0x556224e9f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/4101990146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e9f4d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c01a4a0 tx=0x7f8c7c0bb000 comp rx=0 tx=0).stop 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- 172.21.15.144:0/4101990146 shutdown_connections 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/4101990146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e8b690 0x556224e9f4d0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/4101990146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8ad70 0x556224e47140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/4101990146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e3edb0 0x556224e46c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- 172.21.15.144:0/4101990146 >> 172.21.15.144:0/4101990146 conn(0x556224e6c040 msgr2=0x556224e97ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- 172.21.15.144:0/4101990146 shutdown_connections 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- 172.21.15.144:0/4101990146 wait complete. 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- start start 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 Processor -- start 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e3edb0 0x556224efe620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 0x556224efeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e9e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556224ccf780 con 0x556224e3edb0 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556224e4a3f0 con 0x556224e8ad70 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x556224c57400 con 0x556224e8b690 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 10 client.0 _ll_register_callbacks cb 0x7f8c70007b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e3edb0 0x556224efe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e3edb0 0x556224efe620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51200/0 (socket says 172.21.15.144:51200) 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82a00640 1 -- 172.21.15.144:0/1856153464 learned_addr learned my addr 172.21.15.144:0/1856153464 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82000640 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 0x556224efeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c83400640 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e9e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82a00640 1 -- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 msgr2=0x556224e9e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82a00640 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e9e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82a00640 1 -- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 msgr2=0x556224efeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82a00640 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 0x556224efeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82a00640 1 -- 172.21.15.144:0/1856153464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556224c23640 con 0x556224e3edb0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c82a00640 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e3edb0 0x556224efe620 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f8c74000f70 tx=0x7f8c74001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fad8543735c7f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c63e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c63e00640 1 -- 172.21.15.144:0/1856153464 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74072060 con 0x556224e3edb0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c63e00640 1 -- 172.21.15.144:0/1856153464 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f8c74007470 con 0x556224e3edb0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.478+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1856153464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c7c0c8070 con 0x556224e3edb0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c63e00640 1 -- 172.21.15.144:0/1856153464 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f8c74078050 con 0x556224e3edb0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 10 client.9063 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1856153464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x556224c273b0 con 0x556224e3edb0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c63e00640 1 -- 172.21.15.144:0/1856153464 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0c8070 con 0x556224e3edb0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c63e00640 1 -- 172.21.15.144:0/1856153464 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f8c7407b020 con 0x556224e3edb0 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 10 client.9063 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:37.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 10 client.9063 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:37.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 20 client.9063 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:37.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x556224e9ed20 0x556224e9f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 4 client.9063 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:22:37.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1856153464 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556224c9d470 con 0x556224e9ed20 2024-09-12T12:22:37.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c82000640 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x556224e9ed20 0x556224e9f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c82000640 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x556224e9ed20 0x556224e9f130 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5c048ddcee22654 server_cookie=d4dfd52e92cdd5c9 in_seq=0 out_seq=0 2024-09-12T12:22:37.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c63e00640 10 client.9063 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c63e00640 1 -- 172.21.15.144:0/1856153464 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x556224c9d470 con 0x556224e9ed20 2024-09-12T12:22:37.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c63e00640 10 client.9063 handle_command_reply: tid=0 2024-09-12T12:22:37.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 client.9063 shutdown 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1856153464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e3edb0 msgr2=0x556224efe620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e3edb0 0x556224efe620 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f8c74000f70 tx=0x7f8c74001160 comp rx=0 tx=0).stop 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1856153464 shutdown_connections 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x556224e9ed20 0x556224e9f130 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x556224e8b690 0x556224e9e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556224e8ad70 0x556224efeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 --2- 172.21.15.144:0/1856153464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556224e3edb0 0x556224efe620 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c63e00640 0 client.9063 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1856153464 >> 172.21.15.144:0/1856153464 conn(0x556224e6c040 msgr2=0x556224e8a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1856153464 shutdown_connections 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 1 -- 172.21.15.144:0/1856153464 wait complete. 2024-09-12T12:22:37.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c8ca87000 20 client.9063 trim_cache size 0 max 16384 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "991ff452-16ef-415b-80da-c96f0d33b114": { 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_control_test_path", 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "991ff452-16ef-415b-80da-c96f0d33b114", 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "recursive" 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:22:37.489 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:22:37.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 -- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c640678f0 msgr2=0x7f8c64069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c640678f0 0x7f8c64069db0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8c84151570 tx=0x7f8c70009040 comp rx=0 tx=0).stop 2024-09-12T12:22:37.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 -- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c8406c320 msgr2=0x7f8c8414f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c8406c320 0x7f8c8414f1f0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c420 tx=0x7f8c7400c8e0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 -- 172.21.15.144:0/306223808 shutdown_connections 2024-09-12T12:22:37.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8c640678f0 0x7f8c64069db0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c8415c2e0 0x7f8c84150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c840af5f0 0x7f8c840b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 --2- 172.21.15.144:0/306223808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c8406c320 0x7f8c8414f1f0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 -- 172.21.15.144:0/306223808 >> 172.21.15.144:0/306223808 conn(0x7f8c84068030 msgr2=0x7f8c840cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 -- 172.21.15.144:0/306223808 shutdown_connections 2024-09-12T12:22:37.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.482+0000 7f8c89600640 1 -- 172.21.15.144:0/306223808 wait complete. 2024-09-12T12:22:37.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:37.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.638+0000 7f9dcbe00640 1 Processor -- start 2024-09-12T12:22:37.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dcbe00640 1 -- start start 2024-09-12T12:22:37.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dcbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dcbe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dcc15c480 con 0x7f9dcc0ce950 2024-09-12T12:22:37.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dcbe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dcc15fdd0 con 0x7f9dcc0b7230 2024-09-12T12:22:37.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dcbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc1609e0 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dca000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9dcc0ce950 0x7f9dcc0b6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42866/0 (socket says 172.21.15.144:42866) 2024-09-12T12:22:37.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dca000640 1 -- 172.21.15.144:0/1969914377 learned_addr learned my addr 172.21.15.144:0/1969914377 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:37.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dcaa00640 1 --2- 172.21.15.144:0/1969914377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dcaa00640 1 -- 172.21.15.144:0/1969914377 >> v1:172.21.15.165:6789/0 conn(0x7f9dcc0b7230 legacy=0x7f9dcc0730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dcaa00640 1 -- 172.21.15.144:0/1969914377 >> v1:172.21.15.144:6789/0 conn(0x7f9dcc0ce950 legacy=0x7f9dcc0b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dc9600640 1 -- 172.21.15.144:0/1969914377 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91332358 0 0) 0x7f9dcc15fdd0 con 0x7f9dcc0b7230 2024-09-12T12:22:37.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.642+0000 7f9dcaa00640 1 -- 172.21.15.144:0/1969914377 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc1600b0 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcaa00640 1 --2- 172.21.15.144:0/1969914377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b5310 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0097f0 tx=0x7f9dbc01c2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3545be7816a130a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dc9600640 1 -- 172.21.15.144:0/1969914377 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0b0070 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dc9600640 1 -- 172.21.15.144:0/1969914377 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dbc0ab600 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dc9600640 1 -- 172.21.15.144:0/1969914377 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0ab9d0 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcbe00640 1 -- 172.21.15.144:0/1969914377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc15c0a0 msgr2=0x7f9dcc0b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcbe00640 1 --2- 172.21.15.144:0/1969914377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b5310 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0097f0 tx=0x7f9dbc01c2b0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcbe00640 1 -- 172.21.15.144:0/1969914377 shutdown_connections 2024-09-12T12:22:37.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcbe00640 1 --2- 172.21.15.144:0/1969914377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b5310 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcbe00640 1 -- 172.21.15.144:0/1969914377 >> 172.21.15.144:0/1969914377 conn(0x7f9dcc0d2280 msgr2=0x7f9dcc0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcbe00640 1 -- 172.21.15.144:0/1969914377 shutdown_connections 2024-09-12T12:22:37.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcbe00640 1 -- 172.21.15.144:0/1969914377 wait complete. 2024-09-12T12:22:37.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcbe00640 1 Processor -- start 2024-09-12T12:22:37.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.646+0000 7f9dcbe00640 1 -- start start 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc0b7230 0x7f9dcc150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc0ce950 0x7f9dcc165b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc16a160 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcbe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc169fe0 con 0x7f9dcc0b7230 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc16a2e0 con 0x7f9dcc0ce950 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51210/0 (socket says 172.21.15.144:51210) 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcb400640 1 -- 172.21.15.144:0/2042769441 learned_addr learned my addr 172.21.15.144:0/2042769441 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dca000640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc0ce950 0x7f9dcc165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcaa00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc0b7230 0x7f9dcc150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcb400640 1 -- 172.21.15.144:0/2042769441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc0ce950 msgr2=0x7f9dcc165b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcb400640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc0ce950 0x7f9dcc165b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcb400640 1 -- 172.21.15.144:0/2042769441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc0b7230 msgr2=0x7f9dcc150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcb400640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc0b7230 0x7f9dcc150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcb400640 1 -- 172.21.15.144:0/2042769441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc166510 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcb400640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b2f30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c750 tx=0x7f9dc400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dc2a00640 1 -- 172.21.15.144:0/2042769441 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc400ce60 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dc2a00640 1 -- 172.21.15.144:0/2042769441 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc4003db0 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc1667f0 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dc2a00640 1 -- 172.21.15.144:0/2042769441 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40052b0 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc166db0 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc0b5310 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.650+0000 7f9dc2a00640 1 -- 172.21.15.144:0/2042769441 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9dc4005450 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.654+0000 7f9dc2a00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dac0678c0 0x7f9dac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:37.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.654+0000 7f9dc2a00640 1 -- 172.21.15.144:0/2042769441 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f9dc4085cc0 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.654+0000 7f9dcaa00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dac0678c0 0x7f9dac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:37.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.654+0000 7f9dcaa00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dac0678c0 0x7f9dac069d80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0ad000 tx=0x7f9dbc0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:37.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.658+0000 7f9dc2a00640 1 -- 172.21.15.144:0/2042769441 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9dc408c080 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.846+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dcc0b1c60 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.846+0000 7f9dc2a00640 1 -- 172.21.15.144:0/2042769441 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7f9dc4059490 con 0x7f9dcc15c0a0 2024-09-12T12:22:37.850 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:37.850 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:37.850 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:37.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dac0678c0 msgr2=0x7f9dac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dac0678c0 0x7f9dac069d80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0ad000 tx=0x7f9dbc0a6000 comp rx=0 tx=0).stop 2024-09-12T12:22:37.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc15c0a0 msgr2=0x7f9dcc0b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:37.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b2f30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400c750 tx=0x7f9dc400cc10 comp rx=0 tx=0).stop 2024-09-12T12:22:37.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 shutdown_connections 2024-09-12T12:22:37.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9dac0678c0 0x7f9dac069d80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9dcc15c0a0 0x7f9dcc0b2f30 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9dcc0ce950 0x7f9dcc165b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 --2- 172.21.15.144:0/2042769441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9dcc0b7230 0x7f9dcc150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:37.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 >> 172.21.15.144:0/2042769441 conn(0x7f9dcc0d2280 msgr2=0x7f9dcc15ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:37.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 shutdown_connections 2024-09-12T12:22:37.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:37.850+0000 7f9dcbe00640 1 -- 172.21.15.144:0/2042769441 wait complete. 2024-09-12T12:22:37.870 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-12T12:22:37.870 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:22:38.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.002+0000 7f46da600640 1 Processor -- start 2024-09-12T12:22:38.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.002+0000 7f46da600640 1 -- start start 2024-09-12T12:22:38.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46da600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f46d40ae890 0x7f46d40aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:38.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46da600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d4144560 con 0x7f46d40b0960 2024-09-12T12:22:38.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46da600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d4144840 con 0x7f46d40b3cd0 2024-09-12T12:22:38.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46da600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f46d4162ff0 con 0x7f46d40ae890 2024-09-12T12:22:38.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f46d40b0960 0x7f46d41628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42880/0 (socket says 172.21.15.144:42880) 2024-09-12T12:22:38.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2a00640 1 -- 172.21.15.144:0/875832337 learned_addr learned my addr 172.21.15.144:0/875832337 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d3e00640 1 --2- 172.21.15.144:0/875832337 >> v2:172.21.15.165:3300/0 conn(0x7f46d40ae890 0x7f46d40aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662641001 0 0) 0x7f46d4144560 con 0x7f46d40b0960 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46b8003530 con 0x7f46d40b0960 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000740441 0 0) 0x7f46d4144840 con 0x7f46d40b3cd0 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46d4144560 con 0x7f46d40b3cd0 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2967257582 0 0) 0x7f46b8003530 con 0x7f46d40b0960 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 >> v2:172.21.15.165:3300/0 conn(0x7f46d40ae890 msgr2=0x7f46d40aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 --2- 172.21.15.144:0/875832337 >> v2:172.21.15.165:3300/0 conn(0x7f46d40ae890 0x7f46d40aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 >> v1:172.21.15.165:6789/0 conn(0x7f46d40b3cd0 legacy=0x7f46d4143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d41620e0 con 0x7f46d40b0960 2024-09-12T12:22:38.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f46c0001680 con 0x7f46d40b0960 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 >> v1:172.21.15.144:6789/0 conn(0x7f46d40b0960 legacy=0x7f46d41628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b8003b80 0x7f46b8003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b8004810 0x7f46b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46b80051d0 0x7f46b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4162ff0 con 0x7f46b8004810 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f46b800c020 con 0x7f46b80051d0 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46b800c220 con 0x7f46b8003b80 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2a00640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b8004810 0x7f46b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d3400640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b8003b80 0x7f46b8003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d3e00640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46b80051d0 0x7f46b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2a00640 1 -- 172.21.15.144:0/875832337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b8003b80 msgr2=0x7f46b8003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2a00640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b8003b80 0x7f46b8003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2a00640 1 -- 172.21.15.144:0/875832337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46b80051d0 msgr2=0x7f46b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2a00640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46b80051d0 0x7f46b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d2a00640 1 -- 172.21.15.144:0/875832337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b8003530 con 0x7f46b8004810 2024-09-12T12:22:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.006+0000 7f46d3e00640 1 -- 172.21.15.144:0/875832337 reap_dead start 2024-09-12T12:22:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46d2a00640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b8004810 0x7f46b8004c90 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c160 tx=0x7f46c001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b9d7ef993943bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0007cb0 con 0x7f46b8004810 2024-09-12T12:22:38.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c00a9020 con 0x7f46b8004810 2024-09-12T12:22:38.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46d2000640 1 -- 172.21.15.144:0/875832337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0005b00 con 0x7f46b8004810 2024-09-12T12:22:38.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46da600640 1 -- 172.21.15.144:0/875832337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b8004810 msgr2=0x7f46b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:38.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46da600640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b8004810 0x7f46b8004c90 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c160 tx=0x7f46c001cba0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46da600640 1 -- 172.21.15.144:0/875832337 shutdown_connections 2024-09-12T12:22:38.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46da600640 1 --2- 172.21.15.144:0/875832337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46b8004810 0x7f46b8004c90 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46da600640 1 -- 172.21.15.144:0/875832337 >> 172.21.15.144:0/875832337 conn(0x7f46d40703a0 msgr2=0x7f46d40d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:38.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46da600640 1 -- 172.21.15.144:0/875832337 shutdown_connections 2024-09-12T12:22:38.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46da600640 1 -- 172.21.15.144:0/875832337 wait complete. 2024-09-12T12:22:38.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46da600640 1 Processor -- start 2024-09-12T12:22:38.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.010+0000 7f46da600640 1 -- start start 2024-09-12T12:22:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46da600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b8004810 0x7f46d415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:38.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46da600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46d40cedf0 0x7f46d41f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46da600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46d41f4b80 0x7f46d41f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46da600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40aed40 con 0x7f46d40cedf0 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46da600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4144b20 con 0x7f46d41f4b80 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46da600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46d40aeec0 con 0x7f46b8004810 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46d40cedf0 0x7f46d41f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46d40cedf0 0x7f46d41f77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51236/0 (socket says 172.21.15.144:51236) 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d2a00640 1 -- 172.21.15.144:0/3552114024 learned_addr learned my addr 172.21.15.144:0/3552114024 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d3400640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b8004810 0x7f46d415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d3e00640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46d41f4b80 0x7f46d41f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d2a00640 1 -- 172.21.15.144:0/3552114024 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b8004810 msgr2=0x7f46d415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:38.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d2a00640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b8004810 0x7f46d415b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d2a00640 1 -- 172.21.15.144:0/3552114024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46d41f4b80 msgr2=0x7f46d41f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d2a00640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46d41f4b80 0x7f46d41f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d2a00640 1 -- 172.21.15.144:0/3552114024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d41f8140 con 0x7f46d40cedf0 2024-09-12T12:22:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46d2a00640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46d40cedf0 0x7f46d41f77d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f46c001c610 tx=0x7f46b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:38.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46cb400640 1 -- 172.21.15.144:0/3552114024 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0001be0 con 0x7f46d40cedf0 2024-09-12T12:22:38.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46cb400640 1 -- 172.21.15.144:0/3552114024 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c00b2070 con 0x7f46d40cedf0 2024-09-12T12:22:38.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46cb400640 1 -- 172.21.15.144:0/3552114024 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0004e60 con 0x7f46d40cedf0 2024-09-12T12:22:38.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d41f8420 con 0x7f46d40cedf0 2024-09-12T12:22:38.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d41f7d10 con 0x7f46d40cedf0 2024-09-12T12:22:38.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.014+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d41628e0 con 0x7f46d40cedf0 2024-09-12T12:22:38.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.018+0000 7f46cb400640 1 -- 172.21.15.144:0/3552114024 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46c00070d0 con 0x7f46d40cedf0 2024-09-12T12:22:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.018+0000 7f46cb400640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46b40678f0 0x7f46b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.018+0000 7f46cb400640 1 -- 172.21.15.144:0/3552114024 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f46c011fba0 con 0x7f46d40cedf0 2024-09-12T12:22:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.018+0000 7f46d3400640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46b40678f0 0x7f46b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:38.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.018+0000 7f46d3400640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46b40678f0 0x7f46b4069db0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f46c4000c10 tx=0x7f46c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:38.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.022+0000 7f46cb400640 1 -- 172.21.15.144:0/3552114024 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f46c00168b0 con 0x7f46d40cedf0 2024-09-12T12:22:38.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.234+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f46d41f4170 con 0x7f46d40cedf0 2024-09-12T12:22:38.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.234+0000 7f46cb400640 1 -- 172.21.15.144:0/3552114024 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1664 (secure 0 0 0) 0x7f46c00f04f0 con 0x7f46d40cedf0 2024-09-12T12:22:38.238 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:38.238 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":617,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":920,"data_bytes":941942328,"bytes_used":2248302592,"bytes_avail":770845810688,"bytes_total":773094113280,"recovering_objects_per_sec":2,"recovering_bytes_per_sec":2411033,"recovering_keys_per_sec":0,"num_objects_recovered":23,"num_bytes_recovered":24117248,"num_keys_recovered":0,"write_bytes_sec":50001109,"read_op_per_sec":0,"write_op_per_sec":50},"fsmap":{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":8874}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-12T12:21:57.494261+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46b40678f0 msgr2=0x7f46b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46b40678f0 0x7f46b4069db0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f46c4000c10 tx=0x7f46c4009040 comp rx=0 tx=0).stop 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46d40cedf0 msgr2=0x7f46d41f77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46d40cedf0 0x7f46d41f77d0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f46c001c610 tx=0x7f46b8005840 comp rx=0 tx=0).stop 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 shutdown_connections 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46b40678f0 0x7f46b4069db0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46d41f4b80 0x7f46d41f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46d40cedf0 0x7f46d41f77d0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 --2- 172.21.15.144:0/3552114024 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46b8004810 0x7f46d415b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 >> 172.21.15.144:0/3552114024 conn(0x7f46d40703a0 msgr2=0x7f46d415c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:38.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 shutdown_connections 2024-09-12T12:22:38.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:38.238+0000 7f46da600640 1 -- 172.21.15.144:0/3552114024 wait complete. 2024-09-12T12:22:38.258 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:22:39.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:39.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.398+0000 7efc18e00640 1 Processor -- start 2024-09-12T12:22:39.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.398+0000 7efc18e00640 1 -- start start 2024-09-12T12:22:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.398+0000 7efc18e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efc140b3590 0x7efc1415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.398+0000 7efc18e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc140b3aa0 con 0x7efc1415ad50 2024-09-12T12:22:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.398+0000 7efc18e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc140afc10 con 0x7efc140b42d0 2024-09-12T12:22:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.398+0000 7efc18e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efc1415f860 con 0x7efc140b3590 2024-09-12T12:22:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.398+0000 7efc11400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efc1415ad50 0x7efc140ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42882/0 (socket says 172.21.15.144:42882) 2024-09-12T12:22:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.398+0000 7efc11400640 1 -- 172.21.15.144:0/264491227 learned_addr learned my addr 172.21.15.144:0/264491227 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc11e00640 1 --2- 172.21.15.144:0/264491227 >> v2:172.21.15.165:3300/0 conn(0x7efc140b3590 0x7efc1415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc10a00640 1 -- 172.21.15.144:0/264491227 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448317921 0 0) 0x7efc140b3aa0 con 0x7efc1415ad50 2024-09-12T12:22:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc10a00640 1 -- 172.21.15.144:0/264491227 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbf8003530 con 0x7efc1415ad50 2024-09-12T12:22:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc10a00640 1 -- 172.21.15.144:0/264491227 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153483908 0 0) 0x7efc140afc10 con 0x7efc140b42d0 2024-09-12T12:22:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc10a00640 1 -- 172.21.15.144:0/264491227 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc140b3aa0 con 0x7efc140b42d0 2024-09-12T12:22:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc11e00640 1 -- 172.21.15.144:0/264491227 >> v1:172.21.15.165:6789/0 conn(0x7efc140b42d0 legacy=0x7efc140b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc11e00640 1 -- 172.21.15.144:0/264491227 >> v1:172.21.15.144:6789/0 conn(0x7efc1415ad50 legacy=0x7efc140ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc11e00640 1 -- 172.21.15.144:0/264491227 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc140afef0 con 0x7efc140b3590 2024-09-12T12:22:39.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc11e00640 1 --2- 172.21.15.144:0/264491227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b3590 0x7efc1415f320 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efc04009d90 tx=0x7efc0401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1906bce7aed3ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc10a00640 1 -- 172.21.15.144:0/264491227 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc040b2070 con 0x7efc140b3590 2024-09-12T12:22:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc10a00640 1 -- 172.21.15.144:0/264491227 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc040a57a0 con 0x7efc140b3590 2024-09-12T12:22:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.402+0000 7efc10a00640 1 -- 172.21.15.144:0/264491227 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc040a5b70 con 0x7efc140b3590 2024-09-12T12:22:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 -- 172.21.15.144:0/264491227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b3590 msgr2=0x7efc1415f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 --2- 172.21.15.144:0/264491227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b3590 0x7efc1415f320 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efc04009d90 tx=0x7efc0401c8e0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 -- 172.21.15.144:0/264491227 shutdown_connections 2024-09-12T12:22:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 --2- 172.21.15.144:0/264491227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b3590 0x7efc1415f320 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 -- 172.21.15.144:0/264491227 >> 172.21.15.144:0/264491227 conn(0x7efc1406d0d0 msgr2=0x7efc1406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 -- 172.21.15.144:0/264491227 shutdown_connections 2024-09-12T12:22:39.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 -- 172.21.15.144:0/264491227 wait complete. 2024-09-12T12:22:39.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 Processor -- start 2024-09-12T12:22:39.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 -- start start 2024-09-12T12:22:39.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc140b3590 0x7efc14153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b42d0 0x7efc14153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc1415ad50 0x7efc1415c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc14169700 con 0x7efc1415ad50 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc140cd6f0 con 0x7efc140b42d0 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc18e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc14169880 con 0x7efc140b3590 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc12800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc1415ad50 0x7efc1415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc12800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc1415ad50 0x7efc1415c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51242/0 (socket says 172.21.15.144:51242) 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc12800640 1 -- 172.21.15.144:0/4283471336 learned_addr learned my addr 172.21.15.144:0/4283471336 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc11e00640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc140b3590 0x7efc14153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc11400640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b42d0 0x7efc14153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc12800640 1 -- 172.21.15.144:0/4283471336 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc140b3590 msgr2=0x7efc14153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc12800640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc140b3590 0x7efc14153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc12800640 1 -- 172.21.15.144:0/4283471336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b42d0 msgr2=0x7efc14153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc12800640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b42d0 0x7efc14153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc12800640 1 -- 172.21.15.144:0/4283471336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1415b4e0 con 0x7efc1415ad50 2024-09-12T12:22:39.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.406+0000 7efc11400640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b42d0 0x7efc14153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:39.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc12800640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc1415ad50 0x7efc1415c580 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00c410 tx=0x7efc0c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc0a000640 1 -- 172.21.15.144:0/4283471336 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c017070 con 0x7efc1415ad50 2024-09-12T12:22:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc0a000640 1 -- 172.21.15.144:0/4283471336 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc0c0052d0 con 0x7efc1415ad50 2024-09-12T12:22:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc0a000640 1 -- 172.21.15.144:0/4283471336 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0054c0 con 0x7efc1415ad50 2024-09-12T12:22:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1415b7c0 con 0x7efc1415ad50 2024-09-12T12:22:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1415bd80 con 0x7efc1415ad50 2024-09-12T12:22:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc1415f320 con 0x7efc1415ad50 2024-09-12T12:22:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc0a000640 1 -- 172.21.15.144:0/4283471336 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc0c01a070 con 0x7efc1415ad50 2024-09-12T12:22:39.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc0a000640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efbf40678c0 0x7efbf4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc0a000640 1 -- 172.21.15.144:0/4283471336 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7efc0c085190 con 0x7efc1415ad50 2024-09-12T12:22:39.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc11e00640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efbf40678c0 0x7efbf4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.410+0000 7efc11e00640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efbf40678c0 0x7efbf4069d80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efc040af000 tx=0x7efc040a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:39.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.414+0000 7efc0a000640 1 -- 172.21.15.144:0/4283471336 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efc0c055490 con 0x7efc1415ad50 2024-09-12T12:22:39.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc140d08f0 con 0x7efc1415ad50 2024-09-12T12:22:39.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc0a000640 1 -- 172.21.15.144:0/4283471336 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7efc0c059790 con 0x7efc1415ad50 2024-09-12T12:22:39.611 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:39.611 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:39.612 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:39.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efbf40678c0 msgr2=0x7efbf4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efbf40678c0 0x7efbf4069d80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7efc040af000 tx=0x7efc040a7070 comp rx=0 tx=0).stop 2024-09-12T12:22:39.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc1415ad50 msgr2=0x7efc1415c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc1415ad50 0x7efc1415c580 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00c410 tx=0x7efc0c00c8d0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 shutdown_connections 2024-09-12T12:22:39.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efbf40678c0 0x7efbf4069d80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc1415ad50 0x7efc1415c580 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc140b42d0 0x7efc14153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 --2- 172.21.15.144:0/4283471336 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc140b3590 0x7efc14153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 >> 172.21.15.144:0/4283471336 conn(0x7efc1406d0d0 msgr2=0x7efc1415e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:39.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 shutdown_connections 2024-09-12T12:22:39.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.610+0000 7efc18e00640 1 -- 172.21.15.144:0/4283471336 wait complete. 2024-09-12T12:22:39.631 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-12T12:22:39.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:22:39.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.762+0000 7fe768600640 1 Processor -- start 2024-09-12T12:22:39.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe768600640 1 -- start start 2024-09-12T12:22:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe768600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe7600cf8b0 0x7fe760167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe768600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76006e360 con 0x7fe7600d0ee0 2024-09-12T12:22:39.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe768600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76006e640 con 0x7fe76015c2b0 2024-09-12T12:22:39.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe768600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe7600cd830 con 0x7fe7600cf8b0 2024-09-12T12:22:39.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe765200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe7600d0ee0 0x7fe7600cf1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42888/0 (socket says 172.21.15.144:42888) 2024-09-12T12:22:39.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe765200640 1 -- 172.21.15.144:0/1167901112 learned_addr learned my addr 172.21.15.144:0/1167901112 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:39.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe766600640 1 --2- 172.21.15.144:0/1167901112 >> v2:172.21.15.165:3300/0 conn(0x7fe7600cf8b0 0x7fe760167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820010253 0 0) 0x7fe76006e360 con 0x7fe7600d0ee0 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe748003530 con 0x7fe7600d0ee0 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1679584051 0 0) 0x7fe748003530 con 0x7fe7600d0ee0 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 >> v2:172.21.15.165:3300/0 conn(0x7fe7600cf8b0 msgr2=0x7fe760167260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 --2- 172.21.15.144:0/1167901112 >> v2:172.21.15.165:3300/0 conn(0x7fe7600cf8b0 0x7fe760167260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 >> v1:172.21.15.165:6789/0 conn(0x7fe76015c2b0 legacy=0x7fe76006da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7600cd4c0 con 0x7fe7600d0ee0 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fe74c001680 con 0x7fe7600d0ee0 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 >> v1:172.21.15.144:6789/0 conn(0x7fe7600d0ee0 legacy=0x7fe7600cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7480039c0 0x7fe748003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7480043c0 0x7fe748004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe74800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe7600cd830 con 0x7fe748005090 2024-09-12T12:22:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe74800bff0 con 0x7fe7480039c0 2024-09-12T12:22:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe74800c1f0 con 0x7fe7480043c0 2024-09-12T12:22:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe766600640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe74800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe765200640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7480043c0 0x7fe748004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe765c00640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7480039c0 0x7fe748003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe766600640 1 -- 172.21.15.144:0/1167901112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7480043c0 msgr2=0x7fe748004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe766600640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7480043c0 0x7fe748004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe766600640 1 -- 172.21.15.144:0/1167901112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7480039c0 msgr2=0x7fe748003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:39.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe766600640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7480039c0 0x7fe748003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.766+0000 7fe766600640 1 -- 172.21.15.144:0/1167901112 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe748003530 con 0x7fe748005090 2024-09-12T12:22:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe766600640 1 -- 172.21.15.144:0/1167901112 reap_dead start 2024-09-12T12:22:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe766600640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe74800b9d0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fe758009fc0 tx=0x7fe75801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24caf9f88097145f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758009c10 con 0x7fe748005090 2024-09-12T12:22:39.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7580a5c00 con 0x7fe748005090 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe75fe00640 1 -- 172.21.15.144:0/1167901112 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7580039a0 con 0x7fe748005090 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe768600640 1 -- 172.21.15.144:0/1167901112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 msgr2=0x7fe74800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe768600640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe74800b9d0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fe758009fc0 tx=0x7fe75801ccc0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe768600640 1 -- 172.21.15.144:0/1167901112 shutdown_connections 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe768600640 1 --2- 172.21.15.144:0/1167901112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe74800b9d0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe768600640 1 -- 172.21.15.144:0/1167901112 >> 172.21.15.144:0/1167901112 conn(0x7fe760067e00 msgr2=0x7fe7600d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe768600640 1 -- 172.21.15.144:0/1167901112 shutdown_connections 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.770+0000 7fe768600640 1 -- 172.21.15.144:0/1167901112 wait complete. 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 Processor -- start 2024-09-12T12:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 -- start start 2024-09-12T12:22:39.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe7600b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76015a2c0 0x7fe760155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76015b0d0 0x7fe76015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe76015c810 con 0x7fe748005090 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe76015c690 con 0x7fe76015a2c0 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe7600cf1a0 con 0x7fe76015b0d0 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe7600b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe7600b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51264/0 (socket says 172.21.15.144:51264) 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765c00640 1 -- 172.21.15.144:0/322983315 learned_addr learned my addr 172.21.15.144:0/322983315 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765200640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76015a2c0 0x7fe760155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe766600640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76015b0d0 0x7fe76015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765c00640 1 -- 172.21.15.144:0/322983315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76015b0d0 msgr2=0x7fe76015b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765c00640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76015b0d0 0x7fe76015b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765c00640 1 -- 172.21.15.144:0/322983315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76015a2c0 msgr2=0x7fe760155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765c00640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76015a2c0 0x7fe760155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765c00640 1 -- 172.21.15.144:0/322983315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76015adb0 con 0x7fe748005090 2024-09-12T12:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe765c00640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe7600b2750 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fe75400e530 tx=0x7fe75400e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:39.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe75d600640 1 -- 172.21.15.144:0/322983315 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540052e0 con 0x7fe748005090 2024-09-12T12:22:39.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe75d600640 1 -- 172.21.15.144:0/322983315 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe754018070 con 0x7fe748005090 2024-09-12T12:22:39.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe75d600640 1 -- 172.21.15.144:0/322983315 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754003840 con 0x7fe748005090 2024-09-12T12:22:39.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe76015a7f0 con 0x7fe748005090 2024-09-12T12:22:39.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7600ca7f0 con 0x7fe748005090 2024-09-12T12:22:39.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.774+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7600cf530 con 0x7fe748005090 2024-09-12T12:22:39.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.778+0000 7fe75d600640 1 -- 172.21.15.144:0/322983315 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe7540039e0 con 0x7fe748005090 2024-09-12T12:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.778+0000 7fe75d600640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7400678c0 0x7fe740069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.778+0000 7fe75d600640 1 -- 172.21.15.144:0/322983315 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fe754085a70 con 0x7fe748005090 2024-09-12T12:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.778+0000 7fe765200640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7400678c0 0x7fe740069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.778+0000 7fe765200640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7400678c0 0x7fe740069d80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe7600b4600 tx=0x7fe74c000f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.782+0000 7fe75d600640 1 -- 172.21.15.144:0/322983315 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe754005480 con 0x7fe748005090 2024-09-12T12:22:39.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.994+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe7600732e0 con 0x7fe748005090 2024-09-12T12:22:39.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.994+0000 7fe75d600640 1 -- 172.21.15.144:0/322983315 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1665 (secure 0 0 0) 0x7fe754055ce0 con 0x7fe748005090 2024-09-12T12:22:39.998 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:39.998 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":619,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":995,"data_bytes":1020585528,"bytes_used":2442842112,"bytes_avail":770651271168,"bytes_total":773094113280,"recovering_objects_per_sec":2,"recovering_bytes_per_sec":2192105,"recovering_keys_per_sec":0,"num_objects_recovered":23,"num_bytes_recovered":24117248,"num_keys_recovered":0,"write_bytes_sec":52610708,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":8874}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-12T12:21:57.494261+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:22:40.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7400678c0 msgr2=0x7fe740069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:40.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7400678c0 0x7fe740069d80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe7600b4600 tx=0x7fe74c000f90 comp rx=0 tx=0).stop 2024-09-12T12:22:40.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 msgr2=0x7fe7600b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:40.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe7600b2750 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fe75400e530 tx=0x7fe75400e9f0 comp rx=0 tx=0).stop 2024-09-12T12:22:40.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 shutdown_connections 2024-09-12T12:22:40.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe7400678c0 0x7fe740069d80 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:40.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76015b0d0 0x7fe76015b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:40.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76015a2c0 0x7fe760155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:40.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 --2- 172.21.15.144:0/322983315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe748005090 0x7fe7600b2750 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:40.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 >> 172.21.15.144:0/322983315 conn(0x7fe760067e00 msgr2=0x7fe76015fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:40.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 shutdown_connections 2024-09-12T12:22:40.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:39.998+0000 7fe768600640 1 -- 172.21.15.144:0/322983315 wait complete. 2024-09-12T12:22:40.019 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:22:41.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:41.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f76400640 1 Processor -- start 2024-09-12T12:22:41.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f76400640 1 -- start start 2024-09-12T12:22:41.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f76400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5f700d05c0 0x7f5f70072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f76400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70072640 0x7f5f7015de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f76400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f7015a110 con 0x7f5f70159d30 2024-09-12T12:22:41.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f76400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5f70073710 con 0x7f5f700d05c0 2024-09-12T12:22:41.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f76400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5f70072e70 con 0x7f5f70072640 2024-09-12T12:22:41.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f75a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70072640 0x7f5f7015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f75a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70072640 0x7f5f7015de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:34974/0 (socket says 172.21.15.144:34974) 2024-09-12T12:22:41.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f75a00640 1 -- 172.21.15.144:0/3284097877 learned_addr learned my addr 172.21.15.144:0/3284097877 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:41.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f6fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5f700d05c0 0x7f5f70072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f75000640 1 --1- 172.21.15.144:0/3284097877 >> v1:172.21.15.165:6789/0 conn(0x7f5f70159d30 0x7f5f700cfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:44622/0 (socket says 172.21.15.144:44622) 2024-09-12T12:22:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f75a00640 1 -- 172.21.15.144:0/3284097877 >> v2:172.21.15.165:3300/0 conn(0x7f5f700d05c0 msgr2=0x7f5f70072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f75a00640 1 --2- 172.21.15.144:0/3284097877 >> v2:172.21.15.165:3300/0 conn(0x7f5f700d05c0 0x7f5f70072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f75a00640 1 -- 172.21.15.144:0/3284097877 >> v1:172.21.15.165:6789/0 conn(0x7f5f70159d30 legacy=0x7f5f700cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f75a00640 1 -- 172.21.15.144:0/3284097877 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f70073150 con 0x7f5f70072640 2024-09-12T12:22:41.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.158+0000 7f5f6fe00640 1 --2- 172.21.15.144:0/3284097877 >> v2:172.21.15.165:3300/0 conn(0x7f5f700d05c0 0x7f5f70072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:41.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f75a00640 1 --2- 172.21.15.144:0/3284097877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70072640 0x7f5f7015de60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009e50 tx=0x7f5f6801ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e7bb053db1a354 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f6f400640 1 -- 172.21.15.144:0/3284097877 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f680a58d0 con 0x7f5f70072640 2024-09-12T12:22:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f6f400640 1 -- 172.21.15.144:0/3284097877 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f680a5a70 con 0x7f5f70072640 2024-09-12T12:22:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f6f400640 1 -- 172.21.15.144:0/3284097877 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f680a5e40 con 0x7f5f70072640 2024-09-12T12:22:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f76400640 1 -- 172.21.15.144:0/3284097877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70072640 msgr2=0x7f5f7015de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f76400640 1 --2- 172.21.15.144:0/3284097877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70072640 0x7f5f7015de60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009e50 tx=0x7f5f6801ca00 comp rx=0 tx=0).stop 2024-09-12T12:22:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f76400640 1 -- 172.21.15.144:0/3284097877 shutdown_connections 2024-09-12T12:22:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f76400640 1 --2- 172.21.15.144:0/3284097877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70072640 0x7f5f7015de60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f76400640 1 --2- 172.21.15.144:0/3284097877 >> v2:172.21.15.165:3300/0 conn(0x7f5f700d05c0 0x7f5f70072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f76400640 1 -- 172.21.15.144:0/3284097877 >> 172.21.15.144:0/3284097877 conn(0x7f5f7006bc10 msgr2=0x7f5f7006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f76400640 1 -- 172.21.15.144:0/3284097877 shutdown_connections 2024-09-12T12:22:41.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f76400640 1 -- 172.21.15.144:0/3284097877 wait complete. 2024-09-12T12:22:41.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.162+0000 7f5f76400640 1 Processor -- start 2024-09-12T12:22:41.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 -- start start 2024-09-12T12:22:41.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f70072640 0x7f5f7014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f700d05c0 0x7f5f700c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70159d30 0x7f5f700cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7015ed30 con 0x7f5f70072640 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7015ebb0 con 0x7f5f700d05c0 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5f7015eeb0 con 0x7f5f70159d30 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f70072640 0x7f5f7014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f70072640 0x7f5f7014c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51274/0 (socket says 172.21.15.144:51274) 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75000640 1 -- 172.21.15.144:0/2488828446 learned_addr learned my addr 172.21.15.144:0/2488828446 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f6fe00640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f700d05c0 0x7f5f700c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75a00640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70159d30 0x7f5f700cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75000640 1 -- 172.21.15.144:0/2488828446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70159d30 msgr2=0x7f5f700cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75000640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70159d30 0x7f5f700cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75000640 1 -- 172.21.15.144:0/2488828446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f700d05c0 msgr2=0x7f5f700c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75000640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f700d05c0 0x7f5f700c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75000640 1 -- 172.21.15.144:0/2488828446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f70154270 con 0x7f5f70072640 2024-09-12T12:22:41.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f75000640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f70072640 0x7f5f7014c870 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400c370 tx=0x7f5f6400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f6cc00640 1 -- 172.21.15.144:0/2488828446 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f640074e0 con 0x7f5f70072640 2024-09-12T12:22:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f6cc00640 1 -- 172.21.15.144:0/2488828446 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f64007680 con 0x7f5f70072640 2024-09-12T12:22:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f6cc00640 1 -- 172.21.15.144:0/2488828446 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64004a30 con 0x7f5f70072640 2024-09-12T12:22:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f701552c0 con 0x7f5f70072640 2024-09-12T12:22:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f701544e0 con 0x7f5f70072640 2024-09-12T12:22:41.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.166+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f700cc930 con 0x7f5f70072640 2024-09-12T12:22:41.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.170+0000 7f5f6cc00640 1 -- 172.21.15.144:0/2488828446 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f6401a020 con 0x7f5f70072640 2024-09-12T12:22:41.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.170+0000 7f5f6cc00640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f500678c0 0x7f5f50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.170+0000 7f5f6cc00640 1 -- 172.21.15.144:0/2488828446 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f5f640855f0 con 0x7f5f70072640 2024-09-12T12:22:41.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.170+0000 7f5f6fe00640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f500678c0 0x7f5f50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.170+0000 7f5f6fe00640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f500678c0 0x7f5f50069d80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5f700b4db0 tx=0x7f5f5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.174+0000 7f5f6cc00640 1 -- 172.21.15.144:0/2488828446 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5f700cc930 con 0x7f5f70072640 2024-09-12T12:22:41.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.362+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f7015de60 con 0x7f5f70072640 2024-09-12T12:22:41.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.362+0000 7f5f6cc00640 1 -- 172.21.15.144:0/2488828446 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7f5f64055f40 con 0x7f5f70072640 2024-09-12T12:22:41.366 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:41.366 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:41.366 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f500678c0 msgr2=0x7f5f50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f500678c0 0x7f5f50069d80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5f700b4db0 tx=0x7f5f5c008040 comp rx=0 tx=0).stop 2024-09-12T12:22:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f70072640 msgr2=0x7f5f7014c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f70072640 0x7f5f7014c870 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400c370 tx=0x7f5f6400c830 comp rx=0 tx=0).stop 2024-09-12T12:22:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 shutdown_connections 2024-09-12T12:22:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f500678c0 0x7f5f50069d80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f70159d30 0x7f5f700cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f700d05c0 0x7f5f700c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 --2- 172.21.15.144:0/2488828446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f70072640 0x7f5f7014c870 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 >> 172.21.15.144:0/2488828446 conn(0x7f5f7006bc10 msgr2=0x7f5f701576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 shutdown_connections 2024-09-12T12:22:41.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.366+0000 7f5f76400640 1 -- 172.21.15.144:0/2488828446 wait complete. 2024-09-12T12:22:41.387 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-12T12:22:41.387 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:22:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.522+0000 7fa715c00640 1 Processor -- start 2024-09-12T12:22:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.522+0000 7fa715c00640 1 -- start start 2024-09-12T12:22:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa710147e40 0x7fa71015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa7100b34a0 0x7fa7100b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa71015f120 con 0x7fa7100b4300 2024-09-12T12:22:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa7100b3e50 con 0x7fa7100b34a0 2024-09-12T12:22:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa710161f30 con 0x7fa710147e40 2024-09-12T12:22:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa7100b34a0 0x7fa7100b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa70f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa7100b4300 0x7fa7101626a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42900/0 (socket says 172.21.15.144:42900) 2024-09-12T12:22:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa70f400640 1 -- 172.21.15.144:0/350029343 learned_addr learned my addr 172.21.15.144:0/350029343 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa70fe00640 1 --2- 172.21.15.144:0/350029343 >> v2:172.21.15.165:3300/0 conn(0x7fa710147e40 0x7fa71015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715200640 1 -- 172.21.15.144:0/350029343 >> v2:172.21.15.165:3300/0 conn(0x7fa710147e40 msgr2=0x7fa71015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715200640 1 --2- 172.21.15.144:0/350029343 >> v2:172.21.15.165:3300/0 conn(0x7fa710147e40 0x7fa71015e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715200640 1 -- 172.21.15.144:0/350029343 >> v1:172.21.15.144:6789/0 conn(0x7fa7100b4300 legacy=0x7fa7101626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa715200640 1 -- 172.21.15.144:0/350029343 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71015f400 con 0x7fa7100b34a0 2024-09-12T12:22:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.526+0000 7fa70ea00640 1 -- 172.21.15.144:0/350029343 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059454216 0 0) 0x7fa71015f120 con 0x7fa7100b4300 2024-09-12T12:22:41.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715200640 1 --2- 172.21.15.144:0/350029343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b34a0 0x7fa7100b3910 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fa71006cc80 tx=0x7fa70801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d83c5a8963e14c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa70ea00640 1 -- 172.21.15.144:0/350029343 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7080b2070 con 0x7fa7100b34a0 2024-09-12T12:22:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa70ea00640 1 -- 172.21.15.144:0/350029343 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7080a58e0 con 0x7fa7100b34a0 2024-09-12T12:22:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa70ea00640 1 -- 172.21.15.144:0/350029343 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7080a5cb0 con 0x7fa7100b34a0 2024-09-12T12:22:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 -- 172.21.15.144:0/350029343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b34a0 msgr2=0x7fa7100b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 --2- 172.21.15.144:0/350029343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b34a0 0x7fa7100b3910 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fa71006cc80 tx=0x7fa70801c930 comp rx=0 tx=0).stop 2024-09-12T12:22:41.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 -- 172.21.15.144:0/350029343 shutdown_connections 2024-09-12T12:22:41.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 --2- 172.21.15.144:0/350029343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b34a0 0x7fa7100b3910 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 --2- 172.21.15.144:0/350029343 >> v2:172.21.15.165:3300/0 conn(0x7fa710147e40 0x7fa71015e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 -- 172.21.15.144:0/350029343 >> 172.21.15.144:0/350029343 conn(0x7fa7100b69f0 msgr2=0x7fa7100b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 -- 172.21.15.144:0/350029343 shutdown_connections 2024-09-12T12:22:41.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 -- 172.21.15.144:0/350029343 wait complete. 2024-09-12T12:22:41.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 Processor -- start 2024-09-12T12:22:41.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 -- start start 2024-09-12T12:22:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7100b34a0 0x7fa71013e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.530+0000 7fa715c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b4300 0x7fa71015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa715c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa710147e40 0x7fa710146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa715c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa71016b0a0 con 0x7fa7100b4300 2024-09-12T12:22:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa715c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa71015ee20 con 0x7fa7100b34a0 2024-09-12T12:22:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa715c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa71016b220 con 0x7fa710147e40 2024-09-12T12:22:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b4300 0x7fa71015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b4300 0x7fa71015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51298/0 (socket says 172.21.15.144:51298) 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70f400640 1 -- 172.21.15.144:0/2113167191 learned_addr learned my addr 172.21.15.144:0/2113167191 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70fe00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7100b34a0 0x7fa71013e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa715200640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa710147e40 0x7fa710146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70f400640 1 -- 172.21.15.144:0/2113167191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa710147e40 msgr2=0x7fa710146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70f400640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa710147e40 0x7fa710146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70f400640 1 -- 172.21.15.144:0/2113167191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7100b34a0 msgr2=0x7fa71013e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70f400640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7100b34a0 0x7fa71013e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70f400640 1 -- 172.21.15.144:0/2113167191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7101453c0 con 0x7fa7100b4300 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa70f400640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b4300 0x7fa71015dd50 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00c520 tx=0x7fa6fc00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa707e00640 1 -- 172.21.15.144:0/2113167191 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc018070 con 0x7fa7100b4300 2024-09-12T12:22:41.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa707e00640 1 -- 172.21.15.144:0/2113167191 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6fc0074e0 con 0x7fa7100b4300 2024-09-12T12:22:41.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa710145660 con 0x7fa7100b4300 2024-09-12T12:22:41.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa707e00640 1 -- 172.21.15.144:0/2113167191 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0049f0 con 0x7fa7100b4300 2024-09-12T12:22:41.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa710145c20 con 0x7fa7100b4300 2024-09-12T12:22:41.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7100b3910 con 0x7fa7100b4300 2024-09-12T12:22:41.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.534+0000 7fa707e00640 1 -- 172.21.15.144:0/2113167191 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6fc01b070 con 0x7fa7100b4300 2024-09-12T12:22:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.538+0000 7fa707e00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6f00678c0 0x7fa6f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.538+0000 7fa707e00640 1 -- 172.21.15.144:0/2113167191 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fa6fc085210 con 0x7fa7100b4300 2024-09-12T12:22:41.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.538+0000 7fa70fe00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6f00678c0 0x7fa6f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.538+0000 7fa70fe00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6f00678c0 0x7fa6f0069d80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa710161780 tx=0x7fa700009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.542+0000 7fa707e00640 1 -- 172.21.15.144:0/2113167191 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa6fc055520 con 0x7fa7100b4300 2024-09-12T12:22:41.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.754+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa710160500 con 0x7fa7100b4300 2024-09-12T12:22:41.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.754+0000 7fa707e00640 1 -- 172.21.15.144:0/2113167191 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1817 (secure 0 0 0) 0x7fa6fc059820 con 0x7fa7100b4300 2024-09-12T12:22:41.756 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:41.756 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":621,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076445466,"bytes_used":2583904256,"bytes_avail":770510209024,"bytes_total":773094113280,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":873572,"recovering_keys_per_sec":0,"num_objects_recovered":10,"num_bytes_recovered":10485760,"num_keys_recovered":0,"write_bytes_sec":43263752,"read_op_per_sec":0,"write_op_per_sec":43},"fsmap":{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":8874}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-12T12:22:41.503973+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:22:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.754+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6f00678c0 msgr2=0x7fa6f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.754+0000 7fa715c00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6f00678c0 0x7fa6f0069d80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa710161780 tx=0x7fa700009190 comp rx=0 tx=0).stop 2024-09-12T12:22:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.754+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b4300 msgr2=0x7fa71015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.754+0000 7fa715c00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b4300 0x7fa71015dd50 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00c520 tx=0x7fa6fc00c9e0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.758+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 shutdown_connections 2024-09-12T12:22:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.758+0000 7fa715c00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6f00678c0 0x7fa6f0069d80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.758+0000 7fa715c00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa710147e40 0x7fa710146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.758+0000 7fa715c00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7100b4300 0x7fa71015dd50 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.758+0000 7fa715c00640 1 --2- 172.21.15.144:0/2113167191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7100b34a0 0x7fa71013e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.758+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 >> 172.21.15.144:0/2113167191 conn(0x7fa7100b69f0 msgr2=0x7fa7100cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.758+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 shutdown_connections 2024-09-12T12:22:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.758+0000 7fa715c00640 1 -- 172.21.15.144:0/2113167191 wait complete. 2024-09-12T12:22:41.777 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused'} 2024-09-12T12:22:41.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:41.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-09-12T12:22:41.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec17800640 1 Processor -- start 2024-09-12T12:22:41.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec17800640 1 -- start start 2024-09-12T12:22:41.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec17800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fec100cd9f0 0x7fec1006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec17800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec1015b340 0x7fec1006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec17800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec100b4300 con 0x7fec1015af60 2024-09-12T12:22:41.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec17800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fec100b32f0 con 0x7fec1015b340 2024-09-12T12:22:41.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec17800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fec100b3540 con 0x7fec100cd9f0 2024-09-12T12:22:41.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec15800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec1015b340 0x7fec1006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec15800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec1015b340 0x7fec1006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51300/0 (socket says 172.21.15.144:51300) 2024-09-12T12:22:41.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec15800640 1 -- 172.21.15.144:0/2860492019 learned_addr learned my addr 172.21.15.144:0/2860492019 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec0fe00640 1 --2- 172.21.15.144:0/2860492019 >> v2:172.21.15.165:3300/0 conn(0x7fec100cd9f0 0x7fec1006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec15800640 1 -- 172.21.15.144:0/2860492019 >> v2:172.21.15.165:3300/0 conn(0x7fec100cd9f0 msgr2=0x7fec1006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec15800640 1 --2- 172.21.15.144:0/2860492019 >> v2:172.21.15.165:3300/0 conn(0x7fec100cd9f0 0x7fec1006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec15800640 1 -- 172.21.15.144:0/2860492019 >> v1:172.21.15.165:6789/0 conn(0x7fec1015af60 legacy=0x7fec100ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec15800640 1 -- 172.21.15.144:0/2860492019 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec100b3820 con 0x7fec1015b340 2024-09-12T12:22:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.914+0000 7fec0fe00640 1 --2- 172.21.15.144:0/2860492019 >> v2:172.21.15.165:3300/0 conn(0x7fec100cd9f0 0x7fec1006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec15800640 1 --2- 172.21.15.144:0/2860492019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015b340 0x7fec1006c150 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fec10070d20 tx=0x7fec0801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b8d21946f12459 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec0f400640 1 -- 172.21.15.144:0/2860492019 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080a56c0 con 0x7fec1015b340 2024-09-12T12:22:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec0f400640 1 -- 172.21.15.144:0/2860492019 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec080a5860 con 0x7fec1015b340 2024-09-12T12:22:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec0f400640 1 -- 172.21.15.144:0/2860492019 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080a5c30 con 0x7fec1015b340 2024-09-12T12:22:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec17800640 1 -- 172.21.15.144:0/2860492019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015b340 msgr2=0x7fec1006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec17800640 1 --2- 172.21.15.144:0/2860492019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015b340 0x7fec1006c150 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fec10070d20 tx=0x7fec0801c9f0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec17800640 1 -- 172.21.15.144:0/2860492019 shutdown_connections 2024-09-12T12:22:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec17800640 1 --2- 172.21.15.144:0/2860492019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015b340 0x7fec1006c150 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec17800640 1 --2- 172.21.15.144:0/2860492019 >> v2:172.21.15.165:3300/0 conn(0x7fec100cd9f0 0x7fec1006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec17800640 1 -- 172.21.15.144:0/2860492019 >> 172.21.15.144:0/2860492019 conn(0x7fec10068030 msgr2=0x7fec100b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec17800640 1 -- 172.21.15.144:0/2860492019 shutdown_connections 2024-09-12T12:22:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.918+0000 7fec17800640 1 -- 172.21.15.144:0/2860492019 wait complete. 2024-09-12T12:22:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 Processor -- start 2024-09-12T12:22:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 -- start start 2024-09-12T12:22:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec100cd9f0 0x7fec10154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015af60 0x7fec101460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1015b340 0x7fec10073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec100b5180 con 0x7fec1015af60 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec100b5000 con 0x7fec100cd9f0 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec100b5300 con 0x7fec1015b340 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015af60 0x7fec101460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015af60 0x7fec101460f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51314/0 (socket says 172.21.15.144:51314) 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0fe00640 1 -- 172.21.15.144:0/780779645 learned_addr learned my addr 172.21.15.144:0/780779645 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec15800640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1015b340 0x7fec10073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec14e00640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec100cd9f0 0x7fec10154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0fe00640 1 -- 172.21.15.144:0/780779645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1015b340 msgr2=0x7fec10073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0fe00640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1015b340 0x7fec10073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0fe00640 1 -- 172.21.15.144:0/780779645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec100cd9f0 msgr2=0x7fec10154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0fe00640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec100cd9f0 0x7fec10154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0fe00640 1 -- 172.21.15.144:0/780779645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec101555c0 con 0x7fec1015af60 2024-09-12T12:22:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec14e00640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec100cd9f0 0x7fec10154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0fe00640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015af60 0x7fec101460f0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c7f0 tx=0x7febfc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0cc00640 1 -- 172.21.15.144:0/780779645 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc007a30 con 0x7fec1015af60 2024-09-12T12:22:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0cc00640 1 -- 172.21.15.144:0/780779645 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febfc007bd0 con 0x7fec1015af60 2024-09-12T12:22:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec0cc00640 1 -- 172.21.15.144:0/780779645 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc0113f0 con 0x7fec1015af60 2024-09-12T12:22:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 -- 172.21.15.144:0/780779645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec101558a0 con 0x7fec1015af60 2024-09-12T12:22:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.922+0000 7fec17800640 1 -- 172.21.15.144:0/780779645 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec10155e60 con 0x7fec1015af60 2024-09-12T12:22:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec0cc00640 1 -- 172.21.15.144:0/780779645 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7febfc011590 con 0x7fec1015af60 2024-09-12T12:22:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec0cc00640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febf00678f0 0x7febf0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec0cc00640 1 -- 172.21.15.144:0/780779645 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7febfc085f90 con 0x7fec1015af60 2024-09-12T12:22:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febf00678f0 0x7febf0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec1ab6b000 1 Processor -- start 2024-09-12T12:22:41.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec1ab6b000 1 -- start start 2024-09-12T12:22:41.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febf00678f0 0x7febf0069db0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fec100b14d0 tx=0x7fec00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4420ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 0x55b2a43d4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 0x55b2a43d4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b2a4225cc0 con 0x55b2a4420c10 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b2a41e0a20 con 0x55b2a43d4780 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b2a4221c80 con 0x55b2a4421530 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4420ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4420ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51330/0 (socket says 172.21.15.144:51330) 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 -- 172.21.15.144:0/2530868361 learned_addr learned my addr 172.21.15.144:0/2530868361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec0fe00640 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 0x55b2a43d4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec15800640 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 0x55b2a43d4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 -- 172.21.15.144:0/2530868361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 msgr2=0x55b2a43d4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 0x55b2a43d4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 -- 172.21.15.144:0/2530868361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 msgr2=0x55b2a43d4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 0x55b2a43d4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 -- 172.21.15.144:0/2530868361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2a41c8d40 con 0x55b2a4420c10 2024-09-12T12:22:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec15800640 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 0x55b2a43d4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.926+0000 7fec14e00640 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4420ff0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fec00005100 tx=0x7fec00011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3091701c7669b2db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec05600640 1 -- 172.21.15.144:0/2530868361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00003600 con 0x55b2a4420c10 2024-09-12T12:22:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec05600640 1 -- 172.21.15.144:0/2530868361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec000037a0 con 0x55b2a4420c10 2024-09-12T12:22:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec05600640 1 -- 172.21.15.144:0/2530868361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00003b50 con 0x55b2a4420c10 2024-09-12T12:22:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2530868361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 msgr2=0x55b2a4420ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4420ff0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fec00005100 tx=0x7fec00011000 comp rx=0 tx=0).stop 2024-09-12T12:22:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2530868361 shutdown_connections 2024-09-12T12:22:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 0x55b2a43d4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 0x55b2a43d4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/2530868361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4420ff0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2530868361 >> 172.21.15.144:0/2530868361 conn(0x55b2a44019b0 msgr2=0x55b2a4403da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2530868361 shutdown_connections 2024-09-12T12:22:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2530868361 wait complete. 2024-09-12T12:22:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 -- start start 2024-09-12T12:22:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 Processor -- start 2024-09-12T12:22:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a43d4780 0x55b2a4427f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a4420c10 0x55b2a44284b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 0x55b2a43da490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b2a41bf2c0 con 0x55b2a43d4780 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b2a41e4370 con 0x55b2a4420c10 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b2a4233f50 con 0x55b2a4421530 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec1ab6b000 10 client.0 _ll_register_callbacks cb 0x55b2a4286db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec14e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a43d4780 0x55b2a4427f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec14e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a43d4780 0x55b2a4427f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51340/0 (socket says 172.21.15.144:51340) 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec14e00640 1 -- 172.21.15.144:0/1649581317 learned_addr learned my addr 172.21.15.144:0/1649581317 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec15800640 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 0x55b2a43da490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec0fe00640 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a4420c10 0x55b2a44284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec14e00640 1 -- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 msgr2=0x55b2a43da490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec14e00640 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 0x55b2a43da490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec14e00640 1 -- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a4420c10 msgr2=0x55b2a44284b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec14e00640 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a4420c10 0x55b2a44284b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec14e00640 1 -- 172.21.15.144:0/1649581317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2a41c5770 con 0x55b2a43d4780 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7fec14e00640 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a43d4780 0x55b2a4427f70 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x55b2a41e5470 tx=0x7fec00000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306c2065d3d64474 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.930+0000 7febfa000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7febfa000640 1 -- 172.21.15.144:0/1649581317 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00021450 con 0x55b2a43d4780 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7febfa000640 1 -- 172.21.15.144:0/1649581317 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fec000215f0 con 0x55b2a43d4780 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 -- 172.21.15.144:0/1649581317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec000037a0 con 0x55b2a43d4780 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7febfa000640 1 -- 172.21.15.144:0/1649581317 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fec000217f0 con 0x55b2a43d4780 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 10 client.9111 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 -- 172.21.15.144:0/1649581317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55b2a41e33f0 con 0x55b2a43d4780 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7febfa000640 1 -- 172.21.15.144:0/1649581317 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec000037a0 con 0x55b2a43d4780 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7febfa000640 1 -- 172.21.15.144:0/1649581317 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7fec00037080 con 0x55b2a43d4780 2024-09-12T12:22:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 10 client.9111 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 10 client.9111 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 20 client.9111 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55b2a43daea0 0x55b2a43db2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 4 client.9111 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:22:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 -- 172.21.15.144:0/1649581317 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2a41bfd90 con 0x55b2a43daea0 2024-09-12T12:22:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec0fe00640 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55b2a43daea0 0x55b2a43db2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec0fe00640 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55b2a43daea0 0x55b2a43db2b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aeaa13e58580204 server_cookie=eda42a00b2f62b8a in_seq=0 out_seq=0 2024-09-12T12:22:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7febfa000640 10 client.9111 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:41.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7febfa000640 1 -- 172.21.15.144:0/1649581317 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2a41bfd90 con 0x55b2a43daea0 2024-09-12T12:22:41.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7febfa000640 10 client.9111 handle_command_reply: tid=0 2024-09-12T12:22:41.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 client.9111 shutdown 2024-09-12T12:22:41.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 -- 172.21.15.144:0/1649581317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a43d4780 msgr2=0x55b2a4427f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a43d4780 0x55b2a4427f70 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x55b2a41e5470 tx=0x7fec00000ee0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 -- 172.21.15.144:0/1649581317 shutdown_connections 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55b2a43daea0 0x55b2a43db2b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a4421530 0x55b2a43da490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7febfa000640 0 client.9111 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a4420c10 0x55b2a44284b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/1649581317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a43d4780 0x55b2a4427f70 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 -- 172.21.15.144:0/1649581317 >> 172.21.15.144:0/1649581317 conn(0x55b2a44019b0 msgr2=0x55b2a43d3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 -- 172.21.15.144:0/1649581317 shutdown_connections 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 1 -- 172.21.15.144:0/1649581317 wait complete. 2024-09-12T12:22:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.934+0000 7fec1ab6b000 20 client.9111 trim_cache size 0 max 16384 2024-09-12T12:22:41.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 Processor -- start 2024-09-12T12:22:41.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- start start 2024-09-12T12:22:41.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a44019b0 0x55b2a442e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a43d4780 0x55b2a4438320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4438860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec102032a0 con 0x55b2a4420c10 2024-09-12T12:22:41.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec1014b330 con 0x55b2a44019b0 2024-09-12T12:22:41.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec1014b980 con 0x55b2a43d4780 2024-09-12T12:22:41.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec15800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4438860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec15800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4438860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51352/0 (socket says 172.21.15.144:51352) 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec15800640 1 -- 172.21.15.144:0/2067251556 learned_addr learned my addr 172.21.15.144:0/2067251556 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec0fe00640 1 --2- 172.21.15.144:0/2067251556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a43d4780 0x55b2a4438320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec14e00640 1 --2- 172.21.15.144:0/2067251556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a44019b0 0x55b2a442e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec15800640 1 -- 172.21.15.144:0/2067251556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a43d4780 msgr2=0x55b2a4438320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec15800640 1 --2- 172.21.15.144:0/2067251556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a43d4780 0x55b2a4438320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec15800640 1 -- 172.21.15.144:0/2067251556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a44019b0 msgr2=0x55b2a442e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec15800640 1 --2- 172.21.15.144:0/2067251556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a44019b0 0x55b2a442e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec15800640 1 -- 172.21.15.144:0/2067251556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2a42a7320 con 0x55b2a4420c10 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec15800640 1 --2- 172.21.15.144:0/2067251556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4438860 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fec0801a620 tx=0x7fec080a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1965fd1a880014dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec04c00640 1 -- 172.21.15.144:0/2067251556 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080a56c0 con 0x55b2a4420c10 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec04c00640 1 -- 172.21.15.144:0/2067251556 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec080a5860 con 0x55b2a4420c10 2024-09-12T12:22:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec04c00640 1 -- 172.21.15.144:0/2067251556 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080a5c30 con 0x55b2a4420c10 2024-09-12T12:22:41.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2067251556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 msgr2=0x55b2a4438860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/2067251556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4438860 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fec0801a620 tx=0x7fec080a7070 comp rx=0 tx=0).stop 2024-09-12T12:22:41.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2067251556 shutdown_connections 2024-09-12T12:22:41.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/2067251556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4438860 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/2067251556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a43d4780 0x55b2a4438320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/2067251556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a44019b0 0x55b2a442e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2067251556 >> 172.21.15.144:0/2067251556 conn(0x55b2a43da200 msgr2=0x55b2a43d38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2067251556 shutdown_connections 2024-09-12T12:22:41.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- 172.21.15.144:0/2067251556 wait complete. 2024-09-12T12:22:41.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 -- start start 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.954+0000 7fec1ab6b000 1 Processor -- start 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 0x55b2a442da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a44019b0 0x55b2a442df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4491800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b2a41cd120 con 0x55b2a4420c10 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b2a42a6e90 con 0x55b2a43d4780 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b2a41cfb90 con 0x55b2a44019b0 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 10 client.0 _ll_register_callbacks cb 0x7febfc00cea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec15800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4491800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec15800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4491800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51356/0 (socket says 172.21.15.144:51356) 2024-09-12T12:22:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec15800640 1 -- 172.21.15.144:0/4143967902 learned_addr learned my addr 172.21.15.144:0/4143967902 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec14e00640 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 0x55b2a442da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec0fe00640 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a44019b0 0x55b2a442df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec15800640 1 -- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a44019b0 msgr2=0x55b2a442df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec15800640 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a44019b0 0x55b2a442df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec15800640 1 -- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 msgr2=0x55b2a442da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec15800640 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 0x55b2a442da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec15800640 1 -- 172.21.15.144:0/4143967902 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2a41b95c0 con 0x55b2a4420c10 2024-09-12T12:22:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec15800640 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4491800 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fec080c2040 tx=0x7fec0801b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557c0c47b025c319 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7febfa000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:41.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7febfa000640 1 -- 172.21.15.144:0/4143967902 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080d0060 con 0x55b2a4420c10 2024-09-12T12:22:41.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7febfa000640 1 -- 172.21.15.144:0/4143967902 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fec080cb480 con 0x55b2a4420c10 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 -- 172.21.15.144:0/4143967902 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec080a5860 con 0x55b2a4420c10 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7febfa000640 1 -- 172.21.15.144:0/4143967902 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fec080d6050 con 0x55b2a4420c10 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 10 client.9117 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 -- 172.21.15.144:0/4143967902 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x55b2a41bd330 con 0x55b2a4420c10 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7febfa000640 1 -- 172.21.15.144:0/4143967902 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec080a5860 con 0x55b2a4420c10 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7febfa000640 1 -- 172.21.15.144:0/4143967902 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7fec080d9020 con 0x55b2a4420c10 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 10 client.9117 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 10 client.9117 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 20 client.9117 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55b2a4421530 0x55b2a44921c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 4 client.9117 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 -- 172.21.15.144:0/4143967902 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55b2a42333f0 con 0x55b2a4421530 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec14e00640 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55b2a4421530 0x55b2a44921c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec14e00640 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55b2a4421530 0x55b2a44921c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3915456262a833d3 server_cookie=3a3dc835f35040a6 in_seq=0 out_seq=0 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7febfa000640 10 client.9117 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7febfa000640 1 -- 172.21.15.144:0/4143967902 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2a42333f0 con 0x55b2a4421530 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7febfa000640 10 client.9117 handle_command_reply: tid=0 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.958+0000 7fec1ab6b000 1 client.9117 shutdown 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 -- 172.21.15.144:0/4143967902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 msgr2=0x55b2a4491800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4491800 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fec080c2040 tx=0x7fec0801b230 comp rx=0 tx=0).stop 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 -- 172.21.15.144:0/4143967902 shutdown_connections 2024-09-12T12:22:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x55b2a4421530 0x55b2a44921c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b2a4420c10 0x55b2a4491800 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b2a44019b0 0x55b2a442df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 --2- 172.21.15.144:0/4143967902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b2a43d4780 0x55b2a442da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 -- 172.21.15.144:0/4143967902 >> 172.21.15.144:0/4143967902 conn(0x55b2a43da200 msgr2=0x55b2a43d3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7febfa000640 0 client.9117 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 -- 172.21.15.144:0/4143967902 shutdown_connections 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 1 -- 172.21.15.144:0/4143967902 wait complete. 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec1ab6b000 20 client.9117 trim_cache size 0 max 16384 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:22:41.967 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:22:41.968 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:22:41.968 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:22:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 -- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febf00678f0 msgr2=0x7febf0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febf00678f0 0x7febf0069db0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fec100b14d0 tx=0x7fec00009040 comp rx=0 tx=0).stop 2024-09-12T12:22:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 -- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015af60 msgr2=0x7fec101460f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015af60 0x7fec101460f0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c7f0 tx=0x7febfc00ccb0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 -- 172.21.15.144:0/780779645 shutdown_connections 2024-09-12T12:22:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7febf00678f0 0x7febf0069db0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec1015b340 0x7fec10073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec1015af60 0x7fec101460f0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 --2- 172.21.15.144:0/780779645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec100cd9f0 0x7fec10154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 -- 172.21.15.144:0/780779645 >> 172.21.15.144:0/780779645 conn(0x7fec10068030 msgr2=0x7fec10073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 -- 172.21.15.144:0/780779645 shutdown_connections 2024-09-12T12:22:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:41.962+0000 7fec17800640 1 -- 172.21.15.144:0/780779645 wait complete. 2024-09-12T12:22:41.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:41.981 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-12T12:22:42.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f3346800640 1 Processor -- start 2024-09-12T12:22:42.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f3346800640 1 -- start start 2024-09-12T12:22:42.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f3346800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f334015eb20 0x7f33400b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f3346800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33400b3470 con 0x7f33400b3970 2024-09-12T12:22:42.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f3346800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f334015f270 con 0x7f33400b4b20 2024-09-12T12:22:42.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f3346800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f33400b5440 con 0x7f334015eb20 2024-09-12T12:22:42.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f33400b3970 0x7f3340143c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42908/0 (socket says 172.21.15.144:42908) 2024-09-12T12:22:42.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333fe00640 1 -- 172.21.15.144:0/2660183557 learned_addr learned my addr 172.21.15.144:0/2660183557 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:42.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333ea00640 1 --2- 172.21.15.144:0/2660183557 >> v2:172.21.15.165:3300/0 conn(0x7f334015eb20 0x7f33400b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404211898 0 0) 0x7f33400b3470 con 0x7f33400b3970 2024-09-12T12:22:42.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3324003530 con 0x7f33400b3970 2024-09-12T12:22:42.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4008193335 0 0) 0x7f3324003530 con 0x7f33400b3970 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 >> v2:172.21.15.165:3300/0 conn(0x7f334015eb20 msgr2=0x7f33400b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 --2- 172.21.15.144:0/2660183557 >> v2:172.21.15.165:3300/0 conn(0x7f334015eb20 0x7f33400b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 >> v1:172.21.15.165:6789/0 conn(0x7f33400b4b20 legacy=0x7f3340162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334015f550 con 0x7f33400b3970 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f3338001680 con 0x7f33400b3970 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 >> v1:172.21.15.144:6789/0 conn(0x7f33400b3970 legacy=0x7f3340143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33240039c0 0x7f3324003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33240043c0 0x7f3324004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3324005130 0x7f332400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f33400b5440 con 0x7f33240039c0 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f332400c070 con 0x7f33240043c0 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f332400c270 con 0x7f3324005130 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333f400640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33240039c0 0x7f3324003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333ea00640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33240043c0 0x7f3324004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333fe00640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3324005130 0x7f332400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333f400640 1 -- 172.21.15.144:0/2660183557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3324005130 msgr2=0x7f332400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333f400640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3324005130 0x7f332400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333f400640 1 -- 172.21.15.144:0/2660183557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33240043c0 msgr2=0x7f3324004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333f400640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33240043c0 0x7f3324004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333f400640 1 -- 172.21.15.144:0/2660183557 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3324003530 con 0x7f33240039c0 2024-09-12T12:22:42.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.118+0000 7f333fe00640 1 -- 172.21.15.144:0/2660183557 reap_dead start 2024-09-12T12:22:42.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f333f400640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33240039c0 0x7f3324003da0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f3330001f60 tx=0x7f333001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c237fe92cb77e58e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33300ac070 con 0x7f33240039c0 2024-09-12T12:22:42.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33300a6670 con 0x7f33240039c0 2024-09-12T12:22:42.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f333e000640 1 -- 172.21.15.144:0/2660183557 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330001b60 con 0x7f33240039c0 2024-09-12T12:22:42.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f3346800640 1 -- 172.21.15.144:0/2660183557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33240039c0 msgr2=0x7f3324003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f3346800640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33240039c0 0x7f3324003da0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f3330001f60 tx=0x7f333001c880 comp rx=0 tx=0).stop 2024-09-12T12:22:42.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f3346800640 1 -- 172.21.15.144:0/2660183557 shutdown_connections 2024-09-12T12:22:42.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f3346800640 1 --2- 172.21.15.144:0/2660183557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33240039c0 0x7f3324003da0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f3346800640 1 -- 172.21.15.144:0/2660183557 >> 172.21.15.144:0/2660183557 conn(0x7f3340068030 msgr2=0x7f33400b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f3346800640 1 -- 172.21.15.144:0/2660183557 shutdown_connections 2024-09-12T12:22:42.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.122+0000 7f3346800640 1 -- 172.21.15.144:0/2660183557 wait complete. 2024-09-12T12:22:42.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 Processor -- start 2024-09-12T12:22:42.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 -- start start 2024-09-12T12:22:42.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f33240039c0 0x7f3340073b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334015ba00 0x7f3340156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3340071990 0x7f3340071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3340162950 con 0x7f3340071990 2024-09-12T12:22:42.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3340144410 con 0x7f334015ba00 2024-09-12T12:22:42.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3340162ad0 con 0x7f33240039c0 2024-09-12T12:22:42.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3340071990 0x7f3340071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3340071990 0x7f3340071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51372/0 (socket says 172.21.15.144:51372) 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333fe00640 1 -- 172.21.15.144:0/2746547723 learned_addr learned my addr 172.21.15.144:0/2746547723 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333f400640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f33240039c0 0x7f3340073b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333ea00640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334015ba00 0x7f3340156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333fe00640 1 -- 172.21.15.144:0/2746547723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f33240039c0 msgr2=0x7f3340073b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333fe00640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f33240039c0 0x7f3340073b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333fe00640 1 -- 172.21.15.144:0/2746547723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334015ba00 msgr2=0x7f3340156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333fe00640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334015ba00 0x7f3340156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333fe00640 1 -- 172.21.15.144:0/2746547723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334015bec0 con 0x7f3340071990 2024-09-12T12:22:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f333fe00640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3340071990 0x7f3340071e40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f3338000c10 tx=0x7f3338007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3337400640 1 -- 172.21.15.144:0/2746547723 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333800f700 con 0x7f3340071990 2024-09-12T12:22:42.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3337400640 1 -- 172.21.15.144:0/2746547723 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3338018070 con 0x7f3340071990 2024-09-12T12:22:42.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3337400640 1 -- 172.21.15.144:0/2746547723 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333800fae0 con 0x7f3340071990 2024-09-12T12:22:42.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 -- 172.21.15.144:0/2746547723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334015c1a0 con 0x7f3340071990 2024-09-12T12:22:42.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.126+0000 7f3346800640 1 -- 172.21.15.144:0/2746547723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f334015c760 con 0x7f3340071990 2024-09-12T12:22:42.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.130+0000 7f3337400640 1 -- 172.21.15.144:0/2746547723 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f333800fc80 con 0x7f3340071990 2024-09-12T12:22:42.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.130+0000 7f3337400640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33200678c0 0x7f3320069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.130+0000 7f3337400640 1 -- 172.21.15.144:0/2746547723 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f3338085a40 con 0x7f3340071990 2024-09-12T12:22:42.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.130+0000 7f333f400640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33200678c0 0x7f3320069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.130+0000 7f3349af9000 1 Processor -- start 2024-09-12T12:22:42.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.130+0000 7f3349af9000 1 -- start start 2024-09-12T12:22:42.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.130+0000 7f333f400640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33200678c0 0x7f3320069d80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f33300ae000 tx=0x7f33300b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a55c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 0x559e8a50f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a510190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559e8a3f9960 con 0x559e8a50fdb0 2024-09-12T12:22:42.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559e8a33d900 con 0x559e8a55bd70 2024-09-12T12:22:42.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559e8a360d40 con 0x559e8a55c690 2024-09-12T12:22:42.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a510190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a510190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51388/0 (socket says 172.21.15.144:51388) 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333fe00640 1 -- 172.21.15.144:0/2521893306 learned_addr learned my addr 172.21.15.144:0/2521893306 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333ea00640 1 --2- 172.21.15.144:0/2521893306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 0x559e8a50f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333f400640 1 --2- 172.21.15.144:0/2521893306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a55c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333fe00640 1 -- 172.21.15.144:0/2521893306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 msgr2=0x559e8a50f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333fe00640 1 --2- 172.21.15.144:0/2521893306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 0x559e8a50f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333fe00640 1 -- 172.21.15.144:0/2521893306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 msgr2=0x559e8a55c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333fe00640 1 --2- 172.21.15.144:0/2521893306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a55c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333fe00640 1 -- 172.21.15.144:0/2521893306 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e8a307580 con 0x559e8a50fdb0 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f333fe00640 1 --2- 172.21.15.144:0/2521893306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a510190 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f33380521b0 tx=0x7f3338055990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108aedd6dfde17c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f332be00640 1 -- 172.21.15.144:0/2521893306 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333805a100 con 0x559e8a50fdb0 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f332be00640 1 -- 172.21.15.144:0/2521893306 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333805e930 con 0x559e8a50fdb0 2024-09-12T12:22:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f332be00640 1 -- 172.21.15.144:0/2521893306 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33380523c0 con 0x559e8a50fdb0 2024-09-12T12:22:42.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- 172.21.15.144:0/2521893306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 msgr2=0x559e8a510190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- 172.21.15.144:0/2521893306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a510190 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f33380521b0 tx=0x7f3338055990 comp rx=0 tx=0).stop 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- 172.21.15.144:0/2521893306 shutdown_connections 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- 172.21.15.144:0/2521893306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a510190 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- 172.21.15.144:0/2521893306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 0x559e8a50f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- 172.21.15.144:0/2521893306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a55c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- 172.21.15.144:0/2521893306 >> 172.21.15.144:0/2521893306 conn(0x559e8a53d040 msgr2=0x559e8a53f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- 172.21.15.144:0/2521893306 shutdown_connections 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- 172.21.15.144:0/2521893306 wait complete. 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- start start 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 Processor -- start 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a562ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a563010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 0x559e8a563550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559e8a35cd00 con 0x559e8a50fdb0 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559e8a31baa0 con 0x559e8a55bd70 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559e8a2fa340 con 0x559e8a55c690 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.134+0000 7f3349af9000 10 client.0 _ll_register_callbacks cb 0x559e8a4fd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a562ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a562ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51394/0 (socket says 172.21.15.144:51394) 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333f400640 1 -- 172.21.15.144:0/3195446198 learned_addr learned my addr 172.21.15.144:0/3195446198 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333fe00640 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 0x559e8a563550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333ea00640 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a563010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333f400640 1 -- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 msgr2=0x559e8a563550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333f400640 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 0x559e8a563550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333f400640 1 -- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 msgr2=0x559e8a563010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333f400640 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a563010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333f400640 1 -- 172.21.15.144:0/3195446198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e8a303dc0 con 0x559e8a50fdb0 2024-09-12T12:22:42.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333f400640 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a562ad0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f333001c6b0 tx=0x7f333001b0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ec5953a008e744 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 1 -- 172.21.15.144:0/3195446198 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33300a6e00 con 0x559e8a50fdb0 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 1 -- 172.21.15.144:0/3195446198 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f33300c9ca0 con 0x559e8a50fdb0 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 -- 172.21.15.144:0/3195446198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f333805e930 con 0x559e8a50fdb0 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 1 -- 172.21.15.144:0/3195446198 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f33300c9ea0 con 0x559e8a50fdb0 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 10 client.9129 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 -- 172.21.15.144:0/3195446198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x559e8a3007f0 con 0x559e8a50fdb0 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 1 -- 172.21.15.144:0/3195446198 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333805e930 con 0x559e8a50fdb0 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 1 -- 172.21.15.144:0/3195446198 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f33300b18a0 con 0x559e8a50fdb0 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 10 client.9129 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 10 client.9129 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 20 client.9129 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559e8a56aea0 0x559e8a56d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 4 client.9129 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 -- 172.21.15.144:0/3195446198 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e8a2fae10 con 0x559e8a56aea0 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333ea00640 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559e8a56aea0 0x559e8a56d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 10 client.9129 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f333ea00640 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559e8a56aea0 0x559e8a56d290 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=437e69e5b2bc58ab server_cookie=cc3693bbf5634a4e in_seq=0 out_seq=0 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 1 -- 172.21.15.144:0/3195446198 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e8a2fae10 con 0x559e8a56aea0 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 10 client.9129 handle_command_reply: tid=0 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 client.9129 shutdown 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 -- 172.21.15.144:0/3195446198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 msgr2=0x559e8a562ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a562ad0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f333001c6b0 tx=0x7f333001b0c0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 -- 172.21.15.144:0/3195446198 shutdown_connections 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559e8a56aea0 0x559e8a56d290 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a55c690 0x559e8a563550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a563010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3328c00640 0 client.9129 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 --2- 172.21.15.144:0/3195446198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a50fdb0 0x559e8a562ad0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.138+0000 7f3349af9000 1 -- 172.21.15.144:0/3195446198 >> 172.21.15.144:0/3195446198 conn(0x559e8a53d040 msgr2=0x559e8a50ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.142+0000 7f3349af9000 1 -- 172.21.15.144:0/3195446198 shutdown_connections 2024-09-12T12:22:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.142+0000 7f3349af9000 1 -- 172.21.15.144:0/3195446198 wait complete. 2024-09-12T12:22:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.142+0000 7f3349af9000 20 client.9129 trim_cache size 0 max 16384 2024-09-12T12:22:42.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 Processor -- start 2024-09-12T12:22:42.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 -- start start 2024-09-12T12:22:42.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a53d040 0x559e8a5cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 0x559e8a5cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a55bd70 0x559e8a5cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3340204ba0 con 0x559e8a55bd70 2024-09-12T12:22:42.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3340203bc0 con 0x559e8a53d040 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f33400b1b70 con 0x559e8a50fdb0 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a55bd70 0x559e8a5cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a55bd70 0x559e8a5cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51402/0 (socket says 172.21.15.144:51402) 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333fe00640 1 -- 172.21.15.144:0/2092213123 learned_addr learned my addr 172.21.15.144:0/2092213123 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333f400640 1 --2- 172.21.15.144:0/2092213123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a53d040 0x559e8a5cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333ea00640 1 --2- 172.21.15.144:0/2092213123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 0x559e8a5cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333fe00640 1 -- 172.21.15.144:0/2092213123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 msgr2=0x559e8a5cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333fe00640 1 --2- 172.21.15.144:0/2092213123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 0x559e8a5cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333fe00640 1 -- 172.21.15.144:0/2092213123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a53d040 msgr2=0x559e8a5cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333fe00640 1 --2- 172.21.15.144:0/2092213123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a53d040 0x559e8a5cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333fe00640 1 -- 172.21.15.144:0/2092213123 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e8a31e470 con 0x559e8a55bd70 2024-09-12T12:22:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f333fe00640 1 --2- 172.21.15.144:0/2092213123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a55bd70 0x559e8a5cc610 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f33380521b0 tx=0x7f333801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bbcd22d0444310 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f332b400640 1 -- 172.21.15.144:0/2092213123 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333805e930 con 0x559e8a55bd70 2024-09-12T12:22:42.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f332b400640 1 -- 172.21.15.144:0/2092213123 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33380742d0 con 0x559e8a55bd70 2024-09-12T12:22:42.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f332b400640 1 -- 172.21.15.144:0/2092213123 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333805a100 con 0x559e8a55bd70 2024-09-12T12:22:42.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 -- 172.21.15.144:0/2092213123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a55bd70 msgr2=0x559e8a5cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 --2- 172.21.15.144:0/2092213123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a55bd70 0x559e8a5cc610 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f33380521b0 tx=0x7f333801e000 comp rx=0 tx=0).stop 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 -- 172.21.15.144:0/2092213123 shutdown_connections 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.158+0000 7f3349af9000 1 --2- 172.21.15.144:0/2092213123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a55bd70 0x559e8a5cc610 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 --2- 172.21.15.144:0/2092213123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 0x559e8a5cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 --2- 172.21.15.144:0/2092213123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a53d040 0x559e8a5cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- 172.21.15.144:0/2092213123 >> 172.21.15.144:0/2092213123 conn(0x559e8a514770 msgr2=0x559e8a516b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- 172.21.15.144:0/2092213123 shutdown_connections 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- 172.21.15.144:0/2092213123 wait complete. 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- start start 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 Processor -- start 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 0x559e8a570300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a53d040 0x559e8a5cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a5d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3340203570 con 0x559e8a53d040 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559e8a328400 con 0x559e8a55bd70 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559e8a51b3f0 con 0x559e8a50fdb0 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 10 client.0 _ll_register_callbacks cb 0x7f3324005770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a53d040 0x559e8a5cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a5d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 0x559e8a570300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a53d040 0x559e8a5cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51408/0 (socket says 172.21.15.144:51408) 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333ea00640 1 -- 172.21.15.144:0/1274387963 learned_addr learned my addr 172.21.15.144:0/1274387963 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333ea00640 1 -- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 msgr2=0x559e8a570300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333ea00640 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 0x559e8a570300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333ea00640 1 -- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 msgr2=0x559e8a5d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333ea00640 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a5d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333ea00640 1 -- 172.21.15.144:0/1274387963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e8a2f4640 con 0x559e8a53d040 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f333ea00640 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a53d040 0x559e8a5cff80 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f332c015650 tx=0x7f332c015680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580d6bc452081538 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3328c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3328c00640 1 -- 172.21.15.144:0/1274387963 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c004030 con 0x559e8a53d040 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3328c00640 1 -- 172.21.15.144:0/1274387963 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f332c0041d0 con 0x559e8a53d040 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- 172.21.15.144:0/1274387963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33380742d0 con 0x559e8a53d040 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3328c00640 1 -- 172.21.15.144:0/1274387963 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f332c035050 con 0x559e8a53d040 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 10 client.9135 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- 172.21.15.144:0/1274387963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x559e8a2f83b0 con 0x559e8a53d040 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3328c00640 1 -- 172.21.15.144:0/1274387963 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33380742d0 con 0x559e8a53d040 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3328c00640 1 -- 172.21.15.144:0/1274387963 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f332c038020 con 0x559e8a53d040 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 10 client.9135 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 10 client.9135 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 20 client.9135 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:42.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559e8a55c690 0x559e8a5d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 4 client.9135 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:22:42.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.162+0000 7f3349af9000 1 -- 172.21.15.144:0/1274387963 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e8a36e470 con 0x559e8a55c690 2024-09-12T12:22:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f333f400640 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559e8a55c690 0x559e8a5d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f333f400640 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559e8a55c690 0x559e8a5d0a00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b54e955d9f3d924 server_cookie=1ecde334c2c82d92 in_seq=0 out_seq=0 2024-09-12T12:22:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3328c00640 10 client.9135 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3328c00640 1 -- 172.21.15.144:0/1274387963 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+69 (crc 0 0 0) 0x559e8a36e470 con 0x559e8a55c690 2024-09-12T12:22:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3328c00640 10 client.9135 handle_command_reply: tid=0 2024-09-12T12:22:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 client.9135 shutdown 2024-09-12T12:22:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 -- 172.21.15.144:0/1274387963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a53d040 msgr2=0x559e8a5cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a53d040 0x559e8a5cff80 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f332c015650 tx=0x7f332c015680 comp rx=0 tx=0).stop 2024-09-12T12:22:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 -- 172.21.15.144:0/1274387963 shutdown_connections 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559e8a55c690 0x559e8a5d0a00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8a55bd70 0x559e8a5d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8a53d040 0x559e8a5cff80 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3328c00640 0 client.9135 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 --2- 172.21.15.144:0/1274387963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8a50fdb0 0x559e8a570300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 -- 172.21.15.144:0/1274387963 >> 172.21.15.144:0/1274387963 conn(0x559e8a514770 msgr2=0x559e8a5691e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 -- 172.21.15.144:0/1274387963 shutdown_connections 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 1 -- 172.21.15.144:0/1274387963 wait complete. 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3349af9000 20 client.9135 trim_cache size 0 max 16384 2024-09-12T12:22:42.171 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:22:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-12T12:22:42.172 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:22:42.172 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:22:42.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 -- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33200678c0 msgr2=0x7f3320069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33200678c0 0x7f3320069d80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f33300ae000 tx=0x7f33300b3040 comp rx=0 tx=0).stop 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 -- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3340071990 msgr2=0x7f3340071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3340071990 0x7f3340071e40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f3338000c10 tx=0x7f3338007430 comp rx=0 tx=0).stop 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 -- 172.21.15.144:0/2746547723 shutdown_connections 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f33200678c0 0x7f3320069d80 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3340071990 0x7f3340071e40 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f334015ba00 0x7f3340156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 --2- 172.21.15.144:0/2746547723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f33240039c0 0x7f3340073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 -- 172.21.15.144:0/2746547723 >> 172.21.15.144:0/2746547723 conn(0x7f3340068030 msgr2=0x7f33400af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 -- 172.21.15.144:0/2746547723 shutdown_connections 2024-09-12T12:22:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.166+0000 7f3346800640 1 -- 172.21.15.144:0/2746547723 wait complete. 2024-09-12T12:22:42.187 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:42.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71bcc00640 1 Processor -- start 2024-09-12T12:22:42.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71bcc00640 1 -- start start 2024-09-12T12:22:42.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71bcc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e440 0x7f71b80b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71bcc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71b80b7310 0x7f71b8073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71bcc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b80b4bb0 con 0x7f71b80b47b0 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71bcc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f71b806ed60 con 0x7f71b80b7310 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71bcc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f71b80b7760 con 0x7f71b815e440 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71b6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71b80b7310 0x7f71b8073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71b6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71b80b7310 0x7f71b8073250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51420/0 (socket says 172.21.15.144:51420) 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71b6800640 1 -- 172.21.15.144:0/1503409128 learned_addr learned my addr 172.21.15.144:0/1503409128 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71b5e00640 1 --2- 172.21.15.144:0/1503409128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e440 0x7f71b80b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71b6800640 1 -- 172.21.15.144:0/1503409128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e440 msgr2=0x7f71b80b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71b6800640 1 --2- 172.21.15.144:0/1503409128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e440 0x7f71b80b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71b6800640 1 -- 172.21.15.144:0/1503409128 >> v1:172.21.15.165:6789/0 conn(0x7f71b80b47b0 legacy=0x7f71b80b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.322+0000 7f71b6800640 1 -- 172.21.15.144:0/1503409128 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b806dfe0 con 0x7f71b80b7310 2024-09-12T12:22:42.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71b6800640 1 --2- 172.21.15.144:0/1503409128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b7310 0x7f71b8073250 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e50 tx=0x7f71b001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad07f69317a9dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71b4a00640 1 -- 172.21.15.144:0/1503409128 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b00a58d0 con 0x7f71b80b7310 2024-09-12T12:22:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71b4a00640 1 -- 172.21.15.144:0/1503409128 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b00a5a70 con 0x7f71b80b7310 2024-09-12T12:22:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71b4a00640 1 -- 172.21.15.144:0/1503409128 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b00a5e40 con 0x7f71b80b7310 2024-09-12T12:22:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71bcc00640 1 -- 172.21.15.144:0/1503409128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b7310 msgr2=0x7f71b8073250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71bcc00640 1 --2- 172.21.15.144:0/1503409128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b7310 0x7f71b8073250 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e50 tx=0x7f71b001ca00 comp rx=0 tx=0).stop 2024-09-12T12:22:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71bcc00640 1 -- 172.21.15.144:0/1503409128 shutdown_connections 2024-09-12T12:22:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71bcc00640 1 --2- 172.21.15.144:0/1503409128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b7310 0x7f71b8073250 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71bcc00640 1 --2- 172.21.15.144:0/1503409128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e440 0x7f71b80b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71bcc00640 1 -- 172.21.15.144:0/1503409128 >> 172.21.15.144:0/1503409128 conn(0x7f71b806f3e0 msgr2=0x7f71b806f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71bcc00640 1 -- 172.21.15.144:0/1503409128 shutdown_connections 2024-09-12T12:22:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.326+0000 7f71bcc00640 1 -- 172.21.15.144:0/1503409128 wait complete. 2024-09-12T12:22:42.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 Processor -- start 2024-09-12T12:22:42.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 -- start start 2024-09-12T12:22:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b47b0 0x7f71b814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b80b7310 0x7f71b8161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b815e440 0x7f71b8152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71b81620c0 con 0x7f71b80b47b0 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80b79f0 con 0x7f71b815e440 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f71b8162240 con 0x7f71b80b7310 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b47b0 0x7f71b814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b47b0 0x7f71b814f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51424/0 (socket says 172.21.15.144:51424) 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5e00640 1 -- 172.21.15.144:0/2093623559 learned_addr learned my addr 172.21.15.144:0/2093623559 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5400640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b80b7310 0x7f71b8161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b6800640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b815e440 0x7f71b8152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5e00640 1 -- 172.21.15.144:0/2093623559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b80b7310 msgr2=0x7f71b8161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5e00640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b80b7310 0x7f71b8161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5e00640 1 -- 172.21.15.144:0/2093623559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b815e440 msgr2=0x7f71b8152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5e00640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b815e440 0x7f71b8152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5e00640 1 -- 172.21.15.144:0/2093623559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b8151180 con 0x7f71b80b47b0 2024-09-12T12:22:42.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5400640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b80b7310 0x7f71b8161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71b5e00640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b47b0 0x7f71b814f2c0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f71a800e870 tx=0x7f71a800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71ae000640 1 -- 172.21.15.144:0/2093623559 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8017070 con 0x7f71b80b47b0 2024-09-12T12:22:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71ae000640 1 -- 172.21.15.144:0/2093623559 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a800c940 con 0x7f71b80b47b0 2024-09-12T12:22:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b8151460 con 0x7f71b80b47b0 2024-09-12T12:22:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71ae000640 1 -- 172.21.15.144:0/2093623559 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a800ccf0 con 0x7f71b80b47b0 2024-09-12T12:22:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.330+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b8151a20 con 0x7f71b80b47b0 2024-09-12T12:22:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.334+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b80b14f0 con 0x7f71b80b47b0 2024-09-12T12:22:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.334+0000 7f71ae000640 1 -- 172.21.15.144:0/2093623559 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f71a801a070 con 0x7f71b80b47b0 2024-09-12T12:22:42.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.334+0000 7f71ae000640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71980678c0 0x7f7198069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.334+0000 7f71ae000640 1 -- 172.21.15.144:0/2093623559 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f71a8085fe0 con 0x7f71b80b47b0 2024-09-12T12:22:42.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.334+0000 7f71b5400640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71980678c0 0x7f7198069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.334+0000 7f71b5400640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71980678c0 0x7f7198069d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f71b8160f40 tx=0x7f71a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.338+0000 7f71ae000640 1 -- 172.21.15.144:0/2093623559 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f71a8056340 con 0x7f71b80b47b0 2024-09-12T12:22:42.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.526+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71b81554f0 con 0x7f71b80b47b0 2024-09-12T12:22:42.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.526+0000 7f71ae000640 1 -- 172.21.15.144:0/2093623559 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7f71a805a640 con 0x7f71b80b47b0 2024-09-12T12:22:42.530 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:42.530 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:42.530 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:42.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71980678c0 msgr2=0x7f7198069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71980678c0 0x7f7198069d80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f71b8160f40 tx=0x7f71a4009040 comp rx=0 tx=0).stop 2024-09-12T12:22:42.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b47b0 msgr2=0x7f71b814f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b47b0 0x7f71b814f2c0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f71a800e870 tx=0x7f71a800ec70 comp rx=0 tx=0).stop 2024-09-12T12:22:42.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 shutdown_connections 2024-09-12T12:22:42.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71980678c0 0x7f7198069d80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b815e440 0x7f71b8152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b80b7310 0x7f71b8161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 --2- 172.21.15.144:0/2093623559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b47b0 0x7f71b814f2c0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 >> 172.21.15.144:0/2093623559 conn(0x7f71b806f3e0 msgr2=0x7f71b8155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 shutdown_connections 2024-09-12T12:22:42.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.530+0000 7f71bcc00640 1 -- 172.21.15.144:0/2093623559 wait complete. 2024-09-12T12:22:42.551 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-12T12:22:42.551 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:22:42.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd36e400640 1 Processor -- start 2024-09-12T12:22:42.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd36e400640 1 -- start start 2024-09-12T12:22:42.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd36e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 0x7fd36806d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd36e400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd3680b73a0 0x7fd36806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd36e400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd368073f60 con 0x7fd36815e7e0 2024-09-12T12:22:42.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd36e400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd36806e700 con 0x7fd3680b73a0 2024-09-12T12:22:42.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd36e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd36806e9e0 con 0x7fd3680b55b0 2024-09-12T12:22:42.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd367400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd36815e7e0 0x7fd3680b6c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42924/0 (socket says 172.21.15.144:42924) 2024-09-12T12:22:42.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd367400640 1 -- 172.21.15.144:0/59636108 learned_addr learned my addr 172.21.15.144:0/59636108 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:42.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd367e00640 1 --2- 172.21.15.144:0/59636108 >> v2:172.21.15.144:3300/0 conn(0x7fd3680b73a0 0x7fd36806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd35fe00640 1 --2- 172.21.15.144:0/59636108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 0x7fd36806d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd367e00640 1 -- 172.21.15.144:0/59636108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 msgr2=0x7fd36806d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:42.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd367e00640 1 --2- 172.21.15.144:0/59636108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 0x7fd36806d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd367e00640 1 -- 172.21.15.144:0/59636108 >> v1:172.21.15.144:6789/0 conn(0x7fd36815e7e0 legacy=0x7fd3680b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd367e00640 1 -- 172.21.15.144:0/59636108 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36806ecc0 con 0x7fd3680b73a0 2024-09-12T12:22:42.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.686+0000 7fd366a00640 1 -- 172.21.15.144:0/59636108 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 171712893 0 0) 0x7fd368073f60 con 0x7fd36815e7e0 2024-09-12T12:22:42.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd367e00640 1 --2- 172.21.15.144:0/59636108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 0x7fd36806d740 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fd360009d90 tx=0x7fd36001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dec6f3683425fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd366a00640 1 -- 172.21.15.144:0/59636108 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3600b2070 con 0x7fd3680b73a0 2024-09-12T12:22:42.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd366a00640 1 -- 172.21.15.144:0/59636108 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3600a59c0 con 0x7fd3680b73a0 2024-09-12T12:22:42.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd366a00640 1 -- 172.21.15.144:0/59636108 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3600a5d90 con 0x7fd3680b73a0 2024-09-12T12:22:42.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd36e400640 1 -- 172.21.15.144:0/59636108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 msgr2=0x7fd36806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd36e400640 1 --2- 172.21.15.144:0/59636108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 0x7fd36806d740 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fd360009d90 tx=0x7fd36001c8e0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd36e400640 1 -- 172.21.15.144:0/59636108 shutdown_connections 2024-09-12T12:22:42.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd36e400640 1 --2- 172.21.15.144:0/59636108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 0x7fd36806d740 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd36e400640 1 --2- 172.21.15.144:0/59636108 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 0x7fd36806d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd36e400640 1 -- 172.21.15.144:0/59636108 >> 172.21.15.144:0/59636108 conn(0x7fd3680d2500 msgr2=0x7fd3680d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd36e400640 1 -- 172.21.15.144:0/59636108 shutdown_connections 2024-09-12T12:22:42.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.690+0000 7fd36e400640 1 -- 172.21.15.144:0/59636108 wait complete. 2024-09-12T12:22:42.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 Processor -- start 2024-09-12T12:22:42.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 -- start start 2024-09-12T12:22:42.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 0x7fd36815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 0x7fd368151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd36815e7e0 0x7fd368161530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd36815ed40 con 0x7fd3680b73a0 2024-09-12T12:22:42.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd36815ebc0 con 0x7fd36815e7e0 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd36816ba40 con 0x7fd3680b55b0 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 0x7fd368151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 0x7fd368151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51452/0 (socket says 172.21.15.144:51452) 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35fe00640 1 -- 172.21.15.144:0/190239478 learned_addr learned my addr 172.21.15.144:0/190239478 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd367e00640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd36815e7e0 0x7fd368161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd367400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 0x7fd36815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35fe00640 1 -- 172.21.15.144:0/190239478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 msgr2=0x7fd36815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35fe00640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 0x7fd36815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35fe00640 1 -- 172.21.15.144:0/190239478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd36815e7e0 msgr2=0x7fd368161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35fe00640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd36815e7e0 0x7fd368161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35fe00640 1 -- 172.21.15.144:0/190239478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36815f0c0 con 0x7fd3680b73a0 2024-09-12T12:22:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35fe00640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 0x7fd368151be0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fd35000d7d0 tx=0x7fd35000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35f400640 1 -- 172.21.15.144:0/190239478 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35000b6c0 con 0x7fd3680b73a0 2024-09-12T12:22:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35f400640 1 -- 172.21.15.144:0/190239478 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd350019070 con 0x7fd3680b73a0 2024-09-12T12:22:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd35f400640 1 -- 172.21.15.144:0/190239478 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35000baa0 con 0x7fd3680b73a0 2024-09-12T12:22:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36815f360 con 0x7fd3680b73a0 2024-09-12T12:22:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.694+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd368161010 con 0x7fd3680b73a0 2024-09-12T12:22:42.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.698+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3680b6c90 con 0x7fd3680b73a0 2024-09-12T12:22:42.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.698+0000 7fd35f400640 1 -- 172.21.15.144:0/190239478 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd35000bc40 con 0x7fd3680b73a0 2024-09-12T12:22:42.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.698+0000 7fd35f400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3440678c0 0x7fd344069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:42.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.698+0000 7fd35f400640 1 -- 172.21.15.144:0/190239478 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fd350086390 con 0x7fd3680b73a0 2024-09-12T12:22:42.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.698+0000 7fd367400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3440678c0 0x7fd344069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:42.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.698+0000 7fd367400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3440678c0 0x7fd344069d80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd358000f70 tx=0x7fd358007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:42.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.702+0000 7fd35f400640 1 -- 172.21.15.144:0/190239478 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd350056c50 con 0x7fd3680b73a0 2024-09-12T12:22:42.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.914+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd3680b3b80 con 0x7fd3680b73a0 2024-09-12T12:22:42.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd35f400640 1 -- 172.21.15.144:0/190239478 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1817 (secure 0 0 0) 0x7fd350056550 con 0x7fd3680b73a0 2024-09-12T12:22:42.918 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:42.918 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":622,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076445466,"bytes_used":2583904256,"bytes_avail":770510209024,"bytes_total":773094113280,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":873572,"recovering_keys_per_sec":0,"num_objects_recovered":10,"num_bytes_recovered":10485760,"num_keys_recovered":0,"write_bytes_sec":43263752,"read_op_per_sec":0,"write_op_per_sec":43},"fsmap":{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":8874}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-12T12:22:41.503973+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:22:42.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3440678c0 msgr2=0x7fd344069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3440678c0 0x7fd344069d80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd358000f70 tx=0x7fd358007c10 comp rx=0 tx=0).stop 2024-09-12T12:22:42.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 msgr2=0x7fd368151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:42.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 0x7fd368151be0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fd35000d7d0 tx=0x7fd35000dc90 comp rx=0 tx=0).stop 2024-09-12T12:22:42.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 shutdown_connections 2024-09-12T12:22:42.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3440678c0 0x7fd344069d80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd36815e7e0 0x7fd368161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3680b73a0 0x7fd368151be0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 --2- 172.21.15.144:0/190239478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3680b55b0 0x7fd36815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:42.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 >> 172.21.15.144:0/190239478 conn(0x7fd3680d2500 msgr2=0x7fd36815cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:42.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 shutdown_connections 2024-09-12T12:22:42.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:42.918+0000 7fd36e400640 1 -- 172.21.15.144:0/190239478 wait complete. 2024-09-12T12:22:42.940 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused'} 2024-09-12T12:22:42.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:42.940 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-09-12T12:22:43.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.074+0000 7fd0ce000640 1 Processor -- start 2024-09-12T12:22:43.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.074+0000 7fd0ce000640 1 -- start start 2024-09-12T12:22:43.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0ce000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd0c80af5f0 0x7fd0c806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0ce000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c80733e0 con 0x7fd0c815c2e0 2024-09-12T12:22:43.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0ce000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c80cd290 con 0x7fd0c806c150 2024-09-12T12:22:43.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0ce000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c806c5c0 con 0x7fd0c80af5f0 2024-09-12T12:22:43.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd0c815c2e0 0x7fd0c8072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42930/0 (socket says 172.21.15.144:42930) 2024-09-12T12:22:43.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c7400640 1 -- 172.21.15.144:0/4166406664 learned_addr learned my addr 172.21.15.144:0/4166406664 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:43.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/4166406664 >> v2:172.21.15.165:3300/0 conn(0x7fd0c80af5f0 0x7fd0c806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491274413 0 0) 0x7fd0c80733e0 con 0x7fd0c815c2e0 2024-09-12T12:22:43.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0ac003530 con 0x7fd0c815c2e0 2024-09-12T12:22:43.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3763674664 0 0) 0x7fd0ac003530 con 0x7fd0c815c2e0 2024-09-12T12:22:43.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 >> v2:172.21.15.165:3300/0 conn(0x7fd0c80af5f0 msgr2=0x7fd0c806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 --2- 172.21.15.144:0/4166406664 >> v2:172.21.15.165:3300/0 conn(0x7fd0c80af5f0 0x7fd0c806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 >> v1:172.21.15.165:6789/0 conn(0x7fd0c806c150 legacy=0x7fd0c80cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c80cd570 con 0x7fd0c815c2e0 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fd0b8001680 con 0x7fd0c815c2e0 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 >> v1:172.21.15.144:6789/0 conn(0x7fd0c815c2e0 legacy=0x7fd0c8072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0ac0039c0 0x7fd0ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0ac004810 0x7fd0ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0ac0052f0 0x7fd0ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c806c5c0 con 0x7fd0ac004810 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac00c1c0 con 0x7fd0ac0039c0 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ac00c3c0 con 0x7fd0ac0052f0 2024-09-12T12:22:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0ac004810 0x7fd0ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c7400640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0ac0039c0 0x7fd0ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0ac0052f0 0x7fd0ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6a00640 1 -- 172.21.15.144:0/4166406664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0ac0052f0 msgr2=0x7fd0ac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0ac0052f0 0x7fd0ac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6a00640 1 -- 172.21.15.144:0/4166406664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0ac0039c0 msgr2=0x7fd0ac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0ac0039c0 0x7fd0ac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c6a00640 1 -- 172.21.15.144:0/4166406664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ac003530 con 0x7fd0ac004810 2024-09-12T12:22:43.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.078+0000 7fd0c7e00640 1 -- 172.21.15.144:0/4166406664 reap_dead start 2024-09-12T12:22:43.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0ac004810 0x7fd0ac004c90 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009ab0 tx=0x7fd0b401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ac1cdc0285a3e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40096b0 con 0x7fd0ac004810 2024-09-12T12:22:43.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b40a8440 con 0x7fd0ac004810 2024-09-12T12:22:43.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0c6000640 1 -- 172.21.15.144:0/4166406664 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40a8830 con 0x7fd0ac004810 2024-09-12T12:22:43.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0ce000640 1 -- 172.21.15.144:0/4166406664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0ac004810 msgr2=0x7fd0ac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0ce000640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0ac004810 0x7fd0ac004c90 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009ab0 tx=0x7fd0b401ca30 comp rx=0 tx=0).stop 2024-09-12T12:22:43.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0ce000640 1 -- 172.21.15.144:0/4166406664 shutdown_connections 2024-09-12T12:22:43.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0ce000640 1 --2- 172.21.15.144:0/4166406664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0ac004810 0x7fd0ac004c90 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0ce000640 1 -- 172.21.15.144:0/4166406664 >> 172.21.15.144:0/4166406664 conn(0x7fd0c8068030 msgr2=0x7fd0c80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0ce000640 1 -- 172.21.15.144:0/4166406664 shutdown_connections 2024-09-12T12:22:43.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.082+0000 7fd0ce000640 1 -- 172.21.15.144:0/4166406664 wait complete. 2024-09-12T12:22:43.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 Processor -- start 2024-09-12T12:22:43.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 -- start start 2024-09-12T12:22:43.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0ac004810 0x7fd0c8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0c81f6850 0x7fd0c80ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0c80ab3f0 0x7fd0c8158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c806d900 con 0x7fd0c81f6850 2024-09-12T12:22:43.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c8073170 con 0x7fd0ac004810 2024-09-12T12:22:43.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c806da80 con 0x7fd0c80ab3f0 2024-09-12T12:22:43.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0c81f6850 0x7fd0c80ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0c81f6850 0x7fd0c80ad400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51482/0 (socket says 172.21.15.144:51482) 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c6a00640 1 -- 172.21.15.144:0/3179215507 learned_addr learned my addr 172.21.15.144:0/3179215507 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c7400640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0ac004810 0x7fd0c8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0c80ab3f0 0x7fd0c8158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c6a00640 1 -- 172.21.15.144:0/3179215507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0c80ab3f0 msgr2=0x7fd0c8158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0c80ab3f0 0x7fd0c8158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c6a00640 1 -- 172.21.15.144:0/3179215507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0ac004810 msgr2=0x7fd0c8154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0ac004810 0x7fd0c8154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c6a00640 1 -- 172.21.15.144:0/3179215507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c81548a0 con 0x7fd0c81f6850 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0c80ab3f0 0x7fd0c8158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:43.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0c81f6850 0x7fd0c80ad400 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009ab0 tx=0x7fd0b40197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0bf400640 1 -- 172.21.15.144:0/3179215507 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40a9c80 con 0x7fd0c81f6850 2024-09-12T12:22:43.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0bf400640 1 -- 172.21.15.144:0/3179215507 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b40a9e20 con 0x7fd0c81f6850 2024-09-12T12:22:43.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 -- 172.21.15.144:0/3179215507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c80abdd0 con 0x7fd0c81f6850 2024-09-12T12:22:43.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0bf400640 1 -- 172.21.15.144:0/3179215507 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40bb650 con 0x7fd0c81f6850 2024-09-12T12:22:43.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.086+0000 7fd0ce000640 1 -- 172.21.15.144:0/3179215507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c8156f40 con 0x7fd0c81f6850 2024-09-12T12:22:43.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0bf400640 1 -- 172.21.15.144:0/3179215507 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0b40b0400 con 0x7fd0c81f6850 2024-09-12T12:22:43.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0bf400640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0a80678c0 0x7fd0a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0bf400640 1 -- 172.21.15.144:0/3179215507 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fd0b41203c0 con 0x7fd0c81f6850 2024-09-12T12:22:43.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7400640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0a80678c0 0x7fd0a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0d14aa000 1 Processor -- start 2024-09-12T12:22:43.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0d14aa000 1 -- start start 2024-09-12T12:22:43.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7400640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0a80678c0 0x7fd0a8069d80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8001210 tx=0x7fd0b8007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 0x5606f05fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05faaf0 0x5606f05adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05ae1c0 0x5606f05ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5606f0493960 con 0x5606f05ae1c0 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5606f03d7900 con 0x5606f05fa1d0 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5606f03fad40 con 0x5606f05faaf0 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05ae1c0 0x5606f05ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05ae1c0 0x5606f05ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51498/0 (socket says 172.21.15.144:51498) 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7e00640 1 -- 172.21.15.144:0/3578732410 learned_addr learned my addr 172.21.15.144:0/3578732410 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7400640 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 0x5606f05fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05faaf0 0x5606f05adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7e00640 1 -- 172.21.15.144:0/3578732410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05faaf0 msgr2=0x5606f05adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05faaf0 0x5606f05adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7e00640 1 -- 172.21.15.144:0/3578732410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 msgr2=0x5606f05fa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 0x5606f05fa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.090+0000 7fd0c7e00640 1 -- 172.21.15.144:0/3578732410 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f03a1580 con 0x5606f05ae1c0 2024-09-12T12:22:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05faaf0 0x5606f05adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:43.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05ae1c0 0x5606f05ae5a0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80aff30 tx=0x7fd0c00054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2b00d771dede10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0b3e00640 1 -- 172.21.15.144:0/3578732410 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00018a0 con 0x5606f05ae1c0 2024-09-12T12:22:43.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0b3e00640 1 -- 172.21.15.144:0/3578732410 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c0019070 con 0x5606f05ae1c0 2024-09-12T12:22:43.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0b3e00640 1 -- 172.21.15.144:0/3578732410 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0001c80 con 0x5606f05ae1c0 2024-09-12T12:22:43.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3578732410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05ae1c0 msgr2=0x5606f05ae5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05ae1c0 0x5606f05ae5a0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fd0c80aff30 tx=0x7fd0c00054e0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3578732410 shutdown_connections 2024-09-12T12:22:43.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05ae1c0 0x5606f05ae5a0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05faaf0 0x5606f05adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3578732410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 0x5606f05fa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3578732410 >> 172.21.15.144:0/3578732410 conn(0x5606f05db4a0 msgr2=0x5606f05dd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3578732410 shutdown_connections 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3578732410 wait complete. 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 -- start start 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 Processor -- start 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f0601350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 0x5606f0601890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05faaf0 0x5606f0601dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5606f03f6d00 con 0x5606f05faaf0 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5606f03b5aa0 con 0x5606f05fa1d0 2024-09-12T12:22:43.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5606f0394340 con 0x5606f05ae1c0 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0d14aa000 10 client.0 _ll_register_callbacks cb 0x5606f0597760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05faaf0 0x5606f0601dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05faaf0 0x5606f0601dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51506/0 (socket says 172.21.15.144:51506) 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7e00640 1 -- 172.21.15.144:0/3046464332 learned_addr learned my addr 172.21.15.144:0/3046464332 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7400640 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f0601350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 0x5606f0601890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7e00640 1 -- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 msgr2=0x5606f0601350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f0601350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7e00640 1 -- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 msgr2=0x5606f0601890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 0x5606f0601890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.094+0000 7fd0c7e00640 1 -- 172.21.15.144:0/3046464332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f039ddc0 con 0x5606f05faaf0 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05faaf0 0x5606f0601dd0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0015000 tx=0x7fd0c0001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b5f774183a8f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:43.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 1 -- 172.21.15.144:0/3046464332 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0001260 con 0x5606f05faaf0 2024-09-12T12:22:43.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 1 -- 172.21.15.144:0/3046464332 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fd0c0029cc0 con 0x5606f05faaf0 2024-09-12T12:22:43.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3046464332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c0019070 con 0x5606f05faaf0 2024-09-12T12:22:43.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 1 -- 172.21.15.144:0/3046464332 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fd0c0030050 con 0x5606f05faaf0 2024-09-12T12:22:43.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 10 client.9162 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:43.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3046464332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x5606f039a7f0 con 0x5606f05faaf0 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 1 -- 172.21.15.144:0/3046464332 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c0019070 con 0x5606f05faaf0 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 1 -- 172.21.15.144:0/3046464332 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7fd0c0033020 con 0x5606f05faaf0 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 10 client.9162 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 10 client.9162 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 20 client.9162 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5606f0609720 0x5606f060bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 4 client.9162 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3046464332 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606f0394e10 con 0x5606f0609720 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0c7400640 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5606f0609720 0x5606f060bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 10 client.9162 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0c7400640 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5606f0609720 0x5606f060bb10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b41972ef1531e32 server_cookie=c3b2a8aefdf9a8d0 in_seq=0 out_seq=0 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 1 -- 172.21.15.144:0/3046464332 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606f0394e10 con 0x5606f0609720 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 10 client.9162 handle_command_reply: tid=0 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 client.9162 shutdown 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3046464332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05faaf0 msgr2=0x5606f0601dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05faaf0 0x5606f0601dd0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0015000 tx=0x7fd0c0001520 comp rx=0 tx=0).stop 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3046464332 shutdown_connections 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5606f0609720 0x5606f060bb10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05faaf0 0x5606f0601dd0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05fa1d0 0x5606f0601890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/3046464332 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f0601350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0b0c00640 0 client.9162 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:43.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3046464332 >> 172.21.15.144:0/3046464332 conn(0x5606f05db4a0 msgr2=0x5606f05ad490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3046464332 shutdown_connections 2024-09-12T12:22:43.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 1 -- 172.21.15.144:0/3046464332 wait complete. 2024-09-12T12:22:43.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.098+0000 7fd0d14aa000 20 client.9162 trim_cache size 0 max 16384 2024-09-12T12:22:43.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 Processor -- start 2024-09-12T12:22:43.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- start start 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05f9df0 0x5606f0606f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05db4a0 0x5606f0607470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f060eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c8200be0 con 0x5606f05db4a0 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80b52a0 con 0x5606f05f9df0 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c80b4600 con 0x5606f05ae1c0 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05db4a0 0x5606f0607470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05db4a0 0x5606f0607470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51508/0 (socket says 172.21.15.144:51508) 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c6a00640 1 -- 172.21.15.144:0/2248096524 learned_addr learned my addr 172.21.15.144:0/2248096524 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c7400640 1 --2- 172.21.15.144:0/2248096524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05f9df0 0x5606f0606f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/2248096524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f060eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c6a00640 1 -- 172.21.15.144:0/2248096524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 msgr2=0x5606f060eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/2248096524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f060eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c6a00640 1 -- 172.21.15.144:0/2248096524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05f9df0 msgr2=0x5606f0606f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/2248096524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05f9df0 0x5606f0606f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c6a00640 1 -- 172.21.15.144:0/2248096524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f03b8470 con 0x5606f05db4a0 2024-09-12T12:22:43.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/2248096524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05db4a0 0x5606f0607470 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40ecb10 tx=0x7fd0b4120040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da7dcfb389b55be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0b3400640 1 -- 172.21.15.144:0/2248096524 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4108070 con 0x5606f05db4a0 2024-09-12T12:22:43.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0b3400640 1 -- 172.21.15.144:0/2248096524 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b40f4a60 con 0x5606f05db4a0 2024-09-12T12:22:43.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0b3400640 1 -- 172.21.15.144:0/2248096524 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40f9290 con 0x5606f05db4a0 2024-09-12T12:22:43.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- 172.21.15.144:0/2248096524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05db4a0 msgr2=0x5606f0607470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/2248096524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05db4a0 0x5606f0607470 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40ecb10 tx=0x7fd0b4120040 comp rx=0 tx=0).stop 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- 172.21.15.144:0/2248096524 shutdown_connections 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/2248096524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f060eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/2248096524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05db4a0 0x5606f0607470 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/2248096524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05f9df0 0x5606f0606f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- 172.21.15.144:0/2248096524 >> 172.21.15.144:0/2248096524 conn(0x5606f05f9a10 msgr2=0x5606f05df600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- 172.21.15.144:0/2248096524 shutdown_connections 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- 172.21.15.144:0/2248096524 wait complete. 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 -- start start 2024-09-12T12:22:43.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.118+0000 7fd0d14aa000 1 Processor -- start 2024-09-12T12:22:43.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f066eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05db4a0 0x5606f066eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05f9df0 0x5606f060cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5606f03fa050 con 0x5606f05f9df0 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c80b4c50 con 0x5606f05db4a0 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5606f04b70c0 con 0x5606f05ae1c0 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 10 client.0 _ll_register_callbacks cb 0x7fd0c0003e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05f9df0 0x5606f060cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05f9df0 0x5606f060cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51516/0 (socket says 172.21.15.144:51516) 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7e00640 1 -- 172.21.15.144:0/1737147449 learned_addr learned my addr 172.21.15.144:0/1737147449 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7400640 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f066eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7e00640 1 -- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 msgr2=0x5606f066eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f066eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7e00640 1 -- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05db4a0 msgr2=0x5606f066eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05db4a0 0x5606f066eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05db4a0 0x5606f066eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7e00640 1 -- 172.21.15.144:0/1737147449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f038e640 con 0x5606f05f9df0 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7400640 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f066eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c6a00640 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05db4a0 0x5606f066eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7e00640 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05f9df0 0x5606f060cb60 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0001340 tx=0x7fd0c0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c52e3f01a9a53ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0b0c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0b0c00640 1 -- 172.21.15.144:0/1737147449 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c0006b60 con 0x5606f05f9df0 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0b0c00640 1 -- 172.21.15.144:0/1737147449 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fd0c0010070 con 0x5606f05f9df0 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 -- 172.21.15.144:0/1737147449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0b40f4a60 con 0x5606f05f9df0 2024-09-12T12:22:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0b0c00640 1 -- 172.21.15.144:0/1737147449 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7fd0c0041050 con 0x5606f05f9df0 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 10 client.9168 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 -- 172.21.15.144:0/1737147449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x5606f03923b0 con 0x5606f05f9df0 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0b0c00640 1 -- 172.21.15.144:0/1737147449 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b40f4a60 con 0x5606f05f9df0 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0b0c00640 1 -- 172.21.15.144:0/1737147449 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7fd0c0044020 con 0x5606f05f9df0 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 10 client.9168 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 10 client.9168 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 20 client.9168 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5606f05fa1d0 0x5606f060d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 4 client.9168 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0d14aa000 1 -- 172.21.15.144:0/1737147449 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x5606f05dc9c0 con 0x5606f05fa1d0 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7400640 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5606f05fa1d0 0x5606f060d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0c7400640 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5606f05fa1d0 0x5606f060d0a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69115ed4c28ddaf1 server_cookie=5854c0ca6728bb3d in_seq=0 out_seq=0 2024-09-12T12:22:43.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.122+0000 7fd0b0c00640 10 client.9168 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0b0c00640 1 -- 172.21.15.144:0/1737147449 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5606f05dc9c0 con 0x5606f05fa1d0 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0b0c00640 10 client.9168 handle_command_reply: tid=0 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 client.9168 shutdown 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 -- 172.21.15.144:0/1737147449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05f9df0 msgr2=0x5606f060cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05f9df0 0x5606f060cb60 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0001340 tx=0x7fd0c0009040 comp rx=0 tx=0).stop 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 -- 172.21.15.144:0/1737147449 shutdown_connections 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x5606f05fa1d0 0x5606f060d0a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5606f05f9df0 0x5606f060cb60 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5606f05db4a0 0x5606f066eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 --2- 172.21.15.144:0/1737147449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5606f05ae1c0 0x5606f066eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0b0c00640 0 client.9168 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 -- 172.21.15.144:0/1737147449 >> 172.21.15.144:0/1737147449 conn(0x5606f05f9a10 msgr2=0x5606f05acc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 -- 172.21.15.144:0/1737147449 shutdown_connections 2024-09-12T12:22:43.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 1 -- 172.21.15.144:0/1737147449 wait complete. 2024-09-12T12:22:43.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0d14aa000 20 client.9168 trim_cache size 0 max 16384 2024-09-12T12:22:43.131 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:22:43.131 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:22:43.131 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 -- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0a80678c0 msgr2=0x7fd0a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0a80678c0 0x7fd0a8069d80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8001210 tx=0x7fd0b8007900 comp rx=0 tx=0).stop 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 -- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0c81f6850 msgr2=0x7fd0c80ad400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0c81f6850 0x7fd0c80ad400 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009ab0 tx=0x7fd0b40197d0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 -- 172.21.15.144:0/3179215507 shutdown_connections 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0a80678c0 0x7fd0a8069d80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0c80ab3f0 0x7fd0c8158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0c81f6850 0x7fd0c80ad400 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 --2- 172.21.15.144:0/3179215507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0ac004810 0x7fd0c8154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 -- 172.21.15.144:0/3179215507 >> 172.21.15.144:0/3179215507 conn(0x7fd0c8068030 msgr2=0x7fd0c80b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 -- 172.21.15.144:0/3179215507 shutdown_connections 2024-09-12T12:22:43.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.126+0000 7fd0ce000640 1 -- 172.21.15.144:0/3179215507 wait complete. 2024-09-12T12:22:43.145 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-12T12:22:43.146 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-12T12:22:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8646c00640 1 Processor -- start 2024-09-12T12:22:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8646c00640 1 -- start start 2024-09-12T12:22:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8646c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86400b32f0 0x7f864015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8646c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f864006bc10 0x7f864006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8646c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f864006c070 0x7f864006d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8646c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f864015bf00 con 0x7f864006bc10 2024-09-12T12:22:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8646c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f86400b38b0 con 0x7f864006c070 2024-09-12T12:22:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8646c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86400b3b90 con 0x7f86400b32f0 2024-09-12T12:22:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f863f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f864006bc10 0x7f864006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f863f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f864006bc10 0x7f864006d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51532/0 (socket says 172.21.15.144:51532) 2024-09-12T12:22:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f863f400640 1 -- 172.21.15.144:0/60046994 learned_addr learned my addr 172.21.15.144:0/60046994 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8644c00640 1 --2- 172.21.15.144:0/60046994 >> v2:172.21.15.165:3300/0 conn(0x7f864006c070 0x7f864006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f863fe00640 1 --2- 172.21.15.144:0/60046994 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86400b32f0 0x7f864015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f863f400640 1 -- 172.21.15.144:0/60046994 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86400b32f0 msgr2=0x7f864015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f863f400640 1 --2- 172.21.15.144:0/60046994 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86400b32f0 0x7f864015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f863f400640 1 -- 172.21.15.144:0/60046994 >> v2:172.21.15.165:3300/0 conn(0x7f864006c070 msgr2=0x7f864006d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f863f400640 1 --2- 172.21.15.144:0/60046994 >> v2:172.21.15.165:3300/0 conn(0x7f864006c070 0x7f864006d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f863f400640 1 -- 172.21.15.144:0/60046994 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86400b3e70 con 0x7f864006bc10 2024-09-12T12:22:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.282+0000 7f8644c00640 1 --2- 172.21.15.144:0/60046994 >> v2:172.21.15.165:3300/0 conn(0x7f864006c070 0x7f864006d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:43.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f863f400640 1 --2- 172.21.15.144:0/60046994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f864006bc10 0x7f864006d0f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f86400b5930 tx=0x7f862c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802f299f2ff0b3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f863ea00640 1 -- 172.21.15.144:0/60046994 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0b0070 con 0x7f864006bc10 2024-09-12T12:22:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f863ea00640 1 -- 172.21.15.144:0/60046994 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c0ab600 con 0x7f864006bc10 2024-09-12T12:22:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f863ea00640 1 -- 172.21.15.144:0/60046994 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0ab9d0 con 0x7f864006bc10 2024-09-12T12:22:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f8646c00640 1 -- 172.21.15.144:0/60046994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f864006bc10 msgr2=0x7f864006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f8646c00640 1 --2- 172.21.15.144:0/60046994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f864006bc10 0x7f864006d0f0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f86400b5930 tx=0x7f862c01c520 comp rx=0 tx=0).stop 2024-09-12T12:22:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f8646c00640 1 -- 172.21.15.144:0/60046994 shutdown_connections 2024-09-12T12:22:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f8646c00640 1 --2- 172.21.15.144:0/60046994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f864006bc10 0x7f864006d0f0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f8646c00640 1 --2- 172.21.15.144:0/60046994 >> v2:172.21.15.165:3300/0 conn(0x7f864006c070 0x7f864006d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f8646c00640 1 --2- 172.21.15.144:0/60046994 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86400b32f0 0x7f864015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f8646c00640 1 -- 172.21.15.144:0/60046994 >> 172.21.15.144:0/60046994 conn(0x7f8640068030 msgr2=0x7f86400b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f8646c00640 1 -- 172.21.15.144:0/60046994 shutdown_connections 2024-09-12T12:22:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.286+0000 7f8646c00640 1 -- 172.21.15.144:0/60046994 wait complete. 2024-09-12T12:22:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 Processor -- start 2024-09-12T12:22:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 -- start start 2024-09-12T12:22:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f864006bc10 0x7f8640143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f864006c070 0x7f8640073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86400b32f0 0x7f864015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86400b5020 con 0x7f86400b32f0 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86400ce0e0 con 0x7f864006c070 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86400b51a0 con 0x7f864006bc10 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8644c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86400b32f0 0x7f864015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8644c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86400b32f0 0x7f864015d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51542/0 (socket says 172.21.15.144:51542) 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8644c00640 1 -- 172.21.15.144:0/3157201723 learned_addr learned my addr 172.21.15.144:0/3157201723 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8644c00640 1 -- 172.21.15.144:0/3157201723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f864006bc10 msgr2=0x7f8640143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f863f400640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f864006c070 0x7f8640073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8644c00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f864006bc10 0x7f8640143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8644c00640 1 -- 172.21.15.144:0/3157201723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f864006c070 msgr2=0x7f8640073320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8644c00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f864006c070 0x7f8640073320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8644c00640 1 -- 172.21.15.144:0/3157201723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864014fda0 con 0x7f86400b32f0 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f863f400640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f864006c070 0x7f8640073320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8644c00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86400b32f0 0x7f864015d540 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f863800e5b0 tx=0x7f863800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8637e00640 1 -- 172.21.15.144:0/3157201723 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638017020 con 0x7f86400b32f0 2024-09-12T12:22:43.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8637e00640 1 -- 172.21.15.144:0/3157201723 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8638004230 con 0x7f86400b32f0 2024-09-12T12:22:43.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8637e00640 1 -- 172.21.15.144:0/3157201723 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863800f040 con 0x7f86400b32f0 2024-09-12T12:22:43.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 -- 172.21.15.144:0/3157201723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8640150040 con 0x7f86400b32f0 2024-09-12T12:22:43.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.290+0000 7f8646c00640 1 -- 172.21.15.144:0/3157201723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8640150600 con 0x7f86400b32f0 2024-09-12T12:22:43.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.294+0000 7f8637e00640 1 -- 172.21.15.144:0/3157201723 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f863801a020 con 0x7f86400b32f0 2024-09-12T12:22:43.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.294+0000 7f8637e00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86200678c0 0x7f8620069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.294+0000 7f8637e00640 1 -- 172.21.15.144:0/3157201723 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f8638085c00 con 0x7f86400b32f0 2024-09-12T12:22:43.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.294+0000 7f863fe00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86200678c0 0x7f8620069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.294+0000 7f8649fd9000 1 Processor -- start 2024-09-12T12:22:43.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.294+0000 7f8649fd9000 1 -- start start 2024-09-12T12:22:43.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863fe00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86200678c0 0x7f8620069d80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f86300070b0 tx=0x7f8630007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 0x559d80ba8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba8690 0x559d80b5b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80b5c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559d80a45960 con 0x559d80ba8690 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559d80989900 con 0x559d80ba7d70 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559d809acd40 con 0x559d80b5bdb0 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba8690 0x559d80b5b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba8690 0x559d80b5b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51550/0 (socket says 172.21.15.144:51550) 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863f400640 1 -- 172.21.15.144:0/3081563764 learned_addr learned my addr 172.21.15.144:0/3081563764 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863fe00640 1 --2- 172.21.15.144:0/3081563764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 0x559d80ba8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8644c00640 1 --2- 172.21.15.144:0/3081563764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80b5c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863f400640 1 -- 172.21.15.144:0/3081563764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 msgr2=0x559d80b5c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863f400640 1 --2- 172.21.15.144:0/3081563764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80b5c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863f400640 1 -- 172.21.15.144:0/3081563764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 msgr2=0x559d80ba8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863f400640 1 --2- 172.21.15.144:0/3081563764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 0x559d80ba8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863f400640 1 -- 172.21.15.144:0/3081563764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d80953580 con 0x559d80ba8690 2024-09-12T12:22:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f863f400640 1 --2- 172.21.15.144:0/3081563764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba8690 0x559d80b5b870 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f862c000c10 tx=0x7f862c0a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f840294b17b12175 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8634c00640 1 -- 172.21.15.144:0/3081563764 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0b0040 con 0x559d80ba8690 2024-09-12T12:22:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8634c00640 1 -- 172.21.15.144:0/3081563764 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c0bb070 con 0x559d80ba8690 2024-09-12T12:22:43.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8634c00640 1 -- 172.21.15.144:0/3081563764 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0aba00 con 0x559d80ba8690 2024-09-12T12:22:43.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 -- 172.21.15.144:0/3081563764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba8690 msgr2=0x559d80b5b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 --2- 172.21.15.144:0/3081563764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba8690 0x559d80b5b870 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f862c000c10 tx=0x7f862c0a6000 comp rx=0 tx=0).stop 2024-09-12T12:22:43.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 -- 172.21.15.144:0/3081563764 shutdown_connections 2024-09-12T12:22:43.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 --2- 172.21.15.144:0/3081563764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80b5c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 --2- 172.21.15.144:0/3081563764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba8690 0x559d80b5b870 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 --2- 172.21.15.144:0/3081563764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 0x559d80ba8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 -- 172.21.15.144:0/3081563764 >> 172.21.15.144:0/3081563764 conn(0x559d80b89040 msgr2=0x559d80b8b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 -- 172.21.15.144:0/3081563764 shutdown_connections 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 -- 172.21.15.144:0/3081563764 wait complete. 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 -- start start 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.298+0000 7f8649fd9000 1 Processor -- start 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80baece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80baf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba8690 0x559d80baf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559d809a8d00 con 0x559d80ba7d70 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559d80967aa0 con 0x559d80ba8690 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559d80946340 con 0x559d80b5bdb0 2024-09-12T12:22:43.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 10 client.0 _ll_register_callbacks cb 0x559d80b49760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80baf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80baf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51564/0 (socket says 172.21.15.144:51564) 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863f400640 1 -- 172.21.15.144:0/2281742088 learned_addr learned my addr 172.21.15.144:0/2281742088 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8644c00640 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba8690 0x559d80baf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863fe00640 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80baece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863f400640 1 -- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 msgr2=0x559d80baece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863f400640 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80baece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863f400640 1 -- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba8690 msgr2=0x559d80baf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863f400640 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba8690 0x559d80baf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863f400640 1 -- 172.21.15.144:0/2281742088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d8094fdc0 con 0x559d80ba7d70 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863f400640 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80baf220 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f862c008010 tx=0x7f862c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a6a44bf03f2067 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8629600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:43.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8629600640 1 -- 172.21.15.144:0/2281742088 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0c7060 con 0x559d80ba7d70 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8629600640 1 -- 172.21.15.144:0/2281742088 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f862c0ab800 con 0x559d80ba7d70 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 -- 172.21.15.144:0/2281742088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f862c0bb070 con 0x559d80ba7d70 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8629600640 1 -- 172.21.15.144:0/2281742088 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f862c0cd050 con 0x559d80ba7d70 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 10 client.9180 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 -- 172.21.15.144:0/2281742088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x559d8094c7f0 con 0x559d80ba7d70 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8629600640 1 -- 172.21.15.144:0/2281742088 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f862c0bb070 con 0x559d80ba7d70 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8629600640 1 -- 172.21.15.144:0/2281742088 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f862c0d0020 con 0x559d80ba7d70 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 10 client.9180 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 10 client.9180 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 20 client.9180 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559d80bb70b0 0x559d80bb94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 4 client.9180 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8649fd9000 1 -- 172.21.15.144:0/2281742088 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d80946e10 con 0x559d80bb70b0 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863fe00640 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559d80bb70b0 0x559d80bb94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f863fe00640 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559d80bb70b0 0x559d80bb94a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69589328c6e9f782 server_cookie=964ea460b0db8cc3 in_seq=0 out_seq=0 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.302+0000 7f8629600640 10 client.9180 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8629600640 1 -- 172.21.15.144:0/2281742088 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d80946e10 con 0x559d80bb70b0 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8629600640 10 client.9180 handle_command_reply: tid=0 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 client.9180 shutdown 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 -- 172.21.15.144:0/2281742088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 msgr2=0x559d80baf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80baf220 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f862c008010 tx=0x7f862c0046d0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 -- 172.21.15.144:0/2281742088 shutdown_connections 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559d80bb70b0 0x559d80bb94a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba8690 0x559d80baf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80baf220 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2281742088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80baece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8629600640 0 client.9180 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:43.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 -- 172.21.15.144:0/2281742088 >> 172.21.15.144:0/2281742088 conn(0x559d80b89040 msgr2=0x559d80b5af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 -- 172.21.15.144:0/2281742088 shutdown_connections 2024-09-12T12:22:43.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 1 -- 172.21.15.144:0/2281742088 wait complete. 2024-09-12T12:22:43.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.306+0000 7f8649fd9000 20 client.9180 trim_cache size 0 max 16384 2024-09-12T12:22:43.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8649fd9000 1 Processor -- start 2024-09-12T12:22:43.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8649fd9000 1 -- start start 2024-09-12T12:22:43.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80b89040 0x559d80b63c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80b64170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 0x559d80bb1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8649fd9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86402041b0 con 0x559d80b89040 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8649fd9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86402031f0 con 0x559d80ba7d70 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8649fd9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8640154470 con 0x559d80b5bdb0 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80b89040 0x559d80b63c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80b89040 0x559d80b63c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51580/0 (socket says 172.21.15.144:51580) 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863fe00640 1 -- 172.21.15.144:0/2175733017 learned_addr learned my addr 172.21.15.144:0/2175733017 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863f400640 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80b64170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8644c00640 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 0x559d80bb1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863fe00640 1 -- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 msgr2=0x559d80b64170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863fe00640 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80b64170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863fe00640 1 -- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 msgr2=0x559d80bb1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863fe00640 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 0x559d80bb1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863fe00640 1 -- 172.21.15.144:0/2175733017 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d8096a470 con 0x559d80b89040 2024-09-12T12:22:43.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f8644c00640 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 0x559d80bb1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:43.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863f400640 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80b64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:43.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.322+0000 7f863fe00640 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80b89040 0x559d80b63c30 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f8630016a50 tx=0x7f8630015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8989bfa73f11073 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f862be00640 1 -- 172.21.15.144:0/2175733017 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630009690 con 0x559d80b89040 2024-09-12T12:22:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f862be00640 1 -- 172.21.15.144:0/2175733017 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8630015ad0 con 0x559d80b89040 2024-09-12T12:22:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f862be00640 1 -- 172.21.15.144:0/2175733017 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863002d410 con 0x559d80b89040 2024-09-12T12:22:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- 172.21.15.144:0/2175733017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80b89040 msgr2=0x559d80b63c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80b89040 0x559d80b63c30 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f8630016a50 tx=0x7f8630015000 comp rx=0 tx=0).stop 2024-09-12T12:22:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- 172.21.15.144:0/2175733017 shutdown_connections 2024-09-12T12:22:43.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80ba7d70 0x559d80bb1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b5bdb0 0x559d80b64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 --2- 172.21.15.144:0/2175733017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80b89040 0x559d80b63c30 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- 172.21.15.144:0/2175733017 >> 172.21.15.144:0/2175733017 conn(0x559d80b60770 msgr2=0x559d80baf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- 172.21.15.144:0/2175733017 shutdown_connections 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- 172.21.15.144:0/2175733017 wait complete. 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- start start 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 Processor -- start 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80b5bdb0 0x559d80bb4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b89040 0x559d80c1bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80c1c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559d8096b3f0 con 0x559d80ba7d70 2024-09-12T12:22:43.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559d80974400 con 0x559d80b5bdb0 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559d809ec780 con 0x559d80b89040 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 10 client.0 _ll_register_callbacks cb 0x7f862c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8644c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80c1c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8644c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80c1c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51592/0 (socket says 172.21.15.144:51592) 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8644c00640 1 -- 172.21.15.144:0/1606317203 learned_addr learned my addr 172.21.15.144:0/1606317203 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f863f400640 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b89040 0x559d80c1bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f863fe00640 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80b5bdb0 0x559d80bb4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8644c00640 1 -- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b89040 msgr2=0x559d80c1bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8644c00640 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b89040 0x559d80c1bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8644c00640 1 -- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80b5bdb0 msgr2=0x559d80bb4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8644c00640 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80b5bdb0 0x559d80bb4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8644c00640 1 -- 172.21.15.144:0/1606317203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d80940640 con 0x559d80ba7d70 2024-09-12T12:22:43.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f863f400640 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b89040 0x559d80c1bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f863fe00640 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80b5bdb0 0x559d80bb4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8644c00640 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80c1c320 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f8638006fd0 tx=0x7f863805a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79e142eb809503f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8629600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8629600640 1 -- 172.21.15.144:0/1606317203 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638082060 con 0x559d80ba7d70 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8629600640 1 -- 172.21.15.144:0/1606317203 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f8638083a90 con 0x559d80ba7d70 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- 172.21.15.144:0/1606317203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8630015ad0 con 0x559d80ba7d70 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8629600640 1 -- 172.21.15.144:0/1606317203 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) ==== 24+0+0 (secure 0 0 0) 0x7f8638079050 con 0x559d80ba7d70 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 10 client.9186 fetch_fsmap learned FSMap version 114 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8649fd9000 1 -- 172.21.15.144:0/1606317203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) -- 0x559d809443b0 con 0x559d80ba7d70 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8629600640 1 -- 172.21.15.144:0/1606317203 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8630015ad0 con 0x559d80ba7d70 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.326+0000 7f8629600640 1 -- 172.21.15.144:0/1606317203 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 114) ==== 3502+0+0 (secure 0 0 0) 0x7f863807c020 con 0x559d80ba7d70 2024-09-12T12:22:43.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 10 client.9186 fetch_fsmap finished waiting for FSMap version 114 2024-09-12T12:22:43.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 10 client.9186 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.b 2024-09-12T12:22:43.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 20 client.9186 populate_metadata read hostname 'smithi144' 2024-09-12T12:22:43.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559d80ba8690 0x559d80c1c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 4 client.9186 mds_command: new command op to 8874 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:22:43.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 -- 172.21.15.144:0/1606317203 --> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559d809ba470 con 0x559d80ba8690 2024-09-12T12:22:43.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f863fe00640 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559d80ba8690 0x559d80c1c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f863fe00640 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559d80ba8690 0x559d80c1c860 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94112f6f9846d4 server_cookie=648709e12918ad66 in_seq=0 out_seq=0 2024-09-12T12:22:43.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8629600640 10 client.9186 ms_handle_connect on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:43.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8629600640 1 -- 172.21.15.144:0/1606317203 <== mds.0 v2:172.21.15.165:6833/1602168377 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559d809ba470 con 0x559d80ba8690 2024-09-12T12:22:43.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8629600640 10 client.9186 handle_command_reply: tid=0 2024-09-12T12:22:43.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 client.9186 shutdown 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 -- 172.21.15.144:0/1606317203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 msgr2=0x559d80c1c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80c1c320 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f8638006fd0 tx=0x7f863805a240 comp rx=0 tx=0).stop 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 -- 172.21.15.144:0/1606317203 shutdown_connections 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:6833/1602168377,v1:172.21.15.165:6835/1602168377] conn(0x559d80ba8690 0x559d80c1c860 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559d80ba7d70 0x559d80c1c320 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559d80b89040 0x559d80c1bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8629600640 0 client.9186 ms_handle_reset on v2:172.21.15.165:6833/1602168377 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 --2- 172.21.15.144:0/1606317203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559d80b5bdb0 0x559d80bb4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 -- 172.21.15.144:0/1606317203 >> 172.21.15.144:0/1606317203 conn(0x559d80b60770 msgr2=0x559d80b62c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 -- 172.21.15.144:0/1606317203 shutdown_connections 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 1 -- 172.21.15.144:0/1606317203 wait complete. 2024-09-12T12:22:43.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8649fd9000 20 client.9186 trim_cache size 0 max 16384 2024-09-12T12:22:43.337 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:22:43.337 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "no active scrubs running", 2024-09-12T12:22:43.337 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:22:43.337 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 -- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86200678c0 msgr2=0x7f8620069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86200678c0 0x7f8620069d80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f86300070b0 tx=0x7f8630007040 comp rx=0 tx=0).stop 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 -- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86400b32f0 msgr2=0x7f864015d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86400b32f0 0x7f864015d540 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f863800e5b0 tx=0x7f863800ea70 comp rx=0 tx=0).stop 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 -- 172.21.15.144:0/3157201723 shutdown_connections 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f86200678c0 0x7f8620069d80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86400b32f0 0x7f864015d540 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f864006c070 0x7f8640073320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 --2- 172.21.15.144:0/3157201723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f864006bc10 0x7f8640143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 -- 172.21.15.144:0/3157201723 >> 172.21.15.144:0/3157201723 conn(0x7f8640068030 msgr2=0x7f86400b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 -- 172.21.15.144:0/3157201723 shutdown_connections 2024-09-12T12:22:43.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.330+0000 7f8646c00640 1 -- 172.21.15.144:0/3157201723 wait complete. 2024-09-12T12:22:43.351 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:22:43.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:43.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc83400640 1 Processor -- start 2024-09-12T12:22:43.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc83400640 1 -- start start 2024-09-12T12:22:43.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc83400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc7c147fa0 0x7fbc7c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc83400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbc7c06c150 0x7fbc7c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc83400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c0cf750 0x7fbc7c1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc83400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbc7c072a90 con 0x7fbc7c147fa0 2024-09-12T12:22:43.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc83400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbc7c06c6b0 con 0x7fbc7c06c150 2024-09-12T12:22:43.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc83400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc7c072ce0 con 0x7fbc7c0cf750 2024-09-12T12:22:43.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc80a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc7c147fa0 0x7fbc7c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc80a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc7c147fa0 0x7fbc7c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51604/0 (socket says 172.21.15.144:51604) 2024-09-12T12:22:43.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc80a00640 1 -- 172.21.15.144:0/2615785742 learned_addr learned my addr 172.21.15.144:0/2615785742 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc81400640 1 --2- 172.21.15.144:0/2615785742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c0cf750 0x7fbc7c1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc7be00640 1 --2- 172.21.15.144:0/2615785742 >> v2:172.21.15.165:3300/0 conn(0x7fbc7c06c150 0x7fbc7c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc80a00640 1 -- 172.21.15.144:0/2615785742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c0cf750 msgr2=0x7fbc7c1620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc80a00640 1 --2- 172.21.15.144:0/2615785742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c0cf750 0x7fbc7c1620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc80a00640 1 -- 172.21.15.144:0/2615785742 >> v2:172.21.15.165:3300/0 conn(0x7fbc7c06c150 msgr2=0x7fbc7c0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc80a00640 1 --2- 172.21.15.144:0/2615785742 >> v2:172.21.15.165:3300/0 conn(0x7fbc7c06c150 0x7fbc7c0cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.486+0000 7fbc80a00640 1 -- 172.21.15.144:0/2615785742 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7c072fc0 con 0x7fbc7c147fa0 2024-09-12T12:22:43.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc80a00640 1 --2- 172.21.15.144:0/2615785742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c147fa0 0x7fbc7c06bc10 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0d0810 tx=0x7fbc6c01c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4901f09f98b27e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc7b400640 1 -- 172.21.15.144:0/2615785742 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0a6040 con 0x7fbc7c147fa0 2024-09-12T12:22:43.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc7b400640 1 -- 172.21.15.144:0/2615785742 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0af070 con 0x7fbc7c147fa0 2024-09-12T12:22:43.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc7b400640 1 -- 172.21.15.144:0/2615785742 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0aa660 con 0x7fbc7c147fa0 2024-09-12T12:22:43.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc83400640 1 -- 172.21.15.144:0/2615785742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c147fa0 msgr2=0x7fbc7c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc83400640 1 --2- 172.21.15.144:0/2615785742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c147fa0 0x7fbc7c06bc10 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0d0810 tx=0x7fbc6c01c610 comp rx=0 tx=0).stop 2024-09-12T12:22:43.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc83400640 1 -- 172.21.15.144:0/2615785742 shutdown_connections 2024-09-12T12:22:43.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc83400640 1 --2- 172.21.15.144:0/2615785742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c0cf750 0x7fbc7c1620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc83400640 1 --2- 172.21.15.144:0/2615785742 >> v2:172.21.15.165:3300/0 conn(0x7fbc7c06c150 0x7fbc7c0cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc83400640 1 --2- 172.21.15.144:0/2615785742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c147fa0 0x7fbc7c06bc10 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc83400640 1 -- 172.21.15.144:0/2615785742 >> 172.21.15.144:0/2615785742 conn(0x7fbc7c06cd20 msgr2=0x7fbc7c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc83400640 1 -- 172.21.15.144:0/2615785742 shutdown_connections 2024-09-12T12:22:43.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.490+0000 7fbc83400640 1 -- 172.21.15.144:0/2615785742 wait complete. 2024-09-12T12:22:43.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 Processor -- start 2024-09-12T12:22:43.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 -- start start 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c06c150 0x7fbc7c13e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc7c0cf750 0x7fbc7c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c147fa0 0x7fbc7c0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c15ebf0 con 0x7fbc7c06c150 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c15ea70 con 0x7fbc7c0cf750 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc7c15ed70 con 0x7fbc7c147fa0 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc80a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c06c150 0x7fbc7c13e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc80a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c06c150 0x7fbc7c13e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51610/0 (socket says 172.21.15.144:51610) 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc80a00640 1 -- 172.21.15.144:0/140500229 learned_addr learned my addr 172.21.15.144:0/140500229 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc7be00640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc7c0cf750 0x7fbc7c0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc81400640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c147fa0 0x7fbc7c0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc80a00640 1 -- 172.21.15.144:0/140500229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c147fa0 msgr2=0x7fbc7c0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc80a00640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c147fa0 0x7fbc7c0ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc80a00640 1 -- 172.21.15.144:0/140500229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc7c0cf750 msgr2=0x7fbc7c0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc80a00640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc7c0cf750 0x7fbc7c0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc80a00640 1 -- 172.21.15.144:0/140500229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7c13f670 con 0x7fbc7c06c150 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc80a00640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c06c150 0x7fbc7c13e020 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c01acc0 tx=0x7fbc6c0193b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc78c00640 1 -- 172.21.15.144:0/140500229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0b9070 con 0x7fbc7c06c150 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc78c00640 1 -- 172.21.15.144:0/140500229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0aa640 con 0x7fbc7c06c150 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc78c00640 1 -- 172.21.15.144:0/140500229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0aaa30 con 0x7fbc7c06c150 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc7c13e560 con 0x7fbc7c06c150 2024-09-12T12:22:43.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc7c13fcc0 con 0x7fbc7c06c150 2024-09-12T12:22:43.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.494+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc7c1620b0 con 0x7fbc7c06c150 2024-09-12T12:22:43.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.498+0000 7fbc78c00640 1 -- 172.21.15.144:0/140500229 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc6c0aabd0 con 0x7fbc7c06c150 2024-09-12T12:22:43.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.498+0000 7fbc78c00640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc5c0678c0 0x7fbc5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.498+0000 7fbc78c00640 1 -- 172.21.15.144:0/140500229 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fbc6c11fe10 con 0x7fbc7c06c150 2024-09-12T12:22:43.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.498+0000 7fbc7be00640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc5c0678c0 0x7fbc5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.498+0000 7fbc7be00640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc5c0678c0 0x7fbc5c069d80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fbc680045f0 tx=0x7fbc68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.502+0000 7fbc78c00640 1 -- 172.21.15.144:0/140500229 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbc6c0165e0 con 0x7fbc7c06c150 2024-09-12T12:22:43.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc7c0b67d0 con 0x7fbc7c06c150 2024-09-12T12:22:43.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc78c00640 1 -- 172.21.15.144:0/140500229 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7fbc6c0f0800 con 0x7fbc7c06c150 2024-09-12T12:22:43.696 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:43.696 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc5c0678c0 msgr2=0x7fbc5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc5c0678c0 0x7fbc5c069d80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fbc680045f0 tx=0x7fbc68008040 comp rx=0 tx=0).stop 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c06c150 msgr2=0x7fbc7c13e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c06c150 0x7fbc7c13e020 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c01acc0 tx=0x7fbc6c0193b0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 shutdown_connections 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc5c0678c0 0x7fbc5c069d80 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc7c147fa0 0x7fbc7c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc7c0cf750 0x7fbc7c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 --2- 172.21.15.144:0/140500229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc7c06c150 0x7fbc7c13e020 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 >> 172.21.15.144:0/140500229 conn(0x7fbc7c06cd20 msgr2=0x7fbc7c0b4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 shutdown_connections 2024-09-12T12:22:43.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.694+0000 7fbc83400640 1 -- 172.21.15.144:0/140500229 wait complete. 2024-09-12T12:22:43.717 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-12T12:22:43.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:22:43.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.850+0000 7fa9bd200640 1 Processor -- start 2024-09-12T12:22:43.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.850+0000 7fa9bd200640 1 -- start start 2024-09-12T12:22:43.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9bd200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa9b8147d20 0x7fa9b815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9bd200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9b80b34c0 0x7fa9b80b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9bd200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9b815ffd0 con 0x7fa9b815f5e0 2024-09-12T12:22:43.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9bd200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa9b80b3e70 con 0x7fa9b8147d20 2024-09-12T12:22:43.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9bd200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b80b53b0 con 0x7fa9b80b34c0 2024-09-12T12:22:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9b7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa9b8147d20 0x7fa9b815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9b7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa9b8147d20 0x7fa9b815fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51614/0 (socket says 172.21.15.144:51614) 2024-09-12T12:22:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9b7400640 1 -- 172.21.15.144:0/2840254118 learned_addr learned my addr 172.21.15.144:0/2840254118 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9b7400640 1 -- 172.21.15.144:0/2840254118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9b80b34c0 msgr2=0x7fa9b80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9b7400640 1 --2- 172.21.15.144:0/2840254118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9b80b34c0 0x7fa9b80b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9b7400640 1 -- 172.21.15.144:0/2840254118 >> v1:172.21.15.165:6789/0 conn(0x7fa9b815f5e0 legacy=0x7fa9b80725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:43.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9b7400640 1 -- 172.21.15.144:0/2840254118 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b80b4a80 con 0x7fa9b8147d20 2024-09-12T12:22:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.854+0000 7fa9b7400640 1 --2- 172.21.15.144:0/2840254118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 0x7fa9b815fa90 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009e50 tx=0x7fa9a801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0508aef8e868b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9b6000640 1 -- 172.21.15.144:0/2840254118 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80a5670 con 0x7fa9b8147d20 2024-09-12T12:22:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9b6000640 1 -- 172.21.15.144:0/2840254118 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a80a5810 con 0x7fa9b8147d20 2024-09-12T12:22:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9b6000640 1 -- 172.21.15.144:0/2840254118 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80a5be0 con 0x7fa9b8147d20 2024-09-12T12:22:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 -- 172.21.15.144:0/2840254118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 msgr2=0x7fa9b815fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 --2- 172.21.15.144:0/2840254118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 0x7fa9b815fa90 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009e50 tx=0x7fa9a801c9f0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 -- 172.21.15.144:0/2840254118 shutdown_connections 2024-09-12T12:22:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 --2- 172.21.15.144:0/2840254118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9b80b34c0 0x7fa9b80b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 --2- 172.21.15.144:0/2840254118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 0x7fa9b815fa90 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 -- 172.21.15.144:0/2840254118 >> 172.21.15.144:0/2840254118 conn(0x7fa9b80b69f0 msgr2=0x7fa9b80b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 -- 172.21.15.144:0/2840254118 shutdown_connections 2024-09-12T12:22:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 -- 172.21.15.144:0/2840254118 wait complete. 2024-09-12T12:22:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 Processor -- start 2024-09-12T12:22:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 -- start start 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9b80b34c0 0x7fa9b813a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 0x7fa9b8142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9b815f5e0 0x7fa9b815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80b63e0 con 0x7fa9b8147d20 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80b6260 con 0x7fa9b80b34c0 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9bd200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b8148100 con 0x7fa9b815f5e0 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 0x7fa9b8142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 0x7fa9b8142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51624/0 (socket says 172.21.15.144:51624) 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9b6a00640 1 -- 172.21.15.144:0/839895258 learned_addr learned my addr 172.21.15.144:0/839895258 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.858+0000 7fa9b7400640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9b80b34c0 0x7fa9b813a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9b7e00640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9b815f5e0 0x7fa9b815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9b6a00640 1 -- 172.21.15.144:0/839895258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9b815f5e0 msgr2=0x7fa9b815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9b6a00640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9b815f5e0 0x7fa9b815d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9b6a00640 1 -- 172.21.15.144:0/839895258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9b80b34c0 msgr2=0x7fa9b813a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9b6a00640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9b80b34c0 0x7fa9b813a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9b6a00640 1 -- 172.21.15.144:0/839895258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b80b0ab0 con 0x7fa9b8147d20 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9b6a00640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 0x7fa9b8142c10 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400b3e0 tx=0x7fa9a400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9af400640 1 -- 172.21.15.144:0/839895258 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4015020 con 0x7fa9b8147d20 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9af400640 1 -- 172.21.15.144:0/839895258 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a4011850 con 0x7fa9b8147d20 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9af400640 1 -- 172.21.15.144:0/839895258 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4011c40 con 0x7fa9b8147d20 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b80b0d90 con 0x7fa9b8147d20 2024-09-12T12:22:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b80b1350 con 0x7fa9b8147d20 2024-09-12T12:22:43.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b80b1550 con 0x7fa9b8147d20 2024-09-12T12:22:43.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9af400640 1 -- 172.21.15.144:0/839895258 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa9a4018020 con 0x7fa9b8147d20 2024-09-12T12:22:43.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9af400640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9980678f0 0x7fa998069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:43.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9af400640 1 -- 172.21.15.144:0/839895258 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fa9a4085d70 con 0x7fa9b8147d20 2024-09-12T12:22:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.862+0000 7fa9b7400640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9980678f0 0x7fa998069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:43.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.866+0000 7fa9b7400640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9980678f0 0x7fa998069db0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80ae000 tx=0x7fa9a80a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:43.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:43.866+0000 7fa9af400640 1 -- 172.21.15.144:0/839895258 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa9b80b1550 con 0x7fa9b8147d20 2024-09-12T12:22:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.082+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa9b80b3930 con 0x7fa9b8147d20 2024-09-12T12:22:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.082+0000 7fa9af400640 1 -- 172.21.15.144:0/839895258 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1643 (secure 0 0 0) 0x7fa9a401f020 con 0x7fa9b8147d20 2024-09-12T12:22:44.084 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:44.084 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":623,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076445466,"bytes_used":2583904256,"bytes_avail":770510209024,"bytes_total":773094113280,"write_bytes_sec":34144027,"read_op_per_sec":0,"write_op_per_sec":34},"fsmap":{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":8874}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-12T12:22:41.503973+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:22:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.082+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9980678f0 msgr2=0x7fa998069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9980678f0 0x7fa998069db0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80ae000 tx=0x7fa9a80a7070 comp rx=0 tx=0).stop 2024-09-12T12:22:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 msgr2=0x7fa9b8142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:44.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 0x7fa9b8142c10 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400b3e0 tx=0x7fa9a400b8a0 comp rx=0 tx=0).stop 2024-09-12T12:22:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 shutdown_connections 2024-09-12T12:22:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9980678f0 0x7fa998069db0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa9b815f5e0 0x7fa9b815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9b8147d20 0x7fa9b8142c10 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 --2- 172.21.15.144:0/839895258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9b80b34c0 0x7fa9b813a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 >> 172.21.15.144:0/839895258 conn(0x7fa9b80b69f0 msgr2=0x7fa9b80afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 shutdown_connections 2024-09-12T12:22:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:44.086+0000 7fa9bd200640 1 -- 172.21.15.144:0/839895258 wait complete. 2024-09-12T12:22:44.106 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused'} 2024-09-12T12:22:45.107 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:45.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b3200640 1 Processor -- start 2024-09-12T12:22:45.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b3200640 1 -- start start 2024-09-12T12:22:45.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b3200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f56b41568a0 0x7f56b415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b4141c50 con 0x7f56b40b04e0 2024-09-12T12:22:45.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b4141f30 con 0x7f56b40b08c0 2024-09-12T12:22:45.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b3200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f56b41427d0 con 0x7f56b41568a0 2024-09-12T12:22:45.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f56b40b04e0 0x7f56b4156190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42946/0 (socket says 172.21.15.144:42946) 2024-09-12T12:22:45.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b1e00640 1 -- 172.21.15.144:0/2065362976 learned_addr learned my addr 172.21.15.144:0/2065362976 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:45.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b1400640 1 --2- 172.21.15.144:0/2065362976 >> v2:172.21.15.165:3300/0 conn(0x7f56b41568a0 0x7f56b415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b1400640 1 -- 172.21.15.144:0/2065362976 >> v1:172.21.15.165:6789/0 conn(0x7f56b40b08c0 legacy=0x7f56b406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b1400640 1 -- 172.21.15.144:0/2065362976 >> v1:172.21.15.144:6789/0 conn(0x7f56b40b04e0 legacy=0x7f56b4156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.250+0000 7f56b1400640 1 -- 172.21.15.144:0/2065362976 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b4142210 con 0x7f56b41568a0 2024-09-12T12:22:45.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b1400640 1 --2- 172.21.15.144:0/2065362976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56b41568a0 0x7f56b415d0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f56a00097c0 tx=0x7f56a001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37b663deefd4b7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:45.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b0a00640 1 -- 172.21.15.144:0/2065362976 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a00b0070 con 0x7f56b41568a0 2024-09-12T12:22:45.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b0a00640 1 -- 172.21.15.144:0/2065362976 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a00ab600 con 0x7f56b41568a0 2024-09-12T12:22:45.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b0a00640 1 -- 172.21.15.144:0/2065362976 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a00ab9d0 con 0x7f56b41568a0 2024-09-12T12:22:45.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b3200640 1 -- 172.21.15.144:0/2065362976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56b41568a0 msgr2=0x7f56b415d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b3200640 1 --2- 172.21.15.144:0/2065362976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56b41568a0 0x7f56b415d0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f56a00097c0 tx=0x7f56a001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b3200640 1 -- 172.21.15.144:0/2065362976 shutdown_connections 2024-09-12T12:22:45.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b3200640 1 --2- 172.21.15.144:0/2065362976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56b41568a0 0x7f56b415d0d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b3200640 1 -- 172.21.15.144:0/2065362976 >> 172.21.15.144:0/2065362976 conn(0x7f56b406e060 msgr2=0x7f56b406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:45.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b3200640 1 -- 172.21.15.144:0/2065362976 shutdown_connections 2024-09-12T12:22:45.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.254+0000 7f56b3200640 1 -- 172.21.15.144:0/2065362976 wait complete. 2024-09-12T12:22:45.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 Processor -- start 2024-09-12T12:22:45.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 -- start start 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56b40b04e0 0x7f56b413a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56b40b08c0 0x7f56b4154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56b41568a0 0x7f56b4155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4141a10 con 0x7f56b41568a0 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4141890 con 0x7f56b40b04e0 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f56b406c320 con 0x7f56b40b08c0 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56b41568a0 0x7f56b4155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56b41568a0 0x7f56b4155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51628/0 (socket says 172.21.15.144:51628) 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b2800640 1 -- 172.21.15.144:0/1328248999 learned_addr learned my addr 172.21.15.144:0/1328248999 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b1400640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56b40b08c0 0x7f56b4154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b1e00640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56b40b04e0 0x7f56b413a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b2800640 1 -- 172.21.15.144:0/1328248999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56b40b08c0 msgr2=0x7f56b4154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b2800640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56b40b08c0 0x7f56b4154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b2800640 1 -- 172.21.15.144:0/1328248999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56b40b04e0 msgr2=0x7f56b413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b2800640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56b40b04e0 0x7f56b413a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b2800640 1 -- 172.21.15.144:0/1328248999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b4153520 con 0x7f56b41568a0 2024-09-12T12:22:45.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b2800640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56b41568a0 0x7f56b4155310 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00c770 tx=0x7f56ac00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:45.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56aa000640 1 -- 172.21.15.144:0/1328248999 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac003b80 con 0x7f56b41568a0 2024-09-12T12:22:45.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56aa000640 1 -- 172.21.15.144:0/1328248999 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac003d20 con 0x7f56b41568a0 2024-09-12T12:22:45.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56aa000640 1 -- 172.21.15.144:0/1328248999 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac00aa90 con 0x7f56b41568a0 2024-09-12T12:22:45.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b41537e0 con 0x7f56b41568a0 2024-09-12T12:22:45.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b4153da0 con 0x7f56b41568a0 2024-09-12T12:22:45.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.258+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b406ee90 con 0x7f56b41568a0 2024-09-12T12:22:45.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.262+0000 7f56aa000640 1 -- 172.21.15.144:0/1328248999 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56ac00ac30 con 0x7f56b41568a0 2024-09-12T12:22:45.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.262+0000 7f56aa000640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56940678c0 0x7f5694069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.262+0000 7f56aa000640 1 -- 172.21.15.144:0/1328248999 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f56ac085c60 con 0x7f56b41568a0 2024-09-12T12:22:45.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.262+0000 7f56b1e00640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56940678c0 0x7f5694069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.262+0000 7f56b1e00640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56940678c0 0x7f5694069d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f56a4005890 tx=0x7f56a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:45.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.266+0000 7f56aa000640 1 -- 172.21.15.144:0/1328248999 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f56ac055f60 con 0x7f56b41568a0 2024-09-12T12:22:45.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56b415d0b0 con 0x7f56b41568a0 2024-09-12T12:22:45.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56aa000640 1 -- 172.21.15.144:0/1328248999 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7f56ac05a260 con 0x7f56b41568a0 2024-09-12T12:22:45.460 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:45.460 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:45.460 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:45.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56940678c0 msgr2=0x7f5694069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56940678c0 0x7f5694069d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f56a4005890 tx=0x7f56a4009040 comp rx=0 tx=0).stop 2024-09-12T12:22:45.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56b41568a0 msgr2=0x7f56b4155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56b41568a0 0x7f56b4155310 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00c770 tx=0x7f56ac00cc30 comp rx=0 tx=0).stop 2024-09-12T12:22:45.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 shutdown_connections 2024-09-12T12:22:45.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56940678c0 0x7f5694069d80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56b41568a0 0x7f56b4155310 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56b40b08c0 0x7f56b4154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 --2- 172.21.15.144:0/1328248999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56b40b04e0 0x7f56b413a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 >> 172.21.15.144:0/1328248999 conn(0x7f56b406e060 msgr2=0x7f56b406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:45.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 shutdown_connections 2024-09-12T12:22:45.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.458+0000 7f56b3200640 1 -- 172.21.15.144:0/1328248999 wait complete. 2024-09-12T12:22:45.481 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-12T12:22:45.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:22:45.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.614+0000 7f0649600640 1 Processor -- start 2024-09-12T12:22:45.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.614+0000 7f0649600640 1 -- start start 2024-09-12T12:22:45.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0649600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f064415c2b0 0x7f064406da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0649600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06440d0ee0 0x7f06440cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0649600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064406e360 con 0x7f064415c690 2024-09-12T12:22:45.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0649600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f06440cd830 con 0x7f06440d0ee0 2024-09-12T12:22:45.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0649600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f064406e640 con 0x7f064415c2b0 2024-09-12T12:22:45.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0642000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06440d0ee0 0x7f06440cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0643400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f064415c690 0x7f064415fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42956/0 (socket says 172.21.15.144:42956) 2024-09-12T12:22:45.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0643400640 1 -- 172.21.15.144:0/2883607254 learned_addr learned my addr 172.21.15.144:0/2883607254 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:45.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0642a00640 1 --2- 172.21.15.144:0/2883607254 >> v2:172.21.15.165:3300/0 conn(0x7f064415c2b0 0x7f064406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0642000640 1 -- 172.21.15.144:0/2883607254 >> v2:172.21.15.165:3300/0 conn(0x7f064415c2b0 msgr2=0x7f064406da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:45.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0642000640 1 --2- 172.21.15.144:0/2883607254 >> v2:172.21.15.165:3300/0 conn(0x7f064415c2b0 0x7f064406da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0642000640 1 -- 172.21.15.144:0/2883607254 >> v1:172.21.15.144:6789/0 conn(0x7f064415c690 legacy=0x7f064415fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0642000640 1 -- 172.21.15.144:0/2883607254 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06440cd4c0 con 0x7f06440d0ee0 2024-09-12T12:22:45.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0641600640 1 -- 172.21.15.144:0/2883607254 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724533524 0 0) 0x7f064406e360 con 0x7f064415c690 2024-09-12T12:22:45.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.618+0000 7f0642000640 1 --2- 172.21.15.144:0/2883607254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06440d0ee0 0x7f06440cf1a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f06440b59c0 tx=0x7f063001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba16af49666b501 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:45.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0641600640 1 -- 172.21.15.144:0/2883607254 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300b1070 con 0x7f06440d0ee0 2024-09-12T12:22:45.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0641600640 1 -- 172.21.15.144:0/2883607254 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300ac640 con 0x7f06440d0ee0 2024-09-12T12:22:45.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0641600640 1 -- 172.21.15.144:0/2883607254 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300aca10 con 0x7f06440d0ee0 2024-09-12T12:22:45.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 -- 172.21.15.144:0/2883607254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06440d0ee0 msgr2=0x7f06440cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 --2- 172.21.15.144:0/2883607254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06440d0ee0 0x7f06440cf1a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f06440b59c0 tx=0x7f063001c480 comp rx=0 tx=0).stop 2024-09-12T12:22:45.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 -- 172.21.15.144:0/2883607254 shutdown_connections 2024-09-12T12:22:45.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 --2- 172.21.15.144:0/2883607254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06440d0ee0 0x7f06440cf1a0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 --2- 172.21.15.144:0/2883607254 >> v2:172.21.15.165:3300/0 conn(0x7f064415c2b0 0x7f064406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 -- 172.21.15.144:0/2883607254 >> 172.21.15.144:0/2883607254 conn(0x7f0644067e00 msgr2=0x7f06440d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:45.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 -- 172.21.15.144:0/2883607254 shutdown_connections 2024-09-12T12:22:45.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 -- 172.21.15.144:0/2883607254 wait complete. 2024-09-12T12:22:45.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 Processor -- start 2024-09-12T12:22:45.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 -- start start 2024-09-12T12:22:45.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06440d0ee0 0x7f06441529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f064415c2b0 0x7f0644149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f064415c690 0x7f0644166470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f06441693f0 con 0x7f064415c2b0 2024-09-12T12:22:45.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0644169270 con 0x7f064415c690 2024-09-12T12:22:45.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0649600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0644169570 con 0x7f06440d0ee0 2024-09-12T12:22:45.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0642000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f064415c2b0 0x7f0644149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0642000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f064415c2b0 0x7f0644149e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51644/0 (socket says 172.21.15.144:51644) 2024-09-12T12:22:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0642000640 1 -- 172.21.15.144:0/4098526625 learned_addr learned my addr 172.21.15.144:0/4098526625 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0643400640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f064415c690 0x7f0644166470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.622+0000 7f0642a00640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06440d0ee0 0x7f06441529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0642000640 1 -- 172.21.15.144:0/4098526625 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06440d0ee0 msgr2=0x7f06441529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0642000640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06440d0ee0 0x7f06441529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0642000640 1 -- 172.21.15.144:0/4098526625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f064415c690 msgr2=0x7f0644166470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0642000640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f064415c690 0x7f0644166470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0642000640 1 -- 172.21.15.144:0/4098526625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0644151900 con 0x7f064415c2b0 2024-09-12T12:22:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0642000640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f064415c2b0 0x7f0644149e80 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f06300af040 tx=0x7f063001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:45.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f063aa00640 1 -- 172.21.15.144:0/4098526625 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300bd070 con 0x7f064415c2b0 2024-09-12T12:22:45.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f063aa00640 1 -- 172.21.15.144:0/4098526625 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300b2040 con 0x7f064415c2b0 2024-09-12T12:22:45.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f063aa00640 1 -- 172.21.15.144:0/4098526625 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300b1050 con 0x7f064415c2b0 2024-09-12T12:22:45.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0644151be0 con 0x7f064415c2b0 2024-09-12T12:22:45.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06441521a0 con 0x7f064415c2b0 2024-09-12T12:22:45.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06440cf1a0 con 0x7f064415c2b0 2024-09-12T12:22:45.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f063aa00640 1 -- 172.21.15.144:0/4098526625 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0630004230 con 0x7f064415c2b0 2024-09-12T12:22:45.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f063aa00640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06240678c0 0x7f0624069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:45.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f063aa00640 1 -- 172.21.15.144:0/4098526625 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f063011f950 con 0x7f064415c2b0 2024-09-12T12:22:45.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.626+0000 7f0642a00640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06240678c0 0x7f0624069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:45.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.630+0000 7f0642a00640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06240678c0 0x7f0624069d80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f06340113e0 tx=0x7f063400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:45.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.630+0000 7f063aa00640 1 -- 172.21.15.144:0/4098526625 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0630016070 con 0x7f064415c2b0 2024-09-12T12:22:45.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.846+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f06440732e0 con 0x7f064415c2b0 2024-09-12T12:22:45.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.846+0000 7f063aa00640 1 -- 172.21.15.144:0/4098526625 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1643 (secure 0 0 0) 0x7f06300efc50 con 0x7f064415c2b0 2024-09-12T12:22:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:45.848 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":625,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076445466,"bytes_used":2583904256,"bytes_avail":770510209024,"bytes_total":773094113280,"write_bytes_sec":34144027,"read_op_per_sec":0,"write_op_per_sec":34},"fsmap":{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":8874}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-12T12:22:41.503973+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:22:45.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.846+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06240678c0 msgr2=0x7f0624069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.846+0000 7f0649600640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06240678c0 0x7f0624069d80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f06340113e0 tx=0x7f063400b040 comp rx=0 tx=0).stop 2024-09-12T12:22:45.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.846+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f064415c2b0 msgr2=0x7f0644149e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:45.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.846+0000 7f0649600640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f064415c2b0 0x7f0644149e80 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f06300af040 tx=0x7f063001acc0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.846+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 shutdown_connections 2024-09-12T12:22:45.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.850+0000 7f0649600640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f06240678c0 0x7f0624069d80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.850+0000 7f0649600640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f064415c690 0x7f0644166470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.850+0000 7f0649600640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f064415c2b0 0x7f0644149e80 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.850+0000 7f0649600640 1 --2- 172.21.15.144:0/4098526625 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06440d0ee0 0x7f06441529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:45.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.850+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 >> 172.21.15.144:0/4098526625 conn(0x7f0644067e00 msgr2=0x7f064406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:45.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.850+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 shutdown_connections 2024-09-12T12:22:45.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:45.850+0000 7f0649600640 1 -- 172.21.15.144:0/4098526625 wait complete. 2024-09-12T12:22:45.869 INFO:tasks.ceph.ceph_manager.ceph:{'b': 'paused'} 2024-09-12T12:22:46.399 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:22:46.403 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:22:46.870 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:47.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.014+0000 7f90bc800640 1 Processor -- start 2024-09-12T12:22:47.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.014+0000 7f90bc800640 1 -- start start 2024-09-12T12:22:47.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90bc800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f90b40b3590 0x7f90b415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90bc800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b40b3aa0 con 0x7f90b40b49e0 2024-09-12T12:22:47.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90bc800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b40afc10 con 0x7f90b415ad50 2024-09-12T12:22:47.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90bc800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f90b415f860 con 0x7f90b40b3590 2024-09-12T12:22:47.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90ba800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f90b40b3590 0x7f90b415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90b9400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f90b40b49e0 0x7f90b40b06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42960/0 (socket says 172.21.15.144:42960) 2024-09-12T12:22:47.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90b9400640 1 -- 172.21.15.144:0/3501392869 learned_addr learned my addr 172.21.15.144:0/3501392869 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:47.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90ba800640 1 -- 172.21.15.144:0/3501392869 >> v1:172.21.15.165:6789/0 conn(0x7f90b415ad50 legacy=0x7f90b40b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:47.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90ba800640 1 -- 172.21.15.144:0/3501392869 >> v1:172.21.15.144:6789/0 conn(0x7f90b40b49e0 legacy=0x7f90b40b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90b8a00640 1 -- 172.21.15.144:0/3501392869 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017587423 0 0) 0x7f90b40b3aa0 con 0x7f90b40b49e0 2024-09-12T12:22:47.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.018+0000 7f90ba800640 1 -- 172.21.15.144:0/3501392869 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b40afef0 con 0x7f90b40b3590 2024-09-12T12:22:47.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90ba800640 1 --2- 172.21.15.144:0/3501392869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b3590 0x7f90b415f320 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f90b00097c0 tx=0x7f90b001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97315b987625ea36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:47.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90b8a00640 1 -- 172.21.15.144:0/3501392869 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b00b0070 con 0x7f90b40b3590 2024-09-12T12:22:47.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90b8a00640 1 -- 172.21.15.144:0/3501392869 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b00ab600 con 0x7f90b40b3590 2024-09-12T12:22:47.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90b8a00640 1 -- 172.21.15.144:0/3501392869 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b00ab9d0 con 0x7f90b40b3590 2024-09-12T12:22:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 -- 172.21.15.144:0/3501392869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b3590 msgr2=0x7f90b415f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 --2- 172.21.15.144:0/3501392869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b3590 0x7f90b415f320 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f90b00097c0 tx=0x7f90b001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 -- 172.21.15.144:0/3501392869 shutdown_connections 2024-09-12T12:22:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 --2- 172.21.15.144:0/3501392869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b3590 0x7f90b415f320 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 -- 172.21.15.144:0/3501392869 >> 172.21.15.144:0/3501392869 conn(0x7f90b406d0d0 msgr2=0x7f90b406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 -- 172.21.15.144:0/3501392869 shutdown_connections 2024-09-12T12:22:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 -- 172.21.15.144:0/3501392869 wait complete. 2024-09-12T12:22:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 Processor -- start 2024-09-12T12:22:47.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 -- start start 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b40b3590 0x7f90b41463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b49e0 0x7f90b4158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b415ad50 0x7f90b40d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f90b40b1250 con 0x7f90b40b49e0 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f90b40b10d0 con 0x7f90b415ad50 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.022+0000 7f90bc800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90b40b13d0 con 0x7f90b40b3590 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b49e0 0x7f90b4158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b49e0 0x7f90b4158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51674/0 (socket says 172.21.15.144:51674) 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9400640 1 -- 172.21.15.144:0/1910649450 learned_addr learned my addr 172.21.15.144:0/1910649450 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9e00640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b40b3590 0x7f90b41463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90ba800640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b415ad50 0x7f90b40d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9400640 1 -- 172.21.15.144:0/1910649450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b40b3590 msgr2=0x7f90b41463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9400640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b40b3590 0x7f90b41463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9400640 1 -- 172.21.15.144:0/1910649450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b415ad50 msgr2=0x7f90b40d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9400640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b415ad50 0x7f90b40d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9400640 1 -- 172.21.15.144:0/1910649450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b4158dd0 con 0x7f90b40b49e0 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90b9400640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b49e0 0x7f90b4158350 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f90a400c4d0 tx=0x7f90a400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90ae000640 1 -- 172.21.15.144:0/1910649450 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4018070 con 0x7f90b40b49e0 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90ae000640 1 -- 172.21.15.144:0/1910649450 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a40074e0 con 0x7f90b40b49e0 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b41590b0 con 0x7f90b40b49e0 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90ae000640 1 -- 172.21.15.144:0/1910649450 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4004a30 con 0x7f90b40b49e0 2024-09-12T12:22:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b4159670 con 0x7f90b40b49e0 2024-09-12T12:22:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b40b1790 con 0x7f90b40b49e0 2024-09-12T12:22:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90ae000640 1 -- 172.21.15.144:0/1910649450 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f90a401b070 con 0x7f90b40b49e0 2024-09-12T12:22:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.026+0000 7f90ae000640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90980678c0 0x7f9098069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.030+0000 7f90ae000640 1 -- 172.21.15.144:0/1910649450 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f90a4085180 con 0x7f90b40b49e0 2024-09-12T12:22:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.030+0000 7f90b9e00640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90980678c0 0x7f9098069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.030+0000 7f90b9e00640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90980678c0 0x7f9098069d80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f90b415a770 tx=0x7f90a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:47.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.034+0000 7f90ae000640 1 -- 172.21.15.144:0/1910649450 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f90a4055ae0 con 0x7f90b40b49e0 2024-09-12T12:22:47.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90b41575c0 con 0x7f90b40b49e0 2024-09-12T12:22:47.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90ae000640 1 -- 172.21.15.144:0/1910649450 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7f90a40553e0 con 0x7f90b40b49e0 2024-09-12T12:22:47.224 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:47.224 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:47.224 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:47.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90980678c0 msgr2=0x7f9098069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90980678c0 0x7f9098069d80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f90b415a770 tx=0x7f90a8009040 comp rx=0 tx=0).stop 2024-09-12T12:22:47.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b49e0 msgr2=0x7f90b4158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b49e0 0x7f90b4158350 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f90a400c4d0 tx=0x7f90a400c990 comp rx=0 tx=0).stop 2024-09-12T12:22:47.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 shutdown_connections 2024-09-12T12:22:47.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90980678c0 0x7f9098069d80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b415ad50 0x7f90b40d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b40b49e0 0x7f90b4158350 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 --2- 172.21.15.144:0/1910649450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b40b3590 0x7f90b41463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 >> 172.21.15.144:0/1910649450 conn(0x7f90b406d0d0 msgr2=0x7f90b4157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:47.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 shutdown_connections 2024-09-12T12:22:47.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.222+0000 7f90bc800640 1 -- 172.21.15.144:0/1910649450 wait complete. 2024-09-12T12:22:47.246 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2024-09-12T12:22:47.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:22:47.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c8e00640 1 Processor -- start 2024-09-12T12:22:47.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c8e00640 1 -- start start 2024-09-12T12:22:47.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c8e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe5c4159f00 0x7fe5c406f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c8e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe5c40d0910 0x7fe5c4073240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c8e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c415cd60 con 0x7fe5c40d2880 2024-09-12T12:22:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c8e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe5c415d040 con 0x7fe5c4159f00 2024-09-12T12:22:47.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c8e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe5c415d320 con 0x7fe5c40d0910 2024-09-12T12:22:47.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe5c4159f00 0x7fe5c406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe5c40d2880 0x7fe5c40d0200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44018/0 (socket says 172.21.15.144:44018) 2024-09-12T12:22:47.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c2a00640 1 -- 172.21.15.144:0/2461248487 learned_addr learned my addr 172.21.15.144:0/2461248487 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:47.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c3e00640 1 --2- 172.21.15.144:0/2461248487 >> v2:172.21.15.165:3300/0 conn(0x7fe5c40d0910 0x7fe5c4073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c3400640 1 -- 172.21.15.144:0/2461248487 >> v2:172.21.15.165:3300/0 conn(0x7fe5c40d0910 msgr2=0x7fe5c4073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:47.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c3400640 1 --2- 172.21.15.144:0/2461248487 >> v2:172.21.15.165:3300/0 conn(0x7fe5c40d0910 0x7fe5c4073240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c3400640 1 -- 172.21.15.144:0/2461248487 >> v1:172.21.15.144:6789/0 conn(0x7fe5c40d2880 legacy=0x7fe5c40d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c3400640 1 -- 172.21.15.144:0/2461248487 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c415d600 con 0x7fe5c4159f00 2024-09-12T12:22:47.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.382+0000 7fe5c2000640 1 -- 172.21.15.144:0/2461248487 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564342536 0 0) 0x7fe5c415cd60 con 0x7fe5c40d2880 2024-09-12T12:22:47.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c3400640 1 --2- 172.21.15.144:0/2461248487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 0x7fe5c406f140 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4068660 tx=0x7fe5b401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f805b13b9b5a7e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:47.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c2000640 1 -- 172.21.15.144:0/2461248487 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40b5070 con 0x7fe5c4159f00 2024-09-12T12:22:47.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c2000640 1 -- 172.21.15.144:0/2461248487 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b40a8970 con 0x7fe5c4159f00 2024-09-12T12:22:47.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c2000640 1 -- 172.21.15.144:0/2461248487 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40a8d40 con 0x7fe5c4159f00 2024-09-12T12:22:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c8e00640 1 -- 172.21.15.144:0/2461248487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 msgr2=0x7fe5c406f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c8e00640 1 --2- 172.21.15.144:0/2461248487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 0x7fe5c406f140 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4068660 tx=0x7fe5b401ec70 comp rx=0 tx=0).stop 2024-09-12T12:22:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c8e00640 1 -- 172.21.15.144:0/2461248487 shutdown_connections 2024-09-12T12:22:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c8e00640 1 --2- 172.21.15.144:0/2461248487 >> v2:172.21.15.165:3300/0 conn(0x7fe5c40d0910 0x7fe5c4073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c8e00640 1 --2- 172.21.15.144:0/2461248487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 0x7fe5c406f140 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c8e00640 1 -- 172.21.15.144:0/2461248487 >> 172.21.15.144:0/2461248487 conn(0x7fe5c4067a00 msgr2=0x7fe5c4067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:47.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c8e00640 1 -- 172.21.15.144:0/2461248487 shutdown_connections 2024-09-12T12:22:47.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c8e00640 1 -- 172.21.15.144:0/2461248487 wait complete. 2024-09-12T12:22:47.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.386+0000 7fe5c8e00640 1 Processor -- start 2024-09-12T12:22:47.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 -- start start 2024-09-12T12:22:47.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5c40d0910 0x7fe5c406db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5c40d2880 0x7fe5c406e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 0x7fe5c41f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c415a2e0 con 0x7fe5c4159f00 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c415d8e0 con 0x7fe5c40d0910 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c415a460 con 0x7fe5c40d2880 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 0x7fe5c41f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5c40d0910 0x7fe5c406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5c40d0910 0x7fe5c406db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43962/0 (socket says 172.21.15.144:43962) 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3400640 1 -- 172.21.15.144:0/3768526900 learned_addr learned my addr 172.21.15.144:0/3768526900 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 0x7fe5c41f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44428/0 (socket says 172.21.15.144:44428) 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c2a00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5c40d2880 0x7fe5c406e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3e00640 1 -- 172.21.15.144:0/3768526900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5c40d2880 msgr2=0x7fe5c406e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3e00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5c40d2880 0x7fe5c406e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3e00640 1 -- 172.21.15.144:0/3768526900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5c40d0910 msgr2=0x7fe5c406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3e00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5c40d0910 0x7fe5c406db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3e00640 1 -- 172.21.15.144:0/3768526900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c41f4e00 con 0x7fe5c4159f00 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c3e00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 0x7fe5c41f3ba0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc007d90 tx=0x7fe5bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5bb400640 1 -- 172.21.15.144:0/3768526900 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc00edd0 con 0x7fe5c4159f00 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5bb400640 1 -- 172.21.15.144:0/3768526900 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5bc0039a0 con 0x7fe5c4159f00 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5bb400640 1 -- 172.21.15.144:0/3768526900 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc003d90 con 0x7fe5c4159f00 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c41f17e0 con 0x7fe5c4159f00 2024-09-12T12:22:47.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c41f5350 con 0x7fe5c4159f00 2024-09-12T12:22:47.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.390+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c415c9c0 con 0x7fe5c4159f00 2024-09-12T12:22:47.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.394+0000 7fe5bb400640 1 -- 172.21.15.144:0/3768526900 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5bc01b020 con 0x7fe5c4159f00 2024-09-12T12:22:47.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.394+0000 7fe5bb400640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5a40678c0 0x7fe5a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:47.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.394+0000 7fe5bb400640 1 -- 172.21.15.144:0/3768526900 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fe5bc085ee0 con 0x7fe5c4159f00 2024-09-12T12:22:47.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.394+0000 7fe5c3400640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5a40678c0 0x7fe5a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:47.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.394+0000 7fe5c3400640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5a40678c0 0x7fe5a4069d80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4000c10 tx=0x7fe5b40aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.398+0000 7fe5bb400640 1 -- 172.21.15.144:0/3768526900 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe5c41f17e0 con 0x7fe5c4159f00 2024-09-12T12:22:47.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.614+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe5c40b68f0 con 0x7fe5c4159f00 2024-09-12T12:22:47.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5bb400640 1 -- 172.21.15.144:0/3768526900 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7fe5bc0561e0 con 0x7fe5c4159f00 2024-09-12T12:22:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:47.619 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":627,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076449691,"bytes_used":2584477696,"bytes_avail":770509635584,"bytes_total":773094113280,"write_bytes_sec":34146814,"read_op_per_sec":0,"write_op_per_sec":34},"fsmap":{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":8874}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-12T12:22:45.504854+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5a40678c0 msgr2=0x7fe5a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5a40678c0 0x7fe5a4069d80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4000c10 tx=0x7fe5b40aa070 comp rx=0 tx=0).stop 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 msgr2=0x7fe5c41f3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 0x7fe5c41f3ba0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc007d90 tx=0x7fe5bc00e4b0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 shutdown_connections 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5a40678c0 0x7fe5a4069d80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5c4159f00 0x7fe5c41f3ba0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5c40d2880 0x7fe5c406e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 --2- 172.21.15.144:0/3768526900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5c40d0910 0x7fe5c406db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:47.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 >> 172.21.15.144:0/3768526900 conn(0x7fe5c4067a00 msgr2=0x7fe5c40d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:47.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 shutdown_connections 2024-09-12T12:22:47.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:47.618+0000 7fe5c8e00640 1 -- 172.21.15.144:0/3768526900 wait complete. 2024-09-12T12:22:47.641 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:22:47.641 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:22:47.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:22:47.741 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:22:47.828 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:22:47.828 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:22:47.829 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:22:47.829 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:47.839 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:22:47.839 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:47.890 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:22:48.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa59a600640 1 Processor -- start 2024-09-12T12:22:48.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa59a600640 1 -- start start 2024-09-12T12:22:48.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa59a600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa594071420 0x7fa594071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:48.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa59a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5940b45a0 con 0x7fa59415b4e0 2024-09-12T12:22:48.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa59a600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5940b3fe0 con 0x7fa5940ccf30 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa59a600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa5940b42c0 con 0x7fa594071420 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa59415b4e0 0x7fa5940b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44020/0 (socket says 172.21.15.144:44020) 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593400640 1 -- 172.21.15.144:0/1420907527 learned_addr learned my addr 172.21.15.144:0/1420907527 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592a00640 1 --2- 172.21.15.144:0/1420907527 >> v2:172.21.15.165:3300/0 conn(0x7fa594071420 0x7fa594071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5641419 0 0) 0x7fa5940b45a0 con 0x7fa59415b4e0 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa578003530 con 0x7fa59415b4e0 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 158121682 0 0) 0x7fa578003530 con 0x7fa59415b4e0 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 >> v2:172.21.15.165:3300/0 conn(0x7fa594071420 msgr2=0x7fa594071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 --2- 172.21.15.144:0/1420907527 >> v2:172.21.15.165:3300/0 conn(0x7fa594071420 0x7fa594071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 >> v1:172.21.15.165:6789/0 conn(0x7fa5940ccf30 legacy=0x7fa5940cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5940b1490 con 0x7fa59415b4e0 2024-09-12T12:22:48.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fa584001680 con 0x7fa59415b4e0 2024-09-12T12:22:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 >> v1:172.21.15.144:6789/0 conn(0x7fa59415b4e0 legacy=0x7fa5940b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5780039c0 0x7fa578003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa578004810 0x7fa578004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780051d0 0x7fa57800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5940b42c0 con 0x7fa5780039c0 2024-09-12T12:22:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa57800c070 con 0x7fa578004810 2024-09-12T12:22:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa57800c270 con 0x7fa5780051d0 2024-09-12T12:22:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593400640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5780039c0 0x7fa578003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:48.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa592a00640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa578004810 0x7fa578004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:48.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593e00640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780051d0 0x7fa57800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:48.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593400640 1 -- 172.21.15.144:0/1420907527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780051d0 msgr2=0x7fa57800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:48.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593400640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780051d0 0x7fa57800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593400640 1 -- 172.21.15.144:0/1420907527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa578004810 msgr2=0x7fa578004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:48.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593400640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa578004810 0x7fa578004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593400640 1 -- 172.21.15.144:0/1420907527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa578003530 con 0x7fa5780039c0 2024-09-12T12:22:48.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.074+0000 7fa593e00640 1 -- 172.21.15.144:0/1420907527 reap_dead start 2024-09-12T12:22:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa593400640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5780039c0 0x7fa578003de0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fa58400c1c0 tx=0x7fa58401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35969cdb8fd02fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584007d00 con 0x7fa5780039c0 2024-09-12T12:22:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5840a9020 con 0x7fa5780039c0 2024-09-12T12:22:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa592000640 1 -- 172.21.15.144:0/1420907527 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584005ae0 con 0x7fa5780039c0 2024-09-12T12:22:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa59a600640 1 -- 172.21.15.144:0/1420907527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5780039c0 msgr2=0x7fa578003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa59a600640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5780039c0 0x7fa578003de0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fa58400c1c0 tx=0x7fa58401cc30 comp rx=0 tx=0).stop 2024-09-12T12:22:48.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa59a600640 1 -- 172.21.15.144:0/1420907527 shutdown_connections 2024-09-12T12:22:48.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa59a600640 1 --2- 172.21.15.144:0/1420907527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5780039c0 0x7fa578003de0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa59a600640 1 -- 172.21.15.144:0/1420907527 >> 172.21.15.144:0/1420907527 conn(0x7fa59406d0d0 msgr2=0x7fa59406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:48.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa59a600640 1 -- 172.21.15.144:0/1420907527 shutdown_connections 2024-09-12T12:22:48.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.078+0000 7fa59a600640 1 -- 172.21.15.144:0/1420907527 wait complete. 2024-09-12T12:22:48.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 Processor -- start 2024-09-12T12:22:48.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 -- start start 2024-09-12T12:22:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780039c0 0x7fa5941ec3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5941eb4e0 0x7fa5941ea150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5941eb960 0x7fa5941561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5940cd720 con 0x7fa5941eb960 2024-09-12T12:22:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa5940b3da0 con 0x7fa5941eb4e0 2024-09-12T12:22:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5940cd8a0 con 0x7fa5780039c0 2024-09-12T12:22:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5941eb960 0x7fa5941561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:48.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5941eb960 0x7fa5941561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44436/0 (socket says 172.21.15.144:44436) 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593e00640 1 -- 172.21.15.144:0/2511929594 learned_addr learned my addr 172.21.15.144:0/2511929594 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593400640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780039c0 0x7fa5941ec3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa592a00640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5941eb4e0 0x7fa5941ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593e00640 1 -- 172.21.15.144:0/2511929594 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780039c0 msgr2=0x7fa5941ec3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593e00640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780039c0 0x7fa5941ec3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593e00640 1 -- 172.21.15.144:0/2511929594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5941eb4e0 msgr2=0x7fa5941ea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593e00640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5941eb4e0 0x7fa5941ea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593e00640 1 -- 172.21.15.144:0/2511929594 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5941eac10 con 0x7fa5941eb960 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa592a00640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5941eb4e0 0x7fa5941ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa593e00640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5941eb960 0x7fa5941561d0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fa5940b6500 tx=0x7fa58c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa58b400640 1 -- 172.21.15.144:0/2511929594 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c003980 con 0x7fa5941eb960 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa58b400640 1 -- 172.21.15.144:0/2511929594 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58c018070 con 0x7fa5941eb960 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa58b400640 1 -- 172.21.15.144:0/2511929594 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c003d60 con 0x7fa5941eb960 2024-09-12T12:22:48.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5941eaef0 con 0x7fa5941eb960 2024-09-12T12:22:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.082+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5941ec900 con 0x7fa5941eb960 2024-09-12T12:22:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.086+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5940d15d0 con 0x7fa5941eb960 2024-09-12T12:22:48.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.086+0000 7fa58b400640 1 -- 172.21.15.144:0/2511929594 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa58c0050d0 con 0x7fa5941eb960 2024-09-12T12:22:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.086+0000 7fa58b400640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5740678f0 0x7fa574069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.086+0000 7fa58b400640 1 -- 172.21.15.144:0/2511929594 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fa58c085a00 con 0x7fa5941eb960 2024-09-12T12:22:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.086+0000 7fa593400640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5740678f0 0x7fa574069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:48.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.086+0000 7fa593400640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5740678f0 0x7fa574069db0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa5840aa000 tx=0x7fa5940b41b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:48.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.090+0000 7fa58b400640 1 -- 172.21.15.144:0/2511929594 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa58c056350 con 0x7fa5941eb960 2024-09-12T12:22:48.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.258+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa5940b45a0 con 0x7fa5941eb960 2024-09-12T12:22:48.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa58b400640 1 -- 172.21.15.144:0/2511929594 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v154) ==== 80+0+0 (secure 0 0 0) 0x7fa58c055c50 con 0x7fa5941eb960 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5740678f0 msgr2=0x7fa574069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5740678f0 0x7fa574069db0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa5840aa000 tx=0x7fa5940b41b0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5941eb960 msgr2=0x7fa5941561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5941eb960 0x7fa5941561d0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fa5940b6500 tx=0x7fa58c00ec10 comp rx=0 tx=0).stop 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 shutdown_connections 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5740678f0 0x7fa574069db0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5941eb960 0x7fa5941561d0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5941eb4e0 0x7fa5941ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 --2- 172.21.15.144:0/2511929594 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5780039c0 0x7fa5941ec3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:48.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 >> 172.21.15.144:0/2511929594 conn(0x7fa59406d0d0 msgr2=0x7fa594151140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:48.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 shutdown_connections 2024-09-12T12:22:48.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:48.262+0000 7fa59a600640 1 -- 172.21.15.144:0/2511929594 wait complete. 2024-09-12T12:22:48.411 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:22:48.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:48.411 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:22:49.164 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:22:49.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:22:49.164 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:22:49.177 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:22:49.177 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:22:49.177 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:49.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:22:49.186 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:22:49.187 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:22:49.187 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:49.234 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:22:49.234 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:22:49.234 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:22:49.234 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:49.242 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:22:49.242 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:49.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d3200640 1 Processor -- start 2024-09-12T12:22:49.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d3200640 1 -- start start 2024-09-12T12:22:49.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1cc15b1a0 0x7fb1cc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc067c10 0x7fb1cc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc0b2480 con 0x7fb1cc15cdb0 2024-09-12T12:22:49.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb1cc06fc60 con 0x7fb1cc15b1a0 2024-09-12T12:22:49.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc15b580 con 0x7fb1cc067c10 2024-09-12T12:22:49.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1cc15b1a0 0x7fb1cc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb1cc15cdb0 0x7fb1cc15d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44024/0 (socket says 172.21.15.144:44024) 2024-09-12T12:22:49.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1cc15b1a0 0x7fb1cc06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44450/0 (socket says 172.21.15.144:44450) 2024-09-12T12:22:49.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d2800640 1 -- 172.21.15.144:0/612383730 learned_addr learned my addr 172.21.15.144:0/612383730 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:49.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.414+0000 7fb1d1400640 1 --2- 172.21.15.144:0/612383730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc067c10 0x7fb1cc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d1e00640 1 -- 172.21.15.144:0/612383730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc067c10 msgr2=0x7fb1cc06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:49.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d1e00640 1 --2- 172.21.15.144:0/612383730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc067c10 0x7fb1cc06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d1e00640 1 -- 172.21.15.144:0/612383730 >> v1:172.21.15.144:6789/0 conn(0x7fb1cc15cdb0 legacy=0x7fb1cc15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d1e00640 1 -- 172.21.15.144:0/612383730 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc15c2d0 con 0x7fb1cc15b1a0 2024-09-12T12:22:49.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d1e00640 1 --2- 172.21.15.144:0/612383730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc15b1a0 0x7fb1cc06bc10 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00097c0 tx=0x7fb1c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751ba75b80a3f351 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:49.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d0a00640 1 -- 172.21.15.144:0/612383730 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00b0070 con 0x7fb1cc15b1a0 2024-09-12T12:22:49.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d0a00640 1 -- 172.21.15.144:0/612383730 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c00ab600 con 0x7fb1cc15b1a0 2024-09-12T12:22:49.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d0a00640 1 -- 172.21.15.144:0/612383730 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00ab9d0 con 0x7fb1cc15b1a0 2024-09-12T12:22:49.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d3200640 1 -- 172.21.15.144:0/612383730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc15b1a0 msgr2=0x7fb1cc06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d3200640 1 --2- 172.21.15.144:0/612383730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc15b1a0 0x7fb1cc06bc10 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00097c0 tx=0x7fb1c001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d3200640 1 -- 172.21.15.144:0/612383730 shutdown_connections 2024-09-12T12:22:49.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d3200640 1 --2- 172.21.15.144:0/612383730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc067c10 0x7fb1cc06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d3200640 1 --2- 172.21.15.144:0/612383730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc15b1a0 0x7fb1cc06bc10 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d3200640 1 -- 172.21.15.144:0/612383730 >> 172.21.15.144:0/612383730 conn(0x7fb1cc0b1710 msgr2=0x7fb1cc0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:49.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d3200640 1 -- 172.21.15.144:0/612383730 shutdown_connections 2024-09-12T12:22:49.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.418+0000 7fb1d3200640 1 -- 172.21.15.144:0/612383730 wait complete. 2024-09-12T12:22:49.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d3200640 1 Processor -- start 2024-09-12T12:22:49.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d3200640 1 -- start start 2024-09-12T12:22:49.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc067c10 0x7fb1cc159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1cc15b1a0 0x7fb1cc151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc15cdb0 0x7fb1cc1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc167e80 con 0x7fb1cc067c10 2024-09-12T12:22:49.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc15c920 con 0x7fb1cc15b1a0 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc168000 con 0x7fb1cc15cdb0 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc067c10 0x7fb1cc159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc067c10 0x7fb1cc159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44454/0 (socket says 172.21.15.144:44454) 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1e00640 1 -- 172.21.15.144:0/1794479481 learned_addr learned my addr 172.21.15.144:0/1794479481 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d2800640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc15cdb0 0x7fb1cc1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1400640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1cc15b1a0 0x7fb1cc151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1e00640 1 -- 172.21.15.144:0/1794479481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc15cdb0 msgr2=0x7fb1cc1490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1e00640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc15cdb0 0x7fb1cc1490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1e00640 1 -- 172.21.15.144:0/1794479481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1cc15b1a0 msgr2=0x7fb1cc151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1e00640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1cc15b1a0 0x7fb1cc151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1e00640 1 -- 172.21.15.144:0/1794479481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc0af3d0 con 0x7fb1cc067c10 2024-09-12T12:22:49.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d1e00640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc067c10 0x7fb1cc159f70 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00097c0 tx=0x7fb1c0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:49.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1c6000640 1 -- 172.21.15.144:0/1794479481 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00b0040 con 0x7fb1cc067c10 2024-09-12T12:22:49.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1c6000640 1 -- 172.21.15.144:0/1794479481 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c00b9070 con 0x7fb1cc067c10 2024-09-12T12:22:49.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1c6000640 1 -- 172.21.15.144:0/1794479481 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00aa9f0 con 0x7fb1cc067c10 2024-09-12T12:22:49.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.422+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1cc0af670 con 0x7fb1cc067c10 2024-09-12T12:22:49.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.426+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1cc0afc30 con 0x7fb1cc067c10 2024-09-12T12:22:49.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.426+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1cc15d260 con 0x7fb1cc067c10 2024-09-12T12:22:49.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.426+0000 7fb1c6000640 1 -- 172.21.15.144:0/1794479481 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1c00aab90 con 0x7fb1cc067c10 2024-09-12T12:22:49.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.426+0000 7fb1c6000640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1b00678c0 0x7fb1b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.426+0000 7fb1c6000640 1 -- 172.21.15.144:0/1794479481 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fb1c011fe20 con 0x7fb1cc067c10 2024-09-12T12:22:49.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.426+0000 7fb1d1400640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1b00678c0 0x7fb1b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.426+0000 7fb1d1400640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1b00678c0 0x7fb1b0069d80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0b0460 tx=0x7fb1bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:49.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.430+0000 7fb1c6000640 1 -- 172.21.15.144:0/1794479481 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb1c0016090 con 0x7fb1cc067c10 2024-09-12T12:22:49.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.622+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1cc0747b0 con 0x7fb1cc067c10 2024-09-12T12:22:49.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.622+0000 7fb1c6000640 1 -- 172.21.15.144:0/1794479481 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7fb1c00f0120 con 0x7fb1cc067c10 2024-09-12T12:22:49.625 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:49.625 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:49.626 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1b00678c0 msgr2=0x7fb1b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1b00678c0 0x7fb1b0069d80 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0b0460 tx=0x7fb1bc008040 comp rx=0 tx=0).stop 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc067c10 msgr2=0x7fb1cc159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc067c10 0x7fb1cc159f70 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00097c0 tx=0x7fb1c0019240 comp rx=0 tx=0).stop 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 shutdown_connections 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1b00678c0 0x7fb1b0069d80 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1cc15cdb0 0x7fb1cc1490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1cc15b1a0 0x7fb1cc151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 --2- 172.21.15.144:0/1794479481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1cc067c10 0x7fb1cc159f70 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 >> 172.21.15.144:0/1794479481 conn(0x7fb1cc0b1710 msgr2=0x7fb1cc0b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 shutdown_connections 2024-09-12T12:22:49.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.626+0000 7fb1d3200640 1 -- 172.21.15.144:0/1794479481 wait complete. 2024-09-12T12:22:49.647 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f76400640 1 Processor -- start 2024-09-12T12:22:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f76400640 1 -- start start 2024-09-12T12:22:49.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f76400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f7015cd30 0x7f7f700b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f76400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f700b61e0 con 0x7f7f700b5de0 2024-09-12T12:22:49.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f76400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f700cd870 con 0x7f7f7015c7b0 2024-09-12T12:22:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f76400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7f70072a50 con 0x7f7f7015cd30 2024-09-12T12:22:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f6fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7f700b5de0 0x7f7f70072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44032/0 (socket says 172.21.15.144:44032) 2024-09-12T12:22:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f6fe00640 1 -- 172.21.15.144:0/785439259 learned_addr learned my addr 172.21.15.144:0/785439259 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f6ea00640 1 --2- 172.21.15.144:0/785439259 >> v2:172.21.15.144:3300/0 conn(0x7f7f7015cd30 0x7f7f700b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f6ea00640 1 -- 172.21.15.144:0/785439259 >> v1:172.21.15.165:6789/0 conn(0x7f7f7015c7b0 legacy=0x7f7f700ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f6e000640 1 -- 172.21.15.144:0/785439259 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483145260 0 0) 0x7f7f700cd870 con 0x7f7f7015c7b0 2024-09-12T12:22:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f6ea00640 1 -- 172.21.15.144:0/785439259 >> v1:172.21.15.144:6789/0 conn(0x7f7f700b5de0 legacy=0x7f7f70072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.782+0000 7f7f6ea00640 1 -- 172.21.15.144:0/785439259 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f700cdb50 con 0x7f7f7015cd30 2024-09-12T12:22:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f6ea00640 1 --2- 172.21.15.144:0/785439259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 0x7f7f700b58a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0097c0 tx=0x7f7f5c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825865106946b7de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f6e000640 1 -- 172.21.15.144:0/785439259 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0b0070 con 0x7f7f7015cd30 2024-09-12T12:22:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f6e000640 1 -- 172.21.15.144:0/785439259 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c0ab600 con 0x7f7f7015cd30 2024-09-12T12:22:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f6e000640 1 -- 172.21.15.144:0/785439259 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0ab9d0 con 0x7f7f7015cd30 2024-09-12T12:22:49.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f76400640 1 -- 172.21.15.144:0/785439259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 msgr2=0x7f7f700b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f76400640 1 --2- 172.21.15.144:0/785439259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 0x7f7f700b58a0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0097c0 tx=0x7f7f5c01c330 comp rx=0 tx=0).stop 2024-09-12T12:22:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f76400640 1 -- 172.21.15.144:0/785439259 shutdown_connections 2024-09-12T12:22:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f76400640 1 --2- 172.21.15.144:0/785439259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 0x7f7f700b58a0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f76400640 1 -- 172.21.15.144:0/785439259 >> 172.21.15.144:0/785439259 conn(0x7f7f7006d0d0 msgr2=0x7f7f7006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f76400640 1 -- 172.21.15.144:0/785439259 shutdown_connections 2024-09-12T12:22:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.786+0000 7f7f76400640 1 -- 172.21.15.144:0/785439259 wait complete. 2024-09-12T12:22:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 Processor -- start 2024-09-12T12:22:49.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 -- start start 2024-09-12T12:22:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f700b5de0 0x7f7f70151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f7015c7b0 0x7f7f70153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 0x7f7f70146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700cd610 con 0x7f7f7015cd30 2024-09-12T12:22:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7f700cde30 con 0x7f7f7015c7b0 2024-09-12T12:22:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7f700735f0 con 0x7f7f700b5de0 2024-09-12T12:22:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 0x7f7f70146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6ea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f7015c7b0 0x7f7f70153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 0x7f7f70146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44482/0 (socket says 172.21.15.144:44482) 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6fe00640 1 -- 172.21.15.144:0/3973086366 learned_addr learned my addr 172.21.15.144:0/3973086366 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6f400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f700b5de0 0x7f7f70151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6fe00640 1 -- 172.21.15.144:0/3973086366 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f700b5de0 msgr2=0x7f7f70151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6fe00640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f700b5de0 0x7f7f70151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6fe00640 1 -- 172.21.15.144:0/3973086366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f7015c7b0 msgr2=0x7f7f70153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6fe00640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f7015c7b0 0x7f7f70153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6fe00640 1 -- 172.21.15.144:0/3973086366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f701545c0 con 0x7f7f7015cd30 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6ea00640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f7015c7b0 0x7f7f70153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f6fe00640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 0x7f7f70146930 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009ee0 tx=0x7f7f6800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f67400640 1 -- 172.21.15.144:0/3973086366 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68019070 con 0x7f7f7015cd30 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f67400640 1 -- 172.21.15.144:0/3973086366 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f680078f0 con 0x7f7f7015cd30 2024-09-12T12:22:49.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f67400640 1 -- 172.21.15.144:0/3973086366 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68007ca0 con 0x7f7f7015cd30 2024-09-12T12:22:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7015de20 con 0x7f7f7015cd30 2024-09-12T12:22:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7015e3e0 con 0x7f7f7015cd30 2024-09-12T12:22:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.790+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f701582c0 con 0x7f7f7015cd30 2024-09-12T12:22:49.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.794+0000 7f7f67400640 1 -- 172.21.15.144:0/3973086366 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f6801c070 con 0x7f7f7015cd30 2024-09-12T12:22:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.794+0000 7f7f67400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f500678c0 0x7f7f50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.794+0000 7f7f67400640 1 -- 172.21.15.144:0/3973086366 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f7f68087b80 con 0x7f7f7015cd30 2024-09-12T12:22:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.794+0000 7f7f6f400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f500678c0 0x7f7f50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:49.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.794+0000 7f7f6f400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f500678c0 0x7f7f50069d80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7f600012f0 tx=0x7f7f60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:49.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.798+0000 7f7f67400640 1 -- 172.21.15.144:0/3973086366 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7f68057e80 con 0x7f7f7015cd30 2024-09-12T12:22:49.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f70157fe0 con 0x7f7f7015cd30 2024-09-12T12:22:49.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f67400640 1 -- 172.21.15.144:0/3973086366 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7f7f6805c180 con 0x7f7f7015cd30 2024-09-12T12:22:49.991 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:49.991 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:49.992 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:49.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f500678c0 msgr2=0x7f7f50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f500678c0 0x7f7f50069d80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7f600012f0 tx=0x7f7f60009040 comp rx=0 tx=0).stop 2024-09-12T12:22:49.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 msgr2=0x7f7f70146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:49.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 0x7f7f70146930 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009ee0 tx=0x7f7f6800c430 comp rx=0 tx=0).stop 2024-09-12T12:22:49.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 shutdown_connections 2024-09-12T12:22:49.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f500678c0 0x7f7f50069d80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f7015cd30 0x7f7f70146930 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f7015c7b0 0x7f7f70153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 --2- 172.21.15.144:0/3973086366 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f700b5de0 0x7f7f70151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:49.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 >> 172.21.15.144:0/3973086366 conn(0x7f7f7006d0d0 msgr2=0x7f7f700b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:49.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 shutdown_connections 2024-09-12T12:22:49.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:49.990+0000 7f7f76400640 1 -- 172.21.15.144:0/3973086366 wait complete. 2024-09-12T12:22:50.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:22:50.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.154+0000 7fa5e9400640 1 Processor -- start 2024-09-12T12:22:50.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.154+0000 7fa5e9400640 1 -- start start 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5e4071420 0x7fa5e4071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e40ccf30 0x7fa5e40cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e9400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5e40b45a0 con 0x7fa5e415b4e0 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e9400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e40cd8e0 con 0x7fa5e4071420 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e9400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e40b3fe0 con 0x7fa5e40ccf30 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5e4071420 0x7fa5e4071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa5e415b4e0 0x7fa5e40b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44040/0 (socket says 172.21.15.144:44040) 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e2800640 1 -- 172.21.15.144:0/1657954806 learned_addr learned my addr 172.21.15.144:0/1657954806 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e3200640 1 --2- 172.21.15.144:0/1657954806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e40ccf30 0x7fa5e40cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e1e00640 1 -- 172.21.15.144:0/1657954806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e40ccf30 msgr2=0x7fa5e40cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:50.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e1e00640 1 --2- 172.21.15.144:0/1657954806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e40ccf30 0x7fa5e40cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e1e00640 1 -- 172.21.15.144:0/1657954806 >> v1:172.21.15.144:6789/0 conn(0x7fa5e415b4e0 legacy=0x7fa5e40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e1e00640 1 -- 172.21.15.144:0/1657954806 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e40b42c0 con 0x7fa5e4071420 2024-09-12T12:22:50.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e1400640 1 -- 172.21.15.144:0/1657954806 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116431955 0 0) 0x7fa5e40b45a0 con 0x7fa5e415b4e0 2024-09-12T12:22:50.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.158+0000 7fa5e1e00640 1 --2- 172.21.15.144:0/1657954806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e4071420 0x7fa5e4071840 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00097c0 tx=0x7fa5d001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757e42f492c438f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e1400640 1 -- 172.21.15.144:0/1657954806 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00a7070 con 0x7fa5e4071420 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e1400640 1 -- 172.21.15.144:0/1657954806 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d00b0070 con 0x7fa5e4071420 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e1400640 1 -- 172.21.15.144:0/1657954806 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00ab890 con 0x7fa5e4071420 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 -- 172.21.15.144:0/1657954806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e4071420 msgr2=0x7fa5e4071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 --2- 172.21.15.144:0/1657954806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e4071420 0x7fa5e4071840 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00097c0 tx=0x7fa5d001c470 comp rx=0 tx=0).stop 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 -- 172.21.15.144:0/1657954806 shutdown_connections 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 --2- 172.21.15.144:0/1657954806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e40ccf30 0x7fa5e40cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 --2- 172.21.15.144:0/1657954806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e4071420 0x7fa5e4071840 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 -- 172.21.15.144:0/1657954806 >> 172.21.15.144:0/1657954806 conn(0x7fa5e406d0d0 msgr2=0x7fa5e406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 -- 172.21.15.144:0/1657954806 shutdown_connections 2024-09-12T12:22:50.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 -- 172.21.15.144:0/1657954806 wait complete. 2024-09-12T12:22:50.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 Processor -- start 2024-09-12T12:22:50.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 -- start start 2024-09-12T12:22:50.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5e4071420 0x7fa5e415e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e40ccf30 0x7fa5e415d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e415b4e0 0x7fa5e414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e415b8c0 con 0x7fa5e40ccf30 2024-09-12T12:22:50.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e40cdef0 con 0x7fa5e4071420 2024-09-12T12:22:50.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e9400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e415d760 con 0x7fa5e415b4e0 2024-09-12T12:22:50.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e40ccf30 0x7fa5e415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e40ccf30 0x7fa5e415d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44504/0 (socket says 172.21.15.144:44504) 2024-09-12T12:22:50.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e1e00640 1 -- 172.21.15.144:0/1276479741 learned_addr learned my addr 172.21.15.144:0/1276479741 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:50.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e2800640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5e4071420 0x7fa5e415e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.162+0000 7fa5e3200640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e415b4e0 0x7fa5e414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5e1e00640 1 -- 172.21.15.144:0/1276479741 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e415b4e0 msgr2=0x7fa5e414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5e1e00640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e415b4e0 0x7fa5e414b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5e1e00640 1 -- 172.21.15.144:0/1276479741 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5e4071420 msgr2=0x7fa5e415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5e1e00640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5e4071420 0x7fa5e415e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5e1e00640 1 -- 172.21.15.144:0/1276479741 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e414b820 con 0x7fa5e40ccf30 2024-09-12T12:22:50.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5e1e00640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e40ccf30 0x7fa5e415d220 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00ad040 tx=0x7fa5d001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5daa00640 1 -- 172.21.15.144:0/1276479741 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00abe60 con 0x7fa5e40ccf30 2024-09-12T12:22:50.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5daa00640 1 -- 172.21.15.144:0/1276479741 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d0004230 con 0x7fa5e40ccf30 2024-09-12T12:22:50.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e415d990 con 0x7fa5e40ccf30 2024-09-12T12:22:50.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5daa00640 1 -- 172.21.15.144:0/1276479741 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0003620 con 0x7fa5e40ccf30 2024-09-12T12:22:50.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e4159390 con 0x7fa5e40ccf30 2024-09-12T12:22:50.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e4071840 con 0x7fa5e40ccf30 2024-09-12T12:22:50.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.166+0000 7fa5daa00640 1 -- 172.21.15.144:0/1276479741 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5d00037c0 con 0x7fa5e40ccf30 2024-09-12T12:22:50.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.170+0000 7fa5daa00640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5c40678c0 0x7fa5c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.170+0000 7fa5daa00640 1 -- 172.21.15.144:0/1276479741 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fa5d01208e0 con 0x7fa5e40ccf30 2024-09-12T12:22:50.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.170+0000 7fa5e2800640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5c40678c0 0x7fa5c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.170+0000 7fa5e2800640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5c40678c0 0x7fa5c4069d80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4000f70 tx=0x7fa5d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.174+0000 7fa5daa00640 1 -- 172.21.15.144:0/1276479741 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa5d0016090 con 0x7fa5e40ccf30 2024-09-12T12:22:50.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.334+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5e40b4df0 con 0x7fa5e40ccf30 2024-09-12T12:22:50.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.334+0000 7fa5daa00640 1 -- 172.21.15.144:0/1276479741 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+17181 (secure 0 0 0) 0x7fa5d00f0b50 con 0x7fa5e40ccf30 2024-09-12T12:22:50.337 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:50.337 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":154,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:22:28.493923+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:06.483487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:07.768699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.3","mappings":[{"from":3,"to":0}]},{"pgid":"22.23","mappings":[{"from":3,"to":1}]},{"pgid":"22.30","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:22:50.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5c40678c0 msgr2=0x7fa5c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5c40678c0 0x7fa5c4069d80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4000f70 tx=0x7fa5d4009040 comp rx=0 tx=0).stop 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e40ccf30 msgr2=0x7fa5e415d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e40ccf30 0x7fa5e415d220 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00ad040 tx=0x7fa5d001acb0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 shutdown_connections 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa5c40678c0 0x7fa5c4069d80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5e415b4e0 0x7fa5e414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5e40ccf30 0x7fa5e415d220 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 --2- 172.21.15.144:0/1276479741 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5e4071420 0x7fa5e415e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 >> 172.21.15.144:0/1276479741 conn(0x7fa5e406d0d0 msgr2=0x7fa5e40afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 shutdown_connections 2024-09-12T12:22:50.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.338+0000 7fa5e9400640 1 -- 172.21.15.144:0/1276479741 wait complete. 2024-09-12T12:22:50.359 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:22:50.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:50.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe298000640 1 Processor -- start 2024-09-12T12:22:50.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe298000640 1 -- start start 2024-09-12T12:22:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe298000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe29015c220 0x7fe2900d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe298000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe2900b4200 0x7fe2900b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe298000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2900d1580 con 0x7fe2900732c0 2024-09-12T12:22:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe298000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe2900b4bb0 con 0x7fe29015c220 2024-09-12T12:22:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe298000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe2900d1860 con 0x7fe2900b4200 2024-09-12T12:22:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe295600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe29015c220 0x7fe2900d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe295600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe29015c220 0x7fe2900d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44508/0 (socket says 172.21.15.144:44508) 2024-09-12T12:22:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe295600640 1 -- 172.21.15.144:0/3870495504 learned_addr learned my addr 172.21.15.144:0/3870495504 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:50.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe294c00640 1 --2- 172.21.15.144:0/3870495504 >> v2:172.21.15.165:3300/0 conn(0x7fe2900b4200 0x7fe2900b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe295600640 1 -- 172.21.15.144:0/3870495504 >> v2:172.21.15.165:3300/0 conn(0x7fe2900b4200 msgr2=0x7fe2900b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:50.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe295600640 1 --2- 172.21.15.144:0/3870495504 >> v2:172.21.15.165:3300/0 conn(0x7fe2900b4200 0x7fe2900b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe295600640 1 -- 172.21.15.144:0/3870495504 >> v1:172.21.15.165:6789/0 conn(0x7fe2900732c0 legacy=0x7fe2900736d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.494+0000 7fe295600640 1 -- 172.21.15.144:0/3870495504 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2900d1b40 con 0x7fe29015c220 2024-09-12T12:22:50.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe295600640 1 --2- 172.21.15.144:0/3870495504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe29015c220 0x7fe2900d0c10 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fe2900b17c0 tx=0x7fe28401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fab84c92c8949f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe28fe00640 1 -- 172.21.15.144:0/3870495504 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2840aa650 con 0x7fe29015c220 2024-09-12T12:22:50.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe28fe00640 1 -- 172.21.15.144:0/3870495504 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2840af070 con 0x7fe29015c220 2024-09-12T12:22:50.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe28fe00640 1 -- 172.21.15.144:0/3870495504 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2840aaa10 con 0x7fe29015c220 2024-09-12T12:22:50.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe298000640 1 -- 172.21.15.144:0/3870495504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe29015c220 msgr2=0x7fe2900d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe298000640 1 --2- 172.21.15.144:0/3870495504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe29015c220 0x7fe2900d0c10 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fe2900b17c0 tx=0x7fe28401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe298000640 1 -- 172.21.15.144:0/3870495504 shutdown_connections 2024-09-12T12:22:50.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe298000640 1 --2- 172.21.15.144:0/3870495504 >> v2:172.21.15.165:3300/0 conn(0x7fe2900b4200 0x7fe2900b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe298000640 1 --2- 172.21.15.144:0/3870495504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe29015c220 0x7fe2900d0c10 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe298000640 1 -- 172.21.15.144:0/3870495504 >> 172.21.15.144:0/3870495504 conn(0x7fe29006f400 msgr2=0x7fe29006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:50.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe298000640 1 -- 172.21.15.144:0/3870495504 shutdown_connections 2024-09-12T12:22:50.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe298000640 1 -- 172.21.15.144:0/3870495504 wait complete. 2024-09-12T12:22:50.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.498+0000 7fe298000640 1 Processor -- start 2024-09-12T12:22:50.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 -- start start 2024-09-12T12:22:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2900732c0 0x7fe2901663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2900b4200 0x7fe2901592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe29015c220 0x7fe290159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2900d12d0 con 0x7fe2900732c0 2024-09-12T12:22:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe2900d1150 con 0x7fe29015c220 2024-09-12T12:22:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe290070bf0 con 0x7fe2900b4200 2024-09-12T12:22:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe295600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2900732c0 0x7fe2901663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe295600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2900732c0 0x7fe2901663f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44512/0 (socket says 172.21.15.144:44512) 2024-09-12T12:22:50.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe295600640 1 -- 172.21.15.144:0/2287306872 learned_addr learned my addr 172.21.15.144:0/2287306872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe295600640 1 -- 172.21.15.144:0/2287306872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2900b4200 msgr2=0x7fe2901592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe295600640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2900b4200 0x7fe2901592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe295600640 1 -- 172.21.15.144:0/2287306872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe29015c220 msgr2=0x7fe290159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe295600640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe29015c220 0x7fe290159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe295600640 1 -- 172.21.15.144:0/2287306872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe290158230 con 0x7fe2900732c0 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe295600640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2900732c0 0x7fe2901663f0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fe2840ac040 tx=0x7fe28401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe28d600640 1 -- 172.21.15.144:0/2287306872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2840bd5f0 con 0x7fe2900732c0 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe28d600640 1 -- 172.21.15.144:0/2287306872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2840a6040 con 0x7fe2900732c0 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe28d600640 1 -- 172.21.15.144:0/2287306872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2840bd9f0 con 0x7fe2900732c0 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe290158510 con 0x7fe2900732c0 2024-09-12T12:22:50.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe290158ad0 con 0x7fe2900732c0 2024-09-12T12:22:50.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.502+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2900b4670 con 0x7fe2900732c0 2024-09-12T12:22:50.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.506+0000 7fe28d600640 1 -- 172.21.15.144:0/2287306872 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe2840bdb90 con 0x7fe2900732c0 2024-09-12T12:22:50.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.506+0000 7fe28d600640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2700678c0 0x7fe270069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.506+0000 7fe28d600640 1 -- 172.21.15.144:0/2287306872 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fe2841202b0 con 0x7fe2900732c0 2024-09-12T12:22:50.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.506+0000 7fe294c00640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2700678c0 0x7fe270069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.506+0000 7fe294c00640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2700678c0 0x7fe270069d80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe27c006aa0 tx=0x7fe27c006a30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.510+0000 7fe28d600640 1 -- 172.21.15.144:0/2287306872 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe284016110 con 0x7fe2900732c0 2024-09-12T12:22:50.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2900cf180 con 0x7fe2900732c0 2024-09-12T12:22:50.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe28d600640 1 -- 172.21.15.144:0/2287306872 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7fe2840f0630 con 0x7fe2900732c0 2024-09-12T12:22:50.699 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:50.699 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:50.699 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2700678c0 msgr2=0x7fe270069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2700678c0 0x7fe270069d80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe27c006aa0 tx=0x7fe27c006a30 comp rx=0 tx=0).stop 2024-09-12T12:22:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2900732c0 msgr2=0x7fe2901663f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2900732c0 0x7fe2901663f0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fe2840ac040 tx=0x7fe28401ad30 comp rx=0 tx=0).stop 2024-09-12T12:22:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 shutdown_connections 2024-09-12T12:22:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2700678c0 0x7fe270069d80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe29015c220 0x7fe290159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2900b4200 0x7fe2901592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 --2- 172.21.15.144:0/2287306872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2900732c0 0x7fe2901663f0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 >> 172.21.15.144:0/2287306872 conn(0x7fe29006f400 msgr2=0x7fe2900b5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 shutdown_connections 2024-09-12T12:22:50.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.698+0000 7fe298000640 1 -- 172.21.15.144:0/2287306872 wait complete. 2024-09-12T12:22:50.720 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe115800640 1 Processor -- start 2024-09-12T12:22:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe115800640 1 -- start start 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe115800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe110073bd0 0x7fe110070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe115800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1100cff90 0x7fe1100d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe115800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1100cd1d0 con 0x7fe11015b160 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe115800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe1100d0940 con 0x7fe1100cff90 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe115800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe11015b540 con 0x7fe110073bd0 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe114e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1100cff90 0x7fe1100d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe114e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1100cff90 0x7fe1100d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44524/0 (socket says 172.21.15.144:44524) 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe114e00640 1 -- 172.21.15.144:0/543532973 learned_addr learned my addr 172.21.15.144:0/543532973 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.854+0000 7fe10f400640 1 --2- 172.21.15.144:0/543532973 >> v2:172.21.15.165:3300/0 conn(0x7fe110073bd0 0x7fe110070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe114e00640 1 -- 172.21.15.144:0/543532973 >> v2:172.21.15.165:3300/0 conn(0x7fe110073bd0 msgr2=0x7fe110070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe114e00640 1 --2- 172.21.15.144:0/543532973 >> v2:172.21.15.165:3300/0 conn(0x7fe110073bd0 0x7fe110070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe114e00640 1 -- 172.21.15.144:0/543532973 >> v1:172.21.15.165:6789/0 conn(0x7fe11015b160 legacy=0x7fe1100ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe114e00640 1 -- 172.21.15.144:0/543532973 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1100cd4a0 con 0x7fe1100cff90 2024-09-12T12:22:50.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe10f400640 1 --2- 172.21.15.144:0/543532973 >> v2:172.21.15.165:3300/0 conn(0x7fe110073bd0 0x7fe110070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:50.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe114e00640 1 --2- 172.21.15.144:0/543532973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1100cff90 0x7fe1100d0400 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fe1100d10d0 tx=0x7fe10801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a924cdf0ba0b25e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe10ea00640 1 -- 172.21.15.144:0/543532973 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10800b2d0 con 0x7fe1100cff90 2024-09-12T12:22:50.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe10ea00640 1 -- 172.21.15.144:0/543532973 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10800b470 con 0x7fe1100cff90 2024-09-12T12:22:50.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe10ea00640 1 -- 172.21.15.144:0/543532973 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1080a7b40 con 0x7fe1100cff90 2024-09-12T12:22:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe115800640 1 -- 172.21.15.144:0/543532973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1100cff90 msgr2=0x7fe1100d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe115800640 1 --2- 172.21.15.144:0/543532973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1100cff90 0x7fe1100d0400 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fe1100d10d0 tx=0x7fe10801eb60 comp rx=0 tx=0).stop 2024-09-12T12:22:50.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe115800640 1 -- 172.21.15.144:0/543532973 shutdown_connections 2024-09-12T12:22:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe115800640 1 --2- 172.21.15.144:0/543532973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1100cff90 0x7fe1100d0400 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe115800640 1 --2- 172.21.15.144:0/543532973 >> v2:172.21.15.165:3300/0 conn(0x7fe110073bd0 0x7fe110070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe115800640 1 -- 172.21.15.144:0/543532973 >> 172.21.15.144:0/543532973 conn(0x7fe11006bc10 msgr2=0x7fe11006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.858+0000 7fe115800640 1 -- 172.21.15.144:0/543532973 shutdown_connections 2024-09-12T12:22:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe115800640 1 -- 172.21.15.144:0/543532973 wait complete. 2024-09-12T12:22:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe115800640 1 Processor -- start 2024-09-12T12:22:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe115800640 1 -- start start 2024-09-12T12:22:50.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe115800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe110073bd0 0x7fe110144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe115800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1100cff90 0x7fe11015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe115800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11015b160 0x7fe11015c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe115800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe1100b4310 con 0x7fe11015b160 2024-09-12T12:22:50.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe115800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe1100b4190 con 0x7fe1100cff90 2024-09-12T12:22:50.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe115800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1100b4490 con 0x7fe110073bd0 2024-09-12T12:22:50.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe114e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11015b160 0x7fe11015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe10f400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1100cff90 0x7fe11015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe114e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11015b160 0x7fe11015c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44532/0 (socket says 172.21.15.144:44532) 2024-09-12T12:22:50.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe114e00640 1 -- 172.21.15.144:0/3026368578 learned_addr learned my addr 172.21.15.144:0/3026368578 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:50.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe10fe00640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe110073bd0 0x7fe110144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe114e00640 1 -- 172.21.15.144:0/3026368578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe110073bd0 msgr2=0x7fe110144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe114e00640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe110073bd0 0x7fe110144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe114e00640 1 -- 172.21.15.144:0/3026368578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1100cff90 msgr2=0x7fe11015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:50.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe114e00640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1100cff90 0x7fe11015c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:50.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe114e00640 1 -- 172.21.15.144:0/3026368578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe110144ff0 con 0x7fe11015b160 2024-09-12T12:22:50.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe114e00640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11015b160 0x7fe11015c800 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fe1080b1040 tx=0x7fe10801b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.862+0000 7fe107e00640 1 -- 172.21.15.144:0/3026368578 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108009800 con 0x7fe11015b160 2024-09-12T12:22:50.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.866+0000 7fe107e00640 1 -- 172.21.15.144:0/3026368578 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1080be070 con 0x7fe11015b160 2024-09-12T12:22:50.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.866+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe110158c70 con 0x7fe11015b160 2024-09-12T12:22:50.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.866+0000 7fe107e00640 1 -- 172.21.15.144:0/3026368578 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108009c20 con 0x7fe11015b160 2024-09-12T12:22:50.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.866+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe110154a00 con 0x7fe11015b160 2024-09-12T12:22:50.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.866+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe110158e40 con 0x7fe11015b160 2024-09-12T12:22:50.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.866+0000 7fe107e00640 1 -- 172.21.15.144:0/3026368578 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1080b6070 con 0x7fe11015b160 2024-09-12T12:22:50.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.866+0000 7fe107e00640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0f00678f0 0x7fe0f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:50.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.866+0000 7fe107e00640 1 -- 172.21.15.144:0/3026368578 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7fe1081217c0 con 0x7fe11015b160 2024-09-12T12:22:50.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.866+0000 7fe10fe00640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0f00678f0 0x7fe0f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:50.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.870+0000 7fe10fe00640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0f00678f0 0x7fe0f0069db0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe100001770 tx=0x7fe100009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:50.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:50.870+0000 7fe107e00640 1 -- 172.21.15.144:0/3026368578 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe1080187e0 con 0x7fe11015b160 2024-09-12T12:22:51.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1100ce2e0 con 0x7fe11015b160 2024-09-12T12:22:51.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe107e00640 1 -- 172.21.15.144:0/3026368578 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) ==== 95+0+5245 (secure 0 0 0) 0x7fe1080f1c00 con 0x7fe11015b160 2024-09-12T12:22:51.064 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:51.064 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":114,"btime":"2024-09-12T12:22:12:404317+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:22:08.760789+0000","modified":"2024-09-12T12:22:11.782243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8874":{"gid":8874,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/1602168377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1602168377},{"type":"v1","addr":"172.21.15.165:6835","nonce":1602168377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8874,"qdb_cluster":[8874]},"id":10}]} 2024-09-12T12:22:51.065 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 114 2024-09-12T12:22:51.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0f00678f0 msgr2=0x7fe0f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0f00678f0 0x7fe0f0069db0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe100001770 tx=0x7fe100009040 comp rx=0 tx=0).stop 2024-09-12T12:22:51.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11015b160 msgr2=0x7fe11015c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11015b160 0x7fe11015c800 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fe1080b1040 tx=0x7fe10801b900 comp rx=0 tx=0).stop 2024-09-12T12:22:51.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 shutdown_connections 2024-09-12T12:22:51.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe0f00678f0 0x7fe0f0069db0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe11015b160 0x7fe11015c800 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1100cff90 0x7fe11015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 --2- 172.21.15.144:0/3026368578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe110073bd0 0x7fe110144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.062+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 >> 172.21.15.144:0/3026368578 conn(0x7fe11006bc10 msgr2=0x7fe11015f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:51.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.066+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 shutdown_connections 2024-09-12T12:22:51.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.066+0000 7fe115800640 1 -- 172.21.15.144:0/3026368578 wait complete. 2024-09-12T12:22:51.085 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:22:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f4426600640 1 Processor -- start 2024-09-12T12:22:51.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f4426600640 1 -- start start 2024-09-12T12:22:51.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f4426600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f442006e910 0x7f442006ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f4426600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f442015f210 0x7f442015af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f4426600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442006f230 con 0x7f442015edf0 2024-09-12T12:22:51.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f4426600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f44200727a0 con 0x7f442006e910 2024-09-12T12:22:51.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f4426600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f442015be70 con 0x7f442015f210 2024-09-12T12:22:51.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f441ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f442015edf0 0x7f4420072090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44042/0 (socket says 172.21.15.144:44042) 2024-09-12T12:22:51.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f441ea00640 1 -- 172.21.15.144:0/1498811827 learned_addr learned my addr 172.21.15.144:0/1498811827 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:51.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f441fe00640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f442015f210 0x7f442015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.218+0000 7f441f400640 1 --2- 172.21.15.144:0/1498811827 >> v2:172.21.15.165:3300/0 conn(0x7f442006e910 0x7f442006ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747765426 0 0) 0x7f442006f230 con 0x7f442015edf0 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4404005740 con 0x7f442015edf0 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2950906526 0 0) 0x7f4404005740 con 0x7f442015edf0 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f442015f210 msgr2=0x7f442015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f442015f210 0x7f442015af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 >> v2:172.21.15.165:3300/0 conn(0x7f442006e910 msgr2=0x7f442006ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 --2- 172.21.15.144:0/1498811827 >> v2:172.21.15.165:3300/0 conn(0x7f442006e910 0x7f442006ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442015b8b0 con 0x7f442015edf0 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f440c001680 con 0x7f442015edf0 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 >> v1:172.21.15.144:6789/0 conn(0x7f442015edf0 legacy=0x7f4420072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4404005bd0 0x7f4404005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4404006a20 0x7f4404006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f442015f210 0x7f44040073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f44200727a0 con 0x7f4404006a20 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f442015be70 con 0x7f4404005bd0 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f440400dbe0 con 0x7f442015f210 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441ea00640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4404006a20 0x7f4404006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441f400640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4404005bd0 0x7f4404005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441fe00640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f442015f210 0x7f44040073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441ea00640 1 -- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f442015f210 msgr2=0x7f44040073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441ea00640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f442015f210 0x7f44040073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441ea00640 1 -- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4404005bd0 msgr2=0x7f4404005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441ea00640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4404005bd0 0x7f4404005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441ea00640 1 -- 172.21.15.144:0/1498811827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4404005740 con 0x7f4404006a20 2024-09-12T12:22:51.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.222+0000 7f441fe00640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f442015f210 0x7f44040073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:51.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f441ea00640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4404006a20 0x7f4404006ea0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f440c00c240 tx=0x7f440c01f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad04e7e78642878 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:51.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c007d60 con 0x7f4404006a20 2024-09-12T12:22:51.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440c005b00 con 0x7f4404006a20 2024-09-12T12:22:51.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f441e000640 1 -- 172.21.15.144:0/1498811827 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c007070 con 0x7f4404006a20 2024-09-12T12:22:51.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 -- 172.21.15.144:0/1498811827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4404006a20 msgr2=0x7f4404006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 --2- 172.21.15.144:0/1498811827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4404006a20 0x7f4404006ea0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f440c00c240 tx=0x7f440c01f430 comp rx=0 tx=0).stop 2024-09-12T12:22:51.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f441fe00640 1 -- 172.21.15.144:0/1498811827 reap_dead start 2024-09-12T12:22:51.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 -- 172.21.15.144:0/1498811827 shutdown_connections 2024-09-12T12:22:51.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 -- 172.21.15.144:0/1498811827 >> 172.21.15.144:0/1498811827 conn(0x7f442006ddf0 msgr2=0x7f442006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:51.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 -- 172.21.15.144:0/1498811827 shutdown_connections 2024-09-12T12:22:51.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 -- 172.21.15.144:0/1498811827 wait complete. 2024-09-12T12:22:51.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 Processor -- start 2024-09-12T12:22:51.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 -- start start 2024-09-12T12:22:51.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4404006a20 0x7f44201f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4420142bf0 0x7f44200b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44200cc6e0 0x7f44200ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4420071b70 con 0x7f44200cc6e0 2024-09-12T12:22:51.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4420071890 con 0x7f4404006a20 2024-09-12T12:22:51.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f4426600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4420067a00 con 0x7f4420142bf0 2024-09-12T12:22:51.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f441fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44200cc6e0 0x7f44200ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f441fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44200cc6e0 0x7f44200ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44556/0 (socket says 172.21.15.144:44556) 2024-09-12T12:22:51.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.226+0000 7f441fe00640 1 -- 172.21.15.144:0/297217887 learned_addr learned my addr 172.21.15.144:0/297217887 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f441f400640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4404006a20 0x7f44201f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f441fe00640 1 -- 172.21.15.144:0/297217887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4420142bf0 msgr2=0x7f44200b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f441fe00640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4420142bf0 0x7f44200b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f441fe00640 1 -- 172.21.15.144:0/297217887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4404006a20 msgr2=0x7f44201f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f441fe00640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4404006a20 0x7f44201f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f441fe00640 1 -- 172.21.15.144:0/297217887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44200affb0 con 0x7f44200cc6e0 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f441fe00640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44200cc6e0 0x7f44200ccb60 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f4418009f50 tx=0x7f44180115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f4417400640 1 -- 172.21.15.144:0/297217887 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441801a020 con 0x7f44200cc6e0 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f4417400640 1 -- 172.21.15.144:0/297217887 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4418016470 con 0x7f44200cc6e0 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44200b0290 con 0x7f44200cc6e0 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f4417400640 1 -- 172.21.15.144:0/297217887 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418016860 con 0x7f44200cc6e0 2024-09-12T12:22:51.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44201f3e20 con 0x7f44200cc6e0 2024-09-12T12:22:51.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4420067da0 con 0x7f44200cc6e0 2024-09-12T12:22:51.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.230+0000 7f4417400640 1 -- 172.21.15.144:0/297217887 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f441801d020 con 0x7f44200cc6e0 2024-09-12T12:22:51.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.234+0000 7f4417400640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44000678f0 0x7f4400069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.234+0000 7f4417400640 1 -- 172.21.15.144:0/297217887 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f4418086a80 con 0x7f44200cc6e0 2024-09-12T12:22:51.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.234+0000 7f441f400640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44000678f0 0x7f4400069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.234+0000 7f441f400640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44000678f0 0x7f4400069db0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4410009aa0 tx=0x7f4410008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:51.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.238+0000 7f4417400640 1 -- 172.21.15.144:0/297217887 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4418088e20 con 0x7f44200cc6e0 2024-09-12T12:22:51.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.394+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44200b0600 con 0x7f44200cc6e0 2024-09-12T12:22:51.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4417400640 1 -- 172.21.15.144:0/297217887 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+17181 (secure 0 0 0) 0x7f4418024030 con 0x7f44200cc6e0 2024-09-12T12:22:51.398 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:51.398 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":154,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:22:28.493923+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:22:06.483487+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-12T12:22:07.768699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.3","mappings":[{"from":3,"to":0}]},{"pgid":"22.23","mappings":[{"from":3,"to":1}]},{"pgid":"22.30","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:22:51.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44000678f0 msgr2=0x7f4400069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44000678f0 0x7f4400069db0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4410009aa0 tx=0x7f4410008040 comp rx=0 tx=0).stop 2024-09-12T12:22:51.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44200cc6e0 msgr2=0x7f44200ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44200cc6e0 0x7f44200ccb60 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f4418009f50 tx=0x7f44180115a0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 shutdown_connections 2024-09-12T12:22:51.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f44000678f0 0x7f4400069db0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44200cc6e0 0x7f44200ccb60 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4420142bf0 0x7f44200b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 --2- 172.21.15.144:0/297217887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4404006a20 0x7f44201f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 >> 172.21.15.144:0/297217887 conn(0x7f442006ddf0 msgr2=0x7f442015ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:51.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 shutdown_connections 2024-09-12T12:22:51.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.398+0000 7f4426600640 1 -- 172.21.15.144:0/297217887 wait complete. 2024-09-12T12:22:51.423 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:22:51.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.558+0000 7f7b2dc00640 1 Processor -- start 2024-09-12T12:22:51.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.558+0000 7f7b2dc00640 1 -- start start 2024-09-12T12:22:51.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.558+0000 7f7b2dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7b2815c7b0 0x7f7b280ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.558+0000 7f7b2dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2815cd30 0x7f7b280b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.558+0000 7f7b2dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b280b5de0 0x7f7b281601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.558+0000 7f7b2dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7b28072a50 con 0x7f7b280b5de0 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.558+0000 7f7b2dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7b280cde30 con 0x7f7b2815c7b0 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.558+0000 7f7b2dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7b280b6210 con 0x7f7b2815cd30 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b27400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b280b5de0 0x7f7b281601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b27400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b280b5de0 0x7f7b281601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44562/0 (socket says 172.21.15.144:44562) 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b27400640 1 -- 172.21.15.144:0/3077753159 learned_addr learned my addr 172.21.15.144:0/3077753159 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b26a00640 1 --2- 172.21.15.144:0/3077753159 >> v2:172.21.15.165:3300/0 conn(0x7f7b2815c7b0 0x7f7b280ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b26000640 1 --2- 172.21.15.144:0/3077753159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2815cd30 0x7f7b280b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b27400640 1 -- 172.21.15.144:0/3077753159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2815cd30 msgr2=0x7f7b280b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b27400640 1 --2- 172.21.15.144:0/3077753159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2815cd30 0x7f7b280b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b27400640 1 -- 172.21.15.144:0/3077753159 >> v2:172.21.15.165:3300/0 conn(0x7f7b2815c7b0 msgr2=0x7f7b280ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:51.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b27400640 1 --2- 172.21.15.144:0/3077753159 >> v2:172.21.15.165:3300/0 conn(0x7f7b2815c7b0 0x7f7b280ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b27400640 1 -- 172.21.15.144:0/3077753159 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b280cd870 con 0x7f7b280b5de0 2024-09-12T12:22:51.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b27400640 1 --2- 172.21.15.144:0/3077753159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b280b5de0 0x7f7b281601d0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f7b280d14f0 tx=0x7f7b2001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c988ac7331d47b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:51.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b25600640 1 -- 172.21.15.144:0/3077753159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200a64b0 con 0x7f7b280b5de0 2024-09-12T12:22:51.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b25600640 1 -- 172.21.15.144:0/3077753159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b200a6650 con 0x7f7b280b5de0 2024-09-12T12:22:51.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.562+0000 7f7b25600640 1 -- 172.21.15.144:0/3077753159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200a6a20 con 0x7f7b280b5de0 2024-09-12T12:22:51.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 -- 172.21.15.144:0/3077753159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b280b5de0 msgr2=0x7f7b281601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/3077753159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b280b5de0 0x7f7b281601d0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f7b280d14f0 tx=0x7f7b2001c730 comp rx=0 tx=0).stop 2024-09-12T12:22:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 -- 172.21.15.144:0/3077753159 shutdown_connections 2024-09-12T12:22:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/3077753159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b280b5de0 0x7f7b281601d0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/3077753159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b2815cd30 0x7f7b280b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/3077753159 >> v2:172.21.15.165:3300/0 conn(0x7f7b2815c7b0 0x7f7b280ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 -- 172.21.15.144:0/3077753159 >> 172.21.15.144:0/3077753159 conn(0x7f7b2806d0d0 msgr2=0x7f7b2806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 -- 172.21.15.144:0/3077753159 shutdown_connections 2024-09-12T12:22:51.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 -- 172.21.15.144:0/3077753159 wait complete. 2024-09-12T12:22:51.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 Processor -- start 2024-09-12T12:22:51.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 -- start start 2024-09-12T12:22:51.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b280b5de0 0x7f7b281598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b2815c7b0 0x7f7b28159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2815cd30 0x7f7b28150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28072ec0 con 0x7f7b2815cd30 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7b280cd650 con 0x7f7b2815c7b0 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b2dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7b28073040 con 0x7f7b280b5de0 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b27400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2815cd30 0x7f7b28150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b27400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2815cd30 0x7f7b28150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44574/0 (socket says 172.21.15.144:44574) 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b27400640 1 -- 172.21.15.144:0/115403791 learned_addr learned my addr 172.21.15.144:0/115403791 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b26a00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b280b5de0 0x7f7b281598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b26000640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b2815c7b0 0x7f7b28159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b27400640 1 -- 172.21.15.144:0/115403791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b280b5de0 msgr2=0x7f7b281598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b27400640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b280b5de0 0x7f7b281598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b27400640 1 -- 172.21.15.144:0/115403791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b2815c7b0 msgr2=0x7f7b28159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b27400640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b2815c7b0 0x7f7b28159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b27400640 1 -- 172.21.15.144:0/115403791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b281519c0 con 0x7f7b2815cd30 2024-09-12T12:22:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.566+0000 7f7b27400640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2815cd30 0x7f7b28150680 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f7b2001cfd0 tx=0x7f7b200194d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b1ea00640 1 -- 172.21.15.144:0/115403791 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200bf070 con 0x7f7b2815cd30 2024-09-12T12:22:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b1ea00640 1 -- 172.21.15.144:0/115403791 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b200090d0 con 0x7f7b2815cd30 2024-09-12T12:22:51.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2815a370 con 0x7f7b2815cd30 2024-09-12T12:22:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b1ea00640 1 -- 172.21.15.144:0/115403791 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200a6a40 con 0x7f7b2815cd30 2024-09-12T12:22:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b280b2170 con 0x7f7b2815cd30 2024-09-12T12:22:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b280ccf00 con 0x7f7b2815cd30 2024-09-12T12:22:51.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b1ea00640 1 -- 172.21.15.144:0/115403791 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b200c2070 con 0x7f7b2815cd30 2024-09-12T12:22:51.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b1ea00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b080678c0 0x7f7b08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b1ea00640 1 -- 172.21.15.144:0/115403791 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 6188+0+0 (secure 0 0 0) 0x7f7b2011f9f0 con 0x7f7b2815cd30 2024-09-12T12:22:51.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b26a00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b080678c0 0x7f7b08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.570+0000 7f7b26a00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b080678c0 0x7f7b08069d80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009ae0 tx=0x7f7b18009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.574+0000 7f7b1ea00640 1 -- 172.21.15.144:0/115403791 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7b2815a370 con 0x7f7b2815cd30 2024-09-12T12:22:51.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.766+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7b281569b0 con 0x7f7b2815cd30 2024-09-12T12:22:51.769 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:22:51.766+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:22:51.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.770+0000 7f7b1ea00640 1 -- 172.21.15.144:0/115403791 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v115) ==== 161+0+0 (secure 0 0 0) 0x7f7b281519c0 con 0x7f7b2815cd30 2024-09-12T12:22:51.771 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:22:51.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b080678c0 msgr2=0x7f7b08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b080678c0 0x7f7b08069d80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009ae0 tx=0x7f7b18009190 comp rx=0 tx=0).stop 2024-09-12T12:22:51.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2815cd30 msgr2=0x7f7b28150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2815cd30 0x7f7b28150680 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f7b2001cfd0 tx=0x7f7b200194d0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 shutdown_connections 2024-09-12T12:22:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7b080678c0 0x7f7b08069d80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b2815cd30 0x7f7b28150680 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b2815c7b0 0x7f7b28159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 --2- 172.21.15.144:0/115403791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b280b5de0 0x7f7b281598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 >> 172.21.15.144:0/115403791 conn(0x7f7b2806d0d0 msgr2=0x7f7b280ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 shutdown_connections 2024-09-12T12:22:51.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.774+0000 7f7b2dc00640 1 -- 172.21.15.144:0/115403791 wait complete. 2024-09-12T12:22:51.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:22:51.845 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:22:51.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa41a000640 1 Processor -- start 2024-09-12T12:22:51.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa41a000640 1 -- start start 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa41a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41415af60 0x7fa4140ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa41a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4140cd9f0 0x7fa41406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa41a000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa41415b340 0x7fa41406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa41a000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa4140b32f0 con 0x7fa4140cd9f0 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa41a000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa4140b4300 con 0x7fa41415b340 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa41a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4140b3540 con 0x7fa41415af60 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa412a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4140cd9f0 0x7fa41406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa412a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4140cd9f0 0x7fa41406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44582/0 (socket says 172.21.15.144:44582) 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa412a00640 1 -- 172.21.15.144:0/2077239699 learned_addr learned my addr 172.21.15.144:0/2077239699 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa413400640 1 --2- 172.21.15.144:0/2077239699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41415af60 0x7fa4140ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa413e00640 1 --2- 172.21.15.144:0/2077239699 >> v2:172.21.15.165:3300/0 conn(0x7fa41415b340 0x7fa41406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa412a00640 1 -- 172.21.15.144:0/2077239699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41415af60 msgr2=0x7fa4140ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:51.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa412a00640 1 --2- 172.21.15.144:0/2077239699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41415af60 0x7fa4140ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa412a00640 1 -- 172.21.15.144:0/2077239699 >> v2:172.21.15.165:3300/0 conn(0x7fa41415b340 msgr2=0x7fa41406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:51.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa412a00640 1 --2- 172.21.15.144:0/2077239699 >> v2:172.21.15.165:3300/0 conn(0x7fa41415b340 0x7fa41406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa412a00640 1 -- 172.21.15.144:0/2077239699 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4140b3820 con 0x7fa4140cd9f0 2024-09-12T12:22:51.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.930+0000 7fa413400640 1 --2- 172.21.15.144:0/2077239699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41415af60 0x7fa4140ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:51.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa412a00640 1 --2- 172.21.15.144:0/2077239699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4140cd9f0 0x7fa41406bc10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fa4140cfa80 tx=0x7fa40001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c1918c03707573 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:51.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa412000640 1 -- 172.21.15.144:0/2077239699 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4000b5070 con 0x7fa4140cd9f0 2024-09-12T12:22:51.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa412000640 1 -- 172.21.15.144:0/2077239699 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4000a89d0 con 0x7fa4140cd9f0 2024-09-12T12:22:51.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa412000640 1 -- 172.21.15.144:0/2077239699 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4000a8da0 con 0x7fa4140cd9f0 2024-09-12T12:22:51.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa41a000640 1 -- 172.21.15.144:0/2077239699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4140cd9f0 msgr2=0x7fa41406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa41a000640 1 --2- 172.21.15.144:0/2077239699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4140cd9f0 0x7fa41406bc10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fa4140cfa80 tx=0x7fa40001ed10 comp rx=0 tx=0).stop 2024-09-12T12:22:51.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa41a000640 1 -- 172.21.15.144:0/2077239699 shutdown_connections 2024-09-12T12:22:51.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa41a000640 1 --2- 172.21.15.144:0/2077239699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4140cd9f0 0x7fa41406bc10 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa41a000640 1 --2- 172.21.15.144:0/2077239699 >> v2:172.21.15.165:3300/0 conn(0x7fa41415b340 0x7fa41406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa41a000640 1 --2- 172.21.15.144:0/2077239699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa41415af60 0x7fa4140ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa41a000640 1 -- 172.21.15.144:0/2077239699 >> 172.21.15.144:0/2077239699 conn(0x7fa414068030 msgr2=0x7fa4140b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:51.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa41a000640 1 -- 172.21.15.144:0/2077239699 shutdown_connections 2024-09-12T12:22:51.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.934+0000 7fa41a000640 1 -- 172.21.15.144:0/2077239699 wait complete. 2024-09-12T12:22:51.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 Processor -- start 2024-09-12T12:22:51.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 -- start start 2024-09-12T12:22:51.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4140cd9f0 0x7fa414157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa41415af60 0x7fa4140717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41415b340 0x7fa414071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4140cebc0 con 0x7fa41415af60 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4140b3de0 con 0x7fa41415b340 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4140ced40 con 0x7fa4140cd9f0 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa412a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa41415af60 0x7fa4140717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa413400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4140cd9f0 0x7fa414157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa412a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa41415af60 0x7fa4140717c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44586/0 (socket says 172.21.15.144:44586) 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa412a00640 1 -- 172.21.15.144:0/3331699673 learned_addr learned my addr 172.21.15.144:0/3331699673 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa413e00640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41415b340 0x7fa414071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa412a00640 1 -- 172.21.15.144:0/3331699673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4140cd9f0 msgr2=0x7fa414157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa412a00640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4140cd9f0 0x7fa414157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa412a00640 1 -- 172.21.15.144:0/3331699673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41415b340 msgr2=0x7fa414071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa412a00640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41415b340 0x7fa414071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa412a00640 1 -- 172.21.15.144:0/3331699673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41414fa50 con 0x7fa41415af60 2024-09-12T12:22:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa412a00640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa41415af60 0x7fa4140717c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fa40001d3c0 tx=0x7fa40001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa40b400640 1 -- 172.21.15.144:0/3331699673 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4000b5070 con 0x7fa41415af60 2024-09-12T12:22:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa40b400640 1 -- 172.21.15.144:0/3331699673 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4000b0a70 con 0x7fa41415af60 2024-09-12T12:22:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa40b400640 1 -- 172.21.15.144:0/3331699673 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4000b0e60 con 0x7fa41415af60 2024-09-12T12:22:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa41414fd10 con 0x7fa41415af60 2024-09-12T12:22:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.938+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4141502d0 con 0x7fa41415af60 2024-09-12T12:22:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.942+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4140ce680 con 0x7fa41415af60 2024-09-12T12:22:51.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.942+0000 7fa40b400640 1 -- 172.21.15.144:0/3331699673 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4000c2060 con 0x7fa41415af60 2024-09-12T12:22:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.942+0000 7fa40b400640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3f40678c0 0x7fa3f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.942+0000 7fa40b400640 1 -- 172.21.15.144:0/3331699673 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6274+0+0 (secure 0 0 0) 0x7fa400123020 con 0x7fa41415af60 2024-09-12T12:22:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.942+0000 7fa413400640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3f40678c0 0x7fa3f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.942+0000 7fa413400640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3f40678c0 0x7fa3f4069d80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa40400ab60 tx=0x7fa404008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:51.946+0000 7fa40b400640 1 -- 172.21.15.144:0/3331699673 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa400018870 con 0x7fa41415af60 2024-09-12T12:22:52.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.138+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa4140af7a0 con 0x7fa41415af60 2024-09-12T12:22:52.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa40b400640 1 -- 172.21.15.144:0/3331699673 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v116) ==== 104+0+0 (secure 0 0 0) 0x7fa4000f3230 con 0x7fa41415af60 2024-09-12T12:22:52.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3f40678c0 msgr2=0x7fa3f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3f40678c0 0x7fa3f4069d80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa40400ab60 tx=0x7fa404008040 comp rx=0 tx=0).stop 2024-09-12T12:22:52.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa41415af60 msgr2=0x7fa4140717c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa41415af60 0x7fa4140717c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fa40001d3c0 tx=0x7fa40001bab0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 shutdown_connections 2024-09-12T12:22:52.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3f40678c0 0x7fa3f4069d80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41415b340 0x7fa414071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa41415af60 0x7fa4140717c0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 --2- 172.21.15.144:0/3331699673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4140cd9f0 0x7fa414157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 >> 172.21.15.144:0/3331699673 conn(0x7fa414068030 msgr2=0x7fa4140b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:52.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 shutdown_connections 2024-09-12T12:22:52.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.774+0000 7fa41a000640 1 -- 172.21.15.144:0/3331699673 wait complete. 2024-09-12T12:22:52.799 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:22:52.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.938+0000 7f47bd600640 1 Processor -- start 2024-09-12T12:22:52.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.938+0000 7f47bd600640 1 -- start start 2024-09-12T12:22:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47bd600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b806cff0 0x7f47b806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47bd600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b806cd20 con 0x7f47b8156c10 2024-09-12T12:22:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47bd600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b8072780 con 0x7f47b8073360 2024-09-12T12:22:52.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47bd600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47b806d990 con 0x7f47b806cff0 2024-09-12T12:22:52.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47b6a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f47b8156c10 0x7f47b8072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44048/0 (socket says 172.21.15.144:44048) 2024-09-12T12:22:52.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47b6a00640 1 -- 172.21.15.144:0/369655035 learned_addr learned my addr 172.21.15.144:0/369655035 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:52.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47afe00640 1 --2- 172.21.15.144:0/369655035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b806cff0 0x7f47b806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:52.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47b6000640 1 -- 172.21.15.144:0/369655035 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3567658734 0 0) 0x7f47b806cd20 con 0x7f47b8156c10 2024-09-12T12:22:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47b6000640 1 -- 172.21.15.144:0/369655035 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f479c003530 con 0x7f47b8156c10 2024-09-12T12:22:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47b6000640 1 -- 172.21.15.144:0/369655035 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853092755 0 0) 0x7f47b8072780 con 0x7f47b8073360 2024-09-12T12:22:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47b6000640 1 -- 172.21.15.144:0/369655035 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b806cd20 con 0x7f47b8073360 2024-09-12T12:22:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47afe00640 1 -- 172.21.15.144:0/369655035 >> v1:172.21.15.165:6789/0 conn(0x7f47b8073360 legacy=0x7f47b815de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47afe00640 1 -- 172.21.15.144:0/369655035 >> v1:172.21.15.144:6789/0 conn(0x7f47b8156c10 legacy=0x7f47b8072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.942+0000 7f47afe00640 1 -- 172.21.15.144:0/369655035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b80712b0 con 0x7f47b806cff0 2024-09-12T12:22:52.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47afe00640 1 --2- 172.21.15.144:0/369655035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b806cff0 0x7f47b806d450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f47a00097f0 tx=0x7f47a001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe65354cd3bb590 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:52.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47b6000640 1 -- 172.21.15.144:0/369655035 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a00ab5f0 con 0x7f47b806cff0 2024-09-12T12:22:52.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47b6000640 1 -- 172.21.15.144:0/369655035 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a00b0070 con 0x7f47b806cff0 2024-09-12T12:22:52.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47b6000640 1 -- 172.21.15.144:0/369655035 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a00ab9b0 con 0x7f47b806cff0 2024-09-12T12:22:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47bd600640 1 -- 172.21.15.144:0/369655035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b806cff0 msgr2=0x7f47b806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47bd600640 1 --2- 172.21.15.144:0/369655035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b806cff0 0x7f47b806d450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f47a00097f0 tx=0x7f47a001c4e0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47bd600640 1 -- 172.21.15.144:0/369655035 shutdown_connections 2024-09-12T12:22:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47bd600640 1 --2- 172.21.15.144:0/369655035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b806cff0 0x7f47b806d450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47bd600640 1 -- 172.21.15.144:0/369655035 >> 172.21.15.144:0/369655035 conn(0x7f47b806bc10 msgr2=0x7f47b806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:52.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47bd600640 1 -- 172.21.15.144:0/369655035 shutdown_connections 2024-09-12T12:22:52.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.946+0000 7f47bd600640 1 -- 172.21.15.144:0/369655035 wait complete. 2024-09-12T12:22:52.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 Processor -- start 2024-09-12T12:22:52.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 -- start start 2024-09-12T12:22:52.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b806cff0 0x7f47b8144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:52.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b8073360 0x7f47b8148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:52.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47b8156c10 0x7f47b814abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8073d20 con 0x7f47b806cff0 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8073ba0 con 0x7f47b8156c10 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47b8156ff0 con 0x7f47b8073360 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b806cff0 0x7f47b8144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b806cff0 0x7f47b8144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44598/0 (socket says 172.21.15.144:44598) 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b6a00640 1 -- 172.21.15.144:0/2670861444 learned_addr learned my addr 172.21.15.144:0/2670861444 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47afe00640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b8073360 0x7f47b8148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b7400640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47b8156c10 0x7f47b814abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b6a00640 1 -- 172.21.15.144:0/2670861444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b8073360 msgr2=0x7f47b8148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b6a00640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b8073360 0x7f47b8148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b6a00640 1 -- 172.21.15.144:0/2670861444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47b8156c10 msgr2=0x7f47b814abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b6a00640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47b8156c10 0x7f47b814abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b6a00640 1 -- 172.21.15.144:0/2670861444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b814a3a0 con 0x7f47b806cff0 2024-09-12T12:22:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b7400640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47b8156c10 0x7f47b814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:22:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47b6a00640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b806cff0 0x7f47b8144930 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f47a800c4f0 tx=0x7f47a800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47aea00640 1 -- 172.21.15.144:0/2670861444 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8017070 con 0x7f47b806cff0 2024-09-12T12:22:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47aea00640 1 -- 172.21.15.144:0/2670861444 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8005cf0 con 0x7f47b806cff0 2024-09-12T12:22:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47aea00640 1 -- 172.21.15.144:0/2670861444 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8007270 con 0x7f47b806cff0 2024-09-12T12:22:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b8156210 con 0x7f47b806cff0 2024-09-12T12:22:52.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b8144fd0 con 0x7f47b806cff0 2024-09-12T12:22:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.950+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b806d450 con 0x7f47b806cff0 2024-09-12T12:22:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.954+0000 7f47aea00640 1 -- 172.21.15.144:0/2670861444 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47a801a070 con 0x7f47b806cff0 2024-09-12T12:22:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.954+0000 7f47aea00640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47940678c0 0x7f4794069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.954+0000 7f47aea00640 1 -- 172.21.15.144:0/2670861444 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 6274+0+0 (secure 0 0 0) 0x7f47a8085250 con 0x7f47b806cff0 2024-09-12T12:22:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.954+0000 7f47afe00640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47940678c0 0x7f4794069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.954+0000 7f47afe00640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47940678c0 0x7f4794069d80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f47a00af000 tx=0x7f47a00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:52.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:52.958+0000 7f47aea00640 1 -- 172.21.15.144:0/2670861444 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f47a8055460 con 0x7f47b806cff0 2024-09-12T12:22:53.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.114+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f47b806dd80 con 0x7f47b806cff0 2024-09-12T12:22:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.774+0000 7f47aea00640 1 -- 172.21.15.144:0/2670861444 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v156) ==== 181+0+0 (secure 0 0 0) 0x7f47a8059760 con 0x7f47b806cff0 2024-09-12T12:22:53.775 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:22:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.774+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47940678c0 msgr2=0x7f4794069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.774+0000 7f47bd600640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47940678c0 0x7f4794069d80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f47a00af000 tx=0x7f47a00a7000 comp rx=0 tx=0).stop 2024-09-12T12:22:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.774+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b806cff0 msgr2=0x7f47b8144930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.774+0000 7f47bd600640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b806cff0 0x7f47b8144930 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f47a800c4f0 tx=0x7f47a800c9b0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.778+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 shutdown_connections 2024-09-12T12:22:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.778+0000 7f47bd600640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47940678c0 0x7f4794069d80 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.778+0000 7f47bd600640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47b8156c10 0x7f47b814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.778+0000 7f47bd600640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47b8073360 0x7f47b8148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.778+0000 7f47bd600640 1 --2- 172.21.15.144:0/2670861444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47b806cff0 0x7f47b8144930 secure :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f47a800c4f0 tx=0x7f47a800c9b0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.778+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 >> 172.21.15.144:0/2670861444 conn(0x7f47b806bc10 msgr2=0x7f47b814ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:53.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.778+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 shutdown_connections 2024-09-12T12:22:53.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.778+0000 7f47bd600640 1 -- 172.21.15.144:0/2670861444 wait complete. 2024-09-12T12:22:53.800 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:22:53.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.938+0000 7f5fa0200640 1 Processor -- start 2024-09-12T12:22:53.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.938+0000 7f5fa0200640 1 -- start start 2024-09-12T12:22:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5fa0200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5f9806cff0 0x7f5f9806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5fa0200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f980cc150 0x7f5f980cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5fa0200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f9806cd20 con 0x7f5f980cce70 2024-09-12T12:22:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5fa0200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5f980733d0 con 0x7f5f980cc150 2024-09-12T12:22:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5fa0200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5f9806d910 con 0x7f5f9806cff0 2024-09-12T12:22:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5f9ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f980cc150 0x7f5f980cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5f9ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f980cc150 0x7f5f980cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44614/0 (socket says 172.21.15.144:44614) 2024-09-12T12:22:53.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5f9ce00640 1 -- 172.21.15.144:0/2240526890 learned_addr learned my addr 172.21.15.144:0/2240526890 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5f9ce00640 1 -- 172.21.15.144:0/2240526890 >> v2:172.21.15.165:3300/0 conn(0x7f5f9806cff0 msgr2=0x7f5f9806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5f9ce00640 1 --2- 172.21.15.144:0/2240526890 >> v2:172.21.15.165:3300/0 conn(0x7f5f9806cff0 0x7f5f9806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5f9ce00640 1 -- 172.21.15.144:0/2240526890 >> v1:172.21.15.144:6789/0 conn(0x7f5f980cce70 legacy=0x7f5f980cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.942+0000 7f5f9ce00640 1 -- 172.21.15.144:0/2240526890 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f980ccaf0 con 0x7f5f980cc150 2024-09-12T12:22:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5f9ce00640 1 --2- 172.21.15.144:0/2240526890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cc150 0x7f5f980cc5b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f5f980cdfb0 tx=0x7f5f8401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625211f2eae9f4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5f97e00640 1 -- 172.21.15.144:0/2240526890 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f840aa650 con 0x7f5f980cc150 2024-09-12T12:22:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5f97e00640 1 -- 172.21.15.144:0/2240526890 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f840af070 con 0x7f5f980cc150 2024-09-12T12:22:53.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5f97e00640 1 -- 172.21.15.144:0/2240526890 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f840aaa10 con 0x7f5f980cc150 2024-09-12T12:22:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 -- 172.21.15.144:0/2240526890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cc150 msgr2=0x7f5f980cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 --2- 172.21.15.144:0/2240526890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cc150 0x7f5f980cc5b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f5f980cdfb0 tx=0x7f5f8401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 -- 172.21.15.144:0/2240526890 shutdown_connections 2024-09-12T12:22:53.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 --2- 172.21.15.144:0/2240526890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cc150 0x7f5f980cc5b0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 --2- 172.21.15.144:0/2240526890 >> v2:172.21.15.165:3300/0 conn(0x7f5f9806cff0 0x7f5f9806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 -- 172.21.15.144:0/2240526890 >> 172.21.15.144:0/2240526890 conn(0x7f5f9806bc10 msgr2=0x7f5f9806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 -- 172.21.15.144:0/2240526890 shutdown_connections 2024-09-12T12:22:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 -- 172.21.15.144:0/2240526890 wait complete. 2024-09-12T12:22:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 Processor -- start 2024-09-12T12:22:53.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 -- start start 2024-09-12T12:22:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9806cff0 0x7f5f9813d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f980cc150 0x7f5f980cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cce70 0x7f5f980cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f980741f0 con 0x7f5f980cce70 2024-09-12T12:22:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98073f10 con 0x7f5f9806cff0 2024-09-12T12:22:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5fa0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9815eb90 con 0x7f5f980cc150 2024-09-12T12:22:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.946+0000 7f5f9e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cce70 0x7f5f980cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cce70 0x7f5f980cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44620/0 (socket says 172.21.15.144:44620) 2024-09-12T12:22:53.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9e200640 1 -- 172.21.15.144:0/2300929604 learned_addr learned my addr 172.21.15.144:0/2300929604 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9d800640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9806cff0 0x7f5f9813d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:53.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9ce00640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f980cc150 0x7f5f980cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9e200640 1 -- 172.21.15.144:0/2300929604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f980cc150 msgr2=0x7f5f980cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9e200640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f980cc150 0x7f5f980cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9e200640 1 -- 172.21.15.144:0/2300929604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9806cff0 msgr2=0x7f5f9813d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9e200640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9806cff0 0x7f5f9813d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9e200640 1 -- 172.21.15.144:0/2300929604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9813d590 con 0x7f5f980cce70 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f9e200640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cce70 0x7f5f980cb690 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000c340 tx=0x7f5f9000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f95600640 1 -- 172.21.15.144:0/2300929604 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f90005220 con 0x7f5f980cce70 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f95600640 1 -- 172.21.15.144:0/2300929604 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f900053c0 con 0x7f5f980cce70 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f95600640 1 -- 172.21.15.144:0/2300929604 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f90007270 con 0x7f5f980cce70 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f98161580 con 0x7f5f980cce70 2024-09-12T12:22:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f98161b40 con 0x7f5f980cce70 2024-09-12T12:22:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9806d3d0 con 0x7f5f980cce70 2024-09-12T12:22:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f95600640 1 -- 172.21.15.144:0/2300929604 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f90019020 con 0x7f5f980cce70 2024-09-12T12:22:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f95600640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f780678c0 0x7f5f78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:53.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.950+0000 7f5f95600640 1 -- 172.21.15.144:0/2300929604 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5836+0+0 (secure 0 0 0) 0x7f5f90084f70 con 0x7f5f980cce70 2024-09-12T12:22:53.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.954+0000 7f5f9d800640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f780678c0 0x7f5f78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:53.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.954+0000 7f5f9d800640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f780678c0 0x7f5f78069d80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5f980cbcf0 tx=0x7f5f8c00d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:53.958+0000 7f5f95600640 1 -- 172.21.15.144:0/2300929604 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5f90055340 con 0x7f5f980cce70 2024-09-12T12:22:54.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.118+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5f9815cf00 con 0x7f5f980cce70 2024-09-12T12:22:54.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5f95600640 1 -- 172.21.15.144:0/2300929604 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v157) ==== 169+0+0 (secure 0 0 0) 0x7f5f90059640 con 0x7f5f980cce70 2024-09-12T12:22:54.777 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:22:54.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f780678c0 msgr2=0x7f5f78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f780678c0 0x7f5f78069d80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5f980cbcf0 tx=0x7f5f8c00d040 comp rx=0 tx=0).stop 2024-09-12T12:22:54.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cce70 msgr2=0x7f5f980cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cce70 0x7f5f980cb690 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f5f9000c340 tx=0x7f5f9000c800 comp rx=0 tx=0).stop 2024-09-12T12:22:54.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 shutdown_connections 2024-09-12T12:22:54.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5f780678c0 0x7f5f78069d80 secure :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5f980cbcf0 tx=0x7f5f8c00d040 comp rx=0 tx=0).stop 2024-09-12T12:22:54.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f980cce70 0x7f5f980cb690 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f980cc150 0x7f5f980cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 --2- 172.21.15.144:0/2300929604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9806cff0 0x7f5f9813d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 >> 172.21.15.144:0/2300929604 conn(0x7f5f9806bc10 msgr2=0x7f5f980cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:54.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 shutdown_connections 2024-09-12T12:22:54.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.778+0000 7f5fa0200640 1 -- 172.21.15.144:0/2300929604 wait complete. 2024-09-12T12:22:54.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:22:54.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.954+0000 7f2664600640 1 Processor -- start 2024-09-12T12:22:54.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.954+0000 7f2664600640 1 -- start start 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2664600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f265c0cd9f0 0x7f265c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2664600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15b340 0x7f265c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2664600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f265c0b4300 con 0x7f265c15af60 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2664600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f265c0b32f0 con 0x7f265c0cd9f0 2024-09-12T12:22:54.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2664600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f265c0b3540 con 0x7f265c15b340 2024-09-12T12:22:54.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2662600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15b340 0x7f265c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2661200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f265c0cd9f0 0x7f265c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2662600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15b340 0x7f265c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:44104/0 (socket says 172.21.15.144:44104) 2024-09-12T12:22:54.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2662600640 1 -- 172.21.15.144:0/756135223 learned_addr learned my addr 172.21.15.144:0/756135223 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:54.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2662600640 1 -- 172.21.15.144:0/756135223 >> v2:172.21.15.165:3300/0 conn(0x7f265c0cd9f0 msgr2=0x7f265c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:54.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2662600640 1 --2- 172.21.15.144:0/756135223 >> v2:172.21.15.165:3300/0 conn(0x7f265c0cd9f0 0x7f265c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2662600640 1 -- 172.21.15.144:0/756135223 >> v1:172.21.15.165:6789/0 conn(0x7f265c15af60 legacy=0x7f265c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.958+0000 7f2662600640 1 -- 172.21.15.144:0/756135223 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265c0b3820 con 0x7f265c15b340 2024-09-12T12:22:54.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2662600640 1 --2- 172.21.15.144:0/756135223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15b340 0x7f265c06c150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2654009870 tx=0x7f265401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8551a0124e83cf7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:54.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f265be00640 1 -- 172.21.15.144:0/756135223 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26540b2070 con 0x7f265c15b340 2024-09-12T12:22:54.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f265be00640 1 -- 172.21.15.144:0/756135223 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26540a9070 con 0x7f265c15b340 2024-09-12T12:22:54.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f265be00640 1 -- 172.21.15.144:0/756135223 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26540ad880 con 0x7f265c15b340 2024-09-12T12:22:54.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 -- 172.21.15.144:0/756135223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15b340 msgr2=0x7f265c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 --2- 172.21.15.144:0/756135223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15b340 0x7f265c06c150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2654009870 tx=0x7f265401c560 comp rx=0 tx=0).stop 2024-09-12T12:22:54.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 -- 172.21.15.144:0/756135223 shutdown_connections 2024-09-12T12:22:54.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 --2- 172.21.15.144:0/756135223 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15b340 0x7f265c06c150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 --2- 172.21.15.144:0/756135223 >> v2:172.21.15.165:3300/0 conn(0x7f265c0cd9f0 0x7f265c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 -- 172.21.15.144:0/756135223 >> 172.21.15.144:0/756135223 conn(0x7f265c068030 msgr2=0x7f265c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:54.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 -- 172.21.15.144:0/756135223 shutdown_connections 2024-09-12T12:22:54.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 -- 172.21.15.144:0/756135223 wait complete. 2024-09-12T12:22:54.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 Processor -- start 2024-09-12T12:22:54.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.962+0000 7f2664600640 1 -- start start 2024-09-12T12:22:54.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2664600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f265c0cd9f0 0x7f265c149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2664600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15af60 0x7f265c15e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2664600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265c15b340 0x7f265c1f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2664600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f265c0b5140 con 0x7f265c15b340 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2664600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f265c0b4fc0 con 0x7f265c0cd9f0 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2664600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f265c0b52c0 con 0x7f265c15af60 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2662600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265c15b340 0x7f265c1f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2662600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265c15b340 0x7f265c1f77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44622/0 (socket says 172.21.15.144:44622) 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2661c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f265c0cd9f0 0x7f265c149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2662600640 1 -- 172.21.15.144:0/4289556508 learned_addr learned my addr 172.21.15.144:0/4289556508 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:54.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2661200640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15af60 0x7f265c15e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2662600640 1 -- 172.21.15.144:0/4289556508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15af60 msgr2=0x7f265c15e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2662600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15af60 0x7f265c15e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2662600640 1 -- 172.21.15.144:0/4289556508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f265c0cd9f0 msgr2=0x7f265c149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2662600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f265c0cd9f0 0x7f265c149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2662600640 1 -- 172.21.15.144:0/4289556508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265c147e70 con 0x7f265c15b340 2024-09-12T12:22:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2662600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265c15b340 0x7f265c1f77c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f26540b0040 tx=0x7f2654019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2659600640 1 -- 172.21.15.144:0/4289556508 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26540bb070 con 0x7f265c15b340 2024-09-12T12:22:54.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2659600640 1 -- 172.21.15.144:0/4289556508 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26540adc60 con 0x7f265c15b340 2024-09-12T12:22:54.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2659600640 1 -- 172.21.15.144:0/4289556508 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26540b2040 con 0x7f265c15b340 2024-09-12T12:22:54.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265c1f8010 con 0x7f265c15b340 2024-09-12T12:22:54.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f265c1f85d0 con 0x7f265c15b340 2024-09-12T12:22:54.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f265c0ce680 con 0x7f265c15b340 2024-09-12T12:22:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.966+0000 7f2659600640 1 -- 172.21.15.144:0/4289556508 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26540ab070 con 0x7f265c15b340 2024-09-12T12:22:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.970+0000 7f2659600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f263c0678c0 0x7f263c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.970+0000 7f2659600640 1 -- 172.21.15.144:0/4289556508 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5335+0+0 (secure 0 0 0) 0x7f265411e7c0 con 0x7f265c15b340 2024-09-12T12:22:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.970+0000 7f2661c00640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f263c0678c0 0x7f263c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:54.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.970+0000 7f2661c00640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f263c0678c0 0x7f263c069d80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f265c0af450 tx=0x7f2650009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:54.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:54.974+0000 7f2659600640 1 -- 172.21.15.144:0/4289556508 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2654016150 con 0x7f265c15b340 2024-09-12T12:22:55.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.130+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f265c0afc20 con 0x7f265c15b340 2024-09-12T12:22:55.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.134+0000 7f2659600640 1 -- 172.21.15.144:0/4289556508 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7f26540eed80 con 0x7f265c15b340 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f263c0678c0 msgr2=0x7f263c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f263c0678c0 0x7f263c069d80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f265c0af450 tx=0x7f2650009040 comp rx=0 tx=0).stop 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265c15b340 msgr2=0x7f265c1f77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265c15b340 0x7f265c1f77c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f26540b0040 tx=0x7f2654019300 comp rx=0 tx=0).stop 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 shutdown_connections 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f263c0678c0 0x7f263c069d80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f265c15b340 0x7f265c1f77c0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f265c15af60 0x7f265c15e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 --2- 172.21.15.144:0/4289556508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f265c0cd9f0 0x7f265c149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 >> 172.21.15.144:0/4289556508 conn(0x7f265c068030 msgr2=0x7f265c0b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:55.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 shutdown_connections 2024-09-12T12:22:55.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.138+0000 7f2664600640 1 -- 172.21.15.144:0/4289556508 wait complete. 2024-09-12T12:22:55.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-12T12:22:55.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fba01a00640 1 Processor -- start 2024-09-12T12:22:55.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fba01a00640 1 -- start start 2024-09-12T12:22:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fba01a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 0x7fb9fc0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fba01a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb9fc0b0720 0x7fb9fc072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fba01a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9fc0aeba0 con 0x7fb9fc072b70 2024-09-12T12:22:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fba01a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb9fc0b0b60 con 0x7fb9fc0b0720 2024-09-12T12:22:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fba01a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc0aee40 con 0x7fb9fc15e5d0 2024-09-12T12:22:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fb9f3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb9fc0b0720 0x7fb9fc072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fb9fbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 0x7fb9fc0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fba01000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fb9fc072b70 0x7fb9fc161f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53380/0 (socket says 172.21.15.144:53380) 2024-09-12T12:22:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fba01000640 1 -- 172.21.15.144:0/4160185225 learned_addr learned my addr 172.21.15.144:0/4160185225 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fb9f3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb9fc0b0720 0x7fb9fc072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44152/0 (socket says 172.21.15.144:44152) 2024-09-12T12:22:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fb9fbe00640 1 -- 172.21.15.144:0/4160185225 >> v2:172.21.15.165:3300/0 conn(0x7fb9fc0b0720 msgr2=0x7fb9fc072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fb9fbe00640 1 --2- 172.21.15.144:0/4160185225 >> v2:172.21.15.165:3300/0 conn(0x7fb9fc0b0720 0x7fb9fc072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fb9fbe00640 1 -- 172.21.15.144:0/4160185225 >> v1:172.21.15.165:6789/0 conn(0x7fb9fc072b70 legacy=0x7fb9fc161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.294+0000 7fb9fbe00640 1 -- 172.21.15.144:0/4160185225 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc0af120 con 0x7fb9fc15e5d0 2024-09-12T12:22:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fb9fbe00640 1 --2- 172.21.15.144:0/4160185225 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 0x7fb9fc0b01e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0097c0 tx=0x7fb9ec01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b7a52ed49cc4176 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fb9fb400640 1 -- 172.21.15.144:0/4160185225 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0b0070 con 0x7fb9fc15e5d0 2024-09-12T12:22:55.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fb9fb400640 1 -- 172.21.15.144:0/4160185225 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ec0ab600 con 0x7fb9fc15e5d0 2024-09-12T12:22:55.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fb9fb400640 1 -- 172.21.15.144:0/4160185225 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0ab9d0 con 0x7fb9fc15e5d0 2024-09-12T12:22:55.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fba01a00640 1 -- 172.21.15.144:0/4160185225 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 msgr2=0x7fb9fc0b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fba01a00640 1 --2- 172.21.15.144:0/4160185225 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 0x7fb9fc0b01e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0097c0 tx=0x7fb9ec01c410 comp rx=0 tx=0).stop 2024-09-12T12:22:55.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fba01a00640 1 -- 172.21.15.144:0/4160185225 shutdown_connections 2024-09-12T12:22:55.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fba01a00640 1 --2- 172.21.15.144:0/4160185225 >> v2:172.21.15.165:3300/0 conn(0x7fb9fc0b0720 0x7fb9fc072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fba01a00640 1 --2- 172.21.15.144:0/4160185225 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 0x7fb9fc0b01e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fba01a00640 1 -- 172.21.15.144:0/4160185225 >> 172.21.15.144:0/4160185225 conn(0x7fb9fc06e060 msgr2=0x7fb9fc06e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:55.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fba01a00640 1 -- 172.21.15.144:0/4160185225 shutdown_connections 2024-09-12T12:22:55.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fba01a00640 1 -- 172.21.15.144:0/4160185225 wait complete. 2024-09-12T12:22:55.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.298+0000 7fba01a00640 1 Processor -- start 2024-09-12T12:22:55.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 -- start start 2024-09-12T12:22:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc072b70 0x7fb9fc163050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9fc0b0720 0x7fb9fc153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 0x7fb9fc15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc0afd80 con 0x7fb9fc072b70 2024-09-12T12:22:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc0afc00 con 0x7fb9fc0b0720 2024-09-12T12:22:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc16b2a0 con 0x7fb9fc15e5d0 2024-09-12T12:22:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc072b70 0x7fb9fc163050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc072b70 0x7fb9fc163050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44632/0 (socket says 172.21.15.144:44632) 2024-09-12T12:22:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9fbe00640 1 -- 172.21.15.144:0/2132584349 learned_addr learned my addr 172.21.15.144:0/2132584349 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9f3e00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9fc0b0720 0x7fb9fc153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01000640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 0x7fb9fc15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9fbe00640 1 -- 172.21.15.144:0/2132584349 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 msgr2=0x7fb9fc15a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9fbe00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 0x7fb9fc15a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9fbe00640 1 -- 172.21.15.144:0/2132584349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9fc0b0720 msgr2=0x7fb9fc153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9fbe00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9fc0b0720 0x7fb9fc153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9fbe00640 1 -- 172.21.15.144:0/2132584349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc1fa880 con 0x7fb9fc072b70 2024-09-12T12:22:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9fbe00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc072b70 0x7fb9fc163050 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0097c0 tx=0x7fb9ec0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9f8c00640 1 -- 172.21.15.144:0/2132584349 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0b0040 con 0x7fb9fc072b70 2024-09-12T12:22:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9f8c00640 1 -- 172.21.15.144:0/2132584349 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ec0bc070 con 0x7fb9fc072b70 2024-09-12T12:22:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fb9f8c00640 1 -- 172.21.15.144:0/2132584349 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0b5680 con 0x7fb9fc072b70 2024-09-12T12:22:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc1fab60 con 0x7fb9fc072b70 2024-09-12T12:22:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc1fb120 con 0x7fb9fc072b70 2024-09-12T12:22:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.302+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc072630 con 0x7fb9fc072b70 2024-09-12T12:22:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.306+0000 7fb9f8c00640 1 -- 172.21.15.144:0/2132584349 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9ec0b3070 con 0x7fb9fc072b70 2024-09-12T12:22:55.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.306+0000 7fb9f8c00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9d80678c0 0x7fb9d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.306+0000 7fb9f8c00640 1 -- 172.21.15.144:0/2132584349 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5335+0+0 (secure 0 0 0) 0x7fb9ec11fbf0 con 0x7fb9fc072b70 2024-09-12T12:22:55.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.306+0000 7fb9f3e00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9d80678c0 0x7fb9d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.306+0000 7fb9f3e00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9d80678c0 0x7fb9d8069d80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0b4fd0 tx=0x7fb9e4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:55.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.310+0000 7fb9f8c00640 1 -- 172.21.15.144:0/2132584349 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb9ec016090 con 0x7fb9fc072b70 2024-09-12T12:22:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.558+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7fb9fc06c880 con 0x7fb9fc072b70 2024-09-12T12:22:55.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fb9f8c00640 1 -- 172.21.15.144:0/2132584349 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v503) ==== 166+0+0 (secure 0 0 0) 0x7fb9ec0f02d0 con 0x7fb9fc072b70 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9d80678c0 msgr2=0x7fb9d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9d80678c0 0x7fb9d8069d80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0b4fd0 tx=0x7fb9e4009190 comp rx=0 tx=0).stop 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc072b70 msgr2=0x7fb9fc163050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc072b70 0x7fb9fc163050 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0097c0 tx=0x7fb9ec0191b0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 shutdown_connections 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9d80678c0 0x7fb9d8069d80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9fc15e5d0 0x7fb9fc15a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9fc0b0720 0x7fb9fc153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 --2- 172.21.15.144:0/2132584349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9fc072b70 0x7fb9fc163050 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 >> 172.21.15.144:0/2132584349 conn(0x7fb9fc06e060 msgr2=0x7fb9fc0b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 shutdown_connections 2024-09-12T12:22:55.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.778+0000 7fba01a00640 1 -- 172.21.15.144:0/2132584349 wait complete. 2024-09-12T12:22:55.801 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-12T12:22:55.801 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-12T12:22:55.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:22:55.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae8a000640 1 Processor -- start 2024-09-12T12:22:55.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae8a000640 1 -- start start 2024-09-12T12:22:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae8a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae840ce950 0x7fae840b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae8a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 0x7fae8415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae8a000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8415c480 con 0x7fae8415c0a0 2024-09-12T12:22:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae8a000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fae841609e0 con 0x7fae840ce950 2024-09-12T12:22:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae8a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fae8415fdd0 con 0x7fae840b7230 2024-09-12T12:22:55.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae83e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae840ce950 0x7fae840b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae83e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae840ce950 0x7fae840b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44646/0 (socket says 172.21.15.144:44646) 2024-09-12T12:22:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae83e00640 1 -- 172.21.15.144:0/2723625022 learned_addr learned my addr 172.21.15.144:0/2723625022 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae88c00640 1 --1- 172.21.15.144:0/2723625022 >> v1:172.21.15.144:6789/0 conn(0x7fae8415c0a0 0x7fae840b6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44080/0 (socket says 172.21.15.144:44080) 2024-09-12T12:22:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae89600640 1 --2- 172.21.15.144:0/2723625022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 0x7fae8415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae83e00640 1 -- 172.21.15.144:0/2723625022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 msgr2=0x7fae8415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae83e00640 1 --2- 172.21.15.144:0/2723625022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 0x7fae8415d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae83e00640 1 -- 172.21.15.144:0/2723625022 >> v1:172.21.15.144:6789/0 conn(0x7fae8415c0a0 legacy=0x7fae840b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.938+0000 7fae83e00640 1 -- 172.21.15.144:0/2723625022 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae841600b0 con 0x7fae840ce950 2024-09-12T12:22:55.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae83e00640 1 --2- 172.21.15.144:0/2723625022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 0x7fae840b5310 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fae70009870 tx=0x7fae7001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254e837775f8d09c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:55.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae83400640 1 -- 172.21.15.144:0/2723625022 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae700b1070 con 0x7fae840ce950 2024-09-12T12:22:55.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae83400640 1 -- 172.21.15.144:0/2723625022 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae700ac620 con 0x7fae840ce950 2024-09-12T12:22:55.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae83400640 1 -- 172.21.15.144:0/2723625022 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae700ac9f0 con 0x7fae840ce950 2024-09-12T12:22:55.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 -- 172.21.15.144:0/2723625022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 msgr2=0x7fae840b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 --2- 172.21.15.144:0/2723625022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 0x7fae840b5310 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fae70009870 tx=0x7fae7001c4d0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 -- 172.21.15.144:0/2723625022 shutdown_connections 2024-09-12T12:22:55.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 --2- 172.21.15.144:0/2723625022 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 0x7fae8415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 --2- 172.21.15.144:0/2723625022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 0x7fae840b5310 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 -- 172.21.15.144:0/2723625022 >> 172.21.15.144:0/2723625022 conn(0x7fae840d2280 msgr2=0x7fae840d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:55.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 -- 172.21.15.144:0/2723625022 shutdown_connections 2024-09-12T12:22:55.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 -- 172.21.15.144:0/2723625022 wait complete. 2024-09-12T12:22:55.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 Processor -- start 2024-09-12T12:22:55.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.942+0000 7fae8a000640 1 -- start start 2024-09-12T12:22:55.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae8a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 0x7fae841fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae8a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 0x7fae84148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae8a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae8415c0a0 0x7fae8406e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae8a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fae84073c70 con 0x7fae840ce950 2024-09-12T12:22:55.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae8a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fae84073af0 con 0x7fae8415c0a0 2024-09-12T12:22:55.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae8a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fae84073df0 con 0x7fae840b7230 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 0x7fae84148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 0x7fae84148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44658/0 (socket says 172.21.15.144:44658) 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae83e00640 1 -- 172.21.15.144:0/3764823447 learned_addr learned my addr 172.21.15.144:0/3764823447 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae88c00640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 0x7fae841fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae89600640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae8415c0a0 0x7fae8406e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae83e00640 1 -- 172.21.15.144:0/3764823447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 msgr2=0x7fae841fa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae83e00640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 0x7fae841fa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae83e00640 1 -- 172.21.15.144:0/3764823447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae8415c0a0 msgr2=0x7fae8406e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae83e00640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae8415c0a0 0x7fae8406e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae83e00640 1 -- 172.21.15.144:0/3764823447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae84152ee0 con 0x7fae840ce950 2024-09-12T12:22:55.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae83e00640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 0x7fae84148c20 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fae700af040 tx=0x7fae70019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae80c00640 1 -- 172.21.15.144:0/3764823447 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae700bc070 con 0x7fae840ce950 2024-09-12T12:22:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae80c00640 1 -- 172.21.15.144:0/3764823447 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae700b7630 con 0x7fae840ce950 2024-09-12T12:22:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae841531c0 con 0x7fae840ce950 2024-09-12T12:22:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae80c00640 1 -- 172.21.15.144:0/3764823447 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae700b1040 con 0x7fae840ce950 2024-09-12T12:22:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae84153a60 con 0x7fae840ce950 2024-09-12T12:22:55.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae84153390 con 0x7fae840ce950 2024-09-12T12:22:55.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.946+0000 7fae80c00640 1 -- 172.21.15.144:0/3764823447 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae700bf070 con 0x7fae840ce950 2024-09-12T12:22:55.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.950+0000 7fae80c00640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae640678f0 0x7fae64069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.950+0000 7fae80c00640 1 -- 172.21.15.144:0/3764823447 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5335+0+0 (secure 0 0 0) 0x7fae7011f400 con 0x7fae840ce950 2024-09-12T12:22:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.950+0000 7fae88c00640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae640678f0 0x7fae64069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:55.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.950+0000 7fae88c00640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae640678f0 0x7fae64069db0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fae840ce7d0 tx=0x7fae78007cf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:55.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:55.954+0000 7fae80c00640 1 -- 172.21.15.144:0/3764823447 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fae70016150 con 0x7fae840ce950 2024-09-12T12:22:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.110+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae8415d0c0 con 0x7fae840ce950 2024-09-12T12:22:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.110+0000 7fae80c00640 1 -- 172.21.15.144:0/3764823447 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+13341 (secure 0 0 0) 0x7fae7011de20 con 0x7fae840ce950 2024-09-12T12:22:56.113 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:56.113 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":157,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:22:54.778685+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.165:6835/1602168377":"2024-09-13T12:22:51.772961+0000","172.21.15.165:6833/1602168377":"2024-09-13T12:22:51.772961+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:22:56.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae640678f0 msgr2=0x7fae64069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae640678f0 0x7fae64069db0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fae840ce7d0 tx=0x7fae78007cf0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 msgr2=0x7fae84148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 0x7fae84148c20 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fae700af040 tx=0x7fae70019270 comp rx=0 tx=0).stop 2024-09-12T12:22:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 shutdown_connections 2024-09-12T12:22:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fae640678f0 0x7fae64069db0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae8415c0a0 0x7fae8406e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae840ce950 0x7fae84148c20 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 --2- 172.21.15.144:0/3764823447 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae840b7230 0x7fae841fa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 >> 172.21.15.144:0/3764823447 conn(0x7fae840d2280 msgr2=0x7fae8406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 shutdown_connections 2024-09-12T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.114+0000 7fae8a000640 1 -- 172.21.15.144:0/3764823447 wait complete. 2024-09-12T12:22:56.135 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:22:56.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:22:56.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dd2800640 1 Processor -- start 2024-09-12T12:22:56.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dd2800640 1 -- start start 2024-09-12T12:22:56.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dd2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3dcc15c2e0 0x7f3dcc072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dd2800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3dcc0af5f0 0x7f3dcc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dd2800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dcc0733e0 con 0x7f3dcc06c150 2024-09-12T12:22:56.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dd2800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3dcc06c5c0 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dd2800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3dcc0cd290 con 0x7f3dcc0af5f0 2024-09-12T12:22:56.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dcb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3dcc15c2e0 0x7f3dcc072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dcb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3dcc15c2e0 0x7f3dcc072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44664/0 (socket says 172.21.15.144:44664) 2024-09-12T12:22:56.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dcb400640 1 -- 172.21.15.144:0/3950565437 learned_addr learned my addr 172.21.15.144:0/3950565437 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:56.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/3950565437 >> v2:172.21.15.165:3300/0 conn(0x7f3dcc0af5f0 0x7f3dcc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dcb400640 1 -- 172.21.15.144:0/3950565437 >> v2:172.21.15.165:3300/0 conn(0x7f3dcc0af5f0 msgr2=0x7f3dcc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:56.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dcb400640 1 --2- 172.21.15.144:0/3950565437 >> v2:172.21.15.165:3300/0 conn(0x7f3dcc0af5f0 0x7f3dcc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dcb400640 1 -- 172.21.15.144:0/3950565437 >> v1:172.21.15.165:6789/0 conn(0x7f3dcc06c150 legacy=0x7f3dcc06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:56.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.274+0000 7f3dcb400640 1 -- 172.21.15.144:0/3950565437 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc0cd570 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dcb400640 1 --2- 172.21.15.144:0/3950565437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 0x7f3dcc072b50 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0afa60 tx=0x7f3dbc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0c49373b0604f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:56.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dcaa00640 1 -- 172.21.15.144:0/3950565437 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0b0070 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dcaa00640 1 -- 172.21.15.144:0/3950565437 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0ab600 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dcaa00640 1 -- 172.21.15.144:0/3950565437 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0ab9d0 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dd2800640 1 -- 172.21.15.144:0/3950565437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 msgr2=0x7f3dcc072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dd2800640 1 --2- 172.21.15.144:0/3950565437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 0x7f3dcc072b50 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0afa60 tx=0x7f3dbc01c3c0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dd2800640 1 -- 172.21.15.144:0/3950565437 shutdown_connections 2024-09-12T12:22:56.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dd2800640 1 --2- 172.21.15.144:0/3950565437 >> v2:172.21.15.165:3300/0 conn(0x7f3dcc0af5f0 0x7f3dcc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dd2800640 1 --2- 172.21.15.144:0/3950565437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 0x7f3dcc072b50 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dd2800640 1 -- 172.21.15.144:0/3950565437 >> 172.21.15.144:0/3950565437 conn(0x7f3dcc068030 msgr2=0x7f3dcc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:56.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dd2800640 1 -- 172.21.15.144:0/3950565437 shutdown_connections 2024-09-12T12:22:56.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.278+0000 7f3dd2800640 1 -- 172.21.15.144:0/3950565437 wait complete. 2024-09-12T12:22:56.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 Processor -- start 2024-09-12T12:22:56.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 -- start start 2024-09-12T12:22:56.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dcc06c150 0x7f3dcc14a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dcc0af5f0 0x7f3dcc1504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 0x7f3dcc14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc1690a0 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3dcc168f20 con 0x7f3dcc06c150 2024-09-12T12:22:56.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3dcc169220 con 0x7f3dcc0af5f0 2024-09-12T12:22:56.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 0x7f3dcc14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcb400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dcc06c150 0x7f3dcc14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 0x7f3dcc14dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44668/0 (socket says 172.21.15.144:44668) 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcbe00640 1 -- 172.21.15.144:0/3982564169 learned_addr learned my addr 172.21.15.144:0/3982564169 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dcc0af5f0 0x7f3dcc1504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcbe00640 1 -- 172.21.15.144:0/3982564169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dcc0af5f0 msgr2=0x7f3dcc1504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcbe00640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dcc0af5f0 0x7f3dcc1504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcbe00640 1 -- 172.21.15.144:0/3982564169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dcc06c150 msgr2=0x7f3dcc14a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcbe00640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dcc06c150 0x7f3dcc14a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcbe00640 1 -- 172.21.15.144:0/3982564169 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dcc1544c0 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dcc0af5f0 0x7f3dcc1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dcbe00640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 0x7f3dcc14dce0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400c780 tx=0x7f3dc400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dc3400640 1 -- 172.21.15.144:0/3982564169 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4004b70 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dc3400640 1 -- 172.21.15.144:0/3982564169 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc4004d10 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dc3400640 1 -- 172.21.15.144:0/3982564169 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc400aa90 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dcc1547a0 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.282+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dcc154d60 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.286+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dcc06bc10 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.286+0000 7f3dc3400640 1 -- 172.21.15.144:0/3982564169 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3dc400ac30 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.286+0000 7f3dc3400640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3da80678f0 0x7f3da8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.286+0000 7f3dc3400640 1 -- 172.21.15.144:0/3982564169 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5335+0+0 (secure 0 0 0) 0x7f3dc4085e50 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.286+0000 7f3dcb400640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3da80678f0 0x7f3da8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.286+0000 7f3dcb400640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3da80678f0 0x7f3da8069db0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0ad000 tx=0x7f3dbc0a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:56.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.290+0000 7f3dc3400640 1 -- 172.21.15.144:0/3982564169 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3dc4020070 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3dcc0aee50 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dc3400640 1 -- 172.21.15.144:0/3982564169 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v157) ==== 93+0+10 (secure 0 0 0) 0x7f3dc40569d0 con 0x7f3dcc15c2e0 2024-09-12T12:22:56.452 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:22:56.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3da80678f0 msgr2=0x7f3da8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3da80678f0 0x7f3da8069db0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0ad000 tx=0x7f3dbc0a6000 comp rx=0 tx=0).stop 2024-09-12T12:22:56.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 msgr2=0x7f3dcc14dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 0x7f3dcc14dce0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400c780 tx=0x7f3dc400cc40 comp rx=0 tx=0).stop 2024-09-12T12:22:56.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 shutdown_connections 2024-09-12T12:22:56.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3da80678f0 0x7f3da8069db0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc15c2e0 0x7f3dcc14dce0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dcc0af5f0 0x7f3dcc1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 --2- 172.21.15.144:0/3982564169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dcc06c150 0x7f3dcc14a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 >> 172.21.15.144:0/3982564169 conn(0x7f3dcc068030 msgr2=0x7f3dcc159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:56.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 shutdown_connections 2024-09-12T12:22:56.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.450+0000 7f3dd2800640 1 -- 172.21.15.144:0/3982564169 wait complete. 2024-09-12T12:22:56.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-12T12:22:56.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddbe00640 1 Processor -- start 2024-09-12T12:22:56.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddbe00640 1 -- start start 2024-09-12T12:22:56.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc156660 0x7f7ddc0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7ddc160950 0x7f7ddc0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddbe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc15d3a0 con 0x7f7ddc15c7c0 2024-09-12T12:22:56.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddbe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7ddc06f9d0 con 0x7f7ddc160950 2024-09-12T12:22:56.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc15d680 con 0x7f7ddc156660 2024-09-12T12:22:56.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddaa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc156660 0x7f7ddc0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7dda000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7ddc160950 0x7f7ddc0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddb400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f7ddc15c7c0 0x7f7ddc06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53404/0 (socket says 172.21.15.144:53404) 2024-09-12T12:22:56.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7dda000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7ddc160950 0x7f7ddc0b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44178/0 (socket says 172.21.15.144:44178) 2024-09-12T12:22:56.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddb400640 1 -- 172.21.15.144:0/2227379486 learned_addr learned my addr 172.21.15.144:0/2227379486 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:56.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7dda000640 1 -- 172.21.15.144:0/2227379486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc156660 msgr2=0x7f7ddc0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:56.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7dda000640 1 --2- 172.21.15.144:0/2227379486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc156660 0x7f7ddc0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7dda000640 1 -- 172.21.15.144:0/2227379486 >> v1:172.21.15.165:6789/0 conn(0x7f7ddc15c7c0 legacy=0x7f7ddc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7dda000640 1 -- 172.21.15.144:0/2227379486 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc15fe70 con 0x7f7ddc160950 2024-09-12T12:22:56.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7ddaa00640 1 --2- 172.21.15.144:0/2227379486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc156660 0x7f7ddc0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:56.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.610+0000 7f7dd9600640 1 -- 172.21.15.144:0/2227379486 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321123628 0 0) 0x7f7ddc15d3a0 con 0x7f7ddc15c7c0 2024-09-12T12:22:56.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7dda000640 1 --2- 172.21.15.144:0/2227379486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ddc160950 0x7f7ddc0b3460 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80097c0 tx=0x7f7dc801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9de5df82460713e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:56.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7dd9600640 1 -- 172.21.15.144:0/2227379486 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80b1070 con 0x7f7ddc160950 2024-09-12T12:22:56.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7dd9600640 1 -- 172.21.15.144:0/2227379486 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc80a8050 con 0x7f7ddc160950 2024-09-12T12:22:56.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7dd9600640 1 -- 172.21.15.144:0/2227379486 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80ac860 con 0x7f7ddc160950 2024-09-12T12:22:56.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7ddbe00640 1 -- 172.21.15.144:0/2227379486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ddc160950 msgr2=0x7f7ddc0b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7ddbe00640 1 --2- 172.21.15.144:0/2227379486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ddc160950 0x7f7ddc0b3460 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80097c0 tx=0x7f7dc801c3e0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7ddbe00640 1 -- 172.21.15.144:0/2227379486 shutdown_connections 2024-09-12T12:22:56.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7ddbe00640 1 --2- 172.21.15.144:0/2227379486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ddc160950 0x7f7ddc0b3460 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7ddbe00640 1 --2- 172.21.15.144:0/2227379486 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc156660 0x7f7ddc0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7ddbe00640 1 -- 172.21.15.144:0/2227379486 >> 172.21.15.144:0/2227379486 conn(0x7f7ddc06e200 msgr2=0x7f7ddc06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:56.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7ddbe00640 1 -- 172.21.15.144:0/2227379486 shutdown_connections 2024-09-12T12:22:56.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.614+0000 7f7ddbe00640 1 -- 172.21.15.144:0/2227379486 wait complete. 2024-09-12T12:22:56.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 Processor -- start 2024-09-12T12:22:56.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 -- start start 2024-09-12T12:22:56.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ddc156660 0x7f7ddc160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc15c7c0 0x7f7ddc161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ddc160950 0x7f7ddc1f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc156bc0 con 0x7f7ddc160950 2024-09-12T12:22:56.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc156a40 con 0x7f7ddc156660 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc168e90 con 0x7f7ddc15c7c0 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ddc160950 0x7f7ddc1f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ddc160950 0x7f7ddc1f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44670/0 (socket says 172.21.15.144:44670) 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7dda000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc15c7c0 0x7f7ddc161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddb400640 1 -- 172.21.15.144:0/1413960913 learned_addr learned my addr 172.21.15.144:0/1413960913 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddaa00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ddc156660 0x7f7ddc160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddb400640 1 -- 172.21.15.144:0/1413960913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc15c7c0 msgr2=0x7f7ddc161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddb400640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc15c7c0 0x7f7ddc161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddb400640 1 -- 172.21.15.144:0/1413960913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ddc156660 msgr2=0x7f7ddc160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddb400640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ddc156660 0x7f7ddc160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:56.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddb400640 1 -- 172.21.15.144:0/1413960913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc161c60 con 0x7f7ddc160950 2024-09-12T12:22:56.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddb400640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ddc160950 0x7f7ddc1f6bd0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c7a0 tx=0x7f7dd400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:56.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7dd2a00640 1 -- 172.21.15.144:0/1413960913 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4018070 con 0x7f7ddc160950 2024-09-12T12:22:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7dd2a00640 1 -- 172.21.15.144:0/1413960913 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd400a640 con 0x7f7ddc160950 2024-09-12T12:22:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7dd2a00640 1 -- 172.21.15.144:0/1413960913 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400aab0 con 0x7f7ddc160950 2024-09-12T12:22:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc161f40 con 0x7f7ddc160950 2024-09-12T12:22:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ddc162500 con 0x7f7ddc160950 2024-09-12T12:22:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.618+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc06bc10 con 0x7f7ddc160950 2024-09-12T12:22:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.622+0000 7f7dd2a00640 1 -- 172.21.15.144:0/1413960913 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7dd401b070 con 0x7f7ddc160950 2024-09-12T12:22:56.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.622+0000 7f7dd2a00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7dbc0678c0 0x7f7dbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:56.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.622+0000 7f7dd2a00640 1 -- 172.21.15.144:0/1413960913 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5335+0+0 (secure 0 0 0) 0x7f7dd4085190 con 0x7f7ddc160950 2024-09-12T12:22:56.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.622+0000 7f7ddaa00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7dbc0678c0 0x7f7dbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:56.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.622+0000 7f7ddaa00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7dbc0678c0 0x7f7dbc069d80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc06c210 tx=0x7f7dcc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:56.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.626+0000 7f7dd2a00640 1 -- 172.21.15.144:0/1413960913 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7dd4055750 con 0x7f7ddc160950 2024-09-12T12:22:56.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:56.838+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f7ddc0b5500 con 0x7f7ddc160950 2024-09-12T12:22:57.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.786+0000 7f7dd2a00640 1 -- 172.21.15.144:0/1413960913 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v505) ==== 169+0+0 (secure 0 0 0) 0x7f7dd4059a50 con 0x7f7ddc160950 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7dbc0678c0 msgr2=0x7f7dbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7dbc0678c0 0x7f7dbc069d80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc06c210 tx=0x7f7dcc009190 comp rx=0 tx=0).stop 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ddc160950 msgr2=0x7f7ddc1f6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ddc160950 0x7f7ddc1f6bd0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c7a0 tx=0x7f7dd400cc60 comp rx=0 tx=0).stop 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 shutdown_connections 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7dbc0678c0 0x7f7dbc069d80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ddc160950 0x7f7ddc1f6bd0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ddc15c7c0 0x7f7ddc161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 --2- 172.21.15.144:0/1413960913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ddc156660 0x7f7ddc160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 >> 172.21.15.144:0/1413960913 conn(0x7f7ddc06e200 msgr2=0x7f7ddc0cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:57.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 shutdown_connections 2024-09-12T12:22:57.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.790+0000 7f7ddbe00640 1 -- 172.21.15.144:0/1413960913 wait complete. 2024-09-12T12:22:57.814 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:22:57.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba80e00640 1 Processor -- start 2024-09-12T12:22:57.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba80e00640 1 -- start start 2024-09-12T12:22:57.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba80e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba7c15c0b0 0x7fba7c15c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba80e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fba7c0b46b0 0x7fba7c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba80e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba7c160080 con 0x7fba7c0b6d60 2024-09-12T12:22:57.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba80e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fba7c160360 con 0x7fba7c15c0b0 2024-09-12T12:22:57.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba80e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fba7c160640 con 0x7fba7c0b46b0 2024-09-12T12:22:57.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba7b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba7c15c0b0 0x7fba7c15c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba7b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba7c15c0b0 0x7fba7c15c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60676/0 (socket says 172.21.15.144:60676) 2024-09-12T12:22:57.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba7b400640 1 -- 172.21.15.144:0/328724874 learned_addr learned my addr 172.21.15.144:0/328724874 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:57.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba7be00640 1 --2- 172.21.15.144:0/328724874 >> v2:172.21.15.165:3300/0 conn(0x7fba7c0b46b0 0x7fba7c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba7b400640 1 -- 172.21.15.144:0/328724874 >> v2:172.21.15.165:3300/0 conn(0x7fba7c0b46b0 msgr2=0x7fba7c0b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:57.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba7b400640 1 --2- 172.21.15.144:0/328724874 >> v2:172.21.15.165:3300/0 conn(0x7fba7c0b46b0 0x7fba7c0b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba7b400640 1 -- 172.21.15.144:0/328724874 >> v1:172.21.15.165:6789/0 conn(0x7fba7c0b6d60 legacy=0x7fba7c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:57.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.958+0000 7fba7b400640 1 -- 172.21.15.144:0/328724874 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c160920 con 0x7fba7c15c0b0 2024-09-12T12:22:57.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba7b400640 1 --2- 172.21.15.144:0/328724874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c15c0b0 0x7fba7c15c490 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0686f0 tx=0x7fba6c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f948405e87d6c8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:57.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba7a000640 1 -- 172.21.15.144:0/328724874 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0a5700 con 0x7fba7c15c0b0 2024-09-12T12:22:57.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba7a000640 1 -- 172.21.15.144:0/328724874 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba6c0a58a0 con 0x7fba7c15c0b0 2024-09-12T12:22:57.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba7a000640 1 -- 172.21.15.144:0/328724874 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0a5c70 con 0x7fba7c15c0b0 2024-09-12T12:22:57.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 -- 172.21.15.144:0/328724874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c15c0b0 msgr2=0x7fba7c15c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 --2- 172.21.15.144:0/328724874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c15c0b0 0x7fba7c15c490 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0686f0 tx=0x7fba6c01c930 comp rx=0 tx=0).stop 2024-09-12T12:22:57.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 -- 172.21.15.144:0/328724874 shutdown_connections 2024-09-12T12:22:57.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 --2- 172.21.15.144:0/328724874 >> v2:172.21.15.165:3300/0 conn(0x7fba7c0b46b0 0x7fba7c0b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 --2- 172.21.15.144:0/328724874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c15c0b0 0x7fba7c15c490 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 -- 172.21.15.144:0/328724874 >> 172.21.15.144:0/328724874 conn(0x7fba7c0b7c30 msgr2=0x7fba7c067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:57.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 -- 172.21.15.144:0/328724874 shutdown_connections 2024-09-12T12:22:57.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 -- 172.21.15.144:0/328724874 wait complete. 2024-09-12T12:22:57.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 Processor -- start 2024-09-12T12:22:57.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 -- start start 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7c0b46b0 0x7fba7c13ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c0b6d60 0x7fba7c06dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7c15c0b0 0x7fba7c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c073c40 con 0x7fba7c0b6d60 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c073ac0 con 0x7fba7c0b46b0 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba80e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fba7c073dc0 con 0x7fba7c15c0b0 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba7aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c0b6d60 0x7fba7c06dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba7aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c0b6d60 0x7fba7c06dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60680/0 (socket says 172.21.15.144:60680) 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.962+0000 7fba7aa00640 1 -- 172.21.15.144:0/1238424571 learned_addr learned my addr 172.21.15.144:0/1238424571 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7b400640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7c0b46b0 0x7fba7c13ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7be00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7c15c0b0 0x7fba7c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7aa00640 1 -- 172.21.15.144:0/1238424571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7c15c0b0 msgr2=0x7fba7c06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7aa00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7c15c0b0 0x7fba7c06e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7aa00640 1 -- 172.21.15.144:0/1238424571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7c0b46b0 msgr2=0x7fba7c13ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7aa00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7c0b46b0 0x7fba7c13ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7aa00640 1 -- 172.21.15.144:0/1238424571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c159350 con 0x7fba7c0b6d60 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7be00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7c15c0b0 0x7fba7c06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7aa00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c0b6d60 0x7fba7c06dfd0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fba6800c450 tx=0x7fba6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba73400640 1 -- 172.21.15.144:0/1238424571 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68016020 con 0x7fba7c0b6d60 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba73400640 1 -- 172.21.15.144:0/1238424571 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba680052d0 con 0x7fba7c0b6d60 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba73400640 1 -- 172.21.15.144:0/1238424571 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68007260 con 0x7fba7c0b6d60 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba7c159630 con 0x7fba7c0b6d60 2024-09-12T12:22:57.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba7c159bf0 con 0x7fba7c0b6d60 2024-09-12T12:22:57.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba7c0b71b0 con 0x7fba7c0b6d60 2024-09-12T12:22:57.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba73400640 1 -- 172.21.15.144:0/1238424571 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba68007400 con 0x7fba7c0b6d60 2024-09-12T12:22:57.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba73400640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fba5c0678c0 0x7fba5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:57.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba73400640 1 -- 172.21.15.144:0/1238424571 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5335+0+0 (secure 0 0 0) 0x7fba68085460 con 0x7fba7c0b6d60 2024-09-12T12:22:57.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.966+0000 7fba7b400640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fba5c0678c0 0x7fba5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:57.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.970+0000 7fba7b400640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fba5c0678c0 0x7fba5c069d80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0ae000 tx=0x7fba6c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:57.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:57.970+0000 7fba73400640 1 -- 172.21.15.144:0/1238424571 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fba68020020 con 0x7fba7c0b6d60 2024-09-12T12:22:58.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.130+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fba7c0d15e0 con 0x7fba7c0b6d60 2024-09-12T12:22:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba73400640 1 -- 172.21.15.144:0/1238424571 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7fba68005480 con 0x7fba7c0b6d60 2024-09-12T12:22:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fba5c0678c0 msgr2=0x7fba5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fba5c0678c0 0x7fba5c069d80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fba6c0ae000 tx=0x7fba6c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:22:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c0b6d60 msgr2=0x7fba7c06dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c0b6d60 0x7fba7c06dfd0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fba6800c450 tx=0x7fba6800c910 comp rx=0 tx=0).stop 2024-09-12T12:22:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 shutdown_connections 2024-09-12T12:22:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fba5c0678c0 0x7fba5c069d80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7c15c0b0 0x7fba7c06e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7c0b6d60 0x7fba7c06dfd0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 --2- 172.21.15.144:0/1238424571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7c0b46b0 0x7fba7c13ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 >> 172.21.15.144:0/1238424571 conn(0x7fba7c0b7c30 msgr2=0x7fba7c0b53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:58.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 shutdown_connections 2024-09-12T12:22:58.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.134+0000 7fba80e00640 1 -- 172.21.15.144:0/1238424571 wait complete. 2024-09-12T12:22:58.157 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:22:58.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:22:58.260 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:22:58.355 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:22:58.355 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:22:58.355 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:58.364 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:22:58.365 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:22:58.365 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:58.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:22:58.375 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:22:58.375 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:58.414 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:22:58.414 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:22:58.414 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:22:58.424 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:22:58.425 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:22:58.425 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:22:58.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.590+0000 7f177c000640 1 Processor -- start 2024-09-12T12:22:58.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.590+0000 7f177c000640 1 -- start start 2024-09-12T12:22:58.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177c000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f17740b49e0 0x7f177415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740b3590 0x7f17740b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177c000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17740b3aa0 con 0x7f177415ad50 2024-09-12T12:22:58.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177c000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f177415f860 con 0x7f17740b49e0 2024-09-12T12:22:58.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f17740cdeb0 con 0x7f17740b3590 2024-09-12T12:22:58.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1779600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f177415ad50 0x7f17740b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43170/0 (socket says 172.21.15.144:43170) 2024-09-12T12:22:58.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1779600640 1 -- 172.21.15.144:0/3998159026 learned_addr learned my addr 172.21.15.144:0/3998159026 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:58.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1778c00640 1 --2- 172.21.15.144:0/3998159026 >> v2:172.21.15.165:3300/0 conn(0x7f17740b49e0 0x7f177415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177a000640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740b3590 0x7f17740b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835809059 0 0) 0x7f17740b3aa0 con 0x7f177415ad50 2024-09-12T12:22:58.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f175c003530 con 0x7f177415ad50 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2814947732 0 0) 0x7f175c003530 con 0x7f177415ad50 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740b3590 msgr2=0x7f17740b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740b3590 0x7f17740b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 >> v2:172.21.15.165:3300/0 conn(0x7f17740b49e0 msgr2=0x7f177415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 --2- 172.21.15.144:0/3998159026 >> v2:172.21.15.165:3300/0 conn(0x7f17740b49e0 0x7f177415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17740afc10 con 0x7f177415ad50 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f1768001a00 con 0x7f177415ad50 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 >> v1:172.21.15.144:6789/0 conn(0x7f177415ad50 legacy=0x7f17740b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f175c0039c0 0x7f175c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740b3590 0x7f175c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f175c004d50 0x7f175c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f177415f860 con 0x7f175c004d50 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f17740cdeb0 con 0x7f175c0039c0 2024-09-12T12:22:58.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f175c00b9d0 con 0x7f17740b3590 2024-09-12T12:22:58.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177a000640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f175c004d50 0x7f175c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1779600640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f175c0039c0 0x7f175c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f1778c00640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740b3590 0x7f175c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177a000640 1 -- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740b3590 msgr2=0x7f175c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:58.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177a000640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740b3590 0x7f175c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177a000640 1 -- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f175c0039c0 msgr2=0x7f175c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:58.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177a000640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f175c0039c0 0x7f175c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.594+0000 7f177a000640 1 -- 172.21.15.144:0/3998159026 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c003530 con 0x7f175c004d50 2024-09-12T12:22:58.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f177a000640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f175c004d50 0x7f175c0051d0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f176c009ab0 tx=0x7f176c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195a059664e1fca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:58.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c0b2070 con 0x7f175c004d50 2024-09-12T12:22:58.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c0a5640 con 0x7f175c004d50 2024-09-12T12:22:58.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f1773e00640 1 -- 172.21.15.144:0/3998159026 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c0096b0 con 0x7f175c004d50 2024-09-12T12:22:58.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f177c000640 1 -- 172.21.15.144:0/3998159026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f175c004d50 msgr2=0x7f175c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f177c000640 1 --2- 172.21.15.144:0/3998159026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f175c004d50 0x7f175c0051d0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f176c009ab0 tx=0x7f176c01ca50 comp rx=0 tx=0).stop 2024-09-12T12:22:58.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f177a000640 1 -- 172.21.15.144:0/3998159026 reap_dead start 2024-09-12T12:22:58.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f177c000640 1 -- 172.21.15.144:0/3998159026 shutdown_connections 2024-09-12T12:22:58.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f177c000640 1 -- 172.21.15.144:0/3998159026 >> 172.21.15.144:0/3998159026 conn(0x7f177406d0d0 msgr2=0x7f177406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:58.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f177c000640 1 -- 172.21.15.144:0/3998159026 shutdown_connections 2024-09-12T12:22:58.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.598+0000 7f177c000640 1 -- 172.21.15.144:0/3998159026 wait complete. 2024-09-12T12:22:58.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 Processor -- start 2024-09-12T12:22:58.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 -- start start 2024-09-12T12:22:58.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f175c004d50 0x7f17740738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740731d0 0x7f177414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774150610 0x7f1774150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f177415b130 con 0x7f1774150610 2024-09-12T12:22:58.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f17740b01d0 con 0x7f175c004d50 2024-09-12T12:22:58.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f177415b2b0 con 0x7f17740731d0 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774150610 0x7f1774150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f1778c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740731d0 0x7f177414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f1779600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f175c004d50 0x7f17740738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774150610 0x7f1774150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60696/0 (socket says 172.21.15.144:60696) 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177a000640 1 -- 172.21.15.144:0/2110692216 learned_addr learned my addr 172.21.15.144:0/2110692216 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f1778c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740731d0 0x7f177414fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:52780/0 (socket says 172.21.15.144:52780) 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177a000640 1 -- 172.21.15.144:0/2110692216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740731d0 msgr2=0x7f177414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177a000640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740731d0 0x7f177414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177a000640 1 -- 172.21.15.144:0/2110692216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f175c004d50 msgr2=0x7f17740738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177a000640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f175c004d50 0x7f17740738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177a000640 1 -- 172.21.15.144:0/2110692216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17741f8010 con 0x7f1774150610 2024-09-12T12:22:58.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f1778c00640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740731d0 0x7f177414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:58.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177a000640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774150610 0x7f1774150a90 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f176c01cf30 tx=0x7f175c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:58.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f1771600640 1 -- 172.21.15.144:0/2110692216 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c0bc070 con 0x7f1774150610 2024-09-12T12:22:58.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f1771600640 1 -- 172.21.15.144:0/2110692216 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176c000e50 con 0x7f1774150610 2024-09-12T12:22:58.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17741f82f0 con 0x7f1774150610 2024-09-12T12:22:58.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f1771600640 1 -- 172.21.15.144:0/2110692216 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c0b2040 con 0x7f1774150610 2024-09-12T12:22:58.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17741f88b0 con 0x7f1774150610 2024-09-12T12:22:58.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.602+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f177415f320 con 0x7f1774150610 2024-09-12T12:22:58.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.606+0000 7f1771600640 1 -- 172.21.15.144:0/2110692216 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f176c0bf070 con 0x7f1774150610 2024-09-12T12:22:58.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.606+0000 7f1771600640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17540678c0 0x7f1754069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:58.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.606+0000 7f1771600640 1 -- 172.21.15.144:0/2110692216 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5335+0+0 (secure 0 0 0) 0x7f176c11ee20 con 0x7f1774150610 2024-09-12T12:22:58.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.606+0000 7f1779600640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17540678c0 0x7f1754069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:58.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.606+0000 7f1779600640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17540678c0 0x7f1754069d80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1774072f50 tx=0x7f1768006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:58.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.610+0000 7f1771600640 1 -- 172.21.15.144:0/2110692216 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f176c016760 con 0x7f1774150610 2024-09-12T12:22:58.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.806+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17740aeaa0 con 0x7f1774150610 2024-09-12T12:22:58.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.806+0000 7f1771600640 1 -- 172.21.15.144:0/2110692216 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+3928 (secure 0 0 0) 0x7f176c0ef3e0 con 0x7f1774150610 2024-09-12T12:22:58.808 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:22:58.808 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":116,"btime":"2024-09-12T12:22:52:775366+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3892244204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3892244204},{"type":"v1","addr":"172.21.15.165:6834","nonce":3892244204}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8392,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/3564225871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3564225871},{"type":"v1","addr":"172.21.15.144:6836","nonce":3564225871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8770,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3767217205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3767217205},{"type":"v1","addr":"172.21.15.165:6835","nonce":3767217205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2357854148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2357854148},{"type":"v1","addr":"172.21.15.144:6837","nonce":2357854148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110}],"filesystems":[]} 2024-09-12T12:22:58.808 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 116 2024-09-12T12:22:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17540678c0 msgr2=0x7f1754069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17540678c0 0x7f1754069d80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1774072f50 tx=0x7f1768006040 comp rx=0 tx=0).stop 2024-09-12T12:22:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774150610 msgr2=0x7f1774150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774150610 0x7f1774150a90 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f176c01cf30 tx=0x7f175c005840 comp rx=0 tx=0).stop 2024-09-12T12:22:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 shutdown_connections 2024-09-12T12:22:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f17540678c0 0x7f1754069d80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1774150610 0x7f1774150a90 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17740731d0 0x7f177414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 --2- 172.21.15.144:0/2110692216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f175c004d50 0x7f17740738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 >> 172.21.15.144:0/2110692216 conn(0x7f177406d0d0 msgr2=0x7f17740b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 shutdown_connections 2024-09-12T12:22:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:58.810+0000 7f177c000640 1 -- 172.21.15.144:0/2110692216 wait complete. 2024-09-12T12:22:58.830 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:22:58.831 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:22:58.831 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:22:58.831 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:22:58.831 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:22:58.831 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:22:58.831 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:22:58.832 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:22:58.832 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:22:58.832 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:22:58.832 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:22:58.832 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:22:58.832 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:22:58.832 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:22:58.833 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:22:58.833 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:22:58.843 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:22:58.843 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:22:58.845 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:22:58.845 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:22:58.846 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:22:58.846 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:22:58.847 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:22:58.848 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:22:58.888 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:22:58.888 DEBUG:teuthology.parallel:result is None 2024-09-12T12:22:58.890 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:22:58.890 DEBUG:teuthology.parallel:result is None 2024-09-12T12:22:58.891 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:22:58.891 DEBUG:teuthology.parallel:result is None 2024-09-12T12:22:58.893 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:22:58.893 DEBUG:teuthology.parallel:result is None 2024-09-12T12:22:58.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:22:58.974 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:22:58.975 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:22:58.982 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:22:58.983 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:22:59.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd642e00640 1 Processor -- start 2024-09-12T12:22:59.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd642e00640 1 -- start start 2024-09-12T12:22:59.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd642e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c15b4e0 0x7fd63c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd642e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd63c0ccf30 0x7fd63c0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd642e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd63c0b45a0 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd642e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd63c0b3fe0 con 0x7fd63c0ccf30 2024-09-12T12:22:59.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd642e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd63c0b42c0 con 0x7fd63c15b4e0 2024-09-12T12:22:59.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd640e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd63c0ccf30 0x7fd63c0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd63be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c15b4e0 0x7fd63c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd640e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd63c0ccf30 0x7fd63c0cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:48144/0 (socket says 172.21.15.144:48144) 2024-09-12T12:22:59.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd640e00640 1 -- 172.21.15.144:0/561017450 learned_addr learned my addr 172.21.15.144:0/561017450 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:59.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd640e00640 1 -- 172.21.15.144:0/561017450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c15b4e0 msgr2=0x7fd63c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:59.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd640e00640 1 --2- 172.21.15.144:0/561017450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c15b4e0 0x7fd63c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd640e00640 1 -- 172.21.15.144:0/561017450 >> v1:172.21.15.165:6789/0 conn(0x7fd63c0b3ad0 legacy=0x7fd63c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd640e00640 1 -- 172.21.15.144:0/561017450 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63c0b1490 con 0x7fd63c0ccf30 2024-09-12T12:22:59.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.038+0000 7fd63be00640 1 --2- 172.21.15.144:0/561017450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c15b4e0 0x7fd63c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:22:59.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd640e00640 1 --2- 172.21.15.144:0/561017450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd63c0ccf30 0x7fd63c0cd3e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd634009e50 tx=0x7fd63401ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32db7e59851b09d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:59.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd63b400640 1 -- 172.21.15.144:0/561017450 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6340a5750 con 0x7fd63c0ccf30 2024-09-12T12:22:59.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd63b400640 1 -- 172.21.15.144:0/561017450 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6340a58f0 con 0x7fd63c0ccf30 2024-09-12T12:22:59.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd63b400640 1 -- 172.21.15.144:0/561017450 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6340a5cc0 con 0x7fd63c0ccf30 2024-09-12T12:22:59.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 -- 172.21.15.144:0/561017450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd63c0ccf30 msgr2=0x7fd63c0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 --2- 172.21.15.144:0/561017450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd63c0ccf30 0x7fd63c0cd3e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd634009e50 tx=0x7fd63401ca30 comp rx=0 tx=0).stop 2024-09-12T12:22:59.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 -- 172.21.15.144:0/561017450 shutdown_connections 2024-09-12T12:22:59.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 --2- 172.21.15.144:0/561017450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd63c0ccf30 0x7fd63c0cd3e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 --2- 172.21.15.144:0/561017450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c15b4e0 0x7fd63c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 -- 172.21.15.144:0/561017450 >> 172.21.15.144:0/561017450 conn(0x7fd63c06d0d0 msgr2=0x7fd63c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:59.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 -- 172.21.15.144:0/561017450 shutdown_connections 2024-09-12T12:22:59.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 -- 172.21.15.144:0/561017450 wait complete. 2024-09-12T12:22:59.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 Processor -- start 2024-09-12T12:22:59.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.042+0000 7fd642e00640 1 -- start start 2024-09-12T12:22:59.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd642e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c0b3ad0 0x7fd63c15e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd642e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd63c0ccf30 0x7fd63c147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd642e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63c15b4e0 0x7fd63c156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd642e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c15b8c0 con 0x7fd63c15b4e0 2024-09-12T12:22:59.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd642e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c168260 con 0x7fd63c0ccf30 2024-09-12T12:22:59.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd642e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd63c0ce7c0 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd640e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63c15b4e0 0x7fd63c156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd63be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c0b3ad0 0x7fd63c15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd63be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c0b3ad0 0x7fd63c15e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:52818/0 (socket says 172.21.15.144:52818) 2024-09-12T12:22:59.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd63be00640 1 -- 172.21.15.144:0/1616255035 learned_addr learned my addr 172.21.15.144:0/1616255035 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:59.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd640e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63c15b4e0 0x7fd63c156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60730/0 (socket says 172.21.15.144:60730) 2024-09-12T12:22:59.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd633e00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd63c0ccf30 0x7fd63c147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd63be00640 1 -- 172.21.15.144:0/1616255035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd63c0ccf30 msgr2=0x7fd63c147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd63be00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd63c0ccf30 0x7fd63c147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd63be00640 1 -- 172.21.15.144:0/1616255035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63c15b4e0 msgr2=0x7fd63c156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd63be00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63c15b4e0 0x7fd63c156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd63be00640 1 -- 172.21.15.144:0/1616255035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63c0ceaa0 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd63be00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c0b3ad0 0x7fd63c15e470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00e980 tx=0x7fd62c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd638c00640 1 -- 172.21.15.144:0/1616255035 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c017070 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd638c00640 1 -- 172.21.15.144:0/1616255035 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62c00ca00 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63c0ced80 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd638c00640 1 -- 172.21.15.144:0/1616255035 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00cdd0 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd63c0cf340 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-12T12:22:59.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-12T12:22:59.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-12T12:22:59.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-12T12:22:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.046+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd63c0cd3e0 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.050+0000 7fd638c00640 1 -- 172.21.15.144:0/1616255035 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd62c01a070 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.050+0000 7fd638c00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6180678c0 0x7fd618069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.050+0000 7fd638c00640 1 -- 172.21.15.144:0/1616255035 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(157..157 src has 1..157) ==== 5335+0+0 (secure 0 0 0) 0x7fd62c085e10 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.050+0000 7fd633e00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6180678c0 0x7fd618069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.050+0000 7fd633e00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6180678c0 0x7fd618069d80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0af410 tx=0x7fd624009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:59.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.054+0000 7fd638c00640 1 -- 172.21.15.144:0/1616255035 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd62c089030 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.222+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd63c0686c0 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.801+0000 7fd638c00640 1 -- 172.21.15.144:0/1616255035 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v159) ==== 97+0+0 (secure 0 0 0) 0x7fd62c0563d0 con 0x7fd63c0b3ad0 2024-09-12T12:22:59.805 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:22:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6180678c0 msgr2=0x7fd618069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6180678c0 0x7fd618069d80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0af410 tx=0x7fd624009040 comp rx=0 tx=0).stop 2024-09-12T12:22:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c0b3ad0 msgr2=0x7fd63c15e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c0b3ad0 0x7fd63c15e470 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00e980 tx=0x7fd62c00ee40 comp rx=0 tx=0).stop 2024-09-12T12:22:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 shutdown_connections 2024-09-12T12:22:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd6180678c0 0x7fd618069d80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63c15b4e0 0x7fd63c156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd63c0ccf30 0x7fd63c147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 --2- 172.21.15.144:0/1616255035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd63c0b3ad0 0x7fd63c15e470 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 >> 172.21.15.144:0/1616255035 conn(0x7fd63c06d0d0 msgr2=0x7fd63c0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 shutdown_connections 2024-09-12T12:22:59.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.809+0000 7fd642e00640 1 -- 172.21.15.144:0/1616255035 wait complete. 2024-09-12T12:22:59.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:22:59.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367c000640 1 Processor -- start 2024-09-12T12:22:59.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367c000640 1 -- start start 2024-09-12T12:22:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367c000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3674161c40 0x7f3674071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367c000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f36740b4240 0x7f36740b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367c000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36741621a0 con 0x7f36740b6bf0 2024-09-12T12:22:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367c000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f36740b4bc0 con 0x7f36740b4240 2024-09-12T12:22:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367c000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f36740b7180 con 0x7f3674161c40 2024-09-12T12:22:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f36740b4240 0x7f36740b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f3678c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f36740b6bf0 0x7f367406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43188/0 (socket says 172.21.15.144:43188) 2024-09-12T12:22:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f3678c00640 1 -- 172.21.15.144:0/3856365310 learned_addr learned my addr 172.21.15.144:0/3856365310 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:22:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f3679600640 1 --2- 172.21.15.144:0/3856365310 >> v2:172.21.15.165:3300/0 conn(0x7f3674161c40 0x7f3674071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367a000640 1 -- 172.21.15.144:0/3856365310 >> v2:172.21.15.165:3300/0 conn(0x7f3674161c40 msgr2=0x7f3674071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:22:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367a000640 1 --2- 172.21.15.144:0/3856365310 >> v2:172.21.15.165:3300/0 conn(0x7f3674161c40 0x7f3674071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367a000640 1 -- 172.21.15.144:0/3856365310 >> v1:172.21.15.144:6789/0 conn(0x7f36740b6bf0 legacy=0x7f367406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.973+0000 7f367a000640 1 -- 172.21.15.144:0/3856365310 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36740b7460 con 0x7f36740b4240 2024-09-12T12:22:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367a000640 1 --2- 172.21.15.144:0/3856365310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36740b4240 0x7f36740b4680 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f3674069cb0 tx=0x7f366c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c574b595ce5e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f3673e00640 1 -- 172.21.15.144:0/3856365310 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0b2070 con 0x7f36740b4240 2024-09-12T12:22:59.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f3673e00640 1 -- 172.21.15.144:0/3856365310 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c0a5900 con 0x7f36740b4240 2024-09-12T12:22:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f3673e00640 1 -- 172.21.15.144:0/3856365310 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0a5cd0 con 0x7f36740b4240 2024-09-12T12:22:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 -- 172.21.15.144:0/3856365310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36740b4240 msgr2=0x7f36740b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 --2- 172.21.15.144:0/3856365310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36740b4240 0x7f36740b4680 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f3674069cb0 tx=0x7f366c01c930 comp rx=0 tx=0).stop 2024-09-12T12:22:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 -- 172.21.15.144:0/3856365310 shutdown_connections 2024-09-12T12:22:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 --2- 172.21.15.144:0/3856365310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36740b4240 0x7f36740b4680 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 --2- 172.21.15.144:0/3856365310 >> v2:172.21.15.165:3300/0 conn(0x7f3674161c40 0x7f3674071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 -- 172.21.15.144:0/3856365310 >> 172.21.15.144:0/3856365310 conn(0x7f367406f3c0 msgr2=0x7f367406f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:22:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 -- 172.21.15.144:0/3856365310 shutdown_connections 2024-09-12T12:22:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 -- 172.21.15.144:0/3856365310 wait complete. 2024-09-12T12:22:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 Processor -- start 2024-09-12T12:22:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.977+0000 7f367c000640 1 -- start start 2024-09-12T12:22:59.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36740b4240 0x7f3674167250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36740b6bf0 0x7f3674167790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3674161c40 0x7f367415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36740715d0 con 0x7f3674161c40 2024-09-12T12:22:59.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3674071450 con 0x7f36740b6bf0 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f367416b270 con 0x7f36740b4240 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3674161c40 0x7f367415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3674161c40 0x7f367415c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60754/0 (socket says 172.21.15.144:60754) 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367a000640 1 -- 172.21.15.144:0/2000279861 learned_addr learned my addr 172.21.15.144:0/2000279861 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f3678c00640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36740b6bf0 0x7f3674167790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f3679600640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36740b4240 0x7f3674167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367a000640 1 -- 172.21.15.144:0/2000279861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36740b4240 msgr2=0x7f3674167250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367a000640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36740b4240 0x7f3674167250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367a000640 1 -- 172.21.15.144:0/2000279861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36740b6bf0 msgr2=0x7f3674167790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367a000640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36740b6bf0 0x7f3674167790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:22:59.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367a000640 1 -- 172.21.15.144:0/2000279861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36740d1060 con 0x7f3674161c40 2024-09-12T12:22:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367a000640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3674161c40 0x7f367415c4b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f366c019540 tx=0x7f366c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f3671600640 1 -- 172.21.15.144:0/2000279861 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0b2050 con 0x7f3674161c40 2024-09-12T12:22:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f3671600640 1 -- 172.21.15.144:0/2000279861 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c0be070 con 0x7f3674161c40 2024-09-12T12:22:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f3671600640 1 -- 172.21.15.144:0/2000279861 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0b9690 con 0x7f3674161c40 2024-09-12T12:22:59.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367415dd90 con 0x7f3674161c40 2024-09-12T12:22:59.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367415d4f0 con 0x7f3674161c40 2024-09-12T12:22:59.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.981+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36740b4680 con 0x7f3674161c40 2024-09-12T12:22:59.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.985+0000 7f3671600640 1 -- 172.21.15.144:0/2000279861 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f366c0b9830 con 0x7f3674161c40 2024-09-12T12:22:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.985+0000 7f3671600640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36540678f0 0x7f3654069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:22:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.985+0000 7f3671600640 1 -- 172.21.15.144:0/2000279861 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5249+0+0 (secure 0 0 0) 0x7f366c1208a0 con 0x7f3674161c40 2024-09-12T12:22:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.985+0000 7f3679600640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36540678f0 0x7f3654069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:22:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.985+0000 7f3679600640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36540678f0 0x7f3654069db0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3674168230 tx=0x7f3668008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:22:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:22:59.989+0000 7f3671600640 1 -- 172.21.15.144:0/2000279861 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f366c016520 con 0x7f3674161c40 2024-09-12T12:23:00.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.201+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f36740d2270 con 0x7f3674161c40 2024-09-12T12:23:00.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.201+0000 7f3671600640 1 -- 172.21.15.144:0/2000279861 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f366c0f0ec0 con 0x7f3674161c40 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:23:00.202 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:23:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:23:00.205 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:23:00.207 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:23:00.208 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:23:00.209 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:23:00.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.210 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.211 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:23:00.212 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:23:00.212 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:23:00.212 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:23:00.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.212 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:23:00.212 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:23:00.213 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.213 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:23:00.213 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:23:00.213 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:23:00.213 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:23:00.213 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.213 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:23:00.214 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:23:00.214 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.214 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:23:00.214 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:23:00.214 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:23:00.214 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.215 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:23:00.216 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:23:00.216 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:23:00.216 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:23:00.216 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:23:00.216 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:23:00.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:23:00.216 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:23:00.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36540678f0 msgr2=0x7f3654069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36540678f0 0x7f3654069db0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3674168230 tx=0x7f3668008040 comp rx=0 tx=0).stop 2024-09-12T12:23:00.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3674161c40 msgr2=0x7f367415c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3674161c40 0x7f367415c4b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f366c019540 tx=0x7f366c0196d0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 shutdown_connections 2024-09-12T12:23:00.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f36540678f0 0x7f3654069db0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3674161c40 0x7f367415c4b0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36740b6bf0 0x7f3674167790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 --2- 172.21.15.144:0/2000279861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36740b4240 0x7f3674167250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 >> 172.21.15.144:0/2000279861 conn(0x7f367406f3c0 msgr2=0x7f36740cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:00.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 shutdown_connections 2024-09-12T12:23:00.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.205+0000 7f367c000640 1 -- 172.21.15.144:0/2000279861 wait complete. 2024-09-12T12:23:00.223 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:23:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6877e00640 1 Processor -- start 2024-09-12T12:23:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6877e00640 1 -- start start 2024-09-12T12:23:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6877e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f687816ae20 0x7f687816f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6877e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f687816b200 0x7f68780cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6877e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 0x7f6878073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6877e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f68780cefb0 con 0x7f687816b200 2024-09-12T12:23:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6877e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f68780cdb50 con 0x7f687816ae20 2024-09-12T12:23:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6877e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f68780cd2b0 con 0x7f68780735c0 2024-09-12T12:23:00.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6876000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f687816b200 0x7f68780cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6876a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f687816ae20 0x7f687816f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6876000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f687816b200 0x7f68780cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60766/0 (socket says 172.21.15.144:60766) 2024-09-12T12:23:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6876000640 1 -- 172.21.15.144:0/1334285240 learned_addr learned my addr 172.21.15.144:0/1334285240 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6877400640 1 --2- 172.21.15.144:0/1334285240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 0x7f6878073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6876000640 1 -- 172.21.15.144:0/1334285240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 msgr2=0x7f6878073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6876000640 1 --2- 172.21.15.144:0/1334285240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 0x7f6878073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6876000640 1 -- 172.21.15.144:0/1334285240 >> v2:172.21.15.165:3300/0 conn(0x7f687816ae20 msgr2=0x7f687816f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6876000640 1 --2- 172.21.15.144:0/1334285240 >> v2:172.21.15.165:3300/0 conn(0x7f687816ae20 0x7f687816f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.361+0000 7f6876000640 1 -- 172.21.15.144:0/1334285240 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68780cd590 con 0x7f687816b200 2024-09-12T12:23:00.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6876000640 1 --2- 172.21.15.144:0/1334285240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 0x7f68780cca60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f6878068850 tx=0x7f686001e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0675d9f42e5404 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:00.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6875600640 1 -- 172.21.15.144:0/1334285240 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600ad070 con 0x7f687816b200 2024-09-12T12:23:00.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6875600640 1 -- 172.21.15.144:0/1334285240 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68600a78d0 con 0x7f687816b200 2024-09-12T12:23:00.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6875600640 1 -- 172.21.15.144:0/1334285240 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686000be60 con 0x7f687816b200 2024-09-12T12:23:00.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6877e00640 1 -- 172.21.15.144:0/1334285240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 msgr2=0x7f68780cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6877e00640 1 --2- 172.21.15.144:0/1334285240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 0x7f68780cca60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f6878068850 tx=0x7f686001e950 comp rx=0 tx=0).stop 2024-09-12T12:23:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6877e00640 1 -- 172.21.15.144:0/1334285240 shutdown_connections 2024-09-12T12:23:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6877e00640 1 --2- 172.21.15.144:0/1334285240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 0x7f68780cca60 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6877e00640 1 --2- 172.21.15.144:0/1334285240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 0x7f6878073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6877e00640 1 --2- 172.21.15.144:0/1334285240 >> v2:172.21.15.165:3300/0 conn(0x7f687816ae20 0x7f687816f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6877e00640 1 -- 172.21.15.144:0/1334285240 >> 172.21.15.144:0/1334285240 conn(0x7f687806bc10 msgr2=0x7f687806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6877e00640 1 -- 172.21.15.144:0/1334285240 shutdown_connections 2024-09-12T12:23:00.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.365+0000 7f6877e00640 1 -- 172.21.15.144:0/1334285240 wait complete. 2024-09-12T12:23:00.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 Processor -- start 2024-09-12T12:23:00.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 -- start start 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 0x7f687815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f687816ae20 0x7f68780b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 0x7f68781664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f687806d6b0 con 0x7f687816b200 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f687806d530 con 0x7f687816ae20 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f687806d830 con 0x7f68780735c0 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 0x7f68781664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 0x7f68781664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60776/0 (socket says 172.21.15.144:60776) 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877400640 1 -- 172.21.15.144:0/2440927212 learned_addr learned my addr 172.21.15.144:0/2440927212 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:00.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6876a00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 0x7f687815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6876000640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f687816ae20 0x7f68780b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877400640 1 -- 172.21.15.144:0/2440927212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 msgr2=0x7f687815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877400640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 0x7f687815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877400640 1 -- 172.21.15.144:0/2440927212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f687816ae20 msgr2=0x7f68780b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877400640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f687816ae20 0x7f68780b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877400640 1 -- 172.21.15.144:0/2440927212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687815ef10 con 0x7f687816b200 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877400640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 0x7f68781664c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f687000efc0 tx=0x7f687000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f686ea00640 1 -- 172.21.15.144:0/2440927212 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870018020 con 0x7f687816b200 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f686ea00640 1 -- 172.21.15.144:0/2440927212 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6870014480 con 0x7f687816b200 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f686ea00640 1 -- 172.21.15.144:0/2440927212 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870014870 con 0x7f687816b200 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68780b1f80 con 0x7f687816b200 2024-09-12T12:23:00.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68780b2540 con 0x7f687816b200 2024-09-12T12:23:00.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.369+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6878073a70 con 0x7f687816b200 2024-09-12T12:23:00.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.373+0000 7f686ea00640 1 -- 172.21.15.144:0/2440927212 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f687001b020 con 0x7f687816b200 2024-09-12T12:23:00.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.373+0000 7f686ea00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68540678c0 0x7f6854069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.373+0000 7f686ea00640 1 -- 172.21.15.144:0/2440927212 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5249+0+0 (secure 0 0 0) 0x7f6870086800 con 0x7f687816b200 2024-09-12T12:23:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.373+0000 7f6876a00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68540678c0 0x7f6854069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.373+0000 7f6876a00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68540678c0 0x7f6854069d80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6878167150 tx=0x7f6868009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.377+0000 7f686ea00640 1 -- 172.21.15.144:0/2440927212 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6870022030 con 0x7f687816b200 2024-09-12T12:23:00.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f687808c3c0 con 0x7f687816b200 2024-09-12T12:23:00.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f686ea00640 1 -- 172.21.15.144:0/2440927212 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v161) ==== 84+0+65 (secure 0 0 0) 0x7f6870010040 con 0x7f687816b200 2024-09-12T12:23:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:00.535 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:23:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:23:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:23:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:23:00.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:00.535 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:23:00.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68540678c0 msgr2=0x7f6854069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68540678c0 0x7f6854069d80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6878167150 tx=0x7f6868009190 comp rx=0 tx=0).stop 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 msgr2=0x7f68781664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 0x7f68781664c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f687000efc0 tx=0x7f687000c490 comp rx=0 tx=0).stop 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 shutdown_connections 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68540678c0 0x7f6854069d80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f687816b200 0x7f68781664c0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f687816ae20 0x7f68780b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 --2- 172.21.15.144:0/2440927212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68780735c0 0x7f687815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 >> 172.21.15.144:0/2440927212 conn(0x7f687806bc10 msgr2=0x7f68780cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 shutdown_connections 2024-09-12T12:23:00.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.537+0000 7f6877e00640 1 -- 172.21.15.144:0/2440927212 wait complete. 2024-09-12T12:23:00.556 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:23:00.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:23:00.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5db2000640 1 Processor -- start 2024-09-12T12:23:00.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5db2000640 1 -- start start 2024-09-12T12:23:00.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5db2000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5dac147ea0 0x7f5dac15f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5db2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac072080 0x7f5dac06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5db2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dac06c150 0x7f5dac1620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5db2000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5dac06db70 con 0x7f5dac06c150 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5db2000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5dac06c5a0 con 0x7f5dac147ea0 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5db2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dac0731c0 con 0x7f5dac072080 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5dabe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dac06c150 0x7f5dac1620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5dabe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dac06c150 0x7f5dac1620c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60782/0 (socket says 172.21.15.144:60782) 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5dabe00640 1 -- 172.21.15.144:0/1528980936 learned_addr learned my addr 172.21.15.144:0/1528980936 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5dab400640 1 --2- 172.21.15.144:0/1528980936 >> v2:172.21.15.165:3300/0 conn(0x7f5dac147ea0 0x7f5dac15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5daaa00640 1 --2- 172.21.15.144:0/1528980936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac072080 0x7f5dac06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5dabe00640 1 -- 172.21.15.144:0/1528980936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac072080 msgr2=0x7f5dac06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:00.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5dabe00640 1 --2- 172.21.15.144:0/1528980936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac072080 0x7f5dac06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5dabe00640 1 -- 172.21.15.144:0/1528980936 >> v2:172.21.15.165:3300/0 conn(0x7f5dac147ea0 msgr2=0x7f5dac15f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:00.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5dabe00640 1 --2- 172.21.15.144:0/1528980936 >> v2:172.21.15.165:3300/0 conn(0x7f5dac147ea0 0x7f5dac15f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.697+0000 7f5dabe00640 1 -- 172.21.15.144:0/1528980936 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac15fa90 con 0x7f5dac06c150 2024-09-12T12:23:00.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5dabe00640 1 --2- 172.21.15.144:0/1528980936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac06c150 0x7f5dac1620c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0691b0 tx=0x7f5da401c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f660d9cc47766979 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:00.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5daa000640 1 -- 172.21.15.144:0/1528980936 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da40ac020 con 0x7f5dac06c150 2024-09-12T12:23:00.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5daa000640 1 -- 172.21.15.144:0/1528980936 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da40a6470 con 0x7f5dac06c150 2024-09-12T12:23:00.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5daa000640 1 -- 172.21.15.144:0/1528980936 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da40a6840 con 0x7f5dac06c150 2024-09-12T12:23:00.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5db2000640 1 -- 172.21.15.144:0/1528980936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac06c150 msgr2=0x7f5dac1620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5db2000640 1 --2- 172.21.15.144:0/1528980936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac06c150 0x7f5dac1620c0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0691b0 tx=0x7f5da401c5e0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5db2000640 1 -- 172.21.15.144:0/1528980936 shutdown_connections 2024-09-12T12:23:00.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5db2000640 1 --2- 172.21.15.144:0/1528980936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac06c150 0x7f5dac1620c0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5db2000640 1 --2- 172.21.15.144:0/1528980936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac072080 0x7f5dac06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5db2000640 1 --2- 172.21.15.144:0/1528980936 >> v2:172.21.15.165:3300/0 conn(0x7f5dac147ea0 0x7f5dac15f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5db2000640 1 -- 172.21.15.144:0/1528980936 >> 172.21.15.144:0/1528980936 conn(0x7f5dac06cd20 msgr2=0x7f5dac06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:00.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5db2000640 1 -- 172.21.15.144:0/1528980936 shutdown_connections 2024-09-12T12:23:00.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.701+0000 7f5db2000640 1 -- 172.21.15.144:0/1528980936 wait complete. 2024-09-12T12:23:00.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 Processor -- start 2024-09-12T12:23:00.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 -- start start 2024-09-12T12:23:00.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac06c150 0x7f5dac138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac072080 0x7f5dac13cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dac147ea0 0x7f5dac140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac148280 con 0x7f5dac072080 2024-09-12T12:23:00.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac072e50 con 0x7f5dac147ea0 2024-09-12T12:23:00.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dac073630 con 0x7f5dac06c150 2024-09-12T12:23:00.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5daaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac072080 0x7f5dac13cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5daaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac072080 0x7f5dac13cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60792/0 (socket says 172.21.15.144:60792) 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5daaa00640 1 -- 172.21.15.144:0/2620553377 learned_addr learned my addr 172.21.15.144:0/2620553377 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5dab400640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac06c150 0x7f5dac138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5dabe00640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dac147ea0 0x7f5dac140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5daaa00640 1 -- 172.21.15.144:0/2620553377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac06c150 msgr2=0x7f5dac138db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5daaa00640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac06c150 0x7f5dac138db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5daaa00640 1 -- 172.21.15.144:0/2620553377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dac147ea0 msgr2=0x7f5dac140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5daaa00640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dac147ea0 0x7f5dac140f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5daaa00640 1 -- 172.21.15.144:0/2620553377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac13b900 con 0x7f5dac072080 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5dabe00640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dac147ea0 0x7f5dac140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5daaa00640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac072080 0x7f5dac13cc20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400d800 tx=0x7f5d9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:00.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5da3400640 1 -- 172.21.15.144:0/2620553377 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94018020 con 0x7f5dac072080 2024-09-12T12:23:00.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5da3400640 1 -- 172.21.15.144:0/2620553377 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d94009660 con 0x7f5dac072080 2024-09-12T12:23:00.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5da3400640 1 -- 172.21.15.144:0/2620553377 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94009a50 con 0x7f5dac072080 2024-09-12T12:23:00.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dac13bbe0 con 0x7f5dac072080 2024-09-12T12:23:00.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.705+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac140a20 con 0x7f5dac072080 2024-09-12T12:23:00.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.709+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dac140c20 con 0x7f5dac072080 2024-09-12T12:23:00.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.709+0000 7f5da3400640 1 -- 172.21.15.144:0/2620553377 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d9401b020 con 0x7f5dac072080 2024-09-12T12:23:00.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.709+0000 7f5da3400640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5d880678c0 0x7f5d88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:00.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.709+0000 7f5da3400640 1 -- 172.21.15.144:0/2620553377 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5249+0+0 (secure 0 0 0) 0x7f5d94086050 con 0x7f5dac072080 2024-09-12T12:23:00.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.709+0000 7f5dab400640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5d880678c0 0x7f5d88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:00.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.709+0000 7f5dab400640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5d880678c0 0x7f5d88069d80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0b3940 tx=0x7f5d9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:00.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.713+0000 7f5da3400640 1 -- 172.21.15.144:0/2620553377 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5dac140c20 con 0x7f5dac072080 2024-09-12T12:23:00.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:00.877+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5dac06bc10 con 0x7f5dac072080 2024-09-12T12:23:01.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5da3400640 1 -- 172.21.15.144:0/2620553377 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v162) ==== 138+0+0 (secure 0 0 0) 0x7f5d94022020 con 0x7f5dac072080 2024-09-12T12:23:01.811 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5d880678c0 msgr2=0x7f5d88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5d880678c0 0x7f5d88069d80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0b3940 tx=0x7f5d9c008040 comp rx=0 tx=0).stop 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac072080 msgr2=0x7f5dac13cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac072080 0x7f5dac13cc20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400d800 tx=0x7f5d9400dcc0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 shutdown_connections 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5d880678c0 0x7f5d88069d80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dac147ea0 0x7f5dac140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dac072080 0x7f5dac13cc20 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 --2- 172.21.15.144:0/2620553377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dac06c150 0x7f5dac138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 >> 172.21.15.144:0/2620553377 conn(0x7f5dac06cd20 msgr2=0x7f5dac070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:01.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 shutdown_connections 2024-09-12T12:23:01.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.813+0000 7f5db2000640 1 -- 172.21.15.144:0/2620553377 wait complete. 2024-09-12T12:23:01.844 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:23:01.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.989+0000 7f2573800640 1 Processor -- start 2024-09-12T12:23:01.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.989+0000 7f2573800640 1 -- start start 2024-09-12T12:23:01.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2573800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f256c15c2e0 0x7f256c072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:01.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2573800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c0af5f0 0x7f256c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:01.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2573800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f256c06c150 0x7f256c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:01.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2573800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f256c06c5c0 con 0x7f256c15c2e0 2024-09-12T12:23:01.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2573800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f256c0733e0 con 0x7f256c06c150 2024-09-12T12:23:01.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2573800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f256c0cd290 con 0x7f256c0af5f0 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2570e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f256c15c2e0 0x7f256c072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2570e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f256c15c2e0 0x7f256c072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60794/0 (socket says 172.21.15.144:60794) 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2570e00640 1 -- 172.21.15.144:0/4191344158 learned_addr learned my addr 172.21.15.144:0/4191344158 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f256be00640 1 --2- 172.21.15.144:0/4191344158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c0af5f0 0x7f256c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2571800640 1 --2- 172.21.15.144:0/4191344158 >> v2:172.21.15.165:3300/0 conn(0x7f256c06c150 0x7f256c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2570e00640 1 -- 172.21.15.144:0/4191344158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c0af5f0 msgr2=0x7f256c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2570e00640 1 --2- 172.21.15.144:0/4191344158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c0af5f0 0x7f256c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2570e00640 1 -- 172.21.15.144:0/4191344158 >> v2:172.21.15.165:3300/0 conn(0x7f256c06c150 msgr2=0x7f256c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2570e00640 1 --2- 172.21.15.144:0/4191344158 >> v2:172.21.15.165:3300/0 conn(0x7f256c06c150 0x7f256c06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2570e00640 1 -- 172.21.15.144:0/4191344158 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c0cd570 con 0x7f256c15c2e0 2024-09-12T12:23:01.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.993+0000 7f2571800640 1 --2- 172.21.15.144:0/4191344158 >> v2:172.21.15.165:3300/0 conn(0x7f256c06c150 0x7f256c06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:01.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2570e00640 1 --2- 172.21.15.144:0/4191344158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c15c2e0 0x7f256c072b50 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f256c0aff30 tx=0x7f255c01c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b04388b7846191 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:01.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f256b400640 1 -- 172.21.15.144:0/4191344158 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0ac070 con 0x7f256c15c2e0 2024-09-12T12:23:01.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f256b400640 1 -- 172.21.15.144:0/4191344158 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c0a8410 con 0x7f256c15c2e0 2024-09-12T12:23:01.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f256b400640 1 -- 172.21.15.144:0/4191344158 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0a87e0 con 0x7f256c15c2e0 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 -- 172.21.15.144:0/4191344158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c15c2e0 msgr2=0x7f256c072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 --2- 172.21.15.144:0/4191344158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c15c2e0 0x7f256c072b50 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f256c0aff30 tx=0x7f255c01c610 comp rx=0 tx=0).stop 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 -- 172.21.15.144:0/4191344158 shutdown_connections 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 --2- 172.21.15.144:0/4191344158 >> v2:172.21.15.165:3300/0 conn(0x7f256c06c150 0x7f256c06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 --2- 172.21.15.144:0/4191344158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c0af5f0 0x7f256c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 --2- 172.21.15.144:0/4191344158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c15c2e0 0x7f256c072b50 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 -- 172.21.15.144:0/4191344158 >> 172.21.15.144:0/4191344158 conn(0x7f256c068030 msgr2=0x7f256c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 -- 172.21.15.144:0/4191344158 shutdown_connections 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 -- 172.21.15.144:0/4191344158 wait complete. 2024-09-12T12:23:01.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 Processor -- start 2024-09-12T12:23:01.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:01.997+0000 7f2573800640 1 -- start start 2024-09-12T12:23:01.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2573800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c06c150 0x7f256c15e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:01.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2573800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c0af5f0 0x7f256c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:01.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2573800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c15c2e0 0x7f256c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2573800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0cdef0 con 0x7f256c0af5f0 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2573800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0cdd70 con 0x7f256c15c2e0 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2573800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f256c0ce070 con 0x7f256c06c150 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f256be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c0af5f0 0x7f256c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f256be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c0af5f0 0x7f256c15ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60796/0 (socket says 172.21.15.144:60796) 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f256be00640 1 -- 172.21.15.144:0/1340462970 learned_addr learned my addr 172.21.15.144:0/1340462970 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2570e00640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c06c150 0x7f256c15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2571800640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c15c2e0 0x7f256c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f256be00640 1 -- 172.21.15.144:0/1340462970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c06c150 msgr2=0x7f256c15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f256be00640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c06c150 0x7f256c15e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f256be00640 1 -- 172.21.15.144:0/1340462970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c15c2e0 msgr2=0x7f256c15b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f256be00640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c15c2e0 0x7f256c15b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f256be00640 1 -- 172.21.15.144:0/1340462970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c15d550 con 0x7f256c0af5f0 2024-09-12T12:23:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f256be00640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c0af5f0 0x7f256c15ac20 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f255800d800 tx=0x7f255800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2568c00640 1 -- 172.21.15.144:0/1340462970 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255800b6c0 con 0x7f256c0af5f0 2024-09-12T12:23:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2568c00640 1 -- 172.21.15.144:0/1340462970 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2558019070 con 0x7f256c0af5f0 2024-09-12T12:23:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2568c00640 1 -- 172.21.15.144:0/1340462970 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255800ba60 con 0x7f256c0af5f0 2024-09-12T12:23:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256c15d830 con 0x7f256c0af5f0 2024-09-12T12:23:02.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256c157c20 con 0x7f256c0af5f0 2024-09-12T12:23:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f256c157a10 con 0x7f256c0af5f0 2024-09-12T12:23:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.001+0000 7f2568c00640 1 -- 172.21.15.144:0/1340462970 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f255800bc00 con 0x7f256c0af5f0 2024-09-12T12:23:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.005+0000 7f2568c00640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f254c0678c0 0x7f254c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.005+0000 7f2568c00640 1 -- 172.21.15.144:0/1340462970 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5619+0+0 (secure 0 0 0) 0x7f25580860a0 con 0x7f256c0af5f0 2024-09-12T12:23:02.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.005+0000 7f2570e00640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f254c0678c0 0x7f254c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:02.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.005+0000 7f2570e00640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f254c0678c0 0x7f254c069d80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f255c0ae000 tx=0x7f255c0b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:02.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.009+0000 7f2568c00640 1 -- 172.21.15.144:0/1340462970 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2558056b90 con 0x7f256c0af5f0 2024-09-12T12:23:02.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.165+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f256c06bc10 con 0x7f256c0af5f0 2024-09-12T12:23:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2568c00640 1 -- 172.21.15.144:0/1340462970 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v163) ==== 170+0+0 (secure 0 0 0) 0x7f2558056490 con 0x7f256c0af5f0 2024-09-12T12:23:02.814 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:23:02.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f254c0678c0 msgr2=0x7f254c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f254c0678c0 0x7f254c069d80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f255c0ae000 tx=0x7f255c0b3040 comp rx=0 tx=0).stop 2024-09-12T12:23:02.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c0af5f0 msgr2=0x7f256c15ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:02.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c0af5f0 0x7f256c15ac20 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f255800d800 tx=0x7f255800dc00 comp rx=0 tx=0).stop 2024-09-12T12:23:02.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 shutdown_connections 2024-09-12T12:23:02.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f254c0678c0 0x7f254c069d80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f256c15c2e0 0x7f256c15b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f256c0af5f0 0x7f256c15ac20 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 --2- 172.21.15.144:0/1340462970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f256c06c150 0x7f256c15e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:02.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 >> 172.21.15.144:0/1340462970 conn(0x7f256c068030 msgr2=0x7f256c0b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:02.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 shutdown_connections 2024-09-12T12:23:02.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.817+0000 7f2573800640 1 -- 172.21.15.144:0/1340462970 wait complete. 2024-09-12T12:23:02.854 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:23:02.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb122800640 1 Processor -- start 2024-09-12T12:23:02.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb122800640 1 -- start start 2024-09-12T12:23:02.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb122800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb11c0cd9f0 0x7fb11c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:02.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb122800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb11c0b4300 con 0x7fb11c15b340 2024-09-12T12:23:02.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb122800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb11c0b3540 con 0x7fb11c15af60 2024-09-12T12:23:02.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb122800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb11c0b32f0 con 0x7fb11c0cd9f0 2024-09-12T12:23:02.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb11c15b340 0x7fb11c0b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43196/0 (socket says 172.21.15.144:43196) 2024-09-12T12:23:02.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11be00640 1 -- 172.21.15.144:0/2617705801 learned_addr learned my addr 172.21.15.144:0/2617705801 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:02.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11aa00640 1 --2- 172.21.15.144:0/2617705801 >> v2:172.21.15.165:3300/0 conn(0x7fb11c0cd9f0 0x7fb11c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:02.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3145613112 0 0) 0x7fb11c0b4300 con 0x7fb11c15b340 2024-09-12T12:23:02.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb100003530 con 0x7fb11c15b340 2024-09-12T12:23:02.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450808286 0 0) 0x7fb11c0b3540 con 0x7fb11c15af60 2024-09-12T12:23:02.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb11c0b4300 con 0x7fb11c15af60 2024-09-12T12:23:02.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4160844593 0 0) 0x7fb100003530 con 0x7fb11c15b340 2024-09-12T12:23:02.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 >> v2:172.21.15.165:3300/0 conn(0x7fb11c0cd9f0 msgr2=0x7fb11c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:02.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 --2- 172.21.15.144:0/2617705801 >> v2:172.21.15.165:3300/0 conn(0x7fb11c0cd9f0 0x7fb11c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 >> v1:172.21.15.165:6789/0 conn(0x7fb11c15af60 legacy=0x7fb11c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11c0b3820 con 0x7fb11c15b340 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fb114001a00 con 0x7fb11c15b340 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 >> v1:172.21.15.144:6789/0 conn(0x7fb11c15b340 legacy=0x7fb11c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb100003b50 0x7fb100003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb100004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1000051d0 0x7fb10000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c0b32f0 con 0x7fb100004810 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb10000c050 con 0x7fb1000051d0 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb10000c250 con 0x7fb100003b50 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11aa00640 1 --2- 172.21.15.144:0/2617705801 >> v2:172.21.15.165:3300/0 conn(0x7fb11c0cd9f0 0x7fb11c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:03.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11aa00640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb100004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:03.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11b400640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb100003b50 0x7fb100003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:03.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:02.997+0000 7fb11be00640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1000051d0 0x7fb10000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:03.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11aa00640 1 -- 172.21.15.144:0/2617705801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb100003b50 msgr2=0x7fb100003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:03.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11aa00640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb100003b50 0x7fb100003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11aa00640 1 -- 172.21.15.144:0/2617705801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1000051d0 msgr2=0x7fb10000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:03.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11aa00640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1000051d0 0x7fb10000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11aa00640 1 -- 172.21.15.144:0/2617705801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb100003530 con 0x7fb100004810 2024-09-12T12:23:03.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11be00640 1 -- 172.21.15.144:0/2617705801 reap_dead start 2024-09-12T12:23:03.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11aa00640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb100004c90 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fb108009c90 tx=0x7fb10801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746cbdbf4c899786 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:03.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108009860 con 0x7fb100004810 2024-09-12T12:23:03.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb108004020 con 0x7fb100004810 2024-09-12T12:23:03.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb11a000640 1 -- 172.21.15.144:0/2617705801 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108004450 con 0x7fb100004810 2024-09-12T12:23:03.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb122800640 1 -- 172.21.15.144:0/2617705801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 msgr2=0x7fb100004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:03.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb122800640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb100004c90 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fb108009c90 tx=0x7fb10801cbf0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb122800640 1 -- 172.21.15.144:0/2617705801 shutdown_connections 2024-09-12T12:23:03.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb122800640 1 --2- 172.21.15.144:0/2617705801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb100004c90 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.001+0000 7fb122800640 1 -- 172.21.15.144:0/2617705801 >> 172.21.15.144:0/2617705801 conn(0x7fb11c068030 msgr2=0x7fb11c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:03.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 -- 172.21.15.144:0/2617705801 shutdown_connections 2024-09-12T12:23:03.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 -- 172.21.15.144:0/2617705801 wait complete. 2024-09-12T12:23:03.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 Processor -- start 2024-09-12T12:23:03.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 -- start start 2024-09-12T12:23:03.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb11c13ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:03.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb11c1f4290 0x7fb11c0ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:03.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb11c0aee00 0x7fb11c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:03.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c0ce680 con 0x7fb100004810 2024-09-12T12:23:03.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c0b3de0 con 0x7fb11c0aee00 2024-09-12T12:23:03.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb11c0ce800 con 0x7fb11c1f4290 2024-09-12T12:23:03.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb11c13ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:03.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb11c13ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60816/0 (socket says 172.21.15.144:60816) 2024-09-12T12:23:03.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11b400640 1 -- 172.21.15.144:0/1808895704 learned_addr learned my addr 172.21.15.144:0/1808895704 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:03.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11aa00640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb11c1f4290 0x7fb11c0ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:03.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11be00640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb11c0aee00 0x7fb11c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:03.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11b400640 1 -- 172.21.15.144:0/1808895704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb11c1f4290 msgr2=0x7fb11c0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:03.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11b400640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb11c1f4290 0x7fb11c0ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11b400640 1 -- 172.21.15.144:0/1808895704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb11c0aee00 msgr2=0x7fb11c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:03.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11b400640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb11c0aee00 0x7fb11c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11b400640 1 -- 172.21.15.144:0/1808895704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11c071240 con 0x7fb100004810 2024-09-12T12:23:03.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb11b400640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb11c13ff90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fb10c011420 tx=0x7fb10c0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:03.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb113400640 1 -- 172.21.15.144:0/1808895704 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c010040 con 0x7fb100004810 2024-09-12T12:23:03.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb113400640 1 -- 172.21.15.144:0/1808895704 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c01a070 con 0x7fb100004810 2024-09-12T12:23:03.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb11c071520 con 0x7fb100004810 2024-09-12T12:23:03.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.005+0000 7fb113400640 1 -- 172.21.15.144:0/1808895704 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c007050 con 0x7fb100004810 2024-09-12T12:23:03.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.009+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb11c071ae0 con 0x7fb100004810 2024-09-12T12:23:03.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.009+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb11c15e6e0 con 0x7fb100004810 2024-09-12T12:23:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.009+0000 7fb113400640 1 -- 172.21.15.144:0/1808895704 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb10c0071f0 con 0x7fb100004810 2024-09-12T12:23:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.009+0000 7fb113400640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0fc067890 0x7fb0fc069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.009+0000 7fb113400640 1 -- 172.21.15.144:0/1808895704 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 6001+0+0 (secure 0 0 0) 0x7fb10c0893b0 con 0x7fb100004810 2024-09-12T12:23:03.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.009+0000 7fb11aa00640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0fc067890 0x7fb0fc069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:03.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.013+0000 7fb11aa00640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0fc067890 0x7fb0fc069d50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb1080ae000 tx=0x7fb108008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:03.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.013+0000 7fb113400640 1 -- 172.21.15.144:0/1808895704 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb10c059880 con 0x7fb100004810 2024-09-12T12:23:03.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.205+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb11c0af210 con 0x7fb100004810 2024-09-12T12:23:03.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.849+0000 7fb113400640 1 -- 172.21.15.144:0/1808895704 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v119) ==== 174+0+0 (secure 0 0 0) 0x7fb11c0af210 con 0x7fb100004810 2024-09-12T12:23:03.857 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 23 and data pool 24 2024-09-12T12:23:03.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0fc067890 msgr2=0x7fb0fc069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:03.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0fc067890 0x7fb0fc069d50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb1080ae000 tx=0x7fb108008040 comp rx=0 tx=0).stop 2024-09-12T12:23:03.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 msgr2=0x7fb11c13ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:03.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb11c13ff90 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fb10c011420 tx=0x7fb10c0118e0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 shutdown_connections 2024-09-12T12:23:03.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb0fc067890 0x7fb0fc069d50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb11c0aee00 0x7fb11c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb11c1f4290 0x7fb11c0ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 --2- 172.21.15.144:0/1808895704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb100004810 0x7fb11c13ff90 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:03.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 >> 172.21.15.144:0/1808895704 conn(0x7fb11c068030 msgr2=0x7fb11c14f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:03.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 shutdown_connections 2024-09-12T12:23:03.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:03.865+0000 7fb122800640 1 -- 172.21.15.144:0/1808895704 wait complete. 2024-09-12T12:23:03.896 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:23:04.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff08e00640 1 Processor -- start 2024-09-12T12:23:04.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff08e00640 1 -- start start 2024-09-12T12:23:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff08e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff0415c7b0 0x7eff040ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff08e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff040b5fb0 0x7eff04072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff08e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff040cd870 con 0x7eff0415cd30 2024-09-12T12:23:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff08e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7eff04072a50 con 0x7eff040b5fb0 2024-09-12T12:23:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff08e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff040cde30 con 0x7eff0415c7b0 2024-09-12T12:23:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff02800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff040b5fb0 0x7eff04072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff01400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7eff0415cd30 0x7eff040b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43212/0 (socket says 172.21.15.144:43212) 2024-09-12T12:23:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff01400640 1 -- 172.21.15.144:0/2613868667 learned_addr learned my addr 172.21.15.144:0/2613868667 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff02800640 1 -- 172.21.15.144:0/2613868667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff0415c7b0 msgr2=0x7eff040ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff02800640 1 --2- 172.21.15.144:0/2613868667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff0415c7b0 0x7eff040ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff02800640 1 -- 172.21.15.144:0/2613868667 >> v1:172.21.15.144:6789/0 conn(0x7eff0415cd30 legacy=0x7eff040b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.041+0000 7eff02800640 1 -- 172.21.15.144:0/2613868667 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff040cdb50 con 0x7eff040b5fb0 2024-09-12T12:23:04.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff02800640 1 --2- 172.21.15.144:0/2613868667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 0x7eff04072ee0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7efefc009d90 tx=0x7efefc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525c71c31cf10672 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff00a00640 1 -- 172.21.15.144:0/2613868667 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc0b2070 con 0x7eff040b5fb0 2024-09-12T12:23:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff00a00640 1 -- 172.21.15.144:0/2613868667 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efefc0a5940 con 0x7eff040b5fb0 2024-09-12T12:23:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff00a00640 1 -- 172.21.15.144:0/2613868667 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc0a5d10 con 0x7eff040b5fb0 2024-09-12T12:23:04.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff08e00640 1 -- 172.21.15.144:0/2613868667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 msgr2=0x7eff04072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff08e00640 1 --2- 172.21.15.144:0/2613868667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 0x7eff04072ee0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7efefc009d90 tx=0x7efefc01c970 comp rx=0 tx=0).stop 2024-09-12T12:23:04.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff08e00640 1 -- 172.21.15.144:0/2613868667 shutdown_connections 2024-09-12T12:23:04.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff08e00640 1 --2- 172.21.15.144:0/2613868667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 0x7eff04072ee0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff08e00640 1 --2- 172.21.15.144:0/2613868667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff0415c7b0 0x7eff040ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff08e00640 1 -- 172.21.15.144:0/2613868667 >> 172.21.15.144:0/2613868667 conn(0x7eff0406d0d0 msgr2=0x7eff0406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:04.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff08e00640 1 -- 172.21.15.144:0/2613868667 shutdown_connections 2024-09-12T12:23:04.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.045+0000 7eff08e00640 1 -- 172.21.15.144:0/2613868667 wait complete. 2024-09-12T12:23:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 Processor -- start 2024-09-12T12:23:04.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 -- start start 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 0x7eff041f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff0415c7b0 0x7eff04157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff0415cd30 0x7eff041580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff04073fc0 con 0x7eff040b5fb0 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7eff04073e40 con 0x7eff0415c7b0 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff04074140 con 0x7eff0415cd30 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 0x7eff041f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 0x7eff041f58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60838/0 (socket says 172.21.15.144:60838) 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01e00640 1 -- 172.21.15.144:0/3753766619 learned_addr learned my addr 172.21.15.144:0/3753766619 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff02800640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff0415cd30 0x7eff041580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01400640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff0415c7b0 0x7eff04157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01e00640 1 -- 172.21.15.144:0/3753766619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff0415cd30 msgr2=0x7eff041580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01e00640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff0415cd30 0x7eff041580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01e00640 1 -- 172.21.15.144:0/3753766619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff0415c7b0 msgr2=0x7eff04157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01e00640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff0415c7b0 0x7eff04157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01e00640 1 -- 172.21.15.144:0/3753766619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0415ae60 con 0x7eff040b5fb0 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff01e00640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 0x7eff041f58a0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7efef400b550 tx=0x7efef400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7efefa000640 1 -- 172.21.15.144:0/3753766619 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4014070 con 0x7eff040b5fb0 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7efefa000640 1 -- 172.21.15.144:0/3753766619 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef4010890 con 0x7eff040b5fb0 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff04157cd0 con 0x7eff040b5fb0 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7efefa000640 1 -- 172.21.15.144:0/3753766619 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4010c80 con 0x7eff040b5fb0 2024-09-12T12:23:04.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff041f6500 con 0x7eff040b5fb0 2024-09-12T12:23:04.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.049+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff04072ec0 con 0x7eff040b5fb0 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.053+0000 7efefa000640 1 -- 172.21.15.144:0/3753766619 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efef4017070 con 0x7eff040b5fb0 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.053+0000 7efefa000640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efee40678c0 0x7efee4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.053+0000 7efefa000640 1 -- 172.21.15.144:0/3753766619 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 6101+0+0 (secure 0 0 0) 0x7efef4085d30 con 0x7eff040b5fb0 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.053+0000 7eff01400640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efee40678c0 0x7efee4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.053+0000 7eff01400640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efee40678c0 0x7efee4069d80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7eff0415da70 tx=0x7efef0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.057+0000 7efefa000640 1 -- 172.21.15.144:0/3753766619 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efef408b020 con 0x7eff040b5fb0 2024-09-12T12:23:04.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff04158600 con 0x7eff040b5fb0 2024-09-12T12:23:04.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7efefa000640 1 -- 172.21.15.144:0/3753766619 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) ==== 74+0+16981 (secure 0 0 0) 0x7efef4010e20 con 0x7eff040b5fb0 2024-09-12T12:23:04.216 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:04.216 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":164,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:23:03.208216+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:00.925396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:02.213050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:23:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efee40678c0 msgr2=0x7efee4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efee40678c0 0x7efee4069d80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7eff0415da70 tx=0x7efef0009040 comp rx=0 tx=0).stop 2024-09-12T12:23:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 msgr2=0x7eff041f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 0x7eff041f58a0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7efef400b550 tx=0x7efef400ba10 comp rx=0 tx=0).stop 2024-09-12T12:23:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 shutdown_connections 2024-09-12T12:23:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efee40678c0 0x7efee4069d80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff0415cd30 0x7eff041580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff0415c7b0 0x7eff04157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 --2- 172.21.15.144:0/3753766619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff040b5fb0 0x7eff041f58a0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 >> 172.21.15.144:0/3753766619 conn(0x7eff0406d0d0 msgr2=0x7eff04153b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 shutdown_connections 2024-09-12T12:23:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.217+0000 7eff08e00640 1 -- 172.21.15.144:0/3753766619 wait complete. 2024-09-12T12:23:04.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:23:04.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.373+0000 7ff683a00640 1 Processor -- start 2024-09-12T12:23:04.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.373+0000 7ff683a00640 1 -- start start 2024-09-12T12:23:04.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff683a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff67c15b4e0 0x7ff67c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff683a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67c0b45a0 con 0x7ff67c0ccf30 2024-09-12T12:23:04.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff683a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67c0b3fe0 con 0x7ff67c0b3ad0 2024-09-12T12:23:04.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff683a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff67c0b42c0 con 0x7ff67c15b4e0 2024-09-12T12:23:04.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff681000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff67c15b4e0 0x7ff67c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff681a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff67c0ccf30 0x7ff67c0b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43214/0 (socket says 172.21.15.144:43214) 2024-09-12T12:23:04.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff681a00640 1 -- 172.21.15.144:0/1703311782 learned_addr learned my addr 172.21.15.144:0/1703311782 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:04.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff681000640 1 -- 172.21.15.144:0/1703311782 >> v1:172.21.15.165:6789/0 conn(0x7ff67c0b3ad0 legacy=0x7ff67c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:04.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff681000640 1 -- 172.21.15.144:0/1703311782 >> v1:172.21.15.144:6789/0 conn(0x7ff67c0ccf30 legacy=0x7ff67c0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff681000640 1 -- 172.21.15.144:0/1703311782 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c0b1490 con 0x7ff67c15b4e0 2024-09-12T12:23:04.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff67b400640 1 -- 172.21.15.144:0/1703311782 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398512514 0 0) 0x7ff67c0b45a0 con 0x7ff67c0ccf30 2024-09-12T12:23:04.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.377+0000 7ff681000640 1 --2- 172.21.15.144:0/1703311782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 0x7ff67c0b3590 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009d90 tx=0x7ff66c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae124d21aeed72c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff67b400640 1 -- 172.21.15.144:0/1703311782 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0b2070 con 0x7ff67c15b4e0 2024-09-12T12:23:04.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff67b400640 1 -- 172.21.15.144:0/1703311782 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66c0a5920 con 0x7ff67c15b4e0 2024-09-12T12:23:04.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff67b400640 1 -- 172.21.15.144:0/1703311782 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0a5cf0 con 0x7ff67c15b4e0 2024-09-12T12:23:04.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 -- 172.21.15.144:0/1703311782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 msgr2=0x7ff67c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 --2- 172.21.15.144:0/1703311782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 0x7ff67c0b3590 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009d90 tx=0x7ff66c01c900 comp rx=0 tx=0).stop 2024-09-12T12:23:04.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 -- 172.21.15.144:0/1703311782 shutdown_connections 2024-09-12T12:23:04.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 --2- 172.21.15.144:0/1703311782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 0x7ff67c0b3590 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 -- 172.21.15.144:0/1703311782 >> 172.21.15.144:0/1703311782 conn(0x7ff67c06d0d0 msgr2=0x7ff67c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:04.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 -- 172.21.15.144:0/1703311782 shutdown_connections 2024-09-12T12:23:04.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 -- 172.21.15.144:0/1703311782 wait complete. 2024-09-12T12:23:04.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 Processor -- start 2024-09-12T12:23:04.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 -- start start 2024-09-12T12:23:04.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff67c0b3ad0 0x7ff67c159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff67c0ccf30 0x7ff67c14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 0x7ff67c151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c15b8c0 con 0x7ff67c15b4e0 2024-09-12T12:23:04.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c0cd750 con 0x7ff67c0ccf30 2024-09-12T12:23:04.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff683a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c15bbd0 con 0x7ff67c0b3ad0 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff681a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 0x7ff67c151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff681a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 0x7ff67c151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60856/0 (socket says 172.21.15.144:60856) 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff681a00640 1 -- 172.21.15.144:0/554548340 learned_addr learned my addr 172.21.15.144:0/554548340 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff681000640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff67c0b3ad0 0x7ff67c159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.381+0000 7ff67be00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff67c0ccf30 0x7ff67c14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff681a00640 1 -- 172.21.15.144:0/554548340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff67c0b3ad0 msgr2=0x7ff67c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff681a00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff67c0b3ad0 0x7ff67c159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff681a00640 1 -- 172.21.15.144:0/554548340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff67c0ccf30 msgr2=0x7ff67c14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff681a00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff67c0ccf30 0x7ff67c14fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff681a00640 1 -- 172.21.15.144:0/554548340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c157790 con 0x7ff67c15b4e0 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff681a00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 0x7ff67c151d70 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c480 tx=0x7ff67400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff678c00640 1 -- 172.21.15.144:0/554548340 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674018070 con 0x7ff67c15b4e0 2024-09-12T12:23:04.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff678c00640 1 -- 172.21.15.144:0/554548340 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6740074e0 con 0x7ff67c15b4e0 2024-09-12T12:23:04.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c0b1270 con 0x7ff67c15b4e0 2024-09-12T12:23:04.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff678c00640 1 -- 172.21.15.144:0/554548340 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674004a30 con 0x7ff67c15b4e0 2024-09-12T12:23:04.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c157ce0 con 0x7ff67c15b4e0 2024-09-12T12:23:04.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c0b3590 con 0x7ff67c15b4e0 2024-09-12T12:23:04.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.385+0000 7ff678c00640 1 -- 172.21.15.144:0/554548340 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff67401b070 con 0x7ff67c15b4e0 2024-09-12T12:23:04.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.389+0000 7ff678c00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff65c0678c0 0x7ff65c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.389+0000 7ff678c00640 1 -- 172.21.15.144:0/554548340 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 6101+0+0 (secure 0 0 0) 0x7ff6740850d0 con 0x7ff67c15b4e0 2024-09-12T12:23:04.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.389+0000 7ff681000640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff65c0678c0 0x7ff65c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.389+0000 7ff681000640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff65c0678c0 0x7ff65c069d80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0af000 tx=0x7ff66c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.393+0000 7ff678c00640 1 -- 172.21.15.144:0/554548340 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff674055420 con 0x7ff67c15b4e0 2024-09-12T12:23:04.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.553+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff67c156940 con 0x7ff67c15b4e0 2024-09-12T12:23:04.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.553+0000 7ff678c00640 1 -- 172.21.15.144:0/554548340 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) ==== 74+0+16981 (secure 0 0 0) 0x7ff674059720 con 0x7ff67c15b4e0 2024-09-12T12:23:04.552 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:04.553 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":164,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:23:03.208216+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:00.925396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:02.213050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff65c0678c0 msgr2=0x7ff65c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff65c0678c0 0x7ff65c069d80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0af000 tx=0x7ff66c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 msgr2=0x7ff67c151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 0x7ff67c151d70 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c480 tx=0x7ff67400c940 comp rx=0 tx=0).stop 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 shutdown_connections 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff65c0678c0 0x7ff65c069d80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff67c15b4e0 0x7ff67c151d70 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff67c0ccf30 0x7ff67c14fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 --2- 172.21.15.144:0/554548340 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff67c0b3ad0 0x7ff67c159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 >> 172.21.15.144:0/554548340 conn(0x7ff67c06d0d0 msgr2=0x7ff67c073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:04.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 shutdown_connections 2024-09-12T12:23:04.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.557+0000 7ff683a00640 1 -- 172.21.15.144:0/554548340 wait complete. 2024-09-12T12:23:04.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:23:04.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6268400640 1 Processor -- start 2024-09-12T12:23:04.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6268400640 1 -- start start 2024-09-12T12:23:04.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6268400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62600cd9f0 0x7f626006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6268400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f626015b340 0x7f626006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6268400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62600b4300 con 0x7f626015af60 2024-09-12T12:23:04.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6268400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f62600b32f0 con 0x7f62600cd9f0 2024-09-12T12:23:04.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6268400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f62600b3540 con 0x7f626015b340 2024-09-12T12:23:04.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6265000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62600cd9f0 0x7f626006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6265a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f626015af60 0x7f62600ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43222/0 (socket says 172.21.15.144:43222) 2024-09-12T12:23:04.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.713+0000 7f6265a00640 1 -- 172.21.15.144:0/3074046996 learned_addr learned my addr 172.21.15.144:0/3074046996 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:04.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f6266400640 1 --2- 172.21.15.144:0/3074046996 >> v2:172.21.15.165:3300/0 conn(0x7f626015b340 0x7f626006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f6265000640 1 -- 172.21.15.144:0/3074046996 >> v2:172.21.15.165:3300/0 conn(0x7f626015b340 msgr2=0x7f626006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:04.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f6265000640 1 --2- 172.21.15.144:0/3074046996 >> v2:172.21.15.165:3300/0 conn(0x7f626015b340 0x7f626006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f6265000640 1 -- 172.21.15.144:0/3074046996 >> v1:172.21.15.144:6789/0 conn(0x7f626015af60 legacy=0x7f62600ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f6265000640 1 -- 172.21.15.144:0/3074046996 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62600b3820 con 0x7f62600cd9f0 2024-09-12T12:23:04.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f625fe00640 1 -- 172.21.15.144:0/3074046996 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1971593519 0 0) 0x7f62600b4300 con 0x7f626015af60 2024-09-12T12:23:04.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f6265000640 1 --2- 172.21.15.144:0/3074046996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62600cd9f0 0x7f626006bc10 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f626006f190 tx=0x7f624c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34eda3c2677e9750 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f625fe00640 1 -- 172.21.15.144:0/3074046996 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0b0070 con 0x7f62600cd9f0 2024-09-12T12:23:04.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f625fe00640 1 -- 172.21.15.144:0/3074046996 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c0ab600 con 0x7f62600cd9f0 2024-09-12T12:23:04.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.717+0000 7f625fe00640 1 -- 172.21.15.144:0/3074046996 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0ab9d0 con 0x7f62600cd9f0 2024-09-12T12:23:04.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 -- 172.21.15.144:0/3074046996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62600cd9f0 msgr2=0x7f626006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 --2- 172.21.15.144:0/3074046996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62600cd9f0 0x7f626006bc10 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f626006f190 tx=0x7f624c01c480 comp rx=0 tx=0).stop 2024-09-12T12:23:04.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 -- 172.21.15.144:0/3074046996 shutdown_connections 2024-09-12T12:23:04.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 --2- 172.21.15.144:0/3074046996 >> v2:172.21.15.165:3300/0 conn(0x7f626015b340 0x7f626006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 --2- 172.21.15.144:0/3074046996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62600cd9f0 0x7f626006bc10 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 -- 172.21.15.144:0/3074046996 >> 172.21.15.144:0/3074046996 conn(0x7f6260068030 msgr2=0x7f62600b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:04.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 -- 172.21.15.144:0/3074046996 shutdown_connections 2024-09-12T12:23:04.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 -- 172.21.15.144:0/3074046996 wait complete. 2024-09-12T12:23:04.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 Processor -- start 2024-09-12T12:23:04.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 -- start start 2024-09-12T12:23:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62600cd9f0 0x7f6260149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626015af60 0x7f626015a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626015b340 0x7f62600719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f626006dd10 con 0x7f626015af60 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f626006db90 con 0x7f626015b340 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6268400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f626006de90 con 0x7f62600cd9f0 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6265000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626015af60 0x7f626015a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6265000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626015af60 0x7f626015a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60868/0 (socket says 172.21.15.144:60868) 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6265000640 1 -- 172.21.15.144:0/2886311181 learned_addr learned my addr 172.21.15.144:0/2886311181 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6265a00640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62600cd9f0 0x7f6260149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6266400640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626015b340 0x7f62600719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6265000640 1 -- 172.21.15.144:0/2886311181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62600cd9f0 msgr2=0x7f6260149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6265000640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62600cd9f0 0x7f6260149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6265000640 1 -- 172.21.15.144:0/2886311181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626015b340 msgr2=0x7f62600719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6265000640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626015b340 0x7f62600719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:04.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.721+0000 7f6265000640 1 -- 172.21.15.144:0/2886311181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62601479c0 con 0x7f626015af60 2024-09-12T12:23:04.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f6265000640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626015af60 0x7f626015a090 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f624c01a0b0 tx=0x7f624c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f625d600640 1 -- 172.21.15.144:0/2886311181 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0b0050 con 0x7f626015af60 2024-09-12T12:23:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f625d600640 1 -- 172.21.15.144:0/2886311181 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c0b1040 con 0x7f626015af60 2024-09-12T12:23:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f625d600640 1 -- 172.21.15.144:0/2886311181 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c006e20 con 0x7f626015af60 2024-09-12T12:23:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6260158ff0 con 0x7f626015af60 2024-09-12T12:23:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601595b0 con 0x7f626015af60 2024-09-12T12:23:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62600ce680 con 0x7f626015af60 2024-09-12T12:23:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f625d600640 1 -- 172.21.15.144:0/2886311181 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f624c0be060 con 0x7f626015af60 2024-09-12T12:23:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f625d600640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62400678c0 0x7f6240069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f625d600640 1 -- 172.21.15.144:0/2886311181 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 6101+0+0 (secure 0 0 0) 0x7f624c11f710 con 0x7f626015af60 2024-09-12T12:23:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f6265a00640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62400678c0 0x7f6240069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:04.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.725+0000 7f6265a00640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62400678c0 0x7f6240069d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6254004fd0 tx=0x7f6254001770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:04.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.729+0000 7f625d600640 1 -- 172.21.15.144:0/2886311181 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f624c016070 con 0x7f626015af60 2024-09-12T12:23:04.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:04.925+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f62600afc20 con 0x7f626015af60 2024-09-12T12:23:05.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-12T12:23:05.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-12T12:23:05.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-12T12:23:05.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-12T12:23:05.809 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-12T12:23:05.809+0000 7f0e76000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:23:05.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.857+0000 7f625d600640 1 -- 172.21.15.144:0/2886311181 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v122) ==== 118+0+0 (secure 0 0 0) 0x7f624c0ef9d0 con 0x7f626015af60 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62400678c0 msgr2=0x7f6240069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62400678c0 0x7f6240069d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6254004fd0 tx=0x7f6254001770 comp rx=0 tx=0).stop 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626015af60 msgr2=0x7f626015a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626015af60 0x7f626015a090 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f624c01a0b0 tx=0x7f624c01acc0 comp rx=0 tx=0).stop 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 shutdown_connections 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62400678c0 0x7f6240069d80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626015b340 0x7f62600719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626015af60 0x7f626015a090 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 --2- 172.21.15.144:0/2886311181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62600cd9f0 0x7f6260149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 >> 172.21.15.144:0/2886311181 conn(0x7f6260068030 msgr2=0x7f6260073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 shutdown_connections 2024-09-12T12:23:05.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:05.861+0000 7f6268400640 1 -- 172.21.15.144:0/2886311181 wait complete. 2024-09-12T12:23:05.885 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:23:05.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:23:06.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.029+0000 7f5a96e00640 1 Processor -- start 2024-09-12T12:23:06.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.029+0000 7f5a96e00640 1 -- start start 2024-09-12T12:23:06.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.029+0000 7f5a96e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5a9006c320 0x7f5a90166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:06.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.029+0000 7f5a96e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a900733e0 con 0x7f5a900af5f0 2024-09-12T12:23:06.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.029+0000 7f5a96e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a900cd290 con 0x7f5a9015c2e0 2024-09-12T12:23:06.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.029+0000 7f5a96e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5a900cd570 con 0x7f5a9006c320 2024-09-12T12:23:06.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.029+0000 7f5a94e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5a9006c320 0x7f5a90166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:06.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.033+0000 7f5a94e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5a9006c320 0x7f5a90166f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60882/0 (socket says 172.21.15.144:60882) 2024-09-12T12:23:06.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.033+0000 7f5a94e00640 1 -- 172.21.15.144:0/451207272 learned_addr learned my addr 172.21.15.144:0/451207272 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:06.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.033+0000 7f5a94e00640 1 -- 172.21.15.144:0/451207272 >> v1:172.21.15.165:6789/0 conn(0x7f5a9015c2e0 legacy=0x7f5a90072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:06.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.033+0000 7f5a94e00640 1 -- 172.21.15.144:0/451207272 >> v1:172.21.15.144:6789/0 conn(0x7f5a900af5f0 legacy=0x7f5a9006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.033+0000 7f5a94e00640 1 -- 172.21.15.144:0/451207272 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a900cd850 con 0x7f5a9006c320 2024-09-12T12:23:06.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.033+0000 7f5a94e00640 1 --2- 172.21.15.144:0/451207272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9006c320 0x7f5a90166f10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009e50 tx=0x7f5a8801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cf1e4b326022ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.033+0000 7f5a8ea00640 1 -- 172.21.15.144:0/451207272 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a880a56e0 con 0x7f5a9006c320 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.033+0000 7f5a8ea00640 1 -- 172.21.15.144:0/451207272 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a880a5880 con 0x7f5a9006c320 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.033+0000 7f5a8ea00640 1 -- 172.21.15.144:0/451207272 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a880a5c50 con 0x7f5a9006c320 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 -- 172.21.15.144:0/451207272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9006c320 msgr2=0x7f5a90166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 --2- 172.21.15.144:0/451207272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9006c320 0x7f5a90166f10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009e50 tx=0x7f5a8801c910 comp rx=0 tx=0).stop 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 -- 172.21.15.144:0/451207272 shutdown_connections 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 --2- 172.21.15.144:0/451207272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9006c320 0x7f5a90166f10 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 -- 172.21.15.144:0/451207272 >> 172.21.15.144:0/451207272 conn(0x7f5a90068030 msgr2=0x7f5a900b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 -- 172.21.15.144:0/451207272 shutdown_connections 2024-09-12T12:23:06.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 -- 172.21.15.144:0/451207272 wait complete. 2024-09-12T12:23:06.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 Processor -- start 2024-09-12T12:23:06.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 -- start start 2024-09-12T12:23:06.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9006c320 0x7f5a90136510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:06.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a900af5f0 0x7f5a9015f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:06.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9015c2e0 0x7f5a901530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:06.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9016a000 con 0x7f5a9015c2e0 2024-09-12T12:23:06.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5a90169e80 con 0x7f5a900af5f0 2024-09-12T12:23:06.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a96e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9016a180 con 0x7f5a9006c320 2024-09-12T12:23:06.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a94e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9015c2e0 0x7f5a901530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:06.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a94e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9015c2e0 0x7f5a901530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60894/0 (socket says 172.21.15.144:60894) 2024-09-12T12:23:06.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a94e00640 1 -- 172.21.15.144:0/2729352895 learned_addr learned my addr 172.21.15.144:0/2729352895 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:06.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a8f400640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a900af5f0 0x7f5a9015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:06.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a8fe00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9006c320 0x7f5a90136510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:06.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a94e00640 1 -- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9006c320 msgr2=0x7f5a90136510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a94e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9006c320 0x7f5a90136510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a94e00640 1 -- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a900af5f0 msgr2=0x7f5a9015f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a94e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a900af5f0 0x7f5a9015f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a94e00640 1 -- 172.21.15.144:0/2729352895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9015e5f0 con 0x7f5a9015c2e0 2024-09-12T12:23:06.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a8f400640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a900af5f0 0x7f5a9015f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:06.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a8fe00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9006c320 0x7f5a90136510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:06.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.037+0000 7f5a94e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9015c2e0 0x7f5a901530e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f5a880af040 tx=0x7f5a880196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:06.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a87e00640 1 -- 172.21.15.144:0/2729352895 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a880bc020 con 0x7f5a9015c2e0 2024-09-12T12:23:06.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a87e00640 1 -- 172.21.15.144:0/2729352895 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a880b8880 con 0x7f5a9015c2e0 2024-09-12T12:23:06.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a87e00640 1 -- 172.21.15.144:0/2729352895 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a880b8c70 con 0x7f5a9015c2e0 2024-09-12T12:23:06.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9015e890 con 0x7f5a9015c2e0 2024-09-12T12:23:06.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a9015eb30 con 0x7f5a9015c2e0 2024-09-12T12:23:06.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a9006bc10 con 0x7f5a9015c2e0 2024-09-12T12:23:06.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a87e00640 1 -- 172.21.15.144:0/2729352895 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a880bf020 con 0x7f5a9015c2e0 2024-09-12T12:23:06.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a87e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a700678c0 0x7f5a70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:06.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a87e00640 1 -- 172.21.15.144:0/2729352895 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f5a88121160 con 0x7f5a9015c2e0 2024-09-12T12:23:06.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a8fe00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a700678c0 0x7f5a70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:06.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.041+0000 7f5a8fe00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a700678c0 0x7f5a70069d80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5a80001670 tx=0x7f5a80009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:06.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.045+0000 7f5a87e00640 1 -- 172.21.15.144:0/2729352895 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a880c6030 con 0x7f5a9015c2e0 2024-09-12T12:23:06.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.241+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5a90136a50 con 0x7f5a9015c2e0 2024-09-12T12:23:06.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.861+0000 7f5a87e00640 1 -- 172.21.15.144:0/2729352895 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v123) ==== 122+0+0 (secure 0 0 0) 0x7f5a88016620 con 0x7f5a9015c2e0 2024-09-12T12:23:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a700678c0 msgr2=0x7f5a70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a700678c0 0x7f5a70069d80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5a80001670 tx=0x7f5a80009040 comp rx=0 tx=0).stop 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9015c2e0 msgr2=0x7f5a901530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9015c2e0 0x7f5a901530e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f5a880af040 tx=0x7f5a880196b0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 shutdown_connections 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5a700678c0 0x7f5a70069d80 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a9015c2e0 0x7f5a901530e0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a900af5f0 0x7f5a9015f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 --2- 172.21.15.144:0/2729352895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a9006c320 0x7f5a90136510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 >> 172.21.15.144:0/2729352895 conn(0x7f5a90068030 msgr2=0x7f5a90072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 shutdown_connections 2024-09-12T12:23:06.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:06.865+0000 7f5a96e00640 1 -- 172.21.15.144:0/2729352895 wait complete. 2024-09-12T12:23:06.887 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:23:06.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:07.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc8ae00640 1 Processor -- start 2024-09-12T12:23:07.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc8ae00640 1 -- start start 2024-09-12T12:23:07.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc8ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdc8415c7b0 0x7fdc840ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc8ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 0x7fdc840b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc8ae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdc840b5de0 0x7fdc841601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc8ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdc84072a50 con 0x7fdc8415c7b0 2024-09-12T12:23:07.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc8ae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdc840cde30 con 0x7fdc840b5de0 2024-09-12T12:23:07.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc8ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc840b6210 con 0x7fdc8415cd30 2024-09-12T12:23:07.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc83e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdc8415c7b0 0x7fdc840ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc83e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdc8415c7b0 0x7fdc840ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60904/0 (socket says 172.21.15.144:60904) 2024-09-12T12:23:07.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc83e00640 1 -- 172.21.15.144:0/2534205772 learned_addr learned my addr 172.21.15.144:0/2534205772 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:07.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc83400640 1 --2- 172.21.15.144:0/2534205772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 0x7fdc840b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc88e00640 1 --2- 172.21.15.144:0/2534205772 >> v2:172.21.15.165:3300/0 conn(0x7fdc840b5de0 0x7fdc841601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc83e00640 1 -- 172.21.15.144:0/2534205772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 msgr2=0x7fdc840b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:07.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc83e00640 1 --2- 172.21.15.144:0/2534205772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 0x7fdc840b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc83e00640 1 -- 172.21.15.144:0/2534205772 >> v2:172.21.15.165:3300/0 conn(0x7fdc840b5de0 msgr2=0x7fdc841601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:07.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc83e00640 1 --2- 172.21.15.144:0/2534205772 >> v2:172.21.15.165:3300/0 conn(0x7fdc840b5de0 0x7fdc841601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc83e00640 1 -- 172.21.15.144:0/2534205772 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc840cd870 con 0x7fdc8415c7b0 2024-09-12T12:23:07.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.029+0000 7fdc88e00640 1 --2- 172.21.15.144:0/2534205772 >> v2:172.21.15.165:3300/0 conn(0x7fdc840b5de0 0x7fdc841601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:07.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc83e00640 1 --2- 172.21.15.144:0/2534205772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8415c7b0 0x7fdc840ccf00 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdc840ce230 tx=0x7fdc7401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45da00f9bf8542de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:07.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc82a00640 1 -- 172.21.15.144:0/2534205772 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc740b0070 con 0x7fdc8415c7b0 2024-09-12T12:23:07.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc82a00640 1 -- 172.21.15.144:0/2534205772 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc740ab600 con 0x7fdc8415c7b0 2024-09-12T12:23:07.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc82a00640 1 -- 172.21.15.144:0/2534205772 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc740ab9d0 con 0x7fdc8415c7b0 2024-09-12T12:23:07.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2534205772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8415c7b0 msgr2=0x7fdc840ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2534205772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8415c7b0 0x7fdc840ccf00 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdc840ce230 tx=0x7fdc7401c260 comp rx=0 tx=0).stop 2024-09-12T12:23:07.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2534205772 shutdown_connections 2024-09-12T12:23:07.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2534205772 >> v2:172.21.15.165:3300/0 conn(0x7fdc840b5de0 0x7fdc841601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2534205772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 0x7fdc840b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2534205772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc8415c7b0 0x7fdc840ccf00 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2534205772 >> 172.21.15.144:0/2534205772 conn(0x7fdc8406d0d0 msgr2=0x7fdc8406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:07.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2534205772 shutdown_connections 2024-09-12T12:23:07.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.033+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2534205772 wait complete. 2024-09-12T12:23:07.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 Processor -- start 2024-09-12T12:23:07.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 -- start start 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc840b5de0 0x7fdc841420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc8415c7b0 0x7fdc840b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 0x7fdc840b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc84072ee0 con 0x7fdc840b5de0 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc840cd650 con 0x7fdc8415c7b0 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc84073060 con 0x7fdc8415cd30 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc840b5de0 0x7fdc841420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc840b5de0 0x7fdc841420c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60914/0 (socket says 172.21.15.144:60914) 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83e00640 1 -- 172.21.15.144:0/2838917494 learned_addr learned my addr 172.21.15.144:0/2838917494 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83400640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc8415c7b0 0x7fdc840b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc88e00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 0x7fdc840b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83e00640 1 -- 172.21.15.144:0/2838917494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 msgr2=0x7fdc840b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83e00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 0x7fdc840b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83e00640 1 -- 172.21.15.144:0/2838917494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc8415c7b0 msgr2=0x7fdc840b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83e00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc8415c7b0 0x7fdc840b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83e00640 1 -- 172.21.15.144:0/2838917494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc84142600 con 0x7fdc840b5de0 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc83e00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc840b5de0 0x7fdc841420c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdc7401a910 tx=0x7fdc74019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc7be00640 1 -- 172.21.15.144:0/2838917494 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc740ba070 con 0x7fdc840b5de0 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc7be00640 1 -- 172.21.15.144:0/2838917494 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc740b4420 con 0x7fdc840b5de0 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc7be00640 1 -- 172.21.15.144:0/2838917494 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc740b0040 con 0x7fdc840b5de0 2024-09-12T12:23:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc840b40c0 con 0x7fdc840b5de0 2024-09-12T12:23:07.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc840b11a0 con 0x7fdc840b5de0 2024-09-12T12:23:07.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.037+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc840b45e0 con 0x7fdc840b5de0 2024-09-12T12:23:07.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.041+0000 7fdc7be00640 1 -- 172.21.15.144:0/2838917494 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc740bd070 con 0x7fdc840b5de0 2024-09-12T12:23:07.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.041+0000 7fdc7be00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc640678f0 0x7fdc64069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.041+0000 7fdc7be00640 1 -- 172.21.15.144:0/2838917494 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7fdc7411edf0 con 0x7fdc840b5de0 2024-09-12T12:23:07.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.041+0000 7fdc83400640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc640678f0 0x7fdc64069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.041+0000 7fdc83400640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc640678f0 0x7fdc64069db0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdc84157ed0 tx=0x7fdc70009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:07.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.045+0000 7fdc7be00640 1 -- 172.21.15.144:0/2838917494 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdc840b45e0 con 0x7fdc840b5de0 2024-09-12T12:23:07.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.233+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc840ccf00 con 0x7fdc840b5de0 2024-09-12T12:23:07.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.233+0000 7fdc7be00640 1 -- 172.21.15.144:0/2838917494 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7fdc74016110 con 0x7fdc840b5de0 2024-09-12T12:23:07.234 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:07.234 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:07.234 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:07.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc640678f0 msgr2=0x7fdc64069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc640678f0 0x7fdc64069db0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fdc84157ed0 tx=0x7fdc70009190 comp rx=0 tx=0).stop 2024-09-12T12:23:07.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc840b5de0 msgr2=0x7fdc841420c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc840b5de0 0x7fdc841420c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdc7401a910 tx=0x7fdc74019000 comp rx=0 tx=0).stop 2024-09-12T12:23:07.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 shutdown_connections 2024-09-12T12:23:07.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc640678f0 0x7fdc64069db0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc8415cd30 0x7fdc840b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc8415c7b0 0x7fdc840b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 --2- 172.21.15.144:0/2838917494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc840b5de0 0x7fdc841420c0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 >> 172.21.15.144:0/2838917494 conn(0x7fdc8406d0d0 msgr2=0x7fdc84153f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:07.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 shutdown_connections 2024-09-12T12:23:07.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.237+0000 7fdc8ae00640 1 -- 172.21.15.144:0/2838917494 wait complete. 2024-09-12T12:23:07.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:23:07.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e4200640 1 Processor -- start 2024-09-12T12:23:07.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e4200640 1 -- start start 2024-09-12T12:23:07.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e4200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f53dc15b4e0 0x7f53dc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53dc0b3ad0 0x7f53dc071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e4200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53dc071960 0x7f53dc0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e4200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f53dc0b45a0 con 0x7f53dc071960 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e4200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f53dc0b3fe0 con 0x7f53dc15b4e0 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f53dc0b42c0 con 0x7f53dc0b3ad0 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53dc071960 0x7f53dc0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f53dc071960 0x7f53dc0ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45762/0 (socket says 172.21.15.144:45762) 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e2200640 1 -- 172.21.15.144:0/1057580510 learned_addr learned my addr 172.21.15.144:0/1057580510 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e1800640 1 --2- 172.21.15.144:0/1057580510 >> v2:172.21.15.165:3300/0 conn(0x7f53dc15b4e0 0x7f53dc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e0e00640 1 --2- 172.21.15.144:0/1057580510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53dc0b3ad0 0x7f53dc071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e2200640 1 -- 172.21.15.144:0/1057580510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53dc0b3ad0 msgr2=0x7f53dc071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:07.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e2200640 1 --2- 172.21.15.144:0/1057580510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53dc0b3ad0 0x7f53dc071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e2200640 1 -- 172.21.15.144:0/1057580510 >> v2:172.21.15.165:3300/0 conn(0x7f53dc15b4e0 msgr2=0x7f53dc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:07.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e2200640 1 --2- 172.21.15.144:0/1057580510 >> v2:172.21.15.165:3300/0 conn(0x7f53dc15b4e0 0x7f53dc0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e2200640 1 -- 172.21.15.144:0/1057580510 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc0b1490 con 0x7f53dc071960 2024-09-12T12:23:07.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.393+0000 7f53e1800640 1 --2- 172.21.15.144:0/1057580510 >> v2:172.21.15.165:3300/0 conn(0x7f53dc15b4e0 0x7f53dc0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:07.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e2200640 1 --2- 172.21.15.144:0/1057580510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc071960 0x7f53dc0ccf30 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f53dc069450 tx=0x7f53d401ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2f2a98f271fe2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:07.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53dbe00640 1 -- 172.21.15.144:0/1057580510 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d400b2d0 con 0x7f53dc071960 2024-09-12T12:23:07.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53dbe00640 1 -- 172.21.15.144:0/1057580510 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d400b470 con 0x7f53dc071960 2024-09-12T12:23:07.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53dbe00640 1 -- 172.21.15.144:0/1057580510 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d40a7b80 con 0x7f53dc071960 2024-09-12T12:23:07.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e4200640 1 -- 172.21.15.144:0/1057580510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc071960 msgr2=0x7f53dc0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e4200640 1 --2- 172.21.15.144:0/1057580510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc071960 0x7f53dc0ccf30 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f53dc069450 tx=0x7f53d401ebc0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e4200640 1 -- 172.21.15.144:0/1057580510 shutdown_connections 2024-09-12T12:23:07.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e4200640 1 --2- 172.21.15.144:0/1057580510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc071960 0x7f53dc0ccf30 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e4200640 1 --2- 172.21.15.144:0/1057580510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53dc0b3ad0 0x7f53dc071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e4200640 1 --2- 172.21.15.144:0/1057580510 >> v2:172.21.15.165:3300/0 conn(0x7f53dc15b4e0 0x7f53dc0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e4200640 1 -- 172.21.15.144:0/1057580510 >> 172.21.15.144:0/1057580510 conn(0x7f53dc06d0d0 msgr2=0x7f53dc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:07.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e4200640 1 -- 172.21.15.144:0/1057580510 shutdown_connections 2024-09-12T12:23:07.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.397+0000 7f53e4200640 1 -- 172.21.15.144:0/1057580510 wait complete. 2024-09-12T12:23:07.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 Processor -- start 2024-09-12T12:23:07.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 -- start start 2024-09-12T12:23:07.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53dc071960 0x7f53dc1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53dc0b3ad0 0x7f53dc164d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc15b4e0 0x7f53dc151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc15f270 con 0x7f53dc15b4e0 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc15f0f0 con 0x7f53dc0b3ad0 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f53dc15f3f0 con 0x7f53dc071960 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc15b4e0 0x7f53dc151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc15b4e0 0x7f53dc151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45774/0 (socket says 172.21.15.144:45774) 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e2200640 1 -- 172.21.15.144:0/489005549 learned_addr learned my addr 172.21.15.144:0/489005549 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e2200640 1 -- 172.21.15.144:0/489005549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53dc071960 msgr2=0x7f53dc1521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e2200640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53dc071960 0x7f53dc1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e2200640 1 -- 172.21.15.144:0/489005549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53dc0b3ad0 msgr2=0x7f53dc164d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e2200640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53dc0b3ad0 0x7f53dc164d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e2200640 1 -- 172.21.15.144:0/489005549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc15bc00 con 0x7f53dc15b4e0 2024-09-12T12:23:07.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e2200640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc15b4e0 0x7f53dc151920 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f53d401d270 tx=0x7f53d401b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:07.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53d9600640 1 -- 172.21.15.144:0/489005549 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4009800 con 0x7f53dc15b4e0 2024-09-12T12:23:07.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53d9600640 1 -- 172.21.15.144:0/489005549 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d40be070 con 0x7f53dc15b4e0 2024-09-12T12:23:07.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53d9600640 1 -- 172.21.15.144:0/489005549 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4009be0 con 0x7f53dc15b4e0 2024-09-12T12:23:07.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc15bee0 con 0x7f53dc15b4e0 2024-09-12T12:23:07.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.401+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc15c4a0 con 0x7f53dc15b4e0 2024-09-12T12:23:07.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.405+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc071420 con 0x7f53dc15b4e0 2024-09-12T12:23:07.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.405+0000 7f53d9600640 1 -- 172.21.15.144:0/489005549 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53d40b6070 con 0x7f53dc15b4e0 2024-09-12T12:23:07.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.405+0000 7f53d9600640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53bc0678c0 0x7f53bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.405+0000 7f53d9600640 1 -- 172.21.15.144:0/489005549 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f53d4120e60 con 0x7f53dc15b4e0 2024-09-12T12:23:07.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.405+0000 7f53e1800640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53bc0678c0 0x7f53bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.405+0000 7f53e1800640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53bc0678c0 0x7f53bc069d80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f53d00099e0 tx=0x7f53d0009480 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:07.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.409+0000 7f53d9600640 1 -- 172.21.15.144:0/489005549 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f53d40187e0 con 0x7f53dc15b4e0 2024-09-12T12:23:07.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.569+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53dc0affe0 con 0x7f53dc15b4e0 2024-09-12T12:23:07.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.569+0000 7f53d9600640 1 -- 172.21.15.144:0/489005549 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16968 (secure 0 0 0) 0x7f53d40f1920 con 0x7f53dc15b4e0 2024-09-12T12:23:07.569 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:07.569 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":165,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:23:04.835966+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:00.925396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:02.213050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:23:07.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53bc0678c0 msgr2=0x7f53bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53bc0678c0 0x7f53bc069d80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f53d00099e0 tx=0x7f53d0009480 comp rx=0 tx=0).stop 2024-09-12T12:23:07.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc15b4e0 msgr2=0x7f53dc151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc15b4e0 0x7f53dc151920 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f53d401d270 tx=0x7f53d401b960 comp rx=0 tx=0).stop 2024-09-12T12:23:07.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 shutdown_connections 2024-09-12T12:23:07.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53bc0678c0 0x7f53bc069d80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53dc15b4e0 0x7f53dc151920 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53dc0b3ad0 0x7f53dc164d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 --2- 172.21.15.144:0/489005549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53dc071960 0x7f53dc1521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 >> 172.21.15.144:0/489005549 conn(0x7f53dc06d0d0 msgr2=0x7f53dc0ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:07.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 shutdown_connections 2024-09-12T12:23:07.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.573+0000 7f53e4200640 1 -- 172.21.15.144:0/489005549 wait complete. 2024-09-12T12:23:07.591 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:23:07.592 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:23:07.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.729+0000 7f6951600640 1 Processor -- start 2024-09-12T12:23:07.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.729+0000 7f6951600640 1 -- start start 2024-09-12T12:23:07.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f6951600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f694c0cd640 0x7f694c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f6951600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694c0b45a0 con 0x7f694c071420 2024-09-12T12:23:07.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f6951600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694c0b3fe0 con 0x7f694c15b4e0 2024-09-12T12:23:07.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f6951600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f694c0b42c0 con 0x7f694c0cd640 2024-09-12T12:23:07.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f6942000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f694c071420 0x7f694c0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34566/0 (socket says 172.21.15.144:34566) 2024-09-12T12:23:07.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f6942000640 1 -- 172.21.15.144:0/2807638228 learned_addr learned my addr 172.21.15.144:0/2807638228 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:07.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694b400640 1 --2- 172.21.15.144:0/2807638228 >> v2:172.21.15.165:3300/0 conn(0x7f694c0cd640 0x7f694c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3384987358 0 0) 0x7f694c0b45a0 con 0x7f694c071420 2024-09-12T12:23:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6930003530 con 0x7f694c071420 2024-09-12T12:23:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837036267 0 0) 0x7f694c0b3fe0 con 0x7f694c15b4e0 2024-09-12T12:23:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f694c0b45a0 con 0x7f694c15b4e0 2024-09-12T12:23:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 33199886 0 0) 0x7f6930003530 con 0x7f694c071420 2024-09-12T12:23:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 >> v2:172.21.15.165:3300/0 conn(0x7f694c0cd640 msgr2=0x7f694c071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 --2- 172.21.15.144:0/2807638228 >> v2:172.21.15.165:3300/0 conn(0x7f694c0cd640 0x7f694c071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 >> v1:172.21.15.165:6789/0 conn(0x7f694c15b4e0 legacy=0x7f694c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694c0b1490 con 0x7f694c071420 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f6934001680 con 0x7f694c071420 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 >> v1:172.21.15.144:6789/0 conn(0x7f694c071420 legacy=0x7f694c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6930003b50 0x7f6930003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930004810 0x7f6930004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69300051d0 0x7f693000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f694c0b42c0 con 0x7f6930003b50 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f693000e260 con 0x7f6930004810 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f693000e460 con 0x7f69300051d0 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694aa00640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6930003b50 0x7f6930003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f6942000640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930004810 0x7f6930004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694b400640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69300051d0 0x7f693000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694aa00640 1 -- 172.21.15.144:0/2807638228 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69300051d0 msgr2=0x7f693000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:07.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694aa00640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69300051d0 0x7f693000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694aa00640 1 -- 172.21.15.144:0/2807638228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930004810 msgr2=0x7f6930004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:07.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694aa00640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930004810 0x7f6930004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694aa00640 1 -- 172.21.15.144:0/2807638228 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6930003530 con 0x7f6930003b50 2024-09-12T12:23:07.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f6942000640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930004810 0x7f6930004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:07.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.733+0000 7f694b400640 1 -- 172.21.15.144:0/2807638228 reap_dead start 2024-09-12T12:23:07.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f694aa00640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6930003b50 0x7f6930003f50 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f693c001fd0 tx=0x7f693c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2cfdc66ae0bd17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:07.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c001c20 con 0x7f6930003b50 2024-09-12T12:23:07.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c003ba0 con 0x7f6930003b50 2024-09-12T12:23:07.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f694a000640 1 -- 172.21.15.144:0/2807638228 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c0050d0 con 0x7f6930003b50 2024-09-12T12:23:07.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f6951600640 1 -- 172.21.15.144:0/2807638228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6930003b50 msgr2=0x7f6930003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f6951600640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6930003b50 0x7f6930003f50 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f693c001fd0 tx=0x7f693c01c870 comp rx=0 tx=0).stop 2024-09-12T12:23:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f6951600640 1 -- 172.21.15.144:0/2807638228 shutdown_connections 2024-09-12T12:23:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f6951600640 1 --2- 172.21.15.144:0/2807638228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6930003b50 0x7f6930003f50 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f6951600640 1 -- 172.21.15.144:0/2807638228 >> 172.21.15.144:0/2807638228 conn(0x7f694c06d0d0 msgr2=0x7f694c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f6951600640 1 -- 172.21.15.144:0/2807638228 shutdown_connections 2024-09-12T12:23:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f6951600640 1 -- 172.21.15.144:0/2807638228 wait complete. 2024-09-12T12:23:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f6951600640 1 Processor -- start 2024-09-12T12:23:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.737+0000 7f6951600640 1 -- start start 2024-09-12T12:23:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6951600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930003b50 0x7f694c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6951600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694c1e9450 0x7f694c156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6951600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694c14cd50 0x7f694c14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6951600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f694c15b8c0 con 0x7f694c14cd50 2024-09-12T12:23:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6951600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f694c0b3da0 con 0x7f6930003b50 2024-09-12T12:23:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6951600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f694c1e8160 con 0x7f694c1e9450 2024-09-12T12:23:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694c14cd50 0x7f694c14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694c14cd50 0x7f694c14d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45788/0 (socket says 172.21.15.144:45788) 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694b400640 1 -- 172.21.15.144:0/733151408 learned_addr learned my addr 172.21.15.144:0/733151408 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694aa00640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930003b50 0x7f694c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6942000640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694c1e9450 0x7f694c156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694b400640 1 -- 172.21.15.144:0/733151408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694c1e9450 msgr2=0x7f694c156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694b400640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694c1e9450 0x7f694c156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694b400640 1 -- 172.21.15.144:0/733151408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930003b50 msgr2=0x7f694c154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694b400640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930003b50 0x7f694c154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694b400640 1 -- 172.21.15.144:0/733151408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694c14d6f0 con 0x7f694c14cd50 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f694b400640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694c14cd50 0x7f694c14d1b0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f694c070f90 tx=0x7f6944011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6943400640 1 -- 172.21.15.144:0/733151408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944004240 con 0x7f694c14cd50 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6943400640 1 -- 172.21.15.144:0/733151408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694401b070 con 0x7f694c14cd50 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6943400640 1 -- 172.21.15.144:0/733151408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694400f6f0 con 0x7f694c14cd50 2024-09-12T12:23:07.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f694c1e8410 con 0x7f694c14cd50 2024-09-12T12:23:07.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694c1e8c50 con 0x7f694c14cd50 2024-09-12T12:23:07.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.741+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694c0b1c90 con 0x7f694c14cd50 2024-09-12T12:23:07.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.745+0000 7f6943400640 1 -- 172.21.15.144:0/733151408 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6944012040 con 0x7f694c14cd50 2024-09-12T12:23:07.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.745+0000 7f6943400640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69280678f0 0x7f6928069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:07.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.745+0000 7f6943400640 1 -- 172.21.15.144:0/733151408 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f6944085d30 con 0x7f694c14cd50 2024-09-12T12:23:07.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.745+0000 7f694aa00640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69280678f0 0x7f6928069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:07.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.745+0000 7f694aa00640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69280678f0 0x7f6928069db0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f693c0ac000 tx=0x7f693c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:07.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.749+0000 7f6943400640 1 -- 172.21.15.144:0/733151408 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f694c1e8410 con 0x7f694c14cd50 2024-09-12T12:23:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.905+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f694c0cf570 con 0x7f69280678f0 2024-09-12T12:23:07.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.913+0000 7f6943400640 1 -- 172.21.15.144:0/733151408 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252412 (secure 0 0 0) 0x7f693c0fda10 con 0x7f69280678f0 2024-09-12T12:23:07.914 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:07.916 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:23:07.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69280678f0 msgr2=0x7f6928069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69280678f0 0x7f6928069db0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f693c0ac000 tx=0x7f693c0a7000 comp rx=0 tx=0).stop 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694c14cd50 msgr2=0x7f694c14d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694c14cd50 0x7f694c14d1b0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f694c070f90 tx=0x7f6944011cf0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 shutdown_connections 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f69280678f0 0x7f6928069db0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694c14cd50 0x7f694c14d1b0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694c1e9450 0x7f694c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 --2- 172.21.15.144:0/733151408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6930003b50 0x7f694c154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 >> 172.21.15.144:0/733151408 conn(0x7f694c06d0d0 msgr2=0x7f694c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 shutdown_connections 2024-09-12T12:23:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:07.917+0000 7f6951600640 1 -- 172.21.15.144:0/733151408 wait complete. 2024-09-12T12:23:07.934 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":475,"stamp":"2024-09-12T12:23:07.509062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":423720,"kb_used_data":17308,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754551000,"statfs":{"total":773094113280,"available":772660224000,"internally_reserved":0,"allocated":17723392,"data_stored":8953693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":415944241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.690444"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.852310+0000","last_change":"2024-09-12T12:23:03.846464+0000","last_active":"2024-09-12T12:23:03.852310+0000","last_peered":"2024-09-12T12:23:03.852310+0000","last_clean":"2024-09-12T12:23:03.852310+0000","last_became_active":"2024-09-12T12:23:03.846156+0000","last_became_peered":"2024-09-12T12:23:03.846156+0000","last_unstale":"2024-09-12T12:23:03.852310+0000","last_undegraded":"2024-09-12T12:23:03.852310+0000","last_fullsized":"2024-09-12T12:23:03.852310+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:37.477024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868618+0000","last_change":"2024-09-12T12:23:03.867003+0000","last_active":"2024-09-12T12:23:03.868618+0000","last_peered":"2024-09-12T12:23:03.868618+0000","last_clean":"2024-09-12T12:23:03.868618+0000","last_became_active":"2024-09-12T12:23:03.866702+0000","last_became_peered":"2024-09-12T12:23:03.866702+0000","last_unstale":"2024-09-12T12:23:03.868618+0000","last_undegraded":"2024-09-12T12:23:03.868618+0000","last_fullsized":"2024-09-12T12:23:03.868618+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:14.204718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859075+0000","last_change":"2024-09-12T12:23:03.855347+0000","last_active":"2024-09-12T12:23:03.859075+0000","last_peered":"2024-09-12T12:23:03.859075+0000","last_clean":"2024-09-12T12:23:03.859075+0000","last_became_active":"2024-09-12T12:23:03.854176+0000","last_became_peered":"2024-09-12T12:23:03.854176+0000","last_unstale":"2024-09-12T12:23:03.859075+0000","last_undegraded":"2024-09-12T12:23:03.859075+0000","last_fullsized":"2024-09-12T12:23:03.859075+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:34.181070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863278+0000","last_change":"2024-09-12T12:23:03.862025+0000","last_active":"2024-09-12T12:23:03.863278+0000","last_peered":"2024-09-12T12:23:03.863278+0000","last_clean":"2024-09-12T12:23:03.863278+0000","last_became_active":"2024-09-12T12:23:03.861450+0000","last_became_peered":"2024-09-12T12:23:03.861450+0000","last_unstale":"2024-09-12T12:23:03.863278+0000","last_undegraded":"2024-09-12T12:23:03.863278+0000","last_fullsized":"2024-09-12T12:23:03.863278+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:21.848115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.851152+0000","last_change":"2024-09-12T12:23:03.848653+0000","last_active":"2024-09-12T12:23:03.851152+0000","last_peered":"2024-09-12T12:23:03.851152+0000","last_clean":"2024-09-12T12:23:03.851152+0000","last_became_active":"2024-09-12T12:23:03.848375+0000","last_became_peered":"2024-09-12T12:23:03.848375+0000","last_unstale":"2024-09-12T12:23:03.851152+0000","last_undegraded":"2024-09-12T12:23:03.851152+0000","last_fullsized":"2024-09-12T12:23:03.851152+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:22.423653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863093+0000","last_change":"2024-09-12T12:23:03.860018+0000","last_active":"2024-09-12T12:23:03.863093+0000","last_peered":"2024-09-12T12:23:03.863093+0000","last_clean":"2024-09-12T12:23:03.863093+0000","last_became_active":"2024-09-12T12:23:03.859729+0000","last_became_peered":"2024-09-12T12:23:03.859729+0000","last_unstale":"2024-09-12T12:23:03.863093+0000","last_undegraded":"2024-09-12T12:23:03.863093+0000","last_fullsized":"2024-09-12T12:23:03.863093+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:17.582487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864711+0000","last_change":"2024-09-12T12:23:03.861082+0000","last_active":"2024-09-12T12:23:03.864711+0000","last_peered":"2024-09-12T12:23:03.864711+0000","last_clean":"2024-09-12T12:23:03.864711+0000","last_became_active":"2024-09-12T12:23:03.860782+0000","last_became_peered":"2024-09-12T12:23:03.860782+0000","last_unstale":"2024-09-12T12:23:03.864711+0000","last_undegraded":"2024-09-12T12:23:03.864711+0000","last_fullsized":"2024-09-12T12:23:03.864711+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:08.169856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.853673+0000","last_change":"2024-09-12T12:23:03.851700+0000","last_active":"2024-09-12T12:23:03.853673+0000","last_peered":"2024-09-12T12:23:03.853673+0000","last_clean":"2024-09-12T12:23:03.853673+0000","last_became_active":"2024-09-12T12:23:03.851396+0000","last_became_peered":"2024-09-12T12:23:03.851396+0000","last_unstale":"2024-09-12T12:23:03.853673+0000","last_undegraded":"2024-09-12T12:23:03.853673+0000","last_fullsized":"2024-09-12T12:23:03.853673+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.095725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863732+0000","last_change":"2024-09-12T12:23:03.860660+0000","last_active":"2024-09-12T12:23:03.863732+0000","last_peered":"2024-09-12T12:23:03.863732+0000","last_clean":"2024-09-12T12:23:03.863732+0000","last_became_active":"2024-09-12T12:23:03.860346+0000","last_became_peered":"2024-09-12T12:23:03.860346+0000","last_unstale":"2024-09-12T12:23:03.863732+0000","last_undegraded":"2024-09-12T12:23:03.863732+0000","last_fullsized":"2024-09-12T12:23:03.863732+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854540+0000","last_change":"2024-09-12T12:23:03.848758+0000","last_active":"2024-09-12T12:23:03.854540+0000","last_peered":"2024-09-12T12:23:03.854540+0000","last_clean":"2024-09-12T12:23:03.854540+0000","last_became_active":"2024-09-12T12:23:03.848484+0000","last_became_peered":"2024-09-12T12:23:03.848484+0000","last_unstale":"2024-09-12T12:23:03.854540+0000","last_undegraded":"2024-09-12T12:23:03.854540+0000","last_fullsized":"2024-09-12T12:23:03.854540+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.867864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859280+0000","last_change":"2024-09-12T12:23:03.855788+0000","last_active":"2024-09-12T12:23:03.859280+0000","last_peered":"2024-09-12T12:23:03.859280+0000","last_clean":"2024-09-12T12:23:03.859280+0000","last_became_active":"2024-09-12T12:23:03.855522+0000","last_became_peered":"2024-09-12T12:23:03.855522+0000","last_unstale":"2024-09-12T12:23:03.859280+0000","last_undegraded":"2024-09-12T12:23:03.859280+0000","last_fullsized":"2024-09-12T12:23:03.859280+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:21.878630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868085+0000","last_change":"2024-09-12T12:23:03.865902+0000","last_active":"2024-09-12T12:23:03.868085+0000","last_peered":"2024-09-12T12:23:03.868085+0000","last_clean":"2024-09-12T12:23:03.868085+0000","last_became_active":"2024-09-12T12:23:03.865562+0000","last_became_peered":"2024-09-12T12:23:03.865562+0000","last_unstale":"2024-09-12T12:23:03.868085+0000","last_undegraded":"2024-09-12T12:23:03.868085+0000","last_fullsized":"2024-09-12T12:23:03.868085+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.095725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.870319+0000","last_change":"2024-09-12T12:23:03.862113+0000","last_active":"2024-09-12T12:23:03.870319+0000","last_peered":"2024-09-12T12:23:03.870319+0000","last_clean":"2024-09-12T12:23:03.870319+0000","last_became_active":"2024-09-12T12:23:03.861835+0000","last_became_peered":"2024-09-12T12:23:03.861835+0000","last_unstale":"2024-09-12T12:23:03.870319+0000","last_undegraded":"2024-09-12T12:23:03.870319+0000","last_fullsized":"2024-09-12T12:23:03.870319+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:41.016265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.869757+0000","last_change":"2024-09-12T12:23:03.867416+0000","last_active":"2024-09-12T12:23:03.869757+0000","last_peered":"2024-09-12T12:23:03.869757+0000","last_clean":"2024-09-12T12:23:03.869757+0000","last_became_active":"2024-09-12T12:23:03.867060+0000","last_became_peered":"2024-09-12T12:23:03.867060+0000","last_unstale":"2024-09-12T12:23:03.869757+0000","last_undegraded":"2024-09-12T12:23:03.869757+0000","last_fullsized":"2024-09-12T12:23:03.869757+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:30.636565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.867563+0000","last_change":"2024-09-12T12:23:03.863298+0000","last_active":"2024-09-12T12:23:03.867563+0000","last_peered":"2024-09-12T12:23:03.867563+0000","last_clean":"2024-09-12T12:23:03.867563+0000","last_became_active":"2024-09-12T12:23:03.863020+0000","last_became_peered":"2024-09-12T12:23:03.863020+0000","last_unstale":"2024-09-12T12:23:03.867563+0000","last_undegraded":"2024-09-12T12:23:03.867563+0000","last_fullsized":"2024-09-12T12:23:03.867563+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:47.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863036+0000","last_change":"2024-09-12T12:23:03.861723+0000","last_active":"2024-09-12T12:23:03.863036+0000","last_peered":"2024-09-12T12:23:03.863036+0000","last_clean":"2024-09-12T12:23:03.863036+0000","last_became_active":"2024-09-12T12:23:03.861224+0000","last_became_peered":"2024-09-12T12:23:03.861224+0000","last_unstale":"2024-09-12T12:23:03.863036+0000","last_undegraded":"2024-09-12T12:23:03.863036+0000","last_fullsized":"2024-09-12T12:23:03.863036+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:53.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863711+0000","last_change":"2024-09-12T12:23:03.860035+0000","last_active":"2024-09-12T12:23:03.863711+0000","last_peered":"2024-09-12T12:23:03.863711+0000","last_clean":"2024-09-12T12:23:03.863711+0000","last_became_active":"2024-09-12T12:23:03.859093+0000","last_became_peered":"2024-09-12T12:23:03.859093+0000","last_unstale":"2024-09-12T12:23:03.863711+0000","last_undegraded":"2024-09-12T12:23:03.863711+0000","last_fullsized":"2024-09-12T12:23:03.863711+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:07.335420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.852084+0000","last_change":"2024-09-12T12:23:03.850759+0000","last_active":"2024-09-12T12:23:03.852084+0000","last_peered":"2024-09-12T12:23:03.852084+0000","last_clean":"2024-09-12T12:23:03.852084+0000","last_became_active":"2024-09-12T12:23:03.850496+0000","last_became_peered":"2024-09-12T12:23:03.850496+0000","last_unstale":"2024-09-12T12:23:03.852084+0000","last_undegraded":"2024-09-12T12:23:03.852084+0000","last_fullsized":"2024-09-12T12:23:03.852084+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:04.066195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859299+0000","last_change":"2024-09-12T12:23:03.856489+0000","last_active":"2024-09-12T12:23:03.859299+0000","last_peered":"2024-09-12T12:23:03.859299+0000","last_clean":"2024-09-12T12:23:03.859299+0000","last_became_active":"2024-09-12T12:23:03.855948+0000","last_became_peered":"2024-09-12T12:23:03.855948+0000","last_unstale":"2024-09-12T12:23:03.859299+0000","last_undegraded":"2024-09-12T12:23:03.859299+0000","last_fullsized":"2024-09-12T12:23:03.859299+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:34.709931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.872922+0000","last_change":"2024-09-12T12:23:03.870576+0000","last_active":"2024-09-12T12:23:03.872922+0000","last_peered":"2024-09-12T12:23:03.872922+0000","last_clean":"2024-09-12T12:23:03.872922+0000","last_became_active":"2024-09-12T12:23:03.867402+0000","last_became_peered":"2024-09-12T12:23:03.867402+0000","last_unstale":"2024-09-12T12:23:03.872922+0000","last_undegraded":"2024-09-12T12:23:03.872922+0000","last_fullsized":"2024-09-12T12:23:03.872922+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:23.336564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.869316+0000","last_change":"2024-09-12T12:23:03.860603+0000","last_active":"2024-09-12T12:23:03.869316+0000","last_peered":"2024-09-12T12:23:03.869316+0000","last_clean":"2024-09-12T12:23:03.869316+0000","last_became_active":"2024-09-12T12:23:03.860322+0000","last_became_peered":"2024-09-12T12:23:03.860322+0000","last_unstale":"2024-09-12T12:23:03.869316+0000","last_undegraded":"2024-09-12T12:23:03.869316+0000","last_fullsized":"2024-09-12T12:23:03.869316+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:56.262390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868091+0000","last_change":"2024-09-12T12:23:03.866183+0000","last_active":"2024-09-12T12:23:03.868091+0000","last_peered":"2024-09-12T12:23:03.868091+0000","last_clean":"2024-09-12T12:23:03.868091+0000","last_became_active":"2024-09-12T12:23:03.864832+0000","last_became_peered":"2024-09-12T12:23:03.864832+0000","last_unstale":"2024-09-12T12:23:03.868091+0000","last_undegraded":"2024-09-12T12:23:03.868091+0000","last_fullsized":"2024-09-12T12:23:03.868091+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:38.986598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.853781+0000","last_change":"2024-09-12T12:23:03.849578+0000","last_active":"2024-09-12T12:23:03.853781+0000","last_peered":"2024-09-12T12:23:03.853781+0000","last_clean":"2024-09-12T12:23:03.853781+0000","last_became_active":"2024-09-12T12:23:03.849286+0000","last_became_peered":"2024-09-12T12:23:03.849286+0000","last_unstale":"2024-09-12T12:23:03.853781+0000","last_undegraded":"2024-09-12T12:23:03.853781+0000","last_fullsized":"2024-09-12T12:23:03.853781+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:16.423001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862596+0000","last_change":"2024-09-12T12:23:03.861267+0000","last_active":"2024-09-12T12:23:03.862596+0000","last_peered":"2024-09-12T12:23:03.862596+0000","last_clean":"2024-09-12T12:23:03.862596+0000","last_became_active":"2024-09-12T12:23:03.860870+0000","last_became_peered":"2024-09-12T12:23:03.860870+0000","last_unstale":"2024-09-12T12:23:03.862596+0000","last_undegraded":"2024-09-12T12:23:03.862596+0000","last_fullsized":"2024-09-12T12:23:03.862596+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:51.806790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.870228+0000","last_change":"2024-09-12T12:23:03.863530+0000","last_active":"2024-09-12T12:23:03.870228+0000","last_peered":"2024-09-12T12:23:03.870228+0000","last_clean":"2024-09-12T12:23:03.870228+0000","last_became_active":"2024-09-12T12:23:03.863285+0000","last_became_peered":"2024-09-12T12:23:03.863285+0000","last_unstale":"2024-09-12T12:23:03.870228+0000","last_undegraded":"2024-09-12T12:23:03.870228+0000","last_fullsized":"2024-09-12T12:23:03.870228+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:30.291829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868958+0000","last_change":"2024-09-12T12:23:03.860376+0000","last_active":"2024-09-12T12:23:03.868958+0000","last_peered":"2024-09-12T12:23:03.868958+0000","last_clean":"2024-09-12T12:23:03.868958+0000","last_became_active":"2024-09-12T12:23:03.860132+0000","last_became_peered":"2024-09-12T12:23:03.860132+0000","last_unstale":"2024-09-12T12:23:03.868958+0000","last_undegraded":"2024-09-12T12:23:03.868958+0000","last_fullsized":"2024-09-12T12:23:03.868958+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:47.355077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.867909+0000","last_change":"2024-09-12T12:23:03.864868+0000","last_active":"2024-09-12T12:23:03.867909+0000","last_peered":"2024-09-12T12:23:03.867909+0000","last_clean":"2024-09-12T12:23:03.867909+0000","last_became_active":"2024-09-12T12:23:03.864569+0000","last_became_peered":"2024-09-12T12:23:03.864569+0000","last_unstale":"2024-09-12T12:23:03.867909+0000","last_undegraded":"2024-09-12T12:23:03.867909+0000","last_fullsized":"2024-09-12T12:23:03.867909+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.867864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868288+0000","last_change":"2024-09-12T12:23:03.858388+0000","last_active":"2024-09-12T12:23:03.868288+0000","last_peered":"2024-09-12T12:23:03.868288+0000","last_clean":"2024-09-12T12:23:03.868288+0000","last_became_active":"2024-09-12T12:23:03.857871+0000","last_became_peered":"2024-09-12T12:23:03.857871+0000","last_unstale":"2024-09-12T12:23:03.868288+0000","last_undegraded":"2024-09-12T12:23:03.868288+0000","last_fullsized":"2024-09-12T12:23:03.868288+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:11.670574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.866555+0000","last_change":"2024-09-12T12:23:03.864454+0000","last_active":"2024-09-12T12:23:03.866555+0000","last_peered":"2024-09-12T12:23:03.866555+0000","last_clean":"2024-09-12T12:23:03.866555+0000","last_became_active":"2024-09-12T12:23:03.864066+0000","last_became_peered":"2024-09-12T12:23:03.864066+0000","last_unstale":"2024-09-12T12:23:03.866555+0000","last_undegraded":"2024-09-12T12:23:03.866555+0000","last_fullsized":"2024-09-12T12:23:03.866555+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:21.878630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859170+0000","last_change":"2024-09-12T12:23:03.853389+0000","last_active":"2024-09-12T12:23:03.859170+0000","last_peered":"2024-09-12T12:23:03.859170+0000","last_clean":"2024-09-12T12:23:03.859170+0000","last_became_active":"2024-09-12T12:23:03.852888+0000","last_became_peered":"2024-09-12T12:23:03.852888+0000","last_unstale":"2024-09-12T12:23:03.859170+0000","last_undegraded":"2024-09-12T12:23:03.859170+0000","last_fullsized":"2024-09-12T12:23:03.859170+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:56.732745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.858825+0000","last_change":"2024-09-12T12:23:03.855190+0000","last_active":"2024-09-12T12:23:03.858825+0000","last_peered":"2024-09-12T12:23:03.858825+0000","last_clean":"2024-09-12T12:23:03.858825+0000","last_became_active":"2024-09-12T12:23:03.854905+0000","last_became_peered":"2024-09-12T12:23:03.854905+0000","last_unstale":"2024-09-12T12:23:03.858825+0000","last_undegraded":"2024-09-12T12:23:03.858825+0000","last_fullsized":"2024-09-12T12:23:03.858825+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:17.582487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862723+0000","last_change":"2024-09-12T12:23:03.858591+0000","last_active":"2024-09-12T12:23:03.862723+0000","last_peered":"2024-09-12T12:23:03.862723+0000","last_clean":"2024-09-12T12:23:03.862723+0000","last_became_active":"2024-09-12T12:23:03.858236+0000","last_became_peered":"2024-09-12T12:23:03.858236+0000","last_unstale":"2024-09-12T12:23:03.862723+0000","last_undegraded":"2024-09-12T12:23:03.862723+0000","last_fullsized":"2024-09-12T12:23:03.862723+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:30.199086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868660+0000","last_change":"2024-09-12T12:23:03.867713+0000","last_active":"2024-09-12T12:23:03.868660+0000","last_peered":"2024-09-12T12:23:03.868660+0000","last_clean":"2024-09-12T12:23:03.868660+0000","last_became_active":"2024-09-12T12:23:03.866805+0000","last_became_peered":"2024-09-12T12:23:03.866805+0000","last_unstale":"2024-09-12T12:23:03.868660+0000","last_undegraded":"2024-09-12T12:23:03.868660+0000","last_fullsized":"2024-09-12T12:23:03.868660+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:07.335420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"164'4","reported_seq":16,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.876973+0000","last_change":"2024-09-12T12:23:02.849430+0000","last_active":"2024-09-12T12:23:03.876973+0000","last_peered":"2024-09-12T12:23:03.876973+0000","last_clean":"2024-09-12T12:23:03.876973+0000","last_became_active":"2024-09-12T12:23:02.849241+0000","last_became_peered":"2024-09-12T12:23:02.849241+0000","last_unstale":"2024-09-12T12:23:03.876973+0000","last_undegraded":"2024-09-12T12:23:03.876973+0000","last_fullsized":"2024-09-12T12:23:03.876973+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:24.889874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.866085+0000","last_change":"2024-09-12T12:23:03.856403+0000","last_active":"2024-09-12T12:23:03.866085+0000","last_peered":"2024-09-12T12:23:03.866085+0000","last_clean":"2024-09-12T12:23:03.866085+0000","last_became_active":"2024-09-12T12:23:03.856125+0000","last_became_peered":"2024-09-12T12:23:03.856125+0000","last_unstale":"2024-09-12T12:23:03.866085+0000","last_undegraded":"2024-09-12T12:23:03.866085+0000","last_fullsized":"2024-09-12T12:23:03.866085+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:33.325502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.880100+0000","last_change":"2024-09-12T12:23:02.837296+0000","last_active":"2024-09-12T12:23:03.880100+0000","last_peered":"2024-09-12T12:23:03.880100+0000","last_clean":"2024-09-12T12:23:03.880100+0000","last_became_active":"2024-09-12T12:23:02.837039+0000","last_became_peered":"2024-09-12T12:23:02.837039+0000","last_unstale":"2024-09-12T12:23:03.880100+0000","last_undegraded":"2024-09-12T12:23:03.880100+0000","last_fullsized":"2024-09-12T12:23:03.880100+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:02.363114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862626+0000","last_change":"2024-09-12T12:23:03.852197+0000","last_active":"2024-09-12T12:23:03.862626+0000","last_peered":"2024-09-12T12:23:03.862626+0000","last_clean":"2024-09-12T12:23:03.862626+0000","last_became_active":"2024-09-12T12:23:03.851938+0000","last_became_peered":"2024-09-12T12:23:03.851938+0000","last_unstale":"2024-09-12T12:23:03.862626+0000","last_undegraded":"2024-09-12T12:23:03.862626+0000","last_fullsized":"2024-09-12T12:23:03.862626+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:25.704803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.876726+0000","last_change":"2024-09-12T12:23:02.835317+0000","last_active":"2024-09-12T12:23:03.876726+0000","last_peered":"2024-09-12T12:23:03.876726+0000","last_clean":"2024-09-12T12:23:03.876726+0000","last_became_active":"2024-09-12T12:23:02.835059+0000","last_became_peered":"2024-09-12T12:23:02.835059+0000","last_unstale":"2024-09-12T12:23:03.876726+0000","last_undegraded":"2024-09-12T12:23:03.876726+0000","last_fullsized":"2024-09-12T12:23:03.876726+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:43.530772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.870882+0000","last_change":"2024-09-12T12:23:03.869453+0000","last_active":"2024-09-12T12:23:03.870882+0000","last_peered":"2024-09-12T12:23:03.870882+0000","last_clean":"2024-09-12T12:23:03.870882+0000","last_became_active":"2024-09-12T12:23:03.869126+0000","last_became_peered":"2024-09-12T12:23:03.869126+0000","last_unstale":"2024-09-12T12:23:03.870882+0000","last_undegraded":"2024-09-12T12:23:03.870882+0000","last_fullsized":"2024-09-12T12:23:03.870882+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:08.169856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.878725+0000","last_change":"2024-09-12T12:23:02.843624+0000","last_active":"2024-09-12T12:23:03.878725+0000","last_peered":"2024-09-12T12:23:03.878725+0000","last_clean":"2024-09-12T12:23:03.878725+0000","last_became_active":"2024-09-12T12:23:02.843345+0000","last_became_peered":"2024-09-12T12:23:02.843345+0000","last_unstale":"2024-09-12T12:23:03.878725+0000","last_undegraded":"2024-09-12T12:23:03.878725+0000","last_fullsized":"2024-09-12T12:23:03.878725+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:19.391489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864064+0000","last_change":"2024-09-12T12:23:03.855214+0000","last_active":"2024-09-12T12:23:03.864064+0000","last_peered":"2024-09-12T12:23:03.864064+0000","last_clean":"2024-09-12T12:23:03.864064+0000","last_became_active":"2024-09-12T12:23:03.854932+0000","last_became_peered":"2024-09-12T12:23:03.854932+0000","last_unstale":"2024-09-12T12:23:03.864064+0000","last_undegraded":"2024-09-12T12:23:03.864064+0000","last_fullsized":"2024-09-12T12:23:03.864064+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:14.204718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.879932+0000","last_change":"2024-09-12T12:23:02.847263+0000","last_active":"2024-09-12T12:23:03.879932+0000","last_peered":"2024-09-12T12:23:03.879932+0000","last_clean":"2024-09-12T12:23:03.879932+0000","last_became_active":"2024-09-12T12:23:02.846986+0000","last_became_peered":"2024-09-12T12:23:02.846986+0000","last_unstale":"2024-09-12T12:23:03.879932+0000","last_undegraded":"2024-09-12T12:23:03.879932+0000","last_fullsized":"2024-09-12T12:23:03.879932+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:43.530772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.874276+0000","last_change":"2024-09-12T12:23:03.865529+0000","last_active":"2024-09-12T12:23:03.874276+0000","last_peered":"2024-09-12T12:23:03.874276+0000","last_clean":"2024-09-12T12:23:03.874276+0000","last_became_active":"2024-09-12T12:23:03.865218+0000","last_became_peered":"2024-09-12T12:23:03.865218+0000","last_unstale":"2024-09-12T12:23:03.874276+0000","last_undegraded":"2024-09-12T12:23:03.874276+0000","last_fullsized":"2024-09-12T12:23:03.874276+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:45.325835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.877872+0000","last_change":"2024-09-12T12:23:02.846559+0000","last_active":"2024-09-12T12:23:03.877872+0000","last_peered":"2024-09-12T12:23:03.877872+0000","last_clean":"2024-09-12T12:23:03.877872+0000","last_became_active":"2024-09-12T12:23:02.846282+0000","last_became_peered":"2024-09-12T12:23:02.846282+0000","last_unstale":"2024-09-12T12:23:03.877872+0000","last_undegraded":"2024-09-12T12:23:03.877872+0000","last_fullsized":"2024-09-12T12:23:03.877872+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:38.951326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864787+0000","last_change":"2024-09-12T12:23:03.855562+0000","last_active":"2024-09-12T12:23:03.864787+0000","last_peered":"2024-09-12T12:23:03.864787+0000","last_clean":"2024-09-12T12:23:03.864787+0000","last_became_active":"2024-09-12T12:23:03.855207+0000","last_became_peered":"2024-09-12T12:23:03.855207+0000","last_unstale":"2024-09-12T12:23:03.864787+0000","last_undegraded":"2024-09-12T12:23:03.864787+0000","last_fullsized":"2024-09-12T12:23:03.864787+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:17.849711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.850296+0000","last_change":"2024-09-12T12:23:02.845165+0000","last_active":"2024-09-12T12:23:03.850296+0000","last_peered":"2024-09-12T12:23:03.850296+0000","last_clean":"2024-09-12T12:23:03.850296+0000","last_became_active":"2024-09-12T12:23:02.844891+0000","last_became_peered":"2024-09-12T12:23:02.844891+0000","last_unstale":"2024-09-12T12:23:03.850296+0000","last_undegraded":"2024-09-12T12:23:03.850296+0000","last_fullsized":"2024-09-12T12:23:03.850296+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:49.405439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859838+0000","last_change":"2024-09-12T12:23:03.855827+0000","last_active":"2024-09-12T12:23:03.859838+0000","last_peered":"2024-09-12T12:23:03.859838+0000","last_clean":"2024-09-12T12:23:03.859838+0000","last_became_active":"2024-09-12T12:23:03.853963+0000","last_became_peered":"2024-09-12T12:23:03.853963+0000","last_unstale":"2024-09-12T12:23:03.859838+0000","last_undegraded":"2024-09-12T12:23:03.859838+0000","last_fullsized":"2024-09-12T12:23:03.859838+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:45.089276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.846650+0000","last_change":"2024-09-12T12:23:02.844090+0000","last_active":"2024-09-12T12:23:03.846650+0000","last_peered":"2024-09-12T12:23:03.846650+0000","last_clean":"2024-09-12T12:23:03.846650+0000","last_became_active":"2024-09-12T12:23:02.843835+0000","last_became_peered":"2024-09-12T12:23:02.843835+0000","last_unstale":"2024-09-12T12:23:03.846650+0000","last_undegraded":"2024-09-12T12:23:03.846650+0000","last_fullsized":"2024-09-12T12:23:03.846650+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:14.268669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.872938+0000","last_change":"2024-09-12T12:23:03.870246+0000","last_active":"2024-09-12T12:23:03.872938+0000","last_peered":"2024-09-12T12:23:03.872938+0000","last_clean":"2024-09-12T12:23:03.872938+0000","last_became_active":"2024-09-12T12:23:03.870048+0000","last_became_peered":"2024-09-12T12:23:03.870048+0000","last_unstale":"2024-09-12T12:23:03.872938+0000","last_undegraded":"2024-09-12T12:23:03.872938+0000","last_fullsized":"2024-09-12T12:23:03.872938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:44.451452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.845400+0000","last_change":"2024-09-12T12:23:02.847290+0000","last_active":"2024-09-12T12:23:03.845400+0000","last_peered":"2024-09-12T12:23:03.845400+0000","last_clean":"2024-09-12T12:23:03.845400+0000","last_became_active":"2024-09-12T12:23:02.846571+0000","last_became_peered":"2024-09-12T12:23:02.846571+0000","last_unstale":"2024-09-12T12:23:03.845400+0000","last_undegraded":"2024-09-12T12:23:03.845400+0000","last_fullsized":"2024-09-12T12:23:03.845400+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:58.091769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.865841+0000","last_change":"2024-09-12T12:23:03.856569+0000","last_active":"2024-09-12T12:23:03.865841+0000","last_peered":"2024-09-12T12:23:03.865841+0000","last_clean":"2024-09-12T12:23:03.865841+0000","last_became_active":"2024-09-12T12:23:03.855839+0000","last_became_peered":"2024-09-12T12:23:03.855839+0000","last_unstale":"2024-09-12T12:23:03.865841+0000","last_undegraded":"2024-09-12T12:23:03.865841+0000","last_fullsized":"2024-09-12T12:23:03.865841+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:29.807733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"164'3","reported_seq":15,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.875518+0000","last_change":"2024-09-12T12:23:02.832161+0000","last_active":"2024-09-12T12:23:03.875518+0000","last_peered":"2024-09-12T12:23:03.875518+0000","last_clean":"2024-09-12T12:23:03.875518+0000","last_became_active":"2024-09-12T12:23:02.831531+0000","last_became_peered":"2024-09-12T12:23:02.831531+0000","last_unstale":"2024-09-12T12:23:03.875518+0000","last_undegraded":"2024-09-12T12:23:03.875518+0000","last_fullsized":"2024-09-12T12:23:03.875518+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:53.959165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.865029+0000","last_change":"2024-09-12T12:23:03.859014+0000","last_active":"2024-09-12T12:23:03.865029+0000","last_peered":"2024-09-12T12:23:03.865029+0000","last_clean":"2024-09-12T12:23:03.865029+0000","last_became_active":"2024-09-12T12:23:03.858742+0000","last_became_peered":"2024-09-12T12:23:03.858742+0000","last_unstale":"2024-09-12T12:23:03.865029+0000","last_undegraded":"2024-09-12T12:23:03.865029+0000","last_fullsized":"2024-09-12T12:23:03.865029+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:23.333417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"164'6","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.882099+0000","last_change":"2024-09-12T12:23:02.848115+0000","last_active":"2024-09-12T12:23:03.882099+0000","last_peered":"2024-09-12T12:23:03.882099+0000","last_clean":"2024-09-12T12:23:03.882099+0000","last_became_active":"2024-09-12T12:23:02.846405+0000","last_became_peered":"2024-09-12T12:23:02.846405+0000","last_unstale":"2024-09-12T12:23:03.882099+0000","last_undegraded":"2024-09-12T12:23:03.882099+0000","last_fullsized":"2024-09-12T12:23:03.882099+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:46.562512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.861327+0000","last_change":"2024-09-12T12:23:03.859301+0000","last_active":"2024-09-12T12:23:03.861327+0000","last_peered":"2024-09-12T12:23:03.861327+0000","last_clean":"2024-09-12T12:23:03.861327+0000","last_became_active":"2024-09-12T12:23:03.858985+0000","last_became_peered":"2024-09-12T12:23:03.858985+0000","last_unstale":"2024-09-12T12:23:03.861327+0000","last_undegraded":"2024-09-12T12:23:03.861327+0000","last_fullsized":"2024-09-12T12:23:03.861327+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:30.320376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.878107+0000","last_change":"2024-09-12T12:23:02.840312+0000","last_active":"2024-09-12T12:23:03.878107+0000","last_peered":"2024-09-12T12:23:03.878107+0000","last_clean":"2024-09-12T12:23:03.878107+0000","last_became_active":"2024-09-12T12:23:02.840040+0000","last_became_peered":"2024-09-12T12:23:02.840040+0000","last_unstale":"2024-09-12T12:23:03.878107+0000","last_undegraded":"2024-09-12T12:23:03.878107+0000","last_fullsized":"2024-09-12T12:23:03.878107+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:21.562546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854162+0000","last_change":"2024-09-12T12:23:03.849726+0000","last_active":"2024-09-12T12:23:03.854162+0000","last_peered":"2024-09-12T12:23:03.854162+0000","last_clean":"2024-09-12T12:23:03.854162+0000","last_became_active":"2024-09-12T12:23:03.848049+0000","last_became_peered":"2024-09-12T12:23:03.848049+0000","last_unstale":"2024-09-12T12:23:03.854162+0000","last_undegraded":"2024-09-12T12:23:03.854162+0000","last_fullsized":"2024-09-12T12:23:03.854162+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:34.709931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.845856+0000","last_change":"2024-09-12T12:23:02.845758+0000","last_active":"2024-09-12T12:23:03.845856+0000","last_peered":"2024-09-12T12:23:03.845856+0000","last_clean":"2024-09-12T12:23:03.845856+0000","last_became_active":"2024-09-12T12:23:02.844686+0000","last_became_peered":"2024-09-12T12:23:02.844686+0000","last_unstale":"2024-09-12T12:23:03.845856+0000","last_undegraded":"2024-09-12T12:23:03.845856+0000","last_fullsized":"2024-09-12T12:23:03.845856+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:05.574020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859328+0000","last_change":"2024-09-12T12:23:03.857248+0000","last_active":"2024-09-12T12:23:03.859328+0000","last_peered":"2024-09-12T12:23:03.859328+0000","last_clean":"2024-09-12T12:23:03.859328+0000","last_became_active":"2024-09-12T12:23:03.856968+0000","last_became_peered":"2024-09-12T12:23:03.856968+0000","last_unstale":"2024-09-12T12:23:03.859328+0000","last_undegraded":"2024-09-12T12:23:03.859328+0000","last_fullsized":"2024-09-12T12:23:03.859328+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.095725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.850800+0000","last_change":"2024-09-12T12:23:02.839753+0000","last_active":"2024-09-12T12:23:03.850800+0000","last_peered":"2024-09-12T12:23:03.850800+0000","last_clean":"2024-09-12T12:23:03.850800+0000","last_became_active":"2024-09-12T12:23:02.838673+0000","last_became_peered":"2024-09-12T12:23:02.838673+0000","last_unstale":"2024-09-12T12:23:03.850800+0000","last_undegraded":"2024-09-12T12:23:03.850800+0000","last_fullsized":"2024-09-12T12:23:03.850800+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:29.313797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862300+0000","last_change":"2024-09-12T12:23:03.854358+0000","last_active":"2024-09-12T12:23:03.862300+0000","last_peered":"2024-09-12T12:23:03.862300+0000","last_clean":"2024-09-12T12:23:03.862300+0000","last_became_active":"2024-09-12T12:23:03.853648+0000","last_became_peered":"2024-09-12T12:23:03.853648+0000","last_unstale":"2024-09-12T12:23:03.862300+0000","last_undegraded":"2024-09-12T12:23:03.862300+0000","last_fullsized":"2024-09-12T12:23:03.862300+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:02:47.390812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"164'8","reported_seq":20,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.880600+0000","last_change":"2024-09-12T12:23:02.834110+0000","last_active":"2024-09-12T12:23:03.880600+0000","last_peered":"2024-09-12T12:23:03.880600+0000","last_clean":"2024-09-12T12:23:03.880600+0000","last_became_active":"2024-09-12T12:23:02.833802+0000","last_became_peered":"2024-09-12T12:23:02.833802+0000","last_unstale":"2024-09-12T12:23:03.880600+0000","last_undegraded":"2024-09-12T12:23:03.880600+0000","last_fullsized":"2024-09-12T12:23:03.880600+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:16.575909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.865855+0000","last_change":"2024-09-12T12:23:03.863007+0000","last_active":"2024-09-12T12:23:03.865855+0000","last_peered":"2024-09-12T12:23:03.865855+0000","last_clean":"2024-09-12T12:23:03.865855+0000","last_became_active":"2024-09-12T12:23:03.862732+0000","last_became_peered":"2024-09-12T12:23:03.862732+0000","last_unstale":"2024-09-12T12:23:03.865855+0000","last_undegraded":"2024-09-12T12:23:03.865855+0000","last_fullsized":"2024-09-12T12:23:03.865855+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:44.451452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.876475+0000","last_change":"2024-09-12T12:23:02.840131+0000","last_active":"2024-09-12T12:23:03.876475+0000","last_peered":"2024-09-12T12:23:03.876475+0000","last_clean":"2024-09-12T12:23:03.876475+0000","last_became_active":"2024-09-12T12:23:02.839886+0000","last_became_peered":"2024-09-12T12:23:02.839886+0000","last_unstale":"2024-09-12T12:23:03.876475+0000","last_undegraded":"2024-09-12T12:23:03.876475+0000","last_fullsized":"2024-09-12T12:23:03.876475+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:10:25.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.861293+0000","last_change":"2024-09-12T12:23:03.859564+0000","last_active":"2024-09-12T12:23:03.861293+0000","last_peered":"2024-09-12T12:23:03.861293+0000","last_clean":"2024-09-12T12:23:03.861293+0000","last_became_active":"2024-09-12T12:23:03.859302+0000","last_became_peered":"2024-09-12T12:23:03.859302+0000","last_unstale":"2024-09-12T12:23:03.861293+0000","last_undegraded":"2024-09-12T12:23:03.861293+0000","last_fullsized":"2024-09-12T12:23:03.861293+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:44.537351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.879873+0000","last_change":"2024-09-12T12:23:02.848096+0000","last_active":"2024-09-12T12:23:03.879873+0000","last_peered":"2024-09-12T12:23:03.879873+0000","last_clean":"2024-09-12T12:23:03.879873+0000","last_became_active":"2024-09-12T12:23:02.846791+0000","last_became_peered":"2024-09-12T12:23:02.846791+0000","last_unstale":"2024-09-12T12:23:03.879873+0000","last_undegraded":"2024-09-12T12:23:03.879873+0000","last_fullsized":"2024-09-12T12:23:03.879873+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:20.872052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859015+0000","last_change":"2024-09-12T12:23:03.854917+0000","last_active":"2024-09-12T12:23:03.859015+0000","last_peered":"2024-09-12T12:23:03.859015+0000","last_clean":"2024-09-12T12:23:03.859015+0000","last_became_active":"2024-09-12T12:23:03.854598+0000","last_became_peered":"2024-09-12T12:23:03.854598+0000","last_unstale":"2024-09-12T12:23:03.859015+0000","last_undegraded":"2024-09-12T12:23:03.859015+0000","last_fullsized":"2024-09-12T12:23:03.859015+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:26.216247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.877905+0000","last_change":"2024-09-12T12:23:02.844472+0000","last_active":"2024-09-12T12:23:03.877905+0000","last_peered":"2024-09-12T12:23:03.877905+0000","last_clean":"2024-09-12T12:23:03.877905+0000","last_became_active":"2024-09-12T12:23:02.839568+0000","last_became_peered":"2024-09-12T12:23:02.839568+0000","last_unstale":"2024-09-12T12:23:03.877905+0000","last_undegraded":"2024-09-12T12:23:03.877905+0000","last_fullsized":"2024-09-12T12:23:03.877905+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:49.902421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859241+0000","last_change":"2024-09-12T12:23:03.855968+0000","last_active":"2024-09-12T12:23:03.859241+0000","last_peered":"2024-09-12T12:23:03.859241+0000","last_clean":"2024-09-12T12:23:03.859241+0000","last_became_active":"2024-09-12T12:23:03.855255+0000","last_became_peered":"2024-09-12T12:23:03.855255+0000","last_unstale":"2024-09-12T12:23:03.859241+0000","last_undegraded":"2024-09-12T12:23:03.859241+0000","last_fullsized":"2024-09-12T12:23:03.859241+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.867864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844003+0000","last_change":"2024-09-12T12:23:02.842054+0000","last_active":"2024-09-12T12:23:03.844003+0000","last_peered":"2024-09-12T12:23:03.844003+0000","last_clean":"2024-09-12T12:23:03.844003+0000","last_became_active":"2024-09-12T12:23:02.841733+0000","last_became_peered":"2024-09-12T12:23:02.841733+0000","last_unstale":"2024-09-12T12:23:03.844003+0000","last_undegraded":"2024-09-12T12:23:03.844003+0000","last_fullsized":"2024-09-12T12:23:03.844003+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:25.209669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868267+0000","last_change":"2024-09-12T12:23:03.858174+0000","last_active":"2024-09-12T12:23:03.868267+0000","last_peered":"2024-09-12T12:23:03.868267+0000","last_clean":"2024-09-12T12:23:03.868267+0000","last_became_active":"2024-09-12T12:23:03.857568+0000","last_became_peered":"2024-09-12T12:23:03.857568+0000","last_unstale":"2024-09-12T12:23:03.868267+0000","last_undegraded":"2024-09-12T12:23:03.868267+0000","last_fullsized":"2024-09-12T12:23:03.868267+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:36.925387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.878230+0000","last_change":"2024-09-12T12:23:02.845128+0000","last_active":"2024-09-12T12:23:03.878230+0000","last_peered":"2024-09-12T12:23:03.878230+0000","last_clean":"2024-09-12T12:23:03.878230+0000","last_became_active":"2024-09-12T12:23:02.840640+0000","last_became_peered":"2024-09-12T12:23:02.840640+0000","last_unstale":"2024-09-12T12:23:03.878230+0000","last_undegraded":"2024-09-12T12:23:03.878230+0000","last_fullsized":"2024-09-12T12:23:03.878230+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:06.794634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864012+0000","last_change":"2024-09-12T12:23:03.852360+0000","last_active":"2024-09-12T12:23:03.864012+0000","last_peered":"2024-09-12T12:23:03.864012+0000","last_clean":"2024-09-12T12:23:03.864012+0000","last_became_active":"2024-09-12T12:23:03.851534+0000","last_became_peered":"2024-09-12T12:23:03.851534+0000","last_unstale":"2024-09-12T12:23:03.864012+0000","last_undegraded":"2024-09-12T12:23:03.864012+0000","last_fullsized":"2024-09-12T12:23:03.864012+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:11:54.464521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.850685+0000","last_change":"2024-09-12T12:23:02.845018+0000","last_active":"2024-09-12T12:23:03.850685+0000","last_peered":"2024-09-12T12:23:03.850685+0000","last_clean":"2024-09-12T12:23:03.850685+0000","last_became_active":"2024-09-12T12:23:02.844650+0000","last_became_peered":"2024-09-12T12:23:02.844650+0000","last_unstale":"2024-09-12T12:23:03.850685+0000","last_undegraded":"2024-09-12T12:23:03.850685+0000","last_fullsized":"2024-09-12T12:23:03.850685+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:29.192508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864436+0000","last_change":"2024-09-12T12:23:03.856342+0000","last_active":"2024-09-12T12:23:03.864436+0000","last_peered":"2024-09-12T12:23:03.864436+0000","last_clean":"2024-09-12T12:23:03.864436+0000","last_became_active":"2024-09-12T12:23:03.856084+0000","last_became_peered":"2024-09-12T12:23:03.856084+0000","last_unstale":"2024-09-12T12:23:03.864436+0000","last_undegraded":"2024-09-12T12:23:03.864436+0000","last_fullsized":"2024-09-12T12:23:03.864436+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:01.411327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.850456+0000","last_change":"2024-09-12T12:23:02.839056+0000","last_active":"2024-09-12T12:23:03.850456+0000","last_peered":"2024-09-12T12:23:03.850456+0000","last_clean":"2024-09-12T12:23:03.850456+0000","last_became_active":"2024-09-12T12:23:02.838743+0000","last_became_peered":"2024-09-12T12:23:02.838743+0000","last_unstale":"2024-09-12T12:23:03.850456+0000","last_undegraded":"2024-09-12T12:23:03.850456+0000","last_fullsized":"2024-09-12T12:23:03.850456+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:44.679345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868062+0000","last_change":"2024-09-12T12:23:03.865711+0000","last_active":"2024-09-12T12:23:03.868062+0000","last_peered":"2024-09-12T12:23:03.868062+0000","last_clean":"2024-09-12T12:23:03.868062+0000","last_became_active":"2024-09-12T12:23:03.864705+0000","last_became_peered":"2024-09-12T12:23:03.864705+0000","last_unstale":"2024-09-12T12:23:03.868062+0000","last_undegraded":"2024-09-12T12:23:03.868062+0000","last_fullsized":"2024-09-12T12:23:03.868062+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:47.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854210+0000","last_change":"2024-09-12T12:23:02.842740+0000","last_active":"2024-09-12T12:23:03.854210+0000","last_peered":"2024-09-12T12:23:03.854210+0000","last_clean":"2024-09-12T12:23:03.854210+0000","last_became_active":"2024-09-12T12:23:02.841648+0000","last_became_peered":"2024-09-12T12:23:02.841648+0000","last_unstale":"2024-09-12T12:23:03.854210+0000","last_undegraded":"2024-09-12T12:23:03.854210+0000","last_fullsized":"2024-09-12T12:23:03.854210+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:14.268669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.858902+0000","last_change":"2024-09-12T12:23:03.855109+0000","last_active":"2024-09-12T12:23:03.858902+0000","last_peered":"2024-09-12T12:23:03.858902+0000","last_clean":"2024-09-12T12:23:03.858902+0000","last_became_active":"2024-09-12T12:23:03.854752+0000","last_became_peered":"2024-09-12T12:23:03.854752+0000","last_unstale":"2024-09-12T12:23:03.858902+0000","last_undegraded":"2024-09-12T12:23:03.858902+0000","last_fullsized":"2024-09-12T12:23:03.858902+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:15.275247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.877962+0000","last_change":"2024-09-12T12:23:02.845084+0000","last_active":"2024-09-12T12:23:03.877962+0000","last_peered":"2024-09-12T12:23:03.877962+0000","last_clean":"2024-09-12T12:23:03.877962+0000","last_became_active":"2024-09-12T12:23:02.844810+0000","last_became_peered":"2024-09-12T12:23:02.844810+0000","last_unstale":"2024-09-12T12:23:03.877962+0000","last_undegraded":"2024-09-12T12:23:03.877962+0000","last_fullsized":"2024-09-12T12:23:03.877962+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:02.353019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862068+0000","last_change":"2024-09-12T12:23:03.853845+0000","last_active":"2024-09-12T12:23:03.862068+0000","last_peered":"2024-09-12T12:23:03.862068+0000","last_clean":"2024-09-12T12:23:03.862068+0000","last_became_active":"2024-09-12T12:23:03.853532+0000","last_became_peered":"2024-09-12T12:23:03.853532+0000","last_unstale":"2024-09-12T12:23:03.862068+0000","last_undegraded":"2024-09-12T12:23:03.862068+0000","last_fullsized":"2024-09-12T12:23:03.862068+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:38.986598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844531+0000","last_change":"2024-09-12T12:23:02.849865+0000","last_active":"2024-09-12T12:23:03.844531+0000","last_peered":"2024-09-12T12:23:03.844531+0000","last_clean":"2024-09-12T12:23:03.844531+0000","last_became_active":"2024-09-12T12:23:02.849443+0000","last_became_peered":"2024-09-12T12:23:02.849443+0000","last_unstale":"2024-09-12T12:23:03.844531+0000","last_undegraded":"2024-09-12T12:23:03.844531+0000","last_fullsized":"2024-09-12T12:23:03.844531+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:52.950045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862308+0000","last_change":"2024-09-12T12:23:03.851514+0000","last_active":"2024-09-12T12:23:03.862308+0000","last_peered":"2024-09-12T12:23:03.862308+0000","last_clean":"2024-09-12T12:23:03.862308+0000","last_became_active":"2024-09-12T12:23:03.851246+0000","last_became_peered":"2024-09-12T12:23:03.851246+0000","last_unstale":"2024-09-12T12:23:03.862308+0000","last_undegraded":"2024-09-12T12:23:03.862308+0000","last_fullsized":"2024-09-12T12:23:03.862308+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:48.670699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844705+0000","last_change":"2024-09-12T12:23:02.842669+0000","last_active":"2024-09-12T12:23:03.844705+0000","last_peered":"2024-09-12T12:23:03.844705+0000","last_clean":"2024-09-12T12:23:03.844705+0000","last_became_active":"2024-09-12T12:23:02.841948+0000","last_became_peered":"2024-09-12T12:23:02.841948+0000","last_unstale":"2024-09-12T12:23:03.844705+0000","last_undegraded":"2024-09-12T12:23:03.844705+0000","last_fullsized":"2024-09-12T12:23:03.844705+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:41.443690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.858727+0000","last_change":"2024-09-12T12:23:03.853042+0000","last_active":"2024-09-12T12:23:03.858727+0000","last_peered":"2024-09-12T12:23:03.858727+0000","last_clean":"2024-09-12T12:23:03.858727+0000","last_became_active":"2024-09-12T12:23:03.852698+0000","last_became_peered":"2024-09-12T12:23:03.852698+0000","last_unstale":"2024-09-12T12:23:03.858727+0000","last_undegraded":"2024-09-12T12:23:03.858727+0000","last_fullsized":"2024-09-12T12:23:03.858727+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:47.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.853164+0000","last_change":"2024-09-12T12:23:02.833930+0000","last_active":"2024-09-12T12:23:03.853164+0000","last_peered":"2024-09-12T12:23:03.853164+0000","last_clean":"2024-09-12T12:23:03.853164+0000","last_became_active":"2024-09-12T12:23:02.833661+0000","last_became_peered":"2024-09-12T12:23:02.833661+0000","last_unstale":"2024-09-12T12:23:03.853164+0000","last_undegraded":"2024-09-12T12:23:03.853164+0000","last_fullsized":"2024-09-12T12:23:03.853164+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:56.481666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854372+0000","last_change":"2024-09-12T12:23:03.852699+0000","last_active":"2024-09-12T12:23:03.854372+0000","last_peered":"2024-09-12T12:23:03.854372+0000","last_clean":"2024-09-12T12:23:03.854372+0000","last_became_active":"2024-09-12T12:23:03.852425+0000","last_became_peered":"2024-09-12T12:23:03.852425+0000","last_unstale":"2024-09-12T12:23:03.854372+0000","last_undegraded":"2024-09-12T12:23:03.854372+0000","last_fullsized":"2024-09-12T12:23:03.854372+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:25.677092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844201+0000","last_change":"2024-09-12T12:23:02.842997+0000","last_active":"2024-09-12T12:23:03.844201+0000","last_peered":"2024-09-12T12:23:03.844201+0000","last_clean":"2024-09-12T12:23:03.844201+0000","last_became_active":"2024-09-12T12:23:02.842693+0000","last_became_peered":"2024-09-12T12:23:02.842693+0000","last_unstale":"2024-09-12T12:23:03.844201+0000","last_undegraded":"2024-09-12T12:23:03.844201+0000","last_fullsized":"2024-09-12T12:23:03.844201+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:04.148503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.869382+0000","last_change":"2024-09-12T12:23:03.868018+0000","last_active":"2024-09-12T12:23:03.869382+0000","last_peered":"2024-09-12T12:23:03.869382+0000","last_clean":"2024-09-12T12:23:03.869382+0000","last_became_active":"2024-09-12T12:23:03.867711+0000","last_became_peered":"2024-09-12T12:23:03.867711+0000","last_unstale":"2024-09-12T12:23:03.869382+0000","last_undegraded":"2024-09-12T12:23:03.869382+0000","last_fullsized":"2024-09-12T12:23:03.869382+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.845825+0000","last_change":"2024-09-12T12:23:02.847715+0000","last_active":"2024-09-12T12:23:03.845825+0000","last_peered":"2024-09-12T12:23:03.845825+0000","last_clean":"2024-09-12T12:23:03.845825+0000","last_became_active":"2024-09-12T12:23:02.847365+0000","last_became_peered":"2024-09-12T12:23:02.847365+0000","last_unstale":"2024-09-12T12:23:03.845825+0000","last_undegraded":"2024-09-12T12:23:03.845825+0000","last_fullsized":"2024-09-12T12:23:03.845825+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:20.350599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868164+0000","last_change":"2024-09-12T12:23:03.859469+0000","last_active":"2024-09-12T12:23:03.868164+0000","last_peered":"2024-09-12T12:23:03.868164+0000","last_clean":"2024-09-12T12:23:03.868164+0000","last_became_active":"2024-09-12T12:23:03.859202+0000","last_became_peered":"2024-09-12T12:23:03.859202+0000","last_unstale":"2024-09-12T12:23:03.868164+0000","last_undegraded":"2024-09-12T12:23:03.868164+0000","last_fullsized":"2024-09-12T12:23:03.868164+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:20.533011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.849758+0000","last_change":"2024-09-12T12:23:02.835196+0000","last_active":"2024-09-12T12:23:03.849758+0000","last_peered":"2024-09-12T12:23:03.849758+0000","last_clean":"2024-09-12T12:23:03.849758+0000","last_became_active":"2024-09-12T12:23:02.834556+0000","last_became_peered":"2024-09-12T12:23:02.834556+0000","last_unstale":"2024-09-12T12:23:03.849758+0000","last_undegraded":"2024-09-12T12:23:03.849758+0000","last_fullsized":"2024-09-12T12:23:03.849758+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:55.726167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.874458+0000","last_change":"2024-09-12T12:23:03.870673+0000","last_active":"2024-09-12T12:23:03.874458+0000","last_peered":"2024-09-12T12:23:03.874458+0000","last_clean":"2024-09-12T12:23:03.874458+0000","last_became_active":"2024-09-12T12:23:03.870365+0000","last_became_peered":"2024-09-12T12:23:03.870365+0000","last_unstale":"2024-09-12T12:23:03.874458+0000","last_undegraded":"2024-09-12T12:23:03.874458+0000","last_fullsized":"2024-09-12T12:23:03.874458+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:11.099172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.838397+0000","last_change":"2024-09-12T12:23:02.840986+0000","last_active":"2024-09-12T12:23:03.838397+0000","last_peered":"2024-09-12T12:23:03.838397+0000","last_clean":"2024-09-12T12:23:03.838397+0000","last_became_active":"2024-09-12T12:23:02.840723+0000","last_became_peered":"2024-09-12T12:23:02.840723+0000","last_unstale":"2024-09-12T12:23:03.838397+0000","last_undegraded":"2024-09-12T12:23:03.838397+0000","last_fullsized":"2024-09-12T12:23:03.838397+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:25.071858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.867268+0000","last_change":"2024-09-12T12:23:03.865475+0000","last_active":"2024-09-12T12:23:03.867268+0000","last_peered":"2024-09-12T12:23:03.867268+0000","last_clean":"2024-09-12T12:23:03.867268+0000","last_became_active":"2024-09-12T12:23:03.863919+0000","last_became_peered":"2024-09-12T12:23:03.863919+0000","last_unstale":"2024-09-12T12:23:03.867268+0000","last_undegraded":"2024-09-12T12:23:03.867268+0000","last_fullsized":"2024-09-12T12:23:03.867268+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:34.709931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844377+0000","last_change":"2024-09-12T12:23:02.848571+0000","last_active":"2024-09-12T12:23:03.844377+0000","last_peered":"2024-09-12T12:23:03.844377+0000","last_clean":"2024-09-12T12:23:03.844377+0000","last_became_active":"2024-09-12T12:23:02.848309+0000","last_became_peered":"2024-09-12T12:23:02.848309+0000","last_unstale":"2024-09-12T12:23:03.844377+0000","last_undegraded":"2024-09-12T12:23:03.844377+0000","last_fullsized":"2024-09-12T12:23:03.844377+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:04.925614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":433,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854265+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:23:03.854265+0000","last_peered":"2024-09-12T12:23:03.854265+0000","last_clean":"2024-09-12T12:23:03.854265+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:23:03.854265+0000","last_undegraded":"2024-09-12T12:23:03.854265+0000","last_fullsized":"2024-09-12T12:23:03.854265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47672,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324168,"statfs":{"total":96636764160,"available":96587948032,"internally_reserved":0,"allocated":2654208,"data_stored":1562281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51252,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320588,"statfs":{"total":96636764160,"available":96584282112,"internally_reserved":0,"allocated":2060288,"data_stored":971913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2068480,"data_stored":972037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55432,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316408,"statfs":{"total":96636764160,"available":96580001792,"internally_reserved":0,"allocated":2076672,"data_stored":972677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574979,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55436,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316404,"statfs":{"total":96636764160,"available":96579997696,"internally_reserved":0,"allocated":2080768,"data_stored":974129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55400,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316440,"statfs":{"total":96636764160,"available":96580034560,"internally_reserved":0,"allocated":2048000,"data_stored":964746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55428,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316412,"statfs":{"total":96636764160,"available":96580005888,"internally_reserved":0,"allocated":2072576,"data_stored":973525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51840,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320000,"statfs":{"total":96636764160,"available":96583680000,"internally_reserved":0,"allocated":2662400,"data_stored":1562385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:23:07.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:23:08.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.113+0000 7f742de00640 1 Processor -- start 2024-09-12T12:23:08.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.113+0000 7f742de00640 1 -- start start 2024-09-12T12:23:08.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f742de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74280b3590 0x7f742815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f742de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74280b3aa0 con 0x7f742815ad50 2024-09-12T12:23:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f742de00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74280afc10 con 0x7f74280b49e0 2024-09-12T12:23:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f742de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f742815f860 con 0x7f74280b3590 2024-09-12T12:23:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7426a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f742815ad50 0x7f74280b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34578/0 (socket says 172.21.15.144:34578) 2024-09-12T12:23:08.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7426a00640 1 -- 172.21.15.144:0/4068577510 learned_addr learned my addr 172.21.15.144:0/4068577510 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7427400640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74280b3590 0x7f742815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985395486 0 0) 0x7f74280b3aa0 con 0x7f742815ad50 2024-09-12T12:23:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f740c003530 con 0x7f742815ad50 2024-09-12T12:23:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3772576358 0 0) 0x7f740c003530 con 0x7f742815ad50 2024-09-12T12:23:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74280b3590 msgr2=0x7f742815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74280b3590 0x7f742815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 >> v1:172.21.15.165:6789/0 conn(0x7f74280b49e0 legacy=0x7f74280b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74280afef0 con 0x7f742815ad50 2024-09-12T12:23:08.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f7418001680 con 0x7f742815ad50 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 >> v1:172.21.15.144:6789/0 conn(0x7f742815ad50 legacy=0x7f74280b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74280b3590 0x7f740c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f740c003f70 0x7f740c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f740c004d50 0x7f740c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f742815f860 con 0x7f740c003f70 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f740c00bab0 con 0x7f740c004d50 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f740c00dec0 con 0x7f74280b3590 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7426000640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f740c003f70 0x7f740c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7426a00640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74280b3590 0x7f740c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7427400640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f740c004d50 0x7f740c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7426000640 1 -- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74280b3590 msgr2=0x7f740c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7426000640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74280b3590 0x7f740c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7426000640 1 -- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f740c004d50 msgr2=0x7f740c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7426000640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f740c004d50 0x7f740c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.117+0000 7f7426000640 1 -- 172.21.15.144:0/4068577510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740c003530 con 0x7f740c003f70 2024-09-12T12:23:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f7426000640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f740c003f70 0x7f740c004810 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f7414001780 tx=0x7f741401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a36c4b8dabbc5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74140013a0 con 0x7f740c003f70 2024-09-12T12:23:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74140052f0 con 0x7f740c003f70 2024-09-12T12:23:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f7425600640 1 -- 172.21.15.144:0/4068577510 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414003840 con 0x7f740c003f70 2024-09-12T12:23:08.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f742de00640 1 -- 172.21.15.144:0/4068577510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f740c003f70 msgr2=0x7f740c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f742de00640 1 --2- 172.21.15.144:0/4068577510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f740c003f70 0x7f740c004810 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f7414001780 tx=0x7f741401c420 comp rx=0 tx=0).stop 2024-09-12T12:23:08.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f7427400640 1 -- 172.21.15.144:0/4068577510 reap_dead start 2024-09-12T12:23:08.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f742de00640 1 -- 172.21.15.144:0/4068577510 shutdown_connections 2024-09-12T12:23:08.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f742de00640 1 -- 172.21.15.144:0/4068577510 >> 172.21.15.144:0/4068577510 conn(0x7f742806d0d0 msgr2=0x7f742806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:08.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f742de00640 1 -- 172.21.15.144:0/4068577510 shutdown_connections 2024-09-12T12:23:08.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f742de00640 1 -- 172.21.15.144:0/4068577510 wait complete. 2024-09-12T12:23:08.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f742de00640 1 Processor -- start 2024-09-12T12:23:08.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.121+0000 7f742de00640 1 -- start start 2024-09-12T12:23:08.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f742de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f740c003f70 0x7f742815dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f742de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74281e78c0 0x7f74281f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f742de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74281508d0 0x7f7428150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f742de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f742815b130 con 0x7f74281508d0 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f742de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f74280cdeb0 con 0x7f74281e78c0 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f742de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f742815b2b0 con 0x7f740c003f70 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7427400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74281508d0 0x7f7428150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7427400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74281508d0 0x7f7428150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45804/0 (socket says 172.21.15.144:45804) 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7427400640 1 -- 172.21.15.144:0/2014005497 learned_addr learned my addr 172.21.15.144:0/2014005497 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7426000640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74281e78c0 0x7f74281f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7426a00640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f740c003f70 0x7f742815dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7427400640 1 -- 172.21.15.144:0/2014005497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f740c003f70 msgr2=0x7f742815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7427400640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f740c003f70 0x7f742815dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7427400640 1 -- 172.21.15.144:0/2014005497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74281e78c0 msgr2=0x7f74281f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7427400640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74281e78c0 0x7f74281f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7427400640 1 -- 172.21.15.144:0/2014005497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74281f8de0 con 0x7f74281508d0 2024-09-12T12:23:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f7427400640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74281508d0 0x7f7428150d50 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f74280cda10 tx=0x7f742000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f741f400640 1 -- 172.21.15.144:0/2014005497 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420011e90 con 0x7f74281508d0 2024-09-12T12:23:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f741f400640 1 -- 172.21.15.144:0/2014005497 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742001c070 con 0x7f74281508d0 2024-09-12T12:23:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f741f400640 1 -- 172.21.15.144:0/2014005497 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420003be0 con 0x7f74281508d0 2024-09-12T12:23:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74281e8a20 con 0x7f74281508d0 2024-09-12T12:23:08.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74281e6de0 con 0x7f74281508d0 2024-09-12T12:23:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.125+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742815f320 con 0x7f74281508d0 2024-09-12T12:23:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.129+0000 7f741f400640 1 -- 172.21.15.144:0/2014005497 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7420004030 con 0x7f74281508d0 2024-09-12T12:23:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.129+0000 7f741f400640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7408067a90 0x7f7408069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.129+0000 7f741f400640 1 -- 172.21.15.144:0/2014005497 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f7420086640 con 0x7f74281508d0 2024-09-12T12:23:08.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.129+0000 7f7426a00640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7408067a90 0x7f7408069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.129+0000 7f7426a00640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7408067a90 0x7f7408069f50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f74180011f0 tx=0x7f7418007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.133+0000 7f741f400640 1 -- 172.21.15.144:0/2014005497 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7420010040 con 0x7f74281508d0 2024-09-12T12:23:08.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.285+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7428073fc0 con 0x7f7408067a90 2024-09-12T12:23:08.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.293+0000 7f741f400640 1 -- 172.21.15.144:0/2014005497 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252412 (secure 0 0 0) 0x7f7428073fc0 con 0x7f7408067a90 2024-09-12T12:23:08.293 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:08.295 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7408067a90 msgr2=0x7f7408069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7408067a90 0x7f7408069f50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f74180011f0 tx=0x7f7418007900 comp rx=0 tx=0).stop 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74281508d0 msgr2=0x7f7428150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74281508d0 0x7f7428150d50 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f74280cda10 tx=0x7f742000f580 comp rx=0 tx=0).stop 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 shutdown_connections 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7408067a90 0x7f7408069f50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74281508d0 0x7f7428150d50 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74281e78c0 0x7f74281f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 --2- 172.21.15.144:0/2014005497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f740c003f70 0x7f742815dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 >> 172.21.15.144:0/2014005497 conn(0x7f742806d0d0 msgr2=0x7f74280ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:08.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 shutdown_connections 2024-09-12T12:23:08.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.297+0000 7f742de00640 1 -- 172.21.15.144:0/2014005497 wait complete. 2024-09-12T12:23:08.314 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":475,"stamp":"2024-09-12T12:23:07.509062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":423720,"kb_used_data":17308,"kb_used_omap":12,"kb_used_meta":406195,"kb_avail":754551000,"statfs":{"total":773094113280,"available":772660224000,"internally_reserved":0,"allocated":17723392,"data_stored":8953693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":415944241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.690444"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.852310+0000","last_change":"2024-09-12T12:23:03.846464+0000","last_active":"2024-09-12T12:23:03.852310+0000","last_peered":"2024-09-12T12:23:03.852310+0000","last_clean":"2024-09-12T12:23:03.852310+0000","last_became_active":"2024-09-12T12:23:03.846156+0000","last_became_peered":"2024-09-12T12:23:03.846156+0000","last_unstale":"2024-09-12T12:23:03.852310+0000","last_undegraded":"2024-09-12T12:23:03.852310+0000","last_fullsized":"2024-09-12T12:23:03.852310+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:37.477024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868618+0000","last_change":"2024-09-12T12:23:03.867003+0000","last_active":"2024-09-12T12:23:03.868618+0000","last_peered":"2024-09-12T12:23:03.868618+0000","last_clean":"2024-09-12T12:23:03.868618+0000","last_became_active":"2024-09-12T12:23:03.866702+0000","last_became_peered":"2024-09-12T12:23:03.866702+0000","last_unstale":"2024-09-12T12:23:03.868618+0000","last_undegraded":"2024-09-12T12:23:03.868618+0000","last_fullsized":"2024-09-12T12:23:03.868618+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:14.204718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859075+0000","last_change":"2024-09-12T12:23:03.855347+0000","last_active":"2024-09-12T12:23:03.859075+0000","last_peered":"2024-09-12T12:23:03.859075+0000","last_clean":"2024-09-12T12:23:03.859075+0000","last_became_active":"2024-09-12T12:23:03.854176+0000","last_became_peered":"2024-09-12T12:23:03.854176+0000","last_unstale":"2024-09-12T12:23:03.859075+0000","last_undegraded":"2024-09-12T12:23:03.859075+0000","last_fullsized":"2024-09-12T12:23:03.859075+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:53:34.181070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863278+0000","last_change":"2024-09-12T12:23:03.862025+0000","last_active":"2024-09-12T12:23:03.863278+0000","last_peered":"2024-09-12T12:23:03.863278+0000","last_clean":"2024-09-12T12:23:03.863278+0000","last_became_active":"2024-09-12T12:23:03.861450+0000","last_became_peered":"2024-09-12T12:23:03.861450+0000","last_unstale":"2024-09-12T12:23:03.863278+0000","last_undegraded":"2024-09-12T12:23:03.863278+0000","last_fullsized":"2024-09-12T12:23:03.863278+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:21.848115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.851152+0000","last_change":"2024-09-12T12:23:03.848653+0000","last_active":"2024-09-12T12:23:03.851152+0000","last_peered":"2024-09-12T12:23:03.851152+0000","last_clean":"2024-09-12T12:23:03.851152+0000","last_became_active":"2024-09-12T12:23:03.848375+0000","last_became_peered":"2024-09-12T12:23:03.848375+0000","last_unstale":"2024-09-12T12:23:03.851152+0000","last_undegraded":"2024-09-12T12:23:03.851152+0000","last_fullsized":"2024-09-12T12:23:03.851152+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:22.423653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863093+0000","last_change":"2024-09-12T12:23:03.860018+0000","last_active":"2024-09-12T12:23:03.863093+0000","last_peered":"2024-09-12T12:23:03.863093+0000","last_clean":"2024-09-12T12:23:03.863093+0000","last_became_active":"2024-09-12T12:23:03.859729+0000","last_became_peered":"2024-09-12T12:23:03.859729+0000","last_unstale":"2024-09-12T12:23:03.863093+0000","last_undegraded":"2024-09-12T12:23:03.863093+0000","last_fullsized":"2024-09-12T12:23:03.863093+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:17.582487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864711+0000","last_change":"2024-09-12T12:23:03.861082+0000","last_active":"2024-09-12T12:23:03.864711+0000","last_peered":"2024-09-12T12:23:03.864711+0000","last_clean":"2024-09-12T12:23:03.864711+0000","last_became_active":"2024-09-12T12:23:03.860782+0000","last_became_peered":"2024-09-12T12:23:03.860782+0000","last_unstale":"2024-09-12T12:23:03.864711+0000","last_undegraded":"2024-09-12T12:23:03.864711+0000","last_fullsized":"2024-09-12T12:23:03.864711+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:08.169856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.853673+0000","last_change":"2024-09-12T12:23:03.851700+0000","last_active":"2024-09-12T12:23:03.853673+0000","last_peered":"2024-09-12T12:23:03.853673+0000","last_clean":"2024-09-12T12:23:03.853673+0000","last_became_active":"2024-09-12T12:23:03.851396+0000","last_became_peered":"2024-09-12T12:23:03.851396+0000","last_unstale":"2024-09-12T12:23:03.853673+0000","last_undegraded":"2024-09-12T12:23:03.853673+0000","last_fullsized":"2024-09-12T12:23:03.853673+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.095725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863732+0000","last_change":"2024-09-12T12:23:03.860660+0000","last_active":"2024-09-12T12:23:03.863732+0000","last_peered":"2024-09-12T12:23:03.863732+0000","last_clean":"2024-09-12T12:23:03.863732+0000","last_became_active":"2024-09-12T12:23:03.860346+0000","last_became_peered":"2024-09-12T12:23:03.860346+0000","last_unstale":"2024-09-12T12:23:03.863732+0000","last_undegraded":"2024-09-12T12:23:03.863732+0000","last_fullsized":"2024-09-12T12:23:03.863732+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854540+0000","last_change":"2024-09-12T12:23:03.848758+0000","last_active":"2024-09-12T12:23:03.854540+0000","last_peered":"2024-09-12T12:23:03.854540+0000","last_clean":"2024-09-12T12:23:03.854540+0000","last_became_active":"2024-09-12T12:23:03.848484+0000","last_became_peered":"2024-09-12T12:23:03.848484+0000","last_unstale":"2024-09-12T12:23:03.854540+0000","last_undegraded":"2024-09-12T12:23:03.854540+0000","last_fullsized":"2024-09-12T12:23:03.854540+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.867864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859280+0000","last_change":"2024-09-12T12:23:03.855788+0000","last_active":"2024-09-12T12:23:03.859280+0000","last_peered":"2024-09-12T12:23:03.859280+0000","last_clean":"2024-09-12T12:23:03.859280+0000","last_became_active":"2024-09-12T12:23:03.855522+0000","last_became_peered":"2024-09-12T12:23:03.855522+0000","last_unstale":"2024-09-12T12:23:03.859280+0000","last_undegraded":"2024-09-12T12:23:03.859280+0000","last_fullsized":"2024-09-12T12:23:03.859280+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:21.878630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868085+0000","last_change":"2024-09-12T12:23:03.865902+0000","last_active":"2024-09-12T12:23:03.868085+0000","last_peered":"2024-09-12T12:23:03.868085+0000","last_clean":"2024-09-12T12:23:03.868085+0000","last_became_active":"2024-09-12T12:23:03.865562+0000","last_became_peered":"2024-09-12T12:23:03.865562+0000","last_unstale":"2024-09-12T12:23:03.868085+0000","last_undegraded":"2024-09-12T12:23:03.868085+0000","last_fullsized":"2024-09-12T12:23:03.868085+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.095725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.870319+0000","last_change":"2024-09-12T12:23:03.862113+0000","last_active":"2024-09-12T12:23:03.870319+0000","last_peered":"2024-09-12T12:23:03.870319+0000","last_clean":"2024-09-12T12:23:03.870319+0000","last_became_active":"2024-09-12T12:23:03.861835+0000","last_became_peered":"2024-09-12T12:23:03.861835+0000","last_unstale":"2024-09-12T12:23:03.870319+0000","last_undegraded":"2024-09-12T12:23:03.870319+0000","last_fullsized":"2024-09-12T12:23:03.870319+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:41.016265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.869757+0000","last_change":"2024-09-12T12:23:03.867416+0000","last_active":"2024-09-12T12:23:03.869757+0000","last_peered":"2024-09-12T12:23:03.869757+0000","last_clean":"2024-09-12T12:23:03.869757+0000","last_became_active":"2024-09-12T12:23:03.867060+0000","last_became_peered":"2024-09-12T12:23:03.867060+0000","last_unstale":"2024-09-12T12:23:03.869757+0000","last_undegraded":"2024-09-12T12:23:03.869757+0000","last_fullsized":"2024-09-12T12:23:03.869757+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:30.636565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.867563+0000","last_change":"2024-09-12T12:23:03.863298+0000","last_active":"2024-09-12T12:23:03.867563+0000","last_peered":"2024-09-12T12:23:03.867563+0000","last_clean":"2024-09-12T12:23:03.867563+0000","last_became_active":"2024-09-12T12:23:03.863020+0000","last_became_peered":"2024-09-12T12:23:03.863020+0000","last_unstale":"2024-09-12T12:23:03.867563+0000","last_undegraded":"2024-09-12T12:23:03.867563+0000","last_fullsized":"2024-09-12T12:23:03.867563+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:47.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863036+0000","last_change":"2024-09-12T12:23:03.861723+0000","last_active":"2024-09-12T12:23:03.863036+0000","last_peered":"2024-09-12T12:23:03.863036+0000","last_clean":"2024-09-12T12:23:03.863036+0000","last_became_active":"2024-09-12T12:23:03.861224+0000","last_became_peered":"2024-09-12T12:23:03.861224+0000","last_unstale":"2024-09-12T12:23:03.863036+0000","last_undegraded":"2024-09-12T12:23:03.863036+0000","last_fullsized":"2024-09-12T12:23:03.863036+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:53.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.863711+0000","last_change":"2024-09-12T12:23:03.860035+0000","last_active":"2024-09-12T12:23:03.863711+0000","last_peered":"2024-09-12T12:23:03.863711+0000","last_clean":"2024-09-12T12:23:03.863711+0000","last_became_active":"2024-09-12T12:23:03.859093+0000","last_became_peered":"2024-09-12T12:23:03.859093+0000","last_unstale":"2024-09-12T12:23:03.863711+0000","last_undegraded":"2024-09-12T12:23:03.863711+0000","last_fullsized":"2024-09-12T12:23:03.863711+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:07.335420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.852084+0000","last_change":"2024-09-12T12:23:03.850759+0000","last_active":"2024-09-12T12:23:03.852084+0000","last_peered":"2024-09-12T12:23:03.852084+0000","last_clean":"2024-09-12T12:23:03.852084+0000","last_became_active":"2024-09-12T12:23:03.850496+0000","last_became_peered":"2024-09-12T12:23:03.850496+0000","last_unstale":"2024-09-12T12:23:03.852084+0000","last_undegraded":"2024-09-12T12:23:03.852084+0000","last_fullsized":"2024-09-12T12:23:03.852084+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:04.066195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859299+0000","last_change":"2024-09-12T12:23:03.856489+0000","last_active":"2024-09-12T12:23:03.859299+0000","last_peered":"2024-09-12T12:23:03.859299+0000","last_clean":"2024-09-12T12:23:03.859299+0000","last_became_active":"2024-09-12T12:23:03.855948+0000","last_became_peered":"2024-09-12T12:23:03.855948+0000","last_unstale":"2024-09-12T12:23:03.859299+0000","last_undegraded":"2024-09-12T12:23:03.859299+0000","last_fullsized":"2024-09-12T12:23:03.859299+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:34.709931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.872922+0000","last_change":"2024-09-12T12:23:03.870576+0000","last_active":"2024-09-12T12:23:03.872922+0000","last_peered":"2024-09-12T12:23:03.872922+0000","last_clean":"2024-09-12T12:23:03.872922+0000","last_became_active":"2024-09-12T12:23:03.867402+0000","last_became_peered":"2024-09-12T12:23:03.867402+0000","last_unstale":"2024-09-12T12:23:03.872922+0000","last_undegraded":"2024-09-12T12:23:03.872922+0000","last_fullsized":"2024-09-12T12:23:03.872922+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:23.336564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.869316+0000","last_change":"2024-09-12T12:23:03.860603+0000","last_active":"2024-09-12T12:23:03.869316+0000","last_peered":"2024-09-12T12:23:03.869316+0000","last_clean":"2024-09-12T12:23:03.869316+0000","last_became_active":"2024-09-12T12:23:03.860322+0000","last_became_peered":"2024-09-12T12:23:03.860322+0000","last_unstale":"2024-09-12T12:23:03.869316+0000","last_undegraded":"2024-09-12T12:23:03.869316+0000","last_fullsized":"2024-09-12T12:23:03.869316+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:56.262390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868091+0000","last_change":"2024-09-12T12:23:03.866183+0000","last_active":"2024-09-12T12:23:03.868091+0000","last_peered":"2024-09-12T12:23:03.868091+0000","last_clean":"2024-09-12T12:23:03.868091+0000","last_became_active":"2024-09-12T12:23:03.864832+0000","last_became_peered":"2024-09-12T12:23:03.864832+0000","last_unstale":"2024-09-12T12:23:03.868091+0000","last_undegraded":"2024-09-12T12:23:03.868091+0000","last_fullsized":"2024-09-12T12:23:03.868091+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:38.986598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.853781+0000","last_change":"2024-09-12T12:23:03.849578+0000","last_active":"2024-09-12T12:23:03.853781+0000","last_peered":"2024-09-12T12:23:03.853781+0000","last_clean":"2024-09-12T12:23:03.853781+0000","last_became_active":"2024-09-12T12:23:03.849286+0000","last_became_peered":"2024-09-12T12:23:03.849286+0000","last_unstale":"2024-09-12T12:23:03.853781+0000","last_undegraded":"2024-09-12T12:23:03.853781+0000","last_fullsized":"2024-09-12T12:23:03.853781+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:16.423001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862596+0000","last_change":"2024-09-12T12:23:03.861267+0000","last_active":"2024-09-12T12:23:03.862596+0000","last_peered":"2024-09-12T12:23:03.862596+0000","last_clean":"2024-09-12T12:23:03.862596+0000","last_became_active":"2024-09-12T12:23:03.860870+0000","last_became_peered":"2024-09-12T12:23:03.860870+0000","last_unstale":"2024-09-12T12:23:03.862596+0000","last_undegraded":"2024-09-12T12:23:03.862596+0000","last_fullsized":"2024-09-12T12:23:03.862596+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:51.806790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.870228+0000","last_change":"2024-09-12T12:23:03.863530+0000","last_active":"2024-09-12T12:23:03.870228+0000","last_peered":"2024-09-12T12:23:03.870228+0000","last_clean":"2024-09-12T12:23:03.870228+0000","last_became_active":"2024-09-12T12:23:03.863285+0000","last_became_peered":"2024-09-12T12:23:03.863285+0000","last_unstale":"2024-09-12T12:23:03.870228+0000","last_undegraded":"2024-09-12T12:23:03.870228+0000","last_fullsized":"2024-09-12T12:23:03.870228+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:30.291829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868958+0000","last_change":"2024-09-12T12:23:03.860376+0000","last_active":"2024-09-12T12:23:03.868958+0000","last_peered":"2024-09-12T12:23:03.868958+0000","last_clean":"2024-09-12T12:23:03.868958+0000","last_became_active":"2024-09-12T12:23:03.860132+0000","last_became_peered":"2024-09-12T12:23:03.860132+0000","last_unstale":"2024-09-12T12:23:03.868958+0000","last_undegraded":"2024-09-12T12:23:03.868958+0000","last_fullsized":"2024-09-12T12:23:03.868958+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:36:47.355077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.867909+0000","last_change":"2024-09-12T12:23:03.864868+0000","last_active":"2024-09-12T12:23:03.867909+0000","last_peered":"2024-09-12T12:23:03.867909+0000","last_clean":"2024-09-12T12:23:03.867909+0000","last_became_active":"2024-09-12T12:23:03.864569+0000","last_became_peered":"2024-09-12T12:23:03.864569+0000","last_unstale":"2024-09-12T12:23:03.867909+0000","last_undegraded":"2024-09-12T12:23:03.867909+0000","last_fullsized":"2024-09-12T12:23:03.867909+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.867864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868288+0000","last_change":"2024-09-12T12:23:03.858388+0000","last_active":"2024-09-12T12:23:03.868288+0000","last_peered":"2024-09-12T12:23:03.868288+0000","last_clean":"2024-09-12T12:23:03.868288+0000","last_became_active":"2024-09-12T12:23:03.857871+0000","last_became_peered":"2024-09-12T12:23:03.857871+0000","last_unstale":"2024-09-12T12:23:03.868288+0000","last_undegraded":"2024-09-12T12:23:03.868288+0000","last_fullsized":"2024-09-12T12:23:03.868288+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:11.670574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.866555+0000","last_change":"2024-09-12T12:23:03.864454+0000","last_active":"2024-09-12T12:23:03.866555+0000","last_peered":"2024-09-12T12:23:03.866555+0000","last_clean":"2024-09-12T12:23:03.866555+0000","last_became_active":"2024-09-12T12:23:03.864066+0000","last_became_peered":"2024-09-12T12:23:03.864066+0000","last_unstale":"2024-09-12T12:23:03.866555+0000","last_undegraded":"2024-09-12T12:23:03.866555+0000","last_fullsized":"2024-09-12T12:23:03.866555+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:21.878630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859170+0000","last_change":"2024-09-12T12:23:03.853389+0000","last_active":"2024-09-12T12:23:03.859170+0000","last_peered":"2024-09-12T12:23:03.859170+0000","last_clean":"2024-09-12T12:23:03.859170+0000","last_became_active":"2024-09-12T12:23:03.852888+0000","last_became_peered":"2024-09-12T12:23:03.852888+0000","last_unstale":"2024-09-12T12:23:03.859170+0000","last_undegraded":"2024-09-12T12:23:03.859170+0000","last_fullsized":"2024-09-12T12:23:03.859170+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:56.732745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.858825+0000","last_change":"2024-09-12T12:23:03.855190+0000","last_active":"2024-09-12T12:23:03.858825+0000","last_peered":"2024-09-12T12:23:03.858825+0000","last_clean":"2024-09-12T12:23:03.858825+0000","last_became_active":"2024-09-12T12:23:03.854905+0000","last_became_peered":"2024-09-12T12:23:03.854905+0000","last_unstale":"2024-09-12T12:23:03.858825+0000","last_undegraded":"2024-09-12T12:23:03.858825+0000","last_fullsized":"2024-09-12T12:23:03.858825+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:17.582487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862723+0000","last_change":"2024-09-12T12:23:03.858591+0000","last_active":"2024-09-12T12:23:03.862723+0000","last_peered":"2024-09-12T12:23:03.862723+0000","last_clean":"2024-09-12T12:23:03.862723+0000","last_became_active":"2024-09-12T12:23:03.858236+0000","last_became_peered":"2024-09-12T12:23:03.858236+0000","last_unstale":"2024-09-12T12:23:03.862723+0000","last_undegraded":"2024-09-12T12:23:03.862723+0000","last_fullsized":"2024-09-12T12:23:03.862723+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:30.199086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868660+0000","last_change":"2024-09-12T12:23:03.867713+0000","last_active":"2024-09-12T12:23:03.868660+0000","last_peered":"2024-09-12T12:23:03.868660+0000","last_clean":"2024-09-12T12:23:03.868660+0000","last_became_active":"2024-09-12T12:23:03.866805+0000","last_became_peered":"2024-09-12T12:23:03.866805+0000","last_unstale":"2024-09-12T12:23:03.868660+0000","last_undegraded":"2024-09-12T12:23:03.868660+0000","last_fullsized":"2024-09-12T12:23:03.868660+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:04:07.335420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"164'4","reported_seq":16,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.876973+0000","last_change":"2024-09-12T12:23:02.849430+0000","last_active":"2024-09-12T12:23:03.876973+0000","last_peered":"2024-09-12T12:23:03.876973+0000","last_clean":"2024-09-12T12:23:03.876973+0000","last_became_active":"2024-09-12T12:23:02.849241+0000","last_became_peered":"2024-09-12T12:23:02.849241+0000","last_unstale":"2024-09-12T12:23:03.876973+0000","last_undegraded":"2024-09-12T12:23:03.876973+0000","last_fullsized":"2024-09-12T12:23:03.876973+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:24.889874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.866085+0000","last_change":"2024-09-12T12:23:03.856403+0000","last_active":"2024-09-12T12:23:03.866085+0000","last_peered":"2024-09-12T12:23:03.866085+0000","last_clean":"2024-09-12T12:23:03.866085+0000","last_became_active":"2024-09-12T12:23:03.856125+0000","last_became_peered":"2024-09-12T12:23:03.856125+0000","last_unstale":"2024-09-12T12:23:03.866085+0000","last_undegraded":"2024-09-12T12:23:03.866085+0000","last_fullsized":"2024-09-12T12:23:03.866085+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:33.325502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.880100+0000","last_change":"2024-09-12T12:23:02.837296+0000","last_active":"2024-09-12T12:23:03.880100+0000","last_peered":"2024-09-12T12:23:03.880100+0000","last_clean":"2024-09-12T12:23:03.880100+0000","last_became_active":"2024-09-12T12:23:02.837039+0000","last_became_peered":"2024-09-12T12:23:02.837039+0000","last_unstale":"2024-09-12T12:23:03.880100+0000","last_undegraded":"2024-09-12T12:23:03.880100+0000","last_fullsized":"2024-09-12T12:23:03.880100+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:02.363114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862626+0000","last_change":"2024-09-12T12:23:03.852197+0000","last_active":"2024-09-12T12:23:03.862626+0000","last_peered":"2024-09-12T12:23:03.862626+0000","last_clean":"2024-09-12T12:23:03.862626+0000","last_became_active":"2024-09-12T12:23:03.851938+0000","last_became_peered":"2024-09-12T12:23:03.851938+0000","last_unstale":"2024-09-12T12:23:03.862626+0000","last_undegraded":"2024-09-12T12:23:03.862626+0000","last_fullsized":"2024-09-12T12:23:03.862626+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:25.704803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.876726+0000","last_change":"2024-09-12T12:23:02.835317+0000","last_active":"2024-09-12T12:23:03.876726+0000","last_peered":"2024-09-12T12:23:03.876726+0000","last_clean":"2024-09-12T12:23:03.876726+0000","last_became_active":"2024-09-12T12:23:02.835059+0000","last_became_peered":"2024-09-12T12:23:02.835059+0000","last_unstale":"2024-09-12T12:23:03.876726+0000","last_undegraded":"2024-09-12T12:23:03.876726+0000","last_fullsized":"2024-09-12T12:23:03.876726+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:43.530772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.870882+0000","last_change":"2024-09-12T12:23:03.869453+0000","last_active":"2024-09-12T12:23:03.870882+0000","last_peered":"2024-09-12T12:23:03.870882+0000","last_clean":"2024-09-12T12:23:03.870882+0000","last_became_active":"2024-09-12T12:23:03.869126+0000","last_became_peered":"2024-09-12T12:23:03.869126+0000","last_unstale":"2024-09-12T12:23:03.870882+0000","last_undegraded":"2024-09-12T12:23:03.870882+0000","last_fullsized":"2024-09-12T12:23:03.870882+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:08.169856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.878725+0000","last_change":"2024-09-12T12:23:02.843624+0000","last_active":"2024-09-12T12:23:03.878725+0000","last_peered":"2024-09-12T12:23:03.878725+0000","last_clean":"2024-09-12T12:23:03.878725+0000","last_became_active":"2024-09-12T12:23:02.843345+0000","last_became_peered":"2024-09-12T12:23:02.843345+0000","last_unstale":"2024-09-12T12:23:03.878725+0000","last_undegraded":"2024-09-12T12:23:03.878725+0000","last_fullsized":"2024-09-12T12:23:03.878725+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:19.391489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864064+0000","last_change":"2024-09-12T12:23:03.855214+0000","last_active":"2024-09-12T12:23:03.864064+0000","last_peered":"2024-09-12T12:23:03.864064+0000","last_clean":"2024-09-12T12:23:03.864064+0000","last_became_active":"2024-09-12T12:23:03.854932+0000","last_became_peered":"2024-09-12T12:23:03.854932+0000","last_unstale":"2024-09-12T12:23:03.864064+0000","last_undegraded":"2024-09-12T12:23:03.864064+0000","last_fullsized":"2024-09-12T12:23:03.864064+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:14.204718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.879932+0000","last_change":"2024-09-12T12:23:02.847263+0000","last_active":"2024-09-12T12:23:03.879932+0000","last_peered":"2024-09-12T12:23:03.879932+0000","last_clean":"2024-09-12T12:23:03.879932+0000","last_became_active":"2024-09-12T12:23:02.846986+0000","last_became_peered":"2024-09-12T12:23:02.846986+0000","last_unstale":"2024-09-12T12:23:03.879932+0000","last_undegraded":"2024-09-12T12:23:03.879932+0000","last_fullsized":"2024-09-12T12:23:03.879932+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:43.530772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.874276+0000","last_change":"2024-09-12T12:23:03.865529+0000","last_active":"2024-09-12T12:23:03.874276+0000","last_peered":"2024-09-12T12:23:03.874276+0000","last_clean":"2024-09-12T12:23:03.874276+0000","last_became_active":"2024-09-12T12:23:03.865218+0000","last_became_peered":"2024-09-12T12:23:03.865218+0000","last_unstale":"2024-09-12T12:23:03.874276+0000","last_undegraded":"2024-09-12T12:23:03.874276+0000","last_fullsized":"2024-09-12T12:23:03.874276+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:45.325835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.877872+0000","last_change":"2024-09-12T12:23:02.846559+0000","last_active":"2024-09-12T12:23:03.877872+0000","last_peered":"2024-09-12T12:23:03.877872+0000","last_clean":"2024-09-12T12:23:03.877872+0000","last_became_active":"2024-09-12T12:23:02.846282+0000","last_became_peered":"2024-09-12T12:23:02.846282+0000","last_unstale":"2024-09-12T12:23:03.877872+0000","last_undegraded":"2024-09-12T12:23:03.877872+0000","last_fullsized":"2024-09-12T12:23:03.877872+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:38.951326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864787+0000","last_change":"2024-09-12T12:23:03.855562+0000","last_active":"2024-09-12T12:23:03.864787+0000","last_peered":"2024-09-12T12:23:03.864787+0000","last_clean":"2024-09-12T12:23:03.864787+0000","last_became_active":"2024-09-12T12:23:03.855207+0000","last_became_peered":"2024-09-12T12:23:03.855207+0000","last_unstale":"2024-09-12T12:23:03.864787+0000","last_undegraded":"2024-09-12T12:23:03.864787+0000","last_fullsized":"2024-09-12T12:23:03.864787+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:32:17.849711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.850296+0000","last_change":"2024-09-12T12:23:02.845165+0000","last_active":"2024-09-12T12:23:03.850296+0000","last_peered":"2024-09-12T12:23:03.850296+0000","last_clean":"2024-09-12T12:23:03.850296+0000","last_became_active":"2024-09-12T12:23:02.844891+0000","last_became_peered":"2024-09-12T12:23:02.844891+0000","last_unstale":"2024-09-12T12:23:03.850296+0000","last_undegraded":"2024-09-12T12:23:03.850296+0000","last_fullsized":"2024-09-12T12:23:03.850296+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:49.405439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859838+0000","last_change":"2024-09-12T12:23:03.855827+0000","last_active":"2024-09-12T12:23:03.859838+0000","last_peered":"2024-09-12T12:23:03.859838+0000","last_clean":"2024-09-12T12:23:03.859838+0000","last_became_active":"2024-09-12T12:23:03.853963+0000","last_became_peered":"2024-09-12T12:23:03.853963+0000","last_unstale":"2024-09-12T12:23:03.859838+0000","last_undegraded":"2024-09-12T12:23:03.859838+0000","last_fullsized":"2024-09-12T12:23:03.859838+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:45.089276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.846650+0000","last_change":"2024-09-12T12:23:02.844090+0000","last_active":"2024-09-12T12:23:03.846650+0000","last_peered":"2024-09-12T12:23:03.846650+0000","last_clean":"2024-09-12T12:23:03.846650+0000","last_became_active":"2024-09-12T12:23:02.843835+0000","last_became_peered":"2024-09-12T12:23:02.843835+0000","last_unstale":"2024-09-12T12:23:03.846650+0000","last_undegraded":"2024-09-12T12:23:03.846650+0000","last_fullsized":"2024-09-12T12:23:03.846650+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:14.268669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.872938+0000","last_change":"2024-09-12T12:23:03.870246+0000","last_active":"2024-09-12T12:23:03.872938+0000","last_peered":"2024-09-12T12:23:03.872938+0000","last_clean":"2024-09-12T12:23:03.872938+0000","last_became_active":"2024-09-12T12:23:03.870048+0000","last_became_peered":"2024-09-12T12:23:03.870048+0000","last_unstale":"2024-09-12T12:23:03.872938+0000","last_undegraded":"2024-09-12T12:23:03.872938+0000","last_fullsized":"2024-09-12T12:23:03.872938+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:44.451452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.845400+0000","last_change":"2024-09-12T12:23:02.847290+0000","last_active":"2024-09-12T12:23:03.845400+0000","last_peered":"2024-09-12T12:23:03.845400+0000","last_clean":"2024-09-12T12:23:03.845400+0000","last_became_active":"2024-09-12T12:23:02.846571+0000","last_became_peered":"2024-09-12T12:23:02.846571+0000","last_unstale":"2024-09-12T12:23:03.845400+0000","last_undegraded":"2024-09-12T12:23:03.845400+0000","last_fullsized":"2024-09-12T12:23:03.845400+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:58.091769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.865841+0000","last_change":"2024-09-12T12:23:03.856569+0000","last_active":"2024-09-12T12:23:03.865841+0000","last_peered":"2024-09-12T12:23:03.865841+0000","last_clean":"2024-09-12T12:23:03.865841+0000","last_became_active":"2024-09-12T12:23:03.855839+0000","last_became_peered":"2024-09-12T12:23:03.855839+0000","last_unstale":"2024-09-12T12:23:03.865841+0000","last_undegraded":"2024-09-12T12:23:03.865841+0000","last_fullsized":"2024-09-12T12:23:03.865841+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:29.807733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"164'3","reported_seq":15,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.875518+0000","last_change":"2024-09-12T12:23:02.832161+0000","last_active":"2024-09-12T12:23:03.875518+0000","last_peered":"2024-09-12T12:23:03.875518+0000","last_clean":"2024-09-12T12:23:03.875518+0000","last_became_active":"2024-09-12T12:23:02.831531+0000","last_became_peered":"2024-09-12T12:23:02.831531+0000","last_unstale":"2024-09-12T12:23:03.875518+0000","last_undegraded":"2024-09-12T12:23:03.875518+0000","last_fullsized":"2024-09-12T12:23:03.875518+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:53.959165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.865029+0000","last_change":"2024-09-12T12:23:03.859014+0000","last_active":"2024-09-12T12:23:03.865029+0000","last_peered":"2024-09-12T12:23:03.865029+0000","last_clean":"2024-09-12T12:23:03.865029+0000","last_became_active":"2024-09-12T12:23:03.858742+0000","last_became_peered":"2024-09-12T12:23:03.858742+0000","last_unstale":"2024-09-12T12:23:03.865029+0000","last_undegraded":"2024-09-12T12:23:03.865029+0000","last_fullsized":"2024-09-12T12:23:03.865029+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:23.333417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"164'6","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.882099+0000","last_change":"2024-09-12T12:23:02.848115+0000","last_active":"2024-09-12T12:23:03.882099+0000","last_peered":"2024-09-12T12:23:03.882099+0000","last_clean":"2024-09-12T12:23:03.882099+0000","last_became_active":"2024-09-12T12:23:02.846405+0000","last_became_peered":"2024-09-12T12:23:02.846405+0000","last_unstale":"2024-09-12T12:23:03.882099+0000","last_undegraded":"2024-09-12T12:23:03.882099+0000","last_fullsized":"2024-09-12T12:23:03.882099+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:46.562512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.861327+0000","last_change":"2024-09-12T12:23:03.859301+0000","last_active":"2024-09-12T12:23:03.861327+0000","last_peered":"2024-09-12T12:23:03.861327+0000","last_clean":"2024-09-12T12:23:03.861327+0000","last_became_active":"2024-09-12T12:23:03.858985+0000","last_became_peered":"2024-09-12T12:23:03.858985+0000","last_unstale":"2024-09-12T12:23:03.861327+0000","last_undegraded":"2024-09-12T12:23:03.861327+0000","last_fullsized":"2024-09-12T12:23:03.861327+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:30.320376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.878107+0000","last_change":"2024-09-12T12:23:02.840312+0000","last_active":"2024-09-12T12:23:03.878107+0000","last_peered":"2024-09-12T12:23:03.878107+0000","last_clean":"2024-09-12T12:23:03.878107+0000","last_became_active":"2024-09-12T12:23:02.840040+0000","last_became_peered":"2024-09-12T12:23:02.840040+0000","last_unstale":"2024-09-12T12:23:03.878107+0000","last_undegraded":"2024-09-12T12:23:03.878107+0000","last_fullsized":"2024-09-12T12:23:03.878107+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:21.562546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854162+0000","last_change":"2024-09-12T12:23:03.849726+0000","last_active":"2024-09-12T12:23:03.854162+0000","last_peered":"2024-09-12T12:23:03.854162+0000","last_clean":"2024-09-12T12:23:03.854162+0000","last_became_active":"2024-09-12T12:23:03.848049+0000","last_became_peered":"2024-09-12T12:23:03.848049+0000","last_unstale":"2024-09-12T12:23:03.854162+0000","last_undegraded":"2024-09-12T12:23:03.854162+0000","last_fullsized":"2024-09-12T12:23:03.854162+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:34.709931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.845856+0000","last_change":"2024-09-12T12:23:02.845758+0000","last_active":"2024-09-12T12:23:03.845856+0000","last_peered":"2024-09-12T12:23:03.845856+0000","last_clean":"2024-09-12T12:23:03.845856+0000","last_became_active":"2024-09-12T12:23:02.844686+0000","last_became_peered":"2024-09-12T12:23:02.844686+0000","last_unstale":"2024-09-12T12:23:03.845856+0000","last_undegraded":"2024-09-12T12:23:03.845856+0000","last_fullsized":"2024-09-12T12:23:03.845856+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:05.574020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859328+0000","last_change":"2024-09-12T12:23:03.857248+0000","last_active":"2024-09-12T12:23:03.859328+0000","last_peered":"2024-09-12T12:23:03.859328+0000","last_clean":"2024-09-12T12:23:03.859328+0000","last_became_active":"2024-09-12T12:23:03.856968+0000","last_became_peered":"2024-09-12T12:23:03.856968+0000","last_unstale":"2024-09-12T12:23:03.859328+0000","last_undegraded":"2024-09-12T12:23:03.859328+0000","last_fullsized":"2024-09-12T12:23:03.859328+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:06.095725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.850800+0000","last_change":"2024-09-12T12:23:02.839753+0000","last_active":"2024-09-12T12:23:03.850800+0000","last_peered":"2024-09-12T12:23:03.850800+0000","last_clean":"2024-09-12T12:23:03.850800+0000","last_became_active":"2024-09-12T12:23:02.838673+0000","last_became_peered":"2024-09-12T12:23:02.838673+0000","last_unstale":"2024-09-12T12:23:03.850800+0000","last_undegraded":"2024-09-12T12:23:03.850800+0000","last_fullsized":"2024-09-12T12:23:03.850800+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:29.313797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862300+0000","last_change":"2024-09-12T12:23:03.854358+0000","last_active":"2024-09-12T12:23:03.862300+0000","last_peered":"2024-09-12T12:23:03.862300+0000","last_clean":"2024-09-12T12:23:03.862300+0000","last_became_active":"2024-09-12T12:23:03.853648+0000","last_became_peered":"2024-09-12T12:23:03.853648+0000","last_unstale":"2024-09-12T12:23:03.862300+0000","last_undegraded":"2024-09-12T12:23:03.862300+0000","last_fullsized":"2024-09-12T12:23:03.862300+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:02:47.390812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"164'8","reported_seq":20,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.880600+0000","last_change":"2024-09-12T12:23:02.834110+0000","last_active":"2024-09-12T12:23:03.880600+0000","last_peered":"2024-09-12T12:23:03.880600+0000","last_clean":"2024-09-12T12:23:03.880600+0000","last_became_active":"2024-09-12T12:23:02.833802+0000","last_became_peered":"2024-09-12T12:23:02.833802+0000","last_unstale":"2024-09-12T12:23:03.880600+0000","last_undegraded":"2024-09-12T12:23:03.880600+0000","last_fullsized":"2024-09-12T12:23:03.880600+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:16.575909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.865855+0000","last_change":"2024-09-12T12:23:03.863007+0000","last_active":"2024-09-12T12:23:03.865855+0000","last_peered":"2024-09-12T12:23:03.865855+0000","last_clean":"2024-09-12T12:23:03.865855+0000","last_became_active":"2024-09-12T12:23:03.862732+0000","last_became_peered":"2024-09-12T12:23:03.862732+0000","last_unstale":"2024-09-12T12:23:03.865855+0000","last_undegraded":"2024-09-12T12:23:03.865855+0000","last_fullsized":"2024-09-12T12:23:03.865855+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:44.451452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.876475+0000","last_change":"2024-09-12T12:23:02.840131+0000","last_active":"2024-09-12T12:23:03.876475+0000","last_peered":"2024-09-12T12:23:03.876475+0000","last_clean":"2024-09-12T12:23:03.876475+0000","last_became_active":"2024-09-12T12:23:02.839886+0000","last_became_peered":"2024-09-12T12:23:02.839886+0000","last_unstale":"2024-09-12T12:23:03.876475+0000","last_undegraded":"2024-09-12T12:23:03.876475+0000","last_fullsized":"2024-09-12T12:23:03.876475+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:10:25.340348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.861293+0000","last_change":"2024-09-12T12:23:03.859564+0000","last_active":"2024-09-12T12:23:03.861293+0000","last_peered":"2024-09-12T12:23:03.861293+0000","last_clean":"2024-09-12T12:23:03.861293+0000","last_became_active":"2024-09-12T12:23:03.859302+0000","last_became_peered":"2024-09-12T12:23:03.859302+0000","last_unstale":"2024-09-12T12:23:03.861293+0000","last_undegraded":"2024-09-12T12:23:03.861293+0000","last_fullsized":"2024-09-12T12:23:03.861293+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:44.537351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.879873+0000","last_change":"2024-09-12T12:23:02.848096+0000","last_active":"2024-09-12T12:23:03.879873+0000","last_peered":"2024-09-12T12:23:03.879873+0000","last_clean":"2024-09-12T12:23:03.879873+0000","last_became_active":"2024-09-12T12:23:02.846791+0000","last_became_peered":"2024-09-12T12:23:02.846791+0000","last_unstale":"2024-09-12T12:23:03.879873+0000","last_undegraded":"2024-09-12T12:23:03.879873+0000","last_fullsized":"2024-09-12T12:23:03.879873+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:20.872052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859015+0000","last_change":"2024-09-12T12:23:03.854917+0000","last_active":"2024-09-12T12:23:03.859015+0000","last_peered":"2024-09-12T12:23:03.859015+0000","last_clean":"2024-09-12T12:23:03.859015+0000","last_became_active":"2024-09-12T12:23:03.854598+0000","last_became_peered":"2024-09-12T12:23:03.854598+0000","last_unstale":"2024-09-12T12:23:03.859015+0000","last_undegraded":"2024-09-12T12:23:03.859015+0000","last_fullsized":"2024-09-12T12:23:03.859015+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:26.216247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"164'1","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.877905+0000","last_change":"2024-09-12T12:23:02.844472+0000","last_active":"2024-09-12T12:23:03.877905+0000","last_peered":"2024-09-12T12:23:03.877905+0000","last_clean":"2024-09-12T12:23:03.877905+0000","last_became_active":"2024-09-12T12:23:02.839568+0000","last_became_peered":"2024-09-12T12:23:02.839568+0000","last_unstale":"2024-09-12T12:23:03.877905+0000","last_undegraded":"2024-09-12T12:23:03.877905+0000","last_fullsized":"2024-09-12T12:23:03.877905+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:49.902421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.859241+0000","last_change":"2024-09-12T12:23:03.855968+0000","last_active":"2024-09-12T12:23:03.859241+0000","last_peered":"2024-09-12T12:23:03.859241+0000","last_clean":"2024-09-12T12:23:03.859241+0000","last_became_active":"2024-09-12T12:23:03.855255+0000","last_became_peered":"2024-09-12T12:23:03.855255+0000","last_unstale":"2024-09-12T12:23:03.859241+0000","last_undegraded":"2024-09-12T12:23:03.859241+0000","last_fullsized":"2024-09-12T12:23:03.859241+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.867864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844003+0000","last_change":"2024-09-12T12:23:02.842054+0000","last_active":"2024-09-12T12:23:03.844003+0000","last_peered":"2024-09-12T12:23:03.844003+0000","last_clean":"2024-09-12T12:23:03.844003+0000","last_became_active":"2024-09-12T12:23:02.841733+0000","last_became_peered":"2024-09-12T12:23:02.841733+0000","last_unstale":"2024-09-12T12:23:03.844003+0000","last_undegraded":"2024-09-12T12:23:03.844003+0000","last_fullsized":"2024-09-12T12:23:03.844003+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:25.209669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868267+0000","last_change":"2024-09-12T12:23:03.858174+0000","last_active":"2024-09-12T12:23:03.868267+0000","last_peered":"2024-09-12T12:23:03.868267+0000","last_clean":"2024-09-12T12:23:03.868267+0000","last_became_active":"2024-09-12T12:23:03.857568+0000","last_became_peered":"2024-09-12T12:23:03.857568+0000","last_unstale":"2024-09-12T12:23:03.868267+0000","last_undegraded":"2024-09-12T12:23:03.868267+0000","last_fullsized":"2024-09-12T12:23:03.868267+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:36.925387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.878230+0000","last_change":"2024-09-12T12:23:02.845128+0000","last_active":"2024-09-12T12:23:03.878230+0000","last_peered":"2024-09-12T12:23:03.878230+0000","last_clean":"2024-09-12T12:23:03.878230+0000","last_became_active":"2024-09-12T12:23:02.840640+0000","last_became_peered":"2024-09-12T12:23:02.840640+0000","last_unstale":"2024-09-12T12:23:03.878230+0000","last_undegraded":"2024-09-12T12:23:03.878230+0000","last_fullsized":"2024-09-12T12:23:03.878230+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:06.794634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864012+0000","last_change":"2024-09-12T12:23:03.852360+0000","last_active":"2024-09-12T12:23:03.864012+0000","last_peered":"2024-09-12T12:23:03.864012+0000","last_clean":"2024-09-12T12:23:03.864012+0000","last_became_active":"2024-09-12T12:23:03.851534+0000","last_became_peered":"2024-09-12T12:23:03.851534+0000","last_unstale":"2024-09-12T12:23:03.864012+0000","last_undegraded":"2024-09-12T12:23:03.864012+0000","last_fullsized":"2024-09-12T12:23:03.864012+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:11:54.464521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.850685+0000","last_change":"2024-09-12T12:23:02.845018+0000","last_active":"2024-09-12T12:23:03.850685+0000","last_peered":"2024-09-12T12:23:03.850685+0000","last_clean":"2024-09-12T12:23:03.850685+0000","last_became_active":"2024-09-12T12:23:02.844650+0000","last_became_peered":"2024-09-12T12:23:02.844650+0000","last_unstale":"2024-09-12T12:23:03.850685+0000","last_undegraded":"2024-09-12T12:23:03.850685+0000","last_fullsized":"2024-09-12T12:23:03.850685+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:29.192508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.864436+0000","last_change":"2024-09-12T12:23:03.856342+0000","last_active":"2024-09-12T12:23:03.864436+0000","last_peered":"2024-09-12T12:23:03.864436+0000","last_clean":"2024-09-12T12:23:03.864436+0000","last_became_active":"2024-09-12T12:23:03.856084+0000","last_became_peered":"2024-09-12T12:23:03.856084+0000","last_unstale":"2024-09-12T12:23:03.864436+0000","last_undegraded":"2024-09-12T12:23:03.864436+0000","last_fullsized":"2024-09-12T12:23:03.864436+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:01.411327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.850456+0000","last_change":"2024-09-12T12:23:02.839056+0000","last_active":"2024-09-12T12:23:03.850456+0000","last_peered":"2024-09-12T12:23:03.850456+0000","last_clean":"2024-09-12T12:23:03.850456+0000","last_became_active":"2024-09-12T12:23:02.838743+0000","last_became_peered":"2024-09-12T12:23:02.838743+0000","last_unstale":"2024-09-12T12:23:03.850456+0000","last_undegraded":"2024-09-12T12:23:03.850456+0000","last_fullsized":"2024-09-12T12:23:03.850456+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:44.679345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868062+0000","last_change":"2024-09-12T12:23:03.865711+0000","last_active":"2024-09-12T12:23:03.868062+0000","last_peered":"2024-09-12T12:23:03.868062+0000","last_clean":"2024-09-12T12:23:03.868062+0000","last_became_active":"2024-09-12T12:23:03.864705+0000","last_became_peered":"2024-09-12T12:23:03.864705+0000","last_unstale":"2024-09-12T12:23:03.868062+0000","last_undegraded":"2024-09-12T12:23:03.868062+0000","last_fullsized":"2024-09-12T12:23:03.868062+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:47.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854210+0000","last_change":"2024-09-12T12:23:02.842740+0000","last_active":"2024-09-12T12:23:03.854210+0000","last_peered":"2024-09-12T12:23:03.854210+0000","last_clean":"2024-09-12T12:23:03.854210+0000","last_became_active":"2024-09-12T12:23:02.841648+0000","last_became_peered":"2024-09-12T12:23:02.841648+0000","last_unstale":"2024-09-12T12:23:03.854210+0000","last_undegraded":"2024-09-12T12:23:03.854210+0000","last_fullsized":"2024-09-12T12:23:03.854210+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:14.268669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.858902+0000","last_change":"2024-09-12T12:23:03.855109+0000","last_active":"2024-09-12T12:23:03.858902+0000","last_peered":"2024-09-12T12:23:03.858902+0000","last_clean":"2024-09-12T12:23:03.858902+0000","last_became_active":"2024-09-12T12:23:03.854752+0000","last_became_peered":"2024-09-12T12:23:03.854752+0000","last_unstale":"2024-09-12T12:23:03.858902+0000","last_undegraded":"2024-09-12T12:23:03.858902+0000","last_fullsized":"2024-09-12T12:23:03.858902+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:15.275247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"164'2","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.877962+0000","last_change":"2024-09-12T12:23:02.845084+0000","last_active":"2024-09-12T12:23:03.877962+0000","last_peered":"2024-09-12T12:23:03.877962+0000","last_clean":"2024-09-12T12:23:03.877962+0000","last_became_active":"2024-09-12T12:23:02.844810+0000","last_became_peered":"2024-09-12T12:23:02.844810+0000","last_unstale":"2024-09-12T12:23:03.877962+0000","last_undegraded":"2024-09-12T12:23:03.877962+0000","last_fullsized":"2024-09-12T12:23:03.877962+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:02.353019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862068+0000","last_change":"2024-09-12T12:23:03.853845+0000","last_active":"2024-09-12T12:23:03.862068+0000","last_peered":"2024-09-12T12:23:03.862068+0000","last_clean":"2024-09-12T12:23:03.862068+0000","last_became_active":"2024-09-12T12:23:03.853532+0000","last_became_peered":"2024-09-12T12:23:03.853532+0000","last_unstale":"2024-09-12T12:23:03.862068+0000","last_undegraded":"2024-09-12T12:23:03.862068+0000","last_fullsized":"2024-09-12T12:23:03.862068+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:38.986598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844531+0000","last_change":"2024-09-12T12:23:02.849865+0000","last_active":"2024-09-12T12:23:03.844531+0000","last_peered":"2024-09-12T12:23:03.844531+0000","last_clean":"2024-09-12T12:23:03.844531+0000","last_became_active":"2024-09-12T12:23:02.849443+0000","last_became_peered":"2024-09-12T12:23:02.849443+0000","last_unstale":"2024-09-12T12:23:03.844531+0000","last_undegraded":"2024-09-12T12:23:03.844531+0000","last_fullsized":"2024-09-12T12:23:03.844531+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:52.950045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.862308+0000","last_change":"2024-09-12T12:23:03.851514+0000","last_active":"2024-09-12T12:23:03.862308+0000","last_peered":"2024-09-12T12:23:03.862308+0000","last_clean":"2024-09-12T12:23:03.862308+0000","last_became_active":"2024-09-12T12:23:03.851246+0000","last_became_peered":"2024-09-12T12:23:03.851246+0000","last_unstale":"2024-09-12T12:23:03.862308+0000","last_undegraded":"2024-09-12T12:23:03.862308+0000","last_fullsized":"2024-09-12T12:23:03.862308+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:59:48.670699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844705+0000","last_change":"2024-09-12T12:23:02.842669+0000","last_active":"2024-09-12T12:23:03.844705+0000","last_peered":"2024-09-12T12:23:03.844705+0000","last_clean":"2024-09-12T12:23:03.844705+0000","last_became_active":"2024-09-12T12:23:02.841948+0000","last_became_peered":"2024-09-12T12:23:02.841948+0000","last_unstale":"2024-09-12T12:23:03.844705+0000","last_undegraded":"2024-09-12T12:23:03.844705+0000","last_fullsized":"2024-09-12T12:23:03.844705+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:41.443690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.858727+0000","last_change":"2024-09-12T12:23:03.853042+0000","last_active":"2024-09-12T12:23:03.858727+0000","last_peered":"2024-09-12T12:23:03.858727+0000","last_clean":"2024-09-12T12:23:03.858727+0000","last_became_active":"2024-09-12T12:23:03.852698+0000","last_became_peered":"2024-09-12T12:23:03.852698+0000","last_unstale":"2024-09-12T12:23:03.858727+0000","last_undegraded":"2024-09-12T12:23:03.858727+0000","last_fullsized":"2024-09-12T12:23:03.858727+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:47.802900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.853164+0000","last_change":"2024-09-12T12:23:02.833930+0000","last_active":"2024-09-12T12:23:03.853164+0000","last_peered":"2024-09-12T12:23:03.853164+0000","last_clean":"2024-09-12T12:23:03.853164+0000","last_became_active":"2024-09-12T12:23:02.833661+0000","last_became_peered":"2024-09-12T12:23:02.833661+0000","last_unstale":"2024-09-12T12:23:03.853164+0000","last_undegraded":"2024-09-12T12:23:03.853164+0000","last_fullsized":"2024-09-12T12:23:03.853164+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:56.481666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854372+0000","last_change":"2024-09-12T12:23:03.852699+0000","last_active":"2024-09-12T12:23:03.854372+0000","last_peered":"2024-09-12T12:23:03.854372+0000","last_clean":"2024-09-12T12:23:03.854372+0000","last_became_active":"2024-09-12T12:23:03.852425+0000","last_became_peered":"2024-09-12T12:23:03.852425+0000","last_unstale":"2024-09-12T12:23:03.854372+0000","last_undegraded":"2024-09-12T12:23:03.854372+0000","last_fullsized":"2024-09-12T12:23:03.854372+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:25.677092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844201+0000","last_change":"2024-09-12T12:23:02.842997+0000","last_active":"2024-09-12T12:23:03.844201+0000","last_peered":"2024-09-12T12:23:03.844201+0000","last_clean":"2024-09-12T12:23:03.844201+0000","last_became_active":"2024-09-12T12:23:02.842693+0000","last_became_peered":"2024-09-12T12:23:02.842693+0000","last_unstale":"2024-09-12T12:23:03.844201+0000","last_undegraded":"2024-09-12T12:23:03.844201+0000","last_fullsized":"2024-09-12T12:23:03.844201+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:41:04.148503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.869382+0000","last_change":"2024-09-12T12:23:03.868018+0000","last_active":"2024-09-12T12:23:03.869382+0000","last_peered":"2024-09-12T12:23:03.869382+0000","last_clean":"2024-09-12T12:23:03.869382+0000","last_became_active":"2024-09-12T12:23:03.867711+0000","last_became_peered":"2024-09-12T12:23:03.867711+0000","last_unstale":"2024-09-12T12:23:03.869382+0000","last_undegraded":"2024-09-12T12:23:03.869382+0000","last_fullsized":"2024-09-12T12:23:03.869382+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:26.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.845825+0000","last_change":"2024-09-12T12:23:02.847715+0000","last_active":"2024-09-12T12:23:03.845825+0000","last_peered":"2024-09-12T12:23:03.845825+0000","last_clean":"2024-09-12T12:23:03.845825+0000","last_became_active":"2024-09-12T12:23:02.847365+0000","last_became_peered":"2024-09-12T12:23:02.847365+0000","last_unstale":"2024-09-12T12:23:03.845825+0000","last_undegraded":"2024-09-12T12:23:03.845825+0000","last_fullsized":"2024-09-12T12:23:03.845825+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:20.350599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.868164+0000","last_change":"2024-09-12T12:23:03.859469+0000","last_active":"2024-09-12T12:23:03.868164+0000","last_peered":"2024-09-12T12:23:03.868164+0000","last_clean":"2024-09-12T12:23:03.868164+0000","last_became_active":"2024-09-12T12:23:03.859202+0000","last_became_peered":"2024-09-12T12:23:03.859202+0000","last_unstale":"2024-09-12T12:23:03.868164+0000","last_undegraded":"2024-09-12T12:23:03.868164+0000","last_fullsized":"2024-09-12T12:23:03.868164+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:20.533011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.849758+0000","last_change":"2024-09-12T12:23:02.835196+0000","last_active":"2024-09-12T12:23:03.849758+0000","last_peered":"2024-09-12T12:23:03.849758+0000","last_clean":"2024-09-12T12:23:03.849758+0000","last_became_active":"2024-09-12T12:23:02.834556+0000","last_became_peered":"2024-09-12T12:23:02.834556+0000","last_unstale":"2024-09-12T12:23:03.849758+0000","last_undegraded":"2024-09-12T12:23:03.849758+0000","last_fullsized":"2024-09-12T12:23:03.849758+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:55.726167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.874458+0000","last_change":"2024-09-12T12:23:03.870673+0000","last_active":"2024-09-12T12:23:03.874458+0000","last_peered":"2024-09-12T12:23:03.874458+0000","last_clean":"2024-09-12T12:23:03.874458+0000","last_became_active":"2024-09-12T12:23:03.870365+0000","last_became_peered":"2024-09-12T12:23:03.870365+0000","last_unstale":"2024-09-12T12:23:03.874458+0000","last_undegraded":"2024-09-12T12:23:03.874458+0000","last_fullsized":"2024-09-12T12:23:03.874458+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:11.099172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.838397+0000","last_change":"2024-09-12T12:23:02.840986+0000","last_active":"2024-09-12T12:23:03.838397+0000","last_peered":"2024-09-12T12:23:03.838397+0000","last_clean":"2024-09-12T12:23:03.838397+0000","last_became_active":"2024-09-12T12:23:02.840723+0000","last_became_peered":"2024-09-12T12:23:02.840723+0000","last_unstale":"2024-09-12T12:23:03.838397+0000","last_undegraded":"2024-09-12T12:23:03.838397+0000","last_fullsized":"2024-09-12T12:23:03.838397+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:25.071858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.867268+0000","last_change":"2024-09-12T12:23:03.865475+0000","last_active":"2024-09-12T12:23:03.867268+0000","last_peered":"2024-09-12T12:23:03.867268+0000","last_clean":"2024-09-12T12:23:03.867268+0000","last_became_active":"2024-09-12T12:23:03.863919+0000","last_became_peered":"2024-09-12T12:23:03.863919+0000","last_unstale":"2024-09-12T12:23:03.867268+0000","last_undegraded":"2024-09-12T12:23:03.867268+0000","last_fullsized":"2024-09-12T12:23:03.867268+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:02.814555+0000","last_clean_scrub_stamp":"2024-09-12T12:23:02.814555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:34.709931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.844377+0000","last_change":"2024-09-12T12:23:02.848571+0000","last_active":"2024-09-12T12:23:03.844377+0000","last_peered":"2024-09-12T12:23:03.844377+0000","last_clean":"2024-09-12T12:23:03.844377+0000","last_became_active":"2024-09-12T12:23:02.848309+0000","last_became_peered":"2024-09-12T12:23:02.848309+0000","last_unstale":"2024-09-12T12:23:03.844377+0000","last_undegraded":"2024-09-12T12:23:03.844377+0000","last_fullsized":"2024-09-12T12:23:03.844377+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:23:01.807976+0000","last_clean_scrub_stamp":"2024-09-12T12:23:01.807976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:04.925614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":433,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-12T12:23:03.854265+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:23:03.854265+0000","last_peered":"2024-09-12T12:23:03.854265+0000","last_clean":"2024-09-12T12:23:03.854265+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:23:03.854265+0000","last_undegraded":"2024-09-12T12:23:03.854265+0000","last_fullsized":"2024-09-12T12:23:03.854265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47672,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324168,"statfs":{"total":96636764160,"available":96587948032,"internally_reserved":0,"allocated":2654208,"data_stored":1562281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51252,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320588,"statfs":{"total":96636764160,"available":96584282112,"internally_reserved":0,"allocated":2060288,"data_stored":971913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51260,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320580,"statfs":{"total":96636764160,"available":96584273920,"internally_reserved":0,"allocated":2068480,"data_stored":972037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55432,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316408,"statfs":{"total":96636764160,"available":96580001792,"internally_reserved":0,"allocated":2076672,"data_stored":972677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574979,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55436,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316404,"statfs":{"total":96636764160,"available":96579997696,"internally_reserved":0,"allocated":2080768,"data_stored":974129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54655432},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55400,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316440,"statfs":{"total":96636764160,"available":96580034560,"internally_reserved":0,"allocated":2048000,"data_stored":964746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55428,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316412,"statfs":{"total":96636764160,"available":96580005888,"internally_reserved":0,"allocated":2072576,"data_stored":973525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51840,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320000,"statfs":{"total":96636764160,"available":96583680000,"internally_reserved":0,"allocated":2662400,"data_stored":1562385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:23:08.319 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:23:08.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:23:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.501+0000 7faaef600640 1 Processor -- start 2024-09-12T12:23:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.501+0000 7faaef600640 1 -- start start 2024-09-12T12:23:08.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaef600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae815af60 0x7faae80ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaef600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faae806c320 0x7faae80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaef600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae80b4300 con 0x7faae80cd9f0 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaef600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faae80b32f0 con 0x7faae806c320 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaef600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faae80b3540 con 0x7faae815af60 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaed600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faae806c320 0x7faae80b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaed600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faae806c320 0x7faae80b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45810/0 (socket says 172.21.15.144:45810) 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faae7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faae80cd9f0 0x7faae806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34592/0 (socket says 172.21.15.144:34592) 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaed600640 1 -- 172.21.15.144:0/3647251289 learned_addr learned my addr 172.21.15.144:0/3647251289 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaecc00640 1 --2- 172.21.15.144:0/3647251289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae815af60 0x7faae80ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaed600640 1 -- 172.21.15.144:0/3647251289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae815af60 msgr2=0x7faae80ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaed600640 1 --2- 172.21.15.144:0/3647251289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae815af60 0x7faae80ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaed600640 1 -- 172.21.15.144:0/3647251289 >> v1:172.21.15.144:6789/0 conn(0x7faae80cd9f0 legacy=0x7faae806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaed600640 1 -- 172.21.15.144:0/3647251289 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae80b3820 con 0x7faae806c320 2024-09-12T12:23:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.505+0000 7faaecc00640 1 --2- 172.21.15.144:0/3647251289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae815af60 0x7faae80ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaed600640 1 --2- 172.21.15.144:0/3647251289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 0x7faae80b4560 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7faae0009e50 tx=0x7faae001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dc81b5f61f5c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faae7400640 1 -- 172.21.15.144:0/3647251289 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae00b4070 con 0x7faae806c320 2024-09-12T12:23:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faae7400640 1 -- 172.21.15.144:0/3647251289 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae00af400 con 0x7faae806c320 2024-09-12T12:23:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faae7400640 1 -- 172.21.15.144:0/3647251289 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae00af7d0 con 0x7faae806c320 2024-09-12T12:23:08.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 -- 172.21.15.144:0/3647251289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 msgr2=0x7faae80b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 --2- 172.21.15.144:0/3647251289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 0x7faae80b4560 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7faae0009e50 tx=0x7faae001f210 comp rx=0 tx=0).stop 2024-09-12T12:23:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 -- 172.21.15.144:0/3647251289 shutdown_connections 2024-09-12T12:23:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 --2- 172.21.15.144:0/3647251289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 0x7faae80b4560 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 --2- 172.21.15.144:0/3647251289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae815af60 0x7faae80ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 -- 172.21.15.144:0/3647251289 >> 172.21.15.144:0/3647251289 conn(0x7faae8068030 msgr2=0x7faae80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 -- 172.21.15.144:0/3647251289 shutdown_connections 2024-09-12T12:23:08.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 -- 172.21.15.144:0/3647251289 wait complete. 2024-09-12T12:23:08.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 Processor -- start 2024-09-12T12:23:08.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 -- start start 2024-09-12T12:23:08.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 0x7faae814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae80cd9f0 0x7faae81f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae815af60 0x7faae8152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faae80cebc0 con 0x7faae806c320 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faae80b3de0 con 0x7faae815af60 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.509+0000 7faaef600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faae80ced40 con 0x7faae80cd9f0 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaecc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 0x7faae814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaecc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 0x7faae814eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45824/0 (socket says 172.21.15.144:45824) 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaecc00640 1 -- 172.21.15.144:0/1707339762 learned_addr learned my addr 172.21.15.144:0/1707339762 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaed600640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae815af60 0x7faae8152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faae7e00640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae80cd9f0 0x7faae81f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaecc00640 1 -- 172.21.15.144:0/1707339762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae80cd9f0 msgr2=0x7faae81f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaecc00640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae80cd9f0 0x7faae81f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaecc00640 1 -- 172.21.15.144:0/1707339762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae815af60 msgr2=0x7faae8152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaecc00640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae815af60 0x7faae8152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaecc00640 1 -- 172.21.15.144:0/1707339762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae81f5310 con 0x7faae806c320 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaed600640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae815af60 0x7faae8152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaecc00640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 0x7faae814eaf0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7faad800c820 tx=0x7faad800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faae4c00640 1 -- 172.21.15.144:0/1707339762 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8015070 con 0x7faae806c320 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faae4c00640 1 -- 172.21.15.144:0/1707339762 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad8007a30 con 0x7faae806c320 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faae4c00640 1 -- 172.21.15.144:0/1707339762 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8007e40 con 0x7faae806c320 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae814fcf0 con 0x7faae806c320 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae814e2f0 con 0x7faae806c320 2024-09-12T12:23:08.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae80afc20 con 0x7faae806c320 2024-09-12T12:23:08.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faae4c00640 1 -- 172.21.15.144:0/1707339762 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faad8018070 con 0x7faae806c320 2024-09-12T12:23:08.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.513+0000 7faae4c00640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faac80678f0 0x7faac8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.517+0000 7faae4c00640 1 -- 172.21.15.144:0/1707339762 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7faad8085d50 con 0x7faae806c320 2024-09-12T12:23:08.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.517+0000 7faae7e00640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faac80678f0 0x7faac8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.517+0000 7faae7e00640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faac80678f0 0x7faac8069db0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7faae815e780 tx=0x7faad4007cd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.517+0000 7faae4c00640 1 -- 172.21.15.144:0/1707339762 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faad8056660 con 0x7faae806c320 2024-09-12T12:23:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.737+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7faae80b4b80 con 0x7faae806c320 2024-09-12T12:23:08.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.737+0000 7faae4c00640 1 -- 172.21.15.144:0/1707339762 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7faad8055f60 con 0x7faae806c320 2024-09-12T12:23:08.737 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:23:08.737 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:23:08.737 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:23:08.737 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:23:08.737 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:23:08.738 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:23:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faac80678f0 msgr2=0x7faac8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faac80678f0 0x7faac8069db0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7faae815e780 tx=0x7faad4007cd0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 msgr2=0x7faae814eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 0x7faae814eaf0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7faad800c820 tx=0x7faad800cce0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 shutdown_connections 2024-09-12T12:23:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faac80678f0 0x7faac8069db0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae815af60 0x7faae8152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae80cd9f0 0x7faae81f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 --2- 172.21.15.144:0/1707339762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae806c320 0x7faae814eaf0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 >> 172.21.15.144:0/1707339762 conn(0x7faae8068030 msgr2=0x7faae80ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 shutdown_connections 2024-09-12T12:23:08.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.741+0000 7faaef600640 1 -- 172.21.15.144:0/1707339762 wait complete. 2024-09-12T12:23:08.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:08.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92da800640 1 Processor -- start 2024-09-12T12:23:08.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92da800640 1 -- start start 2024-09-12T12:23:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92da800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 0x7f92d40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92da800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f92d415cd30 0x7f92d40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92da800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d40cd870 con 0x7f92d40b5de0 2024-09-12T12:23:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92da800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f92d4072a50 con 0x7f92d415cd30 2024-09-12T12:23:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92da800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f92d40cde30 con 0x7f92d415c7b0 2024-09-12T12:23:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92caa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f92d415cd30 0x7f92d40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92caa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f92d415cd30 0x7f92d40b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45832/0 (socket says 172.21.15.144:45832) 2024-09-12T12:23:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92caa00640 1 -- 172.21.15.144:0/2296270628 learned_addr learned my addr 172.21.15.144:0/2296270628 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92d3400640 1 --2- 172.21.15.144:0/2296270628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 0x7f92d40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92caa00640 1 -- 172.21.15.144:0/2296270628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 msgr2=0x7f92d40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:08.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92caa00640 1 --2- 172.21.15.144:0/2296270628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 0x7f92d40ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92caa00640 1 -- 172.21.15.144:0/2296270628 >> v1:172.21.15.165:6789/0 conn(0x7f92d40b5de0 legacy=0x7f92d41601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.897+0000 7f92caa00640 1 -- 172.21.15.144:0/2296270628 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d40cdb50 con 0x7f92d415cd30 2024-09-12T12:23:08.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92caa00640 1 --2- 172.21.15.144:0/2296270628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 0x7f92d40b58a0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009870 tx=0x7f92bc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a4e37aac137480 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92d2a00640 1 -- 172.21.15.144:0/2296270628 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0b2070 con 0x7f92d415cd30 2024-09-12T12:23:08.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92d2a00640 1 -- 172.21.15.144:0/2296270628 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92bc0a9070 con 0x7f92d415cd30 2024-09-12T12:23:08.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92d2a00640 1 -- 172.21.15.144:0/2296270628 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0ad880 con 0x7f92d415cd30 2024-09-12T12:23:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92da800640 1 -- 172.21.15.144:0/2296270628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 msgr2=0x7f92d40b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92da800640 1 --2- 172.21.15.144:0/2296270628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 0x7f92d40b58a0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009870 tx=0x7f92bc01c560 comp rx=0 tx=0).stop 2024-09-12T12:23:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92da800640 1 -- 172.21.15.144:0/2296270628 shutdown_connections 2024-09-12T12:23:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92da800640 1 --2- 172.21.15.144:0/2296270628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 0x7f92d40b58a0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92da800640 1 --2- 172.21.15.144:0/2296270628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 0x7f92d40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92da800640 1 -- 172.21.15.144:0/2296270628 >> 172.21.15.144:0/2296270628 conn(0x7f92d406d0d0 msgr2=0x7f92d406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92da800640 1 -- 172.21.15.144:0/2296270628 shutdown_connections 2024-09-12T12:23:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.901+0000 7f92da800640 1 -- 172.21.15.144:0/2296270628 wait complete. 2024-09-12T12:23:08.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 Processor -- start 2024-09-12T12:23:08.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 -- start start 2024-09-12T12:23:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92d40b5de0 0x7f92d40b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 0x7f92d4165950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 0x7f92d4145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f92d4169530 con 0x7f92d415cd30 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92d40cd650 con 0x7f92d40b5de0 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f92d41696b0 con 0x7f92d415c7b0 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 0x7f92d4145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92caa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 0x7f92d4165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 0x7f92d4145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45844/0 (socket says 172.21.15.144:45844) 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3e00640 1 -- 172.21.15.144:0/345483023 learned_addr learned my addr 172.21.15.144:0/345483023 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3400640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92d40b5de0 0x7f92d40b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3e00640 1 -- 172.21.15.144:0/345483023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 msgr2=0x7f92d4165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3e00640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 0x7f92d4165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3e00640 1 -- 172.21.15.144:0/345483023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92d40b5de0 msgr2=0x7f92d40b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3e00640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92d40b5de0 0x7f92d40b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3e00640 1 -- 172.21.15.144:0/345483023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d40b56a0 con 0x7f92d415cd30 2024-09-12T12:23:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92d3e00640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 0x7f92d4145c70 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c770 tx=0x7f92cc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92cbe00640 1 -- 172.21.15.144:0/345483023 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc003b80 con 0x7f92d415cd30 2024-09-12T12:23:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92cbe00640 1 -- 172.21.15.144:0/345483023 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92cc003d20 con 0x7f92d415cd30 2024-09-12T12:23:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92cbe00640 1 -- 172.21.15.144:0/345483023 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92cc00aa90 con 0x7f92d415cd30 2024-09-12T12:23:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d40b4600 con 0x7f92d415cd30 2024-09-12T12:23:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.905+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d40b4ea0 con 0x7f92d415cd30 2024-09-12T12:23:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.909+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d40ccf00 con 0x7f92d415cd30 2024-09-12T12:23:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.909+0000 7f92cbe00640 1 -- 172.21.15.144:0/345483023 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92cc00ac30 con 0x7f92d415cd30 2024-09-12T12:23:08.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.909+0000 7f92cbe00640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92b00678c0 0x7f92b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:08.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.909+0000 7f92cbe00640 1 -- 172.21.15.144:0/345483023 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f92cc085c10 con 0x7f92d415cd30 2024-09-12T12:23:08.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.909+0000 7f92d3400640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92b00678c0 0x7f92b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:08.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.909+0000 7f92d3400640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92b00678c0 0x7f92b0069d80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f92d41faf00 tx=0x7f92c4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:08.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:08.913+0000 7f92cbe00640 1 -- 172.21.15.144:0/345483023 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f92cc055f60 con 0x7f92d415cd30 2024-09-12T12:23:09.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92d415f9e0 con 0x7f92d415cd30 2024-09-12T12:23:09.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92cbe00640 1 -- 172.21.15.144:0/345483023 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7f92cc05a260 con 0x7f92d415cd30 2024-09-12T12:23:09.104 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:09.104 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:09.104 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:09.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92b00678c0 msgr2=0x7f92b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92b00678c0 0x7f92b0069d80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f92d41faf00 tx=0x7f92c4009190 comp rx=0 tx=0).stop 2024-09-12T12:23:09.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 msgr2=0x7f92d4145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 0x7f92d4145c70 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f92cc00c770 tx=0x7f92cc00cc30 comp rx=0 tx=0).stop 2024-09-12T12:23:09.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 shutdown_connections 2024-09-12T12:23:09.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92b00678c0 0x7f92b0069d80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d415cd30 0x7f92d4145c70 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92d415c7b0 0x7f92d4165950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 --2- 172.21.15.144:0/345483023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92d40b5de0 0x7f92d40b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 >> 172.21.15.144:0/345483023 conn(0x7f92d406d0d0 msgr2=0x7f92d40cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 shutdown_connections 2024-09-12T12:23:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.105+0000 7f92da800640 1 -- 172.21.15.144:0/345483023 wait complete. 2024-09-12T12:23:09.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 123, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:23:03.208525+0000', 'modified': '2024-09-12T12:23:06.242554+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9363}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9363': {'gid': 9363, 'name': 'c', 'rank': 0, 'incarnation': 119, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/2909096469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 2909096469}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 2909096469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9363, 'qdb_cluster': [9363]} 2024-09-12T12:23:09.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:23:09.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T12:23:09.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20b0e00640 1 Processor -- start 2024-09-12T12:23:09.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20b0e00640 1 -- start start 2024-09-12T12:23:09.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20b0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 0x7f20ac071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20b0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20ac0cdaa0 0x7f20ac15c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20b0e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac0720f0 con 0x7f20ac071c50 2024-09-12T12:23:09.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20b0e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f20ac0723d0 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20b0e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac0726b0 con 0x7f20ac15c1a0 2024-09-12T12:23:09.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20ac0cdaa0 0x7f20ac15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20ac0cdaa0 0x7f20ac15c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45860/0 (socket says 172.21.15.144:45860) 2024-09-12T12:23:09.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20abe00640 1 -- 172.21.15.144:0/2986360233 learned_addr learned my addr 172.21.15.144:0/2986360233 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:09.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20ab400640 1 --2- 172.21.15.144:0/2986360233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 0x7f20ac071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20abe00640 1 -- 172.21.15.144:0/2986360233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 msgr2=0x7f20ac071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:09.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20abe00640 1 --2- 172.21.15.144:0/2986360233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 0x7f20ac071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20abe00640 1 -- 172.21.15.144:0/2986360233 >> v1:172.21.15.144:6789/0 conn(0x7f20ac071c50 legacy=0x7f20ac0cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20abe00640 1 -- 172.21.15.144:0/2986360233 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac072990 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20aa000640 1 -- 172.21.15.144:0/2986360233 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112794826 0 0) 0x7f20ac0720f0 con 0x7f20ac071c50 2024-09-12T12:23:09.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.669+0000 7f20ab400640 1 --2- 172.21.15.144:0/2986360233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 0x7f20ac071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:09.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20abe00640 1 --2- 172.21.15.144:0/2986360233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 0x7f20ac15c580 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009870 tx=0x7f20a401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88df0867b202b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20aa000640 1 -- 172.21.15.144:0/2986360233 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a40ab430 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20aa000640 1 -- 172.21.15.144:0/2986360233 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a40b0070 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20aa000640 1 -- 172.21.15.144:0/2986360233 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a40ab7f0 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20b0e00640 1 -- 172.21.15.144:0/2986360233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 msgr2=0x7f20ac15c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20b0e00640 1 --2- 172.21.15.144:0/2986360233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 0x7f20ac15c580 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009870 tx=0x7f20a401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20b0e00640 1 -- 172.21.15.144:0/2986360233 shutdown_connections 2024-09-12T12:23:09.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20b0e00640 1 --2- 172.21.15.144:0/2986360233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 0x7f20ac15c580 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20b0e00640 1 --2- 172.21.15.144:0/2986360233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 0x7f20ac071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20b0e00640 1 -- 172.21.15.144:0/2986360233 >> 172.21.15.144:0/2986360233 conn(0x7f20ac0b2860 msgr2=0x7f20ac0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:09.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20b0e00640 1 -- 172.21.15.144:0/2986360233 shutdown_connections 2024-09-12T12:23:09.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.673+0000 7f20b0e00640 1 -- 172.21.15.144:0/2986360233 wait complete. 2024-09-12T12:23:09.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 Processor -- start 2024-09-12T12:23:09.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 -- start start 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20ac071c50 0x7f20ac150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 0x7f20ac1f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 0x7f20ac0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac15d450 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac15d2d0 con 0x7f20ac071c50 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac15d5d0 con 0x7f20ac15c1a0 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 0x7f20ac1f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 0x7f20ac1f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45876/0 (socket says 172.21.15.144:45876) 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20aaa00640 1 -- 172.21.15.144:0/1529694842 learned_addr learned my addr 172.21.15.144:0/1529694842 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20ab400640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20ac071c50 0x7f20ac150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20abe00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 0x7f20ac0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20aaa00640 1 -- 172.21.15.144:0/1529694842 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 msgr2=0x7f20ac0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20aaa00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 0x7f20ac0ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20aaa00640 1 -- 172.21.15.144:0/1529694842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20ac071c50 msgr2=0x7f20ac150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20aaa00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20ac071c50 0x7f20ac150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20aaa00640 1 -- 172.21.15.144:0/1529694842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac159480 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20aaa00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 0x7f20ac1f6ef0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f209800c520 tx=0x7f209800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20a3400640 1 -- 172.21.15.144:0/1529694842 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098017070 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20a3400640 1 -- 172.21.15.144:0/1529694842 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20980052d0 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 -- 172.21.15.144:0/1529694842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac151b70 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20a3400640 1 -- 172.21.15.144:0/1529694842 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20980054c0 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.677+0000 7f20b0e00640 1 -- 172.21.15.144:0/1529694842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac152130 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20a3400640 1 -- 172.21.15.144:0/1529694842 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f209801a070 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20a3400640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f208c0678c0 0x7f208c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20a3400640 1 -- 172.21.15.144:0/1529694842 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f2098085210 con 0x7f20ac0cdaa0 2024-09-12T12:23:09.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20ab400640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f208c0678c0 0x7f208c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20b5891000 1 Processor -- start 2024-09-12T12:23:09.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20b5891000 1 -- start start 2024-09-12T12:23:09.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20ab400640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f208c0678c0 0x7f208c069d80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f209c007510 tx=0x7f209c0074a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20b5891000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec711b20 0x557fec711f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20b5891000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec6c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20b5891000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec6c8290 0x557fec6c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20b5891000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557fec5afb60 con 0x557fec6c8290 2024-09-12T12:23:09.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20b5891000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557fec516c70 con 0x557fec712440 2024-09-12T12:23:09.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20b5891000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557fec4bced0 con 0x557fec711b20 2024-09-12T12:23:09.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20abe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec6c8290 0x557fec6c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20abe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec6c8290 0x557fec6c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45880/0 (socket says 172.21.15.144:45880) 2024-09-12T12:23:09.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20abe00640 1 -- 172.21.15.144:0/3091081398 learned_addr learned my addr 172.21.15.144:0/3091081398 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:09.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20ab400640 1 --2- 172.21.15.144:0/3091081398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec711b20 0x557fec711f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20aaa00640 1 --2- 172.21.15.144:0/3091081398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec6c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20abe00640 1 -- 172.21.15.144:0/3091081398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec711b20 msgr2=0x557fec711f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:09.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20abe00640 1 --2- 172.21.15.144:0/3091081398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec711b20 0x557fec711f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20abe00640 1 -- 172.21.15.144:0/3091081398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 msgr2=0x557fec6c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:09.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20abe00640 1 --2- 172.21.15.144:0/3091081398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec6c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.681+0000 7f20abe00640 1 -- 172.21.15.144:0/3091081398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fec4cee50 con 0x557fec6c8290 2024-09-12T12:23:09.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20abe00640 1 --2- 172.21.15.144:0/3091081398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec6c8290 0x557fec6c8670 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f20a401cd40 tx=0x7f20a4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76f8175157e1ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f2097e00640 1 -- 172.21.15.144:0/3091081398 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a40042f0 con 0x557fec6c8290 2024-09-12T12:23:09.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f2097e00640 1 -- 172.21.15.144:0/3091081398 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a40b0040 con 0x557fec6c8290 2024-09-12T12:23:09.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f2097e00640 1 -- 172.21.15.144:0/3091081398 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4003620 con 0x557fec6c8290 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 -- 172.21.15.144:0/3091081398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec6c8290 msgr2=0x557fec6c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 --2- 172.21.15.144:0/3091081398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec6c8290 0x557fec6c8670 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f20a401cd40 tx=0x7f20a4004740 comp rx=0 tx=0).stop 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 -- 172.21.15.144:0/3091081398 shutdown_connections 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 --2- 172.21.15.144:0/3091081398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec6c8290 0x557fec6c8670 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 --2- 172.21.15.144:0/3091081398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec6c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 --2- 172.21.15.144:0/3091081398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec711b20 0x557fec711f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 -- 172.21.15.144:0/3091081398 >> 172.21.15.144:0/3091081398 conn(0x557fec6ce600 msgr2=0x557fec6c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 -- 172.21.15.144:0/3091081398 shutdown_connections 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 -- 172.21.15.144:0/3091081398 wait complete. 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 -- start start 2024-09-12T12:23:09.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 Processor -- start 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec6cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec6d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec6d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557fec578b00 con 0x557fec711b20 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557fec4f1360 con 0x557fec712440 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557fec4ee2d0 con 0x557fec6cd390 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20b5891000 10 client.0 _ll_register_callbacks cb 0x557fec6b3820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20ab400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec6cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20ab400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec6cce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45882/0 (socket says 172.21.15.144:45882) 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20ab400640 1 -- 172.21.15.144:0/237963770 learned_addr learned my addr 172.21.15.144:0/237963770 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:09.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20aaa00640 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec6d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20abe00640 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec6d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20ab400640 1 -- 172.21.15.144:0/237963770 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 msgr2=0x557fec6d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20ab400640 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec6d3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20ab400640 1 -- 172.21.15.144:0/237963770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 msgr2=0x557fec6d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20ab400640 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec6d2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20ab400640 1 -- 172.21.15.144:0/237963770 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fec4bd120 con 0x557fec711b20 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.685+0000 7f20abe00640 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec6d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20ab400640 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec6cce50 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f209c01df00 tx=0x7f209c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd95075c8fdc8e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 1 -- 172.21.15.144:0/237963770 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c026440 con 0x557fec711b20 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 1 -- 172.21.15.144:0/237963770 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f209c01c420 con 0x557fec711b20 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 -- 172.21.15.144:0/237963770 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20a40b0040 con 0x557fec711b20 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 1 -- 172.21.15.144:0/237963770 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f209c01c620 con 0x557fec711b20 2024-09-12T12:23:09.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 10 client.9495 fetch_fsmap learned FSMap version 123 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 -- 172.21.15.144:0/237963770 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x557fec4b6450 con 0x557fec711b20 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 1 -- 172.21.15.144:0/237963770 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a40b0040 con 0x557fec711b20 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 1 -- 172.21.15.144:0/237963770 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7f209c02e050 con 0x557fec711b20 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 10 client.9495 fetch_fsmap finished waiting for FSMap version 123 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 10 client.9495 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 20 client.9495 populate_metadata read hostname 'smithi144' 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557fec717f50 0x557fec718330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 4 client.9495 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 -- 172.21.15.144:0/237963770 --> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fec4b0c00 con 0x557fec717f50 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20aaa00640 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557fec717f50 0x557fec718330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20aaa00640 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557fec717f50 0x557fec718330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7299a2203e613cb1 server_cookie=b990dc46449a8b6a in_seq=0 out_seq=0 2024-09-12T12:23:09.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 10 client.9495 ms_handle_connect on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:09.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 1 -- 172.21.15.144:0/237963770 <== mds.0 v2:172.21.15.144:6835/2909096469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557fec4b0c00 con 0x557fec717f50 2024-09-12T12:23:09.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 10 client.9495 handle_command_reply: tid=0 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 client.9495 shutdown 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 -- 172.21.15.144:0/237963770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 msgr2=0x557fec6cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec6cce50 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f209c01df00 tx=0x7f209c004ac0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 -- 172.21.15.144:0/237963770 shutdown_connections 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557fec717f50 0x557fec718330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec6d3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec6d2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 --2- 172.21.15.144:0/237963770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec6cce50 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f2094c00640 0 client.9495 ms_handle_reset on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 -- 172.21.15.144:0/237963770 >> 172.21.15.144:0/237963770 conn(0x557fec6c8290 msgr2=0x557fec6c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 -- 172.21.15.144:0/237963770 shutdown_connections 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 1 -- 172.21.15.144:0/237963770 wait complete. 2024-09-12T12:23:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.689+0000 7f20b5891000 20 client.9495 trim_cache size 0 max 16384 2024-09-12T12:23:09.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 Processor -- start 2024-09-12T12:23:09.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 -- start start 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec6cd390 0x557fec70fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec7101c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec712440 0x557fec710700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac202a70 con 0x557fec711b20 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac15a3b0 con 0x557fec6cd390 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac202680 con 0x557fec712440 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec7101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec7101c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45898/0 (socket says 172.21.15.144:45898) 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20aaa00640 1 -- 172.21.15.144:0/1267840284 learned_addr learned my addr 172.21.15.144:0/1267840284 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20ab400640 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec6cd390 0x557fec70fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20abe00640 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec712440 0x557fec710700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20aaa00640 1 -- 172.21.15.144:0/1267840284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec712440 msgr2=0x557fec710700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20aaa00640 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec712440 0x557fec710700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20aaa00640 1 -- 172.21.15.144:0/1267840284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec6cd390 msgr2=0x557fec70fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20aaa00640 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec6cd390 0x557fec70fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20aaa00640 1 -- 172.21.15.144:0/1267840284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fec712270 con 0x557fec711b20 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20ab400640 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec6cd390 0x557fec70fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20aaa00640 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec7101c0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f20980835a0 tx=0x7f2098005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43d627103221454 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f2097400640 1 -- 172.21.15.144:0/1267840284 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209806d030 con 0x557fec711b20 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f2097400640 1 -- 172.21.15.144:0/1267840284 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098051aa0 con 0x557fec711b20 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f2097400640 1 -- 172.21.15.144:0/1267840284 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209806d3f0 con 0x557fec711b20 2024-09-12T12:23:09.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 -- 172.21.15.144:0/1267840284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 msgr2=0x557fec7101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec7101c0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f20980835a0 tx=0x7f2098005040 comp rx=0 tx=0).stop 2024-09-12T12:23:09.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 -- 172.21.15.144:0/1267840284 shutdown_connections 2024-09-12T12:23:09.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec712440 0x557fec710700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec7101c0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 --2- 172.21.15.144:0/1267840284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec6cd390 0x557fec70fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 -- 172.21.15.144:0/1267840284 >> 172.21.15.144:0/1267840284 conn(0x557fec6c8290 msgr2=0x557fec727000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:09.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 -- 172.21.15.144:0/1267840284 shutdown_connections 2024-09-12T12:23:09.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.709+0000 7f20b5891000 1 -- 172.21.15.144:0/1267840284 wait complete. 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 -- start start 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 Processor -- start 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec785710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec785c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec71bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557fec515f80 con 0x557fec711b20 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557fec4ceca0 con 0x557fec712440 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557fec51b2a0 con 0x557fec6cd390 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 10 client.0 _ll_register_callbacks cb 0x7f209c0077e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec785c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20ab400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec785710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20abe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec71bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20ab400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec785710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:56400/0 (socket says 172.21.15.144:56400) 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20ab400640 1 -- 172.21.15.144:0/2183661159 learned_addr learned my addr 172.21.15.144:0/2183661159 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20aaa00640 1 -- 172.21.15.144:0/2183661159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 msgr2=0x557fec785710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20aaa00640 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec785710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20aaa00640 1 -- 172.21.15.144:0/2183661159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 msgr2=0x557fec71bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20aaa00640 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec71bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20aaa00640 1 -- 172.21.15.144:0/2183661159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fec49dfd0 con 0x557fec711b20 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20aaa00640 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec785c50 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f20980553c0 tx=0x7f2098001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862ca31aa0600a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f2094c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f2094c00640 1 -- 172.21.15.144:0/2183661159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098071070 con 0x557fec711b20 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f2094c00640 1 -- 172.21.15.144:0/2183661159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f20980722a0 con 0x557fec711b20 2024-09-12T12:23:09.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 -- 172.21.15.144:0/2183661159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2098051aa0 con 0x557fec711b20 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f2094c00640 1 -- 172.21.15.144:0/2183661159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f209806d040 con 0x557fec711b20 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 10 client.9501 fetch_fsmap learned FSMap version 123 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 -- 172.21.15.144:0/2183661159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x557fec599750 con 0x557fec711b20 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f2094c00640 1 -- 172.21.15.144:0/2183661159 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098051aa0 con 0x557fec711b20 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f2094c00640 1 -- 172.21.15.144:0/2183661159 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7f2098054880 con 0x557fec711b20 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 10 client.9501 fetch_fsmap finished waiting for FSMap version 123 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 10 client.9501 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 20 client.9501 populate_metadata read hostname 'smithi144' 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557fec71c240 0x557fec71c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 4 client.9501 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20b5891000 1 -- 172.21.15.144:0/2183661159 --> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] -- command(tid 0: {"prefix": "status"}) -- 0x557fec5243a0 con 0x557fec71c240 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20ab400640 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557fec71c240 0x557fec71c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f20ab400640 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557fec71c240 0x557fec71c620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee8cd3f5052f6aa6 server_cookie=d545360910aba4da in_seq=0 out_seq=0 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.713+0000 7f2094c00640 10 client.9501 ms_handle_connect on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f2094c00640 1 -- 172.21.15.144:0/2183661159 <== mds.0 v2:172.21.15.144:6835/2909096469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x557fec5243a0 con 0x557fec71c240 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f2094c00640 10 client.9501 handle_command_reply: tid=0 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 client.9501 shutdown 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 -- 172.21.15.144:0/2183661159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 msgr2=0x557fec785c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec785c50 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f20980553c0 tx=0x7f2098001090 comp rx=0 tx=0).stop 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 -- 172.21.15.144:0/2183661159 shutdown_connections 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557fec71c240 0x557fec71c620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557fec712440 0x557fec71bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557fec711b20 0x557fec785c50 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f2094c00640 0 client.9501 ms_handle_reset on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 --2- 172.21.15.144:0/2183661159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557fec6cd390 0x557fec785710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 -- 172.21.15.144:0/2183661159 >> 172.21.15.144:0/2183661159 conn(0x557fec6c8290 msgr2=0x557fec727000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:09.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 -- 172.21.15.144:0/2183661159 shutdown_connections 2024-09-12T12:23:09.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 1 -- 172.21.15.144:0/2183661159 wait complete. 2024-09-12T12:23:09.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b5891000 20 client.9501 trim_cache size 0 max 16384 2024-09-12T12:23:09.720 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:23:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:23:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:23:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 9363, 2024-09-12T12:23:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:23:09.720 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:23:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:23:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 5.8644555589999996, 2024-09-12T12:23:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 123, 2024-09-12T12:23:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 165, 2024-09-12T12:23:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 165, 2024-09-12T12:23:09.721 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.735550203000001 2024-09-12T12:23:09.721 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 -- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f208c0678c0 msgr2=0x7f208c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f208c0678c0 0x7f208c069d80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f209c007510 tx=0x7f209c0074a0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 -- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 msgr2=0x7f20ac1f6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 0x7f20ac1f6ef0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f209800c520 tx=0x7f209800c9e0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 -- 172.21.15.144:0/1529694842 shutdown_connections 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f208c0678c0 0x7f208c069d80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20ac15c1a0 0x7f20ac0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20ac0cdaa0 0x7f20ac1f6ef0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 --2- 172.21.15.144:0/1529694842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20ac071c50 0x7f20ac150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 -- 172.21.15.144:0/1529694842 >> 172.21.15.144:0/1529694842 conn(0x7f20ac0b2860 msgr2=0x7f20ac0b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 -- 172.21.15.144:0/1529694842 shutdown_connections 2024-09-12T12:23:09.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.717+0000 7f20b0e00640 1 -- 172.21.15.144:0/1529694842 wait complete. 2024-09-12T12:23:09.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:23:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ae5800640 1 Processor -- start 2024-09-12T12:23:09.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ae5800640 1 -- start start 2024-09-12T12:23:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ae5800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8ae00cf210 0x7f8ae00cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ae5800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae006c6b0 con 0x7f8ae0147fa0 2024-09-12T12:23:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ae5800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae0072ce0 con 0x7f8ae015ea70 2024-09-12T12:23:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ae5800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae0072a90 con 0x7f8ae00cf210 2024-09-12T12:23:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8adea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8ae0147fa0 0x7f8ae006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34620/0 (socket says 172.21.15.144:34620) 2024-09-12T12:23:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8adea00640 1 -- 172.21.15.144:0/615697765 learned_addr learned my addr 172.21.15.144:0/615697765 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ade000640 1 --2- 172.21.15.144:0/615697765 >> v2:172.21.15.165:3300/0 conn(0x7f8ae00cf210 0x7f8ae00cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8add600640 1 -- 172.21.15.144:0/615697765 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269438090 0 0) 0x7f8ae006c6b0 con 0x7f8ae0147fa0 2024-09-12T12:23:09.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8add600640 1 -- 172.21.15.144:0/615697765 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac4003530 con 0x7f8ae0147fa0 2024-09-12T12:23:09.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ade000640 1 -- 172.21.15.144:0/615697765 >> v1:172.21.15.165:6789/0 conn(0x7f8ae015ea70 legacy=0x7f8ae015ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ade000640 1 -- 172.21.15.144:0/615697765 >> v1:172.21.15.144:6789/0 conn(0x7f8ae0147fa0 legacy=0x7f8ae006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.873+0000 7f8ade000640 1 -- 172.21.15.144:0/615697765 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae0072fc0 con 0x7f8ae00cf210 2024-09-12T12:23:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.877+0000 7f8ade000640 1 --2- 172.21.15.144:0/615697765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ae00cf210 0x7f8ae00cf650 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0097c0 tx=0x7f8acc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfd95ba1eebbd8ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8add600640 1 -- 172.21.15.144:0/615697765 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0b0070 con 0x7f8ae00cf210 2024-09-12T12:23:09.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8add600640 1 -- 172.21.15.144:0/615697765 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8acc0ab600 con 0x7f8ae00cf210 2024-09-12T12:23:09.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8add600640 1 -- 172.21.15.144:0/615697765 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0ab9b0 con 0x7f8ae00cf210 2024-09-12T12:23:09.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 -- 172.21.15.144:0/615697765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ae00cf210 msgr2=0x7f8ae00cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 --2- 172.21.15.144:0/615697765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ae00cf210 0x7f8ae00cf650 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0097c0 tx=0x7f8acc01c380 comp rx=0 tx=0).stop 2024-09-12T12:23:09.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 -- 172.21.15.144:0/615697765 shutdown_connections 2024-09-12T12:23:09.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 --2- 172.21.15.144:0/615697765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ae00cf210 0x7f8ae00cf650 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 -- 172.21.15.144:0/615697765 >> 172.21.15.144:0/615697765 conn(0x7f8ae006cd20 msgr2=0x7f8ae006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:09.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 -- 172.21.15.144:0/615697765 shutdown_connections 2024-09-12T12:23:09.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 -- 172.21.15.144:0/615697765 wait complete. 2024-09-12T12:23:09.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 Processor -- start 2024-09-12T12:23:09.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 -- start start 2024-09-12T12:23:09.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ae00cf210 0x7f8ae013e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ae0147fa0 0x7f8ae013a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ae015ea70 0x7f8ae01549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae015fa20 con 0x7f8ae0147fa0 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae006c320 con 0x7f8ae015ea70 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ae5800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae015fba0 con 0x7f8ae00cf210 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.881+0000 7f8ade000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ae0147fa0 0x7f8ae013a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ade000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ae0147fa0 0x7f8ae013a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45918/0 (socket says 172.21.15.144:45918) 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ade000640 1 -- 172.21.15.144:0/3262268914 learned_addr learned my addr 172.21.15.144:0/3262268914 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8adea00640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ae00cf210 0x7f8ae013e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8adf400640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ae015ea70 0x7f8ae01549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ade000640 1 -- 172.21.15.144:0/3262268914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ae00cf210 msgr2=0x7f8ae013e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ade000640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ae00cf210 0x7f8ae013e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ade000640 1 -- 172.21.15.144:0/3262268914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ae015ea70 msgr2=0x7f8ae01549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ade000640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ae015ea70 0x7f8ae01549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ade000640 1 -- 172.21.15.144:0/3262268914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae0161e00 con 0x7f8ae0147fa0 2024-09-12T12:23:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ade000640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ae0147fa0 0x7f8ae013a4a0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f8acc018f90 tx=0x7f8acc019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ad6a00640 1 -- 172.21.15.144:0/3262268914 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0b8020 con 0x7f8ae0147fa0 2024-09-12T12:23:09.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ad6a00640 1 -- 172.21.15.144:0/3262268914 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8acc0b4410 con 0x7f8ae0147fa0 2024-09-12T12:23:09.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae015ca70 con 0x7f8ae0147fa0 2024-09-12T12:23:09.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ad6a00640 1 -- 172.21.15.144:0/3262268914 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0b0040 con 0x7f8ae0147fa0 2024-09-12T12:23:09.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae015d030 con 0x7f8ae0147fa0 2024-09-12T12:23:09.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae00cf650 con 0x7f8ae0147fa0 2024-09-12T12:23:09.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ad6a00640 1 -- 172.21.15.144:0/3262268914 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8acc0bb020 con 0x7f8ae0147fa0 2024-09-12T12:23:09.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ad6a00640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ac00678c0 0x7f8ac0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:09.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.885+0000 7f8ad6a00640 1 -- 172.21.15.144:0/3262268914 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f8acc11f830 con 0x7f8ae0147fa0 2024-09-12T12:23:09.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.889+0000 7f8adea00640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ac00678c0 0x7f8ac0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:09.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.889+0000 7f8adea00640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ac00678c0 0x7f8ac0069d80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00011f0 tx=0x7f8ad0007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:09.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:09.889+0000 7f8ad6a00640 1 -- 172.21.15.144:0/3262268914 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8acc0c2030 con 0x7f8ae0147fa0 2024-09-12T12:23:10.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.081+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8ae00b67d0 con 0x7f8ae0147fa0 2024-09-12T12:23:10.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ad6a00640 1 -- 172.21.15.144:0/3262268914 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v123) ==== 53+0+73 (secure 0 0 0) 0x7f8acc016090 con 0x7f8ae0147fa0 2024-09-12T12:23:10.082 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ac00678c0 msgr2=0x7f8ac0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ac00678c0 0x7f8ac0069d80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00011f0 tx=0x7f8ad0007d40 comp rx=0 tx=0).stop 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ae0147fa0 msgr2=0x7f8ae013a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ae0147fa0 0x7f8ae013a4a0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f8acc018f90 tx=0x7f8acc019120 comp rx=0 tx=0).stop 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 shutdown_connections 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8ac00678c0 0x7f8ac0069d80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ae015ea70 0x7f8ae01549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ae0147fa0 0x7f8ae013a4a0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 --2- 172.21.15.144:0/3262268914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ae00cf210 0x7f8ae013e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 >> 172.21.15.144:0/3262268914 conn(0x7f8ae006cd20 msgr2=0x7f8ae01575a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 shutdown_connections 2024-09-12T12:23:10.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.085+0000 7f8ae5800640 1 -- 172.21.15.144:0/3262268914 wait complete. 2024-09-12T12:23:10.104 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:23:10.104 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:23:10.104 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:23:10.104 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:23:10.104 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:23:10.104 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:23:10.104 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:23:10.104 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:23:10.104 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:23:10.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:10.105 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:23:10.114 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:23:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:23:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41793sec preferred_lft 41793sec 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:23:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:10.117 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:23:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:23:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:23:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:10.117 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:23:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:23:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:23:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:23:10.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:10.118 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:23:10.175 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:23:10.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:10.177 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:23:10.233 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:23:10.234 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:23:10.234 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:10.234 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:23:10.234 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:23:10.234 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:23:10.234 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:23:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:10.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:10.368 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:23:10.376 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:23:10.376 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:23:10.377 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:23:10.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:10.377 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:23:10.441 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:23:10.441 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:23:10.490 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:23:10.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:23:10.490 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:23:10.541 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:23:10.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:10.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:23:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:23:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:23:10.642 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:23:10.642 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:23:10.642 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:23:10.642 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:23:10.642 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:23:10.646 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:23:10.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:10.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:23:10.666 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:23:10.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:10.776 INFO:teuthology.orchestra.run.smithi144.stdout:client8971 2024-09-12T12:23:10.776 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:23:10.776 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:23:10.785 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:10.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.969+0000 7f3454200640 1 Processor -- start 2024-09-12T12:23:10.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.969+0000 7f3454200640 1 -- start start 2024-09-12T12:23:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3454200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f344c15c7b0 0x7f344c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3454200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c15cd30 0x7f344c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3454200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f344c0b5de0 0x7f344c1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3454200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f344c072a50 con 0x7f344c15c7b0 2024-09-12T12:23:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3454200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f344c0cde30 con 0x7f344c0b5de0 2024-09-12T12:23:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3454200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f344c0b6210 con 0x7f344c15cd30 2024-09-12T12:23:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3451800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f344c15c7b0 0x7f344c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3451800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f344c15c7b0 0x7f344c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45920/0 (socket says 172.21.15.144:45920) 2024-09-12T12:23:10.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3451800640 1 -- 172.21.15.144:0/2745900904 learned_addr learned my addr 172.21.15.144:0/2745900904 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:10.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3452200640 1 --2- 172.21.15.144:0/2745900904 >> v2:172.21.15.165:3300/0 conn(0x7f344c0b5de0 0x7f344c1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3450e00640 1 --2- 172.21.15.144:0/2745900904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c15cd30 0x7f344c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3451800640 1 -- 172.21.15.144:0/2745900904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c15cd30 msgr2=0x7f344c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:10.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3451800640 1 --2- 172.21.15.144:0/2745900904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c15cd30 0x7f344c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3451800640 1 -- 172.21.15.144:0/2745900904 >> v2:172.21.15.165:3300/0 conn(0x7f344c0b5de0 msgr2=0x7f344c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:10.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3451800640 1 --2- 172.21.15.144:0/2745900904 >> v2:172.21.15.165:3300/0 conn(0x7f344c0b5de0 0x7f344c1601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.973+0000 7f3451800640 1 -- 172.21.15.144:0/2745900904 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c0cd870 con 0x7f344c15c7b0 2024-09-12T12:23:10.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3451800640 1 --2- 172.21.15.144:0/2745900904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 0x7f344c0ccf00 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f344c0ce230 tx=0x7f344001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a976cd7ccad811 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f344be00640 1 -- 172.21.15.144:0/2745900904 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400b0070 con 0x7f344c15c7b0 2024-09-12T12:23:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f344be00640 1 -- 172.21.15.144:0/2745900904 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34400ab600 con 0x7f344c15c7b0 2024-09-12T12:23:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f344be00640 1 -- 172.21.15.144:0/2745900904 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400ab9d0 con 0x7f344c15c7b0 2024-09-12T12:23:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 -- 172.21.15.144:0/2745900904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 msgr2=0x7f344c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 --2- 172.21.15.144:0/2745900904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 0x7f344c0ccf00 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f344c0ce230 tx=0x7f344001c260 comp rx=0 tx=0).stop 2024-09-12T12:23:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 -- 172.21.15.144:0/2745900904 shutdown_connections 2024-09-12T12:23:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 --2- 172.21.15.144:0/2745900904 >> v2:172.21.15.165:3300/0 conn(0x7f344c0b5de0 0x7f344c1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 --2- 172.21.15.144:0/2745900904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c15cd30 0x7f344c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 --2- 172.21.15.144:0/2745900904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 0x7f344c0ccf00 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 -- 172.21.15.144:0/2745900904 >> 172.21.15.144:0/2745900904 conn(0x7f344c06d0d0 msgr2=0x7f344c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 -- 172.21.15.144:0/2745900904 shutdown_connections 2024-09-12T12:23:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 -- 172.21.15.144:0/2745900904 wait complete. 2024-09-12T12:23:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 Processor -- start 2024-09-12T12:23:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.977+0000 7f3454200640 1 -- start start 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3454200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c0b5de0 0x7f344c0b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3454200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 0x7f344c15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3454200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f344c15cd30 0x7f344c15b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3454200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f344c072ee0 con 0x7f344c15c7b0 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3454200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f344c0cd650 con 0x7f344c15cd30 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3454200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f344c073060 con 0x7f344c0b5de0 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3450e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 0x7f344c15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3450e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 0x7f344c15b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45924/0 (socket says 172.21.15.144:45924) 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3450e00640 1 -- 172.21.15.144:0/2133129327 learned_addr learned my addr 172.21.15.144:0/2133129327 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3451800640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c0b5de0 0x7f344c0b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3452200640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f344c15cd30 0x7f344c15b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3450e00640 1 -- 172.21.15.144:0/2133129327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c0b5de0 msgr2=0x7f344c0b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3450e00640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c0b5de0 0x7f344c0b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3450e00640 1 -- 172.21.15.144:0/2133129327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f344c15cd30 msgr2=0x7f344c15b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3450e00640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f344c15cd30 0x7f344c15b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3450e00640 1 -- 172.21.15.144:0/2133129327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c0b56d0 con 0x7f344c15c7b0 2024-09-12T12:23:10.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3450e00640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 0x7f344c15b420 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f343800d5f0 tx=0x7f343800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:10.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3449600640 1 -- 172.21.15.144:0/2133129327 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380125f0 con 0x7f344c15c7b0 2024-09-12T12:23:10.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3449600640 1 -- 172.21.15.144:0/2133129327 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3438019070 con 0x7f344c15c7b0 2024-09-12T12:23:10.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3449600640 1 -- 172.21.15.144:0/2133129327 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380129d0 con 0x7f344c15c7b0 2024-09-12T12:23:10.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344c165200 con 0x7f344c15c7b0 2024-09-12T12:23:10.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f344c1657c0 con 0x7f344c15c7b0 2024-09-12T12:23:10.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f344c0ccf00 con 0x7f344c15c7b0 2024-09-12T12:23:10.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.981+0000 7f3449600640 1 -- 172.21.15.144:0/2133129327 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3438012b70 con 0x7f344c15c7b0 2024-09-12T12:23:10.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.985+0000 7f3449600640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f342c0678c0 0x7f342c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:10.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.985+0000 7f3449600640 1 -- 172.21.15.144:0/2133129327 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f3438086220 con 0x7f344c15c7b0 2024-09-12T12:23:10.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.985+0000 7f3451800640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f342c0678c0 0x7f342c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.985+0000 7f3451800640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f342c0678c0 0x7f342c069d80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad000 tx=0x7f3440008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:10.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:10.989+0000 7f3449600640 1 -- 172.21.15.144:0/2133129327 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f34380564e0 con 0x7f344c15c7b0 2024-09-12T12:23:11.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.177+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f344c0d10f0 con 0x7f344c15c7b0 2024-09-12T12:23:11.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.177+0000 7f3449600640 1 -- 172.21.15.144:0/2133129327 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7f343805a7e0 con 0x7f344c15c7b0 2024-09-12T12:23:11.176 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:11.176 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:11.176 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.177+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f342c0678c0 msgr2=0x7f342c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.177+0000 7f3454200640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f342c0678c0 0x7f342c069d80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad000 tx=0x7f3440008040 comp rx=0 tx=0).stop 2024-09-12T12:23:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.177+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 msgr2=0x7f344c15b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.177+0000 7f3454200640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 0x7f344c15b420 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f343800d5f0 tx=0x7f343800dab0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.181+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 shutdown_connections 2024-09-12T12:23:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.181+0000 7f3454200640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f342c0678c0 0x7f342c069d80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.181+0000 7f3454200640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f344c15cd30 0x7f344c15b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.181+0000 7f3454200640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f344c15c7b0 0x7f344c15b420 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.181+0000 7f3454200640 1 --2- 172.21.15.144:0/2133129327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f344c0b5de0 0x7f344c0b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.181+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 >> 172.21.15.144:0/2133129327 conn(0x7f344c06d0d0 msgr2=0x7f344c0cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.181+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 shutdown_connections 2024-09-12T12:23:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.181+0000 7f3454200640 1 -- 172.21.15.144:0/2133129327 wait complete. 2024-09-12T12:23:11.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:11.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c2d400640 1 Processor -- start 2024-09-12T12:23:11.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c2d400640 1 -- start start 2024-09-12T12:23:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c2d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6c280b5fb0 0x7f6c28167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c2d400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c280cd870 con 0x7f6c2815c7b0 2024-09-12T12:23:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c2d400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c280cdb50 con 0x7f6c2815cd30 2024-09-12T12:23:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c2d400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6c28072a50 con 0x7f6c280b5fb0 2024-09-12T12:23:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c26800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6c2815c7b0 0x7f6c280ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34630/0 (socket says 172.21.15.144:34630) 2024-09-12T12:23:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c26800640 1 -- 172.21.15.144:0/2364821601 learned_addr learned my addr 172.21.15.144:0/2364821601 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:11.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c27200640 1 --2- 172.21.15.144:0/2364821601 >> v2:172.21.15.165:3300/0 conn(0x7f6c280b5fb0 0x7f6c28167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:11.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c25400640 1 -- 172.21.15.144:0/2364821601 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926916549 0 0) 0x7f6c280cd870 con 0x7f6c2815c7b0 2024-09-12T12:23:11.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c25400640 1 -- 172.21.15.144:0/2364821601 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c0c003530 con 0x7f6c2815c7b0 2024-09-12T12:23:11.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c27200640 1 -- 172.21.15.144:0/2364821601 >> v1:172.21.15.165:6789/0 conn(0x7f6c2815cd30 legacy=0x7f6c280b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:11.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c27200640 1 -- 172.21.15.144:0/2364821601 >> v1:172.21.15.144:6789/0 conn(0x7f6c2815c7b0 legacy=0x7f6c280ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:11.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.337+0000 7f6c27200640 1 -- 172.21.15.144:0/2364821601 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c280726e0 con 0x7f6c280b5fb0 2024-09-12T12:23:11.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c27200640 1 --2- 172.21.15.144:0/2364821601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c280b5fb0 0x7f6c28167310 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009d90 tx=0x7f6c2001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cfadc20ff2a4cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:11.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c25400640 1 -- 172.21.15.144:0/2364821601 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c200b2070 con 0x7f6c280b5fb0 2024-09-12T12:23:11.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c25400640 1 -- 172.21.15.144:0/2364821601 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c200a5830 con 0x7f6c280b5fb0 2024-09-12T12:23:11.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c25400640 1 -- 172.21.15.144:0/2364821601 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c200a5c00 con 0x7f6c280b5fb0 2024-09-12T12:23:11.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c2d400640 1 -- 172.21.15.144:0/2364821601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c280b5fb0 msgr2=0x7f6c28167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:11.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c2d400640 1 --2- 172.21.15.144:0/2364821601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c280b5fb0 0x7f6c28167310 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009d90 tx=0x7f6c2001c970 comp rx=0 tx=0).stop 2024-09-12T12:23:11.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c2d400640 1 -- 172.21.15.144:0/2364821601 shutdown_connections 2024-09-12T12:23:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c2d400640 1 --2- 172.21.15.144:0/2364821601 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c280b5fb0 0x7f6c28167310 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c2d400640 1 -- 172.21.15.144:0/2364821601 >> 172.21.15.144:0/2364821601 conn(0x7f6c2806d0d0 msgr2=0x7f6c2806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c2d400640 1 -- 172.21.15.144:0/2364821601 shutdown_connections 2024-09-12T12:23:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.341+0000 7f6c2d400640 1 -- 172.21.15.144:0/2364821601 wait complete. 2024-09-12T12:23:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 Processor -- start 2024-09-12T12:23:11.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 -- start start 2024-09-12T12:23:11.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c280b5fb0 0x7f6c281546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c2815c7b0 0x7f6c281fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c2815cd30 0x7f6c28148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2816a690 con 0x7f6c2815c7b0 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280cd610 con 0x7f6c280b5fb0 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2816a810 con 0x7f6c2815cd30 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c25e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c2815c7b0 0x7f6c281fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c25e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c2815c7b0 0x7f6c281fbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45930/0 (socket says 172.21.15.144:45930) 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c25e00640 1 -- 172.21.15.144:0/480493848 learned_addr learned my addr 172.21.15.144:0/480493848 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c26800640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c280b5fb0 0x7f6c281546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c27200640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c2815cd30 0x7f6c28148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c25e00640 1 -- 172.21.15.144:0/480493848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c2815cd30 msgr2=0x7f6c28148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:11.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c25e00640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c2815cd30 0x7f6c28148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c25e00640 1 -- 172.21.15.144:0/480493848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c280b5fb0 msgr2=0x7f6c281546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c25e00640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c280b5fb0 0x7f6c281546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c25e00640 1 -- 172.21.15.144:0/480493848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c280cecc0 con 0x7f6c2815c7b0 2024-09-12T12:23:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c25e00640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c2815c7b0 0x7f6c281fbe90 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c3a0 tx=0x7f6c1400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c1ea00640 1 -- 172.21.15.144:0/480493848 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c140052d0 con 0x7f6c2815c7b0 2024-09-12T12:23:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c1ea00640 1 -- 172.21.15.144:0/480493848 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14005470 con 0x7f6c2815c7b0 2024-09-12T12:23:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c1ea00640 1 -- 172.21.15.144:0/480493848 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14007260 con 0x7f6c2815c7b0 2024-09-12T12:23:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c280ce740 con 0x7f6c2815c7b0 2024-09-12T12:23:11.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.345+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c281fc3d0 con 0x7f6c2815c7b0 2024-09-12T12:23:11.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.349+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c280ccf00 con 0x7f6c2815c7b0 2024-09-12T12:23:11.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.349+0000 7f6c1ea00640 1 -- 172.21.15.144:0/480493848 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c14007400 con 0x7f6c2815c7b0 2024-09-12T12:23:11.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.349+0000 7f6c1ea00640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c080678c0 0x7f6c08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:11.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.349+0000 7f6c1ea00640 1 -- 172.21.15.144:0/480493848 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f6c140851f0 con 0x7f6c2815c7b0 2024-09-12T12:23:11.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.349+0000 7f6c26800640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c080678c0 0x7f6c08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:11.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.349+0000 7f6c26800640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c080678c0 0x7f6c08069d80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6c180011f0 tx=0x7f6c18007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:11.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.353+0000 7f6c1ea00640 1 -- 172.21.15.144:0/480493848 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c14055540 con 0x7f6c2815c7b0 2024-09-12T12:23:11.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.545+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c281561b0 con 0x7f6c2815c7b0 2024-09-12T12:23:11.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.545+0000 7f6c1ea00640 1 -- 172.21.15.144:0/480493848 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7f6c14059840 con 0x7f6c2815c7b0 2024-09-12T12:23:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:11.544 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:11.545 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:11.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c080678c0 msgr2=0x7f6c08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:11.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c080678c0 0x7f6c08069d80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6c180011f0 tx=0x7f6c18007d40 comp rx=0 tx=0).stop 2024-09-12T12:23:11.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c2815c7b0 msgr2=0x7f6c281fbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:11.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c2815c7b0 0x7f6c281fbe90 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c3a0 tx=0x7f6c1400c860 comp rx=0 tx=0).stop 2024-09-12T12:23:11.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 shutdown_connections 2024-09-12T12:23:11.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6c080678c0 0x7f6c08069d80 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c2815cd30 0x7f6c28148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c2815c7b0 0x7f6c281fbe90 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 --2- 172.21.15.144:0/480493848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c280b5fb0 0x7f6c281546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:11.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 >> 172.21.15.144:0/480493848 conn(0x7f6c2806d0d0 msgr2=0x7f6c281607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:11.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 shutdown_connections 2024-09-12T12:23:11.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11.549+0000 7f6c2d400640 1 -- 172.21.15.144:0/480493848 wait complete. 2024-09-12T12:23:11.565 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:11.566 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:11.566 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.0 2024-09-12T12:23:11.566 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:11.566 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:11.566 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:11.566 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:11.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:11.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.647 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179021 s, 58.6 MB/s 2024-09-12T12:23:11.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.669 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.669 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187098 s, 56.0 MB/s 2024-09-12T12:23:11.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.688 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170749 s, 61.4 MB/s 2024-09-12T12:23:11.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.704 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130677 s, 80.2 MB/s 2024-09-12T12:23:11.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.720 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130627 s, 80.3 MB/s 2024-09-12T12:23:11.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.740 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182018 s, 57.6 MB/s 2024-09-12T12:23:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140892 s, 74.4 MB/s 2024-09-12T12:23:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.775 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153833 s, 68.2 MB/s 2024-09-12T12:23:11.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154141 s, 68.0 MB/s 2024-09-12T12:23:11.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.811 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159651 s, 65.7 MB/s 2024-09-12T12:23:11.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.828 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.828 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130088 s, 80.6 MB/s 2024-09-12T12:23:11.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.845 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146288 s, 71.7 MB/s 2024-09-12T12:23:11.864 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.864 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.864 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165098 s, 63.5 MB/s 2024-09-12T12:23:11.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.884 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159011 s, 65.9 MB/s 2024-09-12T12:23:11.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.902 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014821 s, 70.7 MB/s 2024-09-12T12:23:11.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.920 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150348 s, 69.7 MB/s 2024-09-12T12:23:11.936 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.936 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.936 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130639 s, 80.3 MB/s 2024-09-12T12:23:11.954 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.954 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.954 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153103 s, 68.5 MB/s 2024-09-12T12:23:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.974 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.975 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179242 s, 58.5 MB/s 2024-09-12T12:23:11.990 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:11.990 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:11.990 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130759 s, 80.2 MB/s 2024-09-12T12:23:12.007 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.007 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.007 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144112 s, 72.8 MB/s 2024-09-12T12:23:12.023 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.024 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134512 s, 78.0 MB/s 2024-09-12T12:23:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136551 s, 76.8 MB/s 2024-09-12T12:23:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.060 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181146 s, 57.9 MB/s 2024-09-12T12:23:12.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155317 s, 67.5 MB/s 2024-09-12T12:23:12.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.096 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147446 s, 71.1 MB/s 2024-09-12T12:23:12.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.114 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157558 s, 66.6 MB/s 2024-09-12T12:23:12.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.130 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.130 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128591 s, 81.5 MB/s 2024-09-12T12:23:12.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.148 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153737 s, 68.2 MB/s 2024-09-12T12:23:12.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.167 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017048 s, 61.5 MB/s 2024-09-12T12:23:12.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.185 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155058 s, 67.6 MB/s 2024-09-12T12:23:12.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165101 s, 63.5 MB/s 2024-09-12T12:23:12.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:12.212 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:12.212 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:12.212 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.1 2024-09-12T12:23:12.212 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:12.212 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:12.212 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:12.212 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:12.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:12.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.279 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012729 s, 82.4 MB/s 2024-09-12T12:23:12.298 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.298 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165388 s, 63.4 MB/s 2024-09-12T12:23:12.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.316 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142792 s, 73.4 MB/s 2024-09-12T12:23:12.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.333 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144591 s, 72.5 MB/s 2024-09-12T12:23:12.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.349 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126956 s, 82.6 MB/s 2024-09-12T12:23:12.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.368 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170376 s, 61.5 MB/s 2024-09-12T12:23:12.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.385 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144273 s, 72.7 MB/s 2024-09-12T12:23:12.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.403 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148019 s, 70.8 MB/s 2024-09-12T12:23:12.419 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.420 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.420 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143274 s, 73.2 MB/s 2024-09-12T12:23:12.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.435 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128857 s, 81.4 MB/s 2024-09-12T12:23:12.450 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.451 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127559 s, 82.2 MB/s 2024-09-12T12:23:12.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.467 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131638 s, 79.7 MB/s 2024-09-12T12:23:12.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.483 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.483 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136066 s, 77.1 MB/s 2024-09-12T12:23:12.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.499 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135737 s, 77.3 MB/s 2024-09-12T12:23:12.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.515 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140309 s, 74.7 MB/s 2024-09-12T12:23:12.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.531 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.531 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127605 s, 82.2 MB/s 2024-09-12T12:23:12.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.551 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174122 s, 60.2 MB/s 2024-09-12T12:23:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012679 s, 82.7 MB/s 2024-09-12T12:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173275 s, 60.5 MB/s 2024-09-12T12:23:12.603 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.604 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141317 s, 74.2 MB/s 2024-09-12T12:23:12.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.621 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144311 s, 72.7 MB/s 2024-09-12T12:23:12.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.636 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125934 s, 83.3 MB/s 2024-09-12T12:23:12.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.652 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133574 s, 78.5 MB/s 2024-09-12T12:23:12.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.668 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128183 s, 81.8 MB/s 2024-09-12T12:23:12.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.684 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012655 s, 82.9 MB/s 2024-09-12T12:23:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.699 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126912 s, 82.6 MB/s 2024-09-12T12:23:12.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.715 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129807 s, 80.8 MB/s 2024-09-12T12:23:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.734 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016237 s, 64.6 MB/s 2024-09-12T12:23:12.751 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.751 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.751 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144926 s, 72.4 MB/s 2024-09-12T12:23:12.767 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.767 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.767 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013049 s, 80.4 MB/s 2024-09-12T12:23:12.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.785 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014856 s, 70.6 MB/s 2024-09-12T12:23:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.803 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147072 s, 71.3 MB/s 2024-09-12T12:23:12.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:12.810 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:12.811 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:12.811 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.2 2024-09-12T12:23:12.811 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:12.811 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:12.811 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:12.811 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:12.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.920 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139256 s, 75.3 MB/s 2024-09-12T12:23:12.938 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.938 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.938 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147 s, 71.3 MB/s 2024-09-12T12:23:12.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.956 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147153 s, 71.3 MB/s 2024-09-12T12:23:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130981 s, 80.1 MB/s 2024-09-12T12:23:12.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:12.989 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:12.989 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144813 s, 72.4 MB/s 2024-09-12T12:23:13.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.005 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.005 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139186 s, 75.3 MB/s 2024-09-12T12:23:13.023 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.023 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.023 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146332 s, 71.7 MB/s 2024-09-12T12:23:13.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.041 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149224 s, 70.3 MB/s 2024-09-12T12:23:13.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.058 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140648 s, 74.6 MB/s 2024-09-12T12:23:13.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.077 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014661 s, 71.5 MB/s 2024-09-12T12:23:13.093 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.094 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015113 s, 69.4 MB/s 2024-09-12T12:23:13.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.111 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142208 s, 73.7 MB/s 2024-09-12T12:23:13.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.128 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142933 s, 73.4 MB/s 2024-09-12T12:23:13.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.148 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169282 s, 61.9 MB/s 2024-09-12T12:23:13.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.163 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012777 s, 82.1 MB/s 2024-09-12T12:23:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.180 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135259 s, 77.5 MB/s 2024-09-12T12:23:13.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.200 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174643 s, 60.0 MB/s 2024-09-12T12:23:13.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.220 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016381 s, 64.0 MB/s 2024-09-12T12:23:13.235 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.236 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.236 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127685 s, 82.1 MB/s 2024-09-12T12:23:13.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.252 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127887 s, 82.0 MB/s 2024-09-12T12:23:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141425 s, 74.1 MB/s 2024-09-12T12:23:13.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128298 s, 81.7 MB/s 2024-09-12T12:23:13.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122572 s, 85.5 MB/s 2024-09-12T12:23:13.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.315 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136181 s, 77.0 MB/s 2024-09-12T12:23:13.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.335 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170179 s, 61.6 MB/s 2024-09-12T12:23:13.351 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.352 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142362 s, 73.7 MB/s 2024-09-12T12:23:13.367 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.367 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.367 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128149 s, 81.8 MB/s 2024-09-12T12:23:13.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.384 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135682 s, 77.3 MB/s 2024-09-12T12:23:13.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.399 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124713 s, 84.1 MB/s 2024-09-12T12:23:13.415 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.415 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.415 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129183 s, 81.2 MB/s 2024-09-12T12:23:13.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.431 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130272 s, 80.5 MB/s 2024-09-12T12:23:13.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.449 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142439 s, 73.6 MB/s 2024-09-12T12:23:13.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:13.456 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:13.456 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:13.456 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.3 2024-09-12T12:23:13.456 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:13.457 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:13.457 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:13.457 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:13.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.564 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.564 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128486 s, 81.6 MB/s 2024-09-12T12:23:13.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.581 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147029 s, 71.3 MB/s 2024-09-12T12:23:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136011 s, 77.1 MB/s 2024-09-12T12:23:13.618 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.618 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.618 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171228 s, 61.2 MB/s 2024-09-12T12:23:13.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.634 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127498 s, 82.2 MB/s 2024-09-12T12:23:13.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.650 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133845 s, 78.3 MB/s 2024-09-12T12:23:13.669 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.669 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169378 s, 61.9 MB/s 2024-09-12T12:23:13.686 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.686 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.686 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133908 s, 78.3 MB/s 2024-09-12T12:23:13.705 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.705 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.705 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160735 s, 65.2 MB/s 2024-09-12T12:23:13.720 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.720 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.720 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128412 s, 81.7 MB/s 2024-09-12T12:23:13.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.737 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139286 s, 75.3 MB/s 2024-09-12T12:23:13.753 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.753 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.753 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013326 s, 78.7 MB/s 2024-09-12T12:23:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132254 s, 79.3 MB/s 2024-09-12T12:23:13.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.785 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130012 s, 80.7 MB/s 2024-09-12T12:23:13.802 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.802 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.802 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142108 s, 73.8 MB/s 2024-09-12T12:23:13.818 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.818 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.818 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130243 s, 80.5 MB/s 2024-09-12T12:23:13.833 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.833 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.833 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122358 s, 85.7 MB/s 2024-09-12T12:23:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125221 s, 83.7 MB/s 2024-09-12T12:23:13.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.863 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127807 s, 82.0 MB/s 2024-09-12T12:23:13.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.879 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128433 s, 81.6 MB/s 2024-09-12T12:23:13.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.894 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012753 s, 82.2 MB/s 2024-09-12T12:23:13.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132716 s, 79.0 MB/s 2024-09-12T12:23:13.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.930 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171942 s, 61.0 MB/s 2024-09-12T12:23:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128165 s, 81.8 MB/s 2024-09-12T12:23:13.965 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173998 s, 60.3 MB/s 2024-09-12T12:23:13.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:13.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:13.981 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125067 s, 83.8 MB/s 2024-09-12T12:23:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.008 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243259 s, 43.1 MB/s 2024-09-12T12:23:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.024 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129094 s, 81.2 MB/s 2024-09-12T12:23:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144231 s, 72.7 MB/s 2024-09-12T12:23:14.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.058 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144202 s, 72.7 MB/s 2024-09-12T12:23:14.075 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.075 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.075 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142599 s, 73.5 MB/s 2024-09-12T12:23:14.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176496 s, 59.4 MB/s 2024-09-12T12:23:14.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:14.103 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:14.103 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:14.103 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.4 2024-09-12T12:23:14.103 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:14.103 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:14.103 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:14.103 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:14.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:14.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.213 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150714 s, 69.6 MB/s 2024-09-12T12:23:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.228 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130048 s, 80.6 MB/s 2024-09-12T12:23:14.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.248 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168398 s, 62.3 MB/s 2024-09-12T12:23:14.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.266 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146813 s, 71.4 MB/s 2024-09-12T12:23:14.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.281 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128545 s, 81.6 MB/s 2024-09-12T12:23:14.296 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.296 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.296 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124928 s, 83.9 MB/s 2024-09-12T12:23:14.312 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.313 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142311 s, 73.7 MB/s 2024-09-12T12:23:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.329 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138618 s, 75.6 MB/s 2024-09-12T12:23:14.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165455 s, 63.4 MB/s 2024-09-12T12:23:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.365 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142127 s, 73.8 MB/s 2024-09-12T12:23:14.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.381 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.381 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133655 s, 78.5 MB/s 2024-09-12T12:23:14.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168414 s, 62.3 MB/s 2024-09-12T12:23:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144564 s, 72.5 MB/s 2024-09-12T12:23:14.434 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.434 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.434 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140258 s, 74.8 MB/s 2024-09-12T12:23:14.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.451 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145416 s, 72.1 MB/s 2024-09-12T12:23:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014474 s, 72.4 MB/s 2024-09-12T12:23:14.484 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.484 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.484 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135969 s, 77.1 MB/s 2024-09-12T12:23:14.500 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.500 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.500 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132194 s, 79.3 MB/s 2024-09-12T12:23:14.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.515 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127639 s, 82.2 MB/s 2024-09-12T12:23:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01425 s, 73.6 MB/s 2024-09-12T12:23:14.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.549 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014078 s, 74.5 MB/s 2024-09-12T12:23:14.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.568 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163914 s, 64.0 MB/s 2024-09-12T12:23:14.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.586 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146836 s, 71.4 MB/s 2024-09-12T12:23:14.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.602 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141888 s, 73.9 MB/s 2024-09-12T12:23:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.620 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148541 s, 70.6 MB/s 2024-09-12T12:23:14.635 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.636 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012993 s, 80.7 MB/s 2024-09-12T12:23:14.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.651 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012732 s, 82.4 MB/s 2024-09-12T12:23:14.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.667 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137732 s, 76.1 MB/s 2024-09-12T12:23:14.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.684 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138936 s, 75.5 MB/s 2024-09-12T12:23:14.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.700 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142815 s, 73.4 MB/s 2024-09-12T12:23:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.716 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128801 s, 81.4 MB/s 2024-09-12T12:23:14.732 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.732 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.732 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139361 s, 75.2 MB/s 2024-09-12T12:23:14.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:14.740 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:14.740 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:14.740 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.5 2024-09-12T12:23:14.740 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:14.740 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:14.740 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:14.740 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:14.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:14.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.810 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016515 s, 63.5 MB/s 2024-09-12T12:23:14.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.826 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013277 s, 79.0 MB/s 2024-09-12T12:23:14.841 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.841 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.841 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013058 s, 80.3 MB/s 2024-09-12T12:23:14.857 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.857 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.857 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132881 s, 78.9 MB/s 2024-09-12T12:23:14.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.877 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172546 s, 60.8 MB/s 2024-09-12T12:23:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.894 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138894 s, 75.5 MB/s 2024-09-12T12:23:14.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.913 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133176 s, 78.7 MB/s 2024-09-12T12:23:14.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.925 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129277 s, 81.1 MB/s 2024-09-12T12:23:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131686 s, 79.6 MB/s 2024-09-12T12:23:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141705 s, 74.0 MB/s 2024-09-12T12:23:14.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.977 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167523 s, 62.6 MB/s 2024-09-12T12:23:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:14.994 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146976 s, 71.3 MB/s 2024-09-12T12:23:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.014 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164874 s, 63.6 MB/s 2024-09-12T12:23:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.030 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144513 s, 72.6 MB/s 2024-09-12T12:23:15.046 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.046 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.046 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135339 s, 77.5 MB/s 2024-09-12T12:23:15.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.062 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127646 s, 82.1 MB/s 2024-09-12T12:23:15.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131437 s, 79.8 MB/s 2024-09-12T12:23:15.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.095 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145542 s, 72.0 MB/s 2024-09-12T12:23:15.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.113 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155119 s, 67.6 MB/s 2024-09-12T12:23:15.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.129 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130654 s, 80.3 MB/s 2024-09-12T12:23:15.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.146 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146531 s, 71.6 MB/s 2024-09-12T12:23:15.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.163 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.163 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145847 s, 71.9 MB/s 2024-09-12T12:23:15.182 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.182 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.182 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163554 s, 64.1 MB/s 2024-09-12T12:23:15.198 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.199 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142352 s, 73.7 MB/s 2024-09-12T12:23:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.214 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127824 s, 82.0 MB/s 2024-09-12T12:23:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.231 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137872 s, 76.1 MB/s 2024-09-12T12:23:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.246 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.247 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013272 s, 79.0 MB/s 2024-09-12T12:23:15.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.266 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171851 s, 61.0 MB/s 2024-09-12T12:23:15.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.282 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129489 s, 81.0 MB/s 2024-09-12T12:23:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157296 s, 66.7 MB/s 2024-09-12T12:23:15.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.319 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161122 s, 65.1 MB/s 2024-09-12T12:23:15.335 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.336 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138541 s, 75.7 MB/s 2024-09-12T12:23:15.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:15.343 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:15.343 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:15.343 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.6 2024-09-12T12:23:15.343 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:15.343 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:15.344 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:15.344 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:15.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143844 s, 72.9 MB/s 2024-09-12T12:23:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131399 s, 79.8 MB/s 2024-09-12T12:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.443 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134647 s, 77.9 MB/s 2024-09-12T12:23:15.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.458 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129551 s, 80.9 MB/s 2024-09-12T12:23:15.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.473 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127014 s, 82.6 MB/s 2024-09-12T12:23:15.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140333 s, 74.7 MB/s 2024-09-12T12:23:15.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.506 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133841 s, 78.3 MB/s 2024-09-12T12:23:15.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.524 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158199 s, 66.3 MB/s 2024-09-12T12:23:15.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.541 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141481 s, 74.1 MB/s 2024-09-12T12:23:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141802 s, 73.9 MB/s 2024-09-12T12:23:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142156 s, 73.8 MB/s 2024-09-12T12:23:15.591 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.591 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.591 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139165 s, 75.3 MB/s 2024-09-12T12:23:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.607 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132408 s, 79.2 MB/s 2024-09-12T12:23:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.624 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140041 s, 74.9 MB/s 2024-09-12T12:23:15.639 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.640 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132326 s, 79.2 MB/s 2024-09-12T12:23:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.655 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.656 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131858 s, 79.5 MB/s 2024-09-12T12:23:15.671 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.671 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.671 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131352 s, 79.8 MB/s 2024-09-12T12:23:15.687 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.687 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.687 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132558 s, 79.1 MB/s 2024-09-12T12:23:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143284 s, 73.2 MB/s 2024-09-12T12:23:15.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.721 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146358 s, 71.6 MB/s 2024-09-12T12:23:15.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.738 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136455 s, 76.8 MB/s 2024-09-12T12:23:15.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130632 s, 80.3 MB/s 2024-09-12T12:23:15.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.773 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153815 s, 68.2 MB/s 2024-09-12T12:23:15.790 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.790 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.790 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142628 s, 73.5 MB/s 2024-09-12T12:23:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.806 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132138 s, 79.4 MB/s 2024-09-12T12:23:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145475 s, 72.1 MB/s 2024-09-12T12:23:15.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.839 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.839 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129877 s, 80.7 MB/s 2024-09-12T12:23:15.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.858 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.858 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160551 s, 65.3 MB/s 2024-09-12T12:23:15.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.875 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138322 s, 75.8 MB/s 2024-09-12T12:23:15.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.891 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.891 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132842 s, 78.9 MB/s 2024-09-12T12:23:15.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.907 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133938 s, 78.3 MB/s 2024-09-12T12:23:15.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:15.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:15.922 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133305 s, 78.7 MB/s 2024-09-12T12:23:15.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:15.930 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:15.930 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:15.930 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.7 2024-09-12T12:23:15.930 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:15.930 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:15.930 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:15.930 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:16.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:16.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.040 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137408 s, 76.3 MB/s 2024-09-12T12:23:16.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.057 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.057 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141932 s, 73.9 MB/s 2024-09-12T12:23:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.072 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012571 s, 83.4 MB/s 2024-09-12T12:23:16.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.088 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134199 s, 78.1 MB/s 2024-09-12T12:23:16.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.107 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168227 s, 62.3 MB/s 2024-09-12T12:23:16.125 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.125 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.125 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014829 s, 70.7 MB/s 2024-09-12T12:23:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.140 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125481 s, 83.6 MB/s 2024-09-12T12:23:16.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.156 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127555 s, 82.2 MB/s 2024-09-12T12:23:16.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.171 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012876 s, 81.4 MB/s 2024-09-12T12:23:16.186 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.186 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.186 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127703 s, 82.1 MB/s 2024-09-12T12:23:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131707 s, 79.6 MB/s 2024-09-12T12:23:16.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.221 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161355 s, 65.0 MB/s 2024-09-12T12:23:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130326 s, 80.5 MB/s 2024-09-12T12:23:16.255 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.256 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.256 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161971 s, 64.7 MB/s 2024-09-12T12:23:16.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.271 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117681 s, 89.1 MB/s 2024-09-12T12:23:16.287 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.287 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.287 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145364 s, 72.1 MB/s 2024-09-12T12:23:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.304 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145155 s, 72.2 MB/s 2024-09-12T12:23:16.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.320 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.320 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013026 s, 80.5 MB/s 2024-09-12T12:23:16.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.336 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132395 s, 79.2 MB/s 2024-09-12T12:23:16.351 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.351 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.351 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128909 s, 81.3 MB/s 2024-09-12T12:23:16.367 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.367 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.367 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134648 s, 77.9 MB/s 2024-09-12T12:23:16.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.385 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143558 s, 73.0 MB/s 2024-09-12T12:23:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.402 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144007 s, 72.8 MB/s 2024-09-12T12:23:16.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.418 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138921 s, 75.5 MB/s 2024-09-12T12:23:16.434 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.434 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.434 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129984 s, 80.7 MB/s 2024-09-12T12:23:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.449 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127677 s, 82.1 MB/s 2024-09-12T12:23:16.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:23:16.462 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:23:16.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.468 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015798 s, 66.4 MB/s 2024-09-12T12:23:16.485 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.485 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.486 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144226 s, 72.7 MB/s 2024-09-12T12:23:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134471 s, 78.0 MB/s 2024-09-12T12:23:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.517 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137125 s, 76.5 MB/s 2024-09-12T12:23:16.536 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.536 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.536 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160294 s, 65.4 MB/s 2024-09-12T12:23:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129176 s, 81.2 MB/s 2024-09-12T12:23:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:16.559 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:16.559 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:16.559 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.8 2024-09-12T12:23:16.559 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:16.559 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:16.559 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:16.559 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:16.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:16.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.672 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141883 s, 73.9 MB/s 2024-09-12T12:23:16.691 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.691 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.691 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156357 s, 67.1 MB/s 2024-09-12T12:23:16.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.707 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143369 s, 73.1 MB/s 2024-09-12T12:23:16.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.721 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110626 s, 94.8 MB/s 2024-09-12T12:23:16.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.736 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125557 s, 83.5 MB/s 2024-09-12T12:23:16.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.753 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136276 s, 76.9 MB/s 2024-09-12T12:23:16.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.768 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.768 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134684 s, 77.9 MB/s 2024-09-12T12:23:16.784 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.784 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.784 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130729 s, 80.2 MB/s 2024-09-12T12:23:16.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.799 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012583 s, 83.3 MB/s 2024-09-12T12:23:16.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135127 s, 77.6 MB/s 2024-09-12T12:23:16.832 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.832 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.832 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135789 s, 77.2 MB/s 2024-09-12T12:23:16.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.847 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126444 s, 82.9 MB/s 2024-09-12T12:23:16.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.865 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153702 s, 68.2 MB/s 2024-09-12T12:23:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.881 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134402 s, 78.0 MB/s 2024-09-12T12:23:16.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.897 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128636 s, 81.5 MB/s 2024-09-12T12:23:16.912 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.912 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.912 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127754 s, 82.1 MB/s 2024-09-12T12:23:16.928 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.928 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.928 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130332 s, 80.5 MB/s 2024-09-12T12:23:16.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.945 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014623 s, 71.7 MB/s 2024-09-12T12:23:16.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.962 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014307 s, 73.3 MB/s 2024-09-12T12:23:16.978 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.978 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.978 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135354 s, 77.5 MB/s 2024-09-12T12:23:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:16.994 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123218 s, 85.1 MB/s 2024-09-12T12:23:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.011 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01448 s, 72.4 MB/s 2024-09-12T12:23:17.026 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.026 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.026 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132173 s, 79.3 MB/s 2024-09-12T12:23:17.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.042 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130107 s, 80.6 MB/s 2024-09-12T12:23:17.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.058 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.058 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133786 s, 78.4 MB/s 2024-09-12T12:23:17.076 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.076 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.076 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014936 s, 70.2 MB/s 2024-09-12T12:23:17.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.092 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.092 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140521 s, 74.6 MB/s 2024-09-12T12:23:17.108 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.108 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.108 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01323 s, 79.3 MB/s 2024-09-12T12:23:17.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.124 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.124 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131036 s, 80.0 MB/s 2024-09-12T12:23:17.139 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.139 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.139 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126607 s, 82.8 MB/s 2024-09-12T12:23:17.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.155 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012773 s, 82.1 MB/s 2024-09-12T12:23:17.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.169 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122134 s, 85.9 MB/s 2024-09-12T12:23:17.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:17.177 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:17.177 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:17.177 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.9 2024-09-12T12:23:17.177 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:17.177 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:17.177 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:17.177 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:17.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:17.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.249 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170197 s, 61.6 MB/s 2024-09-12T12:23:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.266 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159226 s, 65.9 MB/s 2024-09-12T12:23:17.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152427 s, 68.8 MB/s 2024-09-12T12:23:17.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128314 s, 81.7 MB/s 2024-09-12T12:23:17.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.315 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130076 s, 80.6 MB/s 2024-09-12T12:23:17.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.331 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.331 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012942 s, 81.0 MB/s 2024-09-12T12:23:17.347 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142685 s, 73.5 MB/s 2024-09-12T12:23:17.363 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133639 s, 78.5 MB/s 2024-09-12T12:23:17.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.379 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.379 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124811 s, 84.0 MB/s 2024-09-12T12:23:17.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.396 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140625 s, 74.6 MB/s 2024-09-12T12:23:17.412 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.412 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.412 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138449 s, 75.7 MB/s 2024-09-12T12:23:17.428 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.428 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.428 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136418 s, 76.9 MB/s 2024-09-12T12:23:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.444 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131901 s, 79.5 MB/s 2024-09-12T12:23:17.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.459 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122965 s, 85.3 MB/s 2024-09-12T12:23:17.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.473 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121632 s, 86.2 MB/s 2024-09-12T12:23:17.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.491 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146343 s, 71.7 MB/s 2024-09-12T12:23:17.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.508 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146677 s, 71.5 MB/s 2024-09-12T12:23:17.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.528 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172076 s, 60.9 MB/s 2024-09-12T12:23:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140899 s, 74.4 MB/s 2024-09-12T12:23:17.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.561 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135002 s, 77.7 MB/s 2024-09-12T12:23:17.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.578 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141414 s, 74.1 MB/s 2024-09-12T12:23:17.593 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.594 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128327 s, 81.7 MB/s 2024-09-12T12:23:17.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.609 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132709 s, 79.0 MB/s 2024-09-12T12:23:17.625 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.626 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134301 s, 78.1 MB/s 2024-09-12T12:23:17.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.642 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138741 s, 75.6 MB/s 2024-09-12T12:23:17.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.657 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012147 s, 86.3 MB/s 2024-09-12T12:23:17.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.673 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012873 s, 81.5 MB/s 2024-09-12T12:23:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170479 s, 61.5 MB/s 2024-09-12T12:23:17.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.708 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130363 s, 80.4 MB/s 2024-09-12T12:23:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.723 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126684 s, 82.8 MB/s 2024-09-12T12:23:17.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.740 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136893 s, 76.6 MB/s 2024-09-12T12:23:17.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.755 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126355 s, 83.0 MB/s 2024-09-12T12:23:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:17.763 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:17.763 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:17.763 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.10 2024-09-12T12:23:17.763 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:17.763 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:17.763 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:17.764 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:17.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:17.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.831 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140252 s, 74.8 MB/s 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.847 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131304 s, 79.9 MB/s 2024-09-12T12:23:17.864 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.865 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.865 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148019 s, 70.8 MB/s 2024-09-12T12:23:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.882 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141848 s, 73.9 MB/s 2024-09-12T12:23:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133482 s, 78.6 MB/s 2024-09-12T12:23:17.912 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.913 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125688 s, 83.4 MB/s 2024-09-12T12:23:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010913 s, 96.1 MB/s 2024-09-12T12:23:17.943 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.943 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.943 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146241 s, 71.7 MB/s 2024-09-12T12:23:17.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.959 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134405 s, 78.0 MB/s 2024-09-12T12:23:17.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.976 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013753 s, 76.2 MB/s 2024-09-12T12:23:17.994 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:17.994 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:17.994 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155045 s, 67.6 MB/s 2024-09-12T12:23:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.011 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142696 s, 73.5 MB/s 2024-09-12T12:23:18.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.028 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142826 s, 73.4 MB/s 2024-09-12T12:23:18.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.044 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.044 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132045 s, 79.4 MB/s 2024-09-12T12:23:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.060 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139706 s, 75.1 MB/s 2024-09-12T12:23:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.074 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107613 s, 97.4 MB/s 2024-09-12T12:23:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136099 s, 77.0 MB/s 2024-09-12T12:23:18.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.107 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144795 s, 72.4 MB/s 2024-09-12T12:23:18.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.127 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172069 s, 60.9 MB/s 2024-09-12T12:23:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142085 s, 73.8 MB/s 2024-09-12T12:23:18.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.161 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140595 s, 74.6 MB/s 2024-09-12T12:23:18.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.177 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131617 s, 79.7 MB/s 2024-09-12T12:23:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.194 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144613 s, 72.5 MB/s 2024-09-12T12:23:18.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.211 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144607 s, 72.5 MB/s 2024-09-12T12:23:18.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.228 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143368 s, 73.1 MB/s 2024-09-12T12:23:18.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.242 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117609 s, 89.2 MB/s 2024-09-12T12:23:18.258 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.259 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.259 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143251 s, 73.2 MB/s 2024-09-12T12:23:18.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.275 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136458 s, 76.8 MB/s 2024-09-12T12:23:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138498 s, 75.7 MB/s 2024-09-12T12:23:18.307 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.307 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.307 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136681 s, 76.7 MB/s 2024-09-12T12:23:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135667 s, 77.3 MB/s 2024-09-12T12:23:18.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.341 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143112 s, 73.3 MB/s 2024-09-12T12:23:18.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:18.348 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:18.348 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:18.348 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.11 2024-09-12T12:23:18.348 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:18.348 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:18.348 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:18.348 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.416 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142032 s, 73.8 MB/s 2024-09-12T12:23:18.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.434 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157734 s, 66.5 MB/s 2024-09-12T12:23:18.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.453 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169363 s, 61.9 MB/s 2024-09-12T12:23:18.470 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.470 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.470 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142395 s, 73.6 MB/s 2024-09-12T12:23:18.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.486 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135705 s, 77.3 MB/s 2024-09-12T12:23:18.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.506 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.507 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171459 s, 61.2 MB/s 2024-09-12T12:23:18.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.523 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139042 s, 75.4 MB/s 2024-09-12T12:23:18.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.538 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.538 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131418 s, 79.8 MB/s 2024-09-12T12:23:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.554 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.555 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135416 s, 77.4 MB/s 2024-09-12T12:23:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110122 s, 95.2 MB/s 2024-09-12T12:23:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170793 s, 61.4 MB/s 2024-09-12T12:23:18.603 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.604 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132025 s, 79.4 MB/s 2024-09-12T12:23:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.620 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142278 s, 73.7 MB/s 2024-09-12T12:23:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.638 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140672 s, 74.5 MB/s 2024-09-12T12:23:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130022 s, 80.6 MB/s 2024-09-12T12:23:18.669 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.669 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.669 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132341 s, 79.2 MB/s 2024-09-12T12:23:18.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.685 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134314 s, 78.1 MB/s 2024-09-12T12:23:18.702 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.702 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.702 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146693 s, 71.5 MB/s 2024-09-12T12:23:18.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.719 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.719 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142717 s, 73.5 MB/s 2024-09-12T12:23:18.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.736 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139753 s, 75.0 MB/s 2024-09-12T12:23:18.753 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.753 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.753 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144589 s, 72.5 MB/s 2024-09-12T12:23:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163732 s, 64.0 MB/s 2024-09-12T12:23:18.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.789 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140713 s, 74.5 MB/s 2024-09-12T12:23:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.806 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144471 s, 72.6 MB/s 2024-09-12T12:23:18.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.824 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156308 s, 67.1 MB/s 2024-09-12T12:23:18.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155506 s, 67.4 MB/s 2024-09-12T12:23:18.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.859 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131212 s, 79.9 MB/s 2024-09-12T12:23:18.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.875 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133265 s, 78.7 MB/s 2024-09-12T12:23:18.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.893 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149716 s, 70.0 MB/s 2024-09-12T12:23:18.908 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.908 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.908 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125407 s, 83.6 MB/s 2024-09-12T12:23:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014194 s, 73.9 MB/s 2024-09-12T12:23:18.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139891 s, 75.0 MB/s 2024-09-12T12:23:18.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:18.949 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:18.949 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:18.949 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.12 2024-09-12T12:23:18.949 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:18.949 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:18.949 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:18.949 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:19.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:19.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.084 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148776 s, 70.5 MB/s 2024-09-12T12:23:19.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.102 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163604 s, 64.1 MB/s 2024-09-12T12:23:19.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.119 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014297 s, 73.3 MB/s 2024-09-12T12:23:19.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.138 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144725 s, 72.5 MB/s 2024-09-12T12:23:19.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.154 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129614 s, 80.9 MB/s 2024-09-12T12:23:19.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.169 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130579 s, 80.3 MB/s 2024-09-12T12:23:19.190 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.191 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.191 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190464 s, 55.1 MB/s 2024-09-12T12:23:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.206 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126191 s, 83.1 MB/s 2024-09-12T12:23:19.224 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.224 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.224 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156343 s, 67.1 MB/s 2024-09-12T12:23:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.241 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.242 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149441 s, 70.2 MB/s 2024-09-12T12:23:19.257 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.257 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.257 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132324 s, 79.2 MB/s 2024-09-12T12:23:19.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.273 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131669 s, 79.6 MB/s 2024-09-12T12:23:19.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.289 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138092 s, 75.9 MB/s 2024-09-12T12:23:19.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.304 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124666 s, 84.1 MB/s 2024-09-12T12:23:19.322 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.322 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.322 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152583 s, 68.7 MB/s 2024-09-12T12:23:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134637 s, 77.9 MB/s 2024-09-12T12:23:19.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.354 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137459 s, 76.3 MB/s 2024-09-12T12:23:19.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.371 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139322 s, 75.3 MB/s 2024-09-12T12:23:19.387 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.387 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.387 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142143 s, 73.8 MB/s 2024-09-12T12:23:19.404 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.404 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.404 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141757 s, 74.0 MB/s 2024-09-12T12:23:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.421 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145761 s, 71.9 MB/s 2024-09-12T12:23:19.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.441 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173474 s, 60.4 MB/s 2024-09-12T12:23:19.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.457 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.457 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128192 s, 81.8 MB/s 2024-09-12T12:23:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128785 s, 81.4 MB/s 2024-09-12T12:23:19.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.487 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126029 s, 83.2 MB/s 2024-09-12T12:23:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.503 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129728 s, 80.8 MB/s 2024-09-12T12:23:19.519 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.520 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138475 s, 75.7 MB/s 2024-09-12T12:23:19.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.537 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147608 s, 71.0 MB/s 2024-09-12T12:23:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.552 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127613 s, 82.2 MB/s 2024-09-12T12:23:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139356 s, 75.2 MB/s 2024-09-12T12:23:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.586 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142468 s, 73.6 MB/s 2024-09-12T12:23:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147351 s, 71.2 MB/s 2024-09-12T12:23:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:19.611 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:19.611 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:19.611 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.13 2024-09-12T12:23:19.611 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:19.611 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:19.611 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:19.611 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:19.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:19.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.699 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.700 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017255 s, 60.8 MB/s 2024-09-12T12:23:19.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.700 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156408 s, 67.0 MB/s 2024-09-12T12:23:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.716 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123103 s, 85.2 MB/s 2024-09-12T12:23:19.730 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.730 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.730 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129202 s, 81.2 MB/s 2024-09-12T12:23:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012697 s, 82.6 MB/s 2024-09-12T12:23:19.762 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.762 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.762 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144006 s, 72.8 MB/s 2024-09-12T12:23:19.779 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.779 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.779 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139112 s, 75.4 MB/s 2024-09-12T12:23:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142703 s, 73.5 MB/s 2024-09-12T12:23:19.814 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.814 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.815 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158026 s, 66.4 MB/s 2024-09-12T12:23:19.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.831 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137699 s, 76.1 MB/s 2024-09-12T12:23:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.846 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129136 s, 81.2 MB/s 2024-09-12T12:23:19.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.866 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01633 s, 64.2 MB/s 2024-09-12T12:23:19.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.884 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149163 s, 70.3 MB/s 2024-09-12T12:23:19.899 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.899 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012341 s, 85.0 MB/s 2024-09-12T12:23:19.915 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.915 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.915 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013407 s, 78.2 MB/s 2024-09-12T12:23:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127847 s, 82.0 MB/s 2024-09-12T12:23:19.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.948 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143566 s, 73.0 MB/s 2024-09-12T12:23:19.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.964 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136568 s, 76.8 MB/s 2024-09-12T12:23:19.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:19.984 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:19.984 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170162 s, 61.6 MB/s 2024-09-12T12:23:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.000 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133774 s, 78.4 MB/s 2024-09-12T12:23:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014037 s, 74.7 MB/s 2024-09-12T12:23:20.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.034 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142822 s, 73.4 MB/s 2024-09-12T12:23:20.054 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.054 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.054 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170754 s, 61.4 MB/s 2024-09-12T12:23:20.070 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.070 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.070 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141035 s, 74.3 MB/s 2024-09-12T12:23:20.085 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.085 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.086 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125713 s, 83.4 MB/s 2024-09-12T12:23:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127091 s, 82.5 MB/s 2024-09-12T12:23:20.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.117 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128481 s, 81.6 MB/s 2024-09-12T12:23:20.132 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.132 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.133 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132924 s, 78.9 MB/s 2024-09-12T12:23:20.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.149 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136693 s, 76.7 MB/s 2024-09-12T12:23:20.166 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.166 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.166 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142094 s, 73.8 MB/s 2024-09-12T12:23:20.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.185 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.185 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171911 s, 61.0 MB/s 2024-09-12T12:23:20.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.202 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137873 s, 76.1 MB/s 2024-09-12T12:23:20.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:20.209 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:20.209 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:20.209 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.14 2024-09-12T12:23:20.209 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:20.209 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:20.209 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:20.209 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:20.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:20.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.316 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140846 s, 74.4 MB/s 2024-09-12T12:23:20.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.332 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134314 s, 78.1 MB/s 2024-09-12T12:23:20.351 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.351 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.351 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161548 s, 64.9 MB/s 2024-09-12T12:23:20.366 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.366 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.366 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124407 s, 84.3 MB/s 2024-09-12T12:23:20.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.385 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.385 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165156 s, 63.5 MB/s 2024-09-12T12:23:20.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.402 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.402 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140051 s, 74.9 MB/s 2024-09-12T12:23:20.421 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.421 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.421 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165286 s, 63.4 MB/s 2024-09-12T12:23:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.437 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132371 s, 79.2 MB/s 2024-09-12T12:23:20.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.453 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134743 s, 77.8 MB/s 2024-09-12T12:23:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.469 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136958 s, 76.6 MB/s 2024-09-12T12:23:20.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.486 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144077 s, 72.8 MB/s 2024-09-12T12:23:20.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.503 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140515 s, 74.6 MB/s 2024-09-12T12:23:20.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.518 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129612 s, 80.9 MB/s 2024-09-12T12:23:20.533 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.534 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127496 s, 82.2 MB/s 2024-09-12T12:23:20.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.549 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129326 s, 81.1 MB/s 2024-09-12T12:23:20.564 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.565 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126395 s, 83.0 MB/s 2024-09-12T12:23:20.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.581 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132692 s, 79.0 MB/s 2024-09-12T12:23:20.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.597 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142318 s, 73.7 MB/s 2024-09-12T12:23:20.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.616 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162521 s, 64.5 MB/s 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.631 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124038 s, 84.5 MB/s 2024-09-12T12:23:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167359 s, 62.7 MB/s 2024-09-12T12:23:20.666 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.666 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.666 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012796 s, 81.9 MB/s 2024-09-12T12:23:20.682 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.682 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.682 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130513 s, 80.3 MB/s 2024-09-12T12:23:20.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.698 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133901 s, 78.3 MB/s 2024-09-12T12:23:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121407 s, 86.4 MB/s 2024-09-12T12:23:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.731 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154845 s, 67.7 MB/s 2024-09-12T12:23:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131033 s, 80.0 MB/s 2024-09-12T12:23:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.763 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141964 s, 73.9 MB/s 2024-09-12T12:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124606 s, 84.2 MB/s 2024-09-12T12:23:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.795 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013978 s, 75.0 MB/s 2024-09-12T12:23:20.813 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.813 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.813 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152544 s, 68.7 MB/s 2024-09-12T12:23:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137198 s, 76.4 MB/s 2024-09-12T12:23:20.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:20.837 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:20.837 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:20.837 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.15 2024-09-12T12:23:20.837 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:20.837 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:20.837 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:20.837 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:20.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146816 s, 71.4 MB/s 2024-09-12T12:23:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.923 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.923 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139108 s, 75.4 MB/s 2024-09-12T12:23:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.945 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188912 s, 55.5 MB/s 2024-09-12T12:23:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.961 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142192 s, 73.7 MB/s 2024-09-12T12:23:20.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.981 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170568 s, 61.5 MB/s 2024-09-12T12:23:20.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:20.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:20.998 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140809 s, 74.5 MB/s 2024-09-12T12:23:21.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.015 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143806 s, 72.9 MB/s 2024-09-12T12:23:21.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.033 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139619 s, 75.1 MB/s 2024-09-12T12:23:21.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.051 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.051 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171199 s, 61.2 MB/s 2024-09-12T12:23:21.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.066 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131674 s, 79.6 MB/s 2024-09-12T12:23:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.085 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.086 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164179 s, 63.9 MB/s 2024-09-12T12:23:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.102 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135045 s, 77.6 MB/s 2024-09-12T12:23:21.118 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.119 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143391 s, 73.1 MB/s 2024-09-12T12:23:21.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.136 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.136 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014628 s, 71.7 MB/s 2024-09-12T12:23:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143075 s, 73.3 MB/s 2024-09-12T12:23:21.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.168 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128021 s, 81.9 MB/s 2024-09-12T12:23:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.185 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130885 s, 80.1 MB/s 2024-09-12T12:23:21.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.199 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122328 s, 85.7 MB/s 2024-09-12T12:23:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.215 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129879 s, 80.7 MB/s 2024-09-12T12:23:21.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.231 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138121 s, 75.9 MB/s 2024-09-12T12:23:21.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.248 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.248 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140742 s, 74.5 MB/s 2024-09-12T12:23:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143858 s, 72.9 MB/s 2024-09-12T12:23:21.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.281 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134167 s, 78.2 MB/s 2024-09-12T12:23:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137398 s, 76.3 MB/s 2024-09-12T12:23:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.313 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132205 s, 79.3 MB/s 2024-09-12T12:23:21.329 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.330 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142524 s, 73.6 MB/s 2024-09-12T12:23:21.344 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.344 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.344 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115908 s, 90.5 MB/s 2024-09-12T12:23:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.360 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013624 s, 77.0 MB/s 2024-09-12T12:23:21.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015674 s, 66.9 MB/s 2024-09-12T12:23:21.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.395 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136184 s, 77.0 MB/s 2024-09-12T12:23:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139281 s, 75.3 MB/s 2024-09-12T12:23:21.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137177 s, 76.4 MB/s 2024-09-12T12:23:21.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:21.435 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:21.435 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:21.435 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.16 2024-09-12T12:23:21.435 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:21.435 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:21.435 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:21.435 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:21.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:21.547 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.547 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.547 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128602 s, 81.5 MB/s 2024-09-12T12:23:21.564 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.565 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150075 s, 69.9 MB/s 2024-09-12T12:23:21.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.580 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130893 s, 80.1 MB/s 2024-09-12T12:23:21.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.597 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137218 s, 76.4 MB/s 2024-09-12T12:23:21.613 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.613 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.613 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127992 s, 81.9 MB/s 2024-09-12T12:23:21.629 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.629 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.629 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134011 s, 78.2 MB/s 2024-09-12T12:23:21.645 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.645 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.645 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013133 s, 79.8 MB/s 2024-09-12T12:23:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132324 s, 79.2 MB/s 2024-09-12T12:23:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.679 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146775 s, 71.4 MB/s 2024-09-12T12:23:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.696 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141151 s, 74.3 MB/s 2024-09-12T12:23:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.714 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144298 s, 72.7 MB/s 2024-09-12T12:23:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.731 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147253 s, 71.2 MB/s 2024-09-12T12:23:21.747 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.748 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.748 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141117 s, 74.3 MB/s 2024-09-12T12:23:21.763 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.763 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.763 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133652 s, 78.5 MB/s 2024-09-12T12:23:21.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.780 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139485 s, 75.2 MB/s 2024-09-12T12:23:21.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.797 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146691 s, 71.5 MB/s 2024-09-12T12:23:21.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.811 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110487 s, 94.9 MB/s 2024-09-12T12:23:21.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.827 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139939 s, 74.9 MB/s 2024-09-12T12:23:21.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.842 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123772 s, 84.7 MB/s 2024-09-12T12:23:21.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.860 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147725 s, 71.0 MB/s 2024-09-12T12:23:21.876 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.877 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138201 s, 75.9 MB/s 2024-09-12T12:23:21.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152238 s, 68.9 MB/s 2024-09-12T12:23:21.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.912 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132028 s, 79.4 MB/s 2024-09-12T12:23:21.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.931 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167328 s, 62.7 MB/s 2024-09-12T12:23:21.950 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.951 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172362 s, 60.8 MB/s 2024-09-12T12:23:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.967 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135408 s, 77.4 MB/s 2024-09-12T12:23:21.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.983 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137891 s, 76.0 MB/s 2024-09-12T12:23:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135507 s, 77.4 MB/s 2024-09-12T12:23:22.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.015 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126847 s, 82.7 MB/s 2024-09-12T12:23:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127414 s, 82.3 MB/s 2024-09-12T12:23:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.047 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145556 s, 72.0 MB/s 2024-09-12T12:23:22.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.063 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125671 s, 83.4 MB/s 2024-09-12T12:23:22.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:22.070 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:22.070 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:22.070 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.17 2024-09-12T12:23:22.070 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:22.070 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:22.070 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:22.071 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:22.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:22.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.137 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.137 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140759 s, 74.5 MB/s 2024-09-12T12:23:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144696 s, 72.5 MB/s 2024-09-12T12:23:22.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.169 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.169 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123557 s, 84.9 MB/s 2024-09-12T12:23:22.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015235 s, 68.8 MB/s 2024-09-12T12:23:22.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.204 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.204 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138641 s, 75.6 MB/s 2024-09-12T12:23:22.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.220 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138008 s, 76.0 MB/s 2024-09-12T12:23:22.236 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.237 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013762 s, 76.2 MB/s 2024-09-12T12:23:22.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.253 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138387 s, 75.8 MB/s 2024-09-12T12:23:22.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.270 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148113 s, 70.8 MB/s 2024-09-12T12:23:22.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.288 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153001 s, 68.5 MB/s 2024-09-12T12:23:22.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.305 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144396 s, 72.6 MB/s 2024-09-12T12:23:22.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.322 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140425 s, 74.7 MB/s 2024-09-12T12:23:22.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.341 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168251 s, 62.3 MB/s 2024-09-12T12:23:22.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.356 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127848 s, 82.0 MB/s 2024-09-12T12:23:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.373 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139403 s, 75.2 MB/s 2024-09-12T12:23:22.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.388 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125384 s, 83.6 MB/s 2024-09-12T12:23:22.405 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.406 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.406 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150213 s, 69.8 MB/s 2024-09-12T12:23:22.422 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.422 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.423 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142309 s, 73.7 MB/s 2024-09-12T12:23:22.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.438 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133613 s, 78.5 MB/s 2024-09-12T12:23:22.455 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.455 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.455 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142668 s, 73.5 MB/s 2024-09-12T12:23:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136878 s, 76.6 MB/s 2024-09-12T12:23:22.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.491 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163959 s, 64.0 MB/s 2024-09-12T12:23:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.507 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140823 s, 74.5 MB/s 2024-09-12T12:23:22.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.523 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133297 s, 78.7 MB/s 2024-09-12T12:23:22.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.540 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141598 s, 74.1 MB/s 2024-09-12T12:23:22.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.556 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139125 s, 75.4 MB/s 2024-09-12T12:23:22.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.573 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014152 s, 74.1 MB/s 2024-09-12T12:23:22.593 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.593 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.593 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174896 s, 60.0 MB/s 2024-09-12T12:23:22.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.609 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130383 s, 80.4 MB/s 2024-09-12T12:23:22.625 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.625 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.625 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136522 s, 76.8 MB/s 2024-09-12T12:23:22.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.643 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145944 s, 71.8 MB/s 2024-09-12T12:23:22.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.658 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126819 s, 82.7 MB/s 2024-09-12T12:23:22.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:22.667 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:22.667 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:22.667 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.18 2024-09-12T12:23:22.667 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:22.667 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:22.667 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:22.667 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:22.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:22.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.777 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150591 s, 69.6 MB/s 2024-09-12T12:23:22.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.797 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169762 s, 61.8 MB/s 2024-09-12T12:23:22.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.812 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012505 s, 83.9 MB/s 2024-09-12T12:23:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.830 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152031 s, 69.0 MB/s 2024-09-12T12:23:22.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.847 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144096 s, 72.8 MB/s 2024-09-12T12:23:22.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.862 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126777 s, 82.7 MB/s 2024-09-12T12:23:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.880 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146975 s, 71.3 MB/s 2024-09-12T12:23:22.896 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.897 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01417 s, 74.0 MB/s 2024-09-12T12:23:22.915 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.916 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016022 s, 65.4 MB/s 2024-09-12T12:23:22.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.931 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012567 s, 83.4 MB/s 2024-09-12T12:23:22.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.947 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132612 s, 79.1 MB/s 2024-09-12T12:23:22.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.963 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135514 s, 77.4 MB/s 2024-09-12T12:23:22.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.982 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164526 s, 63.7 MB/s 2024-09-12T12:23:22.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:22.999 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138415 s, 75.8 MB/s 2024-09-12T12:23:23.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.015 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136681 s, 76.7 MB/s 2024-09-12T12:23:23.031 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.032 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137715 s, 76.1 MB/s 2024-09-12T12:23:23.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144695 s, 72.5 MB/s 2024-09-12T12:23:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.066 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137418 s, 76.3 MB/s 2024-09-12T12:23:23.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.084 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144687 s, 72.5 MB/s 2024-09-12T12:23:23.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.099 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123099 s, 85.2 MB/s 2024-09-12T12:23:23.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.119 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.119 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171535 s, 61.1 MB/s 2024-09-12T12:23:23.135 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.135 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.136 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133411 s, 78.6 MB/s 2024-09-12T12:23:23.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.152 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.152 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136335 s, 76.9 MB/s 2024-09-12T12:23:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.166 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.167 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122809 s, 85.4 MB/s 2024-09-12T12:23:23.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.183 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138167 s, 75.9 MB/s 2024-09-12T12:23:23.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.199 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134743 s, 77.8 MB/s 2024-09-12T12:23:23.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170525 s, 61.5 MB/s 2024-09-12T12:23:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.238 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167812 s, 62.5 MB/s 2024-09-12T12:23:23.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.253 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125311 s, 83.7 MB/s 2024-09-12T12:23:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140577 s, 74.6 MB/s 2024-09-12T12:23:23.286 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.286 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.286 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136571 s, 76.8 MB/s 2024-09-12T12:23:23.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.302 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134826 s, 77.8 MB/s 2024-09-12T12:23:23.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:23.310 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:23.310 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:23.311 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.19 2024-09-12T12:23:23.311 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:23.311 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:23.311 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:23.311 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:23.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:23.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136117 s, 77.0 MB/s 2024-09-12T12:23:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.395 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143864 s, 72.9 MB/s 2024-09-12T12:23:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.412 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141587 s, 74.1 MB/s 2024-09-12T12:23:23.428 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.428 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.429 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136549 s, 76.8 MB/s 2024-09-12T12:23:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.446 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143078 s, 73.3 MB/s 2024-09-12T12:23:23.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.462 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.462 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136536 s, 76.8 MB/s 2024-09-12T12:23:23.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.479 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139174 s, 75.3 MB/s 2024-09-12T12:23:23.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.495 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135943 s, 77.1 MB/s 2024-09-12T12:23:23.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.512 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140629 s, 74.6 MB/s 2024-09-12T12:23:23.527 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.527 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.527 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121328 s, 86.4 MB/s 2024-09-12T12:23:23.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.546 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.546 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016602 s, 63.2 MB/s 2024-09-12T12:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.565 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151903 s, 69.0 MB/s 2024-09-12T12:23:23.579 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.580 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.580 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126033 s, 83.2 MB/s 2024-09-12T12:23:23.598 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.598 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.598 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149958 s, 69.9 MB/s 2024-09-12T12:23:23.614 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140301 s, 74.7 MB/s 2024-09-12T12:23:23.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.631 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139552 s, 75.1 MB/s 2024-09-12T12:23:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.648 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140205 s, 74.8 MB/s 2024-09-12T12:23:23.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.663 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132142 s, 79.4 MB/s 2024-09-12T12:23:23.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.679 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128761 s, 81.4 MB/s 2024-09-12T12:23:23.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.696 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142155 s, 73.8 MB/s 2024-09-12T12:23:23.710 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.710 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.711 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117978 s, 88.9 MB/s 2024-09-12T12:23:23.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.727 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143974 s, 72.8 MB/s 2024-09-12T12:23:23.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.743 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133502 s, 78.5 MB/s 2024-09-12T12:23:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142435 s, 73.6 MB/s 2024-09-12T12:23:23.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.777 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139689 s, 75.1 MB/s 2024-09-12T12:23:23.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01319 s, 79.5 MB/s 2024-09-12T12:23:23.810 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.810 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.810 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01429 s, 73.4 MB/s 2024-09-12T12:23:23.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.826 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130567 s, 80.3 MB/s 2024-09-12T12:23:23.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142345 s, 73.7 MB/s 2024-09-12T12:23:23.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.859 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013633 s, 76.9 MB/s 2024-09-12T12:23:23.876 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.876 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.876 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134622 s, 77.9 MB/s 2024-09-12T12:23:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149544 s, 70.1 MB/s 2024-09-12T12:23:23.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:23.901 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:23.901 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:23.901 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.20 2024-09-12T12:23:23.901 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:23.901 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:23.901 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:23.901 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:23.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:24.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.012 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152515 s, 68.8 MB/s 2024-09-12T12:23:24.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.033 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.033 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017772 s, 59.0 MB/s 2024-09-12T12:23:24.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.050 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140624 s, 74.6 MB/s 2024-09-12T12:23:24.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.068 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159896 s, 65.6 MB/s 2024-09-12T12:23:24.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.086 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.086 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146883 s, 71.4 MB/s 2024-09-12T12:23:24.103 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.103 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.103 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141399 s, 74.2 MB/s 2024-09-12T12:23:24.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.118 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.118 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125046 s, 83.9 MB/s 2024-09-12T12:23:24.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.134 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.134 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132389 s, 79.2 MB/s 2024-09-12T12:23:24.150 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.150 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.150 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142097 s, 73.8 MB/s 2024-09-12T12:23:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.166 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013299 s, 78.8 MB/s 2024-09-12T12:23:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138011 s, 76.0 MB/s 2024-09-12T12:23:24.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.199 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139034 s, 75.4 MB/s 2024-09-12T12:23:24.217 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.217 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.217 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153638 s, 68.2 MB/s 2024-09-12T12:23:24.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.234 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014524 s, 72.2 MB/s 2024-09-12T12:23:24.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.251 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138497 s, 75.7 MB/s 2024-09-12T12:23:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.267 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137045 s, 76.5 MB/s 2024-09-12T12:23:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145116 s, 72.3 MB/s 2024-09-12T12:23:24.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.304 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173844 s, 60.3 MB/s 2024-09-12T12:23:24.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.321 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.322 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143845 s, 72.9 MB/s 2024-09-12T12:23:24.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.338 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014441 s, 72.6 MB/s 2024-09-12T12:23:24.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.355 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134633 s, 77.9 MB/s 2024-09-12T12:23:24.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.371 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140046 s, 74.9 MB/s 2024-09-12T12:23:24.387 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.387 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.387 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133421 s, 78.6 MB/s 2024-09-12T12:23:24.407 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.407 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.407 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174241 s, 60.2 MB/s 2024-09-12T12:23:24.423 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.423 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.423 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133463 s, 78.6 MB/s 2024-09-12T12:23:24.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.438 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126237 s, 83.1 MB/s 2024-09-12T12:23:24.455 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.455 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.455 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147135 s, 71.3 MB/s 2024-09-12T12:23:24.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.475 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168057 s, 62.4 MB/s 2024-09-12T12:23:24.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.491 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.491 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013142 s, 79.8 MB/s 2024-09-12T12:23:24.510 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.510 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.511 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171801 s, 61.0 MB/s 2024-09-12T12:23:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.528 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147172 s, 71.2 MB/s 2024-09-12T12:23:24.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145032 s, 72.3 MB/s 2024-09-12T12:23:24.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:24.552 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:24.552 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:24.553 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.21 2024-09-12T12:23:24.553 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:24.553 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:24.553 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:24.553 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:24.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:24.619 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.619 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.619 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140049 s, 74.9 MB/s 2024-09-12T12:23:24.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.636 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.636 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141819 s, 73.9 MB/s 2024-09-12T12:23:24.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.651 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.652 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129622 s, 80.9 MB/s 2024-09-12T12:23:24.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.668 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140805 s, 74.5 MB/s 2024-09-12T12:23:24.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.685 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139475 s, 75.2 MB/s 2024-09-12T12:23:24.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.701 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132941 s, 78.9 MB/s 2024-09-12T12:23:24.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.717 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134031 s, 78.2 MB/s 2024-09-12T12:23:24.732 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.733 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.733 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135956 s, 77.1 MB/s 2024-09-12T12:23:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012658 s, 82.8 MB/s 2024-09-12T12:23:24.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.764 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131992 s, 79.4 MB/s 2024-09-12T12:23:24.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.780 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138715 s, 75.6 MB/s 2024-09-12T12:23:24.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.797 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138914 s, 75.5 MB/s 2024-09-12T12:23:24.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.813 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130759 s, 80.2 MB/s 2024-09-12T12:23:24.828 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.829 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133198 s, 78.7 MB/s 2024-09-12T12:23:24.844 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.844 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.844 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130623 s, 80.3 MB/s 2024-09-12T12:23:24.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.860 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131979 s, 79.5 MB/s 2024-09-12T12:23:24.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.877 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145054 s, 72.3 MB/s 2024-09-12T12:23:24.896 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.896 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.896 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159624 s, 65.7 MB/s 2024-09-12T12:23:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.913 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145277 s, 72.2 MB/s 2024-09-12T12:23:24.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.930 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141069 s, 74.3 MB/s 2024-09-12T12:23:24.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.947 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141198 s, 74.3 MB/s 2024-09-12T12:23:24.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.963 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014365 s, 73.0 MB/s 2024-09-12T12:23:24.979 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.979 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.979 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135592 s, 77.3 MB/s 2024-09-12T12:23:24.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:24.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:24.997 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152023 s, 69.0 MB/s 2024-09-12T12:23:25.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.015 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015097 s, 69.5 MB/s 2024-09-12T12:23:25.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.032 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141293 s, 74.2 MB/s 2024-09-12T12:23:25.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.048 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138896 s, 75.5 MB/s 2024-09-12T12:23:25.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.065 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139964 s, 74.9 MB/s 2024-09-12T12:23:25.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.081 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138143 s, 75.9 MB/s 2024-09-12T12:23:25.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134768 s, 77.8 MB/s 2024-09-12T12:23:25.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.114 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140604 s, 74.6 MB/s 2024-09-12T12:23:25.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.129 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131652 s, 79.6 MB/s 2024-09-12T12:23:25.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:25.137 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:25.137 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:25.137 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.22 2024-09-12T12:23:25.137 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:25.137 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:25.137 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:25.137 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:25.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:25.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.245 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142826 s, 73.4 MB/s 2024-09-12T12:23:25.263 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.263 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.263 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156746 s, 66.9 MB/s 2024-09-12T12:23:25.278 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.278 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.278 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127999 s, 81.9 MB/s 2024-09-12T12:23:25.295 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.295 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.295 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142875 s, 73.4 MB/s 2024-09-12T12:23:25.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.313 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129817 s, 80.8 MB/s 2024-09-12T12:23:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128896 s, 81.4 MB/s 2024-09-12T12:23:25.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.342 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135243 s, 77.5 MB/s 2024-09-12T12:23:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.358 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135939 s, 77.1 MB/s 2024-09-12T12:23:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.374 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129573 s, 80.9 MB/s 2024-09-12T12:23:25.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.390 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130943 s, 80.1 MB/s 2024-09-12T12:23:25.406 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.406 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.406 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139465 s, 75.2 MB/s 2024-09-12T12:23:25.421 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.421 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.421 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126877 s, 82.6 MB/s 2024-09-12T12:23:25.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.436 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.436 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117437 s, 89.3 MB/s 2024-09-12T12:23:25.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.456 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174261 s, 60.2 MB/s 2024-09-12T12:23:25.471 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.471 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.471 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125174 s, 83.8 MB/s 2024-09-12T12:23:25.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.487 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137818 s, 76.1 MB/s 2024-09-12T12:23:25.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.505 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014859 s, 70.6 MB/s 2024-09-12T12:23:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130928 s, 80.1 MB/s 2024-09-12T12:23:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136984 s, 76.5 MB/s 2024-09-12T12:23:25.554 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.554 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.554 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141414 s, 74.1 MB/s 2024-09-12T12:23:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.571 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144134 s, 72.8 MB/s 2024-09-12T12:23:25.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.586 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125154 s, 83.8 MB/s 2024-09-12T12:23:25.603 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.603 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.603 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141363 s, 74.2 MB/s 2024-09-12T12:23:25.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.620 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144754 s, 72.4 MB/s 2024-09-12T12:23:25.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.634 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113702 s, 92.2 MB/s 2024-09-12T12:23:25.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.653 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165652 s, 63.3 MB/s 2024-09-12T12:23:25.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.668 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012533 s, 83.7 MB/s 2024-09-12T12:23:25.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.685 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.686 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146544 s, 71.6 MB/s 2024-09-12T12:23:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.702 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141022 s, 74.4 MB/s 2024-09-12T12:23:25.718 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.718 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.718 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132378 s, 79.2 MB/s 2024-09-12T12:23:25.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.735 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145219 s, 72.2 MB/s 2024-09-12T12:23:25.751 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135319 s, 77.5 MB/s 2024-09-12T12:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:25.759 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:25.759 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:25.759 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.23 2024-09-12T12:23:25.759 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:25.760 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:25.760 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:25.760 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:25.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.827 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138063 s, 75.9 MB/s 2024-09-12T12:23:25.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.842 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013163 s, 79.7 MB/s 2024-09-12T12:23:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.859 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135348 s, 77.5 MB/s 2024-09-12T12:23:25.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.879 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.879 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174244 s, 60.2 MB/s 2024-09-12T12:23:25.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.895 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014182 s, 73.9 MB/s 2024-09-12T12:23:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.911 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127785 s, 82.1 MB/s 2024-09-12T12:23:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141389 s, 74.2 MB/s 2024-09-12T12:23:25.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.944 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.944 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137448 s, 76.3 MB/s 2024-09-12T12:23:25.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.961 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139249 s, 75.3 MB/s 2024-09-12T12:23:25.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.976 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128822 s, 81.4 MB/s 2024-09-12T12:23:25.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:25.994 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:25.994 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146629 s, 71.5 MB/s 2024-09-12T12:23:26.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.009 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123127 s, 85.2 MB/s 2024-09-12T12:23:26.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.024 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129403 s, 81.0 MB/s 2024-09-12T12:23:26.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.039 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.040 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012578 s, 83.4 MB/s 2024-09-12T12:23:26.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.057 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013781 s, 76.1 MB/s 2024-09-12T12:23:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143536 s, 73.1 MB/s 2024-09-12T12:23:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141505 s, 74.1 MB/s 2024-09-12T12:23:26.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.107 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143034 s, 73.3 MB/s 2024-09-12T12:23:26.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.123 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139552 s, 75.1 MB/s 2024-09-12T12:23:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.141 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.141 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142473 s, 73.6 MB/s 2024-09-12T12:23:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.157 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.158 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144017 s, 72.8 MB/s 2024-09-12T12:23:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.177 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171168 s, 61.3 MB/s 2024-09-12T12:23:26.192 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.193 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127671 s, 82.1 MB/s 2024-09-12T12:23:26.208 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.208 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.209 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132282 s, 79.3 MB/s 2024-09-12T12:23:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168634 s, 62.2 MB/s 2024-09-12T12:23:26.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.244 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132153 s, 79.3 MB/s 2024-09-12T12:23:26.261 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.261 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.261 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144279 s, 72.7 MB/s 2024-09-12T12:23:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.280 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164241 s, 63.8 MB/s 2024-09-12T12:23:26.297 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.297 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.297 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013633 s, 76.9 MB/s 2024-09-12T12:23:26.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.314 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.314 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139153 s, 75.4 MB/s 2024-09-12T12:23:26.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.331 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142121 s, 73.8 MB/s 2024-09-12T12:23:26.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146169 s, 71.7 MB/s 2024-09-12T12:23:26.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:26.355 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:26.355 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:26.355 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.24 2024-09-12T12:23:26.355 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:26.356 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:26.356 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:26.356 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:26.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.422 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131999 s, 79.4 MB/s 2024-09-12T12:23:26.439 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.439 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.439 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137895 s, 76.0 MB/s 2024-09-12T12:23:26.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.458 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167221 s, 62.7 MB/s 2024-09-12T12:23:26.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.474 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.475 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141532 s, 74.1 MB/s 2024-09-12T12:23:26.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124498 s, 84.2 MB/s 2024-09-12T12:23:26.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.509 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170698 s, 61.4 MB/s 2024-09-12T12:23:26.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.526 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128776 s, 81.4 MB/s 2024-09-12T12:23:26.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136476 s, 76.8 MB/s 2024-09-12T12:23:26.560 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.560 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.560 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014435 s, 72.6 MB/s 2024-09-12T12:23:26.574 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.574 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.574 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115343 s, 90.9 MB/s 2024-09-12T12:23:26.589 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.590 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.590 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130258 s, 80.5 MB/s 2024-09-12T12:23:26.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.606 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136389 s, 76.9 MB/s 2024-09-12T12:23:26.623 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.623 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.623 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144464 s, 72.6 MB/s 2024-09-12T12:23:26.641 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.641 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.642 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159464 s, 65.8 MB/s 2024-09-12T12:23:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.658 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134482 s, 78.0 MB/s 2024-09-12T12:23:26.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.674 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131107 s, 80.0 MB/s 2024-09-12T12:23:26.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.689 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124379 s, 84.3 MB/s 2024-09-12T12:23:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.706 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147657 s, 71.0 MB/s 2024-09-12T12:23:26.722 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.722 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.722 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131223 s, 79.9 MB/s 2024-09-12T12:23:26.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.738 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133079 s, 78.8 MB/s 2024-09-12T12:23:26.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141304 s, 74.2 MB/s 2024-09-12T12:23:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134001 s, 78.3 MB/s 2024-09-12T12:23:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144988 s, 72.3 MB/s 2024-09-12T12:23:26.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.803 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131384 s, 79.8 MB/s 2024-09-12T12:23:26.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133299 s, 78.7 MB/s 2024-09-12T12:23:26.840 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.840 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.840 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181795 s, 57.7 MB/s 2024-09-12T12:23:26.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.856 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124704 s, 84.1 MB/s 2024-09-12T12:23:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.871 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128992 s, 81.3 MB/s 2024-09-12T12:23:26.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.888 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142483 s, 73.6 MB/s 2024-09-12T12:23:26.905 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.905 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.906 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143287 s, 73.2 MB/s 2024-09-12T12:23:26.921 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.922 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013394 s, 78.3 MB/s 2024-09-12T12:23:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130419 s, 80.4 MB/s 2024-09-12T12:23:26.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:26.945 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:26.945 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:26.945 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.25 2024-09-12T12:23:26.945 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:26.945 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:26.945 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:26.945 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:26.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:27.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.013 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148301 s, 70.7 MB/s 2024-09-12T12:23:27.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.028 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131237 s, 79.9 MB/s 2024-09-12T12:23:27.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.043 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115326 s, 90.9 MB/s 2024-09-12T12:23:27.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.060 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.060 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146666 s, 71.5 MB/s 2024-09-12T12:23:27.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.077 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014523 s, 72.2 MB/s 2024-09-12T12:23:27.093 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.094 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142601 s, 73.5 MB/s 2024-09-12T12:23:27.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.113 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164154 s, 63.9 MB/s 2024-09-12T12:23:27.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.129 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138108 s, 75.9 MB/s 2024-09-12T12:23:27.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.146 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138764 s, 75.6 MB/s 2024-09-12T12:23:27.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.161 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131932 s, 79.5 MB/s 2024-09-12T12:23:27.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.178 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138052 s, 76.0 MB/s 2024-09-12T12:23:27.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.193 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012876 s, 81.4 MB/s 2024-09-12T12:23:27.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.210 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138268 s, 75.8 MB/s 2024-09-12T12:23:27.225 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.226 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.226 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135259 s, 77.5 MB/s 2024-09-12T12:23:27.245 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.245 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.245 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167773 s, 62.5 MB/s 2024-09-12T12:23:27.261 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.261 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.261 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131439 s, 79.8 MB/s 2024-09-12T12:23:27.278 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.278 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.278 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143891 s, 72.9 MB/s 2024-09-12T12:23:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120962 s, 86.7 MB/s 2024-09-12T12:23:27.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.308 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129367 s, 81.1 MB/s 2024-09-12T12:23:27.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.329 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014352 s, 73.1 MB/s 2024-09-12T12:23:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.343 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147641 s, 71.0 MB/s 2024-09-12T12:23:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137791 s, 76.1 MB/s 2024-09-12T12:23:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.375 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133966 s, 78.3 MB/s 2024-09-12T12:23:27.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.395 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169094 s, 62.0 MB/s 2024-09-12T12:23:27.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.411 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132857 s, 78.9 MB/s 2024-09-12T12:23:27.428 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.428 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.428 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145771 s, 71.9 MB/s 2024-09-12T12:23:27.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.443 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126581 s, 82.8 MB/s 2024-09-12T12:23:27.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.460 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144166 s, 72.7 MB/s 2024-09-12T12:23:27.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.480 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.480 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166494 s, 63.0 MB/s 2024-09-12T12:23:27.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.499 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.499 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168932 s, 62.1 MB/s 2024-09-12T12:23:27.516 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.517 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.517 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145213 s, 72.2 MB/s 2024-09-12T12:23:27.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.532 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130305 s, 80.5 MB/s 2024-09-12T12:23:27.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:27.539 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:27.540 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:27.540 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.26 2024-09-12T12:23:27.540 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:27.540 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:27.540 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:27.540 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:27.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:27.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.609 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149898 s, 70.0 MB/s 2024-09-12T12:23:27.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.627 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149389 s, 70.2 MB/s 2024-09-12T12:23:27.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.644 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140556 s, 74.6 MB/s 2024-09-12T12:23:27.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.664 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.664 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017651 s, 59.4 MB/s 2024-09-12T12:23:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.683 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166404 s, 63.0 MB/s 2024-09-12T12:23:27.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.700 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145781 s, 71.9 MB/s 2024-09-12T12:23:27.716 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.717 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.717 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140101 s, 74.8 MB/s 2024-09-12T12:23:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136019 s, 77.1 MB/s 2024-09-12T12:23:27.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.749 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136018 s, 77.1 MB/s 2024-09-12T12:23:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.766 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145029 s, 72.3 MB/s 2024-09-12T12:23:27.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.782 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132063 s, 79.4 MB/s 2024-09-12T12:23:27.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.799 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.799 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139987 s, 74.9 MB/s 2024-09-12T12:23:27.814 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.815 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.815 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133371 s, 78.6 MB/s 2024-09-12T12:23:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134437 s, 78.0 MB/s 2024-09-12T12:23:27.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.848 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.848 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148129 s, 70.8 MB/s 2024-09-12T12:23:27.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.866 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148672 s, 70.5 MB/s 2024-09-12T12:23:27.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.884 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150331 s, 69.8 MB/s 2024-09-12T12:23:27.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.901 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142693 s, 73.5 MB/s 2024-09-12T12:23:27.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.916 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130218 s, 80.5 MB/s 2024-09-12T12:23:27.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.933 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140394 s, 74.7 MB/s 2024-09-12T12:23:27.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.948 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126063 s, 83.2 MB/s 2024-09-12T12:23:27.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.964 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134204 s, 78.1 MB/s 2024-09-12T12:23:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.981 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01425 s, 73.6 MB/s 2024-09-12T12:23:27.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:27.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:27.997 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132106 s, 79.4 MB/s 2024-09-12T12:23:28.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.014 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137253 s, 76.4 MB/s 2024-09-12T12:23:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014248 s, 73.6 MB/s 2024-09-12T12:23:28.047 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.048 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146196 s, 71.7 MB/s 2024-09-12T12:23:28.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.065 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144746 s, 72.4 MB/s 2024-09-12T12:23:28.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.081 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138339 s, 75.8 MB/s 2024-09-12T12:23:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013332 s, 78.7 MB/s 2024-09-12T12:23:28.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.114 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137289 s, 76.4 MB/s 2024-09-12T12:23:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.130 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139335 s, 75.3 MB/s 2024-09-12T12:23:28.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:28.138 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:28.138 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:28.138 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.27 2024-09-12T12:23:28.138 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:28.139 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:28.139 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:28.139 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:28.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133447 s, 78.6 MB/s 2024-09-12T12:23:28.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.221 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129389 s, 81.0 MB/s 2024-09-12T12:23:28.236 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.236 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.236 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125687 s, 83.4 MB/s 2024-09-12T12:23:28.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.254 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01509 s, 69.5 MB/s 2024-09-12T12:23:28.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.273 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163767 s, 64.0 MB/s 2024-09-12T12:23:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.289 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139877 s, 75.0 MB/s 2024-09-12T12:23:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.307 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153597 s, 68.3 MB/s 2024-09-12T12:23:28.327 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.327 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.327 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170423 s, 61.5 MB/s 2024-09-12T12:23:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.341 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110851 s, 94.6 MB/s 2024-09-12T12:23:28.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.356 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128649 s, 81.5 MB/s 2024-09-12T12:23:28.375 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.376 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170436 s, 61.5 MB/s 2024-09-12T12:23:28.391 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.391 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.391 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012931 s, 81.1 MB/s 2024-09-12T12:23:28.408 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.408 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.408 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144067 s, 72.8 MB/s 2024-09-12T12:23:28.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155912 s, 67.3 MB/s 2024-09-12T12:23:28.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.443 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013974 s, 75.0 MB/s 2024-09-12T12:23:28.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.460 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142908 s, 73.4 MB/s 2024-09-12T12:23:28.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.475 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.475 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126768 s, 82.7 MB/s 2024-09-12T12:23:28.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.492 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013854 s, 75.7 MB/s 2024-09-12T12:23:28.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.508 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137475 s, 76.3 MB/s 2024-09-12T12:23:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.524 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.525 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132697 s, 79.0 MB/s 2024-09-12T12:23:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.539 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125881 s, 83.3 MB/s 2024-09-12T12:23:28.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.556 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137973 s, 76.0 MB/s 2024-09-12T12:23:28.571 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.572 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013196 s, 79.5 MB/s 2024-09-12T12:23:28.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.588 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138667 s, 75.6 MB/s 2024-09-12T12:23:28.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.605 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141554 s, 74.1 MB/s 2024-09-12T12:23:28.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.622 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014299 s, 73.3 MB/s 2024-09-12T12:23:28.638 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.638 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.638 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133581 s, 78.5 MB/s 2024-09-12T12:23:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.652 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111137 s, 94.3 MB/s 2024-09-12T12:23:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136908 s, 76.6 MB/s 2024-09-12T12:23:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.684 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128711 s, 81.5 MB/s 2024-09-12T12:23:28.703 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.704 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170167 s, 61.6 MB/s 2024-09-12T12:23:28.720 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.720 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.720 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137706 s, 76.1 MB/s 2024-09-12T12:23:28.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:28.727 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:28.728 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:28.728 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.28 2024-09-12T12:23:28.728 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:28.728 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:28.728 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:28.728 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:28.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013484 s, 77.8 MB/s 2024-09-12T12:23:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.855 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173577 s, 60.4 MB/s 2024-09-12T12:23:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141131 s, 74.3 MB/s 2024-09-12T12:23:28.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.889 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138403 s, 75.8 MB/s 2024-09-12T12:23:28.904 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.904 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.905 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013392 s, 78.3 MB/s 2024-09-12T12:23:28.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.922 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.922 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146197 s, 71.7 MB/s 2024-09-12T12:23:28.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.941 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016286 s, 64.4 MB/s 2024-09-12T12:23:28.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.955 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.955 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116954 s, 89.7 MB/s 2024-09-12T12:23:28.972 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.972 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.972 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141067 s, 74.3 MB/s 2024-09-12T12:23:28.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:28.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:28.993 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183658 s, 57.1 MB/s 2024-09-12T12:23:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.011 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014913 s, 70.3 MB/s 2024-09-12T12:23:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191629 s, 54.7 MB/s 2024-09-12T12:23:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.050 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133279 s, 78.7 MB/s 2024-09-12T12:23:29.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.066 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129189 s, 81.2 MB/s 2024-09-12T12:23:29.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.084 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160565 s, 65.3 MB/s 2024-09-12T12:23:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141695 s, 74.0 MB/s 2024-09-12T12:23:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.118 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125872 s, 83.3 MB/s 2024-09-12T12:23:29.134 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.135 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.135 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140418 s, 74.7 MB/s 2024-09-12T12:23:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169832 s, 61.7 MB/s 2024-09-12T12:23:29.172 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.172 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.172 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144774 s, 72.4 MB/s 2024-09-12T12:23:29.189 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.189 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.189 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140438 s, 74.7 MB/s 2024-09-12T12:23:29.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126254 s, 83.1 MB/s 2024-09-12T12:23:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132109 s, 79.4 MB/s 2024-09-12T12:23:29.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.238 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134491 s, 78.0 MB/s 2024-09-12T12:23:29.256 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.256 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.256 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154499 s, 67.9 MB/s 2024-09-12T12:23:29.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.274 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140272 s, 74.8 MB/s 2024-09-12T12:23:29.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.293 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01679 s, 62.5 MB/s 2024-09-12T12:23:29.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.309 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127457 s, 82.3 MB/s 2024-09-12T12:23:29.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.325 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128989 s, 81.3 MB/s 2024-09-12T12:23:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013115 s, 80.0 MB/s 2024-09-12T12:23:29.357 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.357 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.357 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124053 s, 84.5 MB/s 2024-09-12T12:23:29.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.377 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016614 s, 63.1 MB/s 2024-09-12T12:23:29.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:29.384 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:29.384 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:29.384 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.29 2024-09-12T12:23:29.384 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:29.384 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:29.384 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:29.384 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:29.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:29.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.453 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145915 s, 71.9 MB/s 2024-09-12T12:23:29.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.469 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132413 s, 79.2 MB/s 2024-09-12T12:23:29.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.487 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014519 s, 72.2 MB/s 2024-09-12T12:23:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013038 s, 80.4 MB/s 2024-09-12T12:23:29.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.520 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143774 s, 72.9 MB/s 2024-09-12T12:23:29.536 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.536 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.536 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126537 s, 82.9 MB/s 2024-09-12T12:23:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123072 s, 85.2 MB/s 2024-09-12T12:23:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.569 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138677 s, 75.6 MB/s 2024-09-12T12:23:29.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.586 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147063 s, 71.3 MB/s 2024-09-12T12:23:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.605 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148243 s, 70.7 MB/s 2024-09-12T12:23:29.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144085 s, 72.8 MB/s 2024-09-12T12:23:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.641 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171185 s, 61.3 MB/s 2024-09-12T12:23:29.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.658 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.658 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137942 s, 76.0 MB/s 2024-09-12T12:23:29.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.674 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013623 s, 77.0 MB/s 2024-09-12T12:23:29.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.690 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136653 s, 76.7 MB/s 2024-09-12T12:23:29.709 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.709 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.709 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167433 s, 62.6 MB/s 2024-09-12T12:23:29.725 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.725 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.725 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132361 s, 79.2 MB/s 2024-09-12T12:23:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110742 s, 94.7 MB/s 2024-09-12T12:23:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.755 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140539 s, 74.6 MB/s 2024-09-12T12:23:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138088 s, 75.9 MB/s 2024-09-12T12:23:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133517 s, 78.5 MB/s 2024-09-12T12:23:29.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.803 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131174 s, 79.9 MB/s 2024-09-12T12:23:29.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132401 s, 79.2 MB/s 2024-09-12T12:23:29.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.836 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.836 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143681 s, 73.0 MB/s 2024-09-12T12:23:29.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.853 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142314 s, 73.7 MB/s 2024-09-12T12:23:29.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.868 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127589 s, 82.2 MB/s 2024-09-12T12:23:29.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.884 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.884 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128512 s, 81.6 MB/s 2024-09-12T12:23:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139176 s, 75.3 MB/s 2024-09-12T12:23:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147336 s, 71.2 MB/s 2024-09-12T12:23:29.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.935 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128917 s, 81.3 MB/s 2024-09-12T12:23:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.954 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168781 s, 62.1 MB/s 2024-09-12T12:23:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149204 s, 70.3 MB/s 2024-09-12T12:23:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:29.978 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:29.979 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:29.979 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.30 2024-09-12T12:23:29.979 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:29.979 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:29.979 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:29.979 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:30.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:30.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014689 s, 71.4 MB/s 2024-09-12T12:23:30.064 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.064 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.064 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134515 s, 78.0 MB/s 2024-09-12T12:23:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.082 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144269 s, 72.7 MB/s 2024-09-12T12:23:30.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.098 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141102 s, 74.3 MB/s 2024-09-12T12:23:30.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.117 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01575 s, 66.6 MB/s 2024-09-12T12:23:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.133 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140411 s, 74.7 MB/s 2024-09-12T12:23:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130586 s, 80.3 MB/s 2024-09-12T12:23:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135256 s, 77.5 MB/s 2024-09-12T12:23:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130988 s, 80.1 MB/s 2024-09-12T12:23:30.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.200 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167122 s, 62.7 MB/s 2024-09-12T12:23:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.221 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142707 s, 73.5 MB/s 2024-09-12T12:23:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.233 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013608 s, 77.1 MB/s 2024-09-12T12:23:30.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.250 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.250 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135847 s, 77.2 MB/s 2024-09-12T12:23:30.266 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.267 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145189 s, 72.2 MB/s 2024-09-12T12:23:30.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.282 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.282 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133651 s, 78.5 MB/s 2024-09-12T12:23:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141713 s, 74.0 MB/s 2024-09-12T12:23:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.315 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135896 s, 77.2 MB/s 2024-09-12T12:23:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122915 s, 85.3 MB/s 2024-09-12T12:23:30.347 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.347 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.347 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140208 s, 74.8 MB/s 2024-09-12T12:23:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.367 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.367 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168379 s, 62.3 MB/s 2024-09-12T12:23:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140625 s, 74.6 MB/s 2024-09-12T12:23:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146685 s, 71.5 MB/s 2024-09-12T12:23:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.417 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135304 s, 77.5 MB/s 2024-09-12T12:23:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117068 s, 89.6 MB/s 2024-09-12T12:23:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134428 s, 78.0 MB/s 2024-09-12T12:23:30.463 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.463 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.463 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138606 s, 75.7 MB/s 2024-09-12T12:23:30.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.482 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163064 s, 64.3 MB/s 2024-09-12T12:23:30.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.498 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.498 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136617 s, 76.8 MB/s 2024-09-12T12:23:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169569 s, 61.8 MB/s 2024-09-12T12:23:30.534 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.534 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.535 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140833 s, 74.5 MB/s 2024-09-12T12:23:30.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136278 s, 76.9 MB/s 2024-09-12T12:23:30.566 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.566 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.566 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132942 s, 78.9 MB/s 2024-09-12T12:23:30.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:30.574 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:23:30.574 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:23:30.574 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.31 2024-09-12T12:23:30.574 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:23:30.574 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:23:30.574 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:23:30.575 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:23:30.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:23:30.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.642 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144707 s, 72.5 MB/s 2024-09-12T12:23:30.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.657 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.658 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129111 s, 81.2 MB/s 2024-09-12T12:23:30.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.674 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.674 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140358 s, 74.7 MB/s 2024-09-12T12:23:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.689 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122469 s, 85.6 MB/s 2024-09-12T12:23:30.705 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.705 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.706 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132027 s, 79.4 MB/s 2024-09-12T12:23:30.720 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.721 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129425 s, 81.0 MB/s 2024-09-12T12:23:30.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.738 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143486 s, 73.1 MB/s 2024-09-12T12:23:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013713 s, 76.5 MB/s 2024-09-12T12:23:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.773 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168848 s, 62.1 MB/s 2024-09-12T12:23:30.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.789 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136314 s, 76.9 MB/s 2024-09-12T12:23:30.806 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.806 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.806 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144671 s, 72.5 MB/s 2024-09-12T12:23:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172024 s, 61.0 MB/s 2024-09-12T12:23:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013252 s, 79.1 MB/s 2024-09-12T12:23:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.859 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141809 s, 73.9 MB/s 2024-09-12T12:23:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131878 s, 79.5 MB/s 2024-09-12T12:23:30.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.895 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176272 s, 59.5 MB/s 2024-09-12T12:23:30.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.911 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.911 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139084 s, 75.4 MB/s 2024-09-12T12:23:30.928 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.928 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.928 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146207 s, 71.7 MB/s 2024-09-12T12:23:30.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.948 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174895 s, 60.0 MB/s 2024-09-12T12:23:30.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.964 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128883 s, 81.4 MB/s 2024-09-12T12:23:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144629 s, 72.5 MB/s 2024-09-12T12:23:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.002 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.002 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178609 s, 58.7 MB/s 2024-09-12T12:23:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.018 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139725 s, 75.0 MB/s 2024-09-12T12:23:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.035 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137509 s, 76.3 MB/s 2024-09-12T12:23:31.054 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.054 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.054 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173291 s, 60.5 MB/s 2024-09-12T12:23:31.079 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.079 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.079 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216017 s, 48.5 MB/s 2024-09-12T12:23:31.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149715 s, 70.0 MB/s 2024-09-12T12:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134048 s, 78.2 MB/s 2024-09-12T12:23:31.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.128 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124393 s, 84.3 MB/s 2024-09-12T12:23:31.143 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.143 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.143 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129703 s, 80.8 MB/s 2024-09-12T12:23:31.159 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.159 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.159 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131563 s, 79.7 MB/s 2024-09-12T12:23:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:23:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:23:31.176 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147065 s, 71.3 MB/s 2024-09-12T12:23:31.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:23:31.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:31.183 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-09-12T12:23:31.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.365+0000 7f61e0800640 1 Processor -- start 2024-09-12T12:23:31.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.365+0000 7f61e0800640 1 -- start start 2024-09-12T12:23:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61e0800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f61d806d250 0x7f61d815c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61e0800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f61d80b3490 0x7f61d80b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61e0800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 0x7f61d8155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61e0800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f61d8072620 con 0x7f61d806d250 2024-09-12T12:23:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61e0800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f61d815cc80 con 0x7f61d80b3490 2024-09-12T12:23:31.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61e0800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f61d80b4f30 con 0x7f61d806d630 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dde00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f61d806d250 0x7f61d815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dde00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f61d806d250 0x7f61d815c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43324/0 (socket says 172.21.15.144:43324) 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dde00640 1 -- 172.21.15.144:0/1325804068 learned_addr learned my addr 172.21.15.144:0/1325804068 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dd400640 1 --2- 172.21.15.144:0/1325804068 >> v2:172.21.15.165:3300/0 conn(0x7f61d80b3490 0x7f61d80b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61de800640 1 --2- 172.21.15.144:0/1325804068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 0x7f61d8155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dde00640 1 -- 172.21.15.144:0/1325804068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 msgr2=0x7f61d8155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dde00640 1 --2- 172.21.15.144:0/1325804068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 0x7f61d8155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dde00640 1 -- 172.21.15.144:0/1325804068 >> v2:172.21.15.165:3300/0 conn(0x7f61d80b3490 msgr2=0x7f61d80b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dde00640 1 --2- 172.21.15.144:0/1325804068 >> v2:172.21.15.165:3300/0 conn(0x7f61d80b3490 0x7f61d80b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dde00640 1 -- 172.21.15.144:0/1325804068 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d806cd20 con 0x7f61d806d250 2024-09-12T12:23:31.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dd400640 1 --2- 172.21.15.144:0/1325804068 >> v2:172.21.15.165:3300/0 conn(0x7f61d80b3490 0x7f61d80b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:31.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dde00640 1 --2- 172.21.15.144:0/1325804068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 0x7f61d815c740 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f61d8073fc0 tx=0x7f61cc01e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f5423b97ccf652 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dca00640 1 -- 172.21.15.144:0/1325804068 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0a86b0 con 0x7f61d806d250 2024-09-12T12:23:31.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dca00640 1 -- 172.21.15.144:0/1325804068 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc0a8850 con 0x7f61d806d250 2024-09-12T12:23:31.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.369+0000 7f61dca00640 1 -- 172.21.15.144:0/1325804068 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0a8c20 con 0x7f61d806d250 2024-09-12T12:23:31.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 -- 172.21.15.144:0/1325804068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 msgr2=0x7f61d815c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 --2- 172.21.15.144:0/1325804068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 0x7f61d815c740 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f61d8073fc0 tx=0x7f61cc01e700 comp rx=0 tx=0).stop 2024-09-12T12:23:31.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 -- 172.21.15.144:0/1325804068 shutdown_connections 2024-09-12T12:23:31.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 --2- 172.21.15.144:0/1325804068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 0x7f61d8155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 --2- 172.21.15.144:0/1325804068 >> v2:172.21.15.165:3300/0 conn(0x7f61d80b3490 0x7f61d80b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 --2- 172.21.15.144:0/1325804068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 0x7f61d815c740 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 -- 172.21.15.144:0/1325804068 >> 172.21.15.144:0/1325804068 conn(0x7f61d806bc10 msgr2=0x7f61d806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 -- 172.21.15.144:0/1325804068 shutdown_connections 2024-09-12T12:23:31.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 -- 172.21.15.144:0/1325804068 wait complete. 2024-09-12T12:23:31.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 Processor -- start 2024-09-12T12:23:31.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 -- start start 2024-09-12T12:23:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 0x7f61d80ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 0x7f61d8147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d80b3490 0x7f61d80cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f61d80b41f0 con 0x7f61d806d250 2024-09-12T12:23:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f61d80b3f10 con 0x7f61d80b3490 2024-09-12T12:23:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61e0800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f61d80b44d0 con 0x7f61d806d630 2024-09-12T12:23:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 0x7f61d80ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 0x7f61d80ab4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43340/0 (socket says 172.21.15.144:43340) 2024-09-12T12:23:31.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61dde00640 1 -- 172.21.15.144:0/3129775100 learned_addr learned my addr 172.21.15.144:0/3129775100 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61dd400640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 0x7f61d8147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61de800640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d80b3490 0x7f61d80cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61dde00640 1 -- 172.21.15.144:0/3129775100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 msgr2=0x7f61d8147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61dde00640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 0x7f61d8147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61dde00640 1 -- 172.21.15.144:0/3129775100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d80b3490 msgr2=0x7f61d80cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61dde00640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d80b3490 0x7f61d80cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61dde00640 1 -- 172.21.15.144:0/3129775100 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d80aa480 con 0x7f61d806d250 2024-09-12T12:23:31.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.373+0000 7f61de800640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d80b3490 0x7f61d80cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:31.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61dde00640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 0x7f61d80ab4e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0b2040 tx=0x7f61cc01cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61d2000640 1 -- 172.21.15.144:0/3129775100 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0ba630 con 0x7f61d806d250 2024-09-12T12:23:31.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61d2000640 1 -- 172.21.15.144:0/3129775100 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc0bf070 con 0x7f61d806d250 2024-09-12T12:23:31.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61d2000640 1 -- 172.21.15.144:0/3129775100 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0baa10 con 0x7f61d806d250 2024-09-12T12:23:31.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61e0800640 1 -- 172.21.15.144:0/3129775100 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d80aa720 con 0x7f61d806d250 2024-09-12T12:23:31.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61e0800640 1 -- 172.21.15.144:0/3129775100 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d80aace0 con 0x7f61d806d250 2024-09-12T12:23:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61d2000640 1 -- 172.21.15.144:0/3129775100 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61cc0b7070 con 0x7f61d806d250 2024-09-12T12:23:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61d2000640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f61bc0678c0 0x7f61bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61d2000640 1 -- 172.21.15.144:0/3129775100 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f61cc120720 con 0x7f61d806d250 2024-09-12T12:23:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61dd400640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f61bc0678c0 0x7f61bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.377+0000 7f61e3ba3000 1 Processor -- start 2024-09-12T12:23:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- start start 2024-09-12T12:23:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dd400640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f61bc0678c0 0x7f61bc069d80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f61d80b28d0 tx=0x7f61c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 0x55ff01258160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 0x55ff01258a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ff010a8ba0 con 0x55ff012a46d0 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ff0104e350 con 0x55ff012a4ff0 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ff010a4b60 con 0x55ff012586a0 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43344/0 (socket says 172.21.15.144:43344) 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dd400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 0x55ff01258160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dde00640 1 -- 172.21.15.144:0/3836518261 learned_addr learned my addr 172.21.15.144:0/3836518261 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61de800640 1 --2- 172.21.15.144:0/3836518261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 0x55ff01258a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dde00640 1 -- 172.21.15.144:0/3836518261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 msgr2=0x55ff01258a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dde00640 1 --2- 172.21.15.144:0/3836518261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 0x55ff01258a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dde00640 1 -- 172.21.15.144:0/3836518261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 msgr2=0x55ff01258160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dde00640 1 --2- 172.21.15.144:0/3836518261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 0x55ff01258160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dde00640 1 -- 172.21.15.144:0/3836518261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff01051bd0 con 0x55ff012a46d0 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61dde00640 1 --2- 172.21.15.144:0/3836518261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012a4ab0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009280 tx=0x7f61cc0f0620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c811ff5c0ae3424e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61c6a00640 1 -- 172.21.15.144:0/3836518261 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0f11e0 con 0x55ff012a46d0 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61c6a00640 1 -- 172.21.15.144:0/3836518261 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc0f0ae0 con 0x55ff012a46d0 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61c6a00640 1 -- 172.21.15.144:0/3836518261 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0f4e90 con 0x55ff012a46d0 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3836518261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 msgr2=0x55ff012a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3836518261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012a4ab0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009280 tx=0x7f61cc0f0620 comp rx=0 tx=0).stop 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3836518261 shutdown_connections 2024-09-12T12:23:31.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3836518261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 0x55ff01258a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3836518261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 0x55ff01258160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3836518261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012a4ab0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3836518261 >> 172.21.15.144:0/3836518261 conn(0x55ff01285470 msgr2=0x55ff01287860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3836518261 shutdown_connections 2024-09-12T12:23:31.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3836518261 wait complete. 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 -- start start 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.381+0000 7f61e3ba3000 1 Processor -- start 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012586a0 0x55ff012601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 0x55ff0125c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ff010422a0 con 0x55ff012a46d0 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ff010677d0 con 0x55ff012586a0 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ff01069f70 con 0x55ff012a4ff0 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 10 client.0 _ll_register_callbacks cb 0x55ff01245b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:31.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43358/0 (socket says 172.21.15.144:43358) 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dd400640 1 -- 172.21.15.144:0/951802589 learned_addr learned my addr 172.21.15.144:0/951802589 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dde00640 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012586a0 0x55ff012601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61de800640 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 0x55ff0125c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dd400640 1 -- 172.21.15.144:0/951802589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 msgr2=0x55ff0125c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dd400640 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 0x55ff0125c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dd400640 1 -- 172.21.15.144:0/951802589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012586a0 msgr2=0x55ff012601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dd400640 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012586a0 0x55ff012601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dd400640 1 -- 172.21.15.144:0/951802589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff010b1810 con 0x55ff012a46d0 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dd400640 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012606f0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f61c8016730 tx=0x7f61c80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5b6f0ec643271a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61bb400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61bb400640 1 -- 172.21.15.144:0/951802589 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8026070 con 0x55ff012a46d0 2024-09-12T12:23:31.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61bb400640 1 -- 172.21.15.144:0/951802589 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f61c8014870 con 0x55ff012a46d0 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 -- 172.21.15.144:0/951802589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61cc0f0ae0 con 0x55ff012a46d0 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61bb400640 1 -- 172.21.15.144:0/951802589 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f61c8031050 con 0x55ff012a46d0 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 10 client.9531 fetch_fsmap learned FSMap version 123 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 -- 172.21.15.144:0/951802589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x55ff010529f0 con 0x55ff012a46d0 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61bb400640 1 -- 172.21.15.144:0/951802589 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61cc0f0ae0 con 0x55ff012a46d0 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61bb400640 1 -- 172.21.15.144:0/951802589 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7f61c8034020 con 0x55ff012a46d0 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 10 client.9531 fetch_fsmap finished waiting for FSMap version 123 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 10 client.9531 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 20 client.9531 populate_metadata read hostname 'smithi144' 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x55ff012b2960 0x55ff012b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 4 client.9531 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61e3ba3000 1 -- 172.21.15.144:0/951802589 --> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff01042bd0 con 0x55ff012b2960 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dde00640 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x55ff012b2960 0x55ff012b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61dde00640 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x55ff012b2960 0x55ff012b4d50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=259cc47397d88dc4 server_cookie=4781fac42ee71f4 in_seq=0 out_seq=0 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.385+0000 7f61bb400640 10 client.9531 ms_handle_connect on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61bb400640 1 -- 172.21.15.144:0/951802589 <== mds.0 v2:172.21.15.144:6835/2909096469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff01042bd0 con 0x55ff012b2960 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61bb400640 10 client.9531 handle_command_reply: tid=0 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 client.9531 shutdown 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 -- 172.21.15.144:0/951802589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 msgr2=0x55ff012606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012606f0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f61c8016730 tx=0x7f61c80046d0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 -- 172.21.15.144:0/951802589 shutdown_connections 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x55ff012b2960 0x55ff012b4d50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 0x55ff0125c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff012606f0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/951802589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012586a0 0x55ff012601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61bb400640 0 client.9531 ms_handle_reset on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 -- 172.21.15.144:0/951802589 >> 172.21.15.144:0/951802589 conn(0x55ff01285470 msgr2=0x55ff01287860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 -- 172.21.15.144:0/951802589 shutdown_connections 2024-09-12T12:23:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 1 -- 172.21.15.144:0/951802589 wait complete. 2024-09-12T12:23:31.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.389+0000 7f61e3ba3000 20 client.9531 trim_cache size 0 max 16384 2024-09-12T12:23:31.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61e3ba3000 1 Processor -- start 2024-09-12T12:23:31.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61e3ba3000 1 -- start start 2024-09-12T12:23:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 0x55ff0125aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff0125afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 0x55ff0125b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8203030 con 0x55ff012a46d0 2024-09-12T12:23:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8158220 con 0x55ff012a4ff0 2024-09-12T12:23:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f61d81f8240 con 0x55ff012586a0 2024-09-12T12:23:31.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff0125afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff0125afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43372/0 (socket says 172.21.15.144:43372) 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dd400640 1 -- 172.21.15.144:0/224503534 learned_addr learned my addr 172.21.15.144:0/224503534 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dde00640 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 0x55ff0125aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61de800640 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 0x55ff0125b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dd400640 1 -- 172.21.15.144:0/224503534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 msgr2=0x55ff0125aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dd400640 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 0x55ff0125aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dd400640 1 -- 172.21.15.144:0/224503534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 msgr2=0x55ff0125b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dd400640 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 0x55ff0125b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dd400640 1 -- 172.21.15.144:0/224503534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0104e5a0 con 0x55ff012a46d0 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61de800640 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 0x55ff0125b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61dd400640 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff0125afd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c10 tx=0x7f61c8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396b335d74466fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.405+0000 7f61c6000640 1 -- 172.21.15.144:0/224503534 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8026070 con 0x55ff012a46d0 2024-09-12T12:23:31.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61c6000640 1 -- 172.21.15.144:0/224503534 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c801d040 con 0x55ff012a46d0 2024-09-12T12:23:31.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61c6000640 1 -- 172.21.15.144:0/224503534 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c801c040 con 0x55ff012a46d0 2024-09-12T12:23:31.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- 172.21.15.144:0/224503534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 msgr2=0x55ff0125afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff0125afd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c10 tx=0x7f61c8023000 comp rx=0 tx=0).stop 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- 172.21.15.144:0/224503534 shutdown_connections 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a4ff0 0x55ff0125b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012a46d0 0x55ff0125afd0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/224503534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012586a0 0x55ff0125aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- 172.21.15.144:0/224503534 >> 172.21.15.144:0/224503534 conn(0x55ff01285470 msgr2=0x55ff01283150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- 172.21.15.144:0/224503534 shutdown_connections 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- 172.21.15.144:0/224503534 wait complete. 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- start start 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 Processor -- start 2024-09-12T12:23:31.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012586a0 0x55ff01320ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a46d0 0x55ff01321000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 0x55ff012b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ff01054c10 con 0x55ff012586a0 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ff0104fe30 con 0x55ff012a46d0 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ff0102d8f0 con 0x55ff012a4ff0 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 10 client.0 _ll_register_callbacks cb 0x7f61c80042f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012586a0 0x55ff01320ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012586a0 0x55ff01320ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43384/0 (socket says 172.21.15.144:43384) 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dde00640 1 -- 172.21.15.144:0/3405781030 learned_addr learned my addr 172.21.15.144:0/3405781030 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61de800640 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 0x55ff012b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dd400640 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a46d0 0x55ff01321000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dde00640 1 -- 172.21.15.144:0/3405781030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 msgr2=0x55ff012b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dde00640 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 0x55ff012b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dde00640 1 -- 172.21.15.144:0/3405781030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a46d0 msgr2=0x55ff01321000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dde00640 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a46d0 0x55ff01321000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dde00640 1 -- 172.21.15.144:0/3405781030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff010485b0 con 0x55ff012586a0 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61dde00640 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012586a0 0x55ff01320ac0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f61cc024cd0 tx=0x7f61cc120040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a97821e579de91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61bb400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61bb400640 1 -- 172.21.15.144:0/3405781030 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0f0ae0 con 0x55ff012586a0 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3405781030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61c801d040 con 0x55ff012586a0 2024-09-12T12:23:31.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61bb400640 1 -- 172.21.15.144:0/3405781030 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f61cc0ed150 con 0x55ff012586a0 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61bb400640 1 -- 172.21.15.144:0/3405781030 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f61cc0f96c0 con 0x55ff012586a0 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 10 client.9537 fetch_fsmap learned FSMap version 123 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3405781030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x55ff01040330 con 0x55ff012586a0 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61bb400640 1 -- 172.21.15.144:0/3405781030 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c801d040 con 0x55ff012586a0 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.409+0000 7f61bb400640 1 -- 172.21.15.144:0/3405781030 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7f61cc0b9070 con 0x55ff012586a0 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 10 client.9537 fetch_fsmap finished waiting for FSMap version 123 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 10 client.9537 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 20 client.9537 populate_metadata read hostname 'smithi144' 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x55ff012b75d0 0x55ff012b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 4 client.9537 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3405781030 --> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55ff010b62d0 con 0x55ff012b75d0 2024-09-12T12:23:31.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61dd400640 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x55ff012b75d0 0x55ff012b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61dd400640 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x55ff012b75d0 0x55ff012b79e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96ae8f0761a894c6 server_cookie=d6cac0b9573e0eef in_seq=0 out_seq=0 2024-09-12T12:23:31.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61bb400640 10 client.9537 ms_handle_connect on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61bb400640 1 -- 172.21.15.144:0/3405781030 <== mds.0 v2:172.21.15.144:6835/2909096469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ff010b62d0 con 0x55ff012b75d0 2024-09-12T12:23:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61bb400640 10 client.9537 handle_command_reply: tid=0 2024-09-12T12:23:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 client.9537 shutdown 2024-09-12T12:23:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3405781030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012586a0 msgr2=0x55ff01320ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012586a0 0x55ff01320ac0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f61cc024cd0 tx=0x7f61cc120040 comp rx=0 tx=0).stop 2024-09-12T12:23:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3405781030 shutdown_connections 2024-09-12T12:23:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x55ff012b75d0 0x55ff012b79e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff012a4ff0 0x55ff012b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff012a46d0 0x55ff01321000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 --2- 172.21.15.144:0/3405781030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff012586a0 0x55ff01320ac0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3405781030 >> 172.21.15.144:0/3405781030 conn(0x55ff01285470 msgr2=0x55ff01283970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61bb400640 0 client.9537 ms_handle_reset on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3405781030 shutdown_connections 2024-09-12T12:23:31.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 1 -- 172.21.15.144:0/3405781030 wait complete. 2024-09-12T12:23:31.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.413+0000 7f61e3ba3000 20 client.9537 trim_cache size 0 max 16384 2024-09-12T12:23:31.418 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:23:31.418 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:23:31.418 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "7962b4e4-d9a6-4d69-ab35-4e75bada238c", 2024-09-12T12:23:31.419 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:23:31.419 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:23:31.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 -- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f61bc0678c0 msgr2=0x7f61bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f61bc0678c0 0x7f61bc069d80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f61d80b28d0 tx=0x7f61c8008040 comp rx=0 tx=0).stop 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 -- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 msgr2=0x7f61d80ab4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 0x7f61d80ab4e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0b2040 tx=0x7f61cc01cf40 comp rx=0 tx=0).stop 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 -- 172.21.15.144:0/3129775100 shutdown_connections 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f61bc0678c0 0x7f61bc069d80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61d80b3490 0x7f61d80cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f61d806d630 0x7f61d8147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 --2- 172.21.15.144:0/3129775100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f61d806d250 0x7f61d80ab4e0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 -- 172.21.15.144:0/3129775100 >> 172.21.15.144:0/3129775100 conn(0x7f61d806bc10 msgr2=0x7f61d80cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 -- 172.21.15.144:0/3129775100 shutdown_connections 2024-09-12T12:23:31.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.417+0000 7f61e0800640 1 -- 172.21.15.144:0/3129775100 wait complete. 2024-09-12T12:23:31.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:31.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-09-12T12:23:31.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf9a00640 1 Processor -- start 2024-09-12T12:23:31.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf9a00640 1 -- start start 2024-09-12T12:23:31.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf9a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cf415af60 0x7f3cf40ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf9a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf40cd9f0 0x7f3cf406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf9a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf40b4300 con 0x7f3cf415b340 2024-09-12T12:23:31.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf9a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3cf40b32f0 con 0x7f3cf415af60 2024-09-12T12:23:31.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf9a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf40b3540 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cf415af60 0x7f3cf40ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cf415af60 0x7f3cf40ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43386/0 (socket says 172.21.15.144:43386) 2024-09-12T12:23:31.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf2a00640 1 -- 172.21.15.144:0/14525660 learned_addr learned my addr 172.21.15.144:0/14525660 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf2000640 1 --2- 172.21.15.144:0/14525660 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf40cd9f0 0x7f3cf406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf2a00640 1 -- 172.21.15.144:0/14525660 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf40cd9f0 msgr2=0x7f3cf406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/14525660 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf40cd9f0 0x7f3cf406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf2a00640 1 -- 172.21.15.144:0/14525660 >> v1:172.21.15.165:6789/0 conn(0x7f3cf415b340 legacy=0x7f3cf415ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.613+0000 7f3cf2a00640 1 -- 172.21.15.144:0/14525660 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf40b3820 con 0x7f3cf415af60 2024-09-12T12:23:31.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/14525660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf415af60 0x7f3cf40ce680 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009870 tx=0x7f3ce401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4841b4d702899bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf1600640 1 -- 172.21.15.144:0/14525660 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40b5070 con 0x7f3cf415af60 2024-09-12T12:23:31.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf1600640 1 -- 172.21.15.144:0/14525660 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce40a8a50 con 0x7f3cf415af60 2024-09-12T12:23:31.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf1600640 1 -- 172.21.15.144:0/14525660 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40a8e20 con 0x7f3cf415af60 2024-09-12T12:23:31.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf9a00640 1 -- 172.21.15.144:0/14525660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf415af60 msgr2=0x7f3cf40ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf9a00640 1 --2- 172.21.15.144:0/14525660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf415af60 0x7f3cf40ce680 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009870 tx=0x7f3ce401ed50 comp rx=0 tx=0).stop 2024-09-12T12:23:31.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf9a00640 1 -- 172.21.15.144:0/14525660 shutdown_connections 2024-09-12T12:23:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf9a00640 1 --2- 172.21.15.144:0/14525660 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf40cd9f0 0x7f3cf406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf9a00640 1 --2- 172.21.15.144:0/14525660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf415af60 0x7f3cf40ce680 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf9a00640 1 -- 172.21.15.144:0/14525660 >> 172.21.15.144:0/14525660 conn(0x7f3cf4068030 msgr2=0x7f3cf40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf9a00640 1 -- 172.21.15.144:0/14525660 shutdown_connections 2024-09-12T12:23:31.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.617+0000 7f3cf9a00640 1 -- 172.21.15.144:0/14525660 wait complete. 2024-09-12T12:23:31.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 Processor -- start 2024-09-12T12:23:31.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 -- start start 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40cd9f0 0x7f3cf414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf415af60 0x7f3cf4148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf415b340 0x7f3cf4150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf40b5570 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf40b3de0 con 0x7f3cf415b340 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf40cebc0 con 0x7f3cf415af60 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40cd9f0 0x7f3cf414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40cd9f0 0x7f3cf414e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43402/0 (socket says 172.21.15.144:43402) 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2a00640 1 -- 172.21.15.144:0/3916611529 learned_addr learned my addr 172.21.15.144:0/3916611529 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2000640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf415af60 0x7f3cf4148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf3400640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf415b340 0x7f3cf4150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2a00640 1 -- 172.21.15.144:0/3916611529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf415af60 msgr2=0x7f3cf4148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf415af60 0x7f3cf4148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2a00640 1 -- 172.21.15.144:0/3916611529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf415b340 msgr2=0x7f3cf4150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf415b340 0x7f3cf4150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2a00640 1 -- 172.21.15.144:0/3916611529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf414e400 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf3400640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf415b340 0x7f3cf4150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:31.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40cd9f0 0x7f3cf414e6f0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f3ce401d400 tx=0x7f3ce401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3ceaa00640 1 -- 172.21.15.144:0/3916611529 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40c0070 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3ceaa00640 1 -- 172.21.15.144:0/3916611529 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce40ae550 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 -- 172.21.15.144:0/3916611529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf414de80 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3ceaa00640 1 -- 172.21.15.144:0/3916611529 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40b5070 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.621+0000 7f3cf9a00640 1 -- 172.21.15.144:0/3916611529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf414e120 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.625+0000 7f3ceaa00640 1 -- 172.21.15.144:0/3916611529 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ce40c3070 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.625+0000 7f3ceaa00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3cd40678c0 0x7f3cd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.625+0000 7f3ceaa00640 1 -- 172.21.15.144:0/3916611529 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f3ce4123610 con 0x7f3cf40cd9f0 2024-09-12T12:23:31.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.625+0000 7f3cf2000640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3cd40678c0 0x7f3cd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.625+0000 7f3cfcd14000 1 Processor -- start 2024-09-12T12:23:31.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.625+0000 7f3cfcd14000 1 -- start start 2024-09-12T12:23:31.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.625+0000 7f3cf2000640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3cd40678c0 0x7f3cd4069d80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3cf414b270 tx=0x7f3ce0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139491c10 0x562139491ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139492530 0x562139445240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139445b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562139296cc0 con 0x562139445780 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562139251a20 con 0x562139491c10 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x562139292c80 con 0x562139492530 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139445b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139445b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43404/0 (socket says 172.21.15.144:43404) 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf3400640 1 -- 172.21.15.144:0/2211434781 learned_addr learned my addr 172.21.15.144:0/2211434781 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/2211434781 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139491c10 0x562139491ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf2000640 1 --2- 172.21.15.144:0/2211434781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139492530 0x562139445240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf3400640 1 -- 172.21.15.144:0/2211434781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139492530 msgr2=0x562139445240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf3400640 1 --2- 172.21.15.144:0/2211434781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139492530 0x562139445240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf3400640 1 -- 172.21.15.144:0/2211434781 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139491c10 msgr2=0x562139491ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf3400640 1 --2- 172.21.15.144:0/2211434781 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139491c10 0x562139491ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf3400640 1 -- 172.21.15.144:0/2211434781 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562139239d40 con 0x562139445780 2024-09-12T12:23:31.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cf3400640 1 --2- 172.21.15.144:0/2211434781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139445b60 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f3cec001c80 tx=0x7f3cec002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a931ebdd742696c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cdf400640 1 -- 172.21.15.144:0/2211434781 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec019070 con 0x562139445780 2024-09-12T12:23:31.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cdf400640 1 -- 172.21.15.144:0/2211434781 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cec003b90 con 0x562139445780 2024-09-12T12:23:31.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cdf400640 1 -- 172.21.15.144:0/2211434781 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec00e800 con 0x562139445780 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- 172.21.15.144:0/2211434781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 msgr2=0x562139445b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/2211434781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139445b60 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f3cec001c80 tx=0x7f3cec002080 comp rx=0 tx=0).stop 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- 172.21.15.144:0/2211434781 shutdown_connections 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/2211434781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139445b60 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/2211434781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139492530 0x562139445240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/2211434781 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139491c10 0x562139491ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- 172.21.15.144:0/2211434781 >> 172.21.15.144:0/2211434781 conn(0x5621394729b0 msgr2=0x562139474da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- 172.21.15.144:0/2211434781 shutdown_connections 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- 172.21.15.144:0/2211434781 wait complete. 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- start start 2024-09-12T12:23:31.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 Processor -- start 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139498e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 0x562139471a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x562139471fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5621392302c0 con 0x562139445780 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562139255370 con 0x562139492530 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5621392a4f50 con 0x562139491c10 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.629+0000 7f3cfcd14000 10 client.0 _ll_register_callbacks cb 0x5621392f7db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139498e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139498e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43408/0 (socket says 172.21.15.144:43408) 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2a00640 1 -- 172.21.15.144:0/4078391858 learned_addr learned my addr 172.21.15.144:0/4078391858 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2000640 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 0x562139471a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf3400640 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x562139471fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2a00640 1 -- 172.21.15.144:0/4078391858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 msgr2=0x562139471a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 0x562139471a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2a00640 1 -- 172.21.15.144:0/4078391858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 msgr2=0x562139471fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x562139471fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2a00640 1 -- 172.21.15.144:0/4078391858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562139236770 con 0x562139445780 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139498e40 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40ba000 tx=0x7f3ce40f3380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d7eafe83ac8d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 1 -- 172.21.15.144:0/4078391858 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40fa0b0 con 0x562139445780 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 1 -- 172.21.15.144:0/4078391858 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f3ce40f4be0 con 0x562139445780 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 -- 172.21.15.144:0/4078391858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cec003b90 con 0x562139445780 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 1 -- 172.21.15.144:0/4078391858 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f3ce40f4e00 con 0x562139445780 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 10 client.9549 fetch_fsmap learned FSMap version 123 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 -- 172.21.15.144:0/4078391858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x5621392543f0 con 0x562139445780 2024-09-12T12:23:31.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 1 -- 172.21.15.144:0/4078391858 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cec003b90 con 0x562139445780 2024-09-12T12:23:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 1 -- 172.21.15.144:0/4078391858 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7f3ce40fc000 con 0x562139445780 2024-09-12T12:23:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 10 client.9549 fetch_fsmap finished waiting for FSMap version 123 2024-09-12T12:23:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 10 client.9549 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-12T12:23:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 20 client.9549 populate_metadata read hostname 'smithi144' 2024-09-12T12:23:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x562139499380 0x56213944b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 4 client.9549 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:23:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 -- 172.21.15.144:0/4078391858 --> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562139230d90 con 0x562139499380 2024-09-12T12:23:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2000640 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x562139499380 0x56213944b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 10 client.9549 ms_handle_connect on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cf2000640 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x562139499380 0x56213944b780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e7ec76cb0db939 server_cookie=920b68860dce7f9 in_seq=0 out_seq=0 2024-09-12T12:23:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 1 -- 172.21.15.144:0/4078391858 <== mds.0 v2:172.21.15.144:6835/2909096469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562139230d90 con 0x562139499380 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 10 client.9549 handle_command_reply: tid=0 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 client.9549 shutdown 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 -- 172.21.15.144:0/4078391858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 msgr2=0x562139498e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139498e40 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40ba000 tx=0x7f3ce40f3380 comp rx=0 tx=0).stop 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 -- 172.21.15.144:0/4078391858 shutdown_connections 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x562139499380 0x56213944b780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x562139471fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 0x562139471a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/4078391858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139498e40 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cd3e00640 0 client.9549 ms_handle_reset on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 -- 172.21.15.144:0/4078391858 >> 172.21.15.144:0/4078391858 conn(0x5621394729b0 msgr2=0x562139444940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 -- 172.21.15.144:0/4078391858 shutdown_connections 2024-09-12T12:23:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 1 -- 172.21.15.144:0/4078391858 wait complete. 2024-09-12T12:23:31.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.633+0000 7f3cfcd14000 20 client.9549 trim_cache size 0 max 16384 2024-09-12T12:23:31.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 Processor -- start 2024-09-12T12:23:31.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 -- start start 2024-09-12T12:23:31.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139445780 0x56213949f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139491c10 0x5621394a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x5621394a8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf42001b0 con 0x562139491c10 2024-09-12T12:23:31.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf41ff560 con 0x562139492530 2024-09-12T12:23:31.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf41ffb60 con 0x562139445780 2024-09-12T12:23:31.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139491c10 0x5621394a82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf3400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x5621394a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139445780 0x56213949f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139491c10 0x5621394a82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43416/0 (socket says 172.21.15.144:43416) 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2000640 1 -- 172.21.15.144:0/1840066268 learned_addr learned my addr 172.21.15.144:0/1840066268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2000640 1 -- 172.21.15.144:0/1840066268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139445780 msgr2=0x56213949f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2000640 1 --2- 172.21.15.144:0/1840066268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139445780 0x56213949f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2000640 1 -- 172.21.15.144:0/1840066268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 msgr2=0x5621394a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2000640 1 --2- 172.21.15.144:0/1840066268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x5621394a8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2000640 1 -- 172.21.15.144:0/1840066268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562139318320 con 0x562139491c10 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf3400640 1 --2- 172.21.15.144:0/1840066268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x5621394a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cf2000640 1 --2- 172.21.15.144:0/1840066268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139491c10 0x5621394a82c0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0010c50 tx=0x7f3ce0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f59491dc039de7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cdea00640 1 -- 172.21.15.144:0/1840066268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce001c040 con 0x562139491c10 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cdea00640 1 -- 172.21.15.144:0/1840066268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce0030070 con 0x562139491c10 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cdea00640 1 -- 172.21.15.144:0/1840066268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0010d80 con 0x562139491c10 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 -- 172.21.15.144:0/1840066268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139491c10 msgr2=0x5621394a82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/1840066268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139491c10 0x5621394a82c0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0010c50 tx=0x7f3ce0015000 comp rx=0 tx=0).stop 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 -- 172.21.15.144:0/1840066268 shutdown_connections 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/1840066268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x5621394a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/1840066268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139491c10 0x5621394a82c0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/1840066268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139445780 0x56213949f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 -- 172.21.15.144:0/1840066268 >> 172.21.15.144:0/1840066268 conn(0x5621394729b0 msgr2=0x562139443a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 -- 172.21.15.144:0/1840066268 shutdown_connections 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.653+0000 7f3cfcd14000 1 -- 172.21.15.144:0/1840066268 wait complete. 2024-09-12T12:23:31.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 -- start start 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 Processor -- start 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139505050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 0x56213949bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x56213949c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56213923e120 con 0x562139445780 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562139317e90 con 0x562139492530 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x562139240b90 con 0x562139491c10 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 10 client.0 _ll_register_callbacks cb 0x7f3ce40f3590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139505050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139505050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43420/0 (socket says 172.21.15.144:43420) 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2a00640 1 -- 172.21.15.144:0/6689634 learned_addr learned my addr 172.21.15.144:0/6689634 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf3400640 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x56213949c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2000640 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 0x56213949bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2a00640 1 -- 172.21.15.144:0/6689634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 msgr2=0x56213949bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 0x56213949bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2a00640 1 -- 172.21.15.144:0/6689634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 msgr2=0x56213949c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x56213949c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2a00640 1 -- 172.21.15.144:0/6689634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56213922a5c0 con 0x562139445780 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2a00640 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139505050 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40f38f0 tx=0x7f3ce4121870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca9ba45e363725a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cd3e00640 1 -- 172.21.15.144:0/6689634 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40fa0b0 con 0x562139445780 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 -- 172.21.15.144:0/6689634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ce0030070 con 0x562139445780 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cd3e00640 1 -- 172.21.15.144:0/6689634 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f3ce40f2fc0 con 0x562139445780 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cd3e00640 1 -- 172.21.15.144:0/6689634 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f3ce40efc00 con 0x562139445780 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 10 client.9555 fetch_fsmap learned FSMap version 123 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 -- 172.21.15.144:0/6689634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x56213922e330 con 0x562139445780 2024-09-12T12:23:31.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cd3e00640 1 -- 172.21.15.144:0/6689634 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce0030070 con 0x562139445780 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cd3e00640 1 -- 172.21.15.144:0/6689634 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7f3ce410bb10 con 0x562139445780 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 10 client.9555 fetch_fsmap finished waiting for FSMap version 123 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 10 client.9555 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 20 client.9555 populate_metadata read hostname 'smithi144' 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x562139505590 0x56213949c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 4 client.9555 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cfcd14000 1 -- 172.21.15.144:0/6689634 --> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x5621392a43f0 con 0x562139505590 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2000640 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x562139505590 0x56213949c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cf2000640 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x562139505590 0x56213949c9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9994e90598816f6 server_cookie=da3368196124942e in_seq=0 out_seq=0 2024-09-12T12:23:31.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.657+0000 7f3cd3e00640 10 client.9555 ms_handle_connect on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cd3e00640 1 -- 172.21.15.144:0/6689634 <== mds.0 v2:172.21.15.144:6835/2909096469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5621392a43f0 con 0x562139505590 2024-09-12T12:23:31.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cd3e00640 10 client.9555 handle_command_reply: tid=0 2024-09-12T12:23:31.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 client.9555 shutdown 2024-09-12T12:23:31.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 -- 172.21.15.144:0/6689634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 msgr2=0x562139505050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139505050 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40f38f0 tx=0x7f3ce4121870 comp rx=0 tx=0).stop 2024-09-12T12:23:31.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 -- 172.21.15.144:0/6689634 shutdown_connections 2024-09-12T12:23:31.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x562139505590 0x56213949c9b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562139492530 0x56213949c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x562139491c10 0x56213949bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cd3e00640 0 client.9555 ms_handle_reset on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 --2- 172.21.15.144:0/6689634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562139445780 0x562139505050 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 -- 172.21.15.144:0/6689634 >> 172.21.15.144:0/6689634 conn(0x5621394729b0 msgr2=0x5621394a8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 -- 172.21.15.144:0/6689634 shutdown_connections 2024-09-12T12:23:31.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 1 -- 172.21.15.144:0/6689634 wait complete. 2024-09-12T12:23:31.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cfcd14000 20 client.9555 trim_cache size 0 max 16384 2024-09-12T12:23:31.666 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:23:31.666 INFO:teuthology.orchestra.run.smithi144.stdout: "message": "", 2024-09-12T12:23:31.666 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0 2024-09-12T12:23:31.667 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:23:31.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 -- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3cd40678c0 msgr2=0x7f3cd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3cd40678c0 0x7f3cd4069d80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3cf414b270 tx=0x7f3ce0008040 comp rx=0 tx=0).stop 2024-09-12T12:23:31.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 -- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40cd9f0 msgr2=0x7f3cf414e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40cd9f0 0x7f3cf414e6f0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f3ce401d400 tx=0x7f3ce401baf0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 -- 172.21.15.144:0/3916611529 shutdown_connections 2024-09-12T12:23:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3cd40678c0 0x7f3cd4069d80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf415b340 0x7f3cf4150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cf415af60 0x7f3cf4148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 --2- 172.21.15.144:0/3916611529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cf40cd9f0 0x7f3cf414e6f0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 -- 172.21.15.144:0/3916611529 >> 172.21.15.144:0/3916611529 conn(0x7f3cf4068030 msgr2=0x7f3cf40af460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 -- 172.21.15.144:0/3916611529 shutdown_connections 2024-09-12T12:23:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.661+0000 7f3cf9a00640 1 -- 172.21.15.144:0/3916611529 wait complete. 2024-09-12T12:23:31.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:23:31.678 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-09-12T12:23:31.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bbbe00640 1 Processor -- start 2024-09-12T12:23:31.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bbbe00640 1 -- start start 2024-09-12T12:23:31.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bbbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8bb4073c50 0x7f8bb40d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bbbe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb40708b0 con 0x7f8bb40737c0 2024-09-12T12:23:31.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bbbe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb4070b90 con 0x7f8bb415a120 2024-09-12T12:23:31.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bbbe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb4070e70 con 0x7f8bb4073c50 2024-09-12T12:23:31.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bb9e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8bb40737c0 0x7f8bb40d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55834/0 (socket says 172.21.15.144:55834) 2024-09-12T12:23:31.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bb9e00640 1 -- 172.21.15.144:0/3809931229 learned_addr learned my addr 172.21.15.144:0/3809931229 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:31.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/3809931229 >> v2:172.21.15.165:3300/0 conn(0x7f8bb4073c50 0x7f8bb40d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bb3e00640 1 -- 172.21.15.144:0/3809931229 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156149554 0 0) 0x7f8bb40708b0 con 0x7f8bb40737c0 2024-09-12T12:23:31.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bb3e00640 1 -- 172.21.15.144:0/3809931229 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b9c003530 con 0x7f8bb40737c0 2024-09-12T12:23:31.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bb8a00640 1 -- 172.21.15.144:0/3809931229 >> v1:172.21.15.165:6789/0 conn(0x7f8bb415a120 legacy=0x7f8bb40730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bb8a00640 1 -- 172.21.15.144:0/3809931229 >> v1:172.21.15.144:6789/0 conn(0x7f8bb40737c0 legacy=0x7f8bb40d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.817+0000 7f8bb8a00640 1 -- 172.21.15.144:0/3809931229 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb4071150 con 0x7f8bb4073c50 2024-09-12T12:23:31.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/3809931229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4073c50 0x7f8bb40d03a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00097c0 tx=0x7f8ba001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82c920beb9e74443 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bb3e00640 1 -- 172.21.15.144:0/3809931229 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00ab660 con 0x7f8bb4073c50 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bb3e00640 1 -- 172.21.15.144:0/3809931229 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba00b0070 con 0x7f8bb4073c50 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bb3e00640 1 -- 172.21.15.144:0/3809931229 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00aba00 con 0x7f8bb4073c50 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3809931229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4073c50 msgr2=0x7f8bb40d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bbbe00640 1 --2- 172.21.15.144:0/3809931229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4073c50 0x7f8bb40d03a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00097c0 tx=0x7f8ba001c470 comp rx=0 tx=0).stop 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3809931229 shutdown_connections 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bbbe00640 1 --2- 172.21.15.144:0/3809931229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4073c50 0x7f8bb40d03a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3809931229 >> 172.21.15.144:0/3809931229 conn(0x7f8bb40d2400 msgr2=0x7f8bb40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3809931229 shutdown_connections 2024-09-12T12:23:31.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.821+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3809931229 wait complete. 2024-09-12T12:23:31.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 Processor -- start 2024-09-12T12:23:31.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 -- start start 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bb40737c0 0x7f8bb4146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb4073c50 0x7f8bb41442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb415a120 0x7f8bb4155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb416a540 con 0x7f8bb4073c50 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb416a3c0 con 0x7f8bb415a120 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb416a6c0 con 0x7f8bb40737c0 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb4073c50 0x7f8bb41442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bb40737c0 0x7f8bb4146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb4073c50 0x7f8bb41442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43422/0 (socket says 172.21.15.144:43422) 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb9e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb415a120 0x7f8bb4155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb8a00640 1 -- 172.21.15.144:0/3832445154 learned_addr learned my addr 172.21.15.144:0/3832445154 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb9e00640 1 -- 172.21.15.144:0/3832445154 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bb40737c0 msgr2=0x7f8bb4146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb9e00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bb40737c0 0x7f8bb4146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb9e00640 1 -- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb4073c50 msgr2=0x7f8bb41442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb9e00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb4073c50 0x7f8bb41442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb9e00640 1 -- 172.21.15.144:0/3832445154 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb4144830 con 0x7f8bb415a120 2024-09-12T12:23:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb4073c50 0x7f8bb41442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb9e00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb415a120 0x7f8bb4155300 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c3c0 tx=0x7f8bac00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb1600640 1 -- 172.21.15.144:0/3832445154 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac017070 con 0x7f8bb415a120 2024-09-12T12:23:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb1600640 1 -- 172.21.15.144:0/3832445154 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bac005cf0 con 0x7f8bb415a120 2024-09-12T12:23:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bb1600640 1 -- 172.21.15.144:0/3832445154 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac0072d0 con 0x7f8bb415a120 2024-09-12T12:23:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3832445154 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb40b7080 con 0x7f8bb415a120 2024-09-12T12:23:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.825+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3832445154 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb40b7640 con 0x7f8bb415a120 2024-09-12T12:23:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.829+0000 7f8bb1600640 1 -- 172.21.15.144:0/3832445154 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8bac01a070 con 0x7f8bb415a120 2024-09-12T12:23:31.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.829+0000 7f8bb1600640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b940678c0 0x7f8b94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.829+0000 7f8bb1600640 1 -- 172.21.15.144:0/3832445154 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f8bac084fe0 con 0x7f8bb415a120 2024-09-12T12:23:31.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.829+0000 7f8bb9400640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b940678c0 0x7f8b94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.829+0000 7f8bbf2a8000 1 Processor -- start 2024-09-12T12:23:31.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.829+0000 7f8bbf2a8000 1 -- start start 2024-09-12T12:23:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb9400640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b940678c0 0x7f8b94069d80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8bb41541a0 tx=0x7f8ba8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 0x557b24a295b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249dcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 0x557b249dd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557b248c2960 con 0x557b24a29af0 2024-09-12T12:23:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557b24806900 con 0x557b249dd1c0 2024-09-12T12:23:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557b24829d40 con 0x557b24a291d0 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249dcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 0x557b24a295b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249dcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43426/0 (socket says 172.21.15.144:43426) 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb8a00640 1 -- 172.21.15.144:0/2704635062 learned_addr learned my addr 172.21.15.144:0/2704635062 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb9e00640 1 --2- 172.21.15.144:0/2704635062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 0x557b249dd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb8a00640 1 -- 172.21.15.144:0/2704635062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 msgr2=0x557b24a295b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/2704635062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 0x557b24a295b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb8a00640 1 -- 172.21.15.144:0/2704635062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 msgr2=0x557b249dd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/2704635062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 0x557b249dd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb8a00640 1 -- 172.21.15.144:0/2704635062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b247d0580 con 0x557b24a29af0 2024-09-12T12:23:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/2704635062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249dcc80 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0000c10 tx=0x7f8ba0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a4cce12c7db63c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8ba6000640 1 -- 172.21.15.144:0/2704635062 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0004240 con 0x557b24a29af0 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8ba6000640 1 -- 172.21.15.144:0/2704635062 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba00b0040 con 0x557b24a29af0 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8ba6000640 1 -- 172.21.15.144:0/2704635062 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00ab810 con 0x557b24a29af0 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/2704635062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 msgr2=0x557b249dcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/2704635062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249dcc80 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0000c10 tx=0x7f8ba0004740 comp rx=0 tx=0).stop 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/2704635062 shutdown_connections 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/2704635062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 0x557b249dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/2704635062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249dcc80 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/2704635062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 0x557b24a295b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/2704635062 >> 172.21.15.144:0/2704635062 conn(0x557b24a06040 msgr2=0x557b24a08430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/2704635062 shutdown_connections 2024-09-12T12:23:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/2704635062 wait complete. 2024-09-12T12:23:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 -- start start 2024-09-12T12:23:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.833+0000 7f8bbf2a8000 1 Processor -- start 2024-09-12T12:23:31.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 0x557b24a051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a291d0 0x557b24a05710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a29af0 0x557b249ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557b24825d00 con 0x557b24a291d0 2024-09-12T12:23:31.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557b247e4aa0 con 0x557b249dd1c0 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557b247c3340 con 0x557b24a29af0 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 10 client.0 _ll_register_callbacks cb 0x557b249c6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a291d0 0x557b24a05710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a291d0 0x557b24a05710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43442/0 (socket says 172.21.15.144:43442) 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb8a00640 1 -- 172.21.15.144:0/1951765721 learned_addr learned my addr 172.21.15.144:0/1951765721 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb9e00640 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a29af0 0x557b249ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb9400640 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 0x557b24a051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb8a00640 1 -- 172.21.15.144:0/1951765721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a29af0 msgr2=0x557b249ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a29af0 0x557b249ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb8a00640 1 -- 172.21.15.144:0/1951765721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 msgr2=0x557b24a051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 0x557b24a051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb8a00640 1 -- 172.21.15.144:0/1951765721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b247ccdc0 con 0x557b24a291d0 2024-09-12T12:23:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a291d0 0x557b24a05710 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0019080 tx=0x7f8ba001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f3fa0e197c7270 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8b9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8b9aa00640 1 -- 172.21.15.144:0/1951765721 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00c4030 con 0x557b24a291d0 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8b9aa00640 1 -- 172.21.15.144:0/1951765721 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f8ba0004280 con 0x557b24a291d0 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/1951765721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ba00b0040 con 0x557b24a291d0 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8b9aa00640 1 -- 172.21.15.144:0/1951765721 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f8ba0004480 con 0x557b24a291d0 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 10 client.9567 fetch_fsmap learned FSMap version 123 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/1951765721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x557b247c97f0 con 0x557b24a291d0 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8b9aa00640 1 -- 172.21.15.144:0/1951765721 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba00b0040 con 0x557b24a291d0 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8b9aa00640 1 -- 172.21.15.144:0/1951765721 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7f8ba00ab810 con 0x557b24a291d0 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 10 client.9567 fetch_fsmap finished waiting for FSMap version 123 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 10 client.9567 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 20 client.9567 populate_metadata read hostname 'smithi144' 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557b249ead00 0x557b24a3b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 4 client.9567 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:23:31.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/1951765721 --> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b247c3e10 con 0x557b249ead00 2024-09-12T12:23:31.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb9400640 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557b249ead00 0x557b24a3b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bb9400640 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557b249ead00 0x557b24a3b280 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea3a6dfc9b2fc2e2 server_cookie=8234ea14371636e2 in_seq=0 out_seq=0 2024-09-12T12:23:31.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8b9aa00640 10 client.9567 ms_handle_connect on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8b9aa00640 1 -- 172.21.15.144:0/1951765721 <== mds.0 v2:172.21.15.144:6835/2909096469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b247c3e10 con 0x557b249ead00 2024-09-12T12:23:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8b9aa00640 10 client.9567 handle_command_reply: tid=0 2024-09-12T12:23:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.837+0000 7f8bbf2a8000 1 client.9567 shutdown 2024-09-12T12:23:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/1951765721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a291d0 msgr2=0x557b24a05710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a291d0 0x557b24a05710 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0019080 tx=0x7f8ba001acb0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/1951765721 shutdown_connections 2024-09-12T12:23:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557b249ead00 0x557b24a3b280 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a29af0 0x557b249ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a291d0 0x557b24a05710 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/1951765721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b249dd1c0 0x557b24a051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/1951765721 >> 172.21.15.144:0/1951765721 conn(0x557b24a06040 msgr2=0x557b249d7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8b9aa00640 0 client.9567 ms_handle_reset on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/1951765721 shutdown_connections 2024-09-12T12:23:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/1951765721 wait complete. 2024-09-12T12:23:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.841+0000 7f8bbf2a8000 20 client.9567 trim_cache size 0 max 16384 2024-09-12T12:23:31.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bbf2a8000 1 Processor -- start 2024-09-12T12:23:31.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bbf2a8000 1 -- start start 2024-09-12T12:23:31.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b249dd1c0 0x557b24a3e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a291d0 0x557b249e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb41fffb0 con 0x557b24a29af0 2024-09-12T12:23:31.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb406e790 con 0x557b24a291d0 2024-09-12T12:23:31.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb4153430 con 0x557b249dd1c0 2024-09-12T12:23:31.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b249dd1c0 0x557b24a3e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb8a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a291d0 0x557b249e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b249dd1c0 0x557b24a3e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40852/0 (socket says 172.21.15.144:40852) 2024-09-12T12:23:31.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9400640 1 -- 172.21.15.144:0/378363169 learned_addr learned my addr 172.21.15.144:0/378363169 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9400640 1 -- 172.21.15.144:0/378363169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a291d0 msgr2=0x557b249e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9400640 1 --2- 172.21.15.144:0/378363169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a291d0 0x557b249e8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9400640 1 -- 172.21.15.144:0/378363169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 msgr2=0x557b249e93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9400640 1 --2- 172.21.15.144:0/378363169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249e93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9400640 1 -- 172.21.15.144:0/378363169 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b247e7470 con 0x557b249dd1c0 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.857+0000 7f8bb9400640 1 --2- 172.21.15.144:0/378363169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b249dd1c0 0x557b24a3e6d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80164a0 tx=0x7f8ba800a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ea8f8b5941dca2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8ba5600640 1 -- 172.21.15.144:0/378363169 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80160d0 con 0x557b249dd1c0 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8ba5600640 1 -- 172.21.15.144:0/378363169 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba801b040 con 0x557b249dd1c0 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8ba5600640 1 -- 172.21.15.144:0/378363169 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8016270 con 0x557b249dd1c0 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/378363169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b249dd1c0 msgr2=0x557b24a3e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/378363169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b249dd1c0 0x557b24a3e6d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80164a0 tx=0x7f8ba800a000 comp rx=0 tx=0).stop 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/378363169 shutdown_connections 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/378363169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b24a29af0 0x557b249e93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/378363169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a291d0 0x557b249e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/378363169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b249dd1c0 0x557b24a3e6d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/378363169 >> 172.21.15.144:0/378363169 conn(0x557b24a06040 msgr2=0x557b249d7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/378363169 shutdown_connections 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/378363169 wait complete. 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- start start 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 Processor -- start 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b249dd1c0 0x557b24a3e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 0x557b24a59570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a29af0 0x557b24a59ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb406e140 con 0x557b249dd1c0 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557b247e83f0 con 0x557b24a29af0 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557b24869780 con 0x557b24a291d0 2024-09-12T12:23:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 10 client.0 _ll_register_callbacks cb 0x7f8b9c003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b249dd1c0 0x557b24a3e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b249dd1c0 0x557b24a3e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43460/0 (socket says 172.21.15.144:43460) 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9400640 1 -- 172.21.15.144:0/3522956157 learned_addr learned my addr 172.21.15.144:0/3522956157 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 0x557b24a59570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9e00640 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a29af0 0x557b24a59ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9400640 1 -- 172.21.15.144:0/3522956157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 msgr2=0x557b24a59570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9400640 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 0x557b24a59570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9400640 1 -- 172.21.15.144:0/3522956157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a29af0 msgr2=0x557b24a59ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9400640 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a29af0 0x557b24a59ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9400640 1 -- 172.21.15.144:0/3522956157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b247bd640 con 0x557b249dd1c0 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bb9400640 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b249dd1c0 0x557b24a3e110 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8011010 tx=0x7f8ba8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca1dadcd9c91c60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8b9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:23:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8b9aa00640 1 -- 172.21.15.144:0/3522956157 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8031070 con 0x557b249dd1c0 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8b9aa00640 1 -- 172.21.15.144:0/3522956157 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f8ba8036c40 con 0x557b249dd1c0 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.861+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/3522956157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ba801b040 con 0x557b249dd1c0 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8b9aa00640 1 -- 172.21.15.144:0/3522956157 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f8ba803d050 con 0x557b249dd1c0 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 10 client.9573 fetch_fsmap learned FSMap version 123 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/3522956157 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=2+}) -- 0x557b247c13b0 con 0x557b249dd1c0 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8b9aa00640 1 -- 172.21.15.144:0/3522956157 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba801b040 con 0x557b249dd1c0 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8b9aa00640 1 -- 172.21.15.144:0/3522956157 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 123) ==== 3502+0+0 (secure 0 0 0) 0x7f8ba8040020 con 0x557b249dd1c0 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 10 client.9573 fetch_fsmap finished waiting for FSMap version 123 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 10 client.9573 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 20 client.9573 populate_metadata read hostname 'smithi144' 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557b24a59ff0 0x557b24a9d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 4 client.9573 mds_command: new command op to 9363 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/3522956157 --> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557b24837470 con 0x557b24a59ff0 2024-09-12T12:23:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557b24a59ff0 0x557b24a9d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8b9aa00640 10 client.9573 ms_handle_connect on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bb8a00640 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557b24a59ff0 0x557b24a9d1f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aed7d11e7a67ceda server_cookie=35513ef6fcb55263 in_seq=0 out_seq=0 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8b9aa00640 1 -- 172.21.15.144:0/3522956157 <== mds.0 v2:172.21.15.144:6835/2909096469 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x557b24837470 con 0x557b24a59ff0 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8b9aa00640 10 client.9573 handle_command_reply: tid=0 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 client.9573 shutdown 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/3522956157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b249dd1c0 msgr2=0x557b24a3e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b249dd1c0 0x557b24a3e110 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8011010 tx=0x7f8ba8001260 comp rx=0 tx=0).stop 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/3522956157 shutdown_connections 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.144:6835/2909096469,v1:172.21.15.144:6837/2909096469] conn(0x557b24a59ff0 0x557b24a9d1f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b24a29af0 0x557b24a59ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557b24a291d0 0x557b24a59570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 --2- 172.21.15.144:0/3522956157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557b249dd1c0 0x557b24a3e110 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8b9aa00640 0 client.9573 ms_handle_reset on v2:172.21.15.144:6835/2909096469 2024-09-12T12:23:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/3522956157 >> 172.21.15.144:0/3522956157 conn(0x557b24a06040 msgr2=0x557b249d7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/3522956157 shutdown_connections 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 1 -- 172.21.15.144:0/3522956157 wait complete. 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbf2a8000 20 client.9573 trim_cache size 0 max 16384 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "7962b4e4-d9a6-4d69-ab35-4e75bada238c": { 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/scrub_control_test_path", 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "7962b4e4-d9a6-4d69-ab35-4e75bada238c", 2024-09-12T12:23:31.870 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "recursive" 2024-09-12T12:23:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:31.871 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:23:31.871 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:23:31.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b940678c0 msgr2=0x7f8b94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b940678c0 0x7f8b94069d80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8bb41541a0 tx=0x7f8ba8009040 comp rx=0 tx=0).stop 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3832445154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb415a120 msgr2=0x7f8bb4155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb415a120 0x7f8bb4155300 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c3c0 tx=0x7f8bac00c880 comp rx=0 tx=0).stop 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3832445154 shutdown_connections 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8b940678c0 0x7f8b94069d80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb415a120 0x7f8bb4155300 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb4073c50 0x7f8bb41442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 --2- 172.21.15.144:0/3832445154 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bb40737c0 0x7f8bb4146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3832445154 >> 172.21.15.144:0/3832445154 conn(0x7f8bb40d2400 msgr2=0x7f8bb40d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3832445154 shutdown_connections 2024-09-12T12:23:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:31.865+0000 7f8bbbe00640 1 -- 172.21.15.144:0/3832445154 wait complete. 2024-09-12T12:23:31.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:32.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9b5600640 1 Processor -- start 2024-09-12T12:23:32.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9b5600640 1 -- start start 2024-09-12T12:23:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9b5600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb9b015b4e0 0x7fb9b00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9b5600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 0x7fb9b0071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9b5600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b00b45a0 con 0x7fb9b0071960 2024-09-12T12:23:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9b5600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b00b3fe0 con 0x7fb9b015b4e0 2024-09-12T12:23:32.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9b5600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b00b42c0 con 0x7fb9b00b3ad0 2024-09-12T12:23:32.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9af400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb9b0071960 0x7fb9b00ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55846/0 (socket says 172.21.15.144:55846) 2024-09-12T12:23:32.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9af400640 1 -- 172.21.15.144:0/4028113534 learned_addr learned my addr 172.21.15.144:0/4028113534 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:32.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9ae000640 1 --2- 172.21.15.144:0/4028113534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 0x7fb9b0071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.021+0000 7fb9aea00640 1 --2- 172.21.15.144:0/4028113534 >> v2:172.21.15.165:3300/0 conn(0x7fb9b015b4e0 0x7fb9b00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ad600640 1 -- 172.21.15.144:0/4028113534 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444787835 0 0) 0x7fb9b00b45a0 con 0x7fb9b0071960 2024-09-12T12:23:32.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ad600640 1 -- 172.21.15.144:0/4028113534 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb994005740 con 0x7fb9b0071960 2024-09-12T12:23:32.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ae000640 1 -- 172.21.15.144:0/4028113534 >> v2:172.21.15.165:3300/0 conn(0x7fb9b015b4e0 msgr2=0x7fb9b00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:32.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ae000640 1 --2- 172.21.15.144:0/4028113534 >> v2:172.21.15.165:3300/0 conn(0x7fb9b015b4e0 0x7fb9b00b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ae000640 1 -- 172.21.15.144:0/4028113534 >> v1:172.21.15.144:6789/0 conn(0x7fb9b0071960 legacy=0x7fb9b00ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ae000640 1 -- 172.21.15.144:0/4028113534 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b00b1490 con 0x7fb9b00b3ad0 2024-09-12T12:23:32.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ae000640 1 --2- 172.21.15.144:0/4028113534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 0x7fb9b0071420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0097c0 tx=0x7fb99c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21a8d690a09a9d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:32.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ad600640 1 -- 172.21.15.144:0/4028113534 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0aa5f0 con 0x7fb9b00b3ad0 2024-09-12T12:23:32.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ad600640 1 -- 172.21.15.144:0/4028113534 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c0af070 con 0x7fb9b00b3ad0 2024-09-12T12:23:32.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9ad600640 1 -- 172.21.15.144:0/4028113534 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0aa9b0 con 0x7fb9b00b3ad0 2024-09-12T12:23:32.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9b5600640 1 -- 172.21.15.144:0/4028113534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 msgr2=0x7fb9b0071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9b5600640 1 --2- 172.21.15.144:0/4028113534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 0x7fb9b0071420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0097c0 tx=0x7fb99c01c470 comp rx=0 tx=0).stop 2024-09-12T12:23:32.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9b5600640 1 -- 172.21.15.144:0/4028113534 shutdown_connections 2024-09-12T12:23:32.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9b5600640 1 --2- 172.21.15.144:0/4028113534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 0x7fb9b0071420 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9b5600640 1 --2- 172.21.15.144:0/4028113534 >> v2:172.21.15.165:3300/0 conn(0x7fb9b015b4e0 0x7fb9b00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9b5600640 1 -- 172.21.15.144:0/4028113534 >> 172.21.15.144:0/4028113534 conn(0x7fb9b006d0d0 msgr2=0x7fb9b006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:32.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9b5600640 1 -- 172.21.15.144:0/4028113534 shutdown_connections 2024-09-12T12:23:32.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.025+0000 7fb9b5600640 1 -- 172.21.15.144:0/4028113534 wait complete. 2024-09-12T12:23:32.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9b5600640 1 Processor -- start 2024-09-12T12:23:32.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9b5600640 1 -- start start 2024-09-12T12:23:32.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9b5600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9b0071960 0x7fb9b014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9b5600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 0x7fb9b015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9b5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9b015b4e0 0x7fb9b0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9b5600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b00b2620 con 0x7fb9b015b4e0 2024-09-12T12:23:32.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9b5600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b00b24a0 con 0x7fb9b0071960 2024-09-12T12:23:32.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9b5600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b00cd640 con 0x7fb9b00b3ad0 2024-09-12T12:23:32.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9b015b4e0 0x7fb9b0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9b015b4e0 0x7fb9b0154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43472/0 (socket says 172.21.15.144:43472) 2024-09-12T12:23:32.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9af400640 1 -- 172.21.15.144:0/777741482 learned_addr learned my addr 172.21.15.144:0/777741482 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:32.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9aea00640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9b0071960 0x7fb9b014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9ae000640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 0x7fb9b015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9af400640 1 -- 172.21.15.144:0/777741482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 msgr2=0x7fb9b015cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9af400640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 0x7fb9b015cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9af400640 1 -- 172.21.15.144:0/777741482 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9b0071960 msgr2=0x7fb9b014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9af400640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9b0071960 0x7fb9b014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9af400640 1 -- 172.21.15.144:0/777741482 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b0155690 con 0x7fb9b015b4e0 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9af400640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9b015b4e0 0x7fb9b0154d60 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800cb10 tx=0x7fb9a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9a6a00640 1 -- 172.21.15.144:0/777741482 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8017070 con 0x7fb9b015b4e0 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9a6a00640 1 -- 172.21.15.144:0/777741482 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a800ac70 con 0x7fb9b015b4e0 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9a6a00640 1 -- 172.21.15.144:0/777741482 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a800ae60 con 0x7fb9b015b4e0 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.029+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b0155970 con 0x7fb9b015b4e0 2024-09-12T12:23:32.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.033+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b0157690 con 0x7fb9b015b4e0 2024-09-12T12:23:32.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.033+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b0071420 con 0x7fb9b015b4e0 2024-09-12T12:23:32.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.033+0000 7fb9a6a00640 1 -- 172.21.15.144:0/777741482 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9a801a070 con 0x7fb9b015b4e0 2024-09-12T12:23:32.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.033+0000 7fb9a6a00640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9900678c0 0x7fb990069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.033+0000 7fb9a6a00640 1 -- 172.21.15.144:0/777741482 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7fb9a8085c40 con 0x7fb9b015b4e0 2024-09-12T12:23:32.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.033+0000 7fb9aea00640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9900678c0 0x7fb990069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.033+0000 7fb9aea00640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9900678c0 0x7fb990069d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009aa0 tx=0x7fb9a0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:32.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.037+0000 7fb9a6a00640 1 -- 172.21.15.144:0/777741482 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb9a8055f00 con 0x7fb9b015b4e0 2024-09-12T12:23:32.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.229+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9b0153000 con 0x7fb9b015b4e0 2024-09-12T12:23:32.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.229+0000 7fb9a6a00640 1 -- 172.21.15.144:0/777741482 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7fb9a805a200 con 0x7fb9b015b4e0 2024-09-12T12:23:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:32.229 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:32.229 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9900678c0 msgr2=0x7fb990069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9900678c0 0x7fb990069d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009aa0 tx=0x7fb9a0009190 comp rx=0 tx=0).stop 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9b015b4e0 msgr2=0x7fb9b0154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9b015b4e0 0x7fb9b0154d60 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800cb10 tx=0x7fb9a800a060 comp rx=0 tx=0).stop 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 shutdown_connections 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb9900678c0 0x7fb990069d80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9b015b4e0 0x7fb9b0154d60 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9b00b3ad0 0x7fb9b015cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 --2- 172.21.15.144:0/777741482 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9b0071960 0x7fb9b014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 >> 172.21.15.144:0/777741482 conn(0x7fb9b006d0d0 msgr2=0x7fb9b015f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 shutdown_connections 2024-09-12T12:23:32.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.233+0000 7fb9b5600640 1 -- 172.21.15.144:0/777741482 wait complete. 2024-09-12T12:23:32.249 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-12T12:23:32.249 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:23:32.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.385+0000 7f5157000640 1 Processor -- start 2024-09-12T12:23:32.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.385+0000 7f5157000640 1 -- start start 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5157000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51500aff50 0x7f5150072710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5157000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500b0330 0x7f5150072c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5157000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f515015f800 con 0x7f515006ea40 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5157000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f51500b5fc0 con 0x7f51500aff50 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5157000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f515006dc80 con 0x7f51500b0330 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5155c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51500aff50 0x7f5150072710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5156600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f515006ea40 0x7f515015ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55854/0 (socket says 172.21.15.144:55854) 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5156600640 1 -- 172.21.15.144:0/2881557428 learned_addr learned my addr 172.21.15.144:0/2881557428 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5155200640 1 --2- 172.21.15.144:0/2881557428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500b0330 0x7f5150072c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5155200640 1 -- 172.21.15.144:0/2881557428 >> v2:172.21.15.144:3300/0 conn(0x7f51500aff50 msgr2=0x7f5150072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5155200640 1 --2- 172.21.15.144:0/2881557428 >> v2:172.21.15.144:3300/0 conn(0x7f51500aff50 0x7f5150072710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5155200640 1 -- 172.21.15.144:0/2881557428 >> v1:172.21.15.144:6789/0 conn(0x7f515006ea40 legacy=0x7f515015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5155200640 1 -- 172.21.15.144:0/2881557428 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515006df60 con 0x7f51500b0330 2024-09-12T12:23:32.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.389+0000 7f5155c00640 1 --2- 172.21.15.144:0/2881557428 >> v2:172.21.15.144:3300/0 conn(0x7f51500aff50 0x7f5150072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:32.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5155200640 1 --2- 172.21.15.144:0/2881557428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500b0330 0x7f5150072c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f513c0097c0 tx=0x7f513c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e49b302dfe8733ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:32.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f514fe00640 1 -- 172.21.15.144:0/2881557428 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c0b2070 con 0x7f51500b0330 2024-09-12T12:23:32.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f514fe00640 1 -- 172.21.15.144:0/2881557428 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513c0ad680 con 0x7f51500b0330 2024-09-12T12:23:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f514fe00640 1 -- 172.21.15.144:0/2881557428 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c0ada50 con 0x7f51500b0330 2024-09-12T12:23:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 -- 172.21.15.144:0/2881557428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500b0330 msgr2=0x7f5150072c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 --2- 172.21.15.144:0/2881557428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500b0330 0x7f5150072c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f513c0097c0 tx=0x7f513c01c470 comp rx=0 tx=0).stop 2024-09-12T12:23:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 -- 172.21.15.144:0/2881557428 shutdown_connections 2024-09-12T12:23:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 --2- 172.21.15.144:0/2881557428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500b0330 0x7f5150072c50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 --2- 172.21.15.144:0/2881557428 >> v2:172.21.15.144:3300/0 conn(0x7f51500aff50 0x7f5150072710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 -- 172.21.15.144:0/2881557428 >> 172.21.15.144:0/2881557428 conn(0x7f515006cb10 msgr2=0x7f515006cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 -- 172.21.15.144:0/2881557428 shutdown_connections 2024-09-12T12:23:32.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 -- 172.21.15.144:0/2881557428 wait complete. 2024-09-12T12:23:32.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 Processor -- start 2024-09-12T12:23:32.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.393+0000 7f5157000640 1 -- start start 2024-09-12T12:23:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5157000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f515006ea40 0x7f5150151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5157000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500aff50 0x7f5150158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5157000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5150158f40 0x7f51500ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5157000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5150155720 con 0x7f5150158f40 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5157000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f51501555a0 con 0x7f515006ea40 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5157000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51500b4fb0 con 0x7f51500aff50 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5156600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5150158f40 0x7f51500ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5156600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5150158f40 0x7f51500ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43494/0 (socket says 172.21.15.144:43494) 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5156600640 1 -- 172.21.15.144:0/3736981029 learned_addr learned my addr 172.21.15.144:0/3736981029 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5155200640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500aff50 0x7f5150158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5155c00640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f515006ea40 0x7f5150151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5156600640 1 -- 172.21.15.144:0/3736981029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500aff50 msgr2=0x7f5150158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5156600640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500aff50 0x7f5150158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5156600640 1 -- 172.21.15.144:0/3736981029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f515006ea40 msgr2=0x7f5150151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5156600640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f515006ea40 0x7f5150151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5156600640 1 -- 172.21.15.144:0/3736981029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51501564e0 con 0x7f5150158f40 2024-09-12T12:23:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5155200640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500aff50 0x7f5150158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:23:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5156600640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5150158f40 0x7f51500ce4e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f514800c430 tx=0x7f514800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f514d600640 1 -- 172.21.15.144:0/3736981029 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148017070 con 0x7f5150158f40 2024-09-12T12:23:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f514d600640 1 -- 172.21.15.144:0/3736981029 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5148005cf0 con 0x7f5150158f40 2024-09-12T12:23:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f514d600640 1 -- 172.21.15.144:0/3736981029 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51480072d0 con 0x7f5150158f40 2024-09-12T12:23:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5150156780 con 0x7f5150158f40 2024-09-12T12:23:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5150156d40 con 0x7f5150158f40 2024-09-12T12:23:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5150161ac0 con 0x7f5150158f40 2024-09-12T12:23:32.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.397+0000 7f514d600640 1 -- 172.21.15.144:0/3736981029 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f514801a070 con 0x7f5150158f40 2024-09-12T12:23:32.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.401+0000 7f514d600640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51300678c0 0x7f5130069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:32.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.401+0000 7f514d600640 1 -- 172.21.15.144:0/3736981029 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f51480850d0 con 0x7f5150158f40 2024-09-12T12:23:32.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.401+0000 7f5155c00640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51300678c0 0x7f5130069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:32.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.401+0000 7f5155c00640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51300678c0 0x7f5130069d80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5150072130 tx=0x7f514400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:32.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.405+0000 7f514d600640 1 -- 172.21.15.144:0/3736981029 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5148055410 con 0x7f5150158f40 2024-09-12T12:23:32.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.617+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f515006f2a0 con 0x7f5150158f40 2024-09-12T12:23:32.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.617+0000 7f514d600640 1 -- 172.21.15.144:0/3736981029 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7f5148059710 con 0x7f5150158f40 2024-09-12T12:23:32.618 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:32.618 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":672,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":165,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":955,"data_bytes":978693916,"bytes_used":2364084224,"bytes_avail":770730029056,"bytes_total":773094113280,"write_bytes_sec":51514123,"read_op_per_sec":0,"write_op_per_sec":52},"fsmap":{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9363}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-12T12:22:45.504854+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:23:32.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51300678c0 msgr2=0x7f5130069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51300678c0 0x7f5130069d80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5150072130 tx=0x7f514400b040 comp rx=0 tx=0).stop 2024-09-12T12:23:32.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5150158f40 msgr2=0x7f51500ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:32.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5150158f40 0x7f51500ce4e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f514800c430 tx=0x7f514800c8f0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 shutdown_connections 2024-09-12T12:23:32.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51300678c0 0x7f5130069d80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5150158f40 0x7f51500ce4e0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51500aff50 0x7f5150158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 --2- 172.21.15.144:0/3736981029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f515006ea40 0x7f5150151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:32.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 >> 172.21.15.144:0/3736981029 conn(0x7f515006cb10 msgr2=0x7f51500b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:32.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 shutdown_connections 2024-09-12T12:23:32.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:32.621+0000 7f5157000640 1 -- 172.21.15.144:0/3736981029 wait complete. 2024-09-12T12:23:32.640 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:23:33.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb045000640 1 Processor -- start 2024-09-12T12:23:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb045000640 1 -- start start 2024-09-12T12:23:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb045000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb04015b4e0 0x7fb0400b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb045000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0400ccf30 0x7fb0400cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb045000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0400b45a0 con 0x7fb0400b3ad0 2024-09-12T12:23:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb045000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb0400cd8e0 con 0x7fb04015b4e0 2024-09-12T12:23:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb045000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0400b3fe0 con 0x7fb0400ccf30 2024-09-12T12:23:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb03de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb04015b4e0 0x7fb0400b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb03de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb04015b4e0 0x7fb0400b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43496/0 (socket says 172.21.15.144:43496) 2024-09-12T12:23:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb03de00640 1 -- 172.21.15.144:0/1067596216 learned_addr learned my addr 172.21.15.144:0/1067596216 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:33.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb03d400640 1 --1- 172.21.15.144:0/1067596216 >> v1:172.21.15.144:6789/0 conn(0x7fb0400b3ad0 0x7fb040071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55860/0 (socket says 172.21.15.144:55860) 2024-09-12T12:23:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb03de00640 1 -- 172.21.15.144:0/1067596216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0400ccf30 msgr2=0x7fb0400cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb03de00640 1 --2- 172.21.15.144:0/1067596216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0400ccf30 0x7fb0400cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb03de00640 1 -- 172.21.15.144:0/1067596216 >> v1:172.21.15.144:6789/0 conn(0x7fb0400b3ad0 legacy=0x7fb040071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:33.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.789+0000 7fb03de00640 1 -- 172.21.15.144:0/1067596216 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0400b42c0 con 0x7fb04015b4e0 2024-09-12T12:23:33.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb03de00640 1 --2- 172.21.15.144:0/1067596216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04015b4e0 0x7fb0400b3590 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fb030009e50 tx=0x7fb03001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad55844add99fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:33.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb03ca00640 1 -- 172.21.15.144:0/1067596216 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300a58d0 con 0x7fb04015b4e0 2024-09-12T12:23:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb03ca00640 1 -- 172.21.15.144:0/1067596216 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0300a5a70 con 0x7fb04015b4e0 2024-09-12T12:23:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb03ca00640 1 -- 172.21.15.144:0/1067596216 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300a5e40 con 0x7fb04015b4e0 2024-09-12T12:23:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb045000640 1 -- 172.21.15.144:0/1067596216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04015b4e0 msgr2=0x7fb0400b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb045000640 1 --2- 172.21.15.144:0/1067596216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04015b4e0 0x7fb0400b3590 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fb030009e50 tx=0x7fb03001ca00 comp rx=0 tx=0).stop 2024-09-12T12:23:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb045000640 1 -- 172.21.15.144:0/1067596216 shutdown_connections 2024-09-12T12:23:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb045000640 1 --2- 172.21.15.144:0/1067596216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0400ccf30 0x7fb0400cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb045000640 1 --2- 172.21.15.144:0/1067596216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb04015b4e0 0x7fb0400b3590 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb045000640 1 -- 172.21.15.144:0/1067596216 >> 172.21.15.144:0/1067596216 conn(0x7fb04006d0d0 msgr2=0x7fb04006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:33.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb045000640 1 -- 172.21.15.144:0/1067596216 shutdown_connections 2024-09-12T12:23:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.793+0000 7fb045000640 1 -- 172.21.15.144:0/1067596216 wait complete. 2024-09-12T12:23:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 Processor -- start 2024-09-12T12:23:33.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 -- start start 2024-09-12T12:23:33.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0400b3ad0 0x7fb040156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:33.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0400ccf30 0x7fb04015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:33.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb04015b4e0 0x7fb040153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:33.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb04015b8c0 con 0x7fb0400ccf30 2024-09-12T12:23:33.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0400cdef0 con 0x7fb04015b4e0 2024-09-12T12:23:33.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb040157d30 con 0x7fb0400b3ad0 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0400ccf30 0x7fb04015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0400ccf30 0x7fb04015f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43502/0 (socket says 172.21.15.144:43502) 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03d400640 1 -- 172.21.15.144:0/1597795284 learned_addr learned my addr 172.21.15.144:0/1597795284 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03de00640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0400b3ad0 0x7fb040156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03e800640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb04015b4e0 0x7fb040153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03d400640 1 -- 172.21.15.144:0/1597795284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0400b3ad0 msgr2=0x7fb040156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03d400640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0400b3ad0 0x7fb040156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03d400640 1 -- 172.21.15.144:0/1597795284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb04015b4e0 msgr2=0x7fb040153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03d400640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb04015b4e0 0x7fb040153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03d400640 1 -- 172.21.15.144:0/1597795284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb040159570 con 0x7fb0400ccf30 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03e800640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb04015b4e0 0x7fb040153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb03d400640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0400ccf30 0x7fb04015f200 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c420 tx=0x7fb02800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:33.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb036000640 1 -- 172.21.15.144:0/1597795284 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0280074e0 con 0x7fb0400ccf30 2024-09-12T12:23:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb036000640 1 -- 172.21.15.144:0/1597795284 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb028007680 con 0x7fb0400ccf30 2024-09-12T12:23:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb040157120 con 0x7fb0400ccf30 2024-09-12T12:23:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb036000640 1 -- 172.21.15.144:0/1597795284 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028004a30 con 0x7fb0400ccf30 2024-09-12T12:23:33.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.797+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0401579c0 con 0x7fb0400ccf30 2024-09-12T12:23:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.801+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0400cd3a0 con 0x7fb0400ccf30 2024-09-12T12:23:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.801+0000 7fb036000640 1 -- 172.21.15.144:0/1597795284 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb02801a020 con 0x7fb0400ccf30 2024-09-12T12:23:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.801+0000 7fb036000640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb01c0678c0 0x7fb01c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.801+0000 7fb036000640 1 -- 172.21.15.144:0/1597795284 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7fb0280855d0 con 0x7fb0400ccf30 2024-09-12T12:23:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.801+0000 7fb03de00640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb01c0678c0 0x7fb01c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.801+0000 7fb03de00640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb01c0678c0 0x7fb01c069d80 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb0300ae000 tx=0x7fb0300a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:33.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.805+0000 7fb036000640 1 -- 172.21.15.144:0/1597795284 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb040159570 con 0x7fb0400ccf30 2024-09-12T12:23:33.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0401657d0 con 0x7fb0400ccf30 2024-09-12T12:23:33.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb036000640 1 -- 172.21.15.144:0/1597795284 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7fb028056010 con 0x7fb0400ccf30 2024-09-12T12:23:33.996 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:33.996 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:33.996 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:33.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb01c0678c0 msgr2=0x7fb01c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:33.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb01c0678c0 0x7fb01c069d80 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb0300ae000 tx=0x7fb0300a7070 comp rx=0 tx=0).stop 2024-09-12T12:23:33.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0400ccf30 msgr2=0x7fb04015f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:33.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0400ccf30 0x7fb04015f200 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c420 tx=0x7fb02800c8e0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 shutdown_connections 2024-09-12T12:23:33.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb01c0678c0 0x7fb01c069d80 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb04015b4e0 0x7fb040153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0400ccf30 0x7fb04015f200 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 --2- 172.21.15.144:0/1597795284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0400b3ad0 0x7fb040156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:33.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:33.997+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 >> 172.21.15.144:0/1597795284 conn(0x7fb04006d0d0 msgr2=0x7fb0400ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:33.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.001+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 shutdown_connections 2024-09-12T12:23:33.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.001+0000 7fb045000640 1 -- 172.21.15.144:0/1597795284 wait complete. 2024-09-12T12:23:34.018 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-12T12:23:34.019 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:23:34.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe3800640 1 Processor -- start 2024-09-12T12:23:34.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe3800640 1 -- start start 2024-09-12T12:23:34.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0b1380 0x7f3fdc0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe3800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fdc0d0e40 con 0x7f3fdc072840 2024-09-12T12:23:34.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe3800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fdc0d1120 con 0x7f3fdc15e9d0 2024-09-12T12:23:34.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc06f330 con 0x7f3fdc0b1380 2024-09-12T12:23:34.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3fdc072840 0x7f3fdc06e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55872/0 (socket says 172.21.15.144:55872) 2024-09-12T12:23:34.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdbe00640 1 -- 172.21.15.144:0/3318379132 learned_addr learned my addr 172.21.15.144:0/3318379132 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:34.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe1800640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0b1380 0x7f3fdc0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294078717 0 0) 0x7f3fdc0d0e40 con 0x7f3fdc072840 2024-09-12T12:23:34.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fc4003530 con 0x7f3fdc072840 2024-09-12T12:23:34.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3979083596 0 0) 0x7f3fc4003530 con 0x7f3fdc072840 2024-09-12T12:23:34.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0b1380 msgr2=0x7f3fdc0d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:34.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0b1380 0x7f3fdc0d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 >> v1:172.21.15.165:6789/0 conn(0x7f3fdc15e9d0 legacy=0x7f3fdc072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc06f610 con 0x7f3fdc072840 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f3fc80016a0 con 0x7f3fdc072840 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 >> v1:172.21.15.144:6789/0 conn(0x7f3fdc072840 legacy=0x7f3fdc06e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0b1380 0x7f3fc4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fc4004d50 0x7f3fc40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc06f330 con 0x7f3fc40039f0 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc400ba00 con 0x7f3fc4004d50 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc400bc00 con 0x7f3fdc0b1380 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe0e00640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fdbe00640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0b1380 0x7f3fc4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe1800640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fc4004d50 0x7f3fc40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe0e00640 1 -- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0b1380 msgr2=0x7f3fc4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:34.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe0e00640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0b1380 0x7f3fc4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe0e00640 1 -- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fc4004d50 msgr2=0x7f3fc40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:34.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe0e00640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fc4004d50 0x7f3fc40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe0e00640 1 -- 172.21.15.144:0/3318379132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc4003530 con 0x7f3fc40039f0 2024-09-12T12:23:34.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.157+0000 7f3fe1800640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fc4004d50 0x7f3fc40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:34.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fe0e00640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fc4003dd0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0001860 tx=0x7f3fd001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798d115352a68190 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:34.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00b5070 con 0x7f3fc40039f0 2024-09-12T12:23:34.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd00a87f0 con 0x7f3fc40039f0 2024-09-12T12:23:34.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fdb400640 1 -- 172.21.15.144:0/3318379132 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0001460 con 0x7f3fc40039f0 2024-09-12T12:23:34.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fe3800640 1 -- 172.21.15.144:0/3318379132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 msgr2=0x7f3fc4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fe3800640 1 --2- 172.21.15.144:0/3318379132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fc4003dd0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0001860 tx=0x7f3fd001ebd0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fe1800640 1 -- 172.21.15.144:0/3318379132 reap_dead start 2024-09-12T12:23:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fe3800640 1 -- 172.21.15.144:0/3318379132 shutdown_connections 2024-09-12T12:23:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fe3800640 1 -- 172.21.15.144:0/3318379132 >> 172.21.15.144:0/3318379132 conn(0x7f3fdc0703a0 msgr2=0x7f3fdc0d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fe3800640 1 -- 172.21.15.144:0/3318379132 shutdown_connections 2024-09-12T12:23:34.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.161+0000 7f3fe3800640 1 -- 172.21.15.144:0/3318379132 wait complete. 2024-09-12T12:23:34.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 Processor -- start 2024-09-12T12:23:34.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 -- start start 2024-09-12T12:23:34.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fdc1f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fdc0c6630 0x7f3fdc0ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0aed60 0x7f3fdc148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc0d1df0 con 0x7f3fc40039f0 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc0d1c70 con 0x7f3fdc0c6630 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc0d1f70 con 0x7f3fdc0aed60 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fdc1f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fdc1f54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43524/0 (socket says 172.21.15.144:43524) 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe0e00640 1 -- 172.21.15.144:0/736034286 learned_addr learned my addr 172.21.15.144:0/736034286 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fdbe00640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fdc0c6630 0x7f3fdc0ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe1800640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0aed60 0x7f3fdc148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe0e00640 1 -- 172.21.15.144:0/736034286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0aed60 msgr2=0x7f3fdc148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe0e00640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0aed60 0x7f3fdc148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe0e00640 1 -- 172.21.15.144:0/736034286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fdc0c6630 msgr2=0x7f3fdc0ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe0e00640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fdc0c6630 0x7f3fdc0ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe0e00640 1 -- 172.21.15.144:0/736034286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc0ad780 con 0x7f3fc40039f0 2024-09-12T12:23:34.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe0e00640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fdc1f54f0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00b3040 tx=0x7f3fc4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:34.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fd8c00640 1 -- 172.21.15.144:0/736034286 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd00b5040 con 0x7f3fc40039f0 2024-09-12T12:23:34.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fd8c00640 1 -- 172.21.15.144:0/736034286 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd0005070 con 0x7f3fc40039f0 2024-09-12T12:23:34.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc0ada60 con 0x7f3fc40039f0 2024-09-12T12:23:34.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fd8c00640 1 -- 172.21.15.144:0/736034286 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0005420 con 0x7f3fc40039f0 2024-09-12T12:23:34.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.165+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc0ae020 con 0x7f3fc40039f0 2024-09-12T12:23:34.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.169+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fdc06fb30 con 0x7f3fc40039f0 2024-09-12T12:23:34.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.169+0000 7f3fd8c00640 1 -- 172.21.15.144:0/736034286 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3fd00b8070 con 0x7f3fc40039f0 2024-09-12T12:23:34.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.169+0000 7f3fd8c00640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fbc0678c0 0x7f3fbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:34.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.169+0000 7f3fd8c00640 1 -- 172.21.15.144:0/736034286 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f3fd01235b0 con 0x7f3fc40039f0 2024-09-12T12:23:34.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.169+0000 7f3fdbe00640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fbc0678c0 0x7f3fbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:34.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.169+0000 7f3fdbe00640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fbc0678c0 0x7f3fbc069d80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001d10 tx=0x7f3fc8007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:34.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.173+0000 7f3fd8c00640 1 -- 172.21.15.144:0/736034286 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3fd00188e0 con 0x7f3fc40039f0 2024-09-12T12:23:34.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.389+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3fdc0b25d0 con 0x7f3fc40039f0 2024-09-12T12:23:34.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.389+0000 7f3fd8c00640 1 -- 172.21.15.144:0/736034286 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7f3fd00f3f50 con 0x7f3fc40039f0 2024-09-12T12:23:34.390 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:34.390 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":674,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":165,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":955,"data_bytes":978693916,"bytes_used":2364084224,"bytes_avail":770730029056,"bytes_total":773094113280,"write_bytes_sec":45700291,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9363}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-12T12:22:45.504854+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:23:34.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fbc0678c0 msgr2=0x7f3fbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fbc0678c0 0x7f3fbc069d80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001d10 tx=0x7f3fc8007040 comp rx=0 tx=0).stop 2024-09-12T12:23:34.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 msgr2=0x7f3fdc1f54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:34.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fdc1f54f0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00b3040 tx=0x7f3fc4005840 comp rx=0 tx=0).stop 2024-09-12T12:23:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 shutdown_connections 2024-09-12T12:23:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3fbc0678c0 0x7f3fbc069d80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fdc0aed60 0x7f3fdc148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fdc0c6630 0x7f3fdc0ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 --2- 172.21.15.144:0/736034286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fc40039f0 0x7f3fdc1f54f0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 >> 172.21.15.144:0/736034286 conn(0x7f3fdc0703a0 msgr2=0x7f3fdc0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 shutdown_connections 2024-09-12T12:23:34.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:34.393+0000 7f3fe3800640 1 -- 172.21.15.144:0/736034286 wait complete. 2024-09-12T12:23:34.410 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:23:35.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5696e00640 1 Processor -- start 2024-09-12T12:23:35.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5696e00640 1 -- start start 2024-09-12T12:23:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5696e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f569006bc10 0x7f569006c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5696e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f569015c9a0 0x7f569015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5696e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56900cee10 con 0x7f5690160970 2024-09-12T12:23:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5696e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f569006c5b0 con 0x7f569015c9a0 2024-09-12T12:23:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5696e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f56900d07d0 con 0x7f569006bc10 2024-09-12T12:23:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f568fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5690160970 0x7f56900ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55882/0 (socket says 172.21.15.144:55882) 2024-09-12T12:23:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f568fe00640 1 -- 172.21.15.144:0/3453993679 learned_addr learned my addr 172.21.15.144:0/3453993679 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5694e00640 1 --2- 172.21.15.144:0/3453993679 >> v2:172.21.15.144:3300/0 conn(0x7f569015c9a0 0x7f569015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f568f400640 1 --2- 172.21.15.144:0/3453993679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f569006bc10 0x7f569006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5694e00640 1 -- 172.21.15.144:0/3453993679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f569006bc10 msgr2=0x7f569006c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5694e00640 1 --2- 172.21.15.144:0/3453993679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f569006bc10 0x7f569006c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5694e00640 1 -- 172.21.15.144:0/3453993679 >> v1:172.21.15.144:6789/0 conn(0x7f5690160970 legacy=0x7f56900ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f5694e00640 1 -- 172.21.15.144:0/3453993679 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56900d0ab0 con 0x7f569015c9a0 2024-09-12T12:23:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.565+0000 7f568ea00640 1 -- 172.21.15.144:0/3453993679 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1030592353 0 0) 0x7f56900cee10 con 0x7f5690160970 2024-09-12T12:23:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5694e00640 1 --2- 172.21.15.144:0/3453993679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 0x7f569015ce30 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f5688009d90 tx=0x7f568801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ce143f09efcbfc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f568ea00640 1 -- 172.21.15.144:0/3453993679 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56880b2070 con 0x7f569015c9a0 2024-09-12T12:23:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f568ea00640 1 -- 172.21.15.144:0/3453993679 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56880a57c0 con 0x7f569015c9a0 2024-09-12T12:23:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f568ea00640 1 -- 172.21.15.144:0/3453993679 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56880a5b90 con 0x7f569015c9a0 2024-09-12T12:23:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 -- 172.21.15.144:0/3453993679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 msgr2=0x7f569015ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 --2- 172.21.15.144:0/3453993679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 0x7f569015ce30 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f5688009d90 tx=0x7f568801c8e0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 -- 172.21.15.144:0/3453993679 shutdown_connections 2024-09-12T12:23:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 --2- 172.21.15.144:0/3453993679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 0x7f569015ce30 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 --2- 172.21.15.144:0/3453993679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f569006bc10 0x7f569006c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 -- 172.21.15.144:0/3453993679 >> 172.21.15.144:0/3453993679 conn(0x7f56900b3380 msgr2=0x7f56900b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 -- 172.21.15.144:0/3453993679 shutdown_connections 2024-09-12T12:23:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 -- 172.21.15.144:0/3453993679 wait complete. 2024-09-12T12:23:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 Processor -- start 2024-09-12T12:23:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.569+0000 7f5696e00640 1 -- start start 2024-09-12T12:23:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5696e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f569006bc10 0x7f5690153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5696e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 0x7f56901529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5696e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5690160970 0x7f5690156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5696e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f56900ceb70 con 0x7f569015c9a0 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5696e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56900ce9f0 con 0x7f569006bc10 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5696e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f569015d780 con 0x7f5690160970 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 0x7f56901529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 0x7f56901529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43542/0 (socket says 172.21.15.144:43542) 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568f400640 1 -- 172.21.15.144:0/877067219 learned_addr learned my addr 172.21.15.144:0/877067219 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568fe00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f569006bc10 0x7f5690153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5694e00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5690160970 0x7f5690156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568f400640 1 -- 172.21.15.144:0/877067219 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5690160970 msgr2=0x7f5690156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568f400640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5690160970 0x7f5690156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568f400640 1 -- 172.21.15.144:0/877067219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f569006bc10 msgr2=0x7f5690153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568f400640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f569006bc10 0x7f5690153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568f400640 1 -- 172.21.15.144:0/877067219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5690153ed0 con 0x7f569015c9a0 2024-09-12T12:23:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568fe00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f569006bc10 0x7f5690153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f568f400640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 0x7f56901529f0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f567c00e930 tx=0x7f567c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5687e00640 1 -- 172.21.15.144:0/877067219 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c017070 con 0x7f569015c9a0 2024-09-12T12:23:35.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5687e00640 1 -- 172.21.15.144:0/877067219 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c00ca00 con 0x7f569015c9a0 2024-09-12T12:23:35.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5687e00640 1 -- 172.21.15.144:0/877067219 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c00cdb0 con 0x7f569015c9a0 2024-09-12T12:23:35.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56901558b0 con 0x7f569015c9a0 2024-09-12T12:23:35.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5690155e70 con 0x7f569015c9a0 2024-09-12T12:23:35.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.573+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569006c070 con 0x7f569015c9a0 2024-09-12T12:23:35.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.577+0000 7f5687e00640 1 -- 172.21.15.144:0/877067219 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f567c01a070 con 0x7f569015c9a0 2024-09-12T12:23:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.577+0000 7f5687e00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56700678f0 0x7f5670069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.577+0000 7f5687e00640 1 -- 172.21.15.144:0/877067219 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f567c086240 con 0x7f569015c9a0 2024-09-12T12:23:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.577+0000 7f568fe00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56700678f0 0x7f5670069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.577+0000 7f568fe00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56700678f0 0x7f5670069db0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5680000f70 tx=0x7f5680007cb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:35.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.581+0000 7f5687e00640 1 -- 172.21.15.144:0/877067219 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f567c056ca0 con 0x7f569015c9a0 2024-09-12T12:23:35.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.773+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56901669e0 con 0x7f569015c9a0 2024-09-12T12:23:35.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.773+0000 7f5687e00640 1 -- 172.21.15.144:0/877067219 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7f567c0565a0 con 0x7f569015c9a0 2024-09-12T12:23:35.773 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:35.773 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:35.773 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56700678f0 msgr2=0x7f5670069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56700678f0 0x7f5670069db0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5680000f70 tx=0x7f5680007cb0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 msgr2=0x7f56901529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 0x7f56901529f0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f567c00e930 tx=0x7f567c00edf0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 shutdown_connections 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f56700678f0 0x7f5670069db0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5690160970 0x7f5690156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f569015c9a0 0x7f56901529f0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 --2- 172.21.15.144:0/877067219 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f569006bc10 0x7f5690153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 >> 172.21.15.144:0/877067219 conn(0x7f56900b3380 msgr2=0x7f56900cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 shutdown_connections 2024-09-12T12:23:35.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.777+0000 7f5696e00640 1 -- 172.21.15.144:0/877067219 wait complete. 2024-09-12T12:23:35.794 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-12T12:23:35.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:23:35.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.933+0000 7fc94bc00640 1 Processor -- start 2024-09-12T12:23:35.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.933+0000 7fc94bc00640 1 -- start start 2024-09-12T12:23:35.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc94bc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9440b55b0 0x7fc94406d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc94bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9440b73a0 0x7fc94406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc94bc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc944073f60 con 0x7fc94415e7e0 2024-09-12T12:23:35.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc94bc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc94406e700 con 0x7fc9440b55b0 2024-09-12T12:23:35.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc94bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc94406e9e0 con 0x7fc9440b73a0 2024-09-12T12:23:35.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc93be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9440b55b0 0x7fc94406d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc93be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9440b55b0 0x7fc94406d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43550/0 (socket says 172.21.15.144:43550) 2024-09-12T12:23:35.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc93be00640 1 -- 172.21.15.144:0/3743888888 learned_addr learned my addr 172.21.15.144:0/3743888888 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:35.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc949200640 1 --1- 172.21.15.144:0/3743888888 >> v1:172.21.15.165:6789/0 conn(0x7fc94415e7e0 0x7fc9440b6c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53526/0 (socket says 172.21.15.144:53526) 2024-09-12T12:23:35.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc949c00640 1 --2- 172.21.15.144:0/3743888888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9440b73a0 0x7fc94406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc93be00640 1 -- 172.21.15.144:0/3743888888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9440b73a0 msgr2=0x7fc94406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:35.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc93be00640 1 --2- 172.21.15.144:0/3743888888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9440b73a0 0x7fc94406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc93be00640 1 -- 172.21.15.144:0/3743888888 >> v1:172.21.15.165:6789/0 conn(0x7fc94415e7e0 legacy=0x7fc9440b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.937+0000 7fc93be00640 1 -- 172.21.15.144:0/3743888888 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94406ecc0 con 0x7fc9440b55b0 2024-09-12T12:23:35.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc93be00640 1 --2- 172.21.15.144:0/3743888888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b55b0 0x7fc94406d200 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009870 tx=0x7fc92c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3619244a80d757d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:35.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc943e00640 1 -- 172.21.15.144:0/3743888888 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0b1070 con 0x7fc9440b55b0 2024-09-12T12:23:35.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc943e00640 1 -- 172.21.15.144:0/3743888888 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c0a8050 con 0x7fc9440b55b0 2024-09-12T12:23:35.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc943e00640 1 -- 172.21.15.144:0/3743888888 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0ac860 con 0x7fc9440b55b0 2024-09-12T12:23:35.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 -- 172.21.15.144:0/3743888888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b55b0 msgr2=0x7fc94406d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 --2- 172.21.15.144:0/3743888888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b55b0 0x7fc94406d200 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009870 tx=0x7fc92c01c4d0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 -- 172.21.15.144:0/3743888888 shutdown_connections 2024-09-12T12:23:35.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 --2- 172.21.15.144:0/3743888888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9440b73a0 0x7fc94406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 --2- 172.21.15.144:0/3743888888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b55b0 0x7fc94406d200 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 -- 172.21.15.144:0/3743888888 >> 172.21.15.144:0/3743888888 conn(0x7fc9440d2500 msgr2=0x7fc9440d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:35.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 -- 172.21.15.144:0/3743888888 shutdown_connections 2024-09-12T12:23:35.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 -- 172.21.15.144:0/3743888888 wait complete. 2024-09-12T12:23:35.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 Processor -- start 2024-09-12T12:23:35.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.941+0000 7fc94bc00640 1 -- start start 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc94bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9440b55b0 0x7fc944147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc94bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b73a0 0x7fc944159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc94bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc94415e7e0 0x7fc94415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc94bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc94415ed40 con 0x7fc9440b73a0 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc94bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc94415ebc0 con 0x7fc9440b55b0 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc94bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc94416ba40 con 0x7fc94415e7e0 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc93be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b73a0 0x7fc944159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc93be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b73a0 0x7fc944159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43562/0 (socket says 172.21.15.144:43562) 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc93be00640 1 -- 172.21.15.144:0/885581038 learned_addr learned my addr 172.21.15.144:0/885581038 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc949200640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9440b55b0 0x7fc944147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc949c00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc94415e7e0 0x7fc94415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc93be00640 1 -- 172.21.15.144:0/885581038 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc94415e7e0 msgr2=0x7fc94415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc93be00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc94415e7e0 0x7fc94415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc93be00640 1 -- 172.21.15.144:0/885581038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9440b55b0 msgr2=0x7fc944147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc93be00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9440b55b0 0x7fc944147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc93be00640 1 -- 172.21.15.144:0/885581038 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94415a330 con 0x7fc9440b73a0 2024-09-12T12:23:35.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc93be00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b73a0 0x7fc944159870 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0af040 tx=0x7fc92c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:35.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc941600640 1 -- 172.21.15.144:0/885581038 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0b1040 con 0x7fc9440b73a0 2024-09-12T12:23:35.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc941600640 1 -- 172.21.15.144:0/885581038 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c0acb70 con 0x7fc9440b73a0 2024-09-12T12:23:35.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc941600640 1 -- 172.21.15.144:0/885581038 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0b5440 con 0x7fc9440b73a0 2024-09-12T12:23:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc944153e50 con 0x7fc9440b73a0 2024-09-12T12:23:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc944154410 con 0x7fc9440b73a0 2024-09-12T12:23:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9440b6c90 con 0x7fc9440b73a0 2024-09-12T12:23:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.945+0000 7fc941600640 1 -- 172.21.15.144:0/885581038 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc92c0bc020 con 0x7fc9440b73a0 2024-09-12T12:23:35.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.949+0000 7fc941600640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9200678c0 0x7fc920069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:35.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.949+0000 7fc941600640 1 -- 172.21.15.144:0/885581038 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7fc92c11f0f0 con 0x7fc9440b73a0 2024-09-12T12:23:35.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.949+0000 7fc949200640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9200678c0 0x7fc920069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:35.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.949+0000 7fc949200640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9200678c0 0x7fc920069d80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc944159110 tx=0x7fc934007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:35.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:35.953+0000 7fc941600640 1 -- 172.21.15.144:0/885581038 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc92c0c3020 con 0x7fc9440b73a0 2024-09-12T12:23:36.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.165+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc944075db0 con 0x7fc9440b73a0 2024-09-12T12:23:36.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.165+0000 7fc941600640 1 -- 172.21.15.144:0/885581038 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7fc92c016150 con 0x7fc9440b73a0 2024-09-12T12:23:36.165 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:36.165 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":675,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":165,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076441570,"bytes_used":2598166528,"bytes_avail":770495946752,"bytes_total":773094113280,"write_bytes_sec":53846366,"read_op_per_sec":0,"write_op_per_sec":54},"fsmap":{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9363}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-12T12:22:45.504854+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:23:36.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9200678c0 msgr2=0x7fc920069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9200678c0 0x7fc920069d80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc944159110 tx=0x7fc934007e90 comp rx=0 tx=0).stop 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b73a0 msgr2=0x7fc944159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b73a0 0x7fc944159870 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0af040 tx=0x7fc92c019270 comp rx=0 tx=0).stop 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 shutdown_connections 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9200678c0 0x7fc920069d80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc94415e7e0 0x7fc94415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9440b73a0 0x7fc944159870 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 --2- 172.21.15.144:0/885581038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9440b55b0 0x7fc944147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 >> 172.21.15.144:0/885581038 conn(0x7fc9440d2500 msgr2=0x7fc94406d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 shutdown_connections 2024-09-12T12:23:36.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:36.169+0000 7fc94bc00640 1 -- 172.21.15.144:0/885581038 wait complete. 2024-09-12T12:23:36.187 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:23:37.189 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:37.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.337+0000 7efd29000640 1 Processor -- start 2024-09-12T12:23:37.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.337+0000 7efd29000640 1 -- start start 2024-09-12T12:23:37.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd29000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efd2415c7b0 0x7efd240ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd29000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd2415cd30 0x7efd240b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd29000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efd240b5de0 0x7efd241601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd29000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efd24072a50 con 0x7efd240b5de0 2024-09-12T12:23:37.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd29000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efd240cde30 con 0x7efd2415c7b0 2024-09-12T12:23:37.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd29000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efd240b6210 con 0x7efd2415cd30 2024-09-12T12:23:37.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd22800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efd240b5de0 0x7efd241601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd22800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efd240b5de0 0x7efd241601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37772/0 (socket says 172.21.15.144:37772) 2024-09-12T12:23:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd22800640 1 -- 172.21.15.144:0/3009217817 learned_addr learned my addr 172.21.15.144:0/3009217817 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd21400640 1 --2- 172.21.15.144:0/3009217817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd2415cd30 0x7efd240b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd21e00640 1 --2- 172.21.15.144:0/3009217817 >> v2:172.21.15.165:3300/0 conn(0x7efd2415c7b0 0x7efd240ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd22800640 1 -- 172.21.15.144:0/3009217817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd2415cd30 msgr2=0x7efd240b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd22800640 1 --2- 172.21.15.144:0/3009217817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd2415cd30 0x7efd240b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd22800640 1 -- 172.21.15.144:0/3009217817 >> v2:172.21.15.165:3300/0 conn(0x7efd2415c7b0 msgr2=0x7efd240ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd22800640 1 --2- 172.21.15.144:0/3009217817 >> v2:172.21.15.165:3300/0 conn(0x7efd2415c7b0 0x7efd240ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd22800640 1 -- 172.21.15.144:0/3009217817 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd240cd870 con 0x7efd240b5de0 2024-09-12T12:23:37.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd21e00640 1 --2- 172.21.15.144:0/3009217817 >> v2:172.21.15.165:3300/0 conn(0x7efd2415c7b0 0x7efd240ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:37.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.341+0000 7efd22800640 1 --2- 172.21.15.144:0/3009217817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd240b5de0 0x7efd241601d0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7efd240d14f0 tx=0x7efd1c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2a245588c84c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd20a00640 1 -- 172.21.15.144:0/3009217817 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0b0070 con 0x7efd240b5de0 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd20a00640 1 -- 172.21.15.144:0/3009217817 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c0ab600 con 0x7efd240b5de0 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd20a00640 1 -- 172.21.15.144:0/3009217817 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0ab9d0 con 0x7efd240b5de0 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 -- 172.21.15.144:0/3009217817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd240b5de0 msgr2=0x7efd241601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 --2- 172.21.15.144:0/3009217817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd240b5de0 0x7efd241601d0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7efd240d14f0 tx=0x7efd1c01c260 comp rx=0 tx=0).stop 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 -- 172.21.15.144:0/3009217817 shutdown_connections 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 --2- 172.21.15.144:0/3009217817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd240b5de0 0x7efd241601d0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 --2- 172.21.15.144:0/3009217817 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd2415cd30 0x7efd240b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 --2- 172.21.15.144:0/3009217817 >> v2:172.21.15.165:3300/0 conn(0x7efd2415c7b0 0x7efd240ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 -- 172.21.15.144:0/3009217817 >> 172.21.15.144:0/3009217817 conn(0x7efd2406d0d0 msgr2=0x7efd2406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 -- 172.21.15.144:0/3009217817 shutdown_connections 2024-09-12T12:23:37.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 -- 172.21.15.144:0/3009217817 wait complete. 2024-09-12T12:23:37.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 Processor -- start 2024-09-12T12:23:37.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 -- start start 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240b5de0 0x7efd24140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415c7b0 0x7efd2415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2415cd30 0x7efd2415b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd24072ec0 con 0x7efd2415cd30 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efd240cd650 con 0x7efd2415c7b0 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd29000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efd24073040 con 0x7efd240b5de0 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd22800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2415cd30 0x7efd2415b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd22800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2415cd30 0x7efd2415b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37786/0 (socket says 172.21.15.144:37786) 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd22800640 1 -- 172.21.15.144:0/1310593802 learned_addr learned my addr 172.21.15.144:0/1310593802 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd21e00640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240b5de0 0x7efd24140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd21400640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415c7b0 0x7efd2415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd22800640 1 -- 172.21.15.144:0/1310593802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240b5de0 msgr2=0x7efd24140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd22800640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240b5de0 0x7efd24140b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd22800640 1 -- 172.21.15.144:0/1310593802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415c7b0 msgr2=0x7efd2415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.345+0000 7efd22800640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415c7b0 0x7efd2415b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd22800640 1 -- 172.21.15.144:0/1310593802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd24141270 con 0x7efd2415cd30 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd21e00640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240b5de0 0x7efd24140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd22800640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2415cd30 0x7efd2415b7b0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0ae040 tx=0x7efd1c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd1a000640 1 -- 172.21.15.144:0/1310593802 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0b0040 con 0x7efd2415cd30 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd1a000640 1 -- 172.21.15.144:0/1310593802 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c0b9070 con 0x7efd2415cd30 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd24141550 con 0x7efd2415cd30 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd1a000640 1 -- 172.21.15.144:0/1310593802 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0b4640 con 0x7efd2415cd30 2024-09-12T12:23:37.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd24141b10 con 0x7efd2415cd30 2024-09-12T12:23:37.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd240ccf00 con 0x7efd2415cd30 2024-09-12T12:23:37.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd1a000640 1 -- 172.21.15.144:0/1310593802 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efd1c0b47e0 con 0x7efd2415cd30 2024-09-12T12:23:37.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd1a000640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efd040678c0 0x7efd04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd1a000640 1 -- 172.21.15.144:0/1310593802 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7efd1c11fc00 con 0x7efd2415cd30 2024-09-12T12:23:37.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.349+0000 7efd21e00640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efd040678c0 0x7efd04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.353+0000 7efd21e00640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efd040678c0 0x7efd04069d80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efd14009ac0 tx=0x7efd140039c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.353+0000 7efd1a000640 1 -- 172.21.15.144:0/1310593802 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efd1c016110 con 0x7efd2415cd30 2024-09-12T12:23:37.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.545+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd2415e5b0 con 0x7efd2415cd30 2024-09-12T12:23:37.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.545+0000 7efd1a000640 1 -- 172.21.15.144:0/1310593802 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7efd1c0f0510 con 0x7efd2415cd30 2024-09-12T12:23:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:37.545 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:37.545 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efd040678c0 msgr2=0x7efd04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efd040678c0 0x7efd04069d80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efd14009ac0 tx=0x7efd140039c0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2415cd30 msgr2=0x7efd2415b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2415cd30 0x7efd2415b7b0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0ae040 tx=0x7efd1c019000 comp rx=0 tx=0).stop 2024-09-12T12:23:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 shutdown_connections 2024-09-12T12:23:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efd040678c0 0x7efd04069d80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd2415cd30 0x7efd2415b7b0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd2415c7b0 0x7efd2415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 --2- 172.21.15.144:0/1310593802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd240b5de0 0x7efd24140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 >> 172.21.15.144:0/1310593802 conn(0x7efd2406d0d0 msgr2=0x7efd240b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 shutdown_connections 2024-09-12T12:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.549+0000 7efd29000640 1 -- 172.21.15.144:0/1310593802 wait complete. 2024-09-12T12:23:37.566 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-12T12:23:37.566 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:23:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f910a200640 1 Processor -- start 2024-09-12T12:23:37.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f910a200640 1 -- start start 2024-09-12T12:23:37.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f910a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f910415e9d0 0x7f91040d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f910a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91040b1380 0x7f910406fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f910a200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91040d0e40 con 0x7f9104072130 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f910a200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f91040d1120 con 0x7f910415e9d0 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f910a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f910406f330 con 0x7f91040b1380 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f9103400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f910415e9d0 0x7f91040d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f9103400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f910415e9d0 0x7f91040d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37802/0 (socket says 172.21.15.144:37802) 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f9103400640 1 -- 172.21.15.144:0/788451778 learned_addr learned my addr 172.21.15.144:0/788451778 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f9102a00640 1 --2- 172.21.15.144:0/788451778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91040b1380 0x7f910406fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f9103400640 1 -- 172.21.15.144:0/788451778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91040b1380 msgr2=0x7f910406fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f9103400640 1 --2- 172.21.15.144:0/788451778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91040b1380 0x7f910406fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f9103400640 1 -- 172.21.15.144:0/788451778 >> v1:172.21.15.165:6789/0 conn(0x7f9104072130 legacy=0x7f91040ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f9103400640 1 -- 172.21.15.144:0/788451778 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910406f610 con 0x7f910415e9d0 2024-09-12T12:23:37.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.705+0000 7f9102a00640 1 --2- 172.21.15.144:0/788451778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91040b1380 0x7f910406fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:37.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f9103400640 1 --2- 172.21.15.144:0/788451778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f910415e9d0 0x7f91040d1c70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009870 tx=0x7f90f401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bea3b856e314ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f9102000640 1 -- 172.21.15.144:0/788451778 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f40b0070 con 0x7f910415e9d0 2024-09-12T12:23:37.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f9102000640 1 -- 172.21.15.144:0/788451778 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f40ab600 con 0x7f910415e9d0 2024-09-12T12:23:37.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f9102000640 1 -- 172.21.15.144:0/788451778 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f40ab9d0 con 0x7f910415e9d0 2024-09-12T12:23:37.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 -- 172.21.15.144:0/788451778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f910415e9d0 msgr2=0x7f91040d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 --2- 172.21.15.144:0/788451778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f910415e9d0 0x7f91040d1c70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009870 tx=0x7f90f401c560 comp rx=0 tx=0).stop 2024-09-12T12:23:37.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 -- 172.21.15.144:0/788451778 shutdown_connections 2024-09-12T12:23:37.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 --2- 172.21.15.144:0/788451778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91040b1380 0x7f910406fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 --2- 172.21.15.144:0/788451778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f910415e9d0 0x7f91040d1c70 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 -- 172.21.15.144:0/788451778 >> 172.21.15.144:0/788451778 conn(0x7f91040703a0 msgr2=0x7f91040d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:37.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 -- 172.21.15.144:0/788451778 shutdown_connections 2024-09-12T12:23:37.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 -- 172.21.15.144:0/788451778 wait complete. 2024-09-12T12:23:37.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 Processor -- start 2024-09-12T12:23:37.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.709+0000 7f910a200640 1 -- start start 2024-09-12T12:23:37.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f910a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9104072130 0x7f9104144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f910a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91040b1380 0x7f9104155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f910a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f910415e9d0 0x7f9104155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f910a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f91041682d0 con 0x7f91040b1380 2024-09-12T12:23:37.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f910a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9104168150 con 0x7f910415e9d0 2024-09-12T12:23:37.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f910a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9104168450 con 0x7f9104072130 2024-09-12T12:23:37.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9102a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91040b1380 0x7f9104155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9102a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91040b1380 0x7f9104155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37810/0 (socket says 172.21.15.144:37810) 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9102a00640 1 -- 172.21.15.144:0/4188643047 learned_addr learned my addr 172.21.15.144:0/4188643047 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9103400640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9104072130 0x7f9104144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9103e00640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f910415e9d0 0x7f9104155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9102a00640 1 -- 172.21.15.144:0/4188643047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9104072130 msgr2=0x7f9104144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9102a00640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9104072130 0x7f9104144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9102a00640 1 -- 172.21.15.144:0/4188643047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f910415e9d0 msgr2=0x7f9104155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9102a00640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f910415e9d0 0x7f9104155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9102a00640 1 -- 172.21.15.144:0/4188643047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9104154260 con 0x7f91040b1380 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f9102a00640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91040b1380 0x7f9104155950 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f90f000d830 tx=0x7f90f000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f90fb400640 1 -- 172.21.15.144:0/4188643047 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f000b6c0 con 0x7f91040b1380 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f90fb400640 1 -- 172.21.15.144:0/4188643047 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f0019070 con 0x7f91040b1380 2024-09-12T12:23:37.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9104154540 con 0x7f91040b1380 2024-09-12T12:23:37.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f90fb400640 1 -- 172.21.15.144:0/4188643047 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f000baa0 con 0x7f91040b1380 2024-09-12T12:23:37.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9104154b00 con 0x7f91040b1380 2024-09-12T12:23:37.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910406fb30 con 0x7f91040b1380 2024-09-12T12:23:37.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.713+0000 7f90fb400640 1 -- 172.21.15.144:0/4188643047 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f90f001e460 con 0x7f91040b1380 2024-09-12T12:23:37.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.717+0000 7f90fb400640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90e40678c0 0x7f90e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:37.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.717+0000 7f90fb400640 1 -- 172.21.15.144:0/4188643047 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f90f0086350 con 0x7f91040b1380 2024-09-12T12:23:37.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.717+0000 7f9103400640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90e40678c0 0x7f90e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:37.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.717+0000 7f9103400640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90e40678c0 0x7f90e4069d80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ad000 tx=0x7f90f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:37.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.721+0000 7f90fb400640 1 -- 172.21.15.144:0/4188643047 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f90f0056d70 con 0x7f91040b1380 2024-09-12T12:23:37.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f91040b5ac0 con 0x7f91040b1380 2024-09-12T12:23:37.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f90fb400640 1 -- 172.21.15.144:0/4188643047 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f90f0056670 con 0x7f91040b1380 2024-09-12T12:23:37.935 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:37.935 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":677,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":165,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076441570,"bytes_used":2598166528,"bytes_avail":770495946752,"bytes_total":773094113280,"write_bytes_sec":30997399,"read_op_per_sec":0,"write_op_per_sec":31},"fsmap":{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9363}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-12T12:23:37.514997+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:23:37.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90e40678c0 msgr2=0x7f90e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90e40678c0 0x7f90e4069d80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ad000 tx=0x7f90f4008040 comp rx=0 tx=0).stop 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91040b1380 msgr2=0x7f9104155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91040b1380 0x7f9104155950 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f90f000d830 tx=0x7f90f000dcf0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 shutdown_connections 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f90e40678c0 0x7f90e4069d80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f910415e9d0 0x7f9104155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91040b1380 0x7f9104155950 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 --2- 172.21.15.144:0/4188643047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9104072130 0x7f9104144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 >> 172.21.15.144:0/4188643047 conn(0x7f91040703a0 msgr2=0x7f910406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 shutdown_connections 2024-09-12T12:23:37.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:37.937+0000 7f910a200640 1 -- 172.21.15.144:0/4188643047 wait complete. 2024-09-12T12:23:37.957 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-12T12:23:37.957 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:23:37.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:23:37.971 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:23:37.972 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'a', 'd', 'b'} 2024-09-12T12:23:37.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-12T12:23:38.164 INFO:teuthology.orchestra.run.smithi144.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-12T12:23:38.164 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-12T12:23:38.165 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:38.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f3546600640 1 Processor -- start 2024-09-12T12:23:38.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f3546600640 1 -- start start 2024-09-12T12:23:38.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f3546600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f354015b4e0 0x7f35400b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:38.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f3546600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35400b3ad0 0x7f3540071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:38.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f3546600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35400b45a0 con 0x7f3540071960 2024-09-12T12:23:38.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f3546600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f35400b3fe0 con 0x7f35400b3ad0 2024-09-12T12:23:38.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f3546600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35400b42c0 con 0x7f354015b4e0 2024-09-12T12:23:38.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f353ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35400b3ad0 0x7f3540071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:38.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f353ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35400b3ad0 0x7f3540071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37820/0 (socket says 172.21.15.144:37820) 2024-09-12T12:23:38.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.301+0000 7f353ea00640 1 -- 172.21.15.144:0/1890899445 learned_addr learned my addr 172.21.15.144:0/1890899445 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:38.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.305+0000 7f353f400640 1 --2- 172.21.15.144:0/1890899445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f354015b4e0 0x7f35400b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:38.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.305+0000 7f353ea00640 1 -- 172.21.15.144:0/1890899445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f354015b4e0 msgr2=0x7f35400b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:38.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.305+0000 7f353ea00640 1 --2- 172.21.15.144:0/1890899445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f354015b4e0 0x7f35400b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.305+0000 7f353ea00640 1 -- 172.21.15.144:0/1890899445 >> v1:172.21.15.165:6789/0 conn(0x7f3540071960 legacy=0x7f35400ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:38.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.305+0000 7f353ea00640 1 -- 172.21.15.144:0/1890899445 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35400b1490 con 0x7f35400b3ad0 2024-09-12T12:23:38.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.305+0000 7f353ea00640 1 --2- 172.21.15.144:0/1890899445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35400b3ad0 0x7f3540071420 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f352c009870 tx=0x7f352c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86b0419f20c7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:38.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.305+0000 7f353e000640 1 -- 172.21.15.144:0/1890899445 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c0a9610 con 0x7f35400b3ad0 2024-09-12T12:23:38.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.305+0000 7f353e000640 1 -- 172.21.15.144:0/1890899445 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f352c0a97b0 con 0x7f35400b3ad0 2024-09-12T12:23:38.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.305+0000 7f353e000640 1 -- 172.21.15.144:0/1890899445 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c0a9b80 con 0x7f35400b3ad0 2024-09-12T12:23:38.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 -- 172.21.15.144:0/1890899445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35400b3ad0 msgr2=0x7f3540071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:38.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 --2- 172.21.15.144:0/1890899445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35400b3ad0 0x7f3540071420 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f352c009870 tx=0x7f352c01c530 comp rx=0 tx=0).stop 2024-09-12T12:23:38.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 -- 172.21.15.144:0/1890899445 shutdown_connections 2024-09-12T12:23:38.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 --2- 172.21.15.144:0/1890899445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35400b3ad0 0x7f3540071420 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 --2- 172.21.15.144:0/1890899445 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f354015b4e0 0x7f35400b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 -- 172.21.15.144:0/1890899445 >> 172.21.15.144:0/1890899445 conn(0x7f354006d0d0 msgr2=0x7f354006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:38.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 -- 172.21.15.144:0/1890899445 shutdown_connections 2024-09-12T12:23:38.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 -- 172.21.15.144:0/1890899445 wait complete. 2024-09-12T12:23:38.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 Processor -- start 2024-09-12T12:23:38.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 -- start start 2024-09-12T12:23:38.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3540071960 0x7f35401f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:38.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35400b3ad0 0x7f3540154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:38.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f354015b4e0 0x7f354015e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:38.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35400b2620 con 0x7f3540071960 2024-09-12T12:23:38.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35400b24a0 con 0x7f354015b4e0 2024-09-12T12:23:38.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f3546600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35400cd640 con 0x7f35400b3ad0 2024-09-12T12:23:38.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3540071960 0x7f35401f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3540071960 0x7f35401f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37834/0 (socket says 172.21.15.144:37834) 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353f400640 1 -- 172.21.15.144:0/141682311 learned_addr learned my addr 172.21.15.144:0/141682311 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353fe00640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f354015b4e0 0x7f354015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353ea00640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35400b3ad0 0x7f3540154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353f400640 1 -- 172.21.15.144:0/141682311 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35400b3ad0 msgr2=0x7f3540154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353f400640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35400b3ad0 0x7f3540154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353f400640 1 -- 172.21.15.144:0/141682311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f354015b4e0 msgr2=0x7f354015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353f400640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f354015b4e0 0x7f354015e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353f400640 1 -- 172.21.15.144:0/141682311 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3540155e10 con 0x7f3540071960 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.309+0000 7f353f400640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3540071960 0x7f35401f7420 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f353000efc0 tx=0x7f353000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:38.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f3537400640 1 -- 172.21.15.144:0/141682311 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530018020 con 0x7f3540071960 2024-09-12T12:23:38.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f3537400640 1 -- 172.21.15.144:0/141682311 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3530014480 con 0x7f3540071960 2024-09-12T12:23:38.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f3537400640 1 -- 172.21.15.144:0/141682311 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530014850 con 0x7f3540071960 2024-09-12T12:23:38.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35401560f0 con 0x7f3540071960 2024-09-12T12:23:38.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35401566b0 con 0x7f3540071960 2024-09-12T12:23:38.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3540071420 con 0x7f3540071960 2024-09-12T12:23:38.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f3537400640 1 -- 172.21.15.144:0/141682311 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f353001b020 con 0x7f3540071960 2024-09-12T12:23:38.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f3537400640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35200678c0 0x7f3520069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:38.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f3537400640 1 -- 172.21.15.144:0/141682311 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f3530086910 con 0x7f3540071960 2024-09-12T12:23:38.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f353ea00640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35200678c0 0x7f3520069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:38.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.313+0000 7f353ea00640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35200678c0 0x7f3520069d80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f352c0ae000 tx=0x7f352c0b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:38.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.317+0000 7f3537400640 1 -- 172.21.15.144:0/141682311 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3530022070 con 0x7f3540071960 2024-09-12T12:23:38.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.509+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3540154d70 con 0x7f3540071960 2024-09-12T12:23:38.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.509+0000 7f3537400640 1 -- 172.21.15.144:0/141682311 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7f3530010040 con 0x7f3540071960 2024-09-12T12:23:38.510 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:38.510 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:38.510 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35200678c0 msgr2=0x7f3520069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35200678c0 0x7f3520069d80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f352c0ae000 tx=0x7f352c0b3040 comp rx=0 tx=0).stop 2024-09-12T12:23:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3540071960 msgr2=0x7f35401f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3540071960 0x7f35401f7420 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f353000efc0 tx=0x7f353000c490 comp rx=0 tx=0).stop 2024-09-12T12:23:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 shutdown_connections 2024-09-12T12:23:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35200678c0 0x7f3520069d80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f354015b4e0 0x7f354015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35400b3ad0 0x7f3540154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 --2- 172.21.15.144:0/141682311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3540071960 0x7f35401f7420 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:38.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 >> 172.21.15.144:0/141682311 conn(0x7f354006d0d0 msgr2=0x7f35400aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:38.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 shutdown_connections 2024-09-12T12:23:38.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:38.513+0000 7f3546600640 1 -- 172.21.15.144:0/141682311 wait complete. 2024-09-12T12:23:38.532 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T12:23:43.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:43.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d6c00640 1 Processor -- start 2024-09-12T12:23:43.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d6c00640 1 -- start start 2024-09-12T12:23:43.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d6c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d00ccee0 0x7f88d006deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d6c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d006e4d0 con 0x7f88d00b74b0 2024-09-12T12:23:43.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d6c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d006e7b0 con 0x7f88d015e540 2024-09-12T12:23:43.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d6c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f88d00cba40 con 0x7f88d00ccee0 2024-09-12T12:23:43.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88c7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f88d00b74b0 0x7f88d006d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46598/0 (socket says 172.21.15.144:46598) 2024-09-12T12:23:43.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88c7e00640 1 -- 172.21.15.144:0/1819931927 learned_addr learned my addr 172.21.15.144:0/1819931927 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:43.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d4c00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d00ccee0 0x7f88d006deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316826937 0 0) 0x7f88d006e4d0 con 0x7f88d00b74b0 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88b4003530 con 0x7f88d00b74b0 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237043700 0 0) 0x7f88d006e7b0 con 0x7f88d015e540 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88d006e4d0 con 0x7f88d015e540 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2027305905 0 0) 0x7f88b4003530 con 0x7f88d00b74b0 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d00ccee0 msgr2=0x7f88d006deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d00ccee0 0x7f88d006deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 >> v1:172.21.15.165:6789/0 conn(0x7f88d015e540 legacy=0x7f88d00b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d006ea90 con 0x7f88d00b74b0 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f88b8001800 con 0x7f88d00b74b0 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 >> v1:172.21.15.144:6789/0 conn(0x7f88d00b74b0 legacy=0x7f88d006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d00ccee0 0x7f88b4003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88b4004100 0x7f88b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88b4004d50 0x7f88b40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88d00cba40 con 0x7f88b4004d50 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f88b400bb60 con 0x7f88b4004100 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f88b400bd60 con 0x7f88d00ccee0 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d4c00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88b4004d50 0x7f88b40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cfe00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d00ccee0 0x7f88b4003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88c7e00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88b4004100 0x7f88b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d4c00640 1 -- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d00ccee0 msgr2=0x7f88b4003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d4c00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d00ccee0 0x7f88b4003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d4c00640 1 -- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88b4004100 msgr2=0x7f88b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d4c00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88b4004100 0x7f88b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88d4c00640 1 -- 172.21.15.144:0/1819931927 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b4003530 con 0x7f88b4004d50 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88cfe00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d00ccee0 0x7f88b4003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.685+0000 7f88c7e00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88b4004100 0x7f88b4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:43.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88d4c00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88b4004d50 0x7f88b40051d0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009f90 tx=0x7f88c801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659bc947970975a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c80b2070 con 0x7f88b4004d50 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c80a5c50 con 0x7f88b4004d50 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88cf400640 1 -- 172.21.15.144:0/1819931927 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8009c10 con 0x7f88b4004d50 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88d6c00640 1 -- 172.21.15.144:0/1819931927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88b4004d50 msgr2=0x7f88b40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88d6c00640 1 --2- 172.21.15.144:0/1819931927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88b4004d50 0x7f88b40051d0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009f90 tx=0x7f88c801cc40 comp rx=0 tx=0).stop 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88d4c00640 1 -- 172.21.15.144:0/1819931927 reap_dead start 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88d6c00640 1 -- 172.21.15.144:0/1819931927 shutdown_connections 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88d6c00640 1 -- 172.21.15.144:0/1819931927 >> 172.21.15.144:0/1819931927 conn(0x7f88d0067a00 msgr2=0x7f88d0067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88d6c00640 1 -- 172.21.15.144:0/1819931927 shutdown_connections 2024-09-12T12:23:43.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.689+0000 7f88d6c00640 1 -- 172.21.15.144:0/1819931927 wait complete. 2024-09-12T12:23:43.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 Processor -- start 2024-09-12T12:23:43.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 -- start start 2024-09-12T12:23:43.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88b4004d50 0x7f88d01552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00aae60 0x7f88d00d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d00d2380 0x7f88d01f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88d006e030 con 0x7f88d00aae60 2024-09-12T12:23:43.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f88d006deb0 con 0x7f88d00d2380 2024-09-12T12:23:43.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f88d006e1b0 con 0x7f88b4004d50 2024-09-12T12:23:43.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00aae60 0x7f88d00d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00aae60 0x7f88d00d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37862/0 (socket says 172.21.15.144:37862) 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88c7e00640 1 -- 172.21.15.144:0/2062574619 learned_addr learned my addr 172.21.15.144:0/2062574619 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d4c00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d00d2380 0x7f88d01f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88cfe00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88b4004d50 0x7f88d01552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88c7e00640 1 -- 172.21.15.144:0/2062574619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88b4004d50 msgr2=0x7f88d01552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88c7e00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88b4004d50 0x7f88d01552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88c7e00640 1 -- 172.21.15.144:0/2062574619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d00d2380 msgr2=0x7f88d01f79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88c7e00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d00d2380 0x7f88d01f79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88c7e00640 1 -- 172.21.15.144:0/2062574619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d00b0d30 con 0x7f88d00aae60 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88cfe00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88b4004d50 0x7f88d01552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:23:43.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88c7e00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00aae60 0x7f88d00d1e40 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000f00 tx=0x7f88b800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88ccc00640 1 -- 172.21.15.144:0/2062574619 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b80070d0 con 0x7f88d00aae60 2024-09-12T12:23:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88ccc00640 1 -- 172.21.15.144:0/2062574619 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8018070 con 0x7f88d00aae60 2024-09-12T12:23:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d00b1010 con 0x7f88d00aae60 2024-09-12T12:23:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88ccc00640 1 -- 172.21.15.144:0/2062574619 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8007470 con 0x7f88d00aae60 2024-09-12T12:23:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.693+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d00b15d0 con 0x7f88d00aae60 2024-09-12T12:23:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.697+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d006d7a0 con 0x7f88d00aae60 2024-09-12T12:23:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.697+0000 7f88ccc00640 1 -- 172.21.15.144:0/2062574619 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88b80057b0 con 0x7f88d00aae60 2024-09-12T12:23:43.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.697+0000 7f88ccc00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ac0678c0 0x7f88ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:43.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.697+0000 7f88ccc00640 1 -- 172.21.15.144:0/2062574619 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f88b8085b40 con 0x7f88d00aae60 2024-09-12T12:23:43.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.697+0000 7f88cfe00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ac0678c0 0x7f88ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:43.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.697+0000 7f88cfe00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ac0678c0 0x7f88ac069d80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f88d00abb50 tx=0x7f88c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:43.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.701+0000 7f88ccc00640 1 -- 172.21.15.144:0/2062574619 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f88b80564f0 con 0x7f88d00aae60 2024-09-12T12:23:43.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.897+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88d006d440 con 0x7f88d00aae60 2024-09-12T12:23:43.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.897+0000 7f88ccc00640 1 -- 172.21.15.144:0/2062574619 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7f88b8055df0 con 0x7f88d00aae60 2024-09-12T12:23:43.898 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:43.898 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:43.899 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ac0678c0 msgr2=0x7f88ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ac0678c0 0x7f88ac069d80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f88d00abb50 tx=0x7f88c0009040 comp rx=0 tx=0).stop 2024-09-12T12:23:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00aae60 msgr2=0x7f88d00d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00aae60 0x7f88d00d1e40 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000f00 tx=0x7f88b800eb90 comp rx=0 tx=0).stop 2024-09-12T12:23:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 shutdown_connections 2024-09-12T12:23:43.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ac0678c0 0x7f88ac069d80 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d00d2380 0x7f88d01f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00aae60 0x7f88d00d1e40 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 --2- 172.21.15.144:0/2062574619 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88b4004d50 0x7f88d01552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:43.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 >> 172.21.15.144:0/2062574619 conn(0x7f88d0067a00 msgr2=0x7f88d00cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:43.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 shutdown_connections 2024-09-12T12:23:43.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:43.901+0000 7f88d6c00640 1 -- 172.21.15.144:0/2062574619 wait complete. 2024-09-12T12:23:43.920 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T12:23:46.516 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:23:46.520 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:23:48.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:49.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8065800640 1 Processor -- start 2024-09-12T12:23:49.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8065800640 1 -- start start 2024-09-12T12:23:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8065800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f80601568a0 0x7f806015d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8065800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80600b08c0 0x7f806013f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8065800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8060141c50 con 0x7f80600b04e0 2024-09-12T12:23:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8065800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f80601427d0 con 0x7f80600b08c0 2024-09-12T12:23:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8065800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f806013fd40 con 0x7f80601568a0 2024-09-12T12:23:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8064e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80600b08c0 0x7f806013f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8064e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80600b08c0 0x7f806013f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35928/0 (socket says 172.21.15.144:35928) 2024-09-12T12:23:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8064e00640 1 -- 172.21.15.144:0/3398443268 learned_addr learned my addr 172.21.15.144:0/3398443268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f805f400640 1 --2- 172.21.15.144:0/3398443268 >> v2:172.21.15.165:3300/0 conn(0x7f80601568a0 0x7f806015d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:49.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8064e00640 1 -- 172.21.15.144:0/3398443268 >> v2:172.21.15.165:3300/0 conn(0x7f80601568a0 msgr2=0x7f806015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:49.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8064e00640 1 --2- 172.21.15.144:0/3398443268 >> v2:172.21.15.165:3300/0 conn(0x7f80601568a0 0x7f806015d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8064e00640 1 -- 172.21.15.144:0/3398443268 >> v1:172.21.15.165:6789/0 conn(0x7f80600b04e0 legacy=0x7f8060156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:49.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.069+0000 7f8064e00640 1 -- 172.21.15.144:0/3398443268 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8060141f30 con 0x7f80600b08c0 2024-09-12T12:23:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f8064e00640 1 --2- 172.21.15.144:0/3398443268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 0x7f806013f800 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f80600ceb40 tx=0x7f805801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26378c0978bad3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f805ea00640 1 -- 172.21.15.144:0/3398443268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580a56c0 con 0x7f80600b08c0 2024-09-12T12:23:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f805ea00640 1 -- 172.21.15.144:0/3398443268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80580a5860 con 0x7f80600b08c0 2024-09-12T12:23:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f805ea00640 1 -- 172.21.15.144:0/3398443268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580a5c30 con 0x7f80600b08c0 2024-09-12T12:23:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f8065800640 1 -- 172.21.15.144:0/3398443268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 msgr2=0x7f806013f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f8065800640 1 --2- 172.21.15.144:0/3398443268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 0x7f806013f800 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f80600ceb40 tx=0x7f805801c9f0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f8065800640 1 -- 172.21.15.144:0/3398443268 shutdown_connections 2024-09-12T12:23:49.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f8065800640 1 --2- 172.21.15.144:0/3398443268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 0x7f806013f800 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f8065800640 1 --2- 172.21.15.144:0/3398443268 >> v2:172.21.15.165:3300/0 conn(0x7f80601568a0 0x7f806015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f8065800640 1 -- 172.21.15.144:0/3398443268 >> 172.21.15.144:0/3398443268 conn(0x7f806006e060 msgr2=0x7f806006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:49.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f8065800640 1 -- 172.21.15.144:0/3398443268 shutdown_connections 2024-09-12T12:23:49.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.073+0000 7f8065800640 1 -- 172.21.15.144:0/3398443268 wait complete. 2024-09-12T12:23:49.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 Processor -- start 2024-09-12T12:23:49.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 -- start start 2024-09-12T12:23:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80600b04e0 0x7f806015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 0x7f806015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80601568a0 0x7f80601290d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f80600ce000 con 0x7f80600b08c0 2024-09-12T12:23:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f80600cde80 con 0x7f80600b04e0 2024-09-12T12:23:49.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8060141890 con 0x7f80601568a0 2024-09-12T12:23:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 0x7f806015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 0x7f806015b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35936/0 (socket says 172.21.15.144:35936) 2024-09-12T12:23:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80600b04e0 0x7f806015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805f400640 1 -- 172.21.15.144:0/3079145972 learned_addr learned my addr 172.21.15.144:0/3079145972 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:49.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8064e00640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80601568a0 0x7f80601290d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805f400640 1 -- 172.21.15.144:0/3079145972 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80601568a0 msgr2=0x7f80601290d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805f400640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80601568a0 0x7f80601290d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805f400640 1 -- 172.21.15.144:0/3079145972 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80600b04e0 msgr2=0x7f806015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805f400640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80600b04e0 0x7f806015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805f400640 1 -- 172.21.15.144:0/3079145972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8060129d70 con 0x7f80600b08c0 2024-09-12T12:23:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f805f400640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 0x7f806015b5d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f804c00d7d0 tx=0x7f804c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8057e00640 1 -- 172.21.15.144:0/3079145972 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c00b6c0 con 0x7f80600b08c0 2024-09-12T12:23:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8057e00640 1 -- 172.21.15.144:0/3079145972 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c019070 con 0x7f80600b08c0 2024-09-12T12:23:49.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806012a050 con 0x7f80600b08c0 2024-09-12T12:23:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8057e00640 1 -- 172.21.15.144:0/3079145972 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c00bac0 con 0x7f80600b08c0 2024-09-12T12:23:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.077+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806012a610 con 0x7f80600b08c0 2024-09-12T12:23:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.081+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806013f800 con 0x7f80600b08c0 2024-09-12T12:23:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.081+0000 7f8057e00640 1 -- 172.21.15.144:0/3079145972 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f804c00bc60 con 0x7f80600b08c0 2024-09-12T12:23:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.081+0000 7f8057e00640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80400678c0 0x7f8040069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.081+0000 7f8057e00640 1 -- 172.21.15.144:0/3079145972 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7f804c086240 con 0x7f80600b08c0 2024-09-12T12:23:49.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.081+0000 7f805fe00640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80400678c0 0x7f8040069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:49.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.081+0000 7f805fe00640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80400678c0 0x7f8040069d80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8050001770 tx=0x7f8050009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:49.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.085+0000 7f8057e00640 1 -- 172.21.15.144:0/3079145972 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f804c056500 con 0x7f80600b08c0 2024-09-12T12:23:49.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.277+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80600d0f20 con 0x7f80600b08c0 2024-09-12T12:23:49.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.277+0000 7f8057e00640 1 -- 172.21.15.144:0/3079145972 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7f804c05a800 con 0x7f80600b08c0 2024-09-12T12:23:49.276 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:49.276 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:49.277 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:49.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80400678c0 msgr2=0x7f8040069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:49.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80400678c0 0x7f8040069d80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8050001770 tx=0x7f8050009040 comp rx=0 tx=0).stop 2024-09-12T12:23:49.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 msgr2=0x7f806015b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:49.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 0x7f806015b5d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f804c00d7d0 tx=0x7f804c00dc90 comp rx=0 tx=0).stop 2024-09-12T12:23:49.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 shutdown_connections 2024-09-12T12:23:49.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80400678c0 0x7f8040069d80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80601568a0 0x7f80601290d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80600b08c0 0x7f806015b5d0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 --2- 172.21.15.144:0/3079145972 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80600b04e0 0x7f806015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:49.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 >> 172.21.15.144:0/3079145972 conn(0x7f806006e060 msgr2=0x7f80601405b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:49.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 shutdown_connections 2024-09-12T12:23:49.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:49.281+0000 7f8065800640 1 -- 172.21.15.144:0/3079145972 wait complete. 2024-09-12T12:23:49.299 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T12:23:54.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:54.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac53400640 1 Processor -- start 2024-09-12T12:23:54.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac53400640 1 -- start start 2024-09-12T12:23:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac53400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c06f020 0x7fac4c162a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac53400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac4c0afab0 0x7fac4c0717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac53400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac4c0b5270 con 0x7fac4c15e470 2024-09-12T12:23:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac53400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fac4c0b5e40 con 0x7fac4c0afab0 2024-09-12T12:23:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac53400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac4c071d30 con 0x7fac4c06f020 2024-09-12T12:23:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac51400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac4c0afab0 0x7fac4c0717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac51400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac4c0afab0 0x7fac4c0717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35942/0 (socket says 172.21.15.144:35942) 2024-09-12T12:23:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac51400640 1 -- 172.21.15.144:0/1485619081 learned_addr learned my addr 172.21.15.144:0/1485619081 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac4be00640 1 --2- 172.21.15.144:0/1485619081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c06f020 0x7fac4c162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac51400640 1 -- 172.21.15.144:0/1485619081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c06f020 msgr2=0x7fac4c162a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac51400640 1 --2- 172.21.15.144:0/1485619081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c06f020 0x7fac4c162a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac51400640 1 -- 172.21.15.144:0/1485619081 >> v1:172.21.15.165:6789/0 conn(0x7fac4c15e470 legacy=0x7fac4c06e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac51400640 1 -- 172.21.15.144:0/1485619081 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4c0b5510 con 0x7fac4c0afab0 2024-09-12T12:23:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.448+0000 7fac4be00640 1 --2- 172.21.15.144:0/1485619081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c06f020 0x7fac4c162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:23:54.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac51400640 1 --2- 172.21.15.144:0/1485619081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c0afab0 0x7fac4c0717f0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fac44009e50 tx=0x7fac4401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf085531dc31195 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:54.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac4b400640 1 -- 172.21.15.144:0/1485619081 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac440a57f0 con 0x7fac4c0afab0 2024-09-12T12:23:54.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac4b400640 1 -- 172.21.15.144:0/1485619081 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac440a5990 con 0x7fac4c0afab0 2024-09-12T12:23:54.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac4b400640 1 -- 172.21.15.144:0/1485619081 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac440a5d60 con 0x7fac4c0afab0 2024-09-12T12:23:54.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac53400640 1 -- 172.21.15.144:0/1485619081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c0afab0 msgr2=0x7fac4c0717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:54.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac53400640 1 --2- 172.21.15.144:0/1485619081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c0afab0 0x7fac4c0717f0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fac44009e50 tx=0x7fac4401ca30 comp rx=0 tx=0).stop 2024-09-12T12:23:54.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac53400640 1 -- 172.21.15.144:0/1485619081 shutdown_connections 2024-09-12T12:23:54.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac53400640 1 --2- 172.21.15.144:0/1485619081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c0afab0 0x7fac4c0717f0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:54.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac53400640 1 --2- 172.21.15.144:0/1485619081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c06f020 0x7fac4c162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:54.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac53400640 1 -- 172.21.15.144:0/1485619081 >> 172.21.15.144:0/1485619081 conn(0x7fac4c06ddf0 msgr2=0x7fac4c06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:54.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac53400640 1 -- 172.21.15.144:0/1485619081 shutdown_connections 2024-09-12T12:23:54.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.452+0000 7fac53400640 1 -- 172.21.15.144:0/1485619081 wait complete. 2024-09-12T12:23:54.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 Processor -- start 2024-09-12T12:23:54.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 -- start start 2024-09-12T12:23:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c06f020 0x7fac4c161480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c0afab0 0x7fac4c0ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac4c15e470 0x7fac4c0cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac4c0b6ac0 con 0x7fac4c06f020 2024-09-12T12:23:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac4c15e850 con 0x7fac4c15e470 2024-09-12T12:23:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac4c0b6c40 con 0x7fac4c0afab0 2024-09-12T12:23:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac50a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c06f020 0x7fac4c161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac50a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c06f020 0x7fac4c161480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35956/0 (socket says 172.21.15.144:35956) 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac50a00640 1 -- 172.21.15.144:0/1149386901 learned_addr learned my addr 172.21.15.144:0/1149386901 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac4be00640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c0afab0 0x7fac4c0ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac51400640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac4c15e470 0x7fac4c0cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac50a00640 1 -- 172.21.15.144:0/1149386901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c0afab0 msgr2=0x7fac4c0ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac50a00640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c0afab0 0x7fac4c0ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac50a00640 1 -- 172.21.15.144:0/1149386901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac4c15e470 msgr2=0x7fac4c0cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac50a00640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac4c15e470 0x7fac4c0cfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac50a00640 1 -- 172.21.15.144:0/1149386901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac4c0ceb10 con 0x7fac4c06f020 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac50a00640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c06f020 0x7fac4c161480 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00c370 tx=0x7fac3c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac48c00640 1 -- 172.21.15.144:0/1149386901 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0052d0 con 0x7fac4c06f020 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac48c00640 1 -- 172.21.15.144:0/1149386901 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3c005470 con 0x7fac4c06f020 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac48c00640 1 -- 172.21.15.144:0/1149386901 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c007260 con 0x7fac4c06f020 2024-09-12T12:23:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4c0cedb0 con 0x7fac4c06f020 2024-09-12T12:23:54.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac4c0cf370 con 0x7fac4c06f020 2024-09-12T12:23:54.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.456+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4c162a80 con 0x7fac4c06f020 2024-09-12T12:23:54.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.460+0000 7fac48c00640 1 -- 172.21.15.144:0/1149386901 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac3c007400 con 0x7fac4c06f020 2024-09-12T12:23:54.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.460+0000 7fac48c00640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac2c0678c0 0x7fac2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:54.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.460+0000 7fac48c00640 1 -- 172.21.15.144:0/1149386901 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 6101+0+0 (secure 0 0 0) 0x7fac3c085340 con 0x7fac4c06f020 2024-09-12T12:23:54.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.460+0000 7fac4be00640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac2c0678c0 0x7fac2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:54.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.460+0000 7fac4be00640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac2c0678c0 0x7fac2c069d80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0b1220 tx=0x7fac38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:54.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.464+0000 7fac48c00640 1 -- 172.21.15.144:0/1149386901 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fac3c055c50 con 0x7fac4c06f020 2024-09-12T12:23:54.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac4c067b00 con 0x7fac4c06f020 2024-09-12T12:23:54.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac48c00640 1 -- 172.21.15.144:0/1149386901 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) ==== 95+0+5245 (secure 0 0 0) 0x7fac3c055550 con 0x7fac4c06f020 2024-09-12T12:23:54.655 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:23:54.656 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":123,"btime":"2024-09-12T12:23:06:861220+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":123,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:06.242554+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9363":{"gid":9363,"name":"c","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/2909096469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2909096469},{"type":"v1","addr":"172.21.15.144:6837","nonce":2909096469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9363,"qdb_cluster":[9363]},"id":11}]} 2024-09-12T12:23:54.656 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 123 2024-09-12T12:23:54.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac2c0678c0 msgr2=0x7fac2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:54.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac2c0678c0 0x7fac2c069d80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0b1220 tx=0x7fac38008040 comp rx=0 tx=0).stop 2024-09-12T12:23:54.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c06f020 msgr2=0x7fac4c161480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:54.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c06f020 0x7fac4c161480 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00c370 tx=0x7fac3c00c830 comp rx=0 tx=0).stop 2024-09-12T12:23:54.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 shutdown_connections 2024-09-12T12:23:54.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac2c0678c0 0x7fac2c069d80 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:54.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac4c15e470 0x7fac4c0cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:54.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac4c0afab0 0x7fac4c0ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:54.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 --2- 172.21.15.144:0/1149386901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac4c06f020 0x7fac4c161480 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:54.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 >> 172.21.15.144:0/1149386901 conn(0x7fac4c06ddf0 msgr2=0x7fac4c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:54.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 shutdown_connections 2024-09-12T12:23:54.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:54.656+0000 7fac53400640 1 -- 172.21.15.144:0/1149386901 wait complete. 2024-09-12T12:23:54.677 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-12T12:23:59.678 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:23:59.807 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-12T12:23:59.808+0000 7f2168200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:23:59.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.816+0000 7f314e000640 1 Processor -- start 2024-09-12T12:23:59.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.816+0000 7f314e000640 1 -- start start 2024-09-12T12:23:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f314e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f314815c7b0 0x7f31480ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f314e000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31480b5fb0 0x7f3148072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f314e000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31480cd870 con 0x7f314815cd30 2024-09-12T12:23:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f314e000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3148072a50 con 0x7f314815c7b0 2024-09-12T12:23:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f314e000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f31480cde30 con 0x7f31480b5fb0 2024-09-12T12:23:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f3147400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f314815c7b0 0x7f31480ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f3146a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f314815cd30 0x7f31480b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55870/0 (socket says 172.21.15.144:55870) 2024-09-12T12:23:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f3146a00640 1 -- 172.21.15.144:0/4125446881 learned_addr learned my addr 172.21.15.144:0/4125446881 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:23:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f3147e00640 1 --2- 172.21.15.144:0/4125446881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31480b5fb0 0x7f3148072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f3147400640 1 -- 172.21.15.144:0/4125446881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31480b5fb0 msgr2=0x7f3148072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:23:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f3147400640 1 --2- 172.21.15.144:0/4125446881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31480b5fb0 0x7f3148072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f3147400640 1 -- 172.21.15.144:0/4125446881 >> v1:172.21.15.144:6789/0 conn(0x7f314815cd30 legacy=0x7f31480b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f3147400640 1 -- 172.21.15.144:0/4125446881 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31480cdb50 con 0x7f314815c7b0 2024-09-12T12:23:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.820+0000 7f3146000640 1 -- 172.21.15.144:0/4125446881 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345625458 0 0) 0x7f31480cd870 con 0x7f314815cd30 2024-09-12T12:23:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f3147400640 1 --2- 172.21.15.144:0/4125446881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 0x7f31480ccf00 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f3138009d90 tx=0x7f313801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab77fcb677032d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f3146000640 1 -- 172.21.15.144:0/4125446881 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31380b2070 con 0x7f314815c7b0 2024-09-12T12:23:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f3146000640 1 -- 172.21.15.144:0/4125446881 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31380a5940 con 0x7f314815c7b0 2024-09-12T12:23:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f3146000640 1 -- 172.21.15.144:0/4125446881 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31380a5d10 con 0x7f314815c7b0 2024-09-12T12:23:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 -- 172.21.15.144:0/4125446881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 msgr2=0x7f31480ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 --2- 172.21.15.144:0/4125446881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 0x7f31480ccf00 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f3138009d90 tx=0x7f313801c970 comp rx=0 tx=0).stop 2024-09-12T12:23:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 -- 172.21.15.144:0/4125446881 shutdown_connections 2024-09-12T12:23:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 --2- 172.21.15.144:0/4125446881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31480b5fb0 0x7f3148072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 --2- 172.21.15.144:0/4125446881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 0x7f31480ccf00 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 -- 172.21.15.144:0/4125446881 >> 172.21.15.144:0/4125446881 conn(0x7f314806d0d0 msgr2=0x7f314806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:23:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 -- 172.21.15.144:0/4125446881 shutdown_connections 2024-09-12T12:23:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 -- 172.21.15.144:0/4125446881 wait complete. 2024-09-12T12:23:59.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 Processor -- start 2024-09-12T12:23:59.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 -- start start 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31480b5fb0 0x7f31481612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 0x7f3148162130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f314815cd30 0x7f31481588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3148073fc0 con 0x7f314815c7b0 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3148073e40 con 0x7f31480b5fb0 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.824+0000 7f314e000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3148074140 con 0x7f314815cd30 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3146a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 0x7f3148162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3146a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 0x7f3148162130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34908/0 (socket says 172.21.15.144:34908) 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3146a00640 1 -- 172.21.15.144:0/3589856767 learned_addr learned my addr 172.21.15.144:0/3589856767 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3147400640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31480b5fb0 0x7f31481612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3147e00640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f314815cd30 0x7f31481588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3146a00640 1 -- 172.21.15.144:0/3589856767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f314815cd30 msgr2=0x7f31481588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3146a00640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f314815cd30 0x7f31481588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3146a00640 1 -- 172.21.15.144:0/3589856767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31480b5fb0 msgr2=0x7f31481612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:23:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3146a00640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31480b5fb0 0x7f31481612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:23:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3146a00640 1 -- 172.21.15.144:0/3589856767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31481627c0 con 0x7f314815c7b0 2024-09-12T12:23:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f3146a00640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 0x7f3148162130 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f3134005890 tx=0x7f313400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f313f400640 1 -- 172.21.15.144:0/3589856767 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134017070 con 0x7f314815c7b0 2024-09-12T12:23:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f313f400640 1 -- 172.21.15.144:0/3589856767 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3134005d10 con 0x7f314815c7b0 2024-09-12T12:23:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f313f400640 1 -- 172.21.15.144:0/3589856767 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134007310 con 0x7f314815c7b0 2024-09-12T12:23:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3148162aa0 con 0x7f314815c7b0 2024-09-12T12:23:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31481583a0 con 0x7f314815c7b0 2024-09-12T12:23:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31481585a0 con 0x7f314815c7b0 2024-09-12T12:23:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f313f400640 1 -- 172.21.15.144:0/3589856767 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f313401a070 con 0x7f314815c7b0 2024-09-12T12:23:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f313f400640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31280678c0 0x7f3128069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:23:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.828+0000 7f313f400640 1 -- 172.21.15.144:0/3589856767 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7f3134085170 con 0x7f314815c7b0 2024-09-12T12:23:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.832+0000 7f3147400640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31280678c0 0x7f3128069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:23:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.832+0000 7f3147400640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31280678c0 0x7f3128069d80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f31380af000 tx=0x7f31380a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:23:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:23:59.832+0000 7f313f400640 1 -- 172.21.15.144:0/3589856767 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f31481585a0 con 0x7f314815c7b0 2024-09-12T12:24:00.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.028+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3148157500 con 0x7f314815c7b0 2024-09-12T12:24:00.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.028+0000 7f313f400640 1 -- 172.21.15.144:0/3589856767 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+4419 (secure 0 0 0) 0x7f3134055470 con 0x7f314815c7b0 2024-09-12T12:24:00.030 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:00.030 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":127,"btime":"2024-09-12T12:23:58:281097+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:58.281091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":166,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"a","rank":0,"incarnation":124,"state":"up:active","state_seq":18,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9360,"qdb_cluster":[9360]},"id":11}]} 2024-09-12T12:24:00.030 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 127 2024-09-12T12:24:00.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31280678c0 msgr2=0x7f3128069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31280678c0 0x7f3128069d80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f31380af000 tx=0x7f31380a7070 comp rx=0 tx=0).stop 2024-09-12T12:24:00.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 msgr2=0x7f3148162130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 0x7f3148162130 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f3134005890 tx=0x7f313400c8e0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 shutdown_connections 2024-09-12T12:24:00.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31280678c0 0x7f3128069d80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f314815cd30 0x7f31481588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f314815c7b0 0x7f3148162130 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 --2- 172.21.15.144:0/3589856767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31480b5fb0 0x7f31481612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 >> 172.21.15.144:0/3589856767 conn(0x7f314806d0d0 msgr2=0x7f31480b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 shutdown_connections 2024-09-12T12:24:00.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.032+0000 7f314e000640 1 -- 172.21.15.144:0/3589856767 wait complete. 2024-09-12T12:24:00.051 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-12T12:24:00.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.184+0000 7f245da00640 1 Processor -- start 2024-09-12T12:24:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245da00640 1 -- start start 2024-09-12T12:24:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245da00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2458073bd0 0x7f2458070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24580cff90 0x7f24580d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245da00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24580cd1d0 con 0x7f245815b160 2024-09-12T12:24:00.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245da00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f24580d0940 con 0x7f24580cff90 2024-09-12T12:24:00.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245da00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f245815b540 con 0x7f2458073bd0 2024-09-12T12:24:00.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24580cff90 0x7f24580d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f2457e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f245815b160 0x7f24580ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55876/0 (socket says 172.21.15.144:55876) 2024-09-12T12:24:00.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f2457e00640 1 -- 172.21.15.144:0/3747568898 learned_addr learned my addr 172.21.15.144:0/3747568898 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:00.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f2457400640 1 --2- 172.21.15.144:0/3747568898 >> v2:172.21.15.165:3300/0 conn(0x7f2458073bd0 0x7f2458070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f2456a00640 1 -- 172.21.15.144:0/3747568898 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158168809 0 0) 0x7f24580cd1d0 con 0x7f245815b160 2024-09-12T12:24:00.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f2456a00640 1 -- 172.21.15.144:0/3747568898 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f243c005740 con 0x7f245815b160 2024-09-12T12:24:00.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245d000640 1 -- 172.21.15.144:0/3747568898 >> v2:172.21.15.165:3300/0 conn(0x7f2458073bd0 msgr2=0x7f2458070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:00.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245d000640 1 --2- 172.21.15.144:0/3747568898 >> v2:172.21.15.165:3300/0 conn(0x7f2458073bd0 0x7f2458070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245d000640 1 -- 172.21.15.144:0/3747568898 >> v1:172.21.15.144:6789/0 conn(0x7f245815b160 legacy=0x7f24580ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.188+0000 7f245d000640 1 -- 172.21.15.144:0/3747568898 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24580cd4a0 con 0x7f24580cff90 2024-09-12T12:24:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245d000640 1 --2- 172.21.15.144:0/3747568898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24580cff90 0x7f24580d0400 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f24580d10d0 tx=0x7f245001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76b717da02563d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f2456a00640 1 -- 172.21.15.144:0/3747568898 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500b2070 con 0x7f24580cff90 2024-09-12T12:24:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f2456a00640 1 -- 172.21.15.144:0/3747568898 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24500a5850 con 0x7f24580cff90 2024-09-12T12:24:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f2456a00640 1 -- 172.21.15.144:0/3747568898 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500a5c00 con 0x7f24580cff90 2024-09-12T12:24:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 -- 172.21.15.144:0/3747568898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24580cff90 msgr2=0x7f24580d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 --2- 172.21.15.144:0/3747568898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24580cff90 0x7f24580d0400 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f24580d10d0 tx=0x7f245001c8a0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 -- 172.21.15.144:0/3747568898 shutdown_connections 2024-09-12T12:24:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 --2- 172.21.15.144:0/3747568898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24580cff90 0x7f24580d0400 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 --2- 172.21.15.144:0/3747568898 >> v2:172.21.15.165:3300/0 conn(0x7f2458073bd0 0x7f2458070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 -- 172.21.15.144:0/3747568898 >> 172.21.15.144:0/3747568898 conn(0x7f245806bc10 msgr2=0x7f245806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 -- 172.21.15.144:0/3747568898 shutdown_connections 2024-09-12T12:24:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 -- 172.21.15.144:0/3747568898 wait complete. 2024-09-12T12:24:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 Processor -- start 2024-09-12T12:24:00.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.192+0000 7f245da00640 1 -- start start 2024-09-12T12:24:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2458073bd0 0x7f24581527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24580cff90 0x7f245815a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245815b160 0x7f2458151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24580b4310 con 0x7f245815b160 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245da00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f24580b4190 con 0x7f2458073bd0 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f24580b4490 con 0x7f24580cff90 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245815b160 0x7f2458151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245815b160 0x7f2458151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34930/0 (socket says 172.21.15.144:34930) 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245d000640 1 -- 172.21.15.144:0/3012105349 learned_addr learned my addr 172.21.15.144:0/3012105349 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f2457e00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2458073bd0 0x7f24581527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f2457400640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24580cff90 0x7f245815a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245d000640 1 -- 172.21.15.144:0/3012105349 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24580cff90 msgr2=0x7f245815a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245d000640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24580cff90 0x7f245815a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245d000640 1 -- 172.21.15.144:0/3012105349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2458073bd0 msgr2=0x7f24581527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245d000640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2458073bd0 0x7f24581527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245d000640 1 -- 172.21.15.144:0/3012105349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245815df60 con 0x7f245815b160 2024-09-12T12:24:00.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245d000640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245815b160 0x7f2458151c20 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f24500b0040 tx=0x7f2450019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:00.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f244fe00640 1 -- 172.21.15.144:0/3012105349 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500b2050 con 0x7f245815b160 2024-09-12T12:24:00.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f244fe00640 1 -- 172.21.15.144:0/3012105349 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24500be070 con 0x7f245815b160 2024-09-12T12:24:00.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f244fe00640 1 -- 172.21.15.144:0/3012105349 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500ad870 con 0x7f245815b160 2024-09-12T12:24:00.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245815e200 con 0x7f245815b160 2024-09-12T12:24:00.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24580b0bd0 con 0x7f245815b160 2024-09-12T12:24:00.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.196+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24580d0400 con 0x7f245815b160 2024-09-12T12:24:00.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.200+0000 7f244fe00640 1 -- 172.21.15.144:0/3012105349 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24500ada10 con 0x7f245815b160 2024-09-12T12:24:00.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.200+0000 7f244fe00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24380678c0 0x7f2438069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.200+0000 7f244fe00640 1 -- 172.21.15.144:0/3012105349 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7f2450120f30 con 0x7f245815b160 2024-09-12T12:24:00.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.200+0000 7f2457e00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24380678c0 0x7f2438069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.200+0000 7f2457e00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24380678c0 0x7f2438069d80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2448007fd0 tx=0x7f2448009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:00.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.204+0000 7f244fe00640 1 -- 172.21.15.144:0/3012105349 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2450016520 con 0x7f245815b160 2024-09-12T12:24:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2458073300 con 0x7f245815b160 2024-09-12T12:24:00.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f244fe00640 1 -- 172.21.15.144:0/3012105349 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+4419 (secure 0 0 0) 0x7f24500add00 con 0x7f245815b160 2024-09-12T12:24:00.396 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:00.396 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":127,"btime":"2024-09-12T12:23:58:281097+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:58.281091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":166,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"a","rank":0,"incarnation":124,"state":"up:active","state_seq":18,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9360,"qdb_cluster":[9360]},"id":11}]} 2024-09-12T12:24:00.396 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 127 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24380678c0 msgr2=0x7f2438069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24380678c0 0x7f2438069d80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2448007fd0 tx=0x7f2448009040 comp rx=0 tx=0).stop 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245815b160 msgr2=0x7f2458151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245815b160 0x7f2458151c20 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f24500b0040 tx=0x7f2450019640 comp rx=0 tx=0).stop 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 shutdown_connections 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f24380678c0 0x7f2438069d80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f245815b160 0x7f2458151c20 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24580cff90 0x7f245815a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 --2- 172.21.15.144:0/3012105349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2458073bd0 0x7f24581527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 >> 172.21.15.144:0/3012105349 conn(0x7f245806bc10 msgr2=0x7f245815f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:00.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 shutdown_connections 2024-09-12T12:24:00.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.396+0000 7f245da00640 1 -- 172.21.15.144:0/3012105349 wait complete. 2024-09-12T12:24:00.417 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-12T12:24:00.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:24:00.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.552+0000 7f987be00640 1 Processor -- start 2024-09-12T12:24:00.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.552+0000 7f987be00640 1 -- start start 2024-09-12T12:24:00.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f987c0d27b0 0x7f987c06f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f987c0734a0 con 0x7f987c15e5b0 2024-09-12T12:24:00.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987be00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f987c073780 con 0x7f987c072fa0 2024-09-12T12:24:00.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987be00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f987c06ce30 con 0x7f987c0d27b0 2024-09-12T12:24:00.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f987c15e5b0 0x7f987c0d20a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55880/0 (socket says 172.21.15.144:55880) 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987aa00640 1 -- 172.21.15.144:0/2238388613 learned_addr learned my addr 172.21.15.144:0/2238388613 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987a000640 1 --2- 172.21.15.144:0/2238388613 >> v2:172.21.15.165:3300/0 conn(0x7f987c0d27b0 0x7f987c06f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698712456 0 0) 0x7f987c0734a0 con 0x7f987c15e5b0 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9860003530 con 0x7f987c15e5b0 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1482884098 0 0) 0x7f987c073780 con 0x7f987c072fa0 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f987c0734a0 con 0x7f987c072fa0 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3563989547 0 0) 0x7f9860003530 con 0x7f987c15e5b0 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 >> v2:172.21.15.165:3300/0 conn(0x7f987c0d27b0 msgr2=0x7f987c06f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 --2- 172.21.15.144:0/2238388613 >> v2:172.21.15.165:3300/0 conn(0x7f987c0d27b0 0x7f987c06f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 >> v1:172.21.15.165:6789/0 conn(0x7f987c072fa0 legacy=0x7f987c06d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c073a60 con 0x7f987c15e5b0 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f986c001a00 con 0x7f987c15e5b0 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 >> v1:172.21.15.144:6789/0 conn(0x7f987c15e5b0 legacy=0x7f987c0d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9860003ba0 0x7f9860003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9860004810 0x7f9860004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98600051d0 0x7f986000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f986000bfc0 con 0x7f9860004810 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f986000c170 con 0x7f9860003ba0 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f986000c370 con 0x7f98600051d0 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987a000640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9860004810 0x7f9860004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987aa00640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9860003ba0 0x7f9860003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987b400640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98600051d0 0x7f986000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987a000640 1 -- 172.21.15.144:0/2238388613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98600051d0 msgr2=0x7f986000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987a000640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98600051d0 0x7f986000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987a000640 1 -- 172.21.15.144:0/2238388613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9860003ba0 msgr2=0x7f9860003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:00.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987a000640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9860003ba0 0x7f9860003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987a000640 1 -- 172.21.15.144:0/2238388613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9860003530 con 0x7f9860004810 2024-09-12T12:24:00.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987b400640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98600051d0 0x7f986000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:00.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.556+0000 7f987b400640 1 -- 172.21.15.144:0/2238388613 reap_dead start 2024-09-12T12:24:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987a000640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9860004810 0x7f9860004c90 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f9868009ae0 tx=0x7f986801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ccb7c3253941b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680b2070 con 0x7f9860004810 2024-09-12T12:24:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98680a5660 con 0x7f9860004810 2024-09-12T12:24:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f9879600640 1 -- 172.21.15.144:0/2238388613 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680096b0 con 0x7f9860004810 2024-09-12T12:24:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987be00640 1 -- 172.21.15.144:0/2238388613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9860004810 msgr2=0x7f9860004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987be00640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9860004810 0x7f9860004c90 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f9868009ae0 tx=0x7f986801ca70 comp rx=0 tx=0).stop 2024-09-12T12:24:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987be00640 1 -- 172.21.15.144:0/2238388613 shutdown_connections 2024-09-12T12:24:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987be00640 1 --2- 172.21.15.144:0/2238388613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9860004810 0x7f9860004c90 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987be00640 1 -- 172.21.15.144:0/2238388613 >> 172.21.15.144:0/2238388613 conn(0x7f987c067a00 msgr2=0x7f987c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:00.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987be00640 1 -- 172.21.15.144:0/2238388613 shutdown_connections 2024-09-12T12:24:00.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987be00640 1 -- 172.21.15.144:0/2238388613 wait complete. 2024-09-12T12:24:00.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987be00640 1 Processor -- start 2024-09-12T12:24:00.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.560+0000 7f987be00640 1 -- start start 2024-09-12T12:24:00.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9860004810 0x7f987c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f987c0b1840 0x7f987c1f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f987c0b5310 0x7f987c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f987c15e990 con 0x7f987c0b1840 2024-09-12T12:24:00.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f987c074020 con 0x7f987c0b5310 2024-09-12T12:24:00.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f987c06ff70 con 0x7f9860004810 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f987c0b1840 0x7f987c1f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f987c0b1840 0x7f987c1f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34954/0 (socket says 172.21.15.144:34954) 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987a000640 1 -- 172.21.15.144:0/1839840682 learned_addr learned my addr 172.21.15.144:0/1839840682 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987aa00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9860004810 0x7f987c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987b400640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f987c0b5310 0x7f987c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987a000640 1 -- 172.21.15.144:0/1839840682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9860004810 msgr2=0x7f987c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987a000640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9860004810 0x7f987c0c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987a000640 1 -- 172.21.15.144:0/1839840682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f987c0b5310 msgr2=0x7f987c0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987a000640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f987c0b5310 0x7f987c0b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987a000640 1 -- 172.21.15.144:0/1839840682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c1f4bc0 con 0x7f987c0b1840 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987b400640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f987c0b5310 0x7f987c0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987a000640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f987c0b1840 0x7f987c1f4680 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f986801c8a0 tx=0x7f9868019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:00.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f9872a00640 1 -- 172.21.15.144:0/1839840682 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680b2040 con 0x7f987c0b1840 2024-09-12T12:24:00.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f9872a00640 1 -- 172.21.15.144:0/1839840682 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986800f000 con 0x7f987c0b1840 2024-09-12T12:24:00.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987c0ae9a0 con 0x7f987c0b1840 2024-09-12T12:24:00.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f9872a00640 1 -- 172.21.15.144:0/1839840682 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680096b0 con 0x7f987c0b1840 2024-09-12T12:24:00.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987c0aef60 con 0x7f987c0b1840 2024-09-12T12:24:00.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.564+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987c06f7f0 con 0x7f987c0b1840 2024-09-12T12:24:00.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.568+0000 7f9872a00640 1 -- 172.21.15.144:0/1839840682 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f98680bf030 con 0x7f987c0b1840 2024-09-12T12:24:00.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.568+0000 7f9872a00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f985c0678f0 0x7f985c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:00.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.568+0000 7f9872a00640 1 -- 172.21.15.144:0/1839840682 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7f986811fa80 con 0x7f987c0b1840 2024-09-12T12:24:00.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.568+0000 7f987aa00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f985c0678f0 0x7f985c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:00.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.568+0000 7f987aa00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f985c0678f0 0x7f985c069db0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f986c000f90 tx=0x7f986c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:00.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.572+0000 7f9872a00640 1 -- 172.21.15.144:0/1839840682 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9868121e20 con 0x7f987c0b1840 2024-09-12T12:24:00.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.788+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f987c161ef0 con 0x7f987c0b1840 2024-09-12T12:24:00.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.788+0000 7f9872a00640 1 -- 172.21.15.144:0/1839840682 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1514 (secure 0 0 0) 0x7f98680c6060 con 0x7f987c0b1840 2024-09-12T12:24:00.789 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:00.789 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":700,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":166,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1049,"data_bytes":1078537680,"bytes_used":2609647616,"bytes_avail":770484465664,"bytes_total":773094113280,"read_bytes_sec":224202,"write_bytes_sec":301291,"read_op_per_sec":6,"write_op_per_sec":102},"fsmap":{"epoch":127,"btime":"2024-09-12T12:23:58:281097+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9360}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-12T12:23:55.519644+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f985c0678f0 msgr2=0x7f985c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f985c0678f0 0x7f985c069db0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f986c000f90 tx=0x7f986c009040 comp rx=0 tx=0).stop 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f987c0b1840 msgr2=0x7f987c1f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f987c0b1840 0x7f987c1f4680 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f986801c8a0 tx=0x7f9868019810 comp rx=0 tx=0).stop 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 shutdown_connections 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f985c0678f0 0x7f985c069db0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f987c0b5310 0x7f987c0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f987c0b1840 0x7f987c1f4680 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 --2- 172.21.15.144:0/1839840682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9860004810 0x7f987c0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 >> 172.21.15.144:0/1839840682 conn(0x7f987c067a00 msgr2=0x7f987c0b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:00.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 shutdown_connections 2024-09-12T12:24:00.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:00.792+0000 7f987be00640 1 -- 172.21.15.144:0/1839840682 wait complete. 2024-09-12T12:24:00.809 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-12T12:24:00.810 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:24:00.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:24:00.901 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:24:00.979 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:24:00.979 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:24:00.979 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:24:00.979 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:00.989 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:24:00.989 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:01.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:24:01.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.216+0000 7f5ca8a00640 1 Processor -- start 2024-09-12T12:24:01.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.216+0000 7f5ca8a00640 1 -- start start 2024-09-12T12:24:01.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca8a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5ca415c7b0 0x7f5ca40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca8a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca40cd870 con 0x7f5ca415cd30 2024-09-12T12:24:01.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca8a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca4072a50 con 0x7f5ca415c7b0 2024-09-12T12:24:01.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca8a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca40cde30 con 0x7f5ca40b5fb0 2024-09-12T12:24:01.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca4072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:36442/0 (socket says 172.21.15.144:36442) 2024-09-12T12:24:01.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca2800640 1 -- 172.21.15.144:0/1483058448 learned_addr learned my addr 172.21.15.144:0/1483058448 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:01.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca1e00640 1 --2- 172.21.15.144:0/1483058448 >> v2:172.21.15.165:3300/0 conn(0x7f5ca415c7b0 0x7f5ca40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca2800640 1 -- 172.21.15.144:0/1483058448 >> v2:172.21.15.165:3300/0 conn(0x7f5ca415c7b0 msgr2=0x7f5ca40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:01.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca2800640 1 --2- 172.21.15.144:0/1483058448 >> v2:172.21.15.165:3300/0 conn(0x7f5ca415c7b0 0x7f5ca40ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca2800640 1 -- 172.21.15.144:0/1483058448 >> v1:172.21.15.165:6789/0 conn(0x7f5ca415cd30 legacy=0x7f5ca40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.220+0000 7f5ca2800640 1 -- 172.21.15.144:0/1483058448 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca40cdb50 con 0x7f5ca40b5fb0 2024-09-12T12:24:01.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca2800640 1 --2- 172.21.15.144:0/1483058448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca4072ee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009e50 tx=0x7f5c9c01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a888d4e6bc9573e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:01.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca0a00640 1 -- 172.21.15.144:0/1483058448 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0a5810 con 0x7f5ca40b5fb0 2024-09-12T12:24:01.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca0a00640 1 -- 172.21.15.144:0/1483058448 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0a59b0 con 0x7f5ca40b5fb0 2024-09-12T12:24:01.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca0a00640 1 -- 172.21.15.144:0/1483058448 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0a5d80 con 0x7f5ca40b5fb0 2024-09-12T12:24:01.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 -- 172.21.15.144:0/1483058448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 msgr2=0x7f5ca4072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 --2- 172.21.15.144:0/1483058448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca4072ee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009e50 tx=0x7f5c9c01ca30 comp rx=0 tx=0).stop 2024-09-12T12:24:01.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 -- 172.21.15.144:0/1483058448 shutdown_connections 2024-09-12T12:24:01.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 --2- 172.21.15.144:0/1483058448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca4072ee0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 --2- 172.21.15.144:0/1483058448 >> v2:172.21.15.165:3300/0 conn(0x7f5ca415c7b0 0x7f5ca40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 -- 172.21.15.144:0/1483058448 >> 172.21.15.144:0/1483058448 conn(0x7f5ca406d0d0 msgr2=0x7f5ca406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:01.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 -- 172.21.15.144:0/1483058448 shutdown_connections 2024-09-12T12:24:01.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 -- 172.21.15.144:0/1483058448 wait complete. 2024-09-12T12:24:01.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 Processor -- start 2024-09-12T12:24:01.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.224+0000 7f5ca8a00640 1 -- start start 2024-09-12T12:24:01.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca41471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca8a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ca415c7b0 0x7f5ca415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca415cd30 0x7f5ca415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca8a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4073fc0 con 0x7f5ca415cd30 2024-09-12T12:24:01.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca8a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4073e40 con 0x7f5ca415c7b0 2024-09-12T12:24:01.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca8a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca4074140 con 0x7f5ca40b5fb0 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca415cd30 0x7f5ca415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca415cd30 0x7f5ca415e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34966/0 (socket says 172.21.15.144:34966) 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca2800640 1 -- 172.21.15.144:0/4131533682 learned_addr learned my addr 172.21.15.144:0/4131533682 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca1e00640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca41471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca1400640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ca415c7b0 0x7f5ca415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca2800640 1 -- 172.21.15.144:0/4131533682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 msgr2=0x7f5ca41471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca2800640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca41471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca2800640 1 -- 172.21.15.144:0/4131533682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ca415c7b0 msgr2=0x7f5ca415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca2800640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ca415c7b0 0x7f5ca415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca2800640 1 -- 172.21.15.144:0/4131533682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca4148100 con 0x7f5ca415cd30 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca2800640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca415cd30 0x7f5ca415e6c0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0af040 tx=0x7f5c9c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5c9a000640 1 -- 172.21.15.144:0/4131533682 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0b8670 con 0x7f5ca415cd30 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5c9a000640 1 -- 172.21.15.144:0/4131533682 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0be070 con 0x7f5ca415cd30 2024-09-12T12:24:01.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5c9a000640 1 -- 172.21.15.144:0/4131533682 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0b8a70 con 0x7f5ca415cd30 2024-09-12T12:24:01.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca41483e0 con 0x7f5ca415cd30 2024-09-12T12:24:01.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca41489a0 con 0x7f5ca415cd30 2024-09-12T12:24:01.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.228+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca4072ee0 con 0x7f5ca415cd30 2024-09-12T12:24:01.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.232+0000 7f5c9a000640 1 -- 172.21.15.144:0/4131533682 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c9c0b8c10 con 0x7f5ca415cd30 2024-09-12T12:24:01.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.232+0000 7f5c9a000640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c840678f0 0x7f5c84069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.232+0000 7f5c9a000640 1 -- 172.21.15.144:0/4131533682 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7f5c9c120b30 con 0x7f5ca415cd30 2024-09-12T12:24:01.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.232+0000 7f5ca1e00640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c840678f0 0x7f5c84069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.232+0000 7f5ca1e00640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c840678f0 0x7f5c84069db0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009b60 tx=0x7f5c94009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:01.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.236+0000 7f5c9a000640 1 -- 172.21.15.144:0/4131533682 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5c9c016620 con 0x7f5ca415cd30 2024-09-12T12:24:01.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.404+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5ca40af970 con 0x7f5ca415cd30 2024-09-12T12:24:01.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5c9a000640 1 -- 172.21.15.144:0/4131533682 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v166) ==== 80+0+124 (secure 0 0 0) 0x7f5c9c0a5980 con 0x7f5ca415cd30 2024-09-12T12:24:01.407 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:6837/2909096469 2024-09-13T12:23:55.265062+0000 2024-09-12T12:24:01.407 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144:6835/2909096469 2024-09-13T12:23:55.265062+0000 2024-09-12T12:24:01.407 INFO:teuthology.orchestra.run.smithi144.stderr:listed 2 entries 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c840678f0 msgr2=0x7f5c84069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c840678f0 0x7f5c84069db0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009b60 tx=0x7f5c94009190 comp rx=0 tx=0).stop 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca415cd30 msgr2=0x7f5ca415e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca415cd30 0x7f5ca415e6c0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0af040 tx=0x7f5c9c0197d0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 shutdown_connections 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5c840678f0 0x7f5c84069db0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ca415cd30 0x7f5ca415e6c0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ca415c7b0 0x7f5ca415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 --2- 172.21.15.144:0/4131533682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ca40b5fb0 0x7f5ca41471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 >> 172.21.15.144:0/4131533682 conn(0x7f5ca406d0d0 msgr2=0x7f5ca40ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:01.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 shutdown_connections 2024-09-12T12:24:01.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.408+0000 7f5ca8a00640 1 -- 172.21.15.144:0/4131533682 wait complete. 2024-09-12T12:24:01.427 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:24:01.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:01.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:24:01.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:24:01.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:01.483 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:24:01.492 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:24:01.492 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:24:01.492 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:01.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:24:01.502 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:24:01.502 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:24:01.502 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:01.542 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:24:01.542 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:24:01.542 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:24:01.543 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:01.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:24:01.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:01.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.720+0000 7f67a4800640 1 Processor -- start 2024-09-12T12:24:01.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.720+0000 7f67a4800640 1 -- start start 2024-09-12T12:24:01.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.720+0000 7f67a4800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f679c15b4e0 0x7f679c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.720+0000 7f67a4800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0b3ad0 0x7f679c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.720+0000 7f67a4800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f679c071960 0x7f679c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a4800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f679c0b45a0 con 0x7f679c15b4e0 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a4800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f679c0b3fe0 con 0x7f679c071960 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a4800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f679c0b42c0 con 0x7f679c0b3ad0 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f679c15b4e0 0x7f679c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f679c15b4e0 0x7f679c0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34972/0 (socket says 172.21.15.144:34972) 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1e00640 1 -- 172.21.15.144:0/3500222359 learned_addr learned my addr 172.21.15.144:0/3500222359 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a2800640 1 --2- 172.21.15.144:0/3500222359 >> v2:172.21.15.165:3300/0 conn(0x7f679c071960 0x7f679c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1400640 1 --2- 172.21.15.144:0/3500222359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0b3ad0 0x7f679c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1e00640 1 -- 172.21.15.144:0/3500222359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0b3ad0 msgr2=0x7f679c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:01.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1e00640 1 --2- 172.21.15.144:0/3500222359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0b3ad0 0x7f679c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1e00640 1 -- 172.21.15.144:0/3500222359 >> v2:172.21.15.165:3300/0 conn(0x7f679c071960 msgr2=0x7f679c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:01.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1e00640 1 --2- 172.21.15.144:0/3500222359 >> v2:172.21.15.165:3300/0 conn(0x7f679c071960 0x7f679c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1e00640 1 -- 172.21.15.144:0/3500222359 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c0b1490 con 0x7f679c15b4e0 2024-09-12T12:24:01.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a1e00640 1 --2- 172.21.15.144:0/3500222359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15b4e0 0x7f679c0b3590 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f679c0d04b0 tx=0x7f679001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ca2f6a96b5f0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:01.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a0a00640 1 -- 172.21.15.144:0/3500222359 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900b1070 con 0x7f679c15b4e0 2024-09-12T12:24:01.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a0a00640 1 -- 172.21.15.144:0/3500222359 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67900ac620 con 0x7f679c15b4e0 2024-09-12T12:24:01.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.724+0000 7f67a0a00640 1 -- 172.21.15.144:0/3500222359 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900ac9f0 con 0x7f679c15b4e0 2024-09-12T12:24:01.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 -- 172.21.15.144:0/3500222359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15b4e0 msgr2=0x7f679c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 --2- 172.21.15.144:0/3500222359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15b4e0 0x7f679c0b3590 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f679c0d04b0 tx=0x7f679001c4f0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 -- 172.21.15.144:0/3500222359 shutdown_connections 2024-09-12T12:24:01.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 --2- 172.21.15.144:0/3500222359 >> v2:172.21.15.165:3300/0 conn(0x7f679c071960 0x7f679c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 --2- 172.21.15.144:0/3500222359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0b3ad0 0x7f679c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 --2- 172.21.15.144:0/3500222359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15b4e0 0x7f679c0b3590 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 -- 172.21.15.144:0/3500222359 >> 172.21.15.144:0/3500222359 conn(0x7f679c06d0d0 msgr2=0x7f679c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:01.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 -- 172.21.15.144:0/3500222359 shutdown_connections 2024-09-12T12:24:01.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 -- 172.21.15.144:0/3500222359 wait complete. 2024-09-12T12:24:01.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 Processor -- start 2024-09-12T12:24:01.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 -- start start 2024-09-12T12:24:01.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c071960 0x7f679c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c0b3ad0 0x7f679c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c15b4e0 0x7f679c162b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f679c15f270 con 0x7f679c0b3ad0 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f679c15f0f0 con 0x7f679c15b4e0 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a4800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f679c15f3f0 con 0x7f679c071960 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c0b3ad0 0x7f679c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c0b3ad0 0x7f679c1554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34976/0 (socket says 172.21.15.144:34976) 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c071960 0x7f679c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1400640 1 -- 172.21.15.144:0/2752240138 learned_addr learned my addr 172.21.15.144:0/2752240138 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a2800640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c15b4e0 0x7f679c162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1400640 1 -- 172.21.15.144:0/2752240138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c071960 msgr2=0x7f679c154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1400640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c071960 0x7f679c154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1400640 1 -- 172.21.15.144:0/2752240138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c15b4e0 msgr2=0x7f679c162b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1400640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c15b4e0 0x7f679c162b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1400640 1 -- 172.21.15.144:0/2752240138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c1552e0 con 0x7f679c0b3ad0 2024-09-12T12:24:01.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a2800640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c15b4e0 0x7f679c162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:01.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.728+0000 7f67a1400640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c0b3ad0 0x7f679c1554d0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f678c00d7d0 tx=0x7f678c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:01.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f6796000640 1 -- 172.21.15.144:0/2752240138 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c004030 con 0x7f679c0b3ad0 2024-09-12T12:24:01.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f6796000640 1 -- 172.21.15.144:0/2752240138 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678c0041d0 con 0x7f679c0b3ad0 2024-09-12T12:24:01.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f6796000640 1 -- 172.21.15.144:0/2752240138 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c00b6c0 con 0x7f679c0b3ad0 2024-09-12T12:24:01.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c163600 con 0x7f679c0b3ad0 2024-09-12T12:24:01.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c160590 con 0x7f679c0b3ad0 2024-09-12T12:24:01.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679c071420 con 0x7f679c0b3ad0 2024-09-12T12:24:01.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f6796000640 1 -- 172.21.15.144:0/2752240138 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f678c00b860 con 0x7f679c0b3ad0 2024-09-12T12:24:01.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f6796000640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67800678c0 0x7f6780069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:01.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f6796000640 1 -- 172.21.15.144:0/2752240138 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7f678c086160 con 0x7f679c0b3ad0 2024-09-12T12:24:01.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f67a1e00640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67800678c0 0x7f6780069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:01.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.732+0000 7f67a1e00640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67800678c0 0x7f6780069d80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f67900ae000 tx=0x7f67900a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:01.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.736+0000 7f6796000640 1 -- 172.21.15.144:0/2752240138 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f678c056a20 con 0x7f679c0b3ad0 2024-09-12T12:24:01.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.924+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f679c0b3630 con 0x7f679c0b3ad0 2024-09-12T12:24:01.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.924+0000 7f6796000640 1 -- 172.21.15.144:0/2752240138 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+4419 (secure 0 0 0) 0x7f678c056320 con 0x7f679c0b3ad0 2024-09-12T12:24:01.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:01.926 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":127,"btime":"2024-09-12T12:23:58:281097+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:58.281091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":166,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"a","rank":0,"incarnation":124,"state":"up:active","state_seq":18,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9360,"qdb_cluster":[9360]},"id":11}]} 2024-09-12T12:24:01.926 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 127 2024-09-12T12:24:01.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67800678c0 msgr2=0x7f6780069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67800678c0 0x7f6780069d80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f67900ae000 tx=0x7f67900a7000 comp rx=0 tx=0).stop 2024-09-12T12:24:01.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c0b3ad0 msgr2=0x7f679c1554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:01.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c0b3ad0 0x7f679c1554d0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f678c00d7d0 tx=0x7f678c00dc90 comp rx=0 tx=0).stop 2024-09-12T12:24:01.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 shutdown_connections 2024-09-12T12:24:01.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f67800678c0 0x7f6780069d80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c15b4e0 0x7f679c162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c0b3ad0 0x7f679c1554d0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 --2- 172.21.15.144:0/2752240138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c071960 0x7f679c154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:01.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 >> 172.21.15.144:0/2752240138 conn(0x7f679c06d0d0 msgr2=0x7f679c0d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:01.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 shutdown_connections 2024-09-12T12:24:01.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:01.928+0000 7f67a4800640 1 -- 172.21.15.144:0/2752240138 wait complete. 2024-09-12T12:24:01.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:02.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.080+0000 7fe210400640 1 Processor -- start 2024-09-12T12:24:02.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.080+0000 7fe210400640 1 -- start start 2024-09-12T12:24:02.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe210400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 0x7fe2080ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe210400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2080cd870 con 0x7fe2080b5fb0 2024-09-12T12:24:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe210400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2080cdb50 con 0x7fe20815cd30 2024-09-12T12:24:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe210400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe208072a50 con 0x7fe20815c7b0 2024-09-12T12:24:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe20e400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe2080b5fb0 0x7fe208072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55884/0 (socket says 172.21.15.144:55884) 2024-09-12T12:24:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe20e400640 1 -- 172.21.15.144:0/1627779982 learned_addr learned my addr 172.21.15.144:0/1627779982 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:02.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe20da00640 1 --2- 172.21.15.144:0/1627779982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 0x7fe2080ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe207e00640 1 -- 172.21.15.144:0/1627779982 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028657055 0 0) 0x7fe2080cd870 con 0x7fe2080b5fb0 2024-09-12T12:24:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe207e00640 1 -- 172.21.15.144:0/1627779982 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f0003530 con 0x7fe2080b5fb0 2024-09-12T12:24:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe207e00640 1 -- 172.21.15.144:0/1627779982 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013188679 0 0) 0x7fe2080cdb50 con 0x7fe20815cd30 2024-09-12T12:24:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe207e00640 1 -- 172.21.15.144:0/1627779982 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2080cd870 con 0x7fe20815cd30 2024-09-12T12:24:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe20da00640 1 -- 172.21.15.144:0/1627779982 >> v1:172.21.15.165:6789/0 conn(0x7fe20815cd30 legacy=0x7fe2080b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe20da00640 1 -- 172.21.15.144:0/1627779982 >> v1:172.21.15.144:6789/0 conn(0x7fe2080b5fb0 legacy=0x7fe208072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.084+0000 7fe20da00640 1 -- 172.21.15.144:0/1627779982 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2080726e0 con 0x7fe20815c7b0 2024-09-12T12:24:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe20da00640 1 --2- 172.21.15.144:0/1627779982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 0x7fe2080ccf00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009dc0 tx=0x7fe1fc01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a110a738146debf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe207e00640 1 -- 172.21.15.144:0/1627779982 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0b2070 con 0x7fe20815c7b0 2024-09-12T12:24:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe207e00640 1 -- 172.21.15.144:0/1627779982 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc0a5850 con 0x7fe20815c7b0 2024-09-12T12:24:02.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe207e00640 1 -- 172.21.15.144:0/1627779982 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0a5c00 con 0x7fe20815c7b0 2024-09-12T12:24:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe210400640 1 -- 172.21.15.144:0/1627779982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 msgr2=0x7fe2080ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe210400640 1 --2- 172.21.15.144:0/1627779982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 0x7fe2080ccf00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc009dc0 tx=0x7fe1fc01c990 comp rx=0 tx=0).stop 2024-09-12T12:24:02.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe210400640 1 -- 172.21.15.144:0/1627779982 shutdown_connections 2024-09-12T12:24:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe210400640 1 --2- 172.21.15.144:0/1627779982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 0x7fe2080ccf00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe210400640 1 -- 172.21.15.144:0/1627779982 >> 172.21.15.144:0/1627779982 conn(0x7fe20806d0d0 msgr2=0x7fe20806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe210400640 1 -- 172.21.15.144:0/1627779982 shutdown_connections 2024-09-12T12:24:02.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe210400640 1 -- 172.21.15.144:0/1627779982 wait complete. 2024-09-12T12:24:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe210400640 1 Processor -- start 2024-09-12T12:24:02.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.088+0000 7fe210400640 1 -- start start 2024-09-12T12:24:02.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe210400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080b5fb0 0x7fe208157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe210400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 0x7fe2081612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe210400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815cd30 0x7fe208157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe210400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe208074210 con 0x7fe20815cd30 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe210400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe208074090 con 0x7fe2080b5fb0 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe210400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe2080cde30 con 0x7fe20815c7b0 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815cd30 0x7fe208157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 0x7fe2081612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815cd30 0x7fe208157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34984/0 (socket says 172.21.15.144:34984) 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20e400640 1 -- 172.21.15.144:0/2637332090 learned_addr learned my addr 172.21.15.144:0/2637332090 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20da00640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080b5fb0 0x7fe208157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20e400640 1 -- 172.21.15.144:0/2637332090 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 msgr2=0x7fe2081612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20e400640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 0x7fe2081612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20e400640 1 -- 172.21.15.144:0/2637332090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080b5fb0 msgr2=0x7fe208157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20e400640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080b5fb0 0x7fe208157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20e400640 1 -- 172.21.15.144:0/2637332090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2081f8120 con 0x7fe20815cd30 2024-09-12T12:24:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe20e400640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815cd30 0x7fe208157ce0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fe20000c420 tx=0x7fe20000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe205600640 1 -- 172.21.15.144:0/2637332090 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200017070 con 0x7fe20815cd30 2024-09-12T12:24:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe205600640 1 -- 172.21.15.144:0/2637332090 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe200005d10 con 0x7fe20815cd30 2024-09-12T12:24:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe205600640 1 -- 172.21.15.144:0/2637332090 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200007310 con 0x7fe20815cd30 2024-09-12T12:24:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2081f8400 con 0x7fe20815cd30 2024-09-12T12:24:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2081576c0 con 0x7fe20815cd30 2024-09-12T12:24:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.092+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2080ccf00 con 0x7fe20815cd30 2024-09-12T12:24:02.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.096+0000 7fe205600640 1 -- 172.21.15.144:0/2637332090 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe20001a070 con 0x7fe20815cd30 2024-09-12T12:24:02.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.096+0000 7fe205600640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e80678c0 0x7fe1e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.096+0000 7fe205600640 1 -- 172.21.15.144:0/2637332090 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7fe200085270 con 0x7fe20815cd30 2024-09-12T12:24:02.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.096+0000 7fe20da00640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e80678c0 0x7fe1e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.096+0000 7fe20da00640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e80678c0 0x7fe1e8069d80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0af000 tx=0x7fe1fc0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.100+0000 7fe205600640 1 -- 172.21.15.144:0/2637332090 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe200055570 con 0x7fe20815cd30 2024-09-12T12:24:02.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.288+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2080aedf0 con 0x7fe20815cd30 2024-09-12T12:24:02.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.292+0000 7fe205600640 1 -- 172.21.15.144:0/2637332090 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+4419 (secure 0 0 0) 0x7fe200059870 con 0x7fe20815cd30 2024-09-12T12:24:02.292 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:02.292 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":127,"btime":"2024-09-12T12:23:58:281097+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:58.281091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":166,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"a","rank":0,"incarnation":124,"state":"up:active","state_seq":18,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9360,"qdb_cluster":[9360]},"id":11}]} 2024-09-12T12:24:02.293 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 127 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e80678c0 msgr2=0x7fe1e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e80678c0 0x7fe1e8069d80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0af000 tx=0x7fe1fc0a7070 comp rx=0 tx=0).stop 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815cd30 msgr2=0x7fe208157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815cd30 0x7fe208157ce0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fe20000c420 tx=0x7fe20000c8e0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 shutdown_connections 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe1e80678c0 0x7fe1e8069d80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815cd30 0x7fe208157ce0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815c7b0 0x7fe2081612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 --2- 172.21.15.144:0/2637332090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080b5fb0 0x7fe208157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 >> 172.21.15.144:0/2637332090 conn(0x7fe20806d0d0 msgr2=0x7fe2080ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:02.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 shutdown_connections 2024-09-12T12:24:02.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.296+0000 7fe210400640 1 -- 172.21.15.144:0/2637332090 wait complete. 2024-09-12T12:24:02.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:24:02.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.448+0000 7f7f5a400640 1 Processor -- start 2024-09-12T12:24:02.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.448+0000 7f7f5a400640 1 -- start start 2024-09-12T12:24:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f5a400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7f5415c7b0 0x7f7f540ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f5a400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f5415cd30 0x7f7f540b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f5a400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f540b61e0 con 0x7f7f540b5de0 2024-09-12T12:24:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f5a400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7f54072a50 con 0x7f7f5415cd30 2024-09-12T12:24:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f5a400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7f540cde30 con 0x7f7f5415c7b0 2024-09-12T12:24:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f53e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7f540b5de0 0x7f7f541601d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55900/0 (socket says 172.21.15.144:55900) 2024-09-12T12:24:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f52a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f5415cd30 0x7f7f540b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f53e00640 1 -- 172.21.15.144:0/3997830139 learned_addr learned my addr 172.21.15.144:0/3997830139 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f53400640 1 --2- 172.21.15.144:0/3997830139 >> v2:172.21.15.165:3300/0 conn(0x7f7f5415c7b0 0x7f7f540ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f52a00640 1 -- 172.21.15.144:0/3997830139 >> v2:172.21.15.165:3300/0 conn(0x7f7f5415c7b0 msgr2=0x7f7f540ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f52a00640 1 --2- 172.21.15.144:0/3997830139 >> v2:172.21.15.165:3300/0 conn(0x7f7f5415c7b0 0x7f7f540ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f52a00640 1 -- 172.21.15.144:0/3997830139 >> v1:172.21.15.144:6789/0 conn(0x7f7f540b5de0 legacy=0x7f7f541601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.452+0000 7f7f52a00640 1 -- 172.21.15.144:0/3997830139 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f540cd870 con 0x7f7f5415cd30 2024-09-12T12:24:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f52a00640 1 --2- 172.21.15.144:0/3997830139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 0x7f7f540b58a0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f7f540d14f0 tx=0x7f7f4001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d6165deb55eab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f52000640 1 -- 172.21.15.144:0/3997830139 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400b0070 con 0x7f7f5415cd30 2024-09-12T12:24:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f52000640 1 -- 172.21.15.144:0/3997830139 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f400ab600 con 0x7f7f5415cd30 2024-09-12T12:24:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f52000640 1 -- 172.21.15.144:0/3997830139 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400ab9d0 con 0x7f7f5415cd30 2024-09-12T12:24:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 -- 172.21.15.144:0/3997830139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 msgr2=0x7f7f540b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 --2- 172.21.15.144:0/3997830139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 0x7f7f540b58a0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f7f540d14f0 tx=0x7f7f4001c480 comp rx=0 tx=0).stop 2024-09-12T12:24:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 -- 172.21.15.144:0/3997830139 shutdown_connections 2024-09-12T12:24:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 --2- 172.21.15.144:0/3997830139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 0x7f7f540b58a0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 --2- 172.21.15.144:0/3997830139 >> v2:172.21.15.165:3300/0 conn(0x7f7f5415c7b0 0x7f7f540ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 -- 172.21.15.144:0/3997830139 >> 172.21.15.144:0/3997830139 conn(0x7f7f5406d0d0 msgr2=0x7f7f5406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 -- 172.21.15.144:0/3997830139 shutdown_connections 2024-09-12T12:24:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 -- 172.21.15.144:0/3997830139 wait complete. 2024-09-12T12:24:02.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 Processor -- start 2024-09-12T12:24:02.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 -- start start 2024-09-12T12:24:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f540b5de0 0x7f7f540b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f5415c7b0 0x7f7f54166b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 0x7f7f54153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54169320 con 0x7f7f5415cd30 2024-09-12T12:24:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7f540cd650 con 0x7f7f5415c7b0 2024-09-12T12:24:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f5a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7f541694a0 con 0x7f7f540b5de0 2024-09-12T12:24:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.456+0000 7f7f53e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 0x7f7f54153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f53e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 0x7f7f54153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35004/0 (socket says 172.21.15.144:35004) 2024-09-12T12:24:02.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f53e00640 1 -- 172.21.15.144:0/414132798 learned_addr learned my addr 172.21.15.144:0/414132798 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:02.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f53400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f540b5de0 0x7f7f540b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f52a00640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f5415c7b0 0x7f7f54166b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f53e00640 1 -- 172.21.15.144:0/414132798 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f540b5de0 msgr2=0x7f7f540b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f53e00640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f540b5de0 0x7f7f540b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f53e00640 1 -- 172.21.15.144:0/414132798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f5415c7b0 msgr2=0x7f7f54166b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f53e00640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f5415c7b0 0x7f7f54166b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f53e00640 1 -- 172.21.15.144:0/414132798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5415e420 con 0x7f7f5415cd30 2024-09-12T12:24:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f53e00640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 0x7f7f54153580 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c400 tx=0x7f7f4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f4b400640 1 -- 172.21.15.144:0/414132798 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c017070 con 0x7f7f5415cd30 2024-09-12T12:24:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f4b400640 1 -- 172.21.15.144:0/414132798 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4c005cf0 con 0x7f7f5415cd30 2024-09-12T12:24:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5415d380 con 0x7f7f5415cd30 2024-09-12T12:24:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f4b400640 1 -- 172.21.15.144:0/414132798 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0072d0 con 0x7f7f5415cd30 2024-09-12T12:24:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5415d940 con 0x7f7f5415cd30 2024-09-12T12:24:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f540ccf00 con 0x7f7f5415cd30 2024-09-12T12:24:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f4b400640 1 -- 172.21.15.144:0/414132798 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f4c01a070 con 0x7f7f5415cd30 2024-09-12T12:24:02.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f4b400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f340678c0 0x7f7f34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.460+0000 7f7f4b400640 1 -- 172.21.15.144:0/414132798 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7f7f4c0851d0 con 0x7f7f5415cd30 2024-09-12T12:24:02.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.464+0000 7f7f53400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f340678c0 0x7f7f34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.464+0000 7f7f53400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f340678c0 0x7f7f34069d80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7f541558e0 tx=0x7f7f440098d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.464+0000 7f7f4b400640 1 -- 172.21.15.144:0/414132798 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7f4c055440 con 0x7f7f5415cd30 2024-09-12T12:24:02.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.624+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f54155350 con 0x7f7f5415cd30 2024-09-12T12:24:02.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.624+0000 7f7f4b400640 1 -- 172.21.15.144:0/414132798 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+17099 (secure 0 0 0) 0x7f7f4c059740 con 0x7f7f5415cd30 2024-09-12T12:24:02.625 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:02.625 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":166,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:23:55.265137+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:00.925396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:02.213050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/2909096469":"2024-09-13T12:23:55.265062+0000","172.21.15.144:6835/2909096469":"2024-09-13T12:23:55.265062+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:02.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f340678c0 msgr2=0x7f7f34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f340678c0 0x7f7f34069d80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7f541558e0 tx=0x7f7f440098d0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 msgr2=0x7f7f54153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 0x7f7f54153580 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c400 tx=0x7f7f4c00c8c0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 shutdown_connections 2024-09-12T12:24:02.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f340678c0 0x7f7f34069d80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f5415cd30 0x7f7f54153580 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f5415c7b0 0x7f7f54166b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 --2- 172.21.15.144:0/414132798 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f540b5de0 0x7f7f540b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 >> 172.21.15.144:0/414132798 conn(0x7f7f5406d0d0 msgr2=0x7f7f540b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:02.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 shutdown_connections 2024-09-12T12:24:02.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.628+0000 7f7f5a400640 1 -- 172.21.15.144:0/414132798 wait complete. 2024-09-12T12:24:02.646 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:24:02.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:02.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.780+0000 7fe4dec00640 1 Processor -- start 2024-09-12T12:24:02.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.780+0000 7fe4dec00640 1 -- start start 2024-09-12T12:24:02.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4dec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4d815b4e0 0x7fe4d80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4dec00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe4d80b3ad0 0x7fe4d8071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4dec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d8071960 0x7fe4d80ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4dec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d80b45a0 con 0x7fe4d815b4e0 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4dec00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d80b3fe0 con 0x7fe4d80b3ad0 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4dec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d80b42c0 con 0x7fe4d8071960 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4d815b4e0 0x7fe4d80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4d815b4e0 0x7fe4d80b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35012/0 (socket says 172.21.15.144:35012) 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7e00640 1 -- 172.21.15.144:0/982612533 learned_addr learned my addr 172.21.15.144:0/982612533 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7400640 1 --2- 172.21.15.144:0/982612533 >> v2:172.21.15.165:3300/0 conn(0x7fe4d80b3ad0 0x7fe4d8071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4dcc00640 1 --2- 172.21.15.144:0/982612533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d8071960 0x7fe4d80ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7e00640 1 -- 172.21.15.144:0/982612533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d8071960 msgr2=0x7fe4d80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:02.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7e00640 1 --2- 172.21.15.144:0/982612533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d8071960 0x7fe4d80ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7e00640 1 -- 172.21.15.144:0/982612533 >> v2:172.21.15.165:3300/0 conn(0x7fe4d80b3ad0 msgr2=0x7fe4d8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:02.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7e00640 1 --2- 172.21.15.144:0/982612533 >> v2:172.21.15.165:3300/0 conn(0x7fe4d80b3ad0 0x7fe4d8071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7e00640 1 -- 172.21.15.144:0/982612533 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d80b1490 con 0x7fe4d815b4e0 2024-09-12T12:24:02.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.784+0000 7fe4d7400640 1 --2- 172.21.15.144:0/982612533 >> v2:172.21.15.165:3300/0 conn(0x7fe4d80b3ad0 0x7fe4d8071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:02.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4d7e00640 1 --2- 172.21.15.144:0/982612533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d815b4e0 0x7fe4d80b3590 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80b02b0 tx=0x7fe4c801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64538001bacf827 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4d6a00640 1 -- 172.21.15.144:0/982612533 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80b4070 con 0x7fe4d815b4e0 2024-09-12T12:24:02.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4d6a00640 1 -- 172.21.15.144:0/982612533 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c80a7b60 con 0x7fe4d815b4e0 2024-09-12T12:24:02.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4d6a00640 1 -- 172.21.15.144:0/982612533 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80af440 con 0x7fe4d815b4e0 2024-09-12T12:24:02.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 -- 172.21.15.144:0/982612533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d815b4e0 msgr2=0x7fe4d80b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 --2- 172.21.15.144:0/982612533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d815b4e0 0x7fe4d80b3590 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80b02b0 tx=0x7fe4c801ebc0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 -- 172.21.15.144:0/982612533 shutdown_connections 2024-09-12T12:24:02.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 --2- 172.21.15.144:0/982612533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d8071960 0x7fe4d80ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 --2- 172.21.15.144:0/982612533 >> v2:172.21.15.165:3300/0 conn(0x7fe4d80b3ad0 0x7fe4d8071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 --2- 172.21.15.144:0/982612533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d815b4e0 0x7fe4d80b3590 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 -- 172.21.15.144:0/982612533 >> 172.21.15.144:0/982612533 conn(0x7fe4d806d0d0 msgr2=0x7fe4d806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:02.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 -- 172.21.15.144:0/982612533 shutdown_connections 2024-09-12T12:24:02.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 -- 172.21.15.144:0/982612533 wait complete. 2024-09-12T12:24:02.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 Processor -- start 2024-09-12T12:24:02.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.788+0000 7fe4dec00640 1 -- start start 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d8071960 0x7fe4d81f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d80b3ad0 0x7fe4d80730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4d815b4e0 0x7fe4d8164240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d815f270 con 0x7fe4d8071960 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d815f0f0 con 0x7fe4d815b4e0 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d815f3f0 con 0x7fe4d80b3ad0 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d8071960 0x7fe4d81f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d8071960 0x7fe4d81f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35014/0 (socket says 172.21.15.144:35014) 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7e00640 1 -- 172.21.15.144:0/3940068560 learned_addr learned my addr 172.21.15.144:0/3940068560 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7400640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d80b3ad0 0x7fe4d80730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dcc00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4d815b4e0 0x7fe4d8164240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7e00640 1 -- 172.21.15.144:0/3940068560 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d80b3ad0 msgr2=0x7fe4d80730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7e00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d80b3ad0 0x7fe4d80730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7e00640 1 -- 172.21.15.144:0/3940068560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4d815b4e0 msgr2=0x7fe4d8164240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7e00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4d815b4e0 0x7fe4d8164240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7e00640 1 -- 172.21.15.144:0/3940068560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d81f7350 con 0x7fe4d8071960 2024-09-12T12:24:02.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4d7e00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d8071960 0x7fe4d81f6e10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800b2c0 tx=0x7fe4c801b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4cfe00640 1 -- 172.21.15.144:0/3940068560 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80be020 con 0x7fe4d8071960 2024-09-12T12:24:02.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4cfe00640 1 -- 172.21.15.144:0/3940068560 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c80afc20 con 0x7fe4d8071960 2024-09-12T12:24:02.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d81f75f0 con 0x7fe4d8071960 2024-09-12T12:24:02.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4cfe00640 1 -- 172.21.15.144:0/3940068560 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80b4040 con 0x7fe4d8071960 2024-09-12T12:24:02.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d81f7bb0 con 0x7fe4d8071960 2024-09-12T12:24:02.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d8071420 con 0x7fe4d8071960 2024-09-12T12:24:02.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.792+0000 7fe4cfe00640 1 -- 172.21.15.144:0/3940068560 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4c80c1020 con 0x7fe4d8071960 2024-09-12T12:24:02.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.796+0000 7fe4cfe00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4b80678c0 0x7fe4b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:02.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.796+0000 7fe4cfe00640 1 -- 172.21.15.144:0/3940068560 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7fe4c8122ff0 con 0x7fe4d8071960 2024-09-12T12:24:02.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.796+0000 7fe4d7400640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4b80678c0 0x7fe4b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:02.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.796+0000 7fe4d7400640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4b80678c0 0x7fe4b8069d80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8152a30 tx=0x7fe4c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:02.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.800+0000 7fe4cfe00640 1 -- 172.21.15.144:0/3940068560 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe4c80c8030 con 0x7fe4d8071960 2024-09-12T12:24:02.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.988+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4d80d0cf0 con 0x7fe4d8071960 2024-09-12T12:24:02.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.988+0000 7fe4cfe00640 1 -- 172.21.15.144:0/3940068560 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+4419 (secure 0 0 0) 0x7fe4c80187e0 con 0x7fe4d8071960 2024-09-12T12:24:02.989 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:02.989 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":127,"btime":"2024-09-12T12:23:58:281097+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:58.281091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":166,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"a","rank":0,"incarnation":124,"state":"up:active","state_seq":18,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9360,"qdb_cluster":[9360]},"id":11}]} 2024-09-12T12:24:02.989 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 127 2024-09-12T12:24:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4b80678c0 msgr2=0x7fe4b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4b80678c0 0x7fe4b8069d80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8152a30 tx=0x7fe4c4008040 comp rx=0 tx=0).stop 2024-09-12T12:24:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d8071960 msgr2=0x7fe4d81f6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d8071960 0x7fe4d81f6e10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800b2c0 tx=0x7fe4c801b960 comp rx=0 tx=0).stop 2024-09-12T12:24:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 shutdown_connections 2024-09-12T12:24:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4b80678c0 0x7fe4b8069d80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4d815b4e0 0x7fe4d8164240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4d80b3ad0 0x7fe4d80730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 --2- 172.21.15.144:0/3940068560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4d8071960 0x7fe4d81f6e10 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:02.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 >> 172.21.15.144:0/3940068560 conn(0x7fe4d806d0d0 msgr2=0x7fe4d8165710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:02.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 shutdown_connections 2024-09-12T12:24:02.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:02.992+0000 7fe4dec00640 1 -- 172.21.15.144:0/3940068560 wait complete. 2024-09-12T12:24:03.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff313a00640 1 Processor -- start 2024-09-12T12:24:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff313a00640 1 -- start start 2024-09-12T12:24:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff313a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff30c0b3c10 0x7ff30c0ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff313a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff30c15c6d0 0x7ff30c0cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff313a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c15cbb0 con 0x7ff30c15c2f0 2024-09-12T12:24:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff313a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c0cf1b0 con 0x7ff30c0b3c10 2024-09-12T12:24:03.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff313a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c15ce90 con 0x7ff30c15c6d0 2024-09-12T12:24:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff30be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff30c0b3c10 0x7ff30c0ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff30be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff30c0b3c10 0x7ff30c0ce730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35024/0 (socket says 172.21.15.144:35024) 2024-09-12T12:24:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff30be00640 1 -- 172.21.15.144:0/3221708323 learned_addr learned my addr 172.21.15.144:0/3221708323 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff30be00640 1 -- 172.21.15.144:0/3221708323 >> v2:172.21.15.165:3300/0 conn(0x7ff30c15c6d0 msgr2=0x7ff30c0cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff311a00640 1 --2- 172.21.15.144:0/3221708323 >> v2:172.21.15.165:3300/0 conn(0x7ff30c15c6d0 0x7ff30c0cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff30be00640 1 --2- 172.21.15.144:0/3221708323 >> v2:172.21.15.165:3300/0 conn(0x7ff30c15c6d0 0x7ff30c0cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff30be00640 1 -- 172.21.15.144:0/3221708323 >> v1:172.21.15.165:6789/0 conn(0x7ff30c15c2f0 legacy=0x7ff30c0b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff30be00640 1 -- 172.21.15.144:0/3221708323 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c15d170 con 0x7ff30c0b3c10 2024-09-12T12:24:03.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.148+0000 7ff311a00640 1 --2- 172.21.15.144:0/3221708323 >> v2:172.21.15.165:3300/0 conn(0x7ff30c15c6d0 0x7ff30c0cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff30be00640 1 --2- 172.21.15.144:0/3221708323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c0b3c10 0x7ff30c0ce730 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0b12a0 tx=0x7ff2f801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d165f8b7b64a58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff30b400640 1 -- 172.21.15.144:0/3221708323 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80aa660 con 0x7ff30c0b3c10 2024-09-12T12:24:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff30b400640 1 -- 172.21.15.144:0/3221708323 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f80af070 con 0x7ff30c0b3c10 2024-09-12T12:24:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff30b400640 1 -- 172.21.15.144:0/3221708323 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80aaa20 con 0x7ff30c0b3c10 2024-09-12T12:24:03.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff313a00640 1 -- 172.21.15.144:0/3221708323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c0b3c10 msgr2=0x7ff30c0ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff313a00640 1 --2- 172.21.15.144:0/3221708323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c0b3c10 0x7ff30c0ce730 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7ff30c0b12a0 tx=0x7ff2f801c4e0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff313a00640 1 -- 172.21.15.144:0/3221708323 shutdown_connections 2024-09-12T12:24:03.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff313a00640 1 --2- 172.21.15.144:0/3221708323 >> v2:172.21.15.165:3300/0 conn(0x7ff30c15c6d0 0x7ff30c0cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff313a00640 1 --2- 172.21.15.144:0/3221708323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c0b3c10 0x7ff30c0ce730 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff313a00640 1 -- 172.21.15.144:0/3221708323 >> 172.21.15.144:0/3221708323 conn(0x7ff30c06f8b0 msgr2=0x7ff30c06fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:03.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff313a00640 1 -- 172.21.15.144:0/3221708323 shutdown_connections 2024-09-12T12:24:03.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.152+0000 7ff313a00640 1 -- 172.21.15.144:0/3221708323 wait complete. 2024-09-12T12:24:03.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 Processor -- start 2024-09-12T12:24:03.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 -- start start 2024-09-12T12:24:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30c0b3c10 0x7ff30c148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff30c15c2f0 0x7ff30c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c15c6d0 0x7ff30c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0b64b0 con 0x7ff30c15c6d0 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0b6330 con 0x7ff30c0b3c10 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c0b6630 con 0x7ff30c15c2f0 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c15c6d0 0x7ff30c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c15c6d0 0x7ff30c1539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35040/0 (socket says 172.21.15.144:35040) 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311a00640 1 -- 172.21.15.144:0/1005509318 learned_addr learned my addr 172.21.15.144:0/1005509318 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff30be00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff30c15c2f0 0x7ff30c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311000640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30c0b3c10 0x7ff30c148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311a00640 1 -- 172.21.15.144:0/1005509318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff30c15c2f0 msgr2=0x7ff30c1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311a00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff30c15c2f0 0x7ff30c1534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311a00640 1 -- 172.21.15.144:0/1005509318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30c0b3c10 msgr2=0x7ff30c148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311a00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30c0b3c10 0x7ff30c148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311a00640 1 -- 172.21.15.144:0/1005509318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c149130 con 0x7ff30c15c6d0 2024-09-12T12:24:03.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311000640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30c0b3c10 0x7ff30c148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:03.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff311a00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c15c6d0 0x7ff30c1539f0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7ff30400cd80 tx=0x7ff30400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff308c00640 1 -- 172.21.15.144:0/1005509318 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30400f680 con 0x7ff30c15c6d0 2024-09-12T12:24:03.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff308c00640 1 -- 172.21.15.144:0/1005509318 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff30400f840 con 0x7ff30c15c6d0 2024-09-12T12:24:03.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff308c00640 1 -- 172.21.15.144:0/1005509318 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30400fc30 con 0x7ff30c15c6d0 2024-09-12T12:24:03.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c15b030 con 0x7ff30c15c6d0 2024-09-12T12:24:03.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c0ae890 con 0x7ff30c15c6d0 2024-09-12T12:24:03.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.156+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c0b69f0 con 0x7ff30c15c6d0 2024-09-12T12:24:03.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.160+0000 7ff308c00640 1 -- 172.21.15.144:0/1005509318 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3040213f0 con 0x7ff30c15c6d0 2024-09-12T12:24:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.160+0000 7ff308c00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ec0678c0 0x7ff2ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.160+0000 7ff308c00640 1 -- 172.21.15.144:0/1005509318 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7ff304086b90 con 0x7ff30c15c6d0 2024-09-12T12:24:03.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.160+0000 7ff311000640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ec0678c0 0x7ff2ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.160+0000 7ff311000640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ec0678c0 0x7ff2ec069d80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff300003ec0 tx=0x7ff300009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.164+0000 7ff308c00640 1 -- 172.21.15.144:0/1005509318 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff304014030 con 0x7ff30c15c6d0 2024-09-12T12:24:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff30c1553f0 con 0x7ff30c15c6d0 2024-09-12T12:24:03.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff308c00640 1 -- 172.21.15.144:0/1005509318 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+4419 (secure 0 0 0) 0x7ff3040574f0 con 0x7ff30c15c6d0 2024-09-12T12:24:03.356 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:03.356 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":127,"btime":"2024-09-12T12:23:58:281097+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:23:03.208525+0000","modified":"2024-09-12T12:23:58.281091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":166,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9360":{"gid":9360,"name":"a","rank":0,"incarnation":124,"state":"up:active","state_seq":18,"addr":"172.21.15.144:6836/1543388531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1543388531},{"type":"v1","addr":"172.21.15.144:6836","nonce":1543388531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9360,"qdb_cluster":[9360]},"id":11}]} 2024-09-12T12:24:03.356 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 127 2024-09-12T12:24:03.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ec0678c0 msgr2=0x7ff2ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ec0678c0 0x7ff2ec069d80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff300003ec0 tx=0x7ff300009040 comp rx=0 tx=0).stop 2024-09-12T12:24:03.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c15c6d0 msgr2=0x7ff30c1539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c15c6d0 0x7ff30c1539f0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7ff30400cd80 tx=0x7ff30400a650 comp rx=0 tx=0).stop 2024-09-12T12:24:03.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 shutdown_connections 2024-09-12T12:24:03.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff2ec0678c0 0x7ff2ec069d80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff30c15c6d0 0x7ff30c1539f0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff30c15c2f0 0x7ff30c1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 --2- 172.21.15.144:0/1005509318 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff30c0b3c10 0x7ff30c148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 >> 172.21.15.144:0/1005509318 conn(0x7ff30c06f8b0 msgr2=0x7ff30c1558f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 shutdown_connections 2024-09-12T12:24:03.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.356+0000 7ff313a00640 1 -- 172.21.15.144:0/1005509318 wait complete. 2024-09-12T12:24:03.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:24:03.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3b00600640 1 Processor -- start 2024-09-12T12:24:03.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3b00600640 1 -- start start 2024-09-12T12:24:03.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3b00600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af815b4e0 0x7f3af80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3b00600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3af80b3ad0 0x7f3af8071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3b00600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3af8071960 0x7f3af80ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3b00600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3af80b45a0 con 0x7f3af8071960 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3b00600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3af80b3fe0 con 0x7f3af80b3ad0 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3b00600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3af80b42c0 con 0x7f3af815b4e0 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3afe600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3af8071960 0x7f3af80ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3afe600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3af8071960 0x7f3af80ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35046/0 (socket says 172.21.15.144:35046) 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.512+0000 7f3afe600640 1 -- 172.21.15.144:0/3134408706 learned_addr learned my addr 172.21.15.144:0/3134408706 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afe600640 1 -- 172.21.15.144:0/3134408706 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af815b4e0 msgr2=0x7f3af80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afd200640 1 --2- 172.21.15.144:0/3134408706 >> v2:172.21.15.165:3300/0 conn(0x7f3af80b3ad0 0x7f3af8071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afdc00640 1 --2- 172.21.15.144:0/3134408706 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af815b4e0 0x7f3af80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afe600640 1 --2- 172.21.15.144:0/3134408706 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af815b4e0 0x7f3af80b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afe600640 1 -- 172.21.15.144:0/3134408706 >> v2:172.21.15.165:3300/0 conn(0x7f3af80b3ad0 msgr2=0x7f3af8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afe600640 1 --2- 172.21.15.144:0/3134408706 >> v2:172.21.15.165:3300/0 conn(0x7f3af80b3ad0 0x7f3af8071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afe600640 1 -- 172.21.15.144:0/3134408706 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af80b1490 con 0x7f3af8071960 2024-09-12T12:24:03.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afd200640 1 --2- 172.21.15.144:0/3134408706 >> v2:172.21.15.165:3300/0 conn(0x7f3af80b3ad0 0x7f3af8071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:03.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afdc00640 1 --2- 172.21.15.144:0/3134408706 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af815b4e0 0x7f3af80b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:03.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3afe600640 1 --2- 172.21.15.144:0/3134408706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af8071960 0x7f3af80ccf30 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f3af806a020 tx=0x7f3af001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f907f05b0c4ddce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3af7e00640 1 -- 172.21.15.144:0/3134408706 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af00b1070 con 0x7f3af8071960 2024-09-12T12:24:03.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3af7e00640 1 -- 172.21.15.144:0/3134408706 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af00ac620 con 0x7f3af8071960 2024-09-12T12:24:03.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.516+0000 7f3af7e00640 1 -- 172.21.15.144:0/3134408706 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af00ac9f0 con 0x7f3af8071960 2024-09-12T12:24:03.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 -- 172.21.15.144:0/3134408706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af8071960 msgr2=0x7f3af80ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 --2- 172.21.15.144:0/3134408706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af8071960 0x7f3af80ccf30 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f3af806a020 tx=0x7f3af001c4f0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 -- 172.21.15.144:0/3134408706 shutdown_connections 2024-09-12T12:24:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 --2- 172.21.15.144:0/3134408706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af8071960 0x7f3af80ccf30 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 --2- 172.21.15.144:0/3134408706 >> v2:172.21.15.165:3300/0 conn(0x7f3af80b3ad0 0x7f3af8071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 --2- 172.21.15.144:0/3134408706 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af815b4e0 0x7f3af80b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 -- 172.21.15.144:0/3134408706 >> 172.21.15.144:0/3134408706 conn(0x7f3af806d0d0 msgr2=0x7f3af806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 -- 172.21.15.144:0/3134408706 shutdown_connections 2024-09-12T12:24:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 -- 172.21.15.144:0/3134408706 wait complete. 2024-09-12T12:24:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 Processor -- start 2024-09-12T12:24:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 -- start start 2024-09-12T12:24:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af8071960 0x7f3af80af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af80b3ad0 0x7f3af80ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af815b4e0 0x7f3af80ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3af815f270 con 0x7f3af815b4e0 2024-09-12T12:24:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3af815f0f0 con 0x7f3af80b3ad0 2024-09-12T12:24:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3b00600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3af815f3f0 con 0x7f3af8071960 2024-09-12T12:24:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afe600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af815b4e0 0x7f3af80ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afe600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af815b4e0 0x7f3af80ab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35052/0 (socket says 172.21.15.144:35052) 2024-09-12T12:24:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afe600640 1 -- 172.21.15.144:0/42238205 learned_addr learned my addr 172.21.15.144:0/42238205 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afd200640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af80b3ad0 0x7f3af80ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afdc00640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af8071960 0x7f3af80af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afe600640 1 -- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af8071960 msgr2=0x7f3af80af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afe600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af8071960 0x7f3af80af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afe600640 1 -- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af80b3ad0 msgr2=0x7f3af80ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afe600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af80b3ad0 0x7f3af80ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afe600640 1 -- 172.21.15.144:0/42238205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af80abc50 con 0x7f3af815b4e0 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afd200640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af80b3ad0 0x7f3af80ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.520+0000 7f3afdc00640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af8071960 0x7f3af80af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3afe600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af815b4e0 0x7f3af80ab1b0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f3af00af040 tx=0x7f3af0019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3af5600640 1 -- 172.21.15.144:0/42238205 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af00b1040 con 0x7f3af815b4e0 2024-09-12T12:24:03.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3af5600640 1 -- 172.21.15.144:0/42238205 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af00ba070 con 0x7f3af815b4e0 2024-09-12T12:24:03.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3af5600640 1 -- 172.21.15.144:0/42238205 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af00b56a0 con 0x7f3af815b4e0 2024-09-12T12:24:03.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af8159170 con 0x7f3af815b4e0 2024-09-12T12:24:03.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af8159730 con 0x7f3af815b4e0 2024-09-12T12:24:03.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af8071420 con 0x7f3af815b4e0 2024-09-12T12:24:03.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3af5600640 1 -- 172.21.15.144:0/42238205 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3af00b5840 con 0x7f3af815b4e0 2024-09-12T12:24:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3af5600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ad80678c0 0x7f3ad8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3af5600640 1 -- 172.21.15.144:0/42238205 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7f3af011feb0 con 0x7f3af815b4e0 2024-09-12T12:24:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.524+0000 7f3afdc00640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ad80678c0 0x7f3ad8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.528+0000 7f3afdc00640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ad80678c0 0x7f3ad8069d80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3aec007130 tx=0x7f3aec007060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.528+0000 7f3af5600640 1 -- 172.21.15.144:0/42238205 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3af0016110 con 0x7f3af815b4e0 2024-09-12T12:24:03.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3af815fa50 con 0x7f3af815b4e0 2024-09-12T12:24:03.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3af5600640 1 -- 172.21.15.144:0/42238205 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+17099 (secure 0 0 0) 0x7f3af00f0770 con 0x7f3af815b4e0 2024-09-12T12:24:03.692 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:03.692 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":166,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:23:55.265137+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:23:00.925396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-12T12:23:02.213050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/2909096469":"2024-09-13T12:23:55.265062+0000","172.21.15.144:6835/2909096469":"2024-09-13T12:23:55.265062+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ad80678c0 msgr2=0x7f3ad8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ad80678c0 0x7f3ad8069d80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3aec007130 tx=0x7f3aec007060 comp rx=0 tx=0).stop 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af815b4e0 msgr2=0x7f3af80ab1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af815b4e0 0x7f3af80ab1b0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f3af00af040 tx=0x7f3af0019290 comp rx=0 tx=0).stop 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 shutdown_connections 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ad80678c0 0x7f3ad8069d80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3af815b4e0 0x7f3af80ab1b0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3af80b3ad0 0x7f3af80ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 --2- 172.21.15.144:0/42238205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3af8071960 0x7f3af80af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 >> 172.21.15.144:0/42238205 conn(0x7f3af806d0d0 msgr2=0x7f3af8157c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:03.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 shutdown_connections 2024-09-12T12:24:03.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.692+0000 7f3b00600640 1 -- 172.21.15.144:0/42238205 wait complete. 2024-09-12T12:24:03.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:24:03.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e3aa00640 1 Processor -- start 2024-09-12T12:24:03.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e3aa00640 1 -- start start 2024-09-12T12:24:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e3aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e340b44a0 0x7f1e340b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e3aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e3406e300 0x7f1e3406e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e3aa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3406ec60 con 0x7f1e3415e5f0 2024-09-12T12:24:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e3aa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1e340b6f60 con 0x7f1e3406e300 2024-09-12T12:24:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e3aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e340b7240 con 0x7f1e340b44a0 2024-09-12T12:24:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e38a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e3406e300 0x7f1e3406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e38a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1e3406e300 0x7f1e3406e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35056/0 (socket says 172.21.15.144:35056) 2024-09-12T12:24:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e38a00640 1 -- 172.21.15.144:0/3614519515 learned_addr learned my addr 172.21.15.144:0/3614519515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e2be00640 1 --2- 172.21.15.144:0/3614519515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e340b44a0 0x7f1e340b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e38a00640 1 -- 172.21.15.144:0/3614519515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e340b44a0 msgr2=0x7f1e340b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e38a00640 1 --2- 172.21.15.144:0/3614519515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e340b44a0 0x7f1e340b48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e38a00640 1 -- 172.21.15.144:0/3614519515 >> v1:172.21.15.165:6789/0 conn(0x7f1e3415e5f0 legacy=0x7f1e3406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e38a00640 1 -- 172.21.15.144:0/3614519515 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e340b7520 con 0x7f1e3406e300 2024-09-12T12:24:03.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.852+0000 7f1e2be00640 1 --2- 172.21.15.144:0/3614519515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e340b44a0 0x7f1e340b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:03.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e38a00640 1 --2- 172.21.15.144:0/3614519515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3406e300 0x7f1e3406e720 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009e50 tx=0x7f1e2c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340ed0e7a12f921d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e33400640 1 -- 172.21.15.144:0/3614519515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0a5860 con 0x7f1e3406e300 2024-09-12T12:24:03.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e33400640 1 -- 172.21.15.144:0/3614519515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0a5a00 con 0x7f1e3406e300 2024-09-12T12:24:03.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e33400640 1 -- 172.21.15.144:0/3614519515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0a5dd0 con 0x7f1e3406e300 2024-09-12T12:24:03.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e3aa00640 1 -- 172.21.15.144:0/3614519515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3406e300 msgr2=0x7f1e3406e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e3aa00640 1 --2- 172.21.15.144:0/3614519515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3406e300 0x7f1e3406e720 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009e50 tx=0x7f1e2c01c9c0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e3aa00640 1 -- 172.21.15.144:0/3614519515 shutdown_connections 2024-09-12T12:24:03.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e3aa00640 1 --2- 172.21.15.144:0/3614519515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3406e300 0x7f1e3406e720 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e3aa00640 1 --2- 172.21.15.144:0/3614519515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e340b44a0 0x7f1e340b48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e3aa00640 1 -- 172.21.15.144:0/3614519515 >> 172.21.15.144:0/3614519515 conn(0x7f1e3406f400 msgr2=0x7f1e3406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:03.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e3aa00640 1 -- 172.21.15.144:0/3614519515 shutdown_connections 2024-09-12T12:24:03.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e3aa00640 1 -- 172.21.15.144:0/3614519515 wait complete. 2024-09-12T12:24:03.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.856+0000 7f1e3aa00640 1 Processor -- start 2024-09-12T12:24:03.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 -- start start 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e3406e300 0x7f1e3414f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e340b44a0 0x7f1e34160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3415e5f0 0x7f1e34160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3415f8a0 con 0x7f1e3415e5f0 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3415f720 con 0x7f1e340b44a0 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3415fa20 con 0x7f1e3406e300 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e38a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3415e5f0 0x7f1e34160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e2be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e340b44a0 0x7f1e34160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e33e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e3406e300 0x7f1e3414f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e38a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3415e5f0 0x7f1e34160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35070/0 (socket says 172.21.15.144:35070) 2024-09-12T12:24:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e38a00640 1 -- 172.21.15.144:0/1480451501 learned_addr learned my addr 172.21.15.144:0/1480451501 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e38a00640 1 -- 172.21.15.144:0/1480451501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e3406e300 msgr2=0x7f1e3414f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e38a00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e3406e300 0x7f1e3414f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e38a00640 1 -- 172.21.15.144:0/1480451501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e340b44a0 msgr2=0x7f1e34160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e38a00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e340b44a0 0x7f1e34160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:03.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e38a00640 1 -- 172.21.15.144:0/1480451501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3414fc30 con 0x7f1e3415e5f0 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e38a00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3415e5f0 0x7f1e34160ca0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0af040 tx=0x7f1e2c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e30c00640 1 -- 172.21.15.144:0/1480451501 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c009270 con 0x7f1e3415e5f0 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e30c00640 1 -- 172.21.15.144:0/1480451501 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0be070 con 0x7f1e3415e5f0 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e30c00640 1 -- 172.21.15.144:0/1480451501 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0b8b00 con 0x7f1e3415e5f0 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3414b3e0 con 0x7f1e3415e5f0 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e3415fc80 con 0x7f1e3415e5f0 2024-09-12T12:24:03.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.860+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3406e720 con 0x7f1e3415e5f0 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.864+0000 7f1e30c00640 1 -- 172.21.15.144:0/1480451501 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e2c0b8ca0 con 0x7f1e3415e5f0 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.864+0000 7f1e30c00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e100678f0 0x7f1e10069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.864+0000 7f1e30c00640 1 -- 172.21.15.144:0/1480451501 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 6187+0+0 (secure 0 0 0) 0x7f1e2c120d40 con 0x7f1e3415e5f0 2024-09-12T12:24:03.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.864+0000 7f1e33e00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e100678f0 0x7f1e10069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:03.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.864+0000 7f1e33e00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e100678f0 0x7f1e10069db0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1e24007fd0 tx=0x7f1e24007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:03.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:03.868+0000 7f1e30c00640 1 -- 172.21.15.144:0/1480451501 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e2c0165e0 con 0x7f1e3415e5f0 2024-09-12T12:24:04.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.104+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1e3406e0e0 con 0x7f1e3415e5f0 2024-09-12T12:24:04.104 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:24:04.104+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e30c00640 1 -- 172.21.15.144:0/1480451501 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v128) ==== 161+0+0 (secure 0 0 0) 0x7f1e2c0f0fb0 con 0x7f1e3415e5f0 2024-09-12T12:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e100678f0 msgr2=0x7f1e10069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e100678f0 0x7f1e10069db0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1e24007fd0 tx=0x7f1e24007e40 comp rx=0 tx=0).stop 2024-09-12T12:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3415e5f0 msgr2=0x7f1e34160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3415e5f0 0x7f1e34160ca0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0af040 tx=0x7f1e2c019760 comp rx=0 tx=0).stop 2024-09-12T12:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 shutdown_connections 2024-09-12T12:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1e100678f0 0x7f1e10069db0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1e3415e5f0 0x7f1e34160ca0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e340b44a0 0x7f1e34160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 --2- 172.21.15.144:0/1480451501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1e3406e300 0x7f1e3414f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 >> 172.21.15.144:0/1480451501 conn(0x7f1e3406f400 msgr2=0x7f1e3414b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:04.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 shutdown_connections 2024-09-12T12:24:04.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.108+0000 7f1e3aa00640 1 -- 172.21.15.144:0/1480451501 wait complete. 2024-09-12T12:24:04.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:24:04.175 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:24:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f517de00640 1 Processor -- start 2024-09-12T12:24:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f517de00640 1 -- start start 2024-09-12T12:24:04.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f517de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f517815c2e0 0x7f5178072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:04.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f517de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517806c320 0x7f51780cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:04.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f517de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51780733e0 con 0x7f51780af5f0 2024-09-12T12:24:04.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f517de00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f51780cd290 con 0x7f517815c2e0 2024-09-12T12:24:04.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f517de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51780cd570 con 0x7f517806c320 2024-09-12T12:24:04.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5176000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f51780af5f0 0x7f517806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55924/0 (socket says 172.21.15.144:55924) 2024-09-12T12:24:04.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5176000640 1 -- 172.21.15.144:0/2349610008 learned_addr learned my addr 172.21.15.144:0/2349610008 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5176a00640 1 --2- 172.21.15.144:0/2349610008 >> v2:172.21.15.165:3300/0 conn(0x7f517815c2e0 0x7f5178072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5177400640 1 --2- 172.21.15.144:0/2349610008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517806c320 0x7f51780cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5175600640 1 -- 172.21.15.144:0/2349610008 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2139657139 0 0) 0x7f51780733e0 con 0x7f51780af5f0 2024-09-12T12:24:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5175600640 1 -- 172.21.15.144:0/2349610008 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f515c003530 con 0x7f51780af5f0 2024-09-12T12:24:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5176a00640 1 -- 172.21.15.144:0/2349610008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517806c320 msgr2=0x7f51780cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5176a00640 1 --2- 172.21.15.144:0/2349610008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517806c320 0x7f51780cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5176a00640 1 -- 172.21.15.144:0/2349610008 >> v1:172.21.15.144:6789/0 conn(0x7f51780af5f0 legacy=0x7f517806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.272+0000 7f5176a00640 1 -- 172.21.15.144:0/2349610008 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51780cd850 con 0x7f517815c2e0 2024-09-12T12:24:04.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f5176a00640 1 --2- 172.21.15.144:0/2349610008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f517815c2e0 0x7f5178072b50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5168009d90 tx=0x7f516801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ae6fae5b93921 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:04.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f5175600640 1 -- 172.21.15.144:0/2349610008 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51680b2070 con 0x7f517815c2e0 2024-09-12T12:24:04.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f5175600640 1 -- 172.21.15.144:0/2349610008 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51680a5720 con 0x7f517815c2e0 2024-09-12T12:24:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f5175600640 1 -- 172.21.15.144:0/2349610008 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51680a5af0 con 0x7f517815c2e0 2024-09-12T12:24:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f517de00640 1 -- 172.21.15.144:0/2349610008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f517815c2e0 msgr2=0x7f5178072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f517de00640 1 --2- 172.21.15.144:0/2349610008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f517815c2e0 0x7f5178072b50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5168009d90 tx=0x7f516801c850 comp rx=0 tx=0).stop 2024-09-12T12:24:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f517de00640 1 -- 172.21.15.144:0/2349610008 shutdown_connections 2024-09-12T12:24:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f517de00640 1 --2- 172.21.15.144:0/2349610008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517806c320 0x7f51780cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f517de00640 1 --2- 172.21.15.144:0/2349610008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f517815c2e0 0x7f5178072b50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f517de00640 1 -- 172.21.15.144:0/2349610008 >> 172.21.15.144:0/2349610008 conn(0x7f5178068030 msgr2=0x7f51780b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f517de00640 1 -- 172.21.15.144:0/2349610008 shutdown_connections 2024-09-12T12:24:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.276+0000 7f517de00640 1 -- 172.21.15.144:0/2349610008 wait complete. 2024-09-12T12:24:04.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 Processor -- start 2024-09-12T12:24:04.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 -- start start 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517806c320 0x7f517814a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51780af5f0 0x7f51780ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517815c2e0 0x7f51780aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51780cee50 con 0x7f517806c320 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f51780cecd0 con 0x7f51780af5f0 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51780cefd0 con 0x7f517815c2e0 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517806c320 0x7f517814a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517806c320 0x7f517814a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35086/0 (socket says 172.21.15.144:35086) 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176a00640 1 -- 172.21.15.144:0/2276871111 learned_addr learned my addr 172.21.15.144:0/2276871111 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5177400640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517815c2e0 0x7f51780aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176000640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51780af5f0 0x7f51780ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176a00640 1 -- 172.21.15.144:0/2276871111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517815c2e0 msgr2=0x7f51780aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:04.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176a00640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517815c2e0 0x7f51780aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176a00640 1 -- 172.21.15.144:0/2276871111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51780af5f0 msgr2=0x7f51780ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:04.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176a00640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51780af5f0 0x7f51780ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:04.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176a00640 1 -- 172.21.15.144:0/2276871111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51780b4520 con 0x7f517806c320 2024-09-12T12:24:04.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176000640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51780af5f0 0x7f51780ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:04.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f5176a00640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517806c320 0x7f517814a710 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f51680b0040 tx=0x7f51680195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:04.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f516f400640 1 -- 172.21.15.144:0/2276871111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51680bd020 con 0x7f517806c320 2024-09-12T12:24:04.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f516f400640 1 -- 172.21.15.144:0/2276871111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51680b8470 con 0x7f517806c320 2024-09-12T12:24:04.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f516f400640 1 -- 172.21.15.144:0/2276871111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51680b2040 con 0x7f517806c320 2024-09-12T12:24:04.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51780b4800 con 0x7f517806c320 2024-09-12T12:24:04.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.280+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51780b4dc0 con 0x7f517806c320 2024-09-12T12:24:04.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.284+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f517815d050 con 0x7f517806c320 2024-09-12T12:24:04.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.284+0000 7f516f400640 1 -- 172.21.15.144:0/2276871111 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51680c0020 con 0x7f517806c320 2024-09-12T12:24:04.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.284+0000 7f516f400640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51580678c0 0x7f5158069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:04.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.284+0000 7f516f400640 1 -- 172.21.15.144:0/2276871111 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6273+0+0 (secure 0 0 0) 0x7f5168120c80 con 0x7f517806c320 2024-09-12T12:24:04.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.284+0000 7f5176000640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51580678c0 0x7f5158069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:04.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.284+0000 7f5176000640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51580678c0 0x7f5158069d80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f517815ca80 tx=0x7f5164009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:04.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.288+0000 7f516f400640 1 -- 172.21.15.144:0/2276871111 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f517815d050 con 0x7f517806c320 2024-09-12T12:24:04.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:04.484+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f51780cdd70 con 0x7f517806c320 2024-09-12T12:24:05.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.108+0000 7f516f400640 1 -- 172.21.15.144:0/2276871111 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v129) ==== 104+0+0 (secure 0 0 0) 0x7f51680c7030 con 0x7f517806c320 2024-09-12T12:24:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51580678c0 msgr2=0x7f5158069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51580678c0 0x7f5158069d80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f517815ca80 tx=0x7f5164009040 comp rx=0 tx=0).stop 2024-09-12T12:24:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517806c320 msgr2=0x7f517814a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517806c320 0x7f517814a710 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f51680b0040 tx=0x7f51680195f0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 shutdown_connections 2024-09-12T12:24:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f51580678c0 0x7f5158069d80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f517815c2e0 0x7f51780aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51780af5f0 0x7f51780ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 --2- 172.21.15.144:0/2276871111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517806c320 0x7f517814a710 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 >> 172.21.15.144:0/2276871111 conn(0x7f5178068030 msgr2=0x7f51780b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 shutdown_connections 2024-09-12T12:24:05.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.112+0000 7f517de00640 1 -- 172.21.15.144:0/2276871111 wait complete. 2024-09-12T12:24:05.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:24:05.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f6872400640 1 Processor -- start 2024-09-12T12:24:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f6872400640 1 -- start start 2024-09-12T12:24:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f6872400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c1569f0 0x7f686c06dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f6872400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f686c06cc20 0x7f686c06d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f6872400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686c06fce0 con 0x7f686c06f570 2024-09-12T12:24:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f6872400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f686c06d5d0 con 0x7f686c06cc20 2024-09-12T12:24:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f6872400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f686c0702a0 con 0x7f686c1569f0 2024-09-12T12:24:05.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f686c06cc20 0x7f686c06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c1569f0 0x7f686c06dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c1569f0 0x7f686c06dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:36612/0 (socket says 172.21.15.144:36612) 2024-09-12T12:24:05.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f686c06cc20 0x7f686c06d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:41274/0 (socket says 172.21.15.144:41274) 2024-09-12T12:24:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686b400640 1 -- 172.21.15.144:0/3038403036 learned_addr learned my addr 172.21.15.144:0/3038403036 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686be00640 1 -- 172.21.15.144:0/3038403036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c1569f0 msgr2=0x7f686c06dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686be00640 1 --2- 172.21.15.144:0/3038403036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c1569f0 0x7f686c06dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686be00640 1 -- 172.21.15.144:0/3038403036 >> v1:172.21.15.165:6789/0 conn(0x7f686c06f570 legacy=0x7f686c1608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686be00640 1 -- 172.21.15.144:0/3038403036 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c06ffc0 con 0x7f686c06cc20 2024-09-12T12:24:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.324+0000 7f686b400640 1 --2- 172.21.15.144:0/3038403036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c1569f0 0x7f686c06dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f686be00640 1 --2- 172.21.15.144:0/3038403036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 0x7f686c06d090 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6864009d90 tx=0x7f686401d340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0b1f7f74558688b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f686aa00640 1 -- 172.21.15.144:0/3038403036 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68640b2070 con 0x7f686c06cc20 2024-09-12T12:24:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f686aa00640 1 -- 172.21.15.144:0/3038403036 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68640a58b0 con 0x7f686c06cc20 2024-09-12T12:24:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f686aa00640 1 -- 172.21.15.144:0/3038403036 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68640a5c80 con 0x7f686c06cc20 2024-09-12T12:24:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f6872400640 1 -- 172.21.15.144:0/3038403036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 msgr2=0x7f686c06d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f6872400640 1 --2- 172.21.15.144:0/3038403036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 0x7f686c06d090 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6864009d90 tx=0x7f686401d340 comp rx=0 tx=0).stop 2024-09-12T12:24:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f6872400640 1 -- 172.21.15.144:0/3038403036 shutdown_connections 2024-09-12T12:24:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f6872400640 1 --2- 172.21.15.144:0/3038403036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 0x7f686c06d090 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f6872400640 1 --2- 172.21.15.144:0/3038403036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c1569f0 0x7f686c06dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f6872400640 1 -- 172.21.15.144:0/3038403036 >> 172.21.15.144:0/3038403036 conn(0x7f686c0cdb10 msgr2=0x7f686c0cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f6872400640 1 -- 172.21.15.144:0/3038403036 shutdown_connections 2024-09-12T12:24:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.328+0000 7f6872400640 1 -- 172.21.15.144:0/3038403036 wait complete. 2024-09-12T12:24:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 Processor -- start 2024-09-12T12:24:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 -- start start 2024-09-12T12:24:05.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 0x7f686c1506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c06f570 0x7f686c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f686c1569f0 0x7f686c1654a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f686c15d2d0 con 0x7f686c1569f0 2024-09-12T12:24:05.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f686c15d150 con 0x7f686c06cc20 2024-09-12T12:24:05.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f686c15d450 con 0x7f686c06f570 2024-09-12T12:24:05.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f686c1569f0 0x7f686c1654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f686c1569f0 0x7f686c1654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35090/0 (socket says 172.21.15.144:35090) 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686be00640 1 -- 172.21.15.144:0/1081040690 learned_addr learned my addr 172.21.15.144:0/1081040690 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686b400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 0x7f686c1506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6863e00640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c06f570 0x7f686c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686be00640 1 -- 172.21.15.144:0/1081040690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c06f570 msgr2=0x7f686c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686be00640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c06f570 0x7f686c0b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686be00640 1 -- 172.21.15.144:0/1081040690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 msgr2=0x7f686c1506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686be00640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 0x7f686c1506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686be00640 1 -- 172.21.15.144:0/1081040690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c0b3dc0 con 0x7f686c1569f0 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686b400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 0x7f686c1506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f686be00640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f686c1569f0 0x7f686c1654a0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f6864009d90 tx=0x7f6864019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6863400640 1 -- 172.21.15.144:0/1081040690 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68640b2040 con 0x7f686c1569f0 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6863400640 1 -- 172.21.15.144:0/1081040690 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68640a56b0 con 0x7f686c1569f0 2024-09-12T12:24:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6863400640 1 -- 172.21.15.144:0/1081040690 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68640ad640 con 0x7f686c1569f0 2024-09-12T12:24:05.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c0b4060 con 0x7f686c1569f0 2024-09-12T12:24:05.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c0b4620 con 0x7f686c1569f0 2024-09-12T12:24:05.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.332+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686c06d090 con 0x7f686c1569f0 2024-09-12T12:24:05.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.336+0000 7f6863400640 1 -- 172.21.15.144:0/1081040690 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f68640c0020 con 0x7f686c1569f0 2024-09-12T12:24:05.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.336+0000 7f6863400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68480678c0 0x7f6848069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:05.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.336+0000 7f6863400640 1 -- 172.21.15.144:0/1081040690 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 6273+0+0 (secure 0 0 0) 0x7f6864120530 con 0x7f686c1569f0 2024-09-12T12:24:05.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.336+0000 7f686b400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68480678c0 0x7f6848069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:05.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.336+0000 7f686b400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68480678c0 0x7f6848069d80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f685c009630 tx=0x7f685c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:05.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.340+0000 7f6863400640 1 -- 172.21.15.144:0/1081040690 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6864016560 con 0x7f686c1569f0 2024-09-12T12:24:05.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:05.500+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f686c150c20 con 0x7f686c1569f0 2024-09-12T12:24:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.316+0000 7f6863400640 1 -- 172.21.15.144:0/1081040690 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v168) ==== 181+0+0 (secure 0 0 0) 0x7f68640f0e20 con 0x7f686c1569f0 2024-09-12T12:24:06.317 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:24:06.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68480678c0 msgr2=0x7f6848069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:06.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68480678c0 0x7f6848069d80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f685c009630 tx=0x7f685c008040 comp rx=0 tx=0).stop 2024-09-12T12:24:06.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f686c1569f0 msgr2=0x7f686c1654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:06.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f686c1569f0 0x7f686c1654a0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f6864009d90 tx=0x7f6864019680 comp rx=0 tx=0).stop 2024-09-12T12:24:06.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 shutdown_connections 2024-09-12T12:24:06.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f68480678c0 0x7f6848069d80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f686c1569f0 0x7f686c1654a0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f686c06f570 0x7f686c0b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 --2- 172.21.15.144:0/1081040690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f686c06cc20 0x7f686c1506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 >> 172.21.15.144:0/1081040690 conn(0x7f686c0cdb10 msgr2=0x7f686c072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:06.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 shutdown_connections 2024-09-12T12:24:06.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.320+0000 7f6872400640 1 -- 172.21.15.144:0/1081040690 wait complete. 2024-09-12T12:24:06.342 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:24:06.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb799000640 1 Processor -- start 2024-09-12T12:24:06.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb799000640 1 -- start start 2024-09-12T12:24:06.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb799000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb7940b3ea0 0x7fb79406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb799000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7940cd4a0 0x7fb79406d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb799000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb79406cd20 con 0x7fb7940b4280 2024-09-12T12:24:06.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb799000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb79406db20 con 0x7fb7940cd4a0 2024-09-12T12:24:06.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb799000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb7940710a0 con 0x7fb7940b3ea0 2024-09-12T12:24:06.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb792800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7940cd4a0 0x7fb79406d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb792800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7940cd4a0 0x7fb79406d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35094/0 (socket says 172.21.15.144:35094) 2024-09-12T12:24:06.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb792800640 1 -- 172.21.15.144:0/3862938121 learned_addr learned my addr 172.21.15.144:0/3862938121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb792800640 1 -- 172.21.15.144:0/3862938121 >> v2:172.21.15.165:3300/0 conn(0x7fb7940b3ea0 msgr2=0x7fb79406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.488+0000 7fb791e00640 1 --2- 172.21.15.144:0/3862938121 >> v2:172.21.15.165:3300/0 conn(0x7fb7940b3ea0 0x7fb79406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb792800640 1 --2- 172.21.15.144:0/3862938121 >> v2:172.21.15.165:3300/0 conn(0x7fb7940b3ea0 0x7fb79406cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb792800640 1 -- 172.21.15.144:0/3862938121 >> v1:172.21.15.165:6789/0 conn(0x7fb7940b4280 legacy=0x7fb7940ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb792800640 1 -- 172.21.15.144:0/3862938121 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb794071380 con 0x7fb7940cd4a0 2024-09-12T12:24:06.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb791e00640 1 --2- 172.21.15.144:0/3862938121 >> v2:172.21.15.165:3300/0 conn(0x7fb7940b3ea0 0x7fb79406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb792800640 1 --2- 172.21.15.144:0/3862938121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940cd4a0 0x7fb79406d530 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fb7940b60b0 tx=0x7fb78c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4318aee106d4c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb790a00640 1 -- 172.21.15.144:0/3862938121 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c0a5800 con 0x7fb7940cd4a0 2024-09-12T12:24:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb790a00640 1 -- 172.21.15.144:0/3862938121 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78c0a59a0 con 0x7fb7940cd4a0 2024-09-12T12:24:06.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb790a00640 1 -- 172.21.15.144:0/3862938121 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c0a5d70 con 0x7fb7940cd4a0 2024-09-12T12:24:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb799000640 1 -- 172.21.15.144:0/3862938121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940cd4a0 msgr2=0x7fb79406d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb799000640 1 --2- 172.21.15.144:0/3862938121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940cd4a0 0x7fb79406d530 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fb7940b60b0 tx=0x7fb78c01c980 comp rx=0 tx=0).stop 2024-09-12T12:24:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb799000640 1 -- 172.21.15.144:0/3862938121 shutdown_connections 2024-09-12T12:24:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb799000640 1 --2- 172.21.15.144:0/3862938121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940cd4a0 0x7fb79406d530 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb799000640 1 --2- 172.21.15.144:0/3862938121 >> v2:172.21.15.165:3300/0 conn(0x7fb7940b3ea0 0x7fb79406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb799000640 1 -- 172.21.15.144:0/3862938121 >> 172.21.15.144:0/3862938121 conn(0x7fb79406bc10 msgr2=0x7fb79406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb799000640 1 -- 172.21.15.144:0/3862938121 shutdown_connections 2024-09-12T12:24:06.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.492+0000 7fb799000640 1 -- 172.21.15.144:0/3862938121 wait complete. 2024-09-12T12:24:06.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb799000640 1 Processor -- start 2024-09-12T12:24:06.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb799000640 1 -- start start 2024-09-12T12:24:06.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb799000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7940b3ea0 0x7fb794153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb799000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940b4280 0x7fb7941f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb799000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7940cd4a0 0x7fb7940b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb799000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb79415b700 con 0x7fb7940b4280 2024-09-12T12:24:06.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb799000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb79415b580 con 0x7fb7940cd4a0 2024-09-12T12:24:06.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb799000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb79415b880 con 0x7fb7940b3ea0 2024-09-12T12:24:06.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940b4280 0x7fb7941f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940b4280 0x7fb7941f6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35098/0 (socket says 172.21.15.144:35098) 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791400640 1 -- 172.21.15.144:0/2632863726 learned_addr learned my addr 172.21.15.144:0/2632863726 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791e00640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7940b3ea0 0x7fb794153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb792800640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7940cd4a0 0x7fb7940b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791400640 1 -- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7940b3ea0 msgr2=0x7fb794153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791400640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7940b3ea0 0x7fb794153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791400640 1 -- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7940cd4a0 msgr2=0x7fb7940b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791400640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7940cd4a0 0x7fb7940b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791400640 1 -- 172.21.15.144:0/2632863726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7941f71a0 con 0x7fb7940b4280 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb792800640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7940cd4a0 0x7fb7940b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791e00640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7940b3ea0 0x7fb794153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:06.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb791400640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940b4280 0x7fb7941f6c60 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c410 tx=0x7fb78000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:06.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb78a000640 1 -- 172.21.15.144:0/2632863726 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780017070 con 0x7fb7940b4280 2024-09-12T12:24:06.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb78a000640 1 -- 172.21.15.144:0/2632863726 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb780003600 con 0x7fb7940b4280 2024-09-12T12:24:06.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb78a000640 1 -- 172.21.15.144:0/2632863726 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7800039f0 con 0x7fb7940b4280 2024-09-12T12:24:06.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.496+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7941557d0 con 0x7fb7940b4280 2024-09-12T12:24:06.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.500+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7940ca250 con 0x7fb7940b4280 2024-09-12T12:24:06.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.500+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7940ccd90 con 0x7fb7940b4280 2024-09-12T12:24:06.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.500+0000 7fb78a000640 1 -- 172.21.15.144:0/2632863726 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb780003b90 con 0x7fb7940b4280 2024-09-12T12:24:06.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.500+0000 7fb78a000640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7740678c0 0x7fb774069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:06.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.500+0000 7fb78a000640 1 -- 172.21.15.144:0/2632863726 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5835+0+0 (secure 0 0 0) 0x7fb780085200 con 0x7fb7940b4280 2024-09-12T12:24:06.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.500+0000 7fb791e00640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7740678c0 0x7fb774069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:06.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.500+0000 7fb791e00640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7740678c0 0x7fb774069d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb784008930 tx=0x7fb784008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:06.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.504+0000 7fb78a000640 1 -- 172.21.15.144:0/2632863726 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb780055c20 con 0x7fb7940b4280 2024-09-12T12:24:06.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:06.668+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb79414f940 con 0x7fb7940b4280 2024-09-12T12:24:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.320+0000 7fb78a000640 1 -- 172.21.15.144:0/2632863726 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v169) ==== 169+0+0 (secure 0 0 0) 0x7fb780055520 con 0x7fb7940b4280 2024-09-12T12:24:07.319 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:24:07.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7740678c0 msgr2=0x7fb774069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7740678c0 0x7fb774069d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb784008930 tx=0x7fb784008040 comp rx=0 tx=0).stop 2024-09-12T12:24:07.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940b4280 msgr2=0x7fb7941f6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940b4280 0x7fb7941f6c60 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c410 tx=0x7fb78000c8d0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 shutdown_connections 2024-09-12T12:24:07.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7740678c0 0x7fb774069d80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7940cd4a0 0x7fb7940b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7940b4280 0x7fb7941f6c60 secure :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c410 tx=0x7fb78000c8d0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 --2- 172.21.15.144:0/2632863726 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7940b3ea0 0x7fb794153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 >> 172.21.15.144:0/2632863726 conn(0x7fb79406bc10 msgr2=0x7fb794150140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:07.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 shutdown_connections 2024-09-12T12:24:07.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.324+0000 7fb799000640 1 -- 172.21.15.144:0/2632863726 wait complete. 2024-09-12T12:24:07.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:24:07.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.544+0000 7fbb5a000640 1 Processor -- start 2024-09-12T12:24:07.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.544+0000 7fbb5a000640 1 -- start start 2024-09-12T12:24:07.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.544+0000 7fbb5a000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbb54160bf0 0x7fbb540d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.544+0000 7fbb5a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb5415c790 0x7fbb540d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.544+0000 7fbb5a000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5415cd10 con 0x7fbb5415c3b0 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.544+0000 7fbb5a000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5415d640 con 0x7fbb54160bf0 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.544+0000 7fbb5a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5415cff0 con 0x7fbb5415c790 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.544+0000 7fbb53400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbb5415c3b0 0x7fbb54073b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46550/0 (socket says 172.21.15.144:46550) 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.544+0000 7fbb53400640 1 -- 172.21.15.144:0/162975442 learned_addr learned my addr 172.21.15.144:0/162975442 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb52a00640 1 --2- 172.21.15.144:0/162975442 >> v2:172.21.15.165:3300/0 conn(0x7fbb54160bf0 0x7fbb540d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb53e00640 1 --2- 172.21.15.144:0/162975442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb5415c790 0x7fbb540d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb52000640 1 -- 172.21.15.144:0/162975442 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081417890 0 0) 0x7fbb5415cd10 con 0x7fbb5415c3b0 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb52000640 1 -- 172.21.15.144:0/162975442 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb38003530 con 0x7fbb5415c3b0 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb53e00640 1 -- 172.21.15.144:0/162975442 >> v2:172.21.15.165:3300/0 conn(0x7fbb54160bf0 msgr2=0x7fbb540d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:07.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb53e00640 1 --2- 172.21.15.144:0/162975442 >> v2:172.21.15.165:3300/0 conn(0x7fbb54160bf0 0x7fbb540d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb53e00640 1 -- 172.21.15.144:0/162975442 >> v1:172.21.15.144:6789/0 conn(0x7fbb5415c3b0 legacy=0x7fbb54073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb53e00640 1 -- 172.21.15.144:0/162975442 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5415d2d0 con 0x7fbb5415c790 2024-09-12T12:24:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb52a00640 1 --2- 172.21.15.144:0/162975442 >> v2:172.21.15.165:3300/0 conn(0x7fbb54160bf0 0x7fbb540d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb53e00640 1 --2- 172.21.15.144:0/162975442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb5415c790 0x7fbb540d2960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0097c0 tx=0x7fbb4c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=912155c10286ed33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:07.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb52000640 1 -- 172.21.15.144:0/162975442 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0b1070 con 0x7fbb5415c790 2024-09-12T12:24:07.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb52000640 1 -- 172.21.15.144:0/162975442 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0ac410 con 0x7fbb5415c790 2024-09-12T12:24:07.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.548+0000 7fbb52000640 1 -- 172.21.15.144:0/162975442 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0ac7c0 con 0x7fbb5415c790 2024-09-12T12:24:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 -- 172.21.15.144:0/162975442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb5415c790 msgr2=0x7fbb540d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 --2- 172.21.15.144:0/162975442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb5415c790 0x7fbb540d2960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0097c0 tx=0x7fbb4c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 -- 172.21.15.144:0/162975442 shutdown_connections 2024-09-12T12:24:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 --2- 172.21.15.144:0/162975442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb5415c790 0x7fbb540d2960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 --2- 172.21.15.144:0/162975442 >> v2:172.21.15.165:3300/0 conn(0x7fbb54160bf0 0x7fbb540d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 -- 172.21.15.144:0/162975442 >> 172.21.15.144:0/162975442 conn(0x7fbb5406c010 msgr2=0x7fbb54067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 -- 172.21.15.144:0/162975442 shutdown_connections 2024-09-12T12:24:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 -- 172.21.15.144:0/162975442 wait complete. 2024-09-12T12:24:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 Processor -- start 2024-09-12T12:24:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 -- start start 2024-09-12T12:24:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb5415c3b0 0x7fbb54155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb5415c790 0x7fbb54155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb54160bf0 0x7fbb5406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbb540d0ed0 con 0x7fbb5415c790 2024-09-12T12:24:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbb540d0d50 con 0x7fbb5415c3b0 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb5a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbb540d1050 con 0x7fbb54160bf0 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb52a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb5415c790 0x7fbb54155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb52a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb5415c790 0x7fbb54155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36440/0 (socket says 172.21.15.144:36440) 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb52a00640 1 -- 172.21.15.144:0/1827674611 learned_addr learned my addr 172.21.15.144:0/1827674611 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb53400640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb5415c3b0 0x7fbb54155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.552+0000 7fbb53e00640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb54160bf0 0x7fbb5406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb52a00640 1 -- 172.21.15.144:0/1827674611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb54160bf0 msgr2=0x7fbb5406dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb52a00640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb54160bf0 0x7fbb5406dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb52a00640 1 -- 172.21.15.144:0/1827674611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb5415c3b0 msgr2=0x7fbb54155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb52a00640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb5415c3b0 0x7fbb54155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb52a00640 1 -- 172.21.15.144:0/1827674611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb541565b0 con 0x7fbb5415c790 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb53e00640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb54160bf0 0x7fbb5406dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb52a00640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb5415c790 0x7fbb54155650 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000e9b0 tx=0x7fbb4000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb4b400640 1 -- 172.21.15.144:0/1827674611 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40017070 con 0x7fbb5415c790 2024-09-12T12:24:07.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb4b400640 1 -- 172.21.15.144:0/1827674611 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4000c9a0 con 0x7fbb5415c790 2024-09-12T12:24:07.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb4b400640 1 -- 172.21.15.144:0/1827674611 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4000cd90 con 0x7fbb5415c790 2024-09-12T12:24:07.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb54156890 con 0x7fbb5415c790 2024-09-12T12:24:07.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb54155b90 con 0x7fbb5415c790 2024-09-12T12:24:07.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb540d1410 con 0x7fbb5415c790 2024-09-12T12:24:07.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb4b400640 1 -- 172.21.15.144:0/1827674611 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbb4001a070 con 0x7fbb5415c790 2024-09-12T12:24:07.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb4b400640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb340678f0 0x7fbb34069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb4b400640 1 -- 172.21.15.144:0/1827674611 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5421+0+0 (secure 0 0 0) 0x7fbb40085a70 con 0x7fbb5415c790 2024-09-12T12:24:07.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.556+0000 7fbb53400640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb340678f0 0x7fbb34069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.560+0000 7fbb53400640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb340678f0 0x7fbb34069db0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fbb44005c10 tx=0x7fbb44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.560+0000 7fbb4b400640 1 -- 172.21.15.144:0/1827674611 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbb40055fe0 con 0x7fbb5415c790 2024-09-12T12:24:07.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.724+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbb540b6a90 con 0x7fbb5415c790 2024-09-12T12:24:07.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.728+0000 7fbb4b400640 1 -- 172.21.15.144:0/1827674611 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7fbb4005a2e0 con 0x7fbb5415c790 2024-09-12T12:24:07.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb340678f0 msgr2=0x7fbb34069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb340678f0 0x7fbb34069db0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fbb44005c10 tx=0x7fbb44009040 comp rx=0 tx=0).stop 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb5415c790 msgr2=0x7fbb54155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb5415c790 0x7fbb54155650 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000e9b0 tx=0x7fbb4000ee70 comp rx=0 tx=0).stop 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 shutdown_connections 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbb340678f0 0x7fbb34069db0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb54160bf0 0x7fbb5406dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb5415c790 0x7fbb54155650 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 --2- 172.21.15.144:0/1827674611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb5415c3b0 0x7fbb54155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 >> 172.21.15.144:0/1827674611 conn(0x7fbb5406c010 msgr2=0x7fbb54073b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 shutdown_connections 2024-09-12T12:24:07.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.732+0000 7fbb5a000640 1 -- 172.21.15.144:0/1827674611 wait complete. 2024-09-12T12:24:07.751 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-12T12:24:07.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.888+0000 7f787bc00640 1 Processor -- start 2024-09-12T12:24:07.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.888+0000 7f787bc00640 1 -- start start 2024-09-12T12:24:07.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f787bc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f787415c7b0 0x7f78740ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f787bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78740b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f787bc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78740cd870 con 0x7f78740b5de0 2024-09-12T12:24:07.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f787bc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7874072a50 con 0x7f787415c7b0 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f787bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f78740cde30 con 0x7f787415cd30 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7879200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f787415c7b0 0x7f78740ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7873e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78740b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7879c00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f78740b5de0 0x7f78741601d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:39094/0 (socket says 172.21.15.144:39094) 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7879200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f787415c7b0 0x7f78740ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33010/0 (socket says 172.21.15.144:33010) 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7879c00640 1 -- 172.21.15.144:0/3302174542 learned_addr learned my addr 172.21.15.144:0/3302174542 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7873e00640 1 -- 172.21.15.144:0/3302174542 >> v2:172.21.15.165:3300/0 conn(0x7f787415c7b0 msgr2=0x7f78740ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7873e00640 1 --2- 172.21.15.144:0/3302174542 >> v2:172.21.15.165:3300/0 conn(0x7f787415c7b0 0x7f78740ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7873e00640 1 -- 172.21.15.144:0/3302174542 >> v1:172.21.15.165:6789/0 conn(0x7f78740b5de0 legacy=0x7f78741601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7873400640 1 -- 172.21.15.144:0/3302174542 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2533548937 0 0) 0x7f78740cd870 con 0x7f78740b5de0 2024-09-12T12:24:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.892+0000 7f7873e00640 1 -- 172.21.15.144:0/3302174542 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78740cdb50 con 0x7f787415cd30 2024-09-12T12:24:07.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f7873e00640 1 --2- 172.21.15.144:0/3302174542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78740b58a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f78600097c0 tx=0x7f786001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80228c6ab7d96543 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:07.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f7873400640 1 -- 172.21.15.144:0/3302174542 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600b0070 con 0x7f787415cd30 2024-09-12T12:24:07.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f7873400640 1 -- 172.21.15.144:0/3302174542 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78600ab600 con 0x7f787415cd30 2024-09-12T12:24:07.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f7873400640 1 -- 172.21.15.144:0/3302174542 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600ab9d0 con 0x7f787415cd30 2024-09-12T12:24:07.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 -- 172.21.15.144:0/3302174542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 msgr2=0x7f78740b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 --2- 172.21.15.144:0/3302174542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78740b58a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f78600097c0 tx=0x7f786001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 -- 172.21.15.144:0/3302174542 shutdown_connections 2024-09-12T12:24:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 --2- 172.21.15.144:0/3302174542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78740b58a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 --2- 172.21.15.144:0/3302174542 >> v2:172.21.15.165:3300/0 conn(0x7f787415c7b0 0x7f78740ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 -- 172.21.15.144:0/3302174542 >> 172.21.15.144:0/3302174542 conn(0x7f787406d0d0 msgr2=0x7f787406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 -- 172.21.15.144:0/3302174542 shutdown_connections 2024-09-12T12:24:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 -- 172.21.15.144:0/3302174542 wait complete. 2024-09-12T12:24:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 Processor -- start 2024-09-12T12:24:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 -- start start 2024-09-12T12:24:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78740b5de0 0x7f7874146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f787415c7b0 0x7f78740b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78741667d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7874169530 con 0x7f787415c7b0 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78740cd650 con 0x7f78740b5de0 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.896+0000 7f787bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f78741696b0 con 0x7f787415cd30 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7873e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f787415c7b0 0x7f78740b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7879200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78740b5de0 0x7f7874146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7873e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f787415c7b0 0x7f78740b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36454/0 (socket says 172.21.15.144:36454) 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7873e00640 1 -- 172.21.15.144:0/716605745 learned_addr learned my addr 172.21.15.144:0/716605745 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7879c00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78741667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7873e00640 1 -- 172.21.15.144:0/716605745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 msgr2=0x7f78741667d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7873e00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78741667d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7873e00640 1 -- 172.21.15.144:0/716605745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78740b5de0 msgr2=0x7f7874146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7873e00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78740b5de0 0x7f7874146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7873e00640 1 -- 172.21.15.144:0/716605745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78740b1b20 con 0x7f787415c7b0 2024-09-12T12:24:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7879c00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78741667d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7879200640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78740b5de0 0x7f7874146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:07.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7873e00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f787415c7b0 0x7f78740b10d0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f78600097c0 tx=0x7f7860019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:07.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7870c00640 1 -- 172.21.15.144:0/716605745 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600ba020 con 0x7f787415c7b0 2024-09-12T12:24:07.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7870c00640 1 -- 172.21.15.144:0/716605745 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78600b6670 con 0x7f787415c7b0 2024-09-12T12:24:07.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78740b3c40 con 0x7f787415c7b0 2024-09-12T12:24:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7870c00640 1 -- 172.21.15.144:0/716605745 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600abe60 con 0x7f787415c7b0 2024-09-12T12:24:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78741466b0 con 0x7f787415c7b0 2024-09-12T12:24:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78740ccf00 con 0x7f787415c7b0 2024-09-12T12:24:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.900+0000 7f7870c00640 1 -- 172.21.15.144:0/716605745 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78600bd020 con 0x7f787415c7b0 2024-09-12T12:24:07.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.904+0000 7f7870c00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78540678c0 0x7f7854069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:07.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.904+0000 7f7870c00640 1 -- 172.21.15.144:0/716605745 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5421+0+0 (secure 0 0 0) 0x7f786011f920 con 0x7f787415c7b0 2024-09-12T12:24:07.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.904+0000 7f7879200640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78540678c0 0x7f7854069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:07.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.904+0000 7f7879200640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78540678c0 0x7f7854069d80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f786400e740 tx=0x7f786400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:07.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:07.908+0000 7f7870c00640 1 -- 172.21.15.144:0/716605745 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7860016090 con 0x7f787415c7b0 2024-09-12T12:24:08.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.120+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f7874152d30 con 0x7f787415c7b0 2024-09-12T12:24:08.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.332+0000 7f7870c00640 1 -- 172.21.15.144:0/716605745 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v560) ==== 166+0+0 (secure 0 0 0) 0x7f78600effa0 con 0x7f787415c7b0 2024-09-12T12:24:08.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78540678c0 msgr2=0x7f7854069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78540678c0 0x7f7854069d80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f786400e740 tx=0x7f786400b040 comp rx=0 tx=0).stop 2024-09-12T12:24:08.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f787415c7b0 msgr2=0x7f78740b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f787415c7b0 0x7f78740b10d0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f78600097c0 tx=0x7f7860019240 comp rx=0 tx=0).stop 2024-09-12T12:24:08.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 shutdown_connections 2024-09-12T12:24:08.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78540678c0 0x7f7854069d80 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f787415cd30 0x7f78741667d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f787415c7b0 0x7f78740b10d0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 --2- 172.21.15.144:0/716605745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78740b5de0 0x7f7874146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 >> 172.21.15.144:0/716605745 conn(0x7f787406d0d0 msgr2=0x7f787415d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:08.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 shutdown_connections 2024-09-12T12:24:08.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.336+0000 7f787bc00640 1 -- 172.21.15.144:0/716605745 wait complete. 2024-09-12T12:24:08.356 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-12T12:24:08.356 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-12T12:24:08.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:24:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f2410800640 1 Processor -- start 2024-09-12T12:24:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f2410800640 1 -- start start 2024-09-12T12:24:08.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f2410800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f240815b4e0 0x7f24080b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f2410800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24080b3ad0 0x7f2408071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f2410800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2408071960 0x7f24080ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f2410800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f24080b45a0 con 0x7f24080b3ad0 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f2410800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f24080b3fe0 con 0x7f2408071960 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f2410800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f24080b42c0 con 0x7f240815b4e0 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f240d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24080b3ad0 0x7f2408071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f240d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24080b3ad0 0x7f2408071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36468/0 (socket says 172.21.15.144:36468) 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f240d400640 1 -- 172.21.15.144:0/3057571997 learned_addr learned my addr 172.21.15.144:0/3057571997 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f240e800640 1 --2- 172.21.15.144:0/3057571997 >> v2:172.21.15.165:3300/0 conn(0x7f2408071960 0x7f24080ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f240de00640 1 --2- 172.21.15.144:0/3057571997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f240815b4e0 0x7f24080b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f240d400640 1 -- 172.21.15.144:0/3057571997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f240815b4e0 msgr2=0x7f24080b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.492+0000 7f240d400640 1 --2- 172.21.15.144:0/3057571997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f240815b4e0 0x7f24080b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f240d400640 1 -- 172.21.15.144:0/3057571997 >> v2:172.21.15.165:3300/0 conn(0x7f2408071960 msgr2=0x7f24080ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f240d400640 1 --2- 172.21.15.144:0/3057571997 >> v2:172.21.15.165:3300/0 conn(0x7f2408071960 0x7f24080ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f240d400640 1 -- 172.21.15.144:0/3057571997 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24080b1490 con 0x7f24080b3ad0 2024-09-12T12:24:08.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f240d400640 1 --2- 172.21.15.144:0/3057571997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24080b3ad0 0x7f2408071420 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f24080d04b0 tx=0x7f23f801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7727f4b1e771f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:08.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f240ca00640 1 -- 172.21.15.144:0/3057571997 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80b1070 con 0x7f24080b3ad0 2024-09-12T12:24:08.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f240ca00640 1 -- 172.21.15.144:0/3057571997 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f80ac620 con 0x7f24080b3ad0 2024-09-12T12:24:08.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f240ca00640 1 -- 172.21.15.144:0/3057571997 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80ac9f0 con 0x7f24080b3ad0 2024-09-12T12:24:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f2410800640 1 -- 172.21.15.144:0/3057571997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24080b3ad0 msgr2=0x7f2408071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f2410800640 1 --2- 172.21.15.144:0/3057571997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24080b3ad0 0x7f2408071420 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f24080d04b0 tx=0x7f23f801c4f0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f2410800640 1 -- 172.21.15.144:0/3057571997 shutdown_connections 2024-09-12T12:24:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f2410800640 1 --2- 172.21.15.144:0/3057571997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24080b3ad0 0x7f2408071420 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f2410800640 1 --2- 172.21.15.144:0/3057571997 >> v2:172.21.15.165:3300/0 conn(0x7f2408071960 0x7f24080ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f2410800640 1 --2- 172.21.15.144:0/3057571997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f240815b4e0 0x7f24080b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f2410800640 1 -- 172.21.15.144:0/3057571997 >> 172.21.15.144:0/3057571997 conn(0x7f240806d0d0 msgr2=0x7f240806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.496+0000 7f2410800640 1 -- 172.21.15.144:0/3057571997 shutdown_connections 2024-09-12T12:24:08.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2410800640 1 -- 172.21.15.144:0/3057571997 wait complete. 2024-09-12T12:24:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2410800640 1 Processor -- start 2024-09-12T12:24:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2410800640 1 -- start start 2024-09-12T12:24:08.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2410800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2408071960 0x7f24081649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2410800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24080b3ad0 0x7f2408155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2410800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240815b4e0 0x7f240815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2410800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f240815f270 con 0x7f240815b4e0 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2410800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f240815f0f0 con 0x7f24080b3ad0 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2410800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f240815f3f0 con 0x7f2408071960 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240815b4e0 0x7f240815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2408071960 0x7f24081649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2408071960 0x7f24081649d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60550/0 (socket says 172.21.15.144:60550) 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240de00640 1 -- 172.21.15.144:0/2897431456 learned_addr learned my addr 172.21.15.144:0/2897431456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240d400640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24080b3ad0 0x7f2408155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240de00640 1 -- 172.21.15.144:0/2897431456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24080b3ad0 msgr2=0x7f2408155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240de00640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24080b3ad0 0x7f2408155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240de00640 1 -- 172.21.15.144:0/2897431456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240815b4e0 msgr2=0x7f240815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240de00640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240815b4e0 0x7f240815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240de00640 1 -- 172.21.15.144:0/2897431456 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24081650d0 con 0x7f2408071960 2024-09-12T12:24:08.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f240de00640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2408071960 0x7f24081649d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00e870 tx=0x7f23fc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2402000640 1 -- 172.21.15.144:0/2897431456 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc017070 con 0x7f2408071960 2024-09-12T12:24:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.500+0000 7f2402000640 1 -- 172.21.15.144:0/2897431456 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc00c940 con 0x7f2408071960 2024-09-12T12:24:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.504+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2408162910 con 0x7f2408071960 2024-09-12T12:24:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.504+0000 7f2402000640 1 -- 172.21.15.144:0/2897431456 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00cd10 con 0x7f2408071960 2024-09-12T12:24:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.504+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2408162ed0 con 0x7f2408071960 2024-09-12T12:24:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.504+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2408071420 con 0x7f2408071960 2024-09-12T12:24:08.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.504+0000 7f2402000640 1 -- 172.21.15.144:0/2897431456 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23fc01a070 con 0x7f2408071960 2024-09-12T12:24:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.504+0000 7f2402000640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23ec0678c0 0x7f23ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.504+0000 7f2402000640 1 -- 172.21.15.144:0/2897431456 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(169..169 src has 1..169) ==== 5421+0+0 (secure 0 0 0) 0x7f23fc085e10 con 0x7f2408071960 2024-09-12T12:24:08.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.504+0000 7f240d400640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23ec0678c0 0x7f23ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.504+0000 7f240d400640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23ec0678c0 0x7f23ec069d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f23f80ae000 tx=0x7f23f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:08.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.508+0000 7f2402000640 1 -- 172.21.15.144:0/2897431456 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f23fc056400 con 0x7f2408071960 2024-09-12T12:24:08.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.668+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2408165f30 con 0x7f2408071960 2024-09-12T12:24:08.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.668+0000 7f2402000640 1 -- 172.21.15.144:0/2897431456 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) ==== 74+0+13473 (secure 0 0 0) 0x7f23fc05a700 con 0x7f2408071960 2024-09-12T12:24:08.668 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:08.669 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":169,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:24:07.320373+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6836/1543388531":"2024-09-13T12:24:04.108173+0000","172.21.15.144:6837/2909096469":"2024-09-13T12:23:55.265062+0000","172.21.15.144:6834/1543388531":"2024-09-13T12:24:04.108173+0000","172.21.15.144:6835/2909096469":"2024-09-13T12:23:55.265062+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:08.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.668+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23ec0678c0 msgr2=0x7f23ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.668+0000 7f2410800640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23ec0678c0 0x7f23ec069d80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f23f80ae000 tx=0x7f23f8008040 comp rx=0 tx=0).stop 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.668+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2408071960 msgr2=0x7f24081649d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.668+0000 7f2410800640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2408071960 0x7f24081649d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00e870 tx=0x7f23fc00ed30 comp rx=0 tx=0).stop 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.672+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 shutdown_connections 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.672+0000 7f2410800640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f23ec0678c0 0x7f23ec069d80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.672+0000 7f2410800640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f240815b4e0 0x7f240815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.672+0000 7f2410800640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24080b3ad0 0x7f2408155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.672+0000 7f2410800640 1 --2- 172.21.15.144:0/2897431456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2408071960 0x7f24081649d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.672+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 >> 172.21.15.144:0/2897431456 conn(0x7f240806d0d0 msgr2=0x7f24080cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.672+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 shutdown_connections 2024-09-12T12:24:08.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.672+0000 7f2410800640 1 -- 172.21.15.144:0/2897431456 wait complete. 2024-09-12T12:24:08.690 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:24:08.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:24:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd975400640 1 Processor -- start 2024-09-12T12:24:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd975400640 1 -- start start 2024-09-12T12:24:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd975400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd97006d0f0 0x7fd97006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd975400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9700b32f0 0x7fd97015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd975400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd9700b4810 0x7fd9700b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd975400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd97006da10 con 0x7fd97006d0f0 2024-09-12T12:24:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd975400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd97015bf00 con 0x7fd9700b4810 2024-09-12T12:24:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd975400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd9700b38b0 con 0x7fd9700b32f0 2024-09-12T12:24:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd96e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd97006d0f0 0x7fd97006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd96e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd97006d0f0 0x7fd97006d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36474/0 (socket says 172.21.15.144:36474) 2024-09-12T12:24:08.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd96e800640 1 -- 172.21.15.144:0/1054145737 learned_addr learned my addr 172.21.15.144:0/1054145737 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:08.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd96f200640 1 --2- 172.21.15.144:0/1054145737 >> v2:172.21.15.165:3300/0 conn(0x7fd9700b4810 0x7fd9700b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd96de00640 1 --2- 172.21.15.144:0/1054145737 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9700b32f0 0x7fd97015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd96e800640 1 -- 172.21.15.144:0/1054145737 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9700b32f0 msgr2=0x7fd97015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:08.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.828+0000 7fd96e800640 1 --2- 172.21.15.144:0/1054145737 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9700b32f0 0x7fd97015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd96e800640 1 -- 172.21.15.144:0/1054145737 >> v2:172.21.15.165:3300/0 conn(0x7fd9700b4810 msgr2=0x7fd9700b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:08.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd96e800640 1 --2- 172.21.15.144:0/1054145737 >> v2:172.21.15.165:3300/0 conn(0x7fd9700b4810 0x7fd9700b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd96e800640 1 -- 172.21.15.144:0/1054145737 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9700b3b90 con 0x7fd97006d0f0 2024-09-12T12:24:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd96e800640 1 --2- 172.21.15.144:0/1054145737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97006d0f0 0x7fd97006d4d0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fd9700afef0 tx=0x7fd96001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f7311cf596c71d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd96d400640 1 -- 172.21.15.144:0/1054145737 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600b4070 con 0x7fd97006d0f0 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd96d400640 1 -- 172.21.15.144:0/1054145737 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9600a7a00 con 0x7fd97006d0f0 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd96d400640 1 -- 172.21.15.144:0/1054145737 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600a7dd0 con 0x7fd97006d0f0 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd975400640 1 -- 172.21.15.144:0/1054145737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97006d0f0 msgr2=0x7fd97006d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd975400640 1 --2- 172.21.15.144:0/1054145737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97006d0f0 0x7fd97006d4d0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fd9700afef0 tx=0x7fd96001ebf0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd975400640 1 -- 172.21.15.144:0/1054145737 shutdown_connections 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd975400640 1 --2- 172.21.15.144:0/1054145737 >> v2:172.21.15.165:3300/0 conn(0x7fd9700b4810 0x7fd9700b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd975400640 1 --2- 172.21.15.144:0/1054145737 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9700b32f0 0x7fd97015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd975400640 1 --2- 172.21.15.144:0/1054145737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97006d0f0 0x7fd97006d4d0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd975400640 1 -- 172.21.15.144:0/1054145737 >> 172.21.15.144:0/1054145737 conn(0x7fd970068030 msgr2=0x7fd9700b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd975400640 1 -- 172.21.15.144:0/1054145737 shutdown_connections 2024-09-12T12:24:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.832+0000 7fd975400640 1 -- 172.21.15.144:0/1054145737 wait complete. 2024-09-12T12:24:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 Processor -- start 2024-09-12T12:24:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 -- start start 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd97006d0f0 0x7fd970142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9700b32f0 0x7fd97015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd9700b4810 0x7fd97015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9701589e0 con 0x7fd9700b32f0 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd970158860 con 0x7fd9700b4810 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd9700ccdc0 con 0x7fd97006d0f0 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9700b32f0 0x7fd97015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9700b32f0 0x7fd97015ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36486/0 (socket says 172.21.15.144:36486) 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96de00640 1 -- 172.21.15.144:0/2007354365 learned_addr learned my addr 172.21.15.144:0/2007354365 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96e800640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd97006d0f0 0x7fd970142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96f200640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd9700b4810 0x7fd97015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96de00640 1 -- 172.21.15.144:0/2007354365 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd97006d0f0 msgr2=0x7fd970142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96de00640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd97006d0f0 0x7fd970142e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96de00640 1 -- 172.21.15.144:0/2007354365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd9700b4810 msgr2=0x7fd97015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96de00640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd9700b4810 0x7fd97015b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96de00640 1 -- 172.21.15.144:0/2007354365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd970159810 con 0x7fd9700b32f0 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd96de00640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9700b32f0 0x7fd97015ae00 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00d7d0 tx=0x7fd95c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd966a00640 1 -- 172.21.15.144:0/2007354365 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c004030 con 0x7fd9700b32f0 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd966a00640 1 -- 172.21.15.144:0/2007354365 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95c0041d0 con 0x7fd9700b32f0 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd970159af0 con 0x7fd9700b32f0 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd966a00640 1 -- 172.21.15.144:0/2007354365 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0096a0 con 0x7fd9700b32f0 2024-09-12T12:24:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.836+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97015a0b0 con 0x7fd9700b32f0 2024-09-12T12:24:08.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.840+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd97006d4d0 con 0x7fd9700b32f0 2024-09-12T12:24:08.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.840+0000 7fd966a00640 1 -- 172.21.15.144:0/2007354365 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd95c009840 con 0x7fd9700b32f0 2024-09-12T12:24:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.840+0000 7fd966a00640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd9500678c0 0x7fd950069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.840+0000 7fd966a00640 1 -- 172.21.15.144:0/2007354365 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5421+0+0 (secure 0 0 0) 0x7fd95c085e10 con 0x7fd9700b32f0 2024-09-12T12:24:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.840+0000 7fd96e800640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd9500678c0 0x7fd950069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:08.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.840+0000 7fd96e800640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd9500678c0 0x7fd950069d80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd9600b1000 tx=0x7fd9600a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:08.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:08.844+0000 7fd966a00640 1 -- 172.21.15.144:0/2007354365 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd95c089030 con 0x7fd9700b32f0 2024-09-12T12:24:09.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd970073f00 con 0x7fd9700b32f0 2024-09-12T12:24:09.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd966a00640 1 -- 172.21.15.144:0/2007354365 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v169) ==== 93+0+10 (secure 0 0 0) 0x7fd95c056380 con 0x7fd9700b32f0 2024-09-12T12:24:09.003 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:24:09.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd9500678c0 msgr2=0x7fd950069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd9500678c0 0x7fd950069d80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd9600b1000 tx=0x7fd9600a9070 comp rx=0 tx=0).stop 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9700b32f0 msgr2=0x7fd97015ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9700b32f0 0x7fd97015ae00 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00d7d0 tx=0x7fd95c00dc90 comp rx=0 tx=0).stop 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 shutdown_connections 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd9500678c0 0x7fd950069d80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd9700b4810 0x7fd97015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9700b32f0 0x7fd97015ae00 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 --2- 172.21.15.144:0/2007354365 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd97006d0f0 0x7fd970142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 >> 172.21.15.144:0/2007354365 conn(0x7fd970068030 msgr2=0x7fd97015da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 shutdown_connections 2024-09-12T12:24:09.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.004+0000 7fd975400640 1 -- 172.21.15.144:0/2007354365 wait complete. 2024-09-12T12:24:09.025 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-12T12:24:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.160+0000 7fb823600640 1 Processor -- start 2024-09-12T12:24:09.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.160+0000 7fb823600640 1 -- start start 2024-09-12T12:24:09.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb823600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c15c7b0 0x7fb81c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb823600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb81c0b5fb0 0x7fb81c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb823600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c0cd870 con 0x7fb81c15cd30 2024-09-12T12:24:09.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb823600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb81c072a50 con 0x7fb81c0b5fb0 2024-09-12T12:24:09.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb823600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb81c0cde30 con 0x7fb81c15c7b0 2024-09-12T12:24:09.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb820c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c15c7b0 0x7fb81c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb821600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb81c0b5fb0 0x7fb81c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb820c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c15c7b0 0x7fb81c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60584/0 (socket says 172.21.15.144:60584) 2024-09-12T12:24:09.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb820c00640 1 -- 172.21.15.144:0/2210445513 learned_addr learned my addr 172.21.15.144:0/2210445513 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:09.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb81be00640 1 --1- 172.21.15.144:0/2210445513 >> v1:172.21.15.165:6789/0 conn(0x7fb81c15cd30 0x7fb81c0b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:39108/0 (socket says 172.21.15.144:39108) 2024-09-12T12:24:09.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb820c00640 1 -- 172.21.15.144:0/2210445513 >> v2:172.21.15.165:3300/0 conn(0x7fb81c0b5fb0 msgr2=0x7fb81c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:09.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb820c00640 1 --2- 172.21.15.144:0/2210445513 >> v2:172.21.15.165:3300/0 conn(0x7fb81c0b5fb0 0x7fb81c072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb820c00640 1 -- 172.21.15.144:0/2210445513 >> v1:172.21.15.165:6789/0 conn(0x7fb81c15cd30 legacy=0x7fb81c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.164+0000 7fb820c00640 1 -- 172.21.15.144:0/2210445513 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c0cdb50 con 0x7fb81c15c7b0 2024-09-12T12:24:09.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb820c00640 1 --2- 172.21.15.144:0/2210445513 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c15c7b0 0x7fb81c0ccf00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009e50 tx=0x7fb80c01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be13ba8b0a2c60b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:09.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb81b400640 1 -- 172.21.15.144:0/2210445513 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0a5810 con 0x7fb81c15c7b0 2024-09-12T12:24:09.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb81b400640 1 -- 172.21.15.144:0/2210445513 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c0a59b0 con 0x7fb81c15c7b0 2024-09-12T12:24:09.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb81b400640 1 -- 172.21.15.144:0/2210445513 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0a5d80 con 0x7fb81c15c7b0 2024-09-12T12:24:09.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 -- 172.21.15.144:0/2210445513 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c15c7b0 msgr2=0x7fb81c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 --2- 172.21.15.144:0/2210445513 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c15c7b0 0x7fb81c0ccf00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009e50 tx=0x7fb80c01ca30 comp rx=0 tx=0).stop 2024-09-12T12:24:09.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 -- 172.21.15.144:0/2210445513 shutdown_connections 2024-09-12T12:24:09.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 --2- 172.21.15.144:0/2210445513 >> v2:172.21.15.165:3300/0 conn(0x7fb81c0b5fb0 0x7fb81c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 --2- 172.21.15.144:0/2210445513 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c15c7b0 0x7fb81c0ccf00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 -- 172.21.15.144:0/2210445513 >> 172.21.15.144:0/2210445513 conn(0x7fb81c06d0d0 msgr2=0x7fb81c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:09.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 -- 172.21.15.144:0/2210445513 shutdown_connections 2024-09-12T12:24:09.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 -- 172.21.15.144:0/2210445513 wait complete. 2024-09-12T12:24:09.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 Processor -- start 2024-09-12T12:24:09.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 -- start start 2024-09-12T12:24:09.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0b5fb0 0x7fb81c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15c7b0 0x7fb81c0aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15cd30 0x7fb81c0af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c073fc0 con 0x7fb81c15c7b0 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c073e40 con 0x7fb81c15cd30 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.168+0000 7fb823600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb81c074140 con 0x7fb81c0b5fb0 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb81be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15c7b0 0x7fb81c0aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb81be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15c7b0 0x7fb81c0aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36488/0 (socket says 172.21.15.144:36488) 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb81be00640 1 -- 172.21.15.144:0/3722173213 learned_addr learned my addr 172.21.15.144:0/3722173213 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb821600640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15cd30 0x7fb81c0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb820c00640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0b5fb0 0x7fb81c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb81be00640 1 -- 172.21.15.144:0/3722173213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0b5fb0 msgr2=0x7fb81c1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb81be00640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0b5fb0 0x7fb81c1472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb81be00640 1 -- 172.21.15.144:0/3722173213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15cd30 msgr2=0x7fb81c0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:09.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb81be00640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15cd30 0x7fb81c0af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:09.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb81be00640 1 -- 172.21.15.144:0/3722173213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c0b4300 con 0x7fb81c15c7b0 2024-09-12T12:24:09.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb81be00640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15c7b0 0x7fb81c0aef10 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c370 tx=0x7fb80800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:09.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb818c00640 1 -- 172.21.15.144:0/3722173213 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8080074e0 con 0x7fb81c15c7b0 2024-09-12T12:24:09.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb818c00640 1 -- 172.21.15.144:0/3722173213 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb808007680 con 0x7fb81c15c7b0 2024-09-12T12:24:09.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb818c00640 1 -- 172.21.15.144:0/3722173213 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808004a30 con 0x7fb81c15c7b0 2024-09-12T12:24:09.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c15b930 con 0x7fb81c15c7b0 2024-09-12T12:24:09.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c0b45a0 con 0x7fb81c15c7b0 2024-09-12T12:24:09.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c15be50 con 0x7fb81c15c7b0 2024-09-12T12:24:09.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb818c00640 1 -- 172.21.15.144:0/3722173213 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb80801a020 con 0x7fb81c15c7b0 2024-09-12T12:24:09.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb818c00640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7fc0678c0 0x7fb7fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:09.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.172+0000 7fb818c00640 1 -- 172.21.15.144:0/3722173213 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5421+0+0 (secure 0 0 0) 0x7fb8080851e0 con 0x7fb81c15c7b0 2024-09-12T12:24:09.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.176+0000 7fb820c00640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7fc0678c0 0x7fb7fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:09.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.176+0000 7fb820c00640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7fc0678c0 0x7fb7fc069d80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0ae000 tx=0x7fb80c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:09.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.176+0000 7fb818c00640 1 -- 172.21.15.144:0/3722173213 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb8080557e0 con 0x7fb81c15c7b0 2024-09-12T12:24:09.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:09.396+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7fb81c072ec0 con 0x7fb81c15c7b0 2024-09-12T12:24:10.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.340+0000 7fb818c00640 1 -- 172.21.15.144:0/3722173213 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v562) ==== 162+0+0 (secure 0 0 0) 0x7fb808059ae0 con 0x7fb81c15c7b0 2024-09-12T12:24:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7fc0678c0 msgr2=0x7fb7fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7fc0678c0 0x7fb7fc069d80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0ae000 tx=0x7fb80c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:24:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15c7b0 msgr2=0x7fb81c0aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15c7b0 0x7fb81c0aef10 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c370 tx=0x7fb80800c830 comp rx=0 tx=0).stop 2024-09-12T12:24:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 shutdown_connections 2024-09-12T12:24:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb7fc0678c0 0x7fb7fc069d80 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15cd30 0x7fb81c0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15c7b0 0x7fb81c0aef10 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 --2- 172.21.15.144:0/3722173213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0b5fb0 0x7fb81c1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 >> 172.21.15.144:0/3722173213 conn(0x7fb81c06d0d0 msgr2=0x7fb81c0ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 shutdown_connections 2024-09-12T12:24:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.344+0000 7fb823600640 1 -- 172.21.15.144:0/3722173213 wait complete. 2024-09-12T12:24:10.366 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:24:10.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc68e00640 1 Processor -- start 2024-09-12T12:24:10.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc68e00640 1 -- start start 2024-09-12T12:24:10.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc68e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbc640cd9f0 0x7fbc6406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc68e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc6415b340 0x7fbc6406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc68e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc640b4300 con 0x7fbc6415af60 2024-09-12T12:24:10.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc68e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbc640b32f0 con 0x7fbc6415b340 2024-09-12T12:24:10.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc68e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbc640b3540 con 0x7fbc640cd9f0 2024-09-12T12:24:10.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc62800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc6415b340 0x7fbc6406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc62800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc6415b340 0x7fbc6406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36498/0 (socket says 172.21.15.144:36498) 2024-09-12T12:24:10.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.508+0000 7fbc62800640 1 -- 172.21.15.144:0/3058113014 learned_addr learned my addr 172.21.15.144:0/3058113014 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:10.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc61400640 1 --2- 172.21.15.144:0/3058113014 >> v2:172.21.15.165:3300/0 conn(0x7fbc640cd9f0 0x7fbc6406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc62800640 1 -- 172.21.15.144:0/3058113014 >> v2:172.21.15.165:3300/0 conn(0x7fbc640cd9f0 msgr2=0x7fbc6406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:10.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc62800640 1 --2- 172.21.15.144:0/3058113014 >> v2:172.21.15.165:3300/0 conn(0x7fbc640cd9f0 0x7fbc6406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc62800640 1 -- 172.21.15.144:0/3058113014 >> v1:172.21.15.165:6789/0 conn(0x7fbc6415af60 legacy=0x7fbc640ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc62800640 1 -- 172.21.15.144:0/3058113014 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc640b3820 con 0x7fbc6415b340 2024-09-12T12:24:10.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc62800640 1 --2- 172.21.15.144:0/3058113014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6415b340 0x7fbc6406c150 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fbc64070d20 tx=0x7fbc5c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9a6bf269e0fca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:10.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc60a00640 1 -- 172.21.15.144:0/3058113014 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c0b0070 con 0x7fbc6415b340 2024-09-12T12:24:10.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc60a00640 1 -- 172.21.15.144:0/3058113014 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c0ab600 con 0x7fbc6415b340 2024-09-12T12:24:10.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc60a00640 1 -- 172.21.15.144:0/3058113014 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c0ab9d0 con 0x7fbc6415b340 2024-09-12T12:24:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc68e00640 1 -- 172.21.15.144:0/3058113014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6415b340 msgr2=0x7fbc6406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.512+0000 7fbc68e00640 1 --2- 172.21.15.144:0/3058113014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6415b340 0x7fbc6406c150 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fbc64070d20 tx=0x7fbc5c01c520 comp rx=0 tx=0).stop 2024-09-12T12:24:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 -- 172.21.15.144:0/3058113014 shutdown_connections 2024-09-12T12:24:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 --2- 172.21.15.144:0/3058113014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6415b340 0x7fbc6406c150 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 --2- 172.21.15.144:0/3058113014 >> v2:172.21.15.165:3300/0 conn(0x7fbc640cd9f0 0x7fbc6406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 -- 172.21.15.144:0/3058113014 >> 172.21.15.144:0/3058113014 conn(0x7fbc64068030 msgr2=0x7fbc640b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 -- 172.21.15.144:0/3058113014 shutdown_connections 2024-09-12T12:24:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 -- 172.21.15.144:0/3058113014 wait complete. 2024-09-12T12:24:10.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 Processor -- start 2024-09-12T12:24:10.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 -- start start 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc640cd9f0 0x7fbc64144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6415af60 0x7fbc6415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc6415b340 0x7fbc6415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc640b5180 con 0x7fbc640cd9f0 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc640b5000 con 0x7fbc6415af60 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc640b5300 con 0x7fbc6415b340 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc640cd9f0 0x7fbc64144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc640cd9f0 0x7fbc64144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36514/0 (socket says 172.21.15.144:36514) 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61e00640 1 -- 172.21.15.144:0/493648235 learned_addr learned my addr 172.21.15.144:0/493648235 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61400640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6415af60 0x7fbc6415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc62800640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc6415b340 0x7fbc6415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61e00640 1 -- 172.21.15.144:0/493648235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc6415b340 msgr2=0x7fbc6415bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61e00640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc6415b340 0x7fbc6415bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61e00640 1 -- 172.21.15.144:0/493648235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6415af60 msgr2=0x7fbc6415b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61e00640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6415af60 0x7fbc6415b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61e00640 1 -- 172.21.15.144:0/493648235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc64148fc0 con 0x7fbc640cd9f0 2024-09-12T12:24:10.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc61e00640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc640cd9f0 0x7fbc64144ec0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c790 tx=0x7fbc5400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:10.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc5a000640 1 -- 172.21.15.144:0/493648235 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54016020 con 0x7fbc640cd9f0 2024-09-12T12:24:10.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc5a000640 1 -- 172.21.15.144:0/493648235 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc54006d60 con 0x7fbc640cd9f0 2024-09-12T12:24:10.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6415e440 con 0x7fbc640cd9f0 2024-09-12T12:24:10.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.516+0000 7fbc5a000640 1 -- 172.21.15.144:0/493648235 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54003bc0 con 0x7fbc640cd9f0 2024-09-12T12:24:10.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.520+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6415c5f0 con 0x7fbc640cd9f0 2024-09-12T12:24:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.520+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc640ce680 con 0x7fbc640cd9f0 2024-09-12T12:24:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.520+0000 7fbc5a000640 1 -- 172.21.15.144:0/493648235 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc5400a850 con 0x7fbc640cd9f0 2024-09-12T12:24:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.520+0000 7fbc5a000640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc440678c0 0x7fbc44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.520+0000 7fbc5a000640 1 -- 172.21.15.144:0/493648235 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5421+0+0 (secure 0 0 0) 0x7fbc540857e0 con 0x7fbc640cd9f0 2024-09-12T12:24:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.520+0000 7fbc61400640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc440678c0 0x7fbc44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.520+0000 7fbc61400640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc440678c0 0x7fbc44069d80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbc640aed90 tx=0x7fbc50008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:10.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.524+0000 7fbc5a000640 1 -- 172.21.15.144:0/493648235 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbc54020020 con 0x7fbc640cd9f0 2024-09-12T12:24:10.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.684+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbc64145400 con 0x7fbc640cd9f0 2024-09-12T12:24:10.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.688+0000 7fbc5a000640 1 -- 172.21.15.144:0/493648235 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7fbc54056430 con 0x7fbc640cd9f0 2024-09-12T12:24:10.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.688+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc440678c0 msgr2=0x7fbc44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.688+0000 7fbc68e00640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc440678c0 0x7fbc44069d80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbc640aed90 tx=0x7fbc50008040 comp rx=0 tx=0).stop 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.688+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc640cd9f0 msgr2=0x7fbc64144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.688+0000 7fbc68e00640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc640cd9f0 0x7fbc64144ec0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c790 tx=0x7fbc5400cc50 comp rx=0 tx=0).stop 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.692+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 shutdown_connections 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.692+0000 7fbc68e00640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbc440678c0 0x7fbc44069d80 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.692+0000 7fbc68e00640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc6415b340 0x7fbc6415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.692+0000 7fbc68e00640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc6415af60 0x7fbc6415b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.692+0000 7fbc68e00640 1 --2- 172.21.15.144:0/493648235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc640cd9f0 0x7fbc64144ec0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.692+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 >> 172.21.15.144:0/493648235 conn(0x7fbc64068030 msgr2=0x7fbc640b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.692+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 shutdown_connections 2024-09-12T12:24:10.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:10.692+0000 7fbc68e00640 1 -- 172.21.15.144:0/493648235 wait complete. 2024-09-12T12:24:10.709 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:24:10.709 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:24:10.781 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:24:10.867 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:24:10.867 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:24:10.867 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:10.876 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:24:10.876 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:24:10.876 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:10.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:24:10.885 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:24:10.885 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:10.930 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:24:10.931 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:24:10.931 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:10.941 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:24:10.941 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:24:10.941 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:11.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.112+0000 7f8e97e00640 1 Processor -- start 2024-09-12T12:24:11.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e97e00640 1 -- start start 2024-09-12T12:24:11.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e97e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e9815b160 0x7f8e98070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e97e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e98073bd0 0x7f8e980ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e97e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e980cd4a0 con 0x7f8e980cd000 2024-09-12T12:24:11.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e97e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8e9815b540 con 0x7f8e9815b160 2024-09-12T12:24:11.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e97e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e980cd780 con 0x7f8e98073bd0 2024-09-12T12:24:11.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e96a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e9815b160 0x7f8e98070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e96a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e9815b160 0x7f8e98070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36518/0 (socket says 172.21.15.144:36518) 2024-09-12T12:24:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e96a00640 1 -- 172.21.15.144:0/4072888724 learned_addr learned my addr 172.21.15.144:0/4072888724 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e96000640 1 --2- 172.21.15.144:0/4072888724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e98073bd0 0x7f8e980ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e96a00640 1 -- 172.21.15.144:0/4072888724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e98073bd0 msgr2=0x7f8e980ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e96a00640 1 --2- 172.21.15.144:0/4072888724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e98073bd0 0x7f8e980ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e96a00640 1 -- 172.21.15.144:0/4072888724 >> v1:172.21.15.165:6789/0 conn(0x7f8e980cd000 legacy=0x7f8e980cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:11.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.116+0000 7f8e96a00640 1 -- 172.21.15.144:0/4072888724 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e980b3180 con 0x7f8e9815b160 2024-09-12T12:24:11.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e96a00640 1 --2- 172.21.15.144:0/4072888724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e9815b160 0x7f8e98070ee0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009e50 tx=0x7f8e8801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16eb2627f47fd8b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:11.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e95600640 1 -- 172.21.15.144:0/4072888724 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e880a5770 con 0x7f8e9815b160 2024-09-12T12:24:11.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e95600640 1 -- 172.21.15.144:0/4072888724 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e880a5910 con 0x7f8e9815b160 2024-09-12T12:24:11.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e95600640 1 -- 172.21.15.144:0/4072888724 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e880a5ce0 con 0x7f8e9815b160 2024-09-12T12:24:11.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 -- 172.21.15.144:0/4072888724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e9815b160 msgr2=0x7f8e98070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 --2- 172.21.15.144:0/4072888724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e9815b160 0x7f8e98070ee0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009e50 tx=0x7f8e8801c9a0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 -- 172.21.15.144:0/4072888724 shutdown_connections 2024-09-12T12:24:11.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 --2- 172.21.15.144:0/4072888724 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e98073bd0 0x7f8e980ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 --2- 172.21.15.144:0/4072888724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e9815b160 0x7f8e98070ee0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 -- 172.21.15.144:0/4072888724 >> 172.21.15.144:0/4072888724 conn(0x7f8e9806bc10 msgr2=0x7f8e9806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:11.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 -- 172.21.15.144:0/4072888724 shutdown_connections 2024-09-12T12:24:11.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 -- 172.21.15.144:0/4072888724 wait complete. 2024-09-12T12:24:11.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 Processor -- start 2024-09-12T12:24:11.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.120+0000 7f8e97e00640 1 -- start start 2024-09-12T12:24:11.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e98073bd0 0x7f8e980b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e980cd000 0x7f8e980b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e9815b160 0x7f8e98153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e980b4520 con 0x7f8e980cd000 2024-09-12T12:24:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8e980b43a0 con 0x7f8e98073bd0 2024-09-12T12:24:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e980b46a0 con 0x7f8e9815b160 2024-09-12T12:24:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e980cd000 0x7f8e980b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e980cd000 0x7f8e980b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36532/0 (socket says 172.21.15.144:36532) 2024-09-12T12:24:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96000640 1 -- 172.21.15.144:0/586908370 learned_addr learned my addr 172.21.15.144:0/586908370 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96a00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e98073bd0 0x7f8e980b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97400640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e9815b160 0x7f8e98153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96000640 1 -- 172.21.15.144:0/586908370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e9815b160 msgr2=0x7f8e98153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96000640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e9815b160 0x7f8e98153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96000640 1 -- 172.21.15.144:0/586908370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e98073bd0 msgr2=0x7f8e980b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96000640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e98073bd0 0x7f8e980b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96000640 1 -- 172.21.15.144:0/586908370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e980afef0 con 0x7f8e980cd000 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e96000640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e980cd000 0x7f8e980b28b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400d620 tx=0x7f8e8400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e8ea00640 1 -- 172.21.15.144:0/586908370 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8400b620 con 0x7f8e980cd000 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e8ea00640 1 -- 172.21.15.144:0/586908370 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e84019070 con 0x7f8e980cd000 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e8ea00640 1 -- 172.21.15.144:0/586908370 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8400ba20 con 0x7f8e980cd000 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e980b0190 con 0x7f8e980cd000 2024-09-12T12:24:11.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e98152260 con 0x7f8e980cd000 2024-09-12T12:24:11.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e980ccac0 con 0x7f8e980cd000 2024-09-12T12:24:11.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.124+0000 7f8e8ea00640 1 -- 172.21.15.144:0/586908370 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e8400bbc0 con 0x7f8e980cd000 2024-09-12T12:24:11.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.128+0000 7f8e8ea00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8e780678c0 0x7f8e78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.128+0000 7f8e8ea00640 1 -- 172.21.15.144:0/586908370 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5421+0+0 (secure 0 0 0) 0x7f8e84085ec0 con 0x7f8e980cd000 2024-09-12T12:24:11.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.128+0000 7f8e96a00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8e780678c0 0x7f8e78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.128+0000 7f8e96a00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8e780678c0 0x7f8e78069d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ae000 tx=0x7f8e880a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:11.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.132+0000 7f8e8ea00640 1 -- 172.21.15.144:0/586908370 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e840564c0 con 0x7f8e980cd000 2024-09-12T12:24:11.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.320+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e980b5050 con 0x7f8e980cd000 2024-09-12T12:24:11.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e8ea00640 1 -- 172.21.15.144:0/586908370 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+3099 (secure 0 0 0) 0x7f8e8405a7c0 con 0x7f8e980cd000 2024-09-12T12:24:11.323 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:11.323 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":129,"btime":"2024-09-12T12:24:05:110482+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3397284057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3397284057},{"type":"v1","addr":"172.21.15.165:6834","nonce":3397284057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1719605326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1719605326},{"type":"v1","addr":"172.21.15.165:6835","nonce":1719605326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118},{"gid":9732,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2087822446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2087822446},{"type":"v1","addr":"172.21.15.144:6835","nonce":2087822446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129}],"filesystems":[]} 2024-09-12T12:24:11.323 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 129 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8e780678c0 msgr2=0x7f8e78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8e780678c0 0x7f8e78069d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ae000 tx=0x7f8e880a7070 comp rx=0 tx=0).stop 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e980cd000 msgr2=0x7f8e980b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e980cd000 0x7f8e980b28b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400d620 tx=0x7f8e8400dae0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 shutdown_connections 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8e780678c0 0x7f8e78069d80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e9815b160 0x7f8e98153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e980cd000 0x7f8e980b28b0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 --2- 172.21.15.144:0/586908370 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e98073bd0 0x7f8e980b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 >> 172.21.15.144:0/586908370 conn(0x7f8e9806bc10 msgr2=0x7f8e98071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:11.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 shutdown_connections 2024-09-12T12:24:11.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.324+0000 7f8e97e00640 1 -- 172.21.15.144:0/586908370 wait complete. 2024-09-12T12:24:11.345 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:24:11.345 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:24:11.345 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:24:11.345 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:24:11.346 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:24:11.346 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:24:11.346 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:24:11.346 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:24:11.346 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:24:11.347 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:24:11.347 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:24:11.347 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:24:11.347 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:24:11.347 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:24:11.351 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:24:11.351 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:11.357 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:24:11.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:24:11.360 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:24:11.361 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:24:11.362 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:24:11.362 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:24:11.405 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:24:11.406 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:11.410 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:24:11.410 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:11.412 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:24:11.413 DEBUG:teuthology.parallel:result is None 2024-09-12T12:24:11.413 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:24:11.436 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:24:11.495 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:24:11.504 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:24:11.505 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:24:11.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5ad1e00640 1 Processor -- start 2024-09-12T12:24:11.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5ad1e00640 1 -- start start 2024-09-12T12:24:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5ad1e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5acc15c7b0 0x7f5acc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5ad1e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc0b5fb0 0x7f5acc072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5ad1e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5acc0cd870 con 0x7f5acc15cd30 2024-09-12T12:24:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5ad1e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5acc072a50 con 0x7f5acc15c7b0 2024-09-12T12:24:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5ad1e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5acc0cde30 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5aca000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5acc15cd30 0x7f5acc0b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46580/0 (socket says 172.21.15.144:46580) 2024-09-12T12:24:11.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5aca000640 1 -- 172.21.15.144:0/1905814777 learned_addr learned my addr 172.21.15.144:0/1905814777 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:11.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5acaa00640 1 --2- 172.21.15.144:0/1905814777 >> v2:172.21.15.165:3300/0 conn(0x7f5acc15c7b0 0x7f5acc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5acb400640 1 --2- 172.21.15.144:0/1905814777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc0b5fb0 0x7f5acc072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5ac9600640 1 -- 172.21.15.144:0/1905814777 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080294791 0 0) 0x7f5acc0cd870 con 0x7f5acc15cd30 2024-09-12T12:24:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5ac9600640 1 -- 172.21.15.144:0/1905814777 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ab0003530 con 0x7f5acc15cd30 2024-09-12T12:24:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5acaa00640 1 -- 172.21.15.144:0/1905814777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc0b5fb0 msgr2=0x7f5acc072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5acaa00640 1 --2- 172.21.15.144:0/1905814777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc0b5fb0 0x7f5acc072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5acaa00640 1 -- 172.21.15.144:0/1905814777 >> v1:172.21.15.144:6789/0 conn(0x7f5acc15cd30 legacy=0x7f5acc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.560+0000 7f5acaa00640 1 -- 172.21.15.144:0/1905814777 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc0cdb50 con 0x7f5acc15c7b0 2024-09-12T12:24:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5acaa00640 1 --2- 172.21.15.144:0/1905814777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc15c7b0 0x7f5acc0ccf00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0097c0 tx=0x7f5abc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70d7f9e4a34fe58b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ac9600640 1 -- 172.21.15.144:0/1905814777 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0b1070 con 0x7f5acc15c7b0 2024-09-12T12:24:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ac9600640 1 -- 172.21.15.144:0/1905814777 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5abc0ac410 con 0x7f5acc15c7b0 2024-09-12T12:24:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ac9600640 1 -- 172.21.15.144:0/1905814777 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0ac7e0 con 0x7f5acc15c7b0 2024-09-12T12:24:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ad1e00640 1 -- 172.21.15.144:0/1905814777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc15c7b0 msgr2=0x7f5acc0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ad1e00640 1 --2- 172.21.15.144:0/1905814777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc15c7b0 0x7f5acc0ccf00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0097c0 tx=0x7f5abc01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ad1e00640 1 -- 172.21.15.144:0/1905814777 shutdown_connections 2024-09-12T12:24:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ad1e00640 1 --2- 172.21.15.144:0/1905814777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc0b5fb0 0x7f5acc072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ad1e00640 1 --2- 172.21.15.144:0/1905814777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc15c7b0 0x7f5acc0ccf00 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ad1e00640 1 -- 172.21.15.144:0/1905814777 >> 172.21.15.144:0/1905814777 conn(0x7f5acc06d0d0 msgr2=0x7f5acc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ad1e00640 1 -- 172.21.15.144:0/1905814777 shutdown_connections 2024-09-12T12:24:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.564+0000 7f5ad1e00640 1 -- 172.21.15.144:0/1905814777 wait complete. 2024-09-12T12:24:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 Processor -- start 2024-09-12T12:24:11.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 -- start start 2024-09-12T12:24:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc0b5fb0 0x7f5acc157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc15c7b0 0x7f5acc159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc15cd30 0x7f5acc154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc073fc0 con 0x7f5acc15c7b0 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc073e40 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5acc074140 con 0x7f5acc15cd30 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acaa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc0b5fb0 0x7f5acc157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5aca000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc15c7b0 0x7f5acc159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acaa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc0b5fb0 0x7f5acc157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33118/0 (socket says 172.21.15.144:33118) 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acaa00640 1 -- 172.21.15.144:0/2234812983 learned_addr learned my addr 172.21.15.144:0/2234812983 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acb400640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc15cd30 0x7f5acc154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acaa00640 1 -- 172.21.15.144:0/2234812983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc15cd30 msgr2=0x7f5acc154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acaa00640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc15cd30 0x7f5acc154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acaa00640 1 -- 172.21.15.144:0/2234812983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc15c7b0 msgr2=0x7f5acc159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acaa00640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc15c7b0 0x7f5acc159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acaa00640 1 -- 172.21.15.144:0/2234812983 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc15a950 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5acaa00640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc0b5fb0 0x7f5acc157890 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0097c0 tx=0x7f5abc019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ac3400640 1 -- 172.21.15.144:0/2234812983 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0b1040 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ac3400640 1 -- 172.21.15.144:0/2234812983 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5abc0bb070 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ac3400640 1 -- 172.21.15.144:0/2234812983 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0b5410 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5acc15ac30 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.568+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5acc15b1f0 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.572+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5acc072ee0 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.572+0000 7f5ac3400640 1 -- 172.21.15.144:0/2234812983 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5abc0b55b0 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.572+0000 7f5ac3400640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5aac0678c0 0x7f5aac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.572+0000 7f5ac3400640 1 -- 172.21.15.144:0/2234812983 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5421+0+0 (secure 0 0 0) 0x7f5abc11f4a0 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.572+0000 7f5aca000640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5aac0678c0 0x7f5aac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:11.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.572+0000 7f5aca000640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5aac0678c0 0x7f5aac069d80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5acc155b90 tx=0x7f5ab8000bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:11.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.576+0000 7f5ac3400640 1 -- 172.21.15.144:0/2234812983 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5abc016090 con 0x7f5acc0b5fb0 2024-09-12T12:24:11.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:11.744+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5acc15d340 con 0x7f5acc0b5fb0 2024-09-12T12:24:12.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.356+0000 7f5ac3400640 1 -- 172.21.15.144:0/2234812983 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v171) ==== 97+0+0 (secure 0 0 0) 0x7f5abc0efab0 con 0x7f5acc0b5fb0 2024-09-12T12:24:12.358 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:24:12.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5aac0678c0 msgr2=0x7f5aac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5aac0678c0 0x7f5aac069d80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5acc155b90 tx=0x7f5ab8000bd0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc0b5fb0 msgr2=0x7f5acc157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc0b5fb0 0x7f5acc157890 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0097c0 tx=0x7f5abc019240 comp rx=0 tx=0).stop 2024-09-12T12:24:12.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 shutdown_connections 2024-09-12T12:24:12.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5aac0678c0 0x7f5aac069d80 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc15cd30 0x7f5acc154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc15c7b0 0x7f5acc159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 --2- 172.21.15.144:0/2234812983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc0b5fb0 0x7f5acc157890 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 >> 172.21.15.144:0/2234812983 conn(0x7f5acc06d0d0 msgr2=0x7f5acc0b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:12.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 shutdown_connections 2024-09-12T12:24:12.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.360+0000 7f5ad1e00640 1 -- 172.21.15.144:0/2234812983 wait complete. 2024-09-12T12:24:12.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:24:12.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7073200640 1 Processor -- start 2024-09-12T12:24:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7073200640 1 -- start start 2024-09-12T12:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7073200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707406fb10 0x7f707415e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7073200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707406ed60 con 0x7f70740d18c0 2024-09-12T12:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7073200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707406e7a0 con 0x7f707415e080 2024-09-12T12:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7073200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f707406ea80 con 0x7f707406fb10 2024-09-12T12:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7071400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f70740d18c0 0x7f707406f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46596/0 (socket says 172.21.15.144:46596) 2024-09-12T12:24:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7071400640 1 -- 172.21.15.144:0/1884258848 learned_addr learned my addr 172.21.15.144:0/1884258848 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7072800640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707406fb10 0x7f707415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748647648 0 0) 0x7f707406ed60 con 0x7f70740d18c0 2024-09-12T12:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7058003530 con 0x7f70740d18c0 2024-09-12T12:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067134260 0 0) 0x7f707406e7a0 con 0x7f707415e080 2024-09-12T12:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f707406ed60 con 0x7f707415e080 2024-09-12T12:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3073875873 0 0) 0x7f7058003530 con 0x7f70740d18c0 2024-09-12T12:24:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707406fb10 msgr2=0x7f707415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707406fb10 0x7f707415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 >> v1:172.21.15.165:6789/0 conn(0x7f707415e080 legacy=0x7f7074162810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7074162010 con 0x7f70740d18c0 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f7060001680 con 0x7f70740d18c0 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 >> v1:172.21.15.144:6789/0 conn(0x7f70740d18c0 legacy=0x7f707406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707406fb10 0x7f7058003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7058004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7058004d50 0x7f70580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f707406ea80 con 0x7f70580040e0 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f705800bb60 con 0x7f7058004d50 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f705800bd30 con 0x7f707406fb10 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7071400640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7058004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7071e00640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707406fb10 0x7f7058003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7072800640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7058004d50 0x7f70580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7071400640 1 -- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707406fb10 msgr2=0x7f7058003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7071400640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707406fb10 0x7f7058003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7071400640 1 -- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7058004d50 msgr2=0x7f70580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7071400640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7058004d50 0x7f70580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.560+0000 7f7071400640 1 -- 172.21.15.144:0/1884258848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7058003530 con 0x7f70580040e0 2024-09-12T12:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7071400640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7058004810 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f706000c1c0 tx=0x7f706001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19ff7f2d4221ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060007cd0 con 0x7f70580040e0 2024-09-12T12:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70600a9020 con 0x7f70580040e0 2024-09-12T12:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7070a00640 1 -- 172.21.15.144:0/1884258848 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060005ae0 con 0x7f70580040e0 2024-09-12T12:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7073200640 1 -- 172.21.15.144:0/1884258848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 msgr2=0x7f7058004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7073200640 1 --2- 172.21.15.144:0/1884258848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7058004810 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f706000c1c0 tx=0x7f706001cc00 comp rx=0 tx=0).stop 2024-09-12T12:24:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7072800640 1 -- 172.21.15.144:0/1884258848 reap_dead start 2024-09-12T12:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7073200640 1 -- 172.21.15.144:0/1884258848 shutdown_connections 2024-09-12T12:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7073200640 1 -- 172.21.15.144:0/1884258848 >> 172.21.15.144:0/1884258848 conn(0x7f707406c010 msgr2=0x7f70740b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7073200640 1 -- 172.21.15.144:0/1884258848 shutdown_connections 2024-09-12T12:24:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.564+0000 7f7073200640 1 -- 172.21.15.144:0/1884258848 wait complete. 2024-09-12T12:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 Processor -- start 2024-09-12T12:24:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 -- start start 2024-09-12T12:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7074157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f707413e680 0x7f707414f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707414fb40 0x7f70740cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f707416a090 con 0x7f70580040e0 2024-09-12T12:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f70740b5e10 con 0x7f707413e680 2024-09-12T12:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f707416a210 con 0x7f707414fb40 2024-09-12T12:24:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7071e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7074157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7071e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7074157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36582/0 (socket says 172.21.15.144:36582) 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7071e00640 1 -- 172.21.15.144:0/3500878527 learned_addr learned my addr 172.21.15.144:0/3500878527 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7072800640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707414fb40 0x7f70740cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7071e00640 1 -- 172.21.15.144:0/3500878527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707414fb40 msgr2=0x7f70740cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7071e00640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707414fb40 0x7f70740cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7071e00640 1 -- 172.21.15.144:0/3500878527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f707413e680 msgr2=0x7f707414f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7071e00640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f707413e680 0x7f707414f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7071e00640 1 -- 172.21.15.144:0/3500878527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7074157b50 con 0x7f70580040e0 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7071e00640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7074157300 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f706400f730 tx=0x7f706400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f706a000640 1 -- 172.21.15.144:0/3500878527 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706400fe40 con 0x7f70580040e0 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f706a000640 1 -- 172.21.15.144:0/3500878527 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7064018070 con 0x7f70580040e0 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7074157e30 con 0x7f70580040e0 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f706a000640 1 -- 172.21.15.144:0/3500878527 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706400d730 con 0x7f70580040e0 2024-09-12T12:24:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70741583f0 con 0x7f70580040e0 2024-09-12T12:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.568+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f707406f400 con 0x7f70580040e0 2024-09-12T12:24:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.572+0000 7f706a000640 1 -- 172.21.15.144:0/3500878527 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f706400d8d0 con 0x7f70580040e0 2024-09-12T12:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.572+0000 7f706a000640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70540678c0 0x7f7054069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.572+0000 7f706a000640 1 -- 172.21.15.144:0/3500878527 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5249+0+0 (secure 0 0 0) 0x7f7064085b30 con 0x7f70580040e0 2024-09-12T12:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.572+0000 7f7071400640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70540678c0 0x7f7054069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.572+0000 7f7071400640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70540678c0 0x7f7054069d80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f70600aa000 tx=0x7f70600019d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.576+0000 7f706a000640 1 -- 172.21.15.144:0/3500878527 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f706401a310 con 0x7f70580040e0 2024-09-12T12:24:12.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.800+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7074069450 con 0x7f70580040e0 2024-09-12T12:24:12.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.800+0000 7f706a000640 1 -- 172.21.15.144:0/3500878527 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f7064056790 con 0x7f70580040e0 2024-09-12T12:24:12.800 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:12.800 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.801 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:24:12.802 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.804 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.805 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:24:12.806 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:24:12.808 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.809 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:24:12.809 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:24:12.809 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.809 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.809 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:24:12.809 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:24:12.810 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.811 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:24:12.814 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:24:12.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70540678c0 msgr2=0x7f7054069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70540678c0 0x7f7054069d80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f70600aa000 tx=0x7f70600019d0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 msgr2=0x7f7074157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7074157300 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f706400f730 tx=0x7f706400fbf0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 shutdown_connections 2024-09-12T12:24:12.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70540678c0 0x7f7054069d80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f707414fb40 0x7f70740cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f707413e680 0x7f707414f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 --2- 172.21.15.144:0/3500878527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70580040e0 0x7f7074157300 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 >> 172.21.15.144:0/3500878527 conn(0x7f707406c010 msgr2=0x7f707415cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:12.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 shutdown_connections 2024-09-12T12:24:12.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.804+0000 7f7073200640 1 -- 172.21.15.144:0/3500878527 wait complete. 2024-09-12T12:24:12.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:24:12.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.956+0000 7f7c02800640 1 Processor -- start 2024-09-12T12:24:12.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.956+0000 7f7c02800640 1 -- start start 2024-09-12T12:24:12.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7c02800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc15aa90 0x7f7bfc0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7c02800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7bfc15ae70 0x7f7bfc0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7c02800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc071ca0 con 0x7f7bfc071000 2024-09-12T12:24:12.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7c02800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7bfc071f80 con 0x7f7bfc15ae70 2024-09-12T12:24:12.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7c02800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc072260 con 0x7f7bfc15aa90 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7bfc071000 0x7f7bfc071490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46606/0 (socket says 172.21.15.144:46606) 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfbe00640 1 -- 172.21.15.144:0/2807456013 learned_addr learned my addr 172.21.15.144:0/2807456013 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/2807456013 >> v2:172.21.15.165:3300/0 conn(0x7f7bfc15ae70 0x7f7bfc0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfb400640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc15aa90 0x7f7bfc0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959762866 0 0) 0x7f7bfc071ca0 con 0x7f7bfc071000 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7be0004640 con 0x7f7bfc071000 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 707757494 0 0) 0x7f7be0004640 con 0x7f7bfc071000 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc15aa90 msgr2=0x7f7bfc0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc15aa90 0x7f7bfc0cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 >> v2:172.21.15.165:3300/0 conn(0x7f7bfc15ae70 msgr2=0x7f7bfc0cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 --2- 172.21.15.144:0/2807456013 >> v2:172.21.15.165:3300/0 conn(0x7f7bfc15ae70 0x7f7bfc0cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc072540 con 0x7f7bfc071000 2024-09-12T12:24:12.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f7bf4004ce0 con 0x7f7bfc071000 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 >> v1:172.21.15.144:6789/0 conn(0x7f7bfc071000 legacy=0x7f7bfc071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc15aa90 0x7f7be0004ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7be0005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be0005e60 0x7f7be00062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc071f80 con 0x7f7be0005050 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc072260 con 0x7f7be0005e60 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7be000cae0 con 0x7f7bfc15aa90 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7be0005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfb400640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc15aa90 0x7f7be0004ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfbe00640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be0005e60 0x7f7be00062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfaa00640 1 -- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc15aa90 msgr2=0x7f7be0004ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:12.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc15aa90 0x7f7be0004ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfaa00640 1 -- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be0005e60 msgr2=0x7f7be00062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be0005e60 0x7f7be00062e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfaa00640 1 -- 172.21.15.144:0/2807456013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be0004640 con 0x7f7be0005050 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.960+0000 7f7bfbe00640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7be0005e60 0x7f7be00062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7be0005920 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009ab0 tx=0x7f7be801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b3b04dcf2bf928 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80b2070 con 0x7f7be0005050 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80a5680 con 0x7f7be0005050 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7bfa000640 1 -- 172.21.15.144:0/2807456013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80096b0 con 0x7f7be0005050 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7c02800640 1 -- 172.21.15.144:0/2807456013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 msgr2=0x7f7be0005920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7c02800640 1 --2- 172.21.15.144:0/2807456013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7be0005920 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009ab0 tx=0x7f7be801ca30 comp rx=0 tx=0).stop 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7bfbe00640 1 -- 172.21.15.144:0/2807456013 reap_dead start 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7c02800640 1 -- 172.21.15.144:0/2807456013 shutdown_connections 2024-09-12T12:24:12.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7c02800640 1 -- 172.21.15.144:0/2807456013 >> 172.21.15.144:0/2807456013 conn(0x7f7bfc06d0d0 msgr2=0x7f7bfc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:12.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7c02800640 1 -- 172.21.15.144:0/2807456013 shutdown_connections 2024-09-12T12:24:12.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7c02800640 1 -- 172.21.15.144:0/2807456013 wait complete. 2024-09-12T12:24:12.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7c02800640 1 Processor -- start 2024-09-12T12:24:12.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.964+0000 7f7c02800640 1 -- start start 2024-09-12T12:24:12.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7c02800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7bfc155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7c02800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc1e71f0 0x7f7bfc1e1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7c02800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc1e19c0 0x7f7bfc1e1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7c02800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc06f220 con 0x7f7be0005050 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7c02800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc06f0a0 con 0x7f7bfc1e71f0 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7c02800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc0cced0 con 0x7f7bfc1e19c0 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7bfc155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7bfc155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36614/0 (socket says 172.21.15.144:36614) 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfb400640 1 -- 172.21.15.144:0/4165237488 learned_addr learned my addr 172.21.15.144:0/4165237488 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfb400640 1 -- 172.21.15.144:0/4165237488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc1e19c0 msgr2=0x7f7bfc1e1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfb400640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc1e19c0 0x7f7bfc1e1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc1e71f0 0x7f7bfc1e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfb400640 1 -- 172.21.15.144:0/4165237488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc1e71f0 msgr2=0x7f7bfc1e1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfb400640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc1e71f0 0x7f7bfc1e1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfb400640 1 -- 172.21.15.144:0/4165237488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc1e7790 con 0x7f7be0005050 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc1e71f0 0x7f7bfc1e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:12.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bfb400640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7bfc155160 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f7bec011e30 tx=0x7f7bec00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:12.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bf3400640 1 -- 172.21.15.144:0/4165237488 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec015630 con 0x7f7be0005050 2024-09-12T12:24:12.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bf3400640 1 -- 172.21.15.144:0/4165237488 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec0157d0 con 0x7f7be0005050 2024-09-12T12:24:12.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bfc1e7a70 con 0x7f7be0005050 2024-09-12T12:24:12.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bf3400640 1 -- 172.21.15.144:0/4165237488 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec015ba0 con 0x7f7be0005050 2024-09-12T12:24:12.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bfc1e8030 con 0x7f7be0005050 2024-09-12T12:24:12.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bfc06e140 con 0x7f7be0005050 2024-09-12T12:24:12.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.968+0000 7f7bf3400640 1 -- 172.21.15.144:0/4165237488 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7bec01d400 con 0x7f7be0005050 2024-09-12T12:24:12.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.972+0000 7f7bf3400640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:12.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.972+0000 7f7bf3400640 1 -- 172.21.15.144:0/4165237488 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5249+0+0 (secure 0 0 0) 0x7f7bec086c20 con 0x7f7be0005050 2024-09-12T12:24:12.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.972+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:12.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.972+0000 7f7bfaa00640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7be80af000 tx=0x7f7be80046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:12.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:12.976+0000 7f7bf3400640 1 -- 172.21.15.144:0/4165237488 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7bec019030 con 0x7f7be0005050 2024-09-12T12:24:13.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.132+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7bfc0cf520 con 0x7f7be0005050 2024-09-12T12:24:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.132+0000 7f7bf3400640 1 -- 172.21.15.144:0/4165237488 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v172) ==== 84+0+65 (secure 0 0 0) 0x7f7bec010040 con 0x7f7be0005050 2024-09-12T12:24:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:13.134 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:24:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:24:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:24:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:24:13.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:24:13.134 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:24:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 msgr2=0x7f7bdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7be80af000 tx=0x7f7be80046d0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 msgr2=0x7f7bfc155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7bfc155160 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f7bec011e30 tx=0x7f7bec00f580 comp rx=0 tx=0).stop 2024-09-12T12:24:13.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 shutdown_connections 2024-09-12T12:24:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7bdc0678c0 0x7f7bdc069d80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7bfc1e19c0 0x7f7bfc1e1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7bfc1e71f0 0x7f7bfc1e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 --2- 172.21.15.144:0/4165237488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7be0005050 0x7f7bfc155160 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 >> 172.21.15.144:0/4165237488 conn(0x7f7bfc06d0d0 msgr2=0x7f7bfc0ceaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 shutdown_connections 2024-09-12T12:24:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.136+0000 7f7c02800640 1 -- 172.21.15.144:0/4165237488 wait complete. 2024-09-12T12:24:13.154 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:24:13.155 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:24:13.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45fc000640 1 Processor -- start 2024-09-12T12:24:13.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45fc000640 1 -- start start 2024-09-12T12:24:13.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45fc000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f45f4156c10 0x7f45f4072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45fc000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45f406cff0 0x7f45f406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45fc000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 0x7f45f40737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45fc000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f45f406d990 con 0x7f45f406cff0 2024-09-12T12:24:13.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45fc000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f45f4073d30 con 0x7f45f4156c10 2024-09-12T12:24:13.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45fc000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45f4071be0 con 0x7f45f4073360 2024-09-12T12:24:13.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45f8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45f406cff0 0x7f45f406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45f8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f45f406cff0 0x7f45f406d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36618/0 (socket says 172.21.15.144:36618) 2024-09-12T12:24:13.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45f8c00640 1 -- 172.21.15.144:0/1550168628 learned_addr learned my addr 172.21.15.144:0/1550168628 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:13.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45fa000640 1 --2- 172.21.15.144:0/1550168628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 0x7f45f40737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45f9600640 1 --2- 172.21.15.144:0/1550168628 >> v2:172.21.15.165:3300/0 conn(0x7f45f4156c10 0x7f45f4072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45f8c00640 1 -- 172.21.15.144:0/1550168628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 msgr2=0x7f45f40737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:13.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45f8c00640 1 --2- 172.21.15.144:0/1550168628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 0x7f45f40737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45f8c00640 1 -- 172.21.15.144:0/1550168628 >> v2:172.21.15.165:3300/0 conn(0x7f45f4156c10 msgr2=0x7f45f4072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:13.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45f8c00640 1 --2- 172.21.15.144:0/1550168628 >> v2:172.21.15.165:3300/0 conn(0x7f45f4156c10 0x7f45f4072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.296+0000 7f45f8c00640 1 -- 172.21.15.144:0/1550168628 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f406cd20 con 0x7f45f406cff0 2024-09-12T12:24:13.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45f8c00640 1 --2- 172.21.15.144:0/1550168628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 0x7f45f406d450 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f45f40742c0 tx=0x7f45e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9280608f0a877827 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:13.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45f3e00640 1 -- 172.21.15.144:0/1550168628 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00a6040 con 0x7f45f406cff0 2024-09-12T12:24:13.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45f3e00640 1 -- 172.21.15.144:0/1550168628 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e00af070 con 0x7f45f406cff0 2024-09-12T12:24:13.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45f3e00640 1 -- 172.21.15.144:0/1550168628 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00aa860 con 0x7f45f406cff0 2024-09-12T12:24:13.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 -- 172.21.15.144:0/1550168628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 msgr2=0x7f45f406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 --2- 172.21.15.144:0/1550168628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 0x7f45f406d450 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f45f40742c0 tx=0x7f45e001c520 comp rx=0 tx=0).stop 2024-09-12T12:24:13.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 -- 172.21.15.144:0/1550168628 shutdown_connections 2024-09-12T12:24:13.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 --2- 172.21.15.144:0/1550168628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 0x7f45f406d450 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 --2- 172.21.15.144:0/1550168628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 0x7f45f40737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 --2- 172.21.15.144:0/1550168628 >> v2:172.21.15.165:3300/0 conn(0x7f45f4156c10 0x7f45f4072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 -- 172.21.15.144:0/1550168628 >> 172.21.15.144:0/1550168628 conn(0x7f45f406bc10 msgr2=0x7f45f406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:13.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 -- 172.21.15.144:0/1550168628 shutdown_connections 2024-09-12T12:24:13.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 -- 172.21.15.144:0/1550168628 wait complete. 2024-09-12T12:24:13.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.300+0000 7f45fc000640 1 Processor -- start 2024-09-12T12:24:13.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 -- start start 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 0x7f45f4155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 0x7f45f4155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45f4156c10 0x7f45f40c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4156ff0 con 0x7f45f406cff0 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4073f70 con 0x7f45f4156c10 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45f4157170 con 0x7f45f4073360 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 0x7f45f4155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 0x7f45f4155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36620/0 (socket says 172.21.15.144:36620) 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f9600640 1 -- 172.21.15.144:0/1704465113 learned_addr learned my addr 172.21.15.144:0/1704465113 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:13.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f8c00640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 0x7f45f4155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fa000640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45f4156c10 0x7f45f40c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f9600640 1 -- 172.21.15.144:0/1704465113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 msgr2=0x7f45f4155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f9600640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 0x7f45f4155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f9600640 1 -- 172.21.15.144:0/1704465113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45f4156c10 msgr2=0x7f45f40c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:13.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f9600640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45f4156c10 0x7f45f40c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:13.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f9600640 1 -- 172.21.15.144:0/1704465113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f414d610 con 0x7f45f406cff0 2024-09-12T12:24:13.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f9600640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 0x7f45f4155250 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f45e800d5f0 tx=0x7f45e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:13.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f1600640 1 -- 172.21.15.144:0/1704465113 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e80125f0 con 0x7f45f406cff0 2024-09-12T12:24:13.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f1600640 1 -- 172.21.15.144:0/1704465113 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e8019070 con 0x7f45f406cff0 2024-09-12T12:24:13.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45f1600640 1 -- 172.21.15.144:0/1704465113 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e80129b0 con 0x7f45f406cff0 2024-09-12T12:24:13.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f40c79c0 con 0x7f45f406cff0 2024-09-12T12:24:13.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f40b36c0 con 0x7f45f406cff0 2024-09-12T12:24:13.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.304+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f406d450 con 0x7f45f406cff0 2024-09-12T12:24:13.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.308+0000 7f45f1600640 1 -- 172.21.15.144:0/1704465113 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45e8012b50 con 0x7f45f406cff0 2024-09-12T12:24:13.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.308+0000 7f45f1600640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45d40678c0 0x7f45d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:13.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.308+0000 7f45f1600640 1 -- 172.21.15.144:0/1704465113 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5249+0+0 (secure 0 0 0) 0x7f45e8085e00 con 0x7f45f406cff0 2024-09-12T12:24:13.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.308+0000 7f45f8c00640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45d40678c0 0x7f45d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:13.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.308+0000 7f45f8c00640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45d40678c0 0x7f45d4069d80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f45e00ae000 tx=0x7f45e00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:13.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.312+0000 7f45f1600640 1 -- 172.21.15.144:0/1704465113 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45e80564a0 con 0x7f45f406cff0 2024-09-12T12:24:13.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:13.472+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f45f41672f0 con 0x7f45f406cff0 2024-09-12T12:24:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.356+0000 7f45f1600640 1 -- 172.21.15.144:0/1704465113 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v173) ==== 138+0+0 (secure 0 0 0) 0x7f45e805a7a0 con 0x7f45f406cff0 2024-09-12T12:24:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:24:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45d40678c0 msgr2=0x7f45d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45d40678c0 0x7f45d4069d80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f45e00ae000 tx=0x7f45e00a7000 comp rx=0 tx=0).stop 2024-09-12T12:24:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 msgr2=0x7f45f4155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 0x7f45f4155250 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f45e800d5f0 tx=0x7f45e800dab0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 shutdown_connections 2024-09-12T12:24:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45d40678c0 0x7f45d4069d80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45f4156c10 0x7f45f40c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45f4073360 0x7f45f4155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 --2- 172.21.15.144:0/1704465113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f406cff0 0x7f45f4155250 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 >> 172.21.15.144:0/1704465113 conn(0x7f45f406bc10 msgr2=0x7f45f415bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:14.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 shutdown_connections 2024-09-12T12:24:14.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.360+0000 7f45fc000640 1 -- 172.21.15.144:0/1704465113 wait complete. 2024-09-12T12:24:14.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:24:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.536+0000 7f53f3200640 1 Processor -- start 2024-09-12T12:24:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.536+0000 7f53f3200640 1 -- start start 2024-09-12T12:24:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f3200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f53f40b46b0 0x7f53f41694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f406d220 con 0x7f53f41480a0 2024-09-12T12:24:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f406d500 con 0x7f53f4147cc0 2024-09-12T12:24:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f3200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f53f406e4e0 con 0x7f53f40b46b0 2024-09-12T12:24:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f1400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f53f41480a0 0x7f53f40b3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46620/0 (socket says 172.21.15.144:46620) 2024-09-12T12:24:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f1400640 1 -- 172.21.15.144:0/4252986321 learned_addr learned my addr 172.21.15.144:0/4252986321 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:14.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f2800640 1 --2- 172.21.15.144:0/4252986321 >> v2:172.21.15.165:3300/0 conn(0x7f53f40b46b0 0x7f53f41694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209622824 0 0) 0x7f53f406d220 con 0x7f53f41480a0 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53d8003530 con 0x7f53f41480a0 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928308155 0 0) 0x7f53f406d500 con 0x7f53f4147cc0 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53f406d220 con 0x7f53f4147cc0 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1596559103 0 0) 0x7f53d8003530 con 0x7f53f41480a0 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 >> v2:172.21.15.165:3300/0 conn(0x7f53f40b46b0 msgr2=0x7f53f41694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 --2- 172.21.15.144:0/4252986321 >> v2:172.21.15.165:3300/0 conn(0x7f53f40b46b0 0x7f53f41694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 >> v1:172.21.15.165:6789/0 conn(0x7f53f4147cc0 legacy=0x7f53f406e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f406d7e0 con 0x7f53f41480a0 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f53e0001680 con 0x7f53f41480a0 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 >> v1:172.21.15.144:6789/0 conn(0x7f53f41480a0 legacy=0x7f53f40b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:14.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53d8003b50 0x7f53d8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53d8004810 0x7f53d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f53d800c0d0 con 0x7f53d80051d0 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f53d800c280 con 0x7f53d8004810 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f53d800c480 con 0x7f53d8003b50 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f2800640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f1e00640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53d8003b50 0x7f53d8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f1400640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53d8004810 0x7f53d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f2800640 1 -- 172.21.15.144:0/4252986321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53d8003b50 msgr2=0x7f53d8003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f2800640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53d8003b50 0x7f53d8003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f2800640 1 -- 172.21.15.144:0/4252986321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53d8004810 msgr2=0x7f53d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f2800640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53d8004810 0x7f53d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.540+0000 7f53f2800640 1 -- 172.21.15.144:0/4252986321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d8003530 con 0x7f53d80051d0 2024-09-12T12:24:14.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f2800640 1 -- 172.21.15.144:0/4252986321 reap_dead start 2024-09-12T12:24:14.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f2800640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53d800b9d0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009f90 tx=0x7f53ec01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d667acfb079b900 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:14.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec0b2070 con 0x7f53d80051d0 2024-09-12T12:24:14.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec0a5c90 con 0x7f53d80051d0 2024-09-12T12:24:14.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f0a00640 1 -- 172.21.15.144:0/4252986321 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec009c10 con 0x7f53d80051d0 2024-09-12T12:24:14.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f3200640 1 -- 172.21.15.144:0/4252986321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 msgr2=0x7f53d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:14.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f3200640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53d800b9d0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009f90 tx=0x7f53ec01cc80 comp rx=0 tx=0).stop 2024-09-12T12:24:14.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f3200640 1 -- 172.21.15.144:0/4252986321 shutdown_connections 2024-09-12T12:24:14.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f3200640 1 --2- 172.21.15.144:0/4252986321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53d800b9d0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f3200640 1 -- 172.21.15.144:0/4252986321 >> 172.21.15.144:0/4252986321 conn(0x7f53f40b7c30 msgr2=0x7f53f4067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f3200640 1 -- 172.21.15.144:0/4252986321 shutdown_connections 2024-09-12T12:24:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.544+0000 7f53f3200640 1 -- 172.21.15.144:0/4252986321 wait complete. 2024-09-12T12:24:14.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 Processor -- start 2024-09-12T12:24:14.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 -- start start 2024-09-12T12:24:14.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53f415db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:14.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53f413c2f0 0x7f53f4141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:14.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f41418a0 0x7f53f4145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:14.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4073120 con 0x7f53d80051d0 2024-09-12T12:24:14.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f53f4072fa0 con 0x7f53f41418a0 2024-09-12T12:24:14.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f53f406cd20 con 0x7f53f413c2f0 2024-09-12T12:24:14.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53f415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:14.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53f415db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36640/0 (socket says 172.21.15.144:36640) 2024-09-12T12:24:14.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f2800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f41418a0 0x7f53f4145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:14.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1e00640 1 -- 172.21.15.144:0/2273359415 learned_addr learned my addr 172.21.15.144:0/2273359415 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:14.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1400640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53f413c2f0 0x7f53f4141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:14.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1e00640 1 -- 172.21.15.144:0/2273359415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53f413c2f0 msgr2=0x7f53f4141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:14.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1e00640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53f413c2f0 0x7f53f4141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1e00640 1 -- 172.21.15.144:0/2273359415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f41418a0 msgr2=0x7f53f4145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:14.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1e00640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f41418a0 0x7f53f4145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:14.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1e00640 1 -- 172.21.15.144:0/2273359415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f413b250 con 0x7f53d80051d0 2024-09-12T12:24:14.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f1e00640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53f415db10 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f53e4007ca0 tx=0x7f53e4012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:14.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53ea000640 1 -- 172.21.15.144:0/2273359415 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4010b50 con 0x7f53d80051d0 2024-09-12T12:24:14.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53ea000640 1 -- 172.21.15.144:0/2273359415 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e401b070 con 0x7f53d80051d0 2024-09-12T12:24:14.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53ea000640 1 -- 172.21.15.144:0/2273359415 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4016480 con 0x7f53d80051d0 2024-09-12T12:24:14.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f413b530 con 0x7f53d80051d0 2024-09-12T12:24:14.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f413baf0 con 0x7f53d80051d0 2024-09-12T12:24:14.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.548+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f406e790 con 0x7f53d80051d0 2024-09-12T12:24:14.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.552+0000 7f53ea000640 1 -- 172.21.15.144:0/2273359415 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53e4016620 con 0x7f53d80051d0 2024-09-12T12:24:14.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.552+0000 7f53ea000640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53d40678f0 0x7f53d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:14.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.552+0000 7f53ea000640 1 -- 172.21.15.144:0/2273359415 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5619+0+0 (secure 0 0 0) 0x7f53e40892c0 con 0x7f53d80051d0 2024-09-12T12:24:14.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.552+0000 7f53f1400640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53d40678f0 0x7f53d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:14.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.552+0000 7f53f1400640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53d40678f0 0x7f53d4069db0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f53e0001210 tx=0x7f53e0001e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:14.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.556+0000 7f53ea000640 1 -- 172.21.15.144:0/2273359415 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f53e4059760 con 0x7f53d80051d0 2024-09-12T12:24:14.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:14.712+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f53f406df70 con 0x7f53d80051d0 2024-09-12T12:24:15.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.364+0000 7f53ea000640 1 -- 172.21.15.144:0/2273359415 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v174) ==== 170+0+0 (secure 0 0 0) 0x7f53e405da60 con 0x7f53d80051d0 2024-09-12T12:24:15.366 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:24:15.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53d40678f0 msgr2=0x7f53d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53d40678f0 0x7f53d4069db0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f53e0001210 tx=0x7f53e0001e30 comp rx=0 tx=0).stop 2024-09-12T12:24:15.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 msgr2=0x7f53f415db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53f415db10 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f53e4007ca0 tx=0x7f53e4012c90 comp rx=0 tx=0).stop 2024-09-12T12:24:15.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 shutdown_connections 2024-09-12T12:24:15.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f53d40678f0 0x7f53d4069db0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f53f41418a0 0x7f53f4145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f53f413c2f0 0x7f53f4141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 --2- 172.21.15.144:0/2273359415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53d80051d0 0x7f53f415db10 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 >> 172.21.15.144:0/2273359415 conn(0x7f53f40b7c30 msgr2=0x7f53f40d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:15.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 shutdown_connections 2024-09-12T12:24:15.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.368+0000 7f53f3200640 1 -- 172.21.15.144:0/2273359415 wait complete. 2024-09-12T12:24:15.407 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:24:15.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.548+0000 7f4577200640 1 Processor -- start 2024-09-12T12:24:15.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.548+0000 7f4577200640 1 -- start start 2024-09-12T12:24:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4577200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f457015af60 0x7f45700ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4577200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45700cd9f0 0x7f457006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4577200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f457015b340 0x7f457006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4577200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f45700b32f0 con 0x7f457015b340 2024-09-12T12:24:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4577200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f45700b4300 con 0x7f457015af60 2024-09-12T12:24:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4577200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45700b3540 con 0x7f45700cd9f0 2024-09-12T12:24:15.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4575200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f457015b340 0x7f457006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4575200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f457015b340 0x7f457006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36646/0 (socket says 172.21.15.144:36646) 2024-09-12T12:24:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4575200640 1 -- 172.21.15.144:0/627035227 learned_addr learned my addr 172.21.15.144:0/627035227 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4575200640 1 -- 172.21.15.144:0/627035227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45700cd9f0 msgr2=0x7f457006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4575200640 1 --2- 172.21.15.144:0/627035227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45700cd9f0 0x7f457006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4575200640 1 -- 172.21.15.144:0/627035227 >> v2:172.21.15.165:3300/0 conn(0x7f457015af60 msgr2=0x7f45700ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4575200640 1 --2- 172.21.15.144:0/627035227 >> v2:172.21.15.165:3300/0 conn(0x7f457015af60 0x7f45700ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4575200640 1 -- 172.21.15.144:0/627035227 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45700b3820 con 0x7f457015b340 2024-09-12T12:24:15.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.552+0000 7f4575200640 1 --2- 172.21.15.144:0/627035227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015b340 0x7f457006c150 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f45700d0240 tx=0x7f456801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e77785dd12342da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:15.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f456ea00640 1 -- 172.21.15.144:0/627035227 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45680b4070 con 0x7f457015b340 2024-09-12T12:24:15.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f456ea00640 1 -- 172.21.15.144:0/627035227 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45680af400 con 0x7f457015b340 2024-09-12T12:24:15.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f456ea00640 1 -- 172.21.15.144:0/627035227 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45680af7d0 con 0x7f457015b340 2024-09-12T12:24:15.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 -- 172.21.15.144:0/627035227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015b340 msgr2=0x7f457006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 --2- 172.21.15.144:0/627035227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015b340 0x7f457006c150 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f45700d0240 tx=0x7f456801f1e0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 -- 172.21.15.144:0/627035227 shutdown_connections 2024-09-12T12:24:15.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 --2- 172.21.15.144:0/627035227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015b340 0x7f457006c150 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 --2- 172.21.15.144:0/627035227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45700cd9f0 0x7f457006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 --2- 172.21.15.144:0/627035227 >> v2:172.21.15.165:3300/0 conn(0x7f457015af60 0x7f45700ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 -- 172.21.15.144:0/627035227 >> 172.21.15.144:0/627035227 conn(0x7f4570068030 msgr2=0x7f45700b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 -- 172.21.15.144:0/627035227 shutdown_connections 2024-09-12T12:24:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 -- 172.21.15.144:0/627035227 wait complete. 2024-09-12T12:24:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 Processor -- start 2024-09-12T12:24:15.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 -- start start 2024-09-12T12:24:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45700cd9f0 0x7f4570150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015af60 0x7f457015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f457015b340 0x7f4570156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45700cebc0 con 0x7f457015af60 2024-09-12T12:24:15.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45700b3de0 con 0x7f45700cd9f0 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4577200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45700ced40 con 0x7f457015b340 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f456f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015af60 0x7f457015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f456f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015af60 0x7f457015b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36652/0 (socket says 172.21.15.144:36652) 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f456f400640 1 -- 172.21.15.144:0/1985397808 learned_addr learned my addr 172.21.15.144:0/1985397808 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f456fe00640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45700cd9f0 0x7f4570150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.556+0000 7f4575200640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f457015b340 0x7f4570156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f456f400640 1 -- 172.21.15.144:0/1985397808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f457015b340 msgr2=0x7f4570156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f456f400640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f457015b340 0x7f4570156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f456f400640 1 -- 172.21.15.144:0/1985397808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45700cd9f0 msgr2=0x7f4570150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f456f400640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45700cd9f0 0x7f4570150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f456f400640 1 -- 172.21.15.144:0/1985397808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4570167b30 con 0x7f457015af60 2024-09-12T12:24:15.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f456f400640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015af60 0x7f457015b810 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f455c00b4b0 tx=0x7f455c00b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f4567e00640 1 -- 172.21.15.144:0/1985397808 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c014070 con 0x7f457015af60 2024-09-12T12:24:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f4567e00640 1 -- 172.21.15.144:0/1985397808 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455c010610 con 0x7f457015af60 2024-09-12T12:24:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f4567e00640 1 -- 172.21.15.144:0/1985397808 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0109e0 con 0x7f457015af60 2024-09-12T12:24:15.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4570155af0 con 0x7f457015af60 2024-09-12T12:24:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4570156330 con 0x7f457015af60 2024-09-12T12:24:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45700ce680 con 0x7f457015af60 2024-09-12T12:24:15.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.560+0000 7f4567e00640 1 -- 172.21.15.144:0/1985397808 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f455c017070 con 0x7f457015af60 2024-09-12T12:24:15.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.564+0000 7f4567e00640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45500678c0 0x7f4550069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:15.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.564+0000 7f4567e00640 1 -- 172.21.15.144:0/1985397808 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 6001+0+0 (secure 0 0 0) 0x7f455c085770 con 0x7f457015af60 2024-09-12T12:24:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.564+0000 7f456fe00640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45500678c0 0x7f4550069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:15.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.564+0000 7f456fe00640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45500678c0 0x7f4550069d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f45701518b0 tx=0x7f4560009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.568+0000 7f4567e00640 1 -- 172.21.15.144:0/1985397808 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4570155af0 con 0x7f457015af60 2024-09-12T12:24:15.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:15.760+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f457015ed30 con 0x7f457015af60 2024-09-12T12:24:16.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.380+0000 7f4567e00640 1 -- 172.21.15.144:0/1985397808 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v132) ==== 174+0+0 (secure 0 0 0) 0x7f455c055a90 con 0x7f457015af60 2024-09-12T12:24:16.382 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 25 and data pool 26 2024-09-12T12:24:16.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45500678c0 msgr2=0x7f4550069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45500678c0 0x7f4550069d80 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f45701518b0 tx=0x7f4560009110 comp rx=0 tx=0).stop 2024-09-12T12:24:16.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015af60 msgr2=0x7f457015b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015af60 0x7f457015b810 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f455c00b4b0 tx=0x7f455c00b970 comp rx=0 tx=0).stop 2024-09-12T12:24:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 shutdown_connections 2024-09-12T12:24:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f45500678c0 0x7f4550069d80 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f457015b340 0x7f4570156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f457015af60 0x7f457015b810 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 --2- 172.21.15.144:0/1985397808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45700cd9f0 0x7f4570150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 >> 172.21.15.144:0/1985397808 conn(0x7f4570068030 msgr2=0x7f457014d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:16.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 shutdown_connections 2024-09-12T12:24:16.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.388+0000 7f4577200640 1 -- 172.21.15.144:0/1985397808 wait complete. 2024-09-12T12:24:16.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:24:16.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f2d600640 1 Processor -- start 2024-09-12T12:24:16.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f2d600640 1 -- start start 2024-09-12T12:24:16.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f2d600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4f2815c7b0 0x7f4f280ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f2d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 0x7f4f28072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f2d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f280cd870 con 0x7f4f2815cd30 2024-09-12T12:24:16.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f2d600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4f28072a50 con 0x7f4f2815c7b0 2024-09-12T12:24:16.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f2d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4f280cde30 con 0x7f4f280b5fb0 2024-09-12T12:24:16.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f26000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4f2815cd30 0x7f4f280b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46628/0 (socket says 172.21.15.144:46628) 2024-09-12T12:24:16.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f26000640 1 -- 172.21.15.144:0/2477679991 learned_addr learned my addr 172.21.15.144:0/2477679991 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:16.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f26a00640 1 --2- 172.21.15.144:0/2477679991 >> v2:172.21.15.165:3300/0 conn(0x7f4f2815c7b0 0x7f4f280ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.564+0000 7f4f27400640 1 --2- 172.21.15.144:0/2477679991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 0x7f4f28072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f25600640 1 -- 172.21.15.144:0/2477679991 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858439625 0 0) 0x7f4f280cd870 con 0x7f4f2815cd30 2024-09-12T12:24:16.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f25600640 1 -- 172.21.15.144:0/2477679991 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f0c003530 con 0x7f4f2815cd30 2024-09-12T12:24:16.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f27400640 1 -- 172.21.15.144:0/2477679991 >> v2:172.21.15.165:3300/0 conn(0x7f4f2815c7b0 msgr2=0x7f4f280ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:16.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f27400640 1 --2- 172.21.15.144:0/2477679991 >> v2:172.21.15.165:3300/0 conn(0x7f4f2815c7b0 0x7f4f280ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f27400640 1 -- 172.21.15.144:0/2477679991 >> v1:172.21.15.144:6789/0 conn(0x7f4f2815cd30 legacy=0x7f4f280b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f27400640 1 -- 172.21.15.144:0/2477679991 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f280cdb50 con 0x7f4f280b5fb0 2024-09-12T12:24:16.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f26a00640 1 --2- 172.21.15.144:0/2477679991 >> v2:172.21.15.165:3300/0 conn(0x7f4f2815c7b0 0x7f4f280ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:16.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f27400640 1 --2- 172.21.15.144:0/2477679991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 0x7f4f28072ee0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009d90 tx=0x7f4f2001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=724fcd5261244ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:16.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f25600640 1 -- 172.21.15.144:0/2477679991 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200b2070 con 0x7f4f280b5fb0 2024-09-12T12:24:16.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f25600640 1 -- 172.21.15.144:0/2477679991 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f200a5940 con 0x7f4f280b5fb0 2024-09-12T12:24:16.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.568+0000 7f4f25600640 1 -- 172.21.15.144:0/2477679991 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f200a5cf0 con 0x7f4f280b5fb0 2024-09-12T12:24:16.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 -- 172.21.15.144:0/2477679991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 msgr2=0x7f4f28072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 --2- 172.21.15.144:0/2477679991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 0x7f4f28072ee0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009d90 tx=0x7f4f2001c970 comp rx=0 tx=0).stop 2024-09-12T12:24:16.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 -- 172.21.15.144:0/2477679991 shutdown_connections 2024-09-12T12:24:16.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 --2- 172.21.15.144:0/2477679991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 0x7f4f28072ee0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 --2- 172.21.15.144:0/2477679991 >> v2:172.21.15.165:3300/0 conn(0x7f4f2815c7b0 0x7f4f280ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 -- 172.21.15.144:0/2477679991 >> 172.21.15.144:0/2477679991 conn(0x7f4f2806d0d0 msgr2=0x7f4f2806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:16.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 -- 172.21.15.144:0/2477679991 shutdown_connections 2024-09-12T12:24:16.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 -- 172.21.15.144:0/2477679991 wait complete. 2024-09-12T12:24:16.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 Processor -- start 2024-09-12T12:24:16.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 -- start start 2024-09-12T12:24:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 0x7f4f280b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f2815c7b0 0x7f4f28155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f2815cd30 0x7f4f281656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28073fc0 con 0x7f4f2815c7b0 2024-09-12T12:24:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28073e40 con 0x7f4f2815cd30 2024-09-12T12:24:16.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f2d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4f28074140 con 0x7f4f280b5fb0 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f2815c7b0 0x7f4f28155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f2815c7b0 0x7f4f28155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36660/0 (socket says 172.21.15.144:36660) 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26000640 1 -- 172.21.15.144:0/2039237858 learned_addr learned my addr 172.21.15.144:0/2039237858 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f27400640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f2815cd30 0x7f4f281656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26a00640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 0x7f4f280b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26000640 1 -- 172.21.15.144:0/2039237858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 msgr2=0x7f4f280b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26000640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 0x7f4f280b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26000640 1 -- 172.21.15.144:0/2039237858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f2815cd30 msgr2=0x7f4f281656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26000640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f2815cd30 0x7f4f281656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26000640 1 -- 172.21.15.144:0/2039237858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f281560c0 con 0x7f4f2815c7b0 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.572+0000 7f4f26000640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f2815c7b0 0x7f4f28155b80 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f4f140010f0 tx=0x7f4f1400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f1ea00640 1 -- 172.21.15.144:0/2039237858 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14017070 con 0x7f4f2815c7b0 2024-09-12T12:24:16.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f1ea00640 1 -- 172.21.15.144:0/2039237858 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f14005d10 con 0x7f4f2815c7b0 2024-09-12T12:24:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f281fba00 con 0x7f4f2815c7b0 2024-09-12T12:24:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f1ea00640 1 -- 172.21.15.144:0/2039237858 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14007310 con 0x7f4f2815c7b0 2024-09-12T12:24:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f280b3a10 con 0x7f4f2815c7b0 2024-09-12T12:24:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f28072ee0 con 0x7f4f2815c7b0 2024-09-12T12:24:16.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f1ea00640 1 -- 172.21.15.144:0/2039237858 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f1401a070 con 0x7f4f2815c7b0 2024-09-12T12:24:16.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f1ea00640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f080678c0 0x7f4f08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f1ea00640 1 -- 172.21.15.144:0/2039237858 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 6101+0+0 (secure 0 0 0) 0x7f4f14085160 con 0x7f4f2815c7b0 2024-09-12T12:24:16.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.576+0000 7f4f26a00640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f080678c0 0x7f4f08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.580+0000 7f4f26a00640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f080678c0 0x7f4f08069d80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009580 tx=0x7f4f18009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:16.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:24:16.583 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:24:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.584+0000 7f4f1ea00640 1 -- 172.21.15.144:0/2039237858 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f281560c0 con 0x7f4f2815c7b0 2024-09-12T12:24:16.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f2815ee10 con 0x7f4f2815c7b0 2024-09-12T12:24:16.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f1ea00640 1 -- 172.21.15.144:0/2039237858 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) ==== 74+0+16985 (secure 0 0 0) 0x7f4f140554b0 con 0x7f4f2815c7b0 2024-09-12T12:24:16.744 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:16.744 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":175,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:24:15.762641+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:24:13.519279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-12T12:24:14.760733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:16.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f080678c0 msgr2=0x7f4f08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f080678c0 0x7f4f08069d80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009580 tx=0x7f4f18009190 comp rx=0 tx=0).stop 2024-09-12T12:24:16.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f2815c7b0 msgr2=0x7f4f28155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f2815c7b0 0x7f4f28155b80 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f4f140010f0 tx=0x7f4f1400c890 comp rx=0 tx=0).stop 2024-09-12T12:24:16.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 shutdown_connections 2024-09-12T12:24:16.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4f080678c0 0x7f4f08069d80 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f2815cd30 0x7f4f281656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f2815c7b0 0x7f4f28155b80 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 --2- 172.21.15.144:0/2039237858 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f280b5fb0 0x7f4f280b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 >> 172.21.15.144:0/2039237858 conn(0x7f4f2806d0d0 msgr2=0x7f4f2815dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:16.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 shutdown_connections 2024-09-12T12:24:16.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.744+0000 7f4f2d600640 1 -- 172.21.15.144:0/2039237858 wait complete. 2024-09-12T12:24:16.765 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:24:16.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.900+0000 7fa927200640 1 Processor -- start 2024-09-12T12:24:16.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.900+0000 7fa927200640 1 -- start start 2024-09-12T12:24:16.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa927200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 0x7fa9200b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa927200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa9200b3ad0 0x7fa920071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa927200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa920071960 0x7fa9200ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa927200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa9200b45a0 con 0x7fa9200b3ad0 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa927200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa9200b3fe0 con 0x7fa920071960 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa927200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa9200b42c0 con 0x7fa92015b4e0 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa91f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa9200b3ad0 0x7fa920071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa91f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa9200b3ad0 0x7fa920071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36668/0 (socket says 172.21.15.144:36668) 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa91f400640 1 -- 172.21.15.144:0/4106550028 learned_addr learned my addr 172.21.15.144:0/4106550028 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa91fe00640 1 --2- 172.21.15.144:0/4106550028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 0x7fa9200b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa925200640 1 --2- 172.21.15.144:0/4106550028 >> v2:172.21.15.165:3300/0 conn(0x7fa920071960 0x7fa9200ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa91f400640 1 -- 172.21.15.144:0/4106550028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 msgr2=0x7fa9200b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:16.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa91f400640 1 --2- 172.21.15.144:0/4106550028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 0x7fa9200b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa91f400640 1 -- 172.21.15.144:0/4106550028 >> v2:172.21.15.165:3300/0 conn(0x7fa920071960 msgr2=0x7fa9200ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:16.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa91f400640 1 --2- 172.21.15.144:0/4106550028 >> v2:172.21.15.165:3300/0 conn(0x7fa920071960 0x7fa9200ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.904+0000 7fa91f400640 1 -- 172.21.15.144:0/4106550028 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9200b1490 con 0x7fa9200b3ad0 2024-09-12T12:24:16.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa91f400640 1 --2- 172.21.15.144:0/4106550028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 0x7fa920071420 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fa9200d04b0 tx=0x7fa90c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e921923791b0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:16.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa91ea00640 1 -- 172.21.15.144:0/4106550028 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0b1070 con 0x7fa9200b3ad0 2024-09-12T12:24:16.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa91ea00640 1 -- 172.21.15.144:0/4106550028 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90c0ac620 con 0x7fa9200b3ad0 2024-09-12T12:24:16.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa91ea00640 1 -- 172.21.15.144:0/4106550028 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0ac9f0 con 0x7fa9200b3ad0 2024-09-12T12:24:16.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 -- 172.21.15.144:0/4106550028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 msgr2=0x7fa920071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 --2- 172.21.15.144:0/4106550028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 0x7fa920071420 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fa9200d04b0 tx=0x7fa90c01c4f0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 -- 172.21.15.144:0/4106550028 shutdown_connections 2024-09-12T12:24:16.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 --2- 172.21.15.144:0/4106550028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 0x7fa920071420 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 --2- 172.21.15.144:0/4106550028 >> v2:172.21.15.165:3300/0 conn(0x7fa920071960 0x7fa9200ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 --2- 172.21.15.144:0/4106550028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 0x7fa9200b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 -- 172.21.15.144:0/4106550028 >> 172.21.15.144:0/4106550028 conn(0x7fa92006d0d0 msgr2=0x7fa92006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:16.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 -- 172.21.15.144:0/4106550028 shutdown_connections 2024-09-12T12:24:16.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 -- 172.21.15.144:0/4106550028 wait complete. 2024-09-12T12:24:16.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 Processor -- start 2024-09-12T12:24:16.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.908+0000 7fa927200640 1 -- start start 2024-09-12T12:24:16.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa927200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa920071960 0x7fa9201f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa927200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 0x7fa92015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa927200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 0x7fa920153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa927200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa92015f270 con 0x7fa9200b3ad0 2024-09-12T12:24:16.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa927200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa92015f0f0 con 0x7fa920071960 2024-09-12T12:24:16.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa927200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa92015f3f0 con 0x7fa92015b4e0 2024-09-12T12:24:16.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 0x7fa92015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa920071960 0x7fa9201f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 0x7fa92015dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36676/0 (socket says 172.21.15.144:36676) 2024-09-12T12:24:16.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91f400640 1 -- 172.21.15.144:0/2135761468 learned_addr learned my addr 172.21.15.144:0/2135761468 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:16.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa925200640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 0x7fa920153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91f400640 1 -- 172.21.15.144:0/2135761468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 msgr2=0x7fa920153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91f400640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 0x7fa920153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91f400640 1 -- 172.21.15.144:0/2135761468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa920071960 msgr2=0x7fa9201f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:16.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91f400640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa920071960 0x7fa9201f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:16.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91f400640 1 -- 172.21.15.144:0/2135761468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9201f5f60 con 0x7fa9200b3ad0 2024-09-12T12:24:16.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa91f400640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 0x7fa92015dd10 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0af040 tx=0x7fa90c019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:16.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa917e00640 1 -- 172.21.15.144:0/2135761468 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0bc070 con 0x7fa9200b3ad0 2024-09-12T12:24:16.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa917e00640 1 -- 172.21.15.144:0/2135761468 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90c0ace30 con 0x7fa9200b3ad0 2024-09-12T12:24:16.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa917e00640 1 -- 172.21.15.144:0/2135761468 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0b1040 con 0x7fa9200b3ad0 2024-09-12T12:24:16.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9201f6240 con 0x7fa9200b3ad0 2024-09-12T12:24:16.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9201f6800 con 0x7fa9200b3ad0 2024-09-12T12:24:16.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa920071420 con 0x7fa9200b3ad0 2024-09-12T12:24:16.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.912+0000 7fa917e00640 1 -- 172.21.15.144:0/2135761468 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa90c0bf070 con 0x7fa9200b3ad0 2024-09-12T12:24:16.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.916+0000 7fa917e00640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9000678c0 0x7fa900069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:16.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.916+0000 7fa917e00640 1 -- 172.21.15.144:0/2135761468 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 6101+0+0 (secure 0 0 0) 0x7fa90c11f3e0 con 0x7fa9200b3ad0 2024-09-12T12:24:16.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.916+0000 7fa91fe00640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9000678c0 0x7fa900069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:16.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.916+0000 7fa91fe00640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9000678c0 0x7fa900069d80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa9200d0450 tx=0x7fa910009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:16.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:16.920+0000 7fa917e00640 1 -- 172.21.15.144:0/2135761468 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa90c016110 con 0x7fa9200b3ad0 2024-09-12T12:24:17.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.076+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9200ccf10 con 0x7fa9200b3ad0 2024-09-12T12:24:17.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa917e00640 1 -- 172.21.15.144:0/2135761468 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) ==== 74+0+16985 (secure 0 0 0) 0x7fa90c0ef740 con 0x7fa9200b3ad0 2024-09-12T12:24:17.079 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:17.079 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":175,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:24:15.762641+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:24:13.519279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-12T12:24:14.760733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:17.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9000678c0 msgr2=0x7fa900069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:17.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9000678c0 0x7fa900069d80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa9200d0450 tx=0x7fa910009190 comp rx=0 tx=0).stop 2024-09-12T12:24:17.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 msgr2=0x7fa92015dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:17.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 0x7fa92015dd10 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0af040 tx=0x7fa90c019290 comp rx=0 tx=0).stop 2024-09-12T12:24:17.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 shutdown_connections 2024-09-12T12:24:17.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa9000678c0 0x7fa900069d80 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa92015b4e0 0x7fa920153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9200b3ad0 0x7fa92015dd10 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 --2- 172.21.15.144:0/2135761468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa920071960 0x7fa9201f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 >> 172.21.15.144:0/2135761468 conn(0x7fa92006d0d0 msgr2=0x7fa9201582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:17.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 shutdown_connections 2024-09-12T12:24:17.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.080+0000 7fa927200640 1 -- 172.21.15.144:0/2135761468 wait complete. 2024-09-12T12:24:17.102 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:24:17.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0351400640 1 Processor -- start 2024-09-12T12:24:17.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0351400640 1 -- start start 2024-09-12T12:24:17.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0351400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f034c15af60 0x7f034c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0351400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f034c0cd9f0 0x7f034c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0351400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c0b4300 con 0x7f034c15b340 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0351400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f034c0b32f0 con 0x7f034c15af60 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0351400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f034c0b3540 con 0x7f034c0cd9f0 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f034b200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f034c15b340 0x7f034c15ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53074/0 (socket says 172.21.15.144:53074) 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f034b200640 1 -- 172.21.15.144:0/1732982780 learned_addr learned my addr 172.21.15.144:0/1732982780 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0349e00640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f034c0cd9f0 0x7f034c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f034a800640 1 --2- 172.21.15.144:0/1732982780 >> v2:172.21.15.165:3300/0 conn(0x7f034c15af60 0x7f034c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998749633 0 0) 0x7f034c0b4300 con 0x7f034c15b340 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0330005740 con 0x7f034c15b340 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1218848781 0 0) 0x7f0330005740 con 0x7f034c15b340 2024-09-12T12:24:17.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f034c0cd9f0 msgr2=0x7f034c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:17.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.240+0000 7f0349400640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f034c0cd9f0 0x7f034c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 >> v2:172.21.15.165:3300/0 conn(0x7f034c15af60 msgr2=0x7f034c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:17.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 --2- 172.21.15.144:0/1732982780 >> v2:172.21.15.165:3300/0 conn(0x7f034c15af60 0x7f034c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c0b3820 con 0x7f034c15b340 2024-09-12T12:24:17.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f0344001a00 con 0x7f034c15b340 2024-09-12T12:24:17.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 >> v1:172.21.15.144:6789/0 conn(0x7f034c15b340 legacy=0x7f034c15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:17.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f034c0cd9f0 0x7f0330005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:17.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0330006110 0x7f0330006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0330006590 0x7f0330006f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f034c0b32f0 con 0x7f0330006110 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f034c0b3540 con 0x7f0330006590 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0330007860 con 0x7f034c0cd9f0 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349e00640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0330006110 0x7f0330006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f034a800640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f034c0cd9f0 0x7f0330005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f034b200640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0330006590 0x7f0330006f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349e00640 1 -- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f034c0cd9f0 msgr2=0x7f0330005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349e00640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f034c0cd9f0 0x7f0330005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349e00640 1 -- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0330006590 msgr2=0x7f0330006f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349e00640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0330006590 0x7f0330006f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349e00640 1 -- 172.21.15.144:0/1732982780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0330005740 con 0x7f0330006110 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349e00640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0330006110 0x7f0330006a20 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f0338009ab0 tx=0x7f033801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d75c3ff078d449 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.244+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03380b2070 con 0x7f0330006110 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03380a5640 con 0x7f0330006110 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0349400640 1 -- 172.21.15.144:0/1732982780 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03380096b0 con 0x7f0330006110 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 -- 172.21.15.144:0/1732982780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0330006110 msgr2=0x7f0330006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 --2- 172.21.15.144:0/1732982780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0330006110 0x7f0330006a20 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f0338009ab0 tx=0x7f033801ca50 comp rx=0 tx=0).stop 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034b200640 1 -- 172.21.15.144:0/1732982780 reap_dead start 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 -- 172.21.15.144:0/1732982780 shutdown_connections 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 -- 172.21.15.144:0/1732982780 >> 172.21.15.144:0/1732982780 conn(0x7f034c068030 msgr2=0x7f034c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:17.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 -- 172.21.15.144:0/1732982780 shutdown_connections 2024-09-12T12:24:17.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 -- 172.21.15.144:0/1732982780 wait complete. 2024-09-12T12:24:17.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 Processor -- start 2024-09-12T12:24:17.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 -- start start 2024-09-12T12:24:17.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0330006110 0x7f034c1f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:17.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f034c15e2c0 0x7f034c14ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:17.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f034c0d0df0 0x7f034c072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:17.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f034c0b5570 con 0x7f034c0d0df0 2024-09-12T12:24:17.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f034c0b3de0 con 0x7f034c15e2c0 2024-09-12T12:24:17.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0351400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f034c0cebc0 con 0x7f0330006110 2024-09-12T12:24:17.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f034c0d0df0 0x7f034c072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f034c0d0df0 0x7f034c072130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36358/0 (socket says 172.21.15.144:36358) 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034b200640 1 -- 172.21.15.144:0/2757994284 learned_addr learned my addr 172.21.15.144:0/2757994284 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034a800640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0330006110 0x7f034c1f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f0349e00640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f034c15e2c0 0x7f034c14ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034b200640 1 -- 172.21.15.144:0/2757994284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0330006110 msgr2=0x7f034c1f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034b200640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0330006110 0x7f034c1f0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034b200640 1 -- 172.21.15.144:0/2757994284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f034c15e2c0 msgr2=0x7f034c14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034b200640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f034c15e2c0 0x7f034c14ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034b200640 1 -- 172.21.15.144:0/2757994284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c157b50 con 0x7f034c0d0df0 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.248+0000 7f034a800640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0330006110 0x7f034c1f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f034b200640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f034c0d0df0 0x7f034c072130 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f034c06f1c0 tx=0x7f0344007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f0342a00640 1 -- 172.21.15.144:0/2757994284 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034400abc0 con 0x7f034c0d0df0 2024-09-12T12:24:17.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f0342a00640 1 -- 172.21.15.144:0/2757994284 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0344018070 con 0x7f034c0d0df0 2024-09-12T12:24:17.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f0342a00640 1 -- 172.21.15.144:0/2757994284 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03440133f0 con 0x7f034c0d0df0 2024-09-12T12:24:17.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034c157e30 con 0x7f034c0d0df0 2024-09-12T12:24:17.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034c157800 con 0x7f034c0d0df0 2024-09-12T12:24:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f034c0ce680 con 0x7f034c0d0df0 2024-09-12T12:24:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f0342a00640 1 -- 172.21.15.144:0/2757994284 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0344013590 con 0x7f034c0d0df0 2024-09-12T12:24:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f0342a00640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f032c0678f0 0x7f032c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f0342a00640 1 -- 172.21.15.144:0/2757994284 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 6101+0+0 (secure 0 0 0) 0x7f0344086310 con 0x7f034c0d0df0 2024-09-12T12:24:17.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.252+0000 7f034a800640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f032c0678f0 0x7f032c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:17.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.256+0000 7f034a800640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f032c0678f0 0x7f032c069db0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f034c14ef20 tx=0x7f033c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:17.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.260+0000 7f0342a00640 1 -- 172.21.15.144:0/2757994284 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0344056ca0 con 0x7f034c0d0df0 2024-09-12T12:24:17.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:17.452+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f034c154e00 con 0x7f034c0d0df0 2024-09-12T12:24:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.396+0000 7f0342a00640 1 -- 172.21.15.144:0/2757994284 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v135) ==== 118+0+0 (secure 0 0 0) 0x7f03440565a0 con 0x7f034c0d0df0 2024-09-12T12:24:18.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f032c0678f0 msgr2=0x7f032c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f032c0678f0 0x7f032c069db0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f034c14ef20 tx=0x7f033c008040 comp rx=0 tx=0).stop 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f034c0d0df0 msgr2=0x7f034c072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f034c0d0df0 0x7f034c072130 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f034c06f1c0 tx=0x7f0344007b00 comp rx=0 tx=0).stop 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 shutdown_connections 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f032c0678f0 0x7f032c069db0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f034c0d0df0 0x7f034c072130 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f034c15e2c0 0x7f034c14ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 --2- 172.21.15.144:0/2757994284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0330006110 0x7f034c1f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 >> 172.21.15.144:0/2757994284 conn(0x7f034c068030 msgr2=0x7f034c0b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 shutdown_connections 2024-09-12T12:24:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.400+0000 7f0351400640 1 -- 172.21.15.144:0/2757994284 wait complete. 2024-09-12T12:24:18.421 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:24:18.422 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:24:18.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f0595600640 1 Processor -- start 2024-09-12T12:24:18.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f0595600640 1 -- start start 2024-09-12T12:24:18.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f0595600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05900cd9f0 0x7f059006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f0595600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05900b4300 con 0x7f059015b340 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f0595600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05900b3540 con 0x7f059015af60 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f0595600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05900b32f0 con 0x7f05900cd9f0 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f059015b340 0x7f05900b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53078/0 (socket says 172.21.15.144:53078) 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058f400640 1 -- 172.21.15.144:0/93651515 learned_addr learned my addr 172.21.15.144:0/93651515 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058e000640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05900cd9f0 0x7f059006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741026058 0 0) 0x7f05900b4300 con 0x7f059015b340 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0574003530 con 0x7f059015b340 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793993558 0 0) 0x7f05900b3540 con 0x7f059015af60 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05900b4300 con 0x7f059015af60 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3007643264 0 0) 0x7f0574003530 con 0x7f059015b340 2024-09-12T12:24:18.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05900cd9f0 msgr2=0x7f059006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05900cd9f0 0x7f059006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 >> v1:172.21.15.165:6789/0 conn(0x7f059015af60 legacy=0x7f05900ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05900b3820 con 0x7f059015b340 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f0588001680 con 0x7f059015b340 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 >> v1:172.21.15.144:6789/0 conn(0x7f059015b340 legacy=0x7f05900b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05900cd9f0 0x7f0574003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05740040e0 0x7f0574004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0574004d50 0x7f05740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05900b32f0 con 0x7f05740040e0 2024-09-12T12:24:18.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f057400bab0 con 0x7f0574004d50 2024-09-12T12:24:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f057400bcb0 con 0x7f05900cd9f0 2024-09-12T12:24:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058e000640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05740040e0 0x7f0574004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058ea00640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05900cd9f0 0x7f0574003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.564+0000 7f058f400640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0574004d50 0x7f05740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058e000640 1 -- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05900cd9f0 msgr2=0x7f0574003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058e000640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05900cd9f0 0x7f0574003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058e000640 1 -- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0574004d50 msgr2=0x7f05740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058e000640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0574004d50 0x7f05740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058e000640 1 -- 172.21.15.144:0/93651515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0574003530 con 0x7f05740040e0 2024-09-12T12:24:18.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058e000640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05740040e0 0x7f0574004810 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f057c009ab0 tx=0x7f057c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509493b8528b7616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:18.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0b2070 con 0x7f05740040e0 2024-09-12T12:24:18.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c0a5530 con 0x7f05740040e0 2024-09-12T12:24:18.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058d600640 1 -- 172.21.15.144:0/93651515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c0096b0 con 0x7f05740040e0 2024-09-12T12:24:18.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f0595600640 1 -- 172.21.15.144:0/93651515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05740040e0 msgr2=0x7f0574004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f0595600640 1 --2- 172.21.15.144:0/93651515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05740040e0 0x7f0574004810 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f057c009ab0 tx=0x7f057c01ca50 comp rx=0 tx=0).stop 2024-09-12T12:24:18.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f058f400640 1 -- 172.21.15.144:0/93651515 reap_dead start 2024-09-12T12:24:18.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f0595600640 1 -- 172.21.15.144:0/93651515 shutdown_connections 2024-09-12T12:24:18.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f0595600640 1 -- 172.21.15.144:0/93651515 >> 172.21.15.144:0/93651515 conn(0x7f0590068030 msgr2=0x7f05900b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:18.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f0595600640 1 -- 172.21.15.144:0/93651515 shutdown_connections 2024-09-12T12:24:18.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.568+0000 7f0595600640 1 -- 172.21.15.144:0/93651515 wait complete. 2024-09-12T12:24:18.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 Processor -- start 2024-09-12T12:24:18.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 -- start start 2024-09-12T12:24:18.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05740040e0 0x7f0590144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0590141610 0x7f0590073a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f059016a380 0x7f059016a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f059006bc10 con 0x7f059016a380 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05900b3de0 con 0x7f0590141610 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f059006bd90 con 0x7f05740040e0 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f059016a380 0x7f059016a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f059016a380 0x7f059016a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36372/0 (socket says 172.21.15.144:36372) 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05740040e0 0x7f0590144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058f400640 1 -- 172.21.15.144:0/3432413213 learned_addr learned my addr 172.21.15.144:0/3432413213 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058e000640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0590141610 0x7f0590073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058f400640 1 -- 172.21.15.144:0/3432413213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05740040e0 msgr2=0x7f0590144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058f400640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05740040e0 0x7f0590144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058f400640 1 -- 172.21.15.144:0/3432413213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0590141610 msgr2=0x7f0590073a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:18.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058f400640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0590141610 0x7f0590073a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:18.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058f400640 1 -- 172.21.15.144:0/3432413213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0590141db0 con 0x7f059016a380 2024-09-12T12:24:18.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058ea00640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05740040e0 0x7f0590144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:18.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f058f400640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f059016a380 0x7f059016a810 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f0588000c10 tx=0x7f0588011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:18.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0586a00640 1 -- 172.21.15.144:0/3432413213 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588010040 con 0x7f059016a380 2024-09-12T12:24:18.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0586a00640 1 -- 172.21.15.144:0/3432413213 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f058801a070 con 0x7f059016a380 2024-09-12T12:24:18.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059015dbe0 con 0x7f059016a380 2024-09-12T12:24:18.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0586a00640 1 -- 172.21.15.144:0/3432413213 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588013a20 con 0x7f059016a380 2024-09-12T12:24:18.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.572+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0590169b80 con 0x7f059016a380 2024-09-12T12:24:18.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.576+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f059006c1c0 con 0x7f059016a380 2024-09-12T12:24:18.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.576+0000 7f0586a00640 1 -- 172.21.15.144:0/3432413213 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0588013bc0 con 0x7f059016a380 2024-09-12T12:24:18.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.576+0000 7f0586a00640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05700678c0 0x7f0570069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:18.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.576+0000 7f0586a00640 1 -- 172.21.15.144:0/3432413213 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f0588088c40 con 0x7f059016a380 2024-09-12T12:24:18.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.576+0000 7f058ea00640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05700678c0 0x7f0570069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:18.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.576+0000 7f058ea00640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05700678c0 0x7f0570069d80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0580002240 tx=0x7f0580009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:18.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.580+0000 7f0586a00640 1 -- 172.21.15.144:0/3432413213 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0588058f10 con 0x7f059016a380 2024-09-12T12:24:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:18.772+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f05900afc20 con 0x7f059016a380 2024-09-12T12:24:19.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.396+0000 7f0586a00640 1 -- 172.21.15.144:0/3432413213 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v136) ==== 122+0+0 (secure 0 0 0) 0x7f058805d210 con 0x7f059016a380 2024-09-12T12:24:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05700678c0 msgr2=0x7f0570069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05700678c0 0x7f0570069d80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0580002240 tx=0x7f0580009040 comp rx=0 tx=0).stop 2024-09-12T12:24:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f059016a380 msgr2=0x7f059016a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f059016a380 0x7f059016a810 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f0588000c10 tx=0x7f0588011a70 comp rx=0 tx=0).stop 2024-09-12T12:24:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 shutdown_connections 2024-09-12T12:24:19.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f05700678c0 0x7f0570069d80 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f059016a380 0x7f059016a810 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0590141610 0x7f0590073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 --2- 172.21.15.144:0/3432413213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05740040e0 0x7f0590144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 >> 172.21.15.144:0/3432413213 conn(0x7f0590068030 msgr2=0x7f05900b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:19.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 shutdown_connections 2024-09-12T12:24:19.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.400+0000 7f0595600640 1 -- 172.21.15.144:0/3432413213 wait complete. 2024-09-12T12:24:19.420 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:24:19.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:19.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.556+0000 7ff0b4200640 1 Processor -- start 2024-09-12T12:24:19.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.556+0000 7ff0b4200640 1 -- start start 2024-09-12T12:24:19.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b4200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0ac15c7b0 0x7ff0ac0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b4200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff0ac0b5fb0 0x7ff0ac072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b4200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0ac0cd870 con 0x7ff0ac15cd30 2024-09-12T12:24:19.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b4200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff0ac072a50 con 0x7ff0ac15c7b0 2024-09-12T12:24:19.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b4200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff0ac0cde30 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0ac15c7b0 0x7ff0ac0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0ac15c7b0 0x7ff0ac0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36380/0 (socket says 172.21.15.144:36380) 2024-09-12T12:24:19.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b1800640 1 -- 172.21.15.144:0/3527528650 learned_addr learned my addr 172.21.15.144:0/3527528650 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b2200640 1 --2- 172.21.15.144:0/3527528650 >> v2:172.21.15.165:3300/0 conn(0x7ff0ac0b5fb0 0x7ff0ac072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b1800640 1 -- 172.21.15.144:0/3527528650 >> v2:172.21.15.165:3300/0 conn(0x7ff0ac0b5fb0 msgr2=0x7ff0ac072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b1800640 1 --2- 172.21.15.144:0/3527528650 >> v2:172.21.15.165:3300/0 conn(0x7ff0ac0b5fb0 0x7ff0ac072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b1800640 1 -- 172.21.15.144:0/3527528650 >> v1:172.21.15.165:6789/0 conn(0x7ff0ac15cd30 legacy=0x7ff0ac0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b1800640 1 -- 172.21.15.144:0/3527528650 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac0cdb50 con 0x7ff0ac15c7b0 2024-09-12T12:24:19.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.560+0000 7ff0b2200640 1 --2- 172.21.15.144:0/3527528650 >> v2:172.21.15.165:3300/0 conn(0x7ff0ac0b5fb0 0x7ff0ac072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b1800640 1 --2- 172.21.15.144:0/3527528650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac15c7b0 0x7ff0ac0ccf00 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0d0480 tx=0x7ff0a001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2990e2bd28215a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0abe00640 1 -- 172.21.15.144:0/3527528650 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00a5780 con 0x7ff0ac15c7b0 2024-09-12T12:24:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0abe00640 1 -- 172.21.15.144:0/3527528650 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a00a5920 con 0x7ff0ac15c7b0 2024-09-12T12:24:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0abe00640 1 -- 172.21.15.144:0/3527528650 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00a5cf0 con 0x7ff0ac15c7b0 2024-09-12T12:24:19.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 -- 172.21.15.144:0/3527528650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac15c7b0 msgr2=0x7ff0ac0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 --2- 172.21.15.144:0/3527528650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac15c7b0 0x7ff0ac0ccf00 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0d0480 tx=0x7ff0a001c9b0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 -- 172.21.15.144:0/3527528650 shutdown_connections 2024-09-12T12:24:19.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 --2- 172.21.15.144:0/3527528650 >> v2:172.21.15.165:3300/0 conn(0x7ff0ac0b5fb0 0x7ff0ac072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 --2- 172.21.15.144:0/3527528650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac15c7b0 0x7ff0ac0ccf00 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 -- 172.21.15.144:0/3527528650 >> 172.21.15.144:0/3527528650 conn(0x7ff0ac06d0d0 msgr2=0x7ff0ac06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:19.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 -- 172.21.15.144:0/3527528650 shutdown_connections 2024-09-12T12:24:19.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 -- 172.21.15.144:0/3527528650 wait complete. 2024-09-12T12:24:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 Processor -- start 2024-09-12T12:24:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.564+0000 7ff0b4200640 1 -- start start 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b4200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac0b5fb0 0x7ff0ac1fb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0ac15c7b0 0x7ff0ac143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b4200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0ac15cd30 0x7ff0ac0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b4200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac073fc0 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b4200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac073e40 con 0x7ff0ac15cd30 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ac074140 con 0x7ff0ac15c7b0 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac0b5fb0 0x7ff0ac1fb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac0b5fb0 0x7ff0ac1fb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36394/0 (socket says 172.21.15.144:36394) 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b1800640 1 -- 172.21.15.144:0/194600728 learned_addr learned my addr 172.21.15.144:0/194600728 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:19.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b2200640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0ac15cd30 0x7ff0ac0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b0e00640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0ac15c7b0 0x7ff0ac143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b1800640 1 -- 172.21.15.144:0/194600728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0ac15c7b0 msgr2=0x7ff0ac143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b1800640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0ac15c7b0 0x7ff0ac143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b1800640 1 -- 172.21.15.144:0/194600728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0ac15cd30 msgr2=0x7ff0ac0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b1800640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0ac15cd30 0x7ff0ac0b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b1800640 1 -- 172.21.15.144:0/194600728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac1537b0 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b1800640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac0b5fb0 0x7ff0ac1fb5c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00af040 tx=0x7ff0a0019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0a9600640 1 -- 172.21.15.144:0/194600728 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00b8470 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0a9600640 1 -- 172.21.15.144:0/194600728 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a00b8610 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ac159c90 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0a9600640 1 -- 172.21.15.144:0/194600728 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00b8a00 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ac159f10 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.568+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0ac072ee0 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.572+0000 7ff0a9600640 1 -- 172.21.15.144:0/194600728 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff0a00c0030 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.572+0000 7ff0a9600640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff08c0678c0 0x7ff08c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.572+0000 7ff0a9600640 1 -- 172.21.15.144:0/194600728 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7ff0a0120ac0 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.572+0000 7ff0b0e00640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff08c0678c0 0x7ff08c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.572+0000 7ff0b0e00640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff08c0678c0 0x7ff08c069d80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0af5d0 tx=0x7ff098009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:19.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.576+0000 7ff0a9600640 1 -- 172.21.15.144:0/194600728 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff0a00c7020 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0ac158570 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0a9600640 1 -- 172.21.15.144:0/194600728 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5242 (secure 0 0 0) 0x7ff0ac159c90 con 0x7ff0ac0b5fb0 2024-09-12T12:24:19.769 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:19.769 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":136,"btime":"2024-09-12T12:24:19:399460+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8132,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2178161495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2178161495},{"type":"v1","addr":"172.21.15.144:6835","nonce":2178161495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2493299621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2493299621},{"type":"v1","addr":"172.21.15.165:6835","nonce":2493299621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131},{"gid":9256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2468859076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2468859076},{"type":"v1","addr":"172.21.15.165:6834","nonce":2468859076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:24:15.762976+0000","modified":"2024-09-12T12:24:18.778051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9795":{"gid":9795,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/249899092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":249899092},{"type":"v1","addr":"172.21.15.144:6837","nonce":249899092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9795,"qdb_cluster":[9795]},"id":12}]} 2024-09-12T12:24:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 136 2024-09-12T12:24:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff08c0678c0 msgr2=0x7ff08c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff08c0678c0 0x7ff08c069d80 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0af5d0 tx=0x7ff098009060 comp rx=0 tx=0).stop 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac0b5fb0 msgr2=0x7ff0ac1fb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac0b5fb0 0x7ff0ac1fb5c0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00af040 tx=0x7ff0a0019750 comp rx=0 tx=0).stop 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 shutdown_connections 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff08c0678c0 0x7ff08c069d80 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0ac15cd30 0x7ff0ac0b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff0ac15c7b0 0x7ff0ac143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 --2- 172.21.15.144:0/194600728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0ac0b5fb0 0x7ff0ac1fb5c0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 >> 172.21.15.144:0/194600728 conn(0x7ff0ac06d0d0 msgr2=0x7ff0ac0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 shutdown_connections 2024-09-12T12:24:19.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.768+0000 7ff0b4200640 1 -- 172.21.15.144:0/194600728 wait complete. 2024-09-12T12:24:19.789 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:24:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9eaaa00640 1 Processor -- start 2024-09-12T12:24:19.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9eaaa00640 1 -- start start 2024-09-12T12:24:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9eaaa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea4071420 0x7f9ea4071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9eaaa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9ea40ccf30 0x7f9ea40cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9eaaa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea40b45a0 con 0x7f9ea415b4e0 2024-09-12T12:24:19.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9eaaa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea40b3fe0 con 0x7f9ea40ccf30 2024-09-12T12:24:19.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9eaaa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea40b42c0 con 0x7f9ea4071420 2024-09-12T12:24:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9e9be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea4071420 0x7f9ea4071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9e9be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea4071420 0x7f9ea4071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:46592/0 (socket says 172.21.15.144:46592) 2024-09-12T12:24:19.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9e9be00640 1 -- 172.21.15.144:0/3902002831 learned_addr learned my addr 172.21.15.144:0/3902002831 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.924+0000 7f9ea8a00640 1 --2- 172.21.15.144:0/3902002831 >> v2:172.21.15.165:3300/0 conn(0x7f9ea40ccf30 0x7f9ea40cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.928+0000 7f9e9be00640 1 -- 172.21.15.144:0/3902002831 >> v2:172.21.15.165:3300/0 conn(0x7f9ea40ccf30 msgr2=0x7f9ea40cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.928+0000 7f9e9be00640 1 --2- 172.21.15.144:0/3902002831 >> v2:172.21.15.165:3300/0 conn(0x7f9ea40ccf30 0x7f9ea40cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.928+0000 7f9e9be00640 1 -- 172.21.15.144:0/3902002831 >> v1:172.21.15.165:6789/0 conn(0x7f9ea415b4e0 legacy=0x7f9ea40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.928+0000 7f9e9be00640 1 -- 172.21.15.144:0/3902002831 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea40b1490 con 0x7f9ea4071420 2024-09-12T12:24:19.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.928+0000 7f9e9be00640 1 --2- 172.21.15.144:0/3902002831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea4071420 0x7f9ea4071840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009870 tx=0x7f9e8c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb2d8889081742a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.928+0000 7f9ea3400640 1 -- 172.21.15.144:0/3902002831 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0b1070 con 0x7f9ea4071420 2024-09-12T12:24:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.928+0000 7f9ea3400640 1 -- 172.21.15.144:0/3902002831 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c0a8050 con 0x7f9ea4071420 2024-09-12T12:24:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.928+0000 7f9ea3400640 1 -- 172.21.15.144:0/3902002831 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0ac860 con 0x7f9ea4071420 2024-09-12T12:24:19.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 -- 172.21.15.144:0/3902002831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea4071420 msgr2=0x7f9ea4071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 --2- 172.21.15.144:0/3902002831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea4071420 0x7f9ea4071840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009870 tx=0x7f9e8c01c560 comp rx=0 tx=0).stop 2024-09-12T12:24:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 -- 172.21.15.144:0/3902002831 shutdown_connections 2024-09-12T12:24:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 --2- 172.21.15.144:0/3902002831 >> v2:172.21.15.165:3300/0 conn(0x7f9ea40ccf30 0x7f9ea40cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 --2- 172.21.15.144:0/3902002831 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea4071420 0x7f9ea4071840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 -- 172.21.15.144:0/3902002831 >> 172.21.15.144:0/3902002831 conn(0x7f9ea406d0d0 msgr2=0x7f9ea406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 -- 172.21.15.144:0/3902002831 shutdown_connections 2024-09-12T12:24:19.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 -- 172.21.15.144:0/3902002831 wait complete. 2024-09-12T12:24:19.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 Processor -- start 2024-09-12T12:24:19.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 -- start start 2024-09-12T12:24:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea4071420 0x7f9ea40af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40ccf30 0x7f9ea40cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415b4e0 0x7f9ea414c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea415b8c0 con 0x7f9ea415b4e0 2024-09-12T12:24:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea40b02e0 con 0x7f9ea4071420 2024-09-12T12:24:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9eaaa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea415dda0 con 0x7f9ea40ccf30 2024-09-12T12:24:19.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9ea8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415b4e0 0x7f9ea414c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9ea3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea4071420 0x7f9ea40af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9ea8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415b4e0 0x7f9ea414c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36408/0 (socket says 172.21.15.144:36408) 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9ea3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea4071420 0x7f9ea40af3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:58948/0 (socket says 172.21.15.144:58948) 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9ea8a00640 1 -- 172.21.15.144:0/550664029 learned_addr learned my addr 172.21.15.144:0/550664029 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.932+0000 7f9e9be00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40ccf30 0x7f9ea40cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea8a00640 1 -- 172.21.15.144:0/550664029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40ccf30 msgr2=0x7f9ea40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea8a00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40ccf30 0x7f9ea40cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea8a00640 1 -- 172.21.15.144:0/550664029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea4071420 msgr2=0x7f9ea40af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea8a00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea4071420 0x7f9ea40af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea8a00640 1 -- 172.21.15.144:0/550664029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea414c6f0 con 0x7f9ea415b4e0 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea3e00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea4071420 0x7f9ea40af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:19.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea8a00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415b4e0 0x7f9ea414c1b0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00efc0 tx=0x7f9e9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:19.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea0c00640 1 -- 172.21.15.144:0/550664029 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c018020 con 0x7f9ea415b4e0 2024-09-12T12:24:19.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea0c00640 1 -- 172.21.15.144:0/550664029 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c014480 con 0x7f9ea415b4e0 2024-09-12T12:24:19.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea0c00640 1 -- 172.21.15.144:0/550664029 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c014870 con 0x7f9ea415b4e0 2024-09-12T12:24:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea415dff0 con 0x7f9ea415b4e0 2024-09-12T12:24:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea40aebb0 con 0x7f9ea415b4e0 2024-09-12T12:24:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea4071840 con 0x7f9ea415b4e0 2024-09-12T12:24:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea0c00640 1 -- 172.21.15.144:0/550664029 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e9c01b020 con 0x7f9ea415b4e0 2024-09-12T12:24:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea0c00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea0c00640 1 -- 172.21.15.144:0/550664029 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f9e9c086850 con 0x7f9ea415b4e0 2024-09-12T12:24:19.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.936+0000 7f9ea3e00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:19.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.940+0000 7f9ea3e00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9e94001b60 tx=0x7f9e94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:19.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:19.940+0000 7f9ea0c00640 1 -- 172.21.15.144:0/550664029 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e9c022070 con 0x7f9ea415b4e0 2024-09-12T12:24:20.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.100+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ea40cd430 con 0x7f9ea415b4e0 2024-09-12T12:24:20.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.100+0000 7f9ea0c00640 1 -- 172.21.15.144:0/550664029 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16972 (secure 0 0 0) 0x7f9e9c010040 con 0x7f9ea415b4e0 2024-09-12T12:24:20.101 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:20.101 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":176,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:24:17.371342+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:24:13.519279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-12T12:24:14.760733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:20.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 msgr2=0x7f9e80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9e94001b60 tx=0x7f9e94009040 comp rx=0 tx=0).stop 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415b4e0 msgr2=0x7f9ea414c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415b4e0 0x7f9ea414c1b0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00efc0 tx=0x7f9e9c00c490 comp rx=0 tx=0).stop 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 shutdown_connections 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9e800678c0 0x7f9e80069d80 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea415b4e0 0x7f9ea414c1b0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea40ccf30 0x7f9ea40cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 --2- 172.21.15.144:0/550664029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea4071420 0x7f9ea40af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 >> 172.21.15.144:0/550664029 conn(0x7f9ea406d0d0 msgr2=0x7f9ea41658c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:20.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 shutdown_connections 2024-09-12T12:24:20.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.104+0000 7f9eaaa00640 1 -- 172.21.15.144:0/550664029 wait complete. 2024-09-12T12:24:20.123 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:24:20.124 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:24:20.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e9e00640 1 Processor -- start 2024-09-12T12:24:20.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e9e00640 1 -- start start 2024-09-12T12:24:20.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59e4071420 0x7f59e4071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f59e40ccf30 0x7f59e40cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e9e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e40cd890 con 0x7f59e415b4e0 2024-09-12T12:24:20.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e9e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f59e40b45a0 con 0x7f59e4071420 2024-09-12T12:24:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e9e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f59e40b3fe0 con 0x7f59e40ccf30 2024-09-12T12:24:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59e4071420 0x7f59e4071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59e4071420 0x7f59e4071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36420/0 (socket says 172.21.15.144:36420) 2024-09-12T12:24:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e2000640 1 -- 172.21.15.144:0/2610170822 learned_addr learned my addr 172.21.15.144:0/2610170822 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e3400640 1 --2- 172.21.15.144:0/2610170822 >> v2:172.21.15.165:3300/0 conn(0x7f59e40ccf30 0x7f59e40cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e2000640 1 -- 172.21.15.144:0/2610170822 >> v2:172.21.15.165:3300/0 conn(0x7f59e40ccf30 msgr2=0x7f59e40cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:20.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e2000640 1 --2- 172.21.15.144:0/2610170822 >> v2:172.21.15.165:3300/0 conn(0x7f59e40ccf30 0x7f59e40cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e2000640 1 -- 172.21.15.144:0/2610170822 >> v1:172.21.15.165:6789/0 conn(0x7f59e415b4e0 legacy=0x7f59e40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.260+0000 7f59e2000640 1 -- 172.21.15.144:0/2610170822 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e40b42c0 con 0x7f59e4071420 2024-09-12T12:24:20.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e2000640 1 --2- 172.21.15.144:0/2610170822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 0x7f59e4071840 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f59e40d0480 tx=0x7f59d001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141b1e4b3057ba9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e1600640 1 -- 172.21.15.144:0/2610170822 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00aa650 con 0x7f59e4071420 2024-09-12T12:24:20.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e1600640 1 -- 172.21.15.144:0/2610170822 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d00af070 con 0x7f59e4071420 2024-09-12T12:24:20.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e1600640 1 -- 172.21.15.144:0/2610170822 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00aaa10 con 0x7f59e4071420 2024-09-12T12:24:20.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e9e00640 1 -- 172.21.15.144:0/2610170822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 msgr2=0x7f59e4071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e9e00640 1 --2- 172.21.15.144:0/2610170822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 0x7f59e4071840 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f59e40d0480 tx=0x7f59d001c4f0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e9e00640 1 -- 172.21.15.144:0/2610170822 shutdown_connections 2024-09-12T12:24:20.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e9e00640 1 --2- 172.21.15.144:0/2610170822 >> v2:172.21.15.165:3300/0 conn(0x7f59e40ccf30 0x7f59e40cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e9e00640 1 --2- 172.21.15.144:0/2610170822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 0x7f59e4071840 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e9e00640 1 -- 172.21.15.144:0/2610170822 >> 172.21.15.144:0/2610170822 conn(0x7f59e406d0d0 msgr2=0x7f59e406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e9e00640 1 -- 172.21.15.144:0/2610170822 shutdown_connections 2024-09-12T12:24:20.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.264+0000 7f59e9e00640 1 -- 172.21.15.144:0/2610170822 wait complete. 2024-09-12T12:24:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 Processor -- start 2024-09-12T12:24:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 -- start start 2024-09-12T12:24:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 0x7f59e40d1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59e40ccf30 0x7f59e40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59e415b4e0 0x7f59e4156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59e415b8c0 con 0x7f59e4071420 2024-09-12T12:24:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59e40cdef0 con 0x7f59e415b4e0 2024-09-12T12:24:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59e40b0de0 con 0x7f59e40ccf30 2024-09-12T12:24:20.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 0x7f59e40d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 0x7f59e40d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36422/0 (socket says 172.21.15.144:36422) 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2a00640 1 -- 172.21.15.144:0/827493111 learned_addr learned my addr 172.21.15.144:0/827493111 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2000640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59e40ccf30 0x7f59e40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e3400640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59e415b4e0 0x7f59e4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2a00640 1 -- 172.21.15.144:0/827493111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59e40ccf30 msgr2=0x7f59e40cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2a00640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59e40ccf30 0x7f59e40cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2a00640 1 -- 172.21.15.144:0/827493111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59e415b4e0 msgr2=0x7f59e4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2a00640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59e415b4e0 0x7f59e4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2a00640 1 -- 172.21.15.144:0/827493111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e40d07b0 con 0x7f59e4071420 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e2a00640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 0x7f59e40d1290 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c730 tx=0x7f59d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59db400640 1 -- 172.21.15.144:0/827493111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4016020 con 0x7f59e4071420 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59db400640 1 -- 172.21.15.144:0/827493111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d4006d60 con 0x7f59e4071420 2024-09-12T12:24:20.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e40d0a90 con 0x7f59e4071420 2024-09-12T12:24:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59db400640 1 -- 172.21.15.144:0/827493111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4003bc0 con 0x7f59e4071420 2024-09-12T12:24:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e40af3d0 con 0x7f59e4071420 2024-09-12T12:24:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.268+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e4071840 con 0x7f59e4071420 2024-09-12T12:24:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.272+0000 7f59db400640 1 -- 172.21.15.144:0/827493111 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59d400a850 con 0x7f59e4071420 2024-09-12T12:24:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.272+0000 7f59db400640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59c40678c0 0x7f59c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.272+0000 7f59db400640 1 -- 172.21.15.144:0/827493111 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f59d4086670 con 0x7f59e4071420 2024-09-12T12:24:20.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.272+0000 7f59e2000640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59c40678c0 0x7f59c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.272+0000 7f59e2000640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59c40678c0 0x7f59c4069d80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f59d00ae000 tx=0x7f59d00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.276+0000 7f59db400640 1 -- 172.21.15.144:0/827493111 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59d4020020 con 0x7f59e4071420 2024-09-12T12:24:20.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.432+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59e40d0fb0 con 0x7f59c40678c0 2024-09-12T12:24:20.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.440+0000 7f59db400640 1 -- 172.21.15.144:0/827493111 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251112 (secure 0 0 0) 0x7f59e40d0fb0 con 0x7f59c40678c0 2024-09-12T12:24:20.443 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:20.445 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:24:20.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59c40678c0 msgr2=0x7f59c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59c40678c0 0x7f59c4069d80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f59d00ae000 tx=0x7f59d00a7000 comp rx=0 tx=0).stop 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 msgr2=0x7f59e40d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 0x7f59e40d1290 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c730 tx=0x7f59d400cbf0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 shutdown_connections 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59c40678c0 0x7f59c4069d80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59e415b4e0 0x7f59e4156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59e40ccf30 0x7f59e40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 --2- 172.21.15.144:0/827493111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e4071420 0x7f59e40d1290 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 >> 172.21.15.144:0/827493111 conn(0x7f59e406d0d0 msgr2=0x7f59e4072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 shutdown_connections 2024-09-12T12:24:20.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.444+0000 7f59e9e00640 1 -- 172.21.15.144:0/827493111 wait complete. 2024-09-12T12:24:20.463 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-12T12:24:19.524894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592106,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":445664,"kb_used_data":18484,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754529056,"statfs":{"total":773094113280,"available":772637753344,"internally_reserved":0,"allocated":18927616,"data_stored":9544742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.162310"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376298+0000","last_change":"2024-09-12T12:24:16.395627+0000","last_active":"2024-09-12T12:24:17.376298+0000","last_peered":"2024-09-12T12:24:17.376298+0000","last_clean":"2024-09-12T12:24:17.376298+0000","last_became_active":"2024-09-12T12:24:16.395322+0000","last_became_peered":"2024-09-12T12:24:16.395322+0000","last_unstale":"2024-09-12T12:24:17.376298+0000","last_undegraded":"2024-09-12T12:24:17.376298+0000","last_fullsized":"2024-09-12T12:24:17.376298+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:16.943178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376308+0000","last_change":"2024-09-12T12:24:16.399843+0000","last_active":"2024-09-12T12:24:17.376308+0000","last_peered":"2024-09-12T12:24:17.376308+0000","last_clean":"2024-09-12T12:24:17.376308+0000","last_became_active":"2024-09-12T12:24:16.399540+0000","last_became_peered":"2024-09-12T12:24:16.399540+0000","last_unstale":"2024-09-12T12:24:17.376308+0000","last_undegraded":"2024-09-12T12:24:17.376308+0000","last_fullsized":"2024-09-12T12:24:17.376308+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:18.125453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376939+0000","last_change":"2024-09-12T12:24:16.390401+0000","last_active":"2024-09-12T12:24:17.376939+0000","last_peered":"2024-09-12T12:24:17.376939+0000","last_clean":"2024-09-12T12:24:17.376939+0000","last_became_active":"2024-09-12T12:24:16.390125+0000","last_became_peered":"2024-09-12T12:24:16.390125+0000","last_unstale":"2024-09-12T12:24:17.376939+0000","last_undegraded":"2024-09-12T12:24:17.376939+0000","last_fullsized":"2024-09-12T12:24:17.376939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:13.958791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614197+0000","last_change":"2024-09-12T12:24:16.397905+0000","last_active":"2024-09-12T12:24:18.614197+0000","last_peered":"2024-09-12T12:24:18.614197+0000","last_clean":"2024-09-12T12:24:18.614197+0000","last_became_active":"2024-09-12T12:24:16.397631+0000","last_became_peered":"2024-09-12T12:24:16.397631+0000","last_unstale":"2024-09-12T12:24:18.614197+0000","last_undegraded":"2024-09-12T12:24:18.614197+0000","last_fullsized":"2024-09-12T12:24:18.614197+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:19.720611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614055+0000","last_change":"2024-09-12T12:24:16.405121+0000","last_active":"2024-09-12T12:24:18.614055+0000","last_peered":"2024-09-12T12:24:18.614055+0000","last_clean":"2024-09-12T12:24:18.614055+0000","last_became_active":"2024-09-12T12:24:16.404807+0000","last_became_peered":"2024-09-12T12:24:16.404807+0000","last_unstale":"2024-09-12T12:24:18.614055+0000","last_undegraded":"2024-09-12T12:24:18.614055+0000","last_fullsized":"2024-09-12T12:24:18.614055+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:46.225664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402195+0000","last_change":"2024-09-12T12:24:16.396455+0000","last_active":"2024-09-12T12:24:17.402195+0000","last_peered":"2024-09-12T12:24:17.402195+0000","last_clean":"2024-09-12T12:24:17.402195+0000","last_became_active":"2024-09-12T12:24:16.396163+0000","last_became_peered":"2024-09-12T12:24:16.396163+0000","last_unstale":"2024-09-12T12:24:17.402195+0000","last_undegraded":"2024-09-12T12:24:17.402195+0000","last_fullsized":"2024-09-12T12:24:17.402195+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:51.534062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614642+0000","last_change":"2024-09-12T12:24:16.398847+0000","last_active":"2024-09-12T12:24:18.614642+0000","last_peered":"2024-09-12T12:24:18.614642+0000","last_clean":"2024-09-12T12:24:18.614642+0000","last_became_active":"2024-09-12T12:24:16.398566+0000","last_became_peered":"2024-09-12T12:24:16.398566+0000","last_unstale":"2024-09-12T12:24:18.614642+0000","last_undegraded":"2024-09-12T12:24:18.614642+0000","last_fullsized":"2024-09-12T12:24:18.614642+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:18.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376446+0000","last_change":"2024-09-12T12:24:16.387534+0000","last_active":"2024-09-12T12:24:17.376446+0000","last_peered":"2024-09-12T12:24:17.376446+0000","last_clean":"2024-09-12T12:24:17.376446+0000","last_became_active":"2024-09-12T12:24:16.387258+0000","last_became_peered":"2024-09-12T12:24:16.387258+0000","last_unstale":"2024-09-12T12:24:17.376446+0000","last_undegraded":"2024-09-12T12:24:17.376446+0000","last_fullsized":"2024-09-12T12:24:17.376446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:40.475529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614640+0000","last_change":"2024-09-12T12:24:16.389429+0000","last_active":"2024-09-12T12:24:18.614640+0000","last_peered":"2024-09-12T12:24:18.614640+0000","last_clean":"2024-09-12T12:24:18.614640+0000","last_became_active":"2024-09-12T12:24:16.389118+0000","last_became_peered":"2024-09-12T12:24:16.389118+0000","last_unstale":"2024-09-12T12:24:18.614640+0000","last_undegraded":"2024-09-12T12:24:18.614640+0000","last_fullsized":"2024-09-12T12:24:18.614640+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:17.258071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070564+0000","last_change":"2024-09-12T12:24:16.395888+0000","last_active":"2024-09-12T12:24:18.070564+0000","last_peered":"2024-09-12T12:24:18.070564+0000","last_clean":"2024-09-12T12:24:18.070564+0000","last_became_active":"2024-09-12T12:24:16.395552+0000","last_became_peered":"2024-09-12T12:24:16.395552+0000","last_unstale":"2024-09-12T12:24:18.070564+0000","last_undegraded":"2024-09-12T12:24:18.070564+0000","last_fullsized":"2024-09-12T12:24:18.070564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:42.839292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377994+0000","last_change":"2024-09-12T12:24:16.385909+0000","last_active":"2024-09-12T12:24:17.377994+0000","last_peered":"2024-09-12T12:24:17.377994+0000","last_clean":"2024-09-12T12:24:17.377994+0000","last_became_active":"2024-09-12T12:24:16.385618+0000","last_became_peered":"2024-09-12T12:24:16.385618+0000","last_unstale":"2024-09-12T12:24:17.377994+0000","last_undegraded":"2024-09-12T12:24:17.377994+0000","last_fullsized":"2024-09-12T12:24:17.377994+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.645811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402120+0000","last_change":"2024-09-12T12:24:16.389264+0000","last_active":"2024-09-12T12:24:17.402120+0000","last_peered":"2024-09-12T12:24:17.402120+0000","last_clean":"2024-09-12T12:24:17.402120+0000","last_became_active":"2024-09-12T12:24:16.383477+0000","last_became_peered":"2024-09-12T12:24:16.383477+0000","last_unstale":"2024-09-12T12:24:17.402120+0000","last_undegraded":"2024-09-12T12:24:17.402120+0000","last_fullsized":"2024-09-12T12:24:17.402120+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:00.350364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375908+0000","last_change":"2024-09-12T12:24:16.396038+0000","last_active":"2024-09-12T12:24:17.375908+0000","last_peered":"2024-09-12T12:24:17.375908+0000","last_clean":"2024-09-12T12:24:17.375908+0000","last_became_active":"2024-09-12T12:24:16.395776+0000","last_became_peered":"2024-09-12T12:24:16.395776+0000","last_unstale":"2024-09-12T12:24:17.375908+0000","last_undegraded":"2024-09-12T12:24:17.375908+0000","last_fullsized":"2024-09-12T12:24:17.375908+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613990+0000","last_change":"2024-09-12T12:24:16.394206+0000","last_active":"2024-09-12T12:24:18.613990+0000","last_peered":"2024-09-12T12:24:18.613990+0000","last_clean":"2024-09-12T12:24:18.613990+0000","last_became_active":"2024-09-12T12:24:16.393946+0000","last_became_peered":"2024-09-12T12:24:16.393946+0000","last_unstale":"2024-09-12T12:24:18.613990+0000","last_undegraded":"2024-09-12T12:24:18.613990+0000","last_fullsized":"2024-09-12T12:24:18.613990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:33.481891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614623+0000","last_change":"2024-09-12T12:24:16.393808+0000","last_active":"2024-09-12T12:24:18.614623+0000","last_peered":"2024-09-12T12:24:18.614623+0000","last_clean":"2024-09-12T12:24:18.614623+0000","last_became_active":"2024-09-12T12:24:16.393444+0000","last_became_peered":"2024-09-12T12:24:16.393444+0000","last_unstale":"2024-09-12T12:24:18.614623+0000","last_undegraded":"2024-09-12T12:24:18.614623+0000","last_fullsized":"2024-09-12T12:24:18.614623+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:16.973624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378284+0000","last_change":"2024-09-12T12:24:16.395785+0000","last_active":"2024-09-12T12:24:17.378284+0000","last_peered":"2024-09-12T12:24:17.378284+0000","last_clean":"2024-09-12T12:24:17.378284+0000","last_became_active":"2024-09-12T12:24:16.395155+0000","last_became_peered":"2024-09-12T12:24:16.395155+0000","last_unstale":"2024-09-12T12:24:17.378284+0000","last_undegraded":"2024-09-12T12:24:17.378284+0000","last_fullsized":"2024-09-12T12:24:17.378284+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.128062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378263+0000","last_change":"2024-09-12T12:24:16.384665+0000","last_active":"2024-09-12T12:24:17.378263+0000","last_peered":"2024-09-12T12:24:17.378263+0000","last_clean":"2024-09-12T12:24:17.378263+0000","last_became_active":"2024-09-12T12:24:16.384397+0000","last_became_peered":"2024-09-12T12:24:16.384397+0000","last_unstale":"2024-09-12T12:24:17.378263+0000","last_undegraded":"2024-09-12T12:24:17.378263+0000","last_fullsized":"2024-09-12T12:24:17.378263+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:33.904641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614178+0000","last_change":"2024-09-12T12:24:16.398048+0000","last_active":"2024-09-12T12:24:18.614178+0000","last_peered":"2024-09-12T12:24:18.614178+0000","last_clean":"2024-09-12T12:24:18.614178+0000","last_became_active":"2024-09-12T12:24:16.397351+0000","last_became_peered":"2024-09-12T12:24:16.397351+0000","last_unstale":"2024-09-12T12:24:18.614178+0000","last_undegraded":"2024-09-12T12:24:18.614178+0000","last_fullsized":"2024-09-12T12:24:18.614178+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:42.510300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376118+0000","last_change":"2024-09-12T12:24:16.401679+0000","last_active":"2024-09-12T12:24:17.376118+0000","last_peered":"2024-09-12T12:24:17.376118+0000","last_clean":"2024-09-12T12:24:17.376118+0000","last_became_active":"2024-09-12T12:24:16.401427+0000","last_became_peered":"2024-09-12T12:24:16.401427+0000","last_unstale":"2024-09-12T12:24:17.376118+0000","last_undegraded":"2024-09-12T12:24:17.376118+0000","last_fullsized":"2024-09-12T12:24:17.376118+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:33.370897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376014+0000","last_change":"2024-09-12T12:24:16.389730+0000","last_active":"2024-09-12T12:24:17.376014+0000","last_peered":"2024-09-12T12:24:17.376014+0000","last_clean":"2024-09-12T12:24:17.376014+0000","last_became_active":"2024-09-12T12:24:16.388457+0000","last_became_peered":"2024-09-12T12:24:16.388457+0000","last_unstale":"2024-09-12T12:24:17.376014+0000","last_undegraded":"2024-09-12T12:24:17.376014+0000","last_fullsized":"2024-09-12T12:24:17.376014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:30.253279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614643+0000","last_change":"2024-09-12T12:24:16.408247+0000","last_active":"2024-09-12T12:24:18.614643+0000","last_peered":"2024-09-12T12:24:18.614643+0000","last_clean":"2024-09-12T12:24:18.614643+0000","last_became_active":"2024-09-12T12:24:16.406896+0000","last_became_peered":"2024-09-12T12:24:16.406896+0000","last_unstale":"2024-09-12T12:24:18.614643+0000","last_undegraded":"2024-09-12T12:24:18.614643+0000","last_fullsized":"2024-09-12T12:24:18.614643+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:41.568837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376092+0000","last_change":"2024-09-12T12:24:16.395602+0000","last_active":"2024-09-12T12:24:17.376092+0000","last_peered":"2024-09-12T12:24:17.376092+0000","last_clean":"2024-09-12T12:24:17.376092+0000","last_became_active":"2024-09-12T12:24:16.395302+0000","last_became_peered":"2024-09-12T12:24:16.395302+0000","last_unstale":"2024-09-12T12:24:17.376092+0000","last_undegraded":"2024-09-12T12:24:17.376092+0000","last_fullsized":"2024-09-12T12:24:17.376092+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:37.307464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402587+0000","last_change":"2024-09-12T12:24:16.391686+0000","last_active":"2024-09-12T12:24:17.402587+0000","last_peered":"2024-09-12T12:24:17.402587+0000","last_clean":"2024-09-12T12:24:17.402587+0000","last_became_active":"2024-09-12T12:24:16.391350+0000","last_became_peered":"2024-09-12T12:24:16.391350+0000","last_unstale":"2024-09-12T12:24:17.402587+0000","last_undegraded":"2024-09-12T12:24:17.402587+0000","last_fullsized":"2024-09-12T12:24:17.402587+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:49:56.998916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070631+0000","last_change":"2024-09-12T12:24:16.396345+0000","last_active":"2024-09-12T12:24:18.070631+0000","last_peered":"2024-09-12T12:24:18.070631+0000","last_clean":"2024-09-12T12:24:18.070631+0000","last_became_active":"2024-09-12T12:24:16.395947+0000","last_became_peered":"2024-09-12T12:24:16.395947+0000","last_unstale":"2024-09-12T12:24:18.070631+0000","last_undegraded":"2024-09-12T12:24:18.070631+0000","last_fullsized":"2024-09-12T12:24:18.070631+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:29.398497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614874+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:18.614874+0000","last_peered":"2024-09-12T12:24:18.614874+0000","last_clean":"2024-09-12T12:24:18.614874+0000","last_became_active":"2024-09-12T12:24:16.399490+0000","last_became_peered":"2024-09-12T12:24:16.399490+0000","last_unstale":"2024-09-12T12:24:18.614874+0000","last_undegraded":"2024-09-12T12:24:18.614874+0000","last_fullsized":"2024-09-12T12:24:18.614874+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:40.136783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:16.398270+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:16.397722+0000","last_became_peered":"2024-09-12T12:24:16.397722+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:26.658081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070437+0000","last_change":"2024-09-12T12:24:16.405818+0000","last_active":"2024-09-12T12:24:18.070437+0000","last_peered":"2024-09-12T12:24:18.070437+0000","last_clean":"2024-09-12T12:24:18.070437+0000","last_became_active":"2024-09-12T12:24:16.405396+0000","last_became_peered":"2024-09-12T12:24:16.405396+0000","last_unstale":"2024-09-12T12:24:18.070437+0000","last_undegraded":"2024-09-12T12:24:18.070437+0000","last_fullsized":"2024-09-12T12:24:18.070437+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:53.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070239+0000","last_change":"2024-09-12T12:24:16.407758+0000","last_active":"2024-09-12T12:24:18.070239+0000","last_peered":"2024-09-12T12:24:18.070239+0000","last_clean":"2024-09-12T12:24:18.070239+0000","last_became_active":"2024-09-12T12:24:16.407508+0000","last_became_peered":"2024-09-12T12:24:16.407508+0000","last_unstale":"2024-09-12T12:24:18.070239+0000","last_undegraded":"2024-09-12T12:24:18.070239+0000","last_fullsized":"2024-09-12T12:24:18.070239+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:08.809853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402121+0000","last_change":"2024-09-12T12:24:16.405155+0000","last_active":"2024-09-12T12:24:17.402121+0000","last_peered":"2024-09-12T12:24:17.402121+0000","last_clean":"2024-09-12T12:24:17.402121+0000","last_became_active":"2024-09-12T12:24:16.404882+0000","last_became_peered":"2024-09-12T12:24:16.404882+0000","last_unstale":"2024-09-12T12:24:17.402121+0000","last_undegraded":"2024-09-12T12:24:17.402121+0000","last_fullsized":"2024-09-12T12:24:17.402121+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:18.643188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614001+0000","last_change":"2024-09-12T12:24:16.387749+0000","last_active":"2024-09-12T12:24:18.614001+0000","last_peered":"2024-09-12T12:24:18.614001+0000","last_clean":"2024-09-12T12:24:18.614001+0000","last_became_active":"2024-09-12T12:24:16.387503+0000","last_became_peered":"2024-09-12T12:24:16.387503+0000","last_unstale":"2024-09-12T12:24:18.614001+0000","last_undegraded":"2024-09-12T12:24:18.614001+0000","last_fullsized":"2024-09-12T12:24:18.614001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:59.828091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614916+0000","last_change":"2024-09-12T12:24:16.397982+0000","last_active":"2024-09-12T12:24:18.614916+0000","last_peered":"2024-09-12T12:24:18.614916+0000","last_clean":"2024-09-12T12:24:18.614916+0000","last_became_active":"2024-09-12T12:24:16.397718+0000","last_became_peered":"2024-09-12T12:24:16.397718+0000","last_unstale":"2024-09-12T12:24:18.614916+0000","last_undegraded":"2024-09-12T12:24:18.614916+0000","last_fullsized":"2024-09-12T12:24:18.614916+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367971+0000","last_change":"2024-09-12T12:24:14.367971+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367971+0000","last_undegraded":"2024-09-12T12:24:14.367971+0000","last_fullsized":"2024-09-12T12:24:14.367971+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402547+0000","last_change":"2024-09-12T12:24:16.399030+0000","last_active":"2024-09-12T12:24:17.402547+0000","last_peered":"2024-09-12T12:24:17.402547+0000","last_clean":"2024-09-12T12:24:17.402547+0000","last_became_active":"2024-09-12T12:24:16.398598+0000","last_became_peered":"2024-09-12T12:24:16.398598+0000","last_unstale":"2024-09-12T12:24:17.402547+0000","last_undegraded":"2024-09-12T12:24:17.402547+0000","last_fullsized":"2024-09-12T12:24:17.402547+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:38.682077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614535+0000","last_change":"2024-09-12T12:24:15.399932+0000","last_active":"2024-09-12T12:24:18.614535+0000","last_peered":"2024-09-12T12:24:18.614535+0000","last_clean":"2024-09-12T12:24:18.614535+0000","last_became_active":"2024-09-12T12:24:15.399298+0000","last_became_peered":"2024-09-12T12:24:15.399298+0000","last_unstale":"2024-09-12T12:24:18.614535+0000","last_undegraded":"2024-09-12T12:24:18.614535+0000","last_fullsized":"2024-09-12T12:24:18.614535+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:49.018706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070727+0000","last_change":"2024-09-12T12:24:16.397252+0000","last_active":"2024-09-12T12:24:18.070727+0000","last_peered":"2024-09-12T12:24:18.070727+0000","last_clean":"2024-09-12T12:24:18.070727+0000","last_became_active":"2024-09-12T12:24:16.396964+0000","last_became_peered":"2024-09-12T12:24:16.396964+0000","last_unstale":"2024-09-12T12:24:18.070727+0000","last_undegraded":"2024-09-12T12:24:18.070727+0000","last_fullsized":"2024-09-12T12:24:18.070727+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:16.827590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070399+0000","last_change":"2024-09-12T12:24:15.388771+0000","last_active":"2024-09-12T12:24:18.070399+0000","last_peered":"2024-09-12T12:24:18.070399+0000","last_clean":"2024-09-12T12:24:18.070399+0000","last_became_active":"2024-09-12T12:24:15.388489+0000","last_became_peered":"2024-09-12T12:24:15.388489+0000","last_unstale":"2024-09-12T12:24:18.070399+0000","last_undegraded":"2024-09-12T12:24:18.070399+0000","last_fullsized":"2024-09-12T12:24:18.070399+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.638923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377349+0000","last_change":"2024-09-12T12:24:16.398321+0000","last_active":"2024-09-12T12:24:17.377349+0000","last_peered":"2024-09-12T12:24:17.377349+0000","last_clean":"2024-09-12T12:24:17.377349+0000","last_became_active":"2024-09-12T12:24:16.398059+0000","last_became_peered":"2024-09-12T12:24:16.398059+0000","last_unstale":"2024-09-12T12:24:17.377349+0000","last_undegraded":"2024-09-12T12:24:17.377349+0000","last_fullsized":"2024-09-12T12:24:17.377349+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:49.642450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377968+0000","last_change":"2024-09-12T12:24:15.392075+0000","last_active":"2024-09-12T12:24:17.377968+0000","last_peered":"2024-09-12T12:24:17.377968+0000","last_clean":"2024-09-12T12:24:17.377968+0000","last_became_active":"2024-09-12T12:24:15.391802+0000","last_became_peered":"2024-09-12T12:24:15.391802+0000","last_unstale":"2024-09-12T12:24:17.377968+0000","last_undegraded":"2024-09-12T12:24:17.377968+0000","last_fullsized":"2024-09-12T12:24:17.377968+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377422+0000","last_change":"2024-09-12T12:24:16.390477+0000","last_active":"2024-09-12T12:24:17.377422+0000","last_peered":"2024-09-12T12:24:17.377422+0000","last_clean":"2024-09-12T12:24:17.377422+0000","last_became_active":"2024-09-12T12:24:16.390202+0000","last_became_peered":"2024-09-12T12:24:16.390202+0000","last_unstale":"2024-09-12T12:24:17.377422+0000","last_undegraded":"2024-09-12T12:24:17.377422+0000","last_fullsized":"2024-09-12T12:24:17.377422+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:06.504087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614269+0000","last_change":"2024-09-12T12:24:15.401541+0000","last_active":"2024-09-12T12:24:18.614269+0000","last_peered":"2024-09-12T12:24:18.614269+0000","last_clean":"2024-09-12T12:24:18.614269+0000","last_became_active":"2024-09-12T12:24:15.400546+0000","last_became_peered":"2024-09-12T12:24:15.400546+0000","last_unstale":"2024-09-12T12:24:18.614269+0000","last_undegraded":"2024-09-12T12:24:18.614269+0000","last_fullsized":"2024-09-12T12:24:18.614269+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:22.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376083+0000","last_change":"2024-09-12T12:24:16.394306+0000","last_active":"2024-09-12T12:24:17.376083+0000","last_peered":"2024-09-12T12:24:17.376083+0000","last_clean":"2024-09-12T12:24:17.376083+0000","last_became_active":"2024-09-12T12:24:16.394065+0000","last_became_peered":"2024-09-12T12:24:16.394065+0000","last_unstale":"2024-09-12T12:24:17.376083+0000","last_undegraded":"2024-09-12T12:24:17.376083+0000","last_fullsized":"2024-09-12T12:24:17.376083+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:01.040775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367747+0000","last_change":"2024-09-12T12:24:14.367747+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367747+0000","last_undegraded":"2024-09-12T12:24:14.367747+0000","last_fullsized":"2024-09-12T12:24:14.367747+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376277+0000","last_change":"2024-09-12T12:24:16.398115+0000","last_active":"2024-09-12T12:24:17.376277+0000","last_peered":"2024-09-12T12:24:17.376277+0000","last_clean":"2024-09-12T12:24:17.376277+0000","last_became_active":"2024-09-12T12:24:16.397797+0000","last_became_peered":"2024-09-12T12:24:16.397797+0000","last_unstale":"2024-09-12T12:24:17.376277+0000","last_undegraded":"2024-09-12T12:24:17.376277+0000","last_fullsized":"2024-09-12T12:24:17.376277+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:52.182844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377746+0000","last_change":"2024-09-12T12:24:15.391060+0000","last_active":"2024-09-12T12:24:17.377746+0000","last_peered":"2024-09-12T12:24:17.377746+0000","last_clean":"2024-09-12T12:24:17.377746+0000","last_became_active":"2024-09-12T12:24:15.390781+0000","last_became_peered":"2024-09-12T12:24:15.390781+0000","last_unstale":"2024-09-12T12:24:17.377746+0000","last_undegraded":"2024-09-12T12:24:17.377746+0000","last_fullsized":"2024-09-12T12:24:17.377746+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:34.109701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614981+0000","last_change":"2024-09-12T12:24:16.395507+0000","last_active":"2024-09-12T12:24:18.614981+0000","last_peered":"2024-09-12T12:24:18.614981+0000","last_clean":"2024-09-12T12:24:18.614981+0000","last_became_active":"2024-09-12T12:24:16.395221+0000","last_became_peered":"2024-09-12T12:24:16.395221+0000","last_unstale":"2024-09-12T12:24:18.614981+0000","last_undegraded":"2024-09-12T12:24:18.614981+0000","last_fullsized":"2024-09-12T12:24:18.614981+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614536+0000","last_change":"2024-09-12T12:24:15.396881+0000","last_active":"2024-09-12T12:24:18.614536+0000","last_peered":"2024-09-12T12:24:18.614536+0000","last_clean":"2024-09-12T12:24:18.614536+0000","last_became_active":"2024-09-12T12:24:15.396494+0000","last_became_peered":"2024-09-12T12:24:15.396494+0000","last_unstale":"2024-09-12T12:24:18.614536+0000","last_undegraded":"2024-09-12T12:24:18.614536+0000","last_fullsized":"2024-09-12T12:24:18.614536+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:10.076168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614438+0000","last_change":"2024-09-12T12:24:16.390011+0000","last_active":"2024-09-12T12:24:18.614438+0000","last_peered":"2024-09-12T12:24:18.614438+0000","last_clean":"2024-09-12T12:24:18.614438+0000","last_became_active":"2024-09-12T12:24:16.389735+0000","last_became_peered":"2024-09-12T12:24:16.389735+0000","last_unstale":"2024-09-12T12:24:18.614438+0000","last_undegraded":"2024-09-12T12:24:18.614438+0000","last_fullsized":"2024-09-12T12:24:18.614438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:57.836183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376367+0000","last_change":"2024-09-12T12:24:15.399114+0000","last_active":"2024-09-12T12:24:17.376367+0000","last_peered":"2024-09-12T12:24:17.376367+0000","last_clean":"2024-09-12T12:24:17.376367+0000","last_became_active":"2024-09-12T12:24:15.398674+0000","last_became_peered":"2024-09-12T12:24:15.398674+0000","last_unstale":"2024-09-12T12:24:17.376367+0000","last_undegraded":"2024-09-12T12:24:17.376367+0000","last_fullsized":"2024-09-12T12:24:17.376367+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:48.465962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378417+0000","last_change":"2024-09-12T12:24:16.399719+0000","last_active":"2024-09-12T12:24:17.378417+0000","last_peered":"2024-09-12T12:24:17.378417+0000","last_clean":"2024-09-12T12:24:17.378417+0000","last_became_active":"2024-09-12T12:24:16.399424+0000","last_became_peered":"2024-09-12T12:24:16.399424+0000","last_unstale":"2024-09-12T12:24:17.378417+0000","last_undegraded":"2024-09-12T12:24:17.378417+0000","last_fullsized":"2024-09-12T12:24:17.378417+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:45.872966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367273+0000","last_change":"2024-09-12T12:24:14.367273+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367273+0000","last_undegraded":"2024-09-12T12:24:14.367273+0000","last_fullsized":"2024-09-12T12:24:14.367273+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376580+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:17.376580+0000","last_peered":"2024-09-12T12:24:17.376580+0000","last_clean":"2024-09-12T12:24:17.376580+0000","last_became_active":"2024-09-12T12:24:16.399517+0000","last_became_peered":"2024-09-12T12:24:16.399517+0000","last_unstale":"2024-09-12T12:24:17.376580+0000","last_undegraded":"2024-09-12T12:24:17.376580+0000","last_fullsized":"2024-09-12T12:24:17.376580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:36.668056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"175'6","reported_seq":20,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377972+0000","last_change":"2024-09-12T12:24:15.389229+0000","last_active":"2024-09-12T12:24:17.377972+0000","last_peered":"2024-09-12T12:24:17.377972+0000","last_clean":"2024-09-12T12:24:17.377972+0000","last_became_active":"2024-09-12T12:24:15.388660+0000","last_became_peered":"2024-09-12T12:24:15.388660+0000","last_unstale":"2024-09-12T12:24:17.377972+0000","last_undegraded":"2024-09-12T12:24:17.377972+0000","last_fullsized":"2024-09-12T12:24:17.377972+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:02.449575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402106+0000","last_change":"2024-09-12T12:24:16.399205+0000","last_active":"2024-09-12T12:24:17.402106+0000","last_peered":"2024-09-12T12:24:17.402106+0000","last_clean":"2024-09-12T12:24:17.402106+0000","last_became_active":"2024-09-12T12:24:16.398875+0000","last_became_peered":"2024-09-12T12:24:16.398875+0000","last_unstale":"2024-09-12T12:24:17.402106+0000","last_undegraded":"2024-09-12T12:24:17.402106+0000","last_fullsized":"2024-09-12T12:24:17.402106+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:47.257395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378190+0000","last_change":"2024-09-12T12:24:15.385396+0000","last_active":"2024-09-12T12:24:17.378190+0000","last_peered":"2024-09-12T12:24:17.378190+0000","last_clean":"2024-09-12T12:24:17.378190+0000","last_became_active":"2024-09-12T12:24:15.385095+0000","last_became_peered":"2024-09-12T12:24:15.385095+0000","last_unstale":"2024-09-12T12:24:17.378190+0000","last_undegraded":"2024-09-12T12:24:17.378190+0000","last_fullsized":"2024-09-12T12:24:17.378190+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613984+0000","last_change":"2024-09-12T12:24:16.390955+0000","last_active":"2024-09-12T12:24:18.613984+0000","last_peered":"2024-09-12T12:24:18.613984+0000","last_clean":"2024-09-12T12:24:18.613984+0000","last_became_active":"2024-09-12T12:24:16.388418+0000","last_became_peered":"2024-09-12T12:24:16.388418+0000","last_unstale":"2024-09-12T12:24:18.613984+0000","last_undegraded":"2024-09-12T12:24:18.613984+0000","last_fullsized":"2024-09-12T12:24:18.613984+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:40.208012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376309+0000","last_change":"2024-09-12T12:24:15.395867+0000","last_active":"2024-09-12T12:24:17.376309+0000","last_peered":"2024-09-12T12:24:17.376309+0000","last_clean":"2024-09-12T12:24:17.376309+0000","last_became_active":"2024-09-12T12:24:15.395594+0000","last_became_peered":"2024-09-12T12:24:15.395594+0000","last_unstale":"2024-09-12T12:24:17.376309+0000","last_undegraded":"2024-09-12T12:24:17.376309+0000","last_fullsized":"2024-09-12T12:24:17.376309+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:41.348309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377938+0000","last_change":"2024-09-12T12:24:16.387185+0000","last_active":"2024-09-12T12:24:17.377938+0000","last_peered":"2024-09-12T12:24:17.377938+0000","last_clean":"2024-09-12T12:24:17.377938+0000","last_became_active":"2024-09-12T12:24:16.386859+0000","last_became_peered":"2024-09-12T12:24:16.386859+0000","last_unstale":"2024-09-12T12:24:17.377938+0000","last_undegraded":"2024-09-12T12:24:17.377938+0000","last_fullsized":"2024-09-12T12:24:17.377938+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.116554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367234+0000","last_change":"2024-09-12T12:24:14.367234+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367234+0000","last_undegraded":"2024-09-12T12:24:14.367234+0000","last_fullsized":"2024-09-12T12:24:14.367234+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378125+0000","last_change":"2024-09-12T12:24:16.403838+0000","last_active":"2024-09-12T12:24:17.378125+0000","last_peered":"2024-09-12T12:24:17.378125+0000","last_clean":"2024-09-12T12:24:17.378125+0000","last_became_active":"2024-09-12T12:24:16.403611+0000","last_became_peered":"2024-09-12T12:24:16.403611+0000","last_unstale":"2024-09-12T12:24:17.378125+0000","last_undegraded":"2024-09-12T12:24:17.378125+0000","last_fullsized":"2024-09-12T12:24:17.378125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:38.894390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"175'8","reported_seq":22,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070217+0000","last_change":"2024-09-12T12:24:15.388767+0000","last_active":"2024-09-12T12:24:18.070217+0000","last_peered":"2024-09-12T12:24:18.070217+0000","last_clean":"2024-09-12T12:24:18.070217+0000","last_became_active":"2024-09-12T12:24:15.388428+0000","last_became_peered":"2024-09-12T12:24:15.388428+0000","last_unstale":"2024-09-12T12:24:18.070217+0000","last_undegraded":"2024-09-12T12:24:18.070217+0000","last_fullsized":"2024-09-12T12:24:18.070217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:53.990844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402245+0000","last_change":"2024-09-12T12:24:16.405120+0000","last_active":"2024-09-12T12:24:17.402245+0000","last_peered":"2024-09-12T12:24:17.402245+0000","last_clean":"2024-09-12T12:24:17.402245+0000","last_became_active":"2024-09-12T12:24:16.404831+0000","last_became_peered":"2024-09-12T12:24:16.404831+0000","last_unstale":"2024-09-12T12:24:17.402245+0000","last_undegraded":"2024-09-12T12:24:17.402245+0000","last_fullsized":"2024-09-12T12:24:17.402245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.752182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070641+0000","last_change":"2024-09-12T12:24:15.394278+0000","last_active":"2024-09-12T12:24:18.070641+0000","last_peered":"2024-09-12T12:24:18.070641+0000","last_clean":"2024-09-12T12:24:18.070641+0000","last_became_active":"2024-09-12T12:24:15.392595+0000","last_became_peered":"2024-09-12T12:24:15.392595+0000","last_unstale":"2024-09-12T12:24:18.070641+0000","last_undegraded":"2024-09-12T12:24:18.070641+0000","last_fullsized":"2024-09-12T12:24:18.070641+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:59.109666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614201+0000","last_change":"2024-09-12T12:24:16.391727+0000","last_active":"2024-09-12T12:24:18.614201+0000","last_peered":"2024-09-12T12:24:18.614201+0000","last_clean":"2024-09-12T12:24:18.614201+0000","last_became_active":"2024-09-12T12:24:16.391468+0000","last_became_peered":"2024-09-12T12:24:16.391468+0000","last_unstale":"2024-09-12T12:24:18.614201+0000","last_undegraded":"2024-09-12T12:24:18.614201+0000","last_fullsized":"2024-09-12T12:24:18.614201+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:56.376971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.368232+0000","last_change":"2024-09-12T12:24:14.368232+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.368232+0000","last_undegraded":"2024-09-12T12:24:14.368232+0000","last_fullsized":"2024-09-12T12:24:14.368232+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070786+0000","last_change":"2024-09-12T12:24:16.397975+0000","last_active":"2024-09-12T12:24:18.070786+0000","last_peered":"2024-09-12T12:24:18.070786+0000","last_clean":"2024-09-12T12:24:18.070786+0000","last_became_active":"2024-09-12T12:24:16.397682+0000","last_became_peered":"2024-09-12T12:24:16.397682+0000","last_unstale":"2024-09-12T12:24:18.070786+0000","last_undegraded":"2024-09-12T12:24:18.070786+0000","last_fullsized":"2024-09-12T12:24:18.070786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:19.982642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377000+0000","last_change":"2024-09-12T12:24:15.398973+0000","last_active":"2024-09-12T12:24:17.377000+0000","last_peered":"2024-09-12T12:24:17.377000+0000","last_clean":"2024-09-12T12:24:17.377000+0000","last_became_active":"2024-09-12T12:24:15.398624+0000","last_became_peered":"2024-09-12T12:24:15.398624+0000","last_unstale":"2024-09-12T12:24:17.377000+0000","last_undegraded":"2024-09-12T12:24:17.377000+0000","last_fullsized":"2024-09-12T12:24:17.377000+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376616+0000","last_change":"2024-09-12T12:24:16.390299+0000","last_active":"2024-09-12T12:24:17.376616+0000","last_peered":"2024-09-12T12:24:17.376616+0000","last_clean":"2024-09-12T12:24:17.376616+0000","last_became_active":"2024-09-12T12:24:16.389754+0000","last_became_peered":"2024-09-12T12:24:16.389754+0000","last_unstale":"2024-09-12T12:24:17.376616+0000","last_undegraded":"2024-09-12T12:24:17.376616+0000","last_fullsized":"2024-09-12T12:24:17.376616+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:52.232681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070516+0000","last_change":"2024-09-12T12:24:15.391813+0000","last_active":"2024-09-12T12:24:18.070516+0000","last_peered":"2024-09-12T12:24:18.070516+0000","last_clean":"2024-09-12T12:24:18.070516+0000","last_became_active":"2024-09-12T12:24:15.391434+0000","last_became_peered":"2024-09-12T12:24:15.391434+0000","last_unstale":"2024-09-12T12:24:18.070516+0000","last_undegraded":"2024-09-12T12:24:18.070516+0000","last_fullsized":"2024-09-12T12:24:18.070516+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:37.887502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375786+0000","last_change":"2024-09-12T12:24:16.401815+0000","last_active":"2024-09-12T12:24:17.375786+0000","last_peered":"2024-09-12T12:24:17.375786+0000","last_clean":"2024-09-12T12:24:17.375786+0000","last_became_active":"2024-09-12T12:24:16.401529+0000","last_became_peered":"2024-09-12T12:24:16.401529+0000","last_unstale":"2024-09-12T12:24:17.375786+0000","last_undegraded":"2024-09-12T12:24:17.375786+0000","last_fullsized":"2024-09-12T12:24:17.375786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378241+0000","last_change":"2024-09-12T12:24:15.399471+0000","last_active":"2024-09-12T12:24:17.378241+0000","last_peered":"2024-09-12T12:24:17.378241+0000","last_clean":"2024-09-12T12:24:17.378241+0000","last_became_active":"2024-09-12T12:24:15.399103+0000","last_became_peered":"2024-09-12T12:24:15.399103+0000","last_unstale":"2024-09-12T12:24:17.378241+0000","last_undegraded":"2024-09-12T12:24:17.378241+0000","last_fullsized":"2024-09-12T12:24:17.378241+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367162+0000","last_change":"2024-09-12T12:24:14.367162+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367162+0000","last_undegraded":"2024-09-12T12:24:14.367162+0000","last_fullsized":"2024-09-12T12:24:14.367162+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402270+0000","last_change":"2024-09-12T12:24:15.398819+0000","last_active":"2024-09-12T12:24:17.402270+0000","last_peered":"2024-09-12T12:24:17.402270+0000","last_clean":"2024-09-12T12:24:17.402270+0000","last_became_active":"2024-09-12T12:24:15.398572+0000","last_became_peered":"2024-09-12T12:24:15.398572+0000","last_unstale":"2024-09-12T12:24:17.402270+0000","last_undegraded":"2024-09-12T12:24:17.402270+0000","last_fullsized":"2024-09-12T12:24:17.402270+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:33.388691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614154+0000","last_change":"2024-09-12T12:24:16.393240+0000","last_active":"2024-09-12T12:24:18.614154+0000","last_peered":"2024-09-12T12:24:18.614154+0000","last_clean":"2024-09-12T12:24:18.614154+0000","last_became_active":"2024-09-12T12:24:16.392939+0000","last_became_peered":"2024-09-12T12:24:16.392939+0000","last_unstale":"2024-09-12T12:24:18.614154+0000","last_undegraded":"2024-09-12T12:24:18.614154+0000","last_fullsized":"2024-09-12T12:24:18.614154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:37.911201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376709+0000","last_change":"2024-09-12T12:24:15.391719+0000","last_active":"2024-09-12T12:24:17.376709+0000","last_peered":"2024-09-12T12:24:17.376709+0000","last_clean":"2024-09-12T12:24:17.376709+0000","last_became_active":"2024-09-12T12:24:15.391451+0000","last_became_peered":"2024-09-12T12:24:15.391451+0000","last_unstale":"2024-09-12T12:24:17.376709+0000","last_undegraded":"2024-09-12T12:24:17.376709+0000","last_fullsized":"2024-09-12T12:24:17.376709+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402376+0000","last_change":"2024-09-12T12:24:16.400257+0000","last_active":"2024-09-12T12:24:17.402376+0000","last_peered":"2024-09-12T12:24:17.402376+0000","last_clean":"2024-09-12T12:24:17.402376+0000","last_became_active":"2024-09-12T12:24:16.399908+0000","last_became_peered":"2024-09-12T12:24:16.399908+0000","last_unstale":"2024-09-12T12:24:17.402376+0000","last_undegraded":"2024-09-12T12:24:17.402376+0000","last_fullsized":"2024-09-12T12:24:17.402376+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:19.882883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.366646+0000","last_change":"2024-09-12T12:24:14.366646+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.366646+0000","last_undegraded":"2024-09-12T12:24:14.366646+0000","last_fullsized":"2024-09-12T12:24:14.366646+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375977+0000","last_change":"2024-09-12T12:24:16.393135+0000","last_active":"2024-09-12T12:24:17.375977+0000","last_peered":"2024-09-12T12:24:17.375977+0000","last_clean":"2024-09-12T12:24:17.375977+0000","last_became_active":"2024-09-12T12:24:16.392886+0000","last_became_peered":"2024-09-12T12:24:16.392886+0000","last_unstale":"2024-09-12T12:24:17.375977+0000","last_undegraded":"2024-09-12T12:24:17.375977+0000","last_fullsized":"2024-09-12T12:24:17.375977+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"176'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402509+0000","last_change":"2024-09-12T12:24:15.398312+0000","last_active":"2024-09-12T12:24:17.402509+0000","last_peered":"2024-09-12T12:24:17.402509+0000","last_clean":"2024-09-12T12:24:17.402509+0000","last_became_active":"2024-09-12T12:24:15.397828+0000","last_became_peered":"2024-09-12T12:24:15.397828+0000","last_unstale":"2024-09-12T12:24:17.402509+0000","last_undegraded":"2024-09-12T12:24:17.402509+0000","last_fullsized":"2024-09-12T12:24:17.402509+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:05.355749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614970+0000","last_change":"2024-09-12T12:24:16.396259+0000","last_active":"2024-09-12T12:24:18.614970+0000","last_peered":"2024-09-12T12:24:18.614970+0000","last_clean":"2024-09-12T12:24:18.614970+0000","last_became_active":"2024-09-12T12:24:16.396001+0000","last_became_peered":"2024-09-12T12:24:16.396001+0000","last_unstale":"2024-09-12T12:24:18.614970+0000","last_undegraded":"2024-09-12T12:24:18.614970+0000","last_fullsized":"2024-09-12T12:24:18.614970+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614336+0000","last_change":"2024-09-12T12:24:15.401539+0000","last_active":"2024-09-12T12:24:18.614336+0000","last_peered":"2024-09-12T12:24:18.614336+0000","last_clean":"2024-09-12T12:24:18.614336+0000","last_became_active":"2024-09-12T12:24:15.400457+0000","last_became_peered":"2024-09-12T12:24:15.400457+0000","last_unstale":"2024-09-12T12:24:18.614336+0000","last_undegraded":"2024-09-12T12:24:18.614336+0000","last_fullsized":"2024-09-12T12:24:18.614336+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:00:53.932314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402584+0000","last_change":"2024-09-12T12:24:16.399098+0000","last_active":"2024-09-12T12:24:17.402584+0000","last_peered":"2024-09-12T12:24:17.402584+0000","last_clean":"2024-09-12T12:24:17.402584+0000","last_became_active":"2024-09-12T12:24:16.398823+0000","last_became_peered":"2024-09-12T12:24:16.398823+0000","last_unstale":"2024-09-12T12:24:17.402584+0000","last_undegraded":"2024-09-12T12:24:17.402584+0000","last_fullsized":"2024-09-12T12:24:17.402584+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:20.717320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:15.398497+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:15.398186+0000","last_became_peered":"2024-09-12T12:24:15.398186+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:31.161939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376781+0000","last_change":"2024-09-12T12:24:16.389008+0000","last_active":"2024-09-12T12:24:17.376781+0000","last_peered":"2024-09-12T12:24:17.376781+0000","last_clean":"2024-09-12T12:24:17.376781+0000","last_became_active":"2024-09-12T12:24:16.388763+0000","last_became_peered":"2024-09-12T12:24:16.388763+0000","last_unstale":"2024-09-12T12:24:17.376781+0000","last_undegraded":"2024-09-12T12:24:17.376781+0000","last_fullsized":"2024-09-12T12:24:17.376781+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.252266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614577+0000","last_change":"2024-09-12T12:24:15.392333+0000","last_active":"2024-09-12T12:24:18.614577+0000","last_peered":"2024-09-12T12:24:18.614577+0000","last_clean":"2024-09-12T12:24:18.614577+0000","last_became_active":"2024-09-12T12:24:15.390965+0000","last_became_peered":"2024-09-12T12:24:15.390965+0000","last_unstale":"2024-09-12T12:24:18.614577+0000","last_undegraded":"2024-09-12T12:24:18.614577+0000","last_fullsized":"2024-09-12T12:24:18.614577+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.211150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377869+0000","last_change":"2024-09-12T12:24:16.383386+0000","last_active":"2024-09-12T12:24:17.377869+0000","last_peered":"2024-09-12T12:24:17.377869+0000","last_clean":"2024-09-12T12:24:17.377869+0000","last_became_active":"2024-09-12T12:24:16.383081+0000","last_became_peered":"2024-09-12T12:24:16.383081+0000","last_unstale":"2024-09-12T12:24:17.377869+0000","last_undegraded":"2024-09-12T12:24:17.377869+0000","last_fullsized":"2024-09-12T12:24:17.377869+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.997732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614411+0000","last_change":"2024-09-12T12:24:15.398042+0000","last_active":"2024-09-12T12:24:18.614411+0000","last_peered":"2024-09-12T12:24:18.614411+0000","last_clean":"2024-09-12T12:24:18.614411+0000","last_became_active":"2024-09-12T12:24:15.397831+0000","last_became_peered":"2024-09-12T12:24:15.397831+0000","last_unstale":"2024-09-12T12:24:18.614411+0000","last_undegraded":"2024-09-12T12:24:18.614411+0000","last_fullsized":"2024-09-12T12:24:18.614411+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.073587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376395+0000","last_change":"2024-09-12T12:24:16.391725+0000","last_active":"2024-09-12T12:24:17.376395+0000","last_peered":"2024-09-12T12:24:17.376395+0000","last_clean":"2024-09-12T12:24:17.376395+0000","last_became_active":"2024-09-12T12:24:16.391417+0000","last_became_peered":"2024-09-12T12:24:16.391417+0000","last_unstale":"2024-09-12T12:24:17.376395+0000","last_undegraded":"2024-09-12T12:24:17.376395+0000","last_fullsized":"2024-09-12T12:24:17.376395+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:48.466637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402272+0000","last_change":"2024-09-12T12:24:15.389928+0000","last_active":"2024-09-12T12:24:17.402272+0000","last_peered":"2024-09-12T12:24:17.402272+0000","last_clean":"2024-09-12T12:24:17.402272+0000","last_became_active":"2024-09-12T12:24:15.389340+0000","last_became_peered":"2024-09-12T12:24:15.389340+0000","last_unstale":"2024-09-12T12:24:17.402272+0000","last_undegraded":"2024-09-12T12:24:17.402272+0000","last_fullsized":"2024-09-12T12:24:17.402272+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:15.606771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614638+0000","last_change":"2024-09-12T12:24:16.407188+0000","last_active":"2024-09-12T12:24:18.614638+0000","last_peered":"2024-09-12T12:24:18.614638+0000","last_clean":"2024-09-12T12:24:18.614638+0000","last_became_active":"2024-09-12T12:24:16.406874+0000","last_became_peered":"2024-09-12T12:24:16.406874+0000","last_unstale":"2024-09-12T12:24:18.614638+0000","last_undegraded":"2024-09-12T12:24:18.614638+0000","last_fullsized":"2024-09-12T12:24:18.614638+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:20.527705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376860+0000","last_change":"2024-09-12T12:24:15.394140+0000","last_active":"2024-09-12T12:24:17.376860+0000","last_peered":"2024-09-12T12:24:17.376860+0000","last_clean":"2024-09-12T12:24:17.376860+0000","last_became_active":"2024-09-12T12:24:15.393853+0000","last_became_peered":"2024-09-12T12:24:15.393853+0000","last_unstale":"2024-09-12T12:24:17.376860+0000","last_undegraded":"2024-09-12T12:24:17.376860+0000","last_fullsized":"2024-09-12T12:24:17.376860+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377325+0000","last_change":"2024-09-12T12:24:16.389657+0000","last_active":"2024-09-12T12:24:17.377325+0000","last_peered":"2024-09-12T12:24:17.377325+0000","last_clean":"2024-09-12T12:24:17.377325+0000","last_became_active":"2024-09-12T12:24:16.389393+0000","last_became_peered":"2024-09-12T12:24:16.389393+0000","last_unstale":"2024-09-12T12:24:17.377325+0000","last_undegraded":"2024-09-12T12:24:17.377325+0000","last_fullsized":"2024-09-12T12:24:17.377325+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:43.184029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367329+0000","last_change":"2024-09-12T12:24:14.367329+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367329+0000","last_undegraded":"2024-09-12T12:24:14.367329+0000","last_fullsized":"2024-09-12T12:24:14.367329+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":455,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614607+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:24:18.614607+0000","last_peered":"2024-09-12T12:24:18.614607+0000","last_clean":"2024-09-12T12:24:18.614607+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:24:18.614607+0000","last_undegraded":"2024-09-12T12:24:18.614607+0000","last_fullsized":"2024-09-12T12:24:18.614607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51980,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319860,"statfs":{"total":96636764160,"available":96583536640,"internally_reserved":0,"allocated":2809856,"data_stored":1637923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51404,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320436,"statfs":{"total":96636764160,"available":96584126464,"internally_reserved":0,"allocated":2220032,"data_stored":1047625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51416,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320424,"statfs":{"total":96636764160,"available":96584114176,"internally_reserved":0,"allocated":2232320,"data_stored":1049189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59740,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312100,"statfs":{"total":96636764160,"available":96575590400,"internally_reserved":0,"allocated":2232320,"data_stored":1049201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2224128,"data_stored":1047715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":58915272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2220032,"data_stored":1048137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2215936,"data_stored":1047555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56104,"kb_used_data":2708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315736,"statfs":{"total":96636764160,"available":96579313664,"internally_reserved":0,"allocated":2772992,"data_stored":1617397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:20.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:24:20.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.644+0000 7f3ddde00640 1 Processor -- start 2024-09-12T12:24:20.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.644+0000 7f3ddde00640 1 -- start start 2024-09-12T12:24:20.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3ddde00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3dd815cd30 0x7f3dd80b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3ddde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd80b5de0 0x7f3dd8072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3ddde00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd80cd870 con 0x7f3dd815c7b0 2024-09-12T12:24:20.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3ddde00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd80b6230 con 0x7f3dd815cd30 2024-09-12T12:24:20.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3ddde00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd8072a50 con 0x7f3dd80b5de0 2024-09-12T12:24:20.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3dd815cd30 0x7f3dd80b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd6a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3dd815c7b0 0x7f3dd80ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53082/0 (socket says 172.21.15.144:53082) 2024-09-12T12:24:20.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd6a00640 1 -- 172.21.15.144:0/3649255933 learned_addr learned my addr 172.21.15.144:0/3649255933 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:20.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd7400640 1 --2- 172.21.15.144:0/3649255933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd80b5de0 0x7f3dd8072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd5600640 1 -- 172.21.15.144:0/3649255933 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012271203 0 0) 0x7f3dd80cd870 con 0x7f3dd815c7b0 2024-09-12T12:24:20.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd5600640 1 -- 172.21.15.144:0/3649255933 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dbc003530 con 0x7f3dd815c7b0 2024-09-12T12:24:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd6000640 1 -- 172.21.15.144:0/3649255933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd80b5de0 msgr2=0x7f3dd8072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd6000640 1 --2- 172.21.15.144:0/3649255933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd80b5de0 0x7f3dd8072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd6000640 1 -- 172.21.15.144:0/3649255933 >> v1:172.21.15.144:6789/0 conn(0x7f3dd815c7b0 legacy=0x7f3dd80ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd6000640 1 -- 172.21.15.144:0/3649255933 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd80cdb50 con 0x7f3dd815cd30 2024-09-12T12:24:20.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd7400640 1 --2- 172.21.15.144:0/3649255933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd80b5de0 0x7f3dd8072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:20.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd6000640 1 --2- 172.21.15.144:0/3649255933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd815cd30 0x7f3dd80b58a0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40097c0 tx=0x7f3dc401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6e11c3f4eb6f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd5600640 1 -- 172.21.15.144:0/3649255933 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40b0070 con 0x7f3dd815cd30 2024-09-12T12:24:20.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd5600640 1 -- 172.21.15.144:0/3649255933 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc40ab600 con 0x7f3dd815cd30 2024-09-12T12:24:20.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.648+0000 7f3dd5600640 1 -- 172.21.15.144:0/3649255933 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40ab9b0 con 0x7f3dd815cd30 2024-09-12T12:24:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 -- 172.21.15.144:0/3649255933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd815cd30 msgr2=0x7f3dd80b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 --2- 172.21.15.144:0/3649255933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd815cd30 0x7f3dd80b58a0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40097c0 tx=0x7f3dc401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 -- 172.21.15.144:0/3649255933 shutdown_connections 2024-09-12T12:24:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 --2- 172.21.15.144:0/3649255933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd80b5de0 0x7f3dd8072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 --2- 172.21.15.144:0/3649255933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd815cd30 0x7f3dd80b58a0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 -- 172.21.15.144:0/3649255933 >> 172.21.15.144:0/3649255933 conn(0x7f3dd806d0d0 msgr2=0x7f3dd806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 -- 172.21.15.144:0/3649255933 shutdown_connections 2024-09-12T12:24:20.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 -- 172.21.15.144:0/3649255933 wait complete. 2024-09-12T12:24:20.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 Processor -- start 2024-09-12T12:24:20.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 -- start start 2024-09-12T12:24:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b5de0 0x7f3dd814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd815c7b0 0x7f3dd814b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd815cd30 0x7f3dd8151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8073fc0 con 0x7f3dd80b5de0 2024-09-12T12:24:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8073e40 con 0x7f3dd815cd30 2024-09-12T12:24:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3ddde00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd8074140 con 0x7f3dd815c7b0 2024-09-12T12:24:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b5de0 0x7f3dd814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b5de0 0x7f3dd814c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36444/0 (socket says 172.21.15.144:36444) 2024-09-12T12:24:20.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd6a00640 1 -- 172.21.15.144:0/1631627206 learned_addr learned my addr 172.21.15.144:0/1631627206 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd7400640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd815cd30 0x7f3dd8151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd6000640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd815c7b0 0x7f3dd814b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd6a00640 1 -- 172.21.15.144:0/1631627206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd815c7b0 msgr2=0x7f3dd814b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd6a00640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd815c7b0 0x7f3dd814b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd6a00640 1 -- 172.21.15.144:0/1631627206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd815cd30 msgr2=0x7f3dd8151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd6a00640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd815cd30 0x7f3dd8151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.652+0000 7f3dd6a00640 1 -- 172.21.15.144:0/1631627206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd814c6a0 con 0x7f3dd80b5de0 2024-09-12T12:24:20.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3dd6a00640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b5de0 0x7f3dd814c160 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80010f0 tx=0x7f3dc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3dcf400640 1 -- 172.21.15.144:0/1631627206 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8017070 con 0x7f3dd80b5de0 2024-09-12T12:24:20.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3dcf400640 1 -- 172.21.15.144:0/1631627206 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc8005d10 con 0x7f3dd80b5de0 2024-09-12T12:24:20.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd8150600 con 0x7f3dd80b5de0 2024-09-12T12:24:20.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3dcf400640 1 -- 172.21.15.144:0/1631627206 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8007310 con 0x7f3dd80b5de0 2024-09-12T12:24:20.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd8150bc0 con 0x7f3dd80b5de0 2024-09-12T12:24:20.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd8072ee0 con 0x7f3dd80b5de0 2024-09-12T12:24:20.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3dcf400640 1 -- 172.21.15.144:0/1631627206 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3dc801a070 con 0x7f3dd80b5de0 2024-09-12T12:24:20.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3dcf400640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3db80678f0 0x7f3db8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:20.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3dcf400640 1 -- 172.21.15.144:0/1631627206 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f3dc80852a0 con 0x7f3dd80b5de0 2024-09-12T12:24:20.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.656+0000 7f3dd6000640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3db80678f0 0x7f3db8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:20.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.660+0000 7f3dd6000640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3db80678f0 0x7f3db8069db0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40ad000 tx=0x7f3dc4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:20.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.660+0000 7f3dcf400640 1 -- 172.21.15.144:0/1631627206 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3dc8055c40 con 0x7f3dd80b5de0 2024-09-12T12:24:20.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.816+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3dd815e420 con 0x7f3db80678f0 2024-09-12T12:24:20.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.824+0000 7f3dcf400640 1 -- 172.21.15.144:0/1631627206 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251112 (secure 0 0 0) 0x7f3dd815e420 con 0x7f3db80678f0 2024-09-12T12:24:20.825 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:20.827 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:24:20.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3db80678f0 msgr2=0x7f3db8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3db80678f0 0x7f3db8069db0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40ad000 tx=0x7f3dc4008040 comp rx=0 tx=0).stop 2024-09-12T12:24:20.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b5de0 msgr2=0x7f3dd814c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:20.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b5de0 0x7f3dd814c160 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80010f0 tx=0x7f3dc800c8f0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 shutdown_connections 2024-09-12T12:24:20.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3db80678f0 0x7f3db8069db0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd815cd30 0x7f3dd8151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd815c7b0 0x7f3dd814b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 --2- 172.21.15.144:0/1631627206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd80b5de0 0x7f3dd814c160 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 >> 172.21.15.144:0/1631627206 conn(0x7f3dd806d0d0 msgr2=0x7f3dd8156090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 shutdown_connections 2024-09-12T12:24:20.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:20.828+0000 7f3ddde00640 1 -- 172.21.15.144:0/1631627206 wait complete. 2024-09-12T12:24:20.847 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-12T12:24:19.524894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592106,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":445664,"kb_used_data":18484,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754529056,"statfs":{"total":773094113280,"available":772637753344,"internally_reserved":0,"allocated":18927616,"data_stored":9544742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.162310"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376298+0000","last_change":"2024-09-12T12:24:16.395627+0000","last_active":"2024-09-12T12:24:17.376298+0000","last_peered":"2024-09-12T12:24:17.376298+0000","last_clean":"2024-09-12T12:24:17.376298+0000","last_became_active":"2024-09-12T12:24:16.395322+0000","last_became_peered":"2024-09-12T12:24:16.395322+0000","last_unstale":"2024-09-12T12:24:17.376298+0000","last_undegraded":"2024-09-12T12:24:17.376298+0000","last_fullsized":"2024-09-12T12:24:17.376298+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:16.943178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376308+0000","last_change":"2024-09-12T12:24:16.399843+0000","last_active":"2024-09-12T12:24:17.376308+0000","last_peered":"2024-09-12T12:24:17.376308+0000","last_clean":"2024-09-12T12:24:17.376308+0000","last_became_active":"2024-09-12T12:24:16.399540+0000","last_became_peered":"2024-09-12T12:24:16.399540+0000","last_unstale":"2024-09-12T12:24:17.376308+0000","last_undegraded":"2024-09-12T12:24:17.376308+0000","last_fullsized":"2024-09-12T12:24:17.376308+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:18.125453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376939+0000","last_change":"2024-09-12T12:24:16.390401+0000","last_active":"2024-09-12T12:24:17.376939+0000","last_peered":"2024-09-12T12:24:17.376939+0000","last_clean":"2024-09-12T12:24:17.376939+0000","last_became_active":"2024-09-12T12:24:16.390125+0000","last_became_peered":"2024-09-12T12:24:16.390125+0000","last_unstale":"2024-09-12T12:24:17.376939+0000","last_undegraded":"2024-09-12T12:24:17.376939+0000","last_fullsized":"2024-09-12T12:24:17.376939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:13.958791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614197+0000","last_change":"2024-09-12T12:24:16.397905+0000","last_active":"2024-09-12T12:24:18.614197+0000","last_peered":"2024-09-12T12:24:18.614197+0000","last_clean":"2024-09-12T12:24:18.614197+0000","last_became_active":"2024-09-12T12:24:16.397631+0000","last_became_peered":"2024-09-12T12:24:16.397631+0000","last_unstale":"2024-09-12T12:24:18.614197+0000","last_undegraded":"2024-09-12T12:24:18.614197+0000","last_fullsized":"2024-09-12T12:24:18.614197+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:19.720611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614055+0000","last_change":"2024-09-12T12:24:16.405121+0000","last_active":"2024-09-12T12:24:18.614055+0000","last_peered":"2024-09-12T12:24:18.614055+0000","last_clean":"2024-09-12T12:24:18.614055+0000","last_became_active":"2024-09-12T12:24:16.404807+0000","last_became_peered":"2024-09-12T12:24:16.404807+0000","last_unstale":"2024-09-12T12:24:18.614055+0000","last_undegraded":"2024-09-12T12:24:18.614055+0000","last_fullsized":"2024-09-12T12:24:18.614055+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:46.225664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402195+0000","last_change":"2024-09-12T12:24:16.396455+0000","last_active":"2024-09-12T12:24:17.402195+0000","last_peered":"2024-09-12T12:24:17.402195+0000","last_clean":"2024-09-12T12:24:17.402195+0000","last_became_active":"2024-09-12T12:24:16.396163+0000","last_became_peered":"2024-09-12T12:24:16.396163+0000","last_unstale":"2024-09-12T12:24:17.402195+0000","last_undegraded":"2024-09-12T12:24:17.402195+0000","last_fullsized":"2024-09-12T12:24:17.402195+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:51.534062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614642+0000","last_change":"2024-09-12T12:24:16.398847+0000","last_active":"2024-09-12T12:24:18.614642+0000","last_peered":"2024-09-12T12:24:18.614642+0000","last_clean":"2024-09-12T12:24:18.614642+0000","last_became_active":"2024-09-12T12:24:16.398566+0000","last_became_peered":"2024-09-12T12:24:16.398566+0000","last_unstale":"2024-09-12T12:24:18.614642+0000","last_undegraded":"2024-09-12T12:24:18.614642+0000","last_fullsized":"2024-09-12T12:24:18.614642+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:18.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376446+0000","last_change":"2024-09-12T12:24:16.387534+0000","last_active":"2024-09-12T12:24:17.376446+0000","last_peered":"2024-09-12T12:24:17.376446+0000","last_clean":"2024-09-12T12:24:17.376446+0000","last_became_active":"2024-09-12T12:24:16.387258+0000","last_became_peered":"2024-09-12T12:24:16.387258+0000","last_unstale":"2024-09-12T12:24:17.376446+0000","last_undegraded":"2024-09-12T12:24:17.376446+0000","last_fullsized":"2024-09-12T12:24:17.376446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:40.475529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614640+0000","last_change":"2024-09-12T12:24:16.389429+0000","last_active":"2024-09-12T12:24:18.614640+0000","last_peered":"2024-09-12T12:24:18.614640+0000","last_clean":"2024-09-12T12:24:18.614640+0000","last_became_active":"2024-09-12T12:24:16.389118+0000","last_became_peered":"2024-09-12T12:24:16.389118+0000","last_unstale":"2024-09-12T12:24:18.614640+0000","last_undegraded":"2024-09-12T12:24:18.614640+0000","last_fullsized":"2024-09-12T12:24:18.614640+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:17.258071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070564+0000","last_change":"2024-09-12T12:24:16.395888+0000","last_active":"2024-09-12T12:24:18.070564+0000","last_peered":"2024-09-12T12:24:18.070564+0000","last_clean":"2024-09-12T12:24:18.070564+0000","last_became_active":"2024-09-12T12:24:16.395552+0000","last_became_peered":"2024-09-12T12:24:16.395552+0000","last_unstale":"2024-09-12T12:24:18.070564+0000","last_undegraded":"2024-09-12T12:24:18.070564+0000","last_fullsized":"2024-09-12T12:24:18.070564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:42.839292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377994+0000","last_change":"2024-09-12T12:24:16.385909+0000","last_active":"2024-09-12T12:24:17.377994+0000","last_peered":"2024-09-12T12:24:17.377994+0000","last_clean":"2024-09-12T12:24:17.377994+0000","last_became_active":"2024-09-12T12:24:16.385618+0000","last_became_peered":"2024-09-12T12:24:16.385618+0000","last_unstale":"2024-09-12T12:24:17.377994+0000","last_undegraded":"2024-09-12T12:24:17.377994+0000","last_fullsized":"2024-09-12T12:24:17.377994+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.645811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402120+0000","last_change":"2024-09-12T12:24:16.389264+0000","last_active":"2024-09-12T12:24:17.402120+0000","last_peered":"2024-09-12T12:24:17.402120+0000","last_clean":"2024-09-12T12:24:17.402120+0000","last_became_active":"2024-09-12T12:24:16.383477+0000","last_became_peered":"2024-09-12T12:24:16.383477+0000","last_unstale":"2024-09-12T12:24:17.402120+0000","last_undegraded":"2024-09-12T12:24:17.402120+0000","last_fullsized":"2024-09-12T12:24:17.402120+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:00.350364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375908+0000","last_change":"2024-09-12T12:24:16.396038+0000","last_active":"2024-09-12T12:24:17.375908+0000","last_peered":"2024-09-12T12:24:17.375908+0000","last_clean":"2024-09-12T12:24:17.375908+0000","last_became_active":"2024-09-12T12:24:16.395776+0000","last_became_peered":"2024-09-12T12:24:16.395776+0000","last_unstale":"2024-09-12T12:24:17.375908+0000","last_undegraded":"2024-09-12T12:24:17.375908+0000","last_fullsized":"2024-09-12T12:24:17.375908+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613990+0000","last_change":"2024-09-12T12:24:16.394206+0000","last_active":"2024-09-12T12:24:18.613990+0000","last_peered":"2024-09-12T12:24:18.613990+0000","last_clean":"2024-09-12T12:24:18.613990+0000","last_became_active":"2024-09-12T12:24:16.393946+0000","last_became_peered":"2024-09-12T12:24:16.393946+0000","last_unstale":"2024-09-12T12:24:18.613990+0000","last_undegraded":"2024-09-12T12:24:18.613990+0000","last_fullsized":"2024-09-12T12:24:18.613990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:33.481891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614623+0000","last_change":"2024-09-12T12:24:16.393808+0000","last_active":"2024-09-12T12:24:18.614623+0000","last_peered":"2024-09-12T12:24:18.614623+0000","last_clean":"2024-09-12T12:24:18.614623+0000","last_became_active":"2024-09-12T12:24:16.393444+0000","last_became_peered":"2024-09-12T12:24:16.393444+0000","last_unstale":"2024-09-12T12:24:18.614623+0000","last_undegraded":"2024-09-12T12:24:18.614623+0000","last_fullsized":"2024-09-12T12:24:18.614623+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:16.973624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378284+0000","last_change":"2024-09-12T12:24:16.395785+0000","last_active":"2024-09-12T12:24:17.378284+0000","last_peered":"2024-09-12T12:24:17.378284+0000","last_clean":"2024-09-12T12:24:17.378284+0000","last_became_active":"2024-09-12T12:24:16.395155+0000","last_became_peered":"2024-09-12T12:24:16.395155+0000","last_unstale":"2024-09-12T12:24:17.378284+0000","last_undegraded":"2024-09-12T12:24:17.378284+0000","last_fullsized":"2024-09-12T12:24:17.378284+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.128062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378263+0000","last_change":"2024-09-12T12:24:16.384665+0000","last_active":"2024-09-12T12:24:17.378263+0000","last_peered":"2024-09-12T12:24:17.378263+0000","last_clean":"2024-09-12T12:24:17.378263+0000","last_became_active":"2024-09-12T12:24:16.384397+0000","last_became_peered":"2024-09-12T12:24:16.384397+0000","last_unstale":"2024-09-12T12:24:17.378263+0000","last_undegraded":"2024-09-12T12:24:17.378263+0000","last_fullsized":"2024-09-12T12:24:17.378263+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:33.904641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614178+0000","last_change":"2024-09-12T12:24:16.398048+0000","last_active":"2024-09-12T12:24:18.614178+0000","last_peered":"2024-09-12T12:24:18.614178+0000","last_clean":"2024-09-12T12:24:18.614178+0000","last_became_active":"2024-09-12T12:24:16.397351+0000","last_became_peered":"2024-09-12T12:24:16.397351+0000","last_unstale":"2024-09-12T12:24:18.614178+0000","last_undegraded":"2024-09-12T12:24:18.614178+0000","last_fullsized":"2024-09-12T12:24:18.614178+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:42.510300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376118+0000","last_change":"2024-09-12T12:24:16.401679+0000","last_active":"2024-09-12T12:24:17.376118+0000","last_peered":"2024-09-12T12:24:17.376118+0000","last_clean":"2024-09-12T12:24:17.376118+0000","last_became_active":"2024-09-12T12:24:16.401427+0000","last_became_peered":"2024-09-12T12:24:16.401427+0000","last_unstale":"2024-09-12T12:24:17.376118+0000","last_undegraded":"2024-09-12T12:24:17.376118+0000","last_fullsized":"2024-09-12T12:24:17.376118+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:33.370897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376014+0000","last_change":"2024-09-12T12:24:16.389730+0000","last_active":"2024-09-12T12:24:17.376014+0000","last_peered":"2024-09-12T12:24:17.376014+0000","last_clean":"2024-09-12T12:24:17.376014+0000","last_became_active":"2024-09-12T12:24:16.388457+0000","last_became_peered":"2024-09-12T12:24:16.388457+0000","last_unstale":"2024-09-12T12:24:17.376014+0000","last_undegraded":"2024-09-12T12:24:17.376014+0000","last_fullsized":"2024-09-12T12:24:17.376014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:30.253279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614643+0000","last_change":"2024-09-12T12:24:16.408247+0000","last_active":"2024-09-12T12:24:18.614643+0000","last_peered":"2024-09-12T12:24:18.614643+0000","last_clean":"2024-09-12T12:24:18.614643+0000","last_became_active":"2024-09-12T12:24:16.406896+0000","last_became_peered":"2024-09-12T12:24:16.406896+0000","last_unstale":"2024-09-12T12:24:18.614643+0000","last_undegraded":"2024-09-12T12:24:18.614643+0000","last_fullsized":"2024-09-12T12:24:18.614643+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:41.568837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376092+0000","last_change":"2024-09-12T12:24:16.395602+0000","last_active":"2024-09-12T12:24:17.376092+0000","last_peered":"2024-09-12T12:24:17.376092+0000","last_clean":"2024-09-12T12:24:17.376092+0000","last_became_active":"2024-09-12T12:24:16.395302+0000","last_became_peered":"2024-09-12T12:24:16.395302+0000","last_unstale":"2024-09-12T12:24:17.376092+0000","last_undegraded":"2024-09-12T12:24:17.376092+0000","last_fullsized":"2024-09-12T12:24:17.376092+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:37.307464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402587+0000","last_change":"2024-09-12T12:24:16.391686+0000","last_active":"2024-09-12T12:24:17.402587+0000","last_peered":"2024-09-12T12:24:17.402587+0000","last_clean":"2024-09-12T12:24:17.402587+0000","last_became_active":"2024-09-12T12:24:16.391350+0000","last_became_peered":"2024-09-12T12:24:16.391350+0000","last_unstale":"2024-09-12T12:24:17.402587+0000","last_undegraded":"2024-09-12T12:24:17.402587+0000","last_fullsized":"2024-09-12T12:24:17.402587+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:49:56.998916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070631+0000","last_change":"2024-09-12T12:24:16.396345+0000","last_active":"2024-09-12T12:24:18.070631+0000","last_peered":"2024-09-12T12:24:18.070631+0000","last_clean":"2024-09-12T12:24:18.070631+0000","last_became_active":"2024-09-12T12:24:16.395947+0000","last_became_peered":"2024-09-12T12:24:16.395947+0000","last_unstale":"2024-09-12T12:24:18.070631+0000","last_undegraded":"2024-09-12T12:24:18.070631+0000","last_fullsized":"2024-09-12T12:24:18.070631+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:29.398497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614874+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:18.614874+0000","last_peered":"2024-09-12T12:24:18.614874+0000","last_clean":"2024-09-12T12:24:18.614874+0000","last_became_active":"2024-09-12T12:24:16.399490+0000","last_became_peered":"2024-09-12T12:24:16.399490+0000","last_unstale":"2024-09-12T12:24:18.614874+0000","last_undegraded":"2024-09-12T12:24:18.614874+0000","last_fullsized":"2024-09-12T12:24:18.614874+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:40.136783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:16.398270+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:16.397722+0000","last_became_peered":"2024-09-12T12:24:16.397722+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:26.658081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070437+0000","last_change":"2024-09-12T12:24:16.405818+0000","last_active":"2024-09-12T12:24:18.070437+0000","last_peered":"2024-09-12T12:24:18.070437+0000","last_clean":"2024-09-12T12:24:18.070437+0000","last_became_active":"2024-09-12T12:24:16.405396+0000","last_became_peered":"2024-09-12T12:24:16.405396+0000","last_unstale":"2024-09-12T12:24:18.070437+0000","last_undegraded":"2024-09-12T12:24:18.070437+0000","last_fullsized":"2024-09-12T12:24:18.070437+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:53.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070239+0000","last_change":"2024-09-12T12:24:16.407758+0000","last_active":"2024-09-12T12:24:18.070239+0000","last_peered":"2024-09-12T12:24:18.070239+0000","last_clean":"2024-09-12T12:24:18.070239+0000","last_became_active":"2024-09-12T12:24:16.407508+0000","last_became_peered":"2024-09-12T12:24:16.407508+0000","last_unstale":"2024-09-12T12:24:18.070239+0000","last_undegraded":"2024-09-12T12:24:18.070239+0000","last_fullsized":"2024-09-12T12:24:18.070239+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:08.809853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402121+0000","last_change":"2024-09-12T12:24:16.405155+0000","last_active":"2024-09-12T12:24:17.402121+0000","last_peered":"2024-09-12T12:24:17.402121+0000","last_clean":"2024-09-12T12:24:17.402121+0000","last_became_active":"2024-09-12T12:24:16.404882+0000","last_became_peered":"2024-09-12T12:24:16.404882+0000","last_unstale":"2024-09-12T12:24:17.402121+0000","last_undegraded":"2024-09-12T12:24:17.402121+0000","last_fullsized":"2024-09-12T12:24:17.402121+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:18.643188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614001+0000","last_change":"2024-09-12T12:24:16.387749+0000","last_active":"2024-09-12T12:24:18.614001+0000","last_peered":"2024-09-12T12:24:18.614001+0000","last_clean":"2024-09-12T12:24:18.614001+0000","last_became_active":"2024-09-12T12:24:16.387503+0000","last_became_peered":"2024-09-12T12:24:16.387503+0000","last_unstale":"2024-09-12T12:24:18.614001+0000","last_undegraded":"2024-09-12T12:24:18.614001+0000","last_fullsized":"2024-09-12T12:24:18.614001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:59.828091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614916+0000","last_change":"2024-09-12T12:24:16.397982+0000","last_active":"2024-09-12T12:24:18.614916+0000","last_peered":"2024-09-12T12:24:18.614916+0000","last_clean":"2024-09-12T12:24:18.614916+0000","last_became_active":"2024-09-12T12:24:16.397718+0000","last_became_peered":"2024-09-12T12:24:16.397718+0000","last_unstale":"2024-09-12T12:24:18.614916+0000","last_undegraded":"2024-09-12T12:24:18.614916+0000","last_fullsized":"2024-09-12T12:24:18.614916+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367971+0000","last_change":"2024-09-12T12:24:14.367971+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367971+0000","last_undegraded":"2024-09-12T12:24:14.367971+0000","last_fullsized":"2024-09-12T12:24:14.367971+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402547+0000","last_change":"2024-09-12T12:24:16.399030+0000","last_active":"2024-09-12T12:24:17.402547+0000","last_peered":"2024-09-12T12:24:17.402547+0000","last_clean":"2024-09-12T12:24:17.402547+0000","last_became_active":"2024-09-12T12:24:16.398598+0000","last_became_peered":"2024-09-12T12:24:16.398598+0000","last_unstale":"2024-09-12T12:24:17.402547+0000","last_undegraded":"2024-09-12T12:24:17.402547+0000","last_fullsized":"2024-09-12T12:24:17.402547+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:38.682077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614535+0000","last_change":"2024-09-12T12:24:15.399932+0000","last_active":"2024-09-12T12:24:18.614535+0000","last_peered":"2024-09-12T12:24:18.614535+0000","last_clean":"2024-09-12T12:24:18.614535+0000","last_became_active":"2024-09-12T12:24:15.399298+0000","last_became_peered":"2024-09-12T12:24:15.399298+0000","last_unstale":"2024-09-12T12:24:18.614535+0000","last_undegraded":"2024-09-12T12:24:18.614535+0000","last_fullsized":"2024-09-12T12:24:18.614535+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:49.018706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070727+0000","last_change":"2024-09-12T12:24:16.397252+0000","last_active":"2024-09-12T12:24:18.070727+0000","last_peered":"2024-09-12T12:24:18.070727+0000","last_clean":"2024-09-12T12:24:18.070727+0000","last_became_active":"2024-09-12T12:24:16.396964+0000","last_became_peered":"2024-09-12T12:24:16.396964+0000","last_unstale":"2024-09-12T12:24:18.070727+0000","last_undegraded":"2024-09-12T12:24:18.070727+0000","last_fullsized":"2024-09-12T12:24:18.070727+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:16.827590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070399+0000","last_change":"2024-09-12T12:24:15.388771+0000","last_active":"2024-09-12T12:24:18.070399+0000","last_peered":"2024-09-12T12:24:18.070399+0000","last_clean":"2024-09-12T12:24:18.070399+0000","last_became_active":"2024-09-12T12:24:15.388489+0000","last_became_peered":"2024-09-12T12:24:15.388489+0000","last_unstale":"2024-09-12T12:24:18.070399+0000","last_undegraded":"2024-09-12T12:24:18.070399+0000","last_fullsized":"2024-09-12T12:24:18.070399+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.638923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377349+0000","last_change":"2024-09-12T12:24:16.398321+0000","last_active":"2024-09-12T12:24:17.377349+0000","last_peered":"2024-09-12T12:24:17.377349+0000","last_clean":"2024-09-12T12:24:17.377349+0000","last_became_active":"2024-09-12T12:24:16.398059+0000","last_became_peered":"2024-09-12T12:24:16.398059+0000","last_unstale":"2024-09-12T12:24:17.377349+0000","last_undegraded":"2024-09-12T12:24:17.377349+0000","last_fullsized":"2024-09-12T12:24:17.377349+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:49.642450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377968+0000","last_change":"2024-09-12T12:24:15.392075+0000","last_active":"2024-09-12T12:24:17.377968+0000","last_peered":"2024-09-12T12:24:17.377968+0000","last_clean":"2024-09-12T12:24:17.377968+0000","last_became_active":"2024-09-12T12:24:15.391802+0000","last_became_peered":"2024-09-12T12:24:15.391802+0000","last_unstale":"2024-09-12T12:24:17.377968+0000","last_undegraded":"2024-09-12T12:24:17.377968+0000","last_fullsized":"2024-09-12T12:24:17.377968+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377422+0000","last_change":"2024-09-12T12:24:16.390477+0000","last_active":"2024-09-12T12:24:17.377422+0000","last_peered":"2024-09-12T12:24:17.377422+0000","last_clean":"2024-09-12T12:24:17.377422+0000","last_became_active":"2024-09-12T12:24:16.390202+0000","last_became_peered":"2024-09-12T12:24:16.390202+0000","last_unstale":"2024-09-12T12:24:17.377422+0000","last_undegraded":"2024-09-12T12:24:17.377422+0000","last_fullsized":"2024-09-12T12:24:17.377422+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:06.504087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614269+0000","last_change":"2024-09-12T12:24:15.401541+0000","last_active":"2024-09-12T12:24:18.614269+0000","last_peered":"2024-09-12T12:24:18.614269+0000","last_clean":"2024-09-12T12:24:18.614269+0000","last_became_active":"2024-09-12T12:24:15.400546+0000","last_became_peered":"2024-09-12T12:24:15.400546+0000","last_unstale":"2024-09-12T12:24:18.614269+0000","last_undegraded":"2024-09-12T12:24:18.614269+0000","last_fullsized":"2024-09-12T12:24:18.614269+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:22.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376083+0000","last_change":"2024-09-12T12:24:16.394306+0000","last_active":"2024-09-12T12:24:17.376083+0000","last_peered":"2024-09-12T12:24:17.376083+0000","last_clean":"2024-09-12T12:24:17.376083+0000","last_became_active":"2024-09-12T12:24:16.394065+0000","last_became_peered":"2024-09-12T12:24:16.394065+0000","last_unstale":"2024-09-12T12:24:17.376083+0000","last_undegraded":"2024-09-12T12:24:17.376083+0000","last_fullsized":"2024-09-12T12:24:17.376083+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:01.040775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367747+0000","last_change":"2024-09-12T12:24:14.367747+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367747+0000","last_undegraded":"2024-09-12T12:24:14.367747+0000","last_fullsized":"2024-09-12T12:24:14.367747+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376277+0000","last_change":"2024-09-12T12:24:16.398115+0000","last_active":"2024-09-12T12:24:17.376277+0000","last_peered":"2024-09-12T12:24:17.376277+0000","last_clean":"2024-09-12T12:24:17.376277+0000","last_became_active":"2024-09-12T12:24:16.397797+0000","last_became_peered":"2024-09-12T12:24:16.397797+0000","last_unstale":"2024-09-12T12:24:17.376277+0000","last_undegraded":"2024-09-12T12:24:17.376277+0000","last_fullsized":"2024-09-12T12:24:17.376277+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:52.182844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377746+0000","last_change":"2024-09-12T12:24:15.391060+0000","last_active":"2024-09-12T12:24:17.377746+0000","last_peered":"2024-09-12T12:24:17.377746+0000","last_clean":"2024-09-12T12:24:17.377746+0000","last_became_active":"2024-09-12T12:24:15.390781+0000","last_became_peered":"2024-09-12T12:24:15.390781+0000","last_unstale":"2024-09-12T12:24:17.377746+0000","last_undegraded":"2024-09-12T12:24:17.377746+0000","last_fullsized":"2024-09-12T12:24:17.377746+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:34.109701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614981+0000","last_change":"2024-09-12T12:24:16.395507+0000","last_active":"2024-09-12T12:24:18.614981+0000","last_peered":"2024-09-12T12:24:18.614981+0000","last_clean":"2024-09-12T12:24:18.614981+0000","last_became_active":"2024-09-12T12:24:16.395221+0000","last_became_peered":"2024-09-12T12:24:16.395221+0000","last_unstale":"2024-09-12T12:24:18.614981+0000","last_undegraded":"2024-09-12T12:24:18.614981+0000","last_fullsized":"2024-09-12T12:24:18.614981+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614536+0000","last_change":"2024-09-12T12:24:15.396881+0000","last_active":"2024-09-12T12:24:18.614536+0000","last_peered":"2024-09-12T12:24:18.614536+0000","last_clean":"2024-09-12T12:24:18.614536+0000","last_became_active":"2024-09-12T12:24:15.396494+0000","last_became_peered":"2024-09-12T12:24:15.396494+0000","last_unstale":"2024-09-12T12:24:18.614536+0000","last_undegraded":"2024-09-12T12:24:18.614536+0000","last_fullsized":"2024-09-12T12:24:18.614536+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:10.076168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614438+0000","last_change":"2024-09-12T12:24:16.390011+0000","last_active":"2024-09-12T12:24:18.614438+0000","last_peered":"2024-09-12T12:24:18.614438+0000","last_clean":"2024-09-12T12:24:18.614438+0000","last_became_active":"2024-09-12T12:24:16.389735+0000","last_became_peered":"2024-09-12T12:24:16.389735+0000","last_unstale":"2024-09-12T12:24:18.614438+0000","last_undegraded":"2024-09-12T12:24:18.614438+0000","last_fullsized":"2024-09-12T12:24:18.614438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:57.836183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376367+0000","last_change":"2024-09-12T12:24:15.399114+0000","last_active":"2024-09-12T12:24:17.376367+0000","last_peered":"2024-09-12T12:24:17.376367+0000","last_clean":"2024-09-12T12:24:17.376367+0000","last_became_active":"2024-09-12T12:24:15.398674+0000","last_became_peered":"2024-09-12T12:24:15.398674+0000","last_unstale":"2024-09-12T12:24:17.376367+0000","last_undegraded":"2024-09-12T12:24:17.376367+0000","last_fullsized":"2024-09-12T12:24:17.376367+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:48.465962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378417+0000","last_change":"2024-09-12T12:24:16.399719+0000","last_active":"2024-09-12T12:24:17.378417+0000","last_peered":"2024-09-12T12:24:17.378417+0000","last_clean":"2024-09-12T12:24:17.378417+0000","last_became_active":"2024-09-12T12:24:16.399424+0000","last_became_peered":"2024-09-12T12:24:16.399424+0000","last_unstale":"2024-09-12T12:24:17.378417+0000","last_undegraded":"2024-09-12T12:24:17.378417+0000","last_fullsized":"2024-09-12T12:24:17.378417+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:45.872966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367273+0000","last_change":"2024-09-12T12:24:14.367273+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367273+0000","last_undegraded":"2024-09-12T12:24:14.367273+0000","last_fullsized":"2024-09-12T12:24:14.367273+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376580+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:17.376580+0000","last_peered":"2024-09-12T12:24:17.376580+0000","last_clean":"2024-09-12T12:24:17.376580+0000","last_became_active":"2024-09-12T12:24:16.399517+0000","last_became_peered":"2024-09-12T12:24:16.399517+0000","last_unstale":"2024-09-12T12:24:17.376580+0000","last_undegraded":"2024-09-12T12:24:17.376580+0000","last_fullsized":"2024-09-12T12:24:17.376580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:36.668056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"175'6","reported_seq":20,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377972+0000","last_change":"2024-09-12T12:24:15.389229+0000","last_active":"2024-09-12T12:24:17.377972+0000","last_peered":"2024-09-12T12:24:17.377972+0000","last_clean":"2024-09-12T12:24:17.377972+0000","last_became_active":"2024-09-12T12:24:15.388660+0000","last_became_peered":"2024-09-12T12:24:15.388660+0000","last_unstale":"2024-09-12T12:24:17.377972+0000","last_undegraded":"2024-09-12T12:24:17.377972+0000","last_fullsized":"2024-09-12T12:24:17.377972+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:02.449575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402106+0000","last_change":"2024-09-12T12:24:16.399205+0000","last_active":"2024-09-12T12:24:17.402106+0000","last_peered":"2024-09-12T12:24:17.402106+0000","last_clean":"2024-09-12T12:24:17.402106+0000","last_became_active":"2024-09-12T12:24:16.398875+0000","last_became_peered":"2024-09-12T12:24:16.398875+0000","last_unstale":"2024-09-12T12:24:17.402106+0000","last_undegraded":"2024-09-12T12:24:17.402106+0000","last_fullsized":"2024-09-12T12:24:17.402106+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:47.257395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378190+0000","last_change":"2024-09-12T12:24:15.385396+0000","last_active":"2024-09-12T12:24:17.378190+0000","last_peered":"2024-09-12T12:24:17.378190+0000","last_clean":"2024-09-12T12:24:17.378190+0000","last_became_active":"2024-09-12T12:24:15.385095+0000","last_became_peered":"2024-09-12T12:24:15.385095+0000","last_unstale":"2024-09-12T12:24:17.378190+0000","last_undegraded":"2024-09-12T12:24:17.378190+0000","last_fullsized":"2024-09-12T12:24:17.378190+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613984+0000","last_change":"2024-09-12T12:24:16.390955+0000","last_active":"2024-09-12T12:24:18.613984+0000","last_peered":"2024-09-12T12:24:18.613984+0000","last_clean":"2024-09-12T12:24:18.613984+0000","last_became_active":"2024-09-12T12:24:16.388418+0000","last_became_peered":"2024-09-12T12:24:16.388418+0000","last_unstale":"2024-09-12T12:24:18.613984+0000","last_undegraded":"2024-09-12T12:24:18.613984+0000","last_fullsized":"2024-09-12T12:24:18.613984+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:40.208012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376309+0000","last_change":"2024-09-12T12:24:15.395867+0000","last_active":"2024-09-12T12:24:17.376309+0000","last_peered":"2024-09-12T12:24:17.376309+0000","last_clean":"2024-09-12T12:24:17.376309+0000","last_became_active":"2024-09-12T12:24:15.395594+0000","last_became_peered":"2024-09-12T12:24:15.395594+0000","last_unstale":"2024-09-12T12:24:17.376309+0000","last_undegraded":"2024-09-12T12:24:17.376309+0000","last_fullsized":"2024-09-12T12:24:17.376309+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:41.348309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377938+0000","last_change":"2024-09-12T12:24:16.387185+0000","last_active":"2024-09-12T12:24:17.377938+0000","last_peered":"2024-09-12T12:24:17.377938+0000","last_clean":"2024-09-12T12:24:17.377938+0000","last_became_active":"2024-09-12T12:24:16.386859+0000","last_became_peered":"2024-09-12T12:24:16.386859+0000","last_unstale":"2024-09-12T12:24:17.377938+0000","last_undegraded":"2024-09-12T12:24:17.377938+0000","last_fullsized":"2024-09-12T12:24:17.377938+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.116554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367234+0000","last_change":"2024-09-12T12:24:14.367234+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367234+0000","last_undegraded":"2024-09-12T12:24:14.367234+0000","last_fullsized":"2024-09-12T12:24:14.367234+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378125+0000","last_change":"2024-09-12T12:24:16.403838+0000","last_active":"2024-09-12T12:24:17.378125+0000","last_peered":"2024-09-12T12:24:17.378125+0000","last_clean":"2024-09-12T12:24:17.378125+0000","last_became_active":"2024-09-12T12:24:16.403611+0000","last_became_peered":"2024-09-12T12:24:16.403611+0000","last_unstale":"2024-09-12T12:24:17.378125+0000","last_undegraded":"2024-09-12T12:24:17.378125+0000","last_fullsized":"2024-09-12T12:24:17.378125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:38.894390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"175'8","reported_seq":22,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070217+0000","last_change":"2024-09-12T12:24:15.388767+0000","last_active":"2024-09-12T12:24:18.070217+0000","last_peered":"2024-09-12T12:24:18.070217+0000","last_clean":"2024-09-12T12:24:18.070217+0000","last_became_active":"2024-09-12T12:24:15.388428+0000","last_became_peered":"2024-09-12T12:24:15.388428+0000","last_unstale":"2024-09-12T12:24:18.070217+0000","last_undegraded":"2024-09-12T12:24:18.070217+0000","last_fullsized":"2024-09-12T12:24:18.070217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:53.990844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402245+0000","last_change":"2024-09-12T12:24:16.405120+0000","last_active":"2024-09-12T12:24:17.402245+0000","last_peered":"2024-09-12T12:24:17.402245+0000","last_clean":"2024-09-12T12:24:17.402245+0000","last_became_active":"2024-09-12T12:24:16.404831+0000","last_became_peered":"2024-09-12T12:24:16.404831+0000","last_unstale":"2024-09-12T12:24:17.402245+0000","last_undegraded":"2024-09-12T12:24:17.402245+0000","last_fullsized":"2024-09-12T12:24:17.402245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.752182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070641+0000","last_change":"2024-09-12T12:24:15.394278+0000","last_active":"2024-09-12T12:24:18.070641+0000","last_peered":"2024-09-12T12:24:18.070641+0000","last_clean":"2024-09-12T12:24:18.070641+0000","last_became_active":"2024-09-12T12:24:15.392595+0000","last_became_peered":"2024-09-12T12:24:15.392595+0000","last_unstale":"2024-09-12T12:24:18.070641+0000","last_undegraded":"2024-09-12T12:24:18.070641+0000","last_fullsized":"2024-09-12T12:24:18.070641+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:59.109666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614201+0000","last_change":"2024-09-12T12:24:16.391727+0000","last_active":"2024-09-12T12:24:18.614201+0000","last_peered":"2024-09-12T12:24:18.614201+0000","last_clean":"2024-09-12T12:24:18.614201+0000","last_became_active":"2024-09-12T12:24:16.391468+0000","last_became_peered":"2024-09-12T12:24:16.391468+0000","last_unstale":"2024-09-12T12:24:18.614201+0000","last_undegraded":"2024-09-12T12:24:18.614201+0000","last_fullsized":"2024-09-12T12:24:18.614201+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:56.376971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.368232+0000","last_change":"2024-09-12T12:24:14.368232+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.368232+0000","last_undegraded":"2024-09-12T12:24:14.368232+0000","last_fullsized":"2024-09-12T12:24:14.368232+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070786+0000","last_change":"2024-09-12T12:24:16.397975+0000","last_active":"2024-09-12T12:24:18.070786+0000","last_peered":"2024-09-12T12:24:18.070786+0000","last_clean":"2024-09-12T12:24:18.070786+0000","last_became_active":"2024-09-12T12:24:16.397682+0000","last_became_peered":"2024-09-12T12:24:16.397682+0000","last_unstale":"2024-09-12T12:24:18.070786+0000","last_undegraded":"2024-09-12T12:24:18.070786+0000","last_fullsized":"2024-09-12T12:24:18.070786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:19.982642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377000+0000","last_change":"2024-09-12T12:24:15.398973+0000","last_active":"2024-09-12T12:24:17.377000+0000","last_peered":"2024-09-12T12:24:17.377000+0000","last_clean":"2024-09-12T12:24:17.377000+0000","last_became_active":"2024-09-12T12:24:15.398624+0000","last_became_peered":"2024-09-12T12:24:15.398624+0000","last_unstale":"2024-09-12T12:24:17.377000+0000","last_undegraded":"2024-09-12T12:24:17.377000+0000","last_fullsized":"2024-09-12T12:24:17.377000+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376616+0000","last_change":"2024-09-12T12:24:16.390299+0000","last_active":"2024-09-12T12:24:17.376616+0000","last_peered":"2024-09-12T12:24:17.376616+0000","last_clean":"2024-09-12T12:24:17.376616+0000","last_became_active":"2024-09-12T12:24:16.389754+0000","last_became_peered":"2024-09-12T12:24:16.389754+0000","last_unstale":"2024-09-12T12:24:17.376616+0000","last_undegraded":"2024-09-12T12:24:17.376616+0000","last_fullsized":"2024-09-12T12:24:17.376616+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:52.232681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070516+0000","last_change":"2024-09-12T12:24:15.391813+0000","last_active":"2024-09-12T12:24:18.070516+0000","last_peered":"2024-09-12T12:24:18.070516+0000","last_clean":"2024-09-12T12:24:18.070516+0000","last_became_active":"2024-09-12T12:24:15.391434+0000","last_became_peered":"2024-09-12T12:24:15.391434+0000","last_unstale":"2024-09-12T12:24:18.070516+0000","last_undegraded":"2024-09-12T12:24:18.070516+0000","last_fullsized":"2024-09-12T12:24:18.070516+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:37.887502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375786+0000","last_change":"2024-09-12T12:24:16.401815+0000","last_active":"2024-09-12T12:24:17.375786+0000","last_peered":"2024-09-12T12:24:17.375786+0000","last_clean":"2024-09-12T12:24:17.375786+0000","last_became_active":"2024-09-12T12:24:16.401529+0000","last_became_peered":"2024-09-12T12:24:16.401529+0000","last_unstale":"2024-09-12T12:24:17.375786+0000","last_undegraded":"2024-09-12T12:24:17.375786+0000","last_fullsized":"2024-09-12T12:24:17.375786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378241+0000","last_change":"2024-09-12T12:24:15.399471+0000","last_active":"2024-09-12T12:24:17.378241+0000","last_peered":"2024-09-12T12:24:17.378241+0000","last_clean":"2024-09-12T12:24:17.378241+0000","last_became_active":"2024-09-12T12:24:15.399103+0000","last_became_peered":"2024-09-12T12:24:15.399103+0000","last_unstale":"2024-09-12T12:24:17.378241+0000","last_undegraded":"2024-09-12T12:24:17.378241+0000","last_fullsized":"2024-09-12T12:24:17.378241+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367162+0000","last_change":"2024-09-12T12:24:14.367162+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367162+0000","last_undegraded":"2024-09-12T12:24:14.367162+0000","last_fullsized":"2024-09-12T12:24:14.367162+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402270+0000","last_change":"2024-09-12T12:24:15.398819+0000","last_active":"2024-09-12T12:24:17.402270+0000","last_peered":"2024-09-12T12:24:17.402270+0000","last_clean":"2024-09-12T12:24:17.402270+0000","last_became_active":"2024-09-12T12:24:15.398572+0000","last_became_peered":"2024-09-12T12:24:15.398572+0000","last_unstale":"2024-09-12T12:24:17.402270+0000","last_undegraded":"2024-09-12T12:24:17.402270+0000","last_fullsized":"2024-09-12T12:24:17.402270+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:33.388691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614154+0000","last_change":"2024-09-12T12:24:16.393240+0000","last_active":"2024-09-12T12:24:18.614154+0000","last_peered":"2024-09-12T12:24:18.614154+0000","last_clean":"2024-09-12T12:24:18.614154+0000","last_became_active":"2024-09-12T12:24:16.392939+0000","last_became_peered":"2024-09-12T12:24:16.392939+0000","last_unstale":"2024-09-12T12:24:18.614154+0000","last_undegraded":"2024-09-12T12:24:18.614154+0000","last_fullsized":"2024-09-12T12:24:18.614154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:37.911201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376709+0000","last_change":"2024-09-12T12:24:15.391719+0000","last_active":"2024-09-12T12:24:17.376709+0000","last_peered":"2024-09-12T12:24:17.376709+0000","last_clean":"2024-09-12T12:24:17.376709+0000","last_became_active":"2024-09-12T12:24:15.391451+0000","last_became_peered":"2024-09-12T12:24:15.391451+0000","last_unstale":"2024-09-12T12:24:17.376709+0000","last_undegraded":"2024-09-12T12:24:17.376709+0000","last_fullsized":"2024-09-12T12:24:17.376709+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402376+0000","last_change":"2024-09-12T12:24:16.400257+0000","last_active":"2024-09-12T12:24:17.402376+0000","last_peered":"2024-09-12T12:24:17.402376+0000","last_clean":"2024-09-12T12:24:17.402376+0000","last_became_active":"2024-09-12T12:24:16.399908+0000","last_became_peered":"2024-09-12T12:24:16.399908+0000","last_unstale":"2024-09-12T12:24:17.402376+0000","last_undegraded":"2024-09-12T12:24:17.402376+0000","last_fullsized":"2024-09-12T12:24:17.402376+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:19.882883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.366646+0000","last_change":"2024-09-12T12:24:14.366646+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.366646+0000","last_undegraded":"2024-09-12T12:24:14.366646+0000","last_fullsized":"2024-09-12T12:24:14.366646+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375977+0000","last_change":"2024-09-12T12:24:16.393135+0000","last_active":"2024-09-12T12:24:17.375977+0000","last_peered":"2024-09-12T12:24:17.375977+0000","last_clean":"2024-09-12T12:24:17.375977+0000","last_became_active":"2024-09-12T12:24:16.392886+0000","last_became_peered":"2024-09-12T12:24:16.392886+0000","last_unstale":"2024-09-12T12:24:17.375977+0000","last_undegraded":"2024-09-12T12:24:17.375977+0000","last_fullsized":"2024-09-12T12:24:17.375977+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"176'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402509+0000","last_change":"2024-09-12T12:24:15.398312+0000","last_active":"2024-09-12T12:24:17.402509+0000","last_peered":"2024-09-12T12:24:17.402509+0000","last_clean":"2024-09-12T12:24:17.402509+0000","last_became_active":"2024-09-12T12:24:15.397828+0000","last_became_peered":"2024-09-12T12:24:15.397828+0000","last_unstale":"2024-09-12T12:24:17.402509+0000","last_undegraded":"2024-09-12T12:24:17.402509+0000","last_fullsized":"2024-09-12T12:24:17.402509+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:05.355749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614970+0000","last_change":"2024-09-12T12:24:16.396259+0000","last_active":"2024-09-12T12:24:18.614970+0000","last_peered":"2024-09-12T12:24:18.614970+0000","last_clean":"2024-09-12T12:24:18.614970+0000","last_became_active":"2024-09-12T12:24:16.396001+0000","last_became_peered":"2024-09-12T12:24:16.396001+0000","last_unstale":"2024-09-12T12:24:18.614970+0000","last_undegraded":"2024-09-12T12:24:18.614970+0000","last_fullsized":"2024-09-12T12:24:18.614970+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614336+0000","last_change":"2024-09-12T12:24:15.401539+0000","last_active":"2024-09-12T12:24:18.614336+0000","last_peered":"2024-09-12T12:24:18.614336+0000","last_clean":"2024-09-12T12:24:18.614336+0000","last_became_active":"2024-09-12T12:24:15.400457+0000","last_became_peered":"2024-09-12T12:24:15.400457+0000","last_unstale":"2024-09-12T12:24:18.614336+0000","last_undegraded":"2024-09-12T12:24:18.614336+0000","last_fullsized":"2024-09-12T12:24:18.614336+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:00:53.932314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402584+0000","last_change":"2024-09-12T12:24:16.399098+0000","last_active":"2024-09-12T12:24:17.402584+0000","last_peered":"2024-09-12T12:24:17.402584+0000","last_clean":"2024-09-12T12:24:17.402584+0000","last_became_active":"2024-09-12T12:24:16.398823+0000","last_became_peered":"2024-09-12T12:24:16.398823+0000","last_unstale":"2024-09-12T12:24:17.402584+0000","last_undegraded":"2024-09-12T12:24:17.402584+0000","last_fullsized":"2024-09-12T12:24:17.402584+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:20.717320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:15.398497+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:15.398186+0000","last_became_peered":"2024-09-12T12:24:15.398186+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:31.161939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376781+0000","last_change":"2024-09-12T12:24:16.389008+0000","last_active":"2024-09-12T12:24:17.376781+0000","last_peered":"2024-09-12T12:24:17.376781+0000","last_clean":"2024-09-12T12:24:17.376781+0000","last_became_active":"2024-09-12T12:24:16.388763+0000","last_became_peered":"2024-09-12T12:24:16.388763+0000","last_unstale":"2024-09-12T12:24:17.376781+0000","last_undegraded":"2024-09-12T12:24:17.376781+0000","last_fullsized":"2024-09-12T12:24:17.376781+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.252266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614577+0000","last_change":"2024-09-12T12:24:15.392333+0000","last_active":"2024-09-12T12:24:18.614577+0000","last_peered":"2024-09-12T12:24:18.614577+0000","last_clean":"2024-09-12T12:24:18.614577+0000","last_became_active":"2024-09-12T12:24:15.390965+0000","last_became_peered":"2024-09-12T12:24:15.390965+0000","last_unstale":"2024-09-12T12:24:18.614577+0000","last_undegraded":"2024-09-12T12:24:18.614577+0000","last_fullsized":"2024-09-12T12:24:18.614577+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.211150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377869+0000","last_change":"2024-09-12T12:24:16.383386+0000","last_active":"2024-09-12T12:24:17.377869+0000","last_peered":"2024-09-12T12:24:17.377869+0000","last_clean":"2024-09-12T12:24:17.377869+0000","last_became_active":"2024-09-12T12:24:16.383081+0000","last_became_peered":"2024-09-12T12:24:16.383081+0000","last_unstale":"2024-09-12T12:24:17.377869+0000","last_undegraded":"2024-09-12T12:24:17.377869+0000","last_fullsized":"2024-09-12T12:24:17.377869+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.997732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614411+0000","last_change":"2024-09-12T12:24:15.398042+0000","last_active":"2024-09-12T12:24:18.614411+0000","last_peered":"2024-09-12T12:24:18.614411+0000","last_clean":"2024-09-12T12:24:18.614411+0000","last_became_active":"2024-09-12T12:24:15.397831+0000","last_became_peered":"2024-09-12T12:24:15.397831+0000","last_unstale":"2024-09-12T12:24:18.614411+0000","last_undegraded":"2024-09-12T12:24:18.614411+0000","last_fullsized":"2024-09-12T12:24:18.614411+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.073587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376395+0000","last_change":"2024-09-12T12:24:16.391725+0000","last_active":"2024-09-12T12:24:17.376395+0000","last_peered":"2024-09-12T12:24:17.376395+0000","last_clean":"2024-09-12T12:24:17.376395+0000","last_became_active":"2024-09-12T12:24:16.391417+0000","last_became_peered":"2024-09-12T12:24:16.391417+0000","last_unstale":"2024-09-12T12:24:17.376395+0000","last_undegraded":"2024-09-12T12:24:17.376395+0000","last_fullsized":"2024-09-12T12:24:17.376395+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:48.466637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402272+0000","last_change":"2024-09-12T12:24:15.389928+0000","last_active":"2024-09-12T12:24:17.402272+0000","last_peered":"2024-09-12T12:24:17.402272+0000","last_clean":"2024-09-12T12:24:17.402272+0000","last_became_active":"2024-09-12T12:24:15.389340+0000","last_became_peered":"2024-09-12T12:24:15.389340+0000","last_unstale":"2024-09-12T12:24:17.402272+0000","last_undegraded":"2024-09-12T12:24:17.402272+0000","last_fullsized":"2024-09-12T12:24:17.402272+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:15.606771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614638+0000","last_change":"2024-09-12T12:24:16.407188+0000","last_active":"2024-09-12T12:24:18.614638+0000","last_peered":"2024-09-12T12:24:18.614638+0000","last_clean":"2024-09-12T12:24:18.614638+0000","last_became_active":"2024-09-12T12:24:16.406874+0000","last_became_peered":"2024-09-12T12:24:16.406874+0000","last_unstale":"2024-09-12T12:24:18.614638+0000","last_undegraded":"2024-09-12T12:24:18.614638+0000","last_fullsized":"2024-09-12T12:24:18.614638+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:20.527705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376860+0000","last_change":"2024-09-12T12:24:15.394140+0000","last_active":"2024-09-12T12:24:17.376860+0000","last_peered":"2024-09-12T12:24:17.376860+0000","last_clean":"2024-09-12T12:24:17.376860+0000","last_became_active":"2024-09-12T12:24:15.393853+0000","last_became_peered":"2024-09-12T12:24:15.393853+0000","last_unstale":"2024-09-12T12:24:17.376860+0000","last_undegraded":"2024-09-12T12:24:17.376860+0000","last_fullsized":"2024-09-12T12:24:17.376860+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377325+0000","last_change":"2024-09-12T12:24:16.389657+0000","last_active":"2024-09-12T12:24:17.377325+0000","last_peered":"2024-09-12T12:24:17.377325+0000","last_clean":"2024-09-12T12:24:17.377325+0000","last_became_active":"2024-09-12T12:24:16.389393+0000","last_became_peered":"2024-09-12T12:24:16.389393+0000","last_unstale":"2024-09-12T12:24:17.377325+0000","last_undegraded":"2024-09-12T12:24:17.377325+0000","last_fullsized":"2024-09-12T12:24:17.377325+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:43.184029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367329+0000","last_change":"2024-09-12T12:24:14.367329+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367329+0000","last_undegraded":"2024-09-12T12:24:14.367329+0000","last_fullsized":"2024-09-12T12:24:14.367329+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":455,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614607+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:24:18.614607+0000","last_peered":"2024-09-12T12:24:18.614607+0000","last_clean":"2024-09-12T12:24:18.614607+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:24:18.614607+0000","last_undegraded":"2024-09-12T12:24:18.614607+0000","last_fullsized":"2024-09-12T12:24:18.614607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51980,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319860,"statfs":{"total":96636764160,"available":96583536640,"internally_reserved":0,"allocated":2809856,"data_stored":1637923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51404,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320436,"statfs":{"total":96636764160,"available":96584126464,"internally_reserved":0,"allocated":2220032,"data_stored":1047625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51416,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320424,"statfs":{"total":96636764160,"available":96584114176,"internally_reserved":0,"allocated":2232320,"data_stored":1049189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59740,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312100,"statfs":{"total":96636764160,"available":96575590400,"internally_reserved":0,"allocated":2232320,"data_stored":1049201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2224128,"data_stored":1047715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":58915272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2220032,"data_stored":1048137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2215936,"data_stored":1047555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56104,"kb_used_data":2708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315736,"statfs":{"total":96636764160,"available":96579313664,"internally_reserved":0,"allocated":2772992,"data_stored":1617397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:20.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:24:21.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.028+0000 7f15b3a00640 1 Processor -- start 2024-09-12T12:24:21.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.028+0000 7f15b3a00640 1 -- start start 2024-09-12T12:24:21.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b3a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f15ac15b4e0 0x7f15ac0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b3a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f15ac0b3ad0 0x7f15ac071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b3a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15ac0b45a0 con 0x7f15ac071960 2024-09-12T12:24:21.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b3a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f15ac0b3fe0 con 0x7f15ac15b4e0 2024-09-12T12:24:21.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b3a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f15ac0b42c0 con 0x7f15ac0b3ad0 2024-09-12T12:24:21.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b1a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f15ac071960 0x7f15ac0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53090/0 (socket says 172.21.15.144:53090) 2024-09-12T12:24:21.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b1a00640 1 -- 172.21.15.144:0/2661666408 learned_addr learned my addr 172.21.15.144:0/2661666408 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:21.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b1000640 1 --2- 172.21.15.144:0/2661666408 >> v2:172.21.15.144:3300/0 conn(0x7f15ac15b4e0 0x7f15ac0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15abe00640 1 --2- 172.21.15.144:0/2661666408 >> v2:172.21.15.165:3300/0 conn(0x7f15ac0b3ad0 0x7f15ac071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b1000640 1 -- 172.21.15.144:0/2661666408 >> v2:172.21.15.165:3300/0 conn(0x7f15ac0b3ad0 msgr2=0x7f15ac071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:21.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b1000640 1 --2- 172.21.15.144:0/2661666408 >> v2:172.21.15.165:3300/0 conn(0x7f15ac0b3ad0 0x7f15ac071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b1000640 1 -- 172.21.15.144:0/2661666408 >> v1:172.21.15.144:6789/0 conn(0x7f15ac071960 legacy=0x7f15ac0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15b1000640 1 -- 172.21.15.144:0/2661666408 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac0b1490 con 0x7f15ac15b4e0 2024-09-12T12:24:21.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.032+0000 7f15ab400640 1 -- 172.21.15.144:0/2661666408 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375179856 0 0) 0x7f15ac0b45a0 con 0x7f15ac071960 2024-09-12T12:24:21.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b1000640 1 --2- 172.21.15.144:0/2661666408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 0x7f15ac0b3590 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0b02b0 tx=0x7f159c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdb5345e90417e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15ab400640 1 -- 172.21.15.144:0/2661666408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0b2070 con 0x7f15ac15b4e0 2024-09-12T12:24:21.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15ab400640 1 -- 172.21.15.144:0/2661666408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159c0a59e0 con 0x7f15ac15b4e0 2024-09-12T12:24:21.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15ab400640 1 -- 172.21.15.144:0/2661666408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0a5db0 con 0x7f15ac15b4e0 2024-09-12T12:24:21.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 -- 172.21.15.144:0/2661666408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 msgr2=0x7f15ac0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 --2- 172.21.15.144:0/2661666408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 0x7f15ac0b3590 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0b02b0 tx=0x7f159c01c900 comp rx=0 tx=0).stop 2024-09-12T12:24:21.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 -- 172.21.15.144:0/2661666408 shutdown_connections 2024-09-12T12:24:21.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 --2- 172.21.15.144:0/2661666408 >> v2:172.21.15.165:3300/0 conn(0x7f15ac0b3ad0 0x7f15ac071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 --2- 172.21.15.144:0/2661666408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 0x7f15ac0b3590 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 -- 172.21.15.144:0/2661666408 >> 172.21.15.144:0/2661666408 conn(0x7f15ac06d0d0 msgr2=0x7f15ac06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:21.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 -- 172.21.15.144:0/2661666408 shutdown_connections 2024-09-12T12:24:21.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 -- 172.21.15.144:0/2661666408 wait complete. 2024-09-12T12:24:21.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 Processor -- start 2024-09-12T12:24:21.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.036+0000 7f15b3a00640 1 -- start start 2024-09-12T12:24:21.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b3a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15ac071960 0x7f15ac148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b3a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15ac0b3ad0 0x7f15ac1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b3a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 0x7f15ac146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b3a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac0b2620 con 0x7f15ac15b4e0 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b3a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac0b24a0 con 0x7f15ac071960 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b3a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f15ac0cd640 con 0x7f15ac0b3ad0 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 0x7f15ac146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 0x7f15ac146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36456/0 (socket says 172.21.15.144:36456) 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1a00640 1 -- 172.21.15.144:0/802216151 learned_addr learned my addr 172.21.15.144:0/802216151 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1000640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15ac071960 0x7f15ac148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15abe00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15ac0b3ad0 0x7f15ac1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1a00640 1 -- 172.21.15.144:0/802216151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15ac0b3ad0 msgr2=0x7f15ac1511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1a00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15ac0b3ad0 0x7f15ac1511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1a00640 1 -- 172.21.15.144:0/802216151 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15ac071960 msgr2=0x7f15ac148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1a00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15ac071960 0x7f15ac148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1a00640 1 -- 172.21.15.144:0/802216151 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac14eb40 con 0x7f15ac15b4e0 2024-09-12T12:24:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b1a00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 0x7f15ac146010 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c4b0 tx=0x7f15a400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15a8c00640 1 -- 172.21.15.144:0/802216151 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4018070 con 0x7f15ac15b4e0 2024-09-12T12:24:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15a8c00640 1 -- 172.21.15.144:0/802216151 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a40074e0 con 0x7f15ac15b4e0 2024-09-12T12:24:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ac14ede0 con 0x7f15ac15b4e0 2024-09-12T12:24:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15a8c00640 1 -- 172.21.15.144:0/802216151 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4004a30 con 0x7f15ac15b4e0 2024-09-12T12:24:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ac14f3a0 con 0x7f15ac15b4e0 2024-09-12T12:24:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15ac071420 con 0x7f15ac15b4e0 2024-09-12T12:24:21.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.040+0000 7f15a8c00640 1 -- 172.21.15.144:0/802216151 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15a401b070 con 0x7f15ac15b4e0 2024-09-12T12:24:21.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.044+0000 7f15a8c00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f158c0678c0 0x7f158c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.044+0000 7f15a8c00640 1 -- 172.21.15.144:0/802216151 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f15a4084fd0 con 0x7f15ac15b4e0 2024-09-12T12:24:21.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.044+0000 7f15b1000640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f158c0678c0 0x7f158c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.044+0000 7f15b1000640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f158c0678c0 0x7f158c069d80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f159c0af000 tx=0x7f159c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.048+0000 7f15a8c00640 1 -- 172.21.15.144:0/802216151 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f15a4055320 con 0x7f15ac15b4e0 2024-09-12T12:24:21.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.204+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15ac14fba0 con 0x7f158c0678c0 2024-09-12T12:24:21.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.208+0000 7f15a8c00640 1 -- 172.21.15.144:0/802216151 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251112 (secure 0 0 0) 0x7f159c0b3040 con 0x7f158c0678c0 2024-09-12T12:24:21.211 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:21.213 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:24:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f158c0678c0 msgr2=0x7f158c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f158c0678c0 0x7f158c069d80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f159c0af000 tx=0x7f159c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:24:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 msgr2=0x7f15ac146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 0x7f15ac146010 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c4b0 tx=0x7f15a400c970 comp rx=0 tx=0).stop 2024-09-12T12:24:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 shutdown_connections 2024-09-12T12:24:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f158c0678c0 0x7f158c069d80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15ac15b4e0 0x7f15ac146010 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f15ac0b3ad0 0x7f15ac1511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 --2- 172.21.15.144:0/802216151 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15ac071960 0x7f15ac148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 >> 172.21.15.144:0/802216151 conn(0x7f15ac06d0d0 msgr2=0x7f15ac071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:21.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 shutdown_connections 2024-09-12T12:24:21.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.212+0000 7f15b3a00640 1 -- 172.21.15.144:0/802216151 wait complete. 2024-09-12T12:24:21.233 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-12T12:24:19.524894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592106,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":445664,"kb_used_data":18484,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754529056,"statfs":{"total":773094113280,"available":772637753344,"internally_reserved":0,"allocated":18927616,"data_stored":9544742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.162310"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376298+0000","last_change":"2024-09-12T12:24:16.395627+0000","last_active":"2024-09-12T12:24:17.376298+0000","last_peered":"2024-09-12T12:24:17.376298+0000","last_clean":"2024-09-12T12:24:17.376298+0000","last_became_active":"2024-09-12T12:24:16.395322+0000","last_became_peered":"2024-09-12T12:24:16.395322+0000","last_unstale":"2024-09-12T12:24:17.376298+0000","last_undegraded":"2024-09-12T12:24:17.376298+0000","last_fullsized":"2024-09-12T12:24:17.376298+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:16.943178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376308+0000","last_change":"2024-09-12T12:24:16.399843+0000","last_active":"2024-09-12T12:24:17.376308+0000","last_peered":"2024-09-12T12:24:17.376308+0000","last_clean":"2024-09-12T12:24:17.376308+0000","last_became_active":"2024-09-12T12:24:16.399540+0000","last_became_peered":"2024-09-12T12:24:16.399540+0000","last_unstale":"2024-09-12T12:24:17.376308+0000","last_undegraded":"2024-09-12T12:24:17.376308+0000","last_fullsized":"2024-09-12T12:24:17.376308+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:18.125453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376939+0000","last_change":"2024-09-12T12:24:16.390401+0000","last_active":"2024-09-12T12:24:17.376939+0000","last_peered":"2024-09-12T12:24:17.376939+0000","last_clean":"2024-09-12T12:24:17.376939+0000","last_became_active":"2024-09-12T12:24:16.390125+0000","last_became_peered":"2024-09-12T12:24:16.390125+0000","last_unstale":"2024-09-12T12:24:17.376939+0000","last_undegraded":"2024-09-12T12:24:17.376939+0000","last_fullsized":"2024-09-12T12:24:17.376939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:13.958791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614197+0000","last_change":"2024-09-12T12:24:16.397905+0000","last_active":"2024-09-12T12:24:18.614197+0000","last_peered":"2024-09-12T12:24:18.614197+0000","last_clean":"2024-09-12T12:24:18.614197+0000","last_became_active":"2024-09-12T12:24:16.397631+0000","last_became_peered":"2024-09-12T12:24:16.397631+0000","last_unstale":"2024-09-12T12:24:18.614197+0000","last_undegraded":"2024-09-12T12:24:18.614197+0000","last_fullsized":"2024-09-12T12:24:18.614197+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:19.720611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614055+0000","last_change":"2024-09-12T12:24:16.405121+0000","last_active":"2024-09-12T12:24:18.614055+0000","last_peered":"2024-09-12T12:24:18.614055+0000","last_clean":"2024-09-12T12:24:18.614055+0000","last_became_active":"2024-09-12T12:24:16.404807+0000","last_became_peered":"2024-09-12T12:24:16.404807+0000","last_unstale":"2024-09-12T12:24:18.614055+0000","last_undegraded":"2024-09-12T12:24:18.614055+0000","last_fullsized":"2024-09-12T12:24:18.614055+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:46.225664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402195+0000","last_change":"2024-09-12T12:24:16.396455+0000","last_active":"2024-09-12T12:24:17.402195+0000","last_peered":"2024-09-12T12:24:17.402195+0000","last_clean":"2024-09-12T12:24:17.402195+0000","last_became_active":"2024-09-12T12:24:16.396163+0000","last_became_peered":"2024-09-12T12:24:16.396163+0000","last_unstale":"2024-09-12T12:24:17.402195+0000","last_undegraded":"2024-09-12T12:24:17.402195+0000","last_fullsized":"2024-09-12T12:24:17.402195+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:51.534062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614642+0000","last_change":"2024-09-12T12:24:16.398847+0000","last_active":"2024-09-12T12:24:18.614642+0000","last_peered":"2024-09-12T12:24:18.614642+0000","last_clean":"2024-09-12T12:24:18.614642+0000","last_became_active":"2024-09-12T12:24:16.398566+0000","last_became_peered":"2024-09-12T12:24:16.398566+0000","last_unstale":"2024-09-12T12:24:18.614642+0000","last_undegraded":"2024-09-12T12:24:18.614642+0000","last_fullsized":"2024-09-12T12:24:18.614642+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:18.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376446+0000","last_change":"2024-09-12T12:24:16.387534+0000","last_active":"2024-09-12T12:24:17.376446+0000","last_peered":"2024-09-12T12:24:17.376446+0000","last_clean":"2024-09-12T12:24:17.376446+0000","last_became_active":"2024-09-12T12:24:16.387258+0000","last_became_peered":"2024-09-12T12:24:16.387258+0000","last_unstale":"2024-09-12T12:24:17.376446+0000","last_undegraded":"2024-09-12T12:24:17.376446+0000","last_fullsized":"2024-09-12T12:24:17.376446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:40.475529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614640+0000","last_change":"2024-09-12T12:24:16.389429+0000","last_active":"2024-09-12T12:24:18.614640+0000","last_peered":"2024-09-12T12:24:18.614640+0000","last_clean":"2024-09-12T12:24:18.614640+0000","last_became_active":"2024-09-12T12:24:16.389118+0000","last_became_peered":"2024-09-12T12:24:16.389118+0000","last_unstale":"2024-09-12T12:24:18.614640+0000","last_undegraded":"2024-09-12T12:24:18.614640+0000","last_fullsized":"2024-09-12T12:24:18.614640+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:17.258071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070564+0000","last_change":"2024-09-12T12:24:16.395888+0000","last_active":"2024-09-12T12:24:18.070564+0000","last_peered":"2024-09-12T12:24:18.070564+0000","last_clean":"2024-09-12T12:24:18.070564+0000","last_became_active":"2024-09-12T12:24:16.395552+0000","last_became_peered":"2024-09-12T12:24:16.395552+0000","last_unstale":"2024-09-12T12:24:18.070564+0000","last_undegraded":"2024-09-12T12:24:18.070564+0000","last_fullsized":"2024-09-12T12:24:18.070564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:42.839292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377994+0000","last_change":"2024-09-12T12:24:16.385909+0000","last_active":"2024-09-12T12:24:17.377994+0000","last_peered":"2024-09-12T12:24:17.377994+0000","last_clean":"2024-09-12T12:24:17.377994+0000","last_became_active":"2024-09-12T12:24:16.385618+0000","last_became_peered":"2024-09-12T12:24:16.385618+0000","last_unstale":"2024-09-12T12:24:17.377994+0000","last_undegraded":"2024-09-12T12:24:17.377994+0000","last_fullsized":"2024-09-12T12:24:17.377994+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.645811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402120+0000","last_change":"2024-09-12T12:24:16.389264+0000","last_active":"2024-09-12T12:24:17.402120+0000","last_peered":"2024-09-12T12:24:17.402120+0000","last_clean":"2024-09-12T12:24:17.402120+0000","last_became_active":"2024-09-12T12:24:16.383477+0000","last_became_peered":"2024-09-12T12:24:16.383477+0000","last_unstale":"2024-09-12T12:24:17.402120+0000","last_undegraded":"2024-09-12T12:24:17.402120+0000","last_fullsized":"2024-09-12T12:24:17.402120+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:00.350364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375908+0000","last_change":"2024-09-12T12:24:16.396038+0000","last_active":"2024-09-12T12:24:17.375908+0000","last_peered":"2024-09-12T12:24:17.375908+0000","last_clean":"2024-09-12T12:24:17.375908+0000","last_became_active":"2024-09-12T12:24:16.395776+0000","last_became_peered":"2024-09-12T12:24:16.395776+0000","last_unstale":"2024-09-12T12:24:17.375908+0000","last_undegraded":"2024-09-12T12:24:17.375908+0000","last_fullsized":"2024-09-12T12:24:17.375908+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613990+0000","last_change":"2024-09-12T12:24:16.394206+0000","last_active":"2024-09-12T12:24:18.613990+0000","last_peered":"2024-09-12T12:24:18.613990+0000","last_clean":"2024-09-12T12:24:18.613990+0000","last_became_active":"2024-09-12T12:24:16.393946+0000","last_became_peered":"2024-09-12T12:24:16.393946+0000","last_unstale":"2024-09-12T12:24:18.613990+0000","last_undegraded":"2024-09-12T12:24:18.613990+0000","last_fullsized":"2024-09-12T12:24:18.613990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:33.481891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614623+0000","last_change":"2024-09-12T12:24:16.393808+0000","last_active":"2024-09-12T12:24:18.614623+0000","last_peered":"2024-09-12T12:24:18.614623+0000","last_clean":"2024-09-12T12:24:18.614623+0000","last_became_active":"2024-09-12T12:24:16.393444+0000","last_became_peered":"2024-09-12T12:24:16.393444+0000","last_unstale":"2024-09-12T12:24:18.614623+0000","last_undegraded":"2024-09-12T12:24:18.614623+0000","last_fullsized":"2024-09-12T12:24:18.614623+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:16.973624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378284+0000","last_change":"2024-09-12T12:24:16.395785+0000","last_active":"2024-09-12T12:24:17.378284+0000","last_peered":"2024-09-12T12:24:17.378284+0000","last_clean":"2024-09-12T12:24:17.378284+0000","last_became_active":"2024-09-12T12:24:16.395155+0000","last_became_peered":"2024-09-12T12:24:16.395155+0000","last_unstale":"2024-09-12T12:24:17.378284+0000","last_undegraded":"2024-09-12T12:24:17.378284+0000","last_fullsized":"2024-09-12T12:24:17.378284+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.128062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378263+0000","last_change":"2024-09-12T12:24:16.384665+0000","last_active":"2024-09-12T12:24:17.378263+0000","last_peered":"2024-09-12T12:24:17.378263+0000","last_clean":"2024-09-12T12:24:17.378263+0000","last_became_active":"2024-09-12T12:24:16.384397+0000","last_became_peered":"2024-09-12T12:24:16.384397+0000","last_unstale":"2024-09-12T12:24:17.378263+0000","last_undegraded":"2024-09-12T12:24:17.378263+0000","last_fullsized":"2024-09-12T12:24:17.378263+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:33.904641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614178+0000","last_change":"2024-09-12T12:24:16.398048+0000","last_active":"2024-09-12T12:24:18.614178+0000","last_peered":"2024-09-12T12:24:18.614178+0000","last_clean":"2024-09-12T12:24:18.614178+0000","last_became_active":"2024-09-12T12:24:16.397351+0000","last_became_peered":"2024-09-12T12:24:16.397351+0000","last_unstale":"2024-09-12T12:24:18.614178+0000","last_undegraded":"2024-09-12T12:24:18.614178+0000","last_fullsized":"2024-09-12T12:24:18.614178+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:42.510300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376118+0000","last_change":"2024-09-12T12:24:16.401679+0000","last_active":"2024-09-12T12:24:17.376118+0000","last_peered":"2024-09-12T12:24:17.376118+0000","last_clean":"2024-09-12T12:24:17.376118+0000","last_became_active":"2024-09-12T12:24:16.401427+0000","last_became_peered":"2024-09-12T12:24:16.401427+0000","last_unstale":"2024-09-12T12:24:17.376118+0000","last_undegraded":"2024-09-12T12:24:17.376118+0000","last_fullsized":"2024-09-12T12:24:17.376118+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:33.370897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376014+0000","last_change":"2024-09-12T12:24:16.389730+0000","last_active":"2024-09-12T12:24:17.376014+0000","last_peered":"2024-09-12T12:24:17.376014+0000","last_clean":"2024-09-12T12:24:17.376014+0000","last_became_active":"2024-09-12T12:24:16.388457+0000","last_became_peered":"2024-09-12T12:24:16.388457+0000","last_unstale":"2024-09-12T12:24:17.376014+0000","last_undegraded":"2024-09-12T12:24:17.376014+0000","last_fullsized":"2024-09-12T12:24:17.376014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:30.253279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614643+0000","last_change":"2024-09-12T12:24:16.408247+0000","last_active":"2024-09-12T12:24:18.614643+0000","last_peered":"2024-09-12T12:24:18.614643+0000","last_clean":"2024-09-12T12:24:18.614643+0000","last_became_active":"2024-09-12T12:24:16.406896+0000","last_became_peered":"2024-09-12T12:24:16.406896+0000","last_unstale":"2024-09-12T12:24:18.614643+0000","last_undegraded":"2024-09-12T12:24:18.614643+0000","last_fullsized":"2024-09-12T12:24:18.614643+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:41.568837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376092+0000","last_change":"2024-09-12T12:24:16.395602+0000","last_active":"2024-09-12T12:24:17.376092+0000","last_peered":"2024-09-12T12:24:17.376092+0000","last_clean":"2024-09-12T12:24:17.376092+0000","last_became_active":"2024-09-12T12:24:16.395302+0000","last_became_peered":"2024-09-12T12:24:16.395302+0000","last_unstale":"2024-09-12T12:24:17.376092+0000","last_undegraded":"2024-09-12T12:24:17.376092+0000","last_fullsized":"2024-09-12T12:24:17.376092+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:37.307464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402587+0000","last_change":"2024-09-12T12:24:16.391686+0000","last_active":"2024-09-12T12:24:17.402587+0000","last_peered":"2024-09-12T12:24:17.402587+0000","last_clean":"2024-09-12T12:24:17.402587+0000","last_became_active":"2024-09-12T12:24:16.391350+0000","last_became_peered":"2024-09-12T12:24:16.391350+0000","last_unstale":"2024-09-12T12:24:17.402587+0000","last_undegraded":"2024-09-12T12:24:17.402587+0000","last_fullsized":"2024-09-12T12:24:17.402587+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:49:56.998916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070631+0000","last_change":"2024-09-12T12:24:16.396345+0000","last_active":"2024-09-12T12:24:18.070631+0000","last_peered":"2024-09-12T12:24:18.070631+0000","last_clean":"2024-09-12T12:24:18.070631+0000","last_became_active":"2024-09-12T12:24:16.395947+0000","last_became_peered":"2024-09-12T12:24:16.395947+0000","last_unstale":"2024-09-12T12:24:18.070631+0000","last_undegraded":"2024-09-12T12:24:18.070631+0000","last_fullsized":"2024-09-12T12:24:18.070631+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:29.398497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614874+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:18.614874+0000","last_peered":"2024-09-12T12:24:18.614874+0000","last_clean":"2024-09-12T12:24:18.614874+0000","last_became_active":"2024-09-12T12:24:16.399490+0000","last_became_peered":"2024-09-12T12:24:16.399490+0000","last_unstale":"2024-09-12T12:24:18.614874+0000","last_undegraded":"2024-09-12T12:24:18.614874+0000","last_fullsized":"2024-09-12T12:24:18.614874+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:40.136783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:16.398270+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:16.397722+0000","last_became_peered":"2024-09-12T12:24:16.397722+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:26.658081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070437+0000","last_change":"2024-09-12T12:24:16.405818+0000","last_active":"2024-09-12T12:24:18.070437+0000","last_peered":"2024-09-12T12:24:18.070437+0000","last_clean":"2024-09-12T12:24:18.070437+0000","last_became_active":"2024-09-12T12:24:16.405396+0000","last_became_peered":"2024-09-12T12:24:16.405396+0000","last_unstale":"2024-09-12T12:24:18.070437+0000","last_undegraded":"2024-09-12T12:24:18.070437+0000","last_fullsized":"2024-09-12T12:24:18.070437+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:53.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070239+0000","last_change":"2024-09-12T12:24:16.407758+0000","last_active":"2024-09-12T12:24:18.070239+0000","last_peered":"2024-09-12T12:24:18.070239+0000","last_clean":"2024-09-12T12:24:18.070239+0000","last_became_active":"2024-09-12T12:24:16.407508+0000","last_became_peered":"2024-09-12T12:24:16.407508+0000","last_unstale":"2024-09-12T12:24:18.070239+0000","last_undegraded":"2024-09-12T12:24:18.070239+0000","last_fullsized":"2024-09-12T12:24:18.070239+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:08.809853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402121+0000","last_change":"2024-09-12T12:24:16.405155+0000","last_active":"2024-09-12T12:24:17.402121+0000","last_peered":"2024-09-12T12:24:17.402121+0000","last_clean":"2024-09-12T12:24:17.402121+0000","last_became_active":"2024-09-12T12:24:16.404882+0000","last_became_peered":"2024-09-12T12:24:16.404882+0000","last_unstale":"2024-09-12T12:24:17.402121+0000","last_undegraded":"2024-09-12T12:24:17.402121+0000","last_fullsized":"2024-09-12T12:24:17.402121+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:18.643188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614001+0000","last_change":"2024-09-12T12:24:16.387749+0000","last_active":"2024-09-12T12:24:18.614001+0000","last_peered":"2024-09-12T12:24:18.614001+0000","last_clean":"2024-09-12T12:24:18.614001+0000","last_became_active":"2024-09-12T12:24:16.387503+0000","last_became_peered":"2024-09-12T12:24:16.387503+0000","last_unstale":"2024-09-12T12:24:18.614001+0000","last_undegraded":"2024-09-12T12:24:18.614001+0000","last_fullsized":"2024-09-12T12:24:18.614001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:59.828091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614916+0000","last_change":"2024-09-12T12:24:16.397982+0000","last_active":"2024-09-12T12:24:18.614916+0000","last_peered":"2024-09-12T12:24:18.614916+0000","last_clean":"2024-09-12T12:24:18.614916+0000","last_became_active":"2024-09-12T12:24:16.397718+0000","last_became_peered":"2024-09-12T12:24:16.397718+0000","last_unstale":"2024-09-12T12:24:18.614916+0000","last_undegraded":"2024-09-12T12:24:18.614916+0000","last_fullsized":"2024-09-12T12:24:18.614916+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367971+0000","last_change":"2024-09-12T12:24:14.367971+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367971+0000","last_undegraded":"2024-09-12T12:24:14.367971+0000","last_fullsized":"2024-09-12T12:24:14.367971+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402547+0000","last_change":"2024-09-12T12:24:16.399030+0000","last_active":"2024-09-12T12:24:17.402547+0000","last_peered":"2024-09-12T12:24:17.402547+0000","last_clean":"2024-09-12T12:24:17.402547+0000","last_became_active":"2024-09-12T12:24:16.398598+0000","last_became_peered":"2024-09-12T12:24:16.398598+0000","last_unstale":"2024-09-12T12:24:17.402547+0000","last_undegraded":"2024-09-12T12:24:17.402547+0000","last_fullsized":"2024-09-12T12:24:17.402547+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:38.682077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614535+0000","last_change":"2024-09-12T12:24:15.399932+0000","last_active":"2024-09-12T12:24:18.614535+0000","last_peered":"2024-09-12T12:24:18.614535+0000","last_clean":"2024-09-12T12:24:18.614535+0000","last_became_active":"2024-09-12T12:24:15.399298+0000","last_became_peered":"2024-09-12T12:24:15.399298+0000","last_unstale":"2024-09-12T12:24:18.614535+0000","last_undegraded":"2024-09-12T12:24:18.614535+0000","last_fullsized":"2024-09-12T12:24:18.614535+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:49.018706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070727+0000","last_change":"2024-09-12T12:24:16.397252+0000","last_active":"2024-09-12T12:24:18.070727+0000","last_peered":"2024-09-12T12:24:18.070727+0000","last_clean":"2024-09-12T12:24:18.070727+0000","last_became_active":"2024-09-12T12:24:16.396964+0000","last_became_peered":"2024-09-12T12:24:16.396964+0000","last_unstale":"2024-09-12T12:24:18.070727+0000","last_undegraded":"2024-09-12T12:24:18.070727+0000","last_fullsized":"2024-09-12T12:24:18.070727+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:16.827590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070399+0000","last_change":"2024-09-12T12:24:15.388771+0000","last_active":"2024-09-12T12:24:18.070399+0000","last_peered":"2024-09-12T12:24:18.070399+0000","last_clean":"2024-09-12T12:24:18.070399+0000","last_became_active":"2024-09-12T12:24:15.388489+0000","last_became_peered":"2024-09-12T12:24:15.388489+0000","last_unstale":"2024-09-12T12:24:18.070399+0000","last_undegraded":"2024-09-12T12:24:18.070399+0000","last_fullsized":"2024-09-12T12:24:18.070399+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.638923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377349+0000","last_change":"2024-09-12T12:24:16.398321+0000","last_active":"2024-09-12T12:24:17.377349+0000","last_peered":"2024-09-12T12:24:17.377349+0000","last_clean":"2024-09-12T12:24:17.377349+0000","last_became_active":"2024-09-12T12:24:16.398059+0000","last_became_peered":"2024-09-12T12:24:16.398059+0000","last_unstale":"2024-09-12T12:24:17.377349+0000","last_undegraded":"2024-09-12T12:24:17.377349+0000","last_fullsized":"2024-09-12T12:24:17.377349+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:49.642450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377968+0000","last_change":"2024-09-12T12:24:15.392075+0000","last_active":"2024-09-12T12:24:17.377968+0000","last_peered":"2024-09-12T12:24:17.377968+0000","last_clean":"2024-09-12T12:24:17.377968+0000","last_became_active":"2024-09-12T12:24:15.391802+0000","last_became_peered":"2024-09-12T12:24:15.391802+0000","last_unstale":"2024-09-12T12:24:17.377968+0000","last_undegraded":"2024-09-12T12:24:17.377968+0000","last_fullsized":"2024-09-12T12:24:17.377968+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377422+0000","last_change":"2024-09-12T12:24:16.390477+0000","last_active":"2024-09-12T12:24:17.377422+0000","last_peered":"2024-09-12T12:24:17.377422+0000","last_clean":"2024-09-12T12:24:17.377422+0000","last_became_active":"2024-09-12T12:24:16.390202+0000","last_became_peered":"2024-09-12T12:24:16.390202+0000","last_unstale":"2024-09-12T12:24:17.377422+0000","last_undegraded":"2024-09-12T12:24:17.377422+0000","last_fullsized":"2024-09-12T12:24:17.377422+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:06.504087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614269+0000","last_change":"2024-09-12T12:24:15.401541+0000","last_active":"2024-09-12T12:24:18.614269+0000","last_peered":"2024-09-12T12:24:18.614269+0000","last_clean":"2024-09-12T12:24:18.614269+0000","last_became_active":"2024-09-12T12:24:15.400546+0000","last_became_peered":"2024-09-12T12:24:15.400546+0000","last_unstale":"2024-09-12T12:24:18.614269+0000","last_undegraded":"2024-09-12T12:24:18.614269+0000","last_fullsized":"2024-09-12T12:24:18.614269+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:22.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376083+0000","last_change":"2024-09-12T12:24:16.394306+0000","last_active":"2024-09-12T12:24:17.376083+0000","last_peered":"2024-09-12T12:24:17.376083+0000","last_clean":"2024-09-12T12:24:17.376083+0000","last_became_active":"2024-09-12T12:24:16.394065+0000","last_became_peered":"2024-09-12T12:24:16.394065+0000","last_unstale":"2024-09-12T12:24:17.376083+0000","last_undegraded":"2024-09-12T12:24:17.376083+0000","last_fullsized":"2024-09-12T12:24:17.376083+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:01.040775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367747+0000","last_change":"2024-09-12T12:24:14.367747+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367747+0000","last_undegraded":"2024-09-12T12:24:14.367747+0000","last_fullsized":"2024-09-12T12:24:14.367747+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376277+0000","last_change":"2024-09-12T12:24:16.398115+0000","last_active":"2024-09-12T12:24:17.376277+0000","last_peered":"2024-09-12T12:24:17.376277+0000","last_clean":"2024-09-12T12:24:17.376277+0000","last_became_active":"2024-09-12T12:24:16.397797+0000","last_became_peered":"2024-09-12T12:24:16.397797+0000","last_unstale":"2024-09-12T12:24:17.376277+0000","last_undegraded":"2024-09-12T12:24:17.376277+0000","last_fullsized":"2024-09-12T12:24:17.376277+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:52.182844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377746+0000","last_change":"2024-09-12T12:24:15.391060+0000","last_active":"2024-09-12T12:24:17.377746+0000","last_peered":"2024-09-12T12:24:17.377746+0000","last_clean":"2024-09-12T12:24:17.377746+0000","last_became_active":"2024-09-12T12:24:15.390781+0000","last_became_peered":"2024-09-12T12:24:15.390781+0000","last_unstale":"2024-09-12T12:24:17.377746+0000","last_undegraded":"2024-09-12T12:24:17.377746+0000","last_fullsized":"2024-09-12T12:24:17.377746+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:34.109701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614981+0000","last_change":"2024-09-12T12:24:16.395507+0000","last_active":"2024-09-12T12:24:18.614981+0000","last_peered":"2024-09-12T12:24:18.614981+0000","last_clean":"2024-09-12T12:24:18.614981+0000","last_became_active":"2024-09-12T12:24:16.395221+0000","last_became_peered":"2024-09-12T12:24:16.395221+0000","last_unstale":"2024-09-12T12:24:18.614981+0000","last_undegraded":"2024-09-12T12:24:18.614981+0000","last_fullsized":"2024-09-12T12:24:18.614981+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614536+0000","last_change":"2024-09-12T12:24:15.396881+0000","last_active":"2024-09-12T12:24:18.614536+0000","last_peered":"2024-09-12T12:24:18.614536+0000","last_clean":"2024-09-12T12:24:18.614536+0000","last_became_active":"2024-09-12T12:24:15.396494+0000","last_became_peered":"2024-09-12T12:24:15.396494+0000","last_unstale":"2024-09-12T12:24:18.614536+0000","last_undegraded":"2024-09-12T12:24:18.614536+0000","last_fullsized":"2024-09-12T12:24:18.614536+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:10.076168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614438+0000","last_change":"2024-09-12T12:24:16.390011+0000","last_active":"2024-09-12T12:24:18.614438+0000","last_peered":"2024-09-12T12:24:18.614438+0000","last_clean":"2024-09-12T12:24:18.614438+0000","last_became_active":"2024-09-12T12:24:16.389735+0000","last_became_peered":"2024-09-12T12:24:16.389735+0000","last_unstale":"2024-09-12T12:24:18.614438+0000","last_undegraded":"2024-09-12T12:24:18.614438+0000","last_fullsized":"2024-09-12T12:24:18.614438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:57.836183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376367+0000","last_change":"2024-09-12T12:24:15.399114+0000","last_active":"2024-09-12T12:24:17.376367+0000","last_peered":"2024-09-12T12:24:17.376367+0000","last_clean":"2024-09-12T12:24:17.376367+0000","last_became_active":"2024-09-12T12:24:15.398674+0000","last_became_peered":"2024-09-12T12:24:15.398674+0000","last_unstale":"2024-09-12T12:24:17.376367+0000","last_undegraded":"2024-09-12T12:24:17.376367+0000","last_fullsized":"2024-09-12T12:24:17.376367+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:48.465962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378417+0000","last_change":"2024-09-12T12:24:16.399719+0000","last_active":"2024-09-12T12:24:17.378417+0000","last_peered":"2024-09-12T12:24:17.378417+0000","last_clean":"2024-09-12T12:24:17.378417+0000","last_became_active":"2024-09-12T12:24:16.399424+0000","last_became_peered":"2024-09-12T12:24:16.399424+0000","last_unstale":"2024-09-12T12:24:17.378417+0000","last_undegraded":"2024-09-12T12:24:17.378417+0000","last_fullsized":"2024-09-12T12:24:17.378417+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:45.872966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367273+0000","last_change":"2024-09-12T12:24:14.367273+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367273+0000","last_undegraded":"2024-09-12T12:24:14.367273+0000","last_fullsized":"2024-09-12T12:24:14.367273+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376580+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:17.376580+0000","last_peered":"2024-09-12T12:24:17.376580+0000","last_clean":"2024-09-12T12:24:17.376580+0000","last_became_active":"2024-09-12T12:24:16.399517+0000","last_became_peered":"2024-09-12T12:24:16.399517+0000","last_unstale":"2024-09-12T12:24:17.376580+0000","last_undegraded":"2024-09-12T12:24:17.376580+0000","last_fullsized":"2024-09-12T12:24:17.376580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:36.668056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"175'6","reported_seq":20,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377972+0000","last_change":"2024-09-12T12:24:15.389229+0000","last_active":"2024-09-12T12:24:17.377972+0000","last_peered":"2024-09-12T12:24:17.377972+0000","last_clean":"2024-09-12T12:24:17.377972+0000","last_became_active":"2024-09-12T12:24:15.388660+0000","last_became_peered":"2024-09-12T12:24:15.388660+0000","last_unstale":"2024-09-12T12:24:17.377972+0000","last_undegraded":"2024-09-12T12:24:17.377972+0000","last_fullsized":"2024-09-12T12:24:17.377972+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:02.449575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402106+0000","last_change":"2024-09-12T12:24:16.399205+0000","last_active":"2024-09-12T12:24:17.402106+0000","last_peered":"2024-09-12T12:24:17.402106+0000","last_clean":"2024-09-12T12:24:17.402106+0000","last_became_active":"2024-09-12T12:24:16.398875+0000","last_became_peered":"2024-09-12T12:24:16.398875+0000","last_unstale":"2024-09-12T12:24:17.402106+0000","last_undegraded":"2024-09-12T12:24:17.402106+0000","last_fullsized":"2024-09-12T12:24:17.402106+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:47.257395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378190+0000","last_change":"2024-09-12T12:24:15.385396+0000","last_active":"2024-09-12T12:24:17.378190+0000","last_peered":"2024-09-12T12:24:17.378190+0000","last_clean":"2024-09-12T12:24:17.378190+0000","last_became_active":"2024-09-12T12:24:15.385095+0000","last_became_peered":"2024-09-12T12:24:15.385095+0000","last_unstale":"2024-09-12T12:24:17.378190+0000","last_undegraded":"2024-09-12T12:24:17.378190+0000","last_fullsized":"2024-09-12T12:24:17.378190+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613984+0000","last_change":"2024-09-12T12:24:16.390955+0000","last_active":"2024-09-12T12:24:18.613984+0000","last_peered":"2024-09-12T12:24:18.613984+0000","last_clean":"2024-09-12T12:24:18.613984+0000","last_became_active":"2024-09-12T12:24:16.388418+0000","last_became_peered":"2024-09-12T12:24:16.388418+0000","last_unstale":"2024-09-12T12:24:18.613984+0000","last_undegraded":"2024-09-12T12:24:18.613984+0000","last_fullsized":"2024-09-12T12:24:18.613984+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:40.208012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376309+0000","last_change":"2024-09-12T12:24:15.395867+0000","last_active":"2024-09-12T12:24:17.376309+0000","last_peered":"2024-09-12T12:24:17.376309+0000","last_clean":"2024-09-12T12:24:17.376309+0000","last_became_active":"2024-09-12T12:24:15.395594+0000","last_became_peered":"2024-09-12T12:24:15.395594+0000","last_unstale":"2024-09-12T12:24:17.376309+0000","last_undegraded":"2024-09-12T12:24:17.376309+0000","last_fullsized":"2024-09-12T12:24:17.376309+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:41.348309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377938+0000","last_change":"2024-09-12T12:24:16.387185+0000","last_active":"2024-09-12T12:24:17.377938+0000","last_peered":"2024-09-12T12:24:17.377938+0000","last_clean":"2024-09-12T12:24:17.377938+0000","last_became_active":"2024-09-12T12:24:16.386859+0000","last_became_peered":"2024-09-12T12:24:16.386859+0000","last_unstale":"2024-09-12T12:24:17.377938+0000","last_undegraded":"2024-09-12T12:24:17.377938+0000","last_fullsized":"2024-09-12T12:24:17.377938+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.116554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367234+0000","last_change":"2024-09-12T12:24:14.367234+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367234+0000","last_undegraded":"2024-09-12T12:24:14.367234+0000","last_fullsized":"2024-09-12T12:24:14.367234+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378125+0000","last_change":"2024-09-12T12:24:16.403838+0000","last_active":"2024-09-12T12:24:17.378125+0000","last_peered":"2024-09-12T12:24:17.378125+0000","last_clean":"2024-09-12T12:24:17.378125+0000","last_became_active":"2024-09-12T12:24:16.403611+0000","last_became_peered":"2024-09-12T12:24:16.403611+0000","last_unstale":"2024-09-12T12:24:17.378125+0000","last_undegraded":"2024-09-12T12:24:17.378125+0000","last_fullsized":"2024-09-12T12:24:17.378125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:38.894390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"175'8","reported_seq":22,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070217+0000","last_change":"2024-09-12T12:24:15.388767+0000","last_active":"2024-09-12T12:24:18.070217+0000","last_peered":"2024-09-12T12:24:18.070217+0000","last_clean":"2024-09-12T12:24:18.070217+0000","last_became_active":"2024-09-12T12:24:15.388428+0000","last_became_peered":"2024-09-12T12:24:15.388428+0000","last_unstale":"2024-09-12T12:24:18.070217+0000","last_undegraded":"2024-09-12T12:24:18.070217+0000","last_fullsized":"2024-09-12T12:24:18.070217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:53.990844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402245+0000","last_change":"2024-09-12T12:24:16.405120+0000","last_active":"2024-09-12T12:24:17.402245+0000","last_peered":"2024-09-12T12:24:17.402245+0000","last_clean":"2024-09-12T12:24:17.402245+0000","last_became_active":"2024-09-12T12:24:16.404831+0000","last_became_peered":"2024-09-12T12:24:16.404831+0000","last_unstale":"2024-09-12T12:24:17.402245+0000","last_undegraded":"2024-09-12T12:24:17.402245+0000","last_fullsized":"2024-09-12T12:24:17.402245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.752182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070641+0000","last_change":"2024-09-12T12:24:15.394278+0000","last_active":"2024-09-12T12:24:18.070641+0000","last_peered":"2024-09-12T12:24:18.070641+0000","last_clean":"2024-09-12T12:24:18.070641+0000","last_became_active":"2024-09-12T12:24:15.392595+0000","last_became_peered":"2024-09-12T12:24:15.392595+0000","last_unstale":"2024-09-12T12:24:18.070641+0000","last_undegraded":"2024-09-12T12:24:18.070641+0000","last_fullsized":"2024-09-12T12:24:18.070641+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:59.109666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614201+0000","last_change":"2024-09-12T12:24:16.391727+0000","last_active":"2024-09-12T12:24:18.614201+0000","last_peered":"2024-09-12T12:24:18.614201+0000","last_clean":"2024-09-12T12:24:18.614201+0000","last_became_active":"2024-09-12T12:24:16.391468+0000","last_became_peered":"2024-09-12T12:24:16.391468+0000","last_unstale":"2024-09-12T12:24:18.614201+0000","last_undegraded":"2024-09-12T12:24:18.614201+0000","last_fullsized":"2024-09-12T12:24:18.614201+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:56.376971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.368232+0000","last_change":"2024-09-12T12:24:14.368232+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.368232+0000","last_undegraded":"2024-09-12T12:24:14.368232+0000","last_fullsized":"2024-09-12T12:24:14.368232+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070786+0000","last_change":"2024-09-12T12:24:16.397975+0000","last_active":"2024-09-12T12:24:18.070786+0000","last_peered":"2024-09-12T12:24:18.070786+0000","last_clean":"2024-09-12T12:24:18.070786+0000","last_became_active":"2024-09-12T12:24:16.397682+0000","last_became_peered":"2024-09-12T12:24:16.397682+0000","last_unstale":"2024-09-12T12:24:18.070786+0000","last_undegraded":"2024-09-12T12:24:18.070786+0000","last_fullsized":"2024-09-12T12:24:18.070786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:19.982642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377000+0000","last_change":"2024-09-12T12:24:15.398973+0000","last_active":"2024-09-12T12:24:17.377000+0000","last_peered":"2024-09-12T12:24:17.377000+0000","last_clean":"2024-09-12T12:24:17.377000+0000","last_became_active":"2024-09-12T12:24:15.398624+0000","last_became_peered":"2024-09-12T12:24:15.398624+0000","last_unstale":"2024-09-12T12:24:17.377000+0000","last_undegraded":"2024-09-12T12:24:17.377000+0000","last_fullsized":"2024-09-12T12:24:17.377000+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376616+0000","last_change":"2024-09-12T12:24:16.390299+0000","last_active":"2024-09-12T12:24:17.376616+0000","last_peered":"2024-09-12T12:24:17.376616+0000","last_clean":"2024-09-12T12:24:17.376616+0000","last_became_active":"2024-09-12T12:24:16.389754+0000","last_became_peered":"2024-09-12T12:24:16.389754+0000","last_unstale":"2024-09-12T12:24:17.376616+0000","last_undegraded":"2024-09-12T12:24:17.376616+0000","last_fullsized":"2024-09-12T12:24:17.376616+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:52.232681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070516+0000","last_change":"2024-09-12T12:24:15.391813+0000","last_active":"2024-09-12T12:24:18.070516+0000","last_peered":"2024-09-12T12:24:18.070516+0000","last_clean":"2024-09-12T12:24:18.070516+0000","last_became_active":"2024-09-12T12:24:15.391434+0000","last_became_peered":"2024-09-12T12:24:15.391434+0000","last_unstale":"2024-09-12T12:24:18.070516+0000","last_undegraded":"2024-09-12T12:24:18.070516+0000","last_fullsized":"2024-09-12T12:24:18.070516+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:37.887502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375786+0000","last_change":"2024-09-12T12:24:16.401815+0000","last_active":"2024-09-12T12:24:17.375786+0000","last_peered":"2024-09-12T12:24:17.375786+0000","last_clean":"2024-09-12T12:24:17.375786+0000","last_became_active":"2024-09-12T12:24:16.401529+0000","last_became_peered":"2024-09-12T12:24:16.401529+0000","last_unstale":"2024-09-12T12:24:17.375786+0000","last_undegraded":"2024-09-12T12:24:17.375786+0000","last_fullsized":"2024-09-12T12:24:17.375786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378241+0000","last_change":"2024-09-12T12:24:15.399471+0000","last_active":"2024-09-12T12:24:17.378241+0000","last_peered":"2024-09-12T12:24:17.378241+0000","last_clean":"2024-09-12T12:24:17.378241+0000","last_became_active":"2024-09-12T12:24:15.399103+0000","last_became_peered":"2024-09-12T12:24:15.399103+0000","last_unstale":"2024-09-12T12:24:17.378241+0000","last_undegraded":"2024-09-12T12:24:17.378241+0000","last_fullsized":"2024-09-12T12:24:17.378241+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367162+0000","last_change":"2024-09-12T12:24:14.367162+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367162+0000","last_undegraded":"2024-09-12T12:24:14.367162+0000","last_fullsized":"2024-09-12T12:24:14.367162+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T12:24:15.362018+0000","last_change":"2024-09-12T12:24:15.362018+0000","last_active":"2024-09-12T12:24:15.362018+0000","last_peered":"2024-09-12T12:24:15.362018+0000","last_clean":"2024-09-12T12:24:15.362018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:15.362018+0000","last_undegraded":"2024-09-12T12:24:15.362018+0000","last_fullsized":"2024-09-12T12:24:15.362018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402270+0000","last_change":"2024-09-12T12:24:15.398819+0000","last_active":"2024-09-12T12:24:17.402270+0000","last_peered":"2024-09-12T12:24:17.402270+0000","last_clean":"2024-09-12T12:24:17.402270+0000","last_became_active":"2024-09-12T12:24:15.398572+0000","last_became_peered":"2024-09-12T12:24:15.398572+0000","last_unstale":"2024-09-12T12:24:17.402270+0000","last_undegraded":"2024-09-12T12:24:17.402270+0000","last_fullsized":"2024-09-12T12:24:17.402270+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:33.388691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614154+0000","last_change":"2024-09-12T12:24:16.393240+0000","last_active":"2024-09-12T12:24:18.614154+0000","last_peered":"2024-09-12T12:24:18.614154+0000","last_clean":"2024-09-12T12:24:18.614154+0000","last_became_active":"2024-09-12T12:24:16.392939+0000","last_became_peered":"2024-09-12T12:24:16.392939+0000","last_unstale":"2024-09-12T12:24:18.614154+0000","last_undegraded":"2024-09-12T12:24:18.614154+0000","last_fullsized":"2024-09-12T12:24:18.614154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:37.911201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376709+0000","last_change":"2024-09-12T12:24:15.391719+0000","last_active":"2024-09-12T12:24:17.376709+0000","last_peered":"2024-09-12T12:24:17.376709+0000","last_clean":"2024-09-12T12:24:17.376709+0000","last_became_active":"2024-09-12T12:24:15.391451+0000","last_became_peered":"2024-09-12T12:24:15.391451+0000","last_unstale":"2024-09-12T12:24:17.376709+0000","last_undegraded":"2024-09-12T12:24:17.376709+0000","last_fullsized":"2024-09-12T12:24:17.376709+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402376+0000","last_change":"2024-09-12T12:24:16.400257+0000","last_active":"2024-09-12T12:24:17.402376+0000","last_peered":"2024-09-12T12:24:17.402376+0000","last_clean":"2024-09-12T12:24:17.402376+0000","last_became_active":"2024-09-12T12:24:16.399908+0000","last_became_peered":"2024-09-12T12:24:16.399908+0000","last_unstale":"2024-09-12T12:24:17.402376+0000","last_undegraded":"2024-09-12T12:24:17.402376+0000","last_fullsized":"2024-09-12T12:24:17.402376+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:19.882883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.366646+0000","last_change":"2024-09-12T12:24:14.366646+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.366646+0000","last_undegraded":"2024-09-12T12:24:14.366646+0000","last_fullsized":"2024-09-12T12:24:14.366646+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375977+0000","last_change":"2024-09-12T12:24:16.393135+0000","last_active":"2024-09-12T12:24:17.375977+0000","last_peered":"2024-09-12T12:24:17.375977+0000","last_clean":"2024-09-12T12:24:17.375977+0000","last_became_active":"2024-09-12T12:24:16.392886+0000","last_became_peered":"2024-09-12T12:24:16.392886+0000","last_unstale":"2024-09-12T12:24:17.375977+0000","last_undegraded":"2024-09-12T12:24:17.375977+0000","last_fullsized":"2024-09-12T12:24:17.375977+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"176'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402509+0000","last_change":"2024-09-12T12:24:15.398312+0000","last_active":"2024-09-12T12:24:17.402509+0000","last_peered":"2024-09-12T12:24:17.402509+0000","last_clean":"2024-09-12T12:24:17.402509+0000","last_became_active":"2024-09-12T12:24:15.397828+0000","last_became_peered":"2024-09-12T12:24:15.397828+0000","last_unstale":"2024-09-12T12:24:17.402509+0000","last_undegraded":"2024-09-12T12:24:17.402509+0000","last_fullsized":"2024-09-12T12:24:17.402509+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:05.355749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614970+0000","last_change":"2024-09-12T12:24:16.396259+0000","last_active":"2024-09-12T12:24:18.614970+0000","last_peered":"2024-09-12T12:24:18.614970+0000","last_clean":"2024-09-12T12:24:18.614970+0000","last_became_active":"2024-09-12T12:24:16.396001+0000","last_became_peered":"2024-09-12T12:24:16.396001+0000","last_unstale":"2024-09-12T12:24:18.614970+0000","last_undegraded":"2024-09-12T12:24:18.614970+0000","last_fullsized":"2024-09-12T12:24:18.614970+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614336+0000","last_change":"2024-09-12T12:24:15.401539+0000","last_active":"2024-09-12T12:24:18.614336+0000","last_peered":"2024-09-12T12:24:18.614336+0000","last_clean":"2024-09-12T12:24:18.614336+0000","last_became_active":"2024-09-12T12:24:15.400457+0000","last_became_peered":"2024-09-12T12:24:15.400457+0000","last_unstale":"2024-09-12T12:24:18.614336+0000","last_undegraded":"2024-09-12T12:24:18.614336+0000","last_fullsized":"2024-09-12T12:24:18.614336+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:00:53.932314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402584+0000","last_change":"2024-09-12T12:24:16.399098+0000","last_active":"2024-09-12T12:24:17.402584+0000","last_peered":"2024-09-12T12:24:17.402584+0000","last_clean":"2024-09-12T12:24:17.402584+0000","last_became_active":"2024-09-12T12:24:16.398823+0000","last_became_peered":"2024-09-12T12:24:16.398823+0000","last_unstale":"2024-09-12T12:24:17.402584+0000","last_undegraded":"2024-09-12T12:24:17.402584+0000","last_fullsized":"2024-09-12T12:24:17.402584+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:20.717320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:15.398497+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:15.398186+0000","last_became_peered":"2024-09-12T12:24:15.398186+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:31.161939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376781+0000","last_change":"2024-09-12T12:24:16.389008+0000","last_active":"2024-09-12T12:24:17.376781+0000","last_peered":"2024-09-12T12:24:17.376781+0000","last_clean":"2024-09-12T12:24:17.376781+0000","last_became_active":"2024-09-12T12:24:16.388763+0000","last_became_peered":"2024-09-12T12:24:16.388763+0000","last_unstale":"2024-09-12T12:24:17.376781+0000","last_undegraded":"2024-09-12T12:24:17.376781+0000","last_fullsized":"2024-09-12T12:24:17.376781+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.252266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614577+0000","last_change":"2024-09-12T12:24:15.392333+0000","last_active":"2024-09-12T12:24:18.614577+0000","last_peered":"2024-09-12T12:24:18.614577+0000","last_clean":"2024-09-12T12:24:18.614577+0000","last_became_active":"2024-09-12T12:24:15.390965+0000","last_became_peered":"2024-09-12T12:24:15.390965+0000","last_unstale":"2024-09-12T12:24:18.614577+0000","last_undegraded":"2024-09-12T12:24:18.614577+0000","last_fullsized":"2024-09-12T12:24:18.614577+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.211150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377869+0000","last_change":"2024-09-12T12:24:16.383386+0000","last_active":"2024-09-12T12:24:17.377869+0000","last_peered":"2024-09-12T12:24:17.377869+0000","last_clean":"2024-09-12T12:24:17.377869+0000","last_became_active":"2024-09-12T12:24:16.383081+0000","last_became_peered":"2024-09-12T12:24:16.383081+0000","last_unstale":"2024-09-12T12:24:17.377869+0000","last_undegraded":"2024-09-12T12:24:17.377869+0000","last_fullsized":"2024-09-12T12:24:17.377869+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.997732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614411+0000","last_change":"2024-09-12T12:24:15.398042+0000","last_active":"2024-09-12T12:24:18.614411+0000","last_peered":"2024-09-12T12:24:18.614411+0000","last_clean":"2024-09-12T12:24:18.614411+0000","last_became_active":"2024-09-12T12:24:15.397831+0000","last_became_peered":"2024-09-12T12:24:15.397831+0000","last_unstale":"2024-09-12T12:24:18.614411+0000","last_undegraded":"2024-09-12T12:24:18.614411+0000","last_fullsized":"2024-09-12T12:24:18.614411+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.073587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376395+0000","last_change":"2024-09-12T12:24:16.391725+0000","last_active":"2024-09-12T12:24:17.376395+0000","last_peered":"2024-09-12T12:24:17.376395+0000","last_clean":"2024-09-12T12:24:17.376395+0000","last_became_active":"2024-09-12T12:24:16.391417+0000","last_became_peered":"2024-09-12T12:24:16.391417+0000","last_unstale":"2024-09-12T12:24:17.376395+0000","last_undegraded":"2024-09-12T12:24:17.376395+0000","last_fullsized":"2024-09-12T12:24:17.376395+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:48.466637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402272+0000","last_change":"2024-09-12T12:24:15.389928+0000","last_active":"2024-09-12T12:24:17.402272+0000","last_peered":"2024-09-12T12:24:17.402272+0000","last_clean":"2024-09-12T12:24:17.402272+0000","last_became_active":"2024-09-12T12:24:15.389340+0000","last_became_peered":"2024-09-12T12:24:15.389340+0000","last_unstale":"2024-09-12T12:24:17.402272+0000","last_undegraded":"2024-09-12T12:24:17.402272+0000","last_fullsized":"2024-09-12T12:24:17.402272+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:15.606771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614638+0000","last_change":"2024-09-12T12:24:16.407188+0000","last_active":"2024-09-12T12:24:18.614638+0000","last_peered":"2024-09-12T12:24:18.614638+0000","last_clean":"2024-09-12T12:24:18.614638+0000","last_became_active":"2024-09-12T12:24:16.406874+0000","last_became_peered":"2024-09-12T12:24:16.406874+0000","last_unstale":"2024-09-12T12:24:18.614638+0000","last_undegraded":"2024-09-12T12:24:18.614638+0000","last_fullsized":"2024-09-12T12:24:18.614638+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:20.527705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376860+0000","last_change":"2024-09-12T12:24:15.394140+0000","last_active":"2024-09-12T12:24:17.376860+0000","last_peered":"2024-09-12T12:24:17.376860+0000","last_clean":"2024-09-12T12:24:17.376860+0000","last_became_active":"2024-09-12T12:24:15.393853+0000","last_became_peered":"2024-09-12T12:24:15.393853+0000","last_unstale":"2024-09-12T12:24:17.376860+0000","last_undegraded":"2024-09-12T12:24:17.376860+0000","last_fullsized":"2024-09-12T12:24:17.376860+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377325+0000","last_change":"2024-09-12T12:24:16.389657+0000","last_active":"2024-09-12T12:24:17.377325+0000","last_peered":"2024-09-12T12:24:17.377325+0000","last_clean":"2024-09-12T12:24:17.377325+0000","last_became_active":"2024-09-12T12:24:16.389393+0000","last_became_peered":"2024-09-12T12:24:16.389393+0000","last_unstale":"2024-09-12T12:24:17.377325+0000","last_undegraded":"2024-09-12T12:24:17.377325+0000","last_fullsized":"2024-09-12T12:24:17.377325+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:43.184029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":173,"state":"creating+peering","last_fresh":"2024-09-12T12:24:14.367329+0000","last_change":"2024-09-12T12:24:14.367329+0000","last_active":"2024-09-12T12:24:14.355130+0000","last_peered":"2024-09-12T12:24:14.355130+0000","last_clean":"2024-09-12T12:24:14.355130+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T12:24:14.367329+0000","last_undegraded":"2024-09-12T12:24:14.367329+0000","last_fullsized":"2024-09-12T12:24:14.367329+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":455,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614607+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:24:18.614607+0000","last_peered":"2024-09-12T12:24:18.614607+0000","last_clean":"2024-09-12T12:24:18.614607+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:24:18.614607+0000","last_undegraded":"2024-09-12T12:24:18.614607+0000","last_fullsized":"2024-09-12T12:24:18.614607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":1738,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51980,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319860,"statfs":{"total":96636764160,"available":96583536640,"internally_reserved":0,"allocated":2809856,"data_stored":1637923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51404,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320436,"statfs":{"total":96636764160,"available":96584126464,"internally_reserved":0,"allocated":2220032,"data_stored":1047625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51416,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320424,"statfs":{"total":96636764160,"available":96584114176,"internally_reserved":0,"allocated":2232320,"data_stored":1049189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59740,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312100,"statfs":{"total":96636764160,"available":96575590400,"internally_reserved":0,"allocated":2232320,"data_stored":1049201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2224128,"data_stored":1047715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":58915272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2220032,"data_stored":1048137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2215936,"data_stored":1047555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56104,"kb_used_data":2708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315736,"statfs":{"total":96636764160,"available":96579313664,"internally_reserved":0,"allocated":2772992,"data_stored":1617397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:21.237 INFO:tasks.ceph.ceph_manager.ceph:PG 26.3c is not active+clean 2024-09-12T12:24:21.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T12:24:15.362018+0000', 'last_change': '2024-09-12T12:24:15.362018+0000', 'last_active': '2024-09-12T12:24:15.362018+0000', 'last_peered': '2024-09-12T12:24:15.362018+0000', 'last_clean': '2024-09-12T12:24:15.362018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:15.362018+0000', 'last_undegraded': '2024-09-12T12:24:15.362018+0000', 'last_fullsized': '2024-09-12T12:24:15.362018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T12:24:21.237 INFO:tasks.ceph.ceph_manager.ceph:PG 26.34 is not active+clean 2024-09-12T12:24:21.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T12:24:15.362018+0000', 'last_change': '2024-09-12T12:24:15.362018+0000', 'last_active': '2024-09-12T12:24:15.362018+0000', 'last_peered': '2024-09-12T12:24:15.362018+0000', 'last_clean': '2024-09-12T12:24:15.362018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:15.362018+0000', 'last_undegraded': '2024-09-12T12:24:15.362018+0000', 'last_fullsized': '2024-09-12T12:24:15.362018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T12:24:21.237 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1f is not active+clean 2024-09-12T12:24:21.237 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 173, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:24:14.367971+0000', 'last_change': '2024-09-12T12:24:14.367971+0000', 'last_active': '2024-09-12T12:24:14.355130+0000', 'last_peered': '2024-09-12T12:24:14.355130+0000', 'last_clean': '2024-09-12T12:24:14.355130+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:14.367971+0000', 'last_undegraded': '2024-09-12T12:24:14.367971+0000', 'last_fullsized': '2024-09-12T12:24:14.367971+0000', 'mapping_epoch': 173, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 173, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1a is not active+clean 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 173, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:24:14.367747+0000', 'last_change': '2024-09-12T12:24:14.367747+0000', 'last_active': '2024-09-12T12:24:14.355130+0000', 'last_peered': '2024-09-12T12:24:14.355130+0000', 'last_clean': '2024-09-12T12:24:14.355130+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:14.367747+0000', 'last_undegraded': '2024-09-12T12:24:14.367747+0000', 'last_fullsized': '2024-09-12T12:24:14.367747+0000', 'mapping_epoch': 173, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 173, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:PG 25.15 is not active+clean 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 173, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:24:14.367273+0000', 'last_change': '2024-09-12T12:24:14.367273+0000', 'last_active': '2024-09-12T12:24:14.355130+0000', 'last_peered': '2024-09-12T12:24:14.355130+0000', 'last_clean': '2024-09-12T12:24:14.355130+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:14.367273+0000', 'last_undegraded': '2024-09-12T12:24:14.367273+0000', 'last_fullsized': '2024-09-12T12:24:14.367273+0000', 'mapping_epoch': 173, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 173, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:PG 25.11 is not active+clean 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 173, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:24:14.367234+0000', 'last_change': '2024-09-12T12:24:14.367234+0000', 'last_active': '2024-09-12T12:24:14.355130+0000', 'last_peered': '2024-09-12T12:24:14.355130+0000', 'last_clean': '2024-09-12T12:24:14.355130+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:14.367234+0000', 'last_undegraded': '2024-09-12T12:24:14.367234+0000', 'last_fullsized': '2024-09-12T12:24:14.367234+0000', 'mapping_epoch': 173, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 173, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:PG 25.e is not active+clean 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 173, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:24:14.368232+0000', 'last_change': '2024-09-12T12:24:14.368232+0000', 'last_active': '2024-09-12T12:24:14.355130+0000', 'last_peered': '2024-09-12T12:24:14.355130+0000', 'last_clean': '2024-09-12T12:24:14.355130+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:14.368232+0000', 'last_undegraded': '2024-09-12T12:24:14.368232+0000', 'last_fullsized': '2024-09-12T12:24:14.368232+0000', 'mapping_epoch': 173, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 173, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:PG 26.9 is not active+clean 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T12:24:15.362018+0000', 'last_change': '2024-09-12T12:24:15.362018+0000', 'last_active': '2024-09-12T12:24:15.362018+0000', 'last_peered': '2024-09-12T12:24:15.362018+0000', 'last_clean': '2024-09-12T12:24:15.362018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:15.362018+0000', 'last_undegraded': '2024-09-12T12:24:15.362018+0000', 'last_fullsized': '2024-09-12T12:24:15.362018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T12:24:21.238 INFO:tasks.ceph.ceph_manager.ceph:PG 25.a is not active+clean 2024-09-12T12:24:21.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 173, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:24:14.367162+0000', 'last_change': '2024-09-12T12:24:14.367162+0000', 'last_active': '2024-09-12T12:24:14.355130+0000', 'last_peered': '2024-09-12T12:24:14.355130+0000', 'last_clean': '2024-09-12T12:24:14.355130+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:14.367162+0000', 'last_undegraded': '2024-09-12T12:24:14.367162+0000', 'last_fullsized': '2024-09-12T12:24:14.367162+0000', 'mapping_epoch': 173, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 173, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:24:21.239 INFO:tasks.ceph.ceph_manager.ceph:PG 26.a is not active+clean 2024-09-12T12:24:21.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T12:24:15.362018+0000', 'last_change': '2024-09-12T12:24:15.362018+0000', 'last_active': '2024-09-12T12:24:15.362018+0000', 'last_peered': '2024-09-12T12:24:15.362018+0000', 'last_clean': '2024-09-12T12:24:15.362018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:15.362018+0000', 'last_undegraded': '2024-09-12T12:24:15.362018+0000', 'last_fullsized': '2024-09-12T12:24:15.362018+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:15.362018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T12:24:21.239 INFO:tasks.ceph.ceph_manager.ceph:PG 25.7 is not active+clean 2024-09-12T12:24:21.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 173, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:24:14.366646+0000', 'last_change': '2024-09-12T12:24:14.366646+0000', 'last_active': '2024-09-12T12:24:14.355130+0000', 'last_peered': '2024-09-12T12:24:14.355130+0000', 'last_clean': '2024-09-12T12:24:14.355130+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:14.366646+0000', 'last_undegraded': '2024-09-12T12:24:14.366646+0000', 'last_fullsized': '2024-09-12T12:24:14.366646+0000', 'mapping_epoch': 173, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 173, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:24:21.239 INFO:tasks.ceph.ceph_manager.ceph:PG 25.18 is not active+clean 2024-09-12T12:24:21.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 173, 'state': 'creating+peering', 'last_fresh': '2024-09-12T12:24:14.367329+0000', 'last_change': '2024-09-12T12:24:14.367329+0000', 'last_active': '2024-09-12T12:24:14.355130+0000', 'last_peered': '2024-09-12T12:24:14.355130+0000', 'last_clean': '2024-09-12T12:24:14.355130+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T12:24:14.367329+0000', 'last_undegraded': '2024-09-12T12:24:14.367329+0000', 'last_fullsized': '2024-09-12T12:24:14.367329+0000', 'mapping_epoch': 173, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 173, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'last_clean_scrub_stamp': '2024-09-12T12:24:14.355130+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T12:24:21.240 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T12:24:21.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.408+0000 7f3e12000640 1 Processor -- start 2024-09-12T12:24:21.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.408+0000 7f3e12000640 1 -- start start 2024-09-12T12:24:21.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.408+0000 7f3e12000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b55b0 0x7f3e0c06d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.408+0000 7f3e12000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3e0c0b73a0 0x7f3e0c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.408+0000 7f3e12000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0c073f60 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.408+0000 7f3e12000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3e0c06e700 con 0x7f3e0c0b73a0 2024-09-12T12:24:21.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.408+0000 7f3e12000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c06e9e0 con 0x7f3e0c0b55b0 2024-09-12T12:24:21.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0b400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f3e0c15e7e0 0x7f3e0c0b6c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:44434/0 (socket says 172.21.15.144:44434) 2024-09-12T12:24:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b55b0 0x7f3e0c06d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0b400640 1 -- 172.21.15.144:0/31825908 learned_addr learned my addr 172.21.15.144:0/31825908 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0be00640 1 --2- 172.21.15.144:0/31825908 >> v2:172.21.15.165:3300/0 conn(0x7f3e0c0b73a0 0x7f3e0c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0aa00640 1 -- 172.21.15.144:0/31825908 >> v2:172.21.15.165:3300/0 conn(0x7f3e0c0b73a0 msgr2=0x7f3e0c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0aa00640 1 --2- 172.21.15.144:0/31825908 >> v2:172.21.15.165:3300/0 conn(0x7f3e0c0b73a0 0x7f3e0c06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0aa00640 1 -- 172.21.15.144:0/31825908 >> v1:172.21.15.165:6789/0 conn(0x7f3e0c15e7e0 legacy=0x7f3e0c0b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0aa00640 1 -- 172.21.15.144:0/31825908 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c06ecc0 con 0x7f3e0c0b55b0 2024-09-12T12:24:21.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0aa00640 1 --2- 172.21.15.144:0/31825908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b55b0 0x7f3e0c06d200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3df80097c0 tx=0x7f3df801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ddeb775ba43e168 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0a000640 1 -- 172.21.15.144:0/31825908 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80b0070 con 0x7f3e0c0b55b0 2024-09-12T12:24:21.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0a000640 1 -- 172.21.15.144:0/31825908 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df80ab600 con 0x7f3e0c0b55b0 2024-09-12T12:24:21.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.412+0000 7f3e0a000640 1 -- 172.21.15.144:0/31825908 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80ab9d0 con 0x7f3e0c0b55b0 2024-09-12T12:24:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 -- 172.21.15.144:0/31825908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b55b0 msgr2=0x7f3e0c06d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 --2- 172.21.15.144:0/31825908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b55b0 0x7f3e0c06d200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3df80097c0 tx=0x7f3df801c410 comp rx=0 tx=0).stop 2024-09-12T12:24:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 -- 172.21.15.144:0/31825908 shutdown_connections 2024-09-12T12:24:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 --2- 172.21.15.144:0/31825908 >> v2:172.21.15.165:3300/0 conn(0x7f3e0c0b73a0 0x7f3e0c06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 --2- 172.21.15.144:0/31825908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b55b0 0x7f3e0c06d200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 -- 172.21.15.144:0/31825908 >> 172.21.15.144:0/31825908 conn(0x7f3e0c0d2500 msgr2=0x7f3e0c0d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 -- 172.21.15.144:0/31825908 shutdown_connections 2024-09-12T12:24:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 -- 172.21.15.144:0/31825908 wait complete. 2024-09-12T12:24:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 Processor -- start 2024-09-12T12:24:21.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 -- start start 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e0c0b55b0 0x7f3e0c1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b73a0 0x7f3e0c158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e0c15e7e0 0x7f3e0c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c15ed40 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c15ebc0 con 0x7f3e0c0b55b0 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e12000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c16ba40 con 0x7f3e0c0b73a0 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e0c15e7e0 0x7f3e0c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e0c15e7e0 0x7f3e0c15d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36464/0 (socket says 172.21.15.144:36464) 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0be00640 1 -- 172.21.15.144:0/4058776253 learned_addr learned my addr 172.21.15.144:0/4058776253 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0b400640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e0c0b55b0 0x7f3e0c1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0aa00640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b73a0 0x7f3e0c158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0be00640 1 -- 172.21.15.144:0/4058776253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b73a0 msgr2=0x7f3e0c158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0be00640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b73a0 0x7f3e0c158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0be00640 1 -- 172.21.15.144:0/4058776253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e0c0b55b0 msgr2=0x7f3e0c1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0be00640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e0c0b55b0 0x7f3e0c1549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.416+0000 7f3e0be00640 1 -- 172.21.15.144:0/4058776253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c15fed0 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e0be00640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e0c15e7e0 0x7f3e0c15d3b0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f3e04007e70 tx=0x7f3e0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e03400640 1 -- 172.21.15.144:0/4058776253 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04014620 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e03400640 1 -- 172.21.15.144:0/4058776253 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e04019070 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c1601b0 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e03400640 1 -- 172.21.15.144:0/4058776253 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04014a20 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c160a50 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0c1605a0 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e03400640 1 -- 172.21.15.144:0/4058776253 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e04014bc0 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e03400640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dec0678c0 0x7f3dec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e03400640 1 -- 172.21.15.144:0/4058776253 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f3e04086560 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.420+0000 7f3e0b400640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dec0678c0 0x7f3dec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.424+0000 7f3e0b400640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dec0678c0 0x7f3dec069d80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc005890 tx=0x7f3dfc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.424+0000 7f3e03400640 1 -- 172.21.15.144:0/4058776253 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3e04056950 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.640+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3e0c0b6c90 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.640+0000 7f3e03400640 1 -- 172.21.15.144:0/4058776253 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1383 (secure 0 0 0) 0x7f3e0405ac50 con 0x7f3e0c15e7e0 2024-09-12T12:24:21.642 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:21.642 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":721,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":176,"num_osds":8,"num_up_osds":8,"osd_up_since":1726143153,"num_in_osds":8,"osd_in_since":1726143142,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"creating+peering","count":8},{"state_name":"unknown","count":4}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592106,"bytes_used":456359936,"bytes_avail":772637753344,"bytes_total":773094113280,"unknown_pgs_ratio":0.041237112134695053,"inactive_pgs_ratio":0.082474224269390106,"write_bytes_sec":2380,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":136,"btime":"2024-09-12T12:24:19:399460+0000","id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"a","status":"up:active","gid":9795}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-12T12:24:01.521348+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T12:24:21.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dec0678c0 msgr2=0x7f3dec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dec0678c0 0x7f3dec069d80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc005890 tx=0x7f3dfc009040 comp rx=0 tx=0).stop 2024-09-12T12:24:21.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e0c15e7e0 msgr2=0x7f3e0c15d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e0c15e7e0 0x7f3e0c15d3b0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f3e04007e70 tx=0x7f3e0400e4b0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 shutdown_connections 2024-09-12T12:24:21.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3dec0678c0 0x7f3dec069d80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e0c15e7e0 0x7f3e0c15d3b0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0c0b73a0 0x7f3e0c158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 --2- 172.21.15.144:0/4058776253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e0c0b55b0 0x7f3e0c1549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 >> 172.21.15.144:0/4058776253 conn(0x7f3e0c0d2500 msgr2=0x7f3e0c0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:21.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 shutdown_connections 2024-09-12T12:24:21.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.644+0000 7f3e12000640 1 -- 172.21.15.144:0/4058776253 wait complete. 2024-09-12T12:24:21.662 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T12:24:21.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:24:21.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6bf1400640 1 Processor -- start 2024-09-12T12:24:21.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6bf1400640 1 -- start start 2024-09-12T12:24:21.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6bf1400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6bec0b44a0 0x7f6bec0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6bf1400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6bec06e300 0x7f6bec06e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6bf1400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bec0b6f60 con 0x7f6bec15e5f0 2024-09-12T12:24:21.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6bf1400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6bec06ec90 con 0x7f6bec0b44a0 2024-09-12T12:24:21.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6bf1400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6bec0b7240 con 0x7f6bec06e300 2024-09-12T12:24:21.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6bea800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6bec15e5f0 0x7f6bec06cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53092/0 (socket says 172.21.15.144:53092) 2024-09-12T12:24:21.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6bea800640 1 -- 172.21.15.144:0/3484165100 learned_addr learned my addr 172.21.15.144:0/3484165100 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:21.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6be9e00640 1 --2- 172.21.15.144:0/3484165100 >> v2:172.21.15.144:3300/0 conn(0x7f6bec0b44a0 0x7f6bec0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6beb200640 1 --2- 172.21.15.144:0/3484165100 >> v2:172.21.15.165:3300/0 conn(0x7f6bec06e300 0x7f6bec06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6be9400640 1 -- 172.21.15.144:0/3484165100 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1669753994 0 0) 0x7f6bec0b6f60 con 0x7f6bec15e5f0 2024-09-12T12:24:21.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6be9e00640 1 -- 172.21.15.144:0/3484165100 >> v2:172.21.15.165:3300/0 conn(0x7f6bec06e300 msgr2=0x7f6bec06e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:21.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6be9e00640 1 --2- 172.21.15.144:0/3484165100 >> v2:172.21.15.165:3300/0 conn(0x7f6bec06e300 0x7f6bec06e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6be9e00640 1 -- 172.21.15.144:0/3484165100 >> v1:172.21.15.144:6789/0 conn(0x7f6bec15e5f0 legacy=0x7f6bec06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6be9e00640 1 -- 172.21.15.144:0/3484165100 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec0b7520 con 0x7f6bec0b44a0 2024-09-12T12:24:21.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.800+0000 7f6beb200640 1 --2- 172.21.15.144:0/3484165100 >> v2:172.21.15.165:3300/0 conn(0x7f6bec06e300 0x7f6bec06e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:21.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6be9e00640 1 --2- 172.21.15.144:0/3484165100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 0x7f6bec0b48d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b63f0 tx=0x7f6bd801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92adee6be74a9138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6be9400640 1 -- 172.21.15.144:0/3484165100 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80b1070 con 0x7f6bec0b44a0 2024-09-12T12:24:21.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6be9400640 1 -- 172.21.15.144:0/3484165100 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd80a8050 con 0x7f6bec0b44a0 2024-09-12T12:24:21.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6be9400640 1 -- 172.21.15.144:0/3484165100 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80ac860 con 0x7f6bec0b44a0 2024-09-12T12:24:21.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 -- 172.21.15.144:0/3484165100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 msgr2=0x7f6bec0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 --2- 172.21.15.144:0/3484165100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 0x7f6bec0b48d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0b63f0 tx=0x7f6bd801c3c0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 -- 172.21.15.144:0/3484165100 shutdown_connections 2024-09-12T12:24:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 --2- 172.21.15.144:0/3484165100 >> v2:172.21.15.165:3300/0 conn(0x7f6bec06e300 0x7f6bec06e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 --2- 172.21.15.144:0/3484165100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 0x7f6bec0b48d0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 -- 172.21.15.144:0/3484165100 >> 172.21.15.144:0/3484165100 conn(0x7f6bec06f400 msgr2=0x7f6bec06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 -- 172.21.15.144:0/3484165100 shutdown_connections 2024-09-12T12:24:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 -- 172.21.15.144:0/3484165100 wait complete. 2024-09-12T12:24:21.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 Processor -- start 2024-09-12T12:24:21.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.804+0000 7f6bf1400640 1 -- start start 2024-09-12T12:24:21.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bf1400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bec06e300 0x7f6bec14b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bf1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 0x7f6bec1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bf1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bec15e5f0 0x7f6bec14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bf1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec15f8a0 con 0x7f6bec0b44a0 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bf1400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec15f720 con 0x7f6bec06e300 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bf1400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec15fa20 con 0x7f6bec15e5f0 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 0x7f6bec1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 0x7f6bec1524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36480/0 (socket says 172.21.15.144:36480) 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be9e00640 1 -- 172.21.15.144:0/2026728240 learned_addr learned my addr 172.21.15.144:0/2026728240 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bea800640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bec06e300 0x7f6bec14b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6beb200640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bec15e5f0 0x7f6bec14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be9e00640 1 -- 172.21.15.144:0/2026728240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bec15e5f0 msgr2=0x7f6bec14c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be9e00640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bec15e5f0 0x7f6bec14c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be9e00640 1 -- 172.21.15.144:0/2026728240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bec06e300 msgr2=0x7f6bec14b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be9e00640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bec06e300 0x7f6bec14b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be9e00640 1 -- 172.21.15.144:0/2026728240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec14f640 con 0x7f6bec0b44a0 2024-09-12T12:24:21.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be9e00640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 0x7f6bec1524b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8019ff0 tx=0x7f6bd801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be2a00640 1 -- 172.21.15.144:0/2026728240 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80bd070 con 0x7f6bec0b44a0 2024-09-12T12:24:21.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be2a00640 1 -- 172.21.15.144:0/2026728240 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bd80b2040 con 0x7f6bec0b44a0 2024-09-12T12:24:21.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6be2a00640 1 -- 172.21.15.144:0/2026728240 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80b1050 con 0x7f6bec0b44a0 2024-09-12T12:24:21.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec14f8b0 con 0x7f6bec0b44a0 2024-09-12T12:24:21.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec151f90 con 0x7f6bec0b44a0 2024-09-12T12:24:21.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.808+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bec06e750 con 0x7f6bec0b44a0 2024-09-12T12:24:21.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.812+0000 7f6be2a00640 1 -- 172.21.15.144:0/2026728240 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6bd8003620 con 0x7f6bec0b44a0 2024-09-12T12:24:21.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.812+0000 7f6be2a00640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bcc0678c0 0x7f6bcc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:21.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.812+0000 7f6be2a00640 1 -- 172.21.15.144:0/2026728240 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f6bd811f9d0 con 0x7f6bec0b44a0 2024-09-12T12:24:21.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.812+0000 7f6bea800640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bcc0678c0 0x7f6bcc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:21.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.812+0000 7f6bea800640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bcc0678c0 0x7f6bcc069d80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000f70 tx=0x7f6bdc007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:21.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.816+0000 7f6be2a00640 1 -- 172.21.15.144:0/2026728240 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6bd8016070 con 0x7f6bec0b44a0 2024-09-12T12:24:21.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.968+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6bec0b3320 con 0x7f6bcc0678c0 2024-09-12T12:24:21.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.976+0000 7f6be2a00640 1 -- 172.21.15.144:0/2026728240 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252488 (secure 0 0 0) 0x7f6bec0b3320 con 0x7f6bcc0678c0 2024-09-12T12:24:21.978 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:21.979 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:24:21.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bcc0678c0 msgr2=0x7f6bcc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bcc0678c0 0x7f6bcc069d80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000f70 tx=0x7f6bdc007df0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 msgr2=0x7f6bec1524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:21.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 0x7f6bec1524b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8019ff0 tx=0x7f6bd801ac00 comp rx=0 tx=0).stop 2024-09-12T12:24:21.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 shutdown_connections 2024-09-12T12:24:21.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6bcc0678c0 0x7f6bcc069d80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bec15e5f0 0x7f6bec14c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bec0b44a0 0x7f6bec1524b0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 --2- 172.21.15.144:0/2026728240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bec06e300 0x7f6bec14b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:21.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 >> 172.21.15.144:0/2026728240 conn(0x7f6bec06f400 msgr2=0x7f6bec06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:21.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 shutdown_connections 2024-09-12T12:24:21.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:21.980+0000 7f6bf1400640 1 -- 172.21.15.144:0/2026728240 wait complete. 2024-09-12T12:24:21.998 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2024-09-12T12:24:21.525339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":445716,"kb_used_data":18536,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754529004,"statfs":{"total":773094113280,"available":772637700096,"internally_reserved":0,"allocated":18980864,"data_stored":9565996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.151842"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376298+0000","last_change":"2024-09-12T12:24:16.395627+0000","last_active":"2024-09-12T12:24:17.376298+0000","last_peered":"2024-09-12T12:24:17.376298+0000","last_clean":"2024-09-12T12:24:17.376298+0000","last_became_active":"2024-09-12T12:24:16.395322+0000","last_became_peered":"2024-09-12T12:24:16.395322+0000","last_unstale":"2024-09-12T12:24:17.376298+0000","last_undegraded":"2024-09-12T12:24:17.376298+0000","last_fullsized":"2024-09-12T12:24:17.376298+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:16.943178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376308+0000","last_change":"2024-09-12T12:24:16.399843+0000","last_active":"2024-09-12T12:24:17.376308+0000","last_peered":"2024-09-12T12:24:17.376308+0000","last_clean":"2024-09-12T12:24:17.376308+0000","last_became_active":"2024-09-12T12:24:16.399540+0000","last_became_peered":"2024-09-12T12:24:16.399540+0000","last_unstale":"2024-09-12T12:24:17.376308+0000","last_undegraded":"2024-09-12T12:24:17.376308+0000","last_fullsized":"2024-09-12T12:24:17.376308+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:18.125453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376939+0000","last_change":"2024-09-12T12:24:16.390401+0000","last_active":"2024-09-12T12:24:17.376939+0000","last_peered":"2024-09-12T12:24:17.376939+0000","last_clean":"2024-09-12T12:24:17.376939+0000","last_became_active":"2024-09-12T12:24:16.390125+0000","last_became_peered":"2024-09-12T12:24:16.390125+0000","last_unstale":"2024-09-12T12:24:17.376939+0000","last_undegraded":"2024-09-12T12:24:17.376939+0000","last_fullsized":"2024-09-12T12:24:17.376939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:13.958791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513192+0000","last_change":"2024-09-12T12:24:16.383289+0000","last_active":"2024-09-12T12:24:17.513192+0000","last_peered":"2024-09-12T12:24:17.513192+0000","last_clean":"2024-09-12T12:24:17.513192+0000","last_became_active":"2024-09-12T12:24:16.382709+0000","last_became_peered":"2024-09-12T12:24:16.382709+0000","last_unstale":"2024-09-12T12:24:17.513192+0000","last_undegraded":"2024-09-12T12:24:17.513192+0000","last_fullsized":"2024-09-12T12:24:17.513192+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:50.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614197+0000","last_change":"2024-09-12T12:24:16.397905+0000","last_active":"2024-09-12T12:24:18.614197+0000","last_peered":"2024-09-12T12:24:18.614197+0000","last_clean":"2024-09-12T12:24:18.614197+0000","last_became_active":"2024-09-12T12:24:16.397631+0000","last_became_peered":"2024-09-12T12:24:16.397631+0000","last_unstale":"2024-09-12T12:24:18.614197+0000","last_undegraded":"2024-09-12T12:24:18.614197+0000","last_fullsized":"2024-09-12T12:24:18.614197+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:19.720611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614055+0000","last_change":"2024-09-12T12:24:16.405121+0000","last_active":"2024-09-12T12:24:18.614055+0000","last_peered":"2024-09-12T12:24:18.614055+0000","last_clean":"2024-09-12T12:24:18.614055+0000","last_became_active":"2024-09-12T12:24:16.404807+0000","last_became_peered":"2024-09-12T12:24:16.404807+0000","last_unstale":"2024-09-12T12:24:18.614055+0000","last_undegraded":"2024-09-12T12:24:18.614055+0000","last_fullsized":"2024-09-12T12:24:18.614055+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:46.225664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402195+0000","last_change":"2024-09-12T12:24:16.396455+0000","last_active":"2024-09-12T12:24:17.402195+0000","last_peered":"2024-09-12T12:24:17.402195+0000","last_clean":"2024-09-12T12:24:17.402195+0000","last_became_active":"2024-09-12T12:24:16.396163+0000","last_became_peered":"2024-09-12T12:24:16.396163+0000","last_unstale":"2024-09-12T12:24:17.402195+0000","last_undegraded":"2024-09-12T12:24:17.402195+0000","last_fullsized":"2024-09-12T12:24:17.402195+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:51.534062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614642+0000","last_change":"2024-09-12T12:24:16.398847+0000","last_active":"2024-09-12T12:24:18.614642+0000","last_peered":"2024-09-12T12:24:18.614642+0000","last_clean":"2024-09-12T12:24:18.614642+0000","last_became_active":"2024-09-12T12:24:16.398566+0000","last_became_peered":"2024-09-12T12:24:16.398566+0000","last_unstale":"2024-09-12T12:24:18.614642+0000","last_undegraded":"2024-09-12T12:24:18.614642+0000","last_fullsized":"2024-09-12T12:24:18.614642+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:18.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376446+0000","last_change":"2024-09-12T12:24:16.387534+0000","last_active":"2024-09-12T12:24:17.376446+0000","last_peered":"2024-09-12T12:24:17.376446+0000","last_clean":"2024-09-12T12:24:17.376446+0000","last_became_active":"2024-09-12T12:24:16.387258+0000","last_became_peered":"2024-09-12T12:24:16.387258+0000","last_unstale":"2024-09-12T12:24:17.376446+0000","last_undegraded":"2024-09-12T12:24:17.376446+0000","last_fullsized":"2024-09-12T12:24:17.376446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:40.475529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614640+0000","last_change":"2024-09-12T12:24:16.389429+0000","last_active":"2024-09-12T12:24:18.614640+0000","last_peered":"2024-09-12T12:24:18.614640+0000","last_clean":"2024-09-12T12:24:18.614640+0000","last_became_active":"2024-09-12T12:24:16.389118+0000","last_became_peered":"2024-09-12T12:24:16.389118+0000","last_unstale":"2024-09-12T12:24:18.614640+0000","last_undegraded":"2024-09-12T12:24:18.614640+0000","last_fullsized":"2024-09-12T12:24:18.614640+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:17.258071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070564+0000","last_change":"2024-09-12T12:24:16.395888+0000","last_active":"2024-09-12T12:24:18.070564+0000","last_peered":"2024-09-12T12:24:18.070564+0000","last_clean":"2024-09-12T12:24:18.070564+0000","last_became_active":"2024-09-12T12:24:16.395552+0000","last_became_peered":"2024-09-12T12:24:16.395552+0000","last_unstale":"2024-09-12T12:24:18.070564+0000","last_undegraded":"2024-09-12T12:24:18.070564+0000","last_fullsized":"2024-09-12T12:24:18.070564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:42.839292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513199+0000","last_change":"2024-09-12T12:24:16.396978+0000","last_active":"2024-09-12T12:24:17.513199+0000","last_peered":"2024-09-12T12:24:17.513199+0000","last_clean":"2024-09-12T12:24:17.513199+0000","last_became_active":"2024-09-12T12:24:16.395817+0000","last_became_peered":"2024-09-12T12:24:16.395817+0000","last_unstale":"2024-09-12T12:24:17.513199+0000","last_undegraded":"2024-09-12T12:24:17.513199+0000","last_fullsized":"2024-09-12T12:24:17.513199+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:11.083056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377994+0000","last_change":"2024-09-12T12:24:16.385909+0000","last_active":"2024-09-12T12:24:17.377994+0000","last_peered":"2024-09-12T12:24:17.377994+0000","last_clean":"2024-09-12T12:24:17.377994+0000","last_became_active":"2024-09-12T12:24:16.385618+0000","last_became_peered":"2024-09-12T12:24:16.385618+0000","last_unstale":"2024-09-12T12:24:17.377994+0000","last_undegraded":"2024-09-12T12:24:17.377994+0000","last_fullsized":"2024-09-12T12:24:17.377994+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.645811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402120+0000","last_change":"2024-09-12T12:24:16.389264+0000","last_active":"2024-09-12T12:24:17.402120+0000","last_peered":"2024-09-12T12:24:17.402120+0000","last_clean":"2024-09-12T12:24:17.402120+0000","last_became_active":"2024-09-12T12:24:16.383477+0000","last_became_peered":"2024-09-12T12:24:16.383477+0000","last_unstale":"2024-09-12T12:24:17.402120+0000","last_undegraded":"2024-09-12T12:24:17.402120+0000","last_fullsized":"2024-09-12T12:24:17.402120+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:00.350364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375908+0000","last_change":"2024-09-12T12:24:16.396038+0000","last_active":"2024-09-12T12:24:17.375908+0000","last_peered":"2024-09-12T12:24:17.375908+0000","last_clean":"2024-09-12T12:24:17.375908+0000","last_became_active":"2024-09-12T12:24:16.395776+0000","last_became_peered":"2024-09-12T12:24:16.395776+0000","last_unstale":"2024-09-12T12:24:17.375908+0000","last_undegraded":"2024-09-12T12:24:17.375908+0000","last_fullsized":"2024-09-12T12:24:17.375908+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613990+0000","last_change":"2024-09-12T12:24:16.394206+0000","last_active":"2024-09-12T12:24:18.613990+0000","last_peered":"2024-09-12T12:24:18.613990+0000","last_clean":"2024-09-12T12:24:18.613990+0000","last_became_active":"2024-09-12T12:24:16.393946+0000","last_became_peered":"2024-09-12T12:24:16.393946+0000","last_unstale":"2024-09-12T12:24:18.613990+0000","last_undegraded":"2024-09-12T12:24:18.613990+0000","last_fullsized":"2024-09-12T12:24:18.613990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:33.481891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614623+0000","last_change":"2024-09-12T12:24:16.393808+0000","last_active":"2024-09-12T12:24:18.614623+0000","last_peered":"2024-09-12T12:24:18.614623+0000","last_clean":"2024-09-12T12:24:18.614623+0000","last_became_active":"2024-09-12T12:24:16.393444+0000","last_became_peered":"2024-09-12T12:24:16.393444+0000","last_unstale":"2024-09-12T12:24:18.614623+0000","last_undegraded":"2024-09-12T12:24:18.614623+0000","last_fullsized":"2024-09-12T12:24:18.614623+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:16.973624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378284+0000","last_change":"2024-09-12T12:24:16.395785+0000","last_active":"2024-09-12T12:24:17.378284+0000","last_peered":"2024-09-12T12:24:17.378284+0000","last_clean":"2024-09-12T12:24:17.378284+0000","last_became_active":"2024-09-12T12:24:16.395155+0000","last_became_peered":"2024-09-12T12:24:16.395155+0000","last_unstale":"2024-09-12T12:24:17.378284+0000","last_undegraded":"2024-09-12T12:24:17.378284+0000","last_fullsized":"2024-09-12T12:24:17.378284+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.128062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378263+0000","last_change":"2024-09-12T12:24:16.384665+0000","last_active":"2024-09-12T12:24:17.378263+0000","last_peered":"2024-09-12T12:24:17.378263+0000","last_clean":"2024-09-12T12:24:17.378263+0000","last_became_active":"2024-09-12T12:24:16.384397+0000","last_became_peered":"2024-09-12T12:24:16.384397+0000","last_unstale":"2024-09-12T12:24:17.378263+0000","last_undegraded":"2024-09-12T12:24:17.378263+0000","last_fullsized":"2024-09-12T12:24:17.378263+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:33.904641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614178+0000","last_change":"2024-09-12T12:24:16.398048+0000","last_active":"2024-09-12T12:24:18.614178+0000","last_peered":"2024-09-12T12:24:18.614178+0000","last_clean":"2024-09-12T12:24:18.614178+0000","last_became_active":"2024-09-12T12:24:16.397351+0000","last_became_peered":"2024-09-12T12:24:16.397351+0000","last_unstale":"2024-09-12T12:24:18.614178+0000","last_undegraded":"2024-09-12T12:24:18.614178+0000","last_fullsized":"2024-09-12T12:24:18.614178+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:42.510300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376118+0000","last_change":"2024-09-12T12:24:16.401679+0000","last_active":"2024-09-12T12:24:17.376118+0000","last_peered":"2024-09-12T12:24:17.376118+0000","last_clean":"2024-09-12T12:24:17.376118+0000","last_became_active":"2024-09-12T12:24:16.401427+0000","last_became_peered":"2024-09-12T12:24:16.401427+0000","last_unstale":"2024-09-12T12:24:17.376118+0000","last_undegraded":"2024-09-12T12:24:17.376118+0000","last_fullsized":"2024-09-12T12:24:17.376118+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:33.370897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376014+0000","last_change":"2024-09-12T12:24:16.389730+0000","last_active":"2024-09-12T12:24:17.376014+0000","last_peered":"2024-09-12T12:24:17.376014+0000","last_clean":"2024-09-12T12:24:17.376014+0000","last_became_active":"2024-09-12T12:24:16.388457+0000","last_became_peered":"2024-09-12T12:24:16.388457+0000","last_unstale":"2024-09-12T12:24:17.376014+0000","last_undegraded":"2024-09-12T12:24:17.376014+0000","last_fullsized":"2024-09-12T12:24:17.376014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:30.253279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614643+0000","last_change":"2024-09-12T12:24:16.408247+0000","last_active":"2024-09-12T12:24:18.614643+0000","last_peered":"2024-09-12T12:24:18.614643+0000","last_clean":"2024-09-12T12:24:18.614643+0000","last_became_active":"2024-09-12T12:24:16.406896+0000","last_became_peered":"2024-09-12T12:24:16.406896+0000","last_unstale":"2024-09-12T12:24:18.614643+0000","last_undegraded":"2024-09-12T12:24:18.614643+0000","last_fullsized":"2024-09-12T12:24:18.614643+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:41.568837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376092+0000","last_change":"2024-09-12T12:24:16.395602+0000","last_active":"2024-09-12T12:24:17.376092+0000","last_peered":"2024-09-12T12:24:17.376092+0000","last_clean":"2024-09-12T12:24:17.376092+0000","last_became_active":"2024-09-12T12:24:16.395302+0000","last_became_peered":"2024-09-12T12:24:16.395302+0000","last_unstale":"2024-09-12T12:24:17.376092+0000","last_undegraded":"2024-09-12T12:24:17.376092+0000","last_fullsized":"2024-09-12T12:24:17.376092+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:37.307464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402587+0000","last_change":"2024-09-12T12:24:16.391686+0000","last_active":"2024-09-12T12:24:17.402587+0000","last_peered":"2024-09-12T12:24:17.402587+0000","last_clean":"2024-09-12T12:24:17.402587+0000","last_became_active":"2024-09-12T12:24:16.391350+0000","last_became_peered":"2024-09-12T12:24:16.391350+0000","last_unstale":"2024-09-12T12:24:17.402587+0000","last_undegraded":"2024-09-12T12:24:17.402587+0000","last_fullsized":"2024-09-12T12:24:17.402587+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:49:56.998916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070631+0000","last_change":"2024-09-12T12:24:16.396345+0000","last_active":"2024-09-12T12:24:18.070631+0000","last_peered":"2024-09-12T12:24:18.070631+0000","last_clean":"2024-09-12T12:24:18.070631+0000","last_became_active":"2024-09-12T12:24:16.395947+0000","last_became_peered":"2024-09-12T12:24:16.395947+0000","last_unstale":"2024-09-12T12:24:18.070631+0000","last_undegraded":"2024-09-12T12:24:18.070631+0000","last_fullsized":"2024-09-12T12:24:18.070631+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:29.398497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614874+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:18.614874+0000","last_peered":"2024-09-12T12:24:18.614874+0000","last_clean":"2024-09-12T12:24:18.614874+0000","last_became_active":"2024-09-12T12:24:16.399490+0000","last_became_peered":"2024-09-12T12:24:16.399490+0000","last_unstale":"2024-09-12T12:24:18.614874+0000","last_undegraded":"2024-09-12T12:24:18.614874+0000","last_fullsized":"2024-09-12T12:24:18.614874+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:40.136783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:16.398270+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:16.397722+0000","last_became_peered":"2024-09-12T12:24:16.397722+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:26.658081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070437+0000","last_change":"2024-09-12T12:24:16.405818+0000","last_active":"2024-09-12T12:24:18.070437+0000","last_peered":"2024-09-12T12:24:18.070437+0000","last_clean":"2024-09-12T12:24:18.070437+0000","last_became_active":"2024-09-12T12:24:16.405396+0000","last_became_peered":"2024-09-12T12:24:16.405396+0000","last_unstale":"2024-09-12T12:24:18.070437+0000","last_undegraded":"2024-09-12T12:24:18.070437+0000","last_fullsized":"2024-09-12T12:24:18.070437+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:53.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070239+0000","last_change":"2024-09-12T12:24:16.407758+0000","last_active":"2024-09-12T12:24:18.070239+0000","last_peered":"2024-09-12T12:24:18.070239+0000","last_clean":"2024-09-12T12:24:18.070239+0000","last_became_active":"2024-09-12T12:24:16.407508+0000","last_became_peered":"2024-09-12T12:24:16.407508+0000","last_unstale":"2024-09-12T12:24:18.070239+0000","last_undegraded":"2024-09-12T12:24:18.070239+0000","last_fullsized":"2024-09-12T12:24:18.070239+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:08.809853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402121+0000","last_change":"2024-09-12T12:24:16.405155+0000","last_active":"2024-09-12T12:24:17.402121+0000","last_peered":"2024-09-12T12:24:17.402121+0000","last_clean":"2024-09-12T12:24:17.402121+0000","last_became_active":"2024-09-12T12:24:16.404882+0000","last_became_peered":"2024-09-12T12:24:16.404882+0000","last_unstale":"2024-09-12T12:24:17.402121+0000","last_undegraded":"2024-09-12T12:24:17.402121+0000","last_fullsized":"2024-09-12T12:24:17.402121+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:18.643188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614001+0000","last_change":"2024-09-12T12:24:16.387749+0000","last_active":"2024-09-12T12:24:18.614001+0000","last_peered":"2024-09-12T12:24:18.614001+0000","last_clean":"2024-09-12T12:24:18.614001+0000","last_became_active":"2024-09-12T12:24:16.387503+0000","last_became_peered":"2024-09-12T12:24:16.387503+0000","last_unstale":"2024-09-12T12:24:18.614001+0000","last_undegraded":"2024-09-12T12:24:18.614001+0000","last_fullsized":"2024-09-12T12:24:18.614001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:59.828091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614916+0000","last_change":"2024-09-12T12:24:16.397982+0000","last_active":"2024-09-12T12:24:18.614916+0000","last_peered":"2024-09-12T12:24:18.614916+0000","last_clean":"2024-09-12T12:24:18.614916+0000","last_became_active":"2024-09-12T12:24:16.397718+0000","last_became_peered":"2024-09-12T12:24:16.397718+0000","last_unstale":"2024-09-12T12:24:18.614916+0000","last_undegraded":"2024-09-12T12:24:18.614916+0000","last_fullsized":"2024-09-12T12:24:18.614916+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"175'4","reported_seq":18,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513119+0000","last_change":"2024-09-12T12:24:15.383469+0000","last_active":"2024-09-12T12:24:17.513119+0000","last_peered":"2024-09-12T12:24:17.513119+0000","last_clean":"2024-09-12T12:24:17.513119+0000","last_became_active":"2024-09-12T12:24:15.383202+0000","last_became_peered":"2024-09-12T12:24:15.383202+0000","last_unstale":"2024-09-12T12:24:17.513119+0000","last_undegraded":"2024-09-12T12:24:17.513119+0000","last_fullsized":"2024-09-12T12:24:17.513119+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:32.820899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402547+0000","last_change":"2024-09-12T12:24:16.399030+0000","last_active":"2024-09-12T12:24:17.402547+0000","last_peered":"2024-09-12T12:24:17.402547+0000","last_clean":"2024-09-12T12:24:17.402547+0000","last_became_active":"2024-09-12T12:24:16.398598+0000","last_became_peered":"2024-09-12T12:24:16.398598+0000","last_unstale":"2024-09-12T12:24:17.402547+0000","last_undegraded":"2024-09-12T12:24:17.402547+0000","last_fullsized":"2024-09-12T12:24:17.402547+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:38.682077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614535+0000","last_change":"2024-09-12T12:24:15.399932+0000","last_active":"2024-09-12T12:24:18.614535+0000","last_peered":"2024-09-12T12:24:18.614535+0000","last_clean":"2024-09-12T12:24:18.614535+0000","last_became_active":"2024-09-12T12:24:15.399298+0000","last_became_peered":"2024-09-12T12:24:15.399298+0000","last_unstale":"2024-09-12T12:24:18.614535+0000","last_undegraded":"2024-09-12T12:24:18.614535+0000","last_fullsized":"2024-09-12T12:24:18.614535+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:49.018706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070727+0000","last_change":"2024-09-12T12:24:16.397252+0000","last_active":"2024-09-12T12:24:18.070727+0000","last_peered":"2024-09-12T12:24:18.070727+0000","last_clean":"2024-09-12T12:24:18.070727+0000","last_became_active":"2024-09-12T12:24:16.396964+0000","last_became_peered":"2024-09-12T12:24:16.396964+0000","last_unstale":"2024-09-12T12:24:18.070727+0000","last_undegraded":"2024-09-12T12:24:18.070727+0000","last_fullsized":"2024-09-12T12:24:18.070727+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:16.827590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070399+0000","last_change":"2024-09-12T12:24:15.388771+0000","last_active":"2024-09-12T12:24:18.070399+0000","last_peered":"2024-09-12T12:24:18.070399+0000","last_clean":"2024-09-12T12:24:18.070399+0000","last_became_active":"2024-09-12T12:24:15.388489+0000","last_became_peered":"2024-09-12T12:24:15.388489+0000","last_unstale":"2024-09-12T12:24:18.070399+0000","last_undegraded":"2024-09-12T12:24:18.070399+0000","last_fullsized":"2024-09-12T12:24:18.070399+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.638923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377349+0000","last_change":"2024-09-12T12:24:16.398321+0000","last_active":"2024-09-12T12:24:17.377349+0000","last_peered":"2024-09-12T12:24:17.377349+0000","last_clean":"2024-09-12T12:24:17.377349+0000","last_became_active":"2024-09-12T12:24:16.398059+0000","last_became_peered":"2024-09-12T12:24:16.398059+0000","last_unstale":"2024-09-12T12:24:17.377349+0000","last_undegraded":"2024-09-12T12:24:17.377349+0000","last_fullsized":"2024-09-12T12:24:17.377349+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:49.642450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377968+0000","last_change":"2024-09-12T12:24:15.392075+0000","last_active":"2024-09-12T12:24:17.377968+0000","last_peered":"2024-09-12T12:24:17.377968+0000","last_clean":"2024-09-12T12:24:17.377968+0000","last_became_active":"2024-09-12T12:24:15.391802+0000","last_became_peered":"2024-09-12T12:24:15.391802+0000","last_unstale":"2024-09-12T12:24:17.377968+0000","last_undegraded":"2024-09-12T12:24:17.377968+0000","last_fullsized":"2024-09-12T12:24:17.377968+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377422+0000","last_change":"2024-09-12T12:24:16.390477+0000","last_active":"2024-09-12T12:24:17.377422+0000","last_peered":"2024-09-12T12:24:17.377422+0000","last_clean":"2024-09-12T12:24:17.377422+0000","last_became_active":"2024-09-12T12:24:16.390202+0000","last_became_peered":"2024-09-12T12:24:16.390202+0000","last_unstale":"2024-09-12T12:24:17.377422+0000","last_undegraded":"2024-09-12T12:24:17.377422+0000","last_fullsized":"2024-09-12T12:24:17.377422+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:06.504087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614269+0000","last_change":"2024-09-12T12:24:15.401541+0000","last_active":"2024-09-12T12:24:18.614269+0000","last_peered":"2024-09-12T12:24:18.614269+0000","last_clean":"2024-09-12T12:24:18.614269+0000","last_became_active":"2024-09-12T12:24:15.400546+0000","last_became_peered":"2024-09-12T12:24:15.400546+0000","last_unstale":"2024-09-12T12:24:18.614269+0000","last_undegraded":"2024-09-12T12:24:18.614269+0000","last_fullsized":"2024-09-12T12:24:18.614269+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:22.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376083+0000","last_change":"2024-09-12T12:24:16.394306+0000","last_active":"2024-09-12T12:24:17.376083+0000","last_peered":"2024-09-12T12:24:17.376083+0000","last_clean":"2024-09-12T12:24:17.376083+0000","last_became_active":"2024-09-12T12:24:16.394065+0000","last_became_peered":"2024-09-12T12:24:16.394065+0000","last_unstale":"2024-09-12T12:24:17.376083+0000","last_undegraded":"2024-09-12T12:24:17.376083+0000","last_fullsized":"2024-09-12T12:24:17.376083+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:01.040775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.512954+0000","last_change":"2024-09-12T12:24:15.396683+0000","last_active":"2024-09-12T12:24:17.512954+0000","last_peered":"2024-09-12T12:24:17.512954+0000","last_clean":"2024-09-12T12:24:17.512954+0000","last_became_active":"2024-09-12T12:24:15.396060+0000","last_became_peered":"2024-09-12T12:24:15.396060+0000","last_unstale":"2024-09-12T12:24:17.512954+0000","last_undegraded":"2024-09-12T12:24:17.512954+0000","last_fullsized":"2024-09-12T12:24:17.512954+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:20.372783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376277+0000","last_change":"2024-09-12T12:24:16.398115+0000","last_active":"2024-09-12T12:24:17.376277+0000","last_peered":"2024-09-12T12:24:17.376277+0000","last_clean":"2024-09-12T12:24:17.376277+0000","last_became_active":"2024-09-12T12:24:16.397797+0000","last_became_peered":"2024-09-12T12:24:16.397797+0000","last_unstale":"2024-09-12T12:24:17.376277+0000","last_undegraded":"2024-09-12T12:24:17.376277+0000","last_fullsized":"2024-09-12T12:24:17.376277+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:52.182844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377746+0000","last_change":"2024-09-12T12:24:15.391060+0000","last_active":"2024-09-12T12:24:17.377746+0000","last_peered":"2024-09-12T12:24:17.377746+0000","last_clean":"2024-09-12T12:24:17.377746+0000","last_became_active":"2024-09-12T12:24:15.390781+0000","last_became_peered":"2024-09-12T12:24:15.390781+0000","last_unstale":"2024-09-12T12:24:17.377746+0000","last_undegraded":"2024-09-12T12:24:17.377746+0000","last_fullsized":"2024-09-12T12:24:17.377746+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:34.109701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614981+0000","last_change":"2024-09-12T12:24:16.395507+0000","last_active":"2024-09-12T12:24:18.614981+0000","last_peered":"2024-09-12T12:24:18.614981+0000","last_clean":"2024-09-12T12:24:18.614981+0000","last_became_active":"2024-09-12T12:24:16.395221+0000","last_became_peered":"2024-09-12T12:24:16.395221+0000","last_unstale":"2024-09-12T12:24:18.614981+0000","last_undegraded":"2024-09-12T12:24:18.614981+0000","last_fullsized":"2024-09-12T12:24:18.614981+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614536+0000","last_change":"2024-09-12T12:24:15.396881+0000","last_active":"2024-09-12T12:24:18.614536+0000","last_peered":"2024-09-12T12:24:18.614536+0000","last_clean":"2024-09-12T12:24:18.614536+0000","last_became_active":"2024-09-12T12:24:15.396494+0000","last_became_peered":"2024-09-12T12:24:15.396494+0000","last_unstale":"2024-09-12T12:24:18.614536+0000","last_undegraded":"2024-09-12T12:24:18.614536+0000","last_fullsized":"2024-09-12T12:24:18.614536+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:10.076168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614438+0000","last_change":"2024-09-12T12:24:16.390011+0000","last_active":"2024-09-12T12:24:18.614438+0000","last_peered":"2024-09-12T12:24:18.614438+0000","last_clean":"2024-09-12T12:24:18.614438+0000","last_became_active":"2024-09-12T12:24:16.389735+0000","last_became_peered":"2024-09-12T12:24:16.389735+0000","last_unstale":"2024-09-12T12:24:18.614438+0000","last_undegraded":"2024-09-12T12:24:18.614438+0000","last_fullsized":"2024-09-12T12:24:18.614438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:57.836183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376367+0000","last_change":"2024-09-12T12:24:15.399114+0000","last_active":"2024-09-12T12:24:17.376367+0000","last_peered":"2024-09-12T12:24:17.376367+0000","last_clean":"2024-09-12T12:24:17.376367+0000","last_became_active":"2024-09-12T12:24:15.398674+0000","last_became_peered":"2024-09-12T12:24:15.398674+0000","last_unstale":"2024-09-12T12:24:17.376367+0000","last_undegraded":"2024-09-12T12:24:17.376367+0000","last_fullsized":"2024-09-12T12:24:17.376367+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:48.465962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378417+0000","last_change":"2024-09-12T12:24:16.399719+0000","last_active":"2024-09-12T12:24:17.378417+0000","last_peered":"2024-09-12T12:24:17.378417+0000","last_clean":"2024-09-12T12:24:17.378417+0000","last_became_active":"2024-09-12T12:24:16.399424+0000","last_became_peered":"2024-09-12T12:24:16.399424+0000","last_unstale":"2024-09-12T12:24:17.378417+0000","last_undegraded":"2024-09-12T12:24:17.378417+0000","last_fullsized":"2024-09-12T12:24:17.378417+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:45.872966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"175'3","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513008+0000","last_change":"2024-09-12T12:24:15.398540+0000","last_active":"2024-09-12T12:24:17.513008+0000","last_peered":"2024-09-12T12:24:17.513008+0000","last_clean":"2024-09-12T12:24:17.513008+0000","last_became_active":"2024-09-12T12:24:15.398284+0000","last_became_peered":"2024-09-12T12:24:15.398284+0000","last_unstale":"2024-09-12T12:24:17.513008+0000","last_undegraded":"2024-09-12T12:24:17.513008+0000","last_fullsized":"2024-09-12T12:24:17.513008+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:18.784440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376580+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:17.376580+0000","last_peered":"2024-09-12T12:24:17.376580+0000","last_clean":"2024-09-12T12:24:17.376580+0000","last_became_active":"2024-09-12T12:24:16.399517+0000","last_became_peered":"2024-09-12T12:24:16.399517+0000","last_unstale":"2024-09-12T12:24:17.376580+0000","last_undegraded":"2024-09-12T12:24:17.376580+0000","last_fullsized":"2024-09-12T12:24:17.376580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:36.668056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"175'6","reported_seq":20,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377972+0000","last_change":"2024-09-12T12:24:15.389229+0000","last_active":"2024-09-12T12:24:17.377972+0000","last_peered":"2024-09-12T12:24:17.377972+0000","last_clean":"2024-09-12T12:24:17.377972+0000","last_became_active":"2024-09-12T12:24:15.388660+0000","last_became_peered":"2024-09-12T12:24:15.388660+0000","last_unstale":"2024-09-12T12:24:17.377972+0000","last_undegraded":"2024-09-12T12:24:17.377972+0000","last_fullsized":"2024-09-12T12:24:17.377972+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:02.449575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402106+0000","last_change":"2024-09-12T12:24:16.399205+0000","last_active":"2024-09-12T12:24:17.402106+0000","last_peered":"2024-09-12T12:24:17.402106+0000","last_clean":"2024-09-12T12:24:17.402106+0000","last_became_active":"2024-09-12T12:24:16.398875+0000","last_became_peered":"2024-09-12T12:24:16.398875+0000","last_unstale":"2024-09-12T12:24:17.402106+0000","last_undegraded":"2024-09-12T12:24:17.402106+0000","last_fullsized":"2024-09-12T12:24:17.402106+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:47.257395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378190+0000","last_change":"2024-09-12T12:24:15.385396+0000","last_active":"2024-09-12T12:24:17.378190+0000","last_peered":"2024-09-12T12:24:17.378190+0000","last_clean":"2024-09-12T12:24:17.378190+0000","last_became_active":"2024-09-12T12:24:15.385095+0000","last_became_peered":"2024-09-12T12:24:15.385095+0000","last_unstale":"2024-09-12T12:24:17.378190+0000","last_undegraded":"2024-09-12T12:24:17.378190+0000","last_fullsized":"2024-09-12T12:24:17.378190+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613984+0000","last_change":"2024-09-12T12:24:16.390955+0000","last_active":"2024-09-12T12:24:18.613984+0000","last_peered":"2024-09-12T12:24:18.613984+0000","last_clean":"2024-09-12T12:24:18.613984+0000","last_became_active":"2024-09-12T12:24:16.388418+0000","last_became_peered":"2024-09-12T12:24:16.388418+0000","last_unstale":"2024-09-12T12:24:18.613984+0000","last_undegraded":"2024-09-12T12:24:18.613984+0000","last_fullsized":"2024-09-12T12:24:18.613984+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:40.208012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376309+0000","last_change":"2024-09-12T12:24:15.395867+0000","last_active":"2024-09-12T12:24:17.376309+0000","last_peered":"2024-09-12T12:24:17.376309+0000","last_clean":"2024-09-12T12:24:17.376309+0000","last_became_active":"2024-09-12T12:24:15.395594+0000","last_became_peered":"2024-09-12T12:24:15.395594+0000","last_unstale":"2024-09-12T12:24:17.376309+0000","last_undegraded":"2024-09-12T12:24:17.376309+0000","last_fullsized":"2024-09-12T12:24:17.376309+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:41.348309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377938+0000","last_change":"2024-09-12T12:24:16.387185+0000","last_active":"2024-09-12T12:24:17.377938+0000","last_peered":"2024-09-12T12:24:17.377938+0000","last_clean":"2024-09-12T12:24:17.377938+0000","last_became_active":"2024-09-12T12:24:16.386859+0000","last_became_peered":"2024-09-12T12:24:16.386859+0000","last_unstale":"2024-09-12T12:24:17.377938+0000","last_undegraded":"2024-09-12T12:24:17.377938+0000","last_fullsized":"2024-09-12T12:24:17.377938+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.116554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.512818+0000","last_change":"2024-09-12T12:24:15.381755+0000","last_active":"2024-09-12T12:24:17.512818+0000","last_peered":"2024-09-12T12:24:17.512818+0000","last_clean":"2024-09-12T12:24:17.512818+0000","last_became_active":"2024-09-12T12:24:15.380476+0000","last_became_peered":"2024-09-12T12:24:15.380476+0000","last_unstale":"2024-09-12T12:24:17.512818+0000","last_undegraded":"2024-09-12T12:24:17.512818+0000","last_fullsized":"2024-09-12T12:24:17.512818+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:18.835629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378125+0000","last_change":"2024-09-12T12:24:16.403838+0000","last_active":"2024-09-12T12:24:17.378125+0000","last_peered":"2024-09-12T12:24:17.378125+0000","last_clean":"2024-09-12T12:24:17.378125+0000","last_became_active":"2024-09-12T12:24:16.403611+0000","last_became_peered":"2024-09-12T12:24:16.403611+0000","last_unstale":"2024-09-12T12:24:17.378125+0000","last_undegraded":"2024-09-12T12:24:17.378125+0000","last_fullsized":"2024-09-12T12:24:17.378125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:38.894390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"175'8","reported_seq":22,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070217+0000","last_change":"2024-09-12T12:24:15.388767+0000","last_active":"2024-09-12T12:24:18.070217+0000","last_peered":"2024-09-12T12:24:18.070217+0000","last_clean":"2024-09-12T12:24:18.070217+0000","last_became_active":"2024-09-12T12:24:15.388428+0000","last_became_peered":"2024-09-12T12:24:15.388428+0000","last_unstale":"2024-09-12T12:24:18.070217+0000","last_undegraded":"2024-09-12T12:24:18.070217+0000","last_fullsized":"2024-09-12T12:24:18.070217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:53.990844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402245+0000","last_change":"2024-09-12T12:24:16.405120+0000","last_active":"2024-09-12T12:24:17.402245+0000","last_peered":"2024-09-12T12:24:17.402245+0000","last_clean":"2024-09-12T12:24:17.402245+0000","last_became_active":"2024-09-12T12:24:16.404831+0000","last_became_peered":"2024-09-12T12:24:16.404831+0000","last_unstale":"2024-09-12T12:24:17.402245+0000","last_undegraded":"2024-09-12T12:24:17.402245+0000","last_fullsized":"2024-09-12T12:24:17.402245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.752182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070641+0000","last_change":"2024-09-12T12:24:15.394278+0000","last_active":"2024-09-12T12:24:18.070641+0000","last_peered":"2024-09-12T12:24:18.070641+0000","last_clean":"2024-09-12T12:24:18.070641+0000","last_became_active":"2024-09-12T12:24:15.392595+0000","last_became_peered":"2024-09-12T12:24:15.392595+0000","last_unstale":"2024-09-12T12:24:18.070641+0000","last_undegraded":"2024-09-12T12:24:18.070641+0000","last_fullsized":"2024-09-12T12:24:18.070641+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:59.109666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614201+0000","last_change":"2024-09-12T12:24:16.391727+0000","last_active":"2024-09-12T12:24:18.614201+0000","last_peered":"2024-09-12T12:24:18.614201+0000","last_clean":"2024-09-12T12:24:18.614201+0000","last_became_active":"2024-09-12T12:24:16.391468+0000","last_became_peered":"2024-09-12T12:24:16.391468+0000","last_unstale":"2024-09-12T12:24:18.614201+0000","last_undegraded":"2024-09-12T12:24:18.614201+0000","last_fullsized":"2024-09-12T12:24:18.614201+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:56.376971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.512962+0000","last_change":"2024-09-12T12:24:15.384394+0000","last_active":"2024-09-12T12:24:17.512962+0000","last_peered":"2024-09-12T12:24:17.512962+0000","last_clean":"2024-09-12T12:24:17.512962+0000","last_became_active":"2024-09-12T12:24:15.384130+0000","last_became_peered":"2024-09-12T12:24:15.384130+0000","last_unstale":"2024-09-12T12:24:17.512962+0000","last_undegraded":"2024-09-12T12:24:17.512962+0000","last_fullsized":"2024-09-12T12:24:17.512962+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:57.037340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070786+0000","last_change":"2024-09-12T12:24:16.397975+0000","last_active":"2024-09-12T12:24:18.070786+0000","last_peered":"2024-09-12T12:24:18.070786+0000","last_clean":"2024-09-12T12:24:18.070786+0000","last_became_active":"2024-09-12T12:24:16.397682+0000","last_became_peered":"2024-09-12T12:24:16.397682+0000","last_unstale":"2024-09-12T12:24:18.070786+0000","last_undegraded":"2024-09-12T12:24:18.070786+0000","last_fullsized":"2024-09-12T12:24:18.070786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:19.982642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377000+0000","last_change":"2024-09-12T12:24:15.398973+0000","last_active":"2024-09-12T12:24:17.377000+0000","last_peered":"2024-09-12T12:24:17.377000+0000","last_clean":"2024-09-12T12:24:17.377000+0000","last_became_active":"2024-09-12T12:24:15.398624+0000","last_became_peered":"2024-09-12T12:24:15.398624+0000","last_unstale":"2024-09-12T12:24:17.377000+0000","last_undegraded":"2024-09-12T12:24:17.377000+0000","last_fullsized":"2024-09-12T12:24:17.377000+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376616+0000","last_change":"2024-09-12T12:24:16.390299+0000","last_active":"2024-09-12T12:24:17.376616+0000","last_peered":"2024-09-12T12:24:17.376616+0000","last_clean":"2024-09-12T12:24:17.376616+0000","last_became_active":"2024-09-12T12:24:16.389754+0000","last_became_peered":"2024-09-12T12:24:16.389754+0000","last_unstale":"2024-09-12T12:24:17.376616+0000","last_undegraded":"2024-09-12T12:24:17.376616+0000","last_fullsized":"2024-09-12T12:24:17.376616+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:52.232681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070516+0000","last_change":"2024-09-12T12:24:15.391813+0000","last_active":"2024-09-12T12:24:18.070516+0000","last_peered":"2024-09-12T12:24:18.070516+0000","last_clean":"2024-09-12T12:24:18.070516+0000","last_became_active":"2024-09-12T12:24:15.391434+0000","last_became_peered":"2024-09-12T12:24:15.391434+0000","last_unstale":"2024-09-12T12:24:18.070516+0000","last_undegraded":"2024-09-12T12:24:18.070516+0000","last_fullsized":"2024-09-12T12:24:18.070516+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:37.887502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375786+0000","last_change":"2024-09-12T12:24:16.401815+0000","last_active":"2024-09-12T12:24:17.375786+0000","last_peered":"2024-09-12T12:24:17.375786+0000","last_clean":"2024-09-12T12:24:17.375786+0000","last_became_active":"2024-09-12T12:24:16.401529+0000","last_became_peered":"2024-09-12T12:24:16.401529+0000","last_unstale":"2024-09-12T12:24:17.375786+0000","last_undegraded":"2024-09-12T12:24:17.375786+0000","last_fullsized":"2024-09-12T12:24:17.375786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378241+0000","last_change":"2024-09-12T12:24:15.399471+0000","last_active":"2024-09-12T12:24:17.378241+0000","last_peered":"2024-09-12T12:24:17.378241+0000","last_clean":"2024-09-12T12:24:17.378241+0000","last_became_active":"2024-09-12T12:24:15.399103+0000","last_became_peered":"2024-09-12T12:24:15.399103+0000","last_unstale":"2024-09-12T12:24:17.378241+0000","last_undegraded":"2024-09-12T12:24:17.378241+0000","last_fullsized":"2024-09-12T12:24:17.378241+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513034+0000","last_change":"2024-09-12T12:24:16.380708+0000","last_active":"2024-09-12T12:24:17.513034+0000","last_peered":"2024-09-12T12:24:17.513034+0000","last_clean":"2024-09-12T12:24:17.513034+0000","last_became_active":"2024-09-12T12:24:16.380397+0000","last_became_peered":"2024-09-12T12:24:16.380397+0000","last_unstale":"2024-09-12T12:24:17.513034+0000","last_undegraded":"2024-09-12T12:24:17.513034+0000","last_fullsized":"2024-09-12T12:24:17.513034+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.418022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513087+0000","last_change":"2024-09-12T12:24:15.384219+0000","last_active":"2024-09-12T12:24:17.513087+0000","last_peered":"2024-09-12T12:24:17.513087+0000","last_clean":"2024-09-12T12:24:17.513087+0000","last_became_active":"2024-09-12T12:24:15.383942+0000","last_became_peered":"2024-09-12T12:24:15.383942+0000","last_unstale":"2024-09-12T12:24:17.513087+0000","last_undegraded":"2024-09-12T12:24:17.513087+0000","last_fullsized":"2024-09-12T12:24:17.513087+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:47.850077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513088+0000","last_change":"2024-09-12T12:24:16.401479+0000","last_active":"2024-09-12T12:24:17.513088+0000","last_peered":"2024-09-12T12:24:17.513088+0000","last_clean":"2024-09-12T12:24:17.513088+0000","last_became_active":"2024-09-12T12:24:16.401230+0000","last_became_peered":"2024-09-12T12:24:16.401230+0000","last_unstale":"2024-09-12T12:24:17.513088+0000","last_undegraded":"2024-09-12T12:24:17.513088+0000","last_fullsized":"2024-09-12T12:24:17.513088+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:00:54.939202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402270+0000","last_change":"2024-09-12T12:24:15.398819+0000","last_active":"2024-09-12T12:24:17.402270+0000","last_peered":"2024-09-12T12:24:17.402270+0000","last_clean":"2024-09-12T12:24:17.402270+0000","last_became_active":"2024-09-12T12:24:15.398572+0000","last_became_peered":"2024-09-12T12:24:15.398572+0000","last_unstale":"2024-09-12T12:24:17.402270+0000","last_undegraded":"2024-09-12T12:24:17.402270+0000","last_fullsized":"2024-09-12T12:24:17.402270+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:33.388691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614154+0000","last_change":"2024-09-12T12:24:16.393240+0000","last_active":"2024-09-12T12:24:18.614154+0000","last_peered":"2024-09-12T12:24:18.614154+0000","last_clean":"2024-09-12T12:24:18.614154+0000","last_became_active":"2024-09-12T12:24:16.392939+0000","last_became_peered":"2024-09-12T12:24:16.392939+0000","last_unstale":"2024-09-12T12:24:18.614154+0000","last_undegraded":"2024-09-12T12:24:18.614154+0000","last_fullsized":"2024-09-12T12:24:18.614154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:37.911201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376709+0000","last_change":"2024-09-12T12:24:15.391719+0000","last_active":"2024-09-12T12:24:17.376709+0000","last_peered":"2024-09-12T12:24:17.376709+0000","last_clean":"2024-09-12T12:24:17.376709+0000","last_became_active":"2024-09-12T12:24:15.391451+0000","last_became_peered":"2024-09-12T12:24:15.391451+0000","last_unstale":"2024-09-12T12:24:17.376709+0000","last_undegraded":"2024-09-12T12:24:17.376709+0000","last_fullsized":"2024-09-12T12:24:17.376709+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402376+0000","last_change":"2024-09-12T12:24:16.400257+0000","last_active":"2024-09-12T12:24:17.402376+0000","last_peered":"2024-09-12T12:24:17.402376+0000","last_clean":"2024-09-12T12:24:17.402376+0000","last_became_active":"2024-09-12T12:24:16.399908+0000","last_became_peered":"2024-09-12T12:24:16.399908+0000","last_unstale":"2024-09-12T12:24:17.402376+0000","last_undegraded":"2024-09-12T12:24:17.402376+0000","last_fullsized":"2024-09-12T12:24:17.402376+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:19.882883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513139+0000","last_change":"2024-09-12T12:24:15.391685+0000","last_active":"2024-09-12T12:24:17.513139+0000","last_peered":"2024-09-12T12:24:17.513139+0000","last_clean":"2024-09-12T12:24:17.513139+0000","last_became_active":"2024-09-12T12:24:15.391401+0000","last_became_peered":"2024-09-12T12:24:15.391401+0000","last_unstale":"2024-09-12T12:24:17.513139+0000","last_undegraded":"2024-09-12T12:24:17.513139+0000","last_fullsized":"2024-09-12T12:24:17.513139+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:58.502911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375977+0000","last_change":"2024-09-12T12:24:16.393135+0000","last_active":"2024-09-12T12:24:17.375977+0000","last_peered":"2024-09-12T12:24:17.375977+0000","last_clean":"2024-09-12T12:24:17.375977+0000","last_became_active":"2024-09-12T12:24:16.392886+0000","last_became_peered":"2024-09-12T12:24:16.392886+0000","last_unstale":"2024-09-12T12:24:17.375977+0000","last_undegraded":"2024-09-12T12:24:17.375977+0000","last_fullsized":"2024-09-12T12:24:17.375977+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"176'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402509+0000","last_change":"2024-09-12T12:24:15.398312+0000","last_active":"2024-09-12T12:24:17.402509+0000","last_peered":"2024-09-12T12:24:17.402509+0000","last_clean":"2024-09-12T12:24:17.402509+0000","last_became_active":"2024-09-12T12:24:15.397828+0000","last_became_peered":"2024-09-12T12:24:15.397828+0000","last_unstale":"2024-09-12T12:24:17.402509+0000","last_undegraded":"2024-09-12T12:24:17.402509+0000","last_fullsized":"2024-09-12T12:24:17.402509+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:05.355749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614970+0000","last_change":"2024-09-12T12:24:16.396259+0000","last_active":"2024-09-12T12:24:18.614970+0000","last_peered":"2024-09-12T12:24:18.614970+0000","last_clean":"2024-09-12T12:24:18.614970+0000","last_became_active":"2024-09-12T12:24:16.396001+0000","last_became_peered":"2024-09-12T12:24:16.396001+0000","last_unstale":"2024-09-12T12:24:18.614970+0000","last_undegraded":"2024-09-12T12:24:18.614970+0000","last_fullsized":"2024-09-12T12:24:18.614970+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614336+0000","last_change":"2024-09-12T12:24:15.401539+0000","last_active":"2024-09-12T12:24:18.614336+0000","last_peered":"2024-09-12T12:24:18.614336+0000","last_clean":"2024-09-12T12:24:18.614336+0000","last_became_active":"2024-09-12T12:24:15.400457+0000","last_became_peered":"2024-09-12T12:24:15.400457+0000","last_unstale":"2024-09-12T12:24:18.614336+0000","last_undegraded":"2024-09-12T12:24:18.614336+0000","last_fullsized":"2024-09-12T12:24:18.614336+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:00:53.932314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402584+0000","last_change":"2024-09-12T12:24:16.399098+0000","last_active":"2024-09-12T12:24:17.402584+0000","last_peered":"2024-09-12T12:24:17.402584+0000","last_clean":"2024-09-12T12:24:17.402584+0000","last_became_active":"2024-09-12T12:24:16.398823+0000","last_became_peered":"2024-09-12T12:24:16.398823+0000","last_unstale":"2024-09-12T12:24:17.402584+0000","last_undegraded":"2024-09-12T12:24:17.402584+0000","last_fullsized":"2024-09-12T12:24:17.402584+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:20.717320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:15.398497+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:15.398186+0000","last_became_peered":"2024-09-12T12:24:15.398186+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:31.161939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376781+0000","last_change":"2024-09-12T12:24:16.389008+0000","last_active":"2024-09-12T12:24:17.376781+0000","last_peered":"2024-09-12T12:24:17.376781+0000","last_clean":"2024-09-12T12:24:17.376781+0000","last_became_active":"2024-09-12T12:24:16.388763+0000","last_became_peered":"2024-09-12T12:24:16.388763+0000","last_unstale":"2024-09-12T12:24:17.376781+0000","last_undegraded":"2024-09-12T12:24:17.376781+0000","last_fullsized":"2024-09-12T12:24:17.376781+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.252266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614577+0000","last_change":"2024-09-12T12:24:15.392333+0000","last_active":"2024-09-12T12:24:18.614577+0000","last_peered":"2024-09-12T12:24:18.614577+0000","last_clean":"2024-09-12T12:24:18.614577+0000","last_became_active":"2024-09-12T12:24:15.390965+0000","last_became_peered":"2024-09-12T12:24:15.390965+0000","last_unstale":"2024-09-12T12:24:18.614577+0000","last_undegraded":"2024-09-12T12:24:18.614577+0000","last_fullsized":"2024-09-12T12:24:18.614577+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.211150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377869+0000","last_change":"2024-09-12T12:24:16.383386+0000","last_active":"2024-09-12T12:24:17.377869+0000","last_peered":"2024-09-12T12:24:17.377869+0000","last_clean":"2024-09-12T12:24:17.377869+0000","last_became_active":"2024-09-12T12:24:16.383081+0000","last_became_peered":"2024-09-12T12:24:16.383081+0000","last_unstale":"2024-09-12T12:24:17.377869+0000","last_undegraded":"2024-09-12T12:24:17.377869+0000","last_fullsized":"2024-09-12T12:24:17.377869+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.997732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614411+0000","last_change":"2024-09-12T12:24:15.398042+0000","last_active":"2024-09-12T12:24:18.614411+0000","last_peered":"2024-09-12T12:24:18.614411+0000","last_clean":"2024-09-12T12:24:18.614411+0000","last_became_active":"2024-09-12T12:24:15.397831+0000","last_became_peered":"2024-09-12T12:24:15.397831+0000","last_unstale":"2024-09-12T12:24:18.614411+0000","last_undegraded":"2024-09-12T12:24:18.614411+0000","last_fullsized":"2024-09-12T12:24:18.614411+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.073587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376395+0000","last_change":"2024-09-12T12:24:16.391725+0000","last_active":"2024-09-12T12:24:17.376395+0000","last_peered":"2024-09-12T12:24:17.376395+0000","last_clean":"2024-09-12T12:24:17.376395+0000","last_became_active":"2024-09-12T12:24:16.391417+0000","last_became_peered":"2024-09-12T12:24:16.391417+0000","last_unstale":"2024-09-12T12:24:17.376395+0000","last_undegraded":"2024-09-12T12:24:17.376395+0000","last_fullsized":"2024-09-12T12:24:17.376395+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:48.466637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402272+0000","last_change":"2024-09-12T12:24:15.389928+0000","last_active":"2024-09-12T12:24:17.402272+0000","last_peered":"2024-09-12T12:24:17.402272+0000","last_clean":"2024-09-12T12:24:17.402272+0000","last_became_active":"2024-09-12T12:24:15.389340+0000","last_became_peered":"2024-09-12T12:24:15.389340+0000","last_unstale":"2024-09-12T12:24:17.402272+0000","last_undegraded":"2024-09-12T12:24:17.402272+0000","last_fullsized":"2024-09-12T12:24:17.402272+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:15.606771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614638+0000","last_change":"2024-09-12T12:24:16.407188+0000","last_active":"2024-09-12T12:24:18.614638+0000","last_peered":"2024-09-12T12:24:18.614638+0000","last_clean":"2024-09-12T12:24:18.614638+0000","last_became_active":"2024-09-12T12:24:16.406874+0000","last_became_peered":"2024-09-12T12:24:16.406874+0000","last_unstale":"2024-09-12T12:24:18.614638+0000","last_undegraded":"2024-09-12T12:24:18.614638+0000","last_fullsized":"2024-09-12T12:24:18.614638+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:20.527705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376860+0000","last_change":"2024-09-12T12:24:15.394140+0000","last_active":"2024-09-12T12:24:17.376860+0000","last_peered":"2024-09-12T12:24:17.376860+0000","last_clean":"2024-09-12T12:24:17.376860+0000","last_became_active":"2024-09-12T12:24:15.393853+0000","last_became_peered":"2024-09-12T12:24:15.393853+0000","last_unstale":"2024-09-12T12:24:17.376860+0000","last_undegraded":"2024-09-12T12:24:17.376860+0000","last_fullsized":"2024-09-12T12:24:17.376860+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377325+0000","last_change":"2024-09-12T12:24:16.389657+0000","last_active":"2024-09-12T12:24:17.377325+0000","last_peered":"2024-09-12T12:24:17.377325+0000","last_clean":"2024-09-12T12:24:17.377325+0000","last_became_active":"2024-09-12T12:24:16.389393+0000","last_became_peered":"2024-09-12T12:24:16.389393+0000","last_unstale":"2024-09-12T12:24:17.377325+0000","last_undegraded":"2024-09-12T12:24:17.377325+0000","last_fullsized":"2024-09-12T12:24:17.377325+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:43.184029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.512853+0000","last_change":"2024-09-12T12:24:15.385634+0000","last_active":"2024-09-12T12:24:17.512853+0000","last_peered":"2024-09-12T12:24:17.512853+0000","last_clean":"2024-09-12T12:24:17.512853+0000","last_became_active":"2024-09-12T12:24:15.385354+0000","last_became_peered":"2024-09-12T12:24:15.385354+0000","last_unstale":"2024-09-12T12:24:17.512853+0000","last_undegraded":"2024-09-12T12:24:17.512853+0000","last_fullsized":"2024-09-12T12:24:17.512853+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:25.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":455,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614607+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:24:18.614607+0000","last_peered":"2024-09-12T12:24:18.614607+0000","last_clean":"2024-09-12T12:24:18.614607+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:24:18.614607+0000","last_undegraded":"2024-09-12T12:24:18.614607+0000","last_fullsized":"2024-09-12T12:24:18.614607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51980,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319860,"statfs":{"total":96636764160,"available":96583536640,"internally_reserved":0,"allocated":2809856,"data_stored":1637923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51404,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320436,"statfs":{"total":96636764160,"available":96584126464,"internally_reserved":0,"allocated":2220032,"data_stored":1047625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51416,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320424,"statfs":{"total":96636764160,"available":96584114176,"internally_reserved":0,"allocated":2232320,"data_stored":1049189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59740,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312100,"statfs":{"total":96636764160,"available":96575590400,"internally_reserved":0,"allocated":2232320,"data_stored":1049201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2224128,"data_stored":1047715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":58915272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2220032,"data_stored":1048137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2215936,"data_stored":1047555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":2826240,"data_stored":1638651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:22.358 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-12T12:24:22.356+0000 7f7e71c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:24:25.002 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.148+0000 7f3e9ba00640 1 Processor -- start 2024-09-12T12:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.148+0000 7f3e9ba00640 1 -- start start 2024-09-12T12:24:25.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e9ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415c7b0 0x7f3e940ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e9ba00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3e9415cd30 0x7f3e940b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e9ba00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e940b5de0 0x7f3e941601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e9ba00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3e94072a50 con 0x7f3e940b5de0 2024-09-12T12:24:25.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e9ba00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3e940cde30 con 0x7f3e9415cd30 2024-09-12T12:24:25.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e9ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e940b6210 con 0x7f3e9415c7b0 2024-09-12T12:24:25.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e940b5de0 0x7f3e941601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e940b5de0 0x7f3e941601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36494/0 (socket says 172.21.15.144:36494) 2024-09-12T12:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99a00640 1 -- 172.21.15.144:0/1034138054 learned_addr learned my addr 172.21.15.144:0/1034138054 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99000640 1 --2- 172.21.15.144:0/1034138054 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415c7b0 0x7f3e940ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e93e00640 1 --2- 172.21.15.144:0/1034138054 >> v2:172.21.15.165:3300/0 conn(0x7f3e9415cd30 0x7f3e940b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99a00640 1 -- 172.21.15.144:0/1034138054 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415c7b0 msgr2=0x7f3e940ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99a00640 1 --2- 172.21.15.144:0/1034138054 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415c7b0 0x7f3e940ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99a00640 1 -- 172.21.15.144:0/1034138054 >> v2:172.21.15.165:3300/0 conn(0x7f3e9415cd30 msgr2=0x7f3e940b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:25.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99a00640 1 --2- 172.21.15.144:0/1034138054 >> v2:172.21.15.165:3300/0 conn(0x7f3e9415cd30 0x7f3e940b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99a00640 1 -- 172.21.15.144:0/1034138054 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940cd870 con 0x7f3e940b5de0 2024-09-12T12:24:25.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e99000640 1 --2- 172.21.15.144:0/1034138054 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415c7b0 0x7f3e940ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:25.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.152+0000 7f3e93e00640 1 --2- 172.21.15.144:0/1034138054 >> v2:172.21.15.165:3300/0 conn(0x7f3e9415cd30 0x7f3e940b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e99a00640 1 --2- 172.21.15.144:0/1034138054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 0x7f3e941601d0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f3e9406a020 tx=0x7f3e8c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eddbd74e40e1152 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e93400640 1 -- 172.21.15.144:0/1034138054 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0b0070 con 0x7f3e940b5de0 2024-09-12T12:24:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e93400640 1 -- 172.21.15.144:0/1034138054 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8c0ab600 con 0x7f3e940b5de0 2024-09-12T12:24:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e93400640 1 -- 172.21.15.144:0/1034138054 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0ab9d0 con 0x7f3e940b5de0 2024-09-12T12:24:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1034138054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 msgr2=0x7f3e941601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1034138054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 0x7f3e941601d0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f3e9406a020 tx=0x7f3e8c01c260 comp rx=0 tx=0).stop 2024-09-12T12:24:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1034138054 shutdown_connections 2024-09-12T12:24:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1034138054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 0x7f3e941601d0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1034138054 >> v2:172.21.15.165:3300/0 conn(0x7f3e9415cd30 0x7f3e940b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1034138054 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415c7b0 0x7f3e940ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1034138054 >> 172.21.15.144:0/1034138054 conn(0x7f3e9406d0d0 msgr2=0x7f3e9406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1034138054 shutdown_connections 2024-09-12T12:24:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1034138054 wait complete. 2024-09-12T12:24:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 Processor -- start 2024-09-12T12:24:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 -- start start 2024-09-12T12:24:25.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 0x7f3e940ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e9415c7b0 0x7f3e940b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415cd30 0x7f3e9414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e94072ec0 con 0x7f3e940b5de0 2024-09-12T12:24:25.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940cd650 con 0x7f3e9415c7b0 2024-09-12T12:24:25.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.156+0000 7f3e9ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e94073040 con 0x7f3e9415cd30 2024-09-12T12:24:25.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 0x7f3e940ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 0x7f3e940ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36508/0 (socket says 172.21.15.144:36508) 2024-09-12T12:24:25.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99000640 1 -- 172.21.15.144:0/1998795000 learned_addr learned my addr 172.21.15.144:0/1998795000 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:25.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e93e00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e9415c7b0 0x7f3e940b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99a00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415cd30 0x7f3e9414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99000640 1 -- 172.21.15.144:0/1998795000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415cd30 msgr2=0x7f3e9414ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99000640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415cd30 0x7f3e9414ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99000640 1 -- 172.21.15.144:0/1998795000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e9415c7b0 msgr2=0x7f3e940b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99000640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e9415c7b0 0x7f3e940b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99000640 1 -- 172.21.15.144:0/1998795000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940aa5b0 con 0x7f3e940b5de0 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e99000640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 0x7f3e940ac240 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f3e84007f20 tx=0x7f3e8400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e90c00640 1 -- 172.21.15.144:0/1998795000 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8401a070 con 0x7f3e940b5de0 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e90c00640 1 -- 172.21.15.144:0/1998795000 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e84003ba0 con 0x7f3e940b5de0 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e90c00640 1 -- 172.21.15.144:0/1998795000 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84004030 con 0x7f3e940b5de0 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e940aa890 con 0x7f3e940b5de0 2024-09-12T12:24:25.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e940b2af0 con 0x7f3e940b5de0 2024-09-12T12:24:25.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e940aafb0 con 0x7f3e940b5de0 2024-09-12T12:24:25.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e90c00640 1 -- 172.21.15.144:0/1998795000 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e8401d070 con 0x7f3e940b5de0 2024-09-12T12:24:25.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.160+0000 7f3e90c00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3e740678c0 0x7f3e74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.164+0000 7f3e90c00640 1 -- 172.21.15.144:0/1998795000 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f3e84085fe0 con 0x7f3e940b5de0 2024-09-12T12:24:25.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.164+0000 7f3e93e00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3e740678c0 0x7f3e74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.164+0000 7f3e93e00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3e740678c0 0x7f3e74069d80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3e9415e1d0 tx=0x7f3e80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.168+0000 7f3e90c00640 1 -- 172.21.15.144:0/1998795000 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3e84010070 con 0x7f3e940b5de0 2024-09-12T12:24:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.320+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e940b2e00 con 0x7f3e740678c0 2024-09-12T12:24:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.324+0000 7f3e90c00640 1 -- 172.21.15.144:0/1998795000 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252488 (secure 0 0 0) 0x7f3e940b2e00 con 0x7f3e740678c0 2024-09-12T12:24:25.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:25.330 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:24:25.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3e740678c0 msgr2=0x7f3e74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3e740678c0 0x7f3e74069d80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3e9415e1d0 tx=0x7f3e80008040 comp rx=0 tx=0).stop 2024-09-12T12:24:25.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 msgr2=0x7f3e940ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 0x7f3e940ac240 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f3e84007f20 tx=0x7f3e8400d560 comp rx=0 tx=0).stop 2024-09-12T12:24:25.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 shutdown_connections 2024-09-12T12:24:25.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3e740678c0 0x7f3e74069d80 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e9415cd30 0x7f3e9414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e9415c7b0 0x7f3e940b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 --2- 172.21.15.144:0/1998795000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e940b5de0 0x7f3e940ac240 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 >> 172.21.15.144:0/1998795000 conn(0x7f3e9406d0d0 msgr2=0x7f3e940ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:25.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 shutdown_connections 2024-09-12T12:24:25.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.328+0000 7f3e9ba00640 1 -- 172.21.15.144:0/1998795000 wait complete. 2024-09-12T12:24:25.349 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":524,"stamp":"2024-09-12T12:24:23.525671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":445716,"kb_used_data":18536,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754529004,"statfs":{"total":773094113280,"available":772637700096,"internally_reserved":0,"allocated":18980864,"data_stored":9565996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001453"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376298+0000","last_change":"2024-09-12T12:24:16.395627+0000","last_active":"2024-09-12T12:24:17.376298+0000","last_peered":"2024-09-12T12:24:17.376298+0000","last_clean":"2024-09-12T12:24:17.376298+0000","last_became_active":"2024-09-12T12:24:16.395322+0000","last_became_peered":"2024-09-12T12:24:16.395322+0000","last_unstale":"2024-09-12T12:24:17.376298+0000","last_undegraded":"2024-09-12T12:24:17.376298+0000","last_fullsized":"2024-09-12T12:24:17.376298+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:16.943178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376308+0000","last_change":"2024-09-12T12:24:16.399843+0000","last_active":"2024-09-12T12:24:17.376308+0000","last_peered":"2024-09-12T12:24:17.376308+0000","last_clean":"2024-09-12T12:24:17.376308+0000","last_became_active":"2024-09-12T12:24:16.399540+0000","last_became_peered":"2024-09-12T12:24:16.399540+0000","last_unstale":"2024-09-12T12:24:17.376308+0000","last_undegraded":"2024-09-12T12:24:17.376308+0000","last_fullsized":"2024-09-12T12:24:17.376308+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:18.125453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376939+0000","last_change":"2024-09-12T12:24:16.390401+0000","last_active":"2024-09-12T12:24:17.376939+0000","last_peered":"2024-09-12T12:24:17.376939+0000","last_clean":"2024-09-12T12:24:17.376939+0000","last_became_active":"2024-09-12T12:24:16.390125+0000","last_became_peered":"2024-09-12T12:24:16.390125+0000","last_unstale":"2024-09-12T12:24:17.376939+0000","last_undegraded":"2024-09-12T12:24:17.376939+0000","last_fullsized":"2024-09-12T12:24:17.376939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:13.958791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513192+0000","last_change":"2024-09-12T12:24:16.383289+0000","last_active":"2024-09-12T12:24:17.513192+0000","last_peered":"2024-09-12T12:24:17.513192+0000","last_clean":"2024-09-12T12:24:17.513192+0000","last_became_active":"2024-09-12T12:24:16.382709+0000","last_became_peered":"2024-09-12T12:24:16.382709+0000","last_unstale":"2024-09-12T12:24:17.513192+0000","last_undegraded":"2024-09-12T12:24:17.513192+0000","last_fullsized":"2024-09-12T12:24:17.513192+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:50.025593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614197+0000","last_change":"2024-09-12T12:24:16.397905+0000","last_active":"2024-09-12T12:24:18.614197+0000","last_peered":"2024-09-12T12:24:18.614197+0000","last_clean":"2024-09-12T12:24:18.614197+0000","last_became_active":"2024-09-12T12:24:16.397631+0000","last_became_peered":"2024-09-12T12:24:16.397631+0000","last_unstale":"2024-09-12T12:24:18.614197+0000","last_undegraded":"2024-09-12T12:24:18.614197+0000","last_fullsized":"2024-09-12T12:24:18.614197+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:40:19.720611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614055+0000","last_change":"2024-09-12T12:24:16.405121+0000","last_active":"2024-09-12T12:24:18.614055+0000","last_peered":"2024-09-12T12:24:18.614055+0000","last_clean":"2024-09-12T12:24:18.614055+0000","last_became_active":"2024-09-12T12:24:16.404807+0000","last_became_peered":"2024-09-12T12:24:16.404807+0000","last_unstale":"2024-09-12T12:24:18.614055+0000","last_undegraded":"2024-09-12T12:24:18.614055+0000","last_fullsized":"2024-09-12T12:24:18.614055+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:46.225664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402195+0000","last_change":"2024-09-12T12:24:16.396455+0000","last_active":"2024-09-12T12:24:17.402195+0000","last_peered":"2024-09-12T12:24:17.402195+0000","last_clean":"2024-09-12T12:24:17.402195+0000","last_became_active":"2024-09-12T12:24:16.396163+0000","last_became_peered":"2024-09-12T12:24:16.396163+0000","last_unstale":"2024-09-12T12:24:17.402195+0000","last_undegraded":"2024-09-12T12:24:17.402195+0000","last_fullsized":"2024-09-12T12:24:17.402195+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:51.534062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614642+0000","last_change":"2024-09-12T12:24:16.398847+0000","last_active":"2024-09-12T12:24:18.614642+0000","last_peered":"2024-09-12T12:24:18.614642+0000","last_clean":"2024-09-12T12:24:18.614642+0000","last_became_active":"2024-09-12T12:24:16.398566+0000","last_became_peered":"2024-09-12T12:24:16.398566+0000","last_unstale":"2024-09-12T12:24:18.614642+0000","last_undegraded":"2024-09-12T12:24:18.614642+0000","last_fullsized":"2024-09-12T12:24:18.614642+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:18.048060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376446+0000","last_change":"2024-09-12T12:24:16.387534+0000","last_active":"2024-09-12T12:24:17.376446+0000","last_peered":"2024-09-12T12:24:17.376446+0000","last_clean":"2024-09-12T12:24:17.376446+0000","last_became_active":"2024-09-12T12:24:16.387258+0000","last_became_peered":"2024-09-12T12:24:16.387258+0000","last_unstale":"2024-09-12T12:24:17.376446+0000","last_undegraded":"2024-09-12T12:24:17.376446+0000","last_fullsized":"2024-09-12T12:24:17.376446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:40.475529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614640+0000","last_change":"2024-09-12T12:24:16.389429+0000","last_active":"2024-09-12T12:24:18.614640+0000","last_peered":"2024-09-12T12:24:18.614640+0000","last_clean":"2024-09-12T12:24:18.614640+0000","last_became_active":"2024-09-12T12:24:16.389118+0000","last_became_peered":"2024-09-12T12:24:16.389118+0000","last_unstale":"2024-09-12T12:24:18.614640+0000","last_undegraded":"2024-09-12T12:24:18.614640+0000","last_fullsized":"2024-09-12T12:24:18.614640+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:17.258071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070564+0000","last_change":"2024-09-12T12:24:16.395888+0000","last_active":"2024-09-12T12:24:18.070564+0000","last_peered":"2024-09-12T12:24:18.070564+0000","last_clean":"2024-09-12T12:24:18.070564+0000","last_became_active":"2024-09-12T12:24:16.395552+0000","last_became_peered":"2024-09-12T12:24:16.395552+0000","last_unstale":"2024-09-12T12:24:18.070564+0000","last_undegraded":"2024-09-12T12:24:18.070564+0000","last_fullsized":"2024-09-12T12:24:18.070564+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:42.839292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513199+0000","last_change":"2024-09-12T12:24:16.396978+0000","last_active":"2024-09-12T12:24:17.513199+0000","last_peered":"2024-09-12T12:24:17.513199+0000","last_clean":"2024-09-12T12:24:17.513199+0000","last_became_active":"2024-09-12T12:24:16.395817+0000","last_became_peered":"2024-09-12T12:24:16.395817+0000","last_unstale":"2024-09-12T12:24:17.513199+0000","last_undegraded":"2024-09-12T12:24:17.513199+0000","last_fullsized":"2024-09-12T12:24:17.513199+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:11.083056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377994+0000","last_change":"2024-09-12T12:24:16.385909+0000","last_active":"2024-09-12T12:24:17.377994+0000","last_peered":"2024-09-12T12:24:17.377994+0000","last_clean":"2024-09-12T12:24:17.377994+0000","last_became_active":"2024-09-12T12:24:16.385618+0000","last_became_peered":"2024-09-12T12:24:16.385618+0000","last_unstale":"2024-09-12T12:24:17.377994+0000","last_undegraded":"2024-09-12T12:24:17.377994+0000","last_fullsized":"2024-09-12T12:24:17.377994+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.645811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402120+0000","last_change":"2024-09-12T12:24:16.389264+0000","last_active":"2024-09-12T12:24:17.402120+0000","last_peered":"2024-09-12T12:24:17.402120+0000","last_clean":"2024-09-12T12:24:17.402120+0000","last_became_active":"2024-09-12T12:24:16.383477+0000","last_became_peered":"2024-09-12T12:24:16.383477+0000","last_unstale":"2024-09-12T12:24:17.402120+0000","last_undegraded":"2024-09-12T12:24:17.402120+0000","last_fullsized":"2024-09-12T12:24:17.402120+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:00.350364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375908+0000","last_change":"2024-09-12T12:24:16.396038+0000","last_active":"2024-09-12T12:24:17.375908+0000","last_peered":"2024-09-12T12:24:17.375908+0000","last_clean":"2024-09-12T12:24:17.375908+0000","last_became_active":"2024-09-12T12:24:16.395776+0000","last_became_peered":"2024-09-12T12:24:16.395776+0000","last_unstale":"2024-09-12T12:24:17.375908+0000","last_undegraded":"2024-09-12T12:24:17.375908+0000","last_fullsized":"2024-09-12T12:24:17.375908+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613990+0000","last_change":"2024-09-12T12:24:16.394206+0000","last_active":"2024-09-12T12:24:18.613990+0000","last_peered":"2024-09-12T12:24:18.613990+0000","last_clean":"2024-09-12T12:24:18.613990+0000","last_became_active":"2024-09-12T12:24:16.393946+0000","last_became_peered":"2024-09-12T12:24:16.393946+0000","last_unstale":"2024-09-12T12:24:18.613990+0000","last_undegraded":"2024-09-12T12:24:18.613990+0000","last_fullsized":"2024-09-12T12:24:18.613990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:33.481891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614623+0000","last_change":"2024-09-12T12:24:16.393808+0000","last_active":"2024-09-12T12:24:18.614623+0000","last_peered":"2024-09-12T12:24:18.614623+0000","last_clean":"2024-09-12T12:24:18.614623+0000","last_became_active":"2024-09-12T12:24:16.393444+0000","last_became_peered":"2024-09-12T12:24:16.393444+0000","last_unstale":"2024-09-12T12:24:18.614623+0000","last_undegraded":"2024-09-12T12:24:18.614623+0000","last_fullsized":"2024-09-12T12:24:18.614623+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:16.973624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378284+0000","last_change":"2024-09-12T12:24:16.395785+0000","last_active":"2024-09-12T12:24:17.378284+0000","last_peered":"2024-09-12T12:24:17.378284+0000","last_clean":"2024-09-12T12:24:17.378284+0000","last_became_active":"2024-09-12T12:24:16.395155+0000","last_became_peered":"2024-09-12T12:24:16.395155+0000","last_unstale":"2024-09-12T12:24:17.378284+0000","last_undegraded":"2024-09-12T12:24:17.378284+0000","last_fullsized":"2024-09-12T12:24:17.378284+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:19.128062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378263+0000","last_change":"2024-09-12T12:24:16.384665+0000","last_active":"2024-09-12T12:24:17.378263+0000","last_peered":"2024-09-12T12:24:17.378263+0000","last_clean":"2024-09-12T12:24:17.378263+0000","last_became_active":"2024-09-12T12:24:16.384397+0000","last_became_peered":"2024-09-12T12:24:16.384397+0000","last_unstale":"2024-09-12T12:24:17.378263+0000","last_undegraded":"2024-09-12T12:24:17.378263+0000","last_fullsized":"2024-09-12T12:24:17.378263+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:33.904641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614178+0000","last_change":"2024-09-12T12:24:16.398048+0000","last_active":"2024-09-12T12:24:18.614178+0000","last_peered":"2024-09-12T12:24:18.614178+0000","last_clean":"2024-09-12T12:24:18.614178+0000","last_became_active":"2024-09-12T12:24:16.397351+0000","last_became_peered":"2024-09-12T12:24:16.397351+0000","last_unstale":"2024-09-12T12:24:18.614178+0000","last_undegraded":"2024-09-12T12:24:18.614178+0000","last_fullsized":"2024-09-12T12:24:18.614178+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:42.510300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376118+0000","last_change":"2024-09-12T12:24:16.401679+0000","last_active":"2024-09-12T12:24:17.376118+0000","last_peered":"2024-09-12T12:24:17.376118+0000","last_clean":"2024-09-12T12:24:17.376118+0000","last_became_active":"2024-09-12T12:24:16.401427+0000","last_became_peered":"2024-09-12T12:24:16.401427+0000","last_unstale":"2024-09-12T12:24:17.376118+0000","last_undegraded":"2024-09-12T12:24:17.376118+0000","last_fullsized":"2024-09-12T12:24:17.376118+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:33.370897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376014+0000","last_change":"2024-09-12T12:24:16.389730+0000","last_active":"2024-09-12T12:24:17.376014+0000","last_peered":"2024-09-12T12:24:17.376014+0000","last_clean":"2024-09-12T12:24:17.376014+0000","last_became_active":"2024-09-12T12:24:16.388457+0000","last_became_peered":"2024-09-12T12:24:16.388457+0000","last_unstale":"2024-09-12T12:24:17.376014+0000","last_undegraded":"2024-09-12T12:24:17.376014+0000","last_fullsized":"2024-09-12T12:24:17.376014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:30.253279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614643+0000","last_change":"2024-09-12T12:24:16.408247+0000","last_active":"2024-09-12T12:24:18.614643+0000","last_peered":"2024-09-12T12:24:18.614643+0000","last_clean":"2024-09-12T12:24:18.614643+0000","last_became_active":"2024-09-12T12:24:16.406896+0000","last_became_peered":"2024-09-12T12:24:16.406896+0000","last_unstale":"2024-09-12T12:24:18.614643+0000","last_undegraded":"2024-09-12T12:24:18.614643+0000","last_fullsized":"2024-09-12T12:24:18.614643+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:41.568837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376092+0000","last_change":"2024-09-12T12:24:16.395602+0000","last_active":"2024-09-12T12:24:17.376092+0000","last_peered":"2024-09-12T12:24:17.376092+0000","last_clean":"2024-09-12T12:24:17.376092+0000","last_became_active":"2024-09-12T12:24:16.395302+0000","last_became_peered":"2024-09-12T12:24:16.395302+0000","last_unstale":"2024-09-12T12:24:17.376092+0000","last_undegraded":"2024-09-12T12:24:17.376092+0000","last_fullsized":"2024-09-12T12:24:17.376092+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:37.307464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402587+0000","last_change":"2024-09-12T12:24:16.391686+0000","last_active":"2024-09-12T12:24:17.402587+0000","last_peered":"2024-09-12T12:24:17.402587+0000","last_clean":"2024-09-12T12:24:17.402587+0000","last_became_active":"2024-09-12T12:24:16.391350+0000","last_became_peered":"2024-09-12T12:24:16.391350+0000","last_unstale":"2024-09-12T12:24:17.402587+0000","last_undegraded":"2024-09-12T12:24:17.402587+0000","last_fullsized":"2024-09-12T12:24:17.402587+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:49:56.998916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070631+0000","last_change":"2024-09-12T12:24:16.396345+0000","last_active":"2024-09-12T12:24:18.070631+0000","last_peered":"2024-09-12T12:24:18.070631+0000","last_clean":"2024-09-12T12:24:18.070631+0000","last_became_active":"2024-09-12T12:24:16.395947+0000","last_became_peered":"2024-09-12T12:24:16.395947+0000","last_unstale":"2024-09-12T12:24:18.070631+0000","last_undegraded":"2024-09-12T12:24:18.070631+0000","last_fullsized":"2024-09-12T12:24:18.070631+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:29.398497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614874+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:18.614874+0000","last_peered":"2024-09-12T12:24:18.614874+0000","last_clean":"2024-09-12T12:24:18.614874+0000","last_became_active":"2024-09-12T12:24:16.399490+0000","last_became_peered":"2024-09-12T12:24:16.399490+0000","last_unstale":"2024-09-12T12:24:18.614874+0000","last_undegraded":"2024-09-12T12:24:18.614874+0000","last_fullsized":"2024-09-12T12:24:18.614874+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:40.136783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:16.398270+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:16.397722+0000","last_became_peered":"2024-09-12T12:24:16.397722+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:26.658081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070437+0000","last_change":"2024-09-12T12:24:16.405818+0000","last_active":"2024-09-12T12:24:18.070437+0000","last_peered":"2024-09-12T12:24:18.070437+0000","last_clean":"2024-09-12T12:24:18.070437+0000","last_became_active":"2024-09-12T12:24:16.405396+0000","last_became_peered":"2024-09-12T12:24:16.405396+0000","last_unstale":"2024-09-12T12:24:18.070437+0000","last_undegraded":"2024-09-12T12:24:18.070437+0000","last_fullsized":"2024-09-12T12:24:18.070437+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:34:53.563728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070239+0000","last_change":"2024-09-12T12:24:16.407758+0000","last_active":"2024-09-12T12:24:18.070239+0000","last_peered":"2024-09-12T12:24:18.070239+0000","last_clean":"2024-09-12T12:24:18.070239+0000","last_became_active":"2024-09-12T12:24:16.407508+0000","last_became_peered":"2024-09-12T12:24:16.407508+0000","last_unstale":"2024-09-12T12:24:18.070239+0000","last_undegraded":"2024-09-12T12:24:18.070239+0000","last_fullsized":"2024-09-12T12:24:18.070239+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:08.809853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402121+0000","last_change":"2024-09-12T12:24:16.405155+0000","last_active":"2024-09-12T12:24:17.402121+0000","last_peered":"2024-09-12T12:24:17.402121+0000","last_clean":"2024-09-12T12:24:17.402121+0000","last_became_active":"2024-09-12T12:24:16.404882+0000","last_became_peered":"2024-09-12T12:24:16.404882+0000","last_unstale":"2024-09-12T12:24:17.402121+0000","last_undegraded":"2024-09-12T12:24:17.402121+0000","last_fullsized":"2024-09-12T12:24:17.402121+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:18.643188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614001+0000","last_change":"2024-09-12T12:24:16.387749+0000","last_active":"2024-09-12T12:24:18.614001+0000","last_peered":"2024-09-12T12:24:18.614001+0000","last_clean":"2024-09-12T12:24:18.614001+0000","last_became_active":"2024-09-12T12:24:16.387503+0000","last_became_peered":"2024-09-12T12:24:16.387503+0000","last_unstale":"2024-09-12T12:24:18.614001+0000","last_undegraded":"2024-09-12T12:24:18.614001+0000","last_fullsized":"2024-09-12T12:24:18.614001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:59.828091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614916+0000","last_change":"2024-09-12T12:24:16.397982+0000","last_active":"2024-09-12T12:24:18.614916+0000","last_peered":"2024-09-12T12:24:18.614916+0000","last_clean":"2024-09-12T12:24:18.614916+0000","last_became_active":"2024-09-12T12:24:16.397718+0000","last_became_peered":"2024-09-12T12:24:16.397718+0000","last_unstale":"2024-09-12T12:24:18.614916+0000","last_undegraded":"2024-09-12T12:24:18.614916+0000","last_fullsized":"2024-09-12T12:24:18.614916+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"175'4","reported_seq":18,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513119+0000","last_change":"2024-09-12T12:24:15.383469+0000","last_active":"2024-09-12T12:24:17.513119+0000","last_peered":"2024-09-12T12:24:17.513119+0000","last_clean":"2024-09-12T12:24:17.513119+0000","last_became_active":"2024-09-12T12:24:15.383202+0000","last_became_peered":"2024-09-12T12:24:15.383202+0000","last_unstale":"2024-09-12T12:24:17.513119+0000","last_undegraded":"2024-09-12T12:24:17.513119+0000","last_fullsized":"2024-09-12T12:24:17.513119+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:32.820899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402547+0000","last_change":"2024-09-12T12:24:16.399030+0000","last_active":"2024-09-12T12:24:17.402547+0000","last_peered":"2024-09-12T12:24:17.402547+0000","last_clean":"2024-09-12T12:24:17.402547+0000","last_became_active":"2024-09-12T12:24:16.398598+0000","last_became_peered":"2024-09-12T12:24:16.398598+0000","last_unstale":"2024-09-12T12:24:17.402547+0000","last_undegraded":"2024-09-12T12:24:17.402547+0000","last_fullsized":"2024-09-12T12:24:17.402547+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:38.682077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614535+0000","last_change":"2024-09-12T12:24:15.399932+0000","last_active":"2024-09-12T12:24:18.614535+0000","last_peered":"2024-09-12T12:24:18.614535+0000","last_clean":"2024-09-12T12:24:18.614535+0000","last_became_active":"2024-09-12T12:24:15.399298+0000","last_became_peered":"2024-09-12T12:24:15.399298+0000","last_unstale":"2024-09-12T12:24:18.614535+0000","last_undegraded":"2024-09-12T12:24:18.614535+0000","last_fullsized":"2024-09-12T12:24:18.614535+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:49.018706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070727+0000","last_change":"2024-09-12T12:24:16.397252+0000","last_active":"2024-09-12T12:24:18.070727+0000","last_peered":"2024-09-12T12:24:18.070727+0000","last_clean":"2024-09-12T12:24:18.070727+0000","last_became_active":"2024-09-12T12:24:16.396964+0000","last_became_peered":"2024-09-12T12:24:16.396964+0000","last_unstale":"2024-09-12T12:24:18.070727+0000","last_undegraded":"2024-09-12T12:24:18.070727+0000","last_fullsized":"2024-09-12T12:24:18.070727+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:16.827590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070399+0000","last_change":"2024-09-12T12:24:15.388771+0000","last_active":"2024-09-12T12:24:18.070399+0000","last_peered":"2024-09-12T12:24:18.070399+0000","last_clean":"2024-09-12T12:24:18.070399+0000","last_became_active":"2024-09-12T12:24:15.388489+0000","last_became_peered":"2024-09-12T12:24:15.388489+0000","last_unstale":"2024-09-12T12:24:18.070399+0000","last_undegraded":"2024-09-12T12:24:18.070399+0000","last_fullsized":"2024-09-12T12:24:18.070399+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:10.638923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377349+0000","last_change":"2024-09-12T12:24:16.398321+0000","last_active":"2024-09-12T12:24:17.377349+0000","last_peered":"2024-09-12T12:24:17.377349+0000","last_clean":"2024-09-12T12:24:17.377349+0000","last_became_active":"2024-09-12T12:24:16.398059+0000","last_became_peered":"2024-09-12T12:24:16.398059+0000","last_unstale":"2024-09-12T12:24:17.377349+0000","last_undegraded":"2024-09-12T12:24:17.377349+0000","last_fullsized":"2024-09-12T12:24:17.377349+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:49.642450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377968+0000","last_change":"2024-09-12T12:24:15.392075+0000","last_active":"2024-09-12T12:24:17.377968+0000","last_peered":"2024-09-12T12:24:17.377968+0000","last_clean":"2024-09-12T12:24:17.377968+0000","last_became_active":"2024-09-12T12:24:15.391802+0000","last_became_peered":"2024-09-12T12:24:15.391802+0000","last_unstale":"2024-09-12T12:24:17.377968+0000","last_undegraded":"2024-09-12T12:24:17.377968+0000","last_fullsized":"2024-09-12T12:24:17.377968+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377422+0000","last_change":"2024-09-12T12:24:16.390477+0000","last_active":"2024-09-12T12:24:17.377422+0000","last_peered":"2024-09-12T12:24:17.377422+0000","last_clean":"2024-09-12T12:24:17.377422+0000","last_became_active":"2024-09-12T12:24:16.390202+0000","last_became_peered":"2024-09-12T12:24:16.390202+0000","last_unstale":"2024-09-12T12:24:17.377422+0000","last_undegraded":"2024-09-12T12:24:17.377422+0000","last_fullsized":"2024-09-12T12:24:17.377422+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:06.504087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614269+0000","last_change":"2024-09-12T12:24:15.401541+0000","last_active":"2024-09-12T12:24:18.614269+0000","last_peered":"2024-09-12T12:24:18.614269+0000","last_clean":"2024-09-12T12:24:18.614269+0000","last_became_active":"2024-09-12T12:24:15.400546+0000","last_became_peered":"2024-09-12T12:24:15.400546+0000","last_unstale":"2024-09-12T12:24:18.614269+0000","last_undegraded":"2024-09-12T12:24:18.614269+0000","last_fullsized":"2024-09-12T12:24:18.614269+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:22.411134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376083+0000","last_change":"2024-09-12T12:24:16.394306+0000","last_active":"2024-09-12T12:24:17.376083+0000","last_peered":"2024-09-12T12:24:17.376083+0000","last_clean":"2024-09-12T12:24:17.376083+0000","last_became_active":"2024-09-12T12:24:16.394065+0000","last_became_peered":"2024-09-12T12:24:16.394065+0000","last_unstale":"2024-09-12T12:24:17.376083+0000","last_undegraded":"2024-09-12T12:24:17.376083+0000","last_fullsized":"2024-09-12T12:24:17.376083+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:01.040775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.512954+0000","last_change":"2024-09-12T12:24:15.396683+0000","last_active":"2024-09-12T12:24:17.512954+0000","last_peered":"2024-09-12T12:24:17.512954+0000","last_clean":"2024-09-12T12:24:17.512954+0000","last_became_active":"2024-09-12T12:24:15.396060+0000","last_became_peered":"2024-09-12T12:24:15.396060+0000","last_unstale":"2024-09-12T12:24:17.512954+0000","last_undegraded":"2024-09-12T12:24:17.512954+0000","last_fullsized":"2024-09-12T12:24:17.512954+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:20.372783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376277+0000","last_change":"2024-09-12T12:24:16.398115+0000","last_active":"2024-09-12T12:24:17.376277+0000","last_peered":"2024-09-12T12:24:17.376277+0000","last_clean":"2024-09-12T12:24:17.376277+0000","last_became_active":"2024-09-12T12:24:16.397797+0000","last_became_peered":"2024-09-12T12:24:16.397797+0000","last_unstale":"2024-09-12T12:24:17.376277+0000","last_undegraded":"2024-09-12T12:24:17.376277+0000","last_fullsized":"2024-09-12T12:24:17.376277+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:52.182844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377746+0000","last_change":"2024-09-12T12:24:15.391060+0000","last_active":"2024-09-12T12:24:17.377746+0000","last_peered":"2024-09-12T12:24:17.377746+0000","last_clean":"2024-09-12T12:24:17.377746+0000","last_became_active":"2024-09-12T12:24:15.390781+0000","last_became_peered":"2024-09-12T12:24:15.390781+0000","last_unstale":"2024-09-12T12:24:17.377746+0000","last_undegraded":"2024-09-12T12:24:17.377746+0000","last_fullsized":"2024-09-12T12:24:17.377746+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:34.109701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614981+0000","last_change":"2024-09-12T12:24:16.395507+0000","last_active":"2024-09-12T12:24:18.614981+0000","last_peered":"2024-09-12T12:24:18.614981+0000","last_clean":"2024-09-12T12:24:18.614981+0000","last_became_active":"2024-09-12T12:24:16.395221+0000","last_became_peered":"2024-09-12T12:24:16.395221+0000","last_unstale":"2024-09-12T12:24:18.614981+0000","last_undegraded":"2024-09-12T12:24:18.614981+0000","last_fullsized":"2024-09-12T12:24:18.614981+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614536+0000","last_change":"2024-09-12T12:24:15.396881+0000","last_active":"2024-09-12T12:24:18.614536+0000","last_peered":"2024-09-12T12:24:18.614536+0000","last_clean":"2024-09-12T12:24:18.614536+0000","last_became_active":"2024-09-12T12:24:15.396494+0000","last_became_peered":"2024-09-12T12:24:15.396494+0000","last_unstale":"2024-09-12T12:24:18.614536+0000","last_undegraded":"2024-09-12T12:24:18.614536+0000","last_fullsized":"2024-09-12T12:24:18.614536+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:10.076168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614438+0000","last_change":"2024-09-12T12:24:16.390011+0000","last_active":"2024-09-12T12:24:18.614438+0000","last_peered":"2024-09-12T12:24:18.614438+0000","last_clean":"2024-09-12T12:24:18.614438+0000","last_became_active":"2024-09-12T12:24:16.389735+0000","last_became_peered":"2024-09-12T12:24:16.389735+0000","last_unstale":"2024-09-12T12:24:18.614438+0000","last_undegraded":"2024-09-12T12:24:18.614438+0000","last_fullsized":"2024-09-12T12:24:18.614438+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:57.836183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376367+0000","last_change":"2024-09-12T12:24:15.399114+0000","last_active":"2024-09-12T12:24:17.376367+0000","last_peered":"2024-09-12T12:24:17.376367+0000","last_clean":"2024-09-12T12:24:17.376367+0000","last_became_active":"2024-09-12T12:24:15.398674+0000","last_became_peered":"2024-09-12T12:24:15.398674+0000","last_unstale":"2024-09-12T12:24:17.376367+0000","last_undegraded":"2024-09-12T12:24:17.376367+0000","last_fullsized":"2024-09-12T12:24:17.376367+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:48.465962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378417+0000","last_change":"2024-09-12T12:24:16.399719+0000","last_active":"2024-09-12T12:24:17.378417+0000","last_peered":"2024-09-12T12:24:17.378417+0000","last_clean":"2024-09-12T12:24:17.378417+0000","last_became_active":"2024-09-12T12:24:16.399424+0000","last_became_peered":"2024-09-12T12:24:16.399424+0000","last_unstale":"2024-09-12T12:24:17.378417+0000","last_undegraded":"2024-09-12T12:24:17.378417+0000","last_fullsized":"2024-09-12T12:24:17.378417+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:45.872966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"175'3","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513008+0000","last_change":"2024-09-12T12:24:15.398540+0000","last_active":"2024-09-12T12:24:17.513008+0000","last_peered":"2024-09-12T12:24:17.513008+0000","last_clean":"2024-09-12T12:24:17.513008+0000","last_became_active":"2024-09-12T12:24:15.398284+0000","last_became_peered":"2024-09-12T12:24:15.398284+0000","last_unstale":"2024-09-12T12:24:17.513008+0000","last_undegraded":"2024-09-12T12:24:17.513008+0000","last_fullsized":"2024-09-12T12:24:17.513008+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:04:18.784440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376580+0000","last_change":"2024-09-12T12:24:16.399782+0000","last_active":"2024-09-12T12:24:17.376580+0000","last_peered":"2024-09-12T12:24:17.376580+0000","last_clean":"2024-09-12T12:24:17.376580+0000","last_became_active":"2024-09-12T12:24:16.399517+0000","last_became_peered":"2024-09-12T12:24:16.399517+0000","last_unstale":"2024-09-12T12:24:17.376580+0000","last_undegraded":"2024-09-12T12:24:17.376580+0000","last_fullsized":"2024-09-12T12:24:17.376580+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:36.668056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"175'6","reported_seq":20,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377972+0000","last_change":"2024-09-12T12:24:15.389229+0000","last_active":"2024-09-12T12:24:17.377972+0000","last_peered":"2024-09-12T12:24:17.377972+0000","last_clean":"2024-09-12T12:24:17.377972+0000","last_became_active":"2024-09-12T12:24:15.388660+0000","last_became_peered":"2024-09-12T12:24:15.388660+0000","last_unstale":"2024-09-12T12:24:17.377972+0000","last_undegraded":"2024-09-12T12:24:17.377972+0000","last_fullsized":"2024-09-12T12:24:17.377972+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:02.449575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402106+0000","last_change":"2024-09-12T12:24:16.399205+0000","last_active":"2024-09-12T12:24:17.402106+0000","last_peered":"2024-09-12T12:24:17.402106+0000","last_clean":"2024-09-12T12:24:17.402106+0000","last_became_active":"2024-09-12T12:24:16.398875+0000","last_became_peered":"2024-09-12T12:24:16.398875+0000","last_unstale":"2024-09-12T12:24:17.402106+0000","last_undegraded":"2024-09-12T12:24:17.402106+0000","last_fullsized":"2024-09-12T12:24:17.402106+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:47.257395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378190+0000","last_change":"2024-09-12T12:24:15.385396+0000","last_active":"2024-09-12T12:24:17.378190+0000","last_peered":"2024-09-12T12:24:17.378190+0000","last_clean":"2024-09-12T12:24:17.378190+0000","last_became_active":"2024-09-12T12:24:15.385095+0000","last_became_peered":"2024-09-12T12:24:15.385095+0000","last_unstale":"2024-09-12T12:24:17.378190+0000","last_undegraded":"2024-09-12T12:24:17.378190+0000","last_fullsized":"2024-09-12T12:24:17.378190+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.613984+0000","last_change":"2024-09-12T12:24:16.390955+0000","last_active":"2024-09-12T12:24:18.613984+0000","last_peered":"2024-09-12T12:24:18.613984+0000","last_clean":"2024-09-12T12:24:18.613984+0000","last_became_active":"2024-09-12T12:24:16.388418+0000","last_became_peered":"2024-09-12T12:24:16.388418+0000","last_unstale":"2024-09-12T12:24:18.613984+0000","last_undegraded":"2024-09-12T12:24:18.613984+0000","last_fullsized":"2024-09-12T12:24:18.613984+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:44:40.208012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376309+0000","last_change":"2024-09-12T12:24:15.395867+0000","last_active":"2024-09-12T12:24:17.376309+0000","last_peered":"2024-09-12T12:24:17.376309+0000","last_clean":"2024-09-12T12:24:17.376309+0000","last_became_active":"2024-09-12T12:24:15.395594+0000","last_became_peered":"2024-09-12T12:24:15.395594+0000","last_unstale":"2024-09-12T12:24:17.376309+0000","last_undegraded":"2024-09-12T12:24:17.376309+0000","last_fullsized":"2024-09-12T12:24:17.376309+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:41.348309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377938+0000","last_change":"2024-09-12T12:24:16.387185+0000","last_active":"2024-09-12T12:24:17.377938+0000","last_peered":"2024-09-12T12:24:17.377938+0000","last_clean":"2024-09-12T12:24:17.377938+0000","last_became_active":"2024-09-12T12:24:16.386859+0000","last_became_peered":"2024-09-12T12:24:16.386859+0000","last_unstale":"2024-09-12T12:24:17.377938+0000","last_undegraded":"2024-09-12T12:24:17.377938+0000","last_fullsized":"2024-09-12T12:24:17.377938+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.116554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.512818+0000","last_change":"2024-09-12T12:24:15.381755+0000","last_active":"2024-09-12T12:24:17.512818+0000","last_peered":"2024-09-12T12:24:17.512818+0000","last_clean":"2024-09-12T12:24:17.512818+0000","last_became_active":"2024-09-12T12:24:15.380476+0000","last_became_peered":"2024-09-12T12:24:15.380476+0000","last_unstale":"2024-09-12T12:24:17.512818+0000","last_undegraded":"2024-09-12T12:24:17.512818+0000","last_fullsized":"2024-09-12T12:24:17.512818+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:18.835629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378125+0000","last_change":"2024-09-12T12:24:16.403838+0000","last_active":"2024-09-12T12:24:17.378125+0000","last_peered":"2024-09-12T12:24:17.378125+0000","last_clean":"2024-09-12T12:24:17.378125+0000","last_became_active":"2024-09-12T12:24:16.403611+0000","last_became_peered":"2024-09-12T12:24:16.403611+0000","last_unstale":"2024-09-12T12:24:17.378125+0000","last_undegraded":"2024-09-12T12:24:17.378125+0000","last_fullsized":"2024-09-12T12:24:17.378125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:38.894390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"175'8","reported_seq":22,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070217+0000","last_change":"2024-09-12T12:24:15.388767+0000","last_active":"2024-09-12T12:24:18.070217+0000","last_peered":"2024-09-12T12:24:18.070217+0000","last_clean":"2024-09-12T12:24:18.070217+0000","last_became_active":"2024-09-12T12:24:15.388428+0000","last_became_peered":"2024-09-12T12:24:15.388428+0000","last_unstale":"2024-09-12T12:24:18.070217+0000","last_undegraded":"2024-09-12T12:24:18.070217+0000","last_fullsized":"2024-09-12T12:24:18.070217+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:53.990844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402245+0000","last_change":"2024-09-12T12:24:16.405120+0000","last_active":"2024-09-12T12:24:17.402245+0000","last_peered":"2024-09-12T12:24:17.402245+0000","last_clean":"2024-09-12T12:24:17.402245+0000","last_became_active":"2024-09-12T12:24:16.404831+0000","last_became_peered":"2024-09-12T12:24:16.404831+0000","last_unstale":"2024-09-12T12:24:17.402245+0000","last_undegraded":"2024-09-12T12:24:17.402245+0000","last_fullsized":"2024-09-12T12:24:17.402245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:26.752182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070641+0000","last_change":"2024-09-12T12:24:15.394278+0000","last_active":"2024-09-12T12:24:18.070641+0000","last_peered":"2024-09-12T12:24:18.070641+0000","last_clean":"2024-09-12T12:24:18.070641+0000","last_became_active":"2024-09-12T12:24:15.392595+0000","last_became_peered":"2024-09-12T12:24:15.392595+0000","last_unstale":"2024-09-12T12:24:18.070641+0000","last_undegraded":"2024-09-12T12:24:18.070641+0000","last_fullsized":"2024-09-12T12:24:18.070641+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:02:59.109666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614201+0000","last_change":"2024-09-12T12:24:16.391727+0000","last_active":"2024-09-12T12:24:18.614201+0000","last_peered":"2024-09-12T12:24:18.614201+0000","last_clean":"2024-09-12T12:24:18.614201+0000","last_became_active":"2024-09-12T12:24:16.391468+0000","last_became_peered":"2024-09-12T12:24:16.391468+0000","last_unstale":"2024-09-12T12:24:18.614201+0000","last_undegraded":"2024-09-12T12:24:18.614201+0000","last_fullsized":"2024-09-12T12:24:18.614201+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:56.376971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.512962+0000","last_change":"2024-09-12T12:24:15.384394+0000","last_active":"2024-09-12T12:24:17.512962+0000","last_peered":"2024-09-12T12:24:17.512962+0000","last_clean":"2024-09-12T12:24:17.512962+0000","last_became_active":"2024-09-12T12:24:15.384130+0000","last_became_peered":"2024-09-12T12:24:15.384130+0000","last_unstale":"2024-09-12T12:24:17.512962+0000","last_undegraded":"2024-09-12T12:24:17.512962+0000","last_fullsized":"2024-09-12T12:24:17.512962+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:57.037340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070786+0000","last_change":"2024-09-12T12:24:16.397975+0000","last_active":"2024-09-12T12:24:18.070786+0000","last_peered":"2024-09-12T12:24:18.070786+0000","last_clean":"2024-09-12T12:24:18.070786+0000","last_became_active":"2024-09-12T12:24:16.397682+0000","last_became_peered":"2024-09-12T12:24:16.397682+0000","last_unstale":"2024-09-12T12:24:18.070786+0000","last_undegraded":"2024-09-12T12:24:18.070786+0000","last_fullsized":"2024-09-12T12:24:18.070786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:19.982642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"175'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377000+0000","last_change":"2024-09-12T12:24:15.398973+0000","last_active":"2024-09-12T12:24:17.377000+0000","last_peered":"2024-09-12T12:24:17.377000+0000","last_clean":"2024-09-12T12:24:17.377000+0000","last_became_active":"2024-09-12T12:24:15.398624+0000","last_became_peered":"2024-09-12T12:24:15.398624+0000","last_unstale":"2024-09-12T12:24:17.377000+0000","last_undegraded":"2024-09-12T12:24:17.377000+0000","last_fullsized":"2024-09-12T12:24:17.377000+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:14.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376616+0000","last_change":"2024-09-12T12:24:16.390299+0000","last_active":"2024-09-12T12:24:17.376616+0000","last_peered":"2024-09-12T12:24:17.376616+0000","last_clean":"2024-09-12T12:24:17.376616+0000","last_became_active":"2024-09-12T12:24:16.389754+0000","last_became_peered":"2024-09-12T12:24:16.389754+0000","last_unstale":"2024-09-12T12:24:17.376616+0000","last_undegraded":"2024-09-12T12:24:17.376616+0000","last_fullsized":"2024-09-12T12:24:17.376616+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:52.232681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.070516+0000","last_change":"2024-09-12T12:24:15.391813+0000","last_active":"2024-09-12T12:24:18.070516+0000","last_peered":"2024-09-12T12:24:18.070516+0000","last_clean":"2024-09-12T12:24:18.070516+0000","last_became_active":"2024-09-12T12:24:15.391434+0000","last_became_peered":"2024-09-12T12:24:15.391434+0000","last_unstale":"2024-09-12T12:24:18.070516+0000","last_undegraded":"2024-09-12T12:24:18.070516+0000","last_fullsized":"2024-09-12T12:24:18.070516+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:11:37.887502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375786+0000","last_change":"2024-09-12T12:24:16.401815+0000","last_active":"2024-09-12T12:24:17.375786+0000","last_peered":"2024-09-12T12:24:17.375786+0000","last_clean":"2024-09-12T12:24:17.375786+0000","last_became_active":"2024-09-12T12:24:16.401529+0000","last_became_peered":"2024-09-12T12:24:16.401529+0000","last_unstale":"2024-09-12T12:24:17.375786+0000","last_undegraded":"2024-09-12T12:24:17.375786+0000","last_fullsized":"2024-09-12T12:24:17.375786+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:31.656487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.378241+0000","last_change":"2024-09-12T12:24:15.399471+0000","last_active":"2024-09-12T12:24:17.378241+0000","last_peered":"2024-09-12T12:24:17.378241+0000","last_clean":"2024-09-12T12:24:17.378241+0000","last_became_active":"2024-09-12T12:24:15.399103+0000","last_became_peered":"2024-09-12T12:24:15.399103+0000","last_unstale":"2024-09-12T12:24:17.378241+0000","last_undegraded":"2024-09-12T12:24:17.378241+0000","last_fullsized":"2024-09-12T12:24:17.378241+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513034+0000","last_change":"2024-09-12T12:24:16.380708+0000","last_active":"2024-09-12T12:24:17.513034+0000","last_peered":"2024-09-12T12:24:17.513034+0000","last_clean":"2024-09-12T12:24:17.513034+0000","last_became_active":"2024-09-12T12:24:16.380397+0000","last_became_peered":"2024-09-12T12:24:16.380397+0000","last_unstale":"2024-09-12T12:24:17.513034+0000","last_undegraded":"2024-09-12T12:24:17.513034+0000","last_fullsized":"2024-09-12T12:24:17.513034+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.418022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513087+0000","last_change":"2024-09-12T12:24:15.384219+0000","last_active":"2024-09-12T12:24:17.513087+0000","last_peered":"2024-09-12T12:24:17.513087+0000","last_clean":"2024-09-12T12:24:17.513087+0000","last_became_active":"2024-09-12T12:24:15.383942+0000","last_became_peered":"2024-09-12T12:24:15.383942+0000","last_unstale":"2024-09-12T12:24:17.513087+0000","last_undegraded":"2024-09-12T12:24:17.513087+0000","last_fullsized":"2024-09-12T12:24:17.513087+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:06:47.850077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513088+0000","last_change":"2024-09-12T12:24:16.401479+0000","last_active":"2024-09-12T12:24:17.513088+0000","last_peered":"2024-09-12T12:24:17.513088+0000","last_clean":"2024-09-12T12:24:17.513088+0000","last_became_active":"2024-09-12T12:24:16.401230+0000","last_became_peered":"2024-09-12T12:24:16.401230+0000","last_unstale":"2024-09-12T12:24:17.513088+0000","last_undegraded":"2024-09-12T12:24:17.513088+0000","last_fullsized":"2024-09-12T12:24:17.513088+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:00:54.939202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402270+0000","last_change":"2024-09-12T12:24:15.398819+0000","last_active":"2024-09-12T12:24:17.402270+0000","last_peered":"2024-09-12T12:24:17.402270+0000","last_clean":"2024-09-12T12:24:17.402270+0000","last_became_active":"2024-09-12T12:24:15.398572+0000","last_became_peered":"2024-09-12T12:24:15.398572+0000","last_unstale":"2024-09-12T12:24:17.402270+0000","last_undegraded":"2024-09-12T12:24:17.402270+0000","last_fullsized":"2024-09-12T12:24:17.402270+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:33.388691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614154+0000","last_change":"2024-09-12T12:24:16.393240+0000","last_active":"2024-09-12T12:24:18.614154+0000","last_peered":"2024-09-12T12:24:18.614154+0000","last_clean":"2024-09-12T12:24:18.614154+0000","last_became_active":"2024-09-12T12:24:16.392939+0000","last_became_peered":"2024-09-12T12:24:16.392939+0000","last_unstale":"2024-09-12T12:24:18.614154+0000","last_undegraded":"2024-09-12T12:24:18.614154+0000","last_fullsized":"2024-09-12T12:24:18.614154+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:37.911201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376709+0000","last_change":"2024-09-12T12:24:15.391719+0000","last_active":"2024-09-12T12:24:17.376709+0000","last_peered":"2024-09-12T12:24:17.376709+0000","last_clean":"2024-09-12T12:24:17.376709+0000","last_became_active":"2024-09-12T12:24:15.391451+0000","last_became_peered":"2024-09-12T12:24:15.391451+0000","last_unstale":"2024-09-12T12:24:17.376709+0000","last_undegraded":"2024-09-12T12:24:17.376709+0000","last_fullsized":"2024-09-12T12:24:17.376709+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:19.341788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402376+0000","last_change":"2024-09-12T12:24:16.400257+0000","last_active":"2024-09-12T12:24:17.402376+0000","last_peered":"2024-09-12T12:24:17.402376+0000","last_clean":"2024-09-12T12:24:17.402376+0000","last_became_active":"2024-09-12T12:24:16.399908+0000","last_became_peered":"2024-09-12T12:24:16.399908+0000","last_unstale":"2024-09-12T12:24:17.402376+0000","last_undegraded":"2024-09-12T12:24:17.402376+0000","last_fullsized":"2024-09-12T12:24:17.402376+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:05:19.882883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"175'2","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.513139+0000","last_change":"2024-09-12T12:24:15.391685+0000","last_active":"2024-09-12T12:24:17.513139+0000","last_peered":"2024-09-12T12:24:17.513139+0000","last_clean":"2024-09-12T12:24:17.513139+0000","last_became_active":"2024-09-12T12:24:15.391401+0000","last_became_peered":"2024-09-12T12:24:15.391401+0000","last_unstale":"2024-09-12T12:24:17.513139+0000","last_undegraded":"2024-09-12T12:24:17.513139+0000","last_fullsized":"2024-09-12T12:24:17.513139+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:58.502911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.375977+0000","last_change":"2024-09-12T12:24:16.393135+0000","last_active":"2024-09-12T12:24:17.375977+0000","last_peered":"2024-09-12T12:24:17.375977+0000","last_clean":"2024-09-12T12:24:17.375977+0000","last_became_active":"2024-09-12T12:24:16.392886+0000","last_became_peered":"2024-09-12T12:24:16.392886+0000","last_unstale":"2024-09-12T12:24:17.375977+0000","last_undegraded":"2024-09-12T12:24:17.375977+0000","last_fullsized":"2024-09-12T12:24:17.375977+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:03.027052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"176'1","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402509+0000","last_change":"2024-09-12T12:24:15.398312+0000","last_active":"2024-09-12T12:24:17.402509+0000","last_peered":"2024-09-12T12:24:17.402509+0000","last_clean":"2024-09-12T12:24:17.402509+0000","last_became_active":"2024-09-12T12:24:15.397828+0000","last_became_peered":"2024-09-12T12:24:15.397828+0000","last_unstale":"2024-09-12T12:24:17.402509+0000","last_undegraded":"2024-09-12T12:24:17.402509+0000","last_fullsized":"2024-09-12T12:24:17.402509+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:05.355749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614970+0000","last_change":"2024-09-12T12:24:16.396259+0000","last_active":"2024-09-12T12:24:18.614970+0000","last_peered":"2024-09-12T12:24:18.614970+0000","last_clean":"2024-09-12T12:24:18.614970+0000","last_became_active":"2024-09-12T12:24:16.396001+0000","last_became_peered":"2024-09-12T12:24:16.396001+0000","last_unstale":"2024-09-12T12:24:18.614970+0000","last_undegraded":"2024-09-12T12:24:18.614970+0000","last_fullsized":"2024-09-12T12:24:18.614970+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:33.218784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614336+0000","last_change":"2024-09-12T12:24:15.401539+0000","last_active":"2024-09-12T12:24:18.614336+0000","last_peered":"2024-09-12T12:24:18.614336+0000","last_clean":"2024-09-12T12:24:18.614336+0000","last_became_active":"2024-09-12T12:24:15.400457+0000","last_became_peered":"2024-09-12T12:24:15.400457+0000","last_unstale":"2024-09-12T12:24:18.614336+0000","last_undegraded":"2024-09-12T12:24:18.614336+0000","last_fullsized":"2024-09-12T12:24:18.614336+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:00:53.932314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402584+0000","last_change":"2024-09-12T12:24:16.399098+0000","last_active":"2024-09-12T12:24:17.402584+0000","last_peered":"2024-09-12T12:24:17.402584+0000","last_clean":"2024-09-12T12:24:17.402584+0000","last_became_active":"2024-09-12T12:24:16.398823+0000","last_became_peered":"2024-09-12T12:24:16.398823+0000","last_unstale":"2024-09-12T12:24:17.402584+0000","last_undegraded":"2024-09-12T12:24:17.402584+0000","last_fullsized":"2024-09-12T12:24:17.402584+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:20.717320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614236+0000","last_change":"2024-09-12T12:24:15.398497+0000","last_active":"2024-09-12T12:24:18.614236+0000","last_peered":"2024-09-12T12:24:18.614236+0000","last_clean":"2024-09-12T12:24:18.614236+0000","last_became_active":"2024-09-12T12:24:15.398186+0000","last_became_peered":"2024-09-12T12:24:15.398186+0000","last_unstale":"2024-09-12T12:24:18.614236+0000","last_undegraded":"2024-09-12T12:24:18.614236+0000","last_fullsized":"2024-09-12T12:24:18.614236+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:31.161939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376781+0000","last_change":"2024-09-12T12:24:16.389008+0000","last_active":"2024-09-12T12:24:17.376781+0000","last_peered":"2024-09-12T12:24:17.376781+0000","last_clean":"2024-09-12T12:24:17.376781+0000","last_became_active":"2024-09-12T12:24:16.388763+0000","last_became_peered":"2024-09-12T12:24:16.388763+0000","last_unstale":"2024-09-12T12:24:17.376781+0000","last_undegraded":"2024-09-12T12:24:17.376781+0000","last_fullsized":"2024-09-12T12:24:17.376781+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.252266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614577+0000","last_change":"2024-09-12T12:24:15.392333+0000","last_active":"2024-09-12T12:24:18.614577+0000","last_peered":"2024-09-12T12:24:18.614577+0000","last_clean":"2024-09-12T12:24:18.614577+0000","last_became_active":"2024-09-12T12:24:15.390965+0000","last_became_peered":"2024-09-12T12:24:15.390965+0000","last_unstale":"2024-09-12T12:24:18.614577+0000","last_undegraded":"2024-09-12T12:24:18.614577+0000","last_fullsized":"2024-09-12T12:24:18.614577+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:23.211150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377869+0000","last_change":"2024-09-12T12:24:16.383386+0000","last_active":"2024-09-12T12:24:17.377869+0000","last_peered":"2024-09-12T12:24:17.377869+0000","last_clean":"2024-09-12T12:24:17.377869+0000","last_became_active":"2024-09-12T12:24:16.383081+0000","last_became_peered":"2024-09-12T12:24:16.383081+0000","last_unstale":"2024-09-12T12:24:17.377869+0000","last_undegraded":"2024-09-12T12:24:17.377869+0000","last_fullsized":"2024-09-12T12:24:17.377869+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:54.997732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614411+0000","last_change":"2024-09-12T12:24:15.398042+0000","last_active":"2024-09-12T12:24:18.614411+0000","last_peered":"2024-09-12T12:24:18.614411+0000","last_clean":"2024-09-12T12:24:18.614411+0000","last_became_active":"2024-09-12T12:24:15.397831+0000","last_became_peered":"2024-09-12T12:24:15.397831+0000","last_unstale":"2024-09-12T12:24:18.614411+0000","last_undegraded":"2024-09-12T12:24:18.614411+0000","last_fullsized":"2024-09-12T12:24:18.614411+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:32.073587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376395+0000","last_change":"2024-09-12T12:24:16.391725+0000","last_active":"2024-09-12T12:24:17.376395+0000","last_peered":"2024-09-12T12:24:17.376395+0000","last_clean":"2024-09-12T12:24:17.376395+0000","last_became_active":"2024-09-12T12:24:16.391417+0000","last_became_peered":"2024-09-12T12:24:16.391417+0000","last_unstale":"2024-09-12T12:24:17.376395+0000","last_undegraded":"2024-09-12T12:24:17.376395+0000","last_fullsized":"2024-09-12T12:24:17.376395+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:48.466637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.402272+0000","last_change":"2024-09-12T12:24:15.389928+0000","last_active":"2024-09-12T12:24:17.402272+0000","last_peered":"2024-09-12T12:24:17.402272+0000","last_clean":"2024-09-12T12:24:17.402272+0000","last_became_active":"2024-09-12T12:24:15.389340+0000","last_became_peered":"2024-09-12T12:24:15.389340+0000","last_unstale":"2024-09-12T12:24:17.402272+0000","last_undegraded":"2024-09-12T12:24:17.402272+0000","last_fullsized":"2024-09-12T12:24:17.402272+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:15.606771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614638+0000","last_change":"2024-09-12T12:24:16.407188+0000","last_active":"2024-09-12T12:24:18.614638+0000","last_peered":"2024-09-12T12:24:18.614638+0000","last_clean":"2024-09-12T12:24:18.614638+0000","last_became_active":"2024-09-12T12:24:16.406874+0000","last_became_peered":"2024-09-12T12:24:16.406874+0000","last_unstale":"2024-09-12T12:24:18.614638+0000","last_undegraded":"2024-09-12T12:24:18.614638+0000","last_fullsized":"2024-09-12T12:24:18.614638+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:20.527705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.376860+0000","last_change":"2024-09-12T12:24:15.394140+0000","last_active":"2024-09-12T12:24:17.376860+0000","last_peered":"2024-09-12T12:24:17.376860+0000","last_clean":"2024-09-12T12:24:17.376860+0000","last_became_active":"2024-09-12T12:24:15.393853+0000","last_became_peered":"2024-09-12T12:24:15.393853+0000","last_unstale":"2024-09-12T12:24:17.376860+0000","last_undegraded":"2024-09-12T12:24:17.376860+0000","last_fullsized":"2024-09-12T12:24:17.376860+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:14.900173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.377325+0000","last_change":"2024-09-12T12:24:16.389657+0000","last_active":"2024-09-12T12:24:17.377325+0000","last_peered":"2024-09-12T12:24:17.377325+0000","last_clean":"2024-09-12T12:24:17.377325+0000","last_became_active":"2024-09-12T12:24:16.389393+0000","last_became_peered":"2024-09-12T12:24:16.389393+0000","last_unstale":"2024-09-12T12:24:17.377325+0000","last_undegraded":"2024-09-12T12:24:17.377325+0000","last_fullsized":"2024-09-12T12:24:17.377325+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:15.362018+0000","last_clean_scrub_stamp":"2024-09-12T12:24:15.362018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:43.184029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:17.512853+0000","last_change":"2024-09-12T12:24:15.385634+0000","last_active":"2024-09-12T12:24:17.512853+0000","last_peered":"2024-09-12T12:24:17.512853+0000","last_clean":"2024-09-12T12:24:17.512853+0000","last_became_active":"2024-09-12T12:24:15.385354+0000","last_became_peered":"2024-09-12T12:24:15.385354+0000","last_unstale":"2024-09-12T12:24:17.512853+0000","last_undegraded":"2024-09-12T12:24:17.512853+0000","last_fullsized":"2024-09-12T12:24:17.512853+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:24:14.355130+0000","last_clean_scrub_stamp":"2024-09-12T12:24:14.355130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:25.336605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":455,"reported_epoch":176,"state":"active+clean","last_fresh":"2024-09-12T12:24:18.614607+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:24:18.614607+0000","last_peered":"2024-09-12T12:24:18.614607+0000","last_clean":"2024-09-12T12:24:18.614607+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:24:18.614607+0000","last_undegraded":"2024-09-12T12:24:18.614607+0000","last_fullsized":"2024-09-12T12:24:18.614607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51980,"kb_used_data":2744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319860,"statfs":{"total":96636764160,"available":96583536640,"internally_reserved":0,"allocated":2809856,"data_stored":1637923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51404,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320436,"statfs":{"total":96636764160,"available":96584126464,"internally_reserved":0,"allocated":2220032,"data_stored":1047625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51416,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320424,"statfs":{"total":96636764160,"available":96584114176,"internally_reserved":0,"allocated":2232320,"data_stored":1049189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59740,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312100,"statfs":{"total":96636764160,"available":96575590400,"internally_reserved":0,"allocated":2232320,"data_stored":1049201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59728,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312112,"statfs":{"total":96636764160,"available":96575602688,"internally_reserved":0,"allocated":2224128,"data_stored":1047715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":58915272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55568,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316272,"statfs":{"total":96636764160,"available":96579862528,"internally_reserved":0,"allocated":2220032,"data_stored":1048137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59724,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312116,"statfs":{"total":96636764160,"available":96575606784,"internally_reserved":0,"allocated":2215936,"data_stored":1047555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":2826240,"data_stored":1638651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:24:25.353 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:24:25.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:24:25.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.532+0000 7f4ac7200640 1 Processor -- start 2024-09-12T12:24:25.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.532+0000 7f4ac7200640 1 -- start start 2024-09-12T12:24:25.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac80b1e10 0x7f4ac80b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4ac80b4580 0x7f4ac80b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac80b3470 con 0x7f4ac8155810 2024-09-12T12:24:25.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac815c820 con 0x7f4ac80b4580 2024-09-12T12:24:25.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac80b2790 con 0x7f4ac80b1e10 2024-09-12T12:24:25.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4ac8155810 0x7f4ac815c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53104/0 (socket says 172.21.15.144:53104) 2024-09-12T12:24:25.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5e00640 1 -- 172.21.15.144:0/3677451608 learned_addr learned my addr 172.21.15.144:0/3677451608 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac6800640 1 --2- 172.21.15.144:0/3677451608 >> v2:172.21.15.165:3300/0 conn(0x7f4ac80b4580 0x7f4ac80b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5400640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac80b1e10 0x7f4ac80b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298351605 0 0) 0x7f4ac80b3470 con 0x7f4ac8155810 2024-09-12T12:24:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aac005740 con 0x7f4ac8155810 2024-09-12T12:24:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 958726354 0 0) 0x7f4aac005740 con 0x7f4ac8155810 2024-09-12T12:24:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac80b1e10 msgr2=0x7f4ac80b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac80b1e10 0x7f4ac80b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 >> v2:172.21.15.165:3300/0 conn(0x7f4ac80b4580 msgr2=0x7f4ac80b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 --2- 172.21.15.144:0/3677451608 >> v2:172.21.15.165:3300/0 conn(0x7f4ac80b4580 0x7f4ac80b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac80b3750 con 0x7f4ac8155810 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f4ab8001a00 con 0x7f4ac8155810 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 >> v1:172.21.15.144:6789/0 conn(0x7f4ac8155810 legacy=0x7f4ac815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4aac005bd0 0x7f4aac006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aac006a20 0x7f4aac006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac0073e0 0x7f4aac00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80b2790 con 0x7f4aac006a20 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac00e150 con 0x7f4aac0073e0 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4aac00e350 con 0x7f4aac005bd0 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5400640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac80b1e10 0x7f4ac80b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5400640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aac006a20 0x7f4aac006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5e00640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4aac005bd0 0x7f4aac006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac6800640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac0073e0 0x7f4aac00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5400640 1 -- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4aac005bd0 msgr2=0x7f4aac006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:25.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5400640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4aac005bd0 0x7f4aac006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5400640 1 -- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac0073e0 msgr2=0x7f4aac00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:25.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5400640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac0073e0 0x7f4aac00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.536+0000 7f4ac5400640 1 -- 172.21.15.144:0/3677451608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac005740 con 0x7f4aac006a20 2024-09-12T12:24:25.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac5400640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aac006a20 0x7f4aac006ea0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80afdc0 tx=0x7f4ab401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604baf5a909f34a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400f040 con 0x7f4aac006a20 2024-09-12T12:24:25.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab40b0070 con 0x7f4aac006a20 2024-09-12T12:24:25.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac4a00640 1 -- 172.21.15.144:0/3677451608 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40ab860 con 0x7f4aac006a20 2024-09-12T12:24:25.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac7200640 1 -- 172.21.15.144:0/3677451608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aac006a20 msgr2=0x7f4aac006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac7200640 1 --2- 172.21.15.144:0/3677451608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4aac006a20 0x7f4aac006ea0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80afdc0 tx=0x7f4ab401c3f0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac6800640 1 -- 172.21.15.144:0/3677451608 reap_dead start 2024-09-12T12:24:25.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac7200640 1 -- 172.21.15.144:0/3677451608 shutdown_connections 2024-09-12T12:24:25.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac7200640 1 -- 172.21.15.144:0/3677451608 >> 172.21.15.144:0/3677451608 conn(0x7f4ac806e7e0 msgr2=0x7f4ac806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:25.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac7200640 1 -- 172.21.15.144:0/3677451608 shutdown_connections 2024-09-12T12:24:25.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac7200640 1 -- 172.21.15.144:0/3677451608 wait complete. 2024-09-12T12:24:25.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac7200640 1 Processor -- start 2024-09-12T12:24:25.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.540+0000 7f4ac7200640 1 -- start start 2024-09-12T12:24:25.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac006a20 0x7f4ac81f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac815ae90 0x7f4ac815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac8155bf0 0x7f4ac8156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80b3ff0 con 0x7f4ac8155bf0 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80b3d10 con 0x7f4aac006a20 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac80b3180 con 0x7f4ac815ae90 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac8155bf0 0x7f4ac8156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac5e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac006a20 0x7f4ac81f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac8155bf0 0x7f4ac8156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36526/0 (socket says 172.21.15.144:36526) 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac6800640 1 -- 172.21.15.144:0/3882273537 learned_addr learned my addr 172.21.15.144:0/3882273537 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac5400640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac815ae90 0x7f4ac815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac6800640 1 -- 172.21.15.144:0/3882273537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac815ae90 msgr2=0x7f4ac815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac6800640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac815ae90 0x7f4ac815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac6800640 1 -- 172.21.15.144:0/3882273537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac006a20 msgr2=0x7f4ac81f8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac6800640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac006a20 0x7f4ac81f8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac6800640 1 -- 172.21.15.144:0/3882273537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac815b2f0 con 0x7f4ac8155bf0 2024-09-12T12:24:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac5e00640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac006a20 0x7f4ac81f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac6800640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac8155bf0 0x7f4ac8156070 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80ce010 tx=0x7f4ac0011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4abe000640 1 -- 172.21.15.144:0/3882273537 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0019020 con 0x7f4ac8155bf0 2024-09-12T12:24:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4abe000640 1 -- 172.21.15.144:0/3882273537 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac0004240 con 0x7f4ac8155bf0 2024-09-12T12:24:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4abe000640 1 -- 172.21.15.144:0/3882273537 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac000f6f0 con 0x7f4ac8155bf0 2024-09-12T12:24:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac81f9060 con 0x7f4ac8155bf0 2024-09-12T12:24:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac81f9620 con 0x7f4ac8155bf0 2024-09-12T12:24:25.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac80ce040 con 0x7f4ac8155bf0 2024-09-12T12:24:25.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.544+0000 7f4abe000640 1 -- 172.21.15.144:0/3882273537 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ac001c020 con 0x7f4ac8155bf0 2024-09-12T12:24:25.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.548+0000 7f4abe000640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4aa80678f0 0x7f4aa8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.548+0000 7f4abe000640 1 -- 172.21.15.144:0/3882273537 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f4ac0086020 con 0x7f4ac8155bf0 2024-09-12T12:24:25.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.548+0000 7f4ac5e00640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4aa80678f0 0x7f4aa8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.548+0000 7f4ac5e00640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4aa80678f0 0x7f4aa8069db0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000f90 tx=0x7f4ab8006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.552+0000 7f4abe000640 1 -- 172.21.15.144:0/3882273537 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4ac0023020 con 0x7f4ac8155bf0 2024-09-12T12:24:25.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.764+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4ac80691c0 con 0x7f4ac8155bf0 2024-09-12T12:24:25.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4abe000640 1 -- 172.21.15.144:0/3882273537 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f4ac0056410 con 0x7f4ac8155bf0 2024-09-12T12:24:25.770 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:24:25.770 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:24:25.771 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:24:25.771 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:24:25.771 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:24:25.771 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:24:25.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4aa80678f0 msgr2=0x7f4aa8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4aa80678f0 0x7f4aa8069db0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000f90 tx=0x7f4ab8006040 comp rx=0 tx=0).stop 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac8155bf0 msgr2=0x7f4ac8156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac8155bf0 0x7f4ac8156070 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80ce010 tx=0x7f4ac0011cf0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 shutdown_connections 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4aa80678f0 0x7f4aa8069db0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ac8155bf0 0x7f4ac8156070 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ac815ae90 0x7f4ac815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 --2- 172.21.15.144:0/3882273537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4aac006a20 0x7f4ac81f8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 >> 172.21.15.144:0/3882273537 conn(0x7f4ac806e7e0 msgr2=0x7f4ac8070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 shutdown_connections 2024-09-12T12:24:25.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.772+0000 7f4ac7200640 1 -- 172.21.15.144:0/3882273537 wait complete. 2024-09-12T12:24:25.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.928+0000 7f6239a00640 1 Processor -- start 2024-09-12T12:24:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.928+0000 7f6239a00640 1 -- start start 2024-09-12T12:24:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.928+0000 7f6239a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f623415c7b0 0x7f62340ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.928+0000 7f6239a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62340cd870 con 0x7f62340b5fb0 2024-09-12T12:24:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.928+0000 7f6239a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62340cdb50 con 0x7f623415cd30 2024-09-12T12:24:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.928+0000 7f6239a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6234072a50 con 0x7f623415c7b0 2024-09-12T12:24:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.928+0000 7f6233400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f62340b5fb0 0x7f6234072ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53108/0 (socket says 172.21.15.144:53108) 2024-09-12T12:24:25.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6233400640 1 -- 172.21.15.144:0/2538062180 learned_addr learned my addr 172.21.15.144:0/2538062180 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6232a00640 1 --2- 172.21.15.144:0/2538062180 >> v2:172.21.15.165:3300/0 conn(0x7f623415c7b0 0x7f62340ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776597450 0 0) 0x7f62340cd870 con 0x7f62340b5fb0 2024-09-12T12:24:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6218003530 con 0x7f62340b5fb0 2024-09-12T12:24:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 447307217 0 0) 0x7f6218003530 con 0x7f62340b5fb0 2024-09-12T12:24:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 >> v2:172.21.15.165:3300/0 conn(0x7f623415c7b0 msgr2=0x7f62340ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 --2- 172.21.15.144:0/2538062180 >> v2:172.21.15.165:3300/0 conn(0x7f623415c7b0 0x7f62340ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 >> v1:172.21.15.165:6789/0 conn(0x7f623415cd30 legacy=0x7f62340b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62340726e0 con 0x7f62340b5fb0 2024-09-12T12:24:25.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f622c001a00 con 0x7f62340b5fb0 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 >> v1:172.21.15.144:6789/0 conn(0x7f62340b5fb0 legacy=0x7f6234072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62180039c0 0x7f6218003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6218004810 0x7f6218004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62180051d0 0x7f621800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6234072a50 con 0x7f62180051d0 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f621800c070 con 0x7f6218004810 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f621800c270 con 0x7f62180039c0 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6233400640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62180051d0 0x7f621800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6232000640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6218004810 0x7f6218004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6232a00640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62180039c0 0x7f6218003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6233400640 1 -- 172.21.15.144:0/2538062180 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62180039c0 msgr2=0x7f6218003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6233400640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62180039c0 0x7f6218003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6233400640 1 -- 172.21.15.144:0/2538062180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6218004810 msgr2=0x7f6218004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6233400640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6218004810 0x7f6218004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.932+0000 7f6233400640 1 -- 172.21.15.144:0/2538062180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6218003530 con 0x7f62180051d0 2024-09-12T12:24:25.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6233400640 1 -- 172.21.15.144:0/2538062180 reap_dead start 2024-09-12T12:24:25.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6233400640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62180051d0 0x7f621800b9d0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f622c00a860 tx=0x7f622c01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f800ab6207e880da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c00a480 con 0x7f62180051d0 2024-09-12T12:24:25.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c0ad650 con 0x7f62180051d0 2024-09-12T12:24:25.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6231600640 1 -- 172.21.15.144:0/2538062180 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c0ada40 con 0x7f62180051d0 2024-09-12T12:24:25.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6239a00640 1 -- 172.21.15.144:0/2538062180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62180051d0 msgr2=0x7f621800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6239a00640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62180051d0 0x7f621800b9d0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f622c00a860 tx=0x7f622c01d380 comp rx=0 tx=0).stop 2024-09-12T12:24:25.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6239a00640 1 -- 172.21.15.144:0/2538062180 shutdown_connections 2024-09-12T12:24:25.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6239a00640 1 --2- 172.21.15.144:0/2538062180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62180051d0 0x7f621800b9d0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6239a00640 1 -- 172.21.15.144:0/2538062180 >> 172.21.15.144:0/2538062180 conn(0x7f623406d0d0 msgr2=0x7f623406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:25.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6239a00640 1 -- 172.21.15.144:0/2538062180 shutdown_connections 2024-09-12T12:24:25.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6239a00640 1 -- 172.21.15.144:0/2538062180 wait complete. 2024-09-12T12:24:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6239a00640 1 Processor -- start 2024-09-12T12:24:25.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.936+0000 7f6239a00640 1 -- start start 2024-09-12T12:24:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6239a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62180051d0 0x7f62340ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6239a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f623415a830 0x7f62341f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6239a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341f3110 0x7f62341f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6239a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f62340b5c30 con 0x7f62341f3110 2024-09-12T12:24:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6239a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f62340b5ab0 con 0x7f623415a830 2024-09-12T12:24:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6239a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f62340b5db0 con 0x7f62180051d0 2024-09-12T12:24:25.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6233400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341f3110 0x7f62341f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6233400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341f3110 0x7f62341f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36550/0 (socket says 172.21.15.144:36550) 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6233400640 1 -- 172.21.15.144:0/2106018240 learned_addr learned my addr 172.21.15.144:0/2106018240 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6232a00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62180051d0 0x7f62340ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6232000640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f623415a830 0x7f62341f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6233400640 1 -- 172.21.15.144:0/2106018240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62180051d0 msgr2=0x7f62340ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6233400640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62180051d0 0x7f62340ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6233400640 1 -- 172.21.15.144:0/2106018240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f623415a830 msgr2=0x7f62341f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6233400640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f623415a830 0x7f62341f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6233400640 1 -- 172.21.15.144:0/2106018240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62341574c0 con 0x7f62341f3110 2024-09-12T12:24:25.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6233400640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341f3110 0x7f62341f3590 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f622c01d1b0 tx=0x7f6218005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f622aa00640 1 -- 172.21.15.144:0/2106018240 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c0019c0 con 0x7f62341f3110 2024-09-12T12:24:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f622aa00640 1 -- 172.21.15.144:0/2106018240 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c0b4070 con 0x7f62341f3110 2024-09-12T12:24:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62340ae1d0 con 0x7f62341f3110 2024-09-12T12:24:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f622aa00640 1 -- 172.21.15.144:0/2106018240 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c0ad800 con 0x7f62341f3110 2024-09-12T12:24:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62340ae790 con 0x7f62341f3110 2024-09-12T12:24:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62340ccf00 con 0x7f62341f3110 2024-09-12T12:24:25.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.940+0000 7f622aa00640 1 -- 172.21.15.144:0/2106018240 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f622c0ad9a0 con 0x7f62341f3110 2024-09-12T12:24:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.944+0000 7f622aa00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62140678f0 0x7f6214069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.944+0000 7f622aa00640 1 -- 172.21.15.144:0/2106018240 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f622c120070 con 0x7f62341f3110 2024-09-12T12:24:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.944+0000 7f6232a00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62140678f0 0x7f6214069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:25.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.944+0000 7f6232a00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62140678f0 0x7f6214069db0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6224009ac0 tx=0x7f6224009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:25.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:25.948+0000 7f622aa00640 1 -- 172.21.15.144:0/2106018240 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f622c017090 con 0x7f62341f3110 2024-09-12T12:24:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.136+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f623415f120 con 0x7f62341f3110 2024-09-12T12:24:26.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.136+0000 7f622aa00640 1 -- 172.21.15.144:0/2106018240 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) ==== 95+0+5242 (secure 0 0 0) 0x7f622c0f03f0 con 0x7f62341f3110 2024-09-12T12:24:26.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:26.137 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":136,"btime":"2024-09-12T12:24:19:399460+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8132,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2178161495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2178161495},{"type":"v1","addr":"172.21.15.144:6835","nonce":2178161495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2493299621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2493299621},{"type":"v1","addr":"172.21.15.165:6835","nonce":2493299621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131},{"gid":9256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2468859076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2468859076},{"type":"v1","addr":"172.21.15.165:6834","nonce":2468859076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:24:15.762976+0000","modified":"2024-09-12T12:24:18.778051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9795":{"gid":9795,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/249899092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":249899092},{"type":"v1","addr":"172.21.15.144:6837","nonce":249899092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9795,"qdb_cluster":[9795]},"id":12}]} 2024-09-12T12:24:26.137 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 136 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62140678f0 msgr2=0x7f6214069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62140678f0 0x7f6214069db0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6224009ac0 tx=0x7f6224009190 comp rx=0 tx=0).stop 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341f3110 msgr2=0x7f62341f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341f3110 0x7f62341f3590 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f622c01d1b0 tx=0x7f6218005840 comp rx=0 tx=0).stop 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 shutdown_connections 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f62140678f0 0x7f6214069db0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62341f3110 0x7f62341f3590 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f623415a830 0x7f62341f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 --2- 172.21.15.144:0/2106018240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62180051d0 0x7f62340ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 >> 172.21.15.144:0/2106018240 conn(0x7f623406d0d0 msgr2=0x7f623415bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 shutdown_connections 2024-09-12T12:24:26.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.140+0000 7f6239a00640 1 -- 172.21.15.144:0/2106018240 wait complete. 2024-09-12T12:24:26.561 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 136, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:24:15.762976+0000', 'modified': '2024-09-12T12:24:18.778051+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9795}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9795': {'gid': 9795, 'name': 'a', 'rank': 0, 'incarnation': 132, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/249899092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 249899092}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 249899092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9795, 'qdb_cluster': [9795]} 2024-09-12T12:24:26.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:24:26.600 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T12:24:26.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.736+0000 7f8913600640 1 Processor -- start 2024-09-12T12:24:26.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.736+0000 7f8913600640 1 -- start start 2024-09-12T12:24:26.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f8913600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f890c071420 0x7f890c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f8913600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f890c0b45a0 con 0x7f890c0ccf30 2024-09-12T12:24:26.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f8913600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f890c0b3fe0 con 0x7f890c15b4e0 2024-09-12T12:24:26.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f8913600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f890c0b42c0 con 0x7f890c071420 2024-09-12T12:24:26.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f890be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f890c071420 0x7f890c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f8911600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f890c0ccf30 0x7f890c0cd350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53112/0 (socket says 172.21.15.144:53112) 2024-09-12T12:24:26.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f8911600640 1 -- 172.21.15.144:0/1188721389 learned_addr learned my addr 172.21.15.144:0/1188721389 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:26.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f890be00640 1 -- 172.21.15.144:0/1188721389 >> v1:172.21.15.165:6789/0 conn(0x7f890c15b4e0 legacy=0x7f890c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f890be00640 1 -- 172.21.15.144:0/1188721389 >> v1:172.21.15.144:6789/0 conn(0x7f890c0ccf30 legacy=0x7f890c0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f890be00640 1 -- 172.21.15.144:0/1188721389 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c0b1490 con 0x7f890c071420 2024-09-12T12:24:26.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.740+0000 7f890b400640 1 -- 172.21.15.144:0/1188721389 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2672169038 0 0) 0x7f890c0b45a0 con 0x7f890c0ccf30 2024-09-12T12:24:26.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f890be00640 1 --2- 172.21.15.144:0/1188721389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 0x7f890c071840 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f88f80097c0 tx=0x7f88f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f7df653afa4cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f890b400640 1 -- 172.21.15.144:0/1188721389 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f80ab600 con 0x7f890c071420 2024-09-12T12:24:26.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f890b400640 1 -- 172.21.15.144:0/1188721389 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f80b0070 con 0x7f890c071420 2024-09-12T12:24:26.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f890b400640 1 -- 172.21.15.144:0/1188721389 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f80ab9c0 con 0x7f890c071420 2024-09-12T12:24:26.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 -- 172.21.15.144:0/1188721389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 msgr2=0x7f890c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 --2- 172.21.15.144:0/1188721389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 0x7f890c071840 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f88f80097c0 tx=0x7f88f801c470 comp rx=0 tx=0).stop 2024-09-12T12:24:26.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 -- 172.21.15.144:0/1188721389 shutdown_connections 2024-09-12T12:24:26.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 --2- 172.21.15.144:0/1188721389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 0x7f890c071840 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 -- 172.21.15.144:0/1188721389 >> 172.21.15.144:0/1188721389 conn(0x7f890c06d0d0 msgr2=0x7f890c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 -- 172.21.15.144:0/1188721389 shutdown_connections 2024-09-12T12:24:26.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 -- 172.21.15.144:0/1188721389 wait complete. 2024-09-12T12:24:26.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 Processor -- start 2024-09-12T12:24:26.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 -- start start 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 0x7f890c156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f890c0ccf30 0x7f890c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890c15b4e0 0x7f890c0af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f890c15b8c0 con 0x7f890c071420 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f890c169270 con 0x7f890c0ccf30 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.744+0000 7f8913600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f890c161bc0 con 0x7f890c15b4e0 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8910c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 0x7f890c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8910c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 0x7f890c156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36574/0 (socket says 172.21.15.144:36574) 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8910c00640 1 -- 172.21.15.144:0/3391776926 learned_addr learned my addr 172.21.15.144:0/3391776926 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8911600640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890c15b4e0 0x7f890c0af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f890be00640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f890c0ccf30 0x7f890c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8910c00640 1 -- 172.21.15.144:0/3391776926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890c15b4e0 msgr2=0x7f890c0af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8910c00640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890c15b4e0 0x7f890c0af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8910c00640 1 -- 172.21.15.144:0/3391776926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f890c0ccf30 msgr2=0x7f890c15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8910c00640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f890c0ccf30 0x7f890c15d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8910c00640 1 -- 172.21.15.144:0/3391776926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c157170 con 0x7f890c071420 2024-09-12T12:24:26.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8910c00640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 0x7f890c156c30 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00c3c0 tx=0x7f88fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8908c00640 1 -- 172.21.15.144:0/3391776926 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc017070 con 0x7f890c071420 2024-09-12T12:24:26.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8908c00640 1 -- 172.21.15.144:0/3391776926 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc0052d0 con 0x7f890c071420 2024-09-12T12:24:26.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8908c00640 1 -- 172.21.15.144:0/3391776926 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc003840 con 0x7f890c071420 2024-09-12T12:24:26.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8913600640 1 -- 172.21.15.144:0/3391776926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890c162050 con 0x7f890c071420 2024-09-12T12:24:26.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8913600640 1 -- 172.21.15.144:0/3391776926 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f890c161290 con 0x7f890c071420 2024-09-12T12:24:26.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.748+0000 7f8908c00640 1 -- 172.21.15.144:0/3391776926 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88fc01a070 con 0x7f890c071420 2024-09-12T12:24:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8908c00640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ec0678c0 0x7f88ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 Processor -- start 2024-09-12T12:24:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8908c00640 1 -- 172.21.15.144:0/3391776926 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f88fc0850f0 con 0x7f890c071420 2024-09-12T12:24:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f890be00640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ec0678c0 0x7f88ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 -- start start 2024-09-12T12:24:26.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f890be00640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ec0678c0 0x7f88ec069d80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f88f80af000 tx=0x7f88f80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71cb20 0x55ff4b71cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71d440 0x55ff4b6d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d3290 0x55ff4b6d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b5bab60 con 0x55ff4b6d3290 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b521c70 con 0x55ff4b71d440 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ff4b4c7ed0 con 0x55ff4b71cb20 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8911600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d3290 0x55ff4b6d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8910c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71cb20 0x55ff4b71cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8911600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d3290 0x55ff4b6d3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36590/0 (socket says 172.21.15.144:36590) 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8911600640 1 -- 172.21.15.144:0/1344629141 learned_addr learned my addr 172.21.15.144:0/1344629141 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f890be00640 1 --2- 172.21.15.144:0/1344629141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71d440 0x55ff4b6d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8911600640 1 -- 172.21.15.144:0/1344629141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71cb20 msgr2=0x55ff4b71cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8911600640 1 --2- 172.21.15.144:0/1344629141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71cb20 0x55ff4b71cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8911600640 1 -- 172.21.15.144:0/1344629141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71d440 msgr2=0x55ff4b6d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:26.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8911600640 1 --2- 172.21.15.144:0/1344629141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71d440 0x55ff4b6d2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8911600640 1 -- 172.21.15.144:0/1344629141 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4b4d9e50 con 0x55ff4b6d3290 2024-09-12T12:24:26.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8911600640 1 --2- 172.21.15.144:0/1344629141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d3290 0x55ff4b6d3670 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f89040072e0 tx=0x7f89040077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc51a55b773b116e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8901600640 1 -- 172.21.15.144:0/1344629141 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904019070 con 0x55ff4b6d3290 2024-09-12T12:24:26.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8901600640 1 -- 172.21.15.144:0/1344629141 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8904004d80 con 0x55ff4b6d3290 2024-09-12T12:24:26.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8901600640 1 -- 172.21.15.144:0/1344629141 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904001e60 con 0x55ff4b6d3290 2024-09-12T12:24:26.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 -- 172.21.15.144:0/1344629141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d3290 msgr2=0x55ff4b6d3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 --2- 172.21.15.144:0/1344629141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d3290 0x55ff4b6d3670 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f89040072e0 tx=0x7f89040077a0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 -- 172.21.15.144:0/1344629141 shutdown_connections 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 --2- 172.21.15.144:0/1344629141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d3290 0x55ff4b6d3670 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 --2- 172.21.15.144:0/1344629141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71d440 0x55ff4b6d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 --2- 172.21.15.144:0/1344629141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71cb20 0x55ff4b71cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 -- 172.21.15.144:0/1344629141 >> 172.21.15.144:0/1344629141 conn(0x55ff4b6d9600 msgr2=0x55ff4b6d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 -- 172.21.15.144:0/1344629141 shutdown_connections 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.752+0000 7f8916a66000 1 -- 172.21.15.144:0/1344629141 wait complete. 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 -- start start 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 Processor -- start 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b71cb20 0x55ff4b6d7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 0x55ff4b6ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b6d8330 0x55ff4b6de230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b583b00 con 0x55ff4b71cb20 2024-09-12T12:24:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b4fc360 con 0x55ff4b6d8330 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ff4b4f92d0 con 0x55ff4b71d440 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 10 client.0 _ll_register_callbacks cb 0x55ff4b6be820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8910c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b71cb20 0x55ff4b6d7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8910c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b71cb20 0x55ff4b6d7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36606/0 (socket says 172.21.15.144:36606) 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8910c00640 1 -- 172.21.15.144:0/62059081 learned_addr learned my addr 172.21.15.144:0/62059081 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f890be00640 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 0x55ff4b6ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8911600640 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b6d8330 0x55ff4b6de230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8910c00640 1 -- 172.21.15.144:0/62059081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 msgr2=0x55ff4b6ddcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8910c00640 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 0x55ff4b6ddcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8910c00640 1 -- 172.21.15.144:0/62059081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b6d8330 msgr2=0x55ff4b6de230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8910c00640 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b6d8330 0x55ff4b6de230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8910c00640 1 -- 172.21.15.144:0/62059081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff4b4c8120 con 0x55ff4b71cb20 2024-09-12T12:24:26.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8911600640 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b6d8330 0x55ff4b6de230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8910c00640 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b71cb20 0x55ff4b6d7df0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00c390 tx=0x7f88fc055c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09f28e35ff1b328 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f88f6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f88f6000640 1 -- 172.21.15.144:0/62059081 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc06d1d0 con 0x55ff4b71cb20 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f88f6000640 1 -- 172.21.15.144:0/62059081 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f88fc06d370 con 0x55ff4b71cb20 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 -- 172.21.15.144:0/62059081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8904004d80 con 0x55ff4b71cb20 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f88f6000640 1 -- 172.21.15.144:0/62059081 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f88fc083050 con 0x55ff4b71cb20 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 10 client.9945 fetch_fsmap learned FSMap version 136 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 -- 172.21.15.144:0/62059081 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55ff4b4c1450 con 0x55ff4b71cb20 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f88f6000640 1 -- 172.21.15.144:0/62059081 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8904004d80 con 0x55ff4b71cb20 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f88f6000640 1 -- 172.21.15.144:0/62059081 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7f88fc054880 con 0x55ff4b71cb20 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 10 client.9945 fetch_fsmap finished waiting for FSMap version 136 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 10 client.9945 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:24:26.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 20 client.9945 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:26.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x55ff4b72b280 0x55ff4b72d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 4 client.9945 mds_command: new command op to 9795 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:24:26.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f8916a66000 1 -- 172.21.15.144:0/62059081 --> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff4b4bbc00 con 0x55ff4b72b280 2024-09-12T12:24:26.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f890be00640 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x55ff4b72b280 0x55ff4b72d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f890be00640 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x55ff4b72b280 0x55ff4b72d670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0e2376ce3c38f23 server_cookie=e4307645c28b7cca in_seq=0 out_seq=0 2024-09-12T12:24:26.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.756+0000 7f88f6000640 10 client.9945 ms_handle_connect on v2:172.21.15.144:6836/249899092 2024-09-12T12:24:26.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f88f6000640 1 -- 172.21.15.144:0/62059081 <== mds.0 v2:172.21.15.144:6836/249899092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff4b4bbc00 con 0x55ff4b72b280 2024-09-12T12:24:26.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f88f6000640 10 client.9945 handle_command_reply: tid=0 2024-09-12T12:24:26.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 client.9945 shutdown 2024-09-12T12:24:26.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 -- 172.21.15.144:0/62059081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b71cb20 msgr2=0x55ff4b6d7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b71cb20 0x55ff4b6d7df0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00c390 tx=0x7f88fc055c70 comp rx=0 tx=0).stop 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 -- 172.21.15.144:0/62059081 shutdown_connections 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x55ff4b72b280 0x55ff4b72d670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b6d8330 0x55ff4b6de230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 0x55ff4b6ddcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f88f6000640 0 client.9945 ms_handle_reset on v2:172.21.15.144:6836/249899092 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 --2- 172.21.15.144:0/62059081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b71cb20 0x55ff4b6d7df0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 -- 172.21.15.144:0/62059081 >> 172.21.15.144:0/62059081 conn(0x55ff4b6d3290 msgr2=0x55ff4b6d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 -- 172.21.15.144:0/62059081 shutdown_connections 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 1 -- 172.21.15.144:0/62059081 wait complete. 2024-09-12T12:24:26.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.760+0000 7f8916a66000 20 client.9945 trim_cache size 0 max 16384 2024-09-12T12:24:26.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.776+0000 7f8916a66000 1 Processor -- start 2024-09-12T12:24:26.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.776+0000 7f8916a66000 1 -- start start 2024-09-12T12:24:26.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b71bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71cb20 0x55ff4b71c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71d440 0x55ff4b72d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f890c202ed0 con 0x55ff4b6d8330 2024-09-12T12:24:26.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f890c1f7db0 con 0x55ff4b71d440 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f890c1f83d0 con 0x55ff4b71cb20 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b71bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b71bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36616/0 (socket says 172.21.15.144:36616) 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 -- 172.21.15.144:0/2348670158 learned_addr learned my addr 172.21.15.144:0/2348670158 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 -- 172.21.15.144:0/2348670158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71cb20 msgr2=0x55ff4b71c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 --2- 172.21.15.144:0/2348670158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71cb20 0x55ff4b71c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 -- 172.21.15.144:0/2348670158 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71d440 msgr2=0x55ff4b72d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 --2- 172.21.15.144:0/2348670158 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71d440 0x55ff4b72d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 -- 172.21.15.144:0/2348670158 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4b4a8fd0 con 0x55ff4b6d8330 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 --2- 172.21.15.144:0/2348670158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b71bc90 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f88fc05dae0 tx=0x7f88fc059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cfcaf64aef3812 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8900c00640 1 -- 172.21.15.144:0/2348670158 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc071070 con 0x55ff4b6d8330 2024-09-12T12:24:26.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8900c00640 1 -- 172.21.15.144:0/2348670158 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc005480 con 0x55ff4b6d8330 2024-09-12T12:24:26.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8900c00640 1 -- 172.21.15.144:0/2348670158 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc051aa0 con 0x55ff4b6d8330 2024-09-12T12:24:26.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- 172.21.15.144:0/2348670158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 msgr2=0x55ff4b71bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- 172.21.15.144:0/2348670158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b71bc90 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f88fc05dae0 tx=0x7f88fc059000 comp rx=0 tx=0).stop 2024-09-12T12:24:26.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- 172.21.15.144:0/2348670158 shutdown_connections 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- 172.21.15.144:0/2348670158 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71d440 0x55ff4b72d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- 172.21.15.144:0/2348670158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71cb20 0x55ff4b71c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- 172.21.15.144:0/2348670158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b71bc90 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- 172.21.15.144:0/2348670158 >> 172.21.15.144:0/2348670158 conn(0x55ff4b6d3290 msgr2=0x55ff4b6d75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- 172.21.15.144:0/2348670158 shutdown_connections 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- 172.21.15.144:0/2348670158 wait complete. 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- start start 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 Processor -- start 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b730590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71cb20 0x55ff4b74b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 0x55ff4b74bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b520f80 con 0x55ff4b6d8330 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ff4b4d9ca0 con 0x55ff4b71cb20 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ff4b5262a0 con 0x55ff4b71d440 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8916a66000 10 client.0 _ll_register_callbacks cb 0x7f88fc0011b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b730590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b730590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36624/0 (socket says 172.21.15.144:36624) 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.780+0000 7f8910c00640 1 -- 172.21.15.144:0/4100397494 learned_addr learned my addr 172.21.15.144:0/4100397494 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8911600640 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 0x55ff4b74bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f890be00640 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71cb20 0x55ff4b74b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8910c00640 1 -- 172.21.15.144:0/4100397494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 msgr2=0x55ff4b74bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8910c00640 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 0x55ff4b74bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8910c00640 1 -- 172.21.15.144:0/4100397494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71cb20 msgr2=0x55ff4b74b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:26.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8910c00640 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71cb20 0x55ff4b74b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8910c00640 1 -- 172.21.15.144:0/4100397494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff4b5a4750 con 0x55ff4b6d8330 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8910c00640 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b730590 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f88fc05dae0 tx=0x7f88fc0833f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05b042aed73a575 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 1 -- 172.21.15.144:0/4100397494 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc071070 con 0x55ff4b6d8330 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 1 -- 172.21.15.144:0/4100397494 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f88fc051180 con 0x55ff4b6d8330 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 -- 172.21.15.144:0/4100397494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88fc005480 con 0x55ff4b6d8330 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 1 -- 172.21.15.144:0/4100397494 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) ==== 24+0+0 (secure 0 0 0) 0x7f88fc07b050 con 0x55ff4b6d8330 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 10 client.9951 fetch_fsmap learned FSMap version 136 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 -- 172.21.15.144:0/4100397494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) -- 0x55ff4b4afa30 con 0x55ff4b6d8330 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 1 -- 172.21.15.144:0/4100397494 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc005480 con 0x55ff4b6d8330 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 1 -- 172.21.15.144:0/4100397494 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 136) ==== 3502+0+0 (secure 0 0 0) 0x7f88fc0542f0 con 0x55ff4b6d8330 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 10 client.9951 fetch_fsmap finished waiting for FSMap version 136 2024-09-12T12:24:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 10 client.9951 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 20 client.9951 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x55ff4b74c3e0 0x55ff4b78ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 4 client.9951 mds_command: new command op to 9795 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 -- 172.21.15.144:0/4100397494 --> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] -- command(tid 0: {"prefix": "status"}) -- 0x55ff4b52f3a0 con 0x55ff4b74c3e0 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f890be00640 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x55ff4b74c3e0 0x55ff4b78ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 10 client.9951 ms_handle_connect on v2:172.21.15.144:6836/249899092 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f890be00640 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x55ff4b74c3e0 0x55ff4b78ff80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=346f66a4a9ba9222 server_cookie=9ff79a2971783c20 in_seq=0 out_seq=0 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 1 -- 172.21.15.144:0/4100397494 <== mds.0 v2:172.21.15.144:6836/249899092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55ff4b52f3a0 con 0x55ff4b74c3e0 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 10 client.9951 handle_command_reply: tid=0 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 client.9951 shutdown 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 -- 172.21.15.144:0/4100397494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 msgr2=0x55ff4b730590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b730590 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f88fc05dae0 tx=0x7f88fc0833f0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 -- 172.21.15.144:0/4100397494 shutdown_connections 2024-09-12T12:24:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x55ff4b74c3e0 0x55ff4b78ff80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff4b71d440 0x55ff4b74bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff4b71cb20 0x55ff4b74b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f88f6000640 0 client.9951 ms_handle_reset on v2:172.21.15.144:6836/249899092 2024-09-12T12:24:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 --2- 172.21.15.144:0/4100397494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff4b6d8330 0x55ff4b730590 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 -- 172.21.15.144:0/4100397494 >> 172.21.15.144:0/4100397494 conn(0x55ff4b6d3290 msgr2=0x55ff4b71ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 -- 172.21.15.144:0/4100397494 shutdown_connections 2024-09-12T12:24:26.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 1 -- 172.21.15.144:0/4100397494 wait complete. 2024-09-12T12:24:26.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8916a66000 20 client.9951 trim_cache size 0 max 16384 2024-09-12T12:24:26.790 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:24:26.790 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:24:26.790 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:24:26.790 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 9795, 2024-09-12T12:24:26.790 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:24:26.791 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:24:26.791 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:24:26.791 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 10.404032240999999, 2024-09-12T12:24:26.791 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 136, 2024-09-12T12:24:26.791 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 176, 2024-09-12T12:24:26.791 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 176, 2024-09-12T12:24:26.791 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 15.286278712 2024-09-12T12:24:26.791 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:24:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 -- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ec0678c0 msgr2=0x7f88ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ec0678c0 0x7f88ec069d80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f88f80af000 tx=0x7f88f80a7000 comp rx=0 tx=0).stop 2024-09-12T12:24:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 -- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 msgr2=0x7f890c156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 0x7f890c156c30 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00c3c0 tx=0x7f88fc00c880 comp rx=0 tx=0).stop 2024-09-12T12:24:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 -- 172.21.15.144:0/3391776926 shutdown_connections 2024-09-12T12:24:26.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f88ec0678c0 0x7f88ec069d80 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f890c15b4e0 0x7f890c0af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f890c0ccf30 0x7f890c15d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 --2- 172.21.15.144:0/3391776926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f890c071420 0x7f890c156c30 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 -- 172.21.15.144:0/3391776926 >> 172.21.15.144:0/3391776926 conn(0x7f890c06d0d0 msgr2=0x7f890c157af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 -- 172.21.15.144:0/3391776926 shutdown_connections 2024-09-12T12:24:26.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.784+0000 7f8913600640 1 -- 172.21.15.144:0/3391776926 wait complete. 2024-09-12T12:24:26.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:24:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83dca00640 1 Processor -- start 2024-09-12T12:24:26.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83dca00640 1 -- start start 2024-09-12T12:24:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83dca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f83d815cd30 0x7f83d80b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83dca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f83d80b5de0 0x7f83d8072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83dca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d80b61e0 con 0x7f83d815c7b0 2024-09-12T12:24:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83dca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f83d8072a50 con 0x7f83d80b5de0 2024-09-12T12:24:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83dca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f83d80cde30 con 0x7f83d815cd30 2024-09-12T12:24:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83d5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f83d815c7b0 0x7f83d80ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53118/0 (socket says 172.21.15.144:53118) 2024-09-12T12:24:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83d5e00640 1 -- 172.21.15.144:0/3495288656 learned_addr learned my addr 172.21.15.144:0/3495288656 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.940+0000 7f83d6800640 1 --2- 172.21.15.144:0/3495288656 >> v2:172.21.15.144:3300/0 conn(0x7f83d80b5de0 0x7f83d8072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d5400640 1 --2- 172.21.15.144:0/3495288656 >> v2:172.21.15.165:3300/0 conn(0x7f83d815cd30 0x7f83d80b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d4a00640 1 -- 172.21.15.144:0/3495288656 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641919595 0 0) 0x7f83d80b61e0 con 0x7f83d815c7b0 2024-09-12T12:24:26.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d4a00640 1 -- 172.21.15.144:0/3495288656 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83bc003530 con 0x7f83d815c7b0 2024-09-12T12:24:26.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d6800640 1 -- 172.21.15.144:0/3495288656 >> v2:172.21.15.165:3300/0 conn(0x7f83d815cd30 msgr2=0x7f83d80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:26.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d6800640 1 --2- 172.21.15.144:0/3495288656 >> v2:172.21.15.165:3300/0 conn(0x7f83d815cd30 0x7f83d80b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d6800640 1 -- 172.21.15.144:0/3495288656 >> v1:172.21.15.144:6789/0 conn(0x7f83d815c7b0 legacy=0x7f83d80ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d6800640 1 -- 172.21.15.144:0/3495288656 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d80cd870 con 0x7f83d80b5de0 2024-09-12T12:24:26.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d6800640 1 --2- 172.21.15.144:0/3495288656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 0x7f83d8072ee0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f83d80afd90 tx=0x7f83d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f04f75ee242b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d4a00640 1 -- 172.21.15.144:0/3495288656 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d00b0070 con 0x7f83d80b5de0 2024-09-12T12:24:26.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d4a00640 1 -- 172.21.15.144:0/3495288656 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d00ab600 con 0x7f83d80b5de0 2024-09-12T12:24:26.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.944+0000 7f83d4a00640 1 -- 172.21.15.144:0/3495288656 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d00ab9b0 con 0x7f83d80b5de0 2024-09-12T12:24:26.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 -- 172.21.15.144:0/3495288656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 msgr2=0x7f83d8072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 --2- 172.21.15.144:0/3495288656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 0x7f83d8072ee0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f83d80afd90 tx=0x7f83d001c480 comp rx=0 tx=0).stop 2024-09-12T12:24:26.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 -- 172.21.15.144:0/3495288656 shutdown_connections 2024-09-12T12:24:26.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 --2- 172.21.15.144:0/3495288656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 0x7f83d8072ee0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 --2- 172.21.15.144:0/3495288656 >> v2:172.21.15.165:3300/0 conn(0x7f83d815cd30 0x7f83d80b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 -- 172.21.15.144:0/3495288656 >> 172.21.15.144:0/3495288656 conn(0x7f83d806d0d0 msgr2=0x7f83d806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:26.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 -- 172.21.15.144:0/3495288656 shutdown_connections 2024-09-12T12:24:26.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 -- 172.21.15.144:0/3495288656 wait complete. 2024-09-12T12:24:26.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 Processor -- start 2024-09-12T12:24:26.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 -- start start 2024-09-12T12:24:26.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 0x7f83d814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83d815c7b0 0x7f83d80b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83d815cd30 0x7f83d8153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8073fc0 con 0x7f83d80b5de0 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8073e40 con 0x7f83d815c7b0 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83dca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f83d8074140 con 0x7f83d815cd30 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 0x7f83d814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 0x7f83d814e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36656/0 (socket says 172.21.15.144:36656) 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d5e00640 1 -- 172.21.15.144:0/3190824013 learned_addr learned my addr 172.21.15.144:0/3190824013 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d5400640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83d815c7b0 0x7f83d80b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d6800640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83d815cd30 0x7f83d8153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d5e00640 1 -- 172.21.15.144:0/3190824013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83d815cd30 msgr2=0x7f83d8153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d5e00640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83d815cd30 0x7f83d8153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d5e00640 1 -- 172.21.15.144:0/3190824013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83d815c7b0 msgr2=0x7f83d80b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d5e00640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83d815c7b0 0x7f83d80b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d5e00640 1 -- 172.21.15.144:0/3190824013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d80b06c0 con 0x7f83d80b5de0 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.948+0000 7f83d6800640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83d815cd30 0x7f83d8153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83d5e00640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 0x7f83d814e0f0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f83c800cb40 tx=0x7f83c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83ce000640 1 -- 172.21.15.144:0/3190824013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8017070 con 0x7f83d80b5de0 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83ce000640 1 -- 172.21.15.144:0/3190824013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c800aca0 con 0x7f83d80b5de0 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d80b0980 con 0x7f83d80b5de0 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83ce000640 1 -- 172.21.15.144:0/3190824013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8012620 con 0x7f83d80b5de0 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d80b0f40 con 0x7f83d80b5de0 2024-09-12T12:24:26.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d8072ee0 con 0x7f83d80b5de0 2024-09-12T12:24:26.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83ce000640 1 -- 172.21.15.144:0/3190824013 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83c801a070 con 0x7f83d80b5de0 2024-09-12T12:24:26.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83ce000640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83b80678f0 0x7f83b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:26.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83ce000640 1 -- 172.21.15.144:0/3190824013 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 6101+0+0 (secure 0 0 0) 0x7f83c8085c20 con 0x7f83d80b5de0 2024-09-12T12:24:26.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.952+0000 7f83d5400640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83b80678f0 0x7f83b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:26.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.956+0000 7f83d5400640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83b80678f0 0x7f83b8069db0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f83d80cf880 tx=0x7f83c4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:26.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:26.956+0000 7f83ce000640 1 -- 172.21.15.144:0/3190824013 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83c8055ee0 con 0x7f83d80b5de0 2024-09-12T12:24:27.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.144+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f83d80aeba0 con 0x7f83d80b5de0 2024-09-12T12:24:27.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83ce000640 1 -- 172.21.15.144:0/3190824013 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v136) ==== 53+0+73 (secure 0 0 0) 0x7f83c805a1e0 con 0x7f83d80b5de0 2024-09-12T12:24:27.147 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:24:27.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83b80678f0 msgr2=0x7f83b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:27.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83b80678f0 0x7f83b8069db0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f83d80cf880 tx=0x7f83c4009190 comp rx=0 tx=0).stop 2024-09-12T12:24:27.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 msgr2=0x7f83d814e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:27.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 0x7f83d814e0f0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f83c800cb40 tx=0x7f83c800a060 comp rx=0 tx=0).stop 2024-09-12T12:24:27.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 shutdown_connections 2024-09-12T12:24:27.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f83b80678f0 0x7f83b8069db0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83d815cd30 0x7f83d8153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83d815c7b0 0x7f83d80b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 --2- 172.21.15.144:0/3190824013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83d80b5de0 0x7f83d814e0f0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:27.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 >> 172.21.15.144:0/3190824013 conn(0x7f83d806d0d0 msgr2=0x7f83d80af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:27.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 shutdown_connections 2024-09-12T12:24:27.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27.148+0000 7f83dca00640 1 -- 172.21.15.144:0/3190824013 wait complete. 2024-09-12T12:24:27.168 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:24:27.168 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:24:27.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:24:27.168 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:24:27.168 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:24:27.168 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:24:27.168 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:24:27.168 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:24:27.168 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:24:27.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:27.169 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:27.178 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41716sec preferred_lft 41716sec 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:27.179 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:24:27.180 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:24:27.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:27.182 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:24:27.239 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:24:27.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:27.242 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:24:27.302 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:24:27.302 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:24:27.302 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:24:27.302 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:24:27.302 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:24:27.302 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:24:27.302 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:24:27.302 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:24:27.303 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:24:27.303 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:24:27.303 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:24:27.303 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:24:27.303 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:27.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:24:27.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:24:27.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:24:27.303 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:27.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:24:27.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:27.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:27.440 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:24:27.448 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:24:27.449 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:24:27.449 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:24:27.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:27.449 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:24:27.514 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:24:27.514 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:24:27.566 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:24:27.566 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:24:27.566 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:24:27.617 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:24:27.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:27.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:24:27.706 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:24:27.706 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:24:27.719 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:24:27.719 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:24:27.719 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:24:27.719 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:24:27.719 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:24:27.723 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:24:27.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:27.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:24:27.743 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:24:27.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:27.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:27.848 INFO:teuthology.orchestra.run.smithi144.stdout:client9403 2024-09-12T12:24:27.848 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:24:27.848 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:27.898 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:27.898 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:27.898 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.0 2024-09-12T12:24:27.898 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:27.898 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:27.898 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:27.898 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:27.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:28.020 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.020 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.020 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015969 s, 65.7 MB/s 2024-09-12T12:24:28.038 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.038 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.038 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156837 s, 66.9 MB/s 2024-09-12T12:24:28.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.056 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.056 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153079 s, 68.5 MB/s 2024-09-12T12:24:28.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.072 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131564 s, 79.7 MB/s 2024-09-12T12:24:28.089 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.089 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.089 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143251 s, 73.2 MB/s 2024-09-12T12:24:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.106 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014982 s, 70.0 MB/s 2024-09-12T12:24:28.125 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.125 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.125 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156422 s, 67.0 MB/s 2024-09-12T12:24:28.141 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.141 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.141 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014032 s, 74.7 MB/s 2024-09-12T12:24:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.158 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013746 s, 76.3 MB/s 2024-09-12T12:24:28.175 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.175 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.175 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143988 s, 72.8 MB/s 2024-09-12T12:24:28.191 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.191 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.191 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013674 s, 76.7 MB/s 2024-09-12T12:24:28.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.210 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158532 s, 66.1 MB/s 2024-09-12T12:24:28.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.228 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.228 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155464 s, 67.4 MB/s 2024-09-12T12:24:28.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.244 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.244 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138133 s, 75.9 MB/s 2024-09-12T12:24:28.260 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.261 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.261 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136599 s, 76.8 MB/s 2024-09-12T12:24:28.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.279 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.279 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016085 s, 65.2 MB/s 2024-09-12T12:24:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.302 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194128 s, 54.0 MB/s 2024-09-12T12:24:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.318 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141876 s, 73.9 MB/s 2024-09-12T12:24:28.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.336 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.336 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015072 s, 69.6 MB/s 2024-09-12T12:24:28.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.354 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.355 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159584 s, 65.7 MB/s 2024-09-12T12:24:28.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.373 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.373 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154844 s, 67.7 MB/s 2024-09-12T12:24:28.391 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.391 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.391 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161876 s, 64.8 MB/s 2024-09-12T12:24:28.408 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.408 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.408 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01424 s, 73.6 MB/s 2024-09-12T12:24:28.423 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.423 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.423 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125265 s, 83.7 MB/s 2024-09-12T12:24:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.438 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122494 s, 85.6 MB/s 2024-09-12T12:24:28.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.454 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.454 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129406 s, 81.0 MB/s 2024-09-12T12:24:28.471 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.471 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.471 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148392 s, 70.7 MB/s 2024-09-12T12:24:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.489 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139531 s, 75.2 MB/s 2024-09-12T12:24:28.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.505 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014868 s, 70.5 MB/s 2024-09-12T12:24:28.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.521 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.521 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130203 s, 80.5 MB/s 2024-09-12T12:24:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.537 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138007 s, 76.0 MB/s 2024-09-12T12:24:28.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.553 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129944 s, 80.7 MB/s 2024-09-12T12:24:28.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:28.560 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:28.560 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:28.561 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.1 2024-09-12T12:24:28.561 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:28.561 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:28.561 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:28.561 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:28.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:28.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.627 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125721 s, 83.4 MB/s 2024-09-12T12:24:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.644 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014729 s, 71.2 MB/s 2024-09-12T12:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142047 s, 73.8 MB/s 2024-09-12T12:24:28.676 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.676 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.676 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125257 s, 83.7 MB/s 2024-09-12T12:24:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.693 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126926 s, 82.6 MB/s 2024-09-12T12:24:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.707 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139129 s, 75.4 MB/s 2024-09-12T12:24:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.723 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131271 s, 79.9 MB/s 2024-09-12T12:24:28.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.739 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131267 s, 79.9 MB/s 2024-09-12T12:24:28.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131214 s, 79.9 MB/s 2024-09-12T12:24:28.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.770 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129992 s, 80.7 MB/s 2024-09-12T12:24:28.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.787 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142893 s, 73.4 MB/s 2024-09-12T12:24:28.802 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.803 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.803 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132599 s, 79.1 MB/s 2024-09-12T12:24:28.818 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.818 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.818 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130232 s, 80.5 MB/s 2024-09-12T12:24:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141048 s, 74.3 MB/s 2024-09-12T12:24:28.850 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.850 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.850 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127502 s, 82.2 MB/s 2024-09-12T12:24:28.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.868 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140284 s, 74.7 MB/s 2024-09-12T12:24:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012922 s, 81.1 MB/s 2024-09-12T12:24:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.902 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165197 s, 63.5 MB/s 2024-09-12T12:24:28.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.918 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129783 s, 80.8 MB/s 2024-09-12T12:24:28.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.933 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133467 s, 78.6 MB/s 2024-09-12T12:24:28.949 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.949 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.950 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137725 s, 76.1 MB/s 2024-09-12T12:24:28.965 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:28.965 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:28.965 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133191 s, 78.7 MB/s 2024-09-12T12:24:29.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.299 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.299 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.330812 s, 3.2 MB/s 2024-09-12T12:24:29.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.319 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.320 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017557 s, 59.7 MB/s 2024-09-12T12:24:29.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.337 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.337 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148714 s, 70.5 MB/s 2024-09-12T12:24:29.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.355 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154895 s, 67.7 MB/s 2024-09-12T12:24:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131272 s, 79.9 MB/s 2024-09-12T12:24:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140784 s, 74.5 MB/s 2024-09-12T12:24:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129558 s, 80.9 MB/s 2024-09-12T12:24:29.419 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.419 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.419 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131601 s, 79.7 MB/s 2024-09-12T12:24:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137024 s, 76.5 MB/s 2024-09-12T12:24:29.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.452 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.452 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133804 s, 78.4 MB/s 2024-09-12T12:24:29.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:29.459 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:29.460 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:29.460 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.2 2024-09-12T12:24:29.460 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:29.460 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:29.460 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:29.460 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:29.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118585 s, 88.4 MB/s 2024-09-12T12:24:29.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.540 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123788 s, 84.7 MB/s 2024-09-12T12:24:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013425 s, 78.1 MB/s 2024-09-12T12:24:29.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.572 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136041 s, 77.1 MB/s 2024-09-12T12:24:29.589 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.590 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.590 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014317 s, 73.2 MB/s 2024-09-12T12:24:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135818 s, 77.2 MB/s 2024-09-12T12:24:29.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132086 s, 79.4 MB/s 2024-09-12T12:24:29.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.643 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183778 s, 57.1 MB/s 2024-09-12T12:24:29.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.660 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146506 s, 71.6 MB/s 2024-09-12T12:24:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144969 s, 72.3 MB/s 2024-09-12T12:24:29.693 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.693 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.693 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136031 s, 77.1 MB/s 2024-09-12T12:24:29.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.707 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.707 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011714 s, 89.5 MB/s 2024-09-12T12:24:29.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.723 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130804 s, 80.2 MB/s 2024-09-12T12:24:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.739 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132296 s, 79.3 MB/s 2024-09-12T12:24:29.758 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.758 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.758 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159996 s, 65.5 MB/s 2024-09-12T12:24:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147624 s, 71.0 MB/s 2024-09-12T12:24:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134467 s, 78.0 MB/s 2024-09-12T12:24:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.811 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169276 s, 61.9 MB/s 2024-09-12T12:24:29.828 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.828 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.828 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145035 s, 72.3 MB/s 2024-09-12T12:24:29.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127468 s, 82.3 MB/s 2024-09-12T12:24:29.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.859 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135147 s, 77.6 MB/s 2024-09-12T12:24:29.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.878 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155211 s, 67.6 MB/s 2024-09-12T12:24:29.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.894 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137774 s, 76.1 MB/s 2024-09-12T12:24:29.909 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130174 s, 80.6 MB/s 2024-09-12T12:24:29.928 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.929 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164176 s, 63.9 MB/s 2024-09-12T12:24:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137258 s, 76.4 MB/s 2024-09-12T12:24:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.961 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013201 s, 79.4 MB/s 2024-09-12T12:24:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134786 s, 77.8 MB/s 2024-09-12T12:24:29.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:29.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:29.993 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133108 s, 78.8 MB/s 2024-09-12T12:24:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.009 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137556 s, 76.2 MB/s 2024-09-12T12:24:30.026 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.027 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147416 s, 71.1 MB/s 2024-09-12T12:24:30.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.042 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.042 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129183 s, 81.2 MB/s 2024-09-12T12:24:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:30.050 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:30.050 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:30.050 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.3 2024-09-12T12:24:30.050 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:30.050 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:30.050 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:30.050 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:30.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:30.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.116 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.116 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128603 s, 81.5 MB/s 2024-09-12T12:24:30.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121641 s, 86.2 MB/s 2024-09-12T12:24:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.148 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151407 s, 69.3 MB/s 2024-09-12T12:24:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136564 s, 76.8 MB/s 2024-09-12T12:24:30.180 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.180 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.181 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128591 s, 81.5 MB/s 2024-09-12T12:24:30.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.198 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.198 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146188 s, 71.7 MB/s 2024-09-12T12:24:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.213 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129218 s, 81.1 MB/s 2024-09-12T12:24:30.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.232 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.232 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157898 s, 66.4 MB/s 2024-09-12T12:24:30.247 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.247 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.247 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129843 s, 80.8 MB/s 2024-09-12T12:24:30.264 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.264 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.264 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144155 s, 72.7 MB/s 2024-09-12T12:24:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.280 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135527 s, 77.4 MB/s 2024-09-12T12:24:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.298 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151178 s, 69.4 MB/s 2024-09-12T12:24:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.314 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136426 s, 76.9 MB/s 2024-09-12T12:24:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.331 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134714 s, 77.8 MB/s 2024-09-12T12:24:30.346 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.346 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.346 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131567 s, 79.7 MB/s 2024-09-12T12:24:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129343 s, 81.1 MB/s 2024-09-12T12:24:30.377 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128919 s, 81.3 MB/s 2024-09-12T12:24:30.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.395 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014405 s, 72.8 MB/s 2024-09-12T12:24:30.415 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.415 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.415 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172567 s, 60.8 MB/s 2024-09-12T12:24:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.431 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138061 s, 76.0 MB/s 2024-09-12T12:24:30.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.446 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128576 s, 81.6 MB/s 2024-09-12T12:24:30.464 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.464 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.464 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147133 s, 71.3 MB/s 2024-09-12T12:24:30.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.480 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.480 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130382 s, 80.4 MB/s 2024-09-12T12:24:30.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.496 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130844 s, 80.1 MB/s 2024-09-12T12:24:30.511 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.511 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.511 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130534 s, 80.3 MB/s 2024-09-12T12:24:30.527 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.527 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.527 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130656 s, 80.3 MB/s 2024-09-12T12:24:30.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.544 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136966 s, 76.6 MB/s 2024-09-12T12:24:30.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132184 s, 79.3 MB/s 2024-09-12T12:24:30.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.577 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.577 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149608 s, 70.1 MB/s 2024-09-12T12:24:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133645 s, 78.5 MB/s 2024-09-12T12:24:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.607 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117872 s, 89.0 MB/s 2024-09-12T12:24:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139614 s, 75.1 MB/s 2024-09-12T12:24:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:30.631 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:30.632 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:30.632 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.4 2024-09-12T12:24:30.632 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:30.632 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:30.632 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:30.632 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:30.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:30.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.745 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146967 s, 71.3 MB/s 2024-09-12T12:24:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.761 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137882 s, 76.0 MB/s 2024-09-12T12:24:30.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.778 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144501 s, 72.6 MB/s 2024-09-12T12:24:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124441 s, 84.3 MB/s 2024-09-12T12:24:30.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.809 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134856 s, 77.8 MB/s 2024-09-12T12:24:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.826 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136178 s, 77.0 MB/s 2024-09-12T12:24:30.841 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.842 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135465 s, 77.4 MB/s 2024-09-12T12:24:30.861 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.861 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.861 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168884 s, 62.1 MB/s 2024-09-12T12:24:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013198 s, 79.4 MB/s 2024-09-12T12:24:30.892 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.892 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.892 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129901 s, 80.7 MB/s 2024-09-12T12:24:30.908 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.909 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.909 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136928 s, 76.6 MB/s 2024-09-12T12:24:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.926 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014542 s, 72.1 MB/s 2024-09-12T12:24:30.943 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.943 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.943 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143313 s, 73.2 MB/s 2024-09-12T12:24:30.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.959 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.959 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135223 s, 77.5 MB/s 2024-09-12T12:24:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.976 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143733 s, 73.0 MB/s 2024-09-12T12:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134906 s, 77.7 MB/s 2024-09-12T12:24:31.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.009 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143042 s, 73.3 MB/s 2024-09-12T12:24:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.024 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127902 s, 82.0 MB/s 2024-09-12T12:24:31.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.040 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.040 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128194 s, 81.8 MB/s 2024-09-12T12:24:31.055 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.055 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.055 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129352 s, 81.1 MB/s 2024-09-12T12:24:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.072 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134999 s, 77.7 MB/s 2024-09-12T12:24:31.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.090 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.090 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158993 s, 66.0 MB/s 2024-09-12T12:24:31.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.106 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.106 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130933 s, 80.1 MB/s 2024-09-12T12:24:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.123 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144178 s, 72.7 MB/s 2024-09-12T12:24:31.140 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.141 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.141 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013461 s, 77.9 MB/s 2024-09-12T12:24:31.155 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.156 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140099 s, 74.8 MB/s 2024-09-12T12:24:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.171 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01305 s, 80.4 MB/s 2024-09-12T12:24:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132851 s, 78.9 MB/s 2024-09-12T12:24:31.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.203 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013112 s, 80.0 MB/s 2024-09-12T12:24:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.220 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147593 s, 71.0 MB/s 2024-09-12T12:24:31.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147893 s, 70.9 MB/s 2024-09-12T12:24:31.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.254 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138078 s, 75.9 MB/s 2024-09-12T12:24:31.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:31.261 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:31.262 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:31.262 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.5 2024-09-12T12:24:31.262 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:31.262 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:31.262 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:31.262 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:31.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.332 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167459 s, 62.6 MB/s 2024-09-12T12:24:31.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141634 s, 74.0 MB/s 2024-09-12T12:24:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.364 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129676 s, 80.9 MB/s 2024-09-12T12:24:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.380 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130542 s, 80.3 MB/s 2024-09-12T12:24:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170025 s, 61.7 MB/s 2024-09-12T12:24:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.417 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147763 s, 71.0 MB/s 2024-09-12T12:24:31.437 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.437 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.437 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172094 s, 60.9 MB/s 2024-09-12T12:24:31.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.453 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133243 s, 78.7 MB/s 2024-09-12T12:24:31.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.470 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141496 s, 74.1 MB/s 2024-09-12T12:24:31.485 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.486 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134653 s, 77.9 MB/s 2024-09-12T12:24:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.501 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.502 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133697 s, 78.4 MB/s 2024-09-12T12:24:31.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.520 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159801 s, 65.6 MB/s 2024-09-12T12:24:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139656 s, 75.1 MB/s 2024-09-12T12:24:31.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151667 s, 69.1 MB/s 2024-09-12T12:24:31.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.572 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.572 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132925 s, 78.9 MB/s 2024-09-12T12:24:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.588 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013254 s, 79.1 MB/s 2024-09-12T12:24:31.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.605 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137185 s, 76.4 MB/s 2024-09-12T12:24:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.621 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131043 s, 80.0 MB/s 2024-09-12T12:24:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140812 s, 74.5 MB/s 2024-09-12T12:24:31.654 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.654 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.654 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142346 s, 73.7 MB/s 2024-09-12T12:24:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132926 s, 78.9 MB/s 2024-09-12T12:24:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144629 s, 72.5 MB/s 2024-09-12T12:24:31.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.701 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114108 s, 91.9 MB/s 2024-09-12T12:24:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110501 s, 94.9 MB/s 2024-09-12T12:24:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.735 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126596 s, 82.8 MB/s 2024-09-12T12:24:31.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.745 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132377 s, 79.2 MB/s 2024-09-12T12:24:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162658 s, 64.5 MB/s 2024-09-12T12:24:31.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.780 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132552 s, 79.1 MB/s 2024-09-12T12:24:31.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.795 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115293 s, 90.9 MB/s 2024-09-12T12:24:31.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.811 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145734 s, 72.0 MB/s 2024-09-12T12:24:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131109 s, 80.0 MB/s 2024-09-12T12:24:31.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133624 s, 78.5 MB/s 2024-09-12T12:24:31.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:31.850 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:31.851 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:31.851 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.6 2024-09-12T12:24:31.851 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:31.851 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:31.851 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:31.851 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:31.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:31.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.964 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134974 s, 77.7 MB/s 2024-09-12T12:24:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.983 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168505 s, 62.2 MB/s 2024-09-12T12:24:31.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:31.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:31.999 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131673 s, 79.6 MB/s 2024-09-12T12:24:32.019 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.019 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.019 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173291 s, 60.5 MB/s 2024-09-12T12:24:32.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.034 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.035 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132034 s, 79.4 MB/s 2024-09-12T12:24:32.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.048 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112167 s, 93.5 MB/s 2024-09-12T12:24:32.063 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.064 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.064 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128527 s, 81.6 MB/s 2024-09-12T12:24:32.079 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.079 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.079 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125463 s, 83.6 MB/s 2024-09-12T12:24:32.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.095 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134877 s, 77.7 MB/s 2024-09-12T12:24:32.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.111 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133521 s, 78.5 MB/s 2024-09-12T12:24:32.126 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.127 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131031 s, 80.0 MB/s 2024-09-12T12:24:32.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.145 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161182 s, 65.1 MB/s 2024-09-12T12:24:32.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.165 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.165 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013583 s, 77.2 MB/s 2024-09-12T12:24:32.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.179 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146388 s, 71.6 MB/s 2024-09-12T12:24:32.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.195 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133696 s, 78.4 MB/s 2024-09-12T12:24:32.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.211 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137544 s, 76.2 MB/s 2024-09-12T12:24:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.227 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134231 s, 78.1 MB/s 2024-09-12T12:24:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.243 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132279 s, 79.3 MB/s 2024-09-12T12:24:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013858 s, 75.7 MB/s 2024-09-12T12:24:32.277 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.277 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.277 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143697 s, 73.0 MB/s 2024-09-12T12:24:32.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.293 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.293 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131901 s, 79.5 MB/s 2024-09-12T12:24:32.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.309 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129529 s, 81.0 MB/s 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.325 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.326 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132941 s, 78.9 MB/s 2024-09-12T12:24:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131847 s, 79.5 MB/s 2024-09-12T12:24:32.358 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.358 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.358 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013137 s, 79.8 MB/s 2024-09-12T12:24:32.375 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.376 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146963 s, 71.3 MB/s 2024-09-12T12:24:32.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.395 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158165 s, 66.3 MB/s 2024-09-12T12:24:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.413 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154496 s, 67.9 MB/s 2024-09-12T12:24:32.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.429 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130629 s, 80.3 MB/s 2024-09-12T12:24:32.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.448 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161611 s, 64.9 MB/s 2024-09-12T12:24:32.463 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.463 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.463 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133377 s, 78.6 MB/s 2024-09-12T12:24:32.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.479 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.479 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130361 s, 80.4 MB/s 2024-09-12T12:24:32.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:32.486 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:32.487 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:32.487 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.7 2024-09-12T12:24:32.487 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:32.487 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:32.487 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:32.487 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:32.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.554 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144197 s, 72.7 MB/s 2024-09-12T12:24:32.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.573 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014392 s, 72.9 MB/s 2024-09-12T12:24:32.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.586 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.586 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130642 s, 80.3 MB/s 2024-09-12T12:24:32.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.599 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.599 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105724 s, 99.2 MB/s 2024-09-12T12:24:32.613 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.613 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.613 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116794 s, 89.8 MB/s 2024-09-12T12:24:32.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.631 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153584 s, 68.3 MB/s 2024-09-12T12:24:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.647 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133802 s, 78.4 MB/s 2024-09-12T12:24:32.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.663 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131859 s, 79.5 MB/s 2024-09-12T12:24:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.679 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013871 s, 75.6 MB/s 2024-09-12T12:24:32.695 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.695 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.695 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128493 s, 81.6 MB/s 2024-09-12T12:24:32.710 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.710 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.710 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130395 s, 80.4 MB/s 2024-09-12T12:24:32.726 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.726 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.726 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129713 s, 80.8 MB/s 2024-09-12T12:24:32.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.743 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144937 s, 72.3 MB/s 2024-09-12T12:24:32.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.759 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130391 s, 80.4 MB/s 2024-09-12T12:24:32.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.775 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134727 s, 77.8 MB/s 2024-09-12T12:24:32.794 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.794 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.794 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164892 s, 63.6 MB/s 2024-09-12T12:24:32.811 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.812 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150664 s, 69.6 MB/s 2024-09-12T12:24:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.827 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130193 s, 80.5 MB/s 2024-09-12T12:24:32.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.844 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137599 s, 76.2 MB/s 2024-09-12T12:24:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013313 s, 78.8 MB/s 2024-09-12T12:24:32.876 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.877 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.877 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146178 s, 71.7 MB/s 2024-09-12T12:24:32.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.893 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.893 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134526 s, 77.9 MB/s 2024-09-12T12:24:32.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145445 s, 72.1 MB/s 2024-09-12T12:24:32.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.929 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165303 s, 63.4 MB/s 2024-09-12T12:24:32.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.945 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131408 s, 79.8 MB/s 2024-09-12T12:24:32.960 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.961 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127192 s, 82.4 MB/s 2024-09-12T12:24:32.976 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.977 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134166 s, 78.2 MB/s 2024-09-12T12:24:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136209 s, 77.0 MB/s 2024-09-12T12:24:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.009 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137131 s, 76.5 MB/s 2024-09-12T12:24:33.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.027 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015483 s, 67.7 MB/s 2024-09-12T12:24:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132104 s, 79.4 MB/s 2024-09-12T12:24:33.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.062 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016159 s, 64.9 MB/s 2024-09-12T12:24:33.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:33.070 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:33.070 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:33.070 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.8 2024-09-12T12:24:33.070 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:33.070 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:33.070 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:33.070 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:33.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:33.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.184 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170639 s, 61.4 MB/s 2024-09-12T12:24:33.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.200 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135599 s, 77.3 MB/s 2024-09-12T12:24:33.215 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.216 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.216 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133239 s, 78.7 MB/s 2024-09-12T12:24:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.233 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149874 s, 70.0 MB/s 2024-09-12T12:24:33.247 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.247 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.247 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115265 s, 91.0 MB/s 2024-09-12T12:24:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141993 s, 73.8 MB/s 2024-09-12T12:24:33.280 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.280 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.280 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139082 s, 75.4 MB/s 2024-09-12T12:24:33.296 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.296 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.297 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136056 s, 77.1 MB/s 2024-09-12T12:24:33.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.313 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.313 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135981 s, 77.1 MB/s 2024-09-12T12:24:33.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.328 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129344 s, 81.1 MB/s 2024-09-12T12:24:33.346 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.346 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.346 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147454 s, 71.1 MB/s 2024-09-12T12:24:33.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.362 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134973 s, 77.7 MB/s 2024-09-12T12:24:33.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.380 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153283 s, 68.4 MB/s 2024-09-12T12:24:33.396 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.396 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.396 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136088 s, 77.1 MB/s 2024-09-12T12:24:33.412 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.413 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138241 s, 75.9 MB/s 2024-09-12T12:24:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139571 s, 75.1 MB/s 2024-09-12T12:24:33.445 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.445 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.445 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128645 s, 81.5 MB/s 2024-09-12T12:24:33.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.460 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.460 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130215 s, 80.5 MB/s 2024-09-12T12:24:33.477 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.478 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.478 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146792 s, 71.4 MB/s 2024-09-12T12:24:33.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.495 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.495 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145412 s, 72.1 MB/s 2024-09-12T12:24:33.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.509 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118786 s, 88.3 MB/s 2024-09-12T12:24:33.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.525 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133503 s, 78.5 MB/s 2024-09-12T12:24:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.541 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129109 s, 81.2 MB/s 2024-09-12T12:24:33.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.557 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.557 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136136 s, 77.0 MB/s 2024-09-12T12:24:33.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.573 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132109 s, 79.4 MB/s 2024-09-12T12:24:33.589 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.589 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.589 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135968 s, 77.1 MB/s 2024-09-12T12:24:33.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.606 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141814 s, 73.9 MB/s 2024-09-12T12:24:33.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.621 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125874 s, 83.3 MB/s 2024-09-12T12:24:33.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126057 s, 83.2 MB/s 2024-09-12T12:24:33.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.653 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137766 s, 76.1 MB/s 2024-09-12T12:24:33.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169188 s, 62.0 MB/s 2024-09-12T12:24:33.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.689 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.689 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140341 s, 74.7 MB/s 2024-09-12T12:24:33.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:33.696 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:33.696 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:33.696 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.9 2024-09-12T12:24:33.697 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:33.697 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:33.697 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:33.697 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:33.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.807 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129788 s, 80.8 MB/s 2024-09-12T12:24:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.824 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148706 s, 70.5 MB/s 2024-09-12T12:24:33.840 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.840 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.840 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132772 s, 79.0 MB/s 2024-09-12T12:24:33.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.856 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.856 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129318 s, 81.1 MB/s 2024-09-12T12:24:33.873 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.873 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.873 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146506 s, 71.6 MB/s 2024-09-12T12:24:33.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.890 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.890 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144733 s, 72.4 MB/s 2024-09-12T12:24:33.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.907 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.907 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147118 s, 71.3 MB/s 2024-09-12T12:24:33.924 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.924 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.924 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140977 s, 74.4 MB/s 2024-09-12T12:24:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145768 s, 71.9 MB/s 2024-09-12T12:24:33.958 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.958 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.958 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144073 s, 72.8 MB/s 2024-09-12T12:24:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127831 s, 82.0 MB/s 2024-09-12T12:24:33.991 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:33.991 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:33.991 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141839 s, 73.9 MB/s 2024-09-12T12:24:34.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.008 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.009 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146555 s, 71.5 MB/s 2024-09-12T12:24:34.025 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.025 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.025 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135607 s, 77.3 MB/s 2024-09-12T12:24:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.041 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128566 s, 81.6 MB/s 2024-09-12T12:24:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.062 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174288 s, 60.2 MB/s 2024-09-12T12:24:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139481 s, 75.2 MB/s 2024-09-12T12:24:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.094 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131438 s, 79.8 MB/s 2024-09-12T12:24:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.111 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134255 s, 78.1 MB/s 2024-09-12T12:24:34.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.128 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137953 s, 76.0 MB/s 2024-09-12T12:24:34.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.144 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130306 s, 80.5 MB/s 2024-09-12T12:24:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152552 s, 68.7 MB/s 2024-09-12T12:24:34.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.178 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.179 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130678 s, 80.2 MB/s 2024-09-12T12:24:34.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.195 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.195 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132203 s, 79.3 MB/s 2024-09-12T12:24:34.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.211 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134613 s, 77.9 MB/s 2024-09-12T12:24:34.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.231 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.231 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168543 s, 62.2 MB/s 2024-09-12T12:24:34.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.249 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149803 s, 70.0 MB/s 2024-09-12T12:24:34.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.270 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.270 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167629 s, 62.6 MB/s 2024-09-12T12:24:34.286 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.286 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.286 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144975 s, 72.3 MB/s 2024-09-12T12:24:34.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.304 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.304 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145554 s, 72.0 MB/s 2024-09-12T12:24:34.322 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.322 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.322 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146958 s, 71.4 MB/s 2024-09-12T12:24:34.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.339 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137052 s, 76.5 MB/s 2024-09-12T12:24:34.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:34.346 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:34.346 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:34.346 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.10 2024-09-12T12:24:34.346 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:34.346 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:34.346 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:34.346 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:34.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130182 s, 80.5 MB/s 2024-09-12T12:24:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130323 s, 80.5 MB/s 2024-09-12T12:24:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146033 s, 71.8 MB/s 2024-09-12T12:24:34.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.508 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.508 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152342 s, 68.8 MB/s 2024-09-12T12:24:34.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.525 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.526 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144543 s, 72.5 MB/s 2024-09-12T12:24:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131239 s, 79.9 MB/s 2024-09-12T12:24:34.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.560 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153527 s, 68.3 MB/s 2024-09-12T12:24:34.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.575 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132819 s, 78.9 MB/s 2024-09-12T12:24:34.591 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.591 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.591 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133496 s, 78.5 MB/s 2024-09-12T12:24:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.606 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126948 s, 82.6 MB/s 2024-09-12T12:24:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.622 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132511 s, 79.1 MB/s 2024-09-12T12:24:34.638 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.639 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.639 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136037 s, 77.1 MB/s 2024-09-12T12:24:34.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.659 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174547 s, 60.1 MB/s 2024-09-12T12:24:34.675 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.675 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.675 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136008 s, 77.1 MB/s 2024-09-12T12:24:34.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.692 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144174 s, 72.7 MB/s 2024-09-12T12:24:34.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.708 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132623 s, 79.1 MB/s 2024-09-12T12:24:34.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.723 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129517 s, 81.0 MB/s 2024-09-12T12:24:34.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.739 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130319 s, 80.5 MB/s 2024-09-12T12:24:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.755 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131022 s, 80.0 MB/s 2024-09-12T12:24:34.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.776 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174561 s, 60.1 MB/s 2024-09-12T12:24:34.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.793 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146253 s, 71.7 MB/s 2024-09-12T12:24:34.810 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.810 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.811 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144608 s, 72.5 MB/s 2024-09-12T12:24:34.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.826 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133973 s, 78.3 MB/s 2024-09-12T12:24:34.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.846 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.846 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169374 s, 61.9 MB/s 2024-09-12T12:24:34.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.862 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131597 s, 79.7 MB/s 2024-09-12T12:24:34.878 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.878 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.878 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138984 s, 75.4 MB/s 2024-09-12T12:24:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.894 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133118 s, 78.8 MB/s 2024-09-12T12:24:34.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137085 s, 76.5 MB/s 2024-09-12T12:24:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.926 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132177 s, 79.3 MB/s 2024-09-12T12:24:34.941 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.942 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.942 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128901 s, 81.3 MB/s 2024-09-12T12:24:34.957 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.957 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.957 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127473 s, 82.3 MB/s 2024-09-12T12:24:34.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:34.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:34.973 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131603 s, 79.7 MB/s 2024-09-12T12:24:34.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:34.980 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:34.980 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:34.980 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.11 2024-09-12T12:24:34.980 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:34.980 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:34.980 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:34.980 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:35.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:35.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.088 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134979 s, 77.7 MB/s 2024-09-12T12:24:35.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.108 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168181 s, 62.3 MB/s 2024-09-12T12:24:35.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.123 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.123 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131255 s, 79.9 MB/s 2024-09-12T12:24:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.139 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130075 s, 80.6 MB/s 2024-09-12T12:24:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138385 s, 75.8 MB/s 2024-09-12T12:24:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133615 s, 78.5 MB/s 2024-09-12T12:24:35.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129266 s, 81.1 MB/s 2024-09-12T12:24:35.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.203 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.203 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130533 s, 80.3 MB/s 2024-09-12T12:24:35.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.219 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131465 s, 79.8 MB/s 2024-09-12T12:24:35.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.234 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123124 s, 85.2 MB/s 2024-09-12T12:24:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139166 s, 75.3 MB/s 2024-09-12T12:24:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.271 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179044 s, 58.6 MB/s 2024-09-12T12:24:35.288 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.289 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149685 s, 70.1 MB/s 2024-09-12T12:24:35.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.305 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.306 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142738 s, 73.5 MB/s 2024-09-12T12:24:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.323 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147183 s, 71.2 MB/s 2024-09-12T12:24:35.338 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.339 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.339 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130274 s, 80.5 MB/s 2024-09-12T12:24:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134392 s, 78.0 MB/s 2024-09-12T12:24:35.372 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.372 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.372 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143906 s, 72.9 MB/s 2024-09-12T12:24:35.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.389 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.389 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138395 s, 75.8 MB/s 2024-09-12T12:24:35.406 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.406 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.407 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149777 s, 70.0 MB/s 2024-09-12T12:24:35.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.424 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144272 s, 72.7 MB/s 2024-09-12T12:24:35.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.441 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.441 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141656 s, 74.0 MB/s 2024-09-12T12:24:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133948 s, 78.3 MB/s 2024-09-12T12:24:35.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.473 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.473 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134164 s, 78.2 MB/s 2024-09-12T12:24:35.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.490 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.490 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147094 s, 71.3 MB/s 2024-09-12T12:24:35.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.505 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123367 s, 85.0 MB/s 2024-09-12T12:24:35.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.523 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144464 s, 72.6 MB/s 2024-09-12T12:24:35.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.540 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145922 s, 71.9 MB/s 2024-09-12T12:24:35.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.556 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138556 s, 75.7 MB/s 2024-09-12T12:24:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.573 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143958 s, 72.8 MB/s 2024-09-12T12:24:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.590 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141519 s, 74.1 MB/s 2024-09-12T12:24:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132502 s, 79.1 MB/s 2024-09-12T12:24:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:35.613 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:35.613 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:35.613 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.12 2024-09-12T12:24:35.613 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:35.613 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:35.613 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:35.613 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:35.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:35.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131667 s, 79.6 MB/s 2024-09-12T12:24:35.697 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.697 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.697 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148602 s, 70.6 MB/s 2024-09-12T12:24:35.713 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.713 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.713 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013109 s, 80.0 MB/s 2024-09-12T12:24:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129646 s, 80.9 MB/s 2024-09-12T12:24:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.745 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137419 s, 76.3 MB/s 2024-09-12T12:24:35.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.761 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134768 s, 77.8 MB/s 2024-09-12T12:24:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.777 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134368 s, 78.0 MB/s 2024-09-12T12:24:35.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128144 s, 81.8 MB/s 2024-09-12T12:24:35.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.808 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124953 s, 83.9 MB/s 2024-09-12T12:24:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128164 s, 81.8 MB/s 2024-09-12T12:24:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.840 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129533 s, 81.0 MB/s 2024-09-12T12:24:35.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.854 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.854 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127298 s, 82.4 MB/s 2024-09-12T12:24:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.873 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.874 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135577 s, 77.3 MB/s 2024-09-12T12:24:35.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.886 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.886 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125951 s, 83.3 MB/s 2024-09-12T12:24:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.903 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138122 s, 75.9 MB/s 2024-09-12T12:24:35.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.918 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.918 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013218 s, 79.3 MB/s 2024-09-12T12:24:35.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.933 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126053 s, 83.2 MB/s 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.948 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125654 s, 83.4 MB/s 2024-09-12T12:24:35.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.964 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.964 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013033 s, 80.5 MB/s 2024-09-12T12:24:35.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.981 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.981 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134425 s, 78.0 MB/s 2024-09-12T12:24:35.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:35.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:35.997 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136484 s, 76.8 MB/s 2024-09-12T12:24:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.013 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137098 s, 76.5 MB/s 2024-09-12T12:24:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130192 s, 80.5 MB/s 2024-09-12T12:24:36.044 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.044 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.044 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126626 s, 82.8 MB/s 2024-09-12T12:24:36.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.061 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137939 s, 76.0 MB/s 2024-09-12T12:24:36.077 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141831 s, 73.9 MB/s 2024-09-12T12:24:36.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.096 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131001 s, 80.0 MB/s 2024-09-12T12:24:36.109 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.109 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.109 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129341 s, 81.1 MB/s 2024-09-12T12:24:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135513 s, 77.4 MB/s 2024-09-12T12:24:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.145 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171553 s, 61.1 MB/s 2024-09-12T12:24:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.161 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134291 s, 78.1 MB/s 2024-09-12T12:24:36.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.177 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013011 s, 80.6 MB/s 2024-09-12T12:24:36.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:36.184 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:36.184 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:36.184 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.13 2024-09-12T12:24:36.184 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:36.184 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:36.184 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:36.184 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:36.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:36.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.252 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142659 s, 73.5 MB/s 2024-09-12T12:24:36.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.269 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146911 s, 71.4 MB/s 2024-09-12T12:24:36.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131325 s, 79.8 MB/s 2024-09-12T12:24:36.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.302 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.303 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152579 s, 68.7 MB/s 2024-09-12T12:24:36.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.317 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125915 s, 83.3 MB/s 2024-09-12T12:24:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.334 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138764 s, 75.6 MB/s 2024-09-12T12:24:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.352 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152524 s, 68.7 MB/s 2024-09-12T12:24:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.369 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140521 s, 74.6 MB/s 2024-09-12T12:24:36.386 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.386 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.386 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149629 s, 70.1 MB/s 2024-09-12T12:24:36.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113326 s, 92.5 MB/s 2024-09-12T12:24:36.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.417 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134143 s, 78.2 MB/s 2024-09-12T12:24:36.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.433 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138035 s, 76.0 MB/s 2024-09-12T12:24:36.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.453 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144018 s, 72.8 MB/s 2024-09-12T12:24:36.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.466 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.466 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136575 s, 76.8 MB/s 2024-09-12T12:24:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.482 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128573 s, 81.6 MB/s 2024-09-12T12:24:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.497 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128505 s, 81.6 MB/s 2024-09-12T12:24:36.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.523 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226847 s, 46.2 MB/s 2024-09-12T12:24:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019378 s, 54.1 MB/s 2024-09-12T12:24:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.562 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144407 s, 72.6 MB/s 2024-09-12T12:24:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.578 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.579 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132371 s, 79.2 MB/s 2024-09-12T12:24:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138413 s, 75.8 MB/s 2024-09-12T12:24:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152001 s, 69.0 MB/s 2024-09-12T12:24:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.630 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140649 s, 74.6 MB/s 2024-09-12T12:24:36.646 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.646 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.646 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133115 s, 78.8 MB/s 2024-09-12T12:24:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013487 s, 77.7 MB/s 2024-09-12T12:24:36.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.679 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.679 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01451 s, 72.3 MB/s 2024-09-12T12:24:36.695 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.695 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.695 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133724 s, 78.4 MB/s 2024-09-12T12:24:36.711 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.711 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.711 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01304 s, 80.4 MB/s 2024-09-12T12:24:36.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.728 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.729 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147172 s, 71.2 MB/s 2024-09-12T12:24:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.744 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132996 s, 78.8 MB/s 2024-09-12T12:24:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.761 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147425 s, 71.1 MB/s 2024-09-12T12:24:36.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.777 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.777 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133126 s, 78.8 MB/s 2024-09-12T12:24:36.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:36.785 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:36.785 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:36.785 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.14 2024-09-12T12:24:36.786 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:36.786 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:36.786 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:36.786 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:36.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:36.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.853 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129767 s, 80.8 MB/s 2024-09-12T12:24:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135788 s, 77.2 MB/s 2024-09-12T12:24:36.886 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.886 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.886 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140944 s, 74.4 MB/s 2024-09-12T12:24:36.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.902 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.902 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135021 s, 77.7 MB/s 2024-09-12T12:24:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.917 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128994 s, 81.3 MB/s 2024-09-12T12:24:36.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.934 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137581 s, 76.2 MB/s 2024-09-12T12:24:36.950 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.950 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.950 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137533 s, 76.2 MB/s 2024-09-12T12:24:36.965 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.966 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129899 s, 80.7 MB/s 2024-09-12T12:24:36.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:36.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:36.982 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139828 s, 75.0 MB/s 2024-09-12T12:24:37.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.001 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016634 s, 63.0 MB/s 2024-09-12T12:24:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.016 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.017 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126482 s, 82.9 MB/s 2024-09-12T12:24:37.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.032 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013101 s, 80.0 MB/s 2024-09-12T12:24:37.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135327 s, 77.5 MB/s 2024-09-12T12:24:37.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.069 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.069 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138988 s, 75.4 MB/s 2024-09-12T12:24:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.081 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132005 s, 79.4 MB/s 2024-09-12T12:24:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.099 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153873 s, 68.1 MB/s 2024-09-12T12:24:37.118 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.118 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.118 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169359 s, 61.9 MB/s 2024-09-12T12:24:37.138 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.138 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.138 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168724 s, 62.1 MB/s 2024-09-12T12:24:37.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.154 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133142 s, 78.8 MB/s 2024-09-12T12:24:37.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.171 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.171 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143205 s, 73.2 MB/s 2024-09-12T12:24:37.186 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.186 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132377 s, 79.2 MB/s 2024-09-12T12:24:37.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.202 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.202 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131962 s, 79.5 MB/s 2024-09-12T12:24:37.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.222 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.222 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168583 s, 62.2 MB/s 2024-09-12T12:24:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146381 s, 71.6 MB/s 2024-09-12T12:24:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127297 s, 82.4 MB/s 2024-09-12T12:24:37.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.273 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.273 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146041 s, 71.8 MB/s 2024-09-12T12:24:37.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.289 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.289 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145676 s, 72.0 MB/s 2024-09-12T12:24:37.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.309 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173809 s, 60.3 MB/s 2024-09-12T12:24:37.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.324 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012764 s, 82.2 MB/s 2024-09-12T12:24:37.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.341 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.341 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144124 s, 72.8 MB/s 2024-09-12T12:24:37.358 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.358 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.358 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140059 s, 74.9 MB/s 2024-09-12T12:24:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174798 s, 60.0 MB/s 2024-09-12T12:24:37.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:37.386 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:37.386 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:37.386 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.15 2024-09-12T12:24:37.386 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:37.386 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:37.386 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:37.386 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:37.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:37.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.497 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135087 s, 77.6 MB/s 2024-09-12T12:24:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.515 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160276 s, 65.4 MB/s 2024-09-12T12:24:37.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.532 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.532 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141694 s, 74.0 MB/s 2024-09-12T12:24:37.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.549 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.549 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145616 s, 72.0 MB/s 2024-09-12T12:24:37.566 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.566 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.566 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146135 s, 71.8 MB/s 2024-09-12T12:24:37.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.584 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154728 s, 67.8 MB/s 2024-09-12T12:24:37.600 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.601 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.601 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136267 s, 76.9 MB/s 2024-09-12T12:24:37.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.616 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.616 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01294 s, 81.0 MB/s 2024-09-12T12:24:37.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.634 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147962 s, 70.9 MB/s 2024-09-12T12:24:37.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.650 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140365 s, 74.7 MB/s 2024-09-12T12:24:37.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.667 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.667 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141789 s, 74.0 MB/s 2024-09-12T12:24:37.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.683 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.683 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133722 s, 78.4 MB/s 2024-09-12T12:24:37.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.699 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130065 s, 80.6 MB/s 2024-09-12T12:24:37.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.715 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135349 s, 77.5 MB/s 2024-09-12T12:24:37.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.734 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169129 s, 62.0 MB/s 2024-09-12T12:24:37.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.750 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.750 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128053 s, 81.9 MB/s 2024-09-12T12:24:37.765 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.765 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.765 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127572 s, 82.2 MB/s 2024-09-12T12:24:37.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.780 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.780 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125235 s, 83.7 MB/s 2024-09-12T12:24:37.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.796 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.796 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135626 s, 77.3 MB/s 2024-09-12T12:24:37.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.813 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.813 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134579 s, 77.9 MB/s 2024-09-12T12:24:37.828 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.828 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.828 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131561 s, 79.7 MB/s 2024-09-12T12:24:37.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.845 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.845 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143977 s, 72.8 MB/s 2024-09-12T12:24:37.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.862 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.862 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137388 s, 76.3 MB/s 2024-09-12T12:24:37.882 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.882 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.882 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017658 s, 59.4 MB/s 2024-09-12T12:24:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.898 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.898 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131567 s, 79.7 MB/s 2024-09-12T12:24:37.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.913 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012987 s, 80.7 MB/s 2024-09-12T12:24:37.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.931 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.931 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145421 s, 72.1 MB/s 2024-09-12T12:24:37.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.946 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012975 s, 80.8 MB/s 2024-09-12T12:24:37.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.961 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127458 s, 82.3 MB/s 2024-09-12T12:24:37.979 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.979 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.980 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154994 s, 67.7 MB/s 2024-09-12T12:24:37.995 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:37.995 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:37.995 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013009 s, 80.6 MB/s 2024-09-12T12:24:38.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.013 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.013 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147219 s, 71.2 MB/s 2024-09-12T12:24:38.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:38.020 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:38.020 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:38.020 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.16 2024-09-12T12:24:38.020 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:38.020 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:38.020 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:38.020 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:38.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:38.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.084 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108699 s, 96.5 MB/s 2024-09-12T12:24:38.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.102 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.102 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155156 s, 67.6 MB/s 2024-09-12T12:24:38.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.117 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129618 s, 80.9 MB/s 2024-09-12T12:24:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132026 s, 79.4 MB/s 2024-09-12T12:24:38.152 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.152 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.152 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165336 s, 63.4 MB/s 2024-09-12T12:24:38.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.168 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.168 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131684 s, 79.6 MB/s 2024-09-12T12:24:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.184 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134593 s, 77.9 MB/s 2024-09-12T12:24:38.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.201 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.201 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140529 s, 74.6 MB/s 2024-09-12T12:24:38.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.218 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.219 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151552 s, 69.2 MB/s 2024-09-12T12:24:38.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.234 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.234 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130544 s, 80.3 MB/s 2024-09-12T12:24:38.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.251 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.251 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143457 s, 73.1 MB/s 2024-09-12T12:24:38.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.268 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.269 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145525 s, 72.1 MB/s 2024-09-12T12:24:38.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131193 s, 79.9 MB/s 2024-09-12T12:24:38.300 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138275 s, 75.8 MB/s 2024-09-12T12:24:38.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.317 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131831 s, 79.5 MB/s 2024-09-12T12:24:38.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.332 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127236 s, 82.4 MB/s 2024-09-12T12:24:38.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137697 s, 76.2 MB/s 2024-09-12T12:24:38.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.368 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172515 s, 60.8 MB/s 2024-09-12T12:24:38.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.384 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132962 s, 78.9 MB/s 2024-09-12T12:24:38.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.401 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137419 s, 76.3 MB/s 2024-09-12T12:24:38.420 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171599 s, 61.1 MB/s 2024-09-12T12:24:38.436 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.436 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.436 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130173 s, 80.6 MB/s 2024-09-12T12:24:38.452 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.452 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.452 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131878 s, 79.5 MB/s 2024-09-12T12:24:38.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.469 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014078 s, 74.5 MB/s 2024-09-12T12:24:38.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.486 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.486 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145211 s, 72.2 MB/s 2024-09-12T12:24:38.501 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.502 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.502 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131436 s, 79.8 MB/s 2024-09-12T12:24:38.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.518 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.518 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137154 s, 76.5 MB/s 2024-09-12T12:24:38.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.535 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145278 s, 72.2 MB/s 2024-09-12T12:24:38.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.551 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138093 s, 75.9 MB/s 2024-09-12T12:24:38.567 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.567 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.568 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013399 s, 78.3 MB/s 2024-09-12T12:24:38.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.585 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149094 s, 70.3 MB/s 2024-09-12T12:24:38.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.605 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169805 s, 61.8 MB/s 2024-09-12T12:24:38.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:38.612 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:38.612 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:38.612 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.17 2024-09-12T12:24:38.612 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:38.612 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:38.612 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:38.613 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:38.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:38.680 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.680 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.680 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149556 s, 70.1 MB/s 2024-09-12T12:24:38.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.700 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.700 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168645 s, 62.2 MB/s 2024-09-12T12:24:38.714 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.714 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.714 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118286 s, 88.6 MB/s 2024-09-12T12:24:38.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.734 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.734 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169853 s, 61.7 MB/s 2024-09-12T12:24:38.750 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.750 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.750 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140427 s, 74.7 MB/s 2024-09-12T12:24:38.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.766 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.766 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135723 s, 77.3 MB/s 2024-09-12T12:24:38.781 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.782 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.782 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125515 s, 83.5 MB/s 2024-09-12T12:24:38.797 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.798 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.798 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013364 s, 78.5 MB/s 2024-09-12T12:24:38.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.817 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.817 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169423 s, 61.9 MB/s 2024-09-12T12:24:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.834 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138222 s, 75.9 MB/s 2024-09-12T12:24:38.851 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.852 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150626 s, 69.6 MB/s 2024-09-12T12:24:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.867 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132867 s, 78.9 MB/s 2024-09-12T12:24:38.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.883 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.883 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129552 s, 80.9 MB/s 2024-09-12T12:24:38.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.900 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014491 s, 72.4 MB/s 2024-09-12T12:24:38.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.917 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.917 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146108 s, 71.8 MB/s 2024-09-12T12:24:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140712 s, 74.5 MB/s 2024-09-12T12:24:38.954 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.954 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.954 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177576 s, 59.0 MB/s 2024-09-12T12:24:38.970 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.970 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.970 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133904 s, 78.3 MB/s 2024-09-12T12:24:38.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:38.986 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:38.986 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133482 s, 78.6 MB/s 2024-09-12T12:24:39.002 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.002 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.002 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133548 s, 78.5 MB/s 2024-09-12T12:24:39.018 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.019 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.019 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013412 s, 78.2 MB/s 2024-09-12T12:24:39.037 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.037 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.037 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157265 s, 66.7 MB/s 2024-09-12T12:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131045 s, 80.0 MB/s 2024-09-12T12:24:39.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.068 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.068 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122545 s, 85.6 MB/s 2024-09-12T12:24:39.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.083 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.083 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127263 s, 82.4 MB/s 2024-09-12T12:24:39.100 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.100 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.100 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146706 s, 71.5 MB/s 2024-09-12T12:24:39.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.117 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140431 s, 74.7 MB/s 2024-09-12T12:24:39.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.133 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132947 s, 78.9 MB/s 2024-09-12T12:24:39.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.151 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.152 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158853 s, 66.0 MB/s 2024-09-12T12:24:39.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.167 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.167 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131706 s, 79.6 MB/s 2024-09-12T12:24:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013089 s, 80.1 MB/s 2024-09-12T12:24:39.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.199 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.199 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138144 s, 75.9 MB/s 2024-09-12T12:24:39.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:39.206 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:39.207 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:39.207 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.18 2024-09-12T12:24:39.207 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:39.207 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:39.207 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:39.207 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:39.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:39.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.275 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143709 s, 73.0 MB/s 2024-09-12T12:24:39.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.290 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123721 s, 84.8 MB/s 2024-09-12T12:24:39.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.308 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155124 s, 67.6 MB/s 2024-09-12T12:24:39.327 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.328 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169439 s, 61.9 MB/s 2024-09-12T12:24:39.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.345 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148292 s, 70.7 MB/s 2024-09-12T12:24:39.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.362 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143583 s, 73.0 MB/s 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01381 s, 75.9 MB/s 2024-09-12T12:24:39.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.396 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.396 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144373 s, 72.6 MB/s 2024-09-12T12:24:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.412 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134629 s, 77.9 MB/s 2024-09-12T12:24:39.428 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.428 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.428 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013329 s, 78.7 MB/s 2024-09-12T12:24:39.443 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.444 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.444 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129271 s, 81.1 MB/s 2024-09-12T12:24:39.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.459 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130255 s, 80.5 MB/s 2024-09-12T12:24:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.476 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138481 s, 75.7 MB/s 2024-09-12T12:24:39.493 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.493 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.493 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014527 s, 72.2 MB/s 2024-09-12T12:24:39.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.509 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.509 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137055 s, 76.5 MB/s 2024-09-12T12:24:39.526 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.527 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.527 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145504 s, 72.1 MB/s 2024-09-12T12:24:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.543 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135639 s, 77.3 MB/s 2024-09-12T12:24:39.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.559 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.559 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136365 s, 76.9 MB/s 2024-09-12T12:24:39.574 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129339 s, 81.1 MB/s 2024-09-12T12:24:39.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.592 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146484 s, 71.6 MB/s 2024-09-12T12:24:39.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.610 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150898 s, 69.5 MB/s 2024-09-12T12:24:39.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.626 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.626 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013328 s, 78.7 MB/s 2024-09-12T12:24:39.646 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.646 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.646 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174211 s, 60.2 MB/s 2024-09-12T12:24:39.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.661 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.662 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131424 s, 79.8 MB/s 2024-09-12T12:24:39.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.678 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.678 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135218 s, 77.5 MB/s 2024-09-12T12:24:39.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.692 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.692 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113959 s, 92.0 MB/s 2024-09-12T12:24:39.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.708 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.708 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139338 s, 75.3 MB/s 2024-09-12T12:24:39.723 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.724 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.724 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129485 s, 81.0 MB/s 2024-09-12T12:24:39.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.739 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.739 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124489 s, 84.2 MB/s 2024-09-12T12:24:39.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.755 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.755 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134622 s, 77.9 MB/s 2024-09-12T12:24:39.771 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.772 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.772 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143482 s, 73.1 MB/s 2024-09-12T12:24:39.788 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.789 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.789 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145832 s, 71.9 MB/s 2024-09-12T12:24:39.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:39.796 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:39.796 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:39.796 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.19 2024-09-12T12:24:39.796 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:39.796 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:39.796 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:39.797 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:39.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:39.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.863 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.863 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139567 s, 75.1 MB/s 2024-09-12T12:24:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.880 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145555 s, 72.0 MB/s 2024-09-12T12:24:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.900 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171697 s, 61.1 MB/s 2024-09-12T12:24:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.916 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130707 s, 80.2 MB/s 2024-09-12T12:24:39.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.933 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.933 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014567 s, 72.0 MB/s 2024-09-12T12:24:39.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.947 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.947 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116915 s, 89.7 MB/s 2024-09-12T12:24:39.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.963 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129078 s, 81.2 MB/s 2024-09-12T12:24:39.978 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.978 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.979 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130779 s, 80.2 MB/s 2024-09-12T12:24:39.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:39.996 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:39.996 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144059 s, 72.8 MB/s 2024-09-12T12:24:40.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.014 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148153 s, 70.8 MB/s 2024-09-12T12:24:40.029 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.030 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130976 s, 80.1 MB/s 2024-09-12T12:24:40.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171828 s, 61.0 MB/s 2024-09-12T12:24:40.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.065 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013216 s, 79.3 MB/s 2024-09-12T12:24:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.082 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.083 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145892 s, 71.9 MB/s 2024-09-12T12:24:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.098 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130798 s, 80.2 MB/s 2024-09-12T12:24:40.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.114 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137156 s, 76.5 MB/s 2024-09-12T12:24:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143393 s, 73.1 MB/s 2024-09-12T12:24:40.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.146 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.146 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126326 s, 83.0 MB/s 2024-09-12T12:24:40.164 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.164 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.164 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146914 s, 71.4 MB/s 2024-09-12T12:24:40.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.179 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127608 s, 82.2 MB/s 2024-09-12T12:24:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147904 s, 70.9 MB/s 2024-09-12T12:24:40.212 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.213 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132117 s, 79.4 MB/s 2024-09-12T12:24:40.232 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.233 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017118 s, 61.3 MB/s 2024-09-12T12:24:40.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.250 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138853 s, 75.5 MB/s 2024-09-12T12:24:40.264 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.265 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.265 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131735 s, 79.6 MB/s 2024-09-12T12:24:40.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.281 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.281 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138803 s, 75.5 MB/s 2024-09-12T12:24:40.300 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.300 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.300 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166323 s, 63.0 MB/s 2024-09-12T12:24:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.316 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129975 s, 80.7 MB/s 2024-09-12T12:24:40.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.332 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.333 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132002 s, 79.4 MB/s 2024-09-12T12:24:40.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136126 s, 77.0 MB/s 2024-09-12T12:24:40.363 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.364 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128285 s, 81.7 MB/s 2024-09-12T12:24:40.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.380 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.380 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139623 s, 75.1 MB/s 2024-09-12T12:24:40.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:40.388 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:40.388 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:40.388 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.20 2024-09-12T12:24:40.388 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:40.388 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:40.388 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:40.389 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:40.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:40.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.497 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133891 s, 78.3 MB/s 2024-09-12T12:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162009 s, 64.7 MB/s 2024-09-12T12:24:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115971 s, 90.4 MB/s 2024-09-12T12:24:40.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135409 s, 77.4 MB/s 2024-09-12T12:24:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.561 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127954 s, 81.9 MB/s 2024-09-12T12:24:40.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.577 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.577 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135788 s, 77.2 MB/s 2024-09-12T12:24:40.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.593 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132914 s, 78.9 MB/s 2024-09-12T12:24:40.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.611 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.611 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156315 s, 67.1 MB/s 2024-09-12T12:24:40.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144231 s, 72.7 MB/s 2024-09-12T12:24:40.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.643 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131582 s, 79.7 MB/s 2024-09-12T12:24:40.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.660 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135556 s, 77.4 MB/s 2024-09-12T12:24:40.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.677 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.677 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146305 s, 71.7 MB/s 2024-09-12T12:24:40.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.690 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.691 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110902 s, 94.5 MB/s 2024-09-12T12:24:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.706 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132362 s, 79.2 MB/s 2024-09-12T12:24:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.722 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.723 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136722 s, 76.7 MB/s 2024-09-12T12:24:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129626 s, 80.9 MB/s 2024-09-12T12:24:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131817 s, 79.5 MB/s 2024-09-12T12:24:40.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.770 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131457 s, 79.8 MB/s 2024-09-12T12:24:40.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.787 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145676 s, 72.0 MB/s 2024-09-12T12:24:40.804 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.804 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.804 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014601 s, 71.8 MB/s 2024-09-12T12:24:40.821 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.821 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.821 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138122 s, 75.9 MB/s 2024-09-12T12:24:40.837 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.837 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.837 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134358 s, 78.0 MB/s 2024-09-12T12:24:40.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.853 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.853 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132226 s, 79.3 MB/s 2024-09-12T12:24:40.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.872 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165849 s, 63.2 MB/s 2024-09-12T12:24:40.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.888 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012934 s, 81.1 MB/s 2024-09-12T12:24:40.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.904 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130728 s, 80.2 MB/s 2024-09-12T12:24:40.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.920 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.920 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014136 s, 74.2 MB/s 2024-09-12T12:24:40.936 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.936 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.937 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013463 s, 77.9 MB/s 2024-09-12T12:24:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.956 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170358 s, 61.6 MB/s 2024-09-12T12:24:40.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.973 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.973 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146522 s, 71.6 MB/s 2024-09-12T12:24:40.990 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:40.990 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:40.990 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014403 s, 72.8 MB/s 2024-09-12T12:24:41.006 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.006 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.007 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013448 s, 78.0 MB/s 2024-09-12T12:24:41.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:41.014 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:41.014 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:41.014 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.21 2024-09-12T12:24:41.014 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:41.014 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:41.014 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:41.014 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:41.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133233 s, 78.7 MB/s 2024-09-12T12:24:41.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.098 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.098 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151067 s, 69.4 MB/s 2024-09-12T12:24:41.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.114 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137245 s, 76.4 MB/s 2024-09-12T12:24:41.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145303 s, 72.2 MB/s 2024-09-12T12:24:41.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.147 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129883 s, 80.7 MB/s 2024-09-12T12:24:41.162 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.162 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.162 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130066 s, 80.6 MB/s 2024-09-12T12:24:41.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.179 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.179 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139634 s, 75.1 MB/s 2024-09-12T12:24:41.194 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.194 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.194 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128498 s, 81.6 MB/s 2024-09-12T12:24:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141413 s, 74.1 MB/s 2024-09-12T12:24:41.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.227 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.227 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132011 s, 79.4 MB/s 2024-09-12T12:24:41.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.243 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125736 s, 83.4 MB/s 2024-09-12T12:24:41.260 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.260 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.260 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150058 s, 69.9 MB/s 2024-09-12T12:24:41.276 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.277 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.277 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137821 s, 76.1 MB/s 2024-09-12T12:24:41.292 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.292 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.292 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132998 s, 78.8 MB/s 2024-09-12T12:24:41.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.309 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.309 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146154 s, 71.7 MB/s 2024-09-12T12:24:41.326 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.327 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.327 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145536 s, 72.0 MB/s 2024-09-12T12:24:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145157 s, 72.2 MB/s 2024-09-12T12:24:41.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.360 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134373 s, 78.0 MB/s 2024-09-12T12:24:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.376 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.377 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140872 s, 74.4 MB/s 2024-09-12T12:24:41.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.394 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148988 s, 70.4 MB/s 2024-09-12T12:24:41.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.410 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.410 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013472 s, 77.8 MB/s 2024-09-12T12:24:41.426 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.427 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.427 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140898 s, 74.4 MB/s 2024-09-12T12:24:41.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.442 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.442 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125977 s, 83.2 MB/s 2024-09-12T12:24:41.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.459 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.459 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142503 s, 73.6 MB/s 2024-09-12T12:24:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141558 s, 74.1 MB/s 2024-09-12T12:24:41.492 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.493 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.493 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01426 s, 73.5 MB/s 2024-09-12T12:24:41.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.512 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165164 s, 63.5 MB/s 2024-09-12T12:24:41.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.541 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259986 s, 40.3 MB/s 2024-09-12T12:24:41.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.562 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.563 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190522 s, 55.0 MB/s 2024-09-12T12:24:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.583 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165731 s, 63.3 MB/s 2024-09-12T12:24:41.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.602 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156431 s, 67.0 MB/s 2024-09-12T12:24:41.618 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.618 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.618 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135836 s, 77.2 MB/s 2024-09-12T12:24:41.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:41.626 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:41.626 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:41.626 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.22 2024-09-12T12:24:41.626 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:41.627 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:41.627 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:41.627 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:41.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.736 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.736 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133972 s, 78.3 MB/s 2024-09-12T12:24:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143675 s, 73.0 MB/s 2024-09-12T12:24:41.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.770 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.770 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137934 s, 76.0 MB/s 2024-09-12T12:24:41.786 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.787 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.787 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137189 s, 76.4 MB/s 2024-09-12T12:24:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131169 s, 79.9 MB/s 2024-09-12T12:24:41.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.819 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.819 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136978 s, 76.6 MB/s 2024-09-12T12:24:41.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.835 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.835 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138052 s, 76.0 MB/s 2024-09-12T12:24:41.851 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.852 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.852 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132881 s, 78.9 MB/s 2024-09-12T12:24:41.867 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.868 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.868 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136471 s, 76.8 MB/s 2024-09-12T12:24:41.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.885 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.885 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143048 s, 73.3 MB/s 2024-09-12T12:24:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.903 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155219 s, 67.6 MB/s 2024-09-12T12:24:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133483 s, 78.6 MB/s 2024-09-12T12:24:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135115 s, 77.6 MB/s 2024-09-12T12:24:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122052 s, 85.9 MB/s 2024-09-12T12:24:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133442 s, 78.6 MB/s 2024-09-12T12:24:41.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.982 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133247 s, 78.7 MB/s 2024-09-12T12:24:41.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:41.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:41.998 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132783 s, 79.0 MB/s 2024-09-12T12:24:42.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.015 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144186 s, 72.7 MB/s 2024-09-12T12:24:42.031 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.031 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.031 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140384 s, 74.7 MB/s 2024-09-12T12:24:42.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.048 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144712 s, 72.5 MB/s 2024-09-12T12:24:42.064 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.064 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.064 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131276 s, 79.9 MB/s 2024-09-12T12:24:42.080 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.080 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.080 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132071 s, 79.4 MB/s 2024-09-12T12:24:42.095 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131466 s, 79.8 MB/s 2024-09-12T12:24:42.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.113 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143258 s, 73.2 MB/s 2024-09-12T12:24:42.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.129 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.129 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134961 s, 77.7 MB/s 2024-09-12T12:24:42.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129029 s, 81.3 MB/s 2024-09-12T12:24:42.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.160 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131659 s, 79.6 MB/s 2024-09-12T12:24:42.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.177 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013404 s, 78.2 MB/s 2024-09-12T12:24:42.192 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.192 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.192 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129663 s, 80.9 MB/s 2024-09-12T12:24:42.208 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.208 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.208 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135852 s, 77.2 MB/s 2024-09-12T12:24:42.224 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.224 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.224 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136187 s, 77.0 MB/s 2024-09-12T12:24:42.240 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.240 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.240 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142185 s, 73.7 MB/s 2024-09-12T12:24:42.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:42.248 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:42.248 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:42.248 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.23 2024-09-12T12:24:42.248 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:42.248 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:42.248 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:42.248 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:42.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:42.314 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.314 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.314 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124947 s, 83.9 MB/s 2024-09-12T12:24:42.331 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.331 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.332 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150722 s, 69.6 MB/s 2024-09-12T12:24:42.347 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.348 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134985 s, 77.7 MB/s 2024-09-12T12:24:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175849 s, 59.6 MB/s 2024-09-12T12:24:42.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.384 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.384 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135129 s, 77.6 MB/s 2024-09-12T12:24:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132937 s, 78.9 MB/s 2024-09-12T12:24:42.417 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148659 s, 70.5 MB/s 2024-09-12T12:24:42.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.435 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145678 s, 72.0 MB/s 2024-09-12T12:24:42.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.451 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134807 s, 77.8 MB/s 2024-09-12T12:24:42.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.467 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.467 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137106 s, 76.5 MB/s 2024-09-12T12:24:42.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.487 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173265 s, 60.5 MB/s 2024-09-12T12:24:42.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.503 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131296 s, 79.9 MB/s 2024-09-12T12:24:42.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.520 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.520 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145824 s, 71.9 MB/s 2024-09-12T12:24:42.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.535 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124144 s, 84.5 MB/s 2024-09-12T12:24:42.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.553 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.553 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015023 s, 69.8 MB/s 2024-09-12T12:24:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.569 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134339 s, 78.1 MB/s 2024-09-12T12:24:42.584 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.585 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.585 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131648 s, 79.6 MB/s 2024-09-12T12:24:42.604 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.605 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.605 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174347 s, 60.1 MB/s 2024-09-12T12:24:42.620 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133909 s, 78.3 MB/s 2024-09-12T12:24:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.637 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141302 s, 74.2 MB/s 2024-09-12T12:24:42.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.653 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.653 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130029 s, 80.6 MB/s 2024-09-12T12:24:42.672 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.673 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.673 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169128 s, 62.0 MB/s 2024-09-12T12:24:42.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.688 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.688 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132254 s, 79.3 MB/s 2024-09-12T12:24:42.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.704 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.704 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134159 s, 78.2 MB/s 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.720 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129704 s, 80.8 MB/s 2024-09-12T12:24:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.737 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144481 s, 72.6 MB/s 2024-09-12T12:24:42.753 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.753 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.753 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130206 s, 80.5 MB/s 2024-09-12T12:24:42.769 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.769 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.769 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138773 s, 75.6 MB/s 2024-09-12T12:24:42.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.785 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.785 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013193 s, 79.5 MB/s 2024-09-12T12:24:42.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.801 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.801 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133364 s, 78.6 MB/s 2024-09-12T12:24:42.820 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.820 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.820 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163199 s, 64.3 MB/s 2024-09-12T12:24:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.837 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148891 s, 70.4 MB/s 2024-09-12T12:24:42.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:42.846 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:42.846 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:42.846 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.24 2024-09-12T12:24:42.846 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:42.846 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:42.846 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:42.846 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:42.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:42.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.914 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.914 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143938 s, 72.8 MB/s 2024-09-12T12:24:42.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.930 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.930 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013896 s, 75.5 MB/s 2024-09-12T12:24:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.945 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129508 s, 81.0 MB/s 2024-09-12T12:24:42.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.961 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.962 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133982 s, 78.3 MB/s 2024-09-12T12:24:42.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.977 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.977 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132519 s, 79.1 MB/s 2024-09-12T12:24:42.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:42.997 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:42.997 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169059 s, 62.0 MB/s 2024-09-12T12:24:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129925 s, 80.7 MB/s 2024-09-12T12:24:43.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.028 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.028 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128976 s, 81.3 MB/s 2024-09-12T12:24:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.045 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146799 s, 71.4 MB/s 2024-09-12T12:24:43.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.062 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.062 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134761 s, 77.8 MB/s 2024-09-12T12:24:43.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.078 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.078 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013004 s, 80.6 MB/s 2024-09-12T12:24:43.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.094 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.094 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135566 s, 77.3 MB/s 2024-09-12T12:24:43.110 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.110 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.110 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134464 s, 78.0 MB/s 2024-09-12T12:24:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.127 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.128 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146884 s, 71.4 MB/s 2024-09-12T12:24:43.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.144 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.144 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01324 s, 79.2 MB/s 2024-09-12T12:24:43.159 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.159 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.160 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127332 s, 82.3 MB/s 2024-09-12T12:24:43.175 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.176 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.176 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013081 s, 80.2 MB/s 2024-09-12T12:24:43.190 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.190 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.190 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115897 s, 90.5 MB/s 2024-09-12T12:24:43.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.210 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.210 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166479 s, 63.0 MB/s 2024-09-12T12:24:43.226 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.226 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.227 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136757 s, 76.7 MB/s 2024-09-12T12:24:43.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.243 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130208 s, 80.5 MB/s 2024-09-12T12:24:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.258 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129858 s, 80.7 MB/s 2024-09-12T12:24:43.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.275 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.275 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132288 s, 79.3 MB/s 2024-09-12T12:24:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133041 s, 78.8 MB/s 2024-09-12T12:24:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.308 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152593 s, 68.7 MB/s 2024-09-12T12:24:43.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.324 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131796 s, 79.6 MB/s 2024-09-12T12:24:43.339 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.339 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.339 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127596 s, 82.2 MB/s 2024-09-12T12:24:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.356 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139024 s, 75.4 MB/s 2024-09-12T12:24:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131508 s, 79.7 MB/s 2024-09-12T12:24:43.387 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.387 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.387 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131951 s, 79.5 MB/s 2024-09-12T12:24:43.405 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.405 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.405 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146636 s, 71.5 MB/s 2024-09-12T12:24:43.420 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.420 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.420 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129671 s, 80.9 MB/s 2024-09-12T12:24:43.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:43.428 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:43.428 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:43.428 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.25 2024-09-12T12:24:43.428 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:43.428 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:43.429 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:43.429 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:43.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.535 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116101 s, 90.3 MB/s 2024-09-12T12:24:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127958 s, 81.9 MB/s 2024-09-12T12:24:43.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.565 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.565 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116827 s, 89.8 MB/s 2024-09-12T12:24:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.581 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135515 s, 77.4 MB/s 2024-09-12T12:24:43.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.597 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.597 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130561 s, 80.3 MB/s 2024-09-12T12:24:43.614 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.614 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.614 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151192 s, 69.4 MB/s 2024-09-12T12:24:43.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.631 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134925 s, 77.7 MB/s 2024-09-12T12:24:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123576 s, 84.9 MB/s 2024-09-12T12:24:43.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.663 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.663 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148122 s, 70.8 MB/s 2024-09-12T12:24:43.680 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.681 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.681 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144284 s, 72.7 MB/s 2024-09-12T12:24:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.696 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132331 s, 79.2 MB/s 2024-09-12T12:24:43.711 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.711 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.711 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012782 s, 82.0 MB/s 2024-09-12T12:24:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132492 s, 79.1 MB/s 2024-09-12T12:24:43.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.744 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.744 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137719 s, 76.1 MB/s 2024-09-12T12:24:43.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.760 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131874 s, 79.5 MB/s 2024-09-12T12:24:43.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.778 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.778 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147332 s, 71.2 MB/s 2024-09-12T12:24:43.794 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.795 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133203 s, 78.7 MB/s 2024-09-12T12:24:43.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.812 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145323 s, 72.2 MB/s 2024-09-12T12:24:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115003 s, 91.2 MB/s 2024-09-12T12:24:43.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.843 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138026 s, 76.0 MB/s 2024-09-12T12:24:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137837 s, 76.1 MB/s 2024-09-12T12:24:43.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.876 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.876 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128613 s, 81.5 MB/s 2024-09-12T12:24:43.894 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.895 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.895 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164183 s, 63.9 MB/s 2024-09-12T12:24:43.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.910 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.910 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125843 s, 83.3 MB/s 2024-09-12T12:24:43.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.926 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.926 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131879 s, 79.5 MB/s 2024-09-12T12:24:43.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.945 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.945 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170579 s, 61.5 MB/s 2024-09-12T12:24:43.965 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.965 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.965 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168322 s, 62.3 MB/s 2024-09-12T12:24:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:43.984 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166459 s, 63.0 MB/s 2024-09-12T12:24:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.001 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145232 s, 72.2 MB/s 2024-09-12T12:24:44.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.017 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133413 s, 78.6 MB/s 2024-09-12T12:24:44.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.035 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.035 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151934 s, 69.0 MB/s 2024-09-12T12:24:44.052 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.052 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.052 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134561 s, 77.9 MB/s 2024-09-12T12:24:44.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:44.059 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:44.059 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:44.059 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.26 2024-09-12T12:24:44.059 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:44.059 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:44.059 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:44.059 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:44.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.128 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161091 s, 65.1 MB/s 2024-09-12T12:24:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.145 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142979 s, 73.3 MB/s 2024-09-12T12:24:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.160 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130072 s, 80.6 MB/s 2024-09-12T12:24:44.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.177 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.177 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013609 s, 77.0 MB/s 2024-09-12T12:24:44.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.193 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.193 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132234 s, 79.3 MB/s 2024-09-12T12:24:44.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.209 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.209 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129512 s, 81.0 MB/s 2024-09-12T12:24:44.225 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.225 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.225 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136045 s, 77.1 MB/s 2024-09-12T12:24:44.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.242 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141517 s, 74.1 MB/s 2024-09-12T12:24:44.258 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.258 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.258 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130095 s, 80.6 MB/s 2024-09-12T12:24:44.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.274 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132571 s, 79.1 MB/s 2024-09-12T12:24:44.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.290 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.290 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132279 s, 79.3 MB/s 2024-09-12T12:24:44.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.306 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.306 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130231 s, 80.5 MB/s 2024-09-12T12:24:44.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.324 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.324 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142908 s, 73.4 MB/s 2024-09-12T12:24:44.340 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.340 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.340 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138054 s, 76.0 MB/s 2024-09-12T12:24:44.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.360 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.360 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173032 s, 60.6 MB/s 2024-09-12T12:24:44.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150562 s, 69.6 MB/s 2024-09-12T12:24:44.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.395 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.395 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139105 s, 75.4 MB/s 2024-09-12T12:24:44.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.413 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.413 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014945 s, 70.2 MB/s 2024-09-12T12:24:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133033 s, 78.8 MB/s 2024-09-12T12:24:44.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.447 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.447 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014634 s, 71.7 MB/s 2024-09-12T12:24:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.465 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156693 s, 66.9 MB/s 2024-09-12T12:24:44.480 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.480 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.480 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123487 s, 84.9 MB/s 2024-09-12T12:24:44.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.496 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.496 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133075 s, 78.8 MB/s 2024-09-12T12:24:44.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.512 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.512 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135477 s, 77.4 MB/s 2024-09-12T12:24:44.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.529 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.529 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140926 s, 74.4 MB/s 2024-09-12T12:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131623 s, 79.7 MB/s 2024-09-12T12:24:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.561 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.562 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132714 s, 79.0 MB/s 2024-09-12T12:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126879 s, 82.6 MB/s 2024-09-12T12:24:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146616 s, 71.5 MB/s 2024-09-12T12:24:44.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.610 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.610 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132503 s, 79.1 MB/s 2024-09-12T12:24:44.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.627 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136167 s, 77.0 MB/s 2024-09-12T12:24:44.642 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.643 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.643 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131122 s, 80.0 MB/s 2024-09-12T12:24:44.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:44.650 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:44.650 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:44.650 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.27 2024-09-12T12:24:44.650 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:44.650 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:44.650 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:44.650 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:44.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:44.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.760 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.760 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135341 s, 77.5 MB/s 2024-09-12T12:24:44.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.775 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131427 s, 79.8 MB/s 2024-09-12T12:24:44.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145917 s, 71.9 MB/s 2024-09-12T12:24:44.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.812 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.812 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169187 s, 62.0 MB/s 2024-09-12T12:24:44.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.829 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.830 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145789 s, 71.9 MB/s 2024-09-12T12:24:44.849 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.849 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.849 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168017 s, 62.4 MB/s 2024-09-12T12:24:44.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.866 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.866 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144743 s, 72.4 MB/s 2024-09-12T12:24:44.882 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.882 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.882 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133268 s, 78.7 MB/s 2024-09-12T12:24:44.898 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.898 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.898 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131763 s, 79.6 MB/s 2024-09-12T12:24:44.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.913 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.914 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129688 s, 80.9 MB/s 2024-09-12T12:24:44.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.929 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.929 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130276 s, 80.5 MB/s 2024-09-12T12:24:44.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.946 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.947 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144183 s, 72.7 MB/s 2024-09-12T12:24:44.962 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.963 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.963 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013528 s, 77.5 MB/s 2024-09-12T12:24:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.983 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177339 s, 59.1 MB/s 2024-09-12T12:24:44.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:44.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:44.998 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127164 s, 82.5 MB/s 2024-09-12T12:24:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.015 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.015 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135618 s, 77.3 MB/s 2024-09-12T12:24:45.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.032 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.032 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133108 s, 78.8 MB/s 2024-09-12T12:24:45.048 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.049 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.049 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154261 s, 68.0 MB/s 2024-09-12T12:24:45.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.065 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.065 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013551 s, 77.4 MB/s 2024-09-12T12:24:45.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.081 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132887 s, 78.9 MB/s 2024-09-12T12:24:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130481 s, 80.4 MB/s 2024-09-12T12:24:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145643 s, 72.0 MB/s 2024-09-12T12:24:45.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.131 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.131 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144567 s, 72.5 MB/s 2024-09-12T12:24:45.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.147 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.147 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133843 s, 78.3 MB/s 2024-09-12T12:24:45.166 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.166 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.166 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163948 s, 64.0 MB/s 2024-09-12T12:24:45.181 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.181 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.181 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130626 s, 80.3 MB/s 2024-09-12T12:24:45.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.200 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.201 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164378 s, 63.8 MB/s 2024-09-12T12:24:45.216 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.216 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.216 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133075 s, 78.8 MB/s 2024-09-12T12:24:45.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.233 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.233 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144974 s, 72.3 MB/s 2024-09-12T12:24:45.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.249 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.249 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131 s, 80.0 MB/s 2024-09-12T12:24:45.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.267 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.267 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150072 s, 69.9 MB/s 2024-09-12T12:24:45.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.284 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.284 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148051 s, 70.8 MB/s 2024-09-12T12:24:45.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:45.291 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:45.291 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:45.292 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.28 2024-09-12T12:24:45.292 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:45.292 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:45.292 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:45.292 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:45.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.362 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.363 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017874 s, 58.7 MB/s 2024-09-12T12:24:45.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.378 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.378 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135688 s, 77.3 MB/s 2024-09-12T12:24:45.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.394 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.394 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126753 s, 82.7 MB/s 2024-09-12T12:24:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174134 s, 60.2 MB/s 2024-09-12T12:24:45.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.431 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.431 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013858 s, 75.7 MB/s 2024-09-12T12:24:45.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.451 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.452 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172961 s, 60.6 MB/s 2024-09-12T12:24:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.468 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013514 s, 77.6 MB/s 2024-09-12T12:24:45.488 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.488 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.488 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168664 s, 62.2 MB/s 2024-09-12T12:24:45.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.504 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128914 s, 81.3 MB/s 2024-09-12T12:24:45.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.523 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.523 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171606 s, 61.1 MB/s 2024-09-12T12:24:45.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.540 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.540 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136855 s, 76.6 MB/s 2024-09-12T12:24:45.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.556 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.556 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131737 s, 79.6 MB/s 2024-09-12T12:24:45.575 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.576 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.576 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171614 s, 61.1 MB/s 2024-09-12T12:24:45.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.592 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.592 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136772 s, 76.7 MB/s 2024-09-12T12:24:45.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.609 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.609 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146866 s, 71.4 MB/s 2024-09-12T12:24:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.627 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146255 s, 71.7 MB/s 2024-09-12T12:24:45.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.644 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.644 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131095 s, 80.0 MB/s 2024-09-12T12:24:45.659 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.660 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.660 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136914 s, 76.6 MB/s 2024-09-12T12:24:45.676 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.676 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.677 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137461 s, 76.3 MB/s 2024-09-12T12:24:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.694 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146348 s, 71.6 MB/s 2024-09-12T12:24:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.709 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.710 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126716 s, 82.8 MB/s 2024-09-12T12:24:45.725 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.725 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.726 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133215 s, 78.7 MB/s 2024-09-12T12:24:45.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.743 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147928 s, 70.9 MB/s 2024-09-12T12:24:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.759 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138 s, 76.0 MB/s 2024-09-12T12:24:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013123 s, 79.9 MB/s 2024-09-12T12:24:45.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.792 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135732 s, 77.3 MB/s 2024-09-12T12:24:45.809 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.810 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149116 s, 70.3 MB/s 2024-09-12T12:24:45.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.825 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.825 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125456 s, 83.6 MB/s 2024-09-12T12:24:45.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.842 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.843 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145462 s, 72.1 MB/s 2024-09-12T12:24:45.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.859 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.859 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137392 s, 76.3 MB/s 2024-09-12T12:24:45.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.875 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.875 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138203 s, 75.9 MB/s 2024-09-12T12:24:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:45.892 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139693 s, 75.1 MB/s 2024-09-12T12:24:45.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:45.899 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:45.899 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:45.899 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.29 2024-09-12T12:24:45.900 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:45.900 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:45.900 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:45.900 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:46.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.009 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.009 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145275 s, 72.2 MB/s 2024-09-12T12:24:46.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.027 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.027 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01446 s, 72.5 MB/s 2024-09-12T12:24:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.043 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136416 s, 76.9 MB/s 2024-09-12T12:24:46.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.061 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.061 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145243 s, 72.2 MB/s 2024-09-12T12:24:46.080 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.081 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.081 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167881 s, 62.5 MB/s 2024-09-12T12:24:46.096 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.097 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.097 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128357 s, 81.7 MB/s 2024-09-12T12:24:46.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.117 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174363 s, 60.1 MB/s 2024-09-12T12:24:46.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.133 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.134 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134201 s, 78.1 MB/s 2024-09-12T12:24:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165665 s, 63.3 MB/s 2024-09-12T12:24:46.170 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.170 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.170 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142128 s, 73.8 MB/s 2024-09-12T12:24:46.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.187 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.187 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135914 s, 77.2 MB/s 2024-09-12T12:24:46.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.205 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.205 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148803 s, 70.5 MB/s 2024-09-12T12:24:46.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.221 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.221 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133161 s, 78.7 MB/s 2024-09-12T12:24:46.237 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.238 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.238 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131335 s, 79.8 MB/s 2024-09-12T12:24:46.254 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.256 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.256 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134329 s, 78.1 MB/s 2024-09-12T12:24:46.272 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.272 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.272 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148519 s, 70.6 MB/s 2024-09-12T12:24:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.292 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167099 s, 62.8 MB/s 2024-09-12T12:24:46.310 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.310 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.310 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014967 s, 70.1 MB/s 2024-09-12T12:24:46.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.328 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.328 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145899 s, 71.9 MB/s 2024-09-12T12:24:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.345 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142266 s, 73.7 MB/s 2024-09-12T12:24:46.361 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.361 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.361 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132326 s, 79.2 MB/s 2024-09-12T12:24:46.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.382 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181665 s, 57.7 MB/s 2024-09-12T12:24:46.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.400 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.400 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146251 s, 71.7 MB/s 2024-09-12T12:24:46.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.418 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.418 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151022 s, 69.4 MB/s 2024-09-12T12:24:46.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.435 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.435 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134121 s, 78.2 MB/s 2024-09-12T12:24:46.452 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.453 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146185 s, 71.7 MB/s 2024-09-12T12:24:46.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.469 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.469 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132144 s, 79.4 MB/s 2024-09-12T12:24:46.485 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.485 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.485 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136374 s, 76.9 MB/s 2024-09-12T12:24:46.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.505 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.505 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162538 s, 64.5 MB/s 2024-09-12T12:24:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.522 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014057 s, 74.6 MB/s 2024-09-12T12:24:46.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.539 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.539 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141887 s, 73.9 MB/s 2024-09-12T12:24:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133076 s, 78.8 MB/s 2024-09-12T12:24:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:46.563 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:46.564 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:46.564 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.30 2024-09-12T12:24:46.564 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:46.564 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:46.564 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:46.564 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:46.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126328 s, 83.0 MB/s 2024-09-12T12:24:46.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:24:46.646 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.647 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134092 s, 78.2 MB/s 2024-09-12T12:24:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.665 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014789 s, 70.9 MB/s 2024-09-12T12:24:46.681 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.681 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.681 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135616 s, 77.3 MB/s 2024-09-12T12:24:46.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.698 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.698 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014357 s, 73.0 MB/s 2024-09-12T12:24:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.711 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110253 s, 95.1 MB/s 2024-09-12T12:24:46.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.727 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.727 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136264 s, 77.0 MB/s 2024-09-12T12:24:46.742 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.743 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.743 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126477 s, 82.9 MB/s 2024-09-12T12:24:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.759 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136505 s, 76.8 MB/s 2024-09-12T12:24:46.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.776 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.776 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145915 s, 71.9 MB/s 2024-09-12T12:24:46.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.792 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.793 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136743 s, 76.7 MB/s 2024-09-12T12:24:46.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.808 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.809 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013289 s, 78.9 MB/s 2024-09-12T12:24:46.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.824 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.824 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133266 s, 78.7 MB/s 2024-09-12T12:24:46.840 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.840 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.840 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132396 s, 79.2 MB/s 2024-09-12T12:24:46.855 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.855 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.856 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127414 s, 82.3 MB/s 2024-09-12T12:24:46.871 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.872 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.872 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132818 s, 78.9 MB/s 2024-09-12T12:24:46.888 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.889 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141247 s, 74.2 MB/s 2024-09-12T12:24:46.904 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.904 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.904 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132151 s, 79.3 MB/s 2024-09-12T12:24:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.919 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012871 s, 81.5 MB/s 2024-09-12T12:24:46.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.935 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.935 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128813 s, 81.4 MB/s 2024-09-12T12:24:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.951 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128822 s, 81.4 MB/s 2024-09-12T12:24:46.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.966 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.966 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125432 s, 83.6 MB/s 2024-09-12T12:24:46.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.982 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.982 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141055 s, 74.3 MB/s 2024-09-12T12:24:46.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:46.999 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:46.999 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135023 s, 77.7 MB/s 2024-09-12T12:24:47.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.014 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.015 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131757 s, 79.6 MB/s 2024-09-12T12:24:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134984 s, 77.7 MB/s 2024-09-12T12:24:47.047 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.047 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.047 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135853 s, 77.2 MB/s 2024-09-12T12:24:47.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.066 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.066 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169765 s, 61.8 MB/s 2024-09-12T12:24:47.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.084 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.084 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151737 s, 69.1 MB/s 2024-09-12T12:24:47.100 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.100 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.100 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129204 s, 81.2 MB/s 2024-09-12T12:24:47.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.117 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.117 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014589 s, 71.9 MB/s 2024-09-12T12:24:47.134 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.134 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.134 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140211 s, 74.8 MB/s 2024-09-12T12:24:47.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:47.141 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-12T12:24:47.141 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:24:47.141 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p scrub_control_test_path/dir.31 2024-09-12T12:24:47.141 DEBUG:teuthology.orchestra.run.smithi144:> for ((i = 0; i < 32; i++)); do 2024-09-12T12:24:47.142 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-12T12:24:47.142 DEBUG:teuthology.orchestra.run.smithi144:> done 2024-09-12T12:24:47.142 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:24:47.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:24:47.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.253 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.253 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144872 s, 72.4 MB/s 2024-09-12T12:24:47.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.269 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.269 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138904 s, 75.5 MB/s 2024-09-12T12:24:47.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.285 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.285 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133645 s, 78.5 MB/s 2024-09-12T12:24:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.301 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130338 s, 80.5 MB/s 2024-09-12T12:24:47.316 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.317 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.317 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129253 s, 81.1 MB/s 2024-09-12T12:24:47.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.333 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.333 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141034 s, 74.3 MB/s 2024-09-12T12:24:47.348 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.349 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.349 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126112 s, 83.1 MB/s 2024-09-12T12:24:47.364 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.365 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.365 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132938 s, 78.9 MB/s 2024-09-12T12:24:47.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.382 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.382 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147482 s, 71.1 MB/s 2024-09-12T12:24:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.399 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142698 s, 73.5 MB/s 2024-09-12T12:24:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.416 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141358 s, 74.2 MB/s 2024-09-12T12:24:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.433 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.434 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147231 s, 71.2 MB/s 2024-09-12T12:24:47.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.453 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.453 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166234 s, 63.1 MB/s 2024-09-12T12:24:47.470 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.470 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.470 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142856 s, 73.4 MB/s 2024-09-12T12:24:47.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.487 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.487 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133036 s, 78.8 MB/s 2024-09-12T12:24:47.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.503 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.503 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136005 s, 77.1 MB/s 2024-09-12T12:24:47.519 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.519 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.520 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135637 s, 77.3 MB/s 2024-09-12T12:24:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.537 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145297 s, 72.2 MB/s 2024-09-12T12:24:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142242 s, 73.7 MB/s 2024-09-12T12:24:47.570 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.570 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.570 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132346 s, 79.2 MB/s 2024-09-12T12:24:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141571 s, 74.1 MB/s 2024-09-12T12:24:47.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.602 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.603 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128799 s, 81.4 MB/s 2024-09-12T12:24:47.618 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.618 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.618 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128903 s, 81.3 MB/s 2024-09-12T12:24:47.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.634 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.634 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133668 s, 78.4 MB/s 2024-09-12T12:24:47.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.650 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.650 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131808 s, 79.6 MB/s 2024-09-12T12:24:47.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.665 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.665 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124895 s, 84.0 MB/s 2024-09-12T12:24:47.681 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.681 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.681 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132758 s, 79.0 MB/s 2024-09-12T12:24:47.697 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.697 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.698 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134674 s, 77.9 MB/s 2024-09-12T12:24:47.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.715 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.715 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149602 s, 70.1 MB/s 2024-09-12T12:24:47.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.731 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.731 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138184 s, 75.9 MB/s 2024-09-12T12:24:47.748 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140794 s, 74.5 MB/s 2024-09-12T12:24:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-12T12:24:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-12T12:24:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131654 s, 79.6 MB/s 2024-09-12T12:24:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:24:47.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-09-12T12:24:47.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f425b400640 1 Processor -- start 2024-09-12T12:24:47.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f425b400640 1 -- start start 2024-09-12T12:24:47.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f425b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f425415c2e0 0x7f4254072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f425b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42540af5f0 0x7f425406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f425b400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42540733e0 con 0x7f425406c150 2024-09-12T12:24:47.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f425b400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f425406c5c0 con 0x7f425415c2e0 2024-09-12T12:24:47.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f425b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42540cd290 con 0x7f42540af5f0 2024-09-12T12:24:47.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f4258a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f425415c2e0 0x7f4254072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f4259400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f425406c150 0x7f425406d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47134/0 (socket says 172.21.15.144:47134) 2024-09-12T12:24:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f4259400640 1 -- 172.21.15.144:0/2046155493 learned_addr learned my addr 172.21.15.144:0/2046155493 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f4253e00640 1 --2- 172.21.15.144:0/2046155493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42540af5f0 0x7f425406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f4258a00640 1 -- 172.21.15.144:0/2046155493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42540af5f0 msgr2=0x7f425406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f4258a00640 1 --2- 172.21.15.144:0/2046155493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42540af5f0 0x7f425406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f4258a00640 1 -- 172.21.15.144:0/2046155493 >> v1:172.21.15.144:6789/0 conn(0x7f425406c150 legacy=0x7f425406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:47.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.911+0000 7f4258a00640 1 -- 172.21.15.144:0/2046155493 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42540cd570 con 0x7f425415c2e0 2024-09-12T12:24:47.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f4258a00640 1 --2- 172.21.15.144:0/2046155493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 0x7f4254072b50 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f42480097c0 tx=0x7f424801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc86e45a45dbc45b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:47.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f4253400640 1 -- 172.21.15.144:0/2046155493 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480b0070 con 0x7f425415c2e0 2024-09-12T12:24:47.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f4253400640 1 -- 172.21.15.144:0/2046155493 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42480ab600 con 0x7f425415c2e0 2024-09-12T12:24:47.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f4253400640 1 -- 172.21.15.144:0/2046155493 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480ab9d0 con 0x7f425415c2e0 2024-09-12T12:24:47.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f425b400640 1 -- 172.21.15.144:0/2046155493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 msgr2=0x7f4254072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:47.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f425b400640 1 --2- 172.21.15.144:0/2046155493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 0x7f4254072b50 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f42480097c0 tx=0x7f424801c380 comp rx=0 tx=0).stop 2024-09-12T12:24:47.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f425b400640 1 -- 172.21.15.144:0/2046155493 shutdown_connections 2024-09-12T12:24:47.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f425b400640 1 --2- 172.21.15.144:0/2046155493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42540af5f0 0x7f425406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f425b400640 1 --2- 172.21.15.144:0/2046155493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 0x7f4254072b50 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f425b400640 1 -- 172.21.15.144:0/2046155493 >> 172.21.15.144:0/2046155493 conn(0x7f4254068030 msgr2=0x7f42540b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:47.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f425b400640 1 -- 172.21.15.144:0/2046155493 shutdown_connections 2024-09-12T12:24:47.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f425b400640 1 -- 172.21.15.144:0/2046155493 wait complete. 2024-09-12T12:24:47.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.915+0000 7f425b400640 1 Processor -- start 2024-09-12T12:24:47.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 -- start start 2024-09-12T12:24:47.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f425406c150 0x7f42541fa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42540af5f0 0x7f42540d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 0x7f42540d0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42541690a0 con 0x7f425415c2e0 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4254168f20 con 0x7f42540af5f0 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4254169220 con 0x7f425406c150 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4259400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 0x7f42540d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4259400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 0x7f42540d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52914/0 (socket says 172.21.15.144:52914) 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4259400640 1 -- 172.21.15.144:0/2229499088 learned_addr learned my addr 172.21.15.144:0/2229499088 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4253e00640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42540af5f0 0x7f42540d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4258a00640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f425406c150 0x7f42541fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4259400640 1 -- 172.21.15.144:0/2229499088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f425406c150 msgr2=0x7f42541fa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4259400640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f425406c150 0x7f42541fa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4259400640 1 -- 172.21.15.144:0/2229499088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42540af5f0 msgr2=0x7f42540d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4259400640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42540af5f0 0x7f42540d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4259400640 1 -- 172.21.15.144:0/2229499088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425415cb70 con 0x7f425415c2e0 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4259400640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 0x7f42540d0800 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f424c00ca80 tx=0x7f424c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4250c00640 1 -- 172.21.15.144:0/2229499088 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c017070 con 0x7f425415c2e0 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4250c00640 1 -- 172.21.15.144:0/2229499088 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424c00ac30 con 0x7f425415c2e0 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f4250c00640 1 -- 172.21.15.144:0/2229499088 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c012600 con 0x7f425415c2e0 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425415ce50 con 0x7f425415c2e0 2024-09-12T12:24:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425415d410 con 0x7f425415c2e0 2024-09-12T12:24:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.919+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f425406bc10 con 0x7f425415c2e0 2024-09-12T12:24:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.923+0000 7f4250c00640 1 -- 172.21.15.144:0/2229499088 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f424c01a070 con 0x7f425415c2e0 2024-09-12T12:24:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.923+0000 7f4250c00640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42340678c0 0x7f4234069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.923+0000 7f4250c00640 1 -- 172.21.15.144:0/2229499088 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f424c085b30 con 0x7f425415c2e0 2024-09-12T12:24:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.923+0000 7f4258a00640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42340678c0 0x7f4234069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:47.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.923+0000 7f4258a00640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42340678c0 0x7f4234069d80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f42480ad000 tx=0x7f42480a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:47.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:47.927+0000 7f4250c00640 1 -- 172.21.15.144:0/2229499088 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f424c00ae20 con 0x7f425415c2e0 2024-09-12T12:24:48.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.119+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f42540aeae0 con 0x7f425415c2e0 2024-09-12T12:24:48.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f4250c00640 1 -- 172.21.15.144:0/2229499088 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v137) ==== 105+0+0 (secure 0 0 0) 0x7f424c055d80 con 0x7f425415c2e0 2024-09-12T12:24:48.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42340678c0 msgr2=0x7f4234069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42340678c0 0x7f4234069d80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f42480ad000 tx=0x7f42480a6000 comp rx=0 tx=0).stop 2024-09-12T12:24:48.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 msgr2=0x7f42540d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 0x7f42540d0800 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f424c00ca80 tx=0x7f424c00cf40 comp rx=0 tx=0).stop 2024-09-12T12:24:48.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 shutdown_connections 2024-09-12T12:24:48.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42340678c0 0x7f4234069d80 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f425415c2e0 0x7f42540d0800 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42540af5f0 0x7f42540d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 --2- 172.21.15.144:0/2229499088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f425406c150 0x7f42541fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 >> 172.21.15.144:0/2229499088 conn(0x7f4254068030 msgr2=0x7f4254073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:48.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 shutdown_connections 2024-09-12T12:24:48.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.607+0000 7f425b400640 1 -- 172.21.15.144:0/2229499088 wait complete. 2024-09-12T12:24:48.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-12T12:24:48.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9707c00640 1 Processor -- start 2024-09-12T12:24:48.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9707c00640 1 -- start start 2024-09-12T12:24:48.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9707c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f970015af60 0x7f97000ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9707c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97000cd9f0 0x7f970006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9707c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97000b4300 con 0x7f970015b340 2024-09-12T12:24:48.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9707c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f97000b32f0 con 0x7f970015af60 2024-09-12T12:24:48.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9707c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f97000b3540 con 0x7f97000cd9f0 2024-09-12T12:24:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9705c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f970015b340 0x7f970015ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47146/0 (socket says 172.21.15.144:47146) 2024-09-12T12:24:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9705c00640 1 -- 172.21.15.144:0/3983762665 learned_addr learned my addr 172.21.15.144:0/3983762665 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f96ffe00640 1 --2- 172.21.15.144:0/3983762665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97000cd9f0 0x7f970006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9705200640 1 --2- 172.21.15.144:0/3983762665 >> v2:172.21.15.165:3300/0 conn(0x7f970015af60 0x7f97000ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f96ff400640 1 -- 172.21.15.144:0/3983762665 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907326401 0 0) 0x7f97000b4300 con 0x7f970015b340 2024-09-12T12:24:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f96ff400640 1 -- 172.21.15.144:0/3983762665 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96e4003530 con 0x7f970015b340 2024-09-12T12:24:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9705200640 1 -- 172.21.15.144:0/3983762665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97000cd9f0 msgr2=0x7f970006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9705200640 1 --2- 172.21.15.144:0/3983762665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97000cd9f0 0x7f970006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9705200640 1 -- 172.21.15.144:0/3983762665 >> v1:172.21.15.144:6789/0 conn(0x7f970015b340 legacy=0x7f970015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.767+0000 7f9705200640 1 -- 172.21.15.144:0/3983762665 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97000b3820 con 0x7f970015af60 2024-09-12T12:24:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f9705200640 1 --2- 172.21.15.144:0/3983762665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f970015af60 0x7f97000ce680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009d90 tx=0x7f96f001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b31e76745d6ea019 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f96ff400640 1 -- 172.21.15.144:0/3983762665 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f00b4070 con 0x7f970015af60 2024-09-12T12:24:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f96ff400640 1 -- 172.21.15.144:0/3983762665 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f00af600 con 0x7f970015af60 2024-09-12T12:24:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f96ff400640 1 -- 172.21.15.144:0/3983762665 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f00af9b0 con 0x7f970015af60 2024-09-12T12:24:48.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f9707c00640 1 -- 172.21.15.144:0/3983762665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f970015af60 msgr2=0x7f97000ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f9707c00640 1 --2- 172.21.15.144:0/3983762665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f970015af60 0x7f97000ce680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009d90 tx=0x7f96f001f150 comp rx=0 tx=0).stop 2024-09-12T12:24:48.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f9707c00640 1 -- 172.21.15.144:0/3983762665 shutdown_connections 2024-09-12T12:24:48.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f9707c00640 1 --2- 172.21.15.144:0/3983762665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97000cd9f0 0x7f970006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f9707c00640 1 --2- 172.21.15.144:0/3983762665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f970015af60 0x7f97000ce680 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f9707c00640 1 -- 172.21.15.144:0/3983762665 >> 172.21.15.144:0/3983762665 conn(0x7f9700068030 msgr2=0x7f97000b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:48.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f9707c00640 1 -- 172.21.15.144:0/3983762665 shutdown_connections 2024-09-12T12:24:48.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.771+0000 7f9707c00640 1 -- 172.21.15.144:0/3983762665 wait complete. 2024-09-12T12:24:48.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 Processor -- start 2024-09-12T12:24:48.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 -- start start 2024-09-12T12:24:48.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97000cd9f0 0x7f970014a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f970015af60 0x7f97000725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f970015b340 0x7f9700072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f97000b5570 con 0x7f970015af60 2024-09-12T12:24:48.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f97000b3de0 con 0x7f97000cd9f0 2024-09-12T12:24:48.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f97000cebc0 con 0x7f970015b340 2024-09-12T12:24:48.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96ffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f970015af60 0x7f97000725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96ffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f970015af60 0x7f97000725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52920/0 (socket says 172.21.15.144:52920) 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96ffe00640 1 -- 172.21.15.144:0/4165021446 learned_addr learned my addr 172.21.15.144:0/4165021446 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9705200640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97000cd9f0 0x7f970014a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9705c00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f970015b340 0x7f9700072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96ffe00640 1 -- 172.21.15.144:0/4165021446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f970015b340 msgr2=0x7f9700072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96ffe00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f970015b340 0x7f9700072ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96ffe00640 1 -- 172.21.15.144:0/4165021446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97000cd9f0 msgr2=0x7f970014a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96ffe00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97000cd9f0 0x7f970014a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96ffe00640 1 -- 172.21.15.144:0/4165021446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970015c1f0 con 0x7f970015af60 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96ffe00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f970015af60 0x7f97000725a0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00e930 tx=0x7f96ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96fcc00640 1 -- 172.21.15.144:0/4165021446 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec017070 con 0x7f970015af60 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96fcc00640 1 -- 172.21.15.144:0/4165021446 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec00ca00 con 0x7f970015af60 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97000ab300 con 0x7f970015af60 2024-09-12T12:24:48.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f96fcc00640 1 -- 172.21.15.144:0/4165021446 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec00cdd0 con 0x7f970015af60 2024-09-12T12:24:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970015c750 con 0x7f970015af60 2024-09-12T12:24:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.775+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97000ce680 con 0x7f970015af60 2024-09-12T12:24:48.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.779+0000 7f96fcc00640 1 -- 172.21.15.144:0/4165021446 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96ec01a070 con 0x7f970015af60 2024-09-12T12:24:48.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.779+0000 7f96fcc00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96e00678f0 0x7f96e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:48.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.779+0000 7f96fcc00640 1 -- 172.21.15.144:0/4165021446 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f96ec085ea0 con 0x7f970015af60 2024-09-12T12:24:48.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.779+0000 7f9705200640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96e00678f0 0x7f96e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:48.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.779+0000 7f9705200640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96e00678f0 0x7f96e0069db0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f96f00b1000 tx=0x7f96f00aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:48.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.783+0000 7f96fcc00640 1 -- 172.21.15.144:0/4165021446 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f970015c1f0 con 0x7f970015af60 2024-09-12T12:24:48.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:48.975+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f97000afc20 con 0x7f970015af60 2024-09-12T12:24:49.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.611+0000 7f96fcc00640 1 -- 172.21.15.144:0/4165021446 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v138) ==== 121+0+0 (secure 0 0 0) 0x7f96ec0561b0 con 0x7f970015af60 2024-09-12T12:24:49.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96e00678f0 msgr2=0x7f96e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96e00678f0 0x7f96e0069db0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f96f00b1000 tx=0x7f96f00aa000 comp rx=0 tx=0).stop 2024-09-12T12:24:49.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f970015af60 msgr2=0x7f97000725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f970015af60 0x7f97000725a0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00e930 tx=0x7f96ec00edf0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 shutdown_connections 2024-09-12T12:24:49.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f96e00678f0 0x7f96e0069db0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f970015b340 0x7f9700072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f970015af60 0x7f97000725a0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 --2- 172.21.15.144:0/4165021446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97000cd9f0 0x7f970014a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 >> 172.21.15.144:0/4165021446 conn(0x7f9700068030 msgr2=0x7f970006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:49.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 shutdown_connections 2024-09-12T12:24:49.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.615+0000 7f9707c00640 1 -- 172.21.15.144:0/4165021446 wait complete. 2024-09-12T12:24:49.637 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:49.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.771+0000 7fa3b7200640 1 Processor -- start 2024-09-12T12:24:49.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.771+0000 7fa3b7200640 1 -- start start 2024-09-12T12:24:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3b7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa3b0148190 0x7fa3b00ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 0x7fa3b00b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3b7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b0148570 con 0x7fa3b00cd470 2024-09-12T12:24:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3b7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa3b00ce090 con 0x7fa3b0148190 2024-09-12T12:24:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3b7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b00cd8b0 con 0x7fa3b00b0480 2024-09-12T12:24:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3af400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa3b00cd470 0x7fa3b00afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47148/0 (socket says 172.21.15.144:47148) 2024-09-12T12:24:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3af400640 1 -- 172.21.15.144:0/2017951328 learned_addr learned my addr 172.21.15.144:0/2017951328 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3afe00640 1 --2- 172.21.15.144:0/2017951328 >> v2:172.21.15.165:3300/0 conn(0x7fa3b0148190 0x7fa3b00ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3b5200640 1 --2- 172.21.15.144:0/2017951328 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 0x7fa3b00b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3aea00640 1 -- 172.21.15.144:0/2017951328 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378403632 0 0) 0x7fa3b0148570 con 0x7fa3b00cd470 2024-09-12T12:24:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3aea00640 1 -- 172.21.15.144:0/2017951328 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa394003530 con 0x7fa3b00cd470 2024-09-12T12:24:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3afe00640 1 -- 172.21.15.144:0/2017951328 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 msgr2=0x7fa3b00b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3afe00640 1 --2- 172.21.15.144:0/2017951328 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 0x7fa3b00b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3afe00640 1 -- 172.21.15.144:0/2017951328 >> v1:172.21.15.144:6789/0 conn(0x7fa3b00cd470 legacy=0x7fa3b00afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3afe00640 1 -- 172.21.15.144:0/2017951328 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b00b41f0 con 0x7fa3b0148190 2024-09-12T12:24:49.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.775+0000 7fa3b5200640 1 --2- 172.21.15.144:0/2017951328 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 0x7fa3b00b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:49.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3afe00640 1 --2- 172.21.15.144:0/2017951328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b0148190 0x7fa3b00ccf30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00097c0 tx=0x7fa3a001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a87bce970e83b6a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:49.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3aea00640 1 -- 172.21.15.144:0/2017951328 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a00b2070 con 0x7fa3b0148190 2024-09-12T12:24:49.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3aea00640 1 -- 172.21.15.144:0/2017951328 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a00ad640 con 0x7fa3b0148190 2024-09-12T12:24:49.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3aea00640 1 -- 172.21.15.144:0/2017951328 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a00ada10 con 0x7fa3b0148190 2024-09-12T12:24:49.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 -- 172.21.15.144:0/2017951328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b0148190 msgr2=0x7fa3b00ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 --2- 172.21.15.144:0/2017951328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b0148190 0x7fa3b00ccf30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00097c0 tx=0x7fa3a001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 -- 172.21.15.144:0/2017951328 shutdown_connections 2024-09-12T12:24:49.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 --2- 172.21.15.144:0/2017951328 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 0x7fa3b00b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 --2- 172.21.15.144:0/2017951328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b0148190 0x7fa3b00ccf30 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 -- 172.21.15.144:0/2017951328 >> 172.21.15.144:0/2017951328 conn(0x7fa3b006d0d0 msgr2=0x7fa3b006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:49.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 -- 172.21.15.144:0/2017951328 shutdown_connections 2024-09-12T12:24:49.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 -- 172.21.15.144:0/2017951328 wait complete. 2024-09-12T12:24:49.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 Processor -- start 2024-09-12T12:24:49.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 -- start start 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 0x7fa3b012edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b00cd470 0x7fa3b0140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b0148190 0x7fa3b01413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b00b5420 con 0x7fa3b00cd470 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b00b11f0 con 0x7fa3b0148190 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3b7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b00b55a0 con 0x7fa3b00b0480 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.779+0000 7fa3af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b00cd470 0x7fa3b0140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b00cd470 0x7fa3b0140eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52926/0 (socket says 172.21.15.144:52926) 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3af400640 1 -- 172.21.15.144:0/3841549029 learned_addr learned my addr 172.21.15.144:0/3841549029 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3afe00640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 0x7fa3b012edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3b5200640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b0148190 0x7fa3b01413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3af400640 1 -- 172.21.15.144:0/3841549029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 msgr2=0x7fa3b012edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3af400640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 0x7fa3b012edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3af400640 1 -- 172.21.15.144:0/3841549029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b0148190 msgr2=0x7fa3b01413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3af400640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b0148190 0x7fa3b01413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3af400640 1 -- 172.21.15.144:0/3841549029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b013d430 con 0x7fa3b00cd470 2024-09-12T12:24:49.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3af400640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b00cd470 0x7fa3b0140eb0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c450 tx=0x7fa39c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3a7e00640 1 -- 172.21.15.144:0/3841549029 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c017070 con 0x7fa3b00cd470 2024-09-12T12:24:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3a7e00640 1 -- 172.21.15.144:0/3841549029 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39c005cf0 con 0x7fa3b00cd470 2024-09-12T12:24:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3a7e00640 1 -- 172.21.15.144:0/3841549029 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0072f0 con 0x7fa3b00cd470 2024-09-12T12:24:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b013d710 con 0x7fa3b00cd470 2024-09-12T12:24:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b013dcd0 con 0x7fa3b00cd470 2024-09-12T12:24:49.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b00b58f0 con 0x7fa3b00cd470 2024-09-12T12:24:49.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3a7e00640 1 -- 172.21.15.144:0/3841549029 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa39c01a070 con 0x7fa3b00cd470 2024-09-12T12:24:49.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.783+0000 7fa3a7e00640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3900678c0 0x7fa390069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:49.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.787+0000 7fa3a7e00640 1 -- 172.21.15.144:0/3841549029 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fa39c085340 con 0x7fa3b00cd470 2024-09-12T12:24:49.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.787+0000 7fa3afe00640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3900678c0 0x7fa390069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:49.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.787+0000 7fa3afe00640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3900678c0 0x7fa390069d80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00af000 tx=0x7fa3a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:49.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.787+0000 7fa3a7e00640 1 -- 172.21.15.144:0/3841549029 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa39c055500 con 0x7fa3b00cd470 2024-09-12T12:24:49.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3b0145090 con 0x7fa3b00cd470 2024-09-12T12:24:49.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3a7e00640 1 -- 172.21.15.144:0/3841549029 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) ==== 95+0+5248 (secure 0 0 0) 0x7fa39c059800 con 0x7fa3b00cd470 2024-09-12T12:24:49.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:49.980 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":139,"btime":"2024-09-12T12:24:49:619601+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8132,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2178161495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2178161495},{"type":"v1","addr":"172.21.15.144:6835","nonce":2178161495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2493299621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2493299621},{"type":"v1","addr":"172.21.15.165:6835","nonce":2493299621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":139,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:24:15.762976+0000","modified":"2024-09-12T12:24:49.619585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9256":{"gid":9256,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6834/2468859076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2468859076},{"type":"v1","addr":"172.21.15.165:6834","nonce":2468859076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9795":{"gid":9795,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/249899092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":249899092},{"type":"v1","addr":"172.21.15.144:6837","nonce":249899092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9795,"qdb_cluster":[9795]},"id":12}]} 2024-09-12T12:24:49.980 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 139 2024-09-12T12:24:49.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3900678c0 msgr2=0x7fa390069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3900678c0 0x7fa390069d80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00af000 tx=0x7fa3a0008040 comp rx=0 tx=0).stop 2024-09-12T12:24:49.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b00cd470 msgr2=0x7fa3b0140eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b00cd470 0x7fa3b0140eb0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c450 tx=0x7fa39c00c850 comp rx=0 tx=0).stop 2024-09-12T12:24:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 shutdown_connections 2024-09-12T12:24:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3900678c0 0x7fa390069d80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b0148190 0x7fa3b01413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3b00cd470 0x7fa3b0140eb0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 --2- 172.21.15.144:0/3841549029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b00b0480 0x7fa3b012edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 >> 172.21.15.144:0/3841549029 conn(0x7fa3b006d0d0 msgr2=0x7fa3b015f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 shutdown_connections 2024-09-12T12:24:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:49.979+0000 7fa3b7200640 1 -- 172.21.15.144:0/3841549029 wait complete. 2024-09-12T12:24:50.404 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 139, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T12:24:15.762976+0000', 'modified': '2024-09-12T12:24:49.619585+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9795}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9256': {'gid': 9256, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.165:6834/2468859076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6832', 'nonce': 2468859076}, {'type': 'v1', 'addr': '172.21.15.165:6834', 'nonce': 2468859076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_9795': {'gid': 9795, 'name': 'a', 'rank': 0, 'incarnation': 132, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/249899092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 249899092}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 249899092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9795, 'qdb_cluster': [9795]} 2024-09-12T12:24:50.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:24:50.405 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T12:24:50.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d8600640 1 Processor -- start 2024-09-12T12:24:50.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d8600640 1 -- start start 2024-09-12T12:24:50.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d8600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d0071420 0x7f19d0071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d8600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19d00ccf30 0x7f19d00cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d8600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d00b45a0 con 0x7f19d015b4e0 2024-09-12T12:24:50.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d8600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f19d00b3fe0 con 0x7f19d00ccf30 2024-09-12T12:24:50.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d8600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f19d00b42c0 con 0x7f19d0071420 2024-09-12T12:24:50.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d6600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19d00ccf30 0x7f19d00cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d6600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19d00ccf30 0x7f19d00cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52928/0 (socket says 172.21.15.144:52928) 2024-09-12T12:24:50.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d6600640 1 -- 172.21.15.144:0/1988970009 learned_addr learned my addr 172.21.15.144:0/1988970009 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d5200640 1 --2- 172.21.15.144:0/1988970009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d0071420 0x7f19d0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d6600640 1 -- 172.21.15.144:0/1988970009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d0071420 msgr2=0x7f19d0071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d6600640 1 --2- 172.21.15.144:0/1988970009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d0071420 0x7f19d0071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d6600640 1 -- 172.21.15.144:0/1988970009 >> v1:172.21.15.165:6789/0 conn(0x7f19d015b4e0 legacy=0x7f19d00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d6600640 1 -- 172.21.15.144:0/1988970009 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d00b1490 con 0x7f19d00ccf30 2024-09-12T12:24:50.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.543+0000 7f19d5200640 1 --2- 172.21.15.144:0/1988970009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d0071420 0x7f19d0071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:50.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19d6600640 1 --2- 172.21.15.144:0/1988970009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 0x7f19d00cd3e0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009e50 tx=0x7f19c801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea395f269049f705 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19cfe00640 1 -- 172.21.15.144:0/1988970009 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c80a56f0 con 0x7f19d00ccf30 2024-09-12T12:24:50.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19cfe00640 1 -- 172.21.15.144:0/1988970009 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c80a5890 con 0x7f19d00ccf30 2024-09-12T12:24:50.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19cfe00640 1 -- 172.21.15.144:0/1988970009 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c80a5c60 con 0x7f19d00ccf30 2024-09-12T12:24:50.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19d8600640 1 -- 172.21.15.144:0/1988970009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 msgr2=0x7f19d00cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19d8600640 1 --2- 172.21.15.144:0/1988970009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 0x7f19d00cd3e0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009e50 tx=0x7f19c801c9f0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19d8600640 1 -- 172.21.15.144:0/1988970009 shutdown_connections 2024-09-12T12:24:50.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19d8600640 1 --2- 172.21.15.144:0/1988970009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 0x7f19d00cd3e0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19d8600640 1 --2- 172.21.15.144:0/1988970009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d0071420 0x7f19d0071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19d8600640 1 -- 172.21.15.144:0/1988970009 >> 172.21.15.144:0/1988970009 conn(0x7f19d006d0d0 msgr2=0x7f19d006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19d8600640 1 -- 172.21.15.144:0/1988970009 shutdown_connections 2024-09-12T12:24:50.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.547+0000 7f19d8600640 1 -- 172.21.15.144:0/1988970009 wait complete. 2024-09-12T12:24:50.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 Processor -- start 2024-09-12T12:24:50.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 -- start start 2024-09-12T12:24:50.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d0071420 0x7f19d01578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 0x7f19d0164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d015b4e0 0x7f19d0164b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f19d015b8c0 con 0x7f19d00ccf30 2024-09-12T12:24:50.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19d0168260 con 0x7f19d0071420 2024-09-12T12:24:50.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f19d0157e30 con 0x7f19d015b4e0 2024-09-12T12:24:50.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 0x7f19d0164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 0x7f19d0164610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52938/0 (socket says 172.21.15.144:52938) 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5200640 1 -- 172.21.15.144:0/1705067501 learned_addr learned my addr 172.21.15.144:0/1705067501 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d6600640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d015b4e0 0x7f19d0164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5c00640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d0071420 0x7f19d01578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5200640 1 -- 172.21.15.144:0/1705067501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d015b4e0 msgr2=0x7f19d0164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5200640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d015b4e0 0x7f19d0164b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5200640 1 -- 172.21.15.144:0/1705067501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d0071420 msgr2=0x7f19d01578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5200640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d0071420 0x7f19d01578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5200640 1 -- 172.21.15.144:0/1705067501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d00d0060 con 0x7f19d00ccf30 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5c00640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d0071420 0x7f19d01578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:50.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d5200640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 0x7f19d0164610 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00c820 tx=0x7f19bc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19cd600640 1 -- 172.21.15.144:0/1705067501 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc015070 con 0x7f19d00ccf30 2024-09-12T12:24:50.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19cd600640 1 -- 172.21.15.144:0/1705067501 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc007a30 con 0x7f19d00ccf30 2024-09-12T12:24:50.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19cd600640 1 -- 172.21.15.144:0/1705067501 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc007e20 con 0x7f19d00ccf30 2024-09-12T12:24:50.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 -- 172.21.15.144:0/1705067501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d00aa620 con 0x7f19d00ccf30 2024-09-12T12:24:50.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.551+0000 7f19d8600640 1 -- 172.21.15.144:0/1705067501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d00aabe0 con 0x7f19d00ccf30 2024-09-12T12:24:50.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.555+0000 7f19cd600640 1 -- 172.21.15.144:0/1705067501 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19bc018070 con 0x7f19d00ccf30 2024-09-12T12:24:50.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.555+0000 7f19cd600640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19b00678c0 0x7f19b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.555+0000 7f19cd600640 1 -- 172.21.15.144:0/1705067501 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f19bc085a40 con 0x7f19d00ccf30 2024-09-12T12:24:50.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.555+0000 7f19d5c00640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19b00678c0 0x7f19b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.555+0000 7f19dba6c000 1 Processor -- start 2024-09-12T12:24:50.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.555+0000 7f19dba6c000 1 -- start start 2024-09-12T12:24:50.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.555+0000 7f19d5c00640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19b00678c0 0x7f19b0069d80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f19c40098b0 tx=0x7f19c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.555+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c18ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.555+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c145d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c146290 0x56471c146670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56471c02db60 con 0x56471c18fb20 2024-09-12T12:24:50.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56471bf94c70 con 0x56471c190440 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56471bf3aed0 con 0x56471c146290 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c18ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c18ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52946/0 (socket says 172.21.15.144:52946) 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5c00640 1 -- 172.21.15.144:0/363051844 learned_addr learned my addr 172.21.15.144:0/363051844 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5200640 1 --2- 172.21.15.144:0/363051844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d6600640 1 --2- 172.21.15.144:0/363051844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c146290 0x56471c146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5c00640 1 -- 172.21.15.144:0/363051844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c146290 msgr2=0x56471c146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5c00640 1 --2- 172.21.15.144:0/363051844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c146290 0x56471c146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5c00640 1 -- 172.21.15.144:0/363051844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 msgr2=0x56471c145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5c00640 1 --2- 172.21.15.144:0/363051844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5c00640 1 -- 172.21.15.144:0/363051844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471bf4ce50 con 0x56471c18fb20 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19d5c00640 1 --2- 172.21.15.144:0/363051844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c18ff00 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f19c400d8e0 tx=0x7f19c4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a15d2a0f518046b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19c2000640 1 -- 172.21.15.144:0/363051844 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4024070 con 0x56471c18fb20 2024-09-12T12:24:50.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19c2000640 1 -- 172.21.15.144:0/363051844 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c400de60 con 0x56471c18fb20 2024-09-12T12:24:50.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19c2000640 1 -- 172.21.15.144:0/363051844 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4014de0 con 0x56471c18fb20 2024-09-12T12:24:50.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- 172.21.15.144:0/363051844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 msgr2=0x56471c18ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 --2- 172.21.15.144:0/363051844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c18ff00 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f19c400d8e0 tx=0x7f19c4010000 comp rx=0 tx=0).stop 2024-09-12T12:24:50.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- 172.21.15.144:0/363051844 shutdown_connections 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 --2- 172.21.15.144:0/363051844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c146290 0x56471c146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 --2- 172.21.15.144:0/363051844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 --2- 172.21.15.144:0/363051844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c18ff00 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- 172.21.15.144:0/363051844 >> 172.21.15.144:0/363051844 conn(0x56471c14c600 msgr2=0x56471c144630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- 172.21.15.144:0/363051844 shutdown_connections 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- 172.21.15.144:0/363051844 wait complete. 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- start start 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 Processor -- start 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c151230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56471bff6b00 con 0x56471c18fb20 2024-09-12T12:24:50.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56471bf6f360 con 0x56471c190440 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56471bf6c2d0 con 0x56471c14b330 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.559+0000 7f19dba6c000 10 client.0 _ll_register_callbacks cb 0x56471c131820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52962/0 (socket says 172.21.15.144:52962) 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5c00640 1 -- 172.21.15.144:0/6587877 learned_addr learned my addr 172.21.15.144:0/6587877 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d6600640 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5200640 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5c00640 1 -- 172.21.15.144:0/6587877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 msgr2=0x56471c151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5c00640 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5c00640 1 -- 172.21.15.144:0/6587877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 msgr2=0x56471c150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5c00640 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5c00640 1 -- 172.21.15.144:0/6587877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56471bf3b120 con 0x56471c18fb20 2024-09-12T12:24:50.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d6600640 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5c00640 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14adf0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009200 tx=0x7f19c4004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aee64ede690acba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 1 -- 172.21.15.144:0/6587877 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4024040 con 0x56471c18fb20 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 1 -- 172.21.15.144:0/6587877 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f19c400f040 con 0x56471c18fb20 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 -- 172.21.15.144:0/6587877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19c400de60 con 0x56471c18fb20 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 1 -- 172.21.15.144:0/6587877 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7f19c4034050 con 0x56471c18fb20 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 10 client.9993 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 -- 172.21.15.144:0/6587877 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x56471bf34450 con 0x56471c18fb20 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 1 -- 172.21.15.144:0/6587877 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c400de60 con 0x56471c18fb20 2024-09-12T12:24:50.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 1 -- 172.21.15.144:0/6587877 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7f19c4037020 con 0x56471c18fb20 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 10 client.9993 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 10 client.9993 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 20 client.9993 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x56471c19e280 0x56471c1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 4 client.9993 mds_command: new command op to 9795 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 -- 172.21.15.144:0/6587877 --> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56471bf2ec00 con 0x56471c19e280 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5200640 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x56471c19e280 0x56471c1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19d5200640 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x56471c19e280 0x56471c1a0670 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf130ff5fcb3642 server_cookie=21c9bf4901344c0f in_seq=0 out_seq=0 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 10 client.9993 ms_handle_connect on v2:172.21.15.144:6836/249899092 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 1 -- 172.21.15.144:0/6587877 <== mds.0 v2:172.21.15.144:6836/249899092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56471bf2ec00 con 0x56471c19e280 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 10 client.9993 handle_command_reply: tid=0 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 client.9993 shutdown 2024-09-12T12:24:50.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 -- 172.21.15.144:0/6587877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 msgr2=0x56471c14adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14adf0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009200 tx=0x7f19c4004690 comp rx=0 tx=0).stop 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 -- 172.21.15.144:0/6587877 shutdown_connections 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x56471c19e280 0x56471c1a0670 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19b6a00640 0 client.9993 ms_handle_reset on v2:172.21.15.144:6836/249899092 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 --2- 172.21.15.144:0/6587877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14adf0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 -- 172.21.15.144:0/6587877 >> 172.21.15.144:0/6587877 conn(0x56471c146290 msgr2=0x56471c144d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 -- 172.21.15.144:0/6587877 shutdown_connections 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 1 -- 172.21.15.144:0/6587877 wait complete. 2024-09-12T12:24:50.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.563+0000 7f19dba6c000 20 client.9993 trim_cache size 0 max 16384 2024-09-12T12:24:50.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 Processor -- start 2024-09-12T12:24:50.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 -- start start 2024-09-12T12:24:50.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f19d0204400 con 0x56471c18fb20 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19d00aee90 con 0x56471c190440 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f19d0202e00 con 0x56471c14b330 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52974/0 (socket says 172.21.15.144:52974) 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5200640 1 -- 172.21.15.144:0/2507318012 learned_addr learned my addr 172.21.15.144:0/2507318012 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d6600640 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5c00640 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5200640 1 -- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 msgr2=0x56471c14a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5200640 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c14a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5200640 1 -- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 msgr2=0x56471c1a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5200640 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c1a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5200640 1 -- 172.21.15.144:0/2507318012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471c19b8e0 con 0x56471c18fb20 2024-09-12T12:24:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5c00640 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d6600640 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19d5200640 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14ab30 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f19bc083d60 tx=0x7f19bc083c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c5ae6aa1679c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19c1600640 1 -- 172.21.15.144:0/2507318012 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc01f040 con 0x56471c18fb20 2024-09-12T12:24:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19c1600640 1 -- 172.21.15.144:0/2507318012 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc054020 con 0x56471c18fb20 2024-09-12T12:24:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19c1600640 1 -- 172.21.15.144:0/2507318012 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc055170 con 0x56471c18fb20 2024-09-12T12:24:50.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 -- 172.21.15.144:0/2507318012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 msgr2=0x56471c14ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.583+0000 7f19dba6c000 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14ab30 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f19bc083d60 tx=0x7f19bc083c30 comp rx=0 tx=0).stop 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- 172.21.15.144:0/2507318012 shutdown_connections 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c190440 0x56471c1a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c18fb20 0x56471c14ab30 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 --2- 172.21.15.144:0/2507318012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c14b330 0x56471c14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- 172.21.15.144:0/2507318012 >> 172.21.15.144:0/2507318012 conn(0x56471c146290 msgr2=0x56471c1a38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- 172.21.15.144:0/2507318012 shutdown_connections 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- 172.21.15.144:0/2507318012 wait complete. 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- start start 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 Processor -- start 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c14b330 0x56471c1a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c18fb20 0x56471c1c7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c190440 0x56471c1c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56471bf93f80 con 0x56471c190440 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56471bf4cca0 con 0x56471c14b330 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56471bf992a0 con 0x56471c18fb20 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 10 client.0 _ll_register_callbacks cb 0x7f19c4022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d6600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c190440 0x56471c1c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d5c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c14b330 0x56471c1a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d6600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c190440 0x56471c1c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52980/0 (socket says 172.21.15.144:52980) 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d6600640 1 -- 172.21.15.144:0/4227515598 learned_addr learned my addr 172.21.15.144:0/4227515598 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d5200640 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c18fb20 0x56471c1c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d6600640 1 -- 172.21.15.144:0/4227515598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c18fb20 msgr2=0x56471c1c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d6600640 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c18fb20 0x56471c1c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d6600640 1 -- 172.21.15.144:0/4227515598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c14b330 msgr2=0x56471c1a2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d6600640 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c14b330 0x56471c1a2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d6600640 1 -- 172.21.15.144:0/4227515598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56471c190270 con 0x56471c190440 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d5c00640 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c14b330 0x56471c1a2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d5200640 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c18fb20 0x56471c1c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19d6600640 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c190440 0x56471c1c76b0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f19c801d290 tx=0x7f19c801b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6253d4a7520e9a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19b6a00640 1 -- 172.21.15.144:0/4227515598 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c80c5020 con 0x56471c190440 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19b6a00640 1 -- 172.21.15.144:0/4227515598 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f19c80a5c00 con 0x56471c190440 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- 172.21.15.144:0/4227515598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19bc054020 con 0x56471c190440 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19b6a00640 1 -- 172.21.15.144:0/4227515598 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7f19c80cf050 con 0x56471c190440 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 10 client.9999 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- 172.21.15.144:0/4227515598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x56471bf1bfd0 con 0x56471c190440 2024-09-12T12:24:50.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19b6a00640 1 -- 172.21.15.144:0/4227515598 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc054020 con 0x56471c190440 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19b6a00640 1 -- 172.21.15.144:0/4227515598 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7f19c80d2020 con 0x56471c190440 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 10 client.9999 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 10 client.9999 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 20 client.9999 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x56471c1c7bf0 0x56471c20b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 4 client.9999 mds_command: new command op to 9795 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.587+0000 7f19dba6c000 1 -- 172.21.15.144:0/4227515598 --> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] -- command(tid 0: {"prefix": "status"}) -- 0x56471bfa23a0 con 0x56471c1c7bf0 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d5c00640 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x56471c1c7bf0 0x56471c20b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d5c00640 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x56471c1c7bf0 0x56471c20b830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f4088e5eeb7a2f8 server_cookie=47f6a93f05e979a0 in_seq=0 out_seq=0 2024-09-12T12:24:50.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19b6a00640 10 client.9999 ms_handle_connect on v2:172.21.15.144:6836/249899092 2024-09-12T12:24:50.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19b6a00640 1 -- 172.21.15.144:0/4227515598 <== mds.0 v2:172.21.15.144:6836/249899092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x56471bfa23a0 con 0x56471c1c7bf0 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19b6a00640 10 client.9999 handle_command_reply: tid=0 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 client.9999 shutdown 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 -- 172.21.15.144:0/4227515598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c190440 msgr2=0x56471c1c76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c190440 0x56471c1c76b0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f19c801d290 tx=0x7f19c801b230 comp rx=0 tx=0).stop 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 -- 172.21.15.144:0/4227515598 shutdown_connections 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.144:6836/249899092,v1:172.21.15.144:6837/249899092] conn(0x56471c1c7bf0 0x56471c20b830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56471c190440 0x56471c1c76b0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56471c18fb20 0x56471c1c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 --2- 172.21.15.144:0/4227515598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56471c14b330 0x56471c1a2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19b6a00640 0 client.9999 ms_handle_reset on v2:172.21.15.144:6836/249899092 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 -- 172.21.15.144:0/4227515598 >> 172.21.15.144:0/4227515598 conn(0x56471c146290 msgr2=0x56471c14a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 -- 172.21.15.144:0/4227515598 shutdown_connections 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 1 -- 172.21.15.144:0/4227515598 wait complete. 2024-09-12T12:24:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19dba6c000 20 client.9999 trim_cache size 0 max 16384 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 9795, 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 34.210498109, 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 139, 2024-09-12T12:24:50.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 178, 2024-09-12T12:24:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 178, 2024-09-12T12:24:50.598 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 39.092744384 2024-09-12T12:24:50.598 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:24:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 -- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19b00678c0 msgr2=0x7f19b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19b00678c0 0x7f19b0069d80 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f19c40098b0 tx=0x7f19c4008040 comp rx=0 tx=0).stop 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 -- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 msgr2=0x7f19d0164610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 0x7f19d0164610 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00c820 tx=0x7f19bc00cce0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 -- 172.21.15.144:0/1705067501 shutdown_connections 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f19b00678c0 0x7f19b0069d80 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19d015b4e0 0x7f19d0164b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19d00ccf30 0x7f19d0164610 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 --2- 172.21.15.144:0/1705067501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d0071420 0x7f19d01578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 -- 172.21.15.144:0/1705067501 >> 172.21.15.144:0/1705067501 conn(0x7f19d006d0d0 msgr2=0x7f19d015efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 -- 172.21.15.144:0/1705067501 shutdown_connections 2024-09-12T12:24:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.591+0000 7f19d8600640 1 -- 172.21.15.144:0/1705067501 wait complete. 2024-09-12T12:24:50.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b scrub start /scrub_control_test_path recursive 2024-09-12T12:24:50.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70ee600640 1 Processor -- start 2024-09-12T12:24:50.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70ee600640 1 -- start start 2024-09-12T12:24:50.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70ee600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f70e806cff0 0x7f70e806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70ee600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e806cd20 con 0x7f70e8156c10 2024-09-12T12:24:50.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70ee600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e8072780 con 0x7f70e8073360 2024-09-12T12:24:50.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70ee600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f70e806d990 con 0x7f70e806cff0 2024-09-12T12:24:50.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70e7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f70e8156c10 0x7f70e8072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47152/0 (socket says 172.21.15.144:47152) 2024-09-12T12:24:50.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70e7400640 1 -- 172.21.15.144:0/317724211 learned_addr learned my addr 172.21.15.144:0/317724211 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:50.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70dea00640 1 --2- 172.21.15.144:0/317724211 >> v2:172.21.15.165:3300/0 conn(0x7f70e806cff0 0x7f70e806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553876487 0 0) 0x7f70e806cd20 con 0x7f70e8156c10 2024-09-12T12:24:50.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.751+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70cc003530 con 0x7f70e8156c10 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 55377749 0 0) 0x7f70cc003530 con 0x7f70e8156c10 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 >> v2:172.21.15.165:3300/0 conn(0x7f70e806cff0 msgr2=0x7f70e806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 --2- 172.21.15.144:0/317724211 >> v2:172.21.15.165:3300/0 conn(0x7f70e806cff0 0x7f70e806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 >> v1:172.21.15.165:6789/0 conn(0x7f70e8073360 legacy=0x7f70e80737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e80712b0 con 0x7f70e8156c10 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f70d8001a00 con 0x7f70e8156c10 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 >> v1:172.21.15.144:6789/0 conn(0x7f70e8156c10 legacy=0x7f70e8072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70cc003a10 0x7f70cc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70cc004810 0x7f70cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc0051d0 0x7f70cc00fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc0104b0 con 0x7f70cc0051d0 2024-09-12T12:24:50.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc010660 con 0x7f70cc004810 2024-09-12T12:24:50.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f70cc010860 con 0x7f70cc003a10 2024-09-12T12:24:50.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e7e00640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc0051d0 0x7f70cc00fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70dea00640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70cc004810 0x7f70cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e7400640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70cc003a10 0x7f70cc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e7e00640 1 -- 172.21.15.144:0/317724211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70cc003a10 msgr2=0x7f70cc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e7e00640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70cc003a10 0x7f70cc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e7e00640 1 -- 172.21.15.144:0/317724211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70cc004810 msgr2=0x7f70cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e7e00640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70cc004810 0x7f70cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e7e00640 1 -- 172.21.15.144:0/317724211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc003530 con 0x7f70cc0051d0 2024-09-12T12:24:50.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e7e00640 1 -- 172.21.15.144:0/317724211 reap_dead start 2024-09-12T12:24:50.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e7e00640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc0051d0 0x7f70cc00fde0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f70e0001780 tx=0x7f70e001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411f1ecdbfc39b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e00013a0 con 0x7f70cc0051d0 2024-09-12T12:24:50.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e00a9070 con 0x7f70cc0051d0 2024-09-12T12:24:50.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.755+0000 7f70e6a00640 1 -- 172.21.15.144:0/317724211 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0003600 con 0x7f70cc0051d0 2024-09-12T12:24:50.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 -- 172.21.15.144:0/317724211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc0051d0 msgr2=0x7f70cc00fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc0051d0 0x7f70cc00fde0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f70e0001780 tx=0x7f70e001c420 comp rx=0 tx=0).stop 2024-09-12T12:24:50.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 -- 172.21.15.144:0/317724211 shutdown_connections 2024-09-12T12:24:50.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 --2- 172.21.15.144:0/317724211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70cc0051d0 0x7f70cc00fde0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 -- 172.21.15.144:0/317724211 >> 172.21.15.144:0/317724211 conn(0x7f70e806bc10 msgr2=0x7f70e806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 -- 172.21.15.144:0/317724211 shutdown_connections 2024-09-12T12:24:50.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 -- 172.21.15.144:0/317724211 wait complete. 2024-09-12T12:24:50.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 Processor -- start 2024-09-12T12:24:50.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 -- start start 2024-09-12T12:24:50.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70cc0051d0 0x7f70e814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70e81572f0 0x7f70e8149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e815b6a0 0x7f70e815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8071870 con 0x7f70e815b6a0 2024-09-12T12:24:50.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8071be0 con 0x7f70e81572f0 2024-09-12T12:24:50.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70ee600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f70e8156ff0 con 0x7f70cc0051d0 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e815b6a0 0x7f70e815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e815b6a0 0x7f70e815bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52998/0 (socket says 172.21.15.144:52998) 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7e00640 1 -- 172.21.15.144:0/618874267 learned_addr learned my addr 172.21.15.144:0/618874267 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7400640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70cc0051d0 0x7f70e814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70dea00640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70e81572f0 0x7f70e8149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7e00640 1 -- 172.21.15.144:0/618874267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70cc0051d0 msgr2=0x7f70e814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7e00640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70cc0051d0 0x7f70e814daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7e00640 1 -- 172.21.15.144:0/618874267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70e81572f0 msgr2=0x7f70e8149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7e00640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70e81572f0 0x7f70e8149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7e00640 1 -- 172.21.15.144:0/618874267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e8157820 con 0x7f70e815b6a0 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70e7400640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70cc0051d0 0x7f70e814daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.759+0000 7f70dea00640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70e81572f0 0x7f70e8149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:50.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.763+0000 7f70e7e00640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70e815b6a0 0x7f70e815bb20 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f70e0097e30 tx=0x7f70cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.763+0000 7f70dfe00640 1 -- 172.21.15.144:0/618874267 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0007a40 con 0x7f70e815b6a0 2024-09-12T12:24:50.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.763+0000 7f70dfe00640 1 -- 172.21.15.144:0/618874267 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e00050d0 con 0x7f70e815b6a0 2024-09-12T12:24:50.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.763+0000 7f70dfe00640 1 -- 172.21.15.144:0/618874267 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0007030 con 0x7f70e815b6a0 2024-09-12T12:24:50.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.763+0000 7f70ee600640 1 -- 172.21.15.144:0/618874267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e8157b00 con 0x7f70e815b6a0 2024-09-12T12:24:50.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.763+0000 7f70ee600640 1 -- 172.21.15.144:0/618874267 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e81580c0 con 0x7f70e815b6a0 2024-09-12T12:24:50.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.763+0000 7f70dfe00640 1 -- 172.21.15.144:0/618874267 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70e00b5030 con 0x7f70e815b6a0 2024-09-12T12:24:50.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dfe00640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70c40678c0 0x7f70c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dfe00640 1 -- 172.21.15.144:0/618874267 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f70e011efb0 con 0x7f70e815b6a0 2024-09-12T12:24:50.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70e7400640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70c40678c0 0x7f70c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 Processor -- start 2024-09-12T12:24:50.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 -- start start 2024-09-12T12:24:50.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70e7400640 1 --2- 172.21.15.144:0/618874267 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f70c40678c0 0x7f70c4069d80 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f70d8002240 tx=0x7f70d8001280 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 0x55f4cf78cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf7400b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf7409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f4cf629d30 con 0x55f4cf78d0c0 2024-09-12T12:24:50.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f4cf58fbd0 con 0x55f4cf78c7a0 2024-09-12T12:24:50.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f4cf5352a0 con 0x55f4cf7405f0 2024-09-12T12:24:50.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf7400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf7400b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53012/0 (socket says 172.21.15.144:53012) 2024-09-12T12:24:50.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dea00640 1 -- 172.21.15.144:0/1187792288 learned_addr learned my addr 172.21.15.144:0/1187792288 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70e7400640 1 --2- 172.21.15.144:0/1187792288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 0x55f4cf78cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70e7e00640 1 --2- 172.21.15.144:0/1187792288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf7409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dea00640 1 -- 172.21.15.144:0/1187792288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 msgr2=0x55f4cf7409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dea00640 1 --2- 172.21.15.144:0/1187792288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf7409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dea00640 1 -- 172.21.15.144:0/1187792288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 msgr2=0x55f4cf78cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dea00640 1 --2- 172.21.15.144:0/1187792288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 0x55f4cf78cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dea00640 1 -- 172.21.15.144:0/1187792288 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4cf5629f0 con 0x55f4cf78d0c0 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70dea00640 1 --2- 172.21.15.144:0/1187792288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf7400b0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009b20 tx=0x7f70d0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c29ad8d97dd4a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70d7e00640 1 -- 172.21.15.144:0/1187792288 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d001b070 con 0x55f4cf78d0c0 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70d7e00640 1 -- 172.21.15.144:0/1187792288 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d0013bf0 con 0x55f4cf78d0c0 2024-09-12T12:24:50.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70d7e00640 1 -- 172.21.15.144:0/1187792288 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d0016460 con 0x55f4cf78d0c0 2024-09-12T12:24:50.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 -- 172.21.15.144:0/1187792288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 msgr2=0x55f4cf7400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1187792288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf7400b0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009b20 tx=0x7f70d0009190 comp rx=0 tx=0).stop 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 -- 172.21.15.144:0/1187792288 shutdown_connections 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1187792288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf7409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1187792288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf7400b0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1187792288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 0x55f4cf78cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 -- 172.21.15.144:0/1187792288 >> 172.21.15.144:0/1187792288 conn(0x55f4cf76da40 msgr2=0x55f4cf76fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 -- 172.21.15.144:0/1187792288 shutdown_connections 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.767+0000 7f70f19f1000 1 -- 172.21.15.144:0/1187792288 wait complete. 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 -- start start 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 Processor -- start 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf7405f0 0x55f4cf747d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf78c7a0 0x55f4cf748260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf76de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f4cf58bb90 con 0x55f4cf78d0c0 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f4cf557490 con 0x55f4cf7405f0 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f4cf546810 con 0x55f4cf78c7a0 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 10 client.0 _ll_register_callbacks cb 0x55f4cf72dd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf76de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf76de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53022/0 (socket says 172.21.15.144:53022) 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7e00640 1 -- 172.21.15.144:0/1544922030 learned_addr learned my addr 172.21.15.144:0/1544922030 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70dea00640 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf78c7a0 0x55f4cf748260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7400640 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf7405f0 0x55f4cf747d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7e00640 1 -- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf78c7a0 msgr2=0x55f4cf748260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7e00640 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf78c7a0 0x55f4cf748260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7e00640 1 -- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf7405f0 msgr2=0x55f4cf747d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7e00640 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf7405f0 0x55f4cf747d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7e00640 1 -- 172.21.15.144:0/1544922030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4cf5354d0 con 0x55f4cf78d0c0 2024-09-12T12:24:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7e00640 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf76de20 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f70e00ef0e0 tx=0x7f70e00ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ed57ea0a98e241 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70d4c00640 1 -- 172.21.15.144:0/1544922030 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e00bc070 con 0x55f4cf78d0c0 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70d4c00640 1 -- 172.21.15.144:0/1544922030 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f70e00f3220 con 0x55f4cf78d0c0 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 -- 172.21.15.144:0/1544922030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70d0013bf0 con 0x55f4cf78d0c0 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70d4c00640 1 -- 172.21.15.144:0/1544922030 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7f70e011b050 con 0x55f4cf78d0c0 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 10 client.10011 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 -- 172.21.15.144:0/1544922030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55f4cf52f500 con 0x55f4cf78d0c0 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70d4c00640 1 -- 172.21.15.144:0/1544922030 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d0013bf0 con 0x55f4cf78d0c0 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70d4c00640 1 -- 172.21.15.144:0/1544922030 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7f70e0116ba0 con 0x55f4cf78d0c0 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 10 client.10011 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 10 client.10011 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 20 client.10011 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55f4cf792910 0x55f4cf792cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 4 client.10011 mds_command: new command op to 9256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:24:50.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70f19f1000 1 -- 172.21.15.144:0/1544922030 --> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4cf529b20 con 0x55f4cf792910 2024-09-12T12:24:50.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.771+0000 7f70e7400640 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55f4cf792910 0x55f4cf792cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70e7400640 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55f4cf792910 0x55f4cf792cf0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9256 client_cookie=258fa8e8def67688 server_cookie=e9bf07e05243a8a6 in_seq=0 out_seq=0 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70d4c00640 10 client.10011 ms_handle_connect on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70d4c00640 1 -- 172.21.15.144:0/1544922030 <== mds.9256 v2:172.21.15.165:6832/2468859076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4cf529b20 con 0x55f4cf792910 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70d4c00640 10 client.10011 handle_command_reply: tid=0 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 client.10011 shutdown 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 -- 172.21.15.144:0/1544922030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 msgr2=0x55f4cf76de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf76de20 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f70e00ef0e0 tx=0x7f70e00ef910 comp rx=0 tx=0).stop 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 -- 172.21.15.144:0/1544922030 shutdown_connections 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55f4cf792910 0x55f4cf792cf0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78d0c0 0x55f4cf76de20 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf78c7a0 0x55f4cf748260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70d4c00640 0 client.10011 ms_handle_reset on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:50.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 --2- 172.21.15.144:0/1544922030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf7405f0 0x55f4cf747d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 -- 172.21.15.144:0/1544922030 >> 172.21.15.144:0/1544922030 conn(0x55f4cf76da40 msgr2=0x55f4cf73f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 -- 172.21.15.144:0/1544922030 shutdown_connections 2024-09-12T12:24:50.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 1 -- 172.21.15.144:0/1544922030 wait complete. 2024-09-12T12:24:50.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.775+0000 7f70f19f1000 20 client.10011 trim_cache size 0 max 16384 2024-09-12T12:24:50.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.791+0000 7f70f19f1000 1 Processor -- start 2024-09-12T12:24:50.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.791+0000 7f70f19f1000 1 -- start start 2024-09-12T12:24:50.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf76da40 0x55f4cf78bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf78c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 0x55f4cf7a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f70e81fd1a0 con 0x55f4cf76da40 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f70e815f740 con 0x55f4cf78c7a0 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f70e81fbc40 con 0x55f4cf7405f0 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf76da40 0x55f4cf78bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf76da40 0x55f4cf78bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53034/0 (socket says 172.21.15.144:53034) 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7400640 1 -- 172.21.15.144:0/3625600013 learned_addr learned my addr 172.21.15.144:0/3625600013 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70dea00640 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf78c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7e00640 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 0x55f4cf7a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7400640 1 -- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 msgr2=0x55f4cf78c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7400640 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf78c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7400640 1 -- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 msgr2=0x55f4cf7a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7400640 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 0x55f4cf7a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7400640 1 -- 172.21.15.144:0/3625600013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4cf54d5f0 con 0x55f4cf76da40 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70dea00640 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf78c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7e00640 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 0x55f4cf7a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:50.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70e7400640 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf76da40 0x55f4cf78bbf0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f70d8007420 tx=0x7f70d8009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d908955624c901 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70d7400640 1 -- 172.21.15.144:0/3625600013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8010040 con 0x55f4cf76da40 2024-09-12T12:24:50.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70d7400640 1 -- 172.21.15.144:0/3625600013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d801b040 con 0x55f4cf76da40 2024-09-12T12:24:50.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70d7400640 1 -- 172.21.15.144:0/3625600013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d802a780 con 0x55f4cf76da40 2024-09-12T12:24:50.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- 172.21.15.144:0/3625600013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf76da40 msgr2=0x55f4cf78bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf76da40 0x55f4cf78bbf0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f70d8007420 tx=0x7f70d8009000 comp rx=0 tx=0).stop 2024-09-12T12:24:50.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- 172.21.15.144:0/3625600013 shutdown_connections 2024-09-12T12:24:50.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf78c7a0 0x55f4cf7a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf78c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3625600013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf76da40 0x55f4cf78bbf0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- 172.21.15.144:0/3625600013 >> 172.21.15.144:0/3625600013 conn(0x55f4cf7451e0 msgr2=0x55f4cf798f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- 172.21.15.144:0/3625600013 shutdown_connections 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- 172.21.15.144:0/3625600013 wait complete. 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- start start 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 Processor -- start 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf797fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf76da40 0x55f4cf7984f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78c7a0 0x55f4cf796260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f4cf64d850 con 0x55f4cf78c7a0 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f4cf5462b0 con 0x55f4cf76da40 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f4cf536d80 con 0x55f4cf7405f0 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.795+0000 7f70f19f1000 10 client.0 _ll_register_callbacks cb 0x7f70e00eecd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf797fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70dea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf76da40 0x55f4cf7984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf797fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:35956/0 (socket says 172.21.15.144:35956) 2024-09-12T12:24:50.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7400640 1 -- 172.21.15.144:0/3091409505 learned_addr learned my addr 172.21.15.144:0/3091409505 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7e00640 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78c7a0 0x55f4cf796260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7400640 1 -- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf76da40 msgr2=0x55f4cf7984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7400640 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf76da40 0x55f4cf7984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7400640 1 -- 172.21.15.144:0/3091409505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78c7a0 msgr2=0x55f4cf796260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7400640 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78c7a0 0x55f4cf796260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7400640 1 -- 172.21.15.144:0/3091409505 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f4cf59ae10 con 0x55f4cf7405f0 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70dea00640 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf76da40 0x55f4cf7984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7e00640 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78c7a0 0x55f4cf796260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70e7400640 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf797fb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70d8005fd0 tx=0x7f70e8071480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78214da3445cdf3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 1 -- 172.21.15.144:0/3091409505 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8037070 con 0x55f4cf7405f0 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 1 -- 172.21.15.144:0/3091409505 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f70d802aa00 con 0x55f4cf7405f0 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 -- 172.21.15.144:0/3091409505 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70d801b040 con 0x55f4cf7405f0 2024-09-12T12:24:50.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 1 -- 172.21.15.144:0/3091409505 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7f70d8042050 con 0x55f4cf7405f0 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 10 client.8300 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 -- 172.21.15.144:0/3091409505 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55f4cf5e8cf0 con 0x55f4cf7405f0 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 1 -- 172.21.15.144:0/3091409505 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d801b040 con 0x55f4cf7405f0 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 1 -- 172.21.15.144:0/3091409505 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7f70d8045020 con 0x55f4cf7405f0 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 10 client.8300 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 10 client.8300 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 20 client.8300 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55f4cf78d0c0 0x55f4cf800470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 4 client.8300 mds_command: new command op to 9256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 -- 172.21.15.144:0/3091409505 --> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55f4cf59d300 con 0x55f4cf78d0c0 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70dea00640 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55f4cf78d0c0 0x55f4cf800470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70dea00640 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55f4cf78d0c0 0x55f4cf800470 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9256 client_cookie=5c30346d50c49550 server_cookie=a1e9143412b9264d in_seq=0 out_seq=0 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 10 client.8300 ms_handle_connect on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:50.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 1 -- 172.21.15.144:0/3091409505 <== mds.9256 v2:172.21.15.165:6832/2468859076 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55f4cf59d300 con 0x55f4cf78d0c0 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 10 client.8300 handle_command_reply: tid=0 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 client.8300 shutdown 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 -- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 msgr2=0x55f4cf797fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf797fb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70d8005fd0 tx=0x7f70e8071480 comp rx=0 tx=0).stop 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 -- 172.21.15.144:0/3091409505 shutdown_connections 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55f4cf78d0c0 0x55f4cf800470 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f4cf78c7a0 0x55f4cf796260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f4cf76da40 0x55f4cf7984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70d4c00640 0 client.8300 ms_handle_reset on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 --2- 172.21.15.144:0/3091409505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f4cf7405f0 0x55f4cf797fb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 -- 172.21.15.144:0/3091409505 >> 172.21.15.144:0/3091409505 conn(0x55f4cf7451e0 msgr2=0x55f4cf78abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 -- 172.21.15.144:0/3091409505 shutdown_connections 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 1 -- 172.21.15.144:0/3091409505 wait complete. 2024-09-12T12:24:50.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.799+0000 7f70f19f1000 20 client.8300 trim_cache size 0 max 16384 2024-09-12T12:24:50.806 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: MDS is not active 2024-09-12T12:24:50.808 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T12:24:50.808 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b scrub pause 2024-09-12T12:24:50.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.943+0000 7fe3abc00640 1 Processor -- start 2024-09-12T12:24:50.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.943+0000 7fe3abc00640 1 -- start start 2024-09-12T12:24:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3abc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe3a415af60 0x7fe3a40ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3abc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 0x7fe3a406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3abc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe3a415b340 0x7fe3a406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3abc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a40b32f0 con 0x7fe3a415af60 2024-09-12T12:24:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3abc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a40b4300 con 0x7fe3a415b340 2024-09-12T12:24:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3abc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a40b3540 con 0x7fe3a40cd9f0 2024-09-12T12:24:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a9200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe3a415af60 0x7fe3a40ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a9200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe3a415af60 0x7fe3a40ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53048/0 (socket says 172.21.15.144:53048) 2024-09-12T12:24:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a9200640 1 -- 172.21.15.144:0/74162745 learned_addr learned my addr 172.21.15.144:0/74162745 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a3e00640 1 --2- 172.21.15.144:0/74162745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 0x7fe3a406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/74162745 >> v2:172.21.15.165:3300/0 conn(0x7fe3a415b340 0x7fe3a406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a9200640 1 -- 172.21.15.144:0/74162745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 msgr2=0x7fe3a406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a9200640 1 --2- 172.21.15.144:0/74162745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 0x7fe3a406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a9200640 1 -- 172.21.15.144:0/74162745 >> v2:172.21.15.165:3300/0 conn(0x7fe3a415b340 msgr2=0x7fe3a406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a9200640 1 --2- 172.21.15.144:0/74162745 >> v2:172.21.15.165:3300/0 conn(0x7fe3a415b340 0x7fe3a406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.947+0000 7fe3a9200640 1 -- 172.21.15.144:0/74162745 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a40b3820 con 0x7fe3a415af60 2024-09-12T12:24:50.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3a9200640 1 --2- 172.21.15.144:0/74162745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a415af60 0x7fe3a40ce680 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40cfa80 tx=0x7fe39401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c84d1b7b5b62618 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3a3400640 1 -- 172.21.15.144:0/74162745 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3940b4070 con 0x7fe3a415af60 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3a3400640 1 -- 172.21.15.144:0/74162745 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3940af400 con 0x7fe3a415af60 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3a3400640 1 -- 172.21.15.144:0/74162745 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3940af7d0 con 0x7fe3a415af60 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 -- 172.21.15.144:0/74162745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a415af60 msgr2=0x7fe3a40ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 --2- 172.21.15.144:0/74162745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a415af60 0x7fe3a40ce680 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40cfa80 tx=0x7fe39401f1e0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 -- 172.21.15.144:0/74162745 shutdown_connections 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 --2- 172.21.15.144:0/74162745 >> v2:172.21.15.165:3300/0 conn(0x7fe3a415b340 0x7fe3a406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 --2- 172.21.15.144:0/74162745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 0x7fe3a406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 --2- 172.21.15.144:0/74162745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a415af60 0x7fe3a40ce680 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 -- 172.21.15.144:0/74162745 >> 172.21.15.144:0/74162745 conn(0x7fe3a4068030 msgr2=0x7fe3a40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 -- 172.21.15.144:0/74162745 shutdown_connections 2024-09-12T12:24:50.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 -- 172.21.15.144:0/74162745 wait complete. 2024-09-12T12:24:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 Processor -- start 2024-09-12T12:24:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.951+0000 7fe3abc00640 1 -- start start 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3abc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 0x7fe3a415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3abc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a415af60 0x7fe3a40aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3abc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a415b340 0x7fe3a4149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3abc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a40cebc0 con 0x7fe3a415b340 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3abc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a40b3de0 con 0x7fe3a415af60 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3abc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a40ced40 con 0x7fe3a40cd9f0 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a415b340 0x7fe3a4149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 0x7fe3a415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a415b340 0x7fe3a4149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53060/0 (socket says 172.21.15.144:53060) 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9c00640 1 -- 172.21.15.144:0/3665794739 learned_addr learned my addr 172.21.15.144:0/3665794739 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 0x7fe3a415b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:35988/0 (socket says 172.21.15.144:35988) 2024-09-12T12:24:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a3e00640 1 --2- 172.21.15.144:0/3665794739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a415af60 0x7fe3a40aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9c00640 1 -- 172.21.15.144:0/3665794739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 msgr2=0x7fe3a415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/3665794739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3a40cd9f0 0x7fe3a415b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9c00640 1 -- 172.21.15.144:0/3665794739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a415af60 msgr2=0x7fe3a40aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/3665794739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3a415af60 0x7fe3a40aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9c00640 1 -- 172.21.15.144:0/3665794739 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a414ad60 con 0x7fe3a415b340 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/3665794739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a415b340 0x7fe3a4149270 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00d560 tx=0x7fe39c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a0c00640 1 -- 172.21.15.144:0/3665794739 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0125f0 con 0x7fe3a415b340 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a0c00640 1 -- 172.21.15.144:0/3665794739 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c019070 con 0x7fe3a415b340 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a0c00640 1 -- 172.21.15.144:0/3665794739 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0129f0 con 0x7fe3a415b340 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3abc00640 1 -- 172.21.15.144:0/3665794739 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a415bd50 con 0x7fe3a415b340 2024-09-12T12:24:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3abc00640 1 -- 172.21.15.144:0/3665794739 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a414e920 con 0x7fe3a415b340 2024-09-12T12:24:50.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.955+0000 7fe3a0c00640 1 -- 172.21.15.144:0/3665794739 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe39c012b90 con 0x7fe3a415b340 2024-09-12T12:24:50.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a0c00640 1 --2- 172.21.15.144:0/3665794739 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3840678f0 0x7fe384069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a0c00640 1 -- 172.21.15.144:0/3665794739 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fe39c0860b0 con 0x7fe3a415b340 2024-09-12T12:24:50.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 --2- 172.21.15.144:0/3665794739 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3840678f0 0x7fe384069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 Processor -- start 2024-09-12T12:24:50.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 -- start start 2024-09-12T12:24:50.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 --2- 172.21.15.144:0/3665794739 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3840678f0 0x7fe384069db0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe3940b1000 tx=0x7fe3940aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31d9f1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9f1ca0 0x55b31d9a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9a5420 0x55b31d9a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b31d7aa5b0 con 0x55b31d9f1380 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b31d7f4bf0 con 0x55b31d9a5420 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b31d7af900 con 0x55b31d9f1ca0 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31d9f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31d9f1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53076/0 (socket says 172.21.15.144:53076) 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 -- 172.21.15.144:0/634056733 learned_addr learned my addr 172.21.15.144:0/634056733 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a3e00640 1 --2- 172.21.15.144:0/634056733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9f1ca0 0x55b31d9a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/634056733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9a5420 0x55b31d9a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 -- 172.21.15.144:0/634056733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9f1ca0 msgr2=0x55b31d9a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 --2- 172.21.15.144:0/634056733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9f1ca0 0x55b31d9a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 -- 172.21.15.144:0/634056733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9a5420 msgr2=0x55b31d9a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 --2- 172.21.15.144:0/634056733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9a5420 0x55b31d9a5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 -- 172.21.15.144:0/634056733 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b31d7ae9d0 con 0x55b31d9f1380 2024-09-12T12:24:50.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3a9200640 1 --2- 172.21.15.144:0/634056733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31d9f1760 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fe3940bb040 tx=0x7fe394004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c4ae59d8153fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe399600640 1 -- 172.21.15.144:0/634056733 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3940b4040 con 0x55b31d9f1380 2024-09-12T12:24:50.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe399600640 1 -- 172.21.15.144:0/634056733 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3940b9a50 con 0x55b31d9f1380 2024-09-12T12:24:50.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe399600640 1 -- 172.21.15.144:0/634056733 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3940b9e00 con 0x55b31d9f1380 2024-09-12T12:24:50.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 -- 172.21.15.144:0/634056733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 msgr2=0x55b31d9f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.959+0000 7fe3aef03000 1 --2- 172.21.15.144:0/634056733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31d9f1760 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fe3940bb040 tx=0x7fe394004ac0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- 172.21.15.144:0/634056733 shutdown_connections 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 --2- 172.21.15.144:0/634056733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9a5420 0x55b31d9a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 --2- 172.21.15.144:0/634056733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9f1ca0 0x55b31d9a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 --2- 172.21.15.144:0/634056733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31d9f1760 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- 172.21.15.144:0/634056733 >> 172.21.15.144:0/634056733 conn(0x55b31d99ef30 msgr2=0x55b31d9d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- 172.21.15.144:0/634056733 shutdown_connections 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- 172.21.15.144:0/634056733 wait complete. 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- start start 2024-09-12T12:24:50.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 Processor -- start 2024-09-12T12:24:50.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31d9f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 0x55b31d9f8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b31d78e190 con 0x55b31d9f1ca0 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b31d7f0bb0 con 0x55b31d9f1380 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b31d7c4fb0 con 0x55b31d9a5420 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 10 client.0 _ll_register_callbacks cb 0x55b31d992910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9f8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53092/0 (socket says 172.21.15.144:53092) 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9c00640 1 -- 172.21.15.144:0/2588847314 learned_addr learned my addr 172.21.15.144:0/2588847314 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a3e00640 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 0x55b31d9f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9200640 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31d9f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9c00640 1 -- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 msgr2=0x55b31d9f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31d9f80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9c00640 1 -- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 msgr2=0x55b31d9f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 0x55b31d9f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9c00640 1 -- 172.21.15.144:0/2588847314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b31d7b1570 con 0x55b31d9f1ca0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9f8b60 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00dfd0 tx=0x7fe39c05a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1cb40ad0711e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe38e000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe38e000640 1 -- 172.21.15.144:0/2588847314 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c054750 con 0x55b31d9f1ca0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe38e000640 1 -- 172.21.15.144:0/2588847314 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fe39c06e0d0 con 0x55b31d9f1ca0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- 172.21.15.144:0/2588847314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3940b9a50 con 0x55b31d9f1ca0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe38e000640 1 -- 172.21.15.144:0/2588847314 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7fe39c073050 con 0x55b31d9f1ca0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 10 client.10029 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- 172.21.15.144:0/2588847314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55b31d7b53c0 con 0x55b31d9f1ca0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe38e000640 1 -- 172.21.15.144:0/2588847314 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3940b9a50 con 0x55b31d9f1ca0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe38e000640 1 -- 172.21.15.144:0/2588847314 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7fe39c013070 con 0x55b31d9f1ca0 2024-09-12T12:24:50.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 10 client.10029 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:50.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 10 client.10029 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:24:50.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 20 client.10029 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:50.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55b31da004b0 0x55b31da028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 4 client.10029 mds_command: new command op to 9256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:24:50.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.963+0000 7fe3aef03000 1 -- 172.21.15.144:0/2588847314 --> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b31d88d040 con 0x55b31da004b0 2024-09-12T12:24:50.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3a9200640 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55b31da004b0 0x55b31da028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3a9200640 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55b31da004b0 0x55b31da028a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9256 client_cookie=e5053e4b62681fbb server_cookie=2acb0286c0fa3d92 in_seq=0 out_seq=0 2024-09-12T12:24:50.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe38e000640 10 client.10029 ms_handle_connect on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:50.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe38e000640 1 -- 172.21.15.144:0/2588847314 <== mds.9256 v2:172.21.15.165:6832/2468859076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b31d88d040 con 0x55b31da004b0 2024-09-12T12:24:50.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe38e000640 10 client.10029 handle_command_reply: tid=0 2024-09-12T12:24:50.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 client.10029 shutdown 2024-09-12T12:24:50.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 -- 172.21.15.144:0/2588847314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 msgr2=0x55b31d9f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9f8b60 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00dfd0 tx=0x7fe39c05a7d0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 -- 172.21.15.144:0/2588847314 shutdown_connections 2024-09-12T12:24:50.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55b31da004b0 0x55b31da028a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9f8b60 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 0x55b31d9f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 --2- 172.21.15.144:0/2588847314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31d9f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 -- 172.21.15.144:0/2588847314 >> 172.21.15.144:0/2588847314 conn(0x55b31d99ef30 msgr2=0x55b31d9a45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe38e000640 0 client.10029 ms_handle_reset on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:50.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 -- 172.21.15.144:0/2588847314 shutdown_connections 2024-09-12T12:24:50.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 1 -- 172.21.15.144:0/2588847314 wait complete. 2024-09-12T12:24:50.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.967+0000 7fe3aef03000 20 client.10029 trim_cache size 0 max 16384 2024-09-12T12:24:50.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.983+0000 7fe3aef03000 1 Processor -- start 2024-09-12T12:24:50.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.983+0000 7fe3aef03000 1 -- start start 2024-09-12T12:24:50.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da05cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 0x55b31d9d6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9d6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4200bf0 con 0x55b31d9f1ca0 2024-09-12T12:24:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a42012c0 con 0x55b31d9f1380 2024-09-12T12:24:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a415db40 con 0x55b31d9a5420 2024-09-12T12:24:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9d6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9d6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53106/0 (socket says 172.21.15.144:53106) 2024-09-12T12:24:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9c00640 1 -- 172.21.15.144:0/3214907173 learned_addr learned my addr 172.21.15.144:0/3214907173 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9200640 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da05cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a3e00640 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 0x55b31d9d6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:50.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9c00640 1 -- 172.21.15.144:0/3214907173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 msgr2=0x55b31da05cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da05cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9c00640 1 -- 172.21.15.144:0/3214907173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 msgr2=0x55b31d9d6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 0x55b31d9d6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9c00640 1 -- 172.21.15.144:0/3214907173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b31d7945c0 con 0x55b31d9f1ca0 2024-09-12T12:24:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9200640 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da05cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:50.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9d6b50 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fe39c06e3b0 tx=0x7fe39c059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8c5d61485d9c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe398c00640 1 -- 172.21.15.144:0/3214907173 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c054750 con 0x55b31d9f1ca0 2024-09-12T12:24:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe398c00640 1 -- 172.21.15.144:0/3214907173 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c0557e0 con 0x55b31d9f1ca0 2024-09-12T12:24:50.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe398c00640 1 -- 172.21.15.144:0/3214907173 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c05a160 con 0x55b31d9f1ca0 2024-09-12T12:24:50.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- 172.21.15.144:0/3214907173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 msgr2=0x55b31d9d6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:50.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9d6b50 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fe39c06e3b0 tx=0x7fe39c059000 comp rx=0 tx=0).stop 2024-09-12T12:24:50.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- 172.21.15.144:0/3214907173 shutdown_connections 2024-09-12T12:24:50.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1ca0 0x55b31d9d6b50 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1380 0x55b31d9d6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- 172.21.15.144:0/3214907173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da05cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:50.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- 172.21.15.144:0/3214907173 >> 172.21.15.144:0/3214907173 conn(0x55b31d99ef30 msgr2=0x55b31d9d5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:50.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- 172.21.15.144:0/3214907173 shutdown_connections 2024-09-12T12:24:50.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- 172.21.15.144:0/3214907173 wait complete. 2024-09-12T12:24:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- start start 2024-09-12T12:24:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 Processor -- start 2024-09-12T12:24:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31da293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1ca0 0x55b31da298e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:50.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b31d7f21a0 con 0x55b31d9f1380 2024-09-12T12:24:51.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a415e190 con 0x55b31d9f1ca0 2024-09-12T12:24:51.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b31d794b00 con 0x55b31d9a5420 2024-09-12T12:24:51.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.987+0000 7fe3aef03000 10 client.0 _ll_register_callbacks cb 0x7fe39c056390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:51.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31da293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1ca0 0x55b31da298e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da052d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:36028/0 (socket says 172.21.15.144:36028) 2024-09-12T12:24:51.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9200640 1 -- 172.21.15.144:0/4278971073 learned_addr learned my addr 172.21.15.144:0/4278971073 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9200640 1 -- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1ca0 msgr2=0x55b31da298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9200640 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1ca0 0x55b31da298e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9200640 1 -- 172.21.15.144:0/4278971073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 msgr2=0x55b31da293a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9200640 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31da293a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9200640 1 -- 172.21.15.144:0/4278971073 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55b31d876280 con 0x55b31d9a5420 2024-09-12T12:24:51.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9c00640 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1ca0 0x55b31da298e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:51.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a3e00640 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31da293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:51.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a9200640 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da052d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe394009c90 tx=0x7fe39401da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5931a534afe54269 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-12T12:24:51.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 1 -- 172.21.15.144:0/4278971073 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3940b9e00 con 0x55b31d9a5420 2024-09-12T12:24:51.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 1 -- 172.21.15.144:0/4278971073 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fe3940dbcf0 con 0x55b31d9a5420 2024-09-12T12:24:51.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 -- 172.21.15.144:0/4278971073 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe39c0557e0 con 0x55b31d9a5420 2024-09-12T12:24:51.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 1 -- 172.21.15.144:0/4278971073 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7fe3940e2050 con 0x55b31d9a5420 2024-09-12T12:24:51.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 10 client.8318 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:51.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 -- 172.21.15.144:0/4278971073 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55b31d84d7d0 con 0x55b31d9a5420 2024-09-12T12:24:51.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 1 -- 172.21.15.144:0/4278971073 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c0557e0 con 0x55b31d9a5420 2024-09-12T12:24:51.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 1 -- 172.21.15.144:0/4278971073 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7fe3940e5020 con 0x55b31d9a5420 2024-09-12T12:24:51.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 10 client.8318 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:51.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 10 client.8318 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:24:51.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 20 client.8318 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:51.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55b31da29e20 0x55b31da6cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 4 client.8318 mds_command: new command op to 9256 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-12T12:24:51.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 -- 172.21.15.144:0/4278971073 --> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55b31d78e930 con 0x55b31da29e20 2024-09-12T12:24:51.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a3e00640 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55b31da29e20 0x55b31da6cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 10 client.8318 ms_handle_connect on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3a3e00640 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55b31da29e20 0x55b31da6cd80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9256 client_cookie=101ae86e6cb80d9d server_cookie=aafa58c307cc2df0 in_seq=0 out_seq=0 2024-09-12T12:24:51.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 1 -- 172.21.15.144:0/4278971073 <== mds.9256 v2:172.21.15.165:6832/2468859076 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55b31d78e930 con 0x55b31da29e20 2024-09-12T12:24:51.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 10 client.8318 handle_command_reply: tid=0 2024-09-12T12:24:51.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 client.8318 shutdown 2024-09-12T12:24:51.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 -- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 msgr2=0x55b31da052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da052d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe394009c90 tx=0x7fe39401da20 comp rx=0 tx=0).stop 2024-09-12T12:24:51.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 -- 172.21.15.144:0/4278971073 shutdown_connections 2024-09-12T12:24:51.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55b31da29e20 0x55b31da6cd80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b31d9f1ca0 0x55b31da298e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b31d9f1380 0x55b31da293a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 --2- 172.21.15.144:0/4278971073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b31d9a5420 0x55b31da052d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe38e000640 0 client.8318 ms_handle_reset on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 -- 172.21.15.144:0/4278971073 >> 172.21.15.144:0/4278971073 conn(0x55b31d99ef30 msgr2=0x55b31d9fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 -- 172.21.15.144:0/4278971073 shutdown_connections 2024-09-12T12:24:51.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 1 -- 172.21.15.144:0/4278971073 wait complete. 2024-09-12T12:24:51.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:50.991+0000 7fe3aef03000 20 client.8318 trim_cache size 0 max 16384 2024-09-12T12:24:51.008 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: MDS is not active 2024-09-12T12:24:51.009 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T12:24:51.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b scrub abort 2024-09-12T12:24:51.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.147+0000 7fd3b8000640 1 Processor -- start 2024-09-12T12:24:51.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.147+0000 7fd3b8000640 1 -- start start 2024-09-12T12:24:51.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b8000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd3b00b4b20 0x7fd3b015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b8000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3b00b4f00 0x7fd3b0162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b8000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3b00b3470 con 0x7fd3b00b3970 2024-09-12T12:24:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b8000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd3b015f270 con 0x7fd3b00b4b20 2024-09-12T12:24:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b8000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b015f550 con 0x7fd3b00b4f00 2024-09-12T12:24:51.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b5600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd3b00b4b20 0x7fd3b015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3b00b4f00 0x7fd3b0162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b5600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd3b00b4b20 0x7fd3b015eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33600/0 (socket says 172.21.15.144:33600) 2024-09-12T12:24:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b5600640 1 -- 172.21.15.144:0/3201144771 learned_addr learned my addr 172.21.15.144:0/3201144771 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b6000640 1 --1- 172.21.15.144:0/3201144771 >> v1:172.21.15.165:6789/0 conn(0x7fd3b00b3970 0x7fd3b0143c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:32978/0 (socket says 172.21.15.144:32978) 2024-09-12T12:24:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b5600640 1 -- 172.21.15.144:0/3201144771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3b00b4f00 msgr2=0x7fd3b0162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b5600640 1 --2- 172.21.15.144:0/3201144771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3b00b4f00 0x7fd3b0162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b5600640 1 -- 172.21.15.144:0/3201144771 >> v1:172.21.15.165:6789/0 conn(0x7fd3b00b3970 legacy=0x7fd3b0143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.151+0000 7fd3b5600640 1 -- 172.21.15.144:0/3201144771 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b015f830 con 0x7fd3b00b4b20 2024-09-12T12:24:51.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b5600640 1 --2- 172.21.15.144:0/3201144771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3b00b4b20 0x7fd3b015eb20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009e80 tx=0x7fd3a401c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48de7384656b8325 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3afe00640 1 -- 172.21.15.144:0/3201144771 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40a5640 con 0x7fd3b00b4b20 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3afe00640 1 -- 172.21.15.144:0/3201144771 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a40a57e0 con 0x7fd3b00b4b20 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3afe00640 1 -- 172.21.15.144:0/3201144771 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40a5bb0 con 0x7fd3b00b4b20 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 -- 172.21.15.144:0/3201144771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3b00b4b20 msgr2=0x7fd3b015eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 --2- 172.21.15.144:0/3201144771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3b00b4b20 0x7fd3b015eb20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009e80 tx=0x7fd3a401c980 comp rx=0 tx=0).stop 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 -- 172.21.15.144:0/3201144771 shutdown_connections 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 --2- 172.21.15.144:0/3201144771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3b00b4f00 0x7fd3b0162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 --2- 172.21.15.144:0/3201144771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3b00b4b20 0x7fd3b015eb20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 -- 172.21.15.144:0/3201144771 >> 172.21.15.144:0/3201144771 conn(0x7fd3b0068030 msgr2=0x7fd3b00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 -- 172.21.15.144:0/3201144771 shutdown_connections 2024-09-12T12:24:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 -- 172.21.15.144:0/3201144771 wait complete. 2024-09-12T12:24:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 Processor -- start 2024-09-12T12:24:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.155+0000 7fd3b8000640 1 -- start start 2024-09-12T12:24:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b8000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3b00b3970 0x7fd3b013cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b8000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3b00b4b20 0x7fd3b01fb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b8000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3b00b4f00 0x7fd3b01fb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b8000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b0144490 con 0x7fd3b00b4f00 2024-09-12T12:24:51.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b8000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b0144310 con 0x7fd3b00b3970 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b8000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b00cc2d0 con 0x7fd3b00b4b20 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3b00b4f00 0x7fd3b01fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b5600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3b00b3970 0x7fd3b013cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3b00b4b20 0x7fd3b01fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b5600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3b00b3970 0x7fd3b013cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33610/0 (socket says 172.21.15.144:33610) 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b5600640 1 -- 172.21.15.144:0/1659451495 learned_addr learned my addr 172.21.15.144:0/1659451495 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b6000640 1 -- 172.21.15.144:0/1659451495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3b00b4b20 msgr2=0x7fd3b01fb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b6000640 1 --2- 172.21.15.144:0/1659451495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3b00b4b20 0x7fd3b01fb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b6000640 1 -- 172.21.15.144:0/1659451495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3b00b3970 msgr2=0x7fd3b013cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b6000640 1 --2- 172.21.15.144:0/1659451495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3b00b3970 0x7fd3b013cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b6000640 1 -- 172.21.15.144:0/1659451495 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b013bbb0 con 0x7fd3b00b4f00 2024-09-12T12:24:51.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b6000640 1 --2- 172.21.15.144:0/1659451495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3b00b4f00 0x7fd3b01fb760 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c3c0 tx=0x7fd3a8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3ad600640 1 -- 172.21.15.144:0/1659451495 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a80074e0 con 0x7fd3b00b4f00 2024-09-12T12:24:51.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3ad600640 1 -- 172.21.15.144:0/1659451495 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a8007680 con 0x7fd3b00b4f00 2024-09-12T12:24:51.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3ad600640 1 -- 172.21.15.144:0/1659451495 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8004a10 con 0x7fd3b00b4f00 2024-09-12T12:24:51.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b8000640 1 -- 172.21.15.144:0/1659451495 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b013be50 con 0x7fd3b00b4f00 2024-09-12T12:24:51.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3b8000640 1 -- 172.21.15.144:0/1659451495 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b013c410 con 0x7fd3b00b4f00 2024-09-12T12:24:51.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.159+0000 7fd3ad600640 1 -- 172.21.15.144:0/1659451495 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd3a801a020 con 0x7fd3b00b4f00 2024-09-12T12:24:51.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3ad600640 1 --2- 172.21.15.144:0/1659451495 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3900678c0 0x7fd390069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3ad600640 1 -- 172.21.15.144:0/1659451495 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fd3a80854b0 con 0x7fd3b00b4f00 2024-09-12T12:24:51.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b5600640 1 --2- 172.21.15.144:0/1659451495 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3900678c0 0x7fd390069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 Processor -- start 2024-09-12T12:24:51.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 -- start start 2024-09-12T12:24:51.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b5600640 1 --2- 172.21.15.144:0/1659451495 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd3900678c0 0x7fd390069d80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009e80 tx=0x7fd3a40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78510760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510ca0 0x55ab784c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab784c4420 0x55ab784c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ab782c95b0 con 0x55ab78510ca0 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ab78313bf0 con 0x55ab784c4420 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ab782ce900 con 0x55ab78510380 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510ca0 0x55ab784c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510ca0 0x55ab784c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53130/0 (socket says 172.21.15.144:53130) 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b4c00640 1 -- 172.21.15.144:0/2279072540 learned_addr learned my addr 172.21.15.144:0/2279072540 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b5600640 1 --2- 172.21.15.144:0/2279072540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78510760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b6000640 1 --2- 172.21.15.144:0/2279072540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab784c4420 0x55ab784c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b4c00640 1 -- 172.21.15.144:0/2279072540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 msgr2=0x55ab78510760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/2279072540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78510760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b4c00640 1 -- 172.21.15.144:0/2279072540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab784c4420 msgr2=0x55ab784c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/2279072540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab784c4420 0x55ab784c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b4c00640 1 -- 172.21.15.144:0/2279072540 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab782cd9d0 con 0x55ab78510ca0 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/2279072540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510ca0 0x55ab784c3ee0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009ba0 tx=0x7fd39c011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b52e3389045d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3a2000640 1 -- 172.21.15.144:0/2279072540 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c019070 con 0x55ab78510ca0 2024-09-12T12:24:51.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3a2000640 1 -- 172.21.15.144:0/2279072540 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39c004030 con 0x55ab78510ca0 2024-09-12T12:24:51.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3a2000640 1 -- 172.21.15.144:0/2279072540 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c004400 con 0x55ab78510ca0 2024-09-12T12:24:51.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2279072540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510ca0 msgr2=0x55ab784c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.163+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2279072540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510ca0 0x55ab784c3ee0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009ba0 tx=0x7fd39c011690 comp rx=0 tx=0).stop 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2279072540 shutdown_connections 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2279072540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab784c4420 0x55ab784c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2279072540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510ca0 0x55ab784c3ee0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2279072540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78510760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2279072540 >> 172.21.15.144:0/2279072540 conn(0x55ab784bdf30 msgr2=0x55ab784f3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2279072540 shutdown_connections 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2279072540 wait complete. 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- start start 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 Processor -- start 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab784c4420 0x55ab785172f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510380 0x55ab78517830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78517d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ab782ad190 con 0x55ab78510380 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ab7830fbb0 con 0x55ab78510ca0 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ab782d7590 con 0x55ab784c4420 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 10 client.0 _ll_register_callbacks cb 0x55ab784b1910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510380 0x55ab78517830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510380 0x55ab78517830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53144/0 (socket says 172.21.15.144:53144) 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b4c00640 1 -- 172.21.15.144:0/2870110889 learned_addr learned my addr 172.21.15.144:0/2870110889 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b5600640 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab784c4420 0x55ab785172f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b6000640 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78517d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b4c00640 1 -- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab784c4420 msgr2=0x55ab785172f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab784c4420 0x55ab785172f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b4c00640 1 -- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 msgr2=0x55ab78517d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78517d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b4c00640 1 -- 172.21.15.144:0/2870110889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab782d0570 con 0x55ab78510380 2024-09-12T12:24:51.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510380 0x55ab78517830 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x55ab782df570 tx=0x7fd39c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f159a560a3e631 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd396a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:51.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd396a00640 1 -- 172.21.15.144:0/2870110889 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39c019040 con 0x55ab78510380 2024-09-12T12:24:51.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd396a00640 1 -- 172.21.15.144:0/2870110889 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fd39c003d60 con 0x55ab78510380 2024-09-12T12:24:51.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2870110889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd39c004030 con 0x55ab78510380 2024-09-12T12:24:51.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd396a00640 1 -- 172.21.15.144:0/2870110889 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7fd39c032050 con 0x55ab78510380 2024-09-12T12:24:51.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 10 client.10044 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:51.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2870110889 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55ab782d43c0 con 0x55ab78510380 2024-09-12T12:24:51.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd396a00640 1 -- 172.21.15.144:0/2870110889 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd39c004030 con 0x55ab78510380 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd396a00640 1 -- 172.21.15.144:0/2870110889 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7fd39c035020 con 0x55ab78510380 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 10 client.10044 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 10 client.10044 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 20 client.10044 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55ab7851f6c0 0x55ab78521ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 4 client.10044 mds_command: new command op to 9256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.167+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2870110889 --> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab783ac040 con 0x55ab7851f6c0 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3b5600640 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55ab7851f6c0 0x55ab78521ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3b5600640 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55ab7851f6c0 0x55ab78521ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9256 client_cookie=9cef4f0dd2a37091 server_cookie=f94d100aff801609 in_seq=0 out_seq=0 2024-09-12T12:24:51.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd396a00640 10 client.10044 ms_handle_connect on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd396a00640 1 -- 172.21.15.144:0/2870110889 <== mds.9256 v2:172.21.15.165:6832/2468859076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab783ac040 con 0x55ab7851f6c0 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd396a00640 10 client.10044 handle_command_reply: tid=0 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 client.10044 shutdown 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2870110889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510380 msgr2=0x55ab78517830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510380 0x55ab78517830 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x55ab782df570 tx=0x7fd39c004740 comp rx=0 tx=0).stop 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2870110889 shutdown_connections 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55ab7851f6c0 0x55ab78521ab0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78517d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab78510380 0x55ab78517830 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2870110889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab784c4420 0x55ab785172f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd396a00640 0 client.10044 ms_handle_reset on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2870110889 >> 172.21.15.144:0/2870110889 conn(0x55ab784bdf30 msgr2=0x55ab784c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2870110889 shutdown_connections 2024-09-12T12:24:51.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2870110889 wait complete. 2024-09-12T12:24:51.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.171+0000 7fd3bb41d000 20 client.10044 trim_cache size 0 max 16384 2024-09-12T12:24:51.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.187+0000 7fd3bb41d000 1 Processor -- start 2024-09-12T12:24:51.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.187+0000 7fd3bb41d000 1 -- start start 2024-09-12T12:24:51.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab785805c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78580b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78581040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b02041d0 con 0x55ab784c4420 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b02048a0 con 0x55ab78510ca0 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b0161140 con 0x55ab78510380 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab785805c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab785805c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53152/0 (socket says 172.21.15.144:53152) 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b5600640 1 -- 172.21.15.144:0/3761322520 learned_addr learned my addr 172.21.15.144:0/3761322520 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/3761322520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78580b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b6000640 1 --2- 172.21.15.144:0/3761322520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78581040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b5600640 1 -- 172.21.15.144:0/3761322520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 msgr2=0x55ab78580b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b5600640 1 --2- 172.21.15.144:0/3761322520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78580b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b5600640 1 -- 172.21.15.144:0/3761322520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 msgr2=0x55ab78581040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b5600640 1 --2- 172.21.15.144:0/3761322520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78581040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b5600640 1 -- 172.21.15.144:0/3761322520 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab782b35c0 con 0x55ab784c4420 2024-09-12T12:24:51.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3b5600640 1 --2- 172.21.15.144:0/3761322520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab785805c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009c90 tx=0x7fd3a4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5692a5c21160974 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3a1600640 1 -- 172.21.15.144:0/3761322520 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40ba050 con 0x55ab784c4420 2024-09-12T12:24:51.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3a1600640 1 -- 172.21.15.144:0/3761322520 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a40d3030 con 0x55ab784c4420 2024-09-12T12:24:51.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3a1600640 1 -- 172.21.15.144:0/3761322520 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40c3850 con 0x55ab784c4420 2024-09-12T12:24:51.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 -- 172.21.15.144:0/3761322520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 msgr2=0x55ab785805c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/3761322520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab785805c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009c90 tx=0x7fd3a4004ac0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 -- 172.21.15.144:0/3761322520 shutdown_connections 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/3761322520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78581040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/3761322520 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78580b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/3761322520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab785805c0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 -- 172.21.15.144:0/3761322520 >> 172.21.15.144:0/3761322520 conn(0x55ab784bdf30 msgr2=0x55ab785178d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 -- 172.21.15.144:0/3761322520 shutdown_connections 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 -- 172.21.15.144:0/3761322520 wait complete. 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 -- start start 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.191+0000 7fd3bb41d000 1 Processor -- start 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab78583f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78584450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78584990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ab78350110 con 0x55ab784c4420 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b0203370 con 0x55ab78510ca0 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ab782b3b00 con 0x55ab78510380 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 10 client.0 _ll_register_callbacks cb 0x7fd3a8051a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab78583f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab78583f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53158/0 (socket says 172.21.15.144:53158) 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b5600640 1 -- 172.21.15.144:0/2158371504 learned_addr learned my addr 172.21.15.144:0/2158371504 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78584450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b6000640 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78584990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b5600640 1 -- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 msgr2=0x55ab78584450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b5600640 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78584450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b5600640 1 -- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 msgr2=0x55ab78584990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b5600640 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78584990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b5600640 1 -- 172.21.15.144:0/2158371504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab78395280 con 0x55ab784c4420 2024-09-12T12:24:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b5600640 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab78583f10 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40c5040 tx=0x7fd3a401b1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab6b7e758ef5bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 1 -- 172.21.15.144:0/2158371504 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40c3850 con 0x55ab784c4420 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 1 -- 172.21.15.144:0/2158371504 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fd3a40c39f0 con 0x55ab784c4420 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2158371504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a40d3030 con 0x55ab784c4420 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 1 -- 172.21.15.144:0/2158371504 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7fd3a40ba020 con 0x55ab784c4420 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 10 client.10050 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2158371504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55ab7836c7d0 con 0x55ab784c4420 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 1 -- 172.21.15.144:0/2158371504 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a40d3030 con 0x55ab784c4420 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 1 -- 172.21.15.144:0/2158371504 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7fd3a40cc070 con 0x55ab784c4420 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 10 client.10050 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 10 client.10050 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 20 client.10050 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55ab78540220 0x55ab78540600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 4 client.10050 mds_command: new command op to 9256 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-12T12:24:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2158371504 --> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55ab782ad930 con 0x55ab78540220 2024-09-12T12:24:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55ab78540220 0x55ab78540600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3b4c00640 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55ab78540220 0x55ab78540600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9256 client_cookie=8ef6b996944c0731 server_cookie=69983950eb56b8f9 in_seq=0 out_seq=0 2024-09-12T12:24:51.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 10 client.10050 ms_handle_connect on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 1 -- 172.21.15.144:0/2158371504 <== mds.9256 v2:172.21.15.165:6832/2468859076 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55ab782ad930 con 0x55ab78540220 2024-09-12T12:24:51.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 10 client.10050 handle_command_reply: tid=0 2024-09-12T12:24:51.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 client.10050 shutdown 2024-09-12T12:24:51.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2158371504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 msgr2=0x55ab78583f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab78583f10 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40c5040 tx=0x7fd3a401b1c0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2158371504 shutdown_connections 2024-09-12T12:24:51.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55ab78540220 0x55ab78540600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ab78510ca0 0x55ab78584990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ab78510380 0x55ab78584450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 --2- 172.21.15.144:0/2158371504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ab784c4420 0x55ab78583f10 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd396a00640 0 client.10050 ms_handle_reset on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2158371504 >> 172.21.15.144:0/2158371504 conn(0x55ab784bdf30 msgr2=0x55ab784c26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2158371504 shutdown_connections 2024-09-12T12:24:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 1 -- 172.21.15.144:0/2158371504 wait complete. 2024-09-12T12:24:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.195+0000 7fd3bb41d000 20 client.10050 trim_cache size 0 max 16384 2024-09-12T12:24:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: MDS is not active 2024-09-12T12:24:51.204 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T12:24:51.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b scrub resume 2024-09-12T12:24:51.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.343+0000 7f7d1da00640 1 Processor -- start 2024-09-12T12:24:51.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.343+0000 7f7d1da00640 1 -- start start 2024-09-12T12:24:51.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.343+0000 7f7d1da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7d180b1e10 0x7f7d180b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.343+0000 7f7d1da00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d180b3470 con 0x7f7d180b4580 2024-09-12T12:24:51.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.343+0000 7f7d1da00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d180b3750 con 0x7f7d18155810 2024-09-12T12:24:51.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.343+0000 7f7d1da00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7d180b27c0 con 0x7f7d180b1e10 2024-09-12T12:24:51.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.343+0000 7f7d17400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7d180b1e10 0x7f7d180b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.343+0000 7f7d1d000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7d180b4580 0x7f7d180b49e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47166/0 (socket says 172.21.15.144:47166) 2024-09-12T12:24:51.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.343+0000 7f7d1d000640 1 -- 172.21.15.144:0/1284755662 learned_addr learned my addr 172.21.15.144:0/1284755662 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:51.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.347+0000 7f7d17400640 1 -- 172.21.15.144:0/1284755662 >> v1:172.21.15.165:6789/0 conn(0x7f7d18155810 legacy=0x7f7d1815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.347+0000 7f7d17400640 1 -- 172.21.15.144:0/1284755662 >> v1:172.21.15.144:6789/0 conn(0x7f7d180b4580 legacy=0x7f7d180b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.347+0000 7f7d16a00640 1 -- 172.21.15.144:0/1284755662 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258617801 0 0) 0x7f7d180b3470 con 0x7f7d180b4580 2024-09-12T12:24:51.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.347+0000 7f7d17400640 1 -- 172.21.15.144:0/1284755662 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d180b3a30 con 0x7f7d180b1e10 2024-09-12T12:24:51.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.347+0000 7f7d17400640 1 --2- 172.21.15.144:0/1284755662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d180b1e10 0x7f7d180b2280 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009740 tx=0x7f7d0401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e53f3d43a128cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.347+0000 7f7d16a00640 1 -- 172.21.15.144:0/1284755662 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040b2070 con 0x7f7d180b1e10 2024-09-12T12:24:51.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.347+0000 7f7d16a00640 1 -- 172.21.15.144:0/1284755662 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d040ad680 con 0x7f7d180b1e10 2024-09-12T12:24:51.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.347+0000 7f7d16a00640 1 -- 172.21.15.144:0/1284755662 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040ada50 con 0x7f7d180b1e10 2024-09-12T12:24:51.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 -- 172.21.15.144:0/1284755662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d180b1e10 msgr2=0x7f7d180b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 --2- 172.21.15.144:0/1284755662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d180b1e10 0x7f7d180b2280 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009740 tx=0x7f7d0401c360 comp rx=0 tx=0).stop 2024-09-12T12:24:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 -- 172.21.15.144:0/1284755662 shutdown_connections 2024-09-12T12:24:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 --2- 172.21.15.144:0/1284755662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d180b1e10 0x7f7d180b2280 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 -- 172.21.15.144:0/1284755662 >> 172.21.15.144:0/1284755662 conn(0x7f7d1806e7e0 msgr2=0x7f7d1806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 -- 172.21.15.144:0/1284755662 shutdown_connections 2024-09-12T12:24:51.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 -- 172.21.15.144:0/1284755662 wait complete. 2024-09-12T12:24:51.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 Processor -- start 2024-09-12T12:24:51.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 -- start start 2024-09-12T12:24:51.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7d180b1e10 0x7f7d181f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d180b4580 0x7f7d1815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d18155810 0x7f7d1815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7d180b3ff0 con 0x7f7d180b4580 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d180b3180 con 0x7f7d18155810 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7d180ce040 con 0x7f7d180b1e10 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d180b4580 0x7f7d1815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d180b4580 0x7f7d1815a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53176/0 (socket says 172.21.15.144:53176) 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d17400640 1 -- 172.21.15.144:0/368933159 learned_addr learned my addr 172.21.15.144:0/368933159 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d17e00640 1 --2- 172.21.15.144:0/368933159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7d180b1e10 0x7f7d181f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1d000640 1 --2- 172.21.15.144:0/368933159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d18155810 0x7f7d1815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d17400640 1 -- 172.21.15.144:0/368933159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7d180b1e10 msgr2=0x7f7d181f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d17400640 1 --2- 172.21.15.144:0/368933159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7d180b1e10 0x7f7d181f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d17400640 1 -- 172.21.15.144:0/368933159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d18155810 msgr2=0x7f7d1815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d17400640 1 --2- 172.21.15.144:0/368933159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d18155810 0x7f7d1815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d17400640 1 -- 172.21.15.144:0/368933159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d18155c90 con 0x7f7d180b4580 2024-09-12T12:24:51.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.351+0000 7f7d1d000640 1 --2- 172.21.15.144:0/368933159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d18155810 0x7f7d1815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.355+0000 7f7d17400640 1 --2- 172.21.15.144:0/368933159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d180b4580 0x7f7d1815a7b0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f7d04018f70 tx=0x7f7d0401aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.355+0000 7f7d0fe00640 1 -- 172.21.15.144:0/368933159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040b2040 con 0x7f7d180b4580 2024-09-12T12:24:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.355+0000 7f7d0fe00640 1 -- 172.21.15.144:0/368933159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d040be070 con 0x7f7d180b4580 2024-09-12T12:24:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.355+0000 7f7d0fe00640 1 -- 172.21.15.144:0/368933159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040b8860 con 0x7f7d180b4580 2024-09-12T12:24:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.355+0000 7f7d1da00640 1 -- 172.21.15.144:0/368933159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d18155f70 con 0x7f7d180b4580 2024-09-12T12:24:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.355+0000 7f7d1da00640 1 -- 172.21.15.144:0/368933159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d18156530 con 0x7f7d180b4580 2024-09-12T12:24:51.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.355+0000 7f7d0fe00640 1 -- 172.21.15.144:0/368933159 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7d040b8a00 con 0x7f7d180b4580 2024-09-12T12:24:51.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d0fe00640 1 --2- 172.21.15.144:0/368933159 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7cf80678c0 0x7f7cf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 Processor -- start 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d0fe00640 1 -- 172.21.15.144:0/368933159 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f7d041206d0 con 0x7f7d180b4580 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 -- start start 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17e00640 1 --2- 172.21.15.144:0/368933159 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7cf80678c0 0x7f7cf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17e00640 1 --2- 172.21.15.144:0/368933159 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7cf80678c0 0x7f7cf8069d80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7d080012f0 tx=0x7f7d0800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 0x55c61611fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 0x55c6160d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c615f24cc0 con 0x55c616120530 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c615edfa20 con 0x55c6160d3780 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c615f20c80 con 0x55c61611fc10 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 0x55c61611fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53182/0 (socket says 172.21.15.144:53182) 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17400640 1 -- 172.21.15.144:0/3798179198 learned_addr learned my addr 172.21.15.144:0/3798179198 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d1d000640 1 --2- 172.21.15.144:0/3798179198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 0x55c6160d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17400640 1 -- 172.21.15.144:0/3798179198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 msgr2=0x55c61611fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17400640 1 --2- 172.21.15.144:0/3798179198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 0x55c61611fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17400640 1 -- 172.21.15.144:0/3798179198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 msgr2=0x55c6160d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17400640 1 --2- 172.21.15.144:0/3798179198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 0x55c6160d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17400640 1 -- 172.21.15.144:0/3798179198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c615ec7d40 con 0x55c616120530 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d17400640 1 --2- 172.21.15.144:0/3798179198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d3240 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f7d040a6050 tx=0x7f7d04009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f733f4e48b598741 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d0cc00640 1 -- 172.21.15.144:0/3798179198 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040f0990 con 0x55c616120530 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d0cc00640 1 -- 172.21.15.144:0/3798179198 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d040f4d40 con 0x55c616120530 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d0cc00640 1 -- 172.21.15.144:0/3798179198 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040f9570 con 0x55c616120530 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 -- 172.21.15.144:0/3798179198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 msgr2=0x55c6160d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 --2- 172.21.15.144:0/3798179198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d3240 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f7d040a6050 tx=0x7f7d04009190 comp rx=0 tx=0).stop 2024-09-12T12:24:51.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 -- 172.21.15.144:0/3798179198 shutdown_connections 2024-09-12T12:24:51.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 --2- 172.21.15.144:0/3798179198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 0x55c6160d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 --2- 172.21.15.144:0/3798179198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d3240 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 --2- 172.21.15.144:0/3798179198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 0x55c61611fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 -- 172.21.15.144:0/3798179198 >> 172.21.15.144:0/3798179198 conn(0x55c6161009b0 msgr2=0x55c616102da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 -- 172.21.15.144:0/3798179198 shutdown_connections 2024-09-12T12:24:51.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.359+0000 7f7d2241e000 1 -- 172.21.15.144:0/3798179198 wait complete. 2024-09-12T12:24:51.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 -- start start 2024-09-12T12:24:51.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 Processor -- start 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 0x55c616126f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 0x55c6161274b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c615ebe2c0 con 0x55c616120530 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c615ee3370 con 0x55c6160d3780 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c615f32f50 con 0x55c61611fc10 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 10 client.0 _ll_register_callbacks cb 0x55c615f85db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d1d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d1d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53198/0 (socket says 172.21.15.144:53198) 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d1d000640 1 -- 172.21.15.144:0/2690132563 learned_addr learned my addr 172.21.15.144:0/2690132563 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d17400640 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 0x55c6161274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d17e00640 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 0x55c616126f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d1d000640 1 -- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 msgr2=0x55c6161274b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d1d000640 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 0x55c6161274b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d1d000640 1 -- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 msgr2=0x55c616126f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d1d000640 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 0x55c616126f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d1d000640 1 -- 172.21.15.144:0/2690132563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c615ec4770 con 0x55c616120530 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d1d000640 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d9480 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f7d10011250 tx=0x7f7d10011710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c74d6d5c3b65d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d01600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d01600640 1 -- 172.21.15.144:0/2690132563 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10005ad0 con 0x55c616120530 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d01600640 1 -- 172.21.15.144:0/2690132563 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f7d10005c70 con 0x55c616120530 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 -- 172.21.15.144:0/2690132563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d040f4d40 con 0x55c616120530 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d01600640 1 -- 172.21.15.144:0/2690132563 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7f7d10022050 con 0x55c616120530 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 10 client.10065 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:51.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 -- 172.21.15.144:0/2690132563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55c615ee23f0 con 0x55c616120530 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d01600640 1 -- 172.21.15.144:0/2690132563 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d040f4d40 con 0x55c616120530 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d01600640 1 -- 172.21.15.144:0/2690132563 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7f7d10025020 con 0x55c616120530 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 10 client.10065 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 10 client.10065 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 20 client.10065 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55c6160d9e90 0x55c6160da270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 4 client.10065 mds_command: new command op to 9256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d2241e000 1 -- 172.21.15.144:0/2690132563 --> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c615ebed90 con 0x55c6160d9e90 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d17e00640 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55c6160d9e90 0x55c6160da270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d17e00640 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55c6160d9e90 0x55c6160da270 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9256 client_cookie=f2e30486e0f42f4d server_cookie=6306e2fd2626c1f4 in_seq=0 out_seq=0 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.363+0000 7f7d01600640 10 client.10065 ms_handle_connect on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d01600640 1 -- 172.21.15.144:0/2690132563 <== mds.9256 v2:172.21.15.165:6832/2468859076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c615ebed90 con 0x55c6160d9e90 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d01600640 10 client.10065 handle_command_reply: tid=0 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 client.10065 shutdown 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 -- 172.21.15.144:0/2690132563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 msgr2=0x55c6160d9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d9480 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f7d10011250 tx=0x7f7d10011710 comp rx=0 tx=0).stop 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 -- 172.21.15.144:0/2690132563 shutdown_connections 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55c6160d9e90 0x55c6160da270 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c616120530 0x55c6160d9480 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c61611fc10 0x55c6161274b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2690132563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c6160d3780 0x55c616126f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 -- 172.21.15.144:0/2690132563 >> 172.21.15.144:0/2690132563 conn(0x55c6161009b0 msgr2=0x55c6160d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d01600640 0 client.10065 ms_handle_reset on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 -- 172.21.15.144:0/2690132563 shutdown_connections 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 1 -- 172.21.15.144:0/2690132563 wait complete. 2024-09-12T12:24:51.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.367+0000 7f7d2241e000 20 client.10065 trim_cache size 0 max 16384 2024-09-12T12:24:51.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d2241e000 1 Processor -- start 2024-09-12T12:24:51.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d2241e000 1 -- start start 2024-09-12T12:24:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 0x55c61612d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c616137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 0x55c616137a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d2241e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18201140 con 0x55c61611fc10 2024-09-12T12:24:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d2241e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18154a30 con 0x55c616120530 2024-09-12T12:24:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d2241e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7d181ffc00 con 0x55c6160d3780 2024-09-12T12:24:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c616137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c616137530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53208/0 (socket says 172.21.15.144:53208) 2024-09-12T12:24:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.383+0000 7f7d17400640 1 -- 172.21.15.144:0/3080545998 learned_addr learned my addr 172.21.15.144:0/3080545998 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17e00640 1 --2- 172.21.15.144:0/3080545998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 0x55c61612d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d1d000640 1 --2- 172.21.15.144:0/3080545998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 0x55c616137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 -- 172.21.15.144:0/3080545998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 msgr2=0x55c61612d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 --2- 172.21.15.144:0/3080545998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 0x55c61612d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 -- 172.21.15.144:0/3080545998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 msgr2=0x55c616137a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 --2- 172.21.15.144:0/3080545998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 0x55c616137a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 -- 172.21.15.144:0/3080545998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c615fa6320 con 0x55c61611fc10 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 --2- 172.21.15.144:0/3080545998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c616137530 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f7d04097e50 tx=0x7f7d040bb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e34b1f4b284598 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d03e00640 1 -- 172.21.15.144:0/3080545998 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040ecc30 con 0x55c61611fc10 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d03e00640 1 -- 172.21.15.144:0/3080545998 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d040f9570 con 0x55c61611fc10 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d03e00640 1 -- 172.21.15.144:0/3080545998 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040f0990 con 0x55c61611fc10 2024-09-12T12:24:51.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 -- 172.21.15.144:0/3080545998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 msgr2=0x55c616137530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 --2- 172.21.15.144:0/3080545998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c616137530 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f7d04097e50 tx=0x7f7d040bb000 comp rx=0 tx=0).stop 2024-09-12T12:24:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 -- 172.21.15.144:0/3080545998 shutdown_connections 2024-09-12T12:24:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 --2- 172.21.15.144:0/3080545998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 0x55c616137a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 --2- 172.21.15.144:0/3080545998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c616137530 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 --2- 172.21.15.144:0/3080545998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 0x55c61612d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 -- 172.21.15.144:0/3080545998 >> 172.21.15.144:0/3080545998 conn(0x55c6161009b0 msgr2=0x55c6160d90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 -- 172.21.15.144:0/3080545998 shutdown_connections 2024-09-12T12:24:51.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 -- 172.21.15.144:0/3080545998 wait complete. 2024-09-12T12:24:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 -- start start 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 Processor -- start 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 0x55c61618f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c61612b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 0x55c61612bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c615ecc120 con 0x55c61611fc10 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c615fa5e90 con 0x55c616120530 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c615eceb90 con 0x55c6160d3780 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d2241e000 10 client.0 _ll_register_callbacks cb 0x7f7d10007c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c61612b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c61612b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53216/0 (socket says 172.21.15.144:53216) 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 -- 172.21.15.144:0/2609480742 learned_addr learned my addr 172.21.15.144:0/2609480742 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17e00640 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 0x55c61618f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d1d000640 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 0x55c61612bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 -- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 msgr2=0x55c61618f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 0x55c61618f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 -- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 msgr2=0x55c61612bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 0x55c61612bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.387+0000 7f7d17400640 1 -- 172.21.15.144:0/2609480742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c615eb85c0 con 0x55c61611fc10 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d17400640 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c61612b770 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f7d040ecdf0 tx=0x7f7d04019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8202cffb057d2a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 1 -- 172.21.15.144:0/2609480742 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040f0990 con 0x55c61611fc10 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 1 -- 172.21.15.144:0/2609480742 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f7d040ad590 con 0x55c61611fc10 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 -- 172.21.15.144:0/2609480742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d040f9570 con 0x55c61611fc10 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 1 -- 172.21.15.144:0/2609480742 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7f7d0410f050 con 0x55c61611fc10 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 10 client.10071 fetch_fsmap learned FSMap version 139 2024-09-12T12:24:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 -- 172.21.15.144:0/2609480742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55c615ebc330 con 0x55c61611fc10 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 1 -- 172.21.15.144:0/2609480742 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d040f9570 con 0x55c61611fc10 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 1 -- 172.21.15.144:0/2609480742 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 139) ==== 3490+0+0 (secure 0 0 0) 0x7f7d040b5030 con 0x55c61611fc10 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 10 client.10071 fetch_fsmap finished waiting for FSMap version 139 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 10 client.10071 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 20 client.10071 populate_metadata read hostname 'smithi144' 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55c61612c1f0 0x55c61612c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 4 client.10071 mds_command: new command op to 9256 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 -- 172.21.15.144:0/2609480742 --> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55c615f323f0 con 0x55c61612c1f0 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d17e00640 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55c61612c1f0 0x55c61612c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d17e00640 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55c61612c1f0 0x55c61612c5d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9256 client_cookie=41b4dd8b0ba7752d server_cookie=70d1d861fe646e4c in_seq=0 out_seq=0 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 10 client.10071 ms_handle_connect on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 1 -- 172.21.15.144:0/2609480742 <== mds.9256 v2:172.21.15.165:6832/2468859076 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55c615f323f0 con 0x55c61612c1f0 2024-09-12T12:24:51.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 10 client.10071 handle_command_reply: tid=0 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 client.10071 shutdown 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 -- 172.21.15.144:0/2609480742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 msgr2=0x55c61612b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c61612b770 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f7d040ecdf0 tx=0x7f7d04019100 comp rx=0 tx=0).stop 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 -- 172.21.15.144:0/2609480742 shutdown_connections 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:6832/2468859076,v1:172.21.15.165:6834/2468859076] conn(0x55c61612c1f0 0x55c61612c5d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c616120530 0x55c61612bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c61611fc10 0x55c61612b770 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d01600640 0 client.10071 ms_handle_reset on v2:172.21.15.165:6832/2468859076 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 --2- 172.21.15.144:0/2609480742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c6160d3780 0x55c61618f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 -- 172.21.15.144:0/2609480742 >> 172.21.15.144:0/2609480742 conn(0x55c6161009b0 msgr2=0x55c6160d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 -- 172.21.15.144:0/2609480742 shutdown_connections 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 1 -- 172.21.15.144:0/2609480742 wait complete. 2024-09-12T12:24:51.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.391+0000 7f7d2241e000 20 client.10071 trim_cache size 0 max 16384 2024-09-12T12:24:51.397 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: MDS is not active 2024-09-12T12:24:51.399 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T12:24:51.399 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:24:51.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:24:51.476 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:24:51.579 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:24:51.579 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:24:51.579 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:24:51.579 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:51.588 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:24:51.589 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:51.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:24:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc494200640 1 Processor -- start 2024-09-12T12:24:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc494200640 1 -- start start 2024-09-12T12:24:51.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc494200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc48c15c7b0 0x7fc48c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc494200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c0b5fb0 0x7fc48c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc494200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc48c0cd870 con 0x7fc48c15cd30 2024-09-12T12:24:51.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc494200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc48c072a50 con 0x7fc48c15c7b0 2024-09-12T12:24:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc494200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc48c0cde30 con 0x7fc48c0b5fb0 2024-09-12T12:24:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc491800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc48c15c7b0 0x7fc48c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc491800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc48c15c7b0 0x7fc48c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53218/0 (socket says 172.21.15.144:53218) 2024-09-12T12:24:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc491800640 1 -- 172.21.15.144:0/2828410862 learned_addr learned my addr 172.21.15.144:0/2828410862 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc492200640 1 --2- 172.21.15.144:0/2828410862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c0b5fb0 0x7fc48c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc491800640 1 -- 172.21.15.144:0/2828410862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c0b5fb0 msgr2=0x7fc48c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc491800640 1 --2- 172.21.15.144:0/2828410862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c0b5fb0 0x7fc48c072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc491800640 1 -- 172.21.15.144:0/2828410862 >> v1:172.21.15.165:6789/0 conn(0x7fc48c15cd30 legacy=0x7fc48c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc491800640 1 -- 172.21.15.144:0/2828410862 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c0cdb50 con 0x7fc48c15c7b0 2024-09-12T12:24:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.823+0000 7fc492200640 1 --2- 172.21.15.144:0/2828410862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c0b5fb0 0x7fc48c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:24:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc491800640 1 --2- 172.21.15.144:0/2828410862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 0x7fc48c0ccf00 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fc480009870 tx=0x7fc48001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351f16f9c3bf4c0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc48be00640 1 -- 172.21.15.144:0/2828410862 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4800a7070 con 0x7fc48c15c7b0 2024-09-12T12:24:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc48be00640 1 -- 172.21.15.144:0/2828410862 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4800b0070 con 0x7fc48c15c7b0 2024-09-12T12:24:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc48be00640 1 -- 172.21.15.144:0/2828410862 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4800ab890 con 0x7fc48c15c7b0 2024-09-12T12:24:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc494200640 1 -- 172.21.15.144:0/2828410862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 msgr2=0x7fc48c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc494200640 1 --2- 172.21.15.144:0/2828410862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 0x7fc48c0ccf00 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fc480009870 tx=0x7fc48001c560 comp rx=0 tx=0).stop 2024-09-12T12:24:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc494200640 1 -- 172.21.15.144:0/2828410862 shutdown_connections 2024-09-12T12:24:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc494200640 1 --2- 172.21.15.144:0/2828410862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c0b5fb0 0x7fc48c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc494200640 1 --2- 172.21.15.144:0/2828410862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 0x7fc48c0ccf00 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc494200640 1 -- 172.21.15.144:0/2828410862 >> 172.21.15.144:0/2828410862 conn(0x7fc48c06d0d0 msgr2=0x7fc48c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc494200640 1 -- 172.21.15.144:0/2828410862 shutdown_connections 2024-09-12T12:24:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc494200640 1 -- 172.21.15.144:0/2828410862 wait complete. 2024-09-12T12:24:51.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.827+0000 7fc494200640 1 Processor -- start 2024-09-12T12:24:51.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 -- start start 2024-09-12T12:24:51.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc48c0b5fb0 0x7fc48c15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 0x7fc48c164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c15cd30 0x7fc48c15ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c073fc0 con 0x7fc48c15c7b0 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c073e40 con 0x7fc48c0b5fb0 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc48c074140 con 0x7fc48c15cd30 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc490e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 0x7fc48c164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc490e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 0x7fc48c164770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53232/0 (socket says 172.21.15.144:53232) 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc490e00640 1 -- 172.21.15.144:0/3037885564 learned_addr learned my addr 172.21.15.144:0/3037885564 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc491800640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc48c0b5fb0 0x7fc48c15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc492200640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c15cd30 0x7fc48c15ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc490e00640 1 -- 172.21.15.144:0/3037885564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c15cd30 msgr2=0x7fc48c15ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc490e00640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c15cd30 0x7fc48c15ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc490e00640 1 -- 172.21.15.144:0/3037885564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc48c0b5fb0 msgr2=0x7fc48c15acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc490e00640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc48c0b5fb0 0x7fc48c15acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc490e00640 1 -- 172.21.15.144:0/3037885564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c164fc0 con 0x7fc48c15c7b0 2024-09-12T12:24:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc490e00640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 0x7fc48c164770 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c390 tx=0x7fc47800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc489600640 1 -- 172.21.15.144:0/3037885564 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478017070 con 0x7fc48c15c7b0 2024-09-12T12:24:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc489600640 1 -- 172.21.15.144:0/3037885564 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4780052f0 con 0x7fc48c15c7b0 2024-09-12T12:24:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48c1652a0 con 0x7fc48c15c7b0 2024-09-12T12:24:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc489600640 1 -- 172.21.15.144:0/3037885564 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478003840 con 0x7fc48c15c7b0 2024-09-12T12:24:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48c165860 con 0x7fc48c15c7b0 2024-09-12T12:24:51.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.831+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48c165a60 con 0x7fc48c15c7b0 2024-09-12T12:24:51.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.835+0000 7fc489600640 1 -- 172.21.15.144:0/3037885564 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc47801a070 con 0x7fc48c15c7b0 2024-09-12T12:24:51.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.835+0000 7fc489600640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc46c0678c0 0x7fc46c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:51.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.835+0000 7fc489600640 1 -- 172.21.15.144:0/3037885564 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fc478085040 con 0x7fc48c15c7b0 2024-09-12T12:24:51.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.835+0000 7fc491800640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc46c0678c0 0x7fc46c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:51.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.835+0000 7fc491800640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc46c0678c0 0x7fc46c069d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc4800af000 tx=0x7fc4800a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:51.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:51.839+0000 7fc489600640 1 -- 172.21.15.144:0/3037885564 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4780553a0 con 0x7fc48c15c7b0 2024-09-12T12:24:52.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.011+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc48c072ec0 con 0x7fc48c15c7b0 2024-09-12T12:24:52.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.011+0000 7fc489600640 1 -- 172.21.15.144:0/3037885564 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v178) ==== 80+0+0 (secure 0 0 0) 0x7fc4780596a0 con 0x7fc48c15c7b0 2024-09-12T12:24:52.013 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:24:52.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc46c0678c0 msgr2=0x7fc46c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc46c0678c0 0x7fc46c069d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc4800af000 tx=0x7fc4800a7000 comp rx=0 tx=0).stop 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 msgr2=0x7fc48c164770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 0x7fc48c164770 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c390 tx=0x7fc47800c850 comp rx=0 tx=0).stop 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 shutdown_connections 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc46c0678c0 0x7fc46c069d80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc48c15cd30 0x7fc48c15ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc48c15c7b0 0x7fc48c164770 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 --2- 172.21.15.144:0/3037885564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc48c0b5fb0 0x7fc48c15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 >> 172.21.15.144:0/3037885564 conn(0x7fc48c06d0d0 msgr2=0x7fc48c0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 shutdown_connections 2024-09-12T12:24:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:52.015+0000 7fc494200640 1 -- 172.21.15.144:0/3037885564 wait complete. 2024-09-12T12:24:52.033 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:24:52.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:52.034 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:24:52.827 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:24:52.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:24:52.827 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:24:52.837 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:24:52.837 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:24:52.837 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:52.846 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:24:52.846 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:24:52.846 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:24:52.846 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:52.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:24:52.890 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:24:52.890 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:24:52.890 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:24:52.898 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:24:52.899 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:53.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.071+0000 7fb51dc00640 1 Processor -- start 2024-09-12T12:24:53.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.071+0000 7fb51dc00640 1 -- start start 2024-09-12T12:24:53.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.071+0000 7fb51dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb518071420 0x7fb518071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.071+0000 7fb51dc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5180b45a0 con 0x7fb5180ccf30 2024-09-12T12:24:53.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.071+0000 7fb51dc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5180b3fe0 con 0x7fb51815b4e0 2024-09-12T12:24:53.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.071+0000 7fb51dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb5180b42c0 con 0x7fb518071420 2024-09-12T12:24:53.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb517400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb5180ccf30 0x7fb5180cd350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47176/0 (socket says 172.21.15.144:47176) 2024-09-12T12:24:53.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb517400640 1 -- 172.21.15.144:0/2540540224 learned_addr learned my addr 172.21.15.144:0/2540540224 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:53.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb516000640 1 --2- 172.21.15.144:0/2540540224 >> v2:172.21.15.165:3300/0 conn(0x7fb518071420 0x7fb518071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb515600640 1 -- 172.21.15.144:0/2540540224 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173974515 0 0) 0x7fb5180b45a0 con 0x7fb5180ccf30 2024-09-12T12:24:53.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb515600640 1 -- 172.21.15.144:0/2540540224 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4fc003530 con 0x7fb5180ccf30 2024-09-12T12:24:53.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb515600640 1 -- 172.21.15.144:0/2540540224 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935822733 0 0) 0x7fb5180b3fe0 con 0x7fb51815b4e0 2024-09-12T12:24:53.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb515600640 1 -- 172.21.15.144:0/2540540224 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5180b45a0 con 0x7fb51815b4e0 2024-09-12T12:24:53.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb516000640 1 -- 172.21.15.144:0/2540540224 >> v1:172.21.15.165:6789/0 conn(0x7fb51815b4e0 legacy=0x7fb5180b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb516000640 1 -- 172.21.15.144:0/2540540224 >> v1:172.21.15.144:6789/0 conn(0x7fb5180ccf30 legacy=0x7fb5180cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb516000640 1 -- 172.21.15.144:0/2540540224 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5180b1490 con 0x7fb518071420 2024-09-12T12:24:53.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.075+0000 7fb516000640 1 --2- 172.21.15.144:0/2540540224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb518071420 0x7fb518071840 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb5040097c0 tx=0x7fb50401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec3f5064b09e7d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb515600640 1 -- 172.21.15.144:0/2540540224 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5040ab600 con 0x7fb518071420 2024-09-12T12:24:53.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb515600640 1 -- 172.21.15.144:0/2540540224 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5040b0070 con 0x7fb518071420 2024-09-12T12:24:53.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb515600640 1 -- 172.21.15.144:0/2540540224 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5040ab9a0 con 0x7fb518071420 2024-09-12T12:24:53.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 -- 172.21.15.144:0/2540540224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb518071420 msgr2=0x7fb518071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 --2- 172.21.15.144:0/2540540224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb518071420 0x7fb518071840 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb5040097c0 tx=0x7fb50401c470 comp rx=0 tx=0).stop 2024-09-12T12:24:53.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 -- 172.21.15.144:0/2540540224 shutdown_connections 2024-09-12T12:24:53.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 --2- 172.21.15.144:0/2540540224 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb518071420 0x7fb518071840 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 -- 172.21.15.144:0/2540540224 >> 172.21.15.144:0/2540540224 conn(0x7fb51806d0d0 msgr2=0x7fb51806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 -- 172.21.15.144:0/2540540224 shutdown_connections 2024-09-12T12:24:53.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 -- 172.21.15.144:0/2540540224 wait complete. 2024-09-12T12:24:53.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 Processor -- start 2024-09-12T12:24:53.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 -- start start 2024-09-12T12:24:53.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb518071420 0x7fb518142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5180ccf30 0x7fb5180ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb51815b4e0 0x7fb5181560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb51815b8c0 con 0x7fb518071420 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb518169270 con 0x7fb5180ccf30 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb51dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb518142f90 con 0x7fb51815b4e0 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb516a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb518071420 0x7fb518142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb516a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb518071420 0x7fb518142980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53246/0 (socket says 172.21.15.144:53246) 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb516a00640 1 -- 172.21.15.144:0/3456244150 learned_addr learned my addr 172.21.15.144:0/3456244150 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.079+0000 7fb516000640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5180ccf30 0x7fb5180ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb517400640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb51815b4e0 0x7fb5181560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb516a00640 1 -- 172.21.15.144:0/3456244150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb51815b4e0 msgr2=0x7fb5181560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb516a00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb51815b4e0 0x7fb5181560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb516a00640 1 -- 172.21.15.144:0/3456244150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5180ccf30 msgr2=0x7fb5180ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb516a00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5180ccf30 0x7fb5180ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb516a00640 1 -- 172.21.15.144:0/3456244150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb518143270 con 0x7fb518071420 2024-09-12T12:24:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb516000640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5180ccf30 0x7fb5180ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb516a00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb518071420 0x7fb518142980 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c430 tx=0x7fb50800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb50ea00640 1 -- 172.21.15.144:0/3456244150 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508017070 con 0x7fb518071420 2024-09-12T12:24:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb50ea00640 1 -- 172.21.15.144:0/3456244150 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5080052f0 con 0x7fb518071420 2024-09-12T12:24:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb50ea00640 1 -- 172.21.15.144:0/3456244150 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508003840 con 0x7fb518071420 2024-09-12T12:24:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb518143550 con 0x7fb518071420 2024-09-12T12:24:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5180aec90 con 0x7fb518071420 2024-09-12T12:24:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5180729c0 con 0x7fb518071420 2024-09-12T12:24:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb50ea00640 1 -- 172.21.15.144:0/3456244150 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb50801a070 con 0x7fb518071420 2024-09-12T12:24:53.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb50ea00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4f80678c0 0x7fb4f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb50ea00640 1 -- 172.21.15.144:0/3456244150 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fb5080851c0 con 0x7fb518071420 2024-09-12T12:24:53.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.083+0000 7fb516000640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4f80678c0 0x7fb4f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.087+0000 7fb516000640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4f80678c0 0x7fb4f8069d80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb5040af000 tx=0x7fb5040b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.087+0000 7fb50ea00640 1 -- 172.21.15.144:0/3456244150 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb5080554b0 con 0x7fb518071420 2024-09-12T12:24:53.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.279+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5180b5240 con 0x7fb518071420 2024-09-12T12:24:53.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.279+0000 7fb50ea00640 1 -- 172.21.15.144:0/3456244150 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) ==== 95+0+5248 (secure 0 0 0) 0x7fb5080597b0 con 0x7fb518071420 2024-09-12T12:24:53.281 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:53.281 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":139,"btime":"2024-09-12T12:24:49:619601+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8132,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2178161495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2178161495},{"type":"v1","addr":"172.21.15.144:6835","nonce":2178161495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2493299621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2493299621},{"type":"v1","addr":"172.21.15.165:6835","nonce":2493299621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":139,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:24:15.762976+0000","modified":"2024-09-12T12:24:49.619585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9256":{"gid":9256,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6834/2468859076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2468859076},{"type":"v1","addr":"172.21.15.165:6834","nonce":2468859076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9795":{"gid":9795,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/249899092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":249899092},{"type":"v1","addr":"172.21.15.144:6837","nonce":249899092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9795,"qdb_cluster":[9795]},"id":12}]} 2024-09-12T12:24:53.281 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 139 2024-09-12T12:24:53.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4f80678c0 msgr2=0x7fb4f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4f80678c0 0x7fb4f8069d80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb5040af000 tx=0x7fb5040b6040 comp rx=0 tx=0).stop 2024-09-12T12:24:53.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb518071420 msgr2=0x7fb518142980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb518071420 0x7fb518142980 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c430 tx=0x7fb50800c8f0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 shutdown_connections 2024-09-12T12:24:53.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4f80678c0 0x7fb4f8069d80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb51815b4e0 0x7fb5181560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5180ccf30 0x7fb5180ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 --2- 172.21.15.144:0/3456244150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb518071420 0x7fb518142980 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 >> 172.21.15.144:0/3456244150 conn(0x7fb51806d0d0 msgr2=0x7fb5180ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 shutdown_connections 2024-09-12T12:24:53.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.283+0000 7fb51dc00640 1 -- 172.21.15.144:0/3456244150 wait complete. 2024-09-12T12:24:53.303 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:53.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe621a00640 1 Processor -- start 2024-09-12T12:24:53.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe621a00640 1 -- start start 2024-09-12T12:24:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe621a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe61c15c540 0x7fe61c070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe621a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c0b5090 0x7fe61c0b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe621a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe61c0b0c60 con 0x7fe61c0b6c10 2024-09-12T12:24:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe621a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe61c0b0a10 con 0x7fe61c15c540 2024-09-12T12:24:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe621a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe61c0b0f40 con 0x7fe61c0b5090 2024-09-12T12:24:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe61aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe61c0b6c10 0x7fe61c0b6ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47182/0 (socket says 172.21.15.144:47182) 2024-09-12T12:24:53.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe61aa00640 1 -- 172.21.15.144:0/238038088 learned_addr learned my addr 172.21.15.144:0/238038088 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe61a000640 1 --2- 172.21.15.144:0/238038088 >> v2:172.21.15.165:3300/0 conn(0x7fe61c15c540 0x7fe61c070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe61b400640 1 --2- 172.21.15.144:0/238038088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c0b5090 0x7fe61c0b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe619600640 1 -- 172.21.15.144:0/238038088 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 549416483 0 0) 0x7fe61c0b0c60 con 0x7fe61c0b6c10 2024-09-12T12:24:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe619600640 1 -- 172.21.15.144:0/238038088 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe600003530 con 0x7fe61c0b6c10 2024-09-12T12:24:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe61a000640 1 -- 172.21.15.144:0/238038088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c0b5090 msgr2=0x7fe61c0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe61a000640 1 --2- 172.21.15.144:0/238038088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c0b5090 0x7fe61c0b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe61a000640 1 -- 172.21.15.144:0/238038088 >> v1:172.21.15.144:6789/0 conn(0x7fe61c0b6c10 legacy=0x7fe61c0b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.439+0000 7fe61a000640 1 -- 172.21.15.144:0/238038088 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c0b4890 con 0x7fe61c15c540 2024-09-12T12:24:53.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe61a000640 1 --2- 172.21.15.144:0/238038088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe61c15c540 0x7fe61c070340 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe6080097c0 tx=0x7fe60801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14a22467ef8014e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe619600640 1 -- 172.21.15.144:0/238038088 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6080b1070 con 0x7fe61c15c540 2024-09-12T12:24:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe619600640 1 -- 172.21.15.144:0/238038088 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6080ac410 con 0x7fe61c15c540 2024-09-12T12:24:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe619600640 1 -- 172.21.15.144:0/238038088 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6080ac7c0 con 0x7fe61c15c540 2024-09-12T12:24:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe621a00640 1 -- 172.21.15.144:0/238038088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe61c15c540 msgr2=0x7fe61c070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe621a00640 1 --2- 172.21.15.144:0/238038088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe61c15c540 0x7fe61c070340 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe6080097c0 tx=0x7fe60801c4a0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe621a00640 1 -- 172.21.15.144:0/238038088 shutdown_connections 2024-09-12T12:24:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe621a00640 1 --2- 172.21.15.144:0/238038088 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c0b5090 0x7fe61c0b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe621a00640 1 --2- 172.21.15.144:0/238038088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe61c15c540 0x7fe61c070340 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe621a00640 1 -- 172.21.15.144:0/238038088 >> 172.21.15.144:0/238038088 conn(0x7fe61c0b3380 msgr2=0x7fe61c0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe621a00640 1 -- 172.21.15.144:0/238038088 shutdown_connections 2024-09-12T12:24:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.443+0000 7fe621a00640 1 -- 172.21.15.144:0/238038088 wait complete. 2024-09-12T12:24:53.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 Processor -- start 2024-09-12T12:24:53.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 -- start start 2024-09-12T12:24:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b5090 0x7fe61c153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe61c0b6c10 0x7fe61c1400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c15c540 0x7fe61c1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c169360 con 0x7fe61c0b5090 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c1691e0 con 0x7fe61c0b6c10 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe61c1694e0 con 0x7fe61c15c540 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b5090 0x7fe61c153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b5090 0x7fe61c153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53252/0 (socket says 172.21.15.144:53252) 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61aa00640 1 -- 172.21.15.144:0/21190501 learned_addr learned my addr 172.21.15.144:0/21190501 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61a000640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe61c0b6c10 0x7fe61c1400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61b400640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c15c540 0x7fe61c1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61aa00640 1 -- 172.21.15.144:0/21190501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c15c540 msgr2=0x7fe61c1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61aa00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c15c540 0x7fe61c1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61aa00640 1 -- 172.21.15.144:0/21190501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe61c0b6c10 msgr2=0x7fe61c1400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61aa00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe61c0b6c10 0x7fe61c1400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61aa00640 1 -- 172.21.15.144:0/21190501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c1536d0 con 0x7fe61c0b5090 2024-09-12T12:24:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe61aa00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b5090 0x7fe61c153040 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00cbb0 tx=0x7fe60c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe612a00640 1 -- 172.21.15.144:0/21190501 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c017070 con 0x7fe61c0b5090 2024-09-12T12:24:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe612a00640 1 -- 172.21.15.144:0/21190501 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c00ad00 con 0x7fe61c0b5090 2024-09-12T12:24:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe612a00640 1 -- 172.21.15.144:0/21190501 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c012640 con 0x7fe61c0b5090 2024-09-12T12:24:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61c1539b0 con 0x7fe61c0b5090 2024-09-12T12:24:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.447+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe61c153f70 con 0x7fe61c0b5090 2024-09-12T12:24:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.451+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61c0b54a0 con 0x7fe61c0b5090 2024-09-12T12:24:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.451+0000 7fe612a00640 1 -- 172.21.15.144:0/21190501 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe60c01a070 con 0x7fe61c0b5090 2024-09-12T12:24:53.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.451+0000 7fe612a00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5fc0678f0 0x7fe5fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.451+0000 7fe612a00640 1 -- 172.21.15.144:0/21190501 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fe60c085ce0 con 0x7fe61c0b5090 2024-09-12T12:24:53.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.451+0000 7fe61a000640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5fc0678f0 0x7fe5fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.451+0000 7fe61a000640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5fc0678f0 0x7fe5fc069db0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe6080ae000 tx=0x7fe6080a6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.455+0000 7fe612a00640 1 -- 172.21.15.144:0/21190501 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe60c055ea0 con 0x7fe61c0b5090 2024-09-12T12:24:53.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.647+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe61c0b05e0 con 0x7fe61c0b5090 2024-09-12T12:24:53.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.647+0000 7fe612a00640 1 -- 172.21.15.144:0/21190501 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) ==== 95+0+5248 (secure 0 0 0) 0x7fe60c05a1a0 con 0x7fe61c0b5090 2024-09-12T12:24:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:53.650 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":139,"btime":"2024-09-12T12:24:49:619601+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8132,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2178161495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2178161495},{"type":"v1","addr":"172.21.15.144:6835","nonce":2178161495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2493299621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2493299621},{"type":"v1","addr":"172.21.15.165:6835","nonce":2493299621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":139,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:24:15.762976+0000","modified":"2024-09-12T12:24:49.619585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9256":{"gid":9256,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6834/2468859076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2468859076},{"type":"v1","addr":"172.21.15.165:6834","nonce":2468859076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9795":{"gid":9795,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/249899092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":249899092},{"type":"v1","addr":"172.21.15.144:6837","nonce":249899092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9795,"qdb_cluster":[9795]},"id":12}]} 2024-09-12T12:24:53.650 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 139 2024-09-12T12:24:53.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5fc0678f0 msgr2=0x7fe5fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5fc0678f0 0x7fe5fc069db0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe6080ae000 tx=0x7fe6080a6040 comp rx=0 tx=0).stop 2024-09-12T12:24:53.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b5090 msgr2=0x7fe61c153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b5090 0x7fe61c153040 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00cbb0 tx=0x7fe60c00a430 comp rx=0 tx=0).stop 2024-09-12T12:24:53.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 shutdown_connections 2024-09-12T12:24:53.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5fc0678f0 0x7fe5fc069db0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe61c15c540 0x7fe61c1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe61c0b6c10 0x7fe61c1400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 --2- 172.21.15.144:0/21190501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c0b5090 0x7fe61c153040 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 >> 172.21.15.144:0/21190501 conn(0x7fe61c0b3380 msgr2=0x7fe61c0d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 shutdown_connections 2024-09-12T12:24:53.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.651+0000 7fe621a00640 1 -- 172.21.15.144:0/21190501 wait complete. 2024-09-12T12:24:53.672 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:24:53.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.807+0000 7fea03800640 1 Processor -- start 2024-09-12T12:24:53.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.807+0000 7fea03800640 1 -- start start 2024-09-12T12:24:53.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.807+0000 7fea03800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 0x7fe9fc071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.807+0000 7fea03800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe9fc0ccf30 0x7fe9fc0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea03800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9fc0b45a0 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea03800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0b3fe0 con 0x7fe9fc0ccf30 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea03800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe9fc0b42c0 con 0x7fe9fc071420 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea00e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe9fc15b4e0 0x7fe9fc0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47196/0 (socket says 172.21.15.144:47196) 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea00e00640 1 -- 172.21.15.144:0/2352656104 learned_addr learned my addr 172.21.15.144:0/2352656104 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea01800640 1 --2- 172.21.15.144:0/2352656104 >> v2:172.21.15.165:3300/0 conn(0x7fe9fc0ccf30 0x7fe9fc0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fe9fbe00640 1 --2- 172.21.15.144:0/2352656104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 0x7fe9fc071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fe9fb400640 1 -- 172.21.15.144:0/2352656104 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310211277 0 0) 0x7fe9fc0b45a0 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fe9fb400640 1 -- 172.21.15.144:0/2352656104 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e0003530 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea01800640 1 -- 172.21.15.144:0/2352656104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 msgr2=0x7fe9fc071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:53.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea01800640 1 --2- 172.21.15.144:0/2352656104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 0x7fe9fc071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea01800640 1 -- 172.21.15.144:0/2352656104 >> v1:172.21.15.144:6789/0 conn(0x7fe9fc15b4e0 legacy=0x7fe9fc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea01800640 1 -- 172.21.15.144:0/2352656104 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc0b1490 con 0x7fe9fc0ccf30 2024-09-12T12:24:53.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fe9fbe00640 1 --2- 172.21.15.144:0/2352656104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 0x7fe9fc071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:53.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.811+0000 7fea01800640 1 --2- 172.21.15.144:0/2352656104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9fc0ccf30 0x7fe9fc0cd3e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40097c0 tx=0x7fe9f401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a5182aa316e15f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fe9fb400640 1 -- 172.21.15.144:0/2352656104 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40b0070 con 0x7fe9fc0ccf30 2024-09-12T12:24:53.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fe9fb400640 1 -- 172.21.15.144:0/2352656104 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f40ab600 con 0x7fe9fc0ccf30 2024-09-12T12:24:53.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fe9fb400640 1 -- 172.21.15.144:0/2352656104 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40ab9b0 con 0x7fe9fc0ccf30 2024-09-12T12:24:53.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 -- 172.21.15.144:0/2352656104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9fc0ccf30 msgr2=0x7fe9fc0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 --2- 172.21.15.144:0/2352656104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9fc0ccf30 0x7fe9fc0cd3e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40097c0 tx=0x7fe9f401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 -- 172.21.15.144:0/2352656104 shutdown_connections 2024-09-12T12:24:53.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 --2- 172.21.15.144:0/2352656104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9fc0ccf30 0x7fe9fc0cd3e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 --2- 172.21.15.144:0/2352656104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 0x7fe9fc071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 -- 172.21.15.144:0/2352656104 >> 172.21.15.144:0/2352656104 conn(0x7fe9fc06d0d0 msgr2=0x7fe9fc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 -- 172.21.15.144:0/2352656104 shutdown_connections 2024-09-12T12:24:53.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 -- 172.21.15.144:0/2352656104 wait complete. 2024-09-12T12:24:53.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 Processor -- start 2024-09-12T12:24:53.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 -- start start 2024-09-12T12:24:53.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 0x7fe9fc0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9fc0ccf30 0x7fe9fc15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc15b4e0 0x7fe9fc15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc15b8c0 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc0b02e0 con 0x7fe9fc0ccf30 2024-09-12T12:24:53.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea03800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe9fc0d0260 con 0x7fe9fc071420 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea01800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc15b4e0 0x7fe9fc15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea00e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 0x7fe9fc0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea01800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc15b4e0 0x7fe9fc15def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53268/0 (socket says 172.21.15.144:53268) 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fea01800640 1 -- 172.21.15.144:0/533687211 learned_addr learned my addr 172.21.15.144:0/533687211 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.815+0000 7fe9fbe00640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9fc0ccf30 0x7fe9fc15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea01800640 1 -- 172.21.15.144:0/533687211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 msgr2=0x7fe9fc0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea01800640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 0x7fe9fc0cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea01800640 1 -- 172.21.15.144:0/533687211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9fc0ccf30 msgr2=0x7fe9fc15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea01800640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9fc0ccf30 0x7fe9fc15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea01800640 1 -- 172.21.15.144:0/533687211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc14e5f0 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea01800640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc15b4e0 0x7fe9fc15def0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fe9f401a0d0 tx=0x7fe9f4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fe9f8c00640 1 -- 172.21.15.144:0/533687211 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40b0040 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fe9f8c00640 1 -- 172.21.15.144:0/533687211 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f40ba070 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fe9f8c00640 1 -- 172.21.15.144:0/533687211 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4006e20 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9fc14e310 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9fc150c50 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9fc1587e0 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fe9f8c00640 1 -- 172.21.15.144:0/533687211 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9f40b4610 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fe9f8c00640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9dc0678c0 0x7fe9dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:53.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fe9f8c00640 1 -- 172.21.15.144:0/533687211 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7fe9f411f8e0 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.819+0000 7fea00e00640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9dc0678c0 0x7fe9dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:53.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.823+0000 7fea00e00640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9dc0678c0 0x7fe9dc069d80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec005c10 tx=0x7fe9ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:53.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.823+0000 7fe9f8c00640 1 -- 172.21.15.144:0/533687211 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe9fc1587e0 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.983+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9fc0cd3e0 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fe9f8c00640 1 -- 172.21.15.144:0/533687211 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) ==== 74+0+17162 (secure 0 0 0) 0x7fe9f4016090 con 0x7fe9fc15b4e0 2024-09-12T12:24:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:53.987 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":178,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:24:29.288650+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:24:13.519279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-12T12:24:14.760733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.19","mappings":[{"from":1,"to":0}]},{"pgid":"26.22","mappings":[{"from":1,"to":6}]},{"pgid":"26.2b","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:53.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9dc0678c0 msgr2=0x7fe9dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9dc0678c0 0x7fe9dc069d80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec005c10 tx=0x7fe9ec009040 comp rx=0 tx=0).stop 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc15b4e0 msgr2=0x7fe9fc15def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc15b4e0 0x7fe9fc15def0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fe9f401a0d0 tx=0x7fe9f4019240 comp rx=0 tx=0).stop 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 shutdown_connections 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe9dc0678c0 0x7fe9dc069d80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9fc15b4e0 0x7fe9fc15def0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9fc0ccf30 0x7fe9fc15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 --2- 172.21.15.144:0/533687211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9fc071420 0x7fe9fc0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 >> 172.21.15.144:0/533687211 conn(0x7fe9fc06d0d0 msgr2=0x7fe9fc15a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 shutdown_connections 2024-09-12T12:24:53.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:53.987+0000 7fea03800640 1 -- 172.21.15.144:0/533687211 wait complete. 2024-09-12T12:24:54.007 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:24:54.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:54.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3ccb400640 1 Processor -- start 2024-09-12T12:24:54.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3ccb400640 1 -- start start 2024-09-12T12:24:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3ccb400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3cc415cd30 0x7f3cc40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3ccb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cc40b5de0 0x7f3cc4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3ccb400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cc40b61e0 con 0x7f3cc415c7b0 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3ccb400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3cc4072a50 con 0x7f3cc40b5de0 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3ccb400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3cc40cde30 con 0x7f3cc415cd30 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3cc9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cc40b5de0 0x7f3cc4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3cc9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cc40b5de0 0x7f3cc4072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53278/0 (socket says 172.21.15.144:53278) 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3cc9400640 1 -- 172.21.15.144:0/1070463550 learned_addr learned my addr 172.21.15.144:0/1070463550 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3cc3e00640 1 --2- 172.21.15.144:0/1070463550 >> v2:172.21.15.165:3300/0 conn(0x7f3cc415cd30 0x7f3cc40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3cc9400640 1 -- 172.21.15.144:0/1070463550 >> v2:172.21.15.165:3300/0 conn(0x7f3cc415cd30 msgr2=0x7f3cc40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3cc9400640 1 --2- 172.21.15.144:0/1070463550 >> v2:172.21.15.165:3300/0 conn(0x7f3cc415cd30 0x7f3cc40b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3cc9400640 1 -- 172.21.15.144:0/1070463550 >> v1:172.21.15.165:6789/0 conn(0x7f3cc415c7b0 legacy=0x7f3cc40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.143+0000 7f3cc9400640 1 -- 172.21.15.144:0/1070463550 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc40cd870 con 0x7f3cc40b5de0 2024-09-12T12:24:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3cc9400640 1 --2- 172.21.15.144:0/1070463550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc40b5de0 0x7f3cc4072ee0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40afd90 tx=0x7f3cbc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d138a75e782d4c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3cc3400640 1 -- 172.21.15.144:0/1070463550 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0b0070 con 0x7f3cc40b5de0 2024-09-12T12:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3cc3400640 1 -- 172.21.15.144:0/1070463550 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0ab600 con 0x7f3cc40b5de0 2024-09-12T12:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3cc3400640 1 -- 172.21.15.144:0/1070463550 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0ab9d0 con 0x7f3cc40b5de0 2024-09-12T12:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3ccb400640 1 -- 172.21.15.144:0/1070463550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc40b5de0 msgr2=0x7f3cc4072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3ccb400640 1 --2- 172.21.15.144:0/1070463550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc40b5de0 0x7f3cc4072ee0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40afd90 tx=0x7f3cbc01c520 comp rx=0 tx=0).stop 2024-09-12T12:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3ccb400640 1 -- 172.21.15.144:0/1070463550 shutdown_connections 2024-09-12T12:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3ccb400640 1 --2- 172.21.15.144:0/1070463550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc40b5de0 0x7f3cc4072ee0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3ccb400640 1 --2- 172.21.15.144:0/1070463550 >> v2:172.21.15.165:3300/0 conn(0x7f3cc415cd30 0x7f3cc40b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3ccb400640 1 -- 172.21.15.144:0/1070463550 >> 172.21.15.144:0/1070463550 conn(0x7f3cc406d0d0 msgr2=0x7f3cc406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3ccb400640 1 -- 172.21.15.144:0/1070463550 shutdown_connections 2024-09-12T12:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.147+0000 7f3ccb400640 1 -- 172.21.15.144:0/1070463550 wait complete. 2024-09-12T12:24:54.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 Processor -- start 2024-09-12T12:24:54.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 -- start start 2024-09-12T12:24:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cc40b5de0 0x7f3cc414a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cc415c7b0 0x7f3cc40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc415cd30 0x7f3cc40b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc4073fc0 con 0x7f3cc415cd30 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc4073e40 con 0x7f3cc415c7b0 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc4074140 con 0x7f3cc40b5de0 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cc40b5de0 0x7f3cc414a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc415cd30 0x7f3cc40b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cc415c7b0 0x7f3cc40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cc40b5de0 0x7f3cc414a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:36188/0 (socket says 172.21.15.144:36188) 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cc415c7b0 0x7f3cc40b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33752/0 (socket says 172.21.15.144:33752) 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc8a00640 1 -- 172.21.15.144:0/3760579403 learned_addr learned my addr 172.21.15.144:0/3760579403 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc9400640 1 -- 172.21.15.144:0/3760579403 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cc40b5de0 msgr2=0x7f3cc414a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc9400640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cc40b5de0 0x7f3cc414a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc9400640 1 -- 172.21.15.144:0/3760579403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cc415c7b0 msgr2=0x7f3cc40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc9400640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cc415c7b0 0x7f3cc40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc9400640 1 -- 172.21.15.144:0/3760579403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc414a9a0 con 0x7f3cc415cd30 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc3e00640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cc415c7b0 0x7f3cc40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc9400640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc415cd30 0x7f3cc40b4790 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0ab000 tx=0x7f3cbc0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc0c00640 1 -- 172.21.15.144:0/3760579403 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0b0040 con 0x7f3cc415cd30 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc0c00640 1 -- 172.21.15.144:0/3760579403 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0ab400 con 0x7f3cc415cd30 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3cc0c00640 1 -- 172.21.15.144:0/3760579403 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0b4650 con 0x7f3cc415cd30 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc414e110 con 0x7f3cc415cd30 2024-09-12T12:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.151+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc414e6d0 con 0x7f3cc415cd30 2024-09-12T12:24:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.155+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc4072ee0 con 0x7f3cc415cd30 2024-09-12T12:24:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.155+0000 7f3cc0c00640 1 -- 172.21.15.144:0/3760579403 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3cbc0bc030 con 0x7f3cc415cd30 2024-09-12T12:24:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.155+0000 7f3cc0c00640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ca40678c0 0x7f3ca4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.155+0000 7f3cc0c00640 1 -- 172.21.15.144:0/3760579403 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f3cbc11ef80 con 0x7f3cc415cd30 2024-09-12T12:24:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.155+0000 7f3cc8a00640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ca40678c0 0x7f3ca4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.155+0000 7f3cc8a00640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ca40678c0 0x7f3ca4069d80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4001f60 tx=0x7f3cb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:54.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.159+0000 7f3cc0c00640 1 -- 172.21.15.144:0/3760579403 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3cbc0c3060 con 0x7f3cc415cd30 2024-09-12T12:24:54.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cc40cfd30 con 0x7f3cc415cd30 2024-09-12T12:24:54.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3cc0c00640 1 -- 172.21.15.144:0/3760579403 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) ==== 95+0+5248 (secure 0 0 0) 0x7f3cbc016110 con 0x7f3cc415cd30 2024-09-12T12:24:54.351 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:54.351 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":139,"btime":"2024-09-12T12:24:49:619601+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8132,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2178161495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2178161495},{"type":"v1","addr":"172.21.15.144:6835","nonce":2178161495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2493299621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2493299621},{"type":"v1","addr":"172.21.15.165:6835","nonce":2493299621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":139,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:24:15.762976+0000","modified":"2024-09-12T12:24:49.619585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9256":{"gid":9256,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6834/2468859076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2468859076},{"type":"v1","addr":"172.21.15.165:6834","nonce":2468859076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9795":{"gid":9795,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/249899092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":249899092},{"type":"v1","addr":"172.21.15.144:6837","nonce":249899092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9795,"qdb_cluster":[9795]},"id":12}]} 2024-09-12T12:24:54.352 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 139 2024-09-12T12:24:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ca40678c0 msgr2=0x7f3ca4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ca40678c0 0x7f3ca4069d80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4001f60 tx=0x7f3cb4009040 comp rx=0 tx=0).stop 2024-09-12T12:24:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc415cd30 msgr2=0x7f3cc40b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc415cd30 0x7f3cc40b4790 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0ab000 tx=0x7f3cbc0192c0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 shutdown_connections 2024-09-12T12:24:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3ca40678c0 0x7f3ca4069d80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cc415cd30 0x7f3cc40b4790 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cc415c7b0 0x7f3cc40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 --2- 172.21.15.144:0/3760579403 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cc40b5de0 0x7f3cc414a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 >> 172.21.15.144:0/3760579403 conn(0x7f3cc406d0d0 msgr2=0x7f3cc40d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 shutdown_connections 2024-09-12T12:24:54.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.351+0000 7f3ccb400640 1 -- 172.21.15.144:0/3760579403 wait complete. 2024-09-12T12:24:54.374 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:24:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.507+0000 7f6e56400640 1 Processor -- start 2024-09-12T12:24:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.507+0000 7f6e56400640 1 -- start start 2024-09-12T12:24:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e56400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e5015b4e0 0x7f6e500b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e56400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e500b45a0 con 0x7f6e500ccf30 2024-09-12T12:24:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e56400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e500b3fe0 con 0x7f6e500b3ad0 2024-09-12T12:24:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e56400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6e500b42c0 con 0x7f6e5015b4e0 2024-09-12T12:24:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e4fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6e500ccf30 0x7f6e500b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47206/0 (socket says 172.21.15.144:47206) 2024-09-12T12:24:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e4fe00640 1 -- 172.21.15.144:0/3979833355 learned_addr learned my addr 172.21.15.144:0/3979833355 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e4f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e5015b4e0 0x7f6e500b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e4f400640 1 -- 172.21.15.144:0/3979833355 >> v1:172.21.15.165:6789/0 conn(0x7f6e500b3ad0 legacy=0x7f6e50071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e4f400640 1 -- 172.21.15.144:0/3979833355 >> v1:172.21.15.144:6789/0 conn(0x7f6e500ccf30 legacy=0x7f6e500b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e4f400640 1 -- 172.21.15.144:0/3979833355 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e500b1490 con 0x7f6e5015b4e0 2024-09-12T12:24:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.511+0000 7f6e4ea00640 1 -- 172.21.15.144:0/3979833355 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365199581 0 0) 0x7f6e500b45a0 con 0x7f6e500ccf30 2024-09-12T12:24:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e4f400640 1 --2- 172.21.15.144:0/3979833355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e5015b4e0 0x7f6e500b3590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e400097f0 tx=0x7f6e4001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f2ff9f850f4c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e4ea00640 1 -- 172.21.15.144:0/3979833355 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e400b1070 con 0x7f6e5015b4e0 2024-09-12T12:24:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e4ea00640 1 -- 172.21.15.144:0/3979833355 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e400ac640 con 0x7f6e5015b4e0 2024-09-12T12:24:54.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e4ea00640 1 -- 172.21.15.144:0/3979833355 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e400aca10 con 0x7f6e5015b4e0 2024-09-12T12:24:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e56400640 1 -- 172.21.15.144:0/3979833355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e5015b4e0 msgr2=0x7f6e500b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e56400640 1 --2- 172.21.15.144:0/3979833355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e5015b4e0 0x7f6e500b3590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e400097f0 tx=0x7f6e4001c4b0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e56400640 1 -- 172.21.15.144:0/3979833355 shutdown_connections 2024-09-12T12:24:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e56400640 1 --2- 172.21.15.144:0/3979833355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e5015b4e0 0x7f6e500b3590 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e56400640 1 -- 172.21.15.144:0/3979833355 >> 172.21.15.144:0/3979833355 conn(0x7f6e5006d0d0 msgr2=0x7f6e5006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:54.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e56400640 1 -- 172.21.15.144:0/3979833355 shutdown_connections 2024-09-12T12:24:54.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e56400640 1 -- 172.21.15.144:0/3979833355 wait complete. 2024-09-12T12:24:54.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e56400640 1 Processor -- start 2024-09-12T12:24:54.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.515+0000 7f6e56400640 1 -- start start 2024-09-12T12:24:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e56400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e500b3ad0 0x7f6e5014caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e56400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e500ccf30 0x7f6e50169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e56400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e5015b4e0 0x7f6e5016a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e56400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5015b8c0 con 0x7f6e500ccf30 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e56400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6e500cdef0 con 0x7f6e5015b4e0 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e56400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6e500af360 con 0x7f6e500b3ad0 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e46a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e500ccf30 0x7f6e50169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e46a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e500ccf30 0x7f6e50169d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53300/0 (socket says 172.21.15.144:53300) 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e46a00640 1 -- 172.21.15.144:0/2048018914 learned_addr learned my addr 172.21.15.144:0/2048018914 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e4f400640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e500b3ad0 0x7f6e5014caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e4fe00640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e5015b4e0 0x7f6e5016a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e46a00640 1 -- 172.21.15.144:0/2048018914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e500b3ad0 msgr2=0x7f6e5014caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e46a00640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e500b3ad0 0x7f6e5014caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e46a00640 1 -- 172.21.15.144:0/2048018914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e5015b4e0 msgr2=0x7f6e5016a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e46a00640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e5015b4e0 0x7f6e5016a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e46a00640 1 -- 172.21.15.144:0/2048018914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e50159360 con 0x7f6e500ccf30 2024-09-12T12:24:54.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e46a00640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e500ccf30 0x7f6e50169d50 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c4d0 tx=0x7f6e3800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e47e00640 1 -- 172.21.15.144:0/2048018914 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e380052d0 con 0x7f6e500ccf30 2024-09-12T12:24:54.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e47e00640 1 -- 172.21.15.144:0/2048018914 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e38005470 con 0x7f6e500ccf30 2024-09-12T12:24:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e501512b0 con 0x7f6e500ccf30 2024-09-12T12:24:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e47e00640 1 -- 172.21.15.144:0/2048018914 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e38012830 con 0x7f6e500ccf30 2024-09-12T12:24:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e50159600 con 0x7f6e500ccf30 2024-09-12T12:24:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e500b3590 con 0x7f6e500ccf30 2024-09-12T12:24:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.519+0000 7f6e47e00640 1 -- 172.21.15.144:0/2048018914 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e380129d0 con 0x7f6e500ccf30 2024-09-12T12:24:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.523+0000 7f6e47e00640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e2c0678c0 0x7f6e2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.523+0000 7f6e47e00640 1 -- 172.21.15.144:0/2048018914 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f6e380859d0 con 0x7f6e500ccf30 2024-09-12T12:24:54.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.523+0000 7f6e4f400640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e2c0678c0 0x7f6e2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.523+0000 7f6e4f400640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e2c0678c0 0x7f6e2c069d80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6e400ae000 tx=0x7f6e400a6070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:54.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.527+0000 7f6e47e00640 1 -- 172.21.15.144:0/2048018914 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6e38055c20 con 0x7f6e500ccf30 2024-09-12T12:24:54.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e500b51d0 con 0x7f6e500ccf30 2024-09-12T12:24:54.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e47e00640 1 -- 172.21.15.144:0/2048018914 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) ==== 95+0+5248 (secure 0 0 0) 0x7f6e38059f20 con 0x7f6e500ccf30 2024-09-12T12:24:54.719 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:54.719 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":139,"btime":"2024-09-12T12:24:49:619601+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8132,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2178161495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2178161495},{"type":"v1","addr":"172.21.15.144:6835","nonce":2178161495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2493299621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2493299621},{"type":"v1","addr":"172.21.15.165:6835","nonce":2493299621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":139,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:24:15.762976+0000","modified":"2024-09-12T12:24:49.619585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9256":{"gid":9256,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6834/2468859076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2468859076},{"type":"v1","addr":"172.21.15.165:6834","nonce":2468859076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9795":{"gid":9795,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/249899092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":249899092},{"type":"v1","addr":"172.21.15.144:6837","nonce":249899092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9795,"qdb_cluster":[9795]},"id":12}]} 2024-09-12T12:24:54.720 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 139 2024-09-12T12:24:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e2c0678c0 msgr2=0x7f6e2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e2c0678c0 0x7f6e2c069d80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6e400ae000 tx=0x7f6e400a6070 comp rx=0 tx=0).stop 2024-09-12T12:24:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e500ccf30 msgr2=0x7f6e50169d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e500ccf30 0x7f6e50169d50 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c4d0 tx=0x7f6e3800c990 comp rx=0 tx=0).stop 2024-09-12T12:24:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 shutdown_connections 2024-09-12T12:24:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6e2c0678c0 0x7f6e2c069d80 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e5015b4e0 0x7f6e5016a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e500ccf30 0x7f6e50169d50 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 --2- 172.21.15.144:0/2048018914 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e500b3ad0 0x7f6e5014caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 >> 172.21.15.144:0/2048018914 conn(0x7f6e5006d0d0 msgr2=0x7f6e50075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 shutdown_connections 2024-09-12T12:24:54.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.719+0000 7f6e56400640 1 -- 172.21.15.144:0/2048018914 wait complete. 2024-09-12T12:24:54.740 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:24:54.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.875+0000 7f9672e00640 1 Processor -- start 2024-09-12T12:24:54.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.875+0000 7f9672e00640 1 -- start start 2024-09-12T12:24:54.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f9672e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c148190 0x7f966c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f9672e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f966c0b0480 0x7f966c0b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f9672e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f966c148570 con 0x7f966c0cd470 2024-09-12T12:24:54.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f9672e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f966c0ce090 con 0x7f966c0b0480 2024-09-12T12:24:54.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f9672e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f966c0cd8b0 con 0x7f966c148190 2024-09-12T12:24:54.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f966c0cd470 0x7f966c0afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47214/0 (socket says 172.21.15.144:47214) 2024-09-12T12:24:54.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966b400640 1 -- 172.21.15.144:0/3957123252 learned_addr learned my addr 172.21.15.144:0/3957123252 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966be00640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c148190 0x7f966c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f9670e00640 1 --2- 172.21.15.144:0/3957123252 >> v2:172.21.15.165:3300/0 conn(0x7f966c0b0480 0x7f966c0b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034955860 0 0) 0x7f966c148570 con 0x7f966c0cd470 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9650003530 con 0x7f966c0cd470 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1801340316 0 0) 0x7f9650003530 con 0x7f966c0cd470 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c148190 msgr2=0x7f966c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c148190 0x7f966c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 >> v2:172.21.15.165:3300/0 conn(0x7f966c0b0480 msgr2=0x7f966c0b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 --2- 172.21.15.144:0/3957123252 >> v2:172.21.15.165:3300/0 conn(0x7f966c0b0480 0x7f966c0b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c0b41f0 con 0x7f966c0cd470 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f9658001680 con 0x7f966c0cd470 2024-09-12T12:24:54.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 >> v1:172.21.15.144:6789/0 conn(0x7f966c0cd470 legacy=0x7f966c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c148190 0x7f96500039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9650003f90 0x7f9650004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9650004d50 0x7f96500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f966c0cd8b0 con 0x7f9650003f90 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f965000b9d0 con 0x7f9650004d50 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f965000bb50 con 0x7f966c148190 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966b400640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9650003f90 0x7f9650004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966be00640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c148190 0x7f96500039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f9670e00640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9650004d50 0x7f96500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966b400640 1 -- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c148190 msgr2=0x7f96500039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966b400640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c148190 0x7f96500039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966b400640 1 -- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9650004d50 msgr2=0x7f96500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966b400640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9650004d50 0x7f96500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.879+0000 7f966b400640 1 -- 172.21.15.144:0/3957123252 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9650003530 con 0x7f9650003f90 2024-09-12T12:24:54.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f966b400640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9650003f90 0x7f9650004810 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f965800c160 tx=0x7f965801f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952eab7f814235ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:54.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658007c90 con 0x7f9650003f90 2024-09-12T12:24:54.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9658005ae0 con 0x7f9650003f90 2024-09-12T12:24:54.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f966aa00640 1 -- 172.21.15.144:0/3957123252 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658007070 con 0x7f9650003f90 2024-09-12T12:24:54.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f9672e00640 1 -- 172.21.15.144:0/3957123252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9650003f90 msgr2=0x7f9650004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f9672e00640 1 --2- 172.21.15.144:0/3957123252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9650003f90 0x7f9650004810 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f965800c160 tx=0x7f965801f310 comp rx=0 tx=0).stop 2024-09-12T12:24:54.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f9670e00640 1 -- 172.21.15.144:0/3957123252 reap_dead start 2024-09-12T12:24:54.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f9672e00640 1 -- 172.21.15.144:0/3957123252 shutdown_connections 2024-09-12T12:24:54.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f9672e00640 1 -- 172.21.15.144:0/3957123252 >> 172.21.15.144:0/3957123252 conn(0x7f966c06d0d0 msgr2=0x7f966c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:54.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f9672e00640 1 -- 172.21.15.144:0/3957123252 shutdown_connections 2024-09-12T12:24:54.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f9672e00640 1 -- 172.21.15.144:0/3957123252 wait complete. 2024-09-12T12:24:54.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f9672e00640 1 Processor -- start 2024-09-12T12:24:54.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.883+0000 7f9672e00640 1 -- start start 2024-09-12T12:24:54.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9672e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9650003f90 0x7f966c1f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9672e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f966c0735f0 0x7f966c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9672e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c071130 0x7f966c0715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9672e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f966c0b0f10 con 0x7f966c0735f0 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9672e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f966c0b0c30 con 0x7f9650003f90 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9672e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f966c0b11f0 con 0x7f966c071130 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f966c0735f0 0x7f966c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f966c0735f0 0x7f966c073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53314/0 (socket says 172.21.15.144:53314) 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966b400640 1 -- 172.21.15.144:0/3277278449 learned_addr learned my addr 172.21.15.144:0/3277278449 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966be00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9650003f90 0x7f966c1f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9670e00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c071130 0x7f966c0715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966b400640 1 -- 172.21.15.144:0/3277278449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c071130 msgr2=0x7f966c0715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966b400640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c071130 0x7f966c0715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966b400640 1 -- 172.21.15.144:0/3277278449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9650003f90 msgr2=0x7f966c1f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:54.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966b400640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9650003f90 0x7f966c1f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:54.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966b400640 1 -- 172.21.15.144:0/3277278449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c071e60 con 0x7f966c0735f0 2024-09-12T12:24:54.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f966b400640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f966c0735f0 0x7f966c073a70 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f965801f140 tx=0x7f9650005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:54.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9663e00640 1 -- 172.21.15.144:0/3277278449 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658005c90 con 0x7f966c0735f0 2024-09-12T12:24:54.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9663e00640 1 -- 172.21.15.144:0/3277278449 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9658005e30 con 0x7f966c0735f0 2024-09-12T12:24:54.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9663e00640 1 -- 172.21.15.144:0/3277278449 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96580049f0 con 0x7f966c0735f0 2024-09-12T12:24:54.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966c072140 con 0x7f966c0735f0 2024-09-12T12:24:54.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f966c072700 con 0x7f966c0735f0 2024-09-12T12:24:54.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.887+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f966c0ccf30 con 0x7f966c0735f0 2024-09-12T12:24:54.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.891+0000 7f9663e00640 1 -- 172.21.15.144:0/3277278449 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9658004b90 con 0x7f966c0735f0 2024-09-12T12:24:54.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.891+0000 7f9663e00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f964c0678f0 0x7f964c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:54.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.891+0000 7f9663e00640 1 -- 172.21.15.144:0/3277278449 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f9658122ec0 con 0x7f966c0735f0 2024-09-12T12:24:54.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.891+0000 7f966be00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f964c0678f0 0x7f964c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:54.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.891+0000 7f966be00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f964c0678f0 0x7f964c069db0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f965c014430 tx=0x7f965c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:54.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:54.895+0000 7f9663e00640 1 -- 172.21.15.144:0/3277278449 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9658019020 con 0x7f966c0735f0 2024-09-12T12:24:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.055+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f966c0cf8e0 con 0x7f966c0735f0 2024-09-12T12:24:55.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9663e00640 1 -- 172.21.15.144:0/3277278449 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) ==== 74+0+17162 (secure 0 0 0) 0x7f96580f3760 con 0x7f966c0735f0 2024-09-12T12:24:55.059 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:55.059 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":178,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:24:29.288650+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:24:13.519279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-09-12T12:24:14.760733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.19","mappings":[{"from":1,"to":0}]},{"pgid":"26.22","mappings":[{"from":1,"to":6}]},{"pgid":"26.2b","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f964c0678f0 msgr2=0x7f964c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f964c0678f0 0x7f964c069db0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f965c014430 tx=0x7f965c00b040 comp rx=0 tx=0).stop 2024-09-12T12:24:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f966c0735f0 msgr2=0x7f966c073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f966c0735f0 0x7f966c073a70 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f965801f140 tx=0x7f9650005840 comp rx=0 tx=0).stop 2024-09-12T12:24:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 shutdown_connections 2024-09-12T12:24:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f964c0678f0 0x7f964c069db0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f966c071130 0x7f966c0715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f966c0735f0 0x7f966c073a70 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 --2- 172.21.15.144:0/3277278449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9650003f90 0x7f966c1f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 >> 172.21.15.144:0/3277278449 conn(0x7f966c06d0d0 msgr2=0x7f966c0ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 shutdown_connections 2024-09-12T12:24:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.059+0000 7f9672e00640 1 -- 172.21.15.144:0/3277278449 wait complete. 2024-09-12T12:24:55.081 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:24:55.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.215+0000 7f26da000640 1 Processor -- start 2024-09-12T12:24:55.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.215+0000 7f26da000640 1 -- start start 2024-09-12T12:24:55.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26da000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26d415e600 0x7f26d40717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26da000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f26d406f020 0x7f26d40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26da000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d40b54a0 con 0x7f26d40afab0 2024-09-12T12:24:55.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26da000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f26d40b5270 con 0x7f26d415e600 2024-09-12T12:24:55.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26da000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f26d4163020 con 0x7f26d406f020 2024-09-12T12:24:55.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26d415e600 0x7f26d40717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f26d40afab0 0x7f26d406e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47222/0 (socket says 172.21.15.144:47222) 2024-09-12T12:24:55.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d2a00640 1 -- 172.21.15.144:0/2685772863 learned_addr learned my addr 172.21.15.144:0/2685772863 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:55.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d3e00640 1 --2- 172.21.15.144:0/2685772863 >> v2:172.21.15.165:3300/0 conn(0x7f26d406f020 0x7f26d40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d3400640 1 -- 172.21.15.144:0/2685772863 >> v2:172.21.15.165:3300/0 conn(0x7f26d406f020 msgr2=0x7f26d40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:55.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d3400640 1 --2- 172.21.15.144:0/2685772863 >> v2:172.21.15.165:3300/0 conn(0x7f26d406f020 0x7f26d40b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d3400640 1 -- 172.21.15.144:0/2685772863 >> v1:172.21.15.144:6789/0 conn(0x7f26d40afab0 legacy=0x7f26d406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d2000640 1 -- 172.21.15.144:0/2685772863 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 39590675 0 0) 0x7f26d40b54a0 con 0x7f26d40afab0 2024-09-12T12:24:55.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d3400640 1 -- 172.21.15.144:0/2685772863 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d40b5780 con 0x7f26d415e600 2024-09-12T12:24:55.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.219+0000 7f26d3400640 1 --2- 172.21.15.144:0/2685772863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d415e600 0x7f26d40717f0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f26c40097c0 tx=0x7f26c401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd9599325ac787c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2000640 1 -- 172.21.15.144:0/2685772863 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c40b0070 con 0x7f26d415e600 2024-09-12T12:24:55.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2000640 1 -- 172.21.15.144:0/2685772863 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c40ab600 con 0x7f26d415e600 2024-09-12T12:24:55.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2000640 1 -- 172.21.15.144:0/2685772863 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c40ab9d0 con 0x7f26d415e600 2024-09-12T12:24:55.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 -- 172.21.15.144:0/2685772863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d415e600 msgr2=0x7f26d40717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 --2- 172.21.15.144:0/2685772863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d415e600 0x7f26d40717f0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f26c40097c0 tx=0x7f26c401c460 comp rx=0 tx=0).stop 2024-09-12T12:24:55.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 -- 172.21.15.144:0/2685772863 shutdown_connections 2024-09-12T12:24:55.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 --2- 172.21.15.144:0/2685772863 >> v2:172.21.15.165:3300/0 conn(0x7f26d406f020 0x7f26d40b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 --2- 172.21.15.144:0/2685772863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d415e600 0x7f26d40717f0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 -- 172.21.15.144:0/2685772863 >> 172.21.15.144:0/2685772863 conn(0x7f26d406ddf0 msgr2=0x7f26d406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:55.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 -- 172.21.15.144:0/2685772863 shutdown_connections 2024-09-12T12:24:55.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 -- 172.21.15.144:0/2685772863 wait complete. 2024-09-12T12:24:55.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 Processor -- start 2024-09-12T12:24:55.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 -- start start 2024-09-12T12:24:55.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26d406f020 0x7f26d414d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d40afab0 0x7f26d414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26d415e600 0x7f26d414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f26d416b3b0 con 0x7f26d40afab0 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26d416b230 con 0x7f26d415e600 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26da000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f26d416b530 con 0x7f26d406f020 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d40afab0 0x7f26d414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d40afab0 0x7f26d414fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53324/0 (socket says 172.21.15.144:53324) 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2a00640 1 -- 172.21.15.144:0/2626320681 learned_addr learned my addr 172.21.15.144:0/2626320681 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d3400640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26d406f020 0x7f26d414d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d3e00640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26d415e600 0x7f26d414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2a00640 1 -- 172.21.15.144:0/2626320681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26d406f020 msgr2=0x7f26d414d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2a00640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26d406f020 0x7f26d414d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2a00640 1 -- 172.21.15.144:0/2626320681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26d415e600 msgr2=0x7f26d414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2a00640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26d415e600 0x7f26d414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.223+0000 7f26d2a00640 1 -- 172.21.15.144:0/2626320681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d4150770 con 0x7f26d40afab0 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26d2a00640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d40afab0 0x7f26d414fa00 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f26c00011f0 tx=0x7f26c000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26cb400640 1 -- 172.21.15.144:0/2626320681 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0018070 con 0x7f26d40afab0 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26cb400640 1 -- 172.21.15.144:0/2626320681 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c00074e0 con 0x7f26d40afab0 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26cb400640 1 -- 172.21.15.144:0/2626320681 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c0004a10 con 0x7f26d40afab0 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d4150a50 con 0x7f26d40afab0 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d4151010 con 0x7f26d40afab0 2024-09-12T12:24:55.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d40b6260 con 0x7f26d40afab0 2024-09-12T12:24:55.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26cb400640 1 -- 172.21.15.144:0/2626320681 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f26c001b070 con 0x7f26d40afab0 2024-09-12T12:24:55.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26cb400640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26b40678c0 0x7f26b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26cb400640 1 -- 172.21.15.144:0/2626320681 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 6217+0+0 (secure 0 0 0) 0x7f26c0085220 con 0x7f26d40afab0 2024-09-12T12:24:55.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.227+0000 7f26d3400640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26b40678c0 0x7f26b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.231+0000 7f26d3400640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26b40678c0 0x7f26b4069d80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f26c40ad000 tx=0x7f26c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.231+0000 7f26cb400640 1 -- 172.21.15.144:0/2626320681 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f26c0055470 con 0x7f26d40afab0 2024-09-12T12:24:55.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.423+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f26d415dc20 con 0x7f26d40afab0 2024-09-12T12:24:55.426 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:24:55.427+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:24:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.427+0000 7f26cb400640 1 -- 172.21.15.144:0/2626320681 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v140) ==== 161+0+0 (secure 0 0 0) 0x7f26c0059770 con 0x7f26d40afab0 2024-09-12T12:24:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:24:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26b40678c0 msgr2=0x7f26b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26b40678c0 0x7f26b4069d80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f26c40ad000 tx=0x7f26c4008040 comp rx=0 tx=0).stop 2024-09-12T12:24:55.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d40afab0 msgr2=0x7f26d414fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d40afab0 0x7f26d414fa00 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f26c00011f0 tx=0x7f26c000c9b0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 shutdown_connections 2024-09-12T12:24:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f26b40678c0 0x7f26b4069d80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26d415e600 0x7f26d414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26d40afab0 0x7f26d414fa00 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 --2- 172.21.15.144:0/2626320681 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26d406f020 0x7f26d414d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 >> 172.21.15.144:0/2626320681 conn(0x7f26d406ddf0 msgr2=0x7f26d40b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 shutdown_connections 2024-09-12T12:24:55.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.431+0000 7f26da000640 1 -- 172.21.15.144:0/2626320681 wait complete. 2024-09-12T12:24:55.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:24:55.498 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:24:55.498 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:24:55.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.595+0000 7fdd9a200640 1 Processor -- start 2024-09-12T12:24:55.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.595+0000 7fdd9a200640 1 -- start start 2024-09-12T12:24:55.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.595+0000 7fdd9a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94071330 0x7fdd94071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.595+0000 7fdd9a200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdd94160d00 0x7fdd940afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.595+0000 7fdd9a200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd94071c50 con 0x7fdd940af9c0 2024-09-12T12:24:55.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.595+0000 7fdd9a200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdd94161f10 con 0x7fdd94160d00 2024-09-12T12:24:55.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.595+0000 7fdd9a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9415ec40 con 0x7fdd94071330 2024-09-12T12:24:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd93400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94071330 0x7fdd94071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd93e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdd94160d00 0x7fdd940afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd93400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94071330 0x7fdd94071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:36260/0 (socket says 172.21.15.144:36260) 2024-09-12T12:24:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd93400640 1 -- 172.21.15.144:0/234995822 learned_addr learned my addr 172.21.15.144:0/234995822 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd92a00640 1 --1- 172.21.15.144:0/234995822 >> v1:172.21.15.165:6789/0 conn(0x7fdd940af9c0 0x7fdd940ae890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:33024/0 (socket says 172.21.15.144:33024) 2024-09-12T12:24:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd93400640 1 -- 172.21.15.144:0/234995822 >> v2:172.21.15.165:3300/0 conn(0x7fdd94160d00 msgr2=0x7fdd940afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd93400640 1 --2- 172.21.15.144:0/234995822 >> v2:172.21.15.165:3300/0 conn(0x7fdd94160d00 0x7fdd940afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd93400640 1 -- 172.21.15.144:0/234995822 >> v1:172.21.15.165:6789/0 conn(0x7fdd940af9c0 legacy=0x7fdd940ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd93400640 1 -- 172.21.15.144:0/234995822 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9415ef20 con 0x7fdd94071330 2024-09-12T12:24:55.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd93400640 1 --2- 172.21.15.144:0/234995822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94071330 0x7fdd94071710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009e50 tx=0x7fdd8401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28dbe2bfd4983710 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd92000640 1 -- 172.21.15.144:0/234995822 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd840a5700 con 0x7fdd94071330 2024-09-12T12:24:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd92000640 1 -- 172.21.15.144:0/234995822 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd840a58a0 con 0x7fdd94071330 2024-09-12T12:24:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.599+0000 7fdd92000640 1 -- 172.21.15.144:0/234995822 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd840a5c70 con 0x7fdd94071330 2024-09-12T12:24:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 -- 172.21.15.144:0/234995822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94071330 msgr2=0x7fdd94071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 --2- 172.21.15.144:0/234995822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94071330 0x7fdd94071710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009e50 tx=0x7fdd8401ca30 comp rx=0 tx=0).stop 2024-09-12T12:24:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 -- 172.21.15.144:0/234995822 shutdown_connections 2024-09-12T12:24:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 --2- 172.21.15.144:0/234995822 >> v2:172.21.15.165:3300/0 conn(0x7fdd94160d00 0x7fdd940afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 --2- 172.21.15.144:0/234995822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94071330 0x7fdd94071710 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 -- 172.21.15.144:0/234995822 >> 172.21.15.144:0/234995822 conn(0x7fdd9406bc10 msgr2=0x7fdd9406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 -- 172.21.15.144:0/234995822 shutdown_connections 2024-09-12T12:24:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 -- 172.21.15.144:0/234995822 wait complete. 2024-09-12T12:24:55.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 Processor -- start 2024-09-12T12:24:55.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 -- start start 2024-09-12T12:24:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd94071330 0x7fdd94151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd940af9c0 0x7fdd941591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94160d00 0x7fdd94157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94158fb0 con 0x7fdd94071330 2024-09-12T12:24:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94158e30 con 0x7fdd940af9c0 2024-09-12T12:24:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd9a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9416b170 con 0x7fdd94160d00 2024-09-12T12:24:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd93400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd94071330 0x7fdd94151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd93400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd94071330 0x7fdd94151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53332/0 (socket says 172.21.15.144:53332) 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd93400640 1 -- 172.21.15.144:0/1959852569 learned_addr learned my addr 172.21.15.144:0/1959852569 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd93e00640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94160d00 0x7fdd94157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.603+0000 7fdd92a00640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd940af9c0 0x7fdd941591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd93400640 1 -- 172.21.15.144:0/1959852569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94160d00 msgr2=0x7fdd94157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd93400640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94160d00 0x7fdd94157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd93400640 1 -- 172.21.15.144:0/1959852569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd940af9c0 msgr2=0x7fdd941591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd93400640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd940af9c0 0x7fdd941591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd93400640 1 -- 172.21.15.144:0/1959852569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd94159b10 con 0x7fdd94071330 2024-09-12T12:24:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd93400640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd94071330 0x7fdd94151dc0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fdd8401a660 tx=0x7fdd840197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd8b400640 1 -- 172.21.15.144:0/1959852569 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84009510 con 0x7fdd94071330 2024-09-12T12:24:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd8b400640 1 -- 172.21.15.144:0/1959852569 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd840b8470 con 0x7fdd94071330 2024-09-12T12:24:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd94159df0 con 0x7fdd94071330 2024-09-12T12:24:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd8b400640 1 -- 172.21.15.144:0/1959852569 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd840b8880 con 0x7fdd94071330 2024-09-12T12:24:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd9415a3b0 con 0x7fdd94071330 2024-09-12T12:24:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd94071710 con 0x7fdd94071330 2024-09-12T12:24:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd8b400640 1 -- 172.21.15.144:0/1959852569 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd840c0030 con 0x7fdd94071330 2024-09-12T12:24:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd8b400640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd740678c0 0x7fdd74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd8b400640 1 -- 172.21.15.144:0/1959852569 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6303+0+0 (secure 0 0 0) 0x7fdd84120870 con 0x7fdd94071330 2024-09-12T12:24:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.607+0000 7fdd92a00640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd740678c0 0x7fdd74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.611+0000 7fdd92a00640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd740678c0 0x7fdd74069d80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fdd94157bc0 tx=0x7fdd80007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:55.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.611+0000 7fdd8b400640 1 -- 172.21.15.144:0/1959852569 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdd840c7020 con 0x7fdd94071330 2024-09-12T12:24:55.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:55.803+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdd941f78c0 con 0x7fdd94071330 2024-09-12T12:24:56.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd8b400640 1 -- 172.21.15.144:0/1959852569 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v141) ==== 104+0+0 (secure 0 0 0) 0x7fdd84016620 con 0x7fdd94071330 2024-09-12T12:24:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd740678c0 msgr2=0x7fdd74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd740678c0 0x7fdd74069d80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fdd94157bc0 tx=0x7fdd80007e90 comp rx=0 tx=0).stop 2024-09-12T12:24:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd94071330 msgr2=0x7fdd94151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd94071330 0x7fdd94151dc0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fdd8401a660 tx=0x7fdd840197d0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 shutdown_connections 2024-09-12T12:24:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdd740678c0 0x7fdd74069d80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd94160d00 0x7fdd94157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd940af9c0 0x7fdd941591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 --2- 172.21.15.144:0/1959852569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd94071330 0x7fdd94151dc0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 >> 172.21.15.144:0/1959852569 conn(0x7fdd9406bc10 msgr2=0x7fdd940ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 shutdown_connections 2024-09-12T12:24:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.435+0000 7fdd9a200640 1 -- 172.21.15.144:0/1959852569 wait complete. 2024-09-12T12:24:56.460 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:24:56.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.639+0000 7f89dfe00640 1 Processor -- start 2024-09-12T12:24:56.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.639+0000 7f89dfe00640 1 -- start start 2024-09-12T12:24:56.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f89e0158c30 0x7f89e00d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:56.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e00d0580 0x7f89e00b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:56.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dfe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e00b66a0 con 0x7f89e00b6270 2024-09-12T12:24:56.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dfe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f89e0159010 con 0x7f89e0158c30 2024-09-12T12:24:56.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dfe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89e00b4080 con 0x7f89e00d0580 2024-09-12T12:24:56.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f89e0158c30 0x7f89e00d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f89e0158c30 0x7f89e00d0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53346/0 (socket says 172.21.15.144:53346) 2024-09-12T12:24:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dea00640 1 -- 172.21.15.144:0/1948905983 learned_addr learned my addr 172.21.15.144:0/1948905983 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89d7e00640 1 --2- 172.21.15.144:0/1948905983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e00d0580 0x7f89e00b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dea00640 1 -- 172.21.15.144:0/1948905983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e00d0580 msgr2=0x7f89e00b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dea00640 1 --2- 172.21.15.144:0/1948905983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e00d0580 0x7f89e00b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dea00640 1 -- 172.21.15.144:0/1948905983 >> v1:172.21.15.165:6789/0 conn(0x7f89e00b6270 legacy=0x7f89e015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:56.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.643+0000 7f89dea00640 1 -- 172.21.15.144:0/1948905983 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e00b4360 con 0x7f89e0158c30 2024-09-12T12:24:56.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dea00640 1 --2- 172.21.15.144:0/1948905983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e0158c30 0x7f89e00d0040 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009870 tx=0x7f89d001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99feb32dd952becd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:56.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89de000640 1 -- 172.21.15.144:0/1948905983 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d00b1070 con 0x7f89e0158c30 2024-09-12T12:24:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89de000640 1 -- 172.21.15.144:0/1948905983 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d00ac620 con 0x7f89e0158c30 2024-09-12T12:24:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89de000640 1 -- 172.21.15.144:0/1948905983 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d00ac9f0 con 0x7f89e0158c30 2024-09-12T12:24:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1948905983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e0158c30 msgr2=0x7f89e00d0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:56.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1948905983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e0158c30 0x7f89e00d0040 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009870 tx=0x7f89d001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1948905983 shutdown_connections 2024-09-12T12:24:56.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1948905983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e00d0580 0x7f89e00b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1948905983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e0158c30 0x7f89e00d0040 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1948905983 >> 172.21.15.144:0/1948905983 conn(0x7f89e006caf0 msgr2=0x7f89e006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:56.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1948905983 shutdown_connections 2024-09-12T12:24:56.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1948905983 wait complete. 2024-09-12T12:24:56.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 Processor -- start 2024-09-12T12:24:56.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 -- start start 2024-09-12T12:24:56.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e00b6270 0x7f89e015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e00d0580 0x7f89e015de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e0158c30 0x7f89e0164e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89e00cf650 con 0x7f89e00b6270 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f89e00b4ee0 con 0x7f89e00d0580 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.647+0000 7f89dfe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89e00b5400 con 0x7f89e0158c30 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e00b6270 0x7f89e015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e00b6270 0x7f89e015d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53348/0 (socket says 172.21.15.144:53348) 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dea00640 1 -- 172.21.15.144:0/1457950310 learned_addr learned my addr 172.21.15.144:0/1457950310 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89d7e00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e00d0580 0x7f89e015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89df400640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e0158c30 0x7f89e0164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:56.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dea00640 1 -- 172.21.15.144:0/1457950310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e0158c30 msgr2=0x7f89e0164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dea00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e0158c30 0x7f89e0164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dea00640 1 -- 172.21.15.144:0/1457950310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e00d0580 msgr2=0x7f89e015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dea00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e00d0580 0x7f89e015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dea00640 1 -- 172.21.15.144:0/1457950310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e0166420 con 0x7f89e00b6270 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dea00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e00b6270 0x7f89e015d8c0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f89d00af040 tx=0x7f89d0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89d6a00640 1 -- 172.21.15.144:0/1457950310 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d00b1040 con 0x7f89e00b6270 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89d6a00640 1 -- 172.21.15.144:0/1457950310 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d00ac420 con 0x7f89e00b6270 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89d6a00640 1 -- 172.21.15.144:0/1457950310 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d00b5680 con 0x7f89e00b6270 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e0165b80 con 0x7f89e00b6270 2024-09-12T12:24:56.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e0166140 con 0x7f89e00b6270 2024-09-12T12:24:56.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e00b5d30 con 0x7f89e00b6270 2024-09-12T12:24:56.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89d6a00640 1 -- 172.21.15.144:0/1457950310 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f89d00bc020 con 0x7f89e00b6270 2024-09-12T12:24:56.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89d6a00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89bc0678f0 0x7f89bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:56.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.651+0000 7f89d6a00640 1 -- 172.21.15.144:0/1457950310 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 6303+0+0 (secure 0 0 0) 0x7f89d011f250 con 0x7f89e00b6270 2024-09-12T12:24:56.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.655+0000 7f89d7e00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89bc0678f0 0x7f89bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:56.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.655+0000 7f89d7e00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89bc0678f0 0x7f89bc069db0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f89e015ac80 tx=0x7f89c8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:56.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.659+0000 7f89d6a00640 1 -- 172.21.15.144:0/1457950310 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f89d00c3020 con 0x7f89e00b6270 2024-09-12T12:24:56.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:56.815+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f89e0159980 con 0x7f89e00b6270 2024-09-12T12:24:57.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.643+0000 7f89d6a00640 1 -- 172.21.15.144:0/1457950310 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v180) ==== 181+0+0 (secure 0 0 0) 0x7f89d0016150 con 0x7f89e00b6270 2024-09-12T12:24:57.645 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:24:57.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89bc0678f0 msgr2=0x7f89bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89bc0678f0 0x7f89bc069db0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f89e015ac80 tx=0x7f89c8009190 comp rx=0 tx=0).stop 2024-09-12T12:24:57.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e00b6270 msgr2=0x7f89e015d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e00b6270 0x7f89e015d8c0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f89d00af040 tx=0x7f89d0019240 comp rx=0 tx=0).stop 2024-09-12T12:24:57.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 shutdown_connections 2024-09-12T12:24:57.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f89bc0678f0 0x7f89bc069db0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e0158c30 0x7f89e0164e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e00d0580 0x7f89e015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1457950310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e00b6270 0x7f89e015d8c0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 >> 172.21.15.144:0/1457950310 conn(0x7f89e006caf0 msgr2=0x7f89e0150630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:57.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 shutdown_connections 2024-09-12T12:24:57.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.647+0000 7f89dfe00640 1 -- 172.21.15.144:0/1457950310 wait complete. 2024-09-12T12:24:57.672 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:24:57.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3162a00640 1 Processor -- start 2024-09-12T12:24:57.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3162a00640 1 -- start start 2024-09-12T12:24:57.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3162a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f315c147ea0 0x7f315c15f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3162a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f315c06c320 0x7f315c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3162a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c15fa90 con 0x7f315c072080 2024-09-12T12:24:57.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3162a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f315c06db70 con 0x7f315c06c320 2024-09-12T12:24:57.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3162a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0731c0 con 0x7f315c147ea0 2024-09-12T12:24:57.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f315b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f315c072080 0x7f315c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56758/0 (socket says 172.21.15.144:56758) 2024-09-12T12:24:57.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f315b400640 1 -- 172.21.15.144:0/2134918748 learned_addr learned my addr 172.21.15.144:0/2134918748 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:24:57.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3160a00640 1 --2- 172.21.15.144:0/2134918748 >> v2:172.21.15.144:3300/0 conn(0x7f315c06c320 0x7f315c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f315be00640 1 --2- 172.21.15.144:0/2134918748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f315c147ea0 0x7f315c15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3160a00640 1 -- 172.21.15.144:0/2134918748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f315c147ea0 msgr2=0x7f315c15f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:57.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3160a00640 1 --2- 172.21.15.144:0/2134918748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f315c147ea0 0x7f315c15f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3160a00640 1 -- 172.21.15.144:0/2134918748 >> v1:172.21.15.144:6789/0 conn(0x7f315c072080 legacy=0x7f315c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f3160a00640 1 -- 172.21.15.144:0/2134918748 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c0725b0 con 0x7f315c06c320 2024-09-12T12:24:57.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.815+0000 7f315aa00640 1 -- 172.21.15.144:0/2134918748 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887391323 0 0) 0x7f3148001120 con 0x7f315c072080 2024-09-12T12:24:57.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f3160a00640 1 --2- 172.21.15.144:0/2134918748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c06c320 0x7f315c15fc90 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f3154009d90 tx=0x7f315401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65adb615c8655341 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:57.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f315aa00640 1 -- 172.21.15.144:0/2134918748 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31540ad070 con 0x7f315c06c320 2024-09-12T12:24:57.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f315aa00640 1 -- 172.21.15.144:0/2134918748 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31540a9620 con 0x7f315c06c320 2024-09-12T12:24:57.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f315aa00640 1 -- 172.21.15.144:0/2134918748 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31540a99f0 con 0x7f315c06c320 2024-09-12T12:24:57.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f3162a00640 1 -- 172.21.15.144:0/2134918748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c06c320 msgr2=0x7f315c15fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f3162a00640 1 --2- 172.21.15.144:0/2134918748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c06c320 0x7f315c15fc90 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f3154009d90 tx=0x7f315401c820 comp rx=0 tx=0).stop 2024-09-12T12:24:57.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f3162a00640 1 -- 172.21.15.144:0/2134918748 shutdown_connections 2024-09-12T12:24:57.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f3162a00640 1 --2- 172.21.15.144:0/2134918748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c06c320 0x7f315c15fc90 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f3162a00640 1 --2- 172.21.15.144:0/2134918748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f315c147ea0 0x7f315c15f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f3162a00640 1 -- 172.21.15.144:0/2134918748 >> 172.21.15.144:0/2134918748 conn(0x7f315c06cd20 msgr2=0x7f315c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:57.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f3162a00640 1 -- 172.21.15.144:0/2134918748 shutdown_connections 2024-09-12T12:24:57.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.819+0000 7f3162a00640 1 -- 172.21.15.144:0/2134918748 wait complete. 2024-09-12T12:24:57.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 Processor -- start 2024-09-12T12:24:57.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 -- start start 2024-09-12T12:24:57.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f315c06c320 0x7f315c1436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c072080 0x7f315c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f315c147ea0 0x7f315c146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f315c073630 con 0x7f315c072080 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f315c148280 con 0x7f315c147ea0 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0737b0 con 0x7f315c06c320 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f315b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c072080 0x7f315c1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f315b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c072080 0x7f315c1468f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49706/0 (socket says 172.21.15.144:49706) 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f315b400640 1 -- 172.21.15.144:0/233382331 learned_addr learned my addr 172.21.15.144:0/233382331 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f315b400640 1 -- 172.21.15.144:0/233382331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f315c06c320 msgr2=0x7f315c1436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f315b400640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f315c06c320 0x7f315c1436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f315b400640 1 -- 172.21.15.144:0/233382331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f315c147ea0 msgr2=0x7f315c146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f315b400640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f315c147ea0 0x7f315c146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f315b400640 1 -- 172.21.15.144:0/233382331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c1f82e0 con 0x7f315c072080 2024-09-12T12:24:57.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f315b400640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c072080 0x7f315c1468f0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f314800c780 tx=0x7f314800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:57.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3153e00640 1 -- 172.21.15.144:0/233382331 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148018070 con 0x7f315c072080 2024-09-12T12:24:57.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3153e00640 1 -- 172.21.15.144:0/233382331 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31480072f0 con 0x7f315c072080 2024-09-12T12:24:57.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3153e00640 1 -- 172.21.15.144:0/233382331 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31480047f0 con 0x7f315c072080 2024-09-12T12:24:57.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c1fad20 con 0x7f315c072080 2024-09-12T12:24:57.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c1fb2e0 con 0x7f315c072080 2024-09-12T12:24:57.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.823+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c1fb4e0 con 0x7f315c072080 2024-09-12T12:24:57.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.827+0000 7f3153e00640 1 -- 172.21.15.144:0/233382331 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f314801b070 con 0x7f315c072080 2024-09-12T12:24:57.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.827+0000 7f3153e00640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f313c0678c0 0x7f313c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:57.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.827+0000 7f3153e00640 1 -- 172.21.15.144:0/233382331 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5865+0+0 (secure 0 0 0) 0x7f3148085170 con 0x7f315c072080 2024-09-12T12:24:57.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.827+0000 7f315be00640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f313c0678c0 0x7f313c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:57.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.827+0000 7f315be00640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f313c0678c0 0x7f313c069d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f314c006aa0 tx=0x7f314c006a30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:57.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.831+0000 7f3153e00640 1 -- 172.21.15.144:0/233382331 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f315c1fb4e0 con 0x7f315c072080 2024-09-12T12:24:57.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:57.987+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f315c15fc90 con 0x7f315c072080 2024-09-12T12:24:58.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.647+0000 7f3153e00640 1 -- 172.21.15.144:0/233382331 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v181) ==== 169+0+0 (secure 0 0 0) 0x7f315c15fa90 con 0x7f315c072080 2024-09-12T12:24:58.647 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:24:58.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f313c0678c0 msgr2=0x7f313c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f313c0678c0 0x7f313c069d80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f314c006aa0 tx=0x7f314c006a30 comp rx=0 tx=0).stop 2024-09-12T12:24:58.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c072080 msgr2=0x7f315c1468f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c072080 0x7f315c1468f0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f314800c780 tx=0x7f314800cc40 comp rx=0 tx=0).stop 2024-09-12T12:24:58.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 shutdown_connections 2024-09-12T12:24:58.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f313c0678c0 0x7f313c069d80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f315c147ea0 0x7f315c146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f315c072080 0x7f315c1468f0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 --2- 172.21.15.144:0/233382331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f315c06c320 0x7f315c1436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 >> 172.21.15.144:0/233382331 conn(0x7f315c06cd20 msgr2=0x7f315c1445b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:58.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 shutdown_connections 2024-09-12T12:24:58.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.651+0000 7f3162a00640 1 -- 172.21.15.144:0/233382331 wait complete. 2024-09-12T12:24:58.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:24:58.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.819+0000 7f2a0fa00640 1 Processor -- start 2024-09-12T12:24:58.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.819+0000 7f2a0fa00640 1 -- start start 2024-09-12T12:24:58.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0fa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a0815af60 0x7f2a080ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0fa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2a0806c320 0x7f2a080b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0fa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a080b4300 con 0x7f2a080cd9f0 2024-09-12T12:24:58.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0fa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2a080b32f0 con 0x7f2a0815af60 2024-09-12T12:24:58.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0fa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2a080b3540 con 0x7f2a0806c320 2024-09-12T12:24:58.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a0815af60 0x7f2a080ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a0815af60 0x7f2a080ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49716/0 (socket says 172.21.15.144:49716) 2024-09-12T12:24:58.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a07e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2a080cd9f0 0x7f2a0806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56770/0 (socket says 172.21.15.144:56770) 2024-09-12T12:24:58.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0d000640 1 -- 172.21.15.144:0/2518162011 learned_addr learned my addr 172.21.15.144:0/2518162011 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:58.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0da00640 1 --2- 172.21.15.144:0/2518162011 >> v2:172.21.15.165:3300/0 conn(0x7f2a0806c320 0x7f2a080b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0d000640 1 -- 172.21.15.144:0/2518162011 >> v2:172.21.15.165:3300/0 conn(0x7f2a0806c320 msgr2=0x7f2a080b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:58.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0d000640 1 --2- 172.21.15.144:0/2518162011 >> v2:172.21.15.165:3300/0 conn(0x7f2a0806c320 0x7f2a080b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0d000640 1 -- 172.21.15.144:0/2518162011 >> v1:172.21.15.144:6789/0 conn(0x7f2a080cd9f0 legacy=0x7f2a0806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0d000640 1 -- 172.21.15.144:0/2518162011 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a080b3820 con 0x7f2a0815af60 2024-09-12T12:24:58.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a07400640 1 -- 172.21.15.144:0/2518162011 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 987425091 0 0) 0x7f2a080b4300 con 0x7f2a080cd9f0 2024-09-12T12:24:58.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a0d000640 1 --2- 172.21.15.144:0/2518162011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a0815af60 0x7f2a080ce680 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f2a0806f190 tx=0x7f29f801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161bb60d122b9f16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.823+0000 7f2a07400640 1 -- 172.21.15.144:0/2518162011 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f80ab610 con 0x7f2a0815af60 2024-09-12T12:24:58.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a07400640 1 -- 172.21.15.144:0/2518162011 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f80b0070 con 0x7f2a0815af60 2024-09-12T12:24:58.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a07400640 1 -- 172.21.15.144:0/2518162011 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f80ab9d0 con 0x7f2a0815af60 2024-09-12T12:24:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 -- 172.21.15.144:0/2518162011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a0815af60 msgr2=0x7f2a080ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 --2- 172.21.15.144:0/2518162011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a0815af60 0x7f2a080ce680 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f2a0806f190 tx=0x7f29f801c520 comp rx=0 tx=0).stop 2024-09-12T12:24:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 -- 172.21.15.144:0/2518162011 shutdown_connections 2024-09-12T12:24:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 --2- 172.21.15.144:0/2518162011 >> v2:172.21.15.165:3300/0 conn(0x7f2a0806c320 0x7f2a080b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 --2- 172.21.15.144:0/2518162011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a0815af60 0x7f2a080ce680 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 -- 172.21.15.144:0/2518162011 >> 172.21.15.144:0/2518162011 conn(0x7f2a08068030 msgr2=0x7f2a080b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:58.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 -- 172.21.15.144:0/2518162011 shutdown_connections 2024-09-12T12:24:58.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 -- 172.21.15.144:0/2518162011 wait complete. 2024-09-12T12:24:58.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 Processor -- start 2024-09-12T12:24:58.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 -- start start 2024-09-12T12:24:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a0806c320 0x7f2a0814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a080cd9f0 0x7f2a08158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a0815af60 0x7f2a08142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080b5430 con 0x7f2a080cd9f0 2024-09-12T12:24:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a080b52b0 con 0x7f2a0806c320 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0fa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2a080b55b0 con 0x7f2a0815af60 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a07e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a080cd9f0 0x7f2a08158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a07e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a080cd9f0 0x7f2a08158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49732/0 (socket says 172.21.15.144:49732) 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a07e00640 1 -- 172.21.15.144:0/321558111 learned_addr learned my addr 172.21.15.144:0/321558111 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0da00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a0815af60 0x7f2a08142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.827+0000 7f2a0d000640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a0806c320 0x7f2a0814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a07e00640 1 -- 172.21.15.144:0/321558111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a0815af60 msgr2=0x7f2a08142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a07e00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a0815af60 0x7f2a08142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a07e00640 1 -- 172.21.15.144:0/321558111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a0806c320 msgr2=0x7f2a0814c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a07e00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a0806c320 0x7f2a0814c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a07e00640 1 -- 172.21.15.144:0/321558111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a081432b0 con 0x7f2a080cd9f0 2024-09-12T12:24:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a07e00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a080cd9f0 0x7f2a08158980 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f29f40011f0 tx=0x7f29f400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a04c00640 1 -- 172.21.15.144:0/321558111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4018070 con 0x7f2a080cd9f0 2024-09-12T12:24:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a04c00640 1 -- 172.21.15.144:0/321558111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f40074e0 con 0x7f2a080cd9f0 2024-09-12T12:24:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a04c00640 1 -- 172.21.15.144:0/321558111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4004a10 con 0x7f2a080cd9f0 2024-09-12T12:24:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a08143590 con 0x7f2a080cd9f0 2024-09-12T12:24:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a08143b50 con 0x7f2a080cd9f0 2024-09-12T12:24:58.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a080b4560 con 0x7f2a080cd9f0 2024-09-12T12:24:58.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a04c00640 1 -- 172.21.15.144:0/321558111 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29f401b070 con 0x7f2a080cd9f0 2024-09-12T12:24:58.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a04c00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29e80678c0 0x7f29e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a04c00640 1 -- 172.21.15.144:0/321558111 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5335+0+0 (secure 0 0 0) 0x7f29f4084e10 con 0x7f2a080cd9f0 2024-09-12T12:24:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.831+0000 7f2a0d000640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29e80678c0 0x7f29e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.835+0000 7f2a0d000640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29e80678c0 0x7f29e8069d80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f29f80af000 tx=0x7f29f80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:58.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.835+0000 7f2a04c00640 1 -- 172.21.15.144:0/321558111 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f29f4088030 con 0x7f2a080cd9f0 2024-09-12T12:24:58.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.995+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2a080b03e0 con 0x7f2a080cd9f0 2024-09-12T12:24:58.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a04c00640 1 -- 172.21.15.144:0/321558111 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7f29f4055460 con 0x7f2a080cd9f0 2024-09-12T12:24:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29e80678c0 msgr2=0x7f29e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29e80678c0 0x7f29e8069d80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f29f80af000 tx=0x7f29f80a7000 comp rx=0 tx=0).stop 2024-09-12T12:24:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a080cd9f0 msgr2=0x7f2a08158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a080cd9f0 0x7f2a08158980 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f29f40011f0 tx=0x7f29f400c9b0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 shutdown_connections 2024-09-12T12:24:59.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f29e80678c0 0x7f29e8069d80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a0815af60 0x7f2a08142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a080cd9f0 0x7f2a08158980 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 --2- 172.21.15.144:0/321558111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a0806c320 0x7f2a0814c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 >> 172.21.15.144:0/321558111 conn(0x7f2a08068030 msgr2=0x7f2a080711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:59.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 shutdown_connections 2024-09-12T12:24:59.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:58.999+0000 7f2a0fa00640 1 -- 172.21.15.144:0/321558111 wait complete. 2024-09-12T12:24:59.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-12T12:24:59.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.171+0000 7fe585200640 1 Processor -- start 2024-09-12T12:24:59.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.171+0000 7fe585200640 1 -- start start 2024-09-12T12:24:59.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe585200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe580071420 0x7fe580071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe585200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5800ccf30 0x7fe5800cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe585200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5800b45a0 con 0x7fe58015b4e0 2024-09-12T12:24:59.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe585200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe5800cd8e0 con 0x7fe580071420 2024-09-12T12:24:59.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe585200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe5800b3fe0 con 0x7fe5800ccf30 2024-09-12T12:24:59.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe57e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5800ccf30 0x7fe5800cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe57e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5800ccf30 0x7fe5800cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60328/0 (socket says 172.21.15.144:60328) 2024-09-12T12:24:59.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe57d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe580071420 0x7fe580071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe57de00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fe58015b4e0 0x7fe5800b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:44314/0 (socket says 172.21.15.144:44314) 2024-09-12T12:24:59.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe57e800640 1 -- 172.21.15.144:0/1841557141 learned_addr learned my addr 172.21.15.144:0/1841557141 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:59.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe57e800640 1 -- 172.21.15.144:0/1841557141 >> v2:172.21.15.165:3300/0 conn(0x7fe580071420 msgr2=0x7fe580071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:59.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe57e800640 1 --2- 172.21.15.144:0/1841557141 >> v2:172.21.15.165:3300/0 conn(0x7fe580071420 0x7fe580071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe57e800640 1 -- 172.21.15.144:0/1841557141 >> v1:172.21.15.165:6789/0 conn(0x7fe58015b4e0 legacy=0x7fe5800b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.175+0000 7fe57e800640 1 -- 172.21.15.144:0/1841557141 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5800b42c0 con 0x7fe5800ccf30 2024-09-12T12:24:59.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe57e800640 1 --2- 172.21.15.144:0/1841557141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5800ccf30 0x7fe5800cd3a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe578009e50 tx=0x7fe57801ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8c4864f598d00bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:59.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe57ca00640 1 -- 172.21.15.144:0/1841557141 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780a58d0 con 0x7fe5800ccf30 2024-09-12T12:24:59.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe57ca00640 1 -- 172.21.15.144:0/1841557141 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5780a5a70 con 0x7fe5800ccf30 2024-09-12T12:24:59.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe57ca00640 1 -- 172.21.15.144:0/1841557141 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780a5e40 con 0x7fe5800ccf30 2024-09-12T12:24:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 -- 172.21.15.144:0/1841557141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5800ccf30 msgr2=0x7fe5800cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 --2- 172.21.15.144:0/1841557141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5800ccf30 0x7fe5800cd3a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe578009e50 tx=0x7fe57801ca00 comp rx=0 tx=0).stop 2024-09-12T12:24:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 -- 172.21.15.144:0/1841557141 shutdown_connections 2024-09-12T12:24:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 --2- 172.21.15.144:0/1841557141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe5800ccf30 0x7fe5800cd3a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 --2- 172.21.15.144:0/1841557141 >> v2:172.21.15.165:3300/0 conn(0x7fe580071420 0x7fe580071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 -- 172.21.15.144:0/1841557141 >> 172.21.15.144:0/1841557141 conn(0x7fe58006d0d0 msgr2=0x7fe58006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 -- 172.21.15.144:0/1841557141 shutdown_connections 2024-09-12T12:24:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 -- 172.21.15.144:0/1841557141 wait complete. 2024-09-12T12:24:59.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 Processor -- start 2024-09-12T12:24:59.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.179+0000 7fe585200640 1 -- start start 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe585200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe580071420 0x7fe580152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe585200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5800ccf30 0x7fe5801676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe585200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58015b4e0 0x7fe5800ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe585200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe58015b8c0 con 0x7fe58015b4e0 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe585200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe5800cdef0 con 0x7fe5800ccf30 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe585200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe580168d00 con 0x7fe580071420 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58015b4e0 0x7fe5800ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58015b4e0 0x7fe5800ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49740/0 (socket says 172.21.15.144:49740) 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57e800640 1 -- 172.21.15.144:0/1238307747 learned_addr learned my addr 172.21.15.144:0/1238307747 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57d400640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5800ccf30 0x7fe5801676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57de00640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe580071420 0x7fe580152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57e800640 1 -- 172.21.15.144:0/1238307747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe580071420 msgr2=0x7fe580152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57e800640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe580071420 0x7fe580152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57e800640 1 -- 172.21.15.144:0/1238307747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5800ccf30 msgr2=0x7fe5801676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57e800640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5800ccf30 0x7fe5801676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57e800640 1 -- 172.21.15.144:0/1238307747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe580153350 con 0x7fe58015b4e0 2024-09-12T12:24:59.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe57e800640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58015b4e0 0x7fe5800ae890 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fe57801a630 tx=0x7fe5780197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:59.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe576000640 1 -- 172.21.15.144:0/1238307747 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780a58d0 con 0x7fe58015b4e0 2024-09-12T12:24:59.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe576000640 1 -- 172.21.15.144:0/1238307747 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5780be070 con 0x7fe58015b4e0 2024-09-12T12:24:59.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe576000640 1 -- 172.21.15.144:0/1238307747 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578009510 con 0x7fe58015b4e0 2024-09-12T12:24:59.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5801680f0 con 0x7fe58015b4e0 2024-09-12T12:24:59.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5801686b0 con 0x7fe58015b4e0 2024-09-12T12:24:59.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe580071840 con 0x7fe58015b4e0 2024-09-12T12:24:59.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.183+0000 7fe576000640 1 -- 172.21.15.144:0/1238307747 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5780b8470 con 0x7fe58015b4e0 2024-09-12T12:24:59.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.187+0000 7fe576000640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5600678f0 0x7fe560069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.187+0000 7fe576000640 1 -- 172.21.15.144:0/1238307747 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5335+0+0 (secure 0 0 0) 0x7fe578120ff0 con 0x7fe58015b4e0 2024-09-12T12:24:59.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.187+0000 7fe57de00640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5600678f0 0x7fe560069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.187+0000 7fe57de00640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5600678f0 0x7fe560069db0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe570000f70 tx=0x7fe570007e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:59.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.191+0000 7fe576000640 1 -- 172.21.15.144:0/1238307747 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe578016620 con 0x7fe58015b4e0 2024-09-12T12:24:59.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.443+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7fe5800d0240 con 0x7fe58015b4e0 2024-09-12T12:24:59.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.655+0000 7fe576000640 1 -- 172.21.15.144:0/1238307747 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v602) ==== 159+0+0 (secure 0 0 0) 0x7fe5780f16b0 con 0x7fe58015b4e0 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5600678f0 msgr2=0x7fe560069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5600678f0 0x7fe560069db0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe570000f70 tx=0x7fe570007e10 comp rx=0 tx=0).stop 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58015b4e0 msgr2=0x7fe5800ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58015b4e0 0x7fe5800ae890 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fe57801a630 tx=0x7fe5780197a0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 shutdown_connections 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe5600678f0 0x7fe560069db0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe58015b4e0 0x7fe5800ae890 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5800ccf30 0x7fe5801676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 --2- 172.21.15.144:0/1238307747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe580071420 0x7fe580152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 >> 172.21.15.144:0/1238307747 conn(0x7fe58006d0d0 msgr2=0x7fe5800b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 shutdown_connections 2024-09-12T12:24:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.659+0000 7fe585200640 1 -- 172.21.15.144:0/1238307747 wait complete. 2024-09-12T12:24:59.680 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-12T12:24:59.680 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-12T12:24:59.681 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:24:59.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.815+0000 7f4317800640 1 Processor -- start 2024-09-12T12:24:59.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.815+0000 7f4317800640 1 -- start start 2024-09-12T12:24:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4317800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f431015c7b0 0x7f43100ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4317800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f431015cd30 0x7f43100b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4317800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43100b61e0 con 0x7f43100b5de0 2024-09-12T12:24:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4317800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4310072a50 con 0x7f431015c7b0 2024-09-12T12:24:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4317800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f43100cde30 con 0x7f431015cd30 2024-09-12T12:24:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4314e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f431015c7b0 0x7f43100ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4314e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f431015c7b0 0x7f43100ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49742/0 (socket says 172.21.15.144:49742) 2024-09-12T12:24:59.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4314e00640 1 -- 172.21.15.144:0/596058511 learned_addr learned my addr 172.21.15.144:0/596058511 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f430fe00640 1 --2- 172.21.15.144:0/596058511 >> v2:172.21.15.165:3300/0 conn(0x7f431015cd30 0x7f43100b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4314e00640 1 -- 172.21.15.144:0/596058511 >> v2:172.21.15.165:3300/0 conn(0x7f431015cd30 msgr2=0x7f43100b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:24:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4314e00640 1 --2- 172.21.15.144:0/596058511 >> v2:172.21.15.165:3300/0 conn(0x7f431015cd30 0x7f43100b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4314e00640 1 -- 172.21.15.144:0/596058511 >> v1:172.21.15.144:6789/0 conn(0x7f43100b5de0 legacy=0x7f43101601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4314e00640 1 -- 172.21.15.144:0/596058511 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43100cd870 con 0x7f431015c7b0 2024-09-12T12:24:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f430f400640 1 -- 172.21.15.144:0/596058511 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832728429 0 0) 0x7f43100b61e0 con 0x7f43100b5de0 2024-09-12T12:24:59.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f430fe00640 1 --2- 172.21.15.144:0/596058511 >> v2:172.21.15.165:3300/0 conn(0x7f431015cd30 0x7f43100b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.819+0000 7f4314e00640 1 --2- 172.21.15.144:0/596058511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 0x7f43100ccf00 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f43100afd90 tx=0x7f430001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273afe168713e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430f400640 1 -- 172.21.15.144:0/596058511 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000a57a0 con 0x7f431015c7b0 2024-09-12T12:24:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430f400640 1 -- 172.21.15.144:0/596058511 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43000a5940 con 0x7f431015c7b0 2024-09-12T12:24:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430f400640 1 -- 172.21.15.144:0/596058511 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000a5d10 con 0x7f431015c7b0 2024-09-12T12:24:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 -- 172.21.15.144:0/596058511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 msgr2=0x7f43100ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 --2- 172.21.15.144:0/596058511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 0x7f43100ccf00 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f43100afd90 tx=0x7f430001c9f0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 -- 172.21.15.144:0/596058511 shutdown_connections 2024-09-12T12:24:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 --2- 172.21.15.144:0/596058511 >> v2:172.21.15.165:3300/0 conn(0x7f431015cd30 0x7f43100b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 --2- 172.21.15.144:0/596058511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 0x7f43100ccf00 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 -- 172.21.15.144:0/596058511 >> 172.21.15.144:0/596058511 conn(0x7f431006d0d0 msgr2=0x7f431006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 -- 172.21.15.144:0/596058511 shutdown_connections 2024-09-12T12:24:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 -- 172.21.15.144:0/596058511 wait complete. 2024-09-12T12:24:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 Processor -- start 2024-09-12T12:24:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 -- start start 2024-09-12T12:24:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43100b5de0 0x7f4310148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 0x7f43101656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f431015cd30 0x7f4310165c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4310169320 con 0x7f431015c7b0 2024-09-12T12:24:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f43100cd650 con 0x7f431015cd30 2024-09-12T12:24:59.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4317800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f43101694a0 con 0x7f43100b5de0 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 0x7f43101656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 0x7f43101656f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49744/0 (socket says 172.21.15.144:49744) 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430fe00640 1 -- 172.21.15.144:0/2065899680 learned_addr learned my addr 172.21.15.144:0/2065899680 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4315800640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f431015cd30 0x7f4310165c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f4314e00640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43100b5de0 0x7f4310148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430fe00640 1 -- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43100b5de0 msgr2=0x7f4310148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430fe00640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43100b5de0 0x7f4310148190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430fe00640 1 -- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f431015cd30 msgr2=0x7f4310165c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430fe00640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f431015cd30 0x7f4310165c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.823+0000 7f430fe00640 1 -- 172.21.15.144:0/2065899680 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43101587e0 con 0x7f431015c7b0 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f4315800640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f431015cd30 0x7f4310165c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f4314e00640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43100b5de0 0x7f4310148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:24:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f430fe00640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 0x7f43101656f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c820 tx=0x7f42fc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f430cc00640 1 -- 172.21.15.144:0/2065899680 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc015070 con 0x7f431015c7b0 2024-09-12T12:24:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f430cc00640 1 -- 172.21.15.144:0/2065899680 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42fc007a30 con 0x7f431015c7b0 2024-09-12T12:24:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4310158ac0 con 0x7f431015c7b0 2024-09-12T12:24:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f430cc00640 1 -- 172.21.15.144:0/2065899680 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc007e40 con 0x7f431015c7b0 2024-09-12T12:24:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4310159080 con 0x7f431015c7b0 2024-09-12T12:24:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43100ccf00 con 0x7f431015c7b0 2024-09-12T12:24:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f430cc00640 1 -- 172.21.15.144:0/2065899680 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42fc018070 con 0x7f431015c7b0 2024-09-12T12:24:59.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f430cc00640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42f00678c0 0x7f42f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:24:59.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.827+0000 7f430cc00640 1 -- 172.21.15.144:0/2065899680 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5335+0+0 (secure 0 0 0) 0x7f42fc085b00 con 0x7f431015c7b0 2024-09-12T12:24:59.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.831+0000 7f4314e00640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42f00678c0 0x7f42f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:24:59.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.831+0000 7f4314e00640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42f00678c0 0x7f42f0069d80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f43000ae000 tx=0x7f43000a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:24:59.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.831+0000 7f430cc00640 1 -- 172.21.15.144:0/2065899680 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42fc056710 con 0x7f431015c7b0 2024-09-12T12:24:59.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.995+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4310156590 con 0x7f431015c7b0 2024-09-12T12:24:59.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.995+0000 7f430cc00640 1 -- 172.21.15.144:0/2065899680 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) ==== 74+0+13339 (secure 0 0 0) 0x7f42fc085e20 con 0x7f431015c7b0 2024-09-12T12:24:59.996 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:24:59.996 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":181,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:24:58.648679+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/249899092":"2024-09-13T12:24:55.430123+0000","172.21.15.144:6836/249899092":"2024-09-13T12:24:55.430123+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:24:59.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.995+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42f00678c0 msgr2=0x7f42f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.995+0000 7f4317800640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42f00678c0 0x7f42f0069d80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f43000ae000 tx=0x7f43000a7070 comp rx=0 tx=0).stop 2024-09-12T12:24:59.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.995+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 msgr2=0x7f43101656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:24:59.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.995+0000 7f4317800640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 0x7f43101656f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00c820 tx=0x7f42fc00cce0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.999+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 shutdown_connections 2024-09-12T12:24:59.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.999+0000 7f4317800640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f42f00678c0 0x7f42f0069d80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.999+0000 7f4317800640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f431015cd30 0x7f4310165c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.999+0000 7f4317800640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f431015c7b0 0x7f43101656f0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.999+0000 7f4317800640 1 --2- 172.21.15.144:0/2065899680 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43100b5de0 0x7f4310148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:24:59.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.999+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 >> 172.21.15.144:0/2065899680 conn(0x7f431006d0d0 msgr2=0x7f431015d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:24:59.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.999+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 shutdown_connections 2024-09-12T12:24:59.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:24:59.999+0000 7f4317800640 1 -- 172.21.15.144:0/2065899680 wait complete. 2024-09-12T12:25:00.019 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:25:00.019 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:25:00.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.155+0000 7f71dc800640 1 Processor -- start 2024-09-12T12:25:00.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71dc800640 1 -- start start 2024-09-12T12:25:00.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71dc800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71d415a120 0x7f71d40730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71dc800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f71d40d13b0 0x7f71d40735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71dc800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d40708b0 con 0x7f71d4073c50 2024-09-12T12:25:00.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71dc800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f71d4070b90 con 0x7f71d415a120 2024-09-12T12:25:00.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71dc800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f71d4070e70 con 0x7f71d40d13b0 2024-09-12T12:25:00.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71d9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71d415a120 0x7f71d40730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71d9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71d415a120 0x7f71d40730b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49748/0 (socket says 172.21.15.144:49748) 2024-09-12T12:25:00.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71d9e00640 1 -- 172.21.15.144:0/725164668 learned_addr learned my addr 172.21.15.144:0/725164668 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:00.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71da800640 1 --2- 172.21.15.144:0/725164668 >> v2:172.21.15.165:3300/0 conn(0x7f71d40d13b0 0x7f71d40735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71d9e00640 1 -- 172.21.15.144:0/725164668 >> v2:172.21.15.165:3300/0 conn(0x7f71d40d13b0 msgr2=0x7f71d40735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:00.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71d9e00640 1 --2- 172.21.15.144:0/725164668 >> v2:172.21.15.165:3300/0 conn(0x7f71d40d13b0 0x7f71d40735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71d9e00640 1 -- 172.21.15.144:0/725164668 >> v1:172.21.15.165:6789/0 conn(0x7f71d4073c50 legacy=0x7f71d4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:00.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.159+0000 7f71d9e00640 1 -- 172.21.15.144:0/725164668 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d4071150 con 0x7f71d415a120 2024-09-12T12:25:00.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71d9e00640 1 --2- 172.21.15.144:0/725164668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d415a120 0x7f71d40730b0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f71d4073040 tx=0x7f71c801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d745eda102d9a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71d8a00640 1 -- 172.21.15.144:0/725164668 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c80aa670 con 0x7f71d415a120 2024-09-12T12:25:00.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71d8a00640 1 -- 172.21.15.144:0/725164668 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c80af070 con 0x7f71d415a120 2024-09-12T12:25:00.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71d8a00640 1 -- 172.21.15.144:0/725164668 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c80aaa30 con 0x7f71d415a120 2024-09-12T12:25:00.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 -- 172.21.15.144:0/725164668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d415a120 msgr2=0x7f71d40730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 --2- 172.21.15.144:0/725164668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d415a120 0x7f71d40730b0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f71d4073040 tx=0x7f71c801c4f0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 -- 172.21.15.144:0/725164668 shutdown_connections 2024-09-12T12:25:00.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 --2- 172.21.15.144:0/725164668 >> v2:172.21.15.165:3300/0 conn(0x7f71d40d13b0 0x7f71d40735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 --2- 172.21.15.144:0/725164668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d415a120 0x7f71d40730b0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 -- 172.21.15.144:0/725164668 >> 172.21.15.144:0/725164668 conn(0x7f71d40d2400 msgr2=0x7f71d40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:00.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 -- 172.21.15.144:0/725164668 shutdown_connections 2024-09-12T12:25:00.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 -- 172.21.15.144:0/725164668 wait complete. 2024-09-12T12:25:00.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 Processor -- start 2024-09-12T12:25:00.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.163+0000 7f71dc800640 1 -- start start 2024-09-12T12:25:00.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71dc800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d4073c50 0x7f71d415fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71dc800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d40d13b0 0x7f71d4156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71dc800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71d415a120 0x7f71d41663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71dc800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4169530 con 0x7f71d4073c50 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71dc800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f71d41693b0 con 0x7f71d40d13b0 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71dc800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f71d41696b0 con 0x7f71d415a120 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d4073c50 0x7f71d415fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d4073c50 0x7f71d415fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49752/0 (socket says 172.21.15.144:49752) 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9e00640 1 -- 172.21.15.144:0/2260314766 learned_addr learned my addr 172.21.15.144:0/2260314766 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71da800640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71d415a120 0x7f71d41663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9400640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d40d13b0 0x7f71d4156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9e00640 1 -- 172.21.15.144:0/2260314766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71d415a120 msgr2=0x7f71d41663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9e00640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71d415a120 0x7f71d41663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9e00640 1 -- 172.21.15.144:0/2260314766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d40d13b0 msgr2=0x7f71d4156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9e00640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d40d13b0 0x7f71d4156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9e00640 1 -- 172.21.15.144:0/2260314766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d4156a70 con 0x7f71d4073c50 2024-09-12T12:25:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71d9e00640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d4073c50 0x7f71d415fa40 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f71c80ac040 tx=0x7f71c801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71ce000640 1 -- 172.21.15.144:0/2260314766 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c80bd5f0 con 0x7f71d4073c50 2024-09-12T12:25:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71ce000640 1 -- 172.21.15.144:0/2260314766 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c80bd790 con 0x7f71d4073c50 2024-09-12T12:25:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71ce000640 1 -- 172.21.15.144:0/2260314766 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c80bdb80 con 0x7f71d4073c50 2024-09-12T12:25:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d415e9a0 con 0x7f71d4073c50 2024-09-12T12:25:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d415ef60 con 0x7f71d4073c50 2024-09-12T12:25:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.167+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d4160030 con 0x7f71d4073c50 2024-09-12T12:25:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.171+0000 7f71ce000640 1 -- 172.21.15.144:0/2260314766 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f71c80b33f0 con 0x7f71d4073c50 2024-09-12T12:25:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.171+0000 7f71ce000640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71b80678c0 0x7f71b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.171+0000 7f71ce000640 1 -- 172.21.15.144:0/2260314766 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5335+0+0 (secure 0 0 0) 0x7f71c8120700 con 0x7f71d4073c50 2024-09-12T12:25:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.171+0000 7f71d9400640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71b80678c0 0x7f71b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.171+0000 7f71d9400640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71b80678c0 0x7f71b8069d80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f71d415c6b0 tx=0x7f71c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.175+0000 7f71ce000640 1 -- 172.21.15.144:0/2260314766 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f71d4156a70 con 0x7f71d4073c50 2024-09-12T12:25:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.331+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f71d415bdd0 con 0x7f71d4073c50 2024-09-12T12:25:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.331+0000 7f71ce000640 1 -- 172.21.15.144:0/2260314766 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v181) ==== 93+0+10 (secure 0 0 0) 0x7f71c8016110 con 0x7f71d4073c50 2024-09-12T12:25:00.334 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71b80678c0 msgr2=0x7f71b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71b80678c0 0x7f71b8069d80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f71d415c6b0 tx=0x7f71c4009040 comp rx=0 tx=0).stop 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d4073c50 msgr2=0x7f71d415fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d4073c50 0x7f71d415fa40 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f71c80ac040 tx=0x7f71c801ad30 comp rx=0 tx=0).stop 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 shutdown_connections 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f71b80678c0 0x7f71b8069d80 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71d415a120 0x7f71d41663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71d40d13b0 0x7f71d4156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 --2- 172.21.15.144:0/2260314766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71d4073c50 0x7f71d415fa40 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 >> 172.21.15.144:0/2260314766 conn(0x7f71d40d2400 msgr2=0x7f71d40b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:00.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 shutdown_connections 2024-09-12T12:25:00.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.335+0000 7f71dc800640 1 -- 172.21.15.144:0/2260314766 wait complete. 2024-09-12T12:25:00.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-12T12:25:00.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346aa00640 1 Processor -- start 2024-09-12T12:25:00.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346aa00640 1 -- start start 2024-09-12T12:25:00.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34640ce800 0x7f346415e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f346415ed80 0x7f346415f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346aa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34640d0ee0 con 0x7f346406bc10 2024-09-12T12:25:00.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346aa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f34640d0c00 con 0x7f346415ed80 2024-09-12T12:25:00.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f34640b5b80 con 0x7f34640ce800 2024-09-12T12:25:00.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f346415ed80 0x7f346415f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f346415ed80 0x7f346415f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49766/0 (socket says 172.21.15.144:49766) 2024-09-12T12:25:00.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346a000640 1 -- 172.21.15.144:0/723133708 learned_addr learned my addr 172.21.15.144:0/723133708 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:00.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f3468c00640 1 --2- 172.21.15.144:0/723133708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34640ce800 0x7f346415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346a000640 1 -- 172.21.15.144:0/723133708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34640ce800 msgr2=0x7f346415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:00.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346a000640 1 --2- 172.21.15.144:0/723133708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34640ce800 0x7f346415e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346a000640 1 -- 172.21.15.144:0/723133708 >> v1:172.21.15.165:6789/0 conn(0x7f346406bc10 legacy=0x7f346406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.491+0000 7f346a000640 1 -- 172.21.15.144:0/723133708 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34640b5e60 con 0x7f346415ed80 2024-09-12T12:25:00.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f346a000640 1 --2- 172.21.15.144:0/723133708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346415ed80 0x7f346415f210 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f345c009870 tx=0x7f345c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ccf3a7e3eec425 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f3463e00640 1 -- 172.21.15.144:0/723133708 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c0b2070 con 0x7f346415ed80 2024-09-12T12:25:00.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f3463e00640 1 -- 172.21.15.144:0/723133708 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345c0a9070 con 0x7f346415ed80 2024-09-12T12:25:00.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f3463e00640 1 -- 172.21.15.144:0/723133708 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c0ad880 con 0x7f346415ed80 2024-09-12T12:25:00.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f346aa00640 1 -- 172.21.15.144:0/723133708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346415ed80 msgr2=0x7f346415f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f346aa00640 1 --2- 172.21.15.144:0/723133708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346415ed80 0x7f346415f210 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f345c009870 tx=0x7f345c01c560 comp rx=0 tx=0).stop 2024-09-12T12:25:00.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f346aa00640 1 -- 172.21.15.144:0/723133708 shutdown_connections 2024-09-12T12:25:00.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f346aa00640 1 --2- 172.21.15.144:0/723133708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f346415ed80 0x7f346415f210 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f346aa00640 1 --2- 172.21.15.144:0/723133708 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34640ce800 0x7f346415e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f346aa00640 1 -- 172.21.15.144:0/723133708 >> 172.21.15.144:0/723133708 conn(0x7f34640cdce0 msgr2=0x7f34640ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:00.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f346aa00640 1 -- 172.21.15.144:0/723133708 shutdown_connections 2024-09-12T12:25:00.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.495+0000 7f346aa00640 1 -- 172.21.15.144:0/723133708 wait complete. 2024-09-12T12:25:00.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 Processor -- start 2024-09-12T12:25:00.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 -- start start 2024-09-12T12:25:00.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f346406bc10 0x7f3464142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34640ce800 0x7f3464159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f346415ed80 0x7f3464159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f346406f700 con 0x7f34640ce800 2024-09-12T12:25:00.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f346406f580 con 0x7f346415ed80 2024-09-12T12:25:00.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f34640cebe0 con 0x7f346406bc10 2024-09-12T12:25:00.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3468c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34640ce800 0x7f3464159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3468c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34640ce800 0x7f3464159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49770/0 (socket says 172.21.15.144:49770) 2024-09-12T12:25:00.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3468c00640 1 -- 172.21.15.144:0/1289692542 learned_addr learned my addr 172.21.15.144:0/1289692542 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:00.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3469600640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f346406bc10 0x7f3464142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346a000640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f346415ed80 0x7f3464159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3468c00640 1 -- 172.21.15.144:0/1289692542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f346406bc10 msgr2=0x7f3464142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3468c00640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f346406bc10 0x7f3464142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3468c00640 1 -- 172.21.15.144:0/1289692542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f346415ed80 msgr2=0x7f3464159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:00.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3468c00640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f346415ed80 0x7f3464159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:00.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3468c00640 1 -- 172.21.15.144:0/1289692542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3464143010 con 0x7f34640ce800 2024-09-12T12:25:00.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3468c00640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34640ce800 0x7f3464159900 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f345000e960 tx=0x7f345000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3461600640 1 -- 172.21.15.144:0/1289692542 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450017070 con 0x7f34640ce800 2024-09-12T12:25:00.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3461600640 1 -- 172.21.15.144:0/1289692542 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345000ca00 con 0x7f34640ce800 2024-09-12T12:25:00.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f3461600640 1 -- 172.21.15.144:0/1289692542 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345000cdb0 con 0x7f34640ce800 2024-09-12T12:25:00.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34641fb450 con 0x7f34640ce800 2024-09-12T12:25:00.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.499+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34641fba10 con 0x7f34640ce800 2024-09-12T12:25:00.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.503+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346415e840 con 0x7f34640ce800 2024-09-12T12:25:00.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.503+0000 7f3461600640 1 -- 172.21.15.144:0/1289692542 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f345001a070 con 0x7f34640ce800 2024-09-12T12:25:00.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.503+0000 7f3461600640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f34440678c0 0x7f3444069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.503+0000 7f3461600640 1 -- 172.21.15.144:0/1289692542 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5335+0+0 (secure 0 0 0) 0x7f3450085c30 con 0x7f34640ce800 2024-09-12T12:25:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.503+0000 7f3469600640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f34440678c0 0x7f3444069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.503+0000 7f3469600640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f34440678c0 0x7f3444069d80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3458001cb0 tx=0x7f3458009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.507+0000 7f3461600640 1 -- 172.21.15.144:0/1289692542 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3450056840 con 0x7f34640ce800 2024-09-12T12:25:00.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:00.723+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f34640b2d70 con 0x7f34640ce800 2024-09-12T12:25:01.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.663+0000 7f3461600640 1 -- 172.21.15.144:0/1289692542 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v604) ==== 143+0+0 (secure 0 0 0) 0x7f3450056140 con 0x7f34640ce800 2024-09-12T12:25:01.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f34440678c0 msgr2=0x7f3444069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f34440678c0 0x7f3444069d80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3458001cb0 tx=0x7f3458009040 comp rx=0 tx=0).stop 2024-09-12T12:25:01.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34640ce800 msgr2=0x7f3464159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34640ce800 0x7f3464159900 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f345000e960 tx=0x7f345000ee20 comp rx=0 tx=0).stop 2024-09-12T12:25:01.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 shutdown_connections 2024-09-12T12:25:01.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f34440678c0 0x7f3444069d80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f346415ed80 0x7f3464159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34640ce800 0x7f3464159900 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 --2- 172.21.15.144:0/1289692542 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f346406bc10 0x7f3464142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 >> 172.21.15.144:0/1289692542 conn(0x7f34640cdce0 msgr2=0x7f34640cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:01.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 shutdown_connections 2024-09-12T12:25:01.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.667+0000 7f346aa00640 1 -- 172.21.15.144:0/1289692542 wait complete. 2024-09-12T12:25:01.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:25:01.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa31de00640 1 Processor -- start 2024-09-12T12:25:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa31de00640 1 -- start start 2024-09-12T12:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa31de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 0x7fa31806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa31de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa31806c150 0x7fa3180cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa31de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3180733e0 con 0x7fa31815c2e0 2024-09-12T12:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa31de00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa31806c5c0 con 0x7fa31806c150 2024-09-12T12:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa31de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3180cd290 con 0x7fa3180af5f0 2024-09-12T12:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa316a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa31815c2e0 0x7fa318072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56784/0 (socket says 172.21.15.144:56784) 2024-09-12T12:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa316a00640 1 -- 172.21.15.144:0/2562592913 learned_addr learned my addr 172.21.15.144:0/2562592913 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa317400640 1 --2- 172.21.15.144:0/2562592913 >> v2:172.21.15.144:3300/0 conn(0x7fa31806c150 0x7fa3180cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa316000640 1 --2- 172.21.15.144:0/2562592913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 0x7fa31806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa317400640 1 -- 172.21.15.144:0/2562592913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 msgr2=0x7fa31806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa317400640 1 --2- 172.21.15.144:0/2562592913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 0x7fa31806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa317400640 1 -- 172.21.15.144:0/2562592913 >> v1:172.21.15.144:6789/0 conn(0x7fa31815c2e0 legacy=0x7fa318072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa317400640 1 -- 172.21.15.144:0/2562592913 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3180cd570 con 0x7fa31806c150 2024-09-12T12:25:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.835+0000 7fa315600640 1 -- 172.21.15.144:0/2562592913 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279127109 0 0) 0x7fa3180733e0 con 0x7fa31815c2e0 2024-09-12T12:25:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa317400640 1 --2- 172.21.15.144:0/2562592913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 0x7fa3180cdd70 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fa310009d90 tx=0x7fa31001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2208831a31c7d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa315600640 1 -- 172.21.15.144:0/2562592913 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3100b2070 con 0x7fa31806c150 2024-09-12T12:25:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa315600640 1 -- 172.21.15.144:0/2562592913 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3100a5720 con 0x7fa31806c150 2024-09-12T12:25:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa315600640 1 -- 172.21.15.144:0/2562592913 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3100a5af0 con 0x7fa31806c150 2024-09-12T12:25:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 -- 172.21.15.144:0/2562592913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 msgr2=0x7fa3180cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 --2- 172.21.15.144:0/2562592913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 0x7fa3180cdd70 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fa310009d90 tx=0x7fa31001c850 comp rx=0 tx=0).stop 2024-09-12T12:25:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 -- 172.21.15.144:0/2562592913 shutdown_connections 2024-09-12T12:25:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 --2- 172.21.15.144:0/2562592913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 0x7fa3180cdd70 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 --2- 172.21.15.144:0/2562592913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 0x7fa31806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 -- 172.21.15.144:0/2562592913 >> 172.21.15.144:0/2562592913 conn(0x7fa318068030 msgr2=0x7fa3180b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 -- 172.21.15.144:0/2562592913 shutdown_connections 2024-09-12T12:25:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 -- 172.21.15.144:0/2562592913 wait complete. 2024-09-12T12:25:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 Processor -- start 2024-09-12T12:25:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.839+0000 7fa31de00640 1 -- start start 2024-09-12T12:25:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa31de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 0x7fa318154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa31de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 0x7fa31814ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa31de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31815c2e0 0x7fa31815af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa31de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3180cee90 con 0x7fa31806c150 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa31de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa3180ced10 con 0x7fa31815c2e0 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa31de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3180cf010 con 0x7fa3180af5f0 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 0x7fa318154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 0x7fa318154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49790/0 (socket says 172.21.15.144:49790) 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316a00640 1 -- 172.21.15.144:0/2991093613 learned_addr learned my addr 172.21.15.144:0/2991093613 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316000640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 0x7fa31814ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa317400640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31815c2e0 0x7fa31815af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316a00640 1 -- 172.21.15.144:0/2991093613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 msgr2=0x7fa31814ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316a00640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 0x7fa31814ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316a00640 1 -- 172.21.15.144:0/2991093613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31815c2e0 msgr2=0x7fa31815af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316a00640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31815c2e0 0x7fa31815af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316a00640 1 -- 172.21.15.144:0/2991093613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3181f7150 con 0x7fa31806c150 2024-09-12T12:25:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa316a00640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 0x7fa318154030 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fa3080011f0 tx=0x7fa30800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa30f400640 1 -- 172.21.15.144:0/2991093613 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308018070 con 0x7fa31806c150 2024-09-12T12:25:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa30f400640 1 -- 172.21.15.144:0/2991093613 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3080074e0 con 0x7fa31806c150 2024-09-12T12:25:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3181fa950 con 0x7fa31806c150 2024-09-12T12:25:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa30f400640 1 -- 172.21.15.144:0/2991093613 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308004a10 con 0x7fa31806c150 2024-09-12T12:25:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3181faf10 con 0x7fa31806c150 2024-09-12T12:25:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.843+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa318154710 con 0x7fa31806c150 2024-09-12T12:25:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.847+0000 7fa30f400640 1 -- 172.21.15.144:0/2991093613 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa30801b070 con 0x7fa31806c150 2024-09-12T12:25:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.847+0000 7fa30f400640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2f80678c0 0x7fa2f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.847+0000 7fa30f400640 1 -- 172.21.15.144:0/2991093613 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5335+0+0 (secure 0 0 0) 0x7fa308084d20 con 0x7fa31806c150 2024-09-12T12:25:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.847+0000 7fa316000640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2f80678c0 0x7fa2f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.847+0000 7fa316000640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2f80678c0 0x7fa2f8069d80 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa31806be60 tx=0x7fa304008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:01.851+0000 7fa30f400640 1 -- 172.21.15.144:0/2991093613 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa318154710 con 0x7fa31806c150 2024-09-12T12:25:02.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.011+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa3180cdd70 con 0x7fa31806c150 2024-09-12T12:25:02.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa30f400640 1 -- 172.21.15.144:0/2991093613 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fa308055410 con 0x7fa31806c150 2024-09-12T12:25:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2f80678c0 msgr2=0x7fa2f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2f80678c0 0x7fa2f8069d80 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa31806be60 tx=0x7fa304008040 comp rx=0 tx=0).stop 2024-09-12T12:25:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 msgr2=0x7fa318154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 0x7fa318154030 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fa3080011f0 tx=0x7fa30800c9b0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 shutdown_connections 2024-09-12T12:25:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2f80678c0 0x7fa2f8069d80 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31815c2e0 0x7fa31815af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3180af5f0 0x7fa31814ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 --2- 172.21.15.144:0/2991093613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa31806c150 0x7fa318154030 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 >> 172.21.15.144:0/2991093613 conn(0x7fa318068030 msgr2=0x7fa3180ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 shutdown_connections 2024-09-12T12:25:02.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.015+0000 7fa31de00640 1 -- 172.21.15.144:0/2991093613 wait complete. 2024-09-12T12:25:02.037 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:25:02.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:25:02.124 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:25:02.215 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:25:02.215 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:25:02.215 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:02.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:25:02.224 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:25:02.224 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:02.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:25:02.234 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:25:02.234 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:02.274 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:25:02.274 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:25:02.274 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:02.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:25:02.288 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:25:02.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:25:02.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea3c00640 1 Processor -- start 2024-09-12T12:25:02.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea3c00640 1 -- start start 2024-09-12T12:25:02.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea3c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe9c15c7b0 0x7efe9c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea3c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 0x7efe9c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea3c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe9c0cd870 con 0x7efe9c15cd30 2024-09-12T12:25:02.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea3c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efe9c072a50 con 0x7efe9c15c7b0 2024-09-12T12:25:02.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea3c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c0cde30 con 0x7efe9c0b5fb0 2024-09-12T12:25:02.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea1200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe9c15c7b0 0x7efe9c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea1200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe9c15c7b0 0x7efe9c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49798/0 (socket says 172.21.15.144:49798) 2024-09-12T12:25:02.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea1200640 1 -- 172.21.15.144:0/2640536727 learned_addr learned my addr 172.21.15.144:0/2640536727 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:02.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea1c00640 1 --2- 172.21.15.144:0/2640536727 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 0x7efe9c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea1200640 1 -- 172.21.15.144:0/2640536727 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 msgr2=0x7efe9c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea1200640 1 --2- 172.21.15.144:0/2640536727 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 0x7efe9c072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea1200640 1 -- 172.21.15.144:0/2640536727 >> v1:172.21.15.165:6789/0 conn(0x7efe9c15cd30 legacy=0x7efe9c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.447+0000 7efea1200640 1 -- 172.21.15.144:0/2640536727 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c0cdb50 con 0x7efe9c15c7b0 2024-09-12T12:25:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efea1200640 1 --2- 172.21.15.144:0/2640536727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 0x7efe9c0ccf00 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009e50 tx=0x7efe8c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802fac0c72d42e7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efe9b400640 1 -- 172.21.15.144:0/2640536727 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c0a5810 con 0x7efe9c15c7b0 2024-09-12T12:25:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efe9b400640 1 -- 172.21.15.144:0/2640536727 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe8c0a59b0 con 0x7efe9c15c7b0 2024-09-12T12:25:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efe9b400640 1 -- 172.21.15.144:0/2640536727 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c0a5d80 con 0x7efe9c15c7b0 2024-09-12T12:25:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efea3c00640 1 -- 172.21.15.144:0/2640536727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 msgr2=0x7efe9c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efea3c00640 1 --2- 172.21.15.144:0/2640536727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 0x7efe9c0ccf00 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009e50 tx=0x7efe8c01ca30 comp rx=0 tx=0).stop 2024-09-12T12:25:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efea3c00640 1 -- 172.21.15.144:0/2640536727 shutdown_connections 2024-09-12T12:25:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efea3c00640 1 --2- 172.21.15.144:0/2640536727 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 0x7efe9c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efea3c00640 1 --2- 172.21.15.144:0/2640536727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 0x7efe9c0ccf00 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efea3c00640 1 -- 172.21.15.144:0/2640536727 >> 172.21.15.144:0/2640536727 conn(0x7efe9c06d0d0 msgr2=0x7efe9c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efea3c00640 1 -- 172.21.15.144:0/2640536727 shutdown_connections 2024-09-12T12:25:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.451+0000 7efea3c00640 1 -- 172.21.15.144:0/2640536727 wait complete. 2024-09-12T12:25:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 Processor -- start 2024-09-12T12:25:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 -- start start 2024-09-12T12:25:02.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 0x7efe9c1f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 0x7efe9c1449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe9c15cd30 0x7efe9c15b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c073fc0 con 0x7efe9c15c7b0 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c073e40 con 0x7efe9c15cd30 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c074140 con 0x7efe9c0b5fb0 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe9be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 0x7efe9c1449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe9be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 0x7efe9c1449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49800/0 (socket says 172.21.15.144:49800) 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe9be00640 1 -- 172.21.15.144:0/3949268734 learned_addr learned my addr 172.21.15.144:0/3949268734 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea1200640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 0x7efe9c1f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea1c00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe9c15cd30 0x7efe9c15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe9be00640 1 -- 172.21.15.144:0/3949268734 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 msgr2=0x7efe9c1f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe9be00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 0x7efe9c1f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe9be00640 1 -- 172.21.15.144:0/3949268734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe9c15cd30 msgr2=0x7efe9c15b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe9be00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe9c15cd30 0x7efe9c15b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe9be00640 1 -- 172.21.15.144:0/3949268734 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c145380 con 0x7efe9c15c7b0 2024-09-12T12:25:02.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe9be00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 0x7efe9c1449a0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c390 tx=0x7efe8800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:02.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe98c00640 1 -- 172.21.15.144:0/3949268734 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88017070 con 0x7efe9c15c7b0 2024-09-12T12:25:02.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe98c00640 1 -- 172.21.15.144:0/3949268734 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe880052f0 con 0x7efe9c15c7b0 2024-09-12T12:25:02.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efe98c00640 1 -- 172.21.15.144:0/3949268734 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88003840 con 0x7efe9c15c7b0 2024-09-12T12:25:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9c145660 con 0x7efe9c15c7b0 2024-09-12T12:25:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.455+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9c142d90 con 0x7efe9c15c7b0 2024-09-12T12:25:02.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.459+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe9c165200 con 0x7efe9c15c7b0 2024-09-12T12:25:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.459+0000 7efe98c00640 1 -- 172.21.15.144:0/3949268734 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe8801a070 con 0x7efe9c15c7b0 2024-09-12T12:25:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.459+0000 7efe98c00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe7c0678c0 0x7efe7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.459+0000 7efe98c00640 1 -- 172.21.15.144:0/3949268734 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5335+0+0 (secure 0 0 0) 0x7efe88084d50 con 0x7efe9c15c7b0 2024-09-12T12:25:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.459+0000 7efea1200640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe7c0678c0 0x7efe7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.459+0000 7efea1200640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe7c0678c0 0x7efe7c069d80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0ae000 tx=0x7efe8c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:02.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.463+0000 7efe98c00640 1 -- 172.21.15.144:0/3949268734 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe880553a0 con 0x7efe9c15c7b0 2024-09-12T12:25:02.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.651+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe9c072ec0 con 0x7efe9c15c7b0 2024-09-12T12:25:02.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.651+0000 7efe98c00640 1 -- 172.21.15.144:0/3949268734 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+3929 (secure 0 0 0) 0x7efe880596a0 con 0x7efe9c15c7b0 2024-09-12T12:25:02.654 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:02.655 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":141,"btime":"2024-09-12T12:24:56:432676+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8132,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2178161495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2178161495},{"type":"v1","addr":"172.21.15.144:6835","nonce":2178161495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":130},{"gid":8150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2493299621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2493299621},{"type":"v1","addr":"172.21.15.165:6835","nonce":2493299621}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131},{"gid":9571,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1669479435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1669479435},{"type":"v1","addr":"172.21.15.165:6834","nonce":1669479435}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141},{"gid":10134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1288683365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1288683365},{"type":"v1","addr":"172.21.15.144:6837","nonce":1288683365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":141}],"filesystems":[]} 2024-09-12T12:25:02.655 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 141 2024-09-12T12:25:02.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe7c0678c0 msgr2=0x7efe7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe7c0678c0 0x7efe7c069d80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0ae000 tx=0x7efe8c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:25:02.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 msgr2=0x7efe9c1449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 0x7efe9c1449a0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c390 tx=0x7efe8800c850 comp rx=0 tx=0).stop 2024-09-12T12:25:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 shutdown_connections 2024-09-12T12:25:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efe7c0678c0 0x7efe7c069d80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe9c15cd30 0x7efe9c15b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe9c15c7b0 0x7efe9c1449a0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 --2- 172.21.15.144:0/3949268734 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe9c0b5fb0 0x7efe9c1f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 >> 172.21.15.144:0/3949268734 conn(0x7efe9c06d0d0 msgr2=0x7efe9c0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 shutdown_connections 2024-09-12T12:25:02.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.655+0000 7efea3c00640 1 -- 172.21.15.144:0/3949268734 wait complete. 2024-09-12T12:25:02.676 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:25:02.676 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:25:02.676 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:25:02.676 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:25:02.676 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:25:02.676 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:25:02.677 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:25:02.677 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:25:02.677 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:25:02.677 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:25:02.677 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:25:02.677 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:25:02.677 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:25:02.678 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:25:02.678 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:25:02.678 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:25:02.688 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:25:02.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:25:02.689 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:25:02.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:25:02.691 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:25:02.691 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:25:02.692 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:25:02.692 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:25:02.736 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:25:02.737 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:02.738 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:25:02.738 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:02.739 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:25:02.739 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:02.740 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:25:02.741 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:02.741 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:25:02.822 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:25:02.824 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:25:02.828 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:25:02.830 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:25:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.883+0000 7f9144800640 1 Processor -- start 2024-09-12T12:25:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.883+0000 7f9144800640 1 -- start start 2024-09-12T12:25:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.883+0000 7f9144800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f913c0b74b0 0x7f913c06d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.883+0000 7f9144800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913c06e4d0 con 0x7f913c06dce0 2024-09-12T12:25:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.883+0000 7f9144800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913c06e7b0 con 0x7f913c15e540 2024-09-12T12:25:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.883+0000 7f9144800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f913c0cba40 con 0x7f913c0b74b0 2024-09-12T12:25:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.883+0000 7f9141400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f913c0b74b0 0x7f913c06d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9141e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f913c15e540 0x7f913c0b6da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:44356/0 (socket says 172.21.15.144:44356) 2024-09-12T12:25:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9141e00640 1 -- 172.21.15.144:0/1030121433 learned_addr learned my addr 172.21.15.144:0/1030121433 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9142800640 1 --1- 172.21.15.144:0/1030121433 >> v1:172.21.15.144:6789/0 conn(0x7f913c06dce0 0x7f913c0cbed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56792/0 (socket says 172.21.15.144:56792) 2024-09-12T12:25:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9140a00640 1 -- 172.21.15.144:0/1030121433 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209556827 0 0) 0x7f913c06e7b0 con 0x7f913c15e540 2024-09-12T12:25:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9141400640 1 -- 172.21.15.144:0/1030121433 >> v1:172.21.15.165:6789/0 conn(0x7f913c15e540 legacy=0x7f913c0b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9141400640 1 -- 172.21.15.144:0/1030121433 >> v1:172.21.15.144:6789/0 conn(0x7f913c06dce0 legacy=0x7f913c0cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9141400640 1 -- 172.21.15.144:0/1030121433 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c06ea90 con 0x7f913c0b74b0 2024-09-12T12:25:02.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9141400640 1 --2- 172.21.15.144:0/1030121433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 0x7f913c06d7a0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f912c0097a0 tx=0x7f912c01c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c427b60305b70a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:02.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9140a00640 1 -- 172.21.15.144:0/1030121433 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c0b0070 con 0x7f913c0b74b0 2024-09-12T12:25:02.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9140a00640 1 -- 172.21.15.144:0/1030121433 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912c0ab600 con 0x7f913c0b74b0 2024-09-12T12:25:02.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.887+0000 7f9140a00640 1 -- 172.21.15.144:0/1030121433 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c0ab9d0 con 0x7f913c0b74b0 2024-09-12T12:25:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 -- 172.21.15.144:0/1030121433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 msgr2=0x7f913c06d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 --2- 172.21.15.144:0/1030121433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 0x7f913c06d7a0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f912c0097a0 tx=0x7f912c01c280 comp rx=0 tx=0).stop 2024-09-12T12:25:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 -- 172.21.15.144:0/1030121433 shutdown_connections 2024-09-12T12:25:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 --2- 172.21.15.144:0/1030121433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 0x7f913c06d7a0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 -- 172.21.15.144:0/1030121433 >> 172.21.15.144:0/1030121433 conn(0x7f913c067a00 msgr2=0x7f913c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 -- 172.21.15.144:0/1030121433 shutdown_connections 2024-09-12T12:25:02.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 -- 172.21.15.144:0/1030121433 wait complete. 2024-09-12T12:25:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 Processor -- start 2024-09-12T12:25:02.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 -- start start 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f913c06dce0 0x7f913c1498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 0x7f913c0b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f913c15e540 0x7f913c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f913c06e2b0 con 0x7f913c0b74b0 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f913c06e130 con 0x7f913c06dce0 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9144800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f913c0cc5e0 con 0x7f913c15e540 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 0x7f913c0b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 0x7f913c0b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49864/0 (socket says 172.21.15.144:49864) 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141400640 1 -- 172.21.15.144:0/2035587953 learned_addr learned my addr 172.21.15.144:0/2035587953 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141e00640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f913c06dce0 0x7f913c1498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9142800640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f913c15e540 0x7f913c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141400640 1 -- 172.21.15.144:0/2035587953 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f913c15e540 msgr2=0x7f913c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141400640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f913c15e540 0x7f913c0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141400640 1 -- 172.21.15.144:0/2035587953 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f913c06dce0 msgr2=0x7f913c1498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141400640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f913c06dce0 0x7f913c1498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141400640 1 -- 172.21.15.144:0/2035587953 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913c14bfb0 con 0x7f913c0b74b0 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.891+0000 7f9141400640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 0x7f913c0b41e0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f912c0ae040 tx=0x7f912c01aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9136000640 1 -- 172.21.15.144:0/2035587953 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c0b0040 con 0x7f913c0b74b0 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9136000640 1 -- 172.21.15.144:0/2035587953 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912c004230 con 0x7f913c0b74b0 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913c14af10 con 0x7f913c0b74b0 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9136000640 1 -- 172.21.15.144:0/2035587953 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c0059a0 con 0x7f913c0b74b0 2024-09-12T12:25:02.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f913c14b4d0 con 0x7f913c0b74b0 2024-09-12T12:25:02.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f913c15d710 con 0x7f913c0b74b0 2024-09-12T12:25:02.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9136000640 1 -- 172.21.15.144:0/2035587953 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f912c0ab4c0 con 0x7f913c0b74b0 2024-09-12T12:25:02.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9136000640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91200678f0 0x7f9120069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:02.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9136000640 1 -- 172.21.15.144:0/2035587953 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5335+0+0 (secure 0 0 0) 0x7f912c1202c0 con 0x7f913c0b74b0 2024-09-12T12:25:02.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9141e00640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91200678f0 0x7f9120069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:02.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.895+0000 7f9141e00640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91200678f0 0x7f9120069db0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9130000f70 tx=0x7f9130007240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:02.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:02.899+0000 7f9136000640 1 -- 172.21.15.144:0/2035587953 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f912c0bb020 con 0x7f913c0b74b0 2024-09-12T12:25:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.067+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f913c069500 con 0x7f913c0b74b0 2024-09-12T12:25:03.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9136000640 1 -- 172.21.15.144:0/2035587953 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v183) ==== 97+0+0 (secure 0 0 0) 0x7f912c015f90 con 0x7f913c0b74b0 2024-09-12T12:25:03.678 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:25:03.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91200678f0 msgr2=0x7f9120069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91200678f0 0x7f9120069db0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9130000f70 tx=0x7f9130007240 comp rx=0 tx=0).stop 2024-09-12T12:25:03.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 msgr2=0x7f913c0b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 0x7f913c0b41e0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f912c0ae040 tx=0x7f912c01aac0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 shutdown_connections 2024-09-12T12:25:03.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f91200678f0 0x7f9120069db0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f913c15e540 0x7f913c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f913c0b74b0 0x7f913c0b41e0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 --2- 172.21.15.144:0/2035587953 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f913c06dce0 0x7f913c1498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 >> 172.21.15.144:0/2035587953 conn(0x7f913c067a00 msgr2=0x7f913c0cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:03.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 shutdown_connections 2024-09-12T12:25:03.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.679+0000 7f9144800640 1 -- 172.21.15.144:0/2035587953 wait complete. 2024-09-12T12:25:03.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:25:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f7350c00640 1 Processor -- start 2024-09-12T12:25:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f7350c00640 1 -- start start 2024-09-12T12:25:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f7350c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 0x7f734c0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f7350c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f734c0b2bd0 0x7f734c15c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f7350c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c0ce2b0 con 0x7f734c15c0c0 2024-09-12T12:25:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f7350c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f734c0b3000 con 0x7f734c0b2bd0 2024-09-12T12:25:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f7350c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f734c0ce590 con 0x7f734c0cf350 2024-09-12T12:25:03.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f734a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f734c0b2bd0 0x7f734c15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f734a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f734c0b2bd0 0x7f734c15c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49878/0 (socket says 172.21.15.144:49878) 2024-09-12T12:25:03.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f734a800640 1 -- 172.21.15.144:0/2728880970 learned_addr learned my addr 172.21.15.144:0/2728880970 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:03.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f7349400640 1 --2- 172.21.15.144:0/2728880970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 0x7f734c0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f734a800640 1 -- 172.21.15.144:0/2728880970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 msgr2=0x7f734c0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:03.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f734a800640 1 --2- 172.21.15.144:0/2728880970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 0x7f734c0b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f734a800640 1 -- 172.21.15.144:0/2728880970 >> v1:172.21.15.165:6789/0 conn(0x7f734c15c0c0 legacy=0x7f734c070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.843+0000 7f734a800640 1 -- 172.21.15.144:0/2728880970 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c0ce870 con 0x7f734c0b2bd0 2024-09-12T12:25:03.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f734a800640 1 --2- 172.21.15.144:0/2728880970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 0x7f734c15c4a0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f7344009e50 tx=0x7f734401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca166942e25b1626 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:03.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7348a00640 1 -- 172.21.15.144:0/2728880970 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73440a5810 con 0x7f734c0b2bd0 2024-09-12T12:25:03.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7348a00640 1 -- 172.21.15.144:0/2728880970 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73440a59b0 con 0x7f734c0b2bd0 2024-09-12T12:25:03.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7348a00640 1 -- 172.21.15.144:0/2728880970 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73440a5d80 con 0x7f734c0b2bd0 2024-09-12T12:25:03.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7350c00640 1 -- 172.21.15.144:0/2728880970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 msgr2=0x7f734c15c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7350c00640 1 --2- 172.21.15.144:0/2728880970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 0x7f734c15c4a0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f7344009e50 tx=0x7f734401ca30 comp rx=0 tx=0).stop 2024-09-12T12:25:03.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7350c00640 1 -- 172.21.15.144:0/2728880970 shutdown_connections 2024-09-12T12:25:03.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7350c00640 1 --2- 172.21.15.144:0/2728880970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 0x7f734c15c4a0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7350c00640 1 --2- 172.21.15.144:0/2728880970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 0x7f734c0b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7350c00640 1 -- 172.21.15.144:0/2728880970 >> 172.21.15.144:0/2728880970 conn(0x7f734c0b3280 msgr2=0x7f734c0b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:03.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7350c00640 1 -- 172.21.15.144:0/2728880970 shutdown_connections 2024-09-12T12:25:03.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.847+0000 7f7350c00640 1 -- 172.21.15.144:0/2728880970 wait complete. 2024-09-12T12:25:03.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 Processor -- start 2024-09-12T12:25:03.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 -- start start 2024-09-12T12:25:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 0x7f734c14bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 0x7f734c147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f734c15c0c0 0x7f734c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f734c15d370 con 0x7f734c0b2bd0 2024-09-12T12:25:03.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f734c15d1f0 con 0x7f734c15c0c0 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f734c15d4f0 con 0x7f734c0cf350 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 0x7f734c14bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 0x7f734c14bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49888/0 (socket says 172.21.15.144:49888) 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349e00640 1 -- 172.21.15.144:0/123553665 learned_addr learned my addr 172.21.15.144:0/123553665 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f734a800640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f734c15c0c0 0x7f734c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349400640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 0x7f734c147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349e00640 1 -- 172.21.15.144:0/123553665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 msgr2=0x7f734c147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349e00640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 0x7f734c147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349e00640 1 -- 172.21.15.144:0/123553665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f734c15c0c0 msgr2=0x7f734c15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349e00640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f734c15c0c0 0x7f734c15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349e00640 1 -- 172.21.15.144:0/123553665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c150360 con 0x7f734c0b2bd0 2024-09-12T12:25:03.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7349e00640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 0x7f734c14bb30 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c450 tx=0x7f733c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:03.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7342000640 1 -- 172.21.15.144:0/123553665 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c016020 con 0x7f734c0b2bd0 2024-09-12T12:25:03.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7342000640 1 -- 172.21.15.144:0/123553665 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c0052d0 con 0x7f734c0b2bd0 2024-09-12T12:25:03.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7342000640 1 -- 172.21.15.144:0/123553665 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c007260 con 0x7f734c0b2bd0 2024-09-12T12:25:03.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734c14e7d0 con 0x7f734c0b2bd0 2024-09-12T12:25:03.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734c1480e0 con 0x7f734c0b2bd0 2024-09-12T12:25:03.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.851+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734c15c4a0 con 0x7f734c0b2bd0 2024-09-12T12:25:03.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.855+0000 7f7342000640 1 -- 172.21.15.144:0/123553665 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f733c007400 con 0x7f734c0b2bd0 2024-09-12T12:25:03.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.855+0000 7f7342000640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f732c0678c0 0x7f732c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:03.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.855+0000 7f7342000640 1 -- 172.21.15.144:0/123553665 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5249+0+0 (secure 0 0 0) 0x7f733c085360 con 0x7f734c0b2bd0 2024-09-12T12:25:03.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.855+0000 7f7349400640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f732c0678c0 0x7f732c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:03.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.855+0000 7f7349400640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f732c0678c0 0x7f732c069d80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f734c157080 tx=0x7f7338009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:03.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:03.859+0000 7f7342000640 1 -- 172.21.15.144:0/123553665 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f733c020020 con 0x7f734c0b2bd0 2024-09-12T12:25:04.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.071+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f734c15a980 con 0x7f734c0b2bd0 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7342000640 1 -- 172.21.15.144:0/123553665 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f733c005480 con 0x7f734c0b2bd0 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:04.075 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.077 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.078 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:25:04.080 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:04.081 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:25:04.082 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.084 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:04.085 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:25:04.087 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:04.088 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.089 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:25:04.089 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:25:04.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f732c0678c0 msgr2=0x7f732c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f732c0678c0 0x7f732c069d80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f734c157080 tx=0x7f7338009190 comp rx=0 tx=0).stop 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 msgr2=0x7f734c14bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 0x7f734c14bb30 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c450 tx=0x7f733c00c910 comp rx=0 tx=0).stop 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 shutdown_connections 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f732c0678c0 0x7f732c069d80 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f734c15c0c0 0x7f734c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f734c0cf350 0x7f734c147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 --2- 172.21.15.144:0/123553665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f734c0b2bd0 0x7f734c14bb30 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 >> 172.21.15.144:0/123553665 conn(0x7f734c0b3280 msgr2=0x7f734c150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 shutdown_connections 2024-09-12T12:25:04.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.075+0000 7f7350c00640 1 -- 172.21.15.144:0/123553665 wait complete. 2024-09-12T12:25:04.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:25:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc198c00640 1 Processor -- start 2024-09-12T12:25:04.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc198c00640 1 -- start start 2024-09-12T12:25:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc198c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc1940b4200 0x7fc1940b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc198c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc1940b5720 0x7fc1940b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc198c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1940d1580 con 0x7fc19415c220 2024-09-12T12:25:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc198c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc1940b4bb0 con 0x7fc1940b5720 2024-09-12T12:25:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc198c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc1940d1320 con 0x7fc1940b4200 2024-09-12T12:25:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc192800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc1940b5720 0x7fc1940b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc191e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc19415c220 0x7fc1940d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56800/0 (socket says 172.21.15.144:56800) 2024-09-12T12:25:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.231+0000 7fc191e00640 1 -- 172.21.15.144:0/568515702 learned_addr learned my addr 172.21.15.144:0/568515702 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc192800640 1 -- 172.21.15.144:0/568515702 >> v2:172.21.15.165:3300/0 conn(0x7fc1940b4200 msgr2=0x7fc1940b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:04.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc192800640 1 --2- 172.21.15.144:0/568515702 >> v2:172.21.15.165:3300/0 conn(0x7fc1940b4200 0x7fc1940b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc192800640 1 -- 172.21.15.144:0/568515702 >> v1:172.21.15.144:6789/0 conn(0x7fc19415c220 legacy=0x7fc1940d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc192800640 1 -- 172.21.15.144:0/568515702 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1940d1860 con 0x7fc1940b5720 2024-09-12T12:25:04.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc192800640 1 --2- 172.21.15.144:0/568515702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1940b5720 0x7fc1940b5b30 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fc1940b17c0 tx=0x7fc18c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1122c5cdbfbba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc190a00640 1 -- 172.21.15.144:0/568515702 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0ab430 con 0x7fc1940b5720 2024-09-12T12:25:04.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc190a00640 1 -- 172.21.15.144:0/568515702 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c0b0070 con 0x7fc1940b5720 2024-09-12T12:25:04.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc190a00640 1 -- 172.21.15.144:0/568515702 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0ab7f0 con 0x7fc1940b5720 2024-09-12T12:25:04.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc198c00640 1 -- 172.21.15.144:0/568515702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1940b5720 msgr2=0x7fc1940b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc198c00640 1 --2- 172.21.15.144:0/568515702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1940b5720 0x7fc1940b5b30 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fc1940b17c0 tx=0x7fc18c01c430 comp rx=0 tx=0).stop 2024-09-12T12:25:04.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc198c00640 1 -- 172.21.15.144:0/568515702 shutdown_connections 2024-09-12T12:25:04.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc198c00640 1 --2- 172.21.15.144:0/568515702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1940b5720 0x7fc1940b5b30 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc198c00640 1 --2- 172.21.15.144:0/568515702 >> v2:172.21.15.165:3300/0 conn(0x7fc1940b4200 0x7fc1940b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc198c00640 1 -- 172.21.15.144:0/568515702 >> 172.21.15.144:0/568515702 conn(0x7fc19406f400 msgr2=0x7fc19406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.235+0000 7fc198c00640 1 -- 172.21.15.144:0/568515702 shutdown_connections 2024-09-12T12:25:04.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 -- 172.21.15.144:0/568515702 wait complete. 2024-09-12T12:25:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 Processor -- start 2024-09-12T12:25:04.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 -- start start 2024-09-12T12:25:04.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1940b4200 0x7fc19414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1940b5720 0x7fc19414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc19415c220 0x7fc19415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc19415c780 con 0x7fc19415c220 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc19415c600 con 0x7fc1940b4200 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc194070bf0 con 0x7fc1940b5720 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc192800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc19415c220 0x7fc19415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc192800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc19415c220 0x7fc19415d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49902/0 (socket says 172.21.15.144:49902) 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc192800640 1 -- 172.21.15.144:0/1966728949 learned_addr learned my addr 172.21.15.144:0/1966728949 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc191e00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1940b4200 0x7fc19414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc191400640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1940b5720 0x7fc19414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc192800640 1 -- 172.21.15.144:0/1966728949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1940b5720 msgr2=0x7fc19414efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc192800640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1940b5720 0x7fc19414efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc192800640 1 -- 172.21.15.144:0/1966728949 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1940b4200 msgr2=0x7fc19414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc192800640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1940b4200 0x7fc19414eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc192800640 1 -- 172.21.15.144:0/1966728949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19406da10 con 0x7fc19415c220 2024-09-12T12:25:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc191e00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1940b4200 0x7fc19414eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc192800640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc19415c220 0x7fc19415d310 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fc18c01a060 tx=0x7fc18c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc18a000640 1 -- 172.21.15.144:0/1966728949 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0bf610 con 0x7fc19415c220 2024-09-12T12:25:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc18a000640 1 -- 172.21.15.144:0/1966728949 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c0bf7b0 con 0x7fc19415c220 2024-09-12T12:25:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc18a000640 1 -- 172.21.15.144:0/1966728949 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0bfb80 con 0x7fc19415c220 2024-09-12T12:25:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.239+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19406dcf0 con 0x7fc19415c220 2024-09-12T12:25:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.243+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19406e2b0 con 0x7fc19415c220 2024-09-12T12:25:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.243+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1940b4670 con 0x7fc19415c220 2024-09-12T12:25:04.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.243+0000 7fc18a000640 1 -- 172.21.15.144:0/1966728949 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc18c0bd020 con 0x7fc19415c220 2024-09-12T12:25:04.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.243+0000 7fc18a000640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1740678c0 0x7fc174069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.243+0000 7fc18a000640 1 -- 172.21.15.144:0/1966728949 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5249+0+0 (secure 0 0 0) 0x7fc18c0a8030 con 0x7fc19415c220 2024-09-12T12:25:04.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.243+0000 7fc191e00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1740678c0 0x7fc174069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.243+0000 7fc191e00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1740678c0 0x7fc174069d80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc19414f880 tx=0x7fc184009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.247+0000 7fc18a000640 1 -- 172.21.15.144:0/1966728949 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc18c0c4060 con 0x7fc19415c220 2024-09-12T12:25:04.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc1940cee60 con 0x7fc19415c220 2024-09-12T12:25:04.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc18a000640 1 -- 172.21.15.144:0/1966728949 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v185) ==== 84+0+65 (secure 0 0 0) 0x7fc18c016050 con 0x7fc19415c220 2024-09-12T12:25:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:04.412 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:25:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:04.412 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:25:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:25:04.413 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:04.413 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:25:04.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1740678c0 msgr2=0x7fc174069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1740678c0 0x7fc174069d80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc19414f880 tx=0x7fc184009040 comp rx=0 tx=0).stop 2024-09-12T12:25:04.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc19415c220 msgr2=0x7fc19415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc19415c220 0x7fc19415d310 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fc18c01a060 tx=0x7fc18c01ac70 comp rx=0 tx=0).stop 2024-09-12T12:25:04.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 shutdown_connections 2024-09-12T12:25:04.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc1740678c0 0x7fc174069d80 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc19415c220 0x7fc19415d310 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1940b5720 0x7fc19414efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 --2- 172.21.15.144:0/1966728949 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1940b4200 0x7fc19414eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 >> 172.21.15.144:0/1966728949 conn(0x7fc19406f400 msgr2=0x7fc19415b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 shutdown_connections 2024-09-12T12:25:04.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.411+0000 7fc198c00640 1 -- 172.21.15.144:0/1966728949 wait complete. 2024-09-12T12:25:04.436 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:25:04.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:25:04.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac2c000640 1 Processor -- start 2024-09-12T12:25:04.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac2c000640 1 -- start start 2024-09-12T12:25:04.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac2c000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac240b3490 0x7fac240b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac2c000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac2406cd20 con 0x7fac2406d630 2024-09-12T12:25:04.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac2c000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac240b4f30 con 0x7fac2406d250 2024-09-12T12:25:04.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac2c000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fac24072620 con 0x7fac240b3490 2024-09-12T12:25:04.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac28c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac240b3490 0x7fac240b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac2a000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fac2406d630 0x7fac24155820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56802/0 (socket says 172.21.15.144:56802) 2024-09-12T12:25:04.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac2a000640 1 -- 172.21.15.144:0/1184586230 learned_addr learned my addr 172.21.15.144:0/1184586230 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:04.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac28c00640 1 -- 172.21.15.144:0/1184586230 >> v1:172.21.15.165:6789/0 conn(0x7fac2406d250 legacy=0x7fac2415c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac28c00640 1 -- 172.21.15.144:0/1184586230 >> v1:172.21.15.144:6789/0 conn(0x7fac2406d630 legacy=0x7fac24155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac28c00640 1 -- 172.21.15.144:0/1184586230 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac240b3950 con 0x7fac240b3490 2024-09-12T12:25:04.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.579+0000 7fac23e00640 1 -- 172.21.15.144:0/1184586230 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138873244 0 0) 0x7fac2406cd20 con 0x7fac2406d630 2024-09-12T12:25:04.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac28c00640 1 --2- 172.21.15.144:0/1184586230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 0x7fac240b49f0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fac100097c0 tx=0x7fac1001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffdc3051a26928f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac23e00640 1 -- 172.21.15.144:0/1184586230 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100a7070 con 0x7fac240b3490 2024-09-12T12:25:04.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac23e00640 1 -- 172.21.15.144:0/1184586230 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac100b0070 con 0x7fac240b3490 2024-09-12T12:25:04.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac23e00640 1 -- 172.21.15.144:0/1184586230 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac100ab890 con 0x7fac240b3490 2024-09-12T12:25:04.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac2c000640 1 -- 172.21.15.144:0/1184586230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 msgr2=0x7fac240b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac2c000640 1 --2- 172.21.15.144:0/1184586230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 0x7fac240b49f0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fac100097c0 tx=0x7fac1001c470 comp rx=0 tx=0).stop 2024-09-12T12:25:04.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac2c000640 1 -- 172.21.15.144:0/1184586230 shutdown_connections 2024-09-12T12:25:04.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac2c000640 1 --2- 172.21.15.144:0/1184586230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 0x7fac240b49f0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac2c000640 1 -- 172.21.15.144:0/1184586230 >> 172.21.15.144:0/1184586230 conn(0x7fac2406bc10 msgr2=0x7fac2406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:04.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac2c000640 1 -- 172.21.15.144:0/1184586230 shutdown_connections 2024-09-12T12:25:04.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.583+0000 7fac2c000640 1 -- 172.21.15.144:0/1184586230 wait complete. 2024-09-12T12:25:04.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 Processor -- start 2024-09-12T12:25:04.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 -- start start 2024-09-12T12:25:04.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac2406d250 0x7fac24156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac2406d630 0x7fac24148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 0x7fac240c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac2415d690 con 0x7fac240b3490 2024-09-12T12:25:04.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac240b44d0 con 0x7fac2406d630 2024-09-12T12:25:04.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac2415d810 con 0x7fac2406d250 2024-09-12T12:25:04.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 0x7fac240c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 0x7fac240c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49930/0 (socket says 172.21.15.144:49930) 2024-09-12T12:25:04.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2a000640 1 -- 172.21.15.144:0/2499843941 learned_addr learned my addr 172.21.15.144:0/2499843941 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:04.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac28c00640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac2406d630 0x7fac24148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac29600640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac2406d250 0x7fac24156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2a000640 1 -- 172.21.15.144:0/2499843941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac2406d250 msgr2=0x7fac24156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2a000640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac2406d250 0x7fac24156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2a000640 1 -- 172.21.15.144:0/2499843941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac2406d630 msgr2=0x7fac24148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:04.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2a000640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac2406d630 0x7fac24148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:04.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2a000640 1 -- 172.21.15.144:0/2499843941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2415b750 con 0x7fac240b3490 2024-09-12T12:25:04.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2a000640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 0x7fac240c9ab0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c7a0 tx=0x7fac1c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac21600640 1 -- 172.21.15.144:0/2499843941 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c018070 con 0x7fac240b3490 2024-09-12T12:25:04.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac21600640 1 -- 172.21.15.144:0/2499843941 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c00a640 con 0x7fac240b3490 2024-09-12T12:25:04.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac21600640 1 -- 172.21.15.144:0/2499843941 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00aa70 con 0x7fac240b3490 2024-09-12T12:25:04.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac24156d70 con 0x7fac240b3490 2024-09-12T12:25:04.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2414d560 con 0x7fac240b3490 2024-09-12T12:25:04.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.587+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac240b49f0 con 0x7fac240b3490 2024-09-12T12:25:04.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.591+0000 7fac21600640 1 -- 172.21.15.144:0/2499843941 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac1c00ac10 con 0x7fac240b3490 2024-09-12T12:25:04.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.591+0000 7fac21600640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac040678c0 0x7fac04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:04.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.591+0000 7fac21600640 1 -- 172.21.15.144:0/2499843941 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5249+0+0 (secure 0 0 0) 0x7fac1c0851f0 con 0x7fac240b3490 2024-09-12T12:25:04.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.591+0000 7fac29600640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac040678c0 0x7fac04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:04.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.591+0000 7fac29600640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac040678c0 0x7fac04069d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fac18007fd0 tx=0x7fac18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:04.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.595+0000 7fac21600640 1 -- 172.21.15.144:0/2499843941 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fac2415b750 con 0x7fac240b3490 2024-09-12T12:25:04.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:04.759+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fac2406df20 con 0x7fac240b3490 2024-09-12T12:25:05.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.687+0000 7fac21600640 1 -- 172.21.15.144:0/2499843941 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v186) ==== 138+0+0 (secure 0 0 0) 0x7fac1c055770 con 0x7fac240b3490 2024-09-12T12:25:05.688 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:25:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac040678c0 msgr2=0x7fac04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac040678c0 0x7fac04069d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fac18007fd0 tx=0x7fac18009040 comp rx=0 tx=0).stop 2024-09-12T12:25:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 msgr2=0x7fac240c9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 0x7fac240c9ab0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c7a0 tx=0x7fac1c00cc60 comp rx=0 tx=0).stop 2024-09-12T12:25:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 shutdown_connections 2024-09-12T12:25:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac040678c0 0x7fac04069d80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac240b3490 0x7fac240c9ab0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac2406d630 0x7fac24148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 --2- 172.21.15.144:0/2499843941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac2406d250 0x7fac24156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 >> 172.21.15.144:0/2499843941 conn(0x7fac2406bc10 msgr2=0x7fac24153410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 shutdown_connections 2024-09-12T12:25:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.691+0000 7fac2c000640 1 -- 172.21.15.144:0/2499843941 wait complete. 2024-09-12T12:25:05.721 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:25:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f5110200640 1 Processor -- start 2024-09-12T12:25:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f5110200640 1 -- start start 2024-09-12T12:25:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f5110200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f510815af60 0x7f51080ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f5110200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 0x7f51080b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f5110200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51080b4300 con 0x7f51080cd9f0 2024-09-12T12:25:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f5110200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f51080b32f0 con 0x7f510815af60 2024-09-12T12:25:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f5110200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51080b3540 con 0x7f510806c320 2024-09-12T12:25:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f510d800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f510815af60 0x7f51080ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f510d800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f510815af60 0x7f51080ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49932/0 (socket says 172.21.15.144:49932) 2024-09-12T12:25:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f510d800640 1 -- 172.21.15.144:0/4003650312 learned_addr learned my addr 172.21.15.144:0/4003650312 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f510e200640 1 --2- 172.21.15.144:0/4003650312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 0x7f51080b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f510d800640 1 -- 172.21.15.144:0/4003650312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 msgr2=0x7f51080b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f510d800640 1 --2- 172.21.15.144:0/4003650312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 0x7f51080b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f510d800640 1 -- 172.21.15.144:0/4003650312 >> v1:172.21.15.165:6789/0 conn(0x7f51080cd9f0 legacy=0x7f510806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.867+0000 7f510d800640 1 -- 172.21.15.144:0/4003650312 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080b3820 con 0x7f510815af60 2024-09-12T12:25:05.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f510d800640 1 --2- 172.21.15.144:0/4003650312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 0x7f51080ce680 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009870 tx=0x7f50fc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abc929f79bbbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5107e00640 1 -- 172.21.15.144:0/4003650312 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0ab650 con 0x7f510815af60 2024-09-12T12:25:05.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5107e00640 1 -- 172.21.15.144:0/4003650312 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50fc0b0070 con 0x7f510815af60 2024-09-12T12:25:05.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5107e00640 1 -- 172.21.15.144:0/4003650312 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0aba10 con 0x7f510815af60 2024-09-12T12:25:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5110200640 1 -- 172.21.15.144:0/4003650312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 msgr2=0x7f51080ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5110200640 1 --2- 172.21.15.144:0/4003650312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 0x7f51080ce680 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009870 tx=0x7f50fc01c560 comp rx=0 tx=0).stop 2024-09-12T12:25:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5110200640 1 -- 172.21.15.144:0/4003650312 shutdown_connections 2024-09-12T12:25:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5110200640 1 --2- 172.21.15.144:0/4003650312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 0x7f51080b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5110200640 1 --2- 172.21.15.144:0/4003650312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 0x7f51080ce680 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5110200640 1 -- 172.21.15.144:0/4003650312 >> 172.21.15.144:0/4003650312 conn(0x7f5108068030 msgr2=0x7f51080b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5110200640 1 -- 172.21.15.144:0/4003650312 shutdown_connections 2024-09-12T12:25:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.871+0000 7f5110200640 1 -- 172.21.15.144:0/4003650312 wait complete. 2024-09-12T12:25:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 Processor -- start 2024-09-12T12:25:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 -- start start 2024-09-12T12:25:05.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 0x7f510814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51080cd9f0 0x7f5108072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 0x7f5108070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51080b5430 con 0x7f510815af60 2024-09-12T12:25:05.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f51080b52b0 con 0x7f51080cd9f0 2024-09-12T12:25:05.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51080b55b0 con 0x7f510806c320 2024-09-12T12:25:05.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 0x7f5108070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 0x7f510814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51080cd9f0 0x7f5108072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 0x7f5108070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49938/0 (socket says 172.21.15.144:49938) 2024-09-12T12:25:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510e200640 1 -- 172.21.15.144:0/3625359007 learned_addr learned my addr 172.21.15.144:0/3625359007 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510e200640 1 -- 172.21.15.144:0/3625359007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 msgr2=0x7f510814c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510e200640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 0x7f510814c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510e200640 1 -- 172.21.15.144:0/3625359007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51080cd9f0 msgr2=0x7f5108072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510e200640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51080cd9f0 0x7f5108072ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510e200640 1 -- 172.21.15.144:0/3625359007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5108073020 con 0x7f510815af60 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f510e200640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 0x7f5108070ff0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f510000efc0 tx=0x7f510000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5105600640 1 -- 172.21.15.144:0/3625359007 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100018020 con 0x7f510815af60 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5105600640 1 -- 172.21.15.144:0/3625359007 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5100014480 con 0x7f510815af60 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5105600640 1 -- 172.21.15.144:0/3625359007 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100014870 con 0x7f510815af60 2024-09-12T12:25:05.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5108071a40 con 0x7f510815af60 2024-09-12T12:25:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.875+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5108072000 con 0x7f510815af60 2024-09-12T12:25:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.879+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51080b4560 con 0x7f510815af60 2024-09-12T12:25:05.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.879+0000 7f5105600640 1 -- 172.21.15.144:0/3625359007 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f510001b020 con 0x7f510815af60 2024-09-12T12:25:05.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.879+0000 7f5105600640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50e80678c0 0x7f50e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:05.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.879+0000 7f5105600640 1 -- 172.21.15.144:0/3625359007 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5619+0+0 (secure 0 0 0) 0x7f5100086a40 con 0x7f510815af60 2024-09-12T12:25:05.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.879+0000 7f510d800640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50e80678c0 0x7f50e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:05.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.879+0000 7f510d800640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50e80678c0 0x7f50e8069d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0af000 tx=0x7f50fc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:05.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:05.883+0000 7f5105600640 1 -- 172.21.15.144:0/3625359007 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5100022030 con 0x7f510815af60 2024-09-12T12:25:06.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.043+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f51080b1140 con 0x7f510815af60 2024-09-12T12:25:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.691+0000 7f5105600640 1 -- 172.21.15.144:0/3625359007 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v187) ==== 170+0+0 (secure 0 0 0) 0x7f5108073020 con 0x7f510815af60 2024-09-12T12:25:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:25:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50e80678c0 msgr2=0x7f50e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50e80678c0 0x7f50e8069d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0af000 tx=0x7f50fc0a7000 comp rx=0 tx=0).stop 2024-09-12T12:25:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 msgr2=0x7f5108070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 0x7f5108070ff0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f510000efc0 tx=0x7f510000c490 comp rx=0 tx=0).stop 2024-09-12T12:25:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 shutdown_connections 2024-09-12T12:25:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f50e80678c0 0x7f50e8069d80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:06.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510815af60 0x7f5108070ff0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:06.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51080cd9f0 0x7f5108072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:06.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 --2- 172.21.15.144:0/3625359007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510806c320 0x7f510814c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:06.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 >> 172.21.15.144:0/3625359007 conn(0x7f5108068030 msgr2=0x7f510806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:06.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 shutdown_connections 2024-09-12T12:25:06.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.695+0000 7f5110200640 1 -- 172.21.15.144:0/3625359007 wait complete. 2024-09-12T12:25:06.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:25:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.875+0000 7f0084400640 1 Processor -- start 2024-09-12T12:25:06.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.875+0000 7f0084400640 1 -- start start 2024-09-12T12:25:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0084400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 0x7f007c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0084400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f007c06c320 0x7f007c0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0084400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007c0b4300 con 0x7f007c0cd9f0 2024-09-12T12:25:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0084400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f007c0b32f0 con 0x7f007c06c320 2024-09-12T12:25:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0084400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f007c0b3540 con 0x7f007c15af60 2024-09-12T12:25:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0082400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f007c06c320 0x7f007c0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0082400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f007c06c320 0x7f007c0b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49950/0 (socket says 172.21.15.144:49950) 2024-09-12T12:25:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0082400640 1 -- 172.21.15.144:0/3266567351 learned_addr learned my addr 172.21.15.144:0/3266567351 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:06.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0081a00640 1 --2- 172.21.15.144:0/3266567351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 0x7f007c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0082400640 1 -- 172.21.15.144:0/3266567351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 msgr2=0x7f007c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:06.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0082400640 1 --2- 172.21.15.144:0/3266567351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 0x7f007c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:06.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0082400640 1 -- 172.21.15.144:0/3266567351 >> v1:172.21.15.165:6789/0 conn(0x7f007c0cd9f0 legacy=0x7f007c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:06.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.879+0000 7f0082400640 1 -- 172.21.15.144:0/3266567351 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c0b3820 con 0x7f007c06c320 2024-09-12T12:25:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0082400640 1 --2- 172.21.15.144:0/3266567351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 0x7f007c0b4560 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f0074009e50 tx=0x7f007401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3379e99c46ccf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f007be00640 1 -- 172.21.15.144:0/3266567351 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00740b4070 con 0x7f007c06c320 2024-09-12T12:25:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f007be00640 1 -- 172.21.15.144:0/3266567351 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00740af400 con 0x7f007c06c320 2024-09-12T12:25:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f007be00640 1 -- 172.21.15.144:0/3266567351 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00740af7d0 con 0x7f007c06c320 2024-09-12T12:25:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 -- 172.21.15.144:0/3266567351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 msgr2=0x7f007c0b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:06.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 --2- 172.21.15.144:0/3266567351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 0x7f007c0b4560 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f0074009e50 tx=0x7f007401f210 comp rx=0 tx=0).stop 2024-09-12T12:25:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 -- 172.21.15.144:0/3266567351 shutdown_connections 2024-09-12T12:25:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 --2- 172.21.15.144:0/3266567351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 0x7f007c0b4560 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 --2- 172.21.15.144:0/3266567351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 0x7f007c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 -- 172.21.15.144:0/3266567351 >> 172.21.15.144:0/3266567351 conn(0x7f007c068030 msgr2=0x7f007c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 -- 172.21.15.144:0/3266567351 shutdown_connections 2024-09-12T12:25:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 -- 172.21.15.144:0/3266567351 wait complete. 2024-09-12T12:25:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 Processor -- start 2024-09-12T12:25:06.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.883+0000 7f0084400640 1 -- start start 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0084400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 0x7f007c1417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0084400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f007c0cd9f0 0x7f007c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0084400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 0x7f007c1f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0084400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0cebc0 con 0x7f007c06c320 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0084400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0b3de0 con 0x7f007c0cd9f0 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0084400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f007c0ced40 con 0x7f007c15af60 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 0x7f007c1417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 0x7f007c1417d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49958/0 (socket says 172.21.15.144:49958) 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081a00640 1 -- 172.21.15.144:0/3033261922 learned_addr learned my addr 172.21.15.144:0/3033261922 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:06.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0082400640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 0x7f007c1f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:06.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081000640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f007c0cd9f0 0x7f007c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:06.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081a00640 1 -- 172.21.15.144:0/3033261922 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 msgr2=0x7f007c1f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:06.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081a00640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 0x7f007c1f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:06.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081a00640 1 -- 172.21.15.144:0/3033261922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f007c0cd9f0 msgr2=0x7f007c0b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:06.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081a00640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f007c0cd9f0 0x7f007c0b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:06.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081a00640 1 -- 172.21.15.144:0/3033261922 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c1453b0 con 0x7f007c06c320 2024-09-12T12:25:06.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0081a00640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 0x7f007c1417d0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f007000e8a0 tx=0x7f007000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:06.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0079600640 1 -- 172.21.15.144:0/3033261922 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070017070 con 0x7f007c06c320 2024-09-12T12:25:06.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0079600640 1 -- 172.21.15.144:0/3033261922 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f007000c940 con 0x7f007c06c320 2024-09-12T12:25:06.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0079600640 1 -- 172.21.15.144:0/3033261922 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007000ccf0 con 0x7f007c06c320 2024-09-12T12:25:06.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007c159010 con 0x7f007c06c320 2024-09-12T12:25:06.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007c1595d0 con 0x7f007c06c320 2024-09-12T12:25:06.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.887+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007c15b3d0 con 0x7f007c06c320 2024-09-12T12:25:06.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.891+0000 7f0079600640 1 -- 172.21.15.144:0/3033261922 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f007001a070 con 0x7f007c06c320 2024-09-12T12:25:06.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.891+0000 7f0079600640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f005c0678f0 0x7f005c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:06.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.891+0000 7f0079600640 1 -- 172.21.15.144:0/3033261922 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 6001+0+0 (secure 0 0 0) 0x7f0070085b80 con 0x7f007c06c320 2024-09-12T12:25:06.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.891+0000 7f0081000640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f005c0678f0 0x7f005c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:06.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.891+0000 7f0081000640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f005c0678f0 0x7f005c069db0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f007c151a10 tx=0x7f0068009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:06.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:06.895+0000 7f0079600640 1 -- 172.21.15.144:0/3033261922 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0070055f30 con 0x7f007c06c320 2024-09-12T12:25:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.083+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f007c0afc20 con 0x7f007c06c320 2024-09-12T12:25:07.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.723+0000 7f0079600640 1 -- 172.21.15.144:0/3033261922 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 27 and data pool 28 v144) ==== 174+0+0 (secure 0 0 0) 0x7f007005a230 con 0x7f007c06c320 2024-09-12T12:25:07.730 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 27 and data pool 28 2024-09-12T12:25:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f005c0678f0 msgr2=0x7f005c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f005c0678f0 0x7f005c069db0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f007c151a10 tx=0x7f0068009040 comp rx=0 tx=0).stop 2024-09-12T12:25:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 msgr2=0x7f007c1417d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 0x7f007c1417d0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f007000e8a0 tx=0x7f007000eca0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 shutdown_connections 2024-09-12T12:25:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f005c0678f0 0x7f005c069db0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f007c15af60 0x7f007c1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f007c0cd9f0 0x7f007c0b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 --2- 172.21.15.144:0/3033261922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c06c320 0x7f007c1417d0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.735+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 >> 172.21.15.144:0/3033261922 conn(0x7f007c068030 msgr2=0x7f007c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.739+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 shutdown_connections 2024-09-12T12:25:07.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.739+0000 7f0084400640 1 -- 172.21.15.144:0/3033261922 wait complete. 2024-09-12T12:25:07.768 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:25:07.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf75a00640 1 Processor -- start 2024-09-12T12:25:07.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf75a00640 1 -- start start 2024-09-12T12:25:07.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf75a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf700b02f0 0x7faf70073510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf75a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf7015e9a0 con 0x7faf7006c320 2024-09-12T12:25:07.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf75a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf70073b70 con 0x7faf7015e5c0 2024-09-12T12:25:07.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf75a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faf70073e50 con 0x7faf700b02f0 2024-09-12T12:25:07.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf6f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faf700b02f0 0x7faf70073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf6e000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faf7006c320 0x7faf70072e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55236/0 (socket says 172.21.15.144:55236) 2024-09-12T12:25:07.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf6e000640 1 -- 172.21.15.144:0/1419788852 learned_addr learned my addr 172.21.15.144:0/1419788852 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:07.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf6f400640 1 -- 172.21.15.144:0/1419788852 >> v1:172.21.15.165:6789/0 conn(0x7faf7015e5c0 legacy=0x7faf7006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf6f400640 1 -- 172.21.15.144:0/1419788852 >> v1:172.21.15.144:6789/0 conn(0x7faf7006c320 legacy=0x7faf70072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.907+0000 7faf6f400640 1 -- 172.21.15.144:0/1419788852 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf70074130 con 0x7faf700b02f0 2024-09-12T12:25:07.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf6f400640 1 --2- 172.21.15.144:0/1419788852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 0x7faf70073510 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7faf68009d90 tx=0x7faf6801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3525e24abfc0847f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:07.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf6d600640 1 -- 172.21.15.144:0/1419788852 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf680b2070 con 0x7faf700b02f0 2024-09-12T12:25:07.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf6d600640 1 -- 172.21.15.144:0/1419788852 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf680a5990 con 0x7faf700b02f0 2024-09-12T12:25:07.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf6d600640 1 -- 172.21.15.144:0/1419788852 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf680a5d60 con 0x7faf700b02f0 2024-09-12T12:25:07.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf75a00640 1 -- 172.21.15.144:0/1419788852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 msgr2=0x7faf70073510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf75a00640 1 --2- 172.21.15.144:0/1419788852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 0x7faf70073510 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7faf68009d90 tx=0x7faf6801c8b0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf75a00640 1 -- 172.21.15.144:0/1419788852 shutdown_connections 2024-09-12T12:25:07.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf75a00640 1 --2- 172.21.15.144:0/1419788852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 0x7faf70073510 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf75a00640 1 -- 172.21.15.144:0/1419788852 >> 172.21.15.144:0/1419788852 conn(0x7faf700b3380 msgr2=0x7faf700b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:07.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf75a00640 1 -- 172.21.15.144:0/1419788852 shutdown_connections 2024-09-12T12:25:07.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.911+0000 7faf75a00640 1 -- 172.21.15.144:0/1419788852 wait complete. 2024-09-12T12:25:07.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 Processor -- start 2024-09-12T12:25:07.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 -- start start 2024-09-12T12:25:07.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf7006c320 0x7faf7014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 0x7faf7014aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf7015e5c0 0x7faf7006e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faf7016bd30 con 0x7faf700b02f0 2024-09-12T12:25:07.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faf7016bbb0 con 0x7faf7006c320 2024-09-12T12:25:07.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf7016beb0 con 0x7faf7015e5c0 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 0x7faf7014aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 0x7faf7014aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59438/0 (socket says 172.21.15.144:59438) 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6e000640 1 -- 172.21.15.144:0/1415759791 learned_addr learned my addr 172.21.15.144:0/1415759791 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6ea00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf7006c320 0x7faf7014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6f400640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf7015e5c0 0x7faf7006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6e000640 1 -- 172.21.15.144:0/1415759791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf7015e5c0 msgr2=0x7faf7006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6e000640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf7015e5c0 0x7faf7006e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6e000640 1 -- 172.21.15.144:0/1415759791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf7006c320 msgr2=0x7faf7014e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6e000640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf7006c320 0x7faf7014e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6e000640 1 -- 172.21.15.144:0/1415759791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7014ede0 con 0x7faf700b02f0 2024-09-12T12:25:07.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf6e000640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 0x7faf7014aa40 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c400 tx=0x7faf5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:07.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf66a00640 1 -- 172.21.15.144:0/1415759791 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c017070 con 0x7faf700b02f0 2024-09-12T12:25:07.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf66a00640 1 -- 172.21.15.144:0/1415759791 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5c005cf0 con 0x7faf700b02f0 2024-09-12T12:25:07.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf66a00640 1 -- 172.21.15.144:0/1415759791 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0072d0 con 0x7faf700b02f0 2024-09-12T12:25:07.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf70151140 con 0x7faf700b02f0 2024-09-12T12:25:07.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.915+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf70151700 con 0x7faf700b02f0 2024-09-12T12:25:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.919+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf70151940 con 0x7faf700b02f0 2024-09-12T12:25:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.919+0000 7faf66a00640 1 -- 172.21.15.144:0/1415759791 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf5c01a070 con 0x7faf700b02f0 2024-09-12T12:25:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.919+0000 7faf66a00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf500678c0 0x7faf50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.919+0000 7faf66a00640 1 -- 172.21.15.144:0/1415759791 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 6101+0+0 (secure 0 0 0) 0x7faf5c085150 con 0x7faf700b02f0 2024-09-12T12:25:07.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.919+0000 7faf6ea00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf500678c0 0x7faf50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:07.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.919+0000 7faf6ea00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf500678c0 0x7faf50069d80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faf7006ed40 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:07.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:07.923+0000 7faf66a00640 1 -- 172.21.15.144:0/1415759791 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf5c055410 con 0x7faf700b02f0 2024-09-12T12:25:08.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.079+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf7015ddf0 con 0x7faf700b02f0 2024-09-12T12:25:08.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf66a00640 1 -- 172.21.15.144:0/1415759791 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+17049 (secure 0 0 0) 0x7faf5c059710 con 0x7faf700b02f0 2024-09-12T12:25:08.084 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:08.084 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":188,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:25:07.088960+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:04.807402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-12T12:25:06.093988+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:08.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf500678c0 msgr2=0x7faf50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf500678c0 0x7faf50069d80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faf7006ed40 tx=0x7faf60009040 comp rx=0 tx=0).stop 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 msgr2=0x7faf7014aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 0x7faf7014aa40 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c400 tx=0x7faf5c00c8c0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 shutdown_connections 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7faf500678c0 0x7faf50069d80 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf7015e5c0 0x7faf7006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf700b02f0 0x7faf7014aa40 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 --2- 172.21.15.144:0/1415759791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf7006c320 0x7faf7014e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 >> 172.21.15.144:0/1415759791 conn(0x7faf700b3380 msgr2=0x7faf7015ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 shutdown_connections 2024-09-12T12:25:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.083+0000 7faf75a00640 1 -- 172.21.15.144:0/1415759791 wait complete. 2024-09-12T12:25:08.104 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:25:08.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdf200640 1 Processor -- start 2024-09-12T12:25:08.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdf200640 1 -- start start 2024-09-12T12:25:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdf200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdfd815e4a0 0x7fdfd8161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 0x7fdfd80737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdf200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfd8162720 con 0x7fdfd80b67c0 2024-09-12T12:25:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdf200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdfd8073310 con 0x7fdfd815e4a0 2024-09-12T12:25:08.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd8162a00 con 0x7fdfd80d2e10 2024-09-12T12:25:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 0x7fdfd80737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdde00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdfd815e4a0 0x7fdfd8161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfde800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdfd80b67c0 0x7fdfd80b6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55248/0 (socket says 172.21.15.144:55248) 2024-09-12T12:25:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfde800640 1 -- 172.21.15.144:0/3293632442 learned_addr learned my addr 172.21.15.144:0/3293632442 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdde00640 1 -- 172.21.15.144:0/3293632442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 msgr2=0x7fdfd80737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdde00640 1 --2- 172.21.15.144:0/3293632442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 0x7fdfd80737a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdde00640 1 -- 172.21.15.144:0/3293632442 >> v1:172.21.15.144:6789/0 conn(0x7fdfd80b67c0 legacy=0x7fdfd80b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.243+0000 7fdfdde00640 1 -- 172.21.15.144:0/3293632442 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd8162ce0 con 0x7fdfd815e4a0 2024-09-12T12:25:08.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdde00640 1 --2- 172.21.15.144:0/3293632442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfd815e4a0 0x7fdfd8161e90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0097c0 tx=0x7fdfcc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba02e3a5bf568bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:08.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdca00640 1 -- 172.21.15.144:0/3293632442 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0b1070 con 0x7fdfd815e4a0 2024-09-12T12:25:08.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdca00640 1 -- 172.21.15.144:0/3293632442 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfcc0ac410 con 0x7fdfd815e4a0 2024-09-12T12:25:08.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdca00640 1 -- 172.21.15.144:0/3293632442 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0ac7e0 con 0x7fdfd815e4a0 2024-09-12T12:25:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdf200640 1 -- 172.21.15.144:0/3293632442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfd815e4a0 msgr2=0x7fdfd8161e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdf200640 1 --2- 172.21.15.144:0/3293632442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfd815e4a0 0x7fdfd8161e90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0097c0 tx=0x7fdfcc01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdf200640 1 -- 172.21.15.144:0/3293632442 shutdown_connections 2024-09-12T12:25:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdf200640 1 --2- 172.21.15.144:0/3293632442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 0x7fdfd80737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdf200640 1 --2- 172.21.15.144:0/3293632442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfd815e4a0 0x7fdfd8161e90 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdf200640 1 -- 172.21.15.144:0/3293632442 >> 172.21.15.144:0/3293632442 conn(0x7fdfd80d2280 msgr2=0x7fdfd80d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:08.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdf200640 1 -- 172.21.15.144:0/3293632442 shutdown_connections 2024-09-12T12:25:08.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.247+0000 7fdfdf200640 1 -- 172.21.15.144:0/3293632442 wait complete. 2024-09-12T12:25:08.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 Processor -- start 2024-09-12T12:25:08.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 -- start start 2024-09-12T12:25:08.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfd80b67c0 0x7fdfd81fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 0x7fdfd8160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd815e4a0 0x7fdfd81433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd806d6b0 con 0x7fdfd815e4a0 2024-09-12T12:25:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdfd806d530 con 0x7fdfd80b67c0 2024-09-12T12:25:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdfd816b000 con 0x7fdfd80d2e10 2024-09-12T12:25:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfde800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd815e4a0 0x7fdfd81433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfde800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd815e4a0 0x7fdfd81433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59450/0 (socket says 172.21.15.144:59450) 2024-09-12T12:25:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfde800640 1 -- 172.21.15.144:0/236013182 learned_addr learned my addr 172.21.15.144:0/236013182 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:08.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdd400640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 0x7fdfd8160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdde00640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfd80b67c0 0x7fdfd81fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfde800640 1 -- 172.21.15.144:0/236013182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 msgr2=0x7fdfd8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfde800640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 0x7fdfd8160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfde800640 1 -- 172.21.15.144:0/236013182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfd80b67c0 msgr2=0x7fdfd81fa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfde800640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfd80b67c0 0x7fdfd81fa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfde800640 1 -- 172.21.15.144:0/236013182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfd81fad80 con 0x7fdfd815e4a0 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfde800640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd815e4a0 0x7fdfd81433d0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400cab0 tx=0x7fdfd400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfd2000640 1 -- 172.21.15.144:0/236013182 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4017070 con 0x7fdfd815e4a0 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfd2000640 1 -- 172.21.15.144:0/236013182 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd400ac30 con 0x7fdfd815e4a0 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfd2000640 1 -- 172.21.15.144:0/236013182 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4012400 con 0x7fdfd815e4a0 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfd81fb060 con 0x7fdfd815e4a0 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfd8146630 con 0x7fdfd815e4a0 2024-09-12T12:25:08.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.251+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd8073780 con 0x7fdfd815e4a0 2024-09-12T12:25:08.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.255+0000 7fdfd2000640 1 -- 172.21.15.144:0/236013182 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdfd401a070 con 0x7fdfd815e4a0 2024-09-12T12:25:08.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.255+0000 7fdfd2000640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdfbc0678c0 0x7fdfbc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.255+0000 7fdfd2000640 1 -- 172.21.15.144:0/236013182 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 6101+0+0 (secure 0 0 0) 0x7fdfd4085a60 con 0x7fdfd815e4a0 2024-09-12T12:25:08.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.255+0000 7fdfdde00640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdfbc0678c0 0x7fdfbc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.255+0000 7fdfdde00640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdfbc0678c0 0x7fdfbc069d80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0ae000 tx=0x7fdfcc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:08.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.259+0000 7fdfd2000640 1 -- 172.21.15.144:0/236013182 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdfd4055db0 con 0x7fdfd815e4a0 2024-09-12T12:25:08.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.415+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfd815bfe0 con 0x7fdfd815e4a0 2024-09-12T12:25:08.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfd2000640 1 -- 172.21.15.144:0/236013182 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+17049 (secure 0 0 0) 0x7fdfd405a0b0 con 0x7fdfd815e4a0 2024-09-12T12:25:08.420 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:08.420 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":188,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:25:07.088960+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:04.807402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-12T12:25:06.093988+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:08.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdfbc0678c0 msgr2=0x7fdfbc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdfbc0678c0 0x7fdfbc069d80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0ae000 tx=0x7fdfcc008040 comp rx=0 tx=0).stop 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd815e4a0 msgr2=0x7fdfd81433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd815e4a0 0x7fdfd81433d0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400cab0 tx=0x7fdfd400cf70 comp rx=0 tx=0).stop 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 shutdown_connections 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdfbc0678c0 0x7fdfbc069d80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfd815e4a0 0x7fdfd81433d0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfd80d2e10 0x7fdfd8160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 --2- 172.21.15.144:0/236013182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfd80b67c0 0x7fdfd81fa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 >> 172.21.15.144:0/236013182 conn(0x7fdfd80d2280 msgr2=0x7fdfd80d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:08.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 shutdown_connections 2024-09-12T12:25:08.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.419+0000 7fdfdf200640 1 -- 172.21.15.144:0/236013182 wait complete. 2024-09-12T12:25:08.442 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:25:08.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.579+0000 7ff9ad000640 1 Processor -- start 2024-09-12T12:25:08.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.579+0000 7ff9ad000640 1 -- start start 2024-09-12T12:25:08.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9ad000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815af60 0x7ff9a80ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9ad000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff9a80cd9f0 0x7ff9a806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9ad000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff9a815b340 0x7ff9a806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9ad000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a80b32f0 con 0x7ff9a80cd9f0 2024-09-12T12:25:08.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9ad000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff9a80b4300 con 0x7ff9a815b340 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9ad000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a80b3540 con 0x7ff9a815af60 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff9a80cd9f0 0x7ff9a806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff9a80cd9f0 0x7ff9a806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59456/0 (socket says 172.21.15.144:59456) 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5400640 1 -- 172.21.15.144:0/2258496635 learned_addr learned my addr 172.21.15.144:0/2258496635 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5e00640 1 --2- 172.21.15.144:0/2258496635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815af60 0x7ff9a80ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a6800640 1 --2- 172.21.15.144:0/2258496635 >> v2:172.21.15.165:3300/0 conn(0x7ff9a815b340 0x7ff9a806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5400640 1 -- 172.21.15.144:0/2258496635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815af60 msgr2=0x7ff9a80ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5400640 1 --2- 172.21.15.144:0/2258496635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815af60 0x7ff9a80ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5400640 1 -- 172.21.15.144:0/2258496635 >> v2:172.21.15.165:3300/0 conn(0x7ff9a815b340 msgr2=0x7ff9a806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5400640 1 --2- 172.21.15.144:0/2258496635 >> v2:172.21.15.165:3300/0 conn(0x7ff9a815b340 0x7ff9a806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5400640 1 -- 172.21.15.144:0/2258496635 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a80b3820 con 0x7ff9a80cd9f0 2024-09-12T12:25:08.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.583+0000 7ff9a5400640 1 --2- 172.21.15.144:0/2258496635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a80cd9f0 0x7ff9a806bc10 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80cfa80 tx=0x7ff99401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a50d0cd56530c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:08.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9a4a00640 1 -- 172.21.15.144:0/2258496635 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9940b5070 con 0x7ff9a80cd9f0 2024-09-12T12:25:08.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9a4a00640 1 -- 172.21.15.144:0/2258496635 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9940a89d0 con 0x7ff9a80cd9f0 2024-09-12T12:25:08.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9a4a00640 1 -- 172.21.15.144:0/2258496635 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9940a8da0 con 0x7ff9a80cd9f0 2024-09-12T12:25:08.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 -- 172.21.15.144:0/2258496635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a80cd9f0 msgr2=0x7ff9a806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2258496635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a80cd9f0 0x7ff9a806bc10 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80cfa80 tx=0x7ff99401ed10 comp rx=0 tx=0).stop 2024-09-12T12:25:08.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 -- 172.21.15.144:0/2258496635 shutdown_connections 2024-09-12T12:25:08.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2258496635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a80cd9f0 0x7ff9a806bc10 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2258496635 >> v2:172.21.15.165:3300/0 conn(0x7ff9a815b340 0x7ff9a806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2258496635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815af60 0x7ff9a80ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 -- 172.21.15.144:0/2258496635 >> 172.21.15.144:0/2258496635 conn(0x7ff9a8068030 msgr2=0x7ff9a80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:08.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 -- 172.21.15.144:0/2258496635 shutdown_connections 2024-09-12T12:25:08.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 -- 172.21.15.144:0/2258496635 wait complete. 2024-09-12T12:25:08.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 Processor -- start 2024-09-12T12:25:08.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 -- start start 2024-09-12T12:25:08.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9a80cd9f0 0x7ff9a81475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a815af60 0x7ff9a814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815b340 0x7ff9a80710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a80cebc0 con 0x7ff9a815af60 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a80b3de0 con 0x7ff9a80cd9f0 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9ad000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff9a80ced40 con 0x7ff9a815b340 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9a5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a815af60 0x7ff9a814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9a5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a815af60 0x7ff9a814dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59470/0 (socket says 172.21.15.144:59470) 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9a5400640 1 -- 172.21.15.144:0/2216077335 learned_addr learned my addr 172.21.15.144:0/2216077335 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9a5e00640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9a80cd9f0 0x7ff9a81475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.587+0000 7ff9a6800640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815b340 0x7ff9a80710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff9a5400640 1 -- 172.21.15.144:0/2216077335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815b340 msgr2=0x7ff9a80710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff9a5400640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815b340 0x7ff9a80710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff9a5400640 1 -- 172.21.15.144:0/2216077335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9a80cd9f0 msgr2=0x7ff9a81475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff9a5400640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9a80cd9f0 0x7ff9a81475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:08.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff9a5400640 1 -- 172.21.15.144:0/2216077335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a814ef90 con 0x7ff9a815af60 2024-09-12T12:25:08.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff9a5400640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a815af60 0x7ff9a814dff0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff99401d3c0 tx=0x7ff99401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:08.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff99e000640 1 -- 172.21.15.144:0/2216077335 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9940b5070 con 0x7ff9a815af60 2024-09-12T12:25:08.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff99e000640 1 -- 172.21.15.144:0/2216077335 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9940b0a70 con 0x7ff9a815af60 2024-09-12T12:25:08.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff99e000640 1 -- 172.21.15.144:0/2216077335 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9940b0e60 con 0x7ff9a815af60 2024-09-12T12:25:08.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a814e9d0 con 0x7ff9a815af60 2024-09-12T12:25:08.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a81e4c70 con 0x7ff9a815af60 2024-09-12T12:25:08.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9a80ce680 con 0x7ff9a815af60 2024-09-12T12:25:08.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff99e000640 1 -- 172.21.15.144:0/2216077335 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9940c2060 con 0x7ff9a815af60 2024-09-12T12:25:08.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff99e000640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9880678c0 0x7ff988069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:08.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.591+0000 7ff99e000640 1 -- 172.21.15.144:0/2216077335 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 6101+0+0 (secure 0 0 0) 0x7ff994122f20 con 0x7ff9a815af60 2024-09-12T12:25:08.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.595+0000 7ff9a5e00640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9880678c0 0x7ff988069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:08.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.595+0000 7ff9a5e00640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9880678c0 0x7ff988069d80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff998007a60 tx=0x7ff998008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:08.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.595+0000 7ff99e000640 1 -- 172.21.15.144:0/2216077335 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff994018870 con 0x7ff9a815af60 2024-09-12T12:25:08.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:08.795+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff9a814fc60 con 0x7ff9a815af60 2024-09-12T12:25:09.688 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-12T12:25:09.687+0000 7faa98800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:25:09.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.731+0000 7ff99e000640 1 -- 172.21.15.144:0/2216077335 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v147) ==== 118+0+0 (secure 0 0 0) 0x7ff9940f31e0 con 0x7ff9a815af60 2024-09-12T12:25:09.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9880678c0 msgr2=0x7ff988069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9880678c0 0x7ff988069d80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff998007a60 tx=0x7ff998008040 comp rx=0 tx=0).stop 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a815af60 msgr2=0x7ff9a814dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a815af60 0x7ff9a814dff0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff99401d3c0 tx=0x7ff99401bab0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 shutdown_connections 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff9880678c0 0x7ff988069d80 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9a815b340 0x7ff9a80710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9a815af60 0x7ff9a814dff0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 --2- 172.21.15.144:0/2216077335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9a80cd9f0 0x7ff9a81475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 >> 172.21.15.144:0/2216077335 conn(0x7ff9a8068030 msgr2=0x7ff9a80b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 shutdown_connections 2024-09-12T12:25:09.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.735+0000 7ff9ad000640 1 -- 172.21.15.144:0/2216077335 wait complete. 2024-09-12T12:25:09.761 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:25:09.761 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:25:09.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0ee1600640 1 Processor -- start 2024-09-12T12:25:09.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0ee1600640 1 -- start start 2024-09-12T12:25:09.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0ee1600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0edc0af5f0 0x7f0edc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0ee1600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc06c150 0x7f0edc0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0ee1600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0edc0733e0 con 0x7f0edc15c2e0 2024-09-12T12:25:09.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0ee1600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0edc06c5c0 con 0x7f0edc0af5f0 2024-09-12T12:25:09.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0ee1600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0edc0cd290 con 0x7f0edc06c150 2024-09-12T12:25:09.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0edb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc06c150 0x7f0edc0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0edb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc06c150 0x7f0edc0cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:42108/0 (socket says 172.21.15.144:42108) 2024-09-12T12:25:09.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0eda000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0edc0af5f0 0x7f0edc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.903+0000 7f0edb400640 1 -- 172.21.15.144:0/477589159 learned_addr learned my addr 172.21.15.144:0/477589159 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:09.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0edb400640 1 -- 172.21.15.144:0/477589159 >> v2:172.21.15.165:3300/0 conn(0x7f0edc0af5f0 msgr2=0x7f0edc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:09.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0edb400640 1 --2- 172.21.15.144:0/477589159 >> v2:172.21.15.165:3300/0 conn(0x7f0edc0af5f0 0x7f0edc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0edb400640 1 -- 172.21.15.144:0/477589159 >> v1:172.21.15.165:6789/0 conn(0x7f0edc15c2e0 legacy=0x7f0edc072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0edb400640 1 -- 172.21.15.144:0/477589159 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc0cd570 con 0x7f0edc06c150 2024-09-12T12:25:09.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0eda000640 1 --2- 172.21.15.144:0/477589159 >> v2:172.21.15.165:3300/0 conn(0x7f0edc0af5f0 0x7f0edc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:09.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0edb400640 1 --2- 172.21.15.144:0/477589159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc06c150 0x7f0edc0cdd70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009870 tx=0x7f0ed401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f926c9aede7076e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0ed9600640 1 -- 172.21.15.144:0/477589159 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40b0070 con 0x7f0edc06c150 2024-09-12T12:25:09.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0ed9600640 1 -- 172.21.15.144:0/477589159 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40ab600 con 0x7f0edc06c150 2024-09-12T12:25:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0ed9600640 1 -- 172.21.15.144:0/477589159 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40ab9d0 con 0x7f0edc06c150 2024-09-12T12:25:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0ee1600640 1 -- 172.21.15.144:0/477589159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc06c150 msgr2=0x7f0edc0cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0ee1600640 1 --2- 172.21.15.144:0/477589159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc06c150 0x7f0edc0cdd70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009870 tx=0x7f0ed401c440 comp rx=0 tx=0).stop 2024-09-12T12:25:09.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0ee1600640 1 -- 172.21.15.144:0/477589159 shutdown_connections 2024-09-12T12:25:09.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0ee1600640 1 --2- 172.21.15.144:0/477589159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc06c150 0x7f0edc0cdd70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0ee1600640 1 --2- 172.21.15.144:0/477589159 >> v2:172.21.15.165:3300/0 conn(0x7f0edc0af5f0 0x7f0edc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.907+0000 7f0ee1600640 1 -- 172.21.15.144:0/477589159 >> 172.21.15.144:0/477589159 conn(0x7f0edc068030 msgr2=0x7f0edc0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:09.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 -- 172.21.15.144:0/477589159 shutdown_connections 2024-09-12T12:25:09.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 -- 172.21.15.144:0/477589159 wait complete. 2024-09-12T12:25:09.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 Processor -- start 2024-09-12T12:25:09.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 -- start start 2024-09-12T12:25:09.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0edc06c150 0x7f0edc0aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc0af5f0 0x7f0edc155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0edc15c2e0 0x7f0edc15e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc0cee90 con 0x7f0edc06c150 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc0ced10 con 0x7f0edc15c2e0 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0edc0cf010 con 0x7f0edc0af5f0 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0edc06c150 0x7f0edc0aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0edc06c150 0x7f0edc0aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59478/0 (socket says 172.21.15.144:59478) 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edaa00640 1 -- 172.21.15.144:0/1684862943 learned_addr learned my addr 172.21.15.144:0/1684862943 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edb400640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0edc15c2e0 0x7f0edc15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0eda000640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc0af5f0 0x7f0edc155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edb400640 1 -- 172.21.15.144:0/1684862943 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc0af5f0 msgr2=0x7f0edc155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edb400640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc0af5f0 0x7f0edc155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edb400640 1 -- 172.21.15.144:0/1684862943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0edc06c150 msgr2=0x7f0edc0aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:09.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edb400640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0edc06c150 0x7f0edc0aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:09.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edb400640 1 -- 172.21.15.144:0/1684862943 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc0aa9c0 con 0x7f0edc15c2e0 2024-09-12T12:25:09.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0edb400640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0edc15c2e0 0x7f0edc15e860 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40ab000 tx=0x7f0ed40191e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ed2a00640 1 -- 172.21.15.144:0/1684862943 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40b0040 con 0x7f0edc15c2e0 2024-09-12T12:25:09.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ed2a00640 1 -- 172.21.15.144:0/1684862943 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40b4420 con 0x7f0edc15c2e0 2024-09-12T12:25:09.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ed2a00640 1 -- 172.21.15.144:0/1684862943 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40b4810 con 0x7f0edc15c2e0 2024-09-12T12:25:09.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.911+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0edc0aac40 con 0x7f0edc15c2e0 2024-09-12T12:25:09.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.915+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0edc0ad040 con 0x7f0edc15c2e0 2024-09-12T12:25:09.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.915+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0edc0cdd70 con 0x7f0edc15c2e0 2024-09-12T12:25:09.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.915+0000 7f0ed2a00640 1 -- 172.21.15.144:0/1684862943 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ed40b49b0 con 0x7f0edc15c2e0 2024-09-12T12:25:09.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.915+0000 7f0ed2a00640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0ebc0678c0 0x7f0ebc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:09.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.915+0000 7f0ed2a00640 1 -- 172.21.15.144:0/1684862943 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f0ed4120120 con 0x7f0edc15c2e0 2024-09-12T12:25:09.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.915+0000 7f0edaa00640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0ebc0678c0 0x7f0ebc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:09.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.915+0000 7f0edaa00640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0ebc0678c0 0x7f0ebc069d80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc001f60 tx=0x7f0ecc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:09.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:09.919+0000 7f0ed2a00640 1 -- 172.21.15.144:0/1684862943 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0edc0aa9c0 con 0x7f0edc15c2e0 2024-09-12T12:25:10.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.111+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0edc0685e0 con 0x7f0edc15c2e0 2024-09-12T12:25:10.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.735+0000 7f0ed2a00640 1 -- 172.21.15.144:0/1684862943 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v148) ==== 122+0+0 (secure 0 0 0) 0x7f0ed4016150 con 0x7f0edc15c2e0 2024-09-12T12:25:10.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0ebc0678c0 msgr2=0x7f0ebc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0ebc0678c0 0x7f0ebc069d80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc001f60 tx=0x7f0ecc009040 comp rx=0 tx=0).stop 2024-09-12T12:25:10.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0edc15c2e0 msgr2=0x7f0edc15e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0edc15c2e0 0x7f0edc15e860 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40ab000 tx=0x7f0ed40191e0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 shutdown_connections 2024-09-12T12:25:10.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0ebc0678c0 0x7f0ebc069d80 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0edc15c2e0 0x7f0edc15e860 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0edc0af5f0 0x7f0edc155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 --2- 172.21.15.144:0/1684862943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0edc06c150 0x7f0edc0aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 >> 172.21.15.144:0/1684862943 conn(0x7f0edc068030 msgr2=0x7f0edc072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:10.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 shutdown_connections 2024-09-12T12:25:10.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.739+0000 7f0ee1600640 1 -- 172.21.15.144:0/1684862943 wait complete. 2024-09-12T12:25:10.765 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:25:10.765 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:25:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.903+0000 7fa3c5c00640 1 Processor -- start 2024-09-12T12:25:10.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.903+0000 7fa3c5c00640 1 -- start start 2024-09-12T12:25:10.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3c5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3c0071420 0x7fa3c0071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3c5c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c00b45a0 con 0x7fa3c015b4e0 2024-09-12T12:25:10.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3c5c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c00b3fe0 con 0x7fa3c00ccf30 2024-09-12T12:25:10.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3c5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c00b42c0 con 0x7fa3c0071420 2024-09-12T12:25:10.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa3c015b4e0 0x7fa3c00b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55252/0 (socket says 172.21.15.144:55252) 2024-09-12T12:25:10.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bea00640 1 -- 172.21.15.144:0/3934373689 learned_addr learned my addr 172.21.15.144:0/3934373689 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:10.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3be000640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3c0071420 0x7fa3c0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387296315 0 0) 0x7fa3c00b45a0 con 0x7fa3c015b4e0 2024-09-12T12:25:10.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3a4003530 con 0x7fa3c015b4e0 2024-09-12T12:25:10.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1112670245 0 0) 0x7fa3a4003530 con 0x7fa3c015b4e0 2024-09-12T12:25:10.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3c0071420 msgr2=0x7fa3c0071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:10.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3c0071420 0x7fa3c0071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 >> v1:172.21.15.165:6789/0 conn(0x7fa3c00ccf30 legacy=0x7fa3c00b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c00b1490 con 0x7fa3c015b4e0 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fa3b0001a00 con 0x7fa3c015b4e0 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 >> v1:172.21.15.144:6789/0 conn(0x7fa3c015b4e0 legacy=0x7fa3c00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3a40039f0 0x7fa3a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3a40043a0 0x7fa3a4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3c0071420 0x7fa3a40050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c00b42c0 con 0x7fa3a40039f0 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a400b9d0 con 0x7fa3a40043a0 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a400bbd0 con 0x7fa3c0071420 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bea00640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3a40039f0 0x7fa3a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3be000640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3a40043a0 0x7fa3a4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bf400640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3c0071420 0x7fa3a40050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bea00640 1 -- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3c0071420 msgr2=0x7fa3a40050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:10.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bea00640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3c0071420 0x7fa3a40050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bea00640 1 -- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3a40043a0 msgr2=0x7fa3a4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:10.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bea00640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3a40043a0 0x7fa3a4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.907+0000 7fa3bea00640 1 -- 172.21.15.144:0/3934373689 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a4003530 con 0x7fa3a40039f0 2024-09-12T12:25:10.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3bea00640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3a40039f0 0x7fa3a4003dd0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000a860 tx=0x7fa3b001d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a82b4dbcc56a181 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:10.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b000a480 con 0x7fa3a40039f0 2024-09-12T12:25:10.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b00ad630 con 0x7fa3a40039f0 2024-09-12T12:25:10.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3bd600640 1 -- 172.21.15.144:0/3934373689 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00ada60 con 0x7fa3a40039f0 2024-09-12T12:25:10.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3c5c00640 1 -- 172.21.15.144:0/3934373689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3a40039f0 msgr2=0x7fa3a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3c5c00640 1 --2- 172.21.15.144:0/3934373689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3a40039f0 0x7fa3a4003dd0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000a860 tx=0x7fa3b001d350 comp rx=0 tx=0).stop 2024-09-12T12:25:10.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3bf400640 1 -- 172.21.15.144:0/3934373689 reap_dead start 2024-09-12T12:25:10.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3c5c00640 1 -- 172.21.15.144:0/3934373689 shutdown_connections 2024-09-12T12:25:10.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3c5c00640 1 -- 172.21.15.144:0/3934373689 >> 172.21.15.144:0/3934373689 conn(0x7fa3c006d0d0 msgr2=0x7fa3c006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:10.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3c5c00640 1 -- 172.21.15.144:0/3934373689 shutdown_connections 2024-09-12T12:25:10.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3c5c00640 1 -- 172.21.15.144:0/3934373689 wait complete. 2024-09-12T12:25:10.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3c5c00640 1 Processor -- start 2024-09-12T12:25:10.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.911+0000 7fa3c5c00640 1 -- start start 2024-09-12T12:25:10.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3c5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3a40039f0 0x7fa3c0164b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3c5c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3c0165a90 0x7fa3c015e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3c5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3c015e770 0x7fa3c00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3c5c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c015b8c0 con 0x7fa3c015e770 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3c5c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c00cd380 con 0x7fa3c0165a90 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3c5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c015bdb0 con 0x7fa3a40039f0 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3c015e770 0x7fa3c00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3c015e770 0x7fa3c00ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59498/0 (socket says 172.21.15.144:59498) 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bf400640 1 -- 172.21.15.144:0/2961110502 learned_addr learned my addr 172.21.15.144:0/2961110502 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bea00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3a40039f0 0x7fa3c0164b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3be000640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3c0165a90 0x7fa3c015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bf400640 1 -- 172.21.15.144:0/2961110502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3a40039f0 msgr2=0x7fa3c0164b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bf400640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3a40039f0 0x7fa3c0164b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bf400640 1 -- 172.21.15.144:0/2961110502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3c0165a90 msgr2=0x7fa3c015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:10.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bf400640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3c0165a90 0x7fa3c015e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:10.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bf400640 1 -- 172.21.15.144:0/2961110502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c015c090 con 0x7fa3c015e770 2024-09-12T12:25:10.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3bf400640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3c015e770 0x7fa3c00ae890 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00d0480 tx=0x7fa3b800e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:10.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3b6a00640 1 -- 172.21.15.144:0/2961110502 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8019070 con 0x7fa3c015e770 2024-09-12T12:25:10.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3b6a00640 1 -- 172.21.15.144:0/2961110502 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b80052e0 con 0x7fa3c015e770 2024-09-12T12:25:10.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3b6a00640 1 -- 172.21.15.144:0/2961110502 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8003840 con 0x7fa3c015e770 2024-09-12T12:25:10.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c015da30 con 0x7fa3c015e770 2024-09-12T12:25:10.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c015c370 con 0x7fa3c015e770 2024-09-12T12:25:10.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c00cd790 con 0x7fa3c015e770 2024-09-12T12:25:10.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.915+0000 7fa3b6a00640 1 -- 172.21.15.144:0/2961110502 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3b801c070 con 0x7fa3c015e770 2024-09-12T12:25:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.919+0000 7fa3b6a00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3a00678f0 0x7fa3a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.919+0000 7fa3b6a00640 1 -- 172.21.15.144:0/2961110502 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fa3b80851d0 con 0x7fa3c015e770 2024-09-12T12:25:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.919+0000 7fa3bea00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3a00678f0 0x7fa3a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:10.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.919+0000 7fa3bea00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3a00678f0 0x7fa3a0069db0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000a860 tx=0x7fa3c00b41b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:10.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:10.923+0000 7fa3b6a00640 1 -- 172.21.15.144:0/2961110502 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa3b8055530 con 0x7fa3c015e770 2024-09-12T12:25:11.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3c015dee0 con 0x7fa3c015e770 2024-09-12T12:25:11.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3b6a00640 1 -- 172.21.15.144:0/2961110502 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 148 v148) ==== 95+0+5242 (secure 0 0 0) 0x7fa3b8059830 con 0x7fa3c015e770 2024-09-12T12:25:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:11.116 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":148,"btime":"2024-09-12T12:25:10:737551+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/890330369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":890330369},{"type":"v1","addr":"172.21.15.165:6833","nonce":890330369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":9646,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3806475980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3806475980},{"type":"v1","addr":"172.21.15.165:6835","nonce":3806475980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":10215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/4172702060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4172702060},{"type":"v1","addr":"172.21.15.144:6835","nonce":4172702060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":148,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:25:07.089397+0000","modified":"2024-09-12T12:25:10.115263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10218":{"gid":10218,"name":"c","rank":0,"incarnation":144,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/54351638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":54351638},{"type":"v1","addr":"172.21.15.144:6837","nonce":54351638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10218,"qdb_cluster":[10218]},"id":13}]} 2024-09-12T12:25:11.116 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 148 2024-09-12T12:25:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3a00678f0 msgr2=0x7fa3a0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3a00678f0 0x7fa3a0069db0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000a860 tx=0x7fa3c00b41b0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3c015e770 msgr2=0x7fa3c00ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3c015e770 0x7fa3c00ae890 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fa3c00d0480 tx=0x7fa3b800e760 comp rx=0 tx=0).stop 2024-09-12T12:25:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 shutdown_connections 2024-09-12T12:25:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3a00678f0 0x7fa3a0069db0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3c015e770 0x7fa3c00ae890 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3c0165a90 0x7fa3c015e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 --2- 172.21.15.144:0/2961110502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3a40039f0 0x7fa3c0164b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 >> 172.21.15.144:0/2961110502 conn(0x7fa3c006d0d0 msgr2=0x7fa3c00b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 shutdown_connections 2024-09-12T12:25:11.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.115+0000 7fa3c5c00640 1 -- 172.21.15.144:0/2961110502 wait complete. 2024-09-12T12:25:11.137 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:25:11.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.271+0000 7f74a2000640 1 Processor -- start 2024-09-12T12:25:11.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.271+0000 7f74a2000640 1 -- start start 2024-09-12T12:25:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.271+0000 7f74a2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f749c0cd640 0x7f749c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.271+0000 7f74a2000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f749c0b45a0 con 0x7f749c071420 2024-09-12T12:25:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.271+0000 7f74a2000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f749c0b3fe0 con 0x7f749c15b4e0 2024-09-12T12:25:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.271+0000 7f74a2000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f749c0b42c0 con 0x7f749c0cd640 2024-09-12T12:25:11.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f749c0cd640 0x7f749c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f749c071420 0x7f749c0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55256/0 (socket says 172.21.15.144:55256) 2024-09-12T12:25:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749aa00640 1 -- 172.21.15.144:0/2815088329 learned_addr learned my addr 172.21.15.144:0/2815088329 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749be00640 1 --2- 172.21.15.144:0/2815088329 >> v2:172.21.15.144:3300/0 conn(0x7f749c0cd640 0x7f749c071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59508/0 (socket says 172.21.15.144:59508) 2024-09-12T12:25:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749be00640 1 -- 172.21.15.144:0/2815088329 >> v1:172.21.15.165:6789/0 conn(0x7f749c15b4e0 legacy=0x7f749c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749be00640 1 -- 172.21.15.144:0/2815088329 >> v1:172.21.15.144:6789/0 conn(0x7f749c071420 legacy=0x7f749c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749be00640 1 -- 172.21.15.144:0/2815088329 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749c0b1490 con 0x7f749c0cd640 2024-09-12T12:25:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749be00640 1 --2- 172.21.15.144:0/2815088329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 0x7f749c071840 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f7494009d90 tx=0x7f749401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48991fa7d7772dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749a000640 1 -- 172.21.15.144:0/2815088329 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74940b2070 con 0x7f749c0cd640 2024-09-12T12:25:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749a000640 1 -- 172.21.15.144:0/2815088329 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74940a5990 con 0x7f749c0cd640 2024-09-12T12:25:11.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.275+0000 7f749a000640 1 -- 172.21.15.144:0/2815088329 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74940a5d60 con 0x7f749c0cd640 2024-09-12T12:25:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 -- 172.21.15.144:0/2815088329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 msgr2=0x7f749c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 --2- 172.21.15.144:0/2815088329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 0x7f749c071840 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f7494009d90 tx=0x7f749401c940 comp rx=0 tx=0).stop 2024-09-12T12:25:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 -- 172.21.15.144:0/2815088329 shutdown_connections 2024-09-12T12:25:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 --2- 172.21.15.144:0/2815088329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 0x7f749c071840 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 -- 172.21.15.144:0/2815088329 >> 172.21.15.144:0/2815088329 conn(0x7f749c06d0d0 msgr2=0x7f749c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 -- 172.21.15.144:0/2815088329 shutdown_connections 2024-09-12T12:25:11.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 -- 172.21.15.144:0/2815088329 wait complete. 2024-09-12T12:25:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 Processor -- start 2024-09-12T12:25:11.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 -- start start 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f749c071420 0x7f749c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 0x7f749c143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f749c15b4e0 0x7f749c14df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f749c15b8c0 con 0x7f749c0cd640 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f749c0b02e0 con 0x7f749c071420 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f74a2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f749c14a750 con 0x7f749c15b4e0 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 0x7f749c143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 0x7f749c143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59520/0 (socket says 172.21.15.144:59520) 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749aa00640 1 -- 172.21.15.144:0/564891691 learned_addr learned my addr 172.21.15.144:0/564891691 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749b400640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f749c071420 0x7f749c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749be00640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f749c15b4e0 0x7f749c14df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749aa00640 1 -- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f749c15b4e0 msgr2=0x7f749c14df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749aa00640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f749c15b4e0 0x7f749c14df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749aa00640 1 -- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f749c071420 msgr2=0x7f749c15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749aa00640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f749c071420 0x7f749c15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749aa00640 1 -- 172.21.15.144:0/564891691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749c1437a0 con 0x7f749c0cd640 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749b400640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f749c071420 0x7f749c15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.279+0000 7f749be00640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f749c15b4e0 0x7f749c14df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f749aa00640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 0x7f749c143260 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f748800c500 tx=0x7f748800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f7493400640 1 -- 172.21.15.144:0/564891691 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488017070 con 0x7f749c0cd640 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f7493400640 1 -- 172.21.15.144:0/564891691 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7488005cf0 con 0x7f749c0cd640 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f7493400640 1 -- 172.21.15.144:0/564891691 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74880072f0 con 0x7f749c0cd640 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749c15df20 con 0x7f749c0cd640 2024-09-12T12:25:11.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f749c15e1d0 con 0x7f749c0cd640 2024-09-12T12:25:11.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f749c071840 con 0x7f749c0cd640 2024-09-12T12:25:11.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f7493400640 1 -- 172.21.15.144:0/564891691 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f748801a070 con 0x7f749c0cd640 2024-09-12T12:25:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f7493400640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f747c0678c0 0x7f747c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f7493400640 1 -- 172.21.15.144:0/564891691 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f7488085160 con 0x7f749c0cd640 2024-09-12T12:25:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.283+0000 7f749b400640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f747c0678c0 0x7f747c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.287+0000 7f749b400640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f747c0678c0 0x7f747c069d80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f748c001670 tx=0x7f748c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.287+0000 7f7493400640 1 -- 172.21.15.144:0/564891691 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f74880554b0 con 0x7f749c0cd640 2024-09-12T12:25:11.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.447+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f749c15e570 con 0x7f749c0cd640 2024-09-12T12:25:11.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f7493400640 1 -- 172.21.15.144:0/564891691 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) ==== 74+0+17036 (secure 0 0 0) 0x7f74880597b0 con 0x7f749c0cd640 2024-09-12T12:25:11.452 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:11.452 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":189,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:25:08.708743+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:04.807402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-12T12:25:06.093988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f747c0678c0 msgr2=0x7f747c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f747c0678c0 0x7f747c069d80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f748c001670 tx=0x7f748c009040 comp rx=0 tx=0).stop 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 msgr2=0x7f749c143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 0x7f749c143260 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f748800c500 tx=0x7f748800c9c0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 shutdown_connections 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f747c0678c0 0x7f747c069d80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f749c15b4e0 0x7f749c14df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f749c0cd640 0x7f749c143260 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 --2- 172.21.15.144:0/564891691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f749c071420 0x7f749c15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 >> 172.21.15.144:0/564891691 conn(0x7f749c06d0d0 msgr2=0x7f749c072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 shutdown_connections 2024-09-12T12:25:11.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.451+0000 7f74a2000640 1 -- 172.21.15.144:0/564891691 wait complete. 2024-09-12T12:25:11.475 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:25:11.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:25:11.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd9e00640 1 Processor -- start 2024-09-12T12:25:11.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd9e00640 1 -- start start 2024-09-12T12:25:11.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2cd4071420 0x7f2cd4071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd9e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd40b45a0 con 0x7f2cd415b4e0 2024-09-12T12:25:11.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd9e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd40b3fe0 con 0x7f2cd40ccf30 2024-09-12T12:25:11.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd9e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd40b42c0 con 0x7f2cd4071420 2024-09-12T12:25:11.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2cd4071420 0x7f2cd4071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2cd415b4e0 0x7f2cd40b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55264/0 (socket says 172.21.15.144:55264) 2024-09-12T12:25:11.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd2a00640 1 -- 172.21.15.144:0/2820717321 learned_addr learned my addr 172.21.15.144:0/2820717321 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:11.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2cd4071420 0x7f2cd4071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59528/0 (socket says 172.21.15.144:59528) 2024-09-12T12:25:11.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd2000640 1 -- 172.21.15.144:0/2820717321 >> v1:172.21.15.165:6789/0 conn(0x7f2cd40ccf30 legacy=0x7f2cd40cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd2000640 1 -- 172.21.15.144:0/2820717321 >> v1:172.21.15.144:6789/0 conn(0x7f2cd415b4e0 legacy=0x7f2cd40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd2000640 1 -- 172.21.15.144:0/2820717321 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd40b1490 con 0x7f2cd4071420 2024-09-12T12:25:11.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.611+0000 7f2cd1600640 1 -- 172.21.15.144:0/2820717321 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825868198 0 0) 0x7f2cd40b45a0 con 0x7f2cd415b4e0 2024-09-12T12:25:11.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd2000640 1 --2- 172.21.15.144:0/2820717321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd4071420 0x7f2cd4071840 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000ba60 tx=0x7f2cc001eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14191c44a8b98f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd1600640 1 -- 172.21.15.144:0/2820717321 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00b4070 con 0x7f2cd4071420 2024-09-12T12:25:11.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd1600640 1 -- 172.21.15.144:0/2820717321 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc00a7b60 con 0x7f2cd4071420 2024-09-12T12:25:11.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd1600640 1 -- 172.21.15.144:0/2820717321 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00af440 con 0x7f2cd4071420 2024-09-12T12:25:11.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd9e00640 1 -- 172.21.15.144:0/2820717321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd4071420 msgr2=0x7f2cd4071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd9e00640 1 --2- 172.21.15.144:0/2820717321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd4071420 0x7f2cd4071840 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000ba60 tx=0x7f2cc001eb00 comp rx=0 tx=0).stop 2024-09-12T12:25:11.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd9e00640 1 -- 172.21.15.144:0/2820717321 shutdown_connections 2024-09-12T12:25:11.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd9e00640 1 --2- 172.21.15.144:0/2820717321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd4071420 0x7f2cd4071840 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd9e00640 1 -- 172.21.15.144:0/2820717321 >> 172.21.15.144:0/2820717321 conn(0x7f2cd406d0d0 msgr2=0x7f2cd406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd9e00640 1 -- 172.21.15.144:0/2820717321 shutdown_connections 2024-09-12T12:25:11.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.615+0000 7f2cd9e00640 1 -- 172.21.15.144:0/2820717321 wait complete. 2024-09-12T12:25:11.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 Processor -- start 2024-09-12T12:25:11.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 -- start start 2024-09-12T12:25:11.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4071420 0x7f2cd41f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2cd40ccf30 0x7f2cd4157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd415b4e0 0x7f2cd40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd415b8c0 con 0x7f2cd415b4e0 2024-09-12T12:25:11.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd40b02e0 con 0x7f2cd4071420 2024-09-12T12:25:11.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd41f8720 con 0x7f2cd40ccf30 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd415b4e0 0x7f2cd40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd415b4e0 0x7f2cd40ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59534/0 (socket says 172.21.15.144:59534) 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd3400640 1 -- 172.21.15.144:0/3959224172 learned_addr learned my addr 172.21.15.144:0/3959224172 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd2a00640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4071420 0x7f2cd41f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd2000640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2cd40ccf30 0x7f2cd4157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd3400640 1 -- 172.21.15.144:0/3959224172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2cd40ccf30 msgr2=0x7f2cd4157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd3400640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2cd40ccf30 0x7f2cd4157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd3400640 1 -- 172.21.15.144:0/3959224172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4071420 msgr2=0x7f2cd41f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd3400640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4071420 0x7f2cd41f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd3400640 1 -- 172.21.15.144:0/3959224172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd41f7b10 con 0x7f2cd415b4e0 2024-09-12T12:25:11.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd3400640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd415b4e0 0x7f2cd40ae890 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00c7b0 tx=0x7f2ccc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2ccb400640 1 -- 172.21.15.144:0/3959224172 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc004b70 con 0x7f2cd415b4e0 2024-09-12T12:25:11.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2ccb400640 1 -- 172.21.15.144:0/3959224172 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ccc004d10 con 0x7f2cd415b4e0 2024-09-12T12:25:11.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2ccb400640 1 -- 172.21.15.144:0/3959224172 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00aa90 con 0x7f2cd415b4e0 2024-09-12T12:25:11.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd41f7df0 con 0x7f2cd415b4e0 2024-09-12T12:25:11.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.619+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd41f83b0 con 0x7f2cd415b4e0 2024-09-12T12:25:11.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.623+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd4071840 con 0x7f2cd415b4e0 2024-09-12T12:25:11.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.623+0000 7f2ccb400640 1 -- 172.21.15.144:0/3959224172 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ccc00ac30 con 0x7f2cd415b4e0 2024-09-12T12:25:11.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.623+0000 7f2ccb400640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2cb40678c0 0x7f2cb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.623+0000 7f2ccb400640 1 -- 172.21.15.144:0/3959224172 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f2ccc085f80 con 0x7f2cd415b4e0 2024-09-12T12:25:11.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.623+0000 7f2cd2a00640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2cb40678c0 0x7f2cb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.623+0000 7f2cd2a00640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2cb40678c0 0x7f2cb4069d80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000f70 tx=0x7f2cc4007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.627+0000 7f2ccb400640 1 -- 172.21.15.144:0/3959224172 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2ccc020070 con 0x7f2cd415b4e0 2024-09-12T12:25:11.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.783+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2cd40b5930 con 0x7f2cb40678c0 2024-09-12T12:25:11.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.791+0000 7f2ccb400640 1 -- 172.21.15.144:0/3959224172 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252491 (secure 0 0 0) 0x7f2cd40b5930 con 0x7f2cb40678c0 2024-09-12T12:25:11.794 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:11.796 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:25:11.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2cb40678c0 msgr2=0x7f2cb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2cb40678c0 0x7f2cb4069d80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4000f70 tx=0x7f2cc4007df0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd415b4e0 msgr2=0x7f2cd40ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd415b4e0 0x7f2cd40ae890 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00c7b0 tx=0x7f2ccc00cc70 comp rx=0 tx=0).stop 2024-09-12T12:25:11.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 shutdown_connections 2024-09-12T12:25:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2cb40678c0 0x7f2cb4069d80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd415b4e0 0x7f2cd40ae890 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2cd40ccf30 0x7f2cd4157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 --2- 172.21.15.144:0/3959224172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd4071420 0x7f2cd41f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 >> 172.21.15.144:0/3959224172 conn(0x7f2cd406d0d0 msgr2=0x7f2cd40731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 shutdown_connections 2024-09-12T12:25:11.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.795+0000 7f2cd9e00640 1 -- 172.21.15.144:0/3959224172 wait complete. 2024-09-12T12:25:11.816 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":561,"stamp":"2024-09-12T12:25:11.535957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":459500,"kb_used_data":19812,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754515220,"statfs":{"total":773094113280,"available":772623585280,"internally_reserved":0,"allocated":20287488,"data_stored":10192144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.842779"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017378+0000","last_change":"2024-09-12T12:25:07.731469+0000","last_active":"2024-09-12T12:25:09.017378+0000","last_peered":"2024-09-12T12:25:09.017378+0000","last_clean":"2024-09-12T12:25:09.017378+0000","last_became_active":"2024-09-12T12:25:07.731175+0000","last_became_peered":"2024-09-12T12:25:07.731175+0000","last_unstale":"2024-09-12T12:25:09.017378+0000","last_undegraded":"2024-09-12T12:25:09.017378+0000","last_fullsized":"2024-09-12T12:25:09.017378+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:24.358166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.018006+0000","last_change":"2024-09-12T12:25:07.734870+0000","last_active":"2024-09-12T12:25:09.018006+0000","last_peered":"2024-09-12T12:25:09.018006+0000","last_clean":"2024-09-12T12:25:09.018006+0000","last_became_active":"2024-09-12T12:25:07.734584+0000","last_became_peered":"2024-09-12T12:25:07.734584+0000","last_unstale":"2024-09-12T12:25:09.018006+0000","last_undegraded":"2024-09-12T12:25:09.018006+0000","last_fullsized":"2024-09-12T12:25:09.018006+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:18.194215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715182+0000","last_change":"2024-09-12T12:25:07.725652+0000","last_active":"2024-09-12T12:25:08.715182+0000","last_peered":"2024-09-12T12:25:08.715182+0000","last_clean":"2024-09-12T12:25:08.715182+0000","last_became_active":"2024-09-12T12:25:07.725356+0000","last_became_peered":"2024-09-12T12:25:07.725356+0000","last_unstale":"2024-09-12T12:25:08.715182+0000","last_undegraded":"2024-09-12T12:25:08.715182+0000","last_fullsized":"2024-09-12T12:25:08.715182+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:51.157775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017120+0000","last_change":"2024-09-12T12:25:07.742087+0000","last_active":"2024-09-12T12:25:09.017120+0000","last_peered":"2024-09-12T12:25:09.017120+0000","last_clean":"2024-09-12T12:25:09.017120+0000","last_became_active":"2024-09-12T12:25:07.741757+0000","last_became_peered":"2024-09-12T12:25:07.741757+0000","last_unstale":"2024-09-12T12:25:09.017120+0000","last_undegraded":"2024-09-12T12:25:09.017120+0000","last_fullsized":"2024-09-12T12:25:09.017120+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:36.959459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017018+0000","last_change":"2024-09-12T12:25:07.731526+0000","last_active":"2024-09-12T12:25:09.017018+0000","last_peered":"2024-09-12T12:25:09.017018+0000","last_clean":"2024-09-12T12:25:09.017018+0000","last_became_active":"2024-09-12T12:25:07.731248+0000","last_became_peered":"2024-09-12T12:25:07.731248+0000","last_unstale":"2024-09-12T12:25:09.017018+0000","last_undegraded":"2024-09-12T12:25:09.017018+0000","last_fullsized":"2024-09-12T12:25:09.017018+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:40.802535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016974+0000","last_change":"2024-09-12T12:25:07.729554+0000","last_active":"2024-09-12T12:25:09.016974+0000","last_peered":"2024-09-12T12:25:09.016974+0000","last_clean":"2024-09-12T12:25:09.016974+0000","last_became_active":"2024-09-12T12:25:07.729261+0000","last_became_peered":"2024-09-12T12:25:07.729261+0000","last_unstale":"2024-09-12T12:25:09.016974+0000","last_undegraded":"2024-09-12T12:25:09.016974+0000","last_fullsized":"2024-09-12T12:25:09.016974+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:25.939306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016302+0000","last_change":"2024-09-12T12:25:07.736393+0000","last_active":"2024-09-12T12:25:09.016302+0000","last_peered":"2024-09-12T12:25:09.016302+0000","last_clean":"2024-09-12T12:25:09.016302+0000","last_became_active":"2024-09-12T12:25:07.734445+0000","last_became_peered":"2024-09-12T12:25:07.734445+0000","last_unstale":"2024-09-12T12:25:09.016302+0000","last_undegraded":"2024-09-12T12:25:09.016302+0000","last_fullsized":"2024-09-12T12:25:09.016302+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:10.457747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.714680+0000","last_change":"2024-09-12T12:25:07.728295+0000","last_active":"2024-09-12T12:25:08.714680+0000","last_peered":"2024-09-12T12:25:08.714680+0000","last_clean":"2024-09-12T12:25:08.714680+0000","last_became_active":"2024-09-12T12:25:07.728033+0000","last_became_peered":"2024-09-12T12:25:07.728033+0000","last_unstale":"2024-09-12T12:25:08.714680+0000","last_undegraded":"2024-09-12T12:25:08.714680+0000","last_fullsized":"2024-09-12T12:25:08.714680+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:43.562365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017651+0000","last_change":"2024-09-12T12:25:07.736565+0000","last_active":"2024-09-12T12:25:09.017651+0000","last_peered":"2024-09-12T12:25:09.017651+0000","last_clean":"2024-09-12T12:25:09.017651+0000","last_became_active":"2024-09-12T12:25:07.734126+0000","last_became_peered":"2024-09-12T12:25:07.734126+0000","last_unstale":"2024-09-12T12:25:09.017651+0000","last_undegraded":"2024-09-12T12:25:09.017651+0000","last_fullsized":"2024-09-12T12:25:09.017651+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:20:21.950955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715735+0000","last_change":"2024-09-12T12:25:07.732399+0000","last_active":"2024-09-12T12:25:08.715735+0000","last_peered":"2024-09-12T12:25:08.715735+0000","last_clean":"2024-09-12T12:25:08.715735+0000","last_became_active":"2024-09-12T12:25:07.730694+0000","last_became_peered":"2024-09-12T12:25:07.730694+0000","last_unstale":"2024-09-12T12:25:08.715735+0000","last_undegraded":"2024-09-12T12:25:08.715735+0000","last_fullsized":"2024-09-12T12:25:08.715735+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:50.839483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715268+0000","last_change":"2024-09-12T12:25:07.742987+0000","last_active":"2024-09-12T12:25:08.715268+0000","last_peered":"2024-09-12T12:25:08.715268+0000","last_clean":"2024-09-12T12:25:08.715268+0000","last_became_active":"2024-09-12T12:25:07.742688+0000","last_became_peered":"2024-09-12T12:25:07.742688+0000","last_unstale":"2024-09-12T12:25:08.715268+0000","last_undegraded":"2024-09-12T12:25:08.715268+0000","last_fullsized":"2024-09-12T12:25:08.715268+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:37.555349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017093+0000","last_change":"2024-09-12T12:25:07.723735+0000","last_active":"2024-09-12T12:25:09.017093+0000","last_peered":"2024-09-12T12:25:09.017093+0000","last_clean":"2024-09-12T12:25:09.017093+0000","last_became_active":"2024-09-12T12:25:07.722857+0000","last_became_peered":"2024-09-12T12:25:07.722857+0000","last_unstale":"2024-09-12T12:25:09.017093+0000","last_undegraded":"2024-09-12T12:25:09.017093+0000","last_fullsized":"2024-09-12T12:25:09.017093+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:15.547722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017176+0000","last_change":"2024-09-12T12:25:07.736959+0000","last_active":"2024-09-12T12:25:09.017176+0000","last_peered":"2024-09-12T12:25:09.017176+0000","last_clean":"2024-09-12T12:25:09.017176+0000","last_became_active":"2024-09-12T12:25:07.736663+0000","last_became_peered":"2024-09-12T12:25:07.736663+0000","last_unstale":"2024-09-12T12:25:09.017176+0000","last_undegraded":"2024-09-12T12:25:09.017176+0000","last_fullsized":"2024-09-12T12:25:09.017176+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:51.052817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715107+0000","last_change":"2024-09-12T12:25:07.727276+0000","last_active":"2024-09-12T12:25:08.715107+0000","last_peered":"2024-09-12T12:25:08.715107+0000","last_clean":"2024-09-12T12:25:08.715107+0000","last_became_active":"2024-09-12T12:25:07.726769+0000","last_became_peered":"2024-09-12T12:25:07.726769+0000","last_unstale":"2024-09-12T12:25:08.715107+0000","last_undegraded":"2024-09-12T12:25:08.715107+0000","last_fullsized":"2024-09-12T12:25:08.715107+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:17.673177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715314+0000","last_change":"2024-09-12T12:25:07.741606+0000","last_active":"2024-09-12T12:25:08.715314+0000","last_peered":"2024-09-12T12:25:08.715314+0000","last_clean":"2024-09-12T12:25:08.715314+0000","last_became_active":"2024-09-12T12:25:07.741296+0000","last_became_peered":"2024-09-12T12:25:07.741296+0000","last_unstale":"2024-09-12T12:25:08.715314+0000","last_undegraded":"2024-09-12T12:25:08.715314+0000","last_fullsized":"2024-09-12T12:25:08.715314+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:11.172202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715057+0000","last_change":"2024-09-12T12:25:07.726146+0000","last_active":"2024-09-12T12:25:08.715057+0000","last_peered":"2024-09-12T12:25:08.715057+0000","last_clean":"2024-09-12T12:25:08.715057+0000","last_became_active":"2024-09-12T12:25:07.725835+0000","last_became_peered":"2024-09-12T12:25:07.725835+0000","last_unstale":"2024-09-12T12:25:08.715057+0000","last_undegraded":"2024-09-12T12:25:08.715057+0000","last_fullsized":"2024-09-12T12:25:08.715057+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:24.811576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017799+0000","last_change":"2024-09-12T12:25:07.731263+0000","last_active":"2024-09-12T12:25:09.017799+0000","last_peered":"2024-09-12T12:25:09.017799+0000","last_clean":"2024-09-12T12:25:09.017799+0000","last_became_active":"2024-09-12T12:25:07.730800+0000","last_became_peered":"2024-09-12T12:25:07.730800+0000","last_unstale":"2024-09-12T12:25:09.017799+0000","last_undegraded":"2024-09-12T12:25:09.017799+0000","last_fullsized":"2024-09-12T12:25:09.017799+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:49.099237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017611+0000","last_change":"2024-09-12T12:25:07.727965+0000","last_active":"2024-09-12T12:25:09.017611+0000","last_peered":"2024-09-12T12:25:09.017611+0000","last_clean":"2024-09-12T12:25:09.017611+0000","last_became_active":"2024-09-12T12:25:07.727675+0000","last_became_peered":"2024-09-12T12:25:07.727675+0000","last_unstale":"2024-09-12T12:25:09.017611+0000","last_undegraded":"2024-09-12T12:25:09.017611+0000","last_fullsized":"2024-09-12T12:25:09.017611+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:13.089617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715788+0000","last_change":"2024-09-12T12:25:07.729665+0000","last_active":"2024-09-12T12:25:08.715788+0000","last_peered":"2024-09-12T12:25:08.715788+0000","last_clean":"2024-09-12T12:25:08.715788+0000","last_became_active":"2024-09-12T12:25:07.726455+0000","last_became_peered":"2024-09-12T12:25:07.726455+0000","last_unstale":"2024-09-12T12:25:08.715788+0000","last_undegraded":"2024-09-12T12:25:08.715788+0000","last_fullsized":"2024-09-12T12:25:08.715788+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:44.807274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715445+0000","last_change":"2024-09-12T12:25:07.740739+0000","last_active":"2024-09-12T12:25:08.715445+0000","last_peered":"2024-09-12T12:25:08.715445+0000","last_clean":"2024-09-12T12:25:08.715445+0000","last_became_active":"2024-09-12T12:25:07.740408+0000","last_became_peered":"2024-09-12T12:25:07.740408+0000","last_unstale":"2024-09-12T12:25:08.715445+0000","last_undegraded":"2024-09-12T12:25:08.715445+0000","last_fullsized":"2024-09-12T12:25:08.715445+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:49.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715297+0000","last_change":"2024-09-12T12:25:07.730373+0000","last_active":"2024-09-12T12:25:08.715297+0000","last_peered":"2024-09-12T12:25:08.715297+0000","last_clean":"2024-09-12T12:25:08.715297+0000","last_became_active":"2024-09-12T12:25:07.730060+0000","last_became_peered":"2024-09-12T12:25:07.730060+0000","last_unstale":"2024-09-12T12:25:08.715297+0000","last_undegraded":"2024-09-12T12:25:08.715297+0000","last_fullsized":"2024-09-12T12:25:08.715297+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:11.172202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715452+0000","last_change":"2024-09-12T12:25:07.727374+0000","last_active":"2024-09-12T12:25:08.715452+0000","last_peered":"2024-09-12T12:25:08.715452+0000","last_clean":"2024-09-12T12:25:08.715452+0000","last_became_active":"2024-09-12T12:25:07.727073+0000","last_became_peered":"2024-09-12T12:25:07.727073+0000","last_unstale":"2024-09-12T12:25:08.715452+0000","last_undegraded":"2024-09-12T12:25:08.715452+0000","last_fullsized":"2024-09-12T12:25:08.715452+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:40.186650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016857+0000","last_change":"2024-09-12T12:25:07.719338+0000","last_active":"2024-09-12T12:25:09.016857+0000","last_peered":"2024-09-12T12:25:09.016857+0000","last_clean":"2024-09-12T12:25:09.016857+0000","last_became_active":"2024-09-12T12:25:07.718974+0000","last_became_peered":"2024-09-12T12:25:07.718974+0000","last_unstale":"2024-09-12T12:25:09.016857+0000","last_undegraded":"2024-09-12T12:25:09.016857+0000","last_fullsized":"2024-09-12T12:25:09.016857+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:45:00.395280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016222+0000","last_change":"2024-09-12T12:25:07.726490+0000","last_active":"2024-09-12T12:25:09.016222+0000","last_peered":"2024-09-12T12:25:09.016222+0000","last_clean":"2024-09-12T12:25:09.016222+0000","last_became_active":"2024-09-12T12:25:07.724689+0000","last_became_peered":"2024-09-12T12:25:07.724689+0000","last_unstale":"2024-09-12T12:25:09.016222+0000","last_undegraded":"2024-09-12T12:25:09.016222+0000","last_fullsized":"2024-09-12T12:25:09.016222+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:25.234325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017925+0000","last_change":"2024-09-12T12:25:07.727122+0000","last_active":"2024-09-12T12:25:09.017925+0000","last_peered":"2024-09-12T12:25:09.017925+0000","last_clean":"2024-09-12T12:25:09.017925+0000","last_became_active":"2024-09-12T12:25:07.726842+0000","last_became_peered":"2024-09-12T12:25:07.726842+0000","last_unstale":"2024-09-12T12:25:09.017925+0000","last_undegraded":"2024-09-12T12:25:09.017925+0000","last_fullsized":"2024-09-12T12:25:09.017925+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:09.964668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017866+0000","last_change":"2024-09-12T12:25:07.720666+0000","last_active":"2024-09-12T12:25:09.017866+0000","last_peered":"2024-09-12T12:25:09.017866+0000","last_clean":"2024-09-12T12:25:09.017866+0000","last_became_active":"2024-09-12T12:25:07.720334+0000","last_became_peered":"2024-09-12T12:25:07.720334+0000","last_unstale":"2024-09-12T12:25:09.017866+0000","last_undegraded":"2024-09-12T12:25:09.017866+0000","last_fullsized":"2024-09-12T12:25:09.017866+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:03.854860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715351+0000","last_change":"2024-09-12T12:25:07.741853+0000","last_active":"2024-09-12T12:25:08.715351+0000","last_peered":"2024-09-12T12:25:08.715351+0000","last_clean":"2024-09-12T12:25:08.715351+0000","last_became_active":"2024-09-12T12:25:07.740987+0000","last_became_peered":"2024-09-12T12:25:07.740987+0000","last_unstale":"2024-09-12T12:25:08.715351+0000","last_undegraded":"2024-09-12T12:25:08.715351+0000","last_fullsized":"2024-09-12T12:25:08.715351+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:33.839985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017427+0000","last_change":"2024-09-12T12:25:07.735839+0000","last_active":"2024-09-12T12:25:09.017427+0000","last_peered":"2024-09-12T12:25:09.017427+0000","last_clean":"2024-09-12T12:25:09.017427+0000","last_became_active":"2024-09-12T12:25:07.735582+0000","last_became_peered":"2024-09-12T12:25:07.735582+0000","last_unstale":"2024-09-12T12:25:09.017427+0000","last_undegraded":"2024-09-12T12:25:09.017427+0000","last_fullsized":"2024-09-12T12:25:09.017427+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:24.410159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017156+0000","last_change":"2024-09-12T12:25:07.735144+0000","last_active":"2024-09-12T12:25:09.017156+0000","last_peered":"2024-09-12T12:25:09.017156+0000","last_clean":"2024-09-12T12:25:09.017156+0000","last_became_active":"2024-09-12T12:25:07.734882+0000","last_became_peered":"2024-09-12T12:25:07.734882+0000","last_unstale":"2024-09-12T12:25:09.017156+0000","last_undegraded":"2024-09-12T12:25:09.017156+0000","last_fullsized":"2024-09-12T12:25:09.017156+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:16:37.484882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715483+0000","last_change":"2024-09-12T12:25:07.737180+0000","last_active":"2024-09-12T12:25:08.715483+0000","last_peered":"2024-09-12T12:25:08.715483+0000","last_clean":"2024-09-12T12:25:08.715483+0000","last_became_active":"2024-09-12T12:25:07.736892+0000","last_became_peered":"2024-09-12T12:25:07.736892+0000","last_unstale":"2024-09-12T12:25:08.715483+0000","last_undegraded":"2024-09-12T12:25:08.715483+0000","last_fullsized":"2024-09-12T12:25:08.715483+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:12.709355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017029+0000","last_change":"2024-09-12T12:25:07.738472+0000","last_active":"2024-09-12T12:25:09.017029+0000","last_peered":"2024-09-12T12:25:09.017029+0000","last_clean":"2024-09-12T12:25:09.017029+0000","last_became_active":"2024-09-12T12:25:07.733597+0000","last_became_peered":"2024-09-12T12:25:07.733597+0000","last_unstale":"2024-09-12T12:25:09.017029+0000","last_undegraded":"2024-09-12T12:25:09.017029+0000","last_fullsized":"2024-09-12T12:25:09.017029+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:21.932442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016664+0000","last_change":"2024-09-12T12:25:07.735052+0000","last_active":"2024-09-12T12:25:09.016664+0000","last_peered":"2024-09-12T12:25:09.016664+0000","last_clean":"2024-09-12T12:25:09.016664+0000","last_became_active":"2024-09-12T12:25:07.734774+0000","last_became_peered":"2024-09-12T12:25:07.734774+0000","last_unstale":"2024-09-12T12:25:09.016664+0000","last_undegraded":"2024-09-12T12:25:09.016664+0000","last_fullsized":"2024-09-12T12:25:09.016664+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:03.854860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016969+0000","last_change":"2024-09-12T12:25:07.717568+0000","last_active":"2024-09-12T12:25:09.016969+0000","last_peered":"2024-09-12T12:25:09.016969+0000","last_clean":"2024-09-12T12:25:09.016969+0000","last_became_active":"2024-09-12T12:25:07.716807+0000","last_became_peered":"2024-09-12T12:25:07.716807+0000","last_unstale":"2024-09-12T12:25:09.016969+0000","last_undegraded":"2024-09-12T12:25:09.016969+0000","last_fullsized":"2024-09-12T12:25:09.016969+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:52.438833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"188'4","reported_seq":18,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.716149+0000","last_change":"2024-09-12T12:25:06.719418+0000","last_active":"2024-09-12T12:25:08.716149+0000","last_peered":"2024-09-12T12:25:08.716149+0000","last_clean":"2024-09-12T12:25:08.716149+0000","last_became_active":"2024-09-12T12:25:06.716789+0000","last_became_peered":"2024-09-12T12:25:06.716789+0000","last_unstale":"2024-09-12T12:25:08.716149+0000","last_undegraded":"2024-09-12T12:25:08.716149+0000","last_fullsized":"2024-09-12T12:25:08.716149+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:38.789346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017164+0000","last_change":"2024-09-12T12:25:07.735017+0000","last_active":"2024-09-12T12:25:09.017164+0000","last_peered":"2024-09-12T12:25:09.017164+0000","last_clean":"2024-09-12T12:25:09.017164+0000","last_became_active":"2024-09-12T12:25:07.734667+0000","last_became_peered":"2024-09-12T12:25:07.734667+0000","last_unstale":"2024-09-12T12:25:09.017164+0000","last_undegraded":"2024-09-12T12:25:09.017164+0000","last_fullsized":"2024-09-12T12:25:09.017164+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:01.160148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017405+0000","last_change":"2024-09-12T12:25:06.720063+0000","last_active":"2024-09-12T12:25:09.017405+0000","last_peered":"2024-09-12T12:25:09.017405+0000","last_clean":"2024-09-12T12:25:09.017405+0000","last_became_active":"2024-09-12T12:25:06.719767+0000","last_became_peered":"2024-09-12T12:25:06.719767+0000","last_unstale":"2024-09-12T12:25:09.017405+0000","last_undegraded":"2024-09-12T12:25:09.017405+0000","last_fullsized":"2024-09-12T12:25:09.017405+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:24.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715365+0000","last_change":"2024-09-12T12:25:07.725707+0000","last_active":"2024-09-12T12:25:08.715365+0000","last_peered":"2024-09-12T12:25:08.715365+0000","last_clean":"2024-09-12T12:25:08.715365+0000","last_became_active":"2024-09-12T12:25:07.723886+0000","last_became_peered":"2024-09-12T12:25:07.723886+0000","last_unstale":"2024-09-12T12:25:08.715365+0000","last_undegraded":"2024-09-12T12:25:08.715365+0000","last_fullsized":"2024-09-12T12:25:08.715365+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:12.709355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017903+0000","last_change":"2024-09-12T12:25:06.714216+0000","last_active":"2024-09-12T12:25:09.017903+0000","last_peered":"2024-09-12T12:25:09.017903+0000","last_clean":"2024-09-12T12:25:09.017903+0000","last_became_active":"2024-09-12T12:25:06.713926+0000","last_became_peered":"2024-09-12T12:25:06.713926+0000","last_unstale":"2024-09-12T12:25:09.017903+0000","last_undegraded":"2024-09-12T12:25:09.017903+0000","last_fullsized":"2024-09-12T12:25:09.017903+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:20:20.943980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016615+0000","last_change":"2024-09-12T12:25:07.727645+0000","last_active":"2024-09-12T12:25:09.016615+0000","last_peered":"2024-09-12T12:25:09.016615+0000","last_clean":"2024-09-12T12:25:09.016615+0000","last_became_active":"2024-09-12T12:25:07.724909+0000","last_became_peered":"2024-09-12T12:25:07.724909+0000","last_unstale":"2024-09-12T12:25:09.016615+0000","last_undegraded":"2024-09-12T12:25:09.016615+0000","last_fullsized":"2024-09-12T12:25:09.016615+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:37.202650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017261+0000","last_change":"2024-09-12T12:25:06.722394+0000","last_active":"2024-09-12T12:25:09.017261+0000","last_peered":"2024-09-12T12:25:09.017261+0000","last_clean":"2024-09-12T12:25:09.017261+0000","last_became_active":"2024-09-12T12:25:06.722128+0000","last_became_peered":"2024-09-12T12:25:06.722128+0000","last_unstale":"2024-09-12T12:25:09.017261+0000","last_undegraded":"2024-09-12T12:25:09.017261+0000","last_fullsized":"2024-09-12T12:25:09.017261+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:39.496134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715999+0000","last_change":"2024-09-12T12:25:07.735821+0000","last_active":"2024-09-12T12:25:08.715999+0000","last_peered":"2024-09-12T12:25:08.715999+0000","last_clean":"2024-09-12T12:25:08.715999+0000","last_became_active":"2024-09-12T12:25:07.735558+0000","last_became_peered":"2024-09-12T12:25:07.735558+0000","last_unstale":"2024-09-12T12:25:08.715999+0000","last_undegraded":"2024-09-12T12:25:08.715999+0000","last_fullsized":"2024-09-12T12:25:08.715999+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:05:11.121013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017239+0000","last_change":"2024-09-12T12:25:06.725614+0000","last_active":"2024-09-12T12:25:09.017239+0000","last_peered":"2024-09-12T12:25:09.017239+0000","last_clean":"2024-09-12T12:25:09.017239+0000","last_became_active":"2024-09-12T12:25:06.725339+0000","last_became_peered":"2024-09-12T12:25:06.725339+0000","last_unstale":"2024-09-12T12:25:09.017239+0000","last_undegraded":"2024-09-12T12:25:09.017239+0000","last_fullsized":"2024-09-12T12:25:09.017239+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:56.284737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.716087+0000","last_change":"2024-09-12T12:25:07.736293+0000","last_active":"2024-09-12T12:25:08.716087+0000","last_peered":"2024-09-12T12:25:08.716087+0000","last_clean":"2024-09-12T12:25:08.716087+0000","last_became_active":"2024-09-12T12:25:07.736035+0000","last_became_peered":"2024-09-12T12:25:07.736035+0000","last_unstale":"2024-09-12T12:25:08.716087+0000","last_undegraded":"2024-09-12T12:25:08.716087+0000","last_fullsized":"2024-09-12T12:25:08.716087+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:49.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017011+0000","last_change":"2024-09-12T12:25:06.726121+0000","last_active":"2024-09-12T12:25:09.017011+0000","last_peered":"2024-09-12T12:25:09.017011+0000","last_clean":"2024-09-12T12:25:09.017011+0000","last_became_active":"2024-09-12T12:25:06.725712+0000","last_became_peered":"2024-09-12T12:25:06.725712+0000","last_unstale":"2024-09-12T12:25:09.017011+0000","last_undegraded":"2024-09-12T12:25:09.017011+0000","last_fullsized":"2024-09-12T12:25:09.017011+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:26.281401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017984+0000","last_change":"2024-09-12T12:25:07.731386+0000","last_active":"2024-09-12T12:25:09.017984+0000","last_peered":"2024-09-12T12:25:09.017984+0000","last_clean":"2024-09-12T12:25:09.017984+0000","last_became_active":"2024-09-12T12:25:07.731133+0000","last_became_peered":"2024-09-12T12:25:07.731133+0000","last_unstale":"2024-09-12T12:25:09.017984+0000","last_undegraded":"2024-09-12T12:25:09.017984+0000","last_fullsized":"2024-09-12T12:25:09.017984+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.653733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715089+0000","last_change":"2024-09-12T12:25:06.721135+0000","last_active":"2024-09-12T12:25:08.715089+0000","last_peered":"2024-09-12T12:25:08.715089+0000","last_clean":"2024-09-12T12:25:08.715089+0000","last_became_active":"2024-09-12T12:25:06.720798+0000","last_became_peered":"2024-09-12T12:25:06.720798+0000","last_unstale":"2024-09-12T12:25:08.715089+0000","last_undegraded":"2024-09-12T12:25:08.715089+0000","last_fullsized":"2024-09-12T12:25:08.715089+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:26.027059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.714983+0000","last_change":"2024-09-12T12:25:07.730478+0000","last_active":"2024-09-12T12:25:08.714983+0000","last_peered":"2024-09-12T12:25:08.714983+0000","last_clean":"2024-09-12T12:25:08.714983+0000","last_became_active":"2024-09-12T12:25:07.730191+0000","last_became_peered":"2024-09-12T12:25:07.730191+0000","last_unstale":"2024-09-12T12:25:08.714983+0000","last_undegraded":"2024-09-12T12:25:08.714983+0000","last_fullsized":"2024-09-12T12:25:08.714983+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:17.673177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017314+0000","last_change":"2024-09-12T12:25:06.719165+0000","last_active":"2024-09-12T12:25:09.017314+0000","last_peered":"2024-09-12T12:25:09.017314+0000","last_clean":"2024-09-12T12:25:09.017314+0000","last_became_active":"2024-09-12T12:25:06.718846+0000","last_became_peered":"2024-09-12T12:25:06.718846+0000","last_unstale":"2024-09-12T12:25:09.017314+0000","last_undegraded":"2024-09-12T12:25:09.017314+0000","last_fullsized":"2024-09-12T12:25:09.017314+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:25.293826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715007+0000","last_change":"2024-09-12T12:25:07.726048+0000","last_active":"2024-09-12T12:25:08.715007+0000","last_peered":"2024-09-12T12:25:08.715007+0000","last_clean":"2024-09-12T12:25:08.715007+0000","last_became_active":"2024-09-12T12:25:07.725752+0000","last_became_peered":"2024-09-12T12:25:07.725752+0000","last_unstale":"2024-09-12T12:25:08.715007+0000","last_undegraded":"2024-09-12T12:25:08.715007+0000","last_fullsized":"2024-09-12T12:25:08.715007+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:46.677276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017898+0000","last_change":"2024-09-12T12:25:06.727055+0000","last_active":"2024-09-12T12:25:09.017898+0000","last_peered":"2024-09-12T12:25:09.017898+0000","last_clean":"2024-09-12T12:25:09.017898+0000","last_became_active":"2024-09-12T12:25:06.726740+0000","last_became_peered":"2024-09-12T12:25:06.726740+0000","last_unstale":"2024-09-12T12:25:09.017898+0000","last_undegraded":"2024-09-12T12:25:09.017898+0000","last_fullsized":"2024-09-12T12:25:09.017898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:22.491536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017568+0000","last_change":"2024-09-12T12:25:07.732163+0000","last_active":"2024-09-12T12:25:09.017568+0000","last_peered":"2024-09-12T12:25:09.017568+0000","last_clean":"2024-09-12T12:25:09.017568+0000","last_became_active":"2024-09-12T12:25:07.731898+0000","last_became_peered":"2024-09-12T12:25:07.731898+0000","last_unstale":"2024-09-12T12:25:09.017568+0000","last_undegraded":"2024-09-12T12:25:09.017568+0000","last_fullsized":"2024-09-12T12:25:09.017568+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:34.742428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"188'3","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017540+0000","last_change":"2024-09-12T12:25:06.714880+0000","last_active":"2024-09-12T12:25:09.017540+0000","last_peered":"2024-09-12T12:25:09.017540+0000","last_clean":"2024-09-12T12:25:09.017540+0000","last_became_active":"2024-09-12T12:25:06.714609+0000","last_became_peered":"2024-09-12T12:25:06.714609+0000","last_unstale":"2024-09-12T12:25:09.017540+0000","last_undegraded":"2024-09-12T12:25:09.017540+0000","last_fullsized":"2024-09-12T12:25:09.017540+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:04.624637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016755+0000","last_change":"2024-09-12T12:25:07.732122+0000","last_active":"2024-09-12T12:25:09.016755+0000","last_peered":"2024-09-12T12:25:09.016755+0000","last_clean":"2024-09-12T12:25:09.016755+0000","last_became_active":"2024-09-12T12:25:07.731870+0000","last_became_peered":"2024-09-12T12:25:07.731870+0000","last_unstale":"2024-09-12T12:25:09.016755+0000","last_undegraded":"2024-09-12T12:25:09.016755+0000","last_fullsized":"2024-09-12T12:25:09.016755+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:33.684881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"188'6","reported_seq":20,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017245+0000","last_change":"2024-09-12T12:25:06.725137+0000","last_active":"2024-09-12T12:25:09.017245+0000","last_peered":"2024-09-12T12:25:09.017245+0000","last_clean":"2024-09-12T12:25:09.017245+0000","last_became_active":"2024-09-12T12:25:06.724760+0000","last_became_peered":"2024-09-12T12:25:06.724760+0000","last_unstale":"2024-09-12T12:25:09.017245+0000","last_undegraded":"2024-09-12T12:25:09.017245+0000","last_fullsized":"2024-09-12T12:25:09.017245+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:48.965966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017053+0000","last_change":"2024-09-12T12:25:07.719195+0000","last_active":"2024-09-12T12:25:09.017053+0000","last_peered":"2024-09-12T12:25:09.017053+0000","last_clean":"2024-09-12T12:25:09.017053+0000","last_became_active":"2024-09-12T12:25:07.718899+0000","last_became_peered":"2024-09-12T12:25:07.718899+0000","last_unstale":"2024-09-12T12:25:09.017053+0000","last_undegraded":"2024-09-12T12:25:09.017053+0000","last_fullsized":"2024-09-12T12:25:09.017053+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:18.265319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016847+0000","last_change":"2024-09-12T12:25:06.721650+0000","last_active":"2024-09-12T12:25:09.016847+0000","last_peered":"2024-09-12T12:25:09.016847+0000","last_clean":"2024-09-12T12:25:09.016847+0000","last_became_active":"2024-09-12T12:25:06.721352+0000","last_became_peered":"2024-09-12T12:25:06.721352+0000","last_unstale":"2024-09-12T12:25:09.016847+0000","last_undegraded":"2024-09-12T12:25:09.016847+0000","last_fullsized":"2024-09-12T12:25:09.016847+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:16:36.477907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715399+0000","last_change":"2024-09-12T12:25:07.723642+0000","last_active":"2024-09-12T12:25:08.715399+0000","last_peered":"2024-09-12T12:25:08.715399+0000","last_clean":"2024-09-12T12:25:08.715399+0000","last_became_active":"2024-09-12T12:25:07.723332+0000","last_became_peered":"2024-09-12T12:25:07.723332+0000","last_unstale":"2024-09-12T12:25:08.715399+0000","last_undegraded":"2024-09-12T12:25:08.715399+0000","last_fullsized":"2024-09-12T12:25:08.715399+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:11.050296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715300+0000","last_change":"2024-09-12T12:25:06.715937+0000","last_active":"2024-09-12T12:25:08.715300+0000","last_peered":"2024-09-12T12:25:08.715300+0000","last_clean":"2024-09-12T12:25:08.715300+0000","last_became_active":"2024-09-12T12:25:06.715658+0000","last_became_peered":"2024-09-12T12:25:06.715658+0000","last_unstale":"2024-09-12T12:25:08.715300+0000","last_undegraded":"2024-09-12T12:25:08.715300+0000","last_fullsized":"2024-09-12T12:25:08.715300+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:23.351191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017699+0000","last_change":"2024-09-12T12:25:07.724639+0000","last_active":"2024-09-12T12:25:09.017699+0000","last_peered":"2024-09-12T12:25:09.017699+0000","last_clean":"2024-09-12T12:25:09.017699+0000","last_became_active":"2024-09-12T12:25:07.724366+0000","last_became_peered":"2024-09-12T12:25:07.724366+0000","last_unstale":"2024-09-12T12:25:09.017699+0000","last_undegraded":"2024-09-12T12:25:09.017699+0000","last_fullsized":"2024-09-12T12:25:09.017699+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:05.606075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016859+0000","last_change":"2024-09-12T12:25:06.723088+0000","last_active":"2024-09-12T12:25:09.016859+0000","last_peered":"2024-09-12T12:25:09.016859+0000","last_clean":"2024-09-12T12:25:09.016859+0000","last_became_active":"2024-09-12T12:25:06.722778+0000","last_became_peered":"2024-09-12T12:25:06.722778+0000","last_unstale":"2024-09-12T12:25:09.016859+0000","last_undegraded":"2024-09-12T12:25:09.016859+0000","last_fullsized":"2024-09-12T12:25:09.016859+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:30.579028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017642+0000","last_change":"2024-09-12T12:25:07.736300+0000","last_active":"2024-09-12T12:25:09.017642+0000","last_peered":"2024-09-12T12:25:09.017642+0000","last_clean":"2024-09-12T12:25:09.017642+0000","last_became_active":"2024-09-12T12:25:07.735980+0000","last_became_peered":"2024-09-12T12:25:07.735980+0000","last_unstale":"2024-09-12T12:25:09.017642+0000","last_undegraded":"2024-09-12T12:25:09.017642+0000","last_fullsized":"2024-09-12T12:25:09.017642+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:46.677276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"188'8","reported_seq":22,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016165+0000","last_change":"2024-09-12T12:25:06.720193+0000","last_active":"2024-09-12T12:25:09.016165+0000","last_peered":"2024-09-12T12:25:09.016165+0000","last_clean":"2024-09-12T12:25:09.016165+0000","last_became_active":"2024-09-12T12:25:06.719703+0000","last_became_peered":"2024-09-12T12:25:06.719703+0000","last_unstale":"2024-09-12T12:25:09.016165+0000","last_undegraded":"2024-09-12T12:25:09.016165+0000","last_fullsized":"2024-09-12T12:25:09.016165+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:57.334694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.714718+0000","last_change":"2024-09-12T12:25:07.726702+0000","last_active":"2024-09-12T12:25:08.714718+0000","last_peered":"2024-09-12T12:25:08.714718+0000","last_clean":"2024-09-12T12:25:08.714718+0000","last_became_active":"2024-09-12T12:25:07.726065+0000","last_became_peered":"2024-09-12T12:25:07.726065+0000","last_unstale":"2024-09-12T12:25:08.714718+0000","last_undegraded":"2024-09-12T12:25:08.714718+0000","last_fullsized":"2024-09-12T12:25:08.714718+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:02.316182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017393+0000","last_change":"2024-09-12T12:25:06.721638+0000","last_active":"2024-09-12T12:25:09.017393+0000","last_peered":"2024-09-12T12:25:09.017393+0000","last_clean":"2024-09-12T12:25:09.017393+0000","last_became_active":"2024-09-12T12:25:06.721334+0000","last_became_peered":"2024-09-12T12:25:06.721334+0000","last_unstale":"2024-09-12T12:25:09.017393+0000","last_undegraded":"2024-09-12T12:25:09.017393+0000","last_fullsized":"2024-09-12T12:25:09.017393+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:39.179674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017239+0000","last_change":"2024-09-12T12:25:07.720555+0000","last_active":"2024-09-12T12:25:09.017239+0000","last_peered":"2024-09-12T12:25:09.017239+0000","last_clean":"2024-09-12T12:25:09.017239+0000","last_became_active":"2024-09-12T12:25:07.720207+0000","last_became_peered":"2024-09-12T12:25:07.720207+0000","last_unstale":"2024-09-12T12:25:09.017239+0000","last_undegraded":"2024-09-12T12:25:09.017239+0000","last_fullsized":"2024-09-12T12:25:09.017239+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:27.034034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017488+0000","last_change":"2024-09-12T12:25:06.723939+0000","last_active":"2024-09-12T12:25:09.017488+0000","last_peered":"2024-09-12T12:25:09.017488+0000","last_clean":"2024-09-12T12:25:09.017488+0000","last_became_active":"2024-09-12T12:25:06.723654+0000","last_became_peered":"2024-09-12T12:25:06.723654+0000","last_unstale":"2024-09-12T12:25:09.017488+0000","last_undegraded":"2024-09-12T12:25:09.017488+0000","last_fullsized":"2024-09-12T12:25:09.017488+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:49.832508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017088+0000","last_change":"2024-09-12T12:25:07.726391+0000","last_active":"2024-09-12T12:25:09.017088+0000","last_peered":"2024-09-12T12:25:09.017088+0000","last_clean":"2024-09-12T12:25:09.017088+0000","last_became_active":"2024-09-12T12:25:07.726106+0000","last_became_peered":"2024-09-12T12:25:07.726106+0000","last_unstale":"2024-09-12T12:25:09.017088+0000","last_undegraded":"2024-09-12T12:25:09.017088+0000","last_fullsized":"2024-09-12T12:25:09.017088+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:02.412740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017914+0000","last_change":"2024-09-12T12:25:06.720191+0000","last_active":"2024-09-12T12:25:09.017914+0000","last_peered":"2024-09-12T12:25:09.017914+0000","last_clean":"2024-09-12T12:25:09.017914+0000","last_became_active":"2024-09-12T12:25:06.719929+0000","last_became_peered":"2024-09-12T12:25:06.719929+0000","last_unstale":"2024-09-12T12:25:09.017914+0000","last_undegraded":"2024-09-12T12:25:09.017914+0000","last_fullsized":"2024-09-12T12:25:09.017914+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:12.082642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715492+0000","last_change":"2024-09-12T12:25:07.725042+0000","last_active":"2024-09-12T12:25:08.715492+0000","last_peered":"2024-09-12T12:25:08.715492+0000","last_clean":"2024-09-12T12:25:08.715492+0000","last_became_active":"2024-09-12T12:25:07.724765+0000","last_became_peered":"2024-09-12T12:25:07.724765+0000","last_unstale":"2024-09-12T12:25:08.715492+0000","last_undegraded":"2024-09-12T12:25:08.715492+0000","last_fullsized":"2024-09-12T12:25:08.715492+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:25.157472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017289+0000","last_change":"2024-09-12T12:25:06.722276+0000","last_active":"2024-09-12T12:25:09.017289+0000","last_peered":"2024-09-12T12:25:09.017289+0000","last_clean":"2024-09-12T12:25:09.017289+0000","last_became_active":"2024-09-12T12:25:06.722003+0000","last_became_peered":"2024-09-12T12:25:06.722003+0000","last_unstale":"2024-09-12T12:25:09.017289+0000","last_undegraded":"2024-09-12T12:25:09.017289+0000","last_fullsized":"2024-09-12T12:25:09.017289+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:19.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017745+0000","last_change":"2024-09-12T12:25:07.726314+0000","last_active":"2024-09-12T12:25:09.017745+0000","last_peered":"2024-09-12T12:25:09.017745+0000","last_clean":"2024-09-12T12:25:09.017745+0000","last_became_active":"2024-09-12T12:25:07.726048+0000","last_became_peered":"2024-09-12T12:25:07.726048+0000","last_unstale":"2024-09-12T12:25:09.017745+0000","last_undegraded":"2024-09-12T12:25:09.017745+0000","last_fullsized":"2024-09-12T12:25:09.017745+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:02.291353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017115+0000","last_change":"2024-09-12T12:25:06.715836+0000","last_active":"2024-09-12T12:25:09.017115+0000","last_peered":"2024-09-12T12:25:09.017115+0000","last_clean":"2024-09-12T12:25:09.017115+0000","last_became_active":"2024-09-12T12:25:06.715561+0000","last_became_peered":"2024-09-12T12:25:06.715561+0000","last_unstale":"2024-09-12T12:25:09.017115+0000","last_undegraded":"2024-09-12T12:25:09.017115+0000","last_fullsized":"2024-09-12T12:25:09.017115+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:04.281500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017472+0000","last_change":"2024-09-12T12:25:07.738556+0000","last_active":"2024-09-12T12:25:09.017472+0000","last_peered":"2024-09-12T12:25:09.017472+0000","last_clean":"2024-09-12T12:25:09.017472+0000","last_became_active":"2024-09-12T12:25:07.738287+0000","last_became_peered":"2024-09-12T12:25:07.738287+0000","last_unstale":"2024-09-12T12:25:09.017472+0000","last_undegraded":"2024-09-12T12:25:09.017472+0000","last_fullsized":"2024-09-12T12:25:09.017472+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:43.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016804+0000","last_change":"2024-09-12T12:25:06.716991+0000","last_active":"2024-09-12T12:25:09.016804+0000","last_peered":"2024-09-12T12:25:09.016804+0000","last_clean":"2024-09-12T12:25:09.016804+0000","last_became_active":"2024-09-12T12:25:06.716729+0000","last_became_peered":"2024-09-12T12:25:06.716729+0000","last_unstale":"2024-09-12T12:25:09.016804+0000","last_undegraded":"2024-09-12T12:25:09.016804+0000","last_fullsized":"2024-09-12T12:25:09.016804+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:33.735453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017760+0000","last_change":"2024-09-12T12:25:07.729502+0000","last_active":"2024-09-12T12:25:09.017760+0000","last_peered":"2024-09-12T12:25:09.017760+0000","last_clean":"2024-09-12T12:25:09.017760+0000","last_became_active":"2024-09-12T12:25:07.729199+0000","last_became_peered":"2024-09-12T12:25:07.729199+0000","last_unstale":"2024-09-12T12:25:09.017760+0000","last_undegraded":"2024-09-12T12:25:09.017760+0000","last_fullsized":"2024-09-12T12:25:09.017760+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:35.638801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715516+0000","last_change":"2024-09-12T12:25:06.714767+0000","last_active":"2024-09-12T12:25:08.715516+0000","last_peered":"2024-09-12T12:25:08.715516+0000","last_clean":"2024-09-12T12:25:08.715516+0000","last_became_active":"2024-09-12T12:25:06.714271+0000","last_became_peered":"2024-09-12T12:25:06.714271+0000","last_unstale":"2024-09-12T12:25:08.715516+0000","last_undegraded":"2024-09-12T12:25:08.715516+0000","last_fullsized":"2024-09-12T12:25:08.715516+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:07.265887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.716204+0000","last_change":"2024-09-12T12:25:07.736299+0000","last_active":"2024-09-12T12:25:08.716204+0000","last_peered":"2024-09-12T12:25:08.716204+0000","last_clean":"2024-09-12T12:25:08.716204+0000","last_became_active":"2024-09-12T12:25:07.736011+0000","last_became_peered":"2024-09-12T12:25:07.736011+0000","last_unstale":"2024-09-12T12:25:08.716204+0000","last_undegraded":"2024-09-12T12:25:08.716204+0000","last_fullsized":"2024-09-12T12:25:08.716204+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:27.288376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016684+0000","last_change":"2024-09-12T12:25:06.721270+0000","last_active":"2024-09-12T12:25:09.016684+0000","last_peered":"2024-09-12T12:25:09.016684+0000","last_clean":"2024-09-12T12:25:09.016684+0000","last_became_active":"2024-09-12T12:25:06.720943+0000","last_became_peered":"2024-09-12T12:25:06.720943+0000","last_unstale":"2024-09-12T12:25:09.016684+0000","last_undegraded":"2024-09-12T12:25:09.016684+0000","last_fullsized":"2024-09-12T12:25:09.016684+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:05:10.114037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.714843+0000","last_change":"2024-09-12T12:25:07.726690+0000","last_active":"2024-09-12T12:25:08.714843+0000","last_peered":"2024-09-12T12:25:08.714843+0000","last_clean":"2024-09-12T12:25:08.714843+0000","last_became_active":"2024-09-12T12:25:07.726052+0000","last_became_peered":"2024-09-12T12:25:07.726052+0000","last_unstale":"2024-09-12T12:25:08.714843+0000","last_undegraded":"2024-09-12T12:25:08.714843+0000","last_fullsized":"2024-09-12T12:25:08.714843+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:54.990919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017984+0000","last_change":"2024-09-12T12:25:06.714825+0000","last_active":"2024-09-12T12:25:09.017984+0000","last_peered":"2024-09-12T12:25:09.017984+0000","last_clean":"2024-09-12T12:25:09.017984+0000","last_became_active":"2024-09-12T12:25:06.714545+0000","last_became_peered":"2024-09-12T12:25:06.714545+0000","last_unstale":"2024-09-12T12:25:09.017984+0000","last_undegraded":"2024-09-12T12:25:09.017984+0000","last_fullsized":"2024-09-12T12:25:09.017984+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:40:19.393496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715012+0000","last_change":"2024-09-12T12:25:07.736232+0000","last_active":"2024-09-12T12:25:08.715012+0000","last_peered":"2024-09-12T12:25:08.715012+0000","last_clean":"2024-09-12T12:25:08.715012+0000","last_became_active":"2024-09-12T12:25:07.735745+0000","last_became_peered":"2024-09-12T12:25:07.735745+0000","last_unstale":"2024-09-12T12:25:08.715012+0000","last_undegraded":"2024-09-12T12:25:08.715012+0000","last_fullsized":"2024-09-12T12:25:08.715012+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:31.537697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"189'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.741569+0000","last_change":"2024-09-12T12:25:06.718378+0000","last_active":"2024-09-12T12:25:08.741569+0000","last_peered":"2024-09-12T12:25:08.741569+0000","last_clean":"2024-09-12T12:25:08.741569+0000","last_became_active":"2024-09-12T12:25:06.717669+0000","last_became_peered":"2024-09-12T12:25:06.717669+0000","last_unstale":"2024-09-12T12:25:08.741569+0000","last_undegraded":"2024-09-12T12:25:08.741569+0000","last_fullsized":"2024-09-12T12:25:08.741569+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:30.459493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016757+0000","last_change":"2024-09-12T12:25:07.735405+0000","last_active":"2024-09-12T12:25:09.016757+0000","last_peered":"2024-09-12T12:25:09.016757+0000","last_clean":"2024-09-12T12:25:09.016757+0000","last_became_active":"2024-09-12T12:25:07.734742+0000","last_became_peered":"2024-09-12T12:25:07.734742+0000","last_unstale":"2024-09-12T12:25:09.016757+0000","last_undegraded":"2024-09-12T12:25:09.016757+0000","last_fullsized":"2024-09-12T12:25:09.016757+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:54.969764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.716029+0000","last_change":"2024-09-12T12:25:06.716041+0000","last_active":"2024-09-12T12:25:08.716029+0000","last_peered":"2024-09-12T12:25:08.716029+0000","last_clean":"2024-09-12T12:25:08.716029+0000","last_became_active":"2024-09-12T12:25:06.715775+0000","last_became_peered":"2024-09-12T12:25:06.715775+0000","last_unstale":"2024-09-12T12:25:08.716029+0000","last_undegraded":"2024-09-12T12:25:08.716029+0000","last_fullsized":"2024-09-12T12:25:08.716029+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:08.448163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017554+0000","last_change":"2024-09-12T12:25:07.730566+0000","last_active":"2024-09-12T12:25:09.017554+0000","last_peered":"2024-09-12T12:25:09.017554+0000","last_clean":"2024-09-12T12:25:09.017554+0000","last_became_active":"2024-09-12T12:25:07.730254+0000","last_became_peered":"2024-09-12T12:25:07.730254+0000","last_unstale":"2024-09-12T12:25:09.017554+0000","last_undegraded":"2024-09-12T12:25:09.017554+0000","last_fullsized":"2024-09-12T12:25:09.017554+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:19.169027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016969+0000","last_change":"2024-09-12T12:25:06.719456+0000","last_active":"2024-09-12T12:25:09.016969+0000","last_peered":"2024-09-12T12:25:09.016969+0000","last_clean":"2024-09-12T12:25:09.016969+0000","last_became_active":"2024-09-12T12:25:06.719164+0000","last_became_peered":"2024-09-12T12:25:06.719164+0000","last_unstale":"2024-09-12T12:25:09.016969+0000","last_undegraded":"2024-09-12T12:25:09.016969+0000","last_fullsized":"2024-09-12T12:25:09.016969+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:11.702380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715407+0000","last_change":"2024-09-12T12:25:07.729801+0000","last_active":"2024-09-12T12:25:08.715407+0000","last_peered":"2024-09-12T12:25:08.715407+0000","last_clean":"2024-09-12T12:25:08.715407+0000","last_became_active":"2024-09-12T12:25:07.729435+0000","last_became_peered":"2024-09-12T12:25:07.729435+0000","last_unstale":"2024-09-12T12:25:08.715407+0000","last_undegraded":"2024-09-12T12:25:08.715407+0000","last_fullsized":"2024-09-12T12:25:08.715407+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:05:11.121013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715597+0000","last_change":"2024-09-12T12:25:06.711392+0000","last_active":"2024-09-12T12:25:08.715597+0000","last_peered":"2024-09-12T12:25:08.715597+0000","last_clean":"2024-09-12T12:25:08.715597+0000","last_became_active":"2024-09-12T12:25:06.711092+0000","last_became_peered":"2024-09-12T12:25:06.711092+0000","last_unstale":"2024-09-12T12:25:08.715597+0000","last_undegraded":"2024-09-12T12:25:08.715597+0000","last_fullsized":"2024-09-12T12:25:08.715597+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:31.891547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017591+0000","last_change":"2024-09-12T12:25:07.743823+0000","last_active":"2024-09-12T12:25:09.017591+0000","last_peered":"2024-09-12T12:25:09.017591+0000","last_clean":"2024-09-12T12:25:09.017591+0000","last_became_active":"2024-09-12T12:25:07.743558+0000","last_became_peered":"2024-09-12T12:25:07.743558+0000","last_unstale":"2024-09-12T12:25:09.017591+0000","last_undegraded":"2024-09-12T12:25:09.017591+0000","last_fullsized":"2024-09-12T12:25:09.017591+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:13.830101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017494+0000","last_change":"2024-09-12T12:25:06.723828+0000","last_active":"2024-09-12T12:25:09.017494+0000","last_peered":"2024-09-12T12:25:09.017494+0000","last_clean":"2024-09-12T12:25:09.017494+0000","last_became_active":"2024-09-12T12:25:06.722061+0000","last_became_peered":"2024-09-12T12:25:06.722061+0000","last_unstale":"2024-09-12T12:25:09.017494+0000","last_undegraded":"2024-09-12T12:25:09.017494+0000","last_fullsized":"2024-09-12T12:25:09.017494+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:35.217152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017819+0000","last_change":"2024-09-12T12:25:07.741973+0000","last_active":"2024-09-12T12:25:09.017819+0000","last_peered":"2024-09-12T12:25:09.017819+0000","last_clean":"2024-09-12T12:25:09.017819+0000","last_became_active":"2024-09-12T12:25:07.741685+0000","last_became_peered":"2024-09-12T12:25:07.741685+0000","last_unstale":"2024-09-12T12:25:09.017819+0000","last_undegraded":"2024-09-12T12:25:09.017819+0000","last_fullsized":"2024-09-12T12:25:09.017819+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:31.537697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017414+0000","last_change":"2024-09-12T12:25:06.723146+0000","last_active":"2024-09-12T12:25:09.017414+0000","last_peered":"2024-09-12T12:25:09.017414+0000","last_clean":"2024-09-12T12:25:09.017414+0000","last_became_active":"2024-09-12T12:25:06.722286+0000","last_became_peered":"2024-09-12T12:25:06.722286+0000","last_unstale":"2024-09-12T12:25:09.017414+0000","last_undegraded":"2024-09-12T12:25:09.017414+0000","last_fullsized":"2024-09-12T12:25:09.017414+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:48.366937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715345+0000","last_change":"2024-09-12T12:25:07.733388+0000","last_active":"2024-09-12T12:25:08.715345+0000","last_peered":"2024-09-12T12:25:08.715345+0000","last_clean":"2024-09-12T12:25:08.715345+0000","last_became_active":"2024-09-12T12:25:07.732717+0000","last_became_peered":"2024-09-12T12:25:07.732717+0000","last_unstale":"2024-09-12T12:25:08.715345+0000","last_undegraded":"2024-09-12T12:25:08.715345+0000","last_fullsized":"2024-09-12T12:25:08.715345+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:29.240886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016269+0000","last_change":"2024-09-12T12:25:06.719966+0000","last_active":"2024-09-12T12:25:09.016269+0000","last_peered":"2024-09-12T12:25:09.016269+0000","last_clean":"2024-09-12T12:25:09.016269+0000","last_became_active":"2024-09-12T12:25:06.719344+0000","last_became_peered":"2024-09-12T12:25:06.719344+0000","last_unstale":"2024-09-12T12:25:09.016269+0000","last_undegraded":"2024-09-12T12:25:09.016269+0000","last_fullsized":"2024-09-12T12:25:09.016269+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:28.574976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016920+0000","last_change":"2024-09-12T12:25:07.736011+0000","last_active":"2024-09-12T12:25:09.016920+0000","last_peered":"2024-09-12T12:25:09.016920+0000","last_clean":"2024-09-12T12:25:09.016920+0000","last_became_active":"2024-09-12T12:25:07.735734+0000","last_became_peered":"2024-09-12T12:25:07.735734+0000","last_unstale":"2024-09-12T12:25:09.016920+0000","last_undegraded":"2024-09-12T12:25:09.016920+0000","last_fullsized":"2024-09-12T12:25:09.016920+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:41.355278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017399+0000","last_change":"2024-09-12T12:25:06.716125+0000","last_active":"2024-09-12T12:25:09.017399+0000","last_peered":"2024-09-12T12:25:09.017399+0000","last_clean":"2024-09-12T12:25:09.017399+0000","last_became_active":"2024-09-12T12:25:06.713267+0000","last_became_peered":"2024-09-12T12:25:06.713267+0000","last_unstale":"2024-09-12T12:25:09.017399+0000","last_undegraded":"2024-09-12T12:25:09.017399+0000","last_fullsized":"2024-09-12T12:25:09.017399+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:28:10.156212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":480,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016657+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:25:09.016657+0000","last_peered":"2024-09-12T12:25:09.016657+0000","last_clean":"2024-09-12T12:25:09.016657+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:25:09.016657+0000","last_undegraded":"2024-09-12T12:25:09.016657+0000","last_fullsized":"2024-09-12T12:25:09.016657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52168,"kb_used_data":2924,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319672,"statfs":{"total":96636764160,"available":96583344128,"internally_reserved":0,"allocated":2994176,"data_stored":1720383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2400256,"data_stored":1130527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575002,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51568,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320272,"statfs":{"total":96636764160,"available":96583958528,"internally_reserved":0,"allocated":2379776,"data_stored":1121697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59892,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311948,"statfs":{"total":96636764160,"available":96575434752,"internally_reserved":0,"allocated":2387968,"data_stored":1128915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64064,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307776,"statfs":{"total":96636764160,"available":96571162624,"internally_reserved":0,"allocated":2396160,"data_stored":1128459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":63175112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59876,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311964,"statfs":{"total":96636764160,"available":96575451136,"internally_reserved":0,"allocated":2375680,"data_stored":1121731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59888,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311952,"statfs":{"total":96636764160,"available":96575438848,"internally_reserved":0,"allocated":2383872,"data_stored":1128333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56304,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2969600,"data_stored":1712099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:25:11.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:25:11.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7571200640 1 Processor -- start 2024-09-12T12:25:11.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7571200640 1 -- start start 2024-09-12T12:25:11.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7571200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f756c15c7b0 0x7f756c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7571200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f756c15cd30 0x7f756c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7571200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c0b5de0 0x7f756c1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:11.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7571200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f756c0b6230 con 0x7f756c15c7b0 2024-09-12T12:25:11.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7571200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f756c072a50 con 0x7f756c15cd30 2024-09-12T12:25:11.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7571200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f756c0cde30 con 0x7f756c0b5de0 2024-09-12T12:25:11.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7569e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f756c15c7b0 0x7f756c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7569e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f756c15c7b0 0x7f756c0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59540/0 (socket says 172.21.15.144:59540) 2024-09-12T12:25:11.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.991+0000 7f7569e00640 1 -- 172.21.15.144:0/2461910919 learned_addr learned my addr 172.21.15.144:0/2461910919 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:11.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7569e00640 1 -- 172.21.15.144:0/2461910919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c0b5de0 msgr2=0x7f756c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7569e00640 1 --2- 172.21.15.144:0/2461910919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c0b5de0 0x7f756c1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7561400640 1 --2- 172.21.15.144:0/2461910919 >> v2:172.21.15.165:3300/0 conn(0x7f756c15cd30 0x7f756c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:11.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7569e00640 1 -- 172.21.15.144:0/2461910919 >> v2:172.21.15.165:3300/0 conn(0x7f756c15cd30 msgr2=0x7f756c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:11.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7569e00640 1 --2- 172.21.15.144:0/2461910919 >> v2:172.21.15.165:3300/0 conn(0x7f756c15cd30 0x7f756c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7569e00640 1 -- 172.21.15.144:0/2461910919 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c0cd870 con 0x7f756c15c7b0 2024-09-12T12:25:11.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7561400640 1 --2- 172.21.15.144:0/2461910919 >> v2:172.21.15.165:3300/0 conn(0x7f756c15cd30 0x7f756c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:11.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7569e00640 1 --2- 172.21.15.144:0/2461910919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c15c7b0 0x7f756c0ccf00 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f756c0afd90 tx=0x7f755c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0900333fb52b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:11.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7569400640 1 -- 172.21.15.144:0/2461910919 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0b0070 con 0x7f756c15c7b0 2024-09-12T12:25:11.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7569400640 1 -- 172.21.15.144:0/2461910919 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c0ab600 con 0x7f756c15c7b0 2024-09-12T12:25:11.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7569400640 1 -- 172.21.15.144:0/2461910919 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0ab9d0 con 0x7f756c15c7b0 2024-09-12T12:25:11.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7571200640 1 -- 172.21.15.144:0/2461910919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c15c7b0 msgr2=0x7f756c0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:11.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7571200640 1 --2- 172.21.15.144:0/2461910919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c15c7b0 0x7f756c0ccf00 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f756c0afd90 tx=0x7f755c01c260 comp rx=0 tx=0).stop 2024-09-12T12:25:11.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7571200640 1 -- 172.21.15.144:0/2461910919 shutdown_connections 2024-09-12T12:25:11.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7571200640 1 --2- 172.21.15.144:0/2461910919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c0b5de0 0x7f756c1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7571200640 1 --2- 172.21.15.144:0/2461910919 >> v2:172.21.15.165:3300/0 conn(0x7f756c15cd30 0x7f756c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7571200640 1 --2- 172.21.15.144:0/2461910919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c15c7b0 0x7f756c0ccf00 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:11.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7571200640 1 -- 172.21.15.144:0/2461910919 >> 172.21.15.144:0/2461910919 conn(0x7f756c06d0d0 msgr2=0x7f756c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:11.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7571200640 1 -- 172.21.15.144:0/2461910919 shutdown_connections 2024-09-12T12:25:11.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.995+0000 7f7571200640 1 -- 172.21.15.144:0/2461910919 wait complete. 2024-09-12T12:25:12.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 Processor -- start 2024-09-12T12:25:12.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 -- start start 2024-09-12T12:25:12.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c0b5de0 0x7f756c14b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f756c15c7b0 0x7f756c1540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c15cd30 0x7f756c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f756c072ee0 con 0x7f756c0b5de0 2024-09-12T12:25:12.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f756c0cd650 con 0x7f756c15c7b0 2024-09-12T12:25:12.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f756c073060 con 0x7f756c15cd30 2024-09-12T12:25:12.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7569e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c0b5de0 0x7f756c14b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7569e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c0b5de0 0x7f756c14b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59552/0 (socket says 172.21.15.144:59552) 2024-09-12T12:25:12.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7569e00640 1 -- 172.21.15.144:0/1310850064 learned_addr learned my addr 172.21.15.144:0/1310850064 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7569e00640 1 -- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c15cd30 msgr2=0x7f756c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f756a800640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c15cd30 0x7f756c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7561400640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f756c15c7b0 0x7f756c1540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7569e00640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c15cd30 0x7f756c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7569e00640 1 -- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f756c15c7b0 msgr2=0x7f756c1540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7569e00640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f756c15c7b0 0x7f756c1540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7569e00640 1 -- 172.21.15.144:0/1310850064 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c14b750 con 0x7f756c0b5de0 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f756a800640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c15cd30 0x7f756c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7561400640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f756c15c7b0 0x7f756c1540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7569e00640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c0b5de0 0x7f756c14b210 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f755c01cb00 tx=0x7f755c01aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7562a00640 1 -- 172.21.15.144:0/1310850064 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0ba020 con 0x7f756c0b5de0 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7562a00640 1 -- 172.21.15.144:0/1310850064 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c0b6640 con 0x7f756c0b5de0 2024-09-12T12:25:12.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7562a00640 1 -- 172.21.15.144:0/1310850064 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0b0040 con 0x7f756c0b5de0 2024-09-12T12:25:12.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756c152820 con 0x7f756c0b5de0 2024-09-12T12:25:12.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:11.999+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756c152de0 con 0x7f756c0b5de0 2024-09-12T12:25:12.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.003+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756c0ccf00 con 0x7f756c0b5de0 2024-09-12T12:25:12.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.003+0000 7f7562a00640 1 -- 172.21.15.144:0/1310850064 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f755c0bd020 con 0x7f756c0b5de0 2024-09-12T12:25:12.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.003+0000 7f7562a00640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75480678f0 0x7f7548069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.003+0000 7f7562a00640 1 -- 172.21.15.144:0/1310850064 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f755c120260 con 0x7f756c0b5de0 2024-09-12T12:25:12.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.003+0000 7f7561400640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75480678f0 0x7f7548069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.003+0000 7f7561400640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75480678f0 0x7f7548069db0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f756c166470 tx=0x7f7554008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.007+0000 7f7562a00640 1 -- 172.21.15.144:0/1310850064 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f755c0c4030 con 0x7f756c0b5de0 2024-09-12T12:25:12.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.159+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f756c0b5440 con 0x7f75480678f0 2024-09-12T12:25:12.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.167+0000 7f7562a00640 1 -- 172.21.15.144:0/1310850064 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252491 (secure 0 0 0) 0x7f756c0b5440 con 0x7f75480678f0 2024-09-12T12:25:12.171 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:12.172 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:25:12.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75480678f0 msgr2=0x7f7548069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75480678f0 0x7f7548069db0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f756c166470 tx=0x7f7554008040 comp rx=0 tx=0).stop 2024-09-12T12:25:12.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c0b5de0 msgr2=0x7f756c14b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c0b5de0 0x7f756c14b210 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f755c01cb00 tx=0x7f755c01aaa0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 shutdown_connections 2024-09-12T12:25:12.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f75480678f0 0x7f7548069db0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f756c15cd30 0x7f756c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f756c15c7b0 0x7f756c1540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 --2- 172.21.15.144:0/1310850064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f756c0b5de0 0x7f756c14b210 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 >> 172.21.15.144:0/1310850064 conn(0x7f756c06d0d0 msgr2=0x7f756c0aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:12.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 shutdown_connections 2024-09-12T12:25:12.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.171+0000 7f7571200640 1 -- 172.21.15.144:0/1310850064 wait complete. 2024-09-12T12:25:12.193 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":561,"stamp":"2024-09-12T12:25:11.535957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":459500,"kb_used_data":19812,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754515220,"statfs":{"total":773094113280,"available":772623585280,"internally_reserved":0,"allocated":20287488,"data_stored":10192144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.842779"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017378+0000","last_change":"2024-09-12T12:25:07.731469+0000","last_active":"2024-09-12T12:25:09.017378+0000","last_peered":"2024-09-12T12:25:09.017378+0000","last_clean":"2024-09-12T12:25:09.017378+0000","last_became_active":"2024-09-12T12:25:07.731175+0000","last_became_peered":"2024-09-12T12:25:07.731175+0000","last_unstale":"2024-09-12T12:25:09.017378+0000","last_undegraded":"2024-09-12T12:25:09.017378+0000","last_fullsized":"2024-09-12T12:25:09.017378+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:24.358166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.018006+0000","last_change":"2024-09-12T12:25:07.734870+0000","last_active":"2024-09-12T12:25:09.018006+0000","last_peered":"2024-09-12T12:25:09.018006+0000","last_clean":"2024-09-12T12:25:09.018006+0000","last_became_active":"2024-09-12T12:25:07.734584+0000","last_became_peered":"2024-09-12T12:25:07.734584+0000","last_unstale":"2024-09-12T12:25:09.018006+0000","last_undegraded":"2024-09-12T12:25:09.018006+0000","last_fullsized":"2024-09-12T12:25:09.018006+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:18.194215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715182+0000","last_change":"2024-09-12T12:25:07.725652+0000","last_active":"2024-09-12T12:25:08.715182+0000","last_peered":"2024-09-12T12:25:08.715182+0000","last_clean":"2024-09-12T12:25:08.715182+0000","last_became_active":"2024-09-12T12:25:07.725356+0000","last_became_peered":"2024-09-12T12:25:07.725356+0000","last_unstale":"2024-09-12T12:25:08.715182+0000","last_undegraded":"2024-09-12T12:25:08.715182+0000","last_fullsized":"2024-09-12T12:25:08.715182+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:51.157775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017120+0000","last_change":"2024-09-12T12:25:07.742087+0000","last_active":"2024-09-12T12:25:09.017120+0000","last_peered":"2024-09-12T12:25:09.017120+0000","last_clean":"2024-09-12T12:25:09.017120+0000","last_became_active":"2024-09-12T12:25:07.741757+0000","last_became_peered":"2024-09-12T12:25:07.741757+0000","last_unstale":"2024-09-12T12:25:09.017120+0000","last_undegraded":"2024-09-12T12:25:09.017120+0000","last_fullsized":"2024-09-12T12:25:09.017120+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:36.959459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017018+0000","last_change":"2024-09-12T12:25:07.731526+0000","last_active":"2024-09-12T12:25:09.017018+0000","last_peered":"2024-09-12T12:25:09.017018+0000","last_clean":"2024-09-12T12:25:09.017018+0000","last_became_active":"2024-09-12T12:25:07.731248+0000","last_became_peered":"2024-09-12T12:25:07.731248+0000","last_unstale":"2024-09-12T12:25:09.017018+0000","last_undegraded":"2024-09-12T12:25:09.017018+0000","last_fullsized":"2024-09-12T12:25:09.017018+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:40.802535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016974+0000","last_change":"2024-09-12T12:25:07.729554+0000","last_active":"2024-09-12T12:25:09.016974+0000","last_peered":"2024-09-12T12:25:09.016974+0000","last_clean":"2024-09-12T12:25:09.016974+0000","last_became_active":"2024-09-12T12:25:07.729261+0000","last_became_peered":"2024-09-12T12:25:07.729261+0000","last_unstale":"2024-09-12T12:25:09.016974+0000","last_undegraded":"2024-09-12T12:25:09.016974+0000","last_fullsized":"2024-09-12T12:25:09.016974+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:25.939306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016302+0000","last_change":"2024-09-12T12:25:07.736393+0000","last_active":"2024-09-12T12:25:09.016302+0000","last_peered":"2024-09-12T12:25:09.016302+0000","last_clean":"2024-09-12T12:25:09.016302+0000","last_became_active":"2024-09-12T12:25:07.734445+0000","last_became_peered":"2024-09-12T12:25:07.734445+0000","last_unstale":"2024-09-12T12:25:09.016302+0000","last_undegraded":"2024-09-12T12:25:09.016302+0000","last_fullsized":"2024-09-12T12:25:09.016302+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:10.457747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.714680+0000","last_change":"2024-09-12T12:25:07.728295+0000","last_active":"2024-09-12T12:25:08.714680+0000","last_peered":"2024-09-12T12:25:08.714680+0000","last_clean":"2024-09-12T12:25:08.714680+0000","last_became_active":"2024-09-12T12:25:07.728033+0000","last_became_peered":"2024-09-12T12:25:07.728033+0000","last_unstale":"2024-09-12T12:25:08.714680+0000","last_undegraded":"2024-09-12T12:25:08.714680+0000","last_fullsized":"2024-09-12T12:25:08.714680+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:43.562365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017651+0000","last_change":"2024-09-12T12:25:07.736565+0000","last_active":"2024-09-12T12:25:09.017651+0000","last_peered":"2024-09-12T12:25:09.017651+0000","last_clean":"2024-09-12T12:25:09.017651+0000","last_became_active":"2024-09-12T12:25:07.734126+0000","last_became_peered":"2024-09-12T12:25:07.734126+0000","last_unstale":"2024-09-12T12:25:09.017651+0000","last_undegraded":"2024-09-12T12:25:09.017651+0000","last_fullsized":"2024-09-12T12:25:09.017651+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:20:21.950955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715735+0000","last_change":"2024-09-12T12:25:07.732399+0000","last_active":"2024-09-12T12:25:08.715735+0000","last_peered":"2024-09-12T12:25:08.715735+0000","last_clean":"2024-09-12T12:25:08.715735+0000","last_became_active":"2024-09-12T12:25:07.730694+0000","last_became_peered":"2024-09-12T12:25:07.730694+0000","last_unstale":"2024-09-12T12:25:08.715735+0000","last_undegraded":"2024-09-12T12:25:08.715735+0000","last_fullsized":"2024-09-12T12:25:08.715735+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:50.839483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715268+0000","last_change":"2024-09-12T12:25:07.742987+0000","last_active":"2024-09-12T12:25:08.715268+0000","last_peered":"2024-09-12T12:25:08.715268+0000","last_clean":"2024-09-12T12:25:08.715268+0000","last_became_active":"2024-09-12T12:25:07.742688+0000","last_became_peered":"2024-09-12T12:25:07.742688+0000","last_unstale":"2024-09-12T12:25:08.715268+0000","last_undegraded":"2024-09-12T12:25:08.715268+0000","last_fullsized":"2024-09-12T12:25:08.715268+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:37.555349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017093+0000","last_change":"2024-09-12T12:25:07.723735+0000","last_active":"2024-09-12T12:25:09.017093+0000","last_peered":"2024-09-12T12:25:09.017093+0000","last_clean":"2024-09-12T12:25:09.017093+0000","last_became_active":"2024-09-12T12:25:07.722857+0000","last_became_peered":"2024-09-12T12:25:07.722857+0000","last_unstale":"2024-09-12T12:25:09.017093+0000","last_undegraded":"2024-09-12T12:25:09.017093+0000","last_fullsized":"2024-09-12T12:25:09.017093+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:15.547722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017176+0000","last_change":"2024-09-12T12:25:07.736959+0000","last_active":"2024-09-12T12:25:09.017176+0000","last_peered":"2024-09-12T12:25:09.017176+0000","last_clean":"2024-09-12T12:25:09.017176+0000","last_became_active":"2024-09-12T12:25:07.736663+0000","last_became_peered":"2024-09-12T12:25:07.736663+0000","last_unstale":"2024-09-12T12:25:09.017176+0000","last_undegraded":"2024-09-12T12:25:09.017176+0000","last_fullsized":"2024-09-12T12:25:09.017176+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:51.052817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715107+0000","last_change":"2024-09-12T12:25:07.727276+0000","last_active":"2024-09-12T12:25:08.715107+0000","last_peered":"2024-09-12T12:25:08.715107+0000","last_clean":"2024-09-12T12:25:08.715107+0000","last_became_active":"2024-09-12T12:25:07.726769+0000","last_became_peered":"2024-09-12T12:25:07.726769+0000","last_unstale":"2024-09-12T12:25:08.715107+0000","last_undegraded":"2024-09-12T12:25:08.715107+0000","last_fullsized":"2024-09-12T12:25:08.715107+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:17.673177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715314+0000","last_change":"2024-09-12T12:25:07.741606+0000","last_active":"2024-09-12T12:25:08.715314+0000","last_peered":"2024-09-12T12:25:08.715314+0000","last_clean":"2024-09-12T12:25:08.715314+0000","last_became_active":"2024-09-12T12:25:07.741296+0000","last_became_peered":"2024-09-12T12:25:07.741296+0000","last_unstale":"2024-09-12T12:25:08.715314+0000","last_undegraded":"2024-09-12T12:25:08.715314+0000","last_fullsized":"2024-09-12T12:25:08.715314+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:11.172202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715057+0000","last_change":"2024-09-12T12:25:07.726146+0000","last_active":"2024-09-12T12:25:08.715057+0000","last_peered":"2024-09-12T12:25:08.715057+0000","last_clean":"2024-09-12T12:25:08.715057+0000","last_became_active":"2024-09-12T12:25:07.725835+0000","last_became_peered":"2024-09-12T12:25:07.725835+0000","last_unstale":"2024-09-12T12:25:08.715057+0000","last_undegraded":"2024-09-12T12:25:08.715057+0000","last_fullsized":"2024-09-12T12:25:08.715057+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:24.811576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017799+0000","last_change":"2024-09-12T12:25:07.731263+0000","last_active":"2024-09-12T12:25:09.017799+0000","last_peered":"2024-09-12T12:25:09.017799+0000","last_clean":"2024-09-12T12:25:09.017799+0000","last_became_active":"2024-09-12T12:25:07.730800+0000","last_became_peered":"2024-09-12T12:25:07.730800+0000","last_unstale":"2024-09-12T12:25:09.017799+0000","last_undegraded":"2024-09-12T12:25:09.017799+0000","last_fullsized":"2024-09-12T12:25:09.017799+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:49.099237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017611+0000","last_change":"2024-09-12T12:25:07.727965+0000","last_active":"2024-09-12T12:25:09.017611+0000","last_peered":"2024-09-12T12:25:09.017611+0000","last_clean":"2024-09-12T12:25:09.017611+0000","last_became_active":"2024-09-12T12:25:07.727675+0000","last_became_peered":"2024-09-12T12:25:07.727675+0000","last_unstale":"2024-09-12T12:25:09.017611+0000","last_undegraded":"2024-09-12T12:25:09.017611+0000","last_fullsized":"2024-09-12T12:25:09.017611+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:13.089617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715788+0000","last_change":"2024-09-12T12:25:07.729665+0000","last_active":"2024-09-12T12:25:08.715788+0000","last_peered":"2024-09-12T12:25:08.715788+0000","last_clean":"2024-09-12T12:25:08.715788+0000","last_became_active":"2024-09-12T12:25:07.726455+0000","last_became_peered":"2024-09-12T12:25:07.726455+0000","last_unstale":"2024-09-12T12:25:08.715788+0000","last_undegraded":"2024-09-12T12:25:08.715788+0000","last_fullsized":"2024-09-12T12:25:08.715788+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:44.807274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715445+0000","last_change":"2024-09-12T12:25:07.740739+0000","last_active":"2024-09-12T12:25:08.715445+0000","last_peered":"2024-09-12T12:25:08.715445+0000","last_clean":"2024-09-12T12:25:08.715445+0000","last_became_active":"2024-09-12T12:25:07.740408+0000","last_became_peered":"2024-09-12T12:25:07.740408+0000","last_unstale":"2024-09-12T12:25:08.715445+0000","last_undegraded":"2024-09-12T12:25:08.715445+0000","last_fullsized":"2024-09-12T12:25:08.715445+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:49.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715297+0000","last_change":"2024-09-12T12:25:07.730373+0000","last_active":"2024-09-12T12:25:08.715297+0000","last_peered":"2024-09-12T12:25:08.715297+0000","last_clean":"2024-09-12T12:25:08.715297+0000","last_became_active":"2024-09-12T12:25:07.730060+0000","last_became_peered":"2024-09-12T12:25:07.730060+0000","last_unstale":"2024-09-12T12:25:08.715297+0000","last_undegraded":"2024-09-12T12:25:08.715297+0000","last_fullsized":"2024-09-12T12:25:08.715297+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:11.172202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715452+0000","last_change":"2024-09-12T12:25:07.727374+0000","last_active":"2024-09-12T12:25:08.715452+0000","last_peered":"2024-09-12T12:25:08.715452+0000","last_clean":"2024-09-12T12:25:08.715452+0000","last_became_active":"2024-09-12T12:25:07.727073+0000","last_became_peered":"2024-09-12T12:25:07.727073+0000","last_unstale":"2024-09-12T12:25:08.715452+0000","last_undegraded":"2024-09-12T12:25:08.715452+0000","last_fullsized":"2024-09-12T12:25:08.715452+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:40.186650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016857+0000","last_change":"2024-09-12T12:25:07.719338+0000","last_active":"2024-09-12T12:25:09.016857+0000","last_peered":"2024-09-12T12:25:09.016857+0000","last_clean":"2024-09-12T12:25:09.016857+0000","last_became_active":"2024-09-12T12:25:07.718974+0000","last_became_peered":"2024-09-12T12:25:07.718974+0000","last_unstale":"2024-09-12T12:25:09.016857+0000","last_undegraded":"2024-09-12T12:25:09.016857+0000","last_fullsized":"2024-09-12T12:25:09.016857+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:45:00.395280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016222+0000","last_change":"2024-09-12T12:25:07.726490+0000","last_active":"2024-09-12T12:25:09.016222+0000","last_peered":"2024-09-12T12:25:09.016222+0000","last_clean":"2024-09-12T12:25:09.016222+0000","last_became_active":"2024-09-12T12:25:07.724689+0000","last_became_peered":"2024-09-12T12:25:07.724689+0000","last_unstale":"2024-09-12T12:25:09.016222+0000","last_undegraded":"2024-09-12T12:25:09.016222+0000","last_fullsized":"2024-09-12T12:25:09.016222+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:25.234325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017925+0000","last_change":"2024-09-12T12:25:07.727122+0000","last_active":"2024-09-12T12:25:09.017925+0000","last_peered":"2024-09-12T12:25:09.017925+0000","last_clean":"2024-09-12T12:25:09.017925+0000","last_became_active":"2024-09-12T12:25:07.726842+0000","last_became_peered":"2024-09-12T12:25:07.726842+0000","last_unstale":"2024-09-12T12:25:09.017925+0000","last_undegraded":"2024-09-12T12:25:09.017925+0000","last_fullsized":"2024-09-12T12:25:09.017925+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:09.964668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017866+0000","last_change":"2024-09-12T12:25:07.720666+0000","last_active":"2024-09-12T12:25:09.017866+0000","last_peered":"2024-09-12T12:25:09.017866+0000","last_clean":"2024-09-12T12:25:09.017866+0000","last_became_active":"2024-09-12T12:25:07.720334+0000","last_became_peered":"2024-09-12T12:25:07.720334+0000","last_unstale":"2024-09-12T12:25:09.017866+0000","last_undegraded":"2024-09-12T12:25:09.017866+0000","last_fullsized":"2024-09-12T12:25:09.017866+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:03.854860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715351+0000","last_change":"2024-09-12T12:25:07.741853+0000","last_active":"2024-09-12T12:25:08.715351+0000","last_peered":"2024-09-12T12:25:08.715351+0000","last_clean":"2024-09-12T12:25:08.715351+0000","last_became_active":"2024-09-12T12:25:07.740987+0000","last_became_peered":"2024-09-12T12:25:07.740987+0000","last_unstale":"2024-09-12T12:25:08.715351+0000","last_undegraded":"2024-09-12T12:25:08.715351+0000","last_fullsized":"2024-09-12T12:25:08.715351+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:33.839985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017427+0000","last_change":"2024-09-12T12:25:07.735839+0000","last_active":"2024-09-12T12:25:09.017427+0000","last_peered":"2024-09-12T12:25:09.017427+0000","last_clean":"2024-09-12T12:25:09.017427+0000","last_became_active":"2024-09-12T12:25:07.735582+0000","last_became_peered":"2024-09-12T12:25:07.735582+0000","last_unstale":"2024-09-12T12:25:09.017427+0000","last_undegraded":"2024-09-12T12:25:09.017427+0000","last_fullsized":"2024-09-12T12:25:09.017427+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:24.410159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017156+0000","last_change":"2024-09-12T12:25:07.735144+0000","last_active":"2024-09-12T12:25:09.017156+0000","last_peered":"2024-09-12T12:25:09.017156+0000","last_clean":"2024-09-12T12:25:09.017156+0000","last_became_active":"2024-09-12T12:25:07.734882+0000","last_became_peered":"2024-09-12T12:25:07.734882+0000","last_unstale":"2024-09-12T12:25:09.017156+0000","last_undegraded":"2024-09-12T12:25:09.017156+0000","last_fullsized":"2024-09-12T12:25:09.017156+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:16:37.484882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715483+0000","last_change":"2024-09-12T12:25:07.737180+0000","last_active":"2024-09-12T12:25:08.715483+0000","last_peered":"2024-09-12T12:25:08.715483+0000","last_clean":"2024-09-12T12:25:08.715483+0000","last_became_active":"2024-09-12T12:25:07.736892+0000","last_became_peered":"2024-09-12T12:25:07.736892+0000","last_unstale":"2024-09-12T12:25:08.715483+0000","last_undegraded":"2024-09-12T12:25:08.715483+0000","last_fullsized":"2024-09-12T12:25:08.715483+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:12.709355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017029+0000","last_change":"2024-09-12T12:25:07.738472+0000","last_active":"2024-09-12T12:25:09.017029+0000","last_peered":"2024-09-12T12:25:09.017029+0000","last_clean":"2024-09-12T12:25:09.017029+0000","last_became_active":"2024-09-12T12:25:07.733597+0000","last_became_peered":"2024-09-12T12:25:07.733597+0000","last_unstale":"2024-09-12T12:25:09.017029+0000","last_undegraded":"2024-09-12T12:25:09.017029+0000","last_fullsized":"2024-09-12T12:25:09.017029+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:21.932442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016664+0000","last_change":"2024-09-12T12:25:07.735052+0000","last_active":"2024-09-12T12:25:09.016664+0000","last_peered":"2024-09-12T12:25:09.016664+0000","last_clean":"2024-09-12T12:25:09.016664+0000","last_became_active":"2024-09-12T12:25:07.734774+0000","last_became_peered":"2024-09-12T12:25:07.734774+0000","last_unstale":"2024-09-12T12:25:09.016664+0000","last_undegraded":"2024-09-12T12:25:09.016664+0000","last_fullsized":"2024-09-12T12:25:09.016664+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:03.854860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016969+0000","last_change":"2024-09-12T12:25:07.717568+0000","last_active":"2024-09-12T12:25:09.016969+0000","last_peered":"2024-09-12T12:25:09.016969+0000","last_clean":"2024-09-12T12:25:09.016969+0000","last_became_active":"2024-09-12T12:25:07.716807+0000","last_became_peered":"2024-09-12T12:25:07.716807+0000","last_unstale":"2024-09-12T12:25:09.016969+0000","last_undegraded":"2024-09-12T12:25:09.016969+0000","last_fullsized":"2024-09-12T12:25:09.016969+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:52.438833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"188'4","reported_seq":18,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.716149+0000","last_change":"2024-09-12T12:25:06.719418+0000","last_active":"2024-09-12T12:25:08.716149+0000","last_peered":"2024-09-12T12:25:08.716149+0000","last_clean":"2024-09-12T12:25:08.716149+0000","last_became_active":"2024-09-12T12:25:06.716789+0000","last_became_peered":"2024-09-12T12:25:06.716789+0000","last_unstale":"2024-09-12T12:25:08.716149+0000","last_undegraded":"2024-09-12T12:25:08.716149+0000","last_fullsized":"2024-09-12T12:25:08.716149+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:38.789346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017164+0000","last_change":"2024-09-12T12:25:07.735017+0000","last_active":"2024-09-12T12:25:09.017164+0000","last_peered":"2024-09-12T12:25:09.017164+0000","last_clean":"2024-09-12T12:25:09.017164+0000","last_became_active":"2024-09-12T12:25:07.734667+0000","last_became_peered":"2024-09-12T12:25:07.734667+0000","last_unstale":"2024-09-12T12:25:09.017164+0000","last_undegraded":"2024-09-12T12:25:09.017164+0000","last_fullsized":"2024-09-12T12:25:09.017164+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:01.160148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017405+0000","last_change":"2024-09-12T12:25:06.720063+0000","last_active":"2024-09-12T12:25:09.017405+0000","last_peered":"2024-09-12T12:25:09.017405+0000","last_clean":"2024-09-12T12:25:09.017405+0000","last_became_active":"2024-09-12T12:25:06.719767+0000","last_became_peered":"2024-09-12T12:25:06.719767+0000","last_unstale":"2024-09-12T12:25:09.017405+0000","last_undegraded":"2024-09-12T12:25:09.017405+0000","last_fullsized":"2024-09-12T12:25:09.017405+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:24.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715365+0000","last_change":"2024-09-12T12:25:07.725707+0000","last_active":"2024-09-12T12:25:08.715365+0000","last_peered":"2024-09-12T12:25:08.715365+0000","last_clean":"2024-09-12T12:25:08.715365+0000","last_became_active":"2024-09-12T12:25:07.723886+0000","last_became_peered":"2024-09-12T12:25:07.723886+0000","last_unstale":"2024-09-12T12:25:08.715365+0000","last_undegraded":"2024-09-12T12:25:08.715365+0000","last_fullsized":"2024-09-12T12:25:08.715365+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:12.709355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017903+0000","last_change":"2024-09-12T12:25:06.714216+0000","last_active":"2024-09-12T12:25:09.017903+0000","last_peered":"2024-09-12T12:25:09.017903+0000","last_clean":"2024-09-12T12:25:09.017903+0000","last_became_active":"2024-09-12T12:25:06.713926+0000","last_became_peered":"2024-09-12T12:25:06.713926+0000","last_unstale":"2024-09-12T12:25:09.017903+0000","last_undegraded":"2024-09-12T12:25:09.017903+0000","last_fullsized":"2024-09-12T12:25:09.017903+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:20:20.943980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016615+0000","last_change":"2024-09-12T12:25:07.727645+0000","last_active":"2024-09-12T12:25:09.016615+0000","last_peered":"2024-09-12T12:25:09.016615+0000","last_clean":"2024-09-12T12:25:09.016615+0000","last_became_active":"2024-09-12T12:25:07.724909+0000","last_became_peered":"2024-09-12T12:25:07.724909+0000","last_unstale":"2024-09-12T12:25:09.016615+0000","last_undegraded":"2024-09-12T12:25:09.016615+0000","last_fullsized":"2024-09-12T12:25:09.016615+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:37.202650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017261+0000","last_change":"2024-09-12T12:25:06.722394+0000","last_active":"2024-09-12T12:25:09.017261+0000","last_peered":"2024-09-12T12:25:09.017261+0000","last_clean":"2024-09-12T12:25:09.017261+0000","last_became_active":"2024-09-12T12:25:06.722128+0000","last_became_peered":"2024-09-12T12:25:06.722128+0000","last_unstale":"2024-09-12T12:25:09.017261+0000","last_undegraded":"2024-09-12T12:25:09.017261+0000","last_fullsized":"2024-09-12T12:25:09.017261+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:39.496134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715999+0000","last_change":"2024-09-12T12:25:07.735821+0000","last_active":"2024-09-12T12:25:08.715999+0000","last_peered":"2024-09-12T12:25:08.715999+0000","last_clean":"2024-09-12T12:25:08.715999+0000","last_became_active":"2024-09-12T12:25:07.735558+0000","last_became_peered":"2024-09-12T12:25:07.735558+0000","last_unstale":"2024-09-12T12:25:08.715999+0000","last_undegraded":"2024-09-12T12:25:08.715999+0000","last_fullsized":"2024-09-12T12:25:08.715999+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:05:11.121013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017239+0000","last_change":"2024-09-12T12:25:06.725614+0000","last_active":"2024-09-12T12:25:09.017239+0000","last_peered":"2024-09-12T12:25:09.017239+0000","last_clean":"2024-09-12T12:25:09.017239+0000","last_became_active":"2024-09-12T12:25:06.725339+0000","last_became_peered":"2024-09-12T12:25:06.725339+0000","last_unstale":"2024-09-12T12:25:09.017239+0000","last_undegraded":"2024-09-12T12:25:09.017239+0000","last_fullsized":"2024-09-12T12:25:09.017239+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:37:56.284737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.716087+0000","last_change":"2024-09-12T12:25:07.736293+0000","last_active":"2024-09-12T12:25:08.716087+0000","last_peered":"2024-09-12T12:25:08.716087+0000","last_clean":"2024-09-12T12:25:08.716087+0000","last_became_active":"2024-09-12T12:25:07.736035+0000","last_became_peered":"2024-09-12T12:25:07.736035+0000","last_unstale":"2024-09-12T12:25:08.716087+0000","last_undegraded":"2024-09-12T12:25:08.716087+0000","last_fullsized":"2024-09-12T12:25:08.716087+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:49.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017011+0000","last_change":"2024-09-12T12:25:06.726121+0000","last_active":"2024-09-12T12:25:09.017011+0000","last_peered":"2024-09-12T12:25:09.017011+0000","last_clean":"2024-09-12T12:25:09.017011+0000","last_became_active":"2024-09-12T12:25:06.725712+0000","last_became_peered":"2024-09-12T12:25:06.725712+0000","last_unstale":"2024-09-12T12:25:09.017011+0000","last_undegraded":"2024-09-12T12:25:09.017011+0000","last_fullsized":"2024-09-12T12:25:09.017011+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:26.281401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017984+0000","last_change":"2024-09-12T12:25:07.731386+0000","last_active":"2024-09-12T12:25:09.017984+0000","last_peered":"2024-09-12T12:25:09.017984+0000","last_clean":"2024-09-12T12:25:09.017984+0000","last_became_active":"2024-09-12T12:25:07.731133+0000","last_became_peered":"2024-09-12T12:25:07.731133+0000","last_unstale":"2024-09-12T12:25:09.017984+0000","last_undegraded":"2024-09-12T12:25:09.017984+0000","last_fullsized":"2024-09-12T12:25:09.017984+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:16.653733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715089+0000","last_change":"2024-09-12T12:25:06.721135+0000","last_active":"2024-09-12T12:25:08.715089+0000","last_peered":"2024-09-12T12:25:08.715089+0000","last_clean":"2024-09-12T12:25:08.715089+0000","last_became_active":"2024-09-12T12:25:06.720798+0000","last_became_peered":"2024-09-12T12:25:06.720798+0000","last_unstale":"2024-09-12T12:25:08.715089+0000","last_undegraded":"2024-09-12T12:25:08.715089+0000","last_fullsized":"2024-09-12T12:25:08.715089+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:26.027059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.714983+0000","last_change":"2024-09-12T12:25:07.730478+0000","last_active":"2024-09-12T12:25:08.714983+0000","last_peered":"2024-09-12T12:25:08.714983+0000","last_clean":"2024-09-12T12:25:08.714983+0000","last_became_active":"2024-09-12T12:25:07.730191+0000","last_became_peered":"2024-09-12T12:25:07.730191+0000","last_unstale":"2024-09-12T12:25:08.714983+0000","last_undegraded":"2024-09-12T12:25:08.714983+0000","last_fullsized":"2024-09-12T12:25:08.714983+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:17.673177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017314+0000","last_change":"2024-09-12T12:25:06.719165+0000","last_active":"2024-09-12T12:25:09.017314+0000","last_peered":"2024-09-12T12:25:09.017314+0000","last_clean":"2024-09-12T12:25:09.017314+0000","last_became_active":"2024-09-12T12:25:06.718846+0000","last_became_peered":"2024-09-12T12:25:06.718846+0000","last_unstale":"2024-09-12T12:25:09.017314+0000","last_undegraded":"2024-09-12T12:25:09.017314+0000","last_fullsized":"2024-09-12T12:25:09.017314+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:25.293826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715007+0000","last_change":"2024-09-12T12:25:07.726048+0000","last_active":"2024-09-12T12:25:08.715007+0000","last_peered":"2024-09-12T12:25:08.715007+0000","last_clean":"2024-09-12T12:25:08.715007+0000","last_became_active":"2024-09-12T12:25:07.725752+0000","last_became_peered":"2024-09-12T12:25:07.725752+0000","last_unstale":"2024-09-12T12:25:08.715007+0000","last_undegraded":"2024-09-12T12:25:08.715007+0000","last_fullsized":"2024-09-12T12:25:08.715007+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:46.677276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017898+0000","last_change":"2024-09-12T12:25:06.727055+0000","last_active":"2024-09-12T12:25:09.017898+0000","last_peered":"2024-09-12T12:25:09.017898+0000","last_clean":"2024-09-12T12:25:09.017898+0000","last_became_active":"2024-09-12T12:25:06.726740+0000","last_became_peered":"2024-09-12T12:25:06.726740+0000","last_unstale":"2024-09-12T12:25:09.017898+0000","last_undegraded":"2024-09-12T12:25:09.017898+0000","last_fullsized":"2024-09-12T12:25:09.017898+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:22.491536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017568+0000","last_change":"2024-09-12T12:25:07.732163+0000","last_active":"2024-09-12T12:25:09.017568+0000","last_peered":"2024-09-12T12:25:09.017568+0000","last_clean":"2024-09-12T12:25:09.017568+0000","last_became_active":"2024-09-12T12:25:07.731898+0000","last_became_peered":"2024-09-12T12:25:07.731898+0000","last_unstale":"2024-09-12T12:25:09.017568+0000","last_undegraded":"2024-09-12T12:25:09.017568+0000","last_fullsized":"2024-09-12T12:25:09.017568+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:34.742428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"188'3","reported_seq":17,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017540+0000","last_change":"2024-09-12T12:25:06.714880+0000","last_active":"2024-09-12T12:25:09.017540+0000","last_peered":"2024-09-12T12:25:09.017540+0000","last_clean":"2024-09-12T12:25:09.017540+0000","last_became_active":"2024-09-12T12:25:06.714609+0000","last_became_peered":"2024-09-12T12:25:06.714609+0000","last_unstale":"2024-09-12T12:25:09.017540+0000","last_undegraded":"2024-09-12T12:25:09.017540+0000","last_fullsized":"2024-09-12T12:25:09.017540+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:04.624637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016755+0000","last_change":"2024-09-12T12:25:07.732122+0000","last_active":"2024-09-12T12:25:09.016755+0000","last_peered":"2024-09-12T12:25:09.016755+0000","last_clean":"2024-09-12T12:25:09.016755+0000","last_became_active":"2024-09-12T12:25:07.731870+0000","last_became_peered":"2024-09-12T12:25:07.731870+0000","last_unstale":"2024-09-12T12:25:09.016755+0000","last_undegraded":"2024-09-12T12:25:09.016755+0000","last_fullsized":"2024-09-12T12:25:09.016755+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:33.684881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"188'6","reported_seq":20,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017245+0000","last_change":"2024-09-12T12:25:06.725137+0000","last_active":"2024-09-12T12:25:09.017245+0000","last_peered":"2024-09-12T12:25:09.017245+0000","last_clean":"2024-09-12T12:25:09.017245+0000","last_became_active":"2024-09-12T12:25:06.724760+0000","last_became_peered":"2024-09-12T12:25:06.724760+0000","last_unstale":"2024-09-12T12:25:09.017245+0000","last_undegraded":"2024-09-12T12:25:09.017245+0000","last_fullsized":"2024-09-12T12:25:09.017245+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:48.965966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017053+0000","last_change":"2024-09-12T12:25:07.719195+0000","last_active":"2024-09-12T12:25:09.017053+0000","last_peered":"2024-09-12T12:25:09.017053+0000","last_clean":"2024-09-12T12:25:09.017053+0000","last_became_active":"2024-09-12T12:25:07.718899+0000","last_became_peered":"2024-09-12T12:25:07.718899+0000","last_unstale":"2024-09-12T12:25:09.017053+0000","last_undegraded":"2024-09-12T12:25:09.017053+0000","last_fullsized":"2024-09-12T12:25:09.017053+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:18.265319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016847+0000","last_change":"2024-09-12T12:25:06.721650+0000","last_active":"2024-09-12T12:25:09.016847+0000","last_peered":"2024-09-12T12:25:09.016847+0000","last_clean":"2024-09-12T12:25:09.016847+0000","last_became_active":"2024-09-12T12:25:06.721352+0000","last_became_peered":"2024-09-12T12:25:06.721352+0000","last_unstale":"2024-09-12T12:25:09.016847+0000","last_undegraded":"2024-09-12T12:25:09.016847+0000","last_fullsized":"2024-09-12T12:25:09.016847+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:16:36.477907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715399+0000","last_change":"2024-09-12T12:25:07.723642+0000","last_active":"2024-09-12T12:25:08.715399+0000","last_peered":"2024-09-12T12:25:08.715399+0000","last_clean":"2024-09-12T12:25:08.715399+0000","last_became_active":"2024-09-12T12:25:07.723332+0000","last_became_peered":"2024-09-12T12:25:07.723332+0000","last_unstale":"2024-09-12T12:25:08.715399+0000","last_undegraded":"2024-09-12T12:25:08.715399+0000","last_fullsized":"2024-09-12T12:25:08.715399+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:41:11.050296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715300+0000","last_change":"2024-09-12T12:25:06.715937+0000","last_active":"2024-09-12T12:25:08.715300+0000","last_peered":"2024-09-12T12:25:08.715300+0000","last_clean":"2024-09-12T12:25:08.715300+0000","last_became_active":"2024-09-12T12:25:06.715658+0000","last_became_peered":"2024-09-12T12:25:06.715658+0000","last_unstale":"2024-09-12T12:25:08.715300+0000","last_undegraded":"2024-09-12T12:25:08.715300+0000","last_fullsized":"2024-09-12T12:25:08.715300+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:23.351191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017699+0000","last_change":"2024-09-12T12:25:07.724639+0000","last_active":"2024-09-12T12:25:09.017699+0000","last_peered":"2024-09-12T12:25:09.017699+0000","last_clean":"2024-09-12T12:25:09.017699+0000","last_became_active":"2024-09-12T12:25:07.724366+0000","last_became_peered":"2024-09-12T12:25:07.724366+0000","last_unstale":"2024-09-12T12:25:09.017699+0000","last_undegraded":"2024-09-12T12:25:09.017699+0000","last_fullsized":"2024-09-12T12:25:09.017699+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:05.606075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016859+0000","last_change":"2024-09-12T12:25:06.723088+0000","last_active":"2024-09-12T12:25:09.016859+0000","last_peered":"2024-09-12T12:25:09.016859+0000","last_clean":"2024-09-12T12:25:09.016859+0000","last_became_active":"2024-09-12T12:25:06.722778+0000","last_became_peered":"2024-09-12T12:25:06.722778+0000","last_unstale":"2024-09-12T12:25:09.016859+0000","last_undegraded":"2024-09-12T12:25:09.016859+0000","last_fullsized":"2024-09-12T12:25:09.016859+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:30.579028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017642+0000","last_change":"2024-09-12T12:25:07.736300+0000","last_active":"2024-09-12T12:25:09.017642+0000","last_peered":"2024-09-12T12:25:09.017642+0000","last_clean":"2024-09-12T12:25:09.017642+0000","last_became_active":"2024-09-12T12:25:07.735980+0000","last_became_peered":"2024-09-12T12:25:07.735980+0000","last_unstale":"2024-09-12T12:25:09.017642+0000","last_undegraded":"2024-09-12T12:25:09.017642+0000","last_fullsized":"2024-09-12T12:25:09.017642+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:43:46.677276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"188'8","reported_seq":22,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016165+0000","last_change":"2024-09-12T12:25:06.720193+0000","last_active":"2024-09-12T12:25:09.016165+0000","last_peered":"2024-09-12T12:25:09.016165+0000","last_clean":"2024-09-12T12:25:09.016165+0000","last_became_active":"2024-09-12T12:25:06.719703+0000","last_became_peered":"2024-09-12T12:25:06.719703+0000","last_unstale":"2024-09-12T12:25:09.016165+0000","last_undegraded":"2024-09-12T12:25:09.016165+0000","last_fullsized":"2024-09-12T12:25:09.016165+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:13:57.334694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.714718+0000","last_change":"2024-09-12T12:25:07.726702+0000","last_active":"2024-09-12T12:25:08.714718+0000","last_peered":"2024-09-12T12:25:08.714718+0000","last_clean":"2024-09-12T12:25:08.714718+0000","last_became_active":"2024-09-12T12:25:07.726065+0000","last_became_peered":"2024-09-12T12:25:07.726065+0000","last_unstale":"2024-09-12T12:25:08.714718+0000","last_undegraded":"2024-09-12T12:25:08.714718+0000","last_fullsized":"2024-09-12T12:25:08.714718+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:02.316182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017393+0000","last_change":"2024-09-12T12:25:06.721638+0000","last_active":"2024-09-12T12:25:09.017393+0000","last_peered":"2024-09-12T12:25:09.017393+0000","last_clean":"2024-09-12T12:25:09.017393+0000","last_became_active":"2024-09-12T12:25:06.721334+0000","last_became_peered":"2024-09-12T12:25:06.721334+0000","last_unstale":"2024-09-12T12:25:09.017393+0000","last_undegraded":"2024-09-12T12:25:09.017393+0000","last_fullsized":"2024-09-12T12:25:09.017393+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:39.179674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017239+0000","last_change":"2024-09-12T12:25:07.720555+0000","last_active":"2024-09-12T12:25:09.017239+0000","last_peered":"2024-09-12T12:25:09.017239+0000","last_clean":"2024-09-12T12:25:09.017239+0000","last_became_active":"2024-09-12T12:25:07.720207+0000","last_became_peered":"2024-09-12T12:25:07.720207+0000","last_unstale":"2024-09-12T12:25:09.017239+0000","last_undegraded":"2024-09-12T12:25:09.017239+0000","last_fullsized":"2024-09-12T12:25:09.017239+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:27.034034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017488+0000","last_change":"2024-09-12T12:25:06.723939+0000","last_active":"2024-09-12T12:25:09.017488+0000","last_peered":"2024-09-12T12:25:09.017488+0000","last_clean":"2024-09-12T12:25:09.017488+0000","last_became_active":"2024-09-12T12:25:06.723654+0000","last_became_peered":"2024-09-12T12:25:06.723654+0000","last_unstale":"2024-09-12T12:25:09.017488+0000","last_undegraded":"2024-09-12T12:25:09.017488+0000","last_fullsized":"2024-09-12T12:25:09.017488+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:49.832508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017088+0000","last_change":"2024-09-12T12:25:07.726391+0000","last_active":"2024-09-12T12:25:09.017088+0000","last_peered":"2024-09-12T12:25:09.017088+0000","last_clean":"2024-09-12T12:25:09.017088+0000","last_became_active":"2024-09-12T12:25:07.726106+0000","last_became_peered":"2024-09-12T12:25:07.726106+0000","last_unstale":"2024-09-12T12:25:09.017088+0000","last_undegraded":"2024-09-12T12:25:09.017088+0000","last_fullsized":"2024-09-12T12:25:09.017088+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:02.412740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017914+0000","last_change":"2024-09-12T12:25:06.720191+0000","last_active":"2024-09-12T12:25:09.017914+0000","last_peered":"2024-09-12T12:25:09.017914+0000","last_clean":"2024-09-12T12:25:09.017914+0000","last_became_active":"2024-09-12T12:25:06.719929+0000","last_became_peered":"2024-09-12T12:25:06.719929+0000","last_unstale":"2024-09-12T12:25:09.017914+0000","last_undegraded":"2024-09-12T12:25:09.017914+0000","last_fullsized":"2024-09-12T12:25:09.017914+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:52:12.082642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715492+0000","last_change":"2024-09-12T12:25:07.725042+0000","last_active":"2024-09-12T12:25:08.715492+0000","last_peered":"2024-09-12T12:25:08.715492+0000","last_clean":"2024-09-12T12:25:08.715492+0000","last_became_active":"2024-09-12T12:25:07.724765+0000","last_became_peered":"2024-09-12T12:25:07.724765+0000","last_unstale":"2024-09-12T12:25:08.715492+0000","last_undegraded":"2024-09-12T12:25:08.715492+0000","last_fullsized":"2024-09-12T12:25:08.715492+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:39:25.157472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017289+0000","last_change":"2024-09-12T12:25:06.722276+0000","last_active":"2024-09-12T12:25:09.017289+0000","last_peered":"2024-09-12T12:25:09.017289+0000","last_clean":"2024-09-12T12:25:09.017289+0000","last_became_active":"2024-09-12T12:25:06.722003+0000","last_became_peered":"2024-09-12T12:25:06.722003+0000","last_unstale":"2024-09-12T12:25:09.017289+0000","last_undegraded":"2024-09-12T12:25:09.017289+0000","last_fullsized":"2024-09-12T12:25:09.017289+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:19.293174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017745+0000","last_change":"2024-09-12T12:25:07.726314+0000","last_active":"2024-09-12T12:25:09.017745+0000","last_peered":"2024-09-12T12:25:09.017745+0000","last_clean":"2024-09-12T12:25:09.017745+0000","last_became_active":"2024-09-12T12:25:07.726048+0000","last_became_peered":"2024-09-12T12:25:07.726048+0000","last_unstale":"2024-09-12T12:25:09.017745+0000","last_undegraded":"2024-09-12T12:25:09.017745+0000","last_fullsized":"2024-09-12T12:25:09.017745+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:02.291353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017115+0000","last_change":"2024-09-12T12:25:06.715836+0000","last_active":"2024-09-12T12:25:09.017115+0000","last_peered":"2024-09-12T12:25:09.017115+0000","last_clean":"2024-09-12T12:25:09.017115+0000","last_became_active":"2024-09-12T12:25:06.715561+0000","last_became_peered":"2024-09-12T12:25:06.715561+0000","last_unstale":"2024-09-12T12:25:09.017115+0000","last_undegraded":"2024-09-12T12:25:09.017115+0000","last_fullsized":"2024-09-12T12:25:09.017115+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:04.281500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017472+0000","last_change":"2024-09-12T12:25:07.738556+0000","last_active":"2024-09-12T12:25:09.017472+0000","last_peered":"2024-09-12T12:25:09.017472+0000","last_clean":"2024-09-12T12:25:09.017472+0000","last_became_active":"2024-09-12T12:25:07.738287+0000","last_became_peered":"2024-09-12T12:25:07.738287+0000","last_unstale":"2024-09-12T12:25:09.017472+0000","last_undegraded":"2024-09-12T12:25:09.017472+0000","last_fullsized":"2024-09-12T12:25:09.017472+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:43.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016804+0000","last_change":"2024-09-12T12:25:06.716991+0000","last_active":"2024-09-12T12:25:09.016804+0000","last_peered":"2024-09-12T12:25:09.016804+0000","last_clean":"2024-09-12T12:25:09.016804+0000","last_became_active":"2024-09-12T12:25:06.716729+0000","last_became_peered":"2024-09-12T12:25:06.716729+0000","last_unstale":"2024-09-12T12:25:09.016804+0000","last_undegraded":"2024-09-12T12:25:09.016804+0000","last_fullsized":"2024-09-12T12:25:09.016804+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:33.735453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017760+0000","last_change":"2024-09-12T12:25:07.729502+0000","last_active":"2024-09-12T12:25:09.017760+0000","last_peered":"2024-09-12T12:25:09.017760+0000","last_clean":"2024-09-12T12:25:09.017760+0000","last_became_active":"2024-09-12T12:25:07.729199+0000","last_became_peered":"2024-09-12T12:25:07.729199+0000","last_unstale":"2024-09-12T12:25:09.017760+0000","last_undegraded":"2024-09-12T12:25:09.017760+0000","last_fullsized":"2024-09-12T12:25:09.017760+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:35.638801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715516+0000","last_change":"2024-09-12T12:25:06.714767+0000","last_active":"2024-09-12T12:25:08.715516+0000","last_peered":"2024-09-12T12:25:08.715516+0000","last_clean":"2024-09-12T12:25:08.715516+0000","last_became_active":"2024-09-12T12:25:06.714271+0000","last_became_peered":"2024-09-12T12:25:06.714271+0000","last_unstale":"2024-09-12T12:25:08.715516+0000","last_undegraded":"2024-09-12T12:25:08.715516+0000","last_fullsized":"2024-09-12T12:25:08.715516+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:07.265887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.716204+0000","last_change":"2024-09-12T12:25:07.736299+0000","last_active":"2024-09-12T12:25:08.716204+0000","last_peered":"2024-09-12T12:25:08.716204+0000","last_clean":"2024-09-12T12:25:08.716204+0000","last_became_active":"2024-09-12T12:25:07.736011+0000","last_became_peered":"2024-09-12T12:25:07.736011+0000","last_unstale":"2024-09-12T12:25:08.716204+0000","last_undegraded":"2024-09-12T12:25:08.716204+0000","last_fullsized":"2024-09-12T12:25:08.716204+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:27.288376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016684+0000","last_change":"2024-09-12T12:25:06.721270+0000","last_active":"2024-09-12T12:25:09.016684+0000","last_peered":"2024-09-12T12:25:09.016684+0000","last_clean":"2024-09-12T12:25:09.016684+0000","last_became_active":"2024-09-12T12:25:06.720943+0000","last_became_peered":"2024-09-12T12:25:06.720943+0000","last_unstale":"2024-09-12T12:25:09.016684+0000","last_undegraded":"2024-09-12T12:25:09.016684+0000","last_fullsized":"2024-09-12T12:25:09.016684+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:05:10.114037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.714843+0000","last_change":"2024-09-12T12:25:07.726690+0000","last_active":"2024-09-12T12:25:08.714843+0000","last_peered":"2024-09-12T12:25:08.714843+0000","last_clean":"2024-09-12T12:25:08.714843+0000","last_became_active":"2024-09-12T12:25:07.726052+0000","last_became_peered":"2024-09-12T12:25:07.726052+0000","last_unstale":"2024-09-12T12:25:08.714843+0000","last_undegraded":"2024-09-12T12:25:08.714843+0000","last_fullsized":"2024-09-12T12:25:08.714843+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:54.990919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"188'2","reported_seq":16,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017984+0000","last_change":"2024-09-12T12:25:06.714825+0000","last_active":"2024-09-12T12:25:09.017984+0000","last_peered":"2024-09-12T12:25:09.017984+0000","last_clean":"2024-09-12T12:25:09.017984+0000","last_became_active":"2024-09-12T12:25:06.714545+0000","last_became_peered":"2024-09-12T12:25:06.714545+0000","last_unstale":"2024-09-12T12:25:09.017984+0000","last_undegraded":"2024-09-12T12:25:09.017984+0000","last_fullsized":"2024-09-12T12:25:09.017984+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:40:19.393496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715012+0000","last_change":"2024-09-12T12:25:07.736232+0000","last_active":"2024-09-12T12:25:08.715012+0000","last_peered":"2024-09-12T12:25:08.715012+0000","last_clean":"2024-09-12T12:25:08.715012+0000","last_became_active":"2024-09-12T12:25:07.735745+0000","last_became_peered":"2024-09-12T12:25:07.735745+0000","last_unstale":"2024-09-12T12:25:08.715012+0000","last_undegraded":"2024-09-12T12:25:08.715012+0000","last_fullsized":"2024-09-12T12:25:08.715012+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:31.537697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"189'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.741569+0000","last_change":"2024-09-12T12:25:06.718378+0000","last_active":"2024-09-12T12:25:08.741569+0000","last_peered":"2024-09-12T12:25:08.741569+0000","last_clean":"2024-09-12T12:25:08.741569+0000","last_became_active":"2024-09-12T12:25:06.717669+0000","last_became_peered":"2024-09-12T12:25:06.717669+0000","last_unstale":"2024-09-12T12:25:08.741569+0000","last_undegraded":"2024-09-12T12:25:08.741569+0000","last_fullsized":"2024-09-12T12:25:08.741569+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:23:30.459493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016757+0000","last_change":"2024-09-12T12:25:07.735405+0000","last_active":"2024-09-12T12:25:09.016757+0000","last_peered":"2024-09-12T12:25:09.016757+0000","last_clean":"2024-09-12T12:25:09.016757+0000","last_became_active":"2024-09-12T12:25:07.734742+0000","last_became_peered":"2024-09-12T12:25:07.734742+0000","last_unstale":"2024-09-12T12:25:09.016757+0000","last_undegraded":"2024-09-12T12:25:09.016757+0000","last_fullsized":"2024-09-12T12:25:09.016757+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:54.969764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.716029+0000","last_change":"2024-09-12T12:25:06.716041+0000","last_active":"2024-09-12T12:25:08.716029+0000","last_peered":"2024-09-12T12:25:08.716029+0000","last_clean":"2024-09-12T12:25:08.716029+0000","last_became_active":"2024-09-12T12:25:06.715775+0000","last_became_peered":"2024-09-12T12:25:06.715775+0000","last_unstale":"2024-09-12T12:25:08.716029+0000","last_undegraded":"2024-09-12T12:25:08.716029+0000","last_fullsized":"2024-09-12T12:25:08.716029+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:08.448163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017554+0000","last_change":"2024-09-12T12:25:07.730566+0000","last_active":"2024-09-12T12:25:09.017554+0000","last_peered":"2024-09-12T12:25:09.017554+0000","last_clean":"2024-09-12T12:25:09.017554+0000","last_became_active":"2024-09-12T12:25:07.730254+0000","last_became_peered":"2024-09-12T12:25:07.730254+0000","last_unstale":"2024-09-12T12:25:09.017554+0000","last_undegraded":"2024-09-12T12:25:09.017554+0000","last_fullsized":"2024-09-12T12:25:09.017554+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:19.169027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016969+0000","last_change":"2024-09-12T12:25:06.719456+0000","last_active":"2024-09-12T12:25:09.016969+0000","last_peered":"2024-09-12T12:25:09.016969+0000","last_clean":"2024-09-12T12:25:09.016969+0000","last_became_active":"2024-09-12T12:25:06.719164+0000","last_became_peered":"2024-09-12T12:25:06.719164+0000","last_unstale":"2024-09-12T12:25:09.016969+0000","last_undegraded":"2024-09-12T12:25:09.016969+0000","last_fullsized":"2024-09-12T12:25:09.016969+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:11.702380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715407+0000","last_change":"2024-09-12T12:25:07.729801+0000","last_active":"2024-09-12T12:25:08.715407+0000","last_peered":"2024-09-12T12:25:08.715407+0000","last_clean":"2024-09-12T12:25:08.715407+0000","last_became_active":"2024-09-12T12:25:07.729435+0000","last_became_peered":"2024-09-12T12:25:07.729435+0000","last_unstale":"2024-09-12T12:25:08.715407+0000","last_undegraded":"2024-09-12T12:25:08.715407+0000","last_fullsized":"2024-09-12T12:25:08.715407+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:05:11.121013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715597+0000","last_change":"2024-09-12T12:25:06.711392+0000","last_active":"2024-09-12T12:25:08.715597+0000","last_peered":"2024-09-12T12:25:08.715597+0000","last_clean":"2024-09-12T12:25:08.715597+0000","last_became_active":"2024-09-12T12:25:06.711092+0000","last_became_peered":"2024-09-12T12:25:06.711092+0000","last_unstale":"2024-09-12T12:25:08.715597+0000","last_undegraded":"2024-09-12T12:25:08.715597+0000","last_fullsized":"2024-09-12T12:25:08.715597+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:31.891547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017591+0000","last_change":"2024-09-12T12:25:07.743823+0000","last_active":"2024-09-12T12:25:09.017591+0000","last_peered":"2024-09-12T12:25:09.017591+0000","last_clean":"2024-09-12T12:25:09.017591+0000","last_became_active":"2024-09-12T12:25:07.743558+0000","last_became_peered":"2024-09-12T12:25:07.743558+0000","last_unstale":"2024-09-12T12:25:09.017591+0000","last_undegraded":"2024-09-12T12:25:09.017591+0000","last_fullsized":"2024-09-12T12:25:09.017591+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:13.830101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017494+0000","last_change":"2024-09-12T12:25:06.723828+0000","last_active":"2024-09-12T12:25:09.017494+0000","last_peered":"2024-09-12T12:25:09.017494+0000","last_clean":"2024-09-12T12:25:09.017494+0000","last_became_active":"2024-09-12T12:25:06.722061+0000","last_became_peered":"2024-09-12T12:25:06.722061+0000","last_unstale":"2024-09-12T12:25:09.017494+0000","last_undegraded":"2024-09-12T12:25:09.017494+0000","last_fullsized":"2024-09-12T12:25:09.017494+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:35.217152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017819+0000","last_change":"2024-09-12T12:25:07.741973+0000","last_active":"2024-09-12T12:25:09.017819+0000","last_peered":"2024-09-12T12:25:09.017819+0000","last_clean":"2024-09-12T12:25:09.017819+0000","last_became_active":"2024-09-12T12:25:07.741685+0000","last_became_peered":"2024-09-12T12:25:07.741685+0000","last_unstale":"2024-09-12T12:25:09.017819+0000","last_undegraded":"2024-09-12T12:25:09.017819+0000","last_fullsized":"2024-09-12T12:25:09.017819+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:31.537697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017414+0000","last_change":"2024-09-12T12:25:06.723146+0000","last_active":"2024-09-12T12:25:09.017414+0000","last_peered":"2024-09-12T12:25:09.017414+0000","last_clean":"2024-09-12T12:25:09.017414+0000","last_became_active":"2024-09-12T12:25:06.722286+0000","last_became_peered":"2024-09-12T12:25:06.722286+0000","last_unstale":"2024-09-12T12:25:09.017414+0000","last_undegraded":"2024-09-12T12:25:09.017414+0000","last_fullsized":"2024-09-12T12:25:09.017414+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:48.366937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:08.715345+0000","last_change":"2024-09-12T12:25:07.733388+0000","last_active":"2024-09-12T12:25:08.715345+0000","last_peered":"2024-09-12T12:25:08.715345+0000","last_clean":"2024-09-12T12:25:08.715345+0000","last_became_active":"2024-09-12T12:25:07.732717+0000","last_became_peered":"2024-09-12T12:25:07.732717+0000","last_unstale":"2024-09-12T12:25:08.715345+0000","last_undegraded":"2024-09-12T12:25:08.715345+0000","last_fullsized":"2024-09-12T12:25:08.715345+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:29.240886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":14,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016269+0000","last_change":"2024-09-12T12:25:06.719966+0000","last_active":"2024-09-12T12:25:09.016269+0000","last_peered":"2024-09-12T12:25:09.016269+0000","last_clean":"2024-09-12T12:25:09.016269+0000","last_became_active":"2024-09-12T12:25:06.719344+0000","last_became_peered":"2024-09-12T12:25:06.719344+0000","last_unstale":"2024-09-12T12:25:09.016269+0000","last_undegraded":"2024-09-12T12:25:09.016269+0000","last_fullsized":"2024-09-12T12:25:09.016269+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:28.574976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":12,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016920+0000","last_change":"2024-09-12T12:25:07.736011+0000","last_active":"2024-09-12T12:25:09.016920+0000","last_peered":"2024-09-12T12:25:09.016920+0000","last_clean":"2024-09-12T12:25:09.016920+0000","last_became_active":"2024-09-12T12:25:07.735734+0000","last_became_peered":"2024-09-12T12:25:07.735734+0000","last_unstale":"2024-09-12T12:25:09.016920+0000","last_undegraded":"2024-09-12T12:25:09.016920+0000","last_fullsized":"2024-09-12T12:25:09.016920+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":187,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:06.691703+0000","last_clean_scrub_stamp":"2024-09-12T12:25:06.691703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:41.355278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"188'1","reported_seq":15,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.017399+0000","last_change":"2024-09-12T12:25:06.716125+0000","last_active":"2024-09-12T12:25:09.017399+0000","last_peered":"2024-09-12T12:25:09.017399+0000","last_clean":"2024-09-12T12:25:09.017399+0000","last_became_active":"2024-09-12T12:25:06.713267+0000","last_became_peered":"2024-09-12T12:25:06.713267+0000","last_unstale":"2024-09-12T12:25:09.017399+0000","last_undegraded":"2024-09-12T12:25:09.017399+0000","last_fullsized":"2024-09-12T12:25:09.017399+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:05.684727+0000","last_clean_scrub_stamp":"2024-09-12T12:25:05.684727+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:28:10.156212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":480,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-12T12:25:09.016657+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:25:09.016657+0000","last_peered":"2024-09-12T12:25:09.016657+0000","last_clean":"2024-09-12T12:25:09.016657+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:25:09.016657+0000","last_undegraded":"2024-09-12T12:25:09.016657+0000","last_fullsized":"2024-09-12T12:25:09.016657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52168,"kb_used_data":2924,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319672,"statfs":{"total":96636764160,"available":96583344128,"internally_reserved":0,"allocated":2994176,"data_stored":1720383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2400256,"data_stored":1130527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575002,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51568,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320272,"statfs":{"total":96636764160,"available":96583958528,"internally_reserved":0,"allocated":2379776,"data_stored":1121697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575002,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59892,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311948,"statfs":{"total":96636764160,"available":96575434752,"internally_reserved":0,"allocated":2387968,"data_stored":1128915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64064,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307776,"statfs":{"total":96636764160,"available":96571162624,"internally_reserved":0,"allocated":2396160,"data_stored":1128459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":63175112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575001,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59876,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311964,"statfs":{"total":96636764160,"available":96575451136,"internally_reserved":0,"allocated":2375680,"data_stored":1121731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59888,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311952,"statfs":{"total":96636764160,"available":96575438848,"internally_reserved":0,"allocated":2383872,"data_stored":1128333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56304,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2969600,"data_stored":1712099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:25:12.198 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:25:12.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:25:12.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d7b800640 1 Processor -- start 2024-09-12T12:25:12.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d7b800640 1 -- start start 2024-09-12T12:25:12.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d7b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 0x7f3d7406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d7b800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3d740b32f0 0x7f3d7415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d7b800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7406da10 con 0x7f3d740b4810 2024-09-12T12:25:12.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d7b800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3d7415bf00 con 0x7f3d740b32f0 2024-09-12T12:25:12.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d7b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d740b38b0 con 0x7f3d7406d0f0 2024-09-12T12:25:12.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d73e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3d740b32f0 0x7f3d7415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d78e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 0x7f3d7406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d73e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3d740b32f0 0x7f3d7415b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33368/0 (socket says 172.21.15.144:33368) 2024-09-12T12:25:12.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.379+0000 7f3d73e00640 1 -- 172.21.15.144:0/680050455 learned_addr learned my addr 172.21.15.144:0/680050455 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:12.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d78e00640 1 -- 172.21.15.144:0/680050455 >> v2:172.21.15.165:3300/0 conn(0x7f3d740b32f0 msgr2=0x7f3d7415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:12.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d78e00640 1 --2- 172.21.15.144:0/680050455 >> v2:172.21.15.165:3300/0 conn(0x7f3d740b32f0 0x7f3d7415b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d78e00640 1 -- 172.21.15.144:0/680050455 >> v1:172.21.15.165:6789/0 conn(0x7f3d740b4810 legacy=0x7f3d740b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d78e00640 1 -- 172.21.15.144:0/680050455 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d740b3b90 con 0x7f3d7406d0f0 2024-09-12T12:25:12.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d73e00640 1 --2- 172.21.15.144:0/680050455 >> v2:172.21.15.165:3300/0 conn(0x7f3d740b32f0 0x7f3d7415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:12.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d78e00640 1 --2- 172.21.15.144:0/680050455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 0x7f3d7406d4d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009d90 tx=0x7f3d6401eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=262f8ecb5fd1d225 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d73400640 1 -- 172.21.15.144:0/680050455 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d640b4070 con 0x7f3d7406d0f0 2024-09-12T12:25:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d73400640 1 -- 172.21.15.144:0/680050455 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d640a7a60 con 0x7f3d7406d0f0 2024-09-12T12:25:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d73400640 1 -- 172.21.15.144:0/680050455 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d640a7e30 con 0x7f3d7406d0f0 2024-09-12T12:25:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d7b800640 1 -- 172.21.15.144:0/680050455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 msgr2=0x7f3d7406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.383+0000 7f3d7b800640 1 --2- 172.21.15.144:0/680050455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 0x7f3d7406d4d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009d90 tx=0x7f3d6401eb90 comp rx=0 tx=0).stop 2024-09-12T12:25:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 -- 172.21.15.144:0/680050455 shutdown_connections 2024-09-12T12:25:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 --2- 172.21.15.144:0/680050455 >> v2:172.21.15.165:3300/0 conn(0x7f3d740b32f0 0x7f3d7415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 --2- 172.21.15.144:0/680050455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 0x7f3d7406d4d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 -- 172.21.15.144:0/680050455 >> 172.21.15.144:0/680050455 conn(0x7f3d74068030 msgr2=0x7f3d740b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:12.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 -- 172.21.15.144:0/680050455 shutdown_connections 2024-09-12T12:25:12.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 -- 172.21.15.144:0/680050455 wait complete. 2024-09-12T12:25:12.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 Processor -- start 2024-09-12T12:25:12.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 -- start start 2024-09-12T12:25:12.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 0x7f3d74154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d740b32f0 0x7f3d7415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d740b4810 0x7f3d7415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d74167750 con 0x7f3d740b32f0 2024-09-12T12:25:12.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d741675d0 con 0x7f3d740b4810 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d741678d0 con 0x7f3d7406d0f0 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d740b32f0 0x7f3d7415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d740b32f0 0x7f3d7415c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59562/0 (socket says 172.21.15.144:59562) 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d73e00640 1 -- 172.21.15.144:0/2869649669 learned_addr learned my addr 172.21.15.144:0/2869649669 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d78e00640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 0x7f3d74154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d79800640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d740b4810 0x7f3d7415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d73e00640 1 -- 172.21.15.144:0/2869649669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 msgr2=0x7f3d74154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d73e00640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 0x7f3d74154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d73e00640 1 -- 172.21.15.144:0/2869649669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d740b4810 msgr2=0x7f3d7415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d73e00640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d740b4810 0x7f3d7415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d73e00640 1 -- 172.21.15.144:0/2869649669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7415a7f0 con 0x7f3d740b32f0 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d73e00640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d740b32f0 0x7f3d7415c4f0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000e9b0 tx=0x7f3d6000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d70c00640 1 -- 172.21.15.144:0/2869649669 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60017070 con 0x7f3d740b32f0 2024-09-12T12:25:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d70c00640 1 -- 172.21.15.144:0/2869649669 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6000c9a0 con 0x7f3d740b32f0 2024-09-12T12:25:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.387+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7415aad0 con 0x7f3d740b32f0 2024-09-12T12:25:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.391+0000 7f3d70c00640 1 -- 172.21.15.144:0/2869649669 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000cd90 con 0x7f3d740b32f0 2024-09-12T12:25:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.391+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7415b090 con 0x7f3d740b32f0 2024-09-12T12:25:12.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.391+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7406d4d0 con 0x7f3d740b32f0 2024-09-12T12:25:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.391+0000 7f3d70c00640 1 -- 172.21.15.144:0/2869649669 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d6001a070 con 0x7f3d740b32f0 2024-09-12T12:25:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.391+0000 7f3d70c00640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d540678c0 0x7f3d54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.391+0000 7f3d70c00640 1 -- 172.21.15.144:0/2869649669 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f3d600860a0 con 0x7f3d740b32f0 2024-09-12T12:25:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.391+0000 7f3d78e00640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d540678c0 0x7f3d54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.395+0000 7f3d78e00640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d540678c0 0x7f3d54069d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3d640b1000 tx=0x7f3d640a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.395+0000 7f3d70c00640 1 -- 172.21.15.144:0/2869649669 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d60056360 con 0x7f3d740b32f0 2024-09-12T12:25:12.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.611+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3d740b4fa0 con 0x7f3d740b32f0 2024-09-12T12:25:12.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.611+0000 7f3d70c00640 1 -- 172.21.15.144:0/2869649669 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7f3d6005a660 con 0x7f3d740b32f0 2024-09-12T12:25:12.613 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:25:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:25:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:25:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:25:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:25:12.614 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:25:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d540678c0 msgr2=0x7f3d54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d540678c0 0x7f3d54069d80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3d640b1000 tx=0x7f3d640a9070 comp rx=0 tx=0).stop 2024-09-12T12:25:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d740b32f0 msgr2=0x7f3d7415c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d740b32f0 0x7f3d7415c4f0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000e9b0 tx=0x7f3d6000ee70 comp rx=0 tx=0).stop 2024-09-12T12:25:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 shutdown_connections 2024-09-12T12:25:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3d540678c0 0x7f3d54069d80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d740b4810 0x7f3d7415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d740b32f0 0x7f3d7415c4f0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 --2- 172.21.15.144:0/2869649669 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d7406d0f0 0x7f3d74154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 >> 172.21.15.144:0/2869649669 conn(0x7f3d74068030 msgr2=0x7f3d740d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:12.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 shutdown_connections 2024-09-12T12:25:12.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.615+0000 7f3d7b800640 1 -- 172.21.15.144:0/2869649669 wait complete. 2024-09-12T12:25:12.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:25:12.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.771+0000 7fe323400640 1 Processor -- start 2024-09-12T12:25:12.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.771+0000 7fe323400640 1 -- start start 2024-09-12T12:25:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe323400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe31c15b4e0 0x7fe31c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe323400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c0b45a0 con 0x7fe31c0b3ad0 2024-09-12T12:25:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe323400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c0b3fe0 con 0x7fe31c0ccf30 2024-09-12T12:25:12.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe323400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe31c0b42c0 con 0x7fe31c15b4e0 2024-09-12T12:25:12.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe313e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe31c0b3ad0 0x7fe31c071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55268/0 (socket says 172.21.15.144:55268) 2024-09-12T12:25:12.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe313e00640 1 -- 172.21.15.144:0/2352293471 learned_addr learned my addr 172.21.15.144:0/2352293471 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe320a00640 1 --2- 172.21.15.144:0/2352293471 >> v2:172.21.15.165:3300/0 conn(0x7fe31c15b4e0 0x7fe31c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1278289194 0 0) 0x7fe31c0b45a0 con 0x7fe31c0b3ad0 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe300003530 con 0x7fe31c0b3ad0 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1159432253 0 0) 0x7fe300003530 con 0x7fe31c0b3ad0 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 >> v2:172.21.15.165:3300/0 conn(0x7fe31c15b4e0 msgr2=0x7fe31c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 --2- 172.21.15.144:0/2352293471 >> v2:172.21.15.165:3300/0 conn(0x7fe31c15b4e0 0x7fe31c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 >> v1:172.21.15.165:6789/0 conn(0x7fe31c0ccf30 legacy=0x7fe31c0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c0b1490 con 0x7fe31c0b3ad0 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fe304001680 con 0x7fe31c0b3ad0 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 >> v1:172.21.15.144:6789/0 conn(0x7fe31c0b3ad0 legacy=0x7fe31c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000039c0 0x7fe300003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe300004810 0x7fe300004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3000051d0 0x7fe30000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0b42c0 con 0x7fe3000051d0 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe30000c070 con 0x7fe300004810 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe30000c270 con 0x7fe3000039c0 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe320a00640 1 --2- 172.21.15.144:0/2352293471 >> v2:172.21.15.165:3300/0 conn(0x7fe31c15b4e0 0x7fe31c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe321400640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3000051d0 0x7fe30000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe313e00640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe300004810 0x7fe300004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe320a00640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000039c0 0x7fe300003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe321400640 1 -- 172.21.15.144:0/2352293471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000039c0 msgr2=0x7fe300003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe321400640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000039c0 0x7fe300003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe321400640 1 -- 172.21.15.144:0/2352293471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe300004810 msgr2=0x7fe300004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe321400640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe300004810 0x7fe300004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe321400640 1 -- 172.21.15.144:0/2352293471 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe300003530 con 0x7fe3000051d0 2024-09-12T12:25:12.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.775+0000 7fe320a00640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000039c0 0x7fe300003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:12.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe321400640 1 -- 172.21.15.144:0/2352293471 reap_dead start 2024-09-12T12:25:12.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe321400640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3000051d0 0x7fe30000b9d0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fe314001e70 tx=0x7fe31401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8af310f68c2ddcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314001a90 con 0x7fe3000051d0 2024-09-12T12:25:12.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe314003bc0 con 0x7fe3000051d0 2024-09-12T12:25:12.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe31be00640 1 -- 172.21.15.144:0/2352293471 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314005020 con 0x7fe3000051d0 2024-09-12T12:25:12.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe323400640 1 -- 172.21.15.144:0/2352293471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3000051d0 msgr2=0x7fe30000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe323400640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3000051d0 0x7fe30000b9d0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fe314001e70 tx=0x7fe31401c780 comp rx=0 tx=0).stop 2024-09-12T12:25:12.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe323400640 1 -- 172.21.15.144:0/2352293471 shutdown_connections 2024-09-12T12:25:12.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe323400640 1 --2- 172.21.15.144:0/2352293471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3000051d0 0x7fe30000b9d0 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe323400640 1 -- 172.21.15.144:0/2352293471 >> 172.21.15.144:0/2352293471 conn(0x7fe31c06d0d0 msgr2=0x7fe31c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:12.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe323400640 1 -- 172.21.15.144:0/2352293471 shutdown_connections 2024-09-12T12:25:12.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe323400640 1 -- 172.21.15.144:0/2352293471 wait complete. 2024-09-12T12:25:12.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.779+0000 7fe323400640 1 Processor -- start 2024-09-12T12:25:12.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 -- start start 2024-09-12T12:25:12.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000051d0 0x7fe31c0ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe31c0cbfa0 0x7fe31c0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c0c8770 0x7fe31c15db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c15b8c0 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c0cdef0 con 0x7fe31c0c8770 2024-09-12T12:25:12.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe31c14ca40 con 0x7fe3000051d0 2024-09-12T12:25:12.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe313e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe31c0cbfa0 0x7fe31c0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe313e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe31c0cbfa0 0x7fe31c0c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59574/0 (socket says 172.21.15.144:59574) 2024-09-12T12:25:12.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe313e00640 1 -- 172.21.15.144:0/106398525 learned_addr learned my addr 172.21.15.144:0/106398525 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:12.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe320a00640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000051d0 0x7fe31c0ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe321400640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c0c8770 0x7fe31c15db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe313e00640 1 -- 172.21.15.144:0/106398525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000051d0 msgr2=0x7fe31c0ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe313e00640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000051d0 0x7fe31c0ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe313e00640 1 -- 172.21.15.144:0/106398525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c0c8770 msgr2=0x7fe31c15db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe313e00640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c0c8770 0x7fe31c15db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe313e00640 1 -- 172.21.15.144:0/106398525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c14cd80 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe313e00640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe31c0cbfa0 0x7fe31c0c8230 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fe304004fb0 tx=0x7fe3040074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe319600640 1 -- 172.21.15.144:0/106398525 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30401a070 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe319600640 1 -- 172.21.15.144:0/106398525 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30400f750 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe319600640 1 -- 172.21.15.144:0/106398525 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30400fb00 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c14d020 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31c14d5e0 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.783+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31c0b3590 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.787+0000 7fe319600640 1 -- 172.21.15.144:0/106398525 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe30401d070 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.787+0000 7fe319600640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2f80678c0 0x7fe2f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:12.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.787+0000 7fe319600640 1 -- 172.21.15.144:0/106398525 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fe304085910 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.787+0000 7fe320a00640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2f80678c0 0x7fe2f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:12.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.787+0000 7fe320a00640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2f80678c0 0x7fe2f8069d80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006f90 tx=0x7fe30c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:12.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.791+0000 7fe319600640 1 -- 172.21.15.144:0/106398525 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe304055bd0 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.979+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe31c0c8b50 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.979+0000 7fe319600640 1 -- 172.21.15.144:0/106398525 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 148 v148) ==== 95+0+5242 (secure 0 0 0) 0x7fe304059ed0 con 0x7fe31c0cbfa0 2024-09-12T12:25:12.981 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:12.981 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":148,"btime":"2024-09-12T12:25:10:737551+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/890330369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":890330369},{"type":"v1","addr":"172.21.15.165:6833","nonce":890330369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":9646,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3806475980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3806475980},{"type":"v1","addr":"172.21.15.165:6835","nonce":3806475980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":10215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/4172702060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4172702060},{"type":"v1","addr":"172.21.15.144:6835","nonce":4172702060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":148,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:25:07.089397+0000","modified":"2024-09-12T12:25:10.115263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10218":{"gid":10218,"name":"c","rank":0,"incarnation":144,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/54351638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":54351638},{"type":"v1","addr":"172.21.15.144:6837","nonce":54351638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10218,"qdb_cluster":[10218]},"id":13}]} 2024-09-12T12:25:12.981 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 148 2024-09-12T12:25:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2f80678c0 msgr2=0x7fe2f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2f80678c0 0x7fe2f8069d80 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006f90 tx=0x7fe30c008040 comp rx=0 tx=0).stop 2024-09-12T12:25:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe31c0cbfa0 msgr2=0x7fe31c0c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe31c0cbfa0 0x7fe31c0c8230 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fe304004fb0 tx=0x7fe3040074f0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 shutdown_connections 2024-09-12T12:25:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe2f80678c0 0x7fe2f8069d80 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe31c0c8770 0x7fe31c15db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe31c0cbfa0 0x7fe31c0c8230 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 --2- 172.21.15.144:0/106398525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3000051d0 0x7fe31c0ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 >> 172.21.15.144:0/106398525 conn(0x7fe31c06d0d0 msgr2=0x7fe31c0ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 shutdown_connections 2024-09-12T12:25:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:12.983+0000 7fe323400640 1 -- 172.21.15.144:0/106398525 wait complete. 2024-09-12T12:25:13.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 148, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:25:07.089397+0000', 'modified': '2024-09-12T12:25:10.115263+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10218}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10218': {'gid': 10218, 'name': 'c', 'rank': 0, 'incarnation': 144, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/54351638', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 54351638}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 54351638}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10218, 'qdb_cluster': [10218]} 2024-09-12T12:25:13.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:25:13.405 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T12:25:13.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4ef000640 1 Processor -- start 2024-09-12T12:25:13.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4ef000640 1 -- start start 2024-09-12T12:25:13.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4ef000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e815c7b0 0x7fa4e80ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4ef000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa4e80b5fb0 0x7fa4e8072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4ef000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4e80cd870 con 0x7fa4e815cd30 2024-09-12T12:25:13.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4ef000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e8072a50 con 0x7fa4e80b5fb0 2024-09-12T12:25:13.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4ef000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e80cde30 con 0x7fa4e815c7b0 2024-09-12T12:25:13.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa4e815cd30 0x7fa4e80b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55276/0 (socket says 172.21.15.144:55276) 2024-09-12T12:25:13.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7400640 1 -- 172.21.15.144:0/28128084 learned_addr learned my addr 172.21.15.144:0/28128084 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:13.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4ed000640 1 --2- 172.21.15.144:0/28128084 >> v2:172.21.15.165:3300/0 conn(0x7fa4e80b5fb0 0x7fa4e8072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793814313 0 0) 0x7fa4e80cd870 con 0x7fa4e815cd30 2024-09-12T12:25:13.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e815c7b0 0x7fa4e80ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4cc003530 con 0x7fa4e815cd30 2024-09-12T12:25:13.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3997469329 0 0) 0x7fa4cc003530 con 0x7fa4e815cd30 2024-09-12T12:25:13.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e815c7b0 msgr2=0x7fa4e80ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e815c7b0 0x7fa4e80ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 >> v2:172.21.15.165:3300/0 conn(0x7fa4e80b5fb0 msgr2=0x7fa4e8072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 --2- 172.21.15.144:0/28128084 >> v2:172.21.15.165:3300/0 conn(0x7fa4e80b5fb0 0x7fa4e8072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e80cdb50 con 0x7fa4e815cd30 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fa4d4001680 con 0x7fa4e815cd30 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 >> v1:172.21.15.144:6789/0 conn(0x7fa4e815cd30 legacy=0x7fa4e80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0039c0 0x7fa4cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e815c7b0 0x7fa4cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4cc004d50 0x7fa4cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8072a50 con 0x7fa4cc0039c0 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e80cde30 con 0x7fa4cc004d50 2024-09-12T12:25:13.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc00b9d0 con 0x7fa4e815c7b0 2024-09-12T12:25:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0039c0 0x7fa4cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4ed000640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4cc004d50 0x7fa4cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7400640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e815c7b0 0x7fa4cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7e00640 1 -- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e815c7b0 msgr2=0x7fa4cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e815c7b0 0x7fa4cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7e00640 1 -- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4cc004d50 msgr2=0x7fa4cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4cc004d50 0x7fa4cc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.547+0000 7fa4e7e00640 1 -- 172.21.15.144:0/28128084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc003530 con 0x7fa4cc0039c0 2024-09-12T12:25:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0039c0 0x7fa4cc003de0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009ae0 tx=0x7fa4d801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184668b10bed30b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d80096b0 con 0x7fa4cc0039c0 2024-09-12T12:25:13.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d80a64a0 con 0x7fa4cc0039c0 2024-09-12T12:25:13.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4e6a00640 1 -- 172.21.15.144:0/28128084 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d80a6890 con 0x7fa4cc0039c0 2024-09-12T12:25:13.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4ef000640 1 -- 172.21.15.144:0/28128084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0039c0 msgr2=0x7fa4cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4ef000640 1 --2- 172.21.15.144:0/28128084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4cc0039c0 0x7fa4cc003de0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009ae0 tx=0x7fa4d801c9b0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4ed000640 1 -- 172.21.15.144:0/28128084 reap_dead start 2024-09-12T12:25:13.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4ef000640 1 -- 172.21.15.144:0/28128084 shutdown_connections 2024-09-12T12:25:13.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4ef000640 1 -- 172.21.15.144:0/28128084 >> 172.21.15.144:0/28128084 conn(0x7fa4e806d0d0 msgr2=0x7fa4e806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4ef000640 1 -- 172.21.15.144:0/28128084 shutdown_connections 2024-09-12T12:25:13.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.551+0000 7fa4ef000640 1 -- 172.21.15.144:0/28128084 wait complete. 2024-09-12T12:25:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 Processor -- start 2024-09-12T12:25:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 -- start start 2024-09-12T12:25:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4cc0039c0 0x7fa4e81e9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e81fad20 0x7fa4e81517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e80ae890 0x7fa4e80aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8073fc0 con 0x7fa4e80ae890 2024-09-12T12:25:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8073e40 con 0x7fa4cc0039c0 2024-09-12T12:25:13.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e8074140 con 0x7fa4e81fad20 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ed000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e80ae890 0x7fa4e80aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ed000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e80ae890 0x7fa4e80aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59594/0 (socket says 172.21.15.144:59594) 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ed000640 1 -- 172.21.15.144:0/2995899579 learned_addr learned my addr 172.21.15.144:0/2995899579 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4cc0039c0 0x7fa4e81e9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4e7400640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e81fad20 0x7fa4e81517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ed000640 1 -- 172.21.15.144:0/2995899579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e81fad20 msgr2=0x7fa4e81517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ed000640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e81fad20 0x7fa4e81517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ed000640 1 -- 172.21.15.144:0/2995899579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4cc0039c0 msgr2=0x7fa4e81e9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ed000640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4cc0039c0 0x7fa4e81e9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ed000640 1 -- 172.21.15.144:0/2995899579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e81520a0 con 0x7fa4e80ae890 2024-09-12T12:25:13.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ed000640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e80ae890 0x7fa4e80aed10 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0007cf0 tx=0x7fa4e00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4dfe00640 1 -- 172.21.15.144:0/2995899579 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0011de0 con 0x7fa4e80ae890 2024-09-12T12:25:13.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4dfe00640 1 -- 172.21.15.144:0/2995899579 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e001b070 con 0x7fa4e80ae890 2024-09-12T12:25:13.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 -- 172.21.15.144:0/2995899579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e8152380 con 0x7fa4e80ae890 2024-09-12T12:25:13.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4dfe00640 1 -- 172.21.15.144:0/2995899579 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00039a0 con 0x7fa4e80ae890 2024-09-12T12:25:13.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.555+0000 7fa4ef000640 1 -- 172.21.15.144:0/2995899579 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e8152940 con 0x7fa4e80ae890 2024-09-12T12:25:13.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.559+0000 7fa4dfe00640 1 -- 172.21.15.144:0/2995899579 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4e0003b40 con 0x7fa4e80ae890 2024-09-12T12:25:13.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.559+0000 7fa4dfe00640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c80678f0 0x7fa4c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.559+0000 7fa4dfe00640 1 -- 172.21.15.144:0/2995899579 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fa4e0086470 con 0x7fa4e80ae890 2024-09-12T12:25:13.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.559+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c80678f0 0x7fa4c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.559+0000 7fa4f230c000 1 Processor -- start 2024-09-12T12:25:13.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.559+0000 7fa4f230c000 1 -- start start 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.559+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c80678f0 0x7fa4c8069db0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80ad000 tx=0x7fa4d80b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac990f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 0x5586ac946d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac947290 0x5586ac947670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5586ac82eb60 con 0x5586ac990b20 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5586ac795c70 con 0x5586ac947290 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5586ac73bed0 con 0x5586ac991440 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac990f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac990f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59596/0 (socket says 172.21.15.144:59596) 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7e00640 1 -- 172.21.15.144:0/3171280722 learned_addr learned my addr 172.21.15.144:0/3171280722 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7400640 1 --2- 172.21.15.144:0/3171280722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 0x5586ac946d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4ed000640 1 --2- 172.21.15.144:0/3171280722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac947290 0x5586ac947670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7e00640 1 -- 172.21.15.144:0/3171280722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 msgr2=0x5586ac946d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/3171280722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 0x5586ac946d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7e00640 1 -- 172.21.15.144:0/3171280722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac947290 msgr2=0x5586ac947670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/3171280722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac947290 0x5586ac947670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7e00640 1 -- 172.21.15.144:0/3171280722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586ac74de50 con 0x5586ac990b20 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/3171280722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac990f00 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80982b0 tx=0x7fa4d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99fe9e63cedffd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4dcc00640 1 -- 172.21.15.144:0/3171280722 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d80a64a0 con 0x5586ac990b20 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4dcc00640 1 -- 172.21.15.144:0/3171280722 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d80a6640 con 0x5586ac990b20 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4dcc00640 1 -- 172.21.15.144:0/3171280722 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d80a6a10 con 0x5586ac990b20 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 -- 172.21.15.144:0/3171280722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 msgr2=0x5586ac990f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3171280722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac990f00 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80982b0 tx=0x7fa4d8004740 comp rx=0 tx=0).stop 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 -- 172.21.15.144:0/3171280722 shutdown_connections 2024-09-12T12:25:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3171280722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac947290 0x5586ac947670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3171280722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 0x5586ac946d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3171280722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac990f00 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 -- 172.21.15.144:0/3171280722 >> 172.21.15.144:0/3171280722 conn(0x5586ac94d600 msgr2=0x5586ac945630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 -- 172.21.15.144:0/3171280722 shutdown_connections 2024-09-12T12:25:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 -- 172.21.15.144:0/3171280722 wait complete. 2024-09-12T12:25:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 -- start start 2024-09-12T12:25:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.563+0000 7fa4f230c000 1 Processor -- start 2024-09-12T12:25:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac990b20 0x5586ac94bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 0x5586ac94c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac951cf0 0x5586ac9520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5586ac7f7b00 con 0x5586ac951cf0 2024-09-12T12:25:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5586ac770360 con 0x5586ac990b20 2024-09-12T12:25:13.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5586ac76d2d0 con 0x5586ac991440 2024-09-12T12:25:13.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 10 client.0 _ll_register_callbacks cb 0x5586ac932820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:13.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4ed000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac951cf0 0x5586ac9520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 0x5586ac94c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4e7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac990b20 0x5586ac94bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 0x5586ac94c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:42274/0 (socket says 172.21.15.144:42274) 2024-09-12T12:25:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4e7400640 1 -- 172.21.15.144:0/3115766062 learned_addr learned my addr 172.21.15.144:0/3115766062 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4ed000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac951cf0 0x5586ac9520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59604/0 (socket says 172.21.15.144:59604) 2024-09-12T12:25:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4ed000640 1 -- 172.21.15.144:0/3115766062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 msgr2=0x5586ac94c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4ed000640 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 0x5586ac94c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4ed000640 1 -- 172.21.15.144:0/3115766062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac990b20 msgr2=0x5586ac94bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4ed000640 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac990b20 0x5586ac94bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4ed000640 1 -- 172.21.15.144:0/3115766062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586ac73c120 con 0x5586ac951cf0 2024-09-12T12:25:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4ed000640 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac951cf0 0x5586ac9520d0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0084770 tx=0x7fa4e0003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a94310cc3f19abd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4d1600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4d1600640 1 -- 172.21.15.144:0/3115766062 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e005edd0 con 0x5586ac951cf0 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4d1600640 1 -- 172.21.15.144:0/3115766062 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fa4e005ef70 con 0x5586ac951cf0 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 -- 172.21.15.144:0/3115766062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4d80a6640 con 0x5586ac951cf0 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4d1600640 1 -- 172.21.15.144:0/3115766062 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7fa4e0084350 con 0x5586ac951cf0 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 10 client.10344 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 -- 172.21.15.144:0/3115766062 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x5586ac735450 con 0x5586ac951cf0 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4d1600640 1 -- 172.21.15.144:0/3115766062 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d80a6640 con 0x5586ac951cf0 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4d1600640 1 -- 172.21.15.144:0/3115766062 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7fa4e005bbc0 con 0x5586ac951cf0 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 10 client.10344 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 10 client.10344 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 20 client.10344 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x5586ac99f280 0x5586ac9a1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 4 client.10344 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 -- 172.21.15.144:0/3115766062 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586ac72fc00 con 0x5586ac99f280 2024-09-12T12:25:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x5586ac99f280 0x5586ac9a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4d1600640 10 client.10344 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x5586ac99f280 0x5586ac9a1670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1388918307f06e8e server_cookie=c37ac9db56ccc34e in_seq=0 out_seq=0 2024-09-12T12:25:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4d1600640 1 -- 172.21.15.144:0/3115766062 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586ac72fc00 con 0x5586ac99f280 2024-09-12T12:25:13.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4d1600640 10 client.10344 handle_command_reply: tid=0 2024-09-12T12:25:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 client.10344 shutdown 2024-09-12T12:25:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 -- 172.21.15.144:0/3115766062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac951cf0 msgr2=0x5586ac9520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.567+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac951cf0 0x5586ac9520d0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0084770 tx=0x7fa4e0003f70 comp rx=0 tx=0).stop 2024-09-12T12:25:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4f230c000 1 -- 172.21.15.144:0/3115766062 shutdown_connections 2024-09-12T12:25:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x5586ac99f280 0x5586ac9a1670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac951cf0 0x5586ac9520d0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac991440 0x5586ac94c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4f230c000 1 --2- 172.21.15.144:0/3115766062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac990b20 0x5586ac94bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4d1600640 0 client.10344 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:13.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4f230c000 1 -- 172.21.15.144:0/3115766062 >> 172.21.15.144:0/3115766062 conn(0x5586ac947290 msgr2=0x5586ac945d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4f230c000 1 -- 172.21.15.144:0/3115766062 shutdown_connections 2024-09-12T12:25:13.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4f230c000 1 -- 172.21.15.144:0/3115766062 wait complete. 2024-09-12T12:25:13.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.571+0000 7fa4f230c000 20 client.10344 trim_cache size 0 max 16384 2024-09-12T12:25:13.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4f230c000 1 Processor -- start 2024-09-12T12:25:13.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4f230c000 1 -- start start 2024-09-12T12:25:13.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 0x5586ac98fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 0x5586ac9a1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4f230c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8203d40 con 0x5586ac990b20 2024-09-12T12:25:13.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4f230c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e8140780 con 0x5586ac991440 2024-09-12T12:25:13.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4f230c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e8203740 con 0x5586ac951cf0 2024-09-12T12:25:13.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9900a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59612/0 (socket says 172.21.15.144:59612) 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.587+0000 7fa4e7400640 1 -- 172.21.15.144:0/1825793459 learned_addr learned my addr 172.21.15.144:0/1825793459 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4ed000640 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 0x5586ac9a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 0x5586ac98fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7400640 1 -- 172.21.15.144:0/1825793459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 msgr2=0x5586ac98fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7400640 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 0x5586ac98fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7400640 1 -- 172.21.15.144:0/1825793459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 msgr2=0x5586ac9a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7400640 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 0x5586ac9a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7400640 1 -- 172.21.15.144:0/1825793459 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586ac952440 con 0x5586ac990b20 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 0x5586ac98fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:13.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7400640 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9900a0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4005d70 tx=0x7fa4d40014c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce46dc0a63185e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4d3e00640 1 -- 172.21.15.144:0/1825793459 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40145e0 con 0x5586ac990b20 2024-09-12T12:25:13.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4d3e00640 1 -- 172.21.15.144:0/1825793459 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d40147a0 con 0x5586ac990b20 2024-09-12T12:25:13.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4d3e00640 1 -- 172.21.15.144:0/1825793459 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4014b90 con 0x5586ac990b20 2024-09-12T12:25:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 -- 172.21.15.144:0/1825793459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 msgr2=0x5586ac9900a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9900a0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4005d70 tx=0x7fa4d40014c0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 -- 172.21.15.144:0/1825793459 shutdown_connections 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 0x5586ac9a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9900a0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 --2- 172.21.15.144:0/1825793459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 0x5586ac98fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 -- 172.21.15.144:0/1825793459 >> 172.21.15.144:0/1825793459 conn(0x5586ac947290 msgr2=0x5586ac948db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 -- 172.21.15.144:0/1825793459 shutdown_connections 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 -- 172.21.15.144:0/1825793459 wait complete. 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 -- start start 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 Processor -- start 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 0x5586ac9a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9bf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 0x5586ac9bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5586ac794f80 con 0x5586ac990b20 2024-09-12T12:25:13.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5586ac74dca0 con 0x5586ac991440 2024-09-12T12:25:13.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5586ac79a2a0 con 0x5586ac951cf0 2024-09-12T12:25:13.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4f230c000 10 client.0 _ll_register_callbacks cb 0x7fa4e00565b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:13.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9bf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59616/0 (socket says 172.21.15.144:59616) 2024-09-12T12:25:13.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7400640 1 -- 172.21.15.144:0/677847333 learned_addr learned my addr 172.21.15.144:0/677847333 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:13.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 0x5586ac9a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.591+0000 7fa4ed000640 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 0x5586ac9bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4e7400640 1 -- 172.21.15.144:0/677847333 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 msgr2=0x5586ac9a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4e7400640 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 0x5586ac9a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4e7400640 1 -- 172.21.15.144:0/677847333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 msgr2=0x5586ac9bfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4e7400640 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 0x5586ac9bfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4e7400640 1 -- 172.21.15.144:0/677847333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586ac71cfd0 con 0x5586ac990b20 2024-09-12T12:25:13.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4e7400640 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9bf960 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4001500 tx=0x7fa4d4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4648ab2280956e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:13.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 1 -- 172.21.15.144:0/677847333 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40145e0 con 0x5586ac990b20 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 1 -- 172.21.15.144:0/677847333 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7fa4d4010040 con 0x5586ac990b20 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 -- 172.21.15.144:0/677847333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4d40147a0 con 0x5586ac990b20 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 1 -- 172.21.15.144:0/677847333 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7fa4d4031050 con 0x5586ac990b20 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 10 client.10350 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 -- 172.21.15.144:0/677847333 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x5586ac818750 con 0x5586ac990b20 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 1 -- 172.21.15.144:0/677847333 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d40147a0 con 0x5586ac990b20 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 1 -- 172.21.15.144:0/677847333 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7fa4d4034020 con 0x5586ac990b20 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 10 client.10350 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 10 client.10350 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:25:13.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 20 client.10350 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:13.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x5586ac9c03e0 0x5586aca03f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 4 client.10350 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:25:13.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 -- 172.21.15.144:0/677847333 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "status"}) -- 0x5586ac7a33a0 con 0x5586ac9c03e0 2024-09-12T12:25:13.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x5586ac9c03e0 0x5586aca03f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4e7e00640 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x5586ac9c03e0 0x5586aca03f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df79555dafe9a70 server_cookie=d6aecc3a810c651c in_seq=0 out_seq=0 2024-09-12T12:25:13.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 10 client.10350 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:13.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 1 -- 172.21.15.144:0/677847333 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x5586ac7a33a0 con 0x5586ac9c03e0 2024-09-12T12:25:13.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 10 client.10350 handle_command_reply: tid=0 2024-09-12T12:25:13.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 client.10350 shutdown 2024-09-12T12:25:13.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 -- 172.21.15.144:0/677847333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 msgr2=0x5586ac9bf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9bf960 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4001500 tx=0x7fa4d4001a50 comp rx=0 tx=0).stop 2024-09-12T12:25:13.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 -- 172.21.15.144:0/677847333 shutdown_connections 2024-09-12T12:25:13.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x5586ac9c03e0 0x5586aca03f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586ac991440 0x5586ac9bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5586ac990b20 0x5586ac9bf960 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4d1600640 0 client.10350 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:13.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 --2- 172.21.15.144:0/677847333 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5586ac951cf0 0x5586ac9a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 -- 172.21.15.144:0/677847333 >> 172.21.15.144:0/677847333 conn(0x5586ac947290 msgr2=0x5586ac98eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 -- 172.21.15.144:0/677847333 shutdown_connections 2024-09-12T12:25:13.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 1 -- 172.21.15.144:0/677847333 wait complete. 2024-09-12T12:25:13.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4f230c000 20 client.10350 trim_cache size 0 max 16384 2024-09-12T12:25:13.605 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:25:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:25:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:25:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 10218, 2024-09-12T12:25:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:25:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:25:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:25:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 5.8707674709999997, 2024-09-12T12:25:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 148, 2024-09-12T12:25:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 189, 2024-09-12T12:25:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 189, 2024-09-12T12:25:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.767493225000001 2024-09-12T12:25:13.607 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:25:13.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 -- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c80678f0 msgr2=0x7fa4c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c80678f0 0x7fa4c8069db0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80ad000 tx=0x7fa4d80b3040 comp rx=0 tx=0).stop 2024-09-12T12:25:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 -- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e80ae890 msgr2=0x7fa4e80aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e80ae890 0x7fa4e80aed10 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0007cf0 tx=0x7fa4e00115a0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 -- 172.21.15.144:0/2995899579 shutdown_connections 2024-09-12T12:25:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4c80678f0 0x7fa4c8069db0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e80ae890 0x7fa4e80aed10 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e81fad20 0x7fa4e81517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 --2- 172.21.15.144:0/2995899579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4cc0039c0 0x7fa4e81e9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 -- 172.21.15.144:0/2995899579 >> 172.21.15.144:0/2995899579 conn(0x7fa4e806d0d0 msgr2=0x7fa4e80cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 -- 172.21.15.144:0/2995899579 shutdown_connections 2024-09-12T12:25:13.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.595+0000 7fa4ef000640 1 -- 172.21.15.144:0/2995899579 wait complete. 2024-09-12T12:25:13.616 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:25:13.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fc0200640 1 Processor -- start 2024-09-12T12:25:13.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fc0200640 1 -- start start 2024-09-12T12:25:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fc0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b4200 0x7f9fb80b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fc0200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9fb80b5720 0x7f9fb80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fc0200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb80d1580 con 0x7f9fb815c220 2024-09-12T12:25:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fc0200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9fb80b4bb0 con 0x7f9fb80b5720 2024-09-12T12:25:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fc0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb80d1320 con 0x7f9fb80b4200 2024-09-12T12:25:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fbe200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9fb80b5720 0x7f9fb80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fbe200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9fb80b5720 0x7f9fb80b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59628/0 (socket says 172.21.15.144:59628) 2024-09-12T12:25:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fbe200640 1 -- 172.21.15.144:0/1379513247 learned_addr learned my addr 172.21.15.144:0/1379513247 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.751+0000 7f9fbce00640 1 --2- 172.21.15.144:0/1379513247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b4200 0x7f9fb80b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.755+0000 7f9fbe200640 1 -- 172.21.15.144:0/1379513247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b4200 msgr2=0x7f9fb80b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.755+0000 7f9fbe200640 1 --2- 172.21.15.144:0/1379513247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b4200 0x7f9fb80b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.755+0000 7f9fbe200640 1 -- 172.21.15.144:0/1379513247 >> v1:172.21.15.165:6789/0 conn(0x7f9fb815c220 legacy=0x7f9fb80d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.755+0000 7f9fbe200640 1 -- 172.21.15.144:0/1379513247 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb80d1860 con 0x7f9fb80b5720 2024-09-12T12:25:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.755+0000 7f9fbe200640 1 --2- 172.21.15.144:0/1379513247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb80b5720 0x7f9fb80b5b70 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009e80 tx=0x7f9fb001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c90c8f198b2448 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.755+0000 7f9fb7e00640 1 -- 172.21.15.144:0/1379513247 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00a58a0 con 0x7f9fb80b5720 2024-09-12T12:25:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.755+0000 7f9fb7e00640 1 -- 172.21.15.144:0/1379513247 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb00a5a40 con 0x7f9fb80b5720 2024-09-12T12:25:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.755+0000 7f9fb7e00640 1 -- 172.21.15.144:0/1379513247 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00a5e10 con 0x7f9fb80b5720 2024-09-12T12:25:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 -- 172.21.15.144:0/1379513247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb80b5720 msgr2=0x7f9fb80b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 --2- 172.21.15.144:0/1379513247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb80b5720 0x7f9fb80b5b70 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009e80 tx=0x7f9fb001c9e0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 -- 172.21.15.144:0/1379513247 shutdown_connections 2024-09-12T12:25:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 --2- 172.21.15.144:0/1379513247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb80b5720 0x7f9fb80b5b70 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 --2- 172.21.15.144:0/1379513247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b4200 0x7f9fb80b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 -- 172.21.15.144:0/1379513247 >> 172.21.15.144:0/1379513247 conn(0x7f9fb806f400 msgr2=0x7f9fb806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 -- 172.21.15.144:0/1379513247 shutdown_connections 2024-09-12T12:25:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 -- 172.21.15.144:0/1379513247 wait complete. 2024-09-12T12:25:13.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 Processor -- start 2024-09-12T12:25:13.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 -- start start 2024-09-12T12:25:13.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fb80b4200 0x7f9fb80d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b5720 0x7f9fb80af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb815c220 0x7f9fb81fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb815c780 con 0x7f9fb815c220 2024-09-12T12:25:13.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb815c600 con 0x7f9fb80b4200 2024-09-12T12:25:13.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fc0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb8070bf0 con 0x7f9fb80b5720 2024-09-12T12:25:13.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbe200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb815c220 0x7f9fb81fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbe200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb815c220 0x7f9fb81fee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59644/0 (socket says 172.21.15.144:59644) 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbe200640 1 -- 172.21.15.144:0/2062745684 learned_addr learned my addr 172.21.15.144:0/2062745684 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbd800640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fb80b4200 0x7f9fb80d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbce00640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b5720 0x7f9fb80af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbe200640 1 -- 172.21.15.144:0/2062745684 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b5720 msgr2=0x7f9fb80af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbe200640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b5720 0x7f9fb80af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbe200640 1 -- 172.21.15.144:0/2062745684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fb80b4200 msgr2=0x7f9fb80d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbe200640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fb80b4200 0x7f9fb80d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbe200640 1 -- 172.21.15.144:0/2062745684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb81ffbb0 con 0x7f9fb815c220 2024-09-12T12:25:13.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.759+0000 7f9fbe200640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb815c220 0x7f9fb81fee80 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f9fb001a610 tx=0x7f9fb0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fb5600640 1 -- 172.21.15.144:0/2062745684 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb00a58a0 con 0x7f9fb815c220 2024-09-12T12:25:13.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fb5600640 1 -- 172.21.15.144:0/2062745684 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb00be070 con 0x7f9fb815c220 2024-09-12T12:25:13.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fb5600640 1 -- 172.21.15.144:0/2062745684 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0009510 con 0x7f9fb815c220 2024-09-12T12:25:13.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb80ae5a0 con 0x7f9fb815c220 2024-09-12T12:25:13.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb80aeb60 con 0x7f9fb815c220 2024-09-12T12:25:13.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb80ae390 con 0x7f9fb815c220 2024-09-12T12:25:13.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fb5600640 1 -- 172.21.15.144:0/2062745684 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9fb00b8470 con 0x7f9fb815c220 2024-09-12T12:25:13.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fb5600640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9f980678c0 0x7f9f98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:13.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fb5600640 1 -- 172.21.15.144:0/2062745684 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f9fb0121340 con 0x7f9fb815c220 2024-09-12T12:25:13.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.763+0000 7f9fbd800640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9f980678c0 0x7f9f98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:13.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.767+0000 7f9fbd800640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9f980678c0 0x7f9f98069d80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f9fac001770 tx=0x7f9fac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.767+0000 7f9fb5600640 1 -- 172.21.15.144:0/2062745684 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9fb0016600 con 0x7f9fb815c220 2024-09-12T12:25:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9fb80b4670 con 0x7f9fb815c220 2024-09-12T12:25:13.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fb5600640 1 -- 172.21.15.144:0/2062745684 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v148) ==== 53+0+73 (secure 0 0 0) 0x7f9fb0121100 con 0x7f9fb815c220 2024-09-12T12:25:13.964 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9f980678c0 msgr2=0x7f9f98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9f980678c0 0x7f9f98069d80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f9fac001770 tx=0x7f9fac009040 comp rx=0 tx=0).stop 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb815c220 msgr2=0x7f9fb81fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb815c220 0x7f9fb81fee80 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f9fb001a610 tx=0x7f9fb0019780 comp rx=0 tx=0).stop 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 shutdown_connections 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9f980678c0 0x7f9f98069d80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fb815c220 0x7f9fb81fee80 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fb80b5720 0x7f9fb80af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 --2- 172.21.15.144:0/2062745684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fb80b4200 0x7f9fb80d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:13.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 >> 172.21.15.144:0/2062745684 conn(0x7f9fb806f400 msgr2=0x7f9fb806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:13.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 shutdown_connections 2024-09-12T12:25:13.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:13.963+0000 7f9fc0200640 1 -- 172.21.15.144:0/2062745684 wait complete. 2024-09-12T12:25:13.985 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:25:13.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:25:13.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:25:13.986 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:25:13.986 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:13.986 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:25:13.986 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:25:13.986 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:25:13.986 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:25:13.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:13.987 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:25:13.995 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:25:13.995 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:25:13.995 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:25:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41669sec preferred_lft 41669sec 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:25:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:13.998 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:25:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:25:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:25:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:13.998 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:25:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:25:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:25:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:25:13.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:13.999 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:25:14.063 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:25:14.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:14.065 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:25:14.118 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:25:14.119 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:25:14.119 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:25:14.119 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:25:14.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:25:14.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:25:14.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:25:14.119 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:25:14.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:25:14.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:14.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:14.254 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:25:14.310 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:25:14.310 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:25:14.311 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:25:14.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:14.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:25:14.373 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:25:14.374 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:14.426 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:25:14.426 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:25:14.426 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:14.481 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:25:14.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:14.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:25:14.574 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:25:14.574 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:25:14.588 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:25:14.589 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:25:14.589 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:25:14.589 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:25:14.589 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:25:14.592 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:25:14.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:14.592 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:14.612 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:25:14.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:25:14.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:25:14.721 INFO:teuthology.orchestra.run.smithi144.stdout:client9763 2024-09-12T12:25:14.722 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:25:14.722 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:14.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-12T12:25:14.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f2836600640 1 Processor -- start 2024-09-12T12:25:14.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f2836600640 1 -- start start 2024-09-12T12:25:14.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f2836600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283015c2e0 0x7f2830072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f2836600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f28300af5f0 0x7f283006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f2836600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28300733e0 con 0x7f283006c150 2024-09-12T12:25:14.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f2836600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f28300cd290 con 0x7f28300af5f0 2024-09-12T12:25:14.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f2836600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28300cd570 con 0x7f283015c2e0 2024-09-12T12:25:14.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f282f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283015c2e0 0x7f2830072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f282ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f28300af5f0 0x7f283006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f282f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283015c2e0 0x7f2830072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:42322/0 (socket says 172.21.15.144:42322) 2024-09-12T12:25:14.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f282f400640 1 -- 172.21.15.144:0/2006360547 learned_addr learned my addr 172.21.15.144:0/2006360547 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f282f400640 1 -- 172.21.15.144:0/2006360547 >> v2:172.21.15.165:3300/0 conn(0x7f28300af5f0 msgr2=0x7f283006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f282f400640 1 --2- 172.21.15.144:0/2006360547 >> v2:172.21.15.165:3300/0 conn(0x7f28300af5f0 0x7f283006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f282f400640 1 -- 172.21.15.144:0/2006360547 >> v1:172.21.15.165:6789/0 conn(0x7f283006c150 legacy=0x7f283006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f282f400640 1 -- 172.21.15.144:0/2006360547 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28300cd850 con 0x7f283015c2e0 2024-09-12T12:25:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.911+0000 7f282ea00640 1 --2- 172.21.15.144:0/2006360547 >> v2:172.21.15.165:3300/0 conn(0x7f28300af5f0 0x7f283006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:14.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f282f400640 1 --2- 172.21.15.144:0/2006360547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283015c2e0 0x7f2830072b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2820009e50 tx=0x7f282001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5b276db586c7c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:14.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f282e000640 1 -- 172.21.15.144:0/2006360547 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200a55d0 con 0x7f283015c2e0 2024-09-12T12:25:14.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f282e000640 1 -- 172.21.15.144:0/2006360547 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28200a5770 con 0x7f283015c2e0 2024-09-12T12:25:14.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f282e000640 1 -- 172.21.15.144:0/2006360547 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200a5b40 con 0x7f283015c2e0 2024-09-12T12:25:14.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f2836600640 1 -- 172.21.15.144:0/2006360547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283015c2e0 msgr2=0x7f2830072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f2836600640 1 --2- 172.21.15.144:0/2006360547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283015c2e0 0x7f2830072b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2820009e50 tx=0x7f282001c910 comp rx=0 tx=0).stop 2024-09-12T12:25:14.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f2836600640 1 -- 172.21.15.144:0/2006360547 shutdown_connections 2024-09-12T12:25:14.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f2836600640 1 --2- 172.21.15.144:0/2006360547 >> v2:172.21.15.165:3300/0 conn(0x7f28300af5f0 0x7f283006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f2836600640 1 --2- 172.21.15.144:0/2006360547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283015c2e0 0x7f2830072b50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f2836600640 1 -- 172.21.15.144:0/2006360547 >> 172.21.15.144:0/2006360547 conn(0x7f2830068030 msgr2=0x7f28300b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:14.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f2836600640 1 -- 172.21.15.144:0/2006360547 shutdown_connections 2024-09-12T12:25:14.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.915+0000 7f2836600640 1 -- 172.21.15.144:0/2006360547 wait complete. 2024-09-12T12:25:14.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 Processor -- start 2024-09-12T12:25:14.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 -- start start 2024-09-12T12:25:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283006c150 0x7f2830150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28300af5f0 0x7f283014fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f283015c2e0 0x7f28300b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f28301692b0 con 0x7f28300af5f0 2024-09-12T12:25:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2830169130 con 0x7f283015c2e0 2024-09-12T12:25:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2830169430 con 0x7f283006c150 2024-09-12T12:25:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28300af5f0 0x7f283014fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28300af5f0 0x7f283014fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59654/0 (socket says 172.21.15.144:59654) 2024-09-12T12:25:14.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282ea00640 1 -- 172.21.15.144:0/571447239 learned_addr learned my addr 172.21.15.144:0/571447239 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282fe00640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f283015c2e0 0x7f28300b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282f400640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283006c150 0x7f2830150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282ea00640 1 -- 172.21.15.144:0/571447239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283006c150 msgr2=0x7f2830150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282ea00640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283006c150 0x7f2830150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282ea00640 1 -- 172.21.15.144:0/571447239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f283015c2e0 msgr2=0x7f28300b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282ea00640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f283015c2e0 0x7f28300b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282ea00640 1 -- 172.21.15.144:0/571447239 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2830150010 con 0x7f28300af5f0 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282f400640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283006c150 0x7f2830150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f282ea00640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28300af5f0 0x7f283014fad0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ebb0 tx=0x7f281c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2827400640 1 -- 172.21.15.144:0/571447239 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c017070 con 0x7f28300af5f0 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2827400640 1 -- 172.21.15.144:0/571447239 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c00cc30 con 0x7f28300af5f0 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 -- 172.21.15.144:0/571447239 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283015c970 con 0x7f28300af5f0 2024-09-12T12:25:14.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2827400640 1 -- 172.21.15.144:0/571447239 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c013470 con 0x7f28300af5f0 2024-09-12T12:25:14.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.919+0000 7f2836600640 1 -- 172.21.15.144:0/571447239 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283015cf30 con 0x7f28300af5f0 2024-09-12T12:25:14.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2827400640 1 -- 172.21.15.144:0/571447239 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f281c01a070 con 0x7f28300af5f0 2024-09-12T12:25:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2827400640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28100678c0 0x7f2810069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2827400640 1 -- 172.21.15.144:0/571447239 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f281c085e00 con 0x7f28300af5f0 2024-09-12T12:25:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282f400640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28100678c0 0x7f2810069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2839923000 1 Processor -- start 2024-09-12T12:25:14.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2839923000 1 -- start start 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282f400640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28100678c0 0x7f2810069d80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f28200ae000 tx=0x7f28200a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2839923000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 0x565079eba760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2839923000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079ebaca0 0x565079e70290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2839923000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 0x565079e70bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2839923000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565079d57c40 con 0x565079ebaca0 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2839923000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565079cbed50 con 0x565079e707d0 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f2839923000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x565079c79ab0 con 0x565079eba380 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079ebaca0 0x565079e70290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079ebaca0 0x565079e70290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59660/0 (socket says 172.21.15.144:59660) 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282ea00640 1 -- 172.21.15.144:0/464061688 learned_addr learned my addr 172.21.15.144:0/464061688 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282f400640 1 --2- 172.21.15.144:0/464061688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 0x565079eba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282fe00640 1 --2- 172.21.15.144:0/464061688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 0x565079e70bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282ea00640 1 -- 172.21.15.144:0/464061688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 msgr2=0x565079eba760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282ea00640 1 --2- 172.21.15.144:0/464061688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 0x565079eba760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282ea00640 1 -- 172.21.15.144:0/464061688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 msgr2=0x565079e70bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282ea00640 1 --2- 172.21.15.144:0/464061688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 0x565079e70bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.923+0000 7f282ea00640 1 -- 172.21.15.144:0/464061688 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565079c65590 con 0x565079ebaca0 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282ea00640 1 --2- 172.21.15.144:0/464061688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079ebaca0 0x565079e70290 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ca20 tx=0x7f281c0567d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e466ce87a16ac616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f281be00640 1 -- 172.21.15.144:0/464061688 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c06e020 con 0x565079ebaca0 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f281be00640 1 -- 172.21.15.144:0/464061688 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c05ebf0 con 0x565079ebaca0 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f281be00640 1 -- 172.21.15.144:0/464061688 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c021040 con 0x565079ebaca0 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 -- 172.21.15.144:0/464061688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079ebaca0 msgr2=0x565079e70290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 --2- 172.21.15.144:0/464061688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079ebaca0 0x565079e70290 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ca20 tx=0x7f281c0567d0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 -- 172.21.15.144:0/464061688 shutdown_connections 2024-09-12T12:25:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 --2- 172.21.15.144:0/464061688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 0x565079e70bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 --2- 172.21.15.144:0/464061688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079ebaca0 0x565079e70290 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 --2- 172.21.15.144:0/464061688 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 0x565079eba760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 -- 172.21.15.144:0/464061688 >> 172.21.15.144:0/464061688 conn(0x565079e67bc0 msgr2=0x565079e6eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:14.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 -- 172.21.15.144:0/464061688 shutdown_connections 2024-09-12T12:25:14.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 -- 172.21.15.144:0/464061688 wait complete. 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 -- start start 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 Processor -- start 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079e758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 0x565079ea45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079ebaca0 0x565079ea4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565079c7d400 con 0x565079e707d0 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565079d7b3a0 con 0x565079ebaca0 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x565079cfe260 con 0x565079eba380 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f2839923000 10 client.0 _ll_register_callbacks cb 0x565079d20020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079e758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079e758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59668/0 (socket says 172.21.15.144:59668) 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282f400640 1 -- 172.21.15.144:0/1263590248 learned_addr learned my addr 172.21.15.144:0/1263590248 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282ea00640 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 0x565079ea45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282fe00640 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079ebaca0 0x565079ea4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282f400640 1 -- 172.21.15.144:0/1263590248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 msgr2=0x565079ea45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282f400640 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 0x565079ea45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282f400640 1 -- 172.21.15.144:0/1263590248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079ebaca0 msgr2=0x565079ea4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282f400640 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079ebaca0 0x565079ea4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.927+0000 7f282f400640 1 -- 172.21.15.144:0/1263590248 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565079c61dd0 con 0x565079e707d0 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f282f400640 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079e758a0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f28200982f0 tx=0x7f282001b150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87baac16c20798c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 1 -- 172.21.15.144:0/1263590248 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200c9060 con 0x565079e707d0 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 -- 172.21.15.144:0/1263590248 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f281c05ebf0 con 0x565079e707d0 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 1 -- 172.21.15.144:0/1263590248 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f28200b9650 con 0x565079e707d0 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 1 -- 172.21.15.144:0/1263590248 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7f28200b9850 con 0x565079e707d0 2024-09-12T12:25:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 10 client.10365 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 -- 172.21.15.144:0/1263590248 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x565079c5e800 con 0x565079e707d0 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 1 -- 172.21.15.144:0/1263590248 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c05ebf0 con 0x565079e707d0 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 1 -- 172.21.15.144:0/1263590248 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7f28200c3070 con 0x565079e707d0 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 10 client.10365 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 10 client.10365 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 20 client.10365 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x565079ec10e0 0x565079ec14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 4 client.10365 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 -- 172.21.15.144:0/1263590248 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565079c58e20 con 0x565079ec10e0 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f282ea00640 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x565079ec10e0 0x565079ec14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 10 client.10365 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f282ea00640 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x565079ec10e0 0x565079ec14f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f18628857787d0f8 server_cookie=9581b42996b1b565 in_seq=0 out_seq=0 2024-09-12T12:25:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 1 -- 172.21.15.144:0/1263590248 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565079c58e20 con 0x565079ec10e0 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 10 client.10365 handle_command_reply: tid=0 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 client.10365 shutdown 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 -- 172.21.15.144:0/1263590248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 msgr2=0x565079e758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079e758a0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f28200982f0 tx=0x7f282001b150 comp rx=0 tx=0).stop 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 -- 172.21.15.144:0/1263590248 shutdown_connections 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x565079ec10e0 0x565079ec14f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079ebaca0 0x565079ea4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079eba380 0x565079ea45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2818c00640 0 client.10365 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 --2- 172.21.15.144:0/1263590248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079e758a0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 -- 172.21.15.144:0/1263590248 >> 172.21.15.144:0/1263590248 conn(0x565079e67bc0 msgr2=0x565079e6f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 -- 172.21.15.144:0/1263590248 shutdown_connections 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 1 -- 172.21.15.144:0/1263590248 wait complete. 2024-09-12T12:25:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.931+0000 7f2839923000 20 client.10365 trim_cache size 0 max 16384 2024-09-12T12:25:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 Processor -- start 2024-09-12T12:25:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 -- start start 2024-09-12T12:25:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 0x565079ed16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 0x565079ed1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079eba380 0x565079ebd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f28302036c0 con 0x565079eba380 2024-09-12T12:25:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f283015e300 con 0x565079e707d0 2024-09-12T12:25:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28302031f0 con 0x565079e67bc0 2024-09-12T12:25:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079eba380 0x565079ebd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079eba380 0x565079ebd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59670/0 (socket says 172.21.15.144:59670) 2024-09-12T12:25:14.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282fe00640 1 -- 172.21.15.144:0/1550362290 learned_addr learned my addr 172.21.15.144:0/1550362290 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:14.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282ea00640 1 --2- 172.21.15.144:0/1550362290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 0x565079ed1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282f400640 1 --2- 172.21.15.144:0/1550362290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 0x565079ed16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282fe00640 1 -- 172.21.15.144:0/1550362290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 msgr2=0x565079ed16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:14.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282fe00640 1 --2- 172.21.15.144:0/1550362290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 0x565079ed16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282fe00640 1 -- 172.21.15.144:0/1550362290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 msgr2=0x565079ed1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:14.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282fe00640 1 --2- 172.21.15.144:0/1550362290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 0x565079ed1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282fe00640 1 -- 172.21.15.144:0/1550362290 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565079c7c480 con 0x565079eba380 2024-09-12T12:25:14.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f282fe00640 1 --2- 172.21.15.144:0/1550362290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079eba380 0x565079ebd090 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f2828005510 tx=0x7f28280039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cdf7f0f56cb2da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:14.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f281b400640 1 -- 172.21.15.144:0/1550362290 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828007030 con 0x565079eba380 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f281b400640 1 -- 172.21.15.144:0/1550362290 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28280071d0 con 0x565079eba380 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f281b400640 1 -- 172.21.15.144:0/1550362290 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828007580 con 0x565079eba380 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 -- 172.21.15.144:0/1550362290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079eba380 msgr2=0x565079ebd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 --2- 172.21.15.144:0/1550362290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079eba380 0x565079ebd090 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f2828005510 tx=0x7f28280039d0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 -- 172.21.15.144:0/1550362290 shutdown_connections 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 --2- 172.21.15.144:0/1550362290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079eba380 0x565079ebd090 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 --2- 172.21.15.144:0/1550362290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079e707d0 0x565079ed1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 --2- 172.21.15.144:0/1550362290 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 0x565079ed16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 -- 172.21.15.144:0/1550362290 >> 172.21.15.144:0/1550362290 conn(0x565079ea3830 msgr2=0x565079e750a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 -- 172.21.15.144:0/1550362290 shutdown_connections 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.947+0000 7f2839923000 1 -- 172.21.15.144:0/1550362290 wait complete. 2024-09-12T12:25:14.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 -- start start 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 Processor -- start 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 0x565079ebff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079f369c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079eba380 0x565079f36f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x565079c64f30 con 0x565079e707d0 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565079c7d7d0 con 0x565079eba380 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x565079cbe060 con 0x565079e67bc0 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 10 client.0 _ll_register_callbacks cb 0x7f281c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079f369c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 0x565079ebff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079f369c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59672/0 (socket says 172.21.15.144:59672) 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282ea00640 1 -- 172.21.15.144:0/2222003312 learned_addr learned my addr 172.21.15.144:0/2222003312 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282fe00640 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079eba380 0x565079f36f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282ea00640 1 -- 172.21.15.144:0/2222003312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 msgr2=0x565079ebff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282ea00640 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 0x565079ebff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282ea00640 1 -- 172.21.15.144:0/2222003312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079eba380 msgr2=0x565079f36f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282ea00640 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079eba380 0x565079f36f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282ea00640 1 -- 172.21.15.144:0/2222003312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565079c52650 con 0x565079e707d0 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282fe00640 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079eba380 0x565079f36f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282ea00640 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079f369c0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f281c004780 tx=0x7f281c01e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9569aa0c4291f1eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2818c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2818c00640 1 -- 172.21.15.144:0/2222003312 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c06e040 con 0x565079e707d0 2024-09-12T12:25:14.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2818c00640 1 -- 172.21.15.144:0/2222003312 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f281c052680 con 0x565079e707d0 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 -- 172.21.15.144:0/2222003312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28280071d0 con 0x565079e707d0 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2818c00640 1 -- 172.21.15.144:0/2222003312 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7f281c021040 con 0x565079e707d0 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 10 client.10371 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 -- 172.21.15.144:0/2222003312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x565079c563c0 con 0x565079e707d0 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2818c00640 1 -- 172.21.15.144:0/2222003312 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28280071d0 con 0x565079e707d0 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2818c00640 1 -- 172.21.15.144:0/2222003312 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7f281c024060 con 0x565079e707d0 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 10 client.10371 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 10 client.10371 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 20 client.10371 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x565079ebaca0 0x565079ef2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 4 client.10371 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2839923000 1 -- 172.21.15.144:0/2222003312 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565079ccc480 con 0x565079ebaca0 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282f400640 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x565079ebaca0 0x565079ef2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:14.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f2818c00640 10 client.10371 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.951+0000 7f282f400640 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x565079ebaca0 0x565079ef2c70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=654f0b33bb96478c server_cookie=bd22c69577aeb6e9 in_seq=0 out_seq=0 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2818c00640 1 -- 172.21.15.144:0/2222003312 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565079ccc480 con 0x565079ebaca0 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2818c00640 10 client.10371 handle_command_reply: tid=0 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 client.10371 shutdown 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 -- 172.21.15.144:0/2222003312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 msgr2=0x565079f369c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079f369c0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f281c004780 tx=0x7f281c01e070 comp rx=0 tx=0).stop 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 -- 172.21.15.144:0/2222003312 shutdown_connections 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x565079ebaca0 0x565079ef2c70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x565079eba380 0x565079f36f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565079e707d0 0x565079f369c0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 --2- 172.21.15.144:0/2222003312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x565079e67bc0 0x565079ebff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2818c00640 0 client.10371 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:14.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 -- 172.21.15.144:0/2222003312 >> 172.21.15.144:0/2222003312 conn(0x565079ea3830 msgr2=0x565079e757b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 -- 172.21.15.144:0/2222003312 shutdown_connections 2024-09-12T12:25:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 1 -- 172.21.15.144:0/2222003312 wait complete. 2024-09-12T12:25:14.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2839923000 20 client.10371 trim_cache size 0 max 16384 2024-09-12T12:25:14.959 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-12T12:25:14.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 -- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28100678c0 msgr2=0x7f2810069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28100678c0 0x7f2810069d80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f28200ae000 tx=0x7f28200a7070 comp rx=0 tx=0).stop 2024-09-12T12:25:14.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 -- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28300af5f0 msgr2=0x7f283014fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:14.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28300af5f0 0x7f283014fad0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ebb0 tx=0x7f281c00c520 comp rx=0 tx=0).stop 2024-09-12T12:25:14.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 -- 172.21.15.144:0/571447239 shutdown_connections 2024-09-12T12:25:14.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f28100678c0 0x7f2810069d80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f283015c2e0 0x7f28300b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f28300af5f0 0x7f283014fad0 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 --2- 172.21.15.144:0/571447239 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f283006c150 0x7f2830150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:14.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 -- 172.21.15.144:0/571447239 >> 172.21.15.144:0/571447239 conn(0x7f2830068030 msgr2=0x7f2830073880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:14.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 -- 172.21.15.144:0/571447239 shutdown_connections 2024-09-12T12:25:14.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:14.955+0000 7f2836600640 1 -- 172.21.15.144:0/571447239 wait complete. 2024-09-12T12:25:14.975 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T12:25:15.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.107+0000 7f59cf200640 1 Processor -- start 2024-09-12T12:25:15.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.107+0000 7f59cf200640 1 -- start start 2024-09-12T12:25:15.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59cf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d00d0910 0x7f59d006f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59cf200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59d00d2880 0x7f59d0073240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59cf200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d015cd60 con 0x7f59d0159f00 2024-09-12T12:25:15.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59cf200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f59d015d040 con 0x7f59d00d2880 2024-09-12T12:25:15.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59cf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59d015d320 con 0x7f59d00d0910 2024-09-12T12:25:15.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59ce800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59d00d2880 0x7f59d0073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59ce800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59d00d2880 0x7f59d0073240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59688/0 (socket says 172.21.15.144:59688) 2024-09-12T12:25:15.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59ce800640 1 -- 172.21.15.144:0/2022676667 learned_addr learned my addr 172.21.15.144:0/2022676667 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59cd400640 1 --2- 172.21.15.144:0/2022676667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d00d0910 0x7f59d006f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59ce800640 1 -- 172.21.15.144:0/2022676667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d00d0910 msgr2=0x7f59d006f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59ce800640 1 --2- 172.21.15.144:0/2022676667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d00d0910 0x7f59d006f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59ce800640 1 -- 172.21.15.144:0/2022676667 >> v1:172.21.15.165:6789/0 conn(0x7f59d0159f00 legacy=0x7f59d00d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.111+0000 7f59ce800640 1 -- 172.21.15.144:0/2022676667 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d015d600 con 0x7f59d00d2880 2024-09-12T12:25:15.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59ce800640 1 --2- 172.21.15.144:0/2022676667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d2880 0x7f59d0073240 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009e50 tx=0x7f59c801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0934a6dc9b5bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cca00640 1 -- 172.21.15.144:0/2022676667 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c80b4070 con 0x7f59d00d2880 2024-09-12T12:25:15.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cca00640 1 -- 172.21.15.144:0/2022676667 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c80af400 con 0x7f59d00d2880 2024-09-12T12:25:15.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cca00640 1 -- 172.21.15.144:0/2022676667 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c80af7d0 con 0x7f59d00d2880 2024-09-12T12:25:15.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 -- 172.21.15.144:0/2022676667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d2880 msgr2=0x7f59d0073240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 --2- 172.21.15.144:0/2022676667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d2880 0x7f59d0073240 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009e50 tx=0x7f59c801f210 comp rx=0 tx=0).stop 2024-09-12T12:25:15.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 -- 172.21.15.144:0/2022676667 shutdown_connections 2024-09-12T12:25:15.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 --2- 172.21.15.144:0/2022676667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d2880 0x7f59d0073240 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 --2- 172.21.15.144:0/2022676667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d00d0910 0x7f59d006f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 -- 172.21.15.144:0/2022676667 >> 172.21.15.144:0/2022676667 conn(0x7f59d0067a00 msgr2=0x7f59d0067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 -- 172.21.15.144:0/2022676667 shutdown_connections 2024-09-12T12:25:15.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 -- 172.21.15.144:0/2022676667 wait complete. 2024-09-12T12:25:15.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 Processor -- start 2024-09-12T12:25:15.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.115+0000 7f59cf200640 1 -- start start 2024-09-12T12:25:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d0910 0x7f59d01f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cf200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00d2880 0x7f59d00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d0159f00 0x7f59d01e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59d015a2e0 con 0x7f59d00d0910 2024-09-12T12:25:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cf200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59d015d8e0 con 0x7f59d00d2880 2024-09-12T12:25:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59d015a460 con 0x7f59d0159f00 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d0910 0x7f59d01f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d0910 0x7f59d01f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59696/0 (socket says 172.21.15.144:59696) 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cde00640 1 -- 172.21.15.144:0/2477552507 learned_addr learned my addr 172.21.15.144:0/2477552507 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cd400640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00d2880 0x7f59d00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59ce800640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d0159f00 0x7f59d01e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cde00640 1 -- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d0159f00 msgr2=0x7f59d01e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cde00640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d0159f00 0x7f59d01e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cde00640 1 -- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00d2880 msgr2=0x7f59d00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cde00640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00d2880 0x7f59d00b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cde00640 1 -- 172.21.15.144:0/2477552507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d00b3a50 con 0x7f59d00d0910 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cd400640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00d2880 0x7f59d00b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59ce800640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d0159f00 0x7f59d01e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:15.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cde00640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d0910 0x7f59d01f7110 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c370 tx=0x7f59c000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59c6000640 1 -- 172.21.15.144:0/2477552507 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c00052d0 con 0x7f59d00d0910 2024-09-12T12:25:15.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59c6000640 1 -- 172.21.15.144:0/2477552507 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c0005470 con 0x7f59d00d0910 2024-09-12T12:25:15.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59c6000640 1 -- 172.21.15.144:0/2477552507 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0007260 con 0x7f59d00d0910 2024-09-12T12:25:15.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d00b3d30 con 0x7f59d00d0910 2024-09-12T12:25:15.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d00b42f0 con 0x7f59d00d0910 2024-09-12T12:25:15.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d015c9c0 con 0x7f59d00d0910 2024-09-12T12:25:15.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.119+0000 7f59c6000640 1 -- 172.21.15.144:0/2477552507 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59c0007400 con 0x7f59d00d0910 2024-09-12T12:25:15.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.123+0000 7f59c6000640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59b00678c0 0x7f59b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.123+0000 7f59c6000640 1 -- 172.21.15.144:0/2477552507 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f59c00852b0 con 0x7f59d00d0910 2024-09-12T12:25:15.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.123+0000 7f59cd400640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59b00678c0 0x7f59b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.123+0000 7f59cd400640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59b00678c0 0x7f59b0069d80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f59d00d22a0 tx=0x7f59bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.127+0000 7f59c6000640 1 -- 172.21.15.144:0/2477552507 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59c0055be0 con 0x7f59d00d0910 2024-09-12T12:25:15.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.323+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f59d00b66e0 con 0x7f59d00d0910 2024-09-12T12:25:15.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.323+0000 7f59c6000640 1 -- 172.21.15.144:0/2477552507 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f59c00554e0 con 0x7f59d00d0910 2024-09-12T12:25:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:15.325 INFO:teuthology.orchestra.run.smithi144.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T12:25:15.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59b00678c0 msgr2=0x7f59b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59b00678c0 0x7f59b0069d80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f59d00d22a0 tx=0x7f59bc008040 comp rx=0 tx=0).stop 2024-09-12T12:25:15.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d0910 msgr2=0x7f59d01f7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d0910 0x7f59d01f7110 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c370 tx=0x7f59c000c830 comp rx=0 tx=0).stop 2024-09-12T12:25:15.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 shutdown_connections 2024-09-12T12:25:15.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f59b00678c0 0x7f59b0069d80 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d0159f00 0x7f59d01e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00d2880 0x7f59d00b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 --2- 172.21.15.144:0/2477552507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00d0910 0x7f59d01f7110 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 >> 172.21.15.144:0/2477552507 conn(0x7f59d0067a00 msgr2=0x7f59d015a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 shutdown_connections 2024-09-12T12:25:15.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.327+0000 7f59cf200640 1 -- 172.21.15.144:0/2477552507 wait complete. 2024-09-12T12:25:15.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:15.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-09-12T12:25:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.487+0000 7f35d3c00640 1 Processor -- start 2024-09-12T12:25:15.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.487+0000 7f35d3c00640 1 -- start start 2024-09-12T12:25:15.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.487+0000 7f35d3c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35cc0b3490 0x7f35cc0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.487+0000 7f35d3c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 0x7f35cc155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.487+0000 7f35d3c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35cc06cd20 con 0x7f35cc06d250 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.487+0000 7f35d3c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f35cc072620 con 0x7f35cc0b3490 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.487+0000 7f35d3c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35cc0b4f30 con 0x7f35cc06d630 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35cc0b3490 0x7f35cc0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35cc0b3490 0x7f35cc0b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59706/0 (socket says 172.21.15.144:59706) 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cbe00640 1 -- 172.21.15.144:0/3469977591 learned_addr learned my addr 172.21.15.144:0/3469977591 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35d1200640 1 --1- 172.21.15.144:0/3469977591 >> v1:172.21.15.165:6789/0 conn(0x7f35cc06d250 0x7f35cc15c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:57800/0 (socket says 172.21.15.144:57800) 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35d1c00640 1 --2- 172.21.15.144:0/3469977591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 0x7f35cc155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cbe00640 1 -- 172.21.15.144:0/3469977591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 msgr2=0x7f35cc155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cbe00640 1 --2- 172.21.15.144:0/3469977591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 0x7f35cc155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cbe00640 1 -- 172.21.15.144:0/3469977591 >> v1:172.21.15.165:6789/0 conn(0x7f35cc06d250 legacy=0x7f35cc15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cbe00640 1 -- 172.21.15.144:0/3469977591 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc0b3950 con 0x7f35cc0b3490 2024-09-12T12:25:15.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cbe00640 1 --2- 172.21.15.144:0/3469977591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc0b3490 0x7f35cc0b49f0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009870 tx=0x7f35b801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126d2f2832b16e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cb400640 1 -- 172.21.15.144:0/3469977591 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80a9610 con 0x7f35cc0b3490 2024-09-12T12:25:15.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cb400640 1 -- 172.21.15.144:0/3469977591 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80a97b0 con 0x7f35cc0b3490 2024-09-12T12:25:15.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.491+0000 7f35cb400640 1 -- 172.21.15.144:0/3469977591 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80a9b80 con 0x7f35cc0b3490 2024-09-12T12:25:15.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 -- 172.21.15.144:0/3469977591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc0b3490 msgr2=0x7f35cc0b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 --2- 172.21.15.144:0/3469977591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc0b3490 0x7f35cc0b49f0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009870 tx=0x7f35b801c530 comp rx=0 tx=0).stop 2024-09-12T12:25:15.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 -- 172.21.15.144:0/3469977591 shutdown_connections 2024-09-12T12:25:15.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 --2- 172.21.15.144:0/3469977591 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 0x7f35cc155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 --2- 172.21.15.144:0/3469977591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc0b3490 0x7f35cc0b49f0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 -- 172.21.15.144:0/3469977591 >> 172.21.15.144:0/3469977591 conn(0x7f35cc06bc10 msgr2=0x7f35cc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 -- 172.21.15.144:0/3469977591 shutdown_connections 2024-09-12T12:25:15.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 -- 172.21.15.144:0/3469977591 wait complete. 2024-09-12T12:25:15.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 Processor -- start 2024-09-12T12:25:15.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 -- start start 2024-09-12T12:25:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc06d250 0x7f35cc141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 0x7f35cc0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc0b3490 0x7f35cc149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc0b44d0 con 0x7f35cc06d250 2024-09-12T12:25:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc0b41f0 con 0x7f35cc0b3490 2024-09-12T12:25:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d3c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35cc15d690 con 0x7f35cc06d630 2024-09-12T12:25:15.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc06d250 0x7f35cc141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc06d250 0x7f35cc141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59710/0 (socket says 172.21.15.144:59710) 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d1200640 1 -- 172.21.15.144:0/838129087 learned_addr learned my addr 172.21.15.144:0/838129087 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d1c00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc0b3490 0x7f35cc149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35cbe00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 0x7f35cc0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d1200640 1 -- 172.21.15.144:0/838129087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 msgr2=0x7f35cc0c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d1200640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 0x7f35cc0c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d1200640 1 -- 172.21.15.144:0/838129087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc0b3490 msgr2=0x7f35cc149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d1200640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc0b3490 0x7f35cc149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.495+0000 7f35d1200640 1 -- 172.21.15.144:0/838129087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc0ca150 con 0x7f35cc06d250 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35d1200640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc06d250 0x7f35cc141e90 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c420 tx=0x7f35bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35c8c00640 1 -- 172.21.15.144:0/838129087 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc0074e0 con 0x7f35cc06d250 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35c8c00640 1 -- 172.21.15.144:0/838129087 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc007680 con 0x7f35cc06d250 2024-09-12T12:25:15.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35d3c00640 1 -- 172.21.15.144:0/838129087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35cc0ca430 con 0x7f35cc06d250 2024-09-12T12:25:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35c8c00640 1 -- 172.21.15.144:0/838129087 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc004a30 con 0x7f35cc06d250 2024-09-12T12:25:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35d3c00640 1 -- 172.21.15.144:0/838129087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35cc0ca9f0 con 0x7f35cc06d250 2024-09-12T12:25:15.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35c8c00640 1 -- 172.21.15.144:0/838129087 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35bc01a020 con 0x7f35cc06d250 2024-09-12T12:25:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35c8c00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35ac0678f0 0x7f35ac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35c8c00640 1 -- 172.21.15.144:0/838129087 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f35bc085620 con 0x7f35cc06d250 2024-09-12T12:25:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35cbe00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35ac0678f0 0x7f35ac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35d7008000 1 Processor -- start 2024-09-12T12:25:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.499+0000 7f35d7008000 1 -- start start 2024-09-12T12:25:15.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35cbe00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35ac0678f0 0x7f35ac069db0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f35b80ae000 tx=0x7f35b80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a53cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53d160 0x55f17a4f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 0x55f17a4f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f17a340b20 con 0x55f17a53c840 2024-09-12T12:25:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f17a2fb870 con 0x55f17a4f3000 2024-09-12T12:25:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f17a33cae0 con 0x55f17a53d160 2024-09-12T12:25:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a53cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a53cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59716/0 (socket says 172.21.15.144:59716) 2024-09-12T12:25:15.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1200640 1 -- 172.21.15.144:0/2550025283 learned_addr learned my addr 172.21.15.144:0/2550025283 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35cbe00640 1 --2- 172.21.15.144:0/2550025283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53d160 0x55f17a4f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1c00640 1 --2- 172.21.15.144:0/2550025283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 0x55f17a4f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1200640 1 -- 172.21.15.144:0/2550025283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53d160 msgr2=0x55f17a4f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1200640 1 --2- 172.21.15.144:0/2550025283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53d160 0x55f17a4f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1200640 1 -- 172.21.15.144:0/2550025283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 msgr2=0x55f17a4f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1200640 1 --2- 172.21.15.144:0/2550025283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 0x55f17a4f33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1200640 1 -- 172.21.15.144:0/2550025283 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f17a313940 con 0x55f17a53c840 2024-09-12T12:25:15.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d1200640 1 --2- 172.21.15.144:0/2550025283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a53cc20 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f35bc083890 tx=0x7f35bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b218e31e38b817 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35c1600640 1 -- 172.21.15.144:0/2550025283 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc05c070 con 0x55f17a53c840 2024-09-12T12:25:15.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35c1600640 1 -- 172.21.15.144:0/2550025283 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc053b30 con 0x55f17a53c840 2024-09-12T12:25:15.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35c1600640 1 -- 172.21.15.144:0/2550025283 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc055a90 con 0x55f17a53c840 2024-09-12T12:25:15.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 -- 172.21.15.144:0/2550025283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 msgr2=0x55f17a53cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 --2- 172.21.15.144:0/2550025283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a53cc20 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f35bc083890 tx=0x7f35bc00cf90 comp rx=0 tx=0).stop 2024-09-12T12:25:15.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 -- 172.21.15.144:0/2550025283 shutdown_connections 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 --2- 172.21.15.144:0/2550025283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 0x55f17a4f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 --2- 172.21.15.144:0/2550025283 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53d160 0x55f17a4f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 --2- 172.21.15.144:0/2550025283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a53cc20 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 -- 172.21.15.144:0/2550025283 >> 172.21.15.144:0/2550025283 conn(0x55f17a4f9160 msgr2=0x55f17a4f13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 -- 172.21.15.144:0/2550025283 shutdown_connections 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 -- 172.21.15.144:0/2550025283 wait complete. 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 -- start start 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.503+0000 7f35d7008000 1 Processor -- start 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 0x55f17a529710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53c840 0x55f17a4f7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53d160 0x55f17a4f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f17a30d8e0 con 0x55f17a53d160 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f17a2e49b0 con 0x55f17a4f3000 2024-09-12T12:25:15.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f17a308260 con 0x55f17a53c840 2024-09-12T12:25:15.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 10 client.0 _ll_register_callbacks cb 0x55f17a4de540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:15.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53d160 0x55f17a4f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53d160 0x55f17a4f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59732/0 (socket says 172.21.15.144:59732) 2024-09-12T12:25:15.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1c00640 1 -- 172.21.15.144:0/547688317 learned_addr learned my addr 172.21.15.144:0/547688317 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1200640 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 0x55f17a529710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35cbe00640 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53c840 0x55f17a4f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1c00640 1 -- 172.21.15.144:0/547688317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53c840 msgr2=0x55f17a4f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1c00640 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53c840 0x55f17a4f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1c00640 1 -- 172.21.15.144:0/547688317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 msgr2=0x55f17a529710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1c00640 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 0x55f17a529710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1c00640 1 -- 172.21.15.144:0/547688317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17a2fbac0 con 0x55f17a53d160 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1c00640 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53d160 0x55f17a4f7e60 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009fd0 tx=0x7f35c4013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22fd937ddfee418 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 1 -- 172.21.15.144:0/547688317 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c401c070 con 0x55f17a53d160 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 1 -- 172.21.15.144:0/547688317 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f35c4016630 con 0x55f17a53d160 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- 172.21.15.144:0/547688317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35bc053b30 con 0x55f17a53d160 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 1 -- 172.21.15.144:0/547688317 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7f35c4027050 con 0x55f17a53d160 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 10 client.10389 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- 172.21.15.144:0/547688317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x55f17a2e0810 con 0x55f17a53d160 2024-09-12T12:25:15.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 1 -- 172.21.15.144:0/547688317 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc053b30 con 0x55f17a53d160 2024-09-12T12:25:15.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 1 -- 172.21.15.144:0/547688317 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7f35c402a020 con 0x55f17a53d160 2024-09-12T12:25:15.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 10 client.10389 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:15.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 10 client.10389 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:15.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 20 client.10389 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:15.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55f17a52a710 0x55f17a54d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 4 client.10389 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:15.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- 172.21.15.144:0/547688317 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f17a2dae30 con 0x55f17a52a710 2024-09-12T12:25:15.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1200640 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55f17a52a710 0x55f17a54d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d1200640 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55f17a52a710 0x55f17a54d8e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ecf627ec78696a server_cookie=868d762cc85f43ec in_seq=0 out_seq=0 2024-09-12T12:25:15.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 10 client.10389 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:15.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 1 -- 172.21.15.144:0/547688317 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f17a2dae30 con 0x55f17a52a710 2024-09-12T12:25:15.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 10 client.10389 handle_command_reply: tid=0 2024-09-12T12:25:15.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 client.10389 shutdown 2024-09-12T12:25:15.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- 172.21.15.144:0/547688317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53d160 msgr2=0x55f17a4f7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53d160 0x55f17a4f7e60 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009fd0 tx=0x7f35c4013680 comp rx=0 tx=0).stop 2024-09-12T12:25:15.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- 172.21.15.144:0/547688317 shutdown_connections 2024-09-12T12:25:15.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55f17a52a710 0x55f17a54d8e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53d160 0x55f17a4f7e60 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a53c840 0x55f17a4f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 --2- 172.21.15.144:0/547688317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f3000 0x55f17a529710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35b6000640 0 client.10389 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:15.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- 172.21.15.144:0/547688317 >> 172.21.15.144:0/547688317 conn(0x55f17a4f9160 msgr2=0x55f17a4f13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- 172.21.15.144:0/547688317 shutdown_connections 2024-09-12T12:25:15.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 1 -- 172.21.15.144:0/547688317 wait complete. 2024-09-12T12:25:15.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.507+0000 7f35d7008000 20 client.10389 trim_cache size 0 max 16384 2024-09-12T12:25:15.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d7008000 1 Processor -- start 2024-09-12T12:25:15.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d7008000 1 -- start start 2024-09-12T12:25:15.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d7008000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f9160 0x55f17a4f4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d7008000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a4f3000 0x55f17a4f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d7008000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a53c840 0x55f17a54d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d7008000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc2042b0 con 0x55f17a4f3000 2024-09-12T12:25:15.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d7008000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc2032f0 con 0x55f17a53c840 2024-09-12T12:25:15.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d7008000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35cc1446b0 con 0x55f17a4f9160 2024-09-12T12:25:15.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a4f3000 0x55f17a4f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a4f3000 0x55f17a4f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59738/0 (socket says 172.21.15.144:59738) 2024-09-12T12:25:15.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35cbe00640 1 -- 172.21.15.144:0/1445658661 learned_addr learned my addr 172.21.15.144:0/1445658661 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d1c00640 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a53c840 0x55f17a54d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d1200640 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f9160 0x55f17a4f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35cbe00640 1 -- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f9160 msgr2=0x55f17a4f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35cbe00640 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f9160 0x55f17a4f4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35cbe00640 1 -- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a53c840 msgr2=0x55f17a54d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35cbe00640 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a53c840 0x55f17a54d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35cbe00640 1 -- 172.21.15.144:0/1445658661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f17a2fe240 con 0x55f17a4f3000 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d1c00640 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a53c840 0x55f17a54d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35d1200640 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f9160 0x55f17a4f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35cbe00640 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a4f3000 0x55f17a4f4b40 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009870 tx=0x7f35b8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3eef884ac47388 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35c0c00640 1 -- 172.21.15.144:0/1445658661 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80be410 con 0x55f17a4f3000 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35c0c00640 1 -- 172.21.15.144:0/1445658661 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80be5b0 con 0x55f17a4f3000 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.527+0000 7f35c0c00640 1 -- 172.21.15.144:0/1445658661 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80be760 con 0x55f17a4f3000 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 -- 172.21.15.144:0/1445658661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a4f3000 msgr2=0x55f17a4f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a4f3000 0x55f17a4f4b40 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009870 tx=0x7f35b8004740 comp rx=0 tx=0).stop 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 -- 172.21.15.144:0/1445658661 shutdown_connections 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a53c840 0x55f17a54d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a4f3000 0x55f17a4f4b40 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 --2- 172.21.15.144:0/1445658661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f9160 0x55f17a4f4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 -- 172.21.15.144:0/1445658661 >> 172.21.15.144:0/1445658661 conn(0x55f17a53bf90 msgr2=0x55f17a4f7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 -- 172.21.15.144:0/1445658661 shutdown_connections 2024-09-12T12:25:15.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 -- 172.21.15.144:0/1445658661 wait complete. 2024-09-12T12:25:15.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 -- start start 2024-09-12T12:25:15.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 Processor -- start 2024-09-12T12:25:15.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f3000 0x55f17a550770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f9160 0x55f17a56bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a56c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f17a30d520 con 0x55f17a53c840 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc202ca0 con 0x55f17a4f9160 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55f17a33fe30 con 0x55f17a4f3000 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d7008000 10 client.0 _ll_register_callbacks cb 0x7f35c4009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a56c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35cbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f9160 0x55f17a56bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f3000 0x55f17a550770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a56c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59752/0 (socket says 172.21.15.144:59752) 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d1c00640 1 -- 172.21.15.144:0/133421771 learned_addr learned my addr 172.21.15.144:0/133421771 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35cbe00640 1 -- 172.21.15.144:0/133421771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f3000 msgr2=0x55f17a550770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35cbe00640 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f3000 0x55f17a550770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35cbe00640 1 -- 172.21.15.144:0/133421771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 msgr2=0x55f17a56c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35cbe00640 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a56c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35cbe00640 1 -- 172.21.15.144:0/133421771 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17a3c3330 con 0x55f17a4f9160 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35d1c00640 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a56c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35cbe00640 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f9160 0x55f17a56bbd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f35b801c570 tx=0x7f35b801ad70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81af93805567c39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.531+0000 7f35b6000640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35b6000640 1 -- 172.21.15.144:0/133421771 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80d6060 con 0x55f17a4f9160 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35b6000640 1 -- 172.21.15.144:0/133421771 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f35b80d1400 con 0x55f17a4f9160 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 -- 172.21.15.144:0/133421771 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35b80be5b0 con 0x55f17a4f9160 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35b6000640 1 -- 172.21.15.144:0/133421771 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7f35b80dc050 con 0x55f17a4f9160 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 10 client.9802 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 -- 172.21.15.144:0/133421771 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x55f179ffb400 con 0x55f17a4f9160 2024-09-12T12:25:15.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35b6000640 1 -- 172.21.15.144:0/133421771 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80be5b0 con 0x55f17a4f9160 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35b6000640 1 -- 172.21.15.144:0/133421771 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7f35b80df020 con 0x55f17a4f9160 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 10 client.9802 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 10 client.9802 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 20 client.9802 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55f17a53d160 0x55f17a56c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 4 client.9802 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 -- 172.21.15.144:0/133421771 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55f17a34e250 con 0x55f17a53d160 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d1200640 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55f17a53d160 0x55f17a56c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d1200640 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55f17a53d160 0x55f17a56c650 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a38b5e09978192f server_cookie=7b4c9b425799af71 in_seq=0 out_seq=0 2024-09-12T12:25:15.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35b6000640 10 client.9802 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:15.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35b6000640 1 -- 172.21.15.144:0/133421771 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f17a34e250 con 0x55f17a53d160 2024-09-12T12:25:15.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35b6000640 10 client.9802 handle_command_reply: tid=0 2024-09-12T12:25:15.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 client.9802 shutdown 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 -- 172.21.15.144:0/133421771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f9160 msgr2=0x55f17a56bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f9160 0x55f17a56bbd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f35b801c570 tx=0x7f35b801ad70 comp rx=0 tx=0).stop 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 -- 172.21.15.144:0/133421771 shutdown_connections 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55f17a53d160 0x55f17a56c650 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f17a53c840 0x55f17a56c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f17a4f9160 0x55f17a56bbd0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 --2- 172.21.15.144:0/133421771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55f17a4f3000 0x55f17a550770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 -- 172.21.15.144:0/133421771 >> 172.21.15.144:0/133421771 conn(0x55f17a53bf90 msgr2=0x55f17a4f35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35b6000640 0 client.9802 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 -- 172.21.15.144:0/133421771 shutdown_connections 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 1 -- 172.21.15.144:0/133421771 wait complete. 2024-09-12T12:25:15.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d7008000 20 client.9802 trim_cache size 0 max 16384 2024-09-12T12:25:15.541 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:25:15.541 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:25:15.541 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "65af2152-7597-4443-907c-f82e79eab56c", 2024-09-12T12:25:15.541 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:25:15.541 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 -- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35ac0678f0 msgr2=0x7f35ac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35ac0678f0 0x7f35ac069db0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f35b80ae000 tx=0x7f35b80a7000 comp rx=0 tx=0).stop 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 -- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc06d250 msgr2=0x7f35cc141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc06d250 0x7f35cc141e90 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c420 tx=0x7f35bc00c8e0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 -- 172.21.15.144:0/838129087 shutdown_connections 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f35ac0678f0 0x7f35ac069db0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc0b3490 0x7f35cc149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35cc06d630 0x7f35cc0c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 --2- 172.21.15.144:0/838129087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc06d250 0x7f35cc141e90 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 -- 172.21.15.144:0/838129087 >> 172.21.15.144:0/838129087 conn(0x7f35cc06bc10 msgr2=0x7f35cc15c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 -- 172.21.15.144:0/838129087 shutdown_connections 2024-09-12T12:25:15.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.535+0000 7f35d3c00640 1 -- 172.21.15.144:0/838129087 wait complete. 2024-09-12T12:25:15.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:15.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-12T12:25:15.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.695+0000 7f1f5de00640 1 Processor -- start 2024-09-12T12:25:15.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.695+0000 7f1f5de00640 1 -- start start 2024-09-12T12:25:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f5de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1f5806c320 0x7f1f58166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f5de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f580733e0 con 0x7f1f5815c2e0 2024-09-12T12:25:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f5de00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f580cd290 con 0x7f1f580af5f0 2024-09-12T12:25:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f5de00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1f580cd570 con 0x7f1f5806c320 2024-09-12T12:25:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f56a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1f5815c2e0 0x7f1f58072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55278/0 (socket says 172.21.15.144:55278) 2024-09-12T12:25:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f56a00640 1 -- 172.21.15.144:0/1876118030 learned_addr learned my addr 172.21.15.144:0/1876118030 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f57400640 1 --2- 172.21.15.144:0/1876118030 >> v2:172.21.15.165:3300/0 conn(0x7f1f5806c320 0x7f1f58166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f55600640 1 -- 172.21.15.144:0/1876118030 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862355850 0 0) 0x7f1f580733e0 con 0x7f1f5815c2e0 2024-09-12T12:25:15.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f55600640 1 -- 172.21.15.144:0/1876118030 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f3c003530 con 0x7f1f5815c2e0 2024-09-12T12:25:15.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f57400640 1 -- 172.21.15.144:0/1876118030 >> v1:172.21.15.165:6789/0 conn(0x7f1f580af5f0 legacy=0x7f1f5806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f57400640 1 -- 172.21.15.144:0/1876118030 >> v1:172.21.15.144:6789/0 conn(0x7f1f5815c2e0 legacy=0x7f1f58072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.699+0000 7f1f57400640 1 -- 172.21.15.144:0/1876118030 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f580cd850 con 0x7f1f5806c320 2024-09-12T12:25:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f57400640 1 --2- 172.21.15.144:0/1876118030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5806c320 0x7f1f58166f10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009d90 tx=0x7f1f5001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc750774fca86908 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f55600640 1 -- 172.21.15.144:0/1876118030 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f500b2070 con 0x7f1f5806c320 2024-09-12T12:25:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f55600640 1 -- 172.21.15.144:0/1876118030 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f500a5820 con 0x7f1f5806c320 2024-09-12T12:25:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f55600640 1 -- 172.21.15.144:0/1876118030 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f500a5bf0 con 0x7f1f5806c320 2024-09-12T12:25:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f5de00640 1 -- 172.21.15.144:0/1876118030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5806c320 msgr2=0x7f1f58166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f5de00640 1 --2- 172.21.15.144:0/1876118030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5806c320 0x7f1f58166f10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009d90 tx=0x7f1f5001c850 comp rx=0 tx=0).stop 2024-09-12T12:25:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f5de00640 1 -- 172.21.15.144:0/1876118030 shutdown_connections 2024-09-12T12:25:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f5de00640 1 --2- 172.21.15.144:0/1876118030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5806c320 0x7f1f58166f10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f5de00640 1 -- 172.21.15.144:0/1876118030 >> 172.21.15.144:0/1876118030 conn(0x7f1f58068030 msgr2=0x7f1f580b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f5de00640 1 -- 172.21.15.144:0/1876118030 shutdown_connections 2024-09-12T12:25:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f5de00640 1 -- 172.21.15.144:0/1876118030 wait complete. 2024-09-12T12:25:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f5de00640 1 Processor -- start 2024-09-12T12:25:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.703+0000 7f1f5de00640 1 -- start start 2024-09-12T12:25:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f5de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f5806c320 0x7f1f580b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f5de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f580af5f0 0x7f1f58155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f5de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5815c2e0 0x7f1f58153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f5de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5816a000 con 0x7f1f5806c320 2024-09-12T12:25:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f5de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58169e80 con 0x7f1f5815c2e0 2024-09-12T12:25:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f5de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5816a180 con 0x7f1f580af5f0 2024-09-12T12:25:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f5806c320 0x7f1f580b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f5806c320 0x7f1f580b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59764/0 (socket says 172.21.15.144:59764) 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56a00640 1 -- 172.21.15.144:0/2576939977 learned_addr learned my addr 172.21.15.144:0/2576939977 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f57400640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5815c2e0 0x7f1f58153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56000640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f580af5f0 0x7f1f58155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56a00640 1 -- 172.21.15.144:0/2576939977 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f580af5f0 msgr2=0x7f1f58155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56a00640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f580af5f0 0x7f1f58155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56a00640 1 -- 172.21.15.144:0/2576939977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5815c2e0 msgr2=0x7f1f58153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56a00640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5815c2e0 0x7f1f58153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56a00640 1 -- 172.21.15.144:0/2576939977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f580aec90 con 0x7f1f5806c320 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f56a00640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f5806c320 0x7f1f580b4e50 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800c420 tx=0x7f1f4800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f4f400640 1 -- 172.21.15.144:0/2576939977 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48017070 con 0x7f1f5806c320 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f4f400640 1 -- 172.21.15.144:0/2576939977 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f48005cf0 con 0x7f1f5806c320 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f5de00640 1 -- 172.21.15.144:0/2576939977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f580aef50 con 0x7f1f5806c320 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f4f400640 1 -- 172.21.15.144:0/2576939977 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f480072d0 con 0x7f1f5806c320 2024-09-12T12:25:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f5de00640 1 -- 172.21.15.144:0/2576939977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f58157780 con 0x7f1f5806c320 2024-09-12T12:25:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.707+0000 7f1f4f400640 1 -- 172.21.15.144:0/2576939977 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f4801a070 con 0x7f1f5806c320 2024-09-12T12:25:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f4f400640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f380678c0 0x7f1f38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f4f400640 1 -- 172.21.15.144:0/2576939977 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f1f480851a0 con 0x7f1f5806c320 2024-09-12T12:25:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f380678c0 0x7f1f38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f610f6000 1 Processor -- start 2024-09-12T12:25:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f610f6000 1 -- start start 2024-09-12T12:25:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f380678c0 0x7f1f38069d80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1f58156770 tx=0x7f1f44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d31a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d31a690 0x55c26d2cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d2ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f610f6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c26d1b7960 con 0x55c26d31a690 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f610f6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c26d0fb900 con 0x55c26d319d70 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f610f6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c26d11ed40 con 0x55c26d2cddb0 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d31a690 0x55c26d2cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d31a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d31a690 0x55c26d2cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59780/0 (socket says 172.21.15.144:59780) 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 -- 172.21.15.144:0/3526926322 learned_addr learned my addr 172.21.15.144:0/3526926322 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f57400640 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d2ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 -- 172.21.15.144:0/3526926322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 msgr2=0x55c26d2ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d2ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 -- 172.21.15.144:0/3526926322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 msgr2=0x55c26d31a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d31a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 -- 172.21.15.144:0/3526926322 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26d0c5580 con 0x55c26d31a690 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56a00640 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d31a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f57400640 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d2ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f56000640 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d31a690 0x55c26d2cd870 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f1f44001560 tx=0x7f1f44011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b865e569f1dc58fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f43e00640 1 -- 172.21.15.144:0/3526926322 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44003600 con 0x55c26d31a690 2024-09-12T12:25:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f43e00640 1 -- 172.21.15.144:0/3526926322 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f440037a0 con 0x55c26d31a690 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.711+0000 7f1f43e00640 1 -- 172.21.15.144:0/3526926322 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44003b50 con 0x55c26d31a690 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- 172.21.15.144:0/3526926322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d31a690 msgr2=0x55c26d2cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d31a690 0x55c26d2cd870 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f1f44001560 tx=0x7f1f44011000 comp rx=0 tx=0).stop 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- 172.21.15.144:0/3526926322 shutdown_connections 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d2ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d31a690 0x55c26d2cd870 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 --2- 172.21.15.144:0/3526926322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d31a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- 172.21.15.144:0/3526926322 >> 172.21.15.144:0/3526926322 conn(0x55c26d2fb040 msgr2=0x55c26d2fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- 172.21.15.144:0/3526926322 shutdown_connections 2024-09-12T12:25:15.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- 172.21.15.144:0/3526926322 wait complete. 2024-09-12T12:25:15.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- start start 2024-09-12T12:25:15.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 Processor -- start 2024-09-12T12:25:15.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d320ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d321220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 0x55c26d321760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c26d11ad00 con 0x55c26d319d70 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c26d0d9aa0 con 0x55c26d31a690 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c26d0b8340 con 0x55c26d2cddb0 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 10 client.0 _ll_register_callbacks cb 0x55c26d2bb760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d321220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d321220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59788/0 (socket says 172.21.15.144:59788) 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56000640 1 -- 172.21.15.144:0/1869453716 learned_addr learned my addr 172.21.15.144:0/1869453716 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56a00640 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d320ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f57400640 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 0x55c26d321760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56000640 1 -- 172.21.15.144:0/1869453716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 msgr2=0x55c26d320ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56000640 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d320ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56000640 1 -- 172.21.15.144:0/1869453716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 msgr2=0x55c26d321760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56000640 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 0x55c26d321760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56000640 1 -- 172.21.15.144:0/1869453716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26d0c1dc0 con 0x55c26d319d70 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f56000640 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d321220 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x55c26d0e2c90 tx=0x7f1f44000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6beebf505f2630e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f40c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f40c00640 1 -- 172.21.15.144:0/1869453716 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44003600 con 0x55c26d319d70 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f40c00640 1 -- 172.21.15.144:0/1869453716 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f1f4402dc60 con 0x55c26d319d70 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.715+0000 7f1f610f6000 1 -- 172.21.15.144:0/1869453716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f440037a0 con 0x55c26d319d70 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f40c00640 1 -- 172.21.15.144:0/1869453716 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7f1f44034050 con 0x55c26d319d70 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 10 client.10407 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:15.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 -- 172.21.15.144:0/1869453716 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x55c26d0be7f0 con 0x55c26d319d70 2024-09-12T12:25:15.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f40c00640 1 -- 172.21.15.144:0/1869453716 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f440037a0 con 0x55c26d319d70 2024-09-12T12:25:15.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f40c00640 1 -- 172.21.15.144:0/1869453716 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7f1f44037020 con 0x55c26d319d70 2024-09-12T12:25:15.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 10 client.10407 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:15.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 10 client.10407 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 20 client.10407 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55c26d3290b0 0x55c26d32b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 4 client.10407 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 -- 172.21.15.144:0/1869453716 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c26d0b8e10 con 0x55c26d3290b0 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f56a00640 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55c26d3290b0 0x55c26d32b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f56a00640 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55c26d3290b0 0x55c26d32b4a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9427a0991aa51abd server_cookie=b7bf5bf20960339f in_seq=0 out_seq=0 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f40c00640 10 client.10407 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f40c00640 1 -- 172.21.15.144:0/1869453716 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c26d0b8e10 con 0x55c26d3290b0 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f40c00640 10 client.10407 handle_command_reply: tid=0 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 client.10407 shutdown 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 -- 172.21.15.144:0/1869453716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 msgr2=0x55c26d321220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d321220 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x55c26d0e2c90 tx=0x7f1f44000ee0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 -- 172.21.15.144:0/1869453716 shutdown_connections 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55c26d3290b0 0x55c26d32b4a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 0x55c26d321760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d321220 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f40c00640 0 client.10407 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:15.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 --2- 172.21.15.144:0/1869453716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d320ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 -- 172.21.15.144:0/1869453716 >> 172.21.15.144:0/1869453716 conn(0x55c26d2fb040 msgr2=0x55c26d2ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 -- 172.21.15.144:0/1869453716 shutdown_connections 2024-09-12T12:25:15.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 1 -- 172.21.15.144:0/1869453716 wait complete. 2024-09-12T12:25:15.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.719+0000 7f1f610f6000 20 client.10407 trim_cache size 0 max 16384 2024-09-12T12:25:15.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.739+0000 7f1f610f6000 1 Processor -- start 2024-09-12T12:25:15.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.739+0000 7f1f610f6000 1 -- start start 2024-09-12T12:25:15.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d3893c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d389900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 0x55c26d389e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58204010 con 0x55c26d319d70 2024-09-12T12:25:15.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58203050 con 0x55c26d31a690 2024-09-12T12:25:15.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1f580b4590 con 0x55c26d2cddb0 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d389900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d389900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59792/0 (socket says 172.21.15.144:59792) 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56000640 1 -- 172.21.15.144:0/610943313 learned_addr learned my addr 172.21.15.144:0/610943313 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56a00640 1 --2- 172.21.15.144:0/610943313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d3893c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f57400640 1 --2- 172.21.15.144:0/610943313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 0x55c26d389e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56000640 1 -- 172.21.15.144:0/610943313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 msgr2=0x55c26d3893c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56000640 1 --2- 172.21.15.144:0/610943313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d3893c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56000640 1 -- 172.21.15.144:0/610943313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 msgr2=0x55c26d389e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56000640 1 --2- 172.21.15.144:0/610943313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 0x55c26d389e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56000640 1 -- 172.21.15.144:0/610943313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26d2d3960 con 0x55c26d319d70 2024-09-12T12:25:15.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f56000640 1 --2- 172.21.15.144:0/610943313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d389900 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000f70 tx=0x7f1f44029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e01a70344f1d46a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f43400640 1 -- 172.21.15.144:0/610943313 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44003600 con 0x55c26d319d70 2024-09-12T12:25:15.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f43400640 1 -- 172.21.15.144:0/610943313 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f440037a0 con 0x55c26d319d70 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f43400640 1 -- 172.21.15.144:0/610943313 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44021710 con 0x55c26d319d70 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 -- 172.21.15.144:0/610943313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 msgr2=0x55c26d389900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 --2- 172.21.15.144:0/610943313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d389900 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000f70 tx=0x7f1f44029000 comp rx=0 tx=0).stop 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 -- 172.21.15.144:0/610943313 shutdown_connections 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 --2- 172.21.15.144:0/610943313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d31a690 0x55c26d389e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 --2- 172.21.15.144:0/610943313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d319d70 0x55c26d389900 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 --2- 172.21.15.144:0/610943313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d2cddb0 0x55c26d3893c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 -- 172.21.15.144:0/610943313 >> 172.21.15.144:0/610943313 conn(0x55c26d2fb040 msgr2=0x55c26d2d4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 -- 172.21.15.144:0/610943313 shutdown_connections 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 -- 172.21.15.144:0/610943313 wait complete. 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 -- start start 2024-09-12T12:25:15.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.743+0000 7f1f610f6000 1 Processor -- start 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d2cddb0 0x55c26d326950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d38c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d31a690 0x55c26d38cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58202a00 con 0x55c26d2cddb0 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c26d0b8480 con 0x55c26d319d70 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55c26d0e6400 con 0x55c26d31a690 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 10 client.0 _ll_register_callbacks cb 0x7f1f48055230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d2cddb0 0x55c26d326950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d2cddb0 0x55c26d326950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59796/0 (socket says 172.21.15.144:59796) 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56a00640 1 -- 172.21.15.144:0/229052140 learned_addr learned my addr 172.21.15.144:0/229052140 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56000640 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d38c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f57400640 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d31a690 0x55c26d38cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56a00640 1 -- 172.21.15.144:0/229052140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d31a690 msgr2=0x55c26d38cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56a00640 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d31a690 0x55c26d38cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56a00640 1 -- 172.21.15.144:0/229052140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 msgr2=0x55c26d38c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56a00640 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d38c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56a00640 1 -- 172.21.15.144:0/229052140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26d0dc470 con 0x55c26d2cddb0 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56000640 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d38c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56a00640 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d2cddb0 0x55c26d326950 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800cde0 tx=0x7f1f48083370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd6597523c0d507 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 1 -- 172.21.15.144:0/229052140 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48053820 con 0x55c26d2cddb0 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 1 -- 172.21.15.144:0/229052140 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 6101+0+0 (secure 0 0 0) 0x7f1f48007470 con 0x55c26d2cddb0 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- 172.21.15.144:0/229052140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f440037a0 con 0x55c26d2cddb0 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 1 -- 172.21.15.144:0/229052140 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7f1f48083120 con 0x55c26d2cddb0 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 10 client.10413 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- 172.21.15.144:0/229052140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x55c26d0b2640 con 0x55c26d2cddb0 2024-09-12T12:25:15.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 1 -- 172.21.15.144:0/229052140 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f440037a0 con 0x55c26d2cddb0 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 1 -- 172.21.15.144:0/229052140 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7f1f480548b0 con 0x55c26d2cddb0 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 10 client.10413 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 10 client.10413 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 20 client.10413 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55c26d349790 0x55c26d349ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 4 client.10413 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- 172.21.15.144:0/229052140 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c26d12c470 con 0x55c26d349790 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56000640 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55c26d349790 0x55c26d349ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f56000640 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55c26d349790 0x55c26d349ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeaf502534b3e0a9 server_cookie=daaf6c2efb14c364 in_seq=0 out_seq=0 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 10 client.10413 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 1 -- 172.21.15.144:0/229052140 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x55c26d12c470 con 0x55c26d349790 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 10 client.10413 handle_command_reply: tid=0 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 client.10413 shutdown 2024-09-12T12:25:15.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- 172.21.15.144:0/229052140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d2cddb0 msgr2=0x55c26d326950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d2cddb0 0x55c26d326950 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800cde0 tx=0x7f1f48083370 comp rx=0 tx=0).stop 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- 172.21.15.144:0/229052140 shutdown_connections 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55c26d349790 0x55c26d349ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55c26d31a690 0x55c26d38cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c26d319d70 0x55c26d38c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 --2- 172.21.15.144:0/229052140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c26d2cddb0 0x55c26d326950 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f40c00640 0 client.10413 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- 172.21.15.144:0/229052140 >> 172.21.15.144:0/229052140 conn(0x55c26d2fb040 msgr2=0x55c26d2d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- 172.21.15.144:0/229052140 shutdown_connections 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 1 -- 172.21.15.144:0/229052140 wait complete. 2024-09-12T12:25:15.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f610f6000 20 client.10413 trim_cache size 0 max 16384 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout: "65af2152-7597-4443-907c-f82e79eab56c": { 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "~mds0", 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "65af2152-7597-4443-907c-f82e79eab56c", 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "recursive" 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:15.754 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:25:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 -- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f380678c0 msgr2=0x7f1f38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f380678c0 0x7f1f38069d80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1f58156770 tx=0x7f1f44009040 comp rx=0 tx=0).stop 2024-09-12T12:25:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 -- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f5806c320 msgr2=0x7f1f580b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f5806c320 0x7f1f580b4e50 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800c420 tx=0x7f1f4800c8e0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 -- 172.21.15.144:0/2576939977 shutdown_connections 2024-09-12T12:25:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1f380678c0 0x7f1f38069d80 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f5815c2e0 0x7f1f58153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f580af5f0 0x7f1f58155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 --2- 172.21.15.144:0/2576939977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f5806c320 0x7f1f580b4e50 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:15.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.747+0000 7f1f5de00640 1 -- 172.21.15.144:0/2576939977 >> 172.21.15.144:0/2576939977 conn(0x7f1f58068030 msgr2=0x7f1f5815b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:15.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.751+0000 7f1f5de00640 1 -- 172.21.15.144:0/2576939977 shutdown_connections 2024-09-12T12:25:15.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:15.751+0000 7f1f5de00640 1 -- 172.21.15.144:0/2576939977 wait complete. 2024-09-12T12:25:15.770 INFO:tasks.cephfs.filesystem:scrub status for tag:65af2152-7597-4443-907c-f82e79eab56c - {'path': '~mds0', 'tag': '65af2152-7597-4443-907c-f82e79eab56c', 'options': 'recursive'} 2024-09-12T12:25:16.711 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:25:16.715 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:25:45.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:45.771 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-12T12:25:45.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.918+0000 7f4405e00640 1 Processor -- start 2024-09-12T12:25:45.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.918+0000 7f4405e00640 1 -- start start 2024-09-12T12:25:45.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f4405e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44000cd9f0 0x7f440006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f4405e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44000b4300 con 0x7f440015af60 2024-09-12T12:25:45.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f4405e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44000b3540 con 0x7f440015b340 2024-09-12T12:25:45.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f4405e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44000b32f0 con 0x7f44000cd9f0 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f440015af60 0x7f44000ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55990/0 (socket says 172.21.15.144:55990) 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fea00640 1 -- 172.21.15.144:0/2748717506 learned_addr learned my addr 172.21.15.144:0/2748717506 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fe000640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44000cd9f0 0x7f440006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826570348 0 0) 0x7f44000b4300 con 0x7f440015af60 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e4003530 con 0x7f440015af60 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1808321685 0 0) 0x7f43e4003530 con 0x7f440015af60 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44000cd9f0 msgr2=0x7f440006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44000cd9f0 0x7f440006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 >> v1:172.21.15.165:6789/0 conn(0x7f440015b340 legacy=0x7f44000b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44000b3820 con 0x7f440015af60 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f43f0001680 con 0x7f440015af60 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 >> v1:172.21.15.144:6789/0 conn(0x7f440015af60 legacy=0x7f44000ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44000cd9f0 0x7f43e40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e4003f70 0x7f43e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43e4004d50 0x7f43e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f44000b32f0 con 0x7f43e4003f70 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f43e400bb40 con 0x7f43e4004d50 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f43e400df50 con 0x7f44000cd9f0 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fe000640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e4003f70 0x7f43e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fea00640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44000cd9f0 0x7f43e40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43ff400640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43e4004d50 0x7f43e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fe000640 1 -- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44000cd9f0 msgr2=0x7f43e40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fe000640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f44000cd9f0 0x7f43e40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fe000640 1 -- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43e4004d50 msgr2=0x7f43e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fe000640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43e4004d50 0x7f43e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.922+0000 7f43fe000640 1 -- 172.21.15.144:0/2748717506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e4003530 con 0x7f43e4003f70 2024-09-12T12:25:45.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f43fe000640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e4003f70 0x7f43e4004810 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009ab0 tx=0x7f43ec01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b312ee9c7395d39d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:45.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0b2070 con 0x7f43e4003f70 2024-09-12T12:25:45.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec0a5640 con 0x7f43e4003f70 2024-09-12T12:25:45.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f43fd600640 1 -- 172.21.15.144:0/2748717506 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0096b0 con 0x7f43e4003f70 2024-09-12T12:25:45.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f4405e00640 1 -- 172.21.15.144:0/2748717506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e4003f70 msgr2=0x7f43e4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f4405e00640 1 --2- 172.21.15.144:0/2748717506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43e4003f70 0x7f43e4004810 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009ab0 tx=0x7f43ec01ca50 comp rx=0 tx=0).stop 2024-09-12T12:25:45.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f43ff400640 1 -- 172.21.15.144:0/2748717506 reap_dead start 2024-09-12T12:25:45.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f4405e00640 1 -- 172.21.15.144:0/2748717506 shutdown_connections 2024-09-12T12:25:45.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f4405e00640 1 -- 172.21.15.144:0/2748717506 >> 172.21.15.144:0/2748717506 conn(0x7f4400068030 msgr2=0x7f44000b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:45.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f4405e00640 1 -- 172.21.15.144:0/2748717506 shutdown_connections 2024-09-12T12:25:45.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f4405e00640 1 -- 172.21.15.144:0/2748717506 wait complete. 2024-09-12T12:25:45.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f4405e00640 1 Processor -- start 2024-09-12T12:25:45.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.926+0000 7f4405e00640 1 -- start start 2024-09-12T12:25:45.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f4405e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43e4003f70 0x7f440014b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f4405e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f440015c220 0x7f440015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f4405e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440014cf60 0x7f440014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f4405e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f440006bc10 con 0x7f440015c220 2024-09-12T12:25:45.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f4405e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f44000b3de0 con 0x7f440014cf60 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f4405e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f440006bd90 con 0x7f43e4003f70 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f440015c220 0x7f440015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f440015c220 0x7f440015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47048/0 (socket says 172.21.15.144:47048) 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fe000640 1 -- 172.21.15.144:0/977149997 learned_addr learned my addr 172.21.15.144:0/977149997 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43ff400640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440014cf60 0x7f440014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fea00640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43e4003f70 0x7f440014b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fe000640 1 -- 172.21.15.144:0/977149997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43e4003f70 msgr2=0x7f440014b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fe000640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43e4003f70 0x7f440014b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fe000640 1 -- 172.21.15.144:0/977149997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440014cf60 msgr2=0x7f440014d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fe000640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440014cf60 0x7f440014d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fe000640 1 -- 172.21.15.144:0/977149997 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440015cc80 con 0x7f440015c220 2024-09-12T12:25:45.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43fe000640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f440015c220 0x7f440015c680 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f43ec01c880 tx=0x7f43e4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:45.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43f7400640 1 -- 172.21.15.144:0/977149997 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0bc020 con 0x7f440015c220 2024-09-12T12:25:45.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43f7400640 1 -- 172.21.15.144:0/977149997 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec0ad440 con 0x7f440015c220 2024-09-12T12:25:45.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f43f7400640 1 -- 172.21.15.144:0/977149997 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0b2040 con 0x7f440015c220 2024-09-12T12:25:45.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f4405e00640 1 -- 172.21.15.144:0/977149997 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440015cf60 con 0x7f440015c220 2024-09-12T12:25:45.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.930+0000 7f4405e00640 1 -- 172.21.15.144:0/977149997 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440015d520 con 0x7f440015c220 2024-09-12T12:25:45.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43f7400640 1 -- 172.21.15.144:0/977149997 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f43ec0ad7f0 con 0x7f440015c220 2024-09-12T12:25:45.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43f7400640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43e00678f0 0x7f43e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43f7400640 1 -- 172.21.15.144:0/977149997 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7f43ec120410 con 0x7f440015c220 2024-09-12T12:25:45.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fea00640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43e00678f0 0x7f43e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f44092c7000 1 Processor -- start 2024-09-12T12:25:45.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f44092c7000 1 -- start start 2024-09-12T12:25:45.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fea00640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43e00678f0 0x7f43e0069db0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f43f0000c10 tx=0x7f43f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f44092c7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728ba2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f44092c7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b55870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f44092c7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728b56190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f44092c7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b728a3f960 con 0x55b728ba2690 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f44092c7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b728983900 con 0x55b728ba1d70 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f44092c7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b7289a6d40 con 0x55b728b55db0 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b55870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b55870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47064/0 (socket says 172.21.15.144:47064) 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fe000640 1 -- 172.21.15.144:0/2544078872 learned_addr learned my addr 172.21.15.144:0/2544078872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fea00640 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728ba2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43ff400640 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728b56190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fe000640 1 -- 172.21.15.144:0/2544078872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 msgr2=0x55b728b56190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fe000640 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728b56190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fe000640 1 -- 172.21.15.144:0/2544078872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 msgr2=0x55b728ba2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fe000640 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728ba2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fe000640 1 -- 172.21.15.144:0/2544078872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72894d580 con 0x55b728ba2690 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43ff400640 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728b56190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43fe000640 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b55870 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f43ec098460 tx=0x7f43ec009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4d761b25d78a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43ebe00640 1 -- 172.21.15.144:0/2544078872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0f0660 con 0x55b728ba2690 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43ebe00640 1 -- 172.21.15.144:0/2544078872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec0f4a10 con 0x55b728ba2690 2024-09-12T12:25:45.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.934+0000 7f43ebe00640 1 -- 172.21.15.144:0/2544078872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0f9240 con 0x55b728ba2690 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- 172.21.15.144:0/2544078872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 msgr2=0x55b728b55870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b55870 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f43ec098460 tx=0x7f43ec009190 comp rx=0 tx=0).stop 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- 172.21.15.144:0/2544078872 shutdown_connections 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728b56190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b55870 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 --2- 172.21.15.144:0/2544078872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728ba2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- 172.21.15.144:0/2544078872 >> 172.21.15.144:0/2544078872 conn(0x55b728b83040 msgr2=0x55b728b85430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- 172.21.15.144:0/2544078872 shutdown_connections 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- 172.21.15.144:0/2544078872 wait complete. 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- start start 2024-09-12T12:25:45.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 Processor -- start 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728ba8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba1d70 0x55b728ba9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba2690 0x55b728ba9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b7289a2d00 con 0x55b728b55db0 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b728961aa0 con 0x55b728ba2690 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b728940340 con 0x55b728ba1d70 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 10 client.0 _ll_register_callbacks cb 0x55b728b43760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728ba8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728ba8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47066/0 (socket says 172.21.15.144:47066) 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fea00640 1 -- 172.21.15.144:0/2697080662 learned_addr learned my addr 172.21.15.144:0/2697080662 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fe000640 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba1d70 0x55b728ba9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43ff400640 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba2690 0x55b728ba9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fea00640 1 -- 172.21.15.144:0/2697080662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba1d70 msgr2=0x55b728ba9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fea00640 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba1d70 0x55b728ba9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fea00640 1 -- 172.21.15.144:0/2697080662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba2690 msgr2=0x55b728ba9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fea00640 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba2690 0x55b728ba9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fea00640 1 -- 172.21.15.144:0/2697080662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b728949dc0 con 0x55b728b55db0 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43ff400640 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba2690 0x55b728ba9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43fea00640 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728ba8ad0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f43f0015700 tx=0x7f44000b3710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c419b779d8558f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43e8c00640 1 -- 172.21.15.144:0/2697080662 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f0029060 con 0x55b728b55db0 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43e8c00640 1 -- 172.21.15.144:0/2697080662 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7f43f0024c90 con 0x55b728b55db0 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- 172.21.15.144:0/2697080662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43ec0f4a10 con 0x55b728b55db0 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43e8c00640 1 -- 172.21.15.144:0/2697080662 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7f43f0014720 con 0x55b728b55db0 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 10 client.10425 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:45.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 1 -- 172.21.15.144:0/2697080662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x55b7289467f0 con 0x55b728b55db0 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43e8c00640 1 -- 172.21.15.144:0/2697080662 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec0f4a10 con 0x55b728b55db0 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f43e8c00640 1 -- 172.21.15.144:0/2697080662 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7f43f00148c0 con 0x55b728b55db0 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 10 client.10425 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 10 client.10425 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.938+0000 7f44092c7000 20 client.10425 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55b728bb0ea0 0x55b728bb3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 4 client.10425 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 -- 172.21.15.144:0/2697080662 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b728940e10 con 0x55b728bb0ea0 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f43fe000640 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55b728bb0ea0 0x55b728bb3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f43fe000640 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55b728bb0ea0 0x55b728bb3290 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2145693623144fe server_cookie=f9cf074fa699df81 in_seq=0 out_seq=0 2024-09-12T12:25:45.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f43e8c00640 10 client.10425 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:45.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f43e8c00640 1 -- 172.21.15.144:0/2697080662 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b728940e10 con 0x55b728bb0ea0 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f43e8c00640 10 client.10425 handle_command_reply: tid=0 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 client.10425 shutdown 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 -- 172.21.15.144:0/2697080662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 msgr2=0x55b728ba8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728ba8ad0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f43f0015700 tx=0x7f44000b3710 comp rx=0 tx=0).stop 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 -- 172.21.15.144:0/2697080662 shutdown_connections 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55b728bb0ea0 0x55b728bb3290 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba2690 0x55b728ba9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba1d70 0x55b728ba9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 --2- 172.21.15.144:0/2697080662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728ba8ad0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 -- 172.21.15.144:0/2697080662 >> 172.21.15.144:0/2697080662 conn(0x55b728b83040 msgr2=0x55b728b54f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f43e8c00640 0 client.10425 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:45.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 -- 172.21.15.144:0/2697080662 shutdown_connections 2024-09-12T12:25:45.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 1 -- 172.21.15.144:0/2697080662 wait complete. 2024-09-12T12:25:45.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.942+0000 7f44092c7000 20 client.10425 trim_cache size 0 max 16384 2024-09-12T12:25:45.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.958+0000 7f44092c7000 1 Processor -- start 2024-09-12T12:25:45.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.958+0000 7f44092c7000 1 -- start start 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728baf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728b5dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b5e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4400201bc0 con 0x55b728ba2690 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4400200c00 con 0x55b728ba1d70 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44001fff60 con 0x55b728b55db0 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43ff400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b5e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43ff400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b5e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47082/0 (socket says 172.21.15.144:47082) 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43ff400640 1 -- 172.21.15.144:0/2855482261 learned_addr learned my addr 172.21.15.144:0/2855482261 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43fe000640 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728b5dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43fea00640 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728baf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43ff400640 1 -- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 msgr2=0x55b728baf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43ff400640 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728baf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43ff400640 1 -- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 msgr2=0x55b728b5dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43ff400640 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728b5dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43ff400640 1 -- 172.21.15.144:0/2855482261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b728964470 con 0x55b728ba2690 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43fea00640 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728baf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43fe000640 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728b5dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43ff400640 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b5e110 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f440006f1c0 tx=0x7f43f80020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56d6b64af9c397 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43eb400640 1 -- 172.21.15.144:0/2855482261 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8010040 con 0x55b728ba2690 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43eb400640 1 -- 172.21.15.144:0/2855482261 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f801b070 con 0x55b728ba2690 2024-09-12T12:25:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f43eb400640 1 -- 172.21.15.144:0/2855482261 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8003de0 con 0x55b728ba2690 2024-09-12T12:25:45.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 -- 172.21.15.144:0/2855482261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 msgr2=0x55b728b5e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b5e110 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f440006f1c0 tx=0x7f43f80020e0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 -- 172.21.15.144:0/2855482261 shutdown_connections 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728ba2690 0x55b728b5e110 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728b5dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 --2- 172.21.15.144:0/2855482261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728b55db0 0x55b728baf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 -- 172.21.15.144:0/2855482261 >> 172.21.15.144:0/2855482261 conn(0x55b728b83040 msgr2=0x55b728ba8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 -- 172.21.15.144:0/2855482261 shutdown_connections 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 -- 172.21.15.144:0/2855482261 wait complete. 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 -- start start 2024-09-12T12:25:45.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 Processor -- start 2024-09-12T12:25:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728bae950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.962+0000 7f44092c7000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728c14840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba2690 0x55b728c14d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b72894cf20 con 0x55b728b55db0 2024-09-12T12:25:45.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b7289b4fd0 con 0x55b728ba1d70 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55b7289657c0 con 0x55b728ba2690 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 10 client.0 _ll_register_callbacks cb 0x7f43f0007810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728bae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728bae950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47092/0 (socket says 172.21.15.144:47092) 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fea00640 1 -- 172.21.15.144:0/1193721119 learned_addr learned my addr 172.21.15.144:0/1193721119 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43ff400640 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba2690 0x55b728c14d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fe000640 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728c14840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fea00640 1 -- 172.21.15.144:0/1193721119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba2690 msgr2=0x55b728c14d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fea00640 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba2690 0x55b728c14d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fea00640 1 -- 172.21.15.144:0/1193721119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 msgr2=0x55b728c14840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fea00640 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728c14840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fea00640 1 -- 172.21.15.144:0/1193721119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72893a640 con 0x55b728b55db0 2024-09-12T12:25:45.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fe000640 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728c14840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fea00640 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728bae950 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f43f0001060 tx=0x7f43f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684034577d599af9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 1 -- 172.21.15.144:0/1193721119 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f0014e10 con 0x55b728b55db0 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 1 -- 172.21.15.144:0/1193721119 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7f43f00239c0 con 0x55b728b55db0 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- 172.21.15.144:0/1193721119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43f801b070 con 0x55b728b55db0 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 1 -- 172.21.15.144:0/1193721119 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7f43f0040050 con 0x55b728b55db0 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 10 client.10431 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- 172.21.15.144:0/1193721119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x55b72893e3b0 con 0x55b728b55db0 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 1 -- 172.21.15.144:0/1193721119 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f801b070 con 0x55b728b55db0 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 1 -- 172.21.15.144:0/1193721119 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7f43f0043020 con 0x55b728b55db0 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 10 client.10431 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 10 client.10431 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:45.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 20 client.10431 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55b728bd1580 0x55b728bd1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 4 client.10431 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- 172.21.15.144:0/1193721119 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b7289b4470 con 0x55b728bd1580 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fe000640 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55b728bd1580 0x55b728bd1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43fe000640 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55b728bd1580 0x55b728bd1990 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da467ae42945e3f0 server_cookie=e44ae64651801e8a in_seq=0 out_seq=0 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 10 client.10431 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 1 -- 172.21.15.144:0/1193721119 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b7289b4470 con 0x55b728bd1580 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 10 client.10431 handle_command_reply: tid=0 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 client.10431 shutdown 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- 172.21.15.144:0/1193721119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 msgr2=0x55b728bae950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728bae950 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f43f0001060 tx=0x7f43f0015000 comp rx=0 tx=0).stop 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- 172.21.15.144:0/1193721119 shutdown_connections 2024-09-12T12:25:45.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x55b728bd1580 0x55b728bd1990 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55b728ba2690 0x55b728c14d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b728ba1d70 0x55b728c14840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 --2- 172.21.15.144:0/1193721119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b728b55db0 0x55b728bae950 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- 172.21.15.144:0/1193721119 >> 172.21.15.144:0/1193721119 conn(0x55b728b83040 msgr2=0x55b728b5d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f43e8c00640 0 client.10431 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- 172.21.15.144:0/1193721119 shutdown_connections 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 1 -- 172.21.15.144:0/1193721119 wait complete. 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f44092c7000 20 client.10431 trim_cache size 0 max 16384 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:25:45.975 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "no active scrubs running", 2024-09-12T12:25:45.976 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:25:45.976 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:25:45.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 -- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43e00678f0 msgr2=0x7f43e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43e00678f0 0x7f43e0069db0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f43f0000c10 tx=0x7f43f0009040 comp rx=0 tx=0).stop 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 -- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f440015c220 msgr2=0x7f440015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f440015c220 0x7f440015c680 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f43ec01c880 tx=0x7f43e4005840 comp rx=0 tx=0).stop 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 -- 172.21.15.144:0/977149997 shutdown_connections 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f43e00678f0 0x7f43e0069db0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f440014cf60 0x7f440014d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f440015c220 0x7f440015c680 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 --2- 172.21.15.144:0/977149997 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f43e4003f70 0x7f440014b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.966+0000 7f4405e00640 1 -- 172.21.15.144:0/977149997 >> 172.21.15.144:0/977149997 conn(0x7f4400068030 msgr2=0x7f440006d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.970+0000 7f4405e00640 1 -- 172.21.15.144:0/977149997 shutdown_connections 2024-09-12T12:25:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:45.970+0000 7f4405e00640 1 -- 172.21.15.144:0/977149997 wait complete. 2024-09-12T12:25:45.990 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:25:45.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-12T12:25:46.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.126+0000 7ff1b4200640 1 Processor -- start 2024-09-12T12:25:46.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.126+0000 7ff1b4200640 1 -- start start 2024-09-12T12:25:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b4200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff1ac15b340 0x7ff1ac06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b4200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1ac0b4300 con 0x7ff1ac15af60 2024-09-12T12:25:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b4200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff1ac0b32f0 con 0x7ff1ac15b340 2024-09-12T12:25:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ac0b3540 con 0x7ff1ac0cd9f0 2024-09-12T12:25:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:57660/0 (socket says 172.21.15.144:57660) 2024-09-12T12:25:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b0e00640 1 -- 172.21.15.144:0/3313898584 learned_addr learned my addr 172.21.15.144:0/3313898584 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:46.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b2200640 1 --2- 172.21.15.144:0/3313898584 >> v2:172.21.15.165:3300/0 conn(0x7ff1ac15b340 0x7ff1ac06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b0e00640 1 -- 172.21.15.144:0/3313898584 >> v2:172.21.15.165:3300/0 conn(0x7ff1ac15b340 msgr2=0x7ff1ac06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/3313898584 >> v2:172.21.15.165:3300/0 conn(0x7ff1ac15b340 0x7ff1ac06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b0e00640 1 -- 172.21.15.144:0/3313898584 >> v1:172.21.15.165:6789/0 conn(0x7ff1ac15af60 legacy=0x7ff1ac0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b0e00640 1 -- 172.21.15.144:0/3313898584 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac0b3820 con 0x7ff1ac0cd9f0 2024-09-12T12:25:46.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.130+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/3313898584 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac06bc10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff198009870 tx=0x7ff19801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=beee920645b25a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1abe00640 1 -- 172.21.15.144:0/3313898584 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1980b5070 con 0x7ff1ac0cd9f0 2024-09-12T12:25:46.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1abe00640 1 -- 172.21.15.144:0/3313898584 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1980a8a50 con 0x7ff1ac0cd9f0 2024-09-12T12:25:46.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1abe00640 1 -- 172.21.15.144:0/3313898584 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1980a8e20 con 0x7ff1ac0cd9f0 2024-09-12T12:25:46.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 -- 172.21.15.144:0/3313898584 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 msgr2=0x7ff1ac06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 --2- 172.21.15.144:0/3313898584 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac06bc10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff198009870 tx=0x7ff19801ed50 comp rx=0 tx=0).stop 2024-09-12T12:25:46.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 -- 172.21.15.144:0/3313898584 shutdown_connections 2024-09-12T12:25:46.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 --2- 172.21.15.144:0/3313898584 >> v2:172.21.15.165:3300/0 conn(0x7ff1ac15b340 0x7ff1ac06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 --2- 172.21.15.144:0/3313898584 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac06bc10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 -- 172.21.15.144:0/3313898584 >> 172.21.15.144:0/3313898584 conn(0x7ff1ac068030 msgr2=0x7ff1ac0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:46.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 -- 172.21.15.144:0/3313898584 shutdown_connections 2024-09-12T12:25:46.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 -- 172.21.15.144:0/3313898584 wait complete. 2024-09-12T12:25:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 Processor -- start 2024-09-12T12:25:46.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 -- start start 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1ac15af60 0x7ff1ac148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac15b340 0x7ff1ac159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac0b4560 con 0x7ff1ac15b340 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac0b3de0 con 0x7ff1ac15af60 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ac0b46e0 con 0x7ff1ac0cd9f0 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.134+0000 7ff1b2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac15b340 0x7ff1ac159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac15b340 0x7ff1ac159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47100/0 (socket says 172.21.15.144:47100) 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b2200640 1 -- 172.21.15.144:0/515700606 learned_addr learned my addr 172.21.15.144:0/515700606 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1ac15af60 0x7ff1ac148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b1800640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b0e00640 1 -- 172.21.15.144:0/515700606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 msgr2=0x7ff1ac0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac0719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b0e00640 1 -- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac15b340 msgr2=0x7ff1ac159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac15b340 0x7ff1ac159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b0e00640 1 -- 172.21.15.144:0/515700606 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac15a310 con 0x7ff1ac15af60 2024-09-12T12:25:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b2200640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac15b340 0x7ff1ac159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:46.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1ac15af60 0x7ff1ac148cf0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff1980af000 tx=0x7ff19801baf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1a9600640 1 -- 172.21.15.144:0/515700606 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1980c0070 con 0x7ff1ac15af60 2024-09-12T12:25:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1a9600640 1 -- 172.21.15.144:0/515700606 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1980ae550 con 0x7ff1ac15af60 2024-09-12T12:25:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1a9600640 1 -- 172.21.15.144:0/515700606 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1980b5070 con 0x7ff1ac15af60 2024-09-12T12:25:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b4200640 1 -- 172.21.15.144:0/515700606 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ac15a5f0 con 0x7ff1ac15af60 2024-09-12T12:25:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1b4200640 1 -- 172.21.15.144:0/515700606 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ac159f50 con 0x7ff1ac15af60 2024-09-12T12:25:46.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1a9600640 1 -- 172.21.15.144:0/515700606 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1980c3070 con 0x7ff1ac15af60 2024-09-12T12:25:46.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.138+0000 7ff1a9600640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff18c0678c0 0x7ff18c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1a9600640 1 -- 172.21.15.144:0/515700606 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7ff198123590 con 0x7ff1ac15af60 2024-09-12T12:25:46.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b1800640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff18c0678c0 0x7ff18c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 Processor -- start 2024-09-12T12:25:46.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- start start 2024-09-12T12:25:46.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b1800640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff18c0678c0 0x7ff18c069d80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0001ea0 tx=0x7ff1a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41d0380 0x563dd41d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4186290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 0x563dd4186bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563dd406dc40 con 0x563dd41d0ca0 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563dd3fd4d50 con 0x563dd41867d0 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x563dd3f8fab0 con 0x563dd41d0380 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4186290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4186290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47108/0 (socket says 172.21.15.144:47108) 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b0e00640 1 -- 172.21.15.144:0/1282241106 learned_addr learned my addr 172.21.15.144:0/1282241106 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b1800640 1 --2- 172.21.15.144:0/1282241106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41d0380 0x563dd41d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b2200640 1 --2- 172.21.15.144:0/1282241106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 0x563dd4186bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b0e00640 1 -- 172.21.15.144:0/1282241106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41d0380 msgr2=0x563dd41d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/1282241106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41d0380 0x563dd41d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b0e00640 1 -- 172.21.15.144:0/1282241106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 msgr2=0x563dd4186bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/1282241106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 0x563dd4186bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b0e00640 1 -- 172.21.15.144:0/1282241106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd3f7b590 con 0x563dd41d0ca0 2024-09-12T12:25:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/1282241106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4186290 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7ff1980b5040 tx=0x7ff198009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfcfac2d572a4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff19e000640 1 -- 172.21.15.144:0/1282241106 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1980fa0b0 con 0x563dd41d0ca0 2024-09-12T12:25:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff19e000640 1 -- 172.21.15.144:0/1282241106 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1980f3890 con 0x563dd41d0ca0 2024-09-12T12:25:46.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff19e000640 1 -- 172.21.15.144:0/1282241106 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1980f7b90 con 0x563dd41d0ca0 2024-09-12T12:25:46.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- 172.21.15.144:0/1282241106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 msgr2=0x563dd4186290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 --2- 172.21.15.144:0/1282241106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4186290 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7ff1980b5040 tx=0x7ff198009240 comp rx=0 tx=0).stop 2024-09-12T12:25:46.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- 172.21.15.144:0/1282241106 shutdown_connections 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 --2- 172.21.15.144:0/1282241106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 0x563dd4186bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 --2- 172.21.15.144:0/1282241106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4186290 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 --2- 172.21.15.144:0/1282241106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41d0380 0x563dd41d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- 172.21.15.144:0/1282241106 >> 172.21.15.144:0/1282241106 conn(0x563dd417dbc0 msgr2=0x563dd4184b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- 172.21.15.144:0/1282241106 shutdown_connections 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- 172.21.15.144:0/1282241106 wait complete. 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.142+0000 7ff1b756f000 1 -- start start 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 Processor -- start 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41867d0 0x563dd4191310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 0x563dd4191850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4191d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563dd3f93400 con 0x563dd41d0ca0 2024-09-12T12:25:46.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563dd40913a0 con 0x563dd41d0380 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x563dd4014260 con 0x563dd41867d0 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 10 client.0 _ll_register_callbacks cb 0x563dd4036020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4191d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4191d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47110/0 (socket says 172.21.15.144:47110) 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b2200640 1 -- 172.21.15.144:0/3118943495 learned_addr learned my addr 172.21.15.144:0/3118943495 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 0x563dd4191850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b1800640 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41867d0 0x563dd4191310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b2200640 1 -- 172.21.15.144:0/3118943495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41867d0 msgr2=0x563dd4191310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b2200640 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41867d0 0x563dd4191310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b2200640 1 -- 172.21.15.144:0/3118943495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 msgr2=0x563dd4191850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b2200640 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 0x563dd4191850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b2200640 1 -- 172.21.15.144:0/3118943495 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd3f77dd0 con 0x563dd41d0ca0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b2200640 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4191d90 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4014ef0 tx=0x7ff1a4012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad47ca21d33292c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff192a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff192a00640 1 -- 172.21.15.144:0/3118943495 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4015420 con 0x563dd41d0ca0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff192a00640 1 -- 172.21.15.144:0/3118943495 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7ff1a40155c0 con 0x563dd41d0ca0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 -- 172.21.15.144:0/3118943495 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1980f3890 con 0x563dd41d0ca0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff192a00640 1 -- 172.21.15.144:0/3118943495 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7ff1a40059a0 con 0x563dd41d0ca0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 10 client.10440 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 -- 172.21.15.144:0/3118943495 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x563dd3f74800 con 0x563dd41d0ca0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff192a00640 1 -- 172.21.15.144:0/3118943495 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1980f3890 con 0x563dd41d0ca0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff192a00640 1 -- 172.21.15.144:0/3118943495 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7ff1a402a080 con 0x563dd41d0ca0 2024-09-12T12:25:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 10 client.10440 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 10 client.10440 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 20 client.10440 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x563dd41df410 0x563dd41e1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 4 client.10440 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:25:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b756f000 1 -- 172.21.15.144:0/3118943495 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dd3f6ee20 con 0x563dd41df410 2024-09-12T12:25:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b1800640 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x563dd41df410 0x563dd41e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff1b1800640 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x563dd41df410 0x563dd41e1800 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f68e76e62c22bf7 server_cookie=54bce124a5d01f91 in_seq=0 out_seq=0 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.146+0000 7ff192a00640 10 client.10440 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff192a00640 1 -- 172.21.15.144:0/3118943495 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563dd3f6ee20 con 0x563dd41df410 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff192a00640 10 client.10440 handle_command_reply: tid=0 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 client.10440 shutdown 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 -- 172.21.15.144:0/3118943495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 msgr2=0x563dd4191d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4191d90 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4014ef0 tx=0x7ff1a4012700 comp rx=0 tx=0).stop 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 -- 172.21.15.144:0/3118943495 shutdown_connections 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x563dd41df410 0x563dd41e1800 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0ca0 0x563dd4191d90 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 0x563dd4191850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff192a00640 0 client.10440 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 --2- 172.21.15.144:0/3118943495 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd41867d0 0x563dd4191310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 -- 172.21.15.144:0/3118943495 >> 172.21.15.144:0/3118943495 conn(0x563dd417dbc0 msgr2=0x563dd4185280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 -- 172.21.15.144:0/3118943495 shutdown_connections 2024-09-12T12:25:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 1 -- 172.21.15.144:0/3118943495 wait complete. 2024-09-12T12:25:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.150+0000 7ff1b756f000 20 client.10440 trim_cache size 0 max 16384 2024-09-12T12:25:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b756f000 1 Processor -- start 2024-09-12T12:25:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b756f000 1 -- start start 2024-09-12T12:25:46.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 0x563dd423fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 0x563dd42402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0380 0x563dd42407e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b756f000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac2003c0 con 0x563dd41d0380 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b756f000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac158e70 con 0x563dd41867d0 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b756f000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ac1ffe40 con 0x563dd417dbc0 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0380 0x563dd42407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0380 0x563dd42407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47116/0 (socket says 172.21.15.144:47116) 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.162+0000 7ff1b2200640 1 -- 172.21.15.144:0/388183528 learned_addr learned my addr 172.21.15.144:0/388183528 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b1800640 1 --2- 172.21.15.144:0/388183528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 0x563dd423fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/388183528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 0x563dd42402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b2200640 1 -- 172.21.15.144:0/388183528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 msgr2=0x563dd423fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b2200640 1 --2- 172.21.15.144:0/388183528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 0x563dd423fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b2200640 1 -- 172.21.15.144:0/388183528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 msgr2=0x563dd42402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b2200640 1 --2- 172.21.15.144:0/388183528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 0x563dd42402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b2200640 1 -- 172.21.15.144:0/388183528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd3f92480 con 0x563dd41d0380 2024-09-12T12:25:46.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b2200640 1 --2- 172.21.15.144:0/388183528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0380 0x563dd42407e0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009160 tx=0x7ff1a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f63378c383da28 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff19d600640 1 -- 172.21.15.144:0/388183528 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4015620 con 0x563dd41d0380 2024-09-12T12:25:46.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff19d600640 1 -- 172.21.15.144:0/388183528 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4019070 con 0x563dd41d0380 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff19d600640 1 -- 172.21.15.144:0/388183528 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40159e0 con 0x563dd41d0380 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 -- 172.21.15.144:0/388183528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0380 msgr2=0x563dd42407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 --2- 172.21.15.144:0/388183528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0380 0x563dd42407e0 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009160 tx=0x7ff1a4017000 comp rx=0 tx=0).stop 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 -- 172.21.15.144:0/388183528 shutdown_connections 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 --2- 172.21.15.144:0/388183528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41d0380 0x563dd42407e0 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 --2- 172.21.15.144:0/388183528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41867d0 0x563dd42402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 --2- 172.21.15.144:0/388183528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 0x563dd423fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 -- 172.21.15.144:0/388183528 >> 172.21.15.144:0/388183528 conn(0x563dd41cf730 msgr2=0x563dd418be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 -- 172.21.15.144:0/388183528 shutdown_connections 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 -- 172.21.15.144:0/388183528 wait complete. 2024-09-12T12:25:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 -- start start 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 Processor -- start 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 0x563dd4243de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41867d0 0x563dd41fef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 0x563dd41ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563dd3f7af30 con 0x563dd41867d0 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563dd3f937d0 con 0x563dd41d0380 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x563dd3fd4060 con 0x563dd417dbc0 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b756f000 10 client.0 _ll_register_callbacks cb 0x7ff1a4009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41867d0 0x563dd41fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41867d0 0x563dd41fef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47122/0 (socket says 172.21.15.144:47122) 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b0e00640 1 -- 172.21.15.144:0/2601918620 learned_addr learned my addr 172.21.15.144:0/2601918620 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:46.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b2200640 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 0x563dd41ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b1800640 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 0x563dd4243de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b0e00640 1 -- 172.21.15.144:0/2601918620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 msgr2=0x563dd4243de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 0x563dd4243de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b0e00640 1 -- 172.21.15.144:0/2601918620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 msgr2=0x563dd41ff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 0x563dd41ff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.166+0000 7ff1b0e00640 1 -- 172.21.15.144:0/2601918620 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd3f68650 con 0x563dd41867d0 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b0e00640 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41867d0 0x563dd41fef90 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7ff19809b570 tx=0x7ff1980b4fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e83ee1974fb997a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 1 -- 172.21.15.144:0/2601918620 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19810b040 con 0x563dd41867d0 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 -- 172.21.15.144:0/2601918620 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1a4019070 con 0x563dd41867d0 2024-09-12T12:25:46.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 1 -- 172.21.15.144:0/2601918620 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7ff1980fc130 con 0x563dd41867d0 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 1 -- 172.21.15.144:0/2601918620 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=148) ==== 24+0+0 (secure 0 0 0) 0x7ff19811a050 con 0x563dd41867d0 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 10 client.10446 fetch_fsmap learned FSMap version 148 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 -- 172.21.15.144:0/2601918620 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=148,monmap=2+}) -- 0x563dd3f6c3c0 con 0x563dd41867d0 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 1 -- 172.21.15.144:0/2601918620 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4019070 con 0x563dd41867d0 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 1 -- 172.21.15.144:0/2601918620 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 148) ==== 3502+0+0 (secure 0 0 0) 0x7ff1981230e0 con 0x563dd41867d0 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 10 client.10446 fetch_fsmap finished waiting for FSMap version 148 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 10 client.10446 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 20 client.10446 populate_metadata read hostname 'smithi144' 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x563dd41d0ca0 0x563dd41ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 4 client.10446 mds_command: new command op to 10218 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T12:25:46.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 -- 172.21.15.144:0/2601918620 --> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563dd3fe2480 con 0x563dd41d0ca0 2024-09-12T12:25:46.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b1800640 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x563dd41d0ca0 0x563dd41ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b1800640 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x563dd41d0ca0 0x563dd41ffa10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83ef70faaa092ac9 server_cookie=4c609c7183fca240 in_seq=0 out_seq=0 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 10 client.10446 ms_handle_connect on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 1 -- 172.21.15.144:0/2601918620 <== mds.0 v2:172.21.15.144:6836/54351638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563dd3fe2480 con 0x563dd41d0ca0 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 10 client.10446 handle_command_reply: tid=0 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 client.10446 shutdown 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 -- 172.21.15.144:0/2601918620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41867d0 msgr2=0x563dd41fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41867d0 0x563dd41fef90 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7ff19809b570 tx=0x7ff1980b4fd0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 -- 172.21.15.144:0/2601918620 shutdown_connections 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.144:6836/54351638,v1:172.21.15.144:6837/54351638] conn(0x563dd41d0ca0 0x563dd41ffa10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563dd41d0380 0x563dd41ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563dd41867d0 0x563dd41fef90 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 --2- 172.21.15.144:0/2601918620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x563dd417dbc0 0x563dd4243de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff192a00640 0 client.10446 ms_handle_reset on v2:172.21.15.144:6836/54351638 2024-09-12T12:25:46.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 -- 172.21.15.144:0/2601918620 >> 172.21.15.144:0/2601918620 conn(0x563dd41cf730 msgr2=0x563dd41e1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:46.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 -- 172.21.15.144:0/2601918620 shutdown_connections 2024-09-12T12:25:46.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 1 -- 172.21.15.144:0/2601918620 wait complete. 2024-09-12T12:25:46.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b756f000 20 client.10446 trim_cache size 0 max 16384 2024-09-12T12:25:46.178 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-12T12:25:46.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 -- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff18c0678c0 msgr2=0x7ff18c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff18c0678c0 0x7ff18c069d80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0001ea0 tx=0x7ff1a0009040 comp rx=0 tx=0).stop 2024-09-12T12:25:46.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 -- 172.21.15.144:0/515700606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1ac15af60 msgr2=0x7ff1ac148cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1ac15af60 0x7ff1ac148cf0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff1980af000 tx=0x7ff19801baf0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 -- 172.21.15.144:0/515700606 shutdown_connections 2024-09-12T12:25:46.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff18c0678c0 0x7ff18c069d80 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1ac15b340 0x7ff1ac159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1ac15af60 0x7ff1ac148cf0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 --2- 172.21.15.144:0/515700606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff1ac0cd9f0 0x7ff1ac0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 -- 172.21.15.144:0/515700606 >> 172.21.15.144:0/515700606 conn(0x7ff1ac068030 msgr2=0x7ff1ac0aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:46.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 -- 172.21.15.144:0/515700606 shutdown_connections 2024-09-12T12:25:46.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.170+0000 7ff1b4200640 1 -- 172.21.15.144:0/515700606 wait complete. 2024-09-12T12:25:46.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T12:25:46.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.326+0000 7fa8e3a00640 1 Processor -- start 2024-09-12T12:25:46.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.326+0000 7fa8e3a00640 1 -- start start 2024-09-12T12:25:46.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8e3a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa8dc0d0ee0 0x7fa8dc0cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8e3a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa8dc15c690 0x7fa8dc0cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8e3a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8dc06e360 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8e3a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa8dc0cd830 con 0x7fa8dc0d0ee0 2024-09-12T12:25:46.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8e3a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa8dc06e640 con 0x7fa8dc15c690 2024-09-12T12:25:46.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa8dc0d0ee0 0x7fa8dc0cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa8dc0d0ee0 0x7fa8dc0cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47128/0 (socket says 172.21.15.144:47128) 2024-09-12T12:25:46.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8dbe00640 1 -- 172.21.15.144:0/597204499 learned_addr learned my addr 172.21.15.144:0/597204499 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:46.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8e1a00640 1 --2- 172.21.15.144:0/597204499 >> v2:172.21.15.165:3300/0 conn(0x7fa8dc15c690 0x7fa8dc0cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8dbe00640 1 -- 172.21.15.144:0/597204499 >> v2:172.21.15.165:3300/0 conn(0x7fa8dc15c690 msgr2=0x7fa8dc0cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:46.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8dbe00640 1 --2- 172.21.15.144:0/597204499 >> v2:172.21.15.165:3300/0 conn(0x7fa8dc15c690 0x7fa8dc0cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8dbe00640 1 -- 172.21.15.144:0/597204499 >> v1:172.21.15.165:6789/0 conn(0x7fa8dc15c2b0 legacy=0x7fa8dc06da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.330+0000 7fa8dbe00640 1 -- 172.21.15.144:0/597204499 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc0cd4c0 con 0x7fa8dc0d0ee0 2024-09-12T12:25:46.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8dbe00640 1 --2- 172.21.15.144:0/597204499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc0d0ee0 0x7fa8dc0cf1a0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc073170 tx=0x7fa8c801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff661c651413951 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8db400640 1 -- 172.21.15.144:0/597204499 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80ab430 con 0x7fa8dc0d0ee0 2024-09-12T12:25:46.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8db400640 1 -- 172.21.15.144:0/597204499 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c80b0070 con 0x7fa8dc0d0ee0 2024-09-12T12:25:46.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8db400640 1 -- 172.21.15.144:0/597204499 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80ab7f0 con 0x7fa8dc0d0ee0 2024-09-12T12:25:46.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 -- 172.21.15.144:0/597204499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc0d0ee0 msgr2=0x7fa8dc0cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 --2- 172.21.15.144:0/597204499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc0d0ee0 0x7fa8dc0cf1a0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc073170 tx=0x7fa8c801c520 comp rx=0 tx=0).stop 2024-09-12T12:25:46.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 -- 172.21.15.144:0/597204499 shutdown_connections 2024-09-12T12:25:46.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 --2- 172.21.15.144:0/597204499 >> v2:172.21.15.165:3300/0 conn(0x7fa8dc15c690 0x7fa8dc0cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 --2- 172.21.15.144:0/597204499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc0d0ee0 0x7fa8dc0cf1a0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 -- 172.21.15.144:0/597204499 >> 172.21.15.144:0/597204499 conn(0x7fa8dc067e00 msgr2=0x7fa8dc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 -- 172.21.15.144:0/597204499 shutdown_connections 2024-09-12T12:25:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 -- 172.21.15.144:0/597204499 wait complete. 2024-09-12T12:25:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 Processor -- start 2024-09-12T12:25:46.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.334+0000 7fa8e3a00640 1 -- start start 2024-09-12T12:25:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e3a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8dc0d0ee0 0x7fa8dc150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e3a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc15c2b0 0x7fa8dc072800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e3a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8dc15c690 0x7fa8dc15e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e3a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc0ce880 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e3a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc0ce700 con 0x7fa8dc0d0ee0 2024-09-12T12:25:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e3a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa8dc0cea00 con 0x7fa8dc15c690 2024-09-12T12:25:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8dbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc15c2b0 0x7fa8dc072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8dbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc15c2b0 0x7fa8dc072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47138/0 (socket says 172.21.15.144:47138) 2024-09-12T12:25:46.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8dbe00640 1 -- 172.21.15.144:0/2373381306 learned_addr learned my addr 172.21.15.144:0/2373381306 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e1a00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8dc15c690 0x7fa8dc15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e1000640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8dc0d0ee0 0x7fa8dc150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8dbe00640 1 -- 172.21.15.144:0/2373381306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8dc15c690 msgr2=0x7fa8dc15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8dbe00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8dc15c690 0x7fa8dc15e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8dbe00640 1 -- 172.21.15.144:0/2373381306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8dc0d0ee0 msgr2=0x7fa8dc150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8dbe00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8dc0d0ee0 0x7fa8dc150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8dbe00640 1 -- 172.21.15.144:0/2373381306 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc152ea0 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8dbe00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc15c2b0 0x7fa8dc072800 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8019130 tx=0x7fa8c801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8d8c00640 1 -- 172.21.15.144:0/2373381306 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80b4800 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8d8c00640 1 -- 172.21.15.144:0/2373381306 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c80b49a0 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc152600 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8d8c00640 1 -- 172.21.15.144:0/2373381306 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80b4d90 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc152bc0 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc06da80 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.338+0000 7fa8d8c00640 1 -- 172.21.15.144:0/2373381306 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa8c80c7430 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.342+0000 7fa8d8c00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8bc0678c0 0x7fa8bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.342+0000 7fa8d8c00640 1 -- 172.21.15.144:0/2373381306 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7fa8c80a8030 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.342+0000 7fa8e1000640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8bc0678c0 0x7fa8bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:46.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.342+0000 7fa8e1000640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8bc0678c0 0x7fa8bc069d80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0015b0 tx=0x7fa8cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:46.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.346+0000 7fa8d8c00640 1 -- 172.21.15.144:0/2373381306 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa8c8016110 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.538+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa8dc0732e0 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8d8c00640 1 -- 172.21.15.144:0/2373381306 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa8c80f0b60 con 0x7fa8dc15c2b0 2024-09-12T12:25:46.543 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:46.543 INFO:teuthology.orchestra.run.smithi144.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T12:25:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8bc0678c0 msgr2=0x7fa8bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8bc0678c0 0x7fa8bc069d80 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0015b0 tx=0x7fa8cc009040 comp rx=0 tx=0).stop 2024-09-12T12:25:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc15c2b0 msgr2=0x7fa8dc072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc15c2b0 0x7fa8dc072800 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8019130 tx=0x7fa8c801ad60 comp rx=0 tx=0).stop 2024-09-12T12:25:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 shutdown_connections 2024-09-12T12:25:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8bc0678c0 0x7fa8bc069d80 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8dc15c690 0x7fa8dc15e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8dc15c2b0 0x7fa8dc072800 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 --2- 172.21.15.144:0/2373381306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8dc0d0ee0 0x7fa8dc150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:46.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 >> 172.21.15.144:0/2373381306 conn(0x7fa8dc067e00 msgr2=0x7fa8dc148850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:46.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 shutdown_connections 2024-09-12T12:25:46.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:46.542+0000 7fa8e3a00640 1 -- 172.21.15.144:0/2373381306 wait complete. 2024-09-12T12:25:46.564 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:25:46.565 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:25:46.653 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:25:46.739 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:25:46.739 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:25:46.740 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:25:46.740 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:46.749 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:25:46.749 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:46.786 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:25:46.794 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:25:46.799 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:25:47.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.018+0000 7f4a49e00640 1 Processor -- start 2024-09-12T12:25:47.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.018+0000 7f4a49e00640 1 -- start start 2024-09-12T12:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a49e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a4415cd30 0x7f4a440b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a49e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a440b5de0 0x7f4a44072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a49e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a440cd870 con 0x7f4a4415c7b0 2024-09-12T12:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a49e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4a440b6230 con 0x7f4a4415cd30 2024-09-12T12:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a49e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4a44072a50 con 0x7f4a440b5de0 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a42000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a4415cd30 0x7f4a440b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a42000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a4415cd30 0x7f4a440b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47152/0 (socket says 172.21.15.144:47152) 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a42a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4a4415c7b0 0x7f4a440ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55996/0 (socket says 172.21.15.144:55996) 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a42000640 1 -- 172.21.15.144:0/3697554959 learned_addr learned my addr 172.21.15.144:0/3697554959 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a43400640 1 --2- 172.21.15.144:0/3697554959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a440b5de0 0x7f4a44072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a42000640 1 -- 172.21.15.144:0/3697554959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a440b5de0 msgr2=0x7f4a44072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a42000640 1 --2- 172.21.15.144:0/3697554959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a440b5de0 0x7f4a44072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a42000640 1 -- 172.21.15.144:0/3697554959 >> v1:172.21.15.144:6789/0 conn(0x7f4a4415c7b0 legacy=0x7f4a440ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a42000640 1 -- 172.21.15.144:0/3697554959 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a440cdb50 con 0x7f4a4415cd30 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a43400640 1 --2- 172.21.15.144:0/3697554959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a440b5de0 0x7f4a44072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a41600640 1 -- 172.21.15.144:0/3697554959 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268883823 0 0) 0x7f4a440cd870 con 0x7f4a4415c7b0 2024-09-12T12:25:47.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.022+0000 7f4a42000640 1 --2- 172.21.15.144:0/3697554959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4415cd30 0x7f4a440b58a0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009870 tx=0x7f4a3001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c1ac58513084c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a41600640 1 -- 172.21.15.144:0/3697554959 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a300b2070 con 0x7f4a4415cd30 2024-09-12T12:25:47.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a41600640 1 -- 172.21.15.144:0/3697554959 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a300a9070 con 0x7f4a4415cd30 2024-09-12T12:25:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a41600640 1 -- 172.21.15.144:0/3697554959 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a300ad880 con 0x7f4a4415cd30 2024-09-12T12:25:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 -- 172.21.15.144:0/3697554959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4415cd30 msgr2=0x7f4a440b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 --2- 172.21.15.144:0/3697554959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4415cd30 0x7f4a440b58a0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009870 tx=0x7f4a3001c560 comp rx=0 tx=0).stop 2024-09-12T12:25:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 -- 172.21.15.144:0/3697554959 shutdown_connections 2024-09-12T12:25:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 --2- 172.21.15.144:0/3697554959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a440b5de0 0x7f4a44072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 --2- 172.21.15.144:0/3697554959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a4415cd30 0x7f4a440b58a0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 -- 172.21.15.144:0/3697554959 >> 172.21.15.144:0/3697554959 conn(0x7f4a4406d0d0 msgr2=0x7f4a4406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 -- 172.21.15.144:0/3697554959 shutdown_connections 2024-09-12T12:25:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 -- 172.21.15.144:0/3697554959 wait complete. 2024-09-12T12:25:47.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 Processor -- start 2024-09-12T12:25:47.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 -- start start 2024-09-12T12:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a440b5de0 0x7f4a4414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a4415c7b0 0x7f4a44140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a4415cd30 0x7f4a44150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4a44073fc0 con 0x7f4a440b5de0 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4a44073e40 con 0x7f4a4415c7b0 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a49e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4a44074140 con 0x7f4a4415cd30 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a42a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a440b5de0 0x7f4a4414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a42a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a440b5de0 0x7f4a4414e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47168/0 (socket says 172.21.15.144:47168) 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a42a00640 1 -- 172.21.15.144:0/2917193879 learned_addr learned my addr 172.21.15.144:0/2917193879 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a43400640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a4415cd30 0x7f4a44150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.026+0000 7f4a42000640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a4415c7b0 0x7f4a44140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a42a00640 1 -- 172.21.15.144:0/2917193879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a4415cd30 msgr2=0x7f4a44150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a42a00640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a4415cd30 0x7f4a44150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a42a00640 1 -- 172.21.15.144:0/2917193879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a4415c7b0 msgr2=0x7f4a44140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a42a00640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a4415c7b0 0x7f4a44140030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a42a00640 1 -- 172.21.15.144:0/2917193879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4414f420 con 0x7f4a440b5de0 2024-09-12T12:25:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a42000640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a4415c7b0 0x7f4a44140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a42a00640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a440b5de0 0x7f4a4414e130 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400c4b0 tx=0x7f4a3400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a3b400640 1 -- 172.21.15.144:0/2917193879 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34018070 con 0x7f4a440b5de0 2024-09-12T12:25:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a3b400640 1 -- 172.21.15.144:0/2917193879 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a34007480 con 0x7f4a440b5de0 2024-09-12T12:25:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a3b400640 1 -- 172.21.15.144:0/2917193879 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34004a30 con 0x7f4a440b5de0 2024-09-12T12:25:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a4414e8a0 con 0x7f4a440b5de0 2024-09-12T12:25:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a4414ee60 con 0x7f4a440b5de0 2024-09-12T12:25:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a440ad9e0 con 0x7f4a440b5de0 2024-09-12T12:25:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a3b400640 1 -- 172.21.15.144:0/2917193879 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a34004bd0 con 0x7f4a440b5de0 2024-09-12T12:25:47.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a3b400640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a240678c0 0x7f4a24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a3b400640 1 -- 172.21.15.144:0/2917193879 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7f4a340851b0 con 0x7f4a440b5de0 2024-09-12T12:25:47.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.030+0000 7f4a42000640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a240678c0 0x7f4a24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.034+0000 7f4a42000640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a240678c0 0x7f4a24069d80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4a300af000 tx=0x7f4a300a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.034+0000 7f4a3b400640 1 -- 172.21.15.144:0/2917193879 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a440ad9e0 con 0x7f4a440b5de0 2024-09-12T12:25:47.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a44072ec0 con 0x7f4a440b5de0 2024-09-12T12:25:47.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a3b400640 1 -- 172.21.15.144:0/2917193879 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v191) ==== 80+0+0 (secure 0 0 0) 0x7f4a340554e0 con 0x7f4a440b5de0 2024-09-12T12:25:47.208 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:25:47.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a240678c0 msgr2=0x7f4a24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a240678c0 0x7f4a24069d80 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4a300af000 tx=0x7f4a300a7000 comp rx=0 tx=0).stop 2024-09-12T12:25:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a440b5de0 msgr2=0x7f4a4414e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a440b5de0 0x7f4a4414e130 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400c4b0 tx=0x7f4a3400c970 comp rx=0 tx=0).stop 2024-09-12T12:25:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 shutdown_connections 2024-09-12T12:25:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a240678c0 0x7f4a24069d80 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a4415cd30 0x7f4a44150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a4415c7b0 0x7f4a44140030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 --2- 172.21.15.144:0/2917193879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a440b5de0 0x7f4a4414e130 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 >> 172.21.15.144:0/2917193879 conn(0x7f4a4406d0d0 msgr2=0x7f4a44155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 shutdown_connections 2024-09-12T12:25:47.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.206+0000 7f4a49e00640 1 -- 172.21.15.144:0/2917193879 wait complete. 2024-09-12T12:25:47.230 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:25:47.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:47.230 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:25:47.257 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:25:47.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:25:47.257 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:25:47.311 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:25:47.311 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:25:47.311 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:47.321 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:25:47.321 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:25:47.321 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:25:47.321 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:47.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:25:47.362 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:25:47.362 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:25:47.362 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:47.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:25:47.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:25:47.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.542+0000 7fda3e600640 1 Processor -- start 2024-09-12T12:25:47.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.542+0000 7fda3e600640 1 -- start start 2024-09-12T12:25:47.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.542+0000 7fda3e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 0x7fda380b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.542+0000 7fda3e600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda380b3ad0 0x7fda38071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.542+0000 7fda3e600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda380b45a0 con 0x7fda38071960 2024-09-12T12:25:47.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.542+0000 7fda3e600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fda380b3fe0 con 0x7fda380b3ad0 2024-09-12T12:25:47.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.542+0000 7fda3e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fda380b42c0 con 0x7fda3815b4e0 2024-09-12T12:25:47.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda380b3ad0 0x7fda38071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fda380b3ad0 0x7fda38071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57906/0 (socket says 172.21.15.144:57906) 2024-09-12T12:25:47.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36a00640 1 -- 172.21.15.144:0/1776011238 learned_addr learned my addr 172.21.15.144:0/1776011238 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:47.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda37400640 1 --2- 172.21.15.144:0/1776011238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 0x7fda380b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36a00640 1 -- 172.21.15.144:0/1776011238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 msgr2=0x7fda380b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:47.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36a00640 1 --2- 172.21.15.144:0/1776011238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 0x7fda380b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36a00640 1 -- 172.21.15.144:0/1776011238 >> v1:172.21.15.165:6789/0 conn(0x7fda38071960 legacy=0x7fda380ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:47.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36a00640 1 -- 172.21.15.144:0/1776011238 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda380b1490 con 0x7fda380b3ad0 2024-09-12T12:25:47.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda37400640 1 --2- 172.21.15.144:0/1776011238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 0x7fda380b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36a00640 1 --2- 172.21.15.144:0/1776011238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda380b3ad0 0x7fda38071420 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fda24009870 tx=0x7fda2401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01de3867414fe58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36000640 1 -- 172.21.15.144:0/1776011238 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240aa430 con 0x7fda380b3ad0 2024-09-12T12:25:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36000640 1 -- 172.21.15.144:0/1776011238 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda240af070 con 0x7fda380b3ad0 2024-09-12T12:25:47.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.546+0000 7fda36000640 1 -- 172.21.15.144:0/1776011238 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240aa7f0 con 0x7fda380b3ad0 2024-09-12T12:25:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 -- 172.21.15.144:0/1776011238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda380b3ad0 msgr2=0x7fda38071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 --2- 172.21.15.144:0/1776011238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda380b3ad0 0x7fda38071420 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fda24009870 tx=0x7fda2401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 -- 172.21.15.144:0/1776011238 shutdown_connections 2024-09-12T12:25:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 --2- 172.21.15.144:0/1776011238 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda380b3ad0 0x7fda38071420 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 --2- 172.21.15.144:0/1776011238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 0x7fda380b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 -- 172.21.15.144:0/1776011238 >> 172.21.15.144:0/1776011238 conn(0x7fda3806d0d0 msgr2=0x7fda3806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 -- 172.21.15.144:0/1776011238 shutdown_connections 2024-09-12T12:25:47.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 -- 172.21.15.144:0/1776011238 wait complete. 2024-09-12T12:25:47.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 Processor -- start 2024-09-12T12:25:47.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 -- start start 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda38071960 0x7fda3815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda380b3ad0 0x7fda3814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 0x7fda38073280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fda380b2620 con 0x7fda38071960 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda380b24a0 con 0x7fda380b3ad0 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda3e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fda380cd640 con 0x7fda3815b4e0 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda38071960 0x7fda3815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda38071960 0x7fda3815a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57908/0 (socket says 172.21.15.144:57908) 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda37400640 1 -- 172.21.15.144:0/909427655 learned_addr learned my addr 172.21.15.144:0/909427655 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:47.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda37e00640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 0x7fda38073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda36a00640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda380b3ad0 0x7fda3814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda37400640 1 -- 172.21.15.144:0/909427655 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 msgr2=0x7fda38073280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda37400640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 0x7fda38073280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda37400640 1 -- 172.21.15.144:0/909427655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda380b3ad0 msgr2=0x7fda3814de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda37400640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda380b3ad0 0x7fda3814de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda37400640 1 -- 172.21.15.144:0/909427655 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3815a830 con 0x7fda38071960 2024-09-12T12:25:47.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.550+0000 7fda36a00640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda380b3ad0 0x7fda3814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:47.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda37400640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda38071960 0x7fda3815a2f0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fda2800ce30 tx=0x7fda2800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda2f400640 1 -- 172.21.15.144:0/909427655 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2800f890 con 0x7fda38071960 2024-09-12T12:25:47.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda2f400640 1 -- 172.21.15.144:0/909427655 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2800fa30 con 0x7fda38071960 2024-09-12T12:25:47.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda2f400640 1 -- 172.21.15.144:0/909427655 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2800fe00 con 0x7fda38071960 2024-09-12T12:25:47.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3815aad0 con 0x7fda38071960 2024-09-12T12:25:47.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3815e330 con 0x7fda38071960 2024-09-12T12:25:47.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda38071420 con 0x7fda38071960 2024-09-12T12:25:47.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda2f400640 1 -- 172.21.15.144:0/909427655 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda28018400 con 0x7fda38071960 2024-09-12T12:25:47.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda2f400640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fda180678c0 0x7fda18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda2f400640 1 -- 172.21.15.144:0/909427655 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7fda28086ba0 con 0x7fda38071960 2024-09-12T12:25:47.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.554+0000 7fda36a00640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fda180678c0 0x7fda18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.558+0000 7fda36a00640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fda180678c0 0x7fda18069d80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fda240ae000 tx=0x7fda240a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.558+0000 7fda2f400640 1 -- 172.21.15.144:0/909427655 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fda28014030 con 0x7fda38071960 2024-09-12T12:25:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda380ceca0 con 0x7fda38071960 2024-09-12T12:25:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda2f400640 1 -- 172.21.15.144:0/909427655 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 148 v148) ==== 95+0+5242 (secure 0 0 0) 0x7fda2800ae20 con 0x7fda38071960 2024-09-12T12:25:47.763 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:47.764 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":148,"btime":"2024-09-12T12:25:10:737551+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/890330369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":890330369},{"type":"v1","addr":"172.21.15.165:6833","nonce":890330369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":9646,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3806475980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3806475980},{"type":"v1","addr":"172.21.15.165:6835","nonce":3806475980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":10215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/4172702060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4172702060},{"type":"v1","addr":"172.21.15.144:6835","nonce":4172702060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":148,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:25:07.089397+0000","modified":"2024-09-12T12:25:10.115263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10218":{"gid":10218,"name":"c","rank":0,"incarnation":144,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/54351638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":54351638},{"type":"v1","addr":"172.21.15.144:6837","nonce":54351638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10218,"qdb_cluster":[10218]},"id":13}]} 2024-09-12T12:25:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 148 2024-09-12T12:25:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fda180678c0 msgr2=0x7fda18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fda180678c0 0x7fda18069d80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fda240ae000 tx=0x7fda240a7000 comp rx=0 tx=0).stop 2024-09-12T12:25:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda38071960 msgr2=0x7fda3815a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda38071960 0x7fda3815a2f0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fda2800ce30 tx=0x7fda2800a650 comp rx=0 tx=0).stop 2024-09-12T12:25:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 shutdown_connections 2024-09-12T12:25:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fda180678c0 0x7fda18069d80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda3815b4e0 0x7fda38073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda380b3ad0 0x7fda3814de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 --2- 172.21.15.144:0/909427655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda38071960 0x7fda3815a2f0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 >> 172.21.15.144:0/909427655 conn(0x7fda3806d0d0 msgr2=0x7fda38157b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 shutdown_connections 2024-09-12T12:25:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.762+0000 7fda3e600640 1 -- 172.21.15.144:0/909427655 wait complete. 2024-09-12T12:25:47.785 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:25:47.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f2100000640 1 Processor -- start 2024-09-12T12:25:47.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f2100000640 1 -- start start 2024-09-12T12:25:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f2100000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20f815ad50 0x7f20f815f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f2100000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b3590 0x7f20f80b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f2100000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f20f80b4810 0x7f20f80b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f2100000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f20f815f860 con 0x7f20f815ad50 2024-09-12T12:25:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f2100000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f20f80cdeb0 con 0x7f20f80b4810 2024-09-12T12:25:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f2100000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20f80b3aa0 con 0x7f20f80b3590 2024-09-12T12:25:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f20fd600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20f815ad50 0x7f20f815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f20fd600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20f815ad50 0x7f20f815f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57914/0 (socket says 172.21.15.144:57914) 2024-09-12T12:25:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f20fd600640 1 -- 172.21.15.144:0/126892011 learned_addr learned my addr 172.21.15.144:0/126892011 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f20fcc00640 1 --2- 172.21.15.144:0/126892011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b3590 0x7f20f80b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.918+0000 7f20fe000640 1 --2- 172.21.15.144:0/126892011 >> v2:172.21.15.165:3300/0 conn(0x7f20f80b4810 0x7f20f80b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20fd600640 1 -- 172.21.15.144:0/126892011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b3590 msgr2=0x7f20f80b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:47.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20fd600640 1 --2- 172.21.15.144:0/126892011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b3590 0x7f20f80b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20fd600640 1 -- 172.21.15.144:0/126892011 >> v2:172.21.15.165:3300/0 conn(0x7f20f80b4810 msgr2=0x7f20f80b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:47.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20fd600640 1 --2- 172.21.15.144:0/126892011 >> v2:172.21.15.165:3300/0 conn(0x7f20f80b4810 0x7f20f80b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20fd600640 1 -- 172.21.15.144:0/126892011 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f80afc10 con 0x7f20f815ad50 2024-09-12T12:25:47.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20fe000640 1 --2- 172.21.15.144:0/126892011 >> v2:172.21.15.165:3300/0 conn(0x7f20f80b4810 0x7f20f80b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:47.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20fd600640 1 --2- 172.21.15.144:0/126892011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 0x7f20f815f320 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f20f80cda10 tx=0x7f20ec01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d451c9773b0be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20f7e00640 1 -- 172.21.15.144:0/126892011 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0a55f0 con 0x7f20f815ad50 2024-09-12T12:25:47.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20f7e00640 1 -- 172.21.15.144:0/126892011 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec0a5790 con 0x7f20f815ad50 2024-09-12T12:25:47.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.922+0000 7f20f7e00640 1 -- 172.21.15.144:0/126892011 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0a5b60 con 0x7f20f815ad50 2024-09-12T12:25:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 -- 172.21.15.144:0/126892011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 msgr2=0x7f20f815f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 --2- 172.21.15.144:0/126892011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 0x7f20f815f320 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f20f80cda10 tx=0x7f20ec01c9f0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 -- 172.21.15.144:0/126892011 shutdown_connections 2024-09-12T12:25:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 --2- 172.21.15.144:0/126892011 >> v2:172.21.15.165:3300/0 conn(0x7f20f80b4810 0x7f20f80b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 --2- 172.21.15.144:0/126892011 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b3590 0x7f20f80b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 --2- 172.21.15.144:0/126892011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 0x7f20f815f320 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 -- 172.21.15.144:0/126892011 >> 172.21.15.144:0/126892011 conn(0x7f20f806d0d0 msgr2=0x7f20f806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 -- 172.21.15.144:0/126892011 shutdown_connections 2024-09-12T12:25:47.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 -- 172.21.15.144:0/126892011 wait complete. 2024-09-12T12:25:47.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 Processor -- start 2024-09-12T12:25:47.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 -- start start 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f80b3590 0x7f20f813df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b4810 0x7f20f81586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 0x7f20f813ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20f80b1980 con 0x7f20f815ad50 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20f80b1800 con 0x7f20f80b3590 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f2100000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20f80b2870 con 0x7f20f80b4810 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 0x7f20f813ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fe000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 0x7f20f813ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57928/0 (socket says 172.21.15.144:57928) 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fe000640 1 -- 172.21.15.144:0/1216320664 learned_addr learned my addr 172.21.15.144:0/1216320664 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fd600640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f80b3590 0x7f20f813df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fcc00640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b4810 0x7f20f81586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fe000640 1 -- 172.21.15.144:0/1216320664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b4810 msgr2=0x7f20f81586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fe000640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b4810 0x7f20f81586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fe000640 1 -- 172.21.15.144:0/1216320664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f80b3590 msgr2=0x7f20f813df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:47.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fe000640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f80b3590 0x7f20f813df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:47.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fe000640 1 -- 172.21.15.144:0/1216320664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f813b140 con 0x7f20f815ad50 2024-09-12T12:25:47.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.926+0000 7f20fe000640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 0x7f20f813ac00 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e810 tx=0x7f20f000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f20f5600640 1 -- 172.21.15.144:0/1216320664 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0017070 con 0x7f20f815ad50 2024-09-12T12:25:47.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f20f5600640 1 -- 172.21.15.144:0/1216320664 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f000c6d0 con 0x7f20f815ad50 2024-09-12T12:25:47.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f20f5600640 1 -- 172.21.15.144:0/1216320664 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f000f040 con 0x7f20f815ad50 2024-09-12T12:25:47.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f8158e90 con 0x7f20f815ad50 2024-09-12T12:25:47.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f8159450 con 0x7f20f815ad50 2024-09-12T12:25:47.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f80ce5f0 con 0x7f20f815ad50 2024-09-12T12:25:47.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f20f5600640 1 -- 172.21.15.144:0/1216320664 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20f001a070 con 0x7f20f815ad50 2024-09-12T12:25:47.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f20f5600640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20d80678c0 0x7f20d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:47.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f20f5600640 1 -- 172.21.15.144:0/1216320664 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7f20f00859d0 con 0x7f20f815ad50 2024-09-12T12:25:47.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.930+0000 7f20fd600640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20d80678c0 0x7f20d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:47.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.934+0000 7f20fd600640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20d80678c0 0x7f20d8069d80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0ae000 tx=0x7f20ec0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:47.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:47.934+0000 7f20f5600640 1 -- 172.21.15.144:0/1216320664 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f20f0055cd0 con 0x7f20f815ad50 2024-09-12T12:25:48.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.126+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20f80b22b0 con 0x7f20f815ad50 2024-09-12T12:25:48.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f20f5600640 1 -- 172.21.15.144:0/1216320664 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 148 v148) ==== 95+0+5242 (secure 0 0 0) 0x7f20f0059fd0 con 0x7f20f815ad50 2024-09-12T12:25:48.131 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:48.131 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":148,"btime":"2024-09-12T12:25:10:737551+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/890330369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":890330369},{"type":"v1","addr":"172.21.15.165:6833","nonce":890330369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":9646,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3806475980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3806475980},{"type":"v1","addr":"172.21.15.165:6835","nonce":3806475980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":10215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/4172702060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4172702060},{"type":"v1","addr":"172.21.15.144:6835","nonce":4172702060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":148,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:25:07.089397+0000","modified":"2024-09-12T12:25:10.115263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10218":{"gid":10218,"name":"c","rank":0,"incarnation":144,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/54351638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":54351638},{"type":"v1","addr":"172.21.15.144:6837","nonce":54351638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10218,"qdb_cluster":[10218]},"id":13}]} 2024-09-12T12:25:48.132 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 148 2024-09-12T12:25:48.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20d80678c0 msgr2=0x7f20d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20d80678c0 0x7f20d8069d80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0ae000 tx=0x7f20ec0a7070 comp rx=0 tx=0).stop 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 msgr2=0x7f20f813ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 0x7f20f813ac00 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e810 tx=0x7f20f000ecd0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 shutdown_connections 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20d80678c0 0x7f20d8069d80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20f815ad50 0x7f20f813ac00 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20f80b4810 0x7f20f81586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 --2- 172.21.15.144:0/1216320664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20f80b3590 0x7f20f813df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 >> 172.21.15.144:0/1216320664 conn(0x7f20f806d0d0 msgr2=0x7f20f8159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 shutdown_connections 2024-09-12T12:25:48.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.130+0000 7f2100000640 1 -- 172.21.15.144:0/1216320664 wait complete. 2024-09-12T12:25:48.154 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:25:48.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.286+0000 7fb181000640 1 Processor -- start 2024-09-12T12:25:48.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.286+0000 7fb181000640 1 -- start start 2024-09-12T12:25:48.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb181000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb17c15c7b0 0x7fb17c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb181000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb17c15cd30 0x7fb17c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb181000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17c0b61e0 con 0x7fb17c0b5de0 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb181000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb17c072a50 con 0x7fb17c15cd30 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb181000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb17c0cde30 con 0x7fb17c15c7b0 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb17c15cd30 0x7fb17c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb17c15cd30 0x7fb17c0b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57940/0 (socket says 172.21.15.144:57940) 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179400640 1 -- 172.21.15.144:0/1146344717 learned_addr learned my addr 172.21.15.144:0/1146344717 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179e00640 1 --2- 172.21.15.144:0/1146344717 >> v2:172.21.15.165:3300/0 conn(0x7fb17c15c7b0 0x7fb17c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179400640 1 -- 172.21.15.144:0/1146344717 >> v2:172.21.15.165:3300/0 conn(0x7fb17c15c7b0 msgr2=0x7fb17c0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179400640 1 --2- 172.21.15.144:0/1146344717 >> v2:172.21.15.165:3300/0 conn(0x7fb17c15c7b0 0x7fb17c0ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179400640 1 -- 172.21.15.144:0/1146344717 >> v1:172.21.15.165:6789/0 conn(0x7fb17c0b5de0 legacy=0x7fb17c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179400640 1 -- 172.21.15.144:0/1146344717 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c0cd870 con 0x7fb17c15cd30 2024-09-12T12:25:48.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179e00640 1 --2- 172.21.15.144:0/1146344717 >> v2:172.21.15.165:3300/0 conn(0x7fb17c15c7b0 0x7fb17c0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:48.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.290+0000 7fb179400640 1 --2- 172.21.15.144:0/1146344717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 0x7fb17c0b58a0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0d14f0 tx=0x7fb16801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea1e51a530bcb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb178a00640 1 -- 172.21.15.144:0/1146344717 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1680ab610 con 0x7fb17c15cd30 2024-09-12T12:25:48.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb178a00640 1 -- 172.21.15.144:0/1146344717 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1680b0070 con 0x7fb17c15cd30 2024-09-12T12:25:48.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb178a00640 1 -- 172.21.15.144:0/1146344717 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1680ab9d0 con 0x7fb17c15cd30 2024-09-12T12:25:48.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 -- 172.21.15.144:0/1146344717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 msgr2=0x7fb17c0b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 --2- 172.21.15.144:0/1146344717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 0x7fb17c0b58a0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0d14f0 tx=0x7fb16801c520 comp rx=0 tx=0).stop 2024-09-12T12:25:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 -- 172.21.15.144:0/1146344717 shutdown_connections 2024-09-12T12:25:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 --2- 172.21.15.144:0/1146344717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 0x7fb17c0b58a0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 --2- 172.21.15.144:0/1146344717 >> v2:172.21.15.165:3300/0 conn(0x7fb17c15c7b0 0x7fb17c0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 -- 172.21.15.144:0/1146344717 >> 172.21.15.144:0/1146344717 conn(0x7fb17c06d0d0 msgr2=0x7fb17c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 -- 172.21.15.144:0/1146344717 shutdown_connections 2024-09-12T12:25:48.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 -- 172.21.15.144:0/1146344717 wait complete. 2024-09-12T12:25:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 Processor -- start 2024-09-12T12:25:48.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 -- start start 2024-09-12T12:25:48.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb17c0b5de0 0x7fb17c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17c15c7b0 0x7fb17c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 0x7fb17c0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c169320 con 0x7fb17c15cd30 2024-09-12T12:25:48.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c0cd650 con 0x7fb17c0b5de0 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb181000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb17c1694a0 con 0x7fb17c15c7b0 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb17a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 0x7fb17c0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb17a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 0x7fb17c0cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57944/0 (socket says 172.21.15.144:57944) 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb17a800640 1 -- 172.21.15.144:0/3033299177 learned_addr learned my addr 172.21.15.144:0/3033299177 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb179e00640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb17c0b5de0 0x7fb17c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb179400640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17c15c7b0 0x7fb17c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.294+0000 7fb17a800640 1 -- 172.21.15.144:0/3033299177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17c15c7b0 msgr2=0x7fb17c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb17a800640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17c15c7b0 0x7fb17c152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb17a800640 1 -- 172.21.15.144:0/3033299177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb17c0b5de0 msgr2=0x7fb17c153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb17a800640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb17c0b5de0 0x7fb17c153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb17a800640 1 -- 172.21.15.144:0/3033299177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c15e830 con 0x7fb17c15cd30 2024-09-12T12:25:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb17a800640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 0x7fb17c0cef50 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c770 tx=0x7fb17400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb172000640 1 -- 172.21.15.144:0/3033299177 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174003b80 con 0x7fb17c15cd30 2024-09-12T12:25:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb172000640 1 -- 172.21.15.144:0/3033299177 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb174003d20 con 0x7fb17c15cd30 2024-09-12T12:25:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17c15eb10 con 0x7fb17c15cd30 2024-09-12T12:25:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb172000640 1 -- 172.21.15.144:0/3033299177 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17400aa90 con 0x7fb17c15cd30 2024-09-12T12:25:48.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c15f0d0 con 0x7fb17c15cd30 2024-09-12T12:25:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17c0ccf00 con 0x7fb17c15cd30 2024-09-12T12:25:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb172000640 1 -- 172.21.15.144:0/3033299177 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb17400ac30 con 0x7fb17c15cd30 2024-09-12T12:25:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb172000640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb15c0678c0 0x7fb15c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb172000640 1 -- 172.21.15.144:0/3033299177 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7fb174085cd0 con 0x7fb17c15cd30 2024-09-12T12:25:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.298+0000 7fb179e00640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb15c0678c0 0x7fb15c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.302+0000 7fb179e00640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb15c0678c0 0x7fb15c069d80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009950 tx=0x7fb16c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.302+0000 7fb172000640 1 -- 172.21.15.144:0/3033299177 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb174055f40 con 0x7fb17c15cd30 2024-09-12T12:25:48.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.462+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb17c1552a0 con 0x7fb17c15cd30 2024-09-12T12:25:48.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.462+0000 7fb172000640 1 -- 172.21.15.144:0/3033299177 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+17181 (secure 0 0 0) 0x7fb17405a240 con 0x7fb17c15cd30 2024-09-12T12:25:48.466 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:48.466 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":191,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:25:29.614741+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:04.807402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-12T12:25:06.093988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.1","mappings":[{"from":6,"to":4}]},{"pgid":"28.1a","mappings":[{"from":6,"to":4}]},{"pgid":"28.36","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:48.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb15c0678c0 msgr2=0x7fb15c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb15c0678c0 0x7fb15c069d80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009950 tx=0x7fb16c008040 comp rx=0 tx=0).stop 2024-09-12T12:25:48.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 msgr2=0x7fb17c0cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 0x7fb17c0cef50 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fb17400c770 tx=0x7fb17400cc30 comp rx=0 tx=0).stop 2024-09-12T12:25:48.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 shutdown_connections 2024-09-12T12:25:48.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb15c0678c0 0x7fb15c069d80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17c15cd30 0x7fb17c0cef50 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17c15c7b0 0x7fb17c152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 --2- 172.21.15.144:0/3033299177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb17c0b5de0 0x7fb17c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 >> 172.21.15.144:0/3033299177 conn(0x7fb17c06d0d0 msgr2=0x7fb17c0b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 shutdown_connections 2024-09-12T12:25:48.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.466+0000 7fb181000640 1 -- 172.21.15.144:0/3033299177 wait complete. 2024-09-12T12:25:48.488 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:25:48.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:25:48.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc37400640 1 Processor -- start 2024-09-12T12:25:48.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc37400640 1 -- start start 2024-09-12T12:25:48.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc37400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3015c3c0 0x7efc300b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc37400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efc300709a0 0x7efc30070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc37400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 0x7efc3015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc37400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efc30073c70 con 0x7efc3015c3c0 2024-09-12T12:25:48.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc37400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efc300717b0 con 0x7efc300709a0 2024-09-12T12:25:48.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc37400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc300b2000 con 0x7efc30071320 2024-09-12T12:25:48.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc34a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3015c3c0 0x7efc300b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc34a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3015c3c0 0x7efc300b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57960/0 (socket says 172.21.15.144:57960) 2024-09-12T12:25:48.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc34a00640 1 -- 172.21.15.144:0/239089173 learned_addr learned my addr 172.21.15.144:0/239089173 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:48.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc35400640 1 --2- 172.21.15.144:0/239089173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 0x7efc3015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc27e00640 1 --2- 172.21.15.144:0/239089173 >> v2:172.21.15.165:3300/0 conn(0x7efc300709a0 0x7efc30070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc34a00640 1 -- 172.21.15.144:0/239089173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 msgr2=0x7efc3015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:48.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc34a00640 1 --2- 172.21.15.144:0/239089173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 0x7efc3015fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc34a00640 1 -- 172.21.15.144:0/239089173 >> v2:172.21.15.165:3300/0 conn(0x7efc300709a0 msgr2=0x7efc30070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:48.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc34a00640 1 --2- 172.21.15.144:0/239089173 >> v2:172.21.15.165:3300/0 conn(0x7efc300709a0 0x7efc30070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.626+0000 7efc34a00640 1 -- 172.21.15.144:0/239089173 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc30073f10 con 0x7efc3015c3c0 2024-09-12T12:25:48.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc34a00640 1 --2- 172.21.15.144:0/239089173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 0x7efc300b1ac0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7efc300ced20 tx=0x7efc2001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5db39125fac1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc2fe00640 1 -- 172.21.15.144:0/239089173 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc200ab620 con 0x7efc3015c3c0 2024-09-12T12:25:48.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc2fe00640 1 -- 172.21.15.144:0/239089173 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc200b0070 con 0x7efc3015c3c0 2024-09-12T12:25:48.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc2fe00640 1 -- 172.21.15.144:0/239089173 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc200ab9e0 con 0x7efc3015c3c0 2024-09-12T12:25:48.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc37400640 1 -- 172.21.15.144:0/239089173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 msgr2=0x7efc300b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc37400640 1 --2- 172.21.15.144:0/239089173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 0x7efc300b1ac0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7efc300ced20 tx=0x7efc2001c460 comp rx=0 tx=0).stop 2024-09-12T12:25:48.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc37400640 1 -- 172.21.15.144:0/239089173 shutdown_connections 2024-09-12T12:25:48.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc37400640 1 --2- 172.21.15.144:0/239089173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 0x7efc3015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc37400640 1 --2- 172.21.15.144:0/239089173 >> v2:172.21.15.165:3300/0 conn(0x7efc300709a0 0x7efc30070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc37400640 1 --2- 172.21.15.144:0/239089173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 0x7efc300b1ac0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc37400640 1 -- 172.21.15.144:0/239089173 >> 172.21.15.144:0/239089173 conn(0x7efc300b42b0 msgr2=0x7efc300b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc37400640 1 -- 172.21.15.144:0/239089173 shutdown_connections 2024-09-12T12:25:48.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.630+0000 7efc37400640 1 -- 172.21.15.144:0/239089173 wait complete. 2024-09-12T12:25:48.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 Processor -- start 2024-09-12T12:25:48.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 -- start start 2024-09-12T12:25:48.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc300709a0 0x7efc30165d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 0x7efc3014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 0x7efc300d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc300d0370 con 0x7efc3015c3c0 2024-09-12T12:25:48.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc300d01f0 con 0x7efc300709a0 2024-09-12T12:25:48.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc3015c7a0 con 0x7efc30071320 2024-09-12T12:25:48.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc35400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 0x7efc300d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc35400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 0x7efc300d09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57970/0 (socket says 172.21.15.144:57970) 2024-09-12T12:25:48.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc35400640 1 -- 172.21.15.144:0/41950086 learned_addr learned my addr 172.21.15.144:0/41950086 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:48.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc27e00640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 0x7efc3014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc34a00640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc300709a0 0x7efc30165d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc35400640 1 -- 172.21.15.144:0/41950086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 msgr2=0x7efc3014faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc35400640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 0x7efc3014faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc35400640 1 -- 172.21.15.144:0/41950086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc300709a0 msgr2=0x7efc30165d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc35400640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc300709a0 0x7efc30165d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc35400640 1 -- 172.21.15.144:0/41950086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc30163330 con 0x7efc3015c3c0 2024-09-12T12:25:48.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc35400640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 0x7efc300d09b0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7efc28007e60 tx=0x7efc2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc2d600640 1 -- 172.21.15.144:0/41950086 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28014420 con 0x7efc3015c3c0 2024-09-12T12:25:48.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc2d600640 1 -- 172.21.15.144:0/41950086 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc28019070 con 0x7efc3015c3c0 2024-09-12T12:25:48.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc2d600640 1 -- 172.21.15.144:0/41950086 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28014820 con 0x7efc3015c3c0 2024-09-12T12:25:48.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc30163610 con 0x7efc3015c3c0 2024-09-12T12:25:48.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc30163bd0 con 0x7efc3015c3c0 2024-09-12T12:25:48.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.634+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3015fff0 con 0x7efc3015c3c0 2024-09-12T12:25:48.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.638+0000 7efc2d600640 1 -- 172.21.15.144:0/41950086 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc280149c0 con 0x7efc3015c3c0 2024-09-12T12:25:48.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.638+0000 7efc2d600640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc0c0678c0 0x7efc0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:48.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.638+0000 7efc2d600640 1 -- 172.21.15.144:0/41950086 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7efc28086650 con 0x7efc3015c3c0 2024-09-12T12:25:48.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.638+0000 7efc34a00640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc0c0678c0 0x7efc0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:48.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.638+0000 7efc34a00640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc0c0678c0 0x7efc0c069d80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7efc200af000 tx=0x7efc200a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:48.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.642+0000 7efc2d600640 1 -- 172.21.15.144:0/41950086 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efc280568c0 con 0x7efc3015c3c0 2024-09-12T12:25:48.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.834+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc30069450 con 0x7efc3015c3c0 2024-09-12T12:25:48.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.834+0000 7efc2d600640 1 -- 172.21.15.144:0/41950086 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 148 v148) ==== 95+0+5242 (secure 0 0 0) 0x7efc2805d0e0 con 0x7efc3015c3c0 2024-09-12T12:25:48.838 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:48.838 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":148,"btime":"2024-09-12T12:25:10:737551+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/890330369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":890330369},{"type":"v1","addr":"172.21.15.165:6833","nonce":890330369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":9646,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3806475980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3806475980},{"type":"v1","addr":"172.21.15.165:6835","nonce":3806475980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":10215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/4172702060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4172702060},{"type":"v1","addr":"172.21.15.144:6835","nonce":4172702060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":148,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:25:07.089397+0000","modified":"2024-09-12T12:25:10.115263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10218":{"gid":10218,"name":"c","rank":0,"incarnation":144,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/54351638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":54351638},{"type":"v1","addr":"172.21.15.144:6837","nonce":54351638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10218,"qdb_cluster":[10218]},"id":13}]} 2024-09-12T12:25:48.838 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 148 2024-09-12T12:25:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc0c0678c0 msgr2=0x7efc0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc0c0678c0 0x7efc0c069d80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7efc200af000 tx=0x7efc200a7000 comp rx=0 tx=0).stop 2024-09-12T12:25:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 msgr2=0x7efc300d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 0x7efc300d09b0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7efc28007e60 tx=0x7efc2800e4b0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 shutdown_connections 2024-09-12T12:25:48.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efc0c0678c0 0x7efc0c069d80 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3015c3c0 0x7efc300d09b0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc30071320 0x7efc3014faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 --2- 172.21.15.144:0/41950086 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc300709a0 0x7efc30165d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:48.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 >> 172.21.15.144:0/41950086 conn(0x7efc300b42b0 msgr2=0x7efc300b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:48.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 shutdown_connections 2024-09-12T12:25:48.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.838+0000 7efc37400640 1 -- 172.21.15.144:0/41950086 wait complete. 2024-09-12T12:25:48.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:25:49.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.998+0000 7f41a3e00640 1 Processor -- start 2024-09-12T12:25:49.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:48.998+0000 7f41a3e00640 1 -- start start 2024-09-12T12:25:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f419c0cd640 0x7f419c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a3e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419c0b45a0 con 0x7f419c15b4e0 2024-09-12T12:25:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a3e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419c0b3fe0 con 0x7f419c071420 2024-09-12T12:25:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a3e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f419c0b42c0 con 0x7f419c0cd640 2024-09-12T12:25:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f419c15b4e0 0x7f419c0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60736/0 (socket says 172.21.15.144:60736) 2024-09-12T12:25:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1400640 1 -- 172.21.15.144:0/85422754 learned_addr learned my addr 172.21.15.144:0/85422754 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1e00640 1 --2- 172.21.15.144:0/85422754 >> v2:172.21.15.165:3300/0 conn(0x7f419c0cd640 0x7f419c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736213919 0 0) 0x7f419c0b45a0 con 0x7f419c15b4e0 2024-09-12T12:25:49.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4184003530 con 0x7f419c15b4e0 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3444654740 0 0) 0x7f4184003530 con 0x7f419c15b4e0 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 >> v2:172.21.15.165:3300/0 conn(0x7f419c0cd640 msgr2=0x7f419c071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 --2- 172.21.15.144:0/85422754 >> v2:172.21.15.165:3300/0 conn(0x7f419c0cd640 0x7f419c071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 >> v1:172.21.15.165:6789/0 conn(0x7f419c071420 legacy=0x7f419c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c0b1490 con 0x7f419c15b4e0 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f4190001680 con 0x7f419c15b4e0 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 >> v1:172.21.15.144:6789/0 conn(0x7f419c15b4e0 legacy=0x7f419c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41840039c0 0x7f4184003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4184004810 0x7f4184004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f418400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f419c0b42c0 con 0x7f41840051d0 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f418400c070 con 0x7f4184004810 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f418400c270 con 0x7f41840039c0 2024-09-12T12:25:49.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1e00640 1 --2- 172.21.15.144:0/85422754 >> v2:172.21.15.165:3300/0 conn(0x7f419c0cd640 0x7f419c071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:49.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1400640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41840039c0 0x7f4184003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1e00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f418400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a0a00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4184004810 0x7f4184004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1e00640 1 -- 172.21.15.144:0/85422754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41840039c0 msgr2=0x7f4184003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:49.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1e00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41840039c0 0x7f4184003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1e00640 1 -- 172.21.15.144:0/85422754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4184004810 msgr2=0x7f4184004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:49.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1e00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4184004810 0x7f4184004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.002+0000 7f41a1e00640 1 -- 172.21.15.144:0/85422754 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4184003530 con 0x7f41840051d0 2024-09-12T12:25:49.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a1e00640 1 -- 172.21.15.144:0/85422754 reap_dead start 2024-09-12T12:25:49.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a1e00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f418400b9d0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f419400e350 tx=0x7f419401ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75def4cd29b9ad0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:49.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194009dc0 con 0x7f41840051d0 2024-09-12T12:25:49.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41940039a0 con 0x7f41840051d0 2024-09-12T12:25:49.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f419be00640 1 -- 172.21.15.144:0/85422754 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194003d90 con 0x7f41840051d0 2024-09-12T12:25:49.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a3e00640 1 -- 172.21.15.144:0/85422754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 msgr2=0x7f418400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a3e00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f418400b9d0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f419400e350 tx=0x7f419401ce60 comp rx=0 tx=0).stop 2024-09-12T12:25:49.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a3e00640 1 -- 172.21.15.144:0/85422754 shutdown_connections 2024-09-12T12:25:49.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a3e00640 1 --2- 172.21.15.144:0/85422754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f418400b9d0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a3e00640 1 -- 172.21.15.144:0/85422754 >> 172.21.15.144:0/85422754 conn(0x7f419c06d0d0 msgr2=0x7f419c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:49.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a3e00640 1 -- 172.21.15.144:0/85422754 shutdown_connections 2024-09-12T12:25:49.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a3e00640 1 -- 172.21.15.144:0/85422754 wait complete. 2024-09-12T12:25:49.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a3e00640 1 Processor -- start 2024-09-12T12:25:49.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.006+0000 7f41a3e00640 1 -- start start 2024-09-12T12:25:49.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f419c1f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f419c15d810 0x7f419c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f419c1f7400 0x7f419c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f419c15b8c0 con 0x7f41840051d0 2024-09-12T12:25:49.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a3e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f419c0cdef0 con 0x7f419c1f7400 2024-09-12T12:25:49.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f419c0aedd0 con 0x7f419c15d810 2024-09-12T12:25:49.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f419c1f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f419c1f45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57994/0 (socket says 172.21.15.144:57994) 2024-09-12T12:25:49.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1400640 1 -- 172.21.15.144:0/3872668377 learned_addr learned my addr 172.21.15.144:0/3872668377 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:49.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1e00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f419c1f7400 0x7f419c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a0a00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f419c15d810 0x7f419c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1400640 1 -- 172.21.15.144:0/3872668377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f419c15d810 msgr2=0x7f419c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1400640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f419c15d810 0x7f419c0ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1400640 1 -- 172.21.15.144:0/3872668377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f419c1f7400 msgr2=0x7f419c155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1400640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f419c1f7400 0x7f419c155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1400640 1 -- 172.21.15.144:0/3872668377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c15dc90 con 0x7f41840051d0 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a0a00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f419c15d810 0x7f419c0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a1400640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f419c1f45c0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f4190004f40 tx=0x7f41900074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f4199600640 1 -- 172.21.15.144:0/3872668377 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419001a070 con 0x7f41840051d0 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f4199600640 1 -- 172.21.15.144:0/3872668377 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f419000f750 con 0x7f41840051d0 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419c0af000 con 0x7f41840051d0 2024-09-12T12:25:49.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f4199600640 1 -- 172.21.15.144:0/3872668377 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419000fb40 con 0x7f41840051d0 2024-09-12T12:25:49.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419c0af5c0 con 0x7f41840051d0 2024-09-12T12:25:49.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419c071840 con 0x7f41840051d0 2024-09-12T12:25:49.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.010+0000 7f4199600640 1 -- 172.21.15.144:0/3872668377 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f419001d360 con 0x7f41840051d0 2024-09-12T12:25:49.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.014+0000 7f4199600640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f417c0678f0 0x7f417c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.014+0000 7f4199600640 1 -- 172.21.15.144:0/3872668377 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7f41900857f0 con 0x7f41840051d0 2024-09-12T12:25:49.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.014+0000 7f41a0a00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f417c0678f0 0x7f417c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.014+0000 7f41a0a00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f417c0678f0 0x7f417c069db0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4188000c10 tx=0x7f4188009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:49.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.018+0000 7f4199600640 1 -- 172.21.15.144:0/3872668377 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4190055a70 con 0x7f41840051d0 2024-09-12T12:25:49.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.206+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f419c158010 con 0x7f41840051d0 2024-09-12T12:25:49.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.206+0000 7f4199600640 1 -- 172.21.15.144:0/3872668377 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 148 v148) ==== 95+0+5242 (secure 0 0 0) 0x7f4190059d70 con 0x7f41840051d0 2024-09-12T12:25:49.210 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:49.210 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":148,"btime":"2024-09-12T12:25:10:737551+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/890330369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":890330369},{"type":"v1","addr":"172.21.15.165:6833","nonce":890330369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":9646,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3806475980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3806475980},{"type":"v1","addr":"172.21.15.165:6835","nonce":3806475980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":10215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/4172702060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4172702060},{"type":"v1","addr":"172.21.15.144:6835","nonce":4172702060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":148,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:25:07.089397+0000","modified":"2024-09-12T12:25:10.115263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10218":{"gid":10218,"name":"c","rank":0,"incarnation":144,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/54351638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":54351638},{"type":"v1","addr":"172.21.15.144:6837","nonce":54351638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10218,"qdb_cluster":[10218]},"id":13}]} 2024-09-12T12:25:49.210 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 148 2024-09-12T12:25:49.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f417c0678f0 msgr2=0x7f417c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f417c0678f0 0x7f417c069db0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4188000c10 tx=0x7f4188009040 comp rx=0 tx=0).stop 2024-09-12T12:25:49.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 msgr2=0x7f419c1f45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f419c1f45c0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f4190004f40 tx=0x7f41900074f0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 shutdown_connections 2024-09-12T12:25:49.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f417c0678f0 0x7f417c069db0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f419c1f7400 0x7f419c155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f419c15d810 0x7f419c0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 --2- 172.21.15.144:0/3872668377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41840051d0 0x7f419c1f45c0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 >> 172.21.15.144:0/3872668377 conn(0x7f419c06d0d0 msgr2=0x7f419c075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:49.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 shutdown_connections 2024-09-12T12:25:49.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.210+0000 7f41a3e00640 1 -- 172.21.15.144:0/3872668377 wait complete. 2024-09-12T12:25:49.233 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:25:49.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.366+0000 7f72ce800640 1 Processor -- start 2024-09-12T12:25:49.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.366+0000 7f72ce800640 1 -- start start 2024-09-12T12:25:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72ce800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72ce800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f72c8073bd0 0x7f72c80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72ce800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c80cd4a0 con 0x7f72c80cd000 2024-09-12T12:25:49.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72ce800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f72c815b540 con 0x7f72c8073bd0 2024-09-12T12:25:49.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72ce800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f72c80cd780 con 0x7f72c815b160 2024-09-12T12:25:49.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72cd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72cd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:58540/0 (socket says 172.21.15.144:58540) 2024-09-12T12:25:49.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72cd400640 1 -- 172.21.15.144:0/2570878966 learned_addr learned my addr 172.21.15.144:0/2570878966 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:49.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72cca00640 1 --2- 172.21.15.144:0/2570878966 >> v2:172.21.15.165:3300/0 conn(0x7f72c8073bd0 0x7f72c80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72cd400640 1 -- 172.21.15.144:0/2570878966 >> v2:172.21.15.165:3300/0 conn(0x7f72c8073bd0 msgr2=0x7f72c80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72cd400640 1 --2- 172.21.15.144:0/2570878966 >> v2:172.21.15.165:3300/0 conn(0x7f72c8073bd0 0x7f72c80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72cd400640 1 -- 172.21.15.144:0/2570878966 >> v1:172.21.15.165:6789/0 conn(0x7f72c80cd000 legacy=0x7f72c80cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.370+0000 7f72cd400640 1 -- 172.21.15.144:0/2570878966 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c80b3180 con 0x7f72c815b160 2024-09-12T12:25:49.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72cd400640 1 --2- 172.21.15.144:0/2570878966 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8070ee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009870 tx=0x7f72bc01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae8b9efae6b925c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:49.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72c7e00640 1 -- 172.21.15.144:0/2570878966 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0b1070 con 0x7f72c815b160 2024-09-12T12:25:49.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72c7e00640 1 -- 172.21.15.144:0/2570878966 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc0a8050 con 0x7f72c815b160 2024-09-12T12:25:49.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72c7e00640 1 -- 172.21.15.144:0/2570878966 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0ac860 con 0x7f72c815b160 2024-09-12T12:25:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 -- 172.21.15.144:0/2570878966 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 msgr2=0x7f72c8070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 --2- 172.21.15.144:0/2570878966 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8070ee0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009870 tx=0x7f72bc01c4d0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 -- 172.21.15.144:0/2570878966 shutdown_connections 2024-09-12T12:25:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 --2- 172.21.15.144:0/2570878966 >> v2:172.21.15.165:3300/0 conn(0x7f72c8073bd0 0x7f72c80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 --2- 172.21.15.144:0/2570878966 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8070ee0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 -- 172.21.15.144:0/2570878966 >> 172.21.15.144:0/2570878966 conn(0x7f72c806bc10 msgr2=0x7f72c806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 -- 172.21.15.144:0/2570878966 shutdown_connections 2024-09-12T12:25:49.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 -- 172.21.15.144:0/2570878966 wait complete. 2024-09-12T12:25:49.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 Processor -- start 2024-09-12T12:25:49.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.374+0000 7f72ce800640 1 -- start start 2024-09-12T12:25:49.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72ce800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c8073bd0 0x7f72c815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c80cd000 0x7f72c8154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72ce800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72ce800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f72c80b4520 con 0x7f72c80cd000 2024-09-12T12:25:49.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72ce800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f72c80b43a0 con 0x7f72c8073bd0 2024-09-12T12:25:49.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72ce800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f72c80b46a0 con 0x7f72c815b160 2024-09-12T12:25:49.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c80cd000 0x7f72c8154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cd400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c8073bd0 0x7f72c815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c80cd000 0x7f72c8154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58004/0 (socket says 172.21.15.144:58004) 2024-09-12T12:25:49.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cca00640 1 -- 172.21.15.144:0/2495478884 learned_addr learned my addr 172.21.15.144:0/2495478884 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:49.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cde00640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cd400640 1 -- 172.21.15.144:0/2495478884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 msgr2=0x7f72c8154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cd400640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cd400640 1 -- 172.21.15.144:0/2495478884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c80cd000 msgr2=0x7f72c8154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cd400640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c80cd000 0x7f72c8154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cd400640 1 -- 172.21.15.144:0/2495478884 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c81553c0 con 0x7f72c8073bd0 2024-09-12T12:25:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72cd400640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c8073bd0 0x7f72c815f460 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0ac000 tx=0x7f72bc019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72c5600640 1 -- 172.21.15.144:0/2495478884 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0bc070 con 0x7f72c8073bd0 2024-09-12T12:25:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72c5600640 1 -- 172.21.15.144:0/2495478884 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc0b7430 con 0x7f72c8073bd0 2024-09-12T12:25:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72c5600640 1 -- 172.21.15.144:0/2495478884 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0b1040 con 0x7f72c8073bd0 2024-09-12T12:25:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c815faf0 con 0x7f72c8073bd0 2024-09-12T12:25:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c80b1ee0 con 0x7f72c8073bd0 2024-09-12T12:25:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.378+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c80ccac0 con 0x7f72c8073bd0 2024-09-12T12:25:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.382+0000 7f72c5600640 1 -- 172.21.15.144:0/2495478884 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72bc0ab3e0 con 0x7f72c8073bd0 2024-09-12T12:25:49.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.382+0000 7f72c5600640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72a80678c0 0x7f72a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.382+0000 7f72c5600640 1 -- 172.21.15.144:0/2495478884 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7f72bc11f8e0 con 0x7f72c8073bd0 2024-09-12T12:25:49.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.382+0000 7f72cca00640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72a80678c0 0x7f72a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.382+0000 7f72cca00640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72a80678c0 0x7f72a8069d80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f72c8156450 tx=0x7f72b4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:49.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.386+0000 7f72c5600640 1 -- 172.21.15.144:0/2495478884 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f72bc0c5080 con 0x7f72c8073bd0 2024-09-12T12:25:49.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.546+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72c80af4f0 con 0x7f72c8073bd0 2024-09-12T12:25:49.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.546+0000 7f72c5600640 1 -- 172.21.15.144:0/2495478884 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+17181 (secure 0 0 0) 0x7f72bc016150 con 0x7f72c8073bd0 2024-09-12T12:25:49.549 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:49.549 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":191,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:25:29.614741+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:04.807402+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_data","create_time":"2024-09-12T12:25:06.093988+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.1","mappings":[{"from":6,"to":4}]},{"pgid":"28.1a","mappings":[{"from":6,"to":4}]},{"pgid":"28.36","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:49.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.546+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72a80678c0 msgr2=0x7f72a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.546+0000 7f72ce800640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72a80678c0 0x7f72a8069d80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f72c8156450 tx=0x7f72b4009190 comp rx=0 tx=0).stop 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.546+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c8073bd0 msgr2=0x7f72c815f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.546+0000 7f72ce800640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c8073bd0 0x7f72c815f460 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0ac000 tx=0x7f72bc019270 comp rx=0 tx=0).stop 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.550+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 shutdown_connections 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.550+0000 7f72ce800640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f72a80678c0 0x7f72a8069d80 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.550+0000 7f72ce800640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c815b160 0x7f72c8154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.550+0000 7f72ce800640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c80cd000 0x7f72c8154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.550+0000 7f72ce800640 1 --2- 172.21.15.144:0/2495478884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c8073bd0 0x7f72c815f460 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.550+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 >> 172.21.15.144:0/2495478884 conn(0x7f72c806bc10 msgr2=0x7f72c8159d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.550+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 shutdown_connections 2024-09-12T12:25:49.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.550+0000 7f72ce800640 1 -- 172.21.15.144:0/2495478884 wait complete. 2024-09-12T12:25:49.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:25:49.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.706+0000 7f2e82400640 1 Processor -- start 2024-09-12T12:25:49.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.706+0000 7f2e82400640 1 -- start start 2024-09-12T12:25:49.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e82400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e7c158d70 0x7f2e7c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e82400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c15f800 0x7f2e7c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e82400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e7c06efd0 con 0x7f2e7c06ea50 2024-09-12T12:25:49.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e82400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2e7c15ed20 con 0x7f2e7c158d70 2024-09-12T12:25:49.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e82400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7c15f000 con 0x7f2e7c15f800 2024-09-12T12:25:49.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e81000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e7c158d70 0x7f2e7c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e81000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e7c158d70 0x7f2e7c06e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58016/0 (socket says 172.21.15.144:58016) 2024-09-12T12:25:49.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e81000640 1 -- 172.21.15.144:0/1975173565 learned_addr learned my addr 172.21.15.144:0/1975173565 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:49.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e7be00640 1 --2- 172.21.15.144:0/1975173565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c15f800 0x7f2e7c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e81000640 1 -- 172.21.15.144:0/1975173565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c15f800 msgr2=0x7f2e7c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:49.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e81000640 1 --2- 172.21.15.144:0/1975173565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c15f800 0x7f2e7c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e81000640 1 -- 172.21.15.144:0/1975173565 >> v1:172.21.15.165:6789/0 conn(0x7f2e7c06ea50 legacy=0x7f2e7c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:49.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e81000640 1 -- 172.21.15.144:0/1975173565 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c15f2e0 con 0x7f2e7c158d70 2024-09-12T12:25:49.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e81000640 1 --2- 172.21.15.144:0/1975173565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c158d70 0x7f2e7c06e510 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009e50 tx=0x7f2e6c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50aa43f271fe14f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:49.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e7b400640 1 -- 172.21.15.144:0/1975173565 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0a5700 con 0x7f2e7c158d70 2024-09-12T12:25:49.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e7b400640 1 -- 172.21.15.144:0/1975173565 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6c0a58a0 con 0x7f2e7c158d70 2024-09-12T12:25:49.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.710+0000 7f2e7b400640 1 -- 172.21.15.144:0/1975173565 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0a5c70 con 0x7f2e7c158d70 2024-09-12T12:25:49.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 -- 172.21.15.144:0/1975173565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c158d70 msgr2=0x7f2e7c06e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 --2- 172.21.15.144:0/1975173565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c158d70 0x7f2e7c06e510 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009e50 tx=0x7f2e6c01ca30 comp rx=0 tx=0).stop 2024-09-12T12:25:49.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 -- 172.21.15.144:0/1975173565 shutdown_connections 2024-09-12T12:25:49.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 --2- 172.21.15.144:0/1975173565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c15f800 0x7f2e7c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 --2- 172.21.15.144:0/1975173565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c158d70 0x7f2e7c06e510 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 -- 172.21.15.144:0/1975173565 >> 172.21.15.144:0/1975173565 conn(0x7f2e7c06cd20 msgr2=0x7f2e7c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:49.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 -- 172.21.15.144:0/1975173565 shutdown_connections 2024-09-12T12:25:49.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 -- 172.21.15.144:0/1975173565 wait complete. 2024-09-12T12:25:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 Processor -- start 2024-09-12T12:25:49.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 -- start start 2024-09-12T12:25:49.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c06ea50 0x7f2e7c14ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c158d70 0x7f2e7c150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15f800 0x7f2e7c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c16b360 con 0x7f2e7c06ea50 2024-09-12T12:25:49.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c06c560 con 0x7f2e7c15f800 2024-09-12T12:25:49.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e82400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7c16b4e0 con 0x7f2e7c158d70 2024-09-12T12:25:49.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e81000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c06ea50 0x7f2e7c14ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e81000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c06ea50 0x7f2e7c14ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58020/0 (socket says 172.21.15.144:58020) 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e81000640 1 -- 172.21.15.144:0/3663867891 learned_addr learned my addr 172.21.15.144:0/3663867891 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e7be00640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c158d70 0x7f2e7c150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e81a00640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15f800 0x7f2e7c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e81000640 1 -- 172.21.15.144:0/3663867891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c158d70 msgr2=0x7f2e7c150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e81000640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c158d70 0x7f2e7c150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e81000640 1 -- 172.21.15.144:0/3663867891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15f800 msgr2=0x7f2e7c15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e81000640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15f800 0x7f2e7c15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e81000640 1 -- 172.21.15.144:0/3663867891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c14b2b0 con 0x7f2e7c06ea50 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.714+0000 7f2e7be00640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c158d70 0x7f2e7c150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e81000640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c06ea50 0x7f2e7c14ad70 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c01a660 tx=0x7f2e6c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e78c00640 1 -- 172.21.15.144:0/3663867891 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c009510 con 0x7f2e7c06ea50 2024-09-12T12:25:49.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e78c00640 1 -- 172.21.15.144:0/3663867891 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6c0b8680 con 0x7f2e7c06ea50 2024-09-12T12:25:49.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7c14cd30 con 0x7f2e7c06ea50 2024-09-12T12:25:49.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e78c00640 1 -- 172.21.15.144:0/3663867891 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0b8a90 con 0x7f2e7c06ea50 2024-09-12T12:25:49.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7c14b780 con 0x7f2e7c06ea50 2024-09-12T12:25:49.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7c14c800 con 0x7f2e7c06ea50 2024-09-12T12:25:49.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e78c00640 1 -- 172.21.15.144:0/3663867891 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e6c0c0030 con 0x7f2e7c06ea50 2024-09-12T12:25:49.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e78c00640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e580678f0 0x7f2e58069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:49.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e78c00640 1 -- 172.21.15.144:0/3663867891 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 6188+0+0 (secure 0 0 0) 0x7f2e6c120780 con 0x7f2e7c06ea50 2024-09-12T12:25:49.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.718+0000 7f2e7be00640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e580678f0 0x7f2e58069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:49.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.722+0000 7f2e7be00640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e580678f0 0x7f2e58069db0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c158520 tx=0x7f2e64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:49.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.722+0000 7f2e78c00640 1 -- 172.21.15.144:0/3663867891 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2e7c14c800 con 0x7f2e7c06ea50 2024-09-12T12:25:49.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.914+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2e7c06e510 con 0x7f2e7c06ea50 2024-09-12T12:25:49.916 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:25:49.914+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:25:49.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.918+0000 7f2e78c00640 1 -- 172.21.15.144:0/3663867891 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v149) ==== 161+0+0 (secure 0 0 0) 0x7f2e7c14cd30 con 0x7f2e7c06ea50 2024-09-12T12:25:49.920 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:25:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.918+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e580678f0 msgr2=0x7f2e58069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e580678f0 0x7f2e58069db0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c158520 tx=0x7f2e64008040 comp rx=0 tx=0).stop 2024-09-12T12:25:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c06ea50 msgr2=0x7f2e7c14ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c06ea50 0x7f2e7c14ad70 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c01a660 tx=0x7f2e6c0197d0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 shutdown_connections 2024-09-12T12:25:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e580678f0 0x7f2e58069db0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e7c15f800 0x7f2e7c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e7c158d70 0x7f2e7c150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 --2- 172.21.15.144:0/3663867891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e7c06ea50 0x7f2e7c14ad70 secure :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c01a660 tx=0x7f2e6c0197d0 comp rx=0 tx=0).stop 2024-09-12T12:25:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 >> 172.21.15.144:0/3663867891 conn(0x7f2e7c06cd20 msgr2=0x7f2e7c15c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 shutdown_connections 2024-09-12T12:25:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:49.922+0000 7f2e82400640 1 -- 172.21.15.144:0/3663867891 wait complete. 2024-09-12T12:25:49.930 INFO:tasks.ceph.mds.c.smithi144.stderr: -3558> 2024-09-12T12:25:09.687+0000 7faa98800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:25:49.944 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:25:49.979 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:25:50.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e3b400640 1 Processor -- start 2024-09-12T12:25:50.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e3b400640 1 -- start start 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e3b400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2e3415c3b0 0x7f2e34073b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e3b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e34160bf0 0x7f2e340d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e3b400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e3415cd10 con 0x7f2e3415c790 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e3b400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2e3415d640 con 0x7f2e3415c3b0 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e3b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3415cff0 con 0x7f2e34160bf0 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e33e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e34160bf0 0x7f2e340d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e38a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2e3415c3b0 0x7f2e34073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e33e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e34160bf0 0x7f2e340d2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:58592/0 (socket says 172.21.15.144:58592) 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e33e00640 1 -- 172.21.15.144:0/3613322854 learned_addr learned my addr 172.21.15.144:0/3613322854 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:50.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e38a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2e3415c3b0 0x7f2e34073b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:44400/0 (socket says 172.21.15.144:44400) 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e38a00640 1 -- 172.21.15.144:0/3613322854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e34160bf0 msgr2=0x7f2e340d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e38a00640 1 --2- 172.21.15.144:0/3613322854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e34160bf0 0x7f2e340d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e38a00640 1 -- 172.21.15.144:0/3613322854 >> v1:172.21.15.165:6789/0 conn(0x7f2e3415c790 legacy=0x7f2e3406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e38a00640 1 -- 172.21.15.144:0/3613322854 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3415d2d0 con 0x7f2e3415c3b0 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e33400640 1 -- 172.21.15.144:0/3613322854 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265961331 0 0) 0x7f2e3415cd10 con 0x7f2e3415c790 2024-09-12T12:25:50.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.086+0000 7f2e33e00640 1 --2- 172.21.15.144:0/3613322854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e34160bf0 0x7f2e340d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:25:50.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e38a00640 1 --2- 172.21.15.144:0/3613322854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3415c3b0 0x7f2e34073b60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009d90 tx=0x7f2e2401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de633e8391b112c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:50.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e33400640 1 -- 172.21.15.144:0/3613322854 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e240b2070 con 0x7f2e3415c3b0 2024-09-12T12:25:50.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e33400640 1 -- 172.21.15.144:0/3613322854 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e240a5970 con 0x7f2e3415c3b0 2024-09-12T12:25:50.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e33400640 1 -- 172.21.15.144:0/3613322854 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e240a5d40 con 0x7f2e3415c3b0 2024-09-12T12:25:50.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e3b400640 1 -- 172.21.15.144:0/3613322854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3415c3b0 msgr2=0x7f2e34073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e3b400640 1 --2- 172.21.15.144:0/3613322854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3415c3b0 0x7f2e34073b60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009d90 tx=0x7f2e2401c970 comp rx=0 tx=0).stop 2024-09-12T12:25:50.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e3b400640 1 -- 172.21.15.144:0/3613322854 shutdown_connections 2024-09-12T12:25:50.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e3b400640 1 --2- 172.21.15.144:0/3613322854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e34160bf0 0x7f2e340d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e3b400640 1 --2- 172.21.15.144:0/3613322854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3415c3b0 0x7f2e34073b60 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e3b400640 1 -- 172.21.15.144:0/3613322854 >> 172.21.15.144:0/3613322854 conn(0x7f2e3406c010 msgr2=0x7f2e34067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:50.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e3b400640 1 -- 172.21.15.144:0/3613322854 shutdown_connections 2024-09-12T12:25:50.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.090+0000 7f2e3b400640 1 -- 172.21.15.144:0/3613322854 wait complete. 2024-09-12T12:25:50.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 Processor -- start 2024-09-12T12:25:50.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 -- start start 2024-09-12T12:25:50.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3415c3b0 0x7f2e34150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e3415c790 0x7f2e34155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e34160bf0 0x7f2e341561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341694b0 con 0x7f2e34160bf0 2024-09-12T12:25:50.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34169330 con 0x7f2e3415c3b0 2024-09-12T12:25:50.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e34169630 con 0x7f2e3415c790 2024-09-12T12:25:50.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e39400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e34160bf0 0x7f2e341561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e39400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e34160bf0 0x7f2e341561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58052/0 (socket says 172.21.15.144:58052) 2024-09-12T12:25:50.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e39400640 1 -- 172.21.15.144:0/2724997231 learned_addr learned my addr 172.21.15.144:0/2724997231 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:50.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e33e00640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e3415c790 0x7f2e34155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e38a00640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3415c3b0 0x7f2e34150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e39400640 1 -- 172.21.15.144:0/2724997231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e3415c790 msgr2=0x7f2e34155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e39400640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e3415c790 0x7f2e34155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e39400640 1 -- 172.21.15.144:0/2724997231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3415c3b0 msgr2=0x7f2e34150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e39400640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3415c3b0 0x7f2e34150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e39400640 1 -- 172.21.15.144:0/2724997231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e341541b0 con 0x7f2e34160bf0 2024-09-12T12:25:50.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e39400640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e34160bf0 0x7f2e341561c0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00c3e0 tx=0x7f2e2c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:50.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e30c00640 1 -- 172.21.15.144:0/2724997231 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c017070 con 0x7f2e34160bf0 2024-09-12T12:25:50.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e30c00640 1 -- 172.21.15.144:0/2724997231 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2c003600 con 0x7f2e34160bf0 2024-09-12T12:25:50.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e34154490 con 0x7f2e34160bf0 2024-09-12T12:25:50.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e30c00640 1 -- 172.21.15.144:0/2724997231 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c0039d0 con 0x7f2e34160bf0 2024-09-12T12:25:50.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e34154a50 con 0x7f2e34160bf0 2024-09-12T12:25:50.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.094+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e34073b60 con 0x7f2e34160bf0 2024-09-12T12:25:50.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.098+0000 7f2e30c00640 1 -- 172.21.15.144:0/2724997231 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e2c01a070 con 0x7f2e34160bf0 2024-09-12T12:25:50.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.098+0000 7f2e30c00640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e140678c0 0x7f2e14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:50.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.098+0000 7f2e30c00640 1 -- 172.21.15.144:0/2724997231 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 6274+0+0 (secure 0 0 0) 0x7f2e2c0851d0 con 0x7f2e34160bf0 2024-09-12T12:25:50.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.098+0000 7f2e38a00640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e140678c0 0x7f2e14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:50.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.098+0000 7f2e38a00640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e140678c0 0x7f2e14069d80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2e240af000 tx=0x7f2e240a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:50.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.102+0000 7f2e30c00640 1 -- 172.21.15.144:0/2724997231 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2e2c0553e0 con 0x7f2e34160bf0 2024-09-12T12:25:50.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.294+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2e340d1f50 con 0x7f2e34160bf0 2024-09-12T12:25:50.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e30c00640 1 -- 172.21.15.144:0/2724997231 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v150) ==== 104+0+0 (secure 0 0 0) 0x7f2e2c0596e0 con 0x7f2e34160bf0 2024-09-12T12:25:50.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e140678c0 msgr2=0x7f2e14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e140678c0 0x7f2e14069d80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2e240af000 tx=0x7f2e240a7070 comp rx=0 tx=0).stop 2024-09-12T12:25:50.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e34160bf0 msgr2=0x7f2e341561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:50.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e34160bf0 0x7f2e341561c0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00c3e0 tx=0x7f2e2c00c7e0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 shutdown_connections 2024-09-12T12:25:50.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f2e140678c0 0x7f2e14069d80 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e34160bf0 0x7f2e341561c0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e3415c790 0x7f2e34155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 --2- 172.21.15.144:0/2724997231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3415c3b0 0x7f2e34150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:50.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 >> 172.21.15.144:0/2724997231 conn(0x7f2e3406c010 msgr2=0x7f2e3415db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:50.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 shutdown_connections 2024-09-12T12:25:50.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:50.922+0000 7f2e3b400640 1 -- 172.21.15.144:0/2724997231 wait complete. 2024-09-12T12:25:50.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:25:51.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f273b000640 1 Processor -- start 2024-09-12T12:25:51.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f273b000640 1 -- start start 2024-09-12T12:25:51.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f273b000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f27340b3490 0x7f27340b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f273b000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f273406d630 0x7f2734155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f273b000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f273406cd20 con 0x7f273406d250 2024-09-12T12:25:51.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f273b000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2734072620 con 0x7f27340b3490 2024-09-12T12:25:51.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f273b000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f27340b4f30 con 0x7f273406d630 2024-09-12T12:25:51.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f2733400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f27340b3490 0x7f27340b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f2733400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f27340b3490 0x7f27340b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58060/0 (socket says 172.21.15.144:58060) 2024-09-12T12:25:51.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f2733400640 1 -- 172.21.15.144:0/2402995484 learned_addr learned my addr 172.21.15.144:0/2402995484 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:51.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f2739000640 1 --2- 172.21.15.144:0/2402995484 >> v2:172.21.15.165:3300/0 conn(0x7f273406d630 0x7f2734155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f2733400640 1 -- 172.21.15.144:0/2402995484 >> v2:172.21.15.165:3300/0 conn(0x7f273406d630 msgr2=0x7f2734155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:51.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f2733400640 1 --2- 172.21.15.144:0/2402995484 >> v2:172.21.15.165:3300/0 conn(0x7f273406d630 0x7f2734155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f2733400640 1 -- 172.21.15.144:0/2402995484 >> v1:172.21.15.165:6789/0 conn(0x7f273406d250 legacy=0x7f273415c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.130+0000 7f2733400640 1 -- 172.21.15.144:0/2402995484 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27340b3950 con 0x7f27340b3490 2024-09-12T12:25:51.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f2733400640 1 --2- 172.21.15.144:0/2402995484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27340b3490 0x7f27340b49f0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f2734073ce0 tx=0x7f272001e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8dc76f3c09c0958 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:51.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f2732a00640 1 -- 172.21.15.144:0/2402995484 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27200a86f0 con 0x7f27340b3490 2024-09-12T12:25:51.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f2732a00640 1 -- 172.21.15.144:0/2402995484 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27200a8890 con 0x7f27340b3490 2024-09-12T12:25:51.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f2732a00640 1 -- 172.21.15.144:0/2402995484 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27200a8c60 con 0x7f27340b3490 2024-09-12T12:25:51.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f273b000640 1 -- 172.21.15.144:0/2402995484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27340b3490 msgr2=0x7f27340b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f273b000640 1 --2- 172.21.15.144:0/2402995484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27340b3490 0x7f27340b49f0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f2734073ce0 tx=0x7f272001e700 comp rx=0 tx=0).stop 2024-09-12T12:25:51.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f273b000640 1 -- 172.21.15.144:0/2402995484 shutdown_connections 2024-09-12T12:25:51.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f273b000640 1 --2- 172.21.15.144:0/2402995484 >> v2:172.21.15.165:3300/0 conn(0x7f273406d630 0x7f2734155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f273b000640 1 --2- 172.21.15.144:0/2402995484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27340b3490 0x7f27340b49f0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f273b000640 1 -- 172.21.15.144:0/2402995484 >> 172.21.15.144:0/2402995484 conn(0x7f273406bc10 msgr2=0x7f273406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:51.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f273b000640 1 -- 172.21.15.144:0/2402995484 shutdown_connections 2024-09-12T12:25:51.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.134+0000 7f273b000640 1 -- 172.21.15.144:0/2402995484 wait complete. 2024-09-12T12:25:51.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 Processor -- start 2024-09-12T12:25:51.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 -- start start 2024-09-12T12:25:51.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f273406d250 0x7f2734159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273406d630 0x7f2734144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27340b3490 0x7f273414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f27340b44d0 con 0x7f273406d630 2024-09-12T12:25:51.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f27340b41f0 con 0x7f27340b3490 2024-09-12T12:25:51.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f273415d690 con 0x7f273406d250 2024-09-12T12:25:51.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273406d630 0x7f2734144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273406d630 0x7f2734144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58070/0 (socket says 172.21.15.144:58070) 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733400640 1 -- 172.21.15.144:0/3504247841 learned_addr learned my addr 172.21.15.144:0/3504247841 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733e00640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f273406d250 0x7f2734159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2739000640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27340b3490 0x7f273414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733400640 1 -- 172.21.15.144:0/3504247841 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f273406d250 msgr2=0x7f2734159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733400640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f273406d250 0x7f2734159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733400640 1 -- 172.21.15.144:0/3504247841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27340b3490 msgr2=0x7f273414bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733400640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27340b3490 0x7f273414bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733400640 1 -- 172.21.15.144:0/3504247841 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273414a2f0 con 0x7f273406d630 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f2733400640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273406d630 0x7f2734144290 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f27200b2040 tx=0x7f272001cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f272be00640 1 -- 172.21.15.144:0/3504247841 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27200bb880 con 0x7f273406d630 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f272be00640 1 -- 172.21.15.144:0/3504247841 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27200c1070 con 0x7f273406d630 2024-09-12T12:25:51.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f272be00640 1 -- 172.21.15.144:0/3504247841 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27200bbc20 con 0x7f273406d630 2024-09-12T12:25:51.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273414a5d0 con 0x7f273406d630 2024-09-12T12:25:51.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273414ab90 con 0x7f273406d630 2024-09-12T12:25:51.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.138+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2734155820 con 0x7f273406d630 2024-09-12T12:25:51.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.142+0000 7f272be00640 1 -- 172.21.15.144:0/3504247841 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27200b0420 con 0x7f273406d630 2024-09-12T12:25:51.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.142+0000 7f272be00640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27140678c0 0x7f2714069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:51.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.142+0000 7f272be00640 1 -- 172.21.15.144:0/3504247841 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 6274+0+0 (secure 0 0 0) 0x7f2720122990 con 0x7f273406d630 2024-09-12T12:25:51.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.142+0000 7f2733e00640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27140678c0 0x7f2714069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:51.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.142+0000 7f2733e00640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27140678c0 0x7f2714069d80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2734165dd0 tx=0x7f2724009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:51.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.146+0000 7f272be00640 1 -- 172.21.15.144:0/3504247841 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f27200ca020 con 0x7f273406d630 2024-09-12T12:25:51.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.306+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f27341447d0 con 0x7f273406d630 2024-09-12T12:25:51.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f272be00640 1 -- 172.21.15.144:0/3504247841 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v193) ==== 181+0+0 (secure 0 0 0) 0x7f2720018320 con 0x7f273406d630 2024-09-12T12:25:51.931 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:25:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27140678c0 msgr2=0x7f2714069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27140678c0 0x7f2714069d80 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2734165dd0 tx=0x7f2724009040 comp rx=0 tx=0).stop 2024-09-12T12:25:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273406d630 msgr2=0x7f2734144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273406d630 0x7f2734144290 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f27200b2040 tx=0x7f272001cf40 comp rx=0 tx=0).stop 2024-09-12T12:25:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 shutdown_connections 2024-09-12T12:25:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f27140678c0 0x7f2714069d80 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27340b3490 0x7f273414bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273406d630 0x7f2734144290 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 --2- 172.21.15.144:0/3504247841 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f273406d250 0x7f2734159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:51.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.930+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 >> 172.21.15.144:0/3504247841 conn(0x7f273406bc10 msgr2=0x7f273415c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:51.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.934+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 shutdown_connections 2024-09-12T12:25:51.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:51.934+0000 7f273b000640 1 -- 172.21.15.144:0/3504247841 wait complete. 2024-09-12T12:25:51.955 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:25:52.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f205ce00640 1 Processor -- start 2024-09-12T12:25:52.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f205ce00640 1 -- start start 2024-09-12T12:25:52.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f205ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f205806d250 0x7f205815c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f205ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f205806d630 0x7f2058155820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f205ce00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205806cd20 con 0x7f20580b3490 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f205ce00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2058072620 con 0x7f205806d250 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f205ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f205815cc80 con 0x7f205806d630 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f2055e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f205806d250 0x7f205815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f2055e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f205806d250 0x7f205815c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58074/0 (socket says 172.21.15.144:58074) 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f2055e00640 1 -- 172.21.15.144:0/335459467 learned_addr learned my addr 172.21.15.144:0/335459467 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f2056800640 1 --2- 172.21.15.144:0/335459467 >> v2:172.21.15.165:3300/0 conn(0x7f205806d630 0x7f2058155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f2055e00640 1 -- 172.21.15.144:0/335459467 >> v2:172.21.15.165:3300/0 conn(0x7f205806d630 msgr2=0x7f2058155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f2055e00640 1 --2- 172.21.15.144:0/335459467 >> v2:172.21.15.165:3300/0 conn(0x7f205806d630 0x7f2058155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f2055e00640 1 -- 172.21.15.144:0/335459467 >> v1:172.21.15.165:6789/0 conn(0x7f20580b3490 legacy=0x7f20580b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f2055e00640 1 -- 172.21.15.144:0/335459467 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20580b3950 con 0x7f205806d250 2024-09-12T12:25:52.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.094+0000 7f2056800640 1 --2- 172.21.15.144:0/335459467 >> v2:172.21.15.165:3300/0 conn(0x7f205806d630 0x7f2058155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:52.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f2055e00640 1 --2- 172.21.15.144:0/335459467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d250 0x7f205815c740 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f204800d150 tx=0x7f204801eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58748e72369725ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:52.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f2054a00640 1 -- 172.21.15.144:0/335459467 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204800b2d0 con 0x7f205806d250 2024-09-12T12:25:52.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f2054a00640 1 -- 172.21.15.144:0/335459467 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204800b470 con 0x7f205806d250 2024-09-12T12:25:52.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f2054a00640 1 -- 172.21.15.144:0/335459467 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20480a7c90 con 0x7f205806d250 2024-09-12T12:25:52.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f205ce00640 1 -- 172.21.15.144:0/335459467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d250 msgr2=0x7f205815c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f205ce00640 1 --2- 172.21.15.144:0/335459467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d250 0x7f205815c740 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f204800d150 tx=0x7f204801eb80 comp rx=0 tx=0).stop 2024-09-12T12:25:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f205ce00640 1 -- 172.21.15.144:0/335459467 shutdown_connections 2024-09-12T12:25:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f205ce00640 1 --2- 172.21.15.144:0/335459467 >> v2:172.21.15.165:3300/0 conn(0x7f205806d630 0x7f2058155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f205ce00640 1 --2- 172.21.15.144:0/335459467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d250 0x7f205815c740 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f205ce00640 1 -- 172.21.15.144:0/335459467 >> 172.21.15.144:0/335459467 conn(0x7f205806bc10 msgr2=0x7f205806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f205ce00640 1 -- 172.21.15.144:0/335459467 shutdown_connections 2024-09-12T12:25:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.098+0000 7f205ce00640 1 -- 172.21.15.144:0/335459467 wait complete. 2024-09-12T12:25:52.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 Processor -- start 2024-09-12T12:25:52.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 -- start start 2024-09-12T12:25:52.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205806d250 0x7f2058151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d630 0x7f20580c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20580b3490 0x7f2058142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20580b44d0 con 0x7f205806d630 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20580b41f0 con 0x7f20580b3490 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f205815d690 con 0x7f205806d250 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d630 0x7f20580c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d630 0x7f20580c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58080/0 (socket says 172.21.15.144:58080) 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055400640 1 -- 172.21.15.144:0/2388597073 learned_addr learned my addr 172.21.15.144:0/2388597073 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055e00640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205806d250 0x7f2058151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2056800640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20580b3490 0x7f2058142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055400640 1 -- 172.21.15.144:0/2388597073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205806d250 msgr2=0x7f2058151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055400640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205806d250 0x7f2058151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055400640 1 -- 172.21.15.144:0/2388597073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20580b3490 msgr2=0x7f2058142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055400640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20580b3490 0x7f2058142560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055400640 1 -- 172.21.15.144:0/2388597073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2058142aa0 con 0x7f205806d630 2024-09-12T12:25:52.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f2055400640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d630 0x7f20580c9c40 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f204400b410 tx=0x7f204400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:52.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f204e000640 1 -- 172.21.15.144:0/2388597073 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044015030 con 0x7f205806d630 2024-09-12T12:25:52.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f204e000640 1 -- 172.21.15.144:0/2388597073 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044004020 con 0x7f205806d630 2024-09-12T12:25:52.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f204e000640 1 -- 172.21.15.144:0/2388597073 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044004450 con 0x7f205806d630 2024-09-12T12:25:52.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205813fbb0 con 0x7f205806d630 2024-09-12T12:25:52.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2058140170 con 0x7f205806d630 2024-09-12T12:25:52.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.102+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205815c740 con 0x7f205806d630 2024-09-12T12:25:52.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.106+0000 7f204e000640 1 -- 172.21.15.144:0/2388597073 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2044018070 con 0x7f205806d630 2024-09-12T12:25:52.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.106+0000 7f204e000640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:52.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.106+0000 7f204e000640 1 -- 172.21.15.144:0/2388597073 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 5836+0+0 (secure 0 0 0) 0x7f2044085830 con 0x7f205806d630 2024-09-12T12:25:52.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.106+0000 7f2055e00640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:52.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.106+0000 7f2055e00640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f20480b0000 tx=0x7f20480a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:52.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.110+0000 7f204e000640 1 -- 172.21.15.144:0/2388597073 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2044056250 con 0x7f205806d630 2024-09-12T12:25:52.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.270+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f20580751e0 con 0x7f205806d630 2024-09-12T12:25:52.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.930+0000 7f204e000640 1 -- 172.21.15.144:0/2388597073 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v194) ==== 169+0+0 (secure 0 0 0) 0x7f2044055b50 con 0x7f205806d630 2024-09-12T12:25:52.933 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:25:52.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 msgr2=0x7f2038069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f20480b0000 tx=0x7f20480a9070 comp rx=0 tx=0).stop 2024-09-12T12:25:52.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d630 msgr2=0x7f20580c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:52.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d630 0x7f20580c9c40 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f204400b410 tx=0x7f204400b8d0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 shutdown_connections 2024-09-12T12:25:52.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f20380678c0 0x7f2038069d80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20580b3490 0x7f2058142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f205806d630 0x7f20580c9c40 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 --2- 172.21.15.144:0/2388597073 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f205806d250 0x7f2058151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:52.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 >> 172.21.15.144:0/2388597073 conn(0x7f205806bc10 msgr2=0x7f20580d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:52.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 shutdown_connections 2024-09-12T12:25:52.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:52.934+0000 7f205ce00640 1 -- 172.21.15.144:0/2388597073 wait complete. 2024-09-12T12:25:52.963 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:25:53.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d9400640 1 Processor -- start 2024-09-12T12:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d9400640 1 -- start start 2024-09-12T12:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00d40af5f0 0x7f00d406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d9400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f00d406c150 0x7f00d40cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d9400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d40733e0 con 0x7f00d415c2e0 2024-09-12T12:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d9400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f00d406c5c0 con 0x7f00d40af5f0 2024-09-12T12:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d9400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f00d40cd290 con 0x7f00d406c150 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00d40af5f0 0x7f00d406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00d40af5f0 0x7f00d406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58088/0 (socket says 172.21.15.144:58088) 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f00d415c2e0 0x7f00d4072b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60752/0 (socket says 172.21.15.144:60752) 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d1e00640 1 -- 172.21.15.144:0/4137115919 learned_addr learned my addr 172.21.15.144:0/4137115919 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d3200640 1 --2- 172.21.15.144:0/4137115919 >> v2:172.21.15.165:3300/0 conn(0x7f00d406c150 0x7f00d40cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d1e00640 1 -- 172.21.15.144:0/4137115919 >> v2:172.21.15.165:3300/0 conn(0x7f00d406c150 msgr2=0x7f00d40cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d1e00640 1 --2- 172.21.15.144:0/4137115919 >> v2:172.21.15.165:3300/0 conn(0x7f00d406c150 0x7f00d40cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d1e00640 1 -- 172.21.15.144:0/4137115919 >> v1:172.21.15.144:6789/0 conn(0x7f00d415c2e0 legacy=0x7f00d4072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d1e00640 1 -- 172.21.15.144:0/4137115919 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d40cd570 con 0x7f00d40af5f0 2024-09-12T12:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.106+0000 7f00d1400640 1 -- 172.21.15.144:0/4137115919 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153240119 0 0) 0x7f00d40733e0 con 0x7f00d415c2e0 2024-09-12T12:25:53.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d1e00640 1 --2- 172.21.15.144:0/4137115919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 0x7f00d406bc10 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f00d4071bc0 tx=0x7f00c001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3705cc88df57f657 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d1400640 1 -- 172.21.15.144:0/4137115919 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c00b0070 con 0x7f00d40af5f0 2024-09-12T12:25:53.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d1400640 1 -- 172.21.15.144:0/4137115919 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c00ab600 con 0x7f00d40af5f0 2024-09-12T12:25:53.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d1400640 1 -- 172.21.15.144:0/4137115919 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c00ab9d0 con 0x7f00d40af5f0 2024-09-12T12:25:53.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d9400640 1 -- 172.21.15.144:0/4137115919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 msgr2=0x7f00d406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d9400640 1 --2- 172.21.15.144:0/4137115919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 0x7f00d406bc10 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f00d4071bc0 tx=0x7f00c001c400 comp rx=0 tx=0).stop 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d9400640 1 -- 172.21.15.144:0/4137115919 shutdown_connections 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d9400640 1 --2- 172.21.15.144:0/4137115919 >> v2:172.21.15.165:3300/0 conn(0x7f00d406c150 0x7f00d40cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d9400640 1 --2- 172.21.15.144:0/4137115919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 0x7f00d406bc10 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d9400640 1 -- 172.21.15.144:0/4137115919 >> 172.21.15.144:0/4137115919 conn(0x7f00d4068030 msgr2=0x7f00d40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d9400640 1 -- 172.21.15.144:0/4137115919 shutdown_connections 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.110+0000 7f00d9400640 1 -- 172.21.15.144:0/4137115919 wait complete. 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 Processor -- start 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 -- start start 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d406c150 0x7f00d4151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 0x7f00d4159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00d415c2e0 0x7f00d4152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00d40cee50 con 0x7f00d40af5f0 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f00d40cecd0 con 0x7f00d406c150 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f00d40cefd0 con 0x7f00d415c2e0 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 0x7f00d4159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 0x7f00d4159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58096/0 (socket says 172.21.15.144:58096) 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d1e00640 1 -- 172.21.15.144:0/1336888991 learned_addr learned my addr 172.21.15.144:0/1336888991 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d2800640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d406c150 0x7f00d4151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d3200640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00d415c2e0 0x7f00d4152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d1e00640 1 -- 172.21.15.144:0/1336888991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00d415c2e0 msgr2=0x7f00d4152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d1e00640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00d415c2e0 0x7f00d4152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d1e00640 1 -- 172.21.15.144:0/1336888991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d406c150 msgr2=0x7f00d4151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d1e00640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d406c150 0x7f00d4151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d1e00640 1 -- 172.21.15.144:0/1336888991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d4156280 con 0x7f00d40af5f0 2024-09-12T12:25:53.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d1e00640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 0x7f00d4159860 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f00c00ae040 tx=0x7f00c001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00caa00640 1 -- 172.21.15.144:0/1336888991 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c00b0040 con 0x7f00d40af5f0 2024-09-12T12:25:53.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00caa00640 1 -- 172.21.15.144:0/1336888991 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c0004030 con 0x7f00d40af5f0 2024-09-12T12:25:53.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d4156560 con 0x7f00d40af5f0 2024-09-12T12:25:53.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00caa00640 1 -- 172.21.15.144:0/1336888991 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c00043e0 con 0x7f00d40af5f0 2024-09-12T12:25:53.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.114+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d4156b20 con 0x7f00d40af5f0 2024-09-12T12:25:53.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.118+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d40cdd70 con 0x7f00d40af5f0 2024-09-12T12:25:53.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.118+0000 7f00caa00640 1 -- 172.21.15.144:0/1336888991 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00c00b3070 con 0x7f00d40af5f0 2024-09-12T12:25:53.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.118+0000 7f00caa00640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00b40678c0 0x7f00b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.118+0000 7f00caa00640 1 -- 172.21.15.144:0/1336888991 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5335+0+0 (secure 0 0 0) 0x7f00c011fd90 con 0x7f00d40af5f0 2024-09-12T12:25:53.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.118+0000 7f00d2800640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00b40678c0 0x7f00b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.122+0000 7f00d2800640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00b40678c0 0x7f00b4069d80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f00c4000f70 tx=0x7f00c4007b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.126+0000 7f00caa00640 1 -- 172.21.15.144:0/1336888991 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00c00ba020 con 0x7f00d40af5f0 2024-09-12T12:25:53.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.286+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f00d41515c0 con 0x7f00d40af5f0 2024-09-12T12:25:53.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00caa00640 1 -- 172.21.15.144:0/1336888991 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v47) ==== 104+0+0 (secure 0 0 0) 0x7f00c0016110 con 0x7f00d40af5f0 2024-09-12T12:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00b40678c0 msgr2=0x7f00b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00b40678c0 0x7f00b4069d80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f00c4000f70 tx=0x7f00c4007b60 comp rx=0 tx=0).stop 2024-09-12T12:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 msgr2=0x7f00d4159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 0x7f00d4159860 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f00c00ae040 tx=0x7f00c001ac40 comp rx=0 tx=0).stop 2024-09-12T12:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 shutdown_connections 2024-09-12T12:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f00b40678c0 0x7f00b4069d80 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00d415c2e0 0x7f00d4152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00d40af5f0 0x7f00d4159860 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 --2- 172.21.15.144:0/1336888991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00d406c150 0x7f00d4151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 >> 172.21.15.144:0/1336888991 conn(0x7f00d4068030 msgr2=0x7f00d40d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 shutdown_connections 2024-09-12T12:25:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.290+0000 7f00d9400640 1 -- 172.21.15.144:0/1336888991 wait complete. 2024-09-12T12:25:53.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-12T12:25:53.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb4000640 1 Processor -- start 2024-09-12T12:25:53.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb4000640 1 -- start start 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb4000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7fac15b4e0 0x7f7fac0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb4000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7fac0b3ad0 0x7f7fac071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb4000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7fac071960 0x7f7fac0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb4000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7fac0b45a0 con 0x7f7fac071960 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb4000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7fac0b3fe0 con 0x7f7fac0b3ad0 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb4000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac0b42c0 con 0x7f7fac15b4e0 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7fac071960 0x7f7fac0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7fac071960 0x7f7fac0ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58110/0 (socket says 172.21.15.144:58110) 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb2000640 1 -- 172.21.15.144:0/3481400439 learned_addr learned my addr 172.21.15.144:0/3481400439 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:53.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb0c00640 1 --2- 172.21.15.144:0/3481400439 >> v2:172.21.15.165:3300/0 conn(0x7f7fac0b3ad0 0x7f7fac071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb2000640 1 -- 172.21.15.144:0/3481400439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7fac15b4e0 msgr2=0x7f7fac0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:53.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb2000640 1 --2- 172.21.15.144:0/3481400439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7fac15b4e0 0x7f7fac0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb2000640 1 -- 172.21.15.144:0/3481400439 >> v2:172.21.15.165:3300/0 conn(0x7f7fac0b3ad0 msgr2=0x7f7fac071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:53.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb2000640 1 --2- 172.21.15.144:0/3481400439 >> v2:172.21.15.165:3300/0 conn(0x7f7fac0b3ad0 0x7f7fac071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.446+0000 7f7fb2000640 1 -- 172.21.15.144:0/3481400439 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac0b1490 con 0x7f7fac071960 2024-09-12T12:25:53.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb2000640 1 --2- 172.21.15.144:0/3481400439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 0x7f7fac0ccf30 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f7fac06a020 tx=0x7f7fa401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14dc9450e7e4699 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fabe00640 1 -- 172.21.15.144:0/3481400439 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a5750 con 0x7f7fac071960 2024-09-12T12:25:53.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fabe00640 1 -- 172.21.15.144:0/3481400439 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa40a58f0 con 0x7f7fac071960 2024-09-12T12:25:53.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fabe00640 1 -- 172.21.15.144:0/3481400439 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a5cc0 con 0x7f7fac071960 2024-09-12T12:25:53.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb4000640 1 -- 172.21.15.144:0/3481400439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 msgr2=0x7f7fac0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb4000640 1 --2- 172.21.15.144:0/3481400439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 0x7f7fac0ccf30 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f7fac06a020 tx=0x7f7fa401c9c0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb4000640 1 -- 172.21.15.144:0/3481400439 shutdown_connections 2024-09-12T12:25:53.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb4000640 1 --2- 172.21.15.144:0/3481400439 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 0x7f7fac0ccf30 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb4000640 1 --2- 172.21.15.144:0/3481400439 >> v2:172.21.15.165:3300/0 conn(0x7f7fac0b3ad0 0x7f7fac071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb4000640 1 --2- 172.21.15.144:0/3481400439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7fac15b4e0 0x7f7fac0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb4000640 1 -- 172.21.15.144:0/3481400439 >> 172.21.15.144:0/3481400439 conn(0x7f7fac06d0d0 msgr2=0x7f7fac06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:53.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb4000640 1 -- 172.21.15.144:0/3481400439 shutdown_connections 2024-09-12T12:25:53.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.450+0000 7f7fb4000640 1 -- 172.21.15.144:0/3481400439 wait complete. 2024-09-12T12:25:53.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 Processor -- start 2024-09-12T12:25:53.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 -- start start 2024-09-12T12:25:53.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 0x7f7fac1fa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7fac0b3ad0 0x7f7fac15c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fac15b4e0 0x7f7fac15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac15f270 con 0x7f7fac071960 2024-09-12T12:25:53.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac15f0f0 con 0x7f7fac15b4e0 2024-09-12T12:25:53.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac15f3f0 con 0x7f7fac0b3ad0 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 0x7f7fac1fa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 0x7f7fac1fa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58112/0 (socket says 172.21.15.144:58112) 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb1600640 1 -- 172.21.15.144:0/1757363835 learned_addr learned my addr 172.21.15.144:0/1757363835 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb2000640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fac15b4e0 0x7f7fac15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb0c00640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7fac0b3ad0 0x7f7fac15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb1600640 1 -- 172.21.15.144:0/1757363835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7fac0b3ad0 msgr2=0x7f7fac15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb1600640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7fac0b3ad0 0x7f7fac15c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb1600640 1 -- 172.21.15.144:0/1757363835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fac15b4e0 msgr2=0x7f7fac15dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb1600640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fac15b4e0 0x7f7fac15dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb1600640 1 -- 172.21.15.144:0/1757363835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac1f79f0 con 0x7f7fac071960 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb2000640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fac15b4e0 0x7f7fac15dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb1600640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 0x7f7fac1fa630 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000b410 tx=0x7f7fa000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fa9600640 1 -- 172.21.15.144:0/1757363835 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0015020 con 0x7f7fac071960 2024-09-12T12:25:53.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fa9600640 1 -- 172.21.15.144:0/1757363835 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa0011830 con 0x7f7fac071960 2024-09-12T12:25:53.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fa9600640 1 -- 172.21.15.144:0/1757363835 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0011c20 con 0x7f7fac071960 2024-09-12T12:25:53.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fac1f7cd0 con 0x7f7fac071960 2024-09-12T12:25:53.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.454+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fac1f8290 con 0x7f7fac071960 2024-09-12T12:25:53.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.458+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fac071420 con 0x7f7fac071960 2024-09-12T12:25:53.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.458+0000 7f7fa9600640 1 -- 172.21.15.144:0/1757363835 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7fa0018020 con 0x7f7fac071960 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.458+0000 7f7fa9600640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f8c0678c0 0x7f7f8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.458+0000 7f7fa9600640 1 -- 172.21.15.144:0/1757363835 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5335+0+0 (secure 0 0 0) 0x7f7fa0085ab0 con 0x7f7fac071960 2024-09-12T12:25:53.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.458+0000 7f7fb0c00640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f8c0678c0 0x7f7f8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:53.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.458+0000 7f7fb0c00640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f8c0678c0 0x7f7f8c069d80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7fac072e90 tx=0x7f7f98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:53.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.462+0000 7f7fa9600640 1 -- 172.21.15.144:0/1757363835 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7fa001f020 con 0x7f7fac071960 2024-09-12T12:25:53.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.678+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f7fac0cc6a0 con 0x7f7fac071960 2024-09-12T12:25:53.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fa9600640 1 -- 172.21.15.144:0/1757363835 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v644) ==== 140+0+0 (secure 0 0 0) 0x7f7fa00172c0 con 0x7f7fac071960 2024-09-12T12:25:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f8c0678c0 msgr2=0x7f7f8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f8c0678c0 0x7f7f8c069d80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7fac072e90 tx=0x7f7f98008040 comp rx=0 tx=0).stop 2024-09-12T12:25:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 msgr2=0x7f7fac1fa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 0x7f7fac1fa630 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000b410 tx=0x7f7fa000b8d0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 shutdown_connections 2024-09-12T12:25:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7f8c0678c0 0x7f7f8c069d80 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7fac15b4e0 0x7f7fac15dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7fac0b3ad0 0x7f7fac15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 --2- 172.21.15.144:0/1757363835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fac071960 0x7f7fac1fa630 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 >> 172.21.15.144:0/1757363835 conn(0x7f7fac06d0d0 msgr2=0x7f7fac158120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 shutdown_connections 2024-09-12T12:25:53.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:53.954+0000 7f7fb4000640 1 -- 172.21.15.144:0/1757363835 wait complete. 2024-09-12T12:25:53.978 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-12T12:25:53.978 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-12T12:25:53.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:25:54.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.110+0000 7f1aef000640 1 Processor -- start 2024-09-12T12:25:54.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.110+0000 7f1aef000640 1 -- start start 2024-09-12T12:25:54.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1aef000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ae815c7b0 0x7f1ae80ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1aef000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815cd30 0x7f1ae80b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1aef000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ae80cd870 con 0x7f1ae80b5de0 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1aef000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1ae8072a50 con 0x7f1ae815c7b0 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1aef000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae80cde30 con 0x7f1ae815cd30 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1ae7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ae815c7b0 0x7f1ae80ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1ae7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ae815c7b0 0x7f1ae80ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58114/0 (socket says 172.21.15.144:58114) 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1ae7e00640 1 -- 172.21.15.144:0/1674387033 learned_addr learned my addr 172.21.15.144:0/1674387033 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1ae7400640 1 --2- 172.21.15.144:0/1674387033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815cd30 0x7f1ae80b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1ae7e00640 1 -- 172.21.15.144:0/1674387033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815cd30 msgr2=0x7f1ae80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1ae7e00640 1 --2- 172.21.15.144:0/1674387033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815cd30 0x7f1ae80b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1ae7e00640 1 -- 172.21.15.144:0/1674387033 >> v1:172.21.15.165:6789/0 conn(0x7f1ae80b5de0 legacy=0x7f1ae81601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.114+0000 7f1ae7e00640 1 -- 172.21.15.144:0/1674387033 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae80cdb50 con 0x7f1ae815c7b0 2024-09-12T12:25:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1ae7e00640 1 --2- 172.21.15.144:0/1674387033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815c7b0 0x7f1ae80ccf00 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009870 tx=0x7f1ad801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6438f4721de497 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1ae6a00640 1 -- 172.21.15.144:0/1674387033 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80b2070 con 0x7f1ae815c7b0 2024-09-12T12:25:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1ae6a00640 1 -- 172.21.15.144:0/1674387033 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad80a9070 con 0x7f1ae815c7b0 2024-09-12T12:25:54.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1ae6a00640 1 -- 172.21.15.144:0/1674387033 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad80ad880 con 0x7f1ae815c7b0 2024-09-12T12:25:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 -- 172.21.15.144:0/1674387033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815c7b0 msgr2=0x7f1ae80ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 --2- 172.21.15.144:0/1674387033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815c7b0 0x7f1ae80ccf00 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009870 tx=0x7f1ad801c560 comp rx=0 tx=0).stop 2024-09-12T12:25:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 -- 172.21.15.144:0/1674387033 shutdown_connections 2024-09-12T12:25:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 --2- 172.21.15.144:0/1674387033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815cd30 0x7f1ae80b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 --2- 172.21.15.144:0/1674387033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815c7b0 0x7f1ae80ccf00 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 -- 172.21.15.144:0/1674387033 >> 172.21.15.144:0/1674387033 conn(0x7f1ae806d0d0 msgr2=0x7f1ae806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 -- 172.21.15.144:0/1674387033 shutdown_connections 2024-09-12T12:25:54.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 -- 172.21.15.144:0/1674387033 wait complete. 2024-09-12T12:25:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 Processor -- start 2024-09-12T12:25:54.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 -- start start 2024-09-12T12:25:54.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ae80b5de0 0x7f1ae8150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815c7b0 0x7f1ae81408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815cd30 0x7f1ae8140030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae8169530 con 0x7f1ae815cd30 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae80cd650 con 0x7f1ae80b5de0 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aef000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ae81696b0 con 0x7f1ae815c7b0 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.118+0000 7f1aed000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815cd30 0x7f1ae8140030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aed000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815cd30 0x7f1ae8140030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58126/0 (socket says 172.21.15.144:58126) 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aed000640 1 -- 172.21.15.144:0/2753792951 learned_addr learned my addr 172.21.15.144:0/2753792951 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1ae7400640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815c7b0 0x7f1ae81408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1ae7e00640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ae80b5de0 0x7f1ae8150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aed000640 1 -- 172.21.15.144:0/2753792951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815c7b0 msgr2=0x7f1ae81408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aed000640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815c7b0 0x7f1ae81408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aed000640 1 -- 172.21.15.144:0/2753792951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ae80b5de0 msgr2=0x7f1ae8150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aed000640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ae80b5de0 0x7f1ae8150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aed000640 1 -- 172.21.15.144:0/2753792951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae80b4490 con 0x7f1ae815cd30 2024-09-12T12:25:54.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aed000640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815cd30 0x7f1ae8140030 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c770 tx=0x7f1ae000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1adfe00640 1 -- 172.21.15.144:0/2753792951 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0003b80 con 0x7f1ae815cd30 2024-09-12T12:25:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1adfe00640 1 -- 172.21.15.144:0/2753792951 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ae0003d20 con 0x7f1ae815cd30 2024-09-12T12:25:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae80b0bf0 con 0x7f1ae815cd30 2024-09-12T12:25:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1adfe00640 1 -- 172.21.15.144:0/2753792951 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000aa90 con 0x7f1ae815cd30 2024-09-12T12:25:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae80b1660 con 0x7f1ae815cd30 2024-09-12T12:25:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae80ccf00 con 0x7f1ae815cd30 2024-09-12T12:25:54.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1adfe00640 1 -- 172.21.15.144:0/2753792951 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ae000ac30 con 0x7f1ae815cd30 2024-09-12T12:25:54.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1adfe00640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1ac80678c0 0x7f1ac8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.122+0000 7f1adfe00640 1 -- 172.21.15.144:0/2753792951 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5335+0+0 (secure 0 0 0) 0x7f1ae00858f0 con 0x7f1ae815cd30 2024-09-12T12:25:54.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.126+0000 7f1ae7e00640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1ac80678c0 0x7f1ac8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.126+0000 7f1ae7e00640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1ac80678c0 0x7f1ac8069d80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80af000 tx=0x7f1ad8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:54.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.126+0000 7f1adfe00640 1 -- 172.21.15.144:0/2753792951 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1ae80b4490 con 0x7f1ae815cd30 2024-09-12T12:25:54.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.286+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ae815e300 con 0x7f1ae815cd30 2024-09-12T12:25:54.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.286+0000 7f1adfe00640 1 -- 172.21.15.144:0/2753792951 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) ==== 74+0+13337 (secure 0 0 0) 0x7f1ae0055f40 con 0x7f1ae815cd30 2024-09-12T12:25:54.289 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:54.289 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":194,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:25:52.933810+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":187,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/54351638":"2024-09-13T12:25:49.919428+0000","172.21.15.144:6836/54351638":"2024-09-13T12:25:49.919428+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:25:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1ac80678c0 msgr2=0x7f1ac8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1ac80678c0 0x7f1ac8069d80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80af000 tx=0x7f1ad8008040 comp rx=0 tx=0).stop 2024-09-12T12:25:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815cd30 msgr2=0x7f1ae8140030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815cd30 0x7f1ae8140030 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c770 tx=0x7f1ae000cc30 comp rx=0 tx=0).stop 2024-09-12T12:25:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 shutdown_connections 2024-09-12T12:25:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1ac80678c0 0x7f1ac8069d80 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ae815cd30 0x7f1ae8140030 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ae815c7b0 0x7f1ae81408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 --2- 172.21.15.144:0/2753792951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ae80b5de0 0x7f1ae8150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 >> 172.21.15.144:0/2753792951 conn(0x7f1ae806d0d0 msgr2=0x7f1ae80ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 shutdown_connections 2024-09-12T12:25:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.290+0000 7f1aef000640 1 -- 172.21.15.144:0/2753792951 wait complete. 2024-09-12T12:25:54.311 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:12:35.438330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:25:54.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:25:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.446+0000 7f5befe00640 1 Processor -- start 2024-09-12T12:25:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.446+0000 7f5befe00640 1 -- start start 2024-09-12T12:25:54.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5befe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5bf0147cc0 0x7f5bf006e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5befe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bf01480a0 0x7f5bf00b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5befe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bf006d220 con 0x7f5bf0072fa0 2024-09-12T12:25:54.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5befe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5bf006e4e0 con 0x7f5bf01480a0 2024-09-12T12:25:54.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5befe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5bf006d500 con 0x7f5bf0147cc0 2024-09-12T12:25:54.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5bee000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bf01480a0 0x7f5bf00b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5bee000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bf01480a0 0x7f5bf00b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58142/0 (socket says 172.21.15.144:58142) 2024-09-12T12:25:54.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5bee000640 1 -- 172.21.15.144:0/1130723311 learned_addr learned my addr 172.21.15.144:0/1130723311 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:54.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5beea00640 1 --2- 172.21.15.144:0/1130723311 >> v2:172.21.15.165:3300/0 conn(0x7f5bf0147cc0 0x7f5bf006e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5bee000640 1 -- 172.21.15.144:0/1130723311 >> v2:172.21.15.165:3300/0 conn(0x7f5bf0147cc0 msgr2=0x7f5bf006e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:54.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5bee000640 1 --2- 172.21.15.144:0/1130723311 >> v2:172.21.15.165:3300/0 conn(0x7f5bf0147cc0 0x7f5bf006e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5bee000640 1 -- 172.21.15.144:0/1130723311 >> v1:172.21.15.165:6789/0 conn(0x7f5bf0072fa0 legacy=0x7f5bf0162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:54.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.450+0000 7f5bee000640 1 -- 172.21.15.144:0/1130723311 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf006d7e0 con 0x7f5bf01480a0 2024-09-12T12:25:54.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5bee000640 1 --2- 172.21.15.144:0/1130723311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf01480a0 0x7f5bf00b3fa0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00d33c0 tx=0x7f5bdc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f747810d91b9062f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:54.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5bed600640 1 -- 172.21.15.144:0/1130723311 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0ab5f0 con 0x7f5bf01480a0 2024-09-12T12:25:54.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5bed600640 1 -- 172.21.15.144:0/1130723311 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0b0070 con 0x7f5bf01480a0 2024-09-12T12:25:54.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5bed600640 1 -- 172.21.15.144:0/1130723311 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0ab9b0 con 0x7f5bf01480a0 2024-09-12T12:25:54.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 -- 172.21.15.144:0/1130723311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf01480a0 msgr2=0x7f5bf00b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 --2- 172.21.15.144:0/1130723311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf01480a0 0x7f5bf00b3fa0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00d33c0 tx=0x7f5bdc01c4e0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 -- 172.21.15.144:0/1130723311 shutdown_connections 2024-09-12T12:25:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 --2- 172.21.15.144:0/1130723311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf01480a0 0x7f5bf00b3fa0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 --2- 172.21.15.144:0/1130723311 >> v2:172.21.15.165:3300/0 conn(0x7f5bf0147cc0 0x7f5bf006e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 -- 172.21.15.144:0/1130723311 >> 172.21.15.144:0/1130723311 conn(0x7f5bf00b7c30 msgr2=0x7f5bf0067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 -- 172.21.15.144:0/1130723311 shutdown_connections 2024-09-12T12:25:54.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 -- 172.21.15.144:0/1130723311 wait complete. 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 Processor -- start 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 -- start start 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf0072fa0 0x7f5bf015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf0147cc0 0x7f5bf0140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf01480a0 0x7f5bf0138910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf016b6e0 con 0x7f5bf0072fa0 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf00b48f0 con 0x7f5bf01480a0 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.454+0000 7f5befe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf016b860 con 0x7f5bf0147cc0 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5beea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf0072fa0 0x7f5bf015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5beea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf0072fa0 0x7f5bf015d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58146/0 (socket says 172.21.15.144:58146) 2024-09-12T12:25:54.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5beea00640 1 -- 172.21.15.144:0/2502970663 learned_addr learned my addr 172.21.15.144:0/2502970663 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5bee000640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf0147cc0 0x7f5bf0140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5bef400640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf01480a0 0x7f5bf0138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5beea00640 1 -- 172.21.15.144:0/2502970663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf0147cc0 msgr2=0x7f5bf0140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5beea00640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf0147cc0 0x7f5bf0140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5beea00640 1 -- 172.21.15.144:0/2502970663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf01480a0 msgr2=0x7f5bf0138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5beea00640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf01480a0 0x7f5bf0138910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5beea00640 1 -- 172.21.15.144:0/2502970663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf013ffe0 con 0x7f5bf0072fa0 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5beea00640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf0072fa0 0x7f5bf015d6f0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f5be0007ef0 tx=0x7f5be000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5be7400640 1 -- 172.21.15.144:0/2502970663 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0014620 con 0x7f5bf0072fa0 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5be7400640 1 -- 172.21.15.144:0/2502970663 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be0019070 con 0x7f5bf0072fa0 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf01402c0 con 0x7f5bf0072fa0 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5be7400640 1 -- 172.21.15.144:0/2502970663 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0014a00 con 0x7f5bf0072fa0 2024-09-12T12:25:54.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf01383f0 con 0x7f5bf0072fa0 2024-09-12T12:25:54.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf006e790 con 0x7f5bf0072fa0 2024-09-12T12:25:54.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.458+0000 7f5be7400640 1 -- 172.21.15.144:0/2502970663 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5be0014ba0 con 0x7f5bf0072fa0 2024-09-12T12:25:54.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.462+0000 7f5be7400640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5bd00678c0 0x7f5bd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.462+0000 7f5be7400640 1 -- 172.21.15.144:0/2502970663 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5335+0+0 (secure 0 0 0) 0x7f5be00862d0 con 0x7f5bf0072fa0 2024-09-12T12:25:54.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.462+0000 7f5bee000640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5bd00678c0 0x7f5bd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.462+0000 7f5bee000640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5bd00678c0 0x7f5bd0069d80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0af000 tx=0x7f5bdc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:54.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.466+0000 7f5be7400640 1 -- 172.21.15.144:0/2502970663 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5be0056920 con 0x7f5bf0072fa0 2024-09-12T12:25:54.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5bf006df70 con 0x7f5bf0072fa0 2024-09-12T12:25:54.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5be7400640 1 -- 172.21.15.144:0/2502970663 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v194) ==== 93+0+10 (secure 0 0 0) 0x7f5be005ac20 con 0x7f5bf0072fa0 2024-09-12T12:25:54.628 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-12T12:25:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5bd00678c0 msgr2=0x7f5bd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5bd00678c0 0x7f5bd0069d80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0af000 tx=0x7f5bdc0a7000 comp rx=0 tx=0).stop 2024-09-12T12:25:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf0072fa0 msgr2=0x7f5bf015d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf0072fa0 0x7f5bf015d6f0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f5be0007ef0 tx=0x7f5be000e4b0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 shutdown_connections 2024-09-12T12:25:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5bd00678c0 0x7f5bd0069d80 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf01480a0 0x7f5bf0138910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf0147cc0 0x7f5bf0140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 --2- 172.21.15.144:0/2502970663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf0072fa0 0x7f5bf015d6f0 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.626+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 >> 172.21.15.144:0/2502970663 conn(0x7f5bf00b7c30 msgr2=0x7f5bf013dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:54.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.630+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 shutdown_connections 2024-09-12T12:25:54.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.630+0000 7f5befe00640 1 -- 172.21.15.144:0/2502970663 wait complete. 2024-09-12T12:25:54.651 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-12T12:25:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15ec00640 1 Processor -- start 2024-09-12T12:25:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15ec00640 1 -- start start 2024-09-12T12:25:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 0x7fb1580ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15ec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1580b5fb0 0x7fb158072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1580cd870 con 0x7fb15815cd30 2024-09-12T12:25:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15ec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb158072a50 con 0x7fb1580b5fb0 2024-09-12T12:25:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1580cde30 con 0x7fb15815c7b0 2024-09-12T12:25:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1580b5fb0 0x7fb158072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb157e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 0x7fb1580ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1580b5fb0 0x7fb158072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58150/0 (socket says 172.21.15.144:58150) 2024-09-12T12:25:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15cc00640 1 -- 172.21.15.144:0/3319103146 learned_addr learned my addr 172.21.15.144:0/3319103146 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15cc00640 1 -- 172.21.15.144:0/3319103146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 msgr2=0x7fb1580ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15cc00640 1 --2- 172.21.15.144:0/3319103146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 0x7fb1580ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15cc00640 1 -- 172.21.15.144:0/3319103146 >> v1:172.21.15.165:6789/0 conn(0x7fb15815cd30 legacy=0x7fb1580b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb15cc00640 1 -- 172.21.15.144:0/3319103146 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1580cdb50 con 0x7fb1580b5fb0 2024-09-12T12:25:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.786+0000 7fb156a00640 1 -- 172.21.15.144:0/3319103146 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483196637 0 0) 0x7fb1580cd870 con 0x7fb15815cd30 2024-09-12T12:25:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb15cc00640 1 --2- 172.21.15.144:0/3319103146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 0x7fb158072ee0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fb150009e50 tx=0x7fb15001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b835b898c0576a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb156a00640 1 -- 172.21.15.144:0/3319103146 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1500a5810 con 0x7fb1580b5fb0 2024-09-12T12:25:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb156a00640 1 -- 172.21.15.144:0/3319103146 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1500a59b0 con 0x7fb1580b5fb0 2024-09-12T12:25:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb156a00640 1 -- 172.21.15.144:0/3319103146 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1500a5d80 con 0x7fb1580b5fb0 2024-09-12T12:25:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb15ec00640 1 -- 172.21.15.144:0/3319103146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 msgr2=0x7fb158072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb15ec00640 1 --2- 172.21.15.144:0/3319103146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 0x7fb158072ee0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fb150009e50 tx=0x7fb15001ca30 comp rx=0 tx=0).stop 2024-09-12T12:25:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb15ec00640 1 -- 172.21.15.144:0/3319103146 shutdown_connections 2024-09-12T12:25:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb15ec00640 1 --2- 172.21.15.144:0/3319103146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 0x7fb158072ee0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb15ec00640 1 --2- 172.21.15.144:0/3319103146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 0x7fb1580ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb15ec00640 1 -- 172.21.15.144:0/3319103146 >> 172.21.15.144:0/3319103146 conn(0x7fb15806d0d0 msgr2=0x7fb15806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb15ec00640 1 -- 172.21.15.144:0/3319103146 shutdown_connections 2024-09-12T12:25:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.790+0000 7fb15ec00640 1 -- 172.21.15.144:0/3319103146 wait complete. 2024-09-12T12:25:54.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 Processor -- start 2024-09-12T12:25:54.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 -- start start 2024-09-12T12:25:54.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 0x7fb158146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 0x7fb158155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb15815cd30 0x7fb158156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb158073fc0 con 0x7fb1580b5fb0 2024-09-12T12:25:54.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb158073e40 con 0x7fb15815cd30 2024-09-12T12:25:54.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb158074140 con 0x7fb15815c7b0 2024-09-12T12:25:54.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 0x7fb158146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 0x7fb158146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58158/0 (socket says 172.21.15.144:58158) 2024-09-12T12:25:54.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157e00640 1 -- 172.21.15.144:0/1118125514 learned_addr learned my addr 172.21.15.144:0/1118125514 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:54.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157400640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 0x7fb158155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15cc00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb15815cd30 0x7fb158156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157e00640 1 -- 172.21.15.144:0/1118125514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 msgr2=0x7fb158155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157e00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 0x7fb158155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157e00640 1 -- 172.21.15.144:0/1118125514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb15815cd30 msgr2=0x7fb158156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:54.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157e00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb15815cd30 0x7fb158156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:54.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157e00640 1 -- 172.21.15.144:0/1118125514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1581613f0 con 0x7fb1580b5fb0 2024-09-12T12:25:54.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb157e00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 0x7fb158146fe0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fb14800e9b0 tx=0x7fb14800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:54.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb14fe00640 1 -- 172.21.15.144:0/1118125514 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148017070 con 0x7fb1580b5fb0 2024-09-12T12:25:54.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb14fe00640 1 -- 172.21.15.144:0/1118125514 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14800c9a0 con 0x7fb1580b5fb0 2024-09-12T12:25:54.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb14fe00640 1 -- 172.21.15.144:0/1118125514 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14800cd70 con 0x7fb1580b5fb0 2024-09-12T12:25:54.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1581616d0 con 0x7fb1580b5fb0 2024-09-12T12:25:54.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb158161c90 con 0x7fb1580b5fb0 2024-09-12T12:25:54.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.794+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb158072ee0 con 0x7fb1580b5fb0 2024-09-12T12:25:54.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.798+0000 7fb14fe00640 1 -- 172.21.15.144:0/1118125514 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb14801a070 con 0x7fb1580b5fb0 2024-09-12T12:25:54.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.798+0000 7fb14fe00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1380678c0 0x7fb138069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:54.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.798+0000 7fb14fe00640 1 -- 172.21.15.144:0/1118125514 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5335+0+0 (secure 0 0 0) 0x7fb148085fa0 con 0x7fb1580b5fb0 2024-09-12T12:25:54.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.798+0000 7fb157400640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1380678c0 0x7fb138069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:54.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.798+0000 7fb157400640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1380678c0 0x7fb138069d80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb1580ccc50 tx=0x7fb144009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:54.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:54.802+0000 7fb14fe00640 1 -- 172.21.15.144:0/1118125514 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb148056560 con 0x7fb1580b5fb0 2024-09-12T12:25:55.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.014+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7fb1580afd40 con 0x7fb1580b5fb0 2024-09-12T12:25:55.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.962+0000 7fb14fe00640 1 -- 172.21.15.144:0/1118125514 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v646) ==== 136+0+0 (secure 0 0 0) 0x7fb14805a860 con 0x7fb1580b5fb0 2024-09-12T12:25:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1380678c0 msgr2=0x7fb138069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1380678c0 0x7fb138069d80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb1580ccc50 tx=0x7fb144009040 comp rx=0 tx=0).stop 2024-09-12T12:25:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 msgr2=0x7fb158146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 0x7fb158146fe0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fb14800e9b0 tx=0x7fb14800ee70 comp rx=0 tx=0).stop 2024-09-12T12:25:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 shutdown_connections 2024-09-12T12:25:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb1380678c0 0x7fb138069d80 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb15815cd30 0x7fb158156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb15815c7b0 0x7fb158155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 --2- 172.21.15.144:0/1118125514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1580b5fb0 0x7fb158146fe0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 >> 172.21.15.144:0/1118125514 conn(0x7fb15806d0d0 msgr2=0x7fb1580ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 shutdown_connections 2024-09-12T12:25:55.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:55.966+0000 7fb15ec00640 1 -- 172.21.15.144:0/1118125514 wait complete. 2024-09-12T12:25:55.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T12:25:56.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.130+0000 7f4eafc00640 1 Processor -- start 2024-09-12T12:25:56.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4eafc00640 1 -- start start 2024-09-12T12:25:56.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4eafc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ea815af60 0x7f4ea80ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4eafc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4ea80cd9f0 0x7f4ea806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4eafc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea815b340 0x7f4ea806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4eafc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea80b32f0 con 0x7f4ea815af60 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4eafc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea80b4300 con 0x7f4ea80cd9f0 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4eafc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea80b3540 con 0x7f4ea815b340 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4ead200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ea815af60 0x7f4ea80ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4ead200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ea815af60 0x7f4ea80ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58168/0 (socket says 172.21.15.144:58168) 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4ead200640 1 -- 172.21.15.144:0/3334958492 learned_addr learned my addr 172.21.15.144:0/3334958492 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4eadc00640 1 --2- 172.21.15.144:0/3334958492 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea815b340 0x7f4ea806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4e9fe00640 1 --2- 172.21.15.144:0/3334958492 >> v2:172.21.15.165:3300/0 conn(0x7f4ea80cd9f0 0x7f4ea806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4ead200640 1 -- 172.21.15.144:0/3334958492 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea815b340 msgr2=0x7f4ea806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:56.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4ead200640 1 --2- 172.21.15.144:0/3334958492 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea815b340 0x7f4ea806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4ead200640 1 -- 172.21.15.144:0/3334958492 >> v2:172.21.15.165:3300/0 conn(0x7f4ea80cd9f0 msgr2=0x7f4ea806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:56.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4ead200640 1 --2- 172.21.15.144:0/3334958492 >> v2:172.21.15.165:3300/0 conn(0x7f4ea80cd9f0 0x7f4ea806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4ead200640 1 -- 172.21.15.144:0/3334958492 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea80b3820 con 0x7f4ea815af60 2024-09-12T12:25:56.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4eadc00640 1 --2- 172.21.15.144:0/3334958492 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea815b340 0x7f4ea806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:56.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.134+0000 7f4e9fe00640 1 --2- 172.21.15.144:0/3334958492 >> v2:172.21.15.165:3300/0 conn(0x7f4ea80cd9f0 0x7f4ea806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:56.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4ead200640 1 --2- 172.21.15.144:0/3334958492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815af60 0x7f4ea80ce680 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8070d20 tx=0x7f4e9801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c414386b071ad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:56.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4ea7e00640 1 -- 172.21.15.144:0/3334958492 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b4070 con 0x7f4ea815af60 2024-09-12T12:25:56.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4ea7e00640 1 -- 172.21.15.144:0/3334958492 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980a7b70 con 0x7f4ea815af60 2024-09-12T12:25:56.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4ea7e00640 1 -- 172.21.15.144:0/3334958492 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980af440 con 0x7f4ea815af60 2024-09-12T12:25:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 -- 172.21.15.144:0/3334958492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815af60 msgr2=0x7f4ea80ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 --2- 172.21.15.144:0/3334958492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815af60 0x7f4ea80ce680 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8070d20 tx=0x7f4e9801ebf0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 -- 172.21.15.144:0/3334958492 shutdown_connections 2024-09-12T12:25:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 --2- 172.21.15.144:0/3334958492 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea815b340 0x7f4ea806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 --2- 172.21.15.144:0/3334958492 >> v2:172.21.15.165:3300/0 conn(0x7f4ea80cd9f0 0x7f4ea806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 --2- 172.21.15.144:0/3334958492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815af60 0x7f4ea80ce680 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 -- 172.21.15.144:0/3334958492 >> 172.21.15.144:0/3334958492 conn(0x7f4ea8068030 msgr2=0x7f4ea80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 -- 172.21.15.144:0/3334958492 shutdown_connections 2024-09-12T12:25:56.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 -- 172.21.15.144:0/3334958492 wait complete. 2024-09-12T12:25:56.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.138+0000 7f4eafc00640 1 Processor -- start 2024-09-12T12:25:56.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 -- start start 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea80cd9f0 0x7f4ea814e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea815af60 0x7f4ea815e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815b340 0x7f4ea81500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea815f720 con 0x7f4ea815b340 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea815f5a0 con 0x7f4ea815af60 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea815f8a0 con 0x7f4ea80cd9f0 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eadc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815b340 0x7f4ea81500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eadc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815b340 0x7f4ea81500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58176/0 (socket says 172.21.15.144:58176) 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eadc00640 1 -- 172.21.15.144:0/2837019629 learned_addr learned my addr 172.21.15.144:0/2837019629 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:56.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4ead200640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea80cd9f0 0x7f4ea814e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4e9fe00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea815af60 0x7f4ea815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eadc00640 1 -- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea80cd9f0 msgr2=0x7f4ea814e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eadc00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea80cd9f0 0x7f4ea814e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eadc00640 1 -- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea815af60 msgr2=0x7f4ea815e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eadc00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea815af60 0x7f4ea815e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eadc00640 1 -- 172.21.15.144:0/2837019629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea814c360 con 0x7f4ea815b340 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4ead200640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea80cd9f0 0x7f4ea814e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4e9fe00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea815af60 0x7f4ea815e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eadc00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815b340 0x7f4ea81500e0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0007ea0 tx=0x7f4ea0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4ea5600640 1 -- 172.21.15.144:0/2837019629 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea001a070 con 0x7f4ea815b340 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4ea5600640 1 -- 172.21.15.144:0/2837019629 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea0003bc0 con 0x7f4ea815b340 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4ea5600640 1 -- 172.21.15.144:0/2837019629 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000de70 con 0x7f4ea815b340 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea814c640 con 0x7f4ea815b340 2024-09-12T12:25:56.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea814cc00 con 0x7f4ea815b340 2024-09-12T12:25:56.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.142+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea80ce680 con 0x7f4ea815b340 2024-09-12T12:25:56.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.146+0000 7f4ea5600640 1 -- 172.21.15.144:0/2837019629 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ea001d070 con 0x7f4ea815b340 2024-09-12T12:25:56.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.146+0000 7f4ea5600640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4e840678c0 0x7f4e84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.146+0000 7f4ea5600640 1 -- 172.21.15.144:0/2837019629 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5335+0+0 (secure 0 0 0) 0x7f4ea0085cf0 con 0x7f4ea815b340 2024-09-12T12:25:56.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.146+0000 7f4ead200640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4e840678c0 0x7f4e84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.146+0000 7f4ead200640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4e840678c0 0x7f4e84069d80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4e980b1000 tx=0x7f4e980a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:56.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.150+0000 7f4ea5600640 1 -- 172.21.15.144:0/2837019629 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4ea008a070 con 0x7f4ea815b340 2024-09-12T12:25:56.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.310+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4ea80b0180 con 0x7f4ea815b340 2024-09-12T12:25:56.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.314+0000 7f4ea5600640 1 -- 172.21.15.144:0/2837019629 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f4ea0010070 con 0x7f4ea815b340 2024-09-12T12:25:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4e840678c0 msgr2=0x7f4e84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4e840678c0 0x7f4e84069d80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4e980b1000 tx=0x7f4e980a9070 comp rx=0 tx=0).stop 2024-09-12T12:25:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815b340 msgr2=0x7f4ea81500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815b340 0x7f4ea81500e0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0007ea0 tx=0x7f4ea0007f90 comp rx=0 tx=0).stop 2024-09-12T12:25:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 shutdown_connections 2024-09-12T12:25:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4e840678c0 0x7f4e84069d80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ea815b340 0x7f4ea81500e0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea815af60 0x7f4ea815e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 --2- 172.21.15.144:0/2837019629 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4ea80cd9f0 0x7f4ea814e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 >> 172.21.15.144:0/2837019629 conn(0x7f4ea8068030 msgr2=0x7f4ea80b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:56.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 shutdown_connections 2024-09-12T12:25:56.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.318+0000 7f4eafc00640 1 -- 172.21.15.144:0/2837019629 wait complete. 2024-09-12T12:25:56.340 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:25:56.340 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:25:56.429 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:25:56.527 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:25:56.528 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:25:56.528 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:56.537 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:25:56.537 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:25:56.537 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:56.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:25:56.546 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:25:56.546 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:56.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:25:56.586 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:25:56.587 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:25:56.596 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:25:56.596 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T12:25:56.596 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:25:56.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.762+0000 7fd0e7600640 1 Processor -- start 2024-09-12T12:25:56.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.762+0000 7fd0e7600640 1 -- start start 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0e7600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd0e00b5fb0 0x7fd0e0167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0e7600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e00cd870 con 0x7fd0e015cd30 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0e7600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e00cdb50 con 0x7fd0e015c7b0 2024-09-12T12:25:56.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0e7600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e0072a50 con 0x7fd0e00b5fb0 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0dfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd0e015cd30 0x7fd0e00b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60754/0 (socket says 172.21.15.144:60754) 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0dfe00640 1 -- 172.21.15.144:0/1886245064 learned_addr learned my addr 172.21.15.144:0/1886245064 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:56.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0e5600640 1 --2- 172.21.15.144:0/1886245064 >> v2:172.21.15.144:3300/0 conn(0x7fd0e00b5fb0 0x7fd0e0167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0df400640 1 -- 172.21.15.144:0/1886245064 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526573249 0 0) 0x7fd0e00cd870 con 0x7fd0e015cd30 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0e5600640 1 -- 172.21.15.144:0/1886245064 >> v1:172.21.15.165:6789/0 conn(0x7fd0e015c7b0 legacy=0x7fd0e00ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0e5600640 1 -- 172.21.15.144:0/1886245064 >> v1:172.21.15.144:6789/0 conn(0x7fd0e015cd30 legacy=0x7fd0e00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.766+0000 7fd0e5600640 1 -- 172.21.15.144:0/1886245064 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e00726e0 con 0x7fd0e00b5fb0 2024-09-12T12:25:56.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e5600640 1 --2- 172.21.15.144:0/1886245064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e00b5fb0 0x7fd0e0167310 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097c0 tx=0x7fd0d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92966734564c1495 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:56.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0df400640 1 -- 172.21.15.144:0/1886245064 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80b0070 con 0x7fd0e00b5fb0 2024-09-12T12:25:56.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0df400640 1 -- 172.21.15.144:0/1886245064 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d80ab600 con 0x7fd0e00b5fb0 2024-09-12T12:25:56.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0df400640 1 -- 172.21.15.144:0/1886245064 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80ab9d0 con 0x7fd0e00b5fb0 2024-09-12T12:25:56.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 -- 172.21.15.144:0/1886245064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e00b5fb0 msgr2=0x7fd0e0167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 --2- 172.21.15.144:0/1886245064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e00b5fb0 0x7fd0e0167310 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097c0 tx=0x7fd0d801c460 comp rx=0 tx=0).stop 2024-09-12T12:25:56.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 -- 172.21.15.144:0/1886245064 shutdown_connections 2024-09-12T12:25:56.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 --2- 172.21.15.144:0/1886245064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e00b5fb0 0x7fd0e0167310 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 -- 172.21.15.144:0/1886245064 >> 172.21.15.144:0/1886245064 conn(0x7fd0e006d0d0 msgr2=0x7fd0e006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:56.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 -- 172.21.15.144:0/1886245064 shutdown_connections 2024-09-12T12:25:56.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 -- 172.21.15.144:0/1886245064 wait complete. 2024-09-12T12:25:56.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 Processor -- start 2024-09-12T12:25:56.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 -- start start 2024-09-12T12:25:56.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0e00b5fb0 0x7fd0e0150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0e015c7b0 0x7fd0e015ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e015cd30 0x7fd0e01604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e016a690 con 0x7fd0e015cd30 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e00cd610 con 0x7fd0e015c7b0 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e7600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e016a810 con 0x7fd0e00b5fb0 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e015cd30 0x7fd0e01604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e015cd30 0x7fd0e01604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:58188/0 (socket says 172.21.15.144:58188) 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.770+0000 7fd0e5600640 1 -- 172.21.15.144:0/2178575723 learned_addr learned my addr 172.21.15.144:0/2178575723 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e4c00640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0e00b5fb0 0x7fd0e0150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0dfe00640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0e015c7b0 0x7fd0e015ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e5600640 1 -- 172.21.15.144:0/2178575723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0e00b5fb0 msgr2=0x7fd0e0150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e5600640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0e00b5fb0 0x7fd0e0150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e5600640 1 -- 172.21.15.144:0/2178575723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0e015c7b0 msgr2=0x7fd0e015ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e5600640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0e015c7b0 0x7fd0e015ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e5600640 1 -- 172.21.15.144:0/2178575723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e00b26e0 con 0x7fd0e015cd30 2024-09-12T12:25:56.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e5600640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e015cd30 0x7fd0e01604a0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80ae040 tx=0x7fd0d801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:56.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0dcc00640 1 -- 172.21.15.144:0/2178575723 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80bd070 con 0x7fd0e015cd30 2024-09-12T12:25:56.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0dcc00640 1 -- 172.21.15.144:0/2178575723 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d8004030 con 0x7fd0e015cd30 2024-09-12T12:25:56.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0dcc00640 1 -- 172.21.15.144:0/2178575723 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80b0040 con 0x7fd0e015cd30 2024-09-12T12:25:56.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e0151670 con 0x7fd0e015cd30 2024-09-12T12:25:56.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e0151c30 con 0x7fd0e015cd30 2024-09-12T12:25:56.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e00ccf00 con 0x7fd0e015cd30 2024-09-12T12:25:56.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0dcc00640 1 -- 172.21.15.144:0/2178575723 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0d80aa7d0 con 0x7fd0e015cd30 2024-09-12T12:25:56.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0dcc00640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0c00678c0 0x7fd0c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:56.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0dcc00640 1 -- 172.21.15.144:0/2178575723 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5335+0+0 (secure 0 0 0) 0x7fd0d811fb60 con 0x7fd0e015cd30 2024-09-12T12:25:56.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.774+0000 7fd0e4c00640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0c00678c0 0x7fd0c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:56.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.778+0000 7fd0e4c00640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0c00678c0 0x7fd0c0069d80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00cc870 tx=0x7fd0d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:56.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.778+0000 7fd0dcc00640 1 -- 172.21.15.144:0/2178575723 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd0d8016050 con 0x7fd0e015cd30 2024-09-12T12:25:56.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.970+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0e00aee70 con 0x7fd0e015cd30 2024-09-12T12:25:56.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.970+0000 7fd0dcc00640 1 -- 172.21.15.144:0/2178575723 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+3927 (secure 0 0 0) 0x7fd0d80f0770 con 0x7fd0e015cd30 2024-09-12T12:25:56.974 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:56.974 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":150,"btime":"2024-09-12T12:25:50:923296+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9643,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/890330369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":890330369},{"type":"v1","addr":"172.21.15.165:6833","nonce":890330369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":9646,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3806475980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3806475980},{"type":"v1","addr":"172.21.15.165:6835","nonce":3806475980}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":10215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/4172702060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":4172702060},{"type":"v1","addr":"172.21.15.144:6835","nonce":4172702060}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":142},{"gid":10506,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2677529818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2677529818},{"type":"v1","addr":"172.21.15.144:6837","nonce":2677529818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":150}],"filesystems":[]} 2024-09-12T12:25:56.974 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 150 2024-09-12T12:25:56.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0c00678c0 msgr2=0x7fd0c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0c00678c0 0x7fd0c0069d80 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00cc870 tx=0x7fd0d0009040 comp rx=0 tx=0).stop 2024-09-12T12:25:56.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e015cd30 msgr2=0x7fd0e01604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:56.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e015cd30 0x7fd0e01604a0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80ae040 tx=0x7fd0d801aca0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 shutdown_connections 2024-09-12T12:25:56.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd0c00678c0 0x7fd0c0069d80 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0e015cd30 0x7fd0e01604a0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0e015c7b0 0x7fd0e015ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 --2- 172.21.15.144:0/2178575723 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0e00b5fb0 0x7fd0e0150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:56.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 >> 172.21.15.144:0/2178575723 conn(0x7fd0e006d0d0 msgr2=0x7fd0e01533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:56.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 shutdown_connections 2024-09-12T12:25:56.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:56.974+0000 7fd0e7600640 1 -- 172.21.15.144:0/2178575723 wait complete. 2024-09-12T12:25:56.998 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T12:25:56.998 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T12:25:56.998 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:25:56.998 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:25:56.998 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T12:25:56.998 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T12:25:56.999 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:25:56.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:25:56.999 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T12:25:56.999 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T12:25:56.999 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:25:56.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:25:56.999 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T12:25:56.999 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T12:25:57.000 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:25:57.000 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:25:57.009 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:25:57.010 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T12:25:57.011 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:25:57.011 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T12:25:57.013 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:25:57.013 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T12:25:57.014 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:25:57.014 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T12:25:57.056 INFO:tasks.ceph.mds.c:Started 2024-09-12T12:25:57.057 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:57.058 INFO:tasks.ceph.mds.d:Started 2024-09-12T12:25:57.058 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:57.059 INFO:tasks.ceph.mds.a:Started 2024-09-12T12:25:57.059 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:57.060 INFO:tasks.ceph.mds.b:Started 2024-09-12T12:25:57.060 DEBUG:teuthology.parallel:result is None 2024-09-12T12:25:57.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T12:25:57.143 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-12T12:25:57.143 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-12T12:25:57.149 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-12T12:25:57.149 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:25:57.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.202+0000 7f8a6a800640 1 Processor -- start 2024-09-12T12:25:57.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.202+0000 7f8a6a800640 1 -- start start 2024-09-12T12:25:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a6a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a640cd640 0x7f8a64071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a6a800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a640b45a0 con 0x7f8a6415b4e0 2024-09-12T12:25:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a6a800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a640b3fe0 con 0x7f8a64071420 2024-09-12T12:25:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a6a800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8a640b42c0 con 0x7f8a640cd640 2024-09-12T12:25:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a63400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8a6415b4e0 0x7f8a640b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58388/0 (socket says 172.21.15.144:58388) 2024-09-12T12:25:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a63400640 1 -- 172.21.15.144:0/1487478764 learned_addr learned my addr 172.21.15.144:0/1487478764 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a63e00640 1 --2- 172.21.15.144:0/1487478764 >> v2:172.21.15.144:3300/0 conn(0x7f8a640cd640 0x7f8a64071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a63e00640 1 -- 172.21.15.144:0/1487478764 >> v1:172.21.15.165:6789/0 conn(0x7f8a64071420 legacy=0x7f8a640ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a63e00640 1 -- 172.21.15.144:0/1487478764 >> v1:172.21.15.144:6789/0 conn(0x7f8a6415b4e0 legacy=0x7f8a640b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a63e00640 1 -- 172.21.15.144:0/1487478764 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a640b1490 con 0x7f8a640cd640 2024-09-12T12:25:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a62000640 1 -- 172.21.15.144:0/1487478764 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647311981 0 0) 0x7f8a640b45a0 con 0x7f8a6415b4e0 2024-09-12T12:25:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.206+0000 7f8a63e00640 1 --2- 172.21.15.144:0/1487478764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a640cd640 0x7f8a64071840 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0097c0 tx=0x7f8a5c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7142c3afe7715d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a62000640 1 -- 172.21.15.144:0/1487478764 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0ab600 con 0x7f8a640cd640 2024-09-12T12:25:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a62000640 1 -- 172.21.15.144:0/1487478764 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5c0b0070 con 0x7f8a640cd640 2024-09-12T12:25:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a62000640 1 -- 172.21.15.144:0/1487478764 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0ab9c0 con 0x7f8a640cd640 2024-09-12T12:25:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 -- 172.21.15.144:0/1487478764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a640cd640 msgr2=0x7f8a64071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 --2- 172.21.15.144:0/1487478764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a640cd640 0x7f8a64071840 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0097c0 tx=0x7f8a5c01c470 comp rx=0 tx=0).stop 2024-09-12T12:25:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 -- 172.21.15.144:0/1487478764 shutdown_connections 2024-09-12T12:25:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 --2- 172.21.15.144:0/1487478764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a640cd640 0x7f8a64071840 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 -- 172.21.15.144:0/1487478764 >> 172.21.15.144:0/1487478764 conn(0x7f8a6406d0d0 msgr2=0x7f8a6406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 -- 172.21.15.144:0/1487478764 shutdown_connections 2024-09-12T12:25:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 -- 172.21.15.144:0/1487478764 wait complete. 2024-09-12T12:25:57.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 Processor -- start 2024-09-12T12:25:57.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 -- start start 2024-09-12T12:25:57.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a64071420 0x7f8a64152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a640cd640 0x7f8a64156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a6415b4e0 0x7f8a6415de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6415b8c0 con 0x7f8a64071420 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a640b02e0 con 0x7f8a640cd640 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a6a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8a64155330 con 0x7f8a6415b4e0 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a63400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a64071420 0x7f8a64152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a63400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a64071420 0x7f8a64152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43094/0 (socket says 172.21.15.144:43094) 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a63400640 1 -- 172.21.15.144:0/3736650661 learned_addr learned my addr 172.21.15.144:0/3736650661 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a62a00640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a640cd640 0x7f8a64156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.210+0000 7f8a63e00640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a6415b4e0 0x7f8a6415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a63400640 1 -- 172.21.15.144:0/3736650661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a6415b4e0 msgr2=0x7f8a6415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a63400640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a6415b4e0 0x7f8a6415de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a63400640 1 -- 172.21.15.144:0/3736650661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a640cd640 msgr2=0x7f8a64156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a63400640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a640cd640 0x7f8a64156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a63400640 1 -- 172.21.15.144:0/3736650661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6416a890 con 0x7f8a64071420 2024-09-12T12:25:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a63400640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a64071420 0x7f8a64152e60 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c780 tx=0x7f8a5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:57.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a5b400640 1 -- 172.21.15.144:0/3736650661 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54018070 con 0x7f8a64071420 2024-09-12T12:25:57.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a5b400640 1 -- 172.21.15.144:0/3736650661 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5400a640 con 0x7f8a64071420 2024-09-12T12:25:57.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a641555d0 con 0x7f8a64071420 2024-09-12T12:25:57.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a5b400640 1 -- 172.21.15.144:0/3736650661 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400aa70 con 0x7f8a64071420 2024-09-12T12:25:57.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a64155b90 con 0x7f8a64071420 2024-09-12T12:25:57.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a64071840 con 0x7f8a64071420 2024-09-12T12:25:57.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a5b400640 1 -- 172.21.15.144:0/3736650661 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a5401b070 con 0x7f8a64071420 2024-09-12T12:25:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a5b400640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a440678c0 0x7f8a44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a5b400640 1 -- 172.21.15.144:0/3736650661 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5335+0+0 (secure 0 0 0) 0x7f8a54085120 con 0x7f8a64071420 2024-09-12T12:25:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.214+0000 7f8a62a00640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a440678c0 0x7f8a44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.218+0000 7f8a62a00640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a440678c0 0x7f8a44069d80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b3890 tx=0x7f8a50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:57.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.218+0000 7f8a5b400640 1 -- 172.21.15.144:0/3736650661 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8a540556e0 con 0x7f8a64071420 2024-09-12T12:25:57.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.390+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8a640af990 con 0x7f8a64071420 2024-09-12T12:25:57.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.974+0000 7f8a5b400640 1 -- 172.21.15.144:0/3736650661 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v196) ==== 97+0+0 (secure 0 0 0) 0x7f8a540599e0 con 0x7f8a64071420 2024-09-12T12:25:57.977 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-12T12:25:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a440678c0 msgr2=0x7f8a44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a440678c0 0x7f8a44069d80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b3890 tx=0x7f8a50009040 comp rx=0 tx=0).stop 2024-09-12T12:25:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a64071420 msgr2=0x7f8a64152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a64071420 0x7f8a64152e60 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400c780 tx=0x7f8a5400cc40 comp rx=0 tx=0).stop 2024-09-12T12:25:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 shutdown_connections 2024-09-12T12:25:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f8a440678c0 0x7f8a44069d80 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a6415b4e0 0x7f8a6415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a640cd640 0x7f8a64156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 --2- 172.21.15.144:0/3736650661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a64071420 0x7f8a64152e60 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:57.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 >> 172.21.15.144:0/3736650661 conn(0x7f8a6406d0d0 msgr2=0x7f8a6415efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:57.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 shutdown_connections 2024-09-12T12:25:57.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:57.978+0000 7f8a6a800640 1 -- 172.21.15.144:0/3736650661 wait complete. 2024-09-12T12:25:58.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T12:25:58.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb503200640 1 Processor -- start 2024-09-12T12:25:58.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb503200640 1 -- start start 2024-09-12T12:25:58.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb503200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb4fc06ea10 0x7fb4fc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb503200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4fc0b6f60 con 0x7fb4fc0b44a0 2024-09-12T12:25:58.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb503200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4fc0b7240 con 0x7fb4fc15e5f0 2024-09-12T12:25:58.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb503200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb4fc0b7520 con 0x7fb4fc06ea10 2024-09-12T12:25:58.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb4fb400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb4fc0b44a0 0x7fb4fc06e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58390/0 (socket says 172.21.15.144:58390) 2024-09-12T12:25:58.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb4fb400640 1 -- 172.21.15.144:0/3349227323 learned_addr learned my addr 172.21.15.144:0/3349227323 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:58.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb501200640 1 --2- 172.21.15.144:0/3349227323 >> v2:172.21.15.165:3300/0 conn(0x7fb4fc06ea10 0x7fb4fc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb4faa00640 1 -- 172.21.15.144:0/3349227323 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167747529 0 0) 0x7fb4fc0b6f60 con 0x7fb4fc0b44a0 2024-09-12T12:25:58.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb4faa00640 1 -- 172.21.15.144:0/3349227323 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e0003530 con 0x7fb4fc0b44a0 2024-09-12T12:25:58.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb501200640 1 -- 172.21.15.144:0/3349227323 >> v1:172.21.15.165:6789/0 conn(0x7fb4fc15e5f0 legacy=0x7fb4fc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb501200640 1 -- 172.21.15.144:0/3349227323 >> v1:172.21.15.144:6789/0 conn(0x7fb4fc0b44a0 legacy=0x7fb4fc06e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.142+0000 7fb501200640 1 -- 172.21.15.144:0/3349227323 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4fc0b7800 con 0x7fb4fc06ea10 2024-09-12T12:25:58.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb501200640 1 --2- 172.21.15.144:0/3349227323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4fc06ea10 0x7fb4fc0b48d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40097c0 tx=0x7fb4f401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f45d828a7cd8686 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb4faa00640 1 -- 172.21.15.144:0/3349227323 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40ab430 con 0x7fb4fc06ea10 2024-09-12T12:25:58.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb4faa00640 1 -- 172.21.15.144:0/3349227323 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f40b0070 con 0x7fb4fc06ea10 2024-09-12T12:25:58.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb4faa00640 1 -- 172.21.15.144:0/3349227323 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40ab7f0 con 0x7fb4fc06ea10 2024-09-12T12:25:58.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb503200640 1 -- 172.21.15.144:0/3349227323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4fc06ea10 msgr2=0x7fb4fc0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb503200640 1 --2- 172.21.15.144:0/3349227323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4fc06ea10 0x7fb4fc0b48d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40097c0 tx=0x7fb4f401c410 comp rx=0 tx=0).stop 2024-09-12T12:25:58.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb503200640 1 -- 172.21.15.144:0/3349227323 shutdown_connections 2024-09-12T12:25:58.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb503200640 1 --2- 172.21.15.144:0/3349227323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4fc06ea10 0x7fb4fc0b48d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb503200640 1 -- 172.21.15.144:0/3349227323 >> 172.21.15.144:0/3349227323 conn(0x7fb4fc06f400 msgr2=0x7fb4fc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb503200640 1 -- 172.21.15.144:0/3349227323 shutdown_connections 2024-09-12T12:25:58.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.146+0000 7fb503200640 1 -- 172.21.15.144:0/3349227323 wait complete. 2024-09-12T12:25:58.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 Processor -- start 2024-09-12T12:25:58.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 -- start start 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4fc06ea10 0x7fb4fc15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4fc0b44a0 0x7fb4fc15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4fc15e5f0 0x7fb4fc15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc15fa90 con 0x7fb4fc06ea10 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc15f910 con 0x7fb4fc15e5f0 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb4fc16c130 con 0x7fb4fc0b44a0 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4fc06ea10 0x7fb4fc15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4fc06ea10 0x7fb4fc15d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43102/0 (socket says 172.21.15.144:43102) 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fbe00640 1 -- 172.21.15.144:0/4126065794 learned_addr learned my addr 172.21.15.144:0/4126065794 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:58.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb501200640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4fc15e5f0 0x7fb4fc15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fb400640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4fc0b44a0 0x7fb4fc15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fbe00640 1 -- 172.21.15.144:0/4126065794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4fc0b44a0 msgr2=0x7fb4fc15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fbe00640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4fc0b44a0 0x7fb4fc15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fbe00640 1 -- 172.21.15.144:0/4126065794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4fc15e5f0 msgr2=0x7fb4fc15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fbe00640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4fc15e5f0 0x7fb4fc15c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fbe00640 1 -- 172.21.15.144:0/4126065794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4fc15da30 con 0x7fb4fc06ea10 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fb400640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4fc0b44a0 0x7fb4fc15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4fbe00640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4fc06ea10 0x7fb4fc15d4f0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00c730 tx=0x7fb4ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4f3e00640 1 -- 172.21.15.144:0/4126065794 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec016020 con 0x7fb4fc06ea10 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4f3e00640 1 -- 172.21.15.144:0/4126065794 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ec006d60 con 0x7fb4fc06ea10 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb4f3e00640 1 -- 172.21.15.144:0/4126065794 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec003bc0 con 0x7fb4fc06ea10 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4fc15b3b0 con 0x7fb4fc06ea10 2024-09-12T12:25:58.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.150+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4fc14de20 con 0x7fb4fc06ea10 2024-09-12T12:25:58.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.154+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4fc0b48d0 con 0x7fb4fc06ea10 2024-09-12T12:25:58.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.154+0000 7fb4f3e00640 1 -- 172.21.15.144:0/4126065794 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb4ec00a850 con 0x7fb4fc06ea10 2024-09-12T12:25:58.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.154+0000 7fb4f3e00640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4dc0678f0 0x7fb4dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.154+0000 7fb4f3e00640 1 -- 172.21.15.144:0/4126065794 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 5249+0+0 (secure 0 0 0) 0x7fb4ec086370 con 0x7fb4fc06ea10 2024-09-12T12:25:58.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.154+0000 7fb4fb400640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4dc0678f0 0x7fb4dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.154+0000 7fb4fb400640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4dc0678f0 0x7fb4dc069db0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0d2de0 tx=0x7fb4e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.158+0000 7fb4f3e00640 1 -- 172.21.15.144:0/4126065794 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb4ec020020 con 0x7fb4fc06ea10 2024-09-12T12:25:58.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.370+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb4fc06e220 con 0x7fb4fc06ea10 2024-09-12T12:25:58.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.370+0000 7fb4f3e00640 1 -- 172.21.15.144:0/4126065794 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) ==== 80+0+5304 (secure 0 0 0) 0x7fb4ec0571e0 con 0x7fb4fc06ea10 2024-09-12T12:25:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:58.374 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:25:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-12T12:25:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.374 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmBswPHxAAJznU4v5oit214zLG8maeOw==", 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmM/kAKxAA/IsOIIRj6R72BI80RvvY5A==", 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.375 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmJgQXJhAA5fXAYaxPxevoQbWZjbewSQ==", 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:58.376 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm90w2MhAAs5iAH0PfMYP+oi1wlvA1qg==", 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCD2uJmmWPhMRAAwj8TJrtkoLs/AMel5welJQ==", 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCH2uJmrO5tCRAAeLIR2PkcZNQDmTCpEOznGQ==", 2024-09-12T12:25:58.378 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCK2uJmu8iyHBAABw/b4qZzCHTPhiiIC52yQA==", 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:58.379 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCN2uJmcZ2dLxAA2P8CsFrIzCYc9L4TIRBb0w==", 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCT2uJmXJKgMRAAWOJUR2wl85TSzKRzvxzasg==", 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCX2uJmhCySCxAA9zj+1kl9pNbFJCJWIFFLcg==", 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.381 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCa2uJmAxcuHxAAlh4Rqm4wgzSHvYFkGg+RLg==", 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCd2uJmJFmkNRAAG5x6YuqnjHPe9+apK3/rRQ==", 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA==", 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:58.383 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmbMbDAxAAglZJbFujtgAyDsL8HhDYGw==", 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:25:58.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmF4laABAAJhRT1EMhMLXeadvjEL9xdA==", 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.385 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCB2uJmB+LACRAAEYM0v9SS5/GBK5pi5WS/mA==", 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmeE6lAhAAQsQiLDx7EcB/dpU/4vBQzA==", 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:25:58.386 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmNJ9eGhAAeaRntX6v0wp549BgyNX1Ug==", 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQCA2uJmgkiWFhAAQsCiEz+U3l23CT5LBDVtkw==", 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-12T12:25:58.388 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:25:58.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4dc0678f0 msgr2=0x7fb4dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4dc0678f0 0x7fb4dc069db0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0d2de0 tx=0x7fb4e8009040 comp rx=0 tx=0).stop 2024-09-12T12:25:58.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4fc06ea10 msgr2=0x7fb4fc15d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4fc06ea10 0x7fb4fc15d4f0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00c730 tx=0x7fb4ec00cbf0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 shutdown_connections 2024-09-12T12:25:58.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fb4dc0678f0 0x7fb4dc069db0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4fc15e5f0 0x7fb4fc15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4fc0b44a0 0x7fb4fc15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 --2- 172.21.15.144:0/4126065794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4fc06ea10 0x7fb4fc15d4f0 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 >> 172.21.15.144:0/4126065794 conn(0x7fb4fc06f400 msgr2=0x7fb4fc0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 shutdown_connections 2024-09-12T12:25:58.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.374+0000 7fb503200640 1 -- 172.21.15.144:0/4126065794 wait complete. 2024-09-12T12:25:58.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T12:25:58.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcc2000640 1 Processor -- start 2024-09-12T12:25:58.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcc2000640 1 -- start start 2024-09-12T12:25:58.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcc2000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdcbc15b4e0 0x7fdcbc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcc2000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcbc0b45a0 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcc2000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcbc0b3fe0 con 0x7fdcbc0ccf30 2024-09-12T12:25:58.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcc2000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdcbc0b42c0 con 0x7fdcbc15b4e0 2024-09-12T12:25:58.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcb3e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdcbc0b3ad0 0x7fdcbc071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58404/0 (socket says 172.21.15.144:58404) 2024-09-12T12:25:58.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcb3e00640 1 -- 172.21.15.144:0/2895192831 learned_addr learned my addr 172.21.15.144:0/2895192831 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:25:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcbb400640 1 --2- 172.21.15.144:0/2895192831 >> v2:172.21.15.165:3300/0 conn(0x7fdcbc15b4e0 0x7fdcbc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcbaa00640 1 -- 172.21.15.144:0/2895192831 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673699903 0 0) 0x7fdcbc0b45a0 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.530+0000 7fdcbaa00640 1 -- 172.21.15.144:0/2895192831 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdca0003530 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.534+0000 7fdcbb400640 1 -- 172.21.15.144:0/2895192831 >> v1:172.21.15.165:6789/0 conn(0x7fdcbc0ccf30 legacy=0x7fdcbc0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.534+0000 7fdcbb400640 1 -- 172.21.15.144:0/2895192831 >> v1:172.21.15.144:6789/0 conn(0x7fdcbc0b3ad0 legacy=0x7fdcbc071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.534+0000 7fdcbaa00640 1 -- 172.21.15.144:0/2895192831 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3750185318 0 0) 0x7fdca0003530 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.534+0000 7fdcbb400640 1 -- 172.21.15.144:0/2895192831 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc0b1490 con 0x7fdcbc15b4e0 2024-09-12T12:25:58.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.534+0000 7fdcbb400640 1 --2- 172.21.15.144:0/2895192831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc15b4e0 0x7fdcbc0b3590 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83f00cf1fa05e6d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.534+0000 7fdcbaa00640 1 -- 172.21.15.144:0/2895192831 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0b0070 con 0x7fdcbc15b4e0 2024-09-12T12:25:58.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.534+0000 7fdcbaa00640 1 -- 172.21.15.144:0/2895192831 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcac0ab400 con 0x7fdcbc15b4e0 2024-09-12T12:25:58.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.534+0000 7fdcbaa00640 1 -- 172.21.15.144:0/2895192831 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4001680 con 0x7fdcbc15b4e0 2024-09-12T12:25:58.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- 172.21.15.144:0/2895192831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc15b4e0 msgr2=0x7fdcbc0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 --2- 172.21.15.144:0/2895192831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc15b4e0 0x7fdcbc0b3590 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01c390 comp rx=0 tx=0).stop 2024-09-12T12:25:58.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- 172.21.15.144:0/2895192831 shutdown_connections 2024-09-12T12:25:58.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 --2- 172.21.15.144:0/2895192831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc15b4e0 0x7fdcbc0b3590 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- 172.21.15.144:0/2895192831 >> 172.21.15.144:0/2895192831 conn(0x7fdcbc06d0d0 msgr2=0x7fdcbc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- 172.21.15.144:0/2895192831 shutdown_connections 2024-09-12T12:25:58.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- 172.21.15.144:0/2895192831 wait complete. 2024-09-12T12:25:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 Processor -- start 2024-09-12T12:25:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- start start 2024-09-12T12:25:58.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc0b3ad0 0x7fdcbc156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc0ccf30 0x7fdcbc15c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdcbc15b4e0 0x7fdcbc153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc15b8c0 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc0cd750 con 0x7fdcbc0ccf30 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdcbc0d1440 con 0x7fdcbc15b4e0 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc0b3ad0 0x7fdcbc156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc0b3ad0 0x7fdcbc156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43104/0 (socket says 172.21.15.144:43104) 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbb400640 1 -- 172.21.15.144:0/2852829299 learned_addr learned my addr 172.21.15.144:0/2852829299 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcb3e00640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc0ccf30 0x7fdcbc15c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbbe00640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdcbc15b4e0 0x7fdcbc153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbb400640 1 -- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdcbc15b4e0 msgr2=0x7fdcbc153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbb400640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdcbc15b4e0 0x7fdcbc153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbb400640 1 -- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc0ccf30 msgr2=0x7fdcbc15c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbb400640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc0ccf30 0x7fdcbc15c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbb400640 1 -- 172.21.15.144:0/2852829299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc1552a0 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcb3e00640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc0ccf30 0x7fdcbc15c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbbe00640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdcbc15b4e0 0x7fdcbc153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:25:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcbb400640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc0b3ad0 0x7fdcbc156060 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcb3400640 1 -- 172.21.15.144:0/2852829299 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0b0050 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcb3400640 1 -- 172.21.15.144:0/2852829299 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcac0b1040 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcb3400640 1 -- 172.21.15.144:0/2852829299 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0b7450 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.538+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc155580 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.542+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc155b40 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.542+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcbc0b3590 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.542+0000 7fdcb3400640 1 -- 172.21.15.144:0/2852829299 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdcac0be030 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.542+0000 7fdcb3400640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc980678c0 0x7fdc98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.542+0000 7fdcb3400640 1 -- 172.21.15.144:0/2852829299 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 5249+0+0 (secure 0 0 0) 0x7fdcac11f550 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.542+0000 7fdcb3e00640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc980678c0 0x7fdc98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.542+0000 7fdcb3e00640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc980678c0 0x7fdc98069d80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fdca40011f0 tx=0x7fdca4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.546+0000 7fdcb3400640 1 -- 172.21.15.144:0/2852829299 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdcac0c5060 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdcbc15e740 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcb3400640 1 -- 172.21.15.144:0/2852829299 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v198) ==== 84+0+65 (secure 0 0 0) 0x7fdcac015fb0 con 0x7fdcbc0b3ad0 2024-09-12T12:25:58.708 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:25:58.708 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-12T12:25:58.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-12T12:25:58.709 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-12T12:25:58.709 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-12T12:25:58.709 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:25:58.709 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-12T12:25:58.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc980678c0 msgr2=0x7fdc98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc980678c0 0x7fdc98069d80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fdca40011f0 tx=0x7fdca4009040 comp rx=0 tx=0).stop 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc0b3ad0 msgr2=0x7fdcbc156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc0b3ad0 0x7fdcbc156060 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0097c0 tx=0x7fdcac01abd0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 shutdown_connections 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc980678c0 0x7fdc98069d80 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdcbc15b4e0 0x7fdcbc153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcbc0ccf30 0x7fdcbc15c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.706+0000 7fdcc2000640 1 --2- 172.21.15.144:0/2852829299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdcbc0b3ad0 0x7fdcbc156060 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.710+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 >> 172.21.15.144:0/2852829299 conn(0x7fdcbc06d0d0 msgr2=0x7fdcbc15a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.710+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 shutdown_connections 2024-09-12T12:25:58.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.710+0000 7fdcc2000640 1 -- 172.21.15.144:0/2852829299 wait complete. 2024-09-12T12:25:58.731 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:25:58.731 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:25:58.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.866+0000 7f7a7b200640 1 Processor -- start 2024-09-12T12:25:58.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a7b200640 1 -- start start 2024-09-12T12:25:58.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a7b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7a7c0b1e10 0x7f7a7c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a7b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7a7c073d30 0x7f7a7c070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a7b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7c0b3840 con 0x7f7a7c15c7d0 2024-09-12T12:25:58.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a7b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7c0b3e50 con 0x7f7a7c073d30 2024-09-12T12:25:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a7b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7c0b2730 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a79400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7a7c073d30 0x7f7a7c070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a79400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7a7c073d30 0x7f7a7c070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43112/0 (socket says 172.21.15.144:43112) 2024-09-12T12:25:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a79400640 1 -- 172.21.15.144:0/102632705 learned_addr learned my addr 172.21.15.144:0/102632705 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a79e00640 1 --2- 172.21.15.144:0/102632705 >> v2:172.21.15.165:3300/0 conn(0x7f7a7c0b1e10 0x7f7a7c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a79400640 1 -- 172.21.15.144:0/102632705 >> v2:172.21.15.165:3300/0 conn(0x7f7a7c0b1e10 msgr2=0x7f7a7c0b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:25:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a79400640 1 --2- 172.21.15.144:0/102632705 >> v2:172.21.15.165:3300/0 conn(0x7f7a7c0b1e10 0x7f7a7c0b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a79400640 1 -- 172.21.15.144:0/102632705 >> v1:172.21.15.165:6789/0 conn(0x7f7a7c15c7d0 legacy=0x7f7a7c0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.870+0000 7f7a79400640 1 -- 172.21.15.144:0/102632705 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c071510 con 0x7f7a7c073d30 2024-09-12T12:25:58.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a79400640 1 --2- 172.21.15.144:0/102632705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c073d30 0x7f7a7c070fd0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c068a90 tx=0x7f7a6801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa320905ed21fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a78a00640 1 -- 172.21.15.144:0/102632705 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a680ab610 con 0x7f7a7c073d30 2024-09-12T12:25:58.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a78a00640 1 -- 172.21.15.144:0/102632705 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a680b0070 con 0x7f7a7c073d30 2024-09-12T12:25:58.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a78a00640 1 -- 172.21.15.144:0/102632705 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a680ab9d0 con 0x7f7a7c073d30 2024-09-12T12:25:58.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 -- 172.21.15.144:0/102632705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c073d30 msgr2=0x7f7a7c070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 --2- 172.21.15.144:0/102632705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c073d30 0x7f7a7c070fd0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c068a90 tx=0x7f7a6801c520 comp rx=0 tx=0).stop 2024-09-12T12:25:58.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 -- 172.21.15.144:0/102632705 shutdown_connections 2024-09-12T12:25:58.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 --2- 172.21.15.144:0/102632705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c073d30 0x7f7a7c070fd0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 --2- 172.21.15.144:0/102632705 >> v2:172.21.15.165:3300/0 conn(0x7f7a7c0b1e10 0x7f7a7c0b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 -- 172.21.15.144:0/102632705 >> 172.21.15.144:0/102632705 conn(0x7f7a7c06bc10 msgr2=0x7f7a7c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:58.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 -- 172.21.15.144:0/102632705 shutdown_connections 2024-09-12T12:25:58.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 -- 172.21.15.144:0/102632705 wait complete. 2024-09-12T12:25:58.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 Processor -- start 2024-09-12T12:25:58.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.874+0000 7f7a7b200640 1 -- start start 2024-09-12T12:25:58.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a7c073d30 0x7f7a7c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c0b1e10 0x7f7a7c1395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a7c15c7d0 0x7f7a7c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c145d90 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c0b3ae0 con 0x7f7a7c15c7d0 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7c145f10 con 0x7f7a7c073d30 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c0b1e10 0x7f7a7c1395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c0b1e10 0x7f7a7c1395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43116/0 (socket says 172.21.15.144:43116) 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79400640 1 -- 172.21.15.144:0/3330313969 learned_addr learned my addr 172.21.15.144:0/3330313969 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79e00640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a7c073d30 0x7f7a7c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7a800640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a7c15c7d0 0x7f7a7c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79400640 1 -- 172.21.15.144:0/3330313969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a7c073d30 msgr2=0x7f7a7c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79400640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a7c073d30 0x7f7a7c15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79400640 1 -- 172.21.15.144:0/3330313969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a7c15c7d0 msgr2=0x7f7a7c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79400640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a7c15c7d0 0x7f7a7c0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79400640 1 -- 172.21.15.144:0/3330313969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c15da90 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a79400640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c0b1e10 0x7f7a7c1395f0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ad040 tx=0x7f7a6801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a72000640 1 -- 172.21.15.144:0/3330313969 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a680be5f0 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a72000640 1 -- 172.21.15.144:0/3330313969 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a680be790 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a72000640 1 -- 172.21.15.144:0/3330313969 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a680beb80 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7c15dd70 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7c13ca70 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a7c13c890 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.878+0000 7f7a72000640 1 -- 172.21.15.144:0/3330313969 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a680b43f0 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.882+0000 7f7a72000640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a5c0678c0 0x7f7a5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:25:58.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.882+0000 7f7a72000640 1 -- 172.21.15.144:0/3330313969 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 5249+0+0 (secure 0 0 0) 0x7f7a68120310 con 0x7f7a7c0b1e10 2024-09-12T12:25:58.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.882+0000 7f7a79e00640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a5c0678c0 0x7f7a5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:25:58.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.882+0000 7f7a79e00640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a5c0678c0 0x7f7a5c069d80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009fd0 tx=0x7f7a6c009800 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:25:58.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:58.886+0000 7f7a72000640 1 -- 172.21.15.144:0/3330313969 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a7c13c890 con 0x7f7a7c0b1e10 2024-09-12T12:25:59.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.046+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7a7c0b0360 con 0x7f7a7c0b1e10 2024-09-12T12:25:59.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.986+0000 7f7a72000640 1 -- 172.21.15.144:0/3330313969 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v199) ==== 138+0+0 (secure 0 0 0) 0x7f7a680a8050 con 0x7f7a7c0b1e10 2024-09-12T12:25:59.988 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-12T12:25:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a5c0678c0 msgr2=0x7f7a5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a5c0678c0 0x7f7a5c069d80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009fd0 tx=0x7f7a6c009800 comp rx=0 tx=0).stop 2024-09-12T12:25:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c0b1e10 msgr2=0x7f7a7c1395f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:25:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c0b1e10 0x7f7a7c1395f0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ad040 tx=0x7f7a6801ad60 comp rx=0 tx=0).stop 2024-09-12T12:25:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 shutdown_connections 2024-09-12T12:25:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f7a5c0678c0 0x7f7a5c069d80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a7c15c7d0 0x7f7a7c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a7c0b1e10 0x7f7a7c1395f0 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 --2- 172.21.15.144:0/3330313969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7a7c073d30 0x7f7a7c15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:25:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 >> 172.21.15.144:0/3330313969 conn(0x7f7a7c06bc10 msgr2=0x7f7a7c0b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:25:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 shutdown_connections 2024-09-12T12:25:59.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:25:59.990+0000 7f7a7b200640 1 -- 172.21.15.144:0/3330313969 wait complete. 2024-09-12T12:26:00.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:26:00.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.158+0000 7ff45b200640 1 Processor -- start 2024-09-12T12:26:00.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.158+0000 7ff45b200640 1 -- start start 2024-09-12T12:26:00.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff45b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff45c0d01c0 0x7ff45c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:00.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff45b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45c0af6b0 con 0x7ff45c06d560 2024-09-12T12:26:00.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff45b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45c0d0ae0 con 0x7ff45c072a00 2024-09-12T12:26:00.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff45b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff45c06df40 con 0x7ff45c0d01c0 2024-09-12T12:26:00.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff459400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff45c06d560 0x7ff45c0ae890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58418/0 (socket says 172.21.15.144:58418) 2024-09-12T12:26:00.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff459400640 1 -- 172.21.15.144:0/29098332 learned_addr learned my addr 172.21.15.144:0/29098332 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:00.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff459e00640 1 --2- 172.21.15.144:0/29098332 >> v2:172.21.15.165:3300/0 conn(0x7ff45c0d01c0 0x7ff45c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:00.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff458a00640 1 -- 172.21.15.144:0/29098332 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1736046760 0 0) 0x7ff45c0af6b0 con 0x7ff45c06d560 2024-09-12T12:26:00.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff458a00640 1 -- 172.21.15.144:0/29098332 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff440003530 con 0x7ff45c06d560 2024-09-12T12:26:00.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff459e00640 1 -- 172.21.15.144:0/29098332 >> v1:172.21.15.165:6789/0 conn(0x7ff45c072a00 legacy=0x7ff45c0aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:00.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff459e00640 1 -- 172.21.15.144:0/29098332 >> v1:172.21.15.144:6789/0 conn(0x7ff45c06d560 legacy=0x7ff45c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:00.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.162+0000 7ff459e00640 1 -- 172.21.15.144:0/29098332 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c06e220 con 0x7ff45c0d01c0 2024-09-12T12:26:00.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff459e00640 1 --2- 172.21.15.144:0/29098332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff45c0d01c0 0x7ff45c0d05a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009d90 tx=0x7ff44c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7183d4c546dad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:00.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff458a00640 1 -- 172.21.15.144:0/29098332 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0b2070 con 0x7ff45c0d01c0 2024-09-12T12:26:00.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff458a00640 1 -- 172.21.15.144:0/29098332 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c0a5a20 con 0x7ff45c0d01c0 2024-09-12T12:26:00.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff458a00640 1 -- 172.21.15.144:0/29098332 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0a5dd0 con 0x7ff45c0d01c0 2024-09-12T12:26:00.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 -- 172.21.15.144:0/29098332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff45c0d01c0 msgr2=0x7ff45c0d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 --2- 172.21.15.144:0/29098332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff45c0d01c0 0x7ff45c0d05a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009d90 tx=0x7ff44c01c940 comp rx=0 tx=0).stop 2024-09-12T12:26:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 -- 172.21.15.144:0/29098332 shutdown_connections 2024-09-12T12:26:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 --2- 172.21.15.144:0/29098332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff45c0d01c0 0x7ff45c0d05a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 -- 172.21.15.144:0/29098332 >> 172.21.15.144:0/29098332 conn(0x7ff45c0b60d0 msgr2=0x7ff45c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 -- 172.21.15.144:0/29098332 shutdown_connections 2024-09-12T12:26:00.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 -- 172.21.15.144:0/29098332 wait complete. 2024-09-12T12:26:00.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 Processor -- start 2024-09-12T12:26:00.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 -- start start 2024-09-12T12:26:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff45c06d560 0x7ff45c14d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:00.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff45c072a00 0x7ff45c14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff45c0d01c0 0x7ff45c160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c06c780 con 0x7ff45c072a00 2024-09-12T12:26:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c06c600 con 0x7ff45c06d560 2024-09-12T12:26:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff45b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c15e8e0 con 0x7ff45c0d01c0 2024-09-12T12:26:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.166+0000 7ff459400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff45c072a00 0x7ff45c14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff459400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff45c072a00 0x7ff45c14da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43122/0 (socket says 172.21.15.144:43122) 2024-09-12T12:26:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff459400640 1 -- 172.21.15.144:0/2035220795 learned_addr learned my addr 172.21.15.144:0/2035220795 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff459e00640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff45c06d560 0x7ff45c14d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:00.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff45a800640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff45c0d01c0 0x7ff45c160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:00.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff459400640 1 -- 172.21.15.144:0/2035220795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff45c0d01c0 msgr2=0x7ff45c160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:00.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff459400640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff45c0d01c0 0x7ff45c160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:00.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff459400640 1 -- 172.21.15.144:0/2035220795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff45c06d560 msgr2=0x7ff45c14d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff459400640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff45c06d560 0x7ff45c14d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff459400640 1 -- 172.21.15.144:0/2035220795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c15f6c0 con 0x7ff45c072a00 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff45a800640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff45c0d01c0 0x7ff45c160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff459400640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff45c072a00 0x7ff45c14da60 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c4d0 tx=0x7ff44800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff452000640 1 -- 172.21.15.144:0/2035220795 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448017070 con 0x7ff45c072a00 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff452000640 1 -- 172.21.15.144:0/2035220795 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff448005cf0 con 0x7ff45c072a00 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff452000640 1 -- 172.21.15.144:0/2035220795 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448007270 con 0x7ff45c072a00 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c15f9a0 con 0x7ff45c072a00 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c15ff60 con 0x7ff45c072a00 2024-09-12T12:26:00.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45c0d05a0 con 0x7ff45c072a00 2024-09-12T12:26:00.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.170+0000 7ff452000640 1 -- 172.21.15.144:0/2035220795 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff44801a070 con 0x7ff45c072a00 2024-09-12T12:26:00.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.174+0000 7ff452000640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c0678c0 0x7ff43c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:00.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.174+0000 7ff452000640 1 -- 172.21.15.144:0/2035220795 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5619+0+0 (secure 0 0 0) 0x7ff448084fe0 con 0x7ff45c072a00 2024-09-12T12:26:00.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.174+0000 7ff459e00640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c0678c0 0x7ff43c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:00.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.174+0000 7ff459e00640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c0678c0 0x7ff43c069d80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0af000 tx=0x7ff44c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:00.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.178+0000 7ff452000640 1 -- 172.21.15.144:0/2035220795 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff4480554e0 con 0x7ff45c072a00 2024-09-12T12:26:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.334+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff45c06d340 con 0x7ff45c072a00 2024-09-12T12:26:00.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.990+0000 7ff452000640 1 -- 172.21.15.144:0/2035220795 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v200) ==== 170+0+0 (secure 0 0 0) 0x7ff4480597e0 con 0x7ff45c072a00 2024-09-12T12:26:00.992 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-12T12:26:00.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c0678c0 msgr2=0x7ff43c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:00.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c0678c0 0x7ff43c069d80 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0af000 tx=0x7ff44c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:26:00.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff45c072a00 msgr2=0x7ff45c14da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:00.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff45c072a00 0x7ff45c14da60 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c4d0 tx=0x7ff44800c990 comp rx=0 tx=0).stop 2024-09-12T12:26:00.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 shutdown_connections 2024-09-12T12:26:00.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff43c0678c0 0x7ff43c069d80 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:00.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff45c0d01c0 0x7ff45c160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:00.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff45c072a00 0x7ff45c14da60 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:00.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 --2- 172.21.15.144:0/2035220795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff45c06d560 0x7ff45c14d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:00.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 >> 172.21.15.144:0/2035220795 conn(0x7ff45c0b60d0 msgr2=0x7ff45c075140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:00.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 shutdown_connections 2024-09-12T12:26:00.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:00.994+0000 7ff45b200640 1 -- 172.21.15.144:0/2035220795 wait complete. 2024-09-12T12:26:01.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:26:01.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.170+0000 7fd082200640 1 Processor -- start 2024-09-12T12:26:01.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.170+0000 7fd082200640 1 -- start start 2024-09-12T12:26:01.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.170+0000 7fd082200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd07c15af60 0x7fd07c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.170+0000 7fd082200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd07c06c320 0x7fd07c0b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.170+0000 7fd082200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c0b4300 con 0x7fd07c0cd9f0 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.170+0000 7fd082200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd07c0b32f0 con 0x7fd07c15af60 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.170+0000 7fd082200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd07c0b3540 con 0x7fd07c06c320 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.170+0000 7fd07b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd07c15af60 0x7fd07c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd07c15af60 0x7fd07c0ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43126/0 (socket says 172.21.15.144:43126) 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07b400640 1 -- 172.21.15.144:0/2682719234 learned_addr learned my addr 172.21.15.144:0/2682719234 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd07c0cd9f0 0x7fd07c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58420/0 (socket says 172.21.15.144:58420) 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07be00640 1 --2- 172.21.15.144:0/2682719234 >> v2:172.21.15.165:3300/0 conn(0x7fd07c06c320 0x7fd07c0b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07b400640 1 -- 172.21.15.144:0/2682719234 >> v2:172.21.15.165:3300/0 conn(0x7fd07c06c320 msgr2=0x7fd07c0b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07b400640 1 --2- 172.21.15.144:0/2682719234 >> v2:172.21.15.165:3300/0 conn(0x7fd07c06c320 0x7fd07c0b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07b400640 1 -- 172.21.15.144:0/2682719234 >> v1:172.21.15.144:6789/0 conn(0x7fd07c0cd9f0 legacy=0x7fd07c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07b400640 1 -- 172.21.15.144:0/2682719234 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c0b3820 con 0x7fd07c15af60 2024-09-12T12:26:01.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07b400640 1 --2- 172.21.15.144:0/2682719234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c15af60 0x7fd07c0ce680 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fd07c06f190 tx=0x7fd06c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698ec0118f8e2e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:01.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07a000640 1 -- 172.21.15.144:0/2682719234 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c0a57a0 con 0x7fd07c15af60 2024-09-12T12:26:01.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07a000640 1 -- 172.21.15.144:0/2682719234 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06c0a5940 con 0x7fd07c15af60 2024-09-12T12:26:01.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.174+0000 7fd07a000640 1 -- 172.21.15.144:0/2682719234 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c0a5d10 con 0x7fd07c15af60 2024-09-12T12:26:01.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 -- 172.21.15.144:0/2682719234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c15af60 msgr2=0x7fd07c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 --2- 172.21.15.144:0/2682719234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c15af60 0x7fd07c0ce680 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fd07c06f190 tx=0x7fd06c01c9f0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 -- 172.21.15.144:0/2682719234 shutdown_connections 2024-09-12T12:26:01.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 --2- 172.21.15.144:0/2682719234 >> v2:172.21.15.165:3300/0 conn(0x7fd07c06c320 0x7fd07c0b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 --2- 172.21.15.144:0/2682719234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c15af60 0x7fd07c0ce680 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 -- 172.21.15.144:0/2682719234 >> 172.21.15.144:0/2682719234 conn(0x7fd07c068030 msgr2=0x7fd07c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:01.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 -- 172.21.15.144:0/2682719234 shutdown_connections 2024-09-12T12:26:01.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 -- 172.21.15.144:0/2682719234 wait complete. 2024-09-12T12:26:01.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 Processor -- start 2024-09-12T12:26:01.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 -- start start 2024-09-12T12:26:01.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd07c06c320 0x7fd07c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c0cd9f0 0x7fd07c144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd07c15af60 0x7fd07c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c0b5430 con 0x7fd07c0cd9f0 2024-09-12T12:26:01.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c0b52b0 con 0x7fd07c06c320 2024-09-12T12:26:01.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd082200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd07c0b55b0 con 0x7fd07c15af60 2024-09-12T12:26:01.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c0cd9f0 0x7fd07c144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd07c06c320 0x7fd07c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c0cd9f0 0x7fd07c144ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43128/0 (socket says 172.21.15.144:43128) 2024-09-12T12:26:01.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07aa00640 1 -- 172.21.15.144:0/2454491027 learned_addr learned my addr 172.21.15.144:0/2454491027 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:01.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07be00640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd07c15af60 0x7fd07c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07b400640 1 -- 172.21.15.144:0/2454491027 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd07c15af60 msgr2=0x7fd07c0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07b400640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd07c15af60 0x7fd07c0aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07b400640 1 -- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c0cd9f0 msgr2=0x7fd07c144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:01.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07b400640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c0cd9f0 0x7fd07c144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:01.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07b400640 1 -- 172.21.15.144:0/2454491027 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c146570 con 0x7fd07c06c320 2024-09-12T12:26:01.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.178+0000 7fd07aa00640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c0cd9f0 0x7fd07c144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:01.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd07b400640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd07c06c320 0x7fd07c15a370 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0ab000 tx=0x7fd06c019790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:01.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd073400640 1 -- 172.21.15.144:0/2454491027 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c0b8670 con 0x7fd07c06c320 2024-09-12T12:26:01.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd073400640 1 -- 172.21.15.144:0/2454491027 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06c0be070 con 0x7fd07c06c320 2024-09-12T12:26:01.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07c145c00 con 0x7fd07c06c320 2024-09-12T12:26:01.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd073400640 1 -- 172.21.15.144:0/2454491027 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c0b8a50 con 0x7fd07c06c320 2024-09-12T12:26:01.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07c145ee0 con 0x7fd07c06c320 2024-09-12T12:26:01.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07c0afc20 con 0x7fd07c06c320 2024-09-12T12:26:01.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd073400640 1 -- 172.21.15.144:0/2454491027 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd06c0b8bf0 con 0x7fd07c06c320 2024-09-12T12:26:01.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd073400640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd05c0678c0 0x7fd05c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:01.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd073400640 1 -- 172.21.15.144:0/2454491027 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 6001+0+0 (secure 0 0 0) 0x7fd06c121880 con 0x7fd07c06c320 2024-09-12T12:26:01.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.182+0000 7fd07aa00640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd05c0678c0 0x7fd05c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:01.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.186+0000 7fd07aa00640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd05c0678c0 0x7fd05c069d80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd07c1fada0 tx=0x7fd068007f20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:01.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.186+0000 7fd073400640 1 -- 172.21.15.144:0/2454491027 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd06c0165e0 con 0x7fd07c06c320 2024-09-12T12:26:01.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:01.378+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd07c0b0120 con 0x7fd07c06c320 2024-09-12T12:26:02.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.026+0000 7fd073400640 1 -- 172.21.15.144:0/2454491027 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 29 and data pool 30 v153) ==== 174+0+0 (secure 0 0 0) 0x7fd06c0f1d40 con 0x7fd07c06c320 2024-09-12T12:26:02.029 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 29 and data pool 30 2024-09-12T12:26:02.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd05c0678c0 msgr2=0x7fd05c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd05c0678c0 0x7fd05c069d80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd07c1fada0 tx=0x7fd068007f20 comp rx=0 tx=0).stop 2024-09-12T12:26:02.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd07c06c320 msgr2=0x7fd07c15a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd07c06c320 0x7fd07c15a370 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0ab000 tx=0x7fd06c019790 comp rx=0 tx=0).stop 2024-09-12T12:26:02.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 shutdown_connections 2024-09-12T12:26:02.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fd05c0678c0 0x7fd05c069d80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd07c15af60 0x7fd07c0aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd07c0cd9f0 0x7fd07c144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 --2- 172.21.15.144:0/2454491027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd07c06c320 0x7fd07c15a370 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 >> 172.21.15.144:0/2454491027 conn(0x7fd07c068030 msgr2=0x7fd07c1506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:02.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 shutdown_connections 2024-09-12T12:26:02.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.030+0000 7fd082200640 1 -- 172.21.15.144:0/2454491027 wait complete. 2024-09-12T12:26:02.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:26:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.190+0000 7fa3dcc00640 1 Processor -- start 2024-09-12T12:26:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.190+0000 7fa3dcc00640 1 -- start start 2024-09-12T12:26:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3dcc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815cd30 0x7fa3d80b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3dcc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa3d80b5de0 0x7fa3d8072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3dcc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d80cd870 con 0x7fa3d815c7b0 2024-09-12T12:26:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3dcc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d8072a50 con 0x7fa3d80b5de0 2024-09-12T12:26:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3dcc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d80cde30 con 0x7fa3d815cd30 2024-09-12T12:26:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa3d80b5de0 0x7fa3d8072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa3d80b5de0 0x7fa3d8072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43144/0 (socket says 172.21.15.144:43144) 2024-09-12T12:26:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d6800640 1 -- 172.21.15.144:0/4004306313 learned_addr learned my addr 172.21.15.144:0/4004306313 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d5e00640 1 --1- 172.21.15.144:0/4004306313 >> v1:172.21.15.144:6789/0 conn(0x7fa3d815c7b0 0x7fa3d80ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58422/0 (socket says 172.21.15.144:58422) 2024-09-12T12:26:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d5400640 1 --2- 172.21.15.144:0/4004306313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815cd30 0x7fa3d80b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d6800640 1 -- 172.21.15.144:0/4004306313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815cd30 msgr2=0x7fa3d80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d6800640 1 --2- 172.21.15.144:0/4004306313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815cd30 0x7fa3d80b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d6800640 1 -- 172.21.15.144:0/4004306313 >> v1:172.21.15.144:6789/0 conn(0x7fa3d815c7b0 legacy=0x7fa3d80ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d6800640 1 -- 172.21.15.144:0/4004306313 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d80cdb50 con 0x7fa3d80b5de0 2024-09-12T12:26:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d4a00640 1 -- 172.21.15.144:0/4004306313 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2368158462 0 0) 0x7fa3d80cd870 con 0x7fa3d815c7b0 2024-09-12T12:26:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.194+0000 7fa3d5400640 1 --2- 172.21.15.144:0/4004306313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815cd30 0x7fa3d80b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:02.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3d6800640 1 --2- 172.21.15.144:0/4004306313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 0x7fa3d8072ee0 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009870 tx=0x7fa3d001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b8a2f798c46b02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:02.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3d4a00640 1 -- 172.21.15.144:0/4004306313 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00b2070 con 0x7fa3d80b5de0 2024-09-12T12:26:02.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3d4a00640 1 -- 172.21.15.144:0/4004306313 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d00a9070 con 0x7fa3d80b5de0 2024-09-12T12:26:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3d4a00640 1 -- 172.21.15.144:0/4004306313 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00ad880 con 0x7fa3d80b5de0 2024-09-12T12:26:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 -- 172.21.15.144:0/4004306313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 msgr2=0x7fa3d8072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 --2- 172.21.15.144:0/4004306313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 0x7fa3d8072ee0 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009870 tx=0x7fa3d001c560 comp rx=0 tx=0).stop 2024-09-12T12:26:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 -- 172.21.15.144:0/4004306313 shutdown_connections 2024-09-12T12:26:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 --2- 172.21.15.144:0/4004306313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 0x7fa3d8072ee0 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 --2- 172.21.15.144:0/4004306313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815cd30 0x7fa3d80b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 -- 172.21.15.144:0/4004306313 >> 172.21.15.144:0/4004306313 conn(0x7fa3d806d0d0 msgr2=0x7fa3d806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 -- 172.21.15.144:0/4004306313 shutdown_connections 2024-09-12T12:26:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 -- 172.21.15.144:0/4004306313 wait complete. 2024-09-12T12:26:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 Processor -- start 2024-09-12T12:26:02.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.198+0000 7fa3dcc00640 1 -- start start 2024-09-12T12:26:02.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3dcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 0x7fa3d814d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3dcc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815c7b0 0x7fa3d814d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3dcc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3d815cd30 0x7fa3d81f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3dcc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8073fc0 con 0x7fa3d80b5de0 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3dcc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8073e40 con 0x7fa3d815cd30 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3dcc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d8074140 con 0x7fa3d815c7b0 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3d5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 0x7fa3d814d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3d5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 0x7fa3d814d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43146/0 (socket says 172.21.15.144:43146) 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3d5e00640 1 -- 172.21.15.144:0/3677104933 learned_addr learned my addr 172.21.15.144:0/3677104933 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3d5e00640 1 -- 172.21.15.144:0/3677104933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815c7b0 msgr2=0x7fa3d814d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3d5e00640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815c7b0 0x7fa3d814d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3d5e00640 1 -- 172.21.15.144:0/3677104933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3d815cd30 msgr2=0x7fa3d81f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3d5e00640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3d815cd30 0x7fa3d81f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3d5e00640 1 -- 172.21.15.144:0/3677104933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d814ea90 con 0x7fa3d80b5de0 2024-09-12T12:26:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3d5e00640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 0x7fa3d814d460 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c890 tx=0x7fa3c800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:02.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3ce000640 1 -- 172.21.15.144:0/3677104933 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8018070 con 0x7fa3d80b5de0 2024-09-12T12:26:02.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3ce000640 1 -- 172.21.15.144:0/3677104933 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c800a640 con 0x7fa3d80b5de0 2024-09-12T12:26:02.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d814ed70 con 0x7fa3d80b5de0 2024-09-12T12:26:02.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3ce000640 1 -- 172.21.15.144:0/3677104933 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800aa30 con 0x7fa3d80b5de0 2024-09-12T12:26:02.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d814f330 con 0x7fa3d80b5de0 2024-09-12T12:26:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d8072ec0 con 0x7fa3d80b5de0 2024-09-12T12:26:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.202+0000 7fa3ce000640 1 -- 172.21.15.144:0/3677104933 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3c801b070 con 0x7fa3d80b5de0 2024-09-12T12:26:02.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.206+0000 7fa3ce000640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3b80678c0 0x7fa3b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.206+0000 7fa3ce000640 1 -- 172.21.15.144:0/3677104933 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7fa3c80855c0 con 0x7fa3d80b5de0 2024-09-12T12:26:02.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.206+0000 7fa3d5400640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3b80678c0 0x7fa3b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.206+0000 7fa3d5400640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3b80678c0 0x7fa3b8069d80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4006f10 tx=0x7fa3c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:02.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.210+0000 7fa3ce000640 1 -- 172.21.15.144:0/3677104933 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa3c8055ed0 con 0x7fa3d80b5de0 2024-09-12T12:26:02.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.366+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3d8160cf0 con 0x7fa3d80b5de0 2024-09-12T12:26:02.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3ce000640 1 -- 172.21.15.144:0/3677104933 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) ==== 74+0+16981 (secure 0 0 0) 0x7fa3c80557d0 con 0x7fa3d80b5de0 2024-09-12T12:26:02.371 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:02.371 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":201,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:26:01.385673+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:59.097807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-12T12:26:00.385383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:02.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3b80678c0 msgr2=0x7fa3b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3b80678c0 0x7fa3b8069d80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4006f10 tx=0x7fa3c4008040 comp rx=0 tx=0).stop 2024-09-12T12:26:02.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 msgr2=0x7fa3d814d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 0x7fa3d814d460 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c890 tx=0x7fa3c800cd50 comp rx=0 tx=0).stop 2024-09-12T12:26:02.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 shutdown_connections 2024-09-12T12:26:02.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa3b80678c0 0x7fa3b8069d80 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3d815cd30 0x7fa3d81f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3d815c7b0 0x7fa3d814d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 --2- 172.21.15.144:0/3677104933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3d80b5de0 0x7fa3d814d460 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 >> 172.21.15.144:0/3677104933 conn(0x7fa3d806d0d0 msgr2=0x7fa3d81521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:02.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 shutdown_connections 2024-09-12T12:26:02.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.370+0000 7fa3dcc00640 1 -- 172.21.15.144:0/3677104933 wait complete. 2024-09-12T12:26:02.392 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:26:02.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.526+0000 7f8195400640 1 Processor -- start 2024-09-12T12:26:02.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.526+0000 7f8195400640 1 -- start start 2024-09-12T12:26:02.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.526+0000 7f8195400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f819015b4e0 0x7f81900b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.526+0000 7f8195400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81900b45a0 con 0x7f81900b3ad0 2024-09-12T12:26:02.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.526+0000 7f8195400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81900b3fe0 con 0x7f81900ccf30 2024-09-12T12:26:02.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.526+0000 7f8195400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f81900b42c0 con 0x7f819015b4e0 2024-09-12T12:26:02.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818de00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f81900b3ad0 0x7f8190071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58438/0 (socket says 172.21.15.144:58438) 2024-09-12T12:26:02.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818de00640 1 -- 172.21.15.144:0/2523997908 learned_addr learned my addr 172.21.15.144:0/2523997908 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:02.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818e800640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f819015b4e0 0x7f81900b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566141175 0 0) 0x7f81900b45a0 con 0x7f81900b3ad0 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8174003530 con 0x7f81900b3ad0 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 490261394 0 0) 0x7f81900b3fe0 con 0x7f81900ccf30 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81900b45a0 con 0x7f81900ccf30 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4080897672 0 0) 0x7f8174003530 con 0x7f81900b3ad0 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f819015b4e0 msgr2=0x7f81900b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f819015b4e0 0x7f81900b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 >> v1:172.21.15.165:6789/0 conn(0x7f81900ccf30 legacy=0x7f81900b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81900b1490 con 0x7f81900b3ad0 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f817c001680 con 0x7f81900b3ad0 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 >> v1:172.21.15.144:6789/0 conn(0x7f81900b3ad0 legacy=0x7f8190071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8174003b80 0x7f8174003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8174004810 0x7f8174004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f819015b4e0 0x7f81740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81900b42c0 con 0x7f8174004810 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f817400ba80 con 0x7f8174003b80 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f817400bc50 con 0x7f819015b4e0 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818de00640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8174004810 0x7f8174004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818e800640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8174003b80 0x7f8174003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818f200640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f819015b4e0 0x7f81740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818de00640 1 -- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f819015b4e0 msgr2=0x7f81740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818de00640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f819015b4e0 0x7f81740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818de00640 1 -- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8174003b80 msgr2=0x7f8174003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818de00640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8174003b80 0x7f8174003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818de00640 1 -- 172.21.15.144:0/2523997908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8174003530 con 0x7f8174004810 2024-09-12T12:26:02.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.530+0000 7f818e800640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8174003b80 0x7f8174003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:02.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f818de00640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8174004810 0x7f8174004c90 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f81900b02b0 tx=0x7f817c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e570ea499a8b133b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:02.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c007cb0 con 0x7f8174004810 2024-09-12T12:26:02.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c0a9020 con 0x7f8174004810 2024-09-12T12:26:02.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f818d400640 1 -- 172.21.15.144:0/2523997908 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c005ae0 con 0x7f8174004810 2024-09-12T12:26:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f8195400640 1 -- 172.21.15.144:0/2523997908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8174004810 msgr2=0x7f8174004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f8195400640 1 --2- 172.21.15.144:0/2523997908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8174004810 0x7f8174004c90 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f81900b02b0 tx=0x7f817c01cb60 comp rx=0 tx=0).stop 2024-09-12T12:26:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f818f200640 1 -- 172.21.15.144:0/2523997908 reap_dead start 2024-09-12T12:26:02.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f8195400640 1 -- 172.21.15.144:0/2523997908 shutdown_connections 2024-09-12T12:26:02.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f8195400640 1 -- 172.21.15.144:0/2523997908 >> 172.21.15.144:0/2523997908 conn(0x7f819006d0d0 msgr2=0x7f819006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:02.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f8195400640 1 -- 172.21.15.144:0/2523997908 shutdown_connections 2024-09-12T12:26:02.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f8195400640 1 -- 172.21.15.144:0/2523997908 wait complete. 2024-09-12T12:26:02.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f8195400640 1 Processor -- start 2024-09-12T12:26:02.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.534+0000 7f8195400640 1 -- start start 2024-09-12T12:26:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8195400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8174004810 0x7f8190148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8195400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81901444c0 0x7f81901436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8195400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8190144940 0x7f8190143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8195400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81900cdef0 con 0x7f81901444c0 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8195400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8190071b30 con 0x7f8190144940 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8195400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f819015b8c0 con 0x7f8174004810 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81901444c0 0x7f81901436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81901444c0 0x7f81901436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43164/0 (socket says 172.21.15.144:43164) 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818de00640 1 -- 172.21.15.144:0/487723316 learned_addr learned my addr 172.21.15.144:0/487723316 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818f200640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8190144940 0x7f8190143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818e800640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8174004810 0x7f8190148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818de00640 1 -- 172.21.15.144:0/487723316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8174004810 msgr2=0x7f8190148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818de00640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8174004810 0x7f8190148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818de00640 1 -- 172.21.15.144:0/487723316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8190144940 msgr2=0x7f8190143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818de00640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8190144940 0x7f8190143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818de00640 1 -- 172.21.15.144:0/487723316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8190146050 con 0x7f81901444c0 2024-09-12T12:26:02.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f818de00640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81901444c0 0x7f81901436e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f817c001900 tx=0x7f8174005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:02.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8186a00640 1 -- 172.21.15.144:0/487723316 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c0049f0 con 0x7f81901444c0 2024-09-12T12:26:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8186a00640 1 -- 172.21.15.144:0/487723316 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f817c004b90 con 0x7f81901444c0 2024-09-12T12:26:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8186a00640 1 -- 172.21.15.144:0/487723316 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817c007c90 con 0x7f81901444c0 2024-09-12T12:26:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81900d02a0 con 0x7f81901444c0 2024-09-12T12:26:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81901465d0 con 0x7f81901444c0 2024-09-12T12:26:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81900b3590 con 0x7f81901444c0 2024-09-12T12:26:02.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.538+0000 7f8186a00640 1 -- 172.21.15.144:0/487723316 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f817c007070 con 0x7f81901444c0 2024-09-12T12:26:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.542+0000 7f8186a00640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81700678c0 0x7f8170069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.542+0000 7f8186a00640 1 -- 172.21.15.144:0/487723316 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7f817c1200a0 con 0x7f81901444c0 2024-09-12T12:26:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.542+0000 7f818e800640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81700678c0 0x7f8170069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.542+0000 7f818e800640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81700678c0 0x7f8170069d80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8180009b60 tx=0x7f8180008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:02.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.546+0000 7f8186a00640 1 -- 172.21.15.144:0/487723316 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f817c016870 con 0x7f81901444c0 2024-09-12T12:26:02.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.702+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8190071d50 con 0x7f81901444c0 2024-09-12T12:26:02.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.702+0000 7f8186a00640 1 -- 172.21.15.144:0/487723316 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) ==== 74+0+16981 (secure 0 0 0) 0x7f817c0f0a40 con 0x7f81901444c0 2024-09-12T12:26:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:02.706 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":201,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:26:01.385673+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:59.097807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-12T12:26:00.385383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81700678c0 msgr2=0x7f8170069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81700678c0 0x7f8170069d80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f8180009b60 tx=0x7f8180008040 comp rx=0 tx=0).stop 2024-09-12T12:26:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81901444c0 msgr2=0x7f81901436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81901444c0 0x7f81901436e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f817c001900 tx=0x7f8174005840 comp rx=0 tx=0).stop 2024-09-12T12:26:02.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 shutdown_connections 2024-09-12T12:26:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f81700678c0 0x7f8170069d80 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8190144940 0x7f8190143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81901444c0 0x7f81901436e0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 --2- 172.21.15.144:0/487723316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8174004810 0x7f8190148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 >> 172.21.15.144:0/487723316 conn(0x7f819006d0d0 msgr2=0x7f81900b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 shutdown_connections 2024-09-12T12:26:02.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.706+0000 7f8195400640 1 -- 172.21.15.144:0/487723316 wait complete. 2024-09-12T12:26:02.728 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:26:02.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43fe00640 1 Processor -- start 2024-09-12T12:26:02.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43fe00640 1 -- start start 2024-09-12T12:26:02.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4380b32f0 0x7ff43815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4380ccdc0 0x7ff4380cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43815bf00 con 0x7ff43806d0f0 2024-09-12T12:26:02.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff4380b38b0 con 0x7ff4380b32f0 2024-09-12T12:26:02.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff4380b3b90 con 0x7ff4380ccdc0 2024-09-12T12:26:02.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4380b32f0 0x7ff43815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4380b32f0 0x7ff43815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43176/0 (socket says 172.21.15.144:43176) 2024-09-12T12:26:02.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43ca00640 1 -- 172.21.15.144:0/71869093 learned_addr learned my addr 172.21.15.144:0/71869093 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:02.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43de00640 1 --2- 172.21.15.144:0/71869093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4380ccdc0 0x7ff4380cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43ca00640 1 -- 172.21.15.144:0/71869093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4380ccdc0 msgr2=0x7ff4380cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:02.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43ca00640 1 --2- 172.21.15.144:0/71869093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4380ccdc0 0x7ff4380cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43ca00640 1 -- 172.21.15.144:0/71869093 >> v1:172.21.15.144:6789/0 conn(0x7ff43806d0f0 legacy=0x7ff43806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43ca00640 1 -- 172.21.15.144:0/71869093 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4380b3e70 con 0x7ff4380b32f0 2024-09-12T12:26:02.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff437e00640 1 -- 172.21.15.144:0/71869093 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321107055 0 0) 0x7ff43815bf00 con 0x7ff43806d0f0 2024-09-12T12:26:02.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.866+0000 7ff43de00640 1 --2- 172.21.15.144:0/71869093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4380ccdc0 0x7ff4380cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:02.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43ca00640 1 --2- 172.21.15.144:0/71869093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 0x7ff43815b9c0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7ff424009870 tx=0x7ff42401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f2649ec9913ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:02.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff437e00640 1 -- 172.21.15.144:0/71869093 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4240b1070 con 0x7ff4380b32f0 2024-09-12T12:26:02.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff437e00640 1 -- 172.21.15.144:0/71869093 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4240a8050 con 0x7ff4380b32f0 2024-09-12T12:26:02.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff437e00640 1 -- 172.21.15.144:0/71869093 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4240ac860 con 0x7ff4380b32f0 2024-09-12T12:26:02.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43fe00640 1 -- 172.21.15.144:0/71869093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 msgr2=0x7ff43815b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43fe00640 1 --2- 172.21.15.144:0/71869093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 0x7ff43815b9c0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7ff424009870 tx=0x7ff42401c4d0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43fe00640 1 -- 172.21.15.144:0/71869093 shutdown_connections 2024-09-12T12:26:02.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43fe00640 1 --2- 172.21.15.144:0/71869093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4380ccdc0 0x7ff4380cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43fe00640 1 --2- 172.21.15.144:0/71869093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 0x7ff43815b9c0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43fe00640 1 -- 172.21.15.144:0/71869093 >> 172.21.15.144:0/71869093 conn(0x7ff438068030 msgr2=0x7ff4380b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:02.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43fe00640 1 -- 172.21.15.144:0/71869093 shutdown_connections 2024-09-12T12:26:02.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43fe00640 1 -- 172.21.15.144:0/71869093 wait complete. 2024-09-12T12:26:02.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.870+0000 7ff43fe00640 1 Processor -- start 2024-09-12T12:26:02.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 -- start start 2024-09-12T12:26:02.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff43806d0f0 0x7ff438158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 0x7ff438150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4380ccdc0 0x7ff4380b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff438167960 con 0x7ff4380b32f0 2024-09-12T12:26:02.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4381677e0 con 0x7ff4380ccdc0 2024-09-12T12:26:02.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff438167ae0 con 0x7ff43806d0f0 2024-09-12T12:26:02.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 0x7ff438150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 0x7ff438150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43180/0 (socket says 172.21.15.144:43180) 2024-09-12T12:26:02.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43ca00640 1 -- 172.21.15.144:0/894479530 learned_addr learned my addr 172.21.15.144:0/894479530 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:02.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43d400640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff43806d0f0 0x7ff438158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43de00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4380ccdc0 0x7ff4380b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43ca00640 1 -- 172.21.15.144:0/894479530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff43806d0f0 msgr2=0x7ff438158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43ca00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff43806d0f0 0x7ff438158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43ca00640 1 -- 172.21.15.144:0/894479530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4380ccdc0 msgr2=0x7ff4380b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:02.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43ca00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4380ccdc0 0x7ff4380b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:02.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43ca00640 1 -- 172.21.15.144:0/894479530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff438071320 con 0x7ff4380b32f0 2024-09-12T12:26:02.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43de00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4380ccdc0 0x7ff4380b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:02.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43ca00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 0x7ff438150090 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7ff42401a100 tx=0x7ff42401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:02.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff435600640 1 -- 172.21.15.144:0/894479530 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4240be070 con 0x7ff4380b32f0 2024-09-12T12:26:02.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff435600640 1 -- 172.21.15.144:0/894479530 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff424004030 con 0x7ff4380b32f0 2024-09-12T12:26:02.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff435600640 1 -- 172.21.15.144:0/894479530 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4240b1040 con 0x7ff4380b32f0 2024-09-12T12:26:02.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff438071600 con 0x7ff4380b32f0 2024-09-12T12:26:02.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff438071bc0 con 0x7ff4380b32f0 2024-09-12T12:26:02.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.874+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4380cd1d0 con 0x7ff4380b32f0 2024-09-12T12:26:02.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.878+0000 7ff435600640 1 -- 172.21.15.144:0/894479530 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4240b4070 con 0x7ff4380b32f0 2024-09-12T12:26:02.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.878+0000 7ff435600640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4180678c0 0x7ff418069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:02.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.878+0000 7ff435600640 1 -- 172.21.15.144:0/894479530 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 6101+0+0 (secure 0 0 0) 0x7ff42411f610 con 0x7ff4380b32f0 2024-09-12T12:26:02.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.878+0000 7ff43d400640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4180678c0 0x7ff418069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:02.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.878+0000 7ff43d400640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4180678c0 0x7ff418069d80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff42c007fd0 tx=0x7ff42c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:02.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:02.882+0000 7ff435600640 1 -- 172.21.15.144:0/894479530 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff424016150 con 0x7ff4380b32f0 2024-09-12T12:26:03.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:03.078+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff43815c2b0 con 0x7ff4380b32f0 2024-09-12T12:26:03.986 INFO:tasks.ceph.mds.b.smithi165.stderr:2024-09-12T12:26:03.989+0000 7f4682000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:26:04.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.038+0000 7ff435600640 1 -- 172.21.15.144:0/894479530 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v156) ==== 118+0+0 (secure 0 0 0) 0x7ff4240ef8d0 con 0x7ff4380b32f0 2024-09-12T12:26:04.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4180678c0 msgr2=0x7ff418069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:04.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4180678c0 0x7ff418069d80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff42c007fd0 tx=0x7ff42c009040 comp rx=0 tx=0).stop 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 msgr2=0x7ff438150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 0x7ff438150090 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7ff42401a100 tx=0x7ff42401ad10 comp rx=0 tx=0).stop 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 shutdown_connections 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff4180678c0 0x7ff418069d80 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4380ccdc0 0x7ff4380b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4380b32f0 0x7ff438150090 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 --2- 172.21.15.144:0/894479530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff43806d0f0 0x7ff438158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 >> 172.21.15.144:0/894479530 conn(0x7ff438068030 msgr2=0x7ff43815ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 shutdown_connections 2024-09-12T12:26:04.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.042+0000 7ff43fe00640 1 -- 172.21.15.144:0/894479530 wait complete. 2024-09-12T12:26:04.067 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T12:26:04.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T12:26:04.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.206+0000 7f6b6ca00640 1 Processor -- start 2024-09-12T12:26:04.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.206+0000 7f6b6ca00640 1 -- start start 2024-09-12T12:26:04.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b6ca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6b68159ec0 0x7f6b680b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:04.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b6ca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b68073680 con 0x7f6b680b2350 2024-09-12T12:26:04.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b6ca00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b68072de0 con 0x7f6b680726c0 2024-09-12T12:26:04.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b6ca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6b680b27b0 con 0x7f6b68159ec0 2024-09-12T12:26:04.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b65e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6b680b2350 0x7f6b68071fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58444/0 (socket says 172.21.15.144:58444) 2024-09-12T12:26:04.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b65e00640 1 -- 172.21.15.144:0/3394520282 learned_addr learned my addr 172.21.15.144:0/3394520282 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:04.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b66800640 1 --2- 172.21.15.144:0/3394520282 >> v2:172.21.15.165:3300/0 conn(0x7f6b68159ec0 0x7f6b680b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:04.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b65400640 1 -- 172.21.15.144:0/3394520282 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215736499 0 0) 0x7f6b68073680 con 0x7f6b680b2350 2024-09-12T12:26:04.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b65400640 1 -- 172.21.15.144:0/3394520282 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b4c003530 con 0x7f6b680b2350 2024-09-12T12:26:04.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b66800640 1 -- 172.21.15.144:0/3394520282 >> v1:172.21.15.165:6789/0 conn(0x7f6b680726c0 legacy=0x7f6b6815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:04.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b65400640 1 -- 172.21.15.144:0/3394520282 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1341067562 0 0) 0x7f6b4c003530 con 0x7f6b680b2350 2024-09-12T12:26:04.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b66800640 1 -- 172.21.15.144:0/3394520282 >> v1:172.21.15.144:6789/0 conn(0x7f6b680b2350 legacy=0x7f6b68071fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:04.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.210+0000 7f6b66800640 1 -- 172.21.15.144:0/3394520282 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680730c0 con 0x7f6b68159ec0 2024-09-12T12:26:04.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b66800640 1 --2- 172.21.15.144:0/3394520282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b68159ec0 0x7f6b680b1e10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009d90 tx=0x7f6b5801c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3516bde6fbc0d387 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:04.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b65400640 1 -- 172.21.15.144:0/3394520282 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b580b2070 con 0x7f6b68159ec0 2024-09-12T12:26:04.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b65400640 1 -- 172.21.15.144:0/3394520282 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b580a56a0 con 0x7f6b68159ec0 2024-09-12T12:26:04.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b65400640 1 -- 172.21.15.144:0/3394520282 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b54001680 con 0x7f6b68159ec0 2024-09-12T12:26:04.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b6ca00640 1 -- 172.21.15.144:0/3394520282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b68159ec0 msgr2=0x7f6b680b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:04.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b6ca00640 1 --2- 172.21.15.144:0/3394520282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b68159ec0 0x7f6b680b1e10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009d90 tx=0x7f6b5801c860 comp rx=0 tx=0).stop 2024-09-12T12:26:04.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b6ca00640 1 -- 172.21.15.144:0/3394520282 shutdown_connections 2024-09-12T12:26:04.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b6ca00640 1 --2- 172.21.15.144:0/3394520282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b68159ec0 0x7f6b680b1e10 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:04.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b6ca00640 1 -- 172.21.15.144:0/3394520282 >> 172.21.15.144:0/3394520282 conn(0x7f6b6806e7e0 msgr2=0x7f6b6806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b6ca00640 1 -- 172.21.15.144:0/3394520282 shutdown_connections 2024-09-12T12:26:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b6ca00640 1 -- 172.21.15.144:0/3394520282 wait complete. 2024-09-12T12:26:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b6ca00640 1 Processor -- start 2024-09-12T12:26:04.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.214+0000 7f6b6ca00640 1 -- start start 2024-09-12T12:26:04.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b6ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680726c0 0x7f6b6814ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b6ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b680b2350 0x7f6b6814a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b6ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b68159ec0 0x7f6b68149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b6ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6815efa0 con 0x7f6b680726c0 2024-09-12T12:26:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b6ca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6815ee20 con 0x7f6b680b2350 2024-09-12T12:26:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b6ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6815f120 con 0x7f6b68159ec0 2024-09-12T12:26:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b66800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680726c0 0x7f6b6814ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b66800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680726c0 0x7f6b6814ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43190/0 (socket says 172.21.15.144:43190) 2024-09-12T12:26:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b66800640 1 -- 172.21.15.144:0/2863331168 learned_addr learned my addr 172.21.15.144:0/2863331168 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:04.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b66800640 1 -- 172.21.15.144:0/2863331168 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b68159ec0 msgr2=0x7f6b68149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:04.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b66800640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b68159ec0 0x7f6b68149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:04.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b66800640 1 -- 172.21.15.144:0/2863331168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b680b2350 msgr2=0x7f6b6814a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b65e00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b680b2350 0x7f6b6814a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b66800640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b680b2350 0x7f6b6814a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b66800640 1 -- 172.21.15.144:0/2863331168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680cf250 con 0x7f6b680726c0 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b65e00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b680b2350 0x7f6b6814a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b66800640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680726c0 0x7f6b6814ca30 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f6b58019470 tx=0x7f6b58019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b5ea00640 1 -- 172.21.15.144:0/2863331168 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b580bd020 con 0x7f6b680726c0 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b5ea00640 1 -- 172.21.15.144:0/2863331168 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b580b8670 con 0x7f6b680726c0 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b680cef70 con 0x7f6b680726c0 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b5ea00640 1 -- 172.21.15.144:0/2863331168 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b580b2040 con 0x7f6b680726c0 2024-09-12T12:26:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b680cd3a0 con 0x7f6b680726c0 2024-09-12T12:26:04.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b680691c0 con 0x7f6b680726c0 2024-09-12T12:26:04.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.218+0000 7f6b5ea00640 1 -- 172.21.15.144:0/2863331168 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b580c0020 con 0x7f6b680726c0 2024-09-12T12:26:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.222+0000 7f6b5ea00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b48067910 0x7f6b48069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.222+0000 7f6b5ea00640 1 -- 172.21.15.144:0/2863331168 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f6b58120ce0 con 0x7f6b680726c0 2024-09-12T12:26:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.222+0000 7f6b65e00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b48067910 0x7f6b48069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.222+0000 7f6b65e00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b48067910 0x7f6b48069dd0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6b540011f0 tx=0x7f6b54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.226+0000 7f6b5ea00640 1 -- 172.21.15.144:0/2863331168 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b580c7030 con 0x7f6b680726c0 2024-09-12T12:26:04.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:04.414+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6b680b1df0 con 0x7f6b680726c0 2024-09-12T12:26:05.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b5ea00640 1 -- 172.21.15.144:0/2863331168 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v157) ==== 122+0+0 (secure 0 0 0) 0x7f6b58016480 con 0x7f6b680726c0 2024-09-12T12:26:05.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b48067910 msgr2=0x7f6b48069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b48067910 0x7f6b48069dd0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6b540011f0 tx=0x7f6b54009040 comp rx=0 tx=0).stop 2024-09-12T12:26:05.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680726c0 msgr2=0x7f6b6814ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680726c0 0x7f6b6814ca30 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f6b58019470 tx=0x7f6b58019600 comp rx=0 tx=0).stop 2024-09-12T12:26:05.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 shutdown_connections 2024-09-12T12:26:05.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b48067910 0x7f6b48069dd0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b68159ec0 0x7f6b68149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b680b2350 0x7f6b6814a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 --2- 172.21.15.144:0/2863331168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680726c0 0x7f6b6814ca30 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 >> 172.21.15.144:0/2863331168 conn(0x7f6b6806e7e0 msgr2=0x7f6b6806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 shutdown_connections 2024-09-12T12:26:05.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.042+0000 7f6b6ca00640 1 -- 172.21.15.144:0/2863331168 wait complete. 2024-09-12T12:26:05.069 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T12:26:05.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:26:05.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.202+0000 7f1d49e00640 1 Processor -- start 2024-09-12T12:26:05.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.202+0000 7f1d49e00640 1 -- start start 2024-09-12T12:26:05.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.202+0000 7f1d49e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1d440d08c0 0x7f1d44165ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d49e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d440b6660 con 0x7f1d440b6130 2024-09-12T12:26:05.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d49e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d440b6940 con 0x7f1d4415b0f0 2024-09-12T12:26:05.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d49e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1d440b6c20 con 0x7f1d440d08c0 2024-09-12T12:26:05.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d42000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1d440b6130 0x7f1d4415f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58458/0 (socket says 172.21.15.144:58458) 2024-09-12T12:26:05.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d42000640 1 -- 172.21.15.144:0/4026214209 learned_addr learned my addr 172.21.15.144:0/4026214209 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d43400640 1 --2- 172.21.15.144:0/4026214209 >> v2:172.21.15.165:3300/0 conn(0x7f1d440d08c0 0x7f1d44165ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280043284 0 0) 0x7f1d440b6660 con 0x7f1d440b6130 2024-09-12T12:26:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d28003530 con 0x7f1d440b6130 2024-09-12T12:26:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242754881 0 0) 0x7f1d440b6940 con 0x7f1d4415b0f0 2024-09-12T12:26:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d440b6660 con 0x7f1d4415b0f0 2024-09-12T12:26:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 307679501 0 0) 0x7f1d28003530 con 0x7f1d440b6130 2024-09-12T12:26:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 >> v2:172.21.15.165:3300/0 conn(0x7f1d440d08c0 msgr2=0x7f1d44165ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 --2- 172.21.15.144:0/4026214209 >> v2:172.21.15.165:3300/0 conn(0x7f1d440d08c0 0x7f1d44165ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 >> v1:172.21.15.165:6789/0 conn(0x7f1d4415b0f0 legacy=0x7f1d4415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d440b6f00 con 0x7f1d440b6130 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f1d30001680 con 0x7f1d440b6130 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 >> v1:172.21.15.144:6789/0 conn(0x7f1d440b6130 legacy=0x7f1d4415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d28003ba0 0x7f1d28003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d28004810 0x7f1d28004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d280051d0 0x7f1d2800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440b6c20 con 0x7f1d280051d0 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2800c0a0 con 0x7f1d28003ba0 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2800c2a0 con 0x7f1d28004810 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d43400640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d280051d0 0x7f1d2800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d42000640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d28004810 0x7f1d28004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d42a00640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d28003ba0 0x7f1d28003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d43400640 1 -- 172.21.15.144:0/4026214209 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d28004810 msgr2=0x7f1d28004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:05.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d43400640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d28004810 0x7f1d28004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d43400640 1 -- 172.21.15.144:0/4026214209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d28003ba0 msgr2=0x7f1d28003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:05.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d43400640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d28003ba0 0x7f1d28003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.206+0000 7f1d43400640 1 -- 172.21.15.144:0/4026214209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d28003530 con 0x7f1d280051d0 2024-09-12T12:26:05.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d43400640 1 -- 172.21.15.144:0/4026214209 reap_dead start 2024-09-12T12:26:05.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d43400640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d280051d0 0x7f1d2800b9d0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009fc0 tx=0x7f1d3c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a251cc26c7430f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c009c10 con 0x7f1d280051d0 2024-09-12T12:26:05.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c0a5d10 con 0x7f1d280051d0 2024-09-12T12:26:05.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d41600640 1 -- 172.21.15.144:0/4026214209 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c003be0 con 0x7f1d280051d0 2024-09-12T12:26:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d49e00640 1 -- 172.21.15.144:0/4026214209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d280051d0 msgr2=0x7f1d2800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d49e00640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d280051d0 0x7f1d2800b9d0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009fc0 tx=0x7f1d3c01ccc0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d49e00640 1 -- 172.21.15.144:0/4026214209 shutdown_connections 2024-09-12T12:26:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d49e00640 1 --2- 172.21.15.144:0/4026214209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d280051d0 0x7f1d2800b9d0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d49e00640 1 -- 172.21.15.144:0/4026214209 >> 172.21.15.144:0/4026214209 conn(0x7f1d4406f8b0 msgr2=0x7f1d4406fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d49e00640 1 -- 172.21.15.144:0/4026214209 shutdown_connections 2024-09-12T12:26:05.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d49e00640 1 -- 172.21.15.144:0/4026214209 wait complete. 2024-09-12T12:26:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d49e00640 1 Processor -- start 2024-09-12T12:26:05.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.210+0000 7f1d49e00640 1 -- start start 2024-09-12T12:26:05.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d49e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d280051d0 0x7f1d44148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d49e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d440c6580 0x7f1d440c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d49e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d4415b4d0 0x7f1d4415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d49e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440cf8b0 con 0x7f1d440c6580 2024-09-12T12:26:05.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d49e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440cf340 con 0x7f1d280051d0 2024-09-12T12:26:05.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d49e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1d440cfa30 con 0x7f1d4415b4d0 2024-09-12T12:26:05.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d440c6580 0x7f1d440c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d440c6580 0x7f1d440c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43202/0 (socket says 172.21.15.144:43202) 2024-09-12T12:26:05.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42000640 1 -- 172.21.15.144:0/753444398 learned_addr learned my addr 172.21.15.144:0/753444398 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:05.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42a00640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d280051d0 0x7f1d44148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d43400640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d4415b4d0 0x7f1d4415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42000640 1 -- 172.21.15.144:0/753444398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d4415b4d0 msgr2=0x7f1d4415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42000640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d4415b4d0 0x7f1d4415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42000640 1 -- 172.21.15.144:0/753444398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d280051d0 msgr2=0x7f1d44148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42000640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d280051d0 0x7f1d44148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42000640 1 -- 172.21.15.144:0/753444398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d44149250 con 0x7f1d440c6580 2024-09-12T12:26:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d42000640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d440c6580 0x7f1d440c6a00 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f1d300017f0 tx=0x7f1d300129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d3b400640 1 -- 172.21.15.144:0/753444398 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3001c070 con 0x7f1d440c6580 2024-09-12T12:26:05.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d3b400640 1 -- 172.21.15.144:0/753444398 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d30014750 con 0x7f1d440c6580 2024-09-12T12:26:05.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d3b400640 1 -- 172.21.15.144:0/753444398 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30014b40 con 0x7f1d440c6580 2024-09-12T12:26:05.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d440c7020 con 0x7f1d440c6580 2024-09-12T12:26:05.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d441497d0 con 0x7f1d440c6580 2024-09-12T12:26:05.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d440cfdc0 con 0x7f1d440c6580 2024-09-12T12:26:05.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.214+0000 7f1d3b400640 1 -- 172.21.15.144:0/753444398 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d30014ce0 con 0x7f1d440c6580 2024-09-12T12:26:05.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.218+0000 7f1d3b400640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d240678f0 0x7f1d24069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.218+0000 7f1d3b400640 1 -- 172.21.15.144:0/753444398 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f1d30088660 con 0x7f1d440c6580 2024-09-12T12:26:05.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.218+0000 7f1d42a00640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d240678f0 0x7f1d24069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.218+0000 7f1d42a00640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d240678f0 0x7f1d24069db0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1d34007fd0 tx=0x7f1d34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.222+0000 7f1d3b400640 1 -- 172.21.15.144:0/753444398 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d300589b0 con 0x7f1d440c6580 2024-09-12T12:26:05.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d44148d70 con 0x7f1d440c6580 2024-09-12T12:26:05.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d3b400640 1 -- 172.21.15.144:0/753444398 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) ==== 95+0+5250 (secure 0 0 0) 0x7f1d3005ccb0 con 0x7f1d440c6580 2024-09-12T12:26:05.415 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:05.416 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":157,"btime":"2024-09-12T12:26:05:043642+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/480472502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":480472502},{"type":"v1","addr":"172.21.15.165:6834","nonce":480472502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2632695665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2632695665},{"type":"v1","addr":"172.21.15.144:6836","nonce":2632695665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151},{"gid":10590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2593616401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2593616401},{"type":"v1","addr":"172.21.15.144:6837","nonce":2593616401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:26:01.386066+0000","modified":"2024-09-12T12:26:04.421876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10593":{"gid":10593,"name":"b","rank":0,"incarnation":153,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2360370466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2360370466},{"type":"v1","addr":"172.21.15.165:6835","nonce":2360370466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10593,"qdb_cluster":[10593]},"id":14}]} 2024-09-12T12:26:05.416 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 157 2024-09-12T12:26:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d240678f0 msgr2=0x7f1d24069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d240678f0 0x7f1d24069db0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1d34007fd0 tx=0x7f1d34009040 comp rx=0 tx=0).stop 2024-09-12T12:26:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d440c6580 msgr2=0x7f1d440c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d440c6580 0x7f1d440c6a00 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f1d300017f0 tx=0x7f1d300129a0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 shutdown_connections 2024-09-12T12:26:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f1d240678f0 0x7f1d24069db0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d4415b4d0 0x7f1d4415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d440c6580 0x7f1d440c6a00 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 --2- 172.21.15.144:0/753444398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d280051d0 0x7f1d44148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 >> 172.21.15.144:0/753444398 conn(0x7f1d4406f8b0 msgr2=0x7f1d44072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:05.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 shutdown_connections 2024-09-12T12:26:05.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.414+0000 7f1d49e00640 1 -- 172.21.15.144:0/753444398 wait complete. 2024-09-12T12:26:05.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:26:05.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.570+0000 7f9aed400640 1 Processor -- start 2024-09-12T12:26:05.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.570+0000 7f9aed400640 1 -- start start 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9aed400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ae8071420 0x7f9ae8071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9aed400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9ae80ccf30 0x7f9ae80cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9aed400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae80cd890 con 0x7f9ae815b4e0 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9aed400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae80b45a0 con 0x7f9ae8071420 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9aed400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae80b3fe0 con 0x7f9ae80ccf30 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9ae5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9ae8071420 0x7f9ae8071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9ae6800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9ae815b4e0 0x7f9ae80b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58462/0 (socket says 172.21.15.144:58462) 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9ae6800640 1 -- 172.21.15.144:0/3235838791 learned_addr learned my addr 172.21.15.144:0/3235838791 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9ae7200640 1 --2- 172.21.15.144:0/3235838791 >> v2:172.21.15.165:3300/0 conn(0x7f9ae80ccf30 0x7f9ae80cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9ae5e00640 1 -- 172.21.15.144:0/3235838791 >> v2:172.21.15.165:3300/0 conn(0x7f9ae80ccf30 msgr2=0x7f9ae80cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9ae5e00640 1 --2- 172.21.15.144:0/3235838791 >> v2:172.21.15.165:3300/0 conn(0x7f9ae80ccf30 0x7f9ae80cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9ae5e00640 1 -- 172.21.15.144:0/3235838791 >> v1:172.21.15.144:6789/0 conn(0x7f9ae815b4e0 legacy=0x7f9ae80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9ae5400640 1 -- 172.21.15.144:0/3235838791 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384982335 0 0) 0x7f9ae80cd890 con 0x7f9ae815b4e0 2024-09-12T12:26:05.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.574+0000 7f9ae5e00640 1 -- 172.21.15.144:0/3235838791 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae80b42c0 con 0x7f9ae8071420 2024-09-12T12:26:05.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9ae5e00640 1 --2- 172.21.15.144:0/3235838791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 0x7f9ae8071840 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80d0480 tx=0x7f9ad401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e33d2a07fe8f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9ae5400640 1 -- 172.21.15.144:0/3235838791 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad40ab650 con 0x7f9ae8071420 2024-09-12T12:26:05.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9ae5400640 1 -- 172.21.15.144:0/3235838791 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad40b0070 con 0x7f9ae8071420 2024-09-12T12:26:05.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9ae5400640 1 -- 172.21.15.144:0/3235838791 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad40aba10 con 0x7f9ae8071420 2024-09-12T12:26:05.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 -- 172.21.15.144:0/3235838791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 msgr2=0x7f9ae8071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 --2- 172.21.15.144:0/3235838791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 0x7f9ae8071840 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80d0480 tx=0x7f9ad401c450 comp rx=0 tx=0).stop 2024-09-12T12:26:05.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 -- 172.21.15.144:0/3235838791 shutdown_connections 2024-09-12T12:26:05.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 --2- 172.21.15.144:0/3235838791 >> v2:172.21.15.165:3300/0 conn(0x7f9ae80ccf30 0x7f9ae80cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 --2- 172.21.15.144:0/3235838791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 0x7f9ae8071840 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 -- 172.21.15.144:0/3235838791 >> 172.21.15.144:0/3235838791 conn(0x7f9ae806d0d0 msgr2=0x7f9ae806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:05.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 -- 172.21.15.144:0/3235838791 shutdown_connections 2024-09-12T12:26:05.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 -- 172.21.15.144:0/3235838791 wait complete. 2024-09-12T12:26:05.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 Processor -- start 2024-09-12T12:26:05.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 -- start start 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 0x7f9ae80d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80ccf30 0x7f9ae8167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815b4e0 0x7f9ae81570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae815b8c0 con 0x7f9ae8071420 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae80cdef0 con 0x7f9ae80ccf30 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9aed400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae81683c0 con 0x7f9ae815b4e0 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9ae6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 0x7f9ae80d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9ae6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 0x7f9ae80d0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43226/0 (socket says 172.21.15.144:43226) 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.578+0000 7f9ae6800640 1 -- 172.21.15.144:0/3626431079 learned_addr learned my addr 172.21.15.144:0/3626431079 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9ae5e00640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80ccf30 0x7f9ae8167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9ae7200640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815b4e0 0x7f9ae81570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9ae6800640 1 -- 172.21.15.144:0/3626431079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815b4e0 msgr2=0x7f9ae81570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9ae6800640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815b4e0 0x7f9ae81570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9ae6800640 1 -- 172.21.15.144:0/3626431079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80ccf30 msgr2=0x7f9ae8167c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9ae6800640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80ccf30 0x7f9ae8167c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9ae6800640 1 -- 172.21.15.144:0/3626431079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae81686a0 con 0x7f9ae8071420 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9ae6800640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 0x7f9ae80d0090 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800c480 tx=0x7f9ad800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9adea00640 1 -- 172.21.15.144:0/3626431079 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8018070 con 0x7f9ae8071420 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9adea00640 1 -- 172.21.15.144:0/3626431079 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad8007500 con 0x7f9ae8071420 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae8168980 con 0x7f9ae8071420 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9adea00640 1 -- 172.21.15.144:0/3626431079 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8004a30 con 0x7f9ae8071420 2024-09-12T12:26:05.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae8168f40 con 0x7f9ae8071420 2024-09-12T12:26:05.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae8071840 con 0x7f9ae8071420 2024-09-12T12:26:05.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9adea00640 1 -- 172.21.15.144:0/3626431079 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ad801b070 con 0x7f9ae8071420 2024-09-12T12:26:05.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9adea00640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ac80678f0 0x7f9ac8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.582+0000 7f9adea00640 1 -- 172.21.15.144:0/3626431079 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f9ad80850d0 con 0x7f9ae8071420 2024-09-12T12:26:05.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.586+0000 7f9ae5e00640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ac80678f0 0x7f9ac8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.586+0000 7f9ae5e00640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ac80678f0 0x7f9ac8069db0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40af000 tx=0x7f9ad40a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.590+0000 7f9adea00640 1 -- 172.21.15.144:0/3626431079 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ad8055b10 con 0x7f9ae8071420 2024-09-12T12:26:05.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ae8161340 con 0x7f9ae8071420 2024-09-12T12:26:05.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9adea00640 1 -- 172.21.15.144:0/3626431079 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) ==== 74+0+16968 (secure 0 0 0) 0x7f9ad8055410 con 0x7f9ae8071420 2024-09-12T12:26:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:05.752 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":202,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:26:03.020500+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:59.097807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-12T12:26:00.385383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:05.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ac80678f0 msgr2=0x7f9ac8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ac80678f0 0x7f9ac8069db0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40af000 tx=0x7f9ad40a7000 comp rx=0 tx=0).stop 2024-09-12T12:26:05.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 msgr2=0x7f9ae80d0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 0x7f9ae80d0090 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800c480 tx=0x7f9ad800c940 comp rx=0 tx=0).stop 2024-09-12T12:26:05.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 shutdown_connections 2024-09-12T12:26:05.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f9ac80678f0 0x7f9ac8069db0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815b4e0 0x7f9ae81570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80ccf30 0x7f9ae8167c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 --2- 172.21.15.144:0/3626431079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae8071420 0x7f9ae80d0090 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 >> 172.21.15.144:0/3626431079 conn(0x7f9ae806d0d0 msgr2=0x7f9ae8073720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:05.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 shutdown_connections 2024-09-12T12:26:05.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.750+0000 7f9aed400640 1 -- 172.21.15.144:0/3626431079 wait complete. 2024-09-12T12:26:05.777 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:26:05.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:26:05.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.910+0000 7fc75a600640 1 Processor -- start 2024-09-12T12:26:05.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.910+0000 7fc75a600640 1 -- start start 2024-09-12T12:26:05.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.910+0000 7fc75a600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc75415b4e0 0x7fc7540b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.910+0000 7fc75a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 0x7fc754071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.910+0000 7fc75a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7540b45a0 con 0x7fc754071960 2024-09-12T12:26:05.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.910+0000 7fc75a600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc7540b3fe0 con 0x7fc75415b4e0 2024-09-12T12:26:05.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.910+0000 7fc75a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7540b42c0 con 0x7fc7540b3ad0 2024-09-12T12:26:05.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc753400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc75415b4e0 0x7fc7540b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc753400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc75415b4e0 0x7fc7540b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43238/0 (socket says 172.21.15.144:43238) 2024-09-12T12:26:05.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc753e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc754071960 0x7fc7540ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58472/0 (socket says 172.21.15.144:58472) 2024-09-12T12:26:05.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc753400640 1 -- 172.21.15.144:0/2073188256 learned_addr learned my addr 172.21.15.144:0/2073188256 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc752a00640 1 --2- 172.21.15.144:0/2073188256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 0x7fc754071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc753400640 1 -- 172.21.15.144:0/2073188256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 msgr2=0x7fc754071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc753400640 1 --2- 172.21.15.144:0/2073188256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 0x7fc754071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc753400640 1 -- 172.21.15.144:0/2073188256 >> v1:172.21.15.144:6789/0 conn(0x7fc754071960 legacy=0x7fc7540ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc753400640 1 -- 172.21.15.144:0/2073188256 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7540b1490 con 0x7fc75415b4e0 2024-09-12T12:26:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc752000640 1 -- 172.21.15.144:0/2073188256 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2162770734 0 0) 0x7fc7540b45a0 con 0x7fc754071960 2024-09-12T12:26:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc752a00640 1 --2- 172.21.15.144:0/2073188256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 0x7fc754071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:05.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc753400640 1 --2- 172.21.15.144:0/2073188256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc75415b4e0 0x7fc7540b3590 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d150 tx=0x7fc74401ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8951f7b8a3b0ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc752000640 1 -- 172.21.15.144:0/2073188256 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7440a7cf0 con 0x7fc75415b4e0 2024-09-12T12:26:05.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc752000640 1 -- 172.21.15.144:0/2073188256 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74400b0d0 con 0x7fc75415b4e0 2024-09-12T12:26:05.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.914+0000 7fc752000640 1 -- 172.21.15.144:0/2073188256 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744009600 con 0x7fc75415b4e0 2024-09-12T12:26:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 -- 172.21.15.144:0/2073188256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc75415b4e0 msgr2=0x7fc7540b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 --2- 172.21.15.144:0/2073188256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc75415b4e0 0x7fc7540b3590 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d150 tx=0x7fc74401ec00 comp rx=0 tx=0).stop 2024-09-12T12:26:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 -- 172.21.15.144:0/2073188256 shutdown_connections 2024-09-12T12:26:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 --2- 172.21.15.144:0/2073188256 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 0x7fc754071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 --2- 172.21.15.144:0/2073188256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc75415b4e0 0x7fc7540b3590 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 -- 172.21.15.144:0/2073188256 >> 172.21.15.144:0/2073188256 conn(0x7fc75406d0d0 msgr2=0x7fc75406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 -- 172.21.15.144:0/2073188256 shutdown_connections 2024-09-12T12:26:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 -- 172.21.15.144:0/2073188256 wait complete. 2024-09-12T12:26:05.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 Processor -- start 2024-09-12T12:26:05.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 -- start start 2024-09-12T12:26:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc754071960 0x7fc754153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 0x7fc75415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75415b4e0 0x7fc75414eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7540b2620 con 0x7fc754071960 2024-09-12T12:26:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7540b24a0 con 0x7fc75415b4e0 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc75a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7540cd640 con 0x7fc7540b3ad0 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc753400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc754071960 0x7fc754153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc753400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc754071960 0x7fc754153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43246/0 (socket says 172.21.15.144:43246) 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc753400640 1 -- 172.21.15.144:0/3890723251 learned_addr learned my addr 172.21.15.144:0/3890723251 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc753e00640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75415b4e0 0x7fc75414eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc752a00640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 0x7fc75415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc753400640 1 -- 172.21.15.144:0/3890723251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 msgr2=0x7fc75415dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc753400640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 0x7fc75415dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc753400640 1 -- 172.21.15.144:0/3890723251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75415b4e0 msgr2=0x7fc75414eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc753400640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75415b4e0 0x7fc75414eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.918+0000 7fc753400640 1 -- 172.21.15.144:0/3890723251 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75406f1d0 con 0x7fc754071960 2024-09-12T12:26:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc753400640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc754071960 0x7fc754153630 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d150 tx=0x7fc74401b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc74b400640 1 -- 172.21.15.144:0/3890723251 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74400b480 con 0x7fc754071960 2024-09-12T12:26:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc74b400640 1 -- 172.21.15.144:0/3890723251 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc744009810 con 0x7fc754071960 2024-09-12T12:26:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc74b400640 1 -- 172.21.15.144:0/3890723251 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc744009bc0 con 0x7fc754071960 2024-09-12T12:26:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75415c070 con 0x7fc754071960 2024-09-12T12:26:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75415c910 con 0x7fc754071960 2024-09-12T12:26:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc754071420 con 0x7fc754071960 2024-09-12T12:26:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc74b400640 1 -- 172.21.15.144:0/3890723251 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7440c0020 con 0x7fc754071960 2024-09-12T12:26:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc74b400640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7340678c0 0x7fc734069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc74b400640 1 -- 172.21.15.144:0/3890723251 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7fc744120d20 con 0x7fc754071960 2024-09-12T12:26:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.922+0000 7fc752a00640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7340678c0 0x7fc734069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.926+0000 7fc752a00640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7340678c0 0x7fc734069d80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc754157730 tx=0x7fc740008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:05.926+0000 7fc74b400640 1 -- 172.21.15.144:0/3890723251 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc744018820 con 0x7fc754071960 2024-09-12T12:26:06.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.086+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7540cf470 con 0x7fc7340678c0 2024-09-12T12:26:06.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.090+0000 7fc74b400640 1 -- 172.21.15.144:0/3890723251 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252487 (secure 0 0 0) 0x7fc7540cf470 con 0x7fc7340678c0 2024-09-12T12:26:06.097 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:06.098 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7340678c0 msgr2=0x7fc734069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7340678c0 0x7fc734069d80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc754157730 tx=0x7fc740008040 comp rx=0 tx=0).stop 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc754071960 msgr2=0x7fc754153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc754071960 0x7fc754153630 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d150 tx=0x7fc74401b9a0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 shutdown_connections 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc7340678c0 0x7fc734069d80 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc75415b4e0 0x7fc75414eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7540b3ad0 0x7fc75415dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 --2- 172.21.15.144:0/3890723251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc754071960 0x7fc754153630 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 >> 172.21.15.144:0/3890723251 conn(0x7fc75406d0d0 msgr2=0x7fc7540cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 shutdown_connections 2024-09-12T12:26:06.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.094+0000 7fc75a600640 1 -- 172.21.15.144:0/3890723251 wait complete. 2024-09-12T12:26:06.119 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":601,"stamp":"2024-09-12T12:26:05.550049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":460836,"kb_used_data":21160,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754513884,"statfs":{"total":773094113280,"available":772622217216,"internally_reserved":0,"allocated":21667840,"data_stored":10857148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.552449"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142555+0000","last_change":"2024-09-12T12:26:02.044836+0000","last_active":"2024-09-12T12:26:03.142555+0000","last_peered":"2024-09-12T12:26:03.142555+0000","last_clean":"2024-09-12T12:26:03.142555+0000","last_became_active":"2024-09-12T12:26:02.043992+0000","last_became_peered":"2024-09-12T12:26:02.043992+0000","last_unstale":"2024-09-12T12:26:03.142555+0000","last_undegraded":"2024-09-12T12:26:03.142555+0000","last_fullsized":"2024-09-12T12:26:03.142555+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:45:54.695167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143026+0000","last_change":"2024-09-12T12:26:02.034683+0000","last_active":"2024-09-12T12:26:03.143026+0000","last_peered":"2024-09-12T12:26:03.143026+0000","last_clean":"2024-09-12T12:26:03.143026+0000","last_became_active":"2024-09-12T12:26:02.034335+0000","last_became_peered":"2024-09-12T12:26:02.034335+0000","last_unstale":"2024-09-12T12:26:03.143026+0000","last_undegraded":"2024-09-12T12:26:03.143026+0000","last_fullsized":"2024-09-12T12:26:03.143026+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:38.003912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142483+0000","last_change":"2024-09-12T12:26:02.029011+0000","last_active":"2024-09-12T12:26:03.142483+0000","last_peered":"2024-09-12T12:26:03.142483+0000","last_clean":"2024-09-12T12:26:03.142483+0000","last_became_active":"2024-09-12T12:26:02.028730+0000","last_became_peered":"2024-09-12T12:26:02.028730+0000","last_unstale":"2024-09-12T12:26:03.142483+0000","last_undegraded":"2024-09-12T12:26:03.142483+0000","last_fullsized":"2024-09-12T12:26:03.142483+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:06.077320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041537+0000","last_change":"2024-09-12T12:26:02.038923+0000","last_active":"2024-09-12T12:26:03.041537+0000","last_peered":"2024-09-12T12:26:03.041537+0000","last_clean":"2024-09-12T12:26:03.041537+0000","last_became_active":"2024-09-12T12:26:02.038662+0000","last_became_peered":"2024-09-12T12:26:02.038662+0000","last_unstale":"2024-09-12T12:26:03.041537+0000","last_undegraded":"2024-09-12T12:26:03.041537+0000","last_fullsized":"2024-09-12T12:26:03.041537+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:31.855236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142366+0000","last_change":"2024-09-12T12:26:02.041430+0000","last_active":"2024-09-12T12:26:03.142366+0000","last_peered":"2024-09-12T12:26:03.142366+0000","last_clean":"2024-09-12T12:26:03.142366+0000","last_became_active":"2024-09-12T12:26:02.041137+0000","last_became_peered":"2024-09-12T12:26:02.041137+0000","last_unstale":"2024-09-12T12:26:03.142366+0000","last_undegraded":"2024-09-12T12:26:03.142366+0000","last_fullsized":"2024-09-12T12:26:03.142366+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:43.399124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035535+0000","last_change":"2024-09-12T12:26:02.037881+0000","last_active":"2024-09-12T12:26:03.035535+0000","last_peered":"2024-09-12T12:26:03.035535+0000","last_clean":"2024-09-12T12:26:03.035535+0000","last_became_active":"2024-09-12T12:26:02.036210+0000","last_became_peered":"2024-09-12T12:26:02.036210+0000","last_unstale":"2024-09-12T12:26:03.035535+0000","last_undegraded":"2024-09-12T12:26:03.035535+0000","last_fullsized":"2024-09-12T12:26:03.035535+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:49.269651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142018+0000","last_change":"2024-09-12T12:26:02.037597+0000","last_active":"2024-09-12T12:26:03.142018+0000","last_peered":"2024-09-12T12:26:03.142018+0000","last_clean":"2024-09-12T12:26:03.142018+0000","last_became_active":"2024-09-12T12:26:02.037328+0000","last_became_peered":"2024-09-12T12:26:02.037328+0000","last_unstale":"2024-09-12T12:26:03.142018+0000","last_undegraded":"2024-09-12T12:26:03.142018+0000","last_fullsized":"2024-09-12T12:26:03.142018+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:51.843984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034380+0000","last_change":"2024-09-12T12:26:02.039252+0000","last_active":"2024-09-12T12:26:03.034380+0000","last_peered":"2024-09-12T12:26:03.034380+0000","last_clean":"2024-09-12T12:26:03.034380+0000","last_became_active":"2024-09-12T12:26:02.038512+0000","last_became_peered":"2024-09-12T12:26:02.038512+0000","last_unstale":"2024-09-12T12:26:03.034380+0000","last_undegraded":"2024-09-12T12:26:03.034380+0000","last_fullsized":"2024-09-12T12:26:03.034380+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:11.863516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143283+0000","last_change":"2024-09-12T12:26:02.025684+0000","last_active":"2024-09-12T12:26:03.143283+0000","last_peered":"2024-09-12T12:26:03.143283+0000","last_clean":"2024-09-12T12:26:03.143283+0000","last_became_active":"2024-09-12T12:26:02.025371+0000","last_became_peered":"2024-09-12T12:26:02.025371+0000","last_unstale":"2024-09-12T12:26:03.143283+0000","last_undegraded":"2024-09-12T12:26:03.143283+0000","last_fullsized":"2024-09-12T12:26:03.143283+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:44.272828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142541+0000","last_change":"2024-09-12T12:26:02.036038+0000","last_active":"2024-09-12T12:26:03.142541+0000","last_peered":"2024-09-12T12:26:03.142541+0000","last_clean":"2024-09-12T12:26:03.142541+0000","last_became_active":"2024-09-12T12:26:02.035739+0000","last_became_peered":"2024-09-12T12:26:02.035739+0000","last_unstale":"2024-09-12T12:26:03.142541+0000","last_undegraded":"2024-09-12T12:26:03.142541+0000","last_fullsized":"2024-09-12T12:26:03.142541+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:47.042085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041678+0000","last_change":"2024-09-12T12:26:02.031249+0000","last_active":"2024-09-12T12:26:03.041678+0000","last_peered":"2024-09-12T12:26:03.041678+0000","last_clean":"2024-09-12T12:26:03.041678+0000","last_became_active":"2024-09-12T12:26:02.030850+0000","last_became_peered":"2024-09-12T12:26:02.030850+0000","last_unstale":"2024-09-12T12:26:03.041678+0000","last_undegraded":"2024-09-12T12:26:03.041678+0000","last_fullsized":"2024-09-12T12:26:03.041678+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:23.540773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035740+0000","last_change":"2024-09-12T12:26:02.037833+0000","last_active":"2024-09-12T12:26:03.035740+0000","last_peered":"2024-09-12T12:26:03.035740+0000","last_clean":"2024-09-12T12:26:03.035740+0000","last_became_active":"2024-09-12T12:26:02.037564+0000","last_became_peered":"2024-09-12T12:26:02.037564+0000","last_unstale":"2024-09-12T12:26:03.035740+0000","last_undegraded":"2024-09-12T12:26:03.035740+0000","last_fullsized":"2024-09-12T12:26:03.035740+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:29.042316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034785+0000","last_change":"2024-09-12T12:26:02.037147+0000","last_active":"2024-09-12T12:26:03.034785+0000","last_peered":"2024-09-12T12:26:03.034785+0000","last_clean":"2024-09-12T12:26:03.034785+0000","last_became_active":"2024-09-12T12:26:02.036649+0000","last_became_peered":"2024-09-12T12:26:02.036649+0000","last_unstale":"2024-09-12T12:26:03.034785+0000","last_undegraded":"2024-09-12T12:26:03.034785+0000","last_fullsized":"2024-09-12T12:26:03.034785+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.438081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035815+0000","last_change":"2024-09-12T12:26:02.029118+0000","last_active":"2024-09-12T12:26:03.035815+0000","last_peered":"2024-09-12T12:26:03.035815+0000","last_clean":"2024-09-12T12:26:03.035815+0000","last_became_active":"2024-09-12T12:26:02.028037+0000","last_became_peered":"2024-09-12T12:26:02.028037+0000","last_unstale":"2024-09-12T12:26:03.035815+0000","last_undegraded":"2024-09-12T12:26:03.035815+0000","last_fullsized":"2024-09-12T12:26:03.035815+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:21:16.250842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033018+0000","last_change":"2024-09-12T12:26:02.023964+0000","last_active":"2024-09-12T12:26:03.033018+0000","last_peered":"2024-09-12T12:26:03.033018+0000","last_clean":"2024-09-12T12:26:03.033018+0000","last_became_active":"2024-09-12T12:26:02.023529+0000","last_became_peered":"2024-09-12T12:26:02.023529+0000","last_unstale":"2024-09-12T12:26:03.033018+0000","last_undegraded":"2024-09-12T12:26:03.033018+0000","last_fullsized":"2024-09-12T12:26:03.033018+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:46.738720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034911+0000","last_change":"2024-09-12T12:26:02.033884+0000","last_active":"2024-09-12T12:26:03.034911+0000","last_peered":"2024-09-12T12:26:03.034911+0000","last_clean":"2024-09-12T12:26:03.034911+0000","last_became_active":"2024-09-12T12:26:02.033490+0000","last_became_peered":"2024-09-12T12:26:02.033490+0000","last_unstale":"2024-09-12T12:26:03.034911+0000","last_undegraded":"2024-09-12T12:26:03.034911+0000","last_fullsized":"2024-09-12T12:26:03.034911+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:27.649564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036201+0000","last_change":"2024-09-12T12:26:02.039540+0000","last_active":"2024-09-12T12:26:03.036201+0000","last_peered":"2024-09-12T12:26:03.036201+0000","last_clean":"2024-09-12T12:26:03.036201+0000","last_became_active":"2024-09-12T12:26:02.039230+0000","last_became_peered":"2024-09-12T12:26:02.039230+0000","last_unstale":"2024-09-12T12:26:03.036201+0000","last_undegraded":"2024-09-12T12:26:03.036201+0000","last_fullsized":"2024-09-12T12:26:03.036201+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:04.264555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142733+0000","last_change":"2024-09-12T12:26:02.024313+0000","last_active":"2024-09-12T12:26:03.142733+0000","last_peered":"2024-09-12T12:26:03.142733+0000","last_clean":"2024-09-12T12:26:03.142733+0000","last_became_active":"2024-09-12T12:26:02.023887+0000","last_became_peered":"2024-09-12T12:26:02.023887+0000","last_unstale":"2024-09-12T12:26:03.142733+0000","last_undegraded":"2024-09-12T12:26:03.142733+0000","last_fullsized":"2024-09-12T12:26:03.142733+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:29.727402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142519+0000","last_change":"2024-09-12T12:26:02.042442+0000","last_active":"2024-09-12T12:26:03.142519+0000","last_peered":"2024-09-12T12:26:03.142519+0000","last_clean":"2024-09-12T12:26:03.142519+0000","last_became_active":"2024-09-12T12:26:02.041601+0000","last_became_peered":"2024-09-12T12:26:02.041601+0000","last_unstale":"2024-09-12T12:26:03.142519+0000","last_undegraded":"2024-09-12T12:26:03.142519+0000","last_fullsized":"2024-09-12T12:26:03.142519+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:10.953620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035268+0000","last_change":"2024-09-12T12:26:02.034753+0000","last_active":"2024-09-12T12:26:03.035268+0000","last_peered":"2024-09-12T12:26:03.035268+0000","last_clean":"2024-09-12T12:26:03.035268+0000","last_became_active":"2024-09-12T12:26:02.034483+0000","last_became_peered":"2024-09-12T12:26:02.034483+0000","last_unstale":"2024-09-12T12:26:03.035268+0000","last_undegraded":"2024-09-12T12:26:03.035268+0000","last_fullsized":"2024-09-12T12:26:03.035268+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:04.196342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141905+0000","last_change":"2024-09-12T12:26:02.025670+0000","last_active":"2024-09-12T12:26:03.141905+0000","last_peered":"2024-09-12T12:26:03.141905+0000","last_clean":"2024-09-12T12:26:03.141905+0000","last_became_active":"2024-09-12T12:26:02.025398+0000","last_became_peered":"2024-09-12T12:26:02.025398+0000","last_unstale":"2024-09-12T12:26:03.141905+0000","last_undegraded":"2024-09-12T12:26:03.141905+0000","last_fullsized":"2024-09-12T12:26:03.141905+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:49.798793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033098+0000","last_change":"2024-09-12T12:26:02.036640+0000","last_active":"2024-09-12T12:26:03.033098+0000","last_peered":"2024-09-12T12:26:03.033098+0000","last_clean":"2024-09-12T12:26:03.033098+0000","last_became_active":"2024-09-12T12:26:02.036345+0000","last_became_peered":"2024-09-12T12:26:02.036345+0000","last_unstale":"2024-09-12T12:26:03.033098+0000","last_undegraded":"2024-09-12T12:26:03.033098+0000","last_fullsized":"2024-09-12T12:26:03.033098+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:12.565206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141671+0000","last_change":"2024-09-12T12:26:02.021505+0000","last_active":"2024-09-12T12:26:03.141671+0000","last_peered":"2024-09-12T12:26:03.141671+0000","last_clean":"2024-09-12T12:26:03.141671+0000","last_became_active":"2024-09-12T12:26:02.021214+0000","last_became_peered":"2024-09-12T12:26:02.021214+0000","last_unstale":"2024-09-12T12:26:03.141671+0000","last_undegraded":"2024-09-12T12:26:03.141671+0000","last_fullsized":"2024-09-12T12:26:03.141671+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:19.457359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142381+0000","last_change":"2024-09-12T12:26:02.039990+0000","last_active":"2024-09-12T12:26:03.142381+0000","last_peered":"2024-09-12T12:26:03.142381+0000","last_clean":"2024-09-12T12:26:03.142381+0000","last_became_active":"2024-09-12T12:26:02.039747+0000","last_became_peered":"2024-09-12T12:26:02.039747+0000","last_unstale":"2024-09-12T12:26:03.142381+0000","last_undegraded":"2024-09-12T12:26:03.142381+0000","last_fullsized":"2024-09-12T12:26:03.142381+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:04.264555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142576+0000","last_change":"2024-09-12T12:26:02.045973+0000","last_active":"2024-09-12T12:26:03.142576+0000","last_peered":"2024-09-12T12:26:03.142576+0000","last_clean":"2024-09-12T12:26:03.142576+0000","last_became_active":"2024-09-12T12:26:02.045554+0000","last_became_peered":"2024-09-12T12:26:02.045554+0000","last_unstale":"2024-09-12T12:26:03.142576+0000","last_undegraded":"2024-09-12T12:26:03.142576+0000","last_fullsized":"2024-09-12T12:26:03.142576+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:46.738720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142719+0000","last_change":"2024-09-12T12:26:02.020020+0000","last_active":"2024-09-12T12:26:03.142719+0000","last_peered":"2024-09-12T12:26:03.142719+0000","last_clean":"2024-09-12T12:26:03.142719+0000","last_became_active":"2024-09-12T12:26:02.019747+0000","last_became_peered":"2024-09-12T12:26:02.019747+0000","last_unstale":"2024-09-12T12:26:03.142719+0000","last_undegraded":"2024-09-12T12:26:03.142719+0000","last_fullsized":"2024-09-12T12:26:03.142719+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:48.709394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041717+0000","last_change":"2024-09-12T12:26:02.021382+0000","last_active":"2024-09-12T12:26:03.041717+0000","last_peered":"2024-09-12T12:26:03.041717+0000","last_clean":"2024-09-12T12:26:03.041717+0000","last_became_active":"2024-09-12T12:26:02.020628+0000","last_became_peered":"2024-09-12T12:26:02.020628+0000","last_unstale":"2024-09-12T12:26:03.041717+0000","last_undegraded":"2024-09-12T12:26:03.041717+0000","last_fullsized":"2024-09-12T12:26:03.041717+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:28.139872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036019+0000","last_change":"2024-09-12T12:26:02.027624+0000","last_active":"2024-09-12T12:26:03.036019+0000","last_peered":"2024-09-12T12:26:03.036019+0000","last_clean":"2024-09-12T12:26:03.036019+0000","last_became_active":"2024-09-12T12:26:02.027324+0000","last_became_peered":"2024-09-12T12:26:02.027324+0000","last_unstale":"2024-09-12T12:26:03.036019+0000","last_undegraded":"2024-09-12T12:26:03.036019+0000","last_fullsized":"2024-09-12T12:26:03.036019+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:59.905962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142249+0000","last_change":"2024-09-12T12:26:02.033843+0000","last_active":"2024-09-12T12:26:03.142249+0000","last_peered":"2024-09-12T12:26:03.142249+0000","last_clean":"2024-09-12T12:26:03.142249+0000","last_became_active":"2024-09-12T12:26:02.033399+0000","last_became_peered":"2024-09-12T12:26:02.033399+0000","last_unstale":"2024-09-12T12:26:03.142249+0000","last_undegraded":"2024-09-12T12:26:03.142249+0000","last_fullsized":"2024-09-12T12:26:03.142249+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:09.056834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035239+0000","last_change":"2024-09-12T12:26:02.040081+0000","last_active":"2024-09-12T12:26:03.035239+0000","last_peered":"2024-09-12T12:26:03.035239+0000","last_clean":"2024-09-12T12:26:03.035239+0000","last_became_active":"2024-09-12T12:26:02.039354+0000","last_became_peered":"2024-09-12T12:26:02.039354+0000","last_unstale":"2024-09-12T12:26:03.035239+0000","last_undegraded":"2024-09-12T12:26:03.035239+0000","last_fullsized":"2024-09-12T12:26:03.035239+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:51.799175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141723+0000","last_change":"2024-09-12T12:26:02.028348+0000","last_active":"2024-09-12T12:26:03.141723+0000","last_peered":"2024-09-12T12:26:03.141723+0000","last_clean":"2024-09-12T12:26:03.141723+0000","last_became_active":"2024-09-12T12:26:02.028098+0000","last_became_peered":"2024-09-12T12:26:02.028098+0000","last_unstale":"2024-09-12T12:26:03.141723+0000","last_undegraded":"2024-09-12T12:26:03.141723+0000","last_fullsized":"2024-09-12T12:26:03.141723+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:45.139371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035086+0000","last_change":"2024-09-12T12:26:02.042864+0000","last_active":"2024-09-12T12:26:03.035086+0000","last_peered":"2024-09-12T12:26:03.035086+0000","last_clean":"2024-09-12T12:26:03.035086+0000","last_became_active":"2024-09-12T12:26:02.042035+0000","last_became_peered":"2024-09-12T12:26:02.042035+0000","last_unstale":"2024-09-12T12:26:03.035086+0000","last_undegraded":"2024-09-12T12:26:03.035086+0000","last_fullsized":"2024-09-12T12:26:03.035086+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:37:42.131253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142544+0000","last_change":"2024-09-12T12:26:02.036043+0000","last_active":"2024-09-12T12:26:03.142544+0000","last_peered":"2024-09-12T12:26:03.142544+0000","last_clean":"2024-09-12T12:26:03.142544+0000","last_became_active":"2024-09-12T12:26:02.035792+0000","last_became_peered":"2024-09-12T12:26:02.035792+0000","last_unstale":"2024-09-12T12:26:03.142544+0000","last_undegraded":"2024-09-12T12:26:03.142544+0000","last_fullsized":"2024-09-12T12:26:03.142544+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:36:59.634955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"201'4","reported_seq":18,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143331+0000","last_change":"2024-09-12T12:26:01.016522+0000","last_active":"2024-09-12T12:26:03.143331+0000","last_peered":"2024-09-12T12:26:03.143331+0000","last_clean":"2024-09-12T12:26:03.143331+0000","last_became_active":"2024-09-12T12:26:01.016053+0000","last_became_peered":"2024-09-12T12:26:01.016053+0000","last_unstale":"2024-09-12T12:26:03.143331+0000","last_undegraded":"2024-09-12T12:26:03.143331+0000","last_fullsized":"2024-09-12T12:26:03.143331+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:10.964260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142742+0000","last_change":"2024-09-12T12:26:02.019981+0000","last_active":"2024-09-12T12:26:03.142742+0000","last_peered":"2024-09-12T12:26:03.142742+0000","last_clean":"2024-09-12T12:26:03.142742+0000","last_became_active":"2024-09-12T12:26:02.019659+0000","last_became_peered":"2024-09-12T12:26:02.019659+0000","last_unstale":"2024-09-12T12:26:03.142742+0000","last_undegraded":"2024-09-12T12:26:03.142742+0000","last_fullsized":"2024-09-12T12:26:03.142742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:16.446614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036007+0000","last_change":"2024-09-12T12:26:01.022949+0000","last_active":"2024-09-12T12:26:03.036007+0000","last_peered":"2024-09-12T12:26:03.036007+0000","last_clean":"2024-09-12T12:26:03.036007+0000","last_became_active":"2024-09-12T12:26:01.022190+0000","last_became_peered":"2024-09-12T12:26:01.022190+0000","last_unstale":"2024-09-12T12:26:03.036007+0000","last_undegraded":"2024-09-12T12:26:03.036007+0000","last_fullsized":"2024-09-12T12:26:03.036007+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:42.456950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036071+0000","last_change":"2024-09-12T12:26:02.035884+0000","last_active":"2024-09-12T12:26:03.036071+0000","last_peered":"2024-09-12T12:26:03.036071+0000","last_clean":"2024-09-12T12:26:03.036071+0000","last_became_active":"2024-09-12T12:26:02.035587+0000","last_became_peered":"2024-09-12T12:26:02.035587+0000","last_unstale":"2024-09-12T12:26:03.036071+0000","last_undegraded":"2024-09-12T12:26:03.036071+0000","last_fullsized":"2024-09-12T12:26:03.036071+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:29.938688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035404+0000","last_change":"2024-09-12T12:26:01.022780+0000","last_active":"2024-09-12T12:26:03.035404+0000","last_peered":"2024-09-12T12:26:03.035404+0000","last_clean":"2024-09-12T12:26:03.035404+0000","last_became_active":"2024-09-12T12:26:01.022497+0000","last_became_peered":"2024-09-12T12:26:01.022497+0000","last_unstale":"2024-09-12T12:26:03.035404+0000","last_undegraded":"2024-09-12T12:26:03.035404+0000","last_fullsized":"2024-09-12T12:26:03.035404+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:24.877087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141976+0000","last_change":"2024-09-12T12:26:02.036728+0000","last_active":"2024-09-12T12:26:03.141976+0000","last_peered":"2024-09-12T12:26:03.141976+0000","last_clean":"2024-09-12T12:26:03.141976+0000","last_became_active":"2024-09-12T12:26:02.036440+0000","last_became_peered":"2024-09-12T12:26:02.036440+0000","last_unstale":"2024-09-12T12:26:03.141976+0000","last_undegraded":"2024-09-12T12:26:03.141976+0000","last_fullsized":"2024-09-12T12:26:03.141976+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:01.403192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033490+0000","last_change":"2024-09-12T12:26:01.019733+0000","last_active":"2024-09-12T12:26:03.033490+0000","last_peered":"2024-09-12T12:26:03.033490+0000","last_clean":"2024-09-12T12:26:03.033490+0000","last_became_active":"2024-09-12T12:26:01.019472+0000","last_became_peered":"2024-09-12T12:26:01.019472+0000","last_unstale":"2024-09-12T12:26:03.033490+0000","last_undegraded":"2024-09-12T12:26:03.033490+0000","last_fullsized":"2024-09-12T12:26:03.033490+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:17:30.775965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034557+0000","last_change":"2024-09-12T12:26:02.028710+0000","last_active":"2024-09-12T12:26:03.034557+0000","last_peered":"2024-09-12T12:26:03.034557+0000","last_clean":"2024-09-12T12:26:03.034557+0000","last_became_active":"2024-09-12T12:26:02.028406+0000","last_became_peered":"2024-09-12T12:26:02.028406+0000","last_unstale":"2024-09-12T12:26:03.034557+0000","last_undegraded":"2024-09-12T12:26:03.034557+0000","last_fullsized":"2024-09-12T12:26:03.034557+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:49.269651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142165+0000","last_change":"2024-09-12T12:26:01.025692+0000","last_active":"2024-09-12T12:26:03.142165+0000","last_peered":"2024-09-12T12:26:03.142165+0000","last_clean":"2024-09-12T12:26:03.142165+0000","last_became_active":"2024-09-12T12:26:01.025243+0000","last_became_peered":"2024-09-12T12:26:01.025243+0000","last_unstale":"2024-09-12T12:26:03.142165+0000","last_undegraded":"2024-09-12T12:26:03.142165+0000","last_fullsized":"2024-09-12T12:26:03.142165+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:06.429277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033158+0000","last_change":"2024-09-12T12:26:02.038980+0000","last_active":"2024-09-12T12:26:03.033158+0000","last_peered":"2024-09-12T12:26:03.033158+0000","last_clean":"2024-09-12T12:26:03.033158+0000","last_became_active":"2024-09-12T12:26:02.038672+0000","last_became_peered":"2024-09-12T12:26:02.038672+0000","last_unstale":"2024-09-12T12:26:03.033158+0000","last_undegraded":"2024-09-12T12:26:03.033158+0000","last_fullsized":"2024-09-12T12:26:03.033158+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:56.591240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041530+0000","last_change":"2024-09-12T12:26:01.006624+0000","last_active":"2024-09-12T12:26:03.041530+0000","last_peered":"2024-09-12T12:26:03.041530+0000","last_clean":"2024-09-12T12:26:03.041530+0000","last_became_active":"2024-09-12T12:26:01.005218+0000","last_became_peered":"2024-09-12T12:26:01.005218+0000","last_unstale":"2024-09-12T12:26:03.041530+0000","last_undegraded":"2024-09-12T12:26:03.041530+0000","last_fullsized":"2024-09-12T12:26:03.041530+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:36.529563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142112+0000","last_change":"2024-09-12T12:26:02.035400+0000","last_active":"2024-09-12T12:26:03.142112+0000","last_peered":"2024-09-12T12:26:03.142112+0000","last_clean":"2024-09-12T12:26:03.142112+0000","last_became_active":"2024-09-12T12:26:02.035151+0000","last_became_peered":"2024-09-12T12:26:02.035151+0000","last_unstale":"2024-09-12T12:26:03.142112+0000","last_undegraded":"2024-09-12T12:26:03.142112+0000","last_fullsized":"2024-09-12T12:26:03.142112+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:21.588263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142091+0000","last_change":"2024-09-12T12:26:01.018216+0000","last_active":"2024-09-12T12:26:03.142091+0000","last_peered":"2024-09-12T12:26:03.142091+0000","last_clean":"2024-09-12T12:26:03.142091+0000","last_became_active":"2024-09-12T12:26:01.017757+0000","last_became_peered":"2024-09-12T12:26:01.017757+0000","last_unstale":"2024-09-12T12:26:03.142091+0000","last_undegraded":"2024-09-12T12:26:03.142091+0000","last_fullsized":"2024-09-12T12:26:03.142091+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.192805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033261+0000","last_change":"2024-09-12T12:26:02.025418+0000","last_active":"2024-09-12T12:26:03.033261+0000","last_peered":"2024-09-12T12:26:03.033261+0000","last_clean":"2024-09-12T12:26:03.033261+0000","last_became_active":"2024-09-12T12:26:02.025162+0000","last_became_peered":"2024-09-12T12:26:02.025162+0000","last_unstale":"2024-09-12T12:26:03.033261+0000","last_undegraded":"2024-09-12T12:26:03.033261+0000","last_fullsized":"2024-09-12T12:26:03.033261+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:42:12.494103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142731+0000","last_change":"2024-09-12T12:26:01.020496+0000","last_active":"2024-09-12T12:26:03.142731+0000","last_peered":"2024-09-12T12:26:03.142731+0000","last_clean":"2024-09-12T12:26:03.142731+0000","last_became_active":"2024-09-12T12:26:01.020091+0000","last_became_peered":"2024-09-12T12:26:01.020091+0000","last_unstale":"2024-09-12T12:26:03.142731+0000","last_undegraded":"2024-09-12T12:26:03.142731+0000","last_fullsized":"2024-09-12T12:26:03.142731+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:37:41.122448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033307+0000","last_change":"2024-09-12T12:26:02.026777+0000","last_active":"2024-09-12T12:26:03.033307+0000","last_peered":"2024-09-12T12:26:03.033307+0000","last_clean":"2024-09-12T12:26:03.033307+0000","last_became_active":"2024-09-12T12:26:02.026158+0000","last_became_peered":"2024-09-12T12:26:02.026158+0000","last_unstale":"2024-09-12T12:26:03.033307+0000","last_undegraded":"2024-09-12T12:26:03.033307+0000","last_fullsized":"2024-09-12T12:26:03.033307+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:37.459507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041763+0000","last_change":"2024-09-12T12:26:01.012887+0000","last_active":"2024-09-12T12:26:03.041763+0000","last_peered":"2024-09-12T12:26:03.041763+0000","last_clean":"2024-09-12T12:26:03.041763+0000","last_became_active":"2024-09-12T12:26:01.012605+0000","last_became_peered":"2024-09-12T12:26:01.012605+0000","last_unstale":"2024-09-12T12:26:03.041763+0000","last_undegraded":"2024-09-12T12:26:03.041763+0000","last_fullsized":"2024-09-12T12:26:03.041763+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:07.121184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142838+0000","last_change":"2024-09-12T12:26:02.028664+0000","last_active":"2024-09-12T12:26:03.142838+0000","last_peered":"2024-09-12T12:26:03.142838+0000","last_clean":"2024-09-12T12:26:03.142838+0000","last_became_active":"2024-09-12T12:26:02.028391+0000","last_became_peered":"2024-09-12T12:26:02.028391+0000","last_unstale":"2024-09-12T12:26:03.142838+0000","last_undegraded":"2024-09-12T12:26:03.142838+0000","last_fullsized":"2024-09-12T12:26:03.142838+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:05:56.774618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"201'3","reported_seq":17,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142706+0000","last_change":"2024-09-12T12:26:01.021071+0000","last_active":"2024-09-12T12:26:03.142706+0000","last_peered":"2024-09-12T12:26:03.142706+0000","last_clean":"2024-09-12T12:26:03.142706+0000","last_became_active":"2024-09-12T12:26:01.020798+0000","last_became_peered":"2024-09-12T12:26:01.020798+0000","last_unstale":"2024-09-12T12:26:03.142706+0000","last_undegraded":"2024-09-12T12:26:03.142706+0000","last_fullsized":"2024-09-12T12:26:03.142706+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:26.640760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041891+0000","last_change":"2024-09-12T12:26:02.031584+0000","last_active":"2024-09-12T12:26:03.041891+0000","last_peered":"2024-09-12T12:26:03.041891+0000","last_clean":"2024-09-12T12:26:03.041891+0000","last_became_active":"2024-09-12T12:26:02.031320+0000","last_became_peered":"2024-09-12T12:26:02.031320+0000","last_unstale":"2024-09-12T12:26:03.041891+0000","last_undegraded":"2024-09-12T12:26:03.041891+0000","last_fullsized":"2024-09-12T12:26:03.041891+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:42:05.350183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"201'6","reported_seq":20,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035369+0000","last_change":"2024-09-12T12:26:01.023438+0000","last_active":"2024-09-12T12:26:03.035369+0000","last_peered":"2024-09-12T12:26:03.035369+0000","last_clean":"2024-09-12T12:26:03.035369+0000","last_became_active":"2024-09-12T12:26:01.023155+0000","last_became_peered":"2024-09-12T12:26:01.023155+0000","last_unstale":"2024-09-12T12:26:03.035369+0000","last_undegraded":"2024-09-12T12:26:03.035369+0000","last_fullsized":"2024-09-12T12:26:03.035369+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:18.685647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142473+0000","last_change":"2024-09-12T12:26:02.026715+0000","last_active":"2024-09-12T12:26:03.142473+0000","last_peered":"2024-09-12T12:26:03.142473+0000","last_clean":"2024-09-12T12:26:03.142473+0000","last_became_active":"2024-09-12T12:26:02.026367+0000","last_became_peered":"2024-09-12T12:26:02.026367+0000","last_unstale":"2024-09-12T12:26:03.142473+0000","last_undegraded":"2024-09-12T12:26:03.142473+0000","last_fullsized":"2024-09-12T12:26:03.142473+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:49.115982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035668+0000","last_change":"2024-09-12T12:26:01.011851+0000","last_active":"2024-09-12T12:26:03.035668+0000","last_peered":"2024-09-12T12:26:03.035668+0000","last_clean":"2024-09-12T12:26:03.035668+0000","last_became_active":"2024-09-12T12:26:01.010542+0000","last_became_peered":"2024-09-12T12:26:01.010542+0000","last_unstale":"2024-09-12T12:26:03.035668+0000","last_undegraded":"2024-09-12T12:26:03.035668+0000","last_fullsized":"2024-09-12T12:26:03.035668+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:01.594391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034601+0000","last_change":"2024-09-12T12:26:02.038439+0000","last_active":"2024-09-12T12:26:03.034601+0000","last_peered":"2024-09-12T12:26:03.034601+0000","last_clean":"2024-09-12T12:26:03.034601+0000","last_became_active":"2024-09-12T12:26:02.037171+0000","last_became_peered":"2024-09-12T12:26:02.037171+0000","last_unstale":"2024-09-12T12:26:03.034601+0000","last_undegraded":"2024-09-12T12:26:03.034601+0000","last_fullsized":"2024-09-12T12:26:03.034601+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:17:31.784769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143163+0000","last_change":"2024-09-12T12:26:01.018605+0000","last_active":"2024-09-12T12:26:03.143163+0000","last_peered":"2024-09-12T12:26:03.143163+0000","last_clean":"2024-09-12T12:26:03.143163+0000","last_became_active":"2024-09-12T12:26:01.016388+0000","last_became_peered":"2024-09-12T12:26:01.016388+0000","last_unstale":"2024-09-12T12:26:03.143163+0000","last_undegraded":"2024-09-12T12:26:03.143163+0000","last_fullsized":"2024-09-12T12:26:03.143163+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:32.232411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142080+0000","last_change":"2024-09-12T12:26:02.034750+0000","last_active":"2024-09-12T12:26:03.142080+0000","last_peered":"2024-09-12T12:26:03.142080+0000","last_clean":"2024-09-12T12:26:03.142080+0000","last_became_active":"2024-09-12T12:26:02.032566+0000","last_became_peered":"2024-09-12T12:26:02.032566+0000","last_unstale":"2024-09-12T12:26:03.142080+0000","last_undegraded":"2024-09-12T12:26:03.142080+0000","last_fullsized":"2024-09-12T12:26:03.142080+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:48.122779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034809+0000","last_change":"2024-09-12T12:26:01.018633+0000","last_active":"2024-09-12T12:26:03.034809+0000","last_peered":"2024-09-12T12:26:03.034809+0000","last_clean":"2024-09-12T12:26:03.034809+0000","last_became_active":"2024-09-12T12:26:01.018379+0000","last_became_peered":"2024-09-12T12:26:01.018379+0000","last_unstale":"2024-09-12T12:26:03.034809+0000","last_undegraded":"2024-09-12T12:26:03.034809+0000","last_fullsized":"2024-09-12T12:26:03.034809+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:25.738188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033510+0000","last_change":"2024-09-12T12:26:02.028171+0000","last_active":"2024-09-12T12:26:03.033510+0000","last_peered":"2024-09-12T12:26:03.033510+0000","last_clean":"2024-09-12T12:26:03.033510+0000","last_became_active":"2024-09-12T12:26:02.027929+0000","last_became_peered":"2024-09-12T12:26:02.027929+0000","last_unstale":"2024-09-12T12:26:03.033510+0000","last_undegraded":"2024-09-12T12:26:03.033510+0000","last_fullsized":"2024-09-12T12:26:03.033510+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:15.294102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"201'8","reported_seq":22,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034652+0000","last_change":"2024-09-12T12:26:01.006394+0000","last_active":"2024-09-12T12:26:03.034652+0000","last_peered":"2024-09-12T12:26:03.034652+0000","last_clean":"2024-09-12T12:26:03.034652+0000","last_became_active":"2024-09-12T12:26:01.005899+0000","last_became_peered":"2024-09-12T12:26:01.005899+0000","last_unstale":"2024-09-12T12:26:03.034652+0000","last_undegraded":"2024-09-12T12:26:03.034652+0000","last_fullsized":"2024-09-12T12:26:03.034652+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:01.878838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142102+0000","last_change":"2024-09-12T12:26:02.027254+0000","last_active":"2024-09-12T12:26:03.142102+0000","last_peered":"2024-09-12T12:26:03.142102+0000","last_clean":"2024-09-12T12:26:03.142102+0000","last_became_active":"2024-09-12T12:26:02.026305+0000","last_became_peered":"2024-09-12T12:26:02.026305+0000","last_unstale":"2024-09-12T12:26:03.142102+0000","last_undegraded":"2024-09-12T12:26:03.142102+0000","last_fullsized":"2024-09-12T12:26:03.142102+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:50.201610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142804+0000","last_change":"2024-09-12T12:26:01.020561+0000","last_active":"2024-09-12T12:26:03.142804+0000","last_peered":"2024-09-12T12:26:03.142804+0000","last_clean":"2024-09-12T12:26:03.142804+0000","last_became_active":"2024-09-12T12:26:01.020224+0000","last_became_peered":"2024-09-12T12:26:01.020224+0000","last_unstale":"2024-09-12T12:26:03.142804+0000","last_undegraded":"2024-09-12T12:26:03.142804+0000","last_fullsized":"2024-09-12T12:26:03.142804+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:08.048030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142597+0000","last_change":"2024-09-12T12:26:02.042650+0000","last_active":"2024-09-12T12:26:03.142597+0000","last_peered":"2024-09-12T12:26:03.142597+0000","last_clean":"2024-09-12T12:26:03.142597+0000","last_became_active":"2024-09-12T12:26:02.041876+0000","last_became_peered":"2024-09-12T12:26:02.041876+0000","last_unstale":"2024-09-12T12:26:03.142597+0000","last_undegraded":"2024-09-12T12:26:03.142597+0000","last_fullsized":"2024-09-12T12:26:03.142597+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:12.565206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143110+0000","last_change":"2024-09-12T12:26:01.019776+0000","last_active":"2024-09-12T12:26:03.143110+0000","last_peered":"2024-09-12T12:26:03.143110+0000","last_clean":"2024-09-12T12:26:03.143110+0000","last_became_active":"2024-09-12T12:26:01.019418+0000","last_became_peered":"2024-09-12T12:26:01.019418+0000","last_unstale":"2024-09-12T12:26:03.143110+0000","last_undegraded":"2024-09-12T12:26:03.143110+0000","last_fullsized":"2024-09-12T12:26:03.143110+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:48.282002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142884+0000","last_change":"2024-09-12T12:26:02.024126+0000","last_active":"2024-09-12T12:26:03.142884+0000","last_peered":"2024-09-12T12:26:03.142884+0000","last_clean":"2024-09-12T12:26:03.142884+0000","last_became_active":"2024-09-12T12:26:02.023536+0000","last_became_peered":"2024-09-12T12:26:02.023536+0000","last_unstale":"2024-09-12T12:26:03.142884+0000","last_undegraded":"2024-09-12T12:26:03.142884+0000","last_fullsized":"2024-09-12T12:26:03.142884+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:15.079102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035669+0000","last_change":"2024-09-12T12:26:01.019831+0000","last_active":"2024-09-12T12:26:03.035669+0000","last_peered":"2024-09-12T12:26:03.035669+0000","last_clean":"2024-09-12T12:26:03.035669+0000","last_became_active":"2024-09-12T12:26:01.019171+0000","last_became_peered":"2024-09-12T12:26:01.019171+0000","last_unstale":"2024-09-12T12:26:03.035669+0000","last_undegraded":"2024-09-12T12:26:03.035669+0000","last_fullsized":"2024-09-12T12:26:03.035669+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:11.278849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036151+0000","last_change":"2024-09-12T12:26:02.023518+0000","last_active":"2024-09-12T12:26:03.036151+0000","last_peered":"2024-09-12T12:26:03.036151+0000","last_clean":"2024-09-12T12:26:03.036151+0000","last_became_active":"2024-09-12T12:26:02.023239+0000","last_became_peered":"2024-09-12T12:26:02.023239+0000","last_unstale":"2024-09-12T12:26:03.036151+0000","last_undegraded":"2024-09-12T12:26:03.036151+0000","last_fullsized":"2024-09-12T12:26:03.036151+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:43.399124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036017+0000","last_change":"2024-09-12T12:26:01.020723+0000","last_active":"2024-09-12T12:26:03.036017+0000","last_peered":"2024-09-12T12:26:03.036017+0000","last_clean":"2024-09-12T12:26:03.036017+0000","last_became_active":"2024-09-12T12:26:01.020415+0000","last_became_peered":"2024-09-12T12:26:01.020415+0000","last_unstale":"2024-09-12T12:26:03.036017+0000","last_undegraded":"2024-09-12T12:26:03.036017+0000","last_fullsized":"2024-09-12T12:26:03.036017+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:24.877087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034470+0000","last_change":"2024-09-12T12:26:02.037174+0000","last_active":"2024-09-12T12:26:03.034470+0000","last_peered":"2024-09-12T12:26:03.034470+0000","last_clean":"2024-09-12T12:26:03.034470+0000","last_became_active":"2024-09-12T12:26:02.036787+0000","last_became_peered":"2024-09-12T12:26:02.036787+0000","last_unstale":"2024-09-12T12:26:03.034470+0000","last_undegraded":"2024-09-12T12:26:03.034470+0000","last_fullsized":"2024-09-12T12:26:03.034470+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:04.196342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035817+0000","last_change":"2024-09-12T12:26:01.025031+0000","last_active":"2024-09-12T12:26:03.035817+0000","last_peered":"2024-09-12T12:26:03.035817+0000","last_clean":"2024-09-12T12:26:03.035817+0000","last_became_active":"2024-09-12T12:26:01.024749+0000","last_became_peered":"2024-09-12T12:26:01.024749+0000","last_unstale":"2024-09-12T12:26:03.035817+0000","last_undegraded":"2024-09-12T12:26:03.035817+0000","last_fullsized":"2024-09-12T12:26:03.035817+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:25.738188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142259+0000","last_change":"2024-09-12T12:26:02.037963+0000","last_active":"2024-09-12T12:26:03.142259+0000","last_peered":"2024-09-12T12:26:03.142259+0000","last_clean":"2024-09-12T12:26:03.142259+0000","last_became_active":"2024-09-12T12:26:02.036720+0000","last_became_peered":"2024-09-12T12:26:02.036720+0000","last_unstale":"2024-09-12T12:26:03.142259+0000","last_undegraded":"2024-09-12T12:26:03.142259+0000","last_fullsized":"2024-09-12T12:26:03.142259+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:29.938688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033259+0000","last_change":"2024-09-12T12:26:01.016380+0000","last_active":"2024-09-12T12:26:03.033259+0000","last_peered":"2024-09-12T12:26:03.033259+0000","last_clean":"2024-09-12T12:26:03.033259+0000","last_became_active":"2024-09-12T12:26:01.016097+0000","last_became_peered":"2024-09-12T12:26:01.016097+0000","last_unstale":"2024-09-12T12:26:03.033259+0000","last_undegraded":"2024-09-12T12:26:03.033259+0000","last_fullsized":"2024-09-12T12:26:03.033259+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:48.260847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143107+0000","last_change":"2024-09-12T12:26:02.026860+0000","last_active":"2024-09-12T12:26:03.143107+0000","last_peered":"2024-09-12T12:26:03.143107+0000","last_clean":"2024-09-12T12:26:03.143107+0000","last_became_active":"2024-09-12T12:26:02.026616+0000","last_became_peered":"2024-09-12T12:26:02.026616+0000","last_unstale":"2024-09-12T12:26:03.143107+0000","last_undegraded":"2024-09-12T12:26:03.143107+0000","last_fullsized":"2024-09-12T12:26:03.143107+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:28.750804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.032993+0000","last_change":"2024-09-12T12:26:01.012510+0000","last_active":"2024-09-12T12:26:03.032993+0000","last_peered":"2024-09-12T12:26:03.032993+0000","last_clean":"2024-09-12T12:26:03.032993+0000","last_became_active":"2024-09-12T12:26:01.012265+0000","last_became_peered":"2024-09-12T12:26:01.012265+0000","last_unstale":"2024-09-12T12:26:03.032993+0000","last_undegraded":"2024-09-12T12:26:03.032993+0000","last_fullsized":"2024-09-12T12:26:03.032993+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:28.033511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142448+0000","last_change":"2024-09-12T12:26:02.023018+0000","last_active":"2024-09-12T12:26:03.142448+0000","last_peered":"2024-09-12T12:26:03.142448+0000","last_clean":"2024-09-12T12:26:03.142448+0000","last_became_active":"2024-09-12T12:26:02.019708+0000","last_became_peered":"2024-09-12T12:26:02.019708+0000","last_unstale":"2024-09-12T12:26:03.142448+0000","last_undegraded":"2024-09-12T12:26:03.142448+0000","last_fullsized":"2024-09-12T12:26:03.142448+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:00.335667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141658+0000","last_change":"2024-09-12T12:26:01.018864+0000","last_active":"2024-09-12T12:26:03.141658+0000","last_peered":"2024-09-12T12:26:03.141658+0000","last_clean":"2024-09-12T12:26:03.141658+0000","last_became_active":"2024-09-12T12:26:01.018424+0000","last_became_peered":"2024-09-12T12:26:01.018424+0000","last_unstale":"2024-09-12T12:26:03.141658+0000","last_undegraded":"2024-09-12T12:26:03.141658+0000","last_fullsized":"2024-09-12T12:26:03.141658+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:36.853448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142252+0000","last_change":"2024-09-12T12:26:02.027622+0000","last_active":"2024-09-12T12:26:03.142252+0000","last_peered":"2024-09-12T12:26:03.142252+0000","last_clean":"2024-09-12T12:26:03.142252+0000","last_became_active":"2024-09-12T12:26:02.027283+0000","last_became_peered":"2024-09-12T12:26:02.027283+0000","last_unstale":"2024-09-12T12:26:03.142252+0000","last_undegraded":"2024-09-12T12:26:03.142252+0000","last_fullsized":"2024-09-12T12:26:03.142252+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:46.343290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036270+0000","last_change":"2024-09-12T12:26:01.010805+0000","last_active":"2024-09-12T12:26:03.036270+0000","last_peered":"2024-09-12T12:26:03.036270+0000","last_clean":"2024-09-12T12:26:03.036270+0000","last_became_active":"2024-09-12T12:26:01.010504+0000","last_became_peered":"2024-09-12T12:26:01.010504+0000","last_unstale":"2024-09-12T12:26:03.036270+0000","last_undegraded":"2024-09-12T12:26:03.036270+0000","last_fullsized":"2024-09-12T12:26:03.036270+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:53.349223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142693+0000","last_change":"2024-09-12T12:26:02.042865+0000","last_active":"2024-09-12T12:26:03.142693+0000","last_peered":"2024-09-12T12:26:03.142693+0000","last_clean":"2024-09-12T12:26:03.142693+0000","last_became_active":"2024-09-12T12:26:02.042162+0000","last_became_peered":"2024-09-12T12:26:02.042162+0000","last_unstale":"2024-09-12T12:26:03.142693+0000","last_undegraded":"2024-09-12T12:26:03.142693+0000","last_fullsized":"2024-09-12T12:26:03.142693+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:56.591240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"202'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.040489+0000","last_change":"2024-09-12T12:26:01.007714+0000","last_active":"2024-09-12T12:26:03.040489+0000","last_peered":"2024-09-12T12:26:03.040489+0000","last_clean":"2024-09-12T12:26:03.040489+0000","last_became_active":"2024-09-12T12:26:01.007468+0000","last_became_peered":"2024-09-12T12:26:01.007468+0000","last_unstale":"2024-09-12T12:26:03.040489+0000","last_undegraded":"2024-09-12T12:26:03.040489+0000","last_fullsized":"2024-09-12T12:26:03.040489+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:58.897158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035942+0000","last_change":"2024-09-12T12:26:02.040809+0000","last_active":"2024-09-12T12:26:03.035942+0000","last_peered":"2024-09-12T12:26:03.035942+0000","last_clean":"2024-09-12T12:26:03.035942+0000","last_became_active":"2024-09-12T12:26:02.040166+0000","last_became_peered":"2024-09-12T12:26:02.040166+0000","last_unstale":"2024-09-12T12:26:03.035942+0000","last_undegraded":"2024-09-12T12:26:03.035942+0000","last_fullsized":"2024-09-12T12:26:03.035942+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:17:31.784769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033520+0000","last_change":"2024-09-12T12:26:01.014696+0000","last_active":"2024-09-12T12:26:03.033520+0000","last_peered":"2024-09-12T12:26:03.033520+0000","last_clean":"2024-09-12T12:26:03.033520+0000","last_became_active":"2024-09-12T12:26:01.014279+0000","last_became_peered":"2024-09-12T12:26:01.014279+0000","last_unstale":"2024-09-12T12:26:03.033520+0000","last_undegraded":"2024-09-12T12:26:03.033520+0000","last_fullsized":"2024-09-12T12:26:03.033520+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:21:15.242038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143236+0000","last_change":"2024-09-12T12:26:02.030345+0000","last_active":"2024-09-12T12:26:03.143236+0000","last_peered":"2024-09-12T12:26:03.143236+0000","last_clean":"2024-09-12T12:26:03.143236+0000","last_became_active":"2024-09-12T12:26:02.030087+0000","last_became_peered":"2024-09-12T12:26:02.030087+0000","last_unstale":"2024-09-12T12:26:03.143236+0000","last_undegraded":"2024-09-12T12:26:03.143236+0000","last_fullsized":"2024-09-12T12:26:03.143236+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:51.591600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036154+0000","last_change":"2024-09-12T12:26:01.024924+0000","last_active":"2024-09-12T12:26:03.036154+0000","last_peered":"2024-09-12T12:26:03.036154+0000","last_clean":"2024-09-12T12:26:03.036154+0000","last_became_active":"2024-09-12T12:26:01.024639+0000","last_became_peered":"2024-09-12T12:26:01.024639+0000","last_unstale":"2024-09-12T12:26:03.036154+0000","last_undegraded":"2024-09-12T12:26:03.036154+0000","last_fullsized":"2024-09-12T12:26:03.036154+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:18.685647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141961+0000","last_change":"2024-09-12T12:26:02.020085+0000","last_active":"2024-09-12T12:26:03.141961+0000","last_peered":"2024-09-12T12:26:03.141961+0000","last_clean":"2024-09-12T12:26:03.141961+0000","last_became_active":"2024-09-12T12:26:02.019812+0000","last_became_peered":"2024-09-12T12:26:02.019812+0000","last_unstale":"2024-09-12T12:26:03.141961+0000","last_undegraded":"2024-09-12T12:26:03.141961+0000","last_fullsized":"2024-09-12T12:26:03.141961+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:56.826211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035936+0000","last_change":"2024-09-12T12:26:01.011009+0000","last_active":"2024-09-12T12:26:03.035936+0000","last_peered":"2024-09-12T12:26:03.035936+0000","last_clean":"2024-09-12T12:26:03.035936+0000","last_became_active":"2024-09-12T12:26:01.010694+0000","last_became_peered":"2024-09-12T12:26:01.010694+0000","last_unstale":"2024-09-12T12:26:03.035936+0000","last_undegraded":"2024-09-12T12:26:03.035936+0000","last_fullsized":"2024-09-12T12:26:03.035936+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:29:04.454270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142249+0000","last_change":"2024-09-12T12:26:02.020220+0000","last_active":"2024-09-12T12:26:03.142249+0000","last_peered":"2024-09-12T12:26:03.142249+0000","last_clean":"2024-09-12T12:26:03.142249+0000","last_became_active":"2024-09-12T12:26:02.019924+0000","last_became_peered":"2024-09-12T12:26:02.019924+0000","last_unstale":"2024-09-12T12:26:03.142249+0000","last_undegraded":"2024-09-12T12:26:03.142249+0000","last_fullsized":"2024-09-12T12:26:03.142249+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:33.652797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041363+0000","last_change":"2024-09-12T12:26:01.006185+0000","last_active":"2024-09-12T12:26:03.041363+0000","last_peered":"2024-09-12T12:26:03.041363+0000","last_clean":"2024-09-12T12:26:03.041363+0000","last_became_active":"2024-09-12T12:26:01.005933+0000","last_became_peered":"2024-09-12T12:26:01.005933+0000","last_unstale":"2024-09-12T12:26:03.041363+0000","last_undegraded":"2024-09-12T12:26:03.041363+0000","last_fullsized":"2024-09-12T12:26:03.041363+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:44.343900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141949+0000","last_change":"2024-09-12T12:26:02.025048+0000","last_active":"2024-09-12T12:26:03.141949+0000","last_peered":"2024-09-12T12:26:03.141949+0000","last_clean":"2024-09-12T12:26:03.141949+0000","last_became_active":"2024-09-12T12:26:02.024788+0000","last_became_peered":"2024-09-12T12:26:02.024788+0000","last_unstale":"2024-09-12T12:26:03.141949+0000","last_undegraded":"2024-09-12T12:26:03.141949+0000","last_fullsized":"2024-09-12T12:26:03.141949+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:39.107161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142391+0000","last_change":"2024-09-12T12:26:01.018019+0000","last_active":"2024-09-12T12:26:03.142391+0000","last_peered":"2024-09-12T12:26:03.142391+0000","last_clean":"2024-09-12T12:26:03.142391+0000","last_became_active":"2024-09-12T12:26:01.017730+0000","last_became_peered":"2024-09-12T12:26:01.017730+0000","last_unstale":"2024-09-12T12:26:03.142391+0000","last_undegraded":"2024-09-12T12:26:03.142391+0000","last_fullsized":"2024-09-12T12:26:03.142391+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:10.854712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035774+0000","last_change":"2024-09-12T12:26:02.020873+0000","last_active":"2024-09-12T12:26:03.035774+0000","last_peered":"2024-09-12T12:26:03.035774+0000","last_clean":"2024-09-12T12:26:03.035774+0000","last_became_active":"2024-09-12T12:26:02.020254+0000","last_became_peered":"2024-09-12T12:26:02.020254+0000","last_unstale":"2024-09-12T12:26:03.035774+0000","last_undegraded":"2024-09-12T12:26:03.035774+0000","last_fullsized":"2024-09-12T12:26:03.035774+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:07.389505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034766+0000","last_change":"2024-09-12T12:26:01.003604+0000","last_active":"2024-09-12T12:26:03.034766+0000","last_peered":"2024-09-12T12:26:03.034766+0000","last_clean":"2024-09-12T12:26:03.034766+0000","last_became_active":"2024-09-12T12:26:01.003294+0000","last_became_peered":"2024-09-12T12:26:01.003294+0000","last_unstale":"2024-09-12T12:26:03.034766+0000","last_undegraded":"2024-09-12T12:26:03.034766+0000","last_fullsized":"2024-09-12T12:26:03.034766+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:33.794192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142706+0000","last_change":"2024-09-12T12:26:02.027110+0000","last_active":"2024-09-12T12:26:03.142706+0000","last_peered":"2024-09-12T12:26:03.142706+0000","last_clean":"2024-09-12T12:26:03.142706+0000","last_became_active":"2024-09-12T12:26:02.026840+0000","last_became_peered":"2024-09-12T12:26:02.026840+0000","last_unstale":"2024-09-12T12:26:03.142706+0000","last_undegraded":"2024-09-12T12:26:03.142706+0000","last_fullsized":"2024-09-12T12:26:03.142706+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:27.236594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142511+0000","last_change":"2024-09-12T12:26:01.025006+0000","last_active":"2024-09-12T12:26:03.142511+0000","last_peered":"2024-09-12T12:26:03.142511+0000","last_clean":"2024-09-12T12:26:03.142511+0000","last_became_active":"2024-09-12T12:26:01.023806+0000","last_became_peered":"2024-09-12T12:26:01.023806+0000","last_unstale":"2024-09-12T12:26:03.142511+0000","last_undegraded":"2024-09-12T12:26:03.142511+0000","last_fullsized":"2024-09-12T12:26:03.142511+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:11.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":504,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142234+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:26:03.142234+0000","last_peered":"2024-09-12T12:26:03.142234+0000","last_clean":"2024-09-12T12:26:03.142234+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:26:03.142234+0000","last_undegraded":"2024-09-12T12:26:03.142234+0000","last_fullsized":"2024-09-12T12:26:03.142234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52324,"kb_used_data":3080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319516,"statfs":{"total":96636764160,"available":96583184384,"internally_reserved":0,"allocated":3153920,"data_stored":1799989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575013,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55912,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315928,"statfs":{"total":96636764160,"available":96579510272,"internally_reserved":0,"allocated":2576384,"data_stored":1210687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575013,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51744,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320096,"statfs":{"total":96636764160,"available":96583778304,"internally_reserved":0,"allocated":2568192,"data_stored":1210631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575013,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60056,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311784,"statfs":{"total":96636764160,"available":96575266816,"internally_reserved":0,"allocated":2555904,"data_stored":1209039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64220,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307620,"statfs":{"total":96636764160,"available":96571002880,"internally_reserved":0,"allocated":2555904,"data_stored":1208971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":63175112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60060,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311780,"statfs":{"total":96636764160,"available":96575262720,"internally_reserved":0,"allocated":2560000,"data_stored":1209565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575014,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60052,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311788,"statfs":{"total":96636764160,"available":96575270912,"internally_reserved":0,"allocated":2551808,"data_stored":1208949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575015,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56468,"kb_used_data":3072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315372,"statfs":{"total":96636764160,"available":96578940928,"internally_reserved":0,"allocated":3145728,"data_stored":1799317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:26:06.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:26:06.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.294+0000 7f112fc00640 1 Processor -- start 2024-09-12T12:26:06.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.294+0000 7f112fc00640 1 -- start start 2024-09-12T12:26:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 0x7f11280b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112fc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f11280b5de0 0x7f1128072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112fc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11280cd870 con 0x7f112815c7b0 2024-09-12T12:26:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112fc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1128072a50 con 0x7f11280b5de0 2024-09-12T12:26:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f11280cde30 con 0x7f112815cd30 2024-09-12T12:26:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112d200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f112815c7b0 0x7f11280ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58480/0 (socket says 172.21.15.144:58480) 2024-09-12T12:26:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112d200640 1 -- 172.21.15.144:0/3729293941 learned_addr learned my addr 172.21.15.144:0/3729293941 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:06.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112dc00640 1 --2- 172.21.15.144:0/3729293941 >> v2:172.21.15.144:3300/0 conn(0x7f11280b5de0 0x7f1128072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f1127e00640 1 --2- 172.21.15.144:0/3729293941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 0x7f11280b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f1127400640 1 -- 172.21.15.144:0/3729293941 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177342674 0 0) 0x7f11280cd870 con 0x7f112815c7b0 2024-09-12T12:26:06.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f1127400640 1 -- 172.21.15.144:0/3729293941 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f110c003530 con 0x7f112815c7b0 2024-09-12T12:26:06.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112dc00640 1 -- 172.21.15.144:0/3729293941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 msgr2=0x7f11280b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:06.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112dc00640 1 --2- 172.21.15.144:0/3729293941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 0x7f11280b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112dc00640 1 -- 172.21.15.144:0/3729293941 >> v1:172.21.15.144:6789/0 conn(0x7f112815c7b0 legacy=0x7f11280ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112dc00640 1 -- 172.21.15.144:0/3729293941 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11280cdb50 con 0x7f11280b5de0 2024-09-12T12:26:06.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f1127e00640 1 --2- 172.21.15.144:0/3729293941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 0x7f11280b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:06.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.298+0000 7f112dc00640 1 --2- 172.21.15.144:0/3729293941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 0x7f1128072ee0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f11200097c0 tx=0x7f112001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0f1eac0d13a173 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:06.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f1127400640 1 -- 172.21.15.144:0/3729293941 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11200b0070 con 0x7f11280b5de0 2024-09-12T12:26:06.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f1127400640 1 -- 172.21.15.144:0/3729293941 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11200ab600 con 0x7f11280b5de0 2024-09-12T12:26:06.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f1127400640 1 -- 172.21.15.144:0/3729293941 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11200ab9b0 con 0x7f11280b5de0 2024-09-12T12:26:06.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 -- 172.21.15.144:0/3729293941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 msgr2=0x7f1128072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 --2- 172.21.15.144:0/3729293941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 0x7f1128072ee0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f11200097c0 tx=0x7f112001c4a0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 -- 172.21.15.144:0/3729293941 shutdown_connections 2024-09-12T12:26:06.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 --2- 172.21.15.144:0/3729293941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 0x7f1128072ee0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 --2- 172.21.15.144:0/3729293941 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 0x7f11280b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 -- 172.21.15.144:0/3729293941 >> 172.21.15.144:0/3729293941 conn(0x7f112806d0d0 msgr2=0x7f112806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 -- 172.21.15.144:0/3729293941 shutdown_connections 2024-09-12T12:26:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 -- 172.21.15.144:0/3729293941 wait complete. 2024-09-12T12:26:06.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 Processor -- start 2024-09-12T12:26:06.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 -- start start 2024-09-12T12:26:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 0x7f1128155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f112815c7b0 0x7f112814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 0x7f1128157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1128073fc0 con 0x7f11280b5de0 2024-09-12T12:26:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1128073e40 con 0x7f112815c7b0 2024-09-12T12:26:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1128074140 con 0x7f112815cd30 2024-09-12T12:26:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 0x7f1128155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 0x7f1128155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43254/0 (socket says 172.21.15.144:43254) 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112d200640 1 -- 172.21.15.144:0/3351818957 learned_addr learned my addr 172.21.15.144:0/3351818957 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f1127e00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f112815c7b0 0x7f112814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.302+0000 7f112dc00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 0x7f1128157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f112d200640 1 -- 172.21.15.144:0/3351818957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 msgr2=0x7f1128157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f112d200640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 0x7f1128157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f112d200640 1 -- 172.21.15.144:0/3351818957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f112815c7b0 msgr2=0x7f112814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f112d200640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f112815c7b0 0x7f112814f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f112d200640 1 -- 172.21.15.144:0/3351818957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1128156af0 con 0x7f11280b5de0 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f112d200640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 0x7f1128155980 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f111800cb70 tx=0x7f111800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f1124c00640 1 -- 172.21.15.144:0/3351818957 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118017070 con 0x7f11280b5de0 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f1124c00640 1 -- 172.21.15.144:0/3351818957 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111800ad40 con 0x7f11280b5de0 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1128156dd0 con 0x7f11280b5de0 2024-09-12T12:26:06.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f1124c00640 1 -- 172.21.15.144:0/3351818957 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118012620 con 0x7f11280b5de0 2024-09-12T12:26:06.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1128157390 con 0x7f11280b5de0 2024-09-12T12:26:06.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1128072ee0 con 0x7f11280b5de0 2024-09-12T12:26:06.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f1124c00640 1 -- 172.21.15.144:0/3351818957 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f111801a070 con 0x7f11280b5de0 2024-09-12T12:26:06.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f1124c00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11080678c0 0x7f1108069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f1124c00640 1 -- 172.21.15.144:0/3351818957 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f1118085d10 con 0x7f11280b5de0 2024-09-12T12:26:06.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.306+0000 7f1127e00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11080678c0 0x7f1108069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.310+0000 7f1127e00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11080678c0 0x7f1108069d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f112806d080 tx=0x7f1114008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:06.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.310+0000 7f1124c00640 1 -- 172.21.15.144:0/3351818957 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f111808b020 con 0x7f11280b5de0 2024-09-12T12:26:06.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.466+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11281568a0 con 0x7f11080678c0 2024-09-12T12:26:06.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.474+0000 7f1124c00640 1 -- 172.21.15.144:0/3351818957 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252487 (secure 0 0 0) 0x7f11281568a0 con 0x7f11080678c0 2024-09-12T12:26:06.477 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:06.479 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:26:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.474+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11080678c0 msgr2=0x7f1108069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.474+0000 7f112fc00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11080678c0 0x7f1108069d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f112806d080 tx=0x7f1114008040 comp rx=0 tx=0).stop 2024-09-12T12:26:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.474+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 msgr2=0x7f1128155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.474+0000 7f112fc00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 0x7f1128155980 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f111800cb70 tx=0x7f111800a430 comp rx=0 tx=0).stop 2024-09-12T12:26:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.478+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 shutdown_connections 2024-09-12T12:26:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.478+0000 7f112fc00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f11080678c0 0x7f1108069d80 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.478+0000 7f112fc00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f112815cd30 0x7f1128157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.478+0000 7f112fc00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f112815c7b0 0x7f112814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.478+0000 7f112fc00640 1 --2- 172.21.15.144:0/3351818957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11280b5de0 0x7f1128155980 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.478+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 >> 172.21.15.144:0/3351818957 conn(0x7f112806d0d0 msgr2=0x7f11281527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:06.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.478+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 shutdown_connections 2024-09-12T12:26:06.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.478+0000 7f112fc00640 1 -- 172.21.15.144:0/3351818957 wait complete. 2024-09-12T12:26:06.498 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":601,"stamp":"2024-09-12T12:26:05.550049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":460836,"kb_used_data":21160,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754513884,"statfs":{"total":773094113280,"available":772622217216,"internally_reserved":0,"allocated":21667840,"data_stored":10857148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":450022961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.552449"},"pg_stats":[{"pgid":"30.3f","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142555+0000","last_change":"2024-09-12T12:26:02.044836+0000","last_active":"2024-09-12T12:26:03.142555+0000","last_peered":"2024-09-12T12:26:03.142555+0000","last_clean":"2024-09-12T12:26:03.142555+0000","last_became_active":"2024-09-12T12:26:02.043992+0000","last_became_peered":"2024-09-12T12:26:02.043992+0000","last_unstale":"2024-09-12T12:26:03.142555+0000","last_undegraded":"2024-09-12T12:26:03.142555+0000","last_fullsized":"2024-09-12T12:26:03.142555+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:45:54.695167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3e","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143026+0000","last_change":"2024-09-12T12:26:02.034683+0000","last_active":"2024-09-12T12:26:03.143026+0000","last_peered":"2024-09-12T12:26:03.143026+0000","last_clean":"2024-09-12T12:26:03.143026+0000","last_became_active":"2024-09-12T12:26:02.034335+0000","last_became_peered":"2024-09-12T12:26:02.034335+0000","last_unstale":"2024-09-12T12:26:03.143026+0000","last_undegraded":"2024-09-12T12:26:03.143026+0000","last_fullsized":"2024-09-12T12:26:03.143026+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:16:38.003912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.3d","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142483+0000","last_change":"2024-09-12T12:26:02.029011+0000","last_active":"2024-09-12T12:26:03.142483+0000","last_peered":"2024-09-12T12:26:03.142483+0000","last_clean":"2024-09-12T12:26:03.142483+0000","last_became_active":"2024-09-12T12:26:02.028730+0000","last_became_peered":"2024-09-12T12:26:02.028730+0000","last_unstale":"2024-09-12T12:26:03.142483+0000","last_undegraded":"2024-09-12T12:26:03.142483+0000","last_fullsized":"2024-09-12T12:26:03.142483+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:06.077320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.3c","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041537+0000","last_change":"2024-09-12T12:26:02.038923+0000","last_active":"2024-09-12T12:26:03.041537+0000","last_peered":"2024-09-12T12:26:03.041537+0000","last_clean":"2024-09-12T12:26:03.041537+0000","last_became_active":"2024-09-12T12:26:02.038662+0000","last_became_peered":"2024-09-12T12:26:02.038662+0000","last_unstale":"2024-09-12T12:26:03.041537+0000","last_undegraded":"2024-09-12T12:26:03.041537+0000","last_fullsized":"2024-09-12T12:26:03.041537+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:31.855236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.3b","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142366+0000","last_change":"2024-09-12T12:26:02.041430+0000","last_active":"2024-09-12T12:26:03.142366+0000","last_peered":"2024-09-12T12:26:03.142366+0000","last_clean":"2024-09-12T12:26:03.142366+0000","last_became_active":"2024-09-12T12:26:02.041137+0000","last_became_peered":"2024-09-12T12:26:02.041137+0000","last_unstale":"2024-09-12T12:26:03.142366+0000","last_undegraded":"2024-09-12T12:26:03.142366+0000","last_fullsized":"2024-09-12T12:26:03.142366+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:43.399124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3a","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035535+0000","last_change":"2024-09-12T12:26:02.037881+0000","last_active":"2024-09-12T12:26:03.035535+0000","last_peered":"2024-09-12T12:26:03.035535+0000","last_clean":"2024-09-12T12:26:03.035535+0000","last_became_active":"2024-09-12T12:26:02.036210+0000","last_became_peered":"2024-09-12T12:26:02.036210+0000","last_unstale":"2024-09-12T12:26:03.035535+0000","last_undegraded":"2024-09-12T12:26:03.035535+0000","last_fullsized":"2024-09-12T12:26:03.035535+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:49.269651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.39","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142018+0000","last_change":"2024-09-12T12:26:02.037597+0000","last_active":"2024-09-12T12:26:03.142018+0000","last_peered":"2024-09-12T12:26:03.142018+0000","last_clean":"2024-09-12T12:26:03.142018+0000","last_became_active":"2024-09-12T12:26:02.037328+0000","last_became_peered":"2024-09-12T12:26:02.037328+0000","last_unstale":"2024-09-12T12:26:03.142018+0000","last_undegraded":"2024-09-12T12:26:03.142018+0000","last_fullsized":"2024-09-12T12:26:03.142018+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:51.843984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.38","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034380+0000","last_change":"2024-09-12T12:26:02.039252+0000","last_active":"2024-09-12T12:26:03.034380+0000","last_peered":"2024-09-12T12:26:03.034380+0000","last_clean":"2024-09-12T12:26:03.034380+0000","last_became_active":"2024-09-12T12:26:02.038512+0000","last_became_peered":"2024-09-12T12:26:02.038512+0000","last_unstale":"2024-09-12T12:26:03.034380+0000","last_undegraded":"2024-09-12T12:26:03.034380+0000","last_fullsized":"2024-09-12T12:26:03.034380+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:11.863516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.37","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143283+0000","last_change":"2024-09-12T12:26:02.025684+0000","last_active":"2024-09-12T12:26:03.143283+0000","last_peered":"2024-09-12T12:26:03.143283+0000","last_clean":"2024-09-12T12:26:03.143283+0000","last_became_active":"2024-09-12T12:26:02.025371+0000","last_became_peered":"2024-09-12T12:26:02.025371+0000","last_unstale":"2024-09-12T12:26:03.143283+0000","last_undegraded":"2024-09-12T12:26:03.143283+0000","last_fullsized":"2024-09-12T12:26:03.143283+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:44.272828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.36","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142541+0000","last_change":"2024-09-12T12:26:02.036038+0000","last_active":"2024-09-12T12:26:03.142541+0000","last_peered":"2024-09-12T12:26:03.142541+0000","last_clean":"2024-09-12T12:26:03.142541+0000","last_became_active":"2024-09-12T12:26:02.035739+0000","last_became_peered":"2024-09-12T12:26:02.035739+0000","last_unstale":"2024-09-12T12:26:03.142541+0000","last_undegraded":"2024-09-12T12:26:03.142541+0000","last_fullsized":"2024-09-12T12:26:03.142541+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:47.042085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.35","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041678+0000","last_change":"2024-09-12T12:26:02.031249+0000","last_active":"2024-09-12T12:26:03.041678+0000","last_peered":"2024-09-12T12:26:03.041678+0000","last_clean":"2024-09-12T12:26:03.041678+0000","last_became_active":"2024-09-12T12:26:02.030850+0000","last_became_peered":"2024-09-12T12:26:02.030850+0000","last_unstale":"2024-09-12T12:26:03.041678+0000","last_undegraded":"2024-09-12T12:26:03.041678+0000","last_fullsized":"2024-09-12T12:26:03.041678+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:23.540773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.34","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035740+0000","last_change":"2024-09-12T12:26:02.037833+0000","last_active":"2024-09-12T12:26:03.035740+0000","last_peered":"2024-09-12T12:26:03.035740+0000","last_clean":"2024-09-12T12:26:03.035740+0000","last_became_active":"2024-09-12T12:26:02.037564+0000","last_became_peered":"2024-09-12T12:26:02.037564+0000","last_unstale":"2024-09-12T12:26:03.035740+0000","last_undegraded":"2024-09-12T12:26:03.035740+0000","last_fullsized":"2024-09-12T12:26:03.035740+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:29.042316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.33","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034785+0000","last_change":"2024-09-12T12:26:02.037147+0000","last_active":"2024-09-12T12:26:03.034785+0000","last_peered":"2024-09-12T12:26:03.034785+0000","last_clean":"2024-09-12T12:26:03.034785+0000","last_became_active":"2024-09-12T12:26:02.036649+0000","last_became_peered":"2024-09-12T12:26:02.036649+0000","last_unstale":"2024-09-12T12:26:03.034785+0000","last_undegraded":"2024-09-12T12:26:03.034785+0000","last_fullsized":"2024-09-12T12:26:03.034785+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:07.438081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.32","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035815+0000","last_change":"2024-09-12T12:26:02.029118+0000","last_active":"2024-09-12T12:26:03.035815+0000","last_peered":"2024-09-12T12:26:03.035815+0000","last_clean":"2024-09-12T12:26:03.035815+0000","last_became_active":"2024-09-12T12:26:02.028037+0000","last_became_peered":"2024-09-12T12:26:02.028037+0000","last_unstale":"2024-09-12T12:26:03.035815+0000","last_undegraded":"2024-09-12T12:26:03.035815+0000","last_fullsized":"2024-09-12T12:26:03.035815+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:21:16.250842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.31","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033018+0000","last_change":"2024-09-12T12:26:02.023964+0000","last_active":"2024-09-12T12:26:03.033018+0000","last_peered":"2024-09-12T12:26:03.033018+0000","last_clean":"2024-09-12T12:26:03.033018+0000","last_became_active":"2024-09-12T12:26:02.023529+0000","last_became_peered":"2024-09-12T12:26:02.023529+0000","last_unstale":"2024-09-12T12:26:03.033018+0000","last_undegraded":"2024-09-12T12:26:03.033018+0000","last_fullsized":"2024-09-12T12:26:03.033018+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:46.738720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.30","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034911+0000","last_change":"2024-09-12T12:26:02.033884+0000","last_active":"2024-09-12T12:26:03.034911+0000","last_peered":"2024-09-12T12:26:03.034911+0000","last_clean":"2024-09-12T12:26:03.034911+0000","last_became_active":"2024-09-12T12:26:02.033490+0000","last_became_peered":"2024-09-12T12:26:02.033490+0000","last_unstale":"2024-09-12T12:26:03.034911+0000","last_undegraded":"2024-09-12T12:26:03.034911+0000","last_fullsized":"2024-09-12T12:26:03.034911+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:27.649564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2f","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036201+0000","last_change":"2024-09-12T12:26:02.039540+0000","last_active":"2024-09-12T12:26:03.036201+0000","last_peered":"2024-09-12T12:26:03.036201+0000","last_clean":"2024-09-12T12:26:03.036201+0000","last_became_active":"2024-09-12T12:26:02.039230+0000","last_became_peered":"2024-09-12T12:26:02.039230+0000","last_unstale":"2024-09-12T12:26:03.036201+0000","last_undegraded":"2024-09-12T12:26:03.036201+0000","last_fullsized":"2024-09-12T12:26:03.036201+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:04.264555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.2e","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142733+0000","last_change":"2024-09-12T12:26:02.024313+0000","last_active":"2024-09-12T12:26:03.142733+0000","last_peered":"2024-09-12T12:26:03.142733+0000","last_clean":"2024-09-12T12:26:03.142733+0000","last_became_active":"2024-09-12T12:26:02.023887+0000","last_became_peered":"2024-09-12T12:26:02.023887+0000","last_unstale":"2024-09-12T12:26:03.142733+0000","last_undegraded":"2024-09-12T12:26:03.142733+0000","last_fullsized":"2024-09-12T12:26:03.142733+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:29.727402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2d","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142519+0000","last_change":"2024-09-12T12:26:02.042442+0000","last_active":"2024-09-12T12:26:03.142519+0000","last_peered":"2024-09-12T12:26:03.142519+0000","last_clean":"2024-09-12T12:26:03.142519+0000","last_became_active":"2024-09-12T12:26:02.041601+0000","last_became_peered":"2024-09-12T12:26:02.041601+0000","last_unstale":"2024-09-12T12:26:03.142519+0000","last_undegraded":"2024-09-12T12:26:03.142519+0000","last_fullsized":"2024-09-12T12:26:03.142519+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:10.953620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.2c","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035268+0000","last_change":"2024-09-12T12:26:02.034753+0000","last_active":"2024-09-12T12:26:03.035268+0000","last_peered":"2024-09-12T12:26:03.035268+0000","last_clean":"2024-09-12T12:26:03.035268+0000","last_became_active":"2024-09-12T12:26:02.034483+0000","last_became_peered":"2024-09-12T12:26:02.034483+0000","last_unstale":"2024-09-12T12:26:03.035268+0000","last_undegraded":"2024-09-12T12:26:03.035268+0000","last_fullsized":"2024-09-12T12:26:03.035268+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:04.196342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.2b","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141905+0000","last_change":"2024-09-12T12:26:02.025670+0000","last_active":"2024-09-12T12:26:03.141905+0000","last_peered":"2024-09-12T12:26:03.141905+0000","last_clean":"2024-09-12T12:26:03.141905+0000","last_became_active":"2024-09-12T12:26:02.025398+0000","last_became_peered":"2024-09-12T12:26:02.025398+0000","last_unstale":"2024-09-12T12:26:03.141905+0000","last_undegraded":"2024-09-12T12:26:03.141905+0000","last_fullsized":"2024-09-12T12:26:03.141905+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:49.798793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.2a","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033098+0000","last_change":"2024-09-12T12:26:02.036640+0000","last_active":"2024-09-12T12:26:03.033098+0000","last_peered":"2024-09-12T12:26:03.033098+0000","last_clean":"2024-09-12T12:26:03.033098+0000","last_became_active":"2024-09-12T12:26:02.036345+0000","last_became_peered":"2024-09-12T12:26:02.036345+0000","last_unstale":"2024-09-12T12:26:03.033098+0000","last_undegraded":"2024-09-12T12:26:03.033098+0000","last_fullsized":"2024-09-12T12:26:03.033098+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:12.565206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.29","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141671+0000","last_change":"2024-09-12T12:26:02.021505+0000","last_active":"2024-09-12T12:26:03.141671+0000","last_peered":"2024-09-12T12:26:03.141671+0000","last_clean":"2024-09-12T12:26:03.141671+0000","last_became_active":"2024-09-12T12:26:02.021214+0000","last_became_peered":"2024-09-12T12:26:02.021214+0000","last_unstale":"2024-09-12T12:26:03.141671+0000","last_undegraded":"2024-09-12T12:26:03.141671+0000","last_fullsized":"2024-09-12T12:26:03.141671+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:19.457359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.28","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142381+0000","last_change":"2024-09-12T12:26:02.039990+0000","last_active":"2024-09-12T12:26:03.142381+0000","last_peered":"2024-09-12T12:26:03.142381+0000","last_clean":"2024-09-12T12:26:03.142381+0000","last_became_active":"2024-09-12T12:26:02.039747+0000","last_became_peered":"2024-09-12T12:26:02.039747+0000","last_unstale":"2024-09-12T12:26:03.142381+0000","last_undegraded":"2024-09-12T12:26:03.142381+0000","last_fullsized":"2024-09-12T12:26:03.142381+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:04.264555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.27","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142576+0000","last_change":"2024-09-12T12:26:02.045973+0000","last_active":"2024-09-12T12:26:03.142576+0000","last_peered":"2024-09-12T12:26:03.142576+0000","last_clean":"2024-09-12T12:26:03.142576+0000","last_became_active":"2024-09-12T12:26:02.045554+0000","last_became_peered":"2024-09-12T12:26:02.045554+0000","last_unstale":"2024-09-12T12:26:03.142576+0000","last_undegraded":"2024-09-12T12:26:03.142576+0000","last_fullsized":"2024-09-12T12:26:03.142576+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:46.738720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.26","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142719+0000","last_change":"2024-09-12T12:26:02.020020+0000","last_active":"2024-09-12T12:26:03.142719+0000","last_peered":"2024-09-12T12:26:03.142719+0000","last_clean":"2024-09-12T12:26:03.142719+0000","last_became_active":"2024-09-12T12:26:02.019747+0000","last_became_peered":"2024-09-12T12:26:02.019747+0000","last_unstale":"2024-09-12T12:26:03.142719+0000","last_undegraded":"2024-09-12T12:26:03.142719+0000","last_fullsized":"2024-09-12T12:26:03.142719+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:48.709394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.25","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041717+0000","last_change":"2024-09-12T12:26:02.021382+0000","last_active":"2024-09-12T12:26:03.041717+0000","last_peered":"2024-09-12T12:26:03.041717+0000","last_clean":"2024-09-12T12:26:03.041717+0000","last_became_active":"2024-09-12T12:26:02.020628+0000","last_became_peered":"2024-09-12T12:26:02.020628+0000","last_unstale":"2024-09-12T12:26:03.041717+0000","last_undegraded":"2024-09-12T12:26:03.041717+0000","last_fullsized":"2024-09-12T12:26:03.041717+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:28.139872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.24","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036019+0000","last_change":"2024-09-12T12:26:02.027624+0000","last_active":"2024-09-12T12:26:03.036019+0000","last_peered":"2024-09-12T12:26:03.036019+0000","last_clean":"2024-09-12T12:26:03.036019+0000","last_became_active":"2024-09-12T12:26:02.027324+0000","last_became_peered":"2024-09-12T12:26:02.027324+0000","last_unstale":"2024-09-12T12:26:03.036019+0000","last_undegraded":"2024-09-12T12:26:03.036019+0000","last_fullsized":"2024-09-12T12:26:03.036019+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:59.905962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.23","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142249+0000","last_change":"2024-09-12T12:26:02.033843+0000","last_active":"2024-09-12T12:26:03.142249+0000","last_peered":"2024-09-12T12:26:03.142249+0000","last_clean":"2024-09-12T12:26:03.142249+0000","last_became_active":"2024-09-12T12:26:02.033399+0000","last_became_peered":"2024-09-12T12:26:02.033399+0000","last_unstale":"2024-09-12T12:26:03.142249+0000","last_undegraded":"2024-09-12T12:26:03.142249+0000","last_fullsized":"2024-09-12T12:26:03.142249+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:09.056834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.22","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035239+0000","last_change":"2024-09-12T12:26:02.040081+0000","last_active":"2024-09-12T12:26:03.035239+0000","last_peered":"2024-09-12T12:26:03.035239+0000","last_clean":"2024-09-12T12:26:03.035239+0000","last_became_active":"2024-09-12T12:26:02.039354+0000","last_became_peered":"2024-09-12T12:26:02.039354+0000","last_unstale":"2024-09-12T12:26:03.035239+0000","last_undegraded":"2024-09-12T12:26:03.035239+0000","last_fullsized":"2024-09-12T12:26:03.035239+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:51.799175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.21","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141723+0000","last_change":"2024-09-12T12:26:02.028348+0000","last_active":"2024-09-12T12:26:03.141723+0000","last_peered":"2024-09-12T12:26:03.141723+0000","last_clean":"2024-09-12T12:26:03.141723+0000","last_became_active":"2024-09-12T12:26:02.028098+0000","last_became_peered":"2024-09-12T12:26:02.028098+0000","last_unstale":"2024-09-12T12:26:03.141723+0000","last_undegraded":"2024-09-12T12:26:03.141723+0000","last_fullsized":"2024-09-12T12:26:03.141723+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:45.139371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.20","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035086+0000","last_change":"2024-09-12T12:26:02.042864+0000","last_active":"2024-09-12T12:26:03.035086+0000","last_peered":"2024-09-12T12:26:03.035086+0000","last_clean":"2024-09-12T12:26:03.035086+0000","last_became_active":"2024-09-12T12:26:02.042035+0000","last_became_peered":"2024-09-12T12:26:02.042035+0000","last_unstale":"2024-09-12T12:26:03.035086+0000","last_undegraded":"2024-09-12T12:26:03.035086+0000","last_fullsized":"2024-09-12T12:26:03.035086+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:37:42.131253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.1c","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142544+0000","last_change":"2024-09-12T12:26:02.036043+0000","last_active":"2024-09-12T12:26:03.142544+0000","last_peered":"2024-09-12T12:26:03.142544+0000","last_clean":"2024-09-12T12:26:03.142544+0000","last_became_active":"2024-09-12T12:26:02.035792+0000","last_became_peered":"2024-09-12T12:26:02.035792+0000","last_unstale":"2024-09-12T12:26:03.142544+0000","last_undegraded":"2024-09-12T12:26:03.142544+0000","last_fullsized":"2024-09-12T12:26:03.142544+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:36:59.634955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1f","version":"201'4","reported_seq":18,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143331+0000","last_change":"2024-09-12T12:26:01.016522+0000","last_active":"2024-09-12T12:26:03.143331+0000","last_peered":"2024-09-12T12:26:03.143331+0000","last_clean":"2024-09-12T12:26:03.143331+0000","last_became_active":"2024-09-12T12:26:01.016053+0000","last_became_peered":"2024-09-12T12:26:01.016053+0000","last_unstale":"2024-09-12T12:26:03.143331+0000","last_undegraded":"2024-09-12T12:26:03.143331+0000","last_fullsized":"2024-09-12T12:26:03.143331+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:10.964260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1d","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142742+0000","last_change":"2024-09-12T12:26:02.019981+0000","last_active":"2024-09-12T12:26:03.142742+0000","last_peered":"2024-09-12T12:26:03.142742+0000","last_clean":"2024-09-12T12:26:03.142742+0000","last_became_active":"2024-09-12T12:26:02.019659+0000","last_became_peered":"2024-09-12T12:26:02.019659+0000","last_unstale":"2024-09-12T12:26:03.142742+0000","last_undegraded":"2024-09-12T12:26:03.142742+0000","last_fullsized":"2024-09-12T12:26:03.142742+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:16.446614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1e","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036007+0000","last_change":"2024-09-12T12:26:01.022949+0000","last_active":"2024-09-12T12:26:03.036007+0000","last_peered":"2024-09-12T12:26:03.036007+0000","last_clean":"2024-09-12T12:26:03.036007+0000","last_became_active":"2024-09-12T12:26:01.022190+0000","last_became_peered":"2024-09-12T12:26:01.022190+0000","last_unstale":"2024-09-12T12:26:03.036007+0000","last_undegraded":"2024-09-12T12:26:03.036007+0000","last_fullsized":"2024-09-12T12:26:03.036007+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:42.456950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036071+0000","last_change":"2024-09-12T12:26:02.035884+0000","last_active":"2024-09-12T12:26:03.036071+0000","last_peered":"2024-09-12T12:26:03.036071+0000","last_clean":"2024-09-12T12:26:03.036071+0000","last_became_active":"2024-09-12T12:26:02.035587+0000","last_became_peered":"2024-09-12T12:26:02.035587+0000","last_unstale":"2024-09-12T12:26:03.036071+0000","last_undegraded":"2024-09-12T12:26:03.036071+0000","last_fullsized":"2024-09-12T12:26:03.036071+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:29.938688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1d","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035404+0000","last_change":"2024-09-12T12:26:01.022780+0000","last_active":"2024-09-12T12:26:03.035404+0000","last_peered":"2024-09-12T12:26:03.035404+0000","last_clean":"2024-09-12T12:26:03.035404+0000","last_became_active":"2024-09-12T12:26:01.022497+0000","last_became_peered":"2024-09-12T12:26:01.022497+0000","last_unstale":"2024-09-12T12:26:03.035404+0000","last_undegraded":"2024-09-12T12:26:03.035404+0000","last_fullsized":"2024-09-12T12:26:03.035404+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:24.877087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141976+0000","last_change":"2024-09-12T12:26:02.036728+0000","last_active":"2024-09-12T12:26:03.141976+0000","last_peered":"2024-09-12T12:26:03.141976+0000","last_clean":"2024-09-12T12:26:03.141976+0000","last_became_active":"2024-09-12T12:26:02.036440+0000","last_became_peered":"2024-09-12T12:26:02.036440+0000","last_unstale":"2024-09-12T12:26:03.141976+0000","last_undegraded":"2024-09-12T12:26:03.141976+0000","last_fullsized":"2024-09-12T12:26:03.141976+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:01.403192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1b","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033490+0000","last_change":"2024-09-12T12:26:01.019733+0000","last_active":"2024-09-12T12:26:03.033490+0000","last_peered":"2024-09-12T12:26:03.033490+0000","last_clean":"2024-09-12T12:26:03.033490+0000","last_became_active":"2024-09-12T12:26:01.019472+0000","last_became_peered":"2024-09-12T12:26:01.019472+0000","last_unstale":"2024-09-12T12:26:03.033490+0000","last_undegraded":"2024-09-12T12:26:03.033490+0000","last_fullsized":"2024-09-12T12:26:03.033490+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:17:30.775965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034557+0000","last_change":"2024-09-12T12:26:02.028710+0000","last_active":"2024-09-12T12:26:03.034557+0000","last_peered":"2024-09-12T12:26:03.034557+0000","last_clean":"2024-09-12T12:26:03.034557+0000","last_became_active":"2024-09-12T12:26:02.028406+0000","last_became_peered":"2024-09-12T12:26:02.028406+0000","last_unstale":"2024-09-12T12:26:03.034557+0000","last_undegraded":"2024-09-12T12:26:03.034557+0000","last_fullsized":"2024-09-12T12:26:03.034557+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:49.269651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1a","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142165+0000","last_change":"2024-09-12T12:26:01.025692+0000","last_active":"2024-09-12T12:26:03.142165+0000","last_peered":"2024-09-12T12:26:03.142165+0000","last_clean":"2024-09-12T12:26:03.142165+0000","last_became_active":"2024-09-12T12:26:01.025243+0000","last_became_peered":"2024-09-12T12:26:01.025243+0000","last_unstale":"2024-09-12T12:26:03.142165+0000","last_undegraded":"2024-09-12T12:26:03.142165+0000","last_fullsized":"2024-09-12T12:26:03.142165+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:06.429277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.1a","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033158+0000","last_change":"2024-09-12T12:26:02.038980+0000","last_active":"2024-09-12T12:26:03.033158+0000","last_peered":"2024-09-12T12:26:03.033158+0000","last_clean":"2024-09-12T12:26:03.033158+0000","last_became_active":"2024-09-12T12:26:02.038672+0000","last_became_peered":"2024-09-12T12:26:02.038672+0000","last_unstale":"2024-09-12T12:26:03.033158+0000","last_undegraded":"2024-09-12T12:26:03.033158+0000","last_fullsized":"2024-09-12T12:26:03.033158+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:56.591240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041530+0000","last_change":"2024-09-12T12:26:01.006624+0000","last_active":"2024-09-12T12:26:03.041530+0000","last_peered":"2024-09-12T12:26:03.041530+0000","last_clean":"2024-09-12T12:26:03.041530+0000","last_became_active":"2024-09-12T12:26:01.005218+0000","last_became_peered":"2024-09-12T12:26:01.005218+0000","last_unstale":"2024-09-12T12:26:03.041530+0000","last_undegraded":"2024-09-12T12:26:03.041530+0000","last_fullsized":"2024-09-12T12:26:03.041530+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:36.529563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1b","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142112+0000","last_change":"2024-09-12T12:26:02.035400+0000","last_active":"2024-09-12T12:26:03.142112+0000","last_peered":"2024-09-12T12:26:03.142112+0000","last_clean":"2024-09-12T12:26:03.142112+0000","last_became_active":"2024-09-12T12:26:02.035151+0000","last_became_peered":"2024-09-12T12:26:02.035151+0000","last_unstale":"2024-09-12T12:26:03.142112+0000","last_undegraded":"2024-09-12T12:26:03.142112+0000","last_fullsized":"2024-09-12T12:26:03.142112+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:21.588263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142091+0000","last_change":"2024-09-12T12:26:01.018216+0000","last_active":"2024-09-12T12:26:03.142091+0000","last_peered":"2024-09-12T12:26:03.142091+0000","last_clean":"2024-09-12T12:26:03.142091+0000","last_became_active":"2024-09-12T12:26:01.017757+0000","last_became_peered":"2024-09-12T12:26:01.017757+0000","last_unstale":"2024-09-12T12:26:03.142091+0000","last_undegraded":"2024-09-12T12:26:03.142091+0000","last_fullsized":"2024-09-12T12:26:03.142091+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:49.192805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.14","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033261+0000","last_change":"2024-09-12T12:26:02.025418+0000","last_active":"2024-09-12T12:26:03.033261+0000","last_peered":"2024-09-12T12:26:03.033261+0000","last_clean":"2024-09-12T12:26:03.033261+0000","last_became_active":"2024-09-12T12:26:02.025162+0000","last_became_peered":"2024-09-12T12:26:02.025162+0000","last_unstale":"2024-09-12T12:26:03.033261+0000","last_undegraded":"2024-09-12T12:26:03.033261+0000","last_fullsized":"2024-09-12T12:26:03.033261+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:42:12.494103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142731+0000","last_change":"2024-09-12T12:26:01.020496+0000","last_active":"2024-09-12T12:26:03.142731+0000","last_peered":"2024-09-12T12:26:03.142731+0000","last_clean":"2024-09-12T12:26:03.142731+0000","last_became_active":"2024-09-12T12:26:01.020091+0000","last_became_peered":"2024-09-12T12:26:01.020091+0000","last_unstale":"2024-09-12T12:26:03.142731+0000","last_undegraded":"2024-09-12T12:26:03.142731+0000","last_fullsized":"2024-09-12T12:26:03.142731+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:37:41.122448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.15","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033307+0000","last_change":"2024-09-12T12:26:02.026777+0000","last_active":"2024-09-12T12:26:03.033307+0000","last_peered":"2024-09-12T12:26:03.033307+0000","last_clean":"2024-09-12T12:26:03.033307+0000","last_became_active":"2024-09-12T12:26:02.026158+0000","last_became_peered":"2024-09-12T12:26:02.026158+0000","last_unstale":"2024-09-12T12:26:03.033307+0000","last_undegraded":"2024-09-12T12:26:03.033307+0000","last_fullsized":"2024-09-12T12:26:03.033307+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:37.459507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041763+0000","last_change":"2024-09-12T12:26:01.012887+0000","last_active":"2024-09-12T12:26:03.041763+0000","last_peered":"2024-09-12T12:26:03.041763+0000","last_clean":"2024-09-12T12:26:03.041763+0000","last_became_active":"2024-09-12T12:26:01.012605+0000","last_became_peered":"2024-09-12T12:26:01.012605+0000","last_unstale":"2024-09-12T12:26:03.041763+0000","last_undegraded":"2024-09-12T12:26:03.041763+0000","last_fullsized":"2024-09-12T12:26:03.041763+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:07.121184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142838+0000","last_change":"2024-09-12T12:26:02.028664+0000","last_active":"2024-09-12T12:26:03.142838+0000","last_peered":"2024-09-12T12:26:03.142838+0000","last_clean":"2024-09-12T12:26:03.142838+0000","last_became_active":"2024-09-12T12:26:02.028391+0000","last_became_peered":"2024-09-12T12:26:02.028391+0000","last_unstale":"2024-09-12T12:26:03.142838+0000","last_undegraded":"2024-09-12T12:26:03.142838+0000","last_fullsized":"2024-09-12T12:26:03.142838+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:05:56.774618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.15","version":"201'3","reported_seq":17,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142706+0000","last_change":"2024-09-12T12:26:01.021071+0000","last_active":"2024-09-12T12:26:03.142706+0000","last_peered":"2024-09-12T12:26:03.142706+0000","last_clean":"2024-09-12T12:26:03.142706+0000","last_became_active":"2024-09-12T12:26:01.020798+0000","last_became_peered":"2024-09-12T12:26:01.020798+0000","last_unstale":"2024-09-12T12:26:03.142706+0000","last_undegraded":"2024-09-12T12:26:03.142706+0000","last_fullsized":"2024-09-12T12:26:03.142706+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:26.640760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041891+0000","last_change":"2024-09-12T12:26:02.031584+0000","last_active":"2024-09-12T12:26:03.041891+0000","last_peered":"2024-09-12T12:26:03.041891+0000","last_clean":"2024-09-12T12:26:03.041891+0000","last_became_active":"2024-09-12T12:26:02.031320+0000","last_became_peered":"2024-09-12T12:26:02.031320+0000","last_unstale":"2024-09-12T12:26:03.041891+0000","last_undegraded":"2024-09-12T12:26:03.041891+0000","last_fullsized":"2024-09-12T12:26:03.041891+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:42:05.350183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"201'6","reported_seq":20,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035369+0000","last_change":"2024-09-12T12:26:01.023438+0000","last_active":"2024-09-12T12:26:03.035369+0000","last_peered":"2024-09-12T12:26:03.035369+0000","last_clean":"2024-09-12T12:26:03.035369+0000","last_became_active":"2024-09-12T12:26:01.023155+0000","last_became_peered":"2024-09-12T12:26:01.023155+0000","last_unstale":"2024-09-12T12:26:03.035369+0000","last_undegraded":"2024-09-12T12:26:03.035369+0000","last_fullsized":"2024-09-12T12:26:03.035369+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:18.685647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.10","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142473+0000","last_change":"2024-09-12T12:26:02.026715+0000","last_active":"2024-09-12T12:26:03.142473+0000","last_peered":"2024-09-12T12:26:03.142473+0000","last_clean":"2024-09-12T12:26:03.142473+0000","last_became_active":"2024-09-12T12:26:02.026367+0000","last_became_peered":"2024-09-12T12:26:02.026367+0000","last_unstale":"2024-09-12T12:26:03.142473+0000","last_undegraded":"2024-09-12T12:26:03.142473+0000","last_fullsized":"2024-09-12T12:26:03.142473+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:49.115982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.13","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035668+0000","last_change":"2024-09-12T12:26:01.011851+0000","last_active":"2024-09-12T12:26:03.035668+0000","last_peered":"2024-09-12T12:26:03.035668+0000","last_clean":"2024-09-12T12:26:03.035668+0000","last_became_active":"2024-09-12T12:26:01.010542+0000","last_became_peered":"2024-09-12T12:26:01.010542+0000","last_unstale":"2024-09-12T12:26:03.035668+0000","last_undegraded":"2024-09-12T12:26:03.035668+0000","last_fullsized":"2024-09-12T12:26:03.035668+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:01.594391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034601+0000","last_change":"2024-09-12T12:26:02.038439+0000","last_active":"2024-09-12T12:26:03.034601+0000","last_peered":"2024-09-12T12:26:03.034601+0000","last_clean":"2024-09-12T12:26:03.034601+0000","last_became_active":"2024-09-12T12:26:02.037171+0000","last_became_peered":"2024-09-12T12:26:02.037171+0000","last_unstale":"2024-09-12T12:26:03.034601+0000","last_undegraded":"2024-09-12T12:26:03.034601+0000","last_fullsized":"2024-09-12T12:26:03.034601+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:17:31.784769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143163+0000","last_change":"2024-09-12T12:26:01.018605+0000","last_active":"2024-09-12T12:26:03.143163+0000","last_peered":"2024-09-12T12:26:03.143163+0000","last_clean":"2024-09-12T12:26:03.143163+0000","last_became_active":"2024-09-12T12:26:01.016388+0000","last_became_peered":"2024-09-12T12:26:01.016388+0000","last_unstale":"2024-09-12T12:26:03.143163+0000","last_undegraded":"2024-09-12T12:26:03.143163+0000","last_fullsized":"2024-09-12T12:26:03.143163+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:32.232411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142080+0000","last_change":"2024-09-12T12:26:02.034750+0000","last_active":"2024-09-12T12:26:03.142080+0000","last_peered":"2024-09-12T12:26:03.142080+0000","last_clean":"2024-09-12T12:26:03.142080+0000","last_became_active":"2024-09-12T12:26:02.032566+0000","last_became_peered":"2024-09-12T12:26:02.032566+0000","last_unstale":"2024-09-12T12:26:03.142080+0000","last_undegraded":"2024-09-12T12:26:03.142080+0000","last_fullsized":"2024-09-12T12:26:03.142080+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:48.122779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034809+0000","last_change":"2024-09-12T12:26:01.018633+0000","last_active":"2024-09-12T12:26:03.034809+0000","last_peered":"2024-09-12T12:26:03.034809+0000","last_clean":"2024-09-12T12:26:03.034809+0000","last_became_active":"2024-09-12T12:26:01.018379+0000","last_became_peered":"2024-09-12T12:26:01.018379+0000","last_unstale":"2024-09-12T12:26:03.034809+0000","last_undegraded":"2024-09-12T12:26:03.034809+0000","last_fullsized":"2024-09-12T12:26:03.034809+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:25.738188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.13","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033510+0000","last_change":"2024-09-12T12:26:02.028171+0000","last_active":"2024-09-12T12:26:03.033510+0000","last_peered":"2024-09-12T12:26:03.033510+0000","last_clean":"2024-09-12T12:26:03.033510+0000","last_became_active":"2024-09-12T12:26:02.027929+0000","last_became_peered":"2024-09-12T12:26:02.027929+0000","last_unstale":"2024-09-12T12:26:03.033510+0000","last_undegraded":"2024-09-12T12:26:03.033510+0000","last_fullsized":"2024-09-12T12:26:03.033510+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:15.294102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.10","version":"201'8","reported_seq":22,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034652+0000","last_change":"2024-09-12T12:26:01.006394+0000","last_active":"2024-09-12T12:26:03.034652+0000","last_peered":"2024-09-12T12:26:03.034652+0000","last_clean":"2024-09-12T12:26:03.034652+0000","last_became_active":"2024-09-12T12:26:01.005899+0000","last_became_peered":"2024-09-12T12:26:01.005899+0000","last_unstale":"2024-09-12T12:26:03.034652+0000","last_undegraded":"2024-09-12T12:26:03.034652+0000","last_fullsized":"2024-09-12T12:26:03.034652+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:01.878838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142102+0000","last_change":"2024-09-12T12:26:02.027254+0000","last_active":"2024-09-12T12:26:03.142102+0000","last_peered":"2024-09-12T12:26:03.142102+0000","last_clean":"2024-09-12T12:26:03.142102+0000","last_became_active":"2024-09-12T12:26:02.026305+0000","last_became_peered":"2024-09-12T12:26:02.026305+0000","last_unstale":"2024-09-12T12:26:03.142102+0000","last_undegraded":"2024-09-12T12:26:03.142102+0000","last_fullsized":"2024-09-12T12:26:03.142102+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:50:50.201610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.f","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142804+0000","last_change":"2024-09-12T12:26:01.020561+0000","last_active":"2024-09-12T12:26:03.142804+0000","last_peered":"2024-09-12T12:26:03.142804+0000","last_clean":"2024-09-12T12:26:03.142804+0000","last_became_active":"2024-09-12T12:26:01.020224+0000","last_became_peered":"2024-09-12T12:26:01.020224+0000","last_unstale":"2024-09-12T12:26:03.142804+0000","last_undegraded":"2024-09-12T12:26:03.142804+0000","last_fullsized":"2024-09-12T12:26:03.142804+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:08.048030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.d","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142597+0000","last_change":"2024-09-12T12:26:02.042650+0000","last_active":"2024-09-12T12:26:03.142597+0000","last_peered":"2024-09-12T12:26:03.142597+0000","last_clean":"2024-09-12T12:26:03.142597+0000","last_became_active":"2024-09-12T12:26:02.041876+0000","last_became_peered":"2024-09-12T12:26:02.041876+0000","last_unstale":"2024-09-12T12:26:03.142597+0000","last_undegraded":"2024-09-12T12:26:03.142597+0000","last_fullsized":"2024-09-12T12:26:03.142597+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:12.565206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.e","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143110+0000","last_change":"2024-09-12T12:26:01.019776+0000","last_active":"2024-09-12T12:26:03.143110+0000","last_peered":"2024-09-12T12:26:03.143110+0000","last_clean":"2024-09-12T12:26:03.143110+0000","last_became_active":"2024-09-12T12:26:01.019418+0000","last_became_peered":"2024-09-12T12:26:01.019418+0000","last_unstale":"2024-09-12T12:26:03.143110+0000","last_undegraded":"2024-09-12T12:26:03.143110+0000","last_fullsized":"2024-09-12T12:26:03.143110+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:48.282002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.e","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142884+0000","last_change":"2024-09-12T12:26:02.024126+0000","last_active":"2024-09-12T12:26:03.142884+0000","last_peered":"2024-09-12T12:26:03.142884+0000","last_clean":"2024-09-12T12:26:03.142884+0000","last_became_active":"2024-09-12T12:26:02.023536+0000","last_became_peered":"2024-09-12T12:26:02.023536+0000","last_unstale":"2024-09-12T12:26:03.142884+0000","last_undegraded":"2024-09-12T12:26:03.142884+0000","last_fullsized":"2024-09-12T12:26:03.142884+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:15.079102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.d","version":"201'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035669+0000","last_change":"2024-09-12T12:26:01.019831+0000","last_active":"2024-09-12T12:26:03.035669+0000","last_peered":"2024-09-12T12:26:03.035669+0000","last_clean":"2024-09-12T12:26:03.035669+0000","last_became_active":"2024-09-12T12:26:01.019171+0000","last_became_peered":"2024-09-12T12:26:01.019171+0000","last_unstale":"2024-09-12T12:26:03.035669+0000","last_undegraded":"2024-09-12T12:26:03.035669+0000","last_fullsized":"2024-09-12T12:26:03.035669+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:11.278849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036151+0000","last_change":"2024-09-12T12:26:02.023518+0000","last_active":"2024-09-12T12:26:03.036151+0000","last_peered":"2024-09-12T12:26:03.036151+0000","last_clean":"2024-09-12T12:26:03.036151+0000","last_became_active":"2024-09-12T12:26:02.023239+0000","last_became_peered":"2024-09-12T12:26:02.023239+0000","last_unstale":"2024-09-12T12:26:03.036151+0000","last_undegraded":"2024-09-12T12:26:03.036151+0000","last_fullsized":"2024-09-12T12:26:03.036151+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:43.399124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036017+0000","last_change":"2024-09-12T12:26:01.020723+0000","last_active":"2024-09-12T12:26:03.036017+0000","last_peered":"2024-09-12T12:26:03.036017+0000","last_clean":"2024-09-12T12:26:03.036017+0000","last_became_active":"2024-09-12T12:26:01.020415+0000","last_became_peered":"2024-09-12T12:26:01.020415+0000","last_unstale":"2024-09-12T12:26:03.036017+0000","last_undegraded":"2024-09-12T12:26:03.036017+0000","last_fullsized":"2024-09-12T12:26:03.036017+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:24.877087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034470+0000","last_change":"2024-09-12T12:26:02.037174+0000","last_active":"2024-09-12T12:26:03.034470+0000","last_peered":"2024-09-12T12:26:03.034470+0000","last_clean":"2024-09-12T12:26:03.034470+0000","last_became_active":"2024-09-12T12:26:02.036787+0000","last_became_peered":"2024-09-12T12:26:02.036787+0000","last_unstale":"2024-09-12T12:26:03.034470+0000","last_undegraded":"2024-09-12T12:26:03.034470+0000","last_fullsized":"2024-09-12T12:26:03.034470+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:04.196342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035817+0000","last_change":"2024-09-12T12:26:01.025031+0000","last_active":"2024-09-12T12:26:03.035817+0000","last_peered":"2024-09-12T12:26:03.035817+0000","last_clean":"2024-09-12T12:26:03.035817+0000","last_became_active":"2024-09-12T12:26:01.024749+0000","last_became_peered":"2024-09-12T12:26:01.024749+0000","last_unstale":"2024-09-12T12:26:03.035817+0000","last_undegraded":"2024-09-12T12:26:03.035817+0000","last_fullsized":"2024-09-12T12:26:03.035817+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:25.738188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142259+0000","last_change":"2024-09-12T12:26:02.037963+0000","last_active":"2024-09-12T12:26:03.142259+0000","last_peered":"2024-09-12T12:26:03.142259+0000","last_clean":"2024-09-12T12:26:03.142259+0000","last_became_active":"2024-09-12T12:26:02.036720+0000","last_became_peered":"2024-09-12T12:26:02.036720+0000","last_unstale":"2024-09-12T12:26:03.142259+0000","last_undegraded":"2024-09-12T12:26:03.142259+0000","last_fullsized":"2024-09-12T12:26:03.142259+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:29.938688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033259+0000","last_change":"2024-09-12T12:26:01.016380+0000","last_active":"2024-09-12T12:26:03.033259+0000","last_peered":"2024-09-12T12:26:03.033259+0000","last_clean":"2024-09-12T12:26:03.033259+0000","last_became_active":"2024-09-12T12:26:01.016097+0000","last_became_peered":"2024-09-12T12:26:01.016097+0000","last_unstale":"2024-09-12T12:26:03.033259+0000","last_undegraded":"2024-09-12T12:26:03.033259+0000","last_fullsized":"2024-09-12T12:26:03.033259+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:48.260847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143107+0000","last_change":"2024-09-12T12:26:02.026860+0000","last_active":"2024-09-12T12:26:03.143107+0000","last_peered":"2024-09-12T12:26:03.143107+0000","last_clean":"2024-09-12T12:26:03.143107+0000","last_became_active":"2024-09-12T12:26:02.026616+0000","last_became_peered":"2024-09-12T12:26:02.026616+0000","last_unstale":"2024-09-12T12:26:03.143107+0000","last_undegraded":"2024-09-12T12:26:03.143107+0000","last_fullsized":"2024-09-12T12:26:03.143107+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:24:28.750804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.032993+0000","last_change":"2024-09-12T12:26:01.012510+0000","last_active":"2024-09-12T12:26:03.032993+0000","last_peered":"2024-09-12T12:26:03.032993+0000","last_clean":"2024-09-12T12:26:03.032993+0000","last_became_active":"2024-09-12T12:26:01.012265+0000","last_became_peered":"2024-09-12T12:26:01.012265+0000","last_unstale":"2024-09-12T12:26:03.032993+0000","last_undegraded":"2024-09-12T12:26:03.032993+0000","last_fullsized":"2024-09-12T12:26:03.032993+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:28.033511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.b","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142448+0000","last_change":"2024-09-12T12:26:02.023018+0000","last_active":"2024-09-12T12:26:03.142448+0000","last_peered":"2024-09-12T12:26:03.142448+0000","last_clean":"2024-09-12T12:26:03.142448+0000","last_became_active":"2024-09-12T12:26:02.019708+0000","last_became_peered":"2024-09-12T12:26:02.019708+0000","last_unstale":"2024-09-12T12:26:03.142448+0000","last_undegraded":"2024-09-12T12:26:03.142448+0000","last_fullsized":"2024-09-12T12:26:03.142448+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:20:00.335667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141658+0000","last_change":"2024-09-12T12:26:01.018864+0000","last_active":"2024-09-12T12:26:03.141658+0000","last_peered":"2024-09-12T12:26:03.141658+0000","last_clean":"2024-09-12T12:26:03.141658+0000","last_became_active":"2024-09-12T12:26:01.018424+0000","last_became_peered":"2024-09-12T12:26:01.018424+0000","last_unstale":"2024-09-12T12:26:03.141658+0000","last_undegraded":"2024-09-12T12:26:03.141658+0000","last_fullsized":"2024-09-12T12:26:03.141658+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:36.853448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142252+0000","last_change":"2024-09-12T12:26:02.027622+0000","last_active":"2024-09-12T12:26:03.142252+0000","last_peered":"2024-09-12T12:26:03.142252+0000","last_clean":"2024-09-12T12:26:03.142252+0000","last_became_active":"2024-09-12T12:26:02.027283+0000","last_became_peered":"2024-09-12T12:26:02.027283+0000","last_unstale":"2024-09-12T12:26:03.142252+0000","last_undegraded":"2024-09-12T12:26:03.142252+0000","last_fullsized":"2024-09-12T12:26:03.142252+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:46.343290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.7","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036270+0000","last_change":"2024-09-12T12:26:01.010805+0000","last_active":"2024-09-12T12:26:03.036270+0000","last_peered":"2024-09-12T12:26:03.036270+0000","last_clean":"2024-09-12T12:26:03.036270+0000","last_became_active":"2024-09-12T12:26:01.010504+0000","last_became_peered":"2024-09-12T12:26:01.010504+0000","last_unstale":"2024-09-12T12:26:03.036270+0000","last_undegraded":"2024-09-12T12:26:03.036270+0000","last_fullsized":"2024-09-12T12:26:03.036270+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:53.349223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142693+0000","last_change":"2024-09-12T12:26:02.042865+0000","last_active":"2024-09-12T12:26:03.142693+0000","last_peered":"2024-09-12T12:26:03.142693+0000","last_clean":"2024-09-12T12:26:03.142693+0000","last_became_active":"2024-09-12T12:26:02.042162+0000","last_became_peered":"2024-09-12T12:26:02.042162+0000","last_unstale":"2024-09-12T12:26:03.142693+0000","last_undegraded":"2024-09-12T12:26:03.142693+0000","last_fullsized":"2024-09-12T12:26:03.142693+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:23:56.591240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.6","version":"202'1","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.040489+0000","last_change":"2024-09-12T12:26:01.007714+0000","last_active":"2024-09-12T12:26:03.040489+0000","last_peered":"2024-09-12T12:26:03.040489+0000","last_clean":"2024-09-12T12:26:03.040489+0000","last_became_active":"2024-09-12T12:26:01.007468+0000","last_became_peered":"2024-09-12T12:26:01.007468+0000","last_unstale":"2024-09-12T12:26:03.040489+0000","last_undegraded":"2024-09-12T12:26:03.040489+0000","last_fullsized":"2024-09-12T12:26:03.040489+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:58.897158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035942+0000","last_change":"2024-09-12T12:26:02.040809+0000","last_active":"2024-09-12T12:26:03.035942+0000","last_peered":"2024-09-12T12:26:03.035942+0000","last_clean":"2024-09-12T12:26:03.035942+0000","last_became_active":"2024-09-12T12:26:02.040166+0000","last_became_peered":"2024-09-12T12:26:02.040166+0000","last_unstale":"2024-09-12T12:26:03.035942+0000","last_undegraded":"2024-09-12T12:26:03.035942+0000","last_fullsized":"2024-09-12T12:26:03.035942+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:17:31.784769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.033520+0000","last_change":"2024-09-12T12:26:01.014696+0000","last_active":"2024-09-12T12:26:03.033520+0000","last_peered":"2024-09-12T12:26:03.033520+0000","last_clean":"2024-09-12T12:26:03.033520+0000","last_became_active":"2024-09-12T12:26:01.014279+0000","last_became_peered":"2024-09-12T12:26:01.014279+0000","last_unstale":"2024-09-12T12:26:03.033520+0000","last_undegraded":"2024-09-12T12:26:03.033520+0000","last_fullsized":"2024-09-12T12:26:03.033520+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:21:15.242038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.7","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.143236+0000","last_change":"2024-09-12T12:26:02.030345+0000","last_active":"2024-09-12T12:26:03.143236+0000","last_peered":"2024-09-12T12:26:03.143236+0000","last_clean":"2024-09-12T12:26:03.143236+0000","last_became_active":"2024-09-12T12:26:02.030087+0000","last_became_peered":"2024-09-12T12:26:02.030087+0000","last_unstale":"2024-09-12T12:26:03.143236+0000","last_undegraded":"2024-09-12T12:26:03.143236+0000","last_fullsized":"2024-09-12T12:26:03.143236+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:38:51.591600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.036154+0000","last_change":"2024-09-12T12:26:01.024924+0000","last_active":"2024-09-12T12:26:03.036154+0000","last_peered":"2024-09-12T12:26:03.036154+0000","last_clean":"2024-09-12T12:26:03.036154+0000","last_became_active":"2024-09-12T12:26:01.024639+0000","last_became_peered":"2024-09-12T12:26:01.024639+0000","last_unstale":"2024-09-12T12:26:03.036154+0000","last_undegraded":"2024-09-12T12:26:03.036154+0000","last_fullsized":"2024-09-12T12:26:03.036154+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:18.685647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141961+0000","last_change":"2024-09-12T12:26:02.020085+0000","last_active":"2024-09-12T12:26:03.141961+0000","last_peered":"2024-09-12T12:26:03.141961+0000","last_clean":"2024-09-12T12:26:03.141961+0000","last_became_active":"2024-09-12T12:26:02.019812+0000","last_became_peered":"2024-09-12T12:26:02.019812+0000","last_unstale":"2024-09-12T12:26:03.141961+0000","last_undegraded":"2024-09-12T12:26:03.141961+0000","last_fullsized":"2024-09-12T12:26:03.141961+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:56.826211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035936+0000","last_change":"2024-09-12T12:26:01.011009+0000","last_active":"2024-09-12T12:26:03.035936+0000","last_peered":"2024-09-12T12:26:03.035936+0000","last_clean":"2024-09-12T12:26:03.035936+0000","last_became_active":"2024-09-12T12:26:01.010694+0000","last_became_peered":"2024-09-12T12:26:01.010694+0000","last_unstale":"2024-09-12T12:26:03.035936+0000","last_undegraded":"2024-09-12T12:26:03.035936+0000","last_fullsized":"2024-09-12T12:26:03.035936+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:29:04.454270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142249+0000","last_change":"2024-09-12T12:26:02.020220+0000","last_active":"2024-09-12T12:26:03.142249+0000","last_peered":"2024-09-12T12:26:03.142249+0000","last_clean":"2024-09-12T12:26:03.142249+0000","last_became_active":"2024-09-12T12:26:02.019924+0000","last_became_peered":"2024-09-12T12:26:02.019924+0000","last_unstale":"2024-09-12T12:26:03.142249+0000","last_undegraded":"2024-09-12T12:26:03.142249+0000","last_fullsized":"2024-09-12T12:26:03.142249+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:17:33.652797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.041363+0000","last_change":"2024-09-12T12:26:01.006185+0000","last_active":"2024-09-12T12:26:03.041363+0000","last_peered":"2024-09-12T12:26:03.041363+0000","last_clean":"2024-09-12T12:26:03.041363+0000","last_became_active":"2024-09-12T12:26:01.005933+0000","last_became_peered":"2024-09-12T12:26:01.005933+0000","last_unstale":"2024-09-12T12:26:03.041363+0000","last_undegraded":"2024-09-12T12:26:03.041363+0000","last_fullsized":"2024-09-12T12:26:03.041363+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:44.343900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.141949+0000","last_change":"2024-09-12T12:26:02.025048+0000","last_active":"2024-09-12T12:26:03.141949+0000","last_peered":"2024-09-12T12:26:03.141949+0000","last_clean":"2024-09-12T12:26:03.141949+0000","last_became_active":"2024-09-12T12:26:02.024788+0000","last_became_peered":"2024-09-12T12:26:02.024788+0000","last_unstale":"2024-09-12T12:26:03.141949+0000","last_undegraded":"2024-09-12T12:26:03.141949+0000","last_fullsized":"2024-09-12T12:26:03.141949+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:39.107161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142391+0000","last_change":"2024-09-12T12:26:01.018019+0000","last_active":"2024-09-12T12:26:03.142391+0000","last_peered":"2024-09-12T12:26:03.142391+0000","last_clean":"2024-09-12T12:26:03.142391+0000","last_became_active":"2024-09-12T12:26:01.017730+0000","last_became_peered":"2024-09-12T12:26:01.017730+0000","last_unstale":"2024-09-12T12:26:03.142391+0000","last_undegraded":"2024-09-12T12:26:03.142391+0000","last_fullsized":"2024-09-12T12:26:03.142391+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:10.854712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.035774+0000","last_change":"2024-09-12T12:26:02.020873+0000","last_active":"2024-09-12T12:26:03.035774+0000","last_peered":"2024-09-12T12:26:03.035774+0000","last_clean":"2024-09-12T12:26:03.035774+0000","last_became_active":"2024-09-12T12:26:02.020254+0000","last_became_peered":"2024-09-12T12:26:02.020254+0000","last_unstale":"2024-09-12T12:26:03.035774+0000","last_undegraded":"2024-09-12T12:26:03.035774+0000","last_fullsized":"2024-09-12T12:26:03.035774+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:07.389505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.034766+0000","last_change":"2024-09-12T12:26:01.003604+0000","last_active":"2024-09-12T12:26:03.034766+0000","last_peered":"2024-09-12T12:26:03.034766+0000","last_clean":"2024-09-12T12:26:03.034766+0000","last_became_active":"2024-09-12T12:26:01.003294+0000","last_became_peered":"2024-09-12T12:26:01.003294+0000","last_unstale":"2024-09-12T12:26:03.034766+0000","last_undegraded":"2024-09-12T12:26:03.034766+0000","last_fullsized":"2024-09-12T12:26:03.034766+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:33.794192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1f","version":"0'0","reported_seq":12,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142706+0000","last_change":"2024-09-12T12:26:02.027110+0000","last_active":"2024-09-12T12:26:03.142706+0000","last_peered":"2024-09-12T12:26:03.142706+0000","last_clean":"2024-09-12T12:26:03.142706+0000","last_became_active":"2024-09-12T12:26:02.026840+0000","last_became_peered":"2024-09-12T12:26:02.026840+0000","last_unstale":"2024-09-12T12:26:03.142706+0000","last_undegraded":"2024-09-12T12:26:03.142706+0000","last_fullsized":"2024-09-12T12:26:03.142706+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:26:00.991590+0000","last_clean_scrub_stamp":"2024-09-12T12:26:00.991590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:18:27.236594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1c","version":"201'2","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142511+0000","last_change":"2024-09-12T12:26:01.025006+0000","last_active":"2024-09-12T12:26:03.142511+0000","last_peered":"2024-09-12T12:26:03.142511+0000","last_clean":"2024-09-12T12:26:03.142511+0000","last_became_active":"2024-09-12T12:26:01.023806+0000","last_became_peered":"2024-09-12T12:26:01.023806+0000","last_unstale":"2024-09-12T12:26:03.142511+0000","last_undegraded":"2024-09-12T12:26:03.142511+0000","last_fullsized":"2024-09-12T12:26:03.142511+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:25:59.982786+0000","last_clean_scrub_stamp":"2024-09-12T12:25:59.982786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:11.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":504,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-12T12:26:03.142234+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:26:03.142234+0000","last_peered":"2024-09-12T12:26:03.142234+0000","last_clean":"2024-09-12T12:26:03.142234+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:26:03.142234+0000","last_undegraded":"2024-09-12T12:26:03.142234+0000","last_fullsized":"2024-09-12T12:26:03.142234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":30,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":29,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52324,"kb_used_data":3080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319516,"statfs":{"total":96636764160,"available":96583184384,"internally_reserved":0,"allocated":3153920,"data_stored":1799989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575013,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55912,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315928,"statfs":{"total":96636764160,"available":96579510272,"internally_reserved":0,"allocated":2576384,"data_stored":1210687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575013,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51744,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320096,"statfs":{"total":96636764160,"available":96583778304,"internally_reserved":0,"allocated":2568192,"data_stored":1210631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575013,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60056,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311784,"statfs":{"total":96636764160,"available":96575266816,"internally_reserved":0,"allocated":2555904,"data_stored":1209039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64220,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307620,"statfs":{"total":96636764160,"available":96571002880,"internally_reserved":0,"allocated":2555904,"data_stored":1208971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":63175112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60060,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311780,"statfs":{"total":96636764160,"available":96575262720,"internally_reserved":0,"allocated":2560000,"data_stored":1209565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575014,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60052,"kb_used_data":2492,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311788,"statfs":{"total":96636764160,"available":96575270912,"internally_reserved":0,"allocated":2551808,"data_stored":1208949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575015,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56468,"kb_used_data":3072,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315372,"statfs":{"total":96636764160,"available":96578940928,"internally_reserved":0,"allocated":3145728,"data_stored":1799317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:26:06.501 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:26:06.502 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T12:26:06.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.678+0000 7f0bb1a00640 1 Processor -- start 2024-09-12T12:26:06.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.678+0000 7f0bb1a00640 1 -- start start 2024-09-12T12:26:06.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.678+0000 7f0bb1a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0bac155810 0x7f0bac15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.678+0000 7f0bb1a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac0b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.678+0000 7f0bb1a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bac15c5f0 con 0x7f0bac15ec50 2024-09-12T12:26:06.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.678+0000 7f0bb1a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0bac15c820 con 0x7f0bac155810 2024-09-12T12:26:06.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.678+0000 7f0bb1a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac0b2790 con 0x7f0bac0b1e10 2024-09-12T12:26:06.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0babe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0bac155810 0x7f0bac15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0babe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0bac155810 0x7f0bac15c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43266/0 (socket says 172.21.15.144:43266) 2024-09-12T12:26:06.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0babe00640 1 -- 172.21.15.144:0/2356959007 learned_addr learned my addr 172.21.15.144:0/2356959007 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:06.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0babe00640 1 -- 172.21.15.144:0/2356959007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 msgr2=0x7f0bac0b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:06.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0bab400640 1 --2- 172.21.15.144:0/2356959007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac0b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0babe00640 1 --2- 172.21.15.144:0/2356959007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac0b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0babe00640 1 -- 172.21.15.144:0/2356959007 >> v1:172.21.15.165:6789/0 conn(0x7f0bac15ec50 legacy=0x7f0bac15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:06.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0babe00640 1 -- 172.21.15.144:0/2356959007 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac0b3470 con 0x7f0bac155810 2024-09-12T12:26:06.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0bab400640 1 --2- 172.21.15.144:0/2356959007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac0b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:06.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0babe00640 1 --2- 172.21.15.144:0/2356959007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac155810 0x7f0bac15c0b0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009870 tx=0x7f0b9c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7cb4e2769de986 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:06.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0baaa00640 1 -- 172.21.15.144:0/2356959007 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0b5070 con 0x7f0bac155810 2024-09-12T12:26:06.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0baaa00640 1 -- 172.21.15.144:0/2356959007 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b9c0a89d0 con 0x7f0bac155810 2024-09-12T12:26:06.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.682+0000 7f0baaa00640 1 -- 172.21.15.144:0/2356959007 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0a8da0 con 0x7f0bac155810 2024-09-12T12:26:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 -- 172.21.15.144:0/2356959007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac155810 msgr2=0x7f0bac15c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 --2- 172.21.15.144:0/2356959007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac155810 0x7f0bac15c0b0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009870 tx=0x7f0b9c01ed10 comp rx=0 tx=0).stop 2024-09-12T12:26:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 -- 172.21.15.144:0/2356959007 shutdown_connections 2024-09-12T12:26:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 --2- 172.21.15.144:0/2356959007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac0b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 --2- 172.21.15.144:0/2356959007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac155810 0x7f0bac15c0b0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 -- 172.21.15.144:0/2356959007 >> 172.21.15.144:0/2356959007 conn(0x7f0bac06e7e0 msgr2=0x7f0bac06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 -- 172.21.15.144:0/2356959007 shutdown_connections 2024-09-12T12:26:06.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 -- 172.21.15.144:0/2356959007 wait complete. 2024-09-12T12:26:06.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 Processor -- start 2024-09-12T12:26:06.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 -- start start 2024-09-12T12:26:06.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bac155810 0x7f0bac15a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac15ec50 0x7f0bac0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac0b3d10 con 0x7f0bac15ec50 2024-09-12T12:26:06.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac0b3a30 con 0x7f0bac155810 2024-09-12T12:26:06.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac0b3ff0 con 0x7f0bac0b1e10 2024-09-12T12:26:06.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac15ec50 0x7f0bac0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac15ec50 0x7f0bac0ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43274/0 (socket says 172.21.15.144:43274) 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1000640 1 -- 172.21.15.144:0/1278790698 learned_addr learned my addr 172.21.15.144:0/1278790698 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0babe00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bab400640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bac155810 0x7f0bac15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1000640 1 -- 172.21.15.144:0/1278790698 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 msgr2=0x7f0bac147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1000640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1000640 1 -- 172.21.15.144:0/1278790698 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bac155810 msgr2=0x7f0bac15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1000640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bac155810 0x7f0bac15a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0bb1000640 1 -- 172.21.15.144:0/1278790698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac14f030 con 0x7f0bac15ec50 2024-09-12T12:26:06.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.686+0000 7f0babe00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0bb1000640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac15ec50 0x7f0bac0ae890 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400b970 tx=0x7f0ba400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0ba3e00640 1 -- 172.21.15.144:0/1278790698 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4019070 con 0x7f0bac15ec50 2024-09-12T12:26:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0ba3e00640 1 -- 172.21.15.144:0/1278790698 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba400cb40 con 0x7f0bac15ec50 2024-09-12T12:26:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0ba3e00640 1 -- 172.21.15.144:0/1278790698 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4014440 con 0x7f0bac15ec50 2024-09-12T12:26:06.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bac148030 con 0x7f0bac15ec50 2024-09-12T12:26:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bac158040 con 0x7f0bac15ec50 2024-09-12T12:26:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bac158af0 con 0x7f0bac15ec50 2024-09-12T12:26:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0ba3e00640 1 -- 172.21.15.144:0/1278790698 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ba401c070 con 0x7f0bac15ec50 2024-09-12T12:26:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0ba3e00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0b8c0678c0 0x7f0b8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:06.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0ba3e00640 1 -- 172.21.15.144:0/1278790698 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f0ba4085a30 con 0x7f0bac15ec50 2024-09-12T12:26:06.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.690+0000 7f0babe00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0b8c0678c0 0x7f0b8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:06.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.694+0000 7f0babe00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0b8c0678c0 0x7f0b8c069d80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0b2000 tx=0x7f0b9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:06.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.694+0000 7f0ba3e00640 1 -- 172.21.15.144:0/1278790698 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ba4056450 con 0x7f0bac15ec50 2024-09-12T12:26:06.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.906+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0bac06dd50 con 0x7f0bac15ec50 2024-09-12T12:26:06.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.910+0000 7f0ba3e00640 1 -- 172.21.15.144:0/1278790698 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) ==== 190+0+147 (secure 0 0 0) 0x7f0ba4055d50 con 0x7f0bac15ec50 2024-09-12T12:26:06.913 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-12T12:26:06.913 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCA2uJm58EkNhAAMxNRT/O6F2LjFu0kAUxzuA== 2024-09-12T12:26:06.913 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-12T12:26:06.913 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-12T12:26:06.914 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T12:26:06.914 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-12T12:26:06.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0b8c0678c0 msgr2=0x7f0b8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0b8c0678c0 0x7f0b8c069d80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0b2000 tx=0x7f0b9c008040 comp rx=0 tx=0).stop 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac15ec50 msgr2=0x7f0bac0ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac15ec50 0x7f0bac0ae890 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400b970 tx=0x7f0ba400be30 comp rx=0 tx=0).stop 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 shutdown_connections 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0b8c0678c0 0x7f0b8c069d80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bac15ec50 0x7f0bac0ae890 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0bac155810 0x7f0bac15a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 --2- 172.21.15.144:0/1278790698 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0bac0b1e10 0x7f0bac147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 >> 172.21.15.144:0/1278790698 conn(0x7f0bac06e7e0 msgr2=0x7f0bac0afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 shutdown_connections 2024-09-12T12:26:06.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:06.914+0000 7f0bb1a00640 1 -- 172.21.15.144:0/1278790698 wait complete. 2024-09-12T12:26:06.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:26:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.070+0000 7f5018e00640 1 Processor -- start 2024-09-12T12:26:07.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.070+0000 7f5018e00640 1 -- start start 2024-09-12T12:26:07.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5018e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5014147570 0x7f501406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5018e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5014147fc0 0x7f501406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5018e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50140b6730 con 0x7f5014147a70 2024-09-12T12:26:07.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5018e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5014162100 con 0x7f5014147570 2024-09-12T12:26:07.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5018e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f50141623e0 con 0x7f5014147fc0 2024-09-12T12:26:07.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5011e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5014147570 0x7f501406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5011e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5014147570 0x7f501406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52476/0 (socket says 172.21.15.144:52476) 2024-09-12T12:26:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5012800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5014147a70 0x7f50140ae890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47766/0 (socket says 172.21.15.144:47766) 2024-09-12T12:26:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5011e00640 1 -- 172.21.15.144:0/2437734059 learned_addr learned my addr 172.21.15.144:0/2437734059 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5011400640 1 --2- 172.21.15.144:0/2437734059 >> v2:172.21.15.165:3300/0 conn(0x7f5014147fc0 0x7f501406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5011e00640 1 -- 172.21.15.144:0/2437734059 >> v2:172.21.15.165:3300/0 conn(0x7f5014147fc0 msgr2=0x7f501406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5011e00640 1 --2- 172.21.15.144:0/2437734059 >> v2:172.21.15.165:3300/0 conn(0x7f5014147fc0 0x7f501406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5011e00640 1 -- 172.21.15.144:0/2437734059 >> v1:172.21.15.144:6789/0 conn(0x7f5014147a70 legacy=0x7f50140ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5011e00640 1 -- 172.21.15.144:0/2437734059 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50141626c0 con 0x7f5014147570 2024-09-12T12:26:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5011400640 1 --2- 172.21.15.144:0/2437734059 >> v2:172.21.15.165:3300/0 conn(0x7f5014147fc0 0x7f501406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:07.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.074+0000 7f5010a00640 1 -- 172.21.15.144:0/2437734059 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394690743 0 0) 0x7f50140b6730 con 0x7f5014147a70 2024-09-12T12:26:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5011e00640 1 --2- 172.21.15.144:0/2437734059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 0x7f501406bc10 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f501406e040 tx=0x7f4ffc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc531ece38d0549 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5010a00640 1 -- 172.21.15.144:0/2437734059 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0b0070 con 0x7f5014147570 2024-09-12T12:26:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5010a00640 1 -- 172.21.15.144:0/2437734059 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc004230 con 0x7f5014147570 2024-09-12T12:26:07.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5010a00640 1 -- 172.21.15.144:0/2437734059 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc003620 con 0x7f5014147570 2024-09-12T12:26:07.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 -- 172.21.15.144:0/2437734059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 msgr2=0x7f501406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 --2- 172.21.15.144:0/2437734059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 0x7f501406bc10 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f501406e040 tx=0x7f4ffc01c520 comp rx=0 tx=0).stop 2024-09-12T12:26:07.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 -- 172.21.15.144:0/2437734059 shutdown_connections 2024-09-12T12:26:07.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 --2- 172.21.15.144:0/2437734059 >> v2:172.21.15.165:3300/0 conn(0x7f5014147fc0 0x7f501406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 --2- 172.21.15.144:0/2437734059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 0x7f501406bc10 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 -- 172.21.15.144:0/2437734059 >> 172.21.15.144:0/2437734059 conn(0x7f501406f8b0 msgr2=0x7f501406fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 -- 172.21.15.144:0/2437734059 shutdown_connections 2024-09-12T12:26:07.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 -- 172.21.15.144:0/2437734059 wait complete. 2024-09-12T12:26:07.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 Processor -- start 2024-09-12T12:26:07.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 -- start start 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.078+0000 7f5018e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 0x7f5014163390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5018e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5014147a70 0x7f501415f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5018e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5014147fc0 0x7f5014144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5018e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f501416b370 con 0x7f5014147570 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5018e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f501416b1f0 con 0x7f5014147a70 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5018e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f501416b4f0 con 0x7f5014147fc0 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 0x7f5014163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 0x7f5014163390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52488/0 (socket says 172.21.15.144:52488) 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011e00640 1 -- 172.21.15.144:0/3265137049 learned_addr learned my addr 172.21.15.144:0/3265137049 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:07.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011400640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5014147a70 0x7f501415f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5012800640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5014147fc0 0x7f5014144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011e00640 1 -- 172.21.15.144:0/3265137049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5014147fc0 msgr2=0x7f5014144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011e00640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5014147fc0 0x7f5014144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011e00640 1 -- 172.21.15.144:0/3265137049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5014147a70 msgr2=0x7f501415f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011e00640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5014147a70 0x7f501415f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011e00640 1 -- 172.21.15.144:0/3265137049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50141f7f10 con 0x7f5014147570 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5011e00640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 0x7f5014163390 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc019130 tx=0x7f4ffc0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f500a000640 1 -- 172.21.15.144:0/3265137049 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0b0050 con 0x7f5014147570 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f500a000640 1 -- 172.21.15.144:0/3265137049 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0bb070 con 0x7f5014147570 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f500a000640 1 -- 172.21.15.144:0/3265137049 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0ab660 con 0x7f5014147570 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50141f81f0 con 0x7f5014147570 2024-09-12T12:26:07.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50141f87b0 con 0x7f5014147570 2024-09-12T12:26:07.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50140ae890 con 0x7f5014147570 2024-09-12T12:26:07.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.082+0000 7f500a000640 1 -- 172.21.15.144:0/3265137049 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ffc0ab800 con 0x7f5014147570 2024-09-12T12:26:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.086+0000 7f500a000640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ff00678c0 0x7f4ff0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.086+0000 7f500a000640 1 -- 172.21.15.144:0/3265137049 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f4ffc11fd30 con 0x7f5014147570 2024-09-12T12:26:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.086+0000 7f5011400640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ff00678c0 0x7f4ff0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.086+0000 7f5011400640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ff00678c0 0x7f4ff0069d80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5014168a10 tx=0x7f5004009870 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.090+0000 7f500a000640 1 -- 172.21.15.144:0/3265137049 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4ffc016110 con 0x7f5014147570 2024-09-12T12:26:07.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.278+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5014070070 con 0x7f5014147570 2024-09-12T12:26:07.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.278+0000 7f500a000640 1 -- 172.21.15.144:0/3265137049 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) ==== 95+0+5250 (secure 0 0 0) 0x7f4ffc0f0110 con 0x7f5014147570 2024-09-12T12:26:07.282 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:07.282 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":157,"btime":"2024-09-12T12:26:05:043642+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/480472502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":480472502},{"type":"v1","addr":"172.21.15.165:6834","nonce":480472502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2632695665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2632695665},{"type":"v1","addr":"172.21.15.144:6836","nonce":2632695665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151},{"gid":10590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2593616401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2593616401},{"type":"v1","addr":"172.21.15.144:6837","nonce":2593616401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:26:01.386066+0000","modified":"2024-09-12T12:26:04.421876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10593":{"gid":10593,"name":"b","rank":0,"incarnation":153,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2360370466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2360370466},{"type":"v1","addr":"172.21.15.165:6835","nonce":2360370466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10593,"qdb_cluster":[10593]},"id":14}]} 2024-09-12T12:26:07.282 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 157 2024-09-12T12:26:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ff00678c0 msgr2=0x7f4ff0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ff00678c0 0x7f4ff0069d80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5014168a10 tx=0x7f5004009870 comp rx=0 tx=0).stop 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 msgr2=0x7f5014163390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 0x7f5014163390 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc019130 tx=0x7f4ffc0192c0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 shutdown_connections 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4ff00678c0 0x7f4ff0069d80 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5014147fc0 0x7f5014144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5014147a70 0x7f501415f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 --2- 172.21.15.144:0/3265137049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5014147570 0x7f5014163390 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 >> 172.21.15.144:0/3265137049 conn(0x7f501406f8b0 msgr2=0x7f50140b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 shutdown_connections 2024-09-12T12:26:07.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.282+0000 7f5018e00640 1 -- 172.21.15.144:0/3265137049 wait complete. 2024-09-12T12:26:07.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 157, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T12:26:01.386066+0000', 'modified': '2024-09-12T12:26:04.421876+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10593}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10593': {'gid': 10593, 'name': 'b', 'rank': 0, 'incarnation': 153, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.165:6835/2360370466', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6833', 'nonce': 2360370466}, {'type': 'v1', 'addr': '172.21.15.165:6835', 'nonce': 2360370466}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10593, 'qdb_cluster': [10593]} 2024-09-12T12:26:07.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T12:26:07.710 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T12:26:07.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.846+0000 7fa2e6000640 1 Processor -- start 2024-09-12T12:26:07.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.846+0000 7fa2e6000640 1 -- start start 2024-09-12T12:26:07.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2e6000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 0x7fa2e00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2e6000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa2e00ccf30 0x7fa2e00cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2e6000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2e00b45a0 con 0x7fa2e00b3ad0 2024-09-12T12:26:07.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2e6000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e00b3fe0 con 0x7fa2e00ccf30 2024-09-12T12:26:07.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2e6000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e00b42c0 con 0x7fa2e015b4e0 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2dea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa2e00b3ad0 0x7fa2e0071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47774/0 (socket says 172.21.15.144:47774) 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2dea00640 1 -- 172.21.15.144:0/3512842771 learned_addr learned my addr 172.21.15.144:0/3512842771 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2df400640 1 --2- 172.21.15.144:0/3512842771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 0x7fa2e00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2dfe00640 1 --2- 172.21.15.144:0/3512842771 >> v2:172.21.15.165:3300/0 conn(0x7fa2e00ccf30 0x7fa2e00cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2de000640 1 -- 172.21.15.144:0/3512842771 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2967096868 0 0) 0x7fa2e00b45a0 con 0x7fa2e00b3ad0 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2de000640 1 -- 172.21.15.144:0/3512842771 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c4003530 con 0x7fa2e00b3ad0 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2df400640 1 -- 172.21.15.144:0/3512842771 >> v2:172.21.15.165:3300/0 conn(0x7fa2e00ccf30 msgr2=0x7fa2e00cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2df400640 1 --2- 172.21.15.144:0/3512842771 >> v2:172.21.15.165:3300/0 conn(0x7fa2e00ccf30 0x7fa2e00cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2df400640 1 -- 172.21.15.144:0/3512842771 >> v1:172.21.15.144:6789/0 conn(0x7fa2e00b3ad0 legacy=0x7fa2e0071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.850+0000 7fa2df400640 1 -- 172.21.15.144:0/3512842771 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e00b1490 con 0x7fa2e015b4e0 2024-09-12T12:26:07.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2df400640 1 --2- 172.21.15.144:0/3512842771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 0x7fa2e00b3590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009d90 tx=0x7fa2d001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17ace96a536d5239 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2de000640 1 -- 172.21.15.144:0/3512842771 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00b2070 con 0x7fa2e015b4e0 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2de000640 1 -- 172.21.15.144:0/3512842771 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d00a5880 con 0x7fa2e015b4e0 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2de000640 1 -- 172.21.15.144:0/3512842771 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00a5c30 con 0x7fa2e015b4e0 2024-09-12T12:26:07.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 -- 172.21.15.144:0/3512842771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 msgr2=0x7fa2e00b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 --2- 172.21.15.144:0/3512842771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 0x7fa2e00b3590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0009d90 tx=0x7fa2d001c970 comp rx=0 tx=0).stop 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 -- 172.21.15.144:0/3512842771 shutdown_connections 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 --2- 172.21.15.144:0/3512842771 >> v2:172.21.15.165:3300/0 conn(0x7fa2e00ccf30 0x7fa2e00cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 --2- 172.21.15.144:0/3512842771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 0x7fa2e00b3590 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 -- 172.21.15.144:0/3512842771 >> 172.21.15.144:0/3512842771 conn(0x7fa2e006d0d0 msgr2=0x7fa2e006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 -- 172.21.15.144:0/3512842771 shutdown_connections 2024-09-12T12:26:07.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 -- 172.21.15.144:0/3512842771 wait complete. 2024-09-12T12:26:07.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 Processor -- start 2024-09-12T12:26:07.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 -- start start 2024-09-12T12:26:07.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2e00b3ad0 0x7fa2e0156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00ccf30 0x7fa2e0160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 0x7fa2e00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e015b8c0 con 0x7fa2e00ccf30 2024-09-12T12:26:07.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e0168260 con 0x7fa2e00b3ad0 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2e6000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e00cf2e0 con 0x7fa2e015b4e0 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.854+0000 7fa2dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00ccf30 0x7fa2e0160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00ccf30 0x7fa2e0160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52504/0 (socket says 172.21.15.144:52504) 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2dea00640 1 -- 172.21.15.144:0/479906374 learned_addr learned my addr 172.21.15.144:0/479906374 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2dfe00640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 0x7fa2e00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2df400640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2e00b3ad0 0x7fa2e0156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2dea00640 1 -- 172.21.15.144:0/479906374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 msgr2=0x7fa2e00ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2dea00640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 0x7fa2e00ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2dea00640 1 -- 172.21.15.144:0/479906374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2e00b3ad0 msgr2=0x7fa2e0156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2dea00640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2e00b3ad0 0x7fa2e0156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2dea00640 1 -- 172.21.15.144:0/479906374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e00cf5c0 con 0x7fa2e00ccf30 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2dea00640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00ccf30 0x7fa2e0160200 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00c420 tx=0x7fa2cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2d7400640 1 -- 172.21.15.144:0/479906374 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc017070 con 0x7fa2e00ccf30 2024-09-12T12:26:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2d7400640 1 -- 172.21.15.144:0/479906374 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2cc005d10 con 0x7fa2e00ccf30 2024-09-12T12:26:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2d7400640 1 -- 172.21.15.144:0/479906374 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc007310 con 0x7fa2e00ccf30 2024-09-12T12:26:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2e6000640 1 -- 172.21.15.144:0/479906374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e00cf8a0 con 0x7fa2e00ccf30 2024-09-12T12:26:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2e6000640 1 -- 172.21.15.144:0/479906374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e00cfe60 con 0x7fa2e00ccf30 2024-09-12T12:26:07.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2d7400640 1 -- 172.21.15.144:0/479906374 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa2cc01a070 con 0x7fa2e00ccf30 2024-09-12T12:26:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2d7400640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2c00678c0 0x7fa2c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.858+0000 7fa2d7400640 1 -- 172.21.15.144:0/479906374 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7fa2cc0852c0 con 0x7fa2e00ccf30 2024-09-12T12:26:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2df400640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2c00678c0 0x7fa2c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 Processor -- start 2024-09-12T12:26:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 -- start start 2024-09-12T12:26:07.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2df400640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2c00678c0 0x7fa2c0069d80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00af000 tx=0x7fa2d00a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62af1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 0x560e62aa7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aa8290 0x560e62aa8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560e6298fb60 con 0x560e62aa8290 2024-09-12T12:26:07.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560e628f6c70 con 0x560e62af2440 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560e6289ced0 con 0x560e62af1b20 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aa8290 0x560e62aa8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aa8290 0x560e62aa8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52516/0 (socket says 172.21.15.144:52516) 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dfe00640 1 -- 172.21.15.144:0/3775595796 learned_addr learned my addr 172.21.15.144:0/3775595796 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dea00640 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 0x560e62aa7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2df400640 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62af1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dfe00640 1 -- 172.21.15.144:0/3775595796 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 msgr2=0x560e62af1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dfe00640 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62af1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dfe00640 1 -- 172.21.15.144:0/3775595796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 msgr2=0x560e62aa7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dfe00640 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 0x560e62aa7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dfe00640 1 -- 172.21.15.144:0/3775595796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e628aee50 con 0x560e62aa8290 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dea00640 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 0x560e62aa7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2dfe00640 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aa8290 0x560e62aa8670 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009b80 tx=0x7fa2d8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d09496685765e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2cbe00640 1 -- 172.21.15.144:0/3775595796 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8019070 con 0x560e62aa8290 2024-09-12T12:26:07.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2cbe00640 1 -- 172.21.15.144:0/3775595796 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d8009c70 con 0x560e62aa8290 2024-09-12T12:26:07.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2cbe00640 1 -- 172.21.15.144:0/3775595796 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8015680 con 0x560e62aa8290 2024-09-12T12:26:07.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 -- 172.21.15.144:0/3775595796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aa8290 msgr2=0x560e62aa8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aa8290 0x560e62aa8670 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009b80 tx=0x7fa2d8009190 comp rx=0 tx=0).stop 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 -- 172.21.15.144:0/3775595796 shutdown_connections 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aa8290 0x560e62aa8670 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 0x560e62aa7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/3775595796 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62af1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 -- 172.21.15.144:0/3775595796 >> 172.21.15.144:0/3775595796 conn(0x560e62aae600 msgr2=0x560e62aa6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 -- 172.21.15.144:0/3775595796 shutdown_connections 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.862+0000 7fa2e93b9000 1 -- 172.21.15.144:0/3775595796 wait complete. 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 -- start start 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 Processor -- start 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62aace50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62af2440 0x560e62ab2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62aad390 0x560e62ab3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560e62958b00 con 0x560e62af2440 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560e628d1360 con 0x560e62aad390 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560e628ce2d0 con 0x560e62af1b20 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 10 client.0 _ll_register_callbacks cb 0x560e62a93820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62af2440 0x560e62ab2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62af2440 0x560e62ab2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52526/0 (socket says 172.21.15.144:52526) 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2df400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62aace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dea00640 1 -- 172.21.15.144:0/1295221272 learned_addr learned my addr 172.21.15.144:0/1295221272 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dfe00640 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62aad390 0x560e62ab3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dea00640 1 -- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 msgr2=0x560e62aace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dea00640 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62aace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dea00640 1 -- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62aad390 msgr2=0x560e62ab3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dea00640 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62aad390 0x560e62ab3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dea00640 1 -- 172.21.15.144:0/1295221272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e6289d120 con 0x560e62af2440 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2dea00640 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62af2440 0x560e62ab2cf0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc055520 tx=0x7fa2cc059a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ecaa9df3b93545 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2c8c00640 1 -- 172.21.15.144:0/1295221272 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0076b0 con 0x560e62af2440 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 -- 172.21.15.144:0/1295221272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2d8009c70 con 0x560e62af2440 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2c8c00640 1 -- 172.21.15.144:0/1295221272 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7fa2cc0549e0 con 0x560e62af2440 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2c8c00640 1 -- 172.21.15.144:0/1295221272 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7fa2cc054be0 con 0x560e62af2440 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 10 client.10728 fetch_fsmap learned FSMap version 157 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 -- 172.21.15.144:0/1295221272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) -- 0x560e62896450 con 0x560e62af2440 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2c8c00640 1 -- 172.21.15.144:0/1295221272 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d8009c70 con 0x560e62af2440 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2c8c00640 1 -- 172.21.15.144:0/1295221272 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 157) ==== 3502+0+0 (secure 0 0 0) 0x7fa2cc0512e0 con 0x560e62af2440 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 10 client.10728 fetch_fsmap finished waiting for FSMap version 157 2024-09-12T12:26:07.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 10 client.10728 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:26:07.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 20 client.10728 populate_metadata read hostname 'smithi144' 2024-09-12T12:26:07.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x560e62af7f50 0x560e62af8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 4 client.10728 mds_command: new command op to 10593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:07.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2e93b9000 1 -- 172.21.15.144:0/1295221272 --> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e62890c00 con 0x560e62af7f50 2024-09-12T12:26:07.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.866+0000 7fa2df400640 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x560e62af7f50 0x560e62af8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2c8c00640 10 client.10728 ms_handle_connect on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:07.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2df400640 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x560e62af7f50 0x560e62af8330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83c1e3d1cda261c0 server_cookie=a11111564ad0b743 in_seq=0 out_seq=0 2024-09-12T12:26:07.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2c8c00640 1 -- 172.21.15.144:0/1295221272 <== mds.0 v2:172.21.15.165:6833/2360370466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e62890c00 con 0x560e62af7f50 2024-09-12T12:26:07.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2c8c00640 10 client.10728 handle_command_reply: tid=0 2024-09-12T12:26:07.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 client.10728 shutdown 2024-09-12T12:26:07.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 -- 172.21.15.144:0/1295221272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62af2440 msgr2=0x560e62ab2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62af2440 0x560e62ab2cf0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc055520 tx=0x7fa2cc059a80 comp rx=0 tx=0).stop 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 -- 172.21.15.144:0/1295221272 shutdown_connections 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x560e62af7f50 0x560e62af8330 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62aad390 0x560e62ab3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62af2440 0x560e62ab2cf0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2c8c00640 0 client.10728 ms_handle_reset on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/1295221272 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62aace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 -- 172.21.15.144:0/1295221272 >> 172.21.15.144:0/1295221272 conn(0x560e62aa8290 msgr2=0x560e62aa6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 -- 172.21.15.144:0/1295221272 shutdown_connections 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 1 -- 172.21.15.144:0/1295221272 wait complete. 2024-09-12T12:26:07.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.870+0000 7fa2e93b9000 20 client.10728 trim_cache size 0 max 16384 2024-09-12T12:26:07.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.886+0000 7fa2e93b9000 1 Processor -- start 2024-09-12T12:26:07.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.886+0000 7fa2e93b9000 1 -- start start 2024-09-12T12:26:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62af1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62b08010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 0x560e62b08550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e02031a0 con 0x560e62aad390 2024-09-12T12:26:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e0163010 con 0x560e62af2440 2024-09-12T12:26:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e0202bd0 con 0x560e62af1b20 2024-09-12T12:26:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62af1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62af1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52528/0 (socket says 172.21.15.144:52528) 2024-09-12T12:26:07.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2df400640 1 -- 172.21.15.144:0/2541831192 learned_addr learned my addr 172.21.15.144:0/2541831192 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:07.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2df400640 1 -- 172.21.15.144:0/2541831192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 msgr2=0x560e62b08010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2df400640 1 --2- 172.21.15.144:0/2541831192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62b08010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2df400640 1 -- 172.21.15.144:0/2541831192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 msgr2=0x560e62b08550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2df400640 1 --2- 172.21.15.144:0/2541831192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 0x560e62b08550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2df400640 1 -- 172.21.15.144:0/2541831192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e6287dfd0 con 0x560e62aad390 2024-09-12T12:26:07.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2df400640 1 --2- 172.21.15.144:0/2541831192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62af1500 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00ba040 tx=0x7fa2d0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05d928e7d0e5cda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2cb400640 1 -- 172.21.15.144:0/2541831192 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00bc040 con 0x560e62aad390 2024-09-12T12:26:07.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2cb400640 1 -- 172.21.15.144:0/2541831192 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d00a5a50 con 0x560e62aad390 2024-09-12T12:26:07.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2cb400640 1 -- 172.21.15.144:0/2541831192 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00b2040 con 0x560e62aad390 2024-09-12T12:26:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- 172.21.15.144:0/2541831192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 msgr2=0x560e62af1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/2541831192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62af1500 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00ba040 tx=0x7fa2d0004ac0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- 172.21.15.144:0/2541831192 shutdown_connections 2024-09-12T12:26:07.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/2541831192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af2440 0x560e62b08550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/2541831192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af1b20 0x560e62b08010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/2541831192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62af1500 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- 172.21.15.144:0/2541831192 >> 172.21.15.144:0/2541831192 conn(0x560e62aa8290 msgr2=0x560e62aac8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- 172.21.15.144:0/2541831192 shutdown_connections 2024-09-12T12:26:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- 172.21.15.144:0/2541831192 wait complete. 2024-09-12T12:26:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- start start 2024-09-12T12:26:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 Processor -- start 2024-09-12T12:26:07.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62b6d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af1b20 0x560e62b6dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af2440 0x560e62afb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560e628f5f80 con 0x560e62aad390 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560e628aeca0 con 0x560e62af1b20 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.890+0000 7fa2e93b9000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560e628fb2a0 con 0x560e62af2440 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 10 client.0 _ll_register_callbacks cb 0x7fa2cc005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62b6d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62b6d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52532/0 (socket says 172.21.15.144:52532) 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2df400640 1 -- 172.21.15.144:0/564602300 learned_addr learned my addr 172.21.15.144:0/564602300 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2df400640 1 -- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af2440 msgr2=0x560e62afb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2df400640 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af2440 0x560e62afb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2df400640 1 -- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af1b20 msgr2=0x560e62b6dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:07.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2dea00640 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af1b20 0x560e62b6dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2df400640 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af1b20 0x560e62b6dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2df400640 1 -- 172.21.15.144:0/564602300 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e62979750 con 0x560e62aad390 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2dea00640 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af1b20 0x560e62b6dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2df400640 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62b6d6a0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fa2d001c9b0 tx=0x7fa2d001b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657c761406680e20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 1 -- 172.21.15.144:0/564602300 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00b2040 con 0x560e62aad390 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 1 -- 172.21.15.144:0/564602300 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7fa2d00cb040 con 0x560e62aad390 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 -- 172.21.15.144:0/564602300 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2d00a5a50 con 0x560e62aad390 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 1 -- 172.21.15.144:0/564602300 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7fa2d00bc040 con 0x560e62aad390 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 10 client.10734 fetch_fsmap learned FSMap version 157 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 -- 172.21.15.144:0/564602300 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) -- 0x560e62884a30 con 0x560e62aad390 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 1 -- 172.21.15.144:0/564602300 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d00a5a50 con 0x560e62aad390 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 1 -- 172.21.15.144:0/564602300 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 157) ==== 3502+0+0 (secure 0 0 0) 0x7fa2d0004000 con 0x560e62aad390 2024-09-12T12:26:07.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 10 client.10734 fetch_fsmap finished waiting for FSMap version 157 2024-09-12T12:26:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 10 client.10734 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:26:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 20 client.10734 populate_metadata read hostname 'smithi144' 2024-09-12T12:26:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x560e62afbd30 0x560e62afc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 4 client.10734 mds_command: new command op to 10593 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:26:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 -- 172.21.15.144:0/564602300 --> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] -- command(tid 0: {"prefix": "status"}) -- 0x560e629043a0 con 0x560e62afbd30 2024-09-12T12:26:07.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2dea00640 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x560e62afbd30 0x560e62afc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:07.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2dea00640 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x560e62afbd30 0x560e62afc110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37d5d3e58f3e6d69 server_cookie=ce1bc6584a8a02fd in_seq=0 out_seq=0 2024-09-12T12:26:07.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 10 client.10734 ms_handle_connect on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:07.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 1 -- 172.21.15.144:0/564602300 <== mds.0 v2:172.21.15.165:6833/2360370466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x560e629043a0 con 0x560e62afbd30 2024-09-12T12:26:07.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 10 client.10734 handle_command_reply: tid=0 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 client.10734 shutdown 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 -- 172.21.15.144:0/564602300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 msgr2=0x560e62b6d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62b6d6a0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fa2d001c9b0 tx=0x7fa2d001b1b0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 -- 172.21.15.144:0/564602300 shutdown_connections 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x560e62afbd30 0x560e62afc110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x560e62af2440 0x560e62afb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e62af1b20 0x560e62b6dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2c8c00640 0 client.10734 ms_handle_reset on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 --2- 172.21.15.144:0/564602300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560e62aad390 0x560e62b6d6a0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 -- 172.21.15.144:0/564602300 >> 172.21.15.144:0/564602300 conn(0x560e62aa8290 msgr2=0x560e62b07000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 -- 172.21.15.144:0/564602300 shutdown_connections 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 1 -- 172.21.15.144:0/564602300 wait complete. 2024-09-12T12:26:07.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e93b9000 20 client.10734 trim_cache size 0 max 16384 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "91f78d05-407b-4adf-ae67-409c5ce36eb9", 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 10593, 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 5.8786335760000004, 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 157, 2024-09-12T12:26:07.903 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 202, 2024-09-12T12:26:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 202, 2024-09-12T12:26:07.904 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.745014079000001 2024-09-12T12:26:07.904 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:07.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e6000640 1 -- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2c00678c0 msgr2=0x7fa2c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e6000640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2c00678c0 0x7fa2c0069d80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00af000 tx=0x7fa2d00a7070 comp rx=0 tx=0).stop 2024-09-12T12:26:07.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e6000640 1 -- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00ccf30 msgr2=0x7fa2e0160200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.894+0000 7fa2e6000640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00ccf30 0x7fa2e0160200 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00c420 tx=0x7fa2cc00c8e0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.898+0000 7fa2e6000640 1 -- 172.21.15.144:0/479906374 shutdown_connections 2024-09-12T12:26:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.898+0000 7fa2e6000640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa2c00678c0 0x7fa2c0069d80 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.898+0000 7fa2e6000640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2e015b4e0 0x7fa2e00ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.898+0000 7fa2e6000640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e00ccf30 0x7fa2e0160200 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.898+0000 7fa2e6000640 1 --2- 172.21.15.144:0/479906374 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2e00b3ad0 0x7fa2e0156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.898+0000 7fa2e6000640 1 -- 172.21.15.144:0/479906374 >> 172.21.15.144:0/479906374 conn(0x7fa2e006d0d0 msgr2=0x7fa2e00713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.898+0000 7fa2e6000640 1 -- 172.21.15.144:0/479906374 shutdown_connections 2024-09-12T12:26:07.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:07.898+0000 7fa2e6000640 1 -- 172.21.15.144:0/479906374 wait complete. 2024-09-12T12:26:07.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T12:26:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.050+0000 7fc975e00640 1 Processor -- start 2024-09-12T12:26:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.050+0000 7fc975e00640 1 -- start start 2024-09-12T12:26:08.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc975e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc97015b4e0 0x7fc9700b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc975e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9700b3ad0 0x7fc970071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc975e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc970071960 0x7fc9700ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc975e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc9700b45a0 con 0x7fc9700b3ad0 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc975e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc9700b3fe0 con 0x7fc97015b4e0 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc975e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc9700b42c0 con 0x7fc970071960 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9700b3ad0 0x7fc970071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc97015b4e0 0x7fc9700b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc97015b4e0 0x7fc9700b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:43372/0 (socket says 172.21.15.144:43372) 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96ea00640 1 -- 172.21.15.144:0/2660438337 learned_addr learned my addr 172.21.15.144:0/2660438337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:08.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96f400640 1 --2- 172.21.15.144:0/2660438337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc970071960 0x7fc9700ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96e000640 1 -- 172.21.15.144:0/2660438337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc970071960 msgr2=0x7fc9700ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:08.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96e000640 1 --2- 172.21.15.144:0/2660438337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc970071960 0x7fc9700ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96e000640 1 -- 172.21.15.144:0/2660438337 >> v2:172.21.15.165:3300/0 conn(0x7fc97015b4e0 msgr2=0x7fc9700b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:08.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96e000640 1 --2- 172.21.15.144:0/2660438337 >> v2:172.21.15.165:3300/0 conn(0x7fc97015b4e0 0x7fc9700b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96e000640 1 -- 172.21.15.144:0/2660438337 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9700b1490 con 0x7fc9700b3ad0 2024-09-12T12:26:08.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.054+0000 7fc96ea00640 1 --2- 172.21.15.144:0/2660438337 >> v2:172.21.15.165:3300/0 conn(0x7fc97015b4e0 0x7fc9700b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:08.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc96e000640 1 --2- 172.21.15.144:0/2660438337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9700b3ad0 0x7fc970071420 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fc970069450 tx=0x7fc95c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8528200785ff6ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:08.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc96d600640 1 -- 172.21.15.144:0/2660438337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0b0070 con 0x7fc9700b3ad0 2024-09-12T12:26:08.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc96d600640 1 -- 172.21.15.144:0/2660438337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c0ab600 con 0x7fc9700b3ad0 2024-09-12T12:26:08.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc96d600640 1 -- 172.21.15.144:0/2660438337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0ab9d0 con 0x7fc9700b3ad0 2024-09-12T12:26:08.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 -- 172.21.15.144:0/2660438337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9700b3ad0 msgr2=0x7fc970071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 --2- 172.21.15.144:0/2660438337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9700b3ad0 0x7fc970071420 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fc970069450 tx=0x7fc95c01c450 comp rx=0 tx=0).stop 2024-09-12T12:26:08.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 -- 172.21.15.144:0/2660438337 shutdown_connections 2024-09-12T12:26:08.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 --2- 172.21.15.144:0/2660438337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9700b3ad0 0x7fc970071420 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 --2- 172.21.15.144:0/2660438337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc970071960 0x7fc9700ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 --2- 172.21.15.144:0/2660438337 >> v2:172.21.15.165:3300/0 conn(0x7fc97015b4e0 0x7fc9700b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 -- 172.21.15.144:0/2660438337 >> 172.21.15.144:0/2660438337 conn(0x7fc97006d0d0 msgr2=0x7fc97006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:08.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 -- 172.21.15.144:0/2660438337 shutdown_connections 2024-09-12T12:26:08.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 -- 172.21.15.144:0/2660438337 wait complete. 2024-09-12T12:26:08.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 Processor -- start 2024-09-12T12:26:08.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.058+0000 7fc975e00640 1 -- start start 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc975e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc970071960 0x7fc970158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc975e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9700b3ad0 0x7fc97015db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc975e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97015b4e0 0x7fc9701407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc975e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc97015f270 con 0x7fc97015b4e0 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc975e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc97015f0f0 con 0x7fc970071960 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc975e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc97015f3f0 con 0x7fc9700b3ad0 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97015b4e0 0x7fc9701407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97015b4e0 0x7fc9701407d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52548/0 (socket says 172.21.15.144:52548) 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96f400640 1 -- 172.21.15.144:0/252129845 learned_addr learned my addr 172.21.15.144:0/252129845 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96e000640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9700b3ad0 0x7fc97015db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96ea00640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc970071960 0x7fc970158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96f400640 1 -- 172.21.15.144:0/252129845 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9700b3ad0 msgr2=0x7fc97015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96f400640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9700b3ad0 0x7fc97015db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96f400640 1 -- 172.21.15.144:0/252129845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc970071960 msgr2=0x7fc970158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96f400640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc970071960 0x7fc970158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96f400640 1 -- 172.21.15.144:0/252129845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97015e350 con 0x7fc97015b4e0 2024-09-12T12:26:08.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc96f400640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97015b4e0 0x7fc9701407d0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fc96800efc0 tx=0x7fc96800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:08.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc967400640 1 -- 172.21.15.144:0/252129845 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968018020 con 0x7fc97015b4e0 2024-09-12T12:26:08.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc967400640 1 -- 172.21.15.144:0/252129845 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc968014480 con 0x7fc97015b4e0 2024-09-12T12:26:08.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97015e630 con 0x7fc97015b4e0 2024-09-12T12:26:08.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc967400640 1 -- 172.21.15.144:0/252129845 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968014870 con 0x7fc97015b4e0 2024-09-12T12:26:08.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc970156c80 con 0x7fc97015b4e0 2024-09-12T12:26:08.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc970071420 con 0x7fc97015b4e0 2024-09-12T12:26:08.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.062+0000 7fc967400640 1 -- 172.21.15.144:0/252129845 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc96801b020 con 0x7fc97015b4e0 2024-09-12T12:26:08.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.066+0000 7fc967400640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9500678f0 0x7fc950069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:08.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.066+0000 7fc967400640 1 -- 172.21.15.144:0/252129845 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7fc968086ab0 con 0x7fc97015b4e0 2024-09-12T12:26:08.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.066+0000 7fc96ea00640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9500678f0 0x7fc950069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:08.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.066+0000 7fc96ea00640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9500678f0 0x7fc950069db0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc9600096d0 tx=0x7fc960009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:08.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.070+0000 7fc967400640 1 -- 172.21.15.144:0/252129845 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc968022030 con 0x7fc97015b4e0 2024-09-12T12:26:08.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.262+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc9700af920 con 0x7fc97015b4e0 2024-09-12T12:26:08.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.262+0000 7fc967400640 1 -- 172.21.15.144:0/252129845 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v157) ==== 53+0+73 (secure 0 0 0) 0x7fc968010040 con 0x7fc97015b4e0 2024-09-12T12:26:08.265 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:26:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.262+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9500678f0 msgr2=0x7fc950069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.262+0000 7fc975e00640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9500678f0 0x7fc950069db0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fc9600096d0 tx=0x7fc960009240 comp rx=0 tx=0).stop 2024-09-12T12:26:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.262+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97015b4e0 msgr2=0x7fc9701407d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.262+0000 7fc975e00640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97015b4e0 0x7fc9701407d0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fc96800efc0 tx=0x7fc96800c490 comp rx=0 tx=0).stop 2024-09-12T12:26:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.266+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 shutdown_connections 2024-09-12T12:26:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.266+0000 7fc975e00640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fc9500678f0 0x7fc950069db0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.266+0000 7fc975e00640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc97015b4e0 0x7fc9701407d0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.266+0000 7fc975e00640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9700b3ad0 0x7fc97015db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.266+0000 7fc975e00640 1 --2- 172.21.15.144:0/252129845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc970071960 0x7fc970158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:08.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.266+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 >> 172.21.15.144:0/252129845 conn(0x7fc97006d0d0 msgr2=0x7fc9700ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:08.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.266+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 shutdown_connections 2024-09-12T12:26:08.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08.266+0000 7fc975e00640 1 -- 172.21.15.144:0/252129845 wait complete. 2024-09-12T12:26:08.286 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T12:26:08.286 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:26:08.286 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-12T12:26:08.286 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:26:08.286 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:08.286 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T12:26:08.286 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T12:26:08.286 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:26:08.287 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:26:08.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:08.287 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-12T12:26:08.296 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:26:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:26:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:26:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-12T12:26:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:08.296 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:26:08.296 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 41615sec preferred_lft 41615sec 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:08.297 INFO:teuthology.orchestra.run.smithi144.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 02:42:b9:3c:43:27 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:26:08.298 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T12:26:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:08.299 INFO:teuthology.orchestra.run.smithi144.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T12:26:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:26:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T12:26:08.299 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:26:08.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:08.300 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:26:08.359 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-12T12:26:08.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:08.361 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T12:26:08.414 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:26:08.415 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:26:08.415 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-12T12:26:08.415 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:26:08.415 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:26:08.415 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:26:08.415 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-12T12:26:08.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:26:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:08.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:08.548 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:26:08.557 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:26:08.557 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:26:08.557 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:26:08.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:08.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-12T12:26:08.622 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:26:08.622 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:08.674 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:26:08.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:26:08.675 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:08.729 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T12:26:08.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:08.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:26:08.819 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:26:08.819 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:26:08.832 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T12:26:08.832 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T12:26:08.832 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-12T12:26:08.832 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@91f78d05-407b-4adf-ae67-409c5ce36eb9.cephfs=/ 2024-09-12T12:26:08.833 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-12T12:26:08.837 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:26:08.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:08.837 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:08.859 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:26:08.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:26:08.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:08.967 INFO:teuthology.orchestra.run.smithi144.stdout:client10743 2024-09-12T12:26:08.968 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:26:08.968 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:08.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:08.977 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-12T12:26:09.033 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:26:09.033 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:09.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:09.087 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-12T12:26:09.213 INFO:teuthology.orchestra.run.smithi144.stderr:6+0 records in 2024-09-12T12:26:09.214 INFO:teuthology.orchestra.run.smithi144.stderr:6+0 records out 2024-09-12T12:26:09.214 INFO:teuthology.orchestra.run.smithi144.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0734811 s, 85.6 MB/s 2024-09-12T12:26:09.216 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T12:26:09.219 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T12:26:09.258 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-09-12T12:26:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-09-12T12:26:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T12:26:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-09-12T12:26:09.258 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.259 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T12:26:09.260 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2024-09-12T12:26:09.261 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 91f78d05-407b-4adf-ae67-409c5ce36eb9 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-09-12T12:26:09.262 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug trim objects = true 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-09-12T12:26:09.263 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-09-12T12:26:09.264 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-09-12T12:26:09.265 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T12:26:09.266 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: mon down mkfs grace = 300 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2024-09-12T12:26:09.267 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on pool no app = False 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = "" 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-09-12T12:26:09.268 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds balancer = 20 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: mds cache max size = 1000 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: mds log max segments = 1 2024-09-12T12:26:09.269 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2024-09-12T12:26:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = False 2024-09-12T12:26:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-09-12T12:26:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-09-12T12:26:09.270 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-09-12T12:26:09.270 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2024-09-12T12:26:09.270 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2024-09-12T12:26:09.271 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T12:26:09.271 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2024-09-12T12:26:09.271 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.271 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2024-09-12T12:26:09.271 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.271 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2024-09-12T12:26:09.271 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.271 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.272 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2024-09-12T12:26:09.273 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = "172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on skipped message = False 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = 91f78d05-407b-4adf-ae67-409c5ce36eb9 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.274 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 600 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock profile = high_recovery_ops 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug trim objects = true 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2024-09-12T12:26:09.275 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2024-09-12T12:26:09.276 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 20 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 20 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 10 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.277 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2024-09-12T12:26:09.278 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.279 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: mon down mkfs grace = 300 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: mon op complaint time = 120 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on pool no app = False 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T12:26:09.280 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout: client mount timeout = 600 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = "" 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.b] 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.c] 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.a] 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.c] 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.b] 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.d] 2024-09-12T12:26:09.281 INFO:teuthology.orchestra.run.smithi165.stdout:[mds] 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds = 20 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds balancer = 20 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: mds cache max size = 1000 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug frag = True 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug scatterstat = True 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: mds log max segments = 1 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: mds op complaint time = 180 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: mds verify scatter = False 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-09-12T12:26:09.282 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-09-12T12:26:09.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T12:26:09.329 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T12:26:09.367 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-09-12T12:26:09.368 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-09-12T12:26:09.369 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-09-12T12:26:09.370 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.371 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-09-12T12:26:09.371 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-09-12T12:26:09.371 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-09-12T12:26:09.371 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-09-12T12:26:09.371 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2024-09-12T12:26:09.371 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 91f78d05-407b-4adf-ae67-409c5ce36eb9 2024-09-12T12:26:09.371 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.371 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-09-12T12:26:09.371 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-09-12T12:26:09.372 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug trim objects = true 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.373 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-09-12T12:26:09.374 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.375 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T12:26:09.376 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon down mkfs grace = 300 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on pool no app = False 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-09-12T12:26:09.377 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = "" 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-09-12T12:26:09.378 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds balancer = 20 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout: mds cache max size = 1000 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = False 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout: mds log max segments = 1 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2024-09-12T12:26:09.379 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = False 2024-09-12T12:26:09.380 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-09-12T12:26:09.380 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-09-12T12:26:09.380 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-09-12T12:26:09.380 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2024-09-12T12:26:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2024-09-12T12:26:09.380 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.381 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2024-09-12T12:26:09.382 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2024-09-12T12:26:09.383 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = "172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on skipped message = False 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = 91f78d05-407b-4adf-ae67-409c5ce36eb9 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 600 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock profile = high_recovery_ops 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2024-09-12T12:26:09.384 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug trim objects = true 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2024-09-12T12:26:09.385 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 20 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 20 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 10 2024-09-12T12:26:09.386 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2024-09-12T12:26:09.387 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-12T12:26:09.388 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: mon down mkfs grace = 300 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: mon op complaint time = 120 2024-09-12T12:26:09.389 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on pool no app = False 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: client mount timeout = 600 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = "" 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-09-12T12:26:09.390 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.b] 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.c] 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.a] 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.c] 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.b] 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.d] 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout:[mds] 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds = 20 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds balancer = 20 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout: mds cache max size = 1000 2024-09-12T12:26:09.391 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug frag = True 2024-09-12T12:26:09.392 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug scatterstat = False 2024-09-12T12:26:09.392 INFO:teuthology.orchestra.run.smithi165.stdout: mds log max segments = 1 2024-09-12T12:26:09.392 INFO:teuthology.orchestra.run.smithi165.stdout: mds op complaint time = 180 2024-09-12T12:26:09.392 INFO:teuthology.orchestra.run.smithi165.stdout: mds verify scatter = False 2024-09-12T12:26:09.392 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-09-12T12:26:09.392 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-09-12T12:26:09.392 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> import stat 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> import json 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> import sys 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> try: 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> except OSError as e: 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> sys.exit(e.errno) 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:26:09.394 DEBUG:teuthology.orchestra.run.smithi144:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-12T12:26:09.395 DEBUG:teuthology.orchestra.run.smithi144:> print(json.dumps( 2024-09-12T12:26:09.395 DEBUG:teuthology.orchestra.run.smithi144:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-12T12:26:09.395 DEBUG:teuthology.orchestra.run.smithi144:> indent=2)) 2024-09-12T12:26:09.395 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:26:09.502 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "st_mode": 33204, 2024-09-12T12:26:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "st_ino": 1099511627777, 2024-09-12T12:26:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "st_dev": 44, 2024-09-12T12:26:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "st_nlink": 1, 2024-09-12T12:26:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "st_uid": 1000, 2024-09-12T12:26:09.502 INFO:teuthology.orchestra.run.smithi144.stdout: "st_gid": 1271, 2024-09-12T12:26:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "st_size": 6291456, 2024-09-12T12:26:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "st_atime": 1726143969.1383405, 2024-09-12T12:26:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "st_mtime": 1726143969.1703398, 2024-09-12T12:26:09.503 INFO:teuthology.orchestra.run.smithi144.stdout: "st_ctime": 1726143969.1703398 2024-09-12T12:26:09.503 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:09.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:09.511 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:26:09.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78f0200640 1 Processor -- start 2024-09-12T12:26:09.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78f0200640 1 -- start start 2024-09-12T12:26:09.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78f0200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f78e8148190 0x7f78e80ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78f0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e80cd470 0x7f78e80afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78f0200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e8148570 con 0x7f78e80b02b0 2024-09-12T12:26:09.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78f0200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f78e80ce090 con 0x7f78e8148190 2024-09-12T12:26:09.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78f0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f78e80b0710 con 0x7f78e80cd470 2024-09-12T12:26:09.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78ece00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e80cd470 0x7f78e80afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78ed800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f78e8148190 0x7f78e80ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78ee200640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f78e80b02b0 0x7f78e80ae890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:33770/0 (socket says 172.21.15.144:33770) 2024-09-12T12:26:09.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78ee200640 1 -- 172.21.15.144:0/3242813121 learned_addr learned my addr 172.21.15.144:0/3242813121 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:09.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78ece00640 1 -- 172.21.15.144:0/3242813121 >> v2:172.21.15.165:3300/0 conn(0x7f78e8148190 msgr2=0x7f78e80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:09.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78ece00640 1 --2- 172.21.15.144:0/3242813121 >> v2:172.21.15.165:3300/0 conn(0x7f78e8148190 0x7f78e80ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78ece00640 1 -- 172.21.15.144:0/3242813121 >> v1:172.21.15.165:6789/0 conn(0x7f78e80b02b0 legacy=0x7f78e80ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.694+0000 7f78ece00640 1 -- 172.21.15.144:0/3242813121 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e80b41f0 con 0x7f78e80cd470 2024-09-12T12:26:09.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78ece00640 1 --2- 172.21.15.144:0/3242813121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e80cd470 0x7f78e80afd70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f78d40097c0 tx=0x7f78d401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1679152af4d57822 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:09.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78e7e00640 1 -- 172.21.15.144:0/3242813121 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d40b0070 con 0x7f78e80cd470 2024-09-12T12:26:09.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78e7e00640 1 -- 172.21.15.144:0/3242813121 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d40ab600 con 0x7f78e80cd470 2024-09-12T12:26:09.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78e7e00640 1 -- 172.21.15.144:0/3242813121 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d40ab9d0 con 0x7f78e80cd470 2024-09-12T12:26:09.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78f0200640 1 -- 172.21.15.144:0/3242813121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e80cd470 msgr2=0x7f78e80afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78f0200640 1 --2- 172.21.15.144:0/3242813121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e80cd470 0x7f78e80afd70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f78d40097c0 tx=0x7f78d401c4a0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78f0200640 1 -- 172.21.15.144:0/3242813121 shutdown_connections 2024-09-12T12:26:09.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78f0200640 1 --2- 172.21.15.144:0/3242813121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e80cd470 0x7f78e80afd70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78f0200640 1 --2- 172.21.15.144:0/3242813121 >> v2:172.21.15.165:3300/0 conn(0x7f78e8148190 0x7f78e80ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78f0200640 1 -- 172.21.15.144:0/3242813121 >> 172.21.15.144:0/3242813121 conn(0x7f78e806d0d0 msgr2=0x7f78e806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:09.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78f0200640 1 -- 172.21.15.144:0/3242813121 shutdown_connections 2024-09-12T12:26:09.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.698+0000 7f78f0200640 1 -- 172.21.15.144:0/3242813121 wait complete. 2024-09-12T12:26:09.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 Processor -- start 2024-09-12T12:26:09.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 -- start start 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e80b02b0 0x7f78e815d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e80cd470 0x7f78e813ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e8148190 0x7f78e8072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f78e816b570 con 0x7f78e80b02b0 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78e80b11f0 con 0x7f78e80cd470 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f78e816b6f0 con 0x7f78e8148190 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ed800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e80b02b0 0x7f78e815d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ed800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e80b02b0 0x7f78e815d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52552/0 (socket says 172.21.15.144:52552) 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ed800640 1 -- 172.21.15.144:0/46817547 learned_addr learned my addr 172.21.15.144:0/46817547 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ece00640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e80cd470 0x7f78e813ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ee200640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e8148190 0x7f78e8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ece00640 1 -- 172.21.15.144:0/46817547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e8148190 msgr2=0x7f78e8072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ece00640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e8148190 0x7f78e8072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ece00640 1 -- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e80b02b0 msgr2=0x7f78e815d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ece00640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e80b02b0 0x7f78e815d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ece00640 1 -- 172.21.15.144:0/46817547 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e8072e40 con 0x7f78e80cd470 2024-09-12T12:26:09.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ed800640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e80b02b0 0x7f78e815d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:09.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78ece00640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e80cd470 0x7f78e813ac00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f78d40ab000 tx=0x7f78d4019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:09.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78e5600640 1 -- 172.21.15.144:0/46817547 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d40b0040 con 0x7f78e80cd470 2024-09-12T12:26:09.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78e5600640 1 -- 172.21.15.144:0/46817547 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d40ba070 con 0x7f78e80cd470 2024-09-12T12:26:09.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78e5600640 1 -- 172.21.15.144:0/46817547 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d40b4650 con 0x7f78e80cd470 2024-09-12T12:26:09.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e80730e0 con 0x7f78e80cd470 2024-09-12T12:26:09.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.702+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e80736a0 con 0x7f78e80cd470 2024-09-12T12:26:09.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.706+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e8073d60 con 0x7f78e80cd470 2024-09-12T12:26:09.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.706+0000 7f78e5600640 1 -- 172.21.15.144:0/46817547 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78d40db890 con 0x7f78e80cd470 2024-09-12T12:26:09.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.706+0000 7f78e5600640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c80678c0 0x7f78c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:09.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.706+0000 7f78e5600640 1 -- 172.21.15.144:0/46817547 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f78d411fb70 con 0x7f78e80cd470 2024-09-12T12:26:09.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.706+0000 7f78ed800640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c80678c0 0x7f78c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:09.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.706+0000 7f78ed800640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c80678c0 0x7f78c8069d80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0094c0 tx=0x7f78dc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:09.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.710+0000 7f78e5600640 1 -- 172.21.15.144:0/46817547 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f78e8073d60 con 0x7f78e80cd470 2024-09-12T12:26:09.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.902+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78e80cd230 con 0x7f78e80cd470 2024-09-12T12:26:09.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.902+0000 7f78e5600640 1 -- 172.21.15.144:0/46817547 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) ==== 95+0+5250 (secure 0 0 0) 0x7f78d4016090 con 0x7f78e80cd470 2024-09-12T12:26:09.905 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:09.905 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":157,"btime":"2024-09-12T12:26:05:043642+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/480472502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":480472502},{"type":"v1","addr":"172.21.15.165:6834","nonce":480472502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2632695665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2632695665},{"type":"v1","addr":"172.21.15.144:6836","nonce":2632695665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151},{"gid":10590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2593616401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2593616401},{"type":"v1","addr":"172.21.15.144:6837","nonce":2593616401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:26:01.386066+0000","modified":"2024-09-12T12:26:04.421876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10593":{"gid":10593,"name":"b","rank":0,"incarnation":153,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2360370466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2360370466},{"type":"v1","addr":"172.21.15.165:6835","nonce":2360370466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10593,"qdb_cluster":[10593]},"id":14}]} 2024-09-12T12:26:09.906 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 157 2024-09-12T12:26:09.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c80678c0 msgr2=0x7f78c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c80678c0 0x7f78c8069d80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0094c0 tx=0x7f78dc00b040 comp rx=0 tx=0).stop 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e80cd470 msgr2=0x7f78e813ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e80cd470 0x7f78e813ac00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f78d40ab000 tx=0x7f78d4019240 comp rx=0 tx=0).stop 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 shutdown_connections 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f78c80678c0 0x7f78c8069d80 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78e8148190 0x7f78e8072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78e80cd470 0x7f78e813ac00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 --2- 172.21.15.144:0/46817547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78e80b02b0 0x7f78e815d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 >> 172.21.15.144:0/46817547 conn(0x7f78e806d0d0 msgr2=0x7f78e815f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:09.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 shutdown_connections 2024-09-12T12:26:09.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:09.906+0000 7f78f0200640 1 -- 172.21.15.144:0/46817547 wait complete. 2024-09-12T12:26:09.927 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-12T12:26:10.101 INFO:teuthology.orchestra.run.smithi165.stdout:{"message":"","return_code":0} 2024-09-12T12:26:10.102 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T12:26:10.102 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-09-12T12:26:10.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.146+0000 7f31db455080 1 Processor -- start 2024-09-12T12:26:10.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.146+0000 7f31db455080 1 -- start start 2024-09-12T12:26:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31bc0022b0 0x55aa9a4cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa9a565ec0 0x55aa9a4a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 0x55aa9a582ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55aa9a3fa1b0 con 0x55aa9a565ec0 2024-09-12T12:26:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aa9a4537b0 con 0x55aa9a582ac0 2024-09-12T12:26:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55aa9a4f5190 con 0x7f31bc0022b0 2024-09-12T12:26:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d7c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa9a565ec0 0x55aa9a4a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d7c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa9a565ec0 0x55aa9a4a9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52562/0 (socket says 172.21.15.144:52562) 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d7c00640 1 -- 172.21.15.144:0/4143613647 learned_addr learned my addr 172.21.15.144:0/4143613647 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d8600640 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31bc0022b0 0x55aa9a4cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d9000640 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 0x55aa9a582ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d7c00640 1 -- 172.21.15.144:0/4143613647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31bc0022b0 msgr2=0x55aa9a4cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d7c00640 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31bc0022b0 0x55aa9a4cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d7c00640 1 -- 172.21.15.144:0/4143613647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 msgr2=0x55aa9a582ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d7c00640 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 0x55aa9a582ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d7c00640 1 -- 172.21.15.144:0/4143613647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa9a5820e0 con 0x55aa9a565ec0 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d9000640 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 0x55aa9a582ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d7c00640 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa9a565ec0 0x55aa9a4a9bf0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c790 tx=0x7f31c400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f449bea25a08033 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d6800640 1 -- 172.21.15.144:0/4143613647 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4015020 con 0x55aa9a565ec0 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d6800640 1 -- 172.21.15.144:0/4143613647 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c400eac0 con 0x55aa9a565ec0 2024-09-12T12:26:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31d6800640 1 -- 172.21.15.144:0/4143613647 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c400a040 con 0x55aa9a565ec0 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 -- 172.21.15.144:0/4143613647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa9a565ec0 msgr2=0x55aa9a4a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa9a565ec0 0x55aa9a4a9bf0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c790 tx=0x7f31c400cc50 comp rx=0 tx=0).stop 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 -- 172.21.15.144:0/4143613647 shutdown_connections 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 0x55aa9a582ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa9a565ec0 0x55aa9a4a9bf0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 --2- 172.21.15.144:0/4143613647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31bc0022b0 0x55aa9a4cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 -- 172.21.15.144:0/4143613647 >> 172.21.15.144:0/4143613647 conn(0x55aa9a4d9390 msgr2=0x55aa9a569d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 -- 172.21.15.144:0/4143613647 shutdown_connections 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 -- 172.21.15.144:0/4143613647 wait complete. 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 Processor -- start 2024-09-12T12:26:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.150+0000 7f31db455080 1 -- start start 2024-09-12T12:26:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31db455080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aa9a565ec0 0x55aa9a57d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31db455080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 0x55aa9a57fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31db455080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc0022b0 0x55aa9a580260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31db455080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55aa9a583ea0 con 0x7f31bc0022b0 2024-09-12T12:26:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31db455080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aa9a582380 con 0x55aa9a582ac0 2024-09-12T12:26:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31db455080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55aa9a582620 con 0x55aa9a565ec0 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc0022b0 0x55aa9a580260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d9000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc0022b0 0x55aa9a580260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52566/0 (socket says 172.21.15.144:52566) 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d9000640 1 -- 172.21.15.144:0/1130340284 learned_addr learned my addr 172.21.15.144:0/1130340284 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d8600640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aa9a565ec0 0x55aa9a57d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d7c00640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 0x55aa9a57fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d9000640 1 -- 172.21.15.144:0/1130340284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aa9a565ec0 msgr2=0x55aa9a57d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d9000640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55aa9a565ec0 0x55aa9a57d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d9000640 1 -- 172.21.15.144:0/1130340284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 msgr2=0x55aa9a57fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d9000640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa9a582ac0 0x55aa9a57fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d9000640 1 -- 172.21.15.144:0/1130340284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa9a5640e0 con 0x7f31bc0022b0 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d9000640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc0022b0 0x55aa9a580260 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x55aa9a4abb30 tx=0x7f31d000a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d5400640 1 -- 172.21.15.144:0/1130340284 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0018070 con 0x7f31bc0022b0 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d5400640 1 -- 172.21.15.144:0/1130340284 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d0014720 con 0x7f31bc0022b0 2024-09-12T12:26:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa9a564380 con 0x7f31bc0022b0 2024-09-12T12:26:10.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d5400640 1 -- 172.21.15.144:0/1130340284 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0014af0 con 0x7f31bc0022b0 2024-09-12T12:26:10.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa9a5648c0 con 0x7f31bc0022b0 2024-09-12T12:26:10.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.154+0000 7f31d5400640 1 -- 172.21.15.144:0/1130340284 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31d001b070 con 0x7f31bc0022b0 2024-09-12T12:26:10.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31d5400640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b80662d0 0x7f31b8068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31d5400640 1 -- 172.21.15.144:0/1130340284 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f31d00853a0 con 0x7f31bc0022b0 2024-09-12T12:26:10.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31d8600640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b80662d0 0x7f31b8068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55aa9a563030 0x55aa9a563410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 --> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e202) -- 0x55aa9a563950 con 0x55aa9a563030 2024-09-12T12:26:10.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31d7c00640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55aa9a563030 0x55aa9a563410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31d8600640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b80662d0 0x7f31b8068790 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f31c80ad000 tx=0x7f31c80a6070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31d7c00640 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55aa9a563030 0x55aa9a563410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31d7c00640 1 -- 172.21.15.144:0/1130340284 <== osd.2 v2:172.21.15.144:6809/1322554046 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v202'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f31c400d040 con 0x55aa9a563030 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55aa9a563030 msgr2=0x55aa9a563410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55aa9a563030 0x55aa9a563410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b80662d0 msgr2=0x7f31b8068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f31b80662d0 0x7f31b8068790 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f31c80ad000 tx=0x7f31c80a6070 comp rx=0 tx=0).stop 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc0022b0 msgr2=0x55aa9a580260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 --2- 172.21.15.144:0/1130340284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31bc0022b0 0x55aa9a580260 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x55aa9a4abb30 tx=0x7f31d000a970 comp rx=0 tx=0).stop 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31d9000640 1 -- 172.21.15.144:0/1130340284 reap_dead start 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 shutdown_connections 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 >> 172.21.15.144:0/1130340284 conn(0x55aa9a4d9390 msgr2=0x55aa9a4f6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 shutdown_connections 2024-09-12T12:26:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.158+0000 7f31db455080 1 -- 172.21.15.144:0/1130340284 wait complete. 2024-09-12T12:26:10.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:10.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-09-12T12:26:10.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.302+0000 7f6bb3400640 1 Processor -- start 2024-09-12T12:26:10.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.302+0000 7f6bb3400640 1 -- start start 2024-09-12T12:26:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6bb3400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6bac0b3490 0x7f6bac0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6bb3400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bac06cd20 con 0x7f6bac06d630 2024-09-12T12:26:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6bb3400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bac0b4f30 con 0x7f6bac06d250 2024-09-12T12:26:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6bb3400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6bac072620 con 0x7f6bac0b3490 2024-09-12T12:26:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6bb1400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6bac06d630 0x7f6bac155820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47794/0 (socket says 172.21.15.144:47794) 2024-09-12T12:26:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6bb1400640 1 -- 172.21.15.144:0/2320769900 learned_addr learned my addr 172.21.15.144:0/2320769900 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6babe00640 1 --2- 172.21.15.144:0/2320769900 >> v2:172.21.15.165:3300/0 conn(0x7f6bac0b3490 0x7f6bac0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6babe00640 1 -- 172.21.15.144:0/2320769900 >> v1:172.21.15.165:6789/0 conn(0x7f6bac06d250 legacy=0x7f6bac15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6babe00640 1 -- 172.21.15.144:0/2320769900 >> v1:172.21.15.144:6789/0 conn(0x7f6bac06d630 legacy=0x7f6bac155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6babe00640 1 -- 172.21.15.144:0/2320769900 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac0b3950 con 0x7f6bac0b3490 2024-09-12T12:26:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.306+0000 7f6bab400640 1 -- 172.21.15.144:0/2320769900 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132487077 0 0) 0x7f6bac06cd20 con 0x7f6bac06d630 2024-09-12T12:26:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6babe00640 1 --2- 172.21.15.144:0/2320769900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bac0b3490 0x7f6bac0b49f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6b980097c0 tx=0x7f6b9801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e68aa3a095d22c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bab400640 1 -- 172.21.15.144:0/2320769900 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980a7070 con 0x7f6bac0b3490 2024-09-12T12:26:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bab400640 1 -- 172.21.15.144:0/2320769900 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b980b0070 con 0x7f6bac0b3490 2024-09-12T12:26:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bab400640 1 -- 172.21.15.144:0/2320769900 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980ab890 con 0x7f6bac0b3490 2024-09-12T12:26:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 -- 172.21.15.144:0/2320769900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bac0b3490 msgr2=0x7f6bac0b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 --2- 172.21.15.144:0/2320769900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bac0b3490 0x7f6bac0b49f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6b980097c0 tx=0x7f6b9801c470 comp rx=0 tx=0).stop 2024-09-12T12:26:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 -- 172.21.15.144:0/2320769900 shutdown_connections 2024-09-12T12:26:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 --2- 172.21.15.144:0/2320769900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bac0b3490 0x7f6bac0b49f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 -- 172.21.15.144:0/2320769900 >> 172.21.15.144:0/2320769900 conn(0x7f6bac06bc10 msgr2=0x7f6bac06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 -- 172.21.15.144:0/2320769900 shutdown_connections 2024-09-12T12:26:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 -- 172.21.15.144:0/2320769900 wait complete. 2024-09-12T12:26:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 Processor -- start 2024-09-12T12:26:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 -- start start 2024-09-12T12:26:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.310+0000 7f6bb3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bac06d250 0x7f6bac1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb3400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bac06d630 0x7f6bac1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb3400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bac0b3490 0x7f6bac14e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb3400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac15d690 con 0x7f6bac06d250 2024-09-12T12:26:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb3400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac0b44d0 con 0x7f6bac06d630 2024-09-12T12:26:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb3400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bac15d810 con 0x7f6bac0b3490 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bac06d250 0x7f6bac1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bac06d250 0x7f6bac1523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52572/0 (socket says 172.21.15.144:52572) 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb0a00640 1 -- 172.21.15.144:0/1066017572 learned_addr learned my addr 172.21.15.144:0/1066017572 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6babe00640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bac06d630 0x7f6bac1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb1400640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bac0b3490 0x7f6bac14e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb0a00640 1 -- 172.21.15.144:0/1066017572 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bac0b3490 msgr2=0x7f6bac14e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bac0b3490 0x7f6bac14e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb0a00640 1 -- 172.21.15.144:0/1066017572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bac06d630 msgr2=0x7f6bac1492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bac06d630 0x7f6bac1492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb0a00640 1 -- 172.21.15.144:0/1066017572 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac149800 con 0x7f6bac06d250 2024-09-12T12:26:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bac06d250 0x7f6bac1523e0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000c500 tx=0x7f6ba000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6ba8c00640 1 -- 172.21.15.144:0/1066017572 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0016020 con 0x7f6bac06d250 2024-09-12T12:26:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6ba8c00640 1 -- 172.21.15.144:0/1066017572 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba0005220 con 0x7f6bac06d250 2024-09-12T12:26:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6ba8c00640 1 -- 172.21.15.144:0/1066017572 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0007030 con 0x7f6bac06d250 2024-09-12T12:26:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb3400640 1 -- 172.21.15.144:0/1066017572 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bac14ef50 con 0x7f6bac06d250 2024-09-12T12:26:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6bb3400640 1 -- 172.21.15.144:0/1066017572 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bac151900 con 0x7f6bac06d250 2024-09-12T12:26:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.314+0000 7f6ba8c00640 1 -- 172.21.15.144:0/1066017572 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6ba00071f0 con 0x7f6bac06d250 2024-09-12T12:26:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6ba8c00640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b8c0678c0 0x7f6b8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6ba8c00640 1 -- 172.21.15.144:0/1066017572 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f6ba0085850 con 0x7f6bac06d250 2024-09-12T12:26:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b8c0678c0 0x7f6b8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 Processor -- start 2024-09-12T12:26:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 -- start start 2024-09-12T12:26:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b8c0678c0 0x7f6b8c069d80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6b980af000 tx=0x7f6b980a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 0x56474a86f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a825300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 0x56474a825c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56474a66fe40 con 0x56474a86f9a0 2024-09-12T12:26:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56474a62aba0 con 0x56474a825840 2024-09-12T12:26:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56474a66be00 con 0x56474a86f080 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a825300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a825300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52586/0 (socket says 172.21.15.144:52586) 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 -- 172.21.15.144:0/1976867639 learned_addr learned my addr 172.21.15.144:0/1976867639 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/1976867639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 0x56474a86f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb1400640 1 --2- 172.21.15.144:0/1976867639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 0x56474a825c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 -- 172.21.15.144:0/1976867639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 msgr2=0x56474a86f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 --2- 172.21.15.144:0/1976867639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 0x56474a86f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 -- 172.21.15.144:0/1976867639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 msgr2=0x56474a825c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 --2- 172.21.15.144:0/1976867639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 0x56474a825c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 -- 172.21.15.144:0/1976867639 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474a612ec0 con 0x56474a86f9a0 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6babe00640 1 --2- 172.21.15.144:0/1976867639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a825300 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f6b98000c10 tx=0x7f6b98004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614ee0ad7dc766b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6b9d600640 1 -- 172.21.15.144:0/1976867639 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980ab7f0 con 0x56474a86f9a0 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6b9d600640 1 -- 172.21.15.144:0/1976867639 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b980b0070 con 0x56474a86f9a0 2024-09-12T12:26:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6b9d600640 1 -- 172.21.15.144:0/1976867639 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980abb90 con 0x56474a86f9a0 2024-09-12T12:26:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 -- 172.21.15.144:0/1976867639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 msgr2=0x56474a825300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1976867639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a825300 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f6b98000c10 tx=0x7f6b98004740 comp rx=0 tx=0).stop 2024-09-12T12:26:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 -- 172.21.15.144:0/1976867639 shutdown_connections 2024-09-12T12:26:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1976867639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 0x56474a825c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1976867639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a825300 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1976867639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 0x56474a86f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 -- 172.21.15.144:0/1976867639 >> 172.21.15.144:0/1976867639 conn(0x56474a81d3e0 msgr2=0x56474a81f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 -- 172.21.15.144:0/1976867639 shutdown_connections 2024-09-12T12:26:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.318+0000 7f6bb6890000 1 -- 172.21.15.144:0/1976867639 wait complete. 2024-09-12T12:26:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 -- start start 2024-09-12T12:26:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 Processor -- start 2024-09-12T12:26:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a825840 0x56474a85d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f080 0x56474a85dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f9a0 0x56474a85e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56474a609440 con 0x56474a86f080 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56474a62e4f0 con 0x56474a86f9a0 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56474a6f0920 con 0x56474a825840 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 10 client.0 _ll_register_callbacks cb 0x56474a80c510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6babe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f080 0x56474a85dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6babe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f080 0x56474a85dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52600/0 (socket says 172.21.15.144:52600) 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6babe00640 1 -- 172.21.15.144:0/1605193385 learned_addr learned my addr 172.21.15.144:0/1605193385 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a825840 0x56474a85d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb1400640 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f9a0 0x56474a85e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6babe00640 1 -- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a825840 msgr2=0x56474a85d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6babe00640 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a825840 0x56474a85d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6babe00640 1 -- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f9a0 msgr2=0x56474a85e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6babe00640 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f9a0 0x56474a85e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6babe00640 1 -- 172.21.15.144:0/1605193385 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56474a60f8f0 con 0x56474a86f080 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6babe00640 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f080 0x56474a85dbf0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f6b9801c4b0 tx=0x7f6b9801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63e0ab1cd6bebd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6b92000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6b92000640 1 -- 172.21.15.144:0/1605193385 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b980abb80 con 0x56474a86f080 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 -- 172.21.15.144:0/1605193385 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b980b0070 con 0x56474a86f080 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6b92000640 1 -- 172.21.15.144:0/1605193385 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f6b980abd20 con 0x56474a86f080 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6b92000640 1 -- 172.21.15.144:0/1605193385 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7f6b980be460 con 0x56474a86f080 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 10 client.10767 fetch_fsmap learned FSMap version 157 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 -- 172.21.15.144:0/1605193385 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) -- 0x56474a62d570 con 0x56474a86f080 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6b92000640 1 -- 172.21.15.144:0/1605193385 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b980b0070 con 0x56474a86f080 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6b92000640 1 -- 172.21.15.144:0/1605193385 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 157) ==== 3502+0+0 (secure 0 0 0) 0x7f6b980c7070 con 0x56474a86f080 2024-09-12T12:26:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 10 client.10767 fetch_fsmap finished waiting for FSMap version 157 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 10 client.10767 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 20 client.10767 populate_metadata read hostname 'smithi144' 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x56474a87f120 0x56474a881510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 4 client.10767 mds_command: new command op to 10593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb6890000 1 -- 172.21.15.144:0/1605193385 --> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56474a609f10 con 0x56474a87f120 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.322+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x56474a87f120 0x56474a881510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x56474a87f120 0x56474a881510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d77f8a058e8223a0 server_cookie=c7c2e7297aa46be4 in_seq=0 out_seq=0 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6b92000640 10 client.10767 ms_handle_connect on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6b92000640 1 -- 172.21.15.144:0/1605193385 <== mds.0 v2:172.21.15.165:6833/2360370466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56474a609f10 con 0x56474a87f120 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6b92000640 10 client.10767 handle_command_reply: tid=0 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 client.10767 shutdown 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 -- 172.21.15.144:0/1605193385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f080 msgr2=0x56474a85dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f080 0x56474a85dbf0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f6b9801c4b0 tx=0x7f6b9801acb0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 -- 172.21.15.144:0/1605193385 shutdown_connections 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x56474a87f120 0x56474a881510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f9a0 0x56474a85e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f080 0x56474a85dbf0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6b92000640 0 client.10767 ms_handle_reset on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 --2- 172.21.15.144:0/1605193385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a825840 0x56474a85d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 -- 172.21.15.144:0/1605193385 >> 172.21.15.144:0/1605193385 conn(0x56474a81d3e0 msgr2=0x56474a826440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 -- 172.21.15.144:0/1605193385 shutdown_connections 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 1 -- 172.21.15.144:0/1605193385 wait complete. 2024-09-12T12:26:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.326+0000 7f6bb6890000 20 client.10767 trim_cache size 0 max 16384 2024-09-12T12:26:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.342+0000 7f6bb6890000 1 Processor -- start 2024-09-12T12:26:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.342+0000 7f6bb6890000 1 -- start start 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 0x56474a81f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 0x56474a81fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a884750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac157550 con 0x56474a86f9a0 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac150920 con 0x56474a825840 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bac150f70 con 0x56474a86f080 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a884750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a884750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52616/0 (socket says 172.21.15.144:52616) 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb1400640 1 -- 172.21.15.144:0/3273154169 learned_addr learned my addr 172.21.15.144:0/3273154169 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6babe00640 1 --2- 172.21.15.144:0/3273154169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 0x56474a81fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/3273154169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 0x56474a81f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb1400640 1 -- 172.21.15.144:0/3273154169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 msgr2=0x56474a81fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb1400640 1 --2- 172.21.15.144:0/3273154169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 0x56474a81fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb1400640 1 -- 172.21.15.144:0/3273154169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 msgr2=0x56474a81f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb1400640 1 --2- 172.21.15.144:0/3273154169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 0x56474a81f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb1400640 1 -- 172.21.15.144:0/3273154169 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474a82d360 con 0x56474a86f9a0 2024-09-12T12:26:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb1400640 1 --2- 172.21.15.144:0/3273154169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a884750 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4007330 tx=0x7f6ba40077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519c2ab5010051a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6b9cc00640 1 -- 172.21.15.144:0/3273154169 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4001c20 con 0x56474a86f9a0 2024-09-12T12:26:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6b9cc00640 1 -- 172.21.15.144:0/3273154169 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba401b070 con 0x56474a86f9a0 2024-09-12T12:26:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6b9cc00640 1 -- 172.21.15.144:0/3273154169 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4001fc0 con 0x56474a86f9a0 2024-09-12T12:26:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- 172.21.15.144:0/3273154169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 msgr2=0x56474a884750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- 172.21.15.144:0/3273154169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a884750 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4007330 tx=0x7f6ba40077f0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- 172.21.15.144:0/3273154169 shutdown_connections 2024-09-12T12:26:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- 172.21.15.144:0/3273154169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a86f9a0 0x56474a884750 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- 172.21.15.144:0/3273154169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f080 0x56474a81fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- 172.21.15.144:0/3273154169 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a825840 0x56474a81f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- 172.21.15.144:0/3273154169 >> 172.21.15.144:0/3273154169 conn(0x56474a81d3e0 msgr2=0x56474a82bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- 172.21.15.144:0/3273154169 shutdown_connections 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- 172.21.15.144:0/3273154169 wait complete. 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- start start 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 Processor -- start 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a825840 0x56474a8e3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f080 0x56474a8e3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f9a0 0x56474a881840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56474a616020 con 0x56474a825840 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56474a62e8c0 con 0x56474a86f080 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56474a66f150 con 0x56474a86f9a0 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.346+0000 7f6bb6890000 10 client.0 _ll_register_callbacks cb 0x7f6ba0055840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a825840 0x56474a8e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a825840 0x56474a8e3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52628/0 (socket says 172.21.15.144:52628) 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb0a00640 1 -- 172.21.15.144:0/417568056 learned_addr learned my addr 172.21.15.144:0/417568056 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6babe00640 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f080 0x56474a8e3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb1400640 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f9a0 0x56474a881840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb0a00640 1 -- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f9a0 msgr2=0x56474a881840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f9a0 0x56474a881840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb0a00640 1 -- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f080 msgr2=0x56474a8e3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f080 0x56474a8e3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb0a00640 1 -- 172.21.15.144:0/417568056 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56474a6f0db0 con 0x56474a825840 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb1400640 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f9a0 0x56474a881840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb0a00640 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a825840 0x56474a8e3720 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0055770 tx=0x7f6ba005c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b213aaac0a081d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 1 -- 172.21.15.144:0/417568056 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0072070 con 0x56474a825840 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 1 -- 172.21.15.144:0/417568056 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f6ba007ed80 con 0x56474a825840 2024-09-12T12:26:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 -- 172.21.15.144:0/417568056 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ba401b070 con 0x56474a825840 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 1 -- 172.21.15.144:0/417568056 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7f6ba0010d70 con 0x56474a825840 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 10 client.10773 fetch_fsmap learned FSMap version 157 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 -- 172.21.15.144:0/417568056 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) -- 0x56474a603740 con 0x56474a825840 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 1 -- 172.21.15.144:0/417568056 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba401b070 con 0x56474a825840 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 1 -- 172.21.15.144:0/417568056 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 157) ==== 3502+0+0 (secure 0 0 0) 0x7f6ba006ece0 con 0x56474a825840 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 10 client.10773 fetch_fsmap finished waiting for FSMap version 157 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 10 client.10773 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 20 client.10773 populate_metadata read hostname 'smithi144' 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x56474a881d80 0x56474a882190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 4 client.10773 mds_command: new command op to 10593 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 -- 172.21.15.144:0/417568056 --> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x56474a67d570 con 0x56474a881d80 2024-09-12T12:26:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6babe00640 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x56474a881d80 0x56474a882190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.356 INFO:tasks.ceph.mds.b.smithi165.stderr:2024-09-12T12:26:10.352+0000 7f467d000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-12T12:26:09.166339+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={10743=0-12582912@1} caps={10743=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=10743 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5592c85c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T12:26:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6babe00640 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x56474a881d80 0x56474a882190 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f53ca1c0ea50527a server_cookie=88f44ee49b0013a in_seq=0 out_seq=0 2024-09-12T12:26:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 10 client.10773 ms_handle_connect on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 1 -- 172.21.15.144:0/417568056 <== mds.0 v2:172.21.15.165:6833/2360370466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56474a67d570 con 0x56474a881d80 2024-09-12T12:26:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 10 client.10773 handle_command_reply: tid=0 2024-09-12T12:26:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 client.10773 shutdown 2024-09-12T12:26:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 -- 172.21.15.144:0/417568056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a825840 msgr2=0x56474a8e3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a825840 0x56474a8e3720 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0055770 tx=0x7f6ba005c040 comp rx=0 tx=0).stop 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 -- 172.21.15.144:0/417568056 shutdown_connections 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x56474a881d80 0x56474a882190 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56474a86f9a0 0x56474a881840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56474a86f080 0x56474a8e3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 --2- 172.21.15.144:0/417568056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56474a825840 0x56474a8e3720 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 -- 172.21.15.144:0/417568056 >> 172.21.15.144:0/417568056 conn(0x56474a81d3e0 msgr2=0x56474a825c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6b92000640 0 client.10773 ms_handle_reset on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 -- 172.21.15.144:0/417568056 shutdown_connections 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 1 -- 172.21.15.144:0/417568056 wait complete. 2024-09-12T12:26:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.350+0000 7f6bb6890000 20 client.10773 trim_cache size 0 max 16384 2024-09-12T12:26:10.359 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:10.359 INFO:teuthology.orchestra.run.smithi144.stdout: "return_code": 0, 2024-09-12T12:26:10.359 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_tag": "31dccab7-8d30-4de1-aadc-0c5a725bd6d5", 2024-09-12T12:26:10.359 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": "asynchronous" 2024-09-12T12:26:10.359 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 -- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b8c0678c0 msgr2=0x7f6b8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b8c0678c0 0x7f6b8c069d80 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6b980af000 tx=0x7f6b980a7000 comp rx=0 tx=0).stop 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 -- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bac06d250 msgr2=0x7f6bac1523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bac06d250 0x7f6bac1523e0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000c500 tx=0x7f6ba000c9c0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 -- 172.21.15.144:0/1066017572 shutdown_connections 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6b8c0678c0 0x7f6b8c069d80 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bac0b3490 0x7f6bac14e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bac06d630 0x7f6bac1492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 --2- 172.21.15.144:0/1066017572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bac06d250 0x7f6bac1523e0 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 -- 172.21.15.144:0/1066017572 >> 172.21.15.144:0/1066017572 conn(0x7f6bac06bc10 msgr2=0x7f6bac0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 -- 172.21.15.144:0/1066017572 shutdown_connections 2024-09-12T12:26:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.354+0000 7f6bb3400640 1 -- 172.21.15.144:0/1066017572 wait complete. 2024-09-12T12:26:10.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:10.374 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-12T12:26:10.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80e5600640 1 Processor -- start 2024-09-12T12:26:10.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80e5600640 1 -- start start 2024-09-12T12:26:10.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80e5600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f80e015af60 0x7f80e00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80e5600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e00cd9f0 0x7f80e006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80e5600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e00b4300 con 0x7f80e015b340 2024-09-12T12:26:10.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80e5600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f80e00b32f0 con 0x7f80e015af60 2024-09-12T12:26:10.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80e5600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f80e00b3540 con 0x7f80e00cd9f0 2024-09-12T12:26:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80de000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e00cd9f0 0x7f80e006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80dea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f80e015af60 0x7f80e00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80de000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e00cd9f0 0x7f80e006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:51594/0 (socket says 172.21.15.144:51594) 2024-09-12T12:26:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80df400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f80e015b340 0x7f80e015ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:33790/0 (socket says 172.21.15.144:33790) 2024-09-12T12:26:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.510+0000 7f80de000640 1 -- 172.21.15.144:0/1236168067 learned_addr learned my addr 172.21.15.144:0/1236168067 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80de000640 1 -- 172.21.15.144:0/1236168067 >> v2:172.21.15.165:3300/0 conn(0x7f80e015af60 msgr2=0x7f80e00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80de000640 1 --2- 172.21.15.144:0/1236168067 >> v2:172.21.15.165:3300/0 conn(0x7f80e015af60 0x7f80e00ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80de000640 1 -- 172.21.15.144:0/1236168067 >> v1:172.21.15.165:6789/0 conn(0x7f80e015b340 legacy=0x7f80e015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80de000640 1 -- 172.21.15.144:0/1236168067 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e00b3820 con 0x7f80e00cd9f0 2024-09-12T12:26:10.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80de000640 1 --2- 172.21.15.144:0/1236168067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e00cd9f0 0x7f80e006bc10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009870 tx=0x7f80c801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=518ccca89f6ebc74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80dd600640 1 -- 172.21.15.144:0/1236168067 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c80b5070 con 0x7f80e00cd9f0 2024-09-12T12:26:10.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80dd600640 1 -- 172.21.15.144:0/1236168067 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c80a8a50 con 0x7f80e00cd9f0 2024-09-12T12:26:10.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80dd600640 1 -- 172.21.15.144:0/1236168067 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c80a8e20 con 0x7f80e00cd9f0 2024-09-12T12:26:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80e5600640 1 -- 172.21.15.144:0/1236168067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e00cd9f0 msgr2=0x7f80e006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80e5600640 1 --2- 172.21.15.144:0/1236168067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e00cd9f0 0x7f80e006bc10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009870 tx=0x7f80c801ed50 comp rx=0 tx=0).stop 2024-09-12T12:26:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80e5600640 1 -- 172.21.15.144:0/1236168067 shutdown_connections 2024-09-12T12:26:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80e5600640 1 --2- 172.21.15.144:0/1236168067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e00cd9f0 0x7f80e006bc10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80e5600640 1 --2- 172.21.15.144:0/1236168067 >> v2:172.21.15.165:3300/0 conn(0x7f80e015af60 0x7f80e00ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.514+0000 7f80e5600640 1 -- 172.21.15.144:0/1236168067 >> 172.21.15.144:0/1236168067 conn(0x7f80e0068030 msgr2=0x7f80e00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 -- 172.21.15.144:0/1236168067 shutdown_connections 2024-09-12T12:26:10.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 -- 172.21.15.144:0/1236168067 wait complete. 2024-09-12T12:26:10.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 Processor -- start 2024-09-12T12:26:10.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 -- start start 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e00cd9f0 0x7f80e01f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e015af60 0x7f80e015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e015b340 0x7f80e014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f80e00b5570 con 0x7f80e00cd9f0 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f80e00b3de0 con 0x7f80e015b340 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f80e00cebc0 con 0x7f80e015af60 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e00cd9f0 0x7f80e01f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e00cd9f0 0x7f80e01f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52632/0 (socket says 172.21.15.144:52632) 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80dea00640 1 -- 172.21.15.144:0/2658211474 learned_addr learned my addr 172.21.15.144:0/2658211474 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80de000640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e015af60 0x7f80e015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80df400640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e015b340 0x7f80e014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80dea00640 1 -- 172.21.15.144:0/2658211474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e015af60 msgr2=0x7f80e015c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80dea00640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e015af60 0x7f80e015c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80dea00640 1 -- 172.21.15.144:0/2658211474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e015b340 msgr2=0x7f80e014d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80dea00640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e015b340 0x7f80e014d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80dea00640 1 -- 172.21.15.144:0/2658211474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e015cb80 con 0x7f80e00cd9f0 2024-09-12T12:26:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80df400640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e015b340 0x7f80e014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:10.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80dea00640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e00cd9f0 0x7f80e01f3400 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f80d000efc0 tx=0x7f80d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80d6a00640 1 -- 172.21.15.144:0/2658211474 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0018020 con 0x7f80e00cd9f0 2024-09-12T12:26:10.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80d6a00640 1 -- 172.21.15.144:0/2658211474 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d0014480 con 0x7f80e00cd9f0 2024-09-12T12:26:10.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.518+0000 7f80e5600640 1 -- 172.21.15.144:0/2658211474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e014dc50 con 0x7f80e00cd9f0 2024-09-12T12:26:10.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.522+0000 7f80d6a00640 1 -- 172.21.15.144:0/2658211474 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0014850 con 0x7f80e00cd9f0 2024-09-12T12:26:10.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.522+0000 7f80e5600640 1 -- 172.21.15.144:0/2658211474 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e0071840 con 0x7f80e00cd9f0 2024-09-12T12:26:10.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.522+0000 7f80d6a00640 1 -- 172.21.15.144:0/2658211474 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80d001b020 con 0x7f80e00cd9f0 2024-09-12T12:26:10.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.522+0000 7f80d6a00640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80bc0678c0 0x7f80bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.522+0000 7f80d6a00640 1 -- 172.21.15.144:0/2658211474 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f80d0086d30 con 0x7f80e00cd9f0 2024-09-12T12:26:10.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.522+0000 7f80de000640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80bc0678c0 0x7f80bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.522+0000 7f80e8a21000 1 Processor -- start 2024-09-12T12:26:10.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.522+0000 7f80e8a21000 1 -- start start 2024-09-12T12:26:10.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.522+0000 7f80de000640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80bc0678c0 0x7f80bc069d80 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f80c80b2000 tx=0x7f80c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e491d0 0x5630c4e495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 0x5630c4dfcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4dfd1c0 0x5630c4dfd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5630c4ce2960 con 0x5630c4dfd1c0 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5630c4c26900 con 0x5630c4e49af0 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5630c4c49d40 con 0x5630c4e491d0 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4dfd1c0 0x5630c4dfd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4dfd1c0 0x5630c4dfd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52634/0 (socket says 172.21.15.144:52634) 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80df400640 1 -- 172.21.15.144:0/2689226928 learned_addr learned my addr 172.21.15.144:0/2689226928 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80de000640 1 --2- 172.21.15.144:0/2689226928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 0x5630c4dfcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80dea00640 1 --2- 172.21.15.144:0/2689226928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e491d0 0x5630c4e495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80df400640 1 -- 172.21.15.144:0/2689226928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e491d0 msgr2=0x5630c4e495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80df400640 1 --2- 172.21.15.144:0/2689226928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e491d0 0x5630c4e495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80df400640 1 -- 172.21.15.144:0/2689226928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 msgr2=0x5630c4dfcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80df400640 1 --2- 172.21.15.144:0/2689226928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 0x5630c4dfcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80df400640 1 -- 172.21.15.144:0/2689226928 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630c4bf0580 con 0x5630c4dfd1c0 2024-09-12T12:26:10.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80df400640 1 --2- 172.21.15.144:0/2689226928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4dfd1c0 0x5630c4dfd5a0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f80d80016d0 tx=0x7f80d8001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d686ff9497d24af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80cf400640 1 -- 172.21.15.144:0/2689226928 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80074e0 con 0x5630c4dfd1c0 2024-09-12T12:26:10.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80cf400640 1 -- 172.21.15.144:0/2689226928 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d8007680 con 0x5630c4dfd1c0 2024-09-12T12:26:10.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80cf400640 1 -- 172.21.15.144:0/2689226928 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80049f0 con 0x5630c4dfd1c0 2024-09-12T12:26:10.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 -- 172.21.15.144:0/2689226928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4dfd1c0 msgr2=0x5630c4dfd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2689226928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4dfd1c0 0x5630c4dfd5a0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f80d80016d0 tx=0x7f80d8001b90 comp rx=0 tx=0).stop 2024-09-12T12:26:10.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 -- 172.21.15.144:0/2689226928 shutdown_connections 2024-09-12T12:26:10.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2689226928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4dfd1c0 0x5630c4dfd5a0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2689226928 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 0x5630c4dfcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2689226928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e491d0 0x5630c4e495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 -- 172.21.15.144:0/2689226928 >> 172.21.15.144:0/2689226928 conn(0x5630c4e26040 msgr2=0x5630c4e28430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 -- 172.21.15.144:0/2689226928 shutdown_connections 2024-09-12T12:26:10.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 -- 172.21.15.144:0/2689226928 wait complete. 2024-09-12T12:26:10.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 -- start start 2024-09-12T12:26:10.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.526+0000 7f80e8a21000 1 Processor -- start 2024-09-12T12:26:10.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 0x5630c4e25190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e491d0 0x5630c4e256d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e49af0 0x5630c4e0a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5630c4c45d00 con 0x5630c4e49af0 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5630c4c04aa0 con 0x5630c4e491d0 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5630c4be3340 con 0x5630c4dfd1c0 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 10 client.0 _ll_register_callbacks cb 0x5630c4de6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e49af0 0x5630c4e0a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e49af0 0x5630c4e0a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52640/0 (socket says 172.21.15.144:52640) 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80df400640 1 -- 172.21.15.144:0/2930409233 learned_addr learned my addr 172.21.15.144:0/2930409233 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80de000640 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e491d0 0x5630c4e256d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80dea00640 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 0x5630c4e25190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80df400640 1 -- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 msgr2=0x5630c4e25190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80df400640 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 0x5630c4e25190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80df400640 1 -- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e491d0 msgr2=0x5630c4e256d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80df400640 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e491d0 0x5630c4e256d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80df400640 1 -- 172.21.15.144:0/2930409233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630c4becdc0 con 0x5630c4e49af0 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80df400640 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e49af0 0x5630c4e0a2b0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f80d8000f70 tx=0x7f80d8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b26bd472c23704 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80c3e00640 1 -- 172.21.15.144:0/2930409233 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8023070 con 0x5630c4e49af0 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80c3e00640 1 -- 172.21.15.144:0/2930409233 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f80d8004d90 con 0x5630c4e49af0 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 -- 172.21.15.144:0/2930409233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80d8007680 con 0x5630c4e49af0 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80c3e00640 1 -- 172.21.15.144:0/2930409233 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7f80d800d730 con 0x5630c4e49af0 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 10 client.10782 fetch_fsmap learned FSMap version 157 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 -- 172.21.15.144:0/2930409233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) -- 0x5630c4be97f0 con 0x5630c4e49af0 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80c3e00640 1 -- 172.21.15.144:0/2930409233 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d8007680 con 0x5630c4e49af0 2024-09-12T12:26:10.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80c3e00640 1 -- 172.21.15.144:0/2930409233 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 157) ==== 3502+0+0 (secure 0 0 0) 0x7f80d800d8d0 con 0x5630c4e49af0 2024-09-12T12:26:10.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 10 client.10782 fetch_fsmap finished waiting for FSMap version 157 2024-09-12T12:26:10.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 10 client.10782 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-12T12:26:10.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 20 client.10782 populate_metadata read hostname 'smithi144' 2024-09-12T12:26:10.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x5630c4e0acc0 0x5630c4e5b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 4 client.10782 mds_command: new command op to 10593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:10.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 -- 172.21.15.144:0/2930409233 --> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630c4be3e10 con 0x5630c4e0acc0 2024-09-12T12:26:10.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80dea00640 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x5630c4e0acc0 0x5630c4e5b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80dea00640 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x5630c4e0acc0 0x5630c4e5b280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e12723281c52a2f server_cookie=40b6e83ecdb8668b in_seq=0 out_seq=0 2024-09-12T12:26:10.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80c3e00640 10 client.10782 ms_handle_connect on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80c3e00640 1 -- 172.21.15.144:0/2930409233 <== mds.0 v2:172.21.15.165:6833/2360370466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630c4be3e10 con 0x5630c4e0acc0 2024-09-12T12:26:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80c3e00640 10 client.10782 handle_command_reply: tid=0 2024-09-12T12:26:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.530+0000 7f80e8a21000 1 client.10782 shutdown 2024-09-12T12:26:10.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 -- 172.21.15.144:0/2930409233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e49af0 msgr2=0x5630c4e0a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e49af0 0x5630c4e0a2b0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f80d8000f70 tx=0x7f80d8000ee0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 -- 172.21.15.144:0/2930409233 shutdown_connections 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x5630c4e0acc0 0x5630c4e5b280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e49af0 0x5630c4e0a2b0 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e491d0 0x5630c4e256d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2930409233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 0x5630c4e25190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80c3e00640 0 client.10782 ms_handle_reset on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 -- 172.21.15.144:0/2930409233 >> 172.21.15.144:0/2930409233 conn(0x5630c4e26040 msgr2=0x5630c4df7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 -- 172.21.15.144:0/2930409233 shutdown_connections 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 1 -- 172.21.15.144:0/2930409233 wait complete. 2024-09-12T12:26:10.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.534+0000 7f80e8a21000 20 client.10782 trim_cache size 0 max 16384 2024-09-12T12:26:10.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80e8a21000 1 Processor -- start 2024-09-12T12:26:10.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80e8a21000 1 -- start start 2024-09-12T12:26:10.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 0x5630c4e5e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e491d0 0x5630c4e08e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 0x5630c4e093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80e8a21000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01fced0 con 0x5630c4e491d0 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80e8a21000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01fbfe0 con 0x5630c4e49af0 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80e8a21000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f80e01f3fc0 con 0x5630c4dfd1c0 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80de000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e491d0 0x5630c4e08e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80de000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e491d0 0x5630c4e08e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52650/0 (socket says 172.21.15.144:52650) 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80dea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 0x5630c4e5e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80de000640 1 -- 172.21.15.144:0/280532809 learned_addr learned my addr 172.21.15.144:0/280532809 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80df400640 1 --2- 172.21.15.144:0/280532809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 0x5630c4e093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80de000640 1 -- 172.21.15.144:0/280532809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 msgr2=0x5630c4e5e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80de000640 1 --2- 172.21.15.144:0/280532809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 0x5630c4e5e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80de000640 1 -- 172.21.15.144:0/280532809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 msgr2=0x5630c4e093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80de000640 1 --2- 172.21.15.144:0/280532809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 0x5630c4e093b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80de000640 1 -- 172.21.15.144:0/280532809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630c4c07470 con 0x5630c4e491d0 2024-09-12T12:26:10.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80dea00640 1 --2- 172.21.15.144:0/280532809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 0x5630c4e5e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80de000640 1 --2- 172.21.15.144:0/280532809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e491d0 0x5630c4e08e70 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f80c80b3040 tx=0x7f80c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88963a235b2f0ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.550+0000 7f80cea00640 1 -- 172.21.15.144:0/280532809 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c80b5040 con 0x5630c4e491d0 2024-09-12T12:26:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80cea00640 1 -- 172.21.15.144:0/280532809 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c80b0b90 con 0x5630c4e491d0 2024-09-12T12:26:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80cea00640 1 -- 172.21.15.144:0/280532809 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c80bb420 con 0x5630c4e491d0 2024-09-12T12:26:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- 172.21.15.144:0/280532809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e491d0 msgr2=0x5630c4e08e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 --2- 172.21.15.144:0/280532809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e491d0 0x5630c4e08e70 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f80c80b3040 tx=0x7f80c8004740 comp rx=0 tx=0).stop 2024-09-12T12:26:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- 172.21.15.144:0/280532809 shutdown_connections 2024-09-12T12:26:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 --2- 172.21.15.144:0/280532809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4e49af0 0x5630c4e093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 --2- 172.21.15.144:0/280532809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e491d0 0x5630c4e08e70 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 --2- 172.21.15.144:0/280532809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4dfd1c0 0x5630c4e5e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- 172.21.15.144:0/280532809 >> 172.21.15.144:0/280532809 conn(0x5630c4e26040 msgr2=0x5630c4df7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- 172.21.15.144:0/280532809 shutdown_connections 2024-09-12T12:26:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- 172.21.15.144:0/280532809 wait complete. 2024-09-12T12:26:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- start start 2024-09-12T12:26:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 Processor -- start 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4dfd1c0 0x5630c4e5dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e49af0 0x5630c4e79570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e5e140 0x5630c4e79ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f80e01f4610 con 0x5630c4e5e140 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5630c4c49050 con 0x5630c4dfd1c0 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5630c4c087c0 con 0x5630c4e49af0 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 10 client.0 _ll_register_callbacks cb 0x7f80c80b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e5e140 0x5630c4e79ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e5e140 0x5630c4e79ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52658/0 (socket says 172.21.15.144:52658) 2024-09-12T12:26:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80df400640 1 -- 172.21.15.144:0/2044937466 learned_addr learned my addr 172.21.15.144:0/2044937466 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80de000640 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e49af0 0x5630c4e79570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80dea00640 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4dfd1c0 0x5630c4e5dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80df400640 1 -- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e49af0 msgr2=0x5630c4e79570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80df400640 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e49af0 0x5630c4e79570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80df400640 1 -- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4dfd1c0 msgr2=0x5630c4e5dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80df400640 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4dfd1c0 0x5630c4e5dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80df400640 1 -- 172.21.15.144:0/2044937466 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630c4bdd640 con 0x5630c4e5e140 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80dea00640 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4dfd1c0 0x5630c4e5dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80de000640 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e49af0 0x5630c4e79570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80df400640 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e5e140 0x5630c4e79ab0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f80d80070a0 tx=0x7f80d8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a726587af085b48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80c3e00640 1 -- 172.21.15.144:0/2044937466 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8023040 con 0x5630c4e5e140 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80c3e00640 1 -- 172.21.15.144:0/2044937466 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(202..202 src has 1..202) ==== 6101+0+0 (secure 0 0 0) 0x7f80d8032670 con 0x5630c4e5e140 2024-09-12T12:26:10.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- 172.21.15.144:0/2044937466 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80c80b0b90 con 0x5630c4e5e140 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80c3e00640 1 -- 172.21.15.144:0/2044937466 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7f80d803f050 con 0x5630c4e5e140 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 10 client.10788 fetch_fsmap learned FSMap version 157 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.554+0000 7f80e8a21000 1 -- 172.21.15.144:0/2044937466 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) -- 0x5630c4be13b0 con 0x5630c4e5e140 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80c3e00640 1 -- 172.21.15.144:0/2044937466 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c80b0b90 con 0x5630c4e5e140 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80c3e00640 1 -- 172.21.15.144:0/2044937466 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 157) ==== 3502+0+0 (secure 0 0 0) 0x7f80d8042020 con 0x5630c4e5e140 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 10 client.10788 fetch_fsmap finished waiting for FSMap version 157 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 10 client.10788 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 20 client.10788 populate_metadata read hostname 'smithi144' 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x5630c4ebd550 0x5630c4ebd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 4 client.10788 mds_command: new command op to 10593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 -- 172.21.15.144:0/2044937466 --> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5630c4c57470 con 0x5630c4ebd550 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80dea00640 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x5630c4ebd550 0x5630c4ebd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80c3e00640 10 client.10788 ms_handle_connect on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80dea00640 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x5630c4ebd550 0x5630c4ebd960 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37ef6fbc31647eaa server_cookie=6617bfbda9fd163e in_seq=0 out_seq=0 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80c3e00640 1 -- 172.21.15.144:0/2044937466 <== mds.0 v2:172.21.15.165:6833/2360370466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x5630c4c57470 con 0x5630c4ebd550 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80c3e00640 10 client.10788 handle_command_reply: tid=0 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 client.10788 shutdown 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 -- 172.21.15.144:0/2044937466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e5e140 msgr2=0x5630c4e79ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e5e140 0x5630c4e79ab0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f80d80070a0 tx=0x7f80d8009040 comp rx=0 tx=0).stop 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 -- 172.21.15.144:0/2044937466 shutdown_connections 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x5630c4ebd550 0x5630c4ebd960 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630c4e5e140 0x5630c4e79ab0 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5630c4e49af0 0x5630c4e79570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 --2- 172.21.15.144:0/2044937466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5630c4dfd1c0 0x5630c4e5dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80c3e00640 0 client.10788 ms_handle_reset on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 -- 172.21.15.144:0/2044937466 >> 172.21.15.144:0/2044937466 conn(0x5630c4e26040 msgr2=0x5630c4df7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 -- 172.21.15.144:0/2044937466 shutdown_connections 2024-09-12T12:26:10.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 1 -- 172.21.15.144:0/2044937466 wait complete. 2024-09-12T12:26:10.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e8a21000 20 client.10788 trim_cache size 0 max 16384 2024-09-12T12:26:10.565 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:10.565 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T12:26:10.565 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": { 2024-09-12T12:26:10.565 INFO:teuthology.orchestra.run.smithi144.stdout: "31dccab7-8d30-4de1-aadc-0c5a725bd6d5": { 2024-09-12T12:26:10.565 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/", 2024-09-12T12:26:10.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tag": "31dccab7-8d30-4de1-aadc-0c5a725bd6d5", 2024-09-12T12:26:10.566 INFO:teuthology.orchestra.run.smithi144.stdout: "options": "recursive,repair" 2024-09-12T12:26:10.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:26:10.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-12T12:26:10.566 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 -- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80bc0678c0 msgr2=0x7f80bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80bc0678c0 0x7f80bc069d80 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f80c80b2000 tx=0x7f80c8008040 comp rx=0 tx=0).stop 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 -- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e00cd9f0 msgr2=0x7f80e01f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e00cd9f0 0x7f80e01f3400 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f80d000efc0 tx=0x7f80d000c490 comp rx=0 tx=0).stop 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 -- 172.21.15.144:0/2658211474 shutdown_connections 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f80bc0678c0 0x7f80bc069d80 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80e015b340 0x7f80e014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80e015af60 0x7f80e015c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 --2- 172.21.15.144:0/2658211474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80e00cd9f0 0x7f80e01f3400 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 -- 172.21.15.144:0/2658211474 >> 172.21.15.144:0/2658211474 conn(0x7f80e0068030 msgr2=0x7f80e0155360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 -- 172.21.15.144:0/2658211474 shutdown_connections 2024-09-12T12:26:10.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:10.558+0000 7f80e5600640 1 -- 172.21.15.144:0/2658211474 wait complete. 2024-09-12T12:26:10.580 INFO:tasks.cephfs.filesystem:scrub status for tag:31dccab7-8d30-4de1-aadc-0c5a725bd6d5 - {'path': '/', 'tag': '31dccab7-8d30-4de1-aadc-0c5a725bd6d5', 'options': 'recursive,repair'} 2024-09-12T12:26:16.849 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:26:16.853 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:26:40.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:40.582 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-12T12:26:40.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.729+0000 7fcb7f400640 1 Processor -- start 2024-09-12T12:26:40.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.729+0000 7fcb7f400640 1 -- start start 2024-09-12T12:26:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcb7806d0f0 0x7fcb7806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7f400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb7806da10 con 0x7fcb780b32f0 2024-09-12T12:26:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7f400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb780b38b0 con 0x7fcb780ccdc0 2024-09-12T12:26:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7f400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcb780b3b90 con 0x7fcb7806d0f0 2024-09-12T12:26:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcb7806d0f0 0x7fcb7806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcb7806d0f0 0x7fcb7806d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33458/0 (socket says 172.21.15.144:33458) 2024-09-12T12:26:40.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7ca00640 1 -- 172.21.15.144:0/506037883 learned_addr learned my addr 172.21.15.144:0/506037883 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:40.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7ca00640 1 -- 172.21.15.144:0/506037883 >> v1:172.21.15.165:6789/0 conn(0x7fcb780ccdc0 legacy=0x7fcb780cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7ca00640 1 -- 172.21.15.144:0/506037883 >> v1:172.21.15.144:6789/0 conn(0x7fcb780b32f0 legacy=0x7fcb7815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.733+0000 7fcb7ca00640 1 -- 172.21.15.144:0/506037883 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb780b3e70 con 0x7fcb7806d0f0 2024-09-12T12:26:40.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/506037883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7806d0f0 0x7fcb7806d4d0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fcb68006fd0 tx=0x7fcb6801e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d68e7fe4f10a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb77400640 1 -- 172.21.15.144:0/506037883 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb680ad070 con 0x7fcb7806d0f0 2024-09-12T12:26:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb77400640 1 -- 172.21.15.144:0/506037883 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb68004230 con 0x7fcb7806d0f0 2024-09-12T12:26:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb77400640 1 -- 172.21.15.144:0/506037883 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb680a76c0 con 0x7fcb7806d0f0 2024-09-12T12:26:40.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7f400640 1 -- 172.21.15.144:0/506037883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7806d0f0 msgr2=0x7fcb7806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7f400640 1 --2- 172.21.15.144:0/506037883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7806d0f0 0x7fcb7806d4d0 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7fcb68006fd0 tx=0x7fcb6801e960 comp rx=0 tx=0).stop 2024-09-12T12:26:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7f400640 1 -- 172.21.15.144:0/506037883 shutdown_connections 2024-09-12T12:26:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7f400640 1 --2- 172.21.15.144:0/506037883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7806d0f0 0x7fcb7806d4d0 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7f400640 1 -- 172.21.15.144:0/506037883 >> 172.21.15.144:0/506037883 conn(0x7fcb78068030 msgr2=0x7fcb780b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7f400640 1 -- 172.21.15.144:0/506037883 shutdown_connections 2024-09-12T12:26:40.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7f400640 1 -- 172.21.15.144:0/506037883 wait complete. 2024-09-12T12:26:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7f400640 1 Processor -- start 2024-09-12T12:26:40.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.737+0000 7fcb7f400640 1 -- start start 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb7806d0f0 0x7fcb7815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb780b32f0 0x7fcb7815cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7f400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb780ccdc0 0x7fcb78158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7f400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcb780cdd50 con 0x7fcb780b32f0 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7f400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb780cdbd0 con 0x7fcb780ccdc0 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7f400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcb780cded0 con 0x7fcb7806d0f0 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb77e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb780b32f0 0x7fcb7815cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb77e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb780b32f0 0x7fcb7815cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33470/0 (socket says 172.21.15.144:33470) 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb77e00640 1 -- 172.21.15.144:0/2062237039 learned_addr learned my addr 172.21.15.144:0/2062237039 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7d400640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb780ccdc0 0x7fcb78158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb7806d0f0 0x7fcb7815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb77e00640 1 -- 172.21.15.144:0/2062237039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb7806d0f0 msgr2=0x7fcb7815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb77e00640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb7806d0f0 0x7fcb7815a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb77e00640 1 -- 172.21.15.144:0/2062237039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb780ccdc0 msgr2=0x7fcb78158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb77e00640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb780ccdc0 0x7fcb78158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb77e00640 1 -- 172.21.15.144:0/2062237039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb78147350 con 0x7fcb780b32f0 2024-09-12T12:26:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb77e00640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb780b32f0 0x7fcb7815cc30 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c3f0 tx=0x7fcb6400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb74c00640 1 -- 172.21.15.144:0/2062237039 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64017070 con 0x7fcb780b32f0 2024-09-12T12:26:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb74c00640 1 -- 172.21.15.144:0/2062237039 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb640052d0 con 0x7fcb780b32f0 2024-09-12T12:26:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb74c00640 1 -- 172.21.15.144:0/2062237039 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64003840 con 0x7fcb780b32f0 2024-09-12T12:26:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7f400640 1 -- 172.21.15.144:0/2062237039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7815aef0 con 0x7fcb780b32f0 2024-09-12T12:26:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.741+0000 7fcb7f400640 1 -- 172.21.15.144:0/2062237039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7815b4b0 con 0x7fcb780b32f0 2024-09-12T12:26:40.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb74c00640 1 -- 172.21.15.144:0/2062237039 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcb6401a070 con 0x7fcb780b32f0 2024-09-12T12:26:40.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb74c00640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcb580678f0 0x7fcb58069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb74c00640 1 -- 172.21.15.144:0/2062237039 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7fcb64085230 con 0x7fcb780b32f0 2024-09-12T12:26:40.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcb580678f0 0x7fcb58069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb827ae000 1 Processor -- start 2024-09-12T12:26:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb827ae000 1 -- start start 2024-09-12T12:26:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcb580678f0 0x7fcb58069db0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcb680b1000 tx=0x7fcb680a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 0x559e8e09a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 0x559e8e04d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e04e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb827ae000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559e8df37960 con 0x559e8e04ddb0 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb827ae000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559e8de7b900 con 0x559e8e09a690 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb827ae000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559e8de9ed40 con 0x559e8e099d70 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e04e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 0x559e8e09a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e04e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33486/0 (socket says 172.21.15.144:33486) 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7d400640 1 -- 172.21.15.144:0/4214943502 learned_addr learned my addr 172.21.15.144:0/4214943502 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb77e00640 1 --2- 172.21.15.144:0/4214943502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 0x559e8e04d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7d400640 1 -- 172.21.15.144:0/4214943502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 msgr2=0x559e8e09a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7d400640 1 --2- 172.21.15.144:0/4214943502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 0x559e8e09a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7d400640 1 -- 172.21.15.144:0/4214943502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 msgr2=0x559e8e04d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7d400640 1 --2- 172.21.15.144:0/4214943502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 0x559e8e04d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7d400640 1 -- 172.21.15.144:0/4214943502 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e8de45580 con 0x559e8e04ddb0 2024-09-12T12:26:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb7d400640 1 --2- 172.21.15.144:0/4214943502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e04e190 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fcb70001f50 tx=0x7fcb700016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30262575f032eacc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb6d600640 1 -- 172.21.15.144:0/4214943502 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000fe50 con 0x559e8e04ddb0 2024-09-12T12:26:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb6d600640 1 -- 172.21.15.144:0/4214943502 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb70018070 con 0x559e8e04ddb0 2024-09-12T12:26:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.745+0000 7fcb6d600640 1 -- 172.21.15.144:0/4214943502 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70003b80 con 0x559e8e04ddb0 2024-09-12T12:26:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- 172.21.15.144:0/4214943502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 msgr2=0x559e8e04e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 --2- 172.21.15.144:0/4214943502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e04e190 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fcb70001f50 tx=0x7fcb700016b0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- 172.21.15.144:0/4214943502 shutdown_connections 2024-09-12T12:26:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 --2- 172.21.15.144:0/4214943502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e04e190 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 --2- 172.21.15.144:0/4214943502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 0x559e8e04d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 --2- 172.21.15.144:0/4214943502 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 0x559e8e09a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- 172.21.15.144:0/4214943502 >> 172.21.15.144:0/4214943502 conn(0x559e8e07b040 msgr2=0x559e8e07d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- 172.21.15.144:0/4214943502 shutdown_connections 2024-09-12T12:26:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- 172.21.15.144:0/4214943502 wait complete. 2024-09-12T12:26:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- start start 2024-09-12T12:26:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 Processor -- start 2024-09-12T12:26:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e0a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 0x559e8e0a1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 0x559e8e0a1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559e8de9ad00 con 0x559e8e04ddb0 2024-09-12T12:26:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559e8de59aa0 con 0x559e8e09a690 2024-09-12T12:26:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559e8de38340 con 0x559e8e099d70 2024-09-12T12:26:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 10 client.0 _ll_register_callbacks cb 0x559e8e03b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e0a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e0a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33498/0 (socket says 172.21.15.144:33498) 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7ca00640 1 -- 172.21.15.144:0/1183076956 learned_addr learned my addr 172.21.15.144:0/1183076956 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7d400640 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 0x559e8e0a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb77e00640 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 0x559e8e0a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7ca00640 1 -- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 msgr2=0x559e8e0a1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 0x559e8e0a1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7ca00640 1 -- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 msgr2=0x559e8e0a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 0x559e8e0a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7ca00640 1 -- 172.21.15.144:0/1183076956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e8de41dc0 con 0x559e8e04ddb0 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb77e00640 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 0x559e8e0a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7d400640 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 0x559e8e0a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e0a0ce0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fcb6809a460 tx=0x7fcb680046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51be3abff90e95f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb62000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:26:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb62000640 1 -- 172.21.15.144:0/1183076956 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb680cd060 con 0x559e8e04ddb0 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb62000640 1 -- 172.21.15.144:0/1183076956 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7fcb68003620 con 0x559e8e04ddb0 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- 172.21.15.144:0/1183076956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb70018070 con 0x559e8e04ddb0 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb62000640 1 -- 172.21.15.144:0/1183076956 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7fcb680d3050 con 0x559e8e04ddb0 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 10 client.10803 fetch_fsmap learned FSMap version 157 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.749+0000 7fcb827ae000 1 -- 172.21.15.144:0/1183076956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) -- 0x559e8de3e7f0 con 0x559e8e04ddb0 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb62000640 1 -- 172.21.15.144:0/1183076956 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb70018070 con 0x559e8e04ddb0 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb62000640 1 -- 172.21.15.144:0/1183076956 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 157) ==== 3502+0+0 (secure 0 0 0) 0x7fcb680d6020 con 0x559e8e04ddb0 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 10 client.10803 fetch_fsmap finished waiting for FSMap version 157 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 10 client.10803 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 20 client.10803 populate_metadata read hostname 'smithi144' 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x559e8e0a90b0 0x559e8e0ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 4 client.10803 mds_command: new command op to 10593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:26:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 -- 172.21.15.144:0/1183076956 --> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e8de38e10 con 0x559e8e0a90b0 2024-09-12T12:26:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb77e00640 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x559e8e0a90b0 0x559e8e0ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb77e00640 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x559e8e0a90b0 0x559e8e0ab4a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc8b52874b8506da server_cookie=5e5ad95ec37fd9d8 in_seq=0 out_seq=0 2024-09-12T12:26:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb62000640 10 client.10803 ms_handle_connect on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb62000640 1 -- 172.21.15.144:0/1183076956 <== mds.0 v2:172.21.15.165:6833/2360370466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e8de38e10 con 0x559e8e0a90b0 2024-09-12T12:26:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb62000640 10 client.10803 handle_command_reply: tid=0 2024-09-12T12:26:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 client.10803 shutdown 2024-09-12T12:26:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 -- 172.21.15.144:0/1183076956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 msgr2=0x559e8e0a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e0a0ce0 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fcb6809a460 tx=0x7fcb680046d0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 -- 172.21.15.144:0/1183076956 shutdown_connections 2024-09-12T12:26:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x559e8e0a90b0 0x559e8e0ab4a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e09a690 0x559e8e0a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e099d70 0x559e8e0a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb62000640 0 client.10803 ms_handle_reset on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 --2- 172.21.15.144:0/1183076956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e04ddb0 0x559e8e0a0ce0 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 -- 172.21.15.144:0/1183076956 >> 172.21.15.144:0/1183076956 conn(0x559e8e07b040 msgr2=0x559e8e04cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 -- 172.21.15.144:0/1183076956 shutdown_connections 2024-09-12T12:26:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 1 -- 172.21.15.144:0/1183076956 wait complete. 2024-09-12T12:26:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.753+0000 7fcb827ae000 20 client.10803 trim_cache size 0 max 16384 2024-09-12T12:26:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 Processor -- start 2024-09-12T12:26:40.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 -- start start 2024-09-12T12:26:40.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 0x559e8e1091b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 0x559e8e1096f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e109c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcb781ffea0 con 0x559e8e09a690 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb781feee0 con 0x559e8e099d70 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7814b430 con 0x559e8e04ddb0 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33514/0 (socket says 172.21.15.144:33514) 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7d400640 1 -- 172.21.15.144:0/2594676943 learned_addr learned my addr 172.21.15.144:0/2594676943 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb77e00640 1 --2- 172.21.15.144:0/2594676943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 0x559e8e1096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/2594676943 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 0x559e8e1091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7d400640 1 -- 172.21.15.144:0/2594676943 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 msgr2=0x559e8e1091b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7d400640 1 --2- 172.21.15.144:0/2594676943 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 0x559e8e1091b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7d400640 1 -- 172.21.15.144:0/2594676943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 msgr2=0x559e8e1096f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:40.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7d400640 1 --2- 172.21.15.144:0/2594676943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 0x559e8e1096f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7d400640 1 -- 172.21.15.144:0/2594676943 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e8de5c470 con 0x559e8e09a690 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb7d400640 1 --2- 172.21.15.144:0/2594676943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e109c30 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fcb70002240 tx=0x7fcb7000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4909873d7cf6e1cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb6cc00640 1 -- 172.21.15.144:0/2594676943 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70003b80 con 0x559e8e09a690 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb6cc00640 1 -- 172.21.15.144:0/2594676943 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb70021070 con 0x559e8e09a690 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb6cc00640 1 -- 172.21.15.144:0/2594676943 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb700050d0 con 0x559e8e09a690 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 -- 172.21.15.144:0/2594676943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 msgr2=0x559e8e109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 --2- 172.21.15.144:0/2594676943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e109c30 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fcb70002240 tx=0x7fcb7000a000 comp rx=0 tx=0).stop 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 -- 172.21.15.144:0/2594676943 shutdown_connections 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 --2- 172.21.15.144:0/2594676943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e109c30 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 --2- 172.21.15.144:0/2594676943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 0x559e8e1096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 --2- 172.21.15.144:0/2594676943 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 0x559e8e1091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 -- 172.21.15.144:0/2594676943 >> 172.21.15.144:0/2594676943 conn(0x559e8e07b040 msgr2=0x559e8e054bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:40.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 -- 172.21.15.144:0/2594676943 shutdown_connections 2024-09-12T12:26:40.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.773+0000 7fcb827ae000 1 -- 172.21.15.144:0/2594676943 wait complete. 2024-09-12T12:26:40.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 -- start start 2024-09-12T12:26:40.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 Processor -- start 2024-09-12T12:26:40.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 0x559e8e0a6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 0x559e8e0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559e8de44f20 con 0x559e8e09a690 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7814ba80 con 0x559e8e099d70 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559e8de5d7c0 con 0x559e8e04ddb0 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 10 client.0 _ll_register_callbacks cb 0x7fcb68006ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e0c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33518/0 (socket says 172.21.15.144:33518) 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7d400640 1 -- 172.21.15.144:0/3957548759 learned_addr learned my addr 172.21.15.144:0/3957548759 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb77e00640 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 0x559e8e0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 0x559e8e0a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7d400640 1 -- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 msgr2=0x559e8e0a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7d400640 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 0x559e8e0a6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7d400640 1 -- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 msgr2=0x559e8e0c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7d400640 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 0x559e8e0c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7d400640 1 -- 172.21.15.144:0/3957548759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e8de32640 con 0x559e8e09a690 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7d400640 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e0c9cd0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fcb70014000 tx=0x7fcb70001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f98041ccc0d5fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb62000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb62000640 1 -- 172.21.15.144:0/3957548759 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb700050d0 con 0x559e8e09a690 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb62000640 1 -- 172.21.15.144:0/3957548759 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7fcb70005270 con 0x559e8e09a690 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 -- 172.21.15.144:0/3957548759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb70021070 con 0x559e8e09a690 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb62000640 1 -- 172.21.15.144:0/3957548759 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=157) ==== 24+0+0 (secure 0 0 0) 0x7fcb70005470 con 0x559e8e09a690 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 10 client.10809 fetch_fsmap learned FSMap version 157 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 -- 172.21.15.144:0/3957548759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=157,monmap=2+}) -- 0x559e8de363b0 con 0x559e8e09a690 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb62000640 1 -- 172.21.15.144:0/3957548759 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb70021070 con 0x559e8e09a690 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb62000640 1 -- 172.21.15.144:0/3957548759 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 157) ==== 3502+0+0 (secure 0 0 0) 0x7fcb70005610 con 0x559e8e09a690 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 10 client.10809 fetch_fsmap finished waiting for FSMap version 157 2024-09-12T12:26:40.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 10 client.10809 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.b 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 20 client.10809 populate_metadata read hostname 'smithi144' 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x559e8e0ca210 0x559e8e10d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 4 client.10809 mds_command: new command op to 10593 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb827ae000 1 -- 172.21.15.144:0/3957548759 --> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e8deac470 con 0x559e8e0ca210 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.777+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x559e8e0ca210 0x559e8e10d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7ca00640 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x559e8e0ca210 0x559e8e10d740 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9db53cd154b7fcd server_cookie=6d5ca3c784982697 in_seq=0 out_seq=0 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb62000640 10 client.10809 ms_handle_connect on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb62000640 1 -- 172.21.15.144:0/3957548759 <== mds.0 v2:172.21.15.165:6833/2360370466 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559e8deac470 con 0x559e8e0ca210 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb62000640 10 client.10809 handle_command_reply: tid=0 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 client.10809 shutdown 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 -- 172.21.15.144:0/3957548759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 msgr2=0x559e8e0c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e0c9cd0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fcb70014000 tx=0x7fcb70001260 comp rx=0 tx=0).stop 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 -- 172.21.15.144:0/3957548759 shutdown_connections 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:6833/2360370466,v1:172.21.15.165:6835/2360370466] conn(0x559e8e0ca210 0x559e8e10d740 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559e8e09a690 0x559e8e0c9cd0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559e8e099d70 0x559e8e0c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb62000640 0 client.10809 ms_handle_reset on v2:172.21.15.165:6833/2360370466 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 --2- 172.21.15.144:0/3957548759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x559e8e04ddb0 0x559e8e0a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 -- 172.21.15.144:0/3957548759 >> 172.21.15.144:0/3957548759 conn(0x559e8e07b040 msgr2=0x559e8e055410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 -- 172.21.15.144:0/3957548759 shutdown_connections 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 1 -- 172.21.15.144:0/3957548759 wait complete. 2024-09-12T12:26:40.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb827ae000 20 client.10809 trim_cache size 0 max 16384 2024-09-12T12:26:40.784 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:40.784 INFO:teuthology.orchestra.run.smithi144.stdout: "status": "no active scrubs running", 2024-09-12T12:26:40.784 INFO:teuthology.orchestra.run.smithi144.stdout: "scrubs": {} 2024-09-12T12:26:40.784 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 -- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcb580678f0 msgr2=0x7fcb58069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcb580678f0 0x7fcb58069db0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcb680b1000 tx=0x7fcb680a9070 comp rx=0 tx=0).stop 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 -- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb780b32f0 msgr2=0x7fcb7815cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb780b32f0 0x7fcb7815cc30 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c3f0 tx=0x7fcb6400c8b0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 -- 172.21.15.144:0/2062237039 shutdown_connections 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcb580678f0 0x7fcb58069db0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb780ccdc0 0x7fcb78158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb780b32f0 0x7fcb7815cc30 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 --2- 172.21.15.144:0/2062237039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb7806d0f0 0x7fcb7815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 -- 172.21.15.144:0/2062237039 >> 172.21.15.144:0/2062237039 conn(0x7fcb78068030 msgr2=0x7fcb780b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 -- 172.21.15.144:0/2062237039 shutdown_connections 2024-09-12T12:26:40.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40.781+0000 7fcb7f400640 1 -- 172.21.15.144:0/2062237039 wait complete. 2024-09-12T12:26:40.799 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T12:26:40.799 DEBUG:teuthology.orchestra.run.smithi144:> stdin-killer -- python3 -c ' 2024-09-12T12:26:40.799 DEBUG:teuthology.orchestra.run.smithi144:> import os 2024-09-12T12:26:40.799 DEBUG:teuthology.orchestra.run.smithi144:> import stat 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> import json 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> import sys 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> try: 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> except OSError as e: 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> sys.exit(e.errno) 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> print(json.dumps( 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> indent=2)) 2024-09-12T12:26:40.800 DEBUG:teuthology.orchestra.run.smithi144:> ' 2024-09-12T12:26:40.870 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:40.870 INFO:teuthology.orchestra.run.smithi144.stdout: "st_mode": 33204, 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: "st_ino": 1099511627777, 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: "st_dev": 44, 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: "st_nlink": 1, 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: "st_uid": 1000, 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: "st_gid": 1271, 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: "st_size": 6291456, 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: "st_atime": 1726143969.1383405, 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: "st_mtime": 1726143969.1703398, 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout: "st_ctime": 1726143969.1703398 2024-09-12T12:26:40.871 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:40.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:26:40.880 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:26:41.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5423200640 1 Processor -- start 2024-09-12T12:26:41.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5423200640 1 -- start start 2024-09-12T12:26:41.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5423200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54240b3630 0x7f542415c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5423200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5424160950 0x7f542415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5423200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542415d3a0 con 0x7f5424156660 2024-09-12T12:26:41.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5423200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f542406f9d0 con 0x7f5424160950 2024-09-12T12:26:41.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5423200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f542415d680 con 0x7f54240b3630 2024-09-12T12:26:41.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5421e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5424156660 0x7f54240b2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45444/0 (socket says 172.21.15.144:45444) 2024-09-12T12:26:41.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5421e00640 1 -- 172.21.15.144:0/4002373624 learned_addr learned my addr 172.21.15.144:0/4002373624 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:41.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5422800640 1 --2- 172.21.15.144:0/4002373624 >> v2:172.21.15.165:3300/0 conn(0x7f5424160950 0x7f542415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f541be00640 1 --2- 172.21.15.144:0/4002373624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54240b3630 0x7f542415c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5421400640 1 -- 172.21.15.144:0/4002373624 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1780531046 0 0) 0x7f542415d3a0 con 0x7f5424156660 2024-09-12T12:26:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5421400640 1 -- 172.21.15.144:0/4002373624 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5408003530 con 0x7f5424156660 2024-09-12T12:26:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5422800640 1 -- 172.21.15.144:0/4002373624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54240b3630 msgr2=0x7f542415c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5422800640 1 --2- 172.21.15.144:0/4002373624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54240b3630 0x7f542415c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5422800640 1 -- 172.21.15.144:0/4002373624 >> v1:172.21.15.144:6789/0 conn(0x7f5424156660 legacy=0x7f54240b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.061+0000 7f5422800640 1 -- 172.21.15.144:0/4002373624 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542415fe70 con 0x7f5424160950 2024-09-12T12:26:41.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5422800640 1 --2- 172.21.15.144:0/4002373624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5424160950 0x7f542415cd00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f541c009d90 tx=0x7f541c01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3611611e05b9276e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5421400640 1 -- 172.21.15.144:0/4002373624 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c0b2070 con 0x7f5424160950 2024-09-12T12:26:41.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5421400640 1 -- 172.21.15.144:0/4002373624 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541c0a5970 con 0x7f5424160950 2024-09-12T12:26:41.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5421400640 1 -- 172.21.15.144:0/4002373624 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c0a5d40 con 0x7f5424160950 2024-09-12T12:26:41.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5423200640 1 -- 172.21.15.144:0/4002373624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5424160950 msgr2=0x7f542415cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5423200640 1 --2- 172.21.15.144:0/4002373624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5424160950 0x7f542415cd00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f541c009d90 tx=0x7f541c01c8b0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5423200640 1 -- 172.21.15.144:0/4002373624 shutdown_connections 2024-09-12T12:26:41.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5423200640 1 --2- 172.21.15.144:0/4002373624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5424160950 0x7f542415cd00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5423200640 1 --2- 172.21.15.144:0/4002373624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f54240b3630 0x7f542415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5423200640 1 -- 172.21.15.144:0/4002373624 >> 172.21.15.144:0/4002373624 conn(0x7f542406e200 msgr2=0x7f542406e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5423200640 1 -- 172.21.15.144:0/4002373624 shutdown_connections 2024-09-12T12:26:41.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.065+0000 7f5423200640 1 -- 172.21.15.144:0/4002373624 wait complete. 2024-09-12T12:26:41.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 Processor -- start 2024-09-12T12:26:41.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 -- start start 2024-09-12T12:26:41.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54240b3630 0x7f54240aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5424156660 0x7f54240aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5424160950 0x7f54240af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f54240b4c20 con 0x7f5424156660 2024-09-12T12:26:41.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f54240b4aa0 con 0x7f54240b3630 2024-09-12T12:26:41.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f54240b4da0 con 0x7f5424160950 2024-09-12T12:26:41.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5424156660 0x7f54240aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5424156660 0x7f54240aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33522/0 (socket says 172.21.15.144:33522) 2024-09-12T12:26:41.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541be00640 1 -- 172.21.15.144:0/1471029491 learned_addr learned my addr 172.21.15.144:0/1471029491 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:41.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5421e00640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54240b3630 0x7f54240aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5422800640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5424160950 0x7f54240af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541be00640 1 -- 172.21.15.144:0/1471029491 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5424160950 msgr2=0x7f54240af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541be00640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5424160950 0x7f54240af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541be00640 1 -- 172.21.15.144:0/1471029491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54240b3630 msgr2=0x7f54240aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541be00640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54240b3630 0x7f54240aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541be00640 1 -- 172.21.15.144:0/1471029491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5424156030 con 0x7f5424156660 2024-09-12T12:26:41.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5421e00640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54240b3630 0x7f54240aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:41.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541be00640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5424156660 0x7f54240aef80 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f540c00e930 tx=0x7f540c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541a000640 1 -- 172.21.15.144:0/1471029491 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c017070 con 0x7f5424156660 2024-09-12T12:26:41.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541a000640 1 -- 172.21.15.144:0/1471029491 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f540c00ca00 con 0x7f5424156660 2024-09-12T12:26:41.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54240731e0 con 0x7f5424156660 2024-09-12T12:26:41.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f541a000640 1 -- 172.21.15.144:0/1471029491 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c00cdb0 con 0x7f5424156660 2024-09-12T12:26:41.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.069+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54240737a0 con 0x7f5424156660 2024-09-12T12:26:41.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.073+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54240b2f20 con 0x7f5424156660 2024-09-12T12:26:41.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.073+0000 7f541a000640 1 -- 172.21.15.144:0/1471029491 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f540c01a070 con 0x7f5424156660 2024-09-12T12:26:41.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.073+0000 7f541a000640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54000678c0 0x7f5400069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.073+0000 7f541a000640 1 -- 172.21.15.144:0/1471029491 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7f540c085e90 con 0x7f5424156660 2024-09-12T12:26:41.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.073+0000 7f5421e00640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54000678c0 0x7f5400069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.073+0000 7f5421e00640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54000678c0 0x7f5400069d80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5414005890 tx=0x7f5414009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.077+0000 7f541a000640 1 -- 172.21.15.144:0/1471029491 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f540c0561c0 con 0x7f5424156660 2024-09-12T12:26:41.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.269+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5424166c60 con 0x7f5424156660 2024-09-12T12:26:41.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.269+0000 7f541a000640 1 -- 172.21.15.144:0/1471029491 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) ==== 95+0+5250 (secure 0 0 0) 0x7f540c05a4c0 con 0x7f5424156660 2024-09-12T12:26:41.270 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:41.270 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":157,"btime":"2024-09-12T12:26:05:043642+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/480472502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":480472502},{"type":"v1","addr":"172.21.15.165:6834","nonce":480472502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2632695665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2632695665},{"type":"v1","addr":"172.21.15.144:6836","nonce":2632695665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151},{"gid":10590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2593616401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2593616401},{"type":"v1","addr":"172.21.15.144:6837","nonce":2593616401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:26:01.386066+0000","modified":"2024-09-12T12:26:04.421876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10593":{"gid":10593,"name":"b","rank":0,"incarnation":153,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2360370466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2360370466},{"type":"v1","addr":"172.21.15.165:6835","nonce":2360370466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10593,"qdb_cluster":[10593]},"id":14}]} 2024-09-12T12:26:41.270 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 157 2024-09-12T12:26:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54000678c0 msgr2=0x7f5400069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54000678c0 0x7f5400069d80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5414005890 tx=0x7f5414009040 comp rx=0 tx=0).stop 2024-09-12T12:26:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5424156660 msgr2=0x7f54240aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5424156660 0x7f54240aef80 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f540c00e930 tx=0x7f540c00edf0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 shutdown_connections 2024-09-12T12:26:41.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f54000678c0 0x7f5400069d80 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5424160950 0x7f54240af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5424156660 0x7f54240aef80 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 --2- 172.21.15.144:0/1471029491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f54240b3630 0x7f54240aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 >> 172.21.15.144:0/1471029491 conn(0x7f542406e200 msgr2=0x7f54240b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 shutdown_connections 2024-09-12T12:26:41.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.273+0000 7f5423200640 1 -- 172.21.15.144:0/1471029491 wait complete. 2024-09-12T12:26:41.291 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-12T12:26:41.468 INFO:teuthology.orchestra.run.smithi165.stdout:{"message":"","return_code":0} 2024-09-12T12:26:41.468 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-12T12:26:41.468 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-12T12:26:41.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 Processor -- start 2024-09-12T12:26:41.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 -- start start 2024-09-12T12:26:41.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5595316cf3b0 0x5595316c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316d22d0 0x5595316d4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559531629900 con 0x5595316cf790 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55953154c1b0 con 0x5595316d22d0 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x559531629a80 con 0x5595316cf3b0 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ac5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ace000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5595316cf3b0 0x5595316c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ac5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33528/0 (socket says 172.21.15.144:33528) 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ac5600640 1 -- 172.21.15.144:0/1330806761 learned_addr learned my addr 172.21.15.144:0/1330806761 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3acea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316d22d0 0x5595316d4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ac5600640 1 -- 172.21.15.144:0/1330806761 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5595316cf3b0 msgr2=0x5595316c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ac5600640 1 --2- 172.21.15.144:0/1330806761 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5595316cf3b0 0x5595316c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ac5600640 1 -- 172.21.15.144:0/1330806761 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316d22d0 msgr2=0x5595316d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ac5600640 1 --2- 172.21.15.144:0/1330806761 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316d22d0 0x5595316d4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ac5600640 1 -- 172.21.15.144:0/1330806761 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595316cdf60 con 0x5595316cf790 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3acea00640 1 --2- 172.21.15.144:0/1330806761 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316d22d0 0x5595316d4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ac5600640 1 --2- 172.21.15.144:0/1330806761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316d3b20 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009950 tx=0x7f3ab8005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557cdee41c287831 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3accc00640 1 -- 172.21.15.144:0/1330806761 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8008da0 con 0x5595316cf790 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3accc00640 1 -- 172.21.15.144:0/1330806761 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab8018070 con 0x5595316cf790 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3accc00640 1 -- 172.21.15.144:0/1330806761 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8013640 con 0x5595316cf790 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1330806761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 msgr2=0x5595316d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 --2- 172.21.15.144:0/1330806761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316d3b20 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009950 tx=0x7f3ab8005a10 comp rx=0 tx=0).stop 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1330806761 shutdown_connections 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 --2- 172.21.15.144:0/1330806761 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316d22d0 0x5595316d4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 --2- 172.21.15.144:0/1330806761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316d3b20 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 --2- 172.21.15.144:0/1330806761 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5595316cf3b0 0x5595316c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1330806761 >> 172.21.15.144:0/1330806761 conn(0x559531625bb0 msgr2=0x55953162acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1330806761 shutdown_connections 2024-09-12T12:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1330806761 wait complete. 2024-09-12T12:26:41.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.517+0000 7f3ad1a4e080 1 Processor -- start 2024-09-12T12:26:41.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ad1a4e080 1 -- start start 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ad1a4e080 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316cf3b0 0x5595316c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ad1a4e080 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ad1a4e080 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5595316d22d0 0x559531762730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ad1a4e080 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5595316cdcc0 con 0x5595316cf790 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ad1a4e080 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5595316cda20 con 0x5595316cf3b0 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ad1a4e080 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5595316d28d0 con 0x5595316d22d0 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33544/0 (socket says 172.21.15.144:33544) 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ace000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316cf3b0 0x5595316c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac5600640 1 -- 172.21.15.144:0/1865476868 learned_addr learned my addr 172.21.15.144:0/1865476868 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3acea00640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5595316d22d0 0x559531762730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac5600640 1 -- 172.21.15.144:0/1865476868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5595316d22d0 msgr2=0x559531762730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac5600640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5595316d22d0 0x559531762730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac5600640 1 -- 172.21.15.144:0/1865476868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316cf3b0 msgr2=0x5595316c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac5600640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316cf3b0 0x5595316c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac5600640 1 -- 172.21.15.144:0/1865476868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595316c69c0 con 0x5595316cf790 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ace000640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5595316cf3b0 0x5595316c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac5600640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316c5560 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8008780 tx=0x7f3ab8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac7400640 1 -- 172.21.15.144:0/1865476868 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8008ea0 con 0x5595316cf790 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac7400640 1 -- 172.21.15.144:0/1865476868 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab8021030 con 0x5595316cf790 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595316c6c60 con 0x5595316cf790 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ac7400640 1 -- 172.21.15.144:0/1865476868 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8026420 con 0x5595316cf790 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.521+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595316c71a0 con 0x5595316cf790 2024-09-12T12:26:41.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ac7400640 1 -- 172.21.15.144:0/1865476868 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ab801c420 con 0x5595316cf790 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ac7400640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3aac0662a0 0x7f3aac068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ac7400640 1 -- 172.21.15.144:0/1865476868 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7f3ab8086c00 con 0x5595316cf790 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ace000640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3aac0662a0 0x7f3aac068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55953176b9e0 0x55953176bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 --> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] -- osd_op(unknown.0.0:1 30.7 30:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e204) -- 0x55953176c300 con 0x55953176b9e0 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3acea00640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55953176b9e0 0x55953176bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ace000640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3aac0662a0 0x7f3aac068760 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00012f0 tx=0x7f3ac0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3acea00640 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55953176b9e0 0x55953176bdc0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3acea00640 1 -- 172.21.15.144:0/1865476868 <== osd.2 v2:172.21.15.144:6809/1322554046 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f3ac80aa070 con 0x55953176b9e0 2024-09-12T12:26:41.526 INFO:teuthology.orchestra.run.smithi144.stdout:Ysixmegssubdir 2024-09-12T12:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55953176b9e0 msgr2=0x55953176bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x55953176b9e0 0x55953176bdc0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3aac0662a0 msgr2=0x7f3aac068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f3aac0662a0 0x7f3aac068760 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00012f0 tx=0x7f3ac0008040 comp rx=0 tx=0).stop 2024-09-12T12:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 msgr2=0x5595316c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 --2- 172.21.15.144:0/1865476868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5595316cf790 0x5595316c5560 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8008780 tx=0x7f3ab8003030 comp rx=0 tx=0).stop 2024-09-12T12:26:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3acea00640 1 -- 172.21.15.144:0/1865476868 reap_dead start 2024-09-12T12:26:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 shutdown_connections 2024-09-12T12:26:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 >> 172.21.15.144:0/1865476868 conn(0x559531625bb0 msgr2=0x5595316c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 shutdown_connections 2024-09-12T12:26:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:41.525+0000 7f3ad1a4e080 1 -- 172.21.15.144:0/1865476868 wait complete. 2024-09-12T12:26:41.530 DEBUG:teuthology.orchestra.run.smithi144:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-12T12:26:41.633 INFO:teuthology.orchestra.run.smithi144.stderr:error: stray data at end of buffer, offset 95 2024-09-12T12:26:41.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:26:41.637 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T12:26:41.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:26:41.769 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T12:26:41.851 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T12:26:41.851 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:26:41.851 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:26:41.851 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:41.860 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:26:41.860 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:41.910 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T12:26:42.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.089+0000 7f0db8c00640 1 Processor -- start 2024-09-12T12:26:42.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.089+0000 7f0db8c00640 1 -- start start 2024-09-12T12:26:42.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.089+0000 7f0db8c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0db415cd30 0x7f0db40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.089+0000 7f0db8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0db40b5de0 0x7f0db4072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.089+0000 7f0db8c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db40b61e0 con 0x7f0db415c7b0 2024-09-12T12:26:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db8c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0db4072a50 con 0x7f0db40b5de0 2024-09-12T12:26:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db8c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0db40cde30 con 0x7f0db415cd30 2024-09-12T12:26:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0db40b5de0 0x7f0db4072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0db40b5de0 0x7f0db4072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33560/0 (socket says 172.21.15.144:33560) 2024-09-12T12:26:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db2800640 1 -- 172.21.15.144:0/1124497899 learned_addr learned my addr 172.21.15.144:0/1124497899 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:42.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db1400640 1 --2- 172.21.15.144:0/1124497899 >> v2:172.21.15.165:3300/0 conn(0x7f0db415cd30 0x7f0db40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db2800640 1 -- 172.21.15.144:0/1124497899 >> v2:172.21.15.165:3300/0 conn(0x7f0db415cd30 msgr2=0x7f0db40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:42.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db2800640 1 --2- 172.21.15.144:0/1124497899 >> v2:172.21.15.165:3300/0 conn(0x7f0db415cd30 0x7f0db40b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db2800640 1 -- 172.21.15.144:0/1124497899 >> v1:172.21.15.144:6789/0 conn(0x7f0db415c7b0 legacy=0x7f0db40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db2800640 1 -- 172.21.15.144:0/1124497899 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db40cd870 con 0x7f0db40b5de0 2024-09-12T12:26:42.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db0a00640 1 -- 172.21.15.144:0/1124497899 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930394026 0 0) 0x7f0db40b61e0 con 0x7f0db415c7b0 2024-09-12T12:26:42.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db2800640 1 --2- 172.21.15.144:0/1124497899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db40b5de0 0x7f0db4072ee0 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f0db40afd90 tx=0x7f0dac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0e710d800a089d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:42.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db0a00640 1 -- 172.21.15.144:0/1124497899 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0b0070 con 0x7f0db40b5de0 2024-09-12T12:26:42.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db0a00640 1 -- 172.21.15.144:0/1124497899 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dac0ab600 con 0x7f0db40b5de0 2024-09-12T12:26:42.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.093+0000 7f0db0a00640 1 -- 172.21.15.144:0/1124497899 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0ab9d0 con 0x7f0db40b5de0 2024-09-12T12:26:42.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 -- 172.21.15.144:0/1124497899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db40b5de0 msgr2=0x7f0db4072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 --2- 172.21.15.144:0/1124497899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db40b5de0 0x7f0db4072ee0 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f0db40afd90 tx=0x7f0dac01c520 comp rx=0 tx=0).stop 2024-09-12T12:26:42.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 -- 172.21.15.144:0/1124497899 shutdown_connections 2024-09-12T12:26:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 --2- 172.21.15.144:0/1124497899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db40b5de0 0x7f0db4072ee0 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 --2- 172.21.15.144:0/1124497899 >> v2:172.21.15.165:3300/0 conn(0x7f0db415cd30 0x7f0db40b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 -- 172.21.15.144:0/1124497899 >> 172.21.15.144:0/1124497899 conn(0x7f0db406d0d0 msgr2=0x7f0db406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 -- 172.21.15.144:0/1124497899 shutdown_connections 2024-09-12T12:26:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 -- 172.21.15.144:0/1124497899 wait complete. 2024-09-12T12:26:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 Processor -- start 2024-09-12T12:26:42.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 -- start start 2024-09-12T12:26:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db40b5de0 0x7f0db414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db415c7b0 0x7f0db414ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db415cd30 0x7f0db41523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4073fc0 con 0x7f0db415cd30 2024-09-12T12:26:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4073e40 con 0x7f0db415c7b0 2024-09-12T12:26:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0db4074140 con 0x7f0db40b5de0 2024-09-12T12:26:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db415cd30 0x7f0db41523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db415cd30 0x7f0db41523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33570/0 (socket says 172.21.15.144:33570) 2024-09-12T12:26:42.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db2800640 1 -- 172.21.15.144:0/3705439476 learned_addr learned my addr 172.21.15.144:0/3705439476 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:42.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db1400640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db415c7b0 0x7f0db414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.097+0000 7f0db1e00640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db40b5de0 0x7f0db414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0db2800640 1 -- 172.21.15.144:0/3705439476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db40b5de0 msgr2=0x7f0db414dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0db2800640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db40b5de0 0x7f0db414dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0db2800640 1 -- 172.21.15.144:0/3705439476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db415c7b0 msgr2=0x7f0db414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0db2800640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db415c7b0 0x7f0db414ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0db2800640 1 -- 172.21.15.144:0/3705439476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db414fea0 con 0x7f0db415cd30 2024-09-12T12:26:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0db2800640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db415cd30 0x7f0db41523a0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f0dac01ca00 tx=0x7f0dac0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0daa000640 1 -- 172.21.15.144:0/3705439476 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0b8020 con 0x7f0db415cd30 2024-09-12T12:26:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0daa000640 1 -- 172.21.15.144:0/3705439476 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dac0b4410 con 0x7f0db415cd30 2024-09-12T12:26:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0daa000640 1 -- 172.21.15.144:0/3705439476 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0b0040 con 0x7f0db415cd30 2024-09-12T12:26:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db414f320 con 0x7f0db415cd30 2024-09-12T12:26:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db414f8e0 con 0x7f0db415cd30 2024-09-12T12:26:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db4072ee0 con 0x7f0db415cd30 2024-09-12T12:26:42.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0daa000640 1 -- 172.21.15.144:0/3705439476 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0dac0bb020 con 0x7f0db415cd30 2024-09-12T12:26:42.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0daa000640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d940678c0 0x7f0d94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.101+0000 7f0daa000640 1 -- 172.21.15.144:0/3705439476 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7f0dac11f4a0 con 0x7f0db415cd30 2024-09-12T12:26:42.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.105+0000 7f0db1e00640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d940678c0 0x7f0d94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.105+0000 7f0db1e00640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d940678c0 0x7f0d94069d80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0da40012f0 tx=0x7f0da4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:42.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.109+0000 7f0daa000640 1 -- 172.21.15.144:0/3705439476 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0dac0c2070 con 0x7f0db415cd30 2024-09-12T12:26:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.277+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0db414bf50 con 0x7f0db415cd30 2024-09-12T12:26:42.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.277+0000 7f0daa000640 1 -- 172.21.15.144:0/3705439476 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v204) ==== 80+0+0 (secure 0 0 0) 0x7f0dac016110 con 0x7f0db415cd30 2024-09-12T12:26:42.277 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.277+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d940678c0 msgr2=0x7f0d94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.277+0000 7f0db8c00640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d940678c0 0x7f0d94069d80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f0da40012f0 tx=0x7f0da4009040 comp rx=0 tx=0).stop 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.277+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db415cd30 msgr2=0x7f0db41523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.277+0000 7f0db8c00640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db415cd30 0x7f0db41523a0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f0dac01ca00 tx=0x7f0dac0192c0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.281+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 shutdown_connections 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.281+0000 7f0db8c00640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0d940678c0 0x7f0d94069d80 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.281+0000 7f0db8c00640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0db415cd30 0x7f0db41523a0 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.281+0000 7f0db8c00640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0db415c7b0 0x7f0db414ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.281+0000 7f0db8c00640 1 --2- 172.21.15.144:0/3705439476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0db40b5de0 0x7f0db414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.281+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 >> 172.21.15.144:0/3705439476 conn(0x7f0db406d0d0 msgr2=0x7f0db40ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:42.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.281+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 shutdown_connections 2024-09-12T12:26:42.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.281+0000 7f0db8c00640 1 -- 172.21.15.144:0/3705439476 wait complete. 2024-09-12T12:26:42.298 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:26:42.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:42.299 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:42.345 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:26:42.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:42.345 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:26:42.399 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:26:42.399 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:26:42.399 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:42.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:26:42.408 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:26:42.408 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:26:42.408 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:42.450 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:26:42.450 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T12:26:42.451 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:26:42.451 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:42.459 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:26:42.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:26:42.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.633+0000 7f5f1e800640 1 Processor -- start 2024-09-12T12:26:42.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.633+0000 7f5f1e800640 1 -- start start 2024-09-12T12:26:42.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f1e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f1815cd30 0x7f5f180b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f1e800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f180b61e0 con 0x7f5f1815c7b0 2024-09-12T12:26:42.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f1e800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f180cd870 con 0x7f5f180b5de0 2024-09-12T12:26:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f1e800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5f18072a50 con 0x7f5f1815cd30 2024-09-12T12:26:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f16a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f1815cd30 0x7f5f180b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f16a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5f1815cd30 0x7f5f180b58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33580/0 (socket says 172.21.15.144:33580) 2024-09-12T12:26:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f16a00640 1 -- 172.21.15.144:0/2438220877 learned_addr learned my addr 172.21.15.144:0/2438220877 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f17400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5f1815c7b0 0x7f5f180ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45470/0 (socket says 172.21.15.144:45470) 2024-09-12T12:26:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f16a00640 1 -- 172.21.15.144:0/2438220877 >> v1:172.21.15.165:6789/0 conn(0x7f5f180b5de0 legacy=0x7f5f18072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f16a00640 1 -- 172.21.15.144:0/2438220877 >> v1:172.21.15.144:6789/0 conn(0x7f5f1815c7b0 legacy=0x7f5f180ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.637+0000 7f5f16a00640 1 -- 172.21.15.144:0/2438220877 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f180cdb50 con 0x7f5f1815cd30 2024-09-12T12:26:42.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f16a00640 1 --2- 172.21.15.144:0/2438220877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 0x7f5f180b58a0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009870 tx=0x7f5f0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81de35a6bfb20662 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:42.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f16000640 1 -- 172.21.15.144:0/2438220877 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f040b0070 con 0x7f5f1815cd30 2024-09-12T12:26:42.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f16000640 1 -- 172.21.15.144:0/2438220877 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f040ab600 con 0x7f5f1815cd30 2024-09-12T12:26:42.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f16000640 1 -- 172.21.15.144:0/2438220877 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f040ab9d0 con 0x7f5f1815cd30 2024-09-12T12:26:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 -- 172.21.15.144:0/2438220877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 msgr2=0x7f5f180b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 --2- 172.21.15.144:0/2438220877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 0x7f5f180b58a0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009870 tx=0x7f5f0401c520 comp rx=0 tx=0).stop 2024-09-12T12:26:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 -- 172.21.15.144:0/2438220877 shutdown_connections 2024-09-12T12:26:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 --2- 172.21.15.144:0/2438220877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 0x7f5f180b58a0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 -- 172.21.15.144:0/2438220877 >> 172.21.15.144:0/2438220877 conn(0x7f5f1806d0d0 msgr2=0x7f5f1806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 -- 172.21.15.144:0/2438220877 shutdown_connections 2024-09-12T12:26:42.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 -- 172.21.15.144:0/2438220877 wait complete. 2024-09-12T12:26:42.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 Processor -- start 2024-09-12T12:26:42.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 -- start start 2024-09-12T12:26:42.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f180b5de0 0x7f5f1814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f1815c7b0 0x7f5f180b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 0x7f5f180b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18074210 con 0x7f5f1815cd30 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18074090 con 0x7f5f1815c7b0 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.641+0000 7f5f1e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5f180cd610 con 0x7f5f180b5de0 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 0x7f5f180b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 0x7f5f180b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33588/0 (socket says 172.21.15.144:33588) 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17e00640 1 -- 172.21.15.144:0/2322343617 learned_addr learned my addr 172.21.15.144:0/2322343617 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17400640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f180b5de0 0x7f5f1814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f16a00640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f1815c7b0 0x7f5f180b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17e00640 1 -- 172.21.15.144:0/2322343617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f180b5de0 msgr2=0x7f5f1814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17e00640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f180b5de0 0x7f5f1814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17e00640 1 -- 172.21.15.144:0/2322343617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f1815c7b0 msgr2=0x7f5f180b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17e00640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f1815c7b0 0x7f5f180b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17e00640 1 -- 172.21.15.144:0/2322343617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f180b3da0 con 0x7f5f1815cd30 2024-09-12T12:26:42.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f17e00640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 0x7f5f180b50e0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c3c0 tx=0x7f5f1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:42.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f0f400640 1 -- 172.21.15.144:0/2322343617 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10011790 con 0x7f5f1815cd30 2024-09-12T12:26:42.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f0f400640 1 -- 172.21.15.144:0/2322343617 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f10017070 con 0x7f5f1815cd30 2024-09-12T12:26:42.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f0f400640 1 -- 172.21.15.144:0/2322343617 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10011b70 con 0x7f5f1815cd30 2024-09-12T12:26:42.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f180b4040 con 0x7f5f1815cd30 2024-09-12T12:26:42.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f180b4600 con 0x7f5f1815cd30 2024-09-12T12:26:42.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f180b58a0 con 0x7f5f1815cd30 2024-09-12T12:26:42.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.645+0000 7f5f0f400640 1 -- 172.21.15.144:0/2322343617 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f10011d10 con 0x7f5f1815cd30 2024-09-12T12:26:42.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.649+0000 7f5f0f400640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ef80678c0 0x7f5ef8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:42.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.649+0000 7f5f0f400640 1 -- 172.21.15.144:0/2322343617 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7f5f10085b40 con 0x7f5f1815cd30 2024-09-12T12:26:42.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.649+0000 7f5f17400640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ef80678c0 0x7f5ef8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:42.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.649+0000 7f5f17400640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ef80678c0 0x7f5ef8069d80 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f5f181fad70 tx=0x7f5f080016e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:42.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.653+0000 7f5f0f400640 1 -- 172.21.15.144:0/2322343617 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5f10055e20 con 0x7f5f1815cd30 2024-09-12T12:26:42.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.841+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f180b5620 con 0x7f5f1815cd30 2024-09-12T12:26:42.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f0f400640 1 -- 172.21.15.144:0/2322343617 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) ==== 95+0+5250 (secure 0 0 0) 0x7f5f1005a120 con 0x7f5f1815cd30 2024-09-12T12:26:42.843 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:42.843 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":157,"btime":"2024-09-12T12:26:05:043642+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/480472502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":480472502},{"type":"v1","addr":"172.21.15.165:6834","nonce":480472502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2632695665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2632695665},{"type":"v1","addr":"172.21.15.144:6836","nonce":2632695665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151},{"gid":10590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2593616401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2593616401},{"type":"v1","addr":"172.21.15.144:6837","nonce":2593616401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:26:01.386066+0000","modified":"2024-09-12T12:26:04.421876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10593":{"gid":10593,"name":"b","rank":0,"incarnation":153,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2360370466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2360370466},{"type":"v1","addr":"172.21.15.165:6835","nonce":2360370466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10593,"qdb_cluster":[10593]},"id":14}]} 2024-09-12T12:26:42.843 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 157 2024-09-12T12:26:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ef80678c0 msgr2=0x7f5ef8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ef80678c0 0x7f5ef8069d80 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f5f181fad70 tx=0x7f5f080016e0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 msgr2=0x7f5f180b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 0x7f5f180b50e0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000c3c0 tx=0x7f5f1000c880 comp rx=0 tx=0).stop 2024-09-12T12:26:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 shutdown_connections 2024-09-12T12:26:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f5ef80678c0 0x7f5ef8069d80 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f1815cd30 0x7f5f180b50e0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f1815c7b0 0x7f5f180b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 --2- 172.21.15.144:0/2322343617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f180b5de0 0x7f5f1814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 >> 172.21.15.144:0/2322343617 conn(0x7f5f1806d0d0 msgr2=0x7f5f18167720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 shutdown_connections 2024-09-12T12:26:42.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:42.845+0000 7f5f1e800640 1 -- 172.21.15.144:0/2322343617 wait complete. 2024-09-12T12:26:42.866 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:26:43.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.001+0000 7fce99600640 1 Processor -- start 2024-09-12T12:26:43.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.001+0000 7fce99600640 1 -- start start 2024-09-12T12:26:43.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce99600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fce9415b4e0 0x7fce940b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce99600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce940b45a0 con 0x7fce940b3ad0 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce99600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce940b3fe0 con 0x7fce940ccf30 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce99600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fce940b42c0 con 0x7fce9415b4e0 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce92000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fce940b3ad0 0x7fce94071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45480/0 (socket says 172.21.15.144:45480) 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce92000640 1 -- 172.21.15.144:0/1517291466 learned_addr learned my addr 172.21.15.144:0/1517291466 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce92a00640 1 --2- 172.21.15.144:0/1517291466 >> v2:172.21.15.165:3300/0 conn(0x7fce9415b4e0 0x7fce940b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce91600640 1 -- 172.21.15.144:0/1517291466 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210852176 0 0) 0x7fce940b45a0 con 0x7fce940b3ad0 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce91600640 1 -- 172.21.15.144:0/1517291466 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce78003530 con 0x7fce940b3ad0 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce92a00640 1 -- 172.21.15.144:0/1517291466 >> v1:172.21.15.165:6789/0 conn(0x7fce940ccf30 legacy=0x7fce940b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce91600640 1 -- 172.21.15.144:0/1517291466 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659477274 0 0) 0x7fce940b3fe0 con 0x7fce940ccf30 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce92a00640 1 -- 172.21.15.144:0/1517291466 >> v1:172.21.15.144:6789/0 conn(0x7fce940b3ad0 legacy=0x7fce94071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.005+0000 7fce92a00640 1 -- 172.21.15.144:0/1517291466 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce940b1490 con 0x7fce9415b4e0 2024-09-12T12:26:43.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce92a00640 1 --2- 172.21.15.144:0/1517291466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9415b4e0 0x7fce940b3590 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fce840097c0 tx=0x7fce8401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19d7dea66f55ebca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce91600640 1 -- 172.21.15.144:0/1517291466 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce840b1070 con 0x7fce9415b4e0 2024-09-12T12:26:43.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce91600640 1 -- 172.21.15.144:0/1517291466 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce840ac630 con 0x7fce9415b4e0 2024-09-12T12:26:43.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce91600640 1 -- 172.21.15.144:0/1517291466 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce840a8050 con 0x7fce9415b4e0 2024-09-12T12:26:43.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 -- 172.21.15.144:0/1517291466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9415b4e0 msgr2=0x7fce940b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 --2- 172.21.15.144:0/1517291466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9415b4e0 0x7fce940b3590 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fce840097c0 tx=0x7fce8401c470 comp rx=0 tx=0).stop 2024-09-12T12:26:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 -- 172.21.15.144:0/1517291466 shutdown_connections 2024-09-12T12:26:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 --2- 172.21.15.144:0/1517291466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9415b4e0 0x7fce940b3590 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 -- 172.21.15.144:0/1517291466 >> 172.21.15.144:0/1517291466 conn(0x7fce9406d0d0 msgr2=0x7fce9406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 -- 172.21.15.144:0/1517291466 shutdown_connections 2024-09-12T12:26:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 -- 172.21.15.144:0/1517291466 wait complete. 2024-09-12T12:26:43.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 Processor -- start 2024-09-12T12:26:43.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 -- start start 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce940b3ad0 0x7fce94157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce940ccf30 0x7fce9415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9415b4e0 0x7fce94157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce9415b8c0 con 0x7fce940ccf30 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce940cd750 con 0x7fce940b3ad0 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce99600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce941652e0 con 0x7fce9415b4e0 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.009+0000 7fce92000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce940ccf30 0x7fce9415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce92000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce940ccf30 0x7fce9415a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33602/0 (socket says 172.21.15.144:33602) 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce92000640 1 -- 172.21.15.144:0/3166789090 learned_addr learned my addr 172.21.15.144:0/3166789090 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce92a00640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce940b3ad0 0x7fce94157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce93400640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9415b4e0 0x7fce94157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce92000640 1 -- 172.21.15.144:0/3166789090 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9415b4e0 msgr2=0x7fce94157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce92000640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9415b4e0 0x7fce94157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce92000640 1 -- 172.21.15.144:0/3166789090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce940b3ad0 msgr2=0x7fce94157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce92000640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce940b3ad0 0x7fce94157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce92000640 1 -- 172.21.15.144:0/3166789090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce941655c0 con 0x7fce940ccf30 2024-09-12T12:26:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce92000640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce940ccf30 0x7fce9415a7f0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c480 tx=0x7fce8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce8aa00640 1 -- 172.21.15.144:0/3166789090 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80017070 con 0x7fce940ccf30 2024-09-12T12:26:43.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce8aa00640 1 -- 172.21.15.144:0/3166789090 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce80005cf0 con 0x7fce940ccf30 2024-09-12T12:26:43.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce941658a0 con 0x7fce940ccf30 2024-09-12T12:26:43.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce8aa00640 1 -- 172.21.15.144:0/3166789090 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80007290 con 0x7fce940ccf30 2024-09-12T12:26:43.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9415cc80 con 0x7fce940ccf30 2024-09-12T12:26:43.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce940b3590 con 0x7fce940ccf30 2024-09-12T12:26:43.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.013+0000 7fce8aa00640 1 -- 172.21.15.144:0/3166789090 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce8001a070 con 0x7fce940ccf30 2024-09-12T12:26:43.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.017+0000 7fce8aa00640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce740678f0 0x7fce74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.017+0000 7fce8aa00640 1 -- 172.21.15.144:0/3166789090 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7fce80085210 con 0x7fce940ccf30 2024-09-12T12:26:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.017+0000 7fce92a00640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce740678f0 0x7fce74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.017+0000 7fce92a00640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce740678f0 0x7fce74069db0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fce840ae000 tx=0x7fce840a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.021+0000 7fce8aa00640 1 -- 172.21.15.144:0/3166789090 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fce800554f0 con 0x7fce940ccf30 2024-09-12T12:26:43.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.209+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce940cff30 con 0x7fce940ccf30 2024-09-12T12:26:43.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.209+0000 7fce8aa00640 1 -- 172.21.15.144:0/3166789090 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) ==== 95+0+5250 (secure 0 0 0) 0x7fce800597f0 con 0x7fce940ccf30 2024-09-12T12:26:43.210 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:43.210 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":157,"btime":"2024-09-12T12:26:05:043642+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/480472502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":480472502},{"type":"v1","addr":"172.21.15.165:6834","nonce":480472502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2632695665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2632695665},{"type":"v1","addr":"172.21.15.144:6836","nonce":2632695665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151},{"gid":10590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2593616401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2593616401},{"type":"v1","addr":"172.21.15.144:6837","nonce":2593616401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:26:01.386066+0000","modified":"2024-09-12T12:26:04.421876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10593":{"gid":10593,"name":"b","rank":0,"incarnation":153,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2360370466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2360370466},{"type":"v1","addr":"172.21.15.165:6835","nonce":2360370466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10593,"qdb_cluster":[10593]},"id":14}]} 2024-09-12T12:26:43.211 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 157 2024-09-12T12:26:43.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce740678f0 msgr2=0x7fce74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce740678f0 0x7fce74069db0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fce840ae000 tx=0x7fce840a7000 comp rx=0 tx=0).stop 2024-09-12T12:26:43.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce940ccf30 msgr2=0x7fce9415a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce940ccf30 0x7fce9415a7f0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fce8000c480 tx=0x7fce8000c940 comp rx=0 tx=0).stop 2024-09-12T12:26:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 shutdown_connections 2024-09-12T12:26:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fce740678f0 0x7fce74069db0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9415b4e0 0x7fce94157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce940ccf30 0x7fce9415a7f0 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 --2- 172.21.15.144:0/3166789090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce940b3ad0 0x7fce94157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 >> 172.21.15.144:0/3166789090 conn(0x7fce9406d0d0 msgr2=0x7fce940713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 shutdown_connections 2024-09-12T12:26:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.213+0000 7fce99600640 1 -- 172.21.15.144:0/3166789090 wait complete. 2024-09-12T12:26:43.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.369+0000 7f85af200640 1 Processor -- start 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.369+0000 7f85af200640 1 -- start start 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.369+0000 7f85af200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b015e4a0 0x7f85b0161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.369+0000 7f85af200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f85b00d2e10 0x7f85b00737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.369+0000 7f85af200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b0162720 con 0x7f85b00b67c0 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.369+0000 7f85af200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f85b0073310 con 0x7f85b00d2e10 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.369+0000 7f85af200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f85b0162a00 con 0x7f85b015e4a0 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85ae800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f85b00b67c0 0x7f85b00b6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45496/0 (socket says 172.21.15.144:45496) 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85ae800640 1 -- 172.21.15.144:0/1889871229 learned_addr learned my addr 172.21.15.144:0/1889871229 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85ade00640 1 --2- 172.21.15.144:0/1889871229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b015e4a0 0x7f85b0161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85ad400640 1 --2- 172.21.15.144:0/1889871229 >> v2:172.21.15.165:3300/0 conn(0x7f85b00d2e10 0x7f85b00737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85aca00640 1 -- 172.21.15.144:0/1889871229 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21192884 0 0) 0x7f85b0162720 con 0x7f85b00b67c0 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85aca00640 1 -- 172.21.15.144:0/1889871229 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8594003530 con 0x7f85b00b67c0 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85ad400640 1 -- 172.21.15.144:0/1889871229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b015e4a0 msgr2=0x7f85b0161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85ad400640 1 --2- 172.21.15.144:0/1889871229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b015e4a0 0x7f85b0161e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85ad400640 1 -- 172.21.15.144:0/1889871229 >> v1:172.21.15.144:6789/0 conn(0x7f85b00b67c0 legacy=0x7f85b00b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85ad400640 1 -- 172.21.15.144:0/1889871229 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b0162ce0 con 0x7f85b00d2e10 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.373+0000 7f85ade00640 1 --2- 172.21.15.144:0/1889871229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b015e4a0 0x7f85b0161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85ad400640 1 --2- 172.21.15.144:0/1889871229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b00d2e10 0x7f85b00737a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097c0 tx=0x7f859c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af48d5ae7068d0ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85aca00640 1 -- 172.21.15.144:0/1889871229 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0b1070 con 0x7f85b00d2e10 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85aca00640 1 -- 172.21.15.144:0/1889871229 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859c0ac410 con 0x7f85b00d2e10 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85aca00640 1 -- 172.21.15.144:0/1889871229 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0ac7e0 con 0x7f85b00d2e10 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 -- 172.21.15.144:0/1889871229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b00d2e10 msgr2=0x7f85b00737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 --2- 172.21.15.144:0/1889871229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b00d2e10 0x7f85b00737a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f859c0097c0 tx=0x7f859c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 -- 172.21.15.144:0/1889871229 shutdown_connections 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 --2- 172.21.15.144:0/1889871229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b00d2e10 0x7f85b00737a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 --2- 172.21.15.144:0/1889871229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b015e4a0 0x7f85b0161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 -- 172.21.15.144:0/1889871229 >> 172.21.15.144:0/1889871229 conn(0x7f85b00d2280 msgr2=0x7f85b00d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 -- 172.21.15.144:0/1889871229 shutdown_connections 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 -- 172.21.15.144:0/1889871229 wait complete. 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 Processor -- start 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 -- start start 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85b00b67c0 0x7f85b0152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b00d2e10 0x7f85b0070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b015e4a0 0x7f85b015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f85b006d6b0 con 0x7f85b00b67c0 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f85b006d530 con 0x7f85b015e4a0 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85af200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f85b016b000 con 0x7f85b00d2e10 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85ade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85b00b67c0 0x7f85b0152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85ade00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85b00b67c0 0x7f85b0152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33608/0 (socket says 172.21.15.144:33608) 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.377+0000 7f85ade00640 1 -- 172.21.15.144:0/2400117528 learned_addr learned my addr 172.21.15.144:0/2400117528 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ae800640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b015e4a0 0x7f85b015ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ad400640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b00d2e10 0x7f85b0070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ade00640 1 -- 172.21.15.144:0/2400117528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b00d2e10 msgr2=0x7f85b0070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ade00640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b00d2e10 0x7f85b0070520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ade00640 1 -- 172.21.15.144:0/2400117528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b015e4a0 msgr2=0x7f85b015ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ade00640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b015e4a0 0x7f85b015ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ade00640 1 -- 172.21.15.144:0/2400117528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b015ee90 con 0x7f85b00b67c0 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ae800640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b015e4a0 0x7f85b015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ade00640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85b00b67c0 0x7f85b0152380 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f85a000efc0 tx=0x7f85a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85a6000640 1 -- 172.21.15.144:0/2400117528 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0018020 con 0x7f85b00b67c0 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85a6000640 1 -- 172.21.15.144:0/2400117528 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a0014680 con 0x7f85b00b67c0 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85a6000640 1 -- 172.21.15.144:0/2400117528 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0014a50 con 0x7f85b00b67c0 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b015f170 con 0x7f85b00b67c0 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b015fa10 con 0x7f85b00b67c0 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b015f340 con 0x7f85b00b67c0 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85a6000640 1 -- 172.21.15.144:0/2400117528 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85a001b020 con 0x7f85b00b67c0 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85a6000640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f85900678c0 0x7f8590069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85a6000640 1 -- 172.21.15.144:0/2400117528 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7f85a0086d50 con 0x7f85b00b67c0 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.381+0000 7f85ad400640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f85900678c0 0x7f8590069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.385+0000 7f85ad400640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f85900678c0 0x7f8590069d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f859c0ae000 tx=0x7f859c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.385+0000 7f85a6000640 1 -- 172.21.15.144:0/2400117528 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f85a0022030 con 0x7f85b00b67c0 2024-09-12T12:26:43.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.545+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85b00737a0 con 0x7f85b00b67c0 2024-09-12T12:26:43.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85a6000640 1 -- 172.21.15.144:0/2400117528 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) ==== 74+0+17164 (secure 0 0 0) 0x7f85a0010040 con 0x7f85b00b67c0 2024-09-12T12:26:43.547 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:43.548 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":204,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:26:29.697810+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:59.097807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-12T12:26:00.385383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.b","mappings":[{"from":6,"to":0}]},{"pgid":"29.f","mappings":[{"from":6,"to":0}]},{"pgid":"29.14","mappings":[{"from":6,"to":0}]},{"pgid":"29.16","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f85900678c0 msgr2=0x7f8590069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f85900678c0 0x7f8590069d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f859c0ae000 tx=0x7f859c008040 comp rx=0 tx=0).stop 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85b00b67c0 msgr2=0x7f85b0152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85b00b67c0 0x7f85b0152380 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f85a000efc0 tx=0x7f85a000c490 comp rx=0 tx=0).stop 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 shutdown_connections 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f85900678c0 0x7f8590069d80 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85b015e4a0 0x7f85b015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85b00d2e10 0x7f85b0070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 --2- 172.21.15.144:0/2400117528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85b00b67c0 0x7f85b0152380 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 >> 172.21.15.144:0/2400117528 conn(0x7f85b00d2280 msgr2=0x7f85b00d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 shutdown_connections 2024-09-12T12:26:43.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.549+0000 7f85af200640 1 -- 172.21.15.144:0/2400117528 wait complete. 2024-09-12T12:26:43.570 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:26:43.570 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:26:43.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.705+0000 7f585d600640 1 Processor -- start 2024-09-12T12:26:43.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.705+0000 7f585d600640 1 -- start start 2024-09-12T12:26:43.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f585d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f585815b4e0 0x7f58580b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f585d600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f58580b3ad0 0x7f5858071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f585d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58580b45a0 con 0x7f5858071960 2024-09-12T12:26:43.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f585d600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f58580b3fe0 con 0x7f58580b3ad0 2024-09-12T12:26:43.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f585d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f58580b42c0 con 0x7f585815b4e0 2024-09-12T12:26:43.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f5857400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5858071960 0x7f58580ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45502/0 (socket says 172.21.15.144:45502) 2024-09-12T12:26:43.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f5857400640 1 -- 172.21.15.144:0/3256726199 learned_addr learned my addr 172.21.15.144:0/3256726199 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:43.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f5856a00640 1 --2- 172.21.15.144:0/3256726199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f585815b4e0 0x7f58580b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f584fe00640 1 --2- 172.21.15.144:0/3256726199 >> v2:172.21.15.165:3300/0 conn(0x7f58580b3ad0 0x7f5858071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f5856000640 1 -- 172.21.15.144:0/3256726199 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864572871 0 0) 0x7f58580b45a0 con 0x7f5858071960 2024-09-12T12:26:43.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f5856000640 1 -- 172.21.15.144:0/3256726199 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f583c003530 con 0x7f5858071960 2024-09-12T12:26:43.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f5856a00640 1 -- 172.21.15.144:0/3256726199 >> v2:172.21.15.165:3300/0 conn(0x7f58580b3ad0 msgr2=0x7f5858071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:43.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f5856a00640 1 --2- 172.21.15.144:0/3256726199 >> v2:172.21.15.165:3300/0 conn(0x7f58580b3ad0 0x7f5858071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f5856a00640 1 -- 172.21.15.144:0/3256726199 >> v1:172.21.15.144:6789/0 conn(0x7f5858071960 legacy=0x7f58580ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.709+0000 7f5856a00640 1 -- 172.21.15.144:0/3256726199 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58580b1490 con 0x7f585815b4e0 2024-09-12T12:26:43.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f5856a00640 1 --2- 172.21.15.144:0/3256726199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f585815b4e0 0x7f58580b3590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58480097c0 tx=0x7f584801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4814fe121415f7bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f5856000640 1 -- 172.21.15.144:0/3256726199 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480aa5f0 con 0x7f585815b4e0 2024-09-12T12:26:43.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f5856000640 1 -- 172.21.15.144:0/3256726199 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58480af070 con 0x7f585815b4e0 2024-09-12T12:26:43.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f5856000640 1 -- 172.21.15.144:0/3256726199 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480aa9b0 con 0x7f585815b4e0 2024-09-12T12:26:43.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 -- 172.21.15.144:0/3256726199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f585815b4e0 msgr2=0x7f58580b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 --2- 172.21.15.144:0/3256726199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f585815b4e0 0x7f58580b3590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58480097c0 tx=0x7f584801c470 comp rx=0 tx=0).stop 2024-09-12T12:26:43.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 -- 172.21.15.144:0/3256726199 shutdown_connections 2024-09-12T12:26:43.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 --2- 172.21.15.144:0/3256726199 >> v2:172.21.15.165:3300/0 conn(0x7f58580b3ad0 0x7f5858071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 --2- 172.21.15.144:0/3256726199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f585815b4e0 0x7f58580b3590 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 -- 172.21.15.144:0/3256726199 >> 172.21.15.144:0/3256726199 conn(0x7f585806d0d0 msgr2=0x7f585806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 -- 172.21.15.144:0/3256726199 shutdown_connections 2024-09-12T12:26:43.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 -- 172.21.15.144:0/3256726199 wait complete. 2024-09-12T12:26:43.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 Processor -- start 2024-09-12T12:26:43.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 -- start start 2024-09-12T12:26:43.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5858071960 0x7f58581471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.713+0000 7f585d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58580b3ad0 0x7f58581561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f585d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f585815b4e0 0x7f5858156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f585d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f58580b2620 con 0x7f585815b4e0 2024-09-12T12:26:43.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f585d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58580b24a0 con 0x7f58580b3ad0 2024-09-12T12:26:43.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f585d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f58580cd640 con 0x7f5858071960 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5857400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f585815b4e0 0x7f5858156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5857400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f585815b4e0 0x7f5858156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33622/0 (socket says 172.21.15.144:33622) 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5857400640 1 -- 172.21.15.144:0/1252158583 learned_addr learned my addr 172.21.15.144:0/1252158583 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f584fe00640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58580b3ad0 0x7f58581561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5856a00640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5858071960 0x7f58581471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5857400640 1 -- 172.21.15.144:0/1252158583 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5858071960 msgr2=0x7f58581471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5857400640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5858071960 0x7f58581471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5857400640 1 -- 172.21.15.144:0/1252158583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58580b3ad0 msgr2=0x7f58581561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5857400640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58580b3ad0 0x7f58581561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5857400640 1 -- 172.21.15.144:0/1252158583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58581558b0 con 0x7f585815b4e0 2024-09-12T12:26:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f5857400640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f585815b4e0 0x7f5858156710 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f585000cb10 tx=0x7f585000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f584ea00640 1 -- 172.21.15.144:0/1252158583 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850017070 con 0x7f585815b4e0 2024-09-12T12:26:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f584ea00640 1 -- 172.21.15.144:0/1252158583 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585000ac70 con 0x7f585815b4e0 2024-09-12T12:26:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f584ea00640 1 -- 172.21.15.144:0/1252158583 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585000ae60 con 0x7f585815b4e0 2024-09-12T12:26:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58581577b0 con 0x7f585815b4e0 2024-09-12T12:26:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5858154b10 con 0x7f585815b4e0 2024-09-12T12:26:43.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5858071420 con 0x7f585815b4e0 2024-09-12T12:26:43.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.717+0000 7f584ea00640 1 -- 172.21.15.144:0/1252158583 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f585001a070 con 0x7f585815b4e0 2024-09-12T12:26:43.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.721+0000 7f584ea00640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58340678c0 0x7f5834069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:43.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.721+0000 7f584ea00640 1 -- 172.21.15.144:0/1252158583 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7f5850085c80 con 0x7f585815b4e0 2024-09-12T12:26:43.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.721+0000 7f5856a00640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58340678c0 0x7f5834069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:43.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.721+0000 7f5856a00640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58340678c0 0x7f5834069d80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f58480ae000 tx=0x7f58480b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:43.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.725+0000 7f584ea00640 1 -- 172.21.15.144:0/1252158583 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5850055f60 con 0x7f585815b4e0 2024-09-12T12:26:43.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.913+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58580b37b0 con 0x7f585815b4e0 2024-09-12T12:26:43.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.913+0000 7f584ea00640 1 -- 172.21.15.144:0/1252158583 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) ==== 95+0+5250 (secure 0 0 0) 0x7f585005a260 con 0x7f585815b4e0 2024-09-12T12:26:43.914 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:43.914 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":157,"btime":"2024-09-12T12:26:05:043642+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/480472502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":480472502},{"type":"v1","addr":"172.21.15.165:6834","nonce":480472502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2632695665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2632695665},{"type":"v1","addr":"172.21.15.144:6836","nonce":2632695665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151},{"gid":10590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2593616401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2593616401},{"type":"v1","addr":"172.21.15.144:6837","nonce":2593616401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:26:01.386066+0000","modified":"2024-09-12T12:26:04.421876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10593":{"gid":10593,"name":"b","rank":0,"incarnation":153,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2360370466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2360370466},{"type":"v1","addr":"172.21.15.165:6835","nonce":2360370466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10593,"qdb_cluster":[10593]},"id":14}]} 2024-09-12T12:26:43.914 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 157 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58340678c0 msgr2=0x7f5834069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58340678c0 0x7f5834069d80 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f58480ae000 tx=0x7f58480b5040 comp rx=0 tx=0).stop 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f585815b4e0 msgr2=0x7f5858156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f585815b4e0 0x7f5858156710 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f585000cb10 tx=0x7f585000a060 comp rx=0 tx=0).stop 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 shutdown_connections 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f58340678c0 0x7f5834069d80 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f585815b4e0 0x7f5858156710 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58580b3ad0 0x7f58581561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 --2- 172.21.15.144:0/1252158583 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5858071960 0x7f58581471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:43.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 >> 172.21.15.144:0/1252158583 conn(0x7f585806d0d0 msgr2=0x7f58580ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:43.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 shutdown_connections 2024-09-12T12:26:43.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:43.917+0000 7f585d600640 1 -- 172.21.15.144:0/1252158583 wait complete. 2024-09-12T12:26:43.934 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:26:44.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7999e00640 1 Processor -- start 2024-09-12T12:26:44.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7999e00640 1 -- start start 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7999e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f799415e4a0 0x7f7994161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7999e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79940d2e10 0x7f79940737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7999e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f79940b67c0 0x7f79940b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7999e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7994073310 con 0x7f799415e4a0 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7999e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7994162720 con 0x7f79940b67c0 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7999e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7994162a00 con 0x7f79940d2e10 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7998a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f799415e4a0 0x7f7994161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7998a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f799415e4a0 0x7f7994161e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33624/0 (socket says 172.21.15.144:33624) 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7998a00640 1 -- 172.21.15.144:0/1989595140 learned_addr learned my addr 172.21.15.144:0/1989595140 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7999400640 1 --2- 172.21.15.144:0/1989595140 >> v2:172.21.15.165:3300/0 conn(0x7f79940b67c0 0x7f79940b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7993e00640 1 --2- 172.21.15.144:0/1989595140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79940d2e10 0x7f79940737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7998a00640 1 -- 172.21.15.144:0/1989595140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79940d2e10 msgr2=0x7f79940737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7998a00640 1 --2- 172.21.15.144:0/1989595140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79940d2e10 0x7f79940737a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7998a00640 1 -- 172.21.15.144:0/1989595140 >> v2:172.21.15.165:3300/0 conn(0x7f79940b67c0 msgr2=0x7f79940b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7998a00640 1 --2- 172.21.15.144:0/1989595140 >> v2:172.21.15.165:3300/0 conn(0x7f79940b67c0 0x7f79940b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.073+0000 7f7998a00640 1 -- 172.21.15.144:0/1989595140 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7994162ce0 con 0x7f799415e4a0 2024-09-12T12:26:44.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7998a00640 1 --2- 172.21.15.144:0/1989595140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f799415e4a0 0x7f7994161e90 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f7994068940 tx=0x7f798801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e64e7f36bdf984 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:44.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7993400640 1 -- 172.21.15.144:0/1989595140 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79880b1070 con 0x7f799415e4a0 2024-09-12T12:26:44.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7993400640 1 -- 172.21.15.144:0/1989595140 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79880ac410 con 0x7f799415e4a0 2024-09-12T12:26:44.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7993400640 1 -- 172.21.15.144:0/1989595140 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79880ac7e0 con 0x7f799415e4a0 2024-09-12T12:26:44.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 -- 172.21.15.144:0/1989595140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f799415e4a0 msgr2=0x7f7994161e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 --2- 172.21.15.144:0/1989595140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f799415e4a0 0x7f7994161e90 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f7994068940 tx=0x7f798801c520 comp rx=0 tx=0).stop 2024-09-12T12:26:44.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 -- 172.21.15.144:0/1989595140 shutdown_connections 2024-09-12T12:26:44.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 --2- 172.21.15.144:0/1989595140 >> v2:172.21.15.165:3300/0 conn(0x7f79940b67c0 0x7f79940b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 --2- 172.21.15.144:0/1989595140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79940d2e10 0x7f79940737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 --2- 172.21.15.144:0/1989595140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f799415e4a0 0x7f7994161e90 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 -- 172.21.15.144:0/1989595140 >> 172.21.15.144:0/1989595140 conn(0x7f79940d2280 msgr2=0x7f79940d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:44.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 -- 172.21.15.144:0/1989595140 shutdown_connections 2024-09-12T12:26:44.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 -- 172.21.15.144:0/1989595140 wait complete. 2024-09-12T12:26:44.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.077+0000 7f7999e00640 1 Processor -- start 2024-09-12T12:26:44.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 -- start start 2024-09-12T12:26:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79940b67c0 0x7f7994160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79940d2e10 0x7f79941559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f799415e4a0 0x7f799415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7994073ce0 con 0x7f79940d2e10 2024-09-12T12:26:44.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f799406d530 con 0x7f79940b67c0 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f79940cf9a0 con 0x7f799415e4a0 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7993e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79940d2e10 0x7f79941559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7993e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79940d2e10 0x7f79941559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33638/0 (socket says 172.21.15.144:33638) 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7993e00640 1 -- 172.21.15.144:0/3238695231 learned_addr learned my addr 172.21.15.144:0/3238695231 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7998a00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79940b67c0 0x7f7994160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999400640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f799415e4a0 0x7f799415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7993e00640 1 -- 172.21.15.144:0/3238695231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f799415e4a0 msgr2=0x7f799415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7993e00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f799415e4a0 0x7f799415ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7993e00640 1 -- 172.21.15.144:0/3238695231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79940b67c0 msgr2=0x7f7994160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7993e00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79940b67c0 0x7f7994160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7993e00640 1 -- 172.21.15.144:0/3238695231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7994155f30 con 0x7f79940d2e10 2024-09-12T12:26:44.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7993e00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79940d2e10 0x7f79941559f0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f798000d800 tx=0x7f798000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:44.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7990c00640 1 -- 172.21.15.144:0/3238695231 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7980004030 con 0x7f79940d2e10 2024-09-12T12:26:44.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7990c00640 1 -- 172.21.15.144:0/3238695231 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79800041d0 con 0x7f79940d2e10 2024-09-12T12:26:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79940ced90 con 0x7f79940d2e10 2024-09-12T12:26:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7990c00640 1 -- 172.21.15.144:0/3238695231 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798000b6c0 con 0x7f79940d2e10 2024-09-12T12:26:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79940cf350 con 0x7f79940d2e10 2024-09-12T12:26:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.081+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7994073780 con 0x7f79940d2e10 2024-09-12T12:26:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.085+0000 7f7990c00640 1 -- 172.21.15.144:0/3238695231 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f798000b860 con 0x7f79940d2e10 2024-09-12T12:26:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.085+0000 7f7990c00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79740678c0 0x7f7974069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.085+0000 7f7990c00640 1 -- 172.21.15.144:0/3238695231 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7f79800860c0 con 0x7f79940d2e10 2024-09-12T12:26:44.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.085+0000 7f7998a00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79740678c0 0x7f7974069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.085+0000 7f7998a00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79740678c0 0x7f7974069d80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f79880ae000 tx=0x7f7988008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:44.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.089+0000 7f7990c00640 1 -- 172.21.15.144:0/3238695231 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7994155f30 con 0x7f79940d2e10 2024-09-12T12:26:44.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.277+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7994168a90 con 0x7f79940d2e10 2024-09-12T12:26:44.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.277+0000 7f7990c00640 1 -- 172.21.15.144:0/3238695231 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) ==== 95+0+5250 (secure 0 0 0) 0x7f79800563a0 con 0x7f79940d2e10 2024-09-12T12:26:44.278 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:44.278 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":157,"btime":"2024-09-12T12:26:05:043642+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/480472502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":480472502},{"type":"v1","addr":"172.21.15.165:6834","nonce":480472502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2632695665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2632695665},{"type":"v1","addr":"172.21.15.144:6836","nonce":2632695665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151},{"gid":10590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2593616401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2593616401},{"type":"v1","addr":"172.21.15.144:6837","nonce":2593616401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T12:26:01.386066+0000","modified":"2024-09-12T12:26:04.421876+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10593":{"gid":10593,"name":"b","rank":0,"incarnation":153,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2360370466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2360370466},{"type":"v1","addr":"172.21.15.165:6835","nonce":2360370466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10593,"qdb_cluster":[10593]},"id":14}]} 2024-09-12T12:26:44.278 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 157 2024-09-12T12:26:44.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79740678c0 msgr2=0x7f7974069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79740678c0 0x7f7974069d80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f79880ae000 tx=0x7f7988008040 comp rx=0 tx=0).stop 2024-09-12T12:26:44.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79940d2e10 msgr2=0x7f79941559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79940d2e10 0x7f79941559f0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f798000d800 tx=0x7f798000dcc0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 shutdown_connections 2024-09-12T12:26:44.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f79740678c0 0x7f7974069d80 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f799415e4a0 0x7f799415ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79940d2e10 0x7f79941559f0 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 --2- 172.21.15.144:0/3238695231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79940b67c0 0x7f7994160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 >> 172.21.15.144:0/3238695231 conn(0x7f79940d2280 msgr2=0x7f799406d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:44.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 shutdown_connections 2024-09-12T12:26:44.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.281+0000 7f7999e00640 1 -- 172.21.15.144:0/3238695231 wait complete. 2024-09-12T12:26:44.299 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:26:44.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac9b000640 1 Processor -- start 2024-09-12T12:26:44.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac9b000640 1 -- start start 2024-09-12T12:26:44.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac9b000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac9415c7b0 0x7fac940ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac9b000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac940cd870 con 0x7fac9415cd30 2024-09-12T12:26:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac9b000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac940cdb50 con 0x7fac940b5fb0 2024-09-12T12:26:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac9b000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fac94072a50 con 0x7fac9415c7b0 2024-09-12T12:26:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac93e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac9415c7b0 0x7fac940ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac93e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac9415c7b0 0x7fac940ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33650/0 (socket says 172.21.15.144:33650) 2024-09-12T12:26:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac93400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fac9415cd30 0x7fac940b58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45504/0 (socket says 172.21.15.144:45504) 2024-09-12T12:26:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac93e00640 1 -- 172.21.15.144:0/2805149861 learned_addr learned my addr 172.21.15.144:0/2805149861 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac93e00640 1 -- 172.21.15.144:0/2805149861 >> v1:172.21.15.165:6789/0 conn(0x7fac940b5fb0 legacy=0x7fac94072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac93e00640 1 -- 172.21.15.144:0/2805149861 >> v1:172.21.15.144:6789/0 conn(0x7fac9415cd30 legacy=0x7fac940b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.437+0000 7fac93e00640 1 -- 172.21.15.144:0/2805149861 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac940726e0 con 0x7fac9415c7b0 2024-09-12T12:26:44.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac93e00640 1 --2- 172.21.15.144:0/2805149861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415c7b0 0x7fac940ccf00 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fac84009870 tx=0x7fac8401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2123c131e032d219 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:44.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac92a00640 1 -- 172.21.15.144:0/2805149861 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac840b2070 con 0x7fac9415c7b0 2024-09-12T12:26:44.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac92a00640 1 -- 172.21.15.144:0/2805149861 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac840a9070 con 0x7fac9415c7b0 2024-09-12T12:26:44.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac92a00640 1 -- 172.21.15.144:0/2805149861 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac840ad880 con 0x7fac9415c7b0 2024-09-12T12:26:44.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac9b000640 1 -- 172.21.15.144:0/2805149861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415c7b0 msgr2=0x7fac940ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac9b000640 1 --2- 172.21.15.144:0/2805149861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415c7b0 0x7fac940ccf00 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fac84009870 tx=0x7fac8401c560 comp rx=0 tx=0).stop 2024-09-12T12:26:44.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac9b000640 1 -- 172.21.15.144:0/2805149861 shutdown_connections 2024-09-12T12:26:44.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac9b000640 1 --2- 172.21.15.144:0/2805149861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415c7b0 0x7fac940ccf00 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac9b000640 1 -- 172.21.15.144:0/2805149861 >> 172.21.15.144:0/2805149861 conn(0x7fac9406d0d0 msgr2=0x7fac9406d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:44.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac9b000640 1 -- 172.21.15.144:0/2805149861 shutdown_connections 2024-09-12T12:26:44.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.441+0000 7fac9b000640 1 -- 172.21.15.144:0/2805149861 wait complete. 2024-09-12T12:26:44.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 Processor -- start 2024-09-12T12:26:44.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 -- start start 2024-09-12T12:26:44.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac940b5fb0 0x7fac9414c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9415c7b0 0x7fac9415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415cd30 0x7fac9415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac940741d0 con 0x7fac9415cd30 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac94074050 con 0x7fac940b5fb0 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac940cde30 con 0x7fac9415c7b0 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac99000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415cd30 0x7fac9415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac99000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415cd30 0x7fac9415ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33662/0 (socket says 172.21.15.144:33662) 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac99000640 1 -- 172.21.15.144:0/2656481119 learned_addr learned my addr 172.21.15.144:0/2656481119 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac93400640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9415c7b0 0x7fac9415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac93e00640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac940b5fb0 0x7fac9414c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac99000640 1 -- 172.21.15.144:0/2656481119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9415c7b0 msgr2=0x7fac9415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac99000640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9415c7b0 0x7fac9415a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac99000640 1 -- 172.21.15.144:0/2656481119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac940b5fb0 msgr2=0x7fac9414c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac99000640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac940b5fb0 0x7fac9414c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac99000640 1 -- 172.21.15.144:0/2656481119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac94154560 con 0x7fac9415cd30 2024-09-12T12:26:44.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac99000640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415cd30 0x7fac9415ad20 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c770 tx=0x7fac8c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:44.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac8be00640 1 -- 172.21.15.144:0/2656481119 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c003b80 con 0x7fac9415cd30 2024-09-12T12:26:44.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac8be00640 1 -- 172.21.15.144:0/2656481119 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c003d20 con 0x7fac9415cd30 2024-09-12T12:26:44.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac941f55c0 con 0x7fac9415cd30 2024-09-12T12:26:44.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac8be00640 1 -- 172.21.15.144:0/2656481119 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c00aa90 con 0x7fac9415cd30 2024-09-12T12:26:44.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.445+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac941f60a0 con 0x7fac9415cd30 2024-09-12T12:26:44.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.449+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac941f53b0 con 0x7fac9415cd30 2024-09-12T12:26:44.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.449+0000 7fac8be00640 1 -- 172.21.15.144:0/2656481119 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac8c00ac30 con 0x7fac9415cd30 2024-09-12T12:26:44.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.449+0000 7fac8be00640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.449+0000 7fac8be00640 1 -- 172.21.15.144:0/2656481119 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7fac8c085d10 con 0x7fac9415cd30 2024-09-12T12:26:44.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.449+0000 7fac93e00640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.449+0000 7fac93e00640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fac840af000 tx=0x7fac84008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:44.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.453+0000 7fac8be00640 1 -- 172.21.15.144:0/2656481119 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fac8c08b020 con 0x7fac9415cd30 2024-09-12T12:26:44.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.613+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac940ccf00 con 0x7fac9415cd30 2024-09-12T12:26:44.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.613+0000 7fac8be00640 1 -- 172.21.15.144:0/2656481119 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) ==== 74+0+17164 (secure 0 0 0) 0x7fac8c055f60 con 0x7fac9415cd30 2024-09-12T12:26:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:44.614 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":204,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:26:29.697810+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:25:59.097807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_data","create_time":"2024-09-12T12:26:00.385383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.b","mappings":[{"from":6,"to":0}]},{"pgid":"29.f","mappings":[{"from":6,"to":0}]},{"pgid":"29.14","mappings":[{"from":6,"to":0}]},{"pgid":"29.16","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:44.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 msgr2=0x7fac74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fac840af000 tx=0x7fac84008040 comp rx=0 tx=0).stop 2024-09-12T12:26:44.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415cd30 msgr2=0x7fac9415ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415cd30 0x7fac9415ad20 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c770 tx=0x7fac8c00cc30 comp rx=0 tx=0).stop 2024-09-12T12:26:44.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 shutdown_connections 2024-09-12T12:26:44.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fac740678c0 0x7fac74069d80 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac9415cd30 0x7fac9415ad20 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac9415c7b0 0x7fac9415a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 --2- 172.21.15.144:0/2656481119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac940b5fb0 0x7fac9414c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 >> 172.21.15.144:0/2656481119 conn(0x7fac9406d0d0 msgr2=0x7fac9415ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:44.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 shutdown_connections 2024-09-12T12:26:44.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.617+0000 7fac9b000640 1 -- 172.21.15.144:0/2656481119 wait complete. 2024-09-12T12:26:44.636 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T12:26:44.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.773+0000 7fa723600640 1 Processor -- start 2024-09-12T12:26:44.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.773+0000 7fa723600640 1 -- start start 2024-09-12T12:26:44.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa723600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa71c15b4e0 0x7fa71c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa723600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c0b3ad0 0x7fa71c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa723600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa71c0b45a0 con 0x7fa71c071960 2024-09-12T12:26:44.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa723600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa71c0b3fe0 con 0x7fa71c15b4e0 2024-09-12T12:26:44.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa723600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa71c0b42c0 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa721600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa71c071960 0x7fa71c0ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:45512/0 (socket says 172.21.15.144:45512) 2024-09-12T12:26:44.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa721600640 1 -- 172.21.15.144:0/885766533 learned_addr learned my addr 172.21.15.144:0/885766533 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:44.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa720c00640 1 --2- 172.21.15.144:0/885766533 >> v2:172.21.15.165:3300/0 conn(0x7fa71c15b4e0 0x7fa71c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa71be00640 1 --2- 172.21.15.144:0/885766533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c0b3ad0 0x7fa71c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa71b400640 1 -- 172.21.15.144:0/885766533 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016431958 0 0) 0x7fa71c0b45a0 con 0x7fa71c071960 2024-09-12T12:26:44.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa71b400640 1 -- 172.21.15.144:0/885766533 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa700005740 con 0x7fa71c071960 2024-09-12T12:26:44.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa720c00640 1 -- 172.21.15.144:0/885766533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c0b3ad0 msgr2=0x7fa71c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:44.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa720c00640 1 --2- 172.21.15.144:0/885766533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c0b3ad0 0x7fa71c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa720c00640 1 -- 172.21.15.144:0/885766533 >> v1:172.21.15.144:6789/0 conn(0x7fa71c071960 legacy=0x7fa71c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa71b400640 1 -- 172.21.15.144:0/885766533 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1295808114 0 0) 0x7fa700005740 con 0x7fa71c071960 2024-09-12T12:26:44.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa720c00640 1 -- 172.21.15.144:0/885766533 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c0b1490 con 0x7fa71c15b4e0 2024-09-12T12:26:44.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.777+0000 7fa71be00640 1 --2- 172.21.15.144:0/885766533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c0b3ad0 0x7fa71c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:44.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa720c00640 1 --2- 172.21.15.144:0/885766533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 0x7fa71c0b3590 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009d90 tx=0x7fa70c01c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d76c2df7a0ce5d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:44.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa71b400640 1 -- 172.21.15.144:0/885766533 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c0b2070 con 0x7fa71c15b4e0 2024-09-12T12:26:44.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa71b400640 1 -- 172.21.15.144:0/885766533 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa70c0a5680 con 0x7fa71c15b4e0 2024-09-12T12:26:44.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa71b400640 1 -- 172.21.15.144:0/885766533 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714001680 con 0x7fa71c15b4e0 2024-09-12T12:26:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 -- 172.21.15.144:0/885766533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 msgr2=0x7fa71c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 --2- 172.21.15.144:0/885766533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 0x7fa71c0b3590 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009d90 tx=0x7fa70c01c860 comp rx=0 tx=0).stop 2024-09-12T12:26:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 -- 172.21.15.144:0/885766533 shutdown_connections 2024-09-12T12:26:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 --2- 172.21.15.144:0/885766533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c0b3ad0 0x7fa71c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 --2- 172.21.15.144:0/885766533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 0x7fa71c0b3590 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 -- 172.21.15.144:0/885766533 >> 172.21.15.144:0/885766533 conn(0x7fa71c06d0d0 msgr2=0x7fa71c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 -- 172.21.15.144:0/885766533 shutdown_connections 2024-09-12T12:26:44.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 -- 172.21.15.144:0/885766533 wait complete. 2024-09-12T12:26:44.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 Processor -- start 2024-09-12T12:26:44.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 -- start start 2024-09-12T12:26:44.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.781+0000 7fa723600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c071960 0x7fa71c1f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa723600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71c0b3ad0 0x7fa71c14c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa723600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 0x7fa71c14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa723600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c0b2620 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa723600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa71c0b24a0 con 0x7fa71c15b4e0 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa723600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa71c0cd640 con 0x7fa71c071960 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa71be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71c0b3ad0 0x7fa71c14c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa71be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71c0b3ad0 0x7fa71c14c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33676/0 (socket says 172.21.15.144:33676) 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa71be00640 1 -- 172.21.15.144:0/2124528 learned_addr learned my addr 172.21.15.144:0/2124528 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa720c00640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c071960 0x7fa71c1f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa721600640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 0x7fa71c14cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa71be00640 1 -- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c071960 msgr2=0x7fa71c1f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa71be00640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c071960 0x7fa71c1f71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa71be00640 1 -- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 msgr2=0x7fa71c14cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa71be00640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 0x7fa71c14cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa71be00640 1 -- 172.21.15.144:0/2124528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71c0b2d10 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa720c00640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c071960 0x7fa71c1f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa721600640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 0x7fa71c14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa71be00640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71c0b3ad0 0x7fa71c14c740 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fa70800ebb0 tx=0x7fa70800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa718c00640 1 -- 172.21.15.144:0/2124528 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa708017070 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa718c00640 1 -- 172.21.15.144:0/2124528 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa70800cc30 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa718c00640 1 -- 172.21.15.144:0/2124528 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa708013470 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71c163770 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71c163d30 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa71c071420 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa718c00640 1 -- 172.21.15.144:0/2124528 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa70801a070 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.785+0000 7fa718c00640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6fc0678c0 0x7fa6fc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:44.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.789+0000 7fa718c00640 1 -- 172.21.15.144:0/2124528 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 6217+0+0 (secure 0 0 0) 0x7fa708085dd0 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.789+0000 7fa720c00640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6fc0678c0 0x7fa6fc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:44.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.789+0000 7fa720c00640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6fc0678c0 0x7fa6fc069d80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0af000 tx=0x7fa70c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:44.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.793+0000 7fa718c00640 1 -- 172.21.15.144:0/2124528 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa708056700 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.981+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa71c0b0090 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.980 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-12T12:26:44.981+0000 7fac6ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:26:44.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.981+0000 7fa718c00640 1 -- 172.21.15.144:0/2124528 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v158) ==== 161+0+0 (secure 0 0 0) 0x7fa708056000 con 0x7fa71c0b3ad0 2024-09-12T12:26:44.982 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:26:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6fc0678c0 msgr2=0x7fa6fc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6fc0678c0 0x7fa6fc069d80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0af000 tx=0x7fa70c0a7070 comp rx=0 tx=0).stop 2024-09-12T12:26:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71c0b3ad0 msgr2=0x7fa71c14c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71c0b3ad0 0x7fa71c14c740 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fa70800ebb0 tx=0x7fa70800c520 comp rx=0 tx=0).stop 2024-09-12T12:26:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 shutdown_connections 2024-09-12T12:26:44.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa6fc0678c0 0x7fa6fc069d80 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa71c15b4e0 0x7fa71c14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa71c0b3ad0 0x7fa71c14c740 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 --2- 172.21.15.144:0/2124528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa71c071960 0x7fa71c1f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:44.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 >> 172.21.15.144:0/2124528 conn(0x7fa71c06d0d0 msgr2=0x7fa71c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:44.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 shutdown_connections 2024-09-12T12:26:44.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:44.985+0000 7fa723600640 1 -- 172.21.15.144:0/2124528 wait complete. 2024-09-12T12:26:44.997 INFO:tasks.ceph.mds.b.smithi165.stderr: -6385> 2024-09-12T12:26:03.989+0000 7f4682000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:26:45.002 INFO:tasks.ceph.mds.b.smithi165.stderr: -3163> 2024-09-12T12:26:10.352+0000 7f467d000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-12T12:26:09.166339+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={10743=0-12582912@1} caps={10743=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=10743 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5592c85c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(30)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-12T12:26:45.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:26:45.048 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-12T12:26:45.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe7200640 1 Processor -- start 2024-09-12T12:26:45.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe7200640 1 -- start start 2024-09-12T12:26:45.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 0x7fcfe815c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:45.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcfe80b1e10 0x7fcfe80b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:45.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcfe815ec50 0x7fcfe815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:45.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe815c820 con 0x7fcfe80b1e10 2024-09-12T12:26:45.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe80b2790 con 0x7fcfe815ec50 2024-09-12T12:26:45.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe815c5f0 con 0x7fcfe8155810 2024-09-12T12:26:45.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcfe80b1e10 0x7fcfe80b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:45.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcfe80b1e10 0x7fcfe80b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33678/0 (socket says 172.21.15.144:33678) 2024-09-12T12:26:45.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.145+0000 7fcfe5400640 1 -- 172.21.15.144:0/2991317164 learned_addr learned my addr 172.21.15.144:0/2991317164 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:45.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe6800640 1 --2- 172.21.15.144:0/2991317164 >> v2:172.21.15.165:3300/0 conn(0x7fcfe815ec50 0x7fcfe815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:45.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe5e00640 1 --2- 172.21.15.144:0/2991317164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 0x7fcfe815c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:45.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe5400640 1 -- 172.21.15.144:0/2991317164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 msgr2=0x7fcfe815c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:45.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe5400640 1 --2- 172.21.15.144:0/2991317164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 0x7fcfe815c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe5400640 1 -- 172.21.15.144:0/2991317164 >> v2:172.21.15.165:3300/0 conn(0x7fcfe815ec50 msgr2=0x7fcfe815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:45.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe5400640 1 --2- 172.21.15.144:0/2991317164 >> v2:172.21.15.165:3300/0 conn(0x7fcfe815ec50 0x7fcfe815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe5400640 1 -- 172.21.15.144:0/2991317164 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe80b3470 con 0x7fcfe80b1e10 2024-09-12T12:26:45.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe6800640 1 --2- 172.21.15.144:0/2991317164 >> v2:172.21.15.165:3300/0 conn(0x7fcfe815ec50 0x7fcfe815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe5400640 1 --2- 172.21.15.144:0/2991317164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 0x7fcfe80b2250 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80ced20 tx=0x7fcfd401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a29462c0ee42ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe4a00640 1 -- 172.21.15.144:0/2991317164 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40b5070 con 0x7fcfe80b1e10 2024-09-12T12:26:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe4a00640 1 -- 172.21.15.144:0/2991317164 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd40a89d0 con 0x7fcfe80b1e10 2024-09-12T12:26:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.149+0000 7fcfe4a00640 1 -- 172.21.15.144:0/2991317164 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40a8da0 con 0x7fcfe80b1e10 2024-09-12T12:26:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 -- 172.21.15.144:0/2991317164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 msgr2=0x7fcfe80b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 --2- 172.21.15.144:0/2991317164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 0x7fcfe80b2250 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80ced20 tx=0x7fcfd401ed10 comp rx=0 tx=0).stop 2024-09-12T12:26:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 -- 172.21.15.144:0/2991317164 shutdown_connections 2024-09-12T12:26:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 --2- 172.21.15.144:0/2991317164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 0x7fcfe80b2250 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 --2- 172.21.15.144:0/2991317164 >> v2:172.21.15.165:3300/0 conn(0x7fcfe815ec50 0x7fcfe815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 --2- 172.21.15.144:0/2991317164 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 0x7fcfe815c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 -- 172.21.15.144:0/2991317164 >> 172.21.15.144:0/2991317164 conn(0x7fcfe806e7e0 msgr2=0x7fcfe806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 -- 172.21.15.144:0/2991317164 shutdown_connections 2024-09-12T12:26:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 -- 172.21.15.144:0/2991317164 wait complete. 2024-09-12T12:26:45.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 Processor -- start 2024-09-12T12:26:45.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 -- start start 2024-09-12T12:26:45.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 0x7fcfe81586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 0x7fcfe815df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe815ec50 0x7fcfe815e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe80b3d10 con 0x7fcfe80b1e10 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe80b3a30 con 0x7fcfe815ec50 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe80b3ff0 con 0x7fcfe8155810 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 0x7fcfe81586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 0x7fcfe81586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33680/0 (socket says 172.21.15.144:33680) 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5e00640 1 -- 172.21.15.144:0/4108734387 learned_addr learned my addr 172.21.15.144:0/4108734387 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5400640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 0x7fcfe815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe6800640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe815ec50 0x7fcfe815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5e00640 1 -- 172.21.15.144:0/4108734387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 msgr2=0x7fcfe815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:45.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5e00640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 0x7fcfe815df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5e00640 1 -- 172.21.15.144:0/4108734387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe815ec50 msgr2=0x7fcfe815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5e00640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe815ec50 0x7fcfe815e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5e00640 1 -- 172.21.15.144:0/4108734387 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe81f4060 con 0x7fcfe80b1e10 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe6800640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe815ec50 0x7fcfe815e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.153+0000 7fcfe5e00640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 0x7fcfe81586e0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800d800 tx=0x7fcfd800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfde000640 1 -- 172.21.15.144:0/4108734387 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800b6c0 con 0x7fcfe80b1e10 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfde000640 1 -- 172.21.15.144:0/4108734387 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd8019070 con 0x7fcfe80b1e10 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfde000640 1 -- 172.21.15.144:0/4108734387 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800bae0 con 0x7fcfe80b1e10 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe81f42d0 con 0x7fcfe80b1e10 2024-09-12T12:26:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe81f4890 con 0x7fcfe80b1e10 2024-09-12T12:26:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe80b3180 con 0x7fcfe80b1e10 2024-09-12T12:26:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfde000640 1 -- 172.21.15.144:0/4108734387 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcfd800bc80 con 0x7fcfe80b1e10 2024-09-12T12:26:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfde000640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfc80678c0 0x7fcfc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:45.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfde000640 1 -- 172.21.15.144:0/4108734387 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6303+0+0 (secure 0 0 0) 0x7fcfd8086390 con 0x7fcfe80b1e10 2024-09-12T12:26:45.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.157+0000 7fcfe5400640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfc80678c0 0x7fcfc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:45.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.161+0000 7fcfe5400640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfc80678c0 0x7fcfc8069d80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40b2000 tx=0x7fcfd4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:45.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.161+0000 7fcfde000640 1 -- 172.21.15.144:0/4108734387 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcfd8056c70 con 0x7fcfe80b1e10 2024-09-12T12:26:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.357+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcfe80691c0 con 0x7fcfe80b1e10 2024-09-12T12:26:45.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.985+0000 7fcfde000640 1 -- 172.21.15.144:0/4108734387 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v159) ==== 104+0+0 (secure 0 0 0) 0x7fcfd8056570 con 0x7fcfe80b1e10 2024-09-12T12:26:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfc80678c0 msgr2=0x7fcfc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfc80678c0 0x7fcfc8069d80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40b2000 tx=0x7fcfd4009040 comp rx=0 tx=0).stop 2024-09-12T12:26:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 msgr2=0x7fcfe81586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 0x7fcfe81586e0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800d800 tx=0x7fcfd800dcc0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 shutdown_connections 2024-09-12T12:26:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfc80678c0 0x7fcfc8069d80 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfe815ec50 0x7fcfe815e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfe8155810 0x7fcfe815df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 --2- 172.21.15.144:0/4108734387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfe80b1e10 0x7fcfe81586e0 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:45.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 >> 172.21.15.144:0/4108734387 conn(0x7fcfe806e7e0 msgr2=0x7fcfe80cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:45.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 shutdown_connections 2024-09-12T12:26:45.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:45.989+0000 7fcfe7200640 1 -- 172.21.15.144:0/4108734387 wait complete. 2024-09-12T12:26:46.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:26:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb36400640 1 Processor -- start 2024-09-12T12:26:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb36400640 1 -- start start 2024-09-12T12:26:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb36400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3006f400 0x7feb3006f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb36400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb300d13a0 0x7feb300d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb36400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb300d0060 con 0x7feb3015c480 2024-09-12T12:26:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb36400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7feb3006fd80 con 0x7feb300d13a0 2024-09-12T12:26:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb36400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb3015c860 con 0x7feb3006f400 2024-09-12T12:26:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb2fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb300d13a0 0x7feb300d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb2fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb300d13a0 0x7feb300d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33684/0 (socket says 172.21.15.144:33684) 2024-09-12T12:26:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb2fe00640 1 -- 172.21.15.144:0/1510841291 learned_addr learned my addr 172.21.15.144:0/1510841291 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb2ea00640 1 --2- 172.21.15.144:0/1510841291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3006f400 0x7feb3006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb2fe00640 1 -- 172.21.15.144:0/1510841291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3006f400 msgr2=0x7feb3006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb2fe00640 1 --2- 172.21.15.144:0/1510841291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3006f400 0x7feb3006f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb2fe00640 1 -- 172.21.15.144:0/1510841291 >> v1:172.21.15.165:6789/0 conn(0x7feb3015c480 legacy=0x7feb300b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.157+0000 7feb2fe00640 1 -- 172.21.15.144:0/1510841291 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb300d0300 con 0x7feb300d13a0 2024-09-12T12:26:46.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb2fe00640 1 --2- 172.21.15.144:0/1510841291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 0x7feb300d1830 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7feb28009870 tx=0x7feb2801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed40d73242e08ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:46.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb2e000640 1 -- 172.21.15.144:0/1510841291 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb280b2070 con 0x7feb300d13a0 2024-09-12T12:26:46.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb2e000640 1 -- 172.21.15.144:0/1510841291 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb280a9070 con 0x7feb300d13a0 2024-09-12T12:26:46.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb2e000640 1 -- 172.21.15.144:0/1510841291 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb280ad880 con 0x7feb300d13a0 2024-09-12T12:26:46.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb36400640 1 -- 172.21.15.144:0/1510841291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 msgr2=0x7feb300d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:46.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb36400640 1 --2- 172.21.15.144:0/1510841291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 0x7feb300d1830 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7feb28009870 tx=0x7feb2801c560 comp rx=0 tx=0).stop 2024-09-12T12:26:46.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb36400640 1 -- 172.21.15.144:0/1510841291 shutdown_connections 2024-09-12T12:26:46.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb36400640 1 --2- 172.21.15.144:0/1510841291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 0x7feb300d1830 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb36400640 1 --2- 172.21.15.144:0/1510841291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3006f400 0x7feb3006f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb36400640 1 -- 172.21.15.144:0/1510841291 >> 172.21.15.144:0/1510841291 conn(0x7feb30067a00 msgr2=0x7feb30067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb36400640 1 -- 172.21.15.144:0/1510841291 shutdown_connections 2024-09-12T12:26:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.161+0000 7feb36400640 1 -- 172.21.15.144:0/1510841291 wait complete. 2024-09-12T12:26:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 Processor -- start 2024-09-12T12:26:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 -- start start 2024-09-12T12:26:46.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb3006f400 0x7feb30166830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:46.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 0x7feb301640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:46.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3015c480 0x7feb30165990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:46.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feb30070160 con 0x7feb300d13a0 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb300d0e80 con 0x7feb3006f400 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb30168fc0 con 0x7feb3015c480 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 0x7feb301640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 0x7feb301640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33696/0 (socket says 172.21.15.144:33696) 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2ea00640 1 -- 172.21.15.144:0/4065488149 learned_addr learned my addr 172.21.15.144:0/4065488149 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2fe00640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3015c480 0x7feb30165990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2f400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb3006f400 0x7feb30166830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2ea00640 1 -- 172.21.15.144:0/4065488149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3015c480 msgr2=0x7feb30165990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2ea00640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3015c480 0x7feb30165990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2ea00640 1 -- 172.21.15.144:0/4065488149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb3006f400 msgr2=0x7feb30166830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2ea00640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb3006f400 0x7feb30166830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2ea00640 1 -- 172.21.15.144:0/4065488149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3006e1b0 con 0x7feb300d13a0 2024-09-12T12:26:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2f400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb3006f400 0x7feb30166830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:46.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb2ea00640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 0x7feb301640e0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00e8a0 tx=0x7feb1c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:46.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb27400640 1 -- 172.21.15.144:0/4065488149 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c017070 con 0x7feb300d13a0 2024-09-12T12:26:46.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb27400640 1 -- 172.21.15.144:0/4065488149 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c00c940 con 0x7feb300d13a0 2024-09-12T12:26:46.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb27400640 1 -- 172.21.15.144:0/4065488149 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c00ccf0 con 0x7feb300d13a0 2024-09-12T12:26:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3006e490 con 0x7feb300d13a0 2024-09-12T12:26:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3006ea50 con 0x7feb300d13a0 2024-09-12T12:26:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.165+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3006f840 con 0x7feb300d13a0 2024-09-12T12:26:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.169+0000 7feb27400640 1 -- 172.21.15.144:0/4065488149 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb1c01a070 con 0x7feb300d13a0 2024-09-12T12:26:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.169+0000 7feb27400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb100678c0 0x7feb10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:46.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.169+0000 7feb27400640 1 -- 172.21.15.144:0/4065488149 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 6303+0+0 (secure 0 0 0) 0x7feb1c0860d0 con 0x7feb300d13a0 2024-09-12T12:26:46.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.169+0000 7feb2f400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb100678c0 0x7feb10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:46.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.169+0000 7feb2f400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb100678c0 0x7feb10069d80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7feb20001e10 tx=0x7feb20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:46.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.173+0000 7feb27400640 1 -- 172.21.15.144:0/4065488149 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feb1c056360 con 0x7feb300d13a0 2024-09-12T12:26:46.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.329+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7feb300b7020 con 0x7feb300d13a0 2024-09-12T12:26:46.920 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:26:46.924 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:26:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.985+0000 7feb27400640 1 -- 172.21.15.144:0/4065488149 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v206) ==== 181+0+0 (secure 0 0 0) 0x7feb1c05a660 con 0x7feb300d13a0 2024-09-12T12:26:46.986 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:26:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb100678c0 msgr2=0x7feb10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb100678c0 0x7feb10069d80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7feb20001e10 tx=0x7feb20009040 comp rx=0 tx=0).stop 2024-09-12T12:26:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 msgr2=0x7feb301640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 0x7feb301640e0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00e8a0 tx=0x7feb1c00eca0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 shutdown_connections 2024-09-12T12:26:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7feb100678c0 0x7feb10069d80 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb3015c480 0x7feb30165990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb300d13a0 0x7feb301640e0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 --2- 172.21.15.144:0/4065488149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb3006f400 0x7feb30166830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 >> 172.21.15.144:0/4065488149 conn(0x7feb30067a00 msgr2=0x7feb300b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 shutdown_connections 2024-09-12T12:26:46.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:46.989+0000 7feb36400640 1 -- 172.21.15.144:0/4065488149 wait complete. 2024-09-12T12:26:47.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:26:47.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c6c00640 1 Processor -- start 2024-09-12T12:26:47.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c6c00640 1 -- start start 2024-09-12T12:26:47.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c6c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f46c0159da0 0x7f46c00b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c6c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46c015d510 0x7f46c015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c6c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c00b76b0 con 0x7f46c015df00 2024-09-12T12:26:47.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c6c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f46c00b73d0 con 0x7f46c015d510 2024-09-12T12:26:47.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c6c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f46c00b5420 con 0x7f46c0159da0 2024-09-12T12:26:47.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46c015d510 0x7f46c015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f46c015d510 0x7f46c015d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47786/0 (socket says 172.21.15.144:47786) 2024-09-12T12:26:47.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c4e00640 1 -- 172.21.15.144:0/2001766120 learned_addr learned my addr 172.21.15.144:0/2001766120 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:47.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c5800640 1 --2- 172.21.15.144:0/2001766120 >> v2:172.21.15.165:3300/0 conn(0x7f46c0159da0 0x7f46c00b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c4e00640 1 -- 172.21.15.144:0/2001766120 >> v2:172.21.15.165:3300/0 conn(0x7f46c0159da0 msgr2=0x7f46c00b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:47.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c4e00640 1 --2- 172.21.15.144:0/2001766120 >> v2:172.21.15.165:3300/0 conn(0x7f46c0159da0 0x7f46c00b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c4e00640 1 -- 172.21.15.144:0/2001766120 >> v1:172.21.15.144:6789/0 conn(0x7f46c015df00 legacy=0x7f46c00b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c4e00640 1 -- 172.21.15.144:0/2001766120 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c00b5700 con 0x7f46c015d510 2024-09-12T12:26:47.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.205+0000 7f46c5800640 1 --2- 172.21.15.144:0/2001766120 >> v2:172.21.15.165:3300/0 conn(0x7f46c0159da0 0x7f46c00b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c4e00640 1 --2- 172.21.15.144:0/2001766120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 0x7f46c015d9c0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f46c00b4cc0 tx=0x7f46ac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd0fa7fce9bbf7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46bfe00640 1 -- 172.21.15.144:0/2001766120 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0ab680 con 0x7f46c015d510 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46bfe00640 1 -- 172.21.15.144:0/2001766120 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ac0b0070 con 0x7f46c015d510 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46bfe00640 1 -- 172.21.15.144:0/2001766120 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0aba40 con 0x7f46c015d510 2024-09-12T12:26:47.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 -- 172.21.15.144:0/2001766120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 msgr2=0x7f46c015d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 --2- 172.21.15.144:0/2001766120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 0x7f46c015d9c0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f46c00b4cc0 tx=0x7f46ac01c4f0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 -- 172.21.15.144:0/2001766120 shutdown_connections 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 --2- 172.21.15.144:0/2001766120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 0x7f46c015d9c0 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 --2- 172.21.15.144:0/2001766120 >> v2:172.21.15.165:3300/0 conn(0x7f46c0159da0 0x7f46c00b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 -- 172.21.15.144:0/2001766120 >> 172.21.15.144:0/2001766120 conn(0x7f46c006bde0 msgr2=0x7f46c0067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 -- 172.21.15.144:0/2001766120 shutdown_connections 2024-09-12T12:26:47.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 -- 172.21.15.144:0/2001766120 wait complete. 2024-09-12T12:26:47.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 Processor -- start 2024-09-12T12:26:47.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.209+0000 7f46c6c00640 1 -- start start 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46c0159da0 0x7f46c0149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 0x7f46c006e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46c015df00 0x7f46c01658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f46c00b6890 con 0x7f46c015d510 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f46c00b6710 con 0x7f46c0159da0 2024-09-12T12:26:47.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46c00b4720 con 0x7f46c015df00 2024-09-12T12:26:47.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 0x7f46c006e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 0x7f46c006e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47798/0 (socket says 172.21.15.144:47798) 2024-09-12T12:26:47.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c5800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46c0159da0 0x7f46c0149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c4e00640 1 -- 172.21.15.144:0/1182170216 learned_addr learned my addr 172.21.15.144:0/1182170216 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:47.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6200640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46c015df00 0x7f46c01658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c4e00640 1 -- 172.21.15.144:0/1182170216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46c015df00 msgr2=0x7f46c01658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c4e00640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46c015df00 0x7f46c01658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c4e00640 1 -- 172.21.15.144:0/1182170216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46c0159da0 msgr2=0x7f46c0149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c4e00640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46c0159da0 0x7f46c0149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c4e00640 1 -- 172.21.15.144:0/1182170216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c0157400 con 0x7f46c015d510 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c4e00640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 0x7f46c006e700 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f46ac019100 tx=0x7f46ac01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46bd600640 1 -- 172.21.15.144:0/1182170216 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0be5f0 con 0x7f46c015d510 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46bd600640 1 -- 172.21.15.144:0/1182170216 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ac0a7070 con 0x7f46c015d510 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c01576e0 con 0x7f46c015d510 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46bd600640 1 -- 172.21.15.144:0/1182170216 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0be990 con 0x7f46c015d510 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c0157ca0 con 0x7f46c015d510 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c0166660 con 0x7f46c015d510 2024-09-12T12:26:47.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.213+0000 7f46bd600640 1 -- 172.21.15.144:0/1182170216 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46ac0b43f0 con 0x7f46c015d510 2024-09-12T12:26:47.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.217+0000 7f46bd600640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46a00678c0 0x7f46a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:47.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.217+0000 7f46bd600640 1 -- 172.21.15.144:0/1182170216 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5749+0+0 (secure 0 0 0) 0x7f46ac1203d0 con 0x7f46c015d510 2024-09-12T12:26:47.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.217+0000 7f46c5800640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46a00678c0 0x7f46a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.217+0000 7f46c5800640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46a00678c0 0x7f46a0069d80 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009950 tx=0x7f46b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:47.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.221+0000 7f46bd600640 1 -- 172.21.15.144:0/1182170216 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f46ac0c4060 con 0x7f46c015d510 2024-09-12T12:26:47.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.377+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f46c00b2870 con 0x7f46c015d510 2024-09-12T12:26:47.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.993+0000 7f46bd600640 1 -- 172.21.15.144:0/1182170216 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v207) ==== 169+0+0 (secure 0 0 0) 0x7f46ac016110 con 0x7f46c015d510 2024-09-12T12:26:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-12T12:26:47.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46a00678c0 msgr2=0x7f46a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46a00678c0 0x7f46a0069d80 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009950 tx=0x7f46b4008040 comp rx=0 tx=0).stop 2024-09-12T12:26:47.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 msgr2=0x7f46c006e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:47.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 0x7f46c006e700 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f46ac019100 tx=0x7f46ac01ad30 comp rx=0 tx=0).stop 2024-09-12T12:26:47.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 shutdown_connections 2024-09-12T12:26:47.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f46a00678c0 0x7f46a0069d80 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f46c015df00 0x7f46c01658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f46c015d510 0x7f46c006e700 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 --2- 172.21.15.144:0/1182170216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f46c0159da0 0x7f46c0149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:47.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 >> 172.21.15.144:0/1182170216 conn(0x7f46c006bde0 msgr2=0x7f46c015a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:47.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 shutdown_connections 2024-09-12T12:26:47.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:47.997+0000 7f46c6c00640 1 -- 172.21.15.144:0/1182170216 wait complete. 2024-09-12T12:26:48.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T12:26:48.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.169+0000 7f76cb400640 1 Processor -- start 2024-09-12T12:26:48.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.169+0000 7f76cb400640 1 -- start start 2024-09-12T12:26:48.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76cb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76c415c2e0 0x7f76c4072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76cb400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f76c40af5f0 0x7f76c406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f76c406c150 0x7f76c406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76cb400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f76c40733e0 con 0x7f76c406c150 2024-09-12T12:26:48.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76cb400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f76c40cd290 con 0x7f76c40af5f0 2024-09-12T12:26:48.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76cb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f76c40cd570 con 0x7f76c415c2e0 2024-09-12T12:26:48.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f76c406c150 0x7f76c406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f76c406c150 0x7f76c406d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47802/0 (socket says 172.21.15.144:47802) 2024-09-12T12:26:48.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c9400640 1 -- 172.21.15.144:0/1966472818 learned_addr learned my addr 172.21.15.144:0/1966472818 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:48.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c9400640 1 -- 172.21.15.144:0/1966472818 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76c415c2e0 msgr2=0x7f76c4072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c9400640 1 --2- 172.21.15.144:0/1966472818 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76c415c2e0 0x7f76c4072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c9400640 1 -- 172.21.15.144:0/1966472818 >> v2:172.21.15.165:3300/0 conn(0x7f76c40af5f0 msgr2=0x7f76c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c9400640 1 --2- 172.21.15.144:0/1966472818 >> v2:172.21.15.165:3300/0 conn(0x7f76c40af5f0 0x7f76c406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c9400640 1 -- 172.21.15.144:0/1966472818 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c40cd850 con 0x7f76c406c150 2024-09-12T12:26:48.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c9400640 1 --2- 172.21.15.144:0/1966472818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c406c150 0x7f76c406d0f0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f76c40b57f0 tx=0x7f76bc01c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dcafef73d5231b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.173+0000 7f76c3400640 1 -- 172.21.15.144:0/1966472818 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0b1070 con 0x7f76c406c150 2024-09-12T12:26:48.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76c3400640 1 -- 172.21.15.144:0/1966472818 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76bc0ac440 con 0x7f76c406c150 2024-09-12T12:26:48.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76c3400640 1 -- 172.21.15.144:0/1966472818 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0ac810 con 0x7f76c406c150 2024-09-12T12:26:48.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 -- 172.21.15.144:0/1966472818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c406c150 msgr2=0x7f76c406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 --2- 172.21.15.144:0/1966472818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c406c150 0x7f76c406d0f0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f76c40b57f0 tx=0x7f76bc01c140 comp rx=0 tx=0).stop 2024-09-12T12:26:48.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 -- 172.21.15.144:0/1966472818 shutdown_connections 2024-09-12T12:26:48.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 --2- 172.21.15.144:0/1966472818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c406c150 0x7f76c406d0f0 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 --2- 172.21.15.144:0/1966472818 >> v2:172.21.15.165:3300/0 conn(0x7f76c40af5f0 0x7f76c406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 --2- 172.21.15.144:0/1966472818 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76c415c2e0 0x7f76c4072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 -- 172.21.15.144:0/1966472818 >> 172.21.15.144:0/1966472818 conn(0x7f76c4068030 msgr2=0x7f76c40b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 -- 172.21.15.144:0/1966472818 shutdown_connections 2024-09-12T12:26:48.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 -- 172.21.15.144:0/1966472818 wait complete. 2024-09-12T12:26:48.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 Processor -- start 2024-09-12T12:26:48.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 -- start start 2024-09-12T12:26:48.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76c406c150 0x7f76c41fa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c40af5f0 0x7f76c414c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76c415c2e0 0x7f76c4155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f76c40ce140 con 0x7f76c40af5f0 2024-09-12T12:26:48.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f76c40cdfc0 con 0x7f76c406c150 2024-09-12T12:26:48.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76cb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f76c40ce2c0 con 0x7f76c415c2e0 2024-09-12T12:26:48.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c40af5f0 0x7f76c414c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c40af5f0 0x7f76c414c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47808/0 (socket says 172.21.15.144:47808) 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76c3e00640 1 -- 172.21.15.144:0/2025995530 learned_addr learned my addr 172.21.15.144:0/2025995530 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76c8a00640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76c406c150 0x7f76c41fa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.177+0000 7f76c9400640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76c415c2e0 0x7f76c4155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c3e00640 1 -- 172.21.15.144:0/2025995530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76c415c2e0 msgr2=0x7f76c4155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c3e00640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76c415c2e0 0x7f76c4155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c3e00640 1 -- 172.21.15.144:0/2025995530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76c406c150 msgr2=0x7f76c41fa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c3e00640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76c406c150 0x7f76c41fa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c3e00640 1 -- 172.21.15.144:0/2025995530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c415df90 con 0x7f76c40af5f0 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c3e00640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c40af5f0 0x7f76c414c950 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b4b0 tx=0x7f76b000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c0c00640 1 -- 172.21.15.144:0/2025995530 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0014070 con 0x7f76c40af5f0 2024-09-12T12:26:48.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c0c00640 1 -- 172.21.15.144:0/2025995530 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b0010610 con 0x7f76c40af5f0 2024-09-12T12:26:48.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c0c00640 1 -- 172.21.15.144:0/2025995530 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00109e0 con 0x7f76c40af5f0 2024-09-12T12:26:48.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c415e270 con 0x7f76c40af5f0 2024-09-12T12:26:48.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c415e830 con 0x7f76c40af5f0 2024-09-12T12:26:48.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c406bc10 con 0x7f76c40af5f0 2024-09-12T12:26:48.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c0c00640 1 -- 172.21.15.144:0/2025995530 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f76b0017070 con 0x7f76c40af5f0 2024-09-12T12:26:48.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.181+0000 7f76c0c00640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f76a40678c0 0x7f76a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.185+0000 7f76c0c00640 1 -- 172.21.15.144:0/2025995530 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f76b0085500 con 0x7f76c40af5f0 2024-09-12T12:26:48.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.185+0000 7f76c8a00640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f76a40678c0 0x7f76a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.185+0000 7f76c8a00640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f76a40678c0 0x7f76a4069d80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f76b400a400 tx=0x7f76b400d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.189+0000 7f76c0c00640 1 -- 172.21.15.144:0/2025995530 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f76b0055b50 con 0x7f76c40af5f0 2024-09-12T12:26:48.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.345+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f76c40b1570 con 0x7f76c40af5f0 2024-09-12T12:26:48.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76c0c00640 1 -- 172.21.15.144:0/2025995530 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f76b0059e50 con 0x7f76c40af5f0 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f76a40678c0 msgr2=0x7f76a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f76a40678c0 0x7f76a4069d80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f76b400a400 tx=0x7f76b400d040 comp rx=0 tx=0).stop 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c40af5f0 msgr2=0x7f76c414c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c40af5f0 0x7f76c414c950 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b4b0 tx=0x7f76b000b970 comp rx=0 tx=0).stop 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 shutdown_connections 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f76a40678c0 0x7f76a4069d80 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76c415c2e0 0x7f76c4155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76c40af5f0 0x7f76c414c950 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 --2- 172.21.15.144:0/2025995530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76c406c150 0x7f76c41fa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 >> 172.21.15.144:0/2025995530 conn(0x7f76c4068030 msgr2=0x7f76c4159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 shutdown_connections 2024-09-12T12:26:48.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.349+0000 7f76cb400640 1 -- 172.21.15.144:0/2025995530 wait complete. 2024-09-12T12:26:48.369 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-12T12:26:48.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f577d400640 1 Processor -- start 2024-09-12T12:26:48.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f577d400640 1 -- start start 2024-09-12T12:26:48.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f577d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f57780b44a0 0x7f57780b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f577d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f577806e300 0x7f577806e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f577d400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57780b6f60 con 0x7f577815e5f0 2024-09-12T12:26:48.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f577d400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f577806ec90 con 0x7f57780b44a0 2024-09-12T12:26:48.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f577d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f57780b7240 con 0x7f577806e300 2024-09-12T12:26:48.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f5777200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f577806e300 0x7f577806e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f5775e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f57780b44a0 0x7f57780b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f5776800640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f577815e5f0 0x7f577806cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:40960/0 (socket says 172.21.15.144:40960) 2024-09-12T12:26:48.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f5776800640 1 -- 172.21.15.144:0/1631083103 learned_addr learned my addr 172.21.15.144:0/1631083103 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:48.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f5775e00640 1 -- 172.21.15.144:0/1631083103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f577806e300 msgr2=0x7f577806e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:48.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f5775e00640 1 --2- 172.21.15.144:0/1631083103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f577806e300 0x7f577806e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f5775e00640 1 -- 172.21.15.144:0/1631083103 >> v1:172.21.15.165:6789/0 conn(0x7f577815e5f0 legacy=0x7f577806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.505+0000 7f5775e00640 1 -- 172.21.15.144:0/1631083103 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57780b7520 con 0x7f57780b44a0 2024-09-12T12:26:48.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f5775e00640 1 --2- 172.21.15.144:0/1631083103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57780b44a0 0x7f57780b48d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f57640097c0 tx=0x7f576401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a938056514f6f8f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f5775400640 1 -- 172.21.15.144:0/1631083103 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57640aa5f0 con 0x7f57780b44a0 2024-09-12T12:26:48.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f5775400640 1 -- 172.21.15.144:0/1631083103 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57640af070 con 0x7f57780b44a0 2024-09-12T12:26:48.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f5775400640 1 -- 172.21.15.144:0/1631083103 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57640aa9b0 con 0x7f57780b44a0 2024-09-12T12:26:48.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f577d400640 1 -- 172.21.15.144:0/1631083103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57780b44a0 msgr2=0x7f57780b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f577d400640 1 --2- 172.21.15.144:0/1631083103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57780b44a0 0x7f57780b48d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f57640097c0 tx=0x7f576401c470 comp rx=0 tx=0).stop 2024-09-12T12:26:48.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f577d400640 1 -- 172.21.15.144:0/1631083103 shutdown_connections 2024-09-12T12:26:48.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f577d400640 1 --2- 172.21.15.144:0/1631083103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f577806e300 0x7f577806e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f577d400640 1 --2- 172.21.15.144:0/1631083103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57780b44a0 0x7f57780b48d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f577d400640 1 -- 172.21.15.144:0/1631083103 >> 172.21.15.144:0/1631083103 conn(0x7f577806f400 msgr2=0x7f577806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f577d400640 1 -- 172.21.15.144:0/1631083103 shutdown_connections 2024-09-12T12:26:48.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.509+0000 7f577d400640 1 -- 172.21.15.144:0/1631083103 wait complete. 2024-09-12T12:26:48.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 Processor -- start 2024-09-12T12:26:48.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 -- start start 2024-09-12T12:26:48.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f577806e300 0x7f577814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57780b44a0 0x7f5778149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f577815e5f0 0x7f57781510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f577815f880 con 0x7f577815e5f0 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f577815f700 con 0x7f577806e300 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f577815fa00 con 0x7f57780b44a0 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5777200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f577815e5f0 0x7f57781510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5777200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f577815e5f0 0x7f57781510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47820/0 (socket says 172.21.15.144:47820) 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5777200640 1 -- 172.21.15.144:0/2748676673 learned_addr learned my addr 172.21.15.144:0/2748676673 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5775e00640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57780b44a0 0x7f5778149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5776800640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f577806e300 0x7f577814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5777200640 1 -- 172.21.15.144:0/2748676673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57780b44a0 msgr2=0x7f5778149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5777200640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57780b44a0 0x7f5778149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5777200640 1 -- 172.21.15.144:0/2748676673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f577806e300 msgr2=0x7f577814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5777200640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f577806e300 0x7f577814b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5777200640 1 -- 172.21.15.144:0/2748676673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577814a580 con 0x7f577815e5f0 2024-09-12T12:26:48.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f5777200640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f577815e5f0 0x7f57781510a0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f577000e930 tx=0x7f577000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f576ea00640 1 -- 172.21.15.144:0/2748676673 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770017070 con 0x7f577815e5f0 2024-09-12T12:26:48.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f576ea00640 1 -- 172.21.15.144:0/2748676673 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577000c9a0 con 0x7f577815e5f0 2024-09-12T12:26:48.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577814a860 con 0x7f577815e5f0 2024-09-12T12:26:48.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f576ea00640 1 -- 172.21.15.144:0/2748676673 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577000cd70 con 0x7f577815e5f0 2024-09-12T12:26:48.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.513+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f577814ae20 con 0x7f577815e5f0 2024-09-12T12:26:48.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.517+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f577806e750 con 0x7f577815e5f0 2024-09-12T12:26:48.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.517+0000 7f576ea00640 1 -- 172.21.15.144:0/2748676673 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f577001a070 con 0x7f577815e5f0 2024-09-12T12:26:48.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.517+0000 7f576ea00640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57580678c0 0x7f5758069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:48.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.517+0000 7f576ea00640 1 -- 172.21.15.144:0/2748676673 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f5770085f90 con 0x7f577815e5f0 2024-09-12T12:26:48.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.517+0000 7f5776800640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57580678c0 0x7f5758069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:48.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.517+0000 7f5776800640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57580678c0 0x7f5758069d80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f57781fa4e0 tx=0x7f5768009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:48.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.521+0000 7f576ea00640 1 -- 172.21.15.144:0/2748676673 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5770056c60 con 0x7f577815e5f0 2024-09-12T12:26:48.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.737+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f577806d410 con 0x7f577815e5f0 2024-09-12T12:26:48.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.993+0000 7f576ea00640 1 -- 172.21.15.144:0/2748676673 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v687) ==== 133+0+0 (secure 0 0 0) 0x7f5770056560 con 0x7f577815e5f0 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57580678c0 msgr2=0x7f5758069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57580678c0 0x7f5758069d80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f57781fa4e0 tx=0x7f5768009040 comp rx=0 tx=0).stop 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f577815e5f0 msgr2=0x7f57781510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f577815e5f0 0x7f57781510a0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f577000e930 tx=0x7f577000edf0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 shutdown_connections 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57580678c0 0x7f5758069d80 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f577815e5f0 0x7f57781510a0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57780b44a0 0x7f5778149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 --2- 172.21.15.144:0/2748676673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f577806e300 0x7f577814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 >> 172.21.15.144:0/2748676673 conn(0x7f577806f400 msgr2=0x7f57780d1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 shutdown_connections 2024-09-12T12:26:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:48.997+0000 7f577d400640 1 -- 172.21.15.144:0/2748676673 wait complete. 2024-09-12T12:26:49.017 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ERROR 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner: 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-12T12:26:49.018 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-12T12:26:49.019 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi144 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner: 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner:Ran 13 tests in 804.945s 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner: 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner: 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-12T12:26:49.020 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi144 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-12T12:26:49.021 INFO:tasks.cephfs_test_runner: 2024-09-12T12:26:49.022 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-12T12:26:49.194 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=283aa0a93d1e4517823525da5c13aeaf Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-12T12:26:49.195 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-12T12:26:49.204 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T12:26:49.213 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T12:26:49.213 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:26:49.214 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:49.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:26:49.237 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-12T12:26:49.237 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:49.285 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350200k,nr_inodes=4087550,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9424 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T12:26:49.286 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:26:49.286 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:49.296 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:26:49.296 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-12T12:26:49.296 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:49.349 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9304 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T12:26:49.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:49.349 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:26:49.358 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:26:49.358 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T12:26:49.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:49.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:26:49.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:49.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T12:26:49.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:49.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-12T12:26:50.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:50.013 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-12T12:26:50.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:50.023 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-12T12:26:50.457 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-09-12T12:26:50.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:26:50.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:50.460 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-12T12:26:50.470 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T12:26:50.470 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T12:26:50.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:50.471 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T12:26:50.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:50.535 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T12:26:50.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:50.997 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-12T12:26:51.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:51.148 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-12T12:26:51.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:51.158 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-12T12:26:51.567 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-09-12T12:26:51.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:26:51.570 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T12:26:51.579 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T12:26:51.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:26:51.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e8000640 1 Processor -- start 2024-09-12T12:26:51.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e8000640 1 -- start start 2024-09-12T12:26:51.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e8000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe4e0156c20 0x7fe4e006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e8000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e0160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e8000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4e0160e60 con 0x7fe4e006cc20 2024-09-12T12:26:51.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e8000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe4e0160490 con 0x7fe4e0156c20 2024-09-12T12:26:51.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e8000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e00734a0 con 0x7fe4e0073060 2024-09-12T12:26:51.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e0160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e5600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe4e0156c20 0x7fe4e006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e0160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:39006/0 (socket says 172.21.15.144:39006) 2024-09-12T12:26:51.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e5600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe4e0156c20 0x7fe4e006db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:53042/0 (socket says 172.21.15.144:53042) 2024-09-12T12:26:51.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e6000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fe4e006cc20 0x7fe4e00ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:40968/0 (socket says 172.21.15.144:40968) 2024-09-12T12:26:51.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e4c00640 1 -- 172.21.15.144:0/3263831378 learned_addr learned my addr 172.21.15.144:0/3263831378 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:51.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4dfe00640 1 -- 172.21.15.144:0/3263831378 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355736807 0 0) 0x7fe4d80014a0 con 0x7fe4e006cc20 2024-09-12T12:26:51.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e4c00640 1 -- 172.21.15.144:0/3263831378 >> v2:172.21.15.165:3300/0 conn(0x7fe4e0156c20 msgr2=0x7fe4e006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:51.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e4c00640 1 --2- 172.21.15.144:0/3263831378 >> v2:172.21.15.165:3300/0 conn(0x7fe4e0156c20 0x7fe4e006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e4c00640 1 -- 172.21.15.144:0/3263831378 >> v1:172.21.15.165:6789/0 conn(0x7fe4e006cc20 legacy=0x7fe4e00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e4c00640 1 -- 172.21.15.144:0/3263831378 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e0073760 con 0x7fe4e0073060 2024-09-12T12:26:51.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.729+0000 7fe4e5600640 1 --2- 172.21.15.144:0/3263831378 >> v2:172.21.15.165:3300/0 conn(0x7fe4e0156c20 0x7fe4e006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:26:51.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4e4c00640 1 --2- 172.21.15.144:0/3263831378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e0160920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009870 tx=0x7fe4cc01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ad762c9fa0b866 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:51.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4dfe00640 1 -- 172.21.15.144:0/3263831378 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0ab650 con 0x7fe4e0073060 2024-09-12T12:26:51.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4dfe00640 1 -- 172.21.15.144:0/3263831378 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4cc0b0070 con 0x7fe4e0073060 2024-09-12T12:26:51.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4dfe00640 1 -- 172.21.15.144:0/3263831378 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0aba10 con 0x7fe4e0073060 2024-09-12T12:26:51.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4e8000640 1 -- 172.21.15.144:0/3263831378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 msgr2=0x7fe4e0160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4e8000640 1 --2- 172.21.15.144:0/3263831378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e0160920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009870 tx=0x7fe4cc01c560 comp rx=0 tx=0).stop 2024-09-12T12:26:51.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4e8000640 1 -- 172.21.15.144:0/3263831378 shutdown_connections 2024-09-12T12:26:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4e8000640 1 --2- 172.21.15.144:0/3263831378 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e0160920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4e8000640 1 --2- 172.21.15.144:0/3263831378 >> v2:172.21.15.165:3300/0 conn(0x7fe4e0156c20 0x7fe4e006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4e8000640 1 -- 172.21.15.144:0/3263831378 >> 172.21.15.144:0/3263831378 conn(0x7fe4e00cd870 msgr2=0x7fe4e00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.733+0000 7fe4e8000640 1 -- 172.21.15.144:0/3263831378 shutdown_connections 2024-09-12T12:26:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 -- 172.21.15.144:0/3263831378 wait complete. 2024-09-12T12:26:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 Processor -- start 2024-09-12T12:26:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 -- start start 2024-09-12T12:26:51.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e006cc20 0x7fe4e01500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4e0156c20 0x7fe4e01382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e01698e0 con 0x7fe4e006cc20 2024-09-12T12:26:51.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e00cf5c0 con 0x7fe4e0156c20 2024-09-12T12:26:51.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e0169a60 con 0x7fe4e0073060 2024-09-12T12:26:51.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e006cc20 0x7fe4e01500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e006cc20 0x7fe4e01500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47834/0 (socket says 172.21.15.144:47834) 2024-09-12T12:26:51.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e5600640 1 -- 172.21.15.144:0/4121250269 learned_addr learned my addr 172.21.15.144:0/4121250269 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:51.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e4c00640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e6000640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4e0156c20 0x7fe4e01382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e5600640 1 -- 172.21.15.144:0/4121250269 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 msgr2=0x7fe4e015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e5600640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e015fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e5600640 1 -- 172.21.15.144:0/4121250269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4e0156c20 msgr2=0x7fe4e01382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e5600640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4e0156c20 0x7fe4e01382c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e5600640 1 -- 172.21.15.144:0/4121250269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e0147b40 con 0x7fe4e006cc20 2024-09-12T12:26:51.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e5600640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e006cc20 0x7fe4e01500a0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400e980 tx=0x7fe4d400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:51.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4dd600640 1 -- 172.21.15.144:0/4121250269 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4017070 con 0x7fe4e006cc20 2024-09-12T12:26:51.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4dd600640 1 -- 172.21.15.144:0/4121250269 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d400ca00 con 0x7fe4e006cc20 2024-09-12T12:26:51.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4dd600640 1 -- 172.21.15.144:0/4121250269 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d400cdd0 con 0x7fe4e006cc20 2024-09-12T12:26:51.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.737+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e0147f60 con 0x7fe4e006cc20 2024-09-12T12:26:51.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.741+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e0148520 con 0x7fe4e006cc20 2024-09-12T12:26:51.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.741+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e006db60 con 0x7fe4e006cc20 2024-09-12T12:26:51.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.741+0000 7fe4dd600640 1 -- 172.21.15.144:0/4121250269 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4d401a070 con 0x7fe4e006cc20 2024-09-12T12:26:51.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.741+0000 7fe4dd600640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4c00678c0 0x7fe4c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.741+0000 7fe4dd600640 1 -- 172.21.15.144:0/4121250269 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fe4d4085a20 con 0x7fe4e006cc20 2024-09-12T12:26:51.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.741+0000 7fe4e4c00640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4c00678c0 0x7fe4c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.741+0000 7fe4e4c00640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4c00678c0 0x7fe4c0069d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0af000 tx=0x7fe4cc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:51.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.745+0000 7fe4dd600640 1 -- 172.21.15.144:0/4121250269 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe4d4055fe0 con 0x7fe4e006cc20 2024-09-12T12:26:51.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.901+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4e00691d0 con 0x7fe4c00678c0 2024-09-12T12:26:51.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.901+0000 7fe4dd600640 1 -- 172.21.15.144:0/4121250269 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13511 (secure 0 0 0) 0x7fe4e00691d0 con 0x7fe4c00678c0 2024-09-12T12:26:51.901 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:51.902 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:26:51.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4c00678c0 msgr2=0x7fe4c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4c00678c0 0x7fe4c0069d80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0af000 tx=0x7fe4cc0a7000 comp rx=0 tx=0).stop 2024-09-12T12:26:51.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e006cc20 msgr2=0x7fe4e01500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e006cc20 0x7fe4e01500a0 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7fe4d400e980 tx=0x7fe4d400ee40 comp rx=0 tx=0).stop 2024-09-12T12:26:51.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 shutdown_connections 2024-09-12T12:26:51.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe4c00678c0 0x7fe4c0069d80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4e0156c20 0x7fe4e01382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4e0073060 0x7fe4e015fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 --2- 172.21.15.144:0/4121250269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4e006cc20 0x7fe4e01500a0 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 >> 172.21.15.144:0/4121250269 conn(0x7fe4e00cd870 msgr2=0x7fe4e00ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:51.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 shutdown_connections 2024-09-12T12:26:51.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:51.905+0000 7fe4e8000640 1 -- 172.21.15.144:0/4121250269 wait complete. 2024-09-12T12:26:51.924 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":629,"stamp":"2024-09-12T12:26:51.561851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":448828,"kb_used_data":21640,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754525892,"statfs":{"total":773094113280,"available":772634513408,"internally_reserved":0,"allocated":22159360,"data_stored":11108256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308727,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-91,"num_write_kb":-6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-6,"num_bytes_recovered":-12833,"num_keys_recovered":-1,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.574303"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":515,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-12T12:26:48.030696+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:26:48.030696+0000","last_peered":"2024-09-12T12:26:48.030696+0000","last_clean":"2024-09-12T12:26:48.030696+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:26:48.030696+0000","last_undegraded":"2024-09-12T12:26:48.030696+0000","last_fullsized":"2024-09-12T12:26:48.030696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52380,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319460,"statfs":{"total":96636764160,"available":96583127040,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575022,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55956,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315884,"statfs":{"total":96636764160,"available":96579465216,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575022,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51796,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575022,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575024,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47640,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324200,"statfs":{"total":96636764160,"available":96587980800,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575023,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64280,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307560,"statfs":{"total":96636764160,"available":96570941440,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575024,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56536,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315304,"statfs":{"total":96636764160,"available":96578871296,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:26:51.925 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:26:52.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9247800640 1 Processor -- start 2024-09-12T12:26:52.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9247800640 1 -- start start 2024-09-12T12:26:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9247800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9240161cb0 0x7f924015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9247800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f92400b4970 0x7f924015fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9247800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92401602e0 0x7f92400aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9247800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f924015fbf0 con 0x7f9240161cb0 2024-09-12T12:26:52.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9247800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9240159100 con 0x7f92400b4970 2024-09-12T12:26:52.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9247800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f924015f0d0 con 0x7f92401602e0 2024-09-12T12:26:52.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9244e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9240161cb0 0x7f924015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9244e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9240161cb0 0x7f924015eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47836/0 (socket says 172.21.15.144:47836) 2024-09-12T12:26:52.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9244e00640 1 -- 172.21.15.144:0/638355615 learned_addr learned my addr 172.21.15.144:0/638355615 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:52.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9245800640 1 --2- 172.21.15.144:0/638355615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92401602e0 0x7f92400aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f923fe00640 1 --2- 172.21.15.144:0/638355615 >> v2:172.21.15.165:3300/0 conn(0x7f92400b4970 0x7f924015fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9244e00640 1 -- 172.21.15.144:0/638355615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92401602e0 msgr2=0x7f92400aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9244e00640 1 --2- 172.21.15.144:0/638355615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92401602e0 0x7f92400aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9244e00640 1 -- 172.21.15.144:0/638355615 >> v2:172.21.15.165:3300/0 conn(0x7f92400b4970 msgr2=0x7f924015fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9244e00640 1 --2- 172.21.15.144:0/638355615 >> v2:172.21.15.165:3300/0 conn(0x7f92400b4970 0x7f924015fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9244e00640 1 -- 172.21.15.144:0/638355615 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924015f350 con 0x7f9240161cb0 2024-09-12T12:26:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f9245800640 1 --2- 172.21.15.144:0/638355615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92401602e0 0x7f92400aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.061+0000 7f923fe00640 1 --2- 172.21.15.144:0/638355615 >> v2:172.21.15.165:3300/0 conn(0x7f92400b4970 0x7f924015fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:52.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9244e00640 1 --2- 172.21.15.144:0/638355615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9240161cb0 0x7f924015eb90 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f9240070410 tx=0x7f923001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a474782a232af005 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f923f400640 1 -- 172.21.15.144:0/638355615 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92300b0070 con 0x7f9240161cb0 2024-09-12T12:26:52.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f923f400640 1 -- 172.21.15.144:0/638355615 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92300ab600 con 0x7f9240161cb0 2024-09-12T12:26:52.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f923f400640 1 -- 172.21.15.144:0/638355615 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92300ab9d0 con 0x7f9240161cb0 2024-09-12T12:26:52.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9247800640 1 -- 172.21.15.144:0/638355615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9240161cb0 msgr2=0x7f924015eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9247800640 1 --2- 172.21.15.144:0/638355615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9240161cb0 0x7f924015eb90 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f9240070410 tx=0x7f923001c520 comp rx=0 tx=0).stop 2024-09-12T12:26:52.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9247800640 1 -- 172.21.15.144:0/638355615 shutdown_connections 2024-09-12T12:26:52.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9247800640 1 --2- 172.21.15.144:0/638355615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92401602e0 0x7f92400aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9247800640 1 --2- 172.21.15.144:0/638355615 >> v2:172.21.15.165:3300/0 conn(0x7f92400b4970 0x7f924015fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9247800640 1 --2- 172.21.15.144:0/638355615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9240161cb0 0x7f924015eb90 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9247800640 1 -- 172.21.15.144:0/638355615 >> 172.21.15.144:0/638355615 conn(0x7f92400cd870 msgr2=0x7f92400cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9247800640 1 -- 172.21.15.144:0/638355615 shutdown_connections 2024-09-12T12:26:52.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.065+0000 7f9247800640 1 -- 172.21.15.144:0/638355615 wait complete. 2024-09-12T12:26:52.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 Processor -- start 2024-09-12T12:26:52.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 -- start start 2024-09-12T12:26:52.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92400b4970 0x7f924014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92401602e0 0x7f92400735c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9240161cb0 0x7f9240073b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f92400cf130 con 0x7f92401602e0 2024-09-12T12:26:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92400cefb0 con 0x7f92400b4970 2024-09-12T12:26:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f92400cf2b0 con 0x7f9240161cb0 2024-09-12T12:26:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92401602e0 0x7f92400735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92401602e0 0x7f92400735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47842/0 (socket says 172.21.15.144:47842) 2024-09-12T12:26:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923fe00640 1 -- 172.21.15.144:0/696245122 learned_addr learned my addr 172.21.15.144:0/696245122 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9244e00640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92400b4970 0x7f924014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9245800640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9240161cb0 0x7f9240073b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923fe00640 1 -- 172.21.15.144:0/696245122 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9240161cb0 msgr2=0x7f9240073b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923fe00640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9240161cb0 0x7f9240073b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923fe00640 1 -- 172.21.15.144:0/696245122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92400b4970 msgr2=0x7f924014c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923fe00640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92400b4970 0x7f924014c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923fe00640 1 -- 172.21.15.144:0/696245122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924006f390 con 0x7f92401602e0 2024-09-12T12:26:52.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923fe00640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92401602e0 0x7f92400735c0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f922c00e810 tx=0x7f922c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923cc00640 1 -- 172.21.15.144:0/696245122 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c017070 con 0x7f92401602e0 2024-09-12T12:26:52.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923cc00640 1 -- 172.21.15.144:0/696245122 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c00c8d0 con 0x7f92401602e0 2024-09-12T12:26:52.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f923cc00640 1 -- 172.21.15.144:0/696245122 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c00f040 con 0x7f92401602e0 2024-09-12T12:26:52.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924006f670 con 0x7f92401602e0 2024-09-12T12:26:52.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.069+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924006fc30 con 0x7f92401602e0 2024-09-12T12:26:52.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.073+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92400aef50 con 0x7f92401602e0 2024-09-12T12:26:52.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.073+0000 7f923cc00640 1 -- 172.21.15.144:0/696245122 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f922c01a070 con 0x7f92401602e0 2024-09-12T12:26:52.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.073+0000 7f923cc00640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.073+0000 7f923cc00640 1 -- 172.21.15.144:0/696245122 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f922c085660 con 0x7f92401602e0 2024-09-12T12:26:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.073+0000 7f9244e00640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.073+0000 7f9244e00640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f92300ad000 tx=0x7f92300a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.077+0000 7f923cc00640 1 -- 172.21.15.144:0/696245122 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f922c055cb0 con 0x7f92401602e0 2024-09-12T12:26:52.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.233+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92400691d0 con 0x7f92200678c0 2024-09-12T12:26:52.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.233+0000 7f923cc00640 1 -- 172.21.15.144:0/696245122 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13511 (secure 0 0 0) 0x7f92400691d0 con 0x7f92200678c0 2024-09-12T12:26:52.234 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:52.234 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:26:52.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 msgr2=0x7f9220069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f92300ad000 tx=0x7f92300a6000 comp rx=0 tx=0).stop 2024-09-12T12:26:52.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92401602e0 msgr2=0x7f92400735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92401602e0 0x7f92400735c0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f922c00e810 tx=0x7f922c00ecd0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 shutdown_connections 2024-09-12T12:26:52.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f92200678c0 0x7f9220069d80 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9240161cb0 0x7f9240073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92401602e0 0x7f92400735c0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 --2- 172.21.15.144:0/696245122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92400b4970 0x7f924014c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 >> 172.21.15.144:0/696245122 conn(0x7f92400cd870 msgr2=0x7f92400b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 shutdown_connections 2024-09-12T12:26:52.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.237+0000 7f9247800640 1 -- 172.21.15.144:0/696245122 wait complete. 2024-09-12T12:26:52.255 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":629,"stamp":"2024-09-12T12:26:51.561851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":448828,"kb_used_data":21640,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754525892,"statfs":{"total":773094113280,"available":772634513408,"internally_reserved":0,"allocated":22159360,"data_stored":11108256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308727,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-91,"num_write_kb":-6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-6,"num_bytes_recovered":-12833,"num_keys_recovered":-1,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.574303"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":515,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-12T12:26:48.030696+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:26:48.030696+0000","last_peered":"2024-09-12T12:26:48.030696+0000","last_clean":"2024-09-12T12:26:48.030696+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:26:48.030696+0000","last_undegraded":"2024-09-12T12:26:48.030696+0000","last_fullsized":"2024-09-12T12:26:48.030696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52380,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319460,"statfs":{"total":96636764160,"available":96583127040,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575022,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55956,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315884,"statfs":{"total":96636764160,"available":96579465216,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575022,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51796,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575022,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575024,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47640,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324200,"statfs":{"total":96636764160,"available":96587980800,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575023,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64280,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307560,"statfs":{"total":96636764160,"available":96570941440,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575024,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56536,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315304,"statfs":{"total":96636764160,"available":96578871296,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:26:52.256 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T12:26:52.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:26:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee2a00640 1 Processor -- start 2024-09-12T12:26:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee2a00640 1 -- start start 2024-09-12T12:26:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efedc15c7b0 0x7efedc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 0x7efedc0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efedc0b5de0 0x7efedc1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee2a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efedc072a50 con 0x7efedc15c7b0 2024-09-12T12:26:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efedc0cde30 con 0x7efedc0b5de0 2024-09-12T12:26:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efedc0b6210 con 0x7efedc15cd30 2024-09-12T12:26:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efedbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efedc15c7b0 0x7efedc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efedbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efedc15c7b0 0x7efedc0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47850/0 (socket says 172.21.15.144:47850) 2024-09-12T12:26:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efedbe00640 1 -- 172.21.15.144:0/130280007 learned_addr learned my addr 172.21.15.144:0/130280007 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:52.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efed3e00640 1 --2- 172.21.15.144:0/130280007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 0x7efedc0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee0a00640 1 --2- 172.21.15.144:0/130280007 >> v2:172.21.15.165:3300/0 conn(0x7efedc0b5de0 0x7efedc1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efedbe00640 1 -- 172.21.15.144:0/130280007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 msgr2=0x7efedc0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efedbe00640 1 --2- 172.21.15.144:0/130280007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 0x7efedc0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efedbe00640 1 -- 172.21.15.144:0/130280007 >> v2:172.21.15.165:3300/0 conn(0x7efedc0b5de0 msgr2=0x7efedc1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efedbe00640 1 --2- 172.21.15.144:0/130280007 >> v2:172.21.15.165:3300/0 conn(0x7efedc0b5de0 0x7efedc1601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efedbe00640 1 -- 172.21.15.144:0/130280007 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc0cd870 con 0x7efedc15c7b0 2024-09-12T12:26:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.393+0000 7efee0a00640 1 --2- 172.21.15.144:0/130280007 >> v2:172.21.15.165:3300/0 conn(0x7efedc0b5de0 0x7efedc1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efedbe00640 1 --2- 172.21.15.144:0/130280007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc15c7b0 0x7efedc0ccf00 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7efedc0ce230 tx=0x7efecc01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56962a5c5f16f3a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efedb400640 1 -- 172.21.15.144:0/130280007 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc0b0070 con 0x7efedc15c7b0 2024-09-12T12:26:52.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efedb400640 1 -- 172.21.15.144:0/130280007 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efecc0ab600 con 0x7efedc15c7b0 2024-09-12T12:26:52.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efedb400640 1 -- 172.21.15.144:0/130280007 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc0ab9d0 con 0x7efedc15c7b0 2024-09-12T12:26:52.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efee2a00640 1 -- 172.21.15.144:0/130280007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc15c7b0 msgr2=0x7efedc0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efee2a00640 1 --2- 172.21.15.144:0/130280007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc15c7b0 0x7efedc0ccf00 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7efedc0ce230 tx=0x7efecc01c260 comp rx=0 tx=0).stop 2024-09-12T12:26:52.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efee2a00640 1 -- 172.21.15.144:0/130280007 shutdown_connections 2024-09-12T12:26:52.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efee2a00640 1 --2- 172.21.15.144:0/130280007 >> v2:172.21.15.165:3300/0 conn(0x7efedc0b5de0 0x7efedc1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efee2a00640 1 --2- 172.21.15.144:0/130280007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 0x7efedc0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efee2a00640 1 --2- 172.21.15.144:0/130280007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc15c7b0 0x7efedc0ccf00 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efee2a00640 1 -- 172.21.15.144:0/130280007 >> 172.21.15.144:0/130280007 conn(0x7efedc06d0d0 msgr2=0x7efedc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efee2a00640 1 -- 172.21.15.144:0/130280007 shutdown_connections 2024-09-12T12:26:52.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.397+0000 7efee2a00640 1 -- 172.21.15.144:0/130280007 wait complete. 2024-09-12T12:26:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 Processor -- start 2024-09-12T12:26:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 -- start start 2024-09-12T12:26:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc0b5de0 0x7efedc0b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efedc15c7b0 0x7efedc143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 0x7efedc0ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efedc072ee0 con 0x7efedc0b5de0 2024-09-12T12:26:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efedc0cd650 con 0x7efedc15c7b0 2024-09-12T12:26:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efedc073060 con 0x7efedc15cd30 2024-09-12T12:26:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efedbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc0b5de0 0x7efedc0b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efedbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc0b5de0 0x7efedc0b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47866/0 (socket says 172.21.15.144:47866) 2024-09-12T12:26:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efedbe00640 1 -- 172.21.15.144:0/1952493989 learned_addr learned my addr 172.21.15.144:0/1952493989 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:52.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee0a00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 0x7efedc0ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efed3e00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efedc15c7b0 0x7efedc143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efedbe00640 1 -- 172.21.15.144:0/1952493989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 msgr2=0x7efedc0ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efedbe00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 0x7efedc0ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efedbe00640 1 -- 172.21.15.144:0/1952493989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efedc15c7b0 msgr2=0x7efedc143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efedbe00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efedc15c7b0 0x7efedc143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efedbe00640 1 -- 172.21.15.144:0/1952493989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc0b5bb0 con 0x7efedc0b5de0 2024-09-12T12:26:52.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efed3e00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efedc15c7b0 0x7efedc143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efedbe00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc0b5de0 0x7efedc0b5670 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7efecc01a910 tx=0x7efecc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efed8c00640 1 -- 172.21.15.144:0/1952493989 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc0b9070 con 0x7efedc0b5de0 2024-09-12T12:26:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efed8c00640 1 -- 172.21.15.144:0/1952493989 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efecc0b4400 con 0x7efedc0b5de0 2024-09-12T12:26:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efed8c00640 1 -- 172.21.15.144:0/1952493989 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc0b0040 con 0x7efedc0b5de0 2024-09-12T12:26:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc156120 con 0x7efedc0b5de0 2024-09-12T12:26:52.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc1566e0 con 0x7efedc0b5de0 2024-09-12T12:26:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.401+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efedc0ccf00 con 0x7efedc0b5de0 2024-09-12T12:26:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.405+0000 7efed8c00640 1 -- 172.21.15.144:0/1952493989 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efecc0b33a0 con 0x7efedc0b5de0 2024-09-12T12:26:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.405+0000 7efed8c00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efeb80678c0 0x7efeb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.405+0000 7efed8c00640 1 -- 172.21.15.144:0/1952493989 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7efecc11ed50 con 0x7efedc0b5de0 2024-09-12T12:26:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.405+0000 7efed3e00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efeb80678c0 0x7efeb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.405+0000 7efed3e00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efeb80678c0 0x7efeb8069d80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7efedc146cc0 tx=0x7efec4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.409+0000 7efed8c00640 1 -- 172.21.15.144:0/1952493989 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efecc016110 con 0x7efedc0b5de0 2024-09-12T12:26:52.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.561+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efedc071550 con 0x7efeb80678c0 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.561+0000 7efed8c00640 1 -- 172.21.15.144:0/1952493989 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13511 (secure 0 0 0) 0x7efedc071550 con 0x7efeb80678c0 2024-09-12T12:26:52.562 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:52.563 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:26:52.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efeb80678c0 msgr2=0x7efeb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efeb80678c0 0x7efeb8069d80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7efedc146cc0 tx=0x7efec4008040 comp rx=0 tx=0).stop 2024-09-12T12:26:52.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc0b5de0 msgr2=0x7efedc0b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc0b5de0 0x7efedc0b5670 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7efecc01a910 tx=0x7efecc019000 comp rx=0 tx=0).stop 2024-09-12T12:26:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 shutdown_connections 2024-09-12T12:26:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7efeb80678c0 0x7efeb8069d80 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efedc15cd30 0x7efedc0ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efedc15c7b0 0x7efedc143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 --2- 172.21.15.144:0/1952493989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efedc0b5de0 0x7efedc0b5670 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 >> 172.21.15.144:0/1952493989 conn(0x7efedc06d0d0 msgr2=0x7efedc155490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 shutdown_connections 2024-09-12T12:26:52.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.565+0000 7efee2a00640 1 -- 172.21.15.144:0/1952493989 wait complete. 2024-09-12T12:26:52.584 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":629,"stamp":"2024-09-12T12:26:51.561851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":448828,"kb_used_data":21640,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754525892,"statfs":{"total":773094113280,"available":772634513408,"internally_reserved":0,"allocated":22159360,"data_stored":11108256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308727,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-91,"num_write_kb":-6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-6,"num_bytes_recovered":-12833,"num_keys_recovered":-1,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.574303"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":515,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-12T12:26:48.030696+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:26:48.030696+0000","last_peered":"2024-09-12T12:26:48.030696+0000","last_clean":"2024-09-12T12:26:48.030696+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:26:48.030696+0000","last_undegraded":"2024-09-12T12:26:48.030696+0000","last_fullsized":"2024-09-12T12:26:48.030696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575023,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52380,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319460,"statfs":{"total":96636764160,"available":96583127040,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575022,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55956,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315884,"statfs":{"total":96636764160,"available":96579465216,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575022,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51796,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575022,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575024,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47640,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324200,"statfs":{"total":96636764160,"available":96587980800,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575021,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575023,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64280,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307560,"statfs":{"total":96636764160,"available":96570941440,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575024,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56536,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315304,"statfs":{"total":96636764160,"available":96578871296,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:26:52.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:26:52.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.721+0000 7f0a94600640 1 Processor -- start 2024-09-12T12:26:52.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.721+0000 7f0a94600640 1 -- start start 2024-09-12T12:26:52.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a94600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c0cd640 0x7f0a8c071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a94600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a8c0b45a0 con 0x7f0a8c15b4e0 2024-09-12T12:26:52.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a94600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a8c0b3fe0 con 0x7f0a8c071420 2024-09-12T12:26:52.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a94600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8c0b42c0 con 0x7f0a8c0cd640 2024-09-12T12:26:52.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a91c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0a8c15b4e0 0x7f0a8c0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40918/0 (socket says 172.21.15.144:40918) 2024-09-12T12:26:52.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a91c00640 1 -- 172.21.15.144:0/1091219068 learned_addr learned my addr 172.21.15.144:0/1091219068 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:52.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a92600640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c0cd640 0x7f0a8c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493417550 0 0) 0x7f0a8c0b45a0 con 0x7f0a8c15b4e0 2024-09-12T12:26:52.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a74003530 con 0x7f0a8c15b4e0 2024-09-12T12:26:52.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2987915581 0 0) 0x7f0a74003530 con 0x7f0a8c15b4e0 2024-09-12T12:26:52.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c0cd640 msgr2=0x7f0a8c071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c0cd640 0x7f0a8c071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 >> v1:172.21.15.165:6789/0 conn(0x7f0a8c071420 legacy=0x7f0a8c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c0b1490 con 0x7f0a8c15b4e0 2024-09-12T12:26:52.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f0a80001680 con 0x7f0a8c15b4e0 2024-09-12T12:26:52.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 >> v1:172.21.15.144:6789/0 conn(0x7f0a8c15b4e0 legacy=0x7f0a8c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c0cd640 0x7f0a740039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a74003f70 0x7f0a74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a74004d50 0x7f0a740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c0b42c0 con 0x7f0a74003f70 2024-09-12T12:26:52.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7400bab0 con 0x7f0a74004d50 2024-09-12T12:26:52.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7400dec0 con 0x7f0a8c0cd640 2024-09-12T12:26:52.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a91200640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a74003f70 0x7f0a74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a91c00640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c0cd640 0x7f0a740039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a92600640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a74004d50 0x7f0a740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a91200640 1 -- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c0cd640 msgr2=0x7f0a740039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a91200640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c0cd640 0x7f0a740039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a91200640 1 -- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a74004d50 msgr2=0x7f0a740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:52.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a91200640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a74004d50 0x7f0a740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.725+0000 7f0a91200640 1 -- 172.21.15.144:0/1091219068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a74003530 con 0x7f0a74003f70 2024-09-12T12:26:52.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a91200640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a74003f70 0x7f0a74004810 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f0a78001780 tx=0x7f0a7801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476acc174b501380 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a780013a0 con 0x7f0a74003f70 2024-09-12T12:26:52.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a780052f0 con 0x7f0a74003f70 2024-09-12T12:26:52.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a8be00640 1 -- 172.21.15.144:0/1091219068 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78003840 con 0x7f0a74003f70 2024-09-12T12:26:52.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a94600640 1 -- 172.21.15.144:0/1091219068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a74003f70 msgr2=0x7f0a74004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a94600640 1 --2- 172.21.15.144:0/1091219068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a74003f70 0x7f0a74004810 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f0a78001780 tx=0x7f0a7801c420 comp rx=0 tx=0).stop 2024-09-12T12:26:52.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a92600640 1 -- 172.21.15.144:0/1091219068 reap_dead start 2024-09-12T12:26:52.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a94600640 1 -- 172.21.15.144:0/1091219068 shutdown_connections 2024-09-12T12:26:52.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a94600640 1 -- 172.21.15.144:0/1091219068 >> 172.21.15.144:0/1091219068 conn(0x7f0a8c06d0d0 msgr2=0x7f0a8c06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a94600640 1 -- 172.21.15.144:0/1091219068 shutdown_connections 2024-09-12T12:26:52.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.729+0000 7f0a94600640 1 -- 172.21.15.144:0/1091219068 wait complete. 2024-09-12T12:26:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 Processor -- start 2024-09-12T12:26:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 -- start start 2024-09-12T12:26:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a74003f70 0x7f0a8c141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c150af0 0x7f0a8c13e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8c1536b0 0x7f0a8c13f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c0cdef0 con 0x7f0a8c1536b0 2024-09-12T12:26:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c0b3ca0 con 0x7f0a74003f70 2024-09-12T12:26:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8c15b8c0 con 0x7f0a8c150af0 2024-09-12T12:26:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a92600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8c1536b0 0x7f0a8c13f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a92600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8c1536b0 0x7f0a8c13f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47880/0 (socket says 172.21.15.144:47880) 2024-09-12T12:26:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a92600640 1 -- 172.21.15.144:0/1301387642 learned_addr learned my addr 172.21.15.144:0/1301387642 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:52.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a91c00640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a74003f70 0x7f0a8c141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a91200640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c150af0 0x7f0a8c13e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a92600640 1 -- 172.21.15.144:0/1301387642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c150af0 msgr2=0x7f0a8c13e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a92600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c150af0 0x7f0a8c13e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a92600640 1 -- 172.21.15.144:0/1301387642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a74003f70 msgr2=0x7f0a8c141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a92600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a74003f70 0x7f0a8c141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a92600640 1 -- 172.21.15.144:0/1301387642 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c150f70 con 0x7f0a8c1536b0 2024-09-12T12:26:52.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a92600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8c1536b0 0x7f0a8c13f300 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c070f90 tx=0x7f0a8400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a89600640 1 -- 172.21.15.144:0/1301387642 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400fde0 con 0x7f0a8c1536b0 2024-09-12T12:26:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a89600640 1 -- 172.21.15.144:0/1301387642 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a84015430 con 0x7f0a8c1536b0 2024-09-12T12:26:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a89600640 1 -- 172.21.15.144:0/1301387642 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84015820 con 0x7f0a8c1536b0 2024-09-12T12:26:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8c1528f0 con 0x7f0a8c1536b0 2024-09-12T12:26:52.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8c152eb0 con 0x7f0a8c1536b0 2024-09-12T12:26:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.733+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8c071840 con 0x7f0a8c1536b0 2024-09-12T12:26:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.737+0000 7f0a89600640 1 -- 172.21.15.144:0/1301387642 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a840159c0 con 0x7f0a8c1536b0 2024-09-12T12:26:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.737+0000 7f0a89600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a6c0678f0 0x7f0a6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.737+0000 7f0a89600640 1 -- 172.21.15.144:0/1301387642 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f0a84086880 con 0x7f0a8c1536b0 2024-09-12T12:26:52.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.737+0000 7f0a91c00640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a6c0678f0 0x7f0a6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:52.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.737+0000 7f0a91c00640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a6c0678f0 0x7f0a6c069db0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0a800011f0 tx=0x7f0a80007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:52.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.741+0000 7f0a89600640 1 -- 172.21.15.144:0/1301387642 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a8c150f70 con 0x7f0a8c1536b0 2024-09-12T12:26:52.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.901+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a8c0cf9e0 con 0x7f0a8c1536b0 2024-09-12T12:26:52.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.901+0000 7f0a89600640 1 -- 172.21.15.144:0/1301387642 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) ==== 74+0+13341 (secure 0 0 0) 0x7f0a84019030 con 0x7f0a8c1536b0 2024-09-12T12:26:52.901 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:52.901 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":207,"fsid":"91f78d05-407b-4adf-ae67-409c5ce36eb9","created":"2024-09-12T12:12:20.383845+0000","modified":"2024-09-12T12:26:47.989929+0000","last_up_change":"2024-09-12T12:12:33.679343+0000","last_in_change":"2024-09-12T12:12:22.905516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:12:35.438330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4337f826-e2f8-424f-bbf2-95cac64c0b1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6810","nonce":1854211635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6814","nonce":1854211635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6821","nonce":1854211635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1854211635},{"type":"v1","addr":"172.21.15.144:6818","nonce":1854211635}]},"public_addr":"172.21.15.144:6810/1854211635","cluster_addr":"172.21.15.144:6814/1854211635","heartbeat_back_addr":"172.21.15.144:6821/1854211635","heartbeat_front_addr":"172.21.15.144:6818/1854211635","state":["exists","up"]},{"osd":1,"uuid":"e4cf52b9-ec9b-4086-b5dd-c0120f7ab5a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6825","nonce":68043553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6827","nonce":68043553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6831","nonce":68043553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":68043553},{"type":"v1","addr":"172.21.15.144:6829","nonce":68043553}]},"public_addr":"172.21.15.144:6825/68043553","cluster_addr":"172.21.15.144:6827/68043553","heartbeat_back_addr":"172.21.15.144:6831/68043553","heartbeat_front_addr":"172.21.15.144:6829/68043553","state":["exists","up"]},{"osd":2,"uuid":"7479c663-64a8-4493-b198-547f3031af57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6809","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6811","nonce":1322554046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6813","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6815","nonce":1322554046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6823","nonce":1322554046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6817","nonce":1322554046},{"type":"v1","addr":"172.21.15.144:6820","nonce":1322554046}]},"public_addr":"172.21.15.144:6811/1322554046","cluster_addr":"172.21.15.144:6815/1322554046","heartbeat_back_addr":"172.21.15.144:6823/1322554046","heartbeat_front_addr":"172.21.15.144:6820/1322554046","state":["exists","up"]},{"osd":3,"uuid":"f48972e1-284a-4504-9006-8491c0001f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6801","nonce":331901335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6803","nonce":331901335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6807","nonce":331901335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":331901335},{"type":"v1","addr":"172.21.15.144:6805","nonce":331901335}]},"public_addr":"172.21.15.144:6801/331901335","cluster_addr":"172.21.15.144:6803/331901335","heartbeat_back_addr":"172.21.15.144:6807/331901335","heartbeat_front_addr":"172.21.15.144:6805/331901335","state":["exists","up"]},{"osd":4,"uuid":"5edc1d3c-f2cb-4d2c-949f-e25ec3f168f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6825","nonce":2062585005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6827","nonce":2062585005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6831","nonce":2062585005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2062585005},{"type":"v1","addr":"172.21.15.165:6829","nonce":2062585005}]},"public_addr":"172.21.15.165:6825/2062585005","cluster_addr":"172.21.15.165:6827/2062585005","heartbeat_back_addr":"172.21.15.165:6831/2062585005","heartbeat_front_addr":"172.21.15.165:6829/2062585005","state":["exists","up"]},{"osd":5,"uuid":"47ea549e-8f7e-42d6-bd80-0c100b2efd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6802","nonce":2887749117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6806","nonce":2887749117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6813","nonce":2887749117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":2887749117},{"type":"v1","addr":"172.21.15.165:6809","nonce":2887749117}]},"public_addr":"172.21.15.165:6802/2887749117","cluster_addr":"172.21.15.165:6806/2887749117","heartbeat_back_addr":"172.21.15.165:6813/2887749117","heartbeat_front_addr":"172.21.15.165:6809/2887749117","state":["exists","up"]},{"osd":6,"uuid":"97981375-ee59-41ae-9d02-36da47193340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6817","nonce":608700228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6819","nonce":608700228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6823","nonce":608700228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":608700228},{"type":"v1","addr":"172.21.15.165:6821","nonce":608700228}]},"public_addr":"172.21.15.165:6817/608700228","cluster_addr":"172.21.15.165:6819/608700228","heartbeat_back_addr":"172.21.15.165:6823/608700228","heartbeat_front_addr":"172.21.15.165:6821/608700228","state":["exists","up"]},{"osd":7,"uuid":"3e38fcc7-f7fc-4aba-9d77-b3a746d0eb51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6803","nonce":1577381026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6807","nonce":1577381026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6815","nonce":1577381026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":1577381026},{"type":"v1","addr":"172.21.15.165:6812","nonce":1577381026}]},"public_addr":"172.21.15.165:6803/1577381026","cluster_addr":"172.21.15.165:6807/1577381026","heartbeat_back_addr":"172.21.15.165:6815/1577381026","heartbeat_front_addr":"172.21.15.165:6812/1577381026","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.013878+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.344073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:30.149766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.998584+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.964721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.978382+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.957672+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.832889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.165:6835/2360370466":"2024-09-13T12:26:44.983584+0000","172.21.15.165:6833/2360370466":"2024-09-13T12:26:44.983584+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:52.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a6c0678f0 msgr2=0x7f0a6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a6c0678f0 0x7f0a6c069db0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0a800011f0 tx=0x7f0a80007900 comp rx=0 tx=0).stop 2024-09-12T12:26:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8c1536b0 msgr2=0x7f0a8c13f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8c1536b0 0x7f0a8c13f300 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c070f90 tx=0x7f0a8400f580 comp rx=0 tx=0).stop 2024-09-12T12:26:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 shutdown_connections 2024-09-12T12:26:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f0a6c0678f0 0x7f0a6c069db0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a8c1536b0 0x7f0a8c13f300 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a8c150af0 0x7f0a8c13e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 --2- 172.21.15.144:0/1301387642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a74003f70 0x7f0a8c141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 >> 172.21.15.144:0/1301387642 conn(0x7f0a8c06d0d0 msgr2=0x7f0a8c0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 shutdown_connections 2024-09-12T12:26:52.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:52.905+0000 7f0a94600640 1 -- 172.21.15.144:0/1301387642 wait complete. 2024-09-12T12:26:53.923 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T12:26:53.924 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T12:26:54.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd56600640 1 Processor -- start 2024-09-12T12:26:54.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd56600640 1 -- start start 2024-09-12T12:26:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd56600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd50145cd0 0x7fcd50146340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd56600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd5006d700 0x7fcd50073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd56600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd5006cd20 con 0x7fcd501483d0 2024-09-12T12:26:54.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd56600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcd501460b0 con 0x7fcd5006d700 2024-09-12T12:26:54.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd56600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcd50146880 con 0x7fcd50145cd0 2024-09-12T12:26:54.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd4fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd5006d700 0x7fcd50073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd4fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd5006d700 0x7fcd50073650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47884/0 (socket says 172.21.15.144:47884) 2024-09-12T12:26:54.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd4fe00640 1 -- 172.21.15.144:0/29469489 learned_addr learned my addr 172.21.15.144:0/29469489 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:54.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd4f400640 1 --2- 172.21.15.144:0/29469489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd50145cd0 0x7fcd50146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd4fe00640 1 -- 172.21.15.144:0/29469489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd50145cd0 msgr2=0x7fcd50146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd4fe00640 1 --2- 172.21.15.144:0/29469489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd50145cd0 0x7fcd50146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd4fe00640 1 -- 172.21.15.144:0/29469489 >> v1:172.21.15.165:6789/0 conn(0x7fcd501483d0 legacy=0x7fcd5006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.077+0000 7fcd4fe00640 1 -- 172.21.15.144:0/29469489 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd50148bb0 con 0x7fcd5006d700 2024-09-12T12:26:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd4fe00640 1 --2- 172.21.15.144:0/29469489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5006d700 0x7fcd50073650 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009e50 tx=0x7fcd4801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c6a2a228a532e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd4e000640 1 -- 172.21.15.144:0/29469489 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd480a5830 con 0x7fcd5006d700 2024-09-12T12:26:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd4e000640 1 -- 172.21.15.144:0/29469489 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd480a59d0 con 0x7fcd5006d700 2024-09-12T12:26:54.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd4e000640 1 -- 172.21.15.144:0/29469489 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd480a5da0 con 0x7fcd5006d700 2024-09-12T12:26:54.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd56600640 1 -- 172.21.15.144:0/29469489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5006d700 msgr2=0x7fcd50073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd56600640 1 --2- 172.21.15.144:0/29469489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5006d700 0x7fcd50073650 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009e50 tx=0x7fcd4801c970 comp rx=0 tx=0).stop 2024-09-12T12:26:54.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd56600640 1 -- 172.21.15.144:0/29469489 shutdown_connections 2024-09-12T12:26:54.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd56600640 1 --2- 172.21.15.144:0/29469489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd5006d700 0x7fcd50073650 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd56600640 1 --2- 172.21.15.144:0/29469489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd50145cd0 0x7fcd50146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd56600640 1 -- 172.21.15.144:0/29469489 >> 172.21.15.144:0/29469489 conn(0x7fcd5006bc10 msgr2=0x7fcd5006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd56600640 1 -- 172.21.15.144:0/29469489 shutdown_connections 2024-09-12T12:26:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.081+0000 7fcd56600640 1 -- 172.21.15.144:0/29469489 wait complete. 2024-09-12T12:26:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 Processor -- start 2024-09-12T12:26:54.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 -- start start 2024-09-12T12:26:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd5006d700 0x7fcd50141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd50145cd0 0x7fcd5014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd501483d0 0x7fcd501426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd501487b0 con 0x7fcd501483d0 2024-09-12T12:26:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd50072e00 con 0x7fcd50145cd0 2024-09-12T12:26:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcd50148930 con 0x7fcd5006d700 2024-09-12T12:26:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd501483d0 0x7fcd501426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd501483d0 0x7fcd501426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47900/0 (socket says 172.21.15.144:47900) 2024-09-12T12:26:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4fe00640 1 -- 172.21.15.144:0/375197116 learned_addr learned my addr 172.21.15.144:0/375197116 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4f400640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd5006d700 0x7fcd50141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4ea00640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd50145cd0 0x7fcd5014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4fe00640 1 -- 172.21.15.144:0/375197116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd5006d700 msgr2=0x7fcd50141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4fe00640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd5006d700 0x7fcd50141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4fe00640 1 -- 172.21.15.144:0/375197116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd50145cd0 msgr2=0x7fcd5014b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4fe00640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd50145cd0 0x7fcd5014b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4fe00640 1 -- 172.21.15.144:0/375197116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd50164500 con 0x7fcd501483d0 2024-09-12T12:26:54.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd4fe00640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd501483d0 0x7fcd501426d0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fcd480af040 tx=0x7fcd500743a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd47400640 1 -- 172.21.15.144:0/375197116 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd480bc020 con 0x7fcd501483d0 2024-09-12T12:26:54.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd47400640 1 -- 172.21.15.144:0/375197116 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd480b8670 con 0x7fcd501483d0 2024-09-12T12:26:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd501647e0 con 0x7fcd501483d0 2024-09-12T12:26:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd47400640 1 -- 172.21.15.144:0/375197116 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd480b8a60 con 0x7fcd501483d0 2024-09-12T12:26:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.085+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5014b060 con 0x7fcd501483d0 2024-09-12T12:26:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd50073650 con 0x7fcd501483d0 2024-09-12T12:26:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd47400640 1 -- 172.21.15.144:0/375197116 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd480bf020 con 0x7fcd501483d0 2024-09-12T12:26:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd47400640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd300678c0 0x7fcd30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd47400640 1 -- 172.21.15.144:0/375197116 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fcd48121070 con 0x7fcd501483d0 2024-09-12T12:26:54.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd4f400640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd300678c0 0x7fcd30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd47400640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7fcd3006dd60 0x7fcd300701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd47400640 1 -- 172.21.15.144:0/375197116 --> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd480b6ea0 con 0x7fcd3006dd60 2024-09-12T12:26:54.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd47400640 1 -- 172.21.15.144:0/375197116 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7fcd48121420 con 0x7fcd501483d0 2024-09-12T12:26:54.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd4ea00640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7fcd3006dd60 0x7fcd300701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd4f400640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd300678c0 0x7fcd30069d80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcd5014c280 tx=0x7fcd40009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd4ea00640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7fcd3006dd60 0x7fcd300701a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.089+0000 7fcd47400640 1 -- 172.21.15.144:0/375197116 <== osd.0 v2:172.21.15.144:6808/1854211635 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd480b6ea0 con 0x7fcd3006dd60 2024-09-12T12:26:54.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 --> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcd5006dc60 con 0x7fcd3006dd60 2024-09-12T12:26:54.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd47400640 1 -- 172.21.15.144:0/375197116 <== osd.0 v2:172.21.15.144:6808/1854211635 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcd5006dc60 con 0x7fcd3006dd60 2024-09-12T12:26:54.104 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:54.104 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T12:26:54.104 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:54.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7fcd3006dd60 msgr2=0x7fcd300701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6808/1854211635,v1:172.21.15.144:6810/1854211635] conn(0x7fcd3006dd60 0x7fcd300701a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd300678c0 msgr2=0x7fcd30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcd300678c0 0x7fcd30069d80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcd5014c280 tx=0x7fcd40009190 comp rx=0 tx=0).stop 2024-09-12T12:26:54.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd501483d0 msgr2=0x7fcd501426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 --2- 172.21.15.144:0/375197116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd501483d0 0x7fcd501426d0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fcd480af040 tx=0x7fcd500743a0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd4fe00640 1 -- 172.21.15.144:0/375197116 reap_dead start 2024-09-12T12:26:54.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 shutdown_connections 2024-09-12T12:26:54.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 >> 172.21.15.144:0/375197116 conn(0x7fcd5006bc10 msgr2=0x7fcd500d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 shutdown_connections 2024-09-12T12:26:54.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.105+0000 7fcd56600640 1 -- 172.21.15.144:0/375197116 wait complete. 2024-09-12T12:26:54.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T12:26:54.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa21b200640 1 Processor -- start 2024-09-12T12:26:54.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa21b200640 1 -- start start 2024-09-12T12:26:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa21b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa21415c220 0x7fa2140d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa21b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140b4200 0x7fa2140b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa21b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa2140732c0 0x7fa214073710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa21b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa2140b4bb0 con 0x7fa21415c220 2024-09-12T12:26:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa21b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa2140d1580 con 0x7fa2140732c0 2024-09-12T12:26:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa21b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2140d1860 con 0x7fa2140b4200 2024-09-12T12:26:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa213e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa21415c220 0x7fa2140d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa213e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa21415c220 0x7fa2140d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47904/0 (socket says 172.21.15.144:47904) 2024-09-12T12:26:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa213e00640 1 -- 172.21.15.144:0/1350954937 learned_addr learned my addr 172.21.15.144:0/1350954937 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa213400640 1 --2- 172.21.15.144:0/1350954937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140b4200 0x7fa2140b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa219200640 1 --2- 172.21.15.144:0/1350954937 >> v2:172.21.15.165:3300/0 conn(0x7fa2140732c0 0x7fa214073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa213e00640 1 -- 172.21.15.144:0/1350954937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140b4200 msgr2=0x7fa2140b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa213e00640 1 --2- 172.21.15.144:0/1350954937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140b4200 0x7fa2140b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa213e00640 1 -- 172.21.15.144:0/1350954937 >> v2:172.21.15.165:3300/0 conn(0x7fa2140732c0 msgr2=0x7fa214073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa213e00640 1 --2- 172.21.15.144:0/1350954937 >> v2:172.21.15.165:3300/0 conn(0x7fa2140732c0 0x7fa214073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.261+0000 7fa213e00640 1 -- 172.21.15.144:0/1350954937 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2140d1b40 con 0x7fa21415c220 2024-09-12T12:26:54.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa213e00640 1 --2- 172.21.15.144:0/1350954937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 0x7fa2140d0c10 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fa2140b1680 tx=0x7fa20401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c95de6d542c543 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa212a00640 1 -- 172.21.15.144:0/1350954937 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2040aa610 con 0x7fa21415c220 2024-09-12T12:26:54.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa212a00640 1 -- 172.21.15.144:0/1350954937 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2040af070 con 0x7fa21415c220 2024-09-12T12:26:54.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa212a00640 1 -- 172.21.15.144:0/1350954937 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2040aa9d0 con 0x7fa21415c220 2024-09-12T12:26:54.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa21b200640 1 -- 172.21.15.144:0/1350954937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 msgr2=0x7fa2140d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa21b200640 1 --2- 172.21.15.144:0/1350954937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 0x7fa2140d0c10 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fa2140b1680 tx=0x7fa20401c4f0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa21b200640 1 -- 172.21.15.144:0/1350954937 shutdown_connections 2024-09-12T12:26:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa21b200640 1 --2- 172.21.15.144:0/1350954937 >> v2:172.21.15.165:3300/0 conn(0x7fa2140732c0 0x7fa214073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa21b200640 1 --2- 172.21.15.144:0/1350954937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140b4200 0x7fa2140b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa21b200640 1 --2- 172.21.15.144:0/1350954937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 0x7fa2140d0c10 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa21b200640 1 -- 172.21.15.144:0/1350954937 >> 172.21.15.144:0/1350954937 conn(0x7fa21406f400 msgr2=0x7fa21406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa21b200640 1 -- 172.21.15.144:0/1350954937 shutdown_connections 2024-09-12T12:26:54.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.265+0000 7fa21b200640 1 -- 172.21.15.144:0/1350954937 wait complete. 2024-09-12T12:26:54.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 Processor -- start 2024-09-12T12:26:54.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 -- start start 2024-09-12T12:26:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140732c0 0x7fa2140b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140b4200 0x7fa2141563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 0x7fa21414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa21415c780 con 0x7fa21415c220 2024-09-12T12:26:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa21415c600 con 0x7fa2140b4200 2024-09-12T12:26:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2140d1150 con 0x7fa2140732c0 2024-09-12T12:26:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa219200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 0x7fa21414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa219200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 0x7fa21414d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47910/0 (socket says 172.21.15.144:47910) 2024-09-12T12:26:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa219200640 1 -- 172.21.15.144:0/1952543429 learned_addr learned my addr 172.21.15.144:0/1952543429 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:54.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa213400640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140b4200 0x7fa2141563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa213e00640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140732c0 0x7fa2140b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa219200640 1 -- 172.21.15.144:0/1952543429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140732c0 msgr2=0x7fa2140b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa219200640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140732c0 0x7fa2140b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa219200640 1 -- 172.21.15.144:0/1952543429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140b4200 msgr2=0x7fa2141563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa219200640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140b4200 0x7fa2141563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa219200640 1 -- 172.21.15.144:0/1952543429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21406dd20 con 0x7fa21415c220 2024-09-12T12:26:54.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa219200640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 0x7fa21414d230 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fa20c007e90 tx=0x7fa20c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa20be00640 1 -- 172.21.15.144:0/1952543429 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c014420 con 0x7fa21415c220 2024-09-12T12:26:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa20be00640 1 -- 172.21.15.144:0/1952543429 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20c019070 con 0x7fa21415c220 2024-09-12T12:26:54.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa20be00640 1 -- 172.21.15.144:0/1952543429 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20c014800 con 0x7fa21415c220 2024-09-12T12:26:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa214157c30 con 0x7fa21415c220 2024-09-12T12:26:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2141581b0 con 0x7fa21415c220 2024-09-12T12:26:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.269+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa214070bf0 con 0x7fa21415c220 2024-09-12T12:26:54.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.273+0000 7fa20be00640 1 -- 172.21.15.144:0/1952543429 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa20c0149a0 con 0x7fa21415c220 2024-09-12T12:26:54.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.273+0000 7fa20be00640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1f40678c0 0x7fa1f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.273+0000 7fa20be00640 1 -- 172.21.15.144:0/1952543429 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fa20c086210 con 0x7fa21415c220 2024-09-12T12:26:54.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.273+0000 7fa213e00640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1f40678c0 0x7fa1f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.273+0000 7fa213e00640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1f40678c0 0x7fa1f4069d80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa2040ae000 tx=0x7fa2040a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.277+0000 7fa20be00640 1 -- 172.21.15.144:0/1952543429 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa20c056860 con 0x7fa21415c220 2024-09-12T12:26:54.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fa214069500 con 0x7fa1f40678c0 2024-09-12T12:26:54.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa20be00640 1 -- 172.21.15.144:0/1952543429 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa214069500 con 0x7fa1f40678c0 2024-09-12T12:26:54.436 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T12:26:54.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1f40678c0 msgr2=0x7fa1f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1f40678c0 0x7fa1f4069d80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa2040ae000 tx=0x7fa2040a7000 comp rx=0 tx=0).stop 2024-09-12T12:26:54.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 msgr2=0x7fa21414d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 0x7fa21414d230 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fa20c007e90 tx=0x7fa20c00e4b0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 shutdown_connections 2024-09-12T12:26:54.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa1f40678c0 0x7fa1f4069d80 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa21415c220 0x7fa21414d230 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2140b4200 0x7fa2141563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 --2- 172.21.15.144:0/1952543429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2140732c0 0x7fa2140b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 >> 172.21.15.144:0/1952543429 conn(0x7fa21406f400 msgr2=0x7fa2140d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 shutdown_connections 2024-09-12T12:26:54.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.437+0000 7fa21b200640 1 -- 172.21.15.144:0/1952543429 wait complete. 2024-09-12T12:26:54.458 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T12:26:54.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T12:26:54.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa86aa00640 1 Processor -- start 2024-09-12T12:26:54.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa86aa00640 1 -- start start 2024-09-12T12:26:54.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa86aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa864156c10 0x7fa864072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa86aa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa86406cd20 con 0x7fa86406cff0 2024-09-12T12:26:54.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa86aa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8640712b0 con 0x7fa864073a70 2024-09-12T12:26:54.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa86aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa864071be0 con 0x7fa864156c10 2024-09-12T12:26:54.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa863400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa86406cff0 0x7fa864073360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40920/0 (socket says 172.21.15.144:40920) 2024-09-12T12:26:54.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa863400640 1 -- 172.21.15.144:0/2088692608 learned_addr learned my addr 172.21.15.144:0/2088692608 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:54.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa863e00640 1 --2- 172.21.15.144:0/2088692608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa864156c10 0x7fa864072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa862a00640 1 -- 172.21.15.144:0/2088692608 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836704204 0 0) 0x7fa86406cd20 con 0x7fa86406cff0 2024-09-12T12:26:54.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa862a00640 1 -- 172.21.15.144:0/2088692608 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa848003530 con 0x7fa86406cff0 2024-09-12T12:26:54.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa862a00640 1 -- 172.21.15.144:0/2088692608 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 950540020 0 0) 0x7fa8640712b0 con 0x7fa864073a70 2024-09-12T12:26:54.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa862a00640 1 -- 172.21.15.144:0/2088692608 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa86406cd20 con 0x7fa864073a70 2024-09-12T12:26:54.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa862a00640 1 -- 172.21.15.144:0/2088692608 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4246661322 0 0) 0x7fa848003530 con 0x7fa86406cff0 2024-09-12T12:26:54.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa863e00640 1 -- 172.21.15.144:0/2088692608 >> v1:172.21.15.165:6789/0 conn(0x7fa864073a70 legacy=0x7fa86415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa863e00640 1 -- 172.21.15.144:0/2088692608 >> v1:172.21.15.144:6789/0 conn(0x7fa86406cff0 legacy=0x7fa864073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.601+0000 7fa863e00640 1 -- 172.21.15.144:0/2088692608 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa864071590 con 0x7fa864156c10 2024-09-12T12:26:54.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa863e00640 1 --2- 172.21.15.144:0/2088692608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa864156c10 0x7fa864072070 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa854009dc0 tx=0x7fa85401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18482efbf4e8e367 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa862a00640 1 -- 172.21.15.144:0/2088692608 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8540b2070 con 0x7fa864156c10 2024-09-12T12:26:54.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa862a00640 1 -- 172.21.15.144:0/2088692608 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8540a5710 con 0x7fa864156c10 2024-09-12T12:26:54.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa862a00640 1 -- 172.21.15.144:0/2088692608 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8500016a0 con 0x7fa864156c10 2024-09-12T12:26:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa86aa00640 1 -- 172.21.15.144:0/2088692608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa864156c10 msgr2=0x7fa864072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa86aa00640 1 --2- 172.21.15.144:0/2088692608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa864156c10 0x7fa864072070 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa854009dc0 tx=0x7fa85401c8b0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa86aa00640 1 -- 172.21.15.144:0/2088692608 shutdown_connections 2024-09-12T12:26:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa86aa00640 1 --2- 172.21.15.144:0/2088692608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa864156c10 0x7fa864072070 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa86aa00640 1 -- 172.21.15.144:0/2088692608 >> 172.21.15.144:0/2088692608 conn(0x7fa86406bc10 msgr2=0x7fa86406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa86aa00640 1 -- 172.21.15.144:0/2088692608 shutdown_connections 2024-09-12T12:26:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.605+0000 7fa86aa00640 1 -- 172.21.15.144:0/2088692608 wait complete. 2024-09-12T12:26:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 Processor -- start 2024-09-12T12:26:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 -- start start 2024-09-12T12:26:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa86406cff0 0x7fa864144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa864073a70 0x7fa8640b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa864156c10 0x7fa864154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa864157170 con 0x7fa864073a70 2024-09-12T12:26:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa864156ff0 con 0x7fa864156c10 2024-09-12T12:26:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa8640725b0 con 0x7fa86406cff0 2024-09-12T12:26:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa864073a70 0x7fa8640b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa864073a70 0x7fa8640b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47922/0 (socket says 172.21.15.144:47922) 2024-09-12T12:26:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863400640 1 -- 172.21.15.144:0/1075013785 learned_addr learned my addr 172.21.15.144:0/1075013785 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863e00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa86406cff0 0x7fa864144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863400640 1 -- 172.21.15.144:0/1075013785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa86406cff0 msgr2=0x7fa864144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863400640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa86406cff0 0x7fa864144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863400640 1 -- 172.21.15.144:0/1075013785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa864156c10 msgr2=0x7fa864154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa868a00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa864156c10 0x7fa864154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863400640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa864156c10 0x7fa864154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863400640 1 -- 172.21.15.144:0/1075013785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa864145620 con 0x7fa864073a70 2024-09-12T12:26:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863e00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa86406cff0 0x7fa864144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa868a00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa864156c10 0x7fa864154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa863400640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa864073a70 0x7fa8640b4de0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7fa85000c700 tx=0x7fa85000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa85be00640 1 -- 172.21.15.144:0/1075013785 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850017070 con 0x7fa864073a70 2024-09-12T12:26:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa85be00640 1 -- 172.21.15.144:0/1075013785 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa850005ae0 con 0x7fa864073a70 2024-09-12T12:26:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa85be00640 1 -- 172.21.15.144:0/1075013785 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850007070 con 0x7fa864073a70 2024-09-12T12:26:54.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa864145340 con 0x7fa864073a70 2024-09-12T12:26:54.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa864154250 con 0x7fa864073a70 2024-09-12T12:26:54.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.609+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa864144d90 con 0x7fa864073a70 2024-09-12T12:26:54.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa85be00640 1 -- 172.21.15.144:0/1075013785 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa85001a070 con 0x7fa864073a70 2024-09-12T12:26:54.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa85be00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8440678c0 0x7fa844069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa85be00640 1 -- 172.21.15.144:0/1075013785 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fa850085a10 con 0x7fa864073a70 2024-09-12T12:26:54.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa863e00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8440678c0 0x7fa844069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa85be00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fa84406dd60 0x7fa8440701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa85be00640 1 -- 172.21.15.144:0/1075013785 --> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa850005650 con 0x7fa84406dd60 2024-09-12T12:26:54.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa85be00640 1 -- 172.21.15.144:0/1075013785 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7fa850085ea0 con 0x7fa864073a70 2024-09-12T12:26:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa868a00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fa84406dd60 0x7fa8440701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa863e00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8440678c0 0x7fa844069d80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa8540af000 tx=0x7fa8540a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa868a00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fa84406dd60 0x7fa8440701a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.613+0000 7fa85be00640 1 -- 172.21.15.144:0/1075013785 <== osd.1 v2:172.21.15.144:6824/68043553 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa850005650 con 0x7fa84406dd60 2024-09-12T12:26:54.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 --> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa864072070 con 0x7fa84406dd60 2024-09-12T12:26:54.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa85be00640 1 -- 172.21.15.144:0/1075013785 <== osd.1 v2:172.21.15.144:6824/68043553 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa864072070 con 0x7fa84406dd60 2024-09-12T12:26:54.628 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:54.628 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T12:26:54.628 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:54.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fa84406dd60 msgr2=0x7fa8440701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6824/68043553,v1:172.21.15.144:6825/68043553] conn(0x7fa84406dd60 0x7fa8440701a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8440678c0 msgr2=0x7fa844069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa8440678c0 0x7fa844069d80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa8540af000 tx=0x7fa8540a7070 comp rx=0 tx=0).stop 2024-09-12T12:26:54.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa864073a70 msgr2=0x7fa8640b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 --2- 172.21.15.144:0/1075013785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa864073a70 0x7fa8640b4de0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7fa85000c700 tx=0x7fa85000cbc0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa868a00640 1 -- 172.21.15.144:0/1075013785 reap_dead start 2024-09-12T12:26:54.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 shutdown_connections 2024-09-12T12:26:54.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 >> 172.21.15.144:0/1075013785 conn(0x7fa86406bc10 msgr2=0x7fa86414bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 shutdown_connections 2024-09-12T12:26:54.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.629+0000 7fa86aa00640 1 -- 172.21.15.144:0/1075013785 wait complete. 2024-09-12T12:26:54.647 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T12:26:54.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47ce000640 1 Processor -- start 2024-09-12T12:26:54.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47ce000640 1 -- start start 2024-09-12T12:26:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47ce000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f47c8071420 0x7f47c8071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47ce000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f47c80ccf30 0x7f47c80cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47ce000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c80cd890 con 0x7f47c815b4e0 2024-09-12T12:26:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47ce000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f47c80b45a0 con 0x7f47c80ccf30 2024-09-12T12:26:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47ce000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f47c80b3fe0 con 0x7f47c8071420 2024-09-12T12:26:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47c7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f47c80ccf30 0x7f47c80cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47c7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f47c815b4e0 0x7f47c80b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40932/0 (socket says 172.21.15.144:40932) 2024-09-12T12:26:54.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47c7400640 1 -- 172.21.15.144:0/2228971610 learned_addr learned my addr 172.21.15.144:0/2228971610 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47c6a00640 1 --2- 172.21.15.144:0/2228971610 >> v2:172.21.15.165:3300/0 conn(0x7f47c8071420 0x7f47c8071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47c7e00640 1 -- 172.21.15.144:0/2228971610 >> v2:172.21.15.165:3300/0 conn(0x7f47c8071420 msgr2=0x7f47c8071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47c7e00640 1 --2- 172.21.15.144:0/2228971610 >> v2:172.21.15.165:3300/0 conn(0x7f47c8071420 0x7f47c8071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47c7e00640 1 -- 172.21.15.144:0/2228971610 >> v1:172.21.15.144:6789/0 conn(0x7f47c815b4e0 legacy=0x7f47c80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47c7e00640 1 -- 172.21.15.144:0/2228971610 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c80b42c0 con 0x7f47c80ccf30 2024-09-12T12:26:54.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.785+0000 7f47c6000640 1 -- 172.21.15.144:0/2228971610 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051569143 0 0) 0x7f47c80cd890 con 0x7f47c815b4e0 2024-09-12T12:26:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47c7e00640 1 --2- 172.21.15.144:0/2228971610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 0x7f47c80cd350 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f47c80b02b0 tx=0x7f47c001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bce85dfb86a498 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47c6000640 1 -- 172.21.15.144:0/2228971610 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c00b2070 con 0x7f47c80ccf30 2024-09-12T12:26:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47c6000640 1 -- 172.21.15.144:0/2228971610 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c00a59c0 con 0x7f47c80ccf30 2024-09-12T12:26:54.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47c6000640 1 -- 172.21.15.144:0/2228971610 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c00a5d90 con 0x7f47c80ccf30 2024-09-12T12:26:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47ce000640 1 -- 172.21.15.144:0/2228971610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 msgr2=0x7f47c80cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47ce000640 1 --2- 172.21.15.144:0/2228971610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 0x7f47c80cd350 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f47c80b02b0 tx=0x7f47c001c900 comp rx=0 tx=0).stop 2024-09-12T12:26:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47ce000640 1 -- 172.21.15.144:0/2228971610 shutdown_connections 2024-09-12T12:26:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47ce000640 1 --2- 172.21.15.144:0/2228971610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 0x7f47c80cd350 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47ce000640 1 --2- 172.21.15.144:0/2228971610 >> v2:172.21.15.165:3300/0 conn(0x7f47c8071420 0x7f47c8071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47ce000640 1 -- 172.21.15.144:0/2228971610 >> 172.21.15.144:0/2228971610 conn(0x7f47c806d0d0 msgr2=0x7f47c806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47ce000640 1 -- 172.21.15.144:0/2228971610 shutdown_connections 2024-09-12T12:26:54.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.789+0000 7f47ce000640 1 -- 172.21.15.144:0/2228971610 wait complete. 2024-09-12T12:26:54.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 Processor -- start 2024-09-12T12:26:54.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 -- start start 2024-09-12T12:26:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47c8071420 0x7f47c8162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 0x7f47c81564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47c815b4e0 0x7f47c8164b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f47c815b8c0 con 0x7f47c80ccf30 2024-09-12T12:26:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f47c80cdef0 con 0x7f47c8071420 2024-09-12T12:26:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47c81569f0 con 0x7f47c815b4e0 2024-09-12T12:26:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47c6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 0x7f47c81564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47c6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 0x7f47c81564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47938/0 (socket says 172.21.15.144:47938) 2024-09-12T12:26:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47c6a00640 1 -- 172.21.15.144:0/2204222975 learned_addr learned my addr 172.21.15.144:0/2204222975 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47c6a00640 1 -- 172.21.15.144:0/2204222975 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47c815b4e0 msgr2=0x7f47c8164b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47c6a00640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47c815b4e0 0x7f47c8164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47c6a00640 1 -- 172.21.15.144:0/2204222975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47c8071420 msgr2=0x7f47c8162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47c6a00640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47c8071420 0x7f47c8162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47c6a00640 1 -- 172.21.15.144:0/2204222975 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c8162cd0 con 0x7f47c80ccf30 2024-09-12T12:26:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47c6a00640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 0x7f47c81564b0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e930 tx=0x7f47b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47bf400640 1 -- 172.21.15.144:0/2204222975 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4017070 con 0x7f47c80ccf30 2024-09-12T12:26:54.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47bf400640 1 -- 172.21.15.144:0/2204222975 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b400c9a0 con 0x7f47c80ccf30 2024-09-12T12:26:54.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47bf400640 1 -- 172.21.15.144:0/2204222975 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b400cd50 con 0x7f47c80ccf30 2024-09-12T12:26:54.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c8162fb0 con 0x7f47c80ccf30 2024-09-12T12:26:54.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.793+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c8163570 con 0x7f47c80ccf30 2024-09-12T12:26:54.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.797+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c80b2cc0 con 0x7f47c80ccf30 2024-09-12T12:26:54.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.797+0000 7f47bf400640 1 -- 172.21.15.144:0/2204222975 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47b401a070 con 0x7f47c80ccf30 2024-09-12T12:26:54.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.797+0000 7f47bf400640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47a80678f0 0x7f47a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:54.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.797+0000 7f47bf400640 1 -- 172.21.15.144:0/2204222975 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f47b4085f40 con 0x7f47c80ccf30 2024-09-12T12:26:54.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.797+0000 7f47c7400640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47a80678f0 0x7f47a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:54.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.797+0000 7f47c7400640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47a80678f0 0x7f47a8069db0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f47b80015a0 tx=0x7f47b8007970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:54.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.801+0000 7f47bf400640 1 -- 172.21.15.144:0/2204222975 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f47b4056c10 con 0x7f47c80ccf30 2024-09-12T12:26:54.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f47c815f960 con 0x7f47a80678f0 2024-09-12T12:26:54.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47bf400640 1 -- 172.21.15.144:0/2204222975 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f47c815f960 con 0x7f47a80678f0 2024-09-12T12:26:54.960 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T12:26:54.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47a80678f0 msgr2=0x7f47a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47a80678f0 0x7f47a8069db0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f47b80015a0 tx=0x7f47b8007970 comp rx=0 tx=0).stop 2024-09-12T12:26:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 msgr2=0x7f47c81564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 0x7f47c81564b0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e930 tx=0x7f47b400edf0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 shutdown_connections 2024-09-12T12:26:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f47a80678f0 0x7f47a8069db0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47c815b4e0 0x7f47c8164b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47c80ccf30 0x7f47c81564b0 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 --2- 172.21.15.144:0/2204222975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f47c8071420 0x7f47c8162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:54.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 >> 172.21.15.144:0/2204222975 conn(0x7f47c806d0d0 msgr2=0x7f47c8071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:54.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 shutdown_connections 2024-09-12T12:26:54.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:54.961+0000 7f47ce000640 1 -- 172.21.15.144:0/2204222975 wait complete. 2024-09-12T12:26:54.980 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T12:26:54.980 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T12:26:55.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe95400640 1 Processor -- start 2024-09-12T12:26:55.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe95400640 1 -- start start 2024-09-12T12:26:55.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe95400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90073a70 0x7fbe9006d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe95400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9006cd20 con 0x7fbe90156c10 2024-09-12T12:26:55.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe95400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe90072780 con 0x7fbe9006cff0 2024-09-12T12:26:55.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe95400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9006d990 con 0x7fbe90073a70 2024-09-12T12:26:55.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbe90156c10 0x7fbe90072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40938/0 (socket says 172.21.15.144:40938) 2024-09-12T12:26:55.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8e800640 1 -- 172.21.15.144:0/2229312093 learned_addr learned my addr 172.21.15.144:0/2229312093 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:55.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8f200640 1 --2- 172.21.15.144:0/2229312093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90073a70 0x7fbe9006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8d400640 1 -- 172.21.15.144:0/2229312093 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956355925 0 0) 0x7fbe9006cd20 con 0x7fbe90156c10 2024-09-12T12:26:55.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8d400640 1 -- 172.21.15.144:0/2229312093 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe74003530 con 0x7fbe90156c10 2024-09-12T12:26:55.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8d400640 1 -- 172.21.15.144:0/2229312093 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395499268 0 0) 0x7fbe90072780 con 0x7fbe9006cff0 2024-09-12T12:26:55.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8d400640 1 -- 172.21.15.144:0/2229312093 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe9006cd20 con 0x7fbe9006cff0 2024-09-12T12:26:55.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8f200640 1 -- 172.21.15.144:0/2229312093 >> v1:172.21.15.165:6789/0 conn(0x7fbe9006cff0 legacy=0x7fbe90073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8f200640 1 -- 172.21.15.144:0/2229312093 >> v1:172.21.15.144:6789/0 conn(0x7fbe90156c10 legacy=0x7fbe90072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.121+0000 7fbe8f200640 1 -- 172.21.15.144:0/2229312093 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe900712b0 con 0x7fbe90073a70 2024-09-12T12:26:55.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe8f200640 1 --2- 172.21.15.144:0/2229312093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90073a70 0x7fbe9006d450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009dc0 tx=0x7fbe8801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9420c1db94e5a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe8d400640 1 -- 172.21.15.144:0/2229312093 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe880b2070 con 0x7fbe90073a70 2024-09-12T12:26:55.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe8d400640 1 -- 172.21.15.144:0/2229312093 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe880a5960 con 0x7fbe90073a70 2024-09-12T12:26:55.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe8d400640 1 -- 172.21.15.144:0/2229312093 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe880a5d10 con 0x7fbe90073a70 2024-09-12T12:26:55.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe95400640 1 -- 172.21.15.144:0/2229312093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90073a70 msgr2=0x7fbe9006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe95400640 1 --2- 172.21.15.144:0/2229312093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90073a70 0x7fbe9006d450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009dc0 tx=0x7fbe8801c990 comp rx=0 tx=0).stop 2024-09-12T12:26:55.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe95400640 1 -- 172.21.15.144:0/2229312093 shutdown_connections 2024-09-12T12:26:55.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe95400640 1 --2- 172.21.15.144:0/2229312093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90073a70 0x7fbe9006d450 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe95400640 1 -- 172.21.15.144:0/2229312093 >> 172.21.15.144:0/2229312093 conn(0x7fbe9006bc10 msgr2=0x7fbe9006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe95400640 1 -- 172.21.15.144:0/2229312093 shutdown_connections 2024-09-12T12:26:55.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.125+0000 7fbe95400640 1 -- 172.21.15.144:0/2229312093 wait complete. 2024-09-12T12:26:55.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 Processor -- start 2024-09-12T12:26:55.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 -- start start 2024-09-12T12:26:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe9006cff0 0x7fbe9014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe90073a70 0x7fbe900b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90156c10 0x7fbe90165eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe90157170 con 0x7fbe9006cff0 2024-09-12T12:26:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe90156ff0 con 0x7fbe90073a70 2024-09-12T12:26:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9016a670 con 0x7fbe90156c10 2024-09-12T12:26:55.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe9006cff0 0x7fbe9014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe9006cff0 0x7fbe9014d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47940/0 (socket says 172.21.15.144:47940) 2024-09-12T12:26:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8e800640 1 -- 172.21.15.144:0/3706716484 learned_addr learned my addr 172.21.15.144:0/3706716484 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8f200640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90156c10 0x7fbe90165eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8de00640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe90073a70 0x7fbe900b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8e800640 1 -- 172.21.15.144:0/3706716484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90156c10 msgr2=0x7fbe90165eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8e800640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe90156c10 0x7fbe90165eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8e800640 1 -- 172.21.15.144:0/3706716484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe90073a70 msgr2=0x7fbe900b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8e800640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe90073a70 0x7fbe900b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8e800640 1 -- 172.21.15.144:0/3706716484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe90151dd0 con 0x7fbe9006cff0 2024-09-12T12:26:55.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe8e800640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe9006cff0 0x7fbe9014d100 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c530 tx=0x7fbe8000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe86a00640 1 -- 172.21.15.144:0/3706716484 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80017070 con 0x7fbe9006cff0 2024-09-12T12:26:55.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe86a00640 1 -- 172.21.15.144:0/3706716484 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe80005cf0 con 0x7fbe9006cff0 2024-09-12T12:26:55.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe86a00640 1 -- 172.21.15.144:0/3706716484 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe80007290 con 0x7fbe9006cff0 2024-09-12T12:26:55.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe901597f0 con 0x7fbe9006cff0 2024-09-12T12:26:55.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe90159db0 con 0x7fbe9006cff0 2024-09-12T12:26:55.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.129+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe9014ead0 con 0x7fbe9006cff0 2024-09-12T12:26:55.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe86a00640 1 -- 172.21.15.144:0/3706716484 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbe8001a070 con 0x7fbe9006cff0 2024-09-12T12:26:55.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe86a00640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbe700678c0 0x7fbe70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe86a00640 1 -- 172.21.15.144:0/3706716484 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fbe80084e70 con 0x7fbe9006cff0 2024-09-12T12:26:55.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe8de00640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbe700678c0 0x7fbe70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe86a00640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7fbe7006dd60 0x7fbe700701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe86a00640 1 -- 172.21.15.144:0/3706716484 --> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe70070870 con 0x7fbe7006dd60 2024-09-12T12:26:55.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe86a00640 1 -- 172.21.15.144:0/3706716484 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7fbe80087570 con 0x7fbe9006cff0 2024-09-12T12:26:55.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe8f200640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7fbe7006dd60 0x7fbe700701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe8de00640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbe700678c0 0x7fbe70069d80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbe901564b0 tx=0x7fbe7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe8f200640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7fbe7006dd60 0x7fbe700701a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.133+0000 7fbe86a00640 1 -- 172.21.15.144:0/3706716484 <== osd.2 v2:172.21.15.144:6809/1322554046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe70070870 con 0x7fbe7006dd60 2024-09-12T12:26:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 --> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe9006d450 con 0x7fbe7006dd60 2024-09-12T12:26:55.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe86a00640 1 -- 172.21.15.144:0/3706716484 <== osd.2 v2:172.21.15.144:6809/1322554046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbe9006d450 con 0x7fbe7006dd60 2024-09-12T12:26:55.148 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T12:26:55.148 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:55.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7fbe7006dd60 msgr2=0x7fbe700701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6809/1322554046,v1:172.21.15.144:6811/1322554046] conn(0x7fbe7006dd60 0x7fbe700701a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbe700678c0 msgr2=0x7fbe70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fbe700678c0 0x7fbe70069d80 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbe901564b0 tx=0x7fbe7c009040 comp rx=0 tx=0).stop 2024-09-12T12:26:55.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe9006cff0 msgr2=0x7fbe9014d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 --2- 172.21.15.144:0/3706716484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe9006cff0 0x7fbe9014d100 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c530 tx=0x7fbe8000c9f0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe8f200640 1 -- 172.21.15.144:0/3706716484 reap_dead start 2024-09-12T12:26:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 shutdown_connections 2024-09-12T12:26:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 >> 172.21.15.144:0/3706716484 conn(0x7fbe9006bc10 msgr2=0x7fbe90151100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 shutdown_connections 2024-09-12T12:26:55.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.149+0000 7fbe95400640 1 -- 172.21.15.144:0/3706716484 wait complete. 2024-09-12T12:26:55.165 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T12:26:55.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.301+0000 7fdc5f800640 1 Processor -- start 2024-09-12T12:26:55.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.301+0000 7fdc5f800640 1 -- start start 2024-09-12T12:26:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5f800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdc5815b4e0 0x7fdc580b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5f800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdc580ccf30 0x7fdc580cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5f800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc580b45a0 con 0x7fdc580b3ad0 2024-09-12T12:26:55.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5f800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdc580cd8a0 con 0x7fdc5815b4e0 2024-09-12T12:26:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5f800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdc580b3fe0 con 0x7fdc580ccf30 2024-09-12T12:26:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdc5815b4e0 0x7fdc580b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc57e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdc580b3ad0 0x7fdc58071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40946/0 (socket says 172.21.15.144:40946) 2024-09-12T12:26:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc57e00640 1 -- 172.21.15.144:0/2320992185 learned_addr learned my addr 172.21.15.144:0/2320992185 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5d800640 1 --2- 172.21.15.144:0/2320992185 >> v2:172.21.15.165:3300/0 conn(0x7fdc580ccf30 0x7fdc580cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5ce00640 1 -- 172.21.15.144:0/2320992185 >> v2:172.21.15.165:3300/0 conn(0x7fdc580ccf30 msgr2=0x7fdc580cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5ce00640 1 --2- 172.21.15.144:0/2320992185 >> v2:172.21.15.165:3300/0 conn(0x7fdc580ccf30 0x7fdc580cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5ce00640 1 -- 172.21.15.144:0/2320992185 >> v1:172.21.15.144:6789/0 conn(0x7fdc580b3ad0 legacy=0x7fdc58071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5ce00640 1 -- 172.21.15.144:0/2320992185 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580b42c0 con 0x7fdc5815b4e0 2024-09-12T12:26:55.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc5d800640 1 --2- 172.21.15.144:0/2320992185 >> v2:172.21.15.165:3300/0 conn(0x7fdc580ccf30 0x7fdc580cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:55.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.305+0000 7fdc57400640 1 -- 172.21.15.144:0/2320992185 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640984455 0 0) 0x7fdc580b45a0 con 0x7fdc580b3ad0 2024-09-12T12:26:55.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5ce00640 1 --2- 172.21.15.144:0/2320992185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc5815b4e0 0x7fdc580b3590 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fdc580b3ef0 tx=0x7fdc4801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0cb1548e6ce3c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc57400640 1 -- 172.21.15.144:0/2320992185 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc480b2070 con 0x7fdc5815b4e0 2024-09-12T12:26:55.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc57400640 1 -- 172.21.15.144:0/2320992185 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc480a59c0 con 0x7fdc5815b4e0 2024-09-12T12:26:55.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc57400640 1 -- 172.21.15.144:0/2320992185 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc480a5d90 con 0x7fdc5815b4e0 2024-09-12T12:26:55.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 -- 172.21.15.144:0/2320992185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc5815b4e0 msgr2=0x7fdc580b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 --2- 172.21.15.144:0/2320992185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc5815b4e0 0x7fdc580b3590 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fdc580b3ef0 tx=0x7fdc4801c900 comp rx=0 tx=0).stop 2024-09-12T12:26:55.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 -- 172.21.15.144:0/2320992185 shutdown_connections 2024-09-12T12:26:55.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 --2- 172.21.15.144:0/2320992185 >> v2:172.21.15.165:3300/0 conn(0x7fdc580ccf30 0x7fdc580cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 --2- 172.21.15.144:0/2320992185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc5815b4e0 0x7fdc580b3590 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 -- 172.21.15.144:0/2320992185 >> 172.21.15.144:0/2320992185 conn(0x7fdc5806d0d0 msgr2=0x7fdc5806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 -- 172.21.15.144:0/2320992185 shutdown_connections 2024-09-12T12:26:55.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 -- 172.21.15.144:0/2320992185 wait complete. 2024-09-12T12:26:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 Processor -- start 2024-09-12T12:26:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.309+0000 7fdc5f800640 1 -- start start 2024-09-12T12:26:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5f800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc580b3ad0 0x7fdc581572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5f800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc580ccf30 0x7fdc580ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5f800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc5815b4e0 0x7fdc580ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5f800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5815b8c0 con 0x7fdc580ccf30 2024-09-12T12:26:55.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5f800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc580cdef0 con 0x7fdc580b3ad0 2024-09-12T12:26:55.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5f800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5815d4f0 con 0x7fdc5815b4e0 2024-09-12T12:26:55.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc57e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc580ccf30 0x7fdc580ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc57e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc580ccf30 0x7fdc580ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47956/0 (socket says 172.21.15.144:47956) 2024-09-12T12:26:55.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc57e00640 1 -- 172.21.15.144:0/2989619180 learned_addr learned my addr 172.21.15.144:0/2989619180 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:55.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5ce00640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc580b3ad0 0x7fdc581572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5d800640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc5815b4e0 0x7fdc580ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc57e00640 1 -- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc5815b4e0 msgr2=0x7fdc580ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc57e00640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc5815b4e0 0x7fdc580ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc57e00640 1 -- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc580b3ad0 msgr2=0x7fdc581572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc57e00640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc580b3ad0 0x7fdc581572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc57e00640 1 -- 172.21.15.144:0/2989619180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580ccb20 con 0x7fdc580ccf30 2024-09-12T12:26:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5ce00640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc580b3ad0 0x7fdc581572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5d800640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc5815b4e0 0x7fdc580ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc57e00640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc580ccf30 0x7fdc580ce470 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fdc440011f0 tx=0x7fdc4400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc54c00640 1 -- 172.21.15.144:0/2989619180 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44018070 con 0x7fdc580ccf30 2024-09-12T12:26:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc54c00640 1 -- 172.21.15.144:0/2989619180 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc440074e0 con 0x7fdc580ccf30 2024-09-12T12:26:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc54c00640 1 -- 172.21.15.144:0/2989619180 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44004a10 con 0x7fdc580ccf30 2024-09-12T12:26:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5815cd80 con 0x7fdc580ccf30 2024-09-12T12:26:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc580cc7b0 con 0x7fdc580ccf30 2024-09-12T12:26:55.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc580cd360 con 0x7fdc580ccf30 2024-09-12T12:26:55.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.313+0000 7fdc54c00640 1 -- 172.21.15.144:0/2989619180 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc4401b070 con 0x7fdc580ccf30 2024-09-12T12:26:55.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.317+0000 7fdc54c00640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc380678c0 0x7fdc38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.317+0000 7fdc54c00640 1 -- 172.21.15.144:0/2989619180 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fdc44084f50 con 0x7fdc580ccf30 2024-09-12T12:26:55.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.317+0000 7fdc5ce00640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc380678c0 0x7fdc38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.317+0000 7fdc5ce00640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc380678c0 0x7fdc38069d80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fdc480af000 tx=0x7fdc480a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.321+0000 7fdc54c00640 1 -- 172.21.15.144:0/2989619180 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdc44055b60 con 0x7fdc580ccf30 2024-09-12T12:26:55.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.477+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fdc580b2b60 con 0x7fdc380678c0 2024-09-12T12:26:55.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.477+0000 7fdc54c00640 1 -- 172.21.15.144:0/2989619180 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc580b2b60 con 0x7fdc380678c0 2024-09-12T12:26:55.478 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T12:26:55.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc380678c0 msgr2=0x7fdc38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc380678c0 0x7fdc38069d80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fdc480af000 tx=0x7fdc480a7070 comp rx=0 tx=0).stop 2024-09-12T12:26:55.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc580ccf30 msgr2=0x7fdc580ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc580ccf30 0x7fdc580ce470 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fdc440011f0 tx=0x7fdc4400c9b0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 shutdown_connections 2024-09-12T12:26:55.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fdc380678c0 0x7fdc38069d80 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc5815b4e0 0x7fdc580ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc580ccf30 0x7fdc580ce470 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 --2- 172.21.15.144:0/2989619180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc580b3ad0 0x7fdc581572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 >> 172.21.15.144:0/2989619180 conn(0x7fdc5806d0d0 msgr2=0x7fdc580cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 shutdown_connections 2024-09-12T12:26:55.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.481+0000 7fdc5f800640 1 -- 172.21.15.144:0/2989619180 wait complete. 2024-09-12T12:26:55.500 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T12:26:55.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T12:26:55.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.641+0000 7f679fe00640 1 Processor -- start 2024-09-12T12:26:55.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.641+0000 7f679fe00640 1 -- start start 2024-09-12T12:26:55.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f679fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f67a0145240 0x7f67a0160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f679fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f67a0145c90 0x7f67a006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f679fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a0160cc0 con 0x7f67a0145740 2024-09-12T12:26:55.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f679fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f67a01602f0 con 0x7f67a0145c90 2024-09-12T12:26:55.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f679fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f67a006ed90 con 0x7f67a0145240 2024-09-12T12:26:55.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f6797e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f67a0145c90 0x7f67a006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f679f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f67a0145740 0x7f67a00b4300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40948/0 (socket says 172.21.15.144:40948) 2024-09-12T12:26:55.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f679f400640 1 -- 172.21.15.144:0/2566958013 learned_addr learned my addr 172.21.15.144:0/2566958013 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:55.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f679ea00640 1 --2- 172.21.15.144:0/2566958013 >> v2:172.21.15.165:3300/0 conn(0x7f67a0145240 0x7f67a0160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f6797e00640 1 -- 172.21.15.144:0/2566958013 >> v2:172.21.15.165:3300/0 conn(0x7f67a0145240 msgr2=0x7f67a0160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:55.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f6797e00640 1 --2- 172.21.15.144:0/2566958013 >> v2:172.21.15.165:3300/0 conn(0x7f67a0145240 0x7f67a0160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f6797e00640 1 -- 172.21.15.144:0/2566958013 >> v1:172.21.15.144:6789/0 conn(0x7f67a0145740 legacy=0x7f67a00b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f6797e00640 1 -- 172.21.15.144:0/2566958013 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a006f070 con 0x7f67a0145c90 2024-09-12T12:26:55.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.645+0000 7f679e000640 1 -- 172.21.15.144:0/2566958013 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2315657418 0 0) 0x7f67a0160cc0 con 0x7f67a0145740 2024-09-12T12:26:55.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f6797e00640 1 --2- 172.21.15.144:0/2566958013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 0x7f67a006bc10 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f67a00b3ff0 tx=0x7f678801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62982d23df17e423 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679e000640 1 -- 172.21.15.144:0/2566958013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67880b0070 con 0x7f67a0145c90 2024-09-12T12:26:55.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679e000640 1 -- 172.21.15.144:0/2566958013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67880ab600 con 0x7f67a0145c90 2024-09-12T12:26:55.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679e000640 1 -- 172.21.15.144:0/2566958013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67880ab9d0 con 0x7f67a0145c90 2024-09-12T12:26:55.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 -- 172.21.15.144:0/2566958013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 msgr2=0x7f67a006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 --2- 172.21.15.144:0/2566958013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 0x7f67a006bc10 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f67a00b3ff0 tx=0x7f678801c480 comp rx=0 tx=0).stop 2024-09-12T12:26:55.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 -- 172.21.15.144:0/2566958013 shutdown_connections 2024-09-12T12:26:55.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 --2- 172.21.15.144:0/2566958013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 0x7f67a006bc10 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 --2- 172.21.15.144:0/2566958013 >> v2:172.21.15.165:3300/0 conn(0x7f67a0145240 0x7f67a0160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 -- 172.21.15.144:0/2566958013 >> 172.21.15.144:0/2566958013 conn(0x7f67a006e0f0 msgr2=0x7f67a006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 -- 172.21.15.144:0/2566958013 shutdown_connections 2024-09-12T12:26:55.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 -- 172.21.15.144:0/2566958013 wait complete. 2024-09-12T12:26:55.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 Processor -- start 2024-09-12T12:26:55.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.649+0000 7f679fe00640 1 -- start start 2024-09-12T12:26:55.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0145240 0x7f67a015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67a0145740 0x7f67a00ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 0x7f67a0143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0169aa0 con 0x7f67a0145c90 2024-09-12T12:26:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f67a0169920 con 0x7f67a0145240 2024-09-12T12:26:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f67a0169c20 con 0x7f67a0145740 2024-09-12T12:26:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 0x7f67a0143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 0x7f67a0143380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47974/0 (socket says 172.21.15.144:47974) 2024-09-12T12:26:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679f400640 1 -- 172.21.15.144:0/348598343 learned_addr learned my addr 172.21.15.144:0/348598343 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679ea00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0145240 0x7f67a015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f6797e00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67a0145740 0x7f67a00ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679f400640 1 -- 172.21.15.144:0/348598343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67a0145740 msgr2=0x7f67a00ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679f400640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67a0145740 0x7f67a00ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679f400640 1 -- 172.21.15.144:0/348598343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0145240 msgr2=0x7f67a015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679f400640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0145240 0x7f67a015b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679f400640 1 -- 172.21.15.144:0/348598343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a00b67f0 con 0x7f67a0145c90 2024-09-12T12:26:55.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679f400640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 0x7f67a0143380 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f679800c700 tx=0x7f679800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f6796a00640 1 -- 172.21.15.144:0/348598343 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6798018070 con 0x7f67a0145c90 2024-09-12T12:26:55.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f6796a00640 1 -- 172.21.15.144:0/348598343 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679800ce10 con 0x7f67a0145c90 2024-09-12T12:26:55.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f6796a00640 1 -- 172.21.15.144:0/348598343 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679800a860 con 0x7f67a0145c90 2024-09-12T12:26:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a0072030 con 0x7f67a0145c90 2024-09-12T12:26:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a00728d0 con 0x7f67a0145c90 2024-09-12T12:26:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67a006bc10 con 0x7f67a0145c90 2024-09-12T12:26:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.653+0000 7f6796a00640 1 -- 172.21.15.144:0/348598343 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f679800aa00 con 0x7f67a0145c90 2024-09-12T12:26:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f6796a00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f677c0678c0 0x7f677c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f6796a00640 1 -- 172.21.15.144:0/348598343 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f67980850e0 con 0x7f67a0145c90 2024-09-12T12:26:55.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f679ea00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f677c0678c0 0x7f677c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f6796a00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f677c06dd60 0x7f677c0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f6796a00640 1 -- 172.21.15.144:0/348598343 --> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f677c070870 con 0x7f677c06dd60 2024-09-12T12:26:55.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f6796a00640 1 -- 172.21.15.144:0/348598343 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7f679808c050 con 0x7f67a0145c90 2024-09-12T12:26:55.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f6797e00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f677c06dd60 0x7f677c0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f679ea00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f677c0678c0 0x7f677c069d80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f67a00b0d90 tx=0x7f6790009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f6797e00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f677c06dd60 0x7f677c0701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.657+0000 7f6796a00640 1 -- 172.21.15.144:0/348598343 <== osd.3 v2:172.21.15.144:6800/331901335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f677c070870 con 0x7f677c06dd60 2024-09-12T12:26:55.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.669+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 --> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f67a00cdac0 con 0x7f677c06dd60 2024-09-12T12:26:55.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.669+0000 7f6796a00640 1 -- 172.21.15.144:0/348598343 <== osd.3 v2:172.21.15.144:6800/331901335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f67a00cdac0 con 0x7f677c06dd60 2024-09-12T12:26:55.670 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:55.670 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T12:26:55.670 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:55.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.669+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f677c06dd60 msgr2=0x7f677c0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.669+0000 7f679fe00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6800/331901335,v1:172.21.15.144:6801/331901335] conn(0x7f677c06dd60 0x7f677c0701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.669+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f677c0678c0 msgr2=0x7f677c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.669+0000 7f679fe00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f677c0678c0 0x7f677c069d80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f67a00b0d90 tx=0x7f6790009190 comp rx=0 tx=0).stop 2024-09-12T12:26:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.669+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 msgr2=0x7f67a0143380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.669+0000 7f679fe00640 1 --2- 172.21.15.144:0/348598343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67a0145c90 0x7f67a0143380 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f679800c700 tx=0x7f679800cbc0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.669+0000 7f679f400640 1 -- 172.21.15.144:0/348598343 reap_dead start 2024-09-12T12:26:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.673+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 shutdown_connections 2024-09-12T12:26:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.673+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 >> 172.21.15.144:0/348598343 conn(0x7f67a006e0f0 msgr2=0x7f67a00b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.673+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 shutdown_connections 2024-09-12T12:26:55.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.673+0000 7f679fe00640 1 -- 172.21.15.144:0/348598343 wait complete. 2024-09-12T12:26:55.688 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T12:26:55.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f7200640 1 Processor -- start 2024-09-12T12:26:55.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f7200640 1 -- start start 2024-09-12T12:26:55.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57f015b160 0x7f57f0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f57f0073bd0 0x7f57f00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f00cd000 0x7f57f00cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f57f015b540 con 0x7f57f015b160 2024-09-12T12:26:55.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f57f00cd4a0 con 0x7f57f0073bd0 2024-09-12T12:26:55.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f57f00cd780 con 0x7f57f00cd000 2024-09-12T12:26:55.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57f015b160 0x7f57f0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57f015b160 0x7f57f0070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47984/0 (socket says 172.21.15.144:47984) 2024-09-12T12:26:55.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.825+0000 7f57f5e00640 1 -- 172.21.15.144:0/3648086757 learned_addr learned my addr 172.21.15.144:0/3648086757 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:55.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f6800640 1 --2- 172.21.15.144:0/3648086757 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f00cd000 0x7f57f00cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f5400640 1 --2- 172.21.15.144:0/3648086757 >> v2:172.21.15.165:3300/0 conn(0x7f57f0073bd0 0x7f57f00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f5e00640 1 -- 172.21.15.144:0/3648086757 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f00cd000 msgr2=0x7f57f00cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:55.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f5e00640 1 --2- 172.21.15.144:0/3648086757 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f00cd000 0x7f57f00cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f5e00640 1 -- 172.21.15.144:0/3648086757 >> v2:172.21.15.165:3300/0 conn(0x7f57f0073bd0 msgr2=0x7f57f00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:55.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f5e00640 1 --2- 172.21.15.144:0/3648086757 >> v2:172.21.15.165:3300/0 conn(0x7f57f0073bd0 0x7f57f00ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f5e00640 1 -- 172.21.15.144:0/3648086757 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f00b3180 con 0x7f57f015b160 2024-09-12T12:26:55.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f5400640 1 --2- 172.21.15.144:0/3648086757 >> v2:172.21.15.165:3300/0 conn(0x7f57f0073bd0 0x7f57f00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:55.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f5e00640 1 --2- 172.21.15.144:0/3648086757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f015b160 0x7f57f0070ee0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f57f00d10d0 tx=0x7f57e401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4dcccd544c1237 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f4a00640 1 -- 172.21.15.144:0/3648086757 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e40b0070 con 0x7f57f015b160 2024-09-12T12:26:55.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f4a00640 1 -- 172.21.15.144:0/3648086757 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e40ab600 con 0x7f57f015b160 2024-09-12T12:26:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f4a00640 1 -- 172.21.15.144:0/3648086757 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e40ab9d0 con 0x7f57f015b160 2024-09-12T12:26:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f7200640 1 -- 172.21.15.144:0/3648086757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f015b160 msgr2=0x7f57f0070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f7200640 1 --2- 172.21.15.144:0/3648086757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f015b160 0x7f57f0070ee0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f57f00d10d0 tx=0x7f57e401c490 comp rx=0 tx=0).stop 2024-09-12T12:26:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f7200640 1 -- 172.21.15.144:0/3648086757 shutdown_connections 2024-09-12T12:26:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f7200640 1 --2- 172.21.15.144:0/3648086757 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f00cd000 0x7f57f00cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f7200640 1 --2- 172.21.15.144:0/3648086757 >> v2:172.21.15.165:3300/0 conn(0x7f57f0073bd0 0x7f57f00ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f7200640 1 --2- 172.21.15.144:0/3648086757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f015b160 0x7f57f0070ee0 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.829+0000 7f57f7200640 1 -- 172.21.15.144:0/3648086757 >> 172.21.15.144:0/3648086757 conn(0x7f57f006bc10 msgr2=0x7f57f006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 -- 172.21.15.144:0/3648086757 shutdown_connections 2024-09-12T12:26:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 -- 172.21.15.144:0/3648086757 wait complete. 2024-09-12T12:26:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 Processor -- start 2024-09-12T12:26:55.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 -- start start 2024-09-12T12:26:55.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f0073bd0 0x7f57f00aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00cd000 0x7f57f01499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57f015b160 0x7f57f01641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f57f00b4520 con 0x7f57f00cd000 2024-09-12T12:26:55.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f57f00b43a0 con 0x7f57f015b160 2024-09-12T12:26:55.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f57f00b46a0 con 0x7f57f0073bd0 2024-09-12T12:26:55.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00cd000 0x7f57f01499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00cd000 0x7f57f01499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47994/0 (socket says 172.21.15.144:47994) 2024-09-12T12:26:55.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5400640 1 -- 172.21.15.144:0/850398377 learned_addr learned my addr 172.21.15.144:0/850398377 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5e00640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f0073bd0 0x7f57f00aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f6800640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57f015b160 0x7f57f01641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5400640 1 -- 172.21.15.144:0/850398377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f0073bd0 msgr2=0x7f57f00aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5400640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f0073bd0 0x7f57f00aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5400640 1 -- 172.21.15.144:0/850398377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57f015b160 msgr2=0x7f57f01641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5400640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57f015b160 0x7f57f01641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5400640 1 -- 172.21.15.144:0/850398377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f00738e0 con 0x7f57f00cd000 2024-09-12T12:26:55.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.833+0000 7f57f5400640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00cd000 0x7f57f01499d0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f57e000c7f0 tx=0x7f57e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57ea000640 1 -- 172.21.15.144:0/850398377 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0015070 con 0x7f57f00cd000 2024-09-12T12:26:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57ea000640 1 -- 172.21.15.144:0/850398377 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e0007820 con 0x7f57f00cd000 2024-09-12T12:26:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f0072b20 con 0x7f57f00cd000 2024-09-12T12:26:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57ea000640 1 -- 172.21.15.144:0/850398377 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0007c10 con 0x7f57f00cd000 2024-09-12T12:26:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f00730e0 con 0x7f57f00cd000 2024-09-12T12:26:55.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f00cff90 con 0x7f57f00cd000 2024-09-12T12:26:55.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57ea000640 1 -- 172.21.15.144:0/850398377 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57e0018070 con 0x7f57f00cd000 2024-09-12T12:26:55.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57ea000640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57d40678c0 0x7f57d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57ea000640 1 -- 172.21.15.144:0/850398377 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f57e0085c40 con 0x7f57f00cd000 2024-09-12T12:26:55.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57f5e00640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57d40678c0 0x7f57d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.837+0000 7f57f5e00640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57d40678c0 0x7f57d4069d80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f57e40ad000 tx=0x7f57e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:55.841+0000 7f57ea000640 1 -- 172.21.15.144:0/850398377 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f57e0056170 con 0x7f57f00cd000 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f57f00cec00 con 0x7f57d40678c0 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57ea000640 1 -- 172.21.15.144:0/850398377 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f57f00cec00 con 0x7f57d40678c0 2024-09-12T12:26:55.999 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57d40678c0 msgr2=0x7f57d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57d40678c0 0x7f57d4069d80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f57e40ad000 tx=0x7f57e4008040 comp rx=0 tx=0).stop 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00cd000 msgr2=0x7f57f01499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00cd000 0x7f57f01499d0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f57e000c7f0 tx=0x7f57e000ccb0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 shutdown_connections 2024-09-12T12:26:56.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f57d40678c0 0x7f57d4069d80 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57f015b160 0x7f57f01641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00cd000 0x7f57f01499d0 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 --2- 172.21.15.144:0/850398377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57f0073bd0 0x7f57f00aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 >> 172.21.15.144:0/850398377 conn(0x7f57f006bc10 msgr2=0x7f57f0070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 shutdown_connections 2024-09-12T12:26:56.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.001+0000 7f57f7200640 1 -- 172.21.15.144:0/850398377 wait complete. 2024-09-12T12:26:56.020 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T12:26:56.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T12:26:56.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.161+0000 7fa51fa00640 1 Processor -- start 2024-09-12T12:26:56.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.161+0000 7fa51fa00640 1 -- start start 2024-09-12T12:26:56.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51fa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa518156c10 0x7fa518072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51fa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa51806cff0 0x7fa51806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51fa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa518073360 0x7fa518073810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51fa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa518073d50 con 0x7fa518156c10 2024-09-12T12:26:56.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51fa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa51806d990 con 0x7fa518073360 2024-09-12T12:26:56.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51fa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa518071be0 con 0x7fa51806cff0 2024-09-12T12:26:56.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa518156c10 0x7fa518072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa518156c10 0x7fa518072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48010/0 (socket says 172.21.15.144:48010) 2024-09-12T12:26:56.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51d000640 1 -- 172.21.15.144:0/2172875547 learned_addr learned my addr 172.21.15.144:0/2172875547 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:56.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa517e00640 1 --2- 172.21.15.144:0/2172875547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa51806cff0 0x7fa51806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51da00640 1 --2- 172.21.15.144:0/2172875547 >> v2:172.21.15.165:3300/0 conn(0x7fa518073360 0x7fa518073810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51d000640 1 -- 172.21.15.144:0/2172875547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa51806cff0 msgr2=0x7fa51806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51d000640 1 --2- 172.21.15.144:0/2172875547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa51806cff0 0x7fa51806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51d000640 1 -- 172.21.15.144:0/2172875547 >> v2:172.21.15.165:3300/0 conn(0x7fa518073360 msgr2=0x7fa518073810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51d000640 1 --2- 172.21.15.144:0/2172875547 >> v2:172.21.15.165:3300/0 conn(0x7fa518073360 0x7fa518073810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51d000640 1 -- 172.21.15.144:0/2172875547 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51806cd20 con 0x7fa518156c10 2024-09-12T12:26:56.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51da00640 1 --2- 172.21.15.144:0/2172875547 >> v2:172.21.15.165:3300/0 conn(0x7fa518073360 0x7fa518073810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:56.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.165+0000 7fa51d000640 1 --2- 172.21.15.144:0/2172875547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518156c10 0x7fa518072070 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fa5181601f0 tx=0x7fa50801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3d4a1f9aa83b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa517400640 1 -- 172.21.15.144:0/2172875547 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5080a5870 con 0x7fa518156c10 2024-09-12T12:26:56.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa517400640 1 -- 172.21.15.144:0/2172875547 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5080a5a10 con 0x7fa518156c10 2024-09-12T12:26:56.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa517400640 1 -- 172.21.15.144:0/2172875547 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5080a5de0 con 0x7fa518156c10 2024-09-12T12:26:56.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 -- 172.21.15.144:0/2172875547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518156c10 msgr2=0x7fa518072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 --2- 172.21.15.144:0/2172875547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518156c10 0x7fa518072070 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fa5181601f0 tx=0x7fa50801c9f0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 -- 172.21.15.144:0/2172875547 shutdown_connections 2024-09-12T12:26:56.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 --2- 172.21.15.144:0/2172875547 >> v2:172.21.15.165:3300/0 conn(0x7fa518073360 0x7fa518073810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 --2- 172.21.15.144:0/2172875547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa51806cff0 0x7fa51806d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 --2- 172.21.15.144:0/2172875547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518156c10 0x7fa518072070 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 -- 172.21.15.144:0/2172875547 >> 172.21.15.144:0/2172875547 conn(0x7fa51806bc10 msgr2=0x7fa51806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 -- 172.21.15.144:0/2172875547 shutdown_connections 2024-09-12T12:26:56.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 -- 172.21.15.144:0/2172875547 wait complete. 2024-09-12T12:26:56.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 Processor -- start 2024-09-12T12:26:56.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 -- start start 2024-09-12T12:26:56.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa51806cff0 0x7fa51815b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518073360 0x7fa5181559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa518156c10 0x7fa51813aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa518156ff0 con 0x7fa518073360 2024-09-12T12:26:56.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa518073f70 con 0x7fa518156c10 2024-09-12T12:26:56.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51fa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa518157170 con 0x7fa51806cff0 2024-09-12T12:26:56.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa517e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518073360 0x7fa5181559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa517e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518073360 0x7fa5181559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48022/0 (socket says 172.21.15.144:48022) 2024-09-12T12:26:56.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa517e00640 1 -- 172.21.15.144:0/3154622384 learned_addr learned my addr 172.21.15.144:0/3154622384 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:56.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.169+0000 7fa51d000640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa51806cff0 0x7fa51815b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa51da00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa518156c10 0x7fa51813aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa517e00640 1 -- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa51806cff0 msgr2=0x7fa51815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa517e00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa51806cff0 0x7fa51815b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa517e00640 1 -- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa518156c10 msgr2=0x7fa51813aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa517e00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa518156c10 0x7fa51813aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa517e00640 1 -- 172.21.15.144:0/3154622384 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51815a6f0 con 0x7fa518073360 2024-09-12T12:26:56.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa517e00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518073360 0x7fa5181559c0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d7d0 tx=0x7fa50400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa514c00640 1 -- 172.21.15.144:0/3154622384 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504004030 con 0x7fa518073360 2024-09-12T12:26:56.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa514c00640 1 -- 172.21.15.144:0/3154622384 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5040041d0 con 0x7fa518073360 2024-09-12T12:26:56.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51815a9d0 con 0x7fa518073360 2024-09-12T12:26:56.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa514c00640 1 -- 172.21.15.144:0/3154622384 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5040096a0 con 0x7fa518073360 2024-09-12T12:26:56.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51815af90 con 0x7fa518073360 2024-09-12T12:26:56.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa51813a800 con 0x7fa518073360 2024-09-12T12:26:56.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa514c00640 1 -- 172.21.15.144:0/3154622384 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa504009840 con 0x7fa518073360 2024-09-12T12:26:56.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.173+0000 7fa514c00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4f80678c0 0x7fa4f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.177+0000 7fa514c00640 1 -- 172.21.15.144:0/3154622384 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fa504086800 con 0x7fa518073360 2024-09-12T12:26:56.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.177+0000 7fa51d000640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4f80678c0 0x7fa4f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.177+0000 7fa514c00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7fa4f806dd60 0x7fa4f80701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.177+0000 7fa514c00640 1 -- 172.21.15.144:0/3154622384 --> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa50401ee50 con 0x7fa4f806dd60 2024-09-12T12:26:56.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.177+0000 7fa514c00640 1 -- 172.21.15.144:0/3154622384 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7fa504086bb0 con 0x7fa518073360 2024-09-12T12:26:56.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.177+0000 7fa51da00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7fa4f806dd60 0x7fa4f80701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.177+0000 7fa51d000640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4f80678c0 0x7fa4f8069d80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa5080ae000 tx=0x7fa5080a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.177+0000 7fa51da00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7fa4f806dd60 0x7fa4f80701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.177+0000 7fa514c00640 1 -- 172.21.15.144:0/3154622384 <== osd.4 v2:172.21.15.165:6824/2062585005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa50401ee50 con 0x7fa4f806dd60 2024-09-12T12:26:56.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.189+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 --> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa51806d450 con 0x7fa4f806dd60 2024-09-12T12:26:56.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa514c00640 1 -- 172.21.15.144:0/3154622384 <== osd.4 v2:172.21.15.165:6824/2062585005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa51806d450 con 0x7fa4f806dd60 2024-09-12T12:26:56.191 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:56.191 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T12:26:56.191 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7fa4f806dd60 msgr2=0x7fa4f80701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.165:6824/2062585005,v1:172.21.15.165:6825/2062585005] conn(0x7fa4f806dd60 0x7fa4f80701a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4f80678c0 msgr2=0x7fa4f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4f80678c0 0x7fa4f8069d80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa5080ae000 tx=0x7fa5080a7070 comp rx=0 tx=0).stop 2024-09-12T12:26:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518073360 msgr2=0x7fa5181559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 --2- 172.21.15.144:0/3154622384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa518073360 0x7fa5181559c0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d7d0 tx=0x7fa50400dc90 comp rx=0 tx=0).stop 2024-09-12T12:26:56.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51da00640 1 -- 172.21.15.144:0/3154622384 reap_dead start 2024-09-12T12:26:56.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 shutdown_connections 2024-09-12T12:26:56.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 >> 172.21.15.144:0/3154622384 conn(0x7fa51806bc10 msgr2=0x7fa518160250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 shutdown_connections 2024-09-12T12:26:56.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.193+0000 7fa51fa00640 1 -- 172.21.15.144:0/3154622384 wait complete. 2024-09-12T12:26:56.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T12:26:56.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed9ba00640 1 Processor -- start 2024-09-12T12:26:56.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed9ba00640 1 -- start start 2024-09-12T12:26:56.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed9ba00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fed940b54e0 0x7fed9406d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed9ba00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed940b3d30 con 0x7fed940b3750 2024-09-12T12:26:56.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed9ba00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed940b4010 con 0x7fed9415e4f0 2024-09-12T12:26:56.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed9ba00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fed940b4940 con 0x7fed940b54e0 2024-09-12T12:26:56.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fed940b3750 0x7fed940b4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40958/0 (socket says 172.21.15.144:40958) 2024-09-12T12:26:56.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93e00640 1 -- 172.21.15.144:0/897646996 learned_addr learned my addr 172.21.15.144:0/897646996 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:56.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed99a00640 1 --2- 172.21.15.144:0/897646996 >> v2:172.21.15.165:3300/0 conn(0x7fed940b54e0 0x7fed9406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101347786 0 0) 0x7fed940b3d30 con 0x7fed940b3750 2024-09-12T12:26:56.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed7c003530 con 0x7fed940b3750 2024-09-12T12:26:56.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 925201013 0 0) 0x7fed940b4010 con 0x7fed9415e4f0 2024-09-12T12:26:56.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed940b3d30 con 0x7fed9415e4f0 2024-09-12T12:26:56.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 529778774 0 0) 0x7fed7c003530 con 0x7fed940b3750 2024-09-12T12:26:56.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 >> v2:172.21.15.165:3300/0 conn(0x7fed940b54e0 msgr2=0x7fed9406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 --2- 172.21.15.144:0/897646996 >> v2:172.21.15.165:3300/0 conn(0x7fed940b54e0 0x7fed9406d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 >> v1:172.21.15.165:6789/0 conn(0x7fed9415e4f0 legacy=0x7fed940aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed940b42f0 con 0x7fed940b3750 2024-09-12T12:26:56.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fed80001800 con 0x7fed940b3750 2024-09-12T12:26:56.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 >> v1:172.21.15.144:6789/0 conn(0x7fed940b3750 legacy=0x7fed940b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed7c003b50 0x7fed7c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed7c004810 0x7fed7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7c0051d0 0x7fed7c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fed940b4940 con 0x7fed7c0051d0 2024-09-12T12:26:56.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c00c050 con 0x7fed7c004810 2024-09-12T12:26:56.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c00c250 con 0x7fed7c003b50 2024-09-12T12:26:56.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed99a00640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7c0051d0 0x7fed7c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed99000640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed7c003b50 0x7fed7c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.349+0000 7fed93e00640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed7c004810 0x7fed7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed99a00640 1 -- 172.21.15.144:0/897646996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed7c003b50 msgr2=0x7fed7c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed99a00640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed7c003b50 0x7fed7c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed99a00640 1 -- 172.21.15.144:0/897646996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed7c004810 msgr2=0x7fed7c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed99a00640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed7c004810 0x7fed7c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed99a00640 1 -- 172.21.15.144:0/897646996 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c003530 con 0x7fed7c0051d0 2024-09-12T12:26:56.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed99a00640 1 -- 172.21.15.144:0/897646996 reap_dead start 2024-09-12T12:26:56.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed99a00640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7c0051d0 0x7fed7c00b9d0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009f90 tx=0x7fed8c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381516c300dde1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c009c10 con 0x7fed7c0051d0 2024-09-12T12:26:56.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8c0a5c90 con 0x7fed7c0051d0 2024-09-12T12:26:56.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed93400640 1 -- 172.21.15.144:0/897646996 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c003be0 con 0x7fed7c0051d0 2024-09-12T12:26:56.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed9ba00640 1 -- 172.21.15.144:0/897646996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7c0051d0 msgr2=0x7fed7c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed9ba00640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7c0051d0 0x7fed7c00b9d0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009f90 tx=0x7fed8c01cc80 comp rx=0 tx=0).stop 2024-09-12T12:26:56.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed9ba00640 1 -- 172.21.15.144:0/897646996 shutdown_connections 2024-09-12T12:26:56.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed9ba00640 1 --2- 172.21.15.144:0/897646996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed7c0051d0 0x7fed7c00b9d0 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed9ba00640 1 -- 172.21.15.144:0/897646996 >> 172.21.15.144:0/897646996 conn(0x7fed940b2450 msgr2=0x7fed940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed9ba00640 1 -- 172.21.15.144:0/897646996 shutdown_connections 2024-09-12T12:26:56.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.353+0000 7fed9ba00640 1 -- 172.21.15.144:0/897646996 wait complete. 2024-09-12T12:26:56.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 Processor -- start 2024-09-12T12:26:56.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 -- start start 2024-09-12T12:26:56.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed7c0051d0 0x7fed94152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed941610f0 0x7fed94161570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed9415ea50 0x7fed9415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fed9415e8d0 con 0x7fed9415ea50 2024-09-12T12:26:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed940b3bb0 con 0x7fed7c0051d0 2024-09-12T12:26:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed940b4dd0 con 0x7fed941610f0 2024-09-12T12:26:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed9415ea50 0x7fed9415ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed9415ea50 0x7fed9415ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48038/0 (socket says 172.21.15.144:48038) 2024-09-12T12:26:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99a00640 1 -- 172.21.15.144:0/3880748879 learned_addr learned my addr 172.21.15.144:0/3880748879 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:56.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed93e00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed941610f0 0x7fed94161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99000640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed7c0051d0 0x7fed94152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99a00640 1 -- 172.21.15.144:0/3880748879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed941610f0 msgr2=0x7fed94161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99a00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed941610f0 0x7fed94161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99a00640 1 -- 172.21.15.144:0/3880748879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed7c0051d0 msgr2=0x7fed94152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99a00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed7c0051d0 0x7fed94152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99a00640 1 -- 172.21.15.144:0/3880748879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9415f630 con 0x7fed9415ea50 2024-09-12T12:26:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed99a00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed9415ea50 0x7fed9415ef00 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7fed8c01d520 tx=0x7fed8c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed90c00640 1 -- 172.21.15.144:0/3880748879 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c009c10 con 0x7fed9415ea50 2024-09-12T12:26:56.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed90c00640 1 -- 172.21.15.144:0/3880748879 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8c0a6e50 con 0x7fed9415ea50 2024-09-12T12:26:56.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9415f910 con 0x7fed9415ea50 2024-09-12T12:26:56.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed90c00640 1 -- 172.21.15.144:0/3880748879 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c004230 con 0x7fed9415ea50 2024-09-12T12:26:56.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.357+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9415fed0 con 0x7fed9415ea50 2024-09-12T12:26:56.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.361+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed940b5160 con 0x7fed9415ea50 2024-09-12T12:26:56.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.361+0000 7fed90c00640 1 -- 172.21.15.144:0/3880748879 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed8c0c0020 con 0x7fed9415ea50 2024-09-12T12:26:56.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.361+0000 7fed90c00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed740678f0 0x7fed74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.361+0000 7fed90c00640 1 -- 172.21.15.144:0/3880748879 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fed8c1205a0 con 0x7fed9415ea50 2024-09-12T12:26:56.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.361+0000 7fed99000640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed740678f0 0x7fed74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.361+0000 7fed99000640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed740678f0 0x7fed74069db0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fed88007fd0 tx=0x7fed88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.365+0000 7fed90c00640 1 -- 172.21.15.144:0/3880748879 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed8c0c7020 con 0x7fed9415ea50 2024-09-12T12:26:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.525+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fed94072250 con 0x7fed740678f0 2024-09-12T12:26:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.525+0000 7fed90c00640 1 -- 172.21.15.144:0/3880748879 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fed94072250 con 0x7fed740678f0 2024-09-12T12:26:56.526 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T12:26:56.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed740678f0 msgr2=0x7fed74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed740678f0 0x7fed74069db0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fed88007fd0 tx=0x7fed88009040 comp rx=0 tx=0).stop 2024-09-12T12:26:56.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed9415ea50 msgr2=0x7fed9415ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed9415ea50 0x7fed9415ef00 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7fed8c01d520 tx=0x7fed8c009750 comp rx=0 tx=0).stop 2024-09-12T12:26:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 shutdown_connections 2024-09-12T12:26:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fed740678f0 0x7fed74069db0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed9415ea50 0x7fed9415ef00 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed941610f0 0x7fed94161570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 --2- 172.21.15.144:0/3880748879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed7c0051d0 0x7fed94152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 >> 172.21.15.144:0/3880748879 conn(0x7fed940b2450 msgr2=0x7fed940713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 shutdown_connections 2024-09-12T12:26:56.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.529+0000 7fed9ba00640 1 -- 172.21.15.144:0/3880748879 wait complete. 2024-09-12T12:26:56.548 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T12:26:56.548 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T12:26:56.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.689+0000 7ff7d1c00640 1 Processor -- start 2024-09-12T12:26:56.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.689+0000 7ff7d1c00640 1 -- start start 2024-09-12T12:26:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.689+0000 7ff7d1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7cc06d250 0x7ff7cc15c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.689+0000 7ff7d1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7cc0b3490 0x7ff7cc0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.689+0000 7ff7d1c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc06cd20 con 0x7ff7cc06d630 2024-09-12T12:26:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.689+0000 7ff7d1c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff7cc072620 con 0x7ff7cc0b3490 2024-09-12T12:26:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.689+0000 7ff7d1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7cc15cc80 con 0x7ff7cc06d250 2024-09-12T12:26:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7c3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7cc0b3490 0x7ff7cc0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7c3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7cc0b3490 0x7ff7cc0b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48046/0 (socket says 172.21.15.144:48046) 2024-09-12T12:26:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7c3e00640 1 -- 172.21.15.144:0/734735279 learned_addr learned my addr 172.21.15.144:0/734735279 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7caa00640 1 --2- 172.21.15.144:0/734735279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7cc06d250 0x7ff7cc15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7c3e00640 1 -- 172.21.15.144:0/734735279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7cc06d250 msgr2=0x7ff7cc15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7c3e00640 1 --2- 172.21.15.144:0/734735279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7cc06d250 0x7ff7cc15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7c3e00640 1 -- 172.21.15.144:0/734735279 >> v1:172.21.15.165:6789/0 conn(0x7ff7cc06d630 legacy=0x7ff7cc155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7c3e00640 1 -- 172.21.15.144:0/734735279 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc0b4f30 con 0x7ff7cc0b3490 2024-09-12T12:26:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7c3e00640 1 --2- 172.21.15.144:0/734735279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 0x7ff7cc0b49f0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40098a0 tx=0x7ff7b401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d690a8708c05ae99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7ca000640 1 -- 172.21.15.144:0/734735279 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40aa670 con 0x7ff7cc0b3490 2024-09-12T12:26:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7ca000640 1 -- 172.21.15.144:0/734735279 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b40af070 con 0x7ff7cc0b3490 2024-09-12T12:26:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.693+0000 7ff7ca000640 1 -- 172.21.15.144:0/734735279 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40aaa30 con 0x7ff7cc0b3490 2024-09-12T12:26:56.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 -- 172.21.15.144:0/734735279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 msgr2=0x7ff7cc0b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 --2- 172.21.15.144:0/734735279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 0x7ff7cc0b49f0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40098a0 tx=0x7ff7b401c510 comp rx=0 tx=0).stop 2024-09-12T12:26:56.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 -- 172.21.15.144:0/734735279 shutdown_connections 2024-09-12T12:26:56.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 --2- 172.21.15.144:0/734735279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 0x7ff7cc0b49f0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 --2- 172.21.15.144:0/734735279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7cc06d250 0x7ff7cc15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 -- 172.21.15.144:0/734735279 >> 172.21.15.144:0/734735279 conn(0x7ff7cc06bc10 msgr2=0x7ff7cc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 -- 172.21.15.144:0/734735279 shutdown_connections 2024-09-12T12:26:56.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 -- 172.21.15.144:0/734735279 wait complete. 2024-09-12T12:26:56.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 Processor -- start 2024-09-12T12:26:56.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 -- start start 2024-09-12T12:26:56.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7cc06d250 0x7ff7cc1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7cc06d630 0x7ff7cc145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 0x7ff7cc0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc0b44d0 con 0x7ff7cc0b3490 2024-09-12T12:26:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc0b41f0 con 0x7ff7cc06d630 2024-09-12T12:26:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7d1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7cc15d690 con 0x7ff7cc06d250 2024-09-12T12:26:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 0x7ff7cc0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 0x7ff7cc0d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48056/0 (socket says 172.21.15.144:48056) 2024-09-12T12:26:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7cb400640 1 -- 172.21.15.144:0/3566539578 learned_addr learned my addr 172.21.15.144:0/3566539578 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:56.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7caa00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7cc06d250 0x7ff7cc1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7c3e00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7cc06d630 0x7ff7cc145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7cb400640 1 -- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7cc06d250 msgr2=0x7ff7cc1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7cb400640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7cc06d250 0x7ff7cc1589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7cb400640 1 -- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7cc06d630 msgr2=0x7ff7cc145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7cb400640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7cc06d630 0x7ff7cc145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.697+0000 7ff7cb400640 1 -- 172.21.15.144:0/3566539578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc158ee0 con 0x7ff7cc0b3490 2024-09-12T12:26:56.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7cb400640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 0x7ff7cc0d03c0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400c770 tx=0x7ff7c400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c2a00640 1 -- 172.21.15.144:0/3566539578 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4003b80 con 0x7ff7cc0b3490 2024-09-12T12:26:56.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c2a00640 1 -- 172.21.15.144:0/3566539578 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c4003d20 con 0x7ff7cc0b3490 2024-09-12T12:26:56.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c2a00640 1 -- 172.21.15.144:0/3566539578 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400aa90 con 0x7ff7cc0b3490 2024-09-12T12:26:56.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7cc156340 con 0x7ff7cc0b3490 2024-09-12T12:26:56.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7cc156900 con 0x7ff7cc0b3490 2024-09-12T12:26:56.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7cc15c740 con 0x7ff7cc0b3490 2024-09-12T12:26:56.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c2a00640 1 -- 172.21.15.144:0/3566539578 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7c400ac30 con 0x7ff7cc0b3490 2024-09-12T12:26:56.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c2a00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7a80678c0 0x7ff7a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c2a00640 1 -- 172.21.15.144:0/3566539578 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7ff7c4086440 con 0x7ff7cc0b3490 2024-09-12T12:26:56.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7caa00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7a80678c0 0x7ff7a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c2a00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7ff7a806dd60 0x7ff7a80701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c2a00640 1 -- 172.21.15.144:0/3566539578 --> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7a8070870 con 0x7ff7a806dd60 2024-09-12T12:26:56.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c2a00640 1 -- 172.21.15.144:0/3566539578 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7ff7c40868d0 con 0x7ff7cc0b3490 2024-09-12T12:26:56.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.701+0000 7ff7c3e00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7ff7a806dd60 0x7ff7a80701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.705+0000 7ff7caa00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7a80678c0 0x7ff7a8069d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009af0 tx=0x7ff7bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.705+0000 7ff7c3e00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7ff7a806dd60 0x7ff7a80701a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.705+0000 7ff7c2a00640 1 -- 172.21.15.144:0/3566539578 <== osd.5 v2:172.21.15.165:6800/2887749117 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7a8070870 con 0x7ff7a806dd60 2024-09-12T12:26:56.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 --> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff7cc0b48f0 con 0x7ff7a806dd60 2024-09-12T12:26:56.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7c2a00640 1 -- 172.21.15.144:0/3566539578 <== osd.5 v2:172.21.15.165:6800/2887749117 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff7cc0b48f0 con 0x7ff7a806dd60 2024-09-12T12:26:56.717 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:56.718 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T12:26:56.718 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:56.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7ff7a806dd60 msgr2=0x7ff7a80701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.165:6800/2887749117,v1:172.21.15.165:6802/2887749117] conn(0x7ff7a806dd60 0x7ff7a80701a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7a80678c0 msgr2=0x7ff7a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7ff7a80678c0 0x7ff7a8069d80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009af0 tx=0x7ff7bc008040 comp rx=0 tx=0).stop 2024-09-12T12:26:56.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 msgr2=0x7ff7cc0d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 --2- 172.21.15.144:0/3566539578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7cc0b3490 0x7ff7cc0d03c0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400c770 tx=0x7ff7c400cc30 comp rx=0 tx=0).stop 2024-09-12T12:26:56.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7cb400640 1 -- 172.21.15.144:0/3566539578 reap_dead start 2024-09-12T12:26:56.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 shutdown_connections 2024-09-12T12:26:56.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 >> 172.21.15.144:0/3566539578 conn(0x7ff7cc06bc10 msgr2=0x7ff7cc0cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 shutdown_connections 2024-09-12T12:26:56.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.717+0000 7ff7d1c00640 1 -- 172.21.15.144:0/3566539578 wait complete. 2024-09-12T12:26:56.736 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T12:26:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.873+0000 7fe3d7000640 1 Processor -- start 2024-09-12T12:26:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.873+0000 7fe3d7000640 1 -- start start 2024-09-12T12:26:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.873+0000 7fe3d7000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe3d0071420 0x7fe3d0071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.873+0000 7fe3d7000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d00b45a0 con 0x7fe3d015b4e0 2024-09-12T12:26:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.873+0000 7fe3d7000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d00b3fe0 con 0x7fe3d00ccf30 2024-09-12T12:26:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.873+0000 7fe3d7000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d00b42c0 con 0x7fe3d0071420 2024-09-12T12:26:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.873+0000 7fe3cfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe3d015b4e0 0x7fe3d00b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40966/0 (socket says 172.21.15.144:40966) 2024-09-12T12:26:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.873+0000 7fe3cfe00640 1 -- 172.21.15.144:0/1945001069 learned_addr learned my addr 172.21.15.144:0/1945001069 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.873+0000 7fe3cf400640 1 --2- 172.21.15.144:0/1945001069 >> v2:172.21.15.144:3300/0 conn(0x7fe3d0071420 0x7fe3d0071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3cf400640 1 -- 172.21.15.144:0/1945001069 >> v1:172.21.15.165:6789/0 conn(0x7fe3d00ccf30 legacy=0x7fe3d00cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3cf400640 1 -- 172.21.15.144:0/1945001069 >> v1:172.21.15.144:6789/0 conn(0x7fe3d015b4e0 legacy=0x7fe3d00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3cf400640 1 -- 172.21.15.144:0/1945001069 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d00b1490 con 0x7fe3d0071420 2024-09-12T12:26:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3cf400640 1 --2- 172.21.15.144:0/1945001069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 0x7fe3d0071840 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0097c0 tx=0x7fe3bc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fbc059943388342 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3cea00640 1 -- 172.21.15.144:0/1945001069 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0b1070 con 0x7fe3d0071420 2024-09-12T12:26:56.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3cea00640 1 -- 172.21.15.144:0/1945001069 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0ac620 con 0x7fe3d0071420 2024-09-12T12:26:56.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3cea00640 1 -- 172.21.15.144:0/1945001069 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0ac9f0 con 0x7fe3d0071420 2024-09-12T12:26:56.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3d7000640 1 -- 172.21.15.144:0/1945001069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 msgr2=0x7fe3d0071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3d7000640 1 --2- 172.21.15.144:0/1945001069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 0x7fe3d0071840 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0097c0 tx=0x7fe3bc01c430 comp rx=0 tx=0).stop 2024-09-12T12:26:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3d7000640 1 -- 172.21.15.144:0/1945001069 shutdown_connections 2024-09-12T12:26:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3d7000640 1 --2- 172.21.15.144:0/1945001069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 0x7fe3d0071840 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3d7000640 1 -- 172.21.15.144:0/1945001069 >> 172.21.15.144:0/1945001069 conn(0x7fe3d006d0d0 msgr2=0x7fe3d006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3d7000640 1 -- 172.21.15.144:0/1945001069 shutdown_connections 2024-09-12T12:26:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.877+0000 7fe3d7000640 1 -- 172.21.15.144:0/1945001069 wait complete. 2024-09-12T12:26:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 Processor -- start 2024-09-12T12:26:56.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 -- start start 2024-09-12T12:26:56.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 0x7fe3d00cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d00ccf30 0x7fe3d01fa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d015b4e0 0x7fe3d01f78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d015b8c0 con 0x7fe3d0071420 2024-09-12T12:26:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0169270 con 0x7fe3d015b4e0 2024-09-12T12:26:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d00cf6b0 con 0x7fe3d00ccf30 2024-09-12T12:26:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 0x7fe3d00cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 0x7fe3d00cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48074/0 (socket says 172.21.15.144:48074) 2024-09-12T12:26:56.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cfe00640 1 -- 172.21.15.144:0/2458037901 learned_addr learned my addr 172.21.15.144:0/2458037901 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d5000640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d015b4e0 0x7fe3d01f78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cf400640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d00ccf30 0x7fe3d01fa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cfe00640 1 -- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d00ccf30 msgr2=0x7fe3d01fa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cfe00640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d00ccf30 0x7fe3d01fa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cfe00640 1 -- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d015b4e0 msgr2=0x7fe3d01f78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cfe00640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d015b4e0 0x7fe3d01f78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cfe00640 1 -- 172.21.15.144:0/2458037901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d00cf990 con 0x7fe3d0071420 2024-09-12T12:26:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cf400640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d00ccf30 0x7fe3d01fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d5000640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d015b4e0 0x7fe3d01f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3cfe00640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 0x7fe3d00cedf0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000c370 tx=0x7fe3c000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3c7e00640 1 -- 172.21.15.144:0/2458037901 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0017070 con 0x7fe3d0071420 2024-09-12T12:26:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3c7e00640 1 -- 172.21.15.144:0/2458037901 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c0005cf0 con 0x7fe3d0071420 2024-09-12T12:26:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3c7e00640 1 -- 172.21.15.144:0/2458037901 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00072f0 con 0x7fe3d0071420 2024-09-12T12:26:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d00cfc70 con 0x7fe3d0071420 2024-09-12T12:26:56.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.881+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d00cf330 con 0x7fe3d0071420 2024-09-12T12:26:56.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.885+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d0071840 con 0x7fe3d0071420 2024-09-12T12:26:56.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.885+0000 7fe3c7e00640 1 -- 172.21.15.144:0/2458037901 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3c001a070 con 0x7fe3d0071420 2024-09-12T12:26:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.885+0000 7fe3c7e00640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.885+0000 7fe3c7e00640 1 -- 172.21.15.144:0/2458037901 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fe3c0084ea0 con 0x7fe3d0071420 2024-09-12T12:26:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.885+0000 7fe3cf400640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.885+0000 7fe3cf400640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0ae000 tx=0x7fe3bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:56.889+0000 7fe3c7e00640 1 -- 172.21.15.144:0/2458037901 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe3c0055b50 con 0x7fe3d0071420 2024-09-12T12:26:57.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe3d00755f0 con 0x7fe3b00678c0 2024-09-12T12:26:57.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3c7e00640 1 -- 172.21.15.144:0/2458037901 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe3d00755f0 con 0x7fe3b00678c0 2024-09-12T12:26:57.047 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T12:26:57.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 msgr2=0x7fe3b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc0ae000 tx=0x7fe3bc008040 comp rx=0 tx=0).stop 2024-09-12T12:26:57.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 msgr2=0x7fe3d00cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 0x7fe3d00cedf0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000c370 tx=0x7fe3c000c830 comp rx=0 tx=0).stop 2024-09-12T12:26:57.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 shutdown_connections 2024-09-12T12:26:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fe3b00678c0 0x7fe3b0069d80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3d015b4e0 0x7fe3d01f78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3d00ccf30 0x7fe3d01fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 --2- 172.21.15.144:0/2458037901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3d0071420 0x7fe3d00cedf0 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 >> 172.21.15.144:0/2458037901 conn(0x7fe3d006d0d0 msgr2=0x7fe3d0155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 shutdown_connections 2024-09-12T12:26:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.049+0000 7fe3d7000640 1 -- 172.21.15.144:0/2458037901 wait complete. 2024-09-12T12:26:57.068 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T12:26:57.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T12:26:57.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f8515a00640 1 Processor -- start 2024-09-12T12:26:57.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f8515a00640 1 -- start start 2024-09-12T12:26:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f8515a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8510156c10 0x7f8510072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f8515a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f851006cff0 0x7f851006d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f8515a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f851006cd20 con 0x7f8510073360 2024-09-12T12:26:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f8515a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f851006d990 con 0x7f8510156c10 2024-09-12T12:26:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f8515a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8510071be0 con 0x7f851006cff0 2024-09-12T12:26:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f850ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8510156c10 0x7f8510072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f850ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8510156c10 0x7f8510072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37782/0 (socket says 172.21.15.144:37782) 2024-09-12T12:26:57.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f850ea00640 1 -- 172.21.15.144:0/3079483763 learned_addr learned my addr 172.21.15.144:0/3079483763 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f850ea00640 1 -- 172.21.15.144:0/3079483763 >> v2:172.21.15.165:3300/0 conn(0x7f851006cff0 msgr2=0x7f851006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f850e000640 1 --2- 172.21.15.144:0/3079483763 >> v2:172.21.15.165:3300/0 conn(0x7f851006cff0 0x7f851006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f850ea00640 1 --2- 172.21.15.144:0/3079483763 >> v2:172.21.15.165:3300/0 conn(0x7f851006cff0 0x7f851006d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f850ea00640 1 -- 172.21.15.144:0/3079483763 >> v1:172.21.15.144:6789/0 conn(0x7f8510073360 legacy=0x7f85100737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f850ea00640 1 -- 172.21.15.144:0/3079483763 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85100712b0 con 0x7f8510156c10 2024-09-12T12:26:57.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.209+0000 7f850e000640 1 --2- 172.21.15.144:0/3079483763 >> v2:172.21.15.165:3300/0 conn(0x7f851006cff0 0x7f851006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:57.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f850ea00640 1 --2- 172.21.15.144:0/3079483763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510156c10 0x7f8510072070 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f85100c6080 tx=0x7f850001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6fb6ceacd931df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f850d600640 1 -- 172.21.15.144:0/3079483763 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000aa680 con 0x7f8510156c10 2024-09-12T12:26:57.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f850d600640 1 -- 172.21.15.144:0/3079483763 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85000af070 con 0x7f8510156c10 2024-09-12T12:26:57.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f850d600640 1 -- 172.21.15.144:0/3079483763 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000aaa40 con 0x7f8510156c10 2024-09-12T12:26:57.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f8515a00640 1 -- 172.21.15.144:0/3079483763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510156c10 msgr2=0x7f8510072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f8515a00640 1 --2- 172.21.15.144:0/3079483763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510156c10 0x7f8510072070 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f85100c6080 tx=0x7f850001c520 comp rx=0 tx=0).stop 2024-09-12T12:26:57.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f8515a00640 1 -- 172.21.15.144:0/3079483763 shutdown_connections 2024-09-12T12:26:57.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f8515a00640 1 --2- 172.21.15.144:0/3079483763 >> v2:172.21.15.165:3300/0 conn(0x7f851006cff0 0x7f851006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f8515a00640 1 --2- 172.21.15.144:0/3079483763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510156c10 0x7f8510072070 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f8515a00640 1 -- 172.21.15.144:0/3079483763 >> 172.21.15.144:0/3079483763 conn(0x7f851006bc10 msgr2=0x7f851006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f8515a00640 1 -- 172.21.15.144:0/3079483763 shutdown_connections 2024-09-12T12:26:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.213+0000 7f8515a00640 1 -- 172.21.15.144:0/3079483763 wait complete. 2024-09-12T12:26:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 Processor -- start 2024-09-12T12:26:57.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 -- start start 2024-09-12T12:26:57.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f851006cff0 0x7f851014cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8510073360 0x7f8510155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510155670 0x7f85100c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8510157170 con 0x7f8510155670 2024-09-12T12:26:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8510156ff0 con 0x7f851006cff0 2024-09-12T12:26:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f85100725b0 con 0x7f8510073360 2024-09-12T12:26:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510155670 0x7f85100c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510155670 0x7f85100c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37788/0 (socket says 172.21.15.144:37788) 2024-09-12T12:26:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850f400640 1 -- 172.21.15.144:0/2915238766 learned_addr learned my addr 172.21.15.144:0/2915238766 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850ea00640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f851006cff0 0x7f851014cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850e000640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8510073360 0x7f8510155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850f400640 1 -- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8510073360 msgr2=0x7f8510155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850f400640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8510073360 0x7f8510155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850f400640 1 -- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f851006cff0 msgr2=0x7f851014cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850f400640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f851006cff0 0x7f851014cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850f400640 1 -- 172.21.15.144:0/2915238766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85100b4530 con 0x7f8510155670 2024-09-12T12:26:57.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850ea00640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f851006cff0 0x7f851014cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:57.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f850f400640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510155670 0x7f85100c7260 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f850800c770 tx=0x7f850800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8506a00640 1 -- 172.21.15.144:0/2915238766 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8508003b80 con 0x7f8510155670 2024-09-12T12:26:57.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8506a00640 1 -- 172.21.15.144:0/2915238766 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8508003d20 con 0x7f8510155670 2024-09-12T12:26:57.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8506a00640 1 -- 172.21.15.144:0/2915238766 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850800aa90 con 0x7f8510155670 2024-09-12T12:26:57.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85100b4810 con 0x7f8510155670 2024-09-12T12:26:57.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85100b4dd0 con 0x7f8510155670 2024-09-12T12:26:57.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.217+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8510072070 con 0x7f8510155670 2024-09-12T12:26:57.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f8506a00640 1 -- 172.21.15.144:0/2915238766 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f850800ac30 con 0x7f8510155670 2024-09-12T12:26:57.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f8506a00640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84f00678f0 0x7f84f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f8506a00640 1 -- 172.21.15.144:0/2915238766 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f8508085a50 con 0x7f8510155670 2024-09-12T12:26:57.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f8506a00640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f84f006dd90 0x7f84f00701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f8506a00640 1 -- 172.21.15.144:0/2915238766 --> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f850800ee50 con 0x7f84f006dd90 2024-09-12T12:26:57.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f8506a00640 1 -- 172.21.15.144:0/2915238766 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7f850808a2c0 con 0x7f8510155670 2024-09-12T12:26:57.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f850ea00640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84f00678f0 0x7f84f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f850e000640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f84f006dd90 0x7f84f00701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f850ea00640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84f00678f0 0x7f84f0069db0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f85000ae000 tx=0x7f85000a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f850e000640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f84f006dd90 0x7f84f00701d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.221+0000 7f8506a00640 1 -- 172.21.15.144:0/2915238766 <== osd.6 v2:172.21.15.165:6816/608700228 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f850800ee50 con 0x7f84f006dd90 2024-09-12T12:26:57.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 --> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f851006dd80 con 0x7f84f006dd90 2024-09-12T12:26:57.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8506a00640 1 -- 172.21.15.144:0/2915238766 <== osd.6 v2:172.21.15.165:6816/608700228 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f851006dd80 con 0x7f84f006dd90 2024-09-12T12:26:57.236 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:57.236 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T12:26:57.237 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:57.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f84f006dd90 msgr2=0x7f84f00701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.165:6816/608700228,v1:172.21.15.165:6817/608700228] conn(0x7f84f006dd90 0x7f84f00701d0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84f00678f0 msgr2=0x7f84f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f84f00678f0 0x7f84f0069db0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f85000ae000 tx=0x7f85000a7000 comp rx=0 tx=0).stop 2024-09-12T12:26:57.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510155670 msgr2=0x7f85100c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 --2- 172.21.15.144:0/2915238766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8510155670 0x7f85100c7260 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f850800c770 tx=0x7f850800cc30 comp rx=0 tx=0).stop 2024-09-12T12:26:57.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f850f400640 1 -- 172.21.15.144:0/2915238766 reap_dead start 2024-09-12T12:26:57.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 shutdown_connections 2024-09-12T12:26:57.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 >> 172.21.15.144:0/2915238766 conn(0x7f851006bc10 msgr2=0x7f851015c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 shutdown_connections 2024-09-12T12:26:57.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.237+0000 7f8515a00640 1 -- 172.21.15.144:0/2915238766 wait complete. 2024-09-12T12:26:57.254 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T12:26:57.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.389+0000 7f4157c00640 1 Processor -- start 2024-09-12T12:26:57.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.389+0000 7f4157c00640 1 -- start start 2024-09-12T12:26:57.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4157c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 0x7f41500b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4157c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f41500b3ad0 0x7f4150071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4157c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41500b45a0 con 0x7f4150071960 2024-09-12T12:26:57.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4157c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f41500b3fe0 con 0x7f41500b3ad0 2024-09-12T12:26:57.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4157c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41500b42c0 con 0x7f415015b4e0 2024-09-12T12:26:57.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4155c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4150071960 0x7f41500ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49802/0 (socket says 172.21.15.144:49802) 2024-09-12T12:26:57.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4155c00640 1 -- 172.21.15.144:0/2010256666 learned_addr learned my addr 172.21.15.144:0/2010256666 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:57.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4155200640 1 --2- 172.21.15.144:0/2010256666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 0x7f41500b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f414fe00640 1 --2- 172.21.15.144:0/2010256666 >> v2:172.21.15.165:3300/0 conn(0x7f41500b3ad0 0x7f4150071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f414f400640 1 -- 172.21.15.144:0/2010256666 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2785274598 0 0) 0x7f41500b45a0 con 0x7f4150071960 2024-09-12T12:26:57.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f414f400640 1 -- 172.21.15.144:0/2010256666 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4134003530 con 0x7f4150071960 2024-09-12T12:26:57.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4155200640 1 -- 172.21.15.144:0/2010256666 >> v2:172.21.15.165:3300/0 conn(0x7f41500b3ad0 msgr2=0x7f4150071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4155200640 1 --2- 172.21.15.144:0/2010256666 >> v2:172.21.15.165:3300/0 conn(0x7f41500b3ad0 0x7f4150071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4155200640 1 -- 172.21.15.144:0/2010256666 >> v1:172.21.15.144:6789/0 conn(0x7f4150071960 legacy=0x7f41500ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.393+0000 7f4155200640 1 -- 172.21.15.144:0/2010256666 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41500b1490 con 0x7f415015b4e0 2024-09-12T12:26:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4155200640 1 --2- 172.21.15.144:0/2010256666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 0x7f41500b3590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f41400097c0 tx=0x7f414001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a8b4e58b55cf014 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f414f400640 1 -- 172.21.15.144:0/2010256666 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41400aa5f0 con 0x7f415015b4e0 2024-09-12T12:26:57.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f414f400640 1 -- 172.21.15.144:0/2010256666 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41400af070 con 0x7f415015b4e0 2024-09-12T12:26:57.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f414f400640 1 -- 172.21.15.144:0/2010256666 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41400aa990 con 0x7f415015b4e0 2024-09-12T12:26:57.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 -- 172.21.15.144:0/2010256666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 msgr2=0x7f41500b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 --2- 172.21.15.144:0/2010256666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 0x7f41500b3590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f41400097c0 tx=0x7f414001c470 comp rx=0 tx=0).stop 2024-09-12T12:26:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 -- 172.21.15.144:0/2010256666 shutdown_connections 2024-09-12T12:26:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 --2- 172.21.15.144:0/2010256666 >> v2:172.21.15.165:3300/0 conn(0x7f41500b3ad0 0x7f4150071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 --2- 172.21.15.144:0/2010256666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 0x7f41500b3590 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 -- 172.21.15.144:0/2010256666 >> 172.21.15.144:0/2010256666 conn(0x7f415006d0d0 msgr2=0x7f415006d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 -- 172.21.15.144:0/2010256666 shutdown_connections 2024-09-12T12:26:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 -- 172.21.15.144:0/2010256666 wait complete. 2024-09-12T12:26:57.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 Processor -- start 2024-09-12T12:26:57.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.397+0000 7f4157c00640 1 -- start start 2024-09-12T12:26:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4157c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4150071960 0x7f415015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4157c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41500b3ad0 0x7f415014da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4157c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 0x7f415014dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4157c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41500b2620 con 0x7f41500b3ad0 2024-09-12T12:26:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4157c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f41500b24a0 con 0x7f4150071960 2024-09-12T12:26:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4157c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41500cd640 con 0x7f415015b4e0 2024-09-12T12:26:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41500b3ad0 0x7f415014da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41500b3ad0 0x7f415014da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37802/0 (socket says 172.21.15.144:37802) 2024-09-12T12:26:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414fe00640 1 -- 172.21.15.144:0/3212602796 learned_addr learned my addr 172.21.15.144:0/3212602796 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4155200640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4150071960 0x7f415015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4155c00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 0x7f415014dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414fe00640 1 -- 172.21.15.144:0/3212602796 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 msgr2=0x7f415014dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414fe00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 0x7f415014dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414fe00640 1 -- 172.21.15.144:0/3212602796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4150071960 msgr2=0x7f415015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414fe00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4150071960 0x7f415015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414fe00640 1 -- 172.21.15.144:0/3212602796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415015e2a0 con 0x7f41500b3ad0 2024-09-12T12:26:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414fe00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41500b3ad0 0x7f415014da70 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f413c00e900 tx=0x7f413c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414cc00640 1 -- 172.21.15.144:0/3212602796 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c017070 con 0x7f41500b3ad0 2024-09-12T12:26:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414cc00640 1 -- 172.21.15.144:0/3212602796 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413c00c9a0 con 0x7f41500b3ad0 2024-09-12T12:26:57.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f414cc00640 1 -- 172.21.15.144:0/3212602796 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c00cd70 con 0x7f41500b3ad0 2024-09-12T12:26:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4150157790 con 0x7f41500b3ad0 2024-09-12T12:26:57.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4150157d50 con 0x7f41500b3ad0 2024-09-12T12:26:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.401+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4150071420 con 0x7f41500b3ad0 2024-09-12T12:26:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.405+0000 7f414cc00640 1 -- 172.21.15.144:0/3212602796 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f413c01a070 con 0x7f41500b3ad0 2024-09-12T12:26:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.405+0000 7f414cc00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f41300678c0 0x7f4130069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.405+0000 7f414cc00640 1 -- 172.21.15.144:0/3212602796 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f413c0859e0 con 0x7f41500b3ad0 2024-09-12T12:26:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.405+0000 7f4155200640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f41300678c0 0x7f4130069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.405+0000 7f4155200640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f41300678c0 0x7f4130069d80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f41400ae000 tx=0x7f41400b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.409+0000 7f414cc00640 1 -- 172.21.15.144:0/3212602796 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f415015e2a0 con 0x7f41500b3ad0 2024-09-12T12:26:57.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.565+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f41500b5c40 con 0x7f41300678c0 2024-09-12T12:26:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.565+0000 7f414cc00640 1 -- 172.21.15.144:0/3212602796 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f41500b5c40 con 0x7f41300678c0 2024-09-12T12:26:57.565 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T12:26:57.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f41300678c0 msgr2=0x7f4130069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f41300678c0 0x7f4130069d80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f41400ae000 tx=0x7f41400b5040 comp rx=0 tx=0).stop 2024-09-12T12:26:57.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41500b3ad0 msgr2=0x7f415014da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41500b3ad0 0x7f415014da70 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f413c00e900 tx=0x7f413c00edc0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 shutdown_connections 2024-09-12T12:26:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f41300678c0 0x7f4130069d80 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f415015b4e0 0x7f415014dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41500b3ad0 0x7f415014da70 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 --2- 172.21.15.144:0/3212602796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4150071960 0x7f415015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 >> 172.21.15.144:0/3212602796 conn(0x7f415006d0d0 msgr2=0x7f41500b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 shutdown_connections 2024-09-12T12:26:57.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.569+0000 7f4157c00640 1 -- 172.21.15.144:0/3212602796 wait complete. 2024-09-12T12:26:57.586 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T12:26:57.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T12:26:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.725+0000 7f7011400640 1 Processor -- start 2024-09-12T12:26:57.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.725+0000 7f7011400640 1 -- start start 2024-09-12T12:26:57.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7011400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f700c156c10 0x7f700c072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7011400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c073a70 0x7f700c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7011400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f700c06cd20 con 0x7f700c06cff0 2024-09-12T12:26:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7011400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f700c06d990 con 0x7f700c156c10 2024-09-12T12:26:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7011400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f700c071be0 con 0x7f700c073a70 2024-09-12T12:26:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f700c06cff0 0x7f700c073360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49818/0 (socket says 172.21.15.144:49818) 2024-09-12T12:26:57.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009e00640 1 -- 172.21.15.144:0/1562367068 learned_addr learned my addr 172.21.15.144:0/1562367068 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f700a800640 1 --2- 172.21.15.144:0/1562367068 >> v2:172.21.15.165:3300/0 conn(0x7f700c156c10 0x7f700c072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f700b200640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c073a70 0x7f700c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158178249 0 0) 0x7f700c06cd20 con 0x7f700c06cff0 2024-09-12T12:26:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ff0003530 con 0x7f700c06cff0 2024-09-12T12:26:57.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 936019275 0 0) 0x7f6ff0003530 con 0x7f700c06cff0 2024-09-12T12:26:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c073a70 msgr2=0x7f700c06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c073a70 0x7f700c06d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 >> v2:172.21.15.165:3300/0 conn(0x7f700c156c10 msgr2=0x7f700c072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 --2- 172.21.15.144:0/1562367068 >> v2:172.21.15.165:3300/0 conn(0x7f700c156c10 0x7f700c072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c0712b0 con 0x7f700c06cff0 2024-09-12T12:26:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7f6ff80016a0 con 0x7f700c06cff0 2024-09-12T12:26:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 >> v1:172.21.15.144:6789/0 conn(0x7f700c06cff0 legacy=0x7f700c073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c073a70 0x7f6ff00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff0003f40 0x7f6ff0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff0004d50 0x7f6ff00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f700c071be0 con 0x7f6ff0003f40 2024-09-12T12:26:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff000b9d0 con 0x7f6ff0004d50 2024-09-12T12:26:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff000bb50 con 0x7f700c073a70 2024-09-12T12:26:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009e00640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff0003f40 0x7f6ff0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f700a800640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c073a70 0x7f6ff00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f700b200640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff0004d50 0x7f6ff00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009e00640 1 -- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c073a70 msgr2=0x7f6ff00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009e00640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c073a70 0x7f6ff00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009e00640 1 -- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff0004d50 msgr2=0x7f6ff00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009e00640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff0004d50 0x7f6ff00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.729+0000 7f7009e00640 1 -- 172.21.15.144:0/1562367068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff0003530 con 0x7f6ff0003f40 2024-09-12T12:26:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7009e00640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff0003f40 0x7f6ff0004810 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800c210 tx=0x7f6ff801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b137cfca49797302 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8007d60 con 0x7f6ff0003f40 2024-09-12T12:26:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff8005ae0 con 0x7f6ff0003f40 2024-09-12T12:26:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7009400640 1 -- 172.21.15.144:0/1562367068 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8007070 con 0x7f6ff0003f40 2024-09-12T12:26:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7011400640 1 -- 172.21.15.144:0/1562367068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff0003f40 msgr2=0x7f6ff0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7011400640 1 --2- 172.21.15.144:0/1562367068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff0003f40 0x7f6ff0004810 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800c210 tx=0x7f6ff801f370 comp rx=0 tx=0).stop 2024-09-12T12:26:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f700b200640 1 -- 172.21.15.144:0/1562367068 reap_dead start 2024-09-12T12:26:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7011400640 1 -- 172.21.15.144:0/1562367068 shutdown_connections 2024-09-12T12:26:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7011400640 1 -- 172.21.15.144:0/1562367068 >> 172.21.15.144:0/1562367068 conn(0x7f700c06bc10 msgr2=0x7f700c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7011400640 1 -- 172.21.15.144:0/1562367068 shutdown_connections 2024-09-12T12:26:57.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.733+0000 7f7011400640 1 -- 172.21.15.144:0/1562367068 wait complete. 2024-09-12T12:26:57.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 Processor -- start 2024-09-12T12:26:57.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 -- start start 2024-09-12T12:26:57.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff0003f40 0x7f700c14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c1f5350 0x7f700c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700c159720 0x7f700c0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f700c073f70 con 0x7f700c159720 2024-09-12T12:26:57.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f700c071870 con 0x7f6ff0003f40 2024-09-12T12:26:57.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f700c156ff0 con 0x7f700c1f5350 2024-09-12T12:26:57.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700c159720 0x7f700c0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700c159720 0x7f700c0b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37826/0 (socket says 172.21.15.144:37826) 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700b200640 1 -- 172.21.15.144:0/675251240 learned_addr learned my addr 172.21.15.144:0/675251240 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700a800640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff0003f40 0x7f700c14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7009e00640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c1f5350 0x7f700c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700b200640 1 -- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c1f5350 msgr2=0x7f700c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700b200640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c1f5350 0x7f700c1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700b200640 1 -- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff0003f40 msgr2=0x7f700c14b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700b200640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff0003f40 0x7f700c14b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700b200640 1 -- 172.21.15.144:0/675251240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c1f5160 con 0x7f700c159720 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7009e00640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f700c1f5350 0x7f700c1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700a800640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ff0003f40 0x7f700c14b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f700b200640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700c159720 0x7f700c0b49e0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f700c073ea0 tx=0x7f7004011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7002a00640 1 -- 172.21.15.144:0/675251240 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004003620 con 0x7f700c159720 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7002a00640 1 -- 172.21.15.144:0/675251240 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700401b070 con 0x7f700c159720 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7002a00640 1 -- 172.21.15.144:0/675251240 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004003a20 con 0x7f700c159720 2024-09-12T12:26:57.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700c14b620 con 0x7f700c159720 2024-09-12T12:26:57.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f700c1f48c0 con 0x7f700c159720 2024-09-12T12:26:57.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.737+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f700c06e140 con 0x7f700c159720 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f7002a00640 1 -- 172.21.15.144:0/675251240 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7004003bc0 con 0x7f700c159720 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f7002a00640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fec0678f0 0x7f6fec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f7002a00640 1 -- 172.21.15.144:0/675251240 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f7004085be0 con 0x7f700c159720 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f700a800640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fec0678f0 0x7f6fec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f7002a00640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f6fec06dd90 0x7f6fec0701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f7002a00640 1 -- 172.21.15.144:0/675251240 --> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f700401aec0 con 0x7f6fec06dd90 2024-09-12T12:26:57.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f7002a00640 1 -- 172.21.15.144:0/675251240 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) ==== 24+0+0 (secure 0 0 0) 0x7f70040882e0 con 0x7f700c159720 2024-09-12T12:26:57.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f700a800640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fec0678f0 0x7f6fec069db0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0074d0 tx=0x7f6ffc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f7009e00640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f6fec06dd90 0x7f6fec0701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f7009e00640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f6fec06dd90 0x7f6fec0701d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.741+0000 7f7002a00640 1 -- 172.21.15.144:0/675251240 <== osd.7 v2:172.21.15.165:6801/1577381026 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f700401aec0 con 0x7f6fec06dd90 2024-09-12T12:26:57.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 --> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f700c06dd80 con 0x7f6fec06dd90 2024-09-12T12:26:57.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7002a00640 1 -- 172.21.15.144:0/675251240 <== osd.7 v2:172.21.15.165:6801/1577381026 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f700c06dd80 con 0x7f6fec06dd90 2024-09-12T12:26:57.756 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-12T12:26:57.756 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T12:26:57.756 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-12T12:26:57.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f6fec06dd90 msgr2=0x7f6fec0701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.165:6801/1577381026,v1:172.21.15.165:6803/1577381026] conn(0x7f6fec06dd90 0x7f6fec0701d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fec0678f0 msgr2=0x7f6fec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6fec0678f0 0x7f6fec069db0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0074d0 tx=0x7f6ffc00b040 comp rx=0 tx=0).stop 2024-09-12T12:26:57.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700c159720 msgr2=0x7f700c0b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 --2- 172.21.15.144:0/675251240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f700c159720 0x7f700c0b49e0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f700c073ea0 tx=0x7f7004011920 comp rx=0 tx=0).stop 2024-09-12T12:26:57.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f700b200640 1 -- 172.21.15.144:0/675251240 reap_dead start 2024-09-12T12:26:57.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 shutdown_connections 2024-09-12T12:26:57.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 >> 172.21.15.144:0/675251240 conn(0x7f700c06bc10 msgr2=0x7f700c15b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 shutdown_connections 2024-09-12T12:26:57.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.757+0000 7f7011400640 1 -- 172.21.15.144:0/675251240 wait complete. 2024-09-12T12:26:57.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T12:26:57.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd3600640 1 Processor -- start 2024-09-12T12:26:57.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd3600640 1 -- start start 2024-09-12T12:26:57.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd3600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcfcc0cd640 0x7fcfcc071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd3600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfcc0b45a0 con 0x7fcfcc15b4e0 2024-09-12T12:26:57.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd3600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfcc0b3fe0 con 0x7fcfcc071420 2024-09-12T12:26:57.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd3600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcfcc0b42c0 con 0x7fcfcc0cd640 2024-09-12T12:26:57.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd0c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcfcc15b4e0 0x7fcfcc0b3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49830/0 (socket says 172.21.15.144:49830) 2024-09-12T12:26:57.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd0c00640 1 -- 172.21.15.144:0/2664857212 learned_addr learned my addr 172.21.15.144:0/2664857212 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:57.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd1600640 1 --2- 172.21.15.144:0/2664857212 >> v2:172.21.15.165:3300/0 conn(0x7fcfcc0cd640 0x7fcfcc071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890851846 0 0) 0x7fcfcc0b45a0 con 0x7fcfcc15b4e0 2024-09-12T12:26:57.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfb0003530 con 0x7fcfcc15b4e0 2024-09-12T12:26:57.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991783797 0 0) 0x7fcfcc0b3fe0 con 0x7fcfcc071420 2024-09-12T12:26:57.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfcc0b45a0 con 0x7fcfcc071420 2024-09-12T12:26:57.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1183329763 0 0) 0x7fcfb0003530 con 0x7fcfcc15b4e0 2024-09-12T12:26:57.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 >> v2:172.21.15.165:3300/0 conn(0x7fcfcc0cd640 msgr2=0x7fcfcc071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 --2- 172.21.15.144:0/2664857212 >> v2:172.21.15.165:3300/0 conn(0x7fcfcc0cd640 0x7fcfcc071840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 >> v1:172.21.15.165:6789/0 conn(0x7fcfcc071420 legacy=0x7fcfcc0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfcc0b1490 con 0x7fcfcc15b4e0 2024-09-12T12:26:57.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 128324210 0 0) 0x7fcfbc001680 con 0x7fcfcc15b4e0 2024-09-12T12:26:57.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 >> v1:172.21.15.144:6789/0 conn(0x7fcfcc15b4e0 legacy=0x7fcfcc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb0003b50 0x7fcfb0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfb0004810 0x7fcfb0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfb00051d0 0x7fcfb000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcfcc0b42c0 con 0x7fcfb0003b50 2024-09-12T12:26:57.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb000e260 con 0x7fcfb00051d0 2024-09-12T12:26:57.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb000e460 con 0x7fcfb0004810 2024-09-12T12:26:57.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd0c00640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb0003b50 0x7fcfb0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfcbe00640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfb0004810 0x7fcfb0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.913+0000 7fcfd1600640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfb00051d0 0x7fcfb000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd0c00640 1 -- 172.21.15.144:0/2664857212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfb0004810 msgr2=0x7fcfb0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd0c00640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfb0004810 0x7fcfb0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd0c00640 1 -- 172.21.15.144:0/2664857212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfb00051d0 msgr2=0x7fcfb000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:26:57.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd0c00640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfb00051d0 0x7fcfb000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd0c00640 1 -- 172.21.15.144:0/2664857212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb0003530 con 0x7fcfb0003b50 2024-09-12T12:26:57.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd1600640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfb00051d0 0x7fcfb000dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:57.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd1600640 1 -- 172.21.15.144:0/2664857212 reap_dead start 2024-09-12T12:26:57.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd0c00640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb0003b50 0x7fcfb0003f50 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c210 tx=0x7fcfbc01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd7c8eaf831b9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc007cf0 con 0x7fcfb0003b50 2024-09-12T12:26:57.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc0a9020 con 0x7fcfb0003b50 2024-09-12T12:26:57.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfcb400640 1 -- 172.21.15.144:0/2664857212 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc005b00 con 0x7fcfb0003b50 2024-09-12T12:26:57.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd3600640 1 -- 172.21.15.144:0/2664857212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb0003b50 msgr2=0x7fcfb0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd3600640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb0003b50 0x7fcfb0003f50 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c210 tx=0x7fcfbc01cbf0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd3600640 1 -- 172.21.15.144:0/2664857212 shutdown_connections 2024-09-12T12:26:57.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd3600640 1 --2- 172.21.15.144:0/2664857212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb0003b50 0x7fcfb0003f50 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd3600640 1 -- 172.21.15.144:0/2664857212 >> 172.21.15.144:0/2664857212 conn(0x7fcfcc06d0d0 msgr2=0x7fcfcc06d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd3600640 1 -- 172.21.15.144:0/2664857212 shutdown_connections 2024-09-12T12:26:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.917+0000 7fcfd3600640 1 -- 172.21.15.144:0/2664857212 wait complete. 2024-09-12T12:26:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 Processor -- start 2024-09-12T12:26:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 -- start start 2024-09-12T12:26:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfb0003b50 0x7fcfcc14b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfcc159070 0x7fcfcc0ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfcc1594f0 0x7fcfcc0ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcfcc15b8c0 con 0x7fcfcc1594f0 2024-09-12T12:26:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfcc0b3da0 con 0x7fcfcc159070 2024-09-12T12:26:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfcc0ab090 con 0x7fcfb0003b50 2024-09-12T12:26:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfcc1594f0 0x7fcfcc0ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfcc1594f0 0x7fcfcc0ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37856/0 (socket says 172.21.15.144:37856) 2024-09-12T12:26:57.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd1600640 1 -- 172.21.15.144:0/3452000487 learned_addr learned my addr 172.21.15.144:0/3452000487 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd0c00640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfb0003b50 0x7fcfcc14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfcbe00640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfcc159070 0x7fcfcc0ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd1600640 1 -- 172.21.15.144:0/3452000487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfb0003b50 msgr2=0x7fcfcc14b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd1600640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfb0003b50 0x7fcfcc14b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd1600640 1 -- 172.21.15.144:0/3452000487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfcc159070 msgr2=0x7fcfcc0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd1600640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfcc159070 0x7fcfcc0ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd1600640 1 -- 172.21.15.144:0/3452000487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfcc14b660 con 0x7fcfcc1594f0 2024-09-12T12:26:57.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfcbe00640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfcc159070 0x7fcfcc0ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:57.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd1600640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfcc1594f0 0x7fcfcc0ce920 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc070f90 tx=0x7fcfc4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfc8c00640 1 -- 172.21.15.144:0/3452000487 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4010e00 con 0x7fcfcc1594f0 2024-09-12T12:26:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfc8c00640 1 -- 172.21.15.144:0/3452000487 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc40039a0 con 0x7fcfcc1594f0 2024-09-12T12:26:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfc8c00640 1 -- 172.21.15.144:0/3452000487 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4003d50 con 0x7fcfcc1594f0 2024-09-12T12:26:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfcc0aa480 con 0x7fcfcc1594f0 2024-09-12T12:26:57.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.921+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfcc0aaa40 con 0x7fcfcc1594f0 2024-09-12T12:26:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.925+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfcc0b2450 con 0x7fcfcc1594f0 2024-09-12T12:26:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.925+0000 7fcfc8c00640 1 -- 172.21.15.144:0/3452000487 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcfc401e020 con 0x7fcfcc1594f0 2024-09-12T12:26:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.925+0000 7fcfc8c00640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfac0678f0 0x7fcfac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.925+0000 7fcfc8c00640 1 -- 172.21.15.144:0/3452000487 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fcfc4086250 con 0x7fcfcc1594f0 2024-09-12T12:26:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.925+0000 7fcfd0c00640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfac0678f0 0x7fcfac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:57.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.925+0000 7fcfd0c00640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfac0678f0 0x7fcfac069db0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0aa000 tx=0x7fcfcc0b41b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:57.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:57.929+0000 7fcfc8c00640 1 -- 172.21.15.144:0/3452000487 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcfc4056e60 con 0x7fcfcc1594f0 2024-09-12T12:26:58.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fcfcc0738f0 con 0x7fcfac0678f0 2024-09-12T12:26:58.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfc8c00640 1 -- 172.21.15.144:0/3452000487 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcfcc0738f0 con 0x7fcfac0678f0 2024-09-12T12:26:58.087 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T12:26:58.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfac0678f0 msgr2=0x7fcfac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfac0678f0 0x7fcfac069db0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0aa000 tx=0x7fcfcc0b41b0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfcc1594f0 msgr2=0x7fcfcc0ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfcc1594f0 0x7fcfcc0ce920 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc070f90 tx=0x7fcfc4010590 comp rx=0 tx=0).stop 2024-09-12T12:26:58.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 shutdown_connections 2024-09-12T12:26:58.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fcfac0678f0 0x7fcfac069db0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfcc1594f0 0x7fcfcc0ce920 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfcc159070 0x7fcfcc0ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 --2- 172.21.15.144:0/3452000487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfb0003b50 0x7fcfcc14b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 >> 172.21.15.144:0/3452000487 conn(0x7fcfcc06d0d0 msgr2=0x7fcfcc0cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 shutdown_connections 2024-09-12T12:26:58.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.089+0000 7fcfd3600640 1 -- 172.21.15.144:0/3452000487 wait complete. 2024-09-12T12:26:58.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:26:58.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f098c000640 1 Processor -- start 2024-09-12T12:26:58.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f098c000640 1 -- start start 2024-09-12T12:26:58.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f098c000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f098415e540 0x7f09840b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f098c000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f098406e4d0 con 0x7f09840b72e0 2024-09-12T12:26:58.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f098c000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f098406e7b0 con 0x7f098406deb0 2024-09-12T12:26:58.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f098c000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f09840cba40 con 0x7f098415e540 2024-09-12T12:26:58.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f0989600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f098415e540 0x7f09840b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f0988c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f09840b72e0 0x7f098406d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49844/0 (socket says 172.21.15.144:49844) 2024-09-12T12:26:58.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f0988c00640 1 -- 172.21.15.144:0/663458060 learned_addr learned my addr 172.21.15.144:0/663458060 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:26:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f0989600640 1 -- 172.21.15.144:0/663458060 >> v1:172.21.15.165:6789/0 conn(0x7f098406deb0 legacy=0x7f09840cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f0989600640 1 -- 172.21.15.144:0/663458060 >> v1:172.21.15.144:6789/0 conn(0x7f09840b72e0 legacy=0x7f098406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.245+0000 7f0989600640 1 -- 172.21.15.144:0/663458060 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098406ea90 con 0x7f098415e540 2024-09-12T12:26:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f0989600640 1 --2- 172.21.15.144:0/663458060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f098415e540 0x7f09840b6da0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f0978009d90 tx=0x7f097801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33573875791b2a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f0983e00640 1 -- 172.21.15.144:0/663458060 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09780b2070 con 0x7f098415e540 2024-09-12T12:26:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f0983e00640 1 -- 172.21.15.144:0/663458060 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09780a57a0 con 0x7f098415e540 2024-09-12T12:26:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f0983e00640 1 -- 172.21.15.144:0/663458060 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09780a5b70 con 0x7f098415e540 2024-09-12T12:26:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f098c000640 1 -- 172.21.15.144:0/663458060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f098415e540 msgr2=0x7f09840b6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f098c000640 1 --2- 172.21.15.144:0/663458060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f098415e540 0x7f09840b6da0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f0978009d90 tx=0x7f097801c8e0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f098c000640 1 -- 172.21.15.144:0/663458060 shutdown_connections 2024-09-12T12:26:58.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f098c000640 1 --2- 172.21.15.144:0/663458060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f098415e540 0x7f09840b6da0 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f098c000640 1 -- 172.21.15.144:0/663458060 >> 172.21.15.144:0/663458060 conn(0x7f0984067a00 msgr2=0x7f0984067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f098c000640 1 -- 172.21.15.144:0/663458060 shutdown_connections 2024-09-12T12:26:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.249+0000 7f098c000640 1 -- 172.21.15.144:0/663458060 wait complete. 2024-09-12T12:26:58.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 Processor -- start 2024-09-12T12:26:58.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 -- start start 2024-09-12T12:26:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f098406deb0 0x7f09841513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09840b72e0 0x7f098415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f098415e540 0x7f0984159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f09840cd1c0 con 0x7f09840b72e0 2024-09-12T12:26:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f09840cd040 con 0x7f098406deb0 2024-09-12T12:26:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f098416c1b0 con 0x7f098415e540 2024-09-12T12:26:58.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0988c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09840b72e0 0x7f098415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0988c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09840b72e0 0x7f098415a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37864/0 (socket says 172.21.15.144:37864) 2024-09-12T12:26:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0988c00640 1 -- 172.21.15.144:0/3507138150 learned_addr learned my addr 172.21.15.144:0/3507138150 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:26:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0989600640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f098406deb0 0x7f09841513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098a000640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f098415e540 0x7f0984159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0988c00640 1 -- 172.21.15.144:0/3507138150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f098415e540 msgr2=0x7f0984159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0988c00640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f098415e540 0x7f0984159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0988c00640 1 -- 172.21.15.144:0/3507138150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f098406deb0 msgr2=0x7f09841513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0988c00640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f098406deb0 0x7f09841513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0988c00640 1 -- 172.21.15.144:0/3507138150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098415ac50 con 0x7f09840b72e0 2024-09-12T12:26:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098a000640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f098415e540 0x7f0984159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0988c00640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09840b72e0 0x7f098415a2e0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f097000c400 tx=0x7f097000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0981600640 1 -- 172.21.15.144:0/3507138150 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970017070 con 0x7f09840b72e0 2024-09-12T12:26:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0981600640 1 -- 172.21.15.144:0/3507138150 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09700074e0 con 0x7f09840b72e0 2024-09-12T12:26:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0984158860 con 0x7f09840b72e0 2024-09-12T12:26:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f0981600640 1 -- 172.21.15.144:0/3507138150 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09700059b0 con 0x7f09840b72e0 2024-09-12T12:26:58.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.253+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f098415af30 con 0x7f09840b72e0 2024-09-12T12:26:58.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.257+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09840b6da0 con 0x7f09840b72e0 2024-09-12T12:26:58.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.257+0000 7f0981600640 1 -- 172.21.15.144:0/3507138150 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f097001a070 con 0x7f09840b72e0 2024-09-12T12:26:58.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.257+0000 7f0981600640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09640678c0 0x7f0964069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.257+0000 7f0981600640 1 -- 172.21.15.144:0/3507138150 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f0970084dc0 con 0x7f09840b72e0 2024-09-12T12:26:58.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.257+0000 7f0989600640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09640678c0 0x7f0964069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.257+0000 7f0989600640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09640678c0 0x7f0964069d80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f09780af000 tx=0x7f09780a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.261+0000 7f0981600640 1 -- 172.21.15.144:0/3507138150 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0970055410 con 0x7f09840b72e0 2024-09-12T12:26:58.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.413+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0984154600 con 0x7f09640678c0 2024-09-12T12:26:58.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f0981600640 1 -- 172.21.15.144:0/3507138150 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13394 (secure 0 0 0) 0x7f0984154600 con 0x7f09640678c0 2024-09-12T12:26:58.415 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:26:58.416 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:26:58.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09640678c0 msgr2=0x7f0964069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09640678c0 0x7f0964069d80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f09780af000 tx=0x7f09780a7070 comp rx=0 tx=0).stop 2024-09-12T12:26:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09840b72e0 msgr2=0x7f098415a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09840b72e0 0x7f098415a2e0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f097000c400 tx=0x7f097000c8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 shutdown_connections 2024-09-12T12:26:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f09640678c0 0x7f0964069d80 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f098415e540 0x7f0984159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09840b72e0 0x7f098415a2e0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 --2- 172.21.15.144:0/3507138150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f098406deb0 0x7f09841513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 >> 172.21.15.144:0/3507138150 conn(0x7f0984067a00 msgr2=0x7f0984157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 shutdown_connections 2024-09-12T12:26:58.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:26:58.417+0000 7f098c000640 1 -- 172.21.15.144:0/3507138150 wait complete. 2024-09-12T12:26:58.436 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":632,"stamp":"2024-09-12T12:26:57.563028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":448828,"kb_used_data":21640,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754525892,"statfs":{"total":773094113280,"available":772634513408,"internally_reserved":0,"allocated":22159360,"data_stored":11108256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-7,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002257"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":515,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-12T12:26:48.030696+0000","last_change":"2024-09-12T12:12:37.002720+0000","last_active":"2024-09-12T12:26:48.030696+0000","last_peered":"2024-09-12T12:26:48.030696+0000","last_clean":"2024-09-12T12:26:48.030696+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:26:48.030696+0000","last_undegraded":"2024-09-12T12:26:48.030696+0000","last_fullsized":"2024-09-12T12:26:48.030696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:12:35.693588+0000","last_clean_scrub_stamp":"2024-09-12T12:12:35.693588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:07.267641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575024,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52380,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319460,"statfs":{"total":96636764160,"available":96583127040,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55956,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315884,"statfs":{"total":96636764160,"available":96579465216,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51796,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47640,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324200,"statfs":{"total":96636764160,"available":96587980800,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575022,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64280,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307560,"statfs":{"total":96636764160,"available":96570941440,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575025,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56536,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315304,"statfs":{"total":96636764160,"available":96578871296,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:26:58.439 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T12:12:35.693588+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=12, tm_min=12, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T12:26:58.439 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T12:27:16.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:27:17.000 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:27:18.440 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T12:27:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a39000640 1 Processor -- start 2024-09-12T12:27:18.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a39000640 1 -- start start 2024-09-12T12:27:18.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a39000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a340b4950 0x7f4a34070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a39000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a34071380 0x7f4a340b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a39000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3415c740 con 0x7f4a3415c360 2024-09-12T12:27:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a39000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4a34160d50 con 0x7f4a34071380 2024-09-12T12:27:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a39000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4a34071b90 con 0x7f4a340b4950 2024-09-12T12:27:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a32800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a34071380 0x7f4a340b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a32800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4a34071380 0x7f4a340b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51962/0 (socket says 172.21.15.144:51962) 2024-09-12T12:27:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a32800640 1 -- 172.21.15.144:0/2682022085 learned_addr learned my addr 172.21.15.144:0/2682022085 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:27:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a31e00640 1 --1- 172.21.15.144:0/2682022085 >> v1:172.21.15.144:6789/0 conn(0x7f4a3415c360 0x7f4a340b4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42590/0 (socket says 172.21.15.144:42590) 2024-09-12T12:27:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a31400640 1 --2- 172.21.15.144:0/2682022085 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a340b4950 0x7f4a34070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a32800640 1 -- 172.21.15.144:0/2682022085 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a340b4950 msgr2=0x7f4a34070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:27:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a32800640 1 --2- 172.21.15.144:0/2682022085 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a340b4950 0x7f4a34070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a32800640 1 -- 172.21.15.144:0/2682022085 >> v1:172.21.15.144:6789/0 conn(0x7f4a3415c360 legacy=0x7f4a340b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.589+0000 7f4a32800640 1 -- 172.21.15.144:0/2682022085 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3415ff90 con 0x7f4a34071380 2024-09-12T12:27:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a32800640 1 --2- 172.21.15.144:0/2682022085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a34071380 0x7f4a340b55b0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009870 tx=0x7f4a2c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91ce0e2a970aa39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a30a00640 1 -- 172.21.15.144:0/2682022085 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0aa620 con 0x7f4a34071380 2024-09-12T12:27:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a30a00640 1 -- 172.21.15.144:0/2682022085 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0af070 con 0x7f4a34071380 2024-09-12T12:27:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a30a00640 1 -- 172.21.15.144:0/2682022085 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0aa9e0 con 0x7f4a34071380 2024-09-12T12:27:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a39000640 1 -- 172.21.15.144:0/2682022085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a34071380 msgr2=0x7f4a340b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a39000640 1 --2- 172.21.15.144:0/2682022085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a34071380 0x7f4a340b55b0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009870 tx=0x7f4a2c01c4a0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a39000640 1 -- 172.21.15.144:0/2682022085 shutdown_connections 2024-09-12T12:27:18.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a39000640 1 --2- 172.21.15.144:0/2682022085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a34071380 0x7f4a340b55b0 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a39000640 1 --2- 172.21.15.144:0/2682022085 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a340b4950 0x7f4a34070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a39000640 1 -- 172.21.15.144:0/2682022085 >> 172.21.15.144:0/2682022085 conn(0x7f4a3406f3c0 msgr2=0x7f4a3406f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a39000640 1 -- 172.21.15.144:0/2682022085 shutdown_connections 2024-09-12T12:27:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.593+0000 7f4a39000640 1 -- 172.21.15.144:0/2682022085 wait complete. 2024-09-12T12:27:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 Processor -- start 2024-09-12T12:27:18.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 -- start start 2024-09-12T12:27:18.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a34071380 0x7f4a340ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b4950 0x7f4a34158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3415c360 0x7f4a341f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4a340b6300 con 0x7f4a340b4950 2024-09-12T12:27:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4a34071830 con 0x7f4a34071380 2024-09-12T12:27:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4a340b6480 con 0x7f4a3415c360 2024-09-12T12:27:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b4950 0x7f4a34158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b4950 0x7f4a34158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51970/0 (socket says 172.21.15.144:51970) 2024-09-12T12:27:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31400640 1 -- 172.21.15.144:0/1096653870 learned_addr learned my addr 172.21.15.144:0/1096653870 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:27:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a32800640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3415c360 0x7f4a341f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31e00640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a34071380 0x7f4a340ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31400640 1 -- 172.21.15.144:0/1096653870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3415c360 msgr2=0x7f4a341f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31400640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3415c360 0x7f4a341f6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31400640 1 -- 172.21.15.144:0/1096653870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a34071380 msgr2=0x7f4a340ac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31400640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a34071380 0x7f4a340ac440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31400640 1 -- 172.21.15.144:0/1096653870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a340ac980 con 0x7f4a340b4950 2024-09-12T12:27:18.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a31400640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b4950 0x7f4a34158540 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000d800 tx=0x7f4a2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:18.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a2a000640 1 -- 172.21.15.144:0/1096653870 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000b6c0 con 0x7f4a340b4950 2024-09-12T12:27:18.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a2a000640 1 -- 172.21.15.144:0/1096653870 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a20019070 con 0x7f4a340b4950 2024-09-12T12:27:18.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a340b3a90 con 0x7f4a340b4950 2024-09-12T12:27:18.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a2a000640 1 -- 172.21.15.144:0/1096653870 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000ba60 con 0x7f4a340b4950 2024-09-12T12:27:18.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.597+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a340b4050 con 0x7f4a340b4950 2024-09-12T12:27:18.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.601+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a340b55b0 con 0x7f4a340b4950 2024-09-12T12:27:18.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.601+0000 7f4a2a000640 1 -- 172.21.15.144:0/1096653870 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a2000bc00 con 0x7f4a340b4950 2024-09-12T12:27:18.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.601+0000 7f4a2a000640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a140678c0 0x7f4a14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.601+0000 7f4a2a000640 1 -- 172.21.15.144:0/1096653870 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f4a20085f40 con 0x7f4a340b4950 2024-09-12T12:27:18.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.601+0000 7f4a31e00640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a140678c0 0x7f4a14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.601+0000 7f4a31e00640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a140678c0 0x7f4a14069d80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4a3406e9d0 tx=0x7f4a24001640 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:18.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.605+0000 7f4a2a000640 1 -- 172.21.15.144:0/1096653870 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a20056500 con 0x7f4a340b4950 2024-09-12T12:27:18.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.761+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 --> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a34158a80 con 0x7f4a140678c0 2024-09-12T12:27:18.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.761+0000 7f4a2a000640 1 -- 172.21.15.144:0/1096653870 <== mgr.4110 v2:172.21.15.144:6832/4117380046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13386 (secure 0 0 0) 0x7f4a34158a80 con 0x7f4a140678c0 2024-09-12T12:27:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:27:18.762 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-12T12:27:18.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a140678c0 msgr2=0x7f4a14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a140678c0 0x7f4a14069d80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4a3406e9d0 tx=0x7f4a24001640 comp rx=0 tx=0).stop 2024-09-12T12:27:18.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b4950 msgr2=0x7f4a34158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b4950 0x7f4a34158540 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000d800 tx=0x7f4a2000dcc0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 shutdown_connections 2024-09-12T12:27:18.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f4a140678c0 0x7f4a14069d80 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3415c360 0x7f4a341f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a340b4950 0x7f4a34158540 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 --2- 172.21.15.144:0/1096653870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a34071380 0x7f4a340ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 >> 172.21.15.144:0/1096653870 conn(0x7f4a3406f3c0 msgr2=0x7f4a34165380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:18.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 shutdown_connections 2024-09-12T12:27:18.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.765+0000 7f4a39000640 1 -- 172.21.15.144:0/1096653870 wait complete. 2024-09-12T12:27:18.783 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":642,"stamp":"2024-09-12T12:27:17.567196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":448816,"kb_used_data":21640,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754525904,"statfs":{"total":773094113280,"available":772634525696,"internally_reserved":0,"allocated":22159360,"data_stored":11108256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002573"},"pg_stats":[{"pgid":"1.0","version":"207'119","reported_seq":526,"reported_epoch":207,"state":"active+clean","last_fresh":"2024-09-12T12:26:59.069041+0000","last_change":"2024-09-12T12:26:59.069075+0000","last_active":"2024-09-12T12:26:59.069041+0000","last_peered":"2024-09-12T12:26:59.069041+0000","last_clean":"2024-09-12T12:26:59.069041+0000","last_became_active":"2024-09-12T12:12:37.001598+0000","last_became_peered":"2024-09-12T12:12:37.001598+0000","last_unstale":"2024-09-12T12:26:59.069041+0000","last_undegraded":"2024-09-12T12:26:59.069041+0000","last_fullsized":"2024-09-12T12:26:59.069041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'119","last_scrub_stamp":"2024-09-12T12:26:59.068963+0000","last_deep_scrub":"207'119","last_deep_scrub_stamp":"2024-09-12T12:26:59.068963+0000","last_clean_scrub_stamp":"2024-09-12T12:26:59.068963+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:29.161411+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52372,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319468,"statfs":{"total":96636764160,"available":96583135232,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55956,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315884,"statfs":{"total":96636764160,"available":96579465216,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51796,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320044,"statfs":{"total":96636764160,"available":96583725056,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47640,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324200,"statfs":{"total":96636764160,"available":96587980800,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60120,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64280,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307560,"statfs":{"total":96636764160,"available":96570941440,"internally_reserved":0,"allocated":2621440,"data_stored":1240940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56532,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315308,"statfs":{"total":96636764160,"available":96578875392,"internally_reserved":0,"allocated":3215360,"data_stored":1831308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:27:18.784 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T12:27:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4cec00640 1 Processor -- start 2024-09-12T12:27:18.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4cec00640 1 -- start start 2024-09-12T12:27:18.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4cec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4c815af60 0x7fa4c80ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4cec00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c80b4300 con 0x7fa4c806c320 2024-09-12T12:27:18.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4cec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c80b3540 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4cec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa4c80b32f0 con 0x7fa4c815af60 2024-09-12T12:27:18.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4c7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4c815af60 0x7fa4c80ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4c7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4c815af60 0x7fa4c80ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51986/0 (socket says 172.21.15.144:51986) 2024-09-12T12:27:18.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4c7e00640 1 -- 172.21.15.144:0/2614366021 learned_addr learned my addr 172.21.15.144:0/2614366021 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:27:18.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4c7e00640 1 -- 172.21.15.144:0/2614366021 >> v1:172.21.15.165:6789/0 conn(0x7fa4c80cd9f0 legacy=0x7fa4c806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4c7e00640 1 -- 172.21.15.144:0/2614366021 >> v1:172.21.15.144:6789/0 conn(0x7fa4c806c320 legacy=0x7fa4c80b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.921+0000 7fa4c7e00640 1 -- 172.21.15.144:0/2614366021 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c80b3820 con 0x7fa4c815af60 2024-09-12T12:27:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4c7e00640 1 --2- 172.21.15.144:0/2614366021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c815af60 0x7fa4c80ce680 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c2ced95c2ad555 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4c6a00640 1 -- 172.21.15.144:0/2614366021 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80ab650 con 0x7fa4c815af60 2024-09-12T12:27:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4c6a00640 1 -- 172.21.15.144:0/2614366021 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b80b0070 con 0x7fa4c815af60 2024-09-12T12:27:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4c6a00640 1 -- 172.21.15.144:0/2614366021 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80aba10 con 0x7fa4c815af60 2024-09-12T12:27:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4cec00640 1 -- 172.21.15.144:0/2614366021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c815af60 msgr2=0x7fa4c80ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4cec00640 1 --2- 172.21.15.144:0/2614366021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c815af60 0x7fa4c80ce680 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b801c560 comp rx=0 tx=0).stop 2024-09-12T12:27:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4cec00640 1 -- 172.21.15.144:0/2614366021 shutdown_connections 2024-09-12T12:27:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4cec00640 1 --2- 172.21.15.144:0/2614366021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c815af60 0x7fa4c80ce680 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4cec00640 1 -- 172.21.15.144:0/2614366021 >> 172.21.15.144:0/2614366021 conn(0x7fa4c8068030 msgr2=0x7fa4c80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4cec00640 1 -- 172.21.15.144:0/2614366021 shutdown_connections 2024-09-12T12:27:18.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.925+0000 7fa4cec00640 1 -- 172.21.15.144:0/2614366021 wait complete. 2024-09-12T12:27:18.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 Processor -- start 2024-09-12T12:27:18.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 -- start start 2024-09-12T12:27:18.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c806c320 0x7fa4c814a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c80cd9f0 0x7fa4c80aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c815af60 0x7fa4c8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c8169090 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c8168f10 con 0x7fa4c815af60 2024-09-12T12:27:18.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c8169210 con 0x7fa4c806c320 2024-09-12T12:27:18.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c80cd9f0 0x7fa4c80aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c80cd9f0 0x7fa4c80aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51994/0 (socket says 172.21.15.144:51994) 2024-09-12T12:27:18.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7400640 1 -- 172.21.15.144:0/1760658452 learned_addr learned my addr 172.21.15.144:0/1760658452 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:27:18.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7e00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c806c320 0x7fa4c814a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4ccc00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c815af60 0x7fa4c8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7400640 1 -- 172.21.15.144:0/1760658452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c806c320 msgr2=0x7fa4c814a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7400640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c806c320 0x7fa4c814a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7400640 1 -- 172.21.15.144:0/1760658452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c815af60 msgr2=0x7fa4c8159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7400640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c815af60 0x7fa4c8159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7400640 1 -- 172.21.15.144:0/1760658452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c8073030 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4c7400640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c80cd9f0 0x7fa4c80aee50 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c450 tx=0x7fa4b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4bfe00640 1 -- 172.21.15.144:0/1760658452 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4016020 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4bfe00640 1 -- 172.21.15.144:0/1760658452 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b40052d0 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4bfe00640 1 -- 172.21.15.144:0/1760658452 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4007260 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c8072790 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c8072d50 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.929+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c80ce680 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.933+0000 7fa4bfe00640 1 -- 172.21.15.144:0/1760658452 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4b4007400 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.933+0000 7fa4bfe00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4a80678c0 0x7fa4a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.933+0000 7fa4bfe00640 1 -- 172.21.15.144:0/1760658452 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7fa4b4085310 con 0x7fa4c80cd9f0 2024-09-12T12:27:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.933+0000 7fa4c7e00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4a80678c0 0x7fa4a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:18.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.933+0000 7fa4c7e00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4a80678c0 0x7fa4a8069d80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80af000 tx=0x7fa4b80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:18.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:18.937+0000 7fa4bfe00640 1 -- 172.21.15.144:0/1760658452 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4b4020020 con 0x7fa4c80cd9f0 2024-09-12T12:27:19.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.105+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa4c814bb90 con 0x7fa4c80cd9f0 2024-09-12T12:27:19.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.105+0000 7fa4bfe00640 1 -- 172.21.15.144:0/1760658452 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v50)=0 v50) ==== 123+0+0 (secure 0 0 0) 0x7fa4b4005480 con 0x7fa4c80cd9f0 2024-09-12T12:27:19.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4bfe00640 1 -- 172.21.15.144:0/1760658452 <== mon.0 v2:172.21.15.144:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa4b4055a00 con 0x7fa4c80cd9f0 2024-09-12T12:27:19.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4a80678c0 msgr2=0x7fa4a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:19.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4a80678c0 0x7fa4a8069d80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa4b80af000 tx=0x7fa4b80a7000 comp rx=0 tx=0).stop 2024-09-12T12:27:19.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c80cd9f0 msgr2=0x7fa4c80aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:19.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c80cd9f0 0x7fa4c80aee50 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400c450 tx=0x7fa4b400c910 comp rx=0 tx=0).stop 2024-09-12T12:27:19.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 shutdown_connections 2024-09-12T12:27:19.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7fa4a80678c0 0x7fa4a8069d80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c815af60 0x7fa4c8159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c80cd9f0 0x7fa4c80aee50 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 --2- 172.21.15.144:0/1760658452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c806c320 0x7fa4c814a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 >> 172.21.15.144:0/1760658452 conn(0x7fa4c8068030 msgr2=0x7fa4c80b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:19.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 shutdown_connections 2024-09-12T12:27:19.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.109+0000 7fa4cec00640 1 -- 172.21.15.144:0/1760658452 wait complete. 2024-09-12T12:27:19.130 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:27:19.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T12:27:19.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6aeb000640 1 Processor -- start 2024-09-12T12:27:19.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6aeb000640 1 -- start start 2024-09-12T12:27:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6aeb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae4147cc0 0x7f6ae406e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6aeb000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae406d220 con 0x7f6ae40b46b0 2024-09-12T12:27:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6aeb000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae406d500 con 0x7f6ae41480a0 2024-09-12T12:27:19.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6aeb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae406e4e0 con 0x7f6ae4147cc0 2024-09-12T12:27:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6aea600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6ae40b46b0 0x7f6ae40d2280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:42602/0 (socket says 172.21.15.144:42602) 2024-09-12T12:27:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6aea600640 1 -- 172.21.15.144:0/159860459 learned_addr learned my addr 172.21.15.144:0/159860459 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-12T12:27:19.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6ae9c00640 1 --2- 172.21.15.144:0/159860459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae4147cc0 0x7f6ae406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:19.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6ae3e00640 1 -- 172.21.15.144:0/159860459 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089145709 0 0) 0x7f6ae406d220 con 0x7f6ae40b46b0 2024-09-12T12:27:19.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6ae3e00640 1 -- 172.21.15.144:0/159860459 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6acc003530 con 0x7f6ae40b46b0 2024-09-12T12:27:19.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6ae9c00640 1 -- 172.21.15.144:0/159860459 >> v1:172.21.15.165:6789/0 conn(0x7f6ae41480a0 legacy=0x7f6ae40b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:19.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6ae3e00640 1 -- 172.21.15.144:0/159860459 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2318993731 0 0) 0x7f6ae406d500 con 0x7f6ae41480a0 2024-09-12T12:27:19.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6ae9c00640 1 -- 172.21.15.144:0/159860459 >> v1:172.21.15.144:6789/0 conn(0x7f6ae40b46b0 legacy=0x7f6ae40d2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:19.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.269+0000 7f6ae9c00640 1 -- 172.21.15.144:0/159860459 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae406d7e0 con 0x7f6ae4147cc0 2024-09-12T12:27:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6ae9c00640 1 --2- 172.21.15.144:0/159860459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae4147cc0 0x7f6ae406e790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80097f0 tx=0x7f6ad801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c7d1483fdb02ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6ae3e00640 1 -- 172.21.15.144:0/159860459 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80ab5f0 con 0x7f6ae4147cc0 2024-09-12T12:27:19.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6ae3e00640 1 -- 172.21.15.144:0/159860459 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6ad80b0070 con 0x7f6ae4147cc0 2024-09-12T12:27:19.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6ae3e00640 1 -- 172.21.15.144:0/159860459 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80ab990 con 0x7f6ae4147cc0 2024-09-12T12:27:19.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6aeb000640 1 -- 172.21.15.144:0/159860459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae4147cc0 msgr2=0x7f6ae406e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:19.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6aeb000640 1 --2- 172.21.15.144:0/159860459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae4147cc0 0x7f6ae406e790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80097f0 tx=0x7f6ad801c4e0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6aeb000640 1 -- 172.21.15.144:0/159860459 shutdown_connections 2024-09-12T12:27:19.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6aeb000640 1 --2- 172.21.15.144:0/159860459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae4147cc0 0x7f6ae406e790 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6aeb000640 1 -- 172.21.15.144:0/159860459 >> 172.21.15.144:0/159860459 conn(0x7f6ae40b7c30 msgr2=0x7f6ae4067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:19.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6aeb000640 1 -- 172.21.15.144:0/159860459 shutdown_connections 2024-09-12T12:27:19.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.273+0000 7f6aeb000640 1 -- 172.21.15.144:0/159860459 wait complete. 2024-09-12T12:27:19.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 Processor -- start 2024-09-12T12:27:19.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 -- start start 2024-09-12T12:27:19.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae40b46b0 0x7f6ae415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:19.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ae4147cc0 0x7f6ae4146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:19.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae41480a0 0x7f6ae413ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:19.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae416c870 con 0x7f6ae4147cc0 2024-09-12T12:27:19.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae416c6f0 con 0x7f6ae41480a0 2024-09-12T12:27:19.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae416c9f0 con 0x7f6ae40b46b0 2024-09-12T12:27:19.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ae4147cc0 0x7f6ae4146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:19.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ae4147cc0 0x7f6ae4146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:52010/0 (socket says 172.21.15.144:52010) 2024-09-12T12:27:19.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9200640 1 -- 172.21.15.144:0/3926658827 learned_addr learned my addr 172.21.15.144:0/3926658827 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-12T12:27:19.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9c00640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae40b46b0 0x7f6ae415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:19.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9200640 1 -- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae40b46b0 msgr2=0x7f6ae415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:19.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aea600640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae41480a0 0x7f6ae413ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:19.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9200640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae40b46b0 0x7f6ae415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9200640 1 -- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae41480a0 msgr2=0x7f6ae413ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:19.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9200640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae41480a0 0x7f6ae413ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9200640 1 -- 172.21.15.144:0/3926658827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae4144c50 con 0x7f6ae4147cc0 2024-09-12T12:27:19.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9c00640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae40b46b0 0x7f6ae415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:19.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aea600640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae41480a0 0x7f6ae413ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:27:19.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae9200640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ae4147cc0 0x7f6ae4146190 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c3c0 tx=0x7f6ad000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:19.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae1600640 1 -- 172.21.15.144:0/3926658827 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0017070 con 0x7f6ae4147cc0 2024-09-12T12:27:19.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae1600640 1 -- 172.21.15.144:0/3926658827 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6ad0003600 con 0x7f6ae4147cc0 2024-09-12T12:27:19.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6ae1600640 1 -- 172.21.15.144:0/3926658827 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0003a70 con 0x7f6ae4147cc0 2024-09-12T12:27:19.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae41466d0 con 0x7f6ae4147cc0 2024-09-12T12:27:19.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae4141c70 con 0x7f6ae4147cc0 2024-09-12T12:27:19.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.277+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae406e790 con 0x7f6ae4147cc0 2024-09-12T12:27:19.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.281+0000 7f6ae1600640 1 -- 172.21.15.144:0/3926658827 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6ad001a070 con 0x7f6ae4147cc0 2024-09-12T12:27:19.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.281+0000 7f6ae1600640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ac40678f0 0x7f6ac4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:19.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.281+0000 7f6ae1600640 1 -- 172.21.15.144:0/3926658827 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5335+0+0 (secure 0 0 0) 0x7f6ad0084fd0 con 0x7f6ae4147cc0 2024-09-12T12:27:19.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.281+0000 7f6ae9c00640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ac40678f0 0x7f6ac4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:19.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.281+0000 7f6ae9c00640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ac40678f0 0x7f6ac4069db0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80af000 tx=0x7f6ad8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:19.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.285+0000 7f6ae1600640 1 -- 172.21.15.144:0/3926658827 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6ad0055b50 con 0x7f6ae4147cc0 2024-09-12T12:27:19.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.477+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ae413fc30 con 0x7f6ae4147cc0 2024-09-12T12:27:19.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.477+0000 7f6ae1600640 1 -- 172.21.15.144:0/3926658827 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+3928 (secure 0 0 0) 0x7f6ad0055450 con 0x7f6ae4147cc0 2024-09-12T12:27:19.477 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-12T12:27:19.477 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":159,"btime":"2024-09-12T12:26:45:985558+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/4236764535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":4236764535},{"type":"v1","addr":"172.21.15.165:6835","nonce":4236764535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":159},{"gid":10006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/480472502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":480472502},{"type":"v1","addr":"172.21.15.165:6834","nonce":480472502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2632695665","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2632695665},{"type":"v1","addr":"172.21.15.144:6836","nonce":2632695665}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":151},{"gid":10590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2593616401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2593616401},{"type":"v1","addr":"172.21.15.144:6837","nonce":2593616401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152}],"filesystems":[]} 2024-09-12T12:27:19.478 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 159 2024-09-12T12:27:19.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ac40678f0 msgr2=0x7f6ac4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:19.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ac40678f0 0x7f6ac4069db0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80af000 tx=0x7f6ad8008040 comp rx=0 tx=0).stop 2024-09-12T12:27:19.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ae4147cc0 msgr2=0x7f6ae4146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:19.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ae4147cc0 0x7f6ae4146190 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000c3c0 tx=0x7f6ad000c880 comp rx=0 tx=0).stop 2024-09-12T12:27:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 shutdown_connections 2024-09-12T12:27:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:6832/4117380046,v1:172.21.15.144:6833/4117380046] conn(0x7f6ac40678f0 0x7f6ac4069db0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ae41480a0 0x7f6ae413ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ae4147cc0 0x7f6ae4146190 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 --2- 172.21.15.144:0/3926658827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ae40b46b0 0x7f6ae415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 >> 172.21.15.144:0/3926658827 conn(0x7f6ae40b7c30 msgr2=0x7f6ae4161970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 shutdown_connections 2024-09-12T12:27:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-12T12:27:19.481+0000 7f6aeb000640 1 -- 172.21.15.144:0/3926658827 wait complete. 2024-09-12T12:27:19.500 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-12T12:27:19.500 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T12:27:19.500 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T12:27:19.500 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:19.512 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T12:27:19.512 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T12:27:19.513 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:19.566 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T12:27:19.566 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T12:27:19.566 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:19.581 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T12:27:19.581 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T12:27:19.581 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:19.637 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T12:27:19.638 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T12:27:19.638 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T12:27:19.638 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:25.739 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T12:27:25.740 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T12:27:25.740 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:25.823 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T12:27:25.823 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T12:27:25.823 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:26.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T12:27:31.926 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T12:27:31.926 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T12:27:31.927 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:32.001 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T12:27:32.002 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T12:27:32.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:32.094 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T12:27:32.094 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T12:27:32.094 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:32.179 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T12:27:32.179 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T12:27:37.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T12:27:37.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T12:27:38.195 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T12:27:38.196 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T12:27:38.196 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:38.271 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T12:27:38.272 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T12:27:38.272 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:38.362 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T12:27:38.362 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T12:27:38.362 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T12:27:38.362 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:38.422 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T12:27:38.423 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T12:27:38.423 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:38.478 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T12:27:38.478 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T12:27:38.478 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T12:27:38.478 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:38.499 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T12:27:38.499 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T12:27:38.500 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:38.516 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T12:27:38.516 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T12:27:38.517 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T12:27:38.577 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T12:27:38.577 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T12:27:38.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-09-12T12:27:38.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:27:38.618 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T12:27:38.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:27:38.955 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T12:27:39.116 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:27:39.116 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T12:27:39.290 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:27:39.290 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T12:27:39.485 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:27:39.485 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T12:27:39.732 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:27:39.732 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T12:27:39.936 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:27:39.936 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T12:27:40.141 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:27:40.141 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T12:27:40.315 INFO:tasks.ceph:Archiving mon data... 2024-09-12T12:27:40.317 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704/data/mon.a.tgz 2024-09-12T12:27:40.317 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-09-12T12:27:40.326 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.TmtPAOIO42 2024-09-12T12:27:40.326 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.TmtPAOIO42 2024-09-12T12:27:40.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.TmtPAOIO42 2024-09-12T12:27:40.578 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.TmtPAOIO42 is 580KB 2024-09-12T12:27:40.653 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.TmtPAOIO42 2024-09-12T12:27:40.661 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704/data/mon.b.tgz 2024-09-12T12:27:40.662 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-09-12T12:27:40.670 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.ypFQSqGoEB 2024-09-12T12:27:40.671 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ypFQSqGoEB 2024-09-12T12:27:40.850 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.ypFQSqGoEB 2024-09-12T12:27:40.929 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.ypFQSqGoEB is 603KB 2024-09-12T12:27:40.995 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.ypFQSqGoEB 2024-09-12T12:27:41.003 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704/data/mon.c.tgz 2024-09-12T12:27:41.003 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-09-12T12:27:41.052 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.YGCUsugjX2 2024-09-12T12:27:41.052 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YGCUsugjX2 2024-09-12T12:27:41.227 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.YGCUsugjX2 2024-09-12T12:27:41.301 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.YGCUsugjX2 is 603KB 2024-09-12T12:27:41.371 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.YGCUsugjX2 2024-09-12T12:27:41.379 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T12:27:41.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T12:27:41.383 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T12:27:41.451 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T12:27:41.488 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T12:27:41.488 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T12:27:41.490 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704/remote/smithi144/crash 2024-09-12T12:27:41.491 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T12:27:41.515 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704/remote/smithi165/crash 2024-09-12T12:27:41.515 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T12:27:41.549 INFO:tasks.ceph:Shutting down logrotate 2024-09-12T12:27:41.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:27:41.561 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T12:27:41.644 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T12:27:41.665 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T12:27:41.684 INFO:tasks.ceph:Compressing logs... 2024-09-12T12:27:41.684 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:27:41.713 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:27:41.744 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84013.log 2024-09-12T12:27:41.745 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87397.log 2024-09-12T12:27:41.746 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72358.log 2024-09-12T12:27:41.746 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84013.log.gz 2024-09-12T12:27:41.747 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75152.log 2024-09-12T12:27:41.747 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.87397.log.gz 2024-09-12T12:27:41.748 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88955.log 2024-09-12T12:27:41.749 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75152.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72358.log.gz 2024-09-12T12:27:41.749 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89848.log 2024-09-12T12:27:41.749 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75152.log.gz 2024-09-12T12:27:41.750 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52499.log 2024-09-12T12:27:41.750 INFO:teuthology.orchestra.run.smithi144.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.88955.log.gz 2024-09-12T12:27:41.751 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77448.log 2024-09-12T12:27:41.751 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89848.log.gz 2024-09-12T12:27:41.752 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29101.log 2024-09-12T12:27:41.752 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35144.log 2024-09-12T12:27:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77448.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52499.log.gz 2024-09-12T12:27:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78705.log 2024-09-12T12:27:41.753 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77448.log.gz 2024-09-12T12:27:41.754 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T12:27:41.754 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29101.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T12:27:41.754 INFO:teuthology.orchestra.run.smithi165.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29101.log.gz 2024-09-12T12:27:41.754 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T12:27:41.756 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34722.log 2024-09-12T12:27:41.756 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34824.log 2024-09-12T12:27:41.757 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51275.log 2024-09-12T12:27:41.757 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35144.log.gz 2024-09-12T12:27:41.757 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35619.log 2024-09-12T12:27:41.758 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78705.log.gz 2024-09-12T12:27:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84497.log 2024-09-12T12:27:41.758 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51275.log.gz 2024-09-12T12:27:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58432.log 2024-09-12T12:27:41.758 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35619.log.gz 2024-09-12T12:27:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88040.log 2024-09-12T12:27:41.758 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.84497.log.gz 2024-09-12T12:27:41.762 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.34722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34722.log.gz 2024-09-12T12:27:41.762 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29077.log 2024-09-12T12:27:41.762 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T12:27:41.762 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.3.34824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34824.log.gz 2024-09-12T12:27:41.762 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29077.log: gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.29077.log.gz /var/log/ceph/ceph.log 2024-09-12T12:27:41.762 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-12T12:27:41.762 INFO:teuthology.orchestra.run.smithi165.stderr:gzip/var/log/ceph/ceph-mgr.x.log: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T12:27:41.763 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T12:27:41.763 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-12T12:27:41.764 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38376.log 2024-09-12T12:27:41.764 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58432.log.gz 2024-09-12T12:27:41.764 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52474.log 2024-09-12T12:27:41.765 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88040.log.gz 2024-09-12T12:27:41.765 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.38376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38376.log.gz 2024-09-12T12:27:41.765 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54376.log 2024-09-12T12:27:41.765 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78232.log 2024-09-12T12:27:41.765 INFO:teuthology.orchestra.run.smithi144.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.52474.log.gz 2024-09-12T12:27:41.765 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58060.log 2024-09-12T12:27:41.765 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54376.log.gz 2024-09-12T12:27:41.765 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52270.log 2024-09-12T12:27:41.766 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78232.log.gz 2024-09-12T12:27:41.766 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78545.log 2024-09-12T12:27:41.766 INFO:teuthology.orchestra.run.smithi144.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.58060.log.gz 2024-09-12T12:27:41.766 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75764.log 2024-09-12T12:27:41.766 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78545.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52270.log.gz 2024-09-12T12:27:41.767 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.d.log: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T12:27:41.767 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28981.log 2024-09-12T12:27:41.769 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56648.log 2024-09-12T12:27:41.769 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78545.log.gz 2024-09-12T12:27:41.769 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59943.log 2024-09-12T12:27:41.769 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75764.log.gz 2024-09-12T12:27:41.770 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87013.log 2024-09-12T12:27:41.770 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56648.log.gz 2024-09-12T12:27:41.770 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50963.log 2024-09-12T12:27:41.770 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59943.log.gz 2024-09-12T12:27:41.770 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78336.log 2024-09-12T12:27:41.770 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87013.log.gz 2024-09-12T12:27:41.770 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89900.log 2024-09-12T12:27:41.770 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50963.log.gz 2024-09-12T12:27:41.772 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28981.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28981.log.gz 2024-09-12T12:27:41.772 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28933.log 2024-09-12T12:27:41.772 INFO:teuthology.orchestra.run.smithi165.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T12:27:41.773 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-12T12:27:41.773 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28933.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28933.log.gz 2024-09-12T12:27:41.773 INFO:teuthology.orchestra.run.smithi165.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T12:27:41.774 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72682.log 2024-09-12T12:27:41.775 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78336.log.gz 2024-09-12T12:27:41.775 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84761.log 2024-09-12T12:27:41.775 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.89900.log.gz 2024-09-12T12:27:41.775 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75926.log 2024-09-12T12:27:41.775 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72682.log.gz 2024-09-12T12:27:41.775 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88558.log 2024-09-12T12:27:41.775 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84761.log.gz 2024-09-12T12:27:41.775 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51119.log 2024-09-12T12:27:41.776 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75926.log.gz 2024-09-12T12:27:41.776 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75074.log 2024-09-12T12:27:41.776 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88558.log.gz 2024-09-12T12:27:41.776 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75256.log 2024-09-12T12:27:41.776 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51119.log.gz 2024-09-12T12:27:41.777 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T12:27:41.777 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28957.log 2024-09-12T12:27:41.778 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.28957.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28957.log.gz 2024-09-12T12:27:41.778 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29053.log 2024-09-12T12:27:41.779 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38097.log 2024-09-12T12:27:41.779 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75074.log.gz 2024-09-12T12:27:41.780 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36661.log 2024-09-12T12:27:41.780 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75256.log.gz 2024-09-12T12:27:41.780 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88688.log 2024-09-12T12:27:41.780 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38097.log.gz 2024-09-12T12:27:41.780 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55691.log 2024-09-12T12:27:41.780 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88688.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36661.log.gz 2024-09-12T12:27:41.780 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58532.log 2024-09-12T12:27:41.781 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88688.log.gz 2024-09-12T12:27:41.781 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38067.log 2024-09-12T12:27:41.781 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55691.log.gz 2024-09-12T12:27:41.782 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56310.log 2024-09-12T12:27:41.782 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58532.log.gz 2024-09-12T12:27:41.782 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88085.log 2024-09-12T12:27:41.782 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38067.log.gz 2024-09-12T12:27:41.782 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53875.log 2024-09-12T12:27:41.783 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56310.log.gz 2024-09-12T12:27:41.784 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51475.log 2024-09-12T12:27:41.784 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88085.log.gz 2024-09-12T12:27:41.784 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75712.log 2024-09-12T12:27:41.784 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53875.log.gz 2024-09-12T12:27:41.785 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29053.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29053.log.gz 2024-09-12T12:27:41.785 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T12:27:41.786 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55542.log 2024-09-12T12:27:41.786 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51475.log.gz 2024-09-12T12:27:41.786 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58241.log 2024-09-12T12:27:41.786 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75712.log.gz 2024-09-12T12:27:41.786 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52120.log 2024-09-12T12:27:41.787 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29005.log 2024-09-12T12:27:41.787 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29029.log 2024-09-12T12:27:41.788 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55542.log.gz 2024-09-12T12:27:41.788 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78835.log 2024-09-12T12:27:41.789 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58241.log.gz 2024-09-12T12:27:41.789 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53700.log 2024-09-12T12:27:41.789 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78835.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52120.log.gz 2024-09-12T12:27:41.789 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T12:27:41.790 INFO:teuthology.orchestra.run.smithi165.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29005.log.gz 2024-09-12T12:27:41.791 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78835.log.gz 2024-09-12T12:27:41.791 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51710.log 2024-09-12T12:27:41.791 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53700.log.gz 2024-09-12T12:27:41.791 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57095.log 2024-09-12T12:27:41.791 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37648.log 2024-09-12T12:27:41.792 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51710.log.gz 2024-09-12T12:27:41.793 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52978.log 2024-09-12T12:27:41.793 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57095.log.gz 2024-09-12T12:27:41.793 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88111.log 2024-09-12T12:27:41.793 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37648.log.gz 2024-09-12T12:27:41.794 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57821.log 2024-09-12T12:27:41.794 INFO:teuthology.orchestra.run.smithi144.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52978.log.gz 2024-09-12T12:27:41.795 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37511.log 2024-09-12T12:27:41.795 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88111.log.gz 2024-09-12T12:27:41.795 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77246.log 2024-09-12T12:27:41.796 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57821.log.gz 2024-09-12T12:27:41.796 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88267.log 2024-09-12T12:27:41.797 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37511.log.gz 2024-09-12T12:27:41.797 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86776.log 2024-09-12T12:27:41.798 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29029.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29029.log.gz 2024-09-12T12:27:41.799 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88267.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.77246.log.gz 2024-09-12T12:27:41.799 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55984.log 2024-09-12T12:27:41.799 INFO:teuthology.orchestra.run.smithi144.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.88267.log.gz 2024-09-12T12:27:41.799 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90111.log 2024-09-12T12:27:41.800 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86776.log.gz 2024-09-12T12:27:41.800 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87068.log 2024-09-12T12:27:41.800 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55984.log.gz 2024-09-12T12:27:41.801 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.90111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73436.log 2024-09-12T12:27:41.801 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90111.log.gz 2024-09-12T12:27:41.802 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54244.log 2024-09-12T12:27:41.802 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87068.log.gz 2024-09-12T12:27:41.803 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73436.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73436.log.gz 2024-09-12T12:27:41.803 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54215.log 2024-09-12T12:27:41.804 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53483.log 2024-09-12T12:27:41.804 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54244.log.gz 2024-09-12T12:27:41.805 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81839.log 2024-09-12T12:27:41.805 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54215.log.gz 2024-09-12T12:27:41.805 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58766.log 2024-09-12T12:27:41.806 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81839.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53483.log.gz 2024-09-12T12:27:41.806 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87561.log 2024-09-12T12:27:41.807 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58766.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.81839.log.gz 2024-09-12T12:27:41.807 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54981.log 2024-09-12T12:27:41.807 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58766.log.gz 2024-09-12T12:27:41.808 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88241.log 2024-09-12T12:27:41.808 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87561.log.gz 2024-09-12T12:27:41.809 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53232.log 2024-09-12T12:27:41.809 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54981.log.gz 2024-09-12T12:27:41.810 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54712.log 2024-09-12T12:27:41.810 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88241.log.gz 2024-09-12T12:27:41.811 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57331.log 2024-09-12T12:27:41.811 INFO:teuthology.orchestra.run.smithi144.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.53232.log.gz 2024-09-12T12:27:41.812 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2024-09-12T12:27:41.812 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54712.log.gz 2024-09-12T12:27:41.812 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35749.log 2024-09-12T12:27:41.812 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57331.log.gz 2024-09-12T12:27:41.813 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84735.log 2024-09-12T12:27:41.813 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2024-09-12T12:27:41.814 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80410.log 2024-09-12T12:27:41.814 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35749.log.gz 2024-09-12T12:27:41.815 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86160.log 2024-09-12T12:27:41.815 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.84735.log.gz 2024-09-12T12:27:41.816 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90030.log 2024-09-12T12:27:41.816 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80410.log.gz 2024-09-12T12:27:41.817 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87691.log 2024-09-12T12:27:41.817 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.90030.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.86160.log.gz 2024-09-12T12:27:41.818 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86922.log 2024-09-12T12:27:41.818 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90030.log.gz 2024-09-12T12:27:41.818 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51301.log 2024-09-12T12:27:41.819 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.87691.log.gz 2024-09-12T12:27:41.819 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54858.log 2024-09-12T12:27:41.820 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86922.log.gz 2024-09-12T12:27:41.820 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36293.log 2024-09-12T12:27:41.820 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51301.log.gz 2024-09-12T12:27:41.821 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72578.log 2024-09-12T12:27:41.821 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54858.log.gz 2024-09-12T12:27:41.822 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59324.log 2024-09-12T12:27:41.822 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36293.log.gz 2024-09-12T12:27:41.823 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83361.log 2024-09-12T12:27:41.823 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.72578.log.gz 2024-09-12T12:27:41.824 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54610.log 2024-09-12T12:27:41.824 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59324.log.gz 2024-09-12T12:27:41.825 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56720.log 2024-09-12T12:27:41.825 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83361.log.gz 2024-09-12T12:27:41.826 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89640.log 2024-09-12T12:27:41.826 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54610.log.gz 2024-09-12T12:27:41.826 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90056.log 2024-09-12T12:27:41.827 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56720.log.gz 2024-09-12T12:27:41.827 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89486.log 2024-09-12T12:27:41.828 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89640.log.gz 2024-09-12T12:27:41.828 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.90056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50866.log 2024-09-12T12:27:41.828 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90056.log.gz 2024-09-12T12:27:41.829 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89692.log 2024-09-12T12:27:41.829 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89486.log.gz 2024-09-12T12:27:41.830 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72885.log 2024-09-12T12:27:41.830 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50866.log.gz 2024-09-12T12:27:41.831 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89460.log 2024-09-12T12:27:41.831 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89692.log.gz 2024-09-12T12:27:41.832 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58288.log 2024-09-12T12:27:41.832 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72885.log.gz 2024-09-12T12:27:41.833 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54350.log 2024-09-12T12:27:41.833 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89460.log.gz 2024-09-12T12:27:41.833 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.58288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58288.log.gz 2024-09-12T12:27:41.834 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78627.log 2024-09-12T12:27:41.834 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54350.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T12:27:41.835 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54350.log.gz 2024-09-12T12:27:41.835 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55289.log 2024-09-12T12:27:41.835 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78627.log.gz 2024-09-12T12:27:41.836 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59402.log 2024-09-12T12:27:41.837 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57142.log 2024-09-12T12:27:41.837 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55289.log.gz 2024-09-12T12:27:41.838 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54979.log 2024-09-12T12:27:41.838 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59402.log.gz 2024-09-12T12:27:41.839 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.57142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57142.log.gz 2024-09-12T12:27:41.839 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55490.log 2024-09-12T12:27:41.840 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59019.log 2024-09-12T12:27:41.840 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54979.log.gz 2024-09-12T12:27:41.841 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55951.log 2024-09-12T12:27:41.841 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55490.log.gz 2024-09-12T12:27:41.842 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87371.log 2024-09-12T12:27:41.842 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59019.log.gz 2024-09-12T12:27:41.843 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35196.log 2024-09-12T12:27:41.843 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55951.log.gz 2024-09-12T12:27:41.843 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81889.log 2024-09-12T12:27:41.844 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87371.log.gz 2024-09-12T12:27:41.844 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87039.log 2024-09-12T12:27:41.844 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35196.log.gz 2024-09-12T12:27:41.845 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54298.log 2024-09-12T12:27:41.845 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81889.log.gz 2024-09-12T12:27:41.846 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53804.log 2024-09-12T12:27:41.846 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87039.log.gz 2024-09-12T12:27:41.847 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37978.log 2024-09-12T12:27:41.847 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54298.log.gz 2024-09-12T12:27:41.848 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81787.log 2024-09-12T12:27:41.848 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53804.log.gz 2024-09-12T12:27:41.848 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81249.log 2024-09-12T12:27:41.849 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37978.log.gz 2024-09-12T12:27:41.849 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73384.log 2024-09-12T12:27:41.850 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81787.log.gz 2024-09-12T12:27:41.850 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72963.log 2024-09-12T12:27:41.850 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81249.log.gz 2024-09-12T12:27:41.851 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51501.log 2024-09-12T12:27:41.851 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73384.log.gz 2024-09-12T12:27:41.852 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60196.log 2024-09-12T12:27:41.852 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72963.log.gz 2024-09-12T12:27:41.853 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81171.log 2024-09-12T12:27:41.853 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51501.log.gz 2024-09-12T12:27:41.854 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.60196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60196.log.gz 2024-09-12T12:27:41.854 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88610.log 2024-09-12T12:27:41.855 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80614.log 2024-09-12T12:27:41.855 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81171.log.gz 2024-09-12T12:27:41.856 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88610.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.77953.log -- replaced with /var/log/ceph/ceph-client.admin.88610.log.gz 2024-09-12T12:27:41.856 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-12T12:27:41.857 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51527.log 2024-09-12T12:27:41.857 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.80614.log.gz 2024-09-12T12:27:41.858 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36286.log 2024-09-12T12:27:41.858 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77953.log.gz 2024-09-12T12:27:41.859 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81145.log 2024-09-12T12:27:41.859 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51527.log.gz 2024-09-12T12:27:41.860 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38201.log 2024-09-12T12:27:41.860 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36286.log.gz 2024-09-12T12:27:41.861 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80206.log 2024-09-12T12:27:41.861 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81145.log.gz 2024-09-12T12:27:41.862 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36555.log 2024-09-12T12:27:41.862 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38201.log.gz 2024-09-12T12:27:41.863 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59298.log 2024-09-12T12:27:41.863 INFO:teuthology.orchestra.run.smithi144.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.80206.log.gz 2024-09-12T12:27:41.863 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36555.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36555.log.gzgzip 2024-09-12T12:27:41.863 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.84813.log 2024-09-12T12:27:41.864 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55464.log 2024-09-12T12:27:41.864 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59298.log.gz 2024-09-12T12:27:41.865 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78284.log 2024-09-12T12:27:41.865 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55464.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.84813.log.gz 2024-09-12T12:27:41.866 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55464.log.gz 2024-09-12T12:27:41.866 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86854.log 2024-09-12T12:27:41.867 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84065.log 2024-09-12T12:27:41.867 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78284.log.gz 2024-09-12T12:27:41.868 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56414.log 2024-09-12T12:27:41.868 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86854.log.gz 2024-09-12T12:27:41.869 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57383.log 2024-09-12T12:27:41.869 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84065.log.gz 2024-09-12T12:27:41.870 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56016.log 2024-09-12T12:27:41.870 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56414.log.gz 2024-09-12T12:27:41.871 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51449.log 2024-09-12T12:27:41.871 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57383.log.gz 2024-09-12T12:27:41.871 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50840.log 2024-09-12T12:27:41.872 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56016.log.gz 2024-09-12T12:27:41.872 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81683.log 2024-09-12T12:27:41.873 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51449.log.gz 2024-09-12T12:27:41.873 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34192.log 2024-09-12T12:27:41.873 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50840.log.gz 2024-09-12T12:27:41.874 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73585.log 2024-09-12T12:27:41.874 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.81683.log.gz 2024-09-12T12:27:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.34192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54007.log 2024-09-12T12:27:41.875 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34192.log.gz 2024-09-12T12:27:41.876 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.73585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73585.log.gz 2024-09-12T12:27:41.876 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88532.log 2024-09-12T12:27:41.877 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83209.log 2024-09-12T12:27:41.877 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54007.log.gz 2024-09-12T12:27:41.878 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81483.log 2024-09-12T12:27:41.878 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88532.log.gz 2024-09-12T12:27:41.878 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58139.log 2024-09-12T12:27:41.879 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81483.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.83209.log.gz 2024-09-12T12:27:41.880 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.81483.log.gz 2024-09-12T12:27:41.880 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75386.log 2024-09-12T12:27:41.880 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78519.log 2024-09-12T12:27:41.881 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58139.log.gz 2024-09-12T12:27:41.881 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35866.log 2024-09-12T12:27:41.881 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75386.log.gz 2024-09-12T12:27:41.882 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80664.log 2024-09-12T12:27:41.883 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78519.log.gz 2024-09-12T12:27:41.883 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53185.log 2024-09-12T12:27:41.883 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35866.log.gz 2024-09-12T12:27:41.884 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56082.log 2024-09-12T12:27:41.884 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.80664.log.gz 2024-09-12T12:27:41.885 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75204.log 2024-09-12T12:27:41.885 INFO:teuthology.orchestra.run.smithi144.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53185.log.gz 2024-09-12T12:27:41.886 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55345.log 2024-09-12T12:27:41.886 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56082.log.gz 2024-09-12T12:27:41.887 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81627.log 2024-09-12T12:27:41.887 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75204.log.gz 2024-09-12T12:27:41.888 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78861.log 2024-09-12T12:27:41.888 INFO:teuthology.orchestra.run.smithi144.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55345.log.gz 2024-09-12T12:27:41.889 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81627.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81627.log.gz 2024-09-12T12:27:41.889 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75126.log 2024-09-12T12:27:41.890 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86082.log 2024-09-12T12:27:41.890 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78861.log.gz 2024-09-12T12:27:41.891 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53849.log 2024-09-12T12:27:41.891 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75126.log.gz 2024-09-12T12:27:41.891 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86082.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.86082.log.gz 2024-09-12T12:27:41.891 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37818.log 2024-09-12T12:27:41.892 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84300.log 2024-09-12T12:27:41.892 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53849.log.gz 2024-09-12T12:27:41.893 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36089.log 2024-09-12T12:27:41.893 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37818.log.gz 2024-09-12T12:27:41.894 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86210.log 2024-09-12T12:27:41.894 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.84300.log.gz 2024-09-12T12:27:41.895 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87319.log 2024-09-12T12:27:41.895 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36089.log.gz 2024-09-12T12:27:41.896 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35248.log 2024-09-12T12:27:41.896 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.86210.log.gz 2024-09-12T12:27:41.897 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89978.log 2024-09-12T12:27:41.897 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.87319.log.gz 2024-09-12T12:27:41.898 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38149.log 2024-09-12T12:27:41.898 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35248.log.gz 2024-09-12T12:27:41.899 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75503.log 2024-09-12T12:27:41.899 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89978.log.gz 2024-09-12T12:27:41.900 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73028.log 2024-09-12T12:27:41.900 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38149.log.gz 2024-09-12T12:27:41.901 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83812.log 2024-09-12T12:27:41.901 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.75503.log.gz 2024-09-12T12:27:41.902 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59612.log 2024-09-12T12:27:41.902 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73028.log.gz 2024-09-12T12:27:41.902 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37739.log 2024-09-12T12:27:41.903 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83812.log.gz 2024-09-12T12:27:41.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59612.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59612.log.gzgzip 2024-09-12T12:27:41.904 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55743.log 2024-09-12T12:27:41.904 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77500.log 2024-09-12T12:27:41.905 INFO:teuthology.orchestra.run.smithi144.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37739.log.gz 2024-09-12T12:27:41.905 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56362.log 2024-09-12T12:27:41.906 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55743.log.gz 2024-09-12T12:27:41.906 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73462.log 2024-09-12T12:27:41.907 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77500.log.gz 2024-09-12T12:27:41.907 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58086.log 2024-09-12T12:27:41.907 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56362.log.gz 2024-09-12T12:27:41.908 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57698.log 2024-09-12T12:27:41.908 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73462.log.gz 2024-09-12T12:27:41.909 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57638.log 2024-09-12T12:27:41.909 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58086.log.gz 2024-09-12T12:27:41.910 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35671.log 2024-09-12T12:27:41.910 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57698.log.gz 2024-09-12T12:27:41.911 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51067.log 2024-09-12T12:27:41.911 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57638.log.gz 2024-09-12T12:27:41.912 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59730.log 2024-09-12T12:27:41.912 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35671.log.gz 2024-09-12T12:27:41.913 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53533.log 2024-09-12T12:27:41.913 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51067.log.gz 2024-09-12T12:27:41.914 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84408.log 2024-09-12T12:27:41.914 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59730.log.gz 2024-09-12T12:27:41.914 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53622.log 2024-09-12T12:27:41.915 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.53533.log.gz 2024-09-12T12:27:41.915 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84408.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.84408.log.gz 2024-09-12T12:27:41.916 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T12:27:41.916 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51419.log 2024-09-12T12:27:41.917 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53622.log.gz 2024-09-12T12:27:41.917 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72708.log 2024-09-12T12:27:41.918 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86497.log 2024-09-12T12:27:41.919 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51419.log.gz 2024-09-12T12:27:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56108.log 2024-09-12T12:27:41.920 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72708.log.gz 2024-09-12T12:27:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.86497.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59149.log 2024-09-12T12:27:41.921 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86497.log.gz 2024-09-12T12:27:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87494.log 2024-09-12T12:27:41.922 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56108.log.gz 2024-09-12T12:27:41.923 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52699.log 2024-09-12T12:27:41.923 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59149.log.gz 2024-09-12T12:27:41.923 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.0.87494.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54558.log 2024-09-12T12:27:41.924 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.87494.log.gz 2024-09-12T12:27:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83760.log 2024-09-12T12:27:41.925 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52699.log.gz 2024-09-12T12:27:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35876.log 2024-09-12T12:27:41.926 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54558.log.gz 2024-09-12T12:27:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87910.log 2024-09-12T12:27:41.927 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83760.log.gz 2024-09-12T12:27:41.928 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80989.log 2024-09-12T12:27:41.928 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35876.log.gz 2024-09-12T12:27:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54662.log 2024-09-12T12:27:41.929 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87910.log.gz 2024-09-12T12:27:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57506.log 2024-09-12T12:27:41.930 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80989.log.gz 2024-09-12T12:27:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58690.log 2024-09-12T12:27:41.931 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54662.log.gz 2024-09-12T12:27:41.932 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89159.log 2024-09-12T12:27:41.932 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57506.log.gz 2024-09-12T12:27:41.933 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56388.log 2024-09-12T12:27:41.934 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89159.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58690.log.gz 2024-09-12T12:27:41.934 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34928.log 2024-09-12T12:27:41.935 INFO:teuthology.orchestra.run.smithi144.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.89159.log.gz 2024-09-12T12:27:41.935 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54272.log 2024-09-12T12:27:41.935 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56388.log.gz 2024-09-12T12:27:41.936 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.34928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86750.log 2024-09-12T12:27:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54272.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34928.log.gz 2024-09-12T12:27:41.937 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59812.log 2024-09-12T12:27:41.937 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54272.log.gz 2024-09-12T12:27:41.938 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89030.log 2024-09-12T12:27:41.938 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86750.log.gz 2024-09-12T12:27:41.939 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52649.log 2024-09-12T12:27:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59812.log: /var/log/ceph/ceph-client.admin.89030.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59812.log.gz 2024-09-12T12:27:41.940 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80792.log 2024-09-12T12:27:41.941 INFO:teuthology.orchestra.run.smithi144.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.89030.log.gz 2024-09-12T12:27:41.941 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89192.log 2024-09-12T12:27:41.942 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80792.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52649.log.gz 2024-09-12T12:27:41.943 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83335.log 2024-09-12T12:27:41.944 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89192.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.80792.log.gz 2024-09-12T12:27:41.944 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T12:27:41.944 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89192.log.gz 2024-09-12T12:27:41.944 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58930.log 2024-09-12T12:27:41.945 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54776.log 2024-09-12T12:27:41.945 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83335.log.gz 2024-09-12T12:27:41.946 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84117.log 2024-09-12T12:27:41.946 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58930.log.gz 2024-09-12T12:27:41.947 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54776.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54776.log.gz 2024-09-12T12:27:41.947 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80512.log 2024-09-12T12:27:41.947 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89614.log 2024-09-12T12:27:41.948 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84117.log.gz 2024-09-12T12:27:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50892.log 2024-09-12T12:27:41.949 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.80512.log.gz 2024-09-12T12:27:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89614.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.89614.log.gz 2024-09-12T12:27:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56165.log 2024-09-12T12:27:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75412.log 2024-09-12T12:27:41.951 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50892.log.gz 2024-09-12T12:27:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56254.log 2024-09-12T12:27:41.952 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56165.log.gz 2024-09-12T12:27:41.952 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51970.log 2024-09-12T12:27:41.952 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75412.log.gz 2024-09-12T12:27:41.953 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84443.log 2024-09-12T12:27:41.953 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56254.log.gz 2024-09-12T12:27:41.954 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81457.log 2024-09-12T12:27:41.954 INFO:teuthology.orchestra.run.smithi144.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51970.log.gz 2024-09-12T12:27:41.955 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77656.log 2024-09-12T12:27:41.955 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84443.log.gz 2024-09-12T12:27:41.956 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55873.log 2024-09-12T12:27:41.956 INFO:teuthology.orchestra.run.smithi144.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.81457.log.gz 2024-09-12T12:27:41.957 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80156.log 2024-09-12T12:27:41.957 INFO:teuthology.orchestra.run.smithi144.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.77656.log.gz 2024-09-12T12:27:41.958 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52020.log 2024-09-12T12:27:41.958 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55873.log.gz 2024-09-12T12:27:41.959 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80156.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T12:27:41.959 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.80156.log.gz 2024-09-12T12:27:41.960 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84683.log 2024-09-12T12:27:41.960 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52020.log.gz 2024-09-12T12:27:41.961 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88332.log 2024-09-12T12:27:41.962 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.84683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77422.log 2024-09-12T12:27:41.962 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84683.log.gz 2024-09-12T12:27:41.963 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38253.log 2024-09-12T12:27:41.963 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88332.log.gz 2024-09-12T12:27:41.964 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57930.log 2024-09-12T12:27:41.964 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77422.log.gz 2024-09-12T12:27:41.965 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88397.log 2024-09-12T12:27:41.965 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38253.log.gz 2024-09-12T12:27:41.966 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55847.log 2024-09-12T12:27:41.966 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57930.log.gz 2024-09-12T12:27:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59194.log 2024-09-12T12:27:41.967 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88397.log: /var/log/ceph/ceph-client.admin.55847.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88397.log.gz 2024-09-12T12:27:41.968 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75048.log 2024-09-12T12:27:41.968 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55847.log.gz 2024-09-12T12:27:41.969 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37844.log 2024-09-12T12:27:41.969 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59194.log.gz 2024-09-12T12:27:41.970 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73146.log 2024-09-12T12:27:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75048.log: /var/log/ceph/ceph-client.admin.37844.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75048.log.gz 2024-09-12T12:27:41.971 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80306.log 2024-09-12T12:27:41.971 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37844.log.gz 2024-09-12T12:27:41.972 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75334.log 2024-09-12T12:27:41.972 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73146.log.gz 2024-09-12T12:27:41.973 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83643.log 2024-09-12T12:27:41.974 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80306.log.gz 2024-09-12T12:27:41.974 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87096.log 2024-09-12T12:27:41.975 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75334.log.gz 2024-09-12T12:27:41.975 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83643.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83643.log.gzgzip 2024-09-12T12:27:41.976 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59350.log 2024-09-12T12:27:41.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84202.log 2024-09-12T12:27:41.977 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87096.log.gz 2024-09-12T12:27:41.978 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53357.log 2024-09-12T12:27:41.978 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59350.log.gz 2024-09-12T12:27:41.979 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37950.log 2024-09-12T12:27:41.979 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84202.log.gz 2024-09-12T12:27:41.980 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37563.log 2024-09-12T12:27:41.981 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37950.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37950.log.gz 2024-09-12T12:27:41.981 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53357.log.gz 2024-09-12T12:27:41.981 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89796.log 2024-09-12T12:27:41.982 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80462.log 2024-09-12T12:27:41.982 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37563.log: 89.3%/var/log/ceph/ceph-client.admin.89796.log: -- replaced with /var/log/ceph/ceph-client.admin.37563.log.gz 2024-09-12T12:27:41.983 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37355.log 2024-09-12T12:27:41.983 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89796.log.gz 2024-09-12T12:27:41.984 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72996.log 2024-09-12T12:27:41.985 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37355.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.80462.log.gz 2024-09-12T12:27:41.985 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87185.log 2024-09-12T12:27:41.985 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37355.log.gz 2024-09-12T12:27:41.986 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37537.log 2024-09-12T12:27:41.986 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72996.log.gz 2024-09-12T12:27:41.987 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56810.log 2024-09-12T12:27:41.987 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.87185.log.gz 2024-09-12T12:27:41.988 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88478.log 2024-09-12T12:27:41.988 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37537.log.gz 2024-09-12T12:27:41.989 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.56810.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-09-12T12:27:41.989 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88478.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56810.log.gz 2024-09-12T12:27:41.990 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88740.log 2024-09-12T12:27:41.990 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88478.log.gz 2024-09-12T12:27:41.991 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36074.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-09-12T12:27:41.991 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60099.log 2024-09-12T12:27:41.992 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81275.log 2024-09-12T12:27:41.993 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88740.log.gz 2024-09-12T12:27:41.993 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58898.log 2024-09-12T12:27:41.994 INFO:teuthology.orchestra.run.smithi144.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60099.log.gz 2024-09-12T12:27:41.995 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36086.log 2024-09-12T12:27:41.995 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81275.log.gz 2024-09-12T12:27:41.996 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59487.log 2024-09-12T12:27:41.996 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58898.log.gz 2024-09-12T12:27:41.997 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36086.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36086.log.gz 2024-09-12T12:27:41.997 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58664.log 2024-09-12T12:27:41.998 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.59487.log: /var/log/ceph/ceph-client.admin.81197.log 2024-09-12T12:27:41.998 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59487.log.gz 2024-09-12T12:27:41.999 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51921.log 2024-09-12T12:27:41.999 INFO:teuthology.orchestra.run.smithi144.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.58664.log.gz 2024-09-12T12:27:42.000 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81761.log 2024-09-12T12:27:42.000 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81197.log.gz 2024-09-12T12:27:42.001 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51762.log 2024-09-12T12:27:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81761.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51921.log.gz 2024-09-12T12:27:42.002 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83576.log 2024-09-12T12:27:42.002 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81761.log.gz 2024-09-12T12:27:42.003 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51041.log 2024-09-12T12:27:42.003 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51762.log.gz 2024-09-12T12:27:42.004 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88932.log 2024-09-12T12:27:42.004 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83576.log.gz 2024-09-12T12:27:42.005 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53752.log 2024-09-12T12:27:42.005 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51041.log.gz 2024-09-12T12:27:42.006 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83987.log 2024-09-12T12:27:42.006 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88932.log.gz 2024-09-12T12:27:42.007 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38329.log 2024-09-12T12:27:42.007 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53752.log.gz 2024-09-12T12:27:42.008 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86357.log 2024-09-12T12:27:42.008 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83987.log.gz 2024-09-12T12:27:42.009 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53133.log 2024-09-12T12:27:42.010 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38329.log.gz 2024-09-12T12:27:42.011 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51788.log 2024-09-12T12:27:42.011 INFO:teuthology.orchestra.run.smithi144.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.86357.log.gz 2024-09-12T12:27:42.012 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83890.log 2024-09-12T12:27:42.013 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51788.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53133.log.gz 2024-09-12T12:27:42.013 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35118.log 2024-09-12T12:27:42.013 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.51788.log.gz 2024-09-12T12:27:42.014 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88506.log 2024-09-12T12:27:42.014 INFO:teuthology.orchestra.run.smithi144.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.83890.log.gz 2024-09-12T12:27:42.015 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87962.log 2024-09-12T12:27:42.015 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35118.log.gz 2024-09-12T12:27:42.016 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84605.log 2024-09-12T12:27:42.016 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88506.log.gz 2024-09-12T12:27:42.017 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57019.log 89.1% 2024-09-12T12:27:42.017 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87962.log.gz 2024-09-12T12:27:42.018 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77836.log 2024-09-12T12:27:42.019 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84605.log.gz 2024-09-12T12:27:42.019 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87884.log 2024-09-12T12:27:42.020 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57019.log.gz 2024-09-12T12:27:42.020 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78653.log 2024-09-12T12:27:42.021 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77836.log.gz 2024-09-12T12:27:42.021 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89406.log 2024-09-12T12:27:42.022 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.87884.log.gz 2024-09-12T12:27:42.023 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59782.log 2024-09-12T12:27:42.023 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78653.log.gz 2024-09-12T12:27:42.024 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36088.log 89.7% 2024-09-12T12:27:42.024 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89406.log.gz 2024-09-12T12:27:42.024 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75438.log 2024-09-12T12:27:42.025 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59782.log.gz 2024-09-12T12:27:42.026 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81301.log 2024-09-12T12:27:42.026 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36088.log.gz 2024-09-12T12:27:42.027 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75308.log 2024-09-12T12:27:42.027 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75438.log.gz 2024-09-12T12:27:42.028 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84039.log 2024-09-12T12:27:42.028 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81301.log.gz 2024-09-12T12:27:42.029 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53927.log 2024-09-12T12:27:42.029 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75308.log.gz 2024-09-12T12:27:42.030 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81979.log 2024-09-12T12:27:42.030 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84039.log.gz 2024-09-12T12:27:42.031 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.53927.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.78679.log 2024-09-12T12:27:42.031 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81979.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53927.log.gz 2024-09-12T12:27:42.032 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60021.log 2024-09-12T12:27:42.032 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81979.log.gz 2024-09-12T12:27:42.033 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78679.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.78679.log.gz 2024-09-12T12:27:42.033 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72833.log 2024-09-12T12:27:42.034 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73093.log 2024-09-12T12:27:42.035 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60021.log.gz 2024-09-12T12:27:42.035 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75016.log 2024-09-12T12:27:42.036 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72833.log.gz 2024-09-12T12:27:42.036 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73093.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73093.log.gz 2024-09-12T12:27:42.037 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86575.log 2024-09-12T12:27:42.037 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5/var/log/ceph/ceph-client.admin.75016.log: --verbose -- /var/log/ceph/ceph-client.admin.35723.log 2024-09-12T12:27:42.038 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86575.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75016.log.gz 2024-09-12T12:27:42.039 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53028.log 2024-09-12T12:27:42.039 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86575.log.gz 2024-09-12T12:27:42.040 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83864.log 2024-09-12T12:27:42.040 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35723.log.gz 2024-09-12T12:27:42.040 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88163.log 2024-09-12T12:27:42.042 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83864.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53028.log.gz 2024-09-12T12:27:42.042 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59756.log 2024-09-12T12:27:42.042 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83864.log.gz 2024-09-12T12:27:42.043 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37589.log 2024-09-12T12:27:42.043 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88163.log.gz 2024-09-12T12:27:42.044 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55111.log 2024-09-12T12:27:42.044 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59756.log.gz 2024-09-12T12:27:42.045 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84910.log 2024-09-12T12:27:42.045 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37589.log.gz 2024-09-12T12:27:42.046 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78083.log 2024-09-12T12:27:42.046 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55111.log.gz 2024-09-12T12:27:42.047 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.84910.log: -- /var/log/ceph/ceph-client.admin.78783.log 2024-09-12T12:27:42.047 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.84910.log.gz 2024-09-12T12:27:42.048 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35324.log 2024-09-12T12:27:42.048 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78083.log.gz 2024-09-12T12:27:42.049 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57584.log 2024-09-12T12:27:42.049 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78783.log.gz 2024-09-12T12:27:42.050 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75594.log 2024-09-12T12:27:42.051 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57584.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35324.log.gz 2024-09-12T12:27:42.051 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57584.log.gz 2024-09-12T12:27:42.051 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76028.log 2024-09-12T12:27:42.052 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51579.log 2024-09-12T12:27:42.053 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75594.log.gz 2024-09-12T12:27:42.054 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50597.log 2024-09-12T12:27:42.054 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76028.log.gz 2024-09-12T12:27:42.054 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.51579.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58008.log 2024-09-12T12:27:42.055 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50597.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51579.log.gz 2024-09-12T12:27:42.056 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36064.log 2024-09-12T12:27:42.056 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50597.log.gz 2024-09-12T12:27:42.057 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54802.log 2024-09-12T12:27:42.057 INFO:teuthology.orchestra.run.smithi144.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.58008.log.gz 2024-09-12T12:27:42.058 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76075.log 2024-09-12T12:27:42.058 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36064.log.gz 2024-09-12T12:27:42.059 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54802.log: gzip -5 --verbose 88.1% -- -- replaced with /var/log/ceph/ceph-client.admin.54802.log.gz /var/log/ceph/ceph-client.admin.36283.log 2024-09-12T12:27:42.059 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-12T12:27:42.060 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.76075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50704.log 2024-09-12T12:27:42.060 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76075.log.gz 2024-09-12T12:27:42.061 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78031.log 2024-09-12T12:27:42.062 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36283.log.gz 2024-09-12T12:27:42.063 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35865.log 2024-09-12T12:27:42.063 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50704.log.gz 2024-09-12T12:27:42.063 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90004.log 2024-09-12T12:27:42.064 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78031.log.gz 2024-09-12T12:27:42.065 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35274.log 2024-09-12T12:27:42.065 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35865.log.gz 2024-09-12T12:27:42.066 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.90004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80740.log 2024-09-12T12:27:42.066 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90004.log.gz 2024-09-12T12:27:42.067 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80562.log 2024-09-12T12:27:42.068 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80740.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35274.log.gz 2024-09-12T12:27:42.068 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86549.log 2024-09-12T12:27:42.068 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80740.log.gz 2024-09-12T12:27:42.069 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80562.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.80562.log.gz -- 2024-09-12T12:27:42.069 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-client.admin.59917.log 2024-09-12T12:27:42.070 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.86549.log: -- /var/log/ceph/ceph-client.admin.87241.log 2024-09-12T12:27:42.070 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59917.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86549.log.gz 2024-09-12T12:27:42.071 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88889.log 2024-09-12T12:27:42.071 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59917.log.gz 2024-09-12T12:27:42.072 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58113.log 2024-09-12T12:27:42.072 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87241.log.gz 2024-09-12T12:27:42.073 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.88889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73538.log 2024-09-12T12:27:42.073 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.88889.log.gz 2024-09-12T12:27:42.074 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56137.log 2024-09-12T12:27:42.074 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58113.log.gz 2024-09-12T12:27:42.075 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38393.log 2024-09-12T12:27:42.076 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73538.log.gz 2024-09-12T12:27:42.077 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2024-09-12T12:27:42.077 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56137.log.gz 2024-09-12T12:27:42.077 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51736.log 2024-09-12T12:27:42.078 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38393.log.gz 2024-09-12T12:27:42.079 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57279.log 2024-09-12T12:27:42.079 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2024-09-12T12:27:42.080 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51736.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T12:27:42.080 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51736.log.gz 2024-09-12T12:27:42.081 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53979.log 2024-09-12T12:27:42.081 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57279.log.gz 2024-09-12T12:27:42.082 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72911.log 2024-09-12T12:27:42.083 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37075.log 2024-09-12T12:27:42.084 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53979.log: /var/log/ceph/ceph-client.admin.72911.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53979.log.gz 2024-09-12T12:27:42.084 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84380.log 2024-09-12T12:27:42.085 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72911.log.gz 2024-09-12T12:27:42.085 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77784.log 2024-09-12T12:27:42.086 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37075.log.gz 2024-09-12T12:27:42.087 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34902.log 2024-09-12T12:27:42.087 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84380.log.gz 2024-09-12T12:27:42.087 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59045.log 2024-09-12T12:27:42.088 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77784.log.gz 2024-09-12T12:27:42.089 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.34902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35645.log 2024-09-12T12:27:42.089 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34902.log.gz 2024-09-12T12:27:42.090 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55315.log 2024-09-12T12:27:42.090 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59045.log.gz 2024-09-12T12:27:42.091 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83669.log 2024-09-12T12:27:42.091 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35645.log.gz 2024-09-12T12:27:42.092 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54828.log 2024-09-12T12:27:42.092 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55315.log.gz 2024-09-12T12:27:42.094 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75471.log 2024-09-12T12:27:42.094 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83669.log.gz 2024-09-12T12:27:42.095 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88423.log 2024-09-12T12:27:42.095 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54828.log.gz 2024-09-12T12:27:42.095 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83942.log 2024-09-12T12:27:42.096 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75471.log.gz 2024-09-12T12:27:42.097 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59666.log 2024-09-12T12:27:42.097 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88423.log.gz 2024-09-12T12:27:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83522.log 2024-09-12T12:27:42.099 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83942.log.gz 2024-09-12T12:27:42.099 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57409.log 2024-09-12T12:27:42.099 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59666.log.gz 2024-09-12T12:27:42.100 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29020.log 2024-09-12T12:27:42.101 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83522.log.gz 2024-09-12T12:27:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36087.log 2024-09-12T12:27:42.102 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57409.log.gz 2024-09-12T12:27:42.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.29020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56440.log 2024-09-12T12:27:42.103 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29020.log.gz 2024-09-12T12:27:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50918.log 2024-09-12T12:27:42.104 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36087.log.gz 2024-09-12T12:27:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72520.log 2024-09-12T12:27:42.105 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56440.log.gz 2024-09-12T12:27:42.106 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77526.log 2024-09-12T12:27:42.107 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50918.log.gz 2024-09-12T12:27:42.107 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84709.log 2024-09-12T12:27:42.108 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72520.log.gz 2024-09-12T12:27:42.108 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77979.log 2024-09-12T12:27:42.109 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77526.log.gz 2024-09-12T12:27:42.110 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36843.log 2024-09-12T12:27:42.110 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84709.log.gz 2024-09-12T12:27:42.110 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78109.log 2024-09-12T12:27:42.111 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77979.log.gz 2024-09-12T12:27:42.111 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.36843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86445.log 0.0% 2024-09-12T12:27:42.112 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.0.36843.log.gz 2024-09-12T12:27:42.113 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54980.log 2024-09-12T12:27:42.113 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78109.log.gz 2024-09-12T12:27:42.114 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38279.log 2024-09-12T12:27:42.114 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86445.log.gz 2024-09-12T12:27:42.115 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74857.log 2024-09-12T12:27:42.115 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54980.log.gz 2024-09-12T12:27:42.116 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77921.log 2024-09-12T12:27:42.117 INFO:teuthology.orchestra.run.smithi144.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.38279.log.gz 2024-09-12T12:27:42.117 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77732.log 2024-09-12T12:27:42.118 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77921.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.74857.log.gz 2024-09-12T12:27:42.119 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57730.log 2024-09-12T12:27:42.119 INFO:teuthology.orchestra.run.smithi144.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.77921.log.gz 2024-09-12T12:27:42.120 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88980.log 2024-09-12T12:27:42.120 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77732.log.gz 2024-09-12T12:27:42.120 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36503.log 2024-09-12T12:27:42.121 INFO:teuthology.orchestra.run.smithi144.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.57730.log.gz 2024-09-12T12:27:42.122 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77810.log 2024-09-12T12:27:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36503.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.88980.log.gz 2024-09-12T12:27:42.123 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78005.log 2024-09-12T12:27:42.123 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36503.log.gz 2024-09-12T12:27:42.124 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84527.log 2024-09-12T12:27:42.124 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77810.log.gz 2024-09-12T12:27:42.125 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83786.log 2024-09-12T12:27:42.125 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78005.log.gz 2024-09-12T12:27:42.126 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84787.log 2024-09-12T12:27:42.127 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84527.log.gz 2024-09-12T12:27:42.127 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58429.log 2024-09-12T12:27:42.128 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.83786.log.gz 2024-09-12T12:27:42.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53590.log 2024-09-12T12:27:42.129 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.84787.log.gz 2024-09-12T12:27:42.130 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81119.log 2024-09-12T12:27:42.130 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58429.log.gz 2024-09-12T12:27:42.131 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88584.log 2024-09-12T12:27:42.131 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53590.log.gz 2024-09-12T12:27:42.132 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57532.log 2024-09-12T12:27:42.132 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81119.log.gz 2024-09-12T12:27:42.133 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77606.log 2024-09-12T12:27:42.133 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88584.log.gz 2024-09-12T12:27:42.134 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58634.log 2024-09-12T12:27:42.134 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57532.log.gz 2024-09-12T12:27:42.135 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84091.log 2024-09-12T12:27:42.136 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58634.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.77606.log.gz 2024-09-12T12:27:42.137 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74907.log 2024-09-12T12:27:42.137 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58634.log.gz 2024-09-12T12:27:42.138 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37299.log 2024-09-12T12:27:42.138 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84091.log.gz 2024-09-12T12:27:42.139 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50814.log 2024-09-12T12:27:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37299.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.74907.log.gz 2024-09-12T12:27:42.140 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78057.log 2024-09-12T12:27:42.140 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37299.log.gz 2024-09-12T12:27:42.141 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50814.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T12:27:42.141 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50814.log.gz 2024-09-12T12:27:42.142 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37023.log 2024-09-12T12:27:42.143 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78057.log.gz 2024-09-12T12:27:42.143 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78573.log 2024-09-12T12:27:42.145 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73410.log 2024-09-12T12:27:42.145 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37023.log.gz 2024-09-12T12:27:42.146 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51015.log 2024-09-12T12:27:42.146 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78573.log.gz 2024-09-12T12:27:42.147 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73410.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73410.log.gz 2024-09-12T12:27:42.148 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86627.log 2024-09-12T12:27:42.148 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51015.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51015.log.gz 2024-09-12T12:27:42.149 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74983.log 2024-09-12T12:27:42.150 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59376.log 2024-09-12T12:27:42.150 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86627.log.gz 2024-09-12T12:27:42.151 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51658.log 2024-09-12T12:27:42.152 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74983.log.gz 2024-09-12T12:27:42.153 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59246.log 2024-09-12T12:27:42.153 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.59376.log.gz 2024-09-12T12:27:42.154 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52427.log 2024-09-12T12:27:42.154 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51658.log.gz 2024-09-12T12:27:42.155 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88300.log 2024-09-12T12:27:42.155 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59246.log.gz 2024-09-12T12:27:42.156 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37127.log 2024-09-12T12:27:42.157 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2%/var/log/ceph/ceph-client.admin.88300.log: -- replaced with /var/log/ceph/ceph-client.admin.52427.log.gz 2024-09-12T12:27:42.158 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37205.log 2024-09-12T12:27:42.158 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88300.log.gz 2024-09-12T12:27:42.159 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37127.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37127.log.gz 2024-09-12T12:27:42.159 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38175.log 2024-09-12T12:27:42.160 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87826.log 2024-09-12T12:27:42.160 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37205.log.gz 2024-09-12T12:27:42.162 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54428.log 2024-09-12T12:27:42.162 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38175.log.gz 2024-09-12T12:27:42.163 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87826.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87826.log.gz 2024-09-12T12:27:42.164 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54428.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54428.log.gz 2024-09-12T12:27:42.164 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52829.log 2024-09-12T12:27:42.166 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75848.log 2024-09-12T12:27:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84863.log 2024-09-12T12:27:42.168 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.52829.log.gz 2024-09-12T12:27:42.168 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75848.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75848.log.gz 2024-09-12T12:27:42.169 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84863.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.84863.log.gz 2024-09-12T12:27:42.170 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75874.log 2024-09-12T12:27:42.171 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58191.log 2024-09-12T12:27:42.173 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86523.log 2024-09-12T12:27:42.173 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75874.log.gz 2024-09-12T12:27:42.174 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58191.log: /var/log/ceph/ceph-client.admin.86523.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.58191.log.gz 2024-09-12T12:27:42.174 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86523.log.gz 2024-09-12T12:27:42.175 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73174.log 2024-09-12T12:27:42.176 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37049.log 2024-09-12T12:27:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80937.log 2024-09-12T12:27:42.178 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73174.log.gz 2024-09-12T12:27:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50762.log 2024-09-12T12:27:42.179 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37049.log.gz 2024-09-12T12:27:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80937.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80937.log.gz 2024-09-12T12:27:42.181 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59097.log 2024-09-12T12:27:42.181 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50762.log.gz 2024-09-12T12:27:42.182 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54889.log 2024-09-12T12:27:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58430.log 2024-09-12T12:27:42.183 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59097.log.gz 2024-09-12T12:27:42.184 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54889.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54889.log.gz 2024-09-12T12:27:42.185 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58430.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58430.log.gz 2024-09-12T12:27:42.186 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80963.log 2024-09-12T12:27:42.187 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36477.log 2024-09-12T12:27:42.188 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80714.log 2024-09-12T12:27:42.188 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.80963.log.gz 2024-09-12T12:27:42.190 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36477.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36477.log.gz 2024-09-12T12:27:42.191 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80714.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.80714.log.gz 2024-09-12T12:27:42.191 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83695.log 2024-09-12T12:27:42.192 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87215.log 2024-09-12T12:27:42.194 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73488.log 2024-09-12T12:27:42.195 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83695.log.gz 2024-09-12T12:27:42.195 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81657.log 2024-09-12T12:27:42.195 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87215.log.gz 2024-09-12T12:27:42.197 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73488.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.73488.log.gz 2024-09-12T12:27:42.197 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59428.log 2024-09-12T12:27:42.197 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81657.log.gz 2024-09-12T12:27:42.198 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78731.log 2024-09-12T12:27:42.199 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84579.log 2024-09-12T12:27:42.200 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59428.log.gz 2024-09-12T12:27:42.201 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78731.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78731.log.gz 2024-09-12T12:27:42.202 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84579.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84579.log.gz 2024-09-12T12:27:42.202 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87159.log 2024-09-12T12:27:42.203 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83387.log 2024-09-12T12:27:42.205 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54454.log 2024-09-12T12:27:42.205 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87159.log.gz 2024-09-12T12:27:42.206 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83387.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83387.log.gz 2024-09-12T12:27:42.207 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54454.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54454.log.gz 2024-09-12T12:27:42.209 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37616.log 2024-09-12T12:27:42.210 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56989.log 2024-09-12T12:27:42.212 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59220.log 2024-09-12T12:27:42.212 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37616.log.gz 2024-09-12T12:27:42.212 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56989.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56989.log.gz 2024-09-12T12:27:42.214 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59220.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59220.log.gz 2024-09-12T12:27:42.214 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36971.log 2024-09-12T12:27:42.215 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75568.log 2024-09-12T12:27:42.216 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.2.36971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36272.log 2024-09-12T12:27:42.217 INFO:teuthology.orchestra.run.smithi144.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36971.log.gz 2024-09-12T12:27:42.218 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89084.log 2024-09-12T12:27:42.218 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.75568.log.gz 2024-09-12T12:27:42.219 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81067.log 2024-09-12T12:27:42.219 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36272.log.gz 2024-09-12T12:27:42.220 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86828.log 2024-09-12T12:27:42.221 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2%/var/log/ceph/ceph-client.admin.81067.log: -- replaced with /var/log/ceph/ceph-client.admin.89084.log.gz 2024-09-12T12:27:42.222 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.81067.log.gz 2024-09-12T12:27:42.223 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86828.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86828.log.gz 2024-09-12T12:27:42.223 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37381.log 2024-09-12T12:27:42.224 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86724.log 2024-09-12T12:27:42.226 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51632.log 2024-09-12T12:27:42.226 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37381.log.gz 2024-09-12T12:27:42.227 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86724.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.86724.log.gz 2024-09-12T12:27:42.228 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51632.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51632.log.gz 2024-09-12T12:27:42.229 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57480.log 2024-09-12T12:27:42.230 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37792.log 2024-09-12T12:27:42.232 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37433.log 2024-09-12T12:27:42.232 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57480.log.gz 2024-09-12T12:27:42.232 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37792.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37792.log.gz 2024-09-12T12:27:42.233 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37433.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37433.log.gz 2024-09-12T12:27:42.234 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52375.log 2024-09-12T12:27:42.235 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90082.log 2024-09-12T12:27:42.237 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75952.log 2024-09-12T12:27:42.237 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.90082.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.52375.log.gz 2024-09-12T12:27:42.238 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90082.log.gz 2024-09-12T12:27:42.239 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75952.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75952.log.gz 2024-09-12T12:27:42.239 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58993.log 2024-09-12T12:27:42.240 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54920.log 2024-09-12T12:27:42.242 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88215.log 2024-09-12T12:27:42.242 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58993.log.gz 2024-09-12T12:27:42.243 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54920.log: 91.1%/var/log/ceph/ceph-client.admin.88215.log: -- replaced with /var/log/ceph/ceph-client.admin.54920.log.gz 2024-09-12T12:27:42.244 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88215.log.gz 2024-09-12T12:27:42.244 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81366.log 2024-09-12T12:27:42.245 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54480.log 2024-09-12T12:27:42.247 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78757.log 2024-09-12T12:27:42.248 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81366.log.gz 2024-09-12T12:27:42.248 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54480.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54480.log.gz 2024-09-12T12:27:42.249 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78757.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78757.log.gz 2024-09-12T12:27:42.250 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72937.log 2024-09-12T12:27:42.251 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56963.log 2024-09-12T12:27:42.253 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86890.log 2024-09-12T12:27:42.253 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72937.log.gz 2024-09-12T12:27:42.253 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56963.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56963.log.gz 2024-09-12T12:27:42.255 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86890.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86890.log.gz 2024-09-12T12:27:42.255 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52878.log 2024-09-12T12:27:42.256 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78427.log 2024-09-12T12:27:42.258 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55187.log 2024-09-12T12:27:42.258 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78427.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.52878.log.gz 2024-09-12T12:27:42.259 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78427.log.gz 2024-09-12T12:27:42.260 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55187.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55187.log.gz 2024-09-12T12:27:42.260 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59586.log 2024-09-12T12:27:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75738.log 2024-09-12T12:27:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59891.log 2024-09-12T12:27:42.263 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59586.log.gz 2024-09-12T12:27:42.264 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77578.log 2024-09-12T12:27:42.264 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75738.log.gz 2024-09-12T12:27:42.265 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59891.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59891.log.gz 2024-09-12T12:27:42.266 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.77578.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36073.log 2024-09-12T12:27:42.266 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77578.log.gz 2024-09-12T12:27:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75100.log 2024-09-12T12:27:42.268 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86134.log 2024-09-12T12:27:42.268 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36073.log.gz 2024-09-12T12:27:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75100.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75100.log.gz 2024-09-12T12:27:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86134.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86134.log.gz 2024-09-12T12:27:42.271 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51327.log 2024-09-12T12:27:42.272 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59995.log 2024-09-12T12:27:42.274 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80358.log 2024-09-12T12:27:42.274 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51327.log.gz 2024-09-12T12:27:42.275 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59995.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59995.log.gz 2024-09-12T12:27:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80358.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80358.log.gz 2024-09-12T12:27:42.276 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88636.log 2024-09-12T12:27:42.277 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52928.log 2024-09-12T12:27:42.279 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88636.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T12:27:42.279 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88636.log.gz 2024-09-12T12:27:42.281 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52928.log: 91.2%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.52928.log.gz 2024-09-12T12:27:42.282 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89512.log 2024-09-12T12:27:42.283 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75822.log 2024-09-12T12:27:42.285 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51210.log 2024-09-12T12:27:42.285 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.89512.log.gz 2024-09-12T12:27:42.286 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77552.log 2024-09-12T12:27:42.287 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75822.log.gz 2024-09-12T12:27:42.287 INFO:teuthology.orchestra.run.smithi144.stderr: 86.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T12:27:42.287 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83492.log 2024-09-12T12:27:42.288 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51210.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51210.log.gz 2024-09-12T12:27:42.289 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77552.log: /var/log/ceph/ceph-client.admin.83492.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77552.log.gz 2024-09-12T12:27:42.289 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56572.log 2024-09-12T12:27:42.290 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.83492.log.gz 2024-09-12T12:27:42.290 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60149.log 2024-09-12T12:27:42.292 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56572.log: 89.0%/var/log/ceph/ceph-client.admin.60149.log: -- replaced with /var/log/ceph/ceph-client.admin.56572.log.gz 2024-09-12T12:27:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2024-09-12T12:27:42.293 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60149.log.gz 2024-09-12T12:27:42.294 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77706.log 2024-09-12T12:27:42.295 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54189.log 2024-09-12T12:27:42.296 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2024-09-12T12:27:42.297 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51606.log 2024-09-12T12:27:42.297 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77706.log.gz 2024-09-12T12:27:42.298 INFO:teuthology.orchestra.run.smithi165.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T12:27:42.299 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54189.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54189.log.gz 2024-09-12T12:27:42.299 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51606.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51606.log.gz 2024-09-12T12:27:42.300 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54402.log 2024-09-12T12:27:42.301 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36291.log 2024-09-12T12:27:42.302 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54033.log 2024-09-12T12:27:42.302 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54402.log.gz 2024-09-12T12:27:42.303 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36291.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36291.log.gz 2024-09-12T12:27:42.304 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54033.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54033.log.gz 2024-09-12T12:27:42.305 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58848.log 2024-09-12T12:27:42.306 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34984.log 2024-09-12T12:27:42.308 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78310.log 2024-09-12T12:27:42.308 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.34984.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.58848.log.gz 2024-09-12T12:27:42.309 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34984.log.gz 2024-09-12T12:27:42.310 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78310.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78310.log.gz 2024-09-12T12:27:42.310 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88714.log 2024-09-12T12:27:42.311 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56812.log 2024-09-12T12:27:42.313 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51838.log 2024-09-12T12:27:42.313 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88714.log.gz 2024-09-12T12:27:42.314 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54636.log 2024-09-12T12:27:42.314 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56812.log.gz 2024-09-12T12:27:42.315 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51838.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51838.log.gz 2024-09-12T12:27:42.316 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56813.log 2024-09-12T12:27:42.316 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54636.log.gz 2024-09-12T12:27:42.317 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57956.log 2024-09-12T12:27:42.318 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35038.log 2024-09-12T12:27:42.319 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56813.log.gz 2024-09-12T12:27:42.320 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57956.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57956.log.gz 2024-09-12T12:27:42.321 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35038.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35038.log.gz 2024-09-12T12:27:42.321 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56520.log 2024-09-12T12:27:42.322 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55263.log 2024-09-12T12:27:42.324 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37179.log 2024-09-12T12:27:42.324 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56520.log.gz 2024-09-12T12:27:42.325 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80588.log 2024-09-12T12:27:42.325 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55263.log.gz 2024-09-12T12:27:42.326 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37179.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37179.log.gz 2024-09-12T12:27:42.327 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37485.log 2024-09-12T12:27:42.327 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80588.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.80588.log.gz 2024-09-12T12:27:42.328 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35775.log 2024-09-12T12:27:42.329 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54584.log 2024-09-12T12:27:42.329 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37485.log.gz 2024-09-12T12:27:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35775.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35775.log.gz 2024-09-12T12:27:42.330 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59695.log 2024-09-12T12:27:42.331 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54584.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54584.log.gz 2024-09-12T12:27:42.331 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77862.log 2024-09-12T12:27:42.333 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36885.log 2024-09-12T12:27:42.333 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59695.log.gz 2024-09-12T12:27:42.334 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77862.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.77862.log.gz 2024-09-12T12:27:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36885.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36885.log.gz 2024-09-12T12:27:42.335 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59454.log 2024-09-12T12:27:42.337 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73306.log 2024-09-12T12:27:42.339 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86698.log 2024-09-12T12:27:42.339 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59454.log.gz 2024-09-12T12:27:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73306.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73306.log.gz 2024-09-12T12:27:42.340 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86698.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86698.log.gz 2024-09-12T12:27:42.341 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78395.log 2024-09-12T12:27:42.342 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81575.log 2024-09-12T12:27:42.343 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78395.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.78395.log.gz 2024-09-12T12:27:42.344 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81575.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81575.log.gz 2024-09-12T12:27:42.345 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81540.log 2024-09-12T12:27:42.346 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72413.log 2024-09-12T12:27:42.348 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75230.log 2024-09-12T12:27:42.348 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81540.log.gz 2024-09-12T12:27:42.349 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72413.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.72413.log.gz/var/log/ceph/ceph-client.admin.75230.log: 2024-09-12T12:27:42.350 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75230.log.gz 2024-09-12T12:27:42.350 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81093.log 2024-09-12T12:27:42.351 INFO:teuthology.orchestra.run.smithi165.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T12:27:42.351 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53407.log 2024-09-12T12:27:42.353 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38123.log 2024-09-12T12:27:42.353 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.81093.log.gz 2024-09-12T12:27:42.354 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53407.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53407.log.gz 2024-09-12T12:27:42.355 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78493.log 2024-09-12T12:27:42.356 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38123.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38123.log.gz 2024-09-12T12:27:42.356 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86987.log 2024-09-12T12:27:42.357 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56336.log 2024-09-12T12:27:42.358 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78493.log.gz 2024-09-12T12:27:42.358 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86987.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86987.log.gz 2024-09-12T12:27:42.359 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56336.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56336.log.gz 2024-09-12T12:27:42.360 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55925.log 2024-09-12T12:27:42.361 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54982.log 2024-09-12T12:27:42.362 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57982.log 2024-09-12T12:27:42.362 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55925.log.gz 2024-09-12T12:27:42.363 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54982.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54982.log.gz 2024-09-12T12:27:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57982.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.57982.log.gz 2024-09-12T12:27:42.365 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58371.log 2024-09-12T12:27:42.366 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55157.log 2024-09-12T12:27:42.368 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53457.log 2024-09-12T12:27:42.368 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.58371.log.gz 2024-09-12T12:27:42.369 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55157.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55157.log.gz 2024-09-12T12:27:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53457.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53457.log.gz 2024-09-12T12:27:42.370 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57612.log 2024-09-12T12:27:42.372 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52599.log 2024-09-12T12:27:42.373 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87345.log 2024-09-12T12:27:42.373 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57612.log.gz 2024-09-12T12:27:42.374 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84471.log 2024-09-12T12:27:42.375 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5%/var/log/ceph/ceph-client.admin.87345.log: -- replaced with /var/log/ceph/ceph-client.admin.52599.log.gz 2024-09-12T12:27:42.375 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89562.log 2024-09-12T12:27:42.375 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87345.log.gz 2024-09-12T12:27:42.377 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84471.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.84471.log.gz 2024-09-12T12:27:42.378 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89562.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89562.log.gz 2024-09-12T12:27:42.378 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72779.log 2024-09-12T12:27:42.380 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57847.log 2024-09-12T12:27:42.381 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54324.log 2024-09-12T12:27:42.382 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72779.log.gz 2024-09-12T12:27:42.382 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57847.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57847.log.gz 2024-09-12T12:27:42.382 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80766.log 2024-09-12T12:27:42.383 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54324.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54324.log.gz 2024-09-12T12:27:42.384 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37870.log 2024-09-12T12:27:42.385 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75620.log 2024-09-12T12:27:42.386 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80766.log.gz 2024-09-12T12:27:42.386 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37870.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37870.log.gz 2024-09-12T12:27:42.387 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75620.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75620.log.gz 2024-09-12T12:27:42.388 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86259.log 2024-09-12T12:27:42.389 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36997.log 2024-09-12T12:27:42.390 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35879.log 2024-09-12T12:27:42.391 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36997.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.86259.log.gz 2024-09-12T12:27:42.392 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36997.log.gz 2024-09-12T12:27:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35879.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35879.log.gz 2024-09-12T12:27:42.393 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50647.log 2024-09-12T12:27:42.394 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87511.log 2024-09-12T12:27:42.396 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89952.log 2024-09-12T12:27:42.397 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50647.log.gz 2024-09-12T12:27:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87511.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.87511.log.gz 2024-09-12T12:27:42.398 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89952.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89952.log.gz 2024-09-12T12:27:42.399 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56777.log 2024-09-12T12:27:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55769.log 2024-09-12T12:27:42.402 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74757.log 2024-09-12T12:27:42.402 INFO:teuthology.orchestra.run.smithi144.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.56777.log.gz 2024-09-12T12:27:42.402 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55769.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55769.log.gz 2024-09-12T12:27:42.404 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74757.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.74757.log.gz 2024-09-12T12:27:42.404 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55646.log 2024-09-12T12:27:42.405 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50540.log 2024-09-12T12:27:42.407 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89744.log 2024-09-12T12:27:42.407 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55646.log.gz 2024-09-12T12:27:42.409 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50540.log: /var/log/ceph/ceph-client.admin.89744.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50540.log.gz 2024-09-12T12:27:42.409 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89744.log.gz 2024-09-12T12:27:42.410 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55427.log 2024-09-12T12:27:42.411 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28934.log 2024-09-12T12:27:42.413 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53901.log 2024-09-12T12:27:42.413 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55427.log.gz 2024-09-12T12:27:42.414 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.28934.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28934.log.gz 2024-09-12T12:27:42.415 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53901.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53901.log.gz 2024-09-12T12:27:42.415 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35877.log 2024-09-12T12:27:42.416 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56193.log 2024-09-12T12:27:42.418 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55397.log 2024-09-12T12:27:42.418 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35877.log.gz 2024-09-12T12:27:42.419 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77888.log 2024-09-12T12:27:42.419 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56193.log.gz 2024-09-12T12:27:42.421 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55397.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55397.log.gz 2024-09-12T12:27:42.422 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86601.log 2024-09-12T12:27:42.422 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77888.log.gz 2024-09-12T12:27:42.422 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37765.log 2024-09-12T12:27:42.423 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88792.log 2024-09-12T12:27:42.424 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.86601.log.gz 2024-09-12T12:27:42.425 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37765.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37765.log.gz 2024-09-12T12:27:42.426 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88792.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.88792.log.gz 2024-09-12T12:27:42.427 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75360.log 2024-09-12T12:27:42.427 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34836.log 2024-09-12T12:27:42.429 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55620.log 2024-09-12T12:27:42.429 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75360.log.gz 2024-09-12T12:27:42.430 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.34836.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34836.log.gz 2024-09-12T12:27:42.431 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55620.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55620.log.gz 2024-09-12T12:27:42.432 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89770.log 2024-09-12T12:27:42.433 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59071.log 2024-09-12T12:27:42.435 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60073.log 2024-09-12T12:27:42.435 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89770.log.gz 2024-09-12T12:27:42.435 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59071.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59071.log.gz 2024-09-12T12:27:42.437 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60073.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60073.log.gz 2024-09-12T12:27:42.437 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52775.log 2024-09-12T12:27:42.438 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38227.log 2024-09-12T12:27:42.441 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73202.log 2024-09-12T12:27:42.441 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38227.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.52775.log.gz 2024-09-12T12:27:42.441 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38227.log.gz 2024-09-12T12:27:42.442 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73202.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73202.log.gz 2024-09-12T12:27:42.442 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87447.log 2024-09-12T12:27:42.443 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88449.log 2024-09-12T12:27:42.445 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36071.log 2024-09-12T12:27:42.446 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.87447.log.gz 2024-09-12T12:27:42.446 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56466.log 2024-09-12T12:27:42.446 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88449.log.gz 2024-09-12T12:27:42.448 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36071.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36071.log.gz 2024-09-12T12:27:42.448 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72630.log 2024-09-12T12:27:42.448 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56466.log.gz 2024-09-12T12:27:42.449 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77396.log 2024-09-12T12:27:42.450 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72604.log 2024-09-12T12:27:42.451 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72630.log.gz 2024-09-12T12:27:42.452 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77396.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77396.log.gz 2024-09-12T12:27:42.453 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72604.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72604.log.gz 2024-09-12T12:27:42.453 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35064.log 2024-09-12T12:27:42.455 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35452.log 2024-09-12T12:27:42.456 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84326.log 2024-09-12T12:27:42.456 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35064.log.gz 2024-09-12T12:27:42.457 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56280.log 2024-09-12T12:27:42.459 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84326.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84326.log.gz 2024-09-12T12:27:42.459 INFO:teuthology.orchestra.run.smithi144.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.35452.log.gz 2024-09-12T12:27:42.459 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52725.log 2024-09-12T12:27:42.460 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56280.log.gz 2024-09-12T12:27:42.460 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78180.log 2024-09-12T12:27:42.462 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81334.log 2024-09-12T12:27:42.463 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.52725.log.gz 2024-09-12T12:27:42.464 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78180.log: gzip -5 --verbose -- 89.4% -- replaced with /var/log/ceph/ceph-client.admin.78180.log.gz 2024-09-12T12:27:42.464 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-client.admin.37713.log 2024-09-12T12:27:42.464 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81334.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.81334.log.gz 2024-09-12T12:27:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57664.log 2024-09-12T12:27:42.466 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57357.log 2024-09-12T12:27:42.466 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37713.log.gz 2024-09-12T12:27:42.467 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57664.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57664.log.gz 2024-09-12T12:27:42.468 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57357.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57357.log.gz 2024-09-12T12:27:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87858.log 2024-09-12T12:27:42.470 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59123.log 2024-09-12T12:27:42.472 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72805.log 2024-09-12T12:27:42.472 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87858.log.gz 2024-09-12T12:27:42.473 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59123.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59123.log.gz 2024-09-12T12:27:42.474 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72805.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72805.log.gz 2024-09-12T12:27:42.474 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35881.log 2024-09-12T12:27:42.475 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34798.log 2024-09-12T12:27:42.481 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35881.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T12:27:42.481 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35881.log.gz 2024-09-12T12:27:42.482 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.34798.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34798.log.gz 2024-09-12T12:27:42.482 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86413.log 2024-09-12T12:27:42.484 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89926.log 2024-09-12T12:27:42.484 INFO:teuthology.orchestra.run.smithi144.stderr: 90.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T12:27:42.485 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83259.log 2024-09-12T12:27:42.485 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.86413.log.gz 2024-09-12T12:27:42.486 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88766.log 2024-09-12T12:27:42.487 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89926.log.gz 2024-09-12T12:27:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83259.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-12T12:27:42.488 INFO:teuthology.orchestra.run.smithi144.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.83259.log.gz 2024-09-12T12:27:42.489 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88766.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88766.log.gz 2024-09-12T12:27:42.489 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58608.log 2024-09-12T12:27:42.491 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52549.log 2024-09-12T12:27:42.492 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58608.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58608.log.gz 2024-09-12T12:27:42.493 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89718.log 2024-09-12T12:27:42.494 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52549.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52549.log.gz 2024-09-12T12:27:42.495 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89718.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89718.log.gz 2024-09-12T12:27:42.496 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73280.log 2024-09-12T12:27:42.497 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56695.log 2024-09-12T12:27:42.499 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73280.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73280.log.gz 2024-09-12T12:27:42.499 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.56695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56695.log.gz 2024-09-12T12:27:42.500 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36297.log 2024-09-12T12:27:42.501 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84245.log 2024-09-12T12:27:42.502 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36297.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36297.log.gz 2024-09-12T12:27:42.503 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84245.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.84245.log.gz 2024-09-12T12:27:42.504 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35012.log 2024-09-12T12:27:42.505 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T12:27:42.507 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84631.log 2024-09-12T12:27:42.507 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35012.log.gz 2024-09-12T12:27:42.511 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.84631.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84631.log.gz 2024-09-12T12:27:42.511 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50788.log 2024-09-12T12:27:42.513 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58034.log 2024-09-12T12:27:42.515 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50788.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51145.log 2024-09-12T12:27:42.515 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-12T12:27:42.517 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58034.log: /var/log/ceph/ceph-client.admin.51145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89276.log 2024-09-12T12:27:42.518 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51145.log.gz 2024-09-12T12:27:42.519 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58034.log.gz 2024-09-12T12:27:42.520 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38041.log 2024-09-12T12:27:42.525 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38041.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38041.log.gz 2024-09-12T12:27:42.525 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89276.log.gz 2024-09-12T12:27:42.525 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81735.log 2024-09-12T12:27:42.528 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81735.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.81735.log.gz 2024-09-12T12:27:42.528 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87741.log 2024-09-12T12:27:42.531 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86471.log 2024-09-12T12:27:42.531 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.87741.log.gz 2024-09-12T12:27:42.533 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78984.log 2024-09-12T12:27:42.535 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87293.log 2024-09-12T12:27:42.536 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.78984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.78984.log.gz 2024-09-12T12:27:42.536 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86471.log.gz 2024-09-12T12:27:42.539 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87293.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87293.log.gz 2024-09-12T12:27:42.539 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78601.log 2024-09-12T12:27:42.542 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78601.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78601.log.gz 2024-09-12T12:27:42.542 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53726.log 2024-09-12T12:27:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37101.log 2024-09-12T12:27:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53726.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53726.log.gz 2024-09-12T12:27:42.546 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88189.log 2024-09-12T12:27:42.546 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37101.log.gz 2024-09-12T12:27:42.549 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88189.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.88189.log.gz 2024-09-12T12:27:42.549 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54532.log 2024-09-12T12:27:42.552 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54532.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54532.log.gz 2024-09-12T12:27:42.552 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78206.log 2024-09-12T12:27:42.555 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78206.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78206.log.gz 2024-09-12T12:27:42.555 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84169.log 2024-09-12T12:27:42.558 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81431.log 2024-09-12T12:27:42.558 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84169.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.84169.log.gz 2024-09-12T12:27:42.561 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81431.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.81431.log.gz 2024-09-12T12:27:42.561 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73228.log 2024-09-12T12:27:42.564 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73228.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73228.log.gz 2024-09-12T12:27:42.564 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89666.log 2024-09-12T12:27:42.567 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89666.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89666.log.gz 2024-09-12T12:27:42.567 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35827.log 2024-09-12T12:27:42.568 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55594.log 2024-09-12T12:27:42.570 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35827.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35827.log.gz 2024-09-12T12:27:42.573 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55594.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55594.log.gz 2024-09-12T12:27:42.573 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57305.log 2024-09-12T12:27:42.576 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57305.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57305.log.gz 2024-09-12T12:27:42.576 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60047.log 2024-09-12T12:27:42.579 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60047.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60047.log.gz 2024-09-12T12:27:42.579 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78887.log 2024-09-12T12:27:42.583 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78887.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.78887.log.gz 2024-09-12T12:27:42.583 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58310.log 2024-09-12T12:27:42.586 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57253.log 2024-09-12T12:27:42.586 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58310.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58310.log.gz 2024-09-12T12:27:42.589 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57253.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57253.log.gz 2024-09-12T12:27:42.589 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58967.log 2024-09-12T12:27:42.591 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83159.log 2024-09-12T12:27:42.592 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58967.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58967.log.gz 2024-09-12T12:27:42.596 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83159.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.83159.log.gz 2024-09-12T12:27:42.596 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57161.log 2024-09-12T12:27:42.597 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84143.log 2024-09-12T12:27:42.599 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87637.log 2024-09-12T12:27:42.600 INFO:teuthology.orchestra.run.smithi144.stderr: 91.0%/var/log/ceph/ceph-client.admin.84143.log: -- replaced with /var/log/ceph/ceph-client.admin.57161.log.gz 2024-09-12T12:27:42.604 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84143.log.gz 2024-09-12T12:27:42.604 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87637.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.87637.log.gz 2024-09-12T12:27:42.605 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57904.log 2024-09-12T12:27:42.607 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57904.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57904.log.gz 2024-09-12T12:27:42.608 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53257.log 2024-09-12T12:27:42.610 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35510.log 2024-09-12T12:27:42.611 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53257.log: /var/log/ceph/ceph-client.admin.35510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88662.log 2024-09-12T12:27:42.612 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35510.log.gz 2024-09-12T12:27:42.612 INFO:teuthology.orchestra.run.smithi144.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.53257.log.gz 2024-09-12T12:27:42.615 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88662.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88662.log.gz 2024-09-12T12:27:42.615 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88842.log 2024-09-12T12:27:42.618 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88842.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.88842.log.gz 2024-09-12T12:27:42.618 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56598.log 2024-09-12T12:27:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56598.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56598.log.gz 2024-09-12T12:27:42.621 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55516.log 2024-09-12T12:27:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55516.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55516.log.gz 2024-09-12T12:27:42.624 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81709.log 2024-09-12T12:27:42.628 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37922.log 2024-09-12T12:27:42.628 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81709.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.81709.log.gz 2024-09-12T12:27:42.628 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88137.log 2024-09-12T12:27:42.628 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37922.log.gz 2024-09-12T12:27:42.632 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88137.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88137.log.gz 2024-09-12T12:27:42.632 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78135.log 2024-09-12T12:27:42.634 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78135.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78135.log.gz 2024-09-12T12:27:42.635 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90161.log 2024-09-12T12:27:42.638 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.90161.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90161.log.gz 2024-09-12T12:27:42.638 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80879.log 2024-09-12T12:27:42.641 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80879.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80879.log.gz 2024-09-12T12:27:42.641 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56228.log 2024-09-12T12:27:42.644 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56228.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56228.log.gz 2024-09-12T12:27:42.644 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75282.log 2024-09-12T12:27:42.646 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77346.log 2024-09-12T12:27:42.647 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75282.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75282.log.gz 2024-09-12T12:27:42.648 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78809.log 2024-09-12T12:27:42.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77346.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.77346.log.gz 2024-09-12T12:27:42.653 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78809.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78809.log.gz 2024-09-12T12:27:42.653 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36529.log 2024-09-12T12:27:42.656 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36529.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36529.log.gz 2024-09-12T12:27:42.656 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84352.log 2024-09-12T12:27:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84352.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.84352.log.gz 2024-09-12T12:27:42.659 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53953.log 2024-09-12T12:27:42.662 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53953.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53953.log.gz 2024-09-12T12:27:42.662 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38015.log 2024-09-12T12:27:42.666 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83414.log 2024-09-12T12:27:42.666 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.38015.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38015.log.gz 2024-09-12T12:27:42.667 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59272.log 2024-09-12T12:27:42.667 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83414.log.gz 2024-09-12T12:27:42.670 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59272.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59272.log.gz 2024-09-12T12:27:42.671 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75677.log 2024-09-12T12:27:42.673 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36635.log 2024-09-12T12:27:42.675 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75677.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77758.log 2024-09-12T12:27:42.675 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-12T12:27:42.676 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36635.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36635.log.gz 2024-09-12T12:27:42.678 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57558.log 2024-09-12T12:27:42.681 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57558.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57558.log.gz 2024-09-12T12:27:42.681 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81041.log 2024-09-12T12:27:42.685 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77758.log.gz 2024-09-12T12:27:42.685 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58165.log 2024-09-12T12:27:42.685 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81041.log.gz 2024-09-12T12:27:42.688 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74957.log 2024-09-12T12:27:42.689 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58165.log.gz 2024-09-12T12:27:42.691 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75649.log 2024-09-12T12:27:42.692 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74957.log.gz 2024-09-12T12:27:42.695 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75649.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75649.log.gz 2024-09-12T12:27:42.696 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87936.log 2024-09-12T12:27:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87936.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.87936.log.gz 2024-09-12T12:27:42.699 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50989.log 2024-09-12T12:27:42.701 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50989.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50989.log.gz 2024-09-12T12:27:42.702 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73332.log 2024-09-12T12:27:42.705 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53307.log 2024-09-12T12:27:42.705 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73332.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73332.log.gz 2024-09-12T12:27:42.708 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53307.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.53307.log.gz 2024-09-12T12:27:42.708 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56750.log 2024-09-12T12:27:42.712 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56750.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56750.log.gz 2024-09-12T12:27:42.712 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55568.log 2024-09-12T12:27:42.718 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55568.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55568.log.gz 2024-09-12T12:27:42.718 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72463.log 2024-09-12T12:27:42.718 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72463.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.72463.log.gz 2024-09-12T12:27:42.718 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81601.log 2024-09-12T12:27:42.721 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81601.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81601.log.gz 2024-09-12T12:27:42.721 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56492.log 2024-09-12T12:27:42.724 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81015.log 2024-09-12T12:27:42.724 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56492.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56492.log.gz 2024-09-12T12:27:42.727 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81015.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.81015.log.gz 2024-09-12T12:27:42.728 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81512.log 2024-09-12T12:27:42.730 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81512.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.81512.log.gz 2024-09-12T12:27:42.731 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35537.log 2024-09-12T12:27:42.733 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35537.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35537.log.gz 2024-09-12T12:27:42.733 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81936.log 2024-09-12T12:27:42.734 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75900.log 2024-09-12T12:27:42.738 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.81936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.81936.log.gz 2024-09-12T12:27:42.738 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75900.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75900.log.gz 2024-09-12T12:27:42.739 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72656.log 2024-09-12T12:27:42.742 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81813.log 2024-09-12T12:27:42.743 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72258.log 2024-09-12T12:27:42.743 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72656.log.gz 2024-09-12T12:27:42.745 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81813.log: /var/log/ceph/ceph-client.admin.72258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50440.log 2024-09-12T12:27:42.747 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.81813.log.gz 2024-09-12T12:27:42.747 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.72258.log.gz 2024-09-12T12:27:42.751 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86672.log 2024-09-12T12:27:42.751 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50440.log.gz 2024-09-12T12:27:42.751 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86672.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86672.log.gz 2024-09-12T12:27:42.751 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54066.log 2024-09-12T12:27:42.754 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54066.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54066.log.gz 2024-09-12T12:27:42.754 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56546.log 2024-09-12T12:27:42.758 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87988.log 2024-09-12T12:27:42.758 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56546.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56546.log.gz 2024-09-12T12:27:42.759 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80384.log 2024-09-12T12:27:42.759 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87988.log.gz 2024-09-12T12:27:42.762 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80384.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80384.log.gz 2024-09-12T12:27:42.763 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55795.log 2024-09-12T12:27:42.765 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90135.log 2024-09-12T12:27:42.766 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55795.log.gz 2024-09-12T12:27:42.768 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89250.log 2024-09-12T12:27:42.770 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.90135.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90135.log.gz 2024-09-12T12:27:42.772 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.89250.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34954.log 2024-09-12T12:27:42.773 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89250.log.gz 2024-09-12T12:27:42.775 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.34954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57876.log 2024-09-12T12:27:42.776 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34954.log.gz 2024-09-12T12:27:42.778 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-09-12T12:27:42.779 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57876.log.gz 2024-09-12T12:27:42.781 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35801.log 2024-09-12T12:27:42.786 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35868.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-09-12T12:27:42.786 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35801.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35801.log.gz 2024-09-12T12:27:42.786 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35222.log 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35222.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35222.log.gz 2024-09-12T12:27:42.789 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73119.log 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73119.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73119.log.gz 2024-09-12T12:27:42.792 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87267.log 2024-09-12T12:27:42.795 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35697.log 2024-09-12T12:27:42.796 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87267.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.87267.log.gz 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35697.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35697.log.gz 2024-09-12T12:27:42.798 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89328.log 2024-09-12T12:27:42.801 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89328.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.89328.log.gz 2024-09-12T12:27:42.802 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37270.log 2024-09-12T12:27:42.804 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37270.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37270.log.gz 2024-09-12T12:27:42.805 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53648.log 2024-09-12T12:27:42.807 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53648.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53648.log.gz 2024-09-12T12:27:42.807 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36727.log 2024-09-12T12:27:42.812 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83728.log 2024-09-12T12:27:42.812 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36727.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36727.log.gz 2024-09-12T12:27:42.812 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78937.log 2024-09-12T12:27:42.813 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83728.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83728.log.gz 2024-09-12T12:27:42.815 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89224.log 2024-09-12T12:27:42.816 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78937.log.gz 2024-09-12T12:27:42.818 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36273.log 2024-09-12T12:27:42.819 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89224.log.gz 2024-09-12T12:27:42.821 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36583.log 2024-09-12T12:27:42.823 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.36273.log.gz 2024-09-12T12:27:42.824 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51093.log 2024-09-12T12:27:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36583.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36583.log.gz 2024-09-12T12:27:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51093.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51093.log.gz 2024-09-12T12:27:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89432.log 2024-09-12T12:27:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89432.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89432.log.gz 2024-09-12T12:27:42.830 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80911.log 2024-09-12T12:27:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80911.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80911.log.gz 2024-09-12T12:27:42.833 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72734.log 2024-09-12T12:27:42.836 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59638.log 2024-09-12T12:27:42.836 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72734.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72734.log.gz 2024-09-12T12:27:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59638.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59638.log.gz 2024-09-12T12:27:42.839 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58341.log 2024-09-12T12:27:42.842 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58341.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58341.log.gz 2024-09-12T12:27:42.842 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36609.log 2024-09-12T12:27:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36609.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36609.log.gz 2024-09-12T12:27:42.845 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54163.log 2024-09-12T12:27:42.848 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54163.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54163.log.gz 2024-09-12T12:27:42.848 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37407.log 2024-09-12T12:27:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37407.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37407.log.gz 2024-09-12T12:27:42.851 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35567.log 2024-09-12T12:27:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35567.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35567.log.gz 2024-09-12T12:27:42.854 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80256.log 2024-09-12T12:27:42.857 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80256.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.80256.log.gz 2024-09-12T12:27:42.858 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57795.log 2024-09-12T12:27:42.861 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57795.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57795.log.gz 2024-09-12T12:27:42.861 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55821.log 2024-09-12T12:27:42.864 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55821.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55821.log.gz 2024-09-12T12:27:42.864 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57221.log 2024-09-12T12:27:42.866 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57221.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57221.log.gz 2024-09-12T12:27:42.867 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37329.log 2024-09-12T12:27:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37329.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37329.log.gz 2024-09-12T12:27:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89874.log 2024-09-12T12:27:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89874.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89874.log.gz 2024-09-12T12:27:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84657.log 2024-09-12T12:27:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84657.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84657.log.gz 2024-09-12T12:27:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74807.log 2024-09-12T12:27:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50490.log 2024-09-12T12:27:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74807.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.74807.log.gz 2024-09-12T12:27:42.883 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50490.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50490.log.gz 2024-09-12T12:27:42.883 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37896.log 2024-09-12T12:27:42.886 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37896.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37896.log.gz 2024-09-12T12:27:42.886 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58740.log 2024-09-12T12:27:42.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T12:27:42.889 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58740.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58740.log.gz 2024-09-12T12:27:42.889 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51384.log 2024-09-12T12:27:42.892 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72859.log 2024-09-12T12:27:42.893 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51384.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51384.log.gz 2024-09-12T12:27:42.895 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72859.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72859.log.gz 2024-09-12T12:27:42.896 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75978.log 2024-09-12T12:27:42.899 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75978.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.75978.log.gz 2024-09-12T12:27:42.899 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89354.log 2024-09-12T12:27:42.902 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89354.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89354.log.gz 2024-09-12T12:27:42.902 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75178.log 2024-09-12T12:27:42.905 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75178.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75178.log.gz 2024-09-12T12:27:42.905 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51356.log 2024-09-12T12:27:42.908 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51356.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51356.log.gz 2024-09-12T12:27:42.908 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80820.log 2024-09-12T12:27:42.911 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80820.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80820.log.gz 2024-09-12T12:27:42.911 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88014.log 2024-09-12T12:27:42.914 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51553.log 2024-09-12T12:27:42.915 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.88014.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88014.log.gz 2024-09-12T12:27:42.917 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89588.log 2024-09-12T12:27:42.918 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51553.log.gz 2024-09-12T12:27:42.920 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80332.log 2024-09-12T12:27:42.921 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89588.log.gz 2024-09-12T12:27:42.924 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73358.log 2024-09-12T12:27:42.925 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80332.log.gz 2024-09-12T12:27:42.927 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54506.log 2024-09-12T12:27:42.928 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.73358.log.gz 2024-09-12T12:27:42.930 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52322.log 2024-09-12T12:27:42.931 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54506.log.gz 2024-09-12T12:27:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52322.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52322.log.gz 2024-09-12T12:27:42.935 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57435.log 2024-09-12T12:27:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57435.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57435.log.gz 2024-09-12T12:27:42.938 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75794.log 2024-09-12T12:27:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75794.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75794.log.gz 2024-09-12T12:27:42.942 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50736.log 2024-09-12T12:27:42.944 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50736.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50736.log.gz 2024-09-12T12:27:42.944 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81953.log 2024-09-12T12:27:42.947 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81953.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.81953.log.gz 2024-09-12T12:27:42.947 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59969.log 2024-09-12T12:27:42.953 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59969.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59969.log.gz 2024-09-12T12:27:42.954 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84553.log 2024-09-12T12:27:42.954 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.84553.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.84553.log.gz 2024-09-12T12:27:42.954 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86802.log 2024-09-12T12:27:42.957 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86802.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86802.log.gz 2024-09-12T12:27:42.957 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37239.log 2024-09-12T12:27:42.960 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87133.log 2024-09-12T12:27:42.961 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37239.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37239.log.gz 2024-09-12T12:27:42.961 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52070.log 2024-09-12T12:27:42.961 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.87133.log.gz 2024-09-12T12:27:42.964 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52070.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52070.log.gz 2024-09-12T12:27:42.964 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37153.log 2024-09-12T12:27:42.967 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37153.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37153.log.gz 2024-09-12T12:27:42.967 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73254.log 2024-09-12T12:27:42.970 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73254.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73254.log.gz 2024-09-12T12:27:42.970 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78362.log 2024-09-12T12:27:42.973 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83466.log 2024-09-12T12:27:42.973 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78362.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78362.log.gz 2024-09-12T12:27:42.976 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83466.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83466.log.gz 2024-09-12T12:27:42.977 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58818.log 2024-09-12T12:27:42.979 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72308.log 2024-09-12T12:27:42.980 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58818.log.gz 2024-09-12T12:27:42.981 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51885.log 2024-09-12T12:27:42.983 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72308.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72308.log.gz 2024-09-12T12:27:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.51885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51885.log.gz 2024-09-12T12:27:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89380.log 2024-09-12T12:27:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89380.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.89380.log.gz 2024-09-12T12:27:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86308.log 2024-09-12T12:27:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86308.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.86308.log.gz 2024-09-12T12:27:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83916.log 2024-09-12T12:27:42.995 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83916.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83916.log.gz 2024-09-12T12:27:42.995 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59838.log 2024-09-12T12:27:42.998 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59838.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59838.log.gz 2024-09-12T12:27:42.998 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56814.log 2024-09-12T12:27:43.001 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56814.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56814.log.gz 2024-09-12T12:27:43.001 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89822.log 2024-09-12T12:27:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83548.log 2024-09-12T12:27:43.004 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89822.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89822.log.gz 2024-09-12T12:27:43.005 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36292.log 2024-09-12T12:27:43.005 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83548.log.gz 2024-09-12T12:27:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36292.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36292.log.gz 2024-09-12T12:27:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86108.log 2024-09-12T12:27:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.86108.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.86108.log.gz 2024-09-12T12:27:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89302.log 2024-09-12T12:27:43.014 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89302.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89302.log.gz 2024-09-12T12:27:43.014 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37459.log 2024-09-12T12:27:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.37459.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37459.log.gz 2024-09-12T12:27:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28817.log 2024-09-12T12:27:43.019 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55213.log 2024-09-12T12:27:43.020 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.28817.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28817.log.gz 2024-09-12T12:27:43.024 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55213.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55213.log.gz 2024-09-12T12:27:43.024 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55717.log 2024-09-12T12:27:43.027 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55717.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55717.log.gz 2024-09-12T12:27:43.027 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55899.log 2024-09-12T12:27:43.030 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53674.log 2024-09-12T12:27:43.030 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55899.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55899.log.gz 2024-09-12T12:27:43.033 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53674.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53674.log.gz 2024-09-12T12:27:43.033 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35593.log 2024-09-12T12:27:43.036 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35593.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35593.log.gz 2024-09-12T12:27:43.036 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72552.log 2024-09-12T12:27:43.039 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77296.log 2024-09-12T12:27:43.039 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.72552.log.gz 2024-09-12T12:27:43.041 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77474.log 2024-09-12T12:27:43.043 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77296.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.77296.log.gz 2024-09-12T12:27:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77474.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77474.log.gz 2024-09-12T12:27:43.046 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58433.log 2024-09-12T12:27:43.049 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58433.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58433.log.gz 2024-09-12T12:27:43.049 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83602.log 2024-09-12T12:27:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83602.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.83602.log.gz 2024-09-12T12:27:43.053 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54098.log 2024-09-12T12:27:43.055 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54098.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54098.log.gz 2024-09-12T12:27:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59865.log 2024-09-12T12:27:43.059 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35170.log 2024-09-12T12:27:43.059 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59865.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59865.log.gz 2024-09-12T12:27:43.059 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52170.log 2024-09-12T12:27:43.060 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35170.log.gz 2024-09-12T12:27:43.063 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52170.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.52170.log.gz 2024-09-12T12:27:43.063 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54759.log 2024-09-12T12:27:43.066 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.54759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54759.log.gz 2024-09-12T12:27:43.066 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81223.log 2024-09-12T12:27:43.068 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.81223.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.81223.log.gz 2024-09-12T12:27:43.069 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23992.log 2024-09-12T12:27:43.071 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.tmp-client.admin.23992.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23992.log.gz 2024-09-12T12:27:43.072 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80436.log 2024-09-12T12:27:43.078 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80436.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80436.log.gz 2024-09-12T12:27:43.078 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53080.log 2024-09-12T12:27:43.078 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53080.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53080.log.gz 2024-09-12T12:27:43.078 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83440.log 2024-09-12T12:27:43.081 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83440.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83440.log.gz 2024-09-12T12:27:43.081 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87587.log 2024-09-12T12:27:43.082 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57045.log 2024-09-12T12:27:43.085 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87587.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.87587.log.gz 2024-09-12T12:27:43.087 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53778.log 2024-09-12T12:27:43.088 INFO:teuthology.orchestra.run.smithi144.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.57045.log.gz 2024-09-12T12:27:43.092 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.53778.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53778.log.gz 2024-09-12T12:27:43.092 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.78258.log 2024-09-12T12:27:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78258.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78258.log.gz 2024-09-12T12:27:43.095 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87791.log 2024-09-12T12:27:43.098 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.87791.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87791.log.gz 2024-09-12T12:27:43.098 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89136.log 2024-09-12T12:27:43.102 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83838.log 2024-09-12T12:27:43.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.89136.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89136.log.gz 2024-09-12T12:27:43.103 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83309.log 2024-09-12T12:27:43.103 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83838.log.gz 2024-09-12T12:27:43.105 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.83309.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83309.log.gz 2024-09-12T12:27:43.106 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58792.log 2024-09-12T12:27:43.109 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80846.log 2024-09-12T12:27:43.110 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58792.log.gz 2024-09-12T12:27:43.111 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35092.log 2024-09-12T12:27:43.113 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.80846.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80846.log.gz 2024-09-12T12:27:43.116 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.35092.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59519.log 2024-09-12T12:27:43.117 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35092.log.gz 2024-09-12T12:27:43.119 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35880.log 2024-09-12T12:27:43.120 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59519.log.gz 2024-09-12T12:27:43.122 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60213.log 2024-09-12T12:27:43.123 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35880.log.gz 2024-09-12T12:27:43.126 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60213.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60213.log.gz 2024-09-12T12:27:43.178 INFO:teuthology.orchestra.run.smithi144.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T12:27:43.729 INFO:teuthology.orchestra.run.smithi165.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-12T12:27:43.781 INFO:teuthology.orchestra.run.smithi165.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-12T12:27:46.230 INFO:teuthology.orchestra.run.smithi165.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T12:27:46.267 INFO:teuthology.orchestra.run.smithi165.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T12:27:46.659 INFO:teuthology.orchestra.run.smithi165.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T12:27:46.954 INFO:teuthology.orchestra.run.smithi144.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T12:27:47.128 INFO:teuthology.orchestra.run.smithi165.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T12:27:47.130 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-12T12:27:47.130 INFO:teuthology.orchestra.run.smithi165.stderr:real 0m5.396s 2024-09-12T12:27:47.130 INFO:teuthology.orchestra.run.smithi165.stderr:user 0m22.562s 2024-09-12T12:27:47.130 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m1.855s 2024-09-12T12:27:47.881 INFO:teuthology.orchestra.run.smithi144.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T12:27:48.917 INFO:teuthology.orchestra.run.smithi144.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T12:27:49.442 INFO:teuthology.orchestra.run.smithi144.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T12:28:05.621 INFO:teuthology.orchestra.run.smithi144.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-12T12:28:09.102 INFO:teuthology.orchestra.run.smithi144.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T12:28:09.105 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-12T12:28:09.105 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m27.388s 2024-09-12T12:28:09.105 INFO:teuthology.orchestra.run.smithi144.stderr:user 1m11.599s 2024-09-12T12:28:09.105 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m6.995s 2024-09-12T12:28:09.106 INFO:tasks.ceph:Archiving logs... 2024-09-12T12:28:09.107 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704/remote/smithi144/log 2024-09-12T12:28:09.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:28:17.794 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704/remote/smithi165/log 2024-09-12T12:28:17.795 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:28:20.443 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T12:28:20.452 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T12:28:20.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:28:20.455 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:28:20.560 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T12:28:20.569 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T12:28:20.570 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:28:20.573 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:28:20.585 INFO:teuthology.orchestra.run.smithi144.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T12:28:20.586 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================== 2024-09-12T12:28:20.586 INFO:teuthology.orchestra.run.smithi144.stdout:+hv01.front.sepi 67.205.162.81 3 u 42 128 377 0.087 -1.333 0.207 2024-09-12T12:28:20.586 INFO:teuthology.orchestra.run.smithi144.stdout:+hv02.front.sepi 63.231.80.2 3 u 55 64 377 0.078 -3.750 0.217 2024-09-12T12:28:20.586 INFO:teuthology.orchestra.run.smithi144.stdout:*hv03.front.sepi 74.6.168.72 3 u 47 64 377 0.081 -3.010 0.399 2024-09-12T12:28:20.586 INFO:teuthology.orchestra.run.smithi144.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-12T12:28:20.589 INFO:teuthology.orchestra.run.smithi165.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T12:28:20.589 INFO:teuthology.orchestra.run.smithi165.stdout:============================================================================== 2024-09-12T12:28:20.589 INFO:teuthology.orchestra.run.smithi165.stdout:*hv01.front.sepi 67.205.162.81 3 u 37 64 377 0.088 -1.407 0.597 2024-09-12T12:28:20.589 INFO:teuthology.orchestra.run.smithi165.stdout:+hv02.front.sepi 63.231.80.2 3 u 47 64 377 0.100 -4.250 0.854 2024-09-12T12:28:20.589 INFO:teuthology.orchestra.run.smithi165.stdout:+hv03.front.sepi 74.6.168.72 3 u 42 64 377 0.092 -2.657 0.731 2024-09-12T12:28:20.589 INFO:teuthology.orchestra.run.smithi165.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-12T12:28:20.590 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T12:28:20.599 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T12:28:20.600 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T12:28:20.608 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T12:28:20.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T12:28:20.624 INFO:teuthology.task.internal:Duration was 1670.936809 seconds 2024-09-12T12:28:20.625 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T12:28:20.635 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T12:28:20.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:28:20.638 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:28:20.748 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T12:28:20.748 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-09-12T12:28:20.748 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:28:20.768 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-09-12T12:28:20.768 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:28:20.789 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T12:28:20.789 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:28:20.817 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:28:20.875 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T12:28:20.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:28:20.901 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:28:20.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T12:28:21.003 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T12:28:21.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:28:21.022 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:28:21.042 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T12:28:21.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:28:21.069 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:28:21.083 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-09-12T12:28:21.105 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-09-12T12:28:21.123 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:28:21.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:28:21.149 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:28:21.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:28:21.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T12:28:21.185 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T12:28:21.186 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704/remote/smithi144 2024-09-12T12:28:21.186 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:28:21.217 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901704/remote/smithi165 2024-09-12T12:28:21.217 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:28:21.245 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T12:28:21.245 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:28:21.257 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:28:21.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T12:28:21.302 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T12:28:21.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T12:28:21.312 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T12:28:21.313 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:28:21.316 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:28:21.321 INFO:teuthology.orchestra.run.smithi144.stdout: 658143 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:28 /home/ubuntu/cephtest 2024-09-12T12:28:21.344 INFO:teuthology.orchestra.run.smithi165.stdout: 655428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:28 /home/ubuntu/cephtest 2024-09-12T12:28:21.346 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T12:28:21.356 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T12:28:21.381 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} duration: 1670.9368088245392 failure_reason: 'Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=283aa0a93d1e4517823525da5c13aeaf status: fail success: false 2024-09-12T12:28:21.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T12:28:21.498 INFO:teuthology.run:FAIL